-- Logs begin at Wed 2022-08-24 09:17:46 UTC, end at Wed 2022-08-24 11:52:14 UTC. -- Aug 24 10:00:19.404936 n-d-849328-3 systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 10:00:19.414156 n-d-849328-3 devstack@n-api.service[106528]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 10:00:19.416148 n-d-849328-3 devstack@n-api.service[106528]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 10:00:19 2022] *** Aug 24 10:00:19.416148 n-d-849328-3 devstack@n-api.service[106528]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 10:00:19.416148 n-d-849328-3 devstack@n-api.service[106528]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 10:00:19.416148 n-d-849328-3 devstack@n-api.service[106528]: nodename: n-d-849328-3 Aug 24 10:00:19.416148 n-d-849328-3 devstack@n-api.service[106528]: machine: x86_64 Aug 24 10:00:19.416148 n-d-849328-3 devstack@n-api.service[106528]: clock source: unix Aug 24 10:00:19.416148 n-d-849328-3 devstack@n-api.service[106528]: pcre jit disabled Aug 24 10:00:19.416148 n-d-849328-3 devstack@n-api.service[106528]: detected number of CPU cores: 4 Aug 24 10:00:19.416148 n-d-849328-3 devstack@n-api.service[106528]: current working directory: / Aug 24 10:00:19.416148 n-d-849328-3 devstack@n-api.service[106528]: detected binary path: /usr/bin/uwsgi-core Aug 24 10:00:19.416715 n-d-849328-3 devstack@n-api.service[106528]: your processes number limit is 47680 Aug 24 10:00:19.416715 n-d-849328-3 devstack@n-api.service[106528]: your memory page size is 4096 bytes Aug 24 10:00:19.416715 n-d-849328-3 devstack@n-api.service[106528]: detected max file descriptor number: 2048 Aug 24 10:00:19.416715 n-d-849328-3 devstack@n-api.service[106528]: lock engine: pthread robust mutexes Aug 24 10:00:19.416715 n-d-849328-3 devstack@n-api.service[106528]: thunder lock: enabled Aug 24 10:00:19.416715 n-d-849328-3 devstack@n-api.service[106528]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 10:00:19.416715 n-d-849328-3 devstack@n-api.service[106528]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 10:00:19.455642 n-d-849328-3 devstack@n-api.service[106528]: Python main interpreter initialized at 0x56477884b9c0 Aug 24 10:00:19.455642 n-d-849328-3 devstack@n-api.service[106528]: python threads support enabled Aug 24 10:00:19.455642 n-d-849328-3 devstack@n-api.service[106528]: your server socket listen backlog is limited to 100 connections Aug 24 10:00:19.455642 n-d-849328-3 devstack@n-api.service[106528]: your mercy for graceful operations on workers is 90 seconds Aug 24 10:00:19.456032 n-d-849328-3 devstack@n-api.service[106528]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 10:00:19.456032 n-d-849328-3 devstack@n-api.service[106528]: *** Operational MODE: preforking *** Aug 24 10:00:19.456328 n-d-849328-3 devstack@n-api.service[106528]: *** uWSGI is running in multiple interpreter mode *** Aug 24 10:00:19.456328 n-d-849328-3 devstack@n-api.service[106528]: spawned uWSGI master process (pid: 106528) Aug 24 10:00:19.456494 n-d-849328-3 systemd[1]: Started Devstack devstack@n-api.service. Aug 24 10:00:19.457952 n-d-849328-3 devstack@n-api.service[106528]: spawned uWSGI worker 1 (pid: 106540, cores: 1) Aug 24 10:00:19.457952 n-d-849328-3 devstack@n-api.service[106528]: spawned uWSGI worker 2 (pid: 106541, cores: 1) Aug 24 10:00:19.457952 n-d-849328-3 devstack@n-api.service[106528]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 10:00:20.119979 n-d-849328-3 devstack@n-api.service[106541]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 10:00:20.143157 n-d-849328-3 devstack@n-api.service[106540]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 10:00:21.189627 n-d-849328-3 devstack@n-api.service[106541]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:00:21.189627 n-d-849328-3 devstack@n-api.service[106541]: from cryptography.utils import int_from_bytes Aug 24 10:00:21.190287 n-d-849328-3 devstack@n-api.service[106540]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:00:21.190287 n-d-849328-3 devstack@n-api.service[106540]: from cryptography.utils import int_from_bytes Aug 24 10:00:21.190725 n-d-849328-3 devstack@n-api.service[106541]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:00:21.190725 n-d-849328-3 devstack@n-api.service[106541]: from cryptography.utils import int_from_bytes Aug 24 10:00:21.190844 n-d-849328-3 devstack@n-api.service[106540]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:00:21.190844 n-d-849328-3 devstack@n-api.service[106540]: from cryptography.utils import int_from_bytes Aug 24 10:00:23.617513 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 10:00:23.618199 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 10:00:23.618286 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 10:00:23.618481 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 10:00:23.618900 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 10:00:23.618997 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 10:00:23.619083 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 10:00:23.619229 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 10:00:23.619326 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.619573 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.619712 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 10:00:23.619796 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 10:00:23.619862 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.620189 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.620319 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.620487 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.620593 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.620809 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.620956 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.621093 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.621226 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.621469 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.621599 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.621772 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.621905 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.622001 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.622086 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.622341 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.622464 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.622611 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-849328-3 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.622722 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.622936 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.623079 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.623241 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.623371 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.623541 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.623672 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-849328-3 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.623845 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.623977 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.624147 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.624277 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.624414 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.624505 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.624737 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.624876 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.625024 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.625239 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.625348 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.626423 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.626563 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.626563 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.626750 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.626850 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.626939 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.627017 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.627093 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.627168 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.627259 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.627343 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.627420 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.627492 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.627610 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.627745 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.627922 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.628084 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.628240 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.628354 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.628548 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.628671 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-849328-3 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.628861 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.628971 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.629159 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.629338 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.629561 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.629656 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-849328-3 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.629874 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.629969 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.630183 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.630276 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.630488 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.630622 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.630836 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.630923 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.631154 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.631250 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.631453 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.631549 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.631770 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.631858 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.632080 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.632171 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.632381 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.632477 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.632689 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.632777 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.632981 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.633075 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.633311 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.633440 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.633616 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.633714 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.633913 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.634000 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.634231 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.634324 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.634527 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.634615 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.634772 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.634859 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.635073 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.635162 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.635387 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.635474 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.635622 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.635716 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.635922 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.636009 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.636227 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.636315 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.636456 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.636549 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.636766 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.636857 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.637061 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.637166 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.637334 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.637421 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.637653 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.637746 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.637969 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.638053 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.638265 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.638420 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.638569 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.638686 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.638867 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.638966 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.639162 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.639258 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.639461 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.639556 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.639763 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.639870 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.640065 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.640166 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.640365 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.640460 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.640664 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.640767 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.640973 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.641075 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.641317 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.641414 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.641620 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.641726 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.641915 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.642016 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.642245 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.642340 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.642555 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.642675 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.642856 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.642955 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.643168 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.643259 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.643483 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.643569 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.643784 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.643867 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.644079 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.644193 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.644381 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.644489 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.644694 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.644786 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.644993 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.645083 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.645322 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.645414 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.645565 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.645663 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.645861 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.645955 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.646161 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.646246 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.646466 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.646549 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.646763 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.646846 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.647060 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.647145 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.647356 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.647439 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.647653 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.647758 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.647948 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.648031 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.648243 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.648329 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.648534 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.648627 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.648829 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.648915 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.649137 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.649224 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.649452 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.649544 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.649808 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.649897 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.650109 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.650194 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.650408 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.650505 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.650708 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.650799 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.651009 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.651109 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.651305 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.651389 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.651604 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.651687 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.651903 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.652000 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.652202 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.652295 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.652505 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.652587 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.652800 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.652882 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.653099 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.653356 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.653439 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.653561 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.653727 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.653813 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.654020 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.654111 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.654327 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.654423 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.654625 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.654715 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.654920 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.655011 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.655225 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.655313 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.655518 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.655607 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.655815 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.655898 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.656120 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.656211 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.656412 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.656495 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.656704 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.656795 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.656998 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.657090 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.657320 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.657405 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.657616 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.657701 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.657910 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.657992 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.658201 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.658297 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.658495 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.658577 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.658782 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.658866 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.659073 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.659165 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.659370 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.659464 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.659663 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.659748 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.659959 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.660049 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.660255 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.660348 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.660563 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.660646 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.660864 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.660956 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.661184 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.661272 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.661500 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:00:23.661595 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.661832 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.661917 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.662154 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.662237 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.662479 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.662569 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.662789 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.662874 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.663089 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.663171 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.663399 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.663482 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.663719 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.663803 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.664021 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.664105 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.664323 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.664422 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.664626 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.664709 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.664931 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.665027 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.665285 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.665395 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.665592 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.665688 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.665900 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.665992 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.666206 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.666290 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.666516 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.666605 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.666817 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.666901 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.667125 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.667218 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.667436 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.667527 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.667741 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.667825 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.668038 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.668134 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.668361 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.668443 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.668675 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.668792 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.668982 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.669084 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.669323 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.669407 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.669640 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.669732 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.669945 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.670042 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.670248 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.670332 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.670551 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.670642 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.670863 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.670947 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.671169 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.671253 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.671477 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.671561 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.671786 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.671870 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.672093 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.672177 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.672399 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.672483 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.672701 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.672786 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.673344 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.673429 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.673648 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.673767 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.673953 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.674041 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.674261 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.674345 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.674568 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.674660 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.674872 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.674955 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.675182 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.675275 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.675488 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.675646 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.675794 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.675885 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.676096 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.676187 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.676395 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.676488 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.676693 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.676777 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.676987 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.677070 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.677312 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.677409 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.677610 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.677692 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.677907 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.677989 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.678213 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.678311 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.678512 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.678596 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.678824 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.678902 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.679120 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.679211 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.679423 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.679507 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.679726 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.679809 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.680029 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.680127 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.680327 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.680411 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.680632 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.680715 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.680984 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.681083 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.681313 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.681398 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.681625 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.681709 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.681933 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.682019 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.682240 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.682325 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.682560 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.682652 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.682858 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.682947 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.683156 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.683239 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.683465 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.683560 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.683768 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.683885 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.684070 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.684170 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.684372 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.684465 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.684676 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.684759 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.684984 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.685067 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.685316 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.685404 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.685620 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.685712 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.685938 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.686022 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.686248 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.686333 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.686543 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.686626 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.686861 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.686952 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.687178 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.687262 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.687475 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.687557 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.687771 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.687853 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.688073 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.688166 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.688373 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.688456 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.688675 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.688759 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.688973 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.689058 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.689296 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.689381 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.689597 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.689691 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.689894 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.689990 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.690189 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.690279 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.690485 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.690585 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.690782 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.690865 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.691083 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.691167 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.691380 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.691472 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.691674 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.691757 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.691970 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.692051 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.692270 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.692362 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.692572 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.692661 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.692872 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.692968 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.693201 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.693301 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.693542 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.693626 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.693843 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.693962 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.694153 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.694245 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.694459 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.694543 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.694768 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.694857 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.695072 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.695156 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.695376 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.695460 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.695682 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.695765 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.695987 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.696077 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.696295 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.696379 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.696619 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.696755 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.696926 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.697009 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.697249 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.697344 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.697566 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.697662 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.697867 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.697949 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.698174 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.698256 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.698467 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.698557 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.698773 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.698857 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.699088 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.699179 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.699390 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.699486 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.699702 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.699787 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.700014 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.700097 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.700320 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.700404 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.700626 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.700710 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.700928 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.701019 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.701263 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.701352 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.701573 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.701700 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.701877 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.701968 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.702183 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.702267 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.702485 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.702570 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.702789 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.702871 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.703086 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.703169 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.703395 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.703477 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.703695 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.703790 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.704001 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.704087 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.704293 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.704413 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.704598 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.704695 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.704907 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.704990 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.705233 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.705319 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.705542 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.705638 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.705850 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.705934 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.706162 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.706245 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.706464 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.706557 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.706766 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.706853 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.707065 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.707149 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.707361 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.707453 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.707660 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.707745 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.707961 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.708044 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.708263 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.708348 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.708561 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.708645 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.708861 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.708944 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.709173 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.709260 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.709481 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.709565 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.709783 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.709865 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.710074 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.710160 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.710370 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.710460 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.710670 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.710752 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.710971 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.711057 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.711268 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.711350 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.711574 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.711666 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.711887 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.711990 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.712236 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.712345 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.712535 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.712637 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.712848 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.712944 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.713161 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.713246 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.713461 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.713555 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.713757 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.713849 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.714054 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.714175 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.714355 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.714447 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.714659 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.714743 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.714959 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.715049 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.715269 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.715357 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.715584 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.715666 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.715880 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.715962 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.716187 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.716272 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.716488 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.716579 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.716787 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.716906 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.717097 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.717241 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.717425 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.717519 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.717727 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.717810 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.718029 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.718119 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.718331 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.718422 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.718632 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.718716 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.718933 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.719018 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.719240 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.719364 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.719537 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.719628 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.719835 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.719919 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.720137 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.720220 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.720434 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.720525 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.720735 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.720819 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.721040 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.721141 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.721367 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.721628 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.721715 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.721956 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.722049 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.722267 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.722527 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.722626 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.722861 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.722953 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.723177 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.723261 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.723494 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.723580 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.723812 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.723896 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.724128 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.724212 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.724429 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.724539 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.724733 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.724818 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.725032 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.725142 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.725356 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.725450 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.725660 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.725754 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.725960 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.726052 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.726259 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.726343 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.726555 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.726640 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.726856 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.726940 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.727155 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.727245 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.727454 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.727540 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.727771 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.727875 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.728073 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.728155 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.728374 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.728459 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.728668 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.728749 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.728965 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.729047 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.729285 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.729370 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.729590 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.729672 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.729888 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.729986 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.730186 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.730270 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.730479 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.730560 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.730775 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.730869 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.731078 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.731161 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.731377 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.731460 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.731678 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.731770 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.732014 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.732099 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.732321 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.732405 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.732628 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.732711 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.732925 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.733008 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.733272 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.733371 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.733573 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.733658 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.733870 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.733953 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.734168 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.734253 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.734475 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.734600 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.734771 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.734866 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.735060 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.735143 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.735363 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.735447 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.735664 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.735750 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.735958 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.736050 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.736259 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.736342 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.736556 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.736640 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.736855 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.736947 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.737169 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.737266 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.737469 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.737560 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.737768 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.737864 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.738062 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.738145 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.738354 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.738444 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.738656 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.738749 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.738951 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.739033 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.739241 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.739332 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.739584 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.739678 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.739837 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.739921 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.740131 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.740215 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.740427 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.740512 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.740723 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.740806 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.741015 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.741097 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.741341 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.741428 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.741641 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.741724 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.741932 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.742014 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.742239 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.742323 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.742541 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.742624 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.742837 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.742934 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.743138 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.743221 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.743486 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.743570 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.743781 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.743873 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.744077 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.744160 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.744377 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.744497 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.744678 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.744814 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.744981 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.745067 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.745309 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.745404 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.745629 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.745722 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.745942 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.746027 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.746236 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.746318 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.746532 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.746617 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.746827 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.746918 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.747118 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.747237 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.747412 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.747503 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.747704 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.747788 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.747998 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.748082 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.748288 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.748379 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.748584 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.748666 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.748882 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.748965 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.749207 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.749312 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.749504 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.749593 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.749802 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.749896 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.750099 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.750182 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.750400 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.750484 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.750699 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.750792 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.751033 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.751114 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.751330 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.751412 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.751635 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.751725 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.751939 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.752023 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.752243 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.752326 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.752546 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.752643 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.752843 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.752928 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.753164 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.753250 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.753469 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.753570 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.753767 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.753850 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.754060 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.754143 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.754357 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.754449 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.754661 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.754756 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.754963 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.755058 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.755258 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.755344 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.755569 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.755654 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.755874 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.755957 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.756180 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.756265 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.756471 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.756555 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.756771 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.756863 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.757076 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.757192 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.757404 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.757489 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.757706 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.757842 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.758003 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.758095 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.758305 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.758398 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.758603 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.758694 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.758905 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.758988 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.759232 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.759322 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.759534 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.759629 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.759829 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.759913 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.760130 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.760214 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.760431 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.760525 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.760726 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.760811 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.761027 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.761112 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.761356 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.761446 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.761652 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.761736 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.761953 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.762058 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.762267 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.762378 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.762546 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.762636 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.762838 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.762920 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.763134 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.763258 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.763439 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.763563 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.763739 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.763866 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.764158 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.764249 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.764457 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.764541 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.764758 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.764850 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.765055 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.765168 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.765382 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.765466 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.765681 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.765784 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.765990 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.766075 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.766301 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.766392 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.766603 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.766697 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.766954 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.767037 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.767251 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.767343 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.767546 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.767639 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.767847 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.767931 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.768161 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.768245 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.768458 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.768543 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.768752 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.768836 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.769048 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.769157 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.769380 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.769466 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.769673 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.769757 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.769971 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.770065 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.770290 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.770374 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.770591 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.770675 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.770908 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.770992 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.771319 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.771404 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.771623 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.771708 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.771922 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.772014 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.772237 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.772324 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.772549 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.772640 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.772865 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.772958 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.773189 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.773277 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.773496 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.773579 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.773798 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.773893 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.774113 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.774205 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.774429 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.774513 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.774782 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.774870 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.775090 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.775232 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.775389 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.775475 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.775697 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.775781 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.776004 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.776108 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.776303 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.776387 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.776616 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.776706 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.776931 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.777016 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.777264 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.777353 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.777584 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.777668 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.777953 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.778044 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.778276 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.778361 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.778578 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.778662 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.778877 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.778970 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.779183 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.779267 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.779483 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.779568 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.779785 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.779871 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.780090 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.780177 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.780386 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.780482 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.780688 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.780772 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.780989 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.781079 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.781323 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.781423 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.781622 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.781707 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.781921 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.782013 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.782230 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.782323 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.782525 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.782608 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.782827 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.782911 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.783140 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.783231 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.783444 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.783529 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.783758 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.783840 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.784058 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.784143 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.784371 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.784463 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.784669 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.784752 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.784967 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.785053 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.785293 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.785396 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.785592 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.785679 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.785895 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.785980 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.786197 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.786281 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.786499 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.786585 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.786815 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.786899 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.787125 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.787215 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.787425 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.787523 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.787749 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.787835 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.788067 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.788151 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.788372 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.788469 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.788682 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.788766 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.789002 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.789093 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.789329 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.789430 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.789628 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.789720 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.789930 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.790015 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.790248 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.790348 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.790547 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.790632 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.790842 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.790927 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.791140 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.791232 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.791433 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.791516 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.791730 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.791814 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.792025 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.792109 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.792326 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.792415 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.792623 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.792706 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.792918 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.793002 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.793249 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.793348 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.793548 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.793634 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.793848 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.793936 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.794143 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.794228 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.794440 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.794533 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.794743 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.794829 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.795042 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.795126 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.795351 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.795454 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.795664 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.795757 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.795974 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.796059 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.796276 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.796369 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.796579 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.796662 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.796885 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.796969 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.797214 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.797315 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.797523 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.797609 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.798129 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.798219 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.798434 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.798518 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.798743 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.798827 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.799048 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.799131 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.799351 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.799436 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.799664 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.799855 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.799978 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.800177 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.800291 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.800484 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.800788 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.800873 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.801091 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.801197 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.801423 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.801519 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.801732 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.801825 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.802032 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.802125 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.802335 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.802422 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.802637 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.802724 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.802939 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.803036 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.803245 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.803331 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.803550 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.803635 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.803856 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.803953 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.804180 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.804264 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.804487 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.804571 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.804796 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.804883 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.805106 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.805225 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.805440 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.805551 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.805752 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.805905 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.806112 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.806199 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.806414 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.806508 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.806722 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.806807 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.807031 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.807115 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.807338 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.807431 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.807642 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.807726 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.807944 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.808028 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.808249 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.808337 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.808554 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.808646 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.808852 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.808943 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.809194 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.809283 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.809507 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.809592 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.809816 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.809909 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.810122 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.810208 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.810431 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.810519 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.810741 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.810835 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.811048 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.811139 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.811356 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.811441 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.811665 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.811764 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.811976 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.812177 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.812294 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.812486 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.812609 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.812812 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.813171 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.813300 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.813467 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.813550 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.813777 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.813876 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.814089 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.814174 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.814412 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.814496 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.814709 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.814793 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.815006 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.815090 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.815311 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.815409 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.815616 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.815712 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.815913 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.815998 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.816218 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.816301 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.816519 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.816604 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.816818 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.816901 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.817135 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.817220 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.817455 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.817542 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.817756 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.817981 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.818066 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.818321 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.818408 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.818636 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.818876 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.818970 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.819215 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.819313 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.819534 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.819619 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.819843 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.819934 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.820163 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.820257 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.820460 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.820543 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.820759 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.820843 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.821070 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.821175 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.821398 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.821501 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.821717 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.821806 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.822018 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.822111 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.822321 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.822405 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.822619 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.822711 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.822914 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.822998 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.823220 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.823312 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.823514 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.823606 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.823816 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.823900 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.824115 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.824199 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.824413 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.824505 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.824706 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.824790 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.825009 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.825094 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.825334 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.825433 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.825694 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.825790 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.825926 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.826020 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.826220 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.826313 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.826521 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.826604 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.826813 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.826897 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.827112 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.827203 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.827405 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.827490 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.827703 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.827794 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.827995 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.828090 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.828293 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.828377 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.828586 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.828676 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.828884 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.828969 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.829202 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.829302 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.829501 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.829592 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.829820 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.829906 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.830122 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.830213 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.830432 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.830560 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.830741 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.830826 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.831044 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.831128 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.831358 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.831449 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.831666 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.831752 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.831973 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.832188 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.832319 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.832515 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.832634 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.832830 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.833185 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.833283 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.833512 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.833606 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.833814 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.833900 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.834113 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.834196 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.834409 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.834511 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.834725 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.834810 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.835026 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.835116 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.835325 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.835410 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.835625 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.835714 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.835928 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.836016 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.836228 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.836313 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.836528 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.836614 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.836830 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.836913 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.837194 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.837298 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.837503 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.837595 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.837802 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.837887 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.838105 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.838190 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.838404 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.838496 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.838705 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.838798 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.839003 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.839087 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.839303 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.839394 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.839607 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.839700 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.839912 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.839997 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.840223 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.840307 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.840579 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.840721 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.840839 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.840924 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.841165 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.841252 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.841475 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.841561 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.841781 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.841875 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.842083 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.842175 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.842387 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.842480 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.842696 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.842780 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.843001 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.843093 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.843302 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.843389 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.843626 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.843719 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.843937 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.844035 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.844245 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.844330 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.844607 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.844691 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.844912 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.845009 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.845257 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.845347 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.845574 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.845701 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.845880 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.845978 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.846194 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.846280 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.846497 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.846590 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.846805 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.846890 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.847123 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.847214 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.847435 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.847519 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.847753 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.847838 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.848053 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.848144 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.848355 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.848448 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.848654 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.848740 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.848956 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.849040 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.849297 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.849396 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.849601 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.849684 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.849898 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.849988 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.850198 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.850295 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.850503 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.850588 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.850801 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.850885 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.851098 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.851194 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.851395 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.851480 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.851691 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.851775 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.851991 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.852083 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.852290 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.852375 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.852588 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.852672 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.852918 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.853004 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.853246 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.853345 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.853547 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.853633 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.853845 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.853942 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.854146 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.854232 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.854446 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.854538 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.854745 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.854841 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.855049 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.855134 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.855346 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.855437 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.855645 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.855763 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.855946 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.856079 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.856245 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.856339 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.856545 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.856630 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.856875 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.856958 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.857207 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.857310 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.857526 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.857611 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.857833 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.857926 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.858140 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.858236 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.858453 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.858536 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.858759 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.858843 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.859057 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.859148 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.859380 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.859463 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.859679 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.859762 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.859983 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.860075 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.860284 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.860374 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.860586 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.860670 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.860888 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.860974 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.861214 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.861302 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.861522 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.861605 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.861827 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.861913 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.862136 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.862246 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.862454 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.862566 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.862766 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.862859 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.863067 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.863158 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.863383 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.863483 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.863687 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.863788 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.863999 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.864089 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.864302 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.864402 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.864604 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.864716 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.864904 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.864994 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.865239 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.865344 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.865543 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.865628 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.865848 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.865932 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.866154 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.866249 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.866458 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.866542 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.866762 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.866846 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.867066 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.867159 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.867374 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.867466 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.867686 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.867779 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.867984 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.868069 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.868303 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.868429 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.868671 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.868765 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.868991 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.869084 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.869327 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.869430 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.869652 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.869746 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.869971 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.870055 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.870281 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.870365 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.870586 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.870684 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.870885 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.870977 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.871123 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 10:00:23.871215 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.871517 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.871820 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:00:23.872065 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 10:00:24.024338 n-d-849328-3 devstack@n-api.service[106540]: INFO dbcounter [None req-c0798b22-a35b-4b20-9f51-bd9088c7da22 None None] Registered counter for database nova_api Aug 24 10:00:24.024537 n-d-849328-3 devstack@n-api.service[106541]: INFO dbcounter [None req-6998c08d-0d6a-48e9-9209-b2cc4b11060f None None] Registered counter for database nova_api Aug 24 10:00:24.046235 n-d-849328-3 devstack@n-api.service[106540]: DEBUG oslo_db.sqlalchemy.engines [None req-c0798b22-a35b-4b20-9f51-bd9088c7da22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106540) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:00:24.049773 n-d-849328-3 devstack@n-api.service[106541]: DEBUG oslo_db.sqlalchemy.engines [None req-6998c08d-0d6a-48e9-9209-b2cc4b11060f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106541) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:00:24.052976 n-d-849328-3 devstack@n-api.service[106540]: DEBUG dbcounter [-] [106540] Writer thread running {{(pid=106540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:00:24.057089 n-d-849328-3 devstack@n-api.service[106541]: DEBUG dbcounter [-] [106541] Writer thread running {{(pid=106541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:00:24.107644 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.context [None req-c0798b22-a35b-4b20-9f51-bd9088c7da22 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e852a9c4-5bbb-4a78-aec0-794708e7e59e(cell1) {{(pid=106540) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 10:00:24.111482 n-d-849328-3 devstack@n-api.service[106540]: DEBUG oslo_concurrency.lockutils [None req-c0798b22-a35b-4b20-9f51-bd9088c7da22 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:00:24.111648 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.context [None req-6998c08d-0d6a-48e9-9209-b2cc4b11060f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e852a9c4-5bbb-4a78-aec0-794708e7e59e(cell1) {{(pid=106541) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 10:00:24.111935 n-d-849328-3 devstack@n-api.service[106540]: DEBUG oslo_concurrency.lockutils [None req-c0798b22-a35b-4b20-9f51-bd9088c7da22 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:00:24.113532 n-d-849328-3 devstack@n-api.service[106540]: DEBUG oslo_concurrency.lockutils [None req-c0798b22-a35b-4b20-9f51-bd9088c7da22 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:00:24.114246 n-d-849328-3 devstack@n-api.service[106540]: DEBUG oslo_concurrency.lockutils [None req-c0798b22-a35b-4b20-9f51-bd9088c7da22 None None] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:00:24.114680 n-d-849328-3 devstack@n-api.service[106540]: DEBUG oslo_concurrency.lockutils [None req-c0798b22-a35b-4b20-9f51-bd9088c7da22 None None] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:00:24.115464 n-d-849328-3 devstack@n-api.service[106541]: DEBUG oslo_concurrency.lockutils [None req-6998c08d-0d6a-48e9-9209-b2cc4b11060f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:00:24.115954 n-d-849328-3 devstack@n-api.service[106541]: DEBUG oslo_concurrency.lockutils [None req-6998c08d-0d6a-48e9-9209-b2cc4b11060f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:00:24.116642 n-d-849328-3 devstack@n-api.service[106540]: DEBUG oslo_concurrency.lockutils [None req-c0798b22-a35b-4b20-9f51-bd9088c7da22 None None] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:00:24.117524 n-d-849328-3 devstack@n-api.service[106541]: DEBUG oslo_concurrency.lockutils [None req-6998c08d-0d6a-48e9-9209-b2cc4b11060f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:00:24.118242 n-d-849328-3 devstack@n-api.service[106541]: DEBUG oslo_concurrency.lockutils [None req-6998c08d-0d6a-48e9-9209-b2cc4b11060f None None] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:00:24.118680 n-d-849328-3 devstack@n-api.service[106540]: INFO dbcounter [None req-c0798b22-a35b-4b20-9f51-bd9088c7da22 None None] Registered counter for database nova_cell0 Aug 24 10:00:24.118828 n-d-849328-3 devstack@n-api.service[106541]: DEBUG oslo_concurrency.lockutils [None req-6998c08d-0d6a-48e9-9209-b2cc4b11060f None None] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:00:24.120691 n-d-849328-3 devstack@n-api.service[106541]: DEBUG oslo_concurrency.lockutils [None req-6998c08d-0d6a-48e9-9209-b2cc4b11060f None None] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:00:24.123045 n-d-849328-3 devstack@n-api.service[106541]: INFO dbcounter [None req-6998c08d-0d6a-48e9-9209-b2cc4b11060f None None] Registered counter for database nova_cell0 Aug 24 10:00:24.124018 n-d-849328-3 devstack@n-api.service[106540]: INFO dbcounter [None req-c0798b22-a35b-4b20-9f51-bd9088c7da22 None None] Registered counter for database nova_cell1 Aug 24 10:00:24.128347 n-d-849328-3 devstack@n-api.service[106541]: INFO dbcounter [None req-6998c08d-0d6a-48e9-9209-b2cc4b11060f None None] Registered counter for database nova_cell1 Aug 24 10:00:24.131382 n-d-849328-3 devstack@n-api.service[106540]: DEBUG oslo_db.sqlalchemy.engines [None req-c0798b22-a35b-4b20-9f51-bd9088c7da22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106540) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:00:24.133664 n-d-849328-3 devstack@n-api.service[106540]: DEBUG oslo_db.sqlalchemy.engines [None req-c0798b22-a35b-4b20-9f51-bd9088c7da22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106540) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:00:24.136778 n-d-849328-3 devstack@n-api.service[106541]: DEBUG oslo_db.sqlalchemy.engines [None req-6998c08d-0d6a-48e9-9209-b2cc4b11060f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106541) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:00:24.139279 n-d-849328-3 devstack@n-api.service[106540]: DEBUG dbcounter [-] [106540] Writer thread running {{(pid=106540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:00:24.141645 n-d-849328-3 devstack@n-api.service[106540]: DEBUG dbcounter [-] [106540] Writer thread running {{(pid=106540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:00:24.142000 n-d-849328-3 devstack@n-api.service[106541]: DEBUG dbcounter [-] [106541] Writer thread running {{(pid=106541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:00:24.142626 n-d-849328-3 devstack@n-api.service[106541]: DEBUG oslo_db.sqlalchemy.engines [None req-6998c08d-0d6a-48e9-9209-b2cc4b11060f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106541) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:00:24.280431 n-d-849328-3 devstack@n-api.service[106541]: DEBUG dbcounter [-] [106541] Writer thread running {{(pid=106541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:00:24.281999 n-d-849328-3 devstack@n-api.service[106540]: INFO dbcounter [None req-c0798b22-a35b-4b20-9f51-bd9088c7da22 None None] Registered counter for database nova_cell0 Aug 24 10:00:24.289671 n-d-849328-3 devstack@n-api.service[106541]: INFO dbcounter [None req-6998c08d-0d6a-48e9-9209-b2cc4b11060f None None] Registered counter for database nova_cell0 Aug 24 10:00:24.291251 n-d-849328-3 devstack@n-api.service[106540]: DEBUG oslo_db.sqlalchemy.engines [None req-c0798b22-a35b-4b20-9f51-bd9088c7da22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106540) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:00:24.296834 n-d-849328-3 devstack@n-api.service[106540]: DEBUG dbcounter [-] [106540] Writer thread running {{(pid=106540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:00:24.298970 n-d-849328-3 devstack@n-api.service[106541]: DEBUG oslo_db.sqlalchemy.engines [None req-6998c08d-0d6a-48e9-9209-b2cc4b11060f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106541) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:00:24.303488 n-d-849328-3 devstack@n-api.service[106541]: DEBUG dbcounter [-] [106541] Writer thread running {{(pid=106541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:00:24.631896 n-d-849328-3 devstack@n-api.service[106540]: WARNING keystonemiddleware.auth_token [None req-c0798b22-a35b-4b20-9f51-bd9088c7da22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 10:00:24.632565 n-d-849328-3 devstack@n-api.service[106541]: WARNING keystonemiddleware.auth_token [None req-6998c08d-0d6a-48e9-9209-b2cc4b11060f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 10:00:24.639121 n-d-849328-3 devstack@n-api.service[106540]: WARNING keystonemiddleware.auth_token [None req-c0798b22-a35b-4b20-9f51-bd9088c7da22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 10:00:24.639850 n-d-849328-3 devstack@n-api.service[106541]: WARNING keystonemiddleware.auth_token [None req-6998c08d-0d6a-48e9-9209-b2cc4b11060f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 10:00:24.976656 n-d-849328-3 devstack@n-api.service[106540]: WARNING keystonemiddleware.auth_token [None req-c0798b22-a35b-4b20-9f51-bd9088c7da22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 10:00:24.980655 n-d-849328-3 devstack@n-api.service[106541]: WARNING keystonemiddleware.auth_token [None req-6998c08d-0d6a-48e9-9209-b2cc4b11060f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 10:00:24.982719 n-d-849328-3 devstack@n-api.service[106540]: WARNING keystonemiddleware.auth_token [None req-c0798b22-a35b-4b20-9f51-bd9088c7da22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 10:00:24.986608 n-d-849328-3 devstack@n-api.service[106541]: WARNING keystonemiddleware.auth_token [None req-6998c08d-0d6a-48e9-9209-b2cc4b11060f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 10:00:24.987949 n-d-849328-3 devstack@n-api.service[106540]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56477884b9c0 pid: 106540 (default app) Aug 24 10:00:24.990033 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-c0798b22-a35b-4b20-9f51-bd9088c7da22 None None] Calling method '>' {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:24.991201 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-c0798b22-a35b-4b20-9f51-bd9088c7da22 None None] 10.222.0.85 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001739 Aug 24 10:00:24.991959 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 1/1] 10.222.0.85 () {50 vars in 788 bytes} [Wed Aug 24 10:00:24 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:24.992081 n-d-849328-3 devstack@n-api.service[106541]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56477884b9c0 pid: 106541 (default app) Aug 24 10:01:42.775101 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-c0798b22-a35b-4b20-9f51-bd9088c7da22 None None] Calling method '>' {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:42.776411 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-c0798b22-a35b-4b20-9f51-bd9088c7da22 None None] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001834 Aug 24 10:01:42.776902 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 2/2] 10.222.0.85 () {54 vars in 931 bytes} [Wed Aug 24 10:01:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:42.789652 n-d-849328-3 devstack@n-api.service[106541]: DEBUG dbcounter [-] [106541] Writing DB stats nova_api:SELECT=3 {{(pid=106541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:42.790940 n-d-849328-3 devstack@n-api.service[106541]: DEBUG dbcounter [-] [106541] Writing DB stats nova_cell0:SELECT=3 {{(pid=106541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:42.792256 n-d-849328-3 devstack@n-api.service[106541]: DEBUG dbcounter [-] [106541] Writing DB stats nova_cell1:SELECT=3 {{(pid=106541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:42.793661 n-d-849328-3 devstack@n-api.service[106541]: DEBUG dbcounter [-] [106541] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:43.638133 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-d8ba268c-58a1-4714-87a6-dded7605a4ce admin admin] Calling method '>' {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:43.670082 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-d8ba268c-58a1-4714-87a6-dded7605a4ce admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.886166 Aug 24 10:01:43.670913 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 1/3] 10.222.0.85 () {60 vars in 1292 bytes} [Wed Aug 24 10:01:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:01:46.011520 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-c0798b22-a35b-4b20-9f51-bd9088c7da22 None None] Calling method '>' {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:46.012607 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-c0798b22-a35b-4b20-9f51-bd9088c7da22 None None] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 24 10:01:46.013197 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 3/4] 10.222.0.85 () {54 vars in 931 bytes} [Wed Aug 24 10:01:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:46.457733 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-88540a90-93f1-4126-9bee-f864d00f71c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "c1", "name": "cirros256"}} {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:01:46.477371 n-d-849328-3 devstack@n-api.service[106541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:01:46.477371 n-d-849328-3 devstack@n-api.service[106541]: warnings.warn(msg) Aug 24 10:01:46.518864 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-88540a90-93f1-4126-9bee-f864d00f71c6 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.497423 Aug 24 10:01:46.521517 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 2/5] 10.222.0.85 () {64 vars in 1283 bytes} [Wed Aug 24 10:01:46 2022] POST /compute/v2.1/flavors => generated 407 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:01:46.742484 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-efc1569d-7589-4de2-ac7f-e2074b7d9bcc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:01:46.747115 n-d-849328-3 devstack@n-api.service[106540]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:01:46.747115 n-d-849328-3 devstack@n-api.service[106540]: warnings.warn(msg) Aug 24 10:01:46.750446 n-d-849328-3 devstack@n-api.service[106540]: DEBUG dbcounter [-] [106540] Writing DB stats nova_api:SELECT=3 {{(pid=106540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:46.751487 n-d-849328-3 devstack@n-api.service[106540]: DEBUG dbcounter [-] [106540] Writing DB stats nova_cell0:SELECT=3 {{(pid=106540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:46.752565 n-d-849328-3 devstack@n-api.service[106540]: DEBUG dbcounter [-] [106540] Writing DB stats nova_cell1:SELECT=3 {{(pid=106540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:46.753483 n-d-849328-3 devstack@n-api.service[106540]: DEBUG dbcounter [-] [106540] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:46.816794 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-efc1569d-7589-4de2-ac7f-e2074b7d9bcc admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288814 Aug 24 10:01:46.817421 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 4/6] 10.222.0.85 () {64 vars in 1336 bytes} [Wed Aug 24 10:01:46 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:01:49.204570 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-88540a90-93f1-4126-9bee-f864d00f71c6 admin admin] Calling method '>' {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:49.208622 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-88540a90-93f1-4126-9bee-f864d00f71c6 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001697 Aug 24 10:01:49.208622 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 3/7] 10.222.0.85 () {54 vars in 931 bytes} [Wed Aug 24 10:01:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:49.946754 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-d5790358-36d2-4c76-aeb7-b81c31fe57b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "name": "ds512M", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d1", "swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:01:49.972735 n-d-849328-3 devstack@n-api.service[106540]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:01:49.972735 n-d-849328-3 devstack@n-api.service[106540]: warnings.warn(msg) Aug 24 10:01:49.993220 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-d5790358-36d2-4c76-aeb7-b81c31fe57b6 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.779698 Aug 24 10:01:49.994238 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 5/8] 10.222.0.85 () {64 vars in 1283 bytes} [Wed Aug 24 10:01:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:01:50.006267 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-753a648d-28cc-485e-bd67-061d024a4573 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:01:50.009256 n-d-849328-3 devstack@n-api.service[106541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:01:50.009256 n-d-849328-3 devstack@n-api.service[106541]: warnings.warn(msg) Aug 24 10:01:50.045877 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-753a648d-28cc-485e-bd67-061d024a4573 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043322 Aug 24 10:01:50.046590 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 4/9] 10.222.0.85 () {64 vars in 1336 bytes} [Wed Aug 24 10:01:50 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:01:52.678496 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-d5790358-36d2-4c76-aeb7-b81c31fe57b6 admin admin] Calling method '>' {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:52.680455 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-d5790358-36d2-4c76-aeb7-b81c31fe57b6 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002389 Aug 24 10:01:52.685980 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 6/10] 10.222.0.85 () {54 vars in 931 bytes} [Wed Aug 24 10:01:52 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:53.138216 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-3299be29-0daf-4137-b150-d7f3b7d85d2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d2", "vcpus": 1, "disk": 10, "swap": 0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 1024}} {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:01:53.161180 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-3299be29-0daf-4137-b150-d7f3b7d85d2c admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.473557 Aug 24 10:01:53.170203 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 5/11] 10.222.0.85 () {64 vars in 1283 bytes} [Wed Aug 24 10:01:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:01:53.178814 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-a3816099-18b3-4493-808e-615dff990dd5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:01:53.219583 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-a3816099-18b3-4493-808e-615dff990dd5 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044695 Aug 24 10:01:53.229229 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 7/12] 10.222.0.85 () {64 vars in 1336 bytes} [Wed Aug 24 10:01:53 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:01:55.636153 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-3299be29-0daf-4137-b150-d7f3b7d85d2c admin admin] Calling method '>' {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:55.637191 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-3299be29-0daf-4137-b150-d7f3b7d85d2c admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Aug 24 10:01:55.637594 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 6/13] 10.222.0.85 () {54 vars in 931 bytes} [Wed Aug 24 10:01:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:56.166282 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-bffe8d7b-ec81-4f1b-8d17-6b27202335c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "vcpus": 2, "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "name": "ds2G", "disk": 10}} {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:01:56.190367 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-bffe8d7b-ec81-4f1b-8d17-6b27202335c1 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.545961 Aug 24 10:01:56.193208 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 8/14] 10.222.0.85 () {64 vars in 1283 bytes} [Wed Aug 24 10:01:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:01:56.203472 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-461a38ea-5c77-46a7-aba2-b51c6281f6b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:01:56.232098 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-461a38ea-5c77-46a7-aba2-b51c6281f6b1 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032604 Aug 24 10:01:56.233324 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 7/15] 10.222.0.85 () {64 vars in 1336 bytes} [Wed Aug 24 10:01:56 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:01:58.633751 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-bffe8d7b-ec81-4f1b-8d17-6b27202335c1 admin admin] Calling method '>' {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:58.635032 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-bffe8d7b-ec81-4f1b-8d17-6b27202335c1 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001904 Aug 24 10:01:58.635871 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 9/16] 10.222.0.85 () {54 vars in 931 bytes} [Wed Aug 24 10:01:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:59.283355 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-b8095089-45c1-4005-9ae3-d7871abab45c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "swap": 0, "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 4, "name": "ds4G"}} {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:01:59.314183 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-b8095089-45c1-4005-9ae3-d7871abab45c admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.672332 Aug 24 10:01:59.327830 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-fce08acb-3ca5-4567-b944-2a613f30b87d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:01:59.333521 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 8/17] 10.222.0.85 () {64 vars in 1283 bytes} [Wed Aug 24 10:01:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:01:59.357264 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-fce08acb-3ca5-4567-b944-2a613f30b87d admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033264 Aug 24 10:01:59.369150 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 10/18] 10.222.0.85 () {64 vars in 1336 bytes} [Wed Aug 24 10:01:59 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:02:01.762512 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-b8095089-45c1-4005-9ae3-d7871abab45c admin admin] Calling method '>' {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:01.764221 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-b8095089-45c1-4005-9ae3-d7871abab45c admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002312 Aug 24 10:02:01.769823 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 9/19] 10.222.0.85 () {54 vars in 931 bytes} [Wed Aug 24 10:02:01 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:02.189708 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-1b979444-f0ba-41a5-820b-b0f593510f58 admin admin] Calling method '>' {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:02.215012 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-1b979444-f0ba-41a5-820b-b0f593510f58 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.443445 Aug 24 10:02:02.221519 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 11/20] 10.222.0.85 () {60 vars in 1292 bytes} [Wed Aug 24 10:02:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:02:04.670725 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-b8095089-45c1-4005-9ae3-d7871abab45c admin admin] Calling method '>' {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:04.672139 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-b8095089-45c1-4005-9ae3-d7871abab45c admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002024 Aug 24 10:02:04.672692 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 10/21] 10.222.0.85 () {54 vars in 931 bytes} [Wed Aug 24 10:02:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:05.166735 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-d05b212c-f6e1-417d-92a3-7ed3a1c12b12 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "id": "1", "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny"}} {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:02:05.187470 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-d05b212c-f6e1-417d-92a3-7ed3a1c12b12 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.505842 Aug 24 10:02:05.189164 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 12/22] 10.222.0.85 () {64 vars in 1283 bytes} [Wed Aug 24 10:02:04 2022] POST /compute/v2.1/flavors => generated 402 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:02:05.203935 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-91b77976-22c1-4dc7-a94a-0168854f1523 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:02:05.236548 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-91b77976-22c1-4dc7-a94a-0168854f1523 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038005 Aug 24 10:02:05.237295 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 11/23] 10.222.0.85 () {64 vars in 1333 bytes} [Wed Aug 24 10:02:05 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:02:08.293874 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-d05b212c-f6e1-417d-92a3-7ed3a1c12b12 admin admin] Calling method '>' {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:08.294889 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-d05b212c-f6e1-417d-92a3-7ed3a1c12b12 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Aug 24 10:02:08.295288 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 13/24] 10.222.0.85 () {54 vars in 931 bytes} [Wed Aug 24 10:02:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:08.756476 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-d164be08-3ad8-4c89-b7b1-f60dca5c0147 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.small", "vcpus": 1, "ram": 2048}} {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:02:08.782616 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-d164be08-3ad8-4c89-b7b1-f60dca5c0147 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.479000 Aug 24 10:02:08.783611 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 12/25] 10.222.0.85 () {64 vars in 1283 bytes} [Wed Aug 24 10:02:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:02:08.799708 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-6a69475a-016d-4060-b937-c668feabb6f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:02:08.826507 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-6a69475a-016d-4060-b937-c668feabb6f8 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030834 Aug 24 10:02:08.827205 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 14/26] 10.222.0.85 () {64 vars in 1333 bytes} [Wed Aug 24 10:02:08 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:02:11.165462 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-d164be08-3ad8-4c89-b7b1-f60dca5c0147 admin admin] Calling method '>' {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:11.166498 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-d164be08-3ad8-4c89-b7b1-f60dca5c0147 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Aug 24 10:02:11.166934 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 13/27] 10.222.0.85 () {54 vars in 931 bytes} [Wed Aug 24 10:02:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:11.543517 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-71d20695-a355-4dd0-84f4-2c41d75eef7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "ram": 4096, "id": "3", "swap": 0, "vcpus": 2, "disk": 40, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:02:11.562200 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-71d20695-a355-4dd0-84f4-2c41d75eef7b admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.389046 Aug 24 10:02:11.562732 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 15/28] 10.222.0.85 () {64 vars in 1283 bytes} [Wed Aug 24 10:02:11 2022] POST /compute/v2.1/flavors => generated 406 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:02:11.575022 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-faae85d4-25bb-4751-b301-361778110ed5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:02:11.599699 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-faae85d4-25bb-4751-b301-361778110ed5 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028523 Aug 24 10:02:11.600276 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 14/29] 10.222.0.85 () {64 vars in 1333 bytes} [Wed Aug 24 10:02:11 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:02:13.975509 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-71d20695-a355-4dd0-84f4-2c41d75eef7b admin admin] Calling method '>' {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:13.976655 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-71d20695-a355-4dd0-84f4-2c41d75eef7b admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001632 Aug 24 10:02:13.977104 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 16/30] 10.222.0.85 () {54 vars in 931 bytes} [Wed Aug 24 10:02:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:14.515075 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-bdff7dda-1d16-481f-ba99-a8323f10d56e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "rxtx_factor": 1.0, "id": "4", "disk": 80, "vcpus": 4}} {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:02:14.523589 n-d-849328-3 devstack@n-api.service[106541]: DEBUG dbcounter [-] [106541] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:14.536857 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-bdff7dda-1d16-481f-ba99-a8323f10d56e admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.553261 Aug 24 10:02:14.537734 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 15/31] 10.222.0.85 () {64 vars in 1283 bytes} [Wed Aug 24 10:02:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:02:14.551170 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-8a7eb023-be41-4cb6-9cd3-4462b557eaa3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:02:14.578197 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-8a7eb023-be41-4cb6-9cd3-4462b557eaa3 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030965 Aug 24 10:02:14.585398 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 17/32] 10.222.0.85 () {64 vars in 1333 bytes} [Wed Aug 24 10:02:14 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:02:16.934373 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-bdff7dda-1d16-481f-ba99-a8323f10d56e admin admin] Calling method '>' {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:16.936015 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-bdff7dda-1d16-481f-ba99-a8323f10d56e admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002084 Aug 24 10:02:16.936415 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 16/33] 10.222.0.85 () {54 vars in 931 bytes} [Wed Aug 24 10:02:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:17.390195 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-e088fa07-ac3d-41c5-90ea-d4e26e6c629e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "name": "m1.xlarge", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "5", "vcpus": 8, "ram": 16384}} {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:02:17.396668 n-d-849328-3 devstack@n-api.service[106540]: DEBUG dbcounter [-] [106540] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:17.414811 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-e088fa07-ac3d-41c5-90ea-d4e26e6c629e admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.472289 Aug 24 10:02:17.415387 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 18/34] 10.222.0.85 () {64 vars in 1283 bytes} [Wed Aug 24 10:02:16 2022] POST /compute/v2.1/flavors => generated 408 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:02:17.429267 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-c47b353a-4181-43f2-becd-7effd0f45360 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:02:17.457659 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-c47b353a-4181-43f2-becd-7effd0f45360 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031958 Aug 24 10:02:17.458253 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 17/35] 10.222.0.85 () {64 vars in 1333 bytes} [Wed Aug 24 10:02:17 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:02:39.532314 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-e088fa07-ac3d-41c5-90ea-d4e26e6c629e admin admin] Calling method '>' {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:39.533359 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-e088fa07-ac3d-41c5-90ea-d4e26e6c629e admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 24 10:02:39.533757 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 19/36] 10.222.0.85 () {54 vars in 931 bytes} [Wed Aug 24 10:02:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:39.544437 n-d-849328-3 devstack@n-api.service[106541]: DEBUG dbcounter [-] [106541] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:39.959409 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-2c536f73-71ff-4b5b-acfb-f70f7ecfec8f admin admin] Calling method '>' {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:39.979050 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-2c536f73-71ff-4b5b-acfb-f70f7ecfec8f admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.439095 Aug 24 10:02:39.979595 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 18/37] 10.222.0.85 () {60 vars in 1292 bytes} [Wed Aug 24 10:02:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:02:41.048948 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-e088fa07-ac3d-41c5-90ea-d4e26e6c629e admin admin] Calling method '>' {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:41.050295 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-e088fa07-ac3d-41c5-90ea-d4e26e6c629e admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002257 Aug 24 10:02:41.050818 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 20/38] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Aug 24 10:02:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:41.627543 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-664def58-8f51-4f92-9849-39b6651b578d admin admin] Calling method '>' {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:41.633536 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.wsgi [None req-664def58-8f51-4f92-9849-39b6651b578d admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 10:02:41.636971 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-664def58-8f51-4f92-9849-39b6651b578d admin admin] Request method failure captured: Aug 24 10:02:41.636971 n-d-849328-3 devstack@n-api.service[106541]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 10:02:41.636971 n-d-849328-3 devstack@n-api.service[106541]: Accept: application/json Aug 24 10:02:41.636971 n-d-849328-3 devstack@n-api.service[106541]: Accept-Encoding: gzip, deflate Aug 24 10:02:41.636971 n-d-849328-3 devstack@n-api.service[106541]: Connection: keep-alive Aug 24 10:02:41.636971 n-d-849328-3 devstack@n-api.service[106541]: Content-Length: 0 Aug 24 10:02:41.636971 n-d-849328-3 devstack@n-api.service[106541]: Host: 10.222.0.85 Aug 24 10:02:41.636971 n-d-849328-3 devstack@n-api.service[106541]: Openstack-Api-Version: compute 2.90 Aug 24 10:02:41.636971 n-d-849328-3 devstack@n-api.service[106541]: Openstack-System-Scope: None Aug 24 10:02:41.636971 n-d-849328-3 devstack@n-api.service[106541]: User-Agent: python-novaclient Aug 24 10:02:41.636971 n-d-849328-3 devstack@n-api.service[106541]: X-Auth-Token: gAAAAABjBfdApoSmOoViO2WmjqJGkbpjAljiKvzfqY4NprkZ1RZ11UB9vR25an_pOu7DABOJlG8DYC7d3fwuZPDglgAstW-mXPZ2gA5gxXTWsjqpoexACHU4wAzi3IHqJrvUrdDGsFGZUP0kkrGmnWFPbsFFCiHPq6vR3hM1C5E-MGgCGgEvQDA Aug 24 10:02:41.636971 n-d-849328-3 devstack@n-api.service[106541]: X-Domain-Id: None Aug 24 10:02:41.636971 n-d-849328-3 devstack@n-api.service[106541]: X-Domain-Name: None Aug 24 10:02:41.636971 n-d-849328-3 devstack@n-api.service[106541]: X-Identity-Status: Confirmed Aug 24 10:02:41.636971 n-d-849328-3 devstack@n-api.service[106541]: X-Is-Admin-Project: True Aug 24 10:02:41.636971 n-d-849328-3 devstack@n-api.service[106541]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 10:02:41.636971 n-d-849328-3 devstack@n-api.service[106541]: X-Project-Domain-Id: default Aug 24 10:02:41.636971 n-d-849328-3 devstack@n-api.service[106541]: X-Project-Domain-Name: Default Aug 24 10:02:41.636971 n-d-849328-3 devstack@n-api.service[106541]: X-Project-Id: 9c085b1e8bfa4e7da352bc5ca21e9539 Aug 24 10:02:41.636971 n-d-849328-3 devstack@n-api.service[106541]: X-Project-Name: admin Aug 24 10:02:41.636971 n-d-849328-3 devstack@n-api.service[106541]: X-Role: reader,admin,member Aug 24 10:02:41.636971 n-d-849328-3 devstack@n-api.service[106541]: X-Roles: reader,admin,member Aug 24 10:02:41.638688 n-d-849328-3 devstack@n-api.service[106541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9c085b1e8bfa4e7da352bc5ca21e9539"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9c085b1e8bfa4e7da352bc5ca21e9539", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9c085b1e8bfa4e7da352bc5ca21e9539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9c085b1e8bfa4e7da352bc5ca21e9539"}]}] Aug 24 10:02:41.638688 n-d-849328-3 devstack@n-api.service[106541]: X-Tenant: admin Aug 24 10:02:41.638688 n-d-849328-3 devstack@n-api.service[106541]: X-Tenant-Id: 9c085b1e8bfa4e7da352bc5ca21e9539 Aug 24 10:02:41.638688 n-d-849328-3 devstack@n-api.service[106541]: X-Tenant-Name: admin Aug 24 10:02:41.638688 n-d-849328-3 devstack@n-api.service[106541]: X-User: admin Aug 24 10:02:41.638688 n-d-849328-3 devstack@n-api.service[106541]: X-User-Domain-Id: default Aug 24 10:02:41.638688 n-d-849328-3 devstack@n-api.service[106541]: X-User-Domain-Name: Default Aug 24 10:02:41.638688 n-d-849328-3 devstack@n-api.service[106541]: X-User-Id: 77da4814acab479ab2ce4398ac301961 Aug 24 10:02:41.638688 n-d-849328-3 devstack@n-api.service[106541]: X-User-Name: admin Aug 24 10:02:41.638688 n-d-849328-3 devstack@n-api.service[106541]: method: > Aug 24 10:02:41.638688 n-d-849328-3 devstack@n-api.service[106541]: exception: Flavor 42 could not be found. Aug 24 10:02:41.638688 n-d-849328-3 devstack@n-api.service[106541]: action_args: {'id': '42'} Aug 24 10:02:41.638688 n-d-849328-3 devstack@n-api.service[106541]: {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:02:41.638688 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:02:41.639760 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 10:02:41.639760 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 10:02:41.639760 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 10:02:41.639760 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 10:02:41.639760 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:02:41.639760 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:02:41.639760 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 10:02:41.639760 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 10:02:41.639760 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 10:02:41.639760 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:02:41.639760 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 10:02:41.639760 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 10:02:41.639760 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 10:02:41.639760 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi Aug 24 10:02:41.639760 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:02:41.639760 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi Aug 24 10:02:41.639760 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:02:41.639760 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:02:41.639760 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:02:41.641215 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:02:41.641215 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:02:41.641215 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:02:41.641215 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:02:41.641215 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 10:02:41.641215 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:02:41.641215 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 10:02:41.641215 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi Aug 24 10:02:41.641215 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:02:41.641215 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi Aug 24 10:02:41.641215 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:02:41.641215 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:02:41.641215 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:02:41.641215 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:02:41.641215 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:02:41.641215 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 10:02:41.641215 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi Aug 24 10:02:41.641215 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-664def58-8f51-4f92-9849-39b6651b578d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:02:41.642569 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-664def58-8f51-4f92-9849-39b6651b578d admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.431207 Aug 24 10:02:41.642569 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 19/39] 10.222.0.85 () {60 vars in 1190 bytes} [Wed Aug 24 10:02:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 433 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 10:02:41.648299 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-72aaa9e1-f7e1-4f7c-86b6-16d6bdcbc618 admin admin] Calling method '>' {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:41.671107 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-72aaa9e1-f7e1-4f7c-86b6-16d6bdcbc618 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026362 Aug 24 10:02:41.671645 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 21/40] 10.222.0.85 () {60 vars in 1210 bytes} [Wed Aug 24 10:02:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:02:41.682267 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-bf22a327-16ad-4c70-ab70-9b3312c00a00 admin admin] Calling method '>' {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:41.706182 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-bf22a327-16ad-4c70-ab70-9b3312c00a00 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027505 Aug 24 10:02:41.706724 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 20/41] 10.222.0.85 () {60 vars in 1210 bytes} [Wed Aug 24 10:02:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:02:41.716820 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-3c8ba660-9d34-400f-bda4-f05640c9abc8 admin admin] Calling method '>' {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:41.722743 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.wsgi [None req-3c8ba660-9d34-400f-bda4-f05640c9abc8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 10:02:41.725998 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-3c8ba660-9d34-400f-bda4-f05640c9abc8 admin admin] Request method failure captured: Aug 24 10:02:41.725998 n-d-849328-3 devstack@n-api.service[106540]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 10:02:41.725998 n-d-849328-3 devstack@n-api.service[106540]: Accept: application/json Aug 24 10:02:41.725998 n-d-849328-3 devstack@n-api.service[106540]: Accept-Encoding: gzip, deflate Aug 24 10:02:41.725998 n-d-849328-3 devstack@n-api.service[106540]: Connection: keep-alive Aug 24 10:02:41.725998 n-d-849328-3 devstack@n-api.service[106540]: Content-Length: 0 Aug 24 10:02:41.725998 n-d-849328-3 devstack@n-api.service[106540]: Host: 10.222.0.85 Aug 24 10:02:41.725998 n-d-849328-3 devstack@n-api.service[106540]: Openstack-Api-Version: compute 2.90 Aug 24 10:02:41.725998 n-d-849328-3 devstack@n-api.service[106540]: Openstack-System-Scope: None Aug 24 10:02:41.725998 n-d-849328-3 devstack@n-api.service[106540]: User-Agent: python-novaclient Aug 24 10:02:41.725998 n-d-849328-3 devstack@n-api.service[106540]: X-Auth-Token: gAAAAABjBfdApoSmOoViO2WmjqJGkbpjAljiKvzfqY4NprkZ1RZ11UB9vR25an_pOu7DABOJlG8DYC7d3fwuZPDglgAstW-mXPZ2gA5gxXTWsjqpoexACHU4wAzi3IHqJrvUrdDGsFGZUP0kkrGmnWFPbsFFCiHPq6vR3hM1C5E-MGgCGgEvQDA Aug 24 10:02:41.725998 n-d-849328-3 devstack@n-api.service[106540]: X-Domain-Id: None Aug 24 10:02:41.725998 n-d-849328-3 devstack@n-api.service[106540]: X-Domain-Name: None Aug 24 10:02:41.725998 n-d-849328-3 devstack@n-api.service[106540]: X-Identity-Status: Confirmed Aug 24 10:02:41.725998 n-d-849328-3 devstack@n-api.service[106540]: X-Is-Admin-Project: True Aug 24 10:02:41.725998 n-d-849328-3 devstack@n-api.service[106540]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 10:02:41.725998 n-d-849328-3 devstack@n-api.service[106540]: X-Project-Domain-Id: default Aug 24 10:02:41.725998 n-d-849328-3 devstack@n-api.service[106540]: X-Project-Domain-Name: Default Aug 24 10:02:41.725998 n-d-849328-3 devstack@n-api.service[106540]: X-Project-Id: 9c085b1e8bfa4e7da352bc5ca21e9539 Aug 24 10:02:41.725998 n-d-849328-3 devstack@n-api.service[106540]: X-Project-Name: admin Aug 24 10:02:41.725998 n-d-849328-3 devstack@n-api.service[106540]: X-Role: reader,admin,member Aug 24 10:02:41.725998 n-d-849328-3 devstack@n-api.service[106540]: X-Roles: reader,admin,member Aug 24 10:02:41.727547 n-d-849328-3 devstack@n-api.service[106540]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9c085b1e8bfa4e7da352bc5ca21e9539"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9c085b1e8bfa4e7da352bc5ca21e9539", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9c085b1e8bfa4e7da352bc5ca21e9539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9c085b1e8bfa4e7da352bc5ca21e9539"}]}] Aug 24 10:02:41.727547 n-d-849328-3 devstack@n-api.service[106540]: X-Tenant: admin Aug 24 10:02:41.727547 n-d-849328-3 devstack@n-api.service[106540]: X-Tenant-Id: 9c085b1e8bfa4e7da352bc5ca21e9539 Aug 24 10:02:41.727547 n-d-849328-3 devstack@n-api.service[106540]: X-Tenant-Name: admin Aug 24 10:02:41.727547 n-d-849328-3 devstack@n-api.service[106540]: X-User: admin Aug 24 10:02:41.727547 n-d-849328-3 devstack@n-api.service[106540]: X-User-Domain-Id: default Aug 24 10:02:41.727547 n-d-849328-3 devstack@n-api.service[106540]: X-User-Domain-Name: Default Aug 24 10:02:41.727547 n-d-849328-3 devstack@n-api.service[106540]: X-User-Id: 77da4814acab479ab2ce4398ac301961 Aug 24 10:02:41.727547 n-d-849328-3 devstack@n-api.service[106540]: X-User-Name: admin Aug 24 10:02:41.727547 n-d-849328-3 devstack@n-api.service[106540]: method: > Aug 24 10:02:41.727547 n-d-849328-3 devstack@n-api.service[106540]: exception: Flavor 42 could not be found. Aug 24 10:02:41.727547 n-d-849328-3 devstack@n-api.service[106540]: action_args: {'id': '42'} Aug 24 10:02:41.727547 n-d-849328-3 devstack@n-api.service[106540]: {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:02:41.727547 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:02:41.728609 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 10:02:41.728609 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 10:02:41.728609 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 10:02:41.728609 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 10:02:41.728609 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:02:41.728609 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:02:41.728609 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 10:02:41.728609 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 10:02:41.728609 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 10:02:41.728609 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:02:41.728609 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 10:02:41.728609 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 10:02:41.728609 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 10:02:41.728609 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi Aug 24 10:02:41.728609 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:02:41.728609 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi Aug 24 10:02:41.728609 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:02:41.728609 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:02:41.728609 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:02:41.729929 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:02:41.729929 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:02:41.729929 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:02:41.729929 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:02:41.729929 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 10:02:41.729929 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:02:41.729929 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 10:02:41.729929 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi Aug 24 10:02:41.729929 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:02:41.729929 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi Aug 24 10:02:41.729929 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:02:41.729929 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:02:41.729929 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:02:41.729929 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:02:41.729929 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:02:41.729929 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 10:02:41.729929 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi Aug 24 10:02:41.729929 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-3c8ba660-9d34-400f-bda4-f05640c9abc8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:02:41.731143 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-3c8ba660-9d34-400f-bda4-f05640c9abc8 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014199 Aug 24 10:02:41.731143 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 22/42] 10.222.0.85 () {60 vars in 1190 bytes} [Wed Aug 24 10:02:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 10:02:42.688621 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-bf22a327-16ad-4c70-ab70-9b3312c00a00 admin admin] Calling method '>' {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:42.689708 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-bf22a327-16ad-4c70-ab70-9b3312c00a00 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001880 Aug 24 10:02:42.690374 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 21/43] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Aug 24 10:02:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:43.262160 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-eb8b5931-1ef8-4f32-9908-0c6fd64b59f9 admin admin] Calling method '>' {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:43.268242 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.wsgi [None req-eb8b5931-1ef8-4f32-9908-0c6fd64b59f9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 10:02:43.269796 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-eb8b5931-1ef8-4f32-9908-0c6fd64b59f9 admin admin] Request method failure captured: Aug 24 10:02:43.269796 n-d-849328-3 devstack@n-api.service[106540]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 10:02:43.269796 n-d-849328-3 devstack@n-api.service[106540]: Accept: application/json Aug 24 10:02:43.269796 n-d-849328-3 devstack@n-api.service[106540]: Accept-Encoding: gzip, deflate Aug 24 10:02:43.269796 n-d-849328-3 devstack@n-api.service[106540]: Connection: keep-alive Aug 24 10:02:43.269796 n-d-849328-3 devstack@n-api.service[106540]: Content-Length: 0 Aug 24 10:02:43.269796 n-d-849328-3 devstack@n-api.service[106540]: Host: 10.222.0.85 Aug 24 10:02:43.269796 n-d-849328-3 devstack@n-api.service[106540]: Openstack-Api-Version: compute 2.90 Aug 24 10:02:43.269796 n-d-849328-3 devstack@n-api.service[106540]: Openstack-System-Scope: None Aug 24 10:02:43.269796 n-d-849328-3 devstack@n-api.service[106540]: User-Agent: python-novaclient Aug 24 10:02:43.269796 n-d-849328-3 devstack@n-api.service[106540]: X-Auth-Token: gAAAAABjBfdCkBQSB-hkxNXKY9mvHLSPV9ZdwBmkbXT2AY3BLubUT9UaJ841EZPrbp9ZQ4O_ZW_27VxffSLsa_LyguNgBKV0k88bl1yCIHVU8oAH4PdlsRvc9rLQ_2Se2nVMyK3RlWDKUkOHzihaXcQNCQ0PoTw0dclrTaI00bth-Cb3_EbNnHE Aug 24 10:02:43.269796 n-d-849328-3 devstack@n-api.service[106540]: X-Domain-Id: None Aug 24 10:02:43.269796 n-d-849328-3 devstack@n-api.service[106540]: X-Domain-Name: None Aug 24 10:02:43.269796 n-d-849328-3 devstack@n-api.service[106540]: X-Identity-Status: Confirmed Aug 24 10:02:43.269796 n-d-849328-3 devstack@n-api.service[106540]: X-Is-Admin-Project: True Aug 24 10:02:43.269796 n-d-849328-3 devstack@n-api.service[106540]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 10:02:43.269796 n-d-849328-3 devstack@n-api.service[106540]: X-Project-Domain-Id: default Aug 24 10:02:43.269796 n-d-849328-3 devstack@n-api.service[106540]: X-Project-Domain-Name: Default Aug 24 10:02:43.269796 n-d-849328-3 devstack@n-api.service[106540]: X-Project-Id: 9c085b1e8bfa4e7da352bc5ca21e9539 Aug 24 10:02:43.269796 n-d-849328-3 devstack@n-api.service[106540]: X-Project-Name: admin Aug 24 10:02:43.269796 n-d-849328-3 devstack@n-api.service[106540]: X-Role: reader,admin,member Aug 24 10:02:43.269796 n-d-849328-3 devstack@n-api.service[106540]: X-Roles: reader,admin,member Aug 24 10:02:43.271397 n-d-849328-3 devstack@n-api.service[106540]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9c085b1e8bfa4e7da352bc5ca21e9539"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9c085b1e8bfa4e7da352bc5ca21e9539", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9c085b1e8bfa4e7da352bc5ca21e9539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9c085b1e8bfa4e7da352bc5ca21e9539"}]}] Aug 24 10:02:43.271397 n-d-849328-3 devstack@n-api.service[106540]: X-Tenant: admin Aug 24 10:02:43.271397 n-d-849328-3 devstack@n-api.service[106540]: X-Tenant-Id: 9c085b1e8bfa4e7da352bc5ca21e9539 Aug 24 10:02:43.271397 n-d-849328-3 devstack@n-api.service[106540]: X-Tenant-Name: admin Aug 24 10:02:43.271397 n-d-849328-3 devstack@n-api.service[106540]: X-User: admin Aug 24 10:02:43.271397 n-d-849328-3 devstack@n-api.service[106540]: X-User-Domain-Id: default Aug 24 10:02:43.271397 n-d-849328-3 devstack@n-api.service[106540]: X-User-Domain-Name: Default Aug 24 10:02:43.271397 n-d-849328-3 devstack@n-api.service[106540]: X-User-Id: 77da4814acab479ab2ce4398ac301961 Aug 24 10:02:43.271397 n-d-849328-3 devstack@n-api.service[106540]: X-User-Name: admin Aug 24 10:02:43.271397 n-d-849328-3 devstack@n-api.service[106540]: method: > Aug 24 10:02:43.271397 n-d-849328-3 devstack@n-api.service[106540]: exception: Flavor 84 could not be found. Aug 24 10:02:43.271397 n-d-849328-3 devstack@n-api.service[106540]: action_args: {'id': '84'} Aug 24 10:02:43.271397 n-d-849328-3 devstack@n-api.service[106540]: {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:02:43.271397 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:02:43.274003 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 10:02:43.274003 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 10:02:43.274003 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 10:02:43.274003 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 10:02:43.274003 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:02:43.274003 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:02:43.274003 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 10:02:43.274003 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 10:02:43.274003 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 10:02:43.274003 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:02:43.274003 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 10:02:43.274003 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 10:02:43.274003 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 10:02:43.274003 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi Aug 24 10:02:43.274003 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:02:43.274003 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi Aug 24 10:02:43.274003 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:02:43.274003 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:02:43.274003 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:02:43.275348 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:02:43.275348 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:02:43.275348 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:02:43.275348 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:02:43.275348 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 10:02:43.275348 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:02:43.275348 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 10:02:43.275348 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi Aug 24 10:02:43.275348 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:02:43.275348 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi Aug 24 10:02:43.275348 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:02:43.275348 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:02:43.275348 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:02:43.275348 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:02:43.275348 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:02:43.275348 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 10:02:43.275348 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi Aug 24 10:02:43.275348 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-eb8b5931-1ef8-4f32-9908-0c6fd64b59f9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:02:43.276736 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-eb8b5931-1ef8-4f32-9908-0c6fd64b59f9 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.438102 Aug 24 10:02:43.276736 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 23/44] 10.222.0.85 () {60 vars in 1190 bytes} [Wed Aug 24 10:02:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 439 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 10:02:43.281644 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-53071b1c-ff5d-4a9d-8cc4-c15bd87b6d39 admin admin] Calling method '>' {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:43.296473 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-53071b1c-ff5d-4a9d-8cc4-c15bd87b6d39 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018428 Aug 24 10:02:43.297024 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 22/45] 10.222.0.85 () {60 vars in 1210 bytes} [Wed Aug 24 10:02:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:02:43.306924 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-94cdb5c7-5fea-432e-8b25-0657622bd861 admin admin] Calling method '>' {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:43.323961 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-94cdb5c7-5fea-432e-8b25-0657622bd861 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020638 Aug 24 10:02:43.324513 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 24/46] 10.222.0.85 () {60 vars in 1210 bytes} [Wed Aug 24 10:02:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:02:43.333979 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-8c185d31-58ec-4481-b05b-fd8dae53049f admin admin] Calling method '>' {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:43.339729 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.wsgi [None req-8c185d31-58ec-4481-b05b-fd8dae53049f admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 10:02:43.341277 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-8c185d31-58ec-4481-b05b-fd8dae53049f admin admin] Request method failure captured: Aug 24 10:02:43.341277 n-d-849328-3 devstack@n-api.service[106541]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 10:02:43.341277 n-d-849328-3 devstack@n-api.service[106541]: Accept: application/json Aug 24 10:02:43.341277 n-d-849328-3 devstack@n-api.service[106541]: Accept-Encoding: gzip, deflate Aug 24 10:02:43.341277 n-d-849328-3 devstack@n-api.service[106541]: Connection: keep-alive Aug 24 10:02:43.341277 n-d-849328-3 devstack@n-api.service[106541]: Content-Length: 0 Aug 24 10:02:43.341277 n-d-849328-3 devstack@n-api.service[106541]: Host: 10.222.0.85 Aug 24 10:02:43.341277 n-d-849328-3 devstack@n-api.service[106541]: Openstack-Api-Version: compute 2.90 Aug 24 10:02:43.341277 n-d-849328-3 devstack@n-api.service[106541]: Openstack-System-Scope: None Aug 24 10:02:43.341277 n-d-849328-3 devstack@n-api.service[106541]: User-Agent: python-novaclient Aug 24 10:02:43.341277 n-d-849328-3 devstack@n-api.service[106541]: X-Auth-Token: gAAAAABjBfdCkBQSB-hkxNXKY9mvHLSPV9ZdwBmkbXT2AY3BLubUT9UaJ841EZPrbp9ZQ4O_ZW_27VxffSLsa_LyguNgBKV0k88bl1yCIHVU8oAH4PdlsRvc9rLQ_2Se2nVMyK3RlWDKUkOHzihaXcQNCQ0PoTw0dclrTaI00bth-Cb3_EbNnHE Aug 24 10:02:43.341277 n-d-849328-3 devstack@n-api.service[106541]: X-Domain-Id: None Aug 24 10:02:43.341277 n-d-849328-3 devstack@n-api.service[106541]: X-Domain-Name: None Aug 24 10:02:43.341277 n-d-849328-3 devstack@n-api.service[106541]: X-Identity-Status: Confirmed Aug 24 10:02:43.341277 n-d-849328-3 devstack@n-api.service[106541]: X-Is-Admin-Project: True Aug 24 10:02:43.341277 n-d-849328-3 devstack@n-api.service[106541]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 10:02:43.341277 n-d-849328-3 devstack@n-api.service[106541]: X-Project-Domain-Id: default Aug 24 10:02:43.341277 n-d-849328-3 devstack@n-api.service[106541]: X-Project-Domain-Name: Default Aug 24 10:02:43.341277 n-d-849328-3 devstack@n-api.service[106541]: X-Project-Id: 9c085b1e8bfa4e7da352bc5ca21e9539 Aug 24 10:02:43.341277 n-d-849328-3 devstack@n-api.service[106541]: X-Project-Name: admin Aug 24 10:02:43.341277 n-d-849328-3 devstack@n-api.service[106541]: X-Role: reader,admin,member Aug 24 10:02:43.341277 n-d-849328-3 devstack@n-api.service[106541]: X-Roles: reader,admin,member Aug 24 10:02:43.342781 n-d-849328-3 devstack@n-api.service[106541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9c085b1e8bfa4e7da352bc5ca21e9539"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9c085b1e8bfa4e7da352bc5ca21e9539", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9c085b1e8bfa4e7da352bc5ca21e9539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9c085b1e8bfa4e7da352bc5ca21e9539"}]}] Aug 24 10:02:43.342781 n-d-849328-3 devstack@n-api.service[106541]: X-Tenant: admin Aug 24 10:02:43.342781 n-d-849328-3 devstack@n-api.service[106541]: X-Tenant-Id: 9c085b1e8bfa4e7da352bc5ca21e9539 Aug 24 10:02:43.342781 n-d-849328-3 devstack@n-api.service[106541]: X-Tenant-Name: admin Aug 24 10:02:43.342781 n-d-849328-3 devstack@n-api.service[106541]: X-User: admin Aug 24 10:02:43.342781 n-d-849328-3 devstack@n-api.service[106541]: X-User-Domain-Id: default Aug 24 10:02:43.342781 n-d-849328-3 devstack@n-api.service[106541]: X-User-Domain-Name: Default Aug 24 10:02:43.342781 n-d-849328-3 devstack@n-api.service[106541]: X-User-Id: 77da4814acab479ab2ce4398ac301961 Aug 24 10:02:43.342781 n-d-849328-3 devstack@n-api.service[106541]: X-User-Name: admin Aug 24 10:02:43.342781 n-d-849328-3 devstack@n-api.service[106541]: method: > Aug 24 10:02:43.342781 n-d-849328-3 devstack@n-api.service[106541]: exception: Flavor 84 could not be found. Aug 24 10:02:43.342781 n-d-849328-3 devstack@n-api.service[106541]: action_args: {'id': '84'} Aug 24 10:02:43.342781 n-d-849328-3 devstack@n-api.service[106541]: {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:02:43.342781 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:02:43.343934 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 10:02:43.343934 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 10:02:43.343934 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 10:02:43.343934 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 10:02:43.343934 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:02:43.343934 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:02:43.343934 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 10:02:43.343934 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 10:02:43.343934 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 10:02:43.343934 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:02:43.343934 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 10:02:43.343934 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 10:02:43.343934 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 10:02:43.343934 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi Aug 24 10:02:43.343934 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:02:43.343934 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi Aug 24 10:02:43.343934 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:02:43.343934 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:02:43.343934 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:02:43.345076 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:02:43.345076 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:02:43.345076 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:02:43.345076 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:02:43.345076 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 10:02:43.345076 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:02:43.345076 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 10:02:43.345076 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi Aug 24 10:02:43.345076 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:02:43.345076 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi Aug 24 10:02:43.345076 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:02:43.345076 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:02:43.345076 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:02:43.345076 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:02:43.345076 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:02:43.345076 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 10:02:43.345076 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi Aug 24 10:02:43.345076 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-8c185d31-58ec-4481-b05b-fd8dae53049f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:02:43.346115 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-8c185d31-58ec-4481-b05b-fd8dae53049f admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012227 Aug 24 10:02:43.346115 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 23/47] 10.222.0.85 () {60 vars in 1190 bytes} [Wed Aug 24 10:02:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 10:02:44.307069 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-94cdb5c7-5fea-432e-8b25-0657622bd861 admin admin] Calling method '>' {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:44.308070 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-94cdb5c7-5fea-432e-8b25-0657622bd861 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 24 10:02:44.308489 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 25/48] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Aug 24 10:02:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:44.867575 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-4025fd02-0631-4b32-a3e1-1a48ac846c00 admin admin] Calling method '>' {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:44.873307 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.wsgi [None req-4025fd02-0631-4b32-a3e1-1a48ac846c00 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 10:02:44.874806 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-4025fd02-0631-4b32-a3e1-1a48ac846c00 admin admin] Request method failure captured: Aug 24 10:02:44.874806 n-d-849328-3 devstack@n-api.service[106541]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 10:02:44.874806 n-d-849328-3 devstack@n-api.service[106541]: Accept: application/json Aug 24 10:02:44.874806 n-d-849328-3 devstack@n-api.service[106541]: Accept-Encoding: gzip, deflate Aug 24 10:02:44.874806 n-d-849328-3 devstack@n-api.service[106541]: Connection: keep-alive Aug 24 10:02:44.874806 n-d-849328-3 devstack@n-api.service[106541]: Content-Length: 0 Aug 24 10:02:44.874806 n-d-849328-3 devstack@n-api.service[106541]: Host: 10.222.0.85 Aug 24 10:02:44.874806 n-d-849328-3 devstack@n-api.service[106541]: Openstack-Api-Version: compute 2.90 Aug 24 10:02:44.874806 n-d-849328-3 devstack@n-api.service[106541]: Openstack-System-Scope: None Aug 24 10:02:44.874806 n-d-849328-3 devstack@n-api.service[106541]: User-Agent: python-novaclient Aug 24 10:02:44.874806 n-d-849328-3 devstack@n-api.service[106541]: X-Auth-Token: gAAAAABjBfdE_8g7FkFCmqTi0ybu1iItLEJw7kAvC5UR6mu3Uc1ZLlv8k4L8IcZStghDQV64yqYZITSFhIBTZZcCRn-4d3YRgoTcMPOptzLXKrAy_NxuyG_att_MBn_5_GMkmQoWsP9M0YCXGu-x52-K0EuJ08mRa1ltROdELtLE9xkpSf1nLy0 Aug 24 10:02:44.874806 n-d-849328-3 devstack@n-api.service[106541]: X-Domain-Id: None Aug 24 10:02:44.874806 n-d-849328-3 devstack@n-api.service[106541]: X-Domain-Name: None Aug 24 10:02:44.874806 n-d-849328-3 devstack@n-api.service[106541]: X-Identity-Status: Confirmed Aug 24 10:02:44.874806 n-d-849328-3 devstack@n-api.service[106541]: X-Is-Admin-Project: True Aug 24 10:02:44.874806 n-d-849328-3 devstack@n-api.service[106541]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 10:02:44.874806 n-d-849328-3 devstack@n-api.service[106541]: X-Project-Domain-Id: default Aug 24 10:02:44.874806 n-d-849328-3 devstack@n-api.service[106541]: X-Project-Domain-Name: Default Aug 24 10:02:44.874806 n-d-849328-3 devstack@n-api.service[106541]: X-Project-Id: 9c085b1e8bfa4e7da352bc5ca21e9539 Aug 24 10:02:44.874806 n-d-849328-3 devstack@n-api.service[106541]: X-Project-Name: admin Aug 24 10:02:44.874806 n-d-849328-3 devstack@n-api.service[106541]: X-Role: reader,admin,member Aug 24 10:02:44.874806 n-d-849328-3 devstack@n-api.service[106541]: X-Roles: reader,admin,member Aug 24 10:02:44.876136 n-d-849328-3 devstack@n-api.service[106541]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9c085b1e8bfa4e7da352bc5ca21e9539"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9c085b1e8bfa4e7da352bc5ca21e9539", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9c085b1e8bfa4e7da352bc5ca21e9539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9c085b1e8bfa4e7da352bc5ca21e9539"}]}] Aug 24 10:02:44.876136 n-d-849328-3 devstack@n-api.service[106541]: X-Tenant: admin Aug 24 10:02:44.876136 n-d-849328-3 devstack@n-api.service[106541]: X-Tenant-Id: 9c085b1e8bfa4e7da352bc5ca21e9539 Aug 24 10:02:44.876136 n-d-849328-3 devstack@n-api.service[106541]: X-Tenant-Name: admin Aug 24 10:02:44.876136 n-d-849328-3 devstack@n-api.service[106541]: X-User: admin Aug 24 10:02:44.876136 n-d-849328-3 devstack@n-api.service[106541]: X-User-Domain-Id: default Aug 24 10:02:44.876136 n-d-849328-3 devstack@n-api.service[106541]: X-User-Domain-Name: Default Aug 24 10:02:44.876136 n-d-849328-3 devstack@n-api.service[106541]: X-User-Id: 77da4814acab479ab2ce4398ac301961 Aug 24 10:02:44.876136 n-d-849328-3 devstack@n-api.service[106541]: X-User-Name: admin Aug 24 10:02:44.876136 n-d-849328-3 devstack@n-api.service[106541]: method: > Aug 24 10:02:44.876136 n-d-849328-3 devstack@n-api.service[106541]: exception: Flavor 451 could not be found. Aug 24 10:02:44.876136 n-d-849328-3 devstack@n-api.service[106541]: action_args: {'id': '451'} Aug 24 10:02:44.876136 n-d-849328-3 devstack@n-api.service[106541]: {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:02:44.876136 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:02:44.876947 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 10:02:44.876947 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 10:02:44.876947 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 10:02:44.876947 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 10:02:44.876947 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:02:44.876947 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:02:44.876947 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 10:02:44.876947 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 10:02:44.876947 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 10:02:44.876947 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:02:44.876947 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 10:02:44.876947 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 10:02:44.876947 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 10:02:44.876947 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi Aug 24 10:02:44.876947 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:02:44.876947 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi Aug 24 10:02:44.876947 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:02:44.876947 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:02:44.876947 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:02:44.878039 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:02:44.878039 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:02:44.878039 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:02:44.878039 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:02:44.878039 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 10:02:44.878039 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:02:44.878039 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 10:02:44.878039 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi Aug 24 10:02:44.878039 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:02:44.878039 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi Aug 24 10:02:44.878039 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:02:44.878039 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:02:44.878039 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:02:44.878039 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:02:44.878039 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:02:44.878039 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 10:02:44.878039 n-d-849328-3 devstack@n-api.service[106541]: ERROR nova.api.openstack.wsgi Aug 24 10:02:44.878039 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-4025fd02-0631-4b32-a3e1-1a48ac846c00 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:02:44.879043 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-4025fd02-0631-4b32-a3e1-1a48ac846c00 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.427006 Aug 24 10:02:44.879043 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 24/49] 10.222.0.85 () {60 vars in 1193 bytes} [Wed Aug 24 10:02:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 428 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 10:02:44.885864 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-0cc6300e-a220-473b-9a9a-22c86744725a admin admin] Calling method '>' {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:44.900861 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-0cc6300e-a220-473b-9a9a-22c86744725a admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018560 Aug 24 10:02:44.901417 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 26/50] 10.222.0.85 () {60 vars in 1210 bytes} [Wed Aug 24 10:02:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:02:44.910907 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-17b4ae2e-c810-4949-ab53-2e3bf9d79340 admin admin] Calling method '>' {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:44.926343 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-17b4ae2e-c810-4949-ab53-2e3bf9d79340 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018996 Aug 24 10:02:44.926868 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 25/51] 10.222.0.85 () {60 vars in 1210 bytes} [Wed Aug 24 10:02:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:02:44.935954 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-6e747fc9-0be6-4906-bfe9-8c01e2caf98a admin admin] Calling method '>' {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:44.941380 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.wsgi [None req-6e747fc9-0be6-4906-bfe9-8c01e2caf98a admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 10:02:44.942866 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-6e747fc9-0be6-4906-bfe9-8c01e2caf98a admin admin] Request method failure captured: Aug 24 10:02:44.942866 n-d-849328-3 devstack@n-api.service[106540]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 10:02:44.942866 n-d-849328-3 devstack@n-api.service[106540]: Accept: application/json Aug 24 10:02:44.942866 n-d-849328-3 devstack@n-api.service[106540]: Accept-Encoding: gzip, deflate Aug 24 10:02:44.942866 n-d-849328-3 devstack@n-api.service[106540]: Connection: keep-alive Aug 24 10:02:44.942866 n-d-849328-3 devstack@n-api.service[106540]: Content-Length: 0 Aug 24 10:02:44.942866 n-d-849328-3 devstack@n-api.service[106540]: Host: 10.222.0.85 Aug 24 10:02:44.942866 n-d-849328-3 devstack@n-api.service[106540]: Openstack-Api-Version: compute 2.90 Aug 24 10:02:44.942866 n-d-849328-3 devstack@n-api.service[106540]: Openstack-System-Scope: None Aug 24 10:02:44.942866 n-d-849328-3 devstack@n-api.service[106540]: User-Agent: python-novaclient Aug 24 10:02:44.942866 n-d-849328-3 devstack@n-api.service[106540]: X-Auth-Token: gAAAAABjBfdE_8g7FkFCmqTi0ybu1iItLEJw7kAvC5UR6mu3Uc1ZLlv8k4L8IcZStghDQV64yqYZITSFhIBTZZcCRn-4d3YRgoTcMPOptzLXKrAy_NxuyG_att_MBn_5_GMkmQoWsP9M0YCXGu-x52-K0EuJ08mRa1ltROdELtLE9xkpSf1nLy0 Aug 24 10:02:44.942866 n-d-849328-3 devstack@n-api.service[106540]: X-Domain-Id: None Aug 24 10:02:44.942866 n-d-849328-3 devstack@n-api.service[106540]: X-Domain-Name: None Aug 24 10:02:44.942866 n-d-849328-3 devstack@n-api.service[106540]: X-Identity-Status: Confirmed Aug 24 10:02:44.942866 n-d-849328-3 devstack@n-api.service[106540]: X-Is-Admin-Project: True Aug 24 10:02:44.942866 n-d-849328-3 devstack@n-api.service[106540]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 10:02:44.942866 n-d-849328-3 devstack@n-api.service[106540]: X-Project-Domain-Id: default Aug 24 10:02:44.942866 n-d-849328-3 devstack@n-api.service[106540]: X-Project-Domain-Name: Default Aug 24 10:02:44.942866 n-d-849328-3 devstack@n-api.service[106540]: X-Project-Id: 9c085b1e8bfa4e7da352bc5ca21e9539 Aug 24 10:02:44.942866 n-d-849328-3 devstack@n-api.service[106540]: X-Project-Name: admin Aug 24 10:02:44.942866 n-d-849328-3 devstack@n-api.service[106540]: X-Role: reader,admin,member Aug 24 10:02:44.942866 n-d-849328-3 devstack@n-api.service[106540]: X-Roles: reader,admin,member Aug 24 10:02:44.944475 n-d-849328-3 devstack@n-api.service[106540]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9c085b1e8bfa4e7da352bc5ca21e9539"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9c085b1e8bfa4e7da352bc5ca21e9539", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9c085b1e8bfa4e7da352bc5ca21e9539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9c085b1e8bfa4e7da352bc5ca21e9539"}]}] Aug 24 10:02:44.944475 n-d-849328-3 devstack@n-api.service[106540]: X-Tenant: admin Aug 24 10:02:44.944475 n-d-849328-3 devstack@n-api.service[106540]: X-Tenant-Id: 9c085b1e8bfa4e7da352bc5ca21e9539 Aug 24 10:02:44.944475 n-d-849328-3 devstack@n-api.service[106540]: X-Tenant-Name: admin Aug 24 10:02:44.944475 n-d-849328-3 devstack@n-api.service[106540]: X-User: admin Aug 24 10:02:44.944475 n-d-849328-3 devstack@n-api.service[106540]: X-User-Domain-Id: default Aug 24 10:02:44.944475 n-d-849328-3 devstack@n-api.service[106540]: X-User-Domain-Name: Default Aug 24 10:02:44.944475 n-d-849328-3 devstack@n-api.service[106540]: X-User-Id: 77da4814acab479ab2ce4398ac301961 Aug 24 10:02:44.944475 n-d-849328-3 devstack@n-api.service[106540]: X-User-Name: admin Aug 24 10:02:44.944475 n-d-849328-3 devstack@n-api.service[106540]: method: > Aug 24 10:02:44.944475 n-d-849328-3 devstack@n-api.service[106540]: exception: Flavor 451 could not be found. Aug 24 10:02:44.944475 n-d-849328-3 devstack@n-api.service[106540]: action_args: {'id': '451'} Aug 24 10:02:44.944475 n-d-849328-3 devstack@n-api.service[106540]: {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:02:44.944475 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:02:44.945700 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 10:02:44.945700 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 10:02:44.945700 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 10:02:44.945700 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 10:02:44.945700 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:02:44.945700 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:02:44.945700 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 10:02:44.945700 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 10:02:44.945700 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 10:02:44.945700 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:02:44.945700 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 10:02:44.945700 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 10:02:44.945700 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 10:02:44.945700 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi Aug 24 10:02:44.945700 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:02:44.945700 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi Aug 24 10:02:44.945700 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:02:44.945700 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:02:44.945700 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:02:44.946782 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:02:44.946782 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:02:44.946782 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:02:44.946782 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:02:44.946782 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 10:02:44.946782 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:02:44.946782 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 10:02:44.946782 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi Aug 24 10:02:44.946782 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:02:44.946782 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi Aug 24 10:02:44.946782 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:02:44.946782 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:02:44.946782 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:02:44.946782 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:02:44.946782 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:02:44.946782 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 10:02:44.946782 n-d-849328-3 devstack@n-api.service[106540]: ERROR nova.api.openstack.wsgi Aug 24 10:02:44.946782 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-6e747fc9-0be6-4906-bfe9-8c01e2caf98a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:02:44.947837 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-6e747fc9-0be6-4906-bfe9-8c01e2caf98a admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011749 Aug 24 10:02:44.947837 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 27/52] 10.222.0.85 () {60 vars in 1193 bytes} [Wed Aug 24 10:02:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 10:02:45.923627 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-17b4ae2e-c810-4949-ab53-2e3bf9d79340 admin admin] Calling method '>' {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:45.924951 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-17b4ae2e-c810-4949-ab53-2e3bf9d79340 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001762 Aug 24 10:02:45.925349 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 26/53] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Aug 24 10:02:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:46.487465 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-e77f1029-4c79-4400-a719-48958602deb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:02:46.513235 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-e77f1029-4c79-4400-a719-48958602deb5 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.452327 Aug 24 10:02:46.513796 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 28/54] 10.222.0.85 () {64 vars in 1235 bytes} [Wed Aug 24 10:02:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:02:47.512791 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-17b4ae2e-c810-4949-ab53-2e3bf9d79340 admin admin] Calling method '>' {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:47.514152 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-17b4ae2e-c810-4949-ab53-2e3bf9d79340 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001875 Aug 24 10:02:47.514653 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 27/55] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Aug 24 10:02:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:48.068899 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-7084b55a-6556-49ef-b710-a2815fc18b91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:02:48.089979 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-7084b55a-6556-49ef-b710-a2815fc18b91 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.440190 Aug 24 10:02:48.090557 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 29/56] 10.222.0.85 () {64 vars in 1235 bytes} [Wed Aug 24 10:02:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:02:49.102311 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-17b4ae2e-c810-4949-ab53-2e3bf9d79340 admin admin] Calling method '>' {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:49.103316 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-17b4ae2e-c810-4949-ab53-2e3bf9d79340 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 24 10:02:49.103701 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 28/57] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Aug 24 10:02:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:49.682716 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-709aa63f-d131-4fb6-9a7a-67cf963f2698 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:02:49.703743 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-709aa63f-d131-4fb6-9a7a-67cf963f2698 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.463884 Aug 24 10:02:49.704273 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 30/58] 10.222.0.85 () {64 vars in 1235 bytes} [Wed Aug 24 10:02:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:02:50.675929 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-17b4ae2e-c810-4949-ab53-2e3bf9d79340 admin admin] Calling method '>' {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:50.676971 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-17b4ae2e-c810-4949-ab53-2e3bf9d79340 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 24 10:02:50.677402 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 29/59] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Aug 24 10:02:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:51.244618 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-b8ad98b5-e6ea-48c1-a66a-24ab791a022b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:02:51.270852 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-b8ad98b5-e6ea-48c1-a66a-24ab791a022b admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.454760 Aug 24 10:02:51.271555 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 31/60] 10.222.0.85 () {64 vars in 1235 bytes} [Wed Aug 24 10:02:50 2022] POST /compute/v2.1/flavors => generated 409 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:02:52.259719 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-17b4ae2e-c810-4949-ab53-2e3bf9d79340 admin admin] Calling method '>' {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:52.260721 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-17b4ae2e-c810-4949-ab53-2e3bf9d79340 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 24 10:02:52.261163 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 30/61] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Aug 24 10:02:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:52.804315 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-bd2e17a7-d2e3-4d83-96a9-d5362b1a9df5 admin admin] Calling method '>' {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:52.825911 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-bd2e17a7-d2e3-4d83-96a9-d5362b1a9df5 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.424782 Aug 24 10:02:52.826468 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 32/62] 10.222.0.85 () {60 vars in 1202 bytes} [Wed Aug 24 10:02:52 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:03:46.756441 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-17b4ae2e-c810-4949-ab53-2e3bf9d79340 admin admin] Calling method '>' {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:46.757464 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-17b4ae2e-c810-4949-ab53-2e3bf9d79340 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Aug 24 10:03:46.757861 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 31/63] 10.222.0.85 () {54 vars in 931 bytes} [Wed Aug 24 10:03:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:46.772214 n-d-849328-3 devstack@n-api.service[106540]: DEBUG dbcounter [-] [106540] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:03:47.174111 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-8c058dfa-1fdc-4d30-abe4-54c02b2cd560 admin admin] Calling method '>' {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:47.195113 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-8c058dfa-1fdc-4d30-abe4-54c02b2cd560 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.430640 Aug 24 10:03:47.195727 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 33/64] 10.222.0.85 () {60 vars in 1292 bytes} [Wed Aug 24 10:03:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:03:47.218360 n-d-849328-3 devstack@n-api.service[106541]: DEBUG dbcounter [-] [106541] Writing DB stats nova_api:SELECT=14 {{(pid=106541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:03:47.224714 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-8d26a532-b049-4166-9c3f-cf7fa29c8ae1 admin admin] Calling method '>' {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:47.237679 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-8d26a532-b049-4166-9c3f-cf7fa29c8ae1 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.021472 Aug 24 10:03:47.238460 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 32/65] 10.222.0.85 () {60 vars in 1283 bytes} [Wed Aug 24 10:03:47 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:03:47.252742 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-ea485432-0cd8-4126-a78a-4c108a9510f5 admin admin] Calling method '>' {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:47.260881 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-ea485432-0cd8-4126-a78a-4c108a9510f5 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011858 Aug 24 10:03:47.261471 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 34/66] 10.222.0.85 () {60 vars in 1286 bytes} [Wed Aug 24 10:03:47 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:03:47.273032 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-c044da0c-e6a4-4b41-ad20-cd8e8ba707da admin admin] Calling method '>' {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:47.281360 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-c044da0c-e6a4-4b41-ad20-cd8e8ba707da admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011920 Aug 24 10:03:47.281876 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 33/67] 10.222.0.85 () {60 vars in 1286 bytes} [Wed Aug 24 10:03:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:03:47.296096 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-4f6ab7f9-f48d-4229-b32e-d80d662a1608 admin admin] Calling method '>' {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:47.307679 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-4f6ab7f9-f48d-4229-b32e-d80d662a1608 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017643 Aug 24 10:03:47.308196 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 35/68] 10.222.0.85 () {60 vars in 1283 bytes} [Wed Aug 24 10:03:47 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:09:16.685392 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-c044da0c-e6a4-4b41-ad20-cd8e8ba707da admin admin] Calling method '>' {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:09:16.686397 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-c044da0c-e6a4-4b41-ad20-cd8e8ba707da admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 24 10:09:16.686792 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 34/69] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Aug 24 10:09:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:09:16.837563 n-d-849328-3 devstack@n-api.service[106540]: DEBUG dbcounter [-] [106540] Writing DB stats nova_api:SELECT=6 {{(pid=106540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:09:16.994477 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-c8e772ce-679f-4762-ba9d-823e541ef50c admin admin] Calling method '>' {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:09:16.996858 n-d-849328-3 devstack@n-api.service[106540]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:09:16.996858 n-d-849328-3 devstack@n-api.service[106540]: warnings.warn(msg) Aug 24 10:09:16.998230 n-d-849328-3 devstack@n-api.service[106540]: DEBUG oslo_concurrency.lockutils [None req-c8e772ce-679f-4762-ba9d-823e541ef50c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:09:16.998699 n-d-849328-3 devstack@n-api.service[106540]: DEBUG oslo_concurrency.lockutils [None req-c8e772ce-679f-4762-ba9d-823e541ef50c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:09:16.999123 n-d-849328-3 devstack@n-api.service[106540]: DEBUG oslo_concurrency.lockutils [None req-c8e772ce-679f-4762-ba9d-823e541ef50c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:09:16.999827 n-d-849328-3 devstack@n-api.service[106540]: DEBUG oslo_concurrency.lockutils [None req-c8e772ce-679f-4762-ba9d-823e541ef50c admin admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:09:17.000266 n-d-849328-3 devstack@n-api.service[106540]: DEBUG oslo_concurrency.lockutils [None req-c8e772ce-679f-4762-ba9d-823e541ef50c admin admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:09:17.000675 n-d-849328-3 devstack@n-api.service[106540]: DEBUG oslo_concurrency.lockutils [None req-c8e772ce-679f-4762-ba9d-823e541ef50c admin admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:09:17.042718 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-c8e772ce-679f-4762-ba9d-823e541ef50c admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.206473 Aug 24 10:09:17.043324 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 36/70] 10.222.0.85 () {60 vars in 1193 bytes} [Wed Aug 24 10:09:16 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:09:17.872336 n-d-849328-3 devstack@n-api.service[106541]: DEBUG nova.api.openstack.wsgi [None req-c044da0c-e6a4-4b41-ad20-cd8e8ba707da admin admin] Calling method '>' {{(pid=106541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:09:17.873649 n-d-849328-3 devstack@n-api.service[106541]: INFO nova.api.openstack.requestlog [None req-c044da0c-e6a4-4b41-ad20-cd8e8ba707da admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001943 Aug 24 10:09:17.874176 n-d-849328-3 devstack@n-api.service[106541]: [pid: 106541|app: 0|req: 35/71] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Aug 24 10:09:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:09:18.069737 n-d-849328-3 devstack@n-api.service[106540]: DEBUG nova.api.openstack.wsgi [None req-b35070d5-b824-4f62-a3a0-5a5adee3f6d2 admin admin] Calling method '>' {{(pid=106540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:09:18.072138 n-d-849328-3 devstack@n-api.service[106540]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:09:18.072138 n-d-849328-3 devstack@n-api.service[106540]: warnings.warn(msg) Aug 24 10:09:18.073346 n-d-849328-3 devstack@n-api.service[106540]: DEBUG oslo_concurrency.lockutils [None req-b35070d5-b824-4f62-a3a0-5a5adee3f6d2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:09:18.073762 n-d-849328-3 devstack@n-api.service[106540]: DEBUG oslo_concurrency.lockutils [None req-b35070d5-b824-4f62-a3a0-5a5adee3f6d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:09:18.074193 n-d-849328-3 devstack@n-api.service[106540]: DEBUG oslo_concurrency.lockutils [None req-b35070d5-b824-4f62-a3a0-5a5adee3f6d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:09:18.075458 n-d-849328-3 devstack@n-api.service[106540]: DEBUG oslo_concurrency.lockutils [None req-b35070d5-b824-4f62-a3a0-5a5adee3f6d2 admin admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:09:18.075909 n-d-849328-3 devstack@n-api.service[106540]: DEBUG oslo_concurrency.lockutils [None req-b35070d5-b824-4f62-a3a0-5a5adee3f6d2 admin admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:09:18.076335 n-d-849328-3 devstack@n-api.service[106540]: DEBUG oslo_concurrency.lockutils [None req-b35070d5-b824-4f62-a3a0-5a5adee3f6d2 admin admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:09:18.099187 n-d-849328-3 devstack@n-api.service[106540]: INFO nova.api.openstack.requestlog [None req-b35070d5-b824-4f62-a3a0-5a5adee3f6d2 admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.086875 Aug 24 10:09:18.099747 n-d-849328-3 devstack@n-api.service[106540]: [pid: 106540|app: 0|req: 37/72] 10.222.0.85 () {60 vars in 1193 bytes} [Wed Aug 24 10:09:18 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:10:09.450691 n-d-849328-3 devstack@n-api.service[106528]: Wed Aug 24 10:10:09 2022 - graceful shutdown triggered... Aug 24 10:10:09.450810 n-d-849328-3 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 10:10:09.452404 n-d-849328-3 devstack@n-api.service[106541]: Gracefully killing worker 2 (pid: 106541)... Aug 24 10:10:09.452853 n-d-849328-3 devstack@n-api.service[106540]: Gracefully killing worker 1 (pid: 106540)... Aug 24 10:10:10.453168 n-d-849328-3 devstack@n-api.service[106528]: worker 1 buried after 1 seconds Aug 24 10:10:10.453168 n-d-849328-3 devstack@n-api.service[106528]: worker 2 buried after 1 seconds Aug 24 10:10:10.453168 n-d-849328-3 devstack@n-api.service[106528]: goodbye to uWSGI. Aug 24 10:10:10.455743 n-d-849328-3 systemd[1]: devstack@n-api.service: Succeeded. Aug 24 10:10:10.456689 n-d-849328-3 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 10:10:10.460165 n-d-849328-3 systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 10:10:10.483916 n-d-849328-3 devstack@n-api.service[122423]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 10:10:10.515709 n-d-849328-3 devstack@n-api.service[122423]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 10:10:10 2022] *** Aug 24 10:10:10.515709 n-d-849328-3 devstack@n-api.service[122423]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 10:10:10.515709 n-d-849328-3 devstack@n-api.service[122423]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 10:10:10.515709 n-d-849328-3 devstack@n-api.service[122423]: nodename: n-d-849328-3 Aug 24 10:10:10.515709 n-d-849328-3 devstack@n-api.service[122423]: machine: x86_64 Aug 24 10:10:10.515709 n-d-849328-3 devstack@n-api.service[122423]: clock source: unix Aug 24 10:10:10.515709 n-d-849328-3 devstack@n-api.service[122423]: pcre jit disabled Aug 24 10:10:10.515709 n-d-849328-3 devstack@n-api.service[122423]: detected number of CPU cores: 4 Aug 24 10:10:10.515709 n-d-849328-3 devstack@n-api.service[122423]: current working directory: / Aug 24 10:10:10.515709 n-d-849328-3 devstack@n-api.service[122423]: detected binary path: /usr/bin/uwsgi-core Aug 24 10:10:10.515709 n-d-849328-3 devstack@n-api.service[122423]: your processes number limit is 47680 Aug 24 10:10:10.515709 n-d-849328-3 devstack@n-api.service[122423]: your memory page size is 4096 bytes Aug 24 10:10:10.515709 n-d-849328-3 devstack@n-api.service[122423]: detected max file descriptor number: 2048 Aug 24 10:10:10.515709 n-d-849328-3 devstack@n-api.service[122423]: lock engine: pthread robust mutexes Aug 24 10:10:10.516825 n-d-849328-3 devstack@n-api.service[122423]: thunder lock: enabled Aug 24 10:10:10.516825 n-d-849328-3 devstack@n-api.service[122423]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 10:10:10.516825 n-d-849328-3 devstack@n-api.service[122423]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 10:10:10.557319 n-d-849328-3 devstack@n-api.service[122423]: Python main interpreter initialized at 0x55e0027449c0 Aug 24 10:10:10.557319 n-d-849328-3 devstack@n-api.service[122423]: python threads support enabled Aug 24 10:10:10.557319 n-d-849328-3 devstack@n-api.service[122423]: your server socket listen backlog is limited to 100 connections Aug 24 10:10:10.557319 n-d-849328-3 devstack@n-api.service[122423]: your mercy for graceful operations on workers is 90 seconds Aug 24 10:10:10.557776 n-d-849328-3 devstack@n-api.service[122423]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 10:10:10.557776 n-d-849328-3 devstack@n-api.service[122423]: *** Operational MODE: preforking *** Aug 24 10:10:10.558041 n-d-849328-3 devstack@n-api.service[122423]: *** uWSGI is running in multiple interpreter mode *** Aug 24 10:10:10.558041 n-d-849328-3 devstack@n-api.service[122423]: spawned uWSGI master process (pid: 122423) Aug 24 10:10:10.558259 n-d-849328-3 systemd[1]: Started Devstack devstack@n-api.service. Aug 24 10:10:10.558956 n-d-849328-3 devstack@n-api.service[122423]: spawned uWSGI worker 1 (pid: 122432, cores: 1) Aug 24 10:10:10.559192 n-d-849328-3 devstack@n-api.service[122423]: spawned uWSGI worker 2 (pid: 122433, cores: 1) Aug 24 10:10:10.559350 n-d-849328-3 devstack@n-api.service[122423]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 10:10:11.216404 n-d-849328-3 devstack@n-api.service[122433]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 10:10:11.217093 n-d-849328-3 devstack@n-api.service[122432]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 10:10:12.369008 n-d-849328-3 devstack@n-api.service[122432]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:10:12.369008 n-d-849328-3 devstack@n-api.service[122432]: from cryptography.utils import int_from_bytes Aug 24 10:10:12.369828 n-d-849328-3 devstack@n-api.service[122433]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:10:12.369828 n-d-849328-3 devstack@n-api.service[122433]: from cryptography.utils import int_from_bytes Aug 24 10:10:12.370233 n-d-849328-3 devstack@n-api.service[122432]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:10:12.370233 n-d-849328-3 devstack@n-api.service[122432]: from cryptography.utils import int_from_bytes Aug 24 10:10:12.370376 n-d-849328-3 devstack@n-api.service[122433]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:10:12.370376 n-d-849328-3 devstack@n-api.service[122433]: from cryptography.utils import int_from_bytes Aug 24 10:10:14.786228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 10:10:14.787010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 10:10:14.787010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 10:10:14.787419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 10:10:14.787621 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 10:10:14.788047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.788374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.788676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.789021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.789543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.789863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.790185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.790520 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.790855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.791119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.791439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.791776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-849328-3 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.792106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.792416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.792741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.793060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.793396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.793726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.794048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.794553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.795009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.795320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.795634 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.795977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.796293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.796601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.796922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.797262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.797703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.798019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.798444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-849328-3 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.798766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.799083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.799401 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.799830 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.800144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.800457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.800842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.801192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.801507 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.802180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.802503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.802824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.803146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.803451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.803760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.804074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.804396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.804705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.805011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.805289 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.805612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.805939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.806266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.806591 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.806842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.807092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.807418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.807743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.808055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.808364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.808674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.808982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.809316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.809624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.809931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.810240 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.810561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.810885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.811215 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.811526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.811849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.812270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.812523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.812833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.813202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.813527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.813835 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.814155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.814477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.814786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.815092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.815408 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.815726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.816064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.816398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.816650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.816954 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.817287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.817610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.817922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.818230 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.818539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.818841 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.819146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.819462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.819766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.820072 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.820377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.820681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.820989 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.821319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.821626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.821947 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.822275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.822585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.822892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.823199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.823504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.823829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.824136 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.824443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.824765 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.825073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.825403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.825723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.826031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.826338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.826657 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.826961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.827270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.827586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.827895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.828200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.828505 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.828807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.829109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.829433 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.829734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.830036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.830335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.830654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.830977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.831287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.831595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.831900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.832281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.832625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.832960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.833335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.833656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.834001 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.834359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 10:10:14.834854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.834952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 10:10:14.835047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.835047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.835224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 10:10:14.835309 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.835451 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 10:10:14.835564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.835741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 10:10:14.835911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.836123 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.836261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.836447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.836618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.836722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.836828 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.837071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.837246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.837485 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.837635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.837745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.837834 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.838095 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.838332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.838441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.838530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.838721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.838931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.839035 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.839132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.839297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.839411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.839622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-849328-3 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.839748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.839974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.840128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.840258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.840379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.840585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.840737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.840900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.841050 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.841279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.841433 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.841530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.841625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.841840 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.841990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.842198 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.842354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.842477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.842613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.842794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.842911 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.843131 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.843235 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.843448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.843557 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.843770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.843985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.844196 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.844289 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.844374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.844468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.844688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.844809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.845000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.845103 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.845348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.845458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.845681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.845785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-849328-3 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.846002 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.846100 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.846318 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.846418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.846625 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.846751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.846943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.847056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.847257 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.847359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.847600 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.847701 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.847922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.848018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.848233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.848346 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.848546 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.848707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.848851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.848961 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.849183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.849279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.849493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.849586 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.849819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.849917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.850138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.850243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.850446 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.850537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.850752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.850843 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.851067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.851167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.851369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.851520 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.851669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.851769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.851915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.852019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.852220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.852311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.852537 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.852627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.852854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.852962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.853195 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.853307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.853472 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.853563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.853843 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.853938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.854145 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.854235 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.854473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.854564 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.854779 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.854870 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.855084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.855180 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.855387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.855486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.855695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.855785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.856001 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.856091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.856306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.856404 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.856611 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.856695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.856946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.857044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.857290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.857400 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.857605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.857695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.857927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.858025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.858237 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.858336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.858556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.858649 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.858882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.858979 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.859185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.859275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.859492 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.859592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.859813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.859901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.860126 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.860221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.860432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.860539 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.860736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.860828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.861040 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.861186 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.861370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.861461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.861679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.861808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.861983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.862101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.862286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.862376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.862592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.862691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.862898 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.862997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.863142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.863315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.863491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.863589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.863799 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.863905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.864115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.864212 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.864425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.864526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.864731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.864821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.865036 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.865146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.865358 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.865448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.865662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.865763 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.865965 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.866055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.866268 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.866379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.866578 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.866690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.866883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.866997 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.867189 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.867298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.867482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.867581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.867784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.867880 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.868086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.868189 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.868402 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.868499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.868721 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.868811 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.869025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.869168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.869354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.869447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.869657 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.869750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.869962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.870052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.870278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.870418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.870583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.870674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.870887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.870979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.871203 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.871293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.871506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.871605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.871808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.871943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.872123 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.872275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.872425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.872524 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.872728 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.872824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.873044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.873175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.873366 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.873463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.873816 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.873931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.874034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.874137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.874272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.874368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.874560 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.874659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.874860 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.874987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.875189 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.875325 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.875450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.875551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.875761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.876039 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.876130 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.876223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.876343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.876442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.876638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.876729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.876957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.877055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.877298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.877398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.877604 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.877704 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.877911 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.878002 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.878213 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.878316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.878531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:10:14.878630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.878893 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.878995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.879221 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.879353 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.879530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.879621 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.879837 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.879935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.880147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.880255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.880462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.880560 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.880775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.880872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.881086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.881212 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.881421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.881512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.881738 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.881829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.882046 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.882154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.882357 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.882445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.882664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.882759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.882976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.883074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.883293 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.883426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.883605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.883695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.883921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.884020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.884253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.884353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.884545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.884636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.884853 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.884949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.885195 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.885307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.885508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.885631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.885816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.885907 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.886123 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.886213 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.886430 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.886519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.886774 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.886866 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.887085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.887180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.887388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.887529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.887706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.887797 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.888012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.888119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.888316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.888490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.888622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.888720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.888931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.889024 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.889277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.889394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.889589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.889688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.889905 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.889995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.890215 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.890315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.890525 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.890656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.890835 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.890969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.891138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.891277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.891446 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.891547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.891770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.891867 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.892082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.892171 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.892396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.892530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.892705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.892801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.893010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.893101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.893343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.893489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.893661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.893760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.893962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.894237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.894336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.894625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.894745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.894930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.895027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.895239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.895329 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.895542 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.895667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.895863 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.895956 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.896190 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.896279 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.896497 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.896588 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.896829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.896927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.897165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.897313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.897478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.897564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.897789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.897876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.898108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.898207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.898421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.898518 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.898730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.898828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.899038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.899141 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.899345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.899448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.899657 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.899738 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.899963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.900060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.900285 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.900384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.900573 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.900664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.900881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.900981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.901215 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.901307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.901524 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.901625 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.901832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.901921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.902141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.902280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.902451 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.902540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.902764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.902863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.903073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.903163 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.903375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.903467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.903682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.903782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.904012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.904105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.904319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.904419 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.904639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.904730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.904962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.905066 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.905309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.905416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.905623 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.905713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.905925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.906014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.906232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.906344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.906540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.906644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.906846 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.906936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.907150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.907258 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.907455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.907553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.907756 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.907893 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.908055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.908156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.908355 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.908444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.908656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.908756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.908959 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.909057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.909300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.909409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.909606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.909704 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.909907 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.909999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.910239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.910342 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.910559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.910668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.910867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.910995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.911174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.911357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.911481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.911656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.911793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.911993 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.912109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.912359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.912458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.912706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.912804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.913012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.913102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.913360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.913539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.913723 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.913815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.914036 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.914126 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.914353 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.914450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.914666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.914757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.914977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.915067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.915283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.915374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.915611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.915708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.915926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.916150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.916241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.916525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.916661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.916839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.917163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.917272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.917472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.917673 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.917792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.918119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.918219 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.918438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.918625 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.918734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.919044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.919141 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.919351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.919656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.919772 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.919961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.920175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.920274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.920566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.920696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.920874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.921153 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.921261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.921494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.921655 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.921799 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.922129 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.922227 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.922440 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.922633 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.922746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.923052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.923156 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.923357 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.923639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.923789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.924001 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.924103 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.924364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.924569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.924735 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.924979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.925081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.925325 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.925554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.925645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.925994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.926095 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.926308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.926573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.926673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.927255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.927403 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.927569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.927876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.927979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.928181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.928360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.928485 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.928815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.928913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.929146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.929393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.929486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.929784 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.929874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.930110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.930341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.930439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.930785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.930901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.931043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.931296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.931390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.931657 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.931774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.931969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.932252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.932356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.932587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.932719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.932902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.933213 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.933309 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.933552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.933686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.933866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.934153 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.934244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.934474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.934631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.934786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.935094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.935193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.935432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.935576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.935733 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.936071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.936169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.936345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.936513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.936651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.936965 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.937055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.937296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.937452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.937736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.937931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.938038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.938354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.938450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.938660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.938882 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.938973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.939273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.939363 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.939590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.939855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.939955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.940200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.940324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.940617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.940795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.940915 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.941256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.941366 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.941669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.941803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.941974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.942272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.942382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.942586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.942762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.942922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.943227 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.943327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.943534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.943840 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.943968 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.944163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.944467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.944570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.944792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.944997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.945249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.945565 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.945657 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.945875 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.946181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.946293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.946608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.946734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.946923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.947249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.947349 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.947585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.947851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.947953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.948222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.948432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.948526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.948836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.949002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.949184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.949516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.949609 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.949831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.950137 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.950268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.950444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.950703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.950804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.951085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.951252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.951387 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.951713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.951817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.952134 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.952344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.952459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.952773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.952935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.953097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.953449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.953552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.953760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.954213 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.954340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.954435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.954522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.954637 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.954737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.954959 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.955066 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.955291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.955382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.955610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.955889 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.955980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.956229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.956330 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.956540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.956639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.956848 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.956983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.957242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.957360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.957578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.957677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.957885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.957996 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.958224 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.958335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.958541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.958640 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.958868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.958969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.959181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.959271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.959497 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.959595 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.959811 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.959912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.960125 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.960218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.960431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.960523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.960735 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.960826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.961045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.961208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.961381 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.961477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.961688 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.961784 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.961993 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.962088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.962343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.962436 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.962673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.962870 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.962987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.963322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.963423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.963659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.963760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.963986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.964199 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.964382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.964638 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.964759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.964946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.965186 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.965334 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.965495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.965601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.965805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.965911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.966115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.966207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.966425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.966524 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.966755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.966853 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.967064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.967164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.967369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.967467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.967673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.967764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.967998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.968099 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.968304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.968405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.968627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.968718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.968939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.969038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.969268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.969362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.969575 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.969710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.969879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.969979 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.970224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.970321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.970697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.970824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.970824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.971064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.971170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.971264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.971432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.971567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.971753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.971846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.972335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.972435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.972547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.972643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.972742 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.972835 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.972988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.973079 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.973326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.973419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.973637 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.973739 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.973943 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.974033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.974251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.974359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.974562 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.974661 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.974872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.974971 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.975175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.975457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.975555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.975773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.975863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.976110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.976207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.976431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.976530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.976752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.976844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.977056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.977200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.977409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.977534 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.977726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.977847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.978043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.978149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.978358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.978457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.978674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.978772 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.979008 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.979114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.979336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.979433 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.979642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.979745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.979946 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.980045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.980249 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.980347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.980559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.980664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.980880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.980972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.981220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.981326 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.981530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.981663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.981842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.981944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.982148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.982241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.982452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.982552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.982753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.982851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.983060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.983158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.983365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.983499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.983668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.983760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.983968 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.984074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.984326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.984430 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.984576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.984671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.984885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.984985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.985215 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.985308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.985522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.985624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.985827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.985931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.986129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.986219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.986471 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.986563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.986774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.986885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.987087 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.987177 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.987406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.987503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.987725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.987924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.988042 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.988287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.988593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.988691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.988950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.989168 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.989303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.989622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.989728 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.989941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.990172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.990273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.990564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.990701 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.990872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.991183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.991281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.991502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.991722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.991832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.992122 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.992222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.992434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.992660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.992755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.993051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.993173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.993392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.993661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.994015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.994151 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.994373 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.994653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.994759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.995011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.995157 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.995344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.995662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.995760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.995976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.996137 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.996307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.996619 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.996719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.996927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.997104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.997272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.997589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.997692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.997900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.998078 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.998210 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.998525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.998615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.998837 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.999073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.999185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.999444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.999560 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:14.999751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.000058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.000230 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.000381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.000549 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.000691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.000996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.001095 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.001336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.001524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.001644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.001954 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.002065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.002261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.002479 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.002579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.002864 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.002954 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.003170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.003453 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.003556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.003773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.003962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.004110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.004415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.004520 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.004724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.004912 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.005045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.005343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.005444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.005678 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.005828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.006043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.006313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.006411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.006657 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.006984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.007083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.007300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.007492 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.007613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.007959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.008063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.008278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.008440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.008814 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.008913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.009182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.009422 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.009516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.009830 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.009927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.010165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.010398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.010498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.010773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.010870 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.011080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.011405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.011511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.011719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.011981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.012090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.012337 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.012463 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.012649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.012949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.013043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.013283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.013459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.013847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.013992 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.014093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.014180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.014429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.014568 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.014796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.014914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.015108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.015388 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.015509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.015718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.015851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.016038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.016324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.016416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.016704 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.016855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.017026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.017341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.017435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.017808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.017954 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.018128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.018485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.018645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.018800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.018937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.019075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.019384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.019574 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.019780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.020100 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.020228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.020402 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.020597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.020830 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.021086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.021202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.021487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.021650 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.021812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.022132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.022242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.022457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.022649 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.022783 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.023096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.023187 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.023426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.023567 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.023739 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.024027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.024129 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.024374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.024466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.024707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.024802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.025036 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.025188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.025362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.025460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.025669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.025776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.025975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.026103 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.026285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.026384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.026602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.026707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.026913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.027006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.027220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.027404 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.027525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.027739 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.027838 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.028067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.028158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.028382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.028482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.028710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.028802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.029016 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.029107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.029347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.029450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.029651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.029741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.029955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.030048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.030262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.030363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.030564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.030655 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.030869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.031104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.031203 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.031470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.031591 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.031775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.032107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.032254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.032378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.032546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.032682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.032985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.055779 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.057113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.057896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.058076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.058076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.062017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.062750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.063590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.064165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.064165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.065467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.066508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.066821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.067279 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.067429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.067518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.067518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.067653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.067713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.067768 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.067822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.067822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.067931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.067986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.067986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.068082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.068326 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.068404 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.068471 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.068603 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.068715 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.068787 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.068863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.068921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.069013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.069081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.069162 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.069240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.069300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.069300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.069423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.069488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.069594 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.069656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.069712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.069768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.069846 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.069952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.070083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.070149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.070206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.070263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.070383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.070459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.070459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.070459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.070459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.070459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.070459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.070459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.070949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.071048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.071141 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.071141 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.071315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.071458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.071458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.071654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.071815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.071906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.071968 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.072026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.072081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.072182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.072240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.072310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.072397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.072397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.072500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.072556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.072612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.072676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.072735 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.072793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.072849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.072905 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.072968 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.073027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.073084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.073084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 10:10:15.073221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.073221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.073221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.073221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.073221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.073221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.073221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.073221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.073755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.073755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.073755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.073755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.073755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.073755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.073755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.073755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.074140 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.074140 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.074140 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.074140 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.074140 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.074140 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.074140 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.074140 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.074509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.074509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.074509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.074509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.074509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.074509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.074509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.074509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.075155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.075155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.075155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.075155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.075155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.075155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.075155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.075523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.075523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.075523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.075523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.075523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.075523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.075523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.075523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.075927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.075927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.075927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.075927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.075927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.075927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.075927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.075927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.076334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.076334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.076334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.076334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.076334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.076334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.076334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.076334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.076964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.076964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.076964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.076964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.076964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.076964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.076964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.076964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.077456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.077456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.077456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.077456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.078069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.078429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.078748 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.079077 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.079408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.079738 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.080049 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.080377 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.080690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.081048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.081405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.081721 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.082054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.082363 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.082675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.082985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.083290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.083586 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.083890 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.084217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.084553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.084858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.085181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.085494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.085800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.086107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.086411 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.086715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.087081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.087324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.087633 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.087940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.088255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.088561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.088866 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.089190 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.089515 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.089824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.090181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.090503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.090813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.091135 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.091520 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.091829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.092174 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.092488 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.093022 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.093388 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.093712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.094059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.094596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.095044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.095218 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.095527 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.095866 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.096179 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.096490 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.096808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.098191 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.098191 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.098191 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.098191 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.098575 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.098723 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.105038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.105038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.105038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.105038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.105038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.105038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.105038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.105038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.105635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.105635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.105635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.105635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.105635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.105635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.105635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.105635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.106028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.106028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.106028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.106028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.106028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.106028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.106028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.106382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.106669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.107587 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.107914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.108240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.108553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.108888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.109262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.109580 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.109916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.110229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.110543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.110847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.111158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.111474 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.111785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.112091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.112394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.112697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.112998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.113233 n-d-849328-3 devstack@n-api.service[122433]: INFO dbcounter [None req-a0ecf41e-d226-478a-ab0b-74fe66c1bb1b None None] Registered counter for database nova_api Aug 24 10:10:15.113444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.113817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.114152 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.114461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.114762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.115065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.115375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.115679 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.115980 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.116283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.116592 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.116893 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.117218 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.117526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.117830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.118131 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.118466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.118808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.119127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.119454 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.119792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.120118 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.120428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.120752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.121075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.121424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.121735 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.122069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.122381 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.122696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.123011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.123320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.123629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.123940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.124273 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.124599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.124907 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.125256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.125586 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.125901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.126210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.126522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.126853 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.127164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.127478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.127820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.128083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.128398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.129110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.129597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.129949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.130310 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.130622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.130950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.131252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.131563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.131893 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.132224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.132572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.134373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.134373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.134373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.134373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.134618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_db.sqlalchemy.engines [None req-a0ecf41e-d226-478a-ab0b-74fe66c1bb1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122433) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:10:15.134712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.134712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:10:15.134712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 10:10:15.142143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writer thread running {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:10:15.195628 n-d-849328-3 devstack@n-api.service[122432]: INFO dbcounter [None req-338a6e03-8f02-4715-84fa-ef4c285e66ee None None] Registered counter for database nova_api Aug 24 10:10:15.199938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.context [None req-a0ecf41e-d226-478a-ab0b-74fe66c1bb1b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e852a9c4-5bbb-4a78-aec0-794708e7e59e(cell1) {{(pid=122433) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 10:10:15.204319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0ecf41e-d226-478a-ab0b-74fe66c1bb1b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:10:15.204767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0ecf41e-d226-478a-ab0b-74fe66c1bb1b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:10:15.206414 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0ecf41e-d226-478a-ab0b-74fe66c1bb1b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:10:15.207343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0ecf41e-d226-478a-ab0b-74fe66c1bb1b None None] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:10:15.207788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0ecf41e-d226-478a-ab0b-74fe66c1bb1b None None] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:10:15.209977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0ecf41e-d226-478a-ab0b-74fe66c1bb1b None None] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:10:15.212403 n-d-849328-3 devstack@n-api.service[122433]: INFO dbcounter [None req-a0ecf41e-d226-478a-ab0b-74fe66c1bb1b None None] Registered counter for database nova_cell0 Aug 24 10:10:15.216653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_db.sqlalchemy.engines [None req-338a6e03-8f02-4715-84fa-ef4c285e66ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:10:15.216943 n-d-849328-3 devstack@n-api.service[122433]: INFO dbcounter [None req-a0ecf41e-d226-478a-ab0b-74fe66c1bb1b None None] Registered counter for database nova_cell1 Aug 24 10:10:15.224149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_db.sqlalchemy.engines [None req-a0ecf41e-d226-478a-ab0b-74fe66c1bb1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122433) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:10:15.224309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writer thread running {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:10:15.228398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_db.sqlalchemy.engines [None req-a0ecf41e-d226-478a-ab0b-74fe66c1bb1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122433) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:10:15.230030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writer thread running {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:10:15.280869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.context [None req-338a6e03-8f02-4715-84fa-ef4c285e66ee None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e852a9c4-5bbb-4a78-aec0-794708e7e59e(cell1) {{(pid=122432) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 10:10:15.285467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-338a6e03-8f02-4715-84fa-ef4c285e66ee None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:10:15.285923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-338a6e03-8f02-4715-84fa-ef4c285e66ee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:10:15.287555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-338a6e03-8f02-4715-84fa-ef4c285e66ee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:10:15.288300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-338a6e03-8f02-4715-84fa-ef4c285e66ee None None] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:10:15.288757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-338a6e03-8f02-4715-84fa-ef4c285e66ee None None] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:10:15.290804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-338a6e03-8f02-4715-84fa-ef4c285e66ee None None] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:10:15.292909 n-d-849328-3 devstack@n-api.service[122432]: INFO dbcounter [None req-338a6e03-8f02-4715-84fa-ef4c285e66ee None None] Registered counter for database nova_cell0 Aug 24 10:10:15.297023 n-d-849328-3 devstack@n-api.service[122432]: INFO dbcounter [None req-338a6e03-8f02-4715-84fa-ef4c285e66ee None None] Registered counter for database nova_cell1 Aug 24 10:10:15.304727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_db.sqlalchemy.engines [None req-338a6e03-8f02-4715-84fa-ef4c285e66ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:10:15.307197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_db.sqlalchemy.engines [None req-338a6e03-8f02-4715-84fa-ef4c285e66ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:10:15.314563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writer thread running {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:10:15.315845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writer thread running {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:10:15.374368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writer thread running {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:10:15.384561 n-d-849328-3 devstack@n-api.service[122433]: INFO dbcounter [None req-a0ecf41e-d226-478a-ab0b-74fe66c1bb1b None None] Registered counter for database nova_cell0 Aug 24 10:10:15.391900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_db.sqlalchemy.engines [None req-a0ecf41e-d226-478a-ab0b-74fe66c1bb1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122433) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:10:15.397019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writer thread running {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:10:15.465825 n-d-849328-3 devstack@n-api.service[122432]: INFO dbcounter [None req-338a6e03-8f02-4715-84fa-ef4c285e66ee None None] Registered counter for database nova_cell0 Aug 24 10:10:15.476291 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_db.sqlalchemy.engines [None req-338a6e03-8f02-4715-84fa-ef4c285e66ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:10:15.481104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writer thread running {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:10:15.714157 n-d-849328-3 devstack@n-api.service[122433]: WARNING keystonemiddleware.auth_token [None req-a0ecf41e-d226-478a-ab0b-74fe66c1bb1b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 10:10:15.721668 n-d-849328-3 devstack@n-api.service[122433]: WARNING keystonemiddleware.auth_token [None req-a0ecf41e-d226-478a-ab0b-74fe66c1bb1b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 10:10:15.795605 n-d-849328-3 devstack@n-api.service[122432]: WARNING keystonemiddleware.auth_token [None req-338a6e03-8f02-4715-84fa-ef4c285e66ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 10:10:15.803378 n-d-849328-3 devstack@n-api.service[122432]: WARNING keystonemiddleware.auth_token [None req-338a6e03-8f02-4715-84fa-ef4c285e66ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 10:10:16.065987 n-d-849328-3 devstack@n-api.service[122433]: WARNING keystonemiddleware.auth_token [None req-a0ecf41e-d226-478a-ab0b-74fe66c1bb1b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 10:10:16.072300 n-d-849328-3 devstack@n-api.service[122433]: WARNING keystonemiddleware.auth_token [None req-a0ecf41e-d226-478a-ab0b-74fe66c1bb1b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 10:10:16.077756 n-d-849328-3 devstack@n-api.service[122433]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e0027449c0 pid: 122433 (default app) Aug 24 10:10:16.145593 n-d-849328-3 devstack@n-api.service[122432]: WARNING keystonemiddleware.auth_token [None req-338a6e03-8f02-4715-84fa-ef4c285e66ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 10:10:16.151624 n-d-849328-3 devstack@n-api.service[122432]: WARNING keystonemiddleware.auth_token [None req-338a6e03-8f02-4715-84fa-ef4c285e66ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 10:10:16.156944 n-d-849328-3 devstack@n-api.service[122432]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e0027449c0 pid: 122432 (default app) Aug 24 10:10:55.476445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:10:55.477362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:10:55.479008 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:10:55.481055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:10:56.286838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:10:56.289208 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:10:56.292231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:10:56.294299 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:10:56.969241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fef3a84c-4586-4d30-bff9-9cac844ffec2 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Calling method '.version_select at 0x7f4657b58700>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:56.970824 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:10:56.970824 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:10:56.977213 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fef3a84c-4586-4d30-bff9-9cac844ffec2 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e852a9c4-5bbb-4a78-aec0-794708e7e59e(cell1) {{(pid=122433) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 24 10:10:56.978159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fef3a84c-4586-4d30-bff9-9cac844ffec2 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:10:56.978779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fef3a84c-4586-4d30-bff9-9cac844ffec2 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:10:56.979547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fef3a84c-4586-4d30-bff9-9cac844ffec2 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:10:57.039534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fef3a84c-4586-4d30-bff9-9cac844ffec2 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:10:57.040119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fef3a84c-4586-4d30-bff9-9cac844ffec2 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:10:57.040633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fef3a84c-4586-4d30-bff9-9cac844ffec2 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:10:57.060425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fef3a84c-4586-4d30-bff9-9cac844ffec2 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:10:57.064350 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fef3a84c-4586-4d30-bff9-9cac844ffec2 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:10:57.065263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fef3a84c-4586-4d30-bff9-9cac844ffec2 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:10:57.074780 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fef3a84c-4586-4d30-bff9-9cac844ffec2 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.609790 Aug 24 10:10:57.076134 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1/1] 10.222.0.85 () {58 vars in 1167 bytes} [Wed Aug 24 10:10:55 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:10:57.100423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fdea6d2d-dade-4e27-a9c5-b167dc983e8c tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1484055205", "name": "tempest-test_aggregate-1995901969"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:10:57.167655 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:10:57.167655 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:10:57.169186 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.aggregate [None req-fdea6d2d-dade-4e27-a9c5-b167dc983e8c tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Generated uuid acfbe5d7-9490-4151-ad08-5ea7120b1ee9 for aggregate {{(pid=122433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 10:10:57.272440 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fdea6d2d-dade-4e27-a9c5-b167dc983e8c tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.179173 Aug 24 10:10:57.273833 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2/2] 10.222.0.85 () {60 vars in 1165 bytes} [Wed Aug 24 10:10:57 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:10:57.285792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dededcc0-de97-4a2e-aadc-ab53882a61bf tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:57.286876 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:10:57.286876 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:10:57.306546 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dededcc0-de97-4a2e-aadc-ab53882a61bf tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.025622 Aug 24 10:10:57.308277 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3/3] 10.222.0.85 () {58 vars in 1143 bytes} [Wed Aug 24 10:10:57 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:10:57.804966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-41ee02fe-4842-4d61-bff5-4f81dd125e8d tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:57.808437 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:10:57.808437 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:10:57.809907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41ee02fe-4842-4d61-bff5-4f81dd125e8d tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:10:57.810390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41ee02fe-4842-4d61-bff5-4f81dd125e8d tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:10:57.810820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41ee02fe-4842-4d61-bff5-4f81dd125e8d tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:10:57.812089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41ee02fe-4842-4d61-bff5-4f81dd125e8d tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:10:57.812686 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41ee02fe-4842-4d61-bff5-4f81dd125e8d tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:10:57.813262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41ee02fe-4842-4d61-bff5-4f81dd125e8d tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:10:57.860459 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-41ee02fe-4842-4d61-bff5-4f81dd125e8d tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.550931 Aug 24 10:10:57.869850 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 4/4] 10.222.0.85 () {58 vars in 1176 bytes} [Wed Aug 24 10:10:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:10:57.869850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-22ec540d-d16a-4a55-91e8-af51b1bb686a tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-849328-3"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:10:57.869850 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:10:57.869850 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:10:57.886413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22ec540d-d16a-4a55-91e8-af51b1bb686a tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:10:57.887003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22ec540d-d16a-4a55-91e8-af51b1bb686a tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:10:57.887450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22ec540d-d16a-4a55-91e8-af51b1bb686a tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:10:58.005543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b0e2fa3b-c478-46d6-b525-aee4704eacad tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1134830484", "id": 2111570052, "os-flavor-access:is_public": "True"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:10:58.027480 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:10:58.027480 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:10:58.071472 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b0e2fa3b-c478-46d6-b525-aee4704eacad tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 1.792249 Aug 24 10:10:58.072278 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1/5] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:10:56 2022] POST /compute/v2.1/flavors => generated 430 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:10:58.427580 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-946ce5b9-53f6-463c-9979-3993bf90bc51 tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] Calling method '.version_select at 0x7f4657a43040>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:58.430609 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:10:58.430609 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:10:58.442682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-946ce5b9-53f6-463c-9979-3993bf90bc51 tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e852a9c4-5bbb-4a78-aec0-794708e7e59e(cell1) {{(pid=122432) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 24 10:10:58.444012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-946ce5b9-53f6-463c-9979-3993bf90bc51 tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:10:58.445160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-946ce5b9-53f6-463c-9979-3993bf90bc51 tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:10:58.446523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-946ce5b9-53f6-463c-9979-3993bf90bc51 tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:10:58.516048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-946ce5b9-53f6-463c-9979-3993bf90bc51 tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:10:58.518561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-946ce5b9-53f6-463c-9979-3993bf90bc51 tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:10:58.520206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-946ce5b9-53f6-463c-9979-3993bf90bc51 tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:10:58.553088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-946ce5b9-53f6-463c-9979-3993bf90bc51 tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:10:58.553600 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-946ce5b9-53f6-463c-9979-3993bf90bc51 tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:10:58.554033 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-946ce5b9-53f6-463c-9979-3993bf90bc51 tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:10:58.577298 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-946ce5b9-53f6-463c-9979-3993bf90bc51 tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.495179 Aug 24 10:10:58.591194 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2/6] 10.222.0.85 () {60 vars in 1208 bytes} [Wed Aug 24 10:10:58 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:10:58.801178 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-22ec540d-d16a-4a55-91e8-af51b1bb686a tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.1 time: 0.937997 Aug 24 10:10:58.804724 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 5/7] 10.222.0.85 () {60 vars in 1191 bytes} [Wed Aug 24 10:10:57 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:10:58.947972 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f9072014-0ff0-47a7-855e-face602a7f71 tempest-FlavorsV255TestJSON-342757225 tempest-FlavorsV255TestJSON-342757225-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-2052776055", "id": 565543535, "os-flavor-access:is_public": "True"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:10:58.951168 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:10:58.951168 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:10:58.989812 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f9072014-0ff0-47a7-855e-face602a7f71 tempest-FlavorsV255TestJSON-342757225 tempest-FlavorsV255TestJSON-342757225-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.394467 Aug 24 10:10:58.990959 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3/8] 10.222.0.85 () {62 vars in 1188 bytes} [Wed Aug 24 10:10:58 2022] POST /compute/v2.1/flavors => generated 446 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:10:59.004266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-67b741e5-c807-4fc7-a3e9-2f0acb230cc7 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:59.007256 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:10:59.007256 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:10:59.048803 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-67b741e5-c807-4fc7-a3e9-2f0acb230cc7 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/2111570052" status: 202 len: 0 microversion: 2.1 time: 0.056508 Aug 24 10:10:59.051097 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 4/9] 10.222.0.85 () {58 vars in 1161 bytes} [Wed Aug 24 10:10:58 2022] DELETE /compute/v2.1/flavors/2111570052 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:10:59.212990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c581268-50c0-42d1-bb97-c13429c94d5a tempest-AZAdminV2TestJSON-1462653782 tempest-AZAdminV2TestJSON-1462653782-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:59.214645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c581268-50c0-42d1-bb97-c13429c94d5a tempest-AZAdminV2TestJSON-1462653782 tempest-AZAdminV2TestJSON-1462653782-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:10:59.215138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c581268-50c0-42d1-bb97-c13429c94d5a tempest-AZAdminV2TestJSON-1462653782 tempest-AZAdminV2TestJSON-1462653782-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:10:59.215578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c581268-50c0-42d1-bb97-c13429c94d5a tempest-AZAdminV2TestJSON-1462653782 tempest-AZAdminV2TestJSON-1462653782-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:10:59.216323 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c581268-50c0-42d1-bb97-c13429c94d5a tempest-AZAdminV2TestJSON-1462653782 tempest-AZAdminV2TestJSON-1462653782-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:10:59.218540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c581268-50c0-42d1-bb97-c13429c94d5a tempest-AZAdminV2TestJSON-1462653782 tempest-AZAdminV2TestJSON-1462653782-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:10:59.219166 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c581268-50c0-42d1-bb97-c13429c94d5a tempest-AZAdminV2TestJSON-1462653782 tempest-AZAdminV2TestJSON-1462653782-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:10:59.266234 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2c581268-50c0-42d1-bb97-c13429c94d5a tempest-AZAdminV2TestJSON-1462653782 tempest-AZAdminV2TestJSON-1462653782-project-admin] 10.222.0.85 "GET /compute/v2.1/os-availability-zone" status: 200 len: 190 microversion: 2.1 time: 0.459408 Aug 24 10:10:59.274888 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 6/10] 10.222.0.85 () {58 vars in 1164 bytes} [Wed Aug 24 10:10:58 2022] GET /compute/v2.1/os-availability-zone => generated 190 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:10:59.280217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-30d1b10e-63f9-4ec3-b5ff-49c0dda0eb3d tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:59.321224 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-30d1b10e-63f9-4ec3-b5ff-49c0dda0eb3d tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.044812 Aug 24 10:10:59.322216 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 7/11] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:10:59 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:10:59.379530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2ff488a3-503e-4b4e-b02b-be3b30aba0b9 tempest-FlavorsV255TestJSON-342150612 tempest-FlavorsV255TestJSON-342150612-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:59.413271 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2ff488a3-503e-4b4e-b02b-be3b30aba0b9 tempest-FlavorsV255TestJSON-342150612 tempest-FlavorsV255TestJSON-342150612-project] 10.222.0.85 "GET /compute/v2.1/flavors/565543535" status: 200 len: 446 microversion: 2.55 time: 0.359164 Aug 24 10:10:59.423147 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 5/12] 10.222.0.85 () {60 vars in 1196 bytes} [Wed Aug 24 10:10:59 2022] GET /compute/v2.1/flavors/565543535 => generated 446 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:10:59.429741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a451f878-4b0d-46b9-a79d-bcc6d8ebf9c4 tempest-AZAdminV2TestJSON-1462653782 tempest-AZAdminV2TestJSON-1462653782-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:59.431060 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:10:59.431060 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:10:59.432615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a451f878-4b0d-46b9-a79d-bcc6d8ebf9c4 tempest-AZAdminV2TestJSON-1462653782 tempest-AZAdminV2TestJSON-1462653782-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:10:59.433229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a451f878-4b0d-46b9-a79d-bcc6d8ebf9c4 tempest-AZAdminV2TestJSON-1462653782 tempest-AZAdminV2TestJSON-1462653782-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:10:59.433802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a451f878-4b0d-46b9-a79d-bcc6d8ebf9c4 tempest-AZAdminV2TestJSON-1462653782 tempest-AZAdminV2TestJSON-1462653782-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:10:59.434943 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a451f878-4b0d-46b9-a79d-bcc6d8ebf9c4 tempest-AZAdminV2TestJSON-1462653782 tempest-AZAdminV2TestJSON-1462653782-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:10:59.435368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a451f878-4b0d-46b9-a79d-bcc6d8ebf9c4 tempest-AZAdminV2TestJSON-1462653782 tempest-AZAdminV2TestJSON-1462653782-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:10:59.435922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a451f878-4b0d-46b9-a79d-bcc6d8ebf9c4 tempest-AZAdminV2TestJSON-1462653782 tempest-AZAdminV2TestJSON-1462653782-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:10:59.481165 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a451f878-4b0d-46b9-a79d-bcc6d8ebf9c4 tempest-AZAdminV2TestJSON-1462653782 tempest-AZAdminV2TestJSON-1462653782-project-admin] 10.222.0.85 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 701 microversion: 2.1 time: 0.056422 Aug 24 10:10:59.481985 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 6/13] 10.222.0.85 () {58 vars in 1185 bytes} [Wed Aug 24 10:10:59 2022] GET /compute/v2.1/os-availability-zone/detail => generated 701 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:10:59.497302 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-64d395c9-0572-402b-89f1-ae386165b4ba tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-621246219", "id": 488220947, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:10:59.500836 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:10:59.500836 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:10:59.527198 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-64d395c9-0572-402b-89f1-ae386165b4ba tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.033921 Aug 24 10:10:59.527889 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 7/14] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:10:59 2022] POST /compute/v2.1/flavors => generated 413 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:10:59.544897 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a9ac2e6a-5d07-435e-927d-9c77d4fba294 tempest-FlavorsV255TestJSON-342757225 tempest-FlavorsV255TestJSON-342757225-project-admin] Action: 'update', calling method: .version_select at 0x7f4657f19ca0>, body: {"flavor": {"description": "new"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:10:59.576200 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:10:59.576200 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:10:59.655147 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a9ac2e6a-5d07-435e-927d-9c77d4fba294 tempest-FlavorsV255TestJSON-342757225 tempest-FlavorsV255TestJSON-342757225-project-admin] 10.222.0.85 "PUT /compute/v2.1/flavors/565543535" status: 200 len: 447 microversion: 2.55 time: 0.122663 Aug 24 10:10:59.660731 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 8/15] 10.222.0.85 () {62 vars in 1216 bytes} [Wed Aug 24 10:10:59 2022] PUT /compute/v2.1/flavors/565543535 => generated 447 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:10:59.675410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7a42ce01-1ab9-45a9-99ff-084ef64d0116 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:59.692315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b1d9e19e-932c-4b15-8932-0cd4d8f1f1e8 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1157987293", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "availability_zone": "tempest-test_az-1484055205"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:10:59.741273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1d9e19e-932c-4b15-8932-0cd4d8f1f1e8 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:10:59.742075 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7a42ce01-1ab9-45a9-99ff-084ef64d0116 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 5809 microversion: 2.1 time: 0.080322 Aug 24 10:10:59.742451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1d9e19e-932c-4b15-8932-0cd4d8f1f1e8 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:10:59.743059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1d9e19e-932c-4b15-8932-0cd4d8f1f1e8 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:10:59.744446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1d9e19e-932c-4b15-8932-0cd4d8f1f1e8 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:10:59.745641 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1d9e19e-932c-4b15-8932-0cd4d8f1f1e8 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:10:59.746353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1d9e19e-932c-4b15-8932-0cd4d8f1f1e8 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:10:59.748295 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 9/16] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:10:59 2022] GET /compute/v2.1/flavors/detail => generated 5809 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:10:59.759626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd160f2a-c312-4077-8eaa-cc1b16d08684 tempest-FlavorsV255TestJSON-342150612 tempest-FlavorsV255TestJSON-342150612-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:59.831985 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dd160f2a-c312-4077-8eaa-cc1b16d08684 tempest-FlavorsV255TestJSON-342150612 tempest-FlavorsV255TestJSON-342150612-project] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 6146 microversion: 2.55 time: 0.082592 Aug 24 10:10:59.841784 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 10/17] 10.222.0.85 () {60 vars in 1187 bytes} [Wed Aug 24 10:10:59 2022] GET /compute/v2.1/flavors/detail => generated 6146 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:10:59.841784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f7f54f2b-d664-449a-9a98-6ea99186da04 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:59.841784 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:10:59.841784 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:10:59.880861 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f7f54f2b-d664-449a-9a98-6ea99186da04 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/488220947" status: 202 len: 0 microversion: 2.1 time: 0.044064 Aug 24 10:10:59.882406 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 11/18] 10.222.0.85 () {58 vars in 1158 bytes} [Wed Aug 24 10:10:59 2022] DELETE /compute/v2.1/flavors/488220947 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:10:59.887462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6455b644-7a21-4801-b33d-caec9feabe92 tempest-FlavorsV255TestJSON-342150612 tempest-FlavorsV255TestJSON-342150612-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:59.909922 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6455b644-7a21-4801-b33d-caec9feabe92 tempest-FlavorsV255TestJSON-342150612 tempest-FlavorsV255TestJSON-342150612-project] 10.222.0.85 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.55 time: 0.026498 Aug 24 10:10:59.910578 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 12/19] 10.222.0.85 () {60 vars in 1166 bytes} [Wed Aug 24 10:10:59 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:10:59.922481 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-af20ceee-6a98-4cd3-abed-9194e4a36355 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:59.959429 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-af20ceee-6a98-4cd3-abed-9194e4a36355 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.047704 Aug 24 10:10:59.963380 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 13/20] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:10:59 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:10:59.973512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d1a8999a-1a20-4d15-b18d-a400bbf6d014 tempest-FlavorsV255TestJSON-342757225 tempest-FlavorsV255TestJSON-342757225-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:00.023234 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d1a8999a-1a20-4d15-b18d-a400bbf6d014 tempest-FlavorsV255TestJSON-342757225 tempest-FlavorsV255TestJSON-342757225-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/565543535" status: 202 len: 0 microversion: 2.55 time: 0.056991 Aug 24 10:11:00.025203 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 14/21] 10.222.0.85 () {60 vars in 1199 bytes} [Wed Aug 24 10:10:59 2022] DELETE /compute/v2.1/flavors/565543535 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:11:00.033360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c9ecfd5e-a183-4a12-af15-ecb8413fe38a tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-869270145", "id": 249453108, "os-flavor-access:is_public": "True"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:00.077021 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c9ecfd5e-a183-4a12-af15-ecb8413fe38a tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.050693 Aug 24 10:11:00.078891 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 15/22] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:11:00 2022] POST /compute/v2.1/flavors => generated 425 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:00.084906 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-520fcd96-f2dc-462d-96d8-493f5b0a0791 tempest-FlavorsV255TestJSON-342757225 tempest-FlavorsV255TestJSON-342757225-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:00.123023 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-520fcd96-f2dc-462d-96d8-493f5b0a0791 tempest-FlavorsV255TestJSON-342757225 tempest-FlavorsV255TestJSON-342757225-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 5721 microversion: 2.55 time: 0.041558 Aug 24 10:11:00.124211 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 16/23] 10.222.0.85 () {60 vars in 1187 bytes} [Wed Aug 24 10:11:00 2022] GET /compute/v2.1/flavors/detail => generated 5721 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:11:00.146868 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ef123276-fbd5-40ab-8f08-d274be7eb3f1 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:00.196810 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ef123276-fbd5-40ab-8f08-d274be7eb3f1 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/249453108" status: 202 len: 0 microversion: 2.1 time: 0.070842 Aug 24 10:11:00.199327 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 17/24] 10.222.0.85 () {58 vars in 1158 bytes} [Wed Aug 24 10:11:00 2022] DELETE /compute/v2.1/flavors/249453108 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:11:00.205956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e0fd34d8-9d5c-4021-9bbe-a2073356a903 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:00.242879 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e0fd34d8-9d5c-4021-9bbe-a2073356a903 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041467 Aug 24 10:11:00.246546 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 18/25] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:11:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:11:00.273059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6477056b-1044-4939-9950-b6d60c7b6cc1 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1895291463", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:00.310308 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6477056b-1044-4939-9950-b6d60c7b6cc1 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.041455 Aug 24 10:11:00.322610 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 19/26] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:11:00 2022] POST /compute/v2.1/flavors => generated 507 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:00.336800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8c765f3f-e245-4c60-8502-221ea4bf18ab tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:00.384944 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8c765f3f-e245-4c60-8502-221ea4bf18ab tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/5d0acece-38a8-4db0-a5f6-8645bbab8a59" status: 202 len: 0 microversion: 2.1 time: 0.060887 Aug 24 10:11:00.385596 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 20/27] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:11:00 2022] DELETE /compute/v2.1/flavors/5d0acece-38a8-4db0-a5f6-8645bbab8a59 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:11:00.401055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9738906f-c3f7-4bc7-82a6-5e38a5f84543 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:00.439686 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9738906f-c3f7-4bc7-82a6-5e38a5f84543 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047534 Aug 24 10:11:00.441233 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 21/28] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:11:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:00.468294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bf6933c0-3e60-48f9-8dbc-fc9c9a315481 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1119812369", "id": "e149a78f-1166-4df1-bf2b-777cb365dfa1", "os-flavor-access:is_public": "True"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:00.521616 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bf6933c0-3e60-48f9-8dbc-fc9c9a315481 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.059744 Aug 24 10:11:00.538874 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 22/29] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:11:00 2022] POST /compute/v2.1/flavors => generated 507 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:00.546614 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fc26f83b-9a6c-411b-a6da-47e182f7e8a7 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:00.578479 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fc26f83b-9a6c-411b-a6da-47e182f7e8a7 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/e149a78f-1166-4df1-bf2b-777cb365dfa1" status: 202 len: 0 microversion: 2.1 time: 0.038037 Aug 24 10:11:00.598962 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 23/30] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:11:00 2022] DELETE /compute/v2.1/flavors/e149a78f-1166-4df1-bf2b-777cb365dfa1 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:11:00.608551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b7005bbb-b7ed-47bb-8238-c1db45826f2e tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:00.657088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6,nova_api:DELETE=18,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:00.668285 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b7005bbb-b7ed-47bb-8238-c1db45826f2e tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068036 Aug 24 10:11:00.705364 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 24/31] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:11:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:00.716118 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3a779a84-4153-4dc4-ac03-11c003a1c5d4 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1919484255", "id": 1427375775, "os-flavor-access:is_public": "True"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:00.757330 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3a779a84-4153-4dc4-ac03-11c003a1c5d4 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.049838 Aug 24 10:11:00.758178 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 25/32] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:11:00 2022] POST /compute/v2.1/flavors => generated 414 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:00.770711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b7b8cbf8-8969-4913-8983-35ba89f63a23 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:00.779389 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b7b8cbf8-8969-4913-8983-35ba89f63a23 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/1427375775" status: 200 len: 414 microversion: 2.1 time: 0.012392 Aug 24 10:11:00.780212 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 26/33] 10.222.0.85 () {58 vars in 1158 bytes} [Wed Aug 24 10:11:00 2022] GET /compute/v2.1/flavors/1427375775 => generated 414 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:00.920861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-b1d9e19e-932c-4b15-8932-0cd4d8f1f1e8 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:11:01.241748 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-936a2bc6-6e27-4840-87bd-25ca6b6b193c tempest-FlavorsAdminTestJSON-2032248650 tempest-FlavorsAdminTestJSON-2032248650-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:01.286014 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-936a2bc6-6e27-4840-87bd-25ca6b6b193c tempest-FlavorsAdminTestJSON-2032248650 tempest-FlavorsAdminTestJSON-2032248650-project] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.496938 Aug 24 10:11:01.299950 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 27/34] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:11:00 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:01.303299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b1d9e19e-932c-4b15-8932-0cd4d8f1f1e8 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:11:01.303725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b1d9e19e-932c-4b15-8932-0cd4d8f1f1e8 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:11:01.304204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b1d9e19e-932c-4b15-8932-0cd4d8f1f1e8 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:11:01.304617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b1d9e19e-932c-4b15-8932-0cd4d8f1f1e8 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:11:01.305577 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b1d9e19e-932c-4b15-8932-0cd4d8f1f1e8 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:11:01.306129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-81323f08-dd30-4b40-8358-bbeb816a6587 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:01.322142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1d9e19e-932c-4b15-8932-0cd4d8f1f1e8 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:01.322402 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1d9e19e-932c-4b15-8932-0cd4d8f1f1e8 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:01.322902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1d9e19e-932c-4b15-8932-0cd4d8f1f1e8 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:01.323499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1d9e19e-932c-4b15-8932-0cd4d8f1f1e8 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:01.324281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1d9e19e-932c-4b15-8932-0cd4d8f1f1e8 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:01.324873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1d9e19e-932c-4b15-8932-0cd4d8f1f1e8 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:01.326261 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-81323f08-dd30-4b40-8358-bbeb816a6587 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/1427375775" status: 202 len: 0 microversion: 2.1 time: 0.024859 Aug 24 10:11:01.326956 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 28/35] 10.222.0.85 () {58 vars in 1161 bytes} [Wed Aug 24 10:11:01 2022] DELETE /compute/v2.1/flavors/1427375775 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:11:01.335601 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d6a49aff-36fb-4c5a-b23a-77c8626bbeab tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:01.360789 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d6a49aff-36fb-4c5a-b23a-77c8626bbeab tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028903 Aug 24 10:11:01.361449 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 29/36] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:11:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:01.372525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b1d9e19e-932c-4b15-8932-0cd4d8f1f1e8 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Getting quotas for project d058330a96034236a9429ab2891a111d. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:11:01.382580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b1d9e19e-932c-4b15-8932-0cd4d8f1f1e8 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Getting quotas for user 213baa7d5703491b9ea67a5f7231212b and project d058330a96034236a9429ab2891a111d. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:11:01.382770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-851134fc-ee8b-4e0e-8d5d-7593605ac31f tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1721753816", "id": 1668589132, "os-flavor-access:is_public": "False"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:01.397885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b1d9e19e-932c-4b15-8932-0cd4d8f1f1e8 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:11:01.401815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b1d9e19e-932c-4b15-8932-0cd4d8f1f1e8 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:11:01.411538 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-851134fc-ee8b-4e0e-8d5d-7593605ac31f tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.032270 Aug 24 10:11:01.420520 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 30/37] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:11:01 2022] POST /compute/v2.1/flavors => generated 430 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:11:01.426845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bf9835ba-26e4-4190-9dbb-8be01486e0b1 tempest-FlavorsAdminTestJSON-2032248650 tempest-FlavorsAdminTestJSON-2032248650-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "1668589132"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:01.439743 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-bf9835ba-26e4-4190-9dbb-8be01486e0b1 tempest-FlavorsAdminTestJSON-2032248650 tempest-FlavorsAdminTestJSON-2032248650-project] HTTP exception thrown: Flavor 1668589132 could not be found. Aug 24 10:11:01.444618 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bf9835ba-26e4-4190-9dbb-8be01486e0b1 tempest-FlavorsAdminTestJSON-2032248650 tempest-FlavorsAdminTestJSON-2032248650-project] Request method failure captured: Aug 24 10:11:01.444618 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:11:01.444618 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:11:01.444618 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:11:01.444618 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:11:01.444618 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 107 Aug 24 10:11:01.444618 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:11:01.444618 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:11:01.444618 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:11:01.444618 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:01.444618 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfktKLKAfUqe19jJpHWHhdKO5hNVBwhtfPTkJtisIy0iZaXIuRS3Dg0ozL6Zc10jSWhntjcYfKcCfS4T7nV_jWcZXcwHRz2ApFXdtu4t9HA4iowzhhLCC_UXGqA8Bp9VKSj-v6Jxx1X5fnTZoYEqSpTGRJhb01tEHrCs86uUXuz8nhs Aug 24 10:11:01.444618 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:11:01.444618 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:11:01.444618 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:11:01.444618 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:11:01.444618 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:11:01.444618 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:11:01.444618 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: c6c41597141c448ab47844822c7cdfdd Aug 24 10:11:01.444618 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-FlavorsAdminTestJSON-2032248650 Aug 24 10:11:01.444618 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:11:01.444618 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:11:01.446128 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c6c41597141c448ab47844822c7cdfdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c6c41597141c448ab47844822c7cdfdd", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c6c41597141c448ab47844822c7cdfdd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c6c41597141c448ab47844822c7cdfdd"}]}] Aug 24 10:11:01.446128 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-FlavorsAdminTestJSON-2032248650 Aug 24 10:11:01.446128 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: c6c41597141c448ab47844822c7cdfdd Aug 24 10:11:01.446128 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-2032248650 Aug 24 10:11:01.446128 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-FlavorsAdminTestJSON-2032248650-project Aug 24 10:11:01.446128 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:11:01.446128 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:11:01.446128 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 7280cd0e62e244c884a8af525e218f36 Aug 24 10:11:01.446128 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-FlavorsAdminTestJSON-2032248650-project Aug 24 10:11:01.446128 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:11:01.446128 n-d-849328-3 devstack@n-api.service[122432]: {"server": {"name": "test", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "1668589132"}} Aug 24 10:11:01.446128 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:11:01.446128 n-d-849328-3 devstack@n-api.service[122432]: exception: Flavor 1668589132 could not be found. Aug 24 10:11:01.446949 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af', 'flavorRef': '1668589132'}}} Aug 24 10:11:01.446949 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:01.446949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:01.446949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 24 10:11:01.446949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 24 10:11:01.446949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 10:11:01.446949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 10:11:01.446949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:11:01.446949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:11:01.446949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 10:11:01.446949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 10:11:01.446949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 10:11:01.446949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:01.446949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 10:11:01.446949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 10:11:01.446949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1668589132 could not be found. Aug 24 10:11:01.446949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:01.446949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:01.446949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:01.446949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:01.448233 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:01.448233 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:01.448233 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:01.448233 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:01.448233 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:01.448233 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:01.448233 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:01.448233 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:01.448233 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:01.448233 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:01.448233 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:01.448233 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:01.448233 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 10:11:01.448233 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 24 10:11:01.448233 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 24 10:11:01.448233 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1668589132 could not be found. Aug 24 10:11:01.448233 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:01.448233 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:01.448233 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:01.448233 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:01.448233 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:01.449491 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:01.449491 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:11:01.449491 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:11:01.449491 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1668589132 could not be found. Aug 24 10:11:01.449491 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:01.449491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bf9835ba-26e4-4190-9dbb-8be01486e0b1 tempest-FlavorsAdminTestJSON-2032248650 tempest-FlavorsAdminTestJSON-2032248650-project] Returning 400 to user: Flavor 1668589132 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:01.449491 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bf9835ba-26e4-4190-9dbb-8be01486e0b1 tempest-FlavorsAdminTestJSON-2032248650 tempest-FlavorsAdminTestJSON-2032248650-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.023998 Aug 24 10:11:01.449491 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 31/38] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:11:01 2022] POST /compute/v2.1/servers => generated 81 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 10:11:01.458234 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8c8e28f7-ce20-4f57-acb2-9fbf967d42a1 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:01.481705 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8c8e28f7-ce20-4f57-acb2-9fbf967d42a1 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/1668589132" status: 202 len: 0 microversion: 2.1 time: 0.026941 Aug 24 10:11:01.486267 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 32/39] 10.222.0.85 () {58 vars in 1161 bytes} [Wed Aug 24 10:11:01 2022] DELETE /compute/v2.1/flavors/1668589132 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 10:11:01.492372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f8c50c91-bfcc-4b6d-b89d-ffc169d6d8bd tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:01.516214 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f8c50c91-bfcc-4b6d-b89d-ffc169d6d8bd tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028458 Aug 24 10:11:01.531427 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 33/40] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:11:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:01.541507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-814a850b-2465-45df-8866-569efa2b2934 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1376753945", "id": 641664033, "os-flavor-access:is_public": "False"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:01.577515 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-814a850b-2465-45df-8866-569efa2b2934 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.039332 Aug 24 10:11:01.578148 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 34/41] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:11:01 2022] POST /compute/v2.1/flavors => generated 412 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:01.578824 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b1d9e19e-932c-4b15-8932-0cd4d8f1f1e8 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.253796 Aug 24 10:11:01.589638 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 8/42] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:10:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:11:01.602936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e4fe694e-c202-4163-bd13-e2b34cb8ec7e tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1481100949", "id": 309931640, "os-flavor-access:is_public": "True"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:01.603142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d7d624f3-d333-41c2-9634-6b2d69377cef tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:01.603559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d7d624f3-d333-41c2-9634-6b2d69377cef tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:01.659960 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e4fe694e-c202-4163-bd13-e2b34cb8ec7e tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.071609 Aug 24 10:11:01.670224 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 35/43] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:11:01 2022] POST /compute/v2.1/flavors => generated 411 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:01.682114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-47efcc30-1cee-4901-b273-78c271305d11 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:01.716798 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-47efcc30-1cee-4901-b273-78c271305d11 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.044657 Aug 24 10:11:01.732721 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 36/44] 10.222.0.85 () {58 vars in 1169 bytes} [Wed Aug 24 10:11:01 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:01.741905 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9f8d29a3-5665-4114-80fb-a4b9bf5546a8 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:01.753441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d7d624f3-d333-41c2-9634-6b2d69377cef tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213baa7d5703491b9ea67a5f7231212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd058330a96034236a9429ab2891a111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:01.763014 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9f8d29a3-5665-4114-80fb-a4b9bf5546a8 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.028793 Aug 24 10:11:01.772860 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 37/45] 10.222.0.85 () {58 vars in 1177 bytes} [Wed Aug 24 10:11:01 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:01.777831 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ff69c97e-320f-45e8-85b2-5556491e1905 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:01.782320 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d7d624f3-d333-41c2-9634-6b2d69377cef tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 200 len: 1243 microversion: 2.1 time: 0.188856 Aug 24 10:11:01.790188 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ff69c97e-320f-45e8-85b2-5556491e1905 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.016002 Aug 24 10:11:01.791128 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 9/46] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:01 2022] GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 1243 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:01.799963 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 38/47] 10.222.0.85 () {58 vars in 1171 bytes} [Wed Aug 24 10:11:01 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:01.811730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8cdea1a1-52d3-43a0-b207-b7e91aacacb1 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:01.854531 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8cdea1a1-52d3-43a0-b207-b7e91aacacb1 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.054485 Aug 24 10:11:01.856425 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 10/48] 10.222.0.85 () {58 vars in 1169 bytes} [Wed Aug 24 10:11:01 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:01.867451 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fe0a66c9-edee-4f93-90e0-6eeb91c71184 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:01.910287 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fe0a66c9-edee-4f93-90e0-6eeb91c71184 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5392 microversion: 2.1 time: 0.046358 Aug 24 10:11:01.925298 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 39/49] 10.222.0.85 () {58 vars in 1169 bytes} [Wed Aug 24 10:11:01 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5392 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:01.930938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ba415d26-27be-4653-8ba5-12a2ec9806f1 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:01.955444 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ba415d26-27be-4653-8ba5-12a2ec9806f1 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5392 microversion: 2.1 time: 0.029660 Aug 24 10:11:01.962221 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 11/50] 10.222.0.85 () {58 vars in 1175 bytes} [Wed Aug 24 10:11:01 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5392 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:01.973916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a7a580ba-69aa-4edd-8353-3215f2dfa649 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:02.007730 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a7a580ba-69aa-4edd-8353-3215f2dfa649 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.037464 Aug 24 10:11:02.008346 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 40/51] 10.222.0.85 () {58 vars in 1173 bytes} [Wed Aug 24 10:11:01 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:02.030955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2674f30c-c57d-4240-8c64-c7b0379988f7 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:02.090670 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2674f30c-c57d-4240-8c64-c7b0379988f7 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.061069 Aug 24 10:11:02.091345 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 12/52] 10.222.0.85 () {58 vars in 1169 bytes} [Wed Aug 24 10:11:02 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:02.109646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4bdccfb9-bb92-4384-931d-d9e6bcc91054 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:02.145899 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4bdccfb9-bb92-4384-931d-d9e6bcc91054 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/309931640" status: 202 len: 0 microversion: 2.1 time: 0.038827 Aug 24 10:11:02.146769 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 41/53] 10.222.0.85 () {58 vars in 1158 bytes} [Wed Aug 24 10:11:02 2022] DELETE /compute/v2.1/flavors/309931640 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:11:02.162797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4c0f0e4e-ad57-4473-bc85-0978b61d2c54 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:02.219349 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4c0f0e4e-ad57-4473-bc85-0978b61d2c54 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066993 Aug 24 10:11:02.226315 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 13/54] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:11:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:02.238267 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-68d94477-a34d-40d2-8e92-984439fe1d55 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:02.273757 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-68d94477-a34d-40d2-8e92-984439fe1d55 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/641664033" status: 202 len: 0 microversion: 2.1 time: 0.037996 Aug 24 10:11:02.277714 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 42/55] 10.222.0.85 () {58 vars in 1158 bytes} [Wed Aug 24 10:11:02 2022] DELETE /compute/v2.1/flavors/641664033 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:11:02.283812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8b09ff02-e8b9-412e-91d3-51a5bd94f829 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:02.313044 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8b09ff02-e8b9-412e-91d3-51a5bd94f829 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033669 Aug 24 10:11:02.314344 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 14/56] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:11:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:02.335685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fdac046c-373c-4574-af3c-8062ffe745a0 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-998744128", "id": 1710605717, "os-flavor-access:is_public": "False"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:02.379529 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fdac046c-373c-4574-af3c-8062ffe745a0 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.048572 Aug 24 10:11:02.380683 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 43/57] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:11:02 2022] POST /compute/v2.1/flavors => generated 414 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:02.393574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d3a7810-6114-4026-b809-57db8a1241f2 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:02.422151 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9d3a7810-6114-4026-b809-57db8a1241f2 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032866 Aug 24 10:11:02.422918 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 44/58] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:11:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:02.449077 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-18bc166e-3161-4e01-aa26-106aeb612ec8 tempest-FlavorsAdminTestJSON-2032248650 tempest-FlavorsAdminTestJSON-2032248650-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:02.483643 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-18bc166e-3161-4e01-aa26-106aeb612ec8 tempest-FlavorsAdminTestJSON-2032248650 tempest-FlavorsAdminTestJSON-2032248650-project] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045525 Aug 24 10:11:02.484248 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 45/59] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:11:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:11:02.502551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cf117872-be91-4a99-9715-7abda573bf0e tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:02.535042 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cf117872-be91-4a99-9715-7abda573bf0e tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/1710605717" status: 202 len: 0 microversion: 2.1 time: 0.036455 Aug 24 10:11:02.535816 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 46/60] 10.222.0.85 () {58 vars in 1161 bytes} [Wed Aug 24 10:11:02 2022] DELETE /compute/v2.1/flavors/1710605717 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 10:11:02.544269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-289c0748-3805-4ec8-879d-141ff27627d6 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:02.595598 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-289c0748-3805-4ec8-879d-141ff27627d6 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054909 Aug 24 10:11:02.599515 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 47/61] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:11:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:02.616884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dff7f3ac-bd63-430c-8269-4ab9f996a52c tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-899710132", "id": 1043520003, "os-flavor-access:is_public": "True"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:02.647422 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dff7f3ac-bd63-430c-8269-4ab9f996a52c tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.035224 Aug 24 10:11:02.650132 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 48/62] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:11:02 2022] POST /compute/v2.1/flavors => generated 413 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:02.664500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-23977019-f766-4f89-91db-ed40f5b42514 tempest-FlavorsAdminTestJSON-2032248650 tempest-FlavorsAdminTestJSON-2032248650-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:02.713592 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-23977019-f766-4f89-91db-ed40f5b42514 tempest-FlavorsAdminTestJSON-2032248650 tempest-FlavorsAdminTestJSON-2032248650-project] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.054973 Aug 24 10:11:02.714836 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 49/63] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:11:02 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:11:02.739818 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5406fc03-26ac-491a-9f97-16224cd28b88 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:02.766839 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5406fc03-26ac-491a-9f97-16224cd28b88 tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/1043520003" status: 202 len: 0 microversion: 2.1 time: 0.035819 Aug 24 10:11:02.769210 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 50/64] 10.222.0.85 () {58 vars in 1161 bytes} [Wed Aug 24 10:11:02 2022] DELETE /compute/v2.1/flavors/1043520003 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:11:02.779997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-39390b0d-49af-4107-8d7e-96c002c255ed tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:02.821656 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-39390b0d-49af-4107-8d7e-96c002c255ed tempest-FlavorsAdminTestJSON-97682723 tempest-FlavorsAdminTestJSON-97682723-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049227 Aug 24 10:11:02.823514 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 51/65] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:11:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:02.830235 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b51aa28a-5646-4e14-82d1-23c5483702f8 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:02.838896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b51aa28a-5646-4e14-82d1-23c5483702f8 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:02.857322 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6,nova_api:DELETE=18 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:03.027659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5c38f2e9-a18f-41d9-9d2b-af544af32d0d tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1060392857", "id": 1807099021, "os-flavor-access:is_public": "False"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:03.031864 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:03.031864 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:03.097673 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5c38f2e9-a18f-41d9-9d2b-af544af32d0d tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.721094 Aug 24 10:11:03.098574 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 15/66] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:11:02 2022] POST /compute/v2.1/flavors => generated 439 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:11:03.119050 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b467c7d9-254b-4236-be39-c0299b69adc8 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "93ff8abac45b4d0ea0c070c332af574c"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:03.121831 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:03.121831 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:03.688779 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b51aa28a-5646-4e14-82d1-23c5483702f8 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213baa7d5703491b9ea67a5f7231212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd058330a96034236a9429ab2891a111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:03.700889 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b467c7d9-254b-4236-be39-c0299b69adc8 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors/1807099021/action" status: 200 len: 97 microversion: 2.1 time: 0.592782 Aug 24 10:11:03.706536 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 16/67] 10.222.0.85 () {60 vars in 1200 bytes} [Wed Aug 24 10:11:03 2022] POST /compute/v2.1/flavors/1807099021/action => generated 97 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 10:11:03.716805 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9837bd40-f729-46bd-a7d1-9812dbf2a9fb tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "93ff8abac45b4d0ea0c070c332af574c"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:03.728412 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b51aa28a-5646-4e14-82d1-23c5483702f8 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 200 len: 1243 microversion: 2.1 time: 0.903677 Aug 24 10:11:03.729499 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 52/68] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:02 2022] GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 1243 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:04.465711 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-9837bd40-f729-46bd-a7d1-9812dbf2a9fb tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] HTTP exception thrown: Flavor access already exists for flavor 27 and project 93ff8abac45b4d0ea0c070c332af574c combination. Aug 24 10:11:04.495841 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9837bd40-f729-46bd-a7d1-9812dbf2a9fb tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] Request method failure captured: Aug 24 10:11:04.495841 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/flavors/1807099021/action HTTP/1.1 Aug 24 10:11:04.495841 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:11:04.495841 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:11:04.495841 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:11:04.495841 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 67 Aug 24 10:11:04.495841 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:11:04.495841 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:11:04.495841 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:11:04.495841 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:04.495841 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfkz2fvmgmy0GgfYPYtDwJI7yTf99Q7AAlJ0rRM0CN5FbNTU6qmswUBNp67h3Chy2pHEqpIBHY4gZwVWwyaUSOpfzD8XWD77ghd_E-qRfD9hy6DoGea7Ocj3Wd_iLDXeUXcAqAbkVVzoQFS-ucSUrevhfOs6LK25_f2ldjuOK95hsRY Aug 24 10:11:04.495841 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:11:04.495841 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:11:04.495841 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:11:04.495841 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:11:04.495841 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:11:04.495841 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:11:04.495841 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: aac2d1da66a148658abd9497ed923a42 Aug 24 10:11:04.495841 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1347777399 Aug 24 10:11:04.495841 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:11:04.495841 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:11:04.497254 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/aac2d1da66a148658abd9497ed923a42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_aac2d1da66a148658abd9497ed923a42", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/aac2d1da66a148658abd9497ed923a42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/aac2d1da66a148658abd9497ed923a42"}]}] Aug 24 10:11:04.497254 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1347777399 Aug 24 10:11:04.497254 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: aac2d1da66a148658abd9497ed923a42 Aug 24 10:11:04.497254 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1347777399 Aug 24 10:11:04.497254 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin Aug 24 10:11:04.497254 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:11:04.497254 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:11:04.497254 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 88b568f89f724ddcb00f40b4e3c02b17 Aug 24 10:11:04.497254 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin Aug 24 10:11:04.497254 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:11:04.497254 n-d-849328-3 devstack@n-api.service[122433]: {"addTenantAccess": {"tenant": "93ff8abac45b4d0ea0c070c332af574c"}} Aug 24 10:11:04.497254 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:11:04.498136 n-d-849328-3 devstack@n-api.service[122433]: exception: Flavor access already exists for flavor 27 and project 93ff8abac45b4d0ea0c070c332af574c combination. Aug 24 10:11:04.498136 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '1807099021', 'body': {'addTenantAccess': {'tenant': '93ff8abac45b4d0ea0c070c332af574c'}}} Aug 24 10:11:04.498136 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:04.498136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:04.498136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 10:11:04.498136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 24 10:11:04.498136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 10:11:04.498136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 24 10:11:04.498136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 10:11:04.498136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 24 10:11:04.498136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 10:11:04.498136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 24 10:11:04.498136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 10:11:04.498136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 10:11:04.498136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 10:11:04.498136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result.read() Aug 24 10:11:04.498136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 10:11:04.498136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 24 10:11:04.499422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 10:11:04.499422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 24 10:11:04.499422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 10:11:04.499422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 24 10:11:04.499422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 10:11:04.499422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 24 10:11:04.499422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '27-93ff8abac45b4d0ea0c070c332af574c' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 24 10:11:04.499422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:04.499422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 24 10:11:04.499422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:04.499422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:04.499422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 24 10:11:04.499422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 24 10:11:04.499422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 24 10:11:04.499422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi session.flush() Aug 24 10:11:04.499422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 10:11:04.499422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 24 10:11:04.499422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 10:11:04.499422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 24 10:11:04.500486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 10:11:04.500486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 24 10:11:04.500486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 10:11:04.500486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception Aug 24 10:11:04.500486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 10:11:04.500486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 24 10:11:04.500486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 10:11:04.500486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 24 10:11:04.500486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 10:11:04.500486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 24 10:11:04.500486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 10:11:04.500486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 24 10:11:04.500486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 10:11:04.500486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 24 10:11:04.500486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 10:11:04.500486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 10:11:04.500486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 10:11:04.500486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 24 10:11:04.501860 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 10:11:04.501860 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 24 10:11:04.501860 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 10:11:04.501860 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 24 10:11:04.501860 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 10:11:04.501860 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 10:11:04.501860 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 10:11:04.501860 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception Aug 24 10:11:04.501860 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 10:11:04.501860 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 24 10:11:04.501860 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 10:11:04.501860 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 24 10:11:04.501860 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 10:11:04.501860 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 24 10:11:04.501860 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 10:11:04.501860 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 24 10:11:04.501860 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 10:11:04.501860 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 10:11:04.507269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 10:11:04.507269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result.read() Aug 24 10:11:04.507269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 10:11:04.507269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 24 10:11:04.507269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 10:11:04.507269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 24 10:11:04.507269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 10:11:04.507269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 24 10:11:04.507269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 10:11:04.507269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 24 10:11:04.507269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '27-93ff8abac45b4d0ea0c070c332af574c' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 24 10:11:04.507269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 24 10:11:04.507269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 24, 10, 11, 4, 455876), 'updated_at': None, 'flavor_id': 27, 'project_id': '93ff8abac45b4d0ea0c070c332af574c'}] Aug 24 10:11:04.507269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 10:11:04.507269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:04.507269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:04.507269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:04.508630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:04.508630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 24 10:11:04.508630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 24 10:11:04.508630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 24 10:11:04.508630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 24 10:11:04.508630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 24 10:11:04.508630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 24 10:11:04.508630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 24 10:11:04.508630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 24 10:11:04.508630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 24 10:11:04.508630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 24 10:11:04.508630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 10:11:04.508630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 10:11:04.508630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 24 10:11:04.508630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 24 10:11:04.508630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 27 and project 93ff8abac45b4d0ea0c070c332af574c combination. Aug 24 10:11:04.508630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:04.508630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:04.508630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:04.509975 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:04.509975 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:04.509975 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:04.509975 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:04.509975 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:04.509975 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:04.509975 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:04.509975 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:04.509975 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:04.509975 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 24 10:11:04.509975 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 24 10:11:04.509975 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 27 and project 93ff8abac45b4d0ea0c070c332af574c combination. Aug 24 10:11:04.509975 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:04.509975 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:04.509975 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:04.509975 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:04.509975 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:04.509975 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:04.509975 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:11:04.509975 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:11:04.511031 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 27 and project 93ff8abac45b4d0ea0c070c332af574c combination. Aug 24 10:11:04.511031 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:04.513423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9837bd40-f729-46bd-a7d1-9812dbf2a9fb tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] Returning 409 to user: Flavor access already exists for flavor 27 and project 93ff8abac45b4d0ea0c070c332af574c combination. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:04.519499 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9837bd40-f729-46bd-a7d1-9812dbf2a9fb tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors/1807099021/action" status: 409 len: 152 microversion: 2.1 time: 0.806636 Aug 24 10:11:04.523186 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 17/69] 10.222.0.85 () {60 vars in 1200 bytes} [Wed Aug 24 10:11:03 2022] POST /compute/v2.1/flavors/1807099021/action => generated 152 bytes in 811 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 10:11:04.532512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5780a729-d1b7-4dfa-a8c4-4847fd9f0e54 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "93ff8abac45b4d0ea0c070c332af574c"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:04.536601 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:04.536601 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:04.752853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7f61cb75-8b0b-42f6-b10b-5f261699f542 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:04.753845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7f61cb75-8b0b-42f6-b10b-5f261699f542 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:04.763808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f61cb75-8b0b-42f6-b10b-5f261699f542 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:04.770305 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f61cb75-8b0b-42f6-b10b-5f261699f542 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:04.775339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f61cb75-8b0b-42f6-b10b-5f261699f542 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:04.776673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f61cb75-8b0b-42f6-b10b-5f261699f542 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:04.777250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f61cb75-8b0b-42f6-b10b-5f261699f542 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:04.777598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f61cb75-8b0b-42f6-b10b-5f261699f542 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:05.045239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7f61cb75-8b0b-42f6-b10b-5f261699f542 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213baa7d5703491b9ea67a5f7231212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd058330a96034236a9429ab2891a111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:05.078139 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7f61cb75-8b0b-42f6-b10b-5f261699f542 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 200 len: 1297 microversion: 2.1 time: 0.329995 Aug 24 10:11:05.079165 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 18/70] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:04 2022] GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 1297 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:11:05.099856 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5780a729-d1b7-4dfa-a8c4-4847fd9f0e54 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors/1807099021/action" status: 200 len: 21 microversion: 2.1 time: 0.566909 Aug 24 10:11:05.107233 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 53/71] 10.222.0.85 () {60 vars in 1200 bytes} [Wed Aug 24 10:11:04 2022] POST /compute/v2.1/flavors/1807099021/action => generated 21 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:11:05.112272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-af0b3688-3ad0-413c-9da1-9d12647694f0 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:05.112974 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:05.112974 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:05.152277 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-af0b3688-3ad0-413c-9da1-9d12647694f0 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/1807099021" status: 202 len: 0 microversion: 2.1 time: 0.042972 Aug 24 10:11:05.154401 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 19/72] 10.222.0.85 () {58 vars in 1161 bytes} [Wed Aug 24 10:11:05 2022] DELETE /compute/v2.1/flavors/1807099021 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:11:05.163896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-86e54395-96ac-4c88-aaaa-23309921c64d tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:05.252608 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-86e54395-96ac-4c88-aaaa-23309921c64d tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.093967 Aug 24 10:11:05.266912 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 54/73] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:11:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:05.279467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d57cc57c-51d8-4b6d-9a2f-d000ee20cff0 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1171717821", "id": 1578971483, "os-flavor-access:is_public": "True"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:05.285376 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:05.285376 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:05.311742 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d57cc57c-51d8-4b6d-9a2f-d000ee20cff0 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.041627 Aug 24 10:11:05.318044 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 20/74] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:11:05 2022] POST /compute/v2.1/flavors => generated 438 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:05.331597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-39e4b0af-1848-4c7a-b1f4-157fc20a7767 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:05.332851 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:05.332851 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:05.345789 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-39e4b0af-1848-4c7a-b1f4-157fc20a7767 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 24 10:11:05.349916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-39e4b0af-1848-4c7a-b1f4-157fc20a7767 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] Request method failure captured: Aug 24 10:11:05.349916 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/flavors/1578971483/os-flavor-access HTTP/1.1 Aug 24 10:11:05.349916 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:11:05.349916 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:11:05.349916 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:11:05.349916 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:11:05.349916 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:11:05.349916 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:11:05.349916 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:11:05.349916 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:05.349916 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfkz2fvmgmy0GgfYPYtDwJI7yTf99Q7AAlJ0rRM0CN5FbNTU6qmswUBNp67h3Chy2pHEqpIBHY4gZwVWwyaUSOpfzD8XWD77ghd_E-qRfD9hy6DoGea7Ocj3Wd_iLDXeUXcAqAbkVVzoQFS-ucSUrevhfOs6LK25_f2ldjuOK95hsRY Aug 24 10:11:05.349916 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:11:05.349916 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:11:05.349916 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:11:05.349916 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:11:05.349916 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:11:05.349916 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:11:05.349916 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: aac2d1da66a148658abd9497ed923a42 Aug 24 10:11:05.349916 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1347777399 Aug 24 10:11:05.349916 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,admin,member Aug 24 10:11:05.349916 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,admin,member Aug 24 10:11:05.351657 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/aac2d1da66a148658abd9497ed923a42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_aac2d1da66a148658abd9497ed923a42", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/aac2d1da66a148658abd9497ed923a42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/aac2d1da66a148658abd9497ed923a42"}]}] Aug 24 10:11:05.351657 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1347777399 Aug 24 10:11:05.351657 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: aac2d1da66a148658abd9497ed923a42 Aug 24 10:11:05.351657 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1347777399 Aug 24 10:11:05.351657 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin Aug 24 10:11:05.351657 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:11:05.351657 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:11:05.351657 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 88b568f89f724ddcb00f40b4e3c02b17 Aug 24 10:11:05.351657 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin Aug 24 10:11:05.351657 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:11:05.351657 n-d-849328-3 devstack@n-api.service[122432]: exception: Access list not available for public flavors. Aug 24 10:11:05.351657 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'flavor_id': '1578971483'} Aug 24 10:11:05.352492 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:05.352492 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:05.352492 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:05.352492 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:05.352492 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:05.352492 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:05.352492 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:05.352492 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:05.352492 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 24 10:11:05.352492 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 10:11:05.352492 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 24 10:11:05.352492 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:05.352492 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:05.352492 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:05.352492 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:05.352492 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:05.352492 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:05.352492 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:11:05.352492 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:11:05.352492 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 24 10:11:05.352492 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:05.353834 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-39e4b0af-1848-4c7a-b1f4-157fc20a7767 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:05.355639 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-39e4b0af-1848-4c7a-b1f4-157fc20a7767 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/1578971483/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.028284 Aug 24 10:11:05.359151 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 55/75] 10.222.0.85 () {58 vars in 1209 bytes} [Wed Aug 24 10:11:05 2022] GET /compute/v2.1/flavors/1578971483/os-flavor-access => generated 91 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:11:05.367901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c72b4ba-553d-417e-997d-dd3798d59901 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:05.383292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=10,nova_api:DELETE=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:05.413184 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2c72b4ba-553d-417e-997d-dd3798d59901 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/1578971483" status: 202 len: 0 microversion: 2.1 time: 0.049117 Aug 24 10:11:05.413807 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 21/76] 10.222.0.85 () {58 vars in 1161 bytes} [Wed Aug 24 10:11:05 2022] DELETE /compute/v2.1/flavors/1578971483 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:11:05.422677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bcf9590c-ed50-44be-800c-0e06ba10ce45 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:05.469664 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bcf9590c-ed50-44be-800c-0e06ba10ce45 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044864 Aug 24 10:11:05.471788 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 56/77] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:11:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:05.494380 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f2ddaed1-47ea-406c-be7a-9a4fa6a660bc tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2089349927", "id": 684350105, "os-flavor-access:is_public": "False"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:05.550397 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f2ddaed1-47ea-406c-be7a-9a4fa6a660bc tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.064675 Aug 24 10:11:05.555621 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 22/78] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:11:05 2022] POST /compute/v2.1/flavors => generated 436 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:06.100035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e42bdacd-4ae4-433d-92c6-ccd300f689c5 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:06.100757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e42bdacd-4ae4-433d-92c6-ccd300f689c5 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:06.110448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e42bdacd-4ae4-433d-92c6-ccd300f689c5 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:06.119298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e42bdacd-4ae4-433d-92c6-ccd300f689c5 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:06.122961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e42bdacd-4ae4-433d-92c6-ccd300f689c5 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:06.124026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e42bdacd-4ae4-433d-92c6-ccd300f689c5 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:06.125002 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e42bdacd-4ae4-433d-92c6-ccd300f689c5 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:06.126345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e42bdacd-4ae4-433d-92c6-ccd300f689c5 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:06.251065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8195f2bd-310e-4329-b037-cac0826d80a2 tempest-FlavorsAccessNegativeTestJSON-886016601 tempest-FlavorsAccessNegativeTestJSON-886016601-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "93ff8abac45b4d0ea0c070c332af574c"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:06.254879 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:06.254879 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:06.256447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8195f2bd-310e-4329-b037-cac0826d80a2 tempest-FlavorsAccessNegativeTestJSON-886016601 tempest-FlavorsAccessNegativeTestJSON-886016601-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '017a7d2e394a412db82cbca4446f7afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ff8abac45b4d0ea0c070c332af574c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:06.259260 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8195f2bd-310e-4329-b037-cac0826d80a2 tempest-FlavorsAccessNegativeTestJSON-886016601 tempest-FlavorsAccessNegativeTestJSON-886016601-project] Request method failure captured: Aug 24 10:11:06.259260 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/flavors/684350105/action HTTP/1.1 Aug 24 10:11:06.259260 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:11:06.259260 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:11:06.259260 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:11:06.259260 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 67 Aug 24 10:11:06.259260 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:11:06.259260 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:11:06.259260 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:11:06.259260 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:06.259260 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfkypopMWqWqZeGd3FxoMbnKEUy1FdBpxO6yhpdLRw35wlcVW_N74lWRJ2gEmK1EZ1i_bvFKHC0j9AAQ2b8XAQRB_FHIGJJZ9JcmSgOXAeBC4_-PezGqr0jxS5OVTr1oteh2vhqn4X2lNdlFMPs6P4JSz8SMtGSxwm3zO17e1ZOn11c Aug 24 10:11:06.259260 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:11:06.259260 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:11:06.259260 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:11:06.259260 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:11:06.259260 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:11:06.259260 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:11:06.259260 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 93ff8abac45b4d0ea0c070c332af574c Aug 24 10:11:06.259260 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-886016601 Aug 24 10:11:06.259260 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:11:06.259260 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:11:06.260454 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/93ff8abac45b4d0ea0c070c332af574c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_93ff8abac45b4d0ea0c070c332af574c", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/93ff8abac45b4d0ea0c070c332af574c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/93ff8abac45b4d0ea0c070c332af574c"}]}] Aug 24 10:11:06.260454 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-886016601 Aug 24 10:11:06.260454 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 93ff8abac45b4d0ea0c070c332af574c Aug 24 10:11:06.260454 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-886016601 Aug 24 10:11:06.260454 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-FlavorsAccessNegativeTestJSON-886016601-project Aug 24 10:11:06.260454 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:11:06.260454 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:11:06.260454 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 017a7d2e394a412db82cbca4446f7afd Aug 24 10:11:06.260454 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-886016601-project Aug 24 10:11:06.260454 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:11:06.260454 n-d-849328-3 devstack@n-api.service[122432]: {"addTenantAccess": {"tenant": "93ff8abac45b4d0ea0c070c332af574c"}} Aug 24 10:11:06.260454 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:11:06.261075 n-d-849328-3 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 24 10:11:06.261075 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '684350105', 'body': {'addTenantAccess': {'tenant': '93ff8abac45b4d0ea0c070c332af574c'}}} Aug 24 10:11:06.261075 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:06.261075 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:06.261075 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:06.261075 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:06.261075 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:06.261075 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:06.261075 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:06.261075 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:06.261075 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:06.261075 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:06.261075 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 24 10:11:06.261075 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 24 10:11:06.261075 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:11:06.261075 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:11:06.261075 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:11:06.261075 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:11:06.261075 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:11:06.262023 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:11:06.262023 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:11:06.262023 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:11:06.262023 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:11:06.262023 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:11:06.262023 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:11:06.262023 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:11:06.262023 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:11:06.262023 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:11:06.262023 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 24 10:11:06.262023 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:06.262023 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:06.262023 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:06.262023 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:06.262023 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:06.262023 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:06.262023 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:11:06.262023 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:11:06.262023 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 24 10:11:06.262023 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:06.265569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8195f2bd-310e-4329-b037-cac0826d80a2 tempest-FlavorsAccessNegativeTestJSON-886016601 tempest-FlavorsAccessNegativeTestJSON-886016601-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:06.266746 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8195f2bd-310e-4329-b037-cac0826d80a2 tempest-FlavorsAccessNegativeTestJSON-886016601 tempest-FlavorsAccessNegativeTestJSON-886016601-project] 10.222.0.85 "POST /compute/v2.1/flavors/684350105/action" status: 403 len: 130 microversion: 2.1 time: 0.706431 Aug 24 10:11:06.268124 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 57/79] 10.222.0.85 () {60 vars in 1197 bytes} [Wed Aug 24 10:11:05 2022] POST /compute/v2.1/flavors/684350105/action => generated 130 bytes in 708 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:11:06.281060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fcb56249-8c9f-4f11-9b3c-0e339d20ed1c tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:06.285922 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:06.285922 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:06.354061 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fcb56249-8c9f-4f11-9b3c-0e339d20ed1c tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/684350105" status: 202 len: 0 microversion: 2.1 time: 0.064637 Aug 24 10:11:06.361964 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 58/80] 10.222.0.85 () {58 vars in 1158 bytes} [Wed Aug 24 10:11:06 2022] DELETE /compute/v2.1/flavors/684350105 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:11:06.368305 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1f5fd570-23a0-4bc1-8086-c465121bbf6d tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:06.391278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e42bdacd-4ae4-433d-92c6-ccd300f689c5 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213baa7d5703491b9ea67a5f7231212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd058330a96034236a9429ab2891a111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:06.406165 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e42bdacd-4ae4-433d-92c6-ccd300f689c5 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 200 len: 1297 microversion: 2.1 time: 0.310272 Aug 24 10:11:06.410796 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 23/81] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:06 2022] GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 1297 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:11:06.444477 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1f5fd570-23a0-4bc1-8086-c465121bbf6d tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.083753 Aug 24 10:11:06.467814 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 59/82] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:11:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:06.474268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c5b0bd58-8f1c-4762-8d49-abae69935e83 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-590817291", "id": 1636540394, "os-flavor-access:is_public": "False"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:06.477244 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:06.477244 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:06.512687 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c5b0bd58-8f1c-4762-8d49-abae69935e83 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.041454 Aug 24 10:11:06.513355 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 24/83] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:11:06 2022] POST /compute/v2.1/flavors => generated 438 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:11:06.526193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-435d0081-2243-4485-a4db-bb2ad2ecd26a tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "93ff8abac45b4d0ea0c070c332af574c"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:07.435140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e1ab2e33-d95d-4ffa-9012-3a48e5bbfb9e tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:07.435980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e1ab2e33-d95d-4ffa-9012-3a48e5bbfb9e tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:07.459882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1ab2e33-d95d-4ffa-9012-3a48e5bbfb9e tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:07.463368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1ab2e33-d95d-4ffa-9012-3a48e5bbfb9e tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:07.467168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1ab2e33-d95d-4ffa-9012-3a48e5bbfb9e tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:07.468090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1ab2e33-d95d-4ffa-9012-3a48e5bbfb9e tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:07.468648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1ab2e33-d95d-4ffa-9012-3a48e5bbfb9e tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:07.469080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1ab2e33-d95d-4ffa-9012-3a48e5bbfb9e tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:07.873960 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-435d0081-2243-4485-a4db-bb2ad2ecd26a tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors/1636540394/action" status: 200 len: 97 microversion: 2.1 time: 1.351701 Aug 24 10:11:07.885445 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 60/84] 10.222.0.85 () {60 vars in 1200 bytes} [Wed Aug 24 10:11:06 2022] POST /compute/v2.1/flavors/1636540394/action => generated 97 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:11:07.896599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ab1b2aea-8566-4446-8684-be88841ffd4e tempest-FlavorsAccessNegativeTestJSON-886016601 tempest-FlavorsAccessNegativeTestJSON-886016601-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "93ff8abac45b4d0ea0c070c332af574c"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:07.902544 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ab1b2aea-8566-4446-8684-be88841ffd4e tempest-FlavorsAccessNegativeTestJSON-886016601 tempest-FlavorsAccessNegativeTestJSON-886016601-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '017a7d2e394a412db82cbca4446f7afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ff8abac45b4d0ea0c070c332af574c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:07.904927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ab1b2aea-8566-4446-8684-be88841ffd4e tempest-FlavorsAccessNegativeTestJSON-886016601 tempest-FlavorsAccessNegativeTestJSON-886016601-project] Request method failure captured: Aug 24 10:11:07.904927 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/flavors/1636540394/action HTTP/1.1 Aug 24 10:11:07.904927 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:11:07.904927 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:11:07.904927 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:11:07.904927 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 70 Aug 24 10:11:07.904927 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:11:07.904927 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:11:07.904927 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:11:07.904927 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:07.904927 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfkypopMWqWqZeGd3FxoMbnKEUy1FdBpxO6yhpdLRw35wlcVW_N74lWRJ2gEmK1EZ1i_bvFKHC0j9AAQ2b8XAQRB_FHIGJJZ9JcmSgOXAeBC4_-PezGqr0jxS5OVTr1oteh2vhqn4X2lNdlFMPs6P4JSz8SMtGSxwm3zO17e1ZOn11c Aug 24 10:11:07.904927 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:11:07.904927 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:11:07.904927 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:11:07.904927 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:11:07.904927 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:11:07.904927 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:11:07.904927 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 93ff8abac45b4d0ea0c070c332af574c Aug 24 10:11:07.904927 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-886016601 Aug 24 10:11:07.904927 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:11:07.904927 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:11:07.906642 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/93ff8abac45b4d0ea0c070c332af574c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_93ff8abac45b4d0ea0c070c332af574c", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/93ff8abac45b4d0ea0c070c332af574c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/93ff8abac45b4d0ea0c070c332af574c"}]}] Aug 24 10:11:07.906642 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-886016601 Aug 24 10:11:07.906642 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 93ff8abac45b4d0ea0c070c332af574c Aug 24 10:11:07.906642 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-886016601 Aug 24 10:11:07.906642 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-FlavorsAccessNegativeTestJSON-886016601-project Aug 24 10:11:07.906642 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:11:07.906642 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:11:07.906642 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 017a7d2e394a412db82cbca4446f7afd Aug 24 10:11:07.906642 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-886016601-project Aug 24 10:11:07.906642 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:11:07.906642 n-d-849328-3 devstack@n-api.service[122432]: {"removeTenantAccess": {"tenant": "93ff8abac45b4d0ea0c070c332af574c"}} Aug 24 10:11:07.906642 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:11:07.907410 n-d-849328-3 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 24 10:11:07.907410 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '1636540394', 'body': {'removeTenantAccess': {'tenant': '93ff8abac45b4d0ea0c070c332af574c'}}} Aug 24 10:11:07.907410 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:07.907410 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:07.907410 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:07.907410 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:07.907410 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:07.907410 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:07.907410 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:07.907410 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:07.907410 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:07.907410 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:07.907410 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 24 10:11:07.907410 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can( Aug 24 10:11:07.907410 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:11:07.907410 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:11:07.907410 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:11:07.907410 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:11:07.907410 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:11:07.907410 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:11:07.909597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:11:07.909597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:11:07.909597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:11:07.909597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:11:07.909597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:11:07.909597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:11:07.909597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:11:07.909597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:11:07.909597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 24 10:11:07.909597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:07.909597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:07.909597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:07.909597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:07.909597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:07.909597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:07.909597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:11:07.909597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:11:07.909597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 24 10:11:07.909597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:07.912951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ab1b2aea-8566-4446-8684-be88841ffd4e tempest-FlavorsAccessNegativeTestJSON-886016601 tempest-FlavorsAccessNegativeTestJSON-886016601-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:07.914070 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ab1b2aea-8566-4446-8684-be88841ffd4e tempest-FlavorsAccessNegativeTestJSON-886016601 tempest-FlavorsAccessNegativeTestJSON-886016601-project] 10.222.0.85 "POST /compute/v2.1/flavors/1636540394/action" status: 403 len: 133 microversion: 2.1 time: 0.022836 Aug 24 10:11:07.919912 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 61/85] 10.222.0.85 () {60 vars in 1200 bytes} [Wed Aug 24 10:11:07 2022] POST /compute/v2.1/flavors/1636540394/action => generated 133 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:11:07.931821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-17de717d-14f2-47dc-83b7-97b6c1cf9955 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "93ff8abac45b4d0ea0c070c332af574c"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:08.702251 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e1ab2e33-d95d-4ffa-9012-3a48e5bbfb9e tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213baa7d5703491b9ea67a5f7231212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd058330a96034236a9429ab2891a111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:08.717263 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e1ab2e33-d95d-4ffa-9012-3a48e5bbfb9e tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 200 len: 1339 microversion: 2.1 time: 1.287031 Aug 24 10:11:08.735820 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 25/86] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:07 2022] GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 1339 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:09.165688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2e430c64-7a81-4e45-865c-b4c877360fcb tempest-AZAdminNegativeTestJSON-1070004982 tempest-AZAdminNegativeTestJSON-1070004982-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:09.166948 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:09.166948 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:09.168990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2e430c64-7a81-4e45-865c-b4c877360fcb tempest-AZAdminNegativeTestJSON-1070004982 tempest-AZAdminNegativeTestJSON-1070004982-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'e518501d67c64acd81c88e084606cde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fcfe5306144f7081bfe5c4e0c10782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:09.186176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2e430c64-7a81-4e45-865c-b4c877360fcb tempest-AZAdminNegativeTestJSON-1070004982 tempest-AZAdminNegativeTestJSON-1070004982-project] Request method failure captured: Aug 24 10:11:09.186176 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 24 10:11:09.186176 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:11:09.186176 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:11:09.186176 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:11:09.186176 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:11:09.186176 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:11:09.186176 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:11:09.186176 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:11:09.186176 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:09.186176 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfk5uw5yc389slFmwzjUCSHDLRs3tOuq2A_zhDV5OGac88Lu0l7oXZsNvYdfH8ptfjFEYmE7i6ypF9xhHPheE1_15xnJKTisiUMx7B2CMy1DR6KiEGneNY8_P8Nonc16P0uz0FyIsSa7lRJvzNUspJKeiDXNTD1Jnt-DDO-au9CjS6c Aug 24 10:11:09.186176 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:11:09.186176 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:11:09.186176 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:11:09.186176 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:11:09.186176 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:11:09.186176 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:11:09.186176 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 92fcfe5306144f7081bfe5c4e0c10782 Aug 24 10:11:09.186176 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1070004982 Aug 24 10:11:09.186176 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:11:09.186176 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:11:09.187702 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/92fcfe5306144f7081bfe5c4e0c10782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_92fcfe5306144f7081bfe5c4e0c10782", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/92fcfe5306144f7081bfe5c4e0c10782"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/92fcfe5306144f7081bfe5c4e0c10782"}]}] Aug 24 10:11:09.187702 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AZAdminNegativeTestJSON-1070004982 Aug 24 10:11:09.187702 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 92fcfe5306144f7081bfe5c4e0c10782 Aug 24 10:11:09.187702 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1070004982 Aug 24 10:11:09.187702 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AZAdminNegativeTestJSON-1070004982-project Aug 24 10:11:09.187702 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:11:09.187702 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:11:09.187702 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: e518501d67c64acd81c88e084606cde9 Aug 24 10:11:09.187702 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AZAdminNegativeTestJSON-1070004982-project Aug 24 10:11:09.187702 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:11:09.187702 n-d-849328-3 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 24 10:11:09.187702 n-d-849328-3 devstack@n-api.service[122433]: action_args: {} Aug 24 10:11:09.188510 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:09.188510 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:09.188510 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:09.188510 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:09.188510 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:09.188510 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:09.188510 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:09.188510 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:09.188510 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 24 10:11:09.188510 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 24 10:11:09.188510 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:11:09.188510 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:11:09.188510 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:11:09.188510 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:11:09.188510 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:11:09.188510 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:11:09.188510 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:11:09.188510 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:11:09.188510 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:11:09.189753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:11:09.189753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:11:09.189753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:11:09.189753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:11:09.189753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:11:09.189753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 24 10:11:09.189753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:09.189753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:09.189753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:09.189753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:09.189753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:09.189753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:09.189753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:11:09.189753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:11:09.189753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 24 10:11:09.189753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:09.194862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2e430c64-7a81-4e45-865c-b4c877360fcb tempest-AZAdminNegativeTestJSON-1070004982 tempest-AZAdminNegativeTestJSON-1070004982-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:09.204826 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2e430c64-7a81-4e45-865c-b4c877360fcb tempest-AZAdminNegativeTestJSON-1070004982 tempest-AZAdminNegativeTestJSON-1070004982-project] 10.222.0.85 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.459401 Aug 24 10:11:09.206157 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 26/87] 10.222.0.85 () {58 vars in 1185 bytes} [Wed Aug 24 10:11:08 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 470 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:11:09.259884 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-17de717d-14f2-47dc-83b7-97b6c1cf9955 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors/1636540394/action" status: 200 len: 21 microversion: 2.1 time: 1.337520 Aug 24 10:11:09.274326 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f788706a-5b1e-4720-b915-49cc20cb55b3 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:09.276070 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:09.276070 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:09.289843 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 62/88] 10.222.0.85 () {60 vars in 1200 bytes} [Wed Aug 24 10:11:07 2022] POST /compute/v2.1/flavors/1636540394/action => generated 21 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:11:09.342409 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f788706a-5b1e-4720-b915-49cc20cb55b3 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/1636540394" status: 202 len: 0 microversion: 2.1 time: 0.071732 Aug 24 10:11:09.343581 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 27/89] 10.222.0.85 () {58 vars in 1161 bytes} [Wed Aug 24 10:11:09 2022] DELETE /compute/v2.1/flavors/1636540394 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:11:09.353524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d4f70a4d-c308-4ec8-b829-53ff29bfdb79 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:09.416526 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d4f70a4d-c308-4ec8-b829-53ff29bfdb79 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068063 Aug 24 10:11:09.417173 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 63/90] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:11:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:11:09.438782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b0ce072d-20b9-4690-806d-b8cb84167b92 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1358575094", "id": 1645659041, "os-flavor-access:is_public": "False"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:09.443152 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:09.443152 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:09.465751 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b0ce072d-20b9-4690-806d-b8cb84167b92 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.030671 Aug 24 10:11:09.481079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-003e7fba-e0eb-42bb-bb59-ddcd6a2eb24b tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b868fdadf208463e81ee5bb11f014a68"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:09.485516 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 28/91] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:11:09 2022] POST /compute/v2.1/flavors => generated 439 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:11:09.508361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:09.509696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:09.741493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8cbc07dc-3747-4375-bab8-8d0f3bd5f86a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:09.742585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8cbc07dc-3747-4375-bab8-8d0f3bd5f86a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:09.750484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8cbc07dc-3747-4375-bab8-8d0f3bd5f86a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:09.758952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8cbc07dc-3747-4375-bab8-8d0f3bd5f86a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:09.760911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8cbc07dc-3747-4375-bab8-8d0f3bd5f86a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:09.764693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8cbc07dc-3747-4375-bab8-8d0f3bd5f86a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:09.768870 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8cbc07dc-3747-4375-bab8-8d0f3bd5f86a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:09.770065 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8cbc07dc-3747-4375-bab8-8d0f3bd5f86a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:10.347111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8cbc07dc-3747-4375-bab8-8d0f3bd5f86a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213baa7d5703491b9ea67a5f7231212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd058330a96034236a9429ab2891a111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:10.362505 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8cbc07dc-3747-4375-bab8-8d0f3bd5f86a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 200 len: 1339 microversion: 2.1 time: 0.625714 Aug 24 10:11:10.363231 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 29/92] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:09 2022] GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 1339 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:10.367545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8cbc07dc-3747-4375-bab8-8d0f3bd5f86a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:10.368827 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8cbc07dc-3747-4375-bab8-8d0f3bd5f86a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003726 Aug 24 10:11:10.371486 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 30/93] 10.222.0.85 () {56 vars in 886 bytes} [Wed Aug 24 10:11:10 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 24 10:11:10.602079 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-003e7fba-e0eb-42bb-bb59-ddcd6a2eb24b tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] HTTP exception thrown: Flavor access not found for 31 / b868fdadf208463e81ee5bb11f014a68 combination. Aug 24 10:11:10.611086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-003e7fba-e0eb-42bb-bb59-ddcd6a2eb24b tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] Request method failure captured: Aug 24 10:11:10.611086 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/flavors/1645659041/action HTTP/1.1 Aug 24 10:11:10.611086 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:11:10.611086 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:11:10.611086 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:11:10.611086 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 70 Aug 24 10:11:10.611086 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:11:10.611086 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:11:10.611086 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:11:10.611086 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:10.611086 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfkz2fvmgmy0GgfYPYtDwJI7yTf99Q7AAlJ0rRM0CN5FbNTU6qmswUBNp67h3Chy2pHEqpIBHY4gZwVWwyaUSOpfzD8XWD77ghd_E-qRfD9hy6DoGea7Ocj3Wd_iLDXeUXcAqAbkVVzoQFS-ucSUrevhfOs6LK25_f2ldjuOK95hsRY Aug 24 10:11:10.611086 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:11:10.611086 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:11:10.611086 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:11:10.611086 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:11:10.611086 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:11:10.611086 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:11:10.611086 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: aac2d1da66a148658abd9497ed923a42 Aug 24 10:11:10.611086 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1347777399 Aug 24 10:11:10.611086 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,admin,member Aug 24 10:11:10.611086 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,admin,member Aug 24 10:11:10.612389 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/aac2d1da66a148658abd9497ed923a42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_aac2d1da66a148658abd9497ed923a42", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/aac2d1da66a148658abd9497ed923a42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/aac2d1da66a148658abd9497ed923a42"}]}] Aug 24 10:11:10.612389 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1347777399 Aug 24 10:11:10.612389 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: aac2d1da66a148658abd9497ed923a42 Aug 24 10:11:10.612389 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1347777399 Aug 24 10:11:10.612389 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin Aug 24 10:11:10.612389 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:11:10.612389 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:11:10.612389 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 88b568f89f724ddcb00f40b4e3c02b17 Aug 24 10:11:10.612389 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin Aug 24 10:11:10.612389 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:11:10.612389 n-d-849328-3 devstack@n-api.service[122432]: {"removeTenantAccess": {"tenant": "b868fdadf208463e81ee5bb11f014a68"}} Aug 24 10:11:10.612389 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:11:10.613024 n-d-849328-3 devstack@n-api.service[122432]: exception: Flavor access not found for 31 / b868fdadf208463e81ee5bb11f014a68 combination. Aug 24 10:11:10.613024 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '1645659041', 'body': {'removeTenantAccess': {'tenant': 'b868fdadf208463e81ee5bb11f014a68'}}} Aug 24 10:11:10.613024 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:10.613024 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:10.613024 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 24 10:11:10.613024 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 24 10:11:10.613024 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 24 10:11:10.613024 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 24 10:11:10.613024 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 24 10:11:10.613024 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 24 10:11:10.613024 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 24 10:11:10.613024 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 24 10:11:10.613024 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 24 10:11:10.613024 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 24 10:11:10.613024 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 10:11:10.613024 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 10:11:10.613024 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 24 10:11:10.613024 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 24 10:11:10.617503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 31 / b868fdadf208463e81ee5bb11f014a68 combination. Aug 24 10:11:10.617503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:10.617503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:10.617503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:10.617503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:10.617503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:10.617503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:10.617503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:10.617503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:10.617503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:10.617503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:10.617503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:10.617503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:10.617503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 24 10:11:10.617503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:11:10.617503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 31 / b868fdadf208463e81ee5bb11f014a68 combination. Aug 24 10:11:10.617503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:10.617503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:10.617503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:10.617503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:10.620158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:10.620158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:10.620158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:11:10.620158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:11:10.620158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 31 / b868fdadf208463e81ee5bb11f014a68 combination. Aug 24 10:11:10.620158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:10.639248 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-003e7fba-e0eb-42bb-bb59-ddcd6a2eb24b tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] Returning 404 to user: Flavor access not found for 31 / b868fdadf208463e81ee5bb11f014a68 combination. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:10.640631 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-003e7fba-e0eb-42bb-bb59-ddcd6a2eb24b tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors/1645659041/action" status: 404 len: 124 microversion: 2.1 time: 1.163819 Aug 24 10:11:10.641528 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 64/94] 10.222.0.85 () {60 vars in 1200 bytes} [Wed Aug 24 10:11:09 2022] POST /compute/v2.1/flavors/1645659041/action => generated 124 bytes in 1166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:11:10.650282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-68e1f045-a884-4828-8867-8d24ec35b1be tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:10.651075 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:10.651075 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:10.689607 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-68e1f045-a884-4828-8867-8d24ec35b1be tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/1645659041" status: 202 len: 0 microversion: 2.1 time: 0.042923 Aug 24 10:11:10.696834 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 31/95] 10.222.0.85 () {58 vars in 1161 bytes} [Wed Aug 24 10:11:10 2022] DELETE /compute/v2.1/flavors/1645659041 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:11:10.699202 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-94f30cd9-1dd3-4be7-8ee0-3c5f4212eff5 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:10.754475 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-94f30cd9-1dd3-4be7-8ee0-3c5f4212eff5 tempest-FlavorsAccessNegativeTestJSON-1347777399 tempest-FlavorsAccessNegativeTestJSON-1347777399-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055853 Aug 24 10:11:10.769150 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 65/96] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:11:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:11.381693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:11.387335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-49067b81-75bb-413d-a6a6-0b93df192950 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:11.388164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-49067b81-75bb-413d-a6a6-0b93df192950 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:11.414922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49067b81-75bb-413d-a6a6-0b93df192950 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:11.415483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49067b81-75bb-413d-a6a6-0b93df192950 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:11.417466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49067b81-75bb-413d-a6a6-0b93df192950 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:11.424401 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49067b81-75bb-413d-a6a6-0b93df192950 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:11.425165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49067b81-75bb-413d-a6a6-0b93df192950 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:11.425781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49067b81-75bb-413d-a6a6-0b93df192950 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:11.773336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:11.813779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-49067b81-75bb-413d-a6a6-0b93df192950 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213baa7d5703491b9ea67a5f7231212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd058330a96034236a9429ab2891a111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:11.824559 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-49067b81-75bb-413d-a6a6-0b93df192950 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 200 len: 1339 microversion: 2.1 time: 0.443680 Aug 24 10:11:11.842052 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 32/97] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:11 2022] GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 1339 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:12.700029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-42f260c8-120b-446c-9501-894512e792ac req-55400713-f473-4ca9-bd69-c061a64702bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9790d01-4c85-4d60-814e-d32faf530877", "tag": "ff1c8f8e-b4f9-4267-9cfe-17547f94eaaf"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:12.740420 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-42f260c8-120b-446c-9501-894512e792ac req-55400713-f473-4ca9-bd69-c061a64702bc service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:12.740935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-42f260c8-120b-446c-9501-894512e792ac req-55400713-f473-4ca9-bd69-c061a64702bc service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:12.741370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-42f260c8-120b-446c-9501-894512e792ac req-55400713-f473-4ca9-bd69-c061a64702bc service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:12.856967 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-42f260c8-120b-446c-9501-894512e792ac req-55400713-f473-4ca9-bd69-c061a64702bc service nova] Creating event network-changed:ff1c8f8e-b4f9-4267-9cfe-17547f94eaaf for instance a9790d01-4c85-4d60-814e-d32faf530877 on n-h2-849328-3 Aug 24 10:11:12.857785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-42f260c8-120b-446c-9501-894512e792ac req-55400713-f473-4ca9-bd69-c061a64702bc service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 10:11:12.858242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-42f260c8-120b-446c-9501-894512e792ac req-55400713-f473-4ca9-bd69-c061a64702bc service nova] Acquired lock "compute-rpcapi-router" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 10:11:12.859678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b29c663-89ed-4f1a-90fc-e1ea7382eed2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:12.860179 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b29c663-89ed-4f1a-90fc-e1ea7382eed2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:12.860650 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b29c663-89ed-4f1a-90fc-e1ea7382eed2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:12.861626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b29c663-89ed-4f1a-90fc-e1ea7382eed2 None None] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:12.863678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b29c663-89ed-4f1a-90fc-e1ea7382eed2 None None] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:12.864483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b29c663-89ed-4f1a-90fc-e1ea7382eed2 None None] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:12.865721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dee6f9fc-834f-4471-8102-904cacc0eb0e tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:12.866997 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dee6f9fc-834f-4471-8102-904cacc0eb0e tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:12.879043 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.compute.rpcapi [None req-0b29c663-89ed-4f1a-90fc-e1ea7382eed2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 10:11:12.879640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dee6f9fc-834f-4471-8102-904cacc0eb0e tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:12.883127 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dee6f9fc-834f-4471-8102-904cacc0eb0e tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:12.887040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b29c663-89ed-4f1a-90fc-e1ea7382eed2 None None] Releasing lock "compute-rpcapi-router" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 10:11:12.887602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dee6f9fc-834f-4471-8102-904cacc0eb0e tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:12.888867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dee6f9fc-834f-4471-8102-904cacc0eb0e tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:12.891288 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dee6f9fc-834f-4471-8102-904cacc0eb0e tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:12.892317 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dee6f9fc-834f-4471-8102-904cacc0eb0e tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:12.949020 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0b29c663-89ed-4f1a-90fc-e1ea7382eed2 None None] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.667193 Aug 24 10:11:12.950085 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 66/98] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:13.254968 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dee6f9fc-834f-4471-8102-904cacc0eb0e tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213baa7d5703491b9ea67a5f7231212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd058330a96034236a9429ab2891a111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:13.275210 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dee6f9fc-834f-4471-8102-904cacc0eb0e tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 200 len: 1339 microversion: 2.1 time: 0.418571 Aug 24 10:11:13.290751 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 33/99] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:12 2022] GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 1339 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:14.300524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:14.305398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-41ae6daa-9ce8-4d0d-a729-2917485cf658 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:14.306293 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-41ae6daa-9ce8-4d0d-a729-2917485cf658 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:14.330180 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41ae6daa-9ce8-4d0d-a729-2917485cf658 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:14.333318 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41ae6daa-9ce8-4d0d-a729-2917485cf658 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:14.333811 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41ae6daa-9ce8-4d0d-a729-2917485cf658 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:14.334559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41ae6daa-9ce8-4d0d-a729-2917485cf658 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:14.335027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41ae6daa-9ce8-4d0d-a729-2917485cf658 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:14.344411 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41ae6daa-9ce8-4d0d-a729-2917485cf658 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:15.350419 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-41ae6daa-9ce8-4d0d-a729-2917485cf658 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213baa7d5703491b9ea67a5f7231212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd058330a96034236a9429ab2891a111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:15.375885 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-41ae6daa-9ce8-4d0d-a729-2917485cf658 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 200 len: 1339 microversion: 2.1 time: 1.076344 Aug 24 10:11:15.380571 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 67/100] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:14 2022] GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 1339 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:11:15.763475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3d27ec6e-f848-43b5-9f84-57c743818bf7 tempest-FlavorsExtraSpecsTestJSON-418989414 tempest-FlavorsExtraSpecsTestJSON-418989414-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-668990378", "ram": 512, "vcpus": 1, "disk": 10, "id": 836388578, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:15.775306 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:15.775306 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:15.842012 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3d27ec6e-f848-43b5-9f84-57c743818bf7 tempest-FlavorsExtraSpecsTestJSON-418989414 tempest-FlavorsExtraSpecsTestJSON-418989414-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.841785 Aug 24 10:11:15.843805 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 34/101] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:11:14 2022] POST /compute/v2.1/flavors => generated 412 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:15.857238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-becf1ac4-d428-44ff-84a2-cd6661223356 tempest-FlavorsExtraSpecsTestJSON-418989414 tempest-FlavorsExtraSpecsTestJSON-418989414-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:15.860843 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:15.860843 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:15.957844 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-becf1ac4-d428-44ff-84a2-cd6661223356 tempest-FlavorsExtraSpecsTestJSON-418989414 tempest-FlavorsExtraSpecsTestJSON-418989414-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors/836388578/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.104511 Aug 24 10:11:15.958842 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 68/102] 10.222.0.85 () {60 vars in 1221 bytes} [Wed Aug 24 10:11:15 2022] POST /compute/v2.1/flavors/836388578/os-extra_specs => generated 66 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:11:16.415019 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b2d3b3d7-dc58-443b-a0d7-c450aa904a7d tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:16.421172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b2d3b3d7-dc58-443b-a0d7-c450aa904a7d tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:16.448270 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2d3b3d7-dc58-443b-a0d7-c450aa904a7d tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:16.453481 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2d3b3d7-dc58-443b-a0d7-c450aa904a7d tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:16.457595 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2d3b3d7-dc58-443b-a0d7-c450aa904a7d tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:16.458481 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2d3b3d7-dc58-443b-a0d7-c450aa904a7d tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:16.458962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2d3b3d7-dc58-443b-a0d7-c450aa904a7d tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:16.459394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2d3b3d7-dc58-443b-a0d7-c450aa904a7d tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:16.482253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ff2a4235-abb7-474a-8202-8310e6308280 tempest-FlavorsExtraSpecsTestJSON-497885649 tempest-FlavorsExtraSpecsTestJSON-497885649-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:16.517143 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ff2a4235-abb7-474a-8202-8310e6308280 tempest-FlavorsExtraSpecsTestJSON-497885649 tempest-FlavorsExtraSpecsTestJSON-497885649-project] 10.222.0.85 "GET /compute/v2.1/flavors/836388578/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.552004 Aug 24 10:11:16.535255 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 35/103] 10.222.0.85 () {58 vars in 1200 bytes} [Wed Aug 24 10:11:15 2022] GET /compute/v2.1/flavors/836388578/os-extra_specs => generated 66 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:11:16.549977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b587ae61-3da9-4076-bb5a-de7e0c08b557 tempest-FlavorsExtraSpecsTestJSON-418989414 tempest-FlavorsExtraSpecsTestJSON-418989414-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:16.559356 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:16.559356 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:16.682788 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b587ae61-3da9-4076-bb5a-de7e0c08b557 tempest-FlavorsExtraSpecsTestJSON-418989414 tempest-FlavorsExtraSpecsTestJSON-418989414-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors/836388578/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.146192 Aug 24 10:11:16.690434 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 36/104] 10.222.0.85 () {60 vars in 1221 bytes} [Wed Aug 24 10:11:16 2022] POST /compute/v2.1/flavors/836388578/os-extra_specs => generated 66 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:11:16.701889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a2f40202-035d-4ef0-805e-a150a8192634 tempest-FlavorsExtraSpecsTestJSON-497885649 tempest-FlavorsExtraSpecsTestJSON-497885649-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:16.728804 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a2f40202-035d-4ef0-805e-a150a8192634 tempest-FlavorsExtraSpecsTestJSON-497885649 tempest-FlavorsExtraSpecsTestJSON-497885649-project] 10.222.0.85 "GET /compute/v2.1/flavors/836388578/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.035991 Aug 24 10:11:16.738721 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 37/105] 10.222.0.85 () {58 vars in 1242 bytes} [Wed Aug 24 10:11:16 2022] GET /compute/v2.1/flavors/836388578/os-extra_specs/hw:numa_nodes => generated 22 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:11:16.756493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-abbd55d6-9b06-4b13-839c-d258c98bfc3a tempest-FlavorsExtraSpecsTestJSON-418989414 tempest-FlavorsExtraSpecsTestJSON-418989414-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:16.799129 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-abbd55d6-9b06-4b13-839c-d258c98bfc3a tempest-FlavorsExtraSpecsTestJSON-418989414 tempest-FlavorsExtraSpecsTestJSON-418989414-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors/836388578/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.057847 Aug 24 10:11:16.807211 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 38/106] 10.222.0.85 () {60 vars in 1221 bytes} [Wed Aug 24 10:11:16 2022] POST /compute/v2.1/flavors/836388578/os-extra_specs => generated 66 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:11:16.818784 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-23ce8d1e-39bf-4ed9-b939-150ad7397637 tempest-FlavorsExtraSpecsTestJSON-418989414 tempest-FlavorsExtraSpecsTestJSON-418989414-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:16.841449 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-23ce8d1e-39bf-4ed9-b939-150ad7397637 tempest-FlavorsExtraSpecsTestJSON-418989414 tempest-FlavorsExtraSpecsTestJSON-418989414-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/836388578/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.032531 Aug 24 10:11:16.843569 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 39/107] 10.222.0.85 () {58 vars in 1200 bytes} [Wed Aug 24 10:11:16 2022] GET /compute/v2.1/flavors/836388578/os-extra_specs => generated 66 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:11:16.856584 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-55af988d-086a-407c-bae3-19494381ad09 tempest-FlavorsExtraSpecsTestJSON-418989414 tempest-FlavorsExtraSpecsTestJSON-418989414-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:16.862989 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:16.862989 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:16.928856 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-55af988d-086a-407c-bae3-19494381ad09 tempest-FlavorsExtraSpecsTestJSON-418989414 tempest-FlavorsExtraSpecsTestJSON-418989414-project-admin] 10.222.0.85 "PUT /compute/v2.1/flavors/836388578/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.078923 Aug 24 10:11:16.934829 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 40/108] 10.222.0.85 () {60 vars in 1262 bytes} [Wed Aug 24 10:11:16 2022] PUT /compute/v2.1/flavors/836388578/os-extra_specs/hw:numa_nodes => generated 22 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:11:16.952004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3e1f8b74-841d-46ef-91dc-ee1549c16e26 tempest-FlavorsExtraSpecsTestJSON-418989414 tempest-FlavorsExtraSpecsTestJSON-418989414-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:16.985432 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3e1f8b74-841d-46ef-91dc-ee1549c16e26 tempest-FlavorsExtraSpecsTestJSON-418989414 tempest-FlavorsExtraSpecsTestJSON-418989414-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/836388578/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.044140 Aug 24 10:11:16.988988 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 41/109] 10.222.0.85 () {58 vars in 1200 bytes} [Wed Aug 24 10:11:16 2022] GET /compute/v2.1/flavors/836388578/os-extra_specs => generated 66 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:11:17.005858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-be9311d4-caac-4e82-be26-db0a7a96578e tempest-FlavorsExtraSpecsTestJSON-418989414 tempest-FlavorsExtraSpecsTestJSON-418989414-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:17.006671 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:17.006671 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:17.108256 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-be9311d4-caac-4e82-be26-db0a7a96578e tempest-FlavorsExtraSpecsTestJSON-418989414 tempest-FlavorsExtraSpecsTestJSON-418989414-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/836388578/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.112477 Aug 24 10:11:17.111880 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 42/110] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Aug 24 10:11:16 2022] DELETE /compute/v2.1/flavors/836388578/os-extra_specs/hw:numa_nodes => generated 0 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 10:11:17.137956 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3cc7b732-66b9-4707-b9e4-120123960dc6 tempest-FlavorsExtraSpecsTestJSON-418989414 tempest-FlavorsExtraSpecsTestJSON-418989414-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:17.208248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:DELETE=11,nova_api:SELECT=70,nova_api:INSERT=4,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:17.242940 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3cc7b732-66b9-4707-b9e4-120123960dc6 tempest-FlavorsExtraSpecsTestJSON-418989414 tempest-FlavorsExtraSpecsTestJSON-418989414-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/836388578/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.096955 Aug 24 10:11:17.251081 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 43/111] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Aug 24 10:11:17 2022] DELETE /compute/v2.1/flavors/836388578/os-extra_specs/hw:cpu_policy => generated 0 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 10:11:17.269904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-06927073-f247-4f3e-8d34-d43dc239b471 tempest-FlavorsExtraSpecsTestJSON-418989414 tempest-FlavorsExtraSpecsTestJSON-418989414-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:17.317823 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b2d3b3d7-dc58-443b-a0d7-c450aa904a7d tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213baa7d5703491b9ea67a5f7231212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd058330a96034236a9429ab2891a111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:17.330762 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b2d3b3d7-dc58-443b-a0d7-c450aa904a7d tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 200 len: 1339 microversion: 2.1 time: 0.930001 Aug 24 10:11:17.342671 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-06927073-f247-4f3e-8d34-d43dc239b471 tempest-FlavorsExtraSpecsTestJSON-418989414 tempest-FlavorsExtraSpecsTestJSON-418989414-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/836388578/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.085584 Aug 24 10:11:17.348289 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 69/112] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:16 2022] GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 1339 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:17.349282 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 44/113] 10.222.0.85 () {58 vars in 1200 bytes} [Wed Aug 24 10:11:17 2022] GET /compute/v2.1/flavors/836388578/os-extra_specs => generated 19 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:11:17.370029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7e62cc22-17a3-4d4d-8021-0705ee760892 tempest-FlavorsExtraSpecsTestJSON-418989414 tempest-FlavorsExtraSpecsTestJSON-418989414-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:17.378307 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:17.378307 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:17.443920 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7e62cc22-17a3-4d4d-8021-0705ee760892 tempest-FlavorsExtraSpecsTestJSON-418989414 tempest-FlavorsExtraSpecsTestJSON-418989414-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/836388578" status: 202 len: 0 microversion: 2.1 time: 0.085555 Aug 24 10:11:17.445150 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 70/114] 10.222.0.85 () {58 vars in 1158 bytes} [Wed Aug 24 10:11:17 2022] DELETE /compute/v2.1/flavors/836388578 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:11:17.457557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9c6a1423-ff4d-4e39-8cfb-1ac969873c8d tempest-FlavorsExtraSpecsTestJSON-418989414 tempest-FlavorsExtraSpecsTestJSON-418989414-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:17.567979 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9c6a1423-ff4d-4e39-8cfb-1ac969873c8d tempest-FlavorsExtraSpecsTestJSON-418989414 tempest-FlavorsExtraSpecsTestJSON-418989414-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.116887 Aug 24 10:11:17.571381 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 45/115] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:11:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:11:18.368582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4880792a-45fc-434e-bc63-fbf5c648b9b7 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:18.369618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4880792a-45fc-434e-bc63-fbf5c648b9b7 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:18.385940 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4880792a-45fc-434e-bc63-fbf5c648b9b7 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:18.388104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4880792a-45fc-434e-bc63-fbf5c648b9b7 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:18.389319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4880792a-45fc-434e-bc63-fbf5c648b9b7 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:18.392755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4880792a-45fc-434e-bc63-fbf5c648b9b7 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:18.396550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4880792a-45fc-434e-bc63-fbf5c648b9b7 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:18.397695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4880792a-45fc-434e-bc63-fbf5c648b9b7 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:18.675175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4880792a-45fc-434e-bc63-fbf5c648b9b7 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213baa7d5703491b9ea67a5f7231212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd058330a96034236a9429ab2891a111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:18.683664 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4880792a-45fc-434e-bc63-fbf5c648b9b7 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 200 len: 1339 microversion: 2.1 time: 0.321062 Aug 24 10:11:18.684633 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 46/116] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:18 2022] GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 1339 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:11:18.850025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2fc78ef9-2d63-491c-899e-1d5a1fc6652e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:18.864933 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2fc78ef9-2d63-491c-899e-1d5a1fc6652e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.665134 Aug 24 10:11:18.868924 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 71/117] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:11:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:19.304527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ac100177-f4c1-4519-8995-efb6e217fde3 tempest-ServersWithSpecificFlavorTestJSON-113520978 tempest-ServersWithSpecificFlavorTestJSON-113520978-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-201935610", "id": 280669823, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:19.309222 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:19.309222 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:19.347219 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ac100177-f4c1-4519-8995-efb6e217fde3 tempest-ServersWithSpecificFlavorTestJSON-113520978 tempest-ServersWithSpecificFlavorTestJSON-113520978-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.468071 Aug 24 10:11:19.350619 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 47/118] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:11:18 2022] POST /compute/v2.1/flavors => generated 421 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:19.366232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7cd3270f-d19d-4d2b-b8ce-8cb0a3973641 tempest-ServersWithSpecificFlavorTestJSON-113520978 tempest-ServersWithSpecificFlavorTestJSON-113520978-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:19.411777 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7cd3270f-d19d-4d2b-b8ce-8cb0a3973641 tempest-ServersWithSpecificFlavorTestJSON-113520978 tempest-ServersWithSpecificFlavorTestJSON-113520978-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.052491 Aug 24 10:11:19.414423 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 72/119] 10.222.0.85 () {58 vars in 1182 bytes} [Wed Aug 24 10:11:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:11:19.424377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0237b904-06bf-447e-83f4-b7a5a908425b tempest-ServersWithSpecificFlavorTestJSON-113520978 tempest-ServersWithSpecificFlavorTestJSON-113520978-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1088984862", "id": 226636201, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:19.454470 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0237b904-06bf-447e-83f4-b7a5a908425b tempest-ServersWithSpecificFlavorTestJSON-113520978 tempest-ServersWithSpecificFlavorTestJSON-113520978-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.034012 Aug 24 10:11:19.455693 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 48/120] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:11:19 2022] POST /compute/v2.1/flavors => generated 422 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:19.467296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-832e4547-4e66-4377-80c2-6a2d6285f2db tempest-ServersWithSpecificFlavorTestJSON-113520978 tempest-ServersWithSpecificFlavorTestJSON-113520978-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:19.476303 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-832e4547-4e66-4377-80c2-6a2d6285f2db tempest-ServersWithSpecificFlavorTestJSON-113520978 tempest-ServersWithSpecificFlavorTestJSON-113520978-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012754 Aug 24 10:11:19.488094 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 73/121] 10.222.0.85 () {58 vars in 1182 bytes} [Wed Aug 24 10:11:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:11:19.494229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e3898435-b3b9-4796-b37d-caddfcc68a6d tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Action: 'create', calling method: .version_select at 0x7f4655ca8820>, body: {"keypair": {"name": "tempest-keypair-1759048096", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLF1/ijTFY1b3fB0alml4k9QLz58rXmN0pn77x0/TGd3TQXIZa+GjqYIFbSGUwz2+GDRvka6CZ1fvsc87tVGUSD6qF2HbARLpGljtS5Kw/Hw62izrNnOTaT2R+mqY+2T1w=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:19.531834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-e3898435-b3b9-4796-b37d-caddfcc68a6d tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Getting quotas for project 114821bb876c48869e113c5b6d8898d0. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:11:19.537466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-e3898435-b3b9-4796-b37d-caddfcc68a6d tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Getting quotas for user e5bc9c3828964edabe730dd66ee27ee4 and project 114821bb876c48869e113c5b6d8898d0. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:11:19.568529 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e3898435-b3b9-4796-b37d-caddfcc68a6d tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.080017 Aug 24 10:11:19.569868 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 49/122] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:11:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:19.709359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cec4a89e-aaf6-402d-a035-54d487480052 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:19.711070 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cec4a89e-aaf6-402d-a035-54d487480052 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:19.724313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cec4a89e-aaf6-402d-a035-54d487480052 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:19.725448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cec4a89e-aaf6-402d-a035-54d487480052 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:19.727434 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cec4a89e-aaf6-402d-a035-54d487480052 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:19.728715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cec4a89e-aaf6-402d-a035-54d487480052 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:19.729994 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cec4a89e-aaf6-402d-a035-54d487480052 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:19.731023 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cec4a89e-aaf6-402d-a035-54d487480052 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:20.038019 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cec4a89e-aaf6-402d-a035-54d487480052 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213baa7d5703491b9ea67a5f7231212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd058330a96034236a9429ab2891a111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:20.054480 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cec4a89e-aaf6-402d-a035-54d487480052 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 200 len: 1339 microversion: 2.1 time: 0.351608 Aug 24 10:11:20.069406 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 74/123] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:19 2022] GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 1339 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:20.381022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-18727dbb-5bbe-466d-90df-7f79174d8d3a tempest-FlavorsV261TestJSON-1810205515 tempest-FlavorsV261TestJSON-1810205515-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-584494272", "id": 2106725251, "os-flavor-access:is_public": "True"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:20.437206 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-18727dbb-5bbe-466d-90df-7f79174d8d3a tempest-FlavorsV261TestJSON-1810205515 tempest-FlavorsV261TestJSON-1810205515-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.604868 Aug 24 10:11:20.450339 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 50/124] 10.222.0.85 () {62 vars in 1188 bytes} [Wed Aug 24 10:11:19 2022] POST /compute/v2.1/flavors => generated 467 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:11:21.080757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-130e3be4-a6e3-4aeb-ac81-ebfe4477120f tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:21.082297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-130e3be4-a6e3-4aeb-ac81-ebfe4477120f tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:21.104299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-130e3be4-a6e3-4aeb-ac81-ebfe4477120f tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:21.104800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-130e3be4-a6e3-4aeb-ac81-ebfe4477120f tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:21.105274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-130e3be4-a6e3-4aeb-ac81-ebfe4477120f tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:21.108656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-130e3be4-a6e3-4aeb-ac81-ebfe4477120f tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:21.109188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-130e3be4-a6e3-4aeb-ac81-ebfe4477120f tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:21.110597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-130e3be4-a6e3-4aeb-ac81-ebfe4477120f tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:21.356326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4d2631df-41c5-4949-ae26-b08a4ee5fcbd tempest-FlavorsV261TestJSON-1184195975 tempest-FlavorsV261TestJSON-1184195975-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:21.375895 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4d2631df-41c5-4949-ae26-b08a4ee5fcbd tempest-FlavorsV261TestJSON-1184195975 tempest-FlavorsV261TestJSON-1184195975-project] 10.222.0.85 "GET /compute/v2.1/flavors/2106725251" status: 200 len: 467 microversion: 2.61 time: 0.919184 Aug 24 10:11:21.379457 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 75/125] 10.222.0.85 () {60 vars in 1199 bytes} [Wed Aug 24 10:11:20 2022] GET /compute/v2.1/flavors/2106725251 => generated 467 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:11:21.392808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c99bc39a-3b99-4d38-86b7-f6e86354a1ed tempest-FlavorsV261TestJSON-1810205515 tempest-FlavorsV261TestJSON-1810205515-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:21.419268 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:21.419268 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:21.424554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-130e3be4-a6e3-4aeb-ac81-ebfe4477120f tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213baa7d5703491b9ea67a5f7231212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd058330a96034236a9429ab2891a111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:21.434761 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-130e3be4-a6e3-4aeb-ac81-ebfe4477120f tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 200 len: 1339 microversion: 2.1 time: 0.361776 Aug 24 10:11:21.436672 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 51/126] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:21 2022] GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 1339 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:21.467290 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c99bc39a-3b99-4d38-86b7-f6e86354a1ed tempest-FlavorsV261TestJSON-1810205515 tempest-FlavorsV261TestJSON-1810205515-project-admin] 10.222.0.85 "PUT /compute/v2.1/flavors/2106725251" status: 200 len: 468 microversion: 2.61 time: 0.077954 Aug 24 10:11:21.468384 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 76/127] 10.222.0.85 () {62 vars in 1219 bytes} [Wed Aug 24 10:11:21 2022] PUT /compute/v2.1/flavors/2106725251 => generated 468 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:11:21.484756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2ad9110d-971a-4e06-a300-8fe1c33b4b89 tempest-FlavorsV261TestJSON-1184195975 tempest-FlavorsV261TestJSON-1184195975-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:21.550275 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2ad9110d-971a-4e06-a300-8fe1c33b4b89 tempest-FlavorsV261TestJSON-1184195975 tempest-FlavorsV261TestJSON-1184195975-project] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 7152 microversion: 2.61 time: 0.072326 Aug 24 10:11:21.551780 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 52/128] 10.222.0.85 () {60 vars in 1187 bytes} [Wed Aug 24 10:11:21 2022] GET /compute/v2.1/flavors/detail => generated 7152 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:11:21.574893 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-258f64f8-b963-47f2-b543-21a9adfc74f5 tempest-FlavorsV261TestJSON-1184195975 tempest-FlavorsV261TestJSON-1184195975-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:21.598593 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-258f64f8-b963-47f2-b543-21a9adfc74f5 tempest-FlavorsV261TestJSON-1184195975 tempest-FlavorsV261TestJSON-1184195975-project] 10.222.0.85 "GET /compute/v2.1/flavors" status: 200 len: 3679 microversion: 2.61 time: 0.027600 Aug 24 10:11:21.599725 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 77/129] 10.222.0.85 () {60 vars in 1166 bytes} [Wed Aug 24 10:11:21 2022] GET /compute/v2.1/flavors => generated 3679 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:11:21.625521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7dc4d94d-e470-4e8a-a398-ca7ccf1b79e5 tempest-FlavorsV261TestJSON-1810205515 tempest-FlavorsV261TestJSON-1810205515-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:21.627381 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:21.627381 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:21.662809 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7dc4d94d-e470-4e8a-a398-ca7ccf1b79e5 tempest-FlavorsV261TestJSON-1810205515 tempest-FlavorsV261TestJSON-1810205515-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/2106725251" status: 202 len: 0 microversion: 2.61 time: 0.043173 Aug 24 10:11:21.663853 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 53/130] 10.222.0.85 () {60 vars in 1202 bytes} [Wed Aug 24 10:11:21 2022] DELETE /compute/v2.1/flavors/2106725251 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 10:11:21.674384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5fe0ccd4-ad35-4339-b00e-475150194165 tempest-FlavorsV261TestJSON-1810205515 tempest-FlavorsV261TestJSON-1810205515-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:21.702105 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5fe0ccd4-ad35-4339-b00e-475150194165 tempest-FlavorsV261TestJSON-1810205515 tempest-FlavorsV261TestJSON-1810205515-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 6694 microversion: 2.61 time: 0.033726 Aug 24 10:11:21.703307 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 54/131] 10.222.0.85 () {60 vars in 1187 bytes} [Wed Aug 24 10:11:21 2022] GET /compute/v2.1/flavors/detail => generated 6694 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:11:22.014703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-14e0b997-bdb8-4155-8618-52db01cb99f5 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Calling method '.version_select at 0x7f46566d6670>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:22.015509 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:22.015509 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:22.016587 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14e0b997-bdb8-4155-8618-52db01cb99f5 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:22.017072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14e0b997-bdb8-4155-8618-52db01cb99f5 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:22.017632 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14e0b997-bdb8-4155-8618-52db01cb99f5 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:22.036142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14e0b997-bdb8-4155-8618-52db01cb99f5 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:22.036639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14e0b997-bdb8-4155-8618-52db01cb99f5 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:22.037079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14e0b997-bdb8-4155-8618-52db01cb99f5 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:22.047423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14e0b997-bdb8-4155-8618-52db01cb99f5 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:22.048113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14e0b997-bdb8-4155-8618-52db01cb99f5 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:22.048733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14e0b997-bdb8-4155-8618-52db01cb99f5 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:22.055274 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-14e0b997-bdb8-4155-8618-52db01cb99f5 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.424186 Aug 24 10:11:22.056053 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 78/132] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:11:21 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:22.066726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-71856141-c3e6-40e9-89a1-6678073e2175 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Calling method '.version_select at 0x7f4655bf51f0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:22.067569 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:22.067569 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:22.068626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71856141-c3e6-40e9-89a1-6678073e2175 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:22.069161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71856141-c3e6-40e9-89a1-6678073e2175 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:22.070228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71856141-c3e6-40e9-89a1-6678073e2175 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:22.089918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71856141-c3e6-40e9-89a1-6678073e2175 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:22.090446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71856141-c3e6-40e9-89a1-6678073e2175 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:22.091024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71856141-c3e6-40e9-89a1-6678073e2175 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:22.131706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71856141-c3e6-40e9-89a1-6678073e2175 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:22.132310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71856141-c3e6-40e9-89a1-6678073e2175 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:22.132663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71856141-c3e6-40e9-89a1-6678073e2175 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:22.139191 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-71856141-c3e6-40e9-89a1-6678073e2175 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors/n-h2-849328-3/servers" status: 200 len: 196 microversion: 2.1 time: 0.076466 Aug 24 10:11:22.139781 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 55/133] 10.222.0.85 () {58 vars in 1212 bytes} [Wed Aug 24 10:11:22 2022] GET /compute/v2.1/os-hypervisors/n-h2-849328-3/servers => generated 196 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:22.151342 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-da31185f-eedc-4ce6-bf66-4d242ecad6b9 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Calling method '.version_select at 0x7f46566d63a0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:22.152306 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:22.152306 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:22.154181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da31185f-eedc-4ce6-bf66-4d242ecad6b9 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:22.155529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da31185f-eedc-4ce6-bf66-4d242ecad6b9 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:22.156160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da31185f-eedc-4ce6-bf66-4d242ecad6b9 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:22.172963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da31185f-eedc-4ce6-bf66-4d242ecad6b9 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:22.173642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da31185f-eedc-4ce6-bf66-4d242ecad6b9 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:22.174311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da31185f-eedc-4ce6-bf66-4d242ecad6b9 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:22.186900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da31185f-eedc-4ce6-bf66-4d242ecad6b9 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:22.189666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da31185f-eedc-4ce6-bf66-4d242ecad6b9 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:22.189977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da31185f-eedc-4ce6-bf66-4d242ecad6b9 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:22.199507 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-da31185f-eedc-4ce6-bf66-4d242ecad6b9 tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.050627 Aug 24 10:11:22.200319 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 79/134] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:11:22 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:22.211169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f89d0d56-1725-4a7d-9505-6fe3b3f467ec tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Calling method '.version_select at 0x7f4655c63f70>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:22.212027 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:22.212027 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:22.214645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f89d0d56-1725-4a7d-9505-6fe3b3f467ec tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:22.215142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f89d0d56-1725-4a7d-9505-6fe3b3f467ec tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:22.215579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f89d0d56-1725-4a7d-9505-6fe3b3f467ec tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:22.228369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f89d0d56-1725-4a7d-9505-6fe3b3f467ec tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:22.228891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f89d0d56-1725-4a7d-9505-6fe3b3f467ec tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:22.229589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f89d0d56-1725-4a7d-9505-6fe3b3f467ec tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:22.236444 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f89d0d56-1725-4a7d-9505-6fe3b3f467ec tempest-HypervisorAdminUnderV252Test-47816213 tempest-HypervisorAdminUnderV252Test-47816213-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors/n-h2-849328-3/search" status: 200 len: 104 microversion: 2.1 time: 0.029367 Aug 24 10:11:22.237112 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 56/135] 10.222.0.85 () {58 vars in 1209 bytes} [Wed Aug 24 10:11:22 2022] GET /compute/v2.1/os-hypervisors/n-h2-849328-3/search => generated 104 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:22.250652 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-79f3b41a-f69a-42d8-9e5e-912dc11b33c6 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1267821128", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "226636201", "adminPass": "***", "networks": [{"uuid": "89f7616e-e1bd-4a60-b807-430b638d900b"}], "security_groups": [{"name": "tempest-securitygroup--283143853"}], "key_name": "tempest-keypair-1759048096", "user_data": "}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:22.399000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-79f3b41a-f69a-42d8-9e5e-912dc11b33c6 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] validate_networks() for [('89f7616e-e1bd-4a60-b807-430b638d900b', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:11:22.462028 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0083668f-1405-4f81-822a-32567a789480 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:22.463263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0083668f-1405-4f81-822a-32567a789480 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:22.472970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0083668f-1405-4f81-822a-32567a789480 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:22.474188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0083668f-1405-4f81-822a-32567a789480 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:22.475204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0083668f-1405-4f81-822a-32567a789480 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:22.476113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0083668f-1405-4f81-822a-32567a789480 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:22.477141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0083668f-1405-4f81-822a-32567a789480 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:22.478206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0083668f-1405-4f81-822a-32567a789480 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:22.740051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0083668f-1405-4f81-822a-32567a789480 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213baa7d5703491b9ea67a5f7231212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd058330a96034236a9429ab2891a111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:22.747898 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0083668f-1405-4f81-822a-32567a789480 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 200 len: 1339 microversion: 2.1 time: 0.292717 Aug 24 10:11:22.751575 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 57/136] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:22 2022] GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 1339 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:11:22.873208 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:23.537980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-41c94351-6481-432c-bb71-64a28738e617 tempest-HypervisorAdminNegativeTestJSON-20241933 tempest-HypervisorAdminNegativeTestJSON-20241933-project] Calling method '.version_select at 0x7f4655b66b80>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:23.539033 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:23.539033 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:23.540542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-41c94351-6481-432c-bb71-64a28738e617 tempest-HypervisorAdminNegativeTestJSON-20241933 tempest-HypervisorAdminNegativeTestJSON-20241933-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'c6513ceeac894f9bbe7213fdc9c0592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517c8783bed445d1976a1d5fbd2483be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:23.543020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-41c94351-6481-432c-bb71-64a28738e617 tempest-HypervisorAdminNegativeTestJSON-20241933 tempest-HypervisorAdminNegativeTestJSON-20241933-project] Request method failure captured: Aug 24 10:11:23.543020 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 24 10:11:23.543020 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:11:23.543020 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:11:23.543020 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:11:23.543020 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:11:23.543020 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:11:23.543020 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:11:23.543020 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:11:23.543020 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:23.543020 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBflJtycfozh9OUHhiBTNjOV6wax9ihGx1Sj7ZetxAf2naQjGB6ntJAuBgyQQiE06VaoSsVBZO-0yvQOMkaQXqTMeiloQK_Shg0hS1tCWja1qsuqJUTziFM-X1D61kl_iq6G2T8q9BEV-PZoGmbpo--N0O4ZxMtR0smNwym8Yuxr4xhs Aug 24 10:11:23.543020 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:11:23.543020 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:11:23.543020 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:11:23.543020 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:11:23.543020 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:11:23.543020 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:11:23.543020 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 517c8783bed445d1976a1d5fbd2483be Aug 24 10:11:23.543020 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-20241933 Aug 24 10:11:23.543020 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:11:23.543020 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:11:23.545244 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/517c8783bed445d1976a1d5fbd2483be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_517c8783bed445d1976a1d5fbd2483be", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/517c8783bed445d1976a1d5fbd2483be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/517c8783bed445d1976a1d5fbd2483be"}]}] Aug 24 10:11:23.545244 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-20241933 Aug 24 10:11:23.545244 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 517c8783bed445d1976a1d5fbd2483be Aug 24 10:11:23.545244 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-20241933 Aug 24 10:11:23.545244 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-HypervisorAdminNegativeTestJSON-20241933-project Aug 24 10:11:23.545244 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:11:23.545244 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:11:23.545244 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: c6513ceeac894f9bbe7213fdc9c0592d Aug 24 10:11:23.545244 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-20241933-project Aug 24 10:11:23.545244 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:11:23.545244 n-d-849328-3 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 24 10:11:23.545244 n-d-849328-3 devstack@n-api.service[122433]: action_args: {} Aug 24 10:11:23.545244 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:23.546180 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:23.546180 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:23.546180 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:23.546180 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:23.546180 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:23.546180 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:11:23.546180 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:11:23.546180 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:23.546180 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:23.546180 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 24 10:11:23.546180 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 24 10:11:23.546180 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 24 10:11:23.546180 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 24 10:11:23.546180 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:11:23.546180 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:11:23.546180 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:11:23.546180 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:11:23.546180 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:11:23.546180 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:11:23.547572 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:11:23.547572 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:11:23.547572 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:11:23.547572 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:11:23.547572 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:11:23.547572 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:11:23.547572 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:11:23.547572 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:11:23.547572 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 24 10:11:23.547572 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:23.547572 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:23.547572 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:23.547572 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:23.547572 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:23.547572 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:23.547572 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:11:23.547572 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:11:23.547572 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 24 10:11:23.547572 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:23.548895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-79f3b41a-f69a-42d8-9e5e-912dc11b33c6 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:11:23.548895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-79f3b41a-f69a-42d8-9e5e-912dc11b33c6 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:11:23.549804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-79f3b41a-f69a-42d8-9e5e-912dc11b33c6 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:11:23.549804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-79f3b41a-f69a-42d8-9e5e-912dc11b33c6 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:11:23.550085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-79f3b41a-f69a-42d8-9e5e-912dc11b33c6 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:11:23.552085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-41c94351-6481-432c-bb71-64a28738e617 tempest-HypervisorAdminNegativeTestJSON-20241933 tempest-HypervisorAdminNegativeTestJSON-20241933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:23.553093 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-41c94351-6481-432c-bb71-64a28738e617 tempest-HypervisorAdminNegativeTestJSON-20241933 tempest-HypervisorAdminNegativeTestJSON-20241933-project] 10.222.0.85 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.370925 Aug 24 10:11:23.553846 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 58/137] 10.222.0.85 () {58 vars in 1167 bytes} [Wed Aug 24 10:11:23 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 372 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:11:23.559145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=9,nova_api:INSERT=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:23.566460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b495098e-f4bd-44e4-a799-f9c2b57b4a15 tempest-HypervisorAdminNegativeTestJSON-20241933 tempest-HypervisorAdminNegativeTestJSON-20241933-project] Calling method '.version_select at 0x7f4655b6e0d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:23.567280 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:23.567280 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:23.568434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b495098e-f4bd-44e4-a799-f9c2b57b4a15 tempest-HypervisorAdminNegativeTestJSON-20241933 tempest-HypervisorAdminNegativeTestJSON-20241933-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'c6513ceeac894f9bbe7213fdc9c0592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517c8783bed445d1976a1d5fbd2483be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:23.570145 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b495098e-f4bd-44e4-a799-f9c2b57b4a15 tempest-HypervisorAdminNegativeTestJSON-20241933 tempest-HypervisorAdminNegativeTestJSON-20241933-project] Request method failure captured: Aug 24 10:11:23.570145 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 24 10:11:23.570145 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:11:23.570145 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:11:23.570145 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:11:23.570145 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:11:23.570145 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:11:23.570145 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:11:23.570145 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:11:23.570145 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:23.570145 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBflJtycfozh9OUHhiBTNjOV6wax9ihGx1Sj7ZetxAf2naQjGB6ntJAuBgyQQiE06VaoSsVBZO-0yvQOMkaQXqTMeiloQK_Shg0hS1tCWja1qsuqJUTziFM-X1D61kl_iq6G2T8q9BEV-PZoGmbpo--N0O4ZxMtR0smNwym8Yuxr4xhs Aug 24 10:11:23.570145 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:11:23.570145 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:11:23.570145 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:11:23.570145 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:11:23.570145 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:11:23.570145 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:11:23.570145 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 517c8783bed445d1976a1d5fbd2483be Aug 24 10:11:23.570145 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-20241933 Aug 24 10:11:23.570145 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:11:23.570145 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:11:23.571620 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/517c8783bed445d1976a1d5fbd2483be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_517c8783bed445d1976a1d5fbd2483be", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/517c8783bed445d1976a1d5fbd2483be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/517c8783bed445d1976a1d5fbd2483be"}]}] Aug 24 10:11:23.571620 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-20241933 Aug 24 10:11:23.571620 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 517c8783bed445d1976a1d5fbd2483be Aug 24 10:11:23.571620 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-20241933 Aug 24 10:11:23.571620 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-HypervisorAdminNegativeTestJSON-20241933-project Aug 24 10:11:23.571620 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:11:23.571620 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:11:23.571620 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: c6513ceeac894f9bbe7213fdc9c0592d Aug 24 10:11:23.571620 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-20241933-project Aug 24 10:11:23.571620 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:11:23.571620 n-d-849328-3 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 24 10:11:23.571620 n-d-849328-3 devstack@n-api.service[122433]: action_args: {} Aug 24 10:11:23.571620 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:23.572566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:23.572566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:23.572566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:23.572566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:23.572566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:23.572566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:11:23.572566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:11:23.572566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:23.572566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:23.572566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 24 10:11:23.572566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 24 10:11:23.572566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 24 10:11:23.572566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 24 10:11:23.572566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:11:23.572566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:11:23.572566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:11:23.572566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:11:23.572566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:11:23.572566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:11:23.573820 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:11:23.573820 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:11:23.573820 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:11:23.573820 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:11:23.573820 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:11:23.573820 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:11:23.573820 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:11:23.573820 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:11:23.573820 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 24 10:11:23.573820 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:23.573820 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:23.573820 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:23.573820 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:23.573820 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:23.573820 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:23.573820 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:11:23.573820 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:11:23.573820 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 24 10:11:23.573820 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:23.574993 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b495098e-f4bd-44e4-a799-f9c2b57b4a15 tempest-HypervisorAdminNegativeTestJSON-20241933 tempest-HypervisorAdminNegativeTestJSON-20241933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:23.574993 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b495098e-f4bd-44e4-a799-f9c2b57b4a15 tempest-HypervisorAdminNegativeTestJSON-20241933 tempest-HypervisorAdminNegativeTestJSON-20241933-project] 10.222.0.85 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.009125 Aug 24 10:11:23.584437 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79f3b41a-f69a-42d8-9e5e-912dc11b33c6 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:23.584949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79f3b41a-f69a-42d8-9e5e-912dc11b33c6 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:23.585428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79f3b41a-f69a-42d8-9e5e-912dc11b33c6 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:23.586173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79f3b41a-f69a-42d8-9e5e-912dc11b33c6 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:23.586609 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79f3b41a-f69a-42d8-9e5e-912dc11b33c6 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:23.587122 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 59/138] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:11:23 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:11:23.592249 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79f3b41a-f69a-42d8-9e5e-912dc11b33c6 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:23.597852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eba4e082-1039-4539-8f58-f5b8ffcfeb20 tempest-HypervisorAdminNegativeTestJSON-20241933 tempest-HypervisorAdminNegativeTestJSON-20241933-project] Calling method '.version_select at 0x7f4655c10f70>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:23.600867 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:23.600867 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:23.607847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-eba4e082-1039-4539-8f58-f5b8ffcfeb20 tempest-HypervisorAdminNegativeTestJSON-20241933 tempest-HypervisorAdminNegativeTestJSON-20241933-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'c6513ceeac894f9bbe7213fdc9c0592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517c8783bed445d1976a1d5fbd2483be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:23.609601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eba4e082-1039-4539-8f58-f5b8ffcfeb20 tempest-HypervisorAdminNegativeTestJSON-20241933 tempest-HypervisorAdminNegativeTestJSON-20241933-project] Request method failure captured: Aug 24 10:11:23.609601 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 24 10:11:23.609601 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:11:23.609601 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:11:23.609601 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:11:23.609601 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:11:23.609601 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:11:23.609601 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:11:23.609601 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:11:23.609601 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:23.609601 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBflJtycfozh9OUHhiBTNjOV6wax9ihGx1Sj7ZetxAf2naQjGB6ntJAuBgyQQiE06VaoSsVBZO-0yvQOMkaQXqTMeiloQK_Shg0hS1tCWja1qsuqJUTziFM-X1D61kl_iq6G2T8q9BEV-PZoGmbpo--N0O4ZxMtR0smNwym8Yuxr4xhs Aug 24 10:11:23.609601 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:11:23.609601 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:11:23.609601 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:11:23.609601 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:11:23.609601 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:11:23.609601 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:11:23.609601 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 517c8783bed445d1976a1d5fbd2483be Aug 24 10:11:23.609601 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-20241933 Aug 24 10:11:23.609601 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:11:23.609601 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:11:23.610736 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/517c8783bed445d1976a1d5fbd2483be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_517c8783bed445d1976a1d5fbd2483be", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/517c8783bed445d1976a1d5fbd2483be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/517c8783bed445d1976a1d5fbd2483be"}]}] Aug 24 10:11:23.610736 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-20241933 Aug 24 10:11:23.610736 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 517c8783bed445d1976a1d5fbd2483be Aug 24 10:11:23.610736 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-20241933 Aug 24 10:11:23.610736 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-HypervisorAdminNegativeTestJSON-20241933-project Aug 24 10:11:23.610736 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:11:23.610736 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:11:23.610736 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: c6513ceeac894f9bbe7213fdc9c0592d Aug 24 10:11:23.610736 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-20241933-project Aug 24 10:11:23.610736 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:11:23.610736 n-d-849328-3 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 24 10:11:23.610736 n-d-849328-3 devstack@n-api.service[122433]: action_args: {} Aug 24 10:11:23.610736 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:23.611488 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:23.611488 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:23.611488 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:23.611488 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:23.611488 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:23.611488 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:11:23.611488 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:11:23.611488 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:23.611488 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:23.611488 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 24 10:11:23.611488 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 24 10:11:23.611488 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:11:23.611488 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:11:23.611488 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:11:23.611488 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:11:23.611488 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:11:23.611488 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:11:23.611488 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:11:23.611488 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:11:23.614158 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:11:23.614158 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:11:23.614158 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:11:23.614158 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:11:23.614158 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:11:23.614158 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:11:23.614158 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 24 10:11:23.614158 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:23.614158 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:23.614158 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:23.614158 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:23.614158 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:23.614158 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:23.614158 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:11:23.614158 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:11:23.614158 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 24 10:11:23.614158 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:23.615190 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eba4e082-1039-4539-8f58-f5b8ffcfeb20 tempest-HypervisorAdminNegativeTestJSON-20241933 tempest-HypervisorAdminNegativeTestJSON-20241933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:23.615190 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eba4e082-1039-4539-8f58-f5b8ffcfeb20 tempest-HypervisorAdminNegativeTestJSON-20241933 tempest-HypervisorAdminNegativeTestJSON-20241933-project] 10.222.0.85 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.022866 Aug 24 10:11:23.615190 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 60/139] 10.222.0.85 () {58 vars in 1179 bytes} [Wed Aug 24 10:11:23 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:11:23.642569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-79f3b41a-f69a-42d8-9e5e-912dc11b33c6 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Getting quotas for project 114821bb876c48869e113c5b6d8898d0. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:11:23.650920 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-79f3b41a-f69a-42d8-9e5e-912dc11b33c6 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Getting quotas for user e5bc9c3828964edabe730dd66ee27ee4 and project 114821bb876c48869e113c5b6d8898d0. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:11:23.666339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-79f3b41a-f69a-42d8-9e5e-912dc11b33c6 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:11:23.669368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-79f3b41a-f69a-42d8-9e5e-912dc11b33c6 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: 7e6f46da-f3b6-41ec-96f2-a3db16593a10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:11:23.748987 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-79f3b41a-f69a-42d8-9e5e-912dc11b33c6 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.502721 Aug 24 10:11:23.750575 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 80/140] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:11:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 1505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:11:23.762794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e3e46abc-db76-4cb4-b8ab-191c1248685e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:23.763480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e3e46abc-db76-4cb4-b8ab-191c1248685e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: 7e6f46da-f3b6-41ec-96f2-a3db16593a10] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:23.851456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e3e46abc-db76-4cb4-b8ab-191c1248685e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:23.868229 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e3e46abc-db76-4cb4-b8ab-191c1248685e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10" status: 200 len: 1263 microversion: 2.1 time: 0.110279 Aug 24 10:11:23.869849 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 81/141] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:23 2022] GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10 => generated 1263 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:11:23.877047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bfdfe0cc-9140-4019-a140-447a9f062138 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:23.878026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bfdfe0cc-9140-4019-a140-447a9f062138 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:23.911030 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfdfe0cc-9140-4019-a140-447a9f062138 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:23.912327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfdfe0cc-9140-4019-a140-447a9f062138 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:23.913246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfdfe0cc-9140-4019-a140-447a9f062138 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:23.918373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfdfe0cc-9140-4019-a140-447a9f062138 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:23.920171 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfdfe0cc-9140-4019-a140-447a9f062138 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:23.924513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfdfe0cc-9140-4019-a140-447a9f062138 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:24.193972 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bfdfe0cc-9140-4019-a140-447a9f062138 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213baa7d5703491b9ea67a5f7231212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd058330a96034236a9429ab2891a111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:24.204082 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bfdfe0cc-9140-4019-a140-447a9f062138 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 200 len: 1339 microversion: 2.1 time: 0.332319 Aug 24 10:11:24.215460 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 82/142] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:23 2022] GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 1339 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:24.254013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fae8668f-02e5-48cc-9d31-2cc610c88f8f tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] Calling method '.version_select at 0x7f4655bf5e50>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:24.256187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fae8668f-02e5-48cc-9d31-2cc610c88f8f tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:24.256815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fae8668f-02e5-48cc-9d31-2cc610c88f8f tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:24.257303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fae8668f-02e5-48cc-9d31-2cc610c88f8f tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:24.277495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fae8668f-02e5-48cc-9d31-2cc610c88f8f tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:24.278170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fae8668f-02e5-48cc-9d31-2cc610c88f8f tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:24.278612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fae8668f-02e5-48cc-9d31-2cc610c88f8f tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:24.291275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fae8668f-02e5-48cc-9d31-2cc610c88f8f tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:24.292389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fae8668f-02e5-48cc-9d31-2cc610c88f8f tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:24.293089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fae8668f-02e5-48cc-9d31-2cc610c88f8f tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:24.301987 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fae8668f-02e5-48cc-9d31-2cc610c88f8f tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.683862 Aug 24 10:11:24.304609 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 61/143] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:11:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:24.315487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fab34122-34a4-4517-a96d-ef98ae8c61d6 tempest-HypervisorAdminNegativeTestJSON-20241933 tempest-HypervisorAdminNegativeTestJSON-20241933-project] Calling method '.version_select at 0x7f465659a9d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:24.317255 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:24.317255 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:24.318713 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fab34122-34a4-4517-a96d-ef98ae8c61d6 tempest-HypervisorAdminNegativeTestJSON-20241933 tempest-HypervisorAdminNegativeTestJSON-20241933-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'c6513ceeac894f9bbe7213fdc9c0592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517c8783bed445d1976a1d5fbd2483be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:24.321367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fab34122-34a4-4517-a96d-ef98ae8c61d6 tempest-HypervisorAdminNegativeTestJSON-20241933 tempest-HypervisorAdminNegativeTestJSON-20241933-project] Request method failure captured: Aug 24 10:11:24.321367 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 24 10:11:24.321367 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:11:24.321367 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:11:24.321367 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:11:24.321367 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:11:24.321367 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:11:24.321367 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:11:24.321367 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:11:24.321367 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:24.321367 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBflJtycfozh9OUHhiBTNjOV6wax9ihGx1Sj7ZetxAf2naQjGB6ntJAuBgyQQiE06VaoSsVBZO-0yvQOMkaQXqTMeiloQK_Shg0hS1tCWja1qsuqJUTziFM-X1D61kl_iq6G2T8q9BEV-PZoGmbpo--N0O4ZxMtR0smNwym8Yuxr4xhs Aug 24 10:11:24.321367 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:11:24.321367 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:11:24.321367 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:11:24.321367 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:11:24.321367 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:11:24.321367 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:11:24.321367 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 517c8783bed445d1976a1d5fbd2483be Aug 24 10:11:24.321367 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-20241933 Aug 24 10:11:24.321367 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:11:24.321367 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:11:24.322515 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/517c8783bed445d1976a1d5fbd2483be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_517c8783bed445d1976a1d5fbd2483be", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/517c8783bed445d1976a1d5fbd2483be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/517c8783bed445d1976a1d5fbd2483be"}]}] Aug 24 10:11:24.322515 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-20241933 Aug 24 10:11:24.322515 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 517c8783bed445d1976a1d5fbd2483be Aug 24 10:11:24.322515 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-20241933 Aug 24 10:11:24.322515 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-HypervisorAdminNegativeTestJSON-20241933-project Aug 24 10:11:24.322515 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:11:24.322515 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:11:24.322515 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: c6513ceeac894f9bbe7213fdc9c0592d Aug 24 10:11:24.322515 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-20241933-project Aug 24 10:11:24.322515 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:11:24.322515 n-d-849328-3 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 24 10:11:24.322515 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '1'} Aug 24 10:11:24.322515 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:24.323194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:24.323194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:24.323194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:24.323194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:24.323194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:24.323194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:11:24.323194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:11:24.323194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:24.323194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:24.323194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 24 10:11:24.323194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 24 10:11:24.323194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:11:24.323194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:11:24.323194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:11:24.323194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:11:24.323194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:11:24.323194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:11:24.323194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:11:24.323194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:11:24.324209 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:11:24.324209 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:11:24.324209 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:11:24.324209 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:11:24.324209 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:11:24.324209 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:11:24.324209 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 24 10:11:24.324209 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:24.324209 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:24.324209 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:24.324209 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:24.324209 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:24.324209 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:24.324209 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:11:24.324209 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:11:24.324209 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 24 10:11:24.324209 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:24.327002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fab34122-34a4-4517-a96d-ef98ae8c61d6 tempest-HypervisorAdminNegativeTestJSON-20241933 tempest-HypervisorAdminNegativeTestJSON-20241933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:24.328278 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fab34122-34a4-4517-a96d-ef98ae8c61d6 tempest-HypervisorAdminNegativeTestJSON-20241933 tempest-HypervisorAdminNegativeTestJSON-20241933-project] 10.222.0.85 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.017682 Aug 24 10:11:24.329043 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 83/144] 10.222.0.85 () {58 vars in 1173 bytes} [Wed Aug 24 10:11:24 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:11:24.343639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6de3d73f-50ea-43f0-a546-70b5db540ff7 tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] Calling method '.version_select at 0x7f4655cb5ca0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:24.345341 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:24.345341 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:24.348476 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-6de3d73f-50ea-43f0-a546-70b5db540ff7 tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] HTTP exception thrown: Hypervisor with ID 'f9ba8266-149b-484e-b77b-45f3fd89b48a' could not be found. Aug 24 10:11:24.361050 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6de3d73f-50ea-43f0-a546-70b5db540ff7 tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] Request method failure captured: Aug 24 10:11:24.361050 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-hypervisors/f9ba8266-149b-484e-b77b-45f3fd89b48a/uptime HTTP/1.1 Aug 24 10:11:24.361050 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:11:24.361050 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:11:24.361050 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:11:24.361050 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:11:24.361050 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:11:24.361050 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:11:24.361050 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:11:24.361050 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:24.361050 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBflLO0v7_wNuo_zC03cTGCGJ-KDZBC7V7BK5kvThWUBFXFcpE7hy9TlZ9QoY65hR7ZyH5cTk2Z0b8rVJkvPft9yzTXdms8oX1dTdEZw2dPQ6U5hvfZ-EMO4ZszUc07Z3dLXfOnuPLcJ9tcvpl2geB0MCAlO73Jfgce6y__iMH5bDPLc Aug 24 10:11:24.361050 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:11:24.361050 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:11:24.361050 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:11:24.361050 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:11:24.361050 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:11:24.361050 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:11:24.361050 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 378be9f3a08a45fd94509c16518b198b Aug 24 10:11:24.361050 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-626292815 Aug 24 10:11:24.361050 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:11:24.361050 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:11:24.362330 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/378be9f3a08a45fd94509c16518b198b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_378be9f3a08a45fd94509c16518b198b", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/378be9f3a08a45fd94509c16518b198b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/378be9f3a08a45fd94509c16518b198b"}]}] Aug 24 10:11:24.362330 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-626292815 Aug 24 10:11:24.362330 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 378be9f3a08a45fd94509c16518b198b Aug 24 10:11:24.362330 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-626292815 Aug 24 10:11:24.362330 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin Aug 24 10:11:24.362330 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:11:24.362330 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:11:24.362330 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 6fd338c451074eaea5b940303ea4e52c Aug 24 10:11:24.362330 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin Aug 24 10:11:24.362330 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:11:24.362330 n-d-849328-3 devstack@n-api.service[122433]: exception: Hypervisor with ID 'f9ba8266-149b-484e-b77b-45f3fd89b48a' could not be found. Aug 24 10:11:24.362330 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'f9ba8266-149b-484e-b77b-45f3fd89b48a'} Aug 24 10:11:24.363019 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:24.363019 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:24.363019 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 24 10:11:24.363019 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 24 10:11:24.363019 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'f9ba8266-149b-484e-b77b-45f3fd89b48a' Aug 24 10:11:24.363019 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:24.363019 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:24.363019 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:24.363019 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:24.363019 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 24 10:11:24.363019 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 24 10:11:24.363019 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 24 10:11:24.363019 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 24 10:11:24.363019 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 24 10:11:24.363019 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:24.363019 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:24.363019 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:24.363019 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:24.363019 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 24 10:11:24.363019 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 24 10:11:24.363019 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 24 10:11:24.363019 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 24 10:11:24.364171 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 24 10:11:24.364171 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:24.364171 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:24.364171 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:24.364171 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:24.364171 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:24.364171 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:24.364171 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:24.364171 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:24.364171 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:11:24.364171 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:11:24.364171 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:24.364171 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:24.364171 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 24 10:11:24.364171 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 24 10:11:24.364171 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 24 10:11:24.364171 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 10:11:24.364171 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'f9ba8266-149b-484e-b77b-45f3fd89b48a' could not be found. Aug 24 10:11:24.364171 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:24.364171 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:24.364171 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:24.365951 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:24.365951 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:24.365951 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:24.365951 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:11:24.365951 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:11:24.365951 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'f9ba8266-149b-484e-b77b-45f3fd89b48a' could not be found. Aug 24 10:11:24.365951 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:24.365951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6de3d73f-50ea-43f0-a546-70b5db540ff7 tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] Returning 404 to user: Hypervisor with ID 'f9ba8266-149b-484e-b77b-45f3fd89b48a' could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:24.365951 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6de3d73f-50ea-43f0-a546-70b5db540ff7 tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors/f9ba8266-149b-484e-b77b-45f3fd89b48a/uptime" status: 404 len: 123 microversion: 2.1 time: 0.025762 Aug 24 10:11:24.365951 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 62/145] 10.222.0.85 () {58 vars in 1278 bytes} [Wed Aug 24 10:11:24 2022] GET /compute/v2.1/os-hypervisors/f9ba8266-149b-484e-b77b-45f3fd89b48a/uptime => generated 123 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:11:24.373830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ea161ba6-8341-45c8-a94c-8ccf90e06fa4 tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] Calling method '.version_select at 0x7f46565ae3a0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:24.375353 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:24.375353 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:24.376066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea161ba6-8341-45c8-a94c-8ccf90e06fa4 tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:24.376559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea161ba6-8341-45c8-a94c-8ccf90e06fa4 tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:24.380222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea161ba6-8341-45c8-a94c-8ccf90e06fa4 tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:24.404212 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea161ba6-8341-45c8-a94c-8ccf90e06fa4 tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:24.405189 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea161ba6-8341-45c8-a94c-8ccf90e06fa4 tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:24.405861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea161ba6-8341-45c8-a94c-8ccf90e06fa4 tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:24.419000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea161ba6-8341-45c8-a94c-8ccf90e06fa4 tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:24.419706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea161ba6-8341-45c8-a94c-8ccf90e06fa4 tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:24.420347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea161ba6-8341-45c8-a94c-8ccf90e06fa4 tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:24.427651 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ea161ba6-8341-45c8-a94c-8ccf90e06fa4 tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.058157 Aug 24 10:11:24.439511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec549106-b13d-41f2-812b-0675d31278f9 tempest-HypervisorAdminNegativeTestJSON-20241933 tempest-HypervisorAdminNegativeTestJSON-20241933-project] Calling method '.version_select at 0x7f4655b66c10>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:24.440587 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:24.440587 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:24.441974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ec549106-b13d-41f2-812b-0675d31278f9 tempest-HypervisorAdminNegativeTestJSON-20241933 tempest-HypervisorAdminNegativeTestJSON-20241933-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'c6513ceeac894f9bbe7213fdc9c0592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517c8783bed445d1976a1d5fbd2483be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:24.443793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec549106-b13d-41f2-812b-0675d31278f9 tempest-HypervisorAdminNegativeTestJSON-20241933 tempest-HypervisorAdminNegativeTestJSON-20241933-project] Request method failure captured: Aug 24 10:11:24.443793 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 24 10:11:24.443793 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:11:24.443793 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:11:24.443793 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:11:24.443793 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:11:24.443793 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:11:24.443793 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:11:24.443793 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:11:24.443793 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:24.443793 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBflJtycfozh9OUHhiBTNjOV6wax9ihGx1Sj7ZetxAf2naQjGB6ntJAuBgyQQiE06VaoSsVBZO-0yvQOMkaQXqTMeiloQK_Shg0hS1tCWja1qsuqJUTziFM-X1D61kl_iq6G2T8q9BEV-PZoGmbpo--N0O4ZxMtR0smNwym8Yuxr4xhs Aug 24 10:11:24.443793 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:11:24.443793 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:11:24.443793 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:11:24.443793 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:11:24.443793 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:11:24.443793 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:11:24.443793 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 517c8783bed445d1976a1d5fbd2483be Aug 24 10:11:24.443793 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-20241933 Aug 24 10:11:24.443793 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:11:24.443793 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:11:24.445166 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/517c8783bed445d1976a1d5fbd2483be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_517c8783bed445d1976a1d5fbd2483be", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/517c8783bed445d1976a1d5fbd2483be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/517c8783bed445d1976a1d5fbd2483be"}]}] Aug 24 10:11:24.445166 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-20241933 Aug 24 10:11:24.445166 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 517c8783bed445d1976a1d5fbd2483be Aug 24 10:11:24.445166 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-20241933 Aug 24 10:11:24.445166 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-HypervisorAdminNegativeTestJSON-20241933-project Aug 24 10:11:24.445166 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:11:24.445166 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:11:24.445166 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: c6513ceeac894f9bbe7213fdc9c0592d Aug 24 10:11:24.445166 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-20241933-project Aug 24 10:11:24.445166 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:11:24.445166 n-d-849328-3 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 24 10:11:24.445166 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '1'} Aug 24 10:11:24.445166 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:24.445980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:24.445980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:24.445980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:24.445980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:24.445980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:24.445980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:11:24.445980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:11:24.445980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:24.445980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:24.445980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 24 10:11:24.445980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 24 10:11:24.445980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 24 10:11:24.445980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 24 10:11:24.445980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:11:24.445980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:11:24.445980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:11:24.445980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:11:24.445980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:11:24.445980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:11:24.447204 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:11:24.447204 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:11:24.447204 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:11:24.447204 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:11:24.447204 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:11:24.447204 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:11:24.447204 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:11:24.447204 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:11:24.447204 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 24 10:11:24.447204 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:24.447204 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:24.447204 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:24.447204 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:24.447204 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:24.447204 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:24.447204 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:11:24.447204 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:11:24.447204 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 24 10:11:24.447204 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:24.449168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec549106-b13d-41f2-812b-0675d31278f9 tempest-HypervisorAdminNegativeTestJSON-20241933 tempest-HypervisorAdminNegativeTestJSON-20241933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:24.449628 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 84/146] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:11:24 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:24.450924 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ec549106-b13d-41f2-812b-0675d31278f9 tempest-HypervisorAdminNegativeTestJSON-20241933 tempest-HypervisorAdminNegativeTestJSON-20241933-project] 10.222.0.85 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.015201 Aug 24 10:11:24.458458 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 63/147] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:11:24 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:11:24.461787 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-54eef50e-9ab0-4257-bc36-1048b1ab668a tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] Calling method '.version_select at 0x7f46565e9f70>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:24.462827 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:24.462827 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:24.464074 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-54eef50e-9ab0-4257-bc36-1048b1ab668a tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] HTTP exception thrown: Hypervisor with ID '665ff496-6da7-4efc-8e93-11d74398e064' could not be found. Aug 24 10:11:24.468027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-54eef50e-9ab0-4257-bc36-1048b1ab668a tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] Request method failure captured: Aug 24 10:11:24.468027 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-hypervisors/665ff496-6da7-4efc-8e93-11d74398e064 HTTP/1.1 Aug 24 10:11:24.468027 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:11:24.468027 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:11:24.468027 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:11:24.468027 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:11:24.468027 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:11:24.468027 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:11:24.468027 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:11:24.468027 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:24.468027 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBflLO0v7_wNuo_zC03cTGCGJ-KDZBC7V7BK5kvThWUBFXFcpE7hy9TlZ9QoY65hR7ZyH5cTk2Z0b8rVJkvPft9yzTXdms8oX1dTdEZw2dPQ6U5hvfZ-EMO4ZszUc07Z3dLXfOnuPLcJ9tcvpl2geB0MCAlO73Jfgce6y__iMH5bDPLc Aug 24 10:11:24.468027 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:11:24.468027 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:11:24.468027 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:11:24.468027 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:11:24.468027 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:11:24.468027 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:11:24.468027 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 378be9f3a08a45fd94509c16518b198b Aug 24 10:11:24.468027 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-626292815 Aug 24 10:11:24.468027 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,admin,member Aug 24 10:11:24.468027 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,admin,member Aug 24 10:11:24.469703 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/378be9f3a08a45fd94509c16518b198b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_378be9f3a08a45fd94509c16518b198b", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/378be9f3a08a45fd94509c16518b198b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/378be9f3a08a45fd94509c16518b198b"}]}] Aug 24 10:11:24.469703 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-626292815 Aug 24 10:11:24.469703 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 378be9f3a08a45fd94509c16518b198b Aug 24 10:11:24.469703 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-626292815 Aug 24 10:11:24.469703 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin Aug 24 10:11:24.469703 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:11:24.469703 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:11:24.469703 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 6fd338c451074eaea5b940303ea4e52c Aug 24 10:11:24.469703 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin Aug 24 10:11:24.469703 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:11:24.469703 n-d-849328-3 devstack@n-api.service[122432]: exception: Hypervisor with ID '665ff496-6da7-4efc-8e93-11d74398e064' could not be found. Aug 24 10:11:24.469703 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '665ff496-6da7-4efc-8e93-11d74398e064'} Aug 24 10:11:24.470846 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:24.470846 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:24.470846 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 24 10:11:24.470846 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 24 10:11:24.470846 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '665ff496-6da7-4efc-8e93-11d74398e064' Aug 24 10:11:24.470846 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:24.470846 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:24.470846 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:24.470846 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:24.470846 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 24 10:11:24.470846 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 24 10:11:24.470846 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 24 10:11:24.470846 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 24 10:11:24.470846 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 24 10:11:24.470846 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:24.470846 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:24.470846 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:24.470846 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:24.470846 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 24 10:11:24.470846 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 24 10:11:24.470846 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 24 10:11:24.470846 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 24 10:11:24.472297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 24 10:11:24.472297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:24.472297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:24.472297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:24.472297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:24.472297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:24.472297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:24.472297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:24.472297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:24.472297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:11:24.472297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:11:24.472297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:24.472297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:24.472297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 24 10:11:24.472297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 24 10:11:24.472297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 24 10:11:24.472297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 24 10:11:24.472297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 24 10:11:24.472297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 10:11:24.472297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '665ff496-6da7-4efc-8e93-11d74398e064' could not be found. Aug 24 10:11:24.473616 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:24.473616 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:24.473616 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:24.473616 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:24.473616 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:24.473616 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:24.473616 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:11:24.473616 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:11:24.473616 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '665ff496-6da7-4efc-8e93-11d74398e064' could not be found. Aug 24 10:11:24.473616 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:24.475248 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-54eef50e-9ab0-4257-bc36-1048b1ab668a tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] Returning 404 to user: Hypervisor with ID '665ff496-6da7-4efc-8e93-11d74398e064' could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:24.476117 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-54eef50e-9ab0-4257-bc36-1048b1ab668a tempest-HypervisorAdminNegativeTestJSON-626292815 tempest-HypervisorAdminNegativeTestJSON-626292815-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors/665ff496-6da7-4efc-8e93-11d74398e064" status: 404 len: 123 microversion: 2.1 time: 0.018867 Aug 24 10:11:24.477063 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 85/148] 10.222.0.85 () {58 vars in 1257 bytes} [Wed Aug 24 10:11:24 2022] GET /compute/v2.1/os-hypervisors/665ff496-6da7-4efc-8e93-11d74398e064 => generated 123 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:11:24.895611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-38f66e5a-9dc5-4ee5-87a4-944a38bf139e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:24.896232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-38f66e5a-9dc5-4ee5-87a4-944a38bf139e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: 7e6f46da-f3b6-41ec-96f2-a3db16593a10] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:24.926771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38f66e5a-9dc5-4ee5-87a4-944a38bf139e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:24.927978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38f66e5a-9dc5-4ee5-87a4-944a38bf139e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:24.929198 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38f66e5a-9dc5-4ee5-87a4-944a38bf139e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:24.931732 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38f66e5a-9dc5-4ee5-87a4-944a38bf139e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:24.932259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38f66e5a-9dc5-4ee5-87a4-944a38bf139e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:24.934135 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38f66e5a-9dc5-4ee5-87a4-944a38bf139e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:25.059362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-38f66e5a-9dc5-4ee5-87a4-944a38bf139e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:25.073295 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-38f66e5a-9dc5-4ee5-87a4-944a38bf139e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10" status: 200 len: 1267 microversion: 2.1 time: 0.182975 Aug 24 10:11:25.075916 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 64/149] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:24 2022] GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:25.237664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-118848bc-8761-4c7f-8ddd-ca003c4eb3c1 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:25.238503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-118848bc-8761-4c7f-8ddd-ca003c4eb3c1 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:25.248346 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-118848bc-8761-4c7f-8ddd-ca003c4eb3c1 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:25.249523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-118848bc-8761-4c7f-8ddd-ca003c4eb3c1 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:25.250127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-118848bc-8761-4c7f-8ddd-ca003c4eb3c1 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:25.251263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-118848bc-8761-4c7f-8ddd-ca003c4eb3c1 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:25.251883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-118848bc-8761-4c7f-8ddd-ca003c4eb3c1 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:25.252650 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-118848bc-8761-4c7f-8ddd-ca003c4eb3c1 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:25.468451 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-118848bc-8761-4c7f-8ddd-ca003c4eb3c1 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213baa7d5703491b9ea67a5f7231212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd058330a96034236a9429ab2891a111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:25.482587 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-118848bc-8761-4c7f-8ddd-ca003c4eb3c1 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 200 len: 1339 microversion: 2.1 time: 0.249726 Aug 24 10:11:25.484392 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 86/150] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:25 2022] GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 1339 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:25.874794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4055827a-5780-47b4-9dd2-4dd5d5172834 tempest-HypervisorAdminV228Test-1863904579 tempest-HypervisorAdminV228Test-1863904579-project-admin] Calling method '.version_select at 0x7f4655b6ef70>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:25.875591 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:25.875591 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:25.876656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4055827a-5780-47b4-9dd2-4dd5d5172834 tempest-HypervisorAdminV228Test-1863904579 tempest-HypervisorAdminV228Test-1863904579-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:25.877538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4055827a-5780-47b4-9dd2-4dd5d5172834 tempest-HypervisorAdminV228Test-1863904579 tempest-HypervisorAdminV228Test-1863904579-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:25.877994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4055827a-5780-47b4-9dd2-4dd5d5172834 tempest-HypervisorAdminV228Test-1863904579 tempest-HypervisorAdminV228Test-1863904579-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:25.883689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=97 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:25.904363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4055827a-5780-47b4-9dd2-4dd5d5172834 tempest-HypervisorAdminV228Test-1863904579 tempest-HypervisorAdminV228Test-1863904579-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:25.905547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4055827a-5780-47b4-9dd2-4dd5d5172834 tempest-HypervisorAdminV228Test-1863904579 tempest-HypervisorAdminV228Test-1863904579-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:25.906234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4055827a-5780-47b4-9dd2-4dd5d5172834 tempest-HypervisorAdminV228Test-1863904579 tempest-HypervisorAdminV228Test-1863904579-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:25.925051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4055827a-5780-47b4-9dd2-4dd5d5172834 tempest-HypervisorAdminV228Test-1863904579 tempest-HypervisorAdminV228Test-1863904579-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:25.926131 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4055827a-5780-47b4-9dd2-4dd5d5172834 tempest-HypervisorAdminV228Test-1863904579 tempest-HypervisorAdminV228Test-1863904579-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:25.926845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4055827a-5780-47b4-9dd2-4dd5d5172834 tempest-HypervisorAdminV228Test-1863904579 tempest-HypervisorAdminV228Test-1863904579-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:25.934902 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4055827a-5780-47b4-9dd2-4dd5d5172834 tempest-HypervisorAdminV228Test-1863904579 tempest-HypervisorAdminV228Test-1863904579-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.533887 Aug 24 10:11:25.941296 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 65/151] 10.222.0.85 () {60 vars in 1187 bytes} [Wed Aug 24 10:11:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 10:11:25.947465 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-56ad8679-0248-4785-8d66-97faf92784a6 tempest-HypervisorAdminV228Test-1863904579 tempest-HypervisorAdminV228Test-1863904579-project-admin] Calling method '.version_select at 0x7f46578f0790>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:25.948556 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:25.948556 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:25.949983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56ad8679-0248-4785-8d66-97faf92784a6 tempest-HypervisorAdminV228Test-1863904579 tempest-HypervisorAdminV228Test-1863904579-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:25.951270 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56ad8679-0248-4785-8d66-97faf92784a6 tempest-HypervisorAdminV228Test-1863904579 tempest-HypervisorAdminV228Test-1863904579-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:25.951927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56ad8679-0248-4785-8d66-97faf92784a6 tempest-HypervisorAdminV228Test-1863904579 tempest-HypervisorAdminV228Test-1863904579-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:25.970282 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56ad8679-0248-4785-8d66-97faf92784a6 tempest-HypervisorAdminV228Test-1863904579 tempest-HypervisorAdminV228Test-1863904579-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:25.971246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56ad8679-0248-4785-8d66-97faf92784a6 tempest-HypervisorAdminV228Test-1863904579 tempest-HypervisorAdminV228Test-1863904579-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:25.971881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56ad8679-0248-4785-8d66-97faf92784a6 tempest-HypervisorAdminV228Test-1863904579 tempest-HypervisorAdminV228Test-1863904579-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:25.980760 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-56ad8679-0248-4785-8d66-97faf92784a6 tempest-HypervisorAdminV228Test-1863904579 tempest-HypervisorAdminV228Test-1863904579-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.037588 Aug 24 10:11:25.991813 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 87/152] 10.222.0.85 () {60 vars in 1193 bytes} [Wed Aug 24 10:11:25 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:11:26.096313 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a83def78-10e7-42b0-9aba-11a93757261e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:26.097013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a83def78-10e7-42b0-9aba-11a93757261e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: 7e6f46da-f3b6-41ec-96f2-a3db16593a10] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:26.109927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a83def78-10e7-42b0-9aba-11a93757261e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:26.110523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a83def78-10e7-42b0-9aba-11a93757261e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:26.110993 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a83def78-10e7-42b0-9aba-11a93757261e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:26.113166 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a83def78-10e7-42b0-9aba-11a93757261e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:26.115988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a83def78-10e7-42b0-9aba-11a93757261e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:26.117964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a83def78-10e7-42b0-9aba-11a93757261e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:26.282418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a83def78-10e7-42b0-9aba-11a93757261e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:26.291789 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a83def78-10e7-42b0-9aba-11a93757261e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10" status: 200 len: 1321 microversion: 2.1 time: 0.199921 Aug 24 10:11:26.292700 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 66/153] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:26 2022] GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:26.514350 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2e5bc84b-2341-4a3f-87d2-e7a2ae89667a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:26.515860 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2e5bc84b-2341-4a3f-87d2-e7a2ae89667a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:26.527737 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e5bc84b-2341-4a3f-87d2-e7a2ae89667a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:26.528937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e5bc84b-2341-4a3f-87d2-e7a2ae89667a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:26.529880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e5bc84b-2341-4a3f-87d2-e7a2ae89667a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:26.530896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e5bc84b-2341-4a3f-87d2-e7a2ae89667a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:26.531539 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e5bc84b-2341-4a3f-87d2-e7a2ae89667a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:26.532116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e5bc84b-2341-4a3f-87d2-e7a2ae89667a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:26.766419 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2e5bc84b-2341-4a3f-87d2-e7a2ae89667a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213baa7d5703491b9ea67a5f7231212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd058330a96034236a9429ab2891a111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:26.775322 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2e5bc84b-2341-4a3f-87d2-e7a2ae89667a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 200 len: 1339 microversion: 2.1 time: 0.274754 Aug 24 10:11:26.776527 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 88/154] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:26 2022] GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 1339 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:27.113695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-1543d045-15ae-4f7d-9e7d-87709a7918e3 req-03c72d38-255d-479d-bb1a-53bc6f469e45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9790d01-4c85-4d60-814e-d32faf530877", "name": "network-vif-plugged", "status": "completed", "tag": "ff1c8f8e-b4f9-4267-9cfe-17547f94eaaf"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:27.139518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1543d045-15ae-4f7d-9e7d-87709a7918e3 req-03c72d38-255d-479d-bb1a-53bc6f469e45 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:27.140914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1543d045-15ae-4f7d-9e7d-87709a7918e3 req-03c72d38-255d-479d-bb1a-53bc6f469e45 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:27.141545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1543d045-15ae-4f7d-9e7d-87709a7918e3 req-03c72d38-255d-479d-bb1a-53bc6f469e45 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:27.176984 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-1543d045-15ae-4f7d-9e7d-87709a7918e3 req-03c72d38-255d-479d-bb1a-53bc6f469e45 service nova] Creating event network-vif-plugged:ff1c8f8e-b4f9-4267-9cfe-17547f94eaaf for instance a9790d01-4c85-4d60-814e-d32faf530877 on n-h2-849328-3 Aug 24 10:11:27.177797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1543d045-15ae-4f7d-9e7d-87709a7918e3 req-03c72d38-255d-479d-bb1a-53bc6f469e45 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 10:11:27.178362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1543d045-15ae-4f7d-9e7d-87709a7918e3 req-03c72d38-255d-479d-bb1a-53bc6f469e45 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 10:11:27.179835 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9daaf44e-6036-4ffb-81f6-fba2b4a8440a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:27.180347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9daaf44e-6036-4ffb-81f6-fba2b4a8440a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:27.181333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9daaf44e-6036-4ffb-81f6-fba2b4a8440a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:27.182251 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9daaf44e-6036-4ffb-81f6-fba2b4a8440a None None] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:27.182691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9daaf44e-6036-4ffb-81f6-fba2b4a8440a None None] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:27.183296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9daaf44e-6036-4ffb-81f6-fba2b4a8440a None None] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:27.195851 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.compute.rpcapi [None req-9daaf44e-6036-4ffb-81f6-fba2b4a8440a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 10:11:27.197048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9daaf44e-6036-4ffb-81f6-fba2b4a8440a None None] Releasing lock "compute-rpcapi-router" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 10:11:27.250996 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9daaf44e-6036-4ffb-81f6-fba2b4a8440a None None] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.259481 Aug 24 10:11:27.252261 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 67/155] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:27.319116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b7e4f0d5-84e9-49ea-bd8c-cd238c326570 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:27.320009 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b7e4f0d5-84e9-49ea-bd8c-cd238c326570 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: 7e6f46da-f3b6-41ec-96f2-a3db16593a10] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:27.329726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7e4f0d5-84e9-49ea-bd8c-cd238c326570 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:27.330676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7e4f0d5-84e9-49ea-bd8c-cd238c326570 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:27.331369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7e4f0d5-84e9-49ea-bd8c-cd238c326570 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:27.332385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7e4f0d5-84e9-49ea-bd8c-cd238c326570 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:27.333216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7e4f0d5-84e9-49ea-bd8c-cd238c326570 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:27.333925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7e4f0d5-84e9-49ea-bd8c-cd238c326570 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:27.803139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8e13e50d-8390-47ec-b3e2-dde7991eac85 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:27.803865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8e13e50d-8390-47ec-b3e2-dde7991eac85 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:27.814648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e13e50d-8390-47ec-b3e2-dde7991eac85 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:27.815489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e13e50d-8390-47ec-b3e2-dde7991eac85 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:27.816032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e13e50d-8390-47ec-b3e2-dde7991eac85 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:27.816920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e13e50d-8390-47ec-b3e2-dde7991eac85 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:27.817840 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e13e50d-8390-47ec-b3e2-dde7991eac85 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:27.818549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e13e50d-8390-47ec-b3e2-dde7991eac85 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:27.951710 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b7e4f0d5-84e9-49ea-bd8c-cd238c326570 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:27.966849 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b7e4f0d5-84e9-49ea-bd8c-cd238c326570 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10" status: 200 len: 1388 microversion: 2.1 time: 0.651090 Aug 24 10:11:27.980681 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 89/156] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:27 2022] GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10 => generated 1388 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:28.125905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8e13e50d-8390-47ec-b3e2-dde7991eac85 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213baa7d5703491b9ea67a5f7231212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd058330a96034236a9429ab2891a111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:28.137686 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8e13e50d-8390-47ec-b3e2-dde7991eac85 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 200 len: 1339 microversion: 2.1 time: 0.341794 Aug 24 10:11:28.154885 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 68/157] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:27 2022] GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 1339 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:11:28.439871 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-55c0e376-0695-41dd-8ae5-a0ed616dde7f tempest-InstanceUsageAuditLogNegativeTestJSON-1435826533 tempest-InstanceUsageAuditLogNegativeTestJSON-1435826533-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:28.441184 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:28.441184 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:28.445234 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-55c0e376-0695-41dd-8ae5-a0ed616dde7f tempest-InstanceUsageAuditLogNegativeTestJSON-1435826533 tempest-InstanceUsageAuditLogNegativeTestJSON-1435826533-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 24 10:11:28.453626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-55c0e376-0695-41dd-8ae5-a0ed616dde7f tempest-InstanceUsageAuditLogNegativeTestJSON-1435826533 tempest-InstanceUsageAuditLogNegativeTestJSON-1435826533-project-admin] Request method failure captured: Aug 24 10:11:28.453626 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 24 10:11:28.453626 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:11:28.453626 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:11:28.453626 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:11:28.453626 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:11:28.453626 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:11:28.453626 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:11:28.453626 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:11:28.453626 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:28.453626 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBflPLpWJc9d1IYOCQnn8nMMfFn34yL_FubqBvwXdj8fvtetpom-mfnGogttiSemV0zUqS7xtUPbtPn6RcnWlFMBobr2bl2bVpA37rUADSfTTp7P0M9K5tMym6IEJpHTFsEHaaAtTmh0obucE3gKFyQvhKsYLYCJzupo5VJHJ0enyY-M Aug 24 10:11:28.453626 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:11:28.453626 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:11:28.453626 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:11:28.453626 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:11:28.453626 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:11:28.453626 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:11:28.453626 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 01414c34f70541158ee62af5a9eadc16 Aug 24 10:11:28.453626 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1435826533 Aug 24 10:11:28.453626 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,admin,member Aug 24 10:11:28.453626 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,admin,member Aug 24 10:11:28.455253 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/01414c34f70541158ee62af5a9eadc16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_01414c34f70541158ee62af5a9eadc16", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/01414c34f70541158ee62af5a9eadc16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/01414c34f70541158ee62af5a9eadc16"}]}] Aug 24 10:11:28.455253 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1435826533 Aug 24 10:11:28.455253 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 01414c34f70541158ee62af5a9eadc16 Aug 24 10:11:28.455253 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1435826533 Aug 24 10:11:28.455253 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1435826533-project-admin Aug 24 10:11:28.455253 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:11:28.455253 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:11:28.455253 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: e3e68624e5434ae69a8326a849e503a3 Aug 24 10:11:28.455253 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1435826533-project-admin Aug 24 10:11:28.455253 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:11:28.455253 n-d-849328-3 devstack@n-api.service[122432]: exception: Invalid timestamp for date invalid_time Aug 24 10:11:28.455984 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'invalid_time'} Aug 24 10:11:28.455984 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:28.455984 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:28.455984 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 24 10:11:28.455984 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 24 10:11:28.455984 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 24 10:11:28.455984 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 24 10:11:28.455984 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 24 10:11:28.455984 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 24 10:11:28.455984 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 24 10:11:28.455984 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:28.455984 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:28.455984 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:28.455984 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:28.455984 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:28.455984 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:28.455984 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:28.455984 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:28.455984 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:28.455984 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:28.457382 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 24 10:11:28.457382 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 24 10:11:28.457382 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 24 10:11:28.457382 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:28.457382 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:28.457382 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:28.457382 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:28.457382 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:28.457382 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:28.457382 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:11:28.457382 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:11:28.457382 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 24 10:11:28.457382 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:28.459150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-55c0e376-0695-41dd-8ae5-a0ed616dde7f tempest-InstanceUsageAuditLogNegativeTestJSON-1435826533 tempest-InstanceUsageAuditLogNegativeTestJSON-1435826533-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:28.460135 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-55c0e376-0695-41dd-8ae5-a0ed616dde7f tempest-InstanceUsageAuditLogNegativeTestJSON-1435826533 tempest-InstanceUsageAuditLogNegativeTestJSON-1435826533-project-admin] 10.222.0.85 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.490398 Aug 24 10:11:28.460618 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 90/158] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 10:11:27 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 492 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 10:11:28.833975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-750401d2-1dfa-4390-b5df-1c7c3309544a tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717 tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:28.835543 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:28.835543 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:28.837064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-750401d2-1dfa-4390-b5df-1c7c3309544a tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717 tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '97147fd765b245eb84d09f3f68bd1e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb124a001d24591832ebbefb378941d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:28.839881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-750401d2-1dfa-4390-b5df-1c7c3309544a tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717 tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717-project] Request method failure captured: Aug 24 10:11:28.839881 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 24 10:11:28.839881 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:11:28.839881 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:11:28.839881 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:11:28.839881 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:11:28.839881 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:11:28.839881 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:11:28.839881 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:11:28.839881 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:28.839881 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBflO_Wp-ArEv5Tkq5NVZEXZ4AV98H_zmhwKve-THMUE-FLe57jtBCP4KGC3ZxSMZyALGMHQ2O8Rau65ZkJnm0WOnFEo4OYadq_GZwxPopzPl9GIeEA-B9NFxNr7FtnO_BQy_0TtV2c4qP2Zg2tx4rHJZ1PmjZNKmusAddJ0aPKPh-gk Aug 24 10:11:28.839881 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:11:28.839881 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:11:28.839881 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:11:28.839881 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:11:28.839881 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:11:28.839881 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:11:28.839881 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 9fb124a001d24591832ebbefb378941d Aug 24 10:11:28.839881 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717 Aug 24 10:11:28.839881 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:11:28.839881 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:11:28.841206 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9fb124a001d24591832ebbefb378941d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9fb124a001d24591832ebbefb378941d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9fb124a001d24591832ebbefb378941d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9fb124a001d24591832ebbefb378941d"}]}] Aug 24 10:11:28.841206 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717 Aug 24 10:11:28.841206 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 9fb124a001d24591832ebbefb378941d Aug 24 10:11:28.841206 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717 Aug 24 10:11:28.841206 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717-project Aug 24 10:11:28.841206 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:11:28.841206 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:11:28.841206 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 97147fd765b245eb84d09f3f68bd1e87 Aug 24 10:11:28.841206 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717-project Aug 24 10:11:28.841206 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:11:28.841831 n-d-849328-3 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 24 10:11:28.841831 n-d-849328-3 devstack@n-api.service[122433]: action_args: {} Aug 24 10:11:28.841831 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:28.841831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:28.841831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:28.841831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:28.841831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:28.841831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:28.841831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:28.841831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:28.841831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 24 10:11:28.841831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 24 10:11:28.841831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:11:28.841831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:11:28.841831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:11:28.841831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:11:28.841831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:11:28.841831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:11:28.841831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:11:28.841831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:11:28.843925 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:11:28.843925 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:11:28.843925 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:11:28.843925 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:11:28.843925 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:11:28.843925 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:11:28.843925 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 24 10:11:28.843925 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:28.843925 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:28.843925 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:28.843925 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:28.843925 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:28.843925 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:28.843925 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:11:28.843925 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:11:28.843925 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 24 10:11:28.843925 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:28.847085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-750401d2-1dfa-4390-b5df-1c7c3309544a tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717 tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:28.847085 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-750401d2-1dfa-4390-b5df-1c7c3309544a tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717 tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717-project] 10.222.0.85 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.374866 Aug 24 10:11:28.847085 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 69/159] 10.222.0.85 () {58 vars in 1185 bytes} [Wed Aug 24 10:11:28 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 376 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:11:28.856354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-be887393-efe3-4711-b040-261d0d8986a1 tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717 tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:28.859682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-be887393-efe3-4711-b040-261d0d8986a1 tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717 tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '97147fd765b245eb84d09f3f68bd1e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb124a001d24591832ebbefb378941d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:28.862004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-be887393-efe3-4711-b040-261d0d8986a1 tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717 tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717-project] Request method failure captured: Aug 24 10:11:28.862004 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-24%2010:11:28 HTTP/1.1 Aug 24 10:11:28.862004 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:11:28.862004 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:11:28.862004 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:11:28.862004 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:11:28.862004 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:11:28.862004 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:11:28.862004 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:11:28.862004 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:28.862004 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBflO_Wp-ArEv5Tkq5NVZEXZ4AV98H_zmhwKve-THMUE-FLe57jtBCP4KGC3ZxSMZyALGMHQ2O8Rau65ZkJnm0WOnFEo4OYadq_GZwxPopzPl9GIeEA-B9NFxNr7FtnO_BQy_0TtV2c4qP2Zg2tx4rHJZ1PmjZNKmusAddJ0aPKPh-gk Aug 24 10:11:28.862004 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:11:28.862004 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:11:28.862004 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:11:28.862004 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:11:28.862004 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:11:28.862004 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:11:28.862004 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 9fb124a001d24591832ebbefb378941d Aug 24 10:11:28.862004 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717 Aug 24 10:11:28.862004 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:11:28.862004 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:11:28.863450 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9fb124a001d24591832ebbefb378941d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9fb124a001d24591832ebbefb378941d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9fb124a001d24591832ebbefb378941d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9fb124a001d24591832ebbefb378941d"}]}] Aug 24 10:11:28.863450 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717 Aug 24 10:11:28.863450 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 9fb124a001d24591832ebbefb378941d Aug 24 10:11:28.863450 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717 Aug 24 10:11:28.863450 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717-project Aug 24 10:11:28.863450 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:11:28.863450 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:11:28.863450 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 97147fd765b245eb84d09f3f68bd1e87 Aug 24 10:11:28.863450 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717-project Aug 24 10:11:28.863450 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:11:28.864114 n-d-849328-3 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 24 10:11:28.864114 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '2022-08-24 10:11:28'} Aug 24 10:11:28.864114 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:28.864114 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:28.864114 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:28.864114 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:28.864114 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:28.864114 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:28.864114 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:28.864114 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:28.864114 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 24 10:11:28.864114 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 24 10:11:28.864114 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:11:28.864114 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:11:28.864114 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:11:28.864114 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:11:28.864114 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:11:28.864114 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:11:28.864114 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:11:28.864114 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:11:28.865403 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:11:28.865403 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:11:28.865403 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:11:28.865403 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:11:28.865403 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:11:28.865403 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:11:28.865403 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 24 10:11:28.865403 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:28.865403 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:28.865403 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:28.865403 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:28.865403 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:28.865403 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:28.865403 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:11:28.865403 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:11:28.865403 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 24 10:11:28.865403 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:28.867402 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-be887393-efe3-4711-b040-261d0d8986a1 tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717 tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:28.867948 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-be887393-efe3-4711-b040-261d0d8986a1 tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717 tempest-InstanceUsageAuditLogNegativeTestJSON-2007004717-project] 10.222.0.85 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-24 10:11:28" status: 403 len: 128 microversion: 2.1 time: 0.020849 Aug 24 10:11:28.869218 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 91/160] 10.222.0.85 () {58 vars in 1251 bytes} [Wed Aug 24 10:11:28 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-24%2010%3A11%3A28 => generated 128 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:11:28.990658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-38b4c51d-8797-416b-8e00-8afb78c2207f tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:28.991302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-38b4c51d-8797-416b-8e00-8afb78c2207f tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: 7e6f46da-f3b6-41ec-96f2-a3db16593a10] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:29.006448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38b4c51d-8797-416b-8e00-8afb78c2207f tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:29.011801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38b4c51d-8797-416b-8e00-8afb78c2207f tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:29.013496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38b4c51d-8797-416b-8e00-8afb78c2207f tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:29.015695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38b4c51d-8797-416b-8e00-8afb78c2207f tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:29.016526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38b4c51d-8797-416b-8e00-8afb78c2207f tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:29.017165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38b4c51d-8797-416b-8e00-8afb78c2207f tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:29.178293 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bdec7bef-b3a2-4101-9f20-55425f19ad31 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:29.179265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bdec7bef-b3a2-4101-9f20-55425f19ad31 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:29.196657 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdec7bef-b3a2-4101-9f20-55425f19ad31 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:29.198101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdec7bef-b3a2-4101-9f20-55425f19ad31 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:29.199292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdec7bef-b3a2-4101-9f20-55425f19ad31 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:29.214921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdec7bef-b3a2-4101-9f20-55425f19ad31 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:29.216706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdec7bef-b3a2-4101-9f20-55425f19ad31 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:29.220546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdec7bef-b3a2-4101-9f20-55425f19ad31 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:29.233797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-38b4c51d-8797-416b-8e00-8afb78c2207f tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:29.244934 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-38b4c51d-8797-416b-8e00-8afb78c2207f tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10" status: 200 len: 1388 microversion: 2.1 time: 0.259752 Aug 24 10:11:29.265102 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 70/161] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:28 2022] GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10 => generated 1388 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:29.424467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bdec7bef-b3a2-4101-9f20-55425f19ad31 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213baa7d5703491b9ea67a5f7231212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd058330a96034236a9429ab2891a111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:29.433756 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bdec7bef-b3a2-4101-9f20-55425f19ad31 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 200 len: 1339 microversion: 2.1 time: 0.262182 Aug 24 10:11:29.445169 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 92/162] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:29 2022] GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 1339 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:29.986630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:30.278949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3d5a9e44-873b-4c77-8a11-596d3261a618 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:30.280633 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3d5a9e44-873b-4c77-8a11-596d3261a618 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: 7e6f46da-f3b6-41ec-96f2-a3db16593a10] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:30.299577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d5a9e44-873b-4c77-8a11-596d3261a618 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:30.305509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d5a9e44-873b-4c77-8a11-596d3261a618 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:30.307268 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d5a9e44-873b-4c77-8a11-596d3261a618 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:30.308531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d5a9e44-873b-4c77-8a11-596d3261a618 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:30.311024 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d5a9e44-873b-4c77-8a11-596d3261a618 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:30.311468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d5a9e44-873b-4c77-8a11-596d3261a618 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:30.406656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-58d1d16c-2be8-4c95-87da-e1438b30abbd tempest-NetworksTest-557342348 tempest-NetworksTest-557342348-project-admin] Calling method '.version_select at 0x7f4655b6e9d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:30.565159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3d5a9e44-873b-4c77-8a11-596d3261a618 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:30.586582 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3d5a9e44-873b-4c77-8a11-596d3261a618 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10" status: 200 len: 1388 microversion: 2.1 time: 0.316041 Aug 24 10:11:30.586921 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-58d1d16c-2be8-4c95-87da-e1438b30abbd tempest-NetworksTest-557342348 tempest-NetworksTest-557342348-project-admin] 10.222.0.85 "GET /compute/v2.1/os-networks" status: 200 len: 3326 microversion: 2.1 time: 0.606125 Aug 24 10:11:30.587646 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 93/163] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:30 2022] GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10 => generated 1388 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:30.591143 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 71/164] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:11:29 2022] GET /compute/v2.1/os-networks => generated 3326 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:30.596392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6f3a25b7-db82-468b-b9e7-e1c82fbebb83 tempest-NetworksTest-557342348 tempest-NetworksTest-557342348-project-admin] Calling method '.version_select at 0x7f4655b6e700>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:30.598041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-90517431-ff4d-465b-9895-a94df884d562 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:30.598851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-90517431-ff4d-465b-9895-a94df884d562 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:30.607869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90517431-ff4d-465b-9895-a94df884d562 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:30.608635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90517431-ff4d-465b-9895-a94df884d562 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:30.609079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90517431-ff4d-465b-9895-a94df884d562 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:30.609841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90517431-ff4d-465b-9895-a94df884d562 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:30.610325 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90517431-ff4d-465b-9895-a94df884d562 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:30.610756 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90517431-ff4d-465b-9895-a94df884d562 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:30.728466 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6f3a25b7-db82-468b-b9e7-e1c82fbebb83 tempest-NetworksTest-557342348 tempest-NetworksTest-557342348-project-admin] 10.222.0.85 "GET /compute/v2.1/os-networks/5e14315d-e513-4d23-8987-87edd775859e" status: 200 len: 652 microversion: 2.1 time: 0.135708 Aug 24 10:11:30.731771 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 72/165] 10.222.0.85 () {58 vars in 1248 bytes} [Wed Aug 24 10:11:30 2022] GET /compute/v2.1/os-networks/5e14315d-e513-4d23-8987-87edd775859e => generated 652 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:30.746821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-537a390a-1991-4c9b-b3bf-2ed65acbdd02 tempest-NetworksTest-557342348 tempest-NetworksTest-557342348-project-admin] Calling method '.version_select at 0x7f4655b66430>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:30.796677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-90517431-ff4d-465b-9895-a94df884d562 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213baa7d5703491b9ea67a5f7231212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd058330a96034236a9429ab2891a111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:30.805572 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-90517431-ff4d-465b-9895-a94df884d562 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 200 len: 1489 microversion: 2.1 time: 0.216074 Aug 24 10:11:30.806586 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 94/166] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:30 2022] GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 1489 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:30.831377 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-82780d79-6470-4153-acdd-207a36ac0dfd tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:30.832107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-82780d79-6470-4153-acdd-207a36ac0dfd tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:30.840405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82780d79-6470-4153-acdd-207a36ac0dfd tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:30.840928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82780d79-6470-4153-acdd-207a36ac0dfd tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:30.845551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82780d79-6470-4153-acdd-207a36ac0dfd tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:30.846872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82780d79-6470-4153-acdd-207a36ac0dfd tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:30.847567 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82780d79-6470-4153-acdd-207a36ac0dfd tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:30.848644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82780d79-6470-4153-acdd-207a36ac0dfd tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:30.982389 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-537a390a-1991-4c9b-b3bf-2ed65acbdd02 tempest-NetworksTest-557342348 tempest-NetworksTest-557342348-project-admin] 10.222.0.85 "GET /compute/v2.1/os-networks" status: 200 len: 3326 microversion: 2.1 time: 0.244366 Aug 24 10:11:30.983371 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 73/167] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:11:30 2022] GET /compute/v2.1/os-networks => generated 3326 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:31.612412 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f458dbc1-8968-4398-b1a1-8ae09a782a94 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:31.613044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f458dbc1-8968-4398-b1a1-8ae09a782a94 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: 7e6f46da-f3b6-41ec-96f2-a3db16593a10] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:31.624578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f458dbc1-8968-4398-b1a1-8ae09a782a94 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:31.626271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f458dbc1-8968-4398-b1a1-8ae09a782a94 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:31.626742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f458dbc1-8968-4398-b1a1-8ae09a782a94 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:31.631834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f458dbc1-8968-4398-b1a1-8ae09a782a94 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:31.633283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f458dbc1-8968-4398-b1a1-8ae09a782a94 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:31.633888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f458dbc1-8968-4398-b1a1-8ae09a782a94 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:31.719469 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-82780d79-6470-4153-acdd-207a36ac0dfd tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 200 len: 1640 microversion: 2.1 time: 0.892329 Aug 24 10:11:31.723566 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 95/168] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:30 2022] GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 1640 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:11:31.746693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f5bad194-d626-4cb2-b569-5ab2d85d5c8a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:31.747712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f5bad194-d626-4cb2-b569-5ab2d85d5c8a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:31.756654 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5bad194-d626-4cb2-b569-5ab2d85d5c8a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:31.757291 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5bad194-d626-4cb2-b569-5ab2d85d5c8a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:31.757876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5bad194-d626-4cb2-b569-5ab2d85d5c8a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:31.759064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5bad194-d626-4cb2-b569-5ab2d85d5c8a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:31.759592 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5bad194-d626-4cb2-b569-5ab2d85d5c8a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:31.760448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5bad194-d626-4cb2-b569-5ab2d85d5c8a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:31.805548 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f5bad194-d626-4cb2-b569-5ab2d85d5c8a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:11:31.814914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:31.898906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f458dbc1-8968-4398-b1a1-8ae09a782a94 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:31.912275 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f458dbc1-8968-4398-b1a1-8ae09a782a94 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10" status: 200 len: 1388 microversion: 2.1 time: 0.302978 Aug 24 10:11:31.913878 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 74/169] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:31 2022] GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10 => generated 1388 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:11:32.034840 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f5bad194-d626-4cb2-b569-5ab2d85d5c8a tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 204 len: 0 microversion: 2.1 time: 0.293911 Aug 24 10:11:32.035845 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 96/170] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:11:31 2022] DELETE /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:11:32.050224 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f8520af6-8d70-435e-bf15-9b5579e53303 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:32.052933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f8520af6-8d70-435e-bf15-9b5579e53303 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:32.066373 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8520af6-8d70-435e-bf15-9b5579e53303 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:32.067361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8520af6-8d70-435e-bf15-9b5579e53303 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:32.068048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8520af6-8d70-435e-bf15-9b5579e53303 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:32.069095 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8520af6-8d70-435e-bf15-9b5579e53303 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:32.070246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8520af6-8d70-435e-bf15-9b5579e53303 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:32.071696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8520af6-8d70-435e-bf15-9b5579e53303 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:32.275565 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f8520af6-8d70-435e-bf15-9b5579e53303 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213baa7d5703491b9ea67a5f7231212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd058330a96034236a9429ab2891a111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:32.285368 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f8520af6-8d70-435e-bf15-9b5579e53303 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 200 len: 1495 microversion: 2.1 time: 0.243632 Aug 24 10:11:32.286290 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 75/171] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:32 2022] GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 1495 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:32.951808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-03b13df6-52c1-4409-8447-00a2eae68c20 req-89c82f9a-d768-48bb-903d-4d74e93985e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e6f46da-f3b6-41ec-96f2-a3db16593a10", "tag": "759674c4-7256-4865-8493-4fa0e5a87e8e"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:32.952534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3274d425-b46a-4f10-b657-83afe1b11b8b tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:32.954590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3274d425-b46a-4f10-b657-83afe1b11b8b tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: 7e6f46da-f3b6-41ec-96f2-a3db16593a10] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:32.984584 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3274d425-b46a-4f10-b657-83afe1b11b8b tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:32.990951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3274d425-b46a-4f10-b657-83afe1b11b8b tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:32.991792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3274d425-b46a-4f10-b657-83afe1b11b8b tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:32.993020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3274d425-b46a-4f10-b657-83afe1b11b8b tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:32.998131 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3274d425-b46a-4f10-b657-83afe1b11b8b tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:32.999994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3274d425-b46a-4f10-b657-83afe1b11b8b tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:33.002540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-03b13df6-52c1-4409-8447-00a2eae68c20 req-89c82f9a-d768-48bb-903d-4d74e93985e4 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:33.003423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-03b13df6-52c1-4409-8447-00a2eae68c20 req-89c82f9a-d768-48bb-903d-4d74e93985e4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:33.005796 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-03b13df6-52c1-4409-8447-00a2eae68c20 req-89c82f9a-d768-48bb-903d-4d74e93985e4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:33.051208 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-03b13df6-52c1-4409-8447-00a2eae68c20 req-89c82f9a-d768-48bb-903d-4d74e93985e4 service nova] Creating event network-changed:759674c4-7256-4865-8493-4fa0e5a87e8e for instance 7e6f46da-f3b6-41ec-96f2-a3db16593a10 on n-h1-849328-3 Aug 24 10:11:33.063790 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-03b13df6-52c1-4409-8447-00a2eae68c20 req-89c82f9a-d768-48bb-903d-4d74e93985e4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131879 Aug 24 10:11:33.066116 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 97/172] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:33.279598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3274d425-b46a-4f10-b657-83afe1b11b8b tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:33.289758 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3274d425-b46a-4f10-b657-83afe1b11b8b tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10" status: 200 len: 1388 microversion: 2.1 time: 0.351701 Aug 24 10:11:33.303360 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 76/173] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:32 2022] GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10 => generated 1388 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:33.322864 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2ed10f35-0a80-4a86-aaba-3f0c04ce8d73 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:33.324136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2ed10f35-0a80-4a86-aaba-3f0c04ce8d73 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:33.364397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ed10f35-0a80-4a86-aaba-3f0c04ce8d73 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:33.373433 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ed10f35-0a80-4a86-aaba-3f0c04ce8d73 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:33.376274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ed10f35-0a80-4a86-aaba-3f0c04ce8d73 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:33.383376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ed10f35-0a80-4a86-aaba-3f0c04ce8d73 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:33.384360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ed10f35-0a80-4a86-aaba-3f0c04ce8d73 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:33.388357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ed10f35-0a80-4a86-aaba-3f0c04ce8d73 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:33.623886 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:33.831593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2ed10f35-0a80-4a86-aaba-3f0c04ce8d73 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213baa7d5703491b9ea67a5f7231212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd058330a96034236a9429ab2891a111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:33.858971 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2ed10f35-0a80-4a86-aaba-3f0c04ce8d73 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 200 len: 1495 microversion: 2.1 time: 0.549689 Aug 24 10:11:33.872647 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 98/174] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:33 2022] GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 1495 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:34.312249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-14ae81a3-b742-4b2c-9cd8-a9196fe3acb8 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:34.313671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-14ae81a3-b742-4b2c-9cd8-a9196fe3acb8 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: 7e6f46da-f3b6-41ec-96f2-a3db16593a10] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:34.323519 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ae81a3-b742-4b2c-9cd8-a9196fe3acb8 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:34.326459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ae81a3-b742-4b2c-9cd8-a9196fe3acb8 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:34.327623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ae81a3-b742-4b2c-9cd8-a9196fe3acb8 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:34.330691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ae81a3-b742-4b2c-9cd8-a9196fe3acb8 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:34.331561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ae81a3-b742-4b2c-9cd8-a9196fe3acb8 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:34.332289 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ae81a3-b742-4b2c-9cd8-a9196fe3acb8 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:34.672523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-14ae81a3-b742-4b2c-9cd8-a9196fe3acb8 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:34.706539 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-14ae81a3-b742-4b2c-9cd8-a9196fe3acb8 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10" status: 200 len: 1388 microversion: 2.1 time: 0.398256 Aug 24 10:11:34.708332 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 77/175] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:34 2022] GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10 => generated 1388 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:34.895802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c9c6be35-fe5a-4bc0-9243-57b80bed1f05 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:34.897613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c9c6be35-fe5a-4bc0-9243-57b80bed1f05 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:34.901572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:34.907073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9c6be35-fe5a-4bc0-9243-57b80bed1f05 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:34.908368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9c6be35-fe5a-4bc0-9243-57b80bed1f05 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:34.909036 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9c6be35-fe5a-4bc0-9243-57b80bed1f05 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:34.910750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9c6be35-fe5a-4bc0-9243-57b80bed1f05 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:34.911402 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9c6be35-fe5a-4bc0-9243-57b80bed1f05 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:34.912252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9c6be35-fe5a-4bc0-9243-57b80bed1f05 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:35.347164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c9c6be35-fe5a-4bc0-9243-57b80bed1f05 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213baa7d5703491b9ea67a5f7231212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd058330a96034236a9429ab2891a111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:35.356279 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c9c6be35-fe5a-4bc0-9243-57b80bed1f05 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 200 len: 1495 microversion: 2.1 time: 0.469198 Aug 24 10:11:35.357510 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 99/176] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:34 2022] GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 1495 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:35.733339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6b1be1ee-0863-4647-b03c-dc2940cfff1a tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:35.734189 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6b1be1ee-0863-4647-b03c-dc2940cfff1a tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: 7e6f46da-f3b6-41ec-96f2-a3db16593a10] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:35.748157 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b1be1ee-0863-4647-b03c-dc2940cfff1a tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:35.748650 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b1be1ee-0863-4647-b03c-dc2940cfff1a tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:35.752590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b1be1ee-0863-4647-b03c-dc2940cfff1a tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:35.753633 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b1be1ee-0863-4647-b03c-dc2940cfff1a tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:35.755745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b1be1ee-0863-4647-b03c-dc2940cfff1a tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:35.757782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b1be1ee-0863-4647-b03c-dc2940cfff1a tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:35.826431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-621692f7-8723-4796-9a61-5a123e47ae9d tempest-QuotaClassesAdmin257Test-929404070 tempest-QuotaClassesAdmin257Test-929404070-project-admin] Calling method '.version_select at 0x7f4655af31f0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:35.827179 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:35.827179 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:35.849110 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-621692f7-8723-4796-9a61-5a123e47ae9d tempest-QuotaClassesAdmin257Test-929404070 tempest-QuotaClassesAdmin257Test-929404070-project-admin] 10.222.0.85 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.585098 Aug 24 10:11:35.851025 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 78/177] 10.222.0.85 () {60 vars in 1226 bytes} [Wed Aug 24 10:11:35 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:11:35.864852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5df75097-4908-457b-8f23-1f9e105f4e59 tempest-QuotaClassesAdmin257Test-929404070 tempest-QuotaClassesAdmin257Test-929404070-project-admin] Action: 'update', calling method: .version_select at 0x7f4655af3790>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:35.867840 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:35.867840 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:36.093646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=8,nova_api:DELETE=3,nova_api:UPDATE=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:36.118806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6b1be1ee-0863-4647-b03c-dc2940cfff1a tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:36.130373 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6b1be1ee-0863-4647-b03c-dc2940cfff1a tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10" status: 200 len: 1388 microversion: 2.1 time: 0.401883 Aug 24 10:11:36.131617 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 100/178] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:35 2022] GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10 => generated 1388 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:11:36.295042 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5df75097-4908-457b-8f23-1f9e105f4e59 tempest-QuotaClassesAdmin257Test-929404070 tempest-QuotaClassesAdmin257Test-929404070-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.437274 Aug 24 10:11:36.300179 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 79/179] 10.222.0.85 () {62 vars in 1247 bytes} [Wed Aug 24 10:11:35 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:11:36.312239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-076c9825-4a00-4050-b25a-b04235d3c945 tempest-QuotaClassesAdmin257Test-929404070 tempest-QuotaClassesAdmin257Test-929404070-project-admin] Calling method '.version_select at 0x7f46565aef70>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:36.313578 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:36.313578 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:36.336645 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-076c9825-4a00-4050-b25a-b04235d3c945 tempest-QuotaClassesAdmin257Test-929404070 tempest-QuotaClassesAdmin257Test-929404070-project-admin] 10.222.0.85 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.029685 Aug 24 10:11:36.337954 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 101/180] 10.222.0.85 () {60 vars in 1226 bytes} [Wed Aug 24 10:11:36 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:11:36.356420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-519e7412-28de-4855-9738-37efc6fa8eac tempest-QuotaClassesAdmin257Test-929404070 tempest-QuotaClassesAdmin257Test-929404070-project-admin] Action: 'update', calling method: .version_select at 0x7f4655af3940>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:36.379552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-12a692d8-2510-420b-b39e-252778be438f req-612a1288-3beb-47ab-8e8d-93ec856733a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9790d01-4c85-4d60-814e-d32faf530877", "name": "network-vif-deleted", "tag": "ff1c8f8e-b4f9-4267-9cfe-17547f94eaaf"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:36.460612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-12a692d8-2510-420b-b39e-252778be438f req-612a1288-3beb-47ab-8e8d-93ec856733a3 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:36.461249 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-12a692d8-2510-420b-b39e-252778be438f req-612a1288-3beb-47ab-8e8d-93ec856733a3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:36.461699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-12a692d8-2510-420b-b39e-252778be438f req-612a1288-3beb-47ab-8e8d-93ec856733a3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:36.506128 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-12a692d8-2510-420b-b39e-252778be438f req-612a1288-3beb-47ab-8e8d-93ec856733a3 service nova] Creating event network-vif-deleted:ff1c8f8e-b4f9-4267-9cfe-17547f94eaaf for instance a9790d01-4c85-4d60-814e-d32faf530877 on n-h2-849328-3 Aug 24 10:11:36.540976 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-12a692d8-2510-420b-b39e-252778be438f req-612a1288-3beb-47ab-8e8d-93ec856733a3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167773 Aug 24 10:11:36.542927 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 102/181] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:36.544553 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-519e7412-28de-4855-9738-37efc6fa8eac tempest-QuotaClassesAdmin257Test-929404070 tempest-QuotaClassesAdmin257Test-929404070-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.199276 Aug 24 10:11:36.545626 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 80/182] 10.222.0.85 () {62 vars in 1247 bytes} [Wed Aug 24 10:11:36 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:11:36.563532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c715017e-4a2d-4c4d-9569-2ff5ec3d4aa4 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:36.565080 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c715017e-4a2d-4c4d-9569-2ff5ec3d4aa4 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:36.577962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c715017e-4a2d-4c4d-9569-2ff5ec3d4aa4 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:36.578916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c715017e-4a2d-4c4d-9569-2ff5ec3d4aa4 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:36.579661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c715017e-4a2d-4c4d-9569-2ff5ec3d4aa4 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:36.580762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c715017e-4a2d-4c4d-9569-2ff5ec3d4aa4 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:36.581514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c715017e-4a2d-4c4d-9569-2ff5ec3d4aa4 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:36.582130 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c715017e-4a2d-4c4d-9569-2ff5ec3d4aa4 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:36.657507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c715017e-4a2d-4c4d-9569-2ff5ec3d4aa4 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:36.659259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c715017e-4a2d-4c4d-9569-2ff5ec3d4aa4 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:36.659940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c715017e-4a2d-4c4d-9569-2ff5ec3d4aa4 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:36.660591 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-c715017e-4a2d-4c4d-9569-2ff5ec3d4aa4 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lazy-loading 'fault' on Instance uuid a9790d01-4c85-4d60-814e-d32faf530877 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:11:36.886494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c715017e-4a2d-4c4d-9569-2ff5ec3d4aa4 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213baa7d5703491b9ea67a5f7231212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd058330a96034236a9429ab2891a111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:36.899775 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c715017e-4a2d-4c4d-9569-2ff5ec3d4aa4 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 200 len: 1329 microversion: 2.1 time: 0.354426 Aug 24 10:11:36.900403 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 103/183] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:36 2022] GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 1329 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:37.154189 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e49cec5f-0c85-4f46-9658-f0a1ced0eb16 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:37.154938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e49cec5f-0c85-4f46-9658-f0a1ced0eb16 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: 7e6f46da-f3b6-41ec-96f2-a3db16593a10] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:37.167941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e49cec5f-0c85-4f46-9658-f0a1ced0eb16 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:37.171080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e49cec5f-0c85-4f46-9658-f0a1ced0eb16 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:37.172272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e49cec5f-0c85-4f46-9658-f0a1ced0eb16 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:37.175885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e49cec5f-0c85-4f46-9658-f0a1ced0eb16 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:37.176999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e49cec5f-0c85-4f46-9658-f0a1ced0eb16 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:37.179544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e49cec5f-0c85-4f46-9658-f0a1ced0eb16 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:37.217617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:37.400950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e49cec5f-0c85-4f46-9658-f0a1ced0eb16 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:37.411710 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e49cec5f-0c85-4f46-9658-f0a1ced0eb16 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10" status: 200 len: 1388 microversion: 2.1 time: 0.262570 Aug 24 10:11:37.418837 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 81/184] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:37 2022] GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10 => generated 1388 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:37.920614 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5d0442fc-1ae6-4d1d-b427-62966e986f5c tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:37.921271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5d0442fc-1ae6-4d1d-b427-62966e986f5c tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:37.930451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d0442fc-1ae6-4d1d-b427-62966e986f5c tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:37.935005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d0442fc-1ae6-4d1d-b427-62966e986f5c tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:37.937686 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d0442fc-1ae6-4d1d-b427-62966e986f5c tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:37.941232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d0442fc-1ae6-4d1d-b427-62966e986f5c tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:37.942459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d0442fc-1ae6-4d1d-b427-62966e986f5c tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:37.943993 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d0442fc-1ae6-4d1d-b427-62966e986f5c tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:37.981500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-690c6784-55b2-4d74-b349-e57ea38fdf25 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Calling method '.version_select at 0x7f4656493040>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:37.984065 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-5d0442fc-1ae6-4d1d-b427-62966e986f5c tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] HTTP exception thrown: Instance a9790d01-4c85-4d60-814e-d32faf530877 could not be found. Aug 24 10:11:37.997648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5d0442fc-1ae6-4d1d-b427-62966e986f5c tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Request method failure captured: Aug 24 10:11:37.997648 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 HTTP/1.1 Aug 24 10:11:37.997648 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:11:37.997648 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:11:37.997648 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:11:37.997648 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:11:37.997648 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:11:37.997648 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:11:37.997648 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:11:37.997648 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:37.997648 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfktzSjRXQs9jrfJhckPVukb1ZKsZLepeg7Uq7Kv4gDF373M4WP9K6qXRa34NEYZlqQ1ggGhqDCloklYevV5UrGW7LEfj_m0CbQAJ_we9F4m2dd-YmVA20PNF3vs0TroESn4-6n6tPT6FizuHFcwlN2vqagA__GBx1Mh1RFlmlYZs7E Aug 24 10:11:37.997648 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:11:37.997648 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:11:37.997648 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:11:37.997648 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:11:37.997648 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:11:37.997648 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:11:37.997648 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d058330a96034236a9429ab2891a111d Aug 24 10:11:37.997648 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminTestJSON-1978145020 Aug 24 10:11:37.997648 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:11:37.997648 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:11:37.999167 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d058330a96034236a9429ab2891a111d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d058330a96034236a9429ab2891a111d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d058330a96034236a9429ab2891a111d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d058330a96034236a9429ab2891a111d"}]}] Aug 24 10:11:37.999167 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminTestJSON-1978145020 Aug 24 10:11:37.999167 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d058330a96034236a9429ab2891a111d Aug 24 10:11:37.999167 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1978145020 Aug 24 10:11:37.999167 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminTestJSON-1978145020-project Aug 24 10:11:37.999167 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:11:37.999167 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:11:37.999167 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 213baa7d5703491b9ea67a5f7231212b Aug 24 10:11:37.999167 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminTestJSON-1978145020-project Aug 24 10:11:37.999167 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:11:37.999167 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance a9790d01-4c85-4d60-814e-d32faf530877 could not be found. Aug 24 10:11:37.999167 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'a9790d01-4c85-4d60-814e-d32faf530877'} Aug 24 10:11:37.999834 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:37.999834 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:37.999834 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:11:37.999834 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:11:37.999834 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:11:37.999834 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:11:37.999834 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:11:37.999834 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:11:37.999834 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:11:37.999834 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:11:37.999834 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9790d01-4c85-4d60-814e-d32faf530877 could not be found. Aug 24 10:11:37.999834 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:37.999834 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:37.999834 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:37.999834 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:37.999834 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:37.999834 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:37.999834 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:37.999834 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:37.999834 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:38.001292 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:38.001292 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:11:38.001292 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:11:38.001292 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:11:38.001292 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:11:38.001292 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:11:38.001292 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:11:38.001292 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9790d01-4c85-4d60-814e-d32faf530877 could not be found. Aug 24 10:11:38.001292 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:38.001292 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:38.001292 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:38.001292 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:38.001292 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:38.001292 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:38.001292 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:11:38.001292 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:11:38.001292 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9790d01-4c85-4d60-814e-d32faf530877 could not be found. Aug 24 10:11:38.001292 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:38.002340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5d0442fc-1ae6-4d1d-b427-62966e986f5c tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Returning 404 to user: Instance a9790d01-4c85-4d60-814e-d32faf530877 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:38.002340 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5d0442fc-1ae6-4d1d-b427-62966e986f5c tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 404 len: 111 microversion: 2.1 time: 0.082762 Aug 24 10:11:38.005963 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 82/185] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:37 2022] GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:11:38.020496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9d62a5c4-ed1b-4b93-8622-3317c2e1276e tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-849328-3"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:38.026688 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:38.026688 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:38.044806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d62a5c4-ed1b-4b93-8622-3317c2e1276e tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:38.047077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d62a5c4-ed1b-4b93-8622-3317c2e1276e tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:38.049245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d62a5c4-ed1b-4b93-8622-3317c2e1276e tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:38.300841 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9d62a5c4-ed1b-4b93-8622-3317c2e1276e tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 300 microversion: 2.1 time: 0.290515 Aug 24 10:11:38.303614 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 83/186] 10.222.0.85 () {60 vars in 1191 bytes} [Wed Aug 24 10:11:38 2022] POST /compute/v2.1/os-aggregates/1/action => generated 300 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:11:38.315179 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a3e890d2-7270-4335-aac1-b122886f5398 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:38.316271 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:38.316271 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:38.361338 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a3e890d2-7270-4335-aac1-b122886f5398 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.049990 Aug 24 10:11:38.361960 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 84/187] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:11:38 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 24 10:11:38.375650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-837b552e-a53a-429b-b9a8-7130203a2230 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1587246724"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:38.381723 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:38.381723 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:38.386507 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.aggregate [None req-837b552e-a53a-429b-b9a8-7130203a2230 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Generated uuid 39306763-30de-443f-ba2b-e333ab65a3ab for aggregate {{(pid=122433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 10:11:38.433496 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-837b552e-a53a-429b-b9a8-7130203a2230 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.062287 Aug 24 10:11:38.434786 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 85/188] 10.222.0.85 () {60 vars in 1164 bytes} [Wed Aug 24 10:11:38 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:38.442218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7f0b3585-a74f-4068-ab9f-9d98e76a500c tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:38.443114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7f0b3585-a74f-4068-ab9f-9d98e76a500c tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: 7e6f46da-f3b6-41ec-96f2-a3db16593a10] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:38.455751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f0b3585-a74f-4068-ab9f-9d98e76a500c tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:38.458651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f0b3585-a74f-4068-ab9f-9d98e76a500c tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:38.459309 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f0b3585-a74f-4068-ab9f-9d98e76a500c tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:38.460529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f0b3585-a74f-4068-ab9f-9d98e76a500c tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:38.461168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f0b3585-a74f-4068-ab9f-9d98e76a500c tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:38.462087 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f0b3585-a74f-4068-ab9f-9d98e76a500c tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:38.735262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7f0b3585-a74f-4068-ab9f-9d98e76a500c tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:38.744989 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7f0b3585-a74f-4068-ab9f-9d98e76a500c tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10" status: 200 len: 1388 microversion: 2.1 time: 0.308461 Aug 24 10:11:38.758969 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 86/189] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:38 2022] GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10 => generated 1388 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:38.772771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b5a53473-cf44-492f-b085-bd5ebb6e07e1 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-849328-3"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:38.780389 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:38.780389 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:38.799419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5a53473-cf44-492f-b085-bd5ebb6e07e1 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:38.803068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5a53473-cf44-492f-b085-bd5ebb6e07e1 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:38.803532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5a53473-cf44-492f-b085-bd5ebb6e07e1 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:38.837701 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-690c6784-55b2-4d74-b349-e57ea38fdf25 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] 10.222.0.85 "GET /compute/v2.1/os-quota-sets/abbfb9a5bb7c43119c9977dff46042ad" status: 200 len: 371 microversion: 2.1 time: 1.230544 Aug 24 10:11:38.838306 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 104/190] 10.222.0.85 () {58 vars in 1242 bytes} [Wed Aug 24 10:11:37 2022] GET /compute/v2.1/os-quota-sets/abbfb9a5bb7c43119c9977dff46042ad => generated 371 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:38.861612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f0e29f82-b29f-4224-a1d3-46d7f779f6af tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Action: 'update', calling method: .version_select at 0x7f46564939d0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:39.051111 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b5a53473-cf44-492f-b085-bd5ebb6e07e1 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.291287 Aug 24 10:11:39.053005 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 87/191] 10.222.0.85 () {60 vars in 1191 bytes} [Wed Aug 24 10:11:38 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:39.069673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fe55302e-4a38-4650-b657-104e54fc2226 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:39.071858 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:39.071858 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:39.132833 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fe55302e-4a38-4650-b657-104e54fc2226 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.069057 Aug 24 10:11:39.137682 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 88/192] 10.222.0.85 () {58 vars in 1149 bytes} [Wed Aug 24 10:11:39 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:39.156823 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9ab9ebaa-6f91-439b-b1cb-0de9d47f3e6b tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-849328-3"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:39.169194 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:39.169194 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:39.197895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ab9ebaa-6f91-439b-b1cb-0de9d47f3e6b tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:39.200075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ab9ebaa-6f91-439b-b1cb-0de9d47f3e6b tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:39.201023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ab9ebaa-6f91-439b-b1cb-0de9d47f3e6b tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:39.450804 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9ab9ebaa-6f91-439b-b1cb-0de9d47f3e6b tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.302382 Aug 24 10:11:39.452907 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 89/193] 10.222.0.85 () {60 vars in 1191 bytes} [Wed Aug 24 10:11:39 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:39.466978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ab07da09-3bc8-45e9-8273-a6ca11bc2053 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:39.467978 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:39.467978 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:39.511005 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0e29f82-b29f-4224-a1d3-46d7f779f6af tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:39.511564 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0e29f82-b29f-4224-a1d3-46d7f779f6af tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:39.511918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0e29f82-b29f-4224-a1d3-46d7f779f6af tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:39.512837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0e29f82-b29f-4224-a1d3-46d7f779f6af tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:39.513796 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0e29f82-b29f-4224-a1d3-46d7f779f6af tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:39.514773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0e29f82-b29f-4224-a1d3-46d7f779f6af tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:39.521250 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ab07da09-3bc8-45e9-8273-a6ca11bc2053 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.060990 Aug 24 10:11:39.527791 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 90/194] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:11:39 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 24 10:11:39.540025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6b4110bf-10a8-4d2a-a14b-70c03fbfe3c0 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-644635263"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:39.550031 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:39.550031 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:39.551853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.aggregate [None req-6b4110bf-10a8-4d2a-a14b-70c03fbfe3c0 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Generated uuid 8508d20b-bfb6-4693-9adc-a12d2fe1378f for aggregate {{(pid=122433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 10:11:39.598365 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6b4110bf-10a8-4d2a-a14b-70c03fbfe3c0 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.065871 Aug 24 10:11:39.605455 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 91/195] 10.222.0.85 () {60 vars in 1164 bytes} [Wed Aug 24 10:11:39 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:11:39.634880 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e58d81fc-8892-4487-a324-9cd57b0a6dcd tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-849328-3"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:39.651593 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:39.651593 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:39.680449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e58d81fc-8892-4487-a324-9cd57b0a6dcd tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:39.681779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e58d81fc-8892-4487-a324-9cd57b0a6dcd tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:39.682143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e58d81fc-8892-4487-a324-9cd57b0a6dcd tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:39.768750 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f0e29f82-b29f-4224-a1d3-46d7f779f6af tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-quota-sets/abbfb9a5bb7c43119c9977dff46042ad" status: 200 len: 328 microversion: 2.1 time: 0.918086 Aug 24 10:11:39.770090 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 105/196] 10.222.0.85 () {60 vars in 1262 bytes} [Wed Aug 24 10:11:38 2022] PUT /compute/v2.1/os-quota-sets/abbfb9a5bb7c43119c9977dff46042ad => generated 328 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:39.777401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d3996912-25db-42b3-819f-231f378622f7 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:39.778265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d3996912-25db-42b3-819f-231f378622f7 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: 7e6f46da-f3b6-41ec-96f2-a3db16593a10] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:39.786819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3996912-25db-42b3-819f-231f378622f7 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:39.787550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3996912-25db-42b3-819f-231f378622f7 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:39.788264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3996912-25db-42b3-819f-231f378622f7 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:39.789364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3996912-25db-42b3-819f-231f378622f7 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:39.790303 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3996912-25db-42b3-819f-231f378622f7 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:39.791037 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3996912-25db-42b3-819f-231f378622f7 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:39.941377 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e58d81fc-8892-4487-a324-9cd57b0a6dcd tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.321089 Aug 24 10:11:39.942222 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 92/197] 10.222.0.85 () {60 vars in 1191 bytes} [Wed Aug 24 10:11:39 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:40.079914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d3996912-25db-42b3-819f-231f378622f7 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:40.092255 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d3996912-25db-42b3-819f-231f378622f7 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10" status: 200 len: 1388 microversion: 2.1 time: 0.320767 Aug 24 10:11:40.105296 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 106/198] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:39 2022] GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10 => generated 1388 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:40.120397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8328c587-1feb-46e1-8594-585913f353f8 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-849328-3"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:40.131809 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:40.131809 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:40.197038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8328c587-1feb-46e1-8594-585913f353f8 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:40.198043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8328c587-1feb-46e1-8594-585913f353f8 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:40.200200 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8328c587-1feb-46e1-8594-585913f353f8 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:40.311955 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-8328c587-1feb-46e1-8594-585913f353f8 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] HTTP exception thrown: Aggregate 3 already has host n-h2-849328-3. Aug 24 10:11:40.336905 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8328c587-1feb-46e1-8594-585913f353f8 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Request method failure captured: Aug 24 10:11:40.336905 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Aug 24 10:11:40.336905 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:11:40.336905 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:11:40.336905 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:11:40.336905 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 39 Aug 24 10:11:40.336905 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:11:40.336905 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:11:40.336905 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:11:40.336905 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:40.336905 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfkxOCrhmMp8ZyHWiuE8Rt5MgwQ2qpVfyA6gPnjpwUitOlkT8qaFf-aTwIaoU0EixOW2eKRvcYztHDpMMdyYhdwytoLU5R2blnpSzWoomJR7mk238i4Lkj8-Qge0nsnh1KlmFv8oNGr9wbmQZ0iuQYVaz5J-yaImuvOi8qgS0Ee6wJY Aug 24 10:11:40.336905 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:11:40.336905 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:11:40.336905 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:11:40.336905 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:11:40.336905 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:11:40.336905 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:11:40.336905 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 9b94a17f031a448686100da7234a3445 Aug 24 10:11:40.336905 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1791053395 Aug 24 10:11:40.336905 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,admin,member Aug 24 10:11:40.336905 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,admin,member Aug 24 10:11:40.338622 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9b94a17f031a448686100da7234a3445"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9b94a17f031a448686100da7234a3445", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9b94a17f031a448686100da7234a3445"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9b94a17f031a448686100da7234a3445"}]}] Aug 24 10:11:40.338622 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1791053395 Aug 24 10:11:40.338622 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 9b94a17f031a448686100da7234a3445 Aug 24 10:11:40.338622 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1791053395 Aug 24 10:11:40.338622 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin Aug 24 10:11:40.338622 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:11:40.338622 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:11:40.338622 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 766bd229f8f34a20b940c772dca95614 Aug 24 10:11:40.338622 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin Aug 24 10:11:40.338622 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:11:40.338622 n-d-849328-3 devstack@n-api.service[122432]: {"add_host": {"host": "n-h2-849328-3"}} Aug 24 10:11:40.338622 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:11:40.338622 n-d-849328-3 devstack@n-api.service[122432]: exception: Aggregate 3 already has host n-h2-849328-3. Aug 24 10:11:40.339424 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h2-849328-3'}}} Aug 24 10:11:40.339424 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:40.339424 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:40.339424 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 10:11:40.339424 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 24 10:11:40.339424 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 10:11:40.339424 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 24 10:11:40.339424 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 10:11:40.339424 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 24 10:11:40.339424 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 10:11:40.339424 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 24 10:11:40.339424 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 10:11:40.339424 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 10:11:40.339424 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 10:11:40.339424 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result.read() Aug 24 10:11:40.339424 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 10:11:40.339424 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 24 10:11:40.339424 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 10:11:40.339424 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 24 10:11:40.340545 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 10:11:40.340545 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 24 10:11:40.340545 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 10:11:40.340545 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 24 10:11:40.340545 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-849328-3-3' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 24 10:11:40.340545 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:40.340545 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 24 10:11:40.340545 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:40.340545 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:40.340545 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 24 10:11:40.340545 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 24 10:11:40.340545 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 24 10:11:40.340545 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi session.flush() Aug 24 10:11:40.340545 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 10:11:40.340545 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 24 10:11:40.340545 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 10:11:40.340545 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 24 10:11:40.340545 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 10:11:40.340545 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 24 10:11:40.341621 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 10:11:40.341621 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception Aug 24 10:11:40.341621 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 10:11:40.341621 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 24 10:11:40.341621 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 10:11:40.341621 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 24 10:11:40.341621 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 10:11:40.341621 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 24 10:11:40.341621 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 10:11:40.341621 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 24 10:11:40.341621 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 10:11:40.341621 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 24 10:11:40.341621 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 10:11:40.341621 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 10:11:40.341621 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 10:11:40.341621 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 24 10:11:40.341621 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 10:11:40.341621 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 24 10:11:40.343579 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 10:11:40.343579 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 24 10:11:40.343579 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 10:11:40.343579 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 10:11:40.343579 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 10:11:40.343579 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception Aug 24 10:11:40.343579 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 10:11:40.343579 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 24 10:11:40.343579 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 10:11:40.343579 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 24 10:11:40.343579 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 10:11:40.343579 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 24 10:11:40.343579 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 10:11:40.343579 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 24 10:11:40.343579 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 10:11:40.343579 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 10:11:40.343579 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 10:11:40.343579 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result.read() Aug 24 10:11:40.346210 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 10:11:40.346210 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 24 10:11:40.346210 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 10:11:40.346210 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 24 10:11:40.346210 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 10:11:40.346210 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 24 10:11:40.346210 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 10:11:40.346210 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 24 10:11:40.346210 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-849328-3-3' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 24 10:11:40.346210 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 24 10:11:40.346210 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 24, 10, 11, 40, 294808), 'updated_at': None, 'host': 'n-h2-849328-3', 'aggregate_id': 3}] Aug 24 10:11:40.346210 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 10:11:40.346210 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:40.346210 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:40.346210 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:40.346210 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:40.346210 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 24 10:11:40.348090 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 24 10:11:40.348090 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 10:11:40.348090 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 10:11:40.348090 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:11:40.348090 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:11:40.348090 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:11:40.348090 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:11:40.348090 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 10:11:40.348090 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 10:11:40.348090 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6636, in add_host_to_aggregate Aug 24 10:11:40.348090 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 24 10:11:40.348090 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 24 10:11:40.348090 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 24 10:11:40.348090 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 24 10:11:40.348090 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 24 10:11:40.348090 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 24 10:11:40.348090 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 24 10:11:40.348090 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 3 already has host n-h2-849328-3. Aug 24 10:11:40.348090 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:40.348090 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:40.351577 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:40.351577 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:40.351577 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:40.351577 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:40.351577 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:40.351577 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:40.351577 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:40.351577 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:40.351577 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:40.351577 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:40.351577 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 24 10:11:40.351577 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 24 10:11:40.351577 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 3 already has host n-h2-849328-3. Aug 24 10:11:40.351577 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:40.351577 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:40.351577 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:40.351577 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:40.351577 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:40.351577 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:40.351577 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:11:40.351577 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:11:40.352988 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 3 already has host n-h2-849328-3. Aug 24 10:11:40.352988 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:40.354457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8328c587-1feb-46e1-8594-585913f353f8 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Returning 409 to user: Aggregate 3 already has host n-h2-849328-3. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:40.354457 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8328c587-1feb-46e1-8594-585913f353f8 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates/3/action" status: 409 len: 95 microversion: 2.1 time: 0.244622 Aug 24 10:11:40.356797 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 107/199] 10.222.0.85 () {60 vars in 1191 bytes} [Wed Aug 24 10:11:40 2022] POST /compute/v2.1/os-aggregates/3/action => generated 95 bytes in 251 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 24 10:11:40.360339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a4b2a643-9fcb-4fed-88a5-d023c501c7fa tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1223459561", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:40.442221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-528f01e7-2ef8-42c9-b878-9c0672f970a7 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1830282075", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:40.455537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-a4b2a643-9fcb-4fed-88a5-d023c501c7fa tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:11:40.515914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-528f01e7-2ef8-42c9-b878-9c0672f970a7 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:11:40.856663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a4b2a643-9fcb-4fed-88a5-d023c501c7fa tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:11:40.857291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a4b2a643-9fcb-4fed-88a5-d023c501c7fa tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:11:40.857927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a4b2a643-9fcb-4fed-88a5-d023c501c7fa tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:11:40.860945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a4b2a643-9fcb-4fed-88a5-d023c501c7fa tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:11:40.861568 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a4b2a643-9fcb-4fed-88a5-d023c501c7fa tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:11:40.872515 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4b2a643-9fcb-4fed-88a5-d023c501c7fa tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:40.873295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4b2a643-9fcb-4fed-88a5-d023c501c7fa tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:40.873744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4b2a643-9fcb-4fed-88a5-d023c501c7fa tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:40.874485 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4b2a643-9fcb-4fed-88a5-d023c501c7fa tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:40.874943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4b2a643-9fcb-4fed-88a5-d023c501c7fa tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:40.875373 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4b2a643-9fcb-4fed-88a5-d023c501c7fa tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:40.895996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-a4b2a643-9fcb-4fed-88a5-d023c501c7fa tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Getting quotas for project abbfb9a5bb7c43119c9977dff46042ad. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:11:40.902219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-a4b2a643-9fcb-4fed-88a5-d023c501c7fa tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Getting quotas for user d53b9b8b2e5b4b45bac7281d737b506c and project abbfb9a5bb7c43119c9977dff46042ad. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:11:40.905780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:UPDATE=10,nova_api:SELECT=77,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:40.932468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.utils [None req-a4b2a643-9fcb-4fed-88a5-d023c501c7fa tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] cores quota exceeded for abbfb9a5bb7c43119c9977dff46042ad, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122433) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 24 10:11:40.933366 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-a4b2a643-9fcb-4fed-88a5-d023c501c7fa tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 24 10:11:40.938496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a4b2a643-9fcb-4fed-88a5-d023c501c7fa tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Request method failure captured: Aug 24 10:11:40.938496 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:11:40.938496 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:11:40.938496 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:11:40.938496 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:11:40.938496 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 145 Aug 24 10:11:40.938496 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:11:40.938496 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:11:40.938496 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:11:40.938496 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:40.938496 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBflXdaouklNpWQ1FqRKZ_UdeKIWLp3RMBalwfMF7QcQNWsCUKPjxgx3IrfTXpFC-qsPExr8W1pWfddj-UU0XyrFFbN8WIyloUMSB__oE3J-G0Ys-jgFJQDbfxHHXZB6Lpcky_fl5BUsxt6YeknIvl3JO0qGiYlhbahW5KVmeboONlcY Aug 24 10:11:40.938496 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:11:40.938496 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:11:40.938496 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:11:40.938496 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:11:40.938496 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:11:40.938496 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:11:40.938496 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: abbfb9a5bb7c43119c9977dff46042ad Aug 24 10:11:40.938496 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-QuotasAdminNegativeTest-113072488 Aug 24 10:11:40.938496 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:11:40.938496 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:11:40.940084 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/abbfb9a5bb7c43119c9977dff46042ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_abbfb9a5bb7c43119c9977dff46042ad", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/abbfb9a5bb7c43119c9977dff46042ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/abbfb9a5bb7c43119c9977dff46042ad"}]}] Aug 24 10:11:40.940084 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-QuotasAdminNegativeTest-113072488 Aug 24 10:11:40.940084 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: abbfb9a5bb7c43119c9977dff46042ad Aug 24 10:11:40.940084 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-113072488 Aug 24 10:11:40.940084 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-QuotasAdminNegativeTest-113072488-project Aug 24 10:11:40.940084 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:11:40.940084 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:11:40.940084 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: d53b9b8b2e5b4b45bac7281d737b506c Aug 24 10:11:40.940084 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-QuotasAdminNegativeTest-113072488-project Aug 24 10:11:40.940084 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:11:40.940084 n-d-849328-3 devstack@n-api.service[122433]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1223459561", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}} Aug 24 10:11:40.940084 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:11:40.940995 n-d-849328-3 devstack@n-api.service[122433]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 24 10:11:40.940995 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1223459561', 'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af', 'flavorRef': '452'}}} Aug 24 10:11:40.940995 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:40.940995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:40.940995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 24 10:11:40.940995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 24 10:11:40.940995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:11:40.940995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:11:40.940995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 24 10:11:40.940995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc Aug 24 10:11:40.940995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 24 10:11:40.940995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 24 10:11:40.940995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:11:40.940995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:11:40.940995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 24 10:11:40.940995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 24 10:11:40.940995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 24 10:11:40.940995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 24 10:11:40.942362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 24 10:11:40.942362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 24 10:11:40.942362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 24 10:11:40.942362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:40.942362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:40.942362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:40.942362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:40.942362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 24 10:11:40.942362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 24 10:11:40.942362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 24 10:11:40.942362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 24 10:11:40.942362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1720, in _create_instance Aug 24 10:11:40.942362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 24 10:11:40.942362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1349, in _provision_instances Aug 24 10:11:40.942362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 24 10:11:40.942362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 24 10:11:40.942362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 24 10:11:40.942362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 24 10:11:40.942362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:40.942362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:40.942362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:40.943782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:40.943782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:40.943782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:40.943782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:40.943782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:40.943782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:40.943782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:40.943782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:40.943782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:40.943782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:40.943782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:40.943782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:40.943782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:40.943782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 10:11:40.943782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 24 10:11:40.943782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 24 10:11:40.943782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 24 10:11:40.943782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:40.943782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:40.943782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:40.943782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:40.945145 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:40.945145 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:40.945145 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:11:40.945145 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:11:40.945145 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 24 10:11:40.945145 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:40.947073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a4b2a643-9fcb-4fed-88a5-d023c501c7fa tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:40.948116 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a4b2a643-9fcb-4fed-88a5-d023c501c7fa tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.001550 Aug 24 10:11:40.949073 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 93/200] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:11:39 2022] POST /compute/v2.1/servers => generated 111 bytes in 1003 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:11:40.956828 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4067bca3-d9a9-4d72-80d9-303751bfb467 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-849328-3"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:40.961422 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:40.961422 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:40.972406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4067bca3-d9a9-4d72-80d9-303751bfb467 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:40.973749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4067bca3-d9a9-4d72-80d9-303751bfb467 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:40.974659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4067bca3-d9a9-4d72-80d9-303751bfb467 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:41.142311 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4067bca3-d9a9-4d72-80d9-303751bfb467 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.191787 Aug 24 10:11:41.143804 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 94/201] 10.222.0.85 () {60 vars in 1191 bytes} [Wed Aug 24 10:11:40 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:41.149795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8179554a-f0f4-4f90-be24-fb636868411b req-a2714db6-87eb-42fe-8416-0fcda3d162a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e6f46da-f3b6-41ec-96f2-a3db16593a10", "name": "network-vif-plugged", "status": "completed", "tag": "759674c4-7256-4865-8493-4fa0e5a87e8e"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:41.162088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8179554a-f0f4-4f90-be24-fb636868411b req-a2714db6-87eb-42fe-8416-0fcda3d162a3 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:41.162565 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8179554a-f0f4-4f90-be24-fb636868411b req-a2714db6-87eb-42fe-8416-0fcda3d162a3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:41.162995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8179554a-f0f4-4f90-be24-fb636868411b req-a2714db6-87eb-42fe-8416-0fcda3d162a3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:41.174971 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8179554a-f0f4-4f90-be24-fb636868411b req-a2714db6-87eb-42fe-8416-0fcda3d162a3 service nova] Creating event network-vif-plugged:759674c4-7256-4865-8493-4fa0e5a87e8e for instance 7e6f46da-f3b6-41ec-96f2-a3db16593a10 on n-h1-849328-3 Aug 24 10:11:41.181330 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8179554a-f0f4-4f90-be24-fb636868411b req-a2714db6-87eb-42fe-8416-0fcda3d162a3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036251 Aug 24 10:11:41.182337 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 95/202] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:41.187857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-266c3692-3212-4c89-b29e-979945051efe tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Action: 'update', calling method: .version_select at 0x7f46559f2f70>, body: {"quota_set": {"cores": 20}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:41.229542 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-528f01e7-2ef8-42c9-b878-9c0672f970a7 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:11:41.236325 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-528f01e7-2ef8-42c9-b878-9c0672f970a7 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:11:41.239440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-528f01e7-2ef8-42c9-b878-9c0672f970a7 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:11:41.240135 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-528f01e7-2ef8-42c9-b878-9c0672f970a7 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:11:41.240853 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-528f01e7-2ef8-42c9-b878-9c0672f970a7 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:11:41.258559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-528f01e7-2ef8-42c9-b878-9c0672f970a7 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:41.259495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-528f01e7-2ef8-42c9-b878-9c0672f970a7 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:41.272898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-528f01e7-2ef8-42c9-b878-9c0672f970a7 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:41.274053 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-528f01e7-2ef8-42c9-b878-9c0672f970a7 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:41.274739 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-528f01e7-2ef8-42c9-b878-9c0672f970a7 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:41.275390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-528f01e7-2ef8-42c9-b878-9c0672f970a7 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:41.298634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-528f01e7-2ef8-42c9-b878-9c0672f970a7 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Getting quotas for project 82ddc0c46e914bbd8e265692275f7201. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:11:41.304216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-528f01e7-2ef8-42c9-b878-9c0672f970a7 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Getting quotas for user e7f03e78d1af4252b1d32f0b103b6e16 and project 82ddc0c46e914bbd8e265692275f7201. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:11:41.316356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:41.320205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-528f01e7-2ef8-42c9-b878-9c0672f970a7 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:11:41.322783 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-528f01e7-2ef8-42c9-b878-9c0672f970a7 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 10f639ed-ba2f-4983-9c04-777480733871] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:11:41.395122 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-528f01e7-2ef8-42c9-b878-9c0672f970a7 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.032384 Aug 24 10:11:41.396555 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 108/203] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:11:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:11:41.406283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f985897e-0bb9-455a-89e2-637933433c28 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:41.408080 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f985897e-0bb9-455a-89e2-637933433c28 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: 7e6f46da-f3b6-41ec-96f2-a3db16593a10] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:41.415760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f985897e-0bb9-455a-89e2-637933433c28 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:41.416555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f985897e-0bb9-455a-89e2-637933433c28 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:41.417603 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f985897e-0bb9-455a-89e2-637933433c28 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:41.418563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f985897e-0bb9-455a-89e2-637933433c28 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:41.419362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f985897e-0bb9-455a-89e2-637933433c28 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:41.420558 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f985897e-0bb9-455a-89e2-637933433c28 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:41.567179 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-266c3692-3212-4c89-b29e-979945051efe tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:41.568855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-266c3692-3212-4c89-b29e-979945051efe tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:41.570335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-266c3692-3212-4c89-b29e-979945051efe tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:41.571144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-266c3692-3212-4c89-b29e-979945051efe tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:41.571607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-266c3692-3212-4c89-b29e-979945051efe tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:41.572113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-266c3692-3212-4c89-b29e-979945051efe tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:41.680028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f985897e-0bb9-455a-89e2-637933433c28 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:41.692693 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f985897e-0bb9-455a-89e2-637933433c28 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10" status: 200 len: 1388 microversion: 2.1 time: 0.294261 Aug 24 10:11:41.694419 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 109/204] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:41 2022] GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10 => generated 1388 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:41.704635 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-266c3692-3212-4c89-b29e-979945051efe tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-quota-sets/abbfb9a5bb7c43119c9977dff46042ad" status: 200 len: 329 microversion: 2.1 time: 0.520890 Aug 24 10:11:41.705045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b19c8a82-16d8-41d1-8c90-70f4631004fc tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:41.706099 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:41.706099 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:41.709773 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 96/205] 10.222.0.85 () {60 vars in 1262 bytes} [Wed Aug 24 10:11:41 2022] PUT /compute/v2.1/os-quota-sets/abbfb9a5bb7c43119c9977dff46042ad => generated 329 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:41.722871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fe4a040f-0735-4bad-8823-2d4b2d6d2f70 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:41.723819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fe4a040f-0735-4bad-8823-2d4b2d6d2f70 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 10f639ed-ba2f-4983-9c04-777480733871] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:41.749805 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b19c8a82-16d8-41d1-8c90-70f4631004fc tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.053719 Aug 24 10:11:41.751032 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 110/206] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:11:41 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 10:11:41.763006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-894a5348-9d6b-429c-a8b3-0c3afdf410a8 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Calling method '.version_select at 0x7f4655993700>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:41.797275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fe4a040f-0735-4bad-8823-2d4b2d6d2f70 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:41.807385 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fe4a040f-0735-4bad-8823-2d4b2d6d2f70 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871" status: 200 len: 1222 microversion: 2.1 time: 0.096383 Aug 24 10:11:41.808328 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 97/207] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:41 2022] GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871 => generated 1222 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:41.815567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5040b2bd-fc22-4eee-b5bf-d5ba34f68768 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-630049139"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:41.818746 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:41.818746 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:41.819837 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.aggregate [None req-5040b2bd-fc22-4eee-b5bf-d5ba34f68768 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Generated uuid 1c4512e0-49f9-4009-a4b6-9492753cd3bf for aggregate {{(pid=122433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 10:11:41.851921 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5040b2bd-fc22-4eee-b5bf-d5ba34f68768 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.039362 Aug 24 10:11:41.854481 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 98/208] 10.222.0.85 () {60 vars in 1164 bytes} [Wed Aug 24 10:11:41 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:41.861742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8b039720-75bc-4502-bb13-1793944c61c4 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1728841247"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:41.867220 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:41.867220 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:41.878355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.aggregate [None req-8b039720-75bc-4502-bb13-1793944c61c4 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Generated uuid 00c1619d-fefa-44c6-8f4a-b574ede25876 for aggregate {{(pid=122433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 10:11:41.905640 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8b039720-75bc-4502-bb13-1793944c61c4 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.049772 Aug 24 10:11:41.906981 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 99/209] 10.222.0.85 () {60 vars in 1164 bytes} [Wed Aug 24 10:11:41 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:42.202045 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-894a5348-9d6b-429c-a8b3-0c3afdf410a8 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] 10.222.0.85 "GET /compute/v2.1/os-quota-sets/abbfb9a5bb7c43119c9977dff46042ad" status: 200 len: 371 microversion: 2.1 time: 0.448735 Aug 24 10:11:42.203205 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 111/210] 10.222.0.85 () {58 vars in 1242 bytes} [Wed Aug 24 10:11:41 2022] GET /compute/v2.1/os-quota-sets/abbfb9a5bb7c43119c9977dff46042ad => generated 371 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:42.208397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-178d3937-b51d-48ed-8802-12d2ca01db2d tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-849328-3"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:42.211221 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:42.211221 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:42.222247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-178d3937-b51d-48ed-8802-12d2ca01db2d tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:42.222786 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-178d3937-b51d-48ed-8802-12d2ca01db2d tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:42.223415 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-178d3937-b51d-48ed-8802-12d2ca01db2d tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:42.364707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b427db7d-af2a-4248-be7b-ad5c9265a21e tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-849328-3"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:42.368178 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:42.368178 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:42.370980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b427db7d-af2a-4248-be7b-ad5c9265a21e tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '246bd9608c6946d795aeeec49c43a7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d55a5d5f49b4d3d98f26b32352ec925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:42.377808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b427db7d-af2a-4248-be7b-ad5c9265a21e tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] Request method failure captured: Aug 24 10:11:42.377808 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Aug 24 10:11:42.377808 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:11:42.377808 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:11:42.377808 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:11:42.377808 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 39 Aug 24 10:11:42.377808 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:11:42.377808 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:11:42.377808 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:11:42.377808 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:42.377808 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfku57eEvu-oxWBdyAAEJMaIHiMjx8OfwyMOxvNAzILoUAzyDpIQ1TvUd9_JHsPalbAGo61kFUIn9cYjIuBThVAC1bBbxYCb_IfEYXam6qQbf5cTr3QDh8CRlW8pabC4cwupG6fpRxnFMk5HndFZbkU9bReErEFh1ADggs880_eAWp0 Aug 24 10:11:42.377808 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:11:42.377808 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:11:42.377808 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:11:42.377808 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:11:42.377808 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:11:42.377808 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:11:42.377808 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 5d55a5d5f49b4d3d98f26b32352ec925 Aug 24 10:11:42.377808 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-38839941 Aug 24 10:11:42.377808 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:11:42.377808 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:11:42.379070 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5d55a5d5f49b4d3d98f26b32352ec925"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_5d55a5d5f49b4d3d98f26b32352ec925", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5d55a5d5f49b4d3d98f26b32352ec925"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/5d55a5d5f49b4d3d98f26b32352ec925"}]}] Aug 24 10:11:42.379070 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-38839941 Aug 24 10:11:42.379070 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 5d55a5d5f49b4d3d98f26b32352ec925 Aug 24 10:11:42.379070 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-38839941 Aug 24 10:11:42.379070 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminNegativeTestJSON-38839941-project Aug 24 10:11:42.379070 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:11:42.379070 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:11:42.379070 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 246bd9608c6946d795aeeec49c43a7ee Aug 24 10:11:42.379070 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-38839941-project Aug 24 10:11:42.379070 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:11:42.379070 n-d-849328-3 devstack@n-api.service[122433]: {"add_host": {"host": "n-h2-849328-3"}} Aug 24 10:11:42.379070 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:11:42.379070 n-d-849328-3 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 24 10:11:42.379917 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '4', 'body': {'add_host': {'host': 'n-h2-849328-3'}}} Aug 24 10:11:42.379917 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:42.379917 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:42.379917 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:42.379917 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:42.379917 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:42.379917 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:42.379917 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:42.379917 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:42.379917 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:42.379917 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:42.379917 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 24 10:11:42.379917 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 24 10:11:42.379917 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:11:42.379917 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:11:42.379917 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:11:42.379917 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:11:42.379917 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:11:42.379917 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:11:42.380957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:11:42.380957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:11:42.380957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:11:42.380957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:11:42.380957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:11:42.380957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:11:42.380957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:11:42.380957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:11:42.380957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 24 10:11:42.380957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:42.380957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:42.380957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:42.380957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:42.380957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:42.380957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:42.380957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:11:42.380957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:11:42.380957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 24 10:11:42.380957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:42.385435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b427db7d-af2a-4248-be7b-ad5c9265a21e tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:42.387590 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b427db7d-af2a-4248-be7b-ad5c9265a21e tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] 10.222.0.85 "POST /compute/v2.1/os-aggregates/4/action" status: 403 len: 118 microversion: 2.1 time: 0.478518 Aug 24 10:11:42.389601 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 100/211] 10.222.0.85 () {60 vars in 1191 bytes} [Wed Aug 24 10:11:41 2022] POST /compute/v2.1/os-aggregates/4/action => generated 118 bytes in 482 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:11:42.397386 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de3074d5-06cb-4931-96b4-5331e25b5c28 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Action: 'update', calling method: .version_select at 0x7f4655988040>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:42.826659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de3074d5-06cb-4931-96b4-5331e25b5c28 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:42.827293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de3074d5-06cb-4931-96b4-5331e25b5c28 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:42.827601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de3074d5-06cb-4931-96b4-5331e25b5c28 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:42.839862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de3074d5-06cb-4931-96b4-5331e25b5c28 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:42.843326 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de3074d5-06cb-4931-96b4-5331e25b5c28 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:42.844046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de3074d5-06cb-4931-96b4-5331e25b5c28 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:42.967035 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-de3074d5-06cb-4931-96b4-5331e25b5c28 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-quota-sets/abbfb9a5bb7c43119c9977dff46042ad" status: 200 len: 328 microversion: 2.1 time: 0.576051 Aug 24 10:11:42.972557 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 101/212] 10.222.0.85 () {60 vars in 1262 bytes} [Wed Aug 24 10:11:42 2022] PUT /compute/v2.1/os-quota-sets/abbfb9a5bb7c43119c9977dff46042ad => generated 328 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:42.984492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b7b3f940-b2de-4b9a-85b4-7fa93c26bdee tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:42.989835 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:42.989835 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:43.036514 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b7b3f940-b2de-4b9a-85b4-7fa93c26bdee tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.059431 Aug 24 10:11:43.039452 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 102/213] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:11:42 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 10:11:43.047855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c99f445a-8ba9-4191-9c21-2b22b00c568e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:43.048747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c99f445a-8ba9-4191-9c21-2b22b00c568e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: 7e6f46da-f3b6-41ec-96f2-a3db16593a10] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:43.067960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c99f445a-8ba9-4191-9c21-2b22b00c568e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:43.072895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c99f445a-8ba9-4191-9c21-2b22b00c568e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:43.073891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c99f445a-8ba9-4191-9c21-2b22b00c568e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:43.074821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c99f445a-8ba9-4191-9c21-2b22b00c568e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:43.076155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c99f445a-8ba9-4191-9c21-2b22b00c568e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:43.076766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c99f445a-8ba9-4191-9c21-2b22b00c568e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:43.358581 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-178d3937-b51d-48ed-8802-12d2ca01db2d tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 242 microversion: 2.1 time: 1.154024 Aug 24 10:11:43.360293 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 112/214] 10.222.0.85 () {60 vars in 1191 bytes} [Wed Aug 24 10:11:42 2022] POST /compute/v2.1/os-aggregates/5/action => generated 242 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:43.488586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c99f445a-8ba9-4191-9c21-2b22b00c568e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:43.501784 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c99f445a-8ba9-4191-9c21-2b22b00c568e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10" status: 200 len: 1388 microversion: 2.1 time: 0.460987 Aug 24 10:11:43.505560 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 103/215] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:43 2022] GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10 => generated 1388 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:43.514592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-36e1f688-f927-4f4a-8c06-503c4baa663f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:43.516064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-36e1f688-f927-4f4a-8c06-503c4baa663f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 10f639ed-ba2f-4983-9c04-777480733871] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:43.524910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36e1f688-f927-4f4a-8c06-503c4baa663f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:43.526130 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36e1f688-f927-4f4a-8c06-503c4baa663f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:43.526800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36e1f688-f927-4f4a-8c06-503c4baa663f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:43.527960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36e1f688-f927-4f4a-8c06-503c4baa663f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:43.528687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36e1f688-f927-4f4a-8c06-503c4baa663f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:43.529525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36e1f688-f927-4f4a-8c06-503c4baa663f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:43.534895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:43.608773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-36e1f688-f927-4f4a-8c06-503c4baa663f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:43.619647 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-36e1f688-f927-4f4a-8c06-503c4baa663f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871" status: 200 len: 1280 microversion: 2.1 time: 0.111782 Aug 24 10:11:43.621441 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 104/216] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:43 2022] GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871 => generated 1280 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:43.627910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ffb693e1-9d56-4865-9aad-af01f86e5d9f tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-134158146"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:43.631818 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:43.631818 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:43.632967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.aggregate [None req-ffb693e1-9d56-4865-9aad-af01f86e5d9f tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Generated uuid 3f3dd837-01b3-485b-b6ca-78135a595f50 for aggregate {{(pid=122433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 10:11:43.665642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c823252a-a816-466e-bd9f-c02f08e997b8 tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] Action: 'update', calling method: .version_select at 0x7f465597f820>, body: {"quota_set": {"ram": "5120"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:43.678216 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ffb693e1-9d56-4865-9aad-af01f86e5d9f tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.054102 Aug 24 10:11:43.679039 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 105/217] 10.222.0.85 () {60 vars in 1164 bytes} [Wed Aug 24 10:11:43 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:43.693379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ae12108a-26b7-4d68-a3d9-b46f4856fa43 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1876688958", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:43.762217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c823252a-a816-466e-bd9f-c02f08e997b8 tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:43.763082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c823252a-a816-466e-bd9f-c02f08e997b8 tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:43.763781 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c823252a-a816-466e-bd9f-c02f08e997b8 tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:43.765110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c823252a-a816-466e-bd9f-c02f08e997b8 tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:43.779399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c823252a-a816-466e-bd9f-c02f08e997b8 tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:43.780115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c823252a-a816-466e-bd9f-c02f08e997b8 tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:43.785623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-ae12108a-26b7-4d68-a3d9-b46f4856fa43 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:11:43.845114 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c823252a-a816-466e-bd9f-c02f08e997b8 tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-quota-sets/4a3a6632a0ab46ed8234488248107cd2" status: 200 len: 240 microversion: 2.36 time: 0.475711 Aug 24 10:11:43.846315 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 113/218] 10.222.0.85 () {62 vars in 1303 bytes} [Wed Aug 24 10:11:43 2022] PUT /compute/v2.1/os-quota-sets/4a3a6632a0ab46ed8234488248107cd2 => generated 240 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:11:43.856323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-790d4b6c-afcc-4670-a22a-1968ff6353a4 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:43.858361 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:43.858361 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:43.878887 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-790d4b6c-afcc-4670-a22a-1968ff6353a4 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "GET /compute/v2.1/os-aggregates" status: 200 len: 458 microversion: 2.1 time: 0.030488 Aug 24 10:11:43.879351 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 114/219] 10.222.0.85 () {58 vars in 1143 bytes} [Wed Aug 24 10:11:43 2022] GET /compute/v2.1/os-aggregates => generated 458 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:43.884234 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f20aefe1-d201-478d-b667-5a9b1d85d65e tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-960444758"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:43.887263 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:43.887263 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:43.900754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f20aefe1-d201-478d-b667-5a9b1d85d65e tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:43.902169 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f20aefe1-d201-478d-b667-5a9b1d85d65e tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:43.903114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f20aefe1-d201-478d-b667-5a9b1d85d65e tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:43.914639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f20aefe1-d201-478d-b667-5a9b1d85d65e tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:43.915571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f20aefe1-d201-478d-b667-5a9b1d85d65e tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:43.916275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f20aefe1-d201-478d-b667-5a9b1d85d65e tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:43.926016 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-f20aefe1-d201-478d-b667-5a9b1d85d65e tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-960444758 could not be found. Aug 24 10:11:43.929243 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f20aefe1-d201-478d-b667-5a9b1d85d65e tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Request method failure captured: Aug 24 10:11:43.929243 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Aug 24 10:11:43.929243 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:11:43.929243 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:11:43.929243 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:11:43.929243 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 57 Aug 24 10:11:43.929243 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:11:43.929243 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:11:43.929243 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:11:43.929243 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:43.929243 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfkxOCrhmMp8ZyHWiuE8Rt5MgwQ2qpVfyA6gPnjpwUitOlkT8qaFf-aTwIaoU0EixOW2eKRvcYztHDpMMdyYhdwytoLU5R2blnpSzWoomJR7mk238i4Lkj8-Qge0nsnh1KlmFv8oNGr9wbmQZ0iuQYVaz5J-yaImuvOi8qgS0Ee6wJY Aug 24 10:11:43.929243 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:11:43.929243 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:11:43.929243 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:11:43.929243 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:11:43.929243 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:11:43.929243 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:11:43.929243 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 9b94a17f031a448686100da7234a3445 Aug 24 10:11:43.929243 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1791053395 Aug 24 10:11:43.929243 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,admin,member Aug 24 10:11:43.929243 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,admin,member Aug 24 10:11:43.930721 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9b94a17f031a448686100da7234a3445"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9b94a17f031a448686100da7234a3445", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9b94a17f031a448686100da7234a3445"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9b94a17f031a448686100da7234a3445"}]}] Aug 24 10:11:43.930721 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1791053395 Aug 24 10:11:43.930721 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 9b94a17f031a448686100da7234a3445 Aug 24 10:11:43.930721 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1791053395 Aug 24 10:11:43.930721 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin Aug 24 10:11:43.930721 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:11:43.930721 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:11:43.930721 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 766bd229f8f34a20b940c772dca95614 Aug 24 10:11:43.930721 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin Aug 24 10:11:43.930721 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:11:43.930721 n-d-849328-3 devstack@n-api.service[122432]: {"add_host": {"host": "tempest-nonexist_host-960444758"}} Aug 24 10:11:43.930721 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:11:43.931558 n-d-849328-3 devstack@n-api.service[122432]: exception: Compute host tempest-nonexist_host-960444758 could not be found. Aug 24 10:11:43.931558 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '6', 'body': {'add_host': {'host': 'tempest-nonexist_host-960444758'}}} Aug 24 10:11:43.931558 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:43.931558 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:43.931558 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5994, in _get_service_in_cell_by_host Aug 24 10:11:43.931558 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 24 10:11:43.931558 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:11:43.931558 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:11:43.931558 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 24 10:11:43.931558 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 24 10:11:43.931558 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 10:11:43.931558 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 10:11:43.931558 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 24 10:11:43.931558 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 24 10:11:43.931558 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-960444758' is not mapped to any cell Aug 24 10:11:43.931558 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:43.931558 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:43.931558 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:43.931558 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:43.931558 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6000, in _get_service_in_cell_by_host Aug 24 10:11:43.933083 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 24 10:11:43.933083 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 24 10:11:43.933083 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 24 10:11:43.933083 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 24 10:11:43.933083 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:43.933083 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:43.933083 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:43.933083 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:43.933083 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 24 10:11:43.933083 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 24 10:11:43.933083 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 10:11:43.933083 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 10:11:43.933083 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:11:43.933083 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:11:43.933083 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:11:43.933083 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:11:43.933083 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 10:11:43.933083 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 10:11:43.933083 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6616, in add_host_to_aggregate Aug 24 10:11:43.933083 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 24 10:11:43.934433 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6002, in _get_service_in_cell_by_host Aug 24 10:11:43.934433 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 24 10:11:43.934433 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-960444758 could not be found. Aug 24 10:11:43.934433 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:43.934433 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:43.934433 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:43.934433 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:43.934433 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:43.934433 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:43.934433 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:43.934433 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:43.934433 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:43.934433 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:43.934433 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:43.934433 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:43.934433 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 24 10:11:43.934433 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:11:43.934433 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-960444758 could not be found. Aug 24 10:11:43.934433 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:43.934433 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:43.934433 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:43.936207 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:43.936207 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:43.936207 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:43.936207 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:11:43.936207 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:11:43.936207 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-960444758 could not be found. Aug 24 10:11:43.936207 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:43.938133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f20aefe1-d201-478d-b667-5a9b1d85d65e tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-960444758 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:43.939380 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f20aefe1-d201-478d-b667-5a9b1d85d65e tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates/6/action" status: 404 len: 110 microversion: 2.1 time: 0.059035 Aug 24 10:11:43.940767 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 115/220] 10.222.0.85 () {60 vars in 1191 bytes} [Wed Aug 24 10:11:43 2022] POST /compute/v2.1/os-aggregates/6/action => generated 110 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:11:43.948550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b0c3e05f-e2cc-4314-8277-0f8c4b43a03c tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] Calling method '.version_select at 0x7f4655993160>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:44.024652 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0c3e05f-e2cc-4314-8277-0f8c4b43a03c tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:44.026384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0c3e05f-e2cc-4314-8277-0f8c4b43a03c tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:44.027119 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0c3e05f-e2cc-4314-8277-0f8c4b43a03c tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:44.027837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0c3e05f-e2cc-4314-8277-0f8c4b43a03c tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:44.028552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0c3e05f-e2cc-4314-8277-0f8c4b43a03c tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:44.028951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0c3e05f-e2cc-4314-8277-0f8c4b43a03c tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:44.051928 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b0c3e05f-e2cc-4314-8277-0f8c4b43a03c tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] 10.222.0.85 "GET /compute/v2.1/os-quota-sets/4a3a6632a0ab46ed8234488248107cd2/detail" status: 200 len: 672 microversion: 2.36 time: 0.109392 Aug 24 10:11:44.052751 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 116/221] 10.222.0.85 () {60 vars in 1304 bytes} [Wed Aug 24 10:11:43 2022] GET /compute/v2.1/os-quota-sets/4a3a6632a0ab46ed8234488248107cd2/detail => generated 672 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:11:44.072092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ae12108a-26b7-4d68-a3d9-b46f4856fa43 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:11:44.072650 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-97e04b1d-04b5-4b52-a35d-2458e170a73e tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-849328-3"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:44.072759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ae12108a-26b7-4d68-a3d9-b46f4856fa43 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:11:44.072998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ae12108a-26b7-4d68-a3d9-b46f4856fa43 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:11:44.073744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ae12108a-26b7-4d68-a3d9-b46f4856fa43 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:11:44.074146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ae12108a-26b7-4d68-a3d9-b46f4856fa43 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:11:44.084326 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:44.084326 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:44.087396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae12108a-26b7-4d68-a3d9-b46f4856fa43 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:44.087885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae12108a-26b7-4d68-a3d9-b46f4856fa43 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:44.088403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae12108a-26b7-4d68-a3d9-b46f4856fa43 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:44.089155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae12108a-26b7-4d68-a3d9-b46f4856fa43 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:44.089700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae12108a-26b7-4d68-a3d9-b46f4856fa43 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:44.090030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae12108a-26b7-4d68-a3d9-b46f4856fa43 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:44.105345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97e04b1d-04b5-4b52-a35d-2458e170a73e tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:44.105859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97e04b1d-04b5-4b52-a35d-2458e170a73e tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:44.106476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97e04b1d-04b5-4b52-a35d-2458e170a73e tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:44.111191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-ae12108a-26b7-4d68-a3d9-b46f4856fa43 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Getting quotas for project abbfb9a5bb7c43119c9977dff46042ad. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:11:44.117026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-ae12108a-26b7-4d68-a3d9-b46f4856fa43 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Getting quotas for user d53b9b8b2e5b4b45bac7281d737b506c and project abbfb9a5bb7c43119c9977dff46042ad. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:11:44.130187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.utils [None req-ae12108a-26b7-4d68-a3d9-b46f4856fa43 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] instances quota exceeded for abbfb9a5bb7c43119c9977dff46042ad, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122433) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 24 10:11:44.130813 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-ae12108a-26b7-4d68-a3d9-b46f4856fa43 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 24 10:11:44.132638 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ae12108a-26b7-4d68-a3d9-b46f4856fa43 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Request method failure captured: Aug 24 10:11:44.132638 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:11:44.132638 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:11:44.132638 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:11:44.132638 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:11:44.132638 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 145 Aug 24 10:11:44.132638 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:11:44.132638 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:11:44.132638 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:11:44.132638 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:44.132638 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBflXdaouklNpWQ1FqRKZ_UdeKIWLp3RMBalwfMF7QcQNWsCUKPjxgx3IrfTXpFC-qsPExr8W1pWfddj-UU0XyrFFbN8WIyloUMSB__oE3J-G0Ys-jgFJQDbfxHHXZB6Lpcky_fl5BUsxt6YeknIvl3JO0qGiYlhbahW5KVmeboONlcY Aug 24 10:11:44.132638 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:11:44.132638 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:11:44.132638 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:11:44.132638 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:11:44.132638 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:11:44.132638 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:11:44.132638 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: abbfb9a5bb7c43119c9977dff46042ad Aug 24 10:11:44.132638 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-QuotasAdminNegativeTest-113072488 Aug 24 10:11:44.132638 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:11:44.132638 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:11:44.133970 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/abbfb9a5bb7c43119c9977dff46042ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_abbfb9a5bb7c43119c9977dff46042ad", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/abbfb9a5bb7c43119c9977dff46042ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/abbfb9a5bb7c43119c9977dff46042ad"}]}] Aug 24 10:11:44.133970 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-QuotasAdminNegativeTest-113072488 Aug 24 10:11:44.133970 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: abbfb9a5bb7c43119c9977dff46042ad Aug 24 10:11:44.133970 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-113072488 Aug 24 10:11:44.133970 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-QuotasAdminNegativeTest-113072488-project Aug 24 10:11:44.133970 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:11:44.133970 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:11:44.133970 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: d53b9b8b2e5b4b45bac7281d737b506c Aug 24 10:11:44.133970 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-QuotasAdminNegativeTest-113072488-project Aug 24 10:11:44.133970 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:11:44.133970 n-d-849328-3 devstack@n-api.service[122433]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1876688958", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}} Aug 24 10:11:44.133970 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:11:44.134690 n-d-849328-3 devstack@n-api.service[122433]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 24 10:11:44.134690 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1876688958', 'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af', 'flavorRef': '452'}}} Aug 24 10:11:44.134690 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:44.134690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:44.134690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 24 10:11:44.134690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 24 10:11:44.134690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:11:44.134690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:11:44.134690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 24 10:11:44.134690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc Aug 24 10:11:44.134690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 24 10:11:44.134690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 24 10:11:44.134690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:11:44.134690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:11:44.134690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 24 10:11:44.134690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 24 10:11:44.134690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 24 10:11:44.134690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 24 10:11:44.135668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 24 10:11:44.135668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 24 10:11:44.135668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 24 10:11:44.135668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:44.135668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:44.135668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:44.135668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:44.135668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 24 10:11:44.135668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 24 10:11:44.135668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 24 10:11:44.135668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 24 10:11:44.135668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1720, in _create_instance Aug 24 10:11:44.135668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 24 10:11:44.135668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1349, in _provision_instances Aug 24 10:11:44.135668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 24 10:11:44.135668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 24 10:11:44.135668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 24 10:11:44.135668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 24 10:11:44.135668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:44.135668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:44.135668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:44.136832 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:44.136832 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:44.136832 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:44.136832 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:44.136832 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:44.136832 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:44.136832 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:44.136832 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:44.136832 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:44.136832 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:44.136832 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:44.136832 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:44.136832 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:44.136832 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 10:11:44.136832 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 24 10:11:44.136832 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 24 10:11:44.136832 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 24 10:11:44.136832 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:44.136832 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:44.136832 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:44.136832 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:44.140227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:44.140227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:44.140227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:11:44.140227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:11:44.140227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 24 10:11:44.140227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:44.155881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ae12108a-26b7-4d68-a3d9-b46f4856fa43 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:44.157849 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ae12108a-26b7-4d68-a3d9-b46f4856fa43 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.476465 Aug 24 10:11:44.159208 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 106/222] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:11:43 2022] POST /compute/v2.1/servers => generated 119 bytes in 479 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:11:44.168611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-794c897b-794e-4359-ac09-e6a31e848bae tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:44.170938 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:44.170938 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:44.229682 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-794c897b-794e-4359-ac09-e6a31e848bae tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.068997 Aug 24 10:11:44.233633 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 107/223] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:11:44 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 10:11:44.242677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6456ee1a-e030-43c8-8a85-07871f882f91 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Action: 'update', calling method: .version_select at 0x7f46559f2dc0>, body: {"quota_set": {"instances": 10}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:44.322903 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-97e04b1d-04b5-4b52-a35d-2458e170a73e tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.260450 Aug 24 10:11:44.323857 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 117/224] 10.222.0.85 () {60 vars in 1191 bytes} [Wed Aug 24 10:11:44 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:44.330395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ee8b84de-1139-4915-bee9-06e319c3acf6 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:44.346839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ee8b84de-1139-4915-bee9-06e319c3acf6 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Request method failure captured: Aug 24 10:11:44.346839 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 24 10:11:44.346839 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:11:44.346839 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:11:44.346839 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:11:44.346839 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 283 Aug 24 10:11:44.346839 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:11:44.346839 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:11:44.346839 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:11:44.346839 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:44.346839 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfkxOCrhmMp8ZyHWiuE8Rt5MgwQ2qpVfyA6gPnjpwUitOlkT8qaFf-aTwIaoU0EixOW2eKRvcYztHDpMMdyYhdwytoLU5R2blnpSzWoomJR7mk238i4Lkj8-Qge0nsnh1KlmFv8oNGr9wbmQZ0iuQYVaz5J-yaImuvOi8qgS0Ee6wJY Aug 24 10:11:44.346839 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:11:44.346839 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:11:44.346839 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:11:44.346839 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:11:44.346839 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:11:44.346839 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:11:44.346839 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 9b94a17f031a448686100da7234a3445 Aug 24 10:11:44.346839 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1791053395 Aug 24 10:11:44.346839 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,admin,member Aug 24 10:11:44.346839 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,admin,member Aug 24 10:11:44.348034 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9b94a17f031a448686100da7234a3445"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9b94a17f031a448686100da7234a3445", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9b94a17f031a448686100da7234a3445"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9b94a17f031a448686100da7234a3445"}]}] Aug 24 10:11:44.348034 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1791053395 Aug 24 10:11:44.348034 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 9b94a17f031a448686100da7234a3445 Aug 24 10:11:44.348034 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1791053395 Aug 24 10:11:44.348034 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin Aug 24 10:11:44.348034 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:11:44.348034 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:11:44.348034 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 766bd229f8f34a20b940c772dca95614 Aug 24 10:11:44.348034 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin Aug 24 10:11:44.348034 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:11:44.348586 n-d-849328-3 devstack@n-api.service[122432]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 24 10:11:44.348586 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:11:44.348586 n-d-849328-3 devstack@n-api.service[122432]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 10:11:44.348586 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 24 10:11:44.348586 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:44.348586 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:44.348586 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:11:44.348586 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:11:44.348586 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:11:44.348586 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:11:44.349207 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 10:11:44.349207 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:44.349207 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 24 10:11:44.349207 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 10:11:44.349207 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:44.349207 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 24 10:11:44.349207 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 24 10:11:44.349207 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:44.349207 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:44.349207 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:44.349207 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:44.349207 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:44.349207 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:44.349207 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:44.349207 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:44.349207 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:44.349207 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:44.350234 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:44.350234 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:44.350234 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:11:44.350234 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:11:44.350234 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:11:44.350234 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:11:44.350234 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:11:44.350234 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:11:44.350234 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 10:11:44.350234 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:44.350234 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:44.350234 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:44.350234 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:44.350234 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:44.350234 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:44.351056 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:11:44.351056 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:11:44.351056 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 10:11:44.351056 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:44.353162 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ee8b84de-1139-4915-bee9-06e319c3acf6 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:44.354475 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ee8b84de-1139-4915-bee9-06e319c3acf6 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.029341 Aug 24 10:11:44.360944 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 118/225] 10.222.0.85 () {60 vars in 1165 bytes} [Wed Aug 24 10:11:44 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:11:44.367114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-470f2481-84bb-4323-9098-bf6c0d5b7ec5 tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] Action: 'update', calling method: .version_select at 0x7f4656493700>, body: {"quota_set": {"ram": "2048"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:44.444260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6456ee1a-e030-43c8-8a85-07871f882f91 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:44.444788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6456ee1a-e030-43c8-8a85-07871f882f91 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:44.445283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6456ee1a-e030-43c8-8a85-07871f882f91 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:44.446063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6456ee1a-e030-43c8-8a85-07871f882f91 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:44.446525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6456ee1a-e030-43c8-8a85-07871f882f91 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:44.446935 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6456ee1a-e030-43c8-8a85-07871f882f91 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:44.472397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-470f2481-84bb-4323-9098-bf6c0d5b7ec5 tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:44.473451 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-470f2481-84bb-4323-9098-bf6c0d5b7ec5 tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:44.474132 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-470f2481-84bb-4323-9098-bf6c0d5b7ec5 tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:44.475125 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-470f2481-84bb-4323-9098-bf6c0d5b7ec5 tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:44.476004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-470f2481-84bb-4323-9098-bf6c0d5b7ec5 tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:44.476598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-470f2481-84bb-4323-9098-bf6c0d5b7ec5 tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:44.528740 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-470f2481-84bb-4323-9098-bf6c0d5b7ec5 tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:44.529572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-470f2481-84bb-4323-9098-bf6c0d5b7ec5 tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:44.530119 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-470f2481-84bb-4323-9098-bf6c0d5b7ec5 tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:44.530955 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-470f2481-84bb-4323-9098-bf6c0d5b7ec5 tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:44.531726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-470f2481-84bb-4323-9098-bf6c0d5b7ec5 tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:44.532353 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-470f2481-84bb-4323-9098-bf6c0d5b7ec5 tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:44.559859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=5,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:44.596548 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6456ee1a-e030-43c8-8a85-07871f882f91 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-quota-sets/abbfb9a5bb7c43119c9977dff46042ad" status: 200 len: 329 microversion: 2.1 time: 0.360449 Aug 24 10:11:44.598069 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 108/226] 10.222.0.85 () {60 vars in 1262 bytes} [Wed Aug 24 10:11:44 2022] PUT /compute/v2.1/os-quota-sets/abbfb9a5bb7c43119c9977dff46042ad => generated 329 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:44.603742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2ed9d57e-1d32-4155-bcfd-340714de5ce5 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:44.604968 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:44.604968 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:44.635003 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2ed9d57e-1d32-4155-bcfd-340714de5ce5 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.035578 Aug 24 10:11:44.636461 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 109/227] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:11:44 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 10:11:44.649235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dd9047b8-6394-4d0d-ba94-3e3711b14b29 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:44.666296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dd9047b8-6394-4d0d-ba94-3e3711b14b29 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Request method failure captured: Aug 24 10:11:44.666296 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 24 10:11:44.666296 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:11:44.666296 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:11:44.666296 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:11:44.666296 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 27 Aug 24 10:11:44.666296 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:11:44.666296 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:11:44.666296 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:11:44.666296 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:44.666296 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfkxOCrhmMp8ZyHWiuE8Rt5MgwQ2qpVfyA6gPnjpwUitOlkT8qaFf-aTwIaoU0EixOW2eKRvcYztHDpMMdyYhdwytoLU5R2blnpSzWoomJR7mk238i4Lkj8-Qge0nsnh1KlmFv8oNGr9wbmQZ0iuQYVaz5J-yaImuvOi8qgS0Ee6wJY Aug 24 10:11:44.666296 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:11:44.666296 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:11:44.666296 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:11:44.666296 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:11:44.666296 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:11:44.666296 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:11:44.666296 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 9b94a17f031a448686100da7234a3445 Aug 24 10:11:44.666296 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1791053395 Aug 24 10:11:44.666296 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:11:44.666296 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:11:44.667874 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9b94a17f031a448686100da7234a3445"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9b94a17f031a448686100da7234a3445", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9b94a17f031a448686100da7234a3445"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9b94a17f031a448686100da7234a3445"}]}] Aug 24 10:11:44.667874 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1791053395 Aug 24 10:11:44.667874 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 9b94a17f031a448686100da7234a3445 Aug 24 10:11:44.667874 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1791053395 Aug 24 10:11:44.667874 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin Aug 24 10:11:44.667874 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:11:44.667874 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:11:44.667874 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 766bd229f8f34a20b940c772dca95614 Aug 24 10:11:44.667874 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin Aug 24 10:11:44.667874 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:11:44.667874 n-d-849328-3 devstack@n-api.service[122433]: {"aggregate": {"name": ""}} Aug 24 10:11:44.667874 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:11:44.667874 n-d-849328-3 devstack@n-api.service[122433]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 24 10:11:44.668789 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 24 10:11:44.668789 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:44.668789 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:44.668789 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:11:44.668789 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:11:44.668789 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:11:44.668789 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:11:44.668789 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 24 10:11:44.668789 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:44.668789 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 24 10:11:44.668789 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 10:11:44.668789 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:44.668789 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 24 10:11:44.668789 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi '' Aug 24 10:11:44.668789 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:44.668789 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:44.668789 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:44.668789 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:44.668789 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:44.668789 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:44.668789 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:44.668789 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:44.668789 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:44.670348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:44.670348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:44.670348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:44.670348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:11:44.670348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:11:44.670348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:11:44.670348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:11:44.670348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:11:44.670348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:11:44.670348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 24 10:11:44.670348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:44.670348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:44.670348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:44.670348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:44.670348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:44.670348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:44.670348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:11:44.670348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:11:44.670348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 24 10:11:44.670348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:44.671674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dd9047b8-6394-4d0d-ba94-3e3711b14b29 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:44.671674 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dd9047b8-6394-4d0d-ba94-3e3711b14b29 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.030999 Aug 24 10:11:44.671674 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 110/228] 10.222.0.85 () {60 vars in 1164 bytes} [Wed Aug 24 10:11:44 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:11:44.674227 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-351b91af-5feb-4d0b-b64b-6f0f86759065 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:44.674846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-351b91af-5feb-4d0b-b64b-6f0f86759065 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: 7e6f46da-f3b6-41ec-96f2-a3db16593a10] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:44.684489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-351b91af-5feb-4d0b-b64b-6f0f86759065 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:44.684994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-351b91af-5feb-4d0b-b64b-6f0f86759065 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:44.685462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-351b91af-5feb-4d0b-b64b-6f0f86759065 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:44.686163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-351b91af-5feb-4d0b-b64b-6f0f86759065 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:44.686664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-351b91af-5feb-4d0b-b64b-6f0f86759065 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:44.687086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-351b91af-5feb-4d0b-b64b-6f0f86759065 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:44.689375 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-470f2481-84bb-4323-9098-bf6c0d5b7ec5 tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-quota-sets/4a3a6632a0ab46ed8234488248107cd2?user_id=24bf3c080c7247a487278c857d07ece9" status: 200 len: 240 microversion: 2.36 time: 0.326468 Aug 24 10:11:44.697342 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 119/229] 10.222.0.85 () {62 vars in 1384 bytes} [Wed Aug 24 10:11:44 2022] PUT /compute/v2.1/os-quota-sets/4a3a6632a0ab46ed8234488248107cd2?user_id=24bf3c080c7247a487278c857d07ece9 => generated 240 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:11:44.713537 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-55bcbd21-6fbf-435d-a665-76a727cafab5 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Calling method '.version_select at 0x7f46577e83a0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:44.824017 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-55bcbd21-6fbf-435d-a665-76a727cafab5 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] 10.222.0.85 "GET /compute/v2.1/os-quota-sets/abbfb9a5bb7c43119c9977dff46042ad" status: 200 len: 371 microversion: 2.1 time: 0.125230 Aug 24 10:11:44.831147 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 120/230] 10.222.0.85 () {58 vars in 1242 bytes} [Wed Aug 24 10:11:44 2022] GET /compute/v2.1/os-quota-sets/abbfb9a5bb7c43119c9977dff46042ad => generated 371 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:44.837533 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d6e8e0a0-8472-4941-a995-ee9d0b8c63c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:44.838278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d6e8e0a0-8472-4941-a995-ee9d0b8c63c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 10f639ed-ba2f-4983-9c04-777480733871] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:44.857216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6e8e0a0-8472-4941-a995-ee9d0b8c63c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:44.857566 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6e8e0a0-8472-4941-a995-ee9d0b8c63c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:44.861956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6e8e0a0-8472-4941-a995-ee9d0b8c63c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:44.863043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6e8e0a0-8472-4941-a995-ee9d0b8c63c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:44.863834 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6e8e0a0-8472-4941-a995-ee9d0b8c63c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:44.864432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6e8e0a0-8472-4941-a995-ee9d0b8c63c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:44.961051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-351b91af-5feb-4d0b-b64b-6f0f86759065 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:44.971685 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-351b91af-5feb-4d0b-b64b-6f0f86759065 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10" status: 200 len: 1586 microversion: 2.1 time: 0.301140 Aug 24 10:11:44.974959 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 111/231] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:44 2022] GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10 => generated 1586 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:44.979740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-270bc9f2-331c-4b3e-a1b1-8785d2365315 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-922807185"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:44.992205 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:44.992205 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:44.993274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.aggregate [None req-270bc9f2-331c-4b3e-a1b1-8785d2365315 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Generated uuid 8873a0d2-6678-45b2-b4b2-9004100a2f8b for aggregate {{(pid=122433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 10:11:45.018782 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-270bc9f2-331c-4b3e-a1b1-8785d2365315 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.042119 Aug 24 10:11:45.019936 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 112/232] 10.222.0.85 () {60 vars in 1164 bytes} [Wed Aug 24 10:11:44 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:45.024987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5a1eae6c-b59e-4f8f-bc14-ca26dc5e5a73 tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-758454918"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:45.028516 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:45.028516 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:45.030795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5a1eae6c-b59e-4f8f-bc14-ca26dc5e5a73 tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '246bd9608c6946d795aeeec49c43a7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d55a5d5f49b4d3d98f26b32352ec925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:45.033298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5a1eae6c-b59e-4f8f-bc14-ca26dc5e5a73 tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] Request method failure captured: Aug 24 10:11:45.033298 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 24 10:11:45.033298 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:11:45.033298 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:11:45.033298 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:11:45.033298 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 59 Aug 24 10:11:45.033298 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:11:45.033298 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:11:45.033298 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:11:45.033298 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:45.033298 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfku57eEvu-oxWBdyAAEJMaIHiMjx8OfwyMOxvNAzILoUAzyDpIQ1TvUd9_JHsPalbAGo61kFUIn9cYjIuBThVAC1bBbxYCb_IfEYXam6qQbf5cTr3QDh8CRlW8pabC4cwupG6fpRxnFMk5HndFZbkU9bReErEFh1ADggs880_eAWp0 Aug 24 10:11:45.033298 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:11:45.033298 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:11:45.033298 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:11:45.033298 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:11:45.033298 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:11:45.033298 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:11:45.033298 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 5d55a5d5f49b4d3d98f26b32352ec925 Aug 24 10:11:45.033298 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-38839941 Aug 24 10:11:45.033298 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:11:45.033298 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:11:45.034956 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5d55a5d5f49b4d3d98f26b32352ec925"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_5d55a5d5f49b4d3d98f26b32352ec925", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5d55a5d5f49b4d3d98f26b32352ec925"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/5d55a5d5f49b4d3d98f26b32352ec925"}]}] Aug 24 10:11:45.034956 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-38839941 Aug 24 10:11:45.034956 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 5d55a5d5f49b4d3d98f26b32352ec925 Aug 24 10:11:45.034956 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-38839941 Aug 24 10:11:45.034956 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminNegativeTestJSON-38839941-project Aug 24 10:11:45.034956 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:11:45.034956 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:11:45.034956 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 246bd9608c6946d795aeeec49c43a7ee Aug 24 10:11:45.034956 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-38839941-project Aug 24 10:11:45.034956 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:11:45.034956 n-d-849328-3 devstack@n-api.service[122433]: {"aggregate": {"name": "tempest-test_aggregate-758454918"}} Aug 24 10:11:45.034956 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:11:45.034956 n-d-849328-3 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 24 10:11:45.036011 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-758454918'}}} Aug 24 10:11:45.036011 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:45.036011 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:45.036011 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:45.036011 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:45.036011 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:45.036011 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:45.036011 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:45.036011 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:45.036011 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:45.036011 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:45.036011 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:45.036011 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:45.036011 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 24 10:11:45.036011 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 24 10:11:45.036011 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:11:45.036011 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:11:45.036011 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:11:45.036011 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:11:45.037630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:11:45.037630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:11:45.037630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:11:45.037630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:11:45.037630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:11:45.037630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:11:45.037630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:11:45.037630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:11:45.037630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:11:45.037630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:11:45.037630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 24 10:11:45.037630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:45.037630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:45.037630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:45.037630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:45.037630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:45.037630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:45.037630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:11:45.037630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:11:45.037630 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 24 10:11:45.039254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:45.040447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5a1eae6c-b59e-4f8f-bc14-ca26dc5e5a73 tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:45.041843 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5a1eae6c-b59e-4f8f-bc14-ca26dc5e5a73 tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] 10.222.0.85 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.020370 Aug 24 10:11:45.042654 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 113/233] 10.222.0.85 () {60 vars in 1164 bytes} [Wed Aug 24 10:11:45 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:11:45.067025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3d8a21a8-7c7e-40fa-ad62-5a83411a1f82 tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] Calling method '.version_select at 0x7f4655b165e0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:45.187991 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3d8a21a8-7c7e-40fa-ad62-5a83411a1f82 tempest-QuotasAdminTestV236-968479071 tempest-QuotasAdminTestV236-968479071-project-admin] 10.222.0.85 "GET /compute/v2.1/os-quota-sets/4a3a6632a0ab46ed8234488248107cd2?user_id=24bf3c080c7247a487278c857d07ece9" status: 200 len: 282 microversion: 2.36 time: 0.138068 Aug 24 10:11:45.189925 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 114/234] 10.222.0.85 () {60 vars in 1364 bytes} [Wed Aug 24 10:11:45 2022] GET /compute/v2.1/os-quota-sets/4a3a6632a0ab46ed8234488248107cd2?user_id=24bf3c080c7247a487278c857d07ece9 => generated 282 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:11:45.196436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-57f1c4d4-ec8a-4cd9-a2bd-e95f4761447c tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Action: 'update', calling method: .version_select at 0x7f46559f2040>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:45.309520 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d6e8e0a0-8472-4941-a995-ee9d0b8c63c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:45.319468 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d6e8e0a0-8472-4941-a995-ee9d0b8c63c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871" status: 200 len: 1322 microversion: 2.1 time: 0.485955 Aug 24 10:11:45.320547 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 121/235] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:44 2022] GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871 => generated 1322 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:45.326214 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ff0411e5-61a9-4b6b-a5a8-f2b089ec6cc4 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:45.327488 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ff0411e5-61a9-4b6b-a5a8-f2b089ec6cc4 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: 7e6f46da-f3b6-41ec-96f2-a3db16593a10] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:45.336912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57f1c4d4-ec8a-4cd9-a2bd-e95f4761447c tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:45.337590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57f1c4d4-ec8a-4cd9-a2bd-e95f4761447c tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:45.340067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff0411e5-61a9-4b6b-a5a8-f2b089ec6cc4 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:45.341068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff0411e5-61a9-4b6b-a5a8-f2b089ec6cc4 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:45.341937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57f1c4d4-ec8a-4cd9-a2bd-e95f4761447c tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:45.342385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff0411e5-61a9-4b6b-a5a8-f2b089ec6cc4 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:45.342819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57f1c4d4-ec8a-4cd9-a2bd-e95f4761447c tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:45.343307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57f1c4d4-ec8a-4cd9-a2bd-e95f4761447c tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:45.343742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57f1c4d4-ec8a-4cd9-a2bd-e95f4761447c tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:45.343997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff0411e5-61a9-4b6b-a5a8-f2b089ec6cc4 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:45.344653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff0411e5-61a9-4b6b-a5a8-f2b089ec6cc4 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:45.345410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff0411e5-61a9-4b6b-a5a8-f2b089ec6cc4 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:45.500595 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-57f1c4d4-ec8a-4cd9-a2bd-e95f4761447c tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-quota-sets/abbfb9a5bb7c43119c9977dff46042ad" status: 200 len: 325 microversion: 2.1 time: 0.309152 Aug 24 10:11:45.501724 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 115/236] 10.222.0.85 () {60 vars in 1262 bytes} [Wed Aug 24 10:11:45 2022] PUT /compute/v2.1/os-quota-sets/abbfb9a5bb7c43119c9977dff46042ad => generated 325 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:45.518789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c1c61b45-9ed1-4486-8a89-3874e42a3f0b tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-849328-3"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:45.534218 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:45.534218 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:45.558591 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1c61b45-9ed1-4486-8a89-3874e42a3f0b tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:45.561154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1c61b45-9ed1-4486-8a89-3874e42a3f0b tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:45.568304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1c61b45-9ed1-4486-8a89-3874e42a3f0b tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:45.662756 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ff0411e5-61a9-4b6b-a5a8-f2b089ec6cc4 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.340734 Aug 24 10:11:45.664568 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 122/237] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Aug 24 10:11:45 2022] GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10/os-interface => generated 284 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:45.679918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-057f0694-9d06-47b4-9fe1-edf7797dfa93 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1354425546"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:45.687142 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:45.687142 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:45.695507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.aggregate [None req-057f0694-9d06-47b4-9fe1-edf7797dfa93 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Generated uuid e67241ad-a9c4-4b82-8b66-1a02edf56689 for aggregate {{(pid=122432) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 10:11:45.772577 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-057f0694-9d06-47b4-9fe1-edf7797dfa93 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.096700 Aug 24 10:11:45.781449 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 123/238] 10.222.0.85 () {60 vars in 1164 bytes} [Wed Aug 24 10:11:45 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:45.787685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c861a206-7a5e-438c-99b0-d5c0864a1a99 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1249724683", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:45.888393 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c1c61b45-9ed1-4486-8a89-3874e42a3f0b tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 241 microversion: 2.1 time: 0.384795 Aug 24 10:11:45.890014 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 116/239] 10.222.0.85 () {60 vars in 1191 bytes} [Wed Aug 24 10:11:45 2022] POST /compute/v2.1/os-aggregates/7/action => generated 241 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:45.899953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3a287b01-5fe2-4eae-9eba-0b160e2a7bdd tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1354425546"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:45.900614 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-c861a206-7a5e-438c-99b0-d5c0864a1a99 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:11:45.906143 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:45.906143 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:45.907476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.aggregate [None req-3a287b01-5fe2-4eae-9eba-0b160e2a7bdd tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Generated uuid 3f29c58d-71aa-4f6e-8f1e-f3b91e9632c4 for aggregate {{(pid=122433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 10:11:45.943785 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-3a287b01-5fe2-4eae-9eba-0b160e2a7bdd tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1354425546 already exists. Aug 24 10:11:45.959715 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3a287b01-5fe2-4eae-9eba-0b160e2a7bdd tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Request method failure captured: Aug 24 10:11:45.959715 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 24 10:11:45.959715 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:11:45.959715 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:11:45.959715 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:11:45.959715 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 60 Aug 24 10:11:45.959715 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:11:45.959715 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:11:45.959715 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:11:45.959715 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:45.959715 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfkxOCrhmMp8ZyHWiuE8Rt5MgwQ2qpVfyA6gPnjpwUitOlkT8qaFf-aTwIaoU0EixOW2eKRvcYztHDpMMdyYhdwytoLU5R2blnpSzWoomJR7mk238i4Lkj8-Qge0nsnh1KlmFv8oNGr9wbmQZ0iuQYVaz5J-yaImuvOi8qgS0Ee6wJY Aug 24 10:11:45.959715 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:11:45.959715 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:11:45.959715 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:11:45.959715 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:11:45.959715 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:11:45.959715 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:11:45.959715 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 9b94a17f031a448686100da7234a3445 Aug 24 10:11:45.959715 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1791053395 Aug 24 10:11:45.959715 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:11:45.959715 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:11:45.961424 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9b94a17f031a448686100da7234a3445"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9b94a17f031a448686100da7234a3445", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9b94a17f031a448686100da7234a3445"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9b94a17f031a448686100da7234a3445"}]}] Aug 24 10:11:45.961424 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1791053395 Aug 24 10:11:45.961424 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 9b94a17f031a448686100da7234a3445 Aug 24 10:11:45.961424 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1791053395 Aug 24 10:11:45.961424 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin Aug 24 10:11:45.961424 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:11:45.961424 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:11:45.961424 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 766bd229f8f34a20b940c772dca95614 Aug 24 10:11:45.961424 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin Aug 24 10:11:45.961424 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:11:45.961424 n-d-849328-3 devstack@n-api.service[122433]: {"aggregate": {"name": "tempest-test_aggregate-1354425546"}} Aug 24 10:11:45.961424 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:11:45.961424 n-d-849328-3 devstack@n-api.service[122433]: exception: Aggregate tempest-test_aggregate-1354425546 already exists. Aug 24 10:11:45.962239 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1354425546'}}} Aug 24 10:11:45.962239 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:45.962239 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:45.962239 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 24 10:11:45.962239 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 24 10:11:45.962239 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 10:11:45.962239 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 10:11:45.962239 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:11:45.962239 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:11:45.962239 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:11:45.962239 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:11:45.962239 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 10:11:45.962239 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 10:11:45.962239 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6453, in create_aggregate Aug 24 10:11:45.962239 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 24 10:11:45.962239 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 24 10:11:45.962239 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 24 10:11:45.962239 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 24 10:11:45.962239 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 24 10:11:45.963474 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 10:11:45.963474 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 10:11:45.963474 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 24 10:11:45.963474 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 24 10:11:45.963474 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1354425546 already exists. Aug 24 10:11:45.963474 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:45.963474 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:45.963474 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:45.963474 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:45.963474 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:45.963474 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:45.963474 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:45.963474 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:45.963474 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:45.963474 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:45.963474 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:45.963474 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:45.963474 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:45.963474 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:45.963474 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 24 10:11:45.964698 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 24 10:11:45.964698 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1354425546 already exists. Aug 24 10:11:45.964698 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:45.964698 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:45.964698 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:45.964698 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:45.964698 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:45.964698 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:45.964698 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:11:45.964698 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:11:45.964698 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1354425546 already exists. Aug 24 10:11:45.964698 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:45.967218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3a287b01-5fe2-4eae-9eba-0b160e2a7bdd tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1354425546 already exists. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:45.970315 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3a287b01-5fe2-4eae-9eba-0b160e2a7bdd tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.076543 Aug 24 10:11:45.975548 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 117/240] 10.222.0.85 () {60 vars in 1164 bytes} [Wed Aug 24 10:11:45 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 84 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:11:45.984508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d46398cb-834c-41a0-8c68-cdfe4fab13fd tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-849328-3"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:45.989581 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:45.989581 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:46.004392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d46398cb-834c-41a0-8c68-cdfe4fab13fd tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:46.005263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d46398cb-834c-41a0-8c68-cdfe4fab13fd tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:46.006072 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d46398cb-834c-41a0-8c68-cdfe4fab13fd tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:46.228365 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d46398cb-834c-41a0-8c68-cdfe4fab13fd tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 226 microversion: 2.1 time: 0.251288 Aug 24 10:11:46.232038 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 118/241] 10.222.0.85 () {60 vars in 1191 bytes} [Wed Aug 24 10:11:45 2022] POST /compute/v2.1/os-aggregates/7/action => generated 226 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:46.244491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ad5ace1-71bd-4504-bbee-03e473c4eb37 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:46.249161 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:46.249161 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:46.313837 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ad5ace1-71bd-4504-bbee-03e473c4eb37 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.079720 Aug 24 10:11:46.314923 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 119/242] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:11:46 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 10:11:46.323157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-faa8eaf0-3549-4ff0-b7da-e9a301d96405 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:46.328496 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:46.328496 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:46.389761 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-faa8eaf0-3549-4ff0-b7da-e9a301d96405 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.073310 Aug 24 10:11:46.392273 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 120/243] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:11:46 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 10:11:46.421834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b486484e-75db-4f19-85e0-24a880213005 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-9613302"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:46.424692 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:46.424692 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:46.433413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.aggregate [None req-b486484e-75db-4f19-85e0-24a880213005 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Generated uuid b1d968cf-9bc9-460a-b4b5-50e23968f555 for aggregate {{(pid=122433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 10:11:46.480637 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b486484e-75db-4f19-85e0-24a880213005 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates" status: 200 len: 195 microversion: 2.1 time: 0.084126 Aug 24 10:11:46.482989 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 121/244] 10.222.0.85 () {60 vars in 1164 bytes} [Wed Aug 24 10:11:46 2022] POST /compute/v2.1/os-aggregates => generated 195 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:46.496354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eb9c2077-8c74-4f41-91b4-f4fec186fae5 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:46.497338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-eb9c2077-8c74-4f41-91b4-f4fec186fae5 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 10f639ed-ba2f-4983-9c04-777480733871] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:46.521663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb9c2077-8c74-4f41-91b4-f4fec186fae5 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:46.522694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb9c2077-8c74-4f41-91b4-f4fec186fae5 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:46.523346 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb9c2077-8c74-4f41-91b4-f4fec186fae5 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:46.529883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb9c2077-8c74-4f41-91b4-f4fec186fae5 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:46.534548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb9c2077-8c74-4f41-91b4-f4fec186fae5 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:46.535767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb9c2077-8c74-4f41-91b4-f4fec186fae5 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:46.642595 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c861a206-7a5e-438c-99b0-d5c0864a1a99 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:11:46.643055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c861a206-7a5e-438c-99b0-d5c0864a1a99 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:11:46.643570 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c861a206-7a5e-438c-99b0-d5c0864a1a99 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:11:46.644016 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c861a206-7a5e-438c-99b0-d5c0864a1a99 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:11:46.644510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c861a206-7a5e-438c-99b0-d5c0864a1a99 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:11:46.694124 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c861a206-7a5e-438c-99b0-d5c0864a1a99 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:46.694773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c861a206-7a5e-438c-99b0-d5c0864a1a99 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:46.695052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c861a206-7a5e-438c-99b0-d5c0864a1a99 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:46.696419 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c861a206-7a5e-438c-99b0-d5c0864a1a99 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:46.696751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c861a206-7a5e-438c-99b0-d5c0864a1a99 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:46.698218 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c861a206-7a5e-438c-99b0-d5c0864a1a99 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:46.762808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-c861a206-7a5e-438c-99b0-d5c0864a1a99 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Getting quotas for project abbfb9a5bb7c43119c9977dff46042ad. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:11:46.786893 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-c861a206-7a5e-438c-99b0-d5c0864a1a99 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Getting quotas for user d53b9b8b2e5b4b45bac7281d737b506c and project abbfb9a5bb7c43119c9977dff46042ad. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:11:46.793393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:46.828269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.utils [None req-c861a206-7a5e-438c-99b0-d5c0864a1a99 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] ram quota exceeded for abbfb9a5bb7c43119c9977dff46042ad, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122432) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 24 10:11:46.830694 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-c861a206-7a5e-438c-99b0-d5c0864a1a99 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 24 10:11:46.838339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c861a206-7a5e-438c-99b0-d5c0864a1a99 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Request method failure captured: Aug 24 10:11:46.838339 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:11:46.838339 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:11:46.838339 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:11:46.838339 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:11:46.838339 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 145 Aug 24 10:11:46.838339 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:11:46.838339 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:11:46.838339 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:11:46.838339 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:46.838339 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBflXdaouklNpWQ1FqRKZ_UdeKIWLp3RMBalwfMF7QcQNWsCUKPjxgx3IrfTXpFC-qsPExr8W1pWfddj-UU0XyrFFbN8WIyloUMSB__oE3J-G0Ys-jgFJQDbfxHHXZB6Lpcky_fl5BUsxt6YeknIvl3JO0qGiYlhbahW5KVmeboONlcY Aug 24 10:11:46.838339 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:11:46.838339 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:11:46.838339 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:11:46.838339 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:11:46.838339 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:11:46.838339 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:11:46.838339 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: abbfb9a5bb7c43119c9977dff46042ad Aug 24 10:11:46.838339 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-QuotasAdminNegativeTest-113072488 Aug 24 10:11:46.838339 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:11:46.838339 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:11:46.839865 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/abbfb9a5bb7c43119c9977dff46042ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_abbfb9a5bb7c43119c9977dff46042ad", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/abbfb9a5bb7c43119c9977dff46042ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/abbfb9a5bb7c43119c9977dff46042ad"}]}] Aug 24 10:11:46.839865 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-QuotasAdminNegativeTest-113072488 Aug 24 10:11:46.839865 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: abbfb9a5bb7c43119c9977dff46042ad Aug 24 10:11:46.839865 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-113072488 Aug 24 10:11:46.839865 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-QuotasAdminNegativeTest-113072488-project Aug 24 10:11:46.839865 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:11:46.839865 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:11:46.839865 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: d53b9b8b2e5b4b45bac7281d737b506c Aug 24 10:11:46.839865 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-QuotasAdminNegativeTest-113072488-project Aug 24 10:11:46.839865 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:11:46.839865 n-d-849328-3 devstack@n-api.service[122432]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1249724683", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}} Aug 24 10:11:46.839865 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:11:46.840682 n-d-849328-3 devstack@n-api.service[122432]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 24 10:11:46.840682 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1249724683', 'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af', 'flavorRef': '452'}}} Aug 24 10:11:46.840682 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:46.840682 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:46.840682 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 24 10:11:46.840682 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 24 10:11:46.840682 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:11:46.840682 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:11:46.840682 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 24 10:11:46.840682 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc Aug 24 10:11:46.840682 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 24 10:11:46.840682 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 24 10:11:46.840682 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:11:46.840682 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:11:46.840682 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 24 10:11:46.840682 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 24 10:11:46.840682 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 24 10:11:46.840682 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 24 10:11:46.841914 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 24 10:11:46.841914 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 24 10:11:46.841914 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 24 10:11:46.841914 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:46.841914 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:46.841914 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:46.841914 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:46.841914 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 24 10:11:46.841914 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 24 10:11:46.841914 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 24 10:11:46.841914 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 24 10:11:46.841914 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1720, in _create_instance Aug 24 10:11:46.841914 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 24 10:11:46.841914 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1349, in _provision_instances Aug 24 10:11:46.841914 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 24 10:11:46.841914 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 24 10:11:46.841914 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 24 10:11:46.841914 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 24 10:11:46.841914 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:46.841914 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:46.841914 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:46.843355 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:46.843355 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:46.843355 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:46.843355 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:46.843355 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:46.843355 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:46.843355 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:46.843355 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:46.843355 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:46.843355 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:46.843355 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:46.843355 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:46.843355 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:46.843355 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 10:11:46.843355 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 24 10:11:46.843355 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 24 10:11:46.843355 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 24 10:11:46.843355 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:46.843355 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:46.843355 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:46.843355 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:46.844811 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:46.844811 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:46.844811 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:11:46.844811 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:11:46.844811 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 24 10:11:46.844811 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:46.851029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c861a206-7a5e-438c-99b0-d5c0864a1a99 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:46.852561 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c861a206-7a5e-438c-99b0-d5c0864a1a99 tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.069654 Aug 24 10:11:46.858916 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 124/245] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:11:45 2022] POST /compute/v2.1/servers => generated 110 bytes in 1076 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:11:46.864263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d08f4122-6196-4910-a304-3449cac3e01f tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2137891238"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:46.871093 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:46.871093 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:46.874274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.aggregate [None req-d08f4122-6196-4910-a304-3449cac3e01f tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Generated uuid bb038f22-0d92-4325-81d7-8a9b96b874f2 for aggregate {{(pid=122432) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 10:11:46.935895 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d08f4122-6196-4910-a304-3449cac3e01f tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.075246 Aug 24 10:11:46.942095 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 125/246] 10.222.0.85 () {60 vars in 1164 bytes} [Wed Aug 24 10:11:46 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:46.957098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fbc66ce9-e818-47a4-bdb7-91189cf4e01c tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-996511862"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:46.959871 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:46.959871 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:46.960816 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.aggregate [None req-fbc66ce9-e818-47a4-bdb7-91189cf4e01c tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] Generated uuid efaa6caf-b3bc-4d5c-8e71-0b0872a8cdcd for aggregate {{(pid=122432) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 10:11:47.025796 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fbc66ce9-e818-47a4-bdb7-91189cf4e01c tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.080876 Aug 24 10:11:47.028710 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 126/247] 10.222.0.85 () {62 vars in 1205 bytes} [Wed Aug 24 10:11:46 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:11:47.041875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-85b03188-8a16-4cf4-804d-b7289f1edc6e tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:47.043378 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:47.043378 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:47.046372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-85b03188-8a16-4cf4-804d-b7289f1edc6e tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '246bd9608c6946d795aeeec49c43a7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d55a5d5f49b4d3d98f26b32352ec925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:47.048918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-85b03188-8a16-4cf4-804d-b7289f1edc6e tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] Request method failure captured: Aug 24 10:11:47.048918 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/os-aggregates/9 HTTP/1.1 Aug 24 10:11:47.048918 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:11:47.048918 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:11:47.048918 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:11:47.048918 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:11:47.048918 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:11:47.048918 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:11:47.048918 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:11:47.048918 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:47.048918 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfku57eEvu-oxWBdyAAEJMaIHiMjx8OfwyMOxvNAzILoUAzyDpIQ1TvUd9_JHsPalbAGo61kFUIn9cYjIuBThVAC1bBbxYCb_IfEYXam6qQbf5cTr3QDh8CRlW8pabC4cwupG6fpRxnFMk5HndFZbkU9bReErEFh1ADggs880_eAWp0 Aug 24 10:11:47.048918 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:11:47.048918 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:11:47.048918 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:11:47.048918 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:11:47.048918 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:11:47.048918 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:11:47.048918 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 5d55a5d5f49b4d3d98f26b32352ec925 Aug 24 10:11:47.048918 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-38839941 Aug 24 10:11:47.048918 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:11:47.048918 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:11:47.050446 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5d55a5d5f49b4d3d98f26b32352ec925"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_5d55a5d5f49b4d3d98f26b32352ec925", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5d55a5d5f49b4d3d98f26b32352ec925"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/5d55a5d5f49b4d3d98f26b32352ec925"}]}] Aug 24 10:11:47.050446 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-38839941 Aug 24 10:11:47.050446 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 5d55a5d5f49b4d3d98f26b32352ec925 Aug 24 10:11:47.050446 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-38839941 Aug 24 10:11:47.050446 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-AggregatesAdminNegativeTestJSON-38839941-project Aug 24 10:11:47.050446 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:11:47.050446 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:11:47.050446 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 246bd9608c6946d795aeeec49c43a7ee Aug 24 10:11:47.050446 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-38839941-project Aug 24 10:11:47.050446 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:11:47.050446 n-d-849328-3 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 24 10:11:47.050446 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '9'} Aug 24 10:11:47.051301 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:47.051301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:47.051301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:47.051301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:47.051301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:47.051301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:47.051301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:47.051301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:47.051301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 24 10:11:47.051301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 24 10:11:47.051301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:11:47.051301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:11:47.051301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:11:47.051301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:11:47.051301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:11:47.051301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:11:47.051301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:11:47.051301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:11:47.051301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:11:47.053247 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:11:47.053247 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:11:47.053247 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:11:47.053247 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:11:47.053247 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:11:47.053247 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 24 10:11:47.053247 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:47.053247 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:47.053247 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:47.053247 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:47.053247 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:47.053247 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:47.053247 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:11:47.053247 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:11:47.053247 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 24 10:11:47.053247 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:47.055471 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-85b03188-8a16-4cf4-804d-b7289f1edc6e tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:47.057138 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-85b03188-8a16-4cf4-804d-b7289f1edc6e tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] 10.222.0.85 "DELETE /compute/v2.1/os-aggregates/9" status: 403 len: 116 microversion: 2.1 time: 0.027008 Aug 24 10:11:47.058209 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 127/248] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:11:47 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 116 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:11:47.067609 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-78d267e6-26be-4bd7-9695-76813ad7dcaf req-a61de6eb-5ace-46fb-819d-1fe0870d1a85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10f639ed-ba2f-4983-9c04-777480733871", "tag": "d870b289-99aa-430a-87ca-f1845d13d5e2"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:47.098707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-78d267e6-26be-4bd7-9695-76813ad7dcaf req-a61de6eb-5ace-46fb-819d-1fe0870d1a85 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:47.099203 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-78d267e6-26be-4bd7-9695-76813ad7dcaf req-a61de6eb-5ace-46fb-819d-1fe0870d1a85 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:47.102491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-78d267e6-26be-4bd7-9695-76813ad7dcaf req-a61de6eb-5ace-46fb-819d-1fe0870d1a85 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:47.130522 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-78d267e6-26be-4bd7-9695-76813ad7dcaf req-a61de6eb-5ace-46fb-819d-1fe0870d1a85 service nova] Creating event network-changed:d870b289-99aa-430a-87ca-f1845d13d5e2 for instance 10f639ed-ba2f-4983-9c04-777480733871 on n-h2-849328-3 Aug 24 10:11:47.140486 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-78d267e6-26be-4bd7-9695-76813ad7dcaf req-a61de6eb-5ace-46fb-819d-1fe0870d1a85 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080727 Aug 24 10:11:47.141107 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 128/249] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:47.147478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-059ad348-f9ca-4325-af00-f5d3c69a9516 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Action: 'update', calling method: .version_select at 0x7f4655868160>, body: {"quota_set": {"ram": 51200}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:47.568751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-059ad348-f9ca-4325-af00-f5d3c69a9516 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:47.571894 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-059ad348-f9ca-4325-af00-f5d3c69a9516 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:47.572537 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-059ad348-f9ca-4325-af00-f5d3c69a9516 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:47.582193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-059ad348-f9ca-4325-af00-f5d3c69a9516 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:47.583179 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-059ad348-f9ca-4325-af00-f5d3c69a9516 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:47.583833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-059ad348-f9ca-4325-af00-f5d3c69a9516 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:47.690155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-eb9c2077-8c74-4f41-91b4-f4fec186fae5 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:47.701406 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eb9c2077-8c74-4f41-91b4-f4fec186fae5 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871" status: 200 len: 1322 microversion: 2.1 time: 1.215831 Aug 24 10:11:47.712004 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 122/250] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:46 2022] GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871 => generated 1322 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:47.727270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e9f1f624-b9a7-429e-8a18-40817c7aea5b tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:47.732098 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-059ad348-f9ca-4325-af00-f5d3c69a9516 tempest-QuotasAdminNegativeTest-253352694 tempest-QuotasAdminNegativeTest-253352694-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-quota-sets/abbfb9a5bb7c43119c9977dff46042ad" status: 200 len: 329 microversion: 2.1 time: 0.588824 Aug 24 10:11:47.733827 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:47.733827 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:47.735885 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 129/251] 10.222.0.85 () {60 vars in 1262 bytes} [Wed Aug 24 10:11:47 2022] PUT /compute/v2.1/os-quota-sets/abbfb9a5bb7c43119c9977dff46042ad => generated 329 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:47.747124 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b695c10a-0bd6-422f-b75d-4f53e75d9a7a tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2053170726"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:47.771041 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e9f1f624-b9a7-429e-8a18-40817c7aea5b tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.057522 Aug 24 10:11:47.773219 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 123/252] 10.222.0.85 () {58 vars in 1155 bytes} [Wed Aug 24 10:11:47 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 10:11:47.804240 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d61b2ace-e99d-47d8-89e5-c909f824ee19 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:47.805764 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:47.805764 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:47.857588 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d61b2ace-e99d-47d8-89e5-c909f824ee19 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.065395 Aug 24 10:11:47.858407 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 124/253] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:11:47 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 10:11:47.866544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2cf36c38-137f-47ea-a645-cffc0ac7fabd tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Action: 'update', calling method: .version_select at 0x7f46559f2c10>, body: {"quota_set": {"ram": 0}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:47.874702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2cf36c38-137f-47ea-a645-cffc0ac7fabd tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'd53b9b8b2e5b4b45bac7281d737b506c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbfb9a5bb7c43119c9977dff46042ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:47.877676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2cf36c38-137f-47ea-a645-cffc0ac7fabd tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Request method failure captured: Aug 24 10:11:47.877676 n-d-849328-3 devstack@n-api.service[122433]: request: PUT /compute/v2.1/os-quota-sets/abbfb9a5bb7c43119c9977dff46042ad HTTP/1.1 Aug 24 10:11:47.877676 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:11:47.877676 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:11:47.877676 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:11:47.877676 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 25 Aug 24 10:11:47.877676 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:11:47.877676 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:11:47.877676 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:11:47.877676 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:47.877676 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBflXdaouklNpWQ1FqRKZ_UdeKIWLp3RMBalwfMF7QcQNWsCUKPjxgx3IrfTXpFC-qsPExr8W1pWfddj-UU0XyrFFbN8WIyloUMSB__oE3J-G0Ys-jgFJQDbfxHHXZB6Lpcky_fl5BUsxt6YeknIvl3JO0qGiYlhbahW5KVmeboONlcY Aug 24 10:11:47.877676 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:11:47.877676 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:11:47.877676 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:11:47.877676 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:11:47.877676 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:11:47.877676 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:11:47.877676 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: abbfb9a5bb7c43119c9977dff46042ad Aug 24 10:11:47.877676 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-QuotasAdminNegativeTest-113072488 Aug 24 10:11:47.877676 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:11:47.877676 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:11:47.878887 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/abbfb9a5bb7c43119c9977dff46042ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_abbfb9a5bb7c43119c9977dff46042ad", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/abbfb9a5bb7c43119c9977dff46042ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/abbfb9a5bb7c43119c9977dff46042ad"}]}] Aug 24 10:11:47.878887 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-QuotasAdminNegativeTest-113072488 Aug 24 10:11:47.878887 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: abbfb9a5bb7c43119c9977dff46042ad Aug 24 10:11:47.878887 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-113072488 Aug 24 10:11:47.878887 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-QuotasAdminNegativeTest-113072488-project Aug 24 10:11:47.878887 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:11:47.878887 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:11:47.878887 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: d53b9b8b2e5b4b45bac7281d737b506c Aug 24 10:11:47.878887 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-QuotasAdminNegativeTest-113072488-project Aug 24 10:11:47.878887 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:11:47.878887 n-d-849328-3 devstack@n-api.service[122433]: {"quota_set": {"ram": 0}} Aug 24 10:11:47.878887 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:11:47.878887 n-d-849328-3 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 24 10:11:47.878887 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'abbfb9a5bb7c43119c9977dff46042ad', 'body': {'quota_set': {'ram': 0}}} Aug 24 10:11:47.879745 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:47.879745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:47.879745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:47.879745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:47.879745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:47.879745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:47.879745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:11:47.879745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:11:47.879745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:47.879745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:47.879745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:47.879745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:47.879745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 24 10:11:47.879745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 24 10:11:47.879745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 10:11:47.879745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:47.879745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 10:11:47.879745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:47.879745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 24 10:11:47.880776 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 24 10:11:47.880776 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:11:47.880776 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:11:47.880776 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:11:47.880776 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:11:47.880776 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:11:47.880776 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:11:47.880776 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:11:47.880776 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:11:47.880776 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:11:47.880776 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:11:47.880776 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:11:47.880776 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:11:47.880776 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:11:47.880776 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:11:47.880776 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 24 10:11:47.880776 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:47.880776 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:47.880776 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:47.880776 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:47.883234 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:47.883234 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:47.883234 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:11:47.883234 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:11:47.883234 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 24 10:11:47.883234 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:47.884999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2cf36c38-137f-47ea-a645-cffc0ac7fabd tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:47.886122 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2cf36c38-137f-47ea-a645-cffc0ac7fabd tempest-QuotasAdminNegativeTest-113072488 tempest-QuotasAdminNegativeTest-113072488-project] 10.222.0.85 "PUT /compute/v2.1/os-quota-sets/abbfb9a5bb7c43119c9977dff46042ad" status: 403 len: 116 microversion: 2.1 time: 0.026370 Aug 24 10:11:47.888000 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 125/254] 10.222.0.85 () {60 vars in 1262 bytes} [Wed Aug 24 10:11:47 2022] PUT /compute/v2.1/os-quota-sets/abbfb9a5bb7c43119c9977dff46042ad => generated 116 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:11:47.893467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c9e638e1-23f7-43a7-995f-49ad7f544289 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:47.894895 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:47.894895 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:47.907033 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-c9e638e1-23f7-43a7-995f-49ad7f544289 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] HTTP exception thrown: Aggregate 10 could not be found. Aug 24 10:11:47.913403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c9e638e1-23f7-43a7-995f-49ad7f544289 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Request method failure captured: Aug 24 10:11:47.913403 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-aggregates/10 HTTP/1.1 Aug 24 10:11:47.913403 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:11:47.913403 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:11:47.913403 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:11:47.913403 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:11:47.913403 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:11:47.913403 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:11:47.913403 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:11:47.913403 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:47.913403 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfkv2Y7JJe50iKX1vsMXqu40oK8-1YisXD9jU8EebUpk8fXC3Z1DjHO7mOtM1Zilhe5-bXR5XdOWsHoSTF-sODL-8h4lNJysU_T_L9WwlMGqHNXRNzUE1RZWwIzYQvdjiSSrQuLQZdQrXuhkBF6yMnez6N88HfW2A5lRgiuZnffSuh4 Aug 24 10:11:47.913403 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:11:47.913403 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:11:47.913403 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:11:47.913403 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:11:47.913403 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:11:47.913403 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:11:47.913403 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 4437f1978932419fb1e15a75fc4a68f0 Aug 24 10:11:47.913403 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminTestJSON-1988525817 Aug 24 10:11:47.913403 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:11:47.913403 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:11:47.914642 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/4437f1978932419fb1e15a75fc4a68f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_4437f1978932419fb1e15a75fc4a68f0", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/4437f1978932419fb1e15a75fc4a68f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/4437f1978932419fb1e15a75fc4a68f0"}]}] Aug 24 10:11:47.914642 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminTestJSON-1988525817 Aug 24 10:11:47.914642 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 4437f1978932419fb1e15a75fc4a68f0 Aug 24 10:11:47.914642 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1988525817 Aug 24 10:11:47.914642 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminTestJSON-1988525817-project-admin Aug 24 10:11:47.914642 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:11:47.914642 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:11:47.914642 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 669075b199c249b491ba15cee2a76ae4 Aug 24 10:11:47.914642 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminTestJSON-1988525817-project-admin Aug 24 10:11:47.914642 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:11:47.914642 n-d-849328-3 devstack@n-api.service[122433]: exception: Aggregate 10 could not be found. Aug 24 10:11:47.914642 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '10'} Aug 24 10:11:47.914642 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:47.915726 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:47.915726 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 24 10:11:47.915726 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 24 10:11:47.915726 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6459, in get_aggregate Aug 24 10:11:47.915726 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 24 10:11:47.915726 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:11:47.915726 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:11:47.915726 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 24 10:11:47.915726 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 24 10:11:47.915726 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 10:11:47.915726 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 10:11:47.915726 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 24 10:11:47.915726 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 24 10:11:47.915726 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 10 could not be found. Aug 24 10:11:47.915726 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:47.915726 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:47.915726 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:47.915726 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:47.915726 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:47.916851 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:47.916851 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:47.916851 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:47.916851 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:47.916851 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:47.916851 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 24 10:11:47.916851 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:11:47.916851 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 10 could not be found. Aug 24 10:11:47.916851 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:47.916851 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:47.916851 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:47.916851 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:47.916851 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:47.916851 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:47.916851 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:11:47.916851 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:11:47.916851 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 10 could not be found. Aug 24 10:11:47.916851 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:47.922416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c9e638e1-23f7-43a7-995f-49ad7f544289 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Returning 404 to user: Aggregate 10 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:47.923780 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c9e638e1-23f7-43a7-995f-49ad7f544289 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "GET /compute/v2.1/os-aggregates/10" status: 404 len: 78 microversion: 2.1 time: 0.034344 Aug 24 10:11:47.924858 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 126/255] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:11:47 2022] GET /compute/v2.1/os-aggregates/10 => generated 78 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:11:47.930520 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:47.930520 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:47.932384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-48cb3b6c-7b8c-4c9a-abd8-4488521c41ce tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:47.933446 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:47.933446 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:47.945857 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-48cb3b6c-7b8c-4c9a-abd8-4488521c41ce tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 24 10:11:47.947760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-48cb3b6c-7b8c-4c9a-abd8-4488521c41ce tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Request method failure captured: Aug 24 10:11:47.947760 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 24 10:11:47.947760 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:11:47.947760 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:11:47.947760 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:11:47.947760 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:11:47.947760 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:11:47.947760 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:11:47.947760 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:11:47.947760 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:47.947760 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfkxOCrhmMp8ZyHWiuE8Rt5MgwQ2qpVfyA6gPnjpwUitOlkT8qaFf-aTwIaoU0EixOW2eKRvcYztHDpMMdyYhdwytoLU5R2blnpSzWoomJR7mk238i4Lkj8-Qge0nsnh1KlmFv8oNGr9wbmQZ0iuQYVaz5J-yaImuvOi8qgS0Ee6wJY Aug 24 10:11:47.947760 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:11:47.947760 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:11:47.947760 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:11:47.947760 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:11:47.947760 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:11:47.947760 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:11:47.947760 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 9b94a17f031a448686100da7234a3445 Aug 24 10:11:47.947760 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1791053395 Aug 24 10:11:47.947760 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:11:47.947760 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:11:47.949073 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9b94a17f031a448686100da7234a3445"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9b94a17f031a448686100da7234a3445", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9b94a17f031a448686100da7234a3445"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9b94a17f031a448686100da7234a3445"}]}] Aug 24 10:11:47.949073 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1791053395 Aug 24 10:11:47.949073 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 9b94a17f031a448686100da7234a3445 Aug 24 10:11:47.949073 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1791053395 Aug 24 10:11:47.949073 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin Aug 24 10:11:47.949073 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:11:47.949073 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:11:47.949073 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 766bd229f8f34a20b940c772dca95614 Aug 24 10:11:47.949073 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin Aug 24 10:11:47.949073 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:11:47.949073 n-d-849328-3 devstack@n-api.service[122433]: exception: Aggregate -1 could not be found. Aug 24 10:11:47.949073 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '-1'} Aug 24 10:11:47.949928 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:47.949928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:47.949928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 24 10:11:47.949928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 24 10:11:47.949928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 10:11:47.949928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 10:11:47.949928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:11:47.949928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:11:47.949928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:11:47.949928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:11:47.949928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 10:11:47.949928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 10:11:47.949928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6512, in delete_aggregate Aug 24 10:11:47.949928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 24 10:11:47.949928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:11:47.949928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:11:47.949928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 24 10:11:47.949928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 24 10:11:47.949928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 10:11:47.951290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 10:11:47.951290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 24 10:11:47.951290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 24 10:11:47.951290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 24 10:11:47.951290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:47.951290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:47.951290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:47.951290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:47.951290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:47.951290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:47.951290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:47.951290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:47.951290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:47.951290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:47.951290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 24 10:11:47.951290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:11:47.951290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 24 10:11:47.951290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:47.951290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:47.951290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:47.951290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:47.952654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:47.952654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:47.952654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:11:47.952654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:11:47.952654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 24 10:11:47.952654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:47.954383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-48cb3b6c-7b8c-4c9a-abd8-4488521c41ce tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:47.955508 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-48cb3b6c-7b8c-4c9a-abd8-4488521c41ce tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.028182 Aug 24 10:11:47.957577 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 127/256] 10.222.0.85 () {58 vars in 1155 bytes} [Wed Aug 24 10:11:47 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:11:47.962460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0952677a-1edf-42d0-82f5-d8c2cf226220 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:47.975246 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-0952677a-1edf-42d0-82f5-d8c2cf226220 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] HTTP exception thrown: Aggregate 10 could not be found. Aug 24 10:11:47.978498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0952677a-1edf-42d0-82f5-d8c2cf226220 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Request method failure captured: Aug 24 10:11:47.978498 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-aggregates/10 HTTP/1.1 Aug 24 10:11:47.978498 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:11:47.978498 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:11:47.978498 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:11:47.978498 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:11:47.978498 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:11:47.978498 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:11:47.978498 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:11:47.978498 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:47.978498 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfkv2Y7JJe50iKX1vsMXqu40oK8-1YisXD9jU8EebUpk8fXC3Z1DjHO7mOtM1Zilhe5-bXR5XdOWsHoSTF-sODL-8h4lNJysU_T_L9WwlMGqHNXRNzUE1RZWwIzYQvdjiSSrQuLQZdQrXuhkBF6yMnez6N88HfW2A5lRgiuZnffSuh4 Aug 24 10:11:47.978498 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:11:47.978498 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:11:47.978498 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:11:47.978498 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:11:47.978498 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:11:47.978498 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:11:47.978498 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 4437f1978932419fb1e15a75fc4a68f0 Aug 24 10:11:47.978498 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminTestJSON-1988525817 Aug 24 10:11:47.978498 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:11:47.978498 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:11:47.980140 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/4437f1978932419fb1e15a75fc4a68f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_4437f1978932419fb1e15a75fc4a68f0", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/4437f1978932419fb1e15a75fc4a68f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/4437f1978932419fb1e15a75fc4a68f0"}]}] Aug 24 10:11:47.980140 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminTestJSON-1988525817 Aug 24 10:11:47.980140 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 4437f1978932419fb1e15a75fc4a68f0 Aug 24 10:11:47.980140 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1988525817 Aug 24 10:11:47.980140 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminTestJSON-1988525817-project-admin Aug 24 10:11:47.980140 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:11:47.980140 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:11:47.980140 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 669075b199c249b491ba15cee2a76ae4 Aug 24 10:11:47.980140 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminTestJSON-1988525817-project-admin Aug 24 10:11:47.980140 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:11:47.980140 n-d-849328-3 devstack@n-api.service[122433]: exception: Aggregate 10 could not be found. Aug 24 10:11:47.980140 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '10'} Aug 24 10:11:47.980140 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:47.981251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:47.981251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 24 10:11:47.981251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 24 10:11:47.981251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 10:11:47.981251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 10:11:47.981251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:11:47.981251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:11:47.981251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:11:47.981251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:11:47.981251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 10:11:47.981251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 10:11:47.981251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6512, in delete_aggregate Aug 24 10:11:47.981251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 24 10:11:47.981251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:11:47.981251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:11:47.981251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 24 10:11:47.981251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 24 10:11:47.981251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 10:11:47.981251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 10:11:47.983930 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 24 10:11:47.983930 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 24 10:11:47.983930 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 10 could not be found. Aug 24 10:11:47.983930 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:47.983930 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:47.983930 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:47.983930 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:47.983930 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:47.983930 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:47.983930 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:47.983930 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:47.983930 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:47.983930 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:47.983930 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 24 10:11:47.983930 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:11:47.983930 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 10 could not be found. Aug 24 10:11:47.983930 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:47.983930 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:47.983930 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:47.983930 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:47.983930 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:47.985484 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:47.985484 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:11:47.985484 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:11:47.985484 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 10 could not be found. Aug 24 10:11:47.985484 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:47.986707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0952677a-1edf-42d0-82f5-d8c2cf226220 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Returning 404 to user: Aggregate 10 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:47.987985 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0952677a-1edf-42d0-82f5-d8c2cf226220 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "DELETE /compute/v2.1/os-aggregates/10" status: 404 len: 78 microversion: 2.1 time: 0.029141 Aug 24 10:11:47.989236 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 128/257] 10.222.0.85 () {58 vars in 1155 bytes} [Wed Aug 24 10:11:47 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:11:47.994780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-11c43319-2a89-4b69-ab9a-ef3bb48832c8 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1535956906"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:47.999084 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:47.999084 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:48.000944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.aggregate [None req-11c43319-2a89-4b69-ab9a-ef3bb48832c8 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Generated uuid 1b7f3dae-3b8e-4147-80c5-90930729613e for aggregate {{(pid=122433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 10:11:48.008315 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b695c10a-0bd6-422f-b75d-4f53e75d9a7a tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 300 microversion: 2.41 time: 0.265360 Aug 24 10:11:48.011656 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 130/258] 10.222.0.85 () {62 vars in 1213 bytes} [Wed Aug 24 10:11:47 2022] PUT /compute/v2.1/os-aggregates/11 => generated 300 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:11:48.021479 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1d299ea5-31d4-4081-88a2-6f76eaeade62 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1286490892", "name": "tempest-test_aggregate-1636117902"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:48.049290 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:48.049290 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:48.051193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.aggregate [None req-1d299ea5-31d4-4081-88a2-6f76eaeade62 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Generated uuid 222d7f6f-0dc5-4e7a-a10b-9a79205c35bc for aggregate {{(pid=122432) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 10:11:48.058063 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-11c43319-2a89-4b69-ab9a-ef3bb48832c8 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.066303 Aug 24 10:11:48.063070 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 129/259] 10.222.0.85 () {60 vars in 1164 bytes} [Wed Aug 24 10:11:47 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:48.085231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f68bc839-0d58-4633-91e0-5d2dacfb6797 tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:48.089135 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:48.089135 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:48.109136 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f68bc839-0d58-4633-91e0-5d2dacfb6797 tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] 10.222.0.85 "GET /compute/v2.1/os-aggregates/11" status: 200 len: 300 microversion: 2.41 time: 0.044645 Aug 24 10:11:48.118776 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 130/260] 10.222.0.85 () {60 vars in 1193 bytes} [Wed Aug 24 10:11:48 2022] GET /compute/v2.1/os-aggregates/11 => generated 300 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:11:48.121520 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1d299ea5-31d4-4081-88a2-6f76eaeade62 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.108398 Aug 24 10:11:48.122346 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 131/261] 10.222.0.85 () {60 vars in 1165 bytes} [Wed Aug 24 10:11:48 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:48.134943 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-29a65824-d748-453b-88d3-c50ff26271a6 tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-849328-3"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:48.135939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3eab0203-a213-4afd-9a75-e14d06b82d45 tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:48.138890 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:48.138890 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:48.141038 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:48.141038 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:48.141798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3eab0203-a213-4afd-9a75-e14d06b82d45 tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '246bd9608c6946d795aeeec49c43a7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d55a5d5f49b4d3d98f26b32352ec925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:48.154596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3eab0203-a213-4afd-9a75-e14d06b82d45 tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] Request method failure captured: Aug 24 10:11:48.154596 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Aug 24 10:11:48.154596 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:11:48.154596 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:11:48.154596 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:11:48.154596 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:11:48.154596 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:11:48.154596 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:11:48.154596 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:11:48.154596 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:48.154596 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfku57eEvu-oxWBdyAAEJMaIHiMjx8OfwyMOxvNAzILoUAzyDpIQ1TvUd9_JHsPalbAGo61kFUIn9cYjIuBThVAC1bBbxYCb_IfEYXam6qQbf5cTr3QDh8CRlW8pabC4cwupG6fpRxnFMk5HndFZbkU9bReErEFh1ADggs880_eAWp0 Aug 24 10:11:48.154596 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:11:48.154596 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:11:48.154596 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:11:48.154596 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:11:48.154596 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:11:48.154596 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:11:48.154596 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 5d55a5d5f49b4d3d98f26b32352ec925 Aug 24 10:11:48.154596 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-38839941 Aug 24 10:11:48.154596 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:11:48.154596 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:11:48.155802 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5d55a5d5f49b4d3d98f26b32352ec925"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_5d55a5d5f49b4d3d98f26b32352ec925", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5d55a5d5f49b4d3d98f26b32352ec925"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/5d55a5d5f49b4d3d98f26b32352ec925"}]}] Aug 24 10:11:48.155802 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-38839941 Aug 24 10:11:48.155802 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 5d55a5d5f49b4d3d98f26b32352ec925 Aug 24 10:11:48.155802 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-38839941 Aug 24 10:11:48.155802 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminNegativeTestJSON-38839941-project Aug 24 10:11:48.155802 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:11:48.155802 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:11:48.155802 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 246bd9608c6946d795aeeec49c43a7ee Aug 24 10:11:48.155802 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-38839941-project Aug 24 10:11:48.155802 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:11:48.155802 n-d-849328-3 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 24 10:11:48.155802 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '12'} Aug 24 10:11:48.156558 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:48.156558 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:48.156558 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:48.156558 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:48.156558 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:48.156558 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:48.156558 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:48.156558 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:48.156558 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 24 10:11:48.156558 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 24 10:11:48.156558 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:11:48.156558 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:11:48.156558 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:11:48.156558 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:11:48.156558 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:11:48.156558 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:11:48.156558 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:11:48.156558 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:11:48.156558 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:11:48.157746 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:11:48.157746 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:11:48.157746 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:11:48.157746 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:11:48.157746 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:11:48.157746 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 24 10:11:48.157746 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:48.157746 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:48.157746 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:48.157746 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:48.157746 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:48.157746 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:48.157746 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:11:48.157746 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:11:48.157746 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 24 10:11:48.157746 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:48.157746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3eab0203-a213-4afd-9a75-e14d06b82d45 tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:48.158709 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3eab0203-a213-4afd-9a75-e14d06b82d45 tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] 10.222.0.85 "GET /compute/v2.1/os-aggregates/12" status: 403 len: 114 microversion: 2.1 time: 0.036103 Aug 24 10:11:48.158709 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 131/262] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:11:48 2022] GET /compute/v2.1/os-aggregates/12 => generated 114 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:11:48.163994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fa862da5-576a-471c-a605-3a9639ab9bbd tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:48.164760 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:48.164760 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:48.172820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29a65824-d748-453b-88d3-c50ff26271a6 tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:48.173788 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29a65824-d748-453b-88d3-c50ff26271a6 tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:48.174494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29a65824-d748-453b-88d3-c50ff26271a6 tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:48.197793 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fa862da5-576a-471c-a605-3a9639ab9bbd tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.037482 Aug 24 10:11:48.198838 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 132/263] 10.222.0.85 () {58 vars in 1155 bytes} [Wed Aug 24 10:11:48 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 10:11:48.205635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fd14e522-9fc6-4eb1-8013-68d8d9ccd39d tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:48.207087 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:48.207087 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:48.265882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=15,nova_api:INSERT=5 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:48.297161 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fd14e522-9fc6-4eb1-8013-68d8d9ccd39d tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.091333 Aug 24 10:11:48.299200 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 133/264] 10.222.0.85 () {58 vars in 1155 bytes} [Wed Aug 24 10:11:48 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 10:11:48.309396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2ebca6d9-b708-402a-9c2b-9466374400ad tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:48.310226 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:48.310226 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:48.327621 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-2ebca6d9-b708-402a-9c2b-9466374400ad tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Aug 24 10:11:48.329231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2ebca6d9-b708-402a-9c2b-9466374400ad tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Request method failure captured: Aug 24 10:11:48.329231 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Aug 24 10:11:48.329231 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:11:48.329231 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:11:48.329231 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:11:48.329231 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:11:48.329231 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:11:48.329231 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:11:48.329231 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:11:48.329231 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:48.329231 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfkv2Y7JJe50iKX1vsMXqu40oK8-1YisXD9jU8EebUpk8fXC3Z1DjHO7mOtM1Zilhe5-bXR5XdOWsHoSTF-sODL-8h4lNJysU_T_L9WwlMGqHNXRNzUE1RZWwIzYQvdjiSSrQuLQZdQrXuhkBF6yMnez6N88HfW2A5lRgiuZnffSuh4 Aug 24 10:11:48.329231 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:11:48.329231 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:11:48.329231 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:11:48.329231 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:11:48.329231 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:11:48.329231 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:11:48.329231 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 4437f1978932419fb1e15a75fc4a68f0 Aug 24 10:11:48.329231 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminTestJSON-1988525817 Aug 24 10:11:48.329231 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:11:48.329231 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:11:48.330600 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/4437f1978932419fb1e15a75fc4a68f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_4437f1978932419fb1e15a75fc4a68f0", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/4437f1978932419fb1e15a75fc4a68f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/4437f1978932419fb1e15a75fc4a68f0"}]}] Aug 24 10:11:48.330600 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminTestJSON-1988525817 Aug 24 10:11:48.330600 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 4437f1978932419fb1e15a75fc4a68f0 Aug 24 10:11:48.330600 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1988525817 Aug 24 10:11:48.330600 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminTestJSON-1988525817-project-admin Aug 24 10:11:48.330600 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:11:48.330600 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:11:48.330600 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 669075b199c249b491ba15cee2a76ae4 Aug 24 10:11:48.330600 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminTestJSON-1988525817-project-admin Aug 24 10:11:48.330600 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:11:48.330600 n-d-849328-3 devstack@n-api.service[122433]: exception: Aggregate 13 could not be found. Aug 24 10:11:48.330600 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '13'} Aug 24 10:11:48.330600 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:48.331307 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:48.331307 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 24 10:11:48.331307 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 24 10:11:48.331307 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6459, in get_aggregate Aug 24 10:11:48.331307 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 24 10:11:48.331307 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:11:48.331307 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:11:48.331307 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 24 10:11:48.331307 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 24 10:11:48.331307 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 10:11:48.331307 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 10:11:48.331307 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 24 10:11:48.331307 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 24 10:11:48.331307 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Aug 24 10:11:48.331307 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:48.331307 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:48.331307 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:48.331307 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:48.331307 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:48.332353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:48.332353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:48.332353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:48.332353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:48.332353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:48.332353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 24 10:11:48.332353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:11:48.332353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Aug 24 10:11:48.332353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:48.332353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:48.332353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:48.332353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:48.332353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:48.332353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:48.332353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:11:48.332353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:11:48.332353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Aug 24 10:11:48.332353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:48.333410 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2ebca6d9-b708-402a-9c2b-9466374400ad tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:48.333410 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2ebca6d9-b708-402a-9c2b-9466374400ad tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.029266 Aug 24 10:11:48.333410 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 134/265] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:11:48 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:11:48.357507 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a1438c0b-7579-466c-9984-5e9e75858176 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:48.379531 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-a1438c0b-7579-466c-9984-5e9e75858176 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 24 10:11:48.383048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a1438c0b-7579-466c-9984-5e9e75858176 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Request method failure captured: Aug 24 10:11:48.383048 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 24 10:11:48.383048 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:11:48.383048 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:11:48.383048 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:11:48.383048 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:11:48.383048 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:11:48.383048 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:11:48.383048 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:11:48.383048 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:48.383048 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfkxOCrhmMp8ZyHWiuE8Rt5MgwQ2qpVfyA6gPnjpwUitOlkT8qaFf-aTwIaoU0EixOW2eKRvcYztHDpMMdyYhdwytoLU5R2blnpSzWoomJR7mk238i4Lkj8-Qge0nsnh1KlmFv8oNGr9wbmQZ0iuQYVaz5J-yaImuvOi8qgS0Ee6wJY Aug 24 10:11:48.383048 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:11:48.383048 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:11:48.383048 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:11:48.383048 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:11:48.383048 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:11:48.383048 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:11:48.383048 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 9b94a17f031a448686100da7234a3445 Aug 24 10:11:48.383048 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1791053395 Aug 24 10:11:48.383048 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:11:48.383048 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:11:48.384237 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9b94a17f031a448686100da7234a3445"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9b94a17f031a448686100da7234a3445", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9b94a17f031a448686100da7234a3445"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9b94a17f031a448686100da7234a3445"}]}] Aug 24 10:11:48.384237 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1791053395 Aug 24 10:11:48.384237 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 9b94a17f031a448686100da7234a3445 Aug 24 10:11:48.384237 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1791053395 Aug 24 10:11:48.384237 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin Aug 24 10:11:48.384237 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:11:48.384237 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:11:48.384237 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 766bd229f8f34a20b940c772dca95614 Aug 24 10:11:48.384237 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin Aug 24 10:11:48.384237 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:11:48.384237 n-d-849328-3 devstack@n-api.service[122433]: exception: Aggregate -1 could not be found. Aug 24 10:11:48.384237 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '-1'} Aug 24 10:11:48.384922 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:48.384922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:48.384922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 24 10:11:48.384922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 24 10:11:48.384922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6459, in get_aggregate Aug 24 10:11:48.384922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 24 10:11:48.384922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:11:48.384922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:11:48.384922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 24 10:11:48.384922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 24 10:11:48.384922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 10:11:48.384922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 10:11:48.384922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 24 10:11:48.384922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 24 10:11:48.384922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 24 10:11:48.384922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:48.384922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:48.384922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:48.384922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:48.384922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:48.386304 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:48.386304 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:48.386304 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:48.386304 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:48.386304 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:48.386304 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 24 10:11:48.386304 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:11:48.386304 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 24 10:11:48.386304 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:48.386304 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:48.386304 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:48.386304 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:48.386304 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:48.386304 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:48.386304 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:11:48.386304 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:11:48.386304 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 24 10:11:48.386304 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:48.387291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a1438c0b-7579-466c-9984-5e9e75858176 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:48.387291 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a1438c0b-7579-466c-9984-5e9e75858176 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.052368 Aug 24 10:11:48.390351 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 135/266] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:11:48 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:11:48.395775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0037f3c3-3001-46e7-8667-ec029cbeaeca tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:48.401726 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:48.401726 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:48.432296 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-0037f3c3-3001-46e7-8667-ec029cbeaeca tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Aug 24 10:11:48.435194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0037f3c3-3001-46e7-8667-ec029cbeaeca tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Request method failure captured: Aug 24 10:11:48.435194 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Aug 24 10:11:48.435194 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:11:48.435194 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:11:48.435194 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:11:48.435194 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:11:48.435194 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:11:48.435194 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:11:48.435194 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:11:48.435194 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:48.435194 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfkv2Y7JJe50iKX1vsMXqu40oK8-1YisXD9jU8EebUpk8fXC3Z1DjHO7mOtM1Zilhe5-bXR5XdOWsHoSTF-sODL-8h4lNJysU_T_L9WwlMGqHNXRNzUE1RZWwIzYQvdjiSSrQuLQZdQrXuhkBF6yMnez6N88HfW2A5lRgiuZnffSuh4 Aug 24 10:11:48.435194 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:11:48.435194 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:11:48.435194 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:11:48.435194 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:11:48.435194 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:11:48.435194 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:11:48.435194 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 4437f1978932419fb1e15a75fc4a68f0 Aug 24 10:11:48.435194 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminTestJSON-1988525817 Aug 24 10:11:48.435194 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:11:48.435194 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:11:48.436686 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/4437f1978932419fb1e15a75fc4a68f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_4437f1978932419fb1e15a75fc4a68f0", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/4437f1978932419fb1e15a75fc4a68f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/4437f1978932419fb1e15a75fc4a68f0"}]}] Aug 24 10:11:48.436686 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminTestJSON-1988525817 Aug 24 10:11:48.436686 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 4437f1978932419fb1e15a75fc4a68f0 Aug 24 10:11:48.436686 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1988525817 Aug 24 10:11:48.436686 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminTestJSON-1988525817-project-admin Aug 24 10:11:48.436686 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:11:48.436686 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:11:48.436686 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 669075b199c249b491ba15cee2a76ae4 Aug 24 10:11:48.436686 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminTestJSON-1988525817-project-admin Aug 24 10:11:48.436686 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:11:48.436686 n-d-849328-3 devstack@n-api.service[122433]: exception: Aggregate 13 could not be found. Aug 24 10:11:48.436686 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '13'} Aug 24 10:11:48.436686 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:48.437623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:48.437623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 24 10:11:48.437623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 24 10:11:48.437623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 10:11:48.437623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 10:11:48.437623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:11:48.437623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:11:48.437623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:11:48.437623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:11:48.437623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 10:11:48.437623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 10:11:48.437623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6512, in delete_aggregate Aug 24 10:11:48.437623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 24 10:11:48.437623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:11:48.437623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:11:48.437623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 24 10:11:48.437623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 24 10:11:48.437623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 10:11:48.437623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 10:11:48.438742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 24 10:11:48.438742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 24 10:11:48.438742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Aug 24 10:11:48.438742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:48.438742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:48.438742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:48.438742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:48.438742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:48.438742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:48.438742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:48.438742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:48.438742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:48.438742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:48.438742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 24 10:11:48.438742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:11:48.438742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Aug 24 10:11:48.438742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:48.438742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:48.438742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:48.438742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:48.438742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:48.439920 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:48.439920 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:11:48.439920 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:11:48.439920 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Aug 24 10:11:48.439920 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:48.443214 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0037f3c3-3001-46e7-8667-ec029cbeaeca tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:48.444395 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0037f3c3-3001-46e7-8667-ec029cbeaeca tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.052780 Aug 24 10:11:48.445974 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 136/267] 10.222.0.85 () {58 vars in 1155 bytes} [Wed Aug 24 10:11:48 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:11:48.450718 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-29a65824-d748-453b-88d3-c50ff26271a6 tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 315 microversion: 2.41 time: 0.322913 Aug 24 10:11:48.451625 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 132/268] 10.222.0.85 () {62 vars in 1235 bytes} [Wed Aug 24 10:11:48 2022] POST /compute/v2.1/os-aggregates/11/action => generated 315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:11:48.459781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e4b72fd6-f51f-43ab-900a-805253650834 tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:48.461020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0a92609c-295f-45fc-9781-9d2596d26c0a tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-94835104"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:48.461752 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:48.461752 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:48.464055 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:48.464055 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:48.464628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e4b72fd6-f51f-43ab-900a-805253650834 tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '246bd9608c6946d795aeeec49c43a7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d55a5d5f49b4d3d98f26b32352ec925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:48.465031 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.aggregate [None req-0a92609c-295f-45fc-9781-9d2596d26c0a tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Generated uuid b2b604b0-fd5b-4084-bb44-ddd5dbe0ec0c for aggregate {{(pid=122432) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 10:11:48.475096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e4b72fd6-f51f-43ab-900a-805253650834 tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] Request method failure captured: Aug 24 10:11:48.475096 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 24 10:11:48.475096 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:11:48.475096 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:11:48.475096 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:11:48.475096 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:11:48.475096 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:11:48.475096 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:11:48.475096 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:11:48.475096 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:48.475096 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfku57eEvu-oxWBdyAAEJMaIHiMjx8OfwyMOxvNAzILoUAzyDpIQ1TvUd9_JHsPalbAGo61kFUIn9cYjIuBThVAC1bBbxYCb_IfEYXam6qQbf5cTr3QDh8CRlW8pabC4cwupG6fpRxnFMk5HndFZbkU9bReErEFh1ADggs880_eAWp0 Aug 24 10:11:48.475096 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:11:48.475096 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:11:48.475096 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:11:48.475096 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:11:48.475096 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:11:48.475096 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:11:48.475096 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 5d55a5d5f49b4d3d98f26b32352ec925 Aug 24 10:11:48.475096 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-38839941 Aug 24 10:11:48.475096 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:11:48.475096 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:11:48.478293 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5d55a5d5f49b4d3d98f26b32352ec925"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_5d55a5d5f49b4d3d98f26b32352ec925", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5d55a5d5f49b4d3d98f26b32352ec925"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/5d55a5d5f49b4d3d98f26b32352ec925"}]}] Aug 24 10:11:48.478293 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-38839941 Aug 24 10:11:48.478293 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 5d55a5d5f49b4d3d98f26b32352ec925 Aug 24 10:11:48.478293 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-38839941 Aug 24 10:11:48.478293 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminNegativeTestJSON-38839941-project Aug 24 10:11:48.478293 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:11:48.478293 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:11:48.478293 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 246bd9608c6946d795aeeec49c43a7ee Aug 24 10:11:48.478293 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-38839941-project Aug 24 10:11:48.478293 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:11:48.478293 n-d-849328-3 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 24 10:11:48.478293 n-d-849328-3 devstack@n-api.service[122433]: action_args: {} Aug 24 10:11:48.479628 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:48.479628 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:48.479628 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:48.479628 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:48.479628 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:48.479628 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:48.479628 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:48.479628 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:48.479628 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 24 10:11:48.479628 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 24 10:11:48.479628 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:11:48.479628 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:11:48.479628 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:11:48.479628 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:11:48.479628 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:11:48.479628 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:11:48.479628 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:11:48.479628 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:11:48.479628 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:11:48.481872 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:11:48.481872 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:11:48.481872 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:11:48.481872 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:11:48.481872 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:11:48.481872 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 24 10:11:48.481872 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:48.481872 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:48.481872 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:48.481872 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:48.481872 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:48.481872 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:48.481872 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:11:48.481872 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:11:48.481872 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 24 10:11:48.481872 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:48.486446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e4b72fd6-f51f-43ab-900a-805253650834 tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:48.487918 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e4b72fd6-f51f-43ab-900a-805253650834 tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] 10.222.0.85 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.040368 Aug 24 10:11:48.489078 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 137/269] 10.222.0.85 () {58 vars in 1143 bytes} [Wed Aug 24 10:11:48 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:11:48.498949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-498e8df1-0adf-4a3c-9940-a0709ebbe058 tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-849328-3"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:48.503316 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:48.503316 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:48.526368 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0a92609c-295f-45fc-9781-9d2596d26c0a tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.073469 Aug 24 10:11:48.538394 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 133/270] 10.222.0.85 () {60 vars in 1164 bytes} [Wed Aug 24 10:11:48 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:48.540817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-498e8df1-0adf-4a3c-9940-a0709ebbe058 tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:48.541833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-498e8df1-0adf-4a3c-9940-a0709ebbe058 tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:48.542787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-498e8df1-0adf-4a3c-9940-a0709ebbe058 tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:48.557257 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5f241e28-6677-47c6-bf74-7739c39b260a tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:48.558186 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:48.558186 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:48.589000 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5f241e28-6677-47c6-bf74-7739c39b260a tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 226 microversion: 2.1 time: 0.046612 Aug 24 10:11:48.590815 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 134/271] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:11:48 2022] GET /compute/v2.1/os-aggregates/14 => generated 226 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:48.605384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0a87ecdf-de93-46f6-b238-84f09abddfca tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:48.611039 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:48.611039 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:48.733186 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0a87ecdf-de93-46f6-b238-84f09abddfca tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 264 microversion: 2.1 time: 0.131873 Aug 24 10:11:48.734271 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 135/272] 10.222.0.85 () {60 vars in 1194 bytes} [Wed Aug 24 10:11:48 2022] POST /compute/v2.1/os-aggregates/14/action => generated 264 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:48.746052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b2139a7e-b575-4695-aae8-49007b5575c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:48.747528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b2139a7e-b575-4695-aae8-49007b5575c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 10f639ed-ba2f-4983-9c04-777480733871] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:48.760251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2139a7e-b575-4695-aae8-49007b5575c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:48.760957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2139a7e-b575-4695-aae8-49007b5575c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:48.762819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2139a7e-b575-4695-aae8-49007b5575c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:48.764316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2139a7e-b575-4695-aae8-49007b5575c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:48.764940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2139a7e-b575-4695-aae8-49007b5575c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:48.765650 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2139a7e-b575-4695-aae8-49007b5575c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:48.787147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:48.797267 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-498e8df1-0adf-4a3c-9940-a0709ebbe058 tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 300 microversion: 2.41 time: 0.304549 Aug 24 10:11:48.800209 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 138/273] 10.222.0.85 () {62 vars in 1235 bytes} [Wed Aug 24 10:11:48 2022] POST /compute/v2.1/os-aggregates/11/action => generated 300 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:11:48.825330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b7d796e7-7bd4-4a28-a87d-9797d3eaabb0 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:48.826815 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:48.826815 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:48.854735 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b7d796e7-7bd4-4a28-a87d-9797d3eaabb0 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 240 microversion: 2.1 time: 0.050560 Aug 24 10:11:48.855387 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 139/274] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:11:48 2022] GET /compute/v2.1/os-aggregates/14 => generated 240 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:48.867019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b9303c50-d612-4927-b7b7-a008eca57227 tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:48.867801 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:48.867801 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:48.903080 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b9303c50-d612-4927-b7b7-a008eca57227 tempest-AggregatesAdminTestV241-2003112242 tempest-AggregatesAdminTestV241-2003112242-project-admin] 10.222.0.85 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.41 time: 0.044451 Aug 24 10:11:48.904817 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 140/275] 10.222.0.85 () {60 vars in 1196 bytes} [Wed Aug 24 10:11:48 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:48.918289 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4b572fc3-ad01-45d4-8c0a-7c96fb581cc2 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:48.919768 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:48.919768 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:48.960825 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4b572fc3-ad01-45d4-8c0a-7c96fb581cc2 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.054252 Aug 24 10:11:48.962659 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 141/276] 10.222.0.85 () {58 vars in 1155 bytes} [Wed Aug 24 10:11:48 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 10:11:48.971401 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-100478a6-6d22-4f7c-ac11-c0eca8a329ca tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-91151644"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:48.975389 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:48.975389 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:48.978222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.aggregate [None req-100478a6-6d22-4f7c-ac11-c0eca8a329ca tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Generated uuid 842e0430-c5ee-4135-903c-4caecd69f4ef for aggregate {{(pid=122433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 10:11:49.009337 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-100478a6-6d22-4f7c-ac11-c0eca8a329ca tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.045360 Aug 24 10:11:49.010222 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 142/277] 10.222.0.85 () {60 vars in 1164 bytes} [Wed Aug 24 10:11:48 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:49.016159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-50ecdeb5-aca0-4216-a7e4-17f3adc1a662 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-390501596", "availability_zone": "tempest-test_az-749397010"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:49.020619 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:49.020619 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:49.021920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.aggregate [None req-50ecdeb5-aca0-4216-a7e4-17f3adc1a662 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Generated uuid aa5c9deb-1ed0-4e40-a824-e79684ce3c0e for aggregate {{(pid=122433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 10:11:49.066301 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-50ecdeb5-aca0-4216-a7e4-17f3adc1a662 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.054645 Aug 24 10:11:49.067393 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 143/278] 10.222.0.85 () {60 vars in 1165 bytes} [Wed Aug 24 10:11:49 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:49.076036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2def74f5-e0b1-453f-95ab-21bc8f226225 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-849328-3"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:49.079725 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:49.079725 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:49.091521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2def74f5-e0b1-453f-95ab-21bc8f226225 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:49.092316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2def74f5-e0b1-453f-95ab-21bc8f226225 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:49.092946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2def74f5-e0b1-453f-95ab-21bc8f226225 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:49.287430 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2def74f5-e0b1-453f-95ab-21bc8f226225 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 241 microversion: 2.1 time: 0.218815 Aug 24 10:11:49.288874 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 144/279] 10.222.0.85 () {60 vars in 1194 bytes} [Wed Aug 24 10:11:49 2022] POST /compute/v2.1/os-aggregates/15/action => generated 241 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:49.295494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8e800e2c-f6ee-4879-b263-8b5707259aa6 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-390501596_new", "availability_zone": "tempest-test_az-749397010_new"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:49.337100 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b2139a7e-b575-4695-aae8-49007b5575c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:49.353079 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b2139a7e-b575-4695-aae8-49007b5575c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871" status: 200 len: 1322 microversion: 2.1 time: 0.617378 Aug 24 10:11:49.353752 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 136/280] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:48 2022] GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871 => generated 1322 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:49.367333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b448f3b2-8413-4501-960e-ba1e82c805d0 tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-849328-3"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:49.374444 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:49.374444 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:49.379952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b448f3b2-8413-4501-960e-ba1e82c805d0 tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '246bd9608c6946d795aeeec49c43a7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d55a5d5f49b4d3d98f26b32352ec925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:49.386640 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b448f3b2-8413-4501-960e-ba1e82c805d0 tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] Request method failure captured: Aug 24 10:11:49.386640 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Aug 24 10:11:49.386640 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:11:49.386640 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:11:49.386640 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:11:49.386640 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 42 Aug 24 10:11:49.386640 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:11:49.386640 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:11:49.386640 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:11:49.386640 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:49.386640 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfku57eEvu-oxWBdyAAEJMaIHiMjx8OfwyMOxvNAzILoUAzyDpIQ1TvUd9_JHsPalbAGo61kFUIn9cYjIuBThVAC1bBbxYCb_IfEYXam6qQbf5cTr3QDh8CRlW8pabC4cwupG6fpRxnFMk5HndFZbkU9bReErEFh1ADggs880_eAWp0 Aug 24 10:11:49.386640 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:11:49.386640 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:11:49.386640 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:11:49.386640 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:11:49.386640 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:11:49.386640 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:11:49.386640 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 5d55a5d5f49b4d3d98f26b32352ec925 Aug 24 10:11:49.386640 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-38839941 Aug 24 10:11:49.386640 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:11:49.386640 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:11:49.387927 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5d55a5d5f49b4d3d98f26b32352ec925"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_5d55a5d5f49b4d3d98f26b32352ec925", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5d55a5d5f49b4d3d98f26b32352ec925"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/5d55a5d5f49b4d3d98f26b32352ec925"}]}] Aug 24 10:11:49.387927 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-38839941 Aug 24 10:11:49.387927 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 5d55a5d5f49b4d3d98f26b32352ec925 Aug 24 10:11:49.387927 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-38839941 Aug 24 10:11:49.387927 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-AggregatesAdminNegativeTestJSON-38839941-project Aug 24 10:11:49.387927 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:11:49.387927 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:11:49.387927 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 246bd9608c6946d795aeeec49c43a7ee Aug 24 10:11:49.387927 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-38839941-project Aug 24 10:11:49.387927 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:11:49.387927 n-d-849328-3 devstack@n-api.service[122432]: {"remove_host": {"host": "n-h2-849328-3"}} Aug 24 10:11:49.387927 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:11:49.387927 n-d-849328-3 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 24 10:11:49.388671 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'n-h2-849328-3'}}} Aug 24 10:11:49.388671 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:49.388671 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:49.388671 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:49.388671 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:49.388671 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:49.388671 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:49.388671 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:49.388671 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:49.388671 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:49.388671 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:49.388671 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 24 10:11:49.388671 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 24 10:11:49.388671 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:11:49.388671 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:11:49.388671 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:11:49.388671 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:11:49.388671 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:11:49.388671 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:11:49.389893 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:11:49.389893 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:11:49.389893 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:11:49.389893 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:11:49.389893 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:11:49.389893 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:11:49.389893 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:11:49.389893 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:11:49.389893 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 24 10:11:49.389893 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:49.389893 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:49.389893 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:49.389893 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:49.389893 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:49.389893 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:49.389893 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:11:49.389893 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:11:49.389893 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 24 10:11:49.389893 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:49.393717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b448f3b2-8413-4501-960e-ba1e82c805d0 tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:49.393717 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b448f3b2-8413-4501-960e-ba1e82c805d0 tempest-AggregatesAdminNegativeTestJSON-38839941 tempest-AggregatesAdminNegativeTestJSON-38839941-project] 10.222.0.85 "POST /compute/v2.1/os-aggregates/15/action" status: 403 len: 121 microversion: 2.1 time: 0.033471 Aug 24 10:11:49.393717 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 137/281] 10.222.0.85 () {60 vars in 1194 bytes} [Wed Aug 24 10:11:49 2022] POST /compute/v2.1/os-aggregates/15/action => generated 121 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:11:49.407352 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-27fde015-e8af-4808-aad5-fae48ddbfb94 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-849328-3"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:49.438203 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27fde015-e8af-4808-aad5-fae48ddbfb94 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:49.438741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27fde015-e8af-4808-aad5-fae48ddbfb94 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:49.439373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27fde015-e8af-4808-aad5-fae48ddbfb94 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:49.465239 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:49.465239 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:49.546797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e800e2c-f6ee-4879-b263-8b5707259aa6 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:49.547014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e800e2c-f6ee-4879-b263-8b5707259aa6 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:49.547371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e800e2c-f6ee-4879-b263-8b5707259aa6 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:49.646283 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8e800e2c-f6ee-4879-b263-8b5707259aa6 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 334 microversion: 2.1 time: 0.356119 Aug 24 10:11:49.648732 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 145/282] 10.222.0.85 () {60 vars in 1173 bytes} [Wed Aug 24 10:11:49 2022] PUT /compute/v2.1/os-aggregates/16 => generated 334 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:49.666148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-187e39f7-09a7-422d-9af4-bd7f3523e718 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:49.667465 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:49.667465 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:49.699699 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-187e39f7-09a7-422d-9af4-bd7f3523e718 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "GET /compute/v2.1/os-aggregates" status: 200 len: 565 microversion: 2.1 time: 0.043982 Aug 24 10:11:49.701442 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 146/283] 10.222.0.85 () {58 vars in 1143 bytes} [Wed Aug 24 10:11:49 2022] GET /compute/v2.1/os-aggregates => generated 565 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:11:49.713549 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-27fde015-e8af-4808-aad5-fae48ddbfb94 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 226 microversion: 2.1 time: 0.315839 Aug 24 10:11:49.718332 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 138/284] 10.222.0.85 () {60 vars in 1194 bytes} [Wed Aug 24 10:11:49 2022] POST /compute/v2.1/os-aggregates/15/action => generated 226 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:49.732046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-20243768-4075-4f86-b3b8-1421e1047494 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:49.733080 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:49.733080 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:49.738425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9e783dd7-e88b-45fe-8d28-8286a74d0899 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:49.742335 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:49.742335 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:49.786025 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-20243768-4075-4f86-b3b8-1421e1047494 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.068573 Aug 24 10:11:49.786953 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 147/285] 10.222.0.85 () {58 vars in 1155 bytes} [Wed Aug 24 10:11:49 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 10:11:49.801744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c9d03ec-c8c9-4f40-8489-bee736aafb39 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-954292545"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:49.802470 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9e783dd7-e88b-45fe-8d28-8286a74d0899 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.080031 Aug 24 10:11:49.803530 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 139/286] 10.222.0.85 () {58 vars in 1155 bytes} [Wed Aug 24 10:11:49 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 10:11:49.804666 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:49.804666 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:49.807567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.aggregate [None req-2c9d03ec-c8c9-4f40-8489-bee736aafb39 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Generated uuid fc4dda32-3e72-459f-886f-839ee17b1d36 for aggregate {{(pid=122433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 10:11:49.814496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f8cf07a3-3ff3-4639-87d9-367f8b731d4e tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1175483302"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:49.818363 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:49.818363 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:49.819745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.aggregate [None req-f8cf07a3-3ff3-4639-87d9-367f8b731d4e tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Generated uuid 4d9d4b0a-ff4a-4e98-bb54-652919d44de5 for aggregate {{(pid=122432) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 10:11:49.839899 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2c9d03ec-c8c9-4f40-8489-bee736aafb39 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.047519 Aug 24 10:11:49.841052 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 148/287] 10.222.0.85 () {60 vars in 1164 bytes} [Wed Aug 24 10:11:49 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:49.853705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9687be7c-fb07-40b4-983f-389e91c2a04a tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:49.860213 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:49.860213 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:49.861557 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f8cf07a3-3ff3-4639-87d9-367f8b731d4e tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.051905 Aug 24 10:11:49.862557 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 140/288] 10.222.0.85 () {60 vars in 1164 bytes} [Wed Aug 24 10:11:49 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:49.869668 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9687be7c-fb07-40b4-983f-389e91c2a04a tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "GET /compute/v2.1/os-aggregates" status: 200 len: 445 microversion: 2.1 time: 0.021479 Aug 24 10:11:49.870859 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 149/289] 10.222.0.85 () {58 vars in 1143 bytes} [Wed Aug 24 10:11:49 2022] GET /compute/v2.1/os-aggregates => generated 445 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:11:49.880872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32714936-cadc-4c78-8787-50390623b177 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:49.883931 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:49.883931 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:49.885404 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-53452916-2169-4b0b-bd49-3f3ab6b0e664 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:49.886409 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:49.886409 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:11:49.894871 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32714936-cadc-4c78-8787-50390623b177 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:49.895711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32714936-cadc-4c78-8787-50390623b177 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:49.896327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32714936-cadc-4c78-8787-50390623b177 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:49.903875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32714936-cadc-4c78-8787-50390623b177 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:49.904336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32714936-cadc-4c78-8787-50390623b177 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:49.904770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32714936-cadc-4c78-8787-50390623b177 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:49.916423 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-53452916-2169-4b0b-bd49-3f3ab6b0e664 tempest-AggregatesAdminTestJSON-1988525817 tempest-AggregatesAdminTestJSON-1988525817-project-admin] 10.222.0.85 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.036964 Aug 24 10:11:49.917817 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 150/290] 10.222.0.85 () {58 vars in 1155 bytes} [Wed Aug 24 10:11:49 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 24 10:11:49.921335 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.compute.aggregates [None req-32714936-cadc-4c78-8787-50390623b177 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 24 10:11:49.923706 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-32714936-cadc-4c78-8787-50390623b177 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Aug 24 10:11:49.928198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32714936-cadc-4c78-8787-50390623b177 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Request method failure captured: Aug 24 10:11:49.928198 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Aug 24 10:11:49.928198 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:11:49.928198 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:11:49.928198 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:11:49.928198 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 42 Aug 24 10:11:49.928198 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:11:49.928198 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:11:49.928198 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:11:49.928198 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:49.928198 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfkxOCrhmMp8ZyHWiuE8Rt5MgwQ2qpVfyA6gPnjpwUitOlkT8qaFf-aTwIaoU0EixOW2eKRvcYztHDpMMdyYhdwytoLU5R2blnpSzWoomJR7mk238i4Lkj8-Qge0nsnh1KlmFv8oNGr9wbmQZ0iuQYVaz5J-yaImuvOi8qgS0Ee6wJY Aug 24 10:11:49.928198 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:11:49.928198 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:11:49.928198 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:11:49.928198 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:11:49.928198 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:11:49.928198 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:11:49.928198 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 9b94a17f031a448686100da7234a3445 Aug 24 10:11:49.928198 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1791053395 Aug 24 10:11:49.928198 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,admin,member Aug 24 10:11:49.928198 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,admin,member Aug 24 10:11:49.929736 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9b94a17f031a448686100da7234a3445"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9b94a17f031a448686100da7234a3445", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9b94a17f031a448686100da7234a3445"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9b94a17f031a448686100da7234a3445"}]}] Aug 24 10:11:49.929736 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1791053395 Aug 24 10:11:49.929736 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 9b94a17f031a448686100da7234a3445 Aug 24 10:11:49.929736 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1791053395 Aug 24 10:11:49.929736 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin Aug 24 10:11:49.929736 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:11:49.929736 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:11:49.929736 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 766bd229f8f34a20b940c772dca95614 Aug 24 10:11:49.929736 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin Aug 24 10:11:49.929736 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:11:49.929736 n-d-849328-3 devstack@n-api.service[122432]: {"remove_host": {"host": "nonexist_host"}} Aug 24 10:11:49.929736 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:11:49.929736 n-d-849328-3 devstack@n-api.service[122432]: exception: Cannot remove host nonexist_host in aggregate 18 Aug 24 10:11:49.930618 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 24 10:11:49.930618 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:49.930618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:49.930618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5994, in _get_service_in_cell_by_host Aug 24 10:11:49.930618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 24 10:11:49.930618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:11:49.930618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:11:49.930618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 24 10:11:49.930618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 24 10:11:49.930618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 10:11:49.930618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 10:11:49.930618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 24 10:11:49.930618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 24 10:11:49.930618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 24 10:11:49.930618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:49.930618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:49.930618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:49.930618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:49.930618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6000, in _get_service_in_cell_by_host Aug 24 10:11:49.930618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 24 10:11:49.931991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 24 10:11:49.931991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 24 10:11:49.931991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 24 10:11:49.931991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:49.931991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:49.931991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:49.931991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:49.931991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 24 10:11:49.931991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 24 10:11:49.931991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 10:11:49.931991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 10:11:49.931991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:11:49.931991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:11:49.931991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:11:49.931991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:11:49.931991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 10:11:49.931991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 10:11:49.931991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6678, in remove_host_from_aggregate Aug 24 10:11:49.931991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 24 10:11:49.931991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6002, in _get_service_in_cell_by_host Aug 24 10:11:49.933325 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 24 10:11:49.933325 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 24 10:11:49.933325 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:49.933325 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:49.933325 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:49.933325 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:49.933325 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:49.933325 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:49.933325 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:49.933325 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:49.933325 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:49.933325 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:49.933325 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:49.933325 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:49.933325 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 24 10:11:49.933325 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 10:11:49.933325 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Aug 24 10:11:49.933325 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:49.933325 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:49.933325 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:49.933325 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:49.934679 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:49.934679 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:49.934679 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:11:49.934679 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:11:49.934679 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Aug 24 10:11:49.934679 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:11:49.940548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-20951a1c-ae7c-4b32-95e5-2e615bfb9a53 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:49.940809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32714936-cadc-4c78-8787-50390623b177 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:49.941897 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-32714936-cadc-4c78-8787-50390623b177 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.072390 Aug 24 10:11:49.942638 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 141/291] 10.222.0.85 () {60 vars in 1194 bytes} [Wed Aug 24 10:11:49 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 10:11:49.943348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-20951a1c-ae7c-4b32-95e5-2e615bfb9a53 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:49.951035 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e75ac88f-0886-4aec-9de1-a677d2495dc1 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:49.952695 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:11:49.952695 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:11:49.955706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20951a1c-ae7c-4b32-95e5-2e615bfb9a53 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:49.956470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20951a1c-ae7c-4b32-95e5-2e615bfb9a53 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:49.957513 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20951a1c-ae7c-4b32-95e5-2e615bfb9a53 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:49.958329 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20951a1c-ae7c-4b32-95e5-2e615bfb9a53 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:49.958906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20951a1c-ae7c-4b32-95e5-2e615bfb9a53 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:49.959854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20951a1c-ae7c-4b32-95e5-2e615bfb9a53 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:49.978668 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-20951a1c-ae7c-4b32-95e5-2e615bfb9a53 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] HTTP exception thrown: Instance a9790d01-4c85-4d60-814e-d32faf530877 could not be found. Aug 24 10:11:49.980609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-20951a1c-ae7c-4b32-95e5-2e615bfb9a53 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Request method failure captured: Aug 24 10:11:49.980609 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 HTTP/1.1 Aug 24 10:11:49.980609 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:11:49.980609 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:11:49.980609 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:11:49.980609 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:11:49.980609 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:11:49.980609 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:11:49.980609 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:11:49.980609 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:49.980609 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfktzSjRXQs9jrfJhckPVukb1ZKsZLepeg7Uq7Kv4gDF373M4WP9K6qXRa34NEYZlqQ1ggGhqDCloklYevV5UrGW7LEfj_m0CbQAJ_we9F4m2dd-YmVA20PNF3vs0TroESn4-6n6tPT6FizuHFcwlN2vqagA__GBx1Mh1RFlmlYZs7E Aug 24 10:11:49.980609 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:11:49.980609 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:11:49.980609 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:11:49.980609 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:11:49.980609 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:11:49.980609 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:11:49.980609 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d058330a96034236a9429ab2891a111d Aug 24 10:11:49.980609 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminTestJSON-1978145020 Aug 24 10:11:49.980609 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:11:49.980609 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:11:49.983432 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d058330a96034236a9429ab2891a111d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d058330a96034236a9429ab2891a111d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d058330a96034236a9429ab2891a111d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d058330a96034236a9429ab2891a111d"}]}] Aug 24 10:11:49.983432 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminTestJSON-1978145020 Aug 24 10:11:49.983432 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d058330a96034236a9429ab2891a111d Aug 24 10:11:49.983432 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1978145020 Aug 24 10:11:49.983432 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminTestJSON-1978145020-project Aug 24 10:11:49.983432 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:11:49.983432 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:11:49.983432 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 213baa7d5703491b9ea67a5f7231212b Aug 24 10:11:49.983432 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminTestJSON-1978145020-project Aug 24 10:11:49.983432 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:11:49.983432 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance a9790d01-4c85-4d60-814e-d32faf530877 could not be found. Aug 24 10:11:49.983432 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'a9790d01-4c85-4d60-814e-d32faf530877'} Aug 24 10:11:49.984205 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:49.984205 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:49.984205 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:11:49.984205 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:11:49.984205 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:11:49.984205 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:11:49.984205 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:11:49.984205 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:11:49.984205 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:11:49.984205 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:11:49.984205 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9790d01-4c85-4d60-814e-d32faf530877 could not be found. Aug 24 10:11:49.984205 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:49.984205 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:49.984205 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:49.984205 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:49.984205 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:49.984205 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:49.984205 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:49.984205 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:49.984205 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:49.987678 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:49.987678 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:11:49.987678 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:11:49.987678 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:11:49.987678 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:11:49.987678 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:11:49.987678 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:11:49.987678 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:11:49.987678 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:11:49.987678 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9790d01-4c85-4d60-814e-d32faf530877 could not be found. Aug 24 10:11:49.987678 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:49.987678 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:49.987678 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:49.987678 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:49.987678 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:49.987678 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:49.987678 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:11:49.987678 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:11:49.987678 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9790d01-4c85-4d60-814e-d32faf530877 could not be found. Aug 24 10:11:49.987678 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:49.988835 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-20951a1c-ae7c-4b32-95e5-2e615bfb9a53 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Returning 404 to user: Instance a9790d01-4c85-4d60-814e-d32faf530877 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:49.988835 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-20951a1c-ae7c-4b32-95e5-2e615bfb9a53 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 404 len: 111 microversion: 2.1 time: 0.063129 Aug 24 10:11:49.992027 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 151/292] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:11:49 2022] DELETE /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:11:50.002700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6811ef54-ebd1-492a-bd29-790c0a6b5285 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:50.004131 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6811ef54-ebd1-492a-bd29-790c0a6b5285 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] [instance: a9790d01-4c85-4d60-814e-d32faf530877] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:50.010986 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e75ac88f-0886-4aec-9de1-a677d2495dc1 tempest-AggregatesAdminNegativeTestJSON-1791053395 tempest-AggregatesAdminNegativeTestJSON-1791053395-project-admin] 10.222.0.85 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.057977 Aug 24 10:11:50.014556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6811ef54-ebd1-492a-bd29-790c0a6b5285 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:50.014556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6811ef54-ebd1-492a-bd29-790c0a6b5285 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:50.014556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6811ef54-ebd1-492a-bd29-790c0a6b5285 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:50.015312 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6811ef54-ebd1-492a-bd29-790c0a6b5285 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:50.016179 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6811ef54-ebd1-492a-bd29-790c0a6b5285 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:50.016834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6811ef54-ebd1-492a-bd29-790c0a6b5285 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:50.019134 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 142/293] 10.222.0.85 () {58 vars in 1155 bytes} [Wed Aug 24 10:11:49 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 10:11:50.282537 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-6811ef54-ebd1-492a-bd29-790c0a6b5285 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] HTTP exception thrown: Instance a9790d01-4c85-4d60-814e-d32faf530877 could not be found. Aug 24 10:11:50.284198 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6811ef54-ebd1-492a-bd29-790c0a6b5285 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Request method failure captured: Aug 24 10:11:50.284198 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 HTTP/1.1 Aug 24 10:11:50.284198 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:11:50.284198 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:11:50.284198 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:11:50.284198 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:11:50.284198 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:11:50.284198 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:11:50.284198 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:11:50.284198 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:50.284198 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfktzSjRXQs9jrfJhckPVukb1ZKsZLepeg7Uq7Kv4gDF373M4WP9K6qXRa34NEYZlqQ1ggGhqDCloklYevV5UrGW7LEfj_m0CbQAJ_we9F4m2dd-YmVA20PNF3vs0TroESn4-6n6tPT6FizuHFcwlN2vqagA__GBx1Mh1RFlmlYZs7E Aug 24 10:11:50.284198 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:11:50.284198 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:11:50.284198 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:11:50.284198 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:11:50.284198 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:11:50.284198 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:11:50.284198 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d058330a96034236a9429ab2891a111d Aug 24 10:11:50.284198 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminTestJSON-1978145020 Aug 24 10:11:50.284198 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:11:50.284198 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:11:50.285838 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d058330a96034236a9429ab2891a111d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d058330a96034236a9429ab2891a111d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d058330a96034236a9429ab2891a111d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d058330a96034236a9429ab2891a111d"}]}] Aug 24 10:11:50.285838 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminTestJSON-1978145020 Aug 24 10:11:50.285838 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d058330a96034236a9429ab2891a111d Aug 24 10:11:50.285838 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1978145020 Aug 24 10:11:50.285838 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminTestJSON-1978145020-project Aug 24 10:11:50.285838 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:11:50.285838 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:11:50.285838 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 213baa7d5703491b9ea67a5f7231212b Aug 24 10:11:50.285838 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminTestJSON-1978145020-project Aug 24 10:11:50.285838 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:11:50.285838 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance a9790d01-4c85-4d60-814e-d32faf530877 could not be found. Aug 24 10:11:50.285838 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'a9790d01-4c85-4d60-814e-d32faf530877'} Aug 24 10:11:50.286655 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:50.286655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:50.286655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:11:50.286655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:11:50.286655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:11:50.286655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:11:50.286655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:11:50.286655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:11:50.286655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:11:50.286655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:11:50.286655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9790d01-4c85-4d60-814e-d32faf530877 could not be found. Aug 24 10:11:50.286655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:50.286655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:50.286655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:50.286655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:50.286655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:50.286655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:50.286655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:50.286655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:50.286655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:50.288009 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:50.288009 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:11:50.288009 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:11:50.288009 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:11:50.288009 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:11:50.288009 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:11:50.288009 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:11:50.288009 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9790d01-4c85-4d60-814e-d32faf530877 could not be found. Aug 24 10:11:50.288009 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:50.288009 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:50.288009 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:50.288009 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:50.288009 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:50.288009 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:50.288009 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:11:50.288009 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:11:50.288009 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9790d01-4c85-4d60-814e-d32faf530877 could not be found. Aug 24 10:11:50.288009 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:50.290161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6811ef54-ebd1-492a-bd29-790c0a6b5285 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] Returning 404 to user: Instance a9790d01-4c85-4d60-814e-d32faf530877 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:50.290161 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6811ef54-ebd1-492a-bd29-790c0a6b5285 tempest-AggregatesAdminTestJSON-1978145020 tempest-AggregatesAdminTestJSON-1978145020-project] 10.222.0.85 "GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877" status: 404 len: 111 microversion: 2.1 time: 0.289638 Aug 24 10:11:50.290161 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 152/294] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:49 2022] GET /compute/v2.1/servers/a9790d01-4c85-4d60-814e-d32faf530877 => generated 111 bytes in 297 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:11:50.378809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a25bcc14-45d1-41ce-81c1-0eb33ac4e377 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:50.379899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a25bcc14-45d1-41ce-81c1-0eb33ac4e377 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 10f639ed-ba2f-4983-9c04-777480733871] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:50.395953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a25bcc14-45d1-41ce-81c1-0eb33ac4e377 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:50.397819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a25bcc14-45d1-41ce-81c1-0eb33ac4e377 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:50.398843 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a25bcc14-45d1-41ce-81c1-0eb33ac4e377 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:50.402234 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a25bcc14-45d1-41ce-81c1-0eb33ac4e377 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:50.404896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a25bcc14-45d1-41ce-81c1-0eb33ac4e377 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:50.405962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a25bcc14-45d1-41ce-81c1-0eb33ac4e377 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:50.559771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-89d9164d-aa2d-490a-b6d1-aaea1c687845 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:50.560354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-89d9164d-aa2d-490a-b6d1-aaea1c687845 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: 7e6f46da-f3b6-41ec-96f2-a3db16593a10] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:50.575564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89d9164d-aa2d-490a-b6d1-aaea1c687845 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:50.576065 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89d9164d-aa2d-490a-b6d1-aaea1c687845 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:50.576498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89d9164d-aa2d-490a-b6d1-aaea1c687845 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:50.577236 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89d9164d-aa2d-490a-b6d1-aaea1c687845 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:50.577693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89d9164d-aa2d-490a-b6d1-aaea1c687845 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:50.578112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89d9164d-aa2d-490a-b6d1-aaea1c687845 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:51.059936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-89d9164d-aa2d-490a-b6d1-aaea1c687845 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:51.069550 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-89d9164d-aa2d-490a-b6d1-aaea1c687845 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10" status: 200 len: 1586 microversion: 2.1 time: 0.513491 Aug 24 10:11:51.074345 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 153/295] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:50 2022] GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10 => generated 1586 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:51.078403 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a25bcc14-45d1-41ce-81c1-0eb33ac4e377 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:51.091823 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a25bcc14-45d1-41ce-81c1-0eb33ac4e377 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871" status: 200 len: 1322 microversion: 2.1 time: 0.719441 Aug 24 10:11:51.099174 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 143/296] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:50 2022] GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871 => generated 1322 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:51.658635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c3ce49f7-cee5-48d9-8785-47e03cb88800 req-789564cd-c280-4c6a-be95-d602f121bea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e6f46da-f3b6-41ec-96f2-a3db16593a10", "tag": "759674c4-7256-4865-8493-4fa0e5a87e8e"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:51.678089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c3ce49f7-cee5-48d9-8785-47e03cb88800 req-789564cd-c280-4c6a-be95-d602f121bea6 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:51.678576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c3ce49f7-cee5-48d9-8785-47e03cb88800 req-789564cd-c280-4c6a-be95-d602f121bea6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:51.679006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c3ce49f7-cee5-48d9-8785-47e03cb88800 req-789564cd-c280-4c6a-be95-d602f121bea6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:51.723264 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c3ce49f7-cee5-48d9-8785-47e03cb88800 req-789564cd-c280-4c6a-be95-d602f121bea6 service nova] Creating event network-changed:759674c4-7256-4865-8493-4fa0e5a87e8e for instance 7e6f46da-f3b6-41ec-96f2-a3db16593a10 on n-h1-849328-3 Aug 24 10:11:51.736626 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c3ce49f7-cee5-48d9-8785-47e03cb88800 req-789564cd-c280-4c6a-be95-d602f121bea6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.363492 Aug 24 10:11:51.743951 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 154/297] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:52.114073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f46a719a-34e8-492c-afe7-9938697e7e49 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:52.114606 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f46a719a-34e8-492c-afe7-9938697e7e49 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 10f639ed-ba2f-4983-9c04-777480733871] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:52.127599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f46a719a-34e8-492c-afe7-9938697e7e49 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:52.128388 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f46a719a-34e8-492c-afe7-9938697e7e49 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:52.128975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f46a719a-34e8-492c-afe7-9938697e7e49 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:52.136491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f46a719a-34e8-492c-afe7-9938697e7e49 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:52.138435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f46a719a-34e8-492c-afe7-9938697e7e49 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:52.140211 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f46a719a-34e8-492c-afe7-9938697e7e49 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:52.699916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f46a719a-34e8-492c-afe7-9938697e7e49 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:52.713359 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f46a719a-34e8-492c-afe7-9938697e7e49 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871" status: 200 len: 1322 microversion: 2.1 time: 0.604475 Aug 24 10:11:52.717442 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 144/298] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:52 2022] GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871 => generated 1322 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:53.739129 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-94f5f035-678b-46e2-b1d0-f4ba5736306b tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:53.741338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-94f5f035-678b-46e2-b1d0-f4ba5736306b tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 10f639ed-ba2f-4983-9c04-777480733871] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:53.757057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94f5f035-678b-46e2-b1d0-f4ba5736306b tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:53.758975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94f5f035-678b-46e2-b1d0-f4ba5736306b tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:53.765851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94f5f035-678b-46e2-b1d0-f4ba5736306b tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:53.767084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94f5f035-678b-46e2-b1d0-f4ba5736306b tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:53.767811 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94f5f035-678b-46e2-b1d0-f4ba5736306b tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:53.768787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94f5f035-678b-46e2-b1d0-f4ba5736306b tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:54.073826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-94f5f035-678b-46e2-b1d0-f4ba5736306b tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:54.086443 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-94f5f035-678b-46e2-b1d0-f4ba5736306b tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871" status: 200 len: 1322 microversion: 2.1 time: 0.354701 Aug 24 10:11:54.109726 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 155/299] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:53 2022] GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871 => generated 1322 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:11:54.383515 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-879fda29-acd8-4d1d-886b-f60bdc839f66 req-69e44dbd-b7c3-4efe-ab38-ac1ba38c9e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10f639ed-ba2f-4983-9c04-777480733871", "name": "network-vif-plugged", "status": "completed", "tag": "d870b289-99aa-430a-87ca-f1845d13d5e2"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:54.436512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-879fda29-acd8-4d1d-886b-f60bdc839f66 req-69e44dbd-b7c3-4efe-ab38-ac1ba38c9e64 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:54.437569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-879fda29-acd8-4d1d-886b-f60bdc839f66 req-69e44dbd-b7c3-4efe-ab38-ac1ba38c9e64 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:54.438686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-879fda29-acd8-4d1d-886b-f60bdc839f66 req-69e44dbd-b7c3-4efe-ab38-ac1ba38c9e64 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:54.464905 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-879fda29-acd8-4d1d-886b-f60bdc839f66 req-69e44dbd-b7c3-4efe-ab38-ac1ba38c9e64 service nova] Creating event network-vif-plugged:d870b289-99aa-430a-87ca-f1845d13d5e2 for instance 10f639ed-ba2f-4983-9c04-777480733871 on n-h2-849328-3 Aug 24 10:11:54.479144 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-879fda29-acd8-4d1d-886b-f60bdc839f66 req-69e44dbd-b7c3-4efe-ab38-ac1ba38c9e64 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100432 Aug 24 10:11:54.483001 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 145/300] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:55.116170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c8a57324-3b52-4295-8060-b4fe6ce69a8b tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:55.116917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c8a57324-3b52-4295-8060-b4fe6ce69a8b tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 10f639ed-ba2f-4983-9c04-777480733871] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:55.126785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8a57324-3b52-4295-8060-b4fe6ce69a8b tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:55.127328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8a57324-3b52-4295-8060-b4fe6ce69a8b tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:55.129476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8a57324-3b52-4295-8060-b4fe6ce69a8b tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:55.130328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8a57324-3b52-4295-8060-b4fe6ce69a8b tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:55.130697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8a57324-3b52-4295-8060-b4fe6ce69a8b tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:55.131509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8a57324-3b52-4295-8060-b4fe6ce69a8b tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:55.366529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=12 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:55.483785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=77,nova_cell0:UPDATE=7 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:55.669488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c8a57324-3b52-4295-8060-b4fe6ce69a8b tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:55.686780 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c8a57324-3b52-4295-8060-b4fe6ce69a8b tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871" status: 200 len: 1322 microversion: 2.1 time: 0.574278 Aug 24 10:11:55.691420 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 156/301] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:55 2022] GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871 => generated 1322 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:56.708171 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0291f592-058a-4798-a357-fe8b0ad9502e tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:56.708869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0291f592-058a-4798-a357-fe8b0ad9502e tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 10f639ed-ba2f-4983-9c04-777480733871] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:56.715685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0291f592-058a-4798-a357-fe8b0ad9502e tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:56.718324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0291f592-058a-4798-a357-fe8b0ad9502e tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:56.719710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0291f592-058a-4798-a357-fe8b0ad9502e tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:56.720723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0291f592-058a-4798-a357-fe8b0ad9502e tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:56.722048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0291f592-058a-4798-a357-fe8b0ad9502e tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:56.722862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0291f592-058a-4798-a357-fe8b0ad9502e tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:56.872353 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c0e02da1-1d79-4ab5-ae87-2193e288e0d9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2136956469", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "68027218-9cf0-4391-8ca9-11006ba08a7a"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:56.975583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-c0e02da1-1d79-4ab5-ae87-2193e288e0d9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] validate_networks() for [('68027218-9cf0-4391-8ca9-11006ba08a7a', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:11:57.007643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0291f592-058a-4798-a357-fe8b0ad9502e tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:57.017563 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0291f592-058a-4798-a357-fe8b0ad9502e tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871" status: 200 len: 1472 microversion: 2.1 time: 0.313319 Aug 24 10:11:57.030283 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 157/302] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:56 2022] GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871 => generated 1472 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:57.371231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b638bdd9-47c4-4947-ab50-374259931d56 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1954608948", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:57.455884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-b638bdd9-47c4-4947-ab50-374259931d56 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:11:57.708075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=58 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:57.786788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b638bdd9-47c4-4947-ab50-374259931d56 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:11:57.788308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b638bdd9-47c4-4947-ab50-374259931d56 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:11:57.789593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b638bdd9-47c4-4947-ab50-374259931d56 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:11:57.790233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b638bdd9-47c4-4947-ab50-374259931d56 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:11:57.790829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b638bdd9-47c4-4947-ab50-374259931d56 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:11:57.803340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b638bdd9-47c4-4947-ab50-374259931d56 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:57.804156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b638bdd9-47c4-4947-ab50-374259931d56 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:57.804896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b638bdd9-47c4-4947-ab50-374259931d56 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:57.806055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b638bdd9-47c4-4947-ab50-374259931d56 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:57.806861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b638bdd9-47c4-4947-ab50-374259931d56 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:57.807465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b638bdd9-47c4-4947-ab50-374259931d56 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:57.837691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b638bdd9-47c4-4947-ab50-374259931d56 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:11:57.845494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b638bdd9-47c4-4947-ab50-374259931d56 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for user bf03c0eb5bd748ae85be830f1121dc06 and project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:11:57.861916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=9,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:57.870147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b638bdd9-47c4-4947-ab50-374259931d56 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:11:57.876989 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b638bdd9-47c4-4947-ab50-374259931d56 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: c7ad4cc6-0ddc-47f9-b386-1e0dde47808f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:11:57.988521 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b638bdd9-47c4-4947-ab50-374259931d56 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.956333 Aug 24 10:11:57.997037 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 158/303] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:11:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:11:58.311406 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c0e02da1-1d79-4ab5-ae87-2193e288e0d9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:11:58.312496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c0e02da1-1d79-4ab5-ae87-2193e288e0d9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:11:58.313329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c0e02da1-1d79-4ab5-ae87-2193e288e0d9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:11:58.313923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c0e02da1-1d79-4ab5-ae87-2193e288e0d9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:11:58.314499 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c0e02da1-1d79-4ab5-ae87-2193e288e0d9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:11:58.326045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0e02da1-1d79-4ab5-ae87-2193e288e0d9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:58.327493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0e02da1-1d79-4ab5-ae87-2193e288e0d9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:58.328209 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0e02da1-1d79-4ab5-ae87-2193e288e0d9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:58.330548 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0e02da1-1d79-4ab5-ae87-2193e288e0d9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:58.331289 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0e02da1-1d79-4ab5-ae87-2193e288e0d9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:58.332091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0e02da1-1d79-4ab5-ae87-2193e288e0d9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:58.350608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9,nova_api:UPDATE=2,nova_api:DELETE=5 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:58.375631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-c0e02da1-1d79-4ab5-ae87-2193e288e0d9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Getting quotas for project 34b2b8fc487d4a6abb08f132e0f0c1da. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:11:58.393974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-c0e02da1-1d79-4ab5-ae87-2193e288e0d9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Getting quotas for user dfd26847179f4f2bab0c9f673de0c303 and project 34b2b8fc487d4a6abb08f132e0f0c1da. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:11:58.419575 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c0e02da1-1d79-4ab5-ae87-2193e288e0d9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:11:58.423279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c0e02da1-1d79-4ab5-ae87-2193e288e0d9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:11:58.510069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-694d3aed-233e-47cb-afbe-ca7ec7381b35 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:58.511820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-694d3aed-233e-47cb-afbe-ca7ec7381b35 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] [instance: d4f71ebd-d00a-44ad-ba6e-820271134f80] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:58.516525 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c0e02da1-1d79-4ab5-ae87-2193e288e0d9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.978876 Aug 24 10:11:58.517988 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 146/304] 10.222.0.85 () {62 vars in 1188 bytes} [Wed Aug 24 10:11:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1982 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 10:11:58.524494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ffdffd97-64a6-4b8a-bbe9-b1721070efbe tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:58.525326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ffdffd97-64a6-4b8a-bbe9-b1721070efbe tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: c7ad4cc6-0ddc-47f9-b386-1e0dde47808f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:58.526771 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-694d3aed-233e-47cb-afbe-ca7ec7381b35 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] HTTP exception thrown: Instance d4f71ebd-d00a-44ad-ba6e-820271134f80 could not be found. Aug 24 10:11:58.535015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-694d3aed-233e-47cb-afbe-ca7ec7381b35 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Request method failure captured: Aug 24 10:11:58.535015 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/d4f71ebd-d00a-44ad-ba6e-820271134f80/action HTTP/1.1 Aug 24 10:11:58.535015 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:11:58.535015 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:11:58.535015 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:11:58.535015 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 15 Aug 24 10:11:58.535015 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:11:58.535015 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:11:58.535015 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:11:58.535015 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:11:58.535015 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBflb0DMOekRrSzFqBNwVgqCgG1pmAP2DoCwO7gScv48QEWxoh48Lim2hIHT1Q2eU5R35r47G7MaiobVjvtbyem4drmYY_x5I-T97s3G3C-3weQFPy93wr0UtZdENFdaAwff90DGJol4igz3x1PU_N_iZQVK2Hfpsl52OIyqIA3NFXFY Aug 24 10:11:58.535015 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:11:58.535015 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:11:58.535015 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:11:58.535015 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:11:58.535015 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:11:58.535015 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:11:58.535015 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: af6fefe9606745558ae536b007880b4e Aug 24 10:11:58.535015 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-686592460 Aug 24 10:11:58.535015 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:11:58.535015 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:11:58.536306 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/af6fefe9606745558ae536b007880b4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_af6fefe9606745558ae536b007880b4e", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/af6fefe9606745558ae536b007880b4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/af6fefe9606745558ae536b007880b4e"}]}] Aug 24 10:11:58.536306 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersAdminNegativeTestJSON-686592460 Aug 24 10:11:58.536306 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: af6fefe9606745558ae536b007880b4e Aug 24 10:11:58.536306 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-686592460 Aug 24 10:11:58.536306 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersAdminNegativeTestJSON-686592460-project-admin Aug 24 10:11:58.536306 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:11:58.536306 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:11:58.536306 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: ae7e17af63b9448a8e423085c2c9a99e Aug 24 10:11:58.536306 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersAdminNegativeTestJSON-686592460-project-admin Aug 24 10:11:58.536306 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:11:58.536306 n-d-849328-3 devstack@n-api.service[122433]: {"migrate": {}} Aug 24 10:11:58.536306 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:11:58.536306 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance d4f71ebd-d00a-44ad-ba6e-820271134f80 could not be found. Aug 24 10:11:58.537056 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'd4f71ebd-d00a-44ad-ba6e-820271134f80', 'body': {'migrate': {}}} Aug 24 10:11:58.537056 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:11:58.537056 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:58.537056 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:11:58.537056 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:11:58.537056 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:11:58.537056 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:11:58.537056 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 10:11:58.537056 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 10:11:58.537056 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4f71ebd-d00a-44ad-ba6e-820271134f80 could not be found. Aug 24 10:11:58.537056 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:58.537056 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:58.537056 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:58.537056 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:58.537056 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:58.537056 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:58.537056 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:11:58.537056 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:11:58.537056 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:11:58.537056 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:11:58.538146 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:11:58.538146 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:11:58.538146 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 24 10:11:58.538146 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 24 10:11:58.538146 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:11:58.538146 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:11:58.538146 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4f71ebd-d00a-44ad-ba6e-820271134f80 could not be found. Aug 24 10:11:58.538146 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:58.538146 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:11:58.538146 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:58.538146 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:11:58.538146 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:11:58.538146 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:11:58.538146 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:11:58.538146 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:11:58.538146 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4f71ebd-d00a-44ad-ba6e-820271134f80 could not be found. Aug 24 10:11:58.538146 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:11:58.540984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-694d3aed-233e-47cb-afbe-ca7ec7381b35 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Returning 404 to user: Instance d4f71ebd-d00a-44ad-ba6e-820271134f80 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:11:58.544770 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-694d3aed-233e-47cb-afbe-ca7ec7381b35 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/d4f71ebd-d00a-44ad-ba6e-820271134f80/action" status: 404 len: 111 microversion: 2.1 time: 0.539757 Aug 24 10:11:58.546561 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 159/305] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:11:57 2022] POST /compute/v2.1/servers/d4f71ebd-d00a-44ad-ba6e-820271134f80/action => generated 111 bytes in 549 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:11:58.564447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e06f23b2-f968-4a2a-9927-0e8f5190c8a8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:58.564826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e06f23b2-f968-4a2a-9927-0e8f5190c8a8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:58.674936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e06f23b2-f968-4a2a-9927-0e8f5190c8a8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:58.709172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ffdffd97-64a6-4b8a-bbe9-b1721070efbe tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:58.720373 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e06f23b2-f968-4a2a-9927-0e8f5190c8a8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:58.733100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e06f23b2-f968-4a2a-9927-0e8f5190c8a8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:11:58.750852 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e06f23b2-f968-4a2a-9927-0e8f5190c8a8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 200 len: 1262 microversion: 2.25 time: 0.199096 Aug 24 10:11:58.752915 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ffdffd97-64a6-4b8a-bbe9-b1721070efbe tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f" status: 200 len: 1217 microversion: 2.1 time: 0.229795 Aug 24 10:11:58.754681 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 160/306] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:11:58 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 1262 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:11:58.757346 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 147/307] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:11:58 2022] GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f => generated 1217 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:58.903808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-debb4054-27b9-484b-8d36-eadd0ab0b14f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1652645004", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:11:58.999424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-debb4054-27b9-484b-8d36-eadd0ab0b14f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:11:59.622123 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-debb4054-27b9-484b-8d36-eadd0ab0b14f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:11:59.622755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-debb4054-27b9-484b-8d36-eadd0ab0b14f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:11:59.623447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-debb4054-27b9-484b-8d36-eadd0ab0b14f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:11:59.624098 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-debb4054-27b9-484b-8d36-eadd0ab0b14f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:11:59.624994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-debb4054-27b9-484b-8d36-eadd0ab0b14f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:11:59.644850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-debb4054-27b9-484b-8d36-eadd0ab0b14f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:59.645371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-debb4054-27b9-484b-8d36-eadd0ab0b14f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:59.645857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-debb4054-27b9-484b-8d36-eadd0ab0b14f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:59.646595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-debb4054-27b9-484b-8d36-eadd0ab0b14f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:59.647044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-debb4054-27b9-484b-8d36-eadd0ab0b14f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:59.647465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-debb4054-27b9-484b-8d36-eadd0ab0b14f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:59.700601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-debb4054-27b9-484b-8d36-eadd0ab0b14f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Getting quotas for project 82ddc0c46e914bbd8e265692275f7201. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:11:59.711304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-debb4054-27b9-484b-8d36-eadd0ab0b14f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Getting quotas for user e7f03e78d1af4252b1d32f0b103b6e16 and project 82ddc0c46e914bbd8e265692275f7201. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:11:59.743380 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-debb4054-27b9-484b-8d36-eadd0ab0b14f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:11:59.745593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-debb4054-27b9-484b-8d36-eadd0ab0b14f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 539f1a18-c5df-43d2-8d13-b7315424efb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:11:59.846137 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-debb4054-27b9-484b-8d36-eadd0ab0b14f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.947918 Aug 24 10:11:59.855154 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 161/308] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:11:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:11:59.874564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1f7a0447-dc94-4f3b-afe3-9b03cffb895d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:59.877787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1f7a0447-dc94-4f3b-afe3-9b03cffb895d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:11:59.889494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f7a0447-dc94-4f3b-afe3-9b03cffb895d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:59.894769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f7a0447-dc94-4f3b-afe3-9b03cffb895d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:59.905220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f7a0447-dc94-4f3b-afe3-9b03cffb895d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:11:59.906105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f7a0447-dc94-4f3b-afe3-9b03cffb895d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:11:59.909376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f7a0447-dc94-4f3b-afe3-9b03cffb895d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:11:59.909877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f7a0447-dc94-4f3b-afe3-9b03cffb895d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:00.075137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1f7a0447-dc94-4f3b-afe3-9b03cffb895d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:00.099605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1f7a0447-dc94-4f3b-afe3-9b03cffb895d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:00.111013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1f7a0447-dc94-4f3b-afe3-9b03cffb895d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:00.112474 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1f7a0447-dc94-4f3b-afe3-9b03cffb895d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 200 len: 1258 microversion: 2.25 time: 0.256140 Aug 24 10:12:00.115804 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 162/309] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:11:59 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 1258 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:00.125461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ef5bb26a-e434-44a9-9133-e65929541a5a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:00.127560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ef5bb26a-e434-44a9-9133-e65929541a5a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: c7ad4cc6-0ddc-47f9-b386-1e0dde47808f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:00.138543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef5bb26a-e434-44a9-9133-e65929541a5a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:00.141610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef5bb26a-e434-44a9-9133-e65929541a5a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:00.143433 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef5bb26a-e434-44a9-9133-e65929541a5a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:00.145612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef5bb26a-e434-44a9-9133-e65929541a5a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:00.146460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef5bb26a-e434-44a9-9133-e65929541a5a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:00.149359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef5bb26a-e434-44a9-9133-e65929541a5a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:00.282991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-853bd7f8-9519-4203-a674-7584f8a02afa tempest-FlavorMetadataValidation-1176173202 tempest-FlavorMetadataValidation-1176173202-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1626570634", "id": 54253455, "os-flavor-access:is_public": "True"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:00.292423 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:12:00.292423 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:12:00.382097 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-853bd7f8-9519-4203-a674-7584f8a02afa tempest-FlavorMetadataValidation-1176173202 tempest-FlavorMetadataValidation-1176173202-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.86 time: 0.710219 Aug 24 10:12:00.383171 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 148/310] 10.222.0.85 () {62 vars in 1188 bytes} [Wed Aug 24 10:11:59 2022] POST /compute/v2.1/flavors => generated 465 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:12:00.388480 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ef5bb26a-e434-44a9-9133-e65929541a5a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:00.400727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f6f24cbb-fcae-4d00-840b-1c06705e6fc9 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:00.404698 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ef5bb26a-e434-44a9-9133-e65929541a5a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f" status: 200 len: 1287 microversion: 2.1 time: 0.287583 Aug 24 10:12:00.406541 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 163/311] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:00 2022] GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f => generated 1287 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:00.413820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f6f24cbb-fcae-4d00-840b-1c06705e6fc9 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 539f1a18-c5df-43d2-8d13-b7315424efb2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:00.700226 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f6f24cbb-fcae-4d00-840b-1c06705e6fc9 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:00.716909 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f6f24cbb-fcae-4d00-840b-1c06705e6fc9 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2" status: 200 len: 1222 microversion: 2.1 time: 0.332150 Aug 24 10:12:00.722237 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 149/312] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:00 2022] GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2 => generated 1222 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:00.746307 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-46a83833-1cc5-412e-bf72-3f1c0b6ea2dd tempest-FlavorMetadataValidation-1176173202 tempest-FlavorMetadataValidation-1176173202-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:00.756223 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:12:00.756223 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:12:00.896600 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bc83c022-478b-4e65-834a-b78fee49402f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-481187496", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:01.022367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-bc83c022-478b-4e65-834a-b78fee49402f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:12:01.095224 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-46a83833-1cc5-412e-bf72-3f1c0b6ea2dd tempest-FlavorMetadataValidation-1176173202 tempest-FlavorMetadataValidation-1176173202-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors/54253455/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.367847 Aug 24 10:12:01.097001 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 150/313] 10.222.0.85 () {62 vars in 1259 bytes} [Wed Aug 24 10:12:00 2022] POST /compute/v2.1/flavors/54253455/os-extra_specs => generated 62 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:01.211503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6645acee-5134-4da8-a048-ac39624277de tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1529611425", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:01.370547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-6645acee-5134-4da8-a048-ac39624277de tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:12:02.004912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-bc83c022-478b-4e65-834a-b78fee49402f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:12:02.005405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-bc83c022-478b-4e65-834a-b78fee49402f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:12:02.006114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-bc83c022-478b-4e65-834a-b78fee49402f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:12:02.006710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-bc83c022-478b-4e65-834a-b78fee49402f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:12:02.007872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-bc83c022-478b-4e65-834a-b78fee49402f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:12:02.022963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc83c022-478b-4e65-834a-b78fee49402f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:02.025755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc83c022-478b-4e65-834a-b78fee49402f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:02.028607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc83c022-478b-4e65-834a-b78fee49402f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:02.029811 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc83c022-478b-4e65-834a-b78fee49402f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:02.031233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc83c022-478b-4e65-834a-b78fee49402f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:02.031930 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc83c022-478b-4e65-834a-b78fee49402f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:02.095971 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-bc83c022-478b-4e65-834a-b78fee49402f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Getting quotas for project 12902eb1fd734a189ec5f04a051b30b6. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:12:02.125254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-bc83c022-478b-4e65-834a-b78fee49402f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Getting quotas for user 4cd5610642144fb0b7915285aafc0099 and project 12902eb1fd734a189ec5f04a051b30b6. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:12:02.173387 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bc83c022-478b-4e65-834a-b78fee49402f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:12:02.175923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bc83c022-478b-4e65-834a-b78fee49402f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 9c47edc7-c2c0-43d3-a96a-b779f1d0723c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:12:02.310177 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bc83c022-478b-4e65-834a-b78fee49402f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.901806 Aug 24 10:12:02.312465 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 164/314] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:12:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:12:02.317552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-6645acee-5134-4da8-a048-ac39624277de tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:12:02.318514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-6645acee-5134-4da8-a048-ac39624277de tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:12:02.319415 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-6645acee-5134-4da8-a048-ac39624277de tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:12:02.320043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-6645acee-5134-4da8-a048-ac39624277de tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:12:02.320832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-6645acee-5134-4da8-a048-ac39624277de tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:12:02.325431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3e3ad8be-5c4c-4218-bf9d-781c5fb472d5 tempest-FlavorMetadataValidation-1176173202 tempest-FlavorMetadataValidation-1176173202-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:02.326340 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:12:02.326340 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:12:02.343884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6645acee-5134-4da8-a048-ac39624277de tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:02.344544 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6645acee-5134-4da8-a048-ac39624277de tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:02.352335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6645acee-5134-4da8-a048-ac39624277de tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:02.354106 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6645acee-5134-4da8-a048-ac39624277de tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:02.356777 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6645acee-5134-4da8-a048-ac39624277de tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:02.357807 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6645acee-5134-4da8-a048-ac39624277de tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:02.371110 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3e3ad8be-5c4c-4218-bf9d-781c5fb472d5 tempest-FlavorMetadataValidation-1176173202 tempest-FlavorMetadataValidation-1176173202-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/54253455" status: 202 len: 0 microversion: 2.86 time: 0.057098 Aug 24 10:12:02.377236 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 165/315] 10.222.0.85 () {60 vars in 1196 bytes} [Wed Aug 24 10:12:02 2022] DELETE /compute/v2.1/flavors/54253455 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:12:02.387236 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d49454d1-f834-4ec1-b82c-66d73d4628e6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:02.394315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d49454d1-f834-4ec1-b82c-66d73d4628e6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:02.405742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d49454d1-f834-4ec1-b82c-66d73d4628e6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:02.409750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d49454d1-f834-4ec1-b82c-66d73d4628e6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:02.410471 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d49454d1-f834-4ec1-b82c-66d73d4628e6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:02.410764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-6645acee-5134-4da8-a048-ac39624277de tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Getting quotas for project 7947a063a37946b7870e95dfd7a2e7e6. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:12:02.412312 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d49454d1-f834-4ec1-b82c-66d73d4628e6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:02.414944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d49454d1-f834-4ec1-b82c-66d73d4628e6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:02.415447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d49454d1-f834-4ec1-b82c-66d73d4628e6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:02.418048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-6645acee-5134-4da8-a048-ac39624277de tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Getting quotas for user 53af167c0c744cbb910ff5860767cb95 and project 7947a063a37946b7870e95dfd7a2e7e6. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:12:02.458723 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6645acee-5134-4da8-a048-ac39624277de tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:12:02.461968 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6645acee-5134-4da8-a048-ac39624277de tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:12:02.559946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d49454d1-f834-4ec1-b82c-66d73d4628e6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:02.574376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d49454d1-f834-4ec1-b82c-66d73d4628e6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:02.575160 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6645acee-5134-4da8-a048-ac39624277de tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.475945 Aug 24 10:12:02.581942 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d49454d1-f834-4ec1-b82c-66d73d4628e6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:02.582132 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 151/316] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:12:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:12:02.582215 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d49454d1-f834-4ec1-b82c-66d73d4628e6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 200 len: 1320 microversion: 2.25 time: 0.202863 Aug 24 10:12:02.583755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1de87e99-148b-497f-8135-002249a166aa tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:02.584394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1de87e99-148b-497f-8135-002249a166aa tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: c7ad4cc6-0ddc-47f9-b386-1e0dde47808f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:02.593817 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 166/317] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:02 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 1320 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:02.603299 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1de87e99-148b-497f-8135-002249a166aa tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:02.603866 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1de87e99-148b-497f-8135-002249a166aa tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:02.604310 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1de87e99-148b-497f-8135-002249a166aa tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:02.605041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1de87e99-148b-497f-8135-002249a166aa tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:02.605530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1de87e99-148b-497f-8135-002249a166aa tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:02.606052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1de87e99-148b-497f-8135-002249a166aa tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:02.609495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f273d734-a8b9-43e1-8137-96535609f135 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:02.610371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f273d734-a8b9-43e1-8137-96535609f135 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 539f1a18-c5df-43d2-8d13-b7315424efb2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:02.623452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f273d734-a8b9-43e1-8137-96535609f135 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:02.625928 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f273d734-a8b9-43e1-8137-96535609f135 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:02.626533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f273d734-a8b9-43e1-8137-96535609f135 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:02.627219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f273d734-a8b9-43e1-8137-96535609f135 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:02.627652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f273d734-a8b9-43e1-8137-96535609f135 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:02.628069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f273d734-a8b9-43e1-8137-96535609f135 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:02.762966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f273d734-a8b9-43e1-8137-96535609f135 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:02.775726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:02.791588 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f273d734-a8b9-43e1-8137-96535609f135 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2" status: 200 len: 1280 microversion: 2.1 time: 0.193611 Aug 24 10:12:02.793594 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 167/318] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:02 2022] GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2 => generated 1280 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:02.801136 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bfb3952d-9ecf-4a37-962b-afde0f7b2286 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:02.805742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bfb3952d-9ecf-4a37-962b-afde0f7b2286 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 9c47edc7-c2c0-43d3-a96a-b779f1d0723c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:03.186078 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1de87e99-148b-497f-8135-002249a166aa tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:03.207512 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1de87e99-148b-497f-8135-002249a166aa tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f" status: 200 len: 1275 microversion: 2.1 time: 0.630003 Aug 24 10:12:03.207875 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 152/319] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:02 2022] GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f => generated 1275 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:03.232604 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-de4fee74-6f0a-4b59-bb89-63b27f6765d2 tempest-FlavorMetadataValidation-1176173202 tempest-FlavorMetadataValidation-1176173202-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:03.287277 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-de4fee74-6f0a-4b59-bb89-63b27f6765d2 tempest-FlavorMetadataValidation-1176173202 tempest-FlavorMetadataValidation-1176173202-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 6678 microversion: 2.86 time: 0.058304 Aug 24 10:12:03.298469 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 153/320] 10.222.0.85 () {60 vars in 1187 bytes} [Wed Aug 24 10:12:03 2022] GET /compute/v2.1/flavors/detail => generated 6678 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:03.306182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f69c65f3-4066-4664-a7fa-f7f895a5e758 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:03.311838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f69c65f3-4066-4664-a7fa-f7f895a5e758 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:03.459422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bfb3952d-9ecf-4a37-962b-afde0f7b2286 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:03.479743 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bfb3952d-9ecf-4a37-962b-afde0f7b2286 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c" status: 200 len: 1219 microversion: 2.1 time: 0.684549 Aug 24 10:12:03.480985 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 168/321] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:02 2022] GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c => generated 1219 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:03.610242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-985a0faa-5d6d-4440-9e12-87c468203de3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:03.610971 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-985a0faa-5d6d-4440-9e12-87c468203de3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:03.631561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-985a0faa-5d6d-4440-9e12-87c468203de3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:03.632047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-985a0faa-5d6d-4440-9e12-87c468203de3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:03.632660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-985a0faa-5d6d-4440-9e12-87c468203de3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:03.633578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-985a0faa-5d6d-4440-9e12-87c468203de3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:03.636431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-985a0faa-5d6d-4440-9e12-87c468203de3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:03.637805 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-985a0faa-5d6d-4440-9e12-87c468203de3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:03.647715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f69c65f3-4066-4664-a7fa-f7f895a5e758 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:03.661796 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f69c65f3-4066-4664-a7fa-f7f895a5e758 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1213 microversion: 2.1 time: 0.361610 Aug 24 10:12:03.663820 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 154/322] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:03 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1213 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:03.824129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ea05f43d-75e8-4dc8-a2bd-609b74cdc878 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:03.827732 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ea05f43d-75e8-4dc8-a2bd-609b74cdc878 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 539f1a18-c5df-43d2-8d13-b7315424efb2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:03.840040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea05f43d-75e8-4dc8-a2bd-609b74cdc878 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:03.842899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea05f43d-75e8-4dc8-a2bd-609b74cdc878 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:03.843866 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea05f43d-75e8-4dc8-a2bd-609b74cdc878 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:03.848009 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea05f43d-75e8-4dc8-a2bd-609b74cdc878 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:03.848718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea05f43d-75e8-4dc8-a2bd-609b74cdc878 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:03.850304 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea05f43d-75e8-4dc8-a2bd-609b74cdc878 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:04.069247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ea05f43d-75e8-4dc8-a2bd-609b74cdc878 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:04.088915 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ea05f43d-75e8-4dc8-a2bd-609b74cdc878 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2" status: 200 len: 1280 microversion: 2.1 time: 0.269833 Aug 24 10:12:04.090928 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 155/323] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:03 2022] GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2 => generated 1280 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:12:04.099761 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-985a0faa-5d6d-4440-9e12-87c468203de3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:04.111590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-985a0faa-5d6d-4440-9e12-87c468203de3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:04.115969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-985a0faa-5d6d-4440-9e12-87c468203de3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:04.117423 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-985a0faa-5d6d-4440-9e12-87c468203de3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 200 len: 1362 microversion: 2.25 time: 0.511780 Aug 24 10:12:04.118118 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 169/324] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:03 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 1362 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:04.250597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b6b0ca61-6899-4474-8f9b-dcdf5eeec452 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:04.251255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b6b0ca61-6899-4474-8f9b-dcdf5eeec452 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: c7ad4cc6-0ddc-47f9-b386-1e0dde47808f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:04.278411 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6b0ca61-6899-4474-8f9b-dcdf5eeec452 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:04.281466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6b0ca61-6899-4474-8f9b-dcdf5eeec452 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:04.282234 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6b0ca61-6899-4474-8f9b-dcdf5eeec452 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:04.285155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6b0ca61-6899-4474-8f9b-dcdf5eeec452 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:04.285904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6b0ca61-6899-4474-8f9b-dcdf5eeec452 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:04.286774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6b0ca61-6899-4474-8f9b-dcdf5eeec452 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:04.505772 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-10cf71a3-3abb-4601-ba5d-ecc5f558a5e6 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:04.506960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-10cf71a3-3abb-4601-ba5d-ecc5f558a5e6 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 9c47edc7-c2c0-43d3-a96a-b779f1d0723c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:04.522945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10cf71a3-3abb-4601-ba5d-ecc5f558a5e6 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:04.523998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10cf71a3-3abb-4601-ba5d-ecc5f558a5e6 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:04.524469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10cf71a3-3abb-4601-ba5d-ecc5f558a5e6 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:04.525671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10cf71a3-3abb-4601-ba5d-ecc5f558a5e6 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:04.526181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10cf71a3-3abb-4601-ba5d-ecc5f558a5e6 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:04.526666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10cf71a3-3abb-4601-ba5d-ecc5f558a5e6 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:04.629816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-10cf71a3-3abb-4601-ba5d-ecc5f558a5e6 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:04.663749 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-10cf71a3-3abb-4601-ba5d-ecc5f558a5e6 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c" status: 200 len: 1279 microversion: 2.1 time: 0.162804 Aug 24 10:12:04.665674 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 170/325] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:04 2022] GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c => generated 1279 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:12:04.695990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ce573396-52a2-4fdc-9496-3203ddc1e8ff tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:04.697046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ce573396-52a2-4fdc-9496-3203ddc1e8ff tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:04.714751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce573396-52a2-4fdc-9496-3203ddc1e8ff tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:04.715617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce573396-52a2-4fdc-9496-3203ddc1e8ff tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:04.716277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce573396-52a2-4fdc-9496-3203ddc1e8ff tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:04.717372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce573396-52a2-4fdc-9496-3203ddc1e8ff tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:04.718682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce573396-52a2-4fdc-9496-3203ddc1e8ff tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:04.720484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce573396-52a2-4fdc-9496-3203ddc1e8ff tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:04.995532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ce573396-52a2-4fdc-9496-3203ddc1e8ff tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:05.008637 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ce573396-52a2-4fdc-9496-3203ddc1e8ff tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1265 microversion: 2.1 time: 0.325613 Aug 24 10:12:05.012034 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 171/326] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:04 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1265 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:05.078544 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b6b0ca61-6899-4474-8f9b-dcdf5eeec452 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:05.094366 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b6b0ca61-6899-4474-8f9b-dcdf5eeec452 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f" status: 200 len: 1317 microversion: 2.1 time: 0.865945 Aug 24 10:12:05.098135 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 156/327] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:04 2022] GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f => generated 1317 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:05.120425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c7f88a81-1c72-44ba-803a-e34f6a4ba9ac tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:05.121907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c7f88a81-1c72-44ba-803a-e34f6a4ba9ac tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 539f1a18-c5df-43d2-8d13-b7315424efb2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:05.130089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7f88a81-1c72-44ba-803a-e34f6a4ba9ac tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:05.130891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7f88a81-1c72-44ba-803a-e34f6a4ba9ac tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:05.131754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7f88a81-1c72-44ba-803a-e34f6a4ba9ac tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:05.134865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7f88a81-1c72-44ba-803a-e34f6a4ba9ac tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:05.136291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7f88a81-1c72-44ba-803a-e34f6a4ba9ac tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:05.137668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7f88a81-1c72-44ba-803a-e34f6a4ba9ac tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:05.140232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-261786f9-eb53-454b-bfdb-cf319e7ad51a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:05.141072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-261786f9-eb53-454b-bfdb-cf319e7ad51a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:05.152350 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-261786f9-eb53-454b-bfdb-cf319e7ad51a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:05.161636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-261786f9-eb53-454b-bfdb-cf319e7ad51a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:05.162595 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-261786f9-eb53-454b-bfdb-cf319e7ad51a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:05.163650 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-261786f9-eb53-454b-bfdb-cf319e7ad51a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:05.164323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-261786f9-eb53-454b-bfdb-cf319e7ad51a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:05.164916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-261786f9-eb53-454b-bfdb-cf319e7ad51a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:05.309219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c7f88a81-1c72-44ba-803a-e34f6a4ba9ac tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:05.317294 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c7f88a81-1c72-44ba-803a-e34f6a4ba9ac tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2" status: 200 len: 1280 microversion: 2.1 time: 0.203703 Aug 24 10:12:05.318761 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 172/328] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:05 2022] GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2 => generated 1280 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:12:05.689713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1be491cb-beb7-4aef-897f-1aefc3cc669c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:05.690349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1be491cb-beb7-4aef-897f-1aefc3cc669c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 9c47edc7-c2c0-43d3-a96a-b779f1d0723c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:05.700738 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1be491cb-beb7-4aef-897f-1aefc3cc669c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:05.701258 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1be491cb-beb7-4aef-897f-1aefc3cc669c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:05.701690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1be491cb-beb7-4aef-897f-1aefc3cc669c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:05.704587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1be491cb-beb7-4aef-897f-1aefc3cc669c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:05.705074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1be491cb-beb7-4aef-897f-1aefc3cc669c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:05.705499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1be491cb-beb7-4aef-897f-1aefc3cc669c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:05.743017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-261786f9-eb53-454b-bfdb-cf319e7ad51a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:05.754912 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-261786f9-eb53-454b-bfdb-cf319e7ad51a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:05.759171 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-261786f9-eb53-454b-bfdb-cf319e7ad51a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:05.762124 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-261786f9-eb53-454b-bfdb-cf319e7ad51a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 200 len: 1362 microversion: 2.25 time: 0.625787 Aug 24 10:12:05.777610 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 157/329] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:05 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 1362 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:12:05.871936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1be491cb-beb7-4aef-897f-1aefc3cc669c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:05.887506 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1be491cb-beb7-4aef-897f-1aefc3cc669c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c" status: 200 len: 1277 microversion: 2.1 time: 0.202585 Aug 24 10:12:05.888718 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 173/330] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:05 2022] GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c => generated 1277 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:12:06.041302 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-adecf26e-616a-497f-b0e3-5d86a9bc78d3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:06.042683 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-adecf26e-616a-497f-b0e3-5d86a9bc78d3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:06.055391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adecf26e-616a-497f-b0e3-5d86a9bc78d3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:06.057086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adecf26e-616a-497f-b0e3-5d86a9bc78d3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:06.057838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adecf26e-616a-497f-b0e3-5d86a9bc78d3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:06.058854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adecf26e-616a-497f-b0e3-5d86a9bc78d3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:06.059617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adecf26e-616a-497f-b0e3-5d86a9bc78d3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:06.060790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adecf26e-616a-497f-b0e3-5d86a9bc78d3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:06.126071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-24213dc0-232b-45b5-8ab5-7621ce858b02 req-b5e3be12-735a-4e20-8548-c56f5f90f179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "162790d5-1b97-47d9-b4df-c897b854a902", "tag": "85bbaf28-5677-4b68-aba7-3a4c5c84ab6a"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:06.140482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-24213dc0-232b-45b5-8ab5-7621ce858b02 req-b5e3be12-735a-4e20-8548-c56f5f90f179 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:06.142116 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-24213dc0-232b-45b5-8ab5-7621ce858b02 req-b5e3be12-735a-4e20-8548-c56f5f90f179 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:06.142702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-24213dc0-232b-45b5-8ab5-7621ce858b02 req-b5e3be12-735a-4e20-8548-c56f5f90f179 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:06.171128 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-24213dc0-232b-45b5-8ab5-7621ce858b02 req-b5e3be12-735a-4e20-8548-c56f5f90f179 service nova] Creating event network-changed:85bbaf28-5677-4b68-aba7-3a4c5c84ab6a for instance 162790d5-1b97-47d9-b4df-c897b854a902 on n-h1-849328-3 Aug 24 10:12:06.184906 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-24213dc0-232b-45b5-8ab5-7621ce858b02 req-b5e3be12-735a-4e20-8548-c56f5f90f179 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071575 Aug 24 10:12:06.186129 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 174/331] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:06.194906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1be2b9b7-e6a8-47d0-b8f5-01fe9c6d59e7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:06.197235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1be2b9b7-e6a8-47d0-b8f5-01fe9c6d59e7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: c7ad4cc6-0ddc-47f9-b386-1e0dde47808f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:06.210109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1be2b9b7-e6a8-47d0-b8f5-01fe9c6d59e7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:06.210782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1be2b9b7-e6a8-47d0-b8f5-01fe9c6d59e7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:06.211317 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1be2b9b7-e6a8-47d0-b8f5-01fe9c6d59e7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:06.212795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1be2b9b7-e6a8-47d0-b8f5-01fe9c6d59e7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:06.213381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1be2b9b7-e6a8-47d0-b8f5-01fe9c6d59e7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:06.214143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1be2b9b7-e6a8-47d0-b8f5-01fe9c6d59e7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:06.327475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-adecf26e-616a-497f-b0e3-5d86a9bc78d3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:06.359121 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-adecf26e-616a-497f-b0e3-5d86a9bc78d3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1271 microversion: 2.1 time: 0.322570 Aug 24 10:12:06.360505 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 158/332] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:06 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1271 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:06.366595 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0ccfd045-2943-4d57-bc2b-d4322ee9cc5c tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:06.367459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0ccfd045-2943-4d57-bc2b-d4322ee9cc5c tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 539f1a18-c5df-43d2-8d13-b7315424efb2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:06.384219 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ccfd045-2943-4d57-bc2b-d4322ee9cc5c tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:06.385849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ccfd045-2943-4d57-bc2b-d4322ee9cc5c tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:06.387767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ccfd045-2943-4d57-bc2b-d4322ee9cc5c tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:06.389150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ccfd045-2943-4d57-bc2b-d4322ee9cc5c tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:06.391116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ccfd045-2943-4d57-bc2b-d4322ee9cc5c tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:06.393009 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ccfd045-2943-4d57-bc2b-d4322ee9cc5c tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:07.113083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1be2b9b7-e6a8-47d0-b8f5-01fe9c6d59e7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:07.123968 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1be2b9b7-e6a8-47d0-b8f5-01fe9c6d59e7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f" status: 200 len: 1317 microversion: 2.1 time: 0.935584 Aug 24 10:12:07.124788 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 175/333] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:06 2022] GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f => generated 1317 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:07.142687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aa414caa-c463-4c5e-963d-c400234d7a9e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:07.144963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aa414caa-c463-4c5e-963d-c400234d7a9e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:07.157174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa414caa-c463-4c5e-963d-c400234d7a9e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:07.158225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa414caa-c463-4c5e-963d-c400234d7a9e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:07.159170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa414caa-c463-4c5e-963d-c400234d7a9e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:07.162099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa414caa-c463-4c5e-963d-c400234d7a9e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:07.162965 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa414caa-c463-4c5e-963d-c400234d7a9e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:07.164718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa414caa-c463-4c5e-963d-c400234d7a9e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:07.290163 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0ccfd045-2943-4d57-bc2b-d4322ee9cc5c tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:07.306302 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0ccfd045-2943-4d57-bc2b-d4322ee9cc5c tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2" status: 200 len: 1322 microversion: 2.1 time: 0.944403 Aug 24 10:12:07.307990 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 159/334] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:06 2022] GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2 => generated 1322 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:07.316672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad6f7e99-3c11-4aa1-8dfa-1d4bdc29fadd tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:07.318066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ad6f7e99-3c11-4aa1-8dfa-1d4bdc29fadd tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 9c47edc7-c2c0-43d3-a96a-b779f1d0723c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:07.340928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad6f7e99-3c11-4aa1-8dfa-1d4bdc29fadd tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:07.343375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad6f7e99-3c11-4aa1-8dfa-1d4bdc29fadd tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:07.344495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad6f7e99-3c11-4aa1-8dfa-1d4bdc29fadd tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:07.345566 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad6f7e99-3c11-4aa1-8dfa-1d4bdc29fadd tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:07.346227 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad6f7e99-3c11-4aa1-8dfa-1d4bdc29fadd tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:07.346846 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad6f7e99-3c11-4aa1-8dfa-1d4bdc29fadd tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:07.481223 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ad6f7e99-3c11-4aa1-8dfa-1d4bdc29fadd tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:07.492353 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ad6f7e99-3c11-4aa1-8dfa-1d4bdc29fadd tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c" status: 200 len: 1277 microversion: 2.1 time: 0.182694 Aug 24 10:12:07.494697 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 160/335] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:07 2022] GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c => generated 1277 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:07.504173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-258aed04-64d2-4425-89e9-a0ef837ed36a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:07.505703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-258aed04-64d2-4425-89e9-a0ef837ed36a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:07.522269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-258aed04-64d2-4425-89e9-a0ef837ed36a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:07.522759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-258aed04-64d2-4425-89e9-a0ef837ed36a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:07.523365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-258aed04-64d2-4425-89e9-a0ef837ed36a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:07.524534 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-258aed04-64d2-4425-89e9-a0ef837ed36a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:07.525297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-258aed04-64d2-4425-89e9-a0ef837ed36a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:07.525727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-258aed04-64d2-4425-89e9-a0ef837ed36a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:07.618777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aa414caa-c463-4c5e-963d-c400234d7a9e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:07.627889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aa414caa-c463-4c5e-963d-c400234d7a9e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:07.637957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aa414caa-c463-4c5e-963d-c400234d7a9e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:07.640104 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aa414caa-c463-4c5e-963d-c400234d7a9e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 200 len: 1362 microversion: 2.25 time: 0.514058 Aug 24 10:12:07.640970 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 176/336] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:07 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 1362 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:07.662945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-89475ac1-51d1-4374-bd8b-18d539276bbe req-bb7c09ce-8e48-4979-9190-4a49921495b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7ad4cc6-0ddc-47f9-b386-1e0dde47808f", "tag": "58e03dc7-a396-4e6d-9258-6792561d67a1"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:07.675759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-258aed04-64d2-4425-89e9-a0ef837ed36a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:07.682228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-89475ac1-51d1-4374-bd8b-18d539276bbe req-bb7c09ce-8e48-4979-9190-4a49921495b6 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:07.683084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-89475ac1-51d1-4374-bd8b-18d539276bbe req-bb7c09ce-8e48-4979-9190-4a49921495b6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:07.684289 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-89475ac1-51d1-4374-bd8b-18d539276bbe req-bb7c09ce-8e48-4979-9190-4a49921495b6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:07.689758 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-258aed04-64d2-4425-89e9-a0ef837ed36a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1271 microversion: 2.1 time: 0.192051 Aug 24 10:12:07.694043 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 161/337] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:07 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1271 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:07.710052 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-89475ac1-51d1-4374-bd8b-18d539276bbe req-bb7c09ce-8e48-4979-9190-4a49921495b6 service nova] Creating event network-changed:58e03dc7-a396-4e6d-9258-6792561d67a1 for instance c7ad4cc6-0ddc-47f9-b386-1e0dde47808f on n-h1-849328-3 Aug 24 10:12:07.716767 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-89475ac1-51d1-4374-bd8b-18d539276bbe req-bb7c09ce-8e48-4979-9190-4a49921495b6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056935 Aug 24 10:12:07.717856 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 177/338] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:12:08.150413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2a3fc885-f4ac-4b6b-a89a-7c81d3e81fb7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:08.155073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2a3fc885-f4ac-4b6b-a89a-7c81d3e81fb7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: c7ad4cc6-0ddc-47f9-b386-1e0dde47808f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:08.184474 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a3fc885-f4ac-4b6b-a89a-7c81d3e81fb7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:08.184985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a3fc885-f4ac-4b6b-a89a-7c81d3e81fb7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:08.189264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a3fc885-f4ac-4b6b-a89a-7c81d3e81fb7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:08.191893 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a3fc885-f4ac-4b6b-a89a-7c81d3e81fb7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:08.192958 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a3fc885-f4ac-4b6b-a89a-7c81d3e81fb7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:08.193830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a3fc885-f4ac-4b6b-a89a-7c81d3e81fb7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:08.335657 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-36c11994-1fdc-4d3b-a767-fae3c38bf953 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:08.337288 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-36c11994-1fdc-4d3b-a767-fae3c38bf953 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 539f1a18-c5df-43d2-8d13-b7315424efb2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:08.352531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36c11994-1fdc-4d3b-a767-fae3c38bf953 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:08.353977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36c11994-1fdc-4d3b-a767-fae3c38bf953 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:08.354891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36c11994-1fdc-4d3b-a767-fae3c38bf953 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:08.366119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36c11994-1fdc-4d3b-a767-fae3c38bf953 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:08.367428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36c11994-1fdc-4d3b-a767-fae3c38bf953 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:08.367428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36c11994-1fdc-4d3b-a767-fae3c38bf953 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:08.478115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2a3fc885-f4ac-4b6b-a89a-7c81d3e81fb7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:08.488615 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2a3fc885-f4ac-4b6b-a89a-7c81d3e81fb7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f" status: 200 len: 1317 microversion: 2.1 time: 0.345117 Aug 24 10:12:08.498821 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 162/339] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:08 2022] GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:08.522899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bbdd94e6-cffb-4c92-b616-c258e36b2e0c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:08.523773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bbdd94e6-cffb-4c92-b616-c258e36b2e0c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 9c47edc7-c2c0-43d3-a96a-b779f1d0723c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:08.536426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbdd94e6-cffb-4c92-b616-c258e36b2e0c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:08.540974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbdd94e6-cffb-4c92-b616-c258e36b2e0c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:08.541798 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbdd94e6-cffb-4c92-b616-c258e36b2e0c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:08.542815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbdd94e6-cffb-4c92-b616-c258e36b2e0c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:08.543280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbdd94e6-cffb-4c92-b616-c258e36b2e0c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:08.543875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbdd94e6-cffb-4c92-b616-c258e36b2e0c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:08.759711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-36c11994-1fdc-4d3b-a767-fae3c38bf953 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:08.778204 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-36c11994-1fdc-4d3b-a767-fae3c38bf953 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2" status: 200 len: 1322 microversion: 2.1 time: 0.449196 Aug 24 10:12:08.779049 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 178/340] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:08 2022] GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2 => generated 1322 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:08.786321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fdd616c4-a96d-4b63-b2bc-497bb927b1eb tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:08.787195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fdd616c4-a96d-4b63-b2bc-497bb927b1eb tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:08.802172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdd616c4-a96d-4b63-b2bc-497bb927b1eb tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:08.804346 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdd616c4-a96d-4b63-b2bc-497bb927b1eb tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:08.804950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdd616c4-a96d-4b63-b2bc-497bb927b1eb tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:08.806773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdd616c4-a96d-4b63-b2bc-497bb927b1eb tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:08.813583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdd616c4-a96d-4b63-b2bc-497bb927b1eb tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:08.814287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdd616c4-a96d-4b63-b2bc-497bb927b1eb tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:09.164906 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bbdd94e6-cffb-4c92-b616-c258e36b2e0c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:09.181312 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bbdd94e6-cffb-4c92-b616-c258e36b2e0c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c" status: 200 len: 1319 microversion: 2.1 time: 0.663056 Aug 24 10:12:09.182231 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 163/341] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:08 2022] GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c => generated 1319 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:12:09.187288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2791d18b-da01-4b2d-b99b-710afceed63d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:09.189843 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2791d18b-da01-4b2d-b99b-710afceed63d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:09.204742 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2791d18b-da01-4b2d-b99b-710afceed63d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:09.205524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2791d18b-da01-4b2d-b99b-710afceed63d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:09.206193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2791d18b-da01-4b2d-b99b-710afceed63d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:09.207175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2791d18b-da01-4b2d-b99b-710afceed63d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:09.207830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2791d18b-da01-4b2d-b99b-710afceed63d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:09.217976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2791d18b-da01-4b2d-b99b-710afceed63d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:09.593374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fdd616c4-a96d-4b63-b2bc-497bb927b1eb tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:09.606572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fdd616c4-a96d-4b63-b2bc-497bb927b1eb tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:09.608540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fdd616c4-a96d-4b63-b2bc-497bb927b1eb tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:09.615992 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fdd616c4-a96d-4b63-b2bc-497bb927b1eb tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 200 len: 1362 microversion: 2.25 time: 0.833474 Aug 24 10:12:09.619418 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 179/342] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:08 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 1362 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:09.633073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f6754091-d891-445b-a2bf-3aa6cecab068 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:09.636108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f6754091-d891-445b-a2bf-3aa6cecab068 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: c7ad4cc6-0ddc-47f9-b386-1e0dde47808f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:09.653113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6754091-d891-445b-a2bf-3aa6cecab068 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:09.655625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6754091-d891-445b-a2bf-3aa6cecab068 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:09.658081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6754091-d891-445b-a2bf-3aa6cecab068 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:09.663059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6754091-d891-445b-a2bf-3aa6cecab068 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:09.663782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6754091-d891-445b-a2bf-3aa6cecab068 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:09.666275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6754091-d891-445b-a2bf-3aa6cecab068 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:09.791644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2791d18b-da01-4b2d-b99b-710afceed63d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:09.803654 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2791d18b-da01-4b2d-b99b-710afceed63d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1313 microversion: 2.1 time: 0.620169 Aug 24 10:12:09.812173 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 164/343] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:09 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1313 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:09.849385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-346a9996-b44e-4af3-b5db-a47c1fac72c7 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:09.850790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-346a9996-b44e-4af3-b5db-a47c1fac72c7 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 539f1a18-c5df-43d2-8d13-b7315424efb2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:09.875796 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-346a9996-b44e-4af3-b5db-a47c1fac72c7 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:09.876730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-346a9996-b44e-4af3-b5db-a47c1fac72c7 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:09.877383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-346a9996-b44e-4af3-b5db-a47c1fac72c7 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:09.881418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-346a9996-b44e-4af3-b5db-a47c1fac72c7 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:09.881905 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-346a9996-b44e-4af3-b5db-a47c1fac72c7 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:09.882341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-346a9996-b44e-4af3-b5db-a47c1fac72c7 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:10.114129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-346a9996-b44e-4af3-b5db-a47c1fac72c7 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:10.133758 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-346a9996-b44e-4af3-b5db-a47c1fac72c7 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2" status: 200 len: 1322 microversion: 2.1 time: 0.319965 Aug 24 10:12:10.136105 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 165/344] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:09 2022] GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2 => generated 1322 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:10.203455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-77f67083-d15e-416e-a9e2-a5f3598f623e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:10.204449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-77f67083-d15e-416e-a9e2-a5f3598f623e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 9c47edc7-c2c0-43d3-a96a-b779f1d0723c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:10.215603 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77f67083-d15e-416e-a9e2-a5f3598f623e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:10.216111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77f67083-d15e-416e-a9e2-a5f3598f623e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:10.216557 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77f67083-d15e-416e-a9e2-a5f3598f623e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:10.217317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77f67083-d15e-416e-a9e2-a5f3598f623e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:10.217872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77f67083-d15e-416e-a9e2-a5f3598f623e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:10.218190 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77f67083-d15e-416e-a9e2-a5f3598f623e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:10.233829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:10.327082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f6754091-d891-445b-a2bf-3aa6cecab068 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:10.338617 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f6754091-d891-445b-a2bf-3aa6cecab068 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f" status: 200 len: 1317 microversion: 2.1 time: 0.714448 Aug 24 10:12:10.356632 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 180/345] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:09 2022] GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f => generated 1317 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:10.364660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-99f63beb-2d74-4fce-9747-2587b001dbe4 req-e5b071a7-7f3e-4084-9c94-31712e62bbfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "539f1a18-c5df-43d2-8d13-b7315424efb2", "tag": "d55b2cba-ada4-4603-9eb5-de790963c453"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:10.380256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-99f63beb-2d74-4fce-9747-2587b001dbe4 req-e5b071a7-7f3e-4084-9c94-31712e62bbfd service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:10.382191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-99f63beb-2d74-4fce-9747-2587b001dbe4 req-e5b071a7-7f3e-4084-9c94-31712e62bbfd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:10.382913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-99f63beb-2d74-4fce-9747-2587b001dbe4 req-e5b071a7-7f3e-4084-9c94-31712e62bbfd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:10.420941 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-99f63beb-2d74-4fce-9747-2587b001dbe4 req-e5b071a7-7f3e-4084-9c94-31712e62bbfd service nova] Creating event network-changed:d55b2cba-ada4-4603-9eb5-de790963c453 for instance 539f1a18-c5df-43d2-8d13-b7315424efb2 on n-h2-849328-3 Aug 24 10:12:10.432017 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-99f63beb-2d74-4fce-9747-2587b001dbe4 req-e5b071a7-7f3e-4084-9c94-31712e62bbfd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073031 Aug 24 10:12:10.434121 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 181/346] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:10.644286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f6f0a6e2-adb8-488f-9839-e10f64732bc8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:10.647379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f6f0a6e2-adb8-488f-9839-e10f64732bc8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:10.662617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6f0a6e2-adb8-488f-9839-e10f64732bc8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:10.663423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6f0a6e2-adb8-488f-9839-e10f64732bc8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:10.664034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6f0a6e2-adb8-488f-9839-e10f64732bc8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:10.665611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6f0a6e2-adb8-488f-9839-e10f64732bc8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:10.666542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6f0a6e2-adb8-488f-9839-e10f64732bc8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:10.667114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6f0a6e2-adb8-488f-9839-e10f64732bc8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:10.688012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-77f67083-d15e-416e-a9e2-a5f3598f623e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:10.708465 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-77f67083-d15e-416e-a9e2-a5f3598f623e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c" status: 200 len: 1319 microversion: 2.1 time: 0.506455 Aug 24 10:12:10.714570 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 166/347] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:10 2022] GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c => generated 1319 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:10.834059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fb25ea75-fe15-4b6d-a95c-b67a32be8bae tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:10.836255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fb25ea75-fe15-4b6d-a95c-b67a32be8bae tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:10.846518 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb25ea75-fe15-4b6d-a95c-b67a32be8bae tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:10.853667 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb25ea75-fe15-4b6d-a95c-b67a32be8bae tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:10.857626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb25ea75-fe15-4b6d-a95c-b67a32be8bae tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:10.858592 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb25ea75-fe15-4b6d-a95c-b67a32be8bae tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:10.860197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb25ea75-fe15-4b6d-a95c-b67a32be8bae tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:10.860826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb25ea75-fe15-4b6d-a95c-b67a32be8bae tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:11.342112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f6f0a6e2-adb8-488f-9839-e10f64732bc8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:11.355534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f6f0a6e2-adb8-488f-9839-e10f64732bc8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:11.357071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f6f0a6e2-adb8-488f-9839-e10f64732bc8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:11.358288 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f6f0a6e2-adb8-488f-9839-e10f64732bc8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 200 len: 1362 microversion: 2.25 time: 0.721947 Aug 24 10:12:11.369524 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 182/348] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:10 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 1362 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:11.624936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2b7f78d7-d772-4b3f-be9d-e33826416f01 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-165692120", "ram": 512, "vcpus": 1, "disk": 10, "id": 1896597635, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:11.629680 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:12:11.629680 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:12:11.649247 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2b7f78d7-d772-4b3f-be9d-e33826416f01 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.277814 Aug 24 10:12:11.651023 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 183/349] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:12:11 2022] POST /compute/v2.1/flavors => generated 415 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:11.655996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-876a85bd-a37c-4421-933e-6f6f590146e9 req-359b6ca7-d4cd-45b5-be17-a8656f196cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c47edc7-c2c0-43d3-a96a-b779f1d0723c", "tag": "72420fbc-8d93-4dca-b4e0-67240b59047b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:11.676920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-876a85bd-a37c-4421-933e-6f6f590146e9 req-359b6ca7-d4cd-45b5-be17-a8656f196cc9 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:11.677741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-876a85bd-a37c-4421-933e-6f6f590146e9 req-359b6ca7-d4cd-45b5-be17-a8656f196cc9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:11.678338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-876a85bd-a37c-4421-933e-6f6f590146e9 req-359b6ca7-d4cd-45b5-be17-a8656f196cc9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:11.691520 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-876a85bd-a37c-4421-933e-6f6f590146e9 req-359b6ca7-d4cd-45b5-be17-a8656f196cc9 service nova] Creating event network-changed:72420fbc-8d93-4dca-b4e0-67240b59047b for instance 9c47edc7-c2c0-43d3-a96a-b779f1d0723c on n-h2-849328-3 Aug 24 10:12:11.700447 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-876a85bd-a37c-4421-933e-6f6f590146e9 req-359b6ca7-d4cd-45b5-be17-a8656f196cc9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047893 Aug 24 10:12:11.701754 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 184/350] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:11.716192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-971b9267-d818-48f1-9157-d24ddb5f2a2a tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:11.717442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-971b9267-d818-48f1-9157-d24ddb5f2a2a tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 539f1a18-c5df-43d2-8d13-b7315424efb2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:11.728694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-971b9267-d818-48f1-9157-d24ddb5f2a2a tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:11.731229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-971b9267-d818-48f1-9157-d24ddb5f2a2a tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:11.734044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-971b9267-d818-48f1-9157-d24ddb5f2a2a tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:11.735641 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-971b9267-d818-48f1-9157-d24ddb5f2a2a tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:11.736381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-971b9267-d818-48f1-9157-d24ddb5f2a2a tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:11.737429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-971b9267-d818-48f1-9157-d24ddb5f2a2a tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:11.775204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fb25ea75-fe15-4b6d-a95c-b67a32be8bae tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:11.788639 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fb25ea75-fe15-4b6d-a95c-b67a32be8bae tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1313 microversion: 2.1 time: 0.961713 Aug 24 10:12:11.797840 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 167/351] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:10 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1313 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:12:11.804205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-78cf631f-85fe-4266-bb54-a51285dda6f7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:11.808064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-78cf631f-85fe-4266-bb54-a51285dda6f7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: c7ad4cc6-0ddc-47f9-b386-1e0dde47808f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:11.828296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78cf631f-85fe-4266-bb54-a51285dda6f7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:11.828851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78cf631f-85fe-4266-bb54-a51285dda6f7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:11.829533 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78cf631f-85fe-4266-bb54-a51285dda6f7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:11.833342 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78cf631f-85fe-4266-bb54-a51285dda6f7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:11.835218 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78cf631f-85fe-4266-bb54-a51285dda6f7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:11.835807 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78cf631f-85fe-4266-bb54-a51285dda6f7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:12.061322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:12.254682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-78cf631f-85fe-4266-bb54-a51285dda6f7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:12.266118 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-78cf631f-85fe-4266-bb54-a51285dda6f7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f" status: 200 len: 1317 microversion: 2.1 time: 0.466753 Aug 24 10:12:12.266775 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 168/352] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:11 2022] GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f => generated 1317 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:12.270246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-971b9267-d818-48f1-9157-d24ddb5f2a2a tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:12.280297 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-971b9267-d818-48f1-9157-d24ddb5f2a2a tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2" status: 200 len: 1322 microversion: 2.1 time: 0.577030 Aug 24 10:12:12.282855 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 185/353] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:11 2022] GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2 => generated 1322 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:12.298469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5f8ad925-e6c1-4c68-8249-a2a32260f847 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:12.299317 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5f8ad925-e6c1-4c68-8249-a2a32260f847 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 9c47edc7-c2c0-43d3-a96a-b779f1d0723c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:12.306281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=10,nova_api:DELETE=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:12.316794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f8ad925-e6c1-4c68-8249-a2a32260f847 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:12.318817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f8ad925-e6c1-4c68-8249-a2a32260f847 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:12.319341 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f8ad925-e6c1-4c68-8249-a2a32260f847 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:12.321691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f8ad925-e6c1-4c68-8249-a2a32260f847 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:12.322651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f8ad925-e6c1-4c68-8249-a2a32260f847 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:12.323274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f8ad925-e6c1-4c68-8249-a2a32260f847 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:12.391563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=25 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:12.560427 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5f8ad925-e6c1-4c68-8249-a2a32260f847 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:12.563808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-70e0e5f2-8eba-4100-b904-772874141d29 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:12.570421 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5f8ad925-e6c1-4c68-8249-a2a32260f847 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c" status: 200 len: 1319 microversion: 2.1 time: 0.286167 Aug 24 10:12:12.581450 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-70e0e5f2-8eba-4100-b904-772874141d29 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225-project] HTTP exception thrown: Flavor 1896597635 has no extra specs with key hw:cpu_thread_policy. Aug 24 10:12:12.582206 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 186/354] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:12 2022] GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c => generated 1319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:12.583918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-70e0e5f2-8eba-4100-b904-772874141d29 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225-project] Request method failure captured: Aug 24 10:12:12.583918 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/flavors/1896597635/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 24 10:12:12.583918 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:12:12.583918 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:12:12.583918 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:12:12.583918 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:12:12.583918 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:12:12.583918 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:12:12.583918 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:12:12.583918 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:12:12.583918 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfl5nG4sn49qs1z0n2ha3mMxilKr3f5kBFNMxDE5ekMV4ZgEVoVSbUcELl_cLB7lrLpnxGvwMyy0fLXIkxqmSae6yZdSjoZo6ZIELJ03R28uKcOxrjqcbAQxJA93opeWVCHTzZJqGfmuQiwcm9zi8fkYKGCUsUjibrvY8jRVpwj9bno Aug 24 10:12:12.583918 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:12:12.583918 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:12:12.583918 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:12:12.583918 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:12:12.583918 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:12:12.583918 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:12:12.583918 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 59bdef0bb5bf433abe22a0c7e754ca9b Aug 24 10:12:12.583918 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 Aug 24 10:12:12.583918 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:12:12.583918 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:12:12.585549 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/59bdef0bb5bf433abe22a0c7e754ca9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_59bdef0bb5bf433abe22a0c7e754ca9b", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/59bdef0bb5bf433abe22a0c7e754ca9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/59bdef0bb5bf433abe22a0c7e754ca9b"}]}] Aug 24 10:12:12.585549 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 Aug 24 10:12:12.585549 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 59bdef0bb5bf433abe22a0c7e754ca9b Aug 24 10:12:12.585549 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 Aug 24 10:12:12.585549 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-169564225-project Aug 24 10:12:12.585549 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:12:12.585549 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:12:12.585549 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 7655dcd1233449a0b555b1588be93028 Aug 24 10:12:12.585549 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-169564225-project Aug 24 10:12:12.585549 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:12:12.585549 n-d-849328-3 devstack@n-api.service[122432]: exception: Flavor 1896597635 has no extra specs with key hw:cpu_thread_policy. Aug 24 10:12:12.586230 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'flavor_id': '1896597635', 'id': 'hw:cpu_thread_policy'} Aug 24 10:12:12.586230 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:12:12.586230 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:12.586230 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 24 10:12:12.586230 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 24 10:12:12.586230 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 24 10:12:12.586230 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.586230 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:12.586230 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.586230 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:12.586230 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:12.586230 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:12.586230 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:12:12.586230 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:12:12.586230 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:12:12.586230 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:12:12.586230 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 24 10:12:12.586230 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 10:12:12.586230 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1896597635 has no extra specs with key hw:cpu_thread_policy. Aug 24 10:12:12.586230 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.586230 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:12.586230 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.587489 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:12.587489 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:12.587489 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:12.587489 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:12:12.587489 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:12:12.587489 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1896597635 has no extra specs with key hw:cpu_thread_policy. Aug 24 10:12:12.587489 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.590594 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-70e0e5f2-8eba-4100-b904-772874141d29 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225-project] Returning 404 to user: Flavor 1896597635 has no extra specs with key hw:cpu_thread_policy. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:12:12.591387 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-70e0e5f2-8eba-4100-b904-772874141d29 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225-project] 10.222.0.85 "GET /compute/v2.1/flavors/1896597635/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.321854 Aug 24 10:12:12.591966 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 169/355] 10.222.0.85 () {58 vars in 1266 bytes} [Wed Aug 24 10:12:12 2022] GET /compute/v2.1/flavors/1896597635/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 324 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:12:12.597109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-94e5c941-9007-4aa3-aa55-37ef0e3aeea7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:12.597386 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-94e5c941-9007-4aa3-aa55-37ef0e3aeea7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:12.603150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e1b1374-166e-4978-a4a7-f914fddb0e01 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:12.607528 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:12:12.607528 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:12:12.609484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6e1b1374-166e-4978-a4a7-f914fddb0e01 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '7655dcd1233449a0b555b1588be93028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59bdef0bb5bf433abe22a0c7e754ca9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:12.611251 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94e5c941-9007-4aa3-aa55-37ef0e3aeea7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:12.611759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94e5c941-9007-4aa3-aa55-37ef0e3aeea7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:12.611997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e1b1374-166e-4978-a4a7-f914fddb0e01 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225-project] Request method failure captured: Aug 24 10:12:12.611997 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/flavors/1896597635/os-extra_specs HTTP/1.1 Aug 24 10:12:12.611997 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:12:12.611997 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:12:12.611997 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:12:12.611997 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 66 Aug 24 10:12:12.611997 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:12:12.611997 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:12:12.611997 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:12:12.611997 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:12:12.611997 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfl5nG4sn49qs1z0n2ha3mMxilKr3f5kBFNMxDE5ekMV4ZgEVoVSbUcELl_cLB7lrLpnxGvwMyy0fLXIkxqmSae6yZdSjoZo6ZIELJ03R28uKcOxrjqcbAQxJA93opeWVCHTzZJqGfmuQiwcm9zi8fkYKGCUsUjibrvY8jRVpwj9bno Aug 24 10:12:12.611997 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:12:12.611997 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:12:12.611997 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:12:12.611997 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:12:12.611997 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:12:12.611997 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:12:12.611997 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 59bdef0bb5bf433abe22a0c7e754ca9b Aug 24 10:12:12.611997 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 Aug 24 10:12:12.611997 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:12:12.611997 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:12:12.613173 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/59bdef0bb5bf433abe22a0c7e754ca9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_59bdef0bb5bf433abe22a0c7e754ca9b", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/59bdef0bb5bf433abe22a0c7e754ca9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/59bdef0bb5bf433abe22a0c7e754ca9b"}]}] Aug 24 10:12:12.613173 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 Aug 24 10:12:12.613173 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 59bdef0bb5bf433abe22a0c7e754ca9b Aug 24 10:12:12.613173 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 Aug 24 10:12:12.613173 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-169564225-project Aug 24 10:12:12.613173 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:12:12.613173 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:12:12.613173 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 7655dcd1233449a0b555b1588be93028 Aug 24 10:12:12.613173 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-169564225-project Aug 24 10:12:12.613173 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:12:12.613173 n-d-849328-3 devstack@n-api.service[122432]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 24 10:12:12.613173 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:12:12.613863 n-d-849328-3 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 24 10:12:12.613863 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'flavor_id': '1896597635', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 24 10:12:12.613863 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:12:12.613863 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:12.613863 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:12.613863 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:12.613863 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:12:12.613863 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:12:12.613863 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:12:12.613863 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:12:12.613863 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:12:12.613863 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:12:12.613863 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 24 10:12:12.613863 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 24 10:12:12.613863 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:12:12.613863 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:12:12.613863 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:12:12.613863 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:12:12.613863 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:12:12.615158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:12:12.615158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:12:12.615158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:12:12.615158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:12:12.615158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:12:12.615158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:12:12.615158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:12:12.615158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:12:12.615158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:12:12.615158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 24 10:12:12.615158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.615158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:12.615158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.615158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:12.615158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:12.615158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:12.615158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:12:12.615158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:12:12.615158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 24 10:12:12.615158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.616995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94e5c941-9007-4aa3-aa55-37ef0e3aeea7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:12.616995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94e5c941-9007-4aa3-aa55-37ef0e3aeea7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:12.616995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94e5c941-9007-4aa3-aa55-37ef0e3aeea7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:12.616995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94e5c941-9007-4aa3-aa55-37ef0e3aeea7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:12.620275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e1b1374-166e-4978-a4a7-f914fddb0e01 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:12:12.621461 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6e1b1374-166e-4978-a4a7-f914fddb0e01 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225-project] 10.222.0.85 "POST /compute/v2.1/flavors/1896597635/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.022733 Aug 24 10:12:12.622854 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 170/356] 10.222.0.85 () {60 vars in 1224 bytes} [Wed Aug 24 10:12:12 2022] POST /compute/v2.1/flavors/1896597635/os-extra_specs => generated 124 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:12:12.633017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b45072b5-4369-4a5e-964a-27d7313985bd tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:12.660131 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=11,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:12.670909 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b45072b5-4369-4a5e-964a-27d7313985bd tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors/1896597635/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041230 Aug 24 10:12:12.675418 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 171/357] 10.222.0.85 () {60 vars in 1224 bytes} [Wed Aug 24 10:12:12 2022] POST /compute/v2.1/flavors/1896597635/os-extra_specs => generated 66 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:12:12.687241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-91adc1d9-b7d7-470d-b390-f497167ca2a8 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:12.688262 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:12:12.688262 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:12:12.689503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-91adc1d9-b7d7-470d-b390-f497167ca2a8 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '7655dcd1233449a0b555b1588be93028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59bdef0bb5bf433abe22a0c7e754ca9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:12.691285 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-91adc1d9-b7d7-470d-b390-f497167ca2a8 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225-project] Request method failure captured: Aug 24 10:12:12.691285 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/flavors/1896597635/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 24 10:12:12.691285 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:12:12.691285 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:12:12.691285 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:12:12.691285 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:12:12.691285 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:12:12.691285 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:12:12.691285 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:12:12.691285 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:12:12.691285 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfl5nG4sn49qs1z0n2ha3mMxilKr3f5kBFNMxDE5ekMV4ZgEVoVSbUcELl_cLB7lrLpnxGvwMyy0fLXIkxqmSae6yZdSjoZo6ZIELJ03R28uKcOxrjqcbAQxJA93opeWVCHTzZJqGfmuQiwcm9zi8fkYKGCUsUjibrvY8jRVpwj9bno Aug 24 10:12:12.691285 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:12:12.691285 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:12:12.691285 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:12:12.691285 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:12:12.691285 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:12:12.691285 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:12:12.691285 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 59bdef0bb5bf433abe22a0c7e754ca9b Aug 24 10:12:12.691285 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 Aug 24 10:12:12.691285 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:12:12.691285 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:12:12.692481 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/59bdef0bb5bf433abe22a0c7e754ca9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_59bdef0bb5bf433abe22a0c7e754ca9b", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/59bdef0bb5bf433abe22a0c7e754ca9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/59bdef0bb5bf433abe22a0c7e754ca9b"}]}] Aug 24 10:12:12.692481 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 Aug 24 10:12:12.692481 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 59bdef0bb5bf433abe22a0c7e754ca9b Aug 24 10:12:12.692481 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 Aug 24 10:12:12.692481 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-169564225-project Aug 24 10:12:12.692481 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:12:12.692481 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:12:12.692481 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 7655dcd1233449a0b555b1588be93028 Aug 24 10:12:12.692481 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-169564225-project Aug 24 10:12:12.692481 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:12:12.692481 n-d-849328-3 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 24 10:12:12.693092 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'flavor_id': '1896597635', 'id': 'hw:numa_nodes'} Aug 24 10:12:12.693092 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:12:12.693092 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:12.693092 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:12.693092 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:12.693092 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:12:12.693092 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:12:12.693092 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:12:12.693092 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:12:12.693092 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 24 10:12:12.693092 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 24 10:12:12.693092 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:12:12.693092 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:12:12.693092 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:12:12.693092 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:12:12.693092 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:12:12.693092 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:12:12.693092 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:12:12.693092 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:12:12.693092 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:12:12.694460 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:12:12.694460 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:12:12.694460 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:12:12.694460 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:12:12.694460 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:12:12.694460 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 24 10:12:12.694460 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.694460 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:12.694460 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.694460 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:12.694460 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:12.694460 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:12.694460 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:12:12.694460 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:12:12.694460 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 24 10:12:12.694460 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.697229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-91adc1d9-b7d7-470d-b390-f497167ca2a8 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:12:12.698381 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-91adc1d9-b7d7-470d-b390-f497167ca2a8 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225-project] 10.222.0.85 "DELETE /compute/v2.1/flavors/1896597635/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.015784 Aug 24 10:12:12.699204 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 172/358] 10.222.0.85 () {58 vars in 1248 bytes} [Wed Aug 24 10:12:12 2022] DELETE /compute/v2.1/flavors/1896597635/os-extra_specs/hw:numa_nodes => generated 124 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:12:12.709626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bbe57934-29c8-4ddf-b5fd-d07d9efaed37 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:12.752306 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bbe57934-29c8-4ddf-b5fd-d07d9efaed37 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors/1896597635/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.047201 Aug 24 10:12:12.753899 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 173/359] 10.222.0.85 () {60 vars in 1224 bytes} [Wed Aug 24 10:12:12 2022] POST /compute/v2.1/flavors/1896597635/os-extra_specs => generated 66 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 10:12:12.768136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-db96487c-5ce7-451f-8889-eac8acb4da5f tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:12.775708 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:12:12.775708 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:12:12.777336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-db96487c-5ce7-451f-8889-eac8acb4da5f tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '7655dcd1233449a0b555b1588be93028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59bdef0bb5bf433abe22a0c7e754ca9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:12.779770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-db96487c-5ce7-451f-8889-eac8acb4da5f tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225-project] Request method failure captured: Aug 24 10:12:12.779770 n-d-849328-3 devstack@n-api.service[122432]: request: PUT /compute/v2.1/flavors/1896597635/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 24 10:12:12.779770 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:12:12.779770 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:12:12.779770 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:12:12.779770 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 22 Aug 24 10:12:12.779770 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:12:12.779770 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:12:12.779770 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:12:12.779770 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:12:12.779770 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfl5nG4sn49qs1z0n2ha3mMxilKr3f5kBFNMxDE5ekMV4ZgEVoVSbUcELl_cLB7lrLpnxGvwMyy0fLXIkxqmSae6yZdSjoZo6ZIELJ03R28uKcOxrjqcbAQxJA93opeWVCHTzZJqGfmuQiwcm9zi8fkYKGCUsUjibrvY8jRVpwj9bno Aug 24 10:12:12.779770 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:12:12.779770 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:12:12.779770 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:12:12.779770 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:12:12.779770 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:12:12.779770 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:12:12.779770 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 59bdef0bb5bf433abe22a0c7e754ca9b Aug 24 10:12:12.779770 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 Aug 24 10:12:12.779770 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:12:12.779770 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:12:12.781081 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/59bdef0bb5bf433abe22a0c7e754ca9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_59bdef0bb5bf433abe22a0c7e754ca9b", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/59bdef0bb5bf433abe22a0c7e754ca9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/59bdef0bb5bf433abe22a0c7e754ca9b"}]}] Aug 24 10:12:12.781081 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 Aug 24 10:12:12.781081 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 59bdef0bb5bf433abe22a0c7e754ca9b Aug 24 10:12:12.781081 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 Aug 24 10:12:12.781081 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-169564225-project Aug 24 10:12:12.781081 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:12:12.781081 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:12:12.781081 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 7655dcd1233449a0b555b1588be93028 Aug 24 10:12:12.781081 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-169564225-project Aug 24 10:12:12.781081 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:12:12.781081 n-d-849328-3 devstack@n-api.service[122432]: {"hw:numa_nodes": "1"} Aug 24 10:12:12.781081 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:12:12.781081 n-d-849328-3 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 24 10:12:12.781831 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'flavor_id': '1896597635', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 24 10:12:12.781831 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:12:12.781831 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:12.781831 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:12.781831 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:12.781831 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:12:12.781831 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:12:12.781831 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:12:12.781831 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:12:12.781831 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:12:12.781831 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:12:12.781831 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 24 10:12:12.781831 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 24 10:12:12.781831 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:12:12.781831 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:12:12.781831 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:12:12.781831 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:12:12.781831 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:12:12.781831 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:12:12.782967 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:12:12.782967 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:12:12.782967 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:12:12.782967 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:12:12.782967 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:12:12.782967 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:12:12.782967 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:12:12.782967 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:12:12.782967 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 24 10:12:12.782967 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.782967 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:12.782967 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.782967 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:12.782967 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:12.782967 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:12.782967 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:12:12.782967 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:12:12.782967 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 24 10:12:12.782967 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.785455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-db96487c-5ce7-451f-8889-eac8acb4da5f tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:12:12.787189 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-db96487c-5ce7-451f-8889-eac8acb4da5f tempest-FlavorsExtraSpecsNegativeTestJSON-169564225 tempest-FlavorsExtraSpecsNegativeTestJSON-169564225-project] 10.222.0.85 "PUT /compute/v2.1/flavors/1896597635/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.026122 Aug 24 10:12:12.788645 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 174/360] 10.222.0.85 () {60 vars in 1265 bytes} [Wed Aug 24 10:12:12 2022] PUT /compute/v2.1/flavors/1896597635/os-extra_specs/hw:numa_nodes => generated 124 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:12:12.805449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4ea60b82-260b-44c8-a901-5b664a6014e3 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:12.817360 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-4ea60b82-260b-44c8-a901-5b664a6014e3 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin] HTTP exception thrown: Flavor 1896597635 has no extra specs with key hw:cpu_thread_policy. Aug 24 10:12:12.819456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4ea60b82-260b-44c8-a901-5b664a6014e3 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin] Request method failure captured: Aug 24 10:12:12.819456 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/flavors/1896597635/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 24 10:12:12.819456 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:12:12.819456 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:12:12.819456 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:12:12.819456 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:12:12.819456 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:12:12.819456 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:12:12.819456 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:12:12.819456 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:12:12.819456 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfl6mD8YPo9x1PN_CGFrG-09ZxnAyxVSIrE-x4yKA6PyAkQMWMJ_CAraiU7pBltViC4ZcB_LWedpPjBs1_JrWHNZ_MRm8MWGjJ7bfygpLui8vkkEbJ8mERPZ2gu2aGplDBD183HXi12mCGcu5lwlop2q-IeR56NWQBebAUsU5_BmFrs Aug 24 10:12:12.819456 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:12:12.819456 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:12:12.819456 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:12:12.819456 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:12:12.819456 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:12:12.819456 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:12:12.819456 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: d36781657ad24bd9bdb9241ff1fb24a0 Aug 24 10:12:12.819456 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 Aug 24 10:12:12.819456 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,admin,member Aug 24 10:12:12.819456 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,admin,member Aug 24 10:12:12.820693 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d36781657ad24bd9bdb9241ff1fb24a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d36781657ad24bd9bdb9241ff1fb24a0", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d36781657ad24bd9bdb9241ff1fb24a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d36781657ad24bd9bdb9241ff1fb24a0"}]}] Aug 24 10:12:12.820693 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 Aug 24 10:12:12.820693 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: d36781657ad24bd9bdb9241ff1fb24a0 Aug 24 10:12:12.820693 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 Aug 24 10:12:12.820693 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin Aug 24 10:12:12.820693 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:12:12.820693 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:12:12.820693 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 4ad59d351d0844d98d3a94d094e403cd Aug 24 10:12:12.820693 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin Aug 24 10:12:12.820693 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:12:12.820693 n-d-849328-3 devstack@n-api.service[122432]: exception: Flavor 1896597635 has no extra specs with key hw:cpu_thread_policy. Aug 24 10:12:12.821381 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'flavor_id': '1896597635', 'id': 'hw:cpu_thread_policy'} Aug 24 10:12:12.821381 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:12:12.821381 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:12.821381 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 24 10:12:12.821381 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 24 10:12:12.821381 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 24 10:12:12.821381 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.821381 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:12.821381 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.821381 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:12.821381 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:12.821381 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:12.821381 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:12:12.821381 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:12:12.821381 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:12:12.821381 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:12:12.821381 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 24 10:12:12.821381 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 10:12:12.821381 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1896597635 has no extra specs with key hw:cpu_thread_policy. Aug 24 10:12:12.821381 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.821381 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:12.821381 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.822550 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:12.822550 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:12.822550 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:12.822550 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:12:12.822550 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:12:12.822550 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1896597635 has no extra specs with key hw:cpu_thread_policy. Aug 24 10:12:12.822550 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.824744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4ea60b82-260b-44c8-a901-5b664a6014e3 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin] Returning 404 to user: Flavor 1896597635 has no extra specs with key hw:cpu_thread_policy. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:12:12.825987 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4ea60b82-260b-44c8-a901-5b664a6014e3 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/1896597635/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.032312 Aug 24 10:12:12.827204 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 175/361] 10.222.0.85 () {58 vars in 1269 bytes} [Wed Aug 24 10:12:12 2022] DELETE /compute/v2.1/flavors/1896597635/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:12:12.832792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b4ea2adc-55fd-4111-a62a-b03252ba30ed tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:12.834090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b4ea2adc-55fd-4111-a62a-b03252ba30ed tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:12.845987 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4ea2adc-55fd-4111-a62a-b03252ba30ed tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:12.847746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4ea2adc-55fd-4111-a62a-b03252ba30ed tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:12.848829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4ea2adc-55fd-4111-a62a-b03252ba30ed tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:12.850150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4ea2adc-55fd-4111-a62a-b03252ba30ed tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:12.851120 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4ea2adc-55fd-4111-a62a-b03252ba30ed tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:12.851766 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4ea2adc-55fd-4111-a62a-b03252ba30ed tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:12.885646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-94e5c941-9007-4aa3-aa55-37ef0e3aeea7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:12.899638 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-94e5c941-9007-4aa3-aa55-37ef0e3aeea7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:12.901327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-94e5c941-9007-4aa3-aa55-37ef0e3aeea7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:12.902653 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-94e5c941-9007-4aa3-aa55-37ef0e3aeea7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 200 len: 1362 microversion: 2.25 time: 0.319384 Aug 24 10:12:12.903376 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 187/362] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:12 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:12.912420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2cc7efa4-a9f4-4784-baaf-c1647779acf2 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:12.915658 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:12:12.915658 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:12:12.917267 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-2cc7efa4-a9f4-4784-baaf-c1647779acf2 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 24 10:12:12.919092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2cc7efa4-a9f4-4784-baaf-c1647779acf2 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin] Request method failure captured: Aug 24 10:12:12.919092 n-d-849328-3 devstack@n-api.service[122433]: request: PUT /compute/v2.1/flavors/1896597635/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 24 10:12:12.919092 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:12:12.919092 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:12:12.919092 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:12:12.919092 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 27 Aug 24 10:12:12.919092 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:12:12.919092 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:12:12.919092 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:12:12.919092 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:12:12.919092 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfl6mD8YPo9x1PN_CGFrG-09ZxnAyxVSIrE-x4yKA6PyAkQMWMJ_CAraiU7pBltViC4ZcB_LWedpPjBs1_JrWHNZ_MRm8MWGjJ7bfygpLui8vkkEbJ8mERPZ2gu2aGplDBD183HXi12mCGcu5lwlop2q-IeR56NWQBebAUsU5_BmFrs Aug 24 10:12:12.919092 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:12:12.919092 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:12:12.919092 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:12:12.919092 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:12:12.919092 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:12:12.919092 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:12:12.919092 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d36781657ad24bd9bdb9241ff1fb24a0 Aug 24 10:12:12.919092 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 Aug 24 10:12:12.919092 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:12:12.919092 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:12:12.922244 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d36781657ad24bd9bdb9241ff1fb24a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d36781657ad24bd9bdb9241ff1fb24a0", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d36781657ad24bd9bdb9241ff1fb24a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d36781657ad24bd9bdb9241ff1fb24a0"}]}] Aug 24 10:12:12.922244 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 Aug 24 10:12:12.922244 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d36781657ad24bd9bdb9241ff1fb24a0 Aug 24 10:12:12.922244 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 Aug 24 10:12:12.922244 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin Aug 24 10:12:12.922244 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:12:12.922244 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:12:12.922244 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 4ad59d351d0844d98d3a94d094e403cd Aug 24 10:12:12.922244 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin Aug 24 10:12:12.922244 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:12:12.922244 n-d-849328-3 devstack@n-api.service[122433]: {"hw:cpu_policy": "shared"} Aug 24 10:12:12.922244 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:12:12.922244 n-d-849328-3 devstack@n-api.service[122433]: exception: Request body and URI mismatch Aug 24 10:12:12.923186 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'flavor_id': '1896597635', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 24 10:12:12.923186 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:12:12.923186 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:12.923186 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:12.923186 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:12.923186 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:12:12.923186 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:12:12.923186 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:12:12.923186 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:12:12.923186 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:12:12.923186 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:12:12.923186 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 24 10:12:12.923186 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 24 10:12:12.923186 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 24 10:12:12.923186 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.923186 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:12.923186 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.923186 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:12.923186 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:12.923186 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:12.924502 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:12:12.924502 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:12:12.924502 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 24 10:12:12.924502 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.924502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2cc7efa4-a9f4-4784-baaf-c1647779acf2 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:12:12.924502 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2cc7efa4-a9f4-4784-baaf-c1647779acf2 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin] 10.222.0.85 "PUT /compute/v2.1/flavors/1896597635/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.014327 Aug 24 10:12:12.925276 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 188/363] 10.222.0.85 () {60 vars in 1265 bytes} [Wed Aug 24 10:12:12 2022] PUT /compute/v2.1/flavors/1896597635/os-extra_specs/hw:numa_nodes => generated 73 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 10:12:12.934876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-92b49f4a-d4ef-4e17-a34e-0dca03d0b92c tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:12.941400 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-92b49f4a-d4ef-4e17-a34e-0dca03d0b92c tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin] Request method failure captured: Aug 24 10:12:12.941400 n-d-849328-3 devstack@n-api.service[122433]: request: PUT /compute/v2.1/flavors/1896597635/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 24 10:12:12.941400 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:12:12.941400 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:12:12.941400 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:12:12.941400 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 49 Aug 24 10:12:12.941400 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:12:12.941400 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:12:12.941400 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:12:12.941400 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:12:12.941400 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfl6mD8YPo9x1PN_CGFrG-09ZxnAyxVSIrE-x4yKA6PyAkQMWMJ_CAraiU7pBltViC4ZcB_LWedpPjBs1_JrWHNZ_MRm8MWGjJ7bfygpLui8vkkEbJ8mERPZ2gu2aGplDBD183HXi12mCGcu5lwlop2q-IeR56NWQBebAUsU5_BmFrs Aug 24 10:12:12.941400 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:12:12.941400 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:12:12.941400 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:12:12.941400 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:12:12.941400 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:12:12.941400 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:12:12.941400 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d36781657ad24bd9bdb9241ff1fb24a0 Aug 24 10:12:12.941400 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 Aug 24 10:12:12.941400 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:12:12.941400 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:12:12.943816 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d36781657ad24bd9bdb9241ff1fb24a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d36781657ad24bd9bdb9241ff1fb24a0", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d36781657ad24bd9bdb9241ff1fb24a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d36781657ad24bd9bdb9241ff1fb24a0"}]}] Aug 24 10:12:12.943816 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 Aug 24 10:12:12.943816 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d36781657ad24bd9bdb9241ff1fb24a0 Aug 24 10:12:12.943816 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 Aug 24 10:12:12.943816 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin Aug 24 10:12:12.943816 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:12:12.943816 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:12:12.943816 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 4ad59d351d0844d98d3a94d094e403cd Aug 24 10:12:12.943816 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin Aug 24 10:12:12.943816 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:12:12.943816 n-d-849328-3 devstack@n-api.service[122433]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 24 10:12:12.943816 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:12:12.945359 n-d-849328-3 devstack@n-api.service[122433]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 24 10:12:12.945359 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'flavor_id': '1896597635', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 24 10:12:12.945359 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:12:12.945359 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:12.945359 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:12:12.945359 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:12:12.945359 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:12:12.945359 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:12:12.945359 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 24 10:12:12.945359 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.945359 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 24 10:12:12.945359 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 24 10:12:12.945359 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 24 10:12:12.945359 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 24 10:12:12.945359 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 24 10:12:12.945359 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 24 10:12:12.945359 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 24 10:12:12.945359 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 24 10:12:12.945359 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.945359 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance: Aug 24 10:12:12.945359 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 24 10:12:12.945359 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.948133 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:12.948133 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.948133 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:12.948133 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:12.948133 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:12.948133 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:12:12.948133 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:12:12.948133 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:12:12.948133 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:12:12.948133 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:12:12.948133 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:12:12.948133 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:12:12.948133 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:12:12.948133 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:12:12.948133 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:12:12.948133 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 24 10:12:12.948133 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.948133 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:12.948133 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.948133 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:12.950900 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:12.950900 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:12.950900 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:12:12.950900 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:12:12.950900 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 24 10:12:12.950900 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:12.950900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-92b49f4a-d4ef-4e17-a34e-0dca03d0b92c tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:12:12.950900 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-92b49f4a-d4ef-4e17-a34e-0dca03d0b92c tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin] 10.222.0.85 "PUT /compute/v2.1/flavors/1896597635/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.014110 Aug 24 10:12:12.950900 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 189/364] 10.222.0.85 () {60 vars in 1265 bytes} [Wed Aug 24 10:12:12 2022] PUT /compute/v2.1/flavors/1896597635/os-extra_specs/hw:numa_nodes => generated 117 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 10:12:12.958352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-60ee6e20-ad39-49de-86ce-1ab4ee6da0da tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:12.958352 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:12:12.958352 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:12:12.985445 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-60ee6e20-ad39-49de-86ce-1ab4ee6da0da tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/1896597635" status: 202 len: 0 microversion: 2.1 time: 0.031245 Aug 24 10:12:12.988040 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 190/365] 10.222.0.85 () {58 vars in 1161 bytes} [Wed Aug 24 10:12:12 2022] DELETE /compute/v2.1/flavors/1896597635 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:12:13.010654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-16fcc589-9de7-4a61-9b8f-1d042202f93b tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:13.041911 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-16fcc589-9de7-4a61-9b8f-1d042202f93b tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415 tempest-FlavorsExtraSpecsNegativeTestJSON-1613452415-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.038876 Aug 24 10:12:13.055987 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 191/366] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:12:12 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:12:13.299141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3de8b022-1e01-4d74-9a05-3ddc00654cc3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:13.300517 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3de8b022-1e01-4d74-9a05-3ddc00654cc3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: c7ad4cc6-0ddc-47f9-b386-1e0dde47808f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:13.320519 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3de8b022-1e01-4d74-9a05-3ddc00654cc3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:13.322597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b4ea2adc-55fd-4111-a62a-b03252ba30ed tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:13.323833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3de8b022-1e01-4d74-9a05-3ddc00654cc3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:13.326119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3de8b022-1e01-4d74-9a05-3ddc00654cc3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:13.327421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3de8b022-1e01-4d74-9a05-3ddc00654cc3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:13.330521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3de8b022-1e01-4d74-9a05-3ddc00654cc3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:13.331464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3de8b022-1e01-4d74-9a05-3ddc00654cc3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:13.338614 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b4ea2adc-55fd-4111-a62a-b03252ba30ed tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1313 microversion: 2.1 time: 0.508382 Aug 24 10:12:13.342555 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 176/367] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:12 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1313 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:13.367586 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7baaa824-1eb2-4a63-aee8-e24254360673 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:13.372838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7baaa824-1eb2-4a63-aee8-e24254360673 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 539f1a18-c5df-43d2-8d13-b7315424efb2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:13.405951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7baaa824-1eb2-4a63-aee8-e24254360673 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:13.407888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7baaa824-1eb2-4a63-aee8-e24254360673 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:13.408574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7baaa824-1eb2-4a63-aee8-e24254360673 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:13.409824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7baaa824-1eb2-4a63-aee8-e24254360673 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:13.411575 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7baaa824-1eb2-4a63-aee8-e24254360673 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:13.413543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7baaa824-1eb2-4a63-aee8-e24254360673 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:13.463494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=22 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:13.659719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=18 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:13.823377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3de8b022-1e01-4d74-9a05-3ddc00654cc3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:13.838508 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3de8b022-1e01-4d74-9a05-3ddc00654cc3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f" status: 200 len: 1317 microversion: 2.1 time: 0.546406 Aug 24 10:12:13.853669 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 192/368] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:13 2022] GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f => generated 1317 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:13.859720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-f5145a50-9335-43a0-8157-d0e2ea07ecbd req-2b4fb754-23d6-4834-8e17-606ab843f5e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "162790d5-1b97-47d9-b4df-c897b854a902", "name": "network-vif-plugged", "status": "completed", "tag": "85bbaf28-5677-4b68-aba7-3a4c5c84ab6a"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:13.875523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f5145a50-9335-43a0-8157-d0e2ea07ecbd req-2b4fb754-23d6-4834-8e17-606ab843f5e9 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:13.876468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f5145a50-9335-43a0-8157-d0e2ea07ecbd req-2b4fb754-23d6-4834-8e17-606ab843f5e9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:13.877436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f5145a50-9335-43a0-8157-d0e2ea07ecbd req-2b4fb754-23d6-4834-8e17-606ab843f5e9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:13.884095 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:13.900739 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-f5145a50-9335-43a0-8157-d0e2ea07ecbd req-2b4fb754-23d6-4834-8e17-606ab843f5e9 service nova] Creating event network-vif-plugged:85bbaf28-5677-4b68-aba7-3a4c5c84ab6a for instance 162790d5-1b97-47d9-b4df-c897b854a902 on n-h1-849328-3 Aug 24 10:12:13.912091 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-f5145a50-9335-43a0-8157-d0e2ea07ecbd req-2b4fb754-23d6-4834-8e17-606ab843f5e9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056337 Aug 24 10:12:13.913575 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 193/369] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:13.925434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b363d410-e619-4673-8dbf-e88f95a49278 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:13.927240 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b363d410-e619-4673-8dbf-e88f95a49278 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 9c47edc7-c2c0-43d3-a96a-b779f1d0723c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:13.939860 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b363d410-e619-4673-8dbf-e88f95a49278 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:13.942760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b363d410-e619-4673-8dbf-e88f95a49278 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:13.943822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b363d410-e619-4673-8dbf-e88f95a49278 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:13.945030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b363d410-e619-4673-8dbf-e88f95a49278 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:13.946146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b363d410-e619-4673-8dbf-e88f95a49278 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:13.948358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b363d410-e619-4673-8dbf-e88f95a49278 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:14.067548 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7baaa824-1eb2-4a63-aee8-e24254360673 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:14.075333 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7baaa824-1eb2-4a63-aee8-e24254360673 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2" status: 200 len: 1322 microversion: 2.1 time: 0.731437 Aug 24 10:12:14.090229 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 177/370] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:13 2022] GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2 => generated 1322 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:14.096839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-dba0403e-f166-41f3-9b86-03e3461d4bff req-06664f9c-c7ec-404b-9351-a628f9915492 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f", "tag": "29c5a4d8-1573-48ff-8439-153b2e7ce8e8"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:14.109763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dba0403e-f166-41f3-9b86-03e3461d4bff req-06664f9c-c7ec-404b-9351-a628f9915492 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:14.110688 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dba0403e-f166-41f3-9b86-03e3461d4bff req-06664f9c-c7ec-404b-9351-a628f9915492 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:14.111299 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dba0403e-f166-41f3-9b86-03e3461d4bff req-06664f9c-c7ec-404b-9351-a628f9915492 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:14.126854 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-dba0403e-f166-41f3-9b86-03e3461d4bff req-06664f9c-c7ec-404b-9351-a628f9915492 service nova] Creating event network-changed:29c5a4d8-1573-48ff-8439-153b2e7ce8e8 for instance a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f on n-h2-849328-3 Aug 24 10:12:14.132062 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-dba0403e-f166-41f3-9b86-03e3461d4bff req-06664f9c-c7ec-404b-9351-a628f9915492 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040177 Aug 24 10:12:14.133185 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 178/371] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:14.139540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-96cb659f-0279-4236-ad3f-9384320f29af tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:14.140386 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-96cb659f-0279-4236-ad3f-9384320f29af tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:14.147941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96cb659f-0279-4236-ad3f-9384320f29af tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:14.148589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96cb659f-0279-4236-ad3f-9384320f29af tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:14.149381 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96cb659f-0279-4236-ad3f-9384320f29af tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:14.150253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96cb659f-0279-4236-ad3f-9384320f29af tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:14.151131 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96cb659f-0279-4236-ad3f-9384320f29af tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:14.151559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96cb659f-0279-4236-ad3f-9384320f29af tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:14.235302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b363d410-e619-4673-8dbf-e88f95a49278 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:14.254717 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b363d410-e619-4673-8dbf-e88f95a49278 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c" status: 200 len: 1319 microversion: 2.1 time: 0.337725 Aug 24 10:12:14.268958 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 194/372] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:13 2022] GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c => generated 1319 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:14.387308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4c8435ac-577d-4b73-b4b1-84685d589d39 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:14.388087 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4c8435ac-577d-4b73-b4b1-84685d589d39 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:14.396672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c8435ac-577d-4b73-b4b1-84685d589d39 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:14.397274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c8435ac-577d-4b73-b4b1-84685d589d39 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:14.399315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c8435ac-577d-4b73-b4b1-84685d589d39 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:14.400792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c8435ac-577d-4b73-b4b1-84685d589d39 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:14.401896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c8435ac-577d-4b73-b4b1-84685d589d39 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:14.402686 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c8435ac-577d-4b73-b4b1-84685d589d39 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:14.601192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4c8435ac-577d-4b73-b4b1-84685d589d39 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:14.614157 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4c8435ac-577d-4b73-b4b1-84685d589d39 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1313 microversion: 2.1 time: 0.234210 Aug 24 10:12:14.624775 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 195/373] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:14 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:14.641039 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-96cb659f-0279-4236-ad3f-9384320f29af tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:14.650506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-96cb659f-0279-4236-ad3f-9384320f29af tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:14.652442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-96cb659f-0279-4236-ad3f-9384320f29af tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:14.653674 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-96cb659f-0279-4236-ad3f-9384320f29af tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 200 len: 1362 microversion: 2.25 time: 0.519259 Aug 24 10:12:14.654666 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 179/374] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:14 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 1362 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:14.868765 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a87d820e-0917-4090-8537-163d1f257455 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:14.871631 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a87d820e-0917-4090-8537-163d1f257455 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: c7ad4cc6-0ddc-47f9-b386-1e0dde47808f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:14.879916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a87d820e-0917-4090-8537-163d1f257455 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:14.880773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a87d820e-0917-4090-8537-163d1f257455 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:14.881397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a87d820e-0917-4090-8537-163d1f257455 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:14.882429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a87d820e-0917-4090-8537-163d1f257455 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:14.884625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a87d820e-0917-4090-8537-163d1f257455 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:14.885347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a87d820e-0917-4090-8537-163d1f257455 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:15.075298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a87d820e-0917-4090-8537-163d1f257455 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:15.091665 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a87d820e-0917-4090-8537-163d1f257455 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f" status: 200 len: 1317 microversion: 2.1 time: 0.234637 Aug 24 10:12:15.092559 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 196/375] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:14 2022] GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:15.108515 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ef1eb3e9-d3ee-4878-aead-caeca6b753b6 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:15.109190 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ef1eb3e9-d3ee-4878-aead-caeca6b753b6 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 539f1a18-c5df-43d2-8d13-b7315424efb2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:15.119819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef1eb3e9-d3ee-4878-aead-caeca6b753b6 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:15.120800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef1eb3e9-d3ee-4878-aead-caeca6b753b6 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:15.122472 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef1eb3e9-d3ee-4878-aead-caeca6b753b6 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:15.124361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef1eb3e9-d3ee-4878-aead-caeca6b753b6 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:15.125071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef1eb3e9-d3ee-4878-aead-caeca6b753b6 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:15.126363 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef1eb3e9-d3ee-4878-aead-caeca6b753b6 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:15.278328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-392e2a70-58e5-466c-b832-45ba7c997670 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:15.279299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-392e2a70-58e5-466c-b832-45ba7c997670 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 9c47edc7-c2c0-43d3-a96a-b779f1d0723c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:15.287628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-392e2a70-58e5-466c-b832-45ba7c997670 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:15.288435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-392e2a70-58e5-466c-b832-45ba7c997670 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:15.289424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-392e2a70-58e5-466c-b832-45ba7c997670 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:15.291044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-392e2a70-58e5-466c-b832-45ba7c997670 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:15.291956 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-392e2a70-58e5-466c-b832-45ba7c997670 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:15.292394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-392e2a70-58e5-466c-b832-45ba7c997670 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:15.604212 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-392e2a70-58e5-466c-b832-45ba7c997670 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:15.656153 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-392e2a70-58e5-466c-b832-45ba7c997670 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c" status: 200 len: 1319 microversion: 2.1 time: 0.381415 Aug 24 10:12:15.678835 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 197/376] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:15 2022] GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c => generated 1319 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:15.707346 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bf1f5e54-856d-4251-981e-0eb7f0a4cc4c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:15.710243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bf1f5e54-856d-4251-981e-0eb7f0a4cc4c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:15.720005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf1f5e54-856d-4251-981e-0eb7f0a4cc4c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:15.721918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf1f5e54-856d-4251-981e-0eb7f0a4cc4c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:15.723058 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf1f5e54-856d-4251-981e-0eb7f0a4cc4c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:15.724536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf1f5e54-856d-4251-981e-0eb7f0a4cc4c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:15.725290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf1f5e54-856d-4251-981e-0eb7f0a4cc4c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:15.726384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf1f5e54-856d-4251-981e-0eb7f0a4cc4c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:15.744315 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ef1eb3e9-d3ee-4878-aead-caeca6b753b6 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:15.757785 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ef1eb3e9-d3ee-4878-aead-caeca6b753b6 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2" status: 200 len: 1322 microversion: 2.1 time: 0.653194 Aug 24 10:12:15.762490 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 180/377] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:15 2022] GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2 => generated 1322 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:15.767747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4f42a64e-89e5-43de-83cc-8d5cd304178f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:15.768374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4f42a64e-89e5-43de-83cc-8d5cd304178f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:15.793833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f42a64e-89e5-43de-83cc-8d5cd304178f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:15.794367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f42a64e-89e5-43de-83cc-8d5cd304178f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:15.794801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f42a64e-89e5-43de-83cc-8d5cd304178f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:15.795575 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f42a64e-89e5-43de-83cc-8d5cd304178f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:15.795964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f42a64e-89e5-43de-83cc-8d5cd304178f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:15.796391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f42a64e-89e5-43de-83cc-8d5cd304178f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:16.112054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4f42a64e-89e5-43de-83cc-8d5cd304178f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:16.126042 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4f42a64e-89e5-43de-83cc-8d5cd304178f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:16.127699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4f42a64e-89e5-43de-83cc-8d5cd304178f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:16.128891 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4f42a64e-89e5-43de-83cc-8d5cd304178f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 200 len: 1559 microversion: 2.25 time: 0.365152 Aug 24 10:12:16.129484 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 181/378] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:15 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 1559 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:16.135764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ba993be1-5f0c-4df7-8125-49981a85f65d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:16.136408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ba993be1-5f0c-4df7-8125-49981a85f65d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: c7ad4cc6-0ddc-47f9-b386-1e0dde47808f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:16.142533 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba993be1-5f0c-4df7-8125-49981a85f65d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:16.143260 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba993be1-5f0c-4df7-8125-49981a85f65d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:16.143857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba993be1-5f0c-4df7-8125-49981a85f65d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:16.144865 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba993be1-5f0c-4df7-8125-49981a85f65d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:16.145677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba993be1-5f0c-4df7-8125-49981a85f65d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:16.146368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba993be1-5f0c-4df7-8125-49981a85f65d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:16.188078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bf1f5e54-856d-4251-981e-0eb7f0a4cc4c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:16.200763 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bf1f5e54-856d-4251-981e-0eb7f0a4cc4c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1313 microversion: 2.1 time: 0.509290 Aug 24 10:12:16.201377 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 198/379] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:15 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1313 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:16.494946 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ba993be1-5f0c-4df7-8125-49981a85f65d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:16.513224 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ba993be1-5f0c-4df7-8125-49981a85f65d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f" status: 200 len: 1317 microversion: 2.1 time: 0.381290 Aug 24 10:12:16.526468 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 182/380] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:16 2022] GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:16.665839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-63dfd1d0-5931-43ab-b006-b4e2dfc213d3 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:16.666543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-63dfd1d0-5931-43ab-b006-b4e2dfc213d3 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:16.682785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63dfd1d0-5931-43ab-b006-b4e2dfc213d3 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:16.683773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63dfd1d0-5931-43ab-b006-b4e2dfc213d3 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:16.684746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63dfd1d0-5931-43ab-b006-b4e2dfc213d3 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:16.686498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63dfd1d0-5931-43ab-b006-b4e2dfc213d3 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:16.687537 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2f30380a-6c7e-48e7-a5cb-02ba889ae7eb tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:16.687813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63dfd1d0-5931-43ab-b006-b4e2dfc213d3 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:16.688261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2f30380a-6c7e-48e7-a5cb-02ba889ae7eb tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 9c47edc7-c2c0-43d3-a96a-b779f1d0723c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:16.688682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63dfd1d0-5931-43ab-b006-b4e2dfc213d3 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:16.708972 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f30380a-6c7e-48e7-a5cb-02ba889ae7eb tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:16.709545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f30380a-6c7e-48e7-a5cb-02ba889ae7eb tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:16.709995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f30380a-6c7e-48e7-a5cb-02ba889ae7eb tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:16.710736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f30380a-6c7e-48e7-a5cb-02ba889ae7eb tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:16.713019 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f30380a-6c7e-48e7-a5cb-02ba889ae7eb tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:16.713709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f30380a-6c7e-48e7-a5cb-02ba889ae7eb tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:17.068543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2f30380a-6c7e-48e7-a5cb-02ba889ae7eb tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:17.082311 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2f30380a-6c7e-48e7-a5cb-02ba889ae7eb tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c" status: 200 len: 1319 microversion: 2.1 time: 0.401970 Aug 24 10:12:17.098098 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 183/381] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:16 2022] GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c => generated 1319 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:12:17.116477 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2cfdecce-6c4d-454f-9d54-c076a2df07a1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:17.119016 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2cfdecce-6c4d-454f-9d54-c076a2df07a1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 539f1a18-c5df-43d2-8d13-b7315424efb2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:17.142665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-63dfd1d0-5931-43ab-b006-b4e2dfc213d3 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lazy-loading 'services' on Instance uuid 162790d5-1b97-47d9-b4df-c897b854a902 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:12:17.149902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cfdecce-6c4d-454f-9d54-c076a2df07a1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:17.151144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cfdecce-6c4d-454f-9d54-c076a2df07a1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:17.153563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cfdecce-6c4d-454f-9d54-c076a2df07a1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:17.156732 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cfdecce-6c4d-454f-9d54-c076a2df07a1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:17.157495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cfdecce-6c4d-454f-9d54-c076a2df07a1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:17.158371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cfdecce-6c4d-454f-9d54-c076a2df07a1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:17.276900 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-63dfd1d0-5931-43ab-b006-b4e2dfc213d3 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 200 len: 2052 microversion: 2.25 time: 1.070681 Aug 24 10:12:17.277917 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 199/382] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:16 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 2052 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:17.298790 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-04388391-f4f7-4ddc-ba44-3cc638356cad req-913b73bc-fbac-4d30-aa71-6d9d9de8bc4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7ad4cc6-0ddc-47f9-b386-1e0dde47808f", "name": "network-vif-plugged", "status": "completed", "tag": "58e03dc7-a396-4e6d-9258-6792561d67a1"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:17.333053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-04388391-f4f7-4ddc-ba44-3cc638356cad req-913b73bc-fbac-4d30-aa71-6d9d9de8bc4a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:17.334706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-04388391-f4f7-4ddc-ba44-3cc638356cad req-913b73bc-fbac-4d30-aa71-6d9d9de8bc4a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:17.335352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-04388391-f4f7-4ddc-ba44-3cc638356cad req-913b73bc-fbac-4d30-aa71-6d9d9de8bc4a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:17.360038 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-04388391-f4f7-4ddc-ba44-3cc638356cad req-913b73bc-fbac-4d30-aa71-6d9d9de8bc4a service nova] Creating event network-vif-plugged:58e03dc7-a396-4e6d-9258-6792561d67a1 for instance c7ad4cc6-0ddc-47f9-b386-1e0dde47808f on n-h1-849328-3 Aug 24 10:12:17.369699 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-04388391-f4f7-4ddc-ba44-3cc638356cad req-913b73bc-fbac-4d30-aa71-6d9d9de8bc4a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089878 Aug 24 10:12:17.371463 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 200/383] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:17.379531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1525d34a-5dde-43b9-ab29-868f66da1ca9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:17.380572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1525d34a-5dde-43b9-ab29-868f66da1ca9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:17.388066 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1525d34a-5dde-43b9-ab29-868f66da1ca9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:17.388837 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1525d34a-5dde-43b9-ab29-868f66da1ca9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:17.390101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1525d34a-5dde-43b9-ab29-868f66da1ca9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:17.391047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1525d34a-5dde-43b9-ab29-868f66da1ca9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:17.391767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1525d34a-5dde-43b9-ab29-868f66da1ca9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:17.392350 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1525d34a-5dde-43b9-ab29-868f66da1ca9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:17.500192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2cfdecce-6c4d-454f-9d54-c076a2df07a1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:17.514740 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2cfdecce-6c4d-454f-9d54-c076a2df07a1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2" status: 200 len: 1322 microversion: 2.1 time: 0.408082 Aug 24 10:12:17.515345 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 184/384] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:17 2022] GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2 => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:17.556839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-36d421cb-4d02-49a7-9b4d-4cea884b0aa0 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:17.557611 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-36d421cb-4d02-49a7-9b4d-4cea884b0aa0 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:17.579666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36d421cb-4d02-49a7-9b4d-4cea884b0aa0 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:17.579666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36d421cb-4d02-49a7-9b4d-4cea884b0aa0 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:17.579666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36d421cb-4d02-49a7-9b4d-4cea884b0aa0 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:17.579666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36d421cb-4d02-49a7-9b4d-4cea884b0aa0 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:17.590455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36d421cb-4d02-49a7-9b4d-4cea884b0aa0 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:17.591007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36d421cb-4d02-49a7-9b4d-4cea884b0aa0 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:17.678054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1525d34a-5dde-43b9-ab29-868f66da1ca9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:17.690722 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1525d34a-5dde-43b9-ab29-868f66da1ca9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1313 microversion: 2.1 time: 0.317307 Aug 24 10:12:17.692999 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 201/385] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:17 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:17.715465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e3dfc85f-fe9d-4241-80f8-ac397a21989b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:17.716361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e3dfc85f-fe9d-4241-80f8-ac397a21989b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: c7ad4cc6-0ddc-47f9-b386-1e0dde47808f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:17.737321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3dfc85f-fe9d-4241-80f8-ac397a21989b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:17.737830 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3dfc85f-fe9d-4241-80f8-ac397a21989b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:17.738432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3dfc85f-fe9d-4241-80f8-ac397a21989b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:17.740428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3dfc85f-fe9d-4241-80f8-ac397a21989b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:17.743040 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3dfc85f-fe9d-4241-80f8-ac397a21989b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:17.745440 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3dfc85f-fe9d-4241-80f8-ac397a21989b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:17.942930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-36d421cb-4d02-49a7-9b4d-4cea884b0aa0 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lazy-loading 'services' on Instance uuid 162790d5-1b97-47d9-b4df-c897b854a902 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:12:18.085429 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-36d421cb-4d02-49a7-9b4d-4cea884b0aa0 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 200 len: 2052 microversion: 2.25 time: 0.568973 Aug 24 10:12:18.086046 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 185/386] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:17 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 2052 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:18.110841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-16559b76-5f9e-4fe9-841b-e31afa90fcb1 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:18.113742 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:12:18.113742 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:12:18.114911 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16559b76-5f9e-4fe9-841b-e31afa90fcb1 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:18.115406 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16559b76-5f9e-4fe9-841b-e31afa90fcb1 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:18.115843 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16559b76-5f9e-4fe9-841b-e31afa90fcb1 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:18.116604 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16559b76-5f9e-4fe9-841b-e31afa90fcb1 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:18.117174 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16559b76-5f9e-4fe9-841b-e31afa90fcb1 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:18.117524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16559b76-5f9e-4fe9-841b-e31afa90fcb1 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:18.162317 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e3dfc85f-fe9d-4241-80f8-ac397a21989b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:18.183733 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e3dfc85f-fe9d-4241-80f8-ac397a21989b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f" status: 200 len: 1317 microversion: 2.1 time: 0.486841 Aug 24 10:12:18.191696 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 202/387] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:17 2022] GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f => generated 1317 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:18.192927 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-16559b76-5f9e-4fe9-841b-e31afa90fcb1 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] 10.222.0.85 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.085679 Aug 24 10:12:18.197360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-abcf3dfa-e3eb-447a-b643-73c3e6643a86 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:18.200493 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 186/388] 10.222.0.85 () {60 vars in 1217 bytes} [Wed Aug 24 10:12:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:12:18.201576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-abcf3dfa-e3eb-447a-b643-73c3e6643a86 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 9c47edc7-c2c0-43d3-a96a-b779f1d0723c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:18.213272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abcf3dfa-e3eb-447a-b643-73c3e6643a86 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:18.213960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abcf3dfa-e3eb-447a-b643-73c3e6643a86 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:18.215265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abcf3dfa-e3eb-447a-b643-73c3e6643a86 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:18.217410 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abcf3dfa-e3eb-447a-b643-73c3e6643a86 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:18.222181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abcf3dfa-e3eb-447a-b643-73c3e6643a86 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:18.223854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-495d34a2-982c-48ff-a84c-1e5277cb3374 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-849328-3", "block_migration": "auto"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:18.226011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abcf3dfa-e3eb-447a-b643-73c3e6643a86 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:18.227107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-495d34a2-982c-48ff-a84c-1e5277cb3374 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:18.234081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-495d34a2-982c-48ff-a84c-1e5277cb3374 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:18.234799 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-495d34a2-982c-48ff-a84c-1e5277cb3374 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:18.235738 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-495d34a2-982c-48ff-a84c-1e5277cb3374 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:18.236844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-495d34a2-982c-48ff-a84c-1e5277cb3374 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:18.237749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-495d34a2-982c-48ff-a84c-1e5277cb3374 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:18.238329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-495d34a2-982c-48ff-a84c-1e5277cb3374 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:18.367762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-495d34a2-982c-48ff-a84c-1e5277cb3374 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lazy-loading 'flavor' on Instance uuid 162790d5-1b97-47d9-b4df-c897b854a902 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:12:18.447271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-495d34a2-982c-48ff-a84c-1e5277cb3374 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Going to try to live migrate instance to n-h2-849328-3 {{(pid=122432) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 10:12:19.249292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-abcf3dfa-e3eb-447a-b643-73c3e6643a86 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:19.271434 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-abcf3dfa-e3eb-447a-b643-73c3e6643a86 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c" status: 200 len: 1319 microversion: 2.1 time: 1.078257 Aug 24 10:12:19.272527 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 203/389] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:18 2022] GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c => generated 1319 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:19.285250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-13628272-ae32-4ed3-bf59-f2ce98663b6f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:19.286131 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-13628272-ae32-4ed3-bf59-f2ce98663b6f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 539f1a18-c5df-43d2-8d13-b7315424efb2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:19.303871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13628272-ae32-4ed3-bf59-f2ce98663b6f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:19.304747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13628272-ae32-4ed3-bf59-f2ce98663b6f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:19.306225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13628272-ae32-4ed3-bf59-f2ce98663b6f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:19.307439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13628272-ae32-4ed3-bf59-f2ce98663b6f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:19.308223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13628272-ae32-4ed3-bf59-f2ce98663b6f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:19.308850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13628272-ae32-4ed3-bf59-f2ce98663b6f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:19.586149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-13628272-ae32-4ed3-bf59-f2ce98663b6f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:19.595538 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-13628272-ae32-4ed3-bf59-f2ce98663b6f tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2" status: 200 len: 1322 microversion: 2.1 time: 0.321715 Aug 24 10:12:19.609984 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 204/390] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:19 2022] GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2 => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:19.617902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4b3f8f4a-df78-453b-b6a4-caad6718ae30 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:19.618819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4b3f8f4a-df78-453b-b6a4-caad6718ae30 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:19.628451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b3f8f4a-df78-453b-b6a4-caad6718ae30 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:19.629316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b3f8f4a-df78-453b-b6a4-caad6718ae30 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:19.630174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b3f8f4a-df78-453b-b6a4-caad6718ae30 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:19.630890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b3f8f4a-df78-453b-b6a4-caad6718ae30 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:19.631646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b3f8f4a-df78-453b-b6a4-caad6718ae30 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:19.632068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b3f8f4a-df78-453b-b6a4-caad6718ae30 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:19.891250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4b3f8f4a-df78-453b-b6a4-caad6718ae30 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:19.902796 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4b3f8f4a-df78-453b-b6a4-caad6718ae30 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1313 microversion: 2.1 time: 0.291528 Aug 24 10:12:19.907815 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 205/391] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:19 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:20.120956 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-445898f3-3f30-4bab-9c39-3c67d72bdee2 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Calling method '.version_select at 0x7f4655cb5e50>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:20.124265 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:12:20.124265 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:12:20.126871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-445898f3-3f30-4bab-9c39-3c67d72bdee2 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:20.127654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-445898f3-3f30-4bab-9c39-3c67d72bdee2 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:20.130382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-445898f3-3f30-4bab-9c39-3c67d72bdee2 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:20.131451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-445898f3-3f30-4bab-9c39-3c67d72bdee2 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:20.132084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-445898f3-3f30-4bab-9c39-3c67d72bdee2 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:20.134250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-445898f3-3f30-4bab-9c39-3c67d72bdee2 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:20.230751 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-445898f3-3f30-4bab-9c39-3c67d72bdee2 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.320895 Aug 24 10:12:20.232152 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 206/392] 10.222.0.85 () {58 vars in 1128 bytes} [Wed Aug 24 10:12:19 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:20.263796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b8521eba-e30f-4175-9834-fdc8c2556e16 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:20.268347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b8521eba-e30f-4175-9834-fdc8c2556e16 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: c7ad4cc6-0ddc-47f9-b386-1e0dde47808f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:20.283934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8521eba-e30f-4175-9834-fdc8c2556e16 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:20.286123 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8521eba-e30f-4175-9834-fdc8c2556e16 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:20.286776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8521eba-e30f-4175-9834-fdc8c2556e16 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:20.287813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8521eba-e30f-4175-9834-fdc8c2556e16 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:20.288549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8521eba-e30f-4175-9834-fdc8c2556e16 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:20.289244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8521eba-e30f-4175-9834-fdc8c2556e16 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:20.468274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b8521eba-e30f-4175-9834-fdc8c2556e16 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:20.484092 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b8521eba-e30f-4175-9834-fdc8c2556e16 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f" status: 200 len: 1466 microversion: 2.1 time: 0.249783 Aug 24 10:12:20.485076 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 207/393] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:20 2022] GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f => generated 1466 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:20.516138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-f28c6555-b4c7-4c80-8b3b-1b032926a13c req-d1a0f01b-0d70-41e3-a714-41ba40c75246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "539f1a18-c5df-43d2-8d13-b7315424efb2", "name": "network-vif-plugged", "status": "completed", "tag": "d55b2cba-ada4-4603-9eb5-de790963c453"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:20.536949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f28c6555-b4c7-4c80-8b3b-1b032926a13c req-d1a0f01b-0d70-41e3-a714-41ba40c75246 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:20.537588 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f28c6555-b4c7-4c80-8b3b-1b032926a13c req-d1a0f01b-0d70-41e3-a714-41ba40c75246 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:20.538392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f28c6555-b4c7-4c80-8b3b-1b032926a13c req-d1a0f01b-0d70-41e3-a714-41ba40c75246 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:20.553501 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-f28c6555-b4c7-4c80-8b3b-1b032926a13c req-d1a0f01b-0d70-41e3-a714-41ba40c75246 service nova] Creating event network-vif-plugged:d55b2cba-ada4-4603-9eb5-de790963c453 for instance 539f1a18-c5df-43d2-8d13-b7315424efb2 on n-h2-849328-3 Aug 24 10:12:20.560253 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-f28c6555-b4c7-4c80-8b3b-1b032926a13c req-d1a0f01b-0d70-41e3-a714-41ba40c75246 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046929 Aug 24 10:12:20.561653 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 208/394] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:20.569509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3528ee7b-7d4b-4c23-9dc2-4ce53a086954 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:20.570216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3528ee7b-7d4b-4c23-9dc2-4ce53a086954 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: 7e6f46da-f3b6-41ec-96f2-a3db16593a10] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:20.577834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3528ee7b-7d4b-4c23-9dc2-4ce53a086954 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:20.578346 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3528ee7b-7d4b-4c23-9dc2-4ce53a086954 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:20.578788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3528ee7b-7d4b-4c23-9dc2-4ce53a086954 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:20.579534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3528ee7b-7d4b-4c23-9dc2-4ce53a086954 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:20.579988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3528ee7b-7d4b-4c23-9dc2-4ce53a086954 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:20.580680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3528ee7b-7d4b-4c23-9dc2-4ce53a086954 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:20.609907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3528ee7b-7d4b-4c23-9dc2-4ce53a086954 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: 7e6f46da-f3b6-41ec-96f2-a3db16593a10] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:12:20.763585 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3528ee7b-7d4b-4c23-9dc2-4ce53a086954 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "DELETE /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10" status: 204 len: 0 microversion: 2.1 time: 0.199428 Aug 24 10:12:20.764115 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 209/395] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:12:20 2022] DELETE /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:12:20.779156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-83319d1b-effd-43e9-ad28-f66ca0f8d288 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Calling method '.version_select at 0x7f4655c2dee0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:20.781859 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:12:20.781859 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:12:20.783006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83319d1b-effd-43e9-ad28-f66ca0f8d288 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:20.784326 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83319d1b-effd-43e9-ad28-f66ca0f8d288 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:20.784826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83319d1b-effd-43e9-ad28-f66ca0f8d288 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:20.785530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83319d1b-effd-43e9-ad28-f66ca0f8d288 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:20.785975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83319d1b-effd-43e9-ad28-f66ca0f8d288 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:20.786383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83319d1b-effd-43e9-ad28-f66ca0f8d288 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:20.825176 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-83319d1b-effd-43e9-ad28-f66ca0f8d288 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.050243 Aug 24 10:12:20.826486 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 210/396] 10.222.0.85 () {58 vars in 1139 bytes} [Wed Aug 24 10:12:20 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:20.835563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d1fce647-e72b-4076-a374-1687121f0705 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:20.836499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d1fce647-e72b-4076-a374-1687121f0705 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 9c47edc7-c2c0-43d3-a96a-b779f1d0723c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:20.843257 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1fce647-e72b-4076-a374-1687121f0705 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:20.843849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1fce647-e72b-4076-a374-1687121f0705 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:20.844351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1fce647-e72b-4076-a374-1687121f0705 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:20.845363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1fce647-e72b-4076-a374-1687121f0705 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:20.845778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1fce647-e72b-4076-a374-1687121f0705 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:20.846426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1fce647-e72b-4076-a374-1687121f0705 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:20.853423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:21.101237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d1fce647-e72b-4076-a374-1687121f0705 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:21.112697 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d1fce647-e72b-4076-a374-1687121f0705 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c" status: 200 len: 1319 microversion: 2.1 time: 0.284613 Aug 24 10:12:21.113780 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 211/397] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:20 2022] GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:21.317369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-12358e8e-f607-4107-92e6-85ea7adb105b tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Action: 'create', calling method: .version_select at 0x7f4655963f70>, body: {"keypair": {"name": "tempest-keypair-719838166", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnID1Gq5XRuE1qHG1SDx6KwKgauEnPBoUD3r2j2q2czlNpEcSZcAC5zHqts6bOzQVzrMK8HEMRu7t4H41hld9tfEr4Oz0YyAzW+uEN9Q2CVC/VnxoRjjMhdlHJbQaVgDA=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:21.338545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-12358e8e-f607-4107-92e6-85ea7adb105b tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Getting quotas for project d6a57c8760d34630aa410aa3f7a96edd. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:12:21.344004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-12358e8e-f607-4107-92e6-85ea7adb105b tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Getting quotas for user 360dc9ca253340f79dfb2c14f04c7445 and project d6a57c8760d34630aa410aa3f7a96edd. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:12:21.371531 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-12358e8e-f607-4107-92e6-85ea7adb105b tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.243930 Aug 24 10:12:21.372674 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 212/398] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:12:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:21.574282 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-495d34a2-982c-48ff-a84c-1e5277cb3374 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902/action" status: 202 len: 0 microversion: 2.25 time: 3.354836 Aug 24 10:12:21.575856 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 187/399] 10.222.0.85 () {62 vars in 1319 bytes} [Wed Aug 24 10:12:18 2022] POST /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902/action => generated 0 bytes in 3358 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:12:21.588008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-493b5e57-53da-4a5d-9d03-632d5618a56d tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:21.589919 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-493b5e57-53da-4a5d-9d03-632d5618a56d tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 539f1a18-c5df-43d2-8d13-b7315424efb2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:21.604751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-493b5e57-53da-4a5d-9d03-632d5618a56d tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:21.605664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-493b5e57-53da-4a5d-9d03-632d5618a56d tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:21.606198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-493b5e57-53da-4a5d-9d03-632d5618a56d tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:21.607742 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-493b5e57-53da-4a5d-9d03-632d5618a56d tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:21.608645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-493b5e57-53da-4a5d-9d03-632d5618a56d tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:21.609389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-493b5e57-53da-4a5d-9d03-632d5618a56d tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:21.617820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b489724f-5b9f-4db5-ade4-2fc922fe2123 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:21.618705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b489724f-5b9f-4db5-ade4-2fc922fe2123 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] [instance: c7ad4cc6-0ddc-47f9-b386-1e0dde47808f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:21.631510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b489724f-5b9f-4db5-ade4-2fc922fe2123 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:21.632171 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b489724f-5b9f-4db5-ade4-2fc922fe2123 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:21.632704 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b489724f-5b9f-4db5-ade4-2fc922fe2123 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:21.633545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b489724f-5b9f-4db5-ade4-2fc922fe2123 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:21.634867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b489724f-5b9f-4db5-ade4-2fc922fe2123 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:21.635991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b489724f-5b9f-4db5-ade4-2fc922fe2123 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:21.918981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-493b5e57-53da-4a5d-9d03-632d5618a56d tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:21.922932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:21.936582 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-493b5e57-53da-4a5d-9d03-632d5618a56d tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2" status: 200 len: 1322 microversion: 2.1 time: 0.358690 Aug 24 10:12:21.937761 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 188/400] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:21 2022] GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2 => generated 1322 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:21.954016 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fbcfbce6-e530-49ac-b10d-9efb5b466fd5 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Calling method '.version_select at 0x7f4655673a60>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:21.959159 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:12:21.959159 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:12:21.962245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbcfbce6-e530-49ac-b10d-9efb5b466fd5 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:21.963649 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbcfbce6-e530-49ac-b10d-9efb5b466fd5 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:21.965074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbcfbce6-e530-49ac-b10d-9efb5b466fd5 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:21.967126 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbcfbce6-e530-49ac-b10d-9efb5b466fd5 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:21.968306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbcfbce6-e530-49ac-b10d-9efb5b466fd5 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:21.969747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbcfbce6-e530-49ac-b10d-9efb5b466fd5 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:22.021060 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fbcfbce6-e530-49ac-b10d-9efb5b466fd5 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.081519 Aug 24 10:12:22.022403 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 189/401] 10.222.0.85 () {58 vars in 1145 bytes} [Wed Aug 24 10:12:21 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:12:22.028817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4e2e5e00-e461-4f8e-9ccc-84681b09c760 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:22.031491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4e2e5e00-e461-4f8e-9ccc-84681b09c760 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:22.039382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e2e5e00-e461-4f8e-9ccc-84681b09c760 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:22.040232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e2e5e00-e461-4f8e-9ccc-84681b09c760 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:22.040923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e2e5e00-e461-4f8e-9ccc-84681b09c760 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:22.042235 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e2e5e00-e461-4f8e-9ccc-84681b09c760 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:22.043521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e2e5e00-e461-4f8e-9ccc-84681b09c760 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:22.044225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e2e5e00-e461-4f8e-9ccc-84681b09c760 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:22.124740 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b489724f-5b9f-4db5-ade4-2fc922fe2123 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f" status: 200 len: 1617 microversion: 2.1 time: 0.744647 Aug 24 10:12:22.125885 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 213/402] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:21 2022] GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f => generated 1617 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:22.138743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bf5db898-b50d-4af9-9462-d13b8110be65 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-497249874", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "280669823", "adminPass": "***", "networks": [{"uuid": "89f7616e-e1bd-4a60-b807-430b638d900b"}], "security_groups": [{"name": "tempest-securitygroup--283143853"}], "key_name": "tempest-keypair-1759048096", "user_data": "}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:22.346134 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-bf5db898-b50d-4af9-9462-d13b8110be65 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] validate_networks() for [('89f7616e-e1bd-4a60-b807-430b638d900b', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:12:22.574559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4e2e5e00-e461-4f8e-9ccc-84681b09c760 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:22.589470 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4e2e5e00-e461-4f8e-9ccc-84681b09c760 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1313 microversion: 2.1 time: 0.565285 Aug 24 10:12:22.589901 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 190/403] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:22 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1313 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:22.602444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e55d8aa3-14ae-4f9e-9ea7-ff04d049d80e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:22.603048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e55d8aa3-14ae-4f9e-9ea7-ff04d049d80e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:22.610757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e55d8aa3-14ae-4f9e-9ea7-ff04d049d80e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:22.611558 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e55d8aa3-14ae-4f9e-9ea7-ff04d049d80e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:22.612190 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e55d8aa3-14ae-4f9e-9ea7-ff04d049d80e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:22.613101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e55d8aa3-14ae-4f9e-9ea7-ff04d049d80e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:22.613807 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e55d8aa3-14ae-4f9e-9ea7-ff04d049d80e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:22.614291 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e55d8aa3-14ae-4f9e-9ea7-ff04d049d80e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:23.065837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e55d8aa3-14ae-4f9e-9ea7-ff04d049d80e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:23.090326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e55d8aa3-14ae-4f9e-9ea7-ff04d049d80e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:23.091935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e55d8aa3-14ae-4f9e-9ea7-ff04d049d80e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:23.093330 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e55d8aa3-14ae-4f9e-9ea7-ff04d049d80e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 200 len: 1569 microversion: 2.25 time: 0.502250 Aug 24 10:12:23.094100 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 191/404] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:22 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 1569 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:23.114364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-803f4cec-13e6-4274-99cc-eb890426e8f8 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Calling method '.version_select at 0x7f46557d6ee0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:23.117466 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:12:23.117466 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:12:23.118903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-803f4cec-13e6-4274-99cc-eb890426e8f8 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:23.119595 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-803f4cec-13e6-4274-99cc-eb890426e8f8 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:23.120189 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-803f4cec-13e6-4274-99cc-eb890426e8f8 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:23.121081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-803f4cec-13e6-4274-99cc-eb890426e8f8 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:23.121783 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-803f4cec-13e6-4274-99cc-eb890426e8f8 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:23.122346 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-803f4cec-13e6-4274-99cc-eb890426e8f8 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:23.175264 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-803f4cec-13e6-4274-99cc-eb890426e8f8 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.068541 Aug 24 10:12:23.177006 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 192/405] 10.222.0.85 () {58 vars in 1128 bytes} [Wed Aug 24 10:12:23 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:23.183068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4a988018-c068-461c-a0a9-9f2693f76a61 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:23.183956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4a988018-c068-461c-a0a9-9f2693f76a61 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 9c47edc7-c2c0-43d3-a96a-b779f1d0723c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:23.191644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a988018-c068-461c-a0a9-9f2693f76a61 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:23.192410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a988018-c068-461c-a0a9-9f2693f76a61 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:23.193001 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a988018-c068-461c-a0a9-9f2693f76a61 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:23.193898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a988018-c068-461c-a0a9-9f2693f76a61 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:23.194559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a988018-c068-461c-a0a9-9f2693f76a61 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:23.196845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a988018-c068-461c-a0a9-9f2693f76a61 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:23.544053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-bf5db898-b50d-4af9-9462-d13b8110be65 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:12:23.546476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-bf5db898-b50d-4af9-9462-d13b8110be65 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:12:23.549225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-bf5db898-b50d-4af9-9462-d13b8110be65 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:12:23.551407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-bf5db898-b50d-4af9-9462-d13b8110be65 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:12:23.552724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-bf5db898-b50d-4af9-9462-d13b8110be65 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:12:23.565600 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4a988018-c068-461c-a0a9-9f2693f76a61 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:23.579288 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4a988018-c068-461c-a0a9-9f2693f76a61 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c" status: 200 len: 1319 microversion: 2.1 time: 0.400717 Aug 24 10:12:23.585653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf5db898-b50d-4af9-9462-d13b8110be65 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:23.587324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf5db898-b50d-4af9-9462-d13b8110be65 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:23.588426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf5db898-b50d-4af9-9462-d13b8110be65 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:23.590515 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf5db898-b50d-4af9-9462-d13b8110be65 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:23.594162 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf5db898-b50d-4af9-9462-d13b8110be65 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:23.597000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf5db898-b50d-4af9-9462-d13b8110be65 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:23.610422 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 193/406] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:23 2022] GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c => generated 1319 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:23.665156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-bf5db898-b50d-4af9-9462-d13b8110be65 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Getting quotas for project 114821bb876c48869e113c5b6d8898d0. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:12:23.665735 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f6cb48a8-9a1d-4db5-bbf4-16b4ac838920 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Action: 'create', calling method: .version_select at 0x7f4655630b80>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1740862162", "policies": ["affinity"]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:23.674556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-bf5db898-b50d-4af9-9462-d13b8110be65 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Getting quotas for user e5bc9c3828964edabe730dd66ee27ee4 and project 114821bb876c48869e113c5b6d8898d0. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:12:23.718324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-f6cb48a8-9a1d-4db5-bbf4-16b4ac838920 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'server_groups'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:12:23.718589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bf5db898-b50d-4af9-9462-d13b8110be65 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:12:23.719987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bf5db898-b50d-4af9-9462-d13b8110be65 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: d5911032-bcaa-4a3d-bb73-ccbea62de79b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:12:23.720658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-f6cb48a8-9a1d-4db5-bbf4-16b4ac838920 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for user bf03c0eb5bd748ae85be830f1121dc06 and project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'server_groups'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:12:23.810272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-f6cb48a8-9a1d-4db5-bbf4-16b4ac838920 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'server_groups'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:12:23.822799 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bf5db898-b50d-4af9-9462-d13b8110be65 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.693714 Aug 24 10:12:23.824772 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 214/407] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:12:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 1697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:12:23.829409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-f6cb48a8-9a1d-4db5-bbf4-16b4ac838920 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for user bf03c0eb5bd748ae85be830f1121dc06 and project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'server_groups'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:12:23.831110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a7be51e2-7ed0-4720-ade5-25caea36ce0f req-460ccdfc-9afe-4a22-a0a9-bb32ae8c5811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c47edc7-c2c0-43d3-a96a-b779f1d0723c", "name": "network-vif-plugged", "status": "completed", "tag": "72420fbc-8d93-4dca-b4e0-67240b59047b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:23.851223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a7be51e2-7ed0-4720-ade5-25caea36ce0f req-460ccdfc-9afe-4a22-a0a9-bb32ae8c5811 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:23.852366 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a7be51e2-7ed0-4720-ade5-25caea36ce0f req-460ccdfc-9afe-4a22-a0a9-bb32ae8c5811 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:23.853104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a7be51e2-7ed0-4720-ade5-25caea36ce0f req-460ccdfc-9afe-4a22-a0a9-bb32ae8c5811 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:23.871803 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a7be51e2-7ed0-4720-ade5-25caea36ce0f req-460ccdfc-9afe-4a22-a0a9-bb32ae8c5811 service nova] Creating event network-vif-plugged:72420fbc-8d93-4dca-b4e0-67240b59047b for instance 9c47edc7-c2c0-43d3-a96a-b779f1d0723c on n-h2-849328-3 Aug 24 10:12:23.879486 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a7be51e2-7ed0-4720-ade5-25caea36ce0f req-460ccdfc-9afe-4a22-a0a9-bb32ae8c5811 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052705 Aug 24 10:12:23.880957 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 215/408] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:23.890182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e3db8451-0a58-49a5-8f0c-51f986c89666 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:23.892347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e3db8451-0a58-49a5-8f0c-51f986c89666 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 539f1a18-c5df-43d2-8d13-b7315424efb2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:23.899784 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f6cb48a8-9a1d-4db5-bbf4-16b4ac838920 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.286884 Aug 24 10:12:23.902501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3db8451-0a58-49a5-8f0c-51f986c89666 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:23.903286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3db8451-0a58-49a5-8f0c-51f986c89666 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:23.903941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3db8451-0a58-49a5-8f0c-51f986c89666 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:23.905246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3db8451-0a58-49a5-8f0c-51f986c89666 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:23.905961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3db8451-0a58-49a5-8f0c-51f986c89666 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:23.906601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3db8451-0a58-49a5-8f0c-51f986c89666 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:23.914641 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 194/409] 10.222.0.85 () {60 vars in 1174 bytes} [Wed Aug 24 10:12:23 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:23.921160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f638b5ca-5d2e-4e5f-8105-1477829823bb tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Calling method '.version_select at 0x7f4655692310>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:23.925073 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:12:23.925073 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:12:23.927126 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f638b5ca-5d2e-4e5f-8105-1477829823bb tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:23.929974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f638b5ca-5d2e-4e5f-8105-1477829823bb tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:23.932155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f638b5ca-5d2e-4e5f-8105-1477829823bb tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:23.933201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f638b5ca-5d2e-4e5f-8105-1477829823bb tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:23.934674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f638b5ca-5d2e-4e5f-8105-1477829823bb tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:23.935645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f638b5ca-5d2e-4e5f-8105-1477829823bb tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:23.993345 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f638b5ca-5d2e-4e5f-8105-1477829823bb tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.076462 Aug 24 10:12:23.994533 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 195/410] 10.222.0.85 () {58 vars in 1155 bytes} [Wed Aug 24 10:12:23 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:24.013173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ffe1a0a1-45bc-4a33-b59c-06d57d3e3c16 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:24.014799 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ffe1a0a1-45bc-4a33-b59c-06d57d3e3c16 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:24.023984 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffe1a0a1-45bc-4a33-b59c-06d57d3e3c16 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:24.026654 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffe1a0a1-45bc-4a33-b59c-06d57d3e3c16 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:24.027437 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffe1a0a1-45bc-4a33-b59c-06d57d3e3c16 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:24.028932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffe1a0a1-45bc-4a33-b59c-06d57d3e3c16 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:24.029759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffe1a0a1-45bc-4a33-b59c-06d57d3e3c16 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:24.030468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffe1a0a1-45bc-4a33-b59c-06d57d3e3c16 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:24.461041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ffe1a0a1-45bc-4a33-b59c-06d57d3e3c16 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:24.475350 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ffe1a0a1-45bc-4a33-b59c-06d57d3e3c16 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1313 microversion: 2.1 time: 0.465652 Aug 24 10:12:24.476132 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 196/411] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:24 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1313 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:24.511160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dc82794c-da8b-4572-b231-5c9c6101c980 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:24.512558 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dc82794c-da8b-4572-b231-5c9c6101c980 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: d5911032-bcaa-4a3d-bb73-ccbea62de79b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:24.753594 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dc82794c-da8b-4572-b231-5c9c6101c980 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:24.765790 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dc82794c-da8b-4572-b231-5c9c6101c980 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b" status: 200 len: 1262 microversion: 2.1 time: 0.264334 Aug 24 10:12:24.766553 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 197/412] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:24 2022] GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b => generated 1262 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:24.785896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2460a344-6d6d-4773-b7f9-71bde75b6aba tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Calling method '.version_select at 0x7f46555e1af0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:24.788849 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:12:24.788849 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:12:24.791240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2460a344-6d6d-4773-b7f9-71bde75b6aba tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:24.792127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2460a344-6d6d-4773-b7f9-71bde75b6aba tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:24.792588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2460a344-6d6d-4773-b7f9-71bde75b6aba tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:24.793392 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2460a344-6d6d-4773-b7f9-71bde75b6aba tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:24.796322 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2460a344-6d6d-4773-b7f9-71bde75b6aba tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:24.799681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2460a344-6d6d-4773-b7f9-71bde75b6aba tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:24.888718 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2460a344-6d6d-4773-b7f9-71bde75b6aba tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.107391 Aug 24 10:12:24.890008 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 198/413] 10.222.0.85 () {58 vars in 1128 bytes} [Wed Aug 24 10:12:24 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:24.903798 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-14a8ad41-7c5a-4bae-a1b4-aaa1e61f407f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:24.905374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-14a8ad41-7c5a-4bae-a1b4-aaa1e61f407f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:24.913238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=94,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:24.924427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14a8ad41-7c5a-4bae-a1b4-aaa1e61f407f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:24.926495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14a8ad41-7c5a-4bae-a1b4-aaa1e61f407f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:24.928483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14a8ad41-7c5a-4bae-a1b4-aaa1e61f407f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:24.929651 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14a8ad41-7c5a-4bae-a1b4-aaa1e61f407f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:24.930284 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14a8ad41-7c5a-4bae-a1b4-aaa1e61f407f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:24.931487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14a8ad41-7c5a-4bae-a1b4-aaa1e61f407f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:25.119949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e3db8451-0a58-49a5-8f0c-51f986c89666 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:25.142807 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e3db8451-0a58-49a5-8f0c-51f986c89666 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2" status: 200 len: 1472 microversion: 2.1 time: 1.259579 Aug 24 10:12:25.146657 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 216/414] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:23 2022] GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2 => generated 1472 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:25.159191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f32c8295-5a23-491f-81f6-a3cf0e2a27ac tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2048407865", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "231c8b11-a163-483b-b7a0-21f5ef8e7282"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:25.366283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-f32c8295-5a23-491f-81f6-a3cf0e2a27ac tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:12:25.377304 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-14a8ad41-7c5a-4bae-a1b4-aaa1e61f407f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:25.388725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-14a8ad41-7c5a-4bae-a1b4-aaa1e61f407f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:25.390638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-14a8ad41-7c5a-4bae-a1b4-aaa1e61f407f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:25.392069 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-14a8ad41-7c5a-4bae-a1b4-aaa1e61f407f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 200 len: 1569 microversion: 2.25 time: 0.500931 Aug 24 10:12:25.392717 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 199/415] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:24 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 1569 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:25.397952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8e1a39b1-f97a-496a-978b-e25c9ae3c2cc tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:25.398693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8e1a39b1-f97a-496a-978b-e25c9ae3c2cc tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 9c47edc7-c2c0-43d3-a96a-b779f1d0723c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:25.405404 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e1a39b1-f97a-496a-978b-e25c9ae3c2cc tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:25.406283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e1a39b1-f97a-496a-978b-e25c9ae3c2cc tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:25.407000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e1a39b1-f97a-496a-978b-e25c9ae3c2cc tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:25.408025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e1a39b1-f97a-496a-978b-e25c9ae3c2cc tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:25.408694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e1a39b1-f97a-496a-978b-e25c9ae3c2cc tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:25.409376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e1a39b1-f97a-496a-978b-e25c9ae3c2cc tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:25.773046 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8e1a39b1-f97a-496a-978b-e25c9ae3c2cc tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:25.789295 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8e1a39b1-f97a-496a-978b-e25c9ae3c2cc tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c" status: 200 len: 1319 microversion: 2.1 time: 0.394990 Aug 24 10:12:25.804128 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 200/416] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:25 2022] GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c => generated 1319 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:25.804128 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f35baf6a-7669-4a74-b472-a4d5335cf227 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Calling method '.version_select at 0x7f4655905940>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:25.804128 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:12:25.804128 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:12:25.810621 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f35baf6a-7669-4a74-b472-a4d5335cf227 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:25.811353 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f35baf6a-7669-4a74-b472-a4d5335cf227 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:25.811868 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f35baf6a-7669-4a74-b472-a4d5335cf227 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:25.833159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f35baf6a-7669-4a74-b472-a4d5335cf227 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:25.833671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f35baf6a-7669-4a74-b472-a4d5335cf227 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:25.834244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f35baf6a-7669-4a74-b472-a4d5335cf227 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:25.890106 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f35baf6a-7669-4a74-b472-a4d5335cf227 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hosts/n-h2-849328-3" status: 200 len: 729 microversion: 2.1 time: 0.097594 Aug 24 10:12:25.890905 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 201/417] 10.222.0.85 () {58 vars in 1170 bytes} [Wed Aug 24 10:12:25 2022] GET /compute/v2.1/os-hosts/n-h2-849328-3 => generated 729 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:25.909679 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9aab7c0c-6a2f-47ee-86b2-db66e2e11a00 req-aa63de6b-2cd6-4e03-8b91-b2f203b77aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e6f46da-f3b6-41ec-96f2-a3db16593a10", "name": "network-vif-deleted", "tag": "759674c4-7256-4865-8493-4fa0e5a87e8e"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:25.949680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9aab7c0c-6a2f-47ee-86b2-db66e2e11a00 req-aa63de6b-2cd6-4e03-8b91-b2f203b77aa1 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:25.950193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9aab7c0c-6a2f-47ee-86b2-db66e2e11a00 req-aa63de6b-2cd6-4e03-8b91-b2f203b77aa1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:25.950632 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9aab7c0c-6a2f-47ee-86b2-db66e2e11a00 req-aa63de6b-2cd6-4e03-8b91-b2f203b77aa1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:25.991775 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9aab7c0c-6a2f-47ee-86b2-db66e2e11a00 req-aa63de6b-2cd6-4e03-8b91-b2f203b77aa1 service nova] Creating event network-vif-deleted:759674c4-7256-4865-8493-4fa0e5a87e8e for instance 7e6f46da-f3b6-41ec-96f2-a3db16593a10 on n-h1-849328-3 Aug 24 10:12:26.019429 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9aab7c0c-6a2f-47ee-86b2-db66e2e11a00 req-aa63de6b-2cd6-4e03-8b91-b2f203b77aa1 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118337 Aug 24 10:12:26.025886 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 202/418] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:26.041955 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-832363b5-b2a8-421c-9d1b-940a86c5b282 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:26.045339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-832363b5-b2a8-421c-9d1b-940a86c5b282 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] [instance: 539f1a18-c5df-43d2-8d13-b7315424efb2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:26.067517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-832363b5-b2a8-421c-9d1b-940a86c5b282 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:26.068986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-832363b5-b2a8-421c-9d1b-940a86c5b282 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:26.069628 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-832363b5-b2a8-421c-9d1b-940a86c5b282 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:26.071760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-832363b5-b2a8-421c-9d1b-940a86c5b282 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:26.074115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-832363b5-b2a8-421c-9d1b-940a86c5b282 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:26.075922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-832363b5-b2a8-421c-9d1b-940a86c5b282 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:26.141601 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-832363b5-b2a8-421c-9d1b-940a86c5b282 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Lazy-loading 'flavor' on Instance uuid 539f1a18-c5df-43d2-8d13-b7315424efb2 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:12:26.322005 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-832363b5-b2a8-421c-9d1b-940a86c5b282 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2/action" status: 202 len: 0 microversion: 2.1 time: 0.292013 Aug 24 10:12:26.329213 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 203/419] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:12:26 2022] POST /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:12:26.337675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0a771dc8-8a0a-4fa4-85ab-8906a07f3b21 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:26.340089 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0a771dc8-8a0a-4fa4-85ab-8906a07f3b21 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:26.352988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a771dc8-8a0a-4fa4-85ab-8906a07f3b21 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:26.353811 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a771dc8-8a0a-4fa4-85ab-8906a07f3b21 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:26.354601 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a771dc8-8a0a-4fa4-85ab-8906a07f3b21 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:26.355615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a771dc8-8a0a-4fa4-85ab-8906a07f3b21 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:26.356277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a771dc8-8a0a-4fa4-85ab-8906a07f3b21 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:26.356902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a771dc8-8a0a-4fa4-85ab-8906a07f3b21 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:26.605208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-f32c8295-5a23-491f-81f6-a3cf0e2a27ac tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:12:26.606506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-f32c8295-5a23-491f-81f6-a3cf0e2a27ac tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:12:26.608065 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-f32c8295-5a23-491f-81f6-a3cf0e2a27ac tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:12:26.613586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-f32c8295-5a23-491f-81f6-a3cf0e2a27ac tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:12:26.614583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-f32c8295-5a23-491f-81f6-a3cf0e2a27ac tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:12:26.628762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:26.696064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0a771dc8-8a0a-4fa4-85ab-8906a07f3b21 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:26.707848 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0a771dc8-8a0a-4fa4-85ab-8906a07f3b21 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1313 microversion: 2.1 time: 0.377110 Aug 24 10:12:26.708843 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 204/420] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:26 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:26.712978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f32c8295-5a23-491f-81f6-a3cf0e2a27ac tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:26.713863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f32c8295-5a23-491f-81f6-a3cf0e2a27ac tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:26.714658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f32c8295-5a23-491f-81f6-a3cf0e2a27ac tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:26.715742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f32c8295-5a23-491f-81f6-a3cf0e2a27ac tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:26.716503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f32c8295-5a23-491f-81f6-a3cf0e2a27ac tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:26.717432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f32c8295-5a23-491f-81f6-a3cf0e2a27ac tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:26.725031 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aa696b41-e1cb-407a-8d19-53b9ba65e274 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:26.726508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aa696b41-e1cb-407a-8d19-53b9ba65e274 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: d5911032-bcaa-4a3d-bb73-ccbea62de79b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:26.740685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa696b41-e1cb-407a-8d19-53b9ba65e274 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:26.743252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa696b41-e1cb-407a-8d19-53b9ba65e274 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:26.744121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa696b41-e1cb-407a-8d19-53b9ba65e274 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:26.745484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa696b41-e1cb-407a-8d19-53b9ba65e274 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:26.746987 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa696b41-e1cb-407a-8d19-53b9ba65e274 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:26.747651 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa696b41-e1cb-407a-8d19-53b9ba65e274 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:26.758829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f32c8295-5a23-491f-81f6-a3cf0e2a27ac tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:12:26.768184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f32c8295-5a23-491f-81f6-a3cf0e2a27ac tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for user bf03c0eb5bd748ae85be830f1121dc06 and project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:12:26.821378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f32c8295-5a23-491f-81f6-a3cf0e2a27ac tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Going to run 2 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:12:26.829626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f32c8295-5a23-491f-81f6-a3cf0e2a27ac tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: db566c0d-ce6a-4d8d-bba4-c1480a160d01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:12:26.926010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f32c8295-5a23-491f-81f6-a3cf0e2a27ac tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122433) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 24 10:12:26.958654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f32c8295-5a23-491f-81f6-a3cf0e2a27ac tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:12:26.968735 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f32c8295-5a23-491f-81f6-a3cf0e2a27ac tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for user bf03c0eb5bd748ae85be830f1121dc06 and project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:12:27.008729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aa696b41-e1cb-407a-8d19-53b9ba65e274 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:27.027821 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aa696b41-e1cb-407a-8d19-53b9ba65e274 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b" status: 200 len: 1320 microversion: 2.1 time: 0.316561 Aug 24 10:12:27.029804 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 205/421] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:26 2022] GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b => generated 1320 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:27.043102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b29a49dd-535e-470a-a650-f543501927e2 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Calling method '.version_select at 0x7f4655837ee0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:27.047120 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:12:27.047120 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:12:27.059192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b29a49dd-535e-470a-a650-f543501927e2 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:27.060576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b29a49dd-535e-470a-a650-f543501927e2 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:27.061288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b29a49dd-535e-470a-a650-f543501927e2 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:27.081018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f32c8295-5a23-491f-81f6-a3cf0e2a27ac tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:12:27.088113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f32c8295-5a23-491f-81f6-a3cf0e2a27ac tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for user bf03c0eb5bd748ae85be830f1121dc06 and project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:12:27.096527 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b29a49dd-535e-470a-a650-f543501927e2 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:27.097323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b29a49dd-535e-470a-a650-f543501927e2 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:27.098158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b29a49dd-535e-470a-a650-f543501927e2 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:27.117812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f32c8295-5a23-491f-81f6-a3cf0e2a27ac tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: b00174fc-a16c-4ae5-94d3-d43b9c963cf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=db566c0d-ce6a-4d8d-bba4-c1480a160d01,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:12:27.149205 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b29a49dd-535e-470a-a650-f543501927e2 tempest-HostsAdminTestJSON-1127595501 tempest-HostsAdminTestJSON-1127595501-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hosts/n-h1-849328-3" status: 200 len: 729 microversion: 2.1 time: 0.104455 Aug 24 10:12:27.154816 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 206/422] 10.222.0.85 () {58 vars in 1170 bytes} [Wed Aug 24 10:12:27 2022] GET /compute/v2.1/os-hosts/n-h1-849328-3 => generated 729 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:27.175873 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-cf7bc5a7-b10c-4981-bc17-b92958e85f02 req-22f481a7-bf65-425c-b2cf-67cfa0a0dba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f", "name": "network-vif-plugged", "status": "completed", "tag": "29c5a4d8-1573-48ff-8439-153b2e7ce8e8"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:27.205671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cf7bc5a7-b10c-4981-bc17-b92958e85f02 req-22f481a7-bf65-425c-b2cf-67cfa0a0dba4 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:27.210253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cf7bc5a7-b10c-4981-bc17-b92958e85f02 req-22f481a7-bf65-425c-b2cf-67cfa0a0dba4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:27.216231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f32c8295-5a23-491f-81f6-a3cf0e2a27ac tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:12:27.217405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cf7bc5a7-b10c-4981-bc17-b92958e85f02 req-22f481a7-bf65-425c-b2cf-67cfa0a0dba4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:27.223225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f32c8295-5a23-491f-81f6-a3cf0e2a27ac tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for user bf03c0eb5bd748ae85be830f1121dc06 and project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:12:27.241822 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-cf7bc5a7-b10c-4981-bc17-b92958e85f02 req-22f481a7-bf65-425c-b2cf-67cfa0a0dba4 service nova] Creating event network-vif-plugged:29c5a4d8-1573-48ff-8439-153b2e7ce8e8 for instance a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f on n-h2-849328-3 Aug 24 10:12:27.248238 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-cf7bc5a7-b10c-4981-bc17-b92958e85f02 req-22f481a7-bf65-425c-b2cf-67cfa0a0dba4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088858 Aug 24 10:12:27.257995 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 207/423] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:27.267797 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-6c4d60ae-5164-4921-b488-d60f9aa5834b req-60328733-898e-4db5-bc7c-24b63b923b1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "162790d5-1b97-47d9-b4df-c897b854a902", "name": "network-vif-unplugged", "status": "completed", "tag": "85bbaf28-5677-4b68-aba7-3a4c5c84ab6a"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:27.281423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6c4d60ae-5164-4921-b488-d60f9aa5834b req-60328733-898e-4db5-bc7c-24b63b923b1a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:27.288144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6c4d60ae-5164-4921-b488-d60f9aa5834b req-60328733-898e-4db5-bc7c-24b63b923b1a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:27.289540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6c4d60ae-5164-4921-b488-d60f9aa5834b req-60328733-898e-4db5-bc7c-24b63b923b1a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:27.311231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f32c8295-5a23-491f-81f6-a3cf0e2a27ac tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:12:27.316074 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-6c4d60ae-5164-4921-b488-d60f9aa5834b req-60328733-898e-4db5-bc7c-24b63b923b1a service nova] Creating event network-vif-unplugged:85bbaf28-5677-4b68-aba7-3a4c5c84ab6a for instance 162790d5-1b97-47d9-b4df-c897b854a902 on n-h1-849328-3 Aug 24 10:12:27.323447 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-6c4d60ae-5164-4921-b488-d60f9aa5834b req-60328733-898e-4db5-bc7c-24b63b923b1a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063017 Aug 24 10:12:27.324468 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 208/424] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:27.326922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f32c8295-5a23-491f-81f6-a3cf0e2a27ac tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for user bf03c0eb5bd748ae85be830f1121dc06 and project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:12:27.333716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c7e26c17-1d1f-4295-8267-afaaa31ce049 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:27.334705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c7e26c17-1d1f-4295-8267-afaaa31ce049 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] [instance: 539f1a18-c5df-43d2-8d13-b7315424efb2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:27.346945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7e26c17-1d1f-4295-8267-afaaa31ce049 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:27.348997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7e26c17-1d1f-4295-8267-afaaa31ce049 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:27.349726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7e26c17-1d1f-4295-8267-afaaa31ce049 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:27.351242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7e26c17-1d1f-4295-8267-afaaa31ce049 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:27.351937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7e26c17-1d1f-4295-8267-afaaa31ce049 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:27.353835 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7e26c17-1d1f-4295-8267-afaaa31ce049 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:27.422166 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f32c8295-5a23-491f-81f6-a3cf0e2a27ac tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.268075 Aug 24 10:12:27.425457 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 217/425] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:12:25 2022] POST /compute/v2.1/servers => generated 32 bytes in 2272 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 24 10:12:27.437613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-804e9854-0add-43f0-b2c3-6ab551028c26 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:27.438287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-804e9854-0add-43f0-b2c3-6ab551028c26 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:27.453266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-804e9854-0add-43f0-b2c3-6ab551028c26 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:27.454952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-804e9854-0add-43f0-b2c3-6ab551028c26 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:27.457748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-804e9854-0add-43f0-b2c3-6ab551028c26 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:27.458745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-804e9854-0add-43f0-b2c3-6ab551028c26 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:27.459462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-804e9854-0add-43f0-b2c3-6ab551028c26 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:27.460887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-804e9854-0add-43f0-b2c3-6ab551028c26 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:27.769340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-804e9854-0add-43f0-b2c3-6ab551028c26 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:27.780482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-804e9854-0add-43f0-b2c3-6ab551028c26 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:27.782716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-804e9854-0add-43f0-b2c3-6ab551028c26 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:27.784470 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-804e9854-0add-43f0-b2c3-6ab551028c26 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 200 len: 1569 microversion: 2.25 time: 0.357543 Aug 24 10:12:27.785277 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 218/426] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:27 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 1569 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:27.807314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c9fd6b56-f76d-4554-aed7-191558e58667 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:27.808641 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c9fd6b56-f76d-4554-aed7-191558e58667 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 9c47edc7-c2c0-43d3-a96a-b779f1d0723c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:27.815657 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9fd6b56-f76d-4554-aed7-191558e58667 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:27.816397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9fd6b56-f76d-4554-aed7-191558e58667 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:27.817015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9fd6b56-f76d-4554-aed7-191558e58667 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:27.818561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9fd6b56-f76d-4554-aed7-191558e58667 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:27.819199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9fd6b56-f76d-4554-aed7-191558e58667 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:27.819800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9fd6b56-f76d-4554-aed7-191558e58667 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:28.100786 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c7e26c17-1d1f-4295-8267-afaaa31ce049 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2" status: 200 len: 1614 microversion: 2.1 time: 0.774192 Aug 24 10:12:28.101747 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 209/427] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:27 2022] GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2 => generated 1614 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:28.118459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-72099c80-bad0-4b44-b583-1b609622860c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-625282563", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "25651226-4d53-475d-a4a5-3dd5e1c5a329"}], "security_groups": [{"name": "tempest-securitygroup--131801563"}], "key_name": "tempest-keypair-719838166", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:28.124589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c9fd6b56-f76d-4554-aed7-191558e58667 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:28.145860 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c9fd6b56-f76d-4554-aed7-191558e58667 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c" status: 200 len: 1469 microversion: 2.1 time: 0.345897 Aug 24 10:12:28.158295 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 219/428] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:27 2022] GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c => generated 1469 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:28.158295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b8a6d2c7-e834-4243-8255-63382eaab0a3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:28.174180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b8a6d2c7-e834-4243-8255-63382eaab0a3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:28.175184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b8a6d2c7-e834-4243-8255-63382eaab0a3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Searching by: {'deleted': False, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:12:28.270727 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8a6d2c7-e834-4243-8255-63382eaab0a3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:28.278011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8a6d2c7-e834-4243-8255-63382eaab0a3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:28.280096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8a6d2c7-e834-4243-8255-63382eaab0a3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:28.281624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8a6d2c7-e834-4243-8255-63382eaab0a3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:28.282226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8a6d2c7-e834-4243-8255-63382eaab0a3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:28.287199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8a6d2c7-e834-4243-8255-63382eaab0a3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:28.603497 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-b8a6d2c7-e834-4243-8255-63382eaab0a3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:12:28.826024 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b8a6d2c7-e834-4243-8255-63382eaab0a3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.677319 Aug 24 10:12:28.827545 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 220/429] 10.222.0.85 () {58 vars in 1125 bytes} [Wed Aug 24 10:12:28 2022] GET /compute/v2.1/servers => generated 1004 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:28.841053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ab9c648e-a8c3-4c8b-9aa8-cf4fb8108b33 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:28.847792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ab9c648e-a8c3-4c8b-9aa8-cf4fb8108b33 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:28.863937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab9c648e-a8c3-4c8b-9aa8-cf4fb8108b33 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:28.864554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab9c648e-a8c3-4c8b-9aa8-cf4fb8108b33 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:28.865013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab9c648e-a8c3-4c8b-9aa8-cf4fb8108b33 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:28.870609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab9c648e-a8c3-4c8b-9aa8-cf4fb8108b33 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:28.870609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab9c648e-a8c3-4c8b-9aa8-cf4fb8108b33 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:28.871899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab9c648e-a8c3-4c8b-9aa8-cf4fb8108b33 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:28.974050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-72099c80-bad0-4b44-b583-1b609622860c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] validate_networks() for [('25651226-4d53-475d-a4a5-3dd5e1c5a329', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:12:29.249753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ab9c648e-a8c3-4c8b-9aa8-cf4fb8108b33 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:29.259426 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ab9c648e-a8c3-4c8b-9aa8-cf4fb8108b33 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1313 microversion: 2.1 time: 0.429422 Aug 24 10:12:29.260257 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 221/430] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:28 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1313 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:29.268543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-484168e0-a32e-4561-ac28-b521a2edfab3 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:29.269173 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-484168e0-a32e-4561-ac28-b521a2edfab3 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: d5911032-bcaa-4a3d-bb73-ccbea62de79b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:29.299140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-484168e0-a32e-4561-ac28-b521a2edfab3 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:29.300776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-484168e0-a32e-4561-ac28-b521a2edfab3 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:29.302173 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-484168e0-a32e-4561-ac28-b521a2edfab3 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:29.303799 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-484168e0-a32e-4561-ac28-b521a2edfab3 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:29.305143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-484168e0-a32e-4561-ac28-b521a2edfab3 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:29.306450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-484168e0-a32e-4561-ac28-b521a2edfab3 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:29.683816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-484168e0-a32e-4561-ac28-b521a2edfab3 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:29.693981 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-484168e0-a32e-4561-ac28-b521a2edfab3 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b" status: 200 len: 1387 microversion: 2.1 time: 0.429315 Aug 24 10:12:29.694591 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 222/431] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:29 2022] GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b => generated 1387 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:29.704011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8717b76c-a6c9-45bc-b9d3-637c039f32ee tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:29.705159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8717b76c-a6c9-45bc-b9d3-637c039f32ee tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] [instance: 539f1a18-c5df-43d2-8d13-b7315424efb2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:29.713003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8717b76c-a6c9-45bc-b9d3-637c039f32ee tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:29.714038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8717b76c-a6c9-45bc-b9d3-637c039f32ee tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:29.714667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8717b76c-a6c9-45bc-b9d3-637c039f32ee tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:29.716206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8717b76c-a6c9-45bc-b9d3-637c039f32ee tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:29.717014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8717b76c-a6c9-45bc-b9d3-637c039f32ee tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:29.717636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8717b76c-a6c9-45bc-b9d3-637c039f32ee tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:29.868095 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-8717b76c-a6c9-45bc-b9d3-637c039f32ee tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] HTTP exception thrown: Cannot 'migrate' instance 539f1a18-c5df-43d2-8d13-b7315424efb2 while it is in vm_state suspended Aug 24 10:12:29.872833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8717b76c-a6c9-45bc-b9d3-637c039f32ee tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Request method failure captured: Aug 24 10:12:29.872833 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2/action HTTP/1.1 Aug 24 10:12:29.872833 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:12:29.872833 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:12:29.872833 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:12:29.872833 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 15 Aug 24 10:12:29.872833 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:12:29.872833 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:12:29.872833 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:12:29.872833 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:12:29.872833 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBflb0DMOekRrSzFqBNwVgqCgG1pmAP2DoCwO7gScv48QEWxoh48Lim2hIHT1Q2eU5R35r47G7MaiobVjvtbyem4drmYY_x5I-T97s3G3C-3weQFPy93wr0UtZdENFdaAwff90DGJol4igz3x1PU_N_iZQVK2Hfpsl52OIyqIA3NFXFY Aug 24 10:12:29.872833 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:12:29.872833 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:12:29.872833 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:12:29.872833 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:12:29.872833 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:12:29.872833 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:12:29.872833 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: af6fefe9606745558ae536b007880b4e Aug 24 10:12:29.872833 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-686592460 Aug 24 10:12:29.872833 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:12:29.872833 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:12:29.874930 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/af6fefe9606745558ae536b007880b4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_af6fefe9606745558ae536b007880b4e", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/af6fefe9606745558ae536b007880b4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/af6fefe9606745558ae536b007880b4e"}]}] Aug 24 10:12:29.874930 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersAdminNegativeTestJSON-686592460 Aug 24 10:12:29.874930 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: af6fefe9606745558ae536b007880b4e Aug 24 10:12:29.874930 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-686592460 Aug 24 10:12:29.874930 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersAdminNegativeTestJSON-686592460-project-admin Aug 24 10:12:29.874930 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:12:29.874930 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:12:29.874930 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: ae7e17af63b9448a8e423085c2c9a99e Aug 24 10:12:29.874930 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersAdminNegativeTestJSON-686592460-project-admin Aug 24 10:12:29.874930 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:12:29.874930 n-d-849328-3 devstack@n-api.service[122433]: {"migrate": {}} Aug 24 10:12:29.874930 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:12:29.874930 n-d-849328-3 devstack@n-api.service[122433]: exception: Cannot 'migrate' instance 539f1a18-c5df-43d2-8d13-b7315424efb2 while it is in vm_state suspended Aug 24 10:12:29.876367 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '539f1a18-c5df-43d2-8d13-b7315424efb2', 'body': {'migrate': {}}} Aug 24 10:12:29.876367 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:12:29.876367 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:29.876367 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 24 10:12:29.876367 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 24 10:12:29.876367 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 24 10:12:29.876367 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 10:12:29.876367 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 24 10:12:29.876367 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 10:12:29.876367 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 24 10:12:29.876367 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 10:12:29.876367 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 10:12:29.876367 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 10:12:29.876367 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 10:12:29.876367 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 10:12:29.876367 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 539f1a18-c5df-43d2-8d13-b7315424efb2 in vm_state suspended. Cannot resize while the instance is in this state. Aug 24 10:12:29.876367 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:29.876367 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:29.876367 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:29.876367 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:29.879070 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:29.879070 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:29.879070 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:12:29.879070 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:12:29.879070 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:12:29.879070 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:12:29.879070 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:12:29.879070 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:12:29.879070 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 24 10:12:29.879070 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 10:12:29.879070 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 10:12:29.879070 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 10:12:29.879070 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 539f1a18-c5df-43d2-8d13-b7315424efb2 while it is in vm_state suspended Aug 24 10:12:29.879070 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:29.879070 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:29.879070 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:29.879070 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:29.879070 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:29.879070 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:29.880932 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:12:29.880932 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:12:29.880932 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 539f1a18-c5df-43d2-8d13-b7315424efb2 while it is in vm_state suspended Aug 24 10:12:29.880932 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:29.880932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8717b76c-a6c9-45bc-b9d3-637c039f32ee tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Returning 409 to user: Cannot 'migrate' instance 539f1a18-c5df-43d2-8d13-b7315424efb2 while it is in vm_state suspended {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:12:29.880932 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8717b76c-a6c9-45bc-b9d3-637c039f32ee tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2/action" status: 409 len: 148 microversion: 2.1 time: 0.175820 Aug 24 10:12:29.884155 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 223/432] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:12:29 2022] POST /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2/action => generated 148 bytes in 188 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:12:29.948732 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-72099c80-bad0-4b44-b583-1b609622860c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:12:29.949470 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-72099c80-bad0-4b44-b583-1b609622860c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:12:29.950594 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-72099c80-bad0-4b44-b583-1b609622860c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:12:29.951277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-72099c80-bad0-4b44-b583-1b609622860c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:12:29.952057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-72099c80-bad0-4b44-b583-1b609622860c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:12:29.983794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72099c80-bad0-4b44-b583-1b609622860c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:29.986086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72099c80-bad0-4b44-b583-1b609622860c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:29.988171 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72099c80-bad0-4b44-b583-1b609622860c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:29.992536 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72099c80-bad0-4b44-b583-1b609622860c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:29.995711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72099c80-bad0-4b44-b583-1b609622860c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:29.997752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72099c80-bad0-4b44-b583-1b609622860c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:30.038053 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-72099c80-bad0-4b44-b583-1b609622860c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Getting quotas for project d6a57c8760d34630aa410aa3f7a96edd. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:12:30.048149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-72099c80-bad0-4b44-b583-1b609622860c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Getting quotas for user 360dc9ca253340f79dfb2c14f04c7445 and project d6a57c8760d34630aa410aa3f7a96edd. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:12:30.072733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-72099c80-bad0-4b44-b583-1b609622860c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:12:30.077039 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-72099c80-bad0-4b44-b583-1b609622860c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:12:30.170503 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-72099c80-bad0-4b44-b583-1b609622860c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.067064 Aug 24 10:12:30.191351 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 210/433] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:12:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 2089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:12:30.207874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6aee0d23-3428-429d-920b-51b3792be38c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:30.208850 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6aee0d23-3428-429d-920b-51b3792be38c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:30.220764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aee0d23-3428-429d-920b-51b3792be38c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:30.221890 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aee0d23-3428-429d-920b-51b3792be38c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:30.222674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aee0d23-3428-429d-920b-51b3792be38c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:30.223842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aee0d23-3428-429d-920b-51b3792be38c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:30.224446 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aee0d23-3428-429d-920b-51b3792be38c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:30.225032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aee0d23-3428-429d-920b-51b3792be38c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:30.316293 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:30.368294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1f63f874-3aad-482f-836d-bdf2f15142e8 tempest-DeleteServersAdminTestJSON-2039929978 tempest-DeleteServersAdminTestJSON-2039929978-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:30.368788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1f63f874-3aad-482f-836d-bdf2f15142e8 tempest-DeleteServersAdminTestJSON-2039929978 tempest-DeleteServersAdminTestJSON-2039929978-project-admin] [instance: 9c47edc7-c2c0-43d3-a96a-b779f1d0723c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:30.390466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f63f874-3aad-482f-836d-bdf2f15142e8 tempest-DeleteServersAdminTestJSON-2039929978 tempest-DeleteServersAdminTestJSON-2039929978-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:30.391442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f63f874-3aad-482f-836d-bdf2f15142e8 tempest-DeleteServersAdminTestJSON-2039929978 tempest-DeleteServersAdminTestJSON-2039929978-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:30.392158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f63f874-3aad-482f-836d-bdf2f15142e8 tempest-DeleteServersAdminTestJSON-2039929978 tempest-DeleteServersAdminTestJSON-2039929978-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:30.393449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f63f874-3aad-482f-836d-bdf2f15142e8 tempest-DeleteServersAdminTestJSON-2039929978 tempest-DeleteServersAdminTestJSON-2039929978-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:30.394161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f63f874-3aad-482f-836d-bdf2f15142e8 tempest-DeleteServersAdminTestJSON-2039929978 tempest-DeleteServersAdminTestJSON-2039929978-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:30.394859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f63f874-3aad-482f-836d-bdf2f15142e8 tempest-DeleteServersAdminTestJSON-2039929978 tempest-DeleteServersAdminTestJSON-2039929978-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:30.474695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1f63f874-3aad-482f-836d-bdf2f15142e8 tempest-DeleteServersAdminTestJSON-2039929978 tempest-DeleteServersAdminTestJSON-2039929978-project-admin] [instance: 9c47edc7-c2c0-43d3-a96a-b779f1d0723c] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:12:30.664777 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1f63f874-3aad-482f-836d-bdf2f15142e8 tempest-DeleteServersAdminTestJSON-2039929978 tempest-DeleteServersAdminTestJSON-2039929978-project-admin] 10.222.0.85 "DELETE /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c" status: 204 len: 0 microversion: 2.1 time: 0.776954 Aug 24 10:12:30.667955 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 224/434] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:12:29 2022] DELETE /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c => generated 0 bytes in 783 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:12:30.682332 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a640f042-b9e1-41de-ac4e-d201d06d34b7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:30.684014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a640f042-b9e1-41de-ac4e-d201d06d34b7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: b00174fc-a16c-4ae5-94d3-d43b9c963cf5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:30.696557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a640f042-b9e1-41de-ac4e-d201d06d34b7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:30.697466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a640f042-b9e1-41de-ac4e-d201d06d34b7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:30.698269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a640f042-b9e1-41de-ac4e-d201d06d34b7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:30.699468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a640f042-b9e1-41de-ac4e-d201d06d34b7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:30.700055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a640f042-b9e1-41de-ac4e-d201d06d34b7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:30.701052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a640f042-b9e1-41de-ac4e-d201d06d34b7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:30.784444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6aee0d23-3428-429d-920b-51b3792be38c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:30.829807 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6aee0d23-3428-429d-920b-51b3792be38c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:30.833780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a640f042-b9e1-41de-ac4e-d201d06d34b7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:30.842691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6aee0d23-3428-429d-920b-51b3792be38c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:30.849533 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6aee0d23-3428-429d-920b-51b3792be38c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 200 len: 1569 microversion: 2.25 time: 0.655726 Aug 24 10:12:30.851693 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a640f042-b9e1-41de-ac4e-d201d06d34b7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/b00174fc-a16c-4ae5-94d3-d43b9c963cf5" status: 200 len: 1271 microversion: 2.1 time: 0.181654 Aug 24 10:12:30.852968 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 225/435] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:30 2022] GET /compute/v2.1/servers/b00174fc-a16c-4ae5-94d3-d43b9c963cf5 => generated 1271 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:30.873802 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 211/436] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:30 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 1569 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:30.888992 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-68d46337-06d5-4019-a8cb-2570e44af412 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:30.895811 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-68d46337-06d5-4019-a8cb-2570e44af412 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Request method failure captured: Aug 24 10:12:30.895811 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871/action HTTP/1.1 Aug 24 10:12:30.895811 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:12:30.895811 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:12:30.895811 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:12:30.895811 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 39 Aug 24 10:12:30.895811 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:12:30.895811 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:12:30.895811 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:12:30.895811 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:12:30.895811 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBflb0DMOekRrSzFqBNwVgqCgG1pmAP2DoCwO7gScv48QEWxoh48Lim2hIHT1Q2eU5R35r47G7MaiobVjvtbyem4drmYY_x5I-T97s3G3C-3weQFPy93wr0UtZdENFdaAwff90DGJol4igz3x1PU_N_iZQVK2Hfpsl52OIyqIA3NFXFY Aug 24 10:12:30.895811 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:12:30.895811 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:12:30.895811 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:12:30.895811 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:12:30.895811 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:12:30.895811 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:12:30.895811 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: af6fefe9606745558ae536b007880b4e Aug 24 10:12:30.895811 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-686592460 Aug 24 10:12:30.895811 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,admin,member Aug 24 10:12:30.895811 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,admin,member Aug 24 10:12:30.898447 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/af6fefe9606745558ae536b007880b4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_af6fefe9606745558ae536b007880b4e", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/af6fefe9606745558ae536b007880b4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/af6fefe9606745558ae536b007880b4e"}]}] Aug 24 10:12:30.898447 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersAdminNegativeTestJSON-686592460 Aug 24 10:12:30.898447 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: af6fefe9606745558ae536b007880b4e Aug 24 10:12:30.898447 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-686592460 Aug 24 10:12:30.898447 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersAdminNegativeTestJSON-686592460-project-admin Aug 24 10:12:30.898447 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:12:30.898447 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:12:30.898447 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: ae7e17af63b9448a8e423085c2c9a99e Aug 24 10:12:30.898447 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersAdminNegativeTestJSON-686592460-project-admin Aug 24 10:12:30.898447 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:12:30.898447 n-d-849328-3 devstack@n-api.service[122432]: {"os-resetState": {"state": "invalid"}} Aug 24 10:12:30.898447 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:12:30.899758 n-d-849328-3 devstack@n-api.service[122432]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 24 10:12:30.899758 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '10f639ed-ba2f-4983-9c04-777480733871', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 24 10:12:30.899758 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:12:30.899758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:30.899758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:12:30.899758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:12:30.899758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:12:30.899758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:12:30.899758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 24 10:12:30.899758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:30.899758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 24 10:12:30.899758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 24 10:12:30.899758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:30.899758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 24 10:12:30.899758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'invalid' Aug 24 10:12:30.899758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:30.899758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:30.899758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:30.899758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:30.899758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:30.899758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:30.899758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:12:30.903908 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:12:30.903908 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:12:30.903908 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:12:30.903908 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:12:30.903908 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:12:30.903908 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:12:30.903908 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:12:30.903908 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:12:30.903908 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:12:30.903908 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 24 10:12:30.903908 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:30.903908 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:30.903908 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:30.903908 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:30.903908 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:30.903908 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:30.903908 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:12:30.903908 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:12:30.903908 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 24 10:12:30.907468 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:30.907468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-68d46337-06d5-4019-a8cb-2570e44af412 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:12:30.907468 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-68d46337-06d5-4019-a8cb-2570e44af412 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871/action" status: 400 len: 144 microversion: 2.1 time: 0.022826 Aug 24 10:12:30.907468 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 212/437] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:12:30 2022] POST /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871/action => generated 144 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:12:30.909326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-65679e3d-6e85-4434-b178-f0542608304e tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:30.909326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-65679e3d-6e85-4434-b178-f0542608304e tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:30.914516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-10d5919b-8f70-4864-9248-5a4bdab89e0f req-9a88a1a5-093b-4ef3-9b66-aa4e860cd4fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "162790d5-1b97-47d9-b4df-c897b854a902", "tag": "85bbaf28-5677-4b68-aba7-3a4c5c84ab6a"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:30.958707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-10d5919b-8f70-4864-9248-5a4bdab89e0f req-9a88a1a5-093b-4ef3-9b66-aa4e860cd4fd service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:30.960778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-10d5919b-8f70-4864-9248-5a4bdab89e0f req-9a88a1a5-093b-4ef3-9b66-aa4e860cd4fd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:30.962084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-10d5919b-8f70-4864-9248-5a4bdab89e0f req-9a88a1a5-093b-4ef3-9b66-aa4e860cd4fd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:31.014089 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-10d5919b-8f70-4864-9248-5a4bdab89e0f req-9a88a1a5-093b-4ef3-9b66-aa4e860cd4fd service nova] Creating event network-changed:85bbaf28-5677-4b68-aba7-3a4c5c84ab6a for instance 162790d5-1b97-47d9-b4df-c897b854a902 on n-h1-849328-3 Aug 24 10:12:31.033591 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-10d5919b-8f70-4864-9248-5a4bdab89e0f req-9a88a1a5-093b-4ef3-9b66-aa4e860cd4fd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161636 Aug 24 10:12:31.035254 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 226/438] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:31.098713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b6f095ab-0d72-4274-b41a-bd985fc6e746 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:31.109637 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b6f095ab-0d72-4274-b41a-bd985fc6e746 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:31.147314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6f095ab-0d72-4274-b41a-bd985fc6e746 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:31.150719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6f095ab-0d72-4274-b41a-bd985fc6e746 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:31.169270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6f095ab-0d72-4274-b41a-bd985fc6e746 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:31.171778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6f095ab-0d72-4274-b41a-bd985fc6e746 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:31.174521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6f095ab-0d72-4274-b41a-bd985fc6e746 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:31.178316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6f095ab-0d72-4274-b41a-bd985fc6e746 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:31.195551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-65679e3d-6e85-4434-b178-f0542608304e tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:31.214579 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-65679e3d-6e85-4434-b178-f0542608304e tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381" status: 200 len: 1240 microversion: 2.1 time: 0.313806 Aug 24 10:12:31.218744 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 213/439] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:30 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381 => generated 1240 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:31.246494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-ee46d130-460e-4569-b05a-2e25da914b93 req-d2e802be-b17e-49ba-9f07-9ca43ff4b0bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5911032-bcaa-4a3d-bb73-ccbea62de79b", "tag": "29857c60-2ade-4b2f-b518-b9ceee5755c9"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:31.293255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ee46d130-460e-4569-b05a-2e25da914b93 req-d2e802be-b17e-49ba-9f07-9ca43ff4b0bc service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:31.298709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ee46d130-460e-4569-b05a-2e25da914b93 req-d2e802be-b17e-49ba-9f07-9ca43ff4b0bc service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:31.299528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ee46d130-460e-4569-b05a-2e25da914b93 req-d2e802be-b17e-49ba-9f07-9ca43ff4b0bc service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:31.348595 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-ee46d130-460e-4569-b05a-2e25da914b93 req-d2e802be-b17e-49ba-9f07-9ca43ff4b0bc service nova] Creating event network-changed:29857c60-2ade-4b2f-b518-b9ceee5755c9 for instance d5911032-bcaa-4a3d-bb73-ccbea62de79b on n-h1-849328-3 Aug 24 10:12:31.361774 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-ee46d130-460e-4569-b05a-2e25da914b93 req-d2e802be-b17e-49ba-9f07-9ca43ff4b0bc service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137116 Aug 24 10:12:31.363676 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 214/440] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:31.377088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-94071b1e-6094-4f45-81ab-91a2fd9a726b tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:31.378608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-94071b1e-6094-4f45-81ab-91a2fd9a726b tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 9c47edc7-c2c0-43d3-a96a-b779f1d0723c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:31.390224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94071b1e-6094-4f45-81ab-91a2fd9a726b tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:31.391857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94071b1e-6094-4f45-81ab-91a2fd9a726b tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:31.393023 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94071b1e-6094-4f45-81ab-91a2fd9a726b tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:31.395495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94071b1e-6094-4f45-81ab-91a2fd9a726b tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:31.396566 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94071b1e-6094-4f45-81ab-91a2fd9a726b tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:31.397787 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94071b1e-6094-4f45-81ab-91a2fd9a726b tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:31.604859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b6f095ab-0d72-4274-b41a-bd985fc6e746 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:31.624665 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b6f095ab-0d72-4274-b41a-bd985fc6e746 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1463 microversion: 2.1 time: 0.582436 Aug 24 10:12:31.626016 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 227/441] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:31 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1463 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:31.647218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d809b06c-fe2d-4682-9fea-2aada7924264 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:31.648229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d809b06c-fe2d-4682-9fea-2aada7924264 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: d5911032-bcaa-4a3d-bb73-ccbea62de79b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:31.666767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d809b06c-fe2d-4682-9fea-2aada7924264 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:31.667304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d809b06c-fe2d-4682-9fea-2aada7924264 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:31.667742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d809b06c-fe2d-4682-9fea-2aada7924264 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:31.668463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d809b06c-fe2d-4682-9fea-2aada7924264 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:31.668926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d809b06c-fe2d-4682-9fea-2aada7924264 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:31.669380 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d809b06c-fe2d-4682-9fea-2aada7924264 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:31.950554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-94071b1e-6094-4f45-81ab-91a2fd9a726b tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:31.972752 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-94071b1e-6094-4f45-81ab-91a2fd9a726b tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c" status: 200 len: 1475 microversion: 2.1 time: 0.605934 Aug 24 10:12:31.976840 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 215/442] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:31 2022] GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c => generated 1475 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:31.988238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad761ad8-50cd-45f0-8a09-d63173d89371 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:31.997960 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad761ad8-50cd-45f0-8a09-d63173d89371 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Request method failure captured: Aug 24 10:12:31.997960 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871/action HTTP/1.1 Aug 24 10:12:31.997960 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:12:31.997960 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:12:31.997960 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:12:31.997960 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 31 Aug 24 10:12:31.997960 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:12:31.997960 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:12:31.997960 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:12:31.997960 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:12:31.997960 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBflb0DMOekRrSzFqBNwVgqCgG1pmAP2DoCwO7gScv48QEWxoh48Lim2hIHT1Q2eU5R35r47G7MaiobVjvtbyem4drmYY_x5I-T97s3G3C-3weQFPy93wr0UtZdENFdaAwff90DGJol4igz3x1PU_N_iZQVK2Hfpsl52OIyqIA3NFXFY Aug 24 10:12:31.997960 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:12:31.997960 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:12:31.997960 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:12:31.997960 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:12:31.997960 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:12:31.997960 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:12:31.997960 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: af6fefe9606745558ae536b007880b4e Aug 24 10:12:31.997960 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-686592460 Aug 24 10:12:31.997960 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,admin,member Aug 24 10:12:31.997960 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,admin,member Aug 24 10:12:32.004205 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/af6fefe9606745558ae536b007880b4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_af6fefe9606745558ae536b007880b4e", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/af6fefe9606745558ae536b007880b4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/af6fefe9606745558ae536b007880b4e"}]}] Aug 24 10:12:32.004205 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersAdminNegativeTestJSON-686592460 Aug 24 10:12:32.004205 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: af6fefe9606745558ae536b007880b4e Aug 24 10:12:32.004205 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-686592460 Aug 24 10:12:32.004205 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersAdminNegativeTestJSON-686592460-project-admin Aug 24 10:12:32.004205 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:12:32.004205 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:12:32.004205 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: ae7e17af63b9448a8e423085c2c9a99e Aug 24 10:12:32.004205 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersAdminNegativeTestJSON-686592460-project-admin Aug 24 10:12:32.004205 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:12:32.004205 n-d-849328-3 devstack@n-api.service[122432]: {"os-resetState": {"state": 1}} Aug 24 10:12:32.004205 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:12:32.004205 n-d-849328-3 devstack@n-api.service[122432]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 24 10:12:32.005884 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '10f639ed-ba2f-4983-9c04-777480733871', 'body': {'os-resetState': {'state': 1}}} Aug 24 10:12:32.005884 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:12:32.005884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:32.005884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:12:32.005884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:12:32.005884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:12:32.005884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:12:32.005884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 24 10:12:32.005884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:32.005884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 24 10:12:32.005884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 24 10:12:32.005884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:32.005884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 24 10:12:32.005884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 1 Aug 24 10:12:32.005884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:32.005884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:32.005884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:32.005884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:32.005884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:32.005884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:32.005884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:12:32.005884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:12:32.008949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:12:32.008949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:12:32.008949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:12:32.008949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:12:32.008949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:12:32.008949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:12:32.008949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:12:32.008949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:12:32.008949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 24 10:12:32.008949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:32.008949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:32.008949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:32.008949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:32.008949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:32.008949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:32.008949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:12:32.008949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:12:32.008949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 24 10:12:32.008949 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:32.013470 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad761ad8-50cd-45f0-8a09-d63173d89371 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:12:32.015448 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ad761ad8-50cd-45f0-8a09-d63173d89371 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871/action" status: 400 len: 120 microversion: 2.1 time: 0.035763 Aug 24 10:12:32.025079 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 216/443] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:12:31 2022] POST /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871/action => generated 120 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:12:32.064034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d809b06c-fe2d-4682-9fea-2aada7924264 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:32.096630 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d809b06c-fe2d-4682-9fea-2aada7924264 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b" status: 200 len: 1387 microversion: 2.1 time: 0.468442 Aug 24 10:12:32.097855 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 228/444] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:31 2022] GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b => generated 1387 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:32.118232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0c620d6f-ca45-431a-80b0-5d025d71ba79 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:32.118871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0c620d6f-ca45-431a-80b0-5d025d71ba79 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: b00174fc-a16c-4ae5-94d3-d43b9c963cf5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:32.125390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c620d6f-ca45-431a-80b0-5d025d71ba79 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:32.126446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c620d6f-ca45-431a-80b0-5d025d71ba79 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:32.128066 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c620d6f-ca45-431a-80b0-5d025d71ba79 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:32.129219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c620d6f-ca45-431a-80b0-5d025d71ba79 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:32.129930 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c620d6f-ca45-431a-80b0-5d025d71ba79 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:32.130566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c620d6f-ca45-431a-80b0-5d025d71ba79 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:32.271282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0c620d6f-ca45-431a-80b0-5d025d71ba79 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:32.279052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:32.303964 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0c620d6f-ca45-431a-80b0-5d025d71ba79 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/b00174fc-a16c-4ae5-94d3-d43b9c963cf5" status: 200 len: 1277 microversion: 2.1 time: 0.203326 Aug 24 10:12:32.304980 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 229/445] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:32 2022] GET /compute/v2.1/servers/b00174fc-a16c-4ae5-94d3-d43b9c963cf5 => generated 1277 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:32.319017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cf0d4738-aaa6-4c30-a1ea-a9b9097a12df tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:32.326333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cf0d4738-aaa6-4c30-a1ea-a9b9097a12df tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:32.339416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:32.357255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0d4738-aaa6-4c30-a1ea-a9b9097a12df tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:32.358898 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0d4738-aaa6-4c30-a1ea-a9b9097a12df tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:32.360982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0d4738-aaa6-4c30-a1ea-a9b9097a12df tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:32.361869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0d4738-aaa6-4c30-a1ea-a9b9097a12df tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:32.366243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0d4738-aaa6-4c30-a1ea-a9b9097a12df tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:32.369379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0d4738-aaa6-4c30-a1ea-a9b9097a12df tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:32.388404 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7d9d1d2b-feb5-4503-ae37-2bf26086f05d tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:32.390492 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7d9d1d2b-feb5-4503-ae37-2bf26086f05d tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:32.417427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d9d1d2b-feb5-4503-ae37-2bf26086f05d tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:32.417931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d9d1d2b-feb5-4503-ae37-2bf26086f05d tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:32.424957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d9d1d2b-feb5-4503-ae37-2bf26086f05d tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:32.426458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d9d1d2b-feb5-4503-ae37-2bf26086f05d tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:32.427969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d9d1d2b-feb5-4503-ae37-2bf26086f05d tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:32.430084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d9d1d2b-feb5-4503-ae37-2bf26086f05d tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:32.681915 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cf0d4738-aaa6-4c30-a1ea-a9b9097a12df tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:32.712127 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cf0d4738-aaa6-4c30-a1ea-a9b9097a12df tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:32.714441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cf0d4738-aaa6-4c30-a1ea-a9b9097a12df tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:32.717887 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cf0d4738-aaa6-4c30-a1ea-a9b9097a12df tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 200 len: 1569 microversion: 2.25 time: 0.410093 Aug 24 10:12:32.720144 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 230/446] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:32 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 1569 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:32.733436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-410560b4-d3ba-4670-966c-8b3d6c037188 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:32.736600 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-410560b4-d3ba-4670-966c-8b3d6c037188 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Failed to fetch instance by id 999 {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 24 10:12:32.737953 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-410560b4-d3ba-4670-966c-8b3d6c037188 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 24 10:12:32.739948 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-410560b4-d3ba-4670-966c-8b3d6c037188 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Request method failure captured: Aug 24 10:12:32.739948 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 24 10:12:32.739948 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:12:32.739948 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:12:32.739948 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:12:32.739948 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 37 Aug 24 10:12:32.739948 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:12:32.739948 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:12:32.739948 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:12:32.739948 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:12:32.739948 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBflb0DMOekRrSzFqBNwVgqCgG1pmAP2DoCwO7gScv48QEWxoh48Lim2hIHT1Q2eU5R35r47G7MaiobVjvtbyem4drmYY_x5I-T97s3G3C-3weQFPy93wr0UtZdENFdaAwff90DGJol4igz3x1PU_N_iZQVK2Hfpsl52OIyqIA3NFXFY Aug 24 10:12:32.739948 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:12:32.739948 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:12:32.739948 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:12:32.739948 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:12:32.739948 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:12:32.739948 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:12:32.739948 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: af6fefe9606745558ae536b007880b4e Aug 24 10:12:32.739948 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-686592460 Aug 24 10:12:32.739948 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:12:32.739948 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:12:32.741652 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/af6fefe9606745558ae536b007880b4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_af6fefe9606745558ae536b007880b4e", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/af6fefe9606745558ae536b007880b4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/af6fefe9606745558ae536b007880b4e"}]}] Aug 24 10:12:32.741652 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersAdminNegativeTestJSON-686592460 Aug 24 10:12:32.741652 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: af6fefe9606745558ae536b007880b4e Aug 24 10:12:32.741652 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-686592460 Aug 24 10:12:32.741652 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersAdminNegativeTestJSON-686592460-project-admin Aug 24 10:12:32.741652 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:12:32.741652 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:12:32.741652 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: ae7e17af63b9448a8e423085c2c9a99e Aug 24 10:12:32.741652 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersAdminNegativeTestJSON-686592460-project-admin Aug 24 10:12:32.741652 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:12:32.741652 n-d-849328-3 devstack@n-api.service[122433]: {"os-resetState": {"state": "error"}} Aug 24 10:12:32.741652 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:12:32.741652 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 999 could not be found. Aug 24 10:12:32.742425 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 24 10:12:32.742425 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:12:32.742425 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:32.742425 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:12:32.742425 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:12:32.742425 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 24 10:12:32.742425 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 24 10:12:32.742425 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 24 10:12:32.742425 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:32.742425 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:32.742425 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:32.742425 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:32.742425 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:32.742425 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:32.742425 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:12:32.742425 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:12:32.742425 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:12:32.742425 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:12:32.742425 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:12:32.742425 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:12:32.742425 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 24 10:12:32.744543 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 24 10:12:32.744543 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:12:32.744543 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:12:32.744543 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 24 10:12:32.744543 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:32.744543 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:32.744543 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:32.744543 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:32.744543 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:32.744543 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:32.744543 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:12:32.744543 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:12:32.744543 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 24 10:12:32.744543 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:32.747689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-410560b4-d3ba-4670-966c-8b3d6c037188 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:12:32.749263 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-410560b4-d3ba-4670-966c-8b3d6c037188 tempest-ServersAdminNegativeTestJSON-686592460 tempest-ServersAdminNegativeTestJSON-686592460-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.027133 Aug 24 10:12:32.760760 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 231/447] 10.222.0.85 () {60 vars in 1179 bytes} [Wed Aug 24 10:12:32 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:12:32.768778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a9d5910d-3b28-460f-a1f4-132357435717 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:32.771775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a9d5910d-3b28-460f-a1f4-132357435717 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:32.795432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9d5910d-3b28-460f-a1f4-132357435717 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:32.797195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9d5910d-3b28-460f-a1f4-132357435717 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:32.797908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9d5910d-3b28-460f-a1f4-132357435717 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:32.799138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9d5910d-3b28-460f-a1f4-132357435717 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:32.799813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9d5910d-3b28-460f-a1f4-132357435717 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:32.800427 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9d5910d-3b28-460f-a1f4-132357435717 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:32.963967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a9d5910d-3b28-460f-a1f4-132357435717 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:32.990531 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a9d5910d-3b28-460f-a1f4-132357435717 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381" status: 200 len: 1244 microversion: 2.1 time: 0.227522 Aug 24 10:12:32.997662 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 232/448] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:32 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381 => generated 1244 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:33.026125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1795a96f-a5b5-4d46-a79a-7d63ec23b3bc tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:33.034336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1795a96f-a5b5-4d46-a79a-7d63ec23b3bc tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 539f1a18-c5df-43d2-8d13-b7315424efb2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:33.059508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1795a96f-a5b5-4d46-a79a-7d63ec23b3bc tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:33.065815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1795a96f-a5b5-4d46-a79a-7d63ec23b3bc tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:33.068284 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1795a96f-a5b5-4d46-a79a-7d63ec23b3bc tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:33.069609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1795a96f-a5b5-4d46-a79a-7d63ec23b3bc tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:33.072274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1795a96f-a5b5-4d46-a79a-7d63ec23b3bc tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:33.073287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1795a96f-a5b5-4d46-a79a-7d63ec23b3bc tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:33.194990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1795a96f-a5b5-4d46-a79a-7d63ec23b3bc tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 539f1a18-c5df-43d2-8d13-b7315424efb2] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:12:33.320275 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7d9d1d2b-feb5-4503-ae37-2bf26086f05d tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1614 microversion: 2.1 time: 1.289548 Aug 24 10:12:33.340631 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 217/449] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:32 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1614 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:33.358905 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-828bd2ea-012a-4dfa-a2ab-ad89fb46c089 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:33.363391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-828bd2ea-012a-4dfa-a2ab-ad89fb46c089 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 9c47edc7-c2c0-43d3-a96a-b779f1d0723c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:33.388208 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-828bd2ea-012a-4dfa-a2ab-ad89fb46c089 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:33.388711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-828bd2ea-012a-4dfa-a2ab-ad89fb46c089 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:33.389324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-828bd2ea-012a-4dfa-a2ab-ad89fb46c089 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:33.392453 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-828bd2ea-012a-4dfa-a2ab-ad89fb46c089 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:33.398333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-828bd2ea-012a-4dfa-a2ab-ad89fb46c089 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:33.399454 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-828bd2ea-012a-4dfa-a2ab-ad89fb46c089 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:33.420802 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1795a96f-a5b5-4d46-a79a-7d63ec23b3bc tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "DELETE /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2" status: 204 len: 0 microversion: 2.1 time: 0.420949 Aug 24 10:12:33.421803 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 233/450] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:12:32 2022] DELETE /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:12:33.436473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1f598912-a570-4d78-bd0a-91b2b3af5095 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:33.437562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1f598912-a570-4d78-bd0a-91b2b3af5095 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: d5911032-bcaa-4a3d-bb73-ccbea62de79b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:33.460929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f598912-a570-4d78-bd0a-91b2b3af5095 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:33.461808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f598912-a570-4d78-bd0a-91b2b3af5095 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:33.462429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f598912-a570-4d78-bd0a-91b2b3af5095 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:33.463084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f598912-a570-4d78-bd0a-91b2b3af5095 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:33.463526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f598912-a570-4d78-bd0a-91b2b3af5095 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:33.463986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f598912-a570-4d78-bd0a-91b2b3af5095 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:33.807464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-828bd2ea-012a-4dfa-a2ab-ad89fb46c089 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:33.826479 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-828bd2ea-012a-4dfa-a2ab-ad89fb46c089 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c" status: 200 len: 1475 microversion: 2.1 time: 0.483722 Aug 24 10:12:33.841158 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 218/451] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:33 2022] GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c => generated 1475 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:33.841158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-76495599-bcbf-4778-9a77-8f9ec05e2ba8 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:33.841158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-76495599-bcbf-4778-9a77-8f9ec05e2ba8 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: b00174fc-a16c-4ae5-94d3-d43b9c963cf5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:33.864337 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76495599-bcbf-4778-9a77-8f9ec05e2ba8 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:33.865098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76495599-bcbf-4778-9a77-8f9ec05e2ba8 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:33.865581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76495599-bcbf-4778-9a77-8f9ec05e2ba8 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:33.866811 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76495599-bcbf-4778-9a77-8f9ec05e2ba8 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:33.867294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76495599-bcbf-4778-9a77-8f9ec05e2ba8 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:33.867764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76495599-bcbf-4778-9a77-8f9ec05e2ba8 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:34.151837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-76495599-bcbf-4778-9a77-8f9ec05e2ba8 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:34.161095 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-76495599-bcbf-4778-9a77-8f9ec05e2ba8 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/b00174fc-a16c-4ae5-94d3-d43b9c963cf5" status: 200 len: 1319 microversion: 2.1 time: 0.332111 Aug 24 10:12:34.173750 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 219/452] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:33 2022] GET /compute/v2.1/servers/b00174fc-a16c-4ae5-94d3-d43b9c963cf5 => generated 1319 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:34.181541 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a7791231-2c94-41b4-b6bb-3a248c614513 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:34.182379 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a7791231-2c94-41b4-b6bb-3a248c614513 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:34.189552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7791231-2c94-41b4-b6bb-3a248c614513 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:34.190067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7791231-2c94-41b4-b6bb-3a248c614513 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:34.190603 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7791231-2c94-41b4-b6bb-3a248c614513 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:34.191360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7791231-2c94-41b4-b6bb-3a248c614513 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:34.191824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7791231-2c94-41b4-b6bb-3a248c614513 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:34.192258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7791231-2c94-41b4-b6bb-3a248c614513 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:34.289508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a7791231-2c94-41b4-b6bb-3a248c614513 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9e10b533b89c457a972e0de8d05999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5901a8bee2a473b9e834cd93f11e998', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:34.290749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a7791231-2c94-41b4-b6bb-3a248c614513 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] flavor_id is None. Assuming migration. {{(pid=122432) resize /opt/stack/nova/nova/compute/api.py:4181}} Aug 24 10:12:34.291553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a7791231-2c94-41b4-b6bb-3a248c614513 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122432) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 10:12:34.447912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1f598912-a570-4d78-bd0a-91b2b3af5095 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:34.466157 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1f598912-a570-4d78-bd0a-91b2b3af5095 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b" status: 200 len: 1387 microversion: 2.1 time: 1.042542 Aug 24 10:12:34.491560 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 234/453] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:33 2022] GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b => generated 1387 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:34.514483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2302eae1-ed0b-4421-af3c-29237ea11b5c tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:34.515140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2302eae1-ed0b-4421-af3c-29237ea11b5c tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 539f1a18-c5df-43d2-8d13-b7315424efb2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:34.552550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2302eae1-ed0b-4421-af3c-29237ea11b5c tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:34.558396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2302eae1-ed0b-4421-af3c-29237ea11b5c tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:34.559099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2302eae1-ed0b-4421-af3c-29237ea11b5c tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:34.559863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2302eae1-ed0b-4421-af3c-29237ea11b5c tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:34.563475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2302eae1-ed0b-4421-af3c-29237ea11b5c tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:34.566868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2302eae1-ed0b-4421-af3c-29237ea11b5c tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:34.692850 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a7791231-2c94-41b4-b6bb-3a248c614513 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f/action" status: 202 len: 0 microversion: 2.1 time: 0.516182 Aug 24 10:12:34.711711 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 220/454] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:12:34 2022] POST /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f/action => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:12:34.720753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-848fbb69-3c4d-4a46-8298-d92f998f57c7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:34.721957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-848fbb69-3c4d-4a46-8298-d92f998f57c7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:34.748116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-848fbb69-3c4d-4a46-8298-d92f998f57c7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:34.751868 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-848fbb69-3c4d-4a46-8298-d92f998f57c7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:34.754542 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-848fbb69-3c4d-4a46-8298-d92f998f57c7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:34.760598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-848fbb69-3c4d-4a46-8298-d92f998f57c7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:34.761076 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-848fbb69-3c4d-4a46-8298-d92f998f57c7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:34.761574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-848fbb69-3c4d-4a46-8298-d92f998f57c7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:34.928803 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2302eae1-ed0b-4421-af3c-29237ea11b5c tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:34.938165 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2302eae1-ed0b-4421-af3c-29237ea11b5c tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2" status: 200 len: 1469 microversion: 2.1 time: 0.444384 Aug 24 10:12:34.941502 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 235/455] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:34 2022] GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2 => generated 1469 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:35.202994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-89e14405-7b0a-40ba-add4-68b9f0975e7b tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Calling method '.version_select at 0x7f46556e6a60>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:35.207614 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:12:35.207614 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:12:35.209726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89e14405-7b0a-40ba-add4-68b9f0975e7b tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:35.210997 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89e14405-7b0a-40ba-add4-68b9f0975e7b tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:35.212980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89e14405-7b0a-40ba-add4-68b9f0975e7b tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:35.246675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89e14405-7b0a-40ba-add4-68b9f0975e7b tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:35.248925 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89e14405-7b0a-40ba-add4-68b9f0975e7b tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:35.249417 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89e14405-7b0a-40ba-add4-68b9f0975e7b tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:35.288657 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89e14405-7b0a-40ba-add4-68b9f0975e7b tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:35.289310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89e14405-7b0a-40ba-add4-68b9f0975e7b tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:35.289983 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89e14405-7b0a-40ba-add4-68b9f0975e7b tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:35.317864 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89e14405-7b0a-40ba-add4-68b9f0975e7b tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:35.318736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89e14405-7b0a-40ba-add4-68b9f0975e7b tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:35.319364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89e14405-7b0a-40ba-add4-68b9f0975e7b tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:35.382534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89e14405-7b0a-40ba-add4-68b9f0975e7b tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:35.383449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89e14405-7b0a-40ba-add4-68b9f0975e7b tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:35.384275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89e14405-7b0a-40ba-add4-68b9f0975e7b tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:35.397836 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-89e14405-7b0a-40ba-add4-68b9f0975e7b tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2389 microversion: 2.53 time: 0.453906 Aug 24 10:12:35.399490 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 236/456] 10.222.0.85 () {60 vars in 1243 bytes} [Wed Aug 24 10:12:34 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2389 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:35.406107 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5a2ae204-d519-47e8-84a2-acfa7fba963f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:35.407092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5a2ae204-d519-47e8-84a2-acfa7fba963f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:35.427674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a2ae204-d519-47e8-84a2-acfa7fba963f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:35.428331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a2ae204-d519-47e8-84a2-acfa7fba963f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:35.428929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a2ae204-d519-47e8-84a2-acfa7fba963f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:35.429948 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a2ae204-d519-47e8-84a2-acfa7fba963f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:35.430974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a2ae204-d519-47e8-84a2-acfa7fba963f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:35.432479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a2ae204-d519-47e8-84a2-acfa7fba963f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:35.580778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5a2ae204-d519-47e8-84a2-acfa7fba963f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:35.595981 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5a2ae204-d519-47e8-84a2-acfa7fba963f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381" status: 200 len: 1292 microversion: 2.1 time: 0.194732 Aug 24 10:12:35.596803 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 237/457] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:35 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381 => generated 1292 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:35.607135 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-b3cf48ee-67e7-42ee-94e4-8011c9cc5cc0 req-0006d1cc-1d45-4142-acc5-9ccc17255c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c47edc7-c2c0-43d3-a96a-b779f1d0723c", "name": "network-vif-deleted", "tag": "72420fbc-8d93-4dca-b4e0-67240b59047b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:35.627239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b3cf48ee-67e7-42ee-94e4-8011c9cc5cc0 req-0006d1cc-1d45-4142-acc5-9ccc17255c83 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:35.627744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b3cf48ee-67e7-42ee-94e4-8011c9cc5cc0 req-0006d1cc-1d45-4142-acc5-9ccc17255c83 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:35.628182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b3cf48ee-67e7-42ee-94e4-8011c9cc5cc0 req-0006d1cc-1d45-4142-acc5-9ccc17255c83 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:35.662845 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-b3cf48ee-67e7-42ee-94e4-8011c9cc5cc0 req-0006d1cc-1d45-4142-acc5-9ccc17255c83 service nova] Creating event network-vif-deleted:72420fbc-8d93-4dca-b4e0-67240b59047b for instance 9c47edc7-c2c0-43d3-a96a-b779f1d0723c on n-h2-849328-3 Aug 24 10:12:35.670810 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-b3cf48ee-67e7-42ee-94e4-8011c9cc5cc0 req-0006d1cc-1d45-4142-acc5-9ccc17255c83 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070335 Aug 24 10:12:35.673500 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 238/458] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:35.681532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d03d3ce6-e557-4ab9-b356-a77bf52f6afb tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:35.682446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d03d3ce6-e557-4ab9-b356-a77bf52f6afb tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:35.691727 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d03d3ce6-e557-4ab9-b356-a77bf52f6afb tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:35.692573 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d03d3ce6-e557-4ab9-b356-a77bf52f6afb tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:35.693163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d03d3ce6-e557-4ab9-b356-a77bf52f6afb tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:35.694041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d03d3ce6-e557-4ab9-b356-a77bf52f6afb tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:35.694547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d03d3ce6-e557-4ab9-b356-a77bf52f6afb tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:35.695032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d03d3ce6-e557-4ab9-b356-a77bf52f6afb tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:35.911542 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-848fbb69-3c4d-4a46-8298-d92f998f57c7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:35.936708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-848fbb69-3c4d-4a46-8298-d92f998f57c7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:35.939089 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-848fbb69-3c4d-4a46-8298-d92f998f57c7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:35.940407 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-848fbb69-3c4d-4a46-8298-d92f998f57c7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 200 len: 1569 microversion: 2.25 time: 1.229684 Aug 24 10:12:35.942076 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 221/459] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:34 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 1569 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:35.947402 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3d166f69-20ad-4493-bcaf-30cbc1a91337 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:35.948082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3d166f69-20ad-4493-bcaf-30cbc1a91337 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 9c47edc7-c2c0-43d3-a96a-b779f1d0723c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:35.956780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d166f69-20ad-4493-bcaf-30cbc1a91337 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:35.957774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d166f69-20ad-4493-bcaf-30cbc1a91337 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:35.958414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d166f69-20ad-4493-bcaf-30cbc1a91337 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:35.959852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d166f69-20ad-4493-bcaf-30cbc1a91337 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:35.960508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d166f69-20ad-4493-bcaf-30cbc1a91337 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:35.961106 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d166f69-20ad-4493-bcaf-30cbc1a91337 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:35.987586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d03d3ce6-e557-4ab9-b356-a77bf52f6afb tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:36.006616 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d03d3ce6-e557-4ab9-b356-a77bf52f6afb tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1472 microversion: 2.1 time: 0.331214 Aug 24 10:12:36.007261 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 239/460] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:35 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1472 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:36.017595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aefaa9ef-4aa8-4a77-b5b1-53d1b8cf3b80 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:36.017595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aefaa9ef-4aa8-4a77-b5b1-53d1b8cf3b80 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: b00174fc-a16c-4ae5-94d3-d43b9c963cf5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:36.039436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aefaa9ef-4aa8-4a77-b5b1-53d1b8cf3b80 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:36.039972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aefaa9ef-4aa8-4a77-b5b1-53d1b8cf3b80 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:36.040867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aefaa9ef-4aa8-4a77-b5b1-53d1b8cf3b80 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:36.041838 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aefaa9ef-4aa8-4a77-b5b1-53d1b8cf3b80 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:36.042284 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aefaa9ef-4aa8-4a77-b5b1-53d1b8cf3b80 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:36.042782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aefaa9ef-4aa8-4a77-b5b1-53d1b8cf3b80 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:36.223134 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3d166f69-20ad-4493-bcaf-30cbc1a91337 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:36.233397 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3d166f69-20ad-4493-bcaf-30cbc1a91337 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c" status: 200 len: 1304 microversion: 2.1 time: 0.290143 Aug 24 10:12:36.243238 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 222/461] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:35 2022] GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c => generated 1304 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:36.248569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a107473e-1469-4461-9a19-137fb4102566 tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Calling method '.version_select at 0x7f465556c9d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:36.251578 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:12:36.251578 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:12:36.252763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a107473e-1469-4461-9a19-137fb4102566 tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:36.253298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a107473e-1469-4461-9a19-137fb4102566 tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:36.253735 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a107473e-1469-4461-9a19-137fb4102566 tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:36.296203 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a107473e-1469-4461-9a19-137fb4102566 tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:36.296986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a107473e-1469-4461-9a19-137fb4102566 tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:36.298523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a107473e-1469-4461-9a19-137fb4102566 tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:36.341754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a107473e-1469-4461-9a19-137fb4102566 tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:36.342606 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a107473e-1469-4461-9a19-137fb4102566 tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:36.343198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a107473e-1469-4461-9a19-137fb4102566 tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:36.360038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a107473e-1469-4461-9a19-137fb4102566 tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:36.360814 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a107473e-1469-4461-9a19-137fb4102566 tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:36.361620 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a107473e-1469-4461-9a19-137fb4102566 tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:36.409881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a107473e-1469-4461-9a19-137fb4102566 tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:36.410795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a107473e-1469-4461-9a19-137fb4102566 tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:36.411432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a107473e-1469-4461-9a19-137fb4102566 tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:36.440827 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a107473e-1469-4461-9a19-137fb4102566 tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 1081 microversion: 2.53 time: 0.196199 Aug 24 10:12:36.442623 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 223/462] 10.222.0.85 () {60 vars in 1222 bytes} [Wed Aug 24 10:12:36 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 1081 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:36.448621 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-77d6533c-80c8-402e-895b-cd1279f8145c tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:36.450870 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-77d6533c-80c8-402e-895b-cd1279f8145c tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: d5911032-bcaa-4a3d-bb73-ccbea62de79b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:36.469065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77d6533c-80c8-402e-895b-cd1279f8145c tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:36.470562 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77d6533c-80c8-402e-895b-cd1279f8145c tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:36.473338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77d6533c-80c8-402e-895b-cd1279f8145c tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:36.475699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77d6533c-80c8-402e-895b-cd1279f8145c tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:36.477611 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77d6533c-80c8-402e-895b-cd1279f8145c tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:36.479213 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77d6533c-80c8-402e-895b-cd1279f8145c tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:36.683380 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aefaa9ef-4aa8-4a77-b5b1-53d1b8cf3b80 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:36.699255 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aefaa9ef-4aa8-4a77-b5b1-53d1b8cf3b80 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/b00174fc-a16c-4ae5-94d3-d43b9c963cf5" status: 200 len: 1319 microversion: 2.1 time: 0.687305 Aug 24 10:12:36.700653 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 240/463] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:36 2022] GET /compute/v2.1/servers/b00174fc-a16c-4ae5-94d3-d43b9c963cf5 => generated 1319 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:36.720692 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4b52c67a-bedc-4d4e-a3cf-2f5f76b75d52 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:36.722407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4b52c67a-bedc-4d4e-a3cf-2f5f76b75d52 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 539f1a18-c5df-43d2-8d13-b7315424efb2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:36.736699 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b52c67a-bedc-4d4e-a3cf-2f5f76b75d52 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:36.737599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b52c67a-bedc-4d4e-a3cf-2f5f76b75d52 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:36.738468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b52c67a-bedc-4d4e-a3cf-2f5f76b75d52 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:36.740167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b52c67a-bedc-4d4e-a3cf-2f5f76b75d52 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:36.741193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b52c67a-bedc-4d4e-a3cf-2f5f76b75d52 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:36.742666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b52c67a-bedc-4d4e-a3cf-2f5f76b75d52 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:36.915408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-77d6533c-80c8-402e-895b-cd1279f8145c tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:36.935228 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-77d6533c-80c8-402e-895b-cd1279f8145c tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b" status: 200 len: 1387 microversion: 2.1 time: 0.490505 Aug 24 10:12:36.936009 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 224/464] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:36 2022] GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b => generated 1387 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:36.940959 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8b445418-1e55-4c56-bc9e-b07288a43432 tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Calling method '.version_select at 0x7f46557d6790>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:36.943810 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:12:36.943810 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:12:36.945189 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b445418-1e55-4c56-bc9e-b07288a43432 tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:36.945761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b445418-1e55-4c56-bc9e-b07288a43432 tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:36.946278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b445418-1e55-4c56-bc9e-b07288a43432 tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:37.008114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b445418-1e55-4c56-bc9e-b07288a43432 tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:37.009305 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b445418-1e55-4c56-bc9e-b07288a43432 tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:37.010022 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b445418-1e55-4c56-bc9e-b07288a43432 tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:37.033166 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8b445418-1e55-4c56-bc9e-b07288a43432 tempest-HypervisorAdminV253TestBase-370388891 tempest-HypervisorAdminV253TestBase-370388891-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors/ccc3f8a0-24e7-40e3-b2e0-89170797c163" status: 200 len: 792 microversion: 2.53 time: 0.090368 Aug 24 10:12:37.034297 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 225/465] 10.222.0.85 () {60 vars in 1298 bytes} [Wed Aug 24 10:12:36 2022] GET /compute/v2.1/os-hypervisors/ccc3f8a0-24e7-40e3-b2e0-89170797c163 => generated 792 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:12:37.058226 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7ba7a518-b704-48f1-8bb5-9583fd6912d8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:37.058885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7ba7a518-b704-48f1-8bb5-9583fd6912d8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:37.078900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ba7a518-b704-48f1-8bb5-9583fd6912d8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:37.081447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ba7a518-b704-48f1-8bb5-9583fd6912d8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:37.082953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ba7a518-b704-48f1-8bb5-9583fd6912d8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:37.087399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ba7a518-b704-48f1-8bb5-9583fd6912d8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:37.088032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ba7a518-b704-48f1-8bb5-9583fd6912d8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:37.089276 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ba7a518-b704-48f1-8bb5-9583fd6912d8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:37.234875 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4b52c67a-bedc-4d4e-a3cf-2f5f76b75d52 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:37.248936 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4b52c67a-bedc-4d4e-a3cf-2f5f76b75d52 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2" status: 200 len: 1469 microversion: 2.1 time: 0.546064 Aug 24 10:12:37.250978 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 241/466] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:36 2022] GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2 => generated 1469 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:37.284850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-da145abb-4340-47f0-a13a-c6b54c3e89b8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:37.289507 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-da145abb-4340-47f0-a13a-c6b54c3e89b8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:37.311259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da145abb-4340-47f0-a13a-c6b54c3e89b8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:37.312023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da145abb-4340-47f0-a13a-c6b54c3e89b8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:37.313047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da145abb-4340-47f0-a13a-c6b54c3e89b8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:37.314220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da145abb-4340-47f0-a13a-c6b54c3e89b8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:37.314886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da145abb-4340-47f0-a13a-c6b54c3e89b8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:37.316825 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da145abb-4340-47f0-a13a-c6b54c3e89b8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:37.354422 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7ba7a518-b704-48f1-8bb5-9583fd6912d8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:37.366205 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=32 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:37.371253 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7ba7a518-b704-48f1-8bb5-9583fd6912d8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381" status: 200 len: 1298 microversion: 2.1 time: 0.335461 Aug 24 10:12:37.372463 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 226/467] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:37 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381 => generated 1298 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:37.377474 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-240f0ffa-1756-4bc1-b378-2a988eb29c16 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:37.378100 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-240f0ffa-1756-4bc1-b378-2a988eb29c16 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:37.395521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-240f0ffa-1756-4bc1-b378-2a988eb29c16 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:37.396011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-240f0ffa-1756-4bc1-b378-2a988eb29c16 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:37.396435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-240f0ffa-1756-4bc1-b378-2a988eb29c16 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:37.397153 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-240f0ffa-1756-4bc1-b378-2a988eb29c16 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:37.397635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-240f0ffa-1756-4bc1-b378-2a988eb29c16 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:37.398038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-240f0ffa-1756-4bc1-b378-2a988eb29c16 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:37.834695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da145abb-4340-47f0-a13a-c6b54c3e89b8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:37.856813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da145abb-4340-47f0-a13a-c6b54c3e89b8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:37.858418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da145abb-4340-47f0-a13a-c6b54c3e89b8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:37.859627 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-da145abb-4340-47f0-a13a-c6b54c3e89b8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 200 len: 1569 microversion: 2.25 time: 0.606671 Aug 24 10:12:37.860523 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 242/468] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:37 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 1569 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:37.865533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-96158632-f73d-43a4-bfc0-35fd59c4e74f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:37.866427 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-96158632-f73d-43a4-bfc0-35fd59c4e74f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 9c47edc7-c2c0-43d3-a96a-b779f1d0723c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:37.891537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96158632-f73d-43a4-bfc0-35fd59c4e74f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:37.892692 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96158632-f73d-43a4-bfc0-35fd59c4e74f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:37.893424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96158632-f73d-43a4-bfc0-35fd59c4e74f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:37.894560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96158632-f73d-43a4-bfc0-35fd59c4e74f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:37.895336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96158632-f73d-43a4-bfc0-35fd59c4e74f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:37.896040 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96158632-f73d-43a4-bfc0-35fd59c4e74f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:37.917200 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-96158632-f73d-43a4-bfc0-35fd59c4e74f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] HTTP exception thrown: Instance 9c47edc7-c2c0-43d3-a96a-b779f1d0723c could not be found. Aug 24 10:12:37.919881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-96158632-f73d-43a4-bfc0-35fd59c4e74f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Request method failure captured: Aug 24 10:12:37.919881 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c HTTP/1.1 Aug 24 10:12:37.919881 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:12:37.919881 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:12:37.919881 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:12:37.919881 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:12:37.919881 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:12:37.919881 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:12:37.919881 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:12:37.919881 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:12:37.919881 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfltMlassGauW2joSSY9GPq4QzYSVq06g_75gQuUSjHwXRkRUOaWbR5QacX5i3bcOkH0MdLyn6hxFumSOz3Oa6dtxLf6mdwu7IdynGYhTDAQUbcUgAATOl-3ssTBrMjQ5H0lxe3-j3bz-Z-SkNgYqR0NVLTrSEH-GFgkL8dBT4dnGIE Aug 24 10:12:37.919881 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:12:37.919881 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:12:37.919881 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:12:37.919881 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:12:37.919881 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:12:37.919881 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:12:37.919881 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 12902eb1fd734a189ec5f04a051b30b6 Aug 24 10:12:37.919881 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1265935849 Aug 24 10:12:37.919881 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:12:37.919881 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:12:37.921719 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/12902eb1fd734a189ec5f04a051b30b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_12902eb1fd734a189ec5f04a051b30b6", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/12902eb1fd734a189ec5f04a051b30b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/12902eb1fd734a189ec5f04a051b30b6"}]}] Aug 24 10:12:37.921719 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-DeleteServersAdminTestJSON-1265935849 Aug 24 10:12:37.921719 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 12902eb1fd734a189ec5f04a051b30b6 Aug 24 10:12:37.921719 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1265935849 Aug 24 10:12:37.921719 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-DeleteServersAdminTestJSON-1265935849-project Aug 24 10:12:37.921719 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:12:37.921719 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:12:37.921719 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 4cd5610642144fb0b7915285aafc0099 Aug 24 10:12:37.921719 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-DeleteServersAdminTestJSON-1265935849-project Aug 24 10:12:37.921719 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:12:37.921719 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 9c47edc7-c2c0-43d3-a96a-b779f1d0723c could not be found. Aug 24 10:12:37.921719 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '9c47edc7-c2c0-43d3-a96a-b779f1d0723c'} Aug 24 10:12:37.922667 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:12:37.922667 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:37.922667 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:12:37.922667 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:12:37.922667 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:12:37.922667 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:12:37.922667 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:12:37.922667 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:12:37.922667 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:12:37.922667 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:12:37.922667 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c47edc7-c2c0-43d3-a96a-b779f1d0723c could not be found. Aug 24 10:12:37.922667 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:37.922667 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:37.922667 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:37.922667 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:37.922667 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:37.922667 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:37.922667 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:12:37.922667 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:12:37.922667 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:12:37.924041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:12:37.924041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:12:37.924041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:12:37.924041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:12:37.924041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:12:37.924041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:12:37.924041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:12:37.924041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c47edc7-c2c0-43d3-a96a-b779f1d0723c could not be found. Aug 24 10:12:37.924041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:37.924041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:37.924041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:37.924041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:37.924041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:37.924041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:37.924041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:12:37.924041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:12:37.924041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c47edc7-c2c0-43d3-a96a-b779f1d0723c could not be found. Aug 24 10:12:37.924041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:37.925939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-96158632-f73d-43a4-bfc0-35fd59c4e74f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Returning 404 to user: Instance 9c47edc7-c2c0-43d3-a96a-b779f1d0723c could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:12:37.927257 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-96158632-f73d-43a4-bfc0-35fd59c4e74f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c" status: 404 len: 111 microversion: 2.1 time: 0.065132 Aug 24 10:12:37.940476 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 243/469] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:37 2022] GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:12:37.940476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dfc77700-3963-455b-9ed9-f161426d81bf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:37.940476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dfc77700-3963-455b-9ed9-f161426d81bf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: b00174fc-a16c-4ae5-94d3-d43b9c963cf5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:37.947079 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfc77700-3963-455b-9ed9-f161426d81bf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:37.947662 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfc77700-3963-455b-9ed9-f161426d81bf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:37.948458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfc77700-3963-455b-9ed9-f161426d81bf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:37.950098 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfc77700-3963-455b-9ed9-f161426d81bf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:37.950098 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfc77700-3963-455b-9ed9-f161426d81bf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:37.950098 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfc77700-3963-455b-9ed9-f161426d81bf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:38.136935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-240f0ffa-1756-4bc1-b378-2a988eb29c16 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:38.149170 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-240f0ffa-1756-4bc1-b378-2a988eb29c16 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1472 microversion: 2.1 time: 0.775560 Aug 24 10:12:38.150863 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 227/470] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:37 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1472 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:38.169000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c9a1755a-4e35-46a6-bf15-bb2acb8be2a5 req-65a2b6f2-0890-4b6a-b383-298c9779f212 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b00174fc-a16c-4ae5-94d3-d43b9c963cf5", "tag": "b9df294e-0c89-441c-835e-265525385287"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:38.182216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c9a1755a-4e35-46a6-bf15-bb2acb8be2a5 req-65a2b6f2-0890-4b6a-b383-298c9779f212 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:38.184572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c9a1755a-4e35-46a6-bf15-bb2acb8be2a5 req-65a2b6f2-0890-4b6a-b383-298c9779f212 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:38.185443 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c9a1755a-4e35-46a6-bf15-bb2acb8be2a5 req-65a2b6f2-0890-4b6a-b383-298c9779f212 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:38.201569 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c9a1755a-4e35-46a6-bf15-bb2acb8be2a5 req-65a2b6f2-0890-4b6a-b383-298c9779f212 service nova] Creating event network-changed:b9df294e-0c89-441c-835e-265525385287 for instance b00174fc-a16c-4ae5-94d3-d43b9c963cf5 on n-h1-849328-3 Aug 24 10:12:38.207654 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c9a1755a-4e35-46a6-bf15-bb2acb8be2a5 req-65a2b6f2-0890-4b6a-b383-298c9779f212 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055221 Aug 24 10:12:38.208530 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 228/471] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:38.213740 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-abd5bcb2-4f3f-472f-87f9-76629755e73e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:38.214757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-abd5bcb2-4f3f-472f-87f9-76629755e73e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: d5911032-bcaa-4a3d-bb73-ccbea62de79b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:38.222466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abd5bcb2-4f3f-472f-87f9-76629755e73e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:38.223600 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abd5bcb2-4f3f-472f-87f9-76629755e73e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:38.224027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abd5bcb2-4f3f-472f-87f9-76629755e73e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:38.225113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abd5bcb2-4f3f-472f-87f9-76629755e73e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:38.225834 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abd5bcb2-4f3f-472f-87f9-76629755e73e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:38.226406 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abd5bcb2-4f3f-472f-87f9-76629755e73e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:38.248551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:38.495459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=10 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:38.566749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-abd5bcb2-4f3f-472f-87f9-76629755e73e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:38.587841 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-abd5bcb2-4f3f-472f-87f9-76629755e73e tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b" status: 200 len: 1387 microversion: 2.1 time: 0.377417 Aug 24 10:12:38.589236 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 229/472] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:38 2022] GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b => generated 1387 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:38.616137 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3d9f4089-eb61-4893-b471-360936fe2724 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-69369643", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:38.751534 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-3d9f4089-eb61-4893-b471-360936fe2724 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:12:38.846428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dfc77700-3963-455b-9ed9-f161426d81bf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:38.898217 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dfc77700-3963-455b-9ed9-f161426d81bf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/b00174fc-a16c-4ae5-94d3-d43b9c963cf5" status: 200 len: 1319 microversion: 2.1 time: 0.964574 Aug 24 10:12:38.900898 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 244/473] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:37 2022] GET /compute/v2.1/servers/b00174fc-a16c-4ae5-94d3-d43b9c963cf5 => generated 1319 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:38.909456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0a020510-91bd-41ba-b779-127a9213d621 req-5798cd6a-9f08-47b8-b6fb-051463ed27d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db566c0d-ce6a-4d8d-bba4-c1480a160d01", "tag": "94316740-068c-4594-b2af-29996f90fa21"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:38.927221 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0a020510-91bd-41ba-b779-127a9213d621 req-5798cd6a-9f08-47b8-b6fb-051463ed27d9 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:38.927882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0a020510-91bd-41ba-b779-127a9213d621 req-5798cd6a-9f08-47b8-b6fb-051463ed27d9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:38.928687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0a020510-91bd-41ba-b779-127a9213d621 req-5798cd6a-9f08-47b8-b6fb-051463ed27d9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:38.957279 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0a020510-91bd-41ba-b779-127a9213d621 req-5798cd6a-9f08-47b8-b6fb-051463ed27d9 service nova] Creating event network-changed:94316740-068c-4594-b2af-29996f90fa21 for instance db566c0d-ce6a-4d8d-bba4-c1480a160d01 on n-h1-849328-3 Aug 24 10:12:38.976195 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0a020510-91bd-41ba-b779-127a9213d621 req-5798cd6a-9f08-47b8-b6fb-051463ed27d9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072818 Aug 24 10:12:38.978001 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 245/474] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:38.989709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-72321932-3dd7-40a3-957b-28d3e344bff4 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:38.991906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-72321932-3dd7-40a3-957b-28d3e344bff4 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 539f1a18-c5df-43d2-8d13-b7315424efb2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:39.007961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72321932-3dd7-40a3-957b-28d3e344bff4 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:39.009467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72321932-3dd7-40a3-957b-28d3e344bff4 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:39.012438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72321932-3dd7-40a3-957b-28d3e344bff4 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:39.014525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72321932-3dd7-40a3-957b-28d3e344bff4 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:39.016256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72321932-3dd7-40a3-957b-28d3e344bff4 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:39.017529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72321932-3dd7-40a3-957b-28d3e344bff4 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:39.066360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:39.121289 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72321932-3dd7-40a3-957b-28d3e344bff4 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:39.122697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72321932-3dd7-40a3-957b-28d3e344bff4 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:39.123991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72321932-3dd7-40a3-957b-28d3e344bff4 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:39.125708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-72321932-3dd7-40a3-957b-28d3e344bff4 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lazy-loading 'fault' on Instance uuid 539f1a18-c5df-43d2-8d13-b7315424efb2 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:12:39.251249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-72321932-3dd7-40a3-957b-28d3e344bff4 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:39.328064 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-72321932-3dd7-40a3-957b-28d3e344bff4 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2" status: 200 len: 1312 microversion: 2.1 time: 0.347609 Aug 24 10:12:39.339539 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 246/475] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:38 2022] GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2 => generated 1312 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:39.368013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-31b5a522-d253-4a12-9c6a-286e6f3420ed tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:39.370277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-31b5a522-d253-4a12-9c6a-286e6f3420ed tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:39.381009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31b5a522-d253-4a12-9c6a-286e6f3420ed tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:39.382192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31b5a522-d253-4a12-9c6a-286e6f3420ed tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:39.383195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31b5a522-d253-4a12-9c6a-286e6f3420ed tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:39.384667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31b5a522-d253-4a12-9c6a-286e6f3420ed tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:39.385716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31b5a522-d253-4a12-9c6a-286e6f3420ed tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:39.387660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31b5a522-d253-4a12-9c6a-286e6f3420ed tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:39.855670 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-31b5a522-d253-4a12-9c6a-286e6f3420ed tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:39.869019 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-31b5a522-d253-4a12-9c6a-286e6f3420ed tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381" status: 200 len: 1365 microversion: 2.1 time: 0.521757 Aug 24 10:12:39.883866 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 247/476] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:39 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381 => generated 1365 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:39.899674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3219cde9-2c2e-42bf-94bb-4d83032f78d2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:39.899957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3219cde9-2c2e-42bf-94bb-4d83032f78d2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:39.914905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3219cde9-2c2e-42bf-94bb-4d83032f78d2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:39.915714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3219cde9-2c2e-42bf-94bb-4d83032f78d2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:39.916309 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3219cde9-2c2e-42bf-94bb-4d83032f78d2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:39.917201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3219cde9-2c2e-42bf-94bb-4d83032f78d2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:39.918523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3219cde9-2c2e-42bf-94bb-4d83032f78d2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:39.920312 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3219cde9-2c2e-42bf-94bb-4d83032f78d2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:40.020586 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=12 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:40.125365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3219cde9-2c2e-42bf-94bb-4d83032f78d2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:40.131612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3d9f4089-eb61-4893-b471-360936fe2724 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:12:40.132564 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3d9f4089-eb61-4893-b471-360936fe2724 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:12:40.133397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3d9f4089-eb61-4893-b471-360936fe2724 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:12:40.133937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3d9f4089-eb61-4893-b471-360936fe2724 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:12:40.134514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3d9f4089-eb61-4893-b471-360936fe2724 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:12:40.136767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3219cde9-2c2e-42bf-94bb-4d83032f78d2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:40.140215 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3219cde9-2c2e-42bf-94bb-4d83032f78d2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:40.142394 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3219cde9-2c2e-42bf-94bb-4d83032f78d2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 200 len: 1569 microversion: 2.25 time: 0.257095 Aug 24 10:12:40.146111 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 248/477] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:39 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 1569 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:40.149259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d9f4089-eb61-4893-b471-360936fe2724 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:40.149823 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d9f4089-eb61-4893-b471-360936fe2724 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:40.150329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d9f4089-eb61-4893-b471-360936fe2724 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:40.150853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-889c0a07-ccdf-481b-829f-7c13c62d2c3d req-0f371e7d-84a6-4dec-97c8-b1415917d5d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5911032-bcaa-4a3d-bb73-ccbea62de79b", "name": "network-vif-plugged", "status": "completed", "tag": "29857c60-2ade-4b2f-b518-b9ceee5755c9"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:40.151068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d9f4089-eb61-4893-b471-360936fe2724 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:40.151343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d9f4089-eb61-4893-b471-360936fe2724 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:40.151775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d9f4089-eb61-4893-b471-360936fe2724 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:40.169820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-889c0a07-ccdf-481b-829f-7c13c62d2c3d req-0f371e7d-84a6-4dec-97c8-b1415917d5d9 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:40.171165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-889c0a07-ccdf-481b-829f-7c13c62d2c3d req-0f371e7d-84a6-4dec-97c8-b1415917d5d9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:40.172846 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-3d9f4089-eb61-4893-b471-360936fe2724 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Getting quotas for project 12902eb1fd734a189ec5f04a051b30b6. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:12:40.173267 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-889c0a07-ccdf-481b-829f-7c13c62d2c3d req-0f371e7d-84a6-4dec-97c8-b1415917d5d9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:40.184982 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-3d9f4089-eb61-4893-b471-360936fe2724 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Getting quotas for user 4cd5610642144fb0b7915285aafc0099 and project 12902eb1fd734a189ec5f04a051b30b6. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:12:40.206039 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3d9f4089-eb61-4893-b471-360936fe2724 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:12:40.210170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3d9f4089-eb61-4893-b471-360936fe2724 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 2706bbd7-7fe1-4441-a716-a35246a87268] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:12:40.213377 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-889c0a07-ccdf-481b-829f-7c13c62d2c3d req-0f371e7d-84a6-4dec-97c8-b1415917d5d9 service nova] Creating event network-vif-plugged:29857c60-2ade-4b2f-b518-b9ceee5755c9 for instance d5911032-bcaa-4a3d-bb73-ccbea62de79b on n-h1-849328-3 Aug 24 10:12:40.222671 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-889c0a07-ccdf-481b-829f-7c13c62d2c3d req-0f371e7d-84a6-4dec-97c8-b1415917d5d9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077435 Aug 24 10:12:40.230626 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 249/478] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:40.247825 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b47466ed-f0c9-4089-947d-0362c7d3ae18 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:40.249562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b47466ed-f0c9-4089-947d-0362c7d3ae18 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:40.250198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:40.286264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b47466ed-f0c9-4089-947d-0362c7d3ae18 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:40.287185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b47466ed-f0c9-4089-947d-0362c7d3ae18 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:40.287972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b47466ed-f0c9-4089-947d-0362c7d3ae18 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:40.288931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b47466ed-f0c9-4089-947d-0362c7d3ae18 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:40.296020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b47466ed-f0c9-4089-947d-0362c7d3ae18 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:40.296539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b47466ed-f0c9-4089-947d-0362c7d3ae18 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:40.297957 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3d9f4089-eb61-4893-b471-360936fe2724 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.689695 Aug 24 10:12:40.308888 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 230/479] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:12:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:12:40.317246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5717e8cb-c5a6-46a9-8c2d-0248ab402069 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:40.319283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5717e8cb-c5a6-46a9-8c2d-0248ab402069 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: d5911032-bcaa-4a3d-bb73-ccbea62de79b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:40.333288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5717e8cb-c5a6-46a9-8c2d-0248ab402069 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:40.335226 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5717e8cb-c5a6-46a9-8c2d-0248ab402069 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:40.336057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5717e8cb-c5a6-46a9-8c2d-0248ab402069 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:40.336970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5717e8cb-c5a6-46a9-8c2d-0248ab402069 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:40.338983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5717e8cb-c5a6-46a9-8c2d-0248ab402069 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:40.340120 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5717e8cb-c5a6-46a9-8c2d-0248ab402069 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:40.615861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b47466ed-f0c9-4089-947d-0362c7d3ae18 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:40.641532 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b47466ed-f0c9-4089-947d-0362c7d3ae18 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1477 microversion: 2.1 time: 0.408383 Aug 24 10:12:40.642518 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 250/480] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:40 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1477 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:40.658560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9828717d-fb6f-4cac-829b-3bdfb5c18fea tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:40.665514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9828717d-fb6f-4cac-829b-3bdfb5c18fea tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: b00174fc-a16c-4ae5-94d3-d43b9c963cf5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:40.693053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9828717d-fb6f-4cac-829b-3bdfb5c18fea tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:40.693615 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9828717d-fb6f-4cac-829b-3bdfb5c18fea tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:40.694103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9828717d-fb6f-4cac-829b-3bdfb5c18fea tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:40.695671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9828717d-fb6f-4cac-829b-3bdfb5c18fea tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:40.697700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9828717d-fb6f-4cac-829b-3bdfb5c18fea tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:40.698225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9828717d-fb6f-4cac-829b-3bdfb5c18fea tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:41.062055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9828717d-fb6f-4cac-829b-3bdfb5c18fea tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:41.066541 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5717e8cb-c5a6-46a9-8c2d-0248ab402069 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:41.082606 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9828717d-fb6f-4cac-829b-3bdfb5c18fea tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/b00174fc-a16c-4ae5-94d3-d43b9c963cf5" status: 200 len: 1319 microversion: 2.1 time: 0.438454 Aug 24 10:12:41.090664 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5717e8cb-c5a6-46a9-8c2d-0248ab402069 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b" status: 200 len: 1387 microversion: 2.1 time: 0.779300 Aug 24 10:12:41.093744 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 231/482] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:40 2022] GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b => generated 1387 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:41.097580 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 251/482] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:40 2022] GET /compute/v2.1/servers/b00174fc-a16c-4ae5-94d3-d43b9c963cf5 => generated 1319 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:41.103631 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3c41c9b6-7084-4473-9d1e-ecde8f18b449 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:41.104635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3c41c9b6-7084-4473-9d1e-ecde8f18b449 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 539f1a18-c5df-43d2-8d13-b7315424efb2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:41.108878 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-023ab30c-20c3-43fa-804c-f85bab39d268 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:41.112234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c41c9b6-7084-4473-9d1e-ecde8f18b449 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:41.113744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c41c9b6-7084-4473-9d1e-ecde8f18b449 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:41.115079 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c41c9b6-7084-4473-9d1e-ecde8f18b449 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:41.116051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c41c9b6-7084-4473-9d1e-ecde8f18b449 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:41.116727 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c41c9b6-7084-4473-9d1e-ecde8f18b449 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:41.117427 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c41c9b6-7084-4473-9d1e-ecde8f18b449 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:41.118883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-023ab30c-20c3-43fa-804c-f85bab39d268 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 2706bbd7-7fe1-4441-a716-a35246a87268] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:41.137170 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-3c41c9b6-7084-4473-9d1e-ecde8f18b449 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] HTTP exception thrown: Instance 539f1a18-c5df-43d2-8d13-b7315424efb2 could not be found. Aug 24 10:12:41.139540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3c41c9b6-7084-4473-9d1e-ecde8f18b449 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Request method failure captured: Aug 24 10:12:41.139540 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2 HTTP/1.1 Aug 24 10:12:41.139540 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:12:41.139540 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:12:41.139540 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:12:41.139540 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:12:41.139540 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:12:41.139540 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:12:41.139540 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:12:41.139540 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:12:41.139540 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBflZolKeUtLMAlnbLhEnFCEqRU-fBQSPOLE9_uH2UqC8RcqSTZivUbUR1GnVdI2ImnQCEgs59owuG-SDXmUDb77HdplyBPCEyN_GIwiG3P5kO1P4abnBitPmMnxJYexh6tT5VXoqoz7QEl80fvXTBtYm4fMEHVpBkG99dz101LdE4bs Aug 24 10:12:41.139540 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:12:41.139540 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:12:41.139540 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:12:41.139540 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:12:41.139540 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:12:41.139540 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:12:41.139540 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 82ddc0c46e914bbd8e265692275f7201 Aug 24 10:12:41.139540 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1931050870 Aug 24 10:12:41.139540 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:12:41.139540 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:12:41.141065 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/82ddc0c46e914bbd8e265692275f7201"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_82ddc0c46e914bbd8e265692275f7201", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/82ddc0c46e914bbd8e265692275f7201"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/82ddc0c46e914bbd8e265692275f7201"}]}] Aug 24 10:12:41.141065 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1931050870 Aug 24 10:12:41.141065 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 82ddc0c46e914bbd8e265692275f7201 Aug 24 10:12:41.141065 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1931050870 Aug 24 10:12:41.141065 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersAdminNegativeTestJSON-1931050870-project Aug 24 10:12:41.141065 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:12:41.141065 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:12:41.141065 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: e7f03e78d1af4252b1d32f0b103b6e16 Aug 24 10:12:41.141065 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1931050870-project Aug 24 10:12:41.141065 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:12:41.141065 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 539f1a18-c5df-43d2-8d13-b7315424efb2 could not be found. Aug 24 10:12:41.141065 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '539f1a18-c5df-43d2-8d13-b7315424efb2'} Aug 24 10:12:41.141958 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:12:41.141958 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:41.141958 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:12:41.141958 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:12:41.141958 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:12:41.141958 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:12:41.141958 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:12:41.141958 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:12:41.141958 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:12:41.141958 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:12:41.141958 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 539f1a18-c5df-43d2-8d13-b7315424efb2 could not be found. Aug 24 10:12:41.141958 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:41.141958 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:41.141958 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:41.141958 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:41.141958 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:41.141958 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:41.141958 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:12:41.141958 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:12:41.141958 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:12:41.143266 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:12:41.143266 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:12:41.143266 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:12:41.143266 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:12:41.143266 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:12:41.143266 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:12:41.143266 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:12:41.143266 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 539f1a18-c5df-43d2-8d13-b7315424efb2 could not be found. Aug 24 10:12:41.143266 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:41.143266 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:41.143266 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:41.143266 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:41.143266 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:41.143266 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:41.143266 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:12:41.143266 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:12:41.143266 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 539f1a18-c5df-43d2-8d13-b7315424efb2 could not be found. Aug 24 10:12:41.143266 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:41.144531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3c41c9b6-7084-4473-9d1e-ecde8f18b449 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Returning 404 to user: Instance 539f1a18-c5df-43d2-8d13-b7315424efb2 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:12:41.144531 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3c41c9b6-7084-4473-9d1e-ecde8f18b449 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2" status: 404 len: 111 microversion: 2.1 time: 0.042037 Aug 24 10:12:41.144531 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 252/483] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:41 2022] GET /compute/v2.1/servers/539f1a18-c5df-43d2-8d13-b7315424efb2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:12:41.148653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-16dfcff8-5784-49f0-a567-b4df064a7eb0 req-77a0c47b-2281-401a-8006-2564e13ece94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71cb543d-2961-4511-b990-c53fd25db381", "tag": "a67f32d5-2bc6-456e-bce8-dcad8a07253a"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:41.160815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-16dfcff8-5784-49f0-a567-b4df064a7eb0 req-77a0c47b-2281-401a-8006-2564e13ece94 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:41.161486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-16dfcff8-5784-49f0-a567-b4df064a7eb0 req-77a0c47b-2281-401a-8006-2564e13ece94 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:41.162193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-16dfcff8-5784-49f0-a567-b4df064a7eb0 req-77a0c47b-2281-401a-8006-2564e13ece94 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:41.177404 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-16dfcff8-5784-49f0-a567-b4df064a7eb0 req-77a0c47b-2281-401a-8006-2564e13ece94 service nova] Creating event network-changed:a67f32d5-2bc6-456e-bce8-dcad8a07253a for instance 71cb543d-2961-4511-b990-c53fd25db381 on n-h2-849328-3 Aug 24 10:12:41.188075 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-16dfcff8-5784-49f0-a567-b4df064a7eb0 req-77a0c47b-2281-401a-8006-2564e13ece94 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043990 Aug 24 10:12:41.190202 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 253/484] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:41.201632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-66ed4614-d94c-41b2-8dae-5b4d15e8db53 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:41.203442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-66ed4614-d94c-41b2-8dae-5b4d15e8db53 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:41.218354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66ed4614-d94c-41b2-8dae-5b4d15e8db53 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:41.219623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66ed4614-d94c-41b2-8dae-5b4d15e8db53 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:41.220237 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-023ab30c-20c3-43fa-804c-f85bab39d268 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:41.220925 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66ed4614-d94c-41b2-8dae-5b4d15e8db53 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:41.222521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66ed4614-d94c-41b2-8dae-5b4d15e8db53 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:41.223814 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66ed4614-d94c-41b2-8dae-5b4d15e8db53 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:41.225101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66ed4614-d94c-41b2-8dae-5b4d15e8db53 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:41.242945 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-023ab30c-20c3-43fa-804c-f85bab39d268 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268" status: 200 len: 1218 microversion: 2.1 time: 0.145661 Aug 24 10:12:41.243662 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 232/485] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:41 2022] GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268 => generated 1218 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:41.269602 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0d427125-7acf-44d9-84c4-2d0baab81a78 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:41.270809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0d427125-7acf-44d9-84c4-2d0baab81a78 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 10f639ed-ba2f-4983-9c04-777480733871] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:41.280938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d427125-7acf-44d9-84c4-2d0baab81a78 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:41.281971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d427125-7acf-44d9-84c4-2d0baab81a78 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:41.282659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d427125-7acf-44d9-84c4-2d0baab81a78 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:41.283563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d427125-7acf-44d9-84c4-2d0baab81a78 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:41.285014 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d427125-7acf-44d9-84c4-2d0baab81a78 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:41.286044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d427125-7acf-44d9-84c4-2d0baab81a78 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:41.375484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0d427125-7acf-44d9-84c4-2d0baab81a78 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 10f639ed-ba2f-4983-9c04-777480733871] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:12:41.571770 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0d427125-7acf-44d9-84c4-2d0baab81a78 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "DELETE /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871" status: 204 len: 0 microversion: 2.1 time: 0.317153 Aug 24 10:12:41.583011 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 233/486] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:12:41 2022] DELETE /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:12:41.600454 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-05d4b21b-07f0-45eb-a67e-b818643d61b8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:41.601147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-05d4b21b-07f0-45eb-a67e-b818643d61b8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:41.608262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05d4b21b-07f0-45eb-a67e-b818643d61b8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:41.609151 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05d4b21b-07f0-45eb-a67e-b818643d61b8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:41.609816 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05d4b21b-07f0-45eb-a67e-b818643d61b8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:41.610858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05d4b21b-07f0-45eb-a67e-b818643d61b8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:41.611477 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05d4b21b-07f0-45eb-a67e-b818643d61b8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:41.612055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05d4b21b-07f0-45eb-a67e-b818643d61b8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:41.694959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-66ed4614-d94c-41b2-8dae-5b4d15e8db53 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:41.710163 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-66ed4614-d94c-41b2-8dae-5b4d15e8db53 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381" status: 200 len: 1365 microversion: 2.1 time: 0.517664 Aug 24 10:12:41.712008 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 254/487] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:41 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381 => generated 1365 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:41.721501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c87245a6-97a5-4e20-a431-c6be27b60e44 req-10a2a977-181d-4b39-ba5c-b7dc5ffd1b22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "539f1a18-c5df-43d2-8d13-b7315424efb2", "name": "network-vif-deleted", "tag": "d55b2cba-ada4-4603-9eb5-de790963c453"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:41.740739 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c87245a6-97a5-4e20-a431-c6be27b60e44 req-10a2a977-181d-4b39-ba5c-b7dc5ffd1b22 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:41.741623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c87245a6-97a5-4e20-a431-c6be27b60e44 req-10a2a977-181d-4b39-ba5c-b7dc5ffd1b22 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:41.742469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c87245a6-97a5-4e20-a431-c6be27b60e44 req-10a2a977-181d-4b39-ba5c-b7dc5ffd1b22 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:41.760543 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c87245a6-97a5-4e20-a431-c6be27b60e44 req-10a2a977-181d-4b39-ba5c-b7dc5ffd1b22 service nova] Creating event network-vif-deleted:d55b2cba-ada4-4603-9eb5-de790963c453 for instance 539f1a18-c5df-43d2-8d13-b7315424efb2 on n-h2-849328-3 Aug 24 10:12:41.774271 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c87245a6-97a5-4e20-a431-c6be27b60e44 req-10a2a977-181d-4b39-ba5c-b7dc5ffd1b22 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060241 Aug 24 10:12:41.775089 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 255/488] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:41.782544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-85481a17-5ec8-454c-9757-c9b364b1c995 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:41.783576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-85481a17-5ec8-454c-9757-c9b364b1c995 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 10f639ed-ba2f-4983-9c04-777480733871] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:41.799202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85481a17-5ec8-454c-9757-c9b364b1c995 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:41.800195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85481a17-5ec8-454c-9757-c9b364b1c995 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:41.800999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85481a17-5ec8-454c-9757-c9b364b1c995 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:41.802722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85481a17-5ec8-454c-9757-c9b364b1c995 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:41.803809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85481a17-5ec8-454c-9757-c9b364b1c995 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:41.804555 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85481a17-5ec8-454c-9757-c9b364b1c995 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:41.934247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-05d4b21b-07f0-45eb-a67e-b818643d61b8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:41.946404 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-05d4b21b-07f0-45eb-a67e-b818643d61b8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:41.947573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-05d4b21b-07f0-45eb-a67e-b818643d61b8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:41.948841 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-05d4b21b-07f0-45eb-a67e-b818643d61b8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 200 len: 1569 microversion: 2.25 time: 0.362895 Aug 24 10:12:41.950131 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 234/489] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:41 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 1569 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:41.955012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b50e912-0311-4d13-9afc-d6fe632420d0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:41.955697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2b50e912-0311-4d13-9afc-d6fe632420d0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:41.962564 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b50e912-0311-4d13-9afc-d6fe632420d0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:41.963165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b50e912-0311-4d13-9afc-d6fe632420d0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:41.963676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b50e912-0311-4d13-9afc-d6fe632420d0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:41.964770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b50e912-0311-4d13-9afc-d6fe632420d0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:41.965665 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b50e912-0311-4d13-9afc-d6fe632420d0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:41.966495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b50e912-0311-4d13-9afc-d6fe632420d0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:42.039609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-85481a17-5ec8-454c-9757-c9b364b1c995 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:42.053801 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-85481a17-5ec8-454c-9757-c9b364b1c995 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871" status: 200 len: 1478 microversion: 2.1 time: 0.276736 Aug 24 10:12:42.055308 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 256/490] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:41 2022] GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871 => generated 1478 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:42.108219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dec4e51b-b3c7-4169-bf09-46f06c2e81a8 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:42.109628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dec4e51b-b3c7-4169-bf09-46f06c2e81a8 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: b00174fc-a16c-4ae5-94d3-d43b9c963cf5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:42.120021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dec4e51b-b3c7-4169-bf09-46f06c2e81a8 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:42.120711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dec4e51b-b3c7-4169-bf09-46f06c2e81a8 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:42.121370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dec4e51b-b3c7-4169-bf09-46f06c2e81a8 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:42.122573 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dec4e51b-b3c7-4169-bf09-46f06c2e81a8 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:42.123537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dec4e51b-b3c7-4169-bf09-46f06c2e81a8 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:42.124241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dec4e51b-b3c7-4169-bf09-46f06c2e81a8 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:42.170948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2b50e912-0311-4d13-9afc-d6fe632420d0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:42.181646 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2b50e912-0311-4d13-9afc-d6fe632420d0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1477 microversion: 2.1 time: 0.230307 Aug 24 10:12:42.182395 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 235/491] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:41 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1477 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:42.193630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1fa779e3-602d-43db-9c92-c48ca76b6206 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:42.193630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1fa779e3-602d-43db-9c92-c48ca76b6206 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: d5911032-bcaa-4a3d-bb73-ccbea62de79b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:42.203994 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fa779e3-602d-43db-9c92-c48ca76b6206 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:42.204889 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fa779e3-602d-43db-9c92-c48ca76b6206 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:42.205577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fa779e3-602d-43db-9c92-c48ca76b6206 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:42.207040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fa779e3-602d-43db-9c92-c48ca76b6206 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:42.208279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fa779e3-602d-43db-9c92-c48ca76b6206 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:42.209681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fa779e3-602d-43db-9c92-c48ca76b6206 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:42.302604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dec4e51b-b3c7-4169-bf09-46f06c2e81a8 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:42.311488 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dec4e51b-b3c7-4169-bf09-46f06c2e81a8 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/b00174fc-a16c-4ae5-94d3-d43b9c963cf5" status: 200 len: 1319 microversion: 2.1 time: 0.210258 Aug 24 10:12:42.312079 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 257/492] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:42 2022] GET /compute/v2.1/servers/b00174fc-a16c-4ae5-94d3-d43b9c963cf5 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:12:42.317310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e6c93bb3-e7dd-46ab-9ec8-3d22b7ef818e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:42.317926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e6c93bb3-e7dd-46ab-9ec8-3d22b7ef818e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 2706bbd7-7fe1-4441-a716-a35246a87268] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:42.326300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6c93bb3-e7dd-46ab-9ec8-3d22b7ef818e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:42.327532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6c93bb3-e7dd-46ab-9ec8-3d22b7ef818e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:42.328059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6c93bb3-e7dd-46ab-9ec8-3d22b7ef818e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:42.328926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6c93bb3-e7dd-46ab-9ec8-3d22b7ef818e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:42.329508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6c93bb3-e7dd-46ab-9ec8-3d22b7ef818e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:42.330005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6c93bb3-e7dd-46ab-9ec8-3d22b7ef818e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:42.409008 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e6c93bb3-e7dd-46ab-9ec8-3d22b7ef818e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:42.423655 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e6c93bb3-e7dd-46ab-9ec8-3d22b7ef818e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268" status: 200 len: 1214 microversion: 2.1 time: 0.110101 Aug 24 10:12:42.425523 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 258/493] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:42 2022] GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268 => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:42.430345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1fa779e3-602d-43db-9c92-c48ca76b6206 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:42.442653 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1fa779e3-602d-43db-9c92-c48ca76b6206 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b" status: 200 len: 1387 microversion: 2.1 time: 0.258759 Aug 24 10:12:42.444435 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 236/494] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:42 2022] GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b => generated 1387 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:42.721676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-896a2165-b4c9-411b-8410-5da17f04bdf7 req-dc44cc0e-2438-402e-addc-f8ce546da785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b00174fc-a16c-4ae5-94d3-d43b9c963cf5", "name": "network-vif-plugged", "status": "completed", "tag": "b9df294e-0c89-441c-835e-265525385287"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:42.734350 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-896a2165-b4c9-411b-8410-5da17f04bdf7 req-dc44cc0e-2438-402e-addc-f8ce546da785 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:42.735033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-896a2165-b4c9-411b-8410-5da17f04bdf7 req-dc44cc0e-2438-402e-addc-f8ce546da785 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:42.735648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-896a2165-b4c9-411b-8410-5da17f04bdf7 req-dc44cc0e-2438-402e-addc-f8ce546da785 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:42.757107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0d5092e4-4f8c-4252-b3a9-87c52c10451d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:42.758192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0d5092e4-4f8c-4252-b3a9-87c52c10451d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:42.782098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d5092e4-4f8c-4252-b3a9-87c52c10451d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:42.782879 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d5092e4-4f8c-4252-b3a9-87c52c10451d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:42.783571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d5092e4-4f8c-4252-b3a9-87c52c10451d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:42.784709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d5092e4-4f8c-4252-b3a9-87c52c10451d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:42.785929 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-896a2165-b4c9-411b-8410-5da17f04bdf7 req-dc44cc0e-2438-402e-addc-f8ce546da785 service nova] Creating event network-vif-plugged:b9df294e-0c89-441c-835e-265525385287 for instance b00174fc-a16c-4ae5-94d3-d43b9c963cf5 on n-h1-849328-3 Aug 24 10:12:42.791188 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d5092e4-4f8c-4252-b3a9-87c52c10451d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:42.791882 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d5092e4-4f8c-4252-b3a9-87c52c10451d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:42.795843 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-896a2165-b4c9-411b-8410-5da17f04bdf7 req-dc44cc0e-2438-402e-addc-f8ce546da785 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079848 Aug 24 10:12:42.797223 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 259/495] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:12:42.987590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-951993a5-62e1-4674-b43c-f81b52830421 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:42.988618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-951993a5-62e1-4674-b43c-f81b52830421 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:42.996465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-951993a5-62e1-4674-b43c-f81b52830421 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:42.997842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-951993a5-62e1-4674-b43c-f81b52830421 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:42.998796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-951993a5-62e1-4674-b43c-f81b52830421 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:43.000070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-951993a5-62e1-4674-b43c-f81b52830421 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:43.001278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-951993a5-62e1-4674-b43c-f81b52830421 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:43.002070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-951993a5-62e1-4674-b43c-f81b52830421 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:43.038648 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0d5092e4-4f8c-4252-b3a9-87c52c10451d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:43.054900 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0d5092e4-4f8c-4252-b3a9-87c52c10451d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381" status: 200 len: 1365 microversion: 2.1 time: 0.310678 Aug 24 10:12:43.068743 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 237/496] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:42 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381 => generated 1365 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:43.087930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-89be08eb-98fe-4540-b971-737980169f92 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:43.089015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-89be08eb-98fe-4540-b971-737980169f92 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 10f639ed-ba2f-4983-9c04-777480733871] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:43.107966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89be08eb-98fe-4540-b971-737980169f92 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:43.109585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89be08eb-98fe-4540-b971-737980169f92 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:43.110121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89be08eb-98fe-4540-b971-737980169f92 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:43.115826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89be08eb-98fe-4540-b971-737980169f92 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:43.116480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89be08eb-98fe-4540-b971-737980169f92 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:43.117000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89be08eb-98fe-4540-b971-737980169f92 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:43.458192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-951993a5-62e1-4674-b43c-f81b52830421 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:43.471141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-951993a5-62e1-4674-b43c-f81b52830421 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:43.472681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-951993a5-62e1-4674-b43c-f81b52830421 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:43.474590 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-951993a5-62e1-4674-b43c-f81b52830421 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 200 len: 1569 microversion: 2.25 time: 0.493172 Aug 24 10:12:43.475378 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 260/497] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:42 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 1569 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:12:43.483227 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-caa549e5-d87b-4c07-b40f-91f0682437d9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:43.484009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-caa549e5-d87b-4c07-b40f-91f0682437d9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:43.491176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-caa549e5-d87b-4c07-b40f-91f0682437d9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:43.491910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-caa549e5-d87b-4c07-b40f-91f0682437d9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:43.492554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-caa549e5-d87b-4c07-b40f-91f0682437d9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:43.493658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-caa549e5-d87b-4c07-b40f-91f0682437d9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:43.494498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-caa549e5-d87b-4c07-b40f-91f0682437d9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:43.495080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-caa549e5-d87b-4c07-b40f-91f0682437d9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:43.602451 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-89be08eb-98fe-4540-b971-737980169f92 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:43.614216 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-89be08eb-98fe-4540-b971-737980169f92 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871" status: 200 len: 1478 microversion: 2.1 time: 0.539756 Aug 24 10:12:43.615451 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 238/498] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:43 2022] GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871 => generated 1478 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:12:43.621969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6ba84ab5-eaad-424f-9ef5-95aec18105b9 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:43.622895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6ba84ab5-eaad-424f-9ef5-95aec18105b9 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: b00174fc-a16c-4ae5-94d3-d43b9c963cf5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:43.641842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ba84ab5-eaad-424f-9ef5-95aec18105b9 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:43.642884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ba84ab5-eaad-424f-9ef5-95aec18105b9 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:43.643846 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ba84ab5-eaad-424f-9ef5-95aec18105b9 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:43.647744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ba84ab5-eaad-424f-9ef5-95aec18105b9 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:43.648476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ba84ab5-eaad-424f-9ef5-95aec18105b9 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:43.649305 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ba84ab5-eaad-424f-9ef5-95aec18105b9 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:43.862853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-caa549e5-d87b-4c07-b40f-91f0682437d9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:43.879646 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-caa549e5-d87b-4c07-b40f-91f0682437d9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1477 microversion: 2.1 time: 0.402415 Aug 24 10:12:43.889723 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 261/499] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:43 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1477 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:43.899229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b2264f4b-f8c8-4f77-ba4d-3d761dae7b7f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:43.899824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b2264f4b-f8c8-4f77-ba4d-3d761dae7b7f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 2706bbd7-7fe1-4441-a716-a35246a87268] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:43.909201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2264f4b-f8c8-4f77-ba4d-3d761dae7b7f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:43.909996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2264f4b-f8c8-4f77-ba4d-3d761dae7b7f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:43.910430 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2264f4b-f8c8-4f77-ba4d-3d761dae7b7f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:43.911137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2264f4b-f8c8-4f77-ba4d-3d761dae7b7f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:43.911590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2264f4b-f8c8-4f77-ba4d-3d761dae7b7f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:43.912211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2264f4b-f8c8-4f77-ba4d-3d761dae7b7f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:43.923675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6ba84ab5-eaad-424f-9ef5-95aec18105b9 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:43.934493 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6ba84ab5-eaad-424f-9ef5-95aec18105b9 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/b00174fc-a16c-4ae5-94d3-d43b9c963cf5" status: 200 len: 1319 microversion: 2.1 time: 0.317554 Aug 24 10:12:43.936699 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 239/500] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:43 2022] GET /compute/v2.1/servers/b00174fc-a16c-4ae5-94d3-d43b9c963cf5 => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:43.944275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1fb9efe1-f3ca-4c85-b22d-8e0ad8c37095 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:43.945464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1fb9efe1-f3ca-4c85-b22d-8e0ad8c37095 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: d5911032-bcaa-4a3d-bb73-ccbea62de79b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:43.964172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fb9efe1-f3ca-4c85-b22d-8e0ad8c37095 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:43.964719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fb9efe1-f3ca-4c85-b22d-8e0ad8c37095 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:43.965424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fb9efe1-f3ca-4c85-b22d-8e0ad8c37095 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:43.967680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fb9efe1-f3ca-4c85-b22d-8e0ad8c37095 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:43.968297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fb9efe1-f3ca-4c85-b22d-8e0ad8c37095 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:43.969006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fb9efe1-f3ca-4c85-b22d-8e0ad8c37095 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:44.064611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b2264f4b-f8c8-4f77-ba4d-3d761dae7b7f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:44.078508 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b2264f4b-f8c8-4f77-ba4d-3d761dae7b7f tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268" status: 200 len: 1214 microversion: 2.1 time: 0.187064 Aug 24 10:12:44.079639 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 262/501] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:43 2022] GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268 => generated 1214 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:44.283884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f3c041d4-3dc6-4e38-a31f-43c9394e064f tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:44.286929 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:12:44.286929 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:12:44.288313 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3c041d4-3dc6-4e38-a31f-43c9394e064f tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:44.292540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3c041d4-3dc6-4e38-a31f-43c9394e064f tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:44.293360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3c041d4-3dc6-4e38-a31f-43c9394e064f tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:44.294391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3c041d4-3dc6-4e38-a31f-43c9394e064f tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:44.298554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3c041d4-3dc6-4e38-a31f-43c9394e064f tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:44.299012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3c041d4-3dc6-4e38-a31f-43c9394e064f tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:44.332604 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f3c041d4-3dc6-4e38-a31f-43c9394e064f tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.250216 Aug 24 10:12:44.333648 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 263/502] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:12:44 2022] GET /compute/v2.1/os-services => generated 944 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:44.339155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c72b60e5-cf67-4fa1-bc45-1f3040c6a3f5 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:44.340068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c72b60e5-cf67-4fa1-bc45-1f3040c6a3f5 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:44.347638 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c72b60e5-cf67-4fa1-bc45-1f3040c6a3f5 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:44.348132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c72b60e5-cf67-4fa1-bc45-1f3040c6a3f5 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:44.348818 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c72b60e5-cf67-4fa1-bc45-1f3040c6a3f5 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:44.349659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c72b60e5-cf67-4fa1-bc45-1f3040c6a3f5 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:44.350285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c72b60e5-cf67-4fa1-bc45-1f3040c6a3f5 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:44.350673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c72b60e5-cf67-4fa1-bc45-1f3040c6a3f5 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:44.522135 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1fb9efe1-f3ca-4c85-b22d-8e0ad8c37095 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:44.533112 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1fb9efe1-f3ca-4c85-b22d-8e0ad8c37095 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b" status: 200 len: 1586 microversion: 2.1 time: 0.594145 Aug 24 10:12:44.549375 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 240/503] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:43 2022] GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b => generated 1586 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:44.556057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bc8c0d0e-148b-4aee-abbe-4683019e7ee6 tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:44.559188 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:12:44.559188 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:12:44.560752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc8c0d0e-148b-4aee-abbe-4683019e7ee6 tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:44.561466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc8c0d0e-148b-4aee-abbe-4683019e7ee6 tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:44.562085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc8c0d0e-148b-4aee-abbe-4683019e7ee6 tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:44.563104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc8c0d0e-148b-4aee-abbe-4683019e7ee6 tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:44.563867 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc8c0d0e-148b-4aee-abbe-4683019e7ee6 tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:44.564536 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc8c0d0e-148b-4aee-abbe-4683019e7ee6 tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:44.598057 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bc8c0d0e-148b-4aee-abbe-4683019e7ee6 tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.047211 Aug 24 10:12:44.599340 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 241/504] 10.222.0.85 () {58 vars in 1170 bytes} [Wed Aug 24 10:12:44 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:44.604686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e52b7a64-3d8d-4d5b-81a3-838d4dcbc5d2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:44.605967 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e52b7a64-3d8d-4d5b-81a3-838d4dcbc5d2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:44.613094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e52b7a64-3d8d-4d5b-81a3-838d4dcbc5d2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:44.613888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e52b7a64-3d8d-4d5b-81a3-838d4dcbc5d2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:44.614490 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e52b7a64-3d8d-4d5b-81a3-838d4dcbc5d2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:44.615358 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e52b7a64-3d8d-4d5b-81a3-838d4dcbc5d2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:44.615965 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e52b7a64-3d8d-4d5b-81a3-838d4dcbc5d2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:44.616563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e52b7a64-3d8d-4d5b-81a3-838d4dcbc5d2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:45.019102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c72b60e5-cf67-4fa1-bc45-1f3040c6a3f5 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:45.028592 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e52b7a64-3d8d-4d5b-81a3-838d4dcbc5d2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:45.032829 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c72b60e5-cf67-4fa1-bc45-1f3040c6a3f5 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381" status: 200 len: 1365 microversion: 2.1 time: 0.697524 Aug 24 10:12:45.033853 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 264/505] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:44 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381 => generated 1365 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:45.089460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1c5c26ee-f657-4241-88a1-b0948f84da96 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:45.089707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e52b7a64-3d8d-4d5b-81a3-838d4dcbc5d2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:45.090517 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1c5c26ee-f657-4241-88a1-b0948f84da96 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: d5911032-bcaa-4a3d-bb73-ccbea62de79b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:45.097365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e52b7a64-3d8d-4d5b-81a3-838d4dcbc5d2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:45.100439 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e52b7a64-3d8d-4d5b-81a3-838d4dcbc5d2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 200 len: 1559 microversion: 2.25 time: 0.499399 Aug 24 10:12:45.101033 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 242/506] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:44 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 1559 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:45.116239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c5c26ee-f657-4241-88a1-b0948f84da96 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:45.116743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c5c26ee-f657-4241-88a1-b0948f84da96 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:45.117218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c5c26ee-f657-4241-88a1-b0948f84da96 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:45.117957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c5c26ee-f657-4241-88a1-b0948f84da96 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:45.123140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c5c26ee-f657-4241-88a1-b0948f84da96 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:45.123679 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c7913e7a-74e0-49e5-adf4-64891cd1a2ef tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:45.126646 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:12:45.126646 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:12:45.127029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c5c26ee-f657-4241-88a1-b0948f84da96 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:45.127887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7913e7a-74e0-49e5-adf4-64891cd1a2ef tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:45.128369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7913e7a-74e0-49e5-adf4-64891cd1a2ef tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:45.128804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7913e7a-74e0-49e5-adf4-64891cd1a2ef tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:45.130186 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7913e7a-74e0-49e5-adf4-64891cd1a2ef tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:45.130647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7913e7a-74e0-49e5-adf4-64891cd1a2ef tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:45.131056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7913e7a-74e0-49e5-adf4-64891cd1a2ef tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:45.176569 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c7913e7a-74e0-49e5-adf4-64891cd1a2ef tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.062124 Aug 24 10:12:45.187403 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 243/507] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:12:45 2022] GET /compute/v2.1/os-services => generated 944 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:45.190385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e2d8e711-0924-4352-af05-f25be5b962cb tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:45.191035 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e2d8e711-0924-4352-af05-f25be5b962cb tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 10f639ed-ba2f-4983-9c04-777480733871] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:45.198393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2d8e711-0924-4352-af05-f25be5b962cb tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:45.198881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2d8e711-0924-4352-af05-f25be5b962cb tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:45.199491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2d8e711-0924-4352-af05-f25be5b962cb tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:45.200647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2d8e711-0924-4352-af05-f25be5b962cb tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:45.201293 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2d8e711-0924-4352-af05-f25be5b962cb tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:45.201862 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2d8e711-0924-4352-af05-f25be5b962cb tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:45.372157 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1c5c26ee-f657-4241-88a1-b0948f84da96 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.313124 Aug 24 10:12:45.373475 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 265/508] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Aug 24 10:12:45 2022] GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b/os-interface => generated 285 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:45.384741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-77f7a474-39aa-4d24-9878-f3071bb298da tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:45.388338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-77f7a474-39aa-4d24-9878-f3071bb298da tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:45.415840 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77f7a474-39aa-4d24-9878-f3071bb298da tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:45.418519 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77f7a474-39aa-4d24-9878-f3071bb298da tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:45.419194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77f7a474-39aa-4d24-9878-f3071bb298da tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:45.420080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77f7a474-39aa-4d24-9878-f3071bb298da tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:45.421756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77f7a474-39aa-4d24-9878-f3071bb298da tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:45.426241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77f7a474-39aa-4d24-9878-f3071bb298da tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:45.850586 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e2d8e711-0924-4352-af05-f25be5b962cb tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:45.862159 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e2d8e711-0924-4352-af05-f25be5b962cb tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871" status: 200 len: 1478 microversion: 2.1 time: 0.674369 Aug 24 10:12:45.862979 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 244/509] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:45 2022] GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871 => generated 1478 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:45.867256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f1ecb485-74c0-4006-b33f-bf47b8052475 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:45.868099 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f1ecb485-74c0-4006-b33f-bf47b8052475 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: b00174fc-a16c-4ae5-94d3-d43b9c963cf5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:45.875668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1ecb485-74c0-4006-b33f-bf47b8052475 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:45.876523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1ecb485-74c0-4006-b33f-bf47b8052475 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:45.877396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1ecb485-74c0-4006-b33f-bf47b8052475 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:45.878142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1ecb485-74c0-4006-b33f-bf47b8052475 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:45.878616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1ecb485-74c0-4006-b33f-bf47b8052475 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:45.879272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1ecb485-74c0-4006-b33f-bf47b8052475 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:45.892504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-77f7a474-39aa-4d24-9878-f3071bb298da tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:45.902272 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-77f7a474-39aa-4d24-9878-f3071bb298da tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1477 microversion: 2.1 time: 0.527239 Aug 24 10:12:45.903341 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 266/510] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:45 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1477 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:45.908680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-54affc78-957d-4066-8718-c1b674666c3e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:45.909653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-54affc78-957d-4066-8718-c1b674666c3e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 2706bbd7-7fe1-4441-a716-a35246a87268] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:45.936270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54affc78-957d-4066-8718-c1b674666c3e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:45.940435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54affc78-957d-4066-8718-c1b674666c3e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:45.944393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54affc78-957d-4066-8718-c1b674666c3e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:45.945792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54affc78-957d-4066-8718-c1b674666c3e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:45.946704 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54affc78-957d-4066-8718-c1b674666c3e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:45.947506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54affc78-957d-4066-8718-c1b674666c3e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:45.956373 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:46.040518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-54affc78-957d-4066-8718-c1b674666c3e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:46.053713 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-54affc78-957d-4066-8718-c1b674666c3e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268" status: 200 len: 1276 microversion: 2.1 time: 0.148857 Aug 24 10:12:46.068358 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 267/511] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:45 2022] GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268 => generated 1276 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:46.068358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e9033669-041d-4c9d-8b36-eb2504c682ae tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Calling method '.version_select at 0x7f465553c160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:46.068358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9033669-041d-4c9d-8b36-eb2504c682ae tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:46.068358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9033669-041d-4c9d-8b36-eb2504c682ae tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:46.069343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9033669-041d-4c9d-8b36-eb2504c682ae tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:46.088710 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e9033669-041d-4c9d-8b36-eb2504c682ae tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] 10.222.0.85 "GET /compute/v2.1/os-migrations" status: 200 len: 1104 microversion: 2.25 time: 0.032603 Aug 24 10:12:46.099980 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 268/512] 10.222.0.85 () {60 vars in 1184 bytes} [Wed Aug 24 10:12:46 2022] GET /compute/v2.1/os-migrations => generated 1104 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:46.106259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f352f2ee-ab01-4e13-8af6-0cc1a5b97cb7 tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:46.111674 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:12:46.111674 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:12:46.114012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f352f2ee-ab01-4e13-8af6-0cc1a5b97cb7 tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:46.114998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f352f2ee-ab01-4e13-8af6-0cc1a5b97cb7 tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:46.116129 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f352f2ee-ab01-4e13-8af6-0cc1a5b97cb7 tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:46.117610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f352f2ee-ab01-4e13-8af6-0cc1a5b97cb7 tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:46.118520 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f352f2ee-ab01-4e13-8af6-0cc1a5b97cb7 tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:46.120412 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f352f2ee-ab01-4e13-8af6-0cc1a5b97cb7 tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:46.166891 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f352f2ee-ab01-4e13-8af6-0cc1a5b97cb7 tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] 10.222.0.85 "GET /compute/v2.1/os-services?host=n-d-849328-3&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.065421 Aug 24 10:12:46.177297 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 269/513] 10.222.0.85 () {58 vars in 1194 bytes} [Wed Aug 24 10:12:46 2022] GET /compute/v2.1/os-services?host=n-d-849328-3&binary=xxx => generated 16 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:12:46.191500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-5815c90b-f40b-4e04-9e37-cf1344b1ca33 req-249fc7d7-3da1-4773-87b6-18b28763f798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10f639ed-ba2f-4983-9c04-777480733871", "name": "network-vif-deleted", "tag": "d870b289-99aa-430a-87ca-f1845d13d5e2"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:46.205817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5815c90b-f40b-4e04-9e37-cf1344b1ca33 req-249fc7d7-3da1-4773-87b6-18b28763f798 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:46.206772 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5815c90b-f40b-4e04-9e37-cf1344b1ca33 req-249fc7d7-3da1-4773-87b6-18b28763f798 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:46.207470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5815c90b-f40b-4e04-9e37-cf1344b1ca33 req-249fc7d7-3da1-4773-87b6-18b28763f798 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:46.226038 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-5815c90b-f40b-4e04-9e37-cf1344b1ca33 req-249fc7d7-3da1-4773-87b6-18b28763f798 service nova] Creating event network-vif-deleted:d870b289-99aa-430a-87ca-f1845d13d5e2 for instance 10f639ed-ba2f-4983-9c04-777480733871 on n-h2-849328-3 Aug 24 10:12:46.235293 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-5815c90b-f40b-4e04-9e37-cf1344b1ca33 req-249fc7d7-3da1-4773-87b6-18b28763f798 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052150 Aug 24 10:12:46.236786 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 270/514] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:46.246508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-20f22add-3b38-4f00-ad36-984c722300c9 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:46.247671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-20f22add-3b38-4f00-ad36-984c722300c9 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:46.258505 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20f22add-3b38-4f00-ad36-984c722300c9 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:46.259510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20f22add-3b38-4f00-ad36-984c722300c9 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:46.260996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20f22add-3b38-4f00-ad36-984c722300c9 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:46.262123 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20f22add-3b38-4f00-ad36-984c722300c9 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:46.262852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20f22add-3b38-4f00-ad36-984c722300c9 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:46.263684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20f22add-3b38-4f00-ad36-984c722300c9 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:46.422087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f1ecb485-74c0-4006-b33f-bf47b8052475 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:46.442100 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f1ecb485-74c0-4006-b33f-bf47b8052475 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/b00174fc-a16c-4ae5-94d3-d43b9c963cf5" status: 200 len: 1468 microversion: 2.1 time: 0.578435 Aug 24 10:12:46.443204 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 245/515] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:45 2022] GET /compute/v2.1/servers/b00174fc-a16c-4ae5-94d3-d43b9c963cf5 => generated 1468 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:46.449554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d260af7b-29ef-4737-8009-193d69e682d2 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:46.450578 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d260af7b-29ef-4737-8009-193d69e682d2 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:46.455263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-20f22add-3b38-4f00-ad36-984c722300c9 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:46.459679 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d260af7b-29ef-4737-8009-193d69e682d2 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:46.460544 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d260af7b-29ef-4737-8009-193d69e682d2 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:46.461339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d260af7b-29ef-4737-8009-193d69e682d2 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:46.462721 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d260af7b-29ef-4737-8009-193d69e682d2 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:46.463429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d260af7b-29ef-4737-8009-193d69e682d2 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:46.464090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d260af7b-29ef-4737-8009-193d69e682d2 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:46.471711 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-20f22add-3b38-4f00-ad36-984c722300c9 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381" status: 200 len: 1365 microversion: 2.1 time: 0.233312 Aug 24 10:12:46.472646 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 271/516] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:46 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381 => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:46.480781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f92f7496-39e3-49b9-88f2-b0892c433acd tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:46.499497 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:12:46.499497 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:12:46.502426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f92f7496-39e3-49b9-88f2-b0892c433acd tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:46.504776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f92f7496-39e3-49b9-88f2-b0892c433acd tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:46.505734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f92f7496-39e3-49b9-88f2-b0892c433acd tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:46.507124 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f92f7496-39e3-49b9-88f2-b0892c433acd tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:46.508432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f92f7496-39e3-49b9-88f2-b0892c433acd tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:46.509409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f92f7496-39e3-49b9-88f2-b0892c433acd tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:46.538398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:46.566041 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f92f7496-39e3-49b9-88f2-b0892c433acd tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.091458 Aug 24 10:12:46.568123 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 272/517] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:12:46 2022] GET /compute/v2.1/os-services => generated 944 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:46.577473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-76119c89-94dc-45d7-b1a1-7bd4481d4678 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:46.578917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-76119c89-94dc-45d7-b1a1-7bd4481d4678 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: db566c0d-ce6a-4d8d-bba4-c1480a160d01] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:46.590542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76119c89-94dc-45d7-b1a1-7bd4481d4678 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:46.591796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76119c89-94dc-45d7-b1a1-7bd4481d4678 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:46.592796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76119c89-94dc-45d7-b1a1-7bd4481d4678 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:46.594448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76119c89-94dc-45d7-b1a1-7bd4481d4678 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:46.600665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76119c89-94dc-45d7-b1a1-7bd4481d4678 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:46.603069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76119c89-94dc-45d7-b1a1-7bd4481d4678 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:46.841635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-76119c89-94dc-45d7-b1a1-7bd4481d4678 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:46.853311 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-76119c89-94dc-45d7-b1a1-7bd4481d4678 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/db566c0d-ce6a-4d8d-bba4-c1480a160d01" status: 200 len: 1319 microversion: 2.1 time: 0.283296 Aug 24 10:12:46.866679 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 273/518] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:46 2022] GET /compute/v2.1/servers/db566c0d-ce6a-4d8d-bba4-c1480a160d01 => generated 1319 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:46.876442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a2b3ca35-17c0-4a52-b270-1de3f6cd314e tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:46.879847 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:12:46.879847 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:12:46.881637 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2b3ca35-17c0-4a52-b270-1de3f6cd314e tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:46.882374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2b3ca35-17c0-4a52-b270-1de3f6cd314e tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:46.886165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2b3ca35-17c0-4a52-b270-1de3f6cd314e tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:46.893769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2b3ca35-17c0-4a52-b270-1de3f6cd314e tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:46.896169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2b3ca35-17c0-4a52-b270-1de3f6cd314e tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:46.899901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2b3ca35-17c0-4a52-b270-1de3f6cd314e tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:46.964608 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a2b3ca35-17c0-4a52-b270-1de3f6cd314e tempest-ServicesAdminNegativeTestJSON-1108473005 tempest-ServicesAdminNegativeTestJSON-1108473005-project-admin] 10.222.0.85 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.092735 Aug 24 10:12:46.967586 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 274/519] 10.222.0.85 () {58 vars in 1198 bytes} [Wed Aug 24 10:12:46 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:12:46.976638 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a00685fa-e646-4886-8ed8-4387745f90eb req-4bf000eb-6e50-4869-918f-f0fb971c2ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db566c0d-ce6a-4d8d-bba4-c1480a160d01", "name": "network-vif-plugged", "status": "completed", "tag": "94316740-068c-4594-b2af-29996f90fa21"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:46.991617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a00685fa-e646-4886-8ed8-4387745f90eb req-4bf000eb-6e50-4869-918f-f0fb971c2ebd service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:46.992521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a00685fa-e646-4886-8ed8-4387745f90eb req-4bf000eb-6e50-4869-918f-f0fb971c2ebd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:46.993376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a00685fa-e646-4886-8ed8-4387745f90eb req-4bf000eb-6e50-4869-918f-f0fb971c2ebd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:47.015239 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a00685fa-e646-4886-8ed8-4387745f90eb req-4bf000eb-6e50-4869-918f-f0fb971c2ebd service nova] Creating event network-vif-plugged:94316740-068c-4594-b2af-29996f90fa21 for instance db566c0d-ce6a-4d8d-bba4-c1480a160d01 on n-h1-849328-3 Aug 24 10:12:47.023940 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a00685fa-e646-4886-8ed8-4387745f90eb req-4bf000eb-6e50-4869-918f-f0fb971c2ebd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055927 Aug 24 10:12:47.025949 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 275/520] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:47.035161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c25edf2b-a8b6-402a-9488-34e946308b4e tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:47.036163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c25edf2b-a8b6-402a-9488-34e946308b4e tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 10f639ed-ba2f-4983-9c04-777480733871] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:47.047385 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c25edf2b-a8b6-402a-9488-34e946308b4e tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:47.048170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c25edf2b-a8b6-402a-9488-34e946308b4e tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:47.049004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c25edf2b-a8b6-402a-9488-34e946308b4e tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:47.050085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c25edf2b-a8b6-402a-9488-34e946308b4e tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:47.050818 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c25edf2b-a8b6-402a-9488-34e946308b4e tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:47.051589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c25edf2b-a8b6-402a-9488-34e946308b4e tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:47.122462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c25edf2b-a8b6-402a-9488-34e946308b4e tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:47.122936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c25edf2b-a8b6-402a-9488-34e946308b4e tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:47.123655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c25edf2b-a8b6-402a-9488-34e946308b4e tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:47.124170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-c25edf2b-a8b6-402a-9488-34e946308b4e tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lazy-loading 'fault' on Instance uuid 10f639ed-ba2f-4983-9c04-777480733871 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:12:47.228192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c25edf2b-a8b6-402a-9488-34e946308b4e tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f03e78d1af4252b1d32f0b103b6e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ddc0c46e914bbd8e265692275f7201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:47.250785 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c25edf2b-a8b6-402a-9488-34e946308b4e tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871" status: 200 len: 1312 microversion: 2.1 time: 0.223337 Aug 24 10:12:47.251264 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 276/521] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:47 2022] GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871 => generated 1312 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:47.256287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-d260af7b-29ef-4737-8009-193d69e682d2 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lazy-loading 'services' on Instance uuid 162790d5-1b97-47d9-b4df-c897b854a902 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:12:47.263824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b3cf6ea1-f623-4e25-9ba5-c2bb13e8c1da tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:47.264454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b3cf6ea1-f623-4e25-9ba5-c2bb13e8c1da tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:47.282696 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d260af7b-29ef-4737-8009-193d69e682d2 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 200 len: 2052 microversion: 2.25 time: 0.838012 Aug 24 10:12:47.282696 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 246/522] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:46 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 2052 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:47.300080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3cf6ea1-f623-4e25-9ba5-c2bb13e8c1da tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:47.300601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3cf6ea1-f623-4e25-9ba5-c2bb13e8c1da tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:47.301047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3cf6ea1-f623-4e25-9ba5-c2bb13e8c1da tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:47.304715 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3cf6ea1-f623-4e25-9ba5-c2bb13e8c1da tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:47.305226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3cf6ea1-f623-4e25-9ba5-c2bb13e8c1da tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:47.305674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3cf6ea1-f623-4e25-9ba5-c2bb13e8c1da tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:47.514262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8038e62b-30c4-416a-9ac8-2e52ff359ef1 tempest-ServicesAdminNegativeTestJSON-148679080 tempest-ServicesAdminNegativeTestJSON-148679080-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:47.523665 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:12:47.523665 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:12:47.525547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8038e62b-30c4-416a-9ac8-2e52ff359ef1 tempest-ServicesAdminNegativeTestJSON-148679080 tempest-ServicesAdminNegativeTestJSON-148679080-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'ad6138e68236434d9f119e16144ffdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2848c60c498a4782a2ebbccfec35df67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:47.529921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8038e62b-30c4-416a-9ac8-2e52ff359ef1 tempest-ServicesAdminNegativeTestJSON-148679080 tempest-ServicesAdminNegativeTestJSON-148679080-project] Request method failure captured: Aug 24 10:12:47.529921 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 24 10:12:47.529921 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:12:47.529921 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:12:47.529921 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:12:47.529921 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:12:47.529921 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:12:47.529921 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:12:47.529921 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:12:47.529921 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:12:47.529921 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfma8vdTs44r7Kk8get-akaltuhSOzimBhvfBbTNLJr2mvZcs8bKNri1bzhQu5KaA4H1wNpEnq9z-p6FvQZUWhqOLcOvUG3uzEge-IjoBUOhf_0h_50UgYHXto1NfJnIvL-OZDpqn7hHQI2oK8ACvapkfk3CJwM7br48A36eyfChCcU Aug 24 10:12:47.529921 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:12:47.529921 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:12:47.529921 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:12:47.529921 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:12:47.529921 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:12:47.529921 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:12:47.529921 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 2848c60c498a4782a2ebbccfec35df67 Aug 24 10:12:47.529921 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-148679080 Aug 24 10:12:47.529921 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:12:47.529921 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:12:47.532633 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2848c60c498a4782a2ebbccfec35df67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_2848c60c498a4782a2ebbccfec35df67", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2848c60c498a4782a2ebbccfec35df67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/2848c60c498a4782a2ebbccfec35df67"}]}] Aug 24 10:12:47.532633 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-148679080 Aug 24 10:12:47.532633 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 2848c60c498a4782a2ebbccfec35df67 Aug 24 10:12:47.532633 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-148679080 Aug 24 10:12:47.532633 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServicesAdminNegativeTestJSON-148679080-project Aug 24 10:12:47.532633 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:12:47.532633 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:12:47.532633 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: ad6138e68236434d9f119e16144ffdba Aug 24 10:12:47.532633 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-148679080-project Aug 24 10:12:47.532633 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:12:47.532633 n-d-849328-3 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 24 10:12:47.532633 n-d-849328-3 devstack@n-api.service[122432]: action_args: {} Aug 24 10:12:47.533654 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:12:47.533654 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:47.533654 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:47.533654 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:47.533654 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:12:47.533654 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:12:47.533654 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 10:12:47.533654 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:12:47.533654 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 10:12:47.533654 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:12:47.533654 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:12:47.533654 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:12:47.533654 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 24 10:12:47.533654 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 24 10:12:47.533654 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:12:47.533654 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:12:47.533654 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:12:47.533654 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:12:47.533654 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:12:47.536116 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:12:47.536116 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:12:47.536116 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:12:47.536116 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:12:47.536116 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:12:47.536116 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:12:47.536116 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:12:47.536116 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:12:47.536116 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:12:47.536116 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 24 10:12:47.536116 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:47.536116 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:47.536116 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:47.536116 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:47.536116 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:47.536116 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:47.536116 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:12:47.536116 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:12:47.536116 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 24 10:12:47.536116 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:47.539427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8038e62b-30c4-416a-9ac8-2e52ff359ef1 tempest-ServicesAdminNegativeTestJSON-148679080 tempest-ServicesAdminNegativeTestJSON-148679080-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:12:47.539427 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8038e62b-30c4-416a-9ac8-2e52ff359ef1 tempest-ServicesAdminNegativeTestJSON-148679080 tempest-ServicesAdminNegativeTestJSON-148679080-project] 10.222.0.85 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.218671 Aug 24 10:12:47.540651 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 247/523] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:12:47 2022] GET /compute/v2.1/os-services => generated 112 bytes in 256 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:12:47.549280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-51239d05-5e0d-4fb3-8089-344d4b5212e0 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:47.551978 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-51239d05-5e0d-4fb3-8089-344d4b5212e0 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 2706bbd7-7fe1-4441-a716-a35246a87268] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:47.562580 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51239d05-5e0d-4fb3-8089-344d4b5212e0 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:47.563187 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51239d05-5e0d-4fb3-8089-344d4b5212e0 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:47.564940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51239d05-5e0d-4fb3-8089-344d4b5212e0 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:47.566325 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51239d05-5e0d-4fb3-8089-344d4b5212e0 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:47.567208 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51239d05-5e0d-4fb3-8089-344d4b5212e0 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:47.568064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51239d05-5e0d-4fb3-8089-344d4b5212e0 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:47.628884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:47.720843 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b3cf6ea1-f623-4e25-9ba5-c2bb13e8c1da tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:47.732491 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b3cf6ea1-f623-4e25-9ba5-c2bb13e8c1da tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1477 microversion: 2.1 time: 0.479285 Aug 24 10:12:47.733839 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 277/524] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:47 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1477 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:47.740143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-30e842ee-c6cf-40f5-bf51-a82db8c549c0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-337174796", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "68027218-9cf0-4391-8ca9-11006ba08a7a"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:47.745630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-51239d05-5e0d-4fb3-8089-344d4b5212e0 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:47.755829 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-51239d05-5e0d-4fb3-8089-344d4b5212e0 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268" status: 200 len: 1276 microversion: 2.1 time: 0.213797 Aug 24 10:12:47.756614 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 248/525] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:47 2022] GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268 => generated 1276 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:47.761971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0794de36-3664-497e-bbb0-0cef6521022e tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:47.762787 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0794de36-3664-497e-bbb0-0cef6521022e tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:47.769621 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0794de36-3664-497e-bbb0-0cef6521022e tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:47.770368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0794de36-3664-497e-bbb0-0cef6521022e tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:47.775483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0794de36-3664-497e-bbb0-0cef6521022e tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:47.786406 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0794de36-3664-497e-bbb0-0cef6521022e tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:47.788362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0794de36-3664-497e-bbb0-0cef6521022e tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:47.794423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0794de36-3664-497e-bbb0-0cef6521022e tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:47.840486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-30e842ee-c6cf-40f5-bf51-a82db8c549c0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] validate_networks() for [('68027218-9cf0-4391-8ca9-11006ba08a7a', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:12:48.120417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0794de36-3664-497e-bbb0-0cef6521022e tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:48.131501 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0794de36-3664-497e-bbb0-0cef6521022e tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381" status: 200 len: 1365 microversion: 2.1 time: 0.373111 Aug 24 10:12:48.133218 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 249/526] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:47 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381 => generated 1365 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:48.139243 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0fee368b-7c24-458a-9a1c-ea1da9870668 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:48.140687 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0fee368b-7c24-458a-9a1c-ea1da9870668 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: db566c0d-ce6a-4d8d-bba4-c1480a160d01] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:48.148180 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fee368b-7c24-458a-9a1c-ea1da9870668 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:48.149865 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fee368b-7c24-458a-9a1c-ea1da9870668 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:48.150504 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fee368b-7c24-458a-9a1c-ea1da9870668 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:48.151388 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fee368b-7c24-458a-9a1c-ea1da9870668 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:48.152004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fee368b-7c24-458a-9a1c-ea1da9870668 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:48.152744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fee368b-7c24-458a-9a1c-ea1da9870668 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:48.512126 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0fee368b-7c24-458a-9a1c-ea1da9870668 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:48.542288 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0fee368b-7c24-458a-9a1c-ea1da9870668 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/db566c0d-ce6a-4d8d-bba4-c1480a160d01" status: 200 len: 1319 microversion: 2.1 time: 0.407188 Aug 24 10:12:48.546223 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 250/527] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:48 2022] GET /compute/v2.1/servers/db566c0d-ce6a-4d8d-bba4-c1480a160d01 => generated 1319 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:48.574968 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cfcf599b-d119-4bf2-9683-89c1c6b455c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:48.578883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cfcf599b-d119-4bf2-9683-89c1c6b455c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] [instance: 10f639ed-ba2f-4983-9c04-777480733871] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:48.616111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cfcf599b-d119-4bf2-9683-89c1c6b455c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:48.619059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cfcf599b-d119-4bf2-9683-89c1c6b455c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:48.619951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cfcf599b-d119-4bf2-9683-89c1c6b455c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:48.627196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cfcf599b-d119-4bf2-9683-89c1c6b455c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:48.629539 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cfcf599b-d119-4bf2-9683-89c1c6b455c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:48.630254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cfcf599b-d119-4bf2-9683-89c1c6b455c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:48.670456 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-cfcf599b-d119-4bf2-9683-89c1c6b455c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] HTTP exception thrown: Instance 10f639ed-ba2f-4983-9c04-777480733871 could not be found. Aug 24 10:12:48.672932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cfcf599b-d119-4bf2-9683-89c1c6b455c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Request method failure captured: Aug 24 10:12:48.672932 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871 HTTP/1.1 Aug 24 10:12:48.672932 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:12:48.672932 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:12:48.672932 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:12:48.672932 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:12:48.672932 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:12:48.672932 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:12:48.672932 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:12:48.672932 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:12:48.672932 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBflZolKeUtLMAlnbLhEnFCEqRU-fBQSPOLE9_uH2UqC8RcqSTZivUbUR1GnVdI2ImnQCEgs59owuG-SDXmUDb77HdplyBPCEyN_GIwiG3P5kO1P4abnBitPmMnxJYexh6tT5VXoqoz7QEl80fvXTBtYm4fMEHVpBkG99dz101LdE4bs Aug 24 10:12:48.672932 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:12:48.672932 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:12:48.672932 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:12:48.672932 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:12:48.672932 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:12:48.672932 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:12:48.672932 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 82ddc0c46e914bbd8e265692275f7201 Aug 24 10:12:48.672932 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1931050870 Aug 24 10:12:48.672932 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:12:48.672932 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:12:48.674248 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/82ddc0c46e914bbd8e265692275f7201"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_82ddc0c46e914bbd8e265692275f7201", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/82ddc0c46e914bbd8e265692275f7201"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/82ddc0c46e914bbd8e265692275f7201"}]}] Aug 24 10:12:48.674248 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1931050870 Aug 24 10:12:48.674248 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 82ddc0c46e914bbd8e265692275f7201 Aug 24 10:12:48.674248 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1931050870 Aug 24 10:12:48.674248 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersAdminNegativeTestJSON-1931050870-project Aug 24 10:12:48.674248 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:12:48.674248 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:12:48.674248 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: e7f03e78d1af4252b1d32f0b103b6e16 Aug 24 10:12:48.674248 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1931050870-project Aug 24 10:12:48.674248 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:12:48.674248 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 10f639ed-ba2f-4983-9c04-777480733871 could not be found. Aug 24 10:12:48.674248 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '10f639ed-ba2f-4983-9c04-777480733871'} Aug 24 10:12:48.674960 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:12:48.674960 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:48.674960 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:12:48.674960 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:12:48.674960 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:12:48.674960 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:12:48.674960 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:12:48.674960 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:12:48.674960 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:12:48.674960 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:12:48.674960 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10f639ed-ba2f-4983-9c04-777480733871 could not be found. Aug 24 10:12:48.674960 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:48.674960 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:48.674960 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:48.674960 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:48.674960 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:48.674960 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:48.674960 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:12:48.674960 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:12:48.674960 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:12:48.676110 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:12:48.676110 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:12:48.676110 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:12:48.676110 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:12:48.676110 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:12:48.676110 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:12:48.676110 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:12:48.676110 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10f639ed-ba2f-4983-9c04-777480733871 could not be found. Aug 24 10:12:48.676110 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:48.676110 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:48.676110 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:48.676110 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:48.676110 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:48.676110 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:48.676110 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:12:48.676110 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:12:48.676110 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10f639ed-ba2f-4983-9c04-777480733871 could not be found. Aug 24 10:12:48.676110 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:12:48.683667 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cfcf599b-d119-4bf2-9683-89c1c6b455c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] Returning 404 to user: Instance 10f639ed-ba2f-4983-9c04-777480733871 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:12:48.685192 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cfcf599b-d119-4bf2-9683-89c1c6b455c1 tempest-ServersAdminNegativeTestJSON-1931050870 tempest-ServersAdminNegativeTestJSON-1931050870-project] 10.222.0.85 "GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871" status: 404 len: 111 microversion: 2.1 time: 0.137416 Aug 24 10:12:48.687078 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 251/528] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:48 2022] GET /compute/v2.1/servers/10f639ed-ba2f-4983-9c04-777480733871 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:12:48.700514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-907088ca-f272-47bc-9a9b-4e7325ad1c47 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:48.702401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-907088ca-f272-47bc-9a9b-4e7325ad1c47 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: d5911032-bcaa-4a3d-bb73-ccbea62de79b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:48.709162 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-907088ca-f272-47bc-9a9b-4e7325ad1c47 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:48.710232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-907088ca-f272-47bc-9a9b-4e7325ad1c47 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:48.710964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-907088ca-f272-47bc-9a9b-4e7325ad1c47 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:48.711973 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-907088ca-f272-47bc-9a9b-4e7325ad1c47 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:48.712622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-907088ca-f272-47bc-9a9b-4e7325ad1c47 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:48.713546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-907088ca-f272-47bc-9a9b-4e7325ad1c47 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:49.074648 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-907088ca-f272-47bc-9a9b-4e7325ad1c47 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:49.086673 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-907088ca-f272-47bc-9a9b-4e7325ad1c47 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b" status: 200 len: 1586 microversion: 2.1 time: 0.396269 Aug 24 10:12:49.088658 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 252/529] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:48 2022] GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b => generated 1586 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:49.095044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3f433a7f-a8d7-42bd-9696-8f3feb45ef05 req-656c0a8d-5acc-4b9a-9caa-ffeea33f8e09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5911032-bcaa-4a3d-bb73-ccbea62de79b", "tag": "29857c60-2ade-4b2f-b518-b9ceee5755c9"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:49.105901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3f433a7f-a8d7-42bd-9696-8f3feb45ef05 req-656c0a8d-5acc-4b9a-9caa-ffeea33f8e09 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:49.106767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3f433a7f-a8d7-42bd-9696-8f3feb45ef05 req-656c0a8d-5acc-4b9a-9caa-ffeea33f8e09 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:49.107471 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3f433a7f-a8d7-42bd-9696-8f3feb45ef05 req-656c0a8d-5acc-4b9a-9caa-ffeea33f8e09 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:49.118123 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-30e842ee-c6cf-40f5-bf51-a82db8c549c0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:12:49.119363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-30e842ee-c6cf-40f5-bf51-a82db8c549c0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:12:49.120035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-30e842ee-c6cf-40f5-bf51-a82db8c549c0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:12:49.121051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-30e842ee-c6cf-40f5-bf51-a82db8c549c0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:12:49.121687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-30e842ee-c6cf-40f5-bf51-a82db8c549c0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:12:49.136330 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3f433a7f-a8d7-42bd-9696-8f3feb45ef05 req-656c0a8d-5acc-4b9a-9caa-ffeea33f8e09 service nova] Creating event network-changed:29857c60-2ade-4b2f-b518-b9ceee5755c9 for instance d5911032-bcaa-4a3d-bb73-ccbea62de79b on n-h1-849328-3 Aug 24 10:12:49.146923 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3f433a7f-a8d7-42bd-9696-8f3feb45ef05 req-656c0a8d-5acc-4b9a-9caa-ffeea33f8e09 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056651 Aug 24 10:12:49.156134 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 253/530] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:49.171498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30e842ee-c6cf-40f5-bf51-a82db8c549c0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:49.172708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30e842ee-c6cf-40f5-bf51-a82db8c549c0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:49.173785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30e842ee-c6cf-40f5-bf51-a82db8c549c0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:49.174222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a529adb1-4a6a-4c4d-b506-7f59e81f4ecf tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:49.179567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30e842ee-c6cf-40f5-bf51-a82db8c549c0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:49.179924 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a529adb1-4a6a-4c4d-b506-7f59e81f4ecf tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:49.197427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a529adb1-4a6a-4c4d-b506-7f59e81f4ecf tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:49.198674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30e842ee-c6cf-40f5-bf51-a82db8c549c0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:49.199341 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30e842ee-c6cf-40f5-bf51-a82db8c549c0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:49.200083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a529adb1-4a6a-4c4d-b506-7f59e81f4ecf tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:49.201699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a529adb1-4a6a-4c4d-b506-7f59e81f4ecf tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:49.202705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a529adb1-4a6a-4c4d-b506-7f59e81f4ecf tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:49.210869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a529adb1-4a6a-4c4d-b506-7f59e81f4ecf tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:49.211869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a529adb1-4a6a-4c4d-b506-7f59e81f4ecf tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:49.251066 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-30e842ee-c6cf-40f5-bf51-a82db8c549c0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Getting quotas for project 34b2b8fc487d4a6abb08f132e0f0c1da. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:12:49.262942 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-30e842ee-c6cf-40f5-bf51-a82db8c549c0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Getting quotas for user dfd26847179f4f2bab0c9f673de0c303 and project 34b2b8fc487d4a6abb08f132e0f0c1da. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:12:49.302434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-30e842ee-c6cf-40f5-bf51-a82db8c549c0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:12:49.304886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-30e842ee-c6cf-40f5-bf51-a82db8c549c0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:12:49.448248 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-30e842ee-c6cf-40f5-bf51-a82db8c549c0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.711198 Aug 24 10:12:49.460012 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 278/531] 10.222.0.85 () {62 vars in 1188 bytes} [Wed Aug 24 10:12:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1725 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 10:12:49.477575 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7a35544d-b7f2-4aa4-af65-d0da3d5ef7c2 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:49.480533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7a35544d-b7f2-4aa4-af65-d0da3d5ef7c2 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 2706bbd7-7fe1-4441-a716-a35246a87268] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:49.547390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a35544d-b7f2-4aa4-af65-d0da3d5ef7c2 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:49.552016 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a35544d-b7f2-4aa4-af65-d0da3d5ef7c2 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:49.581882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a35544d-b7f2-4aa4-af65-d0da3d5ef7c2 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:49.588256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a35544d-b7f2-4aa4-af65-d0da3d5ef7c2 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:49.601040 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a35544d-b7f2-4aa4-af65-d0da3d5ef7c2 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:49.602365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a35544d-b7f2-4aa4-af65-d0da3d5ef7c2 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:49.857873 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a529adb1-4a6a-4c4d-b506-7f59e81f4ecf tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:49.870631 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a529adb1-4a6a-4c4d-b506-7f59e81f4ecf tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1477 microversion: 2.1 time: 0.711429 Aug 24 10:12:49.871270 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 254/532] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:49 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1477 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:49.876459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-831f6531-db9c-493b-ac72-9d3bb678ea7d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:49.890792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-831f6531-db9c-493b-ac72-9d3bb678ea7d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:49.910176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-831f6531-db9c-493b-ac72-9d3bb678ea7d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:49.912265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-831f6531-db9c-493b-ac72-9d3bb678ea7d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:49.912762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-831f6531-db9c-493b-ac72-9d3bb678ea7d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:49.914057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-831f6531-db9c-493b-ac72-9d3bb678ea7d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:49.914862 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-831f6531-db9c-493b-ac72-9d3bb678ea7d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:49.915603 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-831f6531-db9c-493b-ac72-9d3bb678ea7d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:50.089573 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7a35544d-b7f2-4aa4-af65-d0da3d5ef7c2 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:50.108263 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7a35544d-b7f2-4aa4-af65-d0da3d5ef7c2 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268" status: 200 len: 1318 microversion: 2.1 time: 0.644732 Aug 24 10:12:50.131823 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 279/533] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:49 2022] GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268 => generated 1318 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:50.141285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-775d6ccd-97ad-4ae9-8bdf-3bf83ff7c1bb tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:50.142371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-775d6ccd-97ad-4ae9-8bdf-3bf83ff7c1bb tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:50.303233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-775d6ccd-97ad-4ae9-8bdf-3bf83ff7c1bb tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:50.315893 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-775d6ccd-97ad-4ae9-8bdf-3bf83ff7c1bb tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:50.317916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-775d6ccd-97ad-4ae9-8bdf-3bf83ff7c1bb tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:50.319337 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-775d6ccd-97ad-4ae9-8bdf-3bf83ff7c1bb tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 1261 microversion: 2.25 time: 0.185563 Aug 24 10:12:50.341146 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 280/534] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:50 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 1261 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:50.351353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4e080005-0ff3-4284-b12d-7b73eabeb24e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:50.352607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4e080005-0ff3-4284-b12d-7b73eabeb24e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: db566c0d-ce6a-4d8d-bba4-c1480a160d01] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:50.362514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e080005-0ff3-4284-b12d-7b73eabeb24e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:50.363181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e080005-0ff3-4284-b12d-7b73eabeb24e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:50.363965 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e080005-0ff3-4284-b12d-7b73eabeb24e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:50.367104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e080005-0ff3-4284-b12d-7b73eabeb24e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:50.367978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e080005-0ff3-4284-b12d-7b73eabeb24e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:50.368970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e080005-0ff3-4284-b12d-7b73eabeb24e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:50.649823 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-831f6531-db9c-493b-ac72-9d3bb678ea7d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:50.673940 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-831f6531-db9c-493b-ac72-9d3bb678ea7d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381" status: 200 len: 1365 microversion: 2.1 time: 0.799305 Aug 24 10:12:50.679886 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 255/535] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:49 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381 => generated 1365 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:50.689151 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-42882851-01f6-4655-b53d-bfed8421350e req-1699c2a0-7fb6-4c47-b461-1409dd9e652e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2706bbd7-7fe1-4441-a716-a35246a87268", "tag": "015ec317-9902-41df-9659-0afb438521b5"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:50.728072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-42882851-01f6-4655-b53d-bfed8421350e req-1699c2a0-7fb6-4c47-b461-1409dd9e652e service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:50.730393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-42882851-01f6-4655-b53d-bfed8421350e req-1699c2a0-7fb6-4c47-b461-1409dd9e652e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:50.732441 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-42882851-01f6-4655-b53d-bfed8421350e req-1699c2a0-7fb6-4c47-b461-1409dd9e652e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:50.757402 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-42882851-01f6-4655-b53d-bfed8421350e req-1699c2a0-7fb6-4c47-b461-1409dd9e652e service nova] Creating event network-changed:015ec317-9902-41df-9659-0afb438521b5 for instance 2706bbd7-7fe1-4441-a716-a35246a87268 on n-h2-849328-3 Aug 24 10:12:50.768725 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-42882851-01f6-4655-b53d-bfed8421350e req-1699c2a0-7fb6-4c47-b461-1409dd9e652e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086879 Aug 24 10:12:50.770551 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 256/536] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:50.853052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4e080005-0ff3-4284-b12d-7b73eabeb24e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:50.879630 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4e080005-0ff3-4284-b12d-7b73eabeb24e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/db566c0d-ce6a-4d8d-bba4-c1480a160d01" status: 200 len: 1469 microversion: 2.1 time: 0.533870 Aug 24 10:12:50.895869 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 281/537] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:50 2022] GET /compute/v2.1/servers/db566c0d-ce6a-4d8d-bba4-c1480a160d01 => generated 1469 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:50.902610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7266657c-80b9-491c-b6e1-67446a7b591d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:50.903874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7266657c-80b9-491c-b6e1-67446a7b591d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:50.905714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ca983f68-7d50-4c80-90cc-b6ede0d7498b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:50.910821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ca983f68-7d50-4c80-90cc-b6ede0d7498b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:50.911709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ca983f68-7d50-4c80-90cc-b6ede0d7498b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Searching by: {'reservation_id': 'r-4qgr1tvp', 'deleted': False, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:12:50.926310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca983f68-7d50-4c80-90cc-b6ede0d7498b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:50.928272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca983f68-7d50-4c80-90cc-b6ede0d7498b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:50.928737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca983f68-7d50-4c80-90cc-b6ede0d7498b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:50.929549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca983f68-7d50-4c80-90cc-b6ede0d7498b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:50.930005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca983f68-7d50-4c80-90cc-b6ede0d7498b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:50.930477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca983f68-7d50-4c80-90cc-b6ede0d7498b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:50.940281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7266657c-80b9-491c-b6e1-67446a7b591d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:50.944336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7266657c-80b9-491c-b6e1-67446a7b591d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:50.945082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7266657c-80b9-491c-b6e1-67446a7b591d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:50.947229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7266657c-80b9-491c-b6e1-67446a7b591d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:50.952218 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7266657c-80b9-491c-b6e1-67446a7b591d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:50.952974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7266657c-80b9-491c-b6e1-67446a7b591d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:51.102680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-ca983f68-7d50-4c80-90cc-b6ede0d7498b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:12:51.248164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=26 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:51.319290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ca983f68-7d50-4c80-90cc-b6ede0d7498b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:51.340465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca983f68-7d50-4c80-90cc-b6ede0d7498b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:51.342687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca983f68-7d50-4c80-90cc-b6ede0d7498b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:51.344048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca983f68-7d50-4c80-90cc-b6ede0d7498b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:51.499583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7266657c-80b9-491c-b6e1-67446a7b591d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:51.511279 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7266657c-80b9-491c-b6e1-67446a7b591d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1477 microversion: 2.1 time: 0.615727 Aug 24 10:12:51.512301 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 257/538] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:50 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1477 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:51.517605 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-33b52eb4-0dad-4a7d-9c64-5fcc0b42f00a tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:51.518533 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-33b52eb4-0dad-4a7d-9c64-5fcc0b42f00a tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 2706bbd7-7fe1-4441-a716-a35246a87268] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:51.525995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33b52eb4-0dad-4a7d-9c64-5fcc0b42f00a tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:51.526970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33b52eb4-0dad-4a7d-9c64-5fcc0b42f00a tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:51.527754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33b52eb4-0dad-4a7d-9c64-5fcc0b42f00a tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:51.528986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33b52eb4-0dad-4a7d-9c64-5fcc0b42f00a tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:51.529820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33b52eb4-0dad-4a7d-9c64-5fcc0b42f00a tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:51.530405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33b52eb4-0dad-4a7d-9c64-5fcc0b42f00a tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:51.728196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-33b52eb4-0dad-4a7d-9c64-5fcc0b42f00a tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:51.740374 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-33b52eb4-0dad-4a7d-9c64-5fcc0b42f00a tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268" status: 200 len: 1318 microversion: 2.1 time: 0.226388 Aug 24 10:12:51.741230 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 258/539] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:51 2022] GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:51.751018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e7deaf30-f64d-45cd-afeb-4b4032086226 req-f9fecfc4-ae2b-48d3-8c0f-ca01d340118a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71cb543d-2961-4511-b990-c53fd25db381", "name": "network-vif-plugged", "status": "completed", "tag": "a67f32d5-2bc6-456e-bce8-dcad8a07253a"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:51.764664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e7deaf30-f64d-45cd-afeb-4b4032086226 req-f9fecfc4-ae2b-48d3-8c0f-ca01d340118a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:51.765839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e7deaf30-f64d-45cd-afeb-4b4032086226 req-f9fecfc4-ae2b-48d3-8c0f-ca01d340118a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:51.766940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e7deaf30-f64d-45cd-afeb-4b4032086226 req-f9fecfc4-ae2b-48d3-8c0f-ca01d340118a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:51.789084 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e7deaf30-f64d-45cd-afeb-4b4032086226 req-f9fecfc4-ae2b-48d3-8c0f-ca01d340118a service nova] Creating event network-vif-plugged:a67f32d5-2bc6-456e-bce8-dcad8a07253a for instance 71cb543d-2961-4511-b990-c53fd25db381 on n-h2-849328-3 Aug 24 10:12:51.794924 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e7deaf30-f64d-45cd-afeb-4b4032086226 req-f9fecfc4-ae2b-48d3-8c0f-ca01d340118a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052034 Aug 24 10:12:51.802889 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 259/540] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:51.810422 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cfb06dc5-9e4c-4550-ba55-418c6dca80fe tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:51.812156 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cfb06dc5-9e4c-4550-ba55-418c6dca80fe tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:51.820765 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cfb06dc5-9e4c-4550-ba55-418c6dca80fe tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:51.821719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cfb06dc5-9e4c-4550-ba55-418c6dca80fe tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:51.822470 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cfb06dc5-9e4c-4550-ba55-418c6dca80fe tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:51.823523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cfb06dc5-9e4c-4550-ba55-418c6dca80fe tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:51.824413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cfb06dc5-9e4c-4550-ba55-418c6dca80fe tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:51.825047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cfb06dc5-9e4c-4550-ba55-418c6dca80fe tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:51.923262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cfb06dc5-9e4c-4550-ba55-418c6dca80fe tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:51.935676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cfb06dc5-9e4c-4550-ba55-418c6dca80fe tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:51.937822 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cfb06dc5-9e4c-4550-ba55-418c6dca80fe tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:51.939941 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cfb06dc5-9e4c-4550-ba55-418c6dca80fe tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 1257 microversion: 2.25 time: 0.135031 Aug 24 10:12:51.955029 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 260/541] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:51 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 1257 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:51.967961 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7f93bc5f-d6e3-4864-a543-8ab8748c5c3f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:51.968878 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7f93bc5f-d6e3-4864-a543-8ab8748c5c3f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:51.977403 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f93bc5f-d6e3-4864-a543-8ab8748c5c3f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:51.978259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f93bc5f-d6e3-4864-a543-8ab8748c5c3f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:51.978917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f93bc5f-d6e3-4864-a543-8ab8748c5c3f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:51.980048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f93bc5f-d6e3-4864-a543-8ab8748c5c3f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:51.980859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f93bc5f-d6e3-4864-a543-8ab8748c5c3f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:51.981613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f93bc5f-d6e3-4864-a543-8ab8748c5c3f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:52.024387 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ca983f68-7d50-4c80-90cc-b6ede0d7498b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/detail?reservation_id=r-4qgr1tvp" status: 200 len: 2930 microversion: 2.1 time: 1.122798 Aug 24 10:12:52.046945 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 282/542] 10.222.0.85 () {58 vars in 1197 bytes} [Wed Aug 24 10:12:50 2022] GET /compute/v2.1/servers/detail?reservation_id=r-4qgr1tvp => generated 2930 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:12:52.061176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8198b444-9824-4dee-9967-a8fecf44471a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:52.094185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.compute.server_groups [None req-8198b444-9824-4dee-9967-a8fecf44471a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Querying cell e852a9c4-5bbb-4a78-aec0-794708e7e59e(cell1) for 2 instances {{(pid=122433) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 24 10:12:52.095071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8198b444-9824-4dee-9967-a8fecf44471a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:52.095562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8198b444-9824-4dee-9967-a8fecf44471a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:52.096023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8198b444-9824-4dee-9967-a8fecf44471a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:52.166948 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8198b444-9824-4dee-9967-a8fecf44471a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/os-server-groups/231c8b11-a163-483b-b7a0-21f5ef8e7282" status: 200 len: 266 microversion: 2.1 time: 0.110438 Aug 24 10:12:52.174233 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 283/543] 10.222.0.85 () {58 vars in 1263 bytes} [Wed Aug 24 10:12:52 2022] GET /compute/v2.1/os-server-groups/231c8b11-a163-483b-b7a0-21f5ef8e7282 => generated 266 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:52.191479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2eef8d55-5cd6-43a0-a60b-c23b2fbc2222 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:52.192708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2eef8d55-5cd6-43a0-a60b-c23b2fbc2222 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] [instance: b00174fc-a16c-4ae5-94d3-d43b9c963cf5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:52.203066 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2eef8d55-5cd6-43a0-a60b-c23b2fbc2222 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:52.204376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2eef8d55-5cd6-43a0-a60b-c23b2fbc2222 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:52.205271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2eef8d55-5cd6-43a0-a60b-c23b2fbc2222 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:52.206543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2eef8d55-5cd6-43a0-a60b-c23b2fbc2222 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:52.207476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2eef8d55-5cd6-43a0-a60b-c23b2fbc2222 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:52.208344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2eef8d55-5cd6-43a0-a60b-c23b2fbc2222 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:52.245712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7f93bc5f-d6e3-4864-a543-8ab8748c5c3f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:52.260477 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7f93bc5f-d6e3-4864-a543-8ab8748c5c3f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381" status: 200 len: 1365 microversion: 2.1 time: 0.302147 Aug 24 10:12:52.262381 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 261/544] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:51 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381 => generated 1365 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:52.458599 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2eef8d55-5cd6-43a0-a60b-c23b2fbc2222 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/b00174fc-a16c-4ae5-94d3-d43b9c963cf5" status: 200 len: 1619 microversion: 2.1 time: 0.280566 Aug 24 10:12:52.460290 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 284/545] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:52 2022] GET /compute/v2.1/servers/b00174fc-a16c-4ae5-94d3-d43b9c963cf5 => generated 1619 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:52.481589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1e23f76f-1954-484b-adb7-d100cb7ce515 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:52.483282 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1e23f76f-1954-484b-adb7-d100cb7ce515 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] [instance: db566c0d-ce6a-4d8d-bba4-c1480a160d01] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:52.493205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e23f76f-1954-484b-adb7-d100cb7ce515 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:52.494845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e23f76f-1954-484b-adb7-d100cb7ce515 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:52.501312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e23f76f-1954-484b-adb7-d100cb7ce515 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:52.502839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e23f76f-1954-484b-adb7-d100cb7ce515 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:52.503621 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e23f76f-1954-484b-adb7-d100cb7ce515 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:52.504422 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e23f76f-1954-484b-adb7-d100cb7ce515 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:52.543123 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4216bd59-16db-44b7-be95-17866af5ea24 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:52.544153 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4216bd59-16db-44b7-be95-17866af5ea24 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:52.564280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4216bd59-16db-44b7-be95-17866af5ea24 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:52.564786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4216bd59-16db-44b7-be95-17866af5ea24 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:52.565255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4216bd59-16db-44b7-be95-17866af5ea24 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:52.565974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4216bd59-16db-44b7-be95-17866af5ea24 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:52.566436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4216bd59-16db-44b7-be95-17866af5ea24 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:52.567256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4216bd59-16db-44b7-be95-17866af5ea24 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:52.745185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4216bd59-16db-44b7-be95-17866af5ea24 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:52.757216 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4216bd59-16db-44b7-be95-17866af5ea24 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1477 microversion: 2.1 time: 0.221218 Aug 24 10:12:52.769213 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 285/546] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:52 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1477 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:12:52.776625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-191b479d-1b44-4635-a881-8667be1d44e3 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:52.779651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-191b479d-1b44-4635-a881-8667be1d44e3 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 2706bbd7-7fe1-4441-a716-a35246a87268] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:52.792833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-191b479d-1b44-4635-a881-8667be1d44e3 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:52.794095 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-191b479d-1b44-4635-a881-8667be1d44e3 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:52.794095 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-191b479d-1b44-4635-a881-8667be1d44e3 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:52.796775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-191b479d-1b44-4635-a881-8667be1d44e3 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:52.799231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-191b479d-1b44-4635-a881-8667be1d44e3 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:52.802899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-191b479d-1b44-4635-a881-8667be1d44e3 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:53.006211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-191b479d-1b44-4635-a881-8667be1d44e3 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:53.020249 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-191b479d-1b44-4635-a881-8667be1d44e3 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268" status: 200 len: 1318 microversion: 2.1 time: 0.250721 Aug 24 10:12:53.021460 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 286/547] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:52 2022] GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:53.087918 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1e23f76f-1954-484b-adb7-d100cb7ce515 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/db566c0d-ce6a-4d8d-bba4-c1480a160d01" status: 200 len: 1620 microversion: 2.1 time: 0.610833 Aug 24 10:12:53.089036 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 262/548] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:52 2022] GET /compute/v2.1/servers/db566c0d-ce6a-4d8d-bba4-c1480a160d01 => generated 1620 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:53.100524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-00168970-348a-4207-bd93-fefd0f4ff53b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:53.102447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-00168970-348a-4207-bd93-fefd0f4ff53b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:53.127461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00168970-348a-4207-bd93-fefd0f4ff53b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:53.127999 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00168970-348a-4207-bd93-fefd0f4ff53b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:53.128467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00168970-348a-4207-bd93-fefd0f4ff53b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:53.129214 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00168970-348a-4207-bd93-fefd0f4ff53b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:53.129899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00168970-348a-4207-bd93-fefd0f4ff53b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:53.130515 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00168970-348a-4207-bd93-fefd0f4ff53b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:53.227833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-00168970-348a-4207-bd93-fefd0f4ff53b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:53.240282 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-00168970-348a-4207-bd93-fefd0f4ff53b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:53.241740 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-00168970-348a-4207-bd93-fefd0f4ff53b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:53.242967 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-00168970-348a-4207-bd93-fefd0f4ff53b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 1319 microversion: 2.25 time: 0.152526 Aug 24 10:12:53.246225 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 263/549] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:53 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:53.260587 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6796218c-99ee-43fa-9c35-f393a2c1efc8 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Action: 'create', calling method: .version_select at 0x7f4655477790>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1026172418", "policies": ["anti-affinity"]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:53.288608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-6796218c-99ee-43fa-9c35-f393a2c1efc8 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'server_groups'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:12:53.294065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-6796218c-99ee-43fa-9c35-f393a2c1efc8 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for user bf03c0eb5bd748ae85be830f1121dc06 and project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'server_groups'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:12:53.354579 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-6796218c-99ee-43fa-9c35-f393a2c1efc8 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'server_groups'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:12:53.360577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:53.361904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-6796218c-99ee-43fa-9c35-f393a2c1efc8 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for user bf03c0eb5bd748ae85be830f1121dc06 and project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'server_groups'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:12:53.382595 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6796218c-99ee-43fa-9c35-f393a2c1efc8 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.135037 Aug 24 10:12:53.383935 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 264/550] 10.222.0.85 () {60 vars in 1174 bytes} [Wed Aug 24 10:12:53 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:53.390347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-203cb648-5182-4bf2-a1db-5f867fc23dd0 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:53.391752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-203cb648-5182-4bf2-a1db-5f867fc23dd0 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:53.399898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-203cb648-5182-4bf2-a1db-5f867fc23dd0 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:53.400823 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-203cb648-5182-4bf2-a1db-5f867fc23dd0 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:53.401452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-203cb648-5182-4bf2-a1db-5f867fc23dd0 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:53.406579 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-203cb648-5182-4bf2-a1db-5f867fc23dd0 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:53.407252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-203cb648-5182-4bf2-a1db-5f867fc23dd0 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:53.407944 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-203cb648-5182-4bf2-a1db-5f867fc23dd0 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:53.534756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1a3ba895-ca98-404f-96ef-34bece33ff74 tempest-FlavorsV2NegativeTest-312661255 tempest-FlavorsV2NegativeTest-312661255-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:53.545817 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1a3ba895-ca98-404f-96ef-34bece33ff74 tempest-FlavorsV2NegativeTest-312661255 tempest-FlavorsV2NegativeTest-312661255-project] 10.222.0.85 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.522744 Aug 24 10:12:53.546537 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 287/551] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:12:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:53.580177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b82ce523-7ec6-403a-9259-845700dbb915 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-487675305", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "0115a7d1-f8a0-4ba5-806f-009c686ef65c"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:53.635533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-b82ce523-7ec6-403a-9259-845700dbb915 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:12:53.944705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-203cb648-5182-4bf2-a1db-5f867fc23dd0 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:53.956293 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-203cb648-5182-4bf2-a1db-5f867fc23dd0 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381" status: 200 len: 1365 microversion: 2.1 time: 0.570532 Aug 24 10:12:53.957074 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 265/552] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:53 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381 => generated 1365 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:53.973923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9ed48030-b3ca-4991-a7eb-e2ff85328e35 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:53.975937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9ed48030-b3ca-4991-a7eb-e2ff85328e35 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:53.985749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ed48030-b3ca-4991-a7eb-e2ff85328e35 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:53.986671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ed48030-b3ca-4991-a7eb-e2ff85328e35 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:53.987495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ed48030-b3ca-4991-a7eb-e2ff85328e35 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:53.988767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ed48030-b3ca-4991-a7eb-e2ff85328e35 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:53.989768 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ed48030-b3ca-4991-a7eb-e2ff85328e35 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:53.990672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ed48030-b3ca-4991-a7eb-e2ff85328e35 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:54.006703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b82ce523-7ec6-403a-9259-845700dbb915 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:12:54.007756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b82ce523-7ec6-403a-9259-845700dbb915 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:12:54.008320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b82ce523-7ec6-403a-9259-845700dbb915 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:12:54.008849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b82ce523-7ec6-403a-9259-845700dbb915 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:12:54.009375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b82ce523-7ec6-403a-9259-845700dbb915 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:12:54.051370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b82ce523-7ec6-403a-9259-845700dbb915 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:54.052575 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b82ce523-7ec6-403a-9259-845700dbb915 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:54.053162 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b82ce523-7ec6-403a-9259-845700dbb915 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:54.054070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b82ce523-7ec6-403a-9259-845700dbb915 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:54.054524 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b82ce523-7ec6-403a-9259-845700dbb915 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:54.054980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b82ce523-7ec6-403a-9259-845700dbb915 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:54.073361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b82ce523-7ec6-403a-9259-845700dbb915 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:12:54.078358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b82ce523-7ec6-403a-9259-845700dbb915 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for user bf03c0eb5bd748ae85be830f1121dc06 and project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:12:54.093519 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b82ce523-7ec6-403a-9259-845700dbb915 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Going to run 2 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:12:54.096302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b82ce523-7ec6-403a-9259-845700dbb915 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 1d8befca-2013-4597-a7e7-e12100a340db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:12:54.157316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b82ce523-7ec6-403a-9259-845700dbb915 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:12:54.163614 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b82ce523-7ec6-403a-9259-845700dbb915 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for user bf03c0eb5bd748ae85be830f1121dc06 and project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:12:54.241974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b82ce523-7ec6-403a-9259-845700dbb915 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:12:54.248329 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b82ce523-7ec6-403a-9259-845700dbb915 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for user bf03c0eb5bd748ae85be830f1121dc06 and project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:12:54.268823 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b82ce523-7ec6-403a-9259-845700dbb915 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 322e4dd7-c596-41d1-94a4-7bdd711f3ebf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=1d8befca-2013-4597-a7e7-e12100a340db,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:12:54.312966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:54.331718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b82ce523-7ec6-403a-9259-845700dbb915 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:12:54.338032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b82ce523-7ec6-403a-9259-845700dbb915 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for user bf03c0eb5bd748ae85be830f1121dc06 and project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:12:54.381149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b82ce523-7ec6-403a-9259-845700dbb915 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:12:54.386690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b82ce523-7ec6-403a-9259-845700dbb915 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for user bf03c0eb5bd748ae85be830f1121dc06 and project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:12:54.445075 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b82ce523-7ec6-403a-9259-845700dbb915 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.868686 Aug 24 10:12:54.452752 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 288/553] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:12:53 2022] POST /compute/v2.1/servers => generated 32 bytes in 877 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Aug 24 10:12:54.460982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2173b34e-1720-4438-a943-73b03356414c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:54.461771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2173b34e-1720-4438-a943-73b03356414c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 2706bbd7-7fe1-4441-a716-a35246a87268] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:54.471350 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2173b34e-1720-4438-a943-73b03356414c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:54.471842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2173b34e-1720-4438-a943-73b03356414c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:54.472281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2173b34e-1720-4438-a943-73b03356414c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:54.473024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2173b34e-1720-4438-a943-73b03356414c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:54.476299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2173b34e-1720-4438-a943-73b03356414c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:54.476742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2173b34e-1720-4438-a943-73b03356414c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:54.662885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9ed48030-b3ca-4991-a7eb-e2ff85328e35 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:54.689374 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9ed48030-b3ca-4991-a7eb-e2ff85328e35 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1477 microversion: 2.1 time: 0.730172 Aug 24 10:12:54.697649 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 266/554] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:53 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1477 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:54.705807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2173b34e-1720-4438-a943-73b03356414c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:54.709633 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f6ba18f1-2bc3-401d-951a-67fa1172c503 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:54.711629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f6ba18f1-2bc3-401d-951a-67fa1172c503 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:54.715383 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2173b34e-1720-4438-a943-73b03356414c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268" status: 200 len: 1318 microversion: 2.1 time: 0.260958 Aug 24 10:12:54.716435 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 289/555] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:54 2022] GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:54.723606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2d468395-68e3-471c-8712-b521eb7c49e0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:54.732010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2d468395-68e3-471c-8712-b521eb7c49e0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:54.732828 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2d468395-68e3-471c-8712-b521eb7c49e0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Searching by: {'deleted': False, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:12:54.743328 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6ba18f1-2bc3-401d-951a-67fa1172c503 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:54.744591 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6ba18f1-2bc3-401d-951a-67fa1172c503 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:54.749208 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6ba18f1-2bc3-401d-951a-67fa1172c503 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:54.752753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d468395-68e3-471c-8712-b521eb7c49e0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:54.753438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d468395-68e3-471c-8712-b521eb7c49e0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:54.754121 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d468395-68e3-471c-8712-b521eb7c49e0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:54.755021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d468395-68e3-471c-8712-b521eb7c49e0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:54.755831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d468395-68e3-471c-8712-b521eb7c49e0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:54.756560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d468395-68e3-471c-8712-b521eb7c49e0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:54.762765 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6ba18f1-2bc3-401d-951a-67fa1172c503 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:54.763616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6ba18f1-2bc3-401d-951a-67fa1172c503 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:54.764395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6ba18f1-2bc3-401d-951a-67fa1172c503 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:54.809984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:54.849250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-2d468395-68e3-471c-8712-b521eb7c49e0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:12:54.898739 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2d468395-68e3-471c-8712-b521eb7c49e0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.180732 Aug 24 10:12:54.914141 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 290/556] 10.222.0.85 () {58 vars in 1125 bytes} [Wed Aug 24 10:12:54 2022] GET /compute/v2.1/servers => generated 1664 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:54.920423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2ac6257f-ccec-4d70-b622-447e7c0c183d tempest-FlavorsV2NegativeTest-312661255 tempest-FlavorsV2NegativeTest-312661255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-208861072", "imageRef": "52eee0e9-1437-49c9-87c0-5d6107da04c7", "flavorRef": "452"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:55.034254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-2ac6257f-ccec-4d70-b622-447e7c0c183d tempest-FlavorsV2NegativeTest-312661255 tempest-FlavorsV2NegativeTest-312661255-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:12:55.148540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:55.235100 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f6ba18f1-2bc3-401d-951a-67fa1172c503 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:55.263372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f6ba18f1-2bc3-401d-951a-67fa1172c503 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:55.267410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f6ba18f1-2bc3-401d-951a-67fa1172c503 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:55.269308 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f6ba18f1-2bc3-401d-951a-67fa1172c503 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 1361 microversion: 2.25 time: 0.569956 Aug 24 10:12:55.270137 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 267/557] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:54 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 1361 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:55.288927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9301a326-6ed3-48ee-bdf9-505c82d42be6 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:55.289961 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9301a326-6ed3-48ee-bdf9-505c82d42be6 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 322e4dd7-c596-41d1-94a4-7bdd711f3ebf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:55.335779 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-2ac6257f-ccec-4d70-b622-447e7c0c183d tempest-FlavorsV2NegativeTest-312661255 tempest-FlavorsV2NegativeTest-312661255-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 24 10:12:55.338157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2ac6257f-ccec-4d70-b622-447e7c0c183d tempest-FlavorsV2NegativeTest-312661255 tempest-FlavorsV2NegativeTest-312661255-project] Request method failure captured: Aug 24 10:12:55.338157 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:12:55.338157 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:12:55.338157 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:12:55.338157 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:12:55.338157 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 142 Aug 24 10:12:55.338157 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:12:55.338157 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:12:55.338157 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:12:55.338157 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:12:55.338157 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfmkUdOTZXMLili4iOBl6XjHIZC8KM5nJo9kmZ-XHvCahTE1tTLopRbb4ZvJ12-7KbB1y3kGRJevNvN1CkKoQU5SzVJsX6i4M-Lyiltm3QD_6mDdIt32xtKt_fkiy5iKyE0Cn3L8KIQCOw2_8jG4-bN-YYIfa-ynPVfk5-6I5dk8Nw8 Aug 24 10:12:55.338157 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:12:55.338157 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:12:55.338157 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:12:55.338157 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:12:55.338157 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:12:55.338157 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:12:55.338157 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 0bd3da3baf2f4a7b9a03730b1826e743 Aug 24 10:12:55.338157 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-FlavorsV2NegativeTest-312661255 Aug 24 10:12:55.338157 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:12:55.338157 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:12:55.339524 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0bd3da3baf2f4a7b9a03730b1826e743"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0bd3da3baf2f4a7b9a03730b1826e743", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0bd3da3baf2f4a7b9a03730b1826e743"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0bd3da3baf2f4a7b9a03730b1826e743"}]}] Aug 24 10:12:55.339524 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-FlavorsV2NegativeTest-312661255 Aug 24 10:12:55.339524 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 0bd3da3baf2f4a7b9a03730b1826e743 Aug 24 10:12:55.339524 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-312661255 Aug 24 10:12:55.339524 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-FlavorsV2NegativeTest-312661255-project Aug 24 10:12:55.339524 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:12:55.339524 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:12:55.339524 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 599cda3f711a44b5b997a99f3e5b379c Aug 24 10:12:55.339524 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-FlavorsV2NegativeTest-312661255-project Aug 24 10:12:55.339524 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:12:55.339524 n-d-849328-3 devstack@n-api.service[122433]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-208861072", "imageRef": "52eee0e9-1437-49c9-87c0-5d6107da04c7", "flavorRef": "452"}} Aug 24 10:12:55.339524 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:12:55.340524 n-d-849328-3 devstack@n-api.service[122433]: exception: Flavor's memory is too small for requested image. Aug 24 10:12:55.340524 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-208861072', 'imageRef': '52eee0e9-1437-49c9-87c0-5d6107da04c7', 'flavorRef': '452'}}} Aug 24 10:12:55.340524 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:12:55.340524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:55.340524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 24 10:12:55.340524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 24 10:12:55.340524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 24 10:12:55.340524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 24 10:12:55.340524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1711, in _create_instance Aug 24 10:12:55.340524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 24 10:12:55.340524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1006, in _checks_for_create_and_rebuild Aug 24 10:12:55.340524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 24 10:12:55.340524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 670, in _validate_flavor_image Aug 24 10:12:55.340524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 24 10:12:55.340524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 738, in _validate_flavor_image_nostatus Aug 24 10:12:55.340524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 24 10:12:55.340524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 24 10:12:55.340524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:55.340524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:55.340524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:55.341836 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:55.341836 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:55.341836 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:55.341836 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:12:55.341836 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:12:55.341836 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:12:55.341836 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:12:55.341836 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:12:55.341836 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:12:55.341836 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:12:55.341836 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:12:55.341836 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:12:55.341836 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:12:55.341836 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 10:12:55.341836 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 24 10:12:55.341836 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 24 10:12:55.341836 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 24 10:12:55.341836 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:55.341836 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:55.341836 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:55.341836 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:55.344938 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:55.344938 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:55.344938 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:12:55.344938 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:12:55.344938 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 24 10:12:55.344938 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:12:55.346617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2ac6257f-ccec-4d70-b622-447e7c0c183d tempest-FlavorsV2NegativeTest-312661255 tempest-FlavorsV2NegativeTest-312661255-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:12:55.347643 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2ac6257f-ccec-4d70-b622-447e7c0c183d tempest-FlavorsV2NegativeTest-312661255 tempest-FlavorsV2NegativeTest-312661255-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.432029 Aug 24 10:12:55.348404 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 291/558] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:12:54 2022] POST /compute/v2.1/servers => generated 93 bytes in 433 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 10:12:55.356823 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-384d02e5-1061-4bd2-821e-3334fbd3e481 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:55.357673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-384d02e5-1061-4bd2-821e-3334fbd3e481 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:55.371528 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-384d02e5-1061-4bd2-821e-3334fbd3e481 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:55.374586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-384d02e5-1061-4bd2-821e-3334fbd3e481 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:55.378649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-384d02e5-1061-4bd2-821e-3334fbd3e481 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:55.378649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-384d02e5-1061-4bd2-821e-3334fbd3e481 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:55.378649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-384d02e5-1061-4bd2-821e-3334fbd3e481 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:55.378649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-384d02e5-1061-4bd2-821e-3334fbd3e481 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:55.423427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9301a326-6ed3-48ee-bdf9-505c82d42be6 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:55.435735 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9301a326-6ed3-48ee-bdf9-505c82d42be6 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf" status: 200 len: 1218 microversion: 2.1 time: 0.163948 Aug 24 10:12:55.436699 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 268/559] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:55 2022] GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf => generated 1218 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:55.630342 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-384d02e5-1061-4bd2-821e-3334fbd3e481 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:55.645498 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-384d02e5-1061-4bd2-821e-3334fbd3e481 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381" status: 200 len: 1555 microversion: 2.1 time: 0.295706 Aug 24 10:12:55.661868 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 292/560] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:55 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381 => generated 1555 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:55.676124 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3977a94f-c585-4804-b222-01646b120bf8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:55.677624 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3977a94f-c585-4804-b222-01646b120bf8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:55.685942 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3977a94f-c585-4804-b222-01646b120bf8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:55.686763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3977a94f-c585-4804-b222-01646b120bf8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:55.687405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3977a94f-c585-4804-b222-01646b120bf8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:55.688362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3977a94f-c585-4804-b222-01646b120bf8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:55.688966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3977a94f-c585-4804-b222-01646b120bf8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:55.690047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3977a94f-c585-4804-b222-01646b120bf8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:55.712137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-493b7edb-1a11-4cb0-8284-c3547505bc56 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:55.715910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:55.717434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-493b7edb-1a11-4cb0-8284-c3547505bc56 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:55.733506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-493b7edb-1a11-4cb0-8284-c3547505bc56 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:55.734027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-493b7edb-1a11-4cb0-8284-c3547505bc56 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:55.736174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-493b7edb-1a11-4cb0-8284-c3547505bc56 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:55.741055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-493b7edb-1a11-4cb0-8284-c3547505bc56 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:55.741889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-493b7edb-1a11-4cb0-8284-c3547505bc56 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:55.742740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-493b7edb-1a11-4cb0-8284-c3547505bc56 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:55.867591 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3977a94f-c585-4804-b222-01646b120bf8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.198217 Aug 24 10:12:55.868200 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 269/561] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Aug 24 10:12:55 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381/os-interface => generated 284 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:12:55.882488 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4f9fac70-c3a6-43e4-ac98-91cd4125c44e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:55.883290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4f9fac70-c3a6-43e4-ac98-91cd4125c44e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 2706bbd7-7fe1-4441-a716-a35246a87268] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:55.897735 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f9fac70-c3a6-43e4-ac98-91cd4125c44e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:55.899881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f9fac70-c3a6-43e4-ac98-91cd4125c44e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:55.901821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f9fac70-c3a6-43e4-ac98-91cd4125c44e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:55.904178 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f9fac70-c3a6-43e4-ac98-91cd4125c44e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:55.910546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f9fac70-c3a6-43e4-ac98-91cd4125c44e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:55.911253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f9fac70-c3a6-43e4-ac98-91cd4125c44e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:55.990851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-493b7edb-1a11-4cb0-8284-c3547505bc56 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:56.001084 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-493b7edb-1a11-4cb0-8284-c3547505bc56 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1477 microversion: 2.1 time: 0.292894 Aug 24 10:12:56.001793 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 293/562] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:55 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1477 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:56.295575 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ef96fd0-6b5c-4782-88e6-8a0bf57ec9bf tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:56.296742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3ef96fd0-6b5c-4782-88e6-8a0bf57ec9bf tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:56.305949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ef96fd0-6b5c-4782-88e6-8a0bf57ec9bf tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:56.306569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ef96fd0-6b5c-4782-88e6-8a0bf57ec9bf tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:56.307091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ef96fd0-6b5c-4782-88e6-8a0bf57ec9bf tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:56.308111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ef96fd0-6b5c-4782-88e6-8a0bf57ec9bf tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:56.308794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ef96fd0-6b5c-4782-88e6-8a0bf57ec9bf tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:56.309578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ef96fd0-6b5c-4782-88e6-8a0bf57ec9bf tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:56.602762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3ef96fd0-6b5c-4782-88e6-8a0bf57ec9bf tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:56.615086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3ef96fd0-6b5c-4782-88e6-8a0bf57ec9bf tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:56.623451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3ef96fd0-6b5c-4782-88e6-8a0bf57ec9bf tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:56.635115 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ef96fd0-6b5c-4782-88e6-8a0bf57ec9bf tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 1361 microversion: 2.25 time: 0.345228 Aug 24 10:12:56.636787 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 294/563] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:56 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 1361 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:56.655501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-563aeae9-8287-466d-858c-81ed3b110dbc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:56.656592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-563aeae9-8287-466d-858c-81ed3b110dbc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 322e4dd7-c596-41d1-94a4-7bdd711f3ebf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:56.690020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-563aeae9-8287-466d-858c-81ed3b110dbc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:56.690559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-563aeae9-8287-466d-858c-81ed3b110dbc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:56.690997 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-563aeae9-8287-466d-858c-81ed3b110dbc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:56.691729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-563aeae9-8287-466d-858c-81ed3b110dbc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:56.692282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-563aeae9-8287-466d-858c-81ed3b110dbc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:56.701987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-563aeae9-8287-466d-858c-81ed3b110dbc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:56.980725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-563aeae9-8287-466d-858c-81ed3b110dbc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:56.989850 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-563aeae9-8287-466d-858c-81ed3b110dbc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf" status: 200 len: 1270 microversion: 2.1 time: 0.351381 Aug 24 10:12:57.000078 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 295/564] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:56 2022] GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf => generated 1270 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:57.037905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dcae13b7-0ab2-4be3-be0f-b5e51ea4a137 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:57.042035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dcae13b7-0ab2-4be3-be0f-b5e51ea4a137 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:57.063393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcae13b7-0ab2-4be3-be0f-b5e51ea4a137 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:57.068405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcae13b7-0ab2-4be3-be0f-b5e51ea4a137 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:57.071182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcae13b7-0ab2-4be3-be0f-b5e51ea4a137 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:57.075044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcae13b7-0ab2-4be3-be0f-b5e51ea4a137 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:57.078509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcae13b7-0ab2-4be3-be0f-b5e51ea4a137 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:57.083397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcae13b7-0ab2-4be3-be0f-b5e51ea4a137 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:57.085288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4f9fac70-c3a6-43e4-ac98-91cd4125c44e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:57.114644 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4f9fac70-c3a6-43e4-ac98-91cd4125c44e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268" status: 200 len: 1318 microversion: 2.1 time: 1.244184 Aug 24 10:12:57.134645 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 270/565] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:55 2022] GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268 => generated 1318 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:57.416096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dcae13b7-0ab2-4be3-be0f-b5e51ea4a137 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:57.424669 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dcae13b7-0ab2-4be3-be0f-b5e51ea4a137 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1477 microversion: 2.1 time: 0.404350 Aug 24 10:12:57.429221 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 296/566] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:57 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1477 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:57.662752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cf72194b-ef40-4806-9be3-2e8f7d84601f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:57.664888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cf72194b-ef40-4806-9be3-2e8f7d84601f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:57.691458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf72194b-ef40-4806-9be3-2e8f7d84601f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:57.692988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf72194b-ef40-4806-9be3-2e8f7d84601f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:57.694237 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf72194b-ef40-4806-9be3-2e8f7d84601f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:57.696229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf72194b-ef40-4806-9be3-2e8f7d84601f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:57.697248 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf72194b-ef40-4806-9be3-2e8f7d84601f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:57.698052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf72194b-ef40-4806-9be3-2e8f7d84601f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:58.057136 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d32d7f68-db9b-4636-b69c-cf795451c4ec tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:58.062718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d32d7f68-db9b-4636-b69c-cf795451c4ec tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 322e4dd7-c596-41d1-94a4-7bdd711f3ebf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:58.093200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d32d7f68-db9b-4636-b69c-cf795451c4ec tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:58.093925 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d32d7f68-db9b-4636-b69c-cf795451c4ec tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:58.095060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d32d7f68-db9b-4636-b69c-cf795451c4ec tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:58.096262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d32d7f68-db9b-4636-b69c-cf795451c4ec tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:58.096767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d32d7f68-db9b-4636-b69c-cf795451c4ec tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:58.098191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d32d7f68-db9b-4636-b69c-cf795451c4ec tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:58.306459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d32d7f68-db9b-4636-b69c-cf795451c4ec tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:58.317682 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d32d7f68-db9b-4636-b69c-cf795451c4ec tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf" status: 200 len: 1276 microversion: 2.1 time: 0.290860 Aug 24 10:12:58.321142 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 297/567] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:58 2022] GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf => generated 1276 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:58.337031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bd529538-5b3e-4344-a651-e4f439ce5665 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:58.338091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bd529538-5b3e-4344-a651-e4f439ce5665 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 2706bbd7-7fe1-4441-a716-a35246a87268] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:58.363949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd529538-5b3e-4344-a651-e4f439ce5665 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:58.367560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd529538-5b3e-4344-a651-e4f439ce5665 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:58.368206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd529538-5b3e-4344-a651-e4f439ce5665 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:58.368972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd529538-5b3e-4344-a651-e4f439ce5665 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:58.369459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd529538-5b3e-4344-a651-e4f439ce5665 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:58.369881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd529538-5b3e-4344-a651-e4f439ce5665 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:58.687512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cf72194b-ef40-4806-9be3-2e8f7d84601f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:58.703606 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cf72194b-ef40-4806-9be3-2e8f7d84601f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:58.705144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cf72194b-ef40-4806-9be3-2e8f7d84601f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:58.706861 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cf72194b-ef40-4806-9be3-2e8f7d84601f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 1361 microversion: 2.25 time: 1.051498 Aug 24 10:12:58.709399 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 271/568] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:57 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 1361 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:12:58.730805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8c403274-de0d-45fb-ae71-c951fd957ccd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:58.732445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8c403274-de0d-45fb-ae71-c951fd957ccd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:58.752388 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c403274-de0d-45fb-ae71-c951fd957ccd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:58.753258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c403274-de0d-45fb-ae71-c951fd957ccd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:58.753900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c403274-de0d-45fb-ae71-c951fd957ccd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:58.755055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c403274-de0d-45fb-ae71-c951fd957ccd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:58.755715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c403274-de0d-45fb-ae71-c951fd957ccd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:58.756298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c403274-de0d-45fb-ae71-c951fd957ccd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:59.093372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bd529538-5b3e-4344-a651-e4f439ce5665 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:59.114704 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bd529538-5b3e-4344-a651-e4f439ce5665 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268" status: 200 len: 1318 microversion: 2.1 time: 0.791602 Aug 24 10:12:59.116307 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 298/569] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:58 2022] GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268 => generated 1318 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:59.127885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-1c40cae2-b46f-4d0b-8eb1-91b6bc65c427 req-54e34a2a-7d14-4403-a4a4-641ae94f9ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26944760-9a04-4f1a-8d41-148a947f41f1", "tag": "3139e3fc-0583-464d-9f47-1476780c5e66"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:59.140988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1c40cae2-b46f-4d0b-8eb1-91b6bc65c427 req-54e34a2a-7d14-4403-a4a4-641ae94f9ac3 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:59.142011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1c40cae2-b46f-4d0b-8eb1-91b6bc65c427 req-54e34a2a-7d14-4403-a4a4-641ae94f9ac3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:59.142550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1c40cae2-b46f-4d0b-8eb1-91b6bc65c427 req-54e34a2a-7d14-4403-a4a4-641ae94f9ac3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:59.160532 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-1c40cae2-b46f-4d0b-8eb1-91b6bc65c427 req-54e34a2a-7d14-4403-a4a4-641ae94f9ac3 service nova] Creating event network-changed:3139e3fc-0583-464d-9f47-1476780c5e66 for instance 26944760-9a04-4f1a-8d41-148a947f41f1 on n-h1-849328-3 Aug 24 10:12:59.168679 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-1c40cae2-b46f-4d0b-8eb1-91b6bc65c427 req-54e34a2a-7d14-4403-a4a4-641ae94f9ac3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049972 Aug 24 10:12:59.170361 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 299/570] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:59.180181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-34cf686d-5257-4b64-a89c-da68ac33466b req-e8d48123-bcb4-46e1-aeb6-6193b6481e4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2706bbd7-7fe1-4441-a716-a35246a87268", "name": "network-vif-plugged", "status": "completed", "tag": "015ec317-9902-41df-9659-0afb438521b5"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:12:59.197164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-34cf686d-5257-4b64-a89c-da68ac33466b req-e8d48123-bcb4-46e1-aeb6-6193b6481e4a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:59.198472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-34cf686d-5257-4b64-a89c-da68ac33466b req-e8d48123-bcb4-46e1-aeb6-6193b6481e4a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:59.199723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-34cf686d-5257-4b64-a89c-da68ac33466b req-e8d48123-bcb4-46e1-aeb6-6193b6481e4a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:59.227457 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-34cf686d-5257-4b64-a89c-da68ac33466b req-e8d48123-bcb4-46e1-aeb6-6193b6481e4a service nova] Creating event network-vif-plugged:015ec317-9902-41df-9659-0afb438521b5 for instance 2706bbd7-7fe1-4441-a716-a35246a87268 on n-h2-849328-3 Aug 24 10:12:59.234521 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-34cf686d-5257-4b64-a89c-da68ac33466b req-e8d48123-bcb4-46e1-aeb6-6193b6481e4a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061176 Aug 24 10:12:59.236050 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 300/571] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:12:59.376019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ae196bb6-f5fb-4486-ae94-9db5c3051c65 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:59.377280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ae196bb6-f5fb-4486-ae94-9db5c3051c65 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 322e4dd7-c596-41d1-94a4-7bdd711f3ebf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:59.401878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae196bb6-f5fb-4486-ae94-9db5c3051c65 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:59.404384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae196bb6-f5fb-4486-ae94-9db5c3051c65 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:59.405743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae196bb6-f5fb-4486-ae94-9db5c3051c65 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:59.407472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae196bb6-f5fb-4486-ae94-9db5c3051c65 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:59.408155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae196bb6-f5fb-4486-ae94-9db5c3051c65 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:59.408798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae196bb6-f5fb-4486-ae94-9db5c3051c65 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:59.725642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8c403274-de0d-45fb-ae71-c951fd957ccd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:12:59.763704 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8c403274-de0d-45fb-ae71-c951fd957ccd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1477 microversion: 2.1 time: 1.034619 Aug 24 10:12:59.766119 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 272/572] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:58 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1477 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:12:59.786750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-deaf88fe-2478-417e-89ec-c301a4f2c015 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:59.787382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-deaf88fe-2478-417e-89ec-c301a4f2c015 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:59.805653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-deaf88fe-2478-417e-89ec-c301a4f2c015 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:59.806286 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-deaf88fe-2478-417e-89ec-c301a4f2c015 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:59.806764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-deaf88fe-2478-417e-89ec-c301a4f2c015 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:59.808458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-deaf88fe-2478-417e-89ec-c301a4f2c015 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:59.809007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-deaf88fe-2478-417e-89ec-c301a4f2c015 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:59.809936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-deaf88fe-2478-417e-89ec-c301a4f2c015 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:00.472190 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ae196bb6-f5fb-4486-ae94-9db5c3051c65 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:00.488750 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ae196bb6-f5fb-4486-ae94-9db5c3051c65 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf" status: 200 len: 1318 microversion: 2.1 time: 1.119753 Aug 24 10:13:00.519559 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 301/573] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:59 2022] GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf => generated 1318 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:13:00.528610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eb0e3f74-6af0-48f4-9b62-ffaa334f374e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:00.534148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-eb0e3f74-6af0-48f4-9b62-ffaa334f374e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 2706bbd7-7fe1-4441-a716-a35246a87268] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:00.550755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb0e3f74-6af0-48f4-9b62-ffaa334f374e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:00.551543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb0e3f74-6af0-48f4-9b62-ffaa334f374e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:00.552539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb0e3f74-6af0-48f4-9b62-ffaa334f374e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:00.553809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb0e3f74-6af0-48f4-9b62-ffaa334f374e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:00.564373 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb0e3f74-6af0-48f4-9b62-ffaa334f374e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:00.567315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb0e3f74-6af0-48f4-9b62-ffaa334f374e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:00.894148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-deaf88fe-2478-417e-89ec-c301a4f2c015 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:00.904321 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-deaf88fe-2478-417e-89ec-c301a4f2c015 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:00.916401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-deaf88fe-2478-417e-89ec-c301a4f2c015 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:00.922496 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-deaf88fe-2478-417e-89ec-c301a4f2c015 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 1361 microversion: 2.25 time: 1.150443 Aug 24 10:13:00.923932 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 273/574] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:12:59 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 1361 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:13:00.947830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dc4ad3b2-6f8b-40dd-93e7-649475fac702 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:00.950142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dc4ad3b2-6f8b-40dd-93e7-649475fac702 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:00.970050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc4ad3b2-6f8b-40dd-93e7-649475fac702 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:00.971076 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc4ad3b2-6f8b-40dd-93e7-649475fac702 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:00.971653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc4ad3b2-6f8b-40dd-93e7-649475fac702 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:00.972552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc4ad3b2-6f8b-40dd-93e7-649475fac702 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:00.973183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc4ad3b2-6f8b-40dd-93e7-649475fac702 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:00.973790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc4ad3b2-6f8b-40dd-93e7-649475fac702 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:01.140803 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-eb0e3f74-6af0-48f4-9b62-ffaa334f374e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:01.179402 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eb0e3f74-6af0-48f4-9b62-ffaa334f374e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268" status: 200 len: 1318 microversion: 2.1 time: 0.654793 Aug 24 10:13:01.197421 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 302/575] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:00 2022] GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268 => generated 1318 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:01.357563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dc4ad3b2-6f8b-40dd-93e7-649475fac702 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:01.372414 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dc4ad3b2-6f8b-40dd-93e7-649475fac702 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1477 microversion: 2.1 time: 0.446144 Aug 24 10:13:01.373061 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 274/576] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:00 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1477 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:01.528604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0b0f4503-4554-473a-88b3-ac9159e12f1e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:01.529488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0b0f4503-4554-473a-88b3-ac9159e12f1e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 322e4dd7-c596-41d1-94a4-7bdd711f3ebf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:01.541811 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b0f4503-4554-473a-88b3-ac9159e12f1e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:01.544332 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b0f4503-4554-473a-88b3-ac9159e12f1e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:01.544946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b0f4503-4554-473a-88b3-ac9159e12f1e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:01.546847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b0f4503-4554-473a-88b3-ac9159e12f1e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:01.548782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b0f4503-4554-473a-88b3-ac9159e12f1e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:01.550415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b0f4503-4554-473a-88b3-ac9159e12f1e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:01.705452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3eaabe8b-2bfc-405f-96c5-f90a4bf7f901 req-04a7baeb-ddf1-4251-a313-07ec32c35322 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71cb543d-2961-4511-b990-c53fd25db381", "tag": "a67f32d5-2bc6-456e-bce8-dcad8a07253a"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:01.736351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3eaabe8b-2bfc-405f-96c5-f90a4bf7f901 req-04a7baeb-ddf1-4251-a313-07ec32c35322 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:01.736853 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3eaabe8b-2bfc-405f-96c5-f90a4bf7f901 req-04a7baeb-ddf1-4251-a313-07ec32c35322 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:01.737354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3eaabe8b-2bfc-405f-96c5-f90a4bf7f901 req-04a7baeb-ddf1-4251-a313-07ec32c35322 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:01.767501 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3eaabe8b-2bfc-405f-96c5-f90a4bf7f901 req-04a7baeb-ddf1-4251-a313-07ec32c35322 service nova] Creating event network-changed:a67f32d5-2bc6-456e-bce8-dcad8a07253a for instance 71cb543d-2961-4511-b990-c53fd25db381 on n-h2-849328-3 Aug 24 10:13:01.792628 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3eaabe8b-2bfc-405f-96c5-f90a4bf7f901 req-04a7baeb-ddf1-4251-a313-07ec32c35322 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090147 Aug 24 10:13:01.794145 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 275/577] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:13:01.958205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-43453c1d-aa5b-4b46-aa37-5e1e732bbda7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:01.962015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-43453c1d-aa5b-4b46-aa37-5e1e732bbda7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:01.980748 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43453c1d-aa5b-4b46-aa37-5e1e732bbda7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:01.984118 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43453c1d-aa5b-4b46-aa37-5e1e732bbda7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:01.984644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43453c1d-aa5b-4b46-aa37-5e1e732bbda7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:01.985414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43453c1d-aa5b-4b46-aa37-5e1e732bbda7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:01.986106 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43453c1d-aa5b-4b46-aa37-5e1e732bbda7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:01.986753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43453c1d-aa5b-4b46-aa37-5e1e732bbda7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:02.244272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0b0f4503-4554-473a-88b3-ac9159e12f1e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:02.258974 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0b0f4503-4554-473a-88b3-ac9159e12f1e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf" status: 200 len: 1318 microversion: 2.1 time: 0.735883 Aug 24 10:13:02.260935 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 303/578] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:01 2022] GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf => generated 1318 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:02.269379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-53378613-aa0c-429f-85e2-cd8394fd98f9 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:02.270653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-53378613-aa0c-429f-85e2-cd8394fd98f9 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 2706bbd7-7fe1-4441-a716-a35246a87268] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:02.290379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53378613-aa0c-429f-85e2-cd8394fd98f9 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:02.290969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53378613-aa0c-429f-85e2-cd8394fd98f9 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:02.291405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53378613-aa0c-429f-85e2-cd8394fd98f9 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:02.292184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53378613-aa0c-429f-85e2-cd8394fd98f9 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:02.292639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53378613-aa0c-429f-85e2-cd8394fd98f9 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:02.293096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53378613-aa0c-429f-85e2-cd8394fd98f9 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:02.461801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-43453c1d-aa5b-4b46-aa37-5e1e732bbda7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:02.482047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-43453c1d-aa5b-4b46-aa37-5e1e732bbda7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:02.515983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-43453c1d-aa5b-4b46-aa37-5e1e732bbda7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:02.518596 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-43453c1d-aa5b-4b46-aa37-5e1e732bbda7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 1361 microversion: 2.25 time: 0.567570 Aug 24 10:13:02.519903 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 276/579] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:13:01 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 1361 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:13:02.529146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ac68c690-af48-400c-b945-218423cd18e5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:02.530555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ac68c690-af48-400c-b945-218423cd18e5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:02.544761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac68c690-af48-400c-b945-218423cd18e5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:02.546081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac68c690-af48-400c-b945-218423cd18e5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:02.547096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac68c690-af48-400c-b945-218423cd18e5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:02.549639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac68c690-af48-400c-b945-218423cd18e5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:02.550694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac68c690-af48-400c-b945-218423cd18e5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:02.551723 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac68c690-af48-400c-b945-218423cd18e5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:02.763275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-53378613-aa0c-429f-85e2-cd8394fd98f9 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:02.779447 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-53378613-aa0c-429f-85e2-cd8394fd98f9 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268" status: 200 len: 1318 microversion: 2.1 time: 0.516565 Aug 24 10:13:02.794732 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 304/580] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:02 2022] GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268 => generated 1318 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:02.820389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-3bb4ec8a-04bb-4ee8-8dcd-3a4a0ba8a420 req-abc6edd9-29d8-41af-93de-36d83a5e46fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "322e4dd7-c596-41d1-94a4-7bdd711f3ebf", "tag": "1932e7da-337e-470e-8ae5-6f500b4e8a39"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:02.841530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3bb4ec8a-04bb-4ee8-8dcd-3a4a0ba8a420 req-abc6edd9-29d8-41af-93de-36d83a5e46fb service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:02.842707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3bb4ec8a-04bb-4ee8-8dcd-3a4a0ba8a420 req-abc6edd9-29d8-41af-93de-36d83a5e46fb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:02.843652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3bb4ec8a-04bb-4ee8-8dcd-3a4a0ba8a420 req-abc6edd9-29d8-41af-93de-36d83a5e46fb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:02.899630 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-3bb4ec8a-04bb-4ee8-8dcd-3a4a0ba8a420 req-abc6edd9-29d8-41af-93de-36d83a5e46fb service nova] Creating event network-changed:1932e7da-337e-470e-8ae5-6f500b4e8a39 for instance 322e4dd7-c596-41d1-94a4-7bdd711f3ebf on n-h2-849328-3 Aug 24 10:13:02.910714 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-3bb4ec8a-04bb-4ee8-8dcd-3a4a0ba8a420 req-abc6edd9-29d8-41af-93de-36d83a5e46fb service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100133 Aug 24 10:13:02.912209 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 305/581] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:13:03.178241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ac68c690-af48-400c-b945-218423cd18e5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:03.213170 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ac68c690-af48-400c-b945-218423cd18e5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1477 microversion: 2.1 time: 0.691099 Aug 24 10:13:03.214235 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 277/582] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:02 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1477 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:03.298171 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-86d28d47-1685-4e2b-bee6-973de19d0e39 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:03.300247 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-86d28d47-1685-4e2b-bee6-973de19d0e39 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 322e4dd7-c596-41d1-94a4-7bdd711f3ebf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:03.309067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86d28d47-1685-4e2b-bee6-973de19d0e39 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:03.310526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86d28d47-1685-4e2b-bee6-973de19d0e39 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:03.311166 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86d28d47-1685-4e2b-bee6-973de19d0e39 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:03.312338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86d28d47-1685-4e2b-bee6-973de19d0e39 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:03.313038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86d28d47-1685-4e2b-bee6-973de19d0e39 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:03.313765 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86d28d47-1685-4e2b-bee6-973de19d0e39 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:03.544158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-72267c10-01a7-4ba9-8d86-15d7c7a9a1a6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:03.544977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-72267c10-01a7-4ba9-8d86-15d7c7a9a1a6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:03.554583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72267c10-01a7-4ba9-8d86-15d7c7a9a1a6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:03.559231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72267c10-01a7-4ba9-8d86-15d7c7a9a1a6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:03.559821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72267c10-01a7-4ba9-8d86-15d7c7a9a1a6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:03.560797 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72267c10-01a7-4ba9-8d86-15d7c7a9a1a6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:03.562182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72267c10-01a7-4ba9-8d86-15d7c7a9a1a6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:03.566096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72267c10-01a7-4ba9-8d86-15d7c7a9a1a6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:04.220922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-72267c10-01a7-4ba9-8d86-15d7c7a9a1a6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:04.251996 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-72267c10-01a7-4ba9-8d86-15d7c7a9a1a6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:04.254608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-72267c10-01a7-4ba9-8d86-15d7c7a9a1a6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:04.263335 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-72267c10-01a7-4ba9-8d86-15d7c7a9a1a6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 1361 microversion: 2.25 time: 0.723260 Aug 24 10:13:04.302273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-86d28d47-1685-4e2b-bee6-973de19d0e39 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:04.307279 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 278/583] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:13:03 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 1361 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:13:04.318459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-579931e0-b5f1-468b-8d31-a5ba5ad6aafe tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:04.319515 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-579931e0-b5f1-468b-8d31-a5ba5ad6aafe tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 2706bbd7-7fe1-4441-a716-a35246a87268] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:04.332874 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-86d28d47-1685-4e2b-bee6-973de19d0e39 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf" status: 200 len: 1318 microversion: 2.1 time: 1.048140 Aug 24 10:13:04.333722 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 306/584] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:03 2022] GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf => generated 1318 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:04.350921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ef5c7a83-be23-40a6-823a-5caf0c787863 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:04.354129 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ef5c7a83-be23-40a6-823a-5caf0c787863 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:04.372028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-579931e0-b5f1-468b-8d31-a5ba5ad6aafe tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:04.374691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-579931e0-b5f1-468b-8d31-a5ba5ad6aafe tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:04.375539 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-579931e0-b5f1-468b-8d31-a5ba5ad6aafe tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:04.376832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-579931e0-b5f1-468b-8d31-a5ba5ad6aafe tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:04.377661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-579931e0-b5f1-468b-8d31-a5ba5ad6aafe tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:04.378391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-579931e0-b5f1-468b-8d31-a5ba5ad6aafe tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:04.387084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef5c7a83-be23-40a6-823a-5caf0c787863 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:04.388006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef5c7a83-be23-40a6-823a-5caf0c787863 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:04.390019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef5c7a83-be23-40a6-823a-5caf0c787863 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:04.392193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef5c7a83-be23-40a6-823a-5caf0c787863 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:04.398166 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef5c7a83-be23-40a6-823a-5caf0c787863 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:04.399242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef5c7a83-be23-40a6-823a-5caf0c787863 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:04.400409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=32 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:04.772036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=16 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:05.385504 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-579931e0-b5f1-468b-8d31-a5ba5ad6aafe tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:05.401029 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-579931e0-b5f1-468b-8d31-a5ba5ad6aafe tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268" status: 200 len: 1467 microversion: 2.1 time: 1.092286 Aug 24 10:13:05.401938 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 279/585] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:04 2022] GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268 => generated 1467 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:05.409940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3e5477bb-8464-480b-a62e-927dd660f6c8 req-dc335f74-55b1-4e98-90aa-806f57f9c857 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d8befca-2013-4597-a7e7-e12100a340db", "tag": "bde82519-9f50-4430-9cd1-5bca12e6e002"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:05.428287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3e5477bb-8464-480b-a62e-927dd660f6c8 req-dc335f74-55b1-4e98-90aa-806f57f9c857 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:05.429726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3e5477bb-8464-480b-a62e-927dd660f6c8 req-dc335f74-55b1-4e98-90aa-806f57f9c857 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:05.430672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3e5477bb-8464-480b-a62e-927dd660f6c8 req-dc335f74-55b1-4e98-90aa-806f57f9c857 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:05.449761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=10 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:05.452973 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3e5477bb-8464-480b-a62e-927dd660f6c8 req-dc335f74-55b1-4e98-90aa-806f57f9c857 service nova] Creating event network-changed:bde82519-9f50-4430-9cd1-5bca12e6e002 for instance 1d8befca-2013-4597-a7e7-e12100a340db on n-h1-849328-3 Aug 24 10:13:05.459225 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3e5477bb-8464-480b-a62e-927dd660f6c8 req-dc335f74-55b1-4e98-90aa-806f57f9c857 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055728 Aug 24 10:13:05.460516 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 280/586] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:13:05.466997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b0548bb3-6b58-486d-a570-93151e761884 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:05.468140 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b0548bb3-6b58-486d-a570-93151e761884 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:05.478328 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0548bb3-6b58-486d-a570-93151e761884 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:05.479641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0548bb3-6b58-486d-a570-93151e761884 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:05.481466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0548bb3-6b58-486d-a570-93151e761884 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:05.483397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0548bb3-6b58-486d-a570-93151e761884 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:05.484737 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0548bb3-6b58-486d-a570-93151e761884 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:05.485811 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0548bb3-6b58-486d-a570-93151e761884 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:05.555278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ef5c7a83-be23-40a6-823a-5caf0c787863 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:05.606717 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ef5c7a83-be23-40a6-823a-5caf0c787863 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1477 microversion: 2.1 time: 1.271120 Aug 24 10:13:05.628858 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 307/587] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:04 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1477 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:05.698494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c7102c19-b043-4f37-b54d-a37608b2622b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:05.700137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c7102c19-b043-4f37-b54d-a37608b2622b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 322e4dd7-c596-41d1-94a4-7bdd711f3ebf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:05.742092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7102c19-b043-4f37-b54d-a37608b2622b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:05.745903 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7102c19-b043-4f37-b54d-a37608b2622b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:05.750045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7102c19-b043-4f37-b54d-a37608b2622b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:05.754026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7102c19-b043-4f37-b54d-a37608b2622b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:05.757634 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7102c19-b043-4f37-b54d-a37608b2622b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:05.758539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7102c19-b043-4f37-b54d-a37608b2622b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:05.897758 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b0548bb3-6b58-486d-a570-93151e761884 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:05.912363 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b0548bb3-6b58-486d-a570-93151e761884 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:05.914367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b0548bb3-6b58-486d-a570-93151e761884 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:05.915408 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b0548bb3-6b58-486d-a570-93151e761884 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 1361 microversion: 2.25 time: 0.453149 Aug 24 10:13:05.926703 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 281/588] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:13:05 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 1361 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:13:05.934711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-30b58286-365b-4444-a6ad-d5460465297c tempest-DeleteServersAdminTestJSON-2039929978 tempest-DeleteServersAdminTestJSON-2039929978-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:05.945263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-30b58286-365b-4444-a6ad-d5460465297c tempest-DeleteServersAdminTestJSON-2039929978 tempest-DeleteServersAdminTestJSON-2039929978-project-admin] [instance: 2706bbd7-7fe1-4441-a716-a35246a87268] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:05.968309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30b58286-365b-4444-a6ad-d5460465297c tempest-DeleteServersAdminTestJSON-2039929978 tempest-DeleteServersAdminTestJSON-2039929978-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:05.968905 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30b58286-365b-4444-a6ad-d5460465297c tempest-DeleteServersAdminTestJSON-2039929978 tempest-DeleteServersAdminTestJSON-2039929978-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:05.969669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30b58286-365b-4444-a6ad-d5460465297c tempest-DeleteServersAdminTestJSON-2039929978 tempest-DeleteServersAdminTestJSON-2039929978-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:05.970470 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30b58286-365b-4444-a6ad-d5460465297c tempest-DeleteServersAdminTestJSON-2039929978 tempest-DeleteServersAdminTestJSON-2039929978-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:05.971064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30b58286-365b-4444-a6ad-d5460465297c tempest-DeleteServersAdminTestJSON-2039929978 tempest-DeleteServersAdminTestJSON-2039929978-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:05.971349 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30b58286-365b-4444-a6ad-d5460465297c tempest-DeleteServersAdminTestJSON-2039929978 tempest-DeleteServersAdminTestJSON-2039929978-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:06.174353 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-30b58286-365b-4444-a6ad-d5460465297c tempest-DeleteServersAdminTestJSON-2039929978 tempest-DeleteServersAdminTestJSON-2039929978-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268/action" status: 202 len: 0 microversion: 2.1 time: 0.244154 Aug 24 10:13:06.179025 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 282/589] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:13:05 2022] POST /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:13:06.186925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f387962f-89bd-4fea-a62c-3d9220c2dfa3 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:06.187580 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f387962f-89bd-4fea-a62c-3d9220c2dfa3 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 2706bbd7-7fe1-4441-a716-a35246a87268] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:06.207692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f387962f-89bd-4fea-a62c-3d9220c2dfa3 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:06.208500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f387962f-89bd-4fea-a62c-3d9220c2dfa3 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:06.209450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f387962f-89bd-4fea-a62c-3d9220c2dfa3 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:06.210347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f387962f-89bd-4fea-a62c-3d9220c2dfa3 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:06.211287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f387962f-89bd-4fea-a62c-3d9220c2dfa3 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:06.211892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f387962f-89bd-4fea-a62c-3d9220c2dfa3 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:06.297238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f387962f-89bd-4fea-a62c-3d9220c2dfa3 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:06.300779 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f387962f-89bd-4fea-a62c-3d9220c2dfa3 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:06.302817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f387962f-89bd-4fea-a62c-3d9220c2dfa3 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:06.303472 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-f387962f-89bd-4fea-a62c-3d9220c2dfa3 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lazy-loading 'fault' on Instance uuid 2706bbd7-7fe1-4441-a716-a35246a87268 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:13:06.314717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c7102c19-b043-4f37-b54d-a37608b2622b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:06.325385 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c7102c19-b043-4f37-b54d-a37608b2622b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf" status: 200 len: 1318 microversion: 2.1 time: 0.694029 Aug 24 10:13:06.329900 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 308/590] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:05 2022] GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf => generated 1318 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:06.618803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f387962f-89bd-4fea-a62c-3d9220c2dfa3 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:06.633779 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f387962f-89bd-4fea-a62c-3d9220c2dfa3 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268" status: 200 len: 1450 microversion: 2.1 time: 0.453369 Aug 24 10:13:06.634663 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 283/591] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:06 2022] GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268 => generated 1450 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:06.665863 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a9c2d071-3045-440c-9573-aeabe80c1323 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:06.666525 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a9c2d071-3045-440c-9573-aeabe80c1323 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:06.670261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1389b4b8-2f1f-422b-be70-38c79ade4e36 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:06.670730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1389b4b8-2f1f-422b-be70-38c79ade4e36 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 2706bbd7-7fe1-4441-a716-a35246a87268] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:06.682659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9c2d071-3045-440c-9573-aeabe80c1323 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:06.683167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9c2d071-3045-440c-9573-aeabe80c1323 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:06.684580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1389b4b8-2f1f-422b-be70-38c79ade4e36 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:06.685062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1389b4b8-2f1f-422b-be70-38c79ade4e36 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:06.686193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1389b4b8-2f1f-422b-be70-38c79ade4e36 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:06.686339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9c2d071-3045-440c-9573-aeabe80c1323 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:06.686565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9c2d071-3045-440c-9573-aeabe80c1323 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:06.687208 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9c2d071-3045-440c-9573-aeabe80c1323 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:06.690853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1389b4b8-2f1f-422b-be70-38c79ade4e36 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:06.691342 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1389b4b8-2f1f-422b-be70-38c79ade4e36 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:06.691798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1389b4b8-2f1f-422b-be70-38c79ade4e36 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:06.691948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9c2d071-3045-440c-9573-aeabe80c1323 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:06.798521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1389b4b8-2f1f-422b-be70-38c79ade4e36 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 2706bbd7-7fe1-4441-a716-a35246a87268] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:13:06.811754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:07.028418 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1389b4b8-2f1f-422b-be70-38c79ade4e36 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "DELETE /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268" status: 204 len: 0 microversion: 2.1 time: 0.367640 Aug 24 10:13:07.028418 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 309/592] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:13:06 2022] DELETE /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:13:07.048298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cf760404-6724-41c1-bc53-55edf03b73c2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:07.049856 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cf760404-6724-41c1-bc53-55edf03b73c2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:07.065722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf760404-6724-41c1-bc53-55edf03b73c2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:07.066327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf760404-6724-41c1-bc53-55edf03b73c2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:07.066951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf760404-6724-41c1-bc53-55edf03b73c2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:07.068017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf760404-6724-41c1-bc53-55edf03b73c2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:07.068584 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf760404-6724-41c1-bc53-55edf03b73c2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:07.069201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf760404-6724-41c1-bc53-55edf03b73c2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:07.232917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a9c2d071-3045-440c-9573-aeabe80c1323 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:07.249671 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a9c2d071-3045-440c-9573-aeabe80c1323 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1477 microversion: 2.1 time: 0.593996 Aug 24 10:13:07.250814 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 284/593] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:06 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1477 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:07.259139 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bbd77f9b-e1ce-4761-9696-3234b85f7cf7 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:07.260213 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bbd77f9b-e1ce-4761-9696-3234b85f7cf7 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 2706bbd7-7fe1-4441-a716-a35246a87268] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:07.276209 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd77f9b-e1ce-4761-9696-3234b85f7cf7 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:07.278962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd77f9b-e1ce-4761-9696-3234b85f7cf7 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:07.279630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd77f9b-e1ce-4761-9696-3234b85f7cf7 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:07.280367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd77f9b-e1ce-4761-9696-3234b85f7cf7 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:07.280819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd77f9b-e1ce-4761-9696-3234b85f7cf7 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:07.281297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd77f9b-e1ce-4761-9696-3234b85f7cf7 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:07.347288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd77f9b-e1ce-4761-9696-3234b85f7cf7 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:07.348048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd77f9b-e1ce-4761-9696-3234b85f7cf7 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:07.348867 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd77f9b-e1ce-4761-9696-3234b85f7cf7 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:07.349617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-bbd77f9b-e1ce-4761-9696-3234b85f7cf7 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lazy-loading 'fault' on Instance uuid 2706bbd7-7fe1-4441-a716-a35246a87268 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:13:07.355668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:07.786775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bbd77f9b-e1ce-4761-9696-3234b85f7cf7 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:07.812619 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bbd77f9b-e1ce-4761-9696-3234b85f7cf7 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268" status: 200 len: 1456 microversion: 2.1 time: 0.558945 Aug 24 10:13:07.813752 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 285/594] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:07 2022] GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268 => generated 1456 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:07.827517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e2981a9c-cc33-4d1a-8ec8-b3f6999b7636 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:07.834142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e2981a9c-cc33-4d1a-8ec8-b3f6999b7636 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 322e4dd7-c596-41d1-94a4-7bdd711f3ebf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:07.855160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2981a9c-cc33-4d1a-8ec8-b3f6999b7636 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:07.856397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2981a9c-cc33-4d1a-8ec8-b3f6999b7636 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:07.857438 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2981a9c-cc33-4d1a-8ec8-b3f6999b7636 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:07.861931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2981a9c-cc33-4d1a-8ec8-b3f6999b7636 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:07.863496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2981a9c-cc33-4d1a-8ec8-b3f6999b7636 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:07.864196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2981a9c-cc33-4d1a-8ec8-b3f6999b7636 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:08.223759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cf760404-6724-41c1-bc53-55edf03b73c2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:08.236791 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e2981a9c-cc33-4d1a-8ec8-b3f6999b7636 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:08.240491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cf760404-6724-41c1-bc53-55edf03b73c2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:08.245371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cf760404-6724-41c1-bc53-55edf03b73c2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:08.248429 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e2981a9c-cc33-4d1a-8ec8-b3f6999b7636 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf" status: 200 len: 1318 microversion: 2.1 time: 0.431856 Aug 24 10:13:08.249167 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 286/595] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:07 2022] GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:08.250540 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cf760404-6724-41c1-bc53-55edf03b73c2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 1361 microversion: 2.25 time: 1.221501 Aug 24 10:13:08.269752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d8d35a2f-7987-4a0f-9be5-dc56d1549356 req-43c776c9-2b71-48c1-8134-1d2aa7734de2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26944760-9a04-4f1a-8d41-148a947f41f1", "name": "network-vif-plugged", "status": "completed", "tag": "3139e3fc-0583-464d-9f47-1476780c5e66"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:08.270351 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 310/596] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:13:07 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 1361 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:13:08.291551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d8d35a2f-7987-4a0f-9be5-dc56d1549356 req-43c776c9-2b71-48c1-8134-1d2aa7734de2 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:08.292175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d8d35a2f-7987-4a0f-9be5-dc56d1549356 req-43c776c9-2b71-48c1-8134-1d2aa7734de2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:08.293505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d8d35a2f-7987-4a0f-9be5-dc56d1549356 req-43c776c9-2b71-48c1-8134-1d2aa7734de2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:08.303065 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-65fdd25e-02d2-4c7b-95d3-44380ae1cfa6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:08.303696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-65fdd25e-02d2-4c7b-95d3-44380ae1cfa6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:08.319823 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d8d35a2f-7987-4a0f-9be5-dc56d1549356 req-43c776c9-2b71-48c1-8134-1d2aa7734de2 service nova] Creating event network-vif-plugged:3139e3fc-0583-464d-9f47-1476780c5e66 for instance 26944760-9a04-4f1a-8d41-148a947f41f1 on n-h1-849328-3 Aug 24 10:13:08.321917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65fdd25e-02d2-4c7b-95d3-44380ae1cfa6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:08.322457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65fdd25e-02d2-4c7b-95d3-44380ae1cfa6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:08.322907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65fdd25e-02d2-4c7b-95d3-44380ae1cfa6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:08.323650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65fdd25e-02d2-4c7b-95d3-44380ae1cfa6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:08.324105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65fdd25e-02d2-4c7b-95d3-44380ae1cfa6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:08.328551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65fdd25e-02d2-4c7b-95d3-44380ae1cfa6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:08.331864 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d8d35a2f-7987-4a0f-9be5-dc56d1549356 req-43c776c9-2b71-48c1-8134-1d2aa7734de2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067661 Aug 24 10:13:08.333770 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 287/597] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:13:08.791620 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-65fdd25e-02d2-4c7b-95d3-44380ae1cfa6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:08.804023 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-65fdd25e-02d2-4c7b-95d3-44380ae1cfa6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1477 microversion: 2.1 time: 0.512205 Aug 24 10:13:08.813382 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 311/598] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:08 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1477 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:08.853811 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aef79b1f-8b32-4c7d-b723-1af34a8273ba tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:08.857524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aef79b1f-8b32-4c7d-b723-1af34a8273ba tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 2706bbd7-7fe1-4441-a716-a35246a87268] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:08.865543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aef79b1f-8b32-4c7d-b723-1af34a8273ba tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:08.866423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aef79b1f-8b32-4c7d-b723-1af34a8273ba tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:08.867103 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aef79b1f-8b32-4c7d-b723-1af34a8273ba tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:08.868107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aef79b1f-8b32-4c7d-b723-1af34a8273ba tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:08.868795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aef79b1f-8b32-4c7d-b723-1af34a8273ba tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:08.869614 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aef79b1f-8b32-4c7d-b723-1af34a8273ba tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:08.923437 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aef79b1f-8b32-4c7d-b723-1af34a8273ba tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:08.923945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aef79b1f-8b32-4c7d-b723-1af34a8273ba tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:08.924396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aef79b1f-8b32-4c7d-b723-1af34a8273ba tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:08.925013 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-aef79b1f-8b32-4c7d-b723-1af34a8273ba tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lazy-loading 'fault' on Instance uuid 2706bbd7-7fe1-4441-a716-a35246a87268 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:13:09.118648 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aef79b1f-8b32-4c7d-b723-1af34a8273ba tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:09.130478 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aef79b1f-8b32-4c7d-b723-1af34a8273ba tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268" status: 200 len: 1456 microversion: 2.1 time: 0.286622 Aug 24 10:13:09.131834 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 288/599] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:08 2022] GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268 => generated 1456 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:09.277175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d87c2423-69c5-46ff-acae-23adb468ec09 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:09.286559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3e722870-f7cc-4b5d-a378-17b224b4d2cd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:09.287641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3e722870-f7cc-4b5d-a378-17b224b4d2cd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:09.287901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d87c2423-69c5-46ff-acae-23adb468ec09 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 322e4dd7-c596-41d1-94a4-7bdd711f3ebf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:09.306995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d87c2423-69c5-46ff-acae-23adb468ec09 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:09.307392 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e722870-f7cc-4b5d-a378-17b224b4d2cd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:09.308044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d87c2423-69c5-46ff-acae-23adb468ec09 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:09.308277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e722870-f7cc-4b5d-a378-17b224b4d2cd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:09.308906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d87c2423-69c5-46ff-acae-23adb468ec09 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:09.309032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e722870-f7cc-4b5d-a378-17b224b4d2cd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:09.310063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d87c2423-69c5-46ff-acae-23adb468ec09 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:09.310379 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e722870-f7cc-4b5d-a378-17b224b4d2cd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:09.311020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d87c2423-69c5-46ff-acae-23adb468ec09 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:09.311226 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e722870-f7cc-4b5d-a378-17b224b4d2cd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:09.311997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e722870-f7cc-4b5d-a378-17b224b4d2cd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:09.312752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d87c2423-69c5-46ff-acae-23adb468ec09 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:09.622997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3e722870-f7cc-4b5d-a378-17b224b4d2cd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:09.636788 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3e722870-f7cc-4b5d-a378-17b224b4d2cd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:09.640685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3e722870-f7cc-4b5d-a378-17b224b4d2cd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:09.643727 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3e722870-f7cc-4b5d-a378-17b224b4d2cd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 1361 microversion: 2.25 time: 0.362722 Aug 24 10:13:09.646200 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 289/600] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:13:09 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 1361 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:13:09.837876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4e30cb15-80c7-4442-9700-e111899455d3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:09.838518 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4e30cb15-80c7-4442-9700-e111899455d3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:09.851807 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e30cb15-80c7-4442-9700-e111899455d3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:09.852361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e30cb15-80c7-4442-9700-e111899455d3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:09.859079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e30cb15-80c7-4442-9700-e111899455d3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:09.860761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e30cb15-80c7-4442-9700-e111899455d3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:09.861880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e30cb15-80c7-4442-9700-e111899455d3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:09.862839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e30cb15-80c7-4442-9700-e111899455d3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:10.191204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4e30cb15-80c7-4442-9700-e111899455d3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:10.204951 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4e30cb15-80c7-4442-9700-e111899455d3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1477 microversion: 2.1 time: 0.371655 Aug 24 10:13:10.206093 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 290/601] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:09 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1477 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:13:10.212427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d16a04c7-1211-4265-9a6a-9aeee79f650f req-e96d477d-3fa7-447f-9bd7-68f0fa641fcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2706bbd7-7fe1-4441-a716-a35246a87268", "name": "network-vif-deleted", "tag": "015ec317-9902-41df-9659-0afb438521b5"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:10.240505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d16a04c7-1211-4265-9a6a-9aeee79f650f req-e96d477d-3fa7-447f-9bd7-68f0fa641fcc service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:10.241391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d16a04c7-1211-4265-9a6a-9aeee79f650f req-e96d477d-3fa7-447f-9bd7-68f0fa641fcc service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:10.242074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d16a04c7-1211-4265-9a6a-9aeee79f650f req-e96d477d-3fa7-447f-9bd7-68f0fa641fcc service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:10.271200 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d16a04c7-1211-4265-9a6a-9aeee79f650f req-e96d477d-3fa7-447f-9bd7-68f0fa641fcc service nova] Creating event network-vif-deleted:015ec317-9902-41df-9659-0afb438521b5 for instance 2706bbd7-7fe1-4441-a716-a35246a87268 on n-h2-849328-3 Aug 24 10:13:10.286912 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d16a04c7-1211-4265-9a6a-9aeee79f650f req-e96d477d-3fa7-447f-9bd7-68f0fa641fcc service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079118 Aug 24 10:13:10.288284 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 291/602] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:13:10.301832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a88fa2bd-dc83-4e2a-a79e-a05991c9175c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:10.309647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a88fa2bd-dc83-4e2a-a79e-a05991c9175c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 2706bbd7-7fe1-4441-a716-a35246a87268] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:10.320948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a88fa2bd-dc83-4e2a-a79e-a05991c9175c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:10.322944 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a88fa2bd-dc83-4e2a-a79e-a05991c9175c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:10.323900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a88fa2bd-dc83-4e2a-a79e-a05991c9175c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:10.325427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a88fa2bd-dc83-4e2a-a79e-a05991c9175c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:10.327805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a88fa2bd-dc83-4e2a-a79e-a05991c9175c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:10.329199 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a88fa2bd-dc83-4e2a-a79e-a05991c9175c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:10.342080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d87c2423-69c5-46ff-acae-23adb468ec09 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:10.352161 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d87c2423-69c5-46ff-acae-23adb468ec09 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf" status: 200 len: 1318 microversion: 2.1 time: 1.082863 Aug 24 10:13:10.358029 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 312/603] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:09 2022] GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf => generated 1318 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:13:10.444859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a88fa2bd-dc83-4e2a-a79e-a05991c9175c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:10.445690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a88fa2bd-dc83-4e2a-a79e-a05991c9175c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:10.446300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a88fa2bd-dc83-4e2a-a79e-a05991c9175c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:10.447114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-a88fa2bd-dc83-4e2a-a79e-a05991c9175c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lazy-loading 'fault' on Instance uuid 2706bbd7-7fe1-4441-a716-a35246a87268 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:13:10.537660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a88fa2bd-dc83-4e2a-a79e-a05991c9175c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd5610642144fb0b7915285aafc0099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12902eb1fd734a189ec5f04a051b30b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:10.548206 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a88fa2bd-dc83-4e2a-a79e-a05991c9175c tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268" status: 200 len: 1308 microversion: 2.1 time: 0.257984 Aug 24 10:13:10.549217 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 292/604] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:10 2022] GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268 => generated 1308 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:10.692024 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c9136ee4-2b91-486f-bf1a-16ef1fb08063 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:10.692757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c9136ee4-2b91-486f-bf1a-16ef1fb08063 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:10.707626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9136ee4-2b91-486f-bf1a-16ef1fb08063 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:10.708248 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9136ee4-2b91-486f-bf1a-16ef1fb08063 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:10.708763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9136ee4-2b91-486f-bf1a-16ef1fb08063 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:10.709854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9136ee4-2b91-486f-bf1a-16ef1fb08063 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:10.710498 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9136ee4-2b91-486f-bf1a-16ef1fb08063 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:10.711103 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9136ee4-2b91-486f-bf1a-16ef1fb08063 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:10.957529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c9136ee4-2b91-486f-bf1a-16ef1fb08063 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:10.961463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c22558b3-1781-4a6e-9a7b-901ced8c90ee tempest-FloatingIPsNegativeTestJSON-1707624756 tempest-FloatingIPsNegativeTestJSON-1707624756-project] Calling method '.version_select at 0x7f46553cb9d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:10.985622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c9136ee4-2b91-486f-bf1a-16ef1fb08063 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:10.994142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c9136ee4-2b91-486f-bf1a-16ef1fb08063 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:10.999974 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c9136ee4-2b91-486f-bf1a-16ef1fb08063 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 1557 microversion: 2.25 time: 0.313196 Aug 24 10:13:11.002065 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 293/605] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:13:10 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 1557 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:13:11.027535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cd4f4255-9a9c-4c9b-8346-7b562b67a20e tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:11.029592 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cd4f4255-9a9c-4c9b-8346-7b562b67a20e tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:11.054271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd4f4255-9a9c-4c9b-8346-7b562b67a20e tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:11.055290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd4f4255-9a9c-4c9b-8346-7b562b67a20e tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:11.055854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd4f4255-9a9c-4c9b-8346-7b562b67a20e tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:11.056805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd4f4255-9a9c-4c9b-8346-7b562b67a20e tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:11.059212 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd4f4255-9a9c-4c9b-8346-7b562b67a20e tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:11.060363 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd4f4255-9a9c-4c9b-8346-7b562b67a20e tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:11.086719 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c22558b3-1781-4a6e-9a7b-901ced8c90ee tempest-FloatingIPsNegativeTestJSON-1707624756 tempest-FloatingIPsNegativeTestJSON-1707624756-project] 10.222.0.85 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.468703 Aug 24 10:13:11.088260 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 313/606] 10.222.0.85 () {58 vars in 1149 bytes} [Wed Aug 24 10:13:10 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:13:11.106207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-831897ad-13aa-41dd-b39a-31b1e416178a tempest-FloatingIPsNegativeTestJSON-1707624756 tempest-FloatingIPsNegativeTestJSON-1707624756-project] Action: 'create', calling method: .version_select at 0x7f46554cb670>, body: {"pool": "non_exist_pool"} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:11.184155 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-831897ad-13aa-41dd-b39a-31b1e416178a tempest-FloatingIPsNegativeTestJSON-1707624756 tempest-FloatingIPsNegativeTestJSON-1707624756-project] HTTP exception thrown: Floating IP pool not found. Aug 24 10:13:11.188112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-831897ad-13aa-41dd-b39a-31b1e416178a tempest-FloatingIPsNegativeTestJSON-1707624756 tempest-FloatingIPsNegativeTestJSON-1707624756-project] Request method failure captured: Aug 24 10:13:11.188112 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 24 10:13:11.188112 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:13:11.188112 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:13:11.188112 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:13:11.188112 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 26 Aug 24 10:13:11.188112 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:13:11.188112 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:13:11.188112 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:13:11.188112 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:11.188112 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfm2sqn0mIuAOIzi1eID7CVecjtRPT-9TQLgxa8CDkBNfw_Ybrfp_ryNlvVrfyNN8cjHLBa80xjv-exJ86F0RPPdXcziMDSoRzpbtSOrFHs3LOC_2WUUQYlaO3HB3Pwfn6OXfkm_QlkWolUxAaO9gCmnR4jvsmdFzyWSymEv81qk-Ug Aug 24 10:13:11.188112 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:13:11.188112 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:13:11.188112 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:13:11.188112 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:13:11.188112 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:13:11.188112 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:13:11.188112 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: f7a5b3da7c3744a9bb75300512b8db71 Aug 24 10:13:11.188112 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1707624756 Aug 24 10:13:11.188112 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:13:11.188112 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:13:11.189645 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7a5b3da7c3744a9bb75300512b8db71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f7a5b3da7c3744a9bb75300512b8db71", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7a5b3da7c3744a9bb75300512b8db71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f7a5b3da7c3744a9bb75300512b8db71"}]}] Aug 24 10:13:11.189645 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1707624756 Aug 24 10:13:11.189645 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: f7a5b3da7c3744a9bb75300512b8db71 Aug 24 10:13:11.189645 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1707624756 Aug 24 10:13:11.189645 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-FloatingIPsNegativeTestJSON-1707624756-project Aug 24 10:13:11.189645 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:13:11.189645 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:13:11.189645 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: fdbf82c655c5452b8969310a6e1aa307 Aug 24 10:13:11.189645 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1707624756-project Aug 24 10:13:11.189645 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:13:11.189645 n-d-849328-3 devstack@n-api.service[122433]: {"pool": "non_exist_pool"} Aug 24 10:13:11.189645 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:13:11.189645 n-d-849328-3 devstack@n-api.service[122433]: exception: Floating IP pool not found. Aug 24 10:13:11.189645 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 24 10:13:11.189645 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:11.190598 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:11.190598 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 24 10:13:11.190598 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 24 10:13:11.190598 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 24 10:13:11.190598 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 24 10:13:11.190598 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 24 10:13:11.190598 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 24 10:13:11.190598 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 24 10:13:11.190598 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:11.190598 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:11.190598 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:11.190598 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:11.190598 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:11.190598 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:11.190598 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:11.190598 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:11.190598 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:13:11.190598 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:13:11.190598 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:11.190598 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:11.191763 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 24 10:13:11.191763 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:13:11.191763 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 24 10:13:11.191763 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:11.191763 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:11.191763 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:11.191763 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:11.191763 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:11.191763 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:11.191763 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:13:11.191763 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:13:11.191763 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 24 10:13:11.191763 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:11.194396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-831897ad-13aa-41dd-b39a-31b1e416178a tempest-FloatingIPsNegativeTestJSON-1707624756 tempest-FloatingIPsNegativeTestJSON-1707624756-project] Returning 404 to user: Floating IP pool not found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:11.195532 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-831897ad-13aa-41dd-b39a-31b1e416178a tempest-FloatingIPsNegativeTestJSON-1707624756 tempest-FloatingIPsNegativeTestJSON-1707624756-project] 10.222.0.85 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.093651 Aug 24 10:13:11.196367 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 314/607] 10.222.0.85 () {60 vars in 1170 bytes} [Wed Aug 24 10:13:11 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 10:13:11.210856 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9defbe82-cfc4-4b82-8357-f0e6f237dc4f tempest-FloatingIPsNegativeTestJSON-1707624756 tempest-FloatingIPsNegativeTestJSON-1707624756-project] Calling method '.version_select at 0x7f46552f6670>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:11.304530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-cd4f4255-9a9c-4c9b-8346-7b562b67a20e tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lazy-loading 'services' on Instance uuid 26944760-9a04-4f1a-8d41-148a947f41f1 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:13:11.307464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG neutronclient.v2_0.client [None req-9defbe82-cfc4-4b82-8357-f0e6f237dc4f tempest-FloatingIPsNegativeTestJSON-1707624756 tempest-FloatingIPsNegativeTestJSON-1707624756-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e6cb967c-8637-4087-9a1e-b32c9b14ddf4 could not be found", "detail": ""}} {{(pid=122433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 10:13:11.308997 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-9defbe82-cfc4-4b82-8357-f0e6f237dc4f tempest-FloatingIPsNegativeTestJSON-1707624756 tempest-FloatingIPsNegativeTestJSON-1707624756-project] HTTP exception thrown: Floating IP not found for ID e6cb967c-8637-4087-9a1e-b32c9b14ddf4 Aug 24 10:13:11.319854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9defbe82-cfc4-4b82-8357-f0e6f237dc4f tempest-FloatingIPsNegativeTestJSON-1707624756 tempest-FloatingIPsNegativeTestJSON-1707624756-project] Request method failure captured: Aug 24 10:13:11.319854 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-floating-ips/e6cb967c-8637-4087-9a1e-b32c9b14ddf4 HTTP/1.1 Aug 24 10:13:11.319854 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:13:11.319854 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:13:11.319854 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:13:11.319854 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:13:11.319854 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:13:11.319854 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:13:11.319854 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:13:11.319854 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:11.319854 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfm2sqn0mIuAOIzi1eID7CVecjtRPT-9TQLgxa8CDkBNfw_Ybrfp_ryNlvVrfyNN8cjHLBa80xjv-exJ86F0RPPdXcziMDSoRzpbtSOrFHs3LOC_2WUUQYlaO3HB3Pwfn6OXfkm_QlkWolUxAaO9gCmnR4jvsmdFzyWSymEv81qk-Ug Aug 24 10:13:11.319854 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:13:11.319854 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:13:11.319854 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:13:11.319854 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:13:11.319854 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:13:11.319854 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:13:11.319854 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: f7a5b3da7c3744a9bb75300512b8db71 Aug 24 10:13:11.319854 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1707624756 Aug 24 10:13:11.319854 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:13:11.319854 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:13:11.322308 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7a5b3da7c3744a9bb75300512b8db71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f7a5b3da7c3744a9bb75300512b8db71", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7a5b3da7c3744a9bb75300512b8db71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f7a5b3da7c3744a9bb75300512b8db71"}]}] Aug 24 10:13:11.322308 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1707624756 Aug 24 10:13:11.322308 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: f7a5b3da7c3744a9bb75300512b8db71 Aug 24 10:13:11.322308 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1707624756 Aug 24 10:13:11.322308 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-FloatingIPsNegativeTestJSON-1707624756-project Aug 24 10:13:11.322308 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:13:11.322308 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:13:11.322308 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: fdbf82c655c5452b8969310a6e1aa307 Aug 24 10:13:11.322308 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1707624756-project Aug 24 10:13:11.322308 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:13:11.322308 n-d-849328-3 devstack@n-api.service[122433]: exception: Floating IP not found for ID e6cb967c-8637-4087-9a1e-b32c9b14ddf4 Aug 24 10:13:11.322308 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'e6cb967c-8637-4087-9a1e-b32c9b14ddf4'} Aug 24 10:13:11.322308 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:11.323745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:11.323745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 24 10:13:11.323745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 24 10:13:11.323745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:13:11.323745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:13:11.323745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 24 10:13:11.323745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 24 10:13:11.323745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:13:11.323745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:13:11.323745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 10:13:11.323745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 10:13:11.323745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:13:11.323745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:13:11.323745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 10:13:11.323745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 10:13:11.323745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:13:11.323745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:13:11.323745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 10:13:11.323745 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 10:13:11.325889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:13:11.325889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:13:11.325889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 10:13:11.325889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 10:13:11.325889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 10:13:11.325889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 10:13:11.325889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e6cb967c-8637-4087-9a1e-b32c9b14ddf4 could not be found Aug 24 10:13:11.325889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-421fcef0-cb9a-4cf5-ab0e-dfa16e6b39e8'] Aug 24 10:13:11.325889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:11.325889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:11.325889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:11.325889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:11.325889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 24 10:13:11.325889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 24 10:13:11.325889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 24 10:13:11.325889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 24 10:13:11.325889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e6cb967c-8637-4087-9a1e-b32c9b14ddf4. Aug 24 10:13:11.325889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:11.325889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:11.325889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:11.327428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:11.327428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:11.327428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:11.327428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:11.327428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:11.327428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:13:11.327428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:13:11.327428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:11.327428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:11.327428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 24 10:13:11.327428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 10:13:11.327428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e6cb967c-8637-4087-9a1e-b32c9b14ddf4 Aug 24 10:13:11.327428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:11.327428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:11.327428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:11.327428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:11.327428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:11.327428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:11.327428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:13:11.327428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:13:11.334543 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e6cb967c-8637-4087-9a1e-b32c9b14ddf4 Aug 24 10:13:11.334543 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:11.334543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9defbe82-cfc4-4b82-8357-f0e6f237dc4f tempest-FloatingIPsNegativeTestJSON-1707624756 tempest-FloatingIPsNegativeTestJSON-1707624756-project] Returning 404 to user: Floating IP not found for ID e6cb967c-8637-4087-9a1e-b32c9b14ddf4 {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:11.334543 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9defbe82-cfc4-4b82-8357-f0e6f237dc4f tempest-FloatingIPsNegativeTestJSON-1707624756 tempest-FloatingIPsNegativeTestJSON-1707624756-project] 10.222.0.85 "DELETE /compute/v2.1/os-floating-ips/e6cb967c-8637-4087-9a1e-b32c9b14ddf4" status: 404 len: 111 microversion: 2.1 time: 0.116954 Aug 24 10:13:11.334543 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 315/608] 10.222.0.85 () {58 vars in 1263 bytes} [Wed Aug 24 10:13:11 2022] DELETE /compute/v2.1/os-floating-ips/e6cb967c-8637-4087-9a1e-b32c9b14ddf4 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:13:11.344567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-82457b7a-39c8-425f-bc26-6343d30f7532 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:11.350168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-82457b7a-39c8-425f-bc26-6343d30f7532 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:11.385026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82457b7a-39c8-425f-bc26-6343d30f7532 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:11.385586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82457b7a-39c8-425f-bc26-6343d30f7532 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:11.386047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82457b7a-39c8-425f-bc26-6343d30f7532 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:11.388806 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cd4f4255-9a9c-4c9b-8346-7b562b67a20e tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 2049 microversion: 2.25 time: 0.363340 Aug 24 10:13:11.400252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82457b7a-39c8-425f-bc26-6343d30f7532 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:11.401935 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82457b7a-39c8-425f-bc26-6343d30f7532 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:11.403323 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82457b7a-39c8-425f-bc26-6343d30f7532 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:11.407619 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 294/609] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:13:11 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 2049 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:13:11.420127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4de2a058-ee66-4853-a50d-5295c2ac9792 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:11.420800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4de2a058-ee66-4853-a50d-5295c2ac9792 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 322e4dd7-c596-41d1-94a4-7bdd711f3ebf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:11.430457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4de2a058-ee66-4853-a50d-5295c2ac9792 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:11.431015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4de2a058-ee66-4853-a50d-5295c2ac9792 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:11.431449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4de2a058-ee66-4853-a50d-5295c2ac9792 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:11.433937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4de2a058-ee66-4853-a50d-5295c2ac9792 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:11.434413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4de2a058-ee66-4853-a50d-5295c2ac9792 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:11.434845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4de2a058-ee66-4853-a50d-5295c2ac9792 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:11.812034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4de2a058-ee66-4853-a50d-5295c2ac9792 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:11.832466 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4de2a058-ee66-4853-a50d-5295c2ac9792 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf" status: 200 len: 1318 microversion: 2.1 time: 0.420786 Aug 24 10:13:11.833333 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 295/610] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:11 2022] GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf => generated 1318 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:11.842038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4480478f-e828-4312-89c6-104d4e3cae8d tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:11.842821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4480478f-e828-4312-89c6-104d4e3cae8d tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:11.852535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4480478f-e828-4312-89c6-104d4e3cae8d tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:11.853716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4480478f-e828-4312-89c6-104d4e3cae8d tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:11.854343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4480478f-e828-4312-89c6-104d4e3cae8d tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:11.855252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4480478f-e828-4312-89c6-104d4e3cae8d tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:11.856159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4480478f-e828-4312-89c6-104d4e3cae8d tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:11.858838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4480478f-e828-4312-89c6-104d4e3cae8d tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:12.060542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-82457b7a-39c8-425f-bc26-6343d30f7532 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:12.069705 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-82457b7a-39c8-425f-bc26-6343d30f7532 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1477 microversion: 2.1 time: 0.745865 Aug 24 10:13:12.073918 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 316/611] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:11 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1477 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:12.086515 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fe9fac91-9cb7-4629-a18f-0ea7fdab28d0 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:12.089044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fe9fac91-9cb7-4629-a18f-0ea7fdab28d0 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 2706bbd7-7fe1-4441-a716-a35246a87268] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:12.106302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe9fac91-9cb7-4629-a18f-0ea7fdab28d0 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:12.110338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe9fac91-9cb7-4629-a18f-0ea7fdab28d0 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:12.111207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe9fac91-9cb7-4629-a18f-0ea7fdab28d0 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:12.112111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe9fac91-9cb7-4629-a18f-0ea7fdab28d0 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:12.112778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe9fac91-9cb7-4629-a18f-0ea7fdab28d0 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:12.114129 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe9fac91-9cb7-4629-a18f-0ea7fdab28d0 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:12.152400 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-fe9fac91-9cb7-4629-a18f-0ea7fdab28d0 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] HTTP exception thrown: Instance 2706bbd7-7fe1-4441-a716-a35246a87268 could not be found. Aug 24 10:13:12.154446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fe9fac91-9cb7-4629-a18f-0ea7fdab28d0 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Request method failure captured: Aug 24 10:13:12.154446 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268 HTTP/1.1 Aug 24 10:13:12.154446 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:13:12.154446 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:13:12.154446 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:13:12.154446 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:13:12.154446 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:13:12.154446 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:13:12.154446 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:13:12.154446 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:12.154446 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfltMlassGauW2joSSY9GPq4QzYSVq06g_75gQuUSjHwXRkRUOaWbR5QacX5i3bcOkH0MdLyn6hxFumSOz3Oa6dtxLf6mdwu7IdynGYhTDAQUbcUgAATOl-3ssTBrMjQ5H0lxe3-j3bz-Z-SkNgYqR0NVLTrSEH-GFgkL8dBT4dnGIE Aug 24 10:13:12.154446 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:13:12.154446 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:13:12.154446 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:13:12.154446 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:13:12.154446 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:13:12.154446 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:13:12.154446 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 12902eb1fd734a189ec5f04a051b30b6 Aug 24 10:13:12.154446 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1265935849 Aug 24 10:13:12.154446 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:13:12.154446 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:13:12.155844 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/12902eb1fd734a189ec5f04a051b30b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_12902eb1fd734a189ec5f04a051b30b6", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/12902eb1fd734a189ec5f04a051b30b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/12902eb1fd734a189ec5f04a051b30b6"}]}] Aug 24 10:13:12.155844 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-DeleteServersAdminTestJSON-1265935849 Aug 24 10:13:12.155844 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 12902eb1fd734a189ec5f04a051b30b6 Aug 24 10:13:12.155844 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1265935849 Aug 24 10:13:12.155844 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-DeleteServersAdminTestJSON-1265935849-project Aug 24 10:13:12.155844 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:13:12.155844 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:13:12.155844 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 4cd5610642144fb0b7915285aafc0099 Aug 24 10:13:12.155844 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-DeleteServersAdminTestJSON-1265935849-project Aug 24 10:13:12.155844 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:13:12.155844 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 2706bbd7-7fe1-4441-a716-a35246a87268 could not be found. Aug 24 10:13:12.155844 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '2706bbd7-7fe1-4441-a716-a35246a87268'} Aug 24 10:13:12.156673 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:12.156673 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:12.156673 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:13:12.156673 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:13:12.156673 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:13:12.156673 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:13:12.156673 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:13:12.156673 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:13:12.156673 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:13:12.156673 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:13:12.156673 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2706bbd7-7fe1-4441-a716-a35246a87268 could not be found. Aug 24 10:13:12.156673 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:12.156673 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:12.156673 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:12.156673 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:12.156673 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:12.156673 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:12.156673 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:12.156673 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:12.156673 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:12.158029 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:12.158029 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:13:12.158029 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:13:12.158029 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:13:12.158029 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:13:12.158029 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:13:12.158029 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:13:12.158029 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2706bbd7-7fe1-4441-a716-a35246a87268 could not be found. Aug 24 10:13:12.158029 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:12.158029 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:12.158029 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:12.158029 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:12.158029 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:12.158029 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:12.158029 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:13:12.158029 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:13:12.158029 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2706bbd7-7fe1-4441-a716-a35246a87268 could not be found. Aug 24 10:13:12.158029 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:12.159235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fe9fac91-9cb7-4629-a18f-0ea7fdab28d0 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Returning 404 to user: Instance 2706bbd7-7fe1-4441-a716-a35246a87268 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:12.159235 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fe9fac91-9cb7-4629-a18f-0ea7fdab28d0 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268" status: 404 len: 111 microversion: 2.1 time: 0.078771 Aug 24 10:13:12.171345 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 317/612] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:12 2022] GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:13:12.179570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-536309e1-c2f4-46b8-8227-fbb14a2c72bc req-74be9335-b8fa-45ca-91d6-2932e7c5c67d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "322e4dd7-c596-41d1-94a4-7bdd711f3ebf", "name": "network-vif-plugged", "status": "completed", "tag": "1932e7da-337e-470e-8ae5-6f500b4e8a39"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:12.211110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-536309e1-c2f4-46b8-8227-fbb14a2c72bc req-74be9335-b8fa-45ca-91d6-2932e7c5c67d service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:12.216866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-536309e1-c2f4-46b8-8227-fbb14a2c72bc req-74be9335-b8fa-45ca-91d6-2932e7c5c67d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:12.217590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-536309e1-c2f4-46b8-8227-fbb14a2c72bc req-74be9335-b8fa-45ca-91d6-2932e7c5c67d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:12.244903 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-536309e1-c2f4-46b8-8227-fbb14a2c72bc req-74be9335-b8fa-45ca-91d6-2932e7c5c67d service nova] Creating event network-vif-plugged:1932e7da-337e-470e-8ae5-6f500b4e8a39 for instance 322e4dd7-c596-41d1-94a4-7bdd711f3ebf on n-h2-849328-3 Aug 24 10:13:12.261671 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-536309e1-c2f4-46b8-8227-fbb14a2c72bc req-74be9335-b8fa-45ca-91d6-2932e7c5c67d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088858 Aug 24 10:13:12.267575 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 318/613] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:13:12.273667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-70e0aa3b-2aba-493b-9d77-5b46b5865101 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:12.279347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-70e0aa3b-2aba-493b-9d77-5b46b5865101 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 2706bbd7-7fe1-4441-a716-a35246a87268] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:12.299364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70e0aa3b-2aba-493b-9d77-5b46b5865101 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:12.300956 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70e0aa3b-2aba-493b-9d77-5b46b5865101 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:12.301587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70e0aa3b-2aba-493b-9d77-5b46b5865101 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:12.305484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70e0aa3b-2aba-493b-9d77-5b46b5865101 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:12.306103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70e0aa3b-2aba-493b-9d77-5b46b5865101 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:12.306643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70e0aa3b-2aba-493b-9d77-5b46b5865101 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:12.359212 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-70e0aa3b-2aba-493b-9d77-5b46b5865101 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] HTTP exception thrown: Instance 2706bbd7-7fe1-4441-a716-a35246a87268 could not be found. Aug 24 10:13:12.361912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-70e0aa3b-2aba-493b-9d77-5b46b5865101 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Request method failure captured: Aug 24 10:13:12.361912 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268 HTTP/1.1 Aug 24 10:13:12.361912 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:13:12.361912 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:13:12.361912 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:13:12.361912 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:13:12.361912 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:13:12.361912 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:13:12.361912 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:13:12.361912 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:12.361912 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfltMlassGauW2joSSY9GPq4QzYSVq06g_75gQuUSjHwXRkRUOaWbR5QacX5i3bcOkH0MdLyn6hxFumSOz3Oa6dtxLf6mdwu7IdynGYhTDAQUbcUgAATOl-3ssTBrMjQ5H0lxe3-j3bz-Z-SkNgYqR0NVLTrSEH-GFgkL8dBT4dnGIE Aug 24 10:13:12.361912 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:13:12.361912 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:13:12.361912 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:13:12.361912 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:13:12.361912 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:13:12.361912 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:13:12.361912 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 12902eb1fd734a189ec5f04a051b30b6 Aug 24 10:13:12.361912 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1265935849 Aug 24 10:13:12.361912 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:13:12.361912 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:13:12.363424 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/12902eb1fd734a189ec5f04a051b30b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_12902eb1fd734a189ec5f04a051b30b6", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/12902eb1fd734a189ec5f04a051b30b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/12902eb1fd734a189ec5f04a051b30b6"}]}] Aug 24 10:13:12.363424 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-DeleteServersAdminTestJSON-1265935849 Aug 24 10:13:12.363424 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 12902eb1fd734a189ec5f04a051b30b6 Aug 24 10:13:12.363424 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1265935849 Aug 24 10:13:12.363424 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-DeleteServersAdminTestJSON-1265935849-project Aug 24 10:13:12.363424 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:13:12.363424 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:13:12.363424 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 4cd5610642144fb0b7915285aafc0099 Aug 24 10:13:12.363424 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-DeleteServersAdminTestJSON-1265935849-project Aug 24 10:13:12.363424 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:13:12.363424 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 2706bbd7-7fe1-4441-a716-a35246a87268 could not be found. Aug 24 10:13:12.363424 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '2706bbd7-7fe1-4441-a716-a35246a87268'} Aug 24 10:13:12.364257 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:12.364257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:12.364257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:13:12.364257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:13:12.364257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:13:12.364257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:13:12.364257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:13:12.364257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:13:12.364257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:13:12.364257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:13:12.364257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2706bbd7-7fe1-4441-a716-a35246a87268 could not be found. Aug 24 10:13:12.364257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:12.364257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:12.364257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:12.364257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:12.364257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:12.364257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:12.364257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:12.364257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:12.364257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:12.365631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:12.365631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:13:12.365631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:13:12.365631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:13:12.365631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:13:12.365631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:13:12.365631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:13:12.365631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:13:12.365631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:13:12.365631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2706bbd7-7fe1-4441-a716-a35246a87268 could not be found. Aug 24 10:13:12.365631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:12.365631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:12.365631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:12.365631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:12.365631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:12.365631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:12.365631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:13:12.365631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:13:12.365631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2706bbd7-7fe1-4441-a716-a35246a87268 could not be found. Aug 24 10:13:12.365631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:12.367750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-70e0aa3b-2aba-493b-9d77-5b46b5865101 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Returning 404 to user: Instance 2706bbd7-7fe1-4441-a716-a35246a87268 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:12.368918 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-70e0aa3b-2aba-493b-9d77-5b46b5865101 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "DELETE /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268" status: 404 len: 111 microversion: 2.1 time: 0.099911 Aug 24 10:13:12.369681 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 319/614] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:13:12 2022] DELETE /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:13:12.383226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ae0ac0b4-3ee6-4566-aa7f-b6116e78d7d9 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:12.384182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ae0ac0b4-3ee6-4566-aa7f-b6116e78d7d9 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 2706bbd7-7fe1-4441-a716-a35246a87268] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:12.399578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae0ac0b4-3ee6-4566-aa7f-b6116e78d7d9 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:12.400346 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae0ac0b4-3ee6-4566-aa7f-b6116e78d7d9 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:12.400945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae0ac0b4-3ee6-4566-aa7f-b6116e78d7d9 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:12.401862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae0ac0b4-3ee6-4566-aa7f-b6116e78d7d9 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:12.409150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae0ac0b4-3ee6-4566-aa7f-b6116e78d7d9 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:12.409894 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae0ac0b4-3ee6-4566-aa7f-b6116e78d7d9 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:12.428105 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-ae0ac0b4-3ee6-4566-aa7f-b6116e78d7d9 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] HTTP exception thrown: Instance 2706bbd7-7fe1-4441-a716-a35246a87268 could not be found. Aug 24 10:13:12.431215 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ae0ac0b4-3ee6-4566-aa7f-b6116e78d7d9 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Request method failure captured: Aug 24 10:13:12.431215 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268 HTTP/1.1 Aug 24 10:13:12.431215 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:13:12.431215 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:13:12.431215 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:13:12.431215 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:13:12.431215 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:13:12.431215 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:13:12.431215 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:13:12.431215 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:12.431215 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfltMlassGauW2joSSY9GPq4QzYSVq06g_75gQuUSjHwXRkRUOaWbR5QacX5i3bcOkH0MdLyn6hxFumSOz3Oa6dtxLf6mdwu7IdynGYhTDAQUbcUgAATOl-3ssTBrMjQ5H0lxe3-j3bz-Z-SkNgYqR0NVLTrSEH-GFgkL8dBT4dnGIE Aug 24 10:13:12.431215 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:13:12.431215 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:13:12.431215 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:13:12.431215 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:13:12.431215 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:13:12.431215 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:13:12.431215 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 12902eb1fd734a189ec5f04a051b30b6 Aug 24 10:13:12.431215 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1265935849 Aug 24 10:13:12.431215 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:13:12.431215 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:13:12.432654 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/12902eb1fd734a189ec5f04a051b30b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_12902eb1fd734a189ec5f04a051b30b6", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/12902eb1fd734a189ec5f04a051b30b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/12902eb1fd734a189ec5f04a051b30b6"}]}] Aug 24 10:13:12.432654 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-DeleteServersAdminTestJSON-1265935849 Aug 24 10:13:12.432654 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 12902eb1fd734a189ec5f04a051b30b6 Aug 24 10:13:12.432654 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1265935849 Aug 24 10:13:12.432654 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-DeleteServersAdminTestJSON-1265935849-project Aug 24 10:13:12.432654 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:13:12.432654 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:13:12.432654 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 4cd5610642144fb0b7915285aafc0099 Aug 24 10:13:12.432654 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-DeleteServersAdminTestJSON-1265935849-project Aug 24 10:13:12.432654 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:13:12.432654 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 2706bbd7-7fe1-4441-a716-a35246a87268 could not be found. Aug 24 10:13:12.432654 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '2706bbd7-7fe1-4441-a716-a35246a87268'} Aug 24 10:13:12.433430 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:12.433430 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:12.433430 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:13:12.433430 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:13:12.433430 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:13:12.433430 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:13:12.433430 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:13:12.433430 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:13:12.433430 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:13:12.433430 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:13:12.433430 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2706bbd7-7fe1-4441-a716-a35246a87268 could not be found. Aug 24 10:13:12.433430 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:12.433430 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:12.433430 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:12.433430 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:12.433430 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:12.433430 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:12.433430 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:12.433430 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:12.433430 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:12.434797 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:12.434797 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:13:12.434797 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:13:12.434797 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:13:12.434797 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:13:12.434797 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:13:12.434797 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:13:12.434797 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2706bbd7-7fe1-4441-a716-a35246a87268 could not be found. Aug 24 10:13:12.434797 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:12.434797 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:12.434797 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:12.434797 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:12.434797 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:12.434797 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:12.434797 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:13:12.434797 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:13:12.434797 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2706bbd7-7fe1-4441-a716-a35246a87268 could not be found. Aug 24 10:13:12.434797 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:12.437761 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ae0ac0b4-3ee6-4566-aa7f-b6116e78d7d9 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Returning 404 to user: Instance 2706bbd7-7fe1-4441-a716-a35246a87268 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:12.438846 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ae0ac0b4-3ee6-4566-aa7f-b6116e78d7d9 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268" status: 404 len: 111 microversion: 2.1 time: 0.063740 Aug 24 10:13:12.439763 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 320/615] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:12 2022] GET /compute/v2.1/servers/2706bbd7-7fe1-4441-a716-a35246a87268 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:13:12.450480 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-577ea7da-ab6a-42c5-aa3f-7fdface03d3e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:12.451410 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-577ea7da-ab6a-42c5-aa3f-7fdface03d3e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 9c47edc7-c2c0-43d3-a96a-b779f1d0723c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:12.460556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-577ea7da-ab6a-42c5-aa3f-7fdface03d3e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:12.461488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-577ea7da-ab6a-42c5-aa3f-7fdface03d3e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:12.462121 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-577ea7da-ab6a-42c5-aa3f-7fdface03d3e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:12.463060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-577ea7da-ab6a-42c5-aa3f-7fdface03d3e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:12.463734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-577ea7da-ab6a-42c5-aa3f-7fdface03d3e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:12.464389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-577ea7da-ab6a-42c5-aa3f-7fdface03d3e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:12.483661 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-577ea7da-ab6a-42c5-aa3f-7fdface03d3e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] HTTP exception thrown: Instance 9c47edc7-c2c0-43d3-a96a-b779f1d0723c could not be found. Aug 24 10:13:12.486260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-577ea7da-ab6a-42c5-aa3f-7fdface03d3e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Request method failure captured: Aug 24 10:13:12.486260 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c HTTP/1.1 Aug 24 10:13:12.486260 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:13:12.486260 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:13:12.486260 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:13:12.486260 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:13:12.486260 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:13:12.486260 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:13:12.486260 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:13:12.486260 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:12.486260 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfltMlassGauW2joSSY9GPq4QzYSVq06g_75gQuUSjHwXRkRUOaWbR5QacX5i3bcOkH0MdLyn6hxFumSOz3Oa6dtxLf6mdwu7IdynGYhTDAQUbcUgAATOl-3ssTBrMjQ5H0lxe3-j3bz-Z-SkNgYqR0NVLTrSEH-GFgkL8dBT4dnGIE Aug 24 10:13:12.486260 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:13:12.486260 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:13:12.486260 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:13:12.486260 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:13:12.486260 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:13:12.486260 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:13:12.486260 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 12902eb1fd734a189ec5f04a051b30b6 Aug 24 10:13:12.486260 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1265935849 Aug 24 10:13:12.486260 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:13:12.486260 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:13:12.487638 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/12902eb1fd734a189ec5f04a051b30b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_12902eb1fd734a189ec5f04a051b30b6", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/12902eb1fd734a189ec5f04a051b30b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/12902eb1fd734a189ec5f04a051b30b6"}]}] Aug 24 10:13:12.487638 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-DeleteServersAdminTestJSON-1265935849 Aug 24 10:13:12.487638 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 12902eb1fd734a189ec5f04a051b30b6 Aug 24 10:13:12.487638 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1265935849 Aug 24 10:13:12.487638 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-DeleteServersAdminTestJSON-1265935849-project Aug 24 10:13:12.487638 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:13:12.487638 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:13:12.487638 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 4cd5610642144fb0b7915285aafc0099 Aug 24 10:13:12.487638 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-DeleteServersAdminTestJSON-1265935849-project Aug 24 10:13:12.487638 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:13:12.487638 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 9c47edc7-c2c0-43d3-a96a-b779f1d0723c could not be found. Aug 24 10:13:12.487638 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '9c47edc7-c2c0-43d3-a96a-b779f1d0723c'} Aug 24 10:13:12.488469 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:12.488469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:12.488469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:13:12.488469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:13:12.488469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:13:12.488469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:13:12.488469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:13:12.488469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:13:12.488469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:13:12.488469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:13:12.488469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c47edc7-c2c0-43d3-a96a-b779f1d0723c could not be found. Aug 24 10:13:12.488469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:12.488469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:12.488469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:12.488469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:12.488469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:12.488469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:12.488469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:12.488469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:12.488469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:12.489742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:12.489742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:13:12.489742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:13:12.489742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:13:12.489742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:13:12.489742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:13:12.489742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:13:12.489742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:13:12.489742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:13:12.489742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c47edc7-c2c0-43d3-a96a-b779f1d0723c could not be found. Aug 24 10:13:12.489742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:12.489742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:12.489742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:12.489742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:12.489742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:12.489742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:12.489742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:13:12.489742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:13:12.489742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c47edc7-c2c0-43d3-a96a-b779f1d0723c could not be found. Aug 24 10:13:12.489742 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:12.493188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-577ea7da-ab6a-42c5-aa3f-7fdface03d3e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Returning 404 to user: Instance 9c47edc7-c2c0-43d3-a96a-b779f1d0723c could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:12.494407 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-577ea7da-ab6a-42c5-aa3f-7fdface03d3e tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "DELETE /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c" status: 404 len: 111 microversion: 2.1 time: 0.049435 Aug 24 10:13:12.495503 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 321/616] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:13:12 2022] DELETE /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:13:12.505717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2f39ea67-62ba-4a83-991f-af8af4216971 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:12.507015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2f39ea67-62ba-4a83-991f-af8af4216971 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] [instance: 9c47edc7-c2c0-43d3-a96a-b779f1d0723c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:12.515488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f39ea67-62ba-4a83-991f-af8af4216971 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:12.516413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f39ea67-62ba-4a83-991f-af8af4216971 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:12.517417 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f39ea67-62ba-4a83-991f-af8af4216971 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:12.518363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f39ea67-62ba-4a83-991f-af8af4216971 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:12.519016 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f39ea67-62ba-4a83-991f-af8af4216971 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:12.519638 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f39ea67-62ba-4a83-991f-af8af4216971 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:12.538938 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-2f39ea67-62ba-4a83-991f-af8af4216971 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] HTTP exception thrown: Instance 9c47edc7-c2c0-43d3-a96a-b779f1d0723c could not be found. Aug 24 10:13:12.544410 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2f39ea67-62ba-4a83-991f-af8af4216971 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Request method failure captured: Aug 24 10:13:12.544410 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c HTTP/1.1 Aug 24 10:13:12.544410 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:13:12.544410 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:13:12.544410 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:13:12.544410 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:13:12.544410 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:13:12.544410 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:13:12.544410 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:13:12.544410 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:12.544410 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfltMlassGauW2joSSY9GPq4QzYSVq06g_75gQuUSjHwXRkRUOaWbR5QacX5i3bcOkH0MdLyn6hxFumSOz3Oa6dtxLf6mdwu7IdynGYhTDAQUbcUgAATOl-3ssTBrMjQ5H0lxe3-j3bz-Z-SkNgYqR0NVLTrSEH-GFgkL8dBT4dnGIE Aug 24 10:13:12.544410 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:13:12.544410 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:13:12.544410 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:13:12.544410 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:13:12.544410 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:13:12.544410 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:13:12.544410 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 12902eb1fd734a189ec5f04a051b30b6 Aug 24 10:13:12.544410 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1265935849 Aug 24 10:13:12.544410 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:13:12.544410 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:13:12.545863 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/12902eb1fd734a189ec5f04a051b30b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_12902eb1fd734a189ec5f04a051b30b6", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/12902eb1fd734a189ec5f04a051b30b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/12902eb1fd734a189ec5f04a051b30b6"}]}] Aug 24 10:13:12.545863 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-DeleteServersAdminTestJSON-1265935849 Aug 24 10:13:12.545863 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 12902eb1fd734a189ec5f04a051b30b6 Aug 24 10:13:12.545863 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1265935849 Aug 24 10:13:12.545863 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-DeleteServersAdminTestJSON-1265935849-project Aug 24 10:13:12.545863 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:13:12.545863 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:13:12.545863 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 4cd5610642144fb0b7915285aafc0099 Aug 24 10:13:12.545863 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-DeleteServersAdminTestJSON-1265935849-project Aug 24 10:13:12.545863 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:13:12.545863 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 9c47edc7-c2c0-43d3-a96a-b779f1d0723c could not be found. Aug 24 10:13:12.545863 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '9c47edc7-c2c0-43d3-a96a-b779f1d0723c'} Aug 24 10:13:12.546553 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:12.546553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:12.546553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:13:12.546553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:13:12.546553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:13:12.546553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:13:12.546553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:13:12.546553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:13:12.546553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:13:12.546553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:13:12.546553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c47edc7-c2c0-43d3-a96a-b779f1d0723c could not be found. Aug 24 10:13:12.546553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:12.546553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:12.546553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:12.546553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:12.546553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:12.546553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:12.546553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:12.546553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:12.546553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:12.547766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:12.547766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:13:12.547766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:13:12.547766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:13:12.547766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:13:12.547766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:13:12.547766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:13:12.547766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c47edc7-c2c0-43d3-a96a-b779f1d0723c could not be found. Aug 24 10:13:12.547766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:12.547766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:12.547766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:12.547766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:12.547766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:12.547766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:12.547766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:13:12.547766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:13:12.547766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c47edc7-c2c0-43d3-a96a-b779f1d0723c could not be found. Aug 24 10:13:12.547766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:12.550748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2f39ea67-62ba-4a83-991f-af8af4216971 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] Returning 404 to user: Instance 9c47edc7-c2c0-43d3-a96a-b779f1d0723c could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:12.551852 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2f39ea67-62ba-4a83-991f-af8af4216971 tempest-DeleteServersAdminTestJSON-1265935849 tempest-DeleteServersAdminTestJSON-1265935849-project] 10.222.0.85 "GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c" status: 404 len: 111 microversion: 2.1 time: 0.051897 Aug 24 10:13:12.553396 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 322/617] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:12 2022] GET /compute/v2.1/servers/9c47edc7-c2c0-43d3-a96a-b779f1d0723c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:13:12.861777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-193a3528-a598-49dd-ac10-e20e9f6d11c0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:12.862499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-193a3528-a598-49dd-ac10-e20e9f6d11c0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 322e4dd7-c596-41d1-94a4-7bdd711f3ebf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:12.878547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-193a3528-a598-49dd-ac10-e20e9f6d11c0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:12.884629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-193a3528-a598-49dd-ac10-e20e9f6d11c0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:12.885403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-193a3528-a598-49dd-ac10-e20e9f6d11c0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:12.886527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-193a3528-a598-49dd-ac10-e20e9f6d11c0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:12.888936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-193a3528-a598-49dd-ac10-e20e9f6d11c0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:12.889770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-193a3528-a598-49dd-ac10-e20e9f6d11c0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:13.201919 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-4480478f-e828-4312-89c6-104d4e3cae8d tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lazy-loading 'services' on Instance uuid 26944760-9a04-4f1a-8d41-148a947f41f1 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:13:13.241264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-193a3528-a598-49dd-ac10-e20e9f6d11c0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:13.242348 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4480478f-e828-4312-89c6-104d4e3cae8d tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 2049 microversion: 2.25 time: 1.401982 Aug 24 10:13:13.257401 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 296/618] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:13:11 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 2049 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:13:13.266218 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-193a3528-a598-49dd-ac10-e20e9f6d11c0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf" status: 200 len: 1318 microversion: 2.1 time: 0.412677 Aug 24 10:13:13.266872 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 323/619] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:12 2022] GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf => generated 1318 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:13.271878 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9326f8c9-0cab-4e96-a1fa-2e2cbfd71e9f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:13.274813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9326f8c9-0cab-4e96-a1fa-2e2cbfd71e9f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:13.289436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2bc5f493-3e7d-4179-b6bc-bb5ca06742d6 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:13.291705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9326f8c9-0cab-4e96-a1fa-2e2cbfd71e9f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:13.292294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9326f8c9-0cab-4e96-a1fa-2e2cbfd71e9f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:13.294324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9326f8c9-0cab-4e96-a1fa-2e2cbfd71e9f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:13.299109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9326f8c9-0cab-4e96-a1fa-2e2cbfd71e9f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:13.299338 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:13:13.299338 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:13:13.300913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bc5f493-3e7d-4179-b6bc-bb5ca06742d6 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:13.301462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bc5f493-3e7d-4179-b6bc-bb5ca06742d6 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:13.302322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bc5f493-3e7d-4179-b6bc-bb5ca06742d6 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:13.303099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bc5f493-3e7d-4179-b6bc-bb5ca06742d6 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:13.306683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bc5f493-3e7d-4179-b6bc-bb5ca06742d6 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:13.307277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9326f8c9-0cab-4e96-a1fa-2e2cbfd71e9f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:13.307738 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9326f8c9-0cab-4e96-a1fa-2e2cbfd71e9f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:13.311757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bc5f493-3e7d-4179-b6bc-bb5ca06742d6 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:13.342597 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2bc5f493-3e7d-4179-b6bc-bb5ca06742d6 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] 10.222.0.85 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.060658 Aug 24 10:13:13.351937 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 324/620] 10.222.0.85 () {60 vars in 1217 bytes} [Wed Aug 24 10:13:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 10:13:13.356664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8219773d-cc6b-4e2b-be9f-e5ea8e07c6d4 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:13.357509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8219773d-cc6b-4e2b-be9f-e5ea8e07c6d4 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:13.366765 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:13.373534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8219773d-cc6b-4e2b-be9f-e5ea8e07c6d4 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:13.375516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8219773d-cc6b-4e2b-be9f-e5ea8e07c6d4 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:13.376378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8219773d-cc6b-4e2b-be9f-e5ea8e07c6d4 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:13.377594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8219773d-cc6b-4e2b-be9f-e5ea8e07c6d4 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:13.378284 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8219773d-cc6b-4e2b-be9f-e5ea8e07c6d4 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:13.378929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8219773d-cc6b-4e2b-be9f-e5ea8e07c6d4 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:13.590690 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8219773d-cc6b-4e2b-be9f-e5ea8e07c6d4 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1/action" status: 202 len: 0 microversion: 2.25 time: 0.237814 Aug 24 10:13:13.591412 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 325/621] 10.222.0.85 () {62 vars in 1319 bytes} [Wed Aug 24 10:13:13 2022] POST /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:13:13.964393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-376cd93e-d377-49a7-b535-24985e8be158 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1008968641", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "6a3a952d-cb92-48d6-ae25-c71db979b739"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:14.097095 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-376cd93e-d377-49a7-b535-24985e8be158 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] validate_networks() for [('6a3a952d-cb92-48d6-ae25-c71db979b739', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:13:14.209420 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9326f8c9-0cab-4e96-a1fa-2e2cbfd71e9f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:14.226724 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9326f8c9-0cab-4e96-a1fa-2e2cbfd71e9f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1477 microversion: 2.1 time: 0.967907 Aug 24 10:13:14.236393 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 297/622] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:13 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1477 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:14.261337 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f045e1ad-a0c3-4eef-b892-226dfe84a36e tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:14.261983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f045e1ad-a0c3-4eef-b892-226dfe84a36e tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:14.277759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f045e1ad-a0c3-4eef-b892-226dfe84a36e tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:14.278752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f045e1ad-a0c3-4eef-b892-226dfe84a36e tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:14.282175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f045e1ad-a0c3-4eef-b892-226dfe84a36e tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:14.282935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f045e1ad-a0c3-4eef-b892-226dfe84a36e tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:14.283581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f045e1ad-a0c3-4eef-b892-226dfe84a36e tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:14.284357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f045e1ad-a0c3-4eef-b892-226dfe84a36e tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:14.674305 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-f045e1ad-a0c3-4eef-b892-226dfe84a36e tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lazy-loading 'services' on Instance uuid 26944760-9a04-4f1a-8d41-148a947f41f1 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:13:14.690959 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f045e1ad-a0c3-4eef-b892-226dfe84a36e tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 2034 microversion: 2.25 time: 0.453160 Aug 24 10:13:14.692294 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 298/623] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:13:14 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 2034 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:13:14.697224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bfe3fc89-4343-41b0-9152-e1432f6b2d25 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:14.698651 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bfe3fc89-4343-41b0-9152-e1432f6b2d25 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 322e4dd7-c596-41d1-94a4-7bdd711f3ebf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:14.710483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfe3fc89-4343-41b0-9152-e1432f6b2d25 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:14.711522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfe3fc89-4343-41b0-9152-e1432f6b2d25 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:14.712589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfe3fc89-4343-41b0-9152-e1432f6b2d25 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:14.713650 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfe3fc89-4343-41b0-9152-e1432f6b2d25 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:14.714258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfe3fc89-4343-41b0-9152-e1432f6b2d25 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:14.714871 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfe3fc89-4343-41b0-9152-e1432f6b2d25 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:14.910211 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bfe3fc89-4343-41b0-9152-e1432f6b2d25 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:14.929048 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bfe3fc89-4343-41b0-9152-e1432f6b2d25 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf" status: 200 len: 1468 microversion: 2.1 time: 0.235229 Aug 24 10:13:14.929924 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 299/624] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:14 2022] GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf => generated 1468 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:14.934645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-edd3cbed-4f03-434c-9eee-fd97e91c40d4 req-296b0171-8fa5-41fe-9fbe-c2490c22d16f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d8befca-2013-4597-a7e7-e12100a340db", "name": "network-vif-plugged", "status": "completed", "tag": "bde82519-9f50-4430-9cd1-5bca12e6e002"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:14.947014 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-edd3cbed-4f03-434c-9eee-fd97e91c40d4 req-296b0171-8fa5-41fe-9fbe-c2490c22d16f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:14.947778 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-edd3cbed-4f03-434c-9eee-fd97e91c40d4 req-296b0171-8fa5-41fe-9fbe-c2490c22d16f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:14.948361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-edd3cbed-4f03-434c-9eee-fd97e91c40d4 req-296b0171-8fa5-41fe-9fbe-c2490c22d16f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:14.963220 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-edd3cbed-4f03-434c-9eee-fd97e91c40d4 req-296b0171-8fa5-41fe-9fbe-c2490c22d16f service nova] Creating event network-vif-plugged:bde82519-9f50-4430-9cd1-5bca12e6e002 for instance 1d8befca-2013-4597-a7e7-e12100a340db on n-h1-849328-3 Aug 24 10:13:14.970796 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-edd3cbed-4f03-434c-9eee-fd97e91c40d4 req-296b0171-8fa5-41fe-9fbe-c2490c22d16f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039438 Aug 24 10:13:14.971996 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 300/625] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:13:14.975620 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-376cd93e-d377-49a7-b535-24985e8be158 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:13:14.976119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-376cd93e-d377-49a7-b535-24985e8be158 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:13:14.977541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-376cd93e-d377-49a7-b535-24985e8be158 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:13:14.978083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-376cd93e-d377-49a7-b535-24985e8be158 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:13:14.978867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-376cd93e-d377-49a7-b535-24985e8be158 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:13:14.980925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0a525696-462b-4f17-a12a-e3eb83c517dc tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-849328-3", "block_migration": "auto"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:14.983637 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0a525696-462b-4f17-a12a-e3eb83c517dc tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:14.992617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376cd93e-d377-49a7-b535-24985e8be158 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:14.993224 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376cd93e-d377-49a7-b535-24985e8be158 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:14.993741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376cd93e-d377-49a7-b535-24985e8be158 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:14.994590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376cd93e-d377-49a7-b535-24985e8be158 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:14.995554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a525696-462b-4f17-a12a-e3eb83c517dc tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:14.995884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376cd93e-d377-49a7-b535-24985e8be158 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:14.996092 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a525696-462b-4f17-a12a-e3eb83c517dc tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:14.996533 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a525696-462b-4f17-a12a-e3eb83c517dc tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:14.997374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a525696-462b-4f17-a12a-e3eb83c517dc tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:14.997629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376cd93e-d377-49a7-b535-24985e8be158 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:14.999205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a525696-462b-4f17-a12a-e3eb83c517dc tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:15.000078 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a525696-462b-4f17-a12a-e3eb83c517dc tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:15.089222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-376cd93e-d377-49a7-b535-24985e8be158 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Getting quotas for project 67b25f29b4a141f4b45518dba7332c3c. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:13:15.092274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-0a525696-462b-4f17-a12a-e3eb83c517dc tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lazy-loading 'flavor' on Instance uuid 26944760-9a04-4f1a-8d41-148a947f41f1 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:13:15.101909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-376cd93e-d377-49a7-b535-24985e8be158 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Getting quotas for user c969980c07dd44b49d7ef299858fe109 and project 67b25f29b4a141f4b45518dba7332c3c. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:13:15.112220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0a525696-462b-4f17-a12a-e3eb83c517dc tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Going to try to live migrate instance to n-h2-849328-3 {{(pid=122432) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 10:13:15.148209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-376cd93e-d377-49a7-b535-24985e8be158 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:13:15.150892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-376cd93e-d377-49a7-b535-24985e8be158 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:13:15.164144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:15.284634 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-376cd93e-d377-49a7-b535-24985e8be158 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.688616 Aug 24 10:13:15.290760 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 326/626] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:13:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:13:15.308499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1766e8b0-4976-447d-a93f-0d43e3fb05c0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:15.314884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1766e8b0-4976-447d-a93f-0d43e3fb05c0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 1d8befca-2013-4597-a7e7-e12100a340db] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:15.342844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1766e8b0-4976-447d-a93f-0d43e3fb05c0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:15.358161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1766e8b0-4976-447d-a93f-0d43e3fb05c0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:15.360528 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1766e8b0-4976-447d-a93f-0d43e3fb05c0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:15.362804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1766e8b0-4976-447d-a93f-0d43e3fb05c0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:15.363247 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1766e8b0-4976-447d-a93f-0d43e3fb05c0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:15.363685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1766e8b0-4976-447d-a93f-0d43e3fb05c0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:15.824020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1766e8b0-4976-447d-a93f-0d43e3fb05c0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:15.849764 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1766e8b0-4976-447d-a93f-0d43e3fb05c0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/1d8befca-2013-4597-a7e7-e12100a340db" status: 200 len: 1318 microversion: 2.1 time: 0.555550 Aug 24 10:13:15.856999 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 327/627] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:15 2022] GET /compute/v2.1/servers/1d8befca-2013-4597-a7e7-e12100a340db => generated 1318 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:15.862499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de0cf0d3-81a3-4b0a-851e-268612c0a70d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:15.874077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-de0cf0d3-81a3-4b0a-851e-268612c0a70d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:15.881995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de0cf0d3-81a3-4b0a-851e-268612c0a70d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:15.882894 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de0cf0d3-81a3-4b0a-851e-268612c0a70d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:15.884584 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de0cf0d3-81a3-4b0a-851e-268612c0a70d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:15.885542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de0cf0d3-81a3-4b0a-851e-268612c0a70d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:15.886770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de0cf0d3-81a3-4b0a-851e-268612c0a70d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:15.887716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de0cf0d3-81a3-4b0a-851e-268612c0a70d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:16.216904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-de0cf0d3-81a3-4b0a-851e-268612c0a70d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:16.237991 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-de0cf0d3-81a3-4b0a-851e-268612c0a70d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1477 microversion: 2.1 time: 0.379005 Aug 24 10:13:16.239277 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 328/628] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:15 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1477 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:16.244359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cac70d98-3900-416e-8eae-caa22cafe06e tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:16.245424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cac70d98-3900-416e-8eae-caa22cafe06e tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:16.334896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cac70d98-3900-416e-8eae-caa22cafe06e tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:16.347070 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cac70d98-3900-416e-8eae-caa22cafe06e tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159" status: 200 len: 1224 microversion: 2.1 time: 0.106236 Aug 24 10:13:16.357785 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 329/629] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:16 2022] GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159 => generated 1224 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:16.895551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a5bab200-a36f-432d-9630-b2d47bac809f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:16.896164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a5bab200-a36f-432d-9630-b2d47bac809f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 1d8befca-2013-4597-a7e7-e12100a340db] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:16.906585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5bab200-a36f-432d-9630-b2d47bac809f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:16.907098 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5bab200-a36f-432d-9630-b2d47bac809f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:16.907538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5bab200-a36f-432d-9630-b2d47bac809f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:16.908257 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5bab200-a36f-432d-9630-b2d47bac809f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:16.908709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5bab200-a36f-432d-9630-b2d47bac809f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:16.909143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5bab200-a36f-432d-9630-b2d47bac809f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:17.172160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a5bab200-a36f-432d-9630-b2d47bac809f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:17.188707 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a5bab200-a36f-432d-9630-b2d47bac809f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/1d8befca-2013-4597-a7e7-e12100a340db" status: 200 len: 1318 microversion: 2.1 time: 0.296946 Aug 24 10:13:17.189422 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 330/630] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:16 2022] GET /compute/v2.1/servers/1d8befca-2013-4597-a7e7-e12100a340db => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:13:17.269091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e9988d67-5e2c-4c2a-b7f2-b4657e3bf68a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:17.270542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e9988d67-5e2c-4c2a-b7f2-b4657e3bf68a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:17.295044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9988d67-5e2c-4c2a-b7f2-b4657e3bf68a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:17.296199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9988d67-5e2c-4c2a-b7f2-b4657e3bf68a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:17.296665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9988d67-5e2c-4c2a-b7f2-b4657e3bf68a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:17.298331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9988d67-5e2c-4c2a-b7f2-b4657e3bf68a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:17.298815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9988d67-5e2c-4c2a-b7f2-b4657e3bf68a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:17.299498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9988d67-5e2c-4c2a-b7f2-b4657e3bf68a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:17.759842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e9988d67-5e2c-4c2a-b7f2-b4657e3bf68a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:17.769177 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e9988d67-5e2c-4c2a-b7f2-b4657e3bf68a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1477 microversion: 2.1 time: 0.513315 Aug 24 10:13:17.782937 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 331/631] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:17 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1477 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:17.788145 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8575b952-d336-4951-a074-1660c1ec1366 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:17.788766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8575b952-d336-4951-a074-1660c1ec1366 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:17.805643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8575b952-d336-4951-a074-1660c1ec1366 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:17.806338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8575b952-d336-4951-a074-1660c1ec1366 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:17.806934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8575b952-d336-4951-a074-1660c1ec1366 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:17.809009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8575b952-d336-4951-a074-1660c1ec1366 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:17.810669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8575b952-d336-4951-a074-1660c1ec1366 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:17.811270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8575b952-d336-4951-a074-1660c1ec1366 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:17.941649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8575b952-d336-4951-a074-1660c1ec1366 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:17.973863 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8575b952-d336-4951-a074-1660c1ec1366 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159" status: 200 len: 1276 microversion: 2.1 time: 0.188782 Aug 24 10:13:17.978078 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 332/632] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:17 2022] GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159 => generated 1276 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:18.217680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d038c59a-b51e-48c9-837a-c1da86724453 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:18.219002 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d038c59a-b51e-48c9-837a-c1da86724453 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 1d8befca-2013-4597-a7e7-e12100a340db] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:18.239665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d038c59a-b51e-48c9-837a-c1da86724453 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:18.243729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d038c59a-b51e-48c9-837a-c1da86724453 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:18.244779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d038c59a-b51e-48c9-837a-c1da86724453 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:18.246009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d038c59a-b51e-48c9-837a-c1da86724453 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:18.249392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d038c59a-b51e-48c9-837a-c1da86724453 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:18.250192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d038c59a-b51e-48c9-837a-c1da86724453 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:18.271005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:18.963031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d038c59a-b51e-48c9-837a-c1da86724453 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:18.971865 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d038c59a-b51e-48c9-837a-c1da86724453 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/1d8befca-2013-4597-a7e7-e12100a340db" status: 200 len: 1468 microversion: 2.1 time: 0.761995 Aug 24 10:13:18.985660 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 333/633] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:18 2022] GET /compute/v2.1/servers/1d8befca-2013-4597-a7e7-e12100a340db => generated 1468 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:19.299741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4f11ea86-2782-493b-a858-bf9f05af1e6d tempest-FlavorsAccessTestJSON-1489530859 tempest-FlavorsAccessTestJSON-1489530859-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-161284037", "id": 176922448, "os-flavor-access:is_public": "False"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:19.311406 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:13:19.311406 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:13:19.360889 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4f11ea86-2782-493b-a858-bf9f05af1e6d tempest-FlavorsAccessTestJSON-1489530859 tempest-FlavorsAccessTestJSON-1489530859-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.369023 Aug 24 10:13:19.362118 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 334/634] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:13:18 2022] POST /compute/v2.1/flavors => generated 427 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:13:19.387422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0002db9c-d8ef-4ce8-b223-33d2a61dc984 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:19.388456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0002db9c-d8ef-4ce8-b223-33d2a61dc984 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:19.397411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0002db9c-d8ef-4ce8-b223-33d2a61dc984 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:19.398443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0002db9c-d8ef-4ce8-b223-33d2a61dc984 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:19.399094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0002db9c-d8ef-4ce8-b223-33d2a61dc984 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:19.400279 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0002db9c-d8ef-4ce8-b223-33d2a61dc984 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:19.402821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0002db9c-d8ef-4ce8-b223-33d2a61dc984 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:19.403652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0002db9c-d8ef-4ce8-b223-33d2a61dc984 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:19.799148 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0a525696-462b-4f17-a12a-e3eb83c517dc tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1/action" status: 202 len: 0 microversion: 2.25 time: 4.825314 Aug 24 10:13:19.805310 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 301/635] 10.222.0.85 () {62 vars in 1319 bytes} [Wed Aug 24 10:13:14 2022] POST /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1/action => generated 0 bytes in 4832 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:13:19.827158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2f6e413b-fa1c-41de-b11a-f497a49e08f3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:19.847153 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2f6e413b-fa1c-41de-b11a-f497a49e08f3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:19.849750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2f6e413b-fa1c-41de-b11a-f497a49e08f3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Searching by: {'reservation_id': 'r-eykqwmke', 'deleted': False, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:13:19.899047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f6e413b-fa1c-41de-b11a-f497a49e08f3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:19.901282 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f6e413b-fa1c-41de-b11a-f497a49e08f3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:19.903492 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f6e413b-fa1c-41de-b11a-f497a49e08f3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:19.905762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f6e413b-fa1c-41de-b11a-f497a49e08f3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:19.907238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f6e413b-fa1c-41de-b11a-f497a49e08f3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:19.909961 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f6e413b-fa1c-41de-b11a-f497a49e08f3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:20.127660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-2f6e413b-fa1c-41de-b11a-f497a49e08f3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:13:20.299204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2f6e413b-fa1c-41de-b11a-f497a49e08f3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:20.308246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f6e413b-fa1c-41de-b11a-f497a49e08f3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:20.308951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f6e413b-fa1c-41de-b11a-f497a49e08f3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:20.309627 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f6e413b-fa1c-41de-b11a-f497a49e08f3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:20.460747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0002db9c-d8ef-4ce8-b223-33d2a61dc984 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:20.480342 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0002db9c-d8ef-4ce8-b223-33d2a61dc984 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1476 microversion: 2.1 time: 1.113366 Aug 24 10:13:20.481579 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 335/636] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:19 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1476 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:20.503375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-35115233-4dd2-4017-aefa-ec2a69d9ad3b tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:20.506132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-35115233-4dd2-4017-aefa-ec2a69d9ad3b tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:20.522938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35115233-4dd2-4017-aefa-ec2a69d9ad3b tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:20.523652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35115233-4dd2-4017-aefa-ec2a69d9ad3b tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:20.524407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35115233-4dd2-4017-aefa-ec2a69d9ad3b tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:20.525874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35115233-4dd2-4017-aefa-ec2a69d9ad3b tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:20.526512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35115233-4dd2-4017-aefa-ec2a69d9ad3b tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:20.526938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35115233-4dd2-4017-aefa-ec2a69d9ad3b tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:20.837109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-35115233-4dd2-4017-aefa-ec2a69d9ad3b tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:20.849039 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-35115233-4dd2-4017-aefa-ec2a69d9ad3b tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159" status: 200 len: 1324 microversion: 2.1 time: 0.365257 Aug 24 10:13:20.850305 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 336/637] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:20 2022] GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159 => generated 1324 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:20.857350 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-e3dfeacd-cd7d-4c96-83e3-dd805e964638 req-e1813a0a-4326-4ed1-a0da-78836418898e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f", "name": "network-vif-unplugged", "status": "completed", "tag": "29c5a4d8-1573-48ff-8439-153b2e7ce8e8"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:20.868989 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e3dfeacd-cd7d-4c96-83e3-dd805e964638 req-e1813a0a-4326-4ed1-a0da-78836418898e service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:20.870303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e3dfeacd-cd7d-4c96-83e3-dd805e964638 req-e1813a0a-4326-4ed1-a0da-78836418898e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:20.871532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e3dfeacd-cd7d-4c96-83e3-dd805e964638 req-e1813a0a-4326-4ed1-a0da-78836418898e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:20.887843 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-e3dfeacd-cd7d-4c96-83e3-dd805e964638 req-e1813a0a-4326-4ed1-a0da-78836418898e service nova] Creating event network-vif-unplugged:29c5a4d8-1573-48ff-8439-153b2e7ce8e8 for instance a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f on n-h1-849328-3 Aug 24 10:13:20.898976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-e3dfeacd-cd7d-4c96-83e3-dd805e964638 req-e1813a0a-4326-4ed1-a0da-78836418898e service nova] Instance a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 10:13:20.912951 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-e3dfeacd-cd7d-4c96-83e3-dd805e964638 req-e1813a0a-4326-4ed1-a0da-78836418898e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061013 Aug 24 10:13:20.914424 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 337/638] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:13:20.920274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec3ac66f-5906-4be1-ac82-1274cbe265df tempest-FlavorsAccessTestJSON-1489530859 tempest-FlavorsAccessTestJSON-1489530859-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b8cab2e1f6114ef9ba44695f4e4fc285"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:20.931894 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:13:20.931894 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:13:21.057310 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ec3ac66f-5906-4be1-ac82-1274cbe265df tempest-FlavorsAccessTestJSON-1489530859 tempest-FlavorsAccessTestJSON-1489530859-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors/176922448/action" status: 200 len: 96 microversion: 2.1 time: 0.141246 Aug 24 10:13:21.058352 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 338/639] 10.222.0.85 () {60 vars in 1197 bytes} [Wed Aug 24 10:13:20 2022] POST /compute/v2.1/flavors/176922448/action => generated 96 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:13:21.064158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-52e40421-8cbf-4099-bccf-ced0525a8d6f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:21.065403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-52e40421-8cbf-4099-bccf-ced0525a8d6f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:21.068769 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2f6e413b-fa1c-41de-b11a-f497a49e08f3 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/detail?reservation_id=r-eykqwmke" status: 200 len: 2929 microversion: 2.1 time: 1.260286 Aug 24 10:13:21.069621 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 302/640] 10.222.0.85 () {58 vars in 1197 bytes} [Wed Aug 24 10:13:19 2022] GET /compute/v2.1/servers/detail?reservation_id=r-eykqwmke => generated 2929 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:21.074348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52e40421-8cbf-4099-bccf-ced0525a8d6f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:21.075062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52e40421-8cbf-4099-bccf-ced0525a8d6f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:21.075658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52e40421-8cbf-4099-bccf-ced0525a8d6f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:21.076992 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52e40421-8cbf-4099-bccf-ced0525a8d6f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:21.077630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52e40421-8cbf-4099-bccf-ced0525a8d6f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:21.078547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52e40421-8cbf-4099-bccf-ced0525a8d6f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:21.275638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-183d433a-c39a-4589-a88f-8e4d6ca662be tempest-FlavorsAccessTestJSON-922068039 tempest-FlavorsAccessTestJSON-922068039-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:21.302709 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-183d433a-c39a-4589-a88f-8e4d6ca662be tempest-FlavorsAccessTestJSON-922068039 tempest-FlavorsAccessTestJSON-922068039-project] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 6231 microversion: 2.1 time: 0.218894 Aug 24 10:13:21.303870 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 303/641] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:13:21 2022] GET /compute/v2.1/flavors/detail => generated 6231 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:21.308855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2e563bb1-1fd6-4ec6-89b7-b1ac7f0941a1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:21.332725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:21.339276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-52e40421-8cbf-4099-bccf-ced0525a8d6f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:21.342646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.compute.server_groups [None req-2e563bb1-1fd6-4ec6-89b7-b1ac7f0941a1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Querying cell e852a9c4-5bbb-4a78-aec0-794708e7e59e(cell1) for 2 instances {{(pid=122432) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 24 10:13:21.343489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e563bb1-1fd6-4ec6-89b7-b1ac7f0941a1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:21.344729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e563bb1-1fd6-4ec6-89b7-b1ac7f0941a1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:21.345384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e563bb1-1fd6-4ec6-89b7-b1ac7f0941a1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:21.352850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-52e40421-8cbf-4099-bccf-ced0525a8d6f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:21.355444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-52e40421-8cbf-4099-bccf-ced0525a8d6f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:21.357700 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-52e40421-8cbf-4099-bccf-ced0525a8d6f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 1567 microversion: 2.25 time: 0.297829 Aug 24 10:13:21.358836 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 339/642] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:13:21 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 1567 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:13:21.364138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-162dc8d8-3bef-43b7-a022-ae27e842cbf0 tempest-FlavorsAccessTestJSON-1489530859 tempest-FlavorsAccessTestJSON-1489530859-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b8cab2e1f6114ef9ba44695f4e4fc285"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:21.367216 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:13:21.367216 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:13:21.394959 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2e563bb1-1fd6-4ec6-89b7-b1ac7f0941a1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/os-server-groups/0115a7d1-f8a0-4ba5-806f-009c686ef65c" status: 200 len: 271 microversion: 2.1 time: 0.089921 Aug 24 10:13:21.396538 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 304/643] 10.222.0.85 () {58 vars in 1263 bytes} [Wed Aug 24 10:13:21 2022] GET /compute/v2.1/os-server-groups/0115a7d1-f8a0-4ba5-806f-009c686ef65c => generated 271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:13:21.408280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-87fbe258-4af6-4fba-9dd9-61b37c7ed0cd tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:21.409717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-87fbe258-4af6-4fba-9dd9-61b37c7ed0cd tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] [instance: 1d8befca-2013-4597-a7e7-e12100a340db] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:21.417278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87fbe258-4af6-4fba-9dd9-61b37c7ed0cd tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:21.417871 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87fbe258-4af6-4fba-9dd9-61b37c7ed0cd tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:21.418344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87fbe258-4af6-4fba-9dd9-61b37c7ed0cd tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:21.419093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87fbe258-4af6-4fba-9dd9-61b37c7ed0cd tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:21.419865 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87fbe258-4af6-4fba-9dd9-61b37c7ed0cd tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:21.420531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87fbe258-4af6-4fba-9dd9-61b37c7ed0cd tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:21.605631 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-162dc8d8-3bef-43b7-a022-ae27e842cbf0 tempest-FlavorsAccessTestJSON-1489530859 tempest-FlavorsAccessTestJSON-1489530859-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors/176922448/action" status: 200 len: 21 microversion: 2.1 time: 0.244706 Aug 24 10:13:21.608446 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 340/644] 10.222.0.85 () {60 vars in 1197 bytes} [Wed Aug 24 10:13:21 2022] POST /compute/v2.1/flavors/176922448/action => generated 21 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:13:21.615283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2b262eb0-48f9-4f62-81e1-08ed67fafd74 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:21.616553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2b262eb0-48f9-4f62-81e1-08ed67fafd74 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:21.627651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b262eb0-48f9-4f62-81e1-08ed67fafd74 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:21.628934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b262eb0-48f9-4f62-81e1-08ed67fafd74 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:21.630080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b262eb0-48f9-4f62-81e1-08ed67fafd74 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:21.631106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b262eb0-48f9-4f62-81e1-08ed67fafd74 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:21.631976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b262eb0-48f9-4f62-81e1-08ed67fafd74 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:21.632565 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b262eb0-48f9-4f62-81e1-08ed67fafd74 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:21.800023 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-87fbe258-4af6-4fba-9dd9-61b37c7ed0cd tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/1d8befca-2013-4597-a7e7-e12100a340db" status: 200 len: 1619 microversion: 2.1 time: 0.395798 Aug 24 10:13:21.800638 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 305/645] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:21 2022] GET /compute/v2.1/servers/1d8befca-2013-4597-a7e7-e12100a340db => generated 1619 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:13:21.817931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ea74bb7c-e3ba-4190-aacc-6a72f22df202 tempest-FlavorsAccessTestJSON-922068039 tempest-FlavorsAccessTestJSON-922068039-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:21.837292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2b262eb0-48f9-4f62-81e1-08ed67fafd74 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:21.851988 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2b262eb0-48f9-4f62-81e1-08ed67fafd74 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1476 microversion: 2.1 time: 0.241760 Aug 24 10:13:21.853087 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 341/646] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:21 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1476 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:21.854205 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ea74bb7c-e3ba-4190-aacc-6a72f22df202 tempest-FlavorsAccessTestJSON-922068039 tempest-FlavorsAccessTestJSON-922068039-project] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.048304 Aug 24 10:13:21.858599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b6825335-3b2c-4035-9d7c-fae08bdddbee tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:21.859865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b6825335-3b2c-4035-9d7c-fae08bdddbee tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] [instance: 322e4dd7-c596-41d1-94a4-7bdd711f3ebf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:21.870534 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 306/647] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:13:21 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:21.871037 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6825335-3b2c-4035-9d7c-fae08bdddbee tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:21.871543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6825335-3b2c-4035-9d7c-fae08bdddbee tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:21.871978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6825335-3b2c-4035-9d7c-fae08bdddbee tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:21.872686 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6825335-3b2c-4035-9d7c-fae08bdddbee tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:21.873161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6825335-3b2c-4035-9d7c-fae08bdddbee tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:21.873587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6825335-3b2c-4035-9d7c-fae08bdddbee tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:21.876895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-402bbdb5-549d-408a-9784-9a7754fd501f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:21.877719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-402bbdb5-549d-408a-9784-9a7754fd501f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:21.884459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-402bbdb5-549d-408a-9784-9a7754fd501f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:21.885107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-402bbdb5-549d-408a-9784-9a7754fd501f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:21.885725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-402bbdb5-549d-408a-9784-9a7754fd501f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:21.887297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-402bbdb5-549d-408a-9784-9a7754fd501f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:21.888112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-402bbdb5-549d-408a-9784-9a7754fd501f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:21.888684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-402bbdb5-549d-408a-9784-9a7754fd501f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:22.062718 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b6825335-3b2c-4035-9d7c-fae08bdddbee tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf" status: 200 len: 1619 microversion: 2.1 time: 0.208084 Aug 24 10:13:22.063399 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 342/648] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:21 2022] GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf => generated 1619 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:22.073431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-30c88169-27e9-4b01-a090-24e8816ce8ff tempest-FlavorsAccessTestJSON-1489530859 tempest-FlavorsAccessTestJSON-1489530859-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:22.075060 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:13:22.075060 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:13:22.103352 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-30c88169-27e9-4b01-a090-24e8816ce8ff tempest-FlavorsAccessTestJSON-1489530859 tempest-FlavorsAccessTestJSON-1489530859-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/176922448" status: 202 len: 0 microversion: 2.1 time: 0.036485 Aug 24 10:13:22.105227 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 343/649] 10.222.0.85 () {58 vars in 1158 bytes} [Wed Aug 24 10:13:22 2022] DELETE /compute/v2.1/flavors/176922448 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:13:22.120752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c1d92eb3-6897-4a3b-b4be-4b5b403bf5be tempest-FlavorsAccessTestJSON-1489530859 tempest-FlavorsAccessTestJSON-1489530859-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:22.175554 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c1d92eb3-6897-4a3b-b4be-4b5b403bf5be tempest-FlavorsAccessTestJSON-1489530859 tempest-FlavorsAccessTestJSON-1489530859-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.061941 Aug 24 10:13:22.177726 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 344/650] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:13:22 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:22.197584 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-814bbe72-b9c1-40e6-9125-4f292613aeb0 tempest-FlavorsAccessTestJSON-1489530859 tempest-FlavorsAccessTestJSON-1489530859-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-850335160", "id": 1094770210, "os-flavor-access:is_public": "False"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:22.201874 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:13:22.201874 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:13:22.221357 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-814bbe72-b9c1-40e6-9125-4f292613aeb0 tempest-FlavorsAccessTestJSON-1489530859 tempest-FlavorsAccessTestJSON-1489530859-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.027351 Aug 24 10:13:22.230487 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 345/651] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:13:22 2022] POST /compute/v2.1/flavors => generated 430 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:13:22.239411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-21aa8b35-32e3-49c6-8cff-1d64e81d786f tempest-FlavorsAccessTestJSON-1489530859 tempest-FlavorsAccessTestJSON-1489530859-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:22.241063 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:13:22.241063 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:13:22.263308 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-21aa8b35-32e3-49c6-8cff-1d64e81d786f tempest-FlavorsAccessTestJSON-1489530859 tempest-FlavorsAccessTestJSON-1489530859-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/1094770210/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.030908 Aug 24 10:13:22.271352 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 346/652] 10.222.0.85 () {58 vars in 1209 bytes} [Wed Aug 24 10:13:22 2022] GET /compute/v2.1/flavors/1094770210/os-flavor-access => generated 21 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:13:22.278364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-24d9809c-63b5-482e-a12d-dc7fd66c514d tempest-FlavorsAccessTestJSON-1489530859 tempest-FlavorsAccessTestJSON-1489530859-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:22.300162 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-24d9809c-63b5-482e-a12d-dc7fd66c514d tempest-FlavorsAccessTestJSON-1489530859 tempest-FlavorsAccessTestJSON-1489530859-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/1094770210" status: 202 len: 0 microversion: 2.1 time: 0.027235 Aug 24 10:13:22.300760 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 347/653] 10.222.0.85 () {58 vars in 1161 bytes} [Wed Aug 24 10:13:22 2022] DELETE /compute/v2.1/flavors/1094770210 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:13:22.306959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e5105926-b94d-4d4c-9931-43dfc415037c tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1437355961", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "c7ad4cc6-0ddc-47f9-b386-1e0dde47808f"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:22.383643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-e5105926-b94d-4d4c-9931-43dfc415037c tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:13:22.594388 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-402bbdb5-549d-408a-9784-9a7754fd501f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:22.610261 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-402bbdb5-549d-408a-9784-9a7754fd501f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159" status: 200 len: 1324 microversion: 2.1 time: 0.734723 Aug 24 10:13:22.611562 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 307/654] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:21 2022] GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159 => generated 1324 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:22.621961 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bba82802-0744-4670-9084-52b7f265caae tempest-FlavorsAccessTestJSON-1489530859 tempest-FlavorsAccessTestJSON-1489530859-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:22.666512 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bba82802-0744-4670-9084-52b7f265caae tempest-FlavorsAccessTestJSON-1489530859 tempest-FlavorsAccessTestJSON-1489530859-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.051571 Aug 24 10:13:22.667246 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 308/655] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:13:22 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:22.680380 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3b3ad4ee-41db-432e-990b-acbfc97f76f9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:22.682063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3b3ad4ee-41db-432e-990b-acbfc97f76f9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:22.699470 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b3ad4ee-41db-432e-990b-acbfc97f76f9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:22.700875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b3ad4ee-41db-432e-990b-acbfc97f76f9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:22.702051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b3ad4ee-41db-432e-990b-acbfc97f76f9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:22.703699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b3ad4ee-41db-432e-990b-acbfc97f76f9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:22.705089 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b3ad4ee-41db-432e-990b-acbfc97f76f9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:22.707278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b3ad4ee-41db-432e-990b-acbfc97f76f9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:22.750808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e5105926-b94d-4d4c-9931-43dfc415037c tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:13:22.751573 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e5105926-b94d-4d4c-9931-43dfc415037c tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:13:22.751739 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e5105926-b94d-4d4c-9931-43dfc415037c tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:13:22.752263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e5105926-b94d-4d4c-9931-43dfc415037c tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:13:22.752885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e5105926-b94d-4d4c-9931-43dfc415037c tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:13:22.780720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5105926-b94d-4d4c-9931-43dfc415037c tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:22.782343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5105926-b94d-4d4c-9931-43dfc415037c tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:22.785667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5105926-b94d-4d4c-9931-43dfc415037c tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:22.786658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5105926-b94d-4d4c-9931-43dfc415037c tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:22.789088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5105926-b94d-4d4c-9931-43dfc415037c tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:22.789869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5105926-b94d-4d4c-9931-43dfc415037c tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:22.820282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-e5105926-b94d-4d4c-9931-43dfc415037c tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:13:22.826937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-e5105926-b94d-4d4c-9931-43dfc415037c tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for user bf03c0eb5bd748ae85be830f1121dc06 and project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:13:22.840895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e5105926-b94d-4d4c-9931-43dfc415037c tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:13:22.844005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e5105926-b94d-4d4c-9931-43dfc415037c tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 38332901-4cb3-4475-90f4-48ad729f16c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:13:22.870737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=8,nova_api:DELETE=7 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:22.917022 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e5105926-b94d-4d4c-9931-43dfc415037c tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614826 Aug 24 10:13:22.917837 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 348/656] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:13:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:13:22.924449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7006680b-6380-478e-b8e8-f4cece53d279 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:22.925081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7006680b-6380-478e-b8e8-f4cece53d279 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:22.934388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7006680b-6380-478e-b8e8-f4cece53d279 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:22.935188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7006680b-6380-478e-b8e8-f4cece53d279 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:22.937902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7006680b-6380-478e-b8e8-f4cece53d279 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:22.939345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7006680b-6380-478e-b8e8-f4cece53d279 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:22.940342 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7006680b-6380-478e-b8e8-f4cece53d279 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:22.941007 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7006680b-6380-478e-b8e8-f4cece53d279 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:23.116017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3b3ad4ee-41db-432e-990b-acbfc97f76f9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:23.125306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3b3ad4ee-41db-432e-990b-acbfc97f76f9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:23.127007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3b3ad4ee-41db-432e-990b-acbfc97f76f9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:23.128391 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3b3ad4ee-41db-432e-990b-acbfc97f76f9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 1567 microversion: 2.25 time: 0.459976 Aug 24 10:13:23.141621 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 309/657] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:13:22 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 1567 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:13:23.153661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-575f3b2d-1ed7-4555-8591-50a78be386d1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:23.154304 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-575f3b2d-1ed7-4555-8591-50a78be386d1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 38332901-4cb3-4475-90f4-48ad729f16c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:23.157647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7006680b-6380-478e-b8e8-f4cece53d279 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:23.169776 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7006680b-6380-478e-b8e8-f4cece53d279 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1474 microversion: 2.1 time: 0.250054 Aug 24 10:13:23.170712 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 349/658] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:22 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1474 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:23.176523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-2c4e44a9-05de-490c-90a7-5a7f0177a912 req-802bdc30-f8d7-43cb-bb0e-b56e3bed4c9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f", "tag": "29c5a4d8-1573-48ff-8439-153b2e7ce8e8"}, {"name": "network-changed", "server_uuid": "c285a5a5-ba66-41c8-aa67-402e2d5f9159", "tag": "ad70c32a-b650-4c05-bd90-a010a57fd42f"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:23.193550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2c4e44a9-05de-490c-90a7-5a7f0177a912 req-802bdc30-f8d7-43cb-bb0e-b56e3bed4c9f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:23.194051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2c4e44a9-05de-490c-90a7-5a7f0177a912 req-802bdc30-f8d7-43cb-bb0e-b56e3bed4c9f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:23.194654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2c4e44a9-05de-490c-90a7-5a7f0177a912 req-802bdc30-f8d7-43cb-bb0e-b56e3bed4c9f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:23.210427 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-2c4e44a9-05de-490c-90a7-5a7f0177a912 req-802bdc30-f8d7-43cb-bb0e-b56e3bed4c9f service nova] Creating event network-changed:29c5a4d8-1573-48ff-8439-153b2e7ce8e8 for instance a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f on n-h1-849328-3 Aug 24 10:13:23.210799 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-2c4e44a9-05de-490c-90a7-5a7f0177a912 req-802bdc30-f8d7-43cb-bb0e-b56e3bed4c9f service nova] Creating event network-changed:ad70c32a-b650-4c05-bd90-a010a57fd42f for instance c285a5a5-ba66-41c8-aa67-402e2d5f9159 on n-h1-849328-3 Aug 24 10:13:23.220181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-2c4e44a9-05de-490c-90a7-5a7f0177a912 req-802bdc30-f8d7-43cb-bb0e-b56e3bed4c9f service nova] Instance a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 10:13:23.235704 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-2c4e44a9-05de-490c-90a7-5a7f0177a912 req-802bdc30-f8d7-43cb-bb0e-b56e3bed4c9f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.063347 Aug 24 10:13:23.236843 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 350/659] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:13:23.260937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-575f3b2d-1ed7-4555-8591-50a78be386d1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:23.274386 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-575f3b2d-1ed7-4555-8591-50a78be386d1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5" status: 200 len: 1217 microversion: 2.1 time: 0.131400 Aug 24 10:13:23.275594 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 310/660] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:23 2022] GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5 => generated 1217 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:23.645525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d216513d-54eb-4e0e-a838-1072b222f93c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:23.649791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d216513d-54eb-4e0e-a838-1072b222f93c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:23.673734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d216513d-54eb-4e0e-a838-1072b222f93c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:23.675116 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d216513d-54eb-4e0e-a838-1072b222f93c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:23.676669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d216513d-54eb-4e0e-a838-1072b222f93c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:23.681101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d216513d-54eb-4e0e-a838-1072b222f93c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:23.682164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d216513d-54eb-4e0e-a838-1072b222f93c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:23.683082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d216513d-54eb-4e0e-a838-1072b222f93c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:24.076552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d216513d-54eb-4e0e-a838-1072b222f93c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:24.087271 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d216513d-54eb-4e0e-a838-1072b222f93c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159" status: 200 len: 1324 microversion: 2.1 time: 0.455641 Aug 24 10:13:24.088289 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 351/661] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:23 2022] GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159 => generated 1324 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:13:24.158396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d006eae8-254b-489f-95c5-acc252470a90 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:24.160042 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d006eae8-254b-489f-95c5-acc252470a90 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:24.197018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-06e0991e-1e0f-4131-9021-148fb1c64916 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:24.197708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-06e0991e-1e0f-4131-9021-148fb1c64916 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:24.209812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06e0991e-1e0f-4131-9021-148fb1c64916 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:24.211982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06e0991e-1e0f-4131-9021-148fb1c64916 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:24.212813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06e0991e-1e0f-4131-9021-148fb1c64916 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:24.214586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06e0991e-1e0f-4131-9021-148fb1c64916 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:24.216545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06e0991e-1e0f-4131-9021-148fb1c64916 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:24.218575 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06e0991e-1e0f-4131-9021-148fb1c64916 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:24.453248 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d006eae8-254b-489f-95c5-acc252470a90 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:24.454206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d006eae8-254b-489f-95c5-acc252470a90 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:24.455202 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d006eae8-254b-489f-95c5-acc252470a90 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:24.456340 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d006eae8-254b-489f-95c5-acc252470a90 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:24.457002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d006eae8-254b-489f-95c5-acc252470a90 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:24.458017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d006eae8-254b-489f-95c5-acc252470a90 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:24.572056 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-06e0991e-1e0f-4131-9021-148fb1c64916 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:24.599593 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-06e0991e-1e0f-4131-9021-148fb1c64916 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1474 microversion: 2.1 time: 0.407540 Aug 24 10:13:24.600478 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 352/662] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:24 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1474 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:24.621748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e9e1ad55-bc00-4ade-bb94-1a944e808175 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:24.622633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e9e1ad55-bc00-4ade-bb94-1a944e808175 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 38332901-4cb3-4475-90f4-48ad729f16c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:24.632412 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9e1ad55-bc00-4ade-bb94-1a944e808175 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:24.635220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9e1ad55-bc00-4ade-bb94-1a944e808175 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:24.637093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9e1ad55-bc00-4ade-bb94-1a944e808175 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:24.638369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9e1ad55-bc00-4ade-bb94-1a944e808175 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:24.640683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9e1ad55-bc00-4ade-bb94-1a944e808175 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:24.641337 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9e1ad55-bc00-4ade-bb94-1a944e808175 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:24.784591 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e9e1ad55-bc00-4ade-bb94-1a944e808175 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:24.802760 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e9e1ad55-bc00-4ade-bb94-1a944e808175 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5" status: 200 len: 1277 microversion: 2.1 time: 0.195750 Aug 24 10:13:24.803905 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 353/663] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:24 2022] GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5 => generated 1277 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:24.969636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d006eae8-254b-489f-95c5-acc252470a90 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:24.985020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d006eae8-254b-489f-95c5-acc252470a90 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:24.987407 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d006eae8-254b-489f-95c5-acc252470a90 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:24.989044 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d006eae8-254b-489f-95c5-acc252470a90 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 1567 microversion: 2.25 time: 0.837656 Aug 24 10:13:24.989825 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 311/664] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:13:24 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 1567 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:13:25.117746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a600315c-e175-4f0d-b9a5-e52d38dcaa78 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:25.119151 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a600315c-e175-4f0d-b9a5-e52d38dcaa78 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:25.132855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a600315c-e175-4f0d-b9a5-e52d38dcaa78 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:25.133979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a600315c-e175-4f0d-b9a5-e52d38dcaa78 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:25.134705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a600315c-e175-4f0d-b9a5-e52d38dcaa78 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:25.135989 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a600315c-e175-4f0d-b9a5-e52d38dcaa78 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:25.136978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a600315c-e175-4f0d-b9a5-e52d38dcaa78 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:25.137897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a600315c-e175-4f0d-b9a5-e52d38dcaa78 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:25.262892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-bf5124b6-42e5-41e6-bdc6-86a59bb5251a req-a8c1b7a7-220e-4d06-8ba8-a15082b9f571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26944760-9a04-4f1a-8d41-148a947f41f1", "name": "network-vif-unplugged", "status": "completed", "tag": "3139e3fc-0583-464d-9f47-1476780c5e66"}, {"name": "network-changed", "server_uuid": "26944760-9a04-4f1a-8d41-148a947f41f1", "tag": "3139e3fc-0583-464d-9f47-1476780c5e66"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:25.279530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-bf5124b6-42e5-41e6-bdc6-86a59bb5251a req-a8c1b7a7-220e-4d06-8ba8-a15082b9f571 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:25.281602 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-bf5124b6-42e5-41e6-bdc6-86a59bb5251a req-a8c1b7a7-220e-4d06-8ba8-a15082b9f571 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:25.282373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-bf5124b6-42e5-41e6-bdc6-86a59bb5251a req-a8c1b7a7-220e-4d06-8ba8-a15082b9f571 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:25.298245 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-bf5124b6-42e5-41e6-bdc6-86a59bb5251a req-a8c1b7a7-220e-4d06-8ba8-a15082b9f571 service nova] Creating event network-vif-unplugged:3139e3fc-0583-464d-9f47-1476780c5e66 for instance 26944760-9a04-4f1a-8d41-148a947f41f1 on n-h1-849328-3 Aug 24 10:13:25.299296 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-bf5124b6-42e5-41e6-bdc6-86a59bb5251a req-a8c1b7a7-220e-4d06-8ba8-a15082b9f571 service nova] Creating event network-changed:3139e3fc-0583-464d-9f47-1476780c5e66 for instance 26944760-9a04-4f1a-8d41-148a947f41f1 on n-h1-849328-3 Aug 24 10:13:25.309071 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-bf5124b6-42e5-41e6-bdc6-86a59bb5251a req-a8c1b7a7-220e-4d06-8ba8-a15082b9f571 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.051477 Aug 24 10:13:25.310386 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 312/665] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:13:25.624381 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-69d54402-15bb-4d91-89cd-52ed61e9c5b1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:25.625719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-69d54402-15bb-4d91-89cd-52ed61e9c5b1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:25.644720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69d54402-15bb-4d91-89cd-52ed61e9c5b1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:25.648068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69d54402-15bb-4d91-89cd-52ed61e9c5b1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:25.648707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69d54402-15bb-4d91-89cd-52ed61e9c5b1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:25.649788 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69d54402-15bb-4d91-89cd-52ed61e9c5b1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:25.653793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69d54402-15bb-4d91-89cd-52ed61e9c5b1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:25.654745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69d54402-15bb-4d91-89cd-52ed61e9c5b1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:25.752815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a600315c-e175-4f0d-b9a5-e52d38dcaa78 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:25.777267 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a600315c-e175-4f0d-b9a5-e52d38dcaa78 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159" status: 200 len: 1324 microversion: 2.1 time: 0.663624 Aug 24 10:13:25.778311 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 354/666] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:25 2022] GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159 => generated 1324 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:25.837759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-db0feed9-2f99-4c58-a07d-74a2172d5026 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:25.838727 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-db0feed9-2f99-4c58-a07d-74a2172d5026 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 38332901-4cb3-4475-90f4-48ad729f16c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:25.846253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db0feed9-2f99-4c58-a07d-74a2172d5026 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:25.846786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db0feed9-2f99-4c58-a07d-74a2172d5026 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:25.847156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db0feed9-2f99-4c58-a07d-74a2172d5026 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:25.848297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db0feed9-2f99-4c58-a07d-74a2172d5026 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:25.849294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db0feed9-2f99-4c58-a07d-74a2172d5026 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:25.850503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db0feed9-2f99-4c58-a07d-74a2172d5026 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:26.491903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-69d54402-15bb-4d91-89cd-52ed61e9c5b1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:26.514619 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-69d54402-15bb-4d91-89cd-52ed61e9c5b1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1474 microversion: 2.1 time: 0.896645 Aug 24 10:13:26.515195 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 313/667] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:25 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1474 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:26.532891 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-938ea5c7-20f9-48d5-97ce-43761e9ce42d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:26.533877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-938ea5c7-20f9-48d5-97ce-43761e9ce42d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:26.553842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-938ea5c7-20f9-48d5-97ce-43761e9ce42d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:26.555687 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-938ea5c7-20f9-48d5-97ce-43761e9ce42d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:26.556458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-938ea5c7-20f9-48d5-97ce-43761e9ce42d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:26.558509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-938ea5c7-20f9-48d5-97ce-43761e9ce42d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:26.562347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-938ea5c7-20f9-48d5-97ce-43761e9ce42d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:26.563060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-938ea5c7-20f9-48d5-97ce-43761e9ce42d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:27.186702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-db0feed9-2f99-4c58-a07d-74a2172d5026 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:27.210985 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-db0feed9-2f99-4c58-a07d-74a2172d5026 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5" status: 200 len: 1317 microversion: 2.1 time: 1.377075 Aug 24 10:13:27.226231 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 355/668] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:25 2022] GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5 => generated 1317 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:27.255460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e609407f-1555-4dfe-b76d-f0d9ab6c8c85 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:27.256941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e609407f-1555-4dfe-b76d-f0d9ab6c8c85 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:27.273289 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e609407f-1555-4dfe-b76d-f0d9ab6c8c85 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:27.275401 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e609407f-1555-4dfe-b76d-f0d9ab6c8c85 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:27.277545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e609407f-1555-4dfe-b76d-f0d9ab6c8c85 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:27.279594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e609407f-1555-4dfe-b76d-f0d9ab6c8c85 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:27.282062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e609407f-1555-4dfe-b76d-f0d9ab6c8c85 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:27.283709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e609407f-1555-4dfe-b76d-f0d9ab6c8c85 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:27.588991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-938ea5c7-20f9-48d5-97ce-43761e9ce42d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:27.612618 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-938ea5c7-20f9-48d5-97ce-43761e9ce42d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:27.619219 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-938ea5c7-20f9-48d5-97ce-43761e9ce42d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:27.621412 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-938ea5c7-20f9-48d5-97ce-43761e9ce42d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 1567 microversion: 2.25 time: 1.098769 Aug 24 10:13:27.644327 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 314/669] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:13:26 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 1567 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:13:27.663347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a5f215d5-a329-4c6b-9200-70f6cd326830 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:27.665717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a5f215d5-a329-4c6b-9200-70f6cd326830 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:27.682391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5f215d5-a329-4c6b-9200-70f6cd326830 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:27.683554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5f215d5-a329-4c6b-9200-70f6cd326830 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:27.683985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5f215d5-a329-4c6b-9200-70f6cd326830 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:27.685004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5f215d5-a329-4c6b-9200-70f6cd326830 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:27.687831 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5f215d5-a329-4c6b-9200-70f6cd326830 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:27.688518 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5f215d5-a329-4c6b-9200-70f6cd326830 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:28.018970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e609407f-1555-4dfe-b76d-f0d9ab6c8c85 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:28.045685 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e609407f-1555-4dfe-b76d-f0d9ab6c8c85 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159" status: 200 len: 1324 microversion: 2.1 time: 0.816394 Aug 24 10:13:28.046844 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 356/670] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:27 2022] GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159 => generated 1324 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:28.091347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-19f84e88-46d1-46be-8a79-89873beae545 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:28.092703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-19f84e88-46d1-46be-8a79-89873beae545 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: d5911032-bcaa-4a3d-bb73-ccbea62de79b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:28.120490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19f84e88-46d1-46be-8a79-89873beae545 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:28.121803 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19f84e88-46d1-46be-8a79-89873beae545 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:28.125203 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19f84e88-46d1-46be-8a79-89873beae545 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:28.126900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19f84e88-46d1-46be-8a79-89873beae545 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:28.131152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19f84e88-46d1-46be-8a79-89873beae545 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:28.135590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19f84e88-46d1-46be-8a79-89873beae545 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:28.168105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a5f215d5-a329-4c6b-9200-70f6cd326830 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:28.190767 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a5f215d5-a329-4c6b-9200-70f6cd326830 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1471 microversion: 2.1 time: 0.541319 Aug 24 10:13:28.199123 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 315/671] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:27 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1471 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:28.213340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-19f84e88-46d1-46be-8a79-89873beae545 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: d5911032-bcaa-4a3d-bb73-ccbea62de79b] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:13:28.227728 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f155fbd3-092b-41a8-90f3-2663b411a54b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:28.228297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f155fbd3-092b-41a8-90f3-2663b411a54b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:28.248538 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f155fbd3-092b-41a8-90f3-2663b411a54b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:28.249046 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f155fbd3-092b-41a8-90f3-2663b411a54b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:28.249947 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f155fbd3-092b-41a8-90f3-2663b411a54b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:28.257646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f155fbd3-092b-41a8-90f3-2663b411a54b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:28.258850 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f155fbd3-092b-41a8-90f3-2663b411a54b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:28.259853 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f155fbd3-092b-41a8-90f3-2663b411a54b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:28.324765 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:28.414154 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f155fbd3-092b-41a8-90f3-2663b411a54b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "POST /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f/action" status: 204 len: 0 microversion: 2.1 time: 0.188131 Aug 24 10:13:28.417709 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 316/672] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:13:28 2022] POST /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f/action => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 10:13:28.431247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad6d5916-286f-43ff-a831-63d643cc85a4 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:28.433386 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ad6d5916-286f-43ff-a831-63d643cc85a4 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 38332901-4cb3-4475-90f4-48ad729f16c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:28.440956 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-19f84e88-46d1-46be-8a79-89873beae545 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b" status: 204 len: 0 microversion: 2.1 time: 0.379179 Aug 24 10:13:28.447542 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad6d5916-286f-43ff-a831-63d643cc85a4 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:28.448928 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 357/673] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:13:28 2022] DELETE /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:13:28.450013 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad6d5916-286f-43ff-a831-63d643cc85a4 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:28.451423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad6d5916-286f-43ff-a831-63d643cc85a4 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:28.453420 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad6d5916-286f-43ff-a831-63d643cc85a4 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:28.454698 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad6d5916-286f-43ff-a831-63d643cc85a4 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:28.455811 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad6d5916-286f-43ff-a831-63d643cc85a4 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:28.468009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-02ae117d-8771-4e5a-bd9c-d02778e27b6a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:28.468287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-02ae117d-8771-4e5a-bd9c-d02778e27b6a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:28.529807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02ae117d-8771-4e5a-bd9c-d02778e27b6a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:28.530397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02ae117d-8771-4e5a-bd9c-d02778e27b6a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:28.530996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02ae117d-8771-4e5a-bd9c-d02778e27b6a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:28.531919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02ae117d-8771-4e5a-bd9c-d02778e27b6a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:28.532880 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02ae117d-8771-4e5a-bd9c-d02778e27b6a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:28.538308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02ae117d-8771-4e5a-bd9c-d02778e27b6a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:28.938797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-02ae117d-8771-4e5a-bd9c-d02778e27b6a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:28.963375 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-02ae117d-8771-4e5a-bd9c-d02778e27b6a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1471 microversion: 2.1 time: 0.512104 Aug 24 10:13:28.964323 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 358/674] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:28 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1471 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:28.975663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-42208698-b6ba-439b-8beb-a270d13feaad tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:28.976660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-42208698-b6ba-439b-8beb-a270d13feaad tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: d5911032-bcaa-4a3d-bb73-ccbea62de79b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:28.993000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42208698-b6ba-439b-8beb-a270d13feaad tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:29.000672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42208698-b6ba-439b-8beb-a270d13feaad tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:29.002024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42208698-b6ba-439b-8beb-a270d13feaad tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:29.003246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42208698-b6ba-439b-8beb-a270d13feaad tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:29.003963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42208698-b6ba-439b-8beb-a270d13feaad tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:29.004597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42208698-b6ba-439b-8beb-a270d13feaad tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:29.376667 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ad6d5916-286f-43ff-a831-63d643cc85a4 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:29.410872 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ad6d5916-286f-43ff-a831-63d643cc85a4 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5" status: 200 len: 1317 microversion: 2.1 time: 0.988011 Aug 24 10:13:29.411873 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 317/675] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:28 2022] GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5 => generated 1317 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:29.423822 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-132431ff-7783-489f-9320-e017af721cb2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:29.425492 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-132431ff-7783-489f-9320-e017af721cb2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:29.458963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-132431ff-7783-489f-9320-e017af721cb2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:29.461027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-132431ff-7783-489f-9320-e017af721cb2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:29.465657 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-132431ff-7783-489f-9320-e017af721cb2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:29.467406 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-132431ff-7783-489f-9320-e017af721cb2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:29.470293 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-132431ff-7783-489f-9320-e017af721cb2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:29.474357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-132431ff-7783-489f-9320-e017af721cb2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:29.793085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-42208698-b6ba-439b-8beb-a270d13feaad tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:29.810099 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-42208698-b6ba-439b-8beb-a270d13feaad tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b" status: 200 len: 1711 microversion: 2.1 time: 0.843957 Aug 24 10:13:29.811024 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 359/676] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:28 2022] GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b => generated 1711 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:29.816324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-db10b2e4-80dd-4302-8774-9df03ab8029e tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:29.817337 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-db10b2e4-80dd-4302-8774-9df03ab8029e tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:29.840106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db10b2e4-80dd-4302-8774-9df03ab8029e tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:29.842839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db10b2e4-80dd-4302-8774-9df03ab8029e tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:29.843766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db10b2e4-80dd-4302-8774-9df03ab8029e tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:29.845317 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db10b2e4-80dd-4302-8774-9df03ab8029e tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:29.846612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db10b2e4-80dd-4302-8774-9df03ab8029e tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:29.847717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db10b2e4-80dd-4302-8774-9df03ab8029e tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:30.013056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:30.118386 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-132431ff-7783-489f-9320-e017af721cb2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:30.158451 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-132431ff-7783-489f-9320-e017af721cb2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:30.160565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-132431ff-7783-489f-9320-e017af721cb2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:30.162274 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-132431ff-7783-489f-9320-e017af721cb2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 1567 microversion: 2.25 time: 0.749062 Aug 24 10:13:30.177832 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 318/677] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:13:29 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 1567 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:13:30.184117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-b8754fe2-cf0e-43bb-9d3c-57fbeb0eabf8 req-574cff99-17c8-474d-a031-c8d9aee2691f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38332901-4cb3-4475-90f4-48ad729f16c5", "tag": "d35c6350-b269-46fa-838a-6e7220b41d64"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:30.196295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b8754fe2-cf0e-43bb-9d3c-57fbeb0eabf8 req-574cff99-17c8-474d-a031-c8d9aee2691f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:30.197255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b8754fe2-cf0e-43bb-9d3c-57fbeb0eabf8 req-574cff99-17c8-474d-a031-c8d9aee2691f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:30.197949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b8754fe2-cf0e-43bb-9d3c-57fbeb0eabf8 req-574cff99-17c8-474d-a031-c8d9aee2691f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:30.218500 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b8754fe2-cf0e-43bb-9d3c-57fbeb0eabf8 req-574cff99-17c8-474d-a031-c8d9aee2691f service nova] Creating event network-changed:d35c6350-b269-46fa-838a-6e7220b41d64 for instance 38332901-4cb3-4475-90f4-48ad729f16c5 on n-h2-849328-3 Aug 24 10:13:30.224486 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-b8754fe2-cf0e-43bb-9d3c-57fbeb0eabf8 req-574cff99-17c8-474d-a031-c8d9aee2691f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044890 Aug 24 10:13:30.226233 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 319/678] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:13:30.349845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-db10b2e4-80dd-4302-8774-9df03ab8029e tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:30.369403 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-db10b2e4-80dd-4302-8774-9df03ab8029e tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159" status: 200 len: 1324 microversion: 2.1 time: 0.556889 Aug 24 10:13:30.373246 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 360/679] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:29 2022] GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159 => generated 1324 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:30.397770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f415845b-f305-46af-842b-9e4fbbea80bb tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:30.398902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f415845b-f305-46af-842b-9e4fbbea80bb tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:30.424831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f415845b-f305-46af-842b-9e4fbbea80bb tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:30.428252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f415845b-f305-46af-842b-9e4fbbea80bb tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:30.431601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f415845b-f305-46af-842b-9e4fbbea80bb tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:30.436443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f415845b-f305-46af-842b-9e4fbbea80bb tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:30.439852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f415845b-f305-46af-842b-9e4fbbea80bb tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:30.441912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f415845b-f305-46af-842b-9e4fbbea80bb tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:30.585708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5cf75e71-8745-4c89-ab4e-70fbd22f3ce6 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Calling method '.version_select at 0x7f46553454c0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:30.589586 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:13:30.589586 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:13:30.591617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cf75e71-8745-4c89-ab4e-70fbd22f3ce6 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:30.592532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cf75e71-8745-4c89-ab4e-70fbd22f3ce6 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:30.601442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cf75e71-8745-4c89-ab4e-70fbd22f3ce6 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:30.604338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cf75e71-8745-4c89-ab4e-70fbd22f3ce6 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:30.605252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cf75e71-8745-4c89-ab4e-70fbd22f3ce6 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:30.605930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cf75e71-8745-4c89-ab4e-70fbd22f3ce6 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:30.648978 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5cf75e71-8745-4c89-ab4e-70fbd22f3ce6 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.419621 Aug 24 10:13:30.650885 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 320/680] 10.222.0.85 () {58 vars in 1128 bytes} [Wed Aug 24 10:13:30 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:13:30.658958 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6f461cc9-dd99-492e-990d-00f4b8678f17 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:30.660200 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6f461cc9-dd99-492e-990d-00f4b8678f17 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 38332901-4cb3-4475-90f4-48ad729f16c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:30.669465 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f461cc9-dd99-492e-990d-00f4b8678f17 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:30.670373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f461cc9-dd99-492e-990d-00f4b8678f17 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:30.671079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f461cc9-dd99-492e-990d-00f4b8678f17 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:30.672263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f461cc9-dd99-492e-990d-00f4b8678f17 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:30.673111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f461cc9-dd99-492e-990d-00f4b8678f17 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:30.674949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f461cc9-dd99-492e-990d-00f4b8678f17 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:30.799481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f415845b-f305-46af-842b-9e4fbbea80bb tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:30.822499 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f415845b-f305-46af-842b-9e4fbbea80bb tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1471 microversion: 2.1 time: 0.446563 Aug 24 10:13:30.825452 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 361/681] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:30 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1471 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:31.014135 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6f461cc9-dd99-492e-990d-00f4b8678f17 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:31.017041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:31.025645 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6f461cc9-dd99-492e-990d-00f4b8678f17 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5" status: 200 len: 1317 microversion: 2.1 time: 0.372982 Aug 24 10:13:31.026416 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 321/682] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:30 2022] GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5 => generated 1317 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:31.031225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-34a1bcc8-0709-4aed-957f-ec34c767139e tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] Calling method '.version_select at 0x7f46552f6430>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:31.034619 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a611c1f8-334c-4d7a-a076-5a549fbd2827 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:31.035732 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:13:31.035732 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:13:31.036244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a611c1f8-334c-4d7a-a076-5a549fbd2827 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: d5911032-bcaa-4a3d-bb73-ccbea62de79b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:31.041638 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-34a1bcc8-0709-4aed-957f-ec34c767139e tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '9822940aca9144c694aab5fac5de9990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f978904695d2401ca4204356f575844a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:31.043737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-34a1bcc8-0709-4aed-957f-ec34c767139e tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] Request method failure captured: Aug 24 10:13:31.043737 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 24 10:13:31.043737 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:13:31.043737 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:13:31.043737 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:13:31.043737 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:13:31.043737 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:13:31.043737 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:13:31.043737 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:13:31.043737 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:31.043737 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfnHpCuBfhRWsOkWcvme0GSYmf_TDzVIL1bKoC1cqr6jy-HemDBPTGWQVHw4p2iVECMByDDS3sFChM45-uUYkD01jzGMy0WXaMdK1rvR3lNNUDMzVlMnXzPfFWJaQih8oD3GkVR9lSihlBDxopVY87LRlpejkaxU2ds6i6Bu-wkDGcQ Aug 24 10:13:31.043737 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:13:31.043737 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:13:31.043737 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:13:31.043737 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:13:31.043737 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:13:31.043737 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:13:31.043737 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: f978904695d2401ca4204356f575844a Aug 24 10:13:31.043737 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1963049173 Aug 24 10:13:31.043737 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:13:31.043737 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:13:31.046166 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f978904695d2401ca4204356f575844a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f978904695d2401ca4204356f575844a", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f978904695d2401ca4204356f575844a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f978904695d2401ca4204356f575844a"}]}] Aug 24 10:13:31.046166 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1963049173 Aug 24 10:13:31.046166 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: f978904695d2401ca4204356f575844a Aug 24 10:13:31.046166 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1963049173 Aug 24 10:13:31.046166 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-HostsAdminNegativeTestJSON-1963049173-project Aug 24 10:13:31.046166 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:13:31.046166 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:13:31.046166 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 9822940aca9144c694aab5fac5de9990 Aug 24 10:13:31.046166 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1963049173-project Aug 24 10:13:31.046166 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:13:31.046166 n-d-849328-3 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 24 10:13:31.046166 n-d-849328-3 devstack@n-api.service[122433]: action_args: {} Aug 24 10:13:31.046166 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:31.047702 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.047702 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:31.047702 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:31.047702 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:31.047702 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:31.047702 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:13:31.047702 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:13:31.047702 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 10:13:31.047702 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:13:31.047702 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:31.047702 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:31.047702 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 24 10:13:31.047702 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 24 10:13:31.047702 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:13:31.047702 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:13:31.047702 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:13:31.047702 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:13:31.047702 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:13:31.047702 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:13:31.050110 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:13:31.050110 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:13:31.050110 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:13:31.050110 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:13:31.050110 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:13:31.050110 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:13:31.050110 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:13:31.050110 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:13:31.050110 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 24 10:13:31.050110 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.050110 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:31.050110 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.050110 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.050110 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:31.050110 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:31.050110 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:13:31.050110 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:13:31.050110 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 24 10:13:31.050110 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.052731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-34a1bcc8-0709-4aed-957f-ec34c767139e tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:31.052731 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-34a1bcc8-0709-4aed-957f-ec34c767139e tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] 10.222.0.85 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.217898 Aug 24 10:13:31.054869 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 362/683] 10.222.0.85 () {58 vars in 1128 bytes} [Wed Aug 24 10:13:30 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 228 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:13:31.059095 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a611c1f8-334c-4d7a-a076-5a549fbd2827 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:31.059901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a611c1f8-334c-4d7a-a076-5a549fbd2827 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:31.060962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a611c1f8-334c-4d7a-a076-5a549fbd2827 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:31.062604 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a611c1f8-334c-4d7a-a076-5a549fbd2827 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:31.063625 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a611c1f8-334c-4d7a-a076-5a549fbd2827 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:31.064430 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a611c1f8-334c-4d7a-a076-5a549fbd2827 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:31.068464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-9ff8446b-ec11-4661-b3cd-a7cfe1573e60 req-7032c199-4e56-445f-9340-da167f7765c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f", "name": "network-vif-plugged", "status": "completed", "tag": "29c5a4d8-1573-48ff-8439-153b2e7ce8e8"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:31.083763 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9ff8446b-ec11-4661-b3cd-a7cfe1573e60 req-7032c199-4e56-445f-9340-da167f7765c4 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:31.084270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9ff8446b-ec11-4661-b3cd-a7cfe1573e60 req-7032c199-4e56-445f-9340-da167f7765c4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:31.084928 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9ff8446b-ec11-4661-b3cd-a7cfe1573e60 req-7032c199-4e56-445f-9340-da167f7765c4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:31.110833 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-9ff8446b-ec11-4661-b3cd-a7cfe1573e60 req-7032c199-4e56-445f-9340-da167f7765c4 service nova] Creating event network-vif-plugged:29c5a4d8-1573-48ff-8439-153b2e7ce8e8 for instance a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f on n-h1-849328-3 Aug 24 10:13:31.122402 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-9ff8446b-ec11-4661-b3cd-a7cfe1573e60 req-7032c199-4e56-445f-9340-da167f7765c4 service nova] Instance a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 10:13:31.145670 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-9ff8446b-ec11-4661-b3cd-a7cfe1573e60 req-7032c199-4e56-445f-9340-da167f7765c4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089594 Aug 24 10:13:31.147187 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 363/684] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:13:31.155991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cc7d3565-db0a-4dcc-a393-c2ae16c0cf88 tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] Calling method '.version_select at 0x7f46552cd3a0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:31.159459 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:13:31.159459 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:13:31.160790 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cc7d3565-db0a-4dcc-a393-c2ae16c0cf88 tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '9822940aca9144c694aab5fac5de9990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f978904695d2401ca4204356f575844a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:31.164232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cc7d3565-db0a-4dcc-a393-c2ae16c0cf88 tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] Request method failure captured: Aug 24 10:13:31.164232 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-hosts/n-d-849328-3/reboot HTTP/1.1 Aug 24 10:13:31.164232 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:13:31.164232 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:13:31.164232 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:13:31.164232 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:13:31.164232 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:13:31.164232 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:13:31.164232 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:13:31.164232 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:31.164232 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfnHpCuBfhRWsOkWcvme0GSYmf_TDzVIL1bKoC1cqr6jy-HemDBPTGWQVHw4p2iVECMByDDS3sFChM45-uUYkD01jzGMy0WXaMdK1rvR3lNNUDMzVlMnXzPfFWJaQih8oD3GkVR9lSihlBDxopVY87LRlpejkaxU2ds6i6Bu-wkDGcQ Aug 24 10:13:31.164232 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:13:31.164232 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:13:31.164232 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:13:31.164232 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:13:31.164232 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:13:31.164232 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:13:31.164232 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: f978904695d2401ca4204356f575844a Aug 24 10:13:31.164232 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1963049173 Aug 24 10:13:31.164232 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:13:31.164232 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:13:31.167357 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f978904695d2401ca4204356f575844a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f978904695d2401ca4204356f575844a", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f978904695d2401ca4204356f575844a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f978904695d2401ca4204356f575844a"}]}] Aug 24 10:13:31.167357 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1963049173 Aug 24 10:13:31.167357 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: f978904695d2401ca4204356f575844a Aug 24 10:13:31.167357 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1963049173 Aug 24 10:13:31.167357 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-HostsAdminNegativeTestJSON-1963049173-project Aug 24 10:13:31.167357 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:13:31.167357 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:13:31.167357 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 9822940aca9144c694aab5fac5de9990 Aug 24 10:13:31.167357 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1963049173-project Aug 24 10:13:31.167357 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:13:31.167357 n-d-849328-3 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 24 10:13:31.167357 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'n-d-849328-3'} Aug 24 10:13:31.167357 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:31.169396 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.169396 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:31.169396 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:31.169396 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:31.169396 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:31.169396 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:13:31.169396 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:13:31.169396 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:31.169396 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:31.169396 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 24 10:13:31.169396 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 24 10:13:31.169396 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:13:31.169396 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:13:31.169396 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:13:31.169396 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:13:31.169396 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:13:31.169396 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:13:31.169396 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:13:31.169396 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:13:31.173074 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:13:31.173074 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:13:31.173074 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:13:31.173074 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:13:31.173074 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:13:31.173074 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:13:31.173074 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 24 10:13:31.173074 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.173074 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:31.173074 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.173074 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.173074 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:31.173074 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:31.173074 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:13:31.173074 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:13:31.173074 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 24 10:13:31.173074 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.177506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cc7d3565-db0a-4dcc-a393-c2ae16c0cf88 tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:31.177506 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cc7d3565-db0a-4dcc-a393-c2ae16c0cf88 tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] 10.222.0.85 "GET /compute/v2.1/os-hosts/n-d-849328-3/reboot" status: 403 len: 111 microversion: 2.1 time: 0.019310 Aug 24 10:13:31.177506 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 364/685] 10.222.0.85 () {58 vars in 1188 bytes} [Wed Aug 24 10:13:31 2022] GET /compute/v2.1/os-hosts/n-d-849328-3/reboot => generated 111 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:13:31.184028 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6d6cdfc4-e16c-414b-ad7f-f0269d20fa8a tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Calling method '.version_select at 0x7f46552f6040>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:31.196862 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-6d6cdfc4-e16c-414b-ad7f-f0269d20fa8a tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 10:13:31.199237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6d6cdfc4-e16c-414b-ad7f-f0269d20fa8a tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Request method failure captured: Aug 24 10:13:31.199237 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 24 10:13:31.199237 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:13:31.199237 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:13:31.199237 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:13:31.199237 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:13:31.199237 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:13:31.199237 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:13:31.199237 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:13:31.199237 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:31.199237 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfnJbNYy8bROUAxRpMV6b0fucYHNy32ebV2fa5pWuR88xae1kRKA4OJ6aM7uzSE3Deknxn4caMJ-JxgveHBxtXBt6I8cQRuxS49C02bxOr6YWnjSeqhRXWaUB3ke7okfAosIPYMxn3AezfqJevAcH92ixitwM7e3DesygM6RavdoG3k Aug 24 10:13:31.199237 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:13:31.199237 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:13:31.199237 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:13:31.199237 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:13:31.199237 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:13:31.199237 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:13:31.199237 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: b2d003f139264f288c0d2c717386095f Aug 24 10:13:31.199237 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1355555782 Aug 24 10:13:31.199237 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:13:31.199237 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:13:31.206574 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b2d003f139264f288c0d2c717386095f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b2d003f139264f288c0d2c717386095f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b2d003f139264f288c0d2c717386095f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b2d003f139264f288c0d2c717386095f"}]}] Aug 24 10:13:31.206574 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1355555782 Aug 24 10:13:31.206574 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: b2d003f139264f288c0d2c717386095f Aug 24 10:13:31.206574 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1355555782 Aug 24 10:13:31.206574 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-HostsAdminNegativeTestJSON-1355555782-project-admin Aug 24 10:13:31.206574 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:13:31.206574 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:13:31.206574 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 888184364170488ea0dd4b500a99e18d Aug 24 10:13:31.206574 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1355555782-project-admin Aug 24 10:13:31.206574 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:13:31.206574 n-d-849328-3 devstack@n-api.service[122433]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 10:13:31.206574 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'nonexistent_hostname'} Aug 24 10:13:31.206574 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:31.208422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.208422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 24 10:13:31.208422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 24 10:13:31.208422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 10:13:31.208422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 10:13:31.208422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:13:31.208422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:13:31.208422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:13:31.208422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:13:31.208422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 10:13:31.208422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 10:13:31.208422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5985, in targeted Aug 24 10:13:31.208422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 24 10:13:31.208422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:13:31.208422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:13:31.208422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 24 10:13:31.208422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 24 10:13:31.208422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 10:13:31.208422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 10:13:31.211760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 24 10:13:31.211760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 24 10:13:31.211760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 10:13:31.211760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.211760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:31.211760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.211760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.211760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:31.211760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:31.211760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:31.211760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:31.211760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:13:31.211760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:13:31.211760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:31.211760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:31.211760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 24 10:13:31.211760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 24 10:13:31.211760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 24 10:13:31.211760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:13:31.214134 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 10:13:31.214134 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.214134 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:31.214134 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.214134 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.214134 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:31.214134 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:31.214134 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:13:31.214134 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:13:31.214134 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 10:13:31.214134 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.214134 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6d6cdfc4-e16c-414b-ad7f-f0269d20fa8a tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:31.214134 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6d6cdfc4-e16c-414b-ad7f-f0269d20fa8a tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.022744 Aug 24 10:13:31.214134 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 365/686] 10.222.0.85 () {58 vars in 1212 bytes} [Wed Aug 24 10:13:31 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 10:13:31.215889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c351fc0e-d499-45a5-9651-368e5626ab13 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:31.215889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c351fc0e-d499-45a5-9651-368e5626ab13 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:31.223970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c351fc0e-d499-45a5-9651-368e5626ab13 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:31.224466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c351fc0e-d499-45a5-9651-368e5626ab13 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:31.224897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c351fc0e-d499-45a5-9651-368e5626ab13 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:31.225645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c351fc0e-d499-45a5-9651-368e5626ab13 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:31.226097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c351fc0e-d499-45a5-9651-368e5626ab13 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:31.226738 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c351fc0e-d499-45a5-9651-368e5626ab13 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:31.417803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a611c1f8-334c-4d7a-a076-5a549fbd2827 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:31.436018 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a611c1f8-334c-4d7a-a076-5a549fbd2827 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b" status: 200 len: 1711 microversion: 2.1 time: 0.408084 Aug 24 10:13:31.437386 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 322/687] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:31 2022] GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b => generated 1711 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:31.459968 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3fbcc7ee-a46a-40f6-b385-c06625d19ecc tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] Calling method '.version_select at 0x7f46553dd940>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:31.461785 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:13:31.461785 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:13:31.464854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3fbcc7ee-a46a-40f6-b385-c06625d19ecc tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '9822940aca9144c694aab5fac5de9990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f978904695d2401ca4204356f575844a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:31.472678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3fbcc7ee-a46a-40f6-b385-c06625d19ecc tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] Request method failure captured: Aug 24 10:13:31.472678 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-hosts/n-d-849328-3 HTTP/1.1 Aug 24 10:13:31.472678 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:13:31.472678 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:13:31.472678 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:13:31.472678 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:13:31.472678 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:13:31.472678 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:13:31.472678 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:13:31.472678 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:31.472678 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfnHpCuBfhRWsOkWcvme0GSYmf_TDzVIL1bKoC1cqr6jy-HemDBPTGWQVHw4p2iVECMByDDS3sFChM45-uUYkD01jzGMy0WXaMdK1rvR3lNNUDMzVlMnXzPfFWJaQih8oD3GkVR9lSihlBDxopVY87LRlpejkaxU2ds6i6Bu-wkDGcQ Aug 24 10:13:31.472678 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:13:31.472678 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:13:31.472678 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:13:31.472678 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:13:31.472678 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:13:31.472678 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:13:31.472678 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: f978904695d2401ca4204356f575844a Aug 24 10:13:31.472678 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1963049173 Aug 24 10:13:31.472678 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:13:31.472678 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:13:31.474352 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f978904695d2401ca4204356f575844a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f978904695d2401ca4204356f575844a", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f978904695d2401ca4204356f575844a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f978904695d2401ca4204356f575844a"}]}] Aug 24 10:13:31.474352 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1963049173 Aug 24 10:13:31.474352 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: f978904695d2401ca4204356f575844a Aug 24 10:13:31.474352 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1963049173 Aug 24 10:13:31.474352 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-HostsAdminNegativeTestJSON-1963049173-project Aug 24 10:13:31.474352 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:13:31.474352 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:13:31.474352 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 9822940aca9144c694aab5fac5de9990 Aug 24 10:13:31.474352 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1963049173-project Aug 24 10:13:31.474352 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:13:31.474352 n-d-849328-3 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 24 10:13:31.474352 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'n-d-849328-3'} Aug 24 10:13:31.474352 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:31.475126 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.475126 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:31.475126 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:31.475126 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:31.475126 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:31.475126 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:13:31.475126 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:13:31.475126 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:31.475126 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:31.475126 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 24 10:13:31.475126 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 24 10:13:31.475126 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:13:31.475126 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:13:31.475126 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:13:31.475126 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:13:31.475126 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:13:31.475126 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:13:31.475126 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:13:31.475126 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:13:31.476206 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:13:31.476206 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:13:31.476206 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:13:31.476206 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:13:31.476206 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:13:31.476206 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:13:31.476206 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 24 10:13:31.476206 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.476206 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:31.476206 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.476206 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.476206 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:31.476206 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:31.476206 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:13:31.476206 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:13:31.476206 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 24 10:13:31.476206 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.479075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3fbcc7ee-a46a-40f6-b385-c06625d19ecc tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:31.480257 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3fbcc7ee-a46a-40f6-b385-c06625d19ecc tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] 10.222.0.85 "GET /compute/v2.1/os-hosts/n-d-849328-3" status: 403 len: 109 microversion: 2.1 time: 0.041566 Aug 24 10:13:31.481615 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 323/688] 10.222.0.85 () {58 vars in 1167 bytes} [Wed Aug 24 10:13:31 2022] GET /compute/v2.1/os-hosts/n-d-849328-3 => generated 109 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:13:31.503530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c27eae49-5b3e-4b69-8c3e-b9b523a45bb5 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:31.504321 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c27eae49-5b3e-4b69-8c3e-b9b523a45bb5 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:31.517069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c27eae49-5b3e-4b69-8c3e-b9b523a45bb5 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:31.517928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c27eae49-5b3e-4b69-8c3e-b9b523a45bb5 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:31.518858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c27eae49-5b3e-4b69-8c3e-b9b523a45bb5 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:31.520397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c27eae49-5b3e-4b69-8c3e-b9b523a45bb5 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:31.521543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c27eae49-5b3e-4b69-8c3e-b9b523a45bb5 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:31.522164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c27eae49-5b3e-4b69-8c3e-b9b523a45bb5 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:31.553800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c351fc0e-d499-45a5-9651-368e5626ab13 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:31.572306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c351fc0e-d499-45a5-9651-368e5626ab13 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:31.573801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c351fc0e-d499-45a5-9651-368e5626ab13 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:31.575228 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c351fc0e-d499-45a5-9651-368e5626ab13 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 1567 microversion: 2.25 time: 0.371110 Aug 24 10:13:31.576254 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 366/689] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:13:31 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 1567 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:13:31.581219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-04a77591-e9db-45af-8ba0-87aa5e7c3721 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Calling method '.version_select at 0x7f46552cdee0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:31.587786 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:13:31.587786 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:13:31.599285 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-04a77591-e9db-45af-8ba0-87aa5e7c3721 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 10:13:31.608513 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-04a77591-e9db-45af-8ba0-87aa5e7c3721 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Request method failure captured: Aug 24 10:13:31.608513 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 24 10:13:31.608513 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:13:31.608513 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:13:31.608513 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:13:31.608513 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:13:31.608513 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:13:31.608513 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:13:31.608513 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:13:31.608513 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:31.608513 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfnJbNYy8bROUAxRpMV6b0fucYHNy32ebV2fa5pWuR88xae1kRKA4OJ6aM7uzSE3Deknxn4caMJ-JxgveHBxtXBt6I8cQRuxS49C02bxOr6YWnjSeqhRXWaUB3ke7okfAosIPYMxn3AezfqJevAcH92ixitwM7e3DesygM6RavdoG3k Aug 24 10:13:31.608513 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:13:31.608513 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:13:31.608513 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:13:31.608513 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:13:31.608513 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:13:31.608513 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:13:31.608513 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: b2d003f139264f288c0d2c717386095f Aug 24 10:13:31.608513 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1355555782 Aug 24 10:13:31.608513 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:13:31.608513 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:13:31.610328 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b2d003f139264f288c0d2c717386095f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b2d003f139264f288c0d2c717386095f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b2d003f139264f288c0d2c717386095f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b2d003f139264f288c0d2c717386095f"}]}] Aug 24 10:13:31.610328 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1355555782 Aug 24 10:13:31.610328 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: b2d003f139264f288c0d2c717386095f Aug 24 10:13:31.610328 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1355555782 Aug 24 10:13:31.610328 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-HostsAdminNegativeTestJSON-1355555782-project-admin Aug 24 10:13:31.610328 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:13:31.610328 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:13:31.610328 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 888184364170488ea0dd4b500a99e18d Aug 24 10:13:31.610328 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1355555782-project-admin Aug 24 10:13:31.610328 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:13:31.610328 n-d-849328-3 devstack@n-api.service[122433]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 10:13:31.610328 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'nonexistent_hostname'} Aug 24 10:13:31.610328 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:31.611246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.611246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 24 10:13:31.611246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 24 10:13:31.611246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:13:31.611246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:13:31.611246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 24 10:13:31.611246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 24 10:13:31.611246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 10:13:31.611246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 10:13:31.611246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 24 10:13:31.611246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 24 10:13:31.611246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 10:13:31.611246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.611246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:31.611246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.611246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.611246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:31.611246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:31.611246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:31.612589 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:31.612589 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:13:31.612589 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:13:31.612589 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:31.612589 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:31.612589 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 24 10:13:31.612589 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:13:31.612589 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 10:13:31.612589 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.612589 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:31.612589 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.612589 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.612589 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:31.612589 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:31.612589 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:13:31.612589 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:13:31.612589 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 10:13:31.612589 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.614701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-04a77591-e9db-45af-8ba0-87aa5e7c3721 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:31.615746 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-04a77591-e9db-45af-8ba0-87aa5e7c3721 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.038391 Aug 24 10:13:31.616470 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 367/690] 10.222.0.85 () {58 vars in 1191 bytes} [Wed Aug 24 10:13:31 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:13:31.632567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ea08fd1c-9fab-4b03-92d8-e460c129dd5e tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] Calling method '.version_select at 0x7f46552f6310>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:31.633745 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:13:31.633745 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:13:31.635258 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ea08fd1c-9fab-4b03-92d8-e460c129dd5e tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '9822940aca9144c694aab5fac5de9990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f978904695d2401ca4204356f575844a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:31.637378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ea08fd1c-9fab-4b03-92d8-e460c129dd5e tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] Request method failure captured: Aug 24 10:13:31.637378 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-hosts/n-d-849328-3/shutdown HTTP/1.1 Aug 24 10:13:31.637378 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:13:31.637378 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:13:31.637378 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:13:31.637378 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:13:31.637378 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:13:31.637378 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:13:31.637378 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:13:31.637378 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:31.637378 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfnHpCuBfhRWsOkWcvme0GSYmf_TDzVIL1bKoC1cqr6jy-HemDBPTGWQVHw4p2iVECMByDDS3sFChM45-uUYkD01jzGMy0WXaMdK1rvR3lNNUDMzVlMnXzPfFWJaQih8oD3GkVR9lSihlBDxopVY87LRlpejkaxU2ds6i6Bu-wkDGcQ Aug 24 10:13:31.637378 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:13:31.637378 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:13:31.637378 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:13:31.637378 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:13:31.637378 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:13:31.637378 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:13:31.637378 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: f978904695d2401ca4204356f575844a Aug 24 10:13:31.637378 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1963049173 Aug 24 10:13:31.637378 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:13:31.637378 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:13:31.638942 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f978904695d2401ca4204356f575844a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f978904695d2401ca4204356f575844a", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f978904695d2401ca4204356f575844a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f978904695d2401ca4204356f575844a"}]}] Aug 24 10:13:31.638942 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1963049173 Aug 24 10:13:31.638942 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: f978904695d2401ca4204356f575844a Aug 24 10:13:31.638942 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1963049173 Aug 24 10:13:31.638942 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-HostsAdminNegativeTestJSON-1963049173-project Aug 24 10:13:31.638942 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:13:31.638942 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:13:31.638942 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 9822940aca9144c694aab5fac5de9990 Aug 24 10:13:31.638942 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1963049173-project Aug 24 10:13:31.638942 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:13:31.638942 n-d-849328-3 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 24 10:13:31.638942 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'n-d-849328-3'} Aug 24 10:13:31.638942 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:31.639871 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.639871 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:31.639871 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:31.639871 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:31.639871 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:31.639871 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:13:31.639871 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:13:31.639871 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:31.639871 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:31.639871 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 24 10:13:31.639871 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 24 10:13:31.639871 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:13:31.639871 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:13:31.639871 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:13:31.639871 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:13:31.639871 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:13:31.639871 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:13:31.639871 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:13:31.639871 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:13:31.641345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:13:31.641345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:13:31.641345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:13:31.641345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:13:31.641345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:13:31.641345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:13:31.641345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 24 10:13:31.641345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.641345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:31.641345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.641345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.641345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:31.641345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:31.641345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:13:31.641345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:13:31.641345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 24 10:13:31.641345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.643737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ea08fd1c-9fab-4b03-92d8-e460c129dd5e tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:31.644794 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ea08fd1c-9fab-4b03-92d8-e460c129dd5e tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] 10.222.0.85 "GET /compute/v2.1/os-hosts/n-d-849328-3/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.016238 Aug 24 10:13:31.646072 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 368/691] 10.222.0.85 () {58 vars in 1194 bytes} [Wed Aug 24 10:13:31 2022] GET /compute/v2.1/os-hosts/n-d-849328-3/shutdown => generated 113 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:13:31.665445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4268c249-5b1f-482c-8a0e-d3f689242df4 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Calling method '.version_select at 0x7f46553cb940>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:31.680179 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-4268c249-5b1f-482c-8a0e-d3f689242df4 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 10:13:31.683869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4268c249-5b1f-482c-8a0e-d3f689242df4 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Request method failure captured: Aug 24 10:13:31.683869 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 24 10:13:31.683869 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:13:31.683869 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:13:31.683869 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:13:31.683869 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:13:31.683869 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:13:31.683869 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:13:31.683869 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:13:31.683869 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:31.683869 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfnJbNYy8bROUAxRpMV6b0fucYHNy32ebV2fa5pWuR88xae1kRKA4OJ6aM7uzSE3Deknxn4caMJ-JxgveHBxtXBt6I8cQRuxS49C02bxOr6YWnjSeqhRXWaUB3ke7okfAosIPYMxn3AezfqJevAcH92ixitwM7e3DesygM6RavdoG3k Aug 24 10:13:31.683869 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:13:31.683869 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:13:31.683869 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:13:31.683869 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:13:31.683869 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:13:31.683869 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:13:31.683869 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: b2d003f139264f288c0d2c717386095f Aug 24 10:13:31.683869 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1355555782 Aug 24 10:13:31.683869 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:13:31.683869 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:13:31.685865 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b2d003f139264f288c0d2c717386095f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b2d003f139264f288c0d2c717386095f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b2d003f139264f288c0d2c717386095f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b2d003f139264f288c0d2c717386095f"}]}] Aug 24 10:13:31.685865 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1355555782 Aug 24 10:13:31.685865 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: b2d003f139264f288c0d2c717386095f Aug 24 10:13:31.685865 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1355555782 Aug 24 10:13:31.685865 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-HostsAdminNegativeTestJSON-1355555782-project-admin Aug 24 10:13:31.685865 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:13:31.685865 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:13:31.685865 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 888184364170488ea0dd4b500a99e18d Aug 24 10:13:31.685865 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1355555782-project-admin Aug 24 10:13:31.685865 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:13:31.685865 n-d-849328-3 devstack@n-api.service[122433]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 10:13:31.685865 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'nonexistent_hostname'} Aug 24 10:13:31.685865 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:31.687285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.687285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 24 10:13:31.687285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 24 10:13:31.687285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 10:13:31.687285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 10:13:31.687285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:13:31.687285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:13:31.687285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:13:31.687285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:13:31.687285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 10:13:31.687285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 10:13:31.687285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5985, in targeted Aug 24 10:13:31.687285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 24 10:13:31.687285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:13:31.687285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:13:31.687285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 24 10:13:31.687285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 24 10:13:31.687285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 10:13:31.687285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 10:13:31.688977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 24 10:13:31.688977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 24 10:13:31.688977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 10:13:31.688977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.688977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:31.688977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.688977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.688977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:31.688977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:31.688977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:31.688977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:31.688977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:13:31.688977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:13:31.688977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:31.688977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:31.688977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 24 10:13:31.688977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 24 10:13:31.688977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 24 10:13:31.688977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:13:31.690311 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 10:13:31.690311 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.690311 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:31.690311 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.690311 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.690311 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:31.690311 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:31.690311 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:13:31.690311 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:13:31.690311 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 10:13:31.690311 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.692383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4268c249-5b1f-482c-8a0e-d3f689242df4 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:31.693899 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4268c249-5b1f-482c-8a0e-d3f689242df4 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.037411 Aug 24 10:13:31.695213 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 369/692] 10.222.0.85 () {58 vars in 1218 bytes} [Wed Aug 24 10:13:31 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:13:31.709261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-702c9744-8ed2-4444-b436-ca06816e38e2 tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] Calling method '.version_select at 0x7f46556e6e50>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:31.714957 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:13:31.714957 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:13:31.717553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-702c9744-8ed2-4444-b436-ca06816e38e2 tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '9822940aca9144c694aab5fac5de9990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f978904695d2401ca4204356f575844a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:31.723984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-702c9744-8ed2-4444-b436-ca06816e38e2 tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] Request method failure captured: Aug 24 10:13:31.723984 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-hosts/n-d-849328-3/startup HTTP/1.1 Aug 24 10:13:31.723984 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:13:31.723984 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:13:31.723984 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:13:31.723984 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:13:31.723984 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:13:31.723984 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:13:31.723984 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:13:31.723984 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:31.723984 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfnHpCuBfhRWsOkWcvme0GSYmf_TDzVIL1bKoC1cqr6jy-HemDBPTGWQVHw4p2iVECMByDDS3sFChM45-uUYkD01jzGMy0WXaMdK1rvR3lNNUDMzVlMnXzPfFWJaQih8oD3GkVR9lSihlBDxopVY87LRlpejkaxU2ds6i6Bu-wkDGcQ Aug 24 10:13:31.723984 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:13:31.723984 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:13:31.723984 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:13:31.723984 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:13:31.723984 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:13:31.723984 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:13:31.723984 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: f978904695d2401ca4204356f575844a Aug 24 10:13:31.723984 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1963049173 Aug 24 10:13:31.723984 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:13:31.723984 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:13:31.725584 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f978904695d2401ca4204356f575844a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f978904695d2401ca4204356f575844a", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f978904695d2401ca4204356f575844a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f978904695d2401ca4204356f575844a"}]}] Aug 24 10:13:31.725584 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1963049173 Aug 24 10:13:31.725584 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: f978904695d2401ca4204356f575844a Aug 24 10:13:31.725584 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1963049173 Aug 24 10:13:31.725584 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-HostsAdminNegativeTestJSON-1963049173-project Aug 24 10:13:31.725584 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:13:31.725584 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:13:31.725584 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 9822940aca9144c694aab5fac5de9990 Aug 24 10:13:31.725584 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1963049173-project Aug 24 10:13:31.725584 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:13:31.725584 n-d-849328-3 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 24 10:13:31.725584 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'n-d-849328-3'} Aug 24 10:13:31.725584 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:31.726452 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.726452 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:31.726452 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:31.726452 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:31.726452 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:31.726452 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:13:31.726452 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:13:31.726452 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:31.726452 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:31.726452 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 24 10:13:31.726452 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 24 10:13:31.726452 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:13:31.726452 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:13:31.726452 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:13:31.726452 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:13:31.726452 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:13:31.726452 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:13:31.726452 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:13:31.726452 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:13:31.727729 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:13:31.727729 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:13:31.727729 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:13:31.727729 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:13:31.727729 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:13:31.727729 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:13:31.727729 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 24 10:13:31.727729 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.727729 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:31.727729 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.727729 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.727729 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:31.727729 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:31.727729 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:13:31.727729 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:13:31.727729 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 24 10:13:31.727729 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.729519 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-702c9744-8ed2-4444-b436-ca06816e38e2 tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:31.730690 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-702c9744-8ed2-4444-b436-ca06816e38e2 tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] 10.222.0.85 "GET /compute/v2.1/os-hosts/n-d-849328-3/startup" status: 403 len: 110 microversion: 2.1 time: 0.026225 Aug 24 10:13:31.739039 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 370/693] 10.222.0.85 () {58 vars in 1191 bytes} [Wed Aug 24 10:13:31 2022] GET /compute/v2.1/os-hosts/n-d-849328-3/startup => generated 110 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:13:31.745282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5cba9269-8bc6-4e21-891b-17bf4c893613 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Calling method '.version_select at 0x7f46552f6430>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:31.759489 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-5cba9269-8bc6-4e21-891b-17bf4c893613 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 10:13:31.762069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5cba9269-8bc6-4e21-891b-17bf4c893613 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Request method failure captured: Aug 24 10:13:31.762069 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 24 10:13:31.762069 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:13:31.762069 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:13:31.762069 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:13:31.762069 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:13:31.762069 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:13:31.762069 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:13:31.762069 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:13:31.762069 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:31.762069 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfnJbNYy8bROUAxRpMV6b0fucYHNy32ebV2fa5pWuR88xae1kRKA4OJ6aM7uzSE3Deknxn4caMJ-JxgveHBxtXBt6I8cQRuxS49C02bxOr6YWnjSeqhRXWaUB3ke7okfAosIPYMxn3AezfqJevAcH92ixitwM7e3DesygM6RavdoG3k Aug 24 10:13:31.762069 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:13:31.762069 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:13:31.762069 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:13:31.762069 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:13:31.762069 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:13:31.762069 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:13:31.762069 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: b2d003f139264f288c0d2c717386095f Aug 24 10:13:31.762069 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1355555782 Aug 24 10:13:31.762069 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:13:31.762069 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:13:31.763720 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b2d003f139264f288c0d2c717386095f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b2d003f139264f288c0d2c717386095f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b2d003f139264f288c0d2c717386095f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b2d003f139264f288c0d2c717386095f"}]}] Aug 24 10:13:31.763720 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1355555782 Aug 24 10:13:31.763720 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: b2d003f139264f288c0d2c717386095f Aug 24 10:13:31.763720 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1355555782 Aug 24 10:13:31.763720 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-HostsAdminNegativeTestJSON-1355555782-project-admin Aug 24 10:13:31.763720 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:13:31.763720 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:13:31.763720 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 888184364170488ea0dd4b500a99e18d Aug 24 10:13:31.763720 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1355555782-project-admin Aug 24 10:13:31.763720 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:13:31.763720 n-d-849328-3 devstack@n-api.service[122433]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 10:13:31.763720 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'nonexistent_hostname'} Aug 24 10:13:31.763720 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:31.764557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.764557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 24 10:13:31.764557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 24 10:13:31.764557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 10:13:31.764557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 10:13:31.764557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:13:31.764557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:13:31.764557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:13:31.764557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:13:31.764557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 10:13:31.764557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 10:13:31.764557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5985, in targeted Aug 24 10:13:31.764557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 24 10:13:31.764557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:13:31.764557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:13:31.764557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 24 10:13:31.764557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 24 10:13:31.764557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 10:13:31.764557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 10:13:31.766115 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 24 10:13:31.766115 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 24 10:13:31.766115 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 10:13:31.766115 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.766115 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:31.766115 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.766115 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.766115 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:31.766115 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:31.766115 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:31.766115 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:31.766115 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:13:31.766115 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:13:31.766115 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:31.766115 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:31.766115 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 24 10:13:31.766115 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 24 10:13:31.766115 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 24 10:13:31.766115 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:13:31.767892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 10:13:31.767892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.767892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:31.767892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.767892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.767892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:31.767892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:31.767892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:13:31.767892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:13:31.767892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 10:13:31.767892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.767892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5cba9269-8bc6-4e21-891b-17bf4c893613 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:31.770527 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5cba9269-8bc6-4e21-891b-17bf4c893613 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.029793 Aug 24 10:13:31.772430 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 371/694] 10.222.0.85 () {58 vars in 1215 bytes} [Wed Aug 24 10:13:31 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:13:31.786424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c8af5006-353c-471a-a1f7-bbd7adeefa8d tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Action: 'update', calling method: .version_select at 0x7f46552cd1f0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:31.790865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c8af5006-353c-471a-a1f7-bbd7adeefa8d tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Request method failure captured: Aug 24 10:13:31.790865 n-d-849328-3 devstack@n-api.service[122433]: request: PUT /compute/v2.1/os-hosts/n-d-849328-3 HTTP/1.1 Aug 24 10:13:31.790865 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:13:31.790865 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:13:31.790865 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:13:31.790865 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 51 Aug 24 10:13:31.790865 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:13:31.790865 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:13:31.790865 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:13:31.790865 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:31.790865 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfnJbNYy8bROUAxRpMV6b0fucYHNy32ebV2fa5pWuR88xae1kRKA4OJ6aM7uzSE3Deknxn4caMJ-JxgveHBxtXBt6I8cQRuxS49C02bxOr6YWnjSeqhRXWaUB3ke7okfAosIPYMxn3AezfqJevAcH92ixitwM7e3DesygM6RavdoG3k Aug 24 10:13:31.790865 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:13:31.790865 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:13:31.790865 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:13:31.790865 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:13:31.790865 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:13:31.790865 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:13:31.790865 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: b2d003f139264f288c0d2c717386095f Aug 24 10:13:31.790865 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1355555782 Aug 24 10:13:31.790865 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:13:31.790865 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:13:31.792565 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b2d003f139264f288c0d2c717386095f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b2d003f139264f288c0d2c717386095f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b2d003f139264f288c0d2c717386095f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b2d003f139264f288c0d2c717386095f"}]}] Aug 24 10:13:31.792565 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1355555782 Aug 24 10:13:31.792565 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: b2d003f139264f288c0d2c717386095f Aug 24 10:13:31.792565 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1355555782 Aug 24 10:13:31.792565 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-HostsAdminNegativeTestJSON-1355555782-project-admin Aug 24 10:13:31.792565 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:13:31.792565 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:13:31.792565 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 888184364170488ea0dd4b500a99e18d Aug 24 10:13:31.792565 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1355555782-project-admin Aug 24 10:13:31.792565 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:13:31.792565 n-d-849328-3 devstack@n-api.service[122433]: {"status": "enable", "maintenance_mode": "invalid"} Aug 24 10:13:31.792565 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:13:31.792565 n-d-849328-3 devstack@n-api.service[122433]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 24 10:13:31.793530 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'n-d-849328-3', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 24 10:13:31.793530 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:31.793530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.793530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:13:31.793530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:13:31.793530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:13:31.793530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:13:31.793530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 24 10:13:31.793530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.793530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 24 10:13:31.793530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 24 10:13:31.793530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'disable', Aug 24 10:13:31.793530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'Enable', Aug 24 10:13:31.793530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'Disable', Aug 24 10:13:31.793530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 24 10:13:31.793530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 24 10:13:31.793530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 24 10:13:31.793530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.793530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance: Aug 24 10:13:31.793530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'invalid' Aug 24 10:13:31.793530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.793530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:31.793530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.793530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.793530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:31.795251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:31.795251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:31.795251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:31.795251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:13:31.795251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:13:31.795251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:31.795251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:31.795251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:13:31.795251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:13:31.795251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:13:31.795251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:13:31.795251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:13:31.795251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:13:31.795251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 24 10:13:31.795251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.795251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:31.795251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.795251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.795251 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:31.797003 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:31.797003 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:13:31.797003 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:13:31.797003 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 24 10:13:31.797003 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.798345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c8af5006-353c-471a-a1f7-bbd7adeefa8d tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:31.799369 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c8af5006-353c-471a-a1f7-bbd7adeefa8d tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-hosts/n-d-849328-3" status: 400 len: 199 microversion: 2.1 time: 0.018366 Aug 24 10:13:31.800424 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 372/695] 10.222.0.85 () {60 vars in 1187 bytes} [Wed Aug 24 10:13:31 2022] PUT /compute/v2.1/os-hosts/n-d-849328-3 => generated 199 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:13:31.815098 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f88ff57-f662-418e-a25d-0947e7dddb42 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Action: 'update', calling method: .version_select at 0x7f46552f60d0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:31.820358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f88ff57-f662-418e-a25d-0947e7dddb42 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Request method failure captured: Aug 24 10:13:31.820358 n-d-849328-3 devstack@n-api.service[122433]: request: PUT /compute/v2.1/os-hosts/n-d-849328-3 HTTP/1.1 Aug 24 10:13:31.820358 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:13:31.820358 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:13:31.820358 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:13:31.820358 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 51 Aug 24 10:13:31.820358 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:13:31.820358 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:13:31.820358 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:13:31.820358 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:31.820358 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfnJbNYy8bROUAxRpMV6b0fucYHNy32ebV2fa5pWuR88xae1kRKA4OJ6aM7uzSE3Deknxn4caMJ-JxgveHBxtXBt6I8cQRuxS49C02bxOr6YWnjSeqhRXWaUB3ke7okfAosIPYMxn3AezfqJevAcH92ixitwM7e3DesygM6RavdoG3k Aug 24 10:13:31.820358 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:13:31.820358 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:13:31.820358 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:13:31.820358 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:13:31.820358 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:13:31.820358 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:13:31.820358 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: b2d003f139264f288c0d2c717386095f Aug 24 10:13:31.820358 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1355555782 Aug 24 10:13:31.820358 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:13:31.820358 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:13:31.822083 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b2d003f139264f288c0d2c717386095f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b2d003f139264f288c0d2c717386095f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b2d003f139264f288c0d2c717386095f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b2d003f139264f288c0d2c717386095f"}]}] Aug 24 10:13:31.822083 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1355555782 Aug 24 10:13:31.822083 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: b2d003f139264f288c0d2c717386095f Aug 24 10:13:31.822083 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1355555782 Aug 24 10:13:31.822083 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-HostsAdminNegativeTestJSON-1355555782-project-admin Aug 24 10:13:31.822083 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:13:31.822083 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:13:31.822083 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 888184364170488ea0dd4b500a99e18d Aug 24 10:13:31.822083 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1355555782-project-admin Aug 24 10:13:31.822083 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:13:31.822083 n-d-849328-3 devstack@n-api.service[122433]: {"status": "invalid", "maintenance_mode": "enable"} Aug 24 10:13:31.822083 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:13:31.822083 n-d-849328-3 devstack@n-api.service[122433]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 24 10:13:31.823057 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'n-d-849328-3', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 24 10:13:31.823057 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:31.823057 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.823057 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:13:31.823057 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:13:31.823057 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:13:31.823057 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:13:31.823057 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 24 10:13:31.823057 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.823057 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 24 10:13:31.823057 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 24 10:13:31.823057 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'disable', Aug 24 10:13:31.823057 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'Enable', Aug 24 10:13:31.823057 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'Disable', Aug 24 10:13:31.823057 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 24 10:13:31.823057 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 24 10:13:31.823057 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 24 10:13:31.823057 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.823057 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance: Aug 24 10:13:31.823057 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'invalid' Aug 24 10:13:31.823057 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.823057 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:31.823057 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.823057 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.823057 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:31.824674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:31.824674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:31.824674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:31.824674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:13:31.824674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:13:31.824674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:31.824674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:31.824674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:13:31.824674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:13:31.824674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:13:31.824674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:13:31.824674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:13:31.824674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:13:31.824674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 24 10:13:31.824674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.824674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:31.824674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.824674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.824674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:31.825939 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:31.825939 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:13:31.825939 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:13:31.825939 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 24 10:13:31.825939 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.829147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f88ff57-f662-418e-a25d-0947e7dddb42 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:31.829147 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0f88ff57-f662-418e-a25d-0947e7dddb42 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-hosts/n-d-849328-3" status: 400 len: 189 microversion: 2.1 time: 0.017148 Aug 24 10:13:31.834813 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 373/696] 10.222.0.85 () {60 vars in 1187 bytes} [Wed Aug 24 10:13:31 2022] PUT /compute/v2.1/os-hosts/n-d-849328-3 => generated 189 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:13:31.845641 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-089962f9-5278-417a-bee0-279ee9e550cd tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] Action: 'update', calling method: .version_select at 0x7f46552cde50>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:31.849444 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:13:31.849444 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:13:31.851782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-089962f9-5278-417a-bee0-279ee9e550cd tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '9822940aca9144c694aab5fac5de9990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f978904695d2401ca4204356f575844a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:31.853816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-089962f9-5278-417a-bee0-279ee9e550cd tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] Request method failure captured: Aug 24 10:13:31.853816 n-d-849328-3 devstack@n-api.service[122433]: request: PUT /compute/v2.1/os-hosts/n-d-849328-3 HTTP/1.1 Aug 24 10:13:31.853816 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:13:31.853816 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:13:31.853816 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:13:31.853816 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 50 Aug 24 10:13:31.853816 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:13:31.853816 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:13:31.853816 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:13:31.853816 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:31.853816 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfnHpCuBfhRWsOkWcvme0GSYmf_TDzVIL1bKoC1cqr6jy-HemDBPTGWQVHw4p2iVECMByDDS3sFChM45-uUYkD01jzGMy0WXaMdK1rvR3lNNUDMzVlMnXzPfFWJaQih8oD3GkVR9lSihlBDxopVY87LRlpejkaxU2ds6i6Bu-wkDGcQ Aug 24 10:13:31.853816 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:13:31.853816 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:13:31.853816 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:13:31.853816 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:13:31.853816 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:13:31.853816 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:13:31.853816 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: f978904695d2401ca4204356f575844a Aug 24 10:13:31.853816 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1963049173 Aug 24 10:13:31.853816 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:13:31.853816 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:13:31.855175 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f978904695d2401ca4204356f575844a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f978904695d2401ca4204356f575844a", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f978904695d2401ca4204356f575844a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f978904695d2401ca4204356f575844a"}]}] Aug 24 10:13:31.855175 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1963049173 Aug 24 10:13:31.855175 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: f978904695d2401ca4204356f575844a Aug 24 10:13:31.855175 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1963049173 Aug 24 10:13:31.855175 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-HostsAdminNegativeTestJSON-1963049173-project Aug 24 10:13:31.855175 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:13:31.855175 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:13:31.855175 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 9822940aca9144c694aab5fac5de9990 Aug 24 10:13:31.855175 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1963049173-project Aug 24 10:13:31.855175 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:13:31.855175 n-d-849328-3 devstack@n-api.service[122433]: {"status": "enable", "maintenance_mode": "enable"} Aug 24 10:13:31.855175 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:13:31.855175 n-d-849328-3 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 24 10:13:31.855175 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'n-d-849328-3', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 24 10:13:31.856000 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:31.856000 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.856000 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:31.856000 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:31.856000 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:31.856000 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:31.856000 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:13:31.856000 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:13:31.856000 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:31.856000 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:31.856000 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:13:31.856000 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:13:31.856000 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 24 10:13:31.856000 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 24 10:13:31.856000 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:13:31.856000 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:13:31.856000 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:13:31.856000 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:13:31.856000 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:13:31.856000 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:13:31.857328 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:13:31.857328 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:13:31.857328 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:13:31.857328 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:13:31.857328 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:13:31.857328 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:13:31.857328 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:13:31.857328 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:13:31.857328 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 24 10:13:31.857328 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.857328 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:31.857328 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.857328 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:31.857328 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:31.857328 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:31.857328 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:13:31.857328 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:13:31.857328 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 24 10:13:31.857328 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:31.859931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-089962f9-5278-417a-bee0-279ee9e550cd tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:31.860991 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-089962f9-5278-417a-bee0-279ee9e550cd tempest-HostsAdminNegativeTestJSON-1963049173 tempest-HostsAdminNegativeTestJSON-1963049173-project] 10.222.0.85 "PUT /compute/v2.1/os-hosts/n-d-849328-3" status: 403 len: 111 microversion: 2.1 time: 0.023143 Aug 24 10:13:31.861778 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 374/697] 10.222.0.85 () {60 vars in 1187 bytes} [Wed Aug 24 10:13:31 2022] PUT /compute/v2.1/os-hosts/n-d-849328-3 => generated 111 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:13:31.867042 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1ccc2484-ef34-42e2-90a3-e5aec3d671ee tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:31.867885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1ccc2484-ef34-42e2-90a3-e5aec3d671ee tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:31.880167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ccc2484-ef34-42e2-90a3-e5aec3d671ee tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:31.881349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ccc2484-ef34-42e2-90a3-e5aec3d671ee tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:31.882099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ccc2484-ef34-42e2-90a3-e5aec3d671ee tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:31.883113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ccc2484-ef34-42e2-90a3-e5aec3d671ee tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:31.883876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ccc2484-ef34-42e2-90a3-e5aec3d671ee tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:31.885209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ccc2484-ef34-42e2-90a3-e5aec3d671ee tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:32.290217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1ccc2484-ef34-42e2-90a3-e5aec3d671ee tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:32.306679 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1ccc2484-ef34-42e2-90a3-e5aec3d671ee tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1471 microversion: 2.1 time: 0.442987 Aug 24 10:13:32.324478 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 375/698] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:31 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1471 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:32.340381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f56559bf-f9b0-4e07-832b-f04808b6a0b2 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Action: 'update', calling method: .version_select at 0x7f46552f6700>, body: {"status": null, "maintenance_mode": null} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:32.348598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f56559bf-f9b0-4e07-832b-f04808b6a0b2 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Request method failure captured: Aug 24 10:13:32.348598 n-d-849328-3 devstack@n-api.service[122433]: request: PUT /compute/v2.1/os-hosts/n-d-849328-3 HTTP/1.1 Aug 24 10:13:32.348598 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:13:32.348598 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:13:32.348598 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:13:32.348598 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 42 Aug 24 10:13:32.348598 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:13:32.348598 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:13:32.348598 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:13:32.348598 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:32.348598 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfnJbNYy8bROUAxRpMV6b0fucYHNy32ebV2fa5pWuR88xae1kRKA4OJ6aM7uzSE3Deknxn4caMJ-JxgveHBxtXBt6I8cQRuxS49C02bxOr6YWnjSeqhRXWaUB3ke7okfAosIPYMxn3AezfqJevAcH92ixitwM7e3DesygM6RavdoG3k Aug 24 10:13:32.348598 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:13:32.348598 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:13:32.348598 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:13:32.348598 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:13:32.348598 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:13:32.348598 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:13:32.348598 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: b2d003f139264f288c0d2c717386095f Aug 24 10:13:32.348598 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1355555782 Aug 24 10:13:32.348598 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:13:32.348598 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:13:32.350666 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b2d003f139264f288c0d2c717386095f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b2d003f139264f288c0d2c717386095f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b2d003f139264f288c0d2c717386095f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b2d003f139264f288c0d2c717386095f"}]}] Aug 24 10:13:32.350666 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1355555782 Aug 24 10:13:32.350666 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: b2d003f139264f288c0d2c717386095f Aug 24 10:13:32.350666 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1355555782 Aug 24 10:13:32.350666 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-HostsAdminNegativeTestJSON-1355555782-project-admin Aug 24 10:13:32.350666 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:13:32.350666 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:13:32.350666 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 888184364170488ea0dd4b500a99e18d Aug 24 10:13:32.350666 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1355555782-project-admin Aug 24 10:13:32.350666 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:13:32.350666 n-d-849328-3 devstack@n-api.service[122433]: {"status": null, "maintenance_mode": null} Aug 24 10:13:32.350666 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:13:32.350666 n-d-849328-3 devstack@n-api.service[122433]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 24 10:13:32.350666 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'n-d-849328-3', 'body': {'status': None, 'maintenance_mode': None}} Aug 24 10:13:32.351728 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:32.351728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:32.351728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:13:32.351728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:13:32.351728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:13:32.351728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:13:32.351728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 24 10:13:32.351728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:32.351728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 24 10:13:32.351728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 24 10:13:32.351728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'disable', Aug 24 10:13:32.351728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'Enable', Aug 24 10:13:32.351728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'Disable', Aug 24 10:13:32.351728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 24 10:13:32.351728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 24 10:13:32.351728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 24 10:13:32.351728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:32.351728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance: Aug 24 10:13:32.351728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi None Aug 24 10:13:32.351728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:32.351728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:32.351728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:32.351728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:32.351728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:32.351728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:32.354096 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:32.354096 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:32.354096 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:13:32.354096 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:13:32.354096 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:32.354096 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:32.354096 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:13:32.354096 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:13:32.354096 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:13:32.354096 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:13:32.354096 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:13:32.354096 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:13:32.354096 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 24 10:13:32.354096 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:32.354096 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:32.354096 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:32.354096 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:32.354096 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:32.354096 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:32.355538 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:13:32.355538 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:13:32.355538 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 24 10:13:32.355538 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:32.359579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f56559bf-f9b0-4e07-832b-f04808b6a0b2 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:32.360851 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f56559bf-f9b0-4e07-832b-f04808b6a0b2 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-hosts/n-d-849328-3" status: 400 len: 127 microversion: 2.1 time: 0.034409 Aug 24 10:13:32.363417 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 376/699] 10.222.0.85 () {60 vars in 1187 bytes} [Wed Aug 24 10:13:32 2022] PUT /compute/v2.1/os-hosts/n-d-849328-3 => generated 127 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:13:32.371933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ee9cf386-470f-41a0-b773-ab03cb4ed186 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:32.373368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ee9cf386-470f-41a0-b773-ab03cb4ed186 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 38332901-4cb3-4475-90f4-48ad729f16c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:32.383966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee9cf386-470f-41a0-b773-ab03cb4ed186 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:32.384720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee9cf386-470f-41a0-b773-ab03cb4ed186 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:32.385334 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee9cf386-470f-41a0-b773-ab03cb4ed186 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:32.386303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee9cf386-470f-41a0-b773-ab03cb4ed186 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:32.386926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee9cf386-470f-41a0-b773-ab03cb4ed186 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:32.388664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee9cf386-470f-41a0-b773-ab03cb4ed186 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:32.579171 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c27eae49-5b3e-4b69-8c3e-b9b523a45bb5 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:32.588770 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c27eae49-5b3e-4b69-8c3e-b9b523a45bb5 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159" status: 200 len: 1324 microversion: 2.1 time: 1.105451 Aug 24 10:13:32.599578 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 324/700] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:31 2022] GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159 => generated 1324 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:32.605914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cd7585b0-3183-4675-a99d-0079ca2663c7 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Action: 'update', calling method: .version_select at 0x7f46566d6dc0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:32.618039 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:13:32.618039 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:13:32.619351 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.hosts [None req-cd7585b0-3183-4675-a99d-0079ca2663c7 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Enabling host nonexistent_hostname. Aug 24 10:13:32.643633 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-cd7585b0-3183-4675-a99d-0079ca2663c7 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 10:13:32.651554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cd7585b0-3183-4675-a99d-0079ca2663c7 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Request method failure captured: Aug 24 10:13:32.651554 n-d-849328-3 devstack@n-api.service[122432]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 24 10:13:32.651554 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:13:32.651554 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:13:32.651554 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:13:32.651554 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 50 Aug 24 10:13:32.651554 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:13:32.651554 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:13:32.651554 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:13:32.651554 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:32.651554 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfnJbNYy8bROUAxRpMV6b0fucYHNy32ebV2fa5pWuR88xae1kRKA4OJ6aM7uzSE3Deknxn4caMJ-JxgveHBxtXBt6I8cQRuxS49C02bxOr6YWnjSeqhRXWaUB3ke7okfAosIPYMxn3AezfqJevAcH92ixitwM7e3DesygM6RavdoG3k Aug 24 10:13:32.651554 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:13:32.651554 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:13:32.651554 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:13:32.651554 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:13:32.651554 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:13:32.651554 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:13:32.651554 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: b2d003f139264f288c0d2c717386095f Aug 24 10:13:32.651554 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1355555782 Aug 24 10:13:32.651554 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,admin,member Aug 24 10:13:32.651554 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,admin,member Aug 24 10:13:32.653867 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b2d003f139264f288c0d2c717386095f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b2d003f139264f288c0d2c717386095f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b2d003f139264f288c0d2c717386095f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b2d003f139264f288c0d2c717386095f"}]}] Aug 24 10:13:32.653867 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1355555782 Aug 24 10:13:32.653867 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: b2d003f139264f288c0d2c717386095f Aug 24 10:13:32.653867 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1355555782 Aug 24 10:13:32.653867 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-HostsAdminNegativeTestJSON-1355555782-project-admin Aug 24 10:13:32.653867 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:13:32.653867 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:13:32.653867 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 888184364170488ea0dd4b500a99e18d Aug 24 10:13:32.653867 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1355555782-project-admin Aug 24 10:13:32.653867 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:13:32.653867 n-d-849328-3 devstack@n-api.service[122432]: {"status": "enable", "maintenance_mode": "enable"} Aug 24 10:13:32.653867 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:13:32.653867 n-d-849328-3 devstack@n-api.service[122432]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 10:13:32.653867 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 24 10:13:32.656102 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:32.656102 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:32.656102 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 24 10:13:32.656102 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 24 10:13:32.656102 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 10:13:32.656102 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 10:13:32.656102 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:13:32.656102 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:13:32.656102 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:13:32.656102 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:13:32.656102 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 10:13:32.656102 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 10:13:32.656102 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5985, in targeted Aug 24 10:13:32.656102 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 24 10:13:32.656102 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:13:32.656102 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:13:32.656102 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 24 10:13:32.656102 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 24 10:13:32.659013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 10:13:32.659013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 10:13:32.659013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 24 10:13:32.659013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 24 10:13:32.659013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 10:13:32.659013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:32.659013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:32.659013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:32.659013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:32.659013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:32.659013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:32.659013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:32.659013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:32.659013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:13:32.659013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:13:32.659013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:32.659013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:32.659013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:13:32.659013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:13:32.659013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 24 10:13:32.660163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 24 10:13:32.660163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 24 10:13:32.660163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:13:32.660163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 10:13:32.660163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:32.660163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:32.660163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:32.660163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:32.660163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:32.660163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:32.660163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:13:32.660163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:13:32.660163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 10:13:32.660163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:32.660163 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cd7585b0-3183-4675-a99d-0079ca2663c7 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:32.661039 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cd7585b0-3183-4675-a99d-0079ca2663c7 tempest-HostsAdminNegativeTestJSON-1355555782 tempest-HostsAdminNegativeTestJSON-1355555782-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.046392 Aug 24 10:13:32.661039 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 325/701] 10.222.0.85 () {60 vars in 1211 bytes} [Wed Aug 24 10:13:32 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:13:32.664420 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8c9ee888-e59d-42b9-beaa-03e45226de31 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:32.665060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8c9ee888-e59d-42b9-beaa-03e45226de31 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: d5911032-bcaa-4a3d-bb73-ccbea62de79b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:32.686345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c9ee888-e59d-42b9-beaa-03e45226de31 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:32.687107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c9ee888-e59d-42b9-beaa-03e45226de31 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:32.689032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c9ee888-e59d-42b9-beaa-03e45226de31 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:32.690003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c9ee888-e59d-42b9-beaa-03e45226de31 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:32.692455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c9ee888-e59d-42b9-beaa-03e45226de31 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:32.697002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c9ee888-e59d-42b9-beaa-03e45226de31 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:32.810151 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:32.834866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=14 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:32.931685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ee9cf386-470f-41a0-b773-ab03cb4ed186 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:32.951212 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ee9cf386-470f-41a0-b773-ab03cb4ed186 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5" status: 200 len: 1317 microversion: 2.1 time: 0.585757 Aug 24 10:13:32.953780 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 377/702] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:32 2022] GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5 => generated 1317 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:32.977227 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d067b304-dad4-420c-8c9b-6191263c3d17 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:32.979069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d067b304-dad4-420c-8c9b-6191263c3d17 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:32.993944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d067b304-dad4-420c-8c9b-6191263c3d17 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:32.994725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d067b304-dad4-420c-8c9b-6191263c3d17 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:32.996218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d067b304-dad4-420c-8c9b-6191263c3d17 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:32.997446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d067b304-dad4-420c-8c9b-6191263c3d17 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:32.998086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d067b304-dad4-420c-8c9b-6191263c3d17 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:32.998668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d067b304-dad4-420c-8c9b-6191263c3d17 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:33.269198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:33.436998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8c9ee888-e59d-42b9-beaa-03e45226de31 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:33.453544 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8c9ee888-e59d-42b9-beaa-03e45226de31 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b" status: 200 len: 1711 microversion: 2.1 time: 0.804409 Aug 24 10:13:33.455282 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 326/703] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:32 2022] GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b => generated 1711 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:33.482870 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-95ed52e5-596c-4c9d-a194-e07c07ac904a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:33.484717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-95ed52e5-596c-4c9d-a194-e07c07ac904a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:33.522874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95ed52e5-596c-4c9d-a194-e07c07ac904a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:33.531731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95ed52e5-596c-4c9d-a194-e07c07ac904a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:33.532553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95ed52e5-596c-4c9d-a194-e07c07ac904a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:33.538573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95ed52e5-596c-4c9d-a194-e07c07ac904a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:33.539386 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95ed52e5-596c-4c9d-a194-e07c07ac904a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:33.540073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95ed52e5-596c-4c9d-a194-e07c07ac904a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:33.768817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d067b304-dad4-420c-8c9b-6191263c3d17 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:33.778715 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d067b304-dad4-420c-8c9b-6191263c3d17 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:33.781333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d067b304-dad4-420c-8c9b-6191263c3d17 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:33.782806 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d067b304-dad4-420c-8c9b-6191263c3d17 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 1567 microversion: 2.25 time: 0.810935 Aug 24 10:13:33.783927 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 378/704] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:13:32 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 1567 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:13:33.789108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a7d682a8-bbca-4223-a293-1082df7bce54 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:33.790451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a7d682a8-bbca-4223-a293-1082df7bce54 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:33.815368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7d682a8-bbca-4223-a293-1082df7bce54 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:33.817295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7d682a8-bbca-4223-a293-1082df7bce54 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:33.817926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7d682a8-bbca-4223-a293-1082df7bce54 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:33.818871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7d682a8-bbca-4223-a293-1082df7bce54 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:33.819494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7d682a8-bbca-4223-a293-1082df7bce54 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:33.820070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7d682a8-bbca-4223-a293-1082df7bce54 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:34.461086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-95ed52e5-596c-4c9d-a194-e07c07ac904a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:34.479834 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-95ed52e5-596c-4c9d-a194-e07c07ac904a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1471 microversion: 2.1 time: 1.019043 Aug 24 10:13:34.480699 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 327/705] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:33 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1471 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:34.487825 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f96764f0-efc1-4dd4-b9bf-2e4fff04f703 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:34.498418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f96764f0-efc1-4dd4-b9bf-2e4fff04f703 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 38332901-4cb3-4475-90f4-48ad729f16c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:34.506798 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f96764f0-efc1-4dd4-b9bf-2e4fff04f703 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:34.511479 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f96764f0-efc1-4dd4-b9bf-2e4fff04f703 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:34.511945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f96764f0-efc1-4dd4-b9bf-2e4fff04f703 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:34.518693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f96764f0-efc1-4dd4-b9bf-2e4fff04f703 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:34.519539 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f96764f0-efc1-4dd4-b9bf-2e4fff04f703 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:34.520333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f96764f0-efc1-4dd4-b9bf-2e4fff04f703 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:34.954386 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a7d682a8-bbca-4223-a293-1082df7bce54 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:34.963881 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a7d682a8-bbca-4223-a293-1082df7bce54 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159" status: 200 len: 1324 microversion: 2.1 time: 1.178410 Aug 24 10:13:34.964959 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 379/706] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:33 2022] GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159 => generated 1324 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:34.984182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ea7d3b08-67a8-4841-8e47-2da995427478 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:34.996270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ea7d3b08-67a8-4841-8e47-2da995427478 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: d5911032-bcaa-4a3d-bb73-ccbea62de79b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:35.004760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea7d3b08-67a8-4841-8e47-2da995427478 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:35.005920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea7d3b08-67a8-4841-8e47-2da995427478 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:35.006624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea7d3b08-67a8-4841-8e47-2da995427478 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:35.007636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea7d3b08-67a8-4841-8e47-2da995427478 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:35.013496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea7d3b08-67a8-4841-8e47-2da995427478 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:35.014750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea7d3b08-67a8-4841-8e47-2da995427478 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:35.206775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ea7d3b08-67a8-4841-8e47-2da995427478 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bc9c3828964edabe730dd66ee27ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114821bb876c48869e113c5b6d8898d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:35.240852 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ea7d3b08-67a8-4841-8e47-2da995427478 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b" status: 200 len: 1347 microversion: 2.1 time: 0.269397 Aug 24 10:13:35.251834 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 380/707] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:34 2022] GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b => generated 1347 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:35.261028 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d861265f-f2a8-4db0-b89a-ab6433d36023 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:35.265300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d861265f-f2a8-4db0-b89a-ab6433d36023 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:35.289885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d861265f-f2a8-4db0-b89a-ab6433d36023 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:35.291023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d861265f-f2a8-4db0-b89a-ab6433d36023 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:35.291962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d861265f-f2a8-4db0-b89a-ab6433d36023 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:35.293330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d861265f-f2a8-4db0-b89a-ab6433d36023 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:35.294301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d861265f-f2a8-4db0-b89a-ab6433d36023 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:35.295046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d861265f-f2a8-4db0-b89a-ab6433d36023 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:35.516134 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f96764f0-efc1-4dd4-b9bf-2e4fff04f703 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:35.548970 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f96764f0-efc1-4dd4-b9bf-2e4fff04f703 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5" status: 200 len: 1317 microversion: 2.1 time: 1.066762 Aug 24 10:13:35.556996 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 328/708] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:34 2022] GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5 => generated 1317 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:35.579063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-52835104-863b-403a-96cb-0f7587c0a997 req-16805119-c919-4167-bf21-08aabe2388ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5911032-bcaa-4a3d-bb73-ccbea62de79b", "name": "network-vif-deleted", "tag": "29857c60-2ade-4b2f-b518-b9ceee5755c9"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:35.606440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-52835104-863b-403a-96cb-0f7587c0a997 req-16805119-c919-4167-bf21-08aabe2388ad service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:35.607181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-52835104-863b-403a-96cb-0f7587c0a997 req-16805119-c919-4167-bf21-08aabe2388ad service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:35.609133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-52835104-863b-403a-96cb-0f7587c0a997 req-16805119-c919-4167-bf21-08aabe2388ad service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:35.640360 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-52835104-863b-403a-96cb-0f7587c0a997 req-16805119-c919-4167-bf21-08aabe2388ad service nova] Creating event network-vif-deleted:29857c60-2ade-4b2f-b518-b9ceee5755c9 for instance d5911032-bcaa-4a3d-bb73-ccbea62de79b on n-h1-849328-3 Aug 24 10:13:35.653625 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-52835104-863b-403a-96cb-0f7587c0a997 req-16805119-c919-4167-bf21-08aabe2388ad service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091791 Aug 24 10:13:35.657685 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 329/709] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:13:35.676032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b6d47a0a-95f8-4804-944e-322291877956 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:35.676772 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b6d47a0a-95f8-4804-944e-322291877956 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:35.699780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6d47a0a-95f8-4804-944e-322291877956 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:35.700292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6d47a0a-95f8-4804-944e-322291877956 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:35.700735 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6d47a0a-95f8-4804-944e-322291877956 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:35.701698 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6d47a0a-95f8-4804-944e-322291877956 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:35.702059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6d47a0a-95f8-4804-944e-322291877956 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:35.702480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6d47a0a-95f8-4804-944e-322291877956 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:35.801443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d861265f-f2a8-4db0-b89a-ab6433d36023 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:35.824588 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d861265f-f2a8-4db0-b89a-ab6433d36023 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:35.826314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d861265f-f2a8-4db0-b89a-ab6433d36023 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:35.827651 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d861265f-f2a8-4db0-b89a-ab6433d36023 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 1567 microversion: 2.25 time: 0.574173 Aug 24 10:13:35.833490 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 381/710] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:13:35 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 1567 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:13:35.991475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ee5f21b1-dde0-4b7a-ae0e-52d7e5970a19 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:35.992157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ee5f21b1-dde0-4b7a-ae0e-52d7e5970a19 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:36.015791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee5f21b1-dde0-4b7a-ae0e-52d7e5970a19 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:36.016534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee5f21b1-dde0-4b7a-ae0e-52d7e5970a19 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:36.017566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee5f21b1-dde0-4b7a-ae0e-52d7e5970a19 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:36.018826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee5f21b1-dde0-4b7a-ae0e-52d7e5970a19 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:36.020056 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee5f21b1-dde0-4b7a-ae0e-52d7e5970a19 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:36.021980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee5f21b1-dde0-4b7a-ae0e-52d7e5970a19 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:36.359620 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b6d47a0a-95f8-4804-944e-322291877956 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:36.375539 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b6d47a0a-95f8-4804-944e-322291877956 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1463 microversion: 2.1 time: 0.716285 Aug 24 10:13:36.386169 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 330/711] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:35 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1463 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:36.387651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ee5f21b1-dde0-4b7a-ae0e-52d7e5970a19 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:36.392704 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cdbb14d6-d0d0-498f-aba8-20d77adf2e1f tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:36.401490 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cdbb14d6-d0d0-498f-aba8-20d77adf2e1f tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: d5911032-bcaa-4a3d-bb73-ccbea62de79b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:36.407832 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ee5f21b1-dde0-4b7a-ae0e-52d7e5970a19 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159" status: 200 len: 1324 microversion: 2.1 time: 0.420240 Aug 24 10:13:36.412768 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdbb14d6-d0d0-498f-aba8-20d77adf2e1f tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:36.413612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdbb14d6-d0d0-498f-aba8-20d77adf2e1f tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:36.414231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdbb14d6-d0d0-498f-aba8-20d77adf2e1f tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:36.418325 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdbb14d6-d0d0-498f-aba8-20d77adf2e1f tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:36.419184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdbb14d6-d0d0-498f-aba8-20d77adf2e1f tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:36.421011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdbb14d6-d0d0-498f-aba8-20d77adf2e1f tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:36.421875 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 382/712] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:35 2022] GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159 => generated 1324 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:13:36.444111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-74318dbd-4d9d-47c6-8e87-e4cd676b5140 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:36.444738 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-74318dbd-4d9d-47c6-8e87-e4cd676b5140 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:36.447605 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-cdbb14d6-d0d0-498f-aba8-20d77adf2e1f tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] HTTP exception thrown: Instance d5911032-bcaa-4a3d-bb73-ccbea62de79b could not be found. Aug 24 10:13:36.449681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cdbb14d6-d0d0-498f-aba8-20d77adf2e1f tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Request method failure captured: Aug 24 10:13:36.449681 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b HTTP/1.1 Aug 24 10:13:36.449681 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:13:36.449681 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:13:36.449681 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:13:36.449681 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:13:36.449681 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:13:36.449681 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:13:36.449681 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:13:36.449681 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:36.449681 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfk1Kj5eteTInLCGwsy22ZjS2-h29bwkKZYedCvB5uR6SkjQYQQ2LRDzz8Q4YhZ0wzz43SddZ2JZSfwqPe5fDCobR2mjbQzP7a6Zoo-EWsvi0HsZPxRi6rb6c4B-Jj9FyPiM-HzVF3n4oGYSamITpd4QKt6LZmSoWeesGDnjzp-EcFM Aug 24 10:13:36.449681 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:13:36.449681 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:13:36.449681 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:13:36.449681 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:13:36.449681 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:13:36.449681 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:13:36.449681 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 114821bb876c48869e113c5b6d8898d0 Aug 24 10:13:36.449681 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1935128973 Aug 24 10:13:36.449681 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:13:36.449681 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:13:36.451187 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/114821bb876c48869e113c5b6d8898d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_114821bb876c48869e113c5b6d8898d0", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/114821bb876c48869e113c5b6d8898d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/114821bb876c48869e113c5b6d8898d0"}]}] Aug 24 10:13:36.451187 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1935128973 Aug 24 10:13:36.451187 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 114821bb876c48869e113c5b6d8898d0 Aug 24 10:13:36.451187 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1935128973 Aug 24 10:13:36.451187 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1935128973-project Aug 24 10:13:36.451187 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:13:36.451187 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:13:36.451187 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: e5bc9c3828964edabe730dd66ee27ee4 Aug 24 10:13:36.451187 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1935128973-project Aug 24 10:13:36.451187 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:13:36.451187 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance d5911032-bcaa-4a3d-bb73-ccbea62de79b could not be found. Aug 24 10:13:36.451187 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'd5911032-bcaa-4a3d-bb73-ccbea62de79b'} Aug 24 10:13:36.451995 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:36.451995 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:36.451995 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:13:36.451995 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:13:36.451995 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:13:36.451995 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:13:36.451995 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:13:36.451995 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:13:36.451995 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:13:36.451995 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:13:36.451995 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5911032-bcaa-4a3d-bb73-ccbea62de79b could not be found. Aug 24 10:13:36.451995 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:36.451995 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:36.451995 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:36.451995 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:36.451995 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:36.451995 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:36.451995 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:36.451995 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:36.451995 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:36.453195 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:36.453195 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:13:36.453195 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:13:36.453195 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:13:36.453195 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:13:36.453195 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:13:36.453195 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:13:36.453195 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5911032-bcaa-4a3d-bb73-ccbea62de79b could not be found. Aug 24 10:13:36.453195 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:36.453195 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:36.453195 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:36.453195 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:36.453195 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:36.453195 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:36.453195 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:13:36.453195 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:13:36.453195 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5911032-bcaa-4a3d-bb73-ccbea62de79b could not be found. Aug 24 10:13:36.453195 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:36.458316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cdbb14d6-d0d0-498f-aba8-20d77adf2e1f tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Returning 404 to user: Instance d5911032-bcaa-4a3d-bb73-ccbea62de79b could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:36.459809 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cdbb14d6-d0d0-498f-aba8-20d77adf2e1f tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b" status: 404 len: 111 microversion: 2.1 time: 0.072182 Aug 24 10:13:36.462100 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 331/713] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:36 2022] GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:13:36.468017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74318dbd-4d9d-47c6-8e87-e4cd676b5140 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:36.468593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74318dbd-4d9d-47c6-8e87-e4cd676b5140 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:36.469035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74318dbd-4d9d-47c6-8e87-e4cd676b5140 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:36.469784 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74318dbd-4d9d-47c6-8e87-e4cd676b5140 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:36.470240 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74318dbd-4d9d-47c6-8e87-e4cd676b5140 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:36.470663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74318dbd-4d9d-47c6-8e87-e4cd676b5140 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:36.474288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1cb21f94-5ce9-459f-9641-2e1cb28872b2 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:36.475566 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1cb21f94-5ce9-459f-9641-2e1cb28872b2 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: 7e6f46da-f3b6-41ec-96f2-a3db16593a10] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:36.509489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cb21f94-5ce9-459f-9641-2e1cb28872b2 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:36.510261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cb21f94-5ce9-459f-9641-2e1cb28872b2 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:36.510891 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cb21f94-5ce9-459f-9641-2e1cb28872b2 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:36.511813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cb21f94-5ce9-459f-9641-2e1cb28872b2 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:36.512532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cb21f94-5ce9-459f-9641-2e1cb28872b2 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:36.514018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cb21f94-5ce9-459f-9641-2e1cb28872b2 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:36.543405 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-1cb21f94-5ce9-459f-9641-2e1cb28872b2 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] HTTP exception thrown: Instance 7e6f46da-f3b6-41ec-96f2-a3db16593a10 could not be found. Aug 24 10:13:36.546406 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1cb21f94-5ce9-459f-9641-2e1cb28872b2 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Request method failure captured: Aug 24 10:13:36.546406 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10 HTTP/1.1 Aug 24 10:13:36.546406 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:13:36.546406 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:13:36.546406 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:13:36.546406 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:13:36.546406 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:13:36.546406 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:13:36.546406 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:13:36.546406 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:36.546406 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfk1Kj5eteTInLCGwsy22ZjS2-h29bwkKZYedCvB5uR6SkjQYQQ2LRDzz8Q4YhZ0wzz43SddZ2JZSfwqPe5fDCobR2mjbQzP7a6Zoo-EWsvi0HsZPxRi6rb6c4B-Jj9FyPiM-HzVF3n4oGYSamITpd4QKt6LZmSoWeesGDnjzp-EcFM Aug 24 10:13:36.546406 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:13:36.546406 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:13:36.546406 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:13:36.546406 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:13:36.546406 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:13:36.546406 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:13:36.546406 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 114821bb876c48869e113c5b6d8898d0 Aug 24 10:13:36.546406 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1935128973 Aug 24 10:13:36.546406 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:13:36.546406 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:13:36.548867 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/114821bb876c48869e113c5b6d8898d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_114821bb876c48869e113c5b6d8898d0", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/114821bb876c48869e113c5b6d8898d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/114821bb876c48869e113c5b6d8898d0"}]}] Aug 24 10:13:36.548867 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1935128973 Aug 24 10:13:36.548867 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 114821bb876c48869e113c5b6d8898d0 Aug 24 10:13:36.548867 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1935128973 Aug 24 10:13:36.548867 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1935128973-project Aug 24 10:13:36.548867 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:13:36.548867 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:13:36.548867 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: e5bc9c3828964edabe730dd66ee27ee4 Aug 24 10:13:36.548867 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1935128973-project Aug 24 10:13:36.548867 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:13:36.548867 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 7e6f46da-f3b6-41ec-96f2-a3db16593a10 could not be found. Aug 24 10:13:36.548867 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '7e6f46da-f3b6-41ec-96f2-a3db16593a10'} Aug 24 10:13:36.550444 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:36.550444 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:36.550444 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:13:36.550444 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:13:36.550444 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:13:36.550444 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:13:36.550444 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:13:36.550444 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:13:36.550444 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:13:36.550444 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:13:36.550444 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e6f46da-f3b6-41ec-96f2-a3db16593a10 could not be found. Aug 24 10:13:36.550444 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:36.550444 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:36.550444 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:36.550444 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:36.550444 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:36.550444 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:36.550444 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:36.550444 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:36.550444 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:36.554502 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:36.554502 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:13:36.554502 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:13:36.554502 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:13:36.554502 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:13:36.554502 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:13:36.554502 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:13:36.554502 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:13:36.554502 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:13:36.554502 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e6f46da-f3b6-41ec-96f2-a3db16593a10 could not be found. Aug 24 10:13:36.554502 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:36.554502 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:36.554502 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:36.554502 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:36.554502 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:36.554502 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:36.554502 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:13:36.554502 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:13:36.554502 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e6f46da-f3b6-41ec-96f2-a3db16593a10 could not be found. Aug 24 10:13:36.554502 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:36.570219 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1cb21f94-5ce9-459f-9641-2e1cb28872b2 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Returning 404 to user: Instance 7e6f46da-f3b6-41ec-96f2-a3db16593a10 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:36.570219 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1cb21f94-5ce9-459f-9641-2e1cb28872b2 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "DELETE /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10" status: 404 len: 111 microversion: 2.1 time: 0.081049 Aug 24 10:13:36.570219 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 332/714] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:13:36 2022] DELETE /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:13:36.571734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-234b2e07-2b09-406f-963e-0e38676f3891 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:36.571992 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-234b2e07-2b09-406f-963e-0e38676f3891 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: 7e6f46da-f3b6-41ec-96f2-a3db16593a10] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:36.578790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-234b2e07-2b09-406f-963e-0e38676f3891 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:36.579288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-234b2e07-2b09-406f-963e-0e38676f3891 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:36.579884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-234b2e07-2b09-406f-963e-0e38676f3891 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:36.582564 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-234b2e07-2b09-406f-963e-0e38676f3891 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:36.583213 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-234b2e07-2b09-406f-963e-0e38676f3891 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:36.583718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-234b2e07-2b09-406f-963e-0e38676f3891 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:36.599721 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-234b2e07-2b09-406f-963e-0e38676f3891 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] HTTP exception thrown: Instance 7e6f46da-f3b6-41ec-96f2-a3db16593a10 could not be found. Aug 24 10:13:36.601504 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-234b2e07-2b09-406f-963e-0e38676f3891 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Request method failure captured: Aug 24 10:13:36.601504 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10 HTTP/1.1 Aug 24 10:13:36.601504 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:13:36.601504 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:13:36.601504 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:13:36.601504 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:13:36.601504 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:13:36.601504 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:13:36.601504 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:13:36.601504 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:36.601504 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfk1Kj5eteTInLCGwsy22ZjS2-h29bwkKZYedCvB5uR6SkjQYQQ2LRDzz8Q4YhZ0wzz43SddZ2JZSfwqPe5fDCobR2mjbQzP7a6Zoo-EWsvi0HsZPxRi6rb6c4B-Jj9FyPiM-HzVF3n4oGYSamITpd4QKt6LZmSoWeesGDnjzp-EcFM Aug 24 10:13:36.601504 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:13:36.601504 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:13:36.601504 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:13:36.601504 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:13:36.601504 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:13:36.601504 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:13:36.601504 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 114821bb876c48869e113c5b6d8898d0 Aug 24 10:13:36.601504 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1935128973 Aug 24 10:13:36.601504 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:13:36.601504 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:13:36.602835 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/114821bb876c48869e113c5b6d8898d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_114821bb876c48869e113c5b6d8898d0", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/114821bb876c48869e113c5b6d8898d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/114821bb876c48869e113c5b6d8898d0"}]}] Aug 24 10:13:36.602835 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1935128973 Aug 24 10:13:36.602835 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 114821bb876c48869e113c5b6d8898d0 Aug 24 10:13:36.602835 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1935128973 Aug 24 10:13:36.602835 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1935128973-project Aug 24 10:13:36.602835 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:13:36.602835 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:13:36.602835 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: e5bc9c3828964edabe730dd66ee27ee4 Aug 24 10:13:36.602835 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1935128973-project Aug 24 10:13:36.602835 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:13:36.602835 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 7e6f46da-f3b6-41ec-96f2-a3db16593a10 could not be found. Aug 24 10:13:36.602835 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '7e6f46da-f3b6-41ec-96f2-a3db16593a10'} Aug 24 10:13:36.603539 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:36.603539 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:36.603539 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:13:36.603539 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:13:36.603539 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:13:36.603539 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:13:36.603539 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:13:36.603539 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:13:36.603539 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:13:36.603539 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:13:36.603539 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e6f46da-f3b6-41ec-96f2-a3db16593a10 could not be found. Aug 24 10:13:36.603539 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:36.603539 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:36.603539 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:36.603539 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:36.603539 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:36.603539 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:36.603539 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:36.603539 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:36.603539 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:36.606463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:36.606463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:13:36.606463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:13:36.606463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:13:36.606463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:13:36.606463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:13:36.606463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:13:36.606463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e6f46da-f3b6-41ec-96f2-a3db16593a10 could not be found. Aug 24 10:13:36.606463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:36.606463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:36.606463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:36.606463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:36.606463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:36.606463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:36.606463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:13:36.606463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:13:36.606463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e6f46da-f3b6-41ec-96f2-a3db16593a10 could not be found. Aug 24 10:13:36.606463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:36.620369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-234b2e07-2b09-406f-963e-0e38676f3891 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Returning 404 to user: Instance 7e6f46da-f3b6-41ec-96f2-a3db16593a10 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:36.622816 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-234b2e07-2b09-406f-963e-0e38676f3891 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10" status: 404 len: 111 microversion: 2.1 time: 0.057432 Aug 24 10:13:36.624448 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 333/715] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:36 2022] GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:13:36.636431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-58713031-61d7-43c5-b0a7-170b2e6de1f1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:36.637389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-58713031-61d7-43c5-b0a7-170b2e6de1f1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 38332901-4cb3-4475-90f4-48ad729f16c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:36.647425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58713031-61d7-43c5-b0a7-170b2e6de1f1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:36.648362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58713031-61d7-43c5-b0a7-170b2e6de1f1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:36.649026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58713031-61d7-43c5-b0a7-170b2e6de1f1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:36.650173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58713031-61d7-43c5-b0a7-170b2e6de1f1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:36.650925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58713031-61d7-43c5-b0a7-170b2e6de1f1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:36.651580 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58713031-61d7-43c5-b0a7-170b2e6de1f1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:36.921048 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-74318dbd-4d9d-47c6-8e87-e4cd676b5140 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1614 microversion: 2.1 time: 0.491211 Aug 24 10:13:36.928403 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 383/716] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:36 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1614 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:36.933871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f25b73cf-6642-45a8-a8e1-c824c8c30ddf tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '.version_select at 0x7f46552f6d30>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:36.990220 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f25b73cf-6642-45a8-a8e1-c824c8c30ddf tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1759048096" status: 202 len: 0 microversion: 2.1 time: 0.060305 Aug 24 10:13:36.990828 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 384/717] 10.222.0.85 () {58 vars in 1221 bytes} [Wed Aug 24 10:13:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1759048096 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:13:36.995739 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-6052e11f-fdc0-4148-91ea-58073d64399d req-25931287-d506-411e-94db-d97a779d9701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38332901-4cb3-4475-90f4-48ad729f16c5", "name": "network-vif-plugged", "status": "completed", "tag": "d35c6350-b269-46fa-838a-6e7220b41d64"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:37.014720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6052e11f-fdc0-4148-91ea-58073d64399d req-25931287-d506-411e-94db-d97a779d9701 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:37.015644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6052e11f-fdc0-4148-91ea-58073d64399d req-25931287-d506-411e-94db-d97a779d9701 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:37.018913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6052e11f-fdc0-4148-91ea-58073d64399d req-25931287-d506-411e-94db-d97a779d9701 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:37.044227 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-6052e11f-fdc0-4148-91ea-58073d64399d req-25931287-d506-411e-94db-d97a779d9701 service nova] Creating event network-vif-plugged:d35c6350-b269-46fa-838a-6e7220b41d64 for instance 38332901-4cb3-4475-90f4-48ad729f16c5 on n-h2-849328-3 Aug 24 10:13:37.051570 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-6052e11f-fdc0-4148-91ea-58073d64399d req-25931287-d506-411e-94db-d97a779d9701 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059287 Aug 24 10:13:37.053226 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 385/718] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:13:37.059535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-07032d77-7a95-4b14-83bc-0edf6ddbe238 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:37.061255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-07032d77-7a95-4b14-83bc-0edf6ddbe238 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:37.072105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07032d77-7a95-4b14-83bc-0edf6ddbe238 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:37.072906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07032d77-7a95-4b14-83bc-0edf6ddbe238 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:37.073605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07032d77-7a95-4b14-83bc-0edf6ddbe238 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:37.074569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07032d77-7a95-4b14-83bc-0edf6ddbe238 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:37.075377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07032d77-7a95-4b14-83bc-0edf6ddbe238 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:37.076108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07032d77-7a95-4b14-83bc-0edf6ddbe238 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:37.131236 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-58713031-61d7-43c5-b0a7-170b2e6de1f1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:37.145418 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-58713031-61d7-43c5-b0a7-170b2e6de1f1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5" status: 200 len: 1317 microversion: 2.1 time: 0.518843 Aug 24 10:13:37.146362 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 334/719] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:36 2022] GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5 => generated 1317 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:37.151218 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3c119c94-bfc8-4202-8725-5f788c1e3e71 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Calling method '.version_select at 0x7f465556c4c0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:37.169652 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c119c94-bfc8-4202-8725-5f788c1e3e71 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:37.170479 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c119c94-bfc8-4202-8725-5f788c1e3e71 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:37.171084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c119c94-bfc8-4202-8725-5f788c1e3e71 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:37.194767 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3c119c94-bfc8-4202-8725-5f788c1e3e71 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] 10.222.0.85 "GET /compute/v2.1/os-migrations" status: 200 len: 1175 microversion: 2.1 time: 0.046903 Aug 24 10:13:37.196096 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 335/720] 10.222.0.85 () {58 vars in 1143 bytes} [Wed Aug 24 10:13:37 2022] GET /compute/v2.1/os-migrations => generated 1175 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:37.365058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aba67d90-3112-48af-bc81-3ccd58f3350d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-881316914", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:37.471349 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-aba67d90-3112-48af-bc81-3ccd58f3350d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:13:37.502525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-07032d77-7a95-4b14-83bc-0edf6ddbe238 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:37.515277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-07032d77-7a95-4b14-83bc-0edf6ddbe238 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:37.519238 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-07032d77-7a95-4b14-83bc-0edf6ddbe238 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:37.521855 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-07032d77-7a95-4b14-83bc-0edf6ddbe238 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 1567 microversion: 2.25 time: 0.466184 Aug 24 10:13:37.523287 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 386/721] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:13:37 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 1567 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:13:37.529238 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2460a888-6766-413f-8c26-aafca462ca70 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:37.530059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2460a888-6766-413f-8c26-aafca462ca70 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:37.542176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2460a888-6766-413f-8c26-aafca462ca70 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:37.543018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2460a888-6766-413f-8c26-aafca462ca70 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:37.543682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2460a888-6766-413f-8c26-aafca462ca70 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:37.545305 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2460a888-6766-413f-8c26-aafca462ca70 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:37.551931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2460a888-6766-413f-8c26-aafca462ca70 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:37.553497 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2460a888-6766-413f-8c26-aafca462ca70 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:37.920846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2460a888-6766-413f-8c26-aafca462ca70 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:37.930082 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2460a888-6766-413f-8c26-aafca462ca70 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159" status: 200 len: 1324 microversion: 2.1 time: 0.405141 Aug 24 10:13:37.949543 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 387/722] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:37 2022] GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159 => generated 1324 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:38.115737 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-aba67d90-3112-48af-bc81-3ccd58f3350d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:13:38.116449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-aba67d90-3112-48af-bc81-3ccd58f3350d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:13:38.116814 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-aba67d90-3112-48af-bc81-3ccd58f3350d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:13:38.117345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-aba67d90-3112-48af-bc81-3ccd58f3350d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:13:38.117855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-aba67d90-3112-48af-bc81-3ccd58f3350d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:13:38.133717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aba67d90-3112-48af-bc81-3ccd58f3350d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:38.134739 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aba67d90-3112-48af-bc81-3ccd58f3350d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:38.135996 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aba67d90-3112-48af-bc81-3ccd58f3350d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:38.137305 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aba67d90-3112-48af-bc81-3ccd58f3350d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:38.139794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aba67d90-3112-48af-bc81-3ccd58f3350d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:38.140623 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aba67d90-3112-48af-bc81-3ccd58f3350d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:38.168819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-aba67d90-3112-48af-bc81-3ccd58f3350d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Getting quotas for project 7947a063a37946b7870e95dfd7a2e7e6. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:13:38.180877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec95320a-d12c-435b-aaad-c0da674e6b95 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:38.181666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-aba67d90-3112-48af-bc81-3ccd58f3350d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Getting quotas for user 53af167c0c744cbb910ff5860767cb95 and project 7947a063a37946b7870e95dfd7a2e7e6. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:13:38.182969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ec95320a-d12c-435b-aaad-c0da674e6b95 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 38332901-4cb3-4475-90f4-48ad729f16c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:38.192653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec95320a-d12c-435b-aaad-c0da674e6b95 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:38.193274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec95320a-d12c-435b-aaad-c0da674e6b95 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:38.193836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec95320a-d12c-435b-aaad-c0da674e6b95 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:38.195578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec95320a-d12c-435b-aaad-c0da674e6b95 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:38.196641 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec95320a-d12c-435b-aaad-c0da674e6b95 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:38.197910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec95320a-d12c-435b-aaad-c0da674e6b95 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:38.213371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aba67d90-3112-48af-bc81-3ccd58f3350d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:13:38.218930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aba67d90-3112-48af-bc81-3ccd58f3350d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:13:38.243280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:38.304871 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aba67d90-3112-48af-bc81-3ccd58f3350d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.944238 Aug 24 10:13:38.306806 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 336/723] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:13:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:13:38.318637 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6808ce34-1278-4aa6-9a7a-9959f66c8b77 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:38.319604 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6808ce34-1278-4aa6-9a7a-9959f66c8b77 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:38.505841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6808ce34-1278-4aa6-9a7a-9959f66c8b77 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:38.520709 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6808ce34-1278-4aa6-9a7a-9959f66c8b77 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1212 microversion: 2.1 time: 0.206237 Aug 24 10:13:38.521352 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 337/724] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:38 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1212 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:13:38.555005 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3fe924c5-4c84-4b61-999d-3b758086159f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:38.555622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3fe924c5-4c84-4b61-999d-3b758086159f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:38.567332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fe924c5-4c84-4b61-999d-3b758086159f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:38.567824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fe924c5-4c84-4b61-999d-3b758086159f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:38.568261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fe924c5-4c84-4b61-999d-3b758086159f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:38.568987 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fe924c5-4c84-4b61-999d-3b758086159f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:38.569480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fe924c5-4c84-4b61-999d-3b758086159f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:38.569905 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fe924c5-4c84-4b61-999d-3b758086159f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:38.789287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ec95320a-d12c-435b-aaad-c0da674e6b95 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:38.823466 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ec95320a-d12c-435b-aaad-c0da674e6b95 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5" status: 200 len: 1317 microversion: 2.1 time: 0.650182 Aug 24 10:13:38.824347 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 388/725] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:38 2022] GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5 => generated 1317 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:38.837157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5c202bf2-af61-47fb-ae2f-da92b42e1e59 tempest-ServersWithSpecificFlavorTestJSON-113520978 tempest-ServersWithSpecificFlavorTestJSON-113520978-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:38.838054 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:13:38.838054 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:13:38.876964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3fe924c5-4c84-4b61-999d-3b758086159f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:38.899244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3fe924c5-4c84-4b61-999d-3b758086159f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:38.906045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3fe924c5-4c84-4b61-999d-3b758086159f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:38.911467 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5c202bf2-af61-47fb-ae2f-da92b42e1e59 tempest-ServersWithSpecificFlavorTestJSON-113520978 tempest-ServersWithSpecificFlavorTestJSON-113520978-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/226636201" status: 202 len: 0 microversion: 2.1 time: 0.079445 Aug 24 10:13:38.912682 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3fe924c5-4c84-4b61-999d-3b758086159f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 1542 microversion: 2.25 time: 0.360621 Aug 24 10:13:38.914899 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 389/726] 10.222.0.85 () {58 vars in 1158 bytes} [Wed Aug 24 10:13:38 2022] DELETE /compute/v2.1/flavors/226636201 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:13:38.934511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d5871910-f1f9-4c10-8ec2-ca56641d257b tempest-ServersWithSpecificFlavorTestJSON-113520978 tempest-ServersWithSpecificFlavorTestJSON-113520978-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:38.938488 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 338/727] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:13:38 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 1542 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:13:38.950390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2e4316b2-5fd0-47e3-ab8c-1b369db132bb tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Calling method '.version_select at 0x7f465540cc10>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:38.955331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e4316b2-5fd0-47e3-ab8c-1b369db132bb tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:38.955971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e4316b2-5fd0-47e3-ab8c-1b369db132bb tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:38.956685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e4316b2-5fd0-47e3-ab8c-1b369db132bb tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:38.972771 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2e4316b2-5fd0-47e3-ab8c-1b369db132bb tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] 10.222.0.85 "GET /compute/v2.1/os-migrations" status: 200 len: 1524 microversion: 2.25 time: 0.027784 Aug 24 10:13:38.984932 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d5871910-f1f9-4c10-8ec2-ca56641d257b tempest-ServersWithSpecificFlavorTestJSON-113520978 tempest-ServersWithSpecificFlavorTestJSON-113520978-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 5402 microversion: 2.1 time: 0.061066 Aug 24 10:13:38.986444 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 339/728] 10.222.0.85 () {60 vars in 1184 bytes} [Wed Aug 24 10:13:38 2022] GET /compute/v2.1/os-migrations => generated 1524 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:13:38.994576 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 390/729] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:13:38 2022] GET /compute/v2.1/flavors/detail => generated 5402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:38.997821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9ab3aa41-c8aa-4180-b326-de40820a0a17 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:38.999107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9ab3aa41-c8aa-4180-b326-de40820a0a17 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:39.009184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ab3aa41-c8aa-4180-b326-de40820a0a17 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:39.009985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ab3aa41-c8aa-4180-b326-de40820a0a17 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:39.010608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ab3aa41-c8aa-4180-b326-de40820a0a17 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:39.011483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ab3aa41-c8aa-4180-b326-de40820a0a17 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:39.012088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ab3aa41-c8aa-4180-b326-de40820a0a17 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:39.013876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ab3aa41-c8aa-4180-b326-de40820a0a17 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:39.255112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9ab3aa41-c8aa-4180-b326-de40820a0a17 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:39.271563 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9ab3aa41-c8aa-4180-b326-de40820a0a17 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159" status: 200 len: 1324 microversion: 2.1 time: 0.282778 Aug 24 10:13:39.272498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-69760ab6-a527-4c04-a891-0901b5e7b8d6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-385335968", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "b3bbedfb-51dc-4363-a78d-44d0daaa6110"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:39.285780 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 340/730] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:38 2022] GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159 => generated 1324 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:39.300697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ae3b7f3e-18a0-4023-9c05-a43e80addf44 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:39.301706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ae3b7f3e-18a0-4023-9c05-a43e80addf44 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:39.308988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae3b7f3e-18a0-4023-9c05-a43e80addf44 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:39.309770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae3b7f3e-18a0-4023-9c05-a43e80addf44 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:39.310371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae3b7f3e-18a0-4023-9c05-a43e80addf44 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:39.314008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae3b7f3e-18a0-4023-9c05-a43e80addf44 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:39.314685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae3b7f3e-18a0-4023-9c05-a43e80addf44 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:39.316077 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae3b7f3e-18a0-4023-9c05-a43e80addf44 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:39.421852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-69760ab6-a527-4c04-a891-0901b5e7b8d6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] validate_networks() for [('b3bbedfb-51dc-4363-a78d-44d0daaa6110', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:13:39.647581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-ae3b7f3e-18a0-4023-9c05-a43e80addf44 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lazy-loading 'services' on Instance uuid 26944760-9a04-4f1a-8d41-148a947f41f1 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:13:39.676974 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ae3b7f3e-18a0-4023-9c05-a43e80addf44 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 2034 microversion: 2.25 time: 0.388729 Aug 24 10:13:39.676974 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 341/731] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:13:39 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 2034 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:13:39.697176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ed3f7cde-23ac-481c-9130-996b82ac89c8 tempest-ServersWithSpecificFlavorTestJSON-113520978 tempest-ServersWithSpecificFlavorTestJSON-113520978-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:39.698107 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:13:39.698107 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:13:39.743721 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ed3f7cde-23ac-481c-9130-996b82ac89c8 tempest-ServersWithSpecificFlavorTestJSON-113520978 tempest-ServersWithSpecificFlavorTestJSON-113520978-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/280669823" status: 202 len: 0 microversion: 2.1 time: 0.065266 Aug 24 10:13:39.744333 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 342/732] 10.222.0.85 () {58 vars in 1158 bytes} [Wed Aug 24 10:13:39 2022] DELETE /compute/v2.1/flavors/280669823 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:13:39.757424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-815f4b23-dfd4-4706-8fa7-592a22934814 req-3b0db9b6-52a1-45ca-af5a-498ce95471a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c285a5a5-ba66-41c8-aa67-402e2d5f9159", "name": "network-vif-plugged", "status": "completed", "tag": "ad70c32a-b650-4c05-bd90-a010a57fd42f"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:39.783101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-815f4b23-dfd4-4706-8fa7-592a22934814 req-3b0db9b6-52a1-45ca-af5a-498ce95471a5 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:39.783741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-815f4b23-dfd4-4706-8fa7-592a22934814 req-3b0db9b6-52a1-45ca-af5a-498ce95471a5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:39.784277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-815f4b23-dfd4-4706-8fa7-592a22934814 req-3b0db9b6-52a1-45ca-af5a-498ce95471a5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:39.840652 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-815f4b23-dfd4-4706-8fa7-592a22934814 req-3b0db9b6-52a1-45ca-af5a-498ce95471a5 service nova] Creating event network-vif-plugged:ad70c32a-b650-4c05-bd90-a010a57fd42f for instance c285a5a5-ba66-41c8-aa67-402e2d5f9159 on n-h1-849328-3 Aug 24 10:13:39.866055 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-815f4b23-dfd4-4706-8fa7-592a22934814 req-3b0db9b6-52a1-45ca-af5a-498ce95471a5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117713 Aug 24 10:13:39.866878 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 343/733] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:13:39.884073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eede2cb2-6267-4765-9679-466dac9dab46 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:39.884790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eede2cb2-6267-4765-9679-466dac9dab46 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:39.897408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:39.913356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eede2cb2-6267-4765-9679-466dac9dab46 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:39.914250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eede2cb2-6267-4765-9679-466dac9dab46 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:39.925466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eede2cb2-6267-4765-9679-466dac9dab46 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:39.928554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eede2cb2-6267-4765-9679-466dac9dab46 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:39.932401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eede2cb2-6267-4765-9679-466dac9dab46 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:39.935259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eede2cb2-6267-4765-9679-466dac9dab46 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:40.097866 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eede2cb2-6267-4765-9679-466dac9dab46 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:40.101354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-69760ab6-a527-4c04-a891-0901b5e7b8d6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:13:40.101787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-69760ab6-a527-4c04-a891-0901b5e7b8d6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:13:40.102658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-69760ab6-a527-4c04-a891-0901b5e7b8d6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:13:40.102658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-69760ab6-a527-4c04-a891-0901b5e7b8d6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:13:40.103061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-69760ab6-a527-4c04-a891-0901b5e7b8d6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:13:40.113590 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eede2cb2-6267-4765-9679-466dac9dab46 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1208 microversion: 2.1 time: 0.235703 Aug 24 10:13:40.116260 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 344/734] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:39 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1208 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:40.120444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69760ab6-a527-4c04-a891-0901b5e7b8d6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:40.120948 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69760ab6-a527-4c04-a891-0901b5e7b8d6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:40.121423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69760ab6-a527-4c04-a891-0901b5e7b8d6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:40.122156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69760ab6-a527-4c04-a891-0901b5e7b8d6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:40.122616 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69760ab6-a527-4c04-a891-0901b5e7b8d6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:40.123041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69760ab6-a527-4c04-a891-0901b5e7b8d6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:40.136364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-65a05927-7e5b-425c-9243-0b4175f41945 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Action: 'create', calling method: .version_select at 0x7f46557d6ca0>, body: {"keypair": {"name": "tempest-keypair-923277923", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFG9lRytfYesLQ0jjMTxsmg/JpV9tLD80jcUe5OIqHKIALOFj8Afaf0/Ydrv/xAvchfUGs76m/OR5dFYEZEZKX8N3DRk7lTkWNYY+fBAPnh06ufbMQtfM/BDQF35UJPpsA=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:40.195254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-69760ab6-a527-4c04-a891-0901b5e7b8d6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Getting quotas for project d30703728b2a4a569b6dd1608d8956b8. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:13:40.215598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-69760ab6-a527-4c04-a891-0901b5e7b8d6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Getting quotas for user 85db443623964ed381b2a4cfc7310202 and project d30703728b2a4a569b6dd1608d8956b8. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:13:40.229844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-65a05927-7e5b-425c-9243-0b4175f41945 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Getting quotas for project 34b2b8fc487d4a6abb08f132e0f0c1da. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:13:40.245428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-65a05927-7e5b-425c-9243-0b4175f41945 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Getting quotas for user dfd26847179f4f2bab0c9f673de0c303 and project 34b2b8fc487d4a6abb08f132e0f0c1da. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:13:40.246154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-69760ab6-a527-4c04-a891-0901b5e7b8d6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:13:40.266690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-69760ab6-a527-4c04-a891-0901b5e7b8d6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:13:40.303810 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-65a05927-7e5b-425c-9243-0b4175f41945 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.184211 Aug 24 10:13:40.303810 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 345/735] 10.222.0.85 () {62 vars in 1200 bytes} [Wed Aug 24 10:13:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 186 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 10:13:40.309291 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ee3c5e7b-6b46-48da-a21d-ca75124c1a8c tempest-ServersWithSpecificFlavorTestJSON-113520978 tempest-ServersWithSpecificFlavorTestJSON-113520978-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:40.372802 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ee3c5e7b-6b46-48da-a21d-ca75124c1a8c tempest-ServersWithSpecificFlavorTestJSON-113520978 tempest-ServersWithSpecificFlavorTestJSON-113520978-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.065280 Aug 24 10:13:40.379173 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 346/736] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:13:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:40.395737 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e100aeb2-7821-4415-a28c-5c65b5dc7784 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:40.399708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e100aeb2-7821-4415-a28c-5c65b5dc7784 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 38332901-4cb3-4475-90f4-48ad729f16c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:40.404026 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-69760ab6-a527-4c04-a891-0901b5e7b8d6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.407640 Aug 24 10:13:40.404917 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 391/737] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:13:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:13:40.409800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e100aeb2-7821-4415-a28c-5c65b5dc7784 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:40.410532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e100aeb2-7821-4415-a28c-5c65b5dc7784 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:40.411442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e100aeb2-7821-4415-a28c-5c65b5dc7784 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:40.412347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e100aeb2-7821-4415-a28c-5c65b5dc7784 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:40.412964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e100aeb2-7821-4415-a28c-5c65b5dc7784 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:40.413572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e100aeb2-7821-4415-a28c-5c65b5dc7784 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:40.425432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c5e52d00-6e3e-40e5-a436-f8409961c1c3 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:40.425859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c5e52d00-6e3e-40e5-a436-f8409961c1c3 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:40.454143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:40.455789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5e52d00-6e3e-40e5-a436-f8409961c1c3 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:40.459193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5e52d00-6e3e-40e5-a436-f8409961c1c3 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:40.459889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5e52d00-6e3e-40e5-a436-f8409961c1c3 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:40.461354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5e52d00-6e3e-40e5-a436-f8409961c1c3 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:40.466010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5e52d00-6e3e-40e5-a436-f8409961c1c3 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:40.466842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5e52d00-6e3e-40e5-a436-f8409961c1c3 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:40.785277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c5e52d00-6e3e-40e5-a436-f8409961c1c3 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:40.795542 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c5e52d00-6e3e-40e5-a436-f8409961c1c3 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159" status: 200 len: 1324 microversion: 2.1 time: 0.389105 Aug 24 10:13:40.801533 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 392/738] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:40 2022] GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159 => generated 1324 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:40.807891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a92cc0b2-4721-4125-800e-768f406c68d4 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:40.815160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a92cc0b2-4721-4125-800e-768f406c68d4 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: d5911032-bcaa-4a3d-bb73-ccbea62de79b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:40.827979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a92cc0b2-4721-4125-800e-768f406c68d4 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:40.828489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a92cc0b2-4721-4125-800e-768f406c68d4 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:40.828939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a92cc0b2-4721-4125-800e-768f406c68d4 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:40.829700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a92cc0b2-4721-4125-800e-768f406c68d4 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:40.830158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a92cc0b2-4721-4125-800e-768f406c68d4 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:40.830582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a92cc0b2-4721-4125-800e-768f406c68d4 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:40.830752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e100aeb2-7821-4415-a28c-5c65b5dc7784 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:40.851793 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e100aeb2-7821-4415-a28c-5c65b5dc7784 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5" status: 200 len: 1467 microversion: 2.1 time: 0.469239 Aug 24 10:13:40.852721 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 347/739] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:40 2022] GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5 => generated 1467 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:40.864175 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-a92cc0b2-4721-4125-800e-768f406c68d4 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] HTTP exception thrown: Instance d5911032-bcaa-4a3d-bb73-ccbea62de79b could not be found. Aug 24 10:13:40.870617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a92cc0b2-4721-4125-800e-768f406c68d4 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Request method failure captured: Aug 24 10:13:40.870617 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b HTTP/1.1 Aug 24 10:13:40.870617 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:13:40.870617 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:13:40.870617 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:13:40.870617 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:13:40.870617 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:13:40.870617 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:13:40.870617 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:13:40.870617 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:40.870617 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfk1Kj5eteTInLCGwsy22ZjS2-h29bwkKZYedCvB5uR6SkjQYQQ2LRDzz8Q4YhZ0wzz43SddZ2JZSfwqPe5fDCobR2mjbQzP7a6Zoo-EWsvi0HsZPxRi6rb6c4B-Jj9FyPiM-HzVF3n4oGYSamITpd4QKt6LZmSoWeesGDnjzp-EcFM Aug 24 10:13:40.870617 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:13:40.870617 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:13:40.870617 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:13:40.870617 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:13:40.870617 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:13:40.870617 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:13:40.870617 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 114821bb876c48869e113c5b6d8898d0 Aug 24 10:13:40.870617 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1935128973 Aug 24 10:13:40.870617 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:13:40.870617 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:13:40.872241 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/114821bb876c48869e113c5b6d8898d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_114821bb876c48869e113c5b6d8898d0", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/114821bb876c48869e113c5b6d8898d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/114821bb876c48869e113c5b6d8898d0"}]}] Aug 24 10:13:40.872241 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1935128973 Aug 24 10:13:40.872241 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 114821bb876c48869e113c5b6d8898d0 Aug 24 10:13:40.872241 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1935128973 Aug 24 10:13:40.872241 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1935128973-project Aug 24 10:13:40.872241 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:13:40.872241 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:13:40.872241 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: e5bc9c3828964edabe730dd66ee27ee4 Aug 24 10:13:40.872241 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1935128973-project Aug 24 10:13:40.872241 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:13:40.872241 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance d5911032-bcaa-4a3d-bb73-ccbea62de79b could not be found. Aug 24 10:13:40.872241 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'd5911032-bcaa-4a3d-bb73-ccbea62de79b'} Aug 24 10:13:40.873227 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:40.873227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:40.873227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:13:40.873227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:13:40.873227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:13:40.873227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:13:40.873227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:13:40.873227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:13:40.873227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:13:40.873227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:13:40.873227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5911032-bcaa-4a3d-bb73-ccbea62de79b could not be found. Aug 24 10:13:40.873227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:40.873227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:40.873227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:40.873227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:40.873227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:40.873227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:40.873227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:40.873227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:40.873227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:40.874465 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:40.874465 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:13:40.874465 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:13:40.874465 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:13:40.874465 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:13:40.874465 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:13:40.874465 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:13:40.874465 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:13:40.874465 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:13:40.874465 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5911032-bcaa-4a3d-bb73-ccbea62de79b could not be found. Aug 24 10:13:40.874465 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:40.874465 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:40.874465 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:40.874465 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:40.874465 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:40.874465 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:40.874465 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:13:40.874465 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:13:40.874465 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5911032-bcaa-4a3d-bb73-ccbea62de79b could not be found. Aug 24 10:13:40.874465 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:40.875800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e3c1f1be-cd00-4a81-a861-90395ecafae5 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:40.875800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e3c1f1be-cd00-4a81-a861-90395ecafae5 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:40.882769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a92cc0b2-4721-4125-800e-768f406c68d4 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Returning 404 to user: Instance d5911032-bcaa-4a3d-bb73-ccbea62de79b could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:40.883917 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a92cc0b2-4721-4125-800e-768f406c68d4 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b" status: 404 len: 111 microversion: 2.1 time: 0.080544 Aug 24 10:13:40.885371 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 393/740] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:13:40 2022] DELETE /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:13:40.902905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f56e3117-bdee-4cf3-9269-2f76ef67a2cb tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:40.903855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f56e3117-bdee-4cf3-9269-2f76ef67a2cb tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] [instance: 38332901-4cb3-4475-90f4-48ad729f16c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:40.930629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f56e3117-bdee-4cf3-9269-2f76ef67a2cb tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:40.931051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f56e3117-bdee-4cf3-9269-2f76ef67a2cb tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:40.931697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f56e3117-bdee-4cf3-9269-2f76ef67a2cb tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:40.932431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f56e3117-bdee-4cf3-9269-2f76ef67a2cb tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:40.932896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f56e3117-bdee-4cf3-9269-2f76ef67a2cb tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:40.933353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f56e3117-bdee-4cf3-9269-2f76ef67a2cb tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:41.086414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e3c1f1be-cd00-4a81-a861-90395ecafae5 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:41.097275 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e3c1f1be-cd00-4a81-a861-90395ecafae5 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab" status: 200 len: 1207 microversion: 2.1 time: 0.242013 Aug 24 10:13:41.098146 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 348/741] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:40 2022] GET /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab => generated 1207 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:41.112038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-624ae3ab-f556-416c-9eee-5d60ad86ebd7 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:41.114365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-624ae3ab-f556-416c-9eee-5d60ad86ebd7 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: d5911032-bcaa-4a3d-bb73-ccbea62de79b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:41.123910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-624ae3ab-f556-416c-9eee-5d60ad86ebd7 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:41.124401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-624ae3ab-f556-416c-9eee-5d60ad86ebd7 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:41.125075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-624ae3ab-f556-416c-9eee-5d60ad86ebd7 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:41.126003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-624ae3ab-f556-416c-9eee-5d60ad86ebd7 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:41.126642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-624ae3ab-f556-416c-9eee-5d60ad86ebd7 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:41.127232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-624ae3ab-f556-416c-9eee-5d60ad86ebd7 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:41.148624 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-624ae3ab-f556-416c-9eee-5d60ad86ebd7 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] HTTP exception thrown: Instance d5911032-bcaa-4a3d-bb73-ccbea62de79b could not be found. Aug 24 10:13:41.152265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-624ae3ab-f556-416c-9eee-5d60ad86ebd7 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Request method failure captured: Aug 24 10:13:41.152265 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b HTTP/1.1 Aug 24 10:13:41.152265 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:13:41.152265 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:13:41.152265 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:13:41.152265 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:13:41.152265 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:13:41.152265 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:13:41.152265 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:13:41.152265 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:41.152265 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfk1Kj5eteTInLCGwsy22ZjS2-h29bwkKZYedCvB5uR6SkjQYQQ2LRDzz8Q4YhZ0wzz43SddZ2JZSfwqPe5fDCobR2mjbQzP7a6Zoo-EWsvi0HsZPxRi6rb6c4B-Jj9FyPiM-HzVF3n4oGYSamITpd4QKt6LZmSoWeesGDnjzp-EcFM Aug 24 10:13:41.152265 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:13:41.152265 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:13:41.152265 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:13:41.152265 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:13:41.152265 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:13:41.152265 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:13:41.152265 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 114821bb876c48869e113c5b6d8898d0 Aug 24 10:13:41.152265 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1935128973 Aug 24 10:13:41.152265 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:13:41.152265 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:13:41.154230 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/114821bb876c48869e113c5b6d8898d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_114821bb876c48869e113c5b6d8898d0", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/114821bb876c48869e113c5b6d8898d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/114821bb876c48869e113c5b6d8898d0"}]}] Aug 24 10:13:41.154230 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1935128973 Aug 24 10:13:41.154230 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 114821bb876c48869e113c5b6d8898d0 Aug 24 10:13:41.154230 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1935128973 Aug 24 10:13:41.154230 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1935128973-project Aug 24 10:13:41.154230 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:13:41.154230 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:13:41.154230 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: e5bc9c3828964edabe730dd66ee27ee4 Aug 24 10:13:41.154230 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1935128973-project Aug 24 10:13:41.154230 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:13:41.154230 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance d5911032-bcaa-4a3d-bb73-ccbea62de79b could not be found. Aug 24 10:13:41.154230 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'd5911032-bcaa-4a3d-bb73-ccbea62de79b'} Aug 24 10:13:41.155124 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:41.155124 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:41.155124 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:13:41.155124 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:13:41.155124 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:13:41.155124 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:13:41.155124 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:13:41.155124 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:13:41.155124 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:13:41.155124 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:13:41.155124 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5911032-bcaa-4a3d-bb73-ccbea62de79b could not be found. Aug 24 10:13:41.155124 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:41.155124 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:41.155124 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:41.155124 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:41.155124 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:41.155124 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:41.155124 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:41.155124 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:41.155124 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:41.158016 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:41.158016 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:13:41.158016 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:13:41.158016 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:13:41.158016 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:13:41.158016 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:13:41.158016 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:13:41.158016 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5911032-bcaa-4a3d-bb73-ccbea62de79b could not be found. Aug 24 10:13:41.158016 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:41.158016 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:41.158016 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:41.158016 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:41.158016 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:41.158016 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:41.158016 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:13:41.158016 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:13:41.158016 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5911032-bcaa-4a3d-bb73-ccbea62de79b could not be found. Aug 24 10:13:41.158016 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:41.163154 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-624ae3ab-f556-416c-9eee-5d60ad86ebd7 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Returning 404 to user: Instance d5911032-bcaa-4a3d-bb73-ccbea62de79b could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:41.166533 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-624ae3ab-f556-416c-9eee-5d60ad86ebd7 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b" status: 404 len: 111 microversion: 2.1 time: 0.064384 Aug 24 10:13:41.172636 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 349/742] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:41 2022] GET /compute/v2.1/servers/d5911032-bcaa-4a3d-bb73-ccbea62de79b => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:13:41.503167 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f56e3117-bdee-4cf3-9269-2f76ef67a2cb tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5" status: 200 len: 1618 microversion: 2.1 time: 0.612103 Aug 24 10:13:41.521190 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 394/743] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:40 2022] GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5 => generated 1618 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:41.522960 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a51770e9-b3fb-4ae7-acd4-53893c7f92f5 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Calling method '.version_select at 0x7f46554b9f70>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:41.522960 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:13:41.522960 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:13:41.522960 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a51770e9-b3fb-4ae7-acd4-53893c7f92f5 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:41.524501 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a51770e9-b3fb-4ae7-acd4-53893c7f92f5 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:41.525848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a51770e9-b3fb-4ae7-acd4-53893c7f92f5 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:41.565274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-13658ece-1efc-4582-8ed8-0625d0b1e1b9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:41.566802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-13658ece-1efc-4582-8ed8-0625d0b1e1b9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:41.580024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13658ece-1efc-4582-8ed8-0625d0b1e1b9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:41.581548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13658ece-1efc-4582-8ed8-0625d0b1e1b9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:41.582652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13658ece-1efc-4582-8ed8-0625d0b1e1b9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:41.584286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13658ece-1efc-4582-8ed8-0625d0b1e1b9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:41.585628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13658ece-1efc-4582-8ed8-0625d0b1e1b9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:41.586723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13658ece-1efc-4582-8ed8-0625d0b1e1b9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:41.593086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a51770e9-b3fb-4ae7-acd4-53893c7f92f5 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:41.593683 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a51770e9-b3fb-4ae7-acd4-53893c7f92f5 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:41.594473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a51770e9-b3fb-4ae7-acd4-53893c7f92f5 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:41.609088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a51770e9-b3fb-4ae7-acd4-53893c7f92f5 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:41.609696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a51770e9-b3fb-4ae7-acd4-53893c7f92f5 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:41.610419 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a51770e9-b3fb-4ae7-acd4-53893c7f92f5 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:41.620561 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a51770e9-b3fb-4ae7-acd4-53893c7f92f5 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.445946 Aug 24 10:13:41.630697 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 350/744] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:13:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:13:41.637551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fdab484c-f218-4820-8bd4-30eff31fa746 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:41.638266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fdab484c-f218-4820-8bd4-30eff31fa746 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: 7e6f46da-f3b6-41ec-96f2-a3db16593a10] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:41.646539 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdab484c-f218-4820-8bd4-30eff31fa746 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:41.648256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdab484c-f218-4820-8bd4-30eff31fa746 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:41.648648 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdab484c-f218-4820-8bd4-30eff31fa746 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:41.650163 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdab484c-f218-4820-8bd4-30eff31fa746 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:41.651006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdab484c-f218-4820-8bd4-30eff31fa746 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:41.652160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdab484c-f218-4820-8bd4-30eff31fa746 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:41.656107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:41.684404 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-fdab484c-f218-4820-8bd4-30eff31fa746 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] HTTP exception thrown: Instance 7e6f46da-f3b6-41ec-96f2-a3db16593a10 could not be found. Aug 24 10:13:41.686220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fdab484c-f218-4820-8bd4-30eff31fa746 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Request method failure captured: Aug 24 10:13:41.686220 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10 HTTP/1.1 Aug 24 10:13:41.686220 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:13:41.686220 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:13:41.686220 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:13:41.686220 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:13:41.686220 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:13:41.686220 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:13:41.686220 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:13:41.686220 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:41.686220 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfk1Kj5eteTInLCGwsy22ZjS2-h29bwkKZYedCvB5uR6SkjQYQQ2LRDzz8Q4YhZ0wzz43SddZ2JZSfwqPe5fDCobR2mjbQzP7a6Zoo-EWsvi0HsZPxRi6rb6c4B-Jj9FyPiM-HzVF3n4oGYSamITpd4QKt6LZmSoWeesGDnjzp-EcFM Aug 24 10:13:41.686220 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:13:41.686220 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:13:41.686220 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:13:41.686220 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:13:41.686220 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:13:41.686220 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:13:41.686220 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 114821bb876c48869e113c5b6d8898d0 Aug 24 10:13:41.686220 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1935128973 Aug 24 10:13:41.686220 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:13:41.686220 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:13:41.688714 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/114821bb876c48869e113c5b6d8898d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_114821bb876c48869e113c5b6d8898d0", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/114821bb876c48869e113c5b6d8898d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/114821bb876c48869e113c5b6d8898d0"}]}] Aug 24 10:13:41.688714 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1935128973 Aug 24 10:13:41.688714 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 114821bb876c48869e113c5b6d8898d0 Aug 24 10:13:41.688714 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1935128973 Aug 24 10:13:41.688714 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1935128973-project Aug 24 10:13:41.688714 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:13:41.688714 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:13:41.688714 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: e5bc9c3828964edabe730dd66ee27ee4 Aug 24 10:13:41.688714 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1935128973-project Aug 24 10:13:41.688714 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:13:41.688714 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 7e6f46da-f3b6-41ec-96f2-a3db16593a10 could not be found. Aug 24 10:13:41.688714 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '7e6f46da-f3b6-41ec-96f2-a3db16593a10'} Aug 24 10:13:41.690050 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:41.690050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:41.690050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:13:41.690050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:13:41.690050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:13:41.690050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:13:41.690050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:13:41.690050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:13:41.690050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:13:41.690050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:13:41.690050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e6f46da-f3b6-41ec-96f2-a3db16593a10 could not be found. Aug 24 10:13:41.690050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:41.690050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:41.690050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:41.690050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:41.690050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:41.690050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:41.690050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:41.690050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:41.690050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:41.696181 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:41.696181 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:13:41.696181 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:13:41.696181 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:13:41.696181 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:13:41.696181 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:13:41.696181 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:13:41.696181 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:13:41.696181 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:13:41.696181 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e6f46da-f3b6-41ec-96f2-a3db16593a10 could not be found. Aug 24 10:13:41.696181 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:41.696181 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:41.696181 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:41.696181 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:41.696181 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:41.696181 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:41.696181 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:13:41.696181 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:13:41.696181 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e6f46da-f3b6-41ec-96f2-a3db16593a10 could not be found. Aug 24 10:13:41.696181 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:41.702238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fdab484c-f218-4820-8bd4-30eff31fa746 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Returning 404 to user: Instance 7e6f46da-f3b6-41ec-96f2-a3db16593a10 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:41.702238 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fdab484c-f218-4820-8bd4-30eff31fa746 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "DELETE /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10" status: 404 len: 111 microversion: 2.1 time: 0.055638 Aug 24 10:13:41.702238 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 351/745] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:13:41 2022] DELETE /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:13:41.821332 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-13658ece-1efc-4582-8ed8-0625d0b1e1b9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:41.849978 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-13658ece-1efc-4582-8ed8-0625d0b1e1b9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1270 microversion: 2.1 time: 0.320827 Aug 24 10:13:41.865959 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 395/746] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:41 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1270 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:41.891293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8853cd79-060a-4977-9134-a104db893d09 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:41.898059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8853cd79-060a-4977-9134-a104db893d09 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] [instance: 7e6f46da-f3b6-41ec-96f2-a3db16593a10] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:41.932009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8853cd79-060a-4977-9134-a104db893d09 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:41.932906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8853cd79-060a-4977-9134-a104db893d09 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:41.933687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8853cd79-060a-4977-9134-a104db893d09 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:41.935072 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8853cd79-060a-4977-9134-a104db893d09 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:41.935928 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8853cd79-060a-4977-9134-a104db893d09 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:41.936741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8853cd79-060a-4977-9134-a104db893d09 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:41.994178 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-8853cd79-060a-4977-9134-a104db893d09 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] HTTP exception thrown: Instance 7e6f46da-f3b6-41ec-96f2-a3db16593a10 could not be found. Aug 24 10:13:41.995817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-91bff577-a51e-4567-ab8a-e17a4737af20 tempest-HypervisorAdminNegativeUnderV252Test-917602426 tempest-HypervisorAdminNegativeUnderV252Test-917602426-project] Calling method '.version_select at 0x7f465540c940>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:41.996687 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:13:41.996687 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:13:41.997236 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8853cd79-060a-4977-9134-a104db893d09 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Request method failure captured: Aug 24 10:13:41.997236 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10 HTTP/1.1 Aug 24 10:13:41.997236 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:13:41.997236 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:13:41.997236 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:13:41.997236 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:13:41.997236 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:13:41.997236 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:13:41.997236 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:13:41.997236 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:41.997236 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfk1Kj5eteTInLCGwsy22ZjS2-h29bwkKZYedCvB5uR6SkjQYQQ2LRDzz8Q4YhZ0wzz43SddZ2JZSfwqPe5fDCobR2mjbQzP7a6Zoo-EWsvi0HsZPxRi6rb6c4B-Jj9FyPiM-HzVF3n4oGYSamITpd4QKt6LZmSoWeesGDnjzp-EcFM Aug 24 10:13:41.997236 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:13:41.997236 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:13:41.997236 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:13:41.997236 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:13:41.997236 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:13:41.997236 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:13:41.997236 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 114821bb876c48869e113c5b6d8898d0 Aug 24 10:13:41.997236 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1935128973 Aug 24 10:13:41.997236 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:13:41.997236 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:13:41.999712 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/114821bb876c48869e113c5b6d8898d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_114821bb876c48869e113c5b6d8898d0", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/114821bb876c48869e113c5b6d8898d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/114821bb876c48869e113c5b6d8898d0"}]}] Aug 24 10:13:41.999712 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1935128973 Aug 24 10:13:41.999712 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 114821bb876c48869e113c5b6d8898d0 Aug 24 10:13:41.999712 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1935128973 Aug 24 10:13:41.999712 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1935128973-project Aug 24 10:13:41.999712 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:13:41.999712 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:13:41.999712 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: e5bc9c3828964edabe730dd66ee27ee4 Aug 24 10:13:41.999712 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1935128973-project Aug 24 10:13:41.999712 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:13:41.999712 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 7e6f46da-f3b6-41ec-96f2-a3db16593a10 could not be found. Aug 24 10:13:41.999712 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '7e6f46da-f3b6-41ec-96f2-a3db16593a10'} Aug 24 10:13:42.001256 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:42.001256 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:42.001256 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:13:42.001256 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:13:42.001256 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:13:42.001256 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:13:42.001256 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:13:42.001256 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:13:42.001256 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:13:42.001256 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:13:42.001256 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e6f46da-f3b6-41ec-96f2-a3db16593a10 could not be found. Aug 24 10:13:42.001256 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:42.001256 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:42.001256 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:42.001256 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:42.001256 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:42.001256 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:42.001256 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:42.001256 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:42.001256 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:42.003664 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:42.003664 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:13:42.003664 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:13:42.003664 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:13:42.003664 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:13:42.003664 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:13:42.003664 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:13:42.003664 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e6f46da-f3b6-41ec-96f2-a3db16593a10 could not be found. Aug 24 10:13:42.003664 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:42.003664 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:42.003664 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:42.003664 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:42.003664 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:42.003664 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:42.003664 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:13:42.003664 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:13:42.003664 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e6f46da-f3b6-41ec-96f2-a3db16593a10 could not be found. Aug 24 10:13:42.003664 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:42.006255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-91bff577-a51e-4567-ab8a-e17a4737af20 tempest-HypervisorAdminNegativeUnderV252Test-917602426 tempest-HypervisorAdminNegativeUnderV252Test-917602426-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '0d954d464fb24c1bae268dd18a7e12e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a1080067641909053e852b36f2e4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:42.006255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-91bff577-a51e-4567-ab8a-e17a4737af20 tempest-HypervisorAdminNegativeUnderV252Test-917602426 tempest-HypervisorAdminNegativeUnderV252Test-917602426-project] Request method failure captured: Aug 24 10:13:42.006255 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-hypervisors/n-h2-849328-3/search HTTP/1.1 Aug 24 10:13:42.006255 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:13:42.006255 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:13:42.006255 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:13:42.006255 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:13:42.006255 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:13:42.006255 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:13:42.006255 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:13:42.006255 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:42.006255 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfnT2GG1zf8E-HCnFsLDcjr27J-EQ5HdUNKzTcN32Riooh3TYVhrtfCOy9Itlcink3izO8If_QLLXGJjs_5iSNjq8ZMh5pXfU1Dw0kUXTP0T7EsEZUWfFpYtOG0q747GuNRvSvDhE8Ez0hhhIj4NOxFvSDhi2SCW8cZwFQiRCgUVWtw Aug 24 10:13:42.006255 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:13:42.006255 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:13:42.006255 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:13:42.006255 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:13:42.006255 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:13:42.006255 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:13:42.006255 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 375a1080067641909053e852b36f2e4c Aug 24 10:13:42.006255 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-917602426 Aug 24 10:13:42.006255 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:13:42.006255 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:13:42.008843 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/375a1080067641909053e852b36f2e4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_375a1080067641909053e852b36f2e4c", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/375a1080067641909053e852b36f2e4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/375a1080067641909053e852b36f2e4c"}]}] Aug 24 10:13:42.008843 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-917602426 Aug 24 10:13:42.008843 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 375a1080067641909053e852b36f2e4c Aug 24 10:13:42.008843 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-917602426 Aug 24 10:13:42.008843 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-917602426-project Aug 24 10:13:42.008843 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:13:42.008843 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:13:42.008843 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 0d954d464fb24c1bae268dd18a7e12e8 Aug 24 10:13:42.008843 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-917602426-project Aug 24 10:13:42.008843 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:13:42.008843 n-d-849328-3 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 24 10:13:42.008843 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'n-h2-849328-3'} Aug 24 10:13:42.011438 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:42.011438 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:42.011438 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:42.011438 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:42.011438 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:42.011438 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:42.011438 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:13:42.011438 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:13:42.011438 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:42.011438 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:42.011438 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 24 10:13:42.011438 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 24 10:13:42.011438 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:13:42.011438 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:13:42.011438 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:13:42.011438 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:13:42.011438 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:13:42.011438 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:13:42.011438 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:13:42.013625 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:13:42.013625 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:13:42.013625 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:13:42.013625 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:13:42.013625 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:13:42.013625 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:13:42.013625 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:13:42.013625 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 24 10:13:42.013625 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:42.013625 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:42.013625 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:42.013625 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:42.013625 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:42.013625 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:42.013625 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:13:42.013625 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:13:42.013625 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 24 10:13:42.013625 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:13:42.015628 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-91bff577-a51e-4567-ab8a-e17a4737af20 tempest-HypervisorAdminNegativeUnderV252Test-917602426 tempest-HypervisorAdminNegativeUnderV252Test-917602426-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:42.015628 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-91bff577-a51e-4567-ab8a-e17a4737af20 tempest-HypervisorAdminNegativeUnderV252Test-917602426 tempest-HypervisorAdminNegativeUnderV252Test-917602426-project] 10.222.0.85 "GET /compute/v2.1/os-hypervisors/n-h2-849328-3/search" status: 403 len: 117 microversion: 2.1 time: 0.309711 Aug 24 10:13:42.015628 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 352/747] 10.222.0.85 () {58 vars in 1209 bytes} [Wed Aug 24 10:13:41 2022] GET /compute/v2.1/os-hypervisors/n-h2-849328-3/search => generated 117 bytes in 311 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:13:42.015628 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3fa662c2-d30d-4ff8-89a6-6cb5edcc2248 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1942928671", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["c7ad4cc6-0ddc-47f9-b386-1e0dde47808f"]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:42.022843 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8853cd79-060a-4977-9134-a104db893d09 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] Returning 404 to user: Instance 7e6f46da-f3b6-41ec-96f2-a3db16593a10 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:42.029344 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8853cd79-060a-4977-9134-a104db893d09 tempest-ServersWithSpecificFlavorTestJSON-1935128973 tempest-ServersWithSpecificFlavorTestJSON-1935128973-project] 10.222.0.85 "GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10" status: 404 len: 111 microversion: 2.1 time: 0.162020 Aug 24 10:13:42.031118 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 396/748] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:41 2022] GET /compute/v2.1/servers/7e6f46da-f3b6-41ec-96f2-a3db16593a10 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:13:42.049740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eaa50595-1188-48c3-993f-9339dec7f62a tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:42.058401 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-eaa50595-1188-48c3-993f-9339dec7f62a tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:42.083656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eaa50595-1188-48c3-993f-9339dec7f62a tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:42.084363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eaa50595-1188-48c3-993f-9339dec7f62a tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:42.085111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eaa50595-1188-48c3-993f-9339dec7f62a tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:42.093841 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eaa50595-1188-48c3-993f-9339dec7f62a tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:42.094706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eaa50595-1188-48c3-993f-9339dec7f62a tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:42.095496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eaa50595-1188-48c3-993f-9339dec7f62a tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:42.122344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-3fa662c2-d30d-4ff8-89a6-6cb5edcc2248 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:13:42.670835 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3fa662c2-d30d-4ff8-89a6-6cb5edcc2248 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:13:42.672066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3fa662c2-d30d-4ff8-89a6-6cb5edcc2248 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:13:42.672322 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3fa662c2-d30d-4ff8-89a6-6cb5edcc2248 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:13:42.673156 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3fa662c2-d30d-4ff8-89a6-6cb5edcc2248 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:13:42.673836 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3fa662c2-d30d-4ff8-89a6-6cb5edcc2248 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:13:42.705328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-eaa50595-1188-48c3-993f-9339dec7f62a tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:42.708142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fa662c2-d30d-4ff8-89a6-6cb5edcc2248 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:42.708707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fa662c2-d30d-4ff8-89a6-6cb5edcc2248 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:42.709770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fa662c2-d30d-4ff8-89a6-6cb5edcc2248 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:42.710801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fa662c2-d30d-4ff8-89a6-6cb5edcc2248 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:42.711517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fa662c2-d30d-4ff8-89a6-6cb5edcc2248 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:42.712815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fa662c2-d30d-4ff8-89a6-6cb5edcc2248 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:42.719800 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eaa50595-1188-48c3-993f-9339dec7f62a tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159" status: 200 len: 1520 microversion: 2.1 time: 0.687079 Aug 24 10:13:42.720410 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 397/749] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:42 2022] GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159 => generated 1520 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:42.725220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ca991693-7ae5-4830-a03f-2d9b46393443 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Calling method '.version_select at 0x7f46554dfaf0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:42.726024 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:13:42.726024 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:13:42.727381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca991693-7ae5-4830-a03f-2d9b46393443 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:42.728028 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca991693-7ae5-4830-a03f-2d9b46393443 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:42.728613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca991693-7ae5-4830-a03f-2d9b46393443 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:42.740808 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-ca991693-7ae5-4830-a03f-2d9b46393443 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 24 10:13:42.744626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ca991693-7ae5-4830-a03f-2d9b46393443 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Request method failure captured: Aug 24 10:13:42.744626 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 24 10:13:42.744626 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:13:42.744626 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:13:42.744626 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:13:42.744626 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:13:42.744626 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:13:42.744626 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:13:42.744626 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:13:42.744626 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:42.744626 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfnU79w5CAHOZgMjzReMved66tvzQOn3So3KCSfeIFByDlOXgB7D-PBter2_j-d-bM3LAbFzWwZoW1Sz54aZ9iFw7qxqOaPWNazWYvvE21JN6ShoZ1PhGDPghRM2TNkPJBTc2GC6ZgZsfm7z5NqUPIty_GtQbxGUxZy-clIrdpkcrOc Aug 24 10:13:42.744626 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:13:42.744626 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:13:42.744626 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:13:42.744626 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:13:42.744626 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:13:42.744626 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:13:42.744626 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 7bd8e45c130a42f6aab966b61cde4a1b Aug 24 10:13:42.744626 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1543505867 Aug 24 10:13:42.744626 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:13:42.744626 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:13:42.746150 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/7bd8e45c130a42f6aab966b61cde4a1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_7bd8e45c130a42f6aab966b61cde4a1b", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/7bd8e45c130a42f6aab966b61cde4a1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/7bd8e45c130a42f6aab966b61cde4a1b"}]}] Aug 24 10:13:42.746150 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1543505867 Aug 24 10:13:42.746150 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 7bd8e45c130a42f6aab966b61cde4a1b Aug 24 10:13:42.746150 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1543505867 Aug 24 10:13:42.746150 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin Aug 24 10:13:42.746150 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:13:42.746150 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:13:42.746150 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: e47e74e1503e498aadb268aae48ea9da Aug 24 10:13:42.746150 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin Aug 24 10:13:42.746150 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:13:42.746150 n-d-849328-3 devstack@n-api.service[122433]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 24 10:13:42.746150 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 24 10:13:42.747149 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:42.747149 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:42.747149 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:42.747149 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:42.747149 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:42.747149 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:42.747149 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:13:42.747149 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:13:42.747149 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:42.747149 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:42.747149 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 24 10:13:42.747149 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 24 10:13:42.747149 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 24 10:13:42.747149 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 10:13:42.747149 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 24 10:13:42.747149 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:42.747149 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:42.747149 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:42.747149 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:42.747149 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:42.748723 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:42.748723 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:13:42.748723 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:13:42.748723 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 24 10:13:42.748723 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:42.756805 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ca991693-7ae5-4830-a03f-2d9b46393443 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:42.758703 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ca991693-7ae5-4830-a03f-2d9b46393443 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.037096 Aug 24 10:13:42.759894 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 398/750] 10.222.0.85 () {58 vars in 1251 bytes} [Wed Aug 24 10:13:42 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:13:42.771701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-804eb5d4-f775-412b-ad8f-a2e49d48f40c tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:42.772867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-804eb5d4-f775-412b-ad8f-a2e49d48f40c tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:42.775793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-3fa662c2-d30d-4ff8-89a6-6cb5edcc2248 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:13:42.784219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-804eb5d4-f775-412b-ad8f-a2e49d48f40c tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:42.786054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-804eb5d4-f775-412b-ad8f-a2e49d48f40c tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:42.786396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-3fa662c2-d30d-4ff8-89a6-6cb5edcc2248 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for user bf03c0eb5bd748ae85be830f1121dc06 and project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:13:42.786964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-804eb5d4-f775-412b-ad8f-a2e49d48f40c tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:42.788886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-804eb5d4-f775-412b-ad8f-a2e49d48f40c tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:42.789587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-804eb5d4-f775-412b-ad8f-a2e49d48f40c tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:42.790548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-804eb5d4-f775-412b-ad8f-a2e49d48f40c tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:42.825804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3fa662c2-d30d-4ff8-89a6-6cb5edcc2248 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:13:42.830743 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3fa662c2-d30d-4ff8-89a6-6cb5edcc2248 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 1b80677b-614d-41a1-be0a-31bf5b46c485] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:13:42.914501 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3fa662c2-d30d-4ff8-89a6-6cb5edcc2248 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.910316 Aug 24 10:13:42.915969 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 353/751] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:13:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:13:42.928466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b2a7e5a6-fa57-4026-a91f-58a9b0a0e8cf tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Action: 'create', calling method: .version_select at 0x7f4656430ca0>, body: {"pool": null} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:43.095681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-804eb5d4-f775-412b-ad8f-a2e49d48f40c tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:43.107776 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-804eb5d4-f775-412b-ad8f-a2e49d48f40c tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab" status: 200 len: 1259 microversion: 2.1 time: 0.346279 Aug 24 10:13:43.111063 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 399/752] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:42 2022] GET /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab => generated 1259 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:43.150088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a5343375-7778-4310-90a6-e3dd0f9f9d61 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Calling method '.version_select at 0x7f46552603a0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:43.151345 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:13:43.151345 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:13:43.157757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5343375-7778-4310-90a6-e3dd0f9f9d61 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:43.174279 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5343375-7778-4310-90a6-e3dd0f9f9d61 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:43.176915 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5343375-7778-4310-90a6-e3dd0f9f9d61 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:43.203806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5343375-7778-4310-90a6-e3dd0f9f9d61 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:43.205540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5343375-7778-4310-90a6-e3dd0f9f9d61 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:43.206412 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5343375-7778-4310-90a6-e3dd0f9f9d61 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:43.224789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5343375-7778-4310-90a6-e3dd0f9f9d61 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:43.225336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5343375-7778-4310-90a6-e3dd0f9f9d61 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:43.226189 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5343375-7778-4310-90a6-e3dd0f9f9d61 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:43.237630 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a5343375-7778-4310-90a6-e3dd0f9f9d61 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.124334 Aug 24 10:13:43.238309 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 400/753] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:13:43 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:13:43.247908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f2063145-d667-4454-a78d-796c2ae15dd5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:43.250150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f2063145-d667-4454-a78d-796c2ae15dd5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:43.257112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2063145-d667-4454-a78d-796c2ae15dd5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:43.257652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2063145-d667-4454-a78d-796c2ae15dd5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:43.258093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2063145-d667-4454-a78d-796c2ae15dd5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:43.258809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2063145-d667-4454-a78d-796c2ae15dd5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:43.259265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2063145-d667-4454-a78d-796c2ae15dd5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:43.259690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2063145-d667-4454-a78d-796c2ae15dd5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:43.892953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f2063145-d667-4454-a78d-796c2ae15dd5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:43.917330 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f2063145-d667-4454-a78d-796c2ae15dd5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1270 microversion: 2.1 time: 0.677612 Aug 24 10:13:43.929635 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 401/754] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:43 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1270 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:43.939863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-985d7e97-bd62-4528-ba08-b676ec502d0c tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:43.940485 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-985d7e97-bd62-4528-ba08-b676ec502d0c tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 1b80677b-614d-41a1-be0a-31bf5b46c485] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:43.962046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-985d7e97-bd62-4528-ba08-b676ec502d0c tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:43.962554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-985d7e97-bd62-4528-ba08-b676ec502d0c tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:43.963010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-985d7e97-bd62-4528-ba08-b676ec502d0c tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:43.963719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-985d7e97-bd62-4528-ba08-b676ec502d0c tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:43.964354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-985d7e97-bd62-4528-ba08-b676ec502d0c tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:43.965168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-985d7e97-bd62-4528-ba08-b676ec502d0c tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:44.494662 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-985d7e97-bd62-4528-ba08-b676ec502d0c tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:44.512491 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-985d7e97-bd62-4528-ba08-b676ec502d0c tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485" status: 200 len: 1221 microversion: 2.1 time: 0.578172 Aug 24 10:13:44.517504 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 402/755] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:43 2022] GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485 => generated 1221 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:44.536897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-91762f9d-26a6-46b3-b752-a1eef8d56858 tempest-HypervisorAdminNegativeUnderV252Test-917602426 tempest-HypervisorAdminNegativeUnderV252Test-917602426-project] Calling method '.version_select at 0x7f4655260d30>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:44.538579 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:13:44.538579 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:13:44.545433 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-91762f9d-26a6-46b3-b752-a1eef8d56858 tempest-HypervisorAdminNegativeUnderV252Test-917602426 tempest-HypervisorAdminNegativeUnderV252Test-917602426-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '0d954d464fb24c1bae268dd18a7e12e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a1080067641909053e852b36f2e4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:44.551267 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-91762f9d-26a6-46b3-b752-a1eef8d56858 tempest-HypervisorAdminNegativeUnderV252Test-917602426 tempest-HypervisorAdminNegativeUnderV252Test-917602426-project] Request method failure captured: Aug 24 10:13:44.551267 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 24 10:13:44.551267 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:13:44.551267 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:13:44.551267 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:13:44.551267 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:13:44.551267 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:13:44.551267 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:13:44.551267 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:13:44.551267 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:44.551267 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfnT2GG1zf8E-HCnFsLDcjr27J-EQ5HdUNKzTcN32Riooh3TYVhrtfCOy9Itlcink3izO8If_QLLXGJjs_5iSNjq8ZMh5pXfU1Dw0kUXTP0T7EsEZUWfFpYtOG0q747GuNRvSvDhE8Ez0hhhIj4NOxFvSDhi2SCW8cZwFQiRCgUVWtw Aug 24 10:13:44.551267 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:13:44.551267 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:13:44.551267 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:13:44.551267 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:13:44.551267 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:13:44.551267 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:13:44.551267 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 375a1080067641909053e852b36f2e4c Aug 24 10:13:44.551267 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-917602426 Aug 24 10:13:44.551267 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:13:44.551267 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:13:44.553195 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/375a1080067641909053e852b36f2e4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_375a1080067641909053e852b36f2e4c", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/375a1080067641909053e852b36f2e4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/375a1080067641909053e852b36f2e4c"}]}] Aug 24 10:13:44.553195 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-917602426 Aug 24 10:13:44.553195 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 375a1080067641909053e852b36f2e4c Aug 24 10:13:44.553195 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-917602426 Aug 24 10:13:44.553195 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-917602426-project Aug 24 10:13:44.553195 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:13:44.553195 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:13:44.553195 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 0d954d464fb24c1bae268dd18a7e12e8 Aug 24 10:13:44.553195 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-917602426-project Aug 24 10:13:44.553195 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:13:44.553195 n-d-849328-3 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 24 10:13:44.553195 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '1'} Aug 24 10:13:44.554103 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:44.554103 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:44.554103 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:44.554103 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:44.554103 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:44.554103 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:44.554103 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:13:44.554103 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:13:44.554103 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:44.554103 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:44.554103 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 24 10:13:44.554103 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 24 10:13:44.554103 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:13:44.554103 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:13:44.554103 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:13:44.554103 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:13:44.554103 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:13:44.554103 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:13:44.554103 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:13:44.555501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:13:44.555501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:13:44.555501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:13:44.555501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:13:44.555501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:13:44.555501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:13:44.555501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:13:44.555501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 24 10:13:44.555501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:44.555501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:44.555501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:44.555501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:44.555501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:44.555501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:44.555501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:13:44.555501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:13:44.555501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 24 10:13:44.555501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:44.557205 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-91762f9d-26a6-46b3-b752-a1eef8d56858 tempest-HypervisorAdminNegativeUnderV252Test-917602426 tempest-HypervisorAdminNegativeUnderV252Test-917602426-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:44.561807 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-91762f9d-26a6-46b3-b752-a1eef8d56858 tempest-HypervisorAdminNegativeUnderV252Test-917602426 tempest-HypervisorAdminNegativeUnderV252Test-917602426-project] 10.222.0.85 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.041150 Aug 24 10:13:44.574105 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 403/756] 10.222.0.85 () {58 vars in 1176 bytes} [Wed Aug 24 10:13:44 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 56 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:13:44.600104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-752971c1-13b5-494f-a381-26af786478cf tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:44.608396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-752971c1-13b5-494f-a381-26af786478cf tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:44.635166 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-752971c1-13b5-494f-a381-26af786478cf tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:44.636232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-752971c1-13b5-494f-a381-26af786478cf tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:44.637730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-752971c1-13b5-494f-a381-26af786478cf tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:44.639279 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-752971c1-13b5-494f-a381-26af786478cf tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:44.640071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-752971c1-13b5-494f-a381-26af786478cf tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:44.640854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-752971c1-13b5-494f-a381-26af786478cf tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:44.922790 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-752971c1-13b5-494f-a381-26af786478cf tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:44.933023 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-752971c1-13b5-494f-a381-26af786478cf tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab" status: 200 len: 1265 microversion: 2.1 time: 0.356652 Aug 24 10:13:44.938404 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 404/757] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:44 2022] GET /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab => generated 1265 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:44.944474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-47121fe8-fc1e-4cae-82e0-b22f29198243 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Calling method '.version_select at 0x7f46554dfc10>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:44.946385 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:13:44.946385 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:13:44.948220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47121fe8-fc1e-4cae-82e0-b22f29198243 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:44.949553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47121fe8-fc1e-4cae-82e0-b22f29198243 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:44.950267 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47121fe8-fc1e-4cae-82e0-b22f29198243 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:44.959186 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-47121fe8-fc1e-4cae-82e0-b22f29198243 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] HTTP exception thrown: No hypervisor matching 'e2c82d12-43e7-4119-8f72-faf787bdfb77' could be found. Aug 24 10:13:44.961812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-47121fe8-fc1e-4cae-82e0-b22f29198243 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Request method failure captured: Aug 24 10:13:44.961812 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-hypervisors/e2c82d12-43e7-4119-8f72-faf787bdfb77/servers HTTP/1.1 Aug 24 10:13:44.961812 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:13:44.961812 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:13:44.961812 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:13:44.961812 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:13:44.961812 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:13:44.961812 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:13:44.961812 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:13:44.961812 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:13:44.961812 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfnU79w5CAHOZgMjzReMved66tvzQOn3So3KCSfeIFByDlOXgB7D-PBter2_j-d-bM3LAbFzWwZoW1Sz54aZ9iFw7qxqOaPWNazWYvvE21JN6ShoZ1PhGDPghRM2TNkPJBTc2GC6ZgZsfm7z5NqUPIty_GtQbxGUxZy-clIrdpkcrOc Aug 24 10:13:44.961812 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:13:44.961812 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:13:44.961812 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:13:44.961812 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:13:44.961812 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:13:44.961812 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:13:44.961812 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 7bd8e45c130a42f6aab966b61cde4a1b Aug 24 10:13:44.961812 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1543505867 Aug 24 10:13:44.961812 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:13:44.961812 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:13:44.963942 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/7bd8e45c130a42f6aab966b61cde4a1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_7bd8e45c130a42f6aab966b61cde4a1b", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/7bd8e45c130a42f6aab966b61cde4a1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/7bd8e45c130a42f6aab966b61cde4a1b"}]}] Aug 24 10:13:44.963942 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1543505867 Aug 24 10:13:44.963942 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 7bd8e45c130a42f6aab966b61cde4a1b Aug 24 10:13:44.963942 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1543505867 Aug 24 10:13:44.963942 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin Aug 24 10:13:44.963942 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:13:44.963942 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:13:44.963942 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: e47e74e1503e498aadb268aae48ea9da Aug 24 10:13:44.963942 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin Aug 24 10:13:44.963942 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:13:44.963942 n-d-849328-3 devstack@n-api.service[122433]: exception: No hypervisor matching 'e2c82d12-43e7-4119-8f72-faf787bdfb77' could be found. Aug 24 10:13:44.963942 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'e2c82d12-43e7-4119-8f72-faf787bdfb77'} Aug 24 10:13:44.965085 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:13:44.965085 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:44.965085 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:44.965085 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:44.965085 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:13:44.965085 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:13:44.965085 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:13:44.965085 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:13:44.965085 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:13:44.965085 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:13:44.965085 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 24 10:13:44.965085 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 24 10:13:44.965085 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 24 10:13:44.965085 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 10:13:44.965085 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'e2c82d12-43e7-4119-8f72-faf787bdfb77' could be found. Aug 24 10:13:44.965085 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:44.965085 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:13:44.965085 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:44.965085 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:13:44.966792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:13:44.966792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:13:44.966792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:13:44.966792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:13:44.966792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'e2c82d12-43e7-4119-8f72-faf787bdfb77' could be found. Aug 24 10:13:44.966792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:13:44.966792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-47121fe8-fc1e-4cae-82e0-b22f29198243 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] Returning 404 to user: No hypervisor matching 'e2c82d12-43e7-4119-8f72-faf787bdfb77' could be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:13:44.966792 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-47121fe8-fc1e-4cae-82e0-b22f29198243 tempest-HypervisorAdminNegativeUnderV252Test-1543505867 tempest-HypervisorAdminNegativeUnderV252Test-1543505867-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors/e2c82d12-43e7-4119-8f72-faf787bdfb77/servers" status: 404 len: 123 microversion: 2.1 time: 0.023800 Aug 24 10:13:44.966792 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 405/758] 10.222.0.85 () {58 vars in 1281 bytes} [Wed Aug 24 10:13:44 2022] GET /compute/v2.1/os-hypervisors/e2c82d12-43e7-4119-8f72-faf787bdfb77/servers => generated 123 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:13:44.984810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0b196159-da85-4f88-8b84-1cb19f339eba tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-686929962", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "68027218-9cf0-4391-8ca9-11006ba08a7a"}], "security_groups": [{"name": "tempest-securitygroup--534456420"}], "key_name": "tempest-keypair-923277923", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:45.659238 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-0b196159-da85-4f88-8b84-1cb19f339eba tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] validate_networks() for [('68027218-9cf0-4391-8ca9-11006ba08a7a', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:13:47.879691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0b196159-da85-4f88-8b84-1cb19f339eba tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:13:47.880428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0b196159-da85-4f88-8b84-1cb19f339eba tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:13:47.880917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0b196159-da85-4f88-8b84-1cb19f339eba tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:13:47.881382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0b196159-da85-4f88-8b84-1cb19f339eba tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:13:47.881818 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0b196159-da85-4f88-8b84-1cb19f339eba tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:13:47.883106 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b2a7e5a6-fa57-4026-a91f-58a9b0a0e8cf tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.965830 Aug 24 10:13:47.898863 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 354/759] 10.222.0.85 () {60 vars in 1170 bytes} [Wed Aug 24 10:13:42 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4982 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:13:47.906424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b196159-da85-4f88-8b84-1cb19f339eba tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:47.907207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b196159-da85-4f88-8b84-1cb19f339eba tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:47.907412 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d49202ef-c3be-4ca4-952d-8c1fdef67516 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:47.908045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d49202ef-c3be-4ca4-952d-8c1fdef67516 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:47.908522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b196159-da85-4f88-8b84-1cb19f339eba tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:47.910653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b196159-da85-4f88-8b84-1cb19f339eba tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:47.911369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b196159-da85-4f88-8b84-1cb19f339eba tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:47.912171 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b196159-da85-4f88-8b84-1cb19f339eba tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:47.921460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d49202ef-c3be-4ca4-952d-8c1fdef67516 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:47.921911 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d49202ef-c3be-4ca4-952d-8c1fdef67516 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:47.922364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d49202ef-c3be-4ca4-952d-8c1fdef67516 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:47.923676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d49202ef-c3be-4ca4-952d-8c1fdef67516 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:47.923676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d49202ef-c3be-4ca4-952d-8c1fdef67516 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:47.923981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d49202ef-c3be-4ca4-952d-8c1fdef67516 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:47.945779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-0b196159-da85-4f88-8b84-1cb19f339eba tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Getting quotas for project 34b2b8fc487d4a6abb08f132e0f0c1da. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:13:47.960666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-0b196159-da85-4f88-8b84-1cb19f339eba tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Getting quotas for user dfd26847179f4f2bab0c9f673de0c303 and project 34b2b8fc487d4a6abb08f132e0f0c1da. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:13:47.994536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0b196159-da85-4f88-8b84-1cb19f339eba tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:13:48.005005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0b196159-da85-4f88-8b84-1cb19f339eba tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:13:48.112837 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0b196159-da85-4f88-8b84-1cb19f339eba tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 3.146851 Aug 24 10:13:48.114443 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 406/760] 10.222.0.85 () {62 vars in 1188 bytes} [Wed Aug 24 10:13:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 3149 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 10:13:48.120561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f31c48f6-072b-4d76-b41a-5c2f274a436f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:48.121379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f31c48f6-072b-4d76-b41a-5c2f274a436f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 1b80677b-614d-41a1-be0a-31bf5b46c485] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:48.131648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f31c48f6-072b-4d76-b41a-5c2f274a436f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:48.132464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f31c48f6-072b-4d76-b41a-5c2f274a436f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:48.133262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f31c48f6-072b-4d76-b41a-5c2f274a436f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:48.134406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f31c48f6-072b-4d76-b41a-5c2f274a436f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:48.135033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f31c48f6-072b-4d76-b41a-5c2f274a436f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:48.135962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f31c48f6-072b-4d76-b41a-5c2f274a436f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:48.367228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f31c48f6-072b-4d76-b41a-5c2f274a436f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:48.407108 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f31c48f6-072b-4d76-b41a-5c2f274a436f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485" status: 200 len: 1275 microversion: 2.1 time: 0.289039 Aug 24 10:13:48.412905 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 407/761] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:48 2022] GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485 => generated 1275 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:48.483717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b3774e6a-54ae-4abd-9320-f1ded9b03028 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:48.487196 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b3774e6a-54ae-4abd-9320-f1ded9b03028 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:48.511102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3774e6a-54ae-4abd-9320-f1ded9b03028 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:48.511908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3774e6a-54ae-4abd-9320-f1ded9b03028 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:48.513101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3774e6a-54ae-4abd-9320-f1ded9b03028 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:48.519893 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3774e6a-54ae-4abd-9320-f1ded9b03028 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:48.520862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3774e6a-54ae-4abd-9320-f1ded9b03028 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:48.521691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3774e6a-54ae-4abd-9320-f1ded9b03028 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:49.462846 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d49202ef-c3be-4ca4-952d-8c1fdef67516 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:49.499714 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d49202ef-c3be-4ca4-952d-8c1fdef67516 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1312 microversion: 2.1 time: 1.597097 Aug 24 10:13:49.514701 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 355/762] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:47 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1312 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:49.532369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e5b524c8-0dee-46d8-a808-69ef79548b0c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:49.554835 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e5b524c8-0dee-46d8-a808-69ef79548b0c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:49.572388 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5b524c8-0dee-46d8-a808-69ef79548b0c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:49.574276 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5b524c8-0dee-46d8-a808-69ef79548b0c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:49.575489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5b524c8-0dee-46d8-a808-69ef79548b0c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:49.577140 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5b524c8-0dee-46d8-a808-69ef79548b0c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:49.578412 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5b524c8-0dee-46d8-a808-69ef79548b0c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:49.580410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5b524c8-0dee-46d8-a808-69ef79548b0c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:49.709793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b3774e6a-54ae-4abd-9320-f1ded9b03028 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:49.724266 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b3774e6a-54ae-4abd-9320-f1ded9b03028 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab" status: 200 len: 1307 microversion: 2.1 time: 1.294777 Aug 24 10:13:49.728527 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 408/763] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:48 2022] GET /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab => generated 1307 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:49.747939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b13d86aa-221a-4fc5-b3bd-54b80a72c83f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1140178015", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "6a3a952d-cb92-48d6-ae25-c71db979b739"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:49.840635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e5b524c8-0dee-46d8-a808-69ef79548b0c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:49.862823 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-b13d86aa-221a-4fc5-b3bd-54b80a72c83f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] validate_networks() for [('6a3a952d-cb92-48d6-ae25-c71db979b739', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:13:49.867141 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e5b524c8-0dee-46d8-a808-69ef79548b0c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:49.868685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e5b524c8-0dee-46d8-a808-69ef79548b0c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:49.879109 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e5b524c8-0dee-46d8-a808-69ef79548b0c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1280 microversion: 2.25 time: 0.353401 Aug 24 10:13:49.881818 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 356/764] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:13:49 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1280 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:13:49.900354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3acc175e-30e4-4fda-9e22-dd4b7939b9ec req-fb00d459-e40e-4500-9783-af6eef858f62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fce6709c-548b-4bdc-9667-fa678dbeb477", "tag": "a5c8b983-3e85-49ee-93ef-994023d0a43c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:49.941997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3acc175e-30e4-4fda-9e22-dd4b7939b9ec req-fb00d459-e40e-4500-9783-af6eef858f62 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:49.942490 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3acc175e-30e4-4fda-9e22-dd4b7939b9ec req-fb00d459-e40e-4500-9783-af6eef858f62 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:49.944401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3acc175e-30e4-4fda-9e22-dd4b7939b9ec req-fb00d459-e40e-4500-9783-af6eef858f62 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:50.024272 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3acc175e-30e4-4fda-9e22-dd4b7939b9ec req-fb00d459-e40e-4500-9783-af6eef858f62 service nova] Creating event network-changed:a5c8b983-3e85-49ee-93ef-994023d0a43c for instance fce6709c-548b-4bdc-9667-fa678dbeb477 on n-h2-849328-3 Aug 24 10:13:50.039658 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3acc175e-30e4-4fda-9e22-dd4b7939b9ec req-fb00d459-e40e-4500-9783-af6eef858f62 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155031 Aug 24 10:13:50.041646 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 357/765] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:13:50.058003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-612e0a2d-ab1b-4929-8331-fba7cebcfdbd tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:50.059575 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-612e0a2d-ab1b-4929-8331-fba7cebcfdbd tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 1b80677b-614d-41a1-be0a-31bf5b46c485] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:50.076421 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-612e0a2d-ab1b-4929-8331-fba7cebcfdbd tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:50.077675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-612e0a2d-ab1b-4929-8331-fba7cebcfdbd tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:50.078681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-612e0a2d-ab1b-4929-8331-fba7cebcfdbd tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:50.080225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-612e0a2d-ab1b-4929-8331-fba7cebcfdbd tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:50.081277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-612e0a2d-ab1b-4929-8331-fba7cebcfdbd tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:50.082193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-612e0a2d-ab1b-4929-8331-fba7cebcfdbd tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:50.916808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-612e0a2d-ab1b-4929-8331-fba7cebcfdbd tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:50.951117 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-612e0a2d-ab1b-4929-8331-fba7cebcfdbd tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485" status: 200 len: 1317 microversion: 2.1 time: 0.905472 Aug 24 10:13:50.956287 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 358/766] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:50 2022] GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485 => generated 1317 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:50.974222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-66e5fcb9-7bff-415c-8924-0cd4ab708329 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:50.975064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-66e5fcb9-7bff-415c-8924-0cd4ab708329 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:50.992201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e5fcb9-7bff-415c-8924-0cd4ab708329 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:50.994500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e5fcb9-7bff-415c-8924-0cd4ab708329 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:50.995364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e5fcb9-7bff-415c-8924-0cd4ab708329 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:50.996864 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e5fcb9-7bff-415c-8924-0cd4ab708329 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:50.997761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e5fcb9-7bff-415c-8924-0cd4ab708329 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:50.998562 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e5fcb9-7bff-415c-8924-0cd4ab708329 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:51.559615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-66e5fcb9-7bff-415c-8924-0cd4ab708329 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:51.609857 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-66e5fcb9-7bff-415c-8924-0cd4ab708329 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1312 microversion: 2.1 time: 0.646814 Aug 24 10:13:51.614852 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 359/767] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:50 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1312 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:51.625267 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c3535159-21f5-4590-b51f-836757c75cec req-7086ef19-ef3e-4e7e-be13-689f6ca98dcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7953a2dc-785d-4cb0-a4ee-8bd420fc6fab", "tag": "c80fb50e-88a4-4f76-93d7-ac7c65fbd4b1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:51.648736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c3535159-21f5-4590-b51f-836757c75cec req-7086ef19-ef3e-4e7e-be13-689f6ca98dcd service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:51.649827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c3535159-21f5-4590-b51f-836757c75cec req-7086ef19-ef3e-4e7e-be13-689f6ca98dcd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:51.651251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c3535159-21f5-4590-b51f-836757c75cec req-7086ef19-ef3e-4e7e-be13-689f6ca98dcd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:51.674263 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c3535159-21f5-4590-b51f-836757c75cec req-7086ef19-ef3e-4e7e-be13-689f6ca98dcd service nova] Creating event network-changed:c80fb50e-88a4-4f76-93d7-ac7c65fbd4b1 for instance 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab on n-h1-849328-3 Aug 24 10:13:51.684361 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c3535159-21f5-4590-b51f-836757c75cec req-7086ef19-ef3e-4e7e-be13-689f6ca98dcd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067211 Aug 24 10:13:51.686447 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 360/768] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:13:51.698368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-86aa7530-d64b-46eb-9ab9-45419ff7d37d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:51.700051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-86aa7530-d64b-46eb-9ab9-45419ff7d37d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:51.712420 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86aa7530-d64b-46eb-9ab9-45419ff7d37d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:51.714041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86aa7530-d64b-46eb-9ab9-45419ff7d37d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:51.716273 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86aa7530-d64b-46eb-9ab9-45419ff7d37d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:51.718098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86aa7530-d64b-46eb-9ab9-45419ff7d37d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:51.719233 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86aa7530-d64b-46eb-9ab9-45419ff7d37d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:51.720281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86aa7530-d64b-46eb-9ab9-45419ff7d37d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:51.977846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b13d86aa-221a-4fc5-b3bd-54b80a72c83f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:13:51.978679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b13d86aa-221a-4fc5-b3bd-54b80a72c83f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:13:51.978679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b13d86aa-221a-4fc5-b3bd-54b80a72c83f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:13:51.979096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b13d86aa-221a-4fc5-b3bd-54b80a72c83f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:13:51.979699 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b13d86aa-221a-4fc5-b3bd-54b80a72c83f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:13:51.989234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b13d86aa-221a-4fc5-b3bd-54b80a72c83f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:51.989978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b13d86aa-221a-4fc5-b3bd-54b80a72c83f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:51.990585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b13d86aa-221a-4fc5-b3bd-54b80a72c83f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:51.991521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b13d86aa-221a-4fc5-b3bd-54b80a72c83f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:51.992132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b13d86aa-221a-4fc5-b3bd-54b80a72c83f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:51.992709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b13d86aa-221a-4fc5-b3bd-54b80a72c83f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:52.017667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b13d86aa-221a-4fc5-b3bd-54b80a72c83f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Getting quotas for project 67b25f29b4a141f4b45518dba7332c3c. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:13:52.027644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b13d86aa-221a-4fc5-b3bd-54b80a72c83f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Getting quotas for user c969980c07dd44b49d7ef299858fe109 and project 67b25f29b4a141f4b45518dba7332c3c. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:13:52.043680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b13d86aa-221a-4fc5-b3bd-54b80a72c83f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:13:52.046751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b13d86aa-221a-4fc5-b3bd-54b80a72c83f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: 293f4b0e-a839-48f3-a510-4b4e320ebf59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:13:52.131554 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b13d86aa-221a-4fc5-b3bd-54b80a72c83f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.401263 Aug 24 10:13:52.132526 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 409/769] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:13:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2403 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:13:52.143084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bb4c8961-8f51-411b-851f-ff2484815045 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b20cfb5d-c464-483f-8308-f20afd882c4e"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:52.146137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bb4c8961-8f51-411b-851f-ff2484815045 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:52.155876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb4c8961-8f51-411b-851f-ff2484815045 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:52.156686 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb4c8961-8f51-411b-851f-ff2484815045 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:52.157402 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb4c8961-8f51-411b-851f-ff2484815045 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:52.158549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb4c8961-8f51-411b-851f-ff2484815045 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:52.159146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb4c8961-8f51-411b-851f-ff2484815045 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:52.159720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb4c8961-8f51-411b-851f-ff2484815045 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:52.308934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-86aa7530-d64b-46eb-9ab9-45419ff7d37d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:52.323705 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-86aa7530-d64b-46eb-9ab9-45419ff7d37d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab" status: 200 len: 1307 microversion: 2.1 time: 0.635060 Aug 24 10:13:52.335757 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 361/770] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:51 2022] GET /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab => generated 1307 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:52.362169 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-91f68b07-68de-4d7c-9c90-e7905f1ab8de tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:52.362783 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-91f68b07-68de-4d7c-9c90-e7905f1ab8de tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:52.405996 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91f68b07-68de-4d7c-9c90-e7905f1ab8de tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:52.406513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91f68b07-68de-4d7c-9c90-e7905f1ab8de tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:52.406956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91f68b07-68de-4d7c-9c90-e7905f1ab8de tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:52.408477 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91f68b07-68de-4d7c-9c90-e7905f1ab8de tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:52.410262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91f68b07-68de-4d7c-9c90-e7905f1ab8de tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:52.410722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91f68b07-68de-4d7c-9c90-e7905f1ab8de tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:52.673709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-91f68b07-68de-4d7c-9c90-e7905f1ab8de tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:52.696852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-91f68b07-68de-4d7c-9c90-e7905f1ab8de tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:52.716970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-91f68b07-68de-4d7c-9c90-e7905f1ab8de tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:52.719042 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-91f68b07-68de-4d7c-9c90-e7905f1ab8de tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1342 microversion: 2.25 time: 0.374295 Aug 24 10:13:52.720200 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 362/771] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:13:52 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1342 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:13:52.739618 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-de46341e-ddf4-47a8-bff0-a53e4e481733 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:52.741775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-de46341e-ddf4-47a8-bff0-a53e4e481733 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 1b80677b-614d-41a1-be0a-31bf5b46c485] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:52.748688 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:52.765753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de46341e-ddf4-47a8-bff0-a53e4e481733 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:52.766257 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de46341e-ddf4-47a8-bff0-a53e4e481733 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:52.783223 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de46341e-ddf4-47a8-bff0-a53e4e481733 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:52.784319 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de46341e-ddf4-47a8-bff0-a53e4e481733 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:52.785024 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de46341e-ddf4-47a8-bff0-a53e4e481733 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:52.785675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de46341e-ddf4-47a8-bff0-a53e4e481733 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:52.844668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=20 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:53.160277 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bb4c8961-8f51-411b-851f-ff2484815045 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "POST /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.021896 Aug 24 10:13:53.186361 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 410/772] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Aug 24 10:13:52 2022] POST /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381/os-volume_attachments => generated 194 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:13:53.215264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-728a0e18-ac54-4428-85e9-c98e0405d368 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:53.216139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-728a0e18-ac54-4428-85e9-c98e0405d368 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: 293f4b0e-a839-48f3-a510-4b4e320ebf59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:53.244378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-728a0e18-ac54-4428-85e9-c98e0405d368 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:53.244901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-728a0e18-ac54-4428-85e9-c98e0405d368 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:53.248888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-728a0e18-ac54-4428-85e9-c98e0405d368 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:53.251409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-728a0e18-ac54-4428-85e9-c98e0405d368 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:53.276877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-728a0e18-ac54-4428-85e9-c98e0405d368 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:53.278815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-728a0e18-ac54-4428-85e9-c98e0405d368 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:53.288404 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:53.317390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-de46341e-ddf4-47a8-bff0-a53e4e481733 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:53.332018 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-de46341e-ddf4-47a8-bff0-a53e4e481733 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485" status: 200 len: 1317 microversion: 2.1 time: 0.610297 Aug 24 10:13:53.345769 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 363/773] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:52 2022] GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485 => generated 1317 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:53.352810 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f5979df9-00fb-4ef1-b888-e31eea1e763b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:53.353722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f5979df9-00fb-4ef1-b888-e31eea1e763b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:53.361654 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5979df9-00fb-4ef1-b888-e31eea1e763b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:53.362420 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5979df9-00fb-4ef1-b888-e31eea1e763b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:53.363053 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5979df9-00fb-4ef1-b888-e31eea1e763b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:53.363999 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5979df9-00fb-4ef1-b888-e31eea1e763b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:53.364705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5979df9-00fb-4ef1-b888-e31eea1e763b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:53.365335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5979df9-00fb-4ef1-b888-e31eea1e763b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:53.449831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-728a0e18-ac54-4428-85e9-c98e0405d368 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:53.498083 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-728a0e18-ac54-4428-85e9-c98e0405d368 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59" status: 200 len: 1220 microversion: 2.1 time: 0.310236 Aug 24 10:13:53.499647 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 411/774] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:53 2022] GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59 => generated 1220 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:53.536944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d6bb5f62-feb3-402e-b67e-8a7492e3d167 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:53.538341 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d6bb5f62-feb3-402e-b67e-8a7492e3d167 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:53.547474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6bb5f62-feb3-402e-b67e-8a7492e3d167 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:53.548415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6bb5f62-feb3-402e-b67e-8a7492e3d167 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:53.549008 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6bb5f62-feb3-402e-b67e-8a7492e3d167 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:53.550010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6bb5f62-feb3-402e-b67e-8a7492e3d167 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:53.550655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6bb5f62-feb3-402e-b67e-8a7492e3d167 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:53.551532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6bb5f62-feb3-402e-b67e-8a7492e3d167 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:53.902280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f5979df9-00fb-4ef1-b888-e31eea1e763b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:53.919196 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f5979df9-00fb-4ef1-b888-e31eea1e763b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1312 microversion: 2.1 time: 0.571546 Aug 24 10:13:53.920020 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 364/775] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:53 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1312 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:53.933696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9d0b69ed-5b07-443d-ac2b-dc462a180ac0 req-ff8eb044-d29f-45d4-88b3-3e0413a8e144 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b80677b-614d-41a1-be0a-31bf5b46c485", "tag": "285fd86f-4935-4224-b70e-59290d2534ce"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:53.991248 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9d0b69ed-5b07-443d-ac2b-dc462a180ac0 req-ff8eb044-d29f-45d4-88b3-3e0413a8e144 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:53.991753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9d0b69ed-5b07-443d-ac2b-dc462a180ac0 req-ff8eb044-d29f-45d4-88b3-3e0413a8e144 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:53.997986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9d0b69ed-5b07-443d-ac2b-dc462a180ac0 req-ff8eb044-d29f-45d4-88b3-3e0413a8e144 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:54.022794 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9d0b69ed-5b07-443d-ac2b-dc462a180ac0 req-ff8eb044-d29f-45d4-88b3-3e0413a8e144 service nova] Creating event network-changed:285fd86f-4935-4224-b70e-59290d2534ce for instance 1b80677b-614d-41a1-be0a-31bf5b46c485 on n-h2-849328-3 Aug 24 10:13:54.035414 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9d0b69ed-5b07-443d-ac2b-dc462a180ac0 req-ff8eb044-d29f-45d4-88b3-3e0413a8e144 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113908 Aug 24 10:13:54.040477 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 365/776] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:13:54.059790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ea9d13bd-16b4-4625-b14e-68dd24571354 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:54.060627 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ea9d13bd-16b4-4625-b14e-68dd24571354 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:54.092084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea9d13bd-16b4-4625-b14e-68dd24571354 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:54.096161 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea9d13bd-16b4-4625-b14e-68dd24571354 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:54.097779 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea9d13bd-16b4-4625-b14e-68dd24571354 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:54.098798 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea9d13bd-16b4-4625-b14e-68dd24571354 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:54.101931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea9d13bd-16b4-4625-b14e-68dd24571354 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:54.102859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea9d13bd-16b4-4625-b14e-68dd24571354 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:54.922244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ea9d13bd-16b4-4625-b14e-68dd24571354 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:54.950062 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ea9d13bd-16b4-4625-b14e-68dd24571354 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:54.958625 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ea9d13bd-16b4-4625-b14e-68dd24571354 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:54.960572 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ea9d13bd-16b4-4625-b14e-68dd24571354 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1409 microversion: 2.25 time: 0.918000 Aug 24 10:13:54.967038 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 366/777] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:13:54 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1409 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:13:55.267471 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d6bb5f62-feb3-402e-b67e-8a7492e3d167 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:55.299369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0e528a5e-54ab-4fef-a178-050d072e800b tempest-KeyPairsV210TestJSON-724409919 tempest-KeyPairsV210TestJSON-724409919-project-admin] Action: 'create', calling method: .version_select at 0x7f465556cd30>, body: {"keypair": {"name": "tempest-keypair-1574580715", "type": "ssh", "user_id": "08d3755e6aa447fa9aca492affb58040", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7FQ8IbX8q2/HC5FwMkGEc84EuM1ler9YfCacLQbU5RVgvEzc8K4xsuPBQ2l3zbquPA+pqQpK3RHaJWT0kbEk5TWBA21botrojvWh55ygffPPPviSvG1099wVn5R80RHw=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:55.300037 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d6bb5f62-feb3-402e-b67e-8a7492e3d167 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab" status: 200 len: 1307 microversion: 2.1 time: 1.798780 Aug 24 10:13:55.301331 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 412/778] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:53 2022] GET /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab => generated 1307 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:55.321335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-385e7252-2144-4e18-9451-7e8e6ae20026 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:55.325696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-385e7252-2144-4e18-9451-7e8e6ae20026 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 1b80677b-614d-41a1-be0a-31bf5b46c485] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:55.332877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-0e528a5e-54ab-4fef-a178-050d072e800b tempest-KeyPairsV210TestJSON-724409919 tempest-KeyPairsV210TestJSON-724409919-project-admin] Getting quotas for project bcf07e186ecf4d7185091b21e60201b8. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:13:55.337575 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-385e7252-2144-4e18-9451-7e8e6ae20026 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:55.338063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-385e7252-2144-4e18-9451-7e8e6ae20026 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:55.339582 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-0e528a5e-54ab-4fef-a178-050d072e800b tempest-KeyPairsV210TestJSON-724409919 tempest-KeyPairsV210TestJSON-724409919-project-admin] Getting quotas for user a7f8bab13a8440dc8c87822fc9eadb9d and project bcf07e186ecf4d7185091b21e60201b8. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:13:55.341415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-385e7252-2144-4e18-9451-7e8e6ae20026 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:55.342376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-385e7252-2144-4e18-9451-7e8e6ae20026 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:55.343070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-385e7252-2144-4e18-9451-7e8e6ae20026 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:55.347323 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-385e7252-2144-4e18-9451-7e8e6ae20026 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:55.377296 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0e528a5e-54ab-4fef-a178-050d072e800b tempest-KeyPairsV210TestJSON-724409919 tempest-KeyPairsV210TestJSON-724409919-project-admin] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.405772 Aug 24 10:13:55.378083 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 367/779] 10.222.0.85 () {62 vars in 1200 bytes} [Wed Aug 24 10:13:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 408 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 10:13:55.392830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6a80c2cd-231a-4211-8dc0-2ed7b7ba2440 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:55.393804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6a80c2cd-231a-4211-8dc0-2ed7b7ba2440 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: 293f4b0e-a839-48f3-a510-4b4e320ebf59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:55.401995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a80c2cd-231a-4211-8dc0-2ed7b7ba2440 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:55.402904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a80c2cd-231a-4211-8dc0-2ed7b7ba2440 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:55.403649 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a80c2cd-231a-4211-8dc0-2ed7b7ba2440 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:55.404705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a80c2cd-231a-4211-8dc0-2ed7b7ba2440 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:55.405444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a80c2cd-231a-4211-8dc0-2ed7b7ba2440 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:55.405829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a80c2cd-231a-4211-8dc0-2ed7b7ba2440 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:56.145688 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6a80c2cd-231a-4211-8dc0-2ed7b7ba2440 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:56.171205 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6a80c2cd-231a-4211-8dc0-2ed7b7ba2440 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59" status: 200 len: 1294 microversion: 2.1 time: 0.782850 Aug 24 10:13:56.172507 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-385e7252-2144-4e18-9451-7e8e6ae20026 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:56.190703 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 368/780] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:55 2022] GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59 => generated 1294 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:56.199904 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-385e7252-2144-4e18-9451-7e8e6ae20026 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485" status: 200 len: 1317 microversion: 2.1 time: 0.896707 Aug 24 10:13:56.214606 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 413/781] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:55 2022] GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485 => generated 1317 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:56.214964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ba003ed-1f92-4120-9cf6-cbade5aaa576 tempest-KeyPairsV210TestJSON-724409919 tempest-KeyPairsV210TestJSON-724409919-project-admin] Action: 'create', calling method: .version_select at 0x7f465528a790>, body: {"keypair": {"name": "tempest-keypair-1230763327", "type": "ssh", "user_id": "08d3755e6aa447fa9aca492affb58040", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUdTWHp0zIpDECh5QmmsyN1CE5Bs+o2LpDAJauw8zP8w5LTMCY6H8SHFojrb0K4kYTKmwi2RxXd9EAZyOvPma3NeR1IrxO0DvaSUKOnouwf5Ysi98UGwjw+7eWl03vlXA=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:56.216100 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-203a9d9c-9dc5-4192-835b-2ba04a5c013d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:56.217382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-203a9d9c-9dc5-4192-835b-2ba04a5c013d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:56.234193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-203a9d9c-9dc5-4192-835b-2ba04a5c013d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:56.235192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-203a9d9c-9dc5-4192-835b-2ba04a5c013d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:56.236241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-203a9d9c-9dc5-4192-835b-2ba04a5c013d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:56.237631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-203a9d9c-9dc5-4192-835b-2ba04a5c013d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:56.238765 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-203a9d9c-9dc5-4192-835b-2ba04a5c013d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:56.239768 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-203a9d9c-9dc5-4192-835b-2ba04a5c013d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:56.281279 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-8ba003ed-1f92-4120-9cf6-cbade5aaa576 tempest-KeyPairsV210TestJSON-724409919 tempest-KeyPairsV210TestJSON-724409919-project-admin] Getting quotas for project bcf07e186ecf4d7185091b21e60201b8. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:13:56.291625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-8ba003ed-1f92-4120-9cf6-cbade5aaa576 tempest-KeyPairsV210TestJSON-724409919 tempest-KeyPairsV210TestJSON-724409919-project-admin] Getting quotas for user a7f8bab13a8440dc8c87822fc9eadb9d and project bcf07e186ecf4d7185091b21e60201b8. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:13:56.348660 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8ba003ed-1f92-4120-9cf6-cbade5aaa576 tempest-KeyPairsV210TestJSON-724409919 tempest-KeyPairsV210TestJSON-724409919-project-admin] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.141403 Aug 24 10:13:56.358171 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 414/782] 10.222.0.85 () {62 vars in 1200 bytes} [Wed Aug 24 10:13:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 152 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 10:13:56.364903 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-67ec6a7d-5ed2-4655-8491-369a6fcabb74 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:56.365913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-67ec6a7d-5ed2-4655-8491-369a6fcabb74 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:56.374375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67ec6a7d-5ed2-4655-8491-369a6fcabb74 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:56.375225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67ec6a7d-5ed2-4655-8491-369a6fcabb74 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:56.375934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67ec6a7d-5ed2-4655-8491-369a6fcabb74 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:56.378450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67ec6a7d-5ed2-4655-8491-369a6fcabb74 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:56.379200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67ec6a7d-5ed2-4655-8491-369a6fcabb74 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:56.379796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67ec6a7d-5ed2-4655-8491-369a6fcabb74 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:56.919806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-67ec6a7d-5ed2-4655-8491-369a6fcabb74 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:56.932536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-67ec6a7d-5ed2-4655-8491-369a6fcabb74 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:56.946140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-67ec6a7d-5ed2-4655-8491-369a6fcabb74 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:56.947332 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-67ec6a7d-5ed2-4655-8491-369a6fcabb74 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1409 microversion: 2.25 time: 0.587698 Aug 24 10:13:56.947924 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 415/783] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:13:56 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1409 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:13:56.952661 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-272d1410-97b1-4876-8c70-d74bf4219edc tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:56.953318 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-272d1410-97b1-4876-8c70-d74bf4219edc tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:56.969796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-272d1410-97b1-4876-8c70-d74bf4219edc tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:56.970191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-272d1410-97b1-4876-8c70-d74bf4219edc tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:56.970623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-272d1410-97b1-4876-8c70-d74bf4219edc tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:56.971331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-272d1410-97b1-4876-8c70-d74bf4219edc tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:56.971781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-272d1410-97b1-4876-8c70-d74bf4219edc tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:56.972199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-272d1410-97b1-4876-8c70-d74bf4219edc tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:57.123912 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-203a9d9c-9dc5-4192-835b-2ba04a5c013d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:57.136236 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-203a9d9c-9dc5-4192-835b-2ba04a5c013d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1312 microversion: 2.1 time: 0.943784 Aug 24 10:13:57.141264 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 369/784] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:56 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1312 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:57.146336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-744fcf1c-41bb-42e8-81a0-c09075bece53 tempest-KeyPairsV210TestJSON-724409919 tempest-KeyPairsV210TestJSON-724409919-project-admin] Calling method '.version_select at 0x7f46556928b0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:57.176802 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-744fcf1c-41bb-42e8-81a0-c09075bece53 tempest-KeyPairsV210TestJSON-724409919 tempest-KeyPairsV210TestJSON-724409919-project-admin] 10.222.0.85 "GET /compute/v2.1/os-keypairs/tempest-keypair-1574580715?user_id=08d3755e6aa447fa9aca492affb58040" status: 200 len: 512 microversion: 2.10 time: 0.034059 Aug 24 10:13:57.178299 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 370/785] 10.222.0.85 () {60 vars in 1340 bytes} [Wed Aug 24 10:13:57 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1574580715?user_id=08d3755e6aa447fa9aca492affb58040 => generated 512 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:13:57.189207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-ac905e6a-41a5-46b6-ac4a-3e0616540274 req-1b372fe0-ad21-4c6d-803d-d3a4e34fdd07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce6709c-548b-4bdc-9667-fa678dbeb477", "name": "network-vif-plugged", "status": "completed", "tag": "a5c8b983-3e85-49ee-93ef-994023d0a43c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:57.212281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ac905e6a-41a5-46b6-ac4a-3e0616540274 req-1b372fe0-ad21-4c6d-803d-d3a4e34fdd07 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:57.215145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ac905e6a-41a5-46b6-ac4a-3e0616540274 req-1b372fe0-ad21-4c6d-803d-d3a4e34fdd07 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:57.216041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ac905e6a-41a5-46b6-ac4a-3e0616540274 req-1b372fe0-ad21-4c6d-803d-d3a4e34fdd07 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:57.248642 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-ac905e6a-41a5-46b6-ac4a-3e0616540274 req-1b372fe0-ad21-4c6d-803d-d3a4e34fdd07 service nova] Creating event network-vif-plugged:a5c8b983-3e85-49ee-93ef-994023d0a43c for instance fce6709c-548b-4bdc-9667-fa678dbeb477 on n-h2-849328-3 Aug 24 10:13:57.256468 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-ac905e6a-41a5-46b6-ac4a-3e0616540274 req-1b372fe0-ad21-4c6d-803d-d3a4e34fdd07 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076661 Aug 24 10:13:57.263555 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 371/786] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:13:57.273466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-073fbc73-7a32-498d-baa2-6f246d712bca tempest-KeyPairsV210TestJSON-724409919 tempest-KeyPairsV210TestJSON-724409919-project-admin] Action: 'create', calling method: .version_select at 0x7f46555ee1f0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-285576698", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbA5Jd7MgbatzdFWaJ7bbek/RfkwOxWm9zoL8igRbsOiZlco5u2Kah7oV0vIS+AckpGNEFN7IIJ+wACCW2tptEWcpoq5sYyiEjFoJe5P10W6v6tSDGrVbdyNnu8vw15iw=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:57.327788 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-073fbc73-7a32-498d-baa2-6f246d712bca tempest-KeyPairsV210TestJSON-724409919 tempest-KeyPairsV210TestJSON-724409919-project-admin] Getting quotas for project bcf07e186ecf4d7185091b21e60201b8. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:13:57.342172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-073fbc73-7a32-498d-baa2-6f246d712bca tempest-KeyPairsV210TestJSON-724409919 tempest-KeyPairsV210TestJSON-724409919-project-admin] Getting quotas for user a7f8bab13a8440dc8c87822fc9eadb9d and project bcf07e186ecf4d7185091b21e60201b8. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:13:57.397309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:57.408964 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-073fbc73-7a32-498d-baa2-6f246d712bca tempest-KeyPairsV210TestJSON-724409919 tempest-KeyPairsV210TestJSON-724409919-project-admin] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.142912 Aug 24 10:13:57.417300 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 372/787] 10.222.0.85 () {62 vars in 1200 bytes} [Wed Aug 24 10:13:57 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 153 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 10:13:57.426993 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7fda0f98-3672-4682-81b6-faccbefb3ff6 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:57.432277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7fda0f98-3672-4682-81b6-faccbefb3ff6 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: 293f4b0e-a839-48f3-a510-4b4e320ebf59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:57.445922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fda0f98-3672-4682-81b6-faccbefb3ff6 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:57.446795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fda0f98-3672-4682-81b6-faccbefb3ff6 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:57.447470 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fda0f98-3672-4682-81b6-faccbefb3ff6 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:57.448537 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fda0f98-3672-4682-81b6-faccbefb3ff6 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:57.449179 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fda0f98-3672-4682-81b6-faccbefb3ff6 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:57.449763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fda0f98-3672-4682-81b6-faccbefb3ff6 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:57.704572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7fda0f98-3672-4682-81b6-faccbefb3ff6 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:57.738843 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7fda0f98-3672-4682-81b6-faccbefb3ff6 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59" status: 200 len: 1282 microversion: 2.1 time: 0.315656 Aug 24 10:13:57.741631 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 373/788] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:57 2022] GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59 => generated 1282 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:57.742261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-272d1410-97b1-4876-8c70-d74bf4219edc tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:57.751829 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-272d1410-97b1-4876-8c70-d74bf4219edc tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab" status: 200 len: 1307 microversion: 2.1 time: 0.802846 Aug 24 10:13:57.754955 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-395733cd-777c-43ee-a811-85c931536aa5 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:57.755725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-395733cd-777c-43ee-a811-85c931536aa5 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 1b80677b-614d-41a1-be0a-31bf5b46c485] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:57.757214 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 416/789] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:56 2022] GET /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab => generated 1307 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:57.762521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bd352f70-c073-4002-8d6e-35d73ecc5349 tempest-KeyPairsV210TestJSON-724409919 tempest-KeyPairsV210TestJSON-724409919-project-admin] Calling method '.version_select at 0x7f4655260160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:57.768206 n-d-849328-3 devstack@n-api.service[122433]: WARNING oslo_db.sqlalchemy.utils [None req-bd352f70-c073-4002-8d6e-35d73ecc5349 tempest-KeyPairsV210TestJSON-724409919 tempest-KeyPairsV210TestJSON-724409919-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 24 10:13:57.769808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-395733cd-777c-43ee-a811-85c931536aa5 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:57.774928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-395733cd-777c-43ee-a811-85c931536aa5 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:57.775471 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-395733cd-777c-43ee-a811-85c931536aa5 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:57.779821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-395733cd-777c-43ee-a811-85c931536aa5 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:57.780035 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bd352f70-c073-4002-8d6e-35d73ecc5349 tempest-KeyPairsV210TestJSON-724409919 tempest-KeyPairsV210TestJSON-724409919-project-admin] 10.222.0.85 "GET /compute/v2.1/os-keypairs?user_id=08d3755e6aa447fa9aca492affb58040" status: 200 len: 726 microversion: 2.10 time: 0.021288 Aug 24 10:13:57.786553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-395733cd-777c-43ee-a811-85c931536aa5 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:57.786553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-395733cd-777c-43ee-a811-85c931536aa5 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:57.787089 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 417/790] 10.222.0.85 () {60 vars in 1259 bytes} [Wed Aug 24 10:13:57 2022] GET /compute/v2.1/os-keypairs?user_id=08d3755e6aa447fa9aca492affb58040 => generated 726 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:13:57.810060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b5ceb4a4-2585-497c-a25d-ef7efe697839 tempest-KeyPairsV210TestJSON-724409919 tempest-KeyPairsV210TestJSON-724409919-project-admin] Calling method '.version_select at 0x7f465528a790>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:57.863682 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b5ceb4a4-2585-497c-a25d-ef7efe697839 tempest-KeyPairsV210TestJSON-724409919 tempest-KeyPairsV210TestJSON-724409919-project-admin] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-285576698" status: 204 len: 0 microversion: 2.10 time: 0.073586 Aug 24 10:13:57.864760 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 418/791] 10.222.0.85 () {60 vars in 1322 bytes} [Wed Aug 24 10:13:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-285576698 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:13:57.882044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2f1da4fb-c498-4f26-9220-1a6c0bed7ea6 tempest-KeyPairsV210TestJSON-724409919 tempest-KeyPairsV210TestJSON-724409919-project-admin] Calling method '.version_select at 0x7f46553b2af0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:57.905817 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2f1da4fb-c498-4f26-9220-1a6c0bed7ea6 tempest-KeyPairsV210TestJSON-724409919 tempest-KeyPairsV210TestJSON-724409919-project-admin] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1230763327?user_id=08d3755e6aa447fa9aca492affb58040" status: 204 len: 0 microversion: 2.10 time: 0.034705 Aug 24 10:13:57.910272 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 419/792] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Aug 24 10:13:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1230763327?user_id=08d3755e6aa447fa9aca492affb58040 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:13:57.916362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-be32395f-f0aa-48c7-ac42-d16bc8d4b2a8 tempest-KeyPairsV210TestJSON-724409919 tempest-KeyPairsV210TestJSON-724409919-project-admin] Calling method '.version_select at 0x7f465528dca0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:57.945863 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-be32395f-f0aa-48c7-ac42-d16bc8d4b2a8 tempest-KeyPairsV210TestJSON-724409919 tempest-KeyPairsV210TestJSON-724409919-project-admin] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1574580715?user_id=08d3755e6aa447fa9aca492affb58040" status: 204 len: 0 microversion: 2.10 time: 0.033789 Aug 24 10:13:57.953989 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 420/793] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Aug 24 10:13:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1574580715?user_id=08d3755e6aa447fa9aca492affb58040 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:13:57.981677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9e22501b-28c7-4d70-9407-495b7b49f01d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:57.982717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9e22501b-28c7-4d70-9407-495b7b49f01d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:58.031489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:58.040115 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e22501b-28c7-4d70-9407-495b7b49f01d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:58.042157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e22501b-28c7-4d70-9407-495b7b49f01d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:58.043919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e22501b-28c7-4d70-9407-495b7b49f01d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:58.046074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e22501b-28c7-4d70-9407-495b7b49f01d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:58.048066 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e22501b-28c7-4d70-9407-495b7b49f01d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:58.063094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e22501b-28c7-4d70-9407-495b7b49f01d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:58.298428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-395733cd-777c-43ee-a811-85c931536aa5 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:58.311809 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-395733cd-777c-43ee-a811-85c931536aa5 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485" status: 200 len: 1317 microversion: 2.1 time: 0.565612 Aug 24 10:13:58.312930 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 374/794] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:57 2022] GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485 => generated 1317 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:58.318839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-dce9bb5f-b2ff-4460-8127-8b6873dfd51b req-acaeed5f-5603-4459-b2a0-fcd1c122ee43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0", "tag": "24b3e11e-37a5-4b8e-b7ef-ba9e0ea1b0bc"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:13:58.338697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dce9bb5f-b2ff-4460-8127-8b6873dfd51b req-acaeed5f-5603-4459-b2a0-fcd1c122ee43 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:58.339481 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dce9bb5f-b2ff-4460-8127-8b6873dfd51b req-acaeed5f-5603-4459-b2a0-fcd1c122ee43 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:58.340087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dce9bb5f-b2ff-4460-8127-8b6873dfd51b req-acaeed5f-5603-4459-b2a0-fcd1c122ee43 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:58.361153 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-dce9bb5f-b2ff-4460-8127-8b6873dfd51b req-acaeed5f-5603-4459-b2a0-fcd1c122ee43 service nova] Creating event network-changed:24b3e11e-37a5-4b8e-b7ef-ba9e0ea1b0bc for instance 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 on n-h1-849328-3 Aug 24 10:13:58.368267 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-dce9bb5f-b2ff-4460-8127-8b6873dfd51b req-acaeed5f-5603-4459-b2a0-fcd1c122ee43 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053348 Aug 24 10:13:58.369855 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 375/795] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:13:58.380455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0ef92338-3c9f-4e58-8fd5-f048c455f36a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:58.382372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0ef92338-3c9f-4e58-8fd5-f048c455f36a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:58.391090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ef92338-3c9f-4e58-8fd5-f048c455f36a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:58.392054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ef92338-3c9f-4e58-8fd5-f048c455f36a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:58.392673 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ef92338-3c9f-4e58-8fd5-f048c455f36a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:58.393591 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ef92338-3c9f-4e58-8fd5-f048c455f36a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:58.394523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ef92338-3c9f-4e58-8fd5-f048c455f36a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:58.395215 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ef92338-3c9f-4e58-8fd5-f048c455f36a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:58.641491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9e22501b-28c7-4d70-9407-495b7b49f01d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:58.656502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9e22501b-28c7-4d70-9407-495b7b49f01d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:58.659935 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9e22501b-28c7-4d70-9407-495b7b49f01d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:58.661705 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9e22501b-28c7-4d70-9407-495b7b49f01d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1409 microversion: 2.25 time: 0.689177 Aug 24 10:13:58.681241 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 421/796] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:13:57 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1409 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:13:58.777810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a923ca30-21d6-44f4-8476-8bf8e19c5e56 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:58.779583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a923ca30-21d6-44f4-8476-8bf8e19c5e56 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: 293f4b0e-a839-48f3-a510-4b4e320ebf59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:58.814386 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a923ca30-21d6-44f4-8476-8bf8e19c5e56 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:58.817154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a923ca30-21d6-44f4-8476-8bf8e19c5e56 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:58.819868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a923ca30-21d6-44f4-8476-8bf8e19c5e56 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:58.820916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a923ca30-21d6-44f4-8476-8bf8e19c5e56 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:58.821711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a923ca30-21d6-44f4-8476-8bf8e19c5e56 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:58.822387 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a923ca30-21d6-44f4-8476-8bf8e19c5e56 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:58.882277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0ef92338-3c9f-4e58-8fd5-f048c455f36a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:58.897337 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0ef92338-3c9f-4e58-8fd5-f048c455f36a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1312 microversion: 2.1 time: 0.524347 Aug 24 10:13:58.913728 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 376/797] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:58 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1312 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:58.939404 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-19ce71f9-c951-4c28-ba4d-ba5a5b6935f9 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:58.940621 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-19ce71f9-c951-4c28-ba4d-ba5a5b6935f9 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:58.963843 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19ce71f9-c951-4c28-ba4d-ba5a5b6935f9 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:58.964464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19ce71f9-c951-4c28-ba4d-ba5a5b6935f9 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:58.965105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19ce71f9-c951-4c28-ba4d-ba5a5b6935f9 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:58.965919 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19ce71f9-c951-4c28-ba4d-ba5a5b6935f9 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:58.966384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19ce71f9-c951-4c28-ba4d-ba5a5b6935f9 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:58.975285 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19ce71f9-c951-4c28-ba4d-ba5a5b6935f9 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:59.077688 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:59.257093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a923ca30-21d6-44f4-8476-8bf8e19c5e56 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:59.271199 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a923ca30-21d6-44f4-8476-8bf8e19c5e56 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59" status: 200 len: 1324 microversion: 2.1 time: 0.501640 Aug 24 10:13:59.280541 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 422/798] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:58 2022] GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59 => generated 1324 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:59.335629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-703e4d76-8fcb-4a8d-9eb9-fab5021edbb7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:59.336580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-703e4d76-8fcb-4a8d-9eb9-fab5021edbb7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 1b80677b-614d-41a1-be0a-31bf5b46c485] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:59.350132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-703e4d76-8fcb-4a8d-9eb9-fab5021edbb7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:59.353419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-703e4d76-8fcb-4a8d-9eb9-fab5021edbb7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:59.353900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-703e4d76-8fcb-4a8d-9eb9-fab5021edbb7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:59.354660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-703e4d76-8fcb-4a8d-9eb9-fab5021edbb7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:59.359579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-703e4d76-8fcb-4a8d-9eb9-fab5021edbb7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:59.362084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-703e4d76-8fcb-4a8d-9eb9-fab5021edbb7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:59.729712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-703e4d76-8fcb-4a8d-9eb9-fab5021edbb7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:13:59.747244 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-703e4d76-8fcb-4a8d-9eb9-fab5021edbb7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485" status: 200 len: 1317 microversion: 2.1 time: 0.415418 Aug 24 10:13:59.762180 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 423/799] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:59 2022] GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485 => generated 1317 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:13:59.780857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4363b19f-be4a-46f6-8e64-3bdbb789e76f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:13:59.781516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4363b19f-be4a-46f6-8e64-3bdbb789e76f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:13:59.789183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4363b19f-be4a-46f6-8e64-3bdbb789e76f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:59.789816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4363b19f-be4a-46f6-8e64-3bdbb789e76f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:59.790257 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4363b19f-be4a-46f6-8e64-3bdbb789e76f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:13:59.790996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4363b19f-be4a-46f6-8e64-3bdbb789e76f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:13:59.791456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4363b19f-be4a-46f6-8e64-3bdbb789e76f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:13:59.792017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4363b19f-be4a-46f6-8e64-3bdbb789e76f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:00.061554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4363b19f-be4a-46f6-8e64-3bdbb789e76f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:00.074006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4363b19f-be4a-46f6-8e64-3bdbb789e76f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:00.075969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4363b19f-be4a-46f6-8e64-3bdbb789e76f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:00.077207 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4363b19f-be4a-46f6-8e64-3bdbb789e76f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1409 microversion: 2.25 time: 0.313290 Aug 24 10:14:00.088167 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 424/800] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:13:59 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1409 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:14:00.094769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb2b4731-5e39-4189-8d43-5e284b63fc2f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:00.095877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cb2b4731-5e39-4189-8d43-5e284b63fc2f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:00.136882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb2b4731-5e39-4189-8d43-5e284b63fc2f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:00.139712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb2b4731-5e39-4189-8d43-5e284b63fc2f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:00.140551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb2b4731-5e39-4189-8d43-5e284b63fc2f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:00.141883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb2b4731-5e39-4189-8d43-5e284b63fc2f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:00.142713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb2b4731-5e39-4189-8d43-5e284b63fc2f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:00.143478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb2b4731-5e39-4189-8d43-5e284b63fc2f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:00.164816 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-19ce71f9-c951-4c28-ba4d-ba5a5b6935f9 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:00.184595 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-19ce71f9-c951-4c28-ba4d-ba5a5b6935f9 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab" status: 200 len: 1307 microversion: 2.1 time: 1.269194 Aug 24 10:14:00.185480 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 377/801] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:13:58 2022] GET /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab => generated 1307 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:00.253366 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-33c0af70-5cf6-44ef-8eea-107737cb95b2 req-6252c13b-03a3-42c2-98c4-a92178a4f931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7953a2dc-785d-4cb0-a4ee-8bd420fc6fab", "name": "network-vif-plugged", "status": "completed", "tag": "c80fb50e-88a4-4f76-93d7-ac7c65fbd4b1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:00.275940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-33c0af70-5cf6-44ef-8eea-107737cb95b2 req-6252c13b-03a3-42c2-98c4-a92178a4f931 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:00.276739 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-33c0af70-5cf6-44ef-8eea-107737cb95b2 req-6252c13b-03a3-42c2-98c4-a92178a4f931 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:00.277355 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-33c0af70-5cf6-44ef-8eea-107737cb95b2 req-6252c13b-03a3-42c2-98c4-a92178a4f931 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:00.298352 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-33c0af70-5cf6-44ef-8eea-107737cb95b2 req-6252c13b-03a3-42c2-98c4-a92178a4f931 service nova] Creating event network-vif-plugged:c80fb50e-88a4-4f76-93d7-ac7c65fbd4b1 for instance 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab on n-h1-849328-3 Aug 24 10:14:00.315858 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-33c0af70-5cf6-44ef-8eea-107737cb95b2 req-6252c13b-03a3-42c2-98c4-a92178a4f931 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066289 Aug 24 10:14:00.320387 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 378/802] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:00.329404 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-985b1dcc-3f71-4d9e-a3cf-8898aeca3a57 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:00.342266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-985b1dcc-3f71-4d9e-a3cf-8898aeca3a57 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: 293f4b0e-a839-48f3-a510-4b4e320ebf59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:00.349948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-985b1dcc-3f71-4d9e-a3cf-8898aeca3a57 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:00.350912 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-985b1dcc-3f71-4d9e-a3cf-8898aeca3a57 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:00.351516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-985b1dcc-3f71-4d9e-a3cf-8898aeca3a57 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:00.354133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-985b1dcc-3f71-4d9e-a3cf-8898aeca3a57 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:00.354793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-985b1dcc-3f71-4d9e-a3cf-8898aeca3a57 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:00.356325 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-985b1dcc-3f71-4d9e-a3cf-8898aeca3a57 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:00.448737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cb2b4731-5e39-4189-8d43-5e284b63fc2f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:00.461940 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cb2b4731-5e39-4189-8d43-5e284b63fc2f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1460 microversion: 2.1 time: 0.381559 Aug 24 10:14:00.477147 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 425/803] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:00 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1460 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:00.496174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d1014add-f451-4cc1-b406-83cf031e4dc3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:00.498996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d1014add-f451-4cc1-b406-83cf031e4dc3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:00.512140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1014add-f451-4cc1-b406-83cf031e4dc3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:00.512866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1014add-f451-4cc1-b406-83cf031e4dc3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:00.513492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1014add-f451-4cc1-b406-83cf031e4dc3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:00.514394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1014add-f451-4cc1-b406-83cf031e4dc3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:00.515090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1014add-f451-4cc1-b406-83cf031e4dc3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:00.515665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1014add-f451-4cc1-b406-83cf031e4dc3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:00.625182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d1014add-f451-4cc1-b406-83cf031e4dc3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:00.633164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d1014add-f451-4cc1-b406-83cf031e4dc3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Old instance type m1.heat2, new instance type m1.heat {{(pid=122433) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 10:14:00.642526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d1014add-f451-4cc1-b406-83cf031e4dc3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:14:00.643874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d1014add-f451-4cc1-b406-83cf031e4dc3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:14:00.643874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d1014add-f451-4cc1-b406-83cf031e4dc3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:14:00.643874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d1014add-f451-4cc1-b406-83cf031e4dc3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:14:00.644420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d1014add-f451-4cc1-b406-83cf031e4dc3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:14:00.811470 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d1014add-f451-4cc1-b406-83cf031e4dc3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "POST /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477/action" status: 202 len: 0 microversion: 2.1 time: 0.325050 Aug 24 10:14:00.818137 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 426/804] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:14:00 2022] POST /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 10:14:00.824545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cad2894a-bf94-45fa-b027-443a464cb3b2 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:00.825521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cad2894a-bf94-45fa-b027-443a464cb3b2 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 1b80677b-614d-41a1-be0a-31bf5b46c485] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:00.834694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cad2894a-bf94-45fa-b027-443a464cb3b2 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:00.835444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cad2894a-bf94-45fa-b027-443a464cb3b2 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:00.836917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cad2894a-bf94-45fa-b027-443a464cb3b2 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:00.836917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cad2894a-bf94-45fa-b027-443a464cb3b2 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:00.837272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cad2894a-bf94-45fa-b027-443a464cb3b2 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:00.837638 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cad2894a-bf94-45fa-b027-443a464cb3b2 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:01.211728 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-985b1dcc-3f71-4d9e-a3cf-8898aeca3a57 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:01.224201 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-985b1dcc-3f71-4d9e-a3cf-8898aeca3a57 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59" status: 200 len: 1324 microversion: 2.1 time: 0.899091 Aug 24 10:14:01.227786 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 379/805] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:00 2022] GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59 => generated 1324 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:01.250831 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b358c5bb-da50-4c10-a981-9cae11d2e9fc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:01.253041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b358c5bb-da50-4c10-a981-9cae11d2e9fc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:01.270192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b358c5bb-da50-4c10-a981-9cae11d2e9fc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:01.270927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b358c5bb-da50-4c10-a981-9cae11d2e9fc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:01.271672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b358c5bb-da50-4c10-a981-9cae11d2e9fc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:01.272851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b358c5bb-da50-4c10-a981-9cae11d2e9fc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:01.273710 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b358c5bb-da50-4c10-a981-9cae11d2e9fc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:01.274428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b358c5bb-da50-4c10-a981-9cae11d2e9fc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:01.343440 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cad2894a-bf94-45fa-b027-443a464cb3b2 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:01.358476 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cad2894a-bf94-45fa-b027-443a464cb3b2 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485" status: 200 len: 1317 microversion: 2.1 time: 0.538858 Aug 24 10:14:01.361510 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 427/806] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:00 2022] GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485 => generated 1317 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:01.373560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d8881588-a06f-469a-858f-5bb67e2ba11a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:01.374752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d8881588-a06f-469a-858f-5bb67e2ba11a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:01.392453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8881588-a06f-469a-858f-5bb67e2ba11a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:01.392982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8881588-a06f-469a-858f-5bb67e2ba11a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:01.394633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8881588-a06f-469a-858f-5bb67e2ba11a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:01.395356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8881588-a06f-469a-858f-5bb67e2ba11a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:01.395807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8881588-a06f-469a-858f-5bb67e2ba11a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:01.396227 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8881588-a06f-469a-858f-5bb67e2ba11a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:02.005340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:14:02.031734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d8881588-a06f-469a-858f-5bb67e2ba11a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:02.053216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d8881588-a06f-469a-858f-5bb67e2ba11a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:02.056888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d8881588-a06f-469a-858f-5bb67e2ba11a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:02.058546 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d8881588-a06f-469a-858f-5bb67e2ba11a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1409 microversion: 2.25 time: 0.695964 Aug 24 10:14:02.080738 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 428/807] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:14:01 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1409 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:14:02.099952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-552bf488-c514-4200-a42d-369c6976a729 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:02.101364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-552bf488-c514-4200-a42d-369c6976a729 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:02.115252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-552bf488-c514-4200-a42d-369c6976a729 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:02.116661 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-552bf488-c514-4200-a42d-369c6976a729 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:02.117472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-552bf488-c514-4200-a42d-369c6976a729 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:02.118583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-552bf488-c514-4200-a42d-369c6976a729 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:02.119452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-552bf488-c514-4200-a42d-369c6976a729 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:02.120187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-552bf488-c514-4200-a42d-369c6976a729 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:02.135418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b358c5bb-da50-4c10-a981-9cae11d2e9fc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:02.146940 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b358c5bb-da50-4c10-a981-9cae11d2e9fc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1469 microversion: 2.1 time: 0.916877 Aug 24 10:14:02.151615 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 380/808] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:01 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1469 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:02.218068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-59a94a30-a0e5-4722-8c63-c91397ab4002 req-ef854527-dfa1-4cd2-921a-e126eec44073 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "293f4b0e-a839-48f3-a510-4b4e320ebf59", "tag": "f62c5a20-b4b1-4fec-8849-6937f20905b9"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:02.249874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-59a94a30-a0e5-4722-8c63-c91397ab4002 req-ef854527-dfa1-4cd2-921a-e126eec44073 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:02.250928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-59a94a30-a0e5-4722-8c63-c91397ab4002 req-ef854527-dfa1-4cd2-921a-e126eec44073 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:02.251478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-59a94a30-a0e5-4722-8c63-c91397ab4002 req-ef854527-dfa1-4cd2-921a-e126eec44073 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:02.297373 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-59a94a30-a0e5-4722-8c63-c91397ab4002 req-ef854527-dfa1-4cd2-921a-e126eec44073 service nova] Creating event network-changed:f62c5a20-b4b1-4fec-8849-6937f20905b9 for instance 293f4b0e-a839-48f3-a510-4b4e320ebf59 on n-h2-849328-3 Aug 24 10:14:02.317982 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-59a94a30-a0e5-4722-8c63-c91397ab4002 req-ef854527-dfa1-4cd2-921a-e126eec44073 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103193 Aug 24 10:14:02.319071 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 381/809] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:14:02.330373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8007fb49-22dc-4e3c-8637-3c0e2bfc6b33 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:02.334317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8007fb49-22dc-4e3c-8637-3c0e2bfc6b33 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: 293f4b0e-a839-48f3-a510-4b4e320ebf59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:02.344324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8007fb49-22dc-4e3c-8637-3c0e2bfc6b33 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:02.344890 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8007fb49-22dc-4e3c-8637-3c0e2bfc6b33 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:02.345577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8007fb49-22dc-4e3c-8637-3c0e2bfc6b33 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:02.346482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8007fb49-22dc-4e3c-8637-3c0e2bfc6b33 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:02.347327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8007fb49-22dc-4e3c-8637-3c0e2bfc6b33 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:02.347935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8007fb49-22dc-4e3c-8637-3c0e2bfc6b33 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:02.837260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-552bf488-c514-4200-a42d-369c6976a729 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:02.848331 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-552bf488-c514-4200-a42d-369c6976a729 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab" status: 200 len: 1307 microversion: 2.1 time: 0.765393 Aug 24 10:14:02.850023 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 429/810] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:02 2022] GET /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab => generated 1307 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:02.855550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-d8b4d7ae-cacc-4eff-99c5-958b50491946 req-12547845-8117-4a47-945d-19f52a344435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b80677b-614d-41a1-be0a-31bf5b46c485", "name": "network-vif-plugged", "status": "completed", "tag": "285fd86f-4935-4224-b70e-59290d2534ce"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:02.871393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d8b4d7ae-cacc-4eff-99c5-958b50491946 req-12547845-8117-4a47-945d-19f52a344435 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:02.872221 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d8b4d7ae-cacc-4eff-99c5-958b50491946 req-12547845-8117-4a47-945d-19f52a344435 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:02.873243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d8b4d7ae-cacc-4eff-99c5-958b50491946 req-12547845-8117-4a47-945d-19f52a344435 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:02.888702 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-d8b4d7ae-cacc-4eff-99c5-958b50491946 req-12547845-8117-4a47-945d-19f52a344435 service nova] Creating event network-vif-plugged:285fd86f-4935-4224-b70e-59290d2534ce for instance 1b80677b-614d-41a1-be0a-31bf5b46c485 on n-h2-849328-3 Aug 24 10:14:02.895221 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-d8b4d7ae-cacc-4eff-99c5-958b50491946 req-12547845-8117-4a47-945d-19f52a344435 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043850 Aug 24 10:14:02.896257 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 430/811] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:02.904844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8e49f8c9-11a6-45ad-95b2-e6e59b329f0b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:02.906093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8e49f8c9-11a6-45ad-95b2-e6e59b329f0b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 1b80677b-614d-41a1-be0a-31bf5b46c485] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:02.943576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e49f8c9-11a6-45ad-95b2-e6e59b329f0b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:02.947624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e49f8c9-11a6-45ad-95b2-e6e59b329f0b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:02.948086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e49f8c9-11a6-45ad-95b2-e6e59b329f0b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:02.949282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e49f8c9-11a6-45ad-95b2-e6e59b329f0b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:02.951377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e49f8c9-11a6-45ad-95b2-e6e59b329f0b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:02.951918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e49f8c9-11a6-45ad-95b2-e6e59b329f0b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:03.417187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8e49f8c9-11a6-45ad-95b2-e6e59b329f0b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:03.424559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8007fb49-22dc-4e3c-8637-3c0e2bfc6b33 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:03.432069 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8e49f8c9-11a6-45ad-95b2-e6e59b329f0b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485" status: 200 len: 1317 microversion: 2.1 time: 0.534367 Aug 24 10:14:03.432674 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 431/812] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:02 2022] GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485 => generated 1317 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:03.454822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ba8beb66-b718-4148-948e-02843fc84e95 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:03.455780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ba8beb66-b718-4148-948e-02843fc84e95 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:03.470952 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8007fb49-22dc-4e3c-8637-3c0e2bfc6b33 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59" status: 200 len: 1324 microversion: 2.1 time: 1.149189 Aug 24 10:14:03.478508 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 382/813] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:02 2022] GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59 => generated 1324 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:03.482235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba8beb66-b718-4148-948e-02843fc84e95 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:03.482809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba8beb66-b718-4148-948e-02843fc84e95 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:03.483272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba8beb66-b718-4148-948e-02843fc84e95 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:03.484070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba8beb66-b718-4148-948e-02843fc84e95 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:03.484528 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba8beb66-b718-4148-948e-02843fc84e95 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:03.497266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7f87dea0-5ff6-408b-b5a9-9ad5705bfbbc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:03.497886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba8beb66-b718-4148-948e-02843fc84e95 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:03.501565 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:14:03.512799 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7f87dea0-5ff6-408b-b5a9-9ad5705bfbbc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:03.565992 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f87dea0-5ff6-408b-b5a9-9ad5705bfbbc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:03.567318 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f87dea0-5ff6-408b-b5a9-9ad5705bfbbc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:03.570084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f87dea0-5ff6-408b-b5a9-9ad5705bfbbc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:03.576002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f87dea0-5ff6-408b-b5a9-9ad5705bfbbc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:03.579068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f87dea0-5ff6-408b-b5a9-9ad5705bfbbc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:03.582401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f87dea0-5ff6-408b-b5a9-9ad5705bfbbc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:03.911349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ba8beb66-b718-4148-948e-02843fc84e95 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:03.943544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ba8beb66-b718-4148-948e-02843fc84e95 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:03.952451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ba8beb66-b718-4148-948e-02843fc84e95 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:03.961706 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ba8beb66-b718-4148-948e-02843fc84e95 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1409 microversion: 2.25 time: 0.525710 Aug 24 10:14:03.969202 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 432/814] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:14:03 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1409 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:14:03.973388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-57b1a706-bb01-4107-b835-e81c0590730e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:03.974295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-57b1a706-bb01-4107-b835-e81c0590730e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:04.013937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57b1a706-bb01-4107-b835-e81c0590730e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:04.015391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57b1a706-bb01-4107-b835-e81c0590730e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:04.020570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57b1a706-bb01-4107-b835-e81c0590730e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:04.022260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57b1a706-bb01-4107-b835-e81c0590730e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:04.026417 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57b1a706-bb01-4107-b835-e81c0590730e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:04.027535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57b1a706-bb01-4107-b835-e81c0590730e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:04.055271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7f87dea0-5ff6-408b-b5a9-9ad5705bfbbc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:04.071018 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7f87dea0-5ff6-408b-b5a9-9ad5705bfbbc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1469 microversion: 2.1 time: 0.589173 Aug 24 10:14:04.075178 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 383/815] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:03 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1469 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:04.438262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-57b1a706-bb01-4107-b835-e81c0590730e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:04.448936 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-57b1a706-bb01-4107-b835-e81c0590730e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab" status: 200 len: 1486 microversion: 2.1 time: 0.482213 Aug 24 10:14:04.453888 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 433/816] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:03 2022] GET /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab => generated 1486 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:04.462260 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-91f2b348-fdf2-4cdc-95f8-accd37bdb021 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:04.463783 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-91f2b348-fdf2-4cdc-95f8-accd37bdb021 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 1b80677b-614d-41a1-be0a-31bf5b46c485] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:04.477896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91f2b348-fdf2-4cdc-95f8-accd37bdb021 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:04.478902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91f2b348-fdf2-4cdc-95f8-accd37bdb021 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:04.478902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91f2b348-fdf2-4cdc-95f8-accd37bdb021 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:04.479574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91f2b348-fdf2-4cdc-95f8-accd37bdb021 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:04.480042 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91f2b348-fdf2-4cdc-95f8-accd37bdb021 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:04.481801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91f2b348-fdf2-4cdc-95f8-accd37bdb021 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:04.487055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-901fcfa7-f9af-4e60-8967-52f448bf23df tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:04.487609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-901fcfa7-f9af-4e60-8967-52f448bf23df tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:04.517379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-901fcfa7-f9af-4e60-8967-52f448bf23df tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:04.520298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-901fcfa7-f9af-4e60-8967-52f448bf23df tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:04.524676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-901fcfa7-f9af-4e60-8967-52f448bf23df tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:04.526499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-901fcfa7-f9af-4e60-8967-52f448bf23df tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:04.527984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-901fcfa7-f9af-4e60-8967-52f448bf23df tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:04.529977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-901fcfa7-f9af-4e60-8967-52f448bf23df tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:04.719012 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-901fcfa7-f9af-4e60-8967-52f448bf23df tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "POST /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab/action" status: 202 len: 0 microversion: 2.1 time: 0.239391 Aug 24 10:14:04.722656 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 434/817] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:14:04 2022] POST /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:14:04.734429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6d4e540c-c6e2-4261-b135-bbfa552c5696 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:04.736053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6d4e540c-c6e2-4261-b135-bbfa552c5696 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: 293f4b0e-a839-48f3-a510-4b4e320ebf59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:04.748201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d4e540c-c6e2-4261-b135-bbfa552c5696 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:04.749615 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d4e540c-c6e2-4261-b135-bbfa552c5696 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:04.750692 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d4e540c-c6e2-4261-b135-bbfa552c5696 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:04.752461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d4e540c-c6e2-4261-b135-bbfa552c5696 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:04.753899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d4e540c-c6e2-4261-b135-bbfa552c5696 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:04.755456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d4e540c-c6e2-4261-b135-bbfa552c5696 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:05.022067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6d4e540c-c6e2-4261-b135-bbfa552c5696 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:05.039822 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6d4e540c-c6e2-4261-b135-bbfa552c5696 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59" status: 200 len: 1324 microversion: 2.1 time: 0.314743 Aug 24 10:14:05.040910 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 435/818] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:04 2022] GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59 => generated 1324 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:05.049374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fc5527a2-dacb-4218-8a0a-59a3ed8b5b30 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:05.050937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fc5527a2-dacb-4218-8a0a-59a3ed8b5b30 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:05.077206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc5527a2-dacb-4218-8a0a-59a3ed8b5b30 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:05.083919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc5527a2-dacb-4218-8a0a-59a3ed8b5b30 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:05.085539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc5527a2-dacb-4218-8a0a-59a3ed8b5b30 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:05.088473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc5527a2-dacb-4218-8a0a-59a3ed8b5b30 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:05.090377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc5527a2-dacb-4218-8a0a-59a3ed8b5b30 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:05.092400 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc5527a2-dacb-4218-8a0a-59a3ed8b5b30 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:05.321533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fc5527a2-dacb-4218-8a0a-59a3ed8b5b30 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:05.335719 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fc5527a2-dacb-4218-8a0a-59a3ed8b5b30 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab" status: 200 len: 1491 microversion: 2.1 time: 0.292725 Aug 24 10:14:05.337164 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 436/819] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:05 2022] GET /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab => generated 1491 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:05.365649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-554b4d1b-a6d2-404e-976a-961359194c6f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:05.366902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-554b4d1b-a6d2-404e-976a-961359194c6f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:05.378909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-554b4d1b-a6d2-404e-976a-961359194c6f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:05.380354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-554b4d1b-a6d2-404e-976a-961359194c6f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:05.380912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-554b4d1b-a6d2-404e-976a-961359194c6f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:05.381978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-554b4d1b-a6d2-404e-976a-961359194c6f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:05.382563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-554b4d1b-a6d2-404e-976a-961359194c6f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:05.383529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-554b4d1b-a6d2-404e-976a-961359194c6f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:05.454743 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-91f2b348-fdf2-4cdc-95f8-accd37bdb021 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:05.512785 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-91f2b348-fdf2-4cdc-95f8-accd37bdb021 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485" status: 200 len: 1317 microversion: 2.1 time: 1.057883 Aug 24 10:14:05.516677 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 384/820] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:04 2022] GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485 => generated 1317 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:14:05.535048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-95f68fdb-9fd8-4964-b9a9-803a4b037afd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:05.538995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-95f68fdb-9fd8-4964-b9a9-803a4b037afd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:05.588881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95f68fdb-9fd8-4964-b9a9-803a4b037afd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:05.595059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95f68fdb-9fd8-4964-b9a9-803a4b037afd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:05.596368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95f68fdb-9fd8-4964-b9a9-803a4b037afd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:05.603599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95f68fdb-9fd8-4964-b9a9-803a4b037afd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:05.607767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95f68fdb-9fd8-4964-b9a9-803a4b037afd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:05.613424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95f68fdb-9fd8-4964-b9a9-803a4b037afd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:05.641991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-554b4d1b-a6d2-404e-976a-961359194c6f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:05.663263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-554b4d1b-a6d2-404e-976a-961359194c6f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:05.668453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-554b4d1b-a6d2-404e-976a-961359194c6f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:05.692162 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-554b4d1b-a6d2-404e-976a-961359194c6f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1409 microversion: 2.25 time: 0.331852 Aug 24 10:14:05.693872 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 437/821] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:14:05 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1409 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:14:06.065255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fff92a72-33b5-49c4-91a0-007d9184a17f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:06.066074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fff92a72-33b5-49c4-91a0-007d9184a17f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: 293f4b0e-a839-48f3-a510-4b4e320ebf59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:06.080822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fff92a72-33b5-49c4-91a0-007d9184a17f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:06.082038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fff92a72-33b5-49c4-91a0-007d9184a17f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:06.084453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fff92a72-33b5-49c4-91a0-007d9184a17f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:06.086007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-95f68fdb-9fd8-4964-b9a9-803a4b037afd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:06.087650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fff92a72-33b5-49c4-91a0-007d9184a17f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:06.088133 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fff92a72-33b5-49c4-91a0-007d9184a17f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:06.088794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fff92a72-33b5-49c4-91a0-007d9184a17f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:06.101265 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-95f68fdb-9fd8-4964-b9a9-803a4b037afd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1469 microversion: 2.1 time: 0.584497 Aug 24 10:14:06.104333 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 385/822] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:05 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1469 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:06.223641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-864c5bef-b86c-493f-a830-944d29838367 req-f2565180-c803-4437-b84d-d4c443e7b3df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0", "name": "network-vif-plugged", "status": "completed", "tag": "24b3e11e-37a5-4b8e-b7ef-ba9e0ea1b0bc"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:06.239974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-864c5bef-b86c-493f-a830-944d29838367 req-f2565180-c803-4437-b84d-d4c443e7b3df service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:06.241363 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-864c5bef-b86c-493f-a830-944d29838367 req-f2565180-c803-4437-b84d-d4c443e7b3df service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:06.242717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-864c5bef-b86c-493f-a830-944d29838367 req-f2565180-c803-4437-b84d-d4c443e7b3df service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:06.264018 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-864c5bef-b86c-493f-a830-944d29838367 req-f2565180-c803-4437-b84d-d4c443e7b3df service nova] Creating event network-vif-plugged:24b3e11e-37a5-4b8e-b7ef-ba9e0ea1b0bc for instance 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 on n-h1-849328-3 Aug 24 10:14:06.273932 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-864c5bef-b86c-493f-a830-944d29838367 req-f2565180-c803-4437-b84d-d4c443e7b3df service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056292 Aug 24 10:14:06.275916 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 386/823] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:14:06.312826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=22 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:14:06.371979 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-98e34893-02ed-4bd6-9908-17a68c4a45ef tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:06.372981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-98e34893-02ed-4bd6-9908-17a68c4a45ef tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:06.382598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98e34893-02ed-4bd6-9908-17a68c4a45ef tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:06.383370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98e34893-02ed-4bd6-9908-17a68c4a45ef tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:06.383805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98e34893-02ed-4bd6-9908-17a68c4a45ef tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:06.384621 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98e34893-02ed-4bd6-9908-17a68c4a45ef tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:06.385010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98e34893-02ed-4bd6-9908-17a68c4a45ef tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:06.385457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98e34893-02ed-4bd6-9908-17a68c4a45ef tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:06.560410 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fff92a72-33b5-49c4-91a0-007d9184a17f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:06.580450 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fff92a72-33b5-49c4-91a0-007d9184a17f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59" status: 200 len: 1324 microversion: 2.1 time: 0.518124 Aug 24 10:14:06.581571 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 438/824] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:06 2022] GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59 => generated 1324 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:06.590034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-df34282f-3bd0-4e3c-a596-aa9521a8925d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:06.591153 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-df34282f-3bd0-4e3c-a596-aa9521a8925d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 1b80677b-614d-41a1-be0a-31bf5b46c485] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:06.603887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df34282f-3bd0-4e3c-a596-aa9521a8925d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:06.605322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df34282f-3bd0-4e3c-a596-aa9521a8925d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:06.605871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df34282f-3bd0-4e3c-a596-aa9521a8925d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:06.606908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df34282f-3bd0-4e3c-a596-aa9521a8925d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:06.607439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df34282f-3bd0-4e3c-a596-aa9521a8925d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:06.607969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df34282f-3bd0-4e3c-a596-aa9521a8925d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:06.657533 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-98e34893-02ed-4bd6-9908-17a68c4a45ef tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:06.671489 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-98e34893-02ed-4bd6-9908-17a68c4a45ef tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab" status: 200 len: 1471 microversion: 2.1 time: 0.306899 Aug 24 10:14:06.672437 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 387/825] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:06 2022] GET /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab => generated 1471 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:14:06.695820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d6d5dda2-dd30-4789-b725-93145869ccc3 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-489750685"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:06.699693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d6d5dda2-dd30-4789-b725-93145869ccc3 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:06.709902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6d5dda2-dd30-4789-b725-93145869ccc3 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:06.710439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6d5dda2-dd30-4789-b725-93145869ccc3 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:06.711064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6d5dda2-dd30-4789-b725-93145869ccc3 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:06.712356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6d5dda2-dd30-4789-b725-93145869ccc3 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:06.713760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6d5dda2-dd30-4789-b725-93145869ccc3 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:06.714465 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6d5dda2-dd30-4789-b725-93145869ccc3 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:07.118901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-df34282f-3bd0-4e3c-a596-aa9521a8925d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:07.132305 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-df34282f-3bd0-4e3c-a596-aa9521a8925d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485" status: 200 len: 1467 microversion: 2.1 time: 0.549286 Aug 24 10:14:07.134385 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 439/826] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:06 2022] GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485 => generated 1467 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:07.144989 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0b6208c8-6d16-4b07-86d6-7a48afb844e0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:07.146275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0b6208c8-6d16-4b07-86d6-7a48afb844e0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:07.161549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b6208c8-6d16-4b07-86d6-7a48afb844e0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:07.163745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b6208c8-6d16-4b07-86d6-7a48afb844e0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:07.164765 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b6208c8-6d16-4b07-86d6-7a48afb844e0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:07.167793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b6208c8-6d16-4b07-86d6-7a48afb844e0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:07.169369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b6208c8-6d16-4b07-86d6-7a48afb844e0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:07.169990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b6208c8-6d16-4b07-86d6-7a48afb844e0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:07.188429 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d6d5dda2-dd30-4789-b725-93145869ccc3 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "POST /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab/action" status: 202 len: 0 microversion: 2.1 time: 0.496582 Aug 24 10:14:07.190458 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 388/827] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:14:06 2022] POST /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 24 10:14:07.202178 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fa238121-942c-43c9-9636-f7bdb3717044 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:07.204179 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fa238121-942c-43c9-9636-f7bdb3717044 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:07.213955 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa238121-942c-43c9-9636-f7bdb3717044 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:07.215027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa238121-942c-43c9-9636-f7bdb3717044 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:07.216296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa238121-942c-43c9-9636-f7bdb3717044 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:07.217720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa238121-942c-43c9-9636-f7bdb3717044 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:07.218516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa238121-942c-43c9-9636-f7bdb3717044 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:07.220205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa238121-942c-43c9-9636-f7bdb3717044 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:07.372988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:14:07.561536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0b6208c8-6d16-4b07-86d6-7a48afb844e0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:07.579572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0b6208c8-6d16-4b07-86d6-7a48afb844e0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:07.583680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0b6208c8-6d16-4b07-86d6-7a48afb844e0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:07.586130 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0b6208c8-6d16-4b07-86d6-7a48afb844e0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1409 microversion: 2.25 time: 0.449144 Aug 24 10:14:07.587583 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 440/828] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:14:07 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1409 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:14:07.631719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5345d8c2-4956-4a62-8d6a-bd0610655715 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:07.633070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5345d8c2-4956-4a62-8d6a-bd0610655715 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] [instance: 1b80677b-614d-41a1-be0a-31bf5b46c485] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:07.678913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5345d8c2-4956-4a62-8d6a-bd0610655715 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:07.679643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5345d8c2-4956-4a62-8d6a-bd0610655715 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:07.680324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5345d8c2-4956-4a62-8d6a-bd0610655715 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:07.680848 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5345d8c2-4956-4a62-8d6a-bd0610655715 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:07.681383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5345d8c2-4956-4a62-8d6a-bd0610655715 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:07.682000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5345d8c2-4956-4a62-8d6a-bd0610655715 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:07.739032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fa238121-942c-43c9-9636-f7bdb3717044 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:07.769992 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fa238121-942c-43c9-9636-f7bdb3717044 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1469 microversion: 2.1 time: 0.576112 Aug 24 10:14:07.771648 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 389/829] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:07 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1469 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:07.780760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d5dc65d1-856c-4b40-bb64-5c0c702925cc tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f465587c8b0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:07.893320 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d5dc65d1-856c-4b40-bb64-5c0c702925cc tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b" status: 200 len: 1413 microversion: 2.1 time: 0.118829 Aug 24 10:14:07.894409 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 390/830] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:14:07 2022] GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b => generated 1413 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:07.911601 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a7c164c6-7904-45cd-b8f1-afaf5aaf0a2c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:07.912252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a7c164c6-7904-45cd-b8f1-afaf5aaf0a2c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: 293f4b0e-a839-48f3-a510-4b4e320ebf59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:07.933309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7c164c6-7904-45cd-b8f1-afaf5aaf0a2c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:07.934338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7c164c6-7904-45cd-b8f1-afaf5aaf0a2c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:07.934925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7c164c6-7904-45cd-b8f1-afaf5aaf0a2c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:07.936023 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7c164c6-7904-45cd-b8f1-afaf5aaf0a2c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:07.936896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7c164c6-7904-45cd-b8f1-afaf5aaf0a2c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:07.937408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7c164c6-7904-45cd-b8f1-afaf5aaf0a2c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:07.983525 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5345d8c2-4956-4a62-8d6a-bd0610655715 tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485" status: 200 len: 1618 microversion: 2.1 time: 0.383646 Aug 24 10:14:07.984643 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 441/831] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:07 2022] GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485 => generated 1618 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:08.224635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-22a32afb-2ab8-4a39-b73d-0ed782bd95fe tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1883166837", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "c7ad4cc6-0ddc-47f9-b386-1e0dde47808f"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:08.313805 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-22a32afb-2ab8-4a39-b73d-0ed782bd95fe tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:14:08.504320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a7c164c6-7904-45cd-b8f1-afaf5aaf0a2c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:08.512603 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a7c164c6-7904-45cd-b8f1-afaf5aaf0a2c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59" status: 200 len: 1324 microversion: 2.1 time: 0.616291 Aug 24 10:14:08.513791 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 391/832] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:07 2022] GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59 => generated 1324 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:08.626414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-29cf6f88-9fb1-4b36-b0d9-79a957f90a19 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:08.627050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-29cf6f88-9fb1-4b36-b0d9-79a957f90a19 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:08.640591 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29cf6f88-9fb1-4b36-b0d9-79a957f90a19 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:08.641295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29cf6f88-9fb1-4b36-b0d9-79a957f90a19 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:08.649922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29cf6f88-9fb1-4b36-b0d9-79a957f90a19 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:08.652764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29cf6f88-9fb1-4b36-b0d9-79a957f90a19 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:08.653681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29cf6f88-9fb1-4b36-b0d9-79a957f90a19 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:08.655922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29cf6f88-9fb1-4b36-b0d9-79a957f90a19 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:08.949729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-29cf6f88-9fb1-4b36-b0d9-79a957f90a19 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:08.985284 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-29cf6f88-9fb1-4b36-b0d9-79a957f90a19 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:08.990343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-29cf6f88-9fb1-4b36-b0d9-79a957f90a19 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:08.995823 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-29cf6f88-9fb1-4b36-b0d9-79a957f90a19 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1606 microversion: 2.25 time: 0.375562 Aug 24 10:14:09.002034 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 392/833] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:14:08 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1606 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:14:09.015871 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aa9b6157-06e6-4328-ae64-c1194c126427 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:09.018082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aa9b6157-06e6-4328-ae64-c1194c126427 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:09.027944 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa9b6157-06e6-4328-ae64-c1194c126427 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:09.028801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa9b6157-06e6-4328-ae64-c1194c126427 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:09.029600 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa9b6157-06e6-4328-ae64-c1194c126427 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:09.030569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa9b6157-06e6-4328-ae64-c1194c126427 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:09.031347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa9b6157-06e6-4328-ae64-c1194c126427 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:09.031937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa9b6157-06e6-4328-ae64-c1194c126427 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:09.092050 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-22a32afb-2ab8-4a39-b73d-0ed782bd95fe tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:14:09.092719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-22a32afb-2ab8-4a39-b73d-0ed782bd95fe tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:14:09.093306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-22a32afb-2ab8-4a39-b73d-0ed782bd95fe tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:14:09.093716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-22a32afb-2ab8-4a39-b73d-0ed782bd95fe tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:14:09.094127 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-22a32afb-2ab8-4a39-b73d-0ed782bd95fe tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:14:09.109794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22a32afb-2ab8-4a39-b73d-0ed782bd95fe tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:09.110298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22a32afb-2ab8-4a39-b73d-0ed782bd95fe tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:09.110727 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22a32afb-2ab8-4a39-b73d-0ed782bd95fe tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:09.114512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22a32afb-2ab8-4a39-b73d-0ed782bd95fe tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:09.115273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22a32afb-2ab8-4a39-b73d-0ed782bd95fe tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:09.116966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22a32afb-2ab8-4a39-b73d-0ed782bd95fe tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:09.170348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-22a32afb-2ab8-4a39-b73d-0ed782bd95fe tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:14:09.190200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-22a32afb-2ab8-4a39-b73d-0ed782bd95fe tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Getting quotas for user bf03c0eb5bd748ae85be830f1121dc06 and project f2e2ee3e278042a5bf8ee7348966a468. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:14:09.216950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-22a32afb-2ab8-4a39-b73d-0ed782bd95fe tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:14:09.222015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aa9b6157-06e6-4328-ae64-c1194c126427 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:09.222585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-22a32afb-2ab8-4a39-b73d-0ed782bd95fe tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:14:09.233862 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aa9b6157-06e6-4328-ae64-c1194c126427 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1469 microversion: 2.1 time: 0.230093 Aug 24 10:14:09.236342 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 393/834] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:09 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1469 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:09.244896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7c08cde1-d1b4-4f46-b053-48d7b01392c5 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4655630d30>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:09.320324 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7c08cde1-d1b4-4f46-b053-48d7b01392c5 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b" status: 200 len: 1413 microversion: 2.1 time: 0.082118 Aug 24 10:14:09.321070 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 394/835] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:14:09 2022] GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b => generated 1413 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:09.335038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-505a0e00-5d84-48f7-81cb-74166ed9d4db tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:09.337928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-505a0e00-5d84-48f7-81cb-74166ed9d4db tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:09.348652 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-505a0e00-5d84-48f7-81cb-74166ed9d4db tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:09.355393 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-22a32afb-2ab8-4a39-b73d-0ed782bd95fe tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.138768 Aug 24 10:14:09.357183 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 442/836] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:14:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:14:09.366170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-505a0e00-5d84-48f7-81cb-74166ed9d4db tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:09.369278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-505a0e00-5d84-48f7-81cb-74166ed9d4db tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:09.374638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-505a0e00-5d84-48f7-81cb-74166ed9d4db tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:09.377498 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-505a0e00-5d84-48f7-81cb-74166ed9d4db tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:09.378387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-505a0e00-5d84-48f7-81cb-74166ed9d4db tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:09.380235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-928ac416-5bf6-416e-8e11-9473225b54d0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:09.381752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-928ac416-5bf6-416e-8e11-9473225b54d0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:09.522049 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-928ac416-5bf6-416e-8e11-9473225b54d0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:09.556671 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-928ac416-5bf6-416e-8e11-9473225b54d0 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5" status: 200 len: 1217 microversion: 2.1 time: 0.183163 Aug 24 10:14:09.569226 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 443/837] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:09 2022] GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 => generated 1217 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:09.584374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f2c31440-0392-4a3b-8cd8-5ab7306bd973 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:09.586139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f2c31440-0392-4a3b-8cd8-5ab7306bd973 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: 293f4b0e-a839-48f3-a510-4b4e320ebf59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:09.608735 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-505a0e00-5d84-48f7-81cb-74166ed9d4db tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.284069 Aug 24 10:14:09.611635 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 395/838] 10.222.0.85 () {60 vars in 1316 bytes} [Wed Aug 24 10:14:09 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0/os-interface => generated 285 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:14:09.612144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2c31440-0392-4a3b-8cd8-5ab7306bd973 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:09.613062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2c31440-0392-4a3b-8cd8-5ab7306bd973 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:09.613849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2c31440-0392-4a3b-8cd8-5ab7306bd973 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:09.622955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2c31440-0392-4a3b-8cd8-5ab7306bd973 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:09.623850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2c31440-0392-4a3b-8cd8-5ab7306bd973 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:09.624657 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2c31440-0392-4a3b-8cd8-5ab7306bd973 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:10.055097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f2c31440-0392-4a3b-8cd8-5ab7306bd973 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:10.084686 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f2c31440-0392-4a3b-8cd8-5ab7306bd973 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59" status: 200 len: 1324 microversion: 2.1 time: 0.522531 Aug 24 10:14:10.085860 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 444/839] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:09 2022] GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59 => generated 1324 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:10.271764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5edb903c-6338-4e7e-b8a9-f5b89aa83c17 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:10.272562 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5edb903c-6338-4e7e-b8a9-f5b89aa83c17 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:10.285942 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5edb903c-6338-4e7e-b8a9-f5b89aa83c17 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:10.286494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5edb903c-6338-4e7e-b8a9-f5b89aa83c17 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:10.287009 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5edb903c-6338-4e7e-b8a9-f5b89aa83c17 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:10.287737 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5edb903c-6338-4e7e-b8a9-f5b89aa83c17 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:10.288193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5edb903c-6338-4e7e-b8a9-f5b89aa83c17 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:10.309450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5edb903c-6338-4e7e-b8a9-f5b89aa83c17 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:10.345747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5865f416-4034-4edb-b7ca-7401d821f478 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4655230af0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:10.467585 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5865f416-4034-4edb-b7ca-7401d821f478 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b" status: 200 len: 1413 microversion: 2.1 time: 0.118322 Aug 24 10:14:10.480871 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 445/840] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:14:10 2022] GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b => generated 1413 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:10.596069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-db971370-d1cf-453c-9e16-1d164612cadc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:10.597022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-db971370-d1cf-453c-9e16-1d164612cadc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:10.608754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db971370-d1cf-453c-9e16-1d164612cadc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:10.613525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db971370-d1cf-453c-9e16-1d164612cadc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:10.615732 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db971370-d1cf-453c-9e16-1d164612cadc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:10.617592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db971370-d1cf-453c-9e16-1d164612cadc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:10.646321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db971370-d1cf-453c-9e16-1d164612cadc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:10.646568 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db971370-d1cf-453c-9e16-1d164612cadc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:10.953589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-db971370-d1cf-453c-9e16-1d164612cadc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:10.989794 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-db971370-d1cf-453c-9e16-1d164612cadc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5" status: 200 len: 1221 microversion: 2.1 time: 0.400952 Aug 24 10:14:11.005973 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 446/841] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:10 2022] GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 => generated 1221 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:11.128560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d54bc56f-9350-4b9d-ba76-6531c0bfa2f6 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:11.129741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d54bc56f-9350-4b9d-ba76-6531c0bfa2f6 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: 293f4b0e-a839-48f3-a510-4b4e320ebf59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:11.160958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d54bc56f-9350-4b9d-ba76-6531c0bfa2f6 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:11.161890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d54bc56f-9350-4b9d-ba76-6531c0bfa2f6 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:11.162541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d54bc56f-9350-4b9d-ba76-6531c0bfa2f6 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:11.163929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d54bc56f-9350-4b9d-ba76-6531c0bfa2f6 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:11.164294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d54bc56f-9350-4b9d-ba76-6531c0bfa2f6 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:11.164757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d54bc56f-9350-4b9d-ba76-6531c0bfa2f6 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:12.149976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5edb903c-6338-4e7e-b8a9-f5b89aa83c17 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:12.182598 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5edb903c-6338-4e7e-b8a9-f5b89aa83c17 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1469 microversion: 2.1 time: 1.914604 Aug 24 10:14:12.244862 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 396/842] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:10 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1469 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:12.270260 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1d0f0186-2eec-4ad9-a13d-c21b5419314b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f46552dd670>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:12.451441 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1d0f0186-2eec-4ad9-a13d-c21b5419314b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b" status: 200 len: 1413 microversion: 2.1 time: 0.199631 Aug 24 10:14:12.454103 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 397/843] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:14:12 2022] GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b => generated 1413 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:12.461004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1adec8ed-194d-4c7b-bf1c-b9bbc120a3e6 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:12.462588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1adec8ed-194d-4c7b-bf1c-b9bbc120a3e6 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:12.472676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1adec8ed-194d-4c7b-bf1c-b9bbc120a3e6 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:12.473509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1adec8ed-194d-4c7b-bf1c-b9bbc120a3e6 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:12.474191 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1adec8ed-194d-4c7b-bf1c-b9bbc120a3e6 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:12.475140 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1adec8ed-194d-4c7b-bf1c-b9bbc120a3e6 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:12.476429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1adec8ed-194d-4c7b-bf1c-b9bbc120a3e6 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:12.477071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1adec8ed-194d-4c7b-bf1c-b9bbc120a3e6 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:12.485065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:14:12.820681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1adec8ed-194d-4c7b-bf1c-b9bbc120a3e6 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:12.835010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d54bc56f-9350-4b9d-ba76-6531c0bfa2f6 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:12.842028 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1adec8ed-194d-4c7b-bf1c-b9bbc120a3e6 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5" status: 200 len: 1287 microversion: 2.1 time: 0.383368 Aug 24 10:14:12.844462 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d54bc56f-9350-4b9d-ba76-6531c0bfa2f6 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59" status: 200 len: 1324 microversion: 2.1 time: 1.723671 Aug 24 10:14:12.845071 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 447/844] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:11 2022] GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59 => generated 1324 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:12.848605 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 398/845] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:12 2022] GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 => generated 1287 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:13.216554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-20aeb7f0-88d9-49bb-9450-64e98b63e47d req-c9ee01b7-c172-457e-9af4-bc337600da80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0", "tag": "24b3e11e-37a5-4b8e-b7ef-ba9e0ea1b0bc"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:13.229381 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-20aeb7f0-88d9-49bb-9450-64e98b63e47d req-c9ee01b7-c172-457e-9af4-bc337600da80 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:13.230534 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-20aeb7f0-88d9-49bb-9450-64e98b63e47d req-c9ee01b7-c172-457e-9af4-bc337600da80 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:13.231167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-20aeb7f0-88d9-49bb-9450-64e98b63e47d req-c9ee01b7-c172-457e-9af4-bc337600da80 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:13.253420 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-20aeb7f0-88d9-49bb-9450-64e98b63e47d req-c9ee01b7-c172-457e-9af4-bc337600da80 service nova] Creating event network-changed:24b3e11e-37a5-4b8e-b7ef-ba9e0ea1b0bc for instance 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 on n-h1-849328-3 Aug 24 10:14:13.260103 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-20aeb7f0-88d9-49bb-9450-64e98b63e47d req-c9ee01b7-c172-457e-9af4-bc337600da80 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047729 Aug 24 10:14:13.261830 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 399/846] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:13.271278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9e213c53-9ac0-4e98-8f2b-0801fe09d667 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:13.272560 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9e213c53-9ac0-4e98-8f2b-0801fe09d667 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:13.282444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e213c53-9ac0-4e98-8f2b-0801fe09d667 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:13.283538 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e213c53-9ac0-4e98-8f2b-0801fe09d667 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:13.283792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e213c53-9ac0-4e98-8f2b-0801fe09d667 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:13.284655 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e213c53-9ac0-4e98-8f2b-0801fe09d667 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:13.285398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e213c53-9ac0-4e98-8f2b-0801fe09d667 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:13.285846 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e213c53-9ac0-4e98-8f2b-0801fe09d667 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:13.462952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f0d79cff-7434-4079-8b65-c78fd9a303a0 tempest-VolumesAdminNegativeTest-340512969 tempest-VolumesAdminNegativeTest-340512969-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "fd0c6cc1-cb96-409c-90ff-9536cef309b9"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:13.466916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f0d79cff-7434-4079-8b65-c78fd9a303a0 tempest-VolumesAdminNegativeTest-340512969 tempest-VolumesAdminNegativeTest-340512969-project-admin] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:13.477890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0d79cff-7434-4079-8b65-c78fd9a303a0 tempest-VolumesAdminNegativeTest-340512969 tempest-VolumesAdminNegativeTest-340512969-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:13.481249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0d79cff-7434-4079-8b65-c78fd9a303a0 tempest-VolumesAdminNegativeTest-340512969 tempest-VolumesAdminNegativeTest-340512969-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:13.482695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0d79cff-7434-4079-8b65-c78fd9a303a0 tempest-VolumesAdminNegativeTest-340512969 tempest-VolumesAdminNegativeTest-340512969-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:13.484388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0d79cff-7434-4079-8b65-c78fd9a303a0 tempest-VolumesAdminNegativeTest-340512969 tempest-VolumesAdminNegativeTest-340512969-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:13.485093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0d79cff-7434-4079-8b65-c78fd9a303a0 tempest-VolumesAdminNegativeTest-340512969 tempest-VolumesAdminNegativeTest-340512969-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:13.485829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0d79cff-7434-4079-8b65-c78fd9a303a0 tempest-VolumesAdminNegativeTest-340512969 tempest-VolumesAdminNegativeTest-340512969-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:13.920131 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9e213c53-9ac0-4e98-8f2b-0801fe09d667 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:13.934511 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9e213c53-9ac0-4e98-8f2b-0801fe09d667 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1474 microversion: 2.1 time: 0.671060 Aug 24 10:14:13.954600 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 400/847] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:13 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1474 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:13.985437 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1131d9f0-6ba1-4467-a117-acb635dcb1b2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4655905ca0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:14.092512 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1131d9f0-6ba1-4467-a117-acb635dcb1b2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b" status: 200 len: 1413 microversion: 2.1 time: 0.132790 Aug 24 10:14:14.095265 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 401/848] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:14:13 2022] GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b => generated 1413 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:14.121574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4036e699-6719-48b0-a126-a4f49cd1cf1f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:14.123674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4036e699-6719-48b0-a126-a4f49cd1cf1f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: 293f4b0e-a839-48f3-a510-4b4e320ebf59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:14.143045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4036e699-6719-48b0-a126-a4f49cd1cf1f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:14.146876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4036e699-6719-48b0-a126-a4f49cd1cf1f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:14.147846 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4036e699-6719-48b0-a126-a4f49cd1cf1f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:14.149513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4036e699-6719-48b0-a126-a4f49cd1cf1f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:14.153088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4036e699-6719-48b0-a126-a4f49cd1cf1f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:14.159622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4036e699-6719-48b0-a126-a4f49cd1cf1f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:14.260348 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-f0d79cff-7434-4079-8b65-c78fd9a303a0 tempest-VolumesAdminNegativeTest-340512969 tempest-VolumesAdminNegativeTest-340512969-project-admin] HTTP exception thrown: Volume fd0c6cc1-cb96-409c-90ff-9536cef309b9 could not be found. Aug 24 10:14:14.271172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f0d79cff-7434-4079-8b65-c78fd9a303a0 tempest-VolumesAdminNegativeTest-340512969 tempest-VolumesAdminNegativeTest-340512969-project-admin] Request method failure captured: Aug 24 10:14:14.271172 n-d-849328-3 devstack@n-api.service[122433]: request: PUT /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381/os-volume_attachments/b20cfb5d-c464-483f-8308-f20afd882c4e HTTP/1.1 Aug 24 10:14:14.271172 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:14:14.271172 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:14:14.271172 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:14:14.271172 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 74 Aug 24 10:14:14.271172 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:14:14.271172 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:14:14.271172 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:14:14.271172 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:14:14.271172 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfmEbsCfRU_EZQbJ2LxrT6sN4iUV_xwnmnpGMxYAhr772TpiK-wkR7hCm_RhTwJbOFc-5BArV2W7Jt9iPUL8UJw6zXwrQ3dJUNw3yRPXbz8I1fiBbSzm5_ZHzPyeWrAaaFec3fatIPjFETK2inZq7A2YQ5jH9ixaDfG52U75qJSQnMw Aug 24 10:14:14.271172 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:14:14.271172 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:14:14.271172 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:14:14.271172 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:14:14.271172 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:14:14.271172 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:14:14.271172 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: f1e57f6a0bed4acbafd6f6ff6b6edf93 Aug 24 10:14:14.271172 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-VolumesAdminNegativeTest-340512969 Aug 24 10:14:14.271172 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:14:14.271172 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:14:14.273112 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f1e57f6a0bed4acbafd6f6ff6b6edf93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f1e57f6a0bed4acbafd6f6ff6b6edf93", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f1e57f6a0bed4acbafd6f6ff6b6edf93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f1e57f6a0bed4acbafd6f6ff6b6edf93"}]}] Aug 24 10:14:14.273112 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-VolumesAdminNegativeTest-340512969 Aug 24 10:14:14.273112 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: f1e57f6a0bed4acbafd6f6ff6b6edf93 Aug 24 10:14:14.273112 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-340512969 Aug 24 10:14:14.273112 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-VolumesAdminNegativeTest-340512969-project-admin Aug 24 10:14:14.273112 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:14:14.273112 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:14:14.273112 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: e4b55230cd4f44af9e20fcb5a6dcc639 Aug 24 10:14:14.273112 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-VolumesAdminNegativeTest-340512969-project-admin Aug 24 10:14:14.273112 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:14:14.273112 n-d-849328-3 devstack@n-api.service[122433]: {"volumeAttachment": {"volumeId": "fd0c6cc1-cb96-409c-90ff-9536cef309b9"}} Aug 24 10:14:14.273112 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:14:14.273112 n-d-849328-3 devstack@n-api.service[122433]: exception: Volume fd0c6cc1-cb96-409c-90ff-9536cef309b9 could not be found. Aug 24 10:14:14.274436 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'server_id': '71cb543d-2961-4511-b990-c53fd25db381', 'id': 'b20cfb5d-c464-483f-8308-f20afd882c4e', 'body': {'volumeAttachment': {'volumeId': 'fd0c6cc1-cb96-409c-90ff-9536cef309b9'}}} Aug 24 10:14:14.274436 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:14:14.274436 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:14:14.274436 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:14:14.274436 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:14:14.274436 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 10:14:14.274436 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 10:14:14.274436 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 10:14:14.274436 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 10:14:14.274436 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:14:14.274436 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:14:14.274436 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:14:14.274436 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:14:14.274436 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:14:14.274436 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:14:14.274436 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:14:14.274436 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:14:14.275879 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fd0c6cc1-cb96-409c-90ff-9536cef309b9 could not be found. (HTTP 404) (Request-ID: req-ba96c1c1-5cca-49a9-9ab3-73ed36b53de7) Aug 24 10:14:14.275879 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:14:14.275879 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:14:14.275879 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:14:14.275879 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:14:14.275879 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 24 10:14:14.275879 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 24 10:14:14.275879 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 10:14:14.275879 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 10:14:14.275879 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 10:14:14.275879 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 10:14:14.275879 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 10:14:14.275879 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 10:14:14.275879 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:14:14.275879 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:14:14.275879 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 10:14:14.275879 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 10:14:14.275879 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 10:14:14.275879 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 10:14:14.277671 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:14:14.277671 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:14:14.277671 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:14:14.277671 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:14:14.277671 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:14:14.277671 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:14:14.277671 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:14:14.277671 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:14:14.277671 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fd0c6cc1-cb96-409c-90ff-9536cef309b9 could not be found. Aug 24 10:14:14.277671 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:14:14.277671 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:14:14.277671 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:14:14.277671 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:14:14.277671 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:14:14.277671 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:14:14.277671 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:14:14.277671 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:14:14.277671 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:14:14.277671 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:14:14.279177 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:14:14.279177 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:14:14.279177 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:14:14.279177 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:14:14.279177 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 24 10:14:14.279177 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 24 10:14:14.279177 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 24 10:14:14.279177 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 10:14:14.279177 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume fd0c6cc1-cb96-409c-90ff-9536cef309b9 could not be found. Aug 24 10:14:14.279177 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:14:14.279177 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:14:14.279177 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:14:14.279177 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:14:14.279177 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:14:14.279177 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:14:14.279177 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:14:14.279177 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:14:14.279177 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fd0c6cc1-cb96-409c-90ff-9536cef309b9 could not be found. Aug 24 10:14:14.279177 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:14:14.281954 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f0d79cff-7434-4079-8b65-c78fd9a303a0 tempest-VolumesAdminNegativeTest-340512969 tempest-VolumesAdminNegativeTest-340512969-project-admin] Returning 400 to user: Volume fd0c6cc1-cb96-409c-90ff-9536cef309b9 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:14:14.286411 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f0d79cff-7434-4079-8b65-c78fd9a303a0 tempest-VolumesAdminNegativeTest-340512969 tempest-VolumesAdminNegativeTest-340512969-project-admin] 10.222.0.85 "PUT /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381/os-volume_attachments/b20cfb5d-c464-483f-8308-f20afd882c4e" status: 400 len: 107 microversion: 2.1 time: 1.440007 Aug 24 10:14:14.291971 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 448/849] 10.222.0.85 () {60 vars in 1433 bytes} [Wed Aug 24 10:14:12 2022] PUT /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381/os-volume_attachments/b20cfb5d-c464-483f-8308-f20afd882c4e => generated 107 bytes in 1446 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:14:14.307705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-56f883fe-36ab-4744-9a11-a2dfb4fac64d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:14.309904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-56f883fe-36ab-4744-9a11-a2dfb4fac64d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:14.349900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56f883fe-36ab-4744-9a11-a2dfb4fac64d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:14.350472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56f883fe-36ab-4744-9a11-a2dfb4fac64d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:14.350916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56f883fe-36ab-4744-9a11-a2dfb4fac64d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:14.353862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56f883fe-36ab-4744-9a11-a2dfb4fac64d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:14.357747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56f883fe-36ab-4744-9a11-a2dfb4fac64d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:14.358397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56f883fe-36ab-4744-9a11-a2dfb4fac64d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:14.493057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-56f883fe-36ab-4744-9a11-a2dfb4fac64d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:14.507430 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-56f883fe-36ab-4744-9a11-a2dfb4fac64d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5" status: 200 len: 1275 microversion: 2.1 time: 0.211551 Aug 24 10:14:14.509787 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 449/850] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:14 2022] GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 => generated 1275 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:14.526989 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6b4afe9a-6976-411f-b6a8-eb29d52cb151 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:14.531031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6b4afe9a-6976-411f-b6a8-eb29d52cb151 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:14.560096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b4afe9a-6976-411f-b6a8-eb29d52cb151 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:14.561500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b4afe9a-6976-411f-b6a8-eb29d52cb151 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:14.565707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b4afe9a-6976-411f-b6a8-eb29d52cb151 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:14.569651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b4afe9a-6976-411f-b6a8-eb29d52cb151 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:14.570726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b4afe9a-6976-411f-b6a8-eb29d52cb151 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:14.571507 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b4afe9a-6976-411f-b6a8-eb29d52cb151 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:14.875759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:14:14.901716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-6b4afe9a-6976-411f-b6a8-eb29d52cb151 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lazy-loading 'services' on Instance uuid 71cb543d-2961-4511-b990-c53fd25db381 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:14:15.260308 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6b4afe9a-6976-411f-b6a8-eb29d52cb151 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "DELETE /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381/os-volume_attachments/b20cfb5d-c464-483f-8308-f20afd882c4e" status: 202 len: 0 microversion: 2.1 time: 0.739934 Aug 24 10:14:15.261740 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 450/851] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Aug 24 10:14:14 2022] DELETE /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381/os-volume_attachments/b20cfb5d-c464-483f-8308-f20afd882c4e => generated 0 bytes in 750 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:14:15.327100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e4705ae5-8fc5-470b-8421-9d0a0a99caf2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:15.345614 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e4705ae5-8fc5-470b-8421-9d0a0a99caf2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:15.381982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4705ae5-8fc5-470b-8421-9d0a0a99caf2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:15.384098 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4705ae5-8fc5-470b-8421-9d0a0a99caf2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:15.387003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4705ae5-8fc5-470b-8421-9d0a0a99caf2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:15.388036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4705ae5-8fc5-470b-8421-9d0a0a99caf2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:15.388704 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4705ae5-8fc5-470b-8421-9d0a0a99caf2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:15.390828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4036e699-6719-48b0-a126-a4f49cd1cf1f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:15.393457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4705ae5-8fc5-470b-8421-9d0a0a99caf2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:15.434761 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4036e699-6719-48b0-a126-a4f49cd1cf1f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59" status: 200 len: 1324 microversion: 2.1 time: 1.337717 Aug 24 10:14:15.435412 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 402/852] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:14 2022] GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59 => generated 1324 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:15.829259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e4705ae5-8fc5-470b-8421-9d0a0a99caf2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:15.838090 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e4705ae5-8fc5-470b-8421-9d0a0a99caf2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1474 microversion: 2.1 time: 0.558295 Aug 24 10:14:15.842457 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 451/853] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:15 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1474 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:15.857241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4edc2141-e9a7-4763-8b40-c815f88cef1f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f46552224c0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:15.885224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-372e4b32-bc75-49bd-ad62-b83294330ee8 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Calling method '.version_select at 0x7f46558f58b0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:15.886442 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:14:15.886442 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:14:15.888343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-372e4b32-bc75-49bd-ad62-b83294330ee8 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:15.889082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-372e4b32-bc75-49bd-ad62-b83294330ee8 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:15.890021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-372e4b32-bc75-49bd-ad62-b83294330ee8 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:15.930993 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-372e4b32-bc75-49bd-ad62-b83294330ee8 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:15.933025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-372e4b32-bc75-49bd-ad62-b83294330ee8 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:15.933745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-372e4b32-bc75-49bd-ad62-b83294330ee8 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:15.970873 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4edc2141-e9a7-4763-8b40-c815f88cef1f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b" status: 200 len: 1413 microversion: 2.1 time: 0.121264 Aug 24 10:14:15.980061 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-372e4b32-bc75-49bd-ad62-b83294330ee8 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:15.980971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-372e4b32-bc75-49bd-ad62-b83294330ee8 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:15.987781 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 452/854] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:14:15 2022] GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b => generated 1413 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:15.990355 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-372e4b32-bc75-49bd-ad62-b83294330ee8 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:15.993626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-76f29f8f-532c-4273-9c1b-37c71e198daa tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:15.998494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-76f29f8f-532c-4273-9c1b-37c71e198daa tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:16.016354 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-372e4b32-bc75-49bd-ad62-b83294330ee8 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.570066 Aug 24 10:14:16.019581 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 403/855] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:14:15 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:16.028944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76f29f8f-532c-4273-9c1b-37c71e198daa tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:16.032010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76f29f8f-532c-4273-9c1b-37c71e198daa tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:16.032681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76f29f8f-532c-4273-9c1b-37c71e198daa tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:16.032905 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d617a9bb-24c8-4b73-bf60-9966ffa7f338 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:16.033769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76f29f8f-532c-4273-9c1b-37c71e198daa tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:16.034240 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76f29f8f-532c-4273-9c1b-37c71e198daa tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:16.034734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d617a9bb-24c8-4b73-bf60-9966ffa7f338 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:16.034899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76f29f8f-532c-4273-9c1b-37c71e198daa tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:16.052534 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d617a9bb-24c8-4b73-bf60-9966ffa7f338 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:16.054505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d617a9bb-24c8-4b73-bf60-9966ffa7f338 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:16.055666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d617a9bb-24c8-4b73-bf60-9966ffa7f338 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:16.058279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d617a9bb-24c8-4b73-bf60-9966ffa7f338 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:16.059316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d617a9bb-24c8-4b73-bf60-9966ffa7f338 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:16.060415 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d617a9bb-24c8-4b73-bf60-9966ffa7f338 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:16.121040 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-76f29f8f-532c-4273-9c1b-37c71e198daa tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131663 Aug 24 10:14:16.129313 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 453/856] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:14:15 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:16.140684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3cf0ac3-a85b-4057-87d2-13d68087fba6 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Calling method '.version_select at 0x7f465528dee0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:16.141985 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:14:16.141985 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:14:16.143249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3cf0ac3-a85b-4057-87d2-13d68087fba6 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:16.143744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3cf0ac3-a85b-4057-87d2-13d68087fba6 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:16.144184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3cf0ac3-a85b-4057-87d2-13d68087fba6 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:16.204721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3cf0ac3-a85b-4057-87d2-13d68087fba6 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:16.205246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3cf0ac3-a85b-4057-87d2-13d68087fba6 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:16.205689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3cf0ac3-a85b-4057-87d2-13d68087fba6 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:16.248825 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3cf0ac3-a85b-4057-87d2-13d68087fba6 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:16.249415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3cf0ac3-a85b-4057-87d2-13d68087fba6 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:16.249862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3cf0ac3-a85b-4057-87d2-13d68087fba6 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:16.282707 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d3cf0ac3-a85b-4057-87d2-13d68087fba6 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1506 microversion: 2.1 time: 0.146589 Aug 24 10:14:16.289560 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 454/857] 10.222.0.85 () {58 vars in 1167 bytes} [Wed Aug 24 10:14:16 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:16.326873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8d0dce6f-b537-427a-9bf6-3499a6d6fff5 req-66643ebf-f758-4d40-9fe0-2c39aab2263f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7953a2dc-785d-4cb0-a4ee-8bd420fc6fab", "name": "network-vif-plugged", "status": "completed", "tag": "c80fb50e-88a4-4f76-93d7-ac7c65fbd4b1"}, {"server_uuid": "293f4b0e-a839-48f3-a510-4b4e320ebf59", "name": "network-vif-plugged", "status": "completed", "tag": "f62c5a20-b4b1-4fec-8849-6937f20905b9"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:16.402077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8d0dce6f-b537-427a-9bf6-3499a6d6fff5 req-66643ebf-f758-4d40-9fe0-2c39aab2263f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:16.403096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8d0dce6f-b537-427a-9bf6-3499a6d6fff5 req-66643ebf-f758-4d40-9fe0-2c39aab2263f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:16.404658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8d0dce6f-b537-427a-9bf6-3499a6d6fff5 req-66643ebf-f758-4d40-9fe0-2c39aab2263f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:16.431766 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d617a9bb-24c8-4b73-bf60-9966ffa7f338 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:16.456857 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d617a9bb-24c8-4b73-bf60-9966ffa7f338 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5" status: 200 len: 1317 microversion: 2.1 time: 0.428483 Aug 24 10:14:16.478866 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 404/858] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:16 2022] GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 => generated 1317 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:16.479634 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8d0dce6f-b537-427a-9bf6-3499a6d6fff5 req-66643ebf-f758-4d40-9fe0-2c39aab2263f service nova] Creating event network-vif-plugged:c80fb50e-88a4-4f76-93d7-ac7c65fbd4b1 for instance 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab on n-h1-849328-3 Aug 24 10:14:16.480418 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8d0dce6f-b537-427a-9bf6-3499a6d6fff5 req-66643ebf-f758-4d40-9fe0-2c39aab2263f service nova] Creating event network-vif-plugged:f62c5a20-b4b1-4fec-8849-6937f20905b9 for instance 293f4b0e-a839-48f3-a510-4b4e320ebf59 on n-h2-849328-3 Aug 24 10:14:16.497459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fedd649e-ac9d-4ab6-993b-f6b64213e2e2 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Calling method '.version_select at 0x7f46554b9b80>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:16.502390 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:14:16.502390 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:14:16.514655 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fedd649e-ac9d-4ab6-993b-f6b64213e2e2 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:16.515369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fedd649e-ac9d-4ab6-993b-f6b64213e2e2 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:16.517375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fedd649e-ac9d-4ab6-993b-f6b64213e2e2 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:16.519128 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8d0dce6f-b537-427a-9bf6-3499a6d6fff5 req-66643ebf-f758-4d40-9fe0-2c39aab2263f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.227933 Aug 24 10:14:16.525939 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 455/859] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:16.539692 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d613cfdc-edba-4a02-a05e-0caf261a94b7 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:16.541637 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d613cfdc-edba-4a02-a05e-0caf261a94b7 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: 293f4b0e-a839-48f3-a510-4b4e320ebf59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:16.559444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fedd649e-ac9d-4ab6-993b-f6b64213e2e2 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:16.560519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fedd649e-ac9d-4ab6-993b-f6b64213e2e2 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:16.562043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d613cfdc-edba-4a02-a05e-0caf261a94b7 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:16.562742 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fedd649e-ac9d-4ab6-993b-f6b64213e2e2 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:16.563339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d613cfdc-edba-4a02-a05e-0caf261a94b7 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:16.564312 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d613cfdc-edba-4a02-a05e-0caf261a94b7 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:16.566000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d613cfdc-edba-4a02-a05e-0caf261a94b7 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:16.567321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d613cfdc-edba-4a02-a05e-0caf261a94b7 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:16.568488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d613cfdc-edba-4a02-a05e-0caf261a94b7 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:16.598965 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fedd649e-ac9d-4ab6-993b-f6b64213e2e2 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:16.599604 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fedd649e-ac9d-4ab6-993b-f6b64213e2e2 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:16.600186 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fedd649e-ac9d-4ab6-993b-f6b64213e2e2 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:16.611729 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fedd649e-ac9d-4ab6-993b-f6b64213e2e2 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.130274 Aug 24 10:14:16.616162 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 405/860] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:14:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:16.627406 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-89b36ca9-398e-4637-b80b-0f4b99eb7568 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Calling method '.version_select at 0x7f46555d41f0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:16.628484 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:14:16.628484 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:14:16.634338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89b36ca9-398e-4637-b80b-0f4b99eb7568 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:16.635233 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89b36ca9-398e-4637-b80b-0f4b99eb7568 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:16.636127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89b36ca9-398e-4637-b80b-0f4b99eb7568 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:16.679460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89b36ca9-398e-4637-b80b-0f4b99eb7568 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:16.690375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89b36ca9-398e-4637-b80b-0f4b99eb7568 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:16.691398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89b36ca9-398e-4637-b80b-0f4b99eb7568 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:16.712652 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-89b36ca9-398e-4637-b80b-0f4b99eb7568 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.089091 Aug 24 10:14:16.716076 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 406/861] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:14:16 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:14:16.728678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4d05e706-cf58-4b36-93c9-96c21b16960f tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Calling method '.version_select at 0x7f4655905310>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:16.730053 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:14:16.730053 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:14:16.731680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4d05e706-cf58-4b36-93c9-96c21b16960f tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:16.733880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4d05e706-cf58-4b36-93c9-96c21b16960f tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:16.736690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4d05e706-cf58-4b36-93c9-96c21b16960f tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:16.784849 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4d05e706-cf58-4b36-93c9-96c21b16960f tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 267 microversion: 2.1 time: 0.059885 Aug 24 10:14:16.786583 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 407/862] 10.222.0.85 () {58 vars in 1179 bytes} [Wed Aug 24 10:14:16 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 267 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:14:16.802974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-abd46907-d2f1-4ecb-a62c-550e16082b69 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Calling method '.version_select at 0x7f4655905940>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:16.804368 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:14:16.804368 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:14:16.813062 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abd46907-d2f1-4ecb-a62c-550e16082b69 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:16.814052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abd46907-d2f1-4ecb-a62c-550e16082b69 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:16.814818 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abd46907-d2f1-4ecb-a62c-550e16082b69 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:16.855025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abd46907-d2f1-4ecb-a62c-550e16082b69 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:16.855923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abd46907-d2f1-4ecb-a62c-550e16082b69 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:16.856610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abd46907-d2f1-4ecb-a62c-550e16082b69 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:16.884714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abd46907-d2f1-4ecb-a62c-550e16082b69 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:16.885640 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abd46907-d2f1-4ecb-a62c-550e16082b69 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:16.886341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abd46907-d2f1-4ecb-a62c-550e16082b69 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:16.906968 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-abd46907-d2f1-4ecb-a62c-550e16082b69 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.109959 Aug 24 10:14:16.908367 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 408/863] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:14:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:14:16.913612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d1a7b2db-cc93-4e8a-a88e-f6049cf04820 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:16.918112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d1a7b2db-cc93-4e8a-a88e-f6049cf04820 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:16.934404 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1a7b2db-cc93-4e8a-a88e-f6049cf04820 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:16.935352 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1a7b2db-cc93-4e8a-a88e-f6049cf04820 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:16.936042 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1a7b2db-cc93-4e8a-a88e-f6049cf04820 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:16.937110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1a7b2db-cc93-4e8a-a88e-f6049cf04820 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:16.940076 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1a7b2db-cc93-4e8a-a88e-f6049cf04820 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:16.940932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1a7b2db-cc93-4e8a-a88e-f6049cf04820 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:17.301699 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d613cfdc-edba-4a02-a05e-0caf261a94b7 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:17.318907 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d613cfdc-edba-4a02-a05e-0caf261a94b7 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59" status: 200 len: 1324 microversion: 2.1 time: 0.791172 Aug 24 10:14:17.320565 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 456/864] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:16 2022] GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59 => generated 1324 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:17.332199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ded08e6-d507-4b22-9c54-812110e9cd14 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Calling method '.version_select at 0x7f46550dc160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:17.335358 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:14:17.335358 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:14:17.338584 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ded08e6-d507-4b22-9c54-812110e9cd14 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:17.341572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ded08e6-d507-4b22-9c54-812110e9cd14 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:17.345512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ded08e6-d507-4b22-9c54-812110e9cd14 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:17.419106 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d1a7b2db-cc93-4e8a-a88e-f6049cf04820 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:17.426348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ded08e6-d507-4b22-9c54-812110e9cd14 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:17.428896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ded08e6-d507-4b22-9c54-812110e9cd14 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:17.429768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ded08e6-d507-4b22-9c54-812110e9cd14 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:17.438628 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d1a7b2db-cc93-4e8a-a88e-f6049cf04820 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1474 microversion: 2.1 time: 0.528636 Aug 24 10:14:17.440401 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 409/865] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:16 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1474 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:17.445910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-036f2ba3-d1d8-4454-a0d3-b965a8ea5265 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f465587caf0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:17.513651 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0ded08e6-d507-4b22-9c54-812110e9cd14 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.188975 Aug 24 10:14:17.532859 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 457/866] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:14:17 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:17.571231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-738f99c7-6e34-49ef-868b-5ca7abe5d804 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:17.591229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-738f99c7-6e34-49ef-868b-5ca7abe5d804 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:17.591970 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-036f2ba3-d1d8-4454-a0d3-b965a8ea5265 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b" status: 200 len: 1413 microversion: 2.1 time: 0.149391 Aug 24 10:14:17.594192 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 410/867] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:14:17 2022] GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b => generated 1413 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:17.607065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8d352b67-8d0e-4c2d-898f-992e709d9069 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:17.608316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8d352b67-8d0e-4c2d-898f-992e709d9069 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:17.626654 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d352b67-8d0e-4c2d-898f-992e709d9069 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:17.627630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d352b67-8d0e-4c2d-898f-992e709d9069 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:17.630507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d352b67-8d0e-4c2d-898f-992e709d9069 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:17.631991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d352b67-8d0e-4c2d-898f-992e709d9069 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:17.632872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d352b67-8d0e-4c2d-898f-992e709d9069 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:17.635439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d352b67-8d0e-4c2d-898f-992e709d9069 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:17.638381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-738f99c7-6e34-49ef-868b-5ca7abe5d804 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:17.639106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-738f99c7-6e34-49ef-868b-5ca7abe5d804 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:17.639729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-738f99c7-6e34-49ef-868b-5ca7abe5d804 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:17.640769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-738f99c7-6e34-49ef-868b-5ca7abe5d804 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:17.641470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-738f99c7-6e34-49ef-868b-5ca7abe5d804 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:17.642070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-738f99c7-6e34-49ef-868b-5ca7abe5d804 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:17.828350 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-738f99c7-6e34-49ef-868b-5ca7abe5d804 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.288830 Aug 24 10:14:17.841161 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 458/868] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:14:17 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381/os-volume_attachments => generated 197 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:17.862012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-66a8003b-4882-4dd2-99c4-491aa4594398 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Calling method '.version_select at 0x7f465528ac10>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:17.869573 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:14:17.869573 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:14:17.874853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66a8003b-4882-4dd2-99c4-491aa4594398 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:17.878432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66a8003b-4882-4dd2-99c4-491aa4594398 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:17.883929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66a8003b-4882-4dd2-99c4-491aa4594398 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:17.980133 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66a8003b-4882-4dd2-99c4-491aa4594398 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:17.991033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66a8003b-4882-4dd2-99c4-491aa4594398 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:17.992508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66a8003b-4882-4dd2-99c4-491aa4594398 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:18.051924 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-66a8003b-4882-4dd2-99c4-491aa4594398 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.208017 Aug 24 10:14:18.071724 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 459/869] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:14:17 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:18.122344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f9cc2cbb-0fbf-4a55-a0a1-1aaff31c4677 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Calling method '.version_select at 0x7f46551d60d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:18.135881 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:14:18.135881 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:14:18.143229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9cc2cbb-0fbf-4a55-a0a1-1aaff31c4677 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:18.148392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9cc2cbb-0fbf-4a55-a0a1-1aaff31c4677 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:18.153329 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9cc2cbb-0fbf-4a55-a0a1-1aaff31c4677 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:18.240114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9cc2cbb-0fbf-4a55-a0a1-1aaff31c4677 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:18.243937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9cc2cbb-0fbf-4a55-a0a1-1aaff31c4677 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:18.246541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9cc2cbb-0fbf-4a55-a0a1-1aaff31c4677 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:18.309037 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9cc2cbb-0fbf-4a55-a0a1-1aaff31c4677 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:18.310161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9cc2cbb-0fbf-4a55-a0a1-1aaff31c4677 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:18.314440 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9cc2cbb-0fbf-4a55-a0a1-1aaff31c4677 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:18.381019 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8d352b67-8d0e-4c2d-898f-992e709d9069 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:18.425675 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8d352b67-8d0e-4c2d-898f-992e709d9069 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5" status: 200 len: 1317 microversion: 2.1 time: 0.824977 Aug 24 10:14:18.427515 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 411/870] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:17 2022] GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 => generated 1317 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:18.446329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2e7b72d3-c974-489f-a3e9-ac20a46952ab tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:18.452023 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2e7b72d3-c974-489f-a3e9-ac20a46952ab tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: 293f4b0e-a839-48f3-a510-4b4e320ebf59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:18.475884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e7b72d3-c974-489f-a3e9-ac20a46952ab tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:18.482183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e7b72d3-c974-489f-a3e9-ac20a46952ab tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:18.483745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e7b72d3-c974-489f-a3e9-ac20a46952ab tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:18.484844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e7b72d3-c974-489f-a3e9-ac20a46952ab tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:18.487985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e7b72d3-c974-489f-a3e9-ac20a46952ab tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:18.489193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e7b72d3-c974-489f-a3e9-ac20a46952ab tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:18.728107 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f9cc2cbb-0fbf-4a55-a0a1-1aaff31c4677 tempest-HypervisorAdminTestJSON-1873881695 tempest-HypervisorAdminTestJSON-1873881695-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.646726 Aug 24 10:14:18.729675 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 460/871] 10.222.0.85 () {58 vars in 1173 bytes} [Wed Aug 24 10:14:18 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:18.744782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8c7fc9e7-3263-4f94-8938-fe36fc5d860d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:18.745857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8c7fc9e7-3263-4f94-8938-fe36fc5d860d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:18.779117 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:14:18.796267 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c7fc9e7-3263-4f94-8938-fe36fc5d860d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:18.807819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c7fc9e7-3263-4f94-8938-fe36fc5d860d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:18.808627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c7fc9e7-3263-4f94-8938-fe36fc5d860d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:18.809991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c7fc9e7-3263-4f94-8938-fe36fc5d860d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:18.810829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c7fc9e7-3263-4f94-8938-fe36fc5d860d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:18.825903 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c7fc9e7-3263-4f94-8938-fe36fc5d860d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:19.148338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:14:19.375302 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2e7b72d3-c974-489f-a3e9-ac20a46952ab tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:19.410668 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2e7b72d3-c974-489f-a3e9-ac20a46952ab tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59" status: 200 len: 1324 microversion: 2.1 time: 0.976808 Aug 24 10:14:19.416811 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 412/872] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:18 2022] GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59 => generated 1324 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:19.448074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d64fe329-53a5-4c6e-8cc1-62f99f3fdf5e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4655673670>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:19.546014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:14:19.605092 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d64fe329-53a5-4c6e-8cc1-62f99f3fdf5e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b" status: 200 len: 1413 microversion: 2.1 time: 0.182261 Aug 24 10:14:19.606879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8c7fc9e7-3263-4f94-8938-fe36fc5d860d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:19.622537 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8c7fc9e7-3263-4f94-8938-fe36fc5d860d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1474 microversion: 2.1 time: 0.888387 Aug 24 10:14:19.630396 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 413/873] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:14:19 2022] GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b => generated 1413 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:19.640611 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 461/874] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:18 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1474 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:19.649770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-77e1ea90-5776-4488-8614-208018b7debe req-e27a01f2-9559-43d6-9361-237c7c2f10f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5", "tag": "d3ec17cd-2f80-4ee9-8623-b97653866a24"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:19.663983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cd177a7c-97e2-4a00-adc8-e52f95ec1edc tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:19.673573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cd177a7c-97e2-4a00-adc8-e52f95ec1edc tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:19.680015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-77e1ea90-5776-4488-8614-208018b7debe req-e27a01f2-9559-43d6-9361-237c7c2f10f3 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:19.682709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-77e1ea90-5776-4488-8614-208018b7debe req-e27a01f2-9559-43d6-9361-237c7c2f10f3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:19.683537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-77e1ea90-5776-4488-8614-208018b7debe req-e27a01f2-9559-43d6-9361-237c7c2f10f3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:19.730326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd177a7c-97e2-4a00-adc8-e52f95ec1edc tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:19.731214 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd177a7c-97e2-4a00-adc8-e52f95ec1edc tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:19.742709 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-77e1ea90-5776-4488-8614-208018b7debe req-e27a01f2-9559-43d6-9361-237c7c2f10f3 service nova] Creating event network-changed:d3ec17cd-2f80-4ee9-8623-b97653866a24 for instance 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 on n-h1-849328-3 Aug 24 10:14:19.744755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd177a7c-97e2-4a00-adc8-e52f95ec1edc tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:19.746112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd177a7c-97e2-4a00-adc8-e52f95ec1edc tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:19.755248 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd177a7c-97e2-4a00-adc8-e52f95ec1edc tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:19.759820 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-77e1ea90-5776-4488-8614-208018b7debe req-e27a01f2-9559-43d6-9361-237c7c2f10f3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117417 Aug 24 10:14:19.765360 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 462/875] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:19.766305 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd177a7c-97e2-4a00-adc8-e52f95ec1edc tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:19.774725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-310f0fad-774c-4c0a-b6c4-d0f7459f0093 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:19.777604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-310f0fad-774c-4c0a-b6c4-d0f7459f0093 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:19.786786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-310f0fad-774c-4c0a-b6c4-d0f7459f0093 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:19.787740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-310f0fad-774c-4c0a-b6c4-d0f7459f0093 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:19.788549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-310f0fad-774c-4c0a-b6c4-d0f7459f0093 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:19.789617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-310f0fad-774c-4c0a-b6c4-d0f7459f0093 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:19.790263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-310f0fad-774c-4c0a-b6c4-d0f7459f0093 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:19.790882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-310f0fad-774c-4c0a-b6c4-d0f7459f0093 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:19.884032 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cd177a7c-97e2-4a00-adc8-e52f95ec1edc tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.251517 Aug 24 10:14:19.900538 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 414/876] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:14:19 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381/os-volume_attachments => generated 197 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:20.444800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-60fb727a-f952-4674-ab43-8eb69b44aef5 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:20.447275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-60fb727a-f952-4674-ab43-8eb69b44aef5 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: 293f4b0e-a839-48f3-a510-4b4e320ebf59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:20.498071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60fb727a-f952-4674-ab43-8eb69b44aef5 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:20.509417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60fb727a-f952-4674-ab43-8eb69b44aef5 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:20.515882 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60fb727a-f952-4674-ab43-8eb69b44aef5 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:20.522808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60fb727a-f952-4674-ab43-8eb69b44aef5 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:20.539857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60fb727a-f952-4674-ab43-8eb69b44aef5 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:20.540319 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60fb727a-f952-4674-ab43-8eb69b44aef5 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:21.002249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-310f0fad-774c-4c0a-b6c4-d0f7459f0093 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:21.024326 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-310f0fad-774c-4c0a-b6c4-d0f7459f0093 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5" status: 200 len: 1317 microversion: 2.1 time: 1.256444 Aug 24 10:14:21.024965 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 463/877] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:19 2022] GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 => generated 1317 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:21.043120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ffc26d4-ce46-41f3-9105-04682bdb5d8b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:21.054271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4ffc26d4-ce46-41f3-9105-04682bdb5d8b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:21.075767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ffc26d4-ce46-41f3-9105-04682bdb5d8b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:21.076304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ffc26d4-ce46-41f3-9105-04682bdb5d8b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:21.076724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ffc26d4-ce46-41f3-9105-04682bdb5d8b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:21.077599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ffc26d4-ce46-41f3-9105-04682bdb5d8b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:21.078067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ffc26d4-ce46-41f3-9105-04682bdb5d8b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:21.078490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ffc26d4-ce46-41f3-9105-04682bdb5d8b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:21.121716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-60fb727a-f952-4674-ab43-8eb69b44aef5 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:21.134635 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-60fb727a-f952-4674-ab43-8eb69b44aef5 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59" status: 200 len: 1521 microversion: 2.1 time: 0.699966 Aug 24 10:14:21.141494 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 415/878] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:20 2022] GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59 => generated 1521 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:21.146491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bb9f7868-7d48-41c0-a85c-0cea6b82d124 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f46558848b0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:21.259386 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bb9f7868-7d48-41c0-a85c-0cea6b82d124 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b" status: 200 len: 1413 microversion: 2.1 time: 0.116642 Aug 24 10:14:21.260315 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 416/879] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:14:21 2022] GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b => generated 1413 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:21.271870 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5bbf4ac3-bf58-4d4e-b7af-29148cef986c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:21.278659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5bbf4ac3-bf58-4d4e-b7af-29148cef986c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:21.314487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bbf4ac3-bf58-4d4e-b7af-29148cef986c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:21.314991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bbf4ac3-bf58-4d4e-b7af-29148cef986c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:21.315437 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bbf4ac3-bf58-4d4e-b7af-29148cef986c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:21.316167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bbf4ac3-bf58-4d4e-b7af-29148cef986c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:21.316630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bbf4ac3-bf58-4d4e-b7af-29148cef986c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:21.317057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bbf4ac3-bf58-4d4e-b7af-29148cef986c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:21.447354 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5bbf4ac3-bf58-4d4e-b7af-29148cef986c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185816 Aug 24 10:14:21.448227 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 417/880] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:14:21 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:21.464083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-243865d1-191e-48ad-af1f-fd23239bfa63 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Action: 'action', calling method: .version_select at 0x7f4657d795e0>, body: {"addFloatingIp": {"address": "172.25.0.196"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:21.469208 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-243865d1-191e-48ad-af1f-fd23239bfa63 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:21.483728 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-243865d1-191e-48ad-af1f-fd23239bfa63 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:21.484711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-243865d1-191e-48ad-af1f-fd23239bfa63 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:21.485438 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-243865d1-191e-48ad-af1f-fd23239bfa63 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:21.496094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-243865d1-191e-48ad-af1f-fd23239bfa63 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:21.501547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4ffc26d4-ce46-41f3-9105-04682bdb5d8b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:21.502567 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-243865d1-191e-48ad-af1f-fd23239bfa63 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:21.516887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-243865d1-191e-48ad-af1f-fd23239bfa63 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:21.521069 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4ffc26d4-ce46-41f3-9105-04682bdb5d8b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1474 microversion: 2.1 time: 0.494856 Aug 24 10:14:21.522085 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 464/881] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:21 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1474 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:21.751784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-243865d1-191e-48ad-af1f-fd23239bfa63 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "refresh_cache-c285a5a5-ba66-41c8-aa67-402e2d5f9159" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 10:14:21.752416 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-243865d1-191e-48ad-af1f-fd23239bfa63 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquired lock "refresh_cache-c285a5a5-ba66-41c8-aa67-402e2d5f9159" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 10:14:22.067647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0aa51ce5-1f55-4cc6-93db-3b4ebc85028a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:22.068789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0aa51ce5-1f55-4cc6-93db-3b4ebc85028a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:22.105405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0aa51ce5-1f55-4cc6-93db-3b4ebc85028a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:22.106255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0aa51ce5-1f55-4cc6-93db-3b4ebc85028a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:22.110608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0aa51ce5-1f55-4cc6-93db-3b4ebc85028a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:22.112363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0aa51ce5-1f55-4cc6-93db-3b4ebc85028a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:22.112880 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0aa51ce5-1f55-4cc6-93db-3b4ebc85028a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:22.113372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0aa51ce5-1f55-4cc6-93db-3b4ebc85028a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:22.881257 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0aa51ce5-1f55-4cc6-93db-3b4ebc85028a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:22.917896 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0aa51ce5-1f55-4cc6-93db-3b4ebc85028a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5" status: 200 len: 1317 microversion: 2.1 time: 0.860173 Aug 24 10:14:22.924344 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 465/882] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:22 2022] GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 => generated 1317 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:22.929956 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c0f84f37-a550-4429-8752-ba1e5e0ed500 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4655092d30>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:23.118179 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c0f84f37-a550-4429-8752-ba1e5e0ed500 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b" status: 200 len: 1413 microversion: 2.1 time: 0.192353 Aug 24 10:14:23.119256 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 466/883] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:14:22 2022] GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b => generated 1413 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:23.124025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-caa74339-8972-46db-b88e-cfb5048d3fa4 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:23.137258 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-caa74339-8972-46db-b88e-cfb5048d3fa4 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:23.161153 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-caa74339-8972-46db-b88e-cfb5048d3fa4 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:23.162071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-caa74339-8972-46db-b88e-cfb5048d3fa4 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:23.162736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-caa74339-8972-46db-b88e-cfb5048d3fa4 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:23.163696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-caa74339-8972-46db-b88e-cfb5048d3fa4 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:23.164380 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-caa74339-8972-46db-b88e-cfb5048d3fa4 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:23.165074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-caa74339-8972-46db-b88e-cfb5048d3fa4 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:23.251239 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-caa74339-8972-46db-b88e-cfb5048d3fa4 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130884 Aug 24 10:14:23.252920 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 467/884] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:14:23 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:23.264603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f26e018f-b883-471c-b980-91723cf12c54 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:23.269055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f26e018f-b883-471c-b980-91723cf12c54 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:23.285257 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f26e018f-b883-471c-b980-91723cf12c54 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:23.286185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f26e018f-b883-471c-b980-91723cf12c54 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:23.288912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f26e018f-b883-471c-b980-91723cf12c54 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:23.290075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f26e018f-b883-471c-b980-91723cf12c54 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:23.290766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f26e018f-b883-471c-b980-91723cf12c54 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:23.291697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f26e018f-b883-471c-b980-91723cf12c54 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:24.015437 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f26e018f-b883-471c-b980-91723cf12c54 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:24.044778 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f26e018f-b883-471c-b980-91723cf12c54 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1474 microversion: 2.1 time: 0.789503 Aug 24 10:14:24.067733 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 468/885] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:23 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1474 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:24.078383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f046c09a-a112-4bfe-87fe-3b0fcd5c7202 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:24.085070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f046c09a-a112-4bfe-87fe-3b0fcd5c7202 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:24.103470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f046c09a-a112-4bfe-87fe-3b0fcd5c7202 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:24.106241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f046c09a-a112-4bfe-87fe-3b0fcd5c7202 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:24.106975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f046c09a-a112-4bfe-87fe-3b0fcd5c7202 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:24.114455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f046c09a-a112-4bfe-87fe-3b0fcd5c7202 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:24.115449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f046c09a-a112-4bfe-87fe-3b0fcd5c7202 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:24.116245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f046c09a-a112-4bfe-87fe-3b0fcd5c7202 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:24.629209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f046c09a-a112-4bfe-87fe-3b0fcd5c7202 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:24.652884 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f046c09a-a112-4bfe-87fe-3b0fcd5c7202 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5" status: 200 len: 1317 microversion: 2.1 time: 0.581367 Aug 24 10:14:24.665815 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 469/886] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:24 2022] GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 => generated 1317 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:24.685807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ce0af4f7-696c-4d56-924a-0b0d7f8e2eb6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4655185310>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:24.802058 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ce0af4f7-696c-4d56-924a-0b0d7f8e2eb6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b" status: 200 len: 1413 microversion: 2.1 time: 0.122328 Aug 24 10:14:24.803374 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 470/887] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:14:24 2022] GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b => generated 1413 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:24.823795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0d8a566f-a8cc-4353-b3a1-ab3820bc6805 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:24.826817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0d8a566f-a8cc-4353-b3a1-ab3820bc6805 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:24.846825 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d8a566f-a8cc-4353-b3a1-ab3820bc6805 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:24.847676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d8a566f-a8cc-4353-b3a1-ab3820bc6805 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:24.848398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d8a566f-a8cc-4353-b3a1-ab3820bc6805 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:24.849773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d8a566f-a8cc-4353-b3a1-ab3820bc6805 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:24.852081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d8a566f-a8cc-4353-b3a1-ab3820bc6805 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:24.853228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d8a566f-a8cc-4353-b3a1-ab3820bc6805 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:24.895456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:14:24.904051 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0d8a566f-a8cc-4353-b3a1-ab3820bc6805 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098658 Aug 24 10:14:24.904681 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 471/888] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:14:24 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:25.075504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b51e92f7-cff7-4340-b5e4-59b5373efb53 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:25.076731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b51e92f7-cff7-4340-b5e4-59b5373efb53 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:25.100206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b51e92f7-cff7-4340-b5e4-59b5373efb53 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:25.100728 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b51e92f7-cff7-4340-b5e4-59b5373efb53 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:25.109467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b51e92f7-cff7-4340-b5e4-59b5373efb53 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:25.110807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b51e92f7-cff7-4340-b5e4-59b5373efb53 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:25.115901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b51e92f7-cff7-4340-b5e4-59b5373efb53 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:25.116862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b51e92f7-cff7-4340-b5e4-59b5373efb53 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:25.543147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b51e92f7-cff7-4340-b5e4-59b5373efb53 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:25.553829 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b51e92f7-cff7-4340-b5e4-59b5373efb53 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1474 microversion: 2.1 time: 0.484006 Aug 24 10:14:25.555081 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 472/889] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:25 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1474 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:14:25.684736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1af7ecb8-4a74-4e57-9dd0-78d297fa304b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:25.685532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1af7ecb8-4a74-4e57-9dd0-78d297fa304b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:25.698870 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1af7ecb8-4a74-4e57-9dd0-78d297fa304b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:25.699380 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1af7ecb8-4a74-4e57-9dd0-78d297fa304b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:25.699817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1af7ecb8-4a74-4e57-9dd0-78d297fa304b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:25.700554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1af7ecb8-4a74-4e57-9dd0-78d297fa304b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:25.701026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1af7ecb8-4a74-4e57-9dd0-78d297fa304b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:25.701620 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1af7ecb8-4a74-4e57-9dd0-78d297fa304b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:26.096801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1af7ecb8-4a74-4e57-9dd0-78d297fa304b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:26.125069 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1af7ecb8-4a74-4e57-9dd0-78d297fa304b tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5" status: 200 len: 1317 microversion: 2.1 time: 0.443765 Aug 24 10:14:26.126724 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 473/890] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:25 2022] GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 => generated 1317 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:14:26.139878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-369417fe-870e-4c6f-8050-2c8c41b9410d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f465528ac10>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:26.309904 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-369417fe-870e-4c6f-8050-2c8c41b9410d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b" status: 200 len: 1413 microversion: 2.1 time: 0.172374 Aug 24 10:14:26.327657 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 474/891] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:14:26 2022] GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b => generated 1413 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:26.350935 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-db1d7f20-1b8d-4469-a517-08e251ed9900 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:26.359175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-db1d7f20-1b8d-4469-a517-08e251ed9900 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:26.401798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db1d7f20-1b8d-4469-a517-08e251ed9900 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:26.404014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db1d7f20-1b8d-4469-a517-08e251ed9900 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:26.406890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db1d7f20-1b8d-4469-a517-08e251ed9900 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:26.412208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db1d7f20-1b8d-4469-a517-08e251ed9900 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:26.414188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db1d7f20-1b8d-4469-a517-08e251ed9900 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:26.417719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db1d7f20-1b8d-4469-a517-08e251ed9900 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:26.567214 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-db1d7f20-1b8d-4469-a517-08e251ed9900 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.237010 Aug 24 10:14:26.579514 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 475/892] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:14:26 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381/os-volume_attachments => generated 197 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:26.600039 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9050c643-c4f6-4d35-8f44-4c4f780c2813 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:26.605213 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9050c643-c4f6-4d35-8f44-4c4f780c2813 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:26.635679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9050c643-c4f6-4d35-8f44-4c4f780c2813 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:26.640693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9050c643-c4f6-4d35-8f44-4c4f780c2813 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:26.641974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9050c643-c4f6-4d35-8f44-4c4f780c2813 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:26.644666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-243865d1-191e-48ad-af1f-fd23239bfa63 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Building network info cache for instance {{(pid=122432) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 10:14:26.647822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9050c643-c4f6-4d35-8f44-4c4f780c2813 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:26.653932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9050c643-c4f6-4d35-8f44-4c4f780c2813 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:26.655056 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9050c643-c4f6-4d35-8f44-4c4f780c2813 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:28.424631 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9050c643-c4f6-4d35-8f44-4c4f780c2813 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:28.468611 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9050c643-c4f6-4d35-8f44-4c4f780c2813 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1474 microversion: 2.1 time: 1.886682 Aug 24 10:14:28.469733 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 476/893] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:26 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1474 bytes in 1889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:28.529719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-61059d02-339f-42a0-bbca-8c264e5ebda7 req-aa3358f7-c9dd-4155-b583-eb48758d403d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c285a5a5-ba66-41c8-aa67-402e2d5f9159", "tag": "ad70c32a-b650-4c05-bd90-a010a57fd42f"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:28.573560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-61059d02-339f-42a0-bbca-8c264e5ebda7 req-aa3358f7-c9dd-4155-b583-eb48758d403d service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:28.577079 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-61059d02-339f-42a0-bbca-8c264e5ebda7 req-aa3358f7-c9dd-4155-b583-eb48758d403d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:28.579128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-61059d02-339f-42a0-bbca-8c264e5ebda7 req-aa3358f7-c9dd-4155-b583-eb48758d403d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:28.642240 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-61059d02-339f-42a0-bbca-8c264e5ebda7 req-aa3358f7-c9dd-4155-b583-eb48758d403d service nova] Creating event network-changed:ad70c32a-b650-4c05-bd90-a010a57fd42f for instance c285a5a5-ba66-41c8-aa67-402e2d5f9159 on n-h1-849328-3 Aug 24 10:14:28.672939 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-61059d02-339f-42a0-bbca-8c264e5ebda7 req-aa3358f7-c9dd-4155-b583-eb48758d403d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175308 Aug 24 10:14:28.677422 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 477/894] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:28.722731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4bee8746-5885-4acb-8076-d21a3a7ebbaa tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:28.724097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4bee8746-5885-4acb-8076-d21a3a7ebbaa tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:28.780618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bee8746-5885-4acb-8076-d21a3a7ebbaa tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:28.785907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bee8746-5885-4acb-8076-d21a3a7ebbaa tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:28.786580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bee8746-5885-4acb-8076-d21a3a7ebbaa tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:28.787427 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bee8746-5885-4acb-8076-d21a3a7ebbaa tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:28.787988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bee8746-5885-4acb-8076-d21a3a7ebbaa tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:28.797234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bee8746-5885-4acb-8076-d21a3a7ebbaa tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:28.873528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-243865d1-191e-48ad-af1f-fd23239bfa63 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Updating instance_info_cache with network_info: [{"id": "ad70c32a-b650-4c05-bd90-a010a57fd42f", "address": "fa:16:3e:a8:d4:28", "network": {"id": "6a3a952d-cb92-48d6-ae25-c71db979b739", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1149866647-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "67b25f29b4a141f4b45518dba7332c3c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapad70c32a-b6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122432) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 10:14:28.932207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-243865d1-191e-48ad-af1f-fd23239bfa63 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Releasing lock "refresh_cache-c285a5a5-ba66-41c8-aa67-402e2d5f9159" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 10:14:28.933174 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-243865d1-191e-48ad-af1f-fd23239bfa63 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "POST /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159/action" status: 202 len: 0 microversion: 2.1 time: 7.483600 Aug 24 10:14:28.940827 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 418/895] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:14:21 2022] POST /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159/action => generated 0 bytes in 7491 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 24 10:14:28.952630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a6c254d3-f7be-4a31-95c8-c733a6bca37b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f46556739d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:29.149461 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a6c254d3-f7be-4a31-95c8-c733a6bca37b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b" status: 200 len: 1413 microversion: 2.1 time: 0.205727 Aug 24 10:14:29.153204 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 419/896] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:14:28 2022] GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b => generated 1413 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:29.174841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b60199b2-28c2-40b6-ae81-0db75644daf2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:29.188046 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b60199b2-28c2-40b6-ae81-0db75644daf2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:29.210711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=83 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:14:29.216212 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b60199b2-28c2-40b6-ae81-0db75644daf2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:29.219773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b60199b2-28c2-40b6-ae81-0db75644daf2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:29.221754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b60199b2-28c2-40b6-ae81-0db75644daf2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:29.224235 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b60199b2-28c2-40b6-ae81-0db75644daf2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:29.228414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b60199b2-28c2-40b6-ae81-0db75644daf2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:29.232688 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b60199b2-28c2-40b6-ae81-0db75644daf2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:29.377455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:14:29.489173 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b60199b2-28c2-40b6-ae81-0db75644daf2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.332926 Aug 24 10:14:29.489173 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 420/897] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:14:29 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381/os-volume_attachments => generated 197 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:29.521973 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9465b2de-ade7-40e6-82c3-ea85d70de5b2 req-93c225bc-fb4c-41dd-98fc-08b2d54d2bce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5", "name": "network-vif-plugged", "status": "completed", "tag": "d3ec17cd-2f80-4ee9-8623-b97653866a24"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:29.576021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9465b2de-ade7-40e6-82c3-ea85d70de5b2 req-93c225bc-fb4c-41dd-98fc-08b2d54d2bce service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:29.581569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9465b2de-ade7-40e6-82c3-ea85d70de5b2 req-93c225bc-fb4c-41dd-98fc-08b2d54d2bce service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:29.582324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9465b2de-ade7-40e6-82c3-ea85d70de5b2 req-93c225bc-fb4c-41dd-98fc-08b2d54d2bce service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:29.655747 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9465b2de-ade7-40e6-82c3-ea85d70de5b2 req-93c225bc-fb4c-41dd-98fc-08b2d54d2bce service nova] Creating event network-vif-plugged:d3ec17cd-2f80-4ee9-8623-b97653866a24 for instance 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 on n-h1-849328-3 Aug 24 10:14:29.691672 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9465b2de-ade7-40e6-82c3-ea85d70de5b2 req-93c225bc-fb4c-41dd-98fc-08b2d54d2bce service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197591 Aug 24 10:14:29.700389 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 421/898] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:29.700635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4bee8746-5885-4acb-8076-d21a3a7ebbaa tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:29.714561 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4bee8746-5885-4acb-8076-d21a3a7ebbaa tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5" status: 200 len: 1317 microversion: 2.1 time: 1.028645 Aug 24 10:14:29.721670 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 478/899] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:28 2022] GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 => generated 1317 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:29.736552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1c28f3ec-b9ec-43a5-a1bb-68cd39037a14 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:29.737810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1c28f3ec-b9ec-43a5-a1bb-68cd39037a14 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:29.739782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7ea6dc36-f07d-4744-8e44-969310c2c7fe tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.196"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:29.757495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7ea6dc36-f07d-4744-8e44-969310c2c7fe tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: 293f4b0e-a839-48f3-a510-4b4e320ebf59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:29.768964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c28f3ec-b9ec-43a5-a1bb-68cd39037a14 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:29.769510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c28f3ec-b9ec-43a5-a1bb-68cd39037a14 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:29.770211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c28f3ec-b9ec-43a5-a1bb-68cd39037a14 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:29.771340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c28f3ec-b9ec-43a5-a1bb-68cd39037a14 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:29.772283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c28f3ec-b9ec-43a5-a1bb-68cd39037a14 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:29.772887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c28f3ec-b9ec-43a5-a1bb-68cd39037a14 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:29.811749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ea6dc36-f07d-4744-8e44-969310c2c7fe tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:29.840685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ea6dc36-f07d-4744-8e44-969310c2c7fe tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:29.841921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ea6dc36-f07d-4744-8e44-969310c2c7fe tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:29.843610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ea6dc36-f07d-4744-8e44-969310c2c7fe tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:29.850659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ea6dc36-f07d-4744-8e44-969310c2c7fe tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:29.851497 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ea6dc36-f07d-4744-8e44-969310c2c7fe tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:29.951640 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ea6dc36-f07d-4744-8e44-969310c2c7fe tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "refresh_cache-293f4b0e-a839-48f3-a510-4b4e320ebf59" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 10:14:29.959969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ea6dc36-f07d-4744-8e44-969310c2c7fe tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquired lock "refresh_cache-293f4b0e-a839-48f3-a510-4b4e320ebf59" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 10:14:30.776781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1c28f3ec-b9ec-43a5-a1bb-68cd39037a14 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:30.810830 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1c28f3ec-b9ec-43a5-a1bb-68cd39037a14 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1474 microversion: 2.1 time: 1.087242 Aug 24 10:14:30.811732 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 479/900] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:29 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1474 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:30.859757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-08f3402a-a288-4d1f-bbfd-89666d1e5472 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f465528dee0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:30.978209 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-08f3402a-a288-4d1f-bbfd-89666d1e5472 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b" status: 200 len: 1413 microversion: 2.1 time: 0.150647 Aug 24 10:14:30.979124 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 480/901] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:14:30 2022] GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b => generated 1413 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:31.448036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a574a15a-ac04-4900-a8f6-75c84a108215 tempest-InstanceUsageAuditLogTestJSON-330999342 tempest-InstanceUsageAuditLogTestJSON-330999342-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:31.449741 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:14:31.449741 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:14:31.532136 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a574a15a-ac04-4900-a8f6-75c84a108215 tempest-InstanceUsageAuditLogTestJSON-330999342 tempest-InstanceUsageAuditLogTestJSON-330999342-project-admin] 10.222.0.85 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-24 10:14:30" status: 200 len: 318 microversion: 2.1 time: 0.544482 Aug 24 10:14:31.532881 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 481/902] 10.222.0.85 () {58 vars in 1251 bytes} [Wed Aug 24 10:14:30 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-24%2010%3A14%3A30 => generated 318 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:31.551195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9f785292-c3cd-47fd-97ab-542497acef24 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:31.555154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9f785292-c3cd-47fd-97ab-542497acef24 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:31.591776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f785292-c3cd-47fd-97ab-542497acef24 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:31.595055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f785292-c3cd-47fd-97ab-542497acef24 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:31.597967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f785292-c3cd-47fd-97ab-542497acef24 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:31.598787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f785292-c3cd-47fd-97ab-542497acef24 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:31.600255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f785292-c3cd-47fd-97ab-542497acef24 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:31.602010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f785292-c3cd-47fd-97ab-542497acef24 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:31.709527 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9f785292-c3cd-47fd-97ab-542497acef24 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.174845 Aug 24 10:14:31.710596 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 482/903] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:14:31 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381/os-volume_attachments => generated 25 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:14:31.758676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-644780b5-958c-4ac8-ac4f-318491d033c1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:31.759966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-644780b5-958c-4ac8-ac4f-318491d033c1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:31.798920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-644780b5-958c-4ac8-ac4f-318491d033c1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:31.802153 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-644780b5-958c-4ac8-ac4f-318491d033c1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:31.803298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-644780b5-958c-4ac8-ac4f-318491d033c1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:31.812303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-644780b5-958c-4ac8-ac4f-318491d033c1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:31.813652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-644780b5-958c-4ac8-ac4f-318491d033c1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:31.817714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-644780b5-958c-4ac8-ac4f-318491d033c1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:32.671838 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-644780b5-958c-4ac8-ac4f-318491d033c1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:32.696773 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-644780b5-958c-4ac8-ac4f-318491d033c1 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5" status: 200 len: 1317 microversion: 2.1 time: 0.958141 Aug 24 10:14:32.697867 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 483/904] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:31 2022] GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 => generated 1317 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:32.721526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ad1f995a-2691-4e21-ba01-b6a7cc151e9b tempest-InstanceUsageAuditLogTestJSON-330999342 tempest-InstanceUsageAuditLogTestJSON-330999342-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:32.723682 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:14:32.723682 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:14:32.806068 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ad1f995a-2691-4e21-ba01-b6a7cc151e9b tempest-InstanceUsageAuditLogTestJSON-330999342 tempest-InstanceUsageAuditLogTestJSON-330999342-project-admin] 10.222.0.85 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.099108 Aug 24 10:14:32.808723 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 484/905] 10.222.0.85 () {58 vars in 1185 bytes} [Wed Aug 24 10:14:32 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:32.831932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1c2530d1-c35a-45bc-a7bf-9e3901b88842 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:32.834334 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1c2530d1-c35a-45bc-a7bf-9e3901b88842 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:32.868004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c2530d1-c35a-45bc-a7bf-9e3901b88842 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:32.872924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c2530d1-c35a-45bc-a7bf-9e3901b88842 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:32.874324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c2530d1-c35a-45bc-a7bf-9e3901b88842 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:32.875876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c2530d1-c35a-45bc-a7bf-9e3901b88842 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:32.878024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c2530d1-c35a-45bc-a7bf-9e3901b88842 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:32.883877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c2530d1-c35a-45bc-a7bf-9e3901b88842 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:33.519935 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1c2530d1-c35a-45bc-a7bf-9e3901b88842 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:33.549810 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1c2530d1-c35a-45bc-a7bf-9e3901b88842 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1474 microversion: 2.1 time: 0.736491 Aug 24 10:14:33.562582 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 485/906] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:32 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1474 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:33.605158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b88e98eb-ed7a-4648-aec4-4a1062afac1c tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f465528a8b0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:33.762846 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b88e98eb-ed7a-4648-aec4-4a1062afac1c tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b" status: 200 len: 1413 microversion: 2.1 time: 0.197972 Aug 24 10:14:33.782401 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 486/907] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:14:33 2022] GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b => generated 1413 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:33.793081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fce4f83f-6134-4ad9-9906-86a772a67664 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-535646010", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "25651226-4d53-475d-a4a5-3dd5e1c5a329"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:33.919596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-fce4f83f-6134-4ad9-9906-86a772a67664 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] validate_networks() for [('25651226-4d53-475d-a4a5-3dd5e1c5a329', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:14:36.363932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-fce4f83f-6134-4ad9-9906-86a772a67664 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:14:36.364829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-fce4f83f-6134-4ad9-9906-86a772a67664 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:14:36.368852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-fce4f83f-6134-4ad9-9906-86a772a67664 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:14:36.370972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-fce4f83f-6134-4ad9-9906-86a772a67664 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:14:36.371417 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-fce4f83f-6134-4ad9-9906-86a772a67664 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:14:36.410268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fce4f83f-6134-4ad9-9906-86a772a67664 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:36.410782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fce4f83f-6134-4ad9-9906-86a772a67664 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:36.411229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fce4f83f-6134-4ad9-9906-86a772a67664 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:36.411994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fce4f83f-6134-4ad9-9906-86a772a67664 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:36.415348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fce4f83f-6134-4ad9-9906-86a772a67664 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:36.415923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fce4f83f-6134-4ad9-9906-86a772a67664 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:36.484703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-fce4f83f-6134-4ad9-9906-86a772a67664 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Getting quotas for project d6a57c8760d34630aa410aa3f7a96edd. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:14:36.507761 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-fce4f83f-6134-4ad9-9906-86a772a67664 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Getting quotas for user 360dc9ca253340f79dfb2c14f04c7445 and project d6a57c8760d34630aa410aa3f7a96edd. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:14:36.531544 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.network.neutron [None req-7ea6dc36-f07d-4744-8e44-969310c2c7fe tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: 293f4b0e-a839-48f3-a510-4b4e320ebf59] re-assign floating IP 172.25.0.196 from instance c285a5a5-ba66-41c8-aa67-402e2d5f9159 Aug 24 10:14:36.537235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fce4f83f-6134-4ad9-9906-86a772a67664 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:14:36.540343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fce4f83f-6134-4ad9-9906-86a772a67664 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: a626b1ea-4968-4e45-b2ab-4c11f06e6f85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:14:36.654381 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fce4f83f-6134-4ad9-9906-86a772a67664 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.869184 Aug 24 10:14:36.667877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-7ea6dc36-f07d-4744-8e44-969310c2c7fe tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Building network info cache for instance {{(pid=122432) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 10:14:36.673221 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 487/908] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:14:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:14:36.683366 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c326b700-d9c3-4fb0-9421-491da102debf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:36.688780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c326b700-d9c3-4fb0-9421-491da102debf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:36.701046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c326b700-d9c3-4fb0-9421-491da102debf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:36.702959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c326b700-d9c3-4fb0-9421-491da102debf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:36.703334 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c326b700-d9c3-4fb0-9421-491da102debf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:36.705145 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c326b700-d9c3-4fb0-9421-491da102debf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:36.705832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c326b700-d9c3-4fb0-9421-491da102debf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:36.706342 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c326b700-d9c3-4fb0-9421-491da102debf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:37.789486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c326b700-d9c3-4fb0-9421-491da102debf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:37.831645 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c326b700-d9c3-4fb0-9421-491da102debf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5" status: 200 len: 1467 microversion: 2.1 time: 1.152070 Aug 24 10:14:37.837359 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 488/909] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:36 2022] GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 => generated 1467 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:37.843800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9350086d-2ea7-4e4d-a2f4-029ceb3f60c3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:37.850501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9350086d-2ea7-4e4d-a2f4-029ceb3f60c3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:37.858722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9350086d-2ea7-4e4d-a2f4-029ceb3f60c3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:37.859923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9350086d-2ea7-4e4d-a2f4-029ceb3f60c3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:37.860665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9350086d-2ea7-4e4d-a2f4-029ceb3f60c3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:37.861703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9350086d-2ea7-4e4d-a2f4-029ceb3f60c3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:37.862524 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9350086d-2ea7-4e4d-a2f4-029ceb3f60c3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:37.863453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9350086d-2ea7-4e4d-a2f4-029ceb3f60c3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:38.324135 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9350086d-2ea7-4e4d-a2f4-029ceb3f60c3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:38.363804 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9350086d-2ea7-4e4d-a2f4-029ceb3f60c3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1474 microversion: 2.1 time: 0.524661 Aug 24 10:14:38.373669 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 489/910] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:37 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1474 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:38.412303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-be6aa409-7b72-40c1-b8cb-c4136db636cc tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f465516c040>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:38.554255 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-be6aa409-7b72-40c1-b8cb-c4136db636cc tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b" status: 200 len: 1413 microversion: 2.1 time: 0.174101 Aug 24 10:14:38.555255 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 490/911] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:14:38 2022] GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b => generated 1413 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:38.565990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-11eb6501-5f14-4f37-9993-2007e8a47e69 req-d9b9ff02-a6f3-40ef-99a9-6ebe30cc6fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c285a5a5-ba66-41c8-aa67-402e2d5f9159", "tag": "ad70c32a-b650-4c05-bd90-a010a57fd42f"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:38.599465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-11eb6501-5f14-4f37-9993-2007e8a47e69 req-d9b9ff02-a6f3-40ef-99a9-6ebe30cc6fa8 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:38.600063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-11eb6501-5f14-4f37-9993-2007e8a47e69 req-d9b9ff02-a6f3-40ef-99a9-6ebe30cc6fa8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:38.601641 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-11eb6501-5f14-4f37-9993-2007e8a47e69 req-d9b9ff02-a6f3-40ef-99a9-6ebe30cc6fa8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:38.626040 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-11eb6501-5f14-4f37-9993-2007e8a47e69 req-d9b9ff02-a6f3-40ef-99a9-6ebe30cc6fa8 service nova] Creating event network-changed:ad70c32a-b650-4c05-bd90-a010a57fd42f for instance c285a5a5-ba66-41c8-aa67-402e2d5f9159 on n-h1-849328-3 Aug 24 10:14:38.638936 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-11eb6501-5f14-4f37-9993-2007e8a47e69 req-d9b9ff02-a6f3-40ef-99a9-6ebe30cc6fa8 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082182 Aug 24 10:14:38.654452 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 491/912] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:38.660373 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-582cbbb4-823e-451b-987f-de042deec5f8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:38.666125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-582cbbb4-823e-451b-987f-de042deec5f8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: a626b1ea-4968-4e45-b2ab-4c11f06e6f85] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:38.700658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-582cbbb4-823e-451b-987f-de042deec5f8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:38.701762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-582cbbb4-823e-451b-987f-de042deec5f8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:38.702648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-582cbbb4-823e-451b-987f-de042deec5f8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:38.703813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-582cbbb4-823e-451b-987f-de042deec5f8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:38.704760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-582cbbb4-823e-451b-987f-de042deec5f8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:38.705943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-582cbbb4-823e-451b-987f-de042deec5f8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:38.942616 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-582cbbb4-823e-451b-987f-de042deec5f8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:38.955497 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-582cbbb4-823e-451b-987f-de042deec5f8 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85" status: 200 len: 1269 microversion: 2.1 time: 0.299221 Aug 24 10:14:38.958998 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 492/913] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:38 2022] GET /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85 => generated 1269 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:38.968437 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d30b8bc2-a901-46b0-8b2a-086b27b942cf tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:38.973705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d30b8bc2-a901-46b0-8b2a-086b27b942cf tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] [instance: 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:38.988956 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d30b8bc2-a901-46b0-8b2a-086b27b942cf tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:38.992270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d30b8bc2-a901-46b0-8b2a-086b27b942cf tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:38.994301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d30b8bc2-a901-46b0-8b2a-086b27b942cf tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:38.997358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d30b8bc2-a901-46b0-8b2a-086b27b942cf tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:38.998292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d30b8bc2-a901-46b0-8b2a-086b27b942cf tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:38.999158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d30b8bc2-a901-46b0-8b2a-086b27b942cf tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:39.311425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-7ea6dc36-f07d-4744-8e44-969310c2c7fe tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Updating instance_info_cache with network_info: [{"id": "ad70c32a-b650-4c05-bd90-a010a57fd42f", "address": "fa:16:3e:a8:d4:28", "network": {"id": "6a3a952d-cb92-48d6-ae25-c71db979b739", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1149866647-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "67b25f29b4a141f4b45518dba7332c3c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapad70c32a-b6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122432) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 10:14:39.341706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-7ea6dc36-f07d-4744-8e44-969310c2c7fe tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: 293f4b0e-a839-48f3-a510-4b4e320ebf59] Building network info cache for instance {{(pid=122432) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 10:14:39.811599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=5 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:14:40.123843 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d30b8bc2-a901-46b0-8b2a-086b27b942cf tempest-ServersOnMultiNodesTest-1299325644 tempest-ServersOnMultiNodesTest-1299325644-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5" status: 200 len: 1618 microversion: 2.1 time: 1.150628 Aug 24 10:14:40.126403 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 493/914] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:38 2022] GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 => generated 1618 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:40.184817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9db2fb0a-130e-4156-af8a-6344de8fd7e4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:40.185659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9db2fb0a-130e-4156-af8a-6344de8fd7e4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:40.236163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9db2fb0a-130e-4156-af8a-6344de8fd7e4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:40.237304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9db2fb0a-130e-4156-af8a-6344de8fd7e4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:40.238103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9db2fb0a-130e-4156-af8a-6344de8fd7e4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:40.241894 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9db2fb0a-130e-4156-af8a-6344de8fd7e4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:40.241894 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9db2fb0a-130e-4156-af8a-6344de8fd7e4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:40.259641 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9db2fb0a-130e-4156-af8a-6344de8fd7e4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:40.984487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9db2fb0a-130e-4156-af8a-6344de8fd7e4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:41.016106 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9db2fb0a-130e-4156-af8a-6344de8fd7e4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1474 microversion: 2.1 time: 0.849812 Aug 24 10:14:41.051259 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 494/915] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:40 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1474 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:41.056304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-af9714d2-21c1-4ade-bed6-6732c33cd9b6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f465504b430>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:41.200911 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-af9714d2-21c1-4ade-bed6-6732c33cd9b6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b" status: 200 len: 1413 microversion: 2.1 time: 0.153250 Aug 24 10:14:41.203537 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 495/916] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:14:41 2022] GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b => generated 1413 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:41.250482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f5249df4-26b8-41f3-996f-3377b9d282a6 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:41.252138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f5249df4-26b8-41f3-996f-3377b9d282a6 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: a626b1ea-4968-4e45-b2ab-4c11f06e6f85] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:41.293608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5249df4-26b8-41f3-996f-3377b9d282a6 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:41.296050 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5249df4-26b8-41f3-996f-3377b9d282a6 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:41.302198 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5249df4-26b8-41f3-996f-3377b9d282a6 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:41.309316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5249df4-26b8-41f3-996f-3377b9d282a6 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:41.313026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5249df4-26b8-41f3-996f-3377b9d282a6 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:41.316952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5249df4-26b8-41f3-996f-3377b9d282a6 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:41.693314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f5249df4-26b8-41f3-996f-3377b9d282a6 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:41.721615 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f5249df4-26b8-41f3-996f-3377b9d282a6 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85" status: 200 len: 1275 microversion: 2.1 time: 0.500244 Aug 24 10:14:41.723395 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 496/917] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:41 2022] GET /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85 => generated 1275 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:41.739366 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-76699734-5314-469e-a10e-58b20134080d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:41.740207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-76699734-5314-469e-a10e-58b20134080d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:41.761923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76699734-5314-469e-a10e-58b20134080d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:41.762963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76699734-5314-469e-a10e-58b20134080d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:41.763647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76699734-5314-469e-a10e-58b20134080d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:41.774607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76699734-5314-469e-a10e-58b20134080d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:41.775504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76699734-5314-469e-a10e-58b20134080d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:41.776291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76699734-5314-469e-a10e-58b20134080d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:41.835940 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:14:41.868377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-76699734-5314-469e-a10e-58b20134080d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:14:42.186051 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-76699734-5314-469e-a10e-58b20134080d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "DELETE /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5" status: 204 len: 0 microversion: 2.1 time: 0.457483 Aug 24 10:14:42.192009 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 497/918] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:14:41 2022] DELETE /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:14:42.208035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a4dc61b5-bd31-4b5e-9db1-dcd48d3677fa req-33977d7b-da11-4b94-a1ec-2c9c0fb72f71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "293f4b0e-a839-48f3-a510-4b4e320ebf59", "tag": "f62c5a20-b4b1-4fec-8849-6937f20905b9"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:42.243278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-7ea6dc36-f07d-4744-8e44-969310c2c7fe tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: 293f4b0e-a839-48f3-a510-4b4e320ebf59] Updating instance_info_cache with network_info: [{"id": "f62c5a20-b4b1-4fec-8849-6937f20905b9", "address": "fa:16:3e:5a:d5:97", "network": {"id": "6a3a952d-cb92-48d6-ae25-c71db979b739", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1149866647-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "67b25f29b4a141f4b45518dba7332c3c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf62c5a20-b4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122432) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 10:14:42.257743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a4dc61b5-bd31-4b5e-9db1-dcd48d3677fa req-33977d7b-da11-4b94-a1ec-2c9c0fb72f71 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:42.258560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a4dc61b5-bd31-4b5e-9db1-dcd48d3677fa req-33977d7b-da11-4b94-a1ec-2c9c0fb72f71 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:42.259273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a4dc61b5-bd31-4b5e-9db1-dcd48d3677fa req-33977d7b-da11-4b94-a1ec-2c9c0fb72f71 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:42.289959 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ea6dc36-f07d-4744-8e44-969310c2c7fe tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Releasing lock "refresh_cache-293f4b0e-a839-48f3-a510-4b4e320ebf59" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 10:14:42.290314 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a4dc61b5-bd31-4b5e-9db1-dcd48d3677fa req-33977d7b-da11-4b94-a1ec-2c9c0fb72f71 service nova] Creating event network-changed:f62c5a20-b4b1-4fec-8849-6937f20905b9 for instance 293f4b0e-a839-48f3-a510-4b4e320ebf59 on n-h2-849328-3 Aug 24 10:14:42.298159 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7ea6dc36-f07d-4744-8e44-969310c2c7fe tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "POST /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59/action" status: 202 len: 0 microversion: 2.1 time: 12.586995 Aug 24 10:14:42.306394 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 422/919] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:14:29 2022] POST /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59/action => generated 0 bytes in 12605 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 24 10:14:42.309728 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a4dc61b5-bd31-4b5e-9db1-dcd48d3677fa req-33977d7b-da11-4b94-a1ec-2c9c0fb72f71 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115443 Aug 24 10:14:42.317673 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 498/920] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:42.333018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-15f0c020-05e5-4bec-8854-8ac519a79d7e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:42.337428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-15f0c020-05e5-4bec-8854-8ac519a79d7e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:42.338442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-171b74dd-2de1-4d30-87da-1b874743c936 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:42.339228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-171b74dd-2de1-4d30-87da-1b874743c936 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:42.369210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15f0c020-05e5-4bec-8854-8ac519a79d7e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:42.370304 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15f0c020-05e5-4bec-8854-8ac519a79d7e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:42.371034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15f0c020-05e5-4bec-8854-8ac519a79d7e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:42.373996 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15f0c020-05e5-4bec-8854-8ac519a79d7e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:42.376600 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15f0c020-05e5-4bec-8854-8ac519a79d7e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:42.378886 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15f0c020-05e5-4bec-8854-8ac519a79d7e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:42.384565 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-171b74dd-2de1-4d30-87da-1b874743c936 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:42.386950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-171b74dd-2de1-4d30-87da-1b874743c936 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:42.388036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-171b74dd-2de1-4d30-87da-1b874743c936 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:42.390486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-171b74dd-2de1-4d30-87da-1b874743c936 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:42.390996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-171b74dd-2de1-4d30-87da-1b874743c936 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:42.391427 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-171b74dd-2de1-4d30-87da-1b874743c936 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:43.224383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-171b74dd-2de1-4d30-87da-1b874743c936 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:43.256540 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-171b74dd-2de1-4d30-87da-1b874743c936 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5" status: 200 len: 1473 microversion: 2.1 time: 0.937342 Aug 24 10:14:43.258154 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 499/921] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:42 2022] GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 => generated 1473 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:43.278853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ccee1baf-2852-45f5-a611-5412ae1a9fad tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f46551c6160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:43.405846 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ccee1baf-2852-45f5-a611-5412ae1a9fad tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b" status: 200 len: 1413 microversion: 2.1 time: 0.137608 Aug 24 10:14:43.407023 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 500/922] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:14:43 2022] GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b => generated 1413 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:43.424589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ae44e14e-ac90-471a-a10e-ea1764c412dd tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Action: 'action', calling method: .version_select at 0x7f4657d77c10>, body: {"removeFloatingIp": {"address": "172.25.0.196"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:43.548915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-15f0c020-05e5-4bec-8854-8ac519a79d7e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:43.583374 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-15f0c020-05e5-4bec-8854-8ac519a79d7e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1474 microversion: 2.1 time: 1.275096 Aug 24 10:14:43.590699 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 423/923] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:42 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1474 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:43.613678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6ec01c36-732d-46cb-baa7-8d1d64be39c2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:43.614646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6ec01c36-732d-46cb-baa7-8d1d64be39c2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: a626b1ea-4968-4e45-b2ab-4c11f06e6f85] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:43.632177 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ec01c36-732d-46cb-baa7-8d1d64be39c2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:43.634989 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ec01c36-732d-46cb-baa7-8d1d64be39c2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:43.638038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ec01c36-732d-46cb-baa7-8d1d64be39c2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:43.640686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ec01c36-732d-46cb-baa7-8d1d64be39c2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:43.648493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ec01c36-732d-46cb-baa7-8d1d64be39c2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:43.649582 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ec01c36-732d-46cb-baa7-8d1d64be39c2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:44.948456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6ec01c36-732d-46cb-baa7-8d1d64be39c2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:44.963414 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6ec01c36-732d-46cb-baa7-8d1d64be39c2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85" status: 200 len: 1317 microversion: 2.1 time: 1.367586 Aug 24 10:14:44.974251 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 424/924] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:43 2022] GET /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85 => generated 1317 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:44.991450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6da59d59-da6d-43a9-bb60-511b341ea698 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:45.003901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6da59d59-da6d-43a9-bb60-511b341ea698 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:45.026204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6da59d59-da6d-43a9-bb60-511b341ea698 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:45.033799 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6da59d59-da6d-43a9-bb60-511b341ea698 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:45.034986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6da59d59-da6d-43a9-bb60-511b341ea698 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:45.036736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6da59d59-da6d-43a9-bb60-511b341ea698 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:45.038286 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6da59d59-da6d-43a9-bb60-511b341ea698 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:45.039214 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6da59d59-da6d-43a9-bb60-511b341ea698 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:45.702337 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ae44e14e-ac90-471a-a10e-ea1764c412dd tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: 293f4b0e-a839-48f3-a510-4b4e320ebf59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:45.721852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae44e14e-ac90-471a-a10e-ea1764c412dd tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:45.722379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae44e14e-ac90-471a-a10e-ea1764c412dd tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:45.728055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae44e14e-ac90-471a-a10e-ea1764c412dd tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:45.728903 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae44e14e-ac90-471a-a10e-ea1764c412dd tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:45.729426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae44e14e-ac90-471a-a10e-ea1764c412dd tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:45.729883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae44e14e-ac90-471a-a10e-ea1764c412dd tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:45.756275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6da59d59-da6d-43a9-bb60-511b341ea698 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:45.769537 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6da59d59-da6d-43a9-bb60-511b341ea698 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5" status: 200 len: 1473 microversion: 2.1 time: 0.793234 Aug 24 10:14:45.770161 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 425/925] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:44 2022] GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 => generated 1473 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:45.784503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-064d78ba-7937-4534-a2a5-1910f0ab137a tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f465644e0d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:45.898907 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-064d78ba-7937-4534-a2a5-1910f0ab137a tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b" status: 200 len: 1413 microversion: 2.1 time: 0.127577 Aug 24 10:14:45.901224 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 426/926] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:14:45 2022] GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b => generated 1413 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:45.913030 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6da70ecb-41d6-4888-aff4-448e9124614c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:45.915235 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6da70ecb-41d6-4888-aff4-448e9124614c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:45.932074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6da70ecb-41d6-4888-aff4-448e9124614c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:45.935442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6da70ecb-41d6-4888-aff4-448e9124614c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:45.936821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6da70ecb-41d6-4888-aff4-448e9124614c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:45.938398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6da70ecb-41d6-4888-aff4-448e9124614c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:45.939305 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6da70ecb-41d6-4888-aff4-448e9124614c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:45.939996 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6da70ecb-41d6-4888-aff4-448e9124614c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:46.454614 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:14:46.525677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=14 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:14:47.574914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6da70ecb-41d6-4888-aff4-448e9124614c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:47.587297 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6da70ecb-41d6-4888-aff4-448e9124614c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1474 microversion: 2.1 time: 1.684691 Aug 24 10:14:47.590597 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 427/927] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:45 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1474 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:47.616974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-22125c30-b67e-434d-b5f5-9fcccc82529c tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:47.617663 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-22125c30-b67e-434d-b5f5-9fcccc82529c tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:47.625057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22125c30-b67e-434d-b5f5-9fcccc82529c tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:47.625647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22125c30-b67e-434d-b5f5-9fcccc82529c tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:47.626146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22125c30-b67e-434d-b5f5-9fcccc82529c tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:47.627464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22125c30-b67e-434d-b5f5-9fcccc82529c tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:47.627995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22125c30-b67e-434d-b5f5-9fcccc82529c tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:47.628419 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22125c30-b67e-434d-b5f5-9fcccc82529c tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:47.791739 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-ae44e14e-ac90-471a-a10e-ea1764c412dd tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] HTTP exception thrown: Floating IP 172.25.0.196 is not associated with instance c285a5a5-ba66-41c8-aa67-402e2d5f9159. Aug 24 10:14:47.795444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ae44e14e-ac90-471a-a10e-ea1764c412dd tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Request method failure captured: Aug 24 10:14:47.795444 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159/action HTTP/1.1 Aug 24 10:14:47.795444 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:14:47.795444 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:14:47.795444 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:14:47.795444 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 49 Aug 24 10:14:47.795444 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:14:47.795444 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:14:47.795444 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:14:47.795444 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:14:47.795444 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfm5kJ5FWnTs7P0zxeBGgL-wu3qC0mwWDuhEjFAghmyC5iKxoD4sp6B2oYcYmhNFNK7poQ5uBIlMPzvMjZLBDszbLIdfBFyKswV2Ahy49qc_Y5M2676Q6uAHbqMfpdtrG9t2VO18rXqqhwoQW-fSPlMv586r9CHLGHUZ80QFfmOHhBo Aug 24 10:14:47.795444 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:14:47.795444 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:14:47.795444 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:14:47.795444 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:14:47.795444 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:14:47.795444 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:14:47.795444 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 67b25f29b4a141f4b45518dba7332c3c Aug 24 10:14:47.795444 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-224357164 Aug 24 10:14:47.795444 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:14:47.795444 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:14:47.797010 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/67b25f29b4a141f4b45518dba7332c3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_67b25f29b4a141f4b45518dba7332c3c", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/67b25f29b4a141f4b45518dba7332c3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/67b25f29b4a141f4b45518dba7332c3c"}]}] Aug 24 10:14:47.797010 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-224357164 Aug 24 10:14:47.797010 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 67b25f29b4a141f4b45518dba7332c3c Aug 24 10:14:47.797010 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-224357164 Aug 24 10:14:47.797010 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-FloatingIPsAssociationTestJSON-224357164-project Aug 24 10:14:47.797010 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:14:47.797010 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:14:47.797010 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: c969980c07dd44b49d7ef299858fe109 Aug 24 10:14:47.797010 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-224357164-project Aug 24 10:14:47.797010 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:14:47.797010 n-d-849328-3 devstack@n-api.service[122433]: {"removeFloatingIp": {"address": "172.25.0.196"}} Aug 24 10:14:47.797010 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:14:47.797010 n-d-849328-3 devstack@n-api.service[122433]: exception: Floating IP 172.25.0.196 is not associated with instance c285a5a5-ba66-41c8-aa67-402e2d5f9159. Aug 24 10:14:47.797942 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'c285a5a5-ba66-41c8-aa67-402e2d5f9159', 'body': {'removeFloatingIp': {'address': '172.25.0.196'}}} Aug 24 10:14:47.797942 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:14:47.797942 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:14:47.797942 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:14:47.797942 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:14:47.797942 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:14:47.797942 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:14:47.797942 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:14:47.797942 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:14:47.797942 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:14:47.797942 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:14:47.797942 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:14:47.797942 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:14:47.797942 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 24 10:14:47.797942 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 10:14:47.797942 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.0.196 is not associated with instance c285a5a5-ba66-41c8-aa67-402e2d5f9159. Aug 24 10:14:47.797942 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:14:47.797942 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:14:47.797942 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:14:47.797942 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:14:47.799349 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:14:47.799349 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:14:47.799349 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:14:47.799349 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:14:47.799349 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.0.196 is not associated with instance c285a5a5-ba66-41c8-aa67-402e2d5f9159. Aug 24 10:14:47.799349 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:14:47.799349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ae44e14e-ac90-471a-a10e-ea1764c412dd tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Returning 409 to user: Floating IP 172.25.0.196 is not associated with instance c285a5a5-ba66-41c8-aa67-402e2d5f9159. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:14:47.799349 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ae44e14e-ac90-471a-a10e-ea1764c412dd tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "POST /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159/action" status: 409 len: 146 microversion: 2.1 time: 4.388645 Aug 24 10:14:47.800472 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 501/928] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:14:43 2022] POST /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159/action => generated 146 bytes in 4392 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:14:47.822713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c8039c30-4b5f-4d9d-b596-48e6cc3f3cb7 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:47.823342 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c8039c30-4b5f-4d9d-b596-48e6cc3f3cb7 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: a626b1ea-4968-4e45-b2ab-4c11f06e6f85] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:47.831726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8039c30-4b5f-4d9d-b596-48e6cc3f3cb7 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:47.832224 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8039c30-4b5f-4d9d-b596-48e6cc3f3cb7 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:47.832735 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8039c30-4b5f-4d9d-b596-48e6cc3f3cb7 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:47.834651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8039c30-4b5f-4d9d-b596-48e6cc3f3cb7 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:47.835138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8039c30-4b5f-4d9d-b596-48e6cc3f3cb7 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:47.835558 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8039c30-4b5f-4d9d-b596-48e6cc3f3cb7 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:48.032927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-22125c30-b67e-434d-b5f5-9fcccc82529c tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lazy-loading 'services' on Instance uuid 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:14:48.079526 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-22125c30-b67e-434d-b5f5-9fcccc82529c tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 2343 microversion: 2.25 time: 0.471837 Aug 24 10:14:48.080824 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 428/929] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:14:47 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 2343 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:14:48.092462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-6b4cc682-2807-4b4f-9be9-64c60bd9a698 req-326dff8f-c8a6-4fe0-8174-794aee959ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a626b1ea-4968-4e45-b2ab-4c11f06e6f85", "tag": "993acca0-372e-44eb-95b8-b63a381f8921"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:48.120379 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6b4cc682-2807-4b4f-9be9-64c60bd9a698 req-326dff8f-c8a6-4fe0-8174-794aee959ed5 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:48.120769 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6b4cc682-2807-4b4f-9be9-64c60bd9a698 req-326dff8f-c8a6-4fe0-8174-794aee959ed5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:48.121288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6b4cc682-2807-4b4f-9be9-64c60bd9a698 req-326dff8f-c8a6-4fe0-8174-794aee959ed5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:48.136811 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-6b4cc682-2807-4b4f-9be9-64c60bd9a698 req-326dff8f-c8a6-4fe0-8174-794aee959ed5 service nova] Creating event network-changed:993acca0-372e-44eb-95b8-b63a381f8921 for instance a626b1ea-4968-4e45-b2ab-4c11f06e6f85 on n-h2-849328-3 Aug 24 10:14:48.143091 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-6b4cc682-2807-4b4f-9be9-64c60bd9a698 req-326dff8f-c8a6-4fe0-8174-794aee959ed5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061227 Aug 24 10:14:48.144056 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 429/930] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:48.150037 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-641626f1-6aa5-4043-a3f4-4239132654e7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:48.150820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-641626f1-6aa5-4043-a3f4-4239132654e7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:48.158314 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-641626f1-6aa5-4043-a3f4-4239132654e7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:48.158936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-641626f1-6aa5-4043-a3f4-4239132654e7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:48.159399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-641626f1-6aa5-4043-a3f4-4239132654e7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:48.160138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-641626f1-6aa5-4043-a3f4-4239132654e7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:48.160591 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-641626f1-6aa5-4043-a3f4-4239132654e7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:48.161013 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-641626f1-6aa5-4043-a3f4-4239132654e7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:48.285835 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c8039c30-4b5f-4d9d-b596-48e6cc3f3cb7 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:48.307358 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c8039c30-4b5f-4d9d-b596-48e6cc3f3cb7 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85" status: 200 len: 1317 microversion: 2.1 time: 0.505427 Aug 24 10:14:48.307971 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 502/931] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:47 2022] GET /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85 => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:48.344156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6ee9d280-f2d1-4c8a-9e07-4e06d9bcea03 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4655092d30>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:48.444985 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6ee9d280-f2d1-4c8a-9e07-4e06d9bcea03 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b" status: 200 len: 1422 microversion: 2.1 time: 0.135797 Aug 24 10:14:48.457000 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 503/932] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:14:48 2022] GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b => generated 1422 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:48.465722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-5dab6900-e0dc-4d68-a7f8-c60987a64329 req-e89bc01a-57f1-4573-9434-a6f767a36a80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5", "name": "network-vif-unplugged", "status": "completed", "tag": "d3ec17cd-2f80-4ee9-8623-b97653866a24"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:48.483509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5dab6900-e0dc-4d68-a7f8-c60987a64329 req-e89bc01a-57f1-4573-9434-a6f767a36a80 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:48.484251 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5dab6900-e0dc-4d68-a7f8-c60987a64329 req-e89bc01a-57f1-4573-9434-a6f767a36a80 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:48.484816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5dab6900-e0dc-4d68-a7f8-c60987a64329 req-e89bc01a-57f1-4573-9434-a6f767a36a80 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:48.502176 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-5dab6900-e0dc-4d68-a7f8-c60987a64329 req-e89bc01a-57f1-4573-9434-a6f767a36a80 service nova] Creating event network-vif-unplugged:d3ec17cd-2f80-4ee9-8623-b97653866a24 for instance 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 on n-h1-849328-3 Aug 24 10:14:48.511221 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-5dab6900-e0dc-4d68-a7f8-c60987a64329 req-e89bc01a-57f1-4573-9434-a6f767a36a80 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051679 Aug 24 10:14:48.517040 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 504/933] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:48.519216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-641626f1-6aa5-4043-a3f4-4239132654e7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:48.526181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a34b0b4b-82f3-4261-bdee-d4a8da16d9f4 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.0.196"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:48.543375 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-641626f1-6aa5-4043-a3f4-4239132654e7 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5" status: 200 len: 1473 microversion: 2.1 time: 0.394392 Aug 24 10:14:48.557987 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 430/934] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:48 2022] GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 => generated 1473 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:48.571231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3e621a08-6a9c-4a6e-8e98-df414c10d0dd tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:48.575652 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:14:48.575652 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:14:48.577575 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e621a08-6a9c-4a6e-8e98-df414c10d0dd tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:48.580271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e621a08-6a9c-4a6e-8e98-df414c10d0dd tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:48.585264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e621a08-6a9c-4a6e-8e98-df414c10d0dd tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:48.587990 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e621a08-6a9c-4a6e-8e98-df414c10d0dd tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:48.589383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e621a08-6a9c-4a6e-8e98-df414c10d0dd tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:48.589837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e621a08-6a9c-4a6e-8e98-df414c10d0dd tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:48.637639 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3e621a08-6a9c-4a6e-8e98-df414c10d0dd tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] 10.222.0.85 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.077719 Aug 24 10:14:48.638303 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 431/935] 10.222.0.85 () {60 vars in 1217 bytes} [Wed Aug 24 10:14:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:14:48.643608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e6dbe9e7-c8bb-4e16-a51a-c3cf040f564a tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f465515f550>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:48.752064 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e6dbe9e7-c8bb-4e16-a51a-c3cf040f564a tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b" status: 200 len: 1422 microversion: 2.1 time: 0.111279 Aug 24 10:14:48.763216 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 432/936] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:14:48 2022] GET /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b => generated 1422 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:48.783311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-321f040c-1033-4f7f-b4cc-6f8b111b44a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:48.784480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-321f040c-1033-4f7f-b4cc-6f8b111b44a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:48.804182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-321f040c-1033-4f7f-b4cc-6f8b111b44a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:48.806083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-321f040c-1033-4f7f-b4cc-6f8b111b44a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:48.808802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-321f040c-1033-4f7f-b4cc-6f8b111b44a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:48.810962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-321f040c-1033-4f7f-b4cc-6f8b111b44a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:48.811948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-321f040c-1033-4f7f-b4cc-6f8b111b44a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:48.812701 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-321f040c-1033-4f7f-b4cc-6f8b111b44a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:49.237605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a34b0b4b-82f3-4261-bdee-d4a8da16d9f4 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: 293f4b0e-a839-48f3-a510-4b4e320ebf59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:49.245832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:14:49.250749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a34b0b4b-82f3-4261-bdee-d4a8da16d9f4 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:49.252717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a34b0b4b-82f3-4261-bdee-d4a8da16d9f4 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:49.256039 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a34b0b4b-82f3-4261-bdee-d4a8da16d9f4 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:49.257062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a34b0b4b-82f3-4261-bdee-d4a8da16d9f4 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:49.257754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a34b0b4b-82f3-4261-bdee-d4a8da16d9f4 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:49.260009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a34b0b4b-82f3-4261-bdee-d4a8da16d9f4 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:49.411923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-321f040c-1033-4f7f-b4cc-6f8b111b44a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:49.441080 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-321f040c-1033-4f7f-b4cc-6f8b111b44a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1474 microversion: 2.1 time: 0.675744 Aug 24 10:14:49.464288 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 433/937] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:48 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1474 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:49.474768 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8e92d8c3-645a-4533-a7cb-ec792354c850 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f46555d48b0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:50.802475 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8e92d8c3-645a-4533-a7cb-ec792354c850 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "DELETE /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b" status: 204 len: 0 microversion: 2.1 time: 1.349340 Aug 24 10:14:50.806607 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 434/938] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:49 2022] DELETE /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b => generated 0 bytes in 1354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:14:50.812779 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-8845a5c7-797b-4ade-b0f8-56fda7132ee8 req-92241bbc-a970-4ac7-94e5-eae29c463e3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5", "name": "network-vif-deleted", "tag": "d3ec17cd-2f80-4ee9-8623-b97653866a24"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:50.835763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8845a5c7-797b-4ade-b0f8-56fda7132ee8 req-92241bbc-a970-4ac7-94e5-eae29c463e3c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:50.836513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8845a5c7-797b-4ade-b0f8-56fda7132ee8 req-92241bbc-a970-4ac7-94e5-eae29c463e3c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:50.837182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8845a5c7-797b-4ade-b0f8-56fda7132ee8 req-92241bbc-a970-4ac7-94e5-eae29c463e3c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:50.859967 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-8845a5c7-797b-4ade-b0f8-56fda7132ee8 req-92241bbc-a970-4ac7-94e5-eae29c463e3c service nova] Creating event network-vif-deleted:d3ec17cd-2f80-4ee9-8623-b97653866a24 for instance 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 on n-h1-849328-3 Aug 24 10:14:50.867014 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-8845a5c7-797b-4ade-b0f8-56fda7132ee8 req-92241bbc-a970-4ac7-94e5-eae29c463e3c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058347 Aug 24 10:14:50.868346 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 435/939] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:50.884628 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4d2d4266-4e84-469b-9f5a-a5e0eb3e2a9c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:50.886348 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4d2d4266-4e84-469b-9f5a-a5e0eb3e2a9c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: a626b1ea-4968-4e45-b2ab-4c11f06e6f85] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:50.901631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4d2d4266-4e84-469b-9f5a-a5e0eb3e2a9c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:50.903088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4d2d4266-4e84-469b-9f5a-a5e0eb3e2a9c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:50.905253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4d2d4266-4e84-469b-9f5a-a5e0eb3e2a9c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:50.907642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4d2d4266-4e84-469b-9f5a-a5e0eb3e2a9c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:50.908833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4d2d4266-4e84-469b-9f5a-a5e0eb3e2a9c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:50.910767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4d2d4266-4e84-469b-9f5a-a5e0eb3e2a9c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:51.076656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a34b0b4b-82f3-4261-bdee-d4a8da16d9f4 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "refresh_cache-293f4b0e-a839-48f3-a510-4b4e320ebf59" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 10:14:51.078106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a34b0b4b-82f3-4261-bdee-d4a8da16d9f4 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquired lock "refresh_cache-293f4b0e-a839-48f3-a510-4b4e320ebf59" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 10:14:51.442581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4d2d4266-4e84-469b-9f5a-a5e0eb3e2a9c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:51.467386 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4d2d4266-4e84-469b-9f5a-a5e0eb3e2a9c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85" status: 200 len: 1317 microversion: 2.1 time: 0.597138 Aug 24 10:14:51.470372 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 436/940] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:50 2022] GET /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85 => generated 1317 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:51.480216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d40eb93a-fa5b-4388-9ebb-724b7a440338 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:51.481229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d40eb93a-fa5b-4388-9ebb-724b7a440338 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:51.494592 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d40eb93a-fa5b-4388-9ebb-724b7a440338 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:51.495511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d40eb93a-fa5b-4388-9ebb-724b7a440338 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:51.497070 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d40eb93a-fa5b-4388-9ebb-724b7a440338 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:51.498877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d40eb93a-fa5b-4388-9ebb-724b7a440338 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:51.499745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d40eb93a-fa5b-4388-9ebb-724b7a440338 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:51.500428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d40eb93a-fa5b-4388-9ebb-724b7a440338 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:51.524857 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-d40eb93a-fa5b-4388-9ebb-724b7a440338 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] HTTP exception thrown: Instance 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 could not be found. Aug 24 10:14:51.530828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d40eb93a-fa5b-4388-9ebb-724b7a440338 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Request method failure captured: Aug 24 10:14:51.530828 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 HTTP/1.1 Aug 24 10:14:51.530828 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:14:51.530828 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:14:51.530828 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:14:51.530828 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:14:51.530828 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:14:51.530828 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:14:51.530828 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:14:51.530828 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:14:51.530828 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBflp1lR6NJiOvJ0jo0u_ObCwr-XT9ZPDd8UFdAdrktIeq9W3st8_Vr__ObGPpyUD3B1sX780QVeUxsP7WLsIfoEmJ6ZRyy4XuEoKUiYvCKqPo1TBHvl0EjfZLY21G0cKkNvRwmjK2bcnCfVvvo4RO0l6RUsKYrhQXpLAAKVAYjdEZcw Aug 24 10:14:51.530828 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:14:51.530828 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:14:51.530828 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:14:51.530828 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:14:51.530828 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:14:51.530828 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:14:51.530828 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: f2e2ee3e278042a5bf8ee7348966a468 Aug 24 10:14:51.530828 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersOnMultiNodesTest-1510468885 Aug 24 10:14:51.530828 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:14:51.530828 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:14:51.532676 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f2e2ee3e278042a5bf8ee7348966a468"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f2e2ee3e278042a5bf8ee7348966a468", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f2e2ee3e278042a5bf8ee7348966a468"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f2e2ee3e278042a5bf8ee7348966a468"}]}] Aug 24 10:14:51.532676 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersOnMultiNodesTest-1510468885 Aug 24 10:14:51.532676 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: f2e2ee3e278042a5bf8ee7348966a468 Aug 24 10:14:51.532676 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1510468885 Aug 24 10:14:51.532676 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersOnMultiNodesTest-1510468885-project Aug 24 10:14:51.532676 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:14:51.532676 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:14:51.532676 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: bf03c0eb5bd748ae85be830f1121dc06 Aug 24 10:14:51.532676 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersOnMultiNodesTest-1510468885-project Aug 24 10:14:51.532676 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:14:51.532676 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 could not be found. Aug 24 10:14:51.532676 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5'} Aug 24 10:14:51.533819 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:14:51.533819 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:14:51.533819 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:14:51.533819 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:14:51.533819 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:14:51.533819 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:14:51.533819 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:14:51.533819 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:14:51.533819 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:14:51.533819 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:14:51.533819 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 could not be found. Aug 24 10:14:51.533819 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:14:51.533819 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:14:51.533819 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:14:51.533819 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:14:51.533819 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:14:51.533819 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:14:51.533819 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:14:51.533819 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:14:51.533819 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:14:51.535236 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:14:51.535236 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:14:51.535236 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:14:51.535236 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:14:51.535236 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:14:51.535236 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:14:51.535236 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:14:51.535236 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 could not be found. Aug 24 10:14:51.535236 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:14:51.535236 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:14:51.535236 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:14:51.535236 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:14:51.535236 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:14:51.535236 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:14:51.535236 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:14:51.535236 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:14:51.535236 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 could not be found. Aug 24 10:14:51.535236 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:14:51.536504 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d40eb93a-fa5b-4388-9ebb-724b7a440338 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Returning 404 to user: Instance 7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:14:51.536504 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d40eb93a-fa5b-4388-9ebb-724b7a440338 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5" status: 404 len: 111 microversion: 2.1 time: 0.061085 Aug 24 10:14:51.537182 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 437/941] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:51 2022] GET /compute/v2.1/servers/7d9bf6ab-a91f-4b83-b6ba-28181f1dc0a5 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:14:51.545850 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-738149d5-bc1c-48fd-95fb-334f2d7ebf0e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:51.546747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-738149d5-bc1c-48fd-95fb-334f2d7ebf0e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:51.555976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-738149d5-bc1c-48fd-95fb-334f2d7ebf0e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:51.556750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-738149d5-bc1c-48fd-95fb-334f2d7ebf0e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:51.557479 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-738149d5-bc1c-48fd-95fb-334f2d7ebf0e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:51.558371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-738149d5-bc1c-48fd-95fb-334f2d7ebf0e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:51.559761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-738149d5-bc1c-48fd-95fb-334f2d7ebf0e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:51.561461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-738149d5-bc1c-48fd-95fb-334f2d7ebf0e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:52.096981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-738149d5-bc1c-48fd-95fb-334f2d7ebf0e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:52.118548 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-738149d5-bc1c-48fd-95fb-334f2d7ebf0e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1474 microversion: 2.1 time: 0.579686 Aug 24 10:14:52.119363 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 438/942] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:51 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1474 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:52.132390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c4c8c4ac-f06d-4564-bae9-e1d67223ecdd tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:52.133623 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c4c8c4ac-f06d-4564-bae9-e1d67223ecdd tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:52.150306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4c8c4ac-f06d-4564-bae9-e1d67223ecdd tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:52.151579 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4c8c4ac-f06d-4564-bae9-e1d67223ecdd tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:52.152684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4c8c4ac-f06d-4564-bae9-e1d67223ecdd tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:52.153970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4c8c4ac-f06d-4564-bae9-e1d67223ecdd tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:52.161449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4c8c4ac-f06d-4564-bae9-e1d67223ecdd tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:52.162309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4c8c4ac-f06d-4564-bae9-e1d67223ecdd tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:52.219571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c4c8c4ac-f06d-4564-bae9-e1d67223ecdd tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:14:52.321803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:14:52.435894 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c4c8c4ac-f06d-4564-bae9-e1d67223ecdd tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "DELETE /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab" status: 204 len: 0 microversion: 2.1 time: 0.314261 Aug 24 10:14:52.445901 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 439/943] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:14:52 2022] DELETE /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:14:52.454773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-65663fd7-e343-4da1-bc20-32eb973f3c9a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:52.458494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-65663fd7-e343-4da1-bc20-32eb973f3c9a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 1b80677b-614d-41a1-be0a-31bf5b46c485] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:52.517945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65663fd7-e343-4da1-bc20-32eb973f3c9a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:52.519475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65663fd7-e343-4da1-bc20-32eb973f3c9a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:52.520650 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65663fd7-e343-4da1-bc20-32eb973f3c9a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:52.522402 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65663fd7-e343-4da1-bc20-32eb973f3c9a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:52.524256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65663fd7-e343-4da1-bc20-32eb973f3c9a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:52.525442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65663fd7-e343-4da1-bc20-32eb973f3c9a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:52.653728 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-65663fd7-e343-4da1-bc20-32eb973f3c9a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 1b80677b-614d-41a1-be0a-31bf5b46c485] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:14:52.914497 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-65663fd7-e343-4da1-bc20-32eb973f3c9a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "DELETE /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485" status: 204 len: 0 microversion: 2.1 time: 0.472401 Aug 24 10:14:52.916793 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 440/944] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:14:52 2022] DELETE /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:14:52.931950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e48d16db-7f94-48e7-bd71-05034ae3892a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60e84452-316c-49d9-b5ba-91a3e3e1bd9c", "device": "/dev/xvdb"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:52.940573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e48d16db-7f94-48e7-bd71-05034ae3892a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:52.955483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e48d16db-7f94-48e7-bd71-05034ae3892a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:52.956855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e48d16db-7f94-48e7-bd71-05034ae3892a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:52.958416 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e48d16db-7f94-48e7-bd71-05034ae3892a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:52.960583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e48d16db-7f94-48e7-bd71-05034ae3892a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:52.961682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e48d16db-7f94-48e7-bd71-05034ae3892a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:52.962521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e48d16db-7f94-48e7-bd71-05034ae3892a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:53.535297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-a34b0b4b-82f3-4261-bdee-d4a8da16d9f4 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: 293f4b0e-a839-48f3-a510-4b4e320ebf59] Building network info cache for instance {{(pid=122433) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 10:14:54.386339 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e48d16db-7f94-48e7-bd71-05034ae3892a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "POST /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.465965 Aug 24 10:14:54.415098 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 441/945] 10.222.0.85 () {62 vars in 1364 bytes} [Wed Aug 24 10:14:52 2022] POST /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0/os-volume_attachments => generated 194 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:14:54.454047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dde761db-6b8c-4752-a5f0-cd09029b2b40 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:54.460649 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dde761db-6b8c-4752-a5f0-cd09029b2b40 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: a626b1ea-4968-4e45-b2ab-4c11f06e6f85] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:54.580361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dde761db-6b8c-4752-a5f0-cd09029b2b40 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:54.581501 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dde761db-6b8c-4752-a5f0-cd09029b2b40 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:54.584178 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dde761db-6b8c-4752-a5f0-cd09029b2b40 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:54.587442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dde761db-6b8c-4752-a5f0-cd09029b2b40 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:54.591656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dde761db-6b8c-4752-a5f0-cd09029b2b40 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:54.597940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dde761db-6b8c-4752-a5f0-cd09029b2b40 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:55.376525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-a34b0b4b-82f3-4261-bdee-d4a8da16d9f4 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: 293f4b0e-a839-48f3-a510-4b4e320ebf59] Updating instance_info_cache with network_info: [{"id": "f62c5a20-b4b1-4fec-8849-6937f20905b9", "address": "fa:16:3e:5a:d5:97", "network": {"id": "6a3a952d-cb92-48d6-ae25-c71db979b739", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1149866647-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "67b25f29b4a141f4b45518dba7332c3c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf62c5a20-b4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122433) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 10:14:55.401819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a34b0b4b-82f3-4261-bdee-d4a8da16d9f4 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Releasing lock "refresh_cache-293f4b0e-a839-48f3-a510-4b4e320ebf59" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 10:14:55.404288 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a34b0b4b-82f3-4261-bdee-d4a8da16d9f4 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "POST /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59/action" status: 202 len: 0 microversion: 2.1 time: 6.884086 Aug 24 10:14:55.406912 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 505/946] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:14:48 2022] POST /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59/action => generated 0 bytes in 6889 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 24 10:14:55.426146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cddd6560-ff09-47a3-9e49-679ea6c1913d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1869790661", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "b3bbedfb-51dc-4363-a78d-44d0daaa6110"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:55.566293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-cddd6560-ff09-47a3-9e49-679ea6c1913d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] validate_networks() for [('b3bbedfb-51dc-4363-a78d-44d0daaa6110', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:14:55.739176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dde761db-6b8c-4752-a5f0-cd09029b2b40 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:55.754649 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dde761db-6b8c-4752-a5f0-cd09029b2b40 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85" status: 200 len: 1317 microversion: 2.1 time: 1.337533 Aug 24 10:14:55.757603 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 442/947] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:54 2022] GET /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85 => generated 1317 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:55.772354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-2e9a1d2b-8435-405f-b37e-4e36ad2cce14 req-2903536f-30ba-4496-ab77-4d80cb78cede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7953a2dc-785d-4cb0-a4ee-8bd420fc6fab", "name": "network-vif-unplugged", "status": "completed", "tag": "c80fb50e-88a4-4f76-93d7-ac7c65fbd4b1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:55.797110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2e9a1d2b-8435-405f-b37e-4e36ad2cce14 req-2903536f-30ba-4496-ab77-4d80cb78cede service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:55.801699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2e9a1d2b-8435-405f-b37e-4e36ad2cce14 req-2903536f-30ba-4496-ab77-4d80cb78cede service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:55.802611 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2e9a1d2b-8435-405f-b37e-4e36ad2cce14 req-2903536f-30ba-4496-ab77-4d80cb78cede service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:55.854924 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-2e9a1d2b-8435-405f-b37e-4e36ad2cce14 req-2903536f-30ba-4496-ab77-4d80cb78cede service nova] Creating event network-vif-unplugged:c80fb50e-88a4-4f76-93d7-ac7c65fbd4b1 for instance 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab on n-h1-849328-3 Aug 24 10:14:55.869168 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-2e9a1d2b-8435-405f-b37e-4e36ad2cce14 req-2903536f-30ba-4496-ab77-4d80cb78cede service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109436 Aug 24 10:14:55.870267 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 443/948] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:55.909242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-053da82c-ff75-4c0a-adc1-385996f8b316 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:55.910279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-053da82c-ff75-4c0a-adc1-385996f8b316 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 1b80677b-614d-41a1-be0a-31bf5b46c485] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:55.924985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-053da82c-ff75-4c0a-adc1-385996f8b316 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:55.929698 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-053da82c-ff75-4c0a-adc1-385996f8b316 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:55.930447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-053da82c-ff75-4c0a-adc1-385996f8b316 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:55.931331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-053da82c-ff75-4c0a-adc1-385996f8b316 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:55.937301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-053da82c-ff75-4c0a-adc1-385996f8b316 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:55.938273 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-053da82c-ff75-4c0a-adc1-385996f8b316 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:56.560765 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-053da82c-ff75-4c0a-adc1-385996f8b316 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:56.570485 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-053da82c-ff75-4c0a-adc1-385996f8b316 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485" status: 200 len: 1473 microversion: 2.1 time: 0.698645 Aug 24 10:14:56.586138 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 444/949] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:55 2022] GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485 => generated 1473 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:56.601654 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5b3a6f7a-e1d7-43ec-b4f8-e62e7653b879 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:56.602456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5b3a6f7a-e1d7-43ec-b4f8-e62e7653b879 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:56.615547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b3a6f7a-e1d7-43ec-b4f8-e62e7653b879 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:56.617008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b3a6f7a-e1d7-43ec-b4f8-e62e7653b879 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:56.620053 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b3a6f7a-e1d7-43ec-b4f8-e62e7653b879 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:56.621259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b3a6f7a-e1d7-43ec-b4f8-e62e7653b879 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:56.621854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b3a6f7a-e1d7-43ec-b4f8-e62e7653b879 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:56.627175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b3a6f7a-e1d7-43ec-b4f8-e62e7653b879 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:57.542414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5b3a6f7a-e1d7-43ec-b4f8-e62e7653b879 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:57.564810 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5b3a6f7a-e1d7-43ec-b4f8-e62e7653b879 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1473 microversion: 2.1 time: 0.971969 Aug 24 10:14:57.571438 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 445/950] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:56 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1473 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:57.589730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c9f2dd2d-9648-4894-9b43-991263660f29 req-304ae381-7547-45fa-8c3e-fff7a9e30198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "293f4b0e-a839-48f3-a510-4b4e320ebf59", "tag": "f62c5a20-b4b1-4fec-8849-6937f20905b9"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:57.620351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c9f2dd2d-9648-4894-9b43-991263660f29 req-304ae381-7547-45fa-8c3e-fff7a9e30198 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:57.632134 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c9f2dd2d-9648-4894-9b43-991263660f29 req-304ae381-7547-45fa-8c3e-fff7a9e30198 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:57.638405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c9f2dd2d-9648-4894-9b43-991263660f29 req-304ae381-7547-45fa-8c3e-fff7a9e30198 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:57.671055 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c9f2dd2d-9648-4894-9b43-991263660f29 req-304ae381-7547-45fa-8c3e-fff7a9e30198 service nova] Creating event network-changed:f62c5a20-b4b1-4fec-8849-6937f20905b9 for instance 293f4b0e-a839-48f3-a510-4b4e320ebf59 on n-h2-849328-3 Aug 24 10:14:57.687745 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c9f2dd2d-9648-4894-9b43-991263660f29 req-304ae381-7547-45fa-8c3e-fff7a9e30198 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112186 Aug 24 10:14:57.688778 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 446/951] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:57.699359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ba1ee5a4-1f93-464e-a130-373ad761cf38 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:57.708496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ba1ee5a4-1f93-464e-a130-373ad761cf38 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: 293f4b0e-a839-48f3-a510-4b4e320ebf59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:57.719711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba1ee5a4-1f93-464e-a130-373ad761cf38 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:57.720505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba1ee5a4-1f93-464e-a130-373ad761cf38 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:57.721220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba1ee5a4-1f93-464e-a130-373ad761cf38 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:57.722179 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba1ee5a4-1f93-464e-a130-373ad761cf38 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:57.728696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba1ee5a4-1f93-464e-a130-373ad761cf38 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:57.729519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba1ee5a4-1f93-464e-a130-373ad761cf38 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:57.786425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ba1ee5a4-1f93-464e-a130-373ad761cf38 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: 293f4b0e-a839-48f3-a510-4b4e320ebf59] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:14:57.982383 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ba1ee5a4-1f93-464e-a130-373ad761cf38 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "DELETE /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59" status: 204 len: 0 microversion: 2.1 time: 0.292063 Aug 24 10:14:57.983906 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 447/952] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:14:57 2022] DELETE /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:14:57.990010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a69aa435-f93f-49e8-a806-2767bcfb81cd tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:57.992476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a69aa435-f93f-49e8-a806-2767bcfb81cd tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: a626b1ea-4968-4e45-b2ab-4c11f06e6f85] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:58.008422 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a69aa435-f93f-49e8-a806-2767bcfb81cd tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:58.009341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a69aa435-f93f-49e8-a806-2767bcfb81cd tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:58.009998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a69aa435-f93f-49e8-a806-2767bcfb81cd tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:58.010941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a69aa435-f93f-49e8-a806-2767bcfb81cd tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:58.011616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a69aa435-f93f-49e8-a806-2767bcfb81cd tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:58.018063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a69aa435-f93f-49e8-a806-2767bcfb81cd tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:58.500891 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a69aa435-f93f-49e8-a806-2767bcfb81cd tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:14:58.530571 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a69aa435-f93f-49e8-a806-2767bcfb81cd tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85" status: 200 len: 1317 microversion: 2.1 time: 0.544838 Aug 24 10:14:58.549607 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 448/953] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:57 2022] GET /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85 => generated 1317 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:14:58.564382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4e53bbcd-8bcd-46d0-b8ce-466c43aea805 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:58.568947 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4e53bbcd-8bcd-46d0-b8ce-466c43aea805 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 1b80677b-614d-41a1-be0a-31bf5b46c485] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:58.589734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e53bbcd-8bcd-46d0-b8ce-466c43aea805 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:58.590589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e53bbcd-8bcd-46d0-b8ce-466c43aea805 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:58.593892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e53bbcd-8bcd-46d0-b8ce-466c43aea805 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:58.594946 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e53bbcd-8bcd-46d0-b8ce-466c43aea805 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:58.595655 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e53bbcd-8bcd-46d0-b8ce-466c43aea805 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:58.597693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e53bbcd-8bcd-46d0-b8ce-466c43aea805 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:58.663015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:14:58.683745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-cddd6560-ff09-47a3-9e49-679ea6c1913d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:14:58.685304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-cddd6560-ff09-47a3-9e49-679ea6c1913d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:14:58.686477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-cddd6560-ff09-47a3-9e49-679ea6c1913d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:14:58.687535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-cddd6560-ff09-47a3-9e49-679ea6c1913d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:14:58.688510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-cddd6560-ff09-47a3-9e49-679ea6c1913d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:14:58.716026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cddd6560-ff09-47a3-9e49-679ea6c1913d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:58.722089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cddd6560-ff09-47a3-9e49-679ea6c1913d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:58.722825 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cddd6560-ff09-47a3-9e49-679ea6c1913d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:58.723829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cddd6560-ff09-47a3-9e49-679ea6c1913d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:58.724466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cddd6560-ff09-47a3-9e49-679ea6c1913d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:58.725295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cddd6560-ff09-47a3-9e49-679ea6c1913d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:58.796712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-cddd6560-ff09-47a3-9e49-679ea6c1913d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Getting quotas for project d30703728b2a4a569b6dd1608d8956b8. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:14:58.820547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-cddd6560-ff09-47a3-9e49-679ea6c1913d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Getting quotas for user 85db443623964ed381b2a4cfc7310202 and project d30703728b2a4a569b6dd1608d8956b8. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:14:58.860277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cddd6560-ff09-47a3-9e49-679ea6c1913d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:14:58.866677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cddd6560-ff09-47a3-9e49-679ea6c1913d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:14:59.013662 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cddd6560-ff09-47a3-9e49-679ea6c1913d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.597543 Aug 24 10:14:59.030464 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 506/954] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:14:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:14:59.049013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7b837105-790f-49f0-83c4-1d7b5dd57611 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Action: 'action', calling method: .version_select at 0x7f4657d775e0>, body: {"addFloatingIp": {"address": "172.25.0.196"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:59.066771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7b837105-790f-49f0-83c4-1d7b5dd57611 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:14:59.122889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b837105-790f-49f0-83c4-1d7b5dd57611 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:59.123749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b837105-790f-49f0-83c4-1d7b5dd57611 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:59.129962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b837105-790f-49f0-83c4-1d7b5dd57611 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:59.146847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b837105-790f-49f0-83c4-1d7b5dd57611 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:59.154509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b837105-790f-49f0-83c4-1d7b5dd57611 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:59.155651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b837105-790f-49f0-83c4-1d7b5dd57611 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:59.253814 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b837105-790f-49f0-83c4-1d7b5dd57611 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "refresh_cache-c285a5a5-ba66-41c8-aa67-402e2d5f9159" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 10:14:59.254230 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b837105-790f-49f0-83c4-1d7b5dd57611 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquired lock "refresh_cache-c285a5a5-ba66-41c8-aa67-402e2d5f9159" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 10:15:00.206312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4e53bbcd-8bcd-46d0-b8ce-466c43aea805 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:00.225066 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4e53bbcd-8bcd-46d0-b8ce-466c43aea805 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485" status: 200 len: 1473 microversion: 2.1 time: 1.673086 Aug 24 10:15:00.227446 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 449/955] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:14:58 2022] GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485 => generated 1473 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:00.257459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-5688499b-0661-405c-915d-df5e98cc8677 req-a4ad4ff3-dd75-47b5-b9e4-4dcb7a20bab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a626b1ea-4968-4e45-b2ab-4c11f06e6f85", "name": "network-vif-plugged", "status": "completed", "tag": "993acca0-372e-44eb-95b8-b63a381f8921"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:00.275567 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5688499b-0661-405c-915d-df5e98cc8677 req-a4ad4ff3-dd75-47b5-b9e4-4dcb7a20bab7 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:00.276082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5688499b-0661-405c-915d-df5e98cc8677 req-a4ad4ff3-dd75-47b5-b9e4-4dcb7a20bab7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:00.276533 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5688499b-0661-405c-915d-df5e98cc8677 req-a4ad4ff3-dd75-47b5-b9e4-4dcb7a20bab7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:00.311515 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-5688499b-0661-405c-915d-df5e98cc8677 req-a4ad4ff3-dd75-47b5-b9e4-4dcb7a20bab7 service nova] Creating event network-vif-plugged:993acca0-372e-44eb-95b8-b63a381f8921 for instance a626b1ea-4968-4e45-b2ab-4c11f06e6f85 on n-h2-849328-3 Aug 24 10:15:00.327289 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-5688499b-0661-405c-915d-df5e98cc8677 req-a4ad4ff3-dd75-47b5-b9e4-4dcb7a20bab7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097970 Aug 24 10:15:00.331657 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 450/956] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:00.348321 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bc69f949-eee1-49c5-a3b6-48867f8f2379 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:00.362022 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bc69f949-eee1-49c5-a3b6-48867f8f2379 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:00.389008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc69f949-eee1-49c5-a3b6-48867f8f2379 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:00.390121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc69f949-eee1-49c5-a3b6-48867f8f2379 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:00.392281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc69f949-eee1-49c5-a3b6-48867f8f2379 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:00.393387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc69f949-eee1-49c5-a3b6-48867f8f2379 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:00.394055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc69f949-eee1-49c5-a3b6-48867f8f2379 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:00.394688 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc69f949-eee1-49c5-a3b6-48867f8f2379 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:01.413212 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bc69f949-eee1-49c5-a3b6-48867f8f2379 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:01.431795 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bc69f949-eee1-49c5-a3b6-48867f8f2379 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1471 microversion: 2.1 time: 1.081194 Aug 24 10:15:01.432915 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 451/957] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:00 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1471 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:01.451351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ec2b1b4d-b097-4084-a237-8e887601cc4e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:01.452772 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ec2b1b4d-b097-4084-a237-8e887601cc4e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:01.478194 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec2b1b4d-b097-4084-a237-8e887601cc4e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:01.481438 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec2b1b4d-b097-4084-a237-8e887601cc4e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:01.484171 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec2b1b4d-b097-4084-a237-8e887601cc4e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:01.488058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec2b1b4d-b097-4084-a237-8e887601cc4e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:01.489103 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec2b1b4d-b097-4084-a237-8e887601cc4e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:01.495288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec2b1b4d-b097-4084-a237-8e887601cc4e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:01.759389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ec2b1b4d-b097-4084-a237-8e887601cc4e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:01.791051 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ec2b1b4d-b097-4084-a237-8e887601cc4e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 200 len: 1204 microversion: 2.1 time: 0.352979 Aug 24 10:15:01.792422 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 452/958] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:01 2022] GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 1204 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:01.804835 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-969cc82f-b236-47fb-b886-69a958bef2aa tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:01.814395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-969cc82f-b236-47fb-b886-69a958bef2aa tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: a626b1ea-4968-4e45-b2ab-4c11f06e6f85] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:01.837056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-969cc82f-b236-47fb-b886-69a958bef2aa tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:01.845802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-969cc82f-b236-47fb-b886-69a958bef2aa tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:01.847686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-969cc82f-b236-47fb-b886-69a958bef2aa tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:01.854555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-969cc82f-b236-47fb-b886-69a958bef2aa tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:01.856632 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-969cc82f-b236-47fb-b886-69a958bef2aa tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:01.858804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-969cc82f-b236-47fb-b886-69a958bef2aa tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:01.871069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:02.425601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-7b837105-790f-49f0-83c4-1d7b5dd57611 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Building network info cache for instance {{(pid=122433) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 10:15:03.077563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-969cc82f-b236-47fb-b886-69a958bef2aa tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:03.096843 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-969cc82f-b236-47fb-b886-69a958bef2aa tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85" status: 200 len: 1317 microversion: 2.1 time: 1.297328 Aug 24 10:15:03.098241 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 453/959] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:01 2022] GET /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85 => generated 1317 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:03.108442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-09a2a8af-b5c8-4f01-b5cf-704ded308802 req-5650629e-8059-484e-a7a4-4704b47199d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce6709c-548b-4bdc-9667-fa678dbeb477", "name": "network-vif-unplugged", "status": "completed", "tag": "a5c8b983-3e85-49ee-93ef-994023d0a43c"}, {"name": "network-changed", "server_uuid": "fce6709c-548b-4bdc-9667-fa678dbeb477", "tag": "a5c8b983-3e85-49ee-93ef-994023d0a43c"}, {"server_uuid": "1b80677b-614d-41a1-be0a-31bf5b46c485", "name": "network-vif-deleted", "tag": "285fd86f-4935-4224-b70e-59290d2534ce"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:03.125954 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-09a2a8af-b5c8-4f01-b5cf-704ded308802 req-5650629e-8059-484e-a7a4-4704b47199d2 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:03.126792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-09a2a8af-b5c8-4f01-b5cf-704ded308802 req-5650629e-8059-484e-a7a4-4704b47199d2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:03.127487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-09a2a8af-b5c8-4f01-b5cf-704ded308802 req-5650629e-8059-484e-a7a4-4704b47199d2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:03.184483 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-09a2a8af-b5c8-4f01-b5cf-704ded308802 req-5650629e-8059-484e-a7a4-4704b47199d2 service nova] Creating event network-vif-unplugged:a5c8b983-3e85-49ee-93ef-994023d0a43c for instance fce6709c-548b-4bdc-9667-fa678dbeb477 on n-h1-849328-3 Aug 24 10:15:03.185882 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-09a2a8af-b5c8-4f01-b5cf-704ded308802 req-5650629e-8059-484e-a7a4-4704b47199d2 service nova] Creating event network-changed:a5c8b983-3e85-49ee-93ef-994023d0a43c for instance fce6709c-548b-4bdc-9667-fa678dbeb477 on n-h1-849328-3 Aug 24 10:15:03.187491 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-09a2a8af-b5c8-4f01-b5cf-704ded308802 req-5650629e-8059-484e-a7a4-4704b47199d2 service nova] Creating event network-vif-deleted:285fd86f-4935-4224-b70e-59290d2534ce for instance 1b80677b-614d-41a1-be0a-31bf5b46c485 on n-h2-849328-3 Aug 24 10:15:03.217745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-09a2a8af-b5c8-4f01-b5cf-704ded308802 req-5650629e-8059-484e-a7a4-4704b47199d2 service nova] Instance fce6709c-548b-4bdc-9667-fa678dbeb477 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 10:15:03.241243 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-09a2a8af-b5c8-4f01-b5cf-704ded308802 req-5650629e-8059-484e-a7a4-4704b47199d2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.139761 Aug 24 10:15:03.242632 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 454/960] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:03.249221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-dfe9dc84-6e3c-46df-87a7-5915e31ae513 req-505b21fd-d059-4ecf-92d6-67a2742f314d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7953a2dc-785d-4cb0-a4ee-8bd420fc6fab", "name": "network-vif-deleted", "tag": "c80fb50e-88a4-4f76-93d7-ac7c65fbd4b1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:03.272545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dfe9dc84-6e3c-46df-87a7-5915e31ae513 req-505b21fd-d059-4ecf-92d6-67a2742f314d service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:03.273683 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dfe9dc84-6e3c-46df-87a7-5915e31ae513 req-505b21fd-d059-4ecf-92d6-67a2742f314d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:03.274320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dfe9dc84-6e3c-46df-87a7-5915e31ae513 req-505b21fd-d059-4ecf-92d6-67a2742f314d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:03.289739 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-dfe9dc84-6e3c-46df-87a7-5915e31ae513 req-505b21fd-d059-4ecf-92d6-67a2742f314d service nova] Creating event network-vif-deleted:c80fb50e-88a4-4f76-93d7-ac7c65fbd4b1 for instance 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab on n-h1-849328-3 Aug 24 10:15:03.299295 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-dfe9dc84-6e3c-46df-87a7-5915e31ae513 req-505b21fd-d059-4ecf-92d6-67a2742f314d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053811 Aug 24 10:15:03.300443 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 455/961] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:03.309521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fe6666cf-8b96-4c5a-9161-e33d1c0b0759 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:03.310813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fe6666cf-8b96-4c5a-9161-e33d1c0b0759 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 1b80677b-614d-41a1-be0a-31bf5b46c485] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:03.324207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe6666cf-8b96-4c5a-9161-e33d1c0b0759 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:03.325329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe6666cf-8b96-4c5a-9161-e33d1c0b0759 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:03.326180 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe6666cf-8b96-4c5a-9161-e33d1c0b0759 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:03.327283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe6666cf-8b96-4c5a-9161-e33d1c0b0759 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:03.328094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe6666cf-8b96-4c5a-9161-e33d1c0b0759 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:03.328727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe6666cf-8b96-4c5a-9161-e33d1c0b0759 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:03.374030 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-fe6666cf-8b96-4c5a-9161-e33d1c0b0759 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] HTTP exception thrown: Instance 1b80677b-614d-41a1-be0a-31bf5b46c485 could not be found. Aug 24 10:15:03.381179 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fe6666cf-8b96-4c5a-9161-e33d1c0b0759 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Request method failure captured: Aug 24 10:15:03.381179 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485 HTTP/1.1 Aug 24 10:15:03.381179 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:15:03.381179 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:15:03.381179 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:15:03.381179 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:15:03.381179 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:15:03.381179 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:15:03.381179 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:15:03.381179 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:15:03.381179 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBflp1lR6NJiOvJ0jo0u_ObCwr-XT9ZPDd8UFdAdrktIeq9W3st8_Vr__ObGPpyUD3B1sX780QVeUxsP7WLsIfoEmJ6ZRyy4XuEoKUiYvCKqPo1TBHvl0EjfZLY21G0cKkNvRwmjK2bcnCfVvvo4RO0l6RUsKYrhQXpLAAKVAYjdEZcw Aug 24 10:15:03.381179 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:15:03.381179 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:15:03.381179 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:15:03.381179 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:15:03.381179 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:15:03.381179 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:15:03.381179 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: f2e2ee3e278042a5bf8ee7348966a468 Aug 24 10:15:03.381179 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersOnMultiNodesTest-1510468885 Aug 24 10:15:03.381179 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:15:03.381179 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:15:03.382699 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f2e2ee3e278042a5bf8ee7348966a468"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f2e2ee3e278042a5bf8ee7348966a468", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f2e2ee3e278042a5bf8ee7348966a468"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f2e2ee3e278042a5bf8ee7348966a468"}]}] Aug 24 10:15:03.382699 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersOnMultiNodesTest-1510468885 Aug 24 10:15:03.382699 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: f2e2ee3e278042a5bf8ee7348966a468 Aug 24 10:15:03.382699 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1510468885 Aug 24 10:15:03.382699 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersOnMultiNodesTest-1510468885-project Aug 24 10:15:03.382699 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:15:03.382699 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:15:03.382699 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: bf03c0eb5bd748ae85be830f1121dc06 Aug 24 10:15:03.382699 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersOnMultiNodesTest-1510468885-project Aug 24 10:15:03.382699 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:15:03.382699 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 1b80677b-614d-41a1-be0a-31bf5b46c485 could not be found. Aug 24 10:15:03.382699 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '1b80677b-614d-41a1-be0a-31bf5b46c485'} Aug 24 10:15:03.383793 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:15:03.383793 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:03.383793 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:15:03.383793 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:15:03.383793 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:15:03.383793 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:15:03.383793 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:15:03.383793 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:15:03.383793 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:15:03.383793 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:15:03.383793 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b80677b-614d-41a1-be0a-31bf5b46c485 could not be found. Aug 24 10:15:03.383793 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:03.383793 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:15:03.383793 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:03.383793 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:03.383793 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:15:03.383793 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:15:03.383793 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:15:03.383793 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:15:03.383793 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:15:03.385256 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:15:03.385256 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:15:03.385256 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:15:03.385256 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:15:03.385256 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:15:03.385256 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:15:03.385256 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:15:03.385256 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b80677b-614d-41a1-be0a-31bf5b46c485 could not be found. Aug 24 10:15:03.385256 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:03.385256 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:15:03.385256 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:03.385256 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:03.385256 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:15:03.385256 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:15:03.385256 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:15:03.385256 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:15:03.385256 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b80677b-614d-41a1-be0a-31bf5b46c485 could not be found. Aug 24 10:15:03.385256 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:03.386514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fe6666cf-8b96-4c5a-9161-e33d1c0b0759 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Returning 404 to user: Instance 1b80677b-614d-41a1-be0a-31bf5b46c485 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:15:03.386514 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fe6666cf-8b96-4c5a-9161-e33d1c0b0759 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485" status: 404 len: 111 microversion: 2.1 time: 0.080619 Aug 24 10:15:03.392093 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 456/962] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:03 2022] GET /compute/v2.1/servers/1b80677b-614d-41a1-be0a-31bf5b46c485 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:15:03.401071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dc1f0a91-26c4-49eb-88b0-c701eb9e4dd8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:03.402025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dc1f0a91-26c4-49eb-88b0-c701eb9e4dd8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:03.410672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc1f0a91-26c4-49eb-88b0-c701eb9e4dd8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:03.411169 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc1f0a91-26c4-49eb-88b0-c701eb9e4dd8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:03.411607 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc1f0a91-26c4-49eb-88b0-c701eb9e4dd8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:03.413845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc1f0a91-26c4-49eb-88b0-c701eb9e4dd8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:03.414328 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc1f0a91-26c4-49eb-88b0-c701eb9e4dd8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:03.414769 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc1f0a91-26c4-49eb-88b0-c701eb9e4dd8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:04.393027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-7b837105-790f-49f0-83c4-1d7b5dd57611 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Updating instance_info_cache with network_info: [{"id": "ad70c32a-b650-4c05-bd90-a010a57fd42f", "address": "fa:16:3e:a8:d4:28", "network": {"id": "6a3a952d-cb92-48d6-ae25-c71db979b739", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1149866647-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "67b25f29b4a141f4b45518dba7332c3c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapad70c32a-b6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122433) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 10:15:04.410264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b837105-790f-49f0-83c4-1d7b5dd57611 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Releasing lock "refresh_cache-c285a5a5-ba66-41c8-aa67-402e2d5f9159" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 10:15:04.411223 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7b837105-790f-49f0-83c4-1d7b5dd57611 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "POST /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159/action" status: 202 len: 0 microversion: 2.1 time: 5.377758 Aug 24 10:15:04.412501 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 507/963] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:14:59 2022] POST /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159/action => generated 0 bytes in 5382 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 24 10:15:04.420914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c0d43f49-de03-4bfb-9814-1324a674c9b4 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:04.422536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c0d43f49-de03-4bfb-9814-1324a674c9b4 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:04.438471 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0d43f49-de03-4bfb-9814-1324a674c9b4 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:04.439577 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0d43f49-de03-4bfb-9814-1324a674c9b4 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:04.440227 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0d43f49-de03-4bfb-9814-1324a674c9b4 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:04.441114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0d43f49-de03-4bfb-9814-1324a674c9b4 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:04.441768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0d43f49-de03-4bfb-9814-1324a674c9b4 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:04.442577 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0d43f49-de03-4bfb-9814-1324a674c9b4 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:04.675348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c0d43f49-de03-4bfb-9814-1324a674c9b4 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:04.687245 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c0d43f49-de03-4bfb-9814-1324a674c9b4 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 200 len: 1266 microversion: 2.1 time: 0.271975 Aug 24 10:15:04.703189 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 508/964] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:04 2022] GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 1266 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:04.710677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a55044e3-335f-4d71-b6de-7df0f78583ca tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:04.711544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a55044e3-335f-4d71-b6de-7df0f78583ca tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 38332901-4cb3-4475-90f4-48ad729f16c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:04.720147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a55044e3-335f-4d71-b6de-7df0f78583ca tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:04.721208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a55044e3-335f-4d71-b6de-7df0f78583ca tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:04.721933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a55044e3-335f-4d71-b6de-7df0f78583ca tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:04.723770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a55044e3-335f-4d71-b6de-7df0f78583ca tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:04.724668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a55044e3-335f-4d71-b6de-7df0f78583ca tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:04.725351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a55044e3-335f-4d71-b6de-7df0f78583ca tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:04.778003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a55044e3-335f-4d71-b6de-7df0f78583ca tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 38332901-4cb3-4475-90f4-48ad729f16c5] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:15:04.829225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dc1f0a91-26c4-49eb-88b0-c701eb9e4dd8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:04.858687 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dc1f0a91-26c4-49eb-88b0-c701eb9e4dd8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1468 microversion: 2.1 time: 1.464609 Aug 24 10:15:04.859769 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 457/965] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:03 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1468 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:04.878429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dea3fbbf-2600-4be5-bd58-328c16849685 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:04.879588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dea3fbbf-2600-4be5-bd58-328c16849685 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: a626b1ea-4968-4e45-b2ab-4c11f06e6f85] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:04.907426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dea3fbbf-2600-4be5-bd58-328c16849685 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:04.908878 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dea3fbbf-2600-4be5-bd58-328c16849685 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:04.909982 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dea3fbbf-2600-4be5-bd58-328c16849685 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:04.911574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dea3fbbf-2600-4be5-bd58-328c16849685 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:04.912696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dea3fbbf-2600-4be5-bd58-328c16849685 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:04.913775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dea3fbbf-2600-4be5-bd58-328c16849685 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:04.973388 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a55044e3-335f-4d71-b6de-7df0f78583ca tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "DELETE /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5" status: 204 len: 0 microversion: 2.1 time: 0.267868 Aug 24 10:15:04.975170 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 509/966] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:15:04 2022] DELETE /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:15:04.992533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-62dec7e0-acbe-4894-87c8-ed25a5d13c7a tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '.version_select at 0x7f4654f5aca0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:05.282700 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-62dec7e0-acbe-4894-87c8-ed25a5d13c7a tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/os-floating-ips/42ba4717-f87e-43f3-a3ef-3d9d04302d1a" status: 200 len: 184 microversion: 2.1 time: 0.305220 Aug 24 10:15:05.283345 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 510/967] 10.222.0.85 () {58 vars in 1260 bytes} [Wed Aug 24 10:15:04 2022] GET /compute/v2.1/os-floating-ips/42ba4717-f87e-43f3-a3ef-3d9d04302d1a => generated 184 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:05.311355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec082b15-00b2-4ce4-bd9c-96b7553071d1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:05.311355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ec082b15-00b2-4ce4-bd9c-96b7553071d1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:05.333586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec082b15-00b2-4ce4-bd9c-96b7553071d1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:05.355505 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec082b15-00b2-4ce4-bd9c-96b7553071d1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:05.357926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec082b15-00b2-4ce4-bd9c-96b7553071d1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:05.359108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec082b15-00b2-4ce4-bd9c-96b7553071d1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:05.361946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec082b15-00b2-4ce4-bd9c-96b7553071d1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:05.362632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec082b15-00b2-4ce4-bd9c-96b7553071d1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:05.500852 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ec082b15-00b2-4ce4-bd9c-96b7553071d1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "POST /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477/action" status: 204 len: 0 microversion: 2.1 time: 0.216009 Aug 24 10:15:05.502558 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 511/968] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:15:05 2022] POST /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477/action => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:15:05.510208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5c47d4ca-c027-4d89-aaff-84080472fddf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:05.511461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5c47d4ca-c027-4d89-aaff-84080472fddf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 38332901-4cb3-4475-90f4-48ad729f16c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:05.539429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c47d4ca-c027-4d89-aaff-84080472fddf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:05.545019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c47d4ca-c027-4d89-aaff-84080472fddf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:05.548353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c47d4ca-c027-4d89-aaff-84080472fddf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:05.556349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c47d4ca-c027-4d89-aaff-84080472fddf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:05.560074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c47d4ca-c027-4d89-aaff-84080472fddf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:05.565851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c47d4ca-c027-4d89-aaff-84080472fddf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:05.977901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dea3fbbf-2600-4be5-bd58-328c16849685 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:06.002093 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dea3fbbf-2600-4be5-bd58-328c16849685 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85" status: 200 len: 1507 microversion: 2.1 time: 1.140693 Aug 24 10:15:06.008074 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 458/969] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:04 2022] GET /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85 => generated 1507 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:06.025327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7578079a-3b40-49c8-a264-dc548d96d5cc tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Action: 'action', calling method: .version_select at 0x7f4657d79c10>, body: {"removeFloatingIp": {"address": "172.25.0.196"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:06.038883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5c47d4ca-c027-4d89-aaff-84080472fddf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:06.066093 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5c47d4ca-c027-4d89-aaff-84080472fddf tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5" status: 200 len: 1473 microversion: 2.1 time: 0.561502 Aug 24 10:15:06.071480 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 512/970] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:05 2022] GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5 => generated 1473 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:06.094780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-ef104550-28f0-4a36-94e0-879b90c99945 req-9e496b76-0082-4fc1-acd9-29bf725c0fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "293f4b0e-a839-48f3-a510-4b4e320ebf59", "name": "network-vif-deleted", "tag": "f62c5a20-b4b1-4fec-8849-6937f20905b9"}, {"name": "network-changed", "server_uuid": "c285a5a5-ba66-41c8-aa67-402e2d5f9159", "tag": "ad70c32a-b650-4c05-bd90-a010a57fd42f"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:06.117238 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ef104550-28f0-4a36-94e0-879b90c99945 req-9e496b76-0082-4fc1-acd9-29bf725c0fff service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:06.118118 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ef104550-28f0-4a36-94e0-879b90c99945 req-9e496b76-0082-4fc1-acd9-29bf725c0fff service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:06.118767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ef104550-28f0-4a36-94e0-879b90c99945 req-9e496b76-0082-4fc1-acd9-29bf725c0fff service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:06.124348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=5,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:06.136307 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-ef104550-28f0-4a36-94e0-879b90c99945 req-9e496b76-0082-4fc1-acd9-29bf725c0fff service nova] Creating event network-vif-deleted:f62c5a20-b4b1-4fec-8849-6937f20905b9 for instance 293f4b0e-a839-48f3-a510-4b4e320ebf59 on n-h2-849328-3 Aug 24 10:15:06.137269 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-ef104550-28f0-4a36-94e0-879b90c99945 req-9e496b76-0082-4fc1-acd9-29bf725c0fff service nova] Creating event network-changed:ad70c32a-b650-4c05-bd90-a010a57fd42f for instance c285a5a5-ba66-41c8-aa67-402e2d5f9159 on n-h1-849328-3 Aug 24 10:15:06.151002 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-ef104550-28f0-4a36-94e0-879b90c99945 req-9e496b76-0082-4fc1-acd9-29bf725c0fff service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.075742 Aug 24 10:15:06.152480 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 513/971] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:06.158381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4a3c2080-5535-4b68-88bf-7a885bf2a7b2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:06.159397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4a3c2080-5535-4b68-88bf-7a885bf2a7b2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:06.170157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a3c2080-5535-4b68-88bf-7a885bf2a7b2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:06.171364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a3c2080-5535-4b68-88bf-7a885bf2a7b2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:06.172038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a3c2080-5535-4b68-88bf-7a885bf2a7b2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:06.173379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a3c2080-5535-4b68-88bf-7a885bf2a7b2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:06.174115 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a3c2080-5535-4b68-88bf-7a885bf2a7b2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:06.174772 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a3c2080-5535-4b68-88bf-7a885bf2a7b2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:06.667216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7578079a-3b40-49c8-a264-dc548d96d5cc tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:06.682161 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7578079a-3b40-49c8-a264-dc548d96d5cc tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:06.688065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7578079a-3b40-49c8-a264-dc548d96d5cc tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:06.688604 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7578079a-3b40-49c8-a264-dc548d96d5cc tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:06.689453 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7578079a-3b40-49c8-a264-dc548d96d5cc tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:06.690660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7578079a-3b40-49c8-a264-dc548d96d5cc tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:06.691362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7578079a-3b40-49c8-a264-dc548d96d5cc tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:07.032261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4a3c2080-5535-4b68-88bf-7a885bf2a7b2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:07.068906 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4a3c2080-5535-4b68-88bf-7a885bf2a7b2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1468 microversion: 2.1 time: 0.909693 Aug 24 10:15:07.081399 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 514/972] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:06 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1468 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:07.098887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-990af096-a386-4f82-829d-44c1a5df9749 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:07.110286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-990af096-a386-4f82-829d-44c1a5df9749 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:07.128873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-990af096-a386-4f82-829d-44c1a5df9749 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:07.132451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-990af096-a386-4f82-829d-44c1a5df9749 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:07.134981 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-990af096-a386-4f82-829d-44c1a5df9749 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:07.138229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-990af096-a386-4f82-829d-44c1a5df9749 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:07.139219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-990af096-a386-4f82-829d-44c1a5df9749 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:07.142731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-990af096-a386-4f82-829d-44c1a5df9749 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:07.377402 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-990af096-a386-4f82-829d-44c1a5df9749 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:07.391777 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-990af096-a386-4f82-829d-44c1a5df9749 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 200 len: 1266 microversion: 2.1 time: 0.310379 Aug 24 10:15:07.393204 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 515/973] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:07 2022] GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 1266 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:07.419127 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d607c5b8-2a0d-45ae-89f2-cbfe44634d89 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:07.422256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d607c5b8-2a0d-45ae-89f2-cbfe44634d89 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 38332901-4cb3-4475-90f4-48ad729f16c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:07.437787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d607c5b8-2a0d-45ae-89f2-cbfe44634d89 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:07.439685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d607c5b8-2a0d-45ae-89f2-cbfe44634d89 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:07.441583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d607c5b8-2a0d-45ae-89f2-cbfe44634d89 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:07.442469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d607c5b8-2a0d-45ae-89f2-cbfe44634d89 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:07.444483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d607c5b8-2a0d-45ae-89f2-cbfe44634d89 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:07.445991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d607c5b8-2a0d-45ae-89f2-cbfe44634d89 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:07.894901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7578079a-3b40-49c8-a264-dc548d96d5cc tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "refresh_cache-c285a5a5-ba66-41c8-aa67-402e2d5f9159" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 10:15:07.895788 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7578079a-3b40-49c8-a264-dc548d96d5cc tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquired lock "refresh_cache-c285a5a5-ba66-41c8-aa67-402e2d5f9159" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 10:15:08.771922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:08.854568 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:08.985067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d607c5b8-2a0d-45ae-89f2-cbfe44634d89 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:08.995240 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d607c5b8-2a0d-45ae-89f2-cbfe44634d89 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5" status: 200 len: 1473 microversion: 2.1 time: 1.586550 Aug 24 10:15:09.000179 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 516/974] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:07 2022] GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5 => generated 1473 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:09.009931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-bc3528c6-b77b-477c-90b9-9ab71dd599f0 req-d81e4e42-87bc-44f8-b699-a6b352bbacba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce6709c-548b-4bdc-9667-fa678dbeb477", "name": "network-vif-plugged", "status": "completed", "tag": "a5c8b983-3e85-49ee-93ef-994023d0a43c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:09.034597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bc3528c6-b77b-477c-90b9-9ab71dd599f0 req-d81e4e42-87bc-44f8-b699-a6b352bbacba service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:09.037371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bc3528c6-b77b-477c-90b9-9ab71dd599f0 req-d81e4e42-87bc-44f8-b699-a6b352bbacba service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:09.039417 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bc3528c6-b77b-477c-90b9-9ab71dd599f0 req-d81e4e42-87bc-44f8-b699-a6b352bbacba service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:09.069251 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-bc3528c6-b77b-477c-90b9-9ab71dd599f0 req-d81e4e42-87bc-44f8-b699-a6b352bbacba service nova] Creating event network-vif-plugged:a5c8b983-3e85-49ee-93ef-994023d0a43c for instance fce6709c-548b-4bdc-9667-fa678dbeb477 on n-h1-849328-3 Aug 24 10:15:09.076972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-bc3528c6-b77b-477c-90b9-9ab71dd599f0 req-d81e4e42-87bc-44f8-b699-a6b352bbacba service nova] Instance fce6709c-548b-4bdc-9667-fa678dbeb477 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 10:15:09.095916 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-bc3528c6-b77b-477c-90b9-9ab71dd599f0 req-d81e4e42-87bc-44f8-b699-a6b352bbacba service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093553 Aug 24 10:15:09.096715 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 517/975] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:09.103816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e9d27b30-2ad4-4cfd-aca6-8cf787937d88 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:09.104543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e9d27b30-2ad4-4cfd-aca6-8cf787937d88 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:09.111777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9d27b30-2ad4-4cfd-aca6-8cf787937d88 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:09.112755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9d27b30-2ad4-4cfd-aca6-8cf787937d88 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:09.113383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9d27b30-2ad4-4cfd-aca6-8cf787937d88 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:09.118818 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9d27b30-2ad4-4cfd-aca6-8cf787937d88 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:09.119570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9d27b30-2ad4-4cfd-aca6-8cf787937d88 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:09.120165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9d27b30-2ad4-4cfd-aca6-8cf787937d88 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:09.565780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e9d27b30-2ad4-4cfd-aca6-8cf787937d88 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:09.580398 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e9d27b30-2ad4-4cfd-aca6-8cf787937d88 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1468 microversion: 2.1 time: 0.479951 Aug 24 10:15:09.581056 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 518/976] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:09 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1468 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:09.599078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-28ecb172-3d7c-4f00-8fbe-c5b6e33edc47 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:09.600709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-28ecb172-3d7c-4f00-8fbe-c5b6e33edc47 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:09.609866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28ecb172-3d7c-4f00-8fbe-c5b6e33edc47 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:09.610656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28ecb172-3d7c-4f00-8fbe-c5b6e33edc47 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:09.611274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28ecb172-3d7c-4f00-8fbe-c5b6e33edc47 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:09.612151 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28ecb172-3d7c-4f00-8fbe-c5b6e33edc47 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:09.612963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28ecb172-3d7c-4f00-8fbe-c5b6e33edc47 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:09.613835 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28ecb172-3d7c-4f00-8fbe-c5b6e33edc47 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:10.122493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-28ecb172-3d7c-4f00-8fbe-c5b6e33edc47 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:10.138076 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-28ecb172-3d7c-4f00-8fbe-c5b6e33edc47 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 200 len: 1308 microversion: 2.1 time: 0.555001 Aug 24 10:15:10.143658 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 519/977] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:09 2022] GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 1308 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:10.167517 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d55157d8-f8c8-43c9-aa14-c2d74a47b42e tempest-VolumesAdminNegativeTest-340512969 tempest-VolumesAdminNegativeTest-340512969-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "20450e50-6006-4204-8e7a-53e8a2ef0f5d"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:10.179911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d55157d8-f8c8-43c9-aa14-c2d74a47b42e tempest-VolumesAdminNegativeTest-340512969 tempest-VolumesAdminNegativeTest-340512969-project-admin] [instance: a626b1ea-4968-4e45-b2ab-4c11f06e6f85] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:10.193163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d55157d8-f8c8-43c9-aa14-c2d74a47b42e tempest-VolumesAdminNegativeTest-340512969 tempest-VolumesAdminNegativeTest-340512969-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:10.194190 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d55157d8-f8c8-43c9-aa14-c2d74a47b42e tempest-VolumesAdminNegativeTest-340512969 tempest-VolumesAdminNegativeTest-340512969-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:10.194944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d55157d8-f8c8-43c9-aa14-c2d74a47b42e tempest-VolumesAdminNegativeTest-340512969 tempest-VolumesAdminNegativeTest-340512969-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:10.196256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d55157d8-f8c8-43c9-aa14-c2d74a47b42e tempest-VolumesAdminNegativeTest-340512969 tempest-VolumesAdminNegativeTest-340512969-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:10.197086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d55157d8-f8c8-43c9-aa14-c2d74a47b42e tempest-VolumesAdminNegativeTest-340512969 tempest-VolumesAdminNegativeTest-340512969-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:10.197930 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d55157d8-f8c8-43c9-aa14-c2d74a47b42e tempest-VolumesAdminNegativeTest-340512969 tempest-VolumesAdminNegativeTest-340512969-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:10.416222 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-d55157d8-f8c8-43c9-aa14-c2d74a47b42e tempest-VolumesAdminNegativeTest-340512969 tempest-VolumesAdminNegativeTest-340512969-project-admin] HTTP exception thrown: Volume f08811d7-2fdc-401c-bd5b-6b3b768d0716 could not be found. Aug 24 10:15:10.421196 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d55157d8-f8c8-43c9-aa14-c2d74a47b42e tempest-VolumesAdminNegativeTest-340512969 tempest-VolumesAdminNegativeTest-340512969-project-admin] Request method failure captured: Aug 24 10:15:10.421196 n-d-849328-3 devstack@n-api.service[122433]: request: PUT /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85/os-volume_attachments/f08811d7-2fdc-401c-bd5b-6b3b768d0716 HTTP/1.1 Aug 24 10:15:10.421196 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:15:10.421196 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:15:10.421196 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:15:10.421196 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 74 Aug 24 10:15:10.421196 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:15:10.421196 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:15:10.421196 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:15:10.421196 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:15:10.421196 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfmEbsCfRU_EZQbJ2LxrT6sN4iUV_xwnmnpGMxYAhr772TpiK-wkR7hCm_RhTwJbOFc-5BArV2W7Jt9iPUL8UJw6zXwrQ3dJUNw3yRPXbz8I1fiBbSzm5_ZHzPyeWrAaaFec3fatIPjFETK2inZq7A2YQ5jH9ixaDfG52U75qJSQnMw Aug 24 10:15:10.421196 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:15:10.421196 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:15:10.421196 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:15:10.421196 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:15:10.421196 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:15:10.421196 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:15:10.421196 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: f1e57f6a0bed4acbafd6f6ff6b6edf93 Aug 24 10:15:10.421196 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-VolumesAdminNegativeTest-340512969 Aug 24 10:15:10.421196 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:15:10.421196 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:15:10.424188 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f1e57f6a0bed4acbafd6f6ff6b6edf93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f1e57f6a0bed4acbafd6f6ff6b6edf93", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f1e57f6a0bed4acbafd6f6ff6b6edf93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f1e57f6a0bed4acbafd6f6ff6b6edf93"}]}] Aug 24 10:15:10.424188 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-VolumesAdminNegativeTest-340512969 Aug 24 10:15:10.424188 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: f1e57f6a0bed4acbafd6f6ff6b6edf93 Aug 24 10:15:10.424188 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-340512969 Aug 24 10:15:10.424188 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-VolumesAdminNegativeTest-340512969-project-admin Aug 24 10:15:10.424188 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:15:10.424188 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:15:10.424188 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: e4b55230cd4f44af9e20fcb5a6dcc639 Aug 24 10:15:10.424188 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-VolumesAdminNegativeTest-340512969-project-admin Aug 24 10:15:10.424188 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:15:10.424188 n-d-849328-3 devstack@n-api.service[122433]: {"volumeAttachment": {"volumeId": "20450e50-6006-4204-8e7a-53e8a2ef0f5d"}} Aug 24 10:15:10.424188 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:15:10.424188 n-d-849328-3 devstack@n-api.service[122433]: exception: Volume f08811d7-2fdc-401c-bd5b-6b3b768d0716 could not be found. Aug 24 10:15:10.425960 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'server_id': 'a626b1ea-4968-4e45-b2ab-4c11f06e6f85', 'id': 'f08811d7-2fdc-401c-bd5b-6b3b768d0716', 'body': {'volumeAttachment': {'volumeId': '20450e50-6006-4204-8e7a-53e8a2ef0f5d'}}} Aug 24 10:15:10.425960 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:15:10.425960 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:10.425960 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:15:10.425960 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:15:10.425960 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 10:15:10.425960 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 10:15:10.425960 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 10:15:10.425960 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 10:15:10.425960 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:15:10.425960 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:15:10.425960 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:15:10.425960 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:15:10.425960 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:15:10.425960 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:15:10.425960 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:15:10.425960 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:15:10.428249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f08811d7-2fdc-401c-bd5b-6b3b768d0716 could not be found. (HTTP 404) (Request-ID: req-06e53e0a-c751-4ee1-a437-2b6a740b6dad) Aug 24 10:15:10.428249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:10.428249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:15:10.428249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:10.428249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:10.428249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 24 10:15:10.428249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 24 10:15:10.428249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 10:15:10.428249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 10:15:10.428249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 10:15:10.428249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 10:15:10.428249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 10:15:10.428249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 10:15:10.428249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:15:10.428249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:15:10.428249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 10:15:10.428249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 10:15:10.428249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 10:15:10.428249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 10:15:10.431191 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:15:10.431191 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:15:10.431191 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:15:10.431191 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:15:10.431191 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:15:10.431191 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:15:10.431191 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:15:10.431191 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:15:10.431191 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f08811d7-2fdc-401c-bd5b-6b3b768d0716 could not be found. Aug 24 10:15:10.431191 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:10.431191 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:15:10.431191 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:10.431191 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:10.431191 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:15:10.431191 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:15:10.431191 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:15:10.431191 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:15:10.431191 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:15:10.431191 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:15:10.435915 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:15:10.435915 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:15:10.435915 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:15:10.435915 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:15:10.435915 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 24 10:15:10.435915 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 24 10:15:10.435915 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 24 10:15:10.435915 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:15:10.435915 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f08811d7-2fdc-401c-bd5b-6b3b768d0716 could not be found. Aug 24 10:15:10.435915 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:10.435915 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:15:10.435915 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:10.435915 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:10.435915 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:15:10.435915 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:15:10.435915 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:15:10.435915 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:15:10.435915 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f08811d7-2fdc-401c-bd5b-6b3b768d0716 could not be found. Aug 24 10:15:10.435915 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:10.442181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d55157d8-f8c8-43c9-aa14-c2d74a47b42e tempest-VolumesAdminNegativeTest-340512969 tempest-VolumesAdminNegativeTest-340512969-project-admin] Returning 404 to user: Volume f08811d7-2fdc-401c-bd5b-6b3b768d0716 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:15:10.447451 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d55157d8-f8c8-43c9-aa14-c2d74a47b42e tempest-VolumesAdminNegativeTest-340512969 tempest-VolumesAdminNegativeTest-340512969-project-admin] 10.222.0.85 "PUT /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85/os-volume_attachments/f08811d7-2fdc-401c-bd5b-6b3b768d0716" status: 404 len: 109 microversion: 2.1 time: 0.299316 Aug 24 10:15:10.461285 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 520/978] 10.222.0.85 () {60 vars in 1433 bytes} [Wed Aug 24 10:15:10 2022] PUT /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85/os-volume_attachments/f08811d7-2fdc-401c-bd5b-6b3b768d0716 => generated 109 bytes in 316 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:15:10.501300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0b2263fe-3aa1-483f-a94f-1040044fc969 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:10.509627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0b2263fe-3aa1-483f-a94f-1040044fc969 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 38332901-4cb3-4475-90f4-48ad729f16c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:10.532757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b2263fe-3aa1-483f-a94f-1040044fc969 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:10.542274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b2263fe-3aa1-483f-a94f-1040044fc969 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:10.543280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b2263fe-3aa1-483f-a94f-1040044fc969 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:10.557605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b2263fe-3aa1-483f-a94f-1040044fc969 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:10.558543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b2263fe-3aa1-483f-a94f-1040044fc969 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:10.561004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b2263fe-3aa1-483f-a94f-1040044fc969 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:10.976246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-7578079a-3b40-49c8-a264-dc548d96d5cc tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Building network info cache for instance {{(pid=122432) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 10:15:11.145036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0b2263fe-3aa1-483f-a94f-1040044fc969 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:11.164510 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0b2263fe-3aa1-483f-a94f-1040044fc969 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5" status: 200 len: 1431 microversion: 2.1 time: 0.699206 Aug 24 10:15:11.165167 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 521/979] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:10 2022] GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5 => generated 1431 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:11.200416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d6c5060f-e371-483f-8056-9e68ae962681 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:11.201039 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d6c5060f-e371-483f-8056-9e68ae962681 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:11.225448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6c5060f-e371-483f-8056-9e68ae962681 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:11.225949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6c5060f-e371-483f-8056-9e68ae962681 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:11.226597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6c5060f-e371-483f-8056-9e68ae962681 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:11.227308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6c5060f-e371-483f-8056-9e68ae962681 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:11.228543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6c5060f-e371-483f-8056-9e68ae962681 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:11.230077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6c5060f-e371-483f-8056-9e68ae962681 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:11.686959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d6c5060f-e371-483f-8056-9e68ae962681 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:11.729748 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d6c5060f-e371-483f-8056-9e68ae962681 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1468 microversion: 2.1 time: 0.537794 Aug 24 10:15:11.730790 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 522/980] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:11 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1468 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:11.760181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-77eff7b2-5bac-4630-8c5b-91289109a7fc req-bb0c1960-320a-4c34-a9c6-e01cd462ba37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38332901-4cb3-4475-90f4-48ad729f16c5", "name": "network-vif-deleted", "tag": "d35c6350-b269-46fa-838a-6e7220b41d64"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:11.799334 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-77eff7b2-5bac-4630-8c5b-91289109a7fc req-bb0c1960-320a-4c34-a9c6-e01cd462ba37 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:11.803779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-77eff7b2-5bac-4630-8c5b-91289109a7fc req-bb0c1960-320a-4c34-a9c6-e01cd462ba37 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:11.806834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-77eff7b2-5bac-4630-8c5b-91289109a7fc req-bb0c1960-320a-4c34-a9c6-e01cd462ba37 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:11.869930 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-77eff7b2-5bac-4630-8c5b-91289109a7fc req-bb0c1960-320a-4c34-a9c6-e01cd462ba37 service nova] Creating event network-vif-deleted:d35c6350-b269-46fa-838a-6e7220b41d64 for instance 38332901-4cb3-4475-90f4-48ad729f16c5 on n-h2-849328-3 Aug 24 10:15:11.899076 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-77eff7b2-5bac-4630-8c5b-91289109a7fc req-bb0c1960-320a-4c34-a9c6-e01cd462ba37 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163425 Aug 24 10:15:11.904530 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 523/981] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:11.954047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-7037e7ab-7636-49a0-9b22-24bd6f71cd68 req-b0c81229-5192-4655-bec5-97945920ad75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c285a5a5-ba66-41c8-aa67-402e2d5f9159", "tag": "ad70c32a-b650-4c05-bd90-a010a57fd42f"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:12.006917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7037e7ab-7636-49a0-9b22-24bd6f71cd68 req-b0c81229-5192-4655-bec5-97945920ad75 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:12.008207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7037e7ab-7636-49a0-9b22-24bd6f71cd68 req-b0c81229-5192-4655-bec5-97945920ad75 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:12.013099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7037e7ab-7636-49a0-9b22-24bd6f71cd68 req-b0c81229-5192-4655-bec5-97945920ad75 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:12.060043 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-7037e7ab-7636-49a0-9b22-24bd6f71cd68 req-b0c81229-5192-4655-bec5-97945920ad75 service nova] Creating event network-changed:ad70c32a-b650-4c05-bd90-a010a57fd42f for instance c285a5a5-ba66-41c8-aa67-402e2d5f9159 on n-h1-849328-3 Aug 24 10:15:12.090149 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-7037e7ab-7636-49a0-9b22-24bd6f71cd68 req-b0c81229-5192-4655-bec5-97945920ad75 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173181 Aug 24 10:15:12.094845 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 524/982] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:12.106822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dc4be595-1eb8-42e6-96f9-31e181bc41c2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:12.109362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dc4be595-1eb8-42e6-96f9-31e181bc41c2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:12.126502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc4be595-1eb8-42e6-96f9-31e181bc41c2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:12.127743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc4be595-1eb8-42e6-96f9-31e181bc41c2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:12.128898 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc4be595-1eb8-42e6-96f9-31e181bc41c2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:12.130423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc4be595-1eb8-42e6-96f9-31e181bc41c2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:12.131632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc4be595-1eb8-42e6-96f9-31e181bc41c2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:12.132550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc4be595-1eb8-42e6-96f9-31e181bc41c2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:12.436440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-7578079a-3b40-49c8-a264-dc548d96d5cc tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Updating instance_info_cache with network_info: [{"id": "ad70c32a-b650-4c05-bd90-a010a57fd42f", "address": "fa:16:3e:a8:d4:28", "network": {"id": "6a3a952d-cb92-48d6-ae25-c71db979b739", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1149866647-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "67b25f29b4a141f4b45518dba7332c3c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapad70c32a-b6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122432) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 10:15:12.454444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7578079a-3b40-49c8-a264-dc548d96d5cc tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Releasing lock "refresh_cache-c285a5a5-ba66-41c8-aa67-402e2d5f9159" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 10:15:12.457339 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7578079a-3b40-49c8-a264-dc548d96d5cc tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "POST /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159/action" status: 202 len: 0 microversion: 2.1 time: 6.444776 Aug 24 10:15:12.464553 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 459/983] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:15:06 2022] POST /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159/action => generated 0 bytes in 6453 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 24 10:15:12.471414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5553e173-380d-4e46-92fb-d74db2dad489 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:12.472586 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5553e173-380d-4e46-92fb-d74db2dad489 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 38332901-4cb3-4475-90f4-48ad729f16c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:12.498145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:12.501312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5553e173-380d-4e46-92fb-d74db2dad489 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:12.502971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5553e173-380d-4e46-92fb-d74db2dad489 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:12.503443 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5553e173-380d-4e46-92fb-d74db2dad489 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:12.504267 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5553e173-380d-4e46-92fb-d74db2dad489 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:12.504729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5553e173-380d-4e46-92fb-d74db2dad489 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:12.505180 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5553e173-380d-4e46-92fb-d74db2dad489 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:12.587440 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-5553e173-380d-4e46-92fb-d74db2dad489 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] HTTP exception thrown: Instance 38332901-4cb3-4475-90f4-48ad729f16c5 could not be found. Aug 24 10:15:12.606793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5553e173-380d-4e46-92fb-d74db2dad489 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Request method failure captured: Aug 24 10:15:12.606793 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5 HTTP/1.1 Aug 24 10:15:12.606793 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:15:12.606793 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:15:12.606793 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:15:12.606793 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:15:12.606793 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:15:12.606793 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:15:12.606793 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:15:12.606793 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:15:12.606793 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBflp1lR6NJiOvJ0jo0u_ObCwr-XT9ZPDd8UFdAdrktIeq9W3st8_Vr__ObGPpyUD3B1sX780QVeUxsP7WLsIfoEmJ6ZRyy4XuEoKUiYvCKqPo1TBHvl0EjfZLY21G0cKkNvRwmjK2bcnCfVvvo4RO0l6RUsKYrhQXpLAAKVAYjdEZcw Aug 24 10:15:12.606793 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:15:12.606793 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:15:12.606793 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:15:12.606793 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:15:12.606793 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:15:12.606793 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:15:12.606793 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: f2e2ee3e278042a5bf8ee7348966a468 Aug 24 10:15:12.606793 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersOnMultiNodesTest-1510468885 Aug 24 10:15:12.606793 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:15:12.606793 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:15:12.608333 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f2e2ee3e278042a5bf8ee7348966a468"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f2e2ee3e278042a5bf8ee7348966a468", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f2e2ee3e278042a5bf8ee7348966a468"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f2e2ee3e278042a5bf8ee7348966a468"}]}] Aug 24 10:15:12.608333 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersOnMultiNodesTest-1510468885 Aug 24 10:15:12.608333 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: f2e2ee3e278042a5bf8ee7348966a468 Aug 24 10:15:12.608333 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1510468885 Aug 24 10:15:12.608333 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersOnMultiNodesTest-1510468885-project Aug 24 10:15:12.608333 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:15:12.608333 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:15:12.608333 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: bf03c0eb5bd748ae85be830f1121dc06 Aug 24 10:15:12.608333 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersOnMultiNodesTest-1510468885-project Aug 24 10:15:12.608333 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:15:12.608333 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 38332901-4cb3-4475-90f4-48ad729f16c5 could not be found. Aug 24 10:15:12.608333 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '38332901-4cb3-4475-90f4-48ad729f16c5'} Aug 24 10:15:12.609099 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:15:12.609099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:12.609099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:15:12.609099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:15:12.609099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:15:12.609099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:15:12.609099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:15:12.609099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:15:12.609099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:15:12.609099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:15:12.609099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38332901-4cb3-4475-90f4-48ad729f16c5 could not be found. Aug 24 10:15:12.609099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:12.609099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:15:12.609099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:12.609099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:12.609099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:15:12.609099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:15:12.609099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:15:12.609099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:15:12.609099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:15:12.610356 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:15:12.610356 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:15:12.610356 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:15:12.610356 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:15:12.610356 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:15:12.610356 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:15:12.610356 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:15:12.610356 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38332901-4cb3-4475-90f4-48ad729f16c5 could not be found. Aug 24 10:15:12.610356 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:12.610356 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:15:12.610356 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:12.610356 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:12.610356 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:15:12.610356 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:15:12.610356 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:15:12.610356 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:15:12.610356 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38332901-4cb3-4475-90f4-48ad729f16c5 could not be found. Aug 24 10:15:12.610356 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:12.612110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5553e173-380d-4e46-92fb-d74db2dad489 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Returning 404 to user: Instance 38332901-4cb3-4475-90f4-48ad729f16c5 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:15:12.613609 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5553e173-380d-4e46-92fb-d74db2dad489 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5" status: 404 len: 111 microversion: 2.1 time: 0.147243 Aug 24 10:15:12.618250 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 460/984] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:12 2022] GET /compute/v2.1/servers/38332901-4cb3-4475-90f4-48ad729f16c5 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:15:12.667663 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8c61b79a-d4d7-425d-9417-941d1a804f42 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:12.674393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8c61b79a-d4d7-425d-9417-941d1a804f42 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: 293f4b0e-a839-48f3-a510-4b4e320ebf59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:12.709889 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c61b79a-d4d7-425d-9417-941d1a804f42 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:12.713028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c61b79a-d4d7-425d-9417-941d1a804f42 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:12.715596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c61b79a-d4d7-425d-9417-941d1a804f42 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:12.716634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c61b79a-d4d7-425d-9417-941d1a804f42 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:12.717982 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c61b79a-d4d7-425d-9417-941d1a804f42 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:12.719269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c61b79a-d4d7-425d-9417-941d1a804f42 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:12.769845 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-8c61b79a-d4d7-425d-9417-941d1a804f42 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] HTTP exception thrown: Instance 293f4b0e-a839-48f3-a510-4b4e320ebf59 could not be found. Aug 24 10:15:12.773386 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8c61b79a-d4d7-425d-9417-941d1a804f42 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Request method failure captured: Aug 24 10:15:12.773386 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59 HTTP/1.1 Aug 24 10:15:12.773386 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:15:12.773386 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:15:12.773386 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:15:12.773386 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:15:12.773386 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:15:12.773386 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:15:12.773386 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:15:12.773386 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:15:12.773386 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfm5kJ5FWnTs7P0zxeBGgL-wu3qC0mwWDuhEjFAghmyC5iKxoD4sp6B2oYcYmhNFNK7poQ5uBIlMPzvMjZLBDszbLIdfBFyKswV2Ahy49qc_Y5M2676Q6uAHbqMfpdtrG9t2VO18rXqqhwoQW-fSPlMv586r9CHLGHUZ80QFfmOHhBo Aug 24 10:15:12.773386 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:15:12.773386 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:15:12.773386 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:15:12.773386 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:15:12.773386 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:15:12.773386 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:15:12.773386 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 67b25f29b4a141f4b45518dba7332c3c Aug 24 10:15:12.773386 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-224357164 Aug 24 10:15:12.773386 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:15:12.773386 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:15:12.775126 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/67b25f29b4a141f4b45518dba7332c3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_67b25f29b4a141f4b45518dba7332c3c", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/67b25f29b4a141f4b45518dba7332c3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/67b25f29b4a141f4b45518dba7332c3c"}]}] Aug 24 10:15:12.775126 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-224357164 Aug 24 10:15:12.775126 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 67b25f29b4a141f4b45518dba7332c3c Aug 24 10:15:12.775126 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-224357164 Aug 24 10:15:12.775126 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-FloatingIPsAssociationTestJSON-224357164-project Aug 24 10:15:12.775126 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:15:12.775126 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:15:12.775126 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: c969980c07dd44b49d7ef299858fe109 Aug 24 10:15:12.775126 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-224357164-project Aug 24 10:15:12.775126 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:15:12.775126 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 293f4b0e-a839-48f3-a510-4b4e320ebf59 could not be found. Aug 24 10:15:12.775126 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '293f4b0e-a839-48f3-a510-4b4e320ebf59'} Aug 24 10:15:12.776332 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:15:12.776332 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:12.776332 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:15:12.776332 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:15:12.776332 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:15:12.776332 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:15:12.776332 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:15:12.776332 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:15:12.776332 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:15:12.776332 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:15:12.776332 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 293f4b0e-a839-48f3-a510-4b4e320ebf59 could not be found. Aug 24 10:15:12.776332 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:12.776332 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:15:12.776332 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:12.776332 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:12.776332 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:15:12.776332 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:15:12.776332 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:15:12.776332 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:15:12.776332 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:15:12.777892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:15:12.777892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:15:12.777892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:15:12.777892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:15:12.777892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:15:12.777892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:15:12.777892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:15:12.777892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:15:12.777892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:15:12.777892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 293f4b0e-a839-48f3-a510-4b4e320ebf59 could not be found. Aug 24 10:15:12.777892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:12.777892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:15:12.777892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:12.777892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:12.777892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:15:12.777892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:15:12.777892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:15:12.777892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:15:12.777892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 293f4b0e-a839-48f3-a510-4b4e320ebf59 could not be found. Aug 24 10:15:12.777892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:12.780720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8c61b79a-d4d7-425d-9417-941d1a804f42 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Returning 404 to user: Instance 293f4b0e-a839-48f3-a510-4b4e320ebf59 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:15:12.782160 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8c61b79a-d4d7-425d-9417-941d1a804f42 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "DELETE /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59" status: 404 len: 111 microversion: 2.1 time: 0.162275 Aug 24 10:15:12.790306 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 461/985] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:15:12 2022] DELETE /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:15:12.804590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-28408e24-ad6d-44ec-9da1-cca6c3317144 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:12.807532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-28408e24-ad6d-44ec-9da1-cca6c3317144 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 1d8befca-2013-4597-a7e7-e12100a340db] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:12.823868 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28408e24-ad6d-44ec-9da1-cca6c3317144 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:12.824734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28408e24-ad6d-44ec-9da1-cca6c3317144 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:12.829962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28408e24-ad6d-44ec-9da1-cca6c3317144 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:12.831730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28408e24-ad6d-44ec-9da1-cca6c3317144 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:12.832377 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28408e24-ad6d-44ec-9da1-cca6c3317144 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:12.832958 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28408e24-ad6d-44ec-9da1-cca6c3317144 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:12.895916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-28408e24-ad6d-44ec-9da1-cca6c3317144 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 1d8befca-2013-4597-a7e7-e12100a340db] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:15:13.058196 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-28408e24-ad6d-44ec-9da1-cca6c3317144 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "DELETE /compute/v2.1/servers/1d8befca-2013-4597-a7e7-e12100a340db" status: 204 len: 0 microversion: 2.1 time: 0.261842 Aug 24 10:15:13.058929 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 462/986] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:15:12 2022] DELETE /compute/v2.1/servers/1d8befca-2013-4597-a7e7-e12100a340db => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:15:13.067160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-34c27842-7968-4f38-b8f5-17f305b924a7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:13.070789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-34c27842-7968-4f38-b8f5-17f305b924a7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:13.098984 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34c27842-7968-4f38-b8f5-17f305b924a7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:13.100070 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34c27842-7968-4f38-b8f5-17f305b924a7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:13.102663 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34c27842-7968-4f38-b8f5-17f305b924a7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:13.103724 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34c27842-7968-4f38-b8f5-17f305b924a7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:13.107803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34c27842-7968-4f38-b8f5-17f305b924a7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:13.108549 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34c27842-7968-4f38-b8f5-17f305b924a7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:13.352768 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-34c27842-7968-4f38-b8f5-17f305b924a7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:13.363814 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-34c27842-7968-4f38-b8f5-17f305b924a7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1460 microversion: 2.1 time: 0.301459 Aug 24 10:15:13.364584 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 463/987] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:13 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1460 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:13.370357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8ab101da-7693-4965-8c18-bc19b9b3e2be tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:13.371108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8ab101da-7693-4965-8c18-bc19b9b3e2be tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: 293f4b0e-a839-48f3-a510-4b4e320ebf59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:13.377776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ab101da-7693-4965-8c18-bc19b9b3e2be tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:13.378578 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ab101da-7693-4965-8c18-bc19b9b3e2be tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:13.379315 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ab101da-7693-4965-8c18-bc19b9b3e2be tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:13.380145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ab101da-7693-4965-8c18-bc19b9b3e2be tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:13.380712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ab101da-7693-4965-8c18-bc19b9b3e2be tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:13.381321 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ab101da-7693-4965-8c18-bc19b9b3e2be tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:13.410911 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-8ab101da-7693-4965-8c18-bc19b9b3e2be tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] HTTP exception thrown: Instance 293f4b0e-a839-48f3-a510-4b4e320ebf59 could not be found. Aug 24 10:15:13.414820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8ab101da-7693-4965-8c18-bc19b9b3e2be tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Request method failure captured: Aug 24 10:15:13.414820 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59 HTTP/1.1 Aug 24 10:15:13.414820 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:15:13.414820 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:15:13.414820 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:15:13.414820 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:15:13.414820 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:15:13.414820 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:15:13.414820 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:15:13.414820 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:15:13.414820 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfm5kJ5FWnTs7P0zxeBGgL-wu3qC0mwWDuhEjFAghmyC5iKxoD4sp6B2oYcYmhNFNK7poQ5uBIlMPzvMjZLBDszbLIdfBFyKswV2Ahy49qc_Y5M2676Q6uAHbqMfpdtrG9t2VO18rXqqhwoQW-fSPlMv586r9CHLGHUZ80QFfmOHhBo Aug 24 10:15:13.414820 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:15:13.414820 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:15:13.414820 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:15:13.414820 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:15:13.414820 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:15:13.414820 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:15:13.414820 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 67b25f29b4a141f4b45518dba7332c3c Aug 24 10:15:13.414820 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-224357164 Aug 24 10:15:13.414820 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:15:13.414820 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:15:13.416655 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/67b25f29b4a141f4b45518dba7332c3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_67b25f29b4a141f4b45518dba7332c3c", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/67b25f29b4a141f4b45518dba7332c3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/67b25f29b4a141f4b45518dba7332c3c"}]}] Aug 24 10:15:13.416655 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-224357164 Aug 24 10:15:13.416655 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 67b25f29b4a141f4b45518dba7332c3c Aug 24 10:15:13.416655 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-224357164 Aug 24 10:15:13.416655 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-FloatingIPsAssociationTestJSON-224357164-project Aug 24 10:15:13.416655 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:15:13.416655 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:15:13.416655 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: c969980c07dd44b49d7ef299858fe109 Aug 24 10:15:13.416655 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-224357164-project Aug 24 10:15:13.416655 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:15:13.416655 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 293f4b0e-a839-48f3-a510-4b4e320ebf59 could not be found. Aug 24 10:15:13.416655 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '293f4b0e-a839-48f3-a510-4b4e320ebf59'} Aug 24 10:15:13.417580 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:15:13.417580 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:13.417580 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:15:13.417580 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:15:13.417580 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:15:13.417580 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:15:13.417580 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:15:13.417580 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:15:13.417580 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:15:13.417580 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:15:13.417580 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 293f4b0e-a839-48f3-a510-4b4e320ebf59 could not be found. Aug 24 10:15:13.417580 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:13.417580 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:15:13.417580 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:13.417580 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:13.417580 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:15:13.417580 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:15:13.417580 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:15:13.417580 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:15:13.417580 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:15:13.420814 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:15:13.420814 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:15:13.420814 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:15:13.420814 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:15:13.420814 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:15:13.420814 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:15:13.420814 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:15:13.420814 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 293f4b0e-a839-48f3-a510-4b4e320ebf59 could not be found. Aug 24 10:15:13.420814 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:13.420814 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:15:13.420814 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:13.420814 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:13.420814 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:15:13.420814 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:15:13.420814 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:15:13.420814 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:15:13.420814 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 293f4b0e-a839-48f3-a510-4b4e320ebf59 could not be found. Aug 24 10:15:13.420814 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:13.421953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dc4be595-1eb8-42e6-96f9-31e181bc41c2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:13.426202 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8ab101da-7693-4965-8c18-bc19b9b3e2be tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Returning 404 to user: Instance 293f4b0e-a839-48f3-a510-4b4e320ebf59 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:15:13.428065 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8ab101da-7693-4965-8c18-bc19b9b3e2be tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59" status: 404 len: 111 microversion: 2.1 time: 0.062306 Aug 24 10:15:13.429283 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 464/988] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:13 2022] GET /compute/v2.1/servers/293f4b0e-a839-48f3-a510-4b4e320ebf59 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:15:13.434224 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dc4be595-1eb8-42e6-96f9-31e181bc41c2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 200 len: 1308 microversion: 2.1 time: 1.336913 Aug 24 10:15:13.437861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3a939eec-fff3-4b14-a863-a2f5a47f9a77 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:13.439055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3a939eec-fff3-4b14-a863-a2f5a47f9a77 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 322e4dd7-c596-41d1-94a4-7bdd711f3ebf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:13.446882 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a939eec-fff3-4b14-a863-a2f5a47f9a77 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:13.447966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a939eec-fff3-4b14-a863-a2f5a47f9a77 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:13.448441 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 525/989] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:12 2022] GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 1308 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:13.448621 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a939eec-fff3-4b14-a863-a2f5a47f9a77 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:13.449585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a939eec-fff3-4b14-a863-a2f5a47f9a77 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:13.450380 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a939eec-fff3-4b14-a863-a2f5a47f9a77 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:13.450912 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a939eec-fff3-4b14-a863-a2f5a47f9a77 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:13.453799 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-06b52122-3474-48da-b3c8-a050310689ea tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:13.454408 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-06b52122-3474-48da-b3c8-a050310689ea tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:13.470922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06b52122-3474-48da-b3c8-a050310689ea tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:13.471712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06b52122-3474-48da-b3c8-a050310689ea tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:13.472163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06b52122-3474-48da-b3c8-a050310689ea tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:13.472899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06b52122-3474-48da-b3c8-a050310689ea tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:13.473403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06b52122-3474-48da-b3c8-a050310689ea tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:13.473840 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06b52122-3474-48da-b3c8-a050310689ea tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:13.519081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3a939eec-fff3-4b14-a863-a2f5a47f9a77 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 322e4dd7-c596-41d1-94a4-7bdd711f3ebf] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:15:13.720772 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3a939eec-fff3-4b14-a863-a2f5a47f9a77 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "DELETE /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf" status: 204 len: 0 microversion: 2.1 time: 0.289869 Aug 24 10:15:13.725496 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 465/990] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:15:13 2022] DELETE /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:15:13.740518 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-008120aa-7c59-486d-bfb2-1ed298bb2969 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '.version_select at 0x7f4655074ca0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:14.126302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-06b52122-3474-48da-b3c8-a050310689ea tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:14.139306 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-06b52122-3474-48da-b3c8-a050310689ea tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1460 microversion: 2.1 time: 0.689489 Aug 24 10:15:14.146136 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 526/991] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:13 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1460 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:14.154882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f2e63570-a6e8-41d1-a60e-178b204cbc39 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:14.159125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f2e63570-a6e8-41d1-a60e-178b204cbc39 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:14.191671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2e63570-a6e8-41d1-a60e-178b204cbc39 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:14.216308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2e63570-a6e8-41d1-a60e-178b204cbc39 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:14.242137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2e63570-a6e8-41d1-a60e-178b204cbc39 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.046s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:14.245360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2e63570-a6e8-41d1-a60e-178b204cbc39 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:14.245972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2e63570-a6e8-41d1-a60e-178b204cbc39 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:14.254332 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2e63570-a6e8-41d1-a60e-178b204cbc39 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:14.999881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-f2e63570-a6e8-41d1-a60e-178b204cbc39 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lazy-loading 'services' on Instance uuid 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:15:15.024090 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f2e63570-a6e8-41d1-a60e-178b204cbc39 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 2421 microversion: 2.25 time: 0.875708 Aug 24 10:15:15.024896 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 527/992] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:15:14 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 2421 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:15:15.030604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9c3b54b4-7fbe-4227-b32b-e0b4724e40be tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:15.031515 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9c3b54b4-7fbe-4227-b32b-e0b4724e40be tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 1d8befca-2013-4597-a7e7-e12100a340db] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:15.045901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c3b54b4-7fbe-4227-b32b-e0b4724e40be tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:15.047385 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c3b54b4-7fbe-4227-b32b-e0b4724e40be tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:15.048363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c3b54b4-7fbe-4227-b32b-e0b4724e40be tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:15.050032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c3b54b4-7fbe-4227-b32b-e0b4724e40be tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:15.051191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c3b54b4-7fbe-4227-b32b-e0b4724e40be tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:15.052178 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c3b54b4-7fbe-4227-b32b-e0b4724e40be tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:16.407697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9c3b54b4-7fbe-4227-b32b-e0b4724e40be tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:16.429969 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9c3b54b4-7fbe-4227-b32b-e0b4724e40be tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/1d8befca-2013-4597-a7e7-e12100a340db" status: 200 len: 1474 microversion: 2.1 time: 1.403400 Aug 24 10:15:16.435494 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 528/993] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:15 2022] GET /compute/v2.1/servers/1d8befca-2013-4597-a7e7-e12100a340db => generated 1474 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:16.451619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9bb3c68d-3640-42d3-a552-8ec6bafec94e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Action: 'create', calling method: .version_select at 0x7f4654f8e3a0>, body: {"keypair": {"name": "tempest-keypair-2099809665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE11GkscETjH9vnL2sMIBmlEa5zEzNJfI9dTkIz/l4O3BIL5syj3g+vqU1w8Rv7QG7eOnsNsDA+0s2enCaINWj7wka1YXL2yHldUe0Y+FXP2SUvIbuJtlrYu/GU7Y12P/g=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:16.485696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-9bb3c68d-3640-42d3-a552-8ec6bafec94e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Getting quotas for project 7947a063a37946b7870e95dfd7a2e7e6. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:15:16.493727 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-9bb3c68d-3640-42d3-a552-8ec6bafec94e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Getting quotas for user 53af167c0c744cbb910ff5860767cb95 and project 7947a063a37946b7870e95dfd7a2e7e6. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:15:16.531430 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9bb3c68d-3640-42d3-a552-8ec6bafec94e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.091893 Aug 24 10:15:16.532758 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 529/994] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:15:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:16.547056 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c57ed8f2-8f73-4b3e-99d8-e4b2d9fd3e43 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:16.548102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c57ed8f2-8f73-4b3e-99d8-e4b2d9fd3e43 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:16.562061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57ed8f2-8f73-4b3e-99d8-e4b2d9fd3e43 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:16.564158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57ed8f2-8f73-4b3e-99d8-e4b2d9fd3e43 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:16.566660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57ed8f2-8f73-4b3e-99d8-e4b2d9fd3e43 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:16.567707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57ed8f2-8f73-4b3e-99d8-e4b2d9fd3e43 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:16.570564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57ed8f2-8f73-4b3e-99d8-e4b2d9fd3e43 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:16.571274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57ed8f2-8f73-4b3e-99d8-e4b2d9fd3e43 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:17.039431 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-008120aa-7c59-486d-bfb2-1ed298bb2969 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "DELETE /compute/v2.1/os-floating-ips/42ba4717-f87e-43f3-a3ef-3d9d04302d1a" status: 202 len: 0 microversion: 2.1 time: 3.310306 Aug 24 10:15:17.043710 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 466/995] 10.222.0.85 () {58 vars in 1263 bytes} [Wed Aug 24 10:15:13 2022] DELETE /compute/v2.1/os-floating-ips/42ba4717-f87e-43f3-a3ef-3d9d04302d1a => generated 0 bytes in 3316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:15:17.062307 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-8fe76865-b427-4fb9-8c06-7fcbe31efed8 req-c39e5771-78c6-4421-942e-a58cc6f84bee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1ebe6bd-b2ae-45c2-8752-314356143de9", "tag": "44b58631-8033-4518-911c-3c45f71ea4a5"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:17.089425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8fe76865-b427-4fb9-8c06-7fcbe31efed8 req-c39e5771-78c6-4421-942e-a58cc6f84bee service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:17.090392 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8fe76865-b427-4fb9-8c06-7fcbe31efed8 req-c39e5771-78c6-4421-942e-a58cc6f84bee service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:17.091379 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8fe76865-b427-4fb9-8c06-7fcbe31efed8 req-c39e5771-78c6-4421-942e-a58cc6f84bee service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:17.122981 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-8fe76865-b427-4fb9-8c06-7fcbe31efed8 req-c39e5771-78c6-4421-942e-a58cc6f84bee service nova] Creating event network-changed:44b58631-8033-4518-911c-3c45f71ea4a5 for instance a1ebe6bd-b2ae-45c2-8752-314356143de9 on n-h1-849328-3 Aug 24 10:15:17.130056 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-8fe76865-b427-4fb9-8c06-7fcbe31efed8 req-c39e5771-78c6-4421-942e-a58cc6f84bee service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081004 Aug 24 10:15:17.132375 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 467/996] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:17.145531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0c203d05-59e7-40c2-a191-84939418bb95 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-849328-3", "block_migration": "auto"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:17.162171 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0c203d05-59e7-40c2-a191-84939418bb95 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:17.176543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c203d05-59e7-40c2-a191-84939418bb95 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:17.177728 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c203d05-59e7-40c2-a191-84939418bb95 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:17.178871 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c203d05-59e7-40c2-a191-84939418bb95 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:17.179934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c203d05-59e7-40c2-a191-84939418bb95 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:17.180652 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c203d05-59e7-40c2-a191-84939418bb95 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:17.182619 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c203d05-59e7-40c2-a191-84939418bb95 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:17.255760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-0c203d05-59e7-40c2-a191-84939418bb95 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lazy-loading 'flavor' on Instance uuid 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:15:17.276327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0c203d05-59e7-40c2-a191-84939418bb95 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Going to try to live migrate instance to n-h2-849328-3 {{(pid=122432) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 10:15:18.299401 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c57ed8f2-8f73-4b3e-99d8-e4b2d9fd3e43 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:18.313849 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c57ed8f2-8f73-4b3e-99d8-e4b2d9fd3e43 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 200 len: 1308 microversion: 2.1 time: 1.778121 Aug 24 10:15:18.316448 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 530/997] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:16 2022] GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 1308 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:18.330393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b17d6e8e-7308-48a0-85b0-8b39ccee5e3e tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:18.331307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b17d6e8e-7308-48a0-85b0-8b39ccee5e3e tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: a626b1ea-4968-4e45-b2ab-4c11f06e6f85] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:18.338493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b17d6e8e-7308-48a0-85b0-8b39ccee5e3e tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:18.339716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b17d6e8e-7308-48a0-85b0-8b39ccee5e3e tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:18.340162 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b17d6e8e-7308-48a0-85b0-8b39ccee5e3e tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:18.341320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b17d6e8e-7308-48a0-85b0-8b39ccee5e3e tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:18.342062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b17d6e8e-7308-48a0-85b0-8b39ccee5e3e tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:18.342801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b17d6e8e-7308-48a0-85b0-8b39ccee5e3e tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:18.382810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b17d6e8e-7308-48a0-85b0-8b39ccee5e3e tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: a626b1ea-4968-4e45-b2ab-4c11f06e6f85] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:15:18.512725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:18.584980 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b17d6e8e-7308-48a0-85b0-8b39ccee5e3e tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85" status: 204 len: 0 microversion: 2.1 time: 0.264837 Aug 24 10:15:18.586718 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 531/998] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:15:18 2022] DELETE /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:15:18.599101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-68efcf9f-28f6-49a8-85c2-d30f7b0ead03 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:18.599745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-68efcf9f-28f6-49a8-85c2-d30f7b0ead03 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:18.608929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68efcf9f-28f6-49a8-85c2-d30f7b0ead03 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:18.609495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68efcf9f-28f6-49a8-85c2-d30f7b0ead03 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:18.609959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68efcf9f-28f6-49a8-85c2-d30f7b0ead03 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:18.610762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68efcf9f-28f6-49a8-85c2-d30f7b0ead03 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:18.611606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68efcf9f-28f6-49a8-85c2-d30f7b0ead03 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:18.612233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68efcf9f-28f6-49a8-85c2-d30f7b0ead03 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:18.648552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-68efcf9f-28f6-49a8-85c2-d30f7b0ead03 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:15:18.784432 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-68efcf9f-28f6-49a8-85c2-d30f7b0ead03 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "DELETE /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159" status: 204 len: 0 microversion: 2.1 time: 0.192046 Aug 24 10:15:18.785315 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 532/999] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:15:18 2022] DELETE /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:15:18.791966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ef415750-7f89-4b2f-acea-f25f57078f0e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:18.792706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ef415750-7f89-4b2f-acea-f25f57078f0e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 1d8befca-2013-4597-a7e7-e12100a340db] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:18.799974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef415750-7f89-4b2f-acea-f25f57078f0e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:18.800503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef415750-7f89-4b2f-acea-f25f57078f0e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:18.800941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef415750-7f89-4b2f-acea-f25f57078f0e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:18.802080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef415750-7f89-4b2f-acea-f25f57078f0e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:18.802851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef415750-7f89-4b2f-acea-f25f57078f0e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:18.802851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef415750-7f89-4b2f-acea-f25f57078f0e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:18.829671 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-ef415750-7f89-4b2f-acea-f25f57078f0e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] HTTP exception thrown: Instance 1d8befca-2013-4597-a7e7-e12100a340db could not be found. Aug 24 10:15:18.832373 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ef415750-7f89-4b2f-acea-f25f57078f0e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Request method failure captured: Aug 24 10:15:18.832373 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/1d8befca-2013-4597-a7e7-e12100a340db HTTP/1.1 Aug 24 10:15:18.832373 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:15:18.832373 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:15:18.832373 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:15:18.832373 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:15:18.832373 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:15:18.832373 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:15:18.832373 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:15:18.832373 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:15:18.832373 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBflp1lR6NJiOvJ0jo0u_ObCwr-XT9ZPDd8UFdAdrktIeq9W3st8_Vr__ObGPpyUD3B1sX780QVeUxsP7WLsIfoEmJ6ZRyy4XuEoKUiYvCKqPo1TBHvl0EjfZLY21G0cKkNvRwmjK2bcnCfVvvo4RO0l6RUsKYrhQXpLAAKVAYjdEZcw Aug 24 10:15:18.832373 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:15:18.832373 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:15:18.832373 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:15:18.832373 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:15:18.832373 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:15:18.832373 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:15:18.832373 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: f2e2ee3e278042a5bf8ee7348966a468 Aug 24 10:15:18.832373 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersOnMultiNodesTest-1510468885 Aug 24 10:15:18.832373 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:15:18.832373 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:15:18.834350 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f2e2ee3e278042a5bf8ee7348966a468"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f2e2ee3e278042a5bf8ee7348966a468", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f2e2ee3e278042a5bf8ee7348966a468"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f2e2ee3e278042a5bf8ee7348966a468"}]}] Aug 24 10:15:18.834350 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersOnMultiNodesTest-1510468885 Aug 24 10:15:18.834350 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: f2e2ee3e278042a5bf8ee7348966a468 Aug 24 10:15:18.834350 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1510468885 Aug 24 10:15:18.834350 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersOnMultiNodesTest-1510468885-project Aug 24 10:15:18.834350 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:15:18.834350 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:15:18.834350 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: bf03c0eb5bd748ae85be830f1121dc06 Aug 24 10:15:18.834350 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersOnMultiNodesTest-1510468885-project Aug 24 10:15:18.834350 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:15:18.834350 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 1d8befca-2013-4597-a7e7-e12100a340db could not be found. Aug 24 10:15:18.834350 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '1d8befca-2013-4597-a7e7-e12100a340db'} Aug 24 10:15:18.835267 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:15:18.835267 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:18.835267 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:15:18.835267 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:15:18.835267 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:15:18.835267 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:15:18.835267 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:15:18.835267 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:15:18.835267 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:15:18.835267 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:15:18.835267 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d8befca-2013-4597-a7e7-e12100a340db could not be found. Aug 24 10:15:18.835267 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:18.835267 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:15:18.835267 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:18.835267 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:18.835267 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:15:18.835267 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:15:18.835267 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:15:18.835267 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:15:18.835267 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:15:18.836947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:15:18.836947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:15:18.836947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:15:18.836947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:15:18.836947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:15:18.836947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:15:18.836947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:15:18.836947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d8befca-2013-4597-a7e7-e12100a340db could not be found. Aug 24 10:15:18.836947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:18.836947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:15:18.836947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:18.836947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:18.836947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:15:18.836947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:15:18.836947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:15:18.836947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:15:18.836947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d8befca-2013-4597-a7e7-e12100a340db could not be found. Aug 24 10:15:18.836947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:18.840188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ef415750-7f89-4b2f-acea-f25f57078f0e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Returning 404 to user: Instance 1d8befca-2013-4597-a7e7-e12100a340db could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:15:18.841174 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ef415750-7f89-4b2f-acea-f25f57078f0e tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/1d8befca-2013-4597-a7e7-e12100a340db" status: 404 len: 111 microversion: 2.1 time: 0.053754 Aug 24 10:15:18.841985 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 533/1000] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:18 2022] GET /compute/v2.1/servers/1d8befca-2013-4597-a7e7-e12100a340db => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:15:18.851541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5ba48e87-ae76-47a9-a662-cbb8b4a098c2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:18.852638 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5ba48e87-ae76-47a9-a662-cbb8b4a098c2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: a626b1ea-4968-4e45-b2ab-4c11f06e6f85] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:18.862503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ba48e87-ae76-47a9-a662-cbb8b4a098c2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:18.863692 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ba48e87-ae76-47a9-a662-cbb8b4a098c2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:18.864654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ba48e87-ae76-47a9-a662-cbb8b4a098c2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:18.865579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ba48e87-ae76-47a9-a662-cbb8b4a098c2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:18.866156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ba48e87-ae76-47a9-a662-cbb8b4a098c2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:18.866812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ba48e87-ae76-47a9-a662-cbb8b4a098c2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:19.526398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5ba48e87-ae76-47a9-a662-cbb8b4a098c2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:19.557483 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5ba48e87-ae76-47a9-a662-cbb8b4a098c2 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85" status: 200 len: 1513 microversion: 2.1 time: 0.709585 Aug 24 10:15:19.561607 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 534/1001] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:18 2022] GET /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85 => generated 1513 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:19.574408 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-46e13d76-cc0d-4342-b8e9-20f165cc1964 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:19.575714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-46e13d76-cc0d-4342-b8e9-20f165cc1964 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:19.581400 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:19.605289 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46e13d76-cc0d-4342-b8e9-20f165cc1964 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:19.606336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46e13d76-cc0d-4342-b8e9-20f165cc1964 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:19.607240 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46e13d76-cc0d-4342-b8e9-20f165cc1964 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:19.608757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46e13d76-cc0d-4342-b8e9-20f165cc1964 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:19.609730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46e13d76-cc0d-4342-b8e9-20f165cc1964 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:19.610783 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46e13d76-cc0d-4342-b8e9-20f165cc1964 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:19.860976 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0c203d05-59e7-40c2-a191-84939418bb95 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0/action" status: 202 len: 0 microversion: 2.25 time: 2.726530 Aug 24 10:15:19.863442 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 468/1002] 10.222.0.85 () {62 vars in 1319 bytes} [Wed Aug 24 10:15:17 2022] POST /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0/action => generated 0 bytes in 2730 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:15:19.882944 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-08d2a84f-49c9-438c-bf49-0ada8cbcac4a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:19.884057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-08d2a84f-49c9-438c-bf49-0ada8cbcac4a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 322e4dd7-c596-41d1-94a4-7bdd711f3ebf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:19.897862 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08d2a84f-49c9-438c-bf49-0ada8cbcac4a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:19.899128 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08d2a84f-49c9-438c-bf49-0ada8cbcac4a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:19.900116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08d2a84f-49c9-438c-bf49-0ada8cbcac4a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:19.901682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08d2a84f-49c9-438c-bf49-0ada8cbcac4a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:19.902704 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08d2a84f-49c9-438c-bf49-0ada8cbcac4a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:19.903697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08d2a84f-49c9-438c-bf49-0ada8cbcac4a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:19.949413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=5,nova_cell1:RELEASE=1,nova_cell1:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:20.052053 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-08d2a84f-49c9-438c-bf49-0ada8cbcac4a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:20.100550 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-08d2a84f-49c9-438c-bf49-0ada8cbcac4a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf" status: 200 len: 1432 microversion: 2.1 time: 0.234378 Aug 24 10:15:20.106237 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 469/1003] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:19 2022] GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf => generated 1432 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:20.117728 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-1fb53418-ef9a-45be-9ea7-dc9a87f629d3 req-79537a07-c7d3-42fc-8c4b-c261b40c6ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "322e4dd7-c596-41d1-94a4-7bdd711f3ebf", "name": "network-vif-deleted", "tag": "1932e7da-337e-470e-8ae5-6f500b4e8a39"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:20.130796 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1fb53418-ef9a-45be-9ea7-dc9a87f629d3 req-79537a07-c7d3-42fc-8c4b-c261b40c6ba6 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:20.131719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1fb53418-ef9a-45be-9ea7-dc9a87f629d3 req-79537a07-c7d3-42fc-8c4b-c261b40c6ba6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:20.132399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1fb53418-ef9a-45be-9ea7-dc9a87f629d3 req-79537a07-c7d3-42fc-8c4b-c261b40c6ba6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:20.154232 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-1fb53418-ef9a-45be-9ea7-dc9a87f629d3 req-79537a07-c7d3-42fc-8c4b-c261b40c6ba6 service nova] Creating event network-vif-deleted:1932e7da-337e-470e-8ae5-6f500b4e8a39 for instance 322e4dd7-c596-41d1-94a4-7bdd711f3ebf on n-h2-849328-3 Aug 24 10:15:20.160922 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-1fb53418-ef9a-45be-9ea7-dc9a87f629d3 req-79537a07-c7d3-42fc-8c4b-c261b40c6ba6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051008 Aug 24 10:15:20.162498 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 470/1004] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:20.170334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9e6fb3fc-d61a-47d1-8398-4fbc017f23e4 req-3dec6097-4d58-4ea2-84b8-f77ec771b636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d8befca-2013-4597-a7e7-e12100a340db", "name": "network-vif-deleted", "tag": "bde82519-9f50-4430-9cd1-5bca12e6e002"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:20.207785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9e6fb3fc-d61a-47d1-8398-4fbc017f23e4 req-3dec6097-4d58-4ea2-84b8-f77ec771b636 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:20.210128 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9e6fb3fc-d61a-47d1-8398-4fbc017f23e4 req-3dec6097-4d58-4ea2-84b8-f77ec771b636 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:20.210718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9e6fb3fc-d61a-47d1-8398-4fbc017f23e4 req-3dec6097-4d58-4ea2-84b8-f77ec771b636 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:20.236839 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9e6fb3fc-d61a-47d1-8398-4fbc017f23e4 req-3dec6097-4d58-4ea2-84b8-f77ec771b636 service nova] Creating event network-vif-deleted:bde82519-9f50-4430-9cd1-5bca12e6e002 for instance 1d8befca-2013-4597-a7e7-e12100a340db on n-h1-849328-3 Aug 24 10:15:20.243238 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9e6fb3fc-d61a-47d1-8398-4fbc017f23e4 req-3dec6097-4d58-4ea2-84b8-f77ec771b636 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078600 Aug 24 10:15:20.245111 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 471/1005] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:20.251427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-12028f1f-894e-4475-ada8-a6b120bf510f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:20.252297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-12028f1f-894e-4475-ada8-a6b120bf510f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:20.263312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12028f1f-894e-4475-ada8-a6b120bf510f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:20.264568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12028f1f-894e-4475-ada8-a6b120bf510f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:20.265554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12028f1f-894e-4475-ada8-a6b120bf510f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:20.266903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12028f1f-894e-4475-ada8-a6b120bf510f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:20.268800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12028f1f-894e-4475-ada8-a6b120bf510f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:20.268800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12028f1f-894e-4475-ada8-a6b120bf510f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:20.654656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-12028f1f-894e-4475-ada8-a6b120bf510f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:20.680420 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-12028f1f-894e-4475-ada8-a6b120bf510f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 200 len: 1308 microversion: 2.1 time: 0.433691 Aug 24 10:15:20.682178 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 472/1006] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:20 2022] GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 1308 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:20.694727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c99f9b8e-6ae3-47c3-bfc2-709809fa0e13 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:20.695354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c99f9b8e-6ae3-47c3-bfc2-709809fa0e13 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:20.717940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c99f9b8e-6ae3-47c3-bfc2-709809fa0e13 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:20.719950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c99f9b8e-6ae3-47c3-bfc2-709809fa0e13 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:20.723729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c99f9b8e-6ae3-47c3-bfc2-709809fa0e13 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:20.725643 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c99f9b8e-6ae3-47c3-bfc2-709809fa0e13 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:20.728600 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c99f9b8e-6ae3-47c3-bfc2-709809fa0e13 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:20.729374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c99f9b8e-6ae3-47c3-bfc2-709809fa0e13 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:20.739498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-46e13d76-cc0d-4342-b8e9-20f165cc1964 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:20.753278 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-46e13d76-cc0d-4342-b8e9-20f165cc1964 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159" status: 200 len: 1526 microversion: 2.1 time: 1.189928 Aug 24 10:15:20.753904 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 535/1007] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:19 2022] GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159 => generated 1526 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:20.758960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bbfb977e-0452-4a85-804d-584083fc8105 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:20.763432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bbfb977e-0452-4a85-804d-584083fc8105 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: a626b1ea-4968-4e45-b2ab-4c11f06e6f85] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:20.780666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbfb977e-0452-4a85-804d-584083fc8105 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:20.781205 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbfb977e-0452-4a85-804d-584083fc8105 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:20.781655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbfb977e-0452-4a85-804d-584083fc8105 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:20.782364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbfb977e-0452-4a85-804d-584083fc8105 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:20.782995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbfb977e-0452-4a85-804d-584083fc8105 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:20.783606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbfb977e-0452-4a85-804d-584083fc8105 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:21.189175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bbfb977e-0452-4a85-804d-584083fc8105 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:21.207371 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bbfb977e-0452-4a85-804d-584083fc8105 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85" status: 200 len: 1513 microversion: 2.1 time: 0.451969 Aug 24 10:15:21.208931 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 536/1008] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:20 2022] GET /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85 => generated 1513 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:21.215450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e85e4239-4cae-49c8-add1-b553ce51daeb tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:21.217410 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e85e4239-4cae-49c8-add1-b553ce51daeb tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: 322e4dd7-c596-41d1-94a4-7bdd711f3ebf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:21.226533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85e4239-4cae-49c8-add1-b553ce51daeb tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:21.228246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85e4239-4cae-49c8-add1-b553ce51daeb tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:21.228885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85e4239-4cae-49c8-add1-b553ce51daeb tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:21.230294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85e4239-4cae-49c8-add1-b553ce51daeb tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:21.230937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85e4239-4cae-49c8-add1-b553ce51daeb tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:21.231642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85e4239-4cae-49c8-add1-b553ce51daeb tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:21.258332 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-e85e4239-4cae-49c8-add1-b553ce51daeb tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] HTTP exception thrown: Instance 322e4dd7-c596-41d1-94a4-7bdd711f3ebf could not be found. Aug 24 10:15:21.262080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e85e4239-4cae-49c8-add1-b553ce51daeb tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Request method failure captured: Aug 24 10:15:21.262080 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf HTTP/1.1 Aug 24 10:15:21.262080 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:15:21.262080 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:15:21.262080 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:15:21.262080 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:15:21.262080 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:15:21.262080 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:15:21.262080 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:15:21.262080 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:15:21.262080 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBflp1lR6NJiOvJ0jo0u_ObCwr-XT9ZPDd8UFdAdrktIeq9W3st8_Vr__ObGPpyUD3B1sX780QVeUxsP7WLsIfoEmJ6ZRyy4XuEoKUiYvCKqPo1TBHvl0EjfZLY21G0cKkNvRwmjK2bcnCfVvvo4RO0l6RUsKYrhQXpLAAKVAYjdEZcw Aug 24 10:15:21.262080 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:15:21.262080 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:15:21.262080 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:15:21.262080 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:15:21.262080 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:15:21.262080 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:15:21.262080 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: f2e2ee3e278042a5bf8ee7348966a468 Aug 24 10:15:21.262080 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersOnMultiNodesTest-1510468885 Aug 24 10:15:21.262080 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:15:21.262080 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:15:21.263700 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f2e2ee3e278042a5bf8ee7348966a468"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f2e2ee3e278042a5bf8ee7348966a468", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f2e2ee3e278042a5bf8ee7348966a468"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f2e2ee3e278042a5bf8ee7348966a468"}]}] Aug 24 10:15:21.263700 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersOnMultiNodesTest-1510468885 Aug 24 10:15:21.263700 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: f2e2ee3e278042a5bf8ee7348966a468 Aug 24 10:15:21.263700 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1510468885 Aug 24 10:15:21.263700 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersOnMultiNodesTest-1510468885-project Aug 24 10:15:21.263700 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:15:21.263700 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:15:21.263700 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: bf03c0eb5bd748ae85be830f1121dc06 Aug 24 10:15:21.263700 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersOnMultiNodesTest-1510468885-project Aug 24 10:15:21.263700 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:15:21.263700 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 322e4dd7-c596-41d1-94a4-7bdd711f3ebf could not be found. Aug 24 10:15:21.263700 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '322e4dd7-c596-41d1-94a4-7bdd711f3ebf'} Aug 24 10:15:21.264690 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:15:21.264690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:21.264690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:15:21.264690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:15:21.264690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:15:21.264690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:15:21.264690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:15:21.264690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:15:21.264690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:15:21.264690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:15:21.264690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 322e4dd7-c596-41d1-94a4-7bdd711f3ebf could not be found. Aug 24 10:15:21.264690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:21.264690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:15:21.264690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:21.264690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:21.264690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:15:21.264690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:15:21.264690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:15:21.264690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:15:21.264690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:15:21.268451 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:15:21.268451 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:15:21.268451 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:15:21.268451 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:15:21.268451 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:15:21.268451 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:15:21.268451 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:15:21.268451 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 322e4dd7-c596-41d1-94a4-7bdd711f3ebf could not be found. Aug 24 10:15:21.268451 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:21.268451 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:15:21.268451 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:21.268451 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:21.268451 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:15:21.268451 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:15:21.268451 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:15:21.268451 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:15:21.268451 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 322e4dd7-c596-41d1-94a4-7bdd711f3ebf could not be found. Aug 24 10:15:21.268451 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:21.272565 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e85e4239-4cae-49c8-add1-b553ce51daeb tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Returning 404 to user: Instance 322e4dd7-c596-41d1-94a4-7bdd711f3ebf could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:15:21.274436 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e85e4239-4cae-49c8-add1-b553ce51daeb tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf" status: 404 len: 111 microversion: 2.1 time: 0.064185 Aug 24 10:15:21.275978 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 537/1009] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:21 2022] GET /compute/v2.1/servers/322e4dd7-c596-41d1-94a4-7bdd711f3ebf => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:15:21.286722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8f0a90ec-9634-480b-81d1-85ba781e4448 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:21.347354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c99f9b8e-6ae3-47c3-bfc2-709809fa0e13 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:21.371283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c99f9b8e-6ae3-47c3-bfc2-709809fa0e13 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:21.372900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c99f9b8e-6ae3-47c3-bfc2-709809fa0e13 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:21.374242 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c99f9b8e-6ae3-47c3-bfc2-709809fa0e13 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1813 microversion: 2.25 time: 0.691172 Aug 24 10:15:21.374827 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 473/1010] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:15:20 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1813 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:15:21.424757 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8f0a90ec-9634-480b-81d1-85ba781e4448 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "DELETE /compute/v2.1/os-server-groups/0115a7d1-f8a0-4ba5-806f-009c686ef65c" status: 204 len: 0 microversion: 2.1 time: 0.142445 Aug 24 10:15:21.425426 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 538/1011] 10.222.0.85 () {58 vars in 1266 bytes} [Wed Aug 24 10:15:21 2022] DELETE /compute/v2.1/os-server-groups/0115a7d1-f8a0-4ba5-806f-009c686ef65c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:15:21.434325 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c191c3af-ad01-4c7f-9dc4-3bcbd30a81af tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:21.434842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c191c3af-ad01-4c7f-9dc4-3bcbd30a81af tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: db566c0d-ce6a-4d8d-bba4-c1480a160d01] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:21.441257 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c191c3af-ad01-4c7f-9dc4-3bcbd30a81af tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:21.450637 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c191c3af-ad01-4c7f-9dc4-3bcbd30a81af tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:21.451313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c191c3af-ad01-4c7f-9dc4-3bcbd30a81af tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:21.452259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c191c3af-ad01-4c7f-9dc4-3bcbd30a81af tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:21.452876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c191c3af-ad01-4c7f-9dc4-3bcbd30a81af tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:21.453608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c191c3af-ad01-4c7f-9dc4-3bcbd30a81af tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:21.527965 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c191c3af-ad01-4c7f-9dc4-3bcbd30a81af tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: db566c0d-ce6a-4d8d-bba4-c1480a160d01] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:15:21.703165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f3a211c-3008-44e9-8bd1-13a9ab23aa5f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:21.704187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0f3a211c-3008-44e9-8bd1-13a9ab23aa5f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:21.711753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f3a211c-3008-44e9-8bd1-13a9ab23aa5f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:21.712853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f3a211c-3008-44e9-8bd1-13a9ab23aa5f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:21.713580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f3a211c-3008-44e9-8bd1-13a9ab23aa5f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:21.723121 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f3a211c-3008-44e9-8bd1-13a9ab23aa5f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:21.725655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f3a211c-3008-44e9-8bd1-13a9ab23aa5f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:21.727491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f3a211c-3008-44e9-8bd1-13a9ab23aa5f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:21.852321 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c191c3af-ad01-4c7f-9dc4-3bcbd30a81af tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "DELETE /compute/v2.1/servers/db566c0d-ce6a-4d8d-bba4-c1480a160d01" status: 204 len: 0 microversion: 2.1 time: 0.415059 Aug 24 10:15:21.853210 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 474/1012] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:15:21 2022] DELETE /compute/v2.1/servers/db566c0d-ce6a-4d8d-bba4-c1480a160d01 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:15:21.861148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3f6b6320-4657-4d0e-b773-27eddad5564e tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:21.862223 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3f6b6320-4657-4d0e-b773-27eddad5564e tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:21.869490 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f6b6320-4657-4d0e-b773-27eddad5564e tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:21.870376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f6b6320-4657-4d0e-b773-27eddad5564e tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:21.871050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f6b6320-4657-4d0e-b773-27eddad5564e tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:21.872221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f6b6320-4657-4d0e-b773-27eddad5564e tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:21.872974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f6b6320-4657-4d0e-b773-27eddad5564e tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:21.873697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f6b6320-4657-4d0e-b773-27eddad5564e tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:22.149830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3f6b6320-4657-4d0e-b773-27eddad5564e tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:22.165382 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3f6b6320-4657-4d0e-b773-27eddad5564e tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159" status: 200 len: 1484 microversion: 2.1 time: 0.308436 Aug 24 10:15:22.166315 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 475/1013] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:21 2022] GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159 => generated 1484 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:22.171253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4063c7cb-bd89-4351-8f1d-0cf3b20a4e8f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:22.171742 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4063c7cb-bd89-4351-8f1d-0cf3b20a4e8f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: b00174fc-a16c-4ae5-94d3-d43b9c963cf5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:22.188898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4063c7cb-bd89-4351-8f1d-0cf3b20a4e8f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:22.188898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4063c7cb-bd89-4351-8f1d-0cf3b20a4e8f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:22.190091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4063c7cb-bd89-4351-8f1d-0cf3b20a4e8f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:22.192429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4063c7cb-bd89-4351-8f1d-0cf3b20a4e8f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:22.193664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4063c7cb-bd89-4351-8f1d-0cf3b20a4e8f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:22.194272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4063c7cb-bd89-4351-8f1d-0cf3b20a4e8f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:22.252530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4063c7cb-bd89-4351-8f1d-0cf3b20a4e8f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: b00174fc-a16c-4ae5-94d3-d43b9c963cf5] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:15:22.428540 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4063c7cb-bd89-4351-8f1d-0cf3b20a4e8f tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b00174fc-a16c-4ae5-94d3-d43b9c963cf5" status: 204 len: 0 microversion: 2.1 time: 0.260402 Aug 24 10:15:22.430938 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 476/1014] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:15:22 2022] DELETE /compute/v2.1/servers/b00174fc-a16c-4ae5-94d3-d43b9c963cf5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:15:22.451918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-20169a15-7971-4aa8-983e-85d5d9fa378a req-35d2e550-a914-4bce-b855-53c83ed56bac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1ebe6bd-b2ae-45c2-8752-314356143de9", "name": "network-vif-plugged", "status": "completed", "tag": "44b58631-8033-4518-911c-3c45f71ea4a5"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:22.464986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-20169a15-7971-4aa8-983e-85d5d9fa378a req-35d2e550-a914-4bce-b855-53c83ed56bac service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:22.465520 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-20169a15-7971-4aa8-983e-85d5d9fa378a req-35d2e550-a914-4bce-b855-53c83ed56bac service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:22.465957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-20169a15-7971-4aa8-983e-85d5d9fa378a req-35d2e550-a914-4bce-b855-53c83ed56bac service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:22.488287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0f3a211c-3008-44e9-8bd1-13a9ab23aa5f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:22.492165 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-20169a15-7971-4aa8-983e-85d5d9fa378a req-35d2e550-a914-4bce-b855-53c83ed56bac service nova] Creating event network-vif-plugged:44b58631-8033-4518-911c-3c45f71ea4a5 for instance a1ebe6bd-b2ae-45c2-8752-314356143de9 on n-h1-849328-3 Aug 24 10:15:22.502543 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0f3a211c-3008-44e9-8bd1-13a9ab23aa5f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 200 len: 1308 microversion: 2.1 time: 0.803955 Aug 24 10:15:22.505854 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-20169a15-7971-4aa8-983e-85d5d9fa378a req-35d2e550-a914-4bce-b855-53c83ed56bac service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063687 Aug 24 10:15:22.512185 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 477/1015] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:22.523350 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 539/1016] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:21 2022] GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 1308 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:22.530498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-29626499-90a9-4139-a008-8e3ef3340929 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Calling method '.version_select at 0x7f4655036dc0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:22.531045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-785ade26-05e5-496d-86c5-0dd3737ed856 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:22.532829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-785ade26-05e5-496d-86c5-0dd3737ed856 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: a626b1ea-4968-4e45-b2ab-4c11f06e6f85] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:22.537174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29626499-90a9-4139-a008-8e3ef3340929 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:22.538023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29626499-90a9-4139-a008-8e3ef3340929 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:22.538631 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29626499-90a9-4139-a008-8e3ef3340929 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:22.555575 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-29626499-90a9-4139-a008-8e3ef3340929 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] 10.222.0.85 "GET /compute/v2.1/os-migrations" status: 200 len: 1954 microversion: 2.1 time: 0.030769 Aug 24 10:15:22.556891 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 540/1017] 10.222.0.85 () {58 vars in 1143 bytes} [Wed Aug 24 10:15:22 2022] GET /compute/v2.1/os-migrations => generated 1954 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:22.563943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-455ed80e-442c-4512-8971-7f48f7f7faad req-9578b3e3-dc95-4130-9fc8-b47db4387d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c285a5a5-ba66-41c8-aa67-402e2d5f9159", "name": "network-vif-deleted", "tag": "ad70c32a-b650-4c05-bd90-a010a57fd42f"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:22.585492 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-785ade26-05e5-496d-86c5-0dd3737ed856 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:22.588031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-455ed80e-442c-4512-8971-7f48f7f7faad req-9578b3e3-dc95-4130-9fc8-b47db4387d52 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:22.588510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-455ed80e-442c-4512-8971-7f48f7f7faad req-9578b3e3-dc95-4130-9fc8-b47db4387d52 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:22.588654 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-785ade26-05e5-496d-86c5-0dd3737ed856 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:22.589009 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-785ade26-05e5-496d-86c5-0dd3737ed856 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:22.589441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-455ed80e-442c-4512-8971-7f48f7f7faad req-9578b3e3-dc95-4130-9fc8-b47db4387d52 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:22.589824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-785ade26-05e5-496d-86c5-0dd3737ed856 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:22.590355 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-785ade26-05e5-496d-86c5-0dd3737ed856 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:22.590811 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-785ade26-05e5-496d-86c5-0dd3737ed856 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:22.606051 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-455ed80e-442c-4512-8971-7f48f7f7faad req-9578b3e3-dc95-4130-9fc8-b47db4387d52 service nova] Creating event network-vif-deleted:ad70c32a-b650-4c05-bd90-a010a57fd42f for instance c285a5a5-ba66-41c8-aa67-402e2d5f9159 on n-h1-849328-3 Aug 24 10:15:22.630237 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-455ed80e-442c-4512-8971-7f48f7f7faad req-9578b3e3-dc95-4130-9fc8-b47db4387d52 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071219 Aug 24 10:15:22.636277 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 541/1018] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:22.646261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-26058c9b-f472-40d5-bf2f-a97a8988b372 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:22.647559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-26058c9b-f472-40d5-bf2f-a97a8988b372 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:22.656557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26058c9b-f472-40d5-bf2f-a97a8988b372 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:22.657459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26058c9b-f472-40d5-bf2f-a97a8988b372 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:22.662495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26058c9b-f472-40d5-bf2f-a97a8988b372 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:22.664149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26058c9b-f472-40d5-bf2f-a97a8988b372 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:22.664897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26058c9b-f472-40d5-bf2f-a97a8988b372 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:22.669708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26058c9b-f472-40d5-bf2f-a97a8988b372 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:22.813202 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-785ade26-05e5-496d-86c5-0dd3737ed856 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:22.827686 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-785ade26-05e5-496d-86c5-0dd3737ed856 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85" status: 200 len: 1302 microversion: 2.1 time: 0.304864 Aug 24 10:15:22.840936 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 478/1019] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:22 2022] GET /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85 => generated 1302 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:22.846709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-96b8df1f-5015-4cd1-8ae0-f8b6522b3a4d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:22.847767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-96b8df1f-5015-4cd1-8ae0-f8b6522b3a4d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: db566c0d-ce6a-4d8d-bba4-c1480a160d01] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:22.862544 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96b8df1f-5015-4cd1-8ae0-f8b6522b3a4d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:22.863365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96b8df1f-5015-4cd1-8ae0-f8b6522b3a4d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:22.867043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96b8df1f-5015-4cd1-8ae0-f8b6522b3a4d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:22.869163 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96b8df1f-5015-4cd1-8ae0-f8b6522b3a4d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:22.872371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96b8df1f-5015-4cd1-8ae0-f8b6522b3a4d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:22.873159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96b8df1f-5015-4cd1-8ae0-f8b6522b3a4d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:23.076555 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-26058c9b-f472-40d5-bf2f-a97a8988b372 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:23.132630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-26058c9b-f472-40d5-bf2f-a97a8988b372 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:23.135324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-26058c9b-f472-40d5-bf2f-a97a8988b372 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:23.136884 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-26058c9b-f472-40d5-bf2f-a97a8988b372 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1813 microversion: 2.25 time: 0.495295 Aug 24 10:15:23.139448 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 542/1020] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:15:22 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1813 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:15:23.146872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-349d2b6f-ff53-4b60-92e2-ea5e59418fa6 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:23.158341 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-349d2b6f-ff53-4b60-92e2-ea5e59418fa6 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017235 Aug 24 10:15:23.159679 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 543/1021] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:15:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:23.172704 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-1f65bd47-ae57-4081-a620-4f5e07e3d13d req-04e7116a-9a6c-403e-b90a-a6daa546960f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a626b1ea-4968-4e45-b2ab-4c11f06e6f85", "name": "network-vif-deleted", "tag": "993acca0-372e-44eb-95b8-b63a381f8921"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:23.201691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1f65bd47-ae57-4081-a620-4f5e07e3d13d req-04e7116a-9a6c-403e-b90a-a6daa546960f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:23.202791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1f65bd47-ae57-4081-a620-4f5e07e3d13d req-04e7116a-9a6c-403e-b90a-a6daa546960f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:23.203483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1f65bd47-ae57-4081-a620-4f5e07e3d13d req-04e7116a-9a6c-403e-b90a-a6daa546960f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:23.215520 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-96b8df1f-5015-4cd1-8ae0-f8b6522b3a4d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:23.219712 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-1f65bd47-ae57-4081-a620-4f5e07e3d13d req-04e7116a-9a6c-403e-b90a-a6daa546960f service nova] Creating event network-vif-deleted:993acca0-372e-44eb-95b8-b63a381f8921 for instance a626b1ea-4968-4e45-b2ab-4c11f06e6f85 on n-h2-849328-3 Aug 24 10:15:23.226384 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-96b8df1f-5015-4cd1-8ae0-f8b6522b3a4d tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/db566c0d-ce6a-4d8d-bba4-c1480a160d01" status: 200 len: 1475 microversion: 2.1 time: 0.383816 Aug 24 10:15:23.227653 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-1f65bd47-ae57-4081-a620-4f5e07e3d13d req-04e7116a-9a6c-403e-b90a-a6daa546960f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064392 Aug 24 10:15:23.228916 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 544/1022] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:23.239758 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a2e8d84b-4b6f-4d0e-b0f9-048b30fe8d5a tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-380818033", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:23.242634 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 479/1023] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:22 2022] GET /compute/v2.1/servers/db566c0d-ce6a-4d8d-bba4-c1480a160d01 => generated 1475 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:23.249714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3b1f12b7-228d-4d56-bfff-da4b2c020a6f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:23.250278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3b1f12b7-228d-4d56-bfff-da4b2c020a6f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:23.257416 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b1f12b7-228d-4d56-bfff-da4b2c020a6f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:23.257925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b1f12b7-228d-4d56-bfff-da4b2c020a6f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:23.258365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b1f12b7-228d-4d56-bfff-da4b2c020a6f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:23.259087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b1f12b7-228d-4d56-bfff-da4b2c020a6f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:23.259560 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b1f12b7-228d-4d56-bfff-da4b2c020a6f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:23.259983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b1f12b7-228d-4d56-bfff-da4b2c020a6f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:23.276223 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:15:23.276223 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:15:23.313233 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a2e8d84b-4b6f-4d0e-b0f9-048b30fe8d5a tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.082622 Aug 24 10:15:23.324713 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 545/1024] 10.222.0.85 () {60 vars in 1146 bytes} [Wed Aug 24 10:15:23 2022] POST /compute/v2.1/flavors => generated 498 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:23.329886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e5f4d313-062e-42b1-b4f8-554c0076dd80 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:23.348256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3b1f12b7-228d-4d56-bfff-da4b2c020a6f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:23.352203 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e5f4d313-062e-42b1-b4f8-554c0076dd80 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.026045 Aug 24 10:15:23.360332 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3b1f12b7-228d-4d56-bfff-da4b2c020a6f tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159" status: 200 len: 1309 microversion: 2.1 time: 0.114579 Aug 24 10:15:23.368009 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 546/1025] 10.222.0.85 () {58 vars in 1182 bytes} [Wed Aug 24 10:15:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:15:23.380701 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 480/1026] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:23 2022] GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159 => generated 1309 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:23.525237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-93097480-c291-469a-882d-e7629b59fcaa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:23.526056 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-93097480-c291-469a-882d-e7629b59fcaa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:23.536969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-41514ab2-4b0a-4b5d-b936-02807d4d8b06 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-873812448", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "623db3b5-0bfd-4b20-95a7-db5ad80e00da"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:23.557978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93097480-c291-469a-882d-e7629b59fcaa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:23.560663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93097480-c291-469a-882d-e7629b59fcaa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:23.561393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93097480-c291-469a-882d-e7629b59fcaa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:23.562386 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93097480-c291-469a-882d-e7629b59fcaa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:23.569823 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93097480-c291-469a-882d-e7629b59fcaa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:23.570605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93097480-c291-469a-882d-e7629b59fcaa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:23.630325 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-41514ab2-4b0a-4b5d-b936-02807d4d8b06 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:15:23.971033 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-41514ab2-4b0a-4b5d-b936-02807d4d8b06 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:15:23.971525 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-41514ab2-4b0a-4b5d-b936-02807d4d8b06 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:15:23.972334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-41514ab2-4b0a-4b5d-b936-02807d4d8b06 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:15:23.972749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-41514ab2-4b0a-4b5d-b936-02807d4d8b06 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:15:23.973424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-41514ab2-4b0a-4b5d-b936-02807d4d8b06 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:15:23.994842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41514ab2-4b0a-4b5d-b936-02807d4d8b06 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:24.003962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41514ab2-4b0a-4b5d-b936-02807d4d8b06 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:24.006180 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41514ab2-4b0a-4b5d-b936-02807d4d8b06 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:24.007801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41514ab2-4b0a-4b5d-b936-02807d4d8b06 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:24.009617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41514ab2-4b0a-4b5d-b936-02807d4d8b06 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:24.012096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41514ab2-4b0a-4b5d-b936-02807d4d8b06 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:24.013283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-93097480-c291-469a-882d-e7629b59fcaa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:24.023265 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-93097480-c291-469a-882d-e7629b59fcaa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 200 len: 1308 microversion: 2.1 time: 0.501953 Aug 24 10:15:24.034289 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 547/1027] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:23 2022] GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 1308 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:24.039904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1e2bbe1d-eec2-4836-a2b9-0c471e0b63ee tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:24.040753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1e2bbe1d-eec2-4836-a2b9-0c471e0b63ee tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: a626b1ea-4968-4e45-b2ab-4c11f06e6f85] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:24.052160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e2bbe1d-eec2-4836-a2b9-0c471e0b63ee tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:24.056982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e2bbe1d-eec2-4836-a2b9-0c471e0b63ee tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:24.057694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e2bbe1d-eec2-4836-a2b9-0c471e0b63ee tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:24.058781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e2bbe1d-eec2-4836-a2b9-0c471e0b63ee tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:24.059439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e2bbe1d-eec2-4836-a2b9-0c471e0b63ee tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:24.059744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-41514ab2-4b0a-4b5d-b936-02807d4d8b06 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Getting quotas for project 7947a063a37946b7870e95dfd7a2e7e6. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:15:24.060256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e2bbe1d-eec2-4836-a2b9-0c471e0b63ee tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:24.073746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-41514ab2-4b0a-4b5d-b936-02807d4d8b06 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Getting quotas for user 53af167c0c744cbb910ff5860767cb95 and project 7947a063a37946b7870e95dfd7a2e7e6. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:15:24.106715 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-1e2bbe1d-eec2-4836-a2b9-0c471e0b63ee tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] HTTP exception thrown: Instance a626b1ea-4968-4e45-b2ab-4c11f06e6f85 could not be found. Aug 24 10:15:24.106981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-41514ab2-4b0a-4b5d-b936-02807d4d8b06 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:15:24.112102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-41514ab2-4b0a-4b5d-b936-02807d4d8b06 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:15:24.117274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1e2bbe1d-eec2-4836-a2b9-0c471e0b63ee tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Request method failure captured: Aug 24 10:15:24.117274 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85 HTTP/1.1 Aug 24 10:15:24.117274 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:15:24.117274 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:15:24.117274 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:15:24.117274 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:15:24.117274 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:15:24.117274 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:15:24.117274 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:15:24.117274 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:15:24.117274 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfl4a9G-cbesU8S4LiuCVGs_VHhA7gJIZxDtIp1n7aBv1vIdNW0d_Pju2RFPvMw4u7uV6oPR0r-j1pAUj8rmPNVhAMa_Y1WFx6TObnTgStZLTeaAfa9qfFkC-7j4KaUmrGhpRLlJzjV2CXmXjYz1tR219s_tJEXD-zPB_DZ44nHuAQ4 Aug 24 10:15:24.117274 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:15:24.117274 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:15:24.117274 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:15:24.117274 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:15:24.117274 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:15:24.117274 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:15:24.117274 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d6a57c8760d34630aa410aa3f7a96edd Aug 24 10:15:24.117274 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-VolumesAdminNegativeTest-2143339667 Aug 24 10:15:24.117274 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:15:24.117274 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:15:24.118693 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d6a57c8760d34630aa410aa3f7a96edd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d6a57c8760d34630aa410aa3f7a96edd", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d6a57c8760d34630aa410aa3f7a96edd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d6a57c8760d34630aa410aa3f7a96edd"}]}] Aug 24 10:15:24.118693 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-VolumesAdminNegativeTest-2143339667 Aug 24 10:15:24.118693 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d6a57c8760d34630aa410aa3f7a96edd Aug 24 10:15:24.118693 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2143339667 Aug 24 10:15:24.118693 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-VolumesAdminNegativeTest-2143339667-project Aug 24 10:15:24.118693 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:15:24.118693 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:15:24.118693 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 360dc9ca253340f79dfb2c14f04c7445 Aug 24 10:15:24.118693 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-VolumesAdminNegativeTest-2143339667-project Aug 24 10:15:24.118693 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:15:24.118693 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance a626b1ea-4968-4e45-b2ab-4c11f06e6f85 could not be found. Aug 24 10:15:24.118693 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'a626b1ea-4968-4e45-b2ab-4c11f06e6f85'} Aug 24 10:15:24.119497 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:15:24.119497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:24.119497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:15:24.119497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:15:24.119497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:15:24.119497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:15:24.119497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:15:24.119497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:15:24.119497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:15:24.119497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:15:24.119497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a626b1ea-4968-4e45-b2ab-4c11f06e6f85 could not be found. Aug 24 10:15:24.119497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:24.119497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:15:24.119497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:24.119497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:24.119497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:15:24.119497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:15:24.119497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:15:24.119497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:15:24.119497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:15:24.120710 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:15:24.120710 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:15:24.120710 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:15:24.120710 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:15:24.120710 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:15:24.120710 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:15:24.120710 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:15:24.120710 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a626b1ea-4968-4e45-b2ab-4c11f06e6f85 could not be found. Aug 24 10:15:24.120710 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:24.120710 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:15:24.120710 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:24.120710 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:24.120710 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:15:24.120710 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:15:24.120710 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:15:24.120710 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:15:24.120710 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a626b1ea-4968-4e45-b2ab-4c11f06e6f85 could not be found. Aug 24 10:15:24.120710 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:24.123263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1e2bbe1d-eec2-4836-a2b9-0c471e0b63ee tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Returning 404 to user: Instance a626b1ea-4968-4e45-b2ab-4c11f06e6f85 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:15:24.124403 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1e2bbe1d-eec2-4836-a2b9-0c471e0b63ee tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85" status: 404 len: 111 microversion: 2.1 time: 0.088580 Aug 24 10:15:24.125215 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 548/1028] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:24 2022] GET /compute/v2.1/servers/a626b1ea-4968-4e45-b2ab-4c11f06e6f85 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:15:24.173427 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7e502f84-e3ff-4354-8bb2-f03b059afa2f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:24.174337 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7e502f84-e3ff-4354-8bb2-f03b059afa2f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:24.194713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e502f84-e3ff-4354-8bb2-f03b059afa2f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:24.198464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e502f84-e3ff-4354-8bb2-f03b059afa2f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:24.202333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e502f84-e3ff-4354-8bb2-f03b059afa2f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:24.206211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e502f84-e3ff-4354-8bb2-f03b059afa2f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:24.209110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e502f84-e3ff-4354-8bb2-f03b059afa2f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:24.211299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e502f84-e3ff-4354-8bb2-f03b059afa2f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:24.231314 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-41514ab2-4b0a-4b5d-b936-02807d4d8b06 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.698202 Aug 24 10:15:24.233388 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 481/1029] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:15:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:15:24.246909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e83a94a4-a214-4519-8ca2-4a595998cd51 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:24.271847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e83a94a4-a214-4519-8ca2-4a595998cd51 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:24.383389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e83a94a4-a214-4519-8ca2-4a595998cd51 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:24.405021 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e83a94a4-a214-4519-8ca2-4a595998cd51 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1278 microversion: 2.1 time: 0.163868 Aug 24 10:15:24.408299 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 482/1030] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:24 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:24.434515 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e19d1be1-605d-4a71-81f1-1042cc837fbb tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:24.435294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e19d1be1-605d-4a71-81f1-1042cc837fbb tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: db566c0d-ce6a-4d8d-bba4-c1480a160d01] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:24.455698 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e19d1be1-605d-4a71-81f1-1042cc837fbb tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:24.458093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e19d1be1-605d-4a71-81f1-1042cc837fbb tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:24.458647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e19d1be1-605d-4a71-81f1-1042cc837fbb tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:24.459416 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e19d1be1-605d-4a71-81f1-1042cc837fbb tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:24.459883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e19d1be1-605d-4a71-81f1-1042cc837fbb tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:24.460307 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e19d1be1-605d-4a71-81f1-1042cc837fbb tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:24.937391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e19d1be1-605d-4a71-81f1-1042cc837fbb tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:24.947887 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e19d1be1-605d-4a71-81f1-1042cc837fbb tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/db566c0d-ce6a-4d8d-bba4-c1480a160d01" status: 200 len: 1475 microversion: 2.1 time: 0.524916 Aug 24 10:15:24.961193 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 483/1031] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:24 2022] GET /compute/v2.1/servers/db566c0d-ce6a-4d8d-bba4-c1480a160d01 => generated 1475 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:24.965239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8e2e3aa5-f918-4d78-82d4-b665d9c7e83c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:24.965879 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8e2e3aa5-f918-4d78-82d4-b665d9c7e83c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:24.972329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e2e3aa5-f918-4d78-82d4-b665d9c7e83c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:24.973029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e2e3aa5-f918-4d78-82d4-b665d9c7e83c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:24.973702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e2e3aa5-f918-4d78-82d4-b665d9c7e83c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:24.974751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e2e3aa5-f918-4d78-82d4-b665d9c7e83c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:24.975390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e2e3aa5-f918-4d78-82d4-b665d9c7e83c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:24.976013 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e2e3aa5-f918-4d78-82d4-b665d9c7e83c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:25.014803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e2e3aa5-f918-4d78-82d4-b665d9c7e83c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:25.015593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e2e3aa5-f918-4d78-82d4-b665d9c7e83c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:25.016305 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e2e3aa5-f918-4d78-82d4-b665d9c7e83c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:25.016981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-8e2e3aa5-f918-4d78-82d4-b665d9c7e83c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lazy-loading 'fault' on Instance uuid c285a5a5-ba66-41c8-aa67-402e2d5f9159 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:15:25.171124 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8e2e3aa5-f918-4d78-82d4-b665d9c7e83c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c969980c07dd44b49d7ef299858fe109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b25f29b4a141f4b45518dba7332c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:25.188640 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8e2e3aa5-f918-4d78-82d4-b665d9c7e83c tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159" status: 200 len: 1314 microversion: 2.1 time: 0.226910 Aug 24 10:15:25.191261 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 484/1032] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:24 2022] GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:25.207164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b1d98770-afa3-465e-972e-108971eb424e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:25.209995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b1d98770-afa3-465e-972e-108971eb424e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:25.223769 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1d98770-afa3-465e-972e-108971eb424e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:25.231012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1d98770-afa3-465e-972e-108971eb424e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:25.231857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1d98770-afa3-465e-972e-108971eb424e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:25.232860 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1d98770-afa3-465e-972e-108971eb424e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:25.233564 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1d98770-afa3-465e-972e-108971eb424e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:25.234182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1d98770-afa3-465e-972e-108971eb424e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:25.478418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7e502f84-e3ff-4354-8bb2-f03b059afa2f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:25.503675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7e502f84-e3ff-4354-8bb2-f03b059afa2f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:25.516337 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7e502f84-e3ff-4354-8bb2-f03b059afa2f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:25.525892 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7e502f84-e3ff-4354-8bb2-f03b059afa2f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1813 microversion: 2.25 time: 1.359299 Aug 24 10:15:25.527951 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 549/1033] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:15:24 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1813 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:15:25.542555 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a6b48fbd-7080-4109-b288-3bbdcae0c613 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:25.550980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a6b48fbd-7080-4109-b288-3bbdcae0c613 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:25.564460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6b48fbd-7080-4109-b288-3bbdcae0c613 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:25.568502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6b48fbd-7080-4109-b288-3bbdcae0c613 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:25.570342 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6b48fbd-7080-4109-b288-3bbdcae0c613 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:25.572089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6b48fbd-7080-4109-b288-3bbdcae0c613 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:25.575939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6b48fbd-7080-4109-b288-3bbdcae0c613 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:25.576622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6b48fbd-7080-4109-b288-3bbdcae0c613 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:25.887933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a6b48fbd-7080-4109-b288-3bbdcae0c613 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:25.904493 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a6b48fbd-7080-4109-b288-3bbdcae0c613 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1274 microversion: 2.1 time: 0.373647 Aug 24 10:15:25.909283 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 550/1034] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:25 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1274 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:25.973723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cf53b0b0-089f-4c0d-ac9f-4dc6283f38be tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:25.974673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cf53b0b0-089f-4c0d-ac9f-4dc6283f38be tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: db566c0d-ce6a-4d8d-bba4-c1480a160d01] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:25.983817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf53b0b0-089f-4c0d-ac9f-4dc6283f38be tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:25.984889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf53b0b0-089f-4c0d-ac9f-4dc6283f38be tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:25.985602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf53b0b0-089f-4c0d-ac9f-4dc6283f38be tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:25.986716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf53b0b0-089f-4c0d-ac9f-4dc6283f38be tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:25.987397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf53b0b0-089f-4c0d-ac9f-4dc6283f38be tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:25.988117 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf53b0b0-089f-4c0d-ac9f-4dc6283f38be tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:26.294240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b1d98770-afa3-465e-972e-108971eb424e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:26.317936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:26.322759 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b1d98770-afa3-465e-972e-108971eb424e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 200 len: 1308 microversion: 2.1 time: 1.127291 Aug 24 10:15:26.334369 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 485/1035] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:25 2022] GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 1308 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:26.342753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d6b5d850-41e2-4da3-aa77-091f95c7eaa2 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:26.346466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d6b5d850-41e2-4da3-aa77-091f95c7eaa2 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] [instance: c285a5a5-ba66-41c8-aa67-402e2d5f9159] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:26.367339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6b5d850-41e2-4da3-aa77-091f95c7eaa2 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:26.382365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6b5d850-41e2-4da3-aa77-091f95c7eaa2 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:26.383608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6b5d850-41e2-4da3-aa77-091f95c7eaa2 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:26.385173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6b5d850-41e2-4da3-aa77-091f95c7eaa2 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:26.386314 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6b5d850-41e2-4da3-aa77-091f95c7eaa2 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:26.387536 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6b5d850-41e2-4da3-aa77-091f95c7eaa2 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:26.437177 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-d6b5d850-41e2-4da3-aa77-091f95c7eaa2 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] HTTP exception thrown: Instance c285a5a5-ba66-41c8-aa67-402e2d5f9159 could not be found. Aug 24 10:15:26.468040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d6b5d850-41e2-4da3-aa77-091f95c7eaa2 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Request method failure captured: Aug 24 10:15:26.468040 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159 HTTP/1.1 Aug 24 10:15:26.468040 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:15:26.468040 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:15:26.468040 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:15:26.468040 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:15:26.468040 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:15:26.468040 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:15:26.468040 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:15:26.468040 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:15:26.468040 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfm5kJ5FWnTs7P0zxeBGgL-wu3qC0mwWDuhEjFAghmyC5iKxoD4sp6B2oYcYmhNFNK7poQ5uBIlMPzvMjZLBDszbLIdfBFyKswV2Ahy49qc_Y5M2676Q6uAHbqMfpdtrG9t2VO18rXqqhwoQW-fSPlMv586r9CHLGHUZ80QFfmOHhBo Aug 24 10:15:26.468040 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:15:26.468040 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:15:26.468040 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:15:26.468040 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:15:26.468040 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:15:26.468040 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:15:26.468040 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 67b25f29b4a141f4b45518dba7332c3c Aug 24 10:15:26.468040 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-224357164 Aug 24 10:15:26.468040 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:15:26.468040 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:15:26.470567 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/67b25f29b4a141f4b45518dba7332c3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_67b25f29b4a141f4b45518dba7332c3c", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/67b25f29b4a141f4b45518dba7332c3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/67b25f29b4a141f4b45518dba7332c3c"}]}] Aug 24 10:15:26.470567 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-224357164 Aug 24 10:15:26.470567 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 67b25f29b4a141f4b45518dba7332c3c Aug 24 10:15:26.470567 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-224357164 Aug 24 10:15:26.470567 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-FloatingIPsAssociationTestJSON-224357164-project Aug 24 10:15:26.470567 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:15:26.470567 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:15:26.470567 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: c969980c07dd44b49d7ef299858fe109 Aug 24 10:15:26.470567 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-224357164-project Aug 24 10:15:26.470567 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:15:26.470567 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance c285a5a5-ba66-41c8-aa67-402e2d5f9159 could not be found. Aug 24 10:15:26.470567 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'c285a5a5-ba66-41c8-aa67-402e2d5f9159'} Aug 24 10:15:26.471937 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:15:26.471937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:26.471937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:15:26.471937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:15:26.471937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:15:26.471937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:15:26.471937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:15:26.471937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:15:26.471937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:15:26.471937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:15:26.471937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c285a5a5-ba66-41c8-aa67-402e2d5f9159 could not be found. Aug 24 10:15:26.471937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:26.471937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:15:26.471937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:26.471937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:26.471937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:15:26.471937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:15:26.471937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:15:26.471937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:15:26.471937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:15:26.475148 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:15:26.475148 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:15:26.475148 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:15:26.475148 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:15:26.475148 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:15:26.475148 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:15:26.475148 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:15:26.475148 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c285a5a5-ba66-41c8-aa67-402e2d5f9159 could not be found. Aug 24 10:15:26.475148 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:26.475148 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:15:26.475148 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:26.475148 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:26.475148 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:15:26.475148 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:15:26.475148 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:15:26.475148 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:15:26.475148 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c285a5a5-ba66-41c8-aa67-402e2d5f9159 could not be found. Aug 24 10:15:26.475148 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:26.481546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d6b5d850-41e2-4da3-aa77-091f95c7eaa2 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] Returning 404 to user: Instance c285a5a5-ba66-41c8-aa67-402e2d5f9159 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:15:26.481917 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d6b5d850-41e2-4da3-aa77-091f95c7eaa2 tempest-FloatingIPsAssociationTestJSON-224357164 tempest-FloatingIPsAssociationTestJSON-224357164-project] 10.222.0.85 "GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159" status: 404 len: 111 microversion: 2.1 time: 0.144728 Aug 24 10:15:26.484594 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 486/1036] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:26 2022] GET /compute/v2.1/servers/c285a5a5-ba66-41c8-aa67-402e2d5f9159 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:15:26.505025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:26.554558 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0640ae5e-1b8b-4b47-b4eb-e7cbb3890c1c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:26.558825 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0640ae5e-1b8b-4b47-b4eb-e7cbb3890c1c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:26.580795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0640ae5e-1b8b-4b47-b4eb-e7cbb3890c1c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:26.581621 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0640ae5e-1b8b-4b47-b4eb-e7cbb3890c1c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:26.582321 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0640ae5e-1b8b-4b47-b4eb-e7cbb3890c1c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:26.593329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0640ae5e-1b8b-4b47-b4eb-e7cbb3890c1c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:26.594121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0640ae5e-1b8b-4b47-b4eb-e7cbb3890c1c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:26.594839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0640ae5e-1b8b-4b47-b4eb-e7cbb3890c1c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:26.932991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cf53b0b0-089f-4c0d-ac9f-4dc6283f38be tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:26.958867 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cf53b0b0-089f-4c0d-ac9f-4dc6283f38be tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/db566c0d-ce6a-4d8d-bba4-c1480a160d01" status: 200 len: 1475 microversion: 2.1 time: 0.986535 Aug 24 10:15:26.960325 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 551/1037] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:25 2022] GET /compute/v2.1/servers/db566c0d-ce6a-4d8d-bba4-c1480a160d01 => generated 1475 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:15:26.974781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3392582-9199-4d76-bb64-86a56d72f63d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:26.985231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d3392582-9199-4d76-bb64-86a56d72f63d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:27.030758 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3392582-9199-4d76-bb64-86a56d72f63d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:27.031271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3392582-9199-4d76-bb64-86a56d72f63d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:27.031723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3392582-9199-4d76-bb64-86a56d72f63d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:27.032537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3392582-9199-4d76-bb64-86a56d72f63d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:27.033639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3392582-9199-4d76-bb64-86a56d72f63d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:27.034406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3392582-9199-4d76-bb64-86a56d72f63d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:27.330697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d3392582-9199-4d76-bb64-86a56d72f63d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:27.344230 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d3392582-9199-4d76-bb64-86a56d72f63d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1336 microversion: 2.1 time: 0.380862 Aug 24 10:15:27.345166 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 552/1038] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:26 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1336 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:27.353506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-29e7c27c-bc49-489c-8236-e8cdc116bc01 req-991fd569-86fe-4a17-94da-9d7312df9d7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b00174fc-a16c-4ae5-94d3-d43b9c963cf5", "name": "network-vif-deleted", "tag": "b9df294e-0c89-441c-835e-265525385287"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:27.375756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-29e7c27c-bc49-489c-8236-e8cdc116bc01 req-991fd569-86fe-4a17-94da-9d7312df9d7d service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:27.376243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-29e7c27c-bc49-489c-8236-e8cdc116bc01 req-991fd569-86fe-4a17-94da-9d7312df9d7d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:27.376666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-29e7c27c-bc49-489c-8236-e8cdc116bc01 req-991fd569-86fe-4a17-94da-9d7312df9d7d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:27.406477 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-29e7c27c-bc49-489c-8236-e8cdc116bc01 req-991fd569-86fe-4a17-94da-9d7312df9d7d service nova] Creating event network-vif-deleted:b9df294e-0c89-441c-835e-265525385287 for instance b00174fc-a16c-4ae5-94d3-d43b9c963cf5 on n-h1-849328-3 Aug 24 10:15:27.423440 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-29e7c27c-bc49-489c-8236-e8cdc116bc01 req-991fd569-86fe-4a17-94da-9d7312df9d7d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076955 Aug 24 10:15:27.430976 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 553/1039] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:27.441176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6ecb3452-5d4f-4fd3-9696-8c4960fe25c0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:27.443626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6ecb3452-5d4f-4fd3-9696-8c4960fe25c0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:27.459874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ecb3452-5d4f-4fd3-9696-8c4960fe25c0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:27.460843 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ecb3452-5d4f-4fd3-9696-8c4960fe25c0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:27.463754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ecb3452-5d4f-4fd3-9696-8c4960fe25c0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:27.464786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ecb3452-5d4f-4fd3-9696-8c4960fe25c0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:27.465460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ecb3452-5d4f-4fd3-9696-8c4960fe25c0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:27.466088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ecb3452-5d4f-4fd3-9696-8c4960fe25c0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:28.232767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6ecb3452-5d4f-4fd3-9696-8c4960fe25c0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:28.248710 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6ecb3452-5d4f-4fd3-9696-8c4960fe25c0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 200 len: 1487 microversion: 2.1 time: 0.815806 Aug 24 10:15:28.266619 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 554/1040] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:27 2022] GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 1487 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:28.277987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-e6313100-e59a-4c40-83f7-0477e6447c2b req-485813d0-276d-48aa-892a-b3693155d701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db566c0d-ce6a-4d8d-bba4-c1480a160d01", "name": "network-vif-deleted", "tag": "94316740-068c-4594-b2af-29996f90fa21"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:28.329003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e6313100-e59a-4c40-83f7-0477e6447c2b req-485813d0-276d-48aa-892a-b3693155d701 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:28.331150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e6313100-e59a-4c40-83f7-0477e6447c2b req-485813d0-276d-48aa-892a-b3693155d701 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:28.332140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e6313100-e59a-4c40-83f7-0477e6447c2b req-485813d0-276d-48aa-892a-b3693155d701 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:28.345576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:28.373208 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-e6313100-e59a-4c40-83f7-0477e6447c2b req-485813d0-276d-48aa-892a-b3693155d701 service nova] Creating event network-vif-deleted:94316740-068c-4594-b2af-29996f90fa21 for instance db566c0d-ce6a-4d8d-bba4-c1480a160d01 on n-h1-849328-3 Aug 24 10:15:28.393368 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-e6313100-e59a-4c40-83f7-0477e6447c2b req-485813d0-276d-48aa-892a-b3693155d701 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123012 Aug 24 10:15:28.395204 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 555/1041] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:28.410462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-85294317-502c-4772-86f9-123f05792d06 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:28.415816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-85294317-502c-4772-86f9-123f05792d06 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: db566c0d-ce6a-4d8d-bba4-c1480a160d01] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:28.431966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85294317-502c-4772-86f9-123f05792d06 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:28.433241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85294317-502c-4772-86f9-123f05792d06 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:28.436010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85294317-502c-4772-86f9-123f05792d06 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:28.439860 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85294317-502c-4772-86f9-123f05792d06 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:28.441686 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85294317-502c-4772-86f9-123f05792d06 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:28.444311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85294317-502c-4772-86f9-123f05792d06 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:28.572396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85294317-502c-4772-86f9-123f05792d06 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:28.572893 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85294317-502c-4772-86f9-123f05792d06 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:28.573359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85294317-502c-4772-86f9-123f05792d06 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:28.573820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-85294317-502c-4772-86f9-123f05792d06 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lazy-loading 'fault' on Instance uuid db566c0d-ce6a-4d8d-bba4-c1480a160d01 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:15:28.638185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0640ae5e-1b8b-4b47-b4eb-e7cbb3890c1c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:28.648258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0640ae5e-1b8b-4b47-b4eb-e7cbb3890c1c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:28.660274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0640ae5e-1b8b-4b47-b4eb-e7cbb3890c1c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:28.668494 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0640ae5e-1b8b-4b47-b4eb-e7cbb3890c1c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1813 microversion: 2.25 time: 2.116254 Aug 24 10:15:28.669413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-85294317-502c-4772-86f9-123f05792d06 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:28.670057 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 487/1042] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:15:26 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1813 bytes in 2124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:15:28.680784 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-85294317-502c-4772-86f9-123f05792d06 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/db566c0d-ce6a-4d8d-bba4-c1480a160d01" status: 200 len: 1309 microversion: 2.1 time: 0.281256 Aug 24 10:15:28.681468 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 556/1043] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:28 2022] GET /compute/v2.1/servers/db566c0d-ce6a-4d8d-bba4-c1480a160d01 => generated 1309 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:28.682889 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d469ec4-b142-468c-9ad9-cf2badc83a57 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:28.701400 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b807023f-d3e5-44f0-842b-bdfad3783fc0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:28.702381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b807023f-d3e5-44f0-842b-bdfad3783fc0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:28.704372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d469ec4-b142-468c-9ad9-cf2badc83a57 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:28.705340 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d469ec4-b142-468c-9ad9-cf2badc83a57 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:28.707232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d469ec4-b142-468c-9ad9-cf2badc83a57 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:28.716904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b807023f-d3e5-44f0-842b-bdfad3783fc0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:28.717496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b807023f-d3e5-44f0-842b-bdfad3783fc0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:28.717939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b807023f-d3e5-44f0-842b-bdfad3783fc0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:28.718696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b807023f-d3e5-44f0-842b-bdfad3783fc0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:28.719158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b807023f-d3e5-44f0-842b-bdfad3783fc0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:28.719584 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b807023f-d3e5-44f0-842b-bdfad3783fc0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:28.944368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9d469ec4-b142-468c-9ad9-cf2badc83a57 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Going to try to stop instance {{(pid=122432) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 10:15:29.045612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b807023f-d3e5-44f0-842b-bdfad3783fc0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:29.054623 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b807023f-d3e5-44f0-842b-bdfad3783fc0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1378 microversion: 2.1 time: 0.370718 Aug 24 10:15:29.055238 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 557/1044] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:28 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1378 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:29.123373 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9d469ec4-b142-468c-9ad9-cf2badc83a57 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "POST /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9/action" status: 202 len: 0 microversion: 2.1 time: 0.451663 Aug 24 10:15:29.124575 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 488/1045] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:15:28 2022] POST /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:15:29.137461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f32deb50-0f74-4a51-b177-2be4b2719b9d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:29.139108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f32deb50-0f74-4a51-b177-2be4b2719b9d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:29.161054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f32deb50-0f74-4a51-b177-2be4b2719b9d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:29.163413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f32deb50-0f74-4a51-b177-2be4b2719b9d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:29.165796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f32deb50-0f74-4a51-b177-2be4b2719b9d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:29.167698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f32deb50-0f74-4a51-b177-2be4b2719b9d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:29.168212 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f32deb50-0f74-4a51-b177-2be4b2719b9d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:29.168611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f32deb50-0f74-4a51-b177-2be4b2719b9d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:29.528835 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f32deb50-0f74-4a51-b177-2be4b2719b9d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:29.537454 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f32deb50-0f74-4a51-b177-2be4b2719b9d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 200 len: 1497 microversion: 2.1 time: 0.408827 Aug 24 10:15:29.544590 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 558/1046] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:29 2022] GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 1497 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:29.631138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bbe5ebe8-14c0-4076-9e2d-e717fde065a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1544944672", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "f9d3da2a-e7f1-4061-b1c2-835192cdb5b7"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:29.651206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:29.693458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2fbfb5b6-c176-4325-a5c6-ad643e6c2b76 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:29.694233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2fbfb5b6-c176-4325-a5c6-ad643e6c2b76 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:29.702302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fbfb5b6-c176-4325-a5c6-ad643e6c2b76 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:29.717740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fbfb5b6-c176-4325-a5c6-ad643e6c2b76 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:29.718436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fbfb5b6-c176-4325-a5c6-ad643e6c2b76 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:29.719482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fbfb5b6-c176-4325-a5c6-ad643e6c2b76 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:29.721737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fbfb5b6-c176-4325-a5c6-ad643e6c2b76 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:29.722377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fbfb5b6-c176-4325-a5c6-ad643e6c2b76 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:29.758598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-bbe5ebe8-14c0-4076-9e2d-e717fde065a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] validate_networks() for [('f9d3da2a-e7f1-4061-b1c2-835192cdb5b7', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:15:29.963463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2fbfb5b6-c176-4325-a5c6-ad643e6c2b76 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:29.979200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2fbfb5b6-c176-4325-a5c6-ad643e6c2b76 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:29.985232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2fbfb5b6-c176-4325-a5c6-ad643e6c2b76 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:29.986435 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2fbfb5b6-c176-4325-a5c6-ad643e6c2b76 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1813 microversion: 2.25 time: 0.297351 Aug 24 10:15:29.987085 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 559/1047] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:15:29 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1813 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:15:29.998668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-44e73e24-ac3a-4f89-84c2-297bc10c6939 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:29.999558 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-44e73e24-ac3a-4f89-84c2-297bc10c6939 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: db566c0d-ce6a-4d8d-bba4-c1480a160d01] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:30.013900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44e73e24-ac3a-4f89-84c2-297bc10c6939 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:30.018260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44e73e24-ac3a-4f89-84c2-297bc10c6939 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:30.018926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44e73e24-ac3a-4f89-84c2-297bc10c6939 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:30.019672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44e73e24-ac3a-4f89-84c2-297bc10c6939 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:30.020130 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44e73e24-ac3a-4f89-84c2-297bc10c6939 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:30.020552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44e73e24-ac3a-4f89-84c2-297bc10c6939 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:30.067575 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-44e73e24-ac3a-4f89-84c2-297bc10c6939 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] HTTP exception thrown: Instance db566c0d-ce6a-4d8d-bba4-c1480a160d01 could not be found. Aug 24 10:15:30.069165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-44e73e24-ac3a-4f89-84c2-297bc10c6939 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Request method failure captured: Aug 24 10:15:30.069165 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/db566c0d-ce6a-4d8d-bba4-c1480a160d01 HTTP/1.1 Aug 24 10:15:30.069165 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:15:30.069165 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:15:30.069165 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:15:30.069165 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:15:30.069165 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:15:30.069165 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:15:30.069165 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:15:30.069165 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:15:30.069165 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBflp1lR6NJiOvJ0jo0u_ObCwr-XT9ZPDd8UFdAdrktIeq9W3st8_Vr__ObGPpyUD3B1sX780QVeUxsP7WLsIfoEmJ6ZRyy4XuEoKUiYvCKqPo1TBHvl0EjfZLY21G0cKkNvRwmjK2bcnCfVvvo4RO0l6RUsKYrhQXpLAAKVAYjdEZcw Aug 24 10:15:30.069165 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:15:30.069165 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:15:30.069165 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:15:30.069165 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:15:30.069165 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:15:30.069165 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:15:30.069165 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: f2e2ee3e278042a5bf8ee7348966a468 Aug 24 10:15:30.069165 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersOnMultiNodesTest-1510468885 Aug 24 10:15:30.069165 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:15:30.069165 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:15:30.070762 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f2e2ee3e278042a5bf8ee7348966a468"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f2e2ee3e278042a5bf8ee7348966a468", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f2e2ee3e278042a5bf8ee7348966a468"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f2e2ee3e278042a5bf8ee7348966a468"}]}] Aug 24 10:15:30.070762 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersOnMultiNodesTest-1510468885 Aug 24 10:15:30.070762 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: f2e2ee3e278042a5bf8ee7348966a468 Aug 24 10:15:30.070762 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1510468885 Aug 24 10:15:30.070762 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersOnMultiNodesTest-1510468885-project Aug 24 10:15:30.070762 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:15:30.070762 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:15:30.070762 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: bf03c0eb5bd748ae85be830f1121dc06 Aug 24 10:15:30.070762 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersOnMultiNodesTest-1510468885-project Aug 24 10:15:30.070762 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:15:30.070762 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance db566c0d-ce6a-4d8d-bba4-c1480a160d01 could not be found. Aug 24 10:15:30.070762 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'db566c0d-ce6a-4d8d-bba4-c1480a160d01'} Aug 24 10:15:30.071638 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:15:30.071638 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:30.071638 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:15:30.071638 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:15:30.071638 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:15:30.071638 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:15:30.071638 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:15:30.071638 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:15:30.071638 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:15:30.071638 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:15:30.071638 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db566c0d-ce6a-4d8d-bba4-c1480a160d01 could not be found. Aug 24 10:15:30.071638 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:30.071638 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:15:30.071638 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:30.071638 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:30.071638 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:15:30.071638 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:15:30.071638 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:15:30.071638 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:15:30.071638 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:15:30.073053 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:15:30.073053 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:15:30.073053 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:15:30.073053 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:15:30.073053 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:15:30.073053 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:15:30.073053 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:15:30.073053 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db566c0d-ce6a-4d8d-bba4-c1480a160d01 could not be found. Aug 24 10:15:30.073053 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:30.073053 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:15:30.073053 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:30.073053 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:30.073053 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:15:30.073053 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:15:30.073053 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:15:30.073053 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:15:30.073053 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db566c0d-ce6a-4d8d-bba4-c1480a160d01 could not be found. Aug 24 10:15:30.073053 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:30.074419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-44e73e24-ac3a-4f89-84c2-297bc10c6939 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Returning 404 to user: Instance db566c0d-ce6a-4d8d-bba4-c1480a160d01 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:15:30.074419 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-44e73e24-ac3a-4f89-84c2-297bc10c6939 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/db566c0d-ce6a-4d8d-bba4-c1480a160d01" status: 404 len: 111 microversion: 2.1 time: 0.081630 Aug 24 10:15:30.074419 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 560/1048] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:29 2022] GET /compute/v2.1/servers/db566c0d-ce6a-4d8d-bba4-c1480a160d01 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:15:30.078876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f14beee1-0bc2-42bc-95c4-12d7d85e1c59 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:30.079695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f14beee1-0bc2-42bc-95c4-12d7d85e1c59 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:30.092392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f14beee1-0bc2-42bc-95c4-12d7d85e1c59 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:30.093446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f14beee1-0bc2-42bc-95c4-12d7d85e1c59 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:30.094042 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f14beee1-0bc2-42bc-95c4-12d7d85e1c59 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:30.095127 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f14beee1-0bc2-42bc-95c4-12d7d85e1c59 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:30.095738 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f14beee1-0bc2-42bc-95c4-12d7d85e1c59 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:30.096345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f14beee1-0bc2-42bc-95c4-12d7d85e1c59 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:30.383138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f14beee1-0bc2-42bc-95c4-12d7d85e1c59 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:30.400037 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f14beee1-0bc2-42bc-95c4-12d7d85e1c59 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1378 microversion: 2.1 time: 0.321329 Aug 24 10:15:30.400825 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 561/1049] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:30 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1378 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:30.420124 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1443d70e-e094-4c6c-b1c8-0b3cbd27c358 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:30.421252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1443d70e-e094-4c6c-b1c8-0b3cbd27c358 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: b00174fc-a16c-4ae5-94d3-d43b9c963cf5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:30.427906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1443d70e-e094-4c6c-b1c8-0b3cbd27c358 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:30.428598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1443d70e-e094-4c6c-b1c8-0b3cbd27c358 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:30.429563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1443d70e-e094-4c6c-b1c8-0b3cbd27c358 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:30.430629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1443d70e-e094-4c6c-b1c8-0b3cbd27c358 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:30.431276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1443d70e-e094-4c6c-b1c8-0b3cbd27c358 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:30.431842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1443d70e-e094-4c6c-b1c8-0b3cbd27c358 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:30.468232 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-1443d70e-e094-4c6c-b1c8-0b3cbd27c358 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] HTTP exception thrown: Instance b00174fc-a16c-4ae5-94d3-d43b9c963cf5 could not be found. Aug 24 10:15:30.470141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1443d70e-e094-4c6c-b1c8-0b3cbd27c358 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Request method failure captured: Aug 24 10:15:30.470141 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/b00174fc-a16c-4ae5-94d3-d43b9c963cf5 HTTP/1.1 Aug 24 10:15:30.470141 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:15:30.470141 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:15:30.470141 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:15:30.470141 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:15:30.470141 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:15:30.470141 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:15:30.470141 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:15:30.470141 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:15:30.470141 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBflp1lR6NJiOvJ0jo0u_ObCwr-XT9ZPDd8UFdAdrktIeq9W3st8_Vr__ObGPpyUD3B1sX780QVeUxsP7WLsIfoEmJ6ZRyy4XuEoKUiYvCKqPo1TBHvl0EjfZLY21G0cKkNvRwmjK2bcnCfVvvo4RO0l6RUsKYrhQXpLAAKVAYjdEZcw Aug 24 10:15:30.470141 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:15:30.470141 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:15:30.470141 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:15:30.470141 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:15:30.470141 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:15:30.470141 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:15:30.470141 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: f2e2ee3e278042a5bf8ee7348966a468 Aug 24 10:15:30.470141 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersOnMultiNodesTest-1510468885 Aug 24 10:15:30.470141 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:15:30.470141 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:15:30.471695 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f2e2ee3e278042a5bf8ee7348966a468"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f2e2ee3e278042a5bf8ee7348966a468", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f2e2ee3e278042a5bf8ee7348966a468"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f2e2ee3e278042a5bf8ee7348966a468"}]}] Aug 24 10:15:30.471695 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersOnMultiNodesTest-1510468885 Aug 24 10:15:30.471695 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: f2e2ee3e278042a5bf8ee7348966a468 Aug 24 10:15:30.471695 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1510468885 Aug 24 10:15:30.471695 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersOnMultiNodesTest-1510468885-project Aug 24 10:15:30.471695 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:15:30.471695 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:15:30.471695 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: bf03c0eb5bd748ae85be830f1121dc06 Aug 24 10:15:30.471695 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersOnMultiNodesTest-1510468885-project Aug 24 10:15:30.471695 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:15:30.471695 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance b00174fc-a16c-4ae5-94d3-d43b9c963cf5 could not be found. Aug 24 10:15:30.471695 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'b00174fc-a16c-4ae5-94d3-d43b9c963cf5'} Aug 24 10:15:30.472567 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:15:30.472567 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:30.472567 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:15:30.472567 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:15:30.472567 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:15:30.472567 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:15:30.472567 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:15:30.472567 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:15:30.472567 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:15:30.472567 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:15:30.472567 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b00174fc-a16c-4ae5-94d3-d43b9c963cf5 could not be found. Aug 24 10:15:30.472567 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:30.472567 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:15:30.472567 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:30.472567 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:30.472567 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:15:30.472567 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:15:30.472567 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:15:30.472567 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:15:30.472567 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:15:30.473993 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:15:30.473993 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:15:30.473993 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:15:30.473993 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:15:30.473993 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:15:30.473993 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:15:30.473993 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:15:30.473993 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b00174fc-a16c-4ae5-94d3-d43b9c963cf5 could not be found. Aug 24 10:15:30.473993 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:30.473993 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:15:30.473993 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:30.473993 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:30.473993 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:15:30.473993 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:15:30.473993 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:15:30.473993 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:15:30.473993 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b00174fc-a16c-4ae5-94d3-d43b9c963cf5 could not be found. Aug 24 10:15:30.473993 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:30.475953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1443d70e-e094-4c6c-b1c8-0b3cbd27c358 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Returning 404 to user: Instance b00174fc-a16c-4ae5-94d3-d43b9c963cf5 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:15:30.477381 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1443d70e-e094-4c6c-b1c8-0b3cbd27c358 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/b00174fc-a16c-4ae5-94d3-d43b9c963cf5" status: 404 len: 111 microversion: 2.1 time: 0.062816 Aug 24 10:15:30.478412 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 562/1050] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:30 2022] GET /compute/v2.1/servers/b00174fc-a16c-4ae5-94d3-d43b9c963cf5 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:15:30.488624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-90455eb6-106f-42cb-a682-06c0883f21ad tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:30.556967 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-90455eb6-106f-42cb-a682-06c0883f21ad tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "DELETE /compute/v2.1/os-server-groups/231c8b11-a163-483b-b7a0-21f5ef8e7282" status: 204 len: 0 microversion: 2.1 time: 0.073681 Aug 24 10:15:30.567120 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 563/1051] 10.222.0.85 () {58 vars in 1266 bytes} [Wed Aug 24 10:15:30 2022] DELETE /compute/v2.1/os-server-groups/231c8b11-a163-483b-b7a0-21f5ef8e7282 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:15:30.575116 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5aab5fc9-5dd4-45b5-814e-eec965afc759 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:30.588279 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5aab5fc9-5dd4-45b5-814e-eec965afc759 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:30.606087 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5aab5fc9-5dd4-45b5-814e-eec965afc759 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:30.608010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5aab5fc9-5dd4-45b5-814e-eec965afc759 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:30.610206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5aab5fc9-5dd4-45b5-814e-eec965afc759 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:30.611647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5aab5fc9-5dd4-45b5-814e-eec965afc759 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:30.613048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5aab5fc9-5dd4-45b5-814e-eec965afc759 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:30.618419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5aab5fc9-5dd4-45b5-814e-eec965afc759 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:31.030328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5aab5fc9-5dd4-45b5-814e-eec965afc759 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:31.047958 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5aab5fc9-5dd4-45b5-814e-eec965afc759 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 200 len: 1497 microversion: 2.1 time: 0.479387 Aug 24 10:15:31.048942 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 564/1052] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:30 2022] GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 1497 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:31.060532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7dfa3e43-ec28-47da-9171-95ebeaff35bc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:31.061324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7dfa3e43-ec28-47da-9171-95ebeaff35bc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: c7ad4cc6-0ddc-47f9-b386-1e0dde47808f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:31.076352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7dfa3e43-ec28-47da-9171-95ebeaff35bc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:31.077105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7dfa3e43-ec28-47da-9171-95ebeaff35bc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:31.079111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7dfa3e43-ec28-47da-9171-95ebeaff35bc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:31.080485 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7dfa3e43-ec28-47da-9171-95ebeaff35bc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:31.083223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7dfa3e43-ec28-47da-9171-95ebeaff35bc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:31.085052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7dfa3e43-ec28-47da-9171-95ebeaff35bc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:31.157387 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7dfa3e43-ec28-47da-9171-95ebeaff35bc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: c7ad4cc6-0ddc-47f9-b386-1e0dde47808f] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:15:31.323872 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7dfa3e43-ec28-47da-9171-95ebeaff35bc tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "DELETE /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f" status: 204 len: 0 microversion: 2.1 time: 0.273273 Aug 24 10:15:31.326098 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 565/1053] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:15:31 2022] DELETE /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:15:31.339045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ddc77d51-4d47-4751-a15d-f561ee8587bf tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:31.344311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ddc77d51-4d47-4751-a15d-f561ee8587bf tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:31.358540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddc77d51-4d47-4751-a15d-f561ee8587bf tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:31.359667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddc77d51-4d47-4751-a15d-f561ee8587bf tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:31.360544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddc77d51-4d47-4751-a15d-f561ee8587bf tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:31.362989 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddc77d51-4d47-4751-a15d-f561ee8587bf tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:31.363696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddc77d51-4d47-4751-a15d-f561ee8587bf tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:31.365511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddc77d51-4d47-4751-a15d-f561ee8587bf tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:31.662651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ddc77d51-4d47-4751-a15d-f561ee8587bf tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:31.676881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ddc77d51-4d47-4751-a15d-f561ee8587bf tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:31.684779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ddc77d51-4d47-4751-a15d-f561ee8587bf tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:31.689872 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ddc77d51-4d47-4751-a15d-f561ee8587bf tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1813 microversion: 2.25 time: 0.360237 Aug 24 10:15:31.691591 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 566/1054] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:15:31 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1813 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:15:31.704551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2018b928-cad2-4f7f-8ec3-aaa4c531b67d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:31.705540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2018b928-cad2-4f7f-8ec3-aaa4c531b67d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:31.726387 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2018b928-cad2-4f7f-8ec3-aaa4c531b67d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:31.730331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2018b928-cad2-4f7f-8ec3-aaa4c531b67d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:31.734263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2018b928-cad2-4f7f-8ec3-aaa4c531b67d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:31.742456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2018b928-cad2-4f7f-8ec3-aaa4c531b67d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:31.744805 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2018b928-cad2-4f7f-8ec3-aaa4c531b67d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:31.748170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2018b928-cad2-4f7f-8ec3-aaa4c531b67d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:31.815698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2018b928-cad2-4f7f-8ec3-aaa4c531b67d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:15:31.974361 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2018b928-cad2-4f7f-8ec3-aaa4c531b67d tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "DELETE /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381" status: 204 len: 0 microversion: 2.1 time: 0.281004 Aug 24 10:15:31.975513 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 567/1055] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:15:31 2022] DELETE /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:15:31.986881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-39216795-a292-48d1-9d0d-6bd0e697085a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:31.987896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-39216795-a292-48d1-9d0d-6bd0e697085a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: c7ad4cc6-0ddc-47f9-b386-1e0dde47808f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:31.997458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39216795-a292-48d1-9d0d-6bd0e697085a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:31.998540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39216795-a292-48d1-9d0d-6bd0e697085a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:31.999511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39216795-a292-48d1-9d0d-6bd0e697085a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:32.000453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39216795-a292-48d1-9d0d-6bd0e697085a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:32.001009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39216795-a292-48d1-9d0d-6bd0e697085a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:32.001817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39216795-a292-48d1-9d0d-6bd0e697085a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:32.244256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-39216795-a292-48d1-9d0d-6bd0e697085a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:32.255368 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-39216795-a292-48d1-9d0d-6bd0e697085a tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f" status: 200 len: 1472 microversion: 2.1 time: 0.278275 Aug 24 10:15:32.256227 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 568/1056] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:31 2022] GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f => generated 1472 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:32.267059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6c000d76-941f-4494-a8d0-2d6aac670c91 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:32.270263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6c000d76-941f-4494-a8d0-2d6aac670c91 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:32.285477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c000d76-941f-4494-a8d0-2d6aac670c91 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:32.286435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c000d76-941f-4494-a8d0-2d6aac670c91 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:32.287077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c000d76-941f-4494-a8d0-2d6aac670c91 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:32.287919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c000d76-941f-4494-a8d0-2d6aac670c91 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:32.288590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c000d76-941f-4494-a8d0-2d6aac670c91 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:32.289267 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c000d76-941f-4494-a8d0-2d6aac670c91 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:32.422511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bbe5ebe8-14c0-4076-9e2d-e717fde065a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:15:32.423557 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bbe5ebe8-14c0-4076-9e2d-e717fde065a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:15:32.424236 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bbe5ebe8-14c0-4076-9e2d-e717fde065a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:15:32.424970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bbe5ebe8-14c0-4076-9e2d-e717fde065a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:15:32.427081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bbe5ebe8-14c0-4076-9e2d-e717fde065a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:15:32.460581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbe5ebe8-14c0-4076-9e2d-e717fde065a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:32.463872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbe5ebe8-14c0-4076-9e2d-e717fde065a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:32.465850 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbe5ebe8-14c0-4076-9e2d-e717fde065a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:32.467010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbe5ebe8-14c0-4076-9e2d-e717fde065a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:32.469794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbe5ebe8-14c0-4076-9e2d-e717fde065a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:32.473964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbe5ebe8-14c0-4076-9e2d-e717fde065a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:32.604301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-bbe5ebe8-14c0-4076-9e2d-e717fde065a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Getting quotas for project 6f266868d6374a82a4ba5333915a9884. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:15:32.634852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-bbe5ebe8-14c0-4076-9e2d-e717fde065a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Getting quotas for user b321b1490c2b4fe3aa1a1747b25408a1 and project 6f266868d6374a82a4ba5333915a9884. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:15:32.673238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bbe5ebe8-14c0-4076-9e2d-e717fde065a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:15:32.678461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bbe5ebe8-14c0-4076-9e2d-e717fde065a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:15:32.768900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6c000d76-941f-4494-a8d0-2d6aac670c91 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:32.784244 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6c000d76-941f-4494-a8d0-2d6aac670c91 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1378 microversion: 2.1 time: 0.524801 Aug 24 10:15:32.785756 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 569/1057] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:32 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1378 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:32.812264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ccbf21b0-76c4-4eeb-9e15-7fd422b4d365 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:32.812934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ccbf21b0-76c4-4eeb-9e15-7fd422b4d365 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:32.827923 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bbe5ebe8-14c0-4076-9e2d-e717fde065a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.579887 Aug 24 10:15:32.836604 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 489/1058] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:15:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:15:32.840056 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ccbf21b0-76c4-4eeb-9e15-7fd422b4d365 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:32.841026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ccbf21b0-76c4-4eeb-9e15-7fd422b4d365 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:32.842049 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ccbf21b0-76c4-4eeb-9e15-7fd422b4d365 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:32.845489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ccbf21b0-76c4-4eeb-9e15-7fd422b4d365 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:32.846243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ccbf21b0-76c4-4eeb-9e15-7fd422b4d365 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:32.846664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2ccc09d5-e125-40d6-b444-d52cc5f731ed tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:32.847608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2ccc09d5-e125-40d6-b444-d52cc5f731ed tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:32.847855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ccbf21b0-76c4-4eeb-9e15-7fd422b4d365 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:32.867177 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ccc09d5-e125-40d6-b444-d52cc5f731ed tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:32.868243 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ccc09d5-e125-40d6-b444-d52cc5f731ed tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:32.871554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ccc09d5-e125-40d6-b444-d52cc5f731ed tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:32.874638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ccc09d5-e125-40d6-b444-d52cc5f731ed tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:32.877770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ccc09d5-e125-40d6-b444-d52cc5f731ed tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:32.878502 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ccc09d5-e125-40d6-b444-d52cc5f731ed tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:33.161527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ccbf21b0-76c4-4eeb-9e15-7fd422b4d365 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:33.172985 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ccbf21b0-76c4-4eeb-9e15-7fd422b4d365 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381" status: 200 len: 1679 microversion: 2.1 time: 0.385881 Aug 24 10:15:33.173909 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 570/1059] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:32 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381 => generated 1679 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:33.194987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-7b4a071a-78bb-42fb-a4d5-68a871706c3d req-cc345504-9e71-4f74-90ca-3b06f96aaf45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35c8116a-830a-4f60-9d70-34eacd719c08", "tag": "6676526f-444f-4a1b-94b1-f417a9a55ffa"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:33.236491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7b4a071a-78bb-42fb-a4d5-68a871706c3d req-cc345504-9e71-4f74-90ca-3b06f96aaf45 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:33.237701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7b4a071a-78bb-42fb-a4d5-68a871706c3d req-cc345504-9e71-4f74-90ca-3b06f96aaf45 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:33.238168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7b4a071a-78bb-42fb-a4d5-68a871706c3d req-cc345504-9e71-4f74-90ca-3b06f96aaf45 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:33.267975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:33.270118 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-7b4a071a-78bb-42fb-a4d5-68a871706c3d req-cc345504-9e71-4f74-90ca-3b06f96aaf45 service nova] Creating event network-changed:6676526f-444f-4a1b-94b1-f417a9a55ffa for instance 35c8116a-830a-4f60-9d70-34eacd719c08 on n-h2-849328-3 Aug 24 10:15:33.275593 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-7b4a071a-78bb-42fb-a4d5-68a871706c3d req-cc345504-9e71-4f74-90ca-3b06f96aaf45 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084458 Aug 24 10:15:33.276564 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 571/1060] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:33.282147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-838e7d1f-9c10-47c3-85eb-cd0c7b6e5ab5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:33.292087 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-838e7d1f-9c10-47c3-85eb-cd0c7b6e5ab5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:33.295097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=6,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:33.322605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-838e7d1f-9c10-47c3-85eb-cd0c7b6e5ab5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:33.325864 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-838e7d1f-9c10-47c3-85eb-cd0c7b6e5ab5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:33.329884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-838e7d1f-9c10-47c3-85eb-cd0c7b6e5ab5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:33.331066 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-838e7d1f-9c10-47c3-85eb-cd0c7b6e5ab5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:33.331785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-838e7d1f-9c10-47c3-85eb-cd0c7b6e5ab5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:33.332461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-838e7d1f-9c10-47c3-85eb-cd0c7b6e5ab5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:33.668133 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-838e7d1f-9c10-47c3-85eb-cd0c7b6e5ab5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:33.707289 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-838e7d1f-9c10-47c3-85eb-cd0c7b6e5ab5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:33.715043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-838e7d1f-9c10-47c3-85eb-cd0c7b6e5ab5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:33.718229 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-838e7d1f-9c10-47c3-85eb-cd0c7b6e5ab5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1813 microversion: 2.25 time: 0.440259 Aug 24 10:15:33.722162 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 572/1061] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:15:33 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1813 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:15:33.742777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a6d69937-844d-4028-95cb-4c2a3a03b743 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:33.745635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a6d69937-844d-4028-95cb-4c2a3a03b743 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:33.868600 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a6d69937-844d-4028-95cb-4c2a3a03b743 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:33.881830 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a6d69937-844d-4028-95cb-4c2a3a03b743 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1211 microversion: 2.1 time: 0.157330 Aug 24 10:15:33.885913 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 573/1062] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:33 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1211 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:34.219809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f8cbce30-adae-48ac-a449-23c1274afbc6 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-984392378", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:34.340697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-f8cbce30-adae-48ac-a449-23c1274afbc6 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:15:34.471116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2ccc09d5-e125-40d6-b444-d52cc5f731ed tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:34.482999 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2ccc09d5-e125-40d6-b444-d52cc5f731ed tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 200 len: 1497 microversion: 2.1 time: 1.644666 Aug 24 10:15:34.493797 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 490/1063] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:32 2022] GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 1497 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:34.519711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-21919df7-9a7c-4f02-89c1-68a1cb8ab705 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:34.522186 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-21919df7-9a7c-4f02-89c1-68a1cb8ab705 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: c7ad4cc6-0ddc-47f9-b386-1e0dde47808f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:34.544938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21919df7-9a7c-4f02-89c1-68a1cb8ab705 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:34.545537 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21919df7-9a7c-4f02-89c1-68a1cb8ab705 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:34.548520 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21919df7-9a7c-4f02-89c1-68a1cb8ab705 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:34.549718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21919df7-9a7c-4f02-89c1-68a1cb8ab705 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:34.551953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21919df7-9a7c-4f02-89c1-68a1cb8ab705 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:34.552631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21919df7-9a7c-4f02-89c1-68a1cb8ab705 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:34.711539 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-21919df7-9a7c-4f02-89c1-68a1cb8ab705 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf03c0eb5bd748ae85be830f1121dc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e2ee3e278042a5bf8ee7348966a468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:34.727254 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-21919df7-9a7c-4f02-89c1-68a1cb8ab705 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f" status: 200 len: 1430 microversion: 2.1 time: 0.231303 Aug 24 10:15:34.727897 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 491/1064] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:34 2022] GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f => generated 1430 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:34.757513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-544ced65-0213-4c7f-867a-b1f381a1fed1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:34.758550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-544ced65-0213-4c7f-867a-b1f381a1fed1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:34.769212 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-544ced65-0213-4c7f-867a-b1f381a1fed1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:34.770089 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-544ced65-0213-4c7f-867a-b1f381a1fed1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:34.770752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-544ced65-0213-4c7f-867a-b1f381a1fed1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:34.771718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-544ced65-0213-4c7f-867a-b1f381a1fed1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:34.772434 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-544ced65-0213-4c7f-867a-b1f381a1fed1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:34.773106 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-544ced65-0213-4c7f-867a-b1f381a1fed1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:34.915974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-f8cbce30-adae-48ac-a449-23c1274afbc6 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:15:34.915974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-f8cbce30-adae-48ac-a449-23c1274afbc6 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:15:34.920236 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-f8cbce30-adae-48ac-a449-23c1274afbc6 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:15:34.920633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-f8cbce30-adae-48ac-a449-23c1274afbc6 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:15:34.921059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-f8cbce30-adae-48ac-a449-23c1274afbc6 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:15:34.934279 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8cbce30-adae-48ac-a449-23c1274afbc6 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:34.934622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8cbce30-adae-48ac-a449-23c1274afbc6 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:34.935070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8cbce30-adae-48ac-a449-23c1274afbc6 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:34.935986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8cbce30-adae-48ac-a449-23c1274afbc6 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:34.936813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8cbce30-adae-48ac-a449-23c1274afbc6 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:34.937455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8cbce30-adae-48ac-a449-23c1274afbc6 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:34.966705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f8cbce30-adae-48ac-a449-23c1274afbc6 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Getting quotas for project e6dcc3fc5b544363b1fcaadd50ea948a. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:15:34.973207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f8cbce30-adae-48ac-a449-23c1274afbc6 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Getting quotas for user 965e7789d7d942a793b07f71dd407fd8 and project e6dcc3fc5b544363b1fcaadd50ea948a. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:15:34.988096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f8cbce30-adae-48ac-a449-23c1274afbc6 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:15:34.990810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f8cbce30-adae-48ac-a449-23c1274afbc6 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:15:35.098123 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f8cbce30-adae-48ac-a449-23c1274afbc6 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.208826 Aug 24 10:15:35.105131 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 574/1065] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:15:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:15:35.120378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3a5b6c82-461d-4a38-a93d-99e63405b7a3 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:35.121717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3a5b6c82-461d-4a38-a93d-99e63405b7a3 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:35.141364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a5b6c82-461d-4a38-a93d-99e63405b7a3 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:35.149554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a5b6c82-461d-4a38-a93d-99e63405b7a3 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:35.151377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a5b6c82-461d-4a38-a93d-99e63405b7a3 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:35.152813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a5b6c82-461d-4a38-a93d-99e63405b7a3 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:35.155753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a5b6c82-461d-4a38-a93d-99e63405b7a3 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:35.156407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a5b6c82-461d-4a38-a93d-99e63405b7a3 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:35.595702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-544ced65-0213-4c7f-867a-b1f381a1fed1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:35.604002 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-544ced65-0213-4c7f-867a-b1f381a1fed1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1378 microversion: 2.1 time: 0.872274 Aug 24 10:15:35.608244 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 492/1066] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:34 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1378 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:35.627172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3dfe75a5-b5d6-48f5-8840-dd9780441a60 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:35.630753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3dfe75a5-b5d6-48f5-8840-dd9780441a60 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:35.644064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dfe75a5-b5d6-48f5-8840-dd9780441a60 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:35.647008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dfe75a5-b5d6-48f5-8840-dd9780441a60 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:35.647588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dfe75a5-b5d6-48f5-8840-dd9780441a60 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:35.649382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dfe75a5-b5d6-48f5-8840-dd9780441a60 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:35.650156 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dfe75a5-b5d6-48f5-8840-dd9780441a60 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:35.652992 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dfe75a5-b5d6-48f5-8840-dd9780441a60 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:35.680947 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3a5b6c82-461d-4a38-a93d-99e63405b7a3 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:35.692988 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3a5b6c82-461d-4a38-a93d-99e63405b7a3 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381" status: 200 len: 1679 microversion: 2.1 time: 0.583005 Aug 24 10:15:35.694084 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 575/1067] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:35 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381 => generated 1679 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:35.701003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cf60a821-1518-40e2-9a12-b5cfed4c0941 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:35.703529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cf60a821-1518-40e2-9a12-b5cfed4c0941 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:35.715660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf60a821-1518-40e2-9a12-b5cfed4c0941 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:35.717320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf60a821-1518-40e2-9a12-b5cfed4c0941 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:35.718037 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf60a821-1518-40e2-9a12-b5cfed4c0941 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:35.719518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf60a821-1518-40e2-9a12-b5cfed4c0941 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:35.720370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf60a821-1518-40e2-9a12-b5cfed4c0941 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:35.721031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf60a821-1518-40e2-9a12-b5cfed4c0941 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:35.892148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cf60a821-1518-40e2-9a12-b5cfed4c0941 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:35.912647 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cf60a821-1518-40e2-9a12-b5cfed4c0941 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1269 microversion: 2.1 time: 0.217004 Aug 24 10:15:35.928654 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 576/1068] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:35 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1269 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:35.937367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8afb15a4-e44f-43b6-b26f-ba1bf7a4d4fd tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1559980776", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:36.027113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-8afb15a4-e44f-43b6-b26f-ba1bf7a4d4fd tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:15:36.188328 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3dfe75a5-b5d6-48f5-8840-dd9780441a60 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:36.206405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3dfe75a5-b5d6-48f5-8840-dd9780441a60 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:36.208960 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3dfe75a5-b5d6-48f5-8840-dd9780441a60 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:36.211122 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3dfe75a5-b5d6-48f5-8840-dd9780441a60 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1813 microversion: 2.25 time: 0.601221 Aug 24 10:15:36.213088 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 493/1069] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:15:35 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1813 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:15:36.235223 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-948b8f5c-68f4-40e7-9caf-114a2d68744e req-abef4206-6eda-4f09-a59d-62ffff953fbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7ad4cc6-0ddc-47f9-b386-1e0dde47808f", "name": "network-vif-deleted", "tag": "58e03dc7-a396-4e6d-9258-6792561d67a1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:36.252129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-948b8f5c-68f4-40e7-9caf-114a2d68744e req-abef4206-6eda-4f09-a59d-62ffff953fbc service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:36.253008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-948b8f5c-68f4-40e7-9caf-114a2d68744e req-abef4206-6eda-4f09-a59d-62ffff953fbc service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:36.253679 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-948b8f5c-68f4-40e7-9caf-114a2d68744e req-abef4206-6eda-4f09-a59d-62ffff953fbc service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:36.275823 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-948b8f5c-68f4-40e7-9caf-114a2d68744e req-abef4206-6eda-4f09-a59d-62ffff953fbc service nova] Creating event network-vif-deleted:58e03dc7-a396-4e6d-9258-6792561d67a1 for instance c7ad4cc6-0ddc-47f9-b386-1e0dde47808f on n-h1-849328-3 Aug 24 10:15:36.290804 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-948b8f5c-68f4-40e7-9caf-114a2d68744e req-abef4206-6eda-4f09-a59d-62ffff953fbc service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075077 Aug 24 10:15:36.291744 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 494/1070] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:36.297343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eebcfada-1dc2-445b-b573-5ff22ffc64bc tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:36.298049 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eebcfada-1dc2-445b-b573-5ff22ffc64bc tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:36.324528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eebcfada-1dc2-445b-b573-5ff22ffc64bc tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:36.327162 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eebcfada-1dc2-445b-b573-5ff22ffc64bc tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:36.328041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eebcfada-1dc2-445b-b573-5ff22ffc64bc tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:36.329917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eebcfada-1dc2-445b-b573-5ff22ffc64bc tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:36.330412 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eebcfada-1dc2-445b-b573-5ff22ffc64bc tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:36.330930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eebcfada-1dc2-445b-b573-5ff22ffc64bc tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:36.517802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8afb15a4-e44f-43b6-b26f-ba1bf7a4d4fd tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:15:36.519463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8afb15a4-e44f-43b6-b26f-ba1bf7a4d4fd tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:15:36.519672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8afb15a4-e44f-43b6-b26f-ba1bf7a4d4fd tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:15:36.520054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8afb15a4-e44f-43b6-b26f-ba1bf7a4d4fd tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:15:36.520786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8afb15a4-e44f-43b6-b26f-ba1bf7a4d4fd tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:15:36.534223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8afb15a4-e44f-43b6-b26f-ba1bf7a4d4fd tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:36.534472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8afb15a4-e44f-43b6-b26f-ba1bf7a4d4fd tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:36.534816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8afb15a4-e44f-43b6-b26f-ba1bf7a4d4fd tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:36.535613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8afb15a4-e44f-43b6-b26f-ba1bf7a4d4fd tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:36.537577 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8afb15a4-e44f-43b6-b26f-ba1bf7a4d4fd tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:36.538173 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8afb15a4-e44f-43b6-b26f-ba1bf7a4d4fd tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:36.560357 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-8afb15a4-e44f-43b6-b26f-ba1bf7a4d4fd tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Getting quotas for project e6dcc3fc5b544363b1fcaadd50ea948a. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:15:36.567418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-8afb15a4-e44f-43b6-b26f-ba1bf7a4d4fd tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Getting quotas for user 965e7789d7d942a793b07f71dd407fd8 and project e6dcc3fc5b544363b1fcaadd50ea948a. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:15:36.585445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8afb15a4-e44f-43b6-b26f-ba1bf7a4d4fd tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:15:36.588486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8afb15a4-e44f-43b6-b26f-ba1bf7a4d4fd tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 7bbf838d-132a-449c-985e-3485e9c4b9fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:15:36.665625 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8afb15a4-e44f-43b6-b26f-ba1bf7a4d4fd tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733725 Aug 24 10:15:36.667709 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 577/1071] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:15:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:15:36.675452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cc40b31f-1613-49a3-9eec-d92989ae5180 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:36.676336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cc40b31f-1613-49a3-9eec-d92989ae5180 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] [instance: c7ad4cc6-0ddc-47f9-b386-1e0dde47808f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:36.684222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc40b31f-1613-49a3-9eec-d92989ae5180 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:36.685557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc40b31f-1613-49a3-9eec-d92989ae5180 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:36.686273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc40b31f-1613-49a3-9eec-d92989ae5180 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:36.687468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc40b31f-1613-49a3-9eec-d92989ae5180 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:36.688103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc40b31f-1613-49a3-9eec-d92989ae5180 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:36.688833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc40b31f-1613-49a3-9eec-d92989ae5180 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:36.713445 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-cc40b31f-1613-49a3-9eec-d92989ae5180 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] HTTP exception thrown: Instance c7ad4cc6-0ddc-47f9-b386-1e0dde47808f could not be found. Aug 24 10:15:36.716663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cc40b31f-1613-49a3-9eec-d92989ae5180 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Request method failure captured: Aug 24 10:15:36.716663 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f HTTP/1.1 Aug 24 10:15:36.716663 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:15:36.716663 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:15:36.716663 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:15:36.716663 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:15:36.716663 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:15:36.716663 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:15:36.716663 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:15:36.716663 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:15:36.716663 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBflp1lR6NJiOvJ0jo0u_ObCwr-XT9ZPDd8UFdAdrktIeq9W3st8_Vr__ObGPpyUD3B1sX780QVeUxsP7WLsIfoEmJ6ZRyy4XuEoKUiYvCKqPo1TBHvl0EjfZLY21G0cKkNvRwmjK2bcnCfVvvo4RO0l6RUsKYrhQXpLAAKVAYjdEZcw Aug 24 10:15:36.716663 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:15:36.716663 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:15:36.716663 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:15:36.716663 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:15:36.716663 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:15:36.716663 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:15:36.716663 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: f2e2ee3e278042a5bf8ee7348966a468 Aug 24 10:15:36.716663 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersOnMultiNodesTest-1510468885 Aug 24 10:15:36.716663 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:15:36.716663 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:15:36.718419 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f2e2ee3e278042a5bf8ee7348966a468"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f2e2ee3e278042a5bf8ee7348966a468", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f2e2ee3e278042a5bf8ee7348966a468"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f2e2ee3e278042a5bf8ee7348966a468"}]}] Aug 24 10:15:36.718419 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersOnMultiNodesTest-1510468885 Aug 24 10:15:36.718419 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: f2e2ee3e278042a5bf8ee7348966a468 Aug 24 10:15:36.718419 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1510468885 Aug 24 10:15:36.718419 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersOnMultiNodesTest-1510468885-project Aug 24 10:15:36.718419 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:15:36.718419 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:15:36.718419 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: bf03c0eb5bd748ae85be830f1121dc06 Aug 24 10:15:36.718419 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersOnMultiNodesTest-1510468885-project Aug 24 10:15:36.718419 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:15:36.718419 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance c7ad4cc6-0ddc-47f9-b386-1e0dde47808f could not be found. Aug 24 10:15:36.718419 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'c7ad4cc6-0ddc-47f9-b386-1e0dde47808f'} Aug 24 10:15:36.719293 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:15:36.719293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:36.719293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:15:36.719293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:15:36.719293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:15:36.719293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:15:36.719293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:15:36.719293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:15:36.719293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:15:36.719293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:15:36.719293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7ad4cc6-0ddc-47f9-b386-1e0dde47808f could not be found. Aug 24 10:15:36.719293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:36.719293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:15:36.719293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:36.719293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:36.719293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:15:36.719293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:15:36.719293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:15:36.719293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:15:36.719293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:15:36.721102 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:15:36.721102 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:15:36.721102 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:15:36.721102 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:15:36.721102 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:15:36.721102 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:15:36.721102 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:15:36.721102 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7ad4cc6-0ddc-47f9-b386-1e0dde47808f could not be found. Aug 24 10:15:36.721102 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:36.721102 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:15:36.721102 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:36.721102 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:36.721102 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:15:36.721102 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:15:36.721102 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:15:36.721102 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:15:36.721102 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7ad4cc6-0ddc-47f9-b386-1e0dde47808f could not be found. Aug 24 10:15:36.721102 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:15:36.723777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cc40b31f-1613-49a3-9eec-d92989ae5180 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] Returning 404 to user: Instance c7ad4cc6-0ddc-47f9-b386-1e0dde47808f could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:15:36.724866 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cc40b31f-1613-49a3-9eec-d92989ae5180 tempest-ServersOnMultiNodesTest-1510468885 tempest-ServersOnMultiNodesTest-1510468885-project] 10.222.0.85 "GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f" status: 404 len: 111 microversion: 2.1 time: 0.055904 Aug 24 10:15:36.725690 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 578/1072] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:36 2022] GET /compute/v2.1/servers/c7ad4cc6-0ddc-47f9-b386-1e0dde47808f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:15:36.749031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e6ba1dc3-c897-4ede-8ad5-b1bd71f46cb9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:36.752932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e6ba1dc3-c897-4ede-8ad5-b1bd71f46cb9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:36.763162 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6ba1dc3-c897-4ede-8ad5-b1bd71f46cb9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:36.766700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6ba1dc3-c897-4ede-8ad5-b1bd71f46cb9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:36.768633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6ba1dc3-c897-4ede-8ad5-b1bd71f46cb9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:36.774443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6ba1dc3-c897-4ede-8ad5-b1bd71f46cb9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:36.775195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6ba1dc3-c897-4ede-8ad5-b1bd71f46cb9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:36.775812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6ba1dc3-c897-4ede-8ad5-b1bd71f46cb9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:37.206955 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eebcfada-1dc2-445b-b573-5ff22ffc64bc tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:37.223013 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eebcfada-1dc2-445b-b573-5ff22ffc64bc tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 200 len: 1497 microversion: 2.1 time: 0.930168 Aug 24 10:15:37.228878 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 495/1073] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:36 2022] GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 1497 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:37.234271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e50911ac-4c2d-4bbe-9a1b-06875ad20dad tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:37.247370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e50911ac-4c2d-4bbe-9a1b-06875ad20dad tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 7bbf838d-132a-449c-985e-3485e9c4b9fe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:37.412664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e50911ac-4c2d-4bbe-9a1b-06875ad20dad tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:37.425768 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e50911ac-4c2d-4bbe-9a1b-06875ad20dad tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe" status: 200 len: 1214 microversion: 2.1 time: 0.195125 Aug 24 10:15:37.426451 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 496/1074] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:37 2022] GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe => generated 1214 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:37.456114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1f92334f-c4de-46fe-bb1e-80ba35803116 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:37.456946 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1f92334f-c4de-46fe-bb1e-80ba35803116 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:37.499341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f92334f-c4de-46fe-bb1e-80ba35803116 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:37.500459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f92334f-c4de-46fe-bb1e-80ba35803116 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:37.501675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f92334f-c4de-46fe-bb1e-80ba35803116 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:37.506119 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f92334f-c4de-46fe-bb1e-80ba35803116 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:37.507038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f92334f-c4de-46fe-bb1e-80ba35803116 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:37.507670 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f92334f-c4de-46fe-bb1e-80ba35803116 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:37.593995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1f92334f-c4de-46fe-bb1e-80ba35803116 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:37.603254 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1f92334f-c4de-46fe-bb1e-80ba35803116 tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381" status: 200 len: 1612 microversion: 2.1 time: 0.151778 Aug 24 10:15:37.604087 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 497/1075] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:37 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381 => generated 1612 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:37.610059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-50d48957-29fb-4a8f-b551-03f250068f5d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:37.611063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-50d48957-29fb-4a8f-b551-03f250068f5d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:37.618066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50d48957-29fb-4a8f-b551-03f250068f5d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:37.618825 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50d48957-29fb-4a8f-b551-03f250068f5d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:37.619445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50d48957-29fb-4a8f-b551-03f250068f5d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:37.620543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50d48957-29fb-4a8f-b551-03f250068f5d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:37.621331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50d48957-29fb-4a8f-b551-03f250068f5d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:37.621970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50d48957-29fb-4a8f-b551-03f250068f5d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:37.839832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e6ba1dc3-c897-4ede-8ad5-b1bd71f46cb9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:37.849910 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e6ba1dc3-c897-4ede-8ad5-b1bd71f46cb9 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1378 microversion: 2.1 time: 1.122643 Aug 24 10:15:37.851130 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 579/1076] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:36 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1378 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:37.857069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d1328a9b-02f4-4c50-956e-265ee5e99af2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:37.869991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d1328a9b-02f4-4c50-956e-265ee5e99af2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:37.894357 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1328a9b-02f4-4c50-956e-265ee5e99af2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:37.894871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1328a9b-02f4-4c50-956e-265ee5e99af2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:37.895317 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1328a9b-02f4-4c50-956e-265ee5e99af2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:37.896040 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1328a9b-02f4-4c50-956e-265ee5e99af2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:37.896499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1328a9b-02f4-4c50-956e-265ee5e99af2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:37.896931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1328a9b-02f4-4c50-956e-265ee5e99af2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:38.114310 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-50d48957-29fb-4a8f-b551-03f250068f5d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:38.134658 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-50d48957-29fb-4a8f-b551-03f250068f5d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1311 microversion: 2.1 time: 0.528874 Aug 24 10:15:38.135296 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 498/1077] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:37 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1311 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:38.254363 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6edf6fff-cc72-4567-bd94-15faf58b7757 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:38.255924 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6edf6fff-cc72-4567-bd94-15faf58b7757 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:38.266401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6edf6fff-cc72-4567-bd94-15faf58b7757 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:38.267099 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6edf6fff-cc72-4567-bd94-15faf58b7757 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:38.267762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6edf6fff-cc72-4567-bd94-15faf58b7757 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:38.268679 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6edf6fff-cc72-4567-bd94-15faf58b7757 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:38.271315 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6edf6fff-cc72-4567-bd94-15faf58b7757 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:38.271939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6edf6fff-cc72-4567-bd94-15faf58b7757 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:38.573669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d1328a9b-02f4-4c50-956e-265ee5e99af2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:38.600886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d1328a9b-02f4-4c50-956e-265ee5e99af2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:38.603699 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d1328a9b-02f4-4c50-956e-265ee5e99af2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:38.607407 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d1328a9b-02f4-4c50-956e-265ee5e99af2 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1813 microversion: 2.25 time: 0.755179 Aug 24 10:15:38.608493 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 580/1078] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:15:37 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1813 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:15:38.615643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3c3e0dfb-f239-41e2-80a5-b3b1d8ee6655 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:38.617044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3c3e0dfb-f239-41e2-80a5-b3b1d8ee6655 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 7bbf838d-132a-449c-985e-3485e9c4b9fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:38.629841 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c3e0dfb-f239-41e2-80a5-b3b1d8ee6655 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:38.631019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c3e0dfb-f239-41e2-80a5-b3b1d8ee6655 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:38.632052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c3e0dfb-f239-41e2-80a5-b3b1d8ee6655 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:38.634097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c3e0dfb-f239-41e2-80a5-b3b1d8ee6655 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:38.635986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c3e0dfb-f239-41e2-80a5-b3b1d8ee6655 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:38.637094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c3e0dfb-f239-41e2-80a5-b3b1d8ee6655 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:38.775034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3c3e0dfb-f239-41e2-80a5-b3b1d8ee6655 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:38.801780 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3c3e0dfb-f239-41e2-80a5-b3b1d8ee6655 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe" status: 200 len: 1266 microversion: 2.1 time: 0.191185 Aug 24 10:15:38.803200 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 581/1079] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:38 2022] GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:38.810324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-04bc7c43-71e1-49ba-b6c3-058202553903 req-916ae14e-06d9-4306-858d-c7d94f31a0b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71cb543d-2961-4511-b990-c53fd25db381", "name": "network-vif-deleted", "tag": "a67f32d5-2bc6-456e-bce8-dcad8a07253a"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:38.827904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-04bc7c43-71e1-49ba-b6c3-058202553903 req-916ae14e-06d9-4306-858d-c7d94f31a0b7 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:38.830806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-04bc7c43-71e1-49ba-b6c3-058202553903 req-916ae14e-06d9-4306-858d-c7d94f31a0b7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:38.831839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-04bc7c43-71e1-49ba-b6c3-058202553903 req-916ae14e-06d9-4306-858d-c7d94f31a0b7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:38.848970 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-04bc7c43-71e1-49ba-b6c3-058202553903 req-916ae14e-06d9-4306-858d-c7d94f31a0b7 service nova] Creating event network-vif-deleted:a67f32d5-2bc6-456e-bce8-dcad8a07253a for instance 71cb543d-2961-4511-b990-c53fd25db381 on n-h2-849328-3 Aug 24 10:15:38.863732 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-04bc7c43-71e1-49ba-b6c3-058202553903 req-916ae14e-06d9-4306-858d-c7d94f31a0b7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056884 Aug 24 10:15:38.870789 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 582/1080] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:38.893452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-675fcff2-fe69-4d1f-b12e-c2270eed558f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:38.896852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-675fcff2-fe69-4d1f-b12e-c2270eed558f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:38.910229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-675fcff2-fe69-4d1f-b12e-c2270eed558f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:38.910807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-675fcff2-fe69-4d1f-b12e-c2270eed558f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:38.911253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-675fcff2-fe69-4d1f-b12e-c2270eed558f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:38.911987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-675fcff2-fe69-4d1f-b12e-c2270eed558f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:38.912447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-675fcff2-fe69-4d1f-b12e-c2270eed558f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:38.912870 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-675fcff2-fe69-4d1f-b12e-c2270eed558f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:38.971975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-675fcff2-fe69-4d1f-b12e-c2270eed558f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:38.972782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-675fcff2-fe69-4d1f-b12e-c2270eed558f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:38.973596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-675fcff2-fe69-4d1f-b12e-c2270eed558f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:38.974488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-675fcff2-fe69-4d1f-b12e-c2270eed558f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lazy-loading 'fault' on Instance uuid 71cb543d-2961-4511-b990-c53fd25db381 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:15:39.100923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6edf6fff-cc72-4567-bd94-15faf58b7757 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:39.117623 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6edf6fff-cc72-4567-bd94-15faf58b7757 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 200 len: 1497 microversion: 2.1 time: 0.865846 Aug 24 10:15:39.124389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-675fcff2-fe69-4d1f-b12e-c2270eed558f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360dc9ca253340f79dfb2c14f04c7445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a57c8760d34630aa410aa3f7a96edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:39.132498 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 499/1081] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:38 2022] GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 1497 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:39.138279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a87b0735-222b-4437-8e6a-7b400e9deab7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:39.139363 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a87b0735-222b-4437-8e6a-7b400e9deab7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:39.147986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a87b0735-222b-4437-8e6a-7b400e9deab7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:39.148799 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a87b0735-222b-4437-8e6a-7b400e9deab7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:39.149510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a87b0735-222b-4437-8e6a-7b400e9deab7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:39.150466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a87b0735-222b-4437-8e6a-7b400e9deab7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:39.151145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a87b0735-222b-4437-8e6a-7b400e9deab7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:39.151812 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a87b0735-222b-4437-8e6a-7b400e9deab7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:39.160477 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-675fcff2-fe69-4d1f-b12e-c2270eed558f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381" status: 200 len: 1330 microversion: 2.1 time: 0.282407 Aug 24 10:15:39.187570 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 583/1082] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:38 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381 => generated 1330 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:39.211898 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a0e22b8c-007a-4044-8b4a-b6c5928be1f9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:39.212873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a0e22b8c-007a-4044-8b4a-b6c5928be1f9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:39.225458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0e22b8c-007a-4044-8b4a-b6c5928be1f9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:39.226333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0e22b8c-007a-4044-8b4a-b6c5928be1f9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:39.226974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0e22b8c-007a-4044-8b4a-b6c5928be1f9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:39.227903 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0e22b8c-007a-4044-8b4a-b6c5928be1f9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:39.228622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0e22b8c-007a-4044-8b4a-b6c5928be1f9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:39.229585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0e22b8c-007a-4044-8b4a-b6c5928be1f9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:39.559480 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a0e22b8c-007a-4044-8b4a-b6c5928be1f9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:39.571551 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a0e22b8c-007a-4044-8b4a-b6c5928be1f9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1311 microversion: 2.1 time: 0.382342 Aug 24 10:15:39.572565 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 584/1083] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:39 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1311 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:39.649388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6cfb2ab8-a723-4d39-81be-767698c24dcd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:39.652111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6cfb2ab8-a723-4d39-81be-767698c24dcd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:39.662122 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cfb2ab8-a723-4d39-81be-767698c24dcd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:39.662728 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cfb2ab8-a723-4d39-81be-767698c24dcd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:39.663315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cfb2ab8-a723-4d39-81be-767698c24dcd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:39.665141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cfb2ab8-a723-4d39-81be-767698c24dcd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:39.666659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cfb2ab8-a723-4d39-81be-767698c24dcd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:39.667201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cfb2ab8-a723-4d39-81be-767698c24dcd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:39.764228 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a87b0735-222b-4437-8e6a-7b400e9deab7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:39.774928 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a87b0735-222b-4437-8e6a-7b400e9deab7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1378 microversion: 2.1 time: 0.640732 Aug 24 10:15:39.776115 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 500/1084] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:39 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1378 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:39.823548 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8cc8f14e-0da0-4440-9e16-55e83f67df3d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:39.824166 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8cc8f14e-0da0-4440-9e16-55e83f67df3d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 7bbf838d-132a-449c-985e-3485e9c4b9fe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:39.834001 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc8f14e-0da0-4440-9e16-55e83f67df3d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:39.834792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc8f14e-0da0-4440-9e16-55e83f67df3d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:39.835901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc8f14e-0da0-4440-9e16-55e83f67df3d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:39.836940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc8f14e-0da0-4440-9e16-55e83f67df3d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:39.837597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc8f14e-0da0-4440-9e16-55e83f67df3d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:39.838448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc8f14e-0da0-4440-9e16-55e83f67df3d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:39.930132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6cfb2ab8-a723-4d39-81be-767698c24dcd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:39.941932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6cfb2ab8-a723-4d39-81be-767698c24dcd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:39.943630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6cfb2ab8-a723-4d39-81be-767698c24dcd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:39.944986 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6cfb2ab8-a723-4d39-81be-767698c24dcd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1813 microversion: 2.25 time: 0.310164 Aug 24 10:15:39.964454 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 585/1085] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:15:39 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1813 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:15:40.036595 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8cc8f14e-0da0-4440-9e16-55e83f67df3d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:40.048954 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8cc8f14e-0da0-4440-9e16-55e83f67df3d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe" status: 200 len: 1272 microversion: 2.1 time: 0.228924 Aug 24 10:15:40.050142 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 501/1086] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:39 2022] GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe => generated 1272 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:15:40.139733 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9aca6c26-fb66-459b-8075-eafee7127941 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:40.140360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9aca6c26-fb66-459b-8075-eafee7127941 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:40.147384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9aca6c26-fb66-459b-8075-eafee7127941 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:40.148242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9aca6c26-fb66-459b-8075-eafee7127941 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:40.148936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9aca6c26-fb66-459b-8075-eafee7127941 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:40.150140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9aca6c26-fb66-459b-8075-eafee7127941 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:40.150784 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9aca6c26-fb66-459b-8075-eafee7127941 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:40.151856 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9aca6c26-fb66-459b-8075-eafee7127941 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:40.187127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-468eaf6e-7647-4249-823d-853f031f7b7c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:40.187805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-468eaf6e-7647-4249-823d-853f031f7b7c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] [instance: 71cb543d-2961-4511-b990-c53fd25db381] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:40.198355 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-468eaf6e-7647-4249-823d-853f031f7b7c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:40.203235 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-468eaf6e-7647-4249-823d-853f031f7b7c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:40.203890 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-468eaf6e-7647-4249-823d-853f031f7b7c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:40.206527 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-468eaf6e-7647-4249-823d-853f031f7b7c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:40.207755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-468eaf6e-7647-4249-823d-853f031f7b7c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:40.209642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-468eaf6e-7647-4249-823d-853f031f7b7c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:40.239113 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-468eaf6e-7647-4249-823d-853f031f7b7c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] HTTP exception thrown: Instance 71cb543d-2961-4511-b990-c53fd25db381 could not be found. Aug 24 10:15:40.241015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-468eaf6e-7647-4249-823d-853f031f7b7c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Request method failure captured: Aug 24 10:15:40.241015 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381 HTTP/1.1 Aug 24 10:15:40.241015 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:15:40.241015 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:15:40.241015 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:15:40.241015 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:15:40.241015 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:15:40.241015 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:15:40.241015 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:15:40.241015 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:15:40.241015 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfl4a9G-cbesU8S4LiuCVGs_VHhA7gJIZxDtIp1n7aBv1vIdNW0d_Pju2RFPvMw4u7uV6oPR0r-j1pAUj8rmPNVhAMa_Y1WFx6TObnTgStZLTeaAfa9qfFkC-7j4KaUmrGhpRLlJzjV2CXmXjYz1tR219s_tJEXD-zPB_DZ44nHuAQ4 Aug 24 10:15:40.241015 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:15:40.241015 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:15:40.241015 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:15:40.241015 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:15:40.241015 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:15:40.241015 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:15:40.241015 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: d6a57c8760d34630aa410aa3f7a96edd Aug 24 10:15:40.241015 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-VolumesAdminNegativeTest-2143339667 Aug 24 10:15:40.241015 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:15:40.241015 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:15:40.242655 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d6a57c8760d34630aa410aa3f7a96edd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d6a57c8760d34630aa410aa3f7a96edd", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d6a57c8760d34630aa410aa3f7a96edd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d6a57c8760d34630aa410aa3f7a96edd"}]}] Aug 24 10:15:40.242655 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-VolumesAdminNegativeTest-2143339667 Aug 24 10:15:40.242655 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: d6a57c8760d34630aa410aa3f7a96edd Aug 24 10:15:40.242655 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2143339667 Aug 24 10:15:40.242655 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-VolumesAdminNegativeTest-2143339667-project Aug 24 10:15:40.242655 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:15:40.242655 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:15:40.242655 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 360dc9ca253340f79dfb2c14f04c7445 Aug 24 10:15:40.242655 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-VolumesAdminNegativeTest-2143339667-project Aug 24 10:15:40.242655 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:15:40.242655 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 71cb543d-2961-4511-b990-c53fd25db381 could not be found. Aug 24 10:15:40.242655 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '71cb543d-2961-4511-b990-c53fd25db381'} Aug 24 10:15:40.243548 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:15:40.243548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:40.243548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:15:40.243548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:15:40.243548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:15:40.243548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:15:40.243548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:15:40.243548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:15:40.243548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:15:40.243548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:15:40.243548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71cb543d-2961-4511-b990-c53fd25db381 could not be found. Aug 24 10:15:40.243548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:40.243548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:15:40.243548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:40.243548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:40.243548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:15:40.243548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:15:40.243548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:15:40.243548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:15:40.243548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:15:40.245027 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:15:40.245027 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:15:40.245027 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:15:40.245027 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:15:40.245027 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:15:40.245027 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:15:40.245027 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:15:40.245027 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71cb543d-2961-4511-b990-c53fd25db381 could not be found. Aug 24 10:15:40.245027 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:40.245027 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:15:40.245027 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:40.245027 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:15:40.245027 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:15:40.245027 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:15:40.245027 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:15:40.245027 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:15:40.245027 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71cb543d-2961-4511-b990-c53fd25db381 could not be found. Aug 24 10:15:40.245027 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:15:40.246368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-468eaf6e-7647-4249-823d-853f031f7b7c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Returning 404 to user: Instance 71cb543d-2961-4511-b990-c53fd25db381 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:15:40.247153 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-468eaf6e-7647-4249-823d-853f031f7b7c tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381" status: 404 len: 111 microversion: 2.1 time: 0.064724 Aug 24 10:15:40.251010 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 502/1087] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:40 2022] GET /compute/v2.1/servers/71cb543d-2961-4511-b990-c53fd25db381 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:15:40.258657 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9dc82451-0336-4146-bcf3-52b72dd50f4f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] Calling method '.version_select at 0x7f46550f5820>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:40.287619 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9dc82451-0336-4146-bcf3-52b72dd50f4f tempest-VolumesAdminNegativeTest-2143339667 tempest-VolumesAdminNegativeTest-2143339667-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-719838166" status: 202 len: 0 microversion: 2.1 time: 0.033292 Aug 24 10:15:40.291616 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 503/1088] 10.222.0.85 () {58 vars in 1218 bytes} [Wed Aug 24 10:15:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-719838166 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:15:40.529382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9aca6c26-fb66-459b-8075-eafee7127941 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:40.542717 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9aca6c26-fb66-459b-8075-eafee7127941 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 200 len: 1497 microversion: 2.1 time: 0.407396 Aug 24 10:15:40.543210 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 586/1089] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:40 2022] GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 1497 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:40.606938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f77606ab-b197-4a4f-9c61-4c875cb322d6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:40.615576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f77606ab-b197-4a4f-9c61-4c875cb322d6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:40.627430 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f77606ab-b197-4a4f-9c61-4c875cb322d6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:40.628587 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f77606ab-b197-4a4f-9c61-4c875cb322d6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:40.629550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f77606ab-b197-4a4f-9c61-4c875cb322d6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:40.630687 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f77606ab-b197-4a4f-9c61-4c875cb322d6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:40.631330 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f77606ab-b197-4a4f-9c61-4c875cb322d6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:40.631910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f77606ab-b197-4a4f-9c61-4c875cb322d6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:40.797396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0729961f-0a09-4295-8cbb-61e16b6faba4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:40.797937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0729961f-0a09-4295-8cbb-61e16b6faba4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:40.822415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0729961f-0a09-4295-8cbb-61e16b6faba4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:40.826828 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0729961f-0a09-4295-8cbb-61e16b6faba4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:40.827488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0729961f-0a09-4295-8cbb-61e16b6faba4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:40.832458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0729961f-0a09-4295-8cbb-61e16b6faba4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:40.834172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0729961f-0a09-4295-8cbb-61e16b6faba4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:40.836083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0729961f-0a09-4295-8cbb-61e16b6faba4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:40.958064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f77606ab-b197-4a4f-9c61-4c875cb322d6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:40.971708 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f77606ab-b197-4a4f-9c61-4c875cb322d6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1311 microversion: 2.1 time: 0.370012 Aug 24 10:15:40.975766 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 504/1090] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:40 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1311 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:40.989828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9f0c82ff-e36b-4b02-823b-ded3cdcb0953 req-47556527-9b8c-412d-b695-d5a11e9fdf30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e35cb9a6-5d75-4272-9a0c-dd6d092e96f8", "tag": "0d6b8ccb-507f-46f4-8fc1-680ff0bcd84b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:41.012347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9f0c82ff-e36b-4b02-823b-ded3cdcb0953 req-47556527-9b8c-412d-b695-d5a11e9fdf30 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:41.017898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9f0c82ff-e36b-4b02-823b-ded3cdcb0953 req-47556527-9b8c-412d-b695-d5a11e9fdf30 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:41.018598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9f0c82ff-e36b-4b02-823b-ded3cdcb0953 req-47556527-9b8c-412d-b695-d5a11e9fdf30 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:41.036706 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9f0c82ff-e36b-4b02-823b-ded3cdcb0953 req-47556527-9b8c-412d-b695-d5a11e9fdf30 service nova] Creating event network-changed:0d6b8ccb-507f-46f4-8fc1-680ff0bcd84b for instance e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 on n-h1-849328-3 Aug 24 10:15:41.043643 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9f0c82ff-e36b-4b02-823b-ded3cdcb0953 req-47556527-9b8c-412d-b695-d5a11e9fdf30 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066263 Aug 24 10:15:41.045670 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 505/1091] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:41.054580 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-02a9efa3-c748-4248-b060-613324537238 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:41.056056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-02a9efa3-c748-4248-b060-613324537238 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:41.063905 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02a9efa3-c748-4248-b060-613324537238 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:41.064877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02a9efa3-c748-4248-b060-613324537238 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:41.065532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02a9efa3-c748-4248-b060-613324537238 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:41.066495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02a9efa3-c748-4248-b060-613324537238 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:41.067250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02a9efa3-c748-4248-b060-613324537238 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:41.068403 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02a9efa3-c748-4248-b060-613324537238 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:41.354799 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0729961f-0a09-4295-8cbb-61e16b6faba4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:41.374876 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0729961f-0a09-4295-8cbb-61e16b6faba4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1378 microversion: 2.1 time: 0.582032 Aug 24 10:15:41.377666 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 587/1092] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:40 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1378 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:15:41.401653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-99d5b120-a0e9-4884-af17-fdc4d72f4c14 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:41.403582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-99d5b120-a0e9-4884-af17-fdc4d72f4c14 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 7bbf838d-132a-449c-985e-3485e9c4b9fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:41.405805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-02a9efa3-c748-4248-b060-613324537238 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:41.408346 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:41.416705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99d5b120-a0e9-4884-af17-fdc4d72f4c14 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:41.419059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99d5b120-a0e9-4884-af17-fdc4d72f4c14 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:41.421823 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99d5b120-a0e9-4884-af17-fdc4d72f4c14 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:41.423507 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99d5b120-a0e9-4884-af17-fdc4d72f4c14 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:41.424569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99d5b120-a0e9-4884-af17-fdc4d72f4c14 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:41.425345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99d5b120-a0e9-4884-af17-fdc4d72f4c14 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:41.438739 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-02a9efa3-c748-4248-b060-613324537238 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:41.440262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-02a9efa3-c748-4248-b060-613324537238 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:41.442196 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-02a9efa3-c748-4248-b060-613324537238 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1813 microversion: 2.25 time: 0.394483 Aug 24 10:15:41.442917 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 506/1093] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:15:41 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1813 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:15:41.565068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8cfc8f9f-b64d-4a74-9a1d-d8f18da4e082 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:41.565871 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8cfc8f9f-b64d-4a74-9a1d-d8f18da4e082 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:41.588125 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cfc8f9f-b64d-4a74-9a1d-d8f18da4e082 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:41.588850 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cfc8f9f-b64d-4a74-9a1d-d8f18da4e082 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:41.589574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cfc8f9f-b64d-4a74-9a1d-d8f18da4e082 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:41.590708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cfc8f9f-b64d-4a74-9a1d-d8f18da4e082 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:41.591392 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cfc8f9f-b64d-4a74-9a1d-d8f18da4e082 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:41.592027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cfc8f9f-b64d-4a74-9a1d-d8f18da4e082 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:41.697330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-99d5b120-a0e9-4884-af17-fdc4d72f4c14 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:41.712313 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-99d5b120-a0e9-4884-af17-fdc4d72f4c14 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe" status: 200 len: 1272 microversion: 2.1 time: 0.332672 Aug 24 10:15:41.725412 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 588/1094] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:41 2022] GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe => generated 1272 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:41.981285 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8cfc8f9f-b64d-4a74-9a1d-d8f18da4e082 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:41.991568 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8cfc8f9f-b64d-4a74-9a1d-d8f18da4e082 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 200 len: 1497 microversion: 2.1 time: 0.430979 Aug 24 10:15:41.996195 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 507/1095] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:41 2022] GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 1497 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:15:42.001464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4d9f2191-d0c4-4c61-9aa7-73bc8c542607 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:42.002390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4d9f2191-d0c4-4c61-9aa7-73bc8c542607 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:42.013545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d9f2191-d0c4-4c61-9aa7-73bc8c542607 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:42.015080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d9f2191-d0c4-4c61-9aa7-73bc8c542607 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:42.015776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d9f2191-d0c4-4c61-9aa7-73bc8c542607 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:42.017029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d9f2191-d0c4-4c61-9aa7-73bc8c542607 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:42.017809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d9f2191-d0c4-4c61-9aa7-73bc8c542607 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:42.019942 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d9f2191-d0c4-4c61-9aa7-73bc8c542607 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:42.540835 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:42.596768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4d9f2191-d0c4-4c61-9aa7-73bc8c542607 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:42.606319 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4d9f2191-d0c4-4c61-9aa7-73bc8c542607 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1311 microversion: 2.1 time: 0.613562 Aug 24 10:15:42.616396 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 589/1096] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:41 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1311 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:15:42.629481 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e8ecb945-88cb-4c66-a5a1-f8ab12292852 tempest-AbsoluteLimitsTestJSON-267944187 tempest-AbsoluteLimitsTestJSON-267944187-project] Calling method '.version_select at 0x7f4655017160>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:42.633862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d6893c54-9df0-49e4-8dcd-e93442a7c72a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:42.634833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d6893c54-9df0-49e4-8dcd-e93442a7c72a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:42.649355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6893c54-9df0-49e4-8dcd-e93442a7c72a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:42.651064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6893c54-9df0-49e4-8dcd-e93442a7c72a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:42.658157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6893c54-9df0-49e4-8dcd-e93442a7c72a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:42.659326 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6893c54-9df0-49e4-8dcd-e93442a7c72a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:42.660121 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6893c54-9df0-49e4-8dcd-e93442a7c72a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:42.660791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6893c54-9df0-49e4-8dcd-e93442a7c72a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:42.668906 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8ecb945-88cb-4c66-a5a1-f8ab12292852 tempest-AbsoluteLimitsTestJSON-267944187 tempest-AbsoluteLimitsTestJSON-267944187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:42.673247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8ecb945-88cb-4c66-a5a1-f8ab12292852 tempest-AbsoluteLimitsTestJSON-267944187 tempest-AbsoluteLimitsTestJSON-267944187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:42.676744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8ecb945-88cb-4c66-a5a1-f8ab12292852 tempest-AbsoluteLimitsTestJSON-267944187 tempest-AbsoluteLimitsTestJSON-267944187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:42.677898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8ecb945-88cb-4c66-a5a1-f8ab12292852 tempest-AbsoluteLimitsTestJSON-267944187 tempest-AbsoluteLimitsTestJSON-267944187-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:42.678767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8ecb945-88cb-4c66-a5a1-f8ab12292852 tempest-AbsoluteLimitsTestJSON-267944187 tempest-AbsoluteLimitsTestJSON-267944187-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:42.681376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8ecb945-88cb-4c66-a5a1-f8ab12292852 tempest-AbsoluteLimitsTestJSON-267944187 tempest-AbsoluteLimitsTestJSON-267944187-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:42.745291 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e8ecb945-88cb-4c66-a5a1-f8ab12292852 tempest-AbsoluteLimitsTestJSON-267944187 tempest-AbsoluteLimitsTestJSON-267944187-project] 10.222.0.85 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.399088 Aug 24 10:15:42.747655 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 508/1097] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 10:15:42 2022] GET /compute/v2.1/limits => generated 511 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:15:42.766593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-553e2a42-abca-4bd6-83f3-ab384b91c08d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:42.767250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-553e2a42-abca-4bd6-83f3-ab384b91c08d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:42.775857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-553e2a42-abca-4bd6-83f3-ab384b91c08d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:42.776649 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-553e2a42-abca-4bd6-83f3-ab384b91c08d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:42.776956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-553e2a42-abca-4bd6-83f3-ab384b91c08d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:42.777805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-553e2a42-abca-4bd6-83f3-ab384b91c08d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:42.778265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-553e2a42-abca-4bd6-83f3-ab384b91c08d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:42.779920 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-553e2a42-abca-4bd6-83f3-ab384b91c08d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:43.141919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d6893c54-9df0-49e4-8dcd-e93442a7c72a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:43.150277 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d6893c54-9df0-49e4-8dcd-e93442a7c72a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1378 microversion: 2.1 time: 0.532153 Aug 24 10:15:43.150888 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 590/1098] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:42 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1378 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:43.169475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0cea1b37-b4cc-484c-8ba1-c15a1ee22224 req-217db448-8359-419a-bee6-09a6f9fb6899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35c8116a-830a-4f60-9d70-34eacd719c08", "name": "network-vif-plugged", "status": "completed", "tag": "6676526f-444f-4a1b-94b1-f417a9a55ffa"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:43.189216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0cea1b37-b4cc-484c-8ba1-c15a1ee22224 req-217db448-8359-419a-bee6-09a6f9fb6899 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:43.189702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0cea1b37-b4cc-484c-8ba1-c15a1ee22224 req-217db448-8359-419a-bee6-09a6f9fb6899 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:43.190133 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0cea1b37-b4cc-484c-8ba1-c15a1ee22224 req-217db448-8359-419a-bee6-09a6f9fb6899 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:43.223863 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0cea1b37-b4cc-484c-8ba1-c15a1ee22224 req-217db448-8359-419a-bee6-09a6f9fb6899 service nova] Creating event network-vif-plugged:6676526f-444f-4a1b-94b1-f417a9a55ffa for instance 35c8116a-830a-4f60-9d70-34eacd719c08 on n-h2-849328-3 Aug 24 10:15:43.230553 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0cea1b37-b4cc-484c-8ba1-c15a1ee22224 req-217db448-8359-419a-bee6-09a6f9fb6899 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078034 Aug 24 10:15:43.231879 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 591/1099] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:43.242502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-32868724-adfe-4ca8-946e-97db8e063c93 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:43.243549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-32868724-adfe-4ca8-946e-97db8e063c93 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 7bbf838d-132a-449c-985e-3485e9c4b9fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:43.283096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32868724-adfe-4ca8-946e-97db8e063c93 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:43.285038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32868724-adfe-4ca8-946e-97db8e063c93 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:43.286853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32868724-adfe-4ca8-946e-97db8e063c93 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:43.289718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32868724-adfe-4ca8-946e-97db8e063c93 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:43.290338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32868724-adfe-4ca8-946e-97db8e063c93 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:43.292602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32868724-adfe-4ca8-946e-97db8e063c93 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:43.375836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:43.665947 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-553e2a42-abca-4bd6-83f3-ab384b91c08d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:43.684938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-553e2a42-abca-4bd6-83f3-ab384b91c08d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:43.688594 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-553e2a42-abca-4bd6-83f3-ab384b91c08d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:43.694589 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-553e2a42-abca-4bd6-83f3-ab384b91c08d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1813 microversion: 2.25 time: 0.945582 Aug 24 10:15:43.696645 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 509/1100] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:15:42 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1813 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:15:43.713596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3ad07d05-5596-41a7-b738-5b89f4365c13 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:43.715066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3ad07d05-5596-41a7-b738-5b89f4365c13 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:43.723751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ad07d05-5596-41a7-b738-5b89f4365c13 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:43.724986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ad07d05-5596-41a7-b738-5b89f4365c13 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:43.725686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ad07d05-5596-41a7-b738-5b89f4365c13 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:43.726703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ad07d05-5596-41a7-b738-5b89f4365c13 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:43.727398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ad07d05-5596-41a7-b738-5b89f4365c13 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:43.728273 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ad07d05-5596-41a7-b738-5b89f4365c13 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:44.143696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-32868724-adfe-4ca8-946e-97db8e063c93 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:44.155623 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3ad07d05-5596-41a7-b738-5b89f4365c13 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:44.158058 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-32868724-adfe-4ca8-946e-97db8e063c93 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe" status: 200 len: 1314 microversion: 2.1 time: 0.924441 Aug 24 10:15:44.159514 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 592/1101] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:43 2022] GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe => generated 1314 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:44.168355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3d1e2b7d-2876-44bb-b0b2-a59726846cec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:44.174811 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3d1e2b7d-2876-44bb-b0b2-a59726846cec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:44.186390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d1e2b7d-2876-44bb-b0b2-a59726846cec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:44.187406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d1e2b7d-2876-44bb-b0b2-a59726846cec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:44.188148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d1e2b7d-2876-44bb-b0b2-a59726846cec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:44.189979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d1e2b7d-2876-44bb-b0b2-a59726846cec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:44.190718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d1e2b7d-2876-44bb-b0b2-a59726846cec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:44.191777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d1e2b7d-2876-44bb-b0b2-a59726846cec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:44.197870 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3ad07d05-5596-41a7-b738-5b89f4365c13 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 200 len: 1497 microversion: 2.1 time: 0.497366 Aug 24 10:15:44.206082 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 510/1102] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:43 2022] GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 1497 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:44.224909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0a8f2678-905a-4f97-bf12-f099f383f0f0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:44.226360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0a8f2678-905a-4f97-bf12-f099f383f0f0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:44.246512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a8f2678-905a-4f97-bf12-f099f383f0f0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:44.247008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a8f2678-905a-4f97-bf12-f099f383f0f0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:44.247483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a8f2678-905a-4f97-bf12-f099f383f0f0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:44.248141 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a8f2678-905a-4f97-bf12-f099f383f0f0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:44.248709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a8f2678-905a-4f97-bf12-f099f383f0f0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:44.250345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a8f2678-905a-4f97-bf12-f099f383f0f0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:44.828722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0a8f2678-905a-4f97-bf12-f099f383f0f0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:44.848183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3d1e2b7d-2876-44bb-b0b2-a59726846cec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:44.875050 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0a8f2678-905a-4f97-bf12-f099f383f0f0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1378 microversion: 2.1 time: 0.661043 Aug 24 10:15:44.875972 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 511/1103] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:44 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1378 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:44.883607 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e4f17d8e-f6ce-4682-914d-8f141d90ce3d req-5ce6c47e-c78e-489f-b67e-26895d2b160c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b390fef-6be9-4e24-b31e-b6f6252c88c1", "tag": "50041625-3e09-4ff3-9bab-8be84832b786"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:44.887396 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3d1e2b7d-2876-44bb-b0b2-a59726846cec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1311 microversion: 2.1 time: 0.724776 Aug 24 10:15:44.889300 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 593/1104] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:44 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1311 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:44.908959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-83c7d602-fc40-4307-a041-f91b4d8f59a5 req-938ba45e-de75-4a12-9f09-a8d294a984b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0", "name": "network-vif-unplugged", "status": "completed", "tag": "24b3e11e-37a5-4b8e-b7ef-ba9e0ea1b0bc"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:44.920108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e4f17d8e-f6ce-4682-914d-8f141d90ce3d req-5ce6c47e-c78e-489f-b67e-26895d2b160c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:44.920843 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e4f17d8e-f6ce-4682-914d-8f141d90ce3d req-5ce6c47e-c78e-489f-b67e-26895d2b160c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:44.922216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e4f17d8e-f6ce-4682-914d-8f141d90ce3d req-5ce6c47e-c78e-489f-b67e-26895d2b160c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:44.925633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-83c7d602-fc40-4307-a041-f91b4d8f59a5 req-938ba45e-de75-4a12-9f09-a8d294a984b7 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:44.926128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-83c7d602-fc40-4307-a041-f91b4d8f59a5 req-938ba45e-de75-4a12-9f09-a8d294a984b7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:44.926550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-83c7d602-fc40-4307-a041-f91b4d8f59a5 req-938ba45e-de75-4a12-9f09-a8d294a984b7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:44.938967 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e4f17d8e-f6ce-4682-914d-8f141d90ce3d req-5ce6c47e-c78e-489f-b67e-26895d2b160c service nova] Creating event network-changed:50041625-3e09-4ff3-9bab-8be84832b786 for instance 6b390fef-6be9-4e24-b31e-b6f6252c88c1 on n-h2-849328-3 Aug 24 10:15:44.944521 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e4f17d8e-f6ce-4682-914d-8f141d90ce3d req-5ce6c47e-c78e-489f-b67e-26895d2b160c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066070 Aug 24 10:15:44.945875 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 512/1105] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:44.949670 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-83c7d602-fc40-4307-a041-f91b4d8f59a5 req-938ba45e-de75-4a12-9f09-a8d294a984b7 service nova] Creating event network-vif-unplugged:24b3e11e-37a5-4b8e-b7ef-ba9e0ea1b0bc for instance 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 on n-h1-849328-3 Aug 24 10:15:44.952373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b62271b7-a494-441c-b222-245171ae06d0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:44.953264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b62271b7-a494-441c-b222-245171ae06d0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:44.961305 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-83c7d602-fc40-4307-a041-f91b4d8f59a5 req-938ba45e-de75-4a12-9f09-a8d294a984b7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068463 Aug 24 10:15:44.962273 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 594/1106] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:44.963792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b62271b7-a494-441c-b222-245171ae06d0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:44.964367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b62271b7-a494-441c-b222-245171ae06d0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:44.965041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b62271b7-a494-441c-b222-245171ae06d0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:44.965583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b62271b7-a494-441c-b222-245171ae06d0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:44.966628 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b62271b7-a494-441c-b222-245171ae06d0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:44.967057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b62271b7-a494-441c-b222-245171ae06d0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:45.184935 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c5a3904-6166-40b5-9ce5-0390354e241c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:45.185968 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2c5a3904-6166-40b5-9ce5-0390354e241c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 7bbf838d-132a-449c-985e-3485e9c4b9fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:45.205632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c5a3904-6166-40b5-9ce5-0390354e241c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:45.207438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c5a3904-6166-40b5-9ce5-0390354e241c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:45.208529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c5a3904-6166-40b5-9ce5-0390354e241c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:45.210149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c5a3904-6166-40b5-9ce5-0390354e241c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:45.211312 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c5a3904-6166-40b5-9ce5-0390354e241c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:45.212379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c5a3904-6166-40b5-9ce5-0390354e241c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:45.977769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2c5a3904-6166-40b5-9ce5-0390354e241c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:46.021368 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2c5a3904-6166-40b5-9ce5-0390354e241c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe" status: 200 len: 1314 microversion: 2.1 time: 0.841977 Aug 24 10:15:46.024418 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 595/1107] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:45 2022] GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe => generated 1314 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:46.056994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ba9e44d1-cdd2-41e9-9116-2a8f576a8426 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:46.080413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ba9e44d1-cdd2-41e9-9116-2a8f576a8426 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:46.107292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba9e44d1-cdd2-41e9-9116-2a8f576a8426 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:46.113093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba9e44d1-cdd2-41e9-9116-2a8f576a8426 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:46.113707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba9e44d1-cdd2-41e9-9116-2a8f576a8426 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:46.115201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba9e44d1-cdd2-41e9-9116-2a8f576a8426 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:46.116374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba9e44d1-cdd2-41e9-9116-2a8f576a8426 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:46.118468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba9e44d1-cdd2-41e9-9116-2a8f576a8426 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:46.228904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b62271b7-a494-441c-b222-245171ae06d0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:46.266109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b62271b7-a494-441c-b222-245171ae06d0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:46.277100 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b62271b7-a494-441c-b222-245171ae06d0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:46.282249 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b62271b7-a494-441c-b222-245171ae06d0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1813 microversion: 2.25 time: 1.334690 Aug 24 10:15:46.287288 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 513/1108] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:15:44 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1813 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:15:46.293022 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bd033d75-b993-44b5-ad26-3c174e4ae83c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:46.294343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bd033d75-b993-44b5-ad26-3c174e4ae83c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:46.310369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd033d75-b993-44b5-ad26-3c174e4ae83c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:46.311856 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd033d75-b993-44b5-ad26-3c174e4ae83c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:46.312485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd033d75-b993-44b5-ad26-3c174e4ae83c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:46.314171 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd033d75-b993-44b5-ad26-3c174e4ae83c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:46.336277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd033d75-b993-44b5-ad26-3c174e4ae83c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:46.339209 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd033d75-b993-44b5-ad26-3c174e4ae83c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:46.548517 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:46.577687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=14 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:46.759642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ba9e44d1-cdd2-41e9-9116-2a8f576a8426 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:46.772134 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ba9e44d1-cdd2-41e9-9116-2a8f576a8426 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 200 len: 1497 microversion: 2.1 time: 0.743724 Aug 24 10:15:46.778037 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 596/1109] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:46 2022] GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 1497 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:46.797943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3a313128-afd2-48b7-9a37-a9b6801a853b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:46.800332 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3a313128-afd2-48b7-9a37-a9b6801a853b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:46.815909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a313128-afd2-48b7-9a37-a9b6801a853b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:46.817451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a313128-afd2-48b7-9a37-a9b6801a853b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:46.819156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a313128-afd2-48b7-9a37-a9b6801a853b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:46.821485 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a313128-afd2-48b7-9a37-a9b6801a853b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:46.822791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a313128-afd2-48b7-9a37-a9b6801a853b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:46.823845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a313128-afd2-48b7-9a37-a9b6801a853b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:47.372366 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bd033d75-b993-44b5-ad26-3c174e4ae83c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:47.393998 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bd033d75-b993-44b5-ad26-3c174e4ae83c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1528 microversion: 2.1 time: 1.107477 Aug 24 10:15:47.400974 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 514/1110] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:46 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1528 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:47.416943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3a313128-afd2-48b7-9a37-a9b6801a853b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:47.419087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-7311d5f3-9034-4518-a932-f2ff56b7693b req-3372da80-2d85-44be-8833-89f2d274c9b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e35cb9a6-5d75-4272-9a0c-dd6d092e96f8", "name": "network-vif-plugged", "status": "completed", "tag": "0d6b8ccb-507f-46f4-8fc1-680ff0bcd84b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:47.430375 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3a313128-afd2-48b7-9a37-a9b6801a853b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1311 microversion: 2.1 time: 0.649508 Aug 24 10:15:47.434197 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 597/1111] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:46 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1311 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:47.451015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-12c45460-becf-4372-8bbd-f9a70bde1062 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:47.451520 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-12c45460-becf-4372-8bbd-f9a70bde1062 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 7bbf838d-132a-449c-985e-3485e9c4b9fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:47.465653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12c45460-becf-4372-8bbd-f9a70bde1062 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:47.466378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12c45460-becf-4372-8bbd-f9a70bde1062 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:47.466959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12c45460-becf-4372-8bbd-f9a70bde1062 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:47.467782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12c45460-becf-4372-8bbd-f9a70bde1062 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:47.468250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12c45460-becf-4372-8bbd-f9a70bde1062 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:47.472675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12c45460-becf-4372-8bbd-f9a70bde1062 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:47.474000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7311d5f3-9034-4518-a932-f2ff56b7693b req-3372da80-2d85-44be-8833-89f2d274c9b7 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:47.475668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7311d5f3-9034-4518-a932-f2ff56b7693b req-3372da80-2d85-44be-8833-89f2d274c9b7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:47.478511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7311d5f3-9034-4518-a932-f2ff56b7693b req-3372da80-2d85-44be-8833-89f2d274c9b7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:47.530080 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7311d5f3-9034-4518-a932-f2ff56b7693b req-3372da80-2d85-44be-8833-89f2d274c9b7 service nova] Creating event network-vif-plugged:0d6b8ccb-507f-46f4-8fc1-680ff0bcd84b for instance e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 on n-h1-849328-3 Aug 24 10:15:47.544671 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-7311d5f3-9034-4518-a932-f2ff56b7693b req-3372da80-2d85-44be-8833-89f2d274c9b7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136865 Aug 24 10:15:47.546460 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 515/1112] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:47.557996 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-0eaf9076-62c2-4054-86c4-5711a06e711f req-875b8770-1e9c-44c4-ba53-0e3113b16866 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bbf838d-132a-449c-985e-3485e9c4b9fe", "tag": "929039dc-5f8e-4877-bfab-387d866840b0"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:47.591430 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0eaf9076-62c2-4054-86c4-5711a06e711f req-875b8770-1e9c-44c4-ba53-0e3113b16866 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:47.594136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0eaf9076-62c2-4054-86c4-5711a06e711f req-875b8770-1e9c-44c4-ba53-0e3113b16866 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:47.595290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0eaf9076-62c2-4054-86c4-5711a06e711f req-875b8770-1e9c-44c4-ba53-0e3113b16866 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:47.650555 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-0eaf9076-62c2-4054-86c4-5711a06e711f req-875b8770-1e9c-44c4-ba53-0e3113b16866 service nova] Creating event network-changed:929039dc-5f8e-4877-bfab-387d866840b0 for instance 7bbf838d-132a-449c-985e-3485e9c4b9fe on n-h1-849328-3 Aug 24 10:15:47.660510 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-0eaf9076-62c2-4054-86c4-5711a06e711f req-875b8770-1e9c-44c4-ba53-0e3113b16866 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111251 Aug 24 10:15:47.671772 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 516/1113] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:47.695054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-b8f305e9-a42d-444c-a38a-dff5d9769a57 req-79bb651a-8238-4e73-b106-4b30d79871e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0", "tag": "24b3e11e-37a5-4b8e-b7ef-ba9e0ea1b0bc"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:47.720940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b8f305e9-a42d-444c-a38a-dff5d9769a57 req-79bb651a-8238-4e73-b106-4b30d79871e1 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:47.722756 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b8f305e9-a42d-444c-a38a-dff5d9769a57 req-79bb651a-8238-4e73-b106-4b30d79871e1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:47.724253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b8f305e9-a42d-444c-a38a-dff5d9769a57 req-79bb651a-8238-4e73-b106-4b30d79871e1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:47.761538 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b8f305e9-a42d-444c-a38a-dff5d9769a57 req-79bb651a-8238-4e73-b106-4b30d79871e1 service nova] Creating event network-changed:24b3e11e-37a5-4b8e-b7ef-ba9e0ea1b0bc for instance 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 on n-h1-849328-3 Aug 24 10:15:47.772299 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-b8f305e9-a42d-444c-a38a-dff5d9769a57 req-79bb651a-8238-4e73-b106-4b30d79871e1 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095917 Aug 24 10:15:47.774495 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 517/1114] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:47.786288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5d5e6a24-8ee0-48cf-87a5-63778bed24e5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:47.789221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5d5e6a24-8ee0-48cf-87a5-63778bed24e5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:47.802977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d5e6a24-8ee0-48cf-87a5-63778bed24e5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:47.804979 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d5e6a24-8ee0-48cf-87a5-63778bed24e5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:47.806036 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d5e6a24-8ee0-48cf-87a5-63778bed24e5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:47.807791 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d5e6a24-8ee0-48cf-87a5-63778bed24e5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:47.808962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d5e6a24-8ee0-48cf-87a5-63778bed24e5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:47.809925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d5e6a24-8ee0-48cf-87a5-63778bed24e5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:48.468240 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-12c45460-becf-4372-8bbd-f9a70bde1062 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:48.493093 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-12c45460-becf-4372-8bbd-f9a70bde1062 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe" status: 200 len: 1314 microversion: 2.1 time: 1.057322 Aug 24 10:15:48.497260 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 598/1115] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:47 2022] GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe => generated 1314 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:48.513406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-68f7dada-ac19-4960-93f0-59a2dcd7f196 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:48.514515 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-68f7dada-ac19-4960-93f0-59a2dcd7f196 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:48.525757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68f7dada-ac19-4960-93f0-59a2dcd7f196 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:48.527634 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68f7dada-ac19-4960-93f0-59a2dcd7f196 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:48.529037 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68f7dada-ac19-4960-93f0-59a2dcd7f196 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:48.531318 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68f7dada-ac19-4960-93f0-59a2dcd7f196 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:48.531748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68f7dada-ac19-4960-93f0-59a2dcd7f196 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:48.532466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68f7dada-ac19-4960-93f0-59a2dcd7f196 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:48.677510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5d5e6a24-8ee0-48cf-87a5-63778bed24e5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:48.698778 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5d5e6a24-8ee0-48cf-87a5-63778bed24e5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:48.703038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5d5e6a24-8ee0-48cf-87a5-63778bed24e5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:48.706088 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5d5e6a24-8ee0-48cf-87a5-63778bed24e5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1813 microversion: 2.25 time: 0.929047 Aug 24 10:15:48.707784 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 518/1116] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:15:47 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1813 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:15:48.750519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad05d900-fb35-45c7-b821-98803eaa5cec tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:48.753091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ad05d900-fb35-45c7-b821-98803eaa5cec tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:48.788115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad05d900-fb35-45c7-b821-98803eaa5cec tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:48.789520 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad05d900-fb35-45c7-b821-98803eaa5cec tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:48.790683 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad05d900-fb35-45c7-b821-98803eaa5cec tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:48.792898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad05d900-fb35-45c7-b821-98803eaa5cec tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:48.794191 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad05d900-fb35-45c7-b821-98803eaa5cec tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:48.795249 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad05d900-fb35-45c7-b821-98803eaa5cec tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:49.138068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-68f7dada-ac19-4960-93f0-59a2dcd7f196 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:49.149247 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-68f7dada-ac19-4960-93f0-59a2dcd7f196 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1528 microversion: 2.1 time: 0.649104 Aug 24 10:15:49.151033 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 599/1117] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:48 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1528 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:49.158819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bb6e75a8-1e75-4f16-8f28-4b9beeb08c2d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:49.159861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bb6e75a8-1e75-4f16-8f28-4b9beeb08c2d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:49.167399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb6e75a8-1e75-4f16-8f28-4b9beeb08c2d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:49.168291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb6e75a8-1e75-4f16-8f28-4b9beeb08c2d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:49.168992 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb6e75a8-1e75-4f16-8f28-4b9beeb08c2d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:49.170022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb6e75a8-1e75-4f16-8f28-4b9beeb08c2d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:49.170858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb6e75a8-1e75-4f16-8f28-4b9beeb08c2d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:49.171617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb6e75a8-1e75-4f16-8f28-4b9beeb08c2d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:49.584097 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ad05d900-fb35-45c7-b821-98803eaa5cec tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:49.609669 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ad05d900-fb35-45c7-b821-98803eaa5cec tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 200 len: 1497 microversion: 2.1 time: 0.870983 Aug 24 10:15:49.637164 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 519/1118] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:48 2022] GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 1497 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:49.637164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a5d0c049-aef6-45d0-8ff5-fd6d38a670e3 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:49.637164 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:15:49.637164 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:15:49.716973 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a5d0c049-aef6-45d0-8ff5-fd6d38a670e3 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/623db3b5-0bfd-4b20-95a7-db5ad80e00da" status: 202 len: 0 microversion: 2.1 time: 0.091863 Aug 24 10:15:49.720732 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 520/1119] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:15:49 2022] DELETE /compute/v2.1/flavors/623db3b5-0bfd-4b20-95a7-db5ad80e00da => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:15:49.736599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-77fbb7fa-1aff-4ea3-8ae4-e7ac2df9a621 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:49.740630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-77fbb7fa-1aff-4ea3-8ae4-e7ac2df9a621 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 7bbf838d-132a-449c-985e-3485e9c4b9fe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:49.769513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77fbb7fa-1aff-4ea3-8ae4-e7ac2df9a621 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:49.771042 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77fbb7fa-1aff-4ea3-8ae4-e7ac2df9a621 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:49.772292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77fbb7fa-1aff-4ea3-8ae4-e7ac2df9a621 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:49.775725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77fbb7fa-1aff-4ea3-8ae4-e7ac2df9a621 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:49.777640 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77fbb7fa-1aff-4ea3-8ae4-e7ac2df9a621 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:49.779699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77fbb7fa-1aff-4ea3-8ae4-e7ac2df9a621 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:49.890541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bb6e75a8-1e75-4f16-8f28-4b9beeb08c2d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:49.915346 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bb6e75a8-1e75-4f16-8f28-4b9beeb08c2d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1311 microversion: 2.1 time: 0.762101 Aug 24 10:15:49.916093 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 600/1120] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:49 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1311 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:49.944092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b10778e4-c093-4f6d-9cc9-ef5b9247b4f9 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:50.002847 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b10778e4-c093-4f6d-9cc9-ef5b9247b4f9 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.085539 Aug 24 10:15:50.018117 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 601/1121] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:15:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:50.025306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8c5b48f3-1fdf-45a9-b94a-e600b38b592f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:50.026391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8c5b48f3-1fdf-45a9-b94a-e600b38b592f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:50.034060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c5b48f3-1fdf-45a9-b94a-e600b38b592f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:50.039740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c5b48f3-1fdf-45a9-b94a-e600b38b592f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:50.041212 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c5b48f3-1fdf-45a9-b94a-e600b38b592f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:50.042232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c5b48f3-1fdf-45a9-b94a-e600b38b592f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:50.044883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c5b48f3-1fdf-45a9-b94a-e600b38b592f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:50.047276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c5b48f3-1fdf-45a9-b94a-e600b38b592f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:50.468429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8c5b48f3-1fdf-45a9-b94a-e600b38b592f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:50.485426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8c5b48f3-1fdf-45a9-b94a-e600b38b592f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:50.489512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8c5b48f3-1fdf-45a9-b94a-e600b38b592f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:50.497066 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8c5b48f3-1fdf-45a9-b94a-e600b38b592f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1813 microversion: 2.25 time: 0.477690 Aug 24 10:15:50.521061 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 602/1122] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:15:50 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1813 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:15:50.526590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e22d334f-77ee-4772-aab3-a26c31d4620f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:50.528981 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e22d334f-77ee-4772-aab3-a26c31d4620f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:50.539998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e22d334f-77ee-4772-aab3-a26c31d4620f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:50.540502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e22d334f-77ee-4772-aab3-a26c31d4620f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:50.540934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e22d334f-77ee-4772-aab3-a26c31d4620f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:50.541674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e22d334f-77ee-4772-aab3-a26c31d4620f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:50.542119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e22d334f-77ee-4772-aab3-a26c31d4620f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:50.553260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e22d334f-77ee-4772-aab3-a26c31d4620f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:50.616254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e22d334f-77ee-4772-aab3-a26c31d4620f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:50.625895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e22d334f-77ee-4772-aab3-a26c31d4620f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Old instance type tempest-test_resize_flavor_-380818033, new instance type m1.heat {{(pid=122433) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 10:15:50.636576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e22d334f-77ee-4772-aab3-a26c31d4620f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:15:50.637260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e22d334f-77ee-4772-aab3-a26c31d4620f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:15:50.637915 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e22d334f-77ee-4772-aab3-a26c31d4620f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:15:50.638495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e22d334f-77ee-4772-aab3-a26c31d4620f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:15:50.639097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e22d334f-77ee-4772-aab3-a26c31d4620f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:15:50.772037 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e22d334f-77ee-4772-aab3-a26c31d4620f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "POST /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08/action" status: 202 len: 0 microversion: 2.1 time: 0.249265 Aug 24 10:15:50.773382 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 603/1123] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:15:50 2022] POST /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:15:50.781839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7ad742dc-cf38-45a2-863e-c52d096223ee tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:50.783582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7ad742dc-cf38-45a2-863e-c52d096223ee tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:50.790746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:50.799971 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ad742dc-cf38-45a2-863e-c52d096223ee tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:50.800777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ad742dc-cf38-45a2-863e-c52d096223ee tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:50.801439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ad742dc-cf38-45a2-863e-c52d096223ee tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:50.802345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ad742dc-cf38-45a2-863e-c52d096223ee tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:50.803068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ad742dc-cf38-45a2-863e-c52d096223ee tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:50.803758 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ad742dc-cf38-45a2-863e-c52d096223ee tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:51.213744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-77fbb7fa-1aff-4ea3-8ae4-e7ac2df9a621 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:51.239999 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-77fbb7fa-1aff-4ea3-8ae4-e7ac2df9a621 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe" status: 200 len: 1314 microversion: 2.1 time: 1.516853 Aug 24 10:15:51.241504 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 521/1124] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:49 2022] GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe => generated 1314 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:51.255354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-85f52b91-8e11-4871-b686-6940d9bfbbf4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:51.256798 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-85f52b91-8e11-4871-b686-6940d9bfbbf4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:51.273664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85f52b91-8e11-4871-b686-6940d9bfbbf4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:51.274912 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85f52b91-8e11-4871-b686-6940d9bfbbf4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:51.275917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85f52b91-8e11-4871-b686-6940d9bfbbf4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:51.277534 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85f52b91-8e11-4871-b686-6940d9bfbbf4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:51.279415 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85f52b91-8e11-4871-b686-6940d9bfbbf4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:51.281426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85f52b91-8e11-4871-b686-6940d9bfbbf4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:51.522433 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7ad742dc-cf38-45a2-863e-c52d096223ee tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:51.573642 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7ad742dc-cf38-45a2-863e-c52d096223ee tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 200 len: 1497 microversion: 2.1 time: 0.793138 Aug 24 10:15:51.590976 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 604/1125] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:50 2022] GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 1497 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:51.597541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-914895c5-6b25-4b85-9355-2b08732c0982 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:51.598714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-914895c5-6b25-4b85-9355-2b08732c0982 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:51.607335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-914895c5-6b25-4b85-9355-2b08732c0982 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:51.608192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-914895c5-6b25-4b85-9355-2b08732c0982 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:51.608901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-914895c5-6b25-4b85-9355-2b08732c0982 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:51.610300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-914895c5-6b25-4b85-9355-2b08732c0982 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:51.611665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-914895c5-6b25-4b85-9355-2b08732c0982 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:51.612353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-914895c5-6b25-4b85-9355-2b08732c0982 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:52.196597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-914895c5-6b25-4b85-9355-2b08732c0982 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:52.216131 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-914895c5-6b25-4b85-9355-2b08732c0982 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1494 microversion: 2.1 time: 0.623475 Aug 24 10:15:52.217464 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 605/1126] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:51 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1494 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:52.222602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a37a2af1-f5e2-4e9b-b55f-1519ecdc2782 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:52.223558 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a37a2af1-f5e2-4e9b-b55f-1519ecdc2782 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:52.243981 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a37a2af1-f5e2-4e9b-b55f-1519ecdc2782 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:52.244895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a37a2af1-f5e2-4e9b-b55f-1519ecdc2782 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:52.248410 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a37a2af1-f5e2-4e9b-b55f-1519ecdc2782 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:52.249557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a37a2af1-f5e2-4e9b-b55f-1519ecdc2782 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:52.250252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a37a2af1-f5e2-4e9b-b55f-1519ecdc2782 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:52.250906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a37a2af1-f5e2-4e9b-b55f-1519ecdc2782 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:52.666083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=18 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:52.704342 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:52.920592 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-85f52b91-8e11-4871-b686-6940d9bfbbf4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:52.934322 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-85f52b91-8e11-4871-b686-6940d9bfbbf4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1537 microversion: 2.1 time: 1.690000 Aug 24 10:15:52.937631 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 522/1127] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:51 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1537 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:52.971889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a37a2af1-f5e2-4e9b-b55f-1519ecdc2782 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:52.990426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a37a2af1-f5e2-4e9b-b55f-1519ecdc2782 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:52.993805 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a37a2af1-f5e2-4e9b-b55f-1519ecdc2782 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:52.995684 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a37a2af1-f5e2-4e9b-b55f-1519ecdc2782 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1813 microversion: 2.25 time: 0.776808 Aug 24 10:15:52.996856 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 606/1128] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:15:52 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1813 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:15:53.017657 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ed031432-6f87-46b3-b679-92c1e2cdef46 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:53.018881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ed031432-6f87-46b3-b679-92c1e2cdef46 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 7bbf838d-132a-449c-985e-3485e9c4b9fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:53.032185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed031432-6f87-46b3-b679-92c1e2cdef46 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:53.033016 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed031432-6f87-46b3-b679-92c1e2cdef46 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:53.033725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed031432-6f87-46b3-b679-92c1e2cdef46 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:53.034786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed031432-6f87-46b3-b679-92c1e2cdef46 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:53.035515 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed031432-6f87-46b3-b679-92c1e2cdef46 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:53.037818 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed031432-6f87-46b3-b679-92c1e2cdef46 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:53.663511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ed44db91-2b6f-4926-a4f2-3ff7dc4b977f tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:53.667498 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ed44db91-2b6f-4926-a4f2-3ff7dc4b977f tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:53.686115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed44db91-2b6f-4926-a4f2-3ff7dc4b977f tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:53.690715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed44db91-2b6f-4926-a4f2-3ff7dc4b977f tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:53.692004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed44db91-2b6f-4926-a4f2-3ff7dc4b977f tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:53.704538 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed44db91-2b6f-4926-a4f2-3ff7dc4b977f tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:53.705843 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed44db91-2b6f-4926-a4f2-3ff7dc4b977f tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:53.707156 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed44db91-2b6f-4926-a4f2-3ff7dc4b977f tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:53.923356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ed031432-6f87-46b3-b679-92c1e2cdef46 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:53.943666 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ed031432-6f87-46b3-b679-92c1e2cdef46 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe" status: 200 len: 1314 microversion: 2.1 time: 0.944710 Aug 24 10:15:53.958791 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 607/1129] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:52 2022] GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe => generated 1314 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:53.976375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7212d6fd-29c3-4bac-8717-1bcaa0b8d271 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:53.981682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7212d6fd-29c3-4bac-8717-1bcaa0b8d271 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:53.991928 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7212d6fd-29c3-4bac-8717-1bcaa0b8d271 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:53.992912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7212d6fd-29c3-4bac-8717-1bcaa0b8d271 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:53.993740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7212d6fd-29c3-4bac-8717-1bcaa0b8d271 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:53.995028 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7212d6fd-29c3-4bac-8717-1bcaa0b8d271 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:53.995810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7212d6fd-29c3-4bac-8717-1bcaa0b8d271 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:53.996523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7212d6fd-29c3-4bac-8717-1bcaa0b8d271 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:54.464069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7212d6fd-29c3-4bac-8717-1bcaa0b8d271 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:54.474160 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7212d6fd-29c3-4bac-8717-1bcaa0b8d271 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 200 len: 1497 microversion: 2.1 time: 0.513670 Aug 24 10:15:54.480232 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 608/1130] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:53 2022] GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 1497 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:54.499834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6a50883c-b21d-4688-aaed-bc19dcb7d212 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:54.500797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6a50883c-b21d-4688-aaed-bc19dcb7d212 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:54.512372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a50883c-b21d-4688-aaed-bc19dcb7d212 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:54.522031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a50883c-b21d-4688-aaed-bc19dcb7d212 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:54.522502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a50883c-b21d-4688-aaed-bc19dcb7d212 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:54.523272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a50883c-b21d-4688-aaed-bc19dcb7d212 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:54.523738 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a50883c-b21d-4688-aaed-bc19dcb7d212 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:54.524173 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a50883c-b21d-4688-aaed-bc19dcb7d212 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:54.567282 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ed44db91-2b6f-4926-a4f2-3ff7dc4b977f tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1645 microversion: 2.1 time: 1.628055 Aug 24 10:15:54.572181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:54.581691 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 523/1131] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:52 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1645 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:54.589599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d410ceb9-ccab-46b1-8ada-78bedd98218a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:54.590238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d410ceb9-ccab-46b1-8ada-78bedd98218a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:54.602947 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d410ceb9-ccab-46b1-8ada-78bedd98218a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:54.603470 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d410ceb9-ccab-46b1-8ada-78bedd98218a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:54.604011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d410ceb9-ccab-46b1-8ada-78bedd98218a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:54.610144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d410ceb9-ccab-46b1-8ada-78bedd98218a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:54.610815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d410ceb9-ccab-46b1-8ada-78bedd98218a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:54.611418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d410ceb9-ccab-46b1-8ada-78bedd98218a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:55.548265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d410ceb9-ccab-46b1-8ada-78bedd98218a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:55.572975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d410ceb9-ccab-46b1-8ada-78bedd98218a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:55.575178 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d410ceb9-ccab-46b1-8ada-78bedd98218a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:55.577063 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d410ceb9-ccab-46b1-8ada-78bedd98218a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1813 microversion: 2.25 time: 0.993962 Aug 24 10:15:55.591157 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 524/1132] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:15:54 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1813 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:15:55.607184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-7094e2c5-955a-4eb5-8a92-2f167fda38b0 req-3d6a6ade-f9c5-444a-8b53-a23cf39d4b41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b390fef-6be9-4e24-b31e-b6f6252c88c1", "name": "network-vif-plugged", "status": "completed", "tag": "50041625-3e09-4ff3-9bab-8be84832b786"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:55.633494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:55.648873 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7094e2c5-955a-4eb5-8a92-2f167fda38b0 req-3d6a6ade-f9c5-444a-8b53-a23cf39d4b41 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:55.650055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7094e2c5-955a-4eb5-8a92-2f167fda38b0 req-3d6a6ade-f9c5-444a-8b53-a23cf39d4b41 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:55.650700 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7094e2c5-955a-4eb5-8a92-2f167fda38b0 req-3d6a6ade-f9c5-444a-8b53-a23cf39d4b41 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:55.663805 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6a50883c-b21d-4688-aaed-bc19dcb7d212 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:55.686211 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6a50883c-b21d-4688-aaed-bc19dcb7d212 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1537 microversion: 2.1 time: 1.203180 Aug 24 10:15:55.687925 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 609/1133] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:54 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1537 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:55.701451 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7094e2c5-955a-4eb5-8a92-2f167fda38b0 req-3d6a6ade-f9c5-444a-8b53-a23cf39d4b41 service nova] Creating event network-vif-plugged:50041625-3e09-4ff3-9bab-8be84832b786 for instance 6b390fef-6be9-4e24-b31e-b6f6252c88c1 on n-h2-849328-3 Aug 24 10:15:55.702431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b8c8835d-e180-4664-8e98-9cd7c4a3f480 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:55.703871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b8c8835d-e180-4664-8e98-9cd7c4a3f480 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:55.716142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8c8835d-e180-4664-8e98-9cd7c4a3f480 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:55.719391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8c8835d-e180-4664-8e98-9cd7c4a3f480 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:55.720008 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-7094e2c5-955a-4eb5-8a92-2f167fda38b0 req-3d6a6ade-f9c5-444a-8b53-a23cf39d4b41 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125896 Aug 24 10:15:55.720731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8c8835d-e180-4664-8e98-9cd7c4a3f480 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:55.723204 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 525/1134] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:55.723387 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8c8835d-e180-4664-8e98-9cd7c4a3f480 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:55.724971 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8c8835d-e180-4664-8e98-9cd7c4a3f480 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:55.741482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-393ed509-2e5c-4c7d-8f18-60b23a5d8714 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:55.742560 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-393ed509-2e5c-4c7d-8f18-60b23a5d8714 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 7bbf838d-132a-449c-985e-3485e9c4b9fe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:55.746262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8c8835d-e180-4664-8e98-9cd7c4a3f480 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:55.763132 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-393ed509-2e5c-4c7d-8f18-60b23a5d8714 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:55.765498 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-393ed509-2e5c-4c7d-8f18-60b23a5d8714 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:55.766178 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-393ed509-2e5c-4c7d-8f18-60b23a5d8714 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:55.768786 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-393ed509-2e5c-4c7d-8f18-60b23a5d8714 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:55.770825 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-393ed509-2e5c-4c7d-8f18-60b23a5d8714 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:55.773344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-393ed509-2e5c-4c7d-8f18-60b23a5d8714 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:56.201268 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b8c8835d-e180-4664-8e98-9cd7c4a3f480 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1645 microversion: 2.1 time: 0.510624 Aug 24 10:15:56.204897 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 610/1135] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:55 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1645 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:56.216310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3043d5ca-43d2-4655-9cb3-152fbb206aa2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:56.218373 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3043d5ca-43d2-4655-9cb3-152fbb206aa2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:56.230933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3043d5ca-43d2-4655-9cb3-152fbb206aa2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:56.232502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3043d5ca-43d2-4655-9cb3-152fbb206aa2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:56.234902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3043d5ca-43d2-4655-9cb3-152fbb206aa2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:56.238473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3043d5ca-43d2-4655-9cb3-152fbb206aa2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:56.239486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3043d5ca-43d2-4655-9cb3-152fbb206aa2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:56.240269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3043d5ca-43d2-4655-9cb3-152fbb206aa2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:56.413183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-393ed509-2e5c-4c7d-8f18-60b23a5d8714 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:56.423389 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-393ed509-2e5c-4c7d-8f18-60b23a5d8714 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe" status: 200 len: 1314 microversion: 2.1 time: 0.697851 Aug 24 10:15:56.437156 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 526/1136] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:55 2022] GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe => generated 1314 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:56.442408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d6993cfe-7b4d-48a9-9378-5223629b5049 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:56.445505 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:15:56.445505 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:15:56.447052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6993cfe-7b4d-48a9-9378-5223629b5049 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:56.447758 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6993cfe-7b4d-48a9-9378-5223629b5049 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:56.448424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6993cfe-7b4d-48a9-9378-5223629b5049 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:56.449430 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6993cfe-7b4d-48a9-9378-5223629b5049 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:56.450124 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6993cfe-7b4d-48a9-9378-5223629b5049 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:56.450773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6993cfe-7b4d-48a9-9378-5223629b5049 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:56.477812 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d6993cfe-7b4d-48a9-9378-5223629b5049 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] 10.222.0.85 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.039050 Aug 24 10:15:56.479147 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 527/1137] 10.222.0.85 () {58 vars in 1176 bytes} [Wed Aug 24 10:15:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:56.500127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-15ce1fb7-0528-46f0-9269-3e73b6f7ff16 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-849328-3", "block_migration": true, "disk_over_commit": false}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:56.503882 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-15ce1fb7-0528-46f0-9269-3e73b6f7ff16 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:56.513618 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15ce1fb7-0528-46f0-9269-3e73b6f7ff16 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:56.515793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15ce1fb7-0528-46f0-9269-3e73b6f7ff16 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:56.516492 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15ce1fb7-0528-46f0-9269-3e73b6f7ff16 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:56.517630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15ce1fb7-0528-46f0-9269-3e73b6f7ff16 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:56.518321 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15ce1fb7-0528-46f0-9269-3e73b6f7ff16 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:56.518959 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15ce1fb7-0528-46f0-9269-3e73b6f7ff16 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:56.558433 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-15ce1fb7-0528-46f0-9269-3e73b6f7ff16 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lazy-loading 'flavor' on Instance uuid e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:15:56.576822 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-15ce1fb7-0528-46f0-9269-3e73b6f7ff16 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Going to try to live migrate instance to n-h2-849328-3 {{(pid=122432) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 10:15:56.602560 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:56.854458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3043d5ca-43d2-4655-9cb3-152fbb206aa2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:56.883521 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3043d5ca-43d2-4655-9cb3-152fbb206aa2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 200 len: 1497 microversion: 2.1 time: 0.676266 Aug 24 10:15:56.891932 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 611/1138] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:56 2022] GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 1497 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:56.905033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ca9fe99b-a83e-4093-aa4c-0c9c477c7ef0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:56.906156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ca9fe99b-a83e-4093-aa4c-0c9c477c7ef0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:56.947344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca9fe99b-a83e-4093-aa4c-0c9c477c7ef0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:56.948155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca9fe99b-a83e-4093-aa4c-0c9c477c7ef0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:56.948887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca9fe99b-a83e-4093-aa4c-0c9c477c7ef0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:56.966046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca9fe99b-a83e-4093-aa4c-0c9c477c7ef0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:56.966905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca9fe99b-a83e-4093-aa4c-0c9c477c7ef0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:56.967700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca9fe99b-a83e-4093-aa4c-0c9c477c7ef0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:57.917112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ca9fe99b-a83e-4093-aa4c-0c9c477c7ef0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:57.969372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ca9fe99b-a83e-4093-aa4c-0c9c477c7ef0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:57.975185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ca9fe99b-a83e-4093-aa4c-0c9c477c7ef0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:57.984773 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ca9fe99b-a83e-4093-aa4c-0c9c477c7ef0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1813 microversion: 2.25 time: 1.089760 Aug 24 10:15:58.002578 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 612/1139] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:15:56 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1813 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:15:58.039581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-da9d8fd7-9ef9-4065-bdea-a1d34a06741a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:58.041262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-da9d8fd7-9ef9-4065-bdea-a1d34a06741a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:58.053362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da9d8fd7-9ef9-4065-bdea-a1d34a06741a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:58.054896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da9d8fd7-9ef9-4065-bdea-a1d34a06741a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:58.055944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da9d8fd7-9ef9-4065-bdea-a1d34a06741a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:58.057468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da9d8fd7-9ef9-4065-bdea-a1d34a06741a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:58.059255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da9d8fd7-9ef9-4065-bdea-a1d34a06741a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:58.060308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da9d8fd7-9ef9-4065-bdea-a1d34a06741a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:59.102484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da9d8fd7-9ef9-4065-bdea-a1d34a06741a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:59.119527 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-da9d8fd7-9ef9-4065-bdea-a1d34a06741a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1542 microversion: 2.1 time: 1.114899 Aug 24 10:15:59.120443 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 613/1140] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:58 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1542 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:59.125976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5e7ae346-7ffc-47c5-be10-cce1968cf51d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:59.132846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5e7ae346-7ffc-47c5-be10-cce1968cf51d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 7bbf838d-132a-449c-985e-3485e9c4b9fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:59.154023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e7ae346-7ffc-47c5-be10-cce1968cf51d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:59.155708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e7ae346-7ffc-47c5-be10-cce1968cf51d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:59.156304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e7ae346-7ffc-47c5-be10-cce1968cf51d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:59.157177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e7ae346-7ffc-47c5-be10-cce1968cf51d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:59.159131 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e7ae346-7ffc-47c5-be10-cce1968cf51d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:59.159869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e7ae346-7ffc-47c5-be10-cce1968cf51d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:59.606370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5e7ae346-7ffc-47c5-be10-cce1968cf51d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:59.627923 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5e7ae346-7ffc-47c5-be10-cce1968cf51d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe" status: 200 len: 1314 microversion: 2.1 time: 0.506182 Aug 24 10:15:59.628544 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 614/1141] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:59 2022] GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:59.649844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b92358d1-6dd9-486e-962d-9eefb4acee47 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:59.650899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b92358d1-6dd9-486e-962d-9eefb4acee47 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:59.696752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b92358d1-6dd9-486e-962d-9eefb4acee47 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:59.697624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b92358d1-6dd9-486e-962d-9eefb4acee47 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:59.698003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b92358d1-6dd9-486e-962d-9eefb4acee47 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:59.698771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b92358d1-6dd9-486e-962d-9eefb4acee47 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:59.699237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b92358d1-6dd9-486e-962d-9eefb4acee47 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:59.699659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b92358d1-6dd9-486e-962d-9eefb4acee47 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:00.481432 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-15ce1fb7-0528-46f0-9269-3e73b6f7ff16 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8/action" status: 202 len: 0 microversion: 2.1 time: 3.986628 Aug 24 10:16:00.483628 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 528/1142] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:15:56 2022] POST /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8/action => generated 0 bytes in 3992 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 10:16:00.507013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b92358d1-6dd9-486e-962d-9eefb4acee47 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:00.525817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-ec572e1e-c260-41fd-aaf9-3eda2fa2d6ae req-16cf91f7-d7d9-434a-ba1f-b4a84f5c60e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bbf838d-132a-449c-985e-3485e9c4b9fe", "name": "network-vif-plugged", "status": "completed", "tag": "929039dc-5f8e-4877-bfab-387d866840b0"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:16:00.528724 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b92358d1-6dd9-486e-962d-9eefb4acee47 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 200 len: 1497 microversion: 2.1 time: 0.881418 Aug 24 10:16:00.530688 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 615/1143] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:59 2022] GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 1497 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:00.540025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-06f995c1-cbd3-4000-b020-27c403b83ee6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:00.557377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-06f995c1-cbd3-4000-b020-27c403b83ee6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:00.567665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06f995c1-cbd3-4000-b020-27c403b83ee6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:00.568586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06f995c1-cbd3-4000-b020-27c403b83ee6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:00.569321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06f995c1-cbd3-4000-b020-27c403b83ee6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:00.570358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06f995c1-cbd3-4000-b020-27c403b83ee6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:00.571066 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06f995c1-cbd3-4000-b020-27c403b83ee6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:00.571740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06f995c1-cbd3-4000-b020-27c403b83ee6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:00.573034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ec572e1e-c260-41fd-aaf9-3eda2fa2d6ae req-16cf91f7-d7d9-434a-ba1f-b4a84f5c60e5 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:00.574725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ec572e1e-c260-41fd-aaf9-3eda2fa2d6ae req-16cf91f7-d7d9-434a-ba1f-b4a84f5c60e5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:00.575174 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ec572e1e-c260-41fd-aaf9-3eda2fa2d6ae req-16cf91f7-d7d9-434a-ba1f-b4a84f5c60e5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:00.602781 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-ec572e1e-c260-41fd-aaf9-3eda2fa2d6ae req-16cf91f7-d7d9-434a-ba1f-b4a84f5c60e5 service nova] Creating event network-vif-plugged:929039dc-5f8e-4877-bfab-387d866840b0 for instance 7bbf838d-132a-449c-985e-3485e9c4b9fe on n-h1-849328-3 Aug 24 10:16:00.615555 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-ec572e1e-c260-41fd-aaf9-3eda2fa2d6ae req-16cf91f7-d7d9-434a-ba1f-b4a84f5c60e5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128498 Aug 24 10:16:00.616527 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 529/1144] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:16:00.623919 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a28c1bca-2509-45a9-8494-639e35d89926 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:00.625372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a28c1bca-2509-45a9-8494-639e35d89926 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:00.633887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a28c1bca-2509-45a9-8494-639e35d89926 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:00.635177 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a28c1bca-2509-45a9-8494-639e35d89926 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:00.636539 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a28c1bca-2509-45a9-8494-639e35d89926 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:00.637643 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a28c1bca-2509-45a9-8494-639e35d89926 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:00.638984 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a28c1bca-2509-45a9-8494-639e35d89926 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:00.648122 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a28c1bca-2509-45a9-8494-639e35d89926 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:01.239583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a28c1bca-2509-45a9-8494-639e35d89926 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:01.278586 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a28c1bca-2509-45a9-8494-639e35d89926 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1542 microversion: 2.1 time: 0.645611 Aug 24 10:16:01.279883 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 530/1145] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:00 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1542 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:01.292238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-72f1ad59-23e1-4cb3-bafa-0e0ecbb73c74 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:01.293182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-72f1ad59-23e1-4cb3-bafa-0e0ecbb73c74 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:01.307275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72f1ad59-23e1-4cb3-bafa-0e0ecbb73c74 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:01.308840 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72f1ad59-23e1-4cb3-bafa-0e0ecbb73c74 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:01.312755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72f1ad59-23e1-4cb3-bafa-0e0ecbb73c74 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:01.313861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72f1ad59-23e1-4cb3-bafa-0e0ecbb73c74 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:01.314497 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72f1ad59-23e1-4cb3-bafa-0e0ecbb73c74 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:01.315159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72f1ad59-23e1-4cb3-bafa-0e0ecbb73c74 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:01.567394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-72f1ad59-23e1-4cb3-bafa-0e0ecbb73c74 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:01.578247 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-72f1ad59-23e1-4cb3-bafa-0e0ecbb73c74 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1504 microversion: 2.1 time: 0.297066 Aug 24 10:16:01.595524 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-06f995c1-cbd3-4000-b020-27c403b83ee6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:01.597826 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 531/1146] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:01 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1504 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:01.603160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7b2824f5-e433-40aa-bbf3-dd8f4be0ec6e tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:01.603997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7b2824f5-e433-40aa-bbf3-dd8f4be0ec6e tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 7bbf838d-132a-449c-985e-3485e9c4b9fe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:01.612279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b2824f5-e433-40aa-bbf3-dd8f4be0ec6e tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:01.612490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-06f995c1-cbd3-4000-b020-27c403b83ee6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:01.613432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b2824f5-e433-40aa-bbf3-dd8f4be0ec6e tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:01.614071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b2824f5-e433-40aa-bbf3-dd8f4be0ec6e tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:01.615345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b2824f5-e433-40aa-bbf3-dd8f4be0ec6e tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:01.616161 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b2824f5-e433-40aa-bbf3-dd8f4be0ec6e tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:01.617549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-06f995c1-cbd3-4000-b020-27c403b83ee6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:01.618241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b2824f5-e433-40aa-bbf3-dd8f4be0ec6e tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:01.622594 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-06f995c1-cbd3-4000-b020-27c403b83ee6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1813 microversion: 2.25 time: 1.089971 Aug 24 10:16:01.624814 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 616/1147] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:16:00 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1813 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:16:01.638929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-361d5554-0f54-4f79-99bb-5652ac1e6c12 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:01.639863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-361d5554-0f54-4f79-99bb-5652ac1e6c12 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:01.659842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361d5554-0f54-4f79-99bb-5652ac1e6c12 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:01.660624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361d5554-0f54-4f79-99bb-5652ac1e6c12 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:01.661491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361d5554-0f54-4f79-99bb-5652ac1e6c12 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:01.662381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361d5554-0f54-4f79-99bb-5652ac1e6c12 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:01.662999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361d5554-0f54-4f79-99bb-5652ac1e6c12 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:01.665687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361d5554-0f54-4f79-99bb-5652ac1e6c12 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:02.112725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-361d5554-0f54-4f79-99bb-5652ac1e6c12 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:02.123744 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-361d5554-0f54-4f79-99bb-5652ac1e6c12 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 200 len: 1474 microversion: 2.1 time: 0.494322 Aug 24 10:16:02.125089 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 617/1148] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:01 2022] GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 1474 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:02.154076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d33b52dd-8f34-45eb-8044-8d841d155e12 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1303727571"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:16:02.158701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d33b52dd-8f34-45eb-8044-8d841d155e12 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:02.170780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d33b52dd-8f34-45eb-8044-8d841d155e12 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:02.171593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d33b52dd-8f34-45eb-8044-8d841d155e12 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:02.172202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d33b52dd-8f34-45eb-8044-8d841d155e12 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:02.173178 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d33b52dd-8f34-45eb-8044-8d841d155e12 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:02.174604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d33b52dd-8f34-45eb-8044-8d841d155e12 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:02.175392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d33b52dd-8f34-45eb-8044-8d841d155e12 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:02.514017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7b2824f5-e433-40aa-bbf3-dd8f4be0ec6e tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:02.562740 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7b2824f5-e433-40aa-bbf3-dd8f4be0ec6e tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe" status: 200 len: 1314 microversion: 2.1 time: 0.961199 Aug 24 10:16:02.585684 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 532/1149] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:01 2022] GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe => generated 1314 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:02.622785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1bb05af2-8831-4b87-acd9-b4cd0b3b21a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:02.625816 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1bb05af2-8831-4b87-acd9-b4cd0b3b21a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:02.658137 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1bb05af2-8831-4b87-acd9-b4cd0b3b21a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:02.659521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1bb05af2-8831-4b87-acd9-b4cd0b3b21a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:02.664334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1bb05af2-8831-4b87-acd9-b4cd0b3b21a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:02.666531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1bb05af2-8831-4b87-acd9-b4cd0b3b21a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:02.668589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1bb05af2-8831-4b87-acd9-b4cd0b3b21a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:02.670465 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1bb05af2-8831-4b87-acd9-b4cd0b3b21a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:02.869788 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d33b52dd-8f34-45eb-8044-8d841d155e12 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "POST /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9/action" status: 202 len: 0 microversion: 2.1 time: 0.717934 Aug 24 10:16:02.874249 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 618/1150] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:16:02 2022] POST /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9/action => generated 0 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 10:16:02.893348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d5e26eb7-2aa4-484f-90bc-ee8e52e1901b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:02.894937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d5e26eb7-2aa4-484f-90bc-ee8e52e1901b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:02.919397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5e26eb7-2aa4-484f-90bc-ee8e52e1901b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:02.921569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5e26eb7-2aa4-484f-90bc-ee8e52e1901b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:02.926483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5e26eb7-2aa4-484f-90bc-ee8e52e1901b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:02.929921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5e26eb7-2aa4-484f-90bc-ee8e52e1901b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:02.931179 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5e26eb7-2aa4-484f-90bc-ee8e52e1901b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:02.932294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5e26eb7-2aa4-484f-90bc-ee8e52e1901b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:03.039735 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1bb05af2-8831-4b87-acd9-b4cd0b3b21a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:03.052914 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1bb05af2-8831-4b87-acd9-b4cd0b3b21a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1542 microversion: 2.1 time: 0.461223 Aug 24 10:16:03.054068 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 533/1151] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:02 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1542 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:03.069269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-23f5c078-b4f4-46c0-93f2-6ec013728764 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:03.070014 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-23f5c078-b4f4-46c0-93f2-6ec013728764 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:03.081511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23f5c078-b4f4-46c0-93f2-6ec013728764 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:03.084250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23f5c078-b4f4-46c0-93f2-6ec013728764 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:03.085634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23f5c078-b4f4-46c0-93f2-6ec013728764 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:03.087139 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23f5c078-b4f4-46c0-93f2-6ec013728764 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:03.090701 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23f5c078-b4f4-46c0-93f2-6ec013728764 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:03.091556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23f5c078-b4f4-46c0-93f2-6ec013728764 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:03.436074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d5e26eb7-2aa4-484f-90bc-ee8e52e1901b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:03.456548 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d5e26eb7-2aa4-484f-90bc-ee8e52e1901b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1504 microversion: 2.1 time: 0.579519 Aug 24 10:16:03.474691 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 619/1152] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:02 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1504 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:03.483953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ad87263b-4d1d-400d-8d2a-75a8d2abda87 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4654ed19d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:03.593645 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ad87263b-4d1d-400d-8d2a-75a8d2abda87 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a" status: 200 len: 1414 microversion: 2.1 time: 0.115199 Aug 24 10:16:03.598942 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 620/1153] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:16:03 2022] GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a => generated 1414 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:03.611032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3cdb47ee-5485-49da-ad26-470b03f3b5ee tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:03.615083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3cdb47ee-5485-49da-ad26-470b03f3b5ee tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 7bbf838d-132a-449c-985e-3485e9c4b9fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:03.631144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cdb47ee-5485-49da-ad26-470b03f3b5ee tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:03.631946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cdb47ee-5485-49da-ad26-470b03f3b5ee tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:03.634824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cdb47ee-5485-49da-ad26-470b03f3b5ee tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:03.638601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cdb47ee-5485-49da-ad26-470b03f3b5ee tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:03.639692 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cdb47ee-5485-49da-ad26-470b03f3b5ee tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:03.642226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cdb47ee-5485-49da-ad26-470b03f3b5ee tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:03.747194 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-23f5c078-b4f4-46c0-93f2-6ec013728764 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:03.768483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-23f5c078-b4f4-46c0-93f2-6ec013728764 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:03.774064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-23f5c078-b4f4-46c0-93f2-6ec013728764 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:03.775478 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-23f5c078-b4f4-46c0-93f2-6ec013728764 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1803 microversion: 2.25 time: 0.717159 Aug 24 10:16:03.778273 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 534/1154] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:16:03 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1803 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:16:03.818754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7f667188-d2e1-47a8-92c4-636280c0f608 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Calling method '.version_select at 0x7f4654fd63a0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:03.826014 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f667188-d2e1-47a8-92c4-636280c0f608 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:03.827213 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f667188-d2e1-47a8-92c4-636280c0f608 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:03.827965 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f667188-d2e1-47a8-92c4-636280c0f608 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:03.842602 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7f667188-d2e1-47a8-92c4-636280c0f608 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] 10.222.0.85 "GET /compute/v2.1/os-migrations" status: 200 len: 3449 microversion: 2.25 time: 0.039768 Aug 24 10:16:03.844077 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 535/1155] 10.222.0.85 () {60 vars in 1184 bytes} [Wed Aug 24 10:16:03 2022] GET /compute/v2.1/os-migrations => generated 3449 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:16:03.869295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7d2d84cd-b792-4f2c-8685-8a7b0f14711b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:03.870373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7d2d84cd-b792-4f2c-8685-8a7b0f14711b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:03.878653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d2d84cd-b792-4f2c-8685-8a7b0f14711b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:03.879759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d2d84cd-b792-4f2c-8685-8a7b0f14711b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:03.880521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d2d84cd-b792-4f2c-8685-8a7b0f14711b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:03.882068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d2d84cd-b792-4f2c-8685-8a7b0f14711b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:03.882775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d2d84cd-b792-4f2c-8685-8a7b0f14711b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:03.883649 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d2d84cd-b792-4f2c-8685-8a7b0f14711b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:04.050962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3cdb47ee-5485-49da-ad26-470b03f3b5ee tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:04.066373 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3cdb47ee-5485-49da-ad26-470b03f3b5ee tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe" status: 200 len: 1464 microversion: 2.1 time: 0.465203 Aug 24 10:16:04.085149 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 621/1156] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:03 2022] GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe => generated 1464 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:04.085531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0cd809a0-dda6-4a5a-8368-0eacade76130 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:04.098749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0cd809a0-dda6-4a5a-8368-0eacade76130 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:04.114884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cd809a0-dda6-4a5a-8368-0eacade76130 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:04.117097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cd809a0-dda6-4a5a-8368-0eacade76130 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:04.121021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cd809a0-dda6-4a5a-8368-0eacade76130 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:04.122107 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cd809a0-dda6-4a5a-8368-0eacade76130 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:04.122786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cd809a0-dda6-4a5a-8368-0eacade76130 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:04.123602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cd809a0-dda6-4a5a-8368-0eacade76130 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:04.510364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0cd809a0-dda6-4a5a-8368-0eacade76130 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:04.526843 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0cd809a0-dda6-4a5a-8368-0eacade76130 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1542 microversion: 2.1 time: 0.452237 Aug 24 10:16:04.533016 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 622/1157] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:04 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1542 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:04.542453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0081348d-3e2f-4ed6-ad90-497e83b14d7c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:04.543084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0081348d-3e2f-4ed6-ad90-497e83b14d7c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:04.571004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0081348d-3e2f-4ed6-ad90-497e83b14d7c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:04.571581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0081348d-3e2f-4ed6-ad90-497e83b14d7c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:04.586390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0081348d-3e2f-4ed6-ad90-497e83b14d7c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:04.587191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0081348d-3e2f-4ed6-ad90-497e83b14d7c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:04.587693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0081348d-3e2f-4ed6-ad90-497e83b14d7c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:04.588166 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0081348d-3e2f-4ed6-ad90-497e83b14d7c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:04.802851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-7d2d84cd-b792-4f2c-8685-8a7b0f14711b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lazy-loading 'services' on Instance uuid 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:16:04.873081 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7d2d84cd-b792-4f2c-8685-8a7b0f14711b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 2421 microversion: 2.25 time: 1.011329 Aug 24 10:16:04.889371 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 536/1158] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:16:03 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 2421 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:16:04.945065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0965c9cf-725b-4fa6-b77b-3c4ac1c7d260 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:04.962623 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0965c9cf-725b-4fa6-b77b-3c4ac1c7d260 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:04.976221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0965c9cf-725b-4fa6-b77b-3c4ac1c7d260 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:04.977331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0965c9cf-725b-4fa6-b77b-3c4ac1c7d260 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:04.978598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0965c9cf-725b-4fa6-b77b-3c4ac1c7d260 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:04.979762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0965c9cf-725b-4fa6-b77b-3c4ac1c7d260 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:04.983415 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0965c9cf-725b-4fa6-b77b-3c4ac1c7d260 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:04.984150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0965c9cf-725b-4fa6-b77b-3c4ac1c7d260 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:05.052117 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0081348d-3e2f-4ed6-ad90-497e83b14d7c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:05.077592 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0081348d-3e2f-4ed6-ad90-497e83b14d7c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1462 microversion: 2.1 time: 0.539463 Aug 24 10:16:05.080231 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 623/1159] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:04 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1462 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:05.117805 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d2ca7e36-1a2a-49be-82e5-57ebb49f5c4f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4654f5a310>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:05.241904 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d2ca7e36-1a2a-49be-82e5-57ebb49f5c4f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a" status: 200 len: 1414 microversion: 2.1 time: 0.144890 Aug 24 10:16:05.256197 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 624/1160] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:16:05 2022] GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a => generated 1414 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:05.276083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-57cd8cc1-4b61-40e8-8cf8-68c22b3da257 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:05.277470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-57cd8cc1-4b61-40e8-8cf8-68c22b3da257 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:05.285315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57cd8cc1-4b61-40e8-8cf8-68c22b3da257 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:05.286384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57cd8cc1-4b61-40e8-8cf8-68c22b3da257 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:05.287084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57cd8cc1-4b61-40e8-8cf8-68c22b3da257 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:05.289872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57cd8cc1-4b61-40e8-8cf8-68c22b3da257 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:05.290617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57cd8cc1-4b61-40e8-8cf8-68c22b3da257 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:05.291271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57cd8cc1-4b61-40e8-8cf8-68c22b3da257 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:05.588359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0965c9cf-725b-4fa6-b77b-3c4ac1c7d260 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:05.602573 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0965c9cf-725b-4fa6-b77b-3c4ac1c7d260 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1504 microversion: 2.1 time: 0.711652 Aug 24 10:16:05.609860 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 537/1161] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:04 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1504 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:05.617939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f32fc3e5-73d8-4c26-bfcf-542f234e9600 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-615398116", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "6b390fef-6be9-4e24-b31e-b6f6252c88c1"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:16:05.762922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-f32fc3e5-73d8-4c26-bfcf-542f234e9600 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:16:06.067555 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-57cd8cc1-4b61-40e8-8cf8-68c22b3da257 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lazy-loading 'services' on Instance uuid 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:16:06.103999 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-57cd8cc1-4b61-40e8-8cf8-68c22b3da257 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 2421 microversion: 2.25 time: 0.844920 Aug 24 10:16:06.123323 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 625/1162] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:16:05 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 2421 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:16:06.130448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c5a2a66e-16f8-4ea9-96f5-58db0323e8aa tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:06.131066 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c5a2a66e-16f8-4ea9-96f5-58db0323e8aa tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:06.143565 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5a2a66e-16f8-4ea9-96f5-58db0323e8aa tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:06.144071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5a2a66e-16f8-4ea9-96f5-58db0323e8aa tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:06.144512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5a2a66e-16f8-4ea9-96f5-58db0323e8aa tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:06.145479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5a2a66e-16f8-4ea9-96f5-58db0323e8aa tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:06.145888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5a2a66e-16f8-4ea9-96f5-58db0323e8aa tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:06.146707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5a2a66e-16f8-4ea9-96f5-58db0323e8aa tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:06.175283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:16:06.459178 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:16:06.503527 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f32fc3e5-73d8-4c26-bfcf-542f234e9600 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:16:06.505004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f32fc3e5-73d8-4c26-bfcf-542f234e9600 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:16:06.505607 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f32fc3e5-73d8-4c26-bfcf-542f234e9600 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:16:06.506233 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f32fc3e5-73d8-4c26-bfcf-542f234e9600 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:16:06.506848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f32fc3e5-73d8-4c26-bfcf-542f234e9600 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:16:06.524037 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f32fc3e5-73d8-4c26-bfcf-542f234e9600 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:06.534619 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f32fc3e5-73d8-4c26-bfcf-542f234e9600 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:06.535742 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f32fc3e5-73d8-4c26-bfcf-542f234e9600 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:06.537871 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f32fc3e5-73d8-4c26-bfcf-542f234e9600 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:06.538578 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f32fc3e5-73d8-4c26-bfcf-542f234e9600 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:06.539231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f32fc3e5-73d8-4c26-bfcf-542f234e9600 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:06.592348 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-f32fc3e5-73d8-4c26-bfcf-542f234e9600 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Getting quotas for project e6dcc3fc5b544363b1fcaadd50ea948a. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:16:06.609457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-f32fc3e5-73d8-4c26-bfcf-542f234e9600 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Getting quotas for user 965e7789d7d942a793b07f71dd407fd8 and project e6dcc3fc5b544363b1fcaadd50ea948a. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:16:06.644643 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f32fc3e5-73d8-4c26-bfcf-542f234e9600 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:16:06.647111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f32fc3e5-73d8-4c26-bfcf-542f234e9600 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 912f291b-bf95-456e-a123-95c1314bbc09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:16:06.762437 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f32fc3e5-73d8-4c26-bfcf-542f234e9600 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.151324 Aug 24 10:16:06.763138 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 538/1163] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:16:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:16:06.910019 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a79d049a-6d65-4ce9-8643-d61d242ee416 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-157927952", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "620680d4-be9b-4509-ae46-5fb73d45beed"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:16:07.039693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-a79d049a-6d65-4ce9-8643-d61d242ee416 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] validate_networks() for [('620680d4-be9b-4509-ae46-5fb73d45beed', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:16:07.610362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c5a2a66e-16f8-4ea9-96f5-58db0323e8aa tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:07.635448 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c5a2a66e-16f8-4ea9-96f5-58db0323e8aa tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1542 microversion: 2.1 time: 1.508605 Aug 24 10:16:07.653192 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 626/1164] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:06 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1542 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:07.667912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7173e39e-6f5f-4d01-978a-107db45905c9 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4654ebca60>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:07.894357 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7173e39e-6f5f-4d01-978a-107db45905c9 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a" status: 200 len: 1414 microversion: 2.1 time: 0.226114 Aug 24 10:16:07.899083 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 627/1165] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:16:07 2022] GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a => generated 1414 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:07.917437 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a23bbf64-67ff-4e33-a4d7-7507886120c5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:07.917956 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a23bbf64-67ff-4e33-a4d7-7507886120c5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:07.963166 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a23bbf64-67ff-4e33-a4d7-7507886120c5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:07.968142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a23bbf64-67ff-4e33-a4d7-7507886120c5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:07.969872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a23bbf64-67ff-4e33-a4d7-7507886120c5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:07.974714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a23bbf64-67ff-4e33-a4d7-7507886120c5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:07.978434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a23bbf64-67ff-4e33-a4d7-7507886120c5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:07.978959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a23bbf64-67ff-4e33-a4d7-7507886120c5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:08.242142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-a23bbf64-67ff-4e33-a4d7-7507886120c5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lazy-loading 'services' on Instance uuid 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:16:08.640921 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a23bbf64-67ff-4e33-a4d7-7507886120c5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "DELETE /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0/os-volume_attachments/60e84452-316c-49d9-b5ba-91a3e3e1bd9c" status: 202 len: 0 microversion: 2.25 time: 0.738126 Aug 24 10:16:08.647487 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 628/1166] 10.222.0.85 () {60 vars in 1457 bytes} [Wed Aug 24 10:16:07 2022] DELETE /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0/os-volume_attachments/60e84452-316c-49d9-b5ba-91a3e3e1bd9c => generated 0 bytes in 748 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:16:08.668023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-488722f1-d6e8-42d9-b411-fc4e5698028b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:08.674353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-488722f1-d6e8-42d9-b411-fc4e5698028b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:08.703780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-488722f1-d6e8-42d9-b411-fc4e5698028b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:08.704715 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-488722f1-d6e8-42d9-b411-fc4e5698028b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:08.705543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-488722f1-d6e8-42d9-b411-fc4e5698028b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:08.706829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-488722f1-d6e8-42d9-b411-fc4e5698028b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:08.707661 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-488722f1-d6e8-42d9-b411-fc4e5698028b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:08.708423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-488722f1-d6e8-42d9-b411-fc4e5698028b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:09.013734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-a79d049a-6d65-4ce9-8643-d61d242ee416 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:16:09.014755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-a79d049a-6d65-4ce9-8643-d61d242ee416 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:16:09.015654 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-a79d049a-6d65-4ce9-8643-d61d242ee416 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:16:09.016476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-a79d049a-6d65-4ce9-8643-d61d242ee416 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:16:09.017337 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-a79d049a-6d65-4ce9-8643-d61d242ee416 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:16:09.069721 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a79d049a-6d65-4ce9-8643-d61d242ee416 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:09.076970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a79d049a-6d65-4ce9-8643-d61d242ee416 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:09.078431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a79d049a-6d65-4ce9-8643-d61d242ee416 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:09.091412 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a79d049a-6d65-4ce9-8643-d61d242ee416 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:09.093244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a79d049a-6d65-4ce9-8643-d61d242ee416 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:09.096540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a79d049a-6d65-4ce9-8643-d61d242ee416 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:09.163995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-a79d049a-6d65-4ce9-8643-d61d242ee416 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Getting quotas for project 1ef1a2f8a03d4395903df62f152212d9. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:16:09.178419 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-a79d049a-6d65-4ce9-8643-d61d242ee416 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Getting quotas for user cb69265eac264f36acc9d04eb60a0449 and project 1ef1a2f8a03d4395903df62f152212d9. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:16:09.242381 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a79d049a-6d65-4ce9-8643-d61d242ee416 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:16:09.253167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a79d049a-6d65-4ce9-8643-d61d242ee416 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:16:09.371262 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a79d049a-6d65-4ce9-8643-d61d242ee416 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.585428 Aug 24 10:16:09.373583 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 539/1167] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:16:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:16:09.387346 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fb1c0446-9fdb-4ef4-923d-4f666eb78fde tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:09.396183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fb1c0446-9fdb-4ef4-923d-4f666eb78fde tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 912f291b-bf95-456e-a123-95c1314bbc09] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:09.449042 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb1c0446-9fdb-4ef4-923d-4f666eb78fde tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:09.450536 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb1c0446-9fdb-4ef4-923d-4f666eb78fde tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:09.453920 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb1c0446-9fdb-4ef4-923d-4f666eb78fde tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:09.454986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb1c0446-9fdb-4ef4-923d-4f666eb78fde tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:09.456206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb1c0446-9fdb-4ef4-923d-4f666eb78fde tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:09.457499 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb1c0446-9fdb-4ef4-923d-4f666eb78fde tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:09.624710 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fb1c0446-9fdb-4ef4-923d-4f666eb78fde tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:09.643877 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fb1c0446-9fdb-4ef4-923d-4f666eb78fde tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09" status: 200 len: 1265 microversion: 2.1 time: 0.268116 Aug 24 10:16:09.657307 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 540/1168] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:09 2022] GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09 => generated 1265 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:09.664925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3ec9e9f3-1ba1-4c9c-bec9-99816dcb1a11 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:09.666730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3ec9e9f3-1ba1-4c9c-bec9-99816dcb1a11 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:09.695284 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ec9e9f3-1ba1-4c9c-bec9-99816dcb1a11 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:09.696146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ec9e9f3-1ba1-4c9c-bec9-99816dcb1a11 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:09.700387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ec9e9f3-1ba1-4c9c-bec9-99816dcb1a11 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:09.701864 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ec9e9f3-1ba1-4c9c-bec9-99816dcb1a11 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:09.702690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ec9e9f3-1ba1-4c9c-bec9-99816dcb1a11 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:09.703409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ec9e9f3-1ba1-4c9c-bec9-99816dcb1a11 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:10.105855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-488722f1-d6e8-42d9-b411-fc4e5698028b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:10.131213 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-488722f1-d6e8-42d9-b411-fc4e5698028b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1504 microversion: 2.1 time: 1.480457 Aug 24 10:16:10.174195 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 629/1169] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:08 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1504 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:10.211909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3b7b187c-3486-4ff3-b6af-c81fe3683ff7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:10.220879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3b7b187c-3486-4ff3-b6af-c81fe3683ff7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:10.261437 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b7b187c-3486-4ff3-b6af-c81fe3683ff7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:10.265514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b7b187c-3486-4ff3-b6af-c81fe3683ff7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:10.266332 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b7b187c-3486-4ff3-b6af-c81fe3683ff7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:10.271919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b7b187c-3486-4ff3-b6af-c81fe3683ff7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:10.273563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b7b187c-3486-4ff3-b6af-c81fe3683ff7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:10.278063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b7b187c-3486-4ff3-b6af-c81fe3683ff7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:10.439500 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3b7b187c-3486-4ff3-b6af-c81fe3683ff7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.262621 Aug 24 10:16:10.440114 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 630/1170] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Aug 24 10:16:10 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0/os-volume_attachments => generated 197 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:16:10.462233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-57bec0d9-9754-4f55-96e6-135a6e39e50f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4654f0b1f0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:10.609951 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-57bec0d9-9754-4f55-96e6-135a6e39e50f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a" status: 200 len: 1414 microversion: 2.1 time: 0.165479 Aug 24 10:16:10.612989 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 631/1171] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:16:10 2022] GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a => generated 1414 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:10.633533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4db6d49d-a9ef-42ba-ba89-bbdd10d4641e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:10.638163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4db6d49d-a9ef-42ba-ba89-bbdd10d4641e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:10.809109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3ec9e9f3-1ba1-4c9c-bec9-99816dcb1a11 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:10.840806 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3ec9e9f3-1ba1-4c9c-bec9-99816dcb1a11 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1542 microversion: 2.1 time: 1.182812 Aug 24 10:16:10.841471 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 541/1172] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:09 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1542 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:10.846981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9a5a80fa-03ce-4d02-96b9-e864c3a8efa2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:10.847610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9a5a80fa-03ce-4d02-96b9-e864c3a8efa2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 912f291b-bf95-456e-a123-95c1314bbc09] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:10.922711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a5a80fa-03ce-4d02-96b9-e864c3a8efa2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:10.923258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a5a80fa-03ce-4d02-96b9-e864c3a8efa2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:10.923727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a5a80fa-03ce-4d02-96b9-e864c3a8efa2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:10.924506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a5a80fa-03ce-4d02-96b9-e864c3a8efa2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:10.924964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a5a80fa-03ce-4d02-96b9-e864c3a8efa2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:10.940424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a5a80fa-03ce-4d02-96b9-e864c3a8efa2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:10.994199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4db6d49d-a9ef-42ba-ba89-bbdd10d4641e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb69265eac264f36acc9d04eb60a0449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1a2f8a03d4395903df62f152212d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:11.019832 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4db6d49d-a9ef-42ba-ba89-bbdd10d4641e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff" status: 200 len: 1231 microversion: 2.1 time: 0.402741 Aug 24 10:16:11.022838 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 632/1173] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:10 2022] GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff => generated 1231 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:11.172335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-413bd74c-2171-40bc-b866-f746ef570bbb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:11.173600 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-413bd74c-2171-40bc-b866-f746ef570bbb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:11.185044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-413bd74c-2171-40bc-b866-f746ef570bbb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:11.187869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-413bd74c-2171-40bc-b866-f746ef570bbb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:11.189838 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-413bd74c-2171-40bc-b866-f746ef570bbb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:11.197299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-413bd74c-2171-40bc-b866-f746ef570bbb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:11.198712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-413bd74c-2171-40bc-b866-f746ef570bbb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:11.199200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-413bd74c-2171-40bc-b866-f746ef570bbb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:11.355716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9a5a80fa-03ce-4d02-96b9-e864c3a8efa2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:11.370876 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9a5a80fa-03ce-4d02-96b9-e864c3a8efa2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09" status: 200 len: 1271 microversion: 2.1 time: 0.522889 Aug 24 10:16:11.376794 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 542/1174] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:10 2022] GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09 => generated 1271 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:11.456428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3b458388-9fe8-458b-8a15-af8a08ec1f59 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:11.459170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3b458388-9fe8-458b-8a15-af8a08ec1f59 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:11.497058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b458388-9fe8-458b-8a15-af8a08ec1f59 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:11.501833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b458388-9fe8-458b-8a15-af8a08ec1f59 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:11.510105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b458388-9fe8-458b-8a15-af8a08ec1f59 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:11.515254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b458388-9fe8-458b-8a15-af8a08ec1f59 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:11.525300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b458388-9fe8-458b-8a15-af8a08ec1f59 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:11.526633 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b458388-9fe8-458b-8a15-af8a08ec1f59 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:11.704575 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3b458388-9fe8-458b-8a15-af8a08ec1f59 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.254262 Aug 24 10:16:11.706632 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 543/1175] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Aug 24 10:16:11 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0/os-volume_attachments => generated 197 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:16:11.715466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-800d6c06-0093-480d-93c8-bdf660178686 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4655001d30>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:11.871283 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-800d6c06-0093-480d-93c8-bdf660178686 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a" status: 200 len: 1414 microversion: 2.1 time: 0.159329 Aug 24 10:16:11.886768 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 544/1176] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:16:11 2022] GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a => generated 1414 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:11.907461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-06067234-4fd8-442c-9302-884c717cafab tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:11.908711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-06067234-4fd8-442c-9302-884c717cafab tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:11.934438 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06067234-4fd8-442c-9302-884c717cafab tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:11.945869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06067234-4fd8-442c-9302-884c717cafab tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:11.947210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06067234-4fd8-442c-9302-884c717cafab tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:11.948786 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06067234-4fd8-442c-9302-884c717cafab tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:11.949742 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06067234-4fd8-442c-9302-884c717cafab tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:11.951435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06067234-4fd8-442c-9302-884c717cafab tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:12.620016 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-06067234-4fd8-442c-9302-884c717cafab tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:12.664420 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-06067234-4fd8-442c-9302-884c717cafab tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1542 microversion: 2.1 time: 0.766716 Aug 24 10:16:12.665624 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 545/1177] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:11 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1542 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:12.722904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e2db3b90-86dc-4cb3-b6f4-4ff982cd9b7a tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:12.723957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e2db3b90-86dc-4cb3-b6f4-4ff982cd9b7a tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:12.758345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2db3b90-86dc-4cb3-b6f4-4ff982cd9b7a tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:12.759177 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2db3b90-86dc-4cb3-b6f4-4ff982cd9b7a tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:12.760052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2db3b90-86dc-4cb3-b6f4-4ff982cd9b7a tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:12.762231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2db3b90-86dc-4cb3-b6f4-4ff982cd9b7a tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:12.766295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2db3b90-86dc-4cb3-b6f4-4ff982cd9b7a tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:12.768577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2db3b90-86dc-4cb3-b6f4-4ff982cd9b7a tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:12.868154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-413bd74c-2171-40bc-b866-f746ef570bbb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:12.879299 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-413bd74c-2171-40bc-b866-f746ef570bbb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1504 microversion: 2.1 time: 1.713309 Aug 24 10:16:12.897329 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 633/1178] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:11 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1504 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:12.915091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c3b119d0-b961-4bfe-a421-5c5b7b2410d0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:12.915749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c3b119d0-b961-4bfe-a421-5c5b7b2410d0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 912f291b-bf95-456e-a123-95c1314bbc09] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:12.958745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3b119d0-b961-4bfe-a421-5c5b7b2410d0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:12.960567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3b119d0-b961-4bfe-a421-5c5b7b2410d0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:12.963280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3b119d0-b961-4bfe-a421-5c5b7b2410d0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:12.969255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3b119d0-b961-4bfe-a421-5c5b7b2410d0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:12.978353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3b119d0-b961-4bfe-a421-5c5b7b2410d0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:12.980987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3b119d0-b961-4bfe-a421-5c5b7b2410d0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:13.066172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e2db3b90-86dc-4cb3-b6f4-4ff982cd9b7a tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb69265eac264f36acc9d04eb60a0449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1a2f8a03d4395903df62f152212d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:13.121495 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e2db3b90-86dc-4cb3-b6f4-4ff982cd9b7a tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff" status: 200 len: 1289 microversion: 2.1 time: 0.414371 Aug 24 10:16:13.126130 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 546/1179] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:12 2022] GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff => generated 1289 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:13.156445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b46161be-902b-4c0f-a4f3-ca40781cda92 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:13.174051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b46161be-902b-4c0f-a4f3-ca40781cda92 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:13.218988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b46161be-902b-4c0f-a4f3-ca40781cda92 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:13.233333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b46161be-902b-4c0f-a4f3-ca40781cda92 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:13.239361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b46161be-902b-4c0f-a4f3-ca40781cda92 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:13.244843 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b46161be-902b-4c0f-a4f3-ca40781cda92 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:13.245904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b46161be-902b-4c0f-a4f3-ca40781cda92 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:13.254133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b46161be-902b-4c0f-a4f3-ca40781cda92 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:13.321608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:16:13.358488 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b46161be-902b-4c0f-a4f3-ca40781cda92 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.230306 Aug 24 10:16:13.362563 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 547/1180] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Aug 24 10:16:13 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0/os-volume_attachments => generated 197 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:16:13.373032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-2d739004-a712-4a45-84aa-b16d1d969903 req-22fa8566-8a80-48fc-b980-e264ec7bc33b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e35cb9a6-5d75-4272-9a0c-dd6d092e96f8", "name": "network-vif-unplugged", "status": "completed", "tag": "0d6b8ccb-507f-46f4-8fc1-680ff0bcd84b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:16:13.412167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2d739004-a712-4a45-84aa-b16d1d969903 req-22fa8566-8a80-48fc-b980-e264ec7bc33b service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:13.416725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2d739004-a712-4a45-84aa-b16d1d969903 req-22fa8566-8a80-48fc-b980-e264ec7bc33b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:13.417874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2d739004-a712-4a45-84aa-b16d1d969903 req-22fa8566-8a80-48fc-b980-e264ec7bc33b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:13.445044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c3b119d0-b961-4bfe-a421-5c5b7b2410d0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:13.479108 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c3b119d0-b961-4bfe-a421-5c5b7b2410d0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09" status: 200 len: 1271 microversion: 2.1 time: 0.579960 Aug 24 10:16:13.496877 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-2d739004-a712-4a45-84aa-b16d1d969903 req-22fa8566-8a80-48fc-b980-e264ec7bc33b service nova] Creating event network-vif-unplugged:0d6b8ccb-507f-46f4-8fc1-680ff0bcd84b for instance e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 on n-h1-849328-3 Aug 24 10:16:13.497406 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 634/1181] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:12 2022] GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09 => generated 1271 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:13.497406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9dbf965d-0790-4a68-9581-171b74c70f1e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4654e7b940>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:13.501885 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-2d739004-a712-4a45-84aa-b16d1d969903 req-22fa8566-8a80-48fc-b980-e264ec7bc33b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135568 Aug 24 10:16:13.508297 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 548/1182] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:16:13.582359 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9dbf965d-0790-4a68-9581-171b74c70f1e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a" status: 200 len: 1414 microversion: 2.1 time: 0.095650 Aug 24 10:16:13.582976 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 635/1183] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:16:13 2022] GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:13.700741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2f95a6b0-0607-4f9f-901c-fff50f596220 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:13.701675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2f95a6b0-0607-4f9f-901c-fff50f596220 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:13.720598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f95a6b0-0607-4f9f-901c-fff50f596220 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:13.721092 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f95a6b0-0607-4f9f-901c-fff50f596220 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:13.721658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f95a6b0-0607-4f9f-901c-fff50f596220 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:13.730046 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f95a6b0-0607-4f9f-901c-fff50f596220 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:13.730546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f95a6b0-0607-4f9f-901c-fff50f596220 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:13.730979 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f95a6b0-0607-4f9f-901c-fff50f596220 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:13.902608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3fd544bc-4e69-4ccf-b795-0dec0d258cfa tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:13.903243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3fd544bc-4e69-4ccf-b795-0dec0d258cfa tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:13.923339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd544bc-4e69-4ccf-b795-0dec0d258cfa tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:13.925625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd544bc-4e69-4ccf-b795-0dec0d258cfa tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:13.929169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd544bc-4e69-4ccf-b795-0dec0d258cfa tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:13.945610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd544bc-4e69-4ccf-b795-0dec0d258cfa tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:13.947576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd544bc-4e69-4ccf-b795-0dec0d258cfa tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:13.948279 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd544bc-4e69-4ccf-b795-0dec0d258cfa tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:14.323470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3fd544bc-4e69-4ccf-b795-0dec0d258cfa tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:14.332085 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3fd544bc-4e69-4ccf-b795-0dec0d258cfa tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1504 microversion: 2.1 time: 0.433702 Aug 24 10:16:14.332692 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 636/1184] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:13 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1504 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:14.371218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6a892f93-b944-4633-9152-0ec9bc990b68 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:14.371848 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6a892f93-b944-4633-9152-0ec9bc990b68 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:14.411438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a892f93-b944-4633-9152-0ec9bc990b68 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:14.411938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a892f93-b944-4633-9152-0ec9bc990b68 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:14.412340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a892f93-b944-4633-9152-0ec9bc990b68 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:14.416445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a892f93-b944-4633-9152-0ec9bc990b68 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:14.417171 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a892f93-b944-4633-9152-0ec9bc990b68 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:14.417771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a892f93-b944-4633-9152-0ec9bc990b68 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:14.598057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6a892f93-b944-4633-9152-0ec9bc990b68 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb69265eac264f36acc9d04eb60a0449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1a2f8a03d4395903df62f152212d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:14.635217 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6a892f93-b944-4633-9152-0ec9bc990b68 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff" status: 200 len: 1289 microversion: 2.1 time: 0.286004 Aug 24 10:16:14.639003 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 637/1185] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:14 2022] GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff => generated 1289 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:14.650825 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0654ba66-db2f-413e-94b7-fa5f0a1d52c1 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:14.658426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0654ba66-db2f-413e-94b7-fa5f0a1d52c1 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:14.677229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0654ba66-db2f-413e-94b7-fa5f0a1d52c1 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:14.680445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0654ba66-db2f-413e-94b7-fa5f0a1d52c1 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:14.681580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0654ba66-db2f-413e-94b7-fa5f0a1d52c1 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:14.683912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0654ba66-db2f-413e-94b7-fa5f0a1d52c1 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:14.685043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0654ba66-db2f-413e-94b7-fa5f0a1d52c1 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:14.688885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0654ba66-db2f-413e-94b7-fa5f0a1d52c1 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:14.841922 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0654ba66-db2f-413e-94b7-fa5f0a1d52c1 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.199191 Aug 24 10:16:14.849845 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 638/1186] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Aug 24 10:16:14 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:16:14.858316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c0814b71-ef2e-42a9-84a6-e401fc5298ab tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:14.858579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c0814b71-ef2e-42a9-84a6-e401fc5298ab tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 912f291b-bf95-456e-a123-95c1314bbc09] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:14.878612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0814b71-ef2e-42a9-84a6-e401fc5298ab tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:14.880420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0814b71-ef2e-42a9-84a6-e401fc5298ab tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:14.886277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0814b71-ef2e-42a9-84a6-e401fc5298ab tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:14.888518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0814b71-ef2e-42a9-84a6-e401fc5298ab tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:14.889160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0814b71-ef2e-42a9-84a6-e401fc5298ab tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:14.889650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0814b71-ef2e-42a9-84a6-e401fc5298ab tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:15.213081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c0814b71-ef2e-42a9-84a6-e401fc5298ab tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:15.257069 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c0814b71-ef2e-42a9-84a6-e401fc5298ab tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09" status: 200 len: 1271 microversion: 2.1 time: 0.406805 Aug 24 10:16:15.262601 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 639/1187] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:14 2022] GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09 => generated 1271 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:15.302492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cbe79ea9-91df-42a9-953a-154a53cb9782 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4654e7b160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:15.319784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2f95a6b0-0607-4f9f-901c-fff50f596220 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:15.346249 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2f95a6b0-0607-4f9f-901c-fff50f596220 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1542 microversion: 2.1 time: 1.642412 Aug 24 10:16:15.368567 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 549/1188] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:13 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1542 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:16:15.405411 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2f5f0e81-bfc6-42ec-b4cb-6a7178709233 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:15.410003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2f5f0e81-bfc6-42ec-b4cb-6a7178709233 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:15.432715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f5f0e81-bfc6-42ec-b4cb-6a7178709233 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:15.434332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f5f0e81-bfc6-42ec-b4cb-6a7178709233 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:15.435242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f5f0e81-bfc6-42ec-b4cb-6a7178709233 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:15.436581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f5f0e81-bfc6-42ec-b4cb-6a7178709233 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:15.439264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f5f0e81-bfc6-42ec-b4cb-6a7178709233 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:15.440105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f5f0e81-bfc6-42ec-b4cb-6a7178709233 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:15.476357 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cbe79ea9-91df-42a9-953a-154a53cb9782 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a" status: 200 len: 1414 microversion: 2.1 time: 0.204524 Aug 24 10:16:15.478555 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 640/1189] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:16:15 2022] GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a => generated 1414 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:15.516711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-92e22f74-a4d9-403a-a715-3fcf4eb29dee req-40f08bf8-6571-41d4-8a27-f446b2a5dfcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1ebe6bd-b2ae-45c2-8752-314356143de9", "name": "network-vif-plugged", "status": "completed", "tag": "44b58631-8033-4518-911c-3c45f71ea4a5"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:16:15.557701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-92e22f74-a4d9-403a-a715-3fcf4eb29dee req-40f08bf8-6571-41d4-8a27-f446b2a5dfcb service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:15.561111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-92e22f74-a4d9-403a-a715-3fcf4eb29dee req-40f08bf8-6571-41d4-8a27-f446b2a5dfcb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:15.563515 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-92e22f74-a4d9-403a-a715-3fcf4eb29dee req-40f08bf8-6571-41d4-8a27-f446b2a5dfcb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:15.692406 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-92e22f74-a4d9-403a-a715-3fcf4eb29dee req-40f08bf8-6571-41d4-8a27-f446b2a5dfcb service nova] Creating event network-vif-plugged:44b58631-8033-4518-911c-3c45f71ea4a5 for instance a1ebe6bd-b2ae-45c2-8752-314356143de9 on n-h1-849328-3 Aug 24 10:16:15.723566 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-92e22f74-a4d9-403a-a715-3fcf4eb29dee req-40f08bf8-6571-41d4-8a27-f446b2a5dfcb service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.243590 Aug 24 10:16:15.728140 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 641/1190] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:16:15.751549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-533f799a-3d9d-4d62-b511-3c0f5605f8e5 req-71bbfc43-fa9d-46c4-b3e6-358a895fffb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e35cb9a6-5d75-4272-9a0c-dd6d092e96f8", "tag": "0d6b8ccb-507f-46f4-8fc1-680ff0bcd84b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:16:15.790369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-533f799a-3d9d-4d62-b511-3c0f5605f8e5 req-71bbfc43-fa9d-46c4-b3e6-358a895fffb4 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:15.791770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-533f799a-3d9d-4d62-b511-3c0f5605f8e5 req-71bbfc43-fa9d-46c4-b3e6-358a895fffb4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:15.792867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-533f799a-3d9d-4d62-b511-3c0f5605f8e5 req-71bbfc43-fa9d-46c4-b3e6-358a895fffb4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:15.841230 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-533f799a-3d9d-4d62-b511-3c0f5605f8e5 req-71bbfc43-fa9d-46c4-b3e6-358a895fffb4 service nova] Creating event network-changed:0d6b8ccb-507f-46f4-8fc1-680ff0bcd84b for instance e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 on n-h1-849328-3 Aug 24 10:16:15.863076 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-533f799a-3d9d-4d62-b511-3c0f5605f8e5 req-71bbfc43-fa9d-46c4-b3e6-358a895fffb4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131164 Aug 24 10:16:15.868157 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 642/1191] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:16:15.881946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-86afa95c-f0f7-484c-a90d-efe941e4516e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:15.885933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-86afa95c-f0f7-484c-a90d-efe941e4516e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:15.914882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86afa95c-f0f7-484c-a90d-efe941e4516e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:15.915391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86afa95c-f0f7-484c-a90d-efe941e4516e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:15.915844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86afa95c-f0f7-484c-a90d-efe941e4516e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:15.923635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86afa95c-f0f7-484c-a90d-efe941e4516e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:15.924225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86afa95c-f0f7-484c-a90d-efe941e4516e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:15.924681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86afa95c-f0f7-484c-a90d-efe941e4516e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:16.184536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-86afa95c-f0f7-484c-a90d-efe941e4516e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb69265eac264f36acc9d04eb60a0449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1a2f8a03d4395903df62f152212d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:16.211701 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-86afa95c-f0f7-484c-a90d-efe941e4516e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff" status: 200 len: 1289 microversion: 2.1 time: 0.344430 Aug 24 10:16:16.225161 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 643/1192] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:15 2022] GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff => generated 1289 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:16.235642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5fe6b84e-8c15-481a-b5f5-c95f90638bea tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:16.240260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5fe6b84e-8c15-481a-b5f5-c95f90638bea tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:16.255846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fe6b84e-8c15-481a-b5f5-c95f90638bea tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:16.256402 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fe6b84e-8c15-481a-b5f5-c95f90638bea tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:16.256857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fe6b84e-8c15-481a-b5f5-c95f90638bea tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:16.257636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fe6b84e-8c15-481a-b5f5-c95f90638bea tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:16.263228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fe6b84e-8c15-481a-b5f5-c95f90638bea tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:16.263689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fe6b84e-8c15-481a-b5f5-c95f90638bea tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:16.398673 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5fe6b84e-8c15-481a-b5f5-c95f90638bea tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.180126 Aug 24 10:16:16.401698 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 644/1193] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Aug 24 10:16:16 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:16:16.419121 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f9e68dd8-58c7-4898-9a90-5522cfcd46c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:16.423614 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f9e68dd8-58c7-4898-9a90-5522cfcd46c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 912f291b-bf95-456e-a123-95c1314bbc09] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:16.444684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9e68dd8-58c7-4898-9a90-5522cfcd46c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:16.447422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9e68dd8-58c7-4898-9a90-5522cfcd46c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:16.451297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9e68dd8-58c7-4898-9a90-5522cfcd46c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:16.456577 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9e68dd8-58c7-4898-9a90-5522cfcd46c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:16.469023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9e68dd8-58c7-4898-9a90-5522cfcd46c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:16.469023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9e68dd8-58c7-4898-9a90-5522cfcd46c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:16.789283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f9e68dd8-58c7-4898-9a90-5522cfcd46c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:16.838001 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f9e68dd8-58c7-4898-9a90-5522cfcd46c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09" status: 200 len: 1271 microversion: 2.1 time: 0.431218 Aug 24 10:16:16.842916 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 645/1194] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:16 2022] GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09 => generated 1271 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:16.859921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-21896f66-1b5c-4bf9-96e9-b2533681a451 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:16.878256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-21896f66-1b5c-4bf9-96e9-b2533681a451 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:16.883427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2f5f0e81-bfc6-42ec-b4cb-6a7178709233 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:16.913291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21896f66-1b5c-4bf9-96e9-b2533681a451 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:16.922390 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2f5f0e81-bfc6-42ec-b4cb-6a7178709233 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1504 microversion: 2.1 time: 1.549985 Aug 24 10:16:16.925977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21896f66-1b5c-4bf9-96e9-b2533681a451 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:16.930993 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21896f66-1b5c-4bf9-96e9-b2533681a451 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:16.932802 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 550/1195] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:15 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1504 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:16.937076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21896f66-1b5c-4bf9-96e9-b2533681a451 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:16.942185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21896f66-1b5c-4bf9-96e9-b2533681a451 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:16.947199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21896f66-1b5c-4bf9-96e9-b2533681a451 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:16.978724 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-326c8edc-921a-4cab-a7dc-8ada6854e2c2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4654f82af0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:17.210195 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-326c8edc-921a-4cab-a7dc-8ada6854e2c2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a" status: 200 len: 1414 microversion: 2.1 time: 0.264498 Aug 24 10:16:17.211981 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 551/1196] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:16:16 2022] GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a => generated 1414 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:17.249785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-695d4f1a-0dcb-4381-960d-60f27c898059 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:17.260170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-695d4f1a-0dcb-4381-960d-60f27c898059 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:17.287496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-695d4f1a-0dcb-4381-960d-60f27c898059 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:17.299207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-695d4f1a-0dcb-4381-960d-60f27c898059 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:17.300255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-695d4f1a-0dcb-4381-960d-60f27c898059 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:17.302139 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-695d4f1a-0dcb-4381-960d-60f27c898059 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:17.303944 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-695d4f1a-0dcb-4381-960d-60f27c898059 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:17.307628 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-695d4f1a-0dcb-4381-960d-60f27c898059 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:18.036599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-21896f66-1b5c-4bf9-96e9-b2533681a451 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:18.067067 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-21896f66-1b5c-4bf9-96e9-b2533681a451 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1542 microversion: 2.1 time: 1.216292 Aug 24 10:16:18.072937 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 646/1197] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:16 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1542 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:18.085309 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f28f68e6-8a42-4c29-afcd-75fc38fe2e84 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:18.095864 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f28f68e6-8a42-4c29-afcd-75fc38fe2e84 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:18.115208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f28f68e6-8a42-4c29-afcd-75fc38fe2e84 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:18.115751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f28f68e6-8a42-4c29-afcd-75fc38fe2e84 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:18.116257 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f28f68e6-8a42-4c29-afcd-75fc38fe2e84 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:18.119987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f28f68e6-8a42-4c29-afcd-75fc38fe2e84 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:18.120547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f28f68e6-8a42-4c29-afcd-75fc38fe2e84 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:18.120999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f28f68e6-8a42-4c29-afcd-75fc38fe2e84 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:18.281338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-695d4f1a-0dcb-4381-960d-60f27c898059 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb69265eac264f36acc9d04eb60a0449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1a2f8a03d4395903df62f152212d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:18.287699 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f28f68e6-8a42-4c29-afcd-75fc38fe2e84 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.199680 Aug 24 10:16:18.290350 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 647/1198] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Aug 24 10:16:18 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0/os-volume_attachments => generated 197 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:16:18.317466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb588a6a-8bd1-4237-bd3b-534cf13f144f tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:18.319223 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-695d4f1a-0dcb-4381-960d-60f27c898059 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff" status: 200 len: 1289 microversion: 2.1 time: 1.078101 Aug 24 10:16:18.339109 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 552/1199] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:17 2022] GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff => generated 1289 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:18.340194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cb588a6a-8bd1-4237-bd3b-534cf13f144f tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 912f291b-bf95-456e-a123-95c1314bbc09] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:18.372702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ca54190f-9ff3-4dbb-a753-dff19a3318ee tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:18.386518 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ca54190f-9ff3-4dbb-a753-dff19a3318ee tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:18.397761 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb588a6a-8bd1-4237-bd3b-534cf13f144f tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:18.399264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb588a6a-8bd1-4237-bd3b-534cf13f144f tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:18.404944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb588a6a-8bd1-4237-bd3b-534cf13f144f tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:18.408560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb588a6a-8bd1-4237-bd3b-534cf13f144f tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:18.412496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb588a6a-8bd1-4237-bd3b-534cf13f144f tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:18.414648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb588a6a-8bd1-4237-bd3b-534cf13f144f tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:18.426644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca54190f-9ff3-4dbb-a753-dff19a3318ee tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:18.433995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca54190f-9ff3-4dbb-a753-dff19a3318ee tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:18.434896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca54190f-9ff3-4dbb-a753-dff19a3318ee tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:18.436023 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca54190f-9ff3-4dbb-a753-dff19a3318ee tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:18.438149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca54190f-9ff3-4dbb-a753-dff19a3318ee tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:18.443918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca54190f-9ff3-4dbb-a753-dff19a3318ee tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:19.146316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:16:19.212469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=12 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:16:19.276392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cb588a6a-8bd1-4237-bd3b-534cf13f144f tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:19.284571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:16:19.288576 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cb588a6a-8bd1-4237-bd3b-534cf13f144f tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09" status: 200 len: 1313 microversion: 2.1 time: 0.990743 Aug 24 10:16:19.294838 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 648/1200] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:18 2022] GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09 => generated 1313 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:19.313452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8e397f9c-8e44-41ab-ad09-f09be39849a6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4654e7d430>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:19.421581 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8e397f9c-8e44-41ab-ad09-f09be39849a6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a" status: 200 len: 1414 microversion: 2.1 time: 0.122845 Aug 24 10:16:19.425968 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 649/1201] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:16:19 2022] GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a => generated 1414 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:19.433717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ca54190f-9ff3-4dbb-a753-dff19a3318ee tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:19.443460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8f62df2b-3ebf-431f-b85c-20a6b0f49ca7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:19.444439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8f62df2b-3ebf-431f-b85c-20a6b0f49ca7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:19.460695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f62df2b-3ebf-431f-b85c-20a6b0f49ca7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:19.462248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f62df2b-3ebf-431f-b85c-20a6b0f49ca7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:19.462932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f62df2b-3ebf-431f-b85c-20a6b0f49ca7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:19.463995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f62df2b-3ebf-431f-b85c-20a6b0f49ca7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:19.464714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f62df2b-3ebf-431f-b85c-20a6b0f49ca7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:19.466012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f62df2b-3ebf-431f-b85c-20a6b0f49ca7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:19.483436 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ca54190f-9ff3-4dbb-a753-dff19a3318ee tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1504 microversion: 2.1 time: 1.140903 Aug 24 10:16:19.498734 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 553/1202] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:18 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1504 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:19.513810 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-11610b03-ca19-492a-9e80-7337285cf747 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:19.524229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-11610b03-ca19-492a-9e80-7337285cf747 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:19.552569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11610b03-ca19-492a-9e80-7337285cf747 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:19.553487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11610b03-ca19-492a-9e80-7337285cf747 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:19.554442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11610b03-ca19-492a-9e80-7337285cf747 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:19.556037 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11610b03-ca19-492a-9e80-7337285cf747 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:19.556902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11610b03-ca19-492a-9e80-7337285cf747 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:19.557767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11610b03-ca19-492a-9e80-7337285cf747 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:19.631843 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-11610b03-ca19-492a-9e80-7337285cf747 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.131034 Aug 24 10:16:19.638310 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 554/1203] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Aug 24 10:16:19 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:16:19.643787 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fee4b378-673e-47c4-b915-990c74734de7 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:19.651862 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fee4b378-673e-47c4-b915-990c74734de7 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:19.668040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fee4b378-673e-47c4-b915-990c74734de7 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:19.669057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fee4b378-673e-47c4-b915-990c74734de7 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:19.669801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fee4b378-673e-47c4-b915-990c74734de7 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:19.673816 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fee4b378-673e-47c4-b915-990c74734de7 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:19.675687 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fee4b378-673e-47c4-b915-990c74734de7 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:19.676460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fee4b378-673e-47c4-b915-990c74734de7 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:19.999125 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fee4b378-673e-47c4-b915-990c74734de7 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb69265eac264f36acc9d04eb60a0449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1a2f8a03d4395903df62f152212d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:20.019251 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fee4b378-673e-47c4-b915-990c74734de7 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff" status: 200 len: 1289 microversion: 2.1 time: 0.379190 Aug 24 10:16:20.034686 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 555/1204] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:19 2022] GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff => generated 1289 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:20.351711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c260c31e-f474-4dde-8e9f-7473dd2b74b1 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:20.353052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c260c31e-f474-4dde-8e9f-7473dd2b74b1 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 912f291b-bf95-456e-a123-95c1314bbc09] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:20.383409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c260c31e-f474-4dde-8e9f-7473dd2b74b1 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:20.384474 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c260c31e-f474-4dde-8e9f-7473dd2b74b1 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:20.385528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c260c31e-f474-4dde-8e9f-7473dd2b74b1 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:20.386531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c260c31e-f474-4dde-8e9f-7473dd2b74b1 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:20.398305 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c260c31e-f474-4dde-8e9f-7473dd2b74b1 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:20.399154 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c260c31e-f474-4dde-8e9f-7473dd2b74b1 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:20.563133 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8f62df2b-3ebf-431f-b85c-20a6b0f49ca7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:20.604055 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8f62df2b-3ebf-431f-b85c-20a6b0f49ca7 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1542 microversion: 2.1 time: 1.171552 Aug 24 10:16:20.604674 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 650/1205] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:19 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1542 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:20.622314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-549022bb-039c-4e3e-99b8-255302169d17 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4654e7baf0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:20.780974 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-549022bb-039c-4e3e-99b8-255302169d17 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a" status: 200 len: 1414 microversion: 2.1 time: 0.170515 Aug 24 10:16:20.782193 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 651/1206] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:16:20 2022] GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a => generated 1414 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:20.814520 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f985d9c5-0b59-483e-bc16-d9657ba45f26 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:20.822783 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f985d9c5-0b59-483e-bc16-d9657ba45f26 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:20.845036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=82 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:16:20.854391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f985d9c5-0b59-483e-bc16-d9657ba45f26 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:20.859568 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f985d9c5-0b59-483e-bc16-d9657ba45f26 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:20.862282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f985d9c5-0b59-483e-bc16-d9657ba45f26 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:20.863076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f985d9c5-0b59-483e-bc16-d9657ba45f26 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:20.865973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f985d9c5-0b59-483e-bc16-d9657ba45f26 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:20.868032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f985d9c5-0b59-483e-bc16-d9657ba45f26 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:20.999368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:16:21.240266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c260c31e-f474-4dde-8e9f-7473dd2b74b1 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:21.254917 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c260c31e-f474-4dde-8e9f-7473dd2b74b1 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09" status: 200 len: 1313 microversion: 2.1 time: 0.911373 Aug 24 10:16:21.256371 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 556/1207] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:20 2022] GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09 => generated 1313 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:16:21.261803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e00fa8ce-0ad6-4697-b386-68c6c7b2cfb4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:21.275907 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e00fa8ce-0ad6-4697-b386-68c6c7b2cfb4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:21.283100 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e00fa8ce-0ad6-4697-b386-68c6c7b2cfb4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:21.297996 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e00fa8ce-0ad6-4697-b386-68c6c7b2cfb4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:21.303014 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e00fa8ce-0ad6-4697-b386-68c6c7b2cfb4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:21.303811 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e00fa8ce-0ad6-4697-b386-68c6c7b2cfb4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:21.304304 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e00fa8ce-0ad6-4697-b386-68c6c7b2cfb4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:21.308159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e00fa8ce-0ad6-4697-b386-68c6c7b2cfb4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:21.450254 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e00fa8ce-0ad6-4697-b386-68c6c7b2cfb4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.192369 Aug 24 10:16:21.458398 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 557/1208] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Aug 24 10:16:21 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:16:21.466915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a8e301bd-771f-415d-ad95-f1be99248a8f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:21.468011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a8e301bd-771f-415d-ad95-f1be99248a8f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:21.511618 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8e301bd-771f-415d-ad95-f1be99248a8f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:21.512386 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8e301bd-771f-415d-ad95-f1be99248a8f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:21.513045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8e301bd-771f-415d-ad95-f1be99248a8f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:21.519939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8e301bd-771f-415d-ad95-f1be99248a8f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:21.520984 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8e301bd-771f-415d-ad95-f1be99248a8f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:21.521939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8e301bd-771f-415d-ad95-f1be99248a8f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:22.060177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f985d9c5-0b59-483e-bc16-d9657ba45f26 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:22.069827 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f985d9c5-0b59-483e-bc16-d9657ba45f26 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1504 microversion: 2.1 time: 1.281532 Aug 24 10:16:22.075489 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 652/1209] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:20 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1504 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:22.081094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b12ef887-6c9a-4870-a8e9-3becbbcef80d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:22.094367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b12ef887-6c9a-4870-a8e9-3becbbcef80d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:22.115737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b12ef887-6c9a-4870-a8e9-3becbbcef80d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:22.117194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b12ef887-6c9a-4870-a8e9-3becbbcef80d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:22.125196 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b12ef887-6c9a-4870-a8e9-3becbbcef80d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:22.127013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b12ef887-6c9a-4870-a8e9-3becbbcef80d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:22.128316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b12ef887-6c9a-4870-a8e9-3becbbcef80d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:22.131955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b12ef887-6c9a-4870-a8e9-3becbbcef80d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:22.330960 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a8e301bd-771f-415d-ad95-f1be99248a8f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb69265eac264f36acc9d04eb60a0449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1a2f8a03d4395903df62f152212d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:22.346509 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a8e301bd-771f-415d-ad95-f1be99248a8f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff" status: 200 len: 1331 microversion: 2.1 time: 0.886440 Aug 24 10:16:22.361991 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 558/1210] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:21 2022] GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff => generated 1331 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:22.367766 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a6045bd3-86f9-447f-99c8-3c9621be64e9 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4654f618b0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:22.483758 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a6045bd3-86f9-447f-99c8-3c9621be64e9 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a" status: 200 len: 1414 microversion: 2.1 time: 0.126973 Aug 24 10:16:22.484392 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 559/1211] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:16:22 2022] GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a => generated 1414 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:22.516582 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-da4ed441-edad-4693-9bb1-8b633d31c9b5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:22.517271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-da4ed441-edad-4693-9bb1-8b633d31c9b5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 912f291b-bf95-456e-a123-95c1314bbc09] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:22.532718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da4ed441-edad-4693-9bb1-8b633d31c9b5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:22.539778 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da4ed441-edad-4693-9bb1-8b633d31c9b5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:22.540592 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da4ed441-edad-4693-9bb1-8b633d31c9b5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:22.541747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da4ed441-edad-4693-9bb1-8b633d31c9b5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:22.542428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da4ed441-edad-4693-9bb1-8b633d31c9b5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:22.543104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da4ed441-edad-4693-9bb1-8b633d31c9b5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:23.319807 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-da4ed441-edad-4693-9bb1-8b633d31c9b5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:23.334634 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-da4ed441-edad-4693-9bb1-8b633d31c9b5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09" status: 200 len: 1313 microversion: 2.1 time: 0.849010 Aug 24 10:16:23.337927 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 560/1212] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:22 2022] GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09 => generated 1313 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:23.351684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-281b0e8d-38fa-43cc-9a83-c416aecc13f1 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:23.367543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-281b0e8d-38fa-43cc-9a83-c416aecc13f1 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:23.376822 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-281b0e8d-38fa-43cc-9a83-c416aecc13f1 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:23.380425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-281b0e8d-38fa-43cc-9a83-c416aecc13f1 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:23.383965 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-281b0e8d-38fa-43cc-9a83-c416aecc13f1 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:23.385066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-281b0e8d-38fa-43cc-9a83-c416aecc13f1 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:23.385786 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-281b0e8d-38fa-43cc-9a83-c416aecc13f1 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:23.386506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-281b0e8d-38fa-43cc-9a83-c416aecc13f1 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:23.479181 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-281b0e8d-38fa-43cc-9a83-c416aecc13f1 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.138006 Aug 24 10:16:23.481566 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 561/1213] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Aug 24 10:16:23 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:16:23.926196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e4d3faa6-38fe-402a-822a-769848f9f005 req-758a7e2c-7f75-4411-8f78-b4fdfdf102b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "912f291b-bf95-456e-a123-95c1314bbc09", "tag": "15ee8e44-fbbd-4e30-90ec-bb8bc625006f"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:16:23.953826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e4d3faa6-38fe-402a-822a-769848f9f005 req-758a7e2c-7f75-4411-8f78-b4fdfdf102b7 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:23.960672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e4d3faa6-38fe-402a-822a-769848f9f005 req-758a7e2c-7f75-4411-8f78-b4fdfdf102b7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:23.964089 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e4d3faa6-38fe-402a-822a-769848f9f005 req-758a7e2c-7f75-4411-8f78-b4fdfdf102b7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:24.012370 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e4d3faa6-38fe-402a-822a-769848f9f005 req-758a7e2c-7f75-4411-8f78-b4fdfdf102b7 service nova] Creating event network-changed:15ee8e44-fbbd-4e30-90ec-bb8bc625006f for instance 912f291b-bf95-456e-a123-95c1314bbc09 on n-h2-849328-3 Aug 24 10:16:24.036758 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e4d3faa6-38fe-402a-822a-769848f9f005 req-758a7e2c-7f75-4411-8f78-b4fdfdf102b7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.553171 Aug 24 10:16:24.041218 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 562/1214] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:16:24.061436 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-59320675-455c-49dc-a928-40f561be1523 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:24.064852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-59320675-455c-49dc-a928-40f561be1523 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:24.079659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:16:24.082427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59320675-455c-49dc-a928-40f561be1523 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:24.085427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59320675-455c-49dc-a928-40f561be1523 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:24.086624 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59320675-455c-49dc-a928-40f561be1523 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:24.088945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59320675-455c-49dc-a928-40f561be1523 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:24.089847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59320675-455c-49dc-a928-40f561be1523 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:24.090647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59320675-455c-49dc-a928-40f561be1523 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:24.396409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b12ef887-6c9a-4870-a8e9-3becbbcef80d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:24.435033 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b12ef887-6c9a-4870-a8e9-3becbbcef80d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1542 microversion: 2.1 time: 2.357414 Aug 24 10:16:24.440020 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 653/1215] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:22 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1542 bytes in 2364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:24.493003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-32d49dbc-85b3-4646-83e7-6f98ced2f7a3 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:24.494273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-32d49dbc-85b3-4646-83e7-6f98ced2f7a3 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:24.523292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32d49dbc-85b3-4646-83e7-6f98ced2f7a3 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:24.524216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32d49dbc-85b3-4646-83e7-6f98ced2f7a3 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:24.529591 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32d49dbc-85b3-4646-83e7-6f98ced2f7a3 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:24.531034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32d49dbc-85b3-4646-83e7-6f98ced2f7a3 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:24.531878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32d49dbc-85b3-4646-83e7-6f98ced2f7a3 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:24.536973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32d49dbc-85b3-4646-83e7-6f98ced2f7a3 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:24.903600 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-59320675-455c-49dc-a928-40f561be1523 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:24.940086 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-59320675-455c-49dc-a928-40f561be1523 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1504 microversion: 2.1 time: 0.896012 Aug 24 10:16:24.961374 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 563/1216] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:24 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1504 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:24.972043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7f7ea574-f354-4405-ae85-a181c59ef5f4 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4655039f70>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:25.080776 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7f7ea574-f354-4405-ae85-a181c59ef5f4 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a" status: 200 len: 1414 microversion: 2.1 time: 0.118136 Aug 24 10:16:25.082059 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 564/1217] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:16:24 2022] GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a => generated 1414 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:25.094468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c60a946a-10be-4283-92f1-fc185fc8c12a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:25.098827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c60a946a-10be-4283-92f1-fc185fc8c12a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 912f291b-bf95-456e-a123-95c1314bbc09] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:25.113710 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c60a946a-10be-4283-92f1-fc185fc8c12a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:25.116071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c60a946a-10be-4283-92f1-fc185fc8c12a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:25.119692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c60a946a-10be-4283-92f1-fc185fc8c12a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:25.121401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c60a946a-10be-4283-92f1-fc185fc8c12a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:25.123776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c60a946a-10be-4283-92f1-fc185fc8c12a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:25.124407 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c60a946a-10be-4283-92f1-fc185fc8c12a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:25.377760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-32d49dbc-85b3-4646-83e7-6f98ced2f7a3 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb69265eac264f36acc9d04eb60a0449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1a2f8a03d4395903df62f152212d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:25.395818 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-32d49dbc-85b3-4646-83e7-6f98ced2f7a3 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff" status: 200 len: 1331 microversion: 2.1 time: 0.931099 Aug 24 10:16:25.406338 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 654/1218] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:24 2022] GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff => generated 1331 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:25.415327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ddac67c7-25b1-401a-8b4c-f7c5e75ec00a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:25.423022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ddac67c7-25b1-401a-8b4c-f7c5e75ec00a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:25.458411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddac67c7-25b1-401a-8b4c-f7c5e75ec00a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:25.459340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddac67c7-25b1-401a-8b4c-f7c5e75ec00a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:25.460014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddac67c7-25b1-401a-8b4c-f7c5e75ec00a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:25.461262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddac67c7-25b1-401a-8b4c-f7c5e75ec00a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:25.461952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddac67c7-25b1-401a-8b4c-f7c5e75ec00a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:25.462647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddac67c7-25b1-401a-8b4c-f7c5e75ec00a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:25.552959 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ddac67c7-25b1-401a-8b4c-f7c5e75ec00a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.144173 Aug 24 10:16:25.555742 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 655/1219] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Aug 24 10:16:25 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0/os-volume_attachments => generated 25 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:25.612517 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-85f813d4-273e-4b96-976f-39c60f410985 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:25.619976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-85f813d4-273e-4b96-976f-39c60f410985 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:25.633840 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c60a946a-10be-4283-92f1-fc185fc8c12a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:25.667825 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c60a946a-10be-4283-92f1-fc185fc8c12a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09" status: 200 len: 1313 microversion: 2.1 time: 0.582583 Aug 24 10:16:25.680992 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 565/1220] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:25 2022] GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09 => generated 1313 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:25.706950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85f813d4-273e-4b96-976f-39c60f410985 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:25.711167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85f813d4-273e-4b96-976f-39c60f410985 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:25.712873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85f813d4-273e-4b96-976f-39c60f410985 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:25.717217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85f813d4-273e-4b96-976f-39c60f410985 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:25.719038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85f813d4-273e-4b96-976f-39c60f410985 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:25.721879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85f813d4-273e-4b96-976f-39c60f410985 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:25.971497 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-00b5138c-c03e-4db2-99ba-5090840360d4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:25.974526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-00b5138c-c03e-4db2-99ba-5090840360d4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:25.996827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b5138c-c03e-4db2-99ba-5090840360d4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:26.002096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b5138c-c03e-4db2-99ba-5090840360d4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:26.004040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b5138c-c03e-4db2-99ba-5090840360d4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:26.005979 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b5138c-c03e-4db2-99ba-5090840360d4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:26.008144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b5138c-c03e-4db2-99ba-5090840360d4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:26.009548 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b5138c-c03e-4db2-99ba-5090840360d4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:26.293915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-00b5138c-c03e-4db2-99ba-5090840360d4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:26.314753 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-00b5138c-c03e-4db2-99ba-5090840360d4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1504 microversion: 2.1 time: 0.350048 Aug 24 10:16:26.342659 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 566/1221] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:25 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1504 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:16:26.366539 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9870d05f-3685-4dc2-8db0-d0968e257025 req-ad92fc9d-48b8-4def-902c-df7dac018561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86d0b20c-a790-4b41-a823-2a79532df7ff", "tag": "ee530f9b-86a7-47a7-bef8-49f2a0946b85"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:16:26.387498 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9870d05f-3685-4dc2-8db0-d0968e257025 req-ad92fc9d-48b8-4def-902c-df7dac018561 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:26.389492 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9870d05f-3685-4dc2-8db0-d0968e257025 req-ad92fc9d-48b8-4def-902c-df7dac018561 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:26.390241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9870d05f-3685-4dc2-8db0-d0968e257025 req-ad92fc9d-48b8-4def-902c-df7dac018561 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:26.418159 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9870d05f-3685-4dc2-8db0-d0968e257025 req-ad92fc9d-48b8-4def-902c-df7dac018561 service nova] Creating event network-changed:ee530f9b-86a7-47a7-bef8-49f2a0946b85 for instance 86d0b20c-a790-4b41-a823-2a79532df7ff on n-h1-849328-3 Aug 24 10:16:26.453804 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9870d05f-3685-4dc2-8db0-d0968e257025 req-ad92fc9d-48b8-4def-902c-df7dac018561 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101195 Aug 24 10:16:26.454949 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 567/1222] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:16:26.497394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-61ff1e8a-7636-4f43-9f77-1506ba1193b3 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4654f61af0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:26.657682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-85f813d4-273e-4b96-976f-39c60f410985 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:26.680999 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-61ff1e8a-7636-4f43-9f77-1506ba1193b3 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a" status: 200 len: 1414 microversion: 2.1 time: 0.215981 Aug 24 10:16:26.684457 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 568/1223] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:16:26 2022] GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a => generated 1414 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:26.692961 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6ca16f92-e01c-4ba1-866d-4cdab4725bb1 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:26.694330 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6ca16f92-e01c-4ba1-866d-4cdab4725bb1 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:26.698855 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-85f813d4-273e-4b96-976f-39c60f410985 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1542 microversion: 2.1 time: 1.140893 Aug 24 10:16:26.700385 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 656/1224] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:25 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1542 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:26.708002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ca16f92-e01c-4ba1-866d-4cdab4725bb1 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:26.708962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ca16f92-e01c-4ba1-866d-4cdab4725bb1 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:26.710309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ca16f92-e01c-4ba1-866d-4cdab4725bb1 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:26.712196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ca16f92-e01c-4ba1-866d-4cdab4725bb1 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:26.712881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ca16f92-e01c-4ba1-866d-4cdab4725bb1 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:26.713515 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ca16f92-e01c-4ba1-866d-4cdab4725bb1 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:26.719537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c89f5683-37f8-4753-80a1-2bde0b018171 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:26.738366 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c89f5683-37f8-4753-80a1-2bde0b018171 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 912f291b-bf95-456e-a123-95c1314bbc09] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:26.757718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c89f5683-37f8-4753-80a1-2bde0b018171 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:26.759230 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c89f5683-37f8-4753-80a1-2bde0b018171 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:26.760364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c89f5683-37f8-4753-80a1-2bde0b018171 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:26.762076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c89f5683-37f8-4753-80a1-2bde0b018171 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:26.763299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c89f5683-37f8-4753-80a1-2bde0b018171 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:26.764523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c89f5683-37f8-4753-80a1-2bde0b018171 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:27.614376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c89f5683-37f8-4753-80a1-2bde0b018171 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:27.625066 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c89f5683-37f8-4753-80a1-2bde0b018171 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09" status: 200 len: 1313 microversion: 2.1 time: 0.916941 Aug 24 10:16:27.628973 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 657/1225] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:26 2022] GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09 => generated 1313 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:27.642039 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9c923670-99a4-4f53-b276-33c911ac391f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:27.644450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9c923670-99a4-4f53-b276-33c911ac391f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:27.669632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c923670-99a4-4f53-b276-33c911ac391f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:27.671710 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6ca16f92-e01c-4ba1-866d-4cdab4725bb1 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb69265eac264f36acc9d04eb60a0449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1a2f8a03d4395903df62f152212d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:27.674987 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:16:27.683215 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c923670-99a4-4f53-b276-33c911ac391f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:27.683892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c923670-99a4-4f53-b276-33c911ac391f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:27.684658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c923670-99a4-4f53-b276-33c911ac391f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:27.685148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c923670-99a4-4f53-b276-33c911ac391f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:27.685570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c923670-99a4-4f53-b276-33c911ac391f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:27.687493 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6ca16f92-e01c-4ba1-866d-4cdab4725bb1 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff" status: 200 len: 1331 microversion: 2.1 time: 1.000189 Aug 24 10:16:27.688287 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 569/1226] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:26 2022] GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff => generated 1331 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:27.710878 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-41a8e63f-51fe-4950-88a5-a04c3afa7aaf tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4654f879d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:27.794630 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-41a8e63f-51fe-4950-88a5-a04c3afa7aaf tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a" status: 200 len: 1414 microversion: 2.1 time: 0.092922 Aug 24 10:16:27.796066 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 570/1227] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:16:27 2022] GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a => generated 1414 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:27.817581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-47d27bf6-06f4-4cd8-9d7d-aaf19247e340 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:27.827919 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-47d27bf6-06f4-4cd8-9d7d-aaf19247e340 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:27.852193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47d27bf6-06f4-4cd8-9d7d-aaf19247e340 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:27.857901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47d27bf6-06f4-4cd8-9d7d-aaf19247e340 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:27.858697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47d27bf6-06f4-4cd8-9d7d-aaf19247e340 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:27.859773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47d27bf6-06f4-4cd8-9d7d-aaf19247e340 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:27.860471 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47d27bf6-06f4-4cd8-9d7d-aaf19247e340 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:27.861402 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47d27bf6-06f4-4cd8-9d7d-aaf19247e340 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:28.388044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9c923670-99a4-4f53-b276-33c911ac391f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:28.404069 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9c923670-99a4-4f53-b276-33c911ac391f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1504 microversion: 2.1 time: 0.771460 Aug 24 10:16:28.407976 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 658/1228] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:27 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1504 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:28.666293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-62cbcccf-549a-4126-8eb8-4f4184ff13a8 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:28.670274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-62cbcccf-549a-4126-8eb8-4f4184ff13a8 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 912f291b-bf95-456e-a123-95c1314bbc09] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:28.720432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62cbcccf-549a-4126-8eb8-4f4184ff13a8 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:28.730657 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62cbcccf-549a-4126-8eb8-4f4184ff13a8 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:28.731865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62cbcccf-549a-4126-8eb8-4f4184ff13a8 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:28.733339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62cbcccf-549a-4126-8eb8-4f4184ff13a8 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:28.734445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62cbcccf-549a-4126-8eb8-4f4184ff13a8 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:28.739446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62cbcccf-549a-4126-8eb8-4f4184ff13a8 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:29.118250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-47d27bf6-06f4-4cd8-9d7d-aaf19247e340 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:29.139441 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-47d27bf6-06f4-4cd8-9d7d-aaf19247e340 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1542 microversion: 2.1 time: 1.341913 Aug 24 10:16:29.144955 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 571/1229] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:27 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1542 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:29.193403 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0e9f2241-64fc-4380-b7d9-ce02ed66c581 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:29.194595 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0e9f2241-64fc-4380-b7d9-ce02ed66c581 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:29.242428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e9f2241-64fc-4380-b7d9-ce02ed66c581 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:29.243340 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e9f2241-64fc-4380-b7d9-ce02ed66c581 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:29.244090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e9f2241-64fc-4380-b7d9-ce02ed66c581 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:29.246553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e9f2241-64fc-4380-b7d9-ce02ed66c581 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:29.247385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e9f2241-64fc-4380-b7d9-ce02ed66c581 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:29.248114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e9f2241-64fc-4380-b7d9-ce02ed66c581 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:30.143640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-62cbcccf-549a-4126-8eb8-4f4184ff13a8 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:30.196332 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-62cbcccf-549a-4126-8eb8-4f4184ff13a8 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09" status: 200 len: 1313 microversion: 2.1 time: 1.532842 Aug 24 10:16:30.201347 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 659/1230] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:28 2022] GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09 => generated 1313 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:30.212825 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0e9f2241-64fc-4380-b7d9-ce02ed66c581 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb69265eac264f36acc9d04eb60a0449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1a2f8a03d4395903df62f152212d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:30.257990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-89cc73ce-67f6-45f7-8273-4c82d3a6dfde tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4654f2bc10>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:30.276146 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0e9f2241-64fc-4380-b7d9-ce02ed66c581 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff" status: 200 len: 1331 microversion: 2.1 time: 1.125242 Aug 24 10:16:30.314818 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 572/1231] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:29 2022] GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff => generated 1331 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:30.356487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c8e60b1e-c6f0-49f6-a95e-a7b4679030ed tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:30.359854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c8e60b1e-c6f0-49f6-a95e-a7b4679030ed tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:30.384025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8e60b1e-c6f0-49f6-a95e-a7b4679030ed tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:30.401223 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8e60b1e-c6f0-49f6-a95e-a7b4679030ed tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:30.404057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8e60b1e-c6f0-49f6-a95e-a7b4679030ed tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:30.407749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8e60b1e-c6f0-49f6-a95e-a7b4679030ed tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:30.412947 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8e60b1e-c6f0-49f6-a95e-a7b4679030ed tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:30.415242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8e60b1e-c6f0-49f6-a95e-a7b4679030ed tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:30.937437 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c8e60b1e-c6f0-49f6-a95e-a7b4679030ed tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:30.951168 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c8e60b1e-c6f0-49f6-a95e-a7b4679030ed tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1504 microversion: 2.1 time: 0.634045 Aug 24 10:16:30.954330 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 573/1232] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:30 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1504 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:30.959887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a0c3a10b-ea41-43a4-8021-442104e735c2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:30.960798 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a0c3a10b-ea41-43a4-8021-442104e735c2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:30.970130 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0c3a10b-ea41-43a4-8021-442104e735c2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:30.971117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0c3a10b-ea41-43a4-8021-442104e735c2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:30.971768 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0c3a10b-ea41-43a4-8021-442104e735c2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:30.973890 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0c3a10b-ea41-43a4-8021-442104e735c2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:30.974620 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0c3a10b-ea41-43a4-8021-442104e735c2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:30.975230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0c3a10b-ea41-43a4-8021-442104e735c2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:31.621347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a0c3a10b-ea41-43a4-8021-442104e735c2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:31.656140 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a0c3a10b-ea41-43a4-8021-442104e735c2 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1542 microversion: 2.1 time: 0.700082 Aug 24 10:16:31.657926 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 574/1233] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:30 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1542 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:31.697786 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-851735a8-4f71-4407-af94-6a74d780afc3 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:31.698908 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-851735a8-4f71-4407-af94-6a74d780afc3 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 912f291b-bf95-456e-a123-95c1314bbc09] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:31.714059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-851735a8-4f71-4407-af94-6a74d780afc3 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:31.715046 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-851735a8-4f71-4407-af94-6a74d780afc3 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:31.716259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-851735a8-4f71-4407-af94-6a74d780afc3 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:31.718160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-851735a8-4f71-4407-af94-6a74d780afc3 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:31.719134 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-851735a8-4f71-4407-af94-6a74d780afc3 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:31.719919 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-851735a8-4f71-4407-af94-6a74d780afc3 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:31.990127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-851735a8-4f71-4407-af94-6a74d780afc3 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:32.001245 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-851735a8-4f71-4407-af94-6a74d780afc3 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09" status: 200 len: 1313 microversion: 2.1 time: 0.334620 Aug 24 10:16:32.026504 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 575/1234] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:31 2022] GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09 => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:32.037016 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-edc641ed-ef5e-42dc-9aaf-eee1c646f580 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:32.038223 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-edc641ed-ef5e-42dc-9aaf-eee1c646f580 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:32.048859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edc641ed-ef5e-42dc-9aaf-eee1c646f580 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:32.050347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edc641ed-ef5e-42dc-9aaf-eee1c646f580 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:32.051116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edc641ed-ef5e-42dc-9aaf-eee1c646f580 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:32.052227 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edc641ed-ef5e-42dc-9aaf-eee1c646f580 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:32.052998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edc641ed-ef5e-42dc-9aaf-eee1c646f580 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:32.053666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edc641ed-ef5e-42dc-9aaf-eee1c646f580 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:32.553289 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-edc641ed-ef5e-42dc-9aaf-eee1c646f580 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb69265eac264f36acc9d04eb60a0449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1a2f8a03d4395903df62f152212d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:32.571708 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-edc641ed-ef5e-42dc-9aaf-eee1c646f580 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff" status: 200 len: 1331 microversion: 2.1 time: 0.542760 Aug 24 10:16:32.585152 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 576/1235] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:32 2022] GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff => generated 1331 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:32.599758 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f75315b0-d60f-4e15-b578-1d29b4bc380a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:32.600792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f75315b0-d60f-4e15-b578-1d29b4bc380a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:32.645597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f75315b0-d60f-4e15-b578-1d29b4bc380a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:32.646334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f75315b0-d60f-4e15-b578-1d29b4bc380a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:32.646638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f75315b0-d60f-4e15-b578-1d29b4bc380a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:32.648111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f75315b0-d60f-4e15-b578-1d29b4bc380a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:32.649753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f75315b0-d60f-4e15-b578-1d29b4bc380a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:32.650195 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f75315b0-d60f-4e15-b578-1d29b4bc380a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:33.067644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f75315b0-d60f-4e15-b578-1d29b4bc380a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:33.081038 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f75315b0-d60f-4e15-b578-1d29b4bc380a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1504 microversion: 2.1 time: 0.495369 Aug 24 10:16:33.098908 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 577/1236] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:32 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1504 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:33.108130 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-90514bc7-174f-4a8a-af3a-8e850637cab0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:33.109661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-90514bc7-174f-4a8a-af3a-8e850637cab0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:33.122387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90514bc7-174f-4a8a-af3a-8e850637cab0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:33.123641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90514bc7-174f-4a8a-af3a-8e850637cab0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:33.124272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90514bc7-174f-4a8a-af3a-8e850637cab0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:33.126099 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90514bc7-174f-4a8a-af3a-8e850637cab0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:33.126782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90514bc7-174f-4a8a-af3a-8e850637cab0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:33.127694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90514bc7-174f-4a8a-af3a-8e850637cab0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:33.864207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-90514bc7-174f-4a8a-af3a-8e850637cab0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:33.880667 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-90514bc7-174f-4a8a-af3a-8e850637cab0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1541 microversion: 2.1 time: 0.776412 Aug 24 10:16:33.891774 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 578/1237] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:33 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1541 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:33.906758 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ef05367f-2113-4429-8f49-875f3d879a75 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:33.916342 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ef05367f-2113-4429-8f49-875f3d879a75 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 912f291b-bf95-456e-a123-95c1314bbc09] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:33.986626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef05367f-2113-4429-8f49-875f3d879a75 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:33.990072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef05367f-2113-4429-8f49-875f3d879a75 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:34.001111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef05367f-2113-4429-8f49-875f3d879a75 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:34.016293 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef05367f-2113-4429-8f49-875f3d879a75 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:34.017660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef05367f-2113-4429-8f49-875f3d879a75 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:34.028590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef05367f-2113-4429-8f49-875f3d879a75 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:34.698225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ef05367f-2113-4429-8f49-875f3d879a75 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:34.717658 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ef05367f-2113-4429-8f49-875f3d879a75 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09" status: 200 len: 1313 microversion: 2.1 time: 0.824324 Aug 24 10:16:34.724760 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 579/1238] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:33 2022] GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09 => generated 1313 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:34.752760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8d422a7f-043a-4935-9f89-482c42d98f7b tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:34.754604 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8d422a7f-043a-4935-9f89-482c42d98f7b tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:34.793352 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d422a7f-043a-4935-9f89-482c42d98f7b tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:34.795054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d422a7f-043a-4935-9f89-482c42d98f7b tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:34.796849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d422a7f-043a-4935-9f89-482c42d98f7b tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:34.799225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d422a7f-043a-4935-9f89-482c42d98f7b tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:34.809202 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d422a7f-043a-4935-9f89-482c42d98f7b tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:34.810080 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d422a7f-043a-4935-9f89-482c42d98f7b tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:35.337936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8d422a7f-043a-4935-9f89-482c42d98f7b tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb69265eac264f36acc9d04eb60a0449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1a2f8a03d4395903df62f152212d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:35.351415 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8d422a7f-043a-4935-9f89-482c42d98f7b tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff" status: 200 len: 1331 microversion: 2.1 time: 0.625125 Aug 24 10:16:35.352040 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 580/1239] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:34 2022] GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff => generated 1331 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:35.382271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ebecfaee-ee88-4bab-9e4f-54a15c4b27f1 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:35.387250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ebecfaee-ee88-4bab-9e4f-54a15c4b27f1 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:35.403452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebecfaee-ee88-4bab-9e4f-54a15c4b27f1 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:35.404266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebecfaee-ee88-4bab-9e4f-54a15c4b27f1 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:35.407105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebecfaee-ee88-4bab-9e4f-54a15c4b27f1 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:35.408245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebecfaee-ee88-4bab-9e4f-54a15c4b27f1 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:35.413843 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebecfaee-ee88-4bab-9e4f-54a15c4b27f1 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:35.414575 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebecfaee-ee88-4bab-9e4f-54a15c4b27f1 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:35.822445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ebecfaee-ee88-4bab-9e4f-54a15c4b27f1 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:35.843746 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ebecfaee-ee88-4bab-9e4f-54a15c4b27f1 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1494 microversion: 2.1 time: 0.489214 Aug 24 10:16:35.845814 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 581/1240] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:35 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1494 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:35.856949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9162dcd4-4611-4cce-b392-9585d61a97e1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:35.858752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9162dcd4-4611-4cce-b392-9585d61a97e1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:35.872880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9162dcd4-4611-4cce-b392-9585d61a97e1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:35.875265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9162dcd4-4611-4cce-b392-9585d61a97e1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:35.877309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9162dcd4-4611-4cce-b392-9585d61a97e1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:35.879142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9162dcd4-4611-4cce-b392-9585d61a97e1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:35.880329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9162dcd4-4611-4cce-b392-9585d61a97e1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:35.881477 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9162dcd4-4611-4cce-b392-9585d61a97e1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:36.315266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9162dcd4-4611-4cce-b392-9585d61a97e1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:36.371094 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9162dcd4-4611-4cce-b392-9585d61a97e1 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1473 microversion: 2.1 time: 0.523138 Aug 24 10:16:36.386692 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 582/1241] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:35 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1473 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:36.403459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-604499bd-49be-4342-bd2a-3106d52794b5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:36.411927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-604499bd-49be-4342-bd2a-3106d52794b5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 912f291b-bf95-456e-a123-95c1314bbc09] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:36.435616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-604499bd-49be-4342-bd2a-3106d52794b5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:36.436481 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-604499bd-49be-4342-bd2a-3106d52794b5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:36.437734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-604499bd-49be-4342-bd2a-3106d52794b5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:36.441417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-604499bd-49be-4342-bd2a-3106d52794b5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:36.442058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-604499bd-49be-4342-bd2a-3106d52794b5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:36.442788 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-604499bd-49be-4342-bd2a-3106d52794b5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:36.885341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-604499bd-49be-4342-bd2a-3106d52794b5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:36.905751 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-604499bd-49be-4342-bd2a-3106d52794b5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09" status: 200 len: 1313 microversion: 2.1 time: 0.508649 Aug 24 10:16:36.908670 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 583/1242] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:36 2022] GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09 => generated 1313 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:36.920506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fd358f82-2192-44fb-9901-e05926d83c24 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Calling method '.version_select at 0x7f4655017940>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:36.957873 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd358f82-2192-44fb-9901-e05926d83c24 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:36.961657 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd358f82-2192-44fb-9901-e05926d83c24 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:36.970820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd358f82-2192-44fb-9901-e05926d83c24 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:37.011249 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fd358f82-2192-44fb-9901-e05926d83c24 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] 10.222.0.85 "GET /compute/v2.1/os-migrations" status: 200 len: 2734 microversion: 2.1 time: 0.099286 Aug 24 10:16:37.026393 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 584/1243] 10.222.0.85 () {58 vars in 1143 bytes} [Wed Aug 24 10:16:36 2022] GET /compute/v2.1/os-migrations => generated 2734 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:37.045660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2769a709-8133-4ff2-b02d-38c1e2eb3dfd tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:37.048464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2769a709-8133-4ff2-b02d-38c1e2eb3dfd tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:37.079555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2769a709-8133-4ff2-b02d-38c1e2eb3dfd tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:37.083615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2769a709-8133-4ff2-b02d-38c1e2eb3dfd tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:37.084713 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2769a709-8133-4ff2-b02d-38c1e2eb3dfd tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:37.091124 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2769a709-8133-4ff2-b02d-38c1e2eb3dfd tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:37.093690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2769a709-8133-4ff2-b02d-38c1e2eb3dfd tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:37.096784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2769a709-8133-4ff2-b02d-38c1e2eb3dfd tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:37.737686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2769a709-8133-4ff2-b02d-38c1e2eb3dfd tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb69265eac264f36acc9d04eb60a0449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1a2f8a03d4395903df62f152212d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:37.769810 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2769a709-8133-4ff2-b02d-38c1e2eb3dfd tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff" status: 200 len: 1331 microversion: 2.1 time: 0.741258 Aug 24 10:16:37.775320 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 585/1244] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:37 2022] GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff => generated 1331 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:37.984383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-6586818f-bdf1-428e-831c-bf6f95a77676 req-c77c4f91-8f9d-4bb6-940f-1cca1dafd4c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86d0b20c-a790-4b41-a823-2a79532df7ff", "name": "network-vif-plugged", "status": "completed", "tag": "ee530f9b-86a7-47a7-bef8-49f2a0946b85"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:16:38.037690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6586818f-bdf1-428e-831c-bf6f95a77676 req-c77c4f91-8f9d-4bb6-940f-1cca1dafd4c3 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:38.051021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6586818f-bdf1-428e-831c-bf6f95a77676 req-c77c4f91-8f9d-4bb6-940f-1cca1dafd4c3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:38.052019 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6586818f-bdf1-428e-831c-bf6f95a77676 req-c77c4f91-8f9d-4bb6-940f-1cca1dafd4c3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:38.188132 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-6586818f-bdf1-428e-831c-bf6f95a77676 req-c77c4f91-8f9d-4bb6-940f-1cca1dafd4c3 service nova] Creating event network-vif-plugged:ee530f9b-86a7-47a7-bef8-49f2a0946b85 for instance 86d0b20c-a790-4b41-a823-2a79532df7ff on n-h1-849328-3 Aug 24 10:16:38.213049 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-6586818f-bdf1-428e-831c-bf6f95a77676 req-c77c4f91-8f9d-4bb6-940f-1cca1dafd4c3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.429215 Aug 24 10:16:38.214172 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 586/1245] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:16:38.233250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cad17f6a-bf4b-4ccc-af6d-8b8e910dc14e tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:38.240684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cad17f6a-bf4b-4ccc-af6d-8b8e910dc14e tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:38.286101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cad17f6a-bf4b-4ccc-af6d-8b8e910dc14e tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:38.289984 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cad17f6a-bf4b-4ccc-af6d-8b8e910dc14e tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:38.292154 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cad17f6a-bf4b-4ccc-af6d-8b8e910dc14e tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:38.299322 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cad17f6a-bf4b-4ccc-af6d-8b8e910dc14e tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:38.300423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cad17f6a-bf4b-4ccc-af6d-8b8e910dc14e tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:38.301409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cad17f6a-bf4b-4ccc-af6d-8b8e910dc14e tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:38.696156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=15 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:16:39.038863 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cad17f6a-bf4b-4ccc-af6d-8b8e910dc14e tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1645 microversion: 2.1 time: 0.820951 Aug 24 10:16:39.042052 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 587/1246] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:38 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1645 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:39.071976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a24b78bd-d879-4118-9583-5ce48cc97643 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:39.073931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a24b78bd-d879-4118-9583-5ce48cc97643 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:39.101262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a24b78bd-d879-4118-9583-5ce48cc97643 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:39.101780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a24b78bd-d879-4118-9583-5ce48cc97643 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:39.102213 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a24b78bd-d879-4118-9583-5ce48cc97643 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:39.111205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a24b78bd-d879-4118-9583-5ce48cc97643 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:39.112543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a24b78bd-d879-4118-9583-5ce48cc97643 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:39.112999 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a24b78bd-d879-4118-9583-5ce48cc97643 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:39.575671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a24b78bd-d879-4118-9583-5ce48cc97643 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:39.579748 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:16:39.647371 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a24b78bd-d879-4118-9583-5ce48cc97643 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1470 microversion: 2.1 time: 0.602955 Aug 24 10:16:39.653007 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 588/1247] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:39 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1470 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:39.664902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-38952ce0-4637-46f4-abaa-0ee57cf44e7b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:39.664902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-38952ce0-4637-46f4-abaa-0ee57cf44e7b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 912f291b-bf95-456e-a123-95c1314bbc09] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:39.674517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38952ce0-4637-46f4-abaa-0ee57cf44e7b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:39.675320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38952ce0-4637-46f4-abaa-0ee57cf44e7b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:39.675809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38952ce0-4637-46f4-abaa-0ee57cf44e7b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:39.676724 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38952ce0-4637-46f4-abaa-0ee57cf44e7b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:39.677352 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38952ce0-4637-46f4-abaa-0ee57cf44e7b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:39.678064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38952ce0-4637-46f4-abaa-0ee57cf44e7b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:40.181878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=54 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:16:40.255513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-38952ce0-4637-46f4-abaa-0ee57cf44e7b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:40.293164 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-38952ce0-4637-46f4-abaa-0ee57cf44e7b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09" status: 200 len: 1313 microversion: 2.1 time: 0.636757 Aug 24 10:16:40.322569 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 589/1248] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:39 2022] GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09 => generated 1313 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:40.363246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1c690e7b-3d59-453b-a31b-21b89d7b6e21 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:40.365349 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1c690e7b-3d59-453b-a31b-21b89d7b6e21 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:40.382276 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c690e7b-3d59-453b-a31b-21b89d7b6e21 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:40.386698 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c690e7b-3d59-453b-a31b-21b89d7b6e21 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:40.388440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c690e7b-3d59-453b-a31b-21b89d7b6e21 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:40.390948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c690e7b-3d59-453b-a31b-21b89d7b6e21 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:40.392461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c690e7b-3d59-453b-a31b-21b89d7b6e21 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:40.394103 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c690e7b-3d59-453b-a31b-21b89d7b6e21 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:40.835383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1c690e7b-3d59-453b-a31b-21b89d7b6e21 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb69265eac264f36acc9d04eb60a0449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1a2f8a03d4395903df62f152212d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:40.853542 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1c690e7b-3d59-453b-a31b-21b89d7b6e21 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff" status: 200 len: 1331 microversion: 2.1 time: 0.508163 Aug 24 10:16:40.855304 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 590/1249] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:40 2022] GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff => generated 1331 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:40.862378 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c5aae70c-8def-429c-a971-5c94b631852a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1445614622", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "f9d3da2a-e7f1-4061-b1c2-835192cdb5b7"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:16:42.296794 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-89cc73ce-67f6-45f7-8273-4c82d3a6dfde tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a" status: 200 len: 1423 microversion: 2.1 time: 12.075691 Aug 24 10:16:42.306457 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 660/1250] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:16:30 2022] GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a => generated 1423 bytes in 12086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:42.309410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-c5aae70c-8def-429c-a971-5c94b631852a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] validate_networks() for [('f9d3da2a-e7f1-4061-b1c2-835192cdb5b7', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:16:42.311877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3fd54958-253c-4e8d-a1d4-eaed983ddf84 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:16:42.312578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3fd54958-253c-4e8d-a1d4-eaed983ddf84 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:42.321650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd54958-253c-4e8d-a1d4-eaed983ddf84 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:42.322154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd54958-253c-4e8d-a1d4-eaed983ddf84 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:42.322568 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd54958-253c-4e8d-a1d4-eaed983ddf84 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:42.323622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd54958-253c-4e8d-a1d4-eaed983ddf84 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:42.323987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd54958-253c-4e8d-a1d4-eaed983ddf84 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:42.324421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd54958-253c-4e8d-a1d4-eaed983ddf84 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:42.372642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd54958-253c-4e8d-a1d4-eaed983ddf84 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:42.373146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd54958-253c-4e8d-a1d4-eaed983ddf84 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:42.373646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd54958-253c-4e8d-a1d4-eaed983ddf84 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:42.375077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd54958-253c-4e8d-a1d4-eaed983ddf84 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:42.375692 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd54958-253c-4e8d-a1d4-eaed983ddf84 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:42.377297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd54958-253c-4e8d-a1d4-eaed983ddf84 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:42.423452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-3fd54958-253c-4e8d-a1d4-eaed983ddf84 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Getting quotas for project 7947a063a37946b7870e95dfd7a2e7e6. Resources: {'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:16:42.429795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-3fd54958-253c-4e8d-a1d4-eaed983ddf84 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Getting quotas for user 53af167c0c744cbb910ff5860767cb95 and project 7947a063a37946b7870e95dfd7a2e7e6. Resources: {'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:16:42.693079 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3fd54958-253c-4e8d-a1d4-eaed983ddf84 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "POST /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08/action" status: 202 len: 0 microversion: 2.1 time: 0.385107 Aug 24 10:16:42.697269 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 661/1251] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:16:42 2022] POST /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:16:42.700365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a5105fb9-087d-43a1-a1ff-19e5a2e76279 req-f1a72fbe-f9eb-4215-b013-cba603142453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "912f291b-bf95-456e-a123-95c1314bbc09", "name": "network-vif-plugged", "status": "completed", "tag": "15ee8e44-fbbd-4e30-90ec-bb8bc625006f"}, {"server_uuid": "35c8116a-830a-4f60-9d70-34eacd719c08", "name": "network-vif-unplugged", "status": "completed", "tag": "6676526f-444f-4a1b-94b1-f417a9a55ffa"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:16:42.727118 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a5105fb9-087d-43a1-a1ff-19e5a2e76279 req-f1a72fbe-f9eb-4215-b013-cba603142453 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:42.727601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a5105fb9-087d-43a1-a1ff-19e5a2e76279 req-f1a72fbe-f9eb-4215-b013-cba603142453 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:42.728027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a5105fb9-087d-43a1-a1ff-19e5a2e76279 req-f1a72fbe-f9eb-4215-b013-cba603142453 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:42.753558 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a5105fb9-087d-43a1-a1ff-19e5a2e76279 req-f1a72fbe-f9eb-4215-b013-cba603142453 service nova] Creating event network-vif-plugged:15ee8e44-fbbd-4e30-90ec-bb8bc625006f for instance 912f291b-bf95-456e-a123-95c1314bbc09 on n-h2-849328-3 Aug 24 10:16:42.754097 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a5105fb9-087d-43a1-a1ff-19e5a2e76279 req-f1a72fbe-f9eb-4215-b013-cba603142453 service nova] Creating event network-vif-unplugged:6676526f-444f-4a1b-94b1-f417a9a55ffa for instance 35c8116a-830a-4f60-9d70-34eacd719c08 on n-h2-849328-3 Aug 24 10:16:42.779306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-a5105fb9-087d-43a1-a1ff-19e5a2e76279 req-f1a72fbe-f9eb-4215-b013-cba603142453 service nova] Instance 35c8116a-830a-4f60-9d70-34eacd719c08 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-849328-3'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 10:16:42.794026 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a5105fb9-087d-43a1-a1ff-19e5a2e76279 req-f1a72fbe-f9eb-4215-b013-cba603142453 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.097112 Aug 24 10:16:42.794483 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 662/1252] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:16:42.806069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4effc54c-1cf4-4c24-ab54-d4c4bb43978b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:42.811985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4effc54c-1cf4-4c24-ab54-d4c4bb43978b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 912f291b-bf95-456e-a123-95c1314bbc09] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:42.823172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4effc54c-1cf4-4c24-ab54-d4c4bb43978b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:42.824427 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4effc54c-1cf4-4c24-ab54-d4c4bb43978b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:42.825262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4effc54c-1cf4-4c24-ab54-d4c4bb43978b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:42.826886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4effc54c-1cf4-4c24-ab54-d4c4bb43978b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:42.827622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4effc54c-1cf4-4c24-ab54-d4c4bb43978b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:42.828424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4effc54c-1cf4-4c24-ab54-d4c4bb43978b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:43.150923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4effc54c-1cf4-4c24-ab54-d4c4bb43978b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:43.169336 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4effc54c-1cf4-4c24-ab54-d4c4bb43978b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09" status: 200 len: 1313 microversion: 2.1 time: 0.373130 Aug 24 10:16:43.178288 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 663/1253] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:42 2022] GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09 => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:43.220735 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b39156e5-7060-4123-9b6b-6a09d07f589f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:43.225884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b39156e5-7060-4123-9b6b-6a09d07f589f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:43.239313 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b39156e5-7060-4123-9b6b-6a09d07f589f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:43.245837 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b39156e5-7060-4123-9b6b-6a09d07f589f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:43.246724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b39156e5-7060-4123-9b6b-6a09d07f589f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:43.247817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b39156e5-7060-4123-9b6b-6a09d07f589f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:43.248756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b39156e5-7060-4123-9b6b-6a09d07f589f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:43.249769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b39156e5-7060-4123-9b6b-6a09d07f589f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:43.385638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c5aae70c-8def-429c-a971-5c94b631852a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:16:43.386178 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c5aae70c-8def-429c-a971-5c94b631852a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:16:43.386785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c5aae70c-8def-429c-a971-5c94b631852a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:16:43.387121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c5aae70c-8def-429c-a971-5c94b631852a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:16:43.387538 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c5aae70c-8def-429c-a971-5c94b631852a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:16:43.413024 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5aae70c-8def-429c-a971-5c94b631852a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:43.413597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5aae70c-8def-429c-a971-5c94b631852a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:43.414248 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5aae70c-8def-429c-a971-5c94b631852a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:43.415182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5aae70c-8def-429c-a971-5c94b631852a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:43.416473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5aae70c-8def-429c-a971-5c94b631852a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:43.417107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5aae70c-8def-429c-a971-5c94b631852a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:43.449640 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-c5aae70c-8def-429c-a971-5c94b631852a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Getting quotas for project 6f266868d6374a82a4ba5333915a9884. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:16:43.487691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-c5aae70c-8def-429c-a971-5c94b631852a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Getting quotas for user b321b1490c2b4fe3aa1a1747b25408a1 and project 6f266868d6374a82a4ba5333915a9884. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:16:43.544053 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c5aae70c-8def-429c-a971-5c94b631852a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:16:43.546790 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b39156e5-7060-4123-9b6b-6a09d07f589f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb69265eac264f36acc9d04eb60a0449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1a2f8a03d4395903df62f152212d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:43.554739 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c5aae70c-8def-429c-a971-5c94b631852a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:16:43.561632 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b39156e5-7060-4123-9b6b-6a09d07f589f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff" status: 200 len: 1534 microversion: 2.1 time: 0.370163 Aug 24 10:16:43.562856 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 664/1254] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:43 2022] GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff => generated 1534 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:43.666586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-59a8a522-b60e-46d7-9afc-8914837aa43f tempest-FloatingIPsTestJSON-1363172196 tempest-FloatingIPsTestJSON-1363172196-project] Action: 'create', calling method: .version_select at 0x7f4654e1d310>, body: {"pool": null} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:16:43.709591 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c5aae70c-8def-429c-a971-5c94b631852a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.851839 Aug 24 10:16:43.710753 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 591/1255] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:16:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:16:43.720052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5329aebf-fe99-4ecb-936f-006c51c25590 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4655093820>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:48.046799 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-59a8a522-b60e-46d7-9afc-8914837aa43f tempest-FloatingIPsTestJSON-1363172196 tempest-FloatingIPsTestJSON-1363172196-project] 10.222.0.85 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.481848 Aug 24 10:16:48.062699 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 665/1256] 10.222.0.85 () {60 vars in 1170 bytes} [Wed Aug 24 10:16:43 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:16:48.072491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-11e06eec-0d34-4453-b53d-f73a0b305df4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:48.073961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-11e06eec-0d34-4453-b53d-f73a0b305df4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:48.095034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11e06eec-0d34-4453-b53d-f73a0b305df4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:48.095678 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11e06eec-0d34-4453-b53d-f73a0b305df4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:48.096132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11e06eec-0d34-4453-b53d-f73a0b305df4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:48.096902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11e06eec-0d34-4453-b53d-f73a0b305df4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:48.108333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11e06eec-0d34-4453-b53d-f73a0b305df4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:48.108847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11e06eec-0d34-4453-b53d-f73a0b305df4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:48.554307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-11e06eec-0d34-4453-b53d-f73a0b305df4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:48.568841 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-11e06eec-0d34-4453-b53d-f73a0b305df4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1469 microversion: 2.1 time: 0.504348 Aug 24 10:16:48.591656 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 666/1257] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:48 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1469 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:48.607628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ab179c02-c505-43bf-a397-d8f943080557 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Action: 'create', calling method: .version_select at 0x7f4654e1d790>, body: {"pool": "5e14315d-e513-4d23-8987-87edd775859e"} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:16:51.072769 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ab179c02-c505-43bf-a397-d8f943080557 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.479254 Aug 24 10:16:51.075094 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 667/1258] 10.222.0.85 () {60 vars in 1170 bytes} [Wed Aug 24 10:16:48 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:16:51.084310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bcfb2924-6ac2-4587-9357-24ae4c035dee tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:51.085533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bcfb2924-6ac2-4587-9357-24ae4c035dee tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:51.096058 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcfb2924-6ac2-4587-9357-24ae4c035dee tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:51.097322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcfb2924-6ac2-4587-9357-24ae4c035dee tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:51.097847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcfb2924-6ac2-4587-9357-24ae4c035dee tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:51.099438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcfb2924-6ac2-4587-9357-24ae4c035dee tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:51.100377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcfb2924-6ac2-4587-9357-24ae4c035dee tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:51.101060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcfb2924-6ac2-4587-9357-24ae4c035dee tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:51.292750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bcfb2924-6ac2-4587-9357-24ae4c035dee tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:51.312592 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bcfb2924-6ac2-4587-9357-24ae4c035dee tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b" status: 200 len: 1311 microversion: 2.1 time: 0.234123 Aug 24 10:16:51.315778 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 668/1259] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:51 2022] GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b => generated 1311 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:51.326456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-56b25dc6-9cc0-464c-82bd-092147696c5b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:51.327597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-56b25dc6-9cc0-464c-82bd-092147696c5b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 912f291b-bf95-456e-a123-95c1314bbc09] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:51.355476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56b25dc6-9cc0-464c-82bd-092147696c5b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:51.356382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56b25dc6-9cc0-464c-82bd-092147696c5b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:51.357185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56b25dc6-9cc0-464c-82bd-092147696c5b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:51.358436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56b25dc6-9cc0-464c-82bd-092147696c5b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:51.359249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56b25dc6-9cc0-464c-82bd-092147696c5b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:51.360018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56b25dc6-9cc0-464c-82bd-092147696c5b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:51.576687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-56b25dc6-9cc0-464c-82bd-092147696c5b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:51.601417 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-56b25dc6-9cc0-464c-82bd-092147696c5b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09" status: 200 len: 1463 microversion: 2.1 time: 0.283220 Aug 24 10:16:51.603253 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 669/1260] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:51 2022] GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09 => generated 1463 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:51.622425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a899392b-cc40-4a83-ace9-74feea14ae59 req-431f22e3-f4fc-4d9e-8ad7-8bbe7738a2ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35c8116a-830a-4f60-9d70-34eacd719c08", "name": "network-vif-plugged", "status": "completed", "tag": "6676526f-444f-4a1b-94b1-f417a9a55ffa"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:16:51.645679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a899392b-cc40-4a83-ace9-74feea14ae59 req-431f22e3-f4fc-4d9e-8ad7-8bbe7738a2ac service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:51.646773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a899392b-cc40-4a83-ace9-74feea14ae59 req-431f22e3-f4fc-4d9e-8ad7-8bbe7738a2ac service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:51.647811 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a899392b-cc40-4a83-ace9-74feea14ae59 req-431f22e3-f4fc-4d9e-8ad7-8bbe7738a2ac service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:51.672269 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a899392b-cc40-4a83-ace9-74feea14ae59 req-431f22e3-f4fc-4d9e-8ad7-8bbe7738a2ac service nova] Creating event network-vif-plugged:6676526f-444f-4a1b-94b1-f417a9a55ffa for instance 35c8116a-830a-4f60-9d70-34eacd719c08 on n-h2-849328-3 Aug 24 10:16:51.679325 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-a899392b-cc40-4a83-ace9-74feea14ae59 req-431f22e3-f4fc-4d9e-8ad7-8bbe7738a2ac service nova] Instance 35c8116a-830a-4f60-9d70-34eacd719c08 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-849328-3'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 10:16:51.689804 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a899392b-cc40-4a83-ace9-74feea14ae59 req-431f22e3-f4fc-4d9e-8ad7-8bbe7738a2ac service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081827 Aug 24 10:16:51.691038 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 670/1261] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:16:51.699242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d4b7ee23-8d41-4923-a704-72c391c919c2 tempest-FloatingIPsTestJSON-1363172196 tempest-FloatingIPsTestJSON-1363172196-project] Calling method '.version_select at 0x7f4654eece50>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:51.961800 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d4b7ee23-8d41-4923-a704-72c391c919c2 tempest-FloatingIPsTestJSON-1363172196 tempest-FloatingIPsTestJSON-1363172196-project] 10.222.0.85 "GET /compute/v2.1/os-floating-ips/3351cb3c-b2a8-4385-acf7-6a90bcb58855" status: 200 len: 142 microversion: 2.1 time: 0.268884 Aug 24 10:16:51.962632 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 671/1262] 10.222.0.85 () {58 vars in 1260 bytes} [Wed Aug 24 10:16:51 2022] GET /compute/v2.1/os-floating-ips/3351cb3c-b2a8-4385-acf7-6a90bcb58855 => generated 142 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:16:51.969579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-73004b04-6530-40fc-8f5b-9e68fe08d410 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:51.970693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-73004b04-6530-40fc-8f5b-9e68fe08d410 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:51.984897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73004b04-6530-40fc-8f5b-9e68fe08d410 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:51.985565 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73004b04-6530-40fc-8f5b-9e68fe08d410 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:51.986731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73004b04-6530-40fc-8f5b-9e68fe08d410 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:51.987066 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73004b04-6530-40fc-8f5b-9e68fe08d410 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:51.987516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73004b04-6530-40fc-8f5b-9e68fe08d410 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:51.987827 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73004b04-6530-40fc-8f5b-9e68fe08d410 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:52.159833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-73004b04-6530-40fc-8f5b-9e68fe08d410 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:52.172365 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-73004b04-6530-40fc-8f5b-9e68fe08d410 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1535 microversion: 2.1 time: 0.208114 Aug 24 10:16:52.173401 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 672/1263] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:51 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1535 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:52.184874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-17bdf3bd-346a-4579-b5d4-4db46134a813 req-2443d7fa-1fc5-468e-9159-9ecd3fa34af2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b", "tag": "66efbfd1-4256-420a-b036-8c92ce86deea"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:16:52.201458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-17bdf3bd-346a-4579-b5d4-4db46134a813 req-2443d7fa-1fc5-468e-9159-9ecd3fa34af2 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:52.201979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-17bdf3bd-346a-4579-b5d4-4db46134a813 req-2443d7fa-1fc5-468e-9159-9ecd3fa34af2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:52.202383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-17bdf3bd-346a-4579-b5d4-4db46134a813 req-2443d7fa-1fc5-468e-9159-9ecd3fa34af2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:52.220219 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-17bdf3bd-346a-4579-b5d4-4db46134a813 req-2443d7fa-1fc5-468e-9159-9ecd3fa34af2 service nova] Creating event network-changed:66efbfd1-4256-420a-b036-8c92ce86deea for instance 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b on n-h1-849328-3 Aug 24 10:16:52.226269 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-17bdf3bd-346a-4579-b5d4-4db46134a813 req-2443d7fa-1fc5-468e-9159-9ecd3fa34af2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049590 Aug 24 10:16:52.226902 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 673/1264] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:16:52.232409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c01c54c1-fe3a-432f-8b25-3b008540e2d7 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.226"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:16:52.235093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c01c54c1-fe3a-432f-8b25-3b008540e2d7 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:52.244462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c01c54c1-fe3a-432f-8b25-3b008540e2d7 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:52.244947 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c01c54c1-fe3a-432f-8b25-3b008540e2d7 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:52.245435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c01c54c1-fe3a-432f-8b25-3b008540e2d7 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:52.246312 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c01c54c1-fe3a-432f-8b25-3b008540e2d7 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:52.246764 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c01c54c1-fe3a-432f-8b25-3b008540e2d7 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:52.247188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c01c54c1-fe3a-432f-8b25-3b008540e2d7 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:52.284660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c01c54c1-fe3a-432f-8b25-3b008540e2d7 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "refresh_cache-86d0b20c-a790-4b41-a823-2a79532df7ff" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 10:16:52.284660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c01c54c1-fe3a-432f-8b25-3b008540e2d7 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquired lock "refresh_cache-86d0b20c-a790-4b41-a823-2a79532df7ff" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 10:16:52.401496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:16:53.436065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:16:53.437356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=15 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:16:53.525254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:16:53.649898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:16:53.926450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-c01c54c1-fe3a-432f-8b25-3b008540e2d7 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Building network info cache for instance {{(pid=122433) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 10:16:54.588414 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-c01c54c1-fe3a-432f-8b25-3b008540e2d7 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Updating instance_info_cache with network_info: [{"id": "ee530f9b-86a7-47a7-bef8-49f2a0946b85", "address": "fa:16:3e:39:8a:82", "network": {"id": "620680d4-be9b-4509-ae46-5fb73d45beed", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-310865075-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1ef1a2f8a03d4395903df62f152212d9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapee530f9b-86", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122433) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 10:16:54.627218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c01c54c1-fe3a-432f-8b25-3b008540e2d7 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Releasing lock "refresh_cache-86d0b20c-a790-4b41-a823-2a79532df7ff" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 10:16:54.628332 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c01c54c1-fe3a-432f-8b25-3b008540e2d7 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "POST /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff/action" status: 202 len: 0 microversion: 2.1 time: 2.400161 Aug 24 10:16:54.630225 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 674/1265] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:16:52 2022] POST /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff/action => generated 0 bytes in 2403 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 24 10:16:54.809958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-923dee2c-0556-4c21-b4b1-c8e91212da72 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:54.815038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-923dee2c-0556-4c21-b4b1-c8e91212da72 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Searching by: {'deleted': False, 'project_id': '421a1a42a4f9443c849d62a3931f33ae'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:16:54.822532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-923dee2c-0556-4c21-b4b1-c8e91212da72 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:54.823283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-923dee2c-0556-4c21-b4b1-c8e91212da72 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:54.823876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-923dee2c-0556-4c21-b4b1-c8e91212da72 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:54.824749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-923dee2c-0556-4c21-b4b1-c8e91212da72 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:54.825376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-923dee2c-0556-4c21-b4b1-c8e91212da72 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:54.825949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-923dee2c-0556-4c21-b4b1-c8e91212da72 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:54.939489 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-923dee2c-0556-4c21-b4b1-c8e91212da72 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.306067 Aug 24 10:16:54.953147 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 675/1266] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:16:54 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:16:54.958686 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b807177b-cf2a-4506-9d01-c62ec8cb81f8 tempest-FloatingIPsTestJSON-1363172196 tempest-FloatingIPsTestJSON-1363172196-project] Calling method '.version_select at 0x7f4654f8ef70>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:55.268832 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b807177b-cf2a-4506-9d01-c62ec8cb81f8 tempest-FloatingIPsTestJSON-1363172196 tempest-FloatingIPsTestJSON-1363172196-project] 10.222.0.85 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.314528 Aug 24 10:16:55.269595 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 676/1267] 10.222.0.85 () {58 vars in 1149 bytes} [Wed Aug 24 10:16:54 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:16:55.275542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f67c4e1c-10c7-4c20-8245-c88cae8ba214 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:55.277812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f67c4e1c-10c7-4c20-8245-c88cae8ba214 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:55.297436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f67c4e1c-10c7-4c20-8245-c88cae8ba214 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:55.298667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f67c4e1c-10c7-4c20-8245-c88cae8ba214 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:55.299643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f67c4e1c-10c7-4c20-8245-c88cae8ba214 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:55.301250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f67c4e1c-10c7-4c20-8245-c88cae8ba214 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:55.302220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f67c4e1c-10c7-4c20-8245-c88cae8ba214 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:55.302720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f67c4e1c-10c7-4c20-8245-c88cae8ba214 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:55.649753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f67c4e1c-10c7-4c20-8245-c88cae8ba214 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:55.679238 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f67c4e1c-10c7-4c20-8245-c88cae8ba214 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b" status: 200 len: 1311 microversion: 2.1 time: 0.407155 Aug 24 10:16:55.696734 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 677/1268] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:55 2022] GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b => generated 1311 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:55.696734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5284bb7b-7926-40a8-a71a-a1a6a90eb46e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:55.696734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5284bb7b-7926-40a8-a71a-a1a6a90eb46e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:55.711202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5284bb7b-7926-40a8-a71a-a1a6a90eb46e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:55.711202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5284bb7b-7926-40a8-a71a-a1a6a90eb46e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:55.711984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5284bb7b-7926-40a8-a71a-a1a6a90eb46e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:55.713313 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5284bb7b-7926-40a8-a71a-a1a6a90eb46e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:55.714462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5284bb7b-7926-40a8-a71a-a1a6a90eb46e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:55.715207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5284bb7b-7926-40a8-a71a-a1a6a90eb46e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:56.010916 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5329aebf-fe99-4ecb-936f-006c51c25590 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a" status: 200 len: 1423 microversion: 2.1 time: 12.297042 Aug 24 10:16:56.014697 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 592/1269] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:16:43 2022] GET /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a => generated 1423 bytes in 12303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:56.029707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-1ad92621-5305-48e4-a72a-6c95a257ae9a req-d3ad3c89-610a-49f4-b329-780cbf46f47f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1ebe6bd-b2ae-45c2-8752-314356143de9", "name": "network-vif-unplugged", "status": "completed", "tag": "44b58631-8033-4518-911c-3c45f71ea4a5"}, {"server_uuid": "35c8116a-830a-4f60-9d70-34eacd719c08", "name": "network-vif-unplugged", "status": "completed", "tag": "6676526f-444f-4a1b-94b1-f417a9a55ffa"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:16:56.047142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1ad92621-5305-48e4-a72a-6c95a257ae9a req-d3ad3c89-610a-49f4-b329-780cbf46f47f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:56.047900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1ad92621-5305-48e4-a72a-6c95a257ae9a req-d3ad3c89-610a-49f4-b329-780cbf46f47f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:56.049328 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1ad92621-5305-48e4-a72a-6c95a257ae9a req-d3ad3c89-610a-49f4-b329-780cbf46f47f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:56.068438 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-1ad92621-5305-48e4-a72a-6c95a257ae9a req-d3ad3c89-610a-49f4-b329-780cbf46f47f service nova] Creating event network-vif-unplugged:44b58631-8033-4518-911c-3c45f71ea4a5 for instance a1ebe6bd-b2ae-45c2-8752-314356143de9 on n-h1-849328-3 Aug 24 10:16:56.069228 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-1ad92621-5305-48e4-a72a-6c95a257ae9a req-d3ad3c89-610a-49f4-b329-780cbf46f47f service nova] Creating event network-vif-unplugged:6676526f-444f-4a1b-94b1-f417a9a55ffa for instance 35c8116a-830a-4f60-9d70-34eacd719c08 on n-h2-849328-3 Aug 24 10:16:56.072125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5284bb7b-7926-40a8-a71a-a1a6a90eb46e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:56.080407 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-1ad92621-5305-48e4-a72a-6c95a257ae9a req-d3ad3c89-610a-49f4-b329-780cbf46f47f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.063747 Aug 24 10:16:56.080941 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5284bb7b-7926-40a8-a71a-a1a6a90eb46e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1528 microversion: 2.1 time: 0.394285 Aug 24 10:16:56.081640 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 593/1270] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:16:56.085479 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 678/1271] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:55 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1528 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:56.091180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-05a9b801-0273-41eb-b50c-890969734bfe tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Action: 'create', calling method: .version_select at 0x7f4654e1d790>, body: {"pool": "5e14315d-e513-4d23-8987-87edd775859e"} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:16:56.155064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-f04eeb1c-3836-4aa1-959a-5754ec869fd5 req-446f5272-9a1e-4eda-b197-e4c525594659 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86d0b20c-a790-4b41-a823-2a79532df7ff", "tag": "ee530f9b-86a7-47a7-bef8-49f2a0946b85"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:16:56.167613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f04eeb1c-3836-4aa1-959a-5754ec869fd5 req-446f5272-9a1e-4eda-b197-e4c525594659 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:56.168362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f04eeb1c-3836-4aa1-959a-5754ec869fd5 req-446f5272-9a1e-4eda-b197-e4c525594659 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:56.168964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f04eeb1c-3836-4aa1-959a-5754ec869fd5 req-446f5272-9a1e-4eda-b197-e4c525594659 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:56.184546 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-f04eeb1c-3836-4aa1-959a-5754ec869fd5 req-446f5272-9a1e-4eda-b197-e4c525594659 service nova] Creating event network-changed:ee530f9b-86a7-47a7-bef8-49f2a0946b85 for instance 86d0b20c-a790-4b41-a823-2a79532df7ff on n-h1-849328-3 Aug 24 10:16:56.190145 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-f04eeb1c-3836-4aa1-959a-5754ec869fd5 req-446f5272-9a1e-4eda-b197-e4c525594659 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107023 Aug 24 10:16:56.191075 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 594/1272] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:16:56.196380 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6a625c65-03cc-43e7-a45c-1f9251fa8fc4 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:56.202748 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6a625c65-03cc-43e7-a45c-1f9251fa8fc4 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Searching by: {'deleted': False} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:16:56.209007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a625c65-03cc-43e7-a45c-1f9251fa8fc4 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:56.209840 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a625c65-03cc-43e7-a45c-1f9251fa8fc4 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:56.210423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a625c65-03cc-43e7-a45c-1f9251fa8fc4 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:56.211313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a625c65-03cc-43e7-a45c-1f9251fa8fc4 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:56.211931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a625c65-03cc-43e7-a45c-1f9251fa8fc4 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:56.212348 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a625c65-03cc-43e7-a45c-1f9251fa8fc4 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:56.331206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-6a625c65-03cc-43e7-a45c-1f9251fa8fc4 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Listed batch of 13 results from cell out of 1000 limit. Returned 13 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:16:56.429093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a625c65-03cc-43e7-a45c-1f9251fa8fc4 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:56.429646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a625c65-03cc-43e7-a45c-1f9251fa8fc4 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:56.430560 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a625c65-03cc-43e7-a45c-1f9251fa8fc4 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:57.115499 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6a625c65-03cc-43e7-a45c-1f9251fa8fc4 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 21330 microversion: 2.1 time: 0.922612 Aug 24 10:16:57.116635 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 595/1273] 10.222.0.85 () {58 vars in 1171 bytes} [Wed Aug 24 10:16:56 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 21330 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:16:57.149347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-43906947-a795-4fbb-9812-3624b5c27f59 tempest-FloatingIPsTestJSON-1363172196 tempest-FloatingIPsTestJSON-1363172196-project] Calling method '.version_select at 0x7f4654f21280>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:58.235032 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-43906947-a795-4fbb-9812-3624b5c27f59 tempest-FloatingIPsTestJSON-1363172196 tempest-FloatingIPsTestJSON-1363172196-project] 10.222.0.85 "DELETE /compute/v2.1/os-floating-ips/3351cb3c-b2a8-4385-acf7-6a90bcb58855" status: 202 len: 0 microversion: 2.1 time: 1.102766 Aug 24 10:16:58.236845 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 596/1274] 10.222.0.85 () {58 vars in 1263 bytes} [Wed Aug 24 10:16:57 2022] DELETE /compute/v2.1/os-floating-ips/3351cb3c-b2a8-4385-acf7-6a90bcb58855 => generated 0 bytes in 1106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:16:58.251048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f548fc79-e29f-4e9d-a9bc-2e38fc7d74d9 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f46550f5280>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:58.367228 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-05a9b801-0273-41eb-b50c-890969734bfe tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.280541 Aug 24 10:16:58.369000 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 679/1275] 10.222.0.85 () {60 vars in 1170 bytes} [Wed Aug 24 10:16:56 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:16:58.374872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0dc610a2-a757-4865-9e62-4fbd6a3be4b0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:58.375721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0dc610a2-a757-4865-9e62-4fbd6a3be4b0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:58.387931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0dc610a2-a757-4865-9e62-4fbd6a3be4b0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:58.388885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0dc610a2-a757-4865-9e62-4fbd6a3be4b0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:58.389543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0dc610a2-a757-4865-9e62-4fbd6a3be4b0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:58.390546 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0dc610a2-a757-4865-9e62-4fbd6a3be4b0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:58.391166 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0dc610a2-a757-4865-9e62-4fbd6a3be4b0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:58.391875 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0dc610a2-a757-4865-9e62-4fbd6a3be4b0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:58.612111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0dc610a2-a757-4865-9e62-4fbd6a3be4b0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:58.632254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:16:58.643473 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0dc610a2-a757-4865-9e62-4fbd6a3be4b0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1528 microversion: 2.1 time: 0.271883 Aug 24 10:16:58.646817 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 680/1276] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:58 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1528 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:58.672566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4d6e4ded-ce00-403a-a44c-0751a2d74bdd tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:58.673608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4d6e4ded-ce00-403a-a44c-0751a2d74bdd tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:58.683341 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d6e4ded-ce00-403a-a44c-0751a2d74bdd tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:58.683341 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d6e4ded-ce00-403a-a44c-0751a2d74bdd tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:58.683341 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d6e4ded-ce00-403a-a44c-0751a2d74bdd tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:58.683703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d6e4ded-ce00-403a-a44c-0751a2d74bdd tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:58.684092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d6e4ded-ce00-403a-a44c-0751a2d74bdd tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:58.684703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d6e4ded-ce00-403a-a44c-0751a2d74bdd tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:58.925379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4d6e4ded-ce00-403a-a44c-0751a2d74bdd tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:16:58.934297 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4d6e4ded-ce00-403a-a44c-0751a2d74bdd tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b" status: 200 len: 1311 microversion: 2.1 time: 0.284879 Aug 24 10:16:58.935877 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 681/1277] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:58 2022] GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b => generated 1311 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:16:58.940765 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a7fd6aa5-365b-44ab-8379-b4ce972c9ed2 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:58.947108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a7fd6aa5-365b-44ab-8379-b4ce972c9ed2 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Searching by: {'deleted': False, 'project_id': '421a1a42a4f9443c849d62a3931f33ae'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:16:58.954598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7fd6aa5-365b-44ab-8379-b4ce972c9ed2 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:58.955617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7fd6aa5-365b-44ab-8379-b4ce972c9ed2 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:58.956497 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7fd6aa5-365b-44ab-8379-b4ce972c9ed2 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:58.958057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7fd6aa5-365b-44ab-8379-b4ce972c9ed2 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:58.959071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7fd6aa5-365b-44ab-8379-b4ce972c9ed2 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:58.959916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7fd6aa5-365b-44ab-8379-b4ce972c9ed2 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:58.997889 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a7fd6aa5-365b-44ab-8379-b4ce972c9ed2 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/detail?tenant_id=e6dcc3fc5b544363b1fcaadd50ea948a" status: 200 len: 15 microversion: 2.1 time: 0.060757 Aug 24 10:16:59.011916 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 682/1278] 10.222.0.85 () {58 vars in 1231 bytes} [Wed Aug 24 10:16:58 2022] GET /compute/v2.1/servers/detail?tenant_id=e6dcc3fc5b544363b1fcaadd50ea948a => generated 15 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:16:59.018572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-27ba2df8-83f9-413e-8e17-6da480888090 req-bac43cb5-b2ab-40d6-9603-bfdcdd456954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35c8116a-830a-4f60-9d70-34eacd719c08", "name": "network-vif-plugged", "status": "completed", "tag": "6676526f-444f-4a1b-94b1-f417a9a55ffa"}, {"server_uuid": "2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b", "name": "network-vif-plugged", "status": "completed", "tag": "66efbfd1-4256-420a-b036-8c92ce86deea"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:16:59.035900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-27ba2df8-83f9-413e-8e17-6da480888090 req-bac43cb5-b2ab-40d6-9603-bfdcdd456954 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:59.036723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-27ba2df8-83f9-413e-8e17-6da480888090 req-bac43cb5-b2ab-40d6-9603-bfdcdd456954 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:59.037401 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-27ba2df8-83f9-413e-8e17-6da480888090 req-bac43cb5-b2ab-40d6-9603-bfdcdd456954 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:59.053065 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-27ba2df8-83f9-413e-8e17-6da480888090 req-bac43cb5-b2ab-40d6-9603-bfdcdd456954 service nova] Creating event network-vif-plugged:6676526f-444f-4a1b-94b1-f417a9a55ffa for instance 35c8116a-830a-4f60-9d70-34eacd719c08 on n-h2-849328-3 Aug 24 10:16:59.053803 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-27ba2df8-83f9-413e-8e17-6da480888090 req-bac43cb5-b2ab-40d6-9603-bfdcdd456954 service nova] Creating event network-vif-plugged:66efbfd1-4256-420a-b036-8c92ce86deea for instance 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b on n-h1-849328-3 Aug 24 10:16:59.065707 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-27ba2df8-83f9-413e-8e17-6da480888090 req-bac43cb5-b2ab-40d6-9603-bfdcdd456954 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.062762 Aug 24 10:16:59.067361 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 683/1279] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:16:59.074091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a25fa7cb-9adc-4a6d-988e-d5ed98589f5d tempest-FloatingIPsTestJSON-1363172196 tempest-FloatingIPsTestJSON-1363172196-project] Action: 'create', calling method: .version_select at 0x7f4654eecd30>, body: {"pool": null} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:16:59.093106 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f548fc79-e29f-4e9d-a9bc-2e38fc7d74d9 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "DELETE /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a" status: 204 len: 0 microversion: 2.1 time: 0.847398 Aug 24 10:16:59.094009 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 597/1280] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:16:58 2022] DELETE /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a => generated 0 bytes in 849 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:16:59.098708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8350c1d1-1f7c-44ef-88b9-702d7faa9d7f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.170"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:16:59.107583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8350c1d1-1f7c-44ef-88b9-702d7faa9d7f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:16:59.131112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8350c1d1-1f7c-44ef-88b9-702d7faa9d7f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:59.131753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8350c1d1-1f7c-44ef-88b9-702d7faa9d7f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:59.132521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8350c1d1-1f7c-44ef-88b9-702d7faa9d7f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:59.133324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8350c1d1-1f7c-44ef-88b9-702d7faa9d7f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:59.133790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8350c1d1-1f7c-44ef-88b9-702d7faa9d7f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:59.134220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8350c1d1-1f7c-44ef-88b9-702d7faa9d7f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:59.195628 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8350c1d1-1f7c-44ef-88b9-702d7faa9d7f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "refresh_cache-86d0b20c-a790-4b41-a823-2a79532df7ff" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 10:16:59.196030 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8350c1d1-1f7c-44ef-88b9-702d7faa9d7f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquired lock "refresh_cache-86d0b20c-a790-4b41-a823-2a79532df7ff" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 10:16:59.741228 n-d-849328-3 devstack@n-api.service[122432]: DEBUG neutronclient.v2_0.client [None req-8350c1d1-1f7c-44ef-88b9-702d7faa9d7f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.0.170 (4fb4921e-b99a-44c8-a3d5-1d0e8e20c4bf) with port ee530f9b-86a7-47a7-bef8-49f2a0946b85 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 5e14315d-e513-4d23-8987-87edd775859e.", "detail": ""}} {{(pid=122432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 10:16:59.743601 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8350c1d1-1f7c-44ef-88b9-702d7faa9d7f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Releasing lock "refresh_cache-86d0b20c-a790-4b41-a823-2a79532df7ff" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 10:16:59.744856 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-8350c1d1-1f7c-44ef-88b9-702d7faa9d7f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] HTTP exception thrown: Cannot associate floating IP 172.25.0.170 (4fb4921e-b99a-44c8-a3d5-1d0e8e20c4bf) with port ee530f9b-86a7-47a7-bef8-49f2a0946b85 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 5e14315d-e513-4d23-8987-87edd775859e. Aug 24 10:16:59.744856 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-3ba68f39-7ccc-46cd-8cb1-569f360158e1'] Aug 24 10:16:59.756740 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8350c1d1-1f7c-44ef-88b9-702d7faa9d7f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Request method failure captured: Aug 24 10:16:59.756740 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff/action HTTP/1.1 Aug 24 10:16:59.756740 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:16:59.756740 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:16:59.756740 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:16:59.756740 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 46 Aug 24 10:16:59.756740 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:16:59.756740 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:16:59.756740 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:16:59.756740 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:16:59.756740 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfplTgd7srch0OUV12_onq92hN1tE6n2OpjGQv0Xy_I9PkLJddgZf7HXwu_Qcr4mCdxDC2-4EDrRmUwhe7W25YzuijkLFDMzbaUPl60kcla86IsXOhleLVtVMjrf9fLUCcX_HaR2i9GigKM9hHrIp_UHZ7WtoK6u7tNK6sMjhvtZ5xY Aug 24 10:16:59.756740 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:16:59.756740 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:16:59.756740 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:16:59.756740 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:16:59.756740 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:16:59.756740 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:16:59.756740 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 1ef1a2f8a03d4395903df62f152212d9 Aug 24 10:16:59.756740 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 Aug 24 10:16:59.756740 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:16:59.756740 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:16:59.759710 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1ef1a2f8a03d4395903df62f152212d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_1ef1a2f8a03d4395903df62f152212d9", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1ef1a2f8a03d4395903df62f152212d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/1ef1a2f8a03d4395903df62f152212d9"}]}] Aug 24 10:16:59.759710 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 Aug 24 10:16:59.759710 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 1ef1a2f8a03d4395903df62f152212d9 Aug 24 10:16:59.759710 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 Aug 24 10:16:59.759710 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project Aug 24 10:16:59.759710 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:16:59.759710 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:16:59.759710 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: cb69265eac264f36acc9d04eb60a0449 Aug 24 10:16:59.759710 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project Aug 24 10:16:59.759710 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:16:59.759710 n-d-849328-3 devstack@n-api.service[122432]: {"addFloatingIp": {"address": "172.25.0.170"}} Aug 24 10:16:59.759710 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:16:59.762039 n-d-849328-3 devstack@n-api.service[122432]: exception: Cannot associate floating IP 172.25.0.170 (4fb4921e-b99a-44c8-a3d5-1d0e8e20c4bf) with port ee530f9b-86a7-47a7-bef8-49f2a0946b85 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 5e14315d-e513-4d23-8987-87edd775859e. Aug 24 10:16:59.762039 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-3ba68f39-7ccc-46cd-8cb1-569f360158e1'] Aug 24 10:16:59.762039 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '86d0b20c-a790-4b41-a823-2a79532df7ff', 'body': {'addFloatingIp': {'address': '172.25.0.170'}}} Aug 24 10:16:59.762039 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:16:59.762039 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:16:59.762039 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 24 10:16:59.762039 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 24 10:16:59.762039 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:16:59.762039 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:16:59.762039 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 24 10:16:59.762039 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 24 10:16:59.762039 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:16:59.762039 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:16:59.762039 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 24 10:16:59.762039 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 24 10:16:59.762039 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:16:59.762039 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:16:59.765007 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 24 10:16:59.765007 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 24 10:16:59.765007 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:16:59.765007 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:16:59.765007 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 10:16:59.765007 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 10:16:59.765007 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:16:59.765007 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:16:59.765007 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 10:16:59.765007 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 10:16:59.765007 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:16:59.765007 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:16:59.765007 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 10:16:59.765007 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 10:16:59.765007 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 10:16:59.765007 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 10:16:59.766849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.0.170 (4fb4921e-b99a-44c8-a3d5-1d0e8e20c4bf) with port ee530f9b-86a7-47a7-bef8-49f2a0946b85 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 5e14315d-e513-4d23-8987-87edd775859e. Aug 24 10:16:59.766849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ba68f39-7ccc-46cd-8cb1-569f360158e1'] Aug 24 10:16:59.766849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:16:59.766849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:16:59.766849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:16:59.766849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:16:59.766849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 24 10:16:59.766849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 24 10:16:59.766849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 24 10:16:59.766849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 24 10:16:59.766849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 24 10:16:59.766849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 24 10:16:59.766849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.0.170 (4fb4921e-b99a-44c8-a3d5-1d0e8e20c4bf) with port ee530f9b-86a7-47a7-bef8-49f2a0946b85 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 5e14315d-e513-4d23-8987-87edd775859e. Aug 24 10:16:59.766849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ba68f39-7ccc-46cd-8cb1-569f360158e1'] Aug 24 10:16:59.766849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:16:59.766849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:16:59.768788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:16:59.768788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:16:59.768788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:16:59.768788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:16:59.768788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:16:59.768788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:16:59.768788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:16:59.768788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:16:59.768788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:16:59.768788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:16:59.768788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:16:59.768788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:16:59.768788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 24 10:16:59.768788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 10:16:59.768788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.0.170 (4fb4921e-b99a-44c8-a3d5-1d0e8e20c4bf) with port ee530f9b-86a7-47a7-bef8-49f2a0946b85 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 5e14315d-e513-4d23-8987-87edd775859e. Aug 24 10:16:59.768788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ba68f39-7ccc-46cd-8cb1-569f360158e1'] Aug 24 10:16:59.768788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:16:59.768788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:16:59.770884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:16:59.770884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:16:59.770884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:16:59.770884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:16:59.770884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:16:59.770884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:16:59.770884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.0.170 (4fb4921e-b99a-44c8-a3d5-1d0e8e20c4bf) with port ee530f9b-86a7-47a7-bef8-49f2a0946b85 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 5e14315d-e513-4d23-8987-87edd775859e. Aug 24 10:16:59.770884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ba68f39-7ccc-46cd-8cb1-569f360158e1'] Aug 24 10:16:59.770884 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:16:59.781860 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8350c1d1-1f7c-44ef-88b9-702d7faa9d7f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Returning 400 to user: Cannot associate floating IP 172.25.0.170 (4fb4921e-b99a-44c8-a3d5-1d0e8e20c4bf) with port ee530f9b-86a7-47a7-bef8-49f2a0946b85 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 5e14315d-e513-4d23-8987-87edd775859e. Aug 24 10:16:59.781860 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-3ba68f39-7ccc-46cd-8cb1-569f360158e1'] {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:16:59.782795 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8350c1d1-1f7c-44ef-88b9-702d7faa9d7f tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "POST /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff/action" status: 400 len: 381 microversion: 2.1 time: 0.687830 Aug 24 10:16:59.794357 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 598/1281] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:16:59 2022] POST /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff/action => generated 381 bytes in 700 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:16:59.800278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ea99d16a-ea20-45c3-82cd-0eb276868e99 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:59.801419 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:16:59.801419 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:16:59.807810 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-ea99d16a-ea20-45c3-82cd-0eb276868e99 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] HTTP exception thrown: Flavor 623db3b5-0bfd-4b20-95a7-db5ad80e00da could not be found. Aug 24 10:16:59.809997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ea99d16a-ea20-45c3-82cd-0eb276868e99 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Request method failure captured: Aug 24 10:16:59.809997 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/flavors/623db3b5-0bfd-4b20-95a7-db5ad80e00da HTTP/1.1 Aug 24 10:16:59.809997 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:16:59.809997 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:16:59.809997 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:16:59.809997 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:16:59.809997 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:16:59.809997 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:16:59.809997 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:16:59.809997 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:16:59.809997 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBflw3sH2rrWgXEYutNIcmEGrJTA6PzzElXwoX9e8_IUT4W6zeQ302YDflnnjx0hWhXuAzKbj-SGm9PuTEb9IqTnPwWzHozujD1faNUpna03YMqGuatku_XICkiniBHMKyaOsvbkZ_Zb51mvmOnnaGFOzlo9ICgT93Z0Y4A7aFn3jC5U Aug 24 10:16:59.809997 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:16:59.809997 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:16:59.809997 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:16:59.809997 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:16:59.809997 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:16:59.809997 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:16:59.809997 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: c5901a8bee2a473b9e834cd93f11e998 Aug 24 10:16:59.809997 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-MigrationsAdminTest-637766083 Aug 24 10:16:59.809997 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,admin,member Aug 24 10:16:59.809997 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,admin,member Aug 24 10:16:59.813268 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c5901a8bee2a473b9e834cd93f11e998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c5901a8bee2a473b9e834cd93f11e998", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c5901a8bee2a473b9e834cd93f11e998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c5901a8bee2a473b9e834cd93f11e998"}]}] Aug 24 10:16:59.813268 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-MigrationsAdminTest-637766083 Aug 24 10:16:59.813268 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: c5901a8bee2a473b9e834cd93f11e998 Aug 24 10:16:59.813268 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-MigrationsAdminTest-637766083 Aug 24 10:16:59.813268 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-MigrationsAdminTest-637766083-project-admin Aug 24 10:16:59.813268 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:16:59.813268 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:16:59.813268 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 9e10b533b89c457a972e0de8d05999fb Aug 24 10:16:59.813268 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-MigrationsAdminTest-637766083-project-admin Aug 24 10:16:59.813268 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:16:59.813268 n-d-849328-3 devstack@n-api.service[122432]: exception: Flavor 623db3b5-0bfd-4b20-95a7-db5ad80e00da could not be found. Aug 24 10:16:59.813268 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '623db3b5-0bfd-4b20-95a7-db5ad80e00da'} Aug 24 10:16:59.814149 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:16:59.814149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:16:59.814149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 24 10:16:59.814149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 24 10:16:59.814149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 24 10:16:59.814149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 24 10:16:59.814149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 24 10:16:59.814149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 24 10:16:59.814149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 24 10:16:59.814149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 24 10:16:59.814149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 10:16:59.814149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 10:16:59.814149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 24 10:16:59.814149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 24 10:16:59.814149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 623db3b5-0bfd-4b20-95a7-db5ad80e00da could not be found. Aug 24 10:16:59.814149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:16:59.814149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:16:59.814149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:16:59.814149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:16:59.814149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:16:59.830906 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:16:59.830906 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:16:59.830906 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:16:59.830906 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:16:59.830906 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:16:59.830906 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 24 10:16:59.830906 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:16:59.830906 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 623db3b5-0bfd-4b20-95a7-db5ad80e00da could not be found. Aug 24 10:16:59.830906 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:16:59.830906 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:16:59.830906 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:16:59.830906 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:16:59.830906 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:16:59.830906 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:16:59.830906 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:16:59.830906 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:16:59.830906 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 623db3b5-0bfd-4b20-95a7-db5ad80e00da could not be found. Aug 24 10:16:59.830906 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:16:59.832052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ea99d16a-ea20-45c3-82cd-0eb276868e99 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Returning 404 to user: Flavor 623db3b5-0bfd-4b20-95a7-db5ad80e00da could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:16:59.832052 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ea99d16a-ea20-45c3-82cd-0eb276868e99 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/623db3b5-0bfd-4b20-95a7-db5ad80e00da" status: 404 len: 109 microversion: 2.1 time: 0.015888 Aug 24 10:16:59.832052 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 599/1282] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:16:59 2022] DELETE /compute/v2.1/flavors/623db3b5-0bfd-4b20-95a7-db5ad80e00da => generated 109 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:16:59.832052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9b105dcf-71d7-40b4-b399-b2f898767b83 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:59.832052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9b105dcf-71d7-40b4-b399-b2f898767b83 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Searching by: {'tenant_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'deleted': False} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:16:59.832418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b105dcf-71d7-40b4-b399-b2f898767b83 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:59.832557 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b105dcf-71d7-40b4-b399-b2f898767b83 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:59.833210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b105dcf-71d7-40b4-b399-b2f898767b83 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:59.834511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b105dcf-71d7-40b4-b399-b2f898767b83 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:59.835196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b105dcf-71d7-40b4-b399-b2f898767b83 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:59.835799 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b105dcf-71d7-40b4-b399-b2f898767b83 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:59.994548 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-9b105dcf-71d7-40b4-b399-b2f898767b83 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:17:00.112417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b105dcf-71d7-40b4-b399-b2f898767b83 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:00.113689 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b105dcf-71d7-40b4-b399-b2f898767b83 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:00.114708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b105dcf-71d7-40b4-b399-b2f898767b83 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:00.266055 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9b105dcf-71d7-40b4-b399-b2f898767b83 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e6dcc3fc5b544363b1fcaadd50ea948a" status: 200 len: 4825 microversion: 2.1 time: 0.452227 Aug 24 10:17:00.273222 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 600/1283] 10.222.0.85 () {58 vars in 1257 bytes} [Wed Aug 24 10:16:59 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e6dcc3fc5b544363b1fcaadd50ea948a => generated 4825 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:00.273222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7bb311ff-5778-4a1f-8b08-d0cab3f8ce0f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:00.273222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7bb311ff-5778-4a1f-8b08-d0cab3f8ce0f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:00.280072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7bb311ff-5778-4a1f-8b08-d0cab3f8ce0f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:00.280563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7bb311ff-5778-4a1f-8b08-d0cab3f8ce0f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:00.281003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7bb311ff-5778-4a1f-8b08-d0cab3f8ce0f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:00.281746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7bb311ff-5778-4a1f-8b08-d0cab3f8ce0f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:00.282204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7bb311ff-5778-4a1f-8b08-d0cab3f8ce0f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:00.282631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7bb311ff-5778-4a1f-8b08-d0cab3f8ce0f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:00.331569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7bb311ff-5778-4a1f-8b08-d0cab3f8ce0f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:17:00.458618 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7bb311ff-5778-4a1f-8b08-d0cab3f8ce0f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 204 len: 0 microversion: 2.1 time: 0.188783 Aug 24 10:17:00.465416 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 601/1284] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:17:00 2022] DELETE /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:17:00.475270 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5101edc4-a231-45bf-940b-f8f42dae4940 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Calling method '.version_select at 0x7f4654d8ab80>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:01.041994 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a25fa7cb-9adc-4a6d-988e-d5ed98589f5d tempest-FloatingIPsTestJSON-1363172196 tempest-FloatingIPsTestJSON-1363172196-project] 10.222.0.85 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.972419 Aug 24 10:17:01.056837 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 684/1285] 10.222.0.85 () {60 vars in 1170 bytes} [Wed Aug 24 10:16:59 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:01.069802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0a6d7e31-ebef-45a4-a247-970169bc57c5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:01.071839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0a6d7e31-ebef-45a4-a247-970169bc57c5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:01.090426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a6d7e31-ebef-45a4-a247-970169bc57c5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:01.091868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a6d7e31-ebef-45a4-a247-970169bc57c5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:01.093081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a6d7e31-ebef-45a4-a247-970169bc57c5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:01.094724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a6d7e31-ebef-45a4-a247-970169bc57c5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:01.095910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a6d7e31-ebef-45a4-a247-970169bc57c5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:01.097869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a6d7e31-ebef-45a4-a247-970169bc57c5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:01.367229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0a6d7e31-ebef-45a4-a247-970169bc57c5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:01.378397 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0a6d7e31-ebef-45a4-a247-970169bc57c5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b" status: 200 len: 1494 microversion: 2.1 time: 0.318938 Aug 24 10:17:01.382678 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 685/1286] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:01 2022] GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b => generated 1494 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:01.489620 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5f711f2a-cbac-428f-af91-78827ca39a1d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1863711698", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:01.566703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-5f711f2a-cbac-428f-af91-78827ca39a1d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:17:01.873229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-5f711f2a-cbac-428f-af91-78827ca39a1d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:17:01.873859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-5f711f2a-cbac-428f-af91-78827ca39a1d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:17:01.875098 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-5f711f2a-cbac-428f-af91-78827ca39a1d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:17:01.875585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-5f711f2a-cbac-428f-af91-78827ca39a1d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:17:01.876072 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-5f711f2a-cbac-428f-af91-78827ca39a1d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:17:01.888260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f711f2a-cbac-428f-af91-78827ca39a1d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:01.889740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f711f2a-cbac-428f-af91-78827ca39a1d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:01.890415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f711f2a-cbac-428f-af91-78827ca39a1d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:01.891559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f711f2a-cbac-428f-af91-78827ca39a1d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:01.892073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f711f2a-cbac-428f-af91-78827ca39a1d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:01.892693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f711f2a-cbac-428f-af91-78827ca39a1d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:01.917979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-5f711f2a-cbac-428f-af91-78827ca39a1d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Getting quotas for project 7947a063a37946b7870e95dfd7a2e7e6. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:01.929255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-5f711f2a-cbac-428f-af91-78827ca39a1d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Getting quotas for user 53af167c0c744cbb910ff5860767cb95 and project 7947a063a37946b7870e95dfd7a2e7e6. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:01.946526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5f711f2a-cbac-428f-af91-78827ca39a1d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:17:01.950879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5f711f2a-cbac-428f-af91-78827ca39a1d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:17:02.020456 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5f711f2a-cbac-428f-af91-78827ca39a1d tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.636286 Aug 24 10:17:02.022202 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 686/1287] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:17:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:17:02.028353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-533d3de0-6c04-45a6-962c-f6cd54debc90 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:02.037042 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-533d3de0-6c04-45a6-962c-f6cd54debc90 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Searching by: {'tenant_id': '421a1a42a4f9443c849d62a3931f33ae', 'deleted': False} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:17:02.050906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-533d3de0-6c04-45a6-962c-f6cd54debc90 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:02.052890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-533d3de0-6c04-45a6-962c-f6cd54debc90 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:02.054817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-533d3de0-6c04-45a6-962c-f6cd54debc90 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:02.055966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-533d3de0-6c04-45a6-962c-f6cd54debc90 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:02.057139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-533d3de0-6c04-45a6-962c-f6cd54debc90 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:02.057800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-533d3de0-6c04-45a6-962c-f6cd54debc90 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:02.072153 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5101edc4-a231-45bf-940b-f8f42dae4940 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "DELETE /compute/v2.1/os-floating-ips/4fb4921e-b99a-44c8-a3d5-1d0e8e20c4bf" status: 202 len: 0 microversion: 2.1 time: 1.604706 Aug 24 10:17:02.075874 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 602/1288] 10.222.0.85 () {58 vars in 1263 bytes} [Wed Aug 24 10:17:00 2022] DELETE /compute/v2.1/os-floating-ips/4fb4921e-b99a-44c8-a3d5-1d0e8e20c4bf => generated 0 bytes in 1607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:17:02.084979 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-715d75b4-7716-427f-9566-2bc91cb0675d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1653763029", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "b3bbedfb-51dc-4363-a78d-44d0daaa6110"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:02.099255 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-533d3de0-6c04-45a6-962c-f6cd54debc90 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=421a1a42a4f9443c849d62a3931f33ae" status: 200 len: 15 microversion: 2.1 time: 0.075911 Aug 24 10:17:02.100063 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 687/1289] 10.222.0.85 () {58 vars in 1257 bytes} [Wed Aug 24 10:17:02 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=421a1a42a4f9443c849d62a3931f33ae => generated 15 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:17:02.120234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e8ea7010-1805-45a1-82a5-28482a4b50a4 tempest-FloatingIPsTestJSON-1363172196 tempest-FloatingIPsTestJSON-1363172196-project] Calling method '.version_select at 0x7f4654eec430>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:02.216662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-715d75b4-7716-427f-9566-2bc91cb0675d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] validate_networks() for [('b3bbedfb-51dc-4363-a78d-44d0daaa6110', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:17:03.045336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-715d75b4-7716-427f-9566-2bc91cb0675d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:17:03.046419 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-715d75b4-7716-427f-9566-2bc91cb0675d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:17:03.047682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-715d75b4-7716-427f-9566-2bc91cb0675d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:17:03.057065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-715d75b4-7716-427f-9566-2bc91cb0675d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:17:03.064598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-715d75b4-7716-427f-9566-2bc91cb0675d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:17:03.101991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-715d75b4-7716-427f-9566-2bc91cb0675d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:03.102742 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-715d75b4-7716-427f-9566-2bc91cb0675d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:03.102993 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-715d75b4-7716-427f-9566-2bc91cb0675d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:03.103845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-715d75b4-7716-427f-9566-2bc91cb0675d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:03.104311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-715d75b4-7716-427f-9566-2bc91cb0675d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:03.104744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-715d75b4-7716-427f-9566-2bc91cb0675d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:03.133979 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-715d75b4-7716-427f-9566-2bc91cb0675d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Getting quotas for project d30703728b2a4a569b6dd1608d8956b8. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:03.140341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-715d75b4-7716-427f-9566-2bc91cb0675d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Getting quotas for user 85db443623964ed381b2a4cfc7310202 and project d30703728b2a4a569b6dd1608d8956b8. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:03.155880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-715d75b4-7716-427f-9566-2bc91cb0675d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:17:03.157597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-715d75b4-7716-427f-9566-2bc91cb0675d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 1fd5ebf9-816f-442a-806d-4cf19678a3d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:17:03.275379 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-715d75b4-7716-427f-9566-2bc91cb0675d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.197614 Aug 24 10:17:03.276964 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 603/1290] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:17:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:17:03.285817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-15281f10-9d5d-4284-ab94-d6afa31eed93 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:03.290877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-15281f10-9d5d-4284-ab94-d6afa31eed93 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] [instance: 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:03.301573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15281f10-9d5d-4284-ab94-d6afa31eed93 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:03.302119 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15281f10-9d5d-4284-ab94-d6afa31eed93 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:03.302577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15281f10-9d5d-4284-ab94-d6afa31eed93 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:03.303292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15281f10-9d5d-4284-ab94-d6afa31eed93 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:03.305048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15281f10-9d5d-4284-ab94-d6afa31eed93 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:03.306054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15281f10-9d5d-4284-ab94-d6afa31eed93 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:03.659595 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-15281f10-9d5d-4284-ab94-d6afa31eed93 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b" status: 200 len: 1645 microversion: 2.1 time: 0.378131 Aug 24 10:17:03.661715 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 604/1291] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:03 2022] GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b => generated 1645 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:03.675272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5062ec54-911c-4588-a0a2-574e364eb80a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:03.676183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5062ec54-911c-4588-a0a2-574e364eb80a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:03.699828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5062ec54-911c-4588-a0a2-574e364eb80a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:03.701373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5062ec54-911c-4588-a0a2-574e364eb80a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:03.701822 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5062ec54-911c-4588-a0a2-574e364eb80a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:03.702281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5062ec54-911c-4588-a0a2-574e364eb80a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:03.704785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5062ec54-911c-4588-a0a2-574e364eb80a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:03.706565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5062ec54-911c-4588-a0a2-574e364eb80a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:03.964303 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5062ec54-911c-4588-a0a2-574e364eb80a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:03.974688 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5062ec54-911c-4588-a0a2-574e364eb80a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1273 microversion: 2.1 time: 0.311537 Aug 24 10:17:03.975293 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 605/1292] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:03 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1273 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:03.986215 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1f2b49f3-1352-4beb-a3e0-8c5b3c903ad6 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.0.226"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:04.005689 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e8ea7010-1805-45a1-82a5-28482a4b50a4 tempest-FloatingIPsTestJSON-1363172196 tempest-FloatingIPsTestJSON-1363172196-project] 10.222.0.85 "DELETE /compute/v2.1/os-floating-ips/34070cff-1ed2-4b96-b355-81c745c34818" status: 202 len: 0 microversion: 2.1 time: 1.895594 Aug 24 10:17:04.006946 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 688/1293] 10.222.0.85 () {58 vars in 1263 bytes} [Wed Aug 24 10:17:02 2022] DELETE /compute/v2.1/os-floating-ips/34070cff-1ed2-4b96-b355-81c745c34818 => generated 0 bytes in 1906 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:17:04.012711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6eecb832-1543-4ee0-a521-99190c460e6d tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:04.026831 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6eecb832-1543-4ee0-a521-99190c460e6d tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.018595 Aug 24 10:17:04.028024 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 689/1294] 10.222.0.85 () {58 vars in 1189 bytes} [Wed Aug 24 10:17:04 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:17:04.037192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3739a1e-7d56-4f04-8432-ae17fc34762f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:04.050323 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d3739a1e-7d56-4f04-8432-ae17fc34762f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 1fd5ebf9-816f-442a-806d-4cf19678a3d2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:04.197493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d3739a1e-7d56-4f04-8432-ae17fc34762f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:04.227516 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d3739a1e-7d56-4f04-8432-ae17fc34762f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2" status: 200 len: 1208 microversion: 2.1 time: 0.194441 Aug 24 10:17:04.228540 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 690/1295] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:04 2022] GET /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2 => generated 1208 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:04.234020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fdb7ee3e-b65e-4cea-b180-c7d34d7ea8ee tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:04.234846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fdb7ee3e-b65e-4cea-b180-c7d34d7ea8ee tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] [instance: 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:04.241644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdb7ee3e-b65e-4cea-b180-c7d34d7ea8ee tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:04.242345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdb7ee3e-b65e-4cea-b180-c7d34d7ea8ee tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:04.242950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdb7ee3e-b65e-4cea-b180-c7d34d7ea8ee tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:04.243821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdb7ee3e-b65e-4cea-b180-c7d34d7ea8ee tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:04.244434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdb7ee3e-b65e-4cea-b180-c7d34d7ea8ee tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:04.245020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdb7ee3e-b65e-4cea-b180-c7d34d7ea8ee tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:04.427385 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fdb7ee3e-b65e-4cea-b180-c7d34d7ea8ee tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b" status: 200 len: 1645 microversion: 2.1 time: 0.197377 Aug 24 10:17:04.428479 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 691/1296] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:04 2022] GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b => generated 1645 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:04.434995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-33f2385e-b0d0-455b-be9d-72cfa647b5cc tempest-FloatingIPsTestJSON-1363172196 tempest-FloatingIPsTestJSON-1363172196-project] Calling method '.version_select at 0x7f4654e7b790>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:04.486905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG neutronclient.v2_0.client [None req-33f2385e-b0d0-455b-be9d-72cfa647b5cc tempest-FloatingIPsTestJSON-1363172196 tempest-FloatingIPsTestJSON-1363172196-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 34070cff-1ed2-4b96-b355-81c745c34818 could not be found", "detail": ""}} {{(pid=122433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 10:17:04.498048 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-33f2385e-b0d0-455b-be9d-72cfa647b5cc tempest-FloatingIPsTestJSON-1363172196 tempest-FloatingIPsTestJSON-1363172196-project] HTTP exception thrown: Floating IP not found for ID 34070cff-1ed2-4b96-b355-81c745c34818 Aug 24 10:17:04.501861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-33f2385e-b0d0-455b-be9d-72cfa647b5cc tempest-FloatingIPsTestJSON-1363172196 tempest-FloatingIPsTestJSON-1363172196-project] Request method failure captured: Aug 24 10:17:04.501861 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-floating-ips/34070cff-1ed2-4b96-b355-81c745c34818 HTTP/1.1 Aug 24 10:17:04.501861 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:17:04.501861 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:17:04.501861 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:17:04.501861 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:17:04.501861 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:17:04.501861 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:17:04.501861 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:17:04.501861 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:17:04.501861 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfqKY7HY7Pbq0yxLBWQYNGKm9mVZLPdqZ3uCsU4s4k0uVUbzqcbAhsnol4b9bdrlujtrruj-4Y-R16-SwQOSlWCFlID4CMOWJux96Db0jQEMrzD8CfphGFT-8mxHpUcD6iHU8lsbdYKxhu87ISxQ8ADkz0ur-3GDwovQE_TIKv6dLQc Aug 24 10:17:04.501861 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:17:04.501861 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:17:04.501861 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:17:04.501861 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:17:04.501861 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:17:04.501861 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:17:04.501861 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 8cb27aef1af2431da876a4940edcd89a Aug 24 10:17:04.501861 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-FloatingIPsTestJSON-1363172196 Aug 24 10:17:04.501861 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:17:04.501861 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:17:04.503501 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8cb27aef1af2431da876a4940edcd89a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8cb27aef1af2431da876a4940edcd89a", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8cb27aef1af2431da876a4940edcd89a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8cb27aef1af2431da876a4940edcd89a"}]}] Aug 24 10:17:04.503501 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-FloatingIPsTestJSON-1363172196 Aug 24 10:17:04.503501 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 8cb27aef1af2431da876a4940edcd89a Aug 24 10:17:04.503501 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1363172196 Aug 24 10:17:04.503501 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-FloatingIPsTestJSON-1363172196-project Aug 24 10:17:04.503501 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:17:04.503501 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:17:04.503501 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 015651119f844f0c8eb6fdcce3865b0e Aug 24 10:17:04.503501 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-FloatingIPsTestJSON-1363172196-project Aug 24 10:17:04.503501 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:17:04.503501 n-d-849328-3 devstack@n-api.service[122433]: exception: Floating IP not found for ID 34070cff-1ed2-4b96-b355-81c745c34818 Aug 24 10:17:04.503501 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '34070cff-1ed2-4b96-b355-81c745c34818'} Aug 24 10:17:04.503501 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:17:04.504906 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:04.504906 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 24 10:17:04.504906 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 24 10:17:04.504906 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:17:04.504906 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:17:04.504906 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 24 10:17:04.504906 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 24 10:17:04.504906 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:17:04.504906 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:17:04.504906 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 10:17:04.504906 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 10:17:04.504906 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:17:04.504906 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:17:04.504906 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 10:17:04.504906 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 10:17:04.504906 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:17:04.504906 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:17:04.504906 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 10:17:04.504906 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 10:17:04.506684 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:17:04.506684 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:17:04.506684 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 10:17:04.506684 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 10:17:04.506684 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 10:17:04.506684 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 10:17:04.506684 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 34070cff-1ed2-4b96-b355-81c745c34818 could not be found Aug 24 10:17:04.506684 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7f2ed545-c078-4025-96e0-b443063da65f'] Aug 24 10:17:04.506684 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:04.506684 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:04.506684 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:04.506684 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:04.506684 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 24 10:17:04.506684 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 24 10:17:04.506684 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 24 10:17:04.506684 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 24 10:17:04.506684 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 34070cff-1ed2-4b96-b355-81c745c34818. Aug 24 10:17:04.506684 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:04.506684 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:04.506684 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:04.508422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:04.508422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:17:04.508422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:17:04.508422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:17:04.508422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:17:04.508422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:17:04.508422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:17:04.508422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:17:04.508422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:17:04.508422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 24 10:17:04.508422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 10:17:04.508422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 34070cff-1ed2-4b96-b355-81c745c34818 Aug 24 10:17:04.508422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:04.508422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:04.508422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:04.508422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:04.508422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:17:04.508422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:17:04.508422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:17:04.508422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:17:04.509926 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 34070cff-1ed2-4b96-b355-81c745c34818 Aug 24 10:17:04.509926 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:04.520742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-33f2385e-b0d0-455b-be9d-72cfa647b5cc tempest-FloatingIPsTestJSON-1363172196 tempest-FloatingIPsTestJSON-1363172196-project] Returning 404 to user: Floating IP not found for ID 34070cff-1ed2-4b96-b355-81c745c34818 {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:17:04.521818 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-33f2385e-b0d0-455b-be9d-72cfa647b5cc tempest-FloatingIPsTestJSON-1363172196 tempest-FloatingIPsTestJSON-1363172196-project] 10.222.0.85 "GET /compute/v2.1/os-floating-ips/34070cff-1ed2-4b96-b355-81c745c34818" status: 404 len: 111 microversion: 2.1 time: 0.092115 Aug 24 10:17:04.522878 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 692/1297] 10.222.0.85 () {58 vars in 1260 bytes} [Wed Aug 24 10:17:04 2022] GET /compute/v2.1/os-floating-ips/34070cff-1ed2-4b96-b355-81c745c34818 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:17:04.529150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ad073fb0-d79a-4390-86f8-6efd1424975c tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:04.531721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ad073fb0-d79a-4390-86f8-6efd1424975c tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:04.539804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad073fb0-d79a-4390-86f8-6efd1424975c tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:04.540858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad073fb0-d79a-4390-86f8-6efd1424975c tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:04.541475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad073fb0-d79a-4390-86f8-6efd1424975c tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:04.542344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad073fb0-d79a-4390-86f8-6efd1424975c tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:04.542955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad073fb0-d79a-4390-86f8-6efd1424975c tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:04.543544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad073fb0-d79a-4390-86f8-6efd1424975c tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:04.605784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1f2b49f3-1352-4beb-a3e0-8c5b3c903ad6 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:04.613053 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f2b49f3-1352-4beb-a3e0-8c5b3c903ad6 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:04.613669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f2b49f3-1352-4beb-a3e0-8c5b3c903ad6 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:04.614104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f2b49f3-1352-4beb-a3e0-8c5b3c903ad6 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:04.614807 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f2b49f3-1352-4beb-a3e0-8c5b3c903ad6 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:04.616460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f2b49f3-1352-4beb-a3e0-8c5b3c903ad6 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:04.616928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f2b49f3-1352-4beb-a3e0-8c5b3c903ad6 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:04.649204 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ad073fb0-d79a-4390-86f8-6efd1424975c tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1/action" status: 202 len: 0 microversion: 2.1 time: 0.124822 Aug 24 10:17:04.650604 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 693/1298] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:17:04 2022] POST /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:17:04.659110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-922d7184-9512-4a1b-adea-83ce78410280 req-e5a2ba5a-f398-4564-92e3-8b30b8671254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1ebe6bd-b2ae-45c2-8752-314356143de9", "name": "network-vif-deleted", "tag": "44b58631-8033-4518-911c-3c45f71ea4a5"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:04.671793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-922d7184-9512-4a1b-adea-83ce78410280 req-e5a2ba5a-f398-4564-92e3-8b30b8671254 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:04.672707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-922d7184-9512-4a1b-adea-83ce78410280 req-e5a2ba5a-f398-4564-92e3-8b30b8671254 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:04.673404 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-922d7184-9512-4a1b-adea-83ce78410280 req-e5a2ba5a-f398-4564-92e3-8b30b8671254 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:04.687639 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-922d7184-9512-4a1b-adea-83ce78410280 req-e5a2ba5a-f398-4564-92e3-8b30b8671254 service nova] Creating event network-vif-deleted:44b58631-8033-4518-911c-3c45f71ea4a5 for instance a1ebe6bd-b2ae-45c2-8752-314356143de9 on n-h1-849328-3 Aug 24 10:17:04.695083 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-922d7184-9512-4a1b-adea-83ce78410280 req-e5a2ba5a-f398-4564-92e3-8b30b8671254 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042416 Aug 24 10:17:04.700529 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 694/1299] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:04.707672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c09b7f0b-7231-4ceb-ac77-3ba024fa7ecc tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:04.711619 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:17:04.711619 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:17:04.714366 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c09b7f0b-7231-4ceb-ac77-3ba024fa7ecc tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:04.715302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c09b7f0b-7231-4ceb-ac77-3ba024fa7ecc tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:04.715970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c09b7f0b-7231-4ceb-ac77-3ba024fa7ecc tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:04.717234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c09b7f0b-7231-4ceb-ac77-3ba024fa7ecc tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:04.719508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c09b7f0b-7231-4ceb-ac77-3ba024fa7ecc tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:04.720181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c09b7f0b-7231-4ceb-ac77-3ba024fa7ecc tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:04.759108 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c09b7f0b-7231-4ceb-ac77-3ba024fa7ecc tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] 10.222.0.85 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.056617 Aug 24 10:17:04.760899 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 695/1300] 10.222.0.85 () {58 vars in 1176 bytes} [Wed Aug 24 10:17:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:04.766581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eba94f9c-d304-4f09-b339-b4ad5ce5fc39 tempest-FloatingIPsTestJSON-1363172196 tempest-FloatingIPsTestJSON-1363172196-project] Calling method '.version_select at 0x7f4654e1d790>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:04.825015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG neutronclient.v2_0.client [None req-eba94f9c-d304-4f09-b339-b4ad5ce5fc39 tempest-FloatingIPsTestJSON-1363172196 tempest-FloatingIPsTestJSON-1363172196-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 34070cff-1ed2-4b96-b355-81c745c34818 could not be found", "detail": ""}} {{(pid=122433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 10:17:04.827168 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-eba94f9c-d304-4f09-b339-b4ad5ce5fc39 tempest-FloatingIPsTestJSON-1363172196 tempest-FloatingIPsTestJSON-1363172196-project] HTTP exception thrown: Floating IP not found for ID 34070cff-1ed2-4b96-b355-81c745c34818 Aug 24 10:17:04.830215 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eba94f9c-d304-4f09-b339-b4ad5ce5fc39 tempest-FloatingIPsTestJSON-1363172196 tempest-FloatingIPsTestJSON-1363172196-project] Request method failure captured: Aug 24 10:17:04.830215 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-floating-ips/34070cff-1ed2-4b96-b355-81c745c34818 HTTP/1.1 Aug 24 10:17:04.830215 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:17:04.830215 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:17:04.830215 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:17:04.830215 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:17:04.830215 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:17:04.830215 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:17:04.830215 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:17:04.830215 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:17:04.830215 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfqKY7HY7Pbq0yxLBWQYNGKm9mVZLPdqZ3uCsU4s4k0uVUbzqcbAhsnol4b9bdrlujtrruj-4Y-R16-SwQOSlWCFlID4CMOWJux96Db0jQEMrzD8CfphGFT-8mxHpUcD6iHU8lsbdYKxhu87ISxQ8ADkz0ur-3GDwovQE_TIKv6dLQc Aug 24 10:17:04.830215 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:17:04.830215 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:17:04.830215 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:17:04.830215 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:17:04.830215 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:17:04.830215 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:17:04.830215 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 8cb27aef1af2431da876a4940edcd89a Aug 24 10:17:04.830215 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-FloatingIPsTestJSON-1363172196 Aug 24 10:17:04.830215 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:17:04.830215 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:17:04.831568 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8cb27aef1af2431da876a4940edcd89a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8cb27aef1af2431da876a4940edcd89a", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8cb27aef1af2431da876a4940edcd89a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8cb27aef1af2431da876a4940edcd89a"}]}] Aug 24 10:17:04.831568 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-FloatingIPsTestJSON-1363172196 Aug 24 10:17:04.831568 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 8cb27aef1af2431da876a4940edcd89a Aug 24 10:17:04.831568 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1363172196 Aug 24 10:17:04.831568 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-FloatingIPsTestJSON-1363172196-project Aug 24 10:17:04.831568 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:17:04.831568 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:17:04.831568 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 015651119f844f0c8eb6fdcce3865b0e Aug 24 10:17:04.831568 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-FloatingIPsTestJSON-1363172196-project Aug 24 10:17:04.831568 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:17:04.831568 n-d-849328-3 devstack@n-api.service[122433]: exception: Floating IP not found for ID 34070cff-1ed2-4b96-b355-81c745c34818 Aug 24 10:17:04.831568 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '34070cff-1ed2-4b96-b355-81c745c34818'} Aug 24 10:17:04.831568 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:17:04.832365 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:04.832365 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 24 10:17:04.832365 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 24 10:17:04.832365 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:17:04.832365 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:17:04.832365 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 24 10:17:04.832365 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 24 10:17:04.832365 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:17:04.832365 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:17:04.832365 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 10:17:04.832365 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 10:17:04.832365 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:17:04.832365 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:17:04.832365 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 10:17:04.832365 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 10:17:04.832365 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:17:04.832365 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:17:04.832365 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 10:17:04.832365 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 10:17:04.834247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:17:04.834247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:17:04.834247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 10:17:04.834247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 10:17:04.834247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 10:17:04.834247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 10:17:04.834247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 34070cff-1ed2-4b96-b355-81c745c34818 could not be found Aug 24 10:17:04.834247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd3dbbdb-33d6-4918-9b8f-0561c93aaac9'] Aug 24 10:17:04.834247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:04.834247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:04.834247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:04.834247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:04.834247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 24 10:17:04.834247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 24 10:17:04.834247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 24 10:17:04.834247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 24 10:17:04.834247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 34070cff-1ed2-4b96-b355-81c745c34818. Aug 24 10:17:04.834247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:04.834247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:04.834247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:04.835449 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:04.835449 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:17:04.835449 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:17:04.835449 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:17:04.835449 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:17:04.835449 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:17:04.835449 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:17:04.835449 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:17:04.835449 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:17:04.835449 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 24 10:17:04.835449 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 10:17:04.835449 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 34070cff-1ed2-4b96-b355-81c745c34818 Aug 24 10:17:04.835449 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:04.835449 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:04.835449 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:04.835449 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:04.835449 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:17:04.835449 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:17:04.835449 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:17:04.835449 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:17:04.836664 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 34070cff-1ed2-4b96-b355-81c745c34818 Aug 24 10:17:04.836664 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:04.838500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eba94f9c-d304-4f09-b339-b4ad5ce5fc39 tempest-FloatingIPsTestJSON-1363172196 tempest-FloatingIPsTestJSON-1363172196-project] Returning 404 to user: Floating IP not found for ID 34070cff-1ed2-4b96-b355-81c745c34818 {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:17:04.839578 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eba94f9c-d304-4f09-b339-b4ad5ce5fc39 tempest-FloatingIPsTestJSON-1363172196 tempest-FloatingIPsTestJSON-1363172196-project] 10.222.0.85 "DELETE /compute/v2.1/os-floating-ips/34070cff-1ed2-4b96-b355-81c745c34818" status: 404 len: 111 microversion: 2.1 time: 0.077305 Aug 24 10:17:04.840682 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 696/1301] 10.222.0.85 () {58 vars in 1263 bytes} [Wed Aug 24 10:17:04 2022] DELETE /compute/v2.1/os-floating-ips/34070cff-1ed2-4b96-b355-81c745c34818 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:17:04.846619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ce4eb2e5-02ac-48c7-90b2-38d68d6c27c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:04.855616 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ce4eb2e5-02ac-48c7-90b2-38d68d6c27c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:04.857939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ce4eb2e5-02ac-48c7-90b2-38d68d6c27c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:17:04.870183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce4eb2e5-02ac-48c7-90b2-38d68d6c27c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:04.871077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce4eb2e5-02ac-48c7-90b2-38d68d6c27c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:04.871793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce4eb2e5-02ac-48c7-90b2-38d68d6c27c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:04.872788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce4eb2e5-02ac-48c7-90b2-38d68d6c27c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:04.873543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce4eb2e5-02ac-48c7-90b2-38d68d6c27c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:04.874314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce4eb2e5-02ac-48c7-90b2-38d68d6c27c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:05.011935 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-ce4eb2e5-02ac-48c7-90b2-38d68d6c27c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:17:05.088239 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ce4eb2e5-02ac-48c7-90b2-38d68d6c27c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.246139 Aug 24 10:17:05.089426 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 697/1302] 10.222.0.85 () {58 vars in 1150 bytes} [Wed Aug 24 10:17:04 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:05.094653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b8a38b3d-e69c-430c-876f-0c377b88394e tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:05.095714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b8a38b3d-e69c-430c-876f-0c377b88394e tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] [instance: 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:05.110642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8a38b3d-e69c-430c-876f-0c377b88394e tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:05.112197 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8a38b3d-e69c-430c-876f-0c377b88394e tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:05.113890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8a38b3d-e69c-430c-876f-0c377b88394e tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:05.117235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8a38b3d-e69c-430c-876f-0c377b88394e tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:05.117942 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8a38b3d-e69c-430c-876f-0c377b88394e tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:05.119498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8a38b3d-e69c-430c-876f-0c377b88394e tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:05.153205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f2b49f3-1352-4beb-a3e0-8c5b3c903ad6 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "refresh_cache-86d0b20c-a790-4b41-a823-2a79532df7ff" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 10:17:05.154002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f2b49f3-1352-4beb-a3e0-8c5b3c903ad6 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquired lock "refresh_cache-86d0b20c-a790-4b41-a823-2a79532df7ff" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 10:17:05.250031 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b8a38b3d-e69c-430c-876f-0c377b88394e tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b/action" status: 202 len: 0 microversion: 2.1 time: 0.152420 Aug 24 10:17:05.257596 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 698/1303] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:17:05 2022] POST /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:17:05.264389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fdb79ddd-db4c-48e1-96e2-8a7e7f0546a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:05.265534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fdb79ddd-db4c-48e1-96e2-8a7e7f0546a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:05.273910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdb79ddd-db4c-48e1-96e2-8a7e7f0546a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:05.274607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdb79ddd-db4c-48e1-96e2-8a7e7f0546a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:05.275275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdb79ddd-db4c-48e1-96e2-8a7e7f0546a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:05.276135 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdb79ddd-db4c-48e1-96e2-8a7e7f0546a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:05.276597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdb79ddd-db4c-48e1-96e2-8a7e7f0546a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:05.277011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdb79ddd-db4c-48e1-96e2-8a7e7f0546a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:05.774791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fdb79ddd-db4c-48e1-96e2-8a7e7f0546a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:05.791443 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fdb79ddd-db4c-48e1-96e2-8a7e7f0546a5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1271 microversion: 2.1 time: 0.535946 Aug 24 10:17:05.801172 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 699/1304] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:05 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1271 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:05.801172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bc7aaa76-4c0f-4e45-a476-6d02e9f953dd tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:05.803522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bc7aaa76-4c0f-4e45-a476-6d02e9f953dd tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:05.814723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc7aaa76-4c0f-4e45-a476-6d02e9f953dd tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:05.815256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc7aaa76-4c0f-4e45-a476-6d02e9f953dd tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:05.816440 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc7aaa76-4c0f-4e45-a476-6d02e9f953dd tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:05.818050 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc7aaa76-4c0f-4e45-a476-6d02e9f953dd tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:05.818685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc7aaa76-4c0f-4e45-a476-6d02e9f953dd tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:05.819260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc7aaa76-4c0f-4e45-a476-6d02e9f953dd tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:05.966877 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bc7aaa76-4c0f-4e45-a476-6d02e9f953dd tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1/action" status: 202 len: 0 microversion: 2.1 time: 0.172614 Aug 24 10:17:05.968268 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 700/1305] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:17:05 2022] POST /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:17:05.980288 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-71c98c0f-cbff-4500-8893-c81b74801c8c tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:05.980906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-71c98c0f-cbff-4500-8893-c81b74801c8c tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 1fd5ebf9-816f-442a-806d-4cf19678a3d2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:06.005858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:06.011260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71c98c0f-cbff-4500-8893-c81b74801c8c tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:06.011586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71c98c0f-cbff-4500-8893-c81b74801c8c tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:06.016050 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71c98c0f-cbff-4500-8893-c81b74801c8c tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:06.018072 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71c98c0f-cbff-4500-8893-c81b74801c8c tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:06.019515 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71c98c0f-cbff-4500-8893-c81b74801c8c tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:06.024704 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71c98c0f-cbff-4500-8893-c81b74801c8c tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:06.194612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-71c98c0f-cbff-4500-8893-c81b74801c8c tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:06.210651 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-71c98c0f-cbff-4500-8893-c81b74801c8c tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2" status: 200 len: 1266 microversion: 2.1 time: 0.240982 Aug 24 10:17:06.225308 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 701/1306] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:05 2022] GET /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2 => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:06.230136 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b4b17a25-347e-48ea-b6dd-38beb95d64c5 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:06.230756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b4b17a25-347e-48ea-b6dd-38beb95d64c5 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] [instance: 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:06.238805 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4b17a25-347e-48ea-b6dd-38beb95d64c5 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:06.239322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4b17a25-347e-48ea-b6dd-38beb95d64c5 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:06.239767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4b17a25-347e-48ea-b6dd-38beb95d64c5 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:06.240778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4b17a25-347e-48ea-b6dd-38beb95d64c5 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:06.243732 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4b17a25-347e-48ea-b6dd-38beb95d64c5 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:06.244435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4b17a25-347e-48ea-b6dd-38beb95d64c5 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:07.177340 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b4b17a25-347e-48ea-b6dd-38beb95d64c5 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b" status: 200 len: 1630 microversion: 2.1 time: 0.950355 Aug 24 10:17:07.193851 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 702/1307] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:06 2022] GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b => generated 1630 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:07.226748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-61aa71d5-ef17-493c-b6dd-b40145952534 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:07.232537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-61aa71d5-ef17-493c-b6dd-b40145952534 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:07.264266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61aa71d5-ef17-493c-b6dd-b40145952534 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:07.265682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61aa71d5-ef17-493c-b6dd-b40145952534 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:07.271027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61aa71d5-ef17-493c-b6dd-b40145952534 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:07.275159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61aa71d5-ef17-493c-b6dd-b40145952534 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:07.282538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61aa71d5-ef17-493c-b6dd-b40145952534 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:07.283727 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61aa71d5-ef17-493c-b6dd-b40145952534 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:07.296030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:07.560204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-1f2b49f3-1352-4beb-a3e0-8c5b3c903ad6 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Building network info cache for instance {{(pid=122432) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 10:17:07.798914 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-61aa71d5-ef17-493c-b6dd-b40145952534 tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1613 microversion: 2.1 time: 0.602740 Aug 24 10:17:07.800191 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 703/1308] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:07 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1613 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:07.818670 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0995e142-07a0-4492-a92d-1752a40550c5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1966548906", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "68027218-9cf0-4391-8ca9-11006ba08a7a"}], "block_device_mapping_v2": [{"uuid": "9ef02df3-957d-4d20-9a8b-da30c5e54a39", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:07.929670 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-0995e142-07a0-4492-a92d-1752a40550c5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] validate_networks() for [('68027218-9cf0-4391-8ca9-11006ba08a7a', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:17:08.623319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0995e142-07a0-4492-a92d-1752a40550c5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:17:08.624809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0995e142-07a0-4492-a92d-1752a40550c5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:17:08.625696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0995e142-07a0-4492-a92d-1752a40550c5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:17:08.626407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0995e142-07a0-4492-a92d-1752a40550c5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:17:08.627362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0995e142-07a0-4492-a92d-1752a40550c5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:17:08.643636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0995e142-07a0-4492-a92d-1752a40550c5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:08.645140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0995e142-07a0-4492-a92d-1752a40550c5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:08.646431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0995e142-07a0-4492-a92d-1752a40550c5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:08.647694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0995e142-07a0-4492-a92d-1752a40550c5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:08.648704 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0995e142-07a0-4492-a92d-1752a40550c5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:08.665396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0995e142-07a0-4492-a92d-1752a40550c5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:08.728819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-0995e142-07a0-4492-a92d-1752a40550c5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Getting quotas for project 34b2b8fc487d4a6abb08f132e0f0c1da. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:08.750872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-0995e142-07a0-4492-a92d-1752a40550c5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Getting quotas for user dfd26847179f4f2bab0c9f673de0c303 and project 34b2b8fc487d4a6abb08f132e0f0c1da. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:08.885182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0995e142-07a0-4492-a92d-1752a40550c5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:17:08.888023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0995e142-07a0-4492-a92d-1752a40550c5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9ef02df3-957d-4d20-9a8b-da30c5e54a39',volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:17:09.284822 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0995e142-07a0-4492-a92d-1752a40550c5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.482979 Aug 24 10:17:09.285926 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 704/1309] 10.222.0.85 () {62 vars in 1188 bytes} [Wed Aug 24 10:17:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1485 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 10:17:09.306254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cbf2c19d-3770-404f-85c1-a7b7d273f6a3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:09.306914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cbf2c19d-3770-404f-85c1-a7b7d273f6a3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:09.324383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbf2c19d-3770-404f-85c1-a7b7d273f6a3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:09.326288 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbf2c19d-3770-404f-85c1-a7b7d273f6a3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:09.340069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbf2c19d-3770-404f-85c1-a7b7d273f6a3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:09.347759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbf2c19d-3770-404f-85c1-a7b7d273f6a3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:09.348928 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbf2c19d-3770-404f-85c1-a7b7d273f6a3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:09.350137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbf2c19d-3770-404f-85c1-a7b7d273f6a3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:10.029881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-1f2b49f3-1352-4beb-a3e0-8c5b3c903ad6 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Updating instance_info_cache with network_info: [{"id": "ee530f9b-86a7-47a7-bef8-49f2a0946b85", "address": "fa:16:3e:39:8a:82", "network": {"id": "620680d4-be9b-4509-ae46-5fb73d45beed", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-310865075-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1ef1a2f8a03d4395903df62f152212d9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapee530f9b-86", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122432) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 10:17:10.057150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f2b49f3-1352-4beb-a3e0-8c5b3c903ad6 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Releasing lock "refresh_cache-86d0b20c-a790-4b41-a823-2a79532df7ff" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 10:17:10.066198 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1f2b49f3-1352-4beb-a3e0-8c5b3c903ad6 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "POST /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff/action" status: 202 len: 0 microversion: 2.1 time: 6.089492 Aug 24 10:17:10.067499 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 606/1310] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:17:03 2022] POST /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff/action => generated 0 bytes in 6091 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 24 10:17:10.079085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1ed20b88-27c6-4ee2-80e5-9f7e5588b2c0 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-849328-3", "block_migration": true, "disk_over_commit": false}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:10.083125 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1ed20b88-27c6-4ee2-80e5-9f7e5588b2c0 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] [instance: 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:10.104366 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ed20b88-27c6-4ee2-80e5-9f7e5588b2c0 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:10.105351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ed20b88-27c6-4ee2-80e5-9f7e5588b2c0 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:10.105958 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ed20b88-27c6-4ee2-80e5-9f7e5588b2c0 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:10.107025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ed20b88-27c6-4ee2-80e5-9f7e5588b2c0 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:10.107796 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ed20b88-27c6-4ee2-80e5-9f7e5588b2c0 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:10.108463 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ed20b88-27c6-4ee2-80e5-9f7e5588b2c0 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:10.165465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cbf2c19d-3770-404f-85c1-a7b7d273f6a3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:10.170712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-1ed20b88-27c6-4ee2-80e5-9f7e5588b2c0 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lazy-loading 'flavor' on Instance uuid 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:17:10.180888 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cbf2c19d-3770-404f-85c1-a7b7d273f6a3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1313 microversion: 2.1 time: 0.889415 Aug 24 10:17:10.181580 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 705/1311] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:09 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1313 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:10.209613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1a2cc522-e910-4539-bdbb-1d78f36142fa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:10.213940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1ed20b88-27c6-4ee2-80e5-9f7e5588b2c0 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] [instance: 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b] Going to try to live migrate instance to n-h2-849328-3 {{(pid=122432) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 10:17:10.214789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1a2cc522-e910-4539-bdbb-1d78f36142fa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 1fd5ebf9-816f-442a-806d-4cf19678a3d2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:10.239084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a2cc522-e910-4539-bdbb-1d78f36142fa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:10.240412 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a2cc522-e910-4539-bdbb-1d78f36142fa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:10.243424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a2cc522-e910-4539-bdbb-1d78f36142fa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:10.244395 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a2cc522-e910-4539-bdbb-1d78f36142fa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:10.244923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a2cc522-e910-4539-bdbb-1d78f36142fa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:10.245399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a2cc522-e910-4539-bdbb-1d78f36142fa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:10.527696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1a2cc522-e910-4539-bdbb-1d78f36142fa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:10.539236 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1a2cc522-e910-4539-bdbb-1d78f36142fa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2" status: 200 len: 1308 microversion: 2.1 time: 0.356531 Aug 24 10:17:10.549504 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 706/1312] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:10 2022] GET /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2 => generated 1308 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:10.565632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f623bf29-7d21-4e57-bffc-32204e90448d tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:10.566680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f623bf29-7d21-4e57-bffc-32204e90448d tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:10.580341 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f623bf29-7d21-4e57-bffc-32204e90448d tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:10.580836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f623bf29-7d21-4e57-bffc-32204e90448d tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:10.585043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f623bf29-7d21-4e57-bffc-32204e90448d tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:10.585988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f623bf29-7d21-4e57-bffc-32204e90448d tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:10.586749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f623bf29-7d21-4e57-bffc-32204e90448d tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:10.587068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f623bf29-7d21-4e57-bffc-32204e90448d tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:11.572751 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f623bf29-7d21-4e57-bffc-32204e90448d tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1613 microversion: 2.1 time: 1.021189 Aug 24 10:17:11.586352 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 707/1313] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:10 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1613 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:11.603773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-6dc9ea73-e9b6-47ab-8ddb-28a99a554d84 req-5e57abb3-9a13-475e-a83f-fb3abb9e64b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86d0b20c-a790-4b41-a823-2a79532df7ff", "tag": "ee530f9b-86a7-47a7-bef8-49f2a0946b85"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:11.632968 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6dc9ea73-e9b6-47ab-8ddb-28a99a554d84 req-5e57abb3-9a13-475e-a83f-fb3abb9e64b2 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:11.634166 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6dc9ea73-e9b6-47ab-8ddb-28a99a554d84 req-5e57abb3-9a13-475e-a83f-fb3abb9e64b2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:11.635168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6dc9ea73-e9b6-47ab-8ddb-28a99a554d84 req-5e57abb3-9a13-475e-a83f-fb3abb9e64b2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:11.653780 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-6dc9ea73-e9b6-47ab-8ddb-28a99a554d84 req-5e57abb3-9a13-475e-a83f-fb3abb9e64b2 service nova] Creating event network-changed:ee530f9b-86a7-47a7-bef8-49f2a0946b85 for instance 86d0b20c-a790-4b41-a823-2a79532df7ff on n-h1-849328-3 Aug 24 10:17:11.668844 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-6dc9ea73-e9b6-47ab-8ddb-28a99a554d84 req-5e57abb3-9a13-475e-a83f-fb3abb9e64b2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080919 Aug 24 10:17:11.670269 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 708/1314] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:11.677915 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-52fad5b0-a251-4f22-b130-ad95183eb84f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:11.678998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-52fad5b0-a251-4f22-b130-ad95183eb84f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:11.687625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52fad5b0-a251-4f22-b130-ad95183eb84f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:11.688459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52fad5b0-a251-4f22-b130-ad95183eb84f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:11.689174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52fad5b0-a251-4f22-b130-ad95183eb84f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:11.690228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52fad5b0-a251-4f22-b130-ad95183eb84f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:11.691044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52fad5b0-a251-4f22-b130-ad95183eb84f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:11.692045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52fad5b0-a251-4f22-b130-ad95183eb84f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:11.907910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-52fad5b0-a251-4f22-b130-ad95183eb84f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:11.928490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-52fad5b0-a251-4f22-b130-ad95183eb84f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:11.931526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-52fad5b0-a251-4f22-b130-ad95183eb84f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:11.934528 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-52fad5b0-a251-4f22-b130-ad95183eb84f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1251 microversion: 2.25 time: 0.262807 Aug 24 10:17:11.936344 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 709/1315] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:17:11 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1251 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:17:11.958531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-21eba00d-1e9e-49a9-860c-03a972ebe054 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Calling method '.version_select at 0x7f4654e39790>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:12.868688 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1ed20b88-27c6-4ee2-80e5-9f7e5588b2c0 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b/action" status: 202 len: 0 microversion: 2.1 time: 2.798809 Aug 24 10:17:12.873272 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 607/1316] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:17:10 2022] POST /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b/action => generated 0 bytes in 2805 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:17:12.880563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-edeb1d64-3fbc-498c-8342-eff918f2caf3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:12.881793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-edeb1d64-3fbc-498c-8342-eff918f2caf3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:12.890744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edeb1d64-3fbc-498c-8342-eff918f2caf3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:12.891694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edeb1d64-3fbc-498c-8342-eff918f2caf3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:12.892529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edeb1d64-3fbc-498c-8342-eff918f2caf3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:12.894391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edeb1d64-3fbc-498c-8342-eff918f2caf3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:12.895355 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edeb1d64-3fbc-498c-8342-eff918f2caf3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:12.896189 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edeb1d64-3fbc-498c-8342-eff918f2caf3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:13.128356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:13.149974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=10 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:13.337686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-edeb1d64-3fbc-498c-8342-eff918f2caf3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:13.351275 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-edeb1d64-3fbc-498c-8342-eff918f2caf3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1313 microversion: 2.1 time: 0.476495 Aug 24 10:17:13.352225 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 608/1317] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:12 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1313 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:13.373043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0fee8358-93e6-4331-bcbb-622c6d8c2caa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:13.373882 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0fee8358-93e6-4331-bcbb-622c6d8c2caa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 1fd5ebf9-816f-442a-806d-4cf19678a3d2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:13.389026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fee8358-93e6-4331-bcbb-622c6d8c2caa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:13.389909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fee8358-93e6-4331-bcbb-622c6d8c2caa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:13.390387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fee8358-93e6-4331-bcbb-622c6d8c2caa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:13.391274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fee8358-93e6-4331-bcbb-622c6d8c2caa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:13.394236 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fee8358-93e6-4331-bcbb-622c6d8c2caa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:13.399954 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fee8358-93e6-4331-bcbb-622c6d8c2caa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:13.990424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0fee8358-93e6-4331-bcbb-622c6d8c2caa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:14.024270 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0fee8358-93e6-4331-bcbb-622c6d8c2caa tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2" status: 200 len: 1308 microversion: 2.1 time: 0.670815 Aug 24 10:17:14.024895 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 609/1318] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:13 2022] GET /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2 => generated 1308 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:14.036933 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e8e3d87-676d-48ac-afb2-01d6d91f1c8c tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:14.055226 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6e8e3d87-676d-48ac-afb2-01d6d91f1c8c tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Searching by: {'host': 'n-h2-849328-3', 'deleted': False} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:17:14.075623 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e8e3d87-676d-48ac-afb2-01d6d91f1c8c tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:14.076119 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e8e3d87-676d-48ac-afb2-01d6d91f1c8c tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:14.076594 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e8e3d87-676d-48ac-afb2-01d6d91f1c8c tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:14.077376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e8e3d87-676d-48ac-afb2-01d6d91f1c8c tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:14.077831 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e8e3d87-676d-48ac-afb2-01d6d91f1c8c tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:14.078262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e8e3d87-676d-48ac-afb2-01d6d91f1c8c tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:14.234857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:14.434230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-6e8e3d87-676d-48ac-afb2-01d6d91f1c8c tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:17:14.616944 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6e8e3d87-676d-48ac-afb2-01d6d91f1c8c tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] 10.222.0.85 "GET /compute/v2.1/servers?host=n-h2-849328-3&all_tenants=1" status: 200 len: 2636 microversion: 2.1 time: 0.590545 Aug 24 10:17:14.617973 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 610/1319] 10.222.0.85 () {58 vars in 1190 bytes} [Wed Aug 24 10:17:14 2022] GET /compute/v2.1/servers?host=n-h2-849328-3&all_tenants=1 => generated 2636 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:14.626937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dc745842-e24f-4fc3-b5f9-847bccd30c8a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:14.627854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dc745842-e24f-4fc3-b5f9-847bccd30c8a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:14.639263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc745842-e24f-4fc3-b5f9-847bccd30c8a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:14.640026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc745842-e24f-4fc3-b5f9-847bccd30c8a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:14.641726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc745842-e24f-4fc3-b5f9-847bccd30c8a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:14.642667 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc745842-e24f-4fc3-b5f9-847bccd30c8a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:14.643327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc745842-e24f-4fc3-b5f9-847bccd30c8a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:14.644104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc745842-e24f-4fc3-b5f9-847bccd30c8a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:14.799520 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-21eba00d-1e9e-49a9-860c-03a972ebe054 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "DELETE /compute/v2.1/os-floating-ips/bd23bfc3-d7e2-45a3-b51c-6d4a9e76587f" status: 202 len: 0 microversion: 2.1 time: 2.859186 Aug 24 10:17:14.800303 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 710/1320] 10.222.0.85 () {58 vars in 1263 bytes} [Wed Aug 24 10:17:11 2022] DELETE /compute/v2.1/os-floating-ips/bd23bfc3-d7e2-45a3-b51c-6d4a9e76587f => generated 0 bytes in 2861 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:17:14.807103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9e5759e3-01b5-4535-aab7-cd810ddd92ef tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:14.808113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9e5759e3-01b5-4535-aab7-cd810ddd92ef tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:14.825943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e5759e3-01b5-4535-aab7-cd810ddd92ef tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:14.827286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e5759e3-01b5-4535-aab7-cd810ddd92ef tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:14.827746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e5759e3-01b5-4535-aab7-cd810ddd92ef tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:14.828490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e5759e3-01b5-4535-aab7-cd810ddd92ef tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:14.831521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e5759e3-01b5-4535-aab7-cd810ddd92ef tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:14.834082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e5759e3-01b5-4535-aab7-cd810ddd92ef tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:15.522052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9e5759e3-01b5-4535-aab7-cd810ddd92ef tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:15.543577 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9e5759e3-01b5-4535-aab7-cd810ddd92ef tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:15.548514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9e5759e3-01b5-4535-aab7-cd810ddd92ef tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:15.551033 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9e5759e3-01b5-4535-aab7-cd810ddd92ef tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1293 microversion: 2.25 time: 0.749521 Aug 24 10:17:15.554944 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 711/1321] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:17:14 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1293 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:17:15.571486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-befcc10a-cd1e-4054-b614-f7c15e8baefd req-8b09ab53-d4d7-4ba4-8c10-96f15adf6744 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f6451db-5c2a-422c-84ff-c13e81621a71", "tag": "7d183dba-e72f-4aa1-9c43-d620da8dd93b"}, {"name": "network-changed", "server_uuid": "1fd5ebf9-816f-442a-806d-4cf19678a3d2", "tag": "212e5fdb-8c9a-4d12-9b94-4e13e5984aa1"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:15.601915 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-befcc10a-cd1e-4054-b614-f7c15e8baefd req-8b09ab53-d4d7-4ba4-8c10-96f15adf6744 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:15.602964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-befcc10a-cd1e-4054-b614-f7c15e8baefd req-8b09ab53-d4d7-4ba4-8c10-96f15adf6744 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:15.603822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-befcc10a-cd1e-4054-b614-f7c15e8baefd req-8b09ab53-d4d7-4ba4-8c10-96f15adf6744 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:15.629329 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-befcc10a-cd1e-4054-b614-f7c15e8baefd req-8b09ab53-d4d7-4ba4-8c10-96f15adf6744 service nova] Creating event network-changed:7d183dba-e72f-4aa1-9c43-d620da8dd93b for instance 1f6451db-5c2a-422c-84ff-c13e81621a71 on n-h1-849328-3 Aug 24 10:17:15.630253 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-befcc10a-cd1e-4054-b614-f7c15e8baefd req-8b09ab53-d4d7-4ba4-8c10-96f15adf6744 service nova] Creating event network-changed:212e5fdb-8c9a-4d12-9b94-4e13e5984aa1 for instance 1fd5ebf9-816f-442a-806d-4cf19678a3d2 on n-h2-849328-3 Aug 24 10:17:15.643130 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-befcc10a-cd1e-4054-b614-f7c15e8baefd req-8b09ab53-d4d7-4ba4-8c10-96f15adf6744 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.083950 Aug 24 10:17:15.644248 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 712/1322] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:15.650546 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-367c019b-403c-40ba-9b10-7b616076ba4a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:15.652063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-367c019b-403c-40ba-9b10-7b616076ba4a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:15.677085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-367c019b-403c-40ba-9b10-7b616076ba4a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:15.678507 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-367c019b-403c-40ba-9b10-7b616076ba4a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:15.679250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-367c019b-403c-40ba-9b10-7b616076ba4a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:15.681388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-367c019b-403c-40ba-9b10-7b616076ba4a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:15.682135 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-367c019b-403c-40ba-9b10-7b616076ba4a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:15.682862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-367c019b-403c-40ba-9b10-7b616076ba4a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:16.159725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-367c019b-403c-40ba-9b10-7b616076ba4a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:16.173506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dc745842-e24f-4fc3-b5f9-847bccd30c8a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:16.178407 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-367c019b-403c-40ba-9b10-7b616076ba4a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1313 microversion: 2.1 time: 0.532103 Aug 24 10:17:16.185212 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 713/1323] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:15 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1313 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:16.187187 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dc745842-e24f-4fc3-b5f9-847bccd30c8a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b" status: 200 len: 1504 microversion: 2.1 time: 1.565177 Aug 24 10:17:16.188115 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 611/1324] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:14 2022] GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b => generated 1504 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:16.196128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4aede651-f8cd-405a-a50b-c75998f6192a tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:16.200936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-12ac4834-97ca-428f-8338-bfa3a0dcc0e8 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:16.205679 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-12ac4834-97ca-428f-8338-bfa3a0dcc0e8 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Request method failure captured: Aug 24 10:17:16.205679 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff/action HTTP/1.1 Aug 24 10:17:16.205679 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:17:16.205679 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:17:16.205679 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:17:16.205679 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 34 Aug 24 10:17:16.205679 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:17:16.205679 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:17:16.205679 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:17:16.205679 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:17:16.205679 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfplTgd7srch0OUV12_onq92hN1tE6n2OpjGQv0Xy_I9PkLJddgZf7HXwu_Qcr4mCdxDC2-4EDrRmUwhe7W25YzuijkLFDMzbaUPl60kcla86IsXOhleLVtVMjrf9fLUCcX_HaR2i9GigKM9hHrIp_UHZ7WtoK6u7tNK6sMjhvtZ5xY Aug 24 10:17:16.205679 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:17:16.205679 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:17:16.205679 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:17:16.205679 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:17:16.205679 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:17:16.205679 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:17:16.205679 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 1ef1a2f8a03d4395903df62f152212d9 Aug 24 10:17:16.205679 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 Aug 24 10:17:16.205679 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:17:16.205679 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:17:16.207959 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1ef1a2f8a03d4395903df62f152212d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_1ef1a2f8a03d4395903df62f152212d9", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1ef1a2f8a03d4395903df62f152212d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/1ef1a2f8a03d4395903df62f152212d9"}]}] Aug 24 10:17:16.207959 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 Aug 24 10:17:16.207959 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 1ef1a2f8a03d4395903df62f152212d9 Aug 24 10:17:16.207959 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 Aug 24 10:17:16.207959 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project Aug 24 10:17:16.207959 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:17:16.207959 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:17:16.207959 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: cb69265eac264f36acc9d04eb60a0449 Aug 24 10:17:16.207959 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project Aug 24 10:17:16.207959 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:17:16.207959 n-d-849328-3 devstack@n-api.service[122432]: {"addFloatingIp": {"address": ""}} Aug 24 10:17:16.207959 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:17:16.207959 n-d-849328-3 devstack@n-api.service[122432]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 24 10:17:16.209067 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '86d0b20c-a790-4b41-a823-2a79532df7ff', 'body': {'addFloatingIp': {'address': ''}}} Aug 24 10:17:16.209067 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:17:16.209067 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:16.209067 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:17:16.209067 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:17:16.209067 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:17:16.209067 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:17:16.209067 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 24 10:17:16.209067 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:17:16.209067 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 24 10:17:16.209067 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 24 10:17:16.209067 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:17:16.209067 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 24 10:17:16.209067 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi '' Aug 24 10:17:16.209067 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:17:16.209067 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:16.209067 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:17:16.209067 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:16.209067 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:17:16.209067 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:17:16.209067 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:17:16.209067 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:17:16.211774 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:17:16.211774 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:17:16.211774 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:17:16.211774 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:17:16.211774 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:17:16.211774 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:17:16.211774 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:17:16.211774 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:17:16.211774 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:17:16.211774 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:17:16.211774 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 24 10:17:16.211774 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:17:16.211774 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:16.211774 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:17:16.211774 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:16.211774 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:17:16.211774 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:17:16.211774 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:17:16.211774 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:17:16.214861 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 24 10:17:16.214861 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:17:16.214861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-12ac4834-97ca-428f-8338-bfa3a0dcc0e8 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:17:16.214861 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-12ac4834-97ca-428f-8338-bfa3a0dcc0e8 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "POST /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff/action" status: 400 len: 142 microversion: 2.1 time: 0.018305 Aug 24 10:17:16.225594 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 612/1325] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:17:16 2022] POST /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff/action => generated 142 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:17:16.230375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4aede651-f8cd-405a-a50b-c75998f6192a tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:17:16.231567 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c4537304-6218-4fc3-8cbc-ef140cb51ec4 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:16.232263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c4537304-6218-4fc3-8cbc-ef140cb51ec4 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 1fd5ebf9-816f-442a-806d-4cf19678a3d2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:16.253877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4aede651-f8cd-405a-a50b-c75998f6192a tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:16.258520 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4aede651-f8cd-405a-a50b-c75998f6192a tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:16.260308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4aede651-f8cd-405a-a50b-c75998f6192a tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:16.261221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4537304-6218-4fc3-8cbc-ef140cb51ec4 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:16.264802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4537304-6218-4fc3-8cbc-ef140cb51ec4 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:16.265542 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4537304-6218-4fc3-8cbc-ef140cb51ec4 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:16.266424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4aede651-f8cd-405a-a50b-c75998f6192a tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:16.266985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4aede651-f8cd-405a-a50b-c75998f6192a tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:16.267444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4aede651-f8cd-405a-a50b-c75998f6192a tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:16.268451 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4537304-6218-4fc3-8cbc-ef140cb51ec4 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:16.269593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4537304-6218-4fc3-8cbc-ef140cb51ec4 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:16.270394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4537304-6218-4fc3-8cbc-ef140cb51ec4 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:16.566363 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4aede651-f8cd-405a-a50b-c75998f6192a tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] 10.222.0.85 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.377165 Aug 24 10:17:16.568848 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 714/1326] 10.222.0.85 () {58 vars in 1196 bytes} [Wed Aug 24 10:17:16 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:17:16.586020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e85708b1-6c5f-44ba-af26-609ae683f617 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:16.593957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e85708b1-6c5f-44ba-af26-609ae683f617 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:16.616721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85708b1-6c5f-44ba-af26-609ae683f617 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:16.619698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85708b1-6c5f-44ba-af26-609ae683f617 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:16.621502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85708b1-6c5f-44ba-af26-609ae683f617 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:16.624383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85708b1-6c5f-44ba-af26-609ae683f617 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:16.625231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85708b1-6c5f-44ba-af26-609ae683f617 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:16.628417 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85708b1-6c5f-44ba-af26-609ae683f617 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:16.757388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85708b1-6c5f-44ba-af26-609ae683f617 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "refresh_cache-86d0b20c-a790-4b41-a823-2a79532df7ff" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 10:17:16.760765 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85708b1-6c5f-44ba-af26-609ae683f617 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquired lock "refresh_cache-86d0b20c-a790-4b41-a823-2a79532df7ff" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 10:17:16.975208 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c4537304-6218-4fc3-8cbc-ef140cb51ec4 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:16.990328 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c4537304-6218-4fc3-8cbc-ef140cb51ec4 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2" status: 200 len: 1308 microversion: 2.1 time: 0.763420 Aug 24 10:17:17.007908 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 613/1327] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:16 2022] GET /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2 => generated 1308 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:17.019728 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fa72c7ad-67d5-42c7-80df-ec2d57eddc8c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:17.021071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fa72c7ad-67d5-42c7-80df-ec2d57eddc8c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:17.029841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa72c7ad-67d5-42c7-80df-ec2d57eddc8c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:17.030799 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa72c7ad-67d5-42c7-80df-ec2d57eddc8c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:17.031517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa72c7ad-67d5-42c7-80df-ec2d57eddc8c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:17.032715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa72c7ad-67d5-42c7-80df-ec2d57eddc8c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:17.033598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa72c7ad-67d5-42c7-80df-ec2d57eddc8c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:17.034199 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa72c7ad-67d5-42c7-80df-ec2d57eddc8c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:17.111222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85708b1-6c5f-44ba-af26-609ae683f617 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Releasing lock "refresh_cache-86d0b20c-a790-4b41-a823-2a79532df7ff" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 10:17:17.112259 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-e85708b1-6c5f-44ba-af26-609ae683f617 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] HTTP exception thrown: floating IP not found Aug 24 10:17:17.113962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e85708b1-6c5f-44ba-af26-609ae683f617 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Request method failure captured: Aug 24 10:17:17.113962 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff/action HTTP/1.1 Aug 24 10:17:17.113962 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:17:17.113962 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:17:17.113962 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:17:17.113962 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 41 Aug 24 10:17:17.113962 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:17:17.113962 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:17:17.113962 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:17:17.113962 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:17:17.113962 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfplTgd7srch0OUV12_onq92hN1tE6n2OpjGQv0Xy_I9PkLJddgZf7HXwu_Qcr4mCdxDC2-4EDrRmUwhe7W25YzuijkLFDMzbaUPl60kcla86IsXOhleLVtVMjrf9fLUCcX_HaR2i9GigKM9hHrIp_UHZ7WtoK6u7tNK6sMjhvtZ5xY Aug 24 10:17:17.113962 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:17:17.113962 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:17:17.113962 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:17:17.113962 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:17:17.113962 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:17:17.113962 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:17:17.113962 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 1ef1a2f8a03d4395903df62f152212d9 Aug 24 10:17:17.113962 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 Aug 24 10:17:17.113962 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:17:17.113962 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:17:17.117932 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1ef1a2f8a03d4395903df62f152212d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_1ef1a2f8a03d4395903df62f152212d9", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1ef1a2f8a03d4395903df62f152212d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/1ef1a2f8a03d4395903df62f152212d9"}]}] Aug 24 10:17:17.117932 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 Aug 24 10:17:17.117932 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 1ef1a2f8a03d4395903df62f152212d9 Aug 24 10:17:17.117932 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 Aug 24 10:17:17.117932 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project Aug 24 10:17:17.117932 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:17:17.117932 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:17:17.117932 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: cb69265eac264f36acc9d04eb60a0449 Aug 24 10:17:17.117932 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project Aug 24 10:17:17.117932 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:17:17.117932 n-d-849328-3 devstack@n-api.service[122433]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 24 10:17:17.117932 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:17:17.117932 n-d-849328-3 devstack@n-api.service[122433]: exception: floating IP not found Aug 24 10:17:17.119738 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '86d0b20c-a790-4b41-a823-2a79532df7ff', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 24 10:17:17.119738 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:17:17.119738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:17.119738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 24 10:17:17.119738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 24 10:17:17.119738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 24 10:17:17.119738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 24 10:17:17.119738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 24 10:17:17.119738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 24 10:17:17.119738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 24 10:17:17.119738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 24 10:17:17.119738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 24 10:17:17.119738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:17.119738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:17.119738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:17.119738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:17.119738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:17:17.119738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:17:17.119738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:17:17.124483 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:17:17.124483 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:17:17.124483 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:17:17.124483 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:17:17.124483 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:17:17.124483 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:17:17.124483 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:17:17.124483 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 24 10:17:17.124483 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 10:17:17.124483 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 24 10:17:17.124483 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:17.124483 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:17.124483 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:17.124483 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:17.124483 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:17:17.124483 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:17:17.124483 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:17:17.124483 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:17:17.124483 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 24 10:17:17.124483 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:17.135413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e85708b1-6c5f-44ba-af26-609ae683f617 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Returning 404 to user: floating IP not found {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:17:17.135413 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e85708b1-6c5f-44ba-af26-609ae683f617 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "POST /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff/action" status: 404 len: 67 microversion: 2.1 time: 0.543698 Aug 24 10:17:17.135413 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 715/1328] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:17:16 2022] POST /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff/action => generated 67 bytes in 548 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:17:17.135413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-741060dd-a4ef-4461-83f3-a32539a6806c tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:17.135413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-741060dd-a4ef-4461-83f3-a32539a6806c tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:17.152951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-741060dd-a4ef-4461-83f3-a32539a6806c tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:17.153700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-741060dd-a4ef-4461-83f3-a32539a6806c tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:17.154148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-741060dd-a4ef-4461-83f3-a32539a6806c tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:17.160096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-741060dd-a4ef-4461-83f3-a32539a6806c tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:17.163538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-741060dd-a4ef-4461-83f3-a32539a6806c tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:17.164387 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-741060dd-a4ef-4461-83f3-a32539a6806c tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:17.371378 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-741060dd-a4ef-4461-83f3-a32539a6806c tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1/action" status: 202 len: 0 microversion: 2.1 time: 0.250036 Aug 24 10:17:17.374604 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 716/1329] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:17:17 2022] POST /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:17:17.388084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-48afa159-7d32-4981-b27f-1334c7836122 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:17.537498 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fa72c7ad-67d5-42c7-80df-ec2d57eddc8c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:17.551587 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fa72c7ad-67d5-42c7-80df-ec2d57eddc8c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:17.559915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fa72c7ad-67d5-42c7-80df-ec2d57eddc8c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:17.562400 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fa72c7ad-67d5-42c7-80df-ec2d57eddc8c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1293 microversion: 2.25 time: 0.553011 Aug 24 10:17:17.565956 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 614/1330] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:17:17 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1293 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:17:17.572579 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32d70de7-a595-4e17-8d58-3636842b67e8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:17.574250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-32d70de7-a595-4e17-8d58-3636842b67e8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:17.581357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d70de7-a595-4e17-8d58-3636842b67e8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:17.589825 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d70de7-a595-4e17-8d58-3636842b67e8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:17.594043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d70de7-a595-4e17-8d58-3636842b67e8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:17.595108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d70de7-a595-4e17-8d58-3636842b67e8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:17.597867 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d70de7-a595-4e17-8d58-3636842b67e8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:17.598732 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d70de7-a595-4e17-8d58-3636842b67e8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:17.619116 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-48afa159-7d32-4981-b27f-1334c7836122 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 24 10:17:17.621006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-48afa159-7d32-4981-b27f-1334c7836122 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Request method failure captured: Aug 24 10:17:17.621006 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff/action HTTP/1.1 Aug 24 10:17:17.621006 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:17:17.621006 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:17:17.621006 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:17:17.621006 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 44 Aug 24 10:17:17.621006 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:17:17.621006 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:17:17.621006 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:17:17.621006 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:17:17.621006 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfplTgd7srch0OUV12_onq92hN1tE6n2OpjGQv0Xy_I9PkLJddgZf7HXwu_Qcr4mCdxDC2-4EDrRmUwhe7W25YzuijkLFDMzbaUPl60kcla86IsXOhleLVtVMjrf9fLUCcX_HaR2i9GigKM9hHrIp_UHZ7WtoK6u7tNK6sMjhvtZ5xY Aug 24 10:17:17.621006 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:17:17.621006 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:17:17.621006 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:17:17.621006 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:17:17.621006 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:17:17.621006 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:17:17.621006 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 1ef1a2f8a03d4395903df62f152212d9 Aug 24 10:17:17.621006 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 Aug 24 10:17:17.621006 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:17:17.621006 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:17:17.622742 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1ef1a2f8a03d4395903df62f152212d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_1ef1a2f8a03d4395903df62f152212d9", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1ef1a2f8a03d4395903df62f152212d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/1ef1a2f8a03d4395903df62f152212d9"}]}] Aug 24 10:17:17.622742 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 Aug 24 10:17:17.622742 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 1ef1a2f8a03d4395903df62f152212d9 Aug 24 10:17:17.622742 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 Aug 24 10:17:17.622742 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project Aug 24 10:17:17.622742 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:17:17.622742 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:17:17.622742 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: cb69265eac264f36acc9d04eb60a0449 Aug 24 10:17:17.622742 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project Aug 24 10:17:17.622742 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:17:17.622742 n-d-849328-3 devstack@n-api.service[122433]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 24 10:17:17.622742 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:17:17.622742 n-d-849328-3 devstack@n-api.service[122433]: exception: Floating IP not found for address 0.0.0.0. Aug 24 10:17:17.624364 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '86d0b20c-a790-4b41-a823-2a79532df7ff', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 24 10:17:17.624364 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:17:17.624364 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:17.624364 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 24 10:17:17.624364 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 24 10:17:17.624364 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 24 10:17:17.624364 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 24 10:17:17.624364 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 24 10:17:17.624364 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 24 10:17:17.624364 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 24 10:17:17.624364 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:17.624364 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:17.624364 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:17.624364 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:17.624364 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:17:17.624364 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:17:17.624364 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:17:17.624364 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:17:17.624364 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:17:17.626238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:17:17.626238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:17:17.626238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:17:17.626238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:17:17.626238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:17:17.626238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 24 10:17:17.626238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 24 10:17:17.626238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 24 10:17:17.626238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 24 10:17:17.626238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 24 10:17:17.626238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:17.626238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:17.626238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:17.626238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:17.626238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:17:17.626238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:17:17.626238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:17:17.626238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:17:17.626238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 24 10:17:17.626238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:17.627997 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-48afa159-7d32-4981-b27f-1334c7836122 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:17:17.627997 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-48afa159-7d32-4981-b27f-1334c7836122 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "POST /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff/action" status: 404 len: 88 microversion: 2.1 time: 0.245699 Aug 24 10:17:17.627997 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 717/1331] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:17:17 2022] POST /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff/action => generated 88 bytes in 249 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:17:17.632656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5f927ebe-446c-47bf-a0d8-faf09e19afc9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:17.637628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5f927ebe-446c-47bf-a0d8-faf09e19afc9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:17.655673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f927ebe-446c-47bf-a0d8-faf09e19afc9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:17.658348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f927ebe-446c-47bf-a0d8-faf09e19afc9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:17.658880 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f927ebe-446c-47bf-a0d8-faf09e19afc9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:17.659645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f927ebe-446c-47bf-a0d8-faf09e19afc9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:17.660125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f927ebe-446c-47bf-a0d8-faf09e19afc9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:17.662649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f927ebe-446c-47bf-a0d8-faf09e19afc9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:17.886561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-32d70de7-a595-4e17-8d58-3636842b67e8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:17.902075 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-32d70de7-a595-4e17-8d58-3636842b67e8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1313 microversion: 2.1 time: 0.334551 Aug 24 10:17:17.902730 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 615/1332] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:17 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:17.928938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d926b529-b761-4c0d-98ff-7f4874985067 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:17.948304 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d926b529-b761-4c0d-98ff-7f4874985067 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:17.980948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d926b529-b761-4c0d-98ff-7f4874985067 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:17.982372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d926b529-b761-4c0d-98ff-7f4874985067 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:17.983120 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d926b529-b761-4c0d-98ff-7f4874985067 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:17.984437 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d926b529-b761-4c0d-98ff-7f4874985067 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:17.985175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d926b529-b761-4c0d-98ff-7f4874985067 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:17.985984 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d926b529-b761-4c0d-98ff-7f4874985067 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:18.210700 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d926b529-b761-4c0d-98ff-7f4874985067 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:17:18.211128 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d926b529-b761-4c0d-98ff-7f4874985067 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:17:18.211615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d926b529-b761-4c0d-98ff-7f4874985067 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:17:18.212024 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d926b529-b761-4c0d-98ff-7f4874985067 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:17:18.212445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d926b529-b761-4c0d-98ff-7f4874985067 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:17:18.361090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d926b529-b761-4c0d-98ff-7f4874985067 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:18.382231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d926b529-b761-4c0d-98ff-7f4874985067 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:18.384887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d926b529-b761-4c0d-98ff-7f4874985067 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:18.390483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d926b529-b761-4c0d-98ff-7f4874985067 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:18.391564 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d926b529-b761-4c0d-98ff-7f4874985067 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:18.392225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d926b529-b761-4c0d-98ff-7f4874985067 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:18.393720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d926b529-b761-4c0d-98ff-7f4874985067 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:18.477744 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d926b529-b761-4c0d-98ff-7f4874985067 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "POST /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1/action" status: 202 len: 1066 microversion: 2.1 time: 0.565849 Aug 24 10:17:18.482229 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 616/1333] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:17:17 2022] POST /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1/action => generated 1066 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 10:17:18.490576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ae22ff17-3d11-4e95-b80f-b07ea96872bf tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:18.496342 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ae22ff17-3d11-4e95-b80f-b07ea96872bf tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:18.516217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae22ff17-3d11-4e95-b80f-b07ea96872bf tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:18.519047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae22ff17-3d11-4e95-b80f-b07ea96872bf tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:18.519745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae22ff17-3d11-4e95-b80f-b07ea96872bf tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:18.525543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae22ff17-3d11-4e95-b80f-b07ea96872bf tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:18.526988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae22ff17-3d11-4e95-b80f-b07ea96872bf tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:18.527642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae22ff17-3d11-4e95-b80f-b07ea96872bf tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:18.551639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5f927ebe-446c-47bf-a0d8-faf09e19afc9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:18.569279 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5f927ebe-446c-47bf-a0d8-faf09e19afc9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b" status: 200 len: 1504 microversion: 2.1 time: 0.943676 Aug 24 10:17:18.570913 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 718/1334] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:17 2022] GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b => generated 1504 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:18.599702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ea636ce6-22cf-4c2f-9906-86161816ac19 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:18.606206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ea636ce6-22cf-4c2f-9906-86161816ac19 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 1fd5ebf9-816f-442a-806d-4cf19678a3d2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:18.627899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea636ce6-22cf-4c2f-9906-86161816ac19 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:18.632919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea636ce6-22cf-4c2f-9906-86161816ac19 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:18.634700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea636ce6-22cf-4c2f-9906-86161816ac19 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:18.635774 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea636ce6-22cf-4c2f-9906-86161816ac19 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:18.641035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea636ce6-22cf-4c2f-9906-86161816ac19 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:18.643340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea636ce6-22cf-4c2f-9906-86161816ac19 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:18.674860 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ae22ff17-3d11-4e95-b80f-b07ea96872bf tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:17:18.799789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=14 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:18.899812 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ae22ff17-3d11-4e95-b80f-b07ea96872bf tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "DELETE /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff" status: 204 len: 0 microversion: 2.1 time: 0.415155 Aug 24 10:17:18.901632 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 617/1335] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:17:18 2022] DELETE /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:17:18.912621 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-1492af93-eec4-4ebd-a3b1-dcccadb539f4 req-e1226d0c-30cf-48a5-8690-d7eac295b69d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6451db-5c2a-422c-84ff-c13e81621a71", "name": "network-vif-plugged", "status": "completed", "tag": "7d183dba-e72f-4aa1-9c43-d620da8dd93b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:18.929183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1492af93-eec4-4ebd-a3b1-dcccadb539f4 req-e1226d0c-30cf-48a5-8690-d7eac295b69d service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:18.929729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1492af93-eec4-4ebd-a3b1-dcccadb539f4 req-e1226d0c-30cf-48a5-8690-d7eac295b69d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:18.930172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1492af93-eec4-4ebd-a3b1-dcccadb539f4 req-e1226d0c-30cf-48a5-8690-d7eac295b69d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:18.959521 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-1492af93-eec4-4ebd-a3b1-dcccadb539f4 req-e1226d0c-30cf-48a5-8690-d7eac295b69d service nova] Creating event network-vif-plugged:7d183dba-e72f-4aa1-9c43-d620da8dd93b for instance 1f6451db-5c2a-422c-84ff-c13e81621a71 on n-h1-849328-3 Aug 24 10:17:18.968825 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-1492af93-eec4-4ebd-a3b1-dcccadb539f4 req-e1226d0c-30cf-48a5-8690-d7eac295b69d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065477 Aug 24 10:17:18.970333 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 618/1336] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:18.976867 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-a3125d94-011f-4324-bc9c-a5407f4e2f31 req-03e9ed45-8ddc-4f1a-87a6-40324b75b949 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e607951-c58f-41ce-bb92-a9399d534b2b", "tag": "b61dbdd6-ed0f-44bc-b778-6a3d23999774"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:19.005452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ea636ce6-22cf-4c2f-9906-86161816ac19 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:19.010997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a3125d94-011f-4324-bc9c-a5407f4e2f31 req-03e9ed45-8ddc-4f1a-87a6-40324b75b949 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:19.011602 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a3125d94-011f-4324-bc9c-a5407f4e2f31 req-03e9ed45-8ddc-4f1a-87a6-40324b75b949 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:19.012069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a3125d94-011f-4324-bc9c-a5407f4e2f31 req-03e9ed45-8ddc-4f1a-87a6-40324b75b949 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:19.025735 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ea636ce6-22cf-4c2f-9906-86161816ac19 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2" status: 200 len: 1308 microversion: 2.1 time: 0.452879 Aug 24 10:17:19.027854 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 719/1337] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:18 2022] GET /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2 => generated 1308 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:19.056798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8a354e02-987a-4a86-a8a1-961617f88411 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:19.057823 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8a354e02-987a-4a86-a8a1-961617f88411 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:19.063456 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-a3125d94-011f-4324-bc9c-a5407f4e2f31 req-03e9ed45-8ddc-4f1a-87a6-40324b75b949 service nova] Creating event network-changed:b61dbdd6-ed0f-44bc-b778-6a3d23999774 for instance 0e607951-c58f-41ce-bb92-a9399d534b2b on n-h1-849328-3 Aug 24 10:17:19.075545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a354e02-987a-4a86-a8a1-961617f88411 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:19.076165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a354e02-987a-4a86-a8a1-961617f88411 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:19.077467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a354e02-987a-4a86-a8a1-961617f88411 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:19.080310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a354e02-987a-4a86-a8a1-961617f88411 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:19.080878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a354e02-987a-4a86-a8a1-961617f88411 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:19.087871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a354e02-987a-4a86-a8a1-961617f88411 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:19.089446 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-a3125d94-011f-4324-bc9c-a5407f4e2f31 req-03e9ed45-8ddc-4f1a-87a6-40324b75b949 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117636 Aug 24 10:17:19.093593 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 619/1338] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:19.103793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9576244b-910f-4227-b0e1-ceaea17de11b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:19.105791 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9576244b-910f-4227-b0e1-ceaea17de11b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:19.125554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9576244b-910f-4227-b0e1-ceaea17de11b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:19.126365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9576244b-910f-4227-b0e1-ceaea17de11b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:19.127131 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9576244b-910f-4227-b0e1-ceaea17de11b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:19.130398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9576244b-910f-4227-b0e1-ceaea17de11b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:19.131675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9576244b-910f-4227-b0e1-ceaea17de11b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:19.132636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9576244b-910f-4227-b0e1-ceaea17de11b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:19.301848 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8a354e02-987a-4a86-a8a1-961617f88411 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:19.310328 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8a354e02-987a-4a86-a8a1-961617f88411 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1470 microversion: 2.1 time: 0.259586 Aug 24 10:17:19.324193 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 720/1339] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:19 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1470 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:19.333111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-13dbfaae-836c-48dd-94e1-5ab66cf1744e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:19.334080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-13dbfaae-836c-48dd-94e1-5ab66cf1744e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:19.340922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13dbfaae-836c-48dd-94e1-5ab66cf1744e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:19.341792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13dbfaae-836c-48dd-94e1-5ab66cf1744e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:19.342468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13dbfaae-836c-48dd-94e1-5ab66cf1744e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:19.343604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13dbfaae-836c-48dd-94e1-5ab66cf1744e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:19.344304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13dbfaae-836c-48dd-94e1-5ab66cf1744e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:19.345367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13dbfaae-836c-48dd-94e1-5ab66cf1744e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:19.509479 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9576244b-910f-4227-b0e1-ceaea17de11b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:19.541864 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9576244b-910f-4227-b0e1-ceaea17de11b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:19.550881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9576244b-910f-4227-b0e1-ceaea17de11b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:19.556556 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9576244b-910f-4227-b0e1-ceaea17de11b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1293 microversion: 2.25 time: 0.458110 Aug 24 10:17:19.557090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-13dbfaae-836c-48dd-94e1-5ab66cf1744e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb69265eac264f36acc9d04eb60a0449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1a2f8a03d4395903df62f152212d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:19.559825 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 620/1340] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:17:19 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1293 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:17:19.567347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c97296eb-5838-4556-87e1-ca5ae45945ed tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:19.568965 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c97296eb-5838-4556-87e1-ca5ae45945ed tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:19.580165 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-13dbfaae-836c-48dd-94e1-5ab66cf1744e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff" status: 200 len: 1540 microversion: 2.1 time: 0.253895 Aug 24 10:17:19.583144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c97296eb-5838-4556-87e1-ca5ae45945ed tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:19.583432 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 721/1341] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:19 2022] GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff => generated 1540 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:19.583739 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c97296eb-5838-4556-87e1-ca5ae45945ed tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:19.585385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c97296eb-5838-4556-87e1-ca5ae45945ed tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:19.589811 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c97296eb-5838-4556-87e1-ca5ae45945ed tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:19.590333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c97296eb-5838-4556-87e1-ca5ae45945ed tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:19.592646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c97296eb-5838-4556-87e1-ca5ae45945ed tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:19.596295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-fa44bcf9-8875-44ae-8166-60399dd08f28 req-e6666166-d7f8-4de3-950d-fd57f2fb81fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b", "name": "network-vif-unplugged", "status": "completed", "tag": "66efbfd1-4256-420a-b036-8c92ce86deea"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:19.621207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fa44bcf9-8875-44ae-8166-60399dd08f28 req-e6666166-d7f8-4de3-950d-fd57f2fb81fc service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:19.622242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fa44bcf9-8875-44ae-8166-60399dd08f28 req-e6666166-d7f8-4de3-950d-fd57f2fb81fc service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:19.622993 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fa44bcf9-8875-44ae-8166-60399dd08f28 req-e6666166-d7f8-4de3-950d-fd57f2fb81fc service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:19.638296 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-fa44bcf9-8875-44ae-8166-60399dd08f28 req-e6666166-d7f8-4de3-950d-fd57f2fb81fc service nova] Creating event network-vif-unplugged:66efbfd1-4256-420a-b036-8c92ce86deea for instance 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b on n-h1-849328-3 Aug 24 10:17:19.648632 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-fa44bcf9-8875-44ae-8166-60399dd08f28 req-e6666166-d7f8-4de3-950d-fd57f2fb81fc service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063242 Aug 24 10:17:19.651071 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 722/1342] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:19.662507 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6254f1f7-0136-49bf-92d0-099ef3cd6893 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:19.663953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6254f1f7-0136-49bf-92d0-099ef3cd6893 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:19.693566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6254f1f7-0136-49bf-92d0-099ef3cd6893 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:19.707318 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6254f1f7-0136-49bf-92d0-099ef3cd6893 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:19.707781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6254f1f7-0136-49bf-92d0-099ef3cd6893 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:19.719512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6254f1f7-0136-49bf-92d0-099ef3cd6893 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:19.719512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6254f1f7-0136-49bf-92d0-099ef3cd6893 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:19.720180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6254f1f7-0136-49bf-92d0-099ef3cd6893 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:19.971507 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6254f1f7-0136-49bf-92d0-099ef3cd6893 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:19.975822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:19.987330 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6254f1f7-0136-49bf-92d0-099ef3cd6893 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b" status: 200 len: 1504 microversion: 2.1 time: 0.333764 Aug 24 10:17:20.002613 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 723/1343] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:19 2022] GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b => generated 1504 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:20.002873 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c97296eb-5838-4556-87e1-ca5ae45945ed tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:20.033369 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c97296eb-5838-4556-87e1-ca5ae45945ed tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1313 microversion: 2.1 time: 0.469154 Aug 24 10:17:20.038595 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 621/1344] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:19 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1313 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:20.062563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4686efb8-b9e6-4c6d-bb32-73cccf151afd tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:20.063476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4686efb8-b9e6-4c6d-bb32-73cccf151afd tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 1fd5ebf9-816f-442a-806d-4cf19678a3d2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:20.083613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4686efb8-b9e6-4c6d-bb32-73cccf151afd tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:20.084107 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4686efb8-b9e6-4c6d-bb32-73cccf151afd tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:20.089628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4686efb8-b9e6-4c6d-bb32-73cccf151afd tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:20.092015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4686efb8-b9e6-4c6d-bb32-73cccf151afd tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:20.094066 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4686efb8-b9e6-4c6d-bb32-73cccf151afd tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:20.094757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4686efb8-b9e6-4c6d-bb32-73cccf151afd tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:20.334770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cddf94aa-ffdd-4649-bf70-42c7b576c0ea tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:20.336320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cddf94aa-ffdd-4649-bf70-42c7b576c0ea tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:20.354916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cddf94aa-ffdd-4649-bf70-42c7b576c0ea tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:20.356285 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cddf94aa-ffdd-4649-bf70-42c7b576c0ea tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:20.357390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cddf94aa-ffdd-4649-bf70-42c7b576c0ea tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:20.359219 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cddf94aa-ffdd-4649-bf70-42c7b576c0ea tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:20.360117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cddf94aa-ffdd-4649-bf70-42c7b576c0ea tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:20.361599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cddf94aa-ffdd-4649-bf70-42c7b576c0ea tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:20.453035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4686efb8-b9e6-4c6d-bb32-73cccf151afd tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:20.462647 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4686efb8-b9e6-4c6d-bb32-73cccf151afd tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2" status: 200 len: 1308 microversion: 2.1 time: 0.406698 Aug 24 10:17:20.463410 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 724/1345] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:20 2022] GET /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2 => generated 1308 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:20.605602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6c66d246-5caf-4954-9f79-6d25b9cfbcf7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:20.607650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6c66d246-5caf-4954-9f79-6d25b9cfbcf7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:20.630120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c66d246-5caf-4954-9f79-6d25b9cfbcf7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:20.631225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c66d246-5caf-4954-9f79-6d25b9cfbcf7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:20.631982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c66d246-5caf-4954-9f79-6d25b9cfbcf7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:20.635025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c66d246-5caf-4954-9f79-6d25b9cfbcf7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:20.635581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c66d246-5caf-4954-9f79-6d25b9cfbcf7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:20.636026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c66d246-5caf-4954-9f79-6d25b9cfbcf7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:20.888274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cddf94aa-ffdd-4649-bf70-42c7b576c0ea tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:20.922390 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cddf94aa-ffdd-4649-bf70-42c7b576c0ea tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1470 microversion: 2.1 time: 0.594320 Aug 24 10:17:20.922962 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 622/1346] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:20 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1470 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:17:20.949416 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-580db314-dff0-4ba2-a1c7-3f93cd1ee34d tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:20.950067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-580db314-dff0-4ba2-a1c7-3f93cd1ee34d tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:20.951051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6c66d246-5caf-4954-9f79-6d25b9cfbcf7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:20.962087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-580db314-dff0-4ba2-a1c7-3f93cd1ee34d tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:20.976643 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-580db314-dff0-4ba2-a1c7-3f93cd1ee34d tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:20.979219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6c66d246-5caf-4954-9f79-6d25b9cfbcf7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:20.980373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-580db314-dff0-4ba2-a1c7-3f93cd1ee34d tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:20.982950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6c66d246-5caf-4954-9f79-6d25b9cfbcf7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:20.983881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-580db314-dff0-4ba2-a1c7-3f93cd1ee34d tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:20.989140 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6c66d246-5caf-4954-9f79-6d25b9cfbcf7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1293 microversion: 2.25 time: 0.389963 Aug 24 10:17:20.991190 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-580db314-dff0-4ba2-a1c7-3f93cd1ee34d tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:20.992368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-580db314-dff0-4ba2-a1c7-3f93cd1ee34d tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:21.014187 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 725/1347] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:17:20 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1293 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:17:21.082175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-61d5819b-aa3f-4076-af81-65895368f58b req-febc9772-ac8e-4507-b50e-9be4fbe99953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fd5ebf9-816f-442a-806d-4cf19678a3d2", "name": "network-vif-plugged", "status": "completed", "tag": "212e5fdb-8c9a-4d12-9b94-4e13e5984aa1"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:21.119453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-61d5819b-aa3f-4076-af81-65895368f58b req-febc9772-ac8e-4507-b50e-9be4fbe99953 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:21.120563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-61d5819b-aa3f-4076-af81-65895368f58b req-febc9772-ac8e-4507-b50e-9be4fbe99953 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:21.122377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-61d5819b-aa3f-4076-af81-65895368f58b req-febc9772-ac8e-4507-b50e-9be4fbe99953 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:21.146023 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-61d5819b-aa3f-4076-af81-65895368f58b req-febc9772-ac8e-4507-b50e-9be4fbe99953 service nova] Creating event network-vif-plugged:212e5fdb-8c9a-4d12-9b94-4e13e5984aa1 for instance 1fd5ebf9-816f-442a-806d-4cf19678a3d2 on n-h2-849328-3 Aug 24 10:17:21.153242 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-61d5819b-aa3f-4076-af81-65895368f58b req-febc9772-ac8e-4507-b50e-9be4fbe99953 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137204 Aug 24 10:17:21.154679 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 726/1348] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:21.162870 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-914cb735-abd7-4710-bffc-190d0912757e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:21.163921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-914cb735-abd7-4710-bffc-190d0912757e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:21.176387 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-914cb735-abd7-4710-bffc-190d0912757e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:21.177208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-914cb735-abd7-4710-bffc-190d0912757e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:21.177817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-914cb735-abd7-4710-bffc-190d0912757e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:21.179789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-914cb735-abd7-4710-bffc-190d0912757e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:21.180561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-914cb735-abd7-4710-bffc-190d0912757e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:21.181890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-914cb735-abd7-4710-bffc-190d0912757e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:21.430458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-914cb735-abd7-4710-bffc-190d0912757e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:21.461769 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-914cb735-abd7-4710-bffc-190d0912757e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b" status: 200 len: 1504 microversion: 2.1 time: 0.304226 Aug 24 10:17:21.463237 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 727/1349] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:21 2022] GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b => generated 1504 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:21.470499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-438294b8-e074-4b98-8eff-c1a6ecd07d4a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:21.471395 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-438294b8-e074-4b98-8eff-c1a6ecd07d4a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:21.479958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-438294b8-e074-4b98-8eff-c1a6ecd07d4a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:21.481218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-438294b8-e074-4b98-8eff-c1a6ecd07d4a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:21.482338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-438294b8-e074-4b98-8eff-c1a6ecd07d4a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:21.484048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-438294b8-e074-4b98-8eff-c1a6ecd07d4a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:21.485446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-438294b8-e074-4b98-8eff-c1a6ecd07d4a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:21.486461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-438294b8-e074-4b98-8eff-c1a6ecd07d4a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:21.695923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-580db314-dff0-4ba2-a1c7-3f93cd1ee34d tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb69265eac264f36acc9d04eb60a0449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1a2f8a03d4395903df62f152212d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:21.713200 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-580db314-dff0-4ba2-a1c7-3f93cd1ee34d tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff" status: 200 len: 1540 microversion: 2.1 time: 0.788673 Aug 24 10:17:21.717242 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 623/1350] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:20 2022] GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff => generated 1540 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:21.725406 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3ed9e828-2f3a-4004-95ae-763fbf366cc0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:21.726830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3ed9e828-2f3a-4004-95ae-763fbf366cc0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 1fd5ebf9-816f-442a-806d-4cf19678a3d2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:21.740139 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ed9e828-2f3a-4004-95ae-763fbf366cc0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:21.743120 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ed9e828-2f3a-4004-95ae-763fbf366cc0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:21.744430 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ed9e828-2f3a-4004-95ae-763fbf366cc0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:21.745461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ed9e828-2f3a-4004-95ae-763fbf366cc0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:21.746820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ed9e828-2f3a-4004-95ae-763fbf366cc0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:21.747513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ed9e828-2f3a-4004-95ae-763fbf366cc0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:21.802262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-438294b8-e074-4b98-8eff-c1a6ecd07d4a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:21.820368 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-438294b8-e074-4b98-8eff-c1a6ecd07d4a tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1313 microversion: 2.1 time: 0.352358 Aug 24 10:17:21.821722 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 728/1351] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:21 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:21.831787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-e4f35ab1-ceef-4bd8-812e-d63e17b4aa20 req-7455a2b5-8d6c-479c-a377-11177b2aa442 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b", "tag": "66efbfd1-4256-420a-b036-8c92ce86deea"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:21.856975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e4f35ab1-ceef-4bd8-812e-d63e17b4aa20 req-7455a2b5-8d6c-479c-a377-11177b2aa442 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:21.858453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e4f35ab1-ceef-4bd8-812e-d63e17b4aa20 req-7455a2b5-8d6c-479c-a377-11177b2aa442 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:21.859862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e4f35ab1-ceef-4bd8-812e-d63e17b4aa20 req-7455a2b5-8d6c-479c-a377-11177b2aa442 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:21.885560 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-e4f35ab1-ceef-4bd8-812e-d63e17b4aa20 req-7455a2b5-8d6c-479c-a377-11177b2aa442 service nova] Creating event network-changed:66efbfd1-4256-420a-b036-8c92ce86deea for instance 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b on n-h1-849328-3 Aug 24 10:17:21.895490 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-e4f35ab1-ceef-4bd8-812e-d63e17b4aa20 req-7455a2b5-8d6c-479c-a377-11177b2aa442 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071243 Aug 24 10:17:21.896476 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 729/1352] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:21.906699 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-371a3cb5-67b2-4e8a-9858-722c51bb7740 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Calling method '.version_select at 0x7f4654eb7790>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:21.986119 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-371a3cb5-67b2-4e8a-9858-722c51bb7740 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] 10.222.0.85 "GET /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6" status: 200 len: 637 microversion: 2.1 time: 0.087737 Aug 24 10:17:21.987030 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 730/1353] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:17:21 2022] GET /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6 => generated 637 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:22.001797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a21eb863-2214-4db2-9233-64adb25c865f tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:22.002559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a21eb863-2214-4db2-9233-64adb25c865f tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:22.013953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a21eb863-2214-4db2-9233-64adb25c865f tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:22.014478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a21eb863-2214-4db2-9233-64adb25c865f tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:22.014915 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a21eb863-2214-4db2-9233-64adb25c865f tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:22.015666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a21eb863-2214-4db2-9233-64adb25c865f tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:22.016120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a21eb863-2214-4db2-9233-64adb25c865f tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:22.017006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a21eb863-2214-4db2-9233-64adb25c865f tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:22.247889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a21eb863-2214-4db2-9233-64adb25c865f tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:22.262312 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a21eb863-2214-4db2-9233-64adb25c865f tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1470 microversion: 2.1 time: 0.264642 Aug 24 10:17:22.263367 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 731/1354] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:21 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1470 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:22.271871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-38cf8d5b-eac9-4b3b-8b28-450675ca3154 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Action: 'update_all', calling method: .version_select at 0x7f4654eb7940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:22.338141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-38cf8d5b-eac9-4b3b-8b28-450675ca3154 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Getting quotas for project c88de139afce4c77866e1040a78632c8. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:22.348547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-38cf8d5b-eac9-4b3b-8b28-450675ca3154 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Getting quotas for user 24b219a1363d46d3ba75d29f69cd3ead and project c88de139afce4c77866e1040a78632c8. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:22.516815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3ed9e828-2f3a-4004-95ae-763fbf366cc0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:22.533309 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3ed9e828-2f3a-4004-95ae-763fbf366cc0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2" status: 200 len: 1308 microversion: 2.1 time: 0.813868 Aug 24 10:17:22.534725 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 624/1355] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:21 2022] GET /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2 => generated 1308 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:22.544277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e4b59585-61e2-4338-9d04-bd1251fefcb9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:22.545739 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e4b59585-61e2-4338-9d04-bd1251fefcb9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:22.553901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4b59585-61e2-4338-9d04-bd1251fefcb9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:22.555117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4b59585-61e2-4338-9d04-bd1251fefcb9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:22.556595 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4b59585-61e2-4338-9d04-bd1251fefcb9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:22.558518 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4b59585-61e2-4338-9d04-bd1251fefcb9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:22.559733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4b59585-61e2-4338-9d04-bd1251fefcb9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:22.560512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4b59585-61e2-4338-9d04-bd1251fefcb9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:22.569507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:22.728754 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-38cf8d5b-eac9-4b3b-8b28-450675ca3154 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] 10.222.0.85 "PUT /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.463257 Aug 24 10:17:22.731054 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 732/1356] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:17:22 2022] PUT /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata => generated 61 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:17:22.740783 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b7852c0d-e358-44f8-8092-8b2d2ab32c3f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:22.745166 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b7852c0d-e358-44f8-8092-8b2d2ab32c3f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:22.757157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7852c0d-e358-44f8-8092-8b2d2ab32c3f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:22.758031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7852c0d-e358-44f8-8092-8b2d2ab32c3f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:22.760886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7852c0d-e358-44f8-8092-8b2d2ab32c3f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:22.762537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7852c0d-e358-44f8-8092-8b2d2ab32c3f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:22.763776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7852c0d-e358-44f8-8092-8b2d2ab32c3f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:22.764827 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7852c0d-e358-44f8-8092-8b2d2ab32c3f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:22.960610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e4b59585-61e2-4338-9d04-bd1251fefcb9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:22.991209 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e4b59585-61e2-4338-9d04-bd1251fefcb9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:22.998554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e4b59585-61e2-4338-9d04-bd1251fefcb9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:23.000985 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e4b59585-61e2-4338-9d04-bd1251fefcb9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1281 microversion: 2.25 time: 0.464048 Aug 24 10:17:23.013255 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 625/1357] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:17:22 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1281 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:17:23.022609 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-53f85fdf-dd2e-416d-9df3-110222c39da6 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Calling method '.version_select at 0x7f4654fca670>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:23.362037 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b7852c0d-e358-44f8-8092-8b2d2ab32c3f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:23.373894 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b7852c0d-e358-44f8-8092-8b2d2ab32c3f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b" status: 200 len: 1504 microversion: 2.1 time: 0.641141 Aug 24 10:17:23.375269 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 733/1358] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:22 2022] GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b => generated 1504 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:23.394734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-60d0d832-a330-4bce-8cba-9caaaa372b8e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:23.395883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-60d0d832-a330-4bce-8cba-9caaaa372b8e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:23.407875 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60d0d832-a330-4bce-8cba-9caaaa372b8e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:23.410338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60d0d832-a330-4bce-8cba-9caaaa372b8e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:23.413653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60d0d832-a330-4bce-8cba-9caaaa372b8e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:23.415797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60d0d832-a330-4bce-8cba-9caaaa372b8e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:23.416862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60d0d832-a330-4bce-8cba-9caaaa372b8e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:23.417904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60d0d832-a330-4bce-8cba-9caaaa372b8e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:23.528836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60d0d832-a330-4bce-8cba-9caaaa372b8e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:23.529714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60d0d832-a330-4bce-8cba-9caaaa372b8e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:23.530393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60d0d832-a330-4bce-8cba-9caaaa372b8e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:23.531199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-60d0d832-a330-4bce-8cba-9caaaa372b8e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lazy-loading 'fault' on Instance uuid 86d0b20c-a790-4b41-a823-2a79532df7ff {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:17:23.643658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-60d0d832-a330-4bce-8cba-9caaaa372b8e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb69265eac264f36acc9d04eb60a0449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1a2f8a03d4395903df62f152212d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:23.692224 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-60d0d832-a330-4bce-8cba-9caaaa372b8e tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff" status: 200 len: 1321 microversion: 2.1 time: 0.312949 Aug 24 10:17:23.696223 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-53f85fdf-dd2e-416d-9df3-110222c39da6 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] 10.222.0.85 "DELETE /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.680939 Aug 24 10:17:23.700749 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 626/1359] 10.222.0.85 () {58 vars in 1296 bytes} [Wed Aug 24 10:17:23 2022] DELETE /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata/os_version => generated 0 bytes in 683 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:17:23.707852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c5bbb7de-1169-4ea1-a06c-435d278e1b35 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:23.708497 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c5bbb7de-1169-4ea1-a06c-435d278e1b35 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:23.717595 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 734/1360] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:23 2022] GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff => generated 1321 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:23.727363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0b1abf1b-3efc-45e0-ab53-d14a1724ee28 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:23.728000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0b1abf1b-3efc-45e0-ab53-d14a1724ee28 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:23.730170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:23.736296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5bbb7de-1169-4ea1-a06c-435d278e1b35 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:23.736856 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5bbb7de-1169-4ea1-a06c-435d278e1b35 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:23.737353 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5bbb7de-1169-4ea1-a06c-435d278e1b35 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:23.744982 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5bbb7de-1169-4ea1-a06c-435d278e1b35 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:23.751677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5bbb7de-1169-4ea1-a06c-435d278e1b35 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:23.752264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5bbb7de-1169-4ea1-a06c-435d278e1b35 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:23.760138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b1abf1b-3efc-45e0-ab53-d14a1724ee28 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:23.764415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b1abf1b-3efc-45e0-ab53-d14a1724ee28 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:23.767001 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b1abf1b-3efc-45e0-ab53-d14a1724ee28 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:23.775469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b1abf1b-3efc-45e0-ab53-d14a1724ee28 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:23.776670 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b1abf1b-3efc-45e0-ab53-d14a1724ee28 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:23.777514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b1abf1b-3efc-45e0-ab53-d14a1724ee28 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:24.090921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c5bbb7de-1169-4ea1-a06c-435d278e1b35 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:24.119842 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c5bbb7de-1169-4ea1-a06c-435d278e1b35 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1463 microversion: 2.1 time: 0.415356 Aug 24 10:17:24.124928 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 627/1361] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:23 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1463 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:24.146361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e4a2c1e1-4e90-4b81-9b2d-85f823bbaf98 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:24.147834 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e4a2c1e1-4e90-4b81-9b2d-85f823bbaf98 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 1fd5ebf9-816f-442a-806d-4cf19678a3d2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:24.165240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4a2c1e1-4e90-4b81-9b2d-85f823bbaf98 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:24.166217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4a2c1e1-4e90-4b81-9b2d-85f823bbaf98 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:24.167841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4a2c1e1-4e90-4b81-9b2d-85f823bbaf98 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:24.170115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4a2c1e1-4e90-4b81-9b2d-85f823bbaf98 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:24.172671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4a2c1e1-4e90-4b81-9b2d-85f823bbaf98 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:24.175062 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4a2c1e1-4e90-4b81-9b2d-85f823bbaf98 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:24.178081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:24.276564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0b1abf1b-3efc-45e0-ab53-d14a1724ee28 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:24.296174 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0b1abf1b-3efc-45e0-ab53-d14a1724ee28 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1470 microversion: 2.1 time: 0.576897 Aug 24 10:17:24.297628 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 735/1362] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:23 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1470 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:24.328131 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-98782dd1-4fb2-4850-99e7-232def3c9b73 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Calling method '.version_select at 0x7f4654e19160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:24.419678 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-98782dd1-4fb2-4850-99e7-232def3c9b73 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] 10.222.0.85 "GET /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata" status: 200 len: 37 microversion: 2.1 time: 0.106681 Aug 24 10:17:24.433965 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 736/1363] 10.222.0.85 () {58 vars in 1260 bytes} [Wed Aug 24 10:17:24 2022] GET /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata => generated 37 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:17:24.444103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0fb5702f-8b13-416c-b2f8-3cba878c9530 req-c37ee995-49bb-4acd-b634-2bd7bd624b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86d0b20c-a790-4b41-a823-2a79532df7ff", "name": "network-vif-deleted", "tag": "ee530f9b-86a7-47a7-bef8-49f2a0946b85"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:24.466258 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0fb5702f-8b13-416c-b2f8-3cba878c9530 req-c37ee995-49bb-4acd-b634-2bd7bd624b1e service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:24.466946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0fb5702f-8b13-416c-b2f8-3cba878c9530 req-c37ee995-49bb-4acd-b634-2bd7bd624b1e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:24.467553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0fb5702f-8b13-416c-b2f8-3cba878c9530 req-c37ee995-49bb-4acd-b634-2bd7bd624b1e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:24.484121 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0fb5702f-8b13-416c-b2f8-3cba878c9530 req-c37ee995-49bb-4acd-b634-2bd7bd624b1e service nova] Creating event network-vif-deleted:ee530f9b-86a7-47a7-bef8-49f2a0946b85 for instance 86d0b20c-a790-4b41-a823-2a79532df7ff on n-h1-849328-3 Aug 24 10:17:24.490442 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0fb5702f-8b13-416c-b2f8-3cba878c9530 req-c37ee995-49bb-4acd-b634-2bd7bd624b1e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054190 Aug 24 10:17:24.491820 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 737/1364] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:24.501424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e6678e9b-c84b-4500-95a5-c0e1afd1cc97 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:24.502370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e6678e9b-c84b-4500-95a5-c0e1afd1cc97 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:24.514633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6678e9b-c84b-4500-95a5-c0e1afd1cc97 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:24.515384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6678e9b-c84b-4500-95a5-c0e1afd1cc97 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:24.515881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6678e9b-c84b-4500-95a5-c0e1afd1cc97 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:24.517754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6678e9b-c84b-4500-95a5-c0e1afd1cc97 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:24.518044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6678e9b-c84b-4500-95a5-c0e1afd1cc97 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:24.518549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6678e9b-c84b-4500-95a5-c0e1afd1cc97 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:24.551081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e4a2c1e1-4e90-4b81-9b2d-85f823bbaf98 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:24.568780 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e4a2c1e1-4e90-4b81-9b2d-85f823bbaf98 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2" status: 200 len: 1488 microversion: 2.1 time: 0.437423 Aug 24 10:17:24.581159 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 628/1365] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:24 2022] GET /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2 => generated 1488 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:24.600901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-82d3e373-9fa9-42ca-a365-5372055d340d tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:24.603124 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-82d3e373-9fa9-42ca-a365-5372055d340d tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:24.612339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82d3e373-9fa9-42ca-a365-5372055d340d tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:24.613175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82d3e373-9fa9-42ca-a365-5372055d340d tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:24.613775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82d3e373-9fa9-42ca-a365-5372055d340d tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:24.614721 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82d3e373-9fa9-42ca-a365-5372055d340d tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:24.615354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82d3e373-9fa9-42ca-a365-5372055d340d tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:24.616416 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82d3e373-9fa9-42ca-a365-5372055d340d tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:24.717596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e6678e9b-c84b-4500-95a5-c0e1afd1cc97 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:24.730486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e6678e9b-c84b-4500-95a5-c0e1afd1cc97 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:24.732258 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e6678e9b-c84b-4500-95a5-c0e1afd1cc97 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:24.733508 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e6678e9b-c84b-4500-95a5-c0e1afd1cc97 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1281 microversion: 2.25 time: 0.240312 Aug 24 10:17:24.734101 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 738/1366] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:17:24 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1281 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:17:24.740066 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f15ada11-11f8-4312-95c4-55fb1a0f43d4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:24.740744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f15ada11-11f8-4312-95c4-55fb1a0f43d4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:24.747432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f15ada11-11f8-4312-95c4-55fb1a0f43d4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:24.748278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f15ada11-11f8-4312-95c4-55fb1a0f43d4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:24.748917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f15ada11-11f8-4312-95c4-55fb1a0f43d4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:24.749861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f15ada11-11f8-4312-95c4-55fb1a0f43d4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:24.751161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f15ada11-11f8-4312-95c4-55fb1a0f43d4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:24.751764 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f15ada11-11f8-4312-95c4-55fb1a0f43d4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:24.904157 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-82d3e373-9fa9-42ca-a365-5372055d340d tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1614 microversion: 2.1 time: 0.319771 Aug 24 10:17:24.916436 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 629/1367] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:24 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1614 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:24.921853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f15ada11-11f8-4312-95c4-55fb1a0f43d4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:24.928490 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-443816f0-d5ff-4223-b00c-b6ff9404a089 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Action: 'update_all', calling method: .version_select at 0x7f46550178b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:24.943644 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f15ada11-11f8-4312-95c4-55fb1a0f43d4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b" status: 200 len: 1504 microversion: 2.1 time: 0.207239 Aug 24 10:17:24.944705 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 739/1368] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:24 2022] GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:24.971852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-07988d9e-51a0-4a44-8e0d-a3ff159be370 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:24.972570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-07988d9e-51a0-4a44-8e0d-a3ff159be370 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 1fd5ebf9-816f-442a-806d-4cf19678a3d2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:24.983668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07988d9e-51a0-4a44-8e0d-a3ff159be370 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:24.984405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07988d9e-51a0-4a44-8e0d-a3ff159be370 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:24.985057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07988d9e-51a0-4a44-8e0d-a3ff159be370 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:24.986284 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07988d9e-51a0-4a44-8e0d-a3ff159be370 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:24.987001 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07988d9e-51a0-4a44-8e0d-a3ff159be370 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:24.987623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07988d9e-51a0-4a44-8e0d-a3ff159be370 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:25.044676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-07988d9e-51a0-4a44-8e0d-a3ff159be370 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lazy-loading 'flavor' on Instance uuid 1fd5ebf9-816f-442a-806d-4cf19678a3d2 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:17:25.059703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-443816f0-d5ff-4223-b00c-b6ff9404a089 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Getting quotas for project c88de139afce4c77866e1040a78632c8. Resources: dict_keys(['metadata_items']) {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:25.070228 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-443816f0-d5ff-4223-b00c-b6ff9404a089 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Getting quotas for user 24b219a1363d46d3ba75d29f69cd3ead and project c88de139afce4c77866e1040a78632c8. Resources: dict_keys(['metadata_items']) {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:25.238863 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-07988d9e-51a0-4a44-8e0d-a3ff159be370 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "POST /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2/action" status: 202 len: 0 microversion: 2.1 time: 0.281961 Aug 24 10:17:25.240466 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 740/1369] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:17:24 2022] POST /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:17:25.255549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5aabff71-dc99-4f5b-9afb-90d01b166822 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:25.256798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5aabff71-dc99-4f5b-9afb-90d01b166822 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] [instance: 86d0b20c-a790-4b41-a823-2a79532df7ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:25.273725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5aabff71-dc99-4f5b-9afb-90d01b166822 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:25.274804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5aabff71-dc99-4f5b-9afb-90d01b166822 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:25.276736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5aabff71-dc99-4f5b-9afb-90d01b166822 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:25.278665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5aabff71-dc99-4f5b-9afb-90d01b166822 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:25.279630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5aabff71-dc99-4f5b-9afb-90d01b166822 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:25.280420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5aabff71-dc99-4f5b-9afb-90d01b166822 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:25.308289 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-5aabff71-dc99-4f5b-9afb-90d01b166822 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] HTTP exception thrown: Instance 86d0b20c-a790-4b41-a823-2a79532df7ff could not be found. Aug 24 10:17:25.310290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5aabff71-dc99-4f5b-9afb-90d01b166822 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Request method failure captured: Aug 24 10:17:25.310290 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff HTTP/1.1 Aug 24 10:17:25.310290 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:17:25.310290 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:17:25.310290 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:17:25.310290 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:17:25.310290 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:17:25.310290 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:17:25.310290 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:17:25.310290 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:17:25.310290 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfplTgd7srch0OUV12_onq92hN1tE6n2OpjGQv0Xy_I9PkLJddgZf7HXwu_Qcr4mCdxDC2-4EDrRmUwhe7W25YzuijkLFDMzbaUPl60kcla86IsXOhleLVtVMjrf9fLUCcX_HaR2i9GigKM9hHrIp_UHZ7WtoK6u7tNK6sMjhvtZ5xY Aug 24 10:17:25.310290 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:17:25.310290 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:17:25.310290 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:17:25.310290 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:17:25.310290 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:17:25.310290 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:17:25.310290 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 1ef1a2f8a03d4395903df62f152212d9 Aug 24 10:17:25.310290 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 Aug 24 10:17:25.310290 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:17:25.310290 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:17:25.312978 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1ef1a2f8a03d4395903df62f152212d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_1ef1a2f8a03d4395903df62f152212d9", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1ef1a2f8a03d4395903df62f152212d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/1ef1a2f8a03d4395903df62f152212d9"}]}] Aug 24 10:17:25.312978 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 Aug 24 10:17:25.312978 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 1ef1a2f8a03d4395903df62f152212d9 Aug 24 10:17:25.312978 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 Aug 24 10:17:25.312978 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project Aug 24 10:17:25.312978 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:17:25.312978 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:17:25.312978 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: cb69265eac264f36acc9d04eb60a0449 Aug 24 10:17:25.312978 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project Aug 24 10:17:25.312978 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:17:25.312978 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 86d0b20c-a790-4b41-a823-2a79532df7ff could not be found. Aug 24 10:17:25.314429 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '86d0b20c-a790-4b41-a823-2a79532df7ff'} Aug 24 10:17:25.314429 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:17:25.314429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:25.314429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:17:25.314429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:17:25.314429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:17:25.314429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:17:25.314429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:17:25.314429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:17:25.314429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:17:25.314429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:17:25.314429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86d0b20c-a790-4b41-a823-2a79532df7ff could not be found. Aug 24 10:17:25.314429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:25.314429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:25.314429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:25.314429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:25.314429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:17:25.314429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:17:25.314429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:17:25.314429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:17:25.316875 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:17:25.316875 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:17:25.316875 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:17:25.316875 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:17:25.316875 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:17:25.316875 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:17:25.316875 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:17:25.316875 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:17:25.316875 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86d0b20c-a790-4b41-a823-2a79532df7ff could not be found. Aug 24 10:17:25.316875 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:25.316875 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:25.316875 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:25.316875 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:25.316875 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:17:25.316875 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:17:25.316875 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:17:25.316875 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:17:25.316875 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86d0b20c-a790-4b41-a823-2a79532df7ff could not be found. Aug 24 10:17:25.316875 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:25.319184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5aabff71-dc99-4f5b-9afb-90d01b166822 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] Returning 404 to user: Instance 86d0b20c-a790-4b41-a823-2a79532df7ff could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:17:25.319184 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5aabff71-dc99-4f5b-9afb-90d01b166822 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989 tempest-FloatingIPsAssociationNegativeTestJSON-1822369989-project] 10.222.0.85 "GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff" status: 404 len: 111 microversion: 2.1 time: 0.069018 Aug 24 10:17:25.319184 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 741/1370] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:25 2022] GET /compute/v2.1/servers/86d0b20c-a790-4b41-a823-2a79532df7ff => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:17:25.319184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-54fdeb2c-1c3e-457b-8dc0-bbbde1d4a3eb tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:25.319184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-54fdeb2c-1c3e-457b-8dc0-bbbde1d4a3eb tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:25.335168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54fdeb2c-1c3e-457b-8dc0-bbbde1d4a3eb tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:25.336260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54fdeb2c-1c3e-457b-8dc0-bbbde1d4a3eb tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:25.336946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54fdeb2c-1c3e-457b-8dc0-bbbde1d4a3eb tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:25.338194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54fdeb2c-1c3e-457b-8dc0-bbbde1d4a3eb tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:25.339064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54fdeb2c-1c3e-457b-8dc0-bbbde1d4a3eb tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:25.340034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54fdeb2c-1c3e-457b-8dc0-bbbde1d4a3eb tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:25.417497 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-54fdeb2c-1c3e-457b-8dc0-bbbde1d4a3eb tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9e10b533b89c457a972e0de8d05999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5901a8bee2a473b9e834cd93f11e998', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:25.421727 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-54fdeb2c-1c3e-457b-8dc0-bbbde1d4a3eb tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] flavor_id is None. Assuming migration. {{(pid=122433) resize /opt/stack/nova/nova/compute/api.py:4181}} Aug 24 10:17:25.422833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-54fdeb2c-1c3e-457b-8dc0-bbbde1d4a3eb tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122433) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 10:17:25.529781 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-443816f0-d5ff-4223-b00c-b6ff9404a089 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] 10.222.0.85 "PUT /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.609676 Aug 24 10:17:25.533996 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 630/1371] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:17:24 2022] PUT /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata => generated 61 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:17:25.551128 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-56dc2fdf-5582-4733-82b9-e349b5059917 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:25.553359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-56dc2fdf-5582-4733-82b9-e349b5059917 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 1fd5ebf9-816f-442a-806d-4cf19678a3d2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:25.571946 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56dc2fdf-5582-4733-82b9-e349b5059917 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:25.572433 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56dc2fdf-5582-4733-82b9-e349b5059917 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:25.574259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56dc2fdf-5582-4733-82b9-e349b5059917 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:25.575137 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56dc2fdf-5582-4733-82b9-e349b5059917 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:25.575660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56dc2fdf-5582-4733-82b9-e349b5059917 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:25.576134 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56dc2fdf-5582-4733-82b9-e349b5059917 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:25.884622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-56dc2fdf-5582-4733-82b9-e349b5059917 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:25.901749 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-56dc2fdf-5582-4733-82b9-e349b5059917 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2" status: 200 len: 1496 microversion: 2.1 time: 0.365497 Aug 24 10:17:25.903792 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 631/1372] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:25 2022] GET /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2 => generated 1496 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:25.913266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-466a727b-483b-4d7d-a373-0468e2c64159 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:25.914390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-466a727b-483b-4d7d-a373-0468e2c64159 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:25.933995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-466a727b-483b-4d7d-a373-0468e2c64159 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:25.937173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-466a727b-483b-4d7d-a373-0468e2c64159 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:25.937558 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-466a727b-483b-4d7d-a373-0468e2c64159 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:25.938475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-466a727b-483b-4d7d-a373-0468e2c64159 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:25.939010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-466a727b-483b-4d7d-a373-0468e2c64159 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:25.939362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-466a727b-483b-4d7d-a373-0468e2c64159 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:25.960470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:26.014656 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-54fdeb2c-1c3e-457b-8dc0-bbbde1d4a3eb tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71/action" status: 202 len: 0 microversion: 2.1 time: 0.700576 Aug 24 10:17:26.016215 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 742/1373] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:17:25 2022] POST /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71/action => generated 0 bytes in 702 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:17:26.023661 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-602ae616-8733-48c7-b36b-90d125a925a5 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Calling method '.version_select at 0x7f4654efbe50>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:26.106459 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-602ae616-8733-48c7-b36b-90d125a925a5 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] 10.222.0.85 "GET /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.088864 Aug 24 10:17:26.108993 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 743/1374] 10.222.0.85 () {58 vars in 1290 bytes} [Wed Aug 24 10:17:26 2022] GET /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata/os_distro => generated 33 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:17:26.116214 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-47a61ebb-0fdb-4692-b73f-cdc861a9e91f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:26.118056 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-47a61ebb-0fdb-4692-b73f-cdc861a9e91f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:26.120882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:26.129908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47a61ebb-0fdb-4692-b73f-cdc861a9e91f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:26.130752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47a61ebb-0fdb-4692-b73f-cdc861a9e91f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:26.131404 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47a61ebb-0fdb-4692-b73f-cdc861a9e91f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:26.132869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47a61ebb-0fdb-4692-b73f-cdc861a9e91f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:26.133618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47a61ebb-0fdb-4692-b73f-cdc861a9e91f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:26.134253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47a61ebb-0fdb-4692-b73f-cdc861a9e91f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:26.318052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-466a727b-483b-4d7d-a373-0468e2c64159 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:26.327902 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-466a727b-483b-4d7d-a373-0468e2c64159 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1470 microversion: 2.1 time: 0.422466 Aug 24 10:17:26.329857 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 632/1375] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:25 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1470 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:26.331604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=16 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:26.335655 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-50d310ee-b93b-4e65-9b8b-29bb509504db tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:26.336581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-50d310ee-b93b-4e65-9b8b-29bb509504db tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:26.343828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50d310ee-b93b-4e65-9b8b-29bb509504db tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:26.344684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50d310ee-b93b-4e65-9b8b-29bb509504db tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:26.345476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50d310ee-b93b-4e65-9b8b-29bb509504db tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:26.346500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50d310ee-b93b-4e65-9b8b-29bb509504db tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:26.347222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50d310ee-b93b-4e65-9b8b-29bb509504db tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:26.347867 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50d310ee-b93b-4e65-9b8b-29bb509504db tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:26.602772 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-47a61ebb-0fdb-4692-b73f-cdc861a9e91f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:26.621526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-47a61ebb-0fdb-4692-b73f-cdc861a9e91f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:26.623314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-47a61ebb-0fdb-4692-b73f-cdc861a9e91f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:26.624592 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-47a61ebb-0fdb-4692-b73f-cdc861a9e91f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1281 microversion: 2.25 time: 0.514254 Aug 24 10:17:26.625279 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 744/1376] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:17:26 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1281 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:17:26.638669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b7119d03-cb98-43e7-a036-dedbfe175962 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:26.639673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b7119d03-cb98-43e7-a036-dedbfe175962 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:26.647449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7119d03-cb98-43e7-a036-dedbfe175962 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:26.648486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7119d03-cb98-43e7-a036-dedbfe175962 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:26.649187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7119d03-cb98-43e7-a036-dedbfe175962 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:26.650116 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7119d03-cb98-43e7-a036-dedbfe175962 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:26.650736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7119d03-cb98-43e7-a036-dedbfe175962 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:26.651318 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7119d03-cb98-43e7-a036-dedbfe175962 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:26.725351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-50d310ee-b93b-4e65-9b8b-29bb509504db tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:26.748456 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-50d310ee-b93b-4e65-9b8b-29bb509504db tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b" status: 200 len: 1504 microversion: 2.1 time: 0.414162 Aug 24 10:17:26.750474 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 633/1377] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:26 2022] GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b => generated 1504 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:26.758010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aed97a41-3bd6-40c2-9409-ebf9181c8692 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Action: 'update_all', calling method: .version_select at 0x7f4654f82e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:26.843235 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-aed97a41-3bd6-40c2-9409-ebf9181c8692 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Getting quotas for project c88de139afce4c77866e1040a78632c8. Resources: dict_keys(['metadata_items']) {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:26.852263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-aed97a41-3bd6-40c2-9409-ebf9181c8692 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Getting quotas for user 24b219a1363d46d3ba75d29f69cd3ead and project c88de139afce4c77866e1040a78632c8. Resources: dict_keys(['metadata_items']) {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:27.184674 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aed97a41-3bd6-40c2-9409-ebf9181c8692 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] 10.222.0.85 "PUT /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.432313 Aug 24 10:17:27.186281 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 634/1378] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:17:26 2022] PUT /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata => generated 61 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:17:27.200743 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2feba834-0037-41ef-96c4-642900f3c0c5 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:27.209818 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2feba834-0037-41ef-96c4-642900f3c0c5 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 1fd5ebf9-816f-442a-806d-4cf19678a3d2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:27.238278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2feba834-0037-41ef-96c4-642900f3c0c5 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:27.239147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2feba834-0037-41ef-96c4-642900f3c0c5 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:27.246360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2feba834-0037-41ef-96c4-642900f3c0c5 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:27.253233 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2feba834-0037-41ef-96c4-642900f3c0c5 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:27.254966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2feba834-0037-41ef-96c4-642900f3c0c5 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:27.255598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2feba834-0037-41ef-96c4-642900f3c0c5 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:27.580604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b7119d03-cb98-43e7-a036-dedbfe175962 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:27.592173 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b7119d03-cb98-43e7-a036-dedbfe175962 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1472 microversion: 2.1 time: 0.965465 Aug 24 10:17:27.592787 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 745/1379] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:26 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1472 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:27.612458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-352280d9-49d1-4874-bb46-995f76bb8118 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Calling method '.version_select at 0x7f4654e7dc10>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:27.626280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2feba834-0037-41ef-96c4-642900f3c0c5 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:27.639165 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2feba834-0037-41ef-96c4-642900f3c0c5 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2" status: 200 len: 1479 microversion: 2.1 time: 0.450707 Aug 24 10:17:27.644619 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 635/1380] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:27 2022] GET /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2 => generated 1479 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:27.651794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-202a7dbd-61ff-4e2c-9793-9557c71261d0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:27.656017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-202a7dbd-61ff-4e2c-9793-9557c71261d0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:27.673354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-202a7dbd-61ff-4e2c-9793-9557c71261d0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:27.674149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-202a7dbd-61ff-4e2c-9793-9557c71261d0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:27.674880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-202a7dbd-61ff-4e2c-9793-9557c71261d0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:27.675753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-202a7dbd-61ff-4e2c-9793-9557c71261d0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:27.677182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-202a7dbd-61ff-4e2c-9793-9557c71261d0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:27.677833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-202a7dbd-61ff-4e2c-9793-9557c71261d0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:27.684750 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-352280d9-49d1-4874-bb46-995f76bb8118 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] 10.222.0.85 "GET /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.082076 Aug 24 10:17:27.686534 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 746/1381] 10.222.0.85 () {58 vars in 1260 bytes} [Wed Aug 24 10:17:27 2022] GET /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata => generated 61 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:17:27.695929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5dae115d-5dc5-4391-a3f6-70387d0ed1f7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:27.699209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5dae115d-5dc5-4391-a3f6-70387d0ed1f7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:27.710975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dae115d-5dc5-4391-a3f6-70387d0ed1f7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:27.717225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dae115d-5dc5-4391-a3f6-70387d0ed1f7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:27.718069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dae115d-5dc5-4391-a3f6-70387d0ed1f7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:27.718998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dae115d-5dc5-4391-a3f6-70387d0ed1f7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:27.720491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dae115d-5dc5-4391-a3f6-70387d0ed1f7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:27.721102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dae115d-5dc5-4391-a3f6-70387d0ed1f7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:27.973656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-202a7dbd-61ff-4e2c-9793-9557c71261d0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:28.013039 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-202a7dbd-61ff-4e2c-9793-9557c71261d0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1470 microversion: 2.1 time: 0.363947 Aug 24 10:17:28.016705 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 636/1382] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:27 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1470 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:28.029461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ae1e5258-f12b-4681-9ab0-c67a50156b5b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1391577135"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:28.039788 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ae1e5258-f12b-4681-9ab0-c67a50156b5b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 1fd5ebf9-816f-442a-806d-4cf19678a3d2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:28.057252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5dae115d-5dc5-4391-a3f6-70387d0ed1f7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:28.057855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae1e5258-f12b-4681-9ab0-c67a50156b5b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:28.058500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae1e5258-f12b-4681-9ab0-c67a50156b5b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:28.059012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae1e5258-f12b-4681-9ab0-c67a50156b5b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:28.059912 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae1e5258-f12b-4681-9ab0-c67a50156b5b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:28.060614 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae1e5258-f12b-4681-9ab0-c67a50156b5b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:28.062135 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae1e5258-f12b-4681-9ab0-c67a50156b5b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:28.084473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5dae115d-5dc5-4391-a3f6-70387d0ed1f7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:28.088804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5dae115d-5dc5-4391-a3f6-70387d0ed1f7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:28.092688 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5dae115d-5dc5-4391-a3f6-70387d0ed1f7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1281 microversion: 2.25 time: 0.405035 Aug 24 10:17:28.115465 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 747/1383] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:17:27 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1281 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:17:28.131554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ddb27ca9-4e3e-4122-874d-d105e3d3d3b6 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Action: 'update_all', calling method: .version_select at 0x7f4654eec1f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:28.247867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-ddb27ca9-4e3e-4122-874d-d105e3d3d3b6 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Getting quotas for project c88de139afce4c77866e1040a78632c8. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:28.256085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-ddb27ca9-4e3e-4122-874d-d105e3d3d3b6 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Getting quotas for user 24b219a1363d46d3ba75d29f69cd3ead and project c88de139afce4c77866e1040a78632c8. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:28.647481 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ddb27ca9-4e3e-4122-874d-d105e3d3d3b6 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] 10.222.0.85 "PUT /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.527132 Aug 24 10:17:28.656805 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 748/1384] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:17:28 2022] PUT /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata => generated 61 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:17:28.657103 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ae1e5258-f12b-4681-9ab0-c67a50156b5b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "POST /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2/action" status: 202 len: 0 microversion: 2.1 time: 0.634787 Aug 24 10:17:28.657103 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 637/1385] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:17:28 2022] POST /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2/action => generated 0 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 10:17:28.666360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-68280331-f568-4b09-93c6-ca2d7a7e5413 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:28.672733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-68280331-f568-4b09-93c6-ca2d7a7e5413 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:28.679112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fad30426-7626-4465-a0d6-90939f56e82f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:28.680558 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fad30426-7626-4465-a0d6-90939f56e82f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:28.692193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68280331-f568-4b09-93c6-ca2d7a7e5413 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:28.693021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68280331-f568-4b09-93c6-ca2d7a7e5413 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:28.693273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad30426-7626-4465-a0d6-90939f56e82f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:28.693686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68280331-f568-4b09-93c6-ca2d7a7e5413 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:28.694445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad30426-7626-4465-a0d6-90939f56e82f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:28.695278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad30426-7626-4465-a0d6-90939f56e82f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:28.696498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad30426-7626-4465-a0d6-90939f56e82f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:28.697474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad30426-7626-4465-a0d6-90939f56e82f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:28.698236 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad30426-7626-4465-a0d6-90939f56e82f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:28.704998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68280331-f568-4b09-93c6-ca2d7a7e5413 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:28.705616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68280331-f568-4b09-93c6-ca2d7a7e5413 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:28.706054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68280331-f568-4b09-93c6-ca2d7a7e5413 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:29.066364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fad30426-7626-4465-a0d6-90939f56e82f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:29.143656 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fad30426-7626-4465-a0d6-90939f56e82f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1472 microversion: 2.1 time: 0.473852 Aug 24 10:17:29.150611 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 749/1386] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:28 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1472 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:29.212611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-93a41861-00e4-46e5-8743-f25f9be48571 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Action: 'update_all', calling method: .version_select at 0x7f4654efb4c0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:29.226291 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-68280331-f568-4b09-93c6-ca2d7a7e5413 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:29.265841 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-68280331-f568-4b09-93c6-ca2d7a7e5413 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b" status: 200 len: 1479 microversion: 2.1 time: 0.609528 Aug 24 10:17:29.266471 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 638/1387] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:28 2022] GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b => generated 1479 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:29.295068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2e2443df-d59b-44ac-8b3f-1e7d19075db2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4654d53820>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:29.355801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-93a41861-00e4-46e5-8743-f25f9be48571 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Getting quotas for project c88de139afce4c77866e1040a78632c8. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:29.376436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-93a41861-00e4-46e5-8743-f25f9be48571 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Getting quotas for user 24b219a1363d46d3ba75d29f69cd3ead and project c88de139afce4c77866e1040a78632c8. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:29.377766 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2e2443df-d59b-44ac-8b3f-1e7d19075db2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7" status: 200 len: 1440 microversion: 2.1 time: 0.109896 Aug 24 10:17:29.381076 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 639/1388] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:17:29 2022] GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7 => generated 1440 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:29.400829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a1cc09d0-69e0-44c0-8074-aa071db0fcea tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:29.405175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a1cc09d0-69e0-44c0-8074-aa071db0fcea tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:29.428243 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1cc09d0-69e0-44c0-8074-aa071db0fcea tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:29.430204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1cc09d0-69e0-44c0-8074-aa071db0fcea tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:29.434150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1cc09d0-69e0-44c0-8074-aa071db0fcea tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:29.435790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1cc09d0-69e0-44c0-8074-aa071db0fcea tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:29.438749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1cc09d0-69e0-44c0-8074-aa071db0fcea tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:29.439956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1cc09d0-69e0-44c0-8074-aa071db0fcea tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:30.203206 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-93a41861-00e4-46e5-8743-f25f9be48571 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] 10.222.0.85 "PUT /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata" status: 200 len: 64 microversion: 2.1 time: 1.002186 Aug 24 10:17:30.210177 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 750/1389] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:17:29 2022] PUT /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata => generated 64 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:17:30.233197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a1cc09d0-69e0-44c0-8074-aa071db0fcea tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:30.237310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ecb1d2a-e211-449f-8424-d99dc1a1ce89 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:30.238183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4ecb1d2a-e211-449f-8424-d99dc1a1ce89 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:30.245564 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a1cc09d0-69e0-44c0-8074-aa071db0fcea tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1470 microversion: 2.1 time: 0.862089 Aug 24 10:17:30.251935 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 640/1390] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:29 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1470 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:30.260224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4e608e3b-775b-476d-a003-ae754bfa83d9 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Calling method '.version_select at 0x7f4654d53820>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:30.267402 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e608e3b-775b-476d-a003-ae754bfa83d9 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:30.268847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ecb1d2a-e211-449f-8424-d99dc1a1ce89 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:30.269424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ecb1d2a-e211-449f-8424-d99dc1a1ce89 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:30.269868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ecb1d2a-e211-449f-8424-d99dc1a1ce89 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:30.270600 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ecb1d2a-e211-449f-8424-d99dc1a1ce89 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:30.271052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ecb1d2a-e211-449f-8424-d99dc1a1ce89 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:30.271487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ecb1d2a-e211-449f-8424-d99dc1a1ce89 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:30.275626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e608e3b-775b-476d-a003-ae754bfa83d9 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:30.277019 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e608e3b-775b-476d-a003-ae754bfa83d9 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:30.317458 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4e608e3b-775b-476d-a003-ae754bfa83d9 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] 10.222.0.85 "GET /compute/v2.1/os-migrations" status: 200 len: 3511 microversion: 2.1 time: 0.061255 Aug 24 10:17:30.320990 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 641/1391] 10.222.0.85 () {58 vars in 1143 bytes} [Wed Aug 24 10:17:30 2022] GET /compute/v2.1/os-migrations => generated 3511 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:30.332219 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2a43541c-fedf-41ea-a6af-045b41fd19d5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:30.338190 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2a43541c-fedf-41ea-a6af-045b41fd19d5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:30.351750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a43541c-fedf-41ea-a6af-045b41fd19d5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:30.353294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a43541c-fedf-41ea-a6af-045b41fd19d5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:30.354556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a43541c-fedf-41ea-a6af-045b41fd19d5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:30.356107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a43541c-fedf-41ea-a6af-045b41fd19d5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:30.357284 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a43541c-fedf-41ea-a6af-045b41fd19d5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:30.358412 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a43541c-fedf-41ea-a6af-045b41fd19d5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:30.635421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4ecb1d2a-e211-449f-8424-d99dc1a1ce89 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:30.650428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4ecb1d2a-e211-449f-8424-d99dc1a1ce89 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:30.656614 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4ecb1d2a-e211-449f-8424-d99dc1a1ce89 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:30.671439 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4ecb1d2a-e211-449f-8424-d99dc1a1ce89 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1281 microversion: 2.25 time: 0.459372 Aug 24 10:17:30.672453 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 751/1392] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:17:30 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1281 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:17:30.688088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-09369cd0-81de-48ed-9f2b-c65db769573b tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Calling method '.version_select at 0x7f4654e19c10>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:30.773528 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-09369cd0-81de-48ed-9f2b-c65db769573b tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] 10.222.0.85 "GET /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata" status: 200 len: 64 microversion: 2.1 time: 0.098494 Aug 24 10:17:30.774921 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 752/1393] 10.222.0.85 () {58 vars in 1260 bytes} [Wed Aug 24 10:17:30 2022] GET /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata => generated 64 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:17:30.799660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0864b8a5-cd7e-4c30-9f42-60aaf974a619 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:30.800792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0864b8a5-cd7e-4c30-9f42-60aaf974a619 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] [instance: 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:30.826478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0864b8a5-cd7e-4c30-9f42-60aaf974a619 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:30.827545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0864b8a5-cd7e-4c30-9f42-60aaf974a619 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:30.828245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0864b8a5-cd7e-4c30-9f42-60aaf974a619 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:30.834611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0864b8a5-cd7e-4c30-9f42-60aaf974a619 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:30.835394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0864b8a5-cd7e-4c30-9f42-60aaf974a619 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:30.835845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0864b8a5-cd7e-4c30-9f42-60aaf974a619 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:31.194895 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0864b8a5-cd7e-4c30-9f42-60aaf974a619 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b" status: 200 len: 1630 microversion: 2.1 time: 0.409145 Aug 24 10:17:31.196445 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 753/1394] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:30 2022] GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b => generated 1630 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:31.203883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d412111b-0623-46e5-9079-f3bbde381974 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4654f8e160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:31.378286 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d412111b-0623-46e5-9079-f3bbde381974 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7" status: 200 len: 1440 microversion: 2.1 time: 0.175979 Aug 24 10:17:31.382026 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 754/1395] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:17:31 2022] GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7 => generated 1440 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:31.401645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-181b74b7-0163-4638-af95-bd395cb35035 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Action: 'update_all', calling method: .version_select at 0x7f4654eef940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:31.553918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2a43541c-fedf-41ea-a6af-045b41fd19d5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:31.555109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-181b74b7-0163-4638-af95-bd395cb35035 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Getting quotas for project c88de139afce4c77866e1040a78632c8. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:31.564032 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2a43541c-fedf-41ea-a6af-045b41fd19d5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1472 microversion: 2.1 time: 1.241397 Aug 24 10:17:31.564641 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 642/1396] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:30 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1472 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:31.568164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-181b74b7-0163-4638-af95-bd395cb35035 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Getting quotas for user 24b219a1363d46d3ba75d29f69cd3ead and project c88de139afce4c77866e1040a78632c8. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:31.574441 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-73991ee2-acdc-4d79-91ae-8206570eb137 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Action: 'create', calling method: .version_select at 0x7f4654fcaee0>, body: {"keypair": {"name": "tempest-keypair-1970654174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMG+a90t/QIkTKTqZKp71PNeUvxhVpt55cg0UIfogqYqJkaLKnWEmtsGOLl3OOV8ryFq4aAxt7GikT9BqJa2Mi14uEjDNJTeRH9hx0PtfssFge87FzumaND67QicZ7LcA=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:31.689348 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-73991ee2-acdc-4d79-91ae-8206570eb137 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Getting quotas for project 6f266868d6374a82a4ba5333915a9884. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:31.702768 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-73991ee2-acdc-4d79-91ae-8206570eb137 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Getting quotas for user b321b1490c2b4fe3aa1a1747b25408a1 and project 6f266868d6374a82a4ba5333915a9884. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:31.804540 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-73991ee2-acdc-4d79-91ae-8206570eb137 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.233856 Aug 24 10:17:31.814031 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 643/1397] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:17:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:31.827598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-33a43b61-b258-4e65-8dc2-376e5a63360a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:31.830943 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-33a43b61-b258-4e65-8dc2-376e5a63360a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:31.854122 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33a43b61-b258-4e65-8dc2-376e5a63360a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:31.854769 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33a43b61-b258-4e65-8dc2-376e5a63360a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:31.855328 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33a43b61-b258-4e65-8dc2-376e5a63360a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:31.856185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33a43b61-b258-4e65-8dc2-376e5a63360a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:31.859250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33a43b61-b258-4e65-8dc2-376e5a63360a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:31.866366 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33a43b61-b258-4e65-8dc2-376e5a63360a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:32.444312 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-181b74b7-0163-4638-af95-bd395cb35035 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] 10.222.0.85 "PUT /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata" status: 200 len: 61 microversion: 2.1 time: 1.055261 Aug 24 10:17:32.446659 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 755/1398] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:17:31 2022] PUT /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata => generated 61 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:17:32.452396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c90016ef-0f36-4a1e-8457-b3f61f97740c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:32.457002 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c90016ef-0f36-4a1e-8457-b3f61f97740c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:32.477095 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c90016ef-0f36-4a1e-8457-b3f61f97740c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:32.477915 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c90016ef-0f36-4a1e-8457-b3f61f97740c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:32.480580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c90016ef-0f36-4a1e-8457-b3f61f97740c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:32.481689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c90016ef-0f36-4a1e-8457-b3f61f97740c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:32.483894 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c90016ef-0f36-4a1e-8457-b3f61f97740c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:32.484537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c90016ef-0f36-4a1e-8457-b3f61f97740c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:32.652827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-33a43b61-b258-4e65-8dc2-376e5a63360a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:32.677599 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-33a43b61-b258-4e65-8dc2-376e5a63360a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1470 microversion: 2.1 time: 0.859784 Aug 24 10:17:32.678541 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 644/1399] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:31 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1470 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:32.725904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a73f64b3-d35e-4f17-af8c-579e1ff12ee8 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4655017160>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:32.840491 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a73f64b3-d35e-4f17-af8c-579e1ff12ee8 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7" status: 200 len: 1440 microversion: 2.1 time: 0.131408 Aug 24 10:17:32.851891 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 645/1400] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:17:32 2022] GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7 => generated 1440 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:32.861106 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3e454b40-083d-47a3-b3e7-794562014f81 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Action: 'update', calling method: .version_select at 0x7f4655054790>, body: {"meta": {"os_version": "alt"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:32.963764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-3e454b40-083d-47a3-b3e7-794562014f81 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Getting quotas for project c88de139afce4c77866e1040a78632c8. Resources: dict_keys(['metadata_items']) {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:32.982393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-3e454b40-083d-47a3-b3e7-794562014f81 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Getting quotas for user 24b219a1363d46d3ba75d29f69cd3ead and project c88de139afce4c77866e1040a78632c8. Resources: dict_keys(['metadata_items']) {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:33.499464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c90016ef-0f36-4a1e-8457-b3f61f97740c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:33.520727 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c90016ef-0f36-4a1e-8457-b3f61f97740c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:33.522584 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c90016ef-0f36-4a1e-8457-b3f61f97740c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:33.523936 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c90016ef-0f36-4a1e-8457-b3f61f97740c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1281 microversion: 2.25 time: 1.075861 Aug 24 10:17:33.524719 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 756/1401] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:17:32 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1281 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:17:33.536130 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c0802379-abf8-4758-bb46-57c6855b9681 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:33.537255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c0802379-abf8-4758-bb46-57c6855b9681 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:33.548239 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3e454b40-083d-47a3-b3e7-794562014f81 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] 10.222.0.85 "PUT /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.693845 Aug 24 10:17:33.548363 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 646/1402] 10.222.0.85 () {60 vars in 1313 bytes} [Wed Aug 24 10:17:32 2022] PUT /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata/os_version => generated 31 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:17:33.557702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0802379-abf8-4758-bb46-57c6855b9681 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:33.558361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0802379-abf8-4758-bb46-57c6855b9681 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:33.559984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0802379-abf8-4758-bb46-57c6855b9681 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:33.561040 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0802379-abf8-4758-bb46-57c6855b9681 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:33.561280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f890e98c-1f51-490c-b3d0-b7f4ad31a397 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Calling method '.version_select at 0x7f4655074f70>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:33.563138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0802379-abf8-4758-bb46-57c6855b9681 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:33.564272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0802379-abf8-4758-bb46-57c6855b9681 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:33.647065 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f890e98c-1f51-490c-b3d0-b7f4ad31a397 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] 10.222.0.85 "GET /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata" status: 200 len: 58 microversion: 2.1 time: 0.092194 Aug 24 10:17:33.649292 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 647/1403] 10.222.0.85 () {58 vars in 1260 bytes} [Wed Aug 24 10:17:33 2022] GET /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata => generated 58 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 10:17:33.667953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8f0cebcd-1316-44a8-bad0-fc2adb5114a2 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Action: 'update_all', calling method: .version_select at 0x7f4655017a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:33.790306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-8f0cebcd-1316-44a8-bad0-fc2adb5114a2 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Getting quotas for project c88de139afce4c77866e1040a78632c8. Resources: dict_keys(['metadata_items']) {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:33.797852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-8f0cebcd-1316-44a8-bad0-fc2adb5114a2 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Getting quotas for user 24b219a1363d46d3ba75d29f69cd3ead and project c88de139afce4c77866e1040a78632c8. Resources: dict_keys(['metadata_items']) {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:34.308568 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c0802379-abf8-4758-bb46-57c6855b9681 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:34.348159 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c0802379-abf8-4758-bb46-57c6855b9681 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1477 microversion: 2.1 time: 0.814946 Aug 24 10:17:34.348941 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 757/1404] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:33 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1477 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:34.363839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-296ee256-0d4e-4d04-96ab-a50db83ba6db tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:34.372561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-296ee256-0d4e-4d04-96ab-a50db83ba6db tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:34.399777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-296ee256-0d4e-4d04-96ab-a50db83ba6db tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:34.401505 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-296ee256-0d4e-4d04-96ab-a50db83ba6db tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:34.405068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-296ee256-0d4e-4d04-96ab-a50db83ba6db tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:34.410740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-296ee256-0d4e-4d04-96ab-a50db83ba6db tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:34.411988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-296ee256-0d4e-4d04-96ab-a50db83ba6db tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:34.413528 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-296ee256-0d4e-4d04-96ab-a50db83ba6db tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:34.442865 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8f0cebcd-1316-44a8-bad0-fc2adb5114a2 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] 10.222.0.85 "PUT /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.780405 Aug 24 10:17:34.443500 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 648/1405] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:17:33 2022] PUT /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata => generated 61 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:17:34.449983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-15f9bdec-4739-4817-a969-477cf2f33220 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4655017280>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:34.652183 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-15f9bdec-4739-4817-a969-477cf2f33220 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7" status: 200 len: 1440 microversion: 2.1 time: 0.207364 Aug 24 10:17:34.653457 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 649/1406] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:17:34 2022] GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7 => generated 1440 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:34.659988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dbc529e1-c06e-438d-a27a-9a98787a23d8 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Action: 'create', calling method: .version_select at 0x7f4654fd6040>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:34.801072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-dbc529e1-c06e-438d-a27a-9a98787a23d8 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Getting quotas for project c88de139afce4c77866e1040a78632c8. Resources: dict_keys(['metadata_items']) {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:34.810266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-dbc529e1-c06e-438d-a27a-9a98787a23d8 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Getting quotas for user 24b219a1363d46d3ba75d29f69cd3ead and project c88de139afce4c77866e1040a78632c8. Resources: dict_keys(['metadata_items']) {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:35.028620 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-296ee256-0d4e-4d04-96ab-a50db83ba6db tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:35.047936 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-296ee256-0d4e-4d04-96ab-a50db83ba6db tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1470 microversion: 2.1 time: 0.697509 Aug 24 10:17:35.049045 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 758/1407] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:34 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1470 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:35.056941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c5d26d57-9815-4380-b788-e67d2b125a78 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:35.063723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c5d26d57-9815-4380-b788-e67d2b125a78 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:35.081052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5d26d57-9815-4380-b788-e67d2b125a78 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:35.083451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5d26d57-9815-4380-b788-e67d2b125a78 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:35.089825 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5d26d57-9815-4380-b788-e67d2b125a78 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:35.091165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5d26d57-9815-4380-b788-e67d2b125a78 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:35.091887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5d26d57-9815-4380-b788-e67d2b125a78 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:35.092570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5d26d57-9815-4380-b788-e67d2b125a78 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:35.379695 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dbc529e1-c06e-438d-a27a-9a98787a23d8 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] 10.222.0.85 "POST /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata" status: 200 len: 85 microversion: 2.1 time: 0.724749 Aug 24 10:17:35.381822 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 650/1408] 10.222.0.85 () {60 vars in 1281 bytes} [Wed Aug 24 10:17:34 2022] POST /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata => generated 85 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:17:35.399029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b0d40ab2-986c-4f37-8024-7d45b9b74b59 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:35.445520 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b0d40ab2-986c-4f37-8024-7d45b9b74b59 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:35.502355 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0d40ab2-986c-4f37-8024-7d45b9b74b59 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:35.506613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0d40ab2-986c-4f37-8024-7d45b9b74b59 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:35.512218 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0d40ab2-986c-4f37-8024-7d45b9b74b59 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:35.513507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0d40ab2-986c-4f37-8024-7d45b9b74b59 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:35.514244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0d40ab2-986c-4f37-8024-7d45b9b74b59 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:35.514880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0d40ab2-986c-4f37-8024-7d45b9b74b59 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:35.760520 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c5d26d57-9815-4380-b788-e67d2b125a78 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:35.779102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c5d26d57-9815-4380-b788-e67d2b125a78 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:35.784459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c5d26d57-9815-4380-b788-e67d2b125a78 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:35.789222 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c5d26d57-9815-4380-b788-e67d2b125a78 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1281 microversion: 2.25 time: 0.738306 Aug 24 10:17:35.791098 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 759/1409] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:17:35 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1281 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:17:35.805054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b0a5a384-ae45-4e5c-acd9-9aab64daf077 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] Calling method '.version_select at 0x7f4654f5a1f0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:35.921081 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b0a5a384-ae45-4e5c-acd9-9aab64daf077 tempest-ImagesMetadataTestJSON-1749165810 tempest-ImagesMetadataTestJSON-1749165810-project] 10.222.0.85 "GET /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata" status: 200 len: 85 microversion: 2.1 time: 0.127117 Aug 24 10:17:35.927539 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 760/1410] 10.222.0.85 () {58 vars in 1260 bytes} [Wed Aug 24 10:17:35 2022] GET /compute/v2.1/images/75b383d6-4f83-4665-9cb1-af026ceda3c6/metadata => generated 85 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:17:35.940372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9d6ac0ef-fddb-4557-8f90-0a46304c9917 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4654f3f9d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:36.615793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b0d40ab2-986c-4f37-8024-7d45b9b74b59 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:36.628627 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b0d40ab2-986c-4f37-8024-7d45b9b74b59 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1477 microversion: 2.1 time: 1.236376 Aug 24 10:17:36.655343 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 651/1411] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:35 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1477 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:36.669005 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-27fc4221-ea4e-4ff9-a6b9-e39caf9e1813 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:36.672678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-27fc4221-ea4e-4ff9-a6b9-e39caf9e1813 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:36.702793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27fc4221-ea4e-4ff9-a6b9-e39caf9e1813 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:36.705081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27fc4221-ea4e-4ff9-a6b9-e39caf9e1813 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:36.705692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27fc4221-ea4e-4ff9-a6b9-e39caf9e1813 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:36.708540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27fc4221-ea4e-4ff9-a6b9-e39caf9e1813 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:36.709664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27fc4221-ea4e-4ff9-a6b9-e39caf9e1813 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:36.712349 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27fc4221-ea4e-4ff9-a6b9-e39caf9e1813 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:36.756269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:36.912220 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9d6ac0ef-fddb-4557-8f90-0a46304c9917 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7" status: 200 len: 1440 microversion: 2.1 time: 0.985586 Aug 24 10:17:36.912821 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 761/1412] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:17:35 2022] GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7 => generated 1440 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:36.918475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-28dff9d7-accd-4286-80ce-9e805b38430a tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Action: 'create', calling method: .version_select at 0x7f4654ebc1f0>, body: {"keypair": {"name": "tempest-keypair-1656422405", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcs+86HdkhC/Av9acZIvYfqVIOJiiA73K02eLnYVRup0Vm0yB2t7r3mc6vNwXAHkX7m/S/dPTkGcfmn9bP2wMgpKFx5eJphQgIQTkRFFDGe4uPZqVxM9ANZvNFnkUs5ew=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:37.005283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-28dff9d7-accd-4286-80ce-9e805b38430a tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Getting quotas for project ad01394db2334c029874ee8e14e227f5. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:37.039100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-28dff9d7-accd-4286-80ce-9e805b38430a tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Getting quotas for user b24e6810543444048cf6e0871f5521eb and project ad01394db2334c029874ee8e14e227f5. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:37.094722 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-28dff9d7-accd-4286-80ce-9e805b38430a tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.179865 Aug 24 10:17:37.095770 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 762/1413] 10.222.0.85 () {62 vars in 1200 bytes} [Wed Aug 24 10:17:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 181 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 10:17:37.106442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9ef0619b-3796-4bec-85c8-6ceeb404e5e0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:37.107249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9ef0619b-3796-4bec-85c8-6ceeb404e5e0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:37.125171 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ef0619b-3796-4bec-85c8-6ceeb404e5e0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:37.127609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ef0619b-3796-4bec-85c8-6ceeb404e5e0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:37.128281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ef0619b-3796-4bec-85c8-6ceeb404e5e0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:37.133315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ef0619b-3796-4bec-85c8-6ceeb404e5e0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:37.134049 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ef0619b-3796-4bec-85c8-6ceeb404e5e0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:37.134659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ef0619b-3796-4bec-85c8-6ceeb404e5e0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:37.333815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-27fc4221-ea4e-4ff9-a6b9-e39caf9e1813 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:37.346177 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-27fc4221-ea4e-4ff9-a6b9-e39caf9e1813 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1470 microversion: 2.1 time: 0.687729 Aug 24 10:17:37.350090 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 652/1414] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:36 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1470 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:37.363896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-6827014b-561f-460e-bd23-29574fa3cc25 req-1f94066d-3120-49e7-9d98-0a99ab3be7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e607951-c58f-41ce-bb92-a9399d534b2b", "name": "network-vif-plugged", "status": "completed", "tag": "b61dbdd6-ed0f-44bc-b778-6a3d23999774"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:37.398436 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6827014b-561f-460e-bd23-29574fa3cc25 req-1f94066d-3120-49e7-9d98-0a99ab3be7f5 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:37.399492 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6827014b-561f-460e-bd23-29574fa3cc25 req-1f94066d-3120-49e7-9d98-0a99ab3be7f5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:37.402085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6827014b-561f-460e-bd23-29574fa3cc25 req-1f94066d-3120-49e7-9d98-0a99ab3be7f5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:37.433503 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-6827014b-561f-460e-bd23-29574fa3cc25 req-1f94066d-3120-49e7-9d98-0a99ab3be7f5 service nova] Creating event network-vif-plugged:b61dbdd6-ed0f-44bc-b778-6a3d23999774 for instance 0e607951-c58f-41ce-bb92-a9399d534b2b on n-h1-849328-3 Aug 24 10:17:37.453193 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-6827014b-561f-460e-bd23-29574fa3cc25 req-1f94066d-3120-49e7-9d98-0a99ab3be7f5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098672 Aug 24 10:17:37.455587 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 653/1415] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:37.658441 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f326ec47-ce68-4735-99ec-3943679ee183 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:37.660395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f326ec47-ce68-4735-99ec-3943679ee183 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:37.682148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f326ec47-ce68-4735-99ec-3943679ee183 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:37.683259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f326ec47-ce68-4735-99ec-3943679ee183 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:37.686365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f326ec47-ce68-4735-99ec-3943679ee183 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:37.687780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f326ec47-ce68-4735-99ec-3943679ee183 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:37.691862 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f326ec47-ce68-4735-99ec-3943679ee183 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:37.697593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f326ec47-ce68-4735-99ec-3943679ee183 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:37.801307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9ef0619b-3796-4bec-85c8-6ceeb404e5e0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:37.838218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9ef0619b-3796-4bec-85c8-6ceeb404e5e0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:37.853754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9ef0619b-3796-4bec-85c8-6ceeb404e5e0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:37.857975 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9ef0619b-3796-4bec-85c8-6ceeb404e5e0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1281 microversion: 2.25 time: 0.757814 Aug 24 10:17:37.861245 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 763/1416] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:17:37 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1281 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:17:37.939461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7b8fc960-1c5d-4162-83e8-e78412f08d38 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4654de3ca0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:38.049415 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7b8fc960-1c5d-4162-83e8-e78412f08d38 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7" status: 200 len: 1440 microversion: 2.1 time: 0.115156 Aug 24 10:17:38.058228 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 764/1417] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:17:37 2022] GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7 => generated 1440 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:38.376668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-03c5448c-38c7-4afb-98f0-649b4f7b052c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:38.377512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-03c5448c-38c7-4afb-98f0-649b4f7b052c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:38.393163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03c5448c-38c7-4afb-98f0-649b4f7b052c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:38.395273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03c5448c-38c7-4afb-98f0-649b4f7b052c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:38.399340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03c5448c-38c7-4afb-98f0-649b4f7b052c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:38.400407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03c5448c-38c7-4afb-98f0-649b4f7b052c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:38.400972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03c5448c-38c7-4afb-98f0-649b4f7b052c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:38.401662 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03c5448c-38c7-4afb-98f0-649b4f7b052c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:38.464393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f326ec47-ce68-4735-99ec-3943679ee183 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:38.497851 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f326ec47-ce68-4735-99ec-3943679ee183 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1477 microversion: 2.1 time: 0.841102 Aug 24 10:17:38.499067 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 654/1418] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:37 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1477 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:38.937184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-03c5448c-38c7-4afb-98f0-649b4f7b052c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:38.954510 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-03c5448c-38c7-4afb-98f0-649b4f7b052c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1470 microversion: 2.1 time: 0.584438 Aug 24 10:17:38.959668 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 765/1419] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:38 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1470 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:38.987800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b47714e6-a8c1-4757-b0fc-822c40d3f4eb tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] Calling method '.version_select at 0x7f4655001790>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:38.998306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-604a618a-b140-4f76-a46a-74eff2868198 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-749480516", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "f9d3da2a-e7f1-4061-b1c2-835192cdb5b7"}], "security_groups": [{"name": "tempest-securitygroup--1745696232"}], "key_name": "tempest-keypair-1970654174", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:39.049624 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-b47714e6-a8c1-4757-b0fc-822c40d3f4eb tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] HTTP exception thrown: Image not found. Aug 24 10:17:39.070644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b47714e6-a8c1-4757-b0fc-822c40d3f4eb tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] Request method failure captured: Aug 24 10:17:39.070644 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/images/0bb484f7-abb7-4d68-8011-94957adad36c/metadata/os_distro HTTP/1.1 Aug 24 10:17:39.070644 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:17:39.070644 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:17:39.070644 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:17:39.070644 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:17:39.070644 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:17:39.070644 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:17:39.070644 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:17:39.070644 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:17:39.070644 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfrCpdP-MWnIVDjNHYhfLTUi-taRDCgJD6ZKV5BrMDjjUzmXR_xoKBH-zMp3hOjRHX_STpUJYDapbkl6os6CiEFmO0fTLzvZGDWk9-jV-cnuD8nBm6QEyqv5tGreSA2z12mFX8eJVdlLCTQNocqUpiOdxPCdL6ph_imsU_a6MO5xyCw Aug 24 10:17:39.070644 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:17:39.070644 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:17:39.070644 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:17:39.070644 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:17:39.070644 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:17:39.070644 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:17:39.070644 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: d72ddf6b94134791a407f8b8260f11e4 Aug 24 10:17:39.070644 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1668017167 Aug 24 10:17:39.070644 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:17:39.070644 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:17:39.072598 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d72ddf6b94134791a407f8b8260f11e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d72ddf6b94134791a407f8b8260f11e4", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d72ddf6b94134791a407f8b8260f11e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d72ddf6b94134791a407f8b8260f11e4"}]}] Aug 24 10:17:39.072598 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1668017167 Aug 24 10:17:39.072598 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: d72ddf6b94134791a407f8b8260f11e4 Aug 24 10:17:39.072598 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1668017167 Aug 24 10:17:39.072598 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ImagesMetadataNegativeTestJSON-1668017167-project Aug 24 10:17:39.072598 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:17:39.072598 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:17:39.072598 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: a40a204f72924d96be796ae961584c84 Aug 24 10:17:39.072598 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1668017167-project Aug 24 10:17:39.072598 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:17:39.072598 n-d-849328-3 devstack@n-api.service[122432]: exception: Image not found. Aug 24 10:17:39.072598 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'image_id': '0bb484f7-abb7-4d68-8011-94957adad36c', 'id': 'os_distro'} Aug 24 10:17:39.072598 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:17:39.074334 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:39.074334 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 10:17:39.074334 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 10:17:39.074334 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:17:39.074334 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:17:39.074334 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 10:17:39.074334 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 10:17:39.074334 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:17:39.074334 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:17:39.074334 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 10:17:39.074334 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 10:17:39.074334 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 10:17:39.074334 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 10:17:39.074334 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:17:39.074334 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:17:39.074334 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:17:39.074334 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:17:39.074334 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0bb484f7-abb7-4d68-8011-94957adad36c Aug 24 10:17:39.076123 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:17:39.076123 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:39.076123 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:17:39.076123 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:39.076123 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 24 10:17:39.076123 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 24 10:17:39.076123 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 10:17:39.076123 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 10:17:39.076123 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 10:17:39.076123 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 10:17:39.076123 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 10:17:39.076123 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 10:17:39.076123 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 10:17:39.076123 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 10:17:39.076123 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:17:39.076123 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:17:39.076123 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 10:17:39.076123 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 10:17:39.076123 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:17:39.076123 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:17:39.078840 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 10:17:39.078840 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 10:17:39.078840 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 10:17:39.078840 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 10:17:39.078840 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:17:39.078840 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:17:39.078840 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:17:39.078840 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:17:39.078840 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0bb484f7-abb7-4d68-8011-94957adad36c could not be found. Aug 24 10:17:39.078840 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:17:39.078840 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:39.078840 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:17:39.078840 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:39.078840 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:17:39.078840 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:17:39.078840 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:17:39.078840 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:17:39.078840 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:17:39.078840 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:17:39.084462 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:17:39.084462 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:17:39.084462 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 24 10:17:39.084462 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 24 10:17:39.084462 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 24 10:17:39.084462 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 10:17:39.084462 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 10:17:39.084462 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:17:39.084462 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:39.084462 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:17:39.084462 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:39.084462 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:17:39.084462 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:17:39.084462 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:17:39.084462 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:17:39.084462 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 10:17:39.084462 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:17:39.084462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b47714e6-a8c1-4757-b0fc-822c40d3f4eb tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] Returning 404 to user: Image not found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:17:39.086481 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b47714e6-a8c1-4757-b0fc-822c40d3f4eb tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] 10.222.0.85 "DELETE /compute/v2.1/images/0bb484f7-abb7-4d68-8011-94957adad36c/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.580802 Aug 24 10:17:39.086481 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 655/1420] 10.222.0.85 () {58 vars in 1293 bytes} [Wed Aug 24 10:17:38 2022] DELETE /compute/v2.1/images/0bb484f7-abb7-4d68-8011-94957adad36c/metadata/os_distro => generated 62 bytes in 583 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:17:39.094455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-24b2acf2-db8c-4eea-97d3-0d8eaffada09 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:39.100122 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-24b2acf2-db8c-4eea-97d3-0d8eaffada09 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:39.124169 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24b2acf2-db8c-4eea-97d3-0d8eaffada09 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:39.126404 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24b2acf2-db8c-4eea-97d3-0d8eaffada09 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:39.129390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24b2acf2-db8c-4eea-97d3-0d8eaffada09 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:39.133172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24b2acf2-db8c-4eea-97d3-0d8eaffada09 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:39.135556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24b2acf2-db8c-4eea-97d3-0d8eaffada09 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:39.143034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24b2acf2-db8c-4eea-97d3-0d8eaffada09 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:39.288625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-604a618a-b140-4f76-a46a-74eff2868198 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] validate_networks() for [('f9d3da2a-e7f1-4061-b1c2-835192cdb5b7', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:17:39.856734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-24b2acf2-db8c-4eea-97d3-0d8eaffada09 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:39.878606 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-24b2acf2-db8c-4eea-97d3-0d8eaffada09 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:39.889017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-24b2acf2-db8c-4eea-97d3-0d8eaffada09 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:39.892678 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-24b2acf2-db8c-4eea-97d3-0d8eaffada09 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1281 microversion: 2.25 time: 0.803035 Aug 24 10:17:39.898602 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 656/1421] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:17:39 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1281 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:17:39.918859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-08b520fb-cfd2-4f5b-aa10-fb68b0ea0f34 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f465505e940>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:40.024322 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-08b520fb-cfd2-4f5b-aa10-fb68b0ea0f34 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7" status: 200 len: 1440 microversion: 2.1 time: 0.122997 Aug 24 10:17:40.025624 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 657/1422] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:17:39 2022] GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7 => generated 1440 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:40.039345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1f17c0e9-2ed4-4b43-a252-695fce25bba9 tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] Calling method '.version_select at 0x7f465505eaf0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:40.100357 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-1f17c0e9-2ed4-4b43-a252-695fce25bba9 tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] HTTP exception thrown: Image not found. Aug 24 10:17:40.102464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1f17c0e9-2ed4-4b43-a252-695fce25bba9 tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] Request method failure captured: Aug 24 10:17:40.102464 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/images/af38bcd1-8805-454b-82b4-f03c5090e972/metadata/os_version HTTP/1.1 Aug 24 10:17:40.102464 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:17:40.102464 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:17:40.102464 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:17:40.102464 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:17:40.102464 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:17:40.102464 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:17:40.102464 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:17:40.102464 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:17:40.102464 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfrCpdP-MWnIVDjNHYhfLTUi-taRDCgJD6ZKV5BrMDjjUzmXR_xoKBH-zMp3hOjRHX_STpUJYDapbkl6os6CiEFmO0fTLzvZGDWk9-jV-cnuD8nBm6QEyqv5tGreSA2z12mFX8eJVdlLCTQNocqUpiOdxPCdL6ph_imsU_a6MO5xyCw Aug 24 10:17:40.102464 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:17:40.102464 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:17:40.102464 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:17:40.102464 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:17:40.102464 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:17:40.102464 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:17:40.102464 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: d72ddf6b94134791a407f8b8260f11e4 Aug 24 10:17:40.102464 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1668017167 Aug 24 10:17:40.102464 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:17:40.102464 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:17:40.103906 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d72ddf6b94134791a407f8b8260f11e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d72ddf6b94134791a407f8b8260f11e4", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d72ddf6b94134791a407f8b8260f11e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d72ddf6b94134791a407f8b8260f11e4"}]}] Aug 24 10:17:40.103906 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1668017167 Aug 24 10:17:40.103906 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: d72ddf6b94134791a407f8b8260f11e4 Aug 24 10:17:40.103906 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1668017167 Aug 24 10:17:40.103906 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ImagesMetadataNegativeTestJSON-1668017167-project Aug 24 10:17:40.103906 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:17:40.103906 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:17:40.103906 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: a40a204f72924d96be796ae961584c84 Aug 24 10:17:40.103906 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1668017167-project Aug 24 10:17:40.103906 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:17:40.103906 n-d-849328-3 devstack@n-api.service[122432]: exception: Image not found. Aug 24 10:17:40.103906 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'image_id': 'af38bcd1-8805-454b-82b4-f03c5090e972', 'id': 'os_version'} Aug 24 10:17:40.103906 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:17:40.104758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:40.104758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 10:17:40.104758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 10:17:40.104758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:17:40.104758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:17:40.104758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 10:17:40.104758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 10:17:40.104758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:17:40.104758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:17:40.104758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 10:17:40.104758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 10:17:40.104758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 10:17:40.104758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 10:17:40.104758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:17:40.104758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:17:40.104758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:17:40.104758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:17:40.104758 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID af38bcd1-8805-454b-82b4-f03c5090e972 Aug 24 10:17:40.106342 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:17:40.106342 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:40.106342 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:17:40.106342 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:40.106342 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 24 10:17:40.106342 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 24 10:17:40.106342 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 10:17:40.106342 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 10:17:40.106342 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 10:17:40.106342 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 10:17:40.106342 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 10:17:40.106342 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 10:17:40.106342 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 10:17:40.106342 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 10:17:40.106342 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:17:40.106342 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:17:40.106342 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 10:17:40.106342 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 10:17:40.106342 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:17:40.106342 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:17:40.108480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 10:17:40.108480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 10:17:40.108480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 10:17:40.108480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 10:17:40.108480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:17:40.108480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:17:40.108480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:17:40.108480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:17:40.108480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image af38bcd1-8805-454b-82b4-f03c5090e972 could not be found. Aug 24 10:17:40.108480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:17:40.108480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:40.108480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:17:40.108480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:40.108480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:17:40.108480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:17:40.108480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:17:40.108480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:17:40.108480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:17:40.108480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:17:40.110414 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:17:40.110414 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:17:40.110414 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 24 10:17:40.110414 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 24 10:17:40.110414 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 24 10:17:40.110414 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 10:17:40.110414 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 10:17:40.110414 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:17:40.110414 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:40.110414 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:17:40.110414 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:40.110414 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:17:40.110414 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:17:40.110414 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:17:40.110414 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:17:40.110414 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 10:17:40.110414 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:17:40.114396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1f17c0e9-2ed4-4b43-a252-695fce25bba9 tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] Returning 404 to user: Image not found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:17:40.114396 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1f17c0e9-2ed4-4b43-a252-695fce25bba9 tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] 10.222.0.85 "GET /compute/v2.1/images/af38bcd1-8805-454b-82b4-f03c5090e972/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.086635 Aug 24 10:17:40.114948 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 658/1423] 10.222.0.85 () {58 vars in 1293 bytes} [Wed Aug 24 10:17:40 2022] GET /compute/v2.1/images/af38bcd1-8805-454b-82b4-f03c5090e972/metadata/os_version => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:17:40.126689 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-85892d7e-ab0a-4e5b-bdfb-14ec3cc69a86 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:40.131547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-85892d7e-ab0a-4e5b-bdfb-14ec3cc69a86 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:40.149966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85892d7e-ab0a-4e5b-bdfb-14ec3cc69a86 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:40.150739 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85892d7e-ab0a-4e5b-bdfb-14ec3cc69a86 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:40.151175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85892d7e-ab0a-4e5b-bdfb-14ec3cc69a86 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:40.151901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85892d7e-ab0a-4e5b-bdfb-14ec3cc69a86 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:40.152353 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85892d7e-ab0a-4e5b-bdfb-14ec3cc69a86 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:40.155234 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85892d7e-ab0a-4e5b-bdfb-14ec3cc69a86 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:40.507792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-85892d7e-ab0a-4e5b-bdfb-14ec3cc69a86 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:40.525638 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-85892d7e-ab0a-4e5b-bdfb-14ec3cc69a86 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1477 microversion: 2.1 time: 0.407340 Aug 24 10:17:40.527300 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 659/1424] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:40 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1477 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:40.542800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-dd4391aa-3d66-4aa2-bbf5-3075580e8946 req-a323e23c-b908-4a9e-aaac-ad612e703062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fd5ebf9-816f-442a-806d-4cf19678a3d2", "name": "network-vif-plugged", "status": "completed", "tag": "212e5fdb-8c9a-4d12-9b94-4e13e5984aa1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:40.563290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dd4391aa-3d66-4aa2-bbf5-3075580e8946 req-a323e23c-b908-4a9e-aaac-ad612e703062 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:40.564183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dd4391aa-3d66-4aa2-bbf5-3075580e8946 req-a323e23c-b908-4a9e-aaac-ad612e703062 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:40.564774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dd4391aa-3d66-4aa2-bbf5-3075580e8946 req-a323e23c-b908-4a9e-aaac-ad612e703062 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:40.612091 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-dd4391aa-3d66-4aa2-bbf5-3075580e8946 req-a323e23c-b908-4a9e-aaac-ad612e703062 service nova] Creating event network-vif-plugged:212e5fdb-8c9a-4d12-9b94-4e13e5984aa1 for instance 1fd5ebf9-816f-442a-806d-4cf19678a3d2 on n-h2-849328-3 Aug 24 10:17:40.621140 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-dd4391aa-3d66-4aa2-bbf5-3075580e8946 req-a323e23c-b908-4a9e-aaac-ad612e703062 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090934 Aug 24 10:17:40.623235 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 660/1425] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:40.638866 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6ae2dea6-191f-4b40-ac75-14b71f5bb93e tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:40.639790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6ae2dea6-191f-4b40-ac75-14b71f5bb93e tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:40.664501 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ae2dea6-191f-4b40-ac75-14b71f5bb93e tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:40.675695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ae2dea6-191f-4b40-ac75-14b71f5bb93e tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:40.676607 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ae2dea6-191f-4b40-ac75-14b71f5bb93e tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:40.677426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ae2dea6-191f-4b40-ac75-14b71f5bb93e tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:40.677913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ae2dea6-191f-4b40-ac75-14b71f5bb93e tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:40.678482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ae2dea6-191f-4b40-ac75-14b71f5bb93e tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:40.986585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6ae2dea6-191f-4b40-ac75-14b71f5bb93e tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:40.995532 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6ae2dea6-191f-4b40-ac75-14b71f5bb93e tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1470 microversion: 2.1 time: 0.368354 Aug 24 10:17:40.997818 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 661/1426] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:40 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1470 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:41.028031 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f43907cb-5e06-4179-b132-6a1f48885949 tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] Calling method '.version_select at 0x7f4654f348b0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:41.066180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-604a618a-b140-4f76-a46a-74eff2868198 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:17:41.067230 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-604a618a-b140-4f76-a46a-74eff2868198 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:17:41.067888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-604a618a-b140-4f76-a46a-74eff2868198 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:17:41.068474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-604a618a-b140-4f76-a46a-74eff2868198 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:17:41.069311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-604a618a-b140-4f76-a46a-74eff2868198 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:17:41.078405 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-f43907cb-5e06-4179-b132-6a1f48885949 tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] HTTP exception thrown: Image not found. Aug 24 10:17:41.088110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f43907cb-5e06-4179-b132-6a1f48885949 tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] Request method failure captured: Aug 24 10:17:41.088110 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/images/51e17112-3c44-4a84-b195-53e7d57b4a8e/metadata HTTP/1.1 Aug 24 10:17:41.088110 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:17:41.088110 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:17:41.088110 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:17:41.088110 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:17:41.088110 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:17:41.088110 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:17:41.088110 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:17:41.088110 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:17:41.088110 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfrCpdP-MWnIVDjNHYhfLTUi-taRDCgJD6ZKV5BrMDjjUzmXR_xoKBH-zMp3hOjRHX_STpUJYDapbkl6os6CiEFmO0fTLzvZGDWk9-jV-cnuD8nBm6QEyqv5tGreSA2z12mFX8eJVdlLCTQNocqUpiOdxPCdL6ph_imsU_a6MO5xyCw Aug 24 10:17:41.088110 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:17:41.088110 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:17:41.088110 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:17:41.088110 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:17:41.088110 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:17:41.088110 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:17:41.088110 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: d72ddf6b94134791a407f8b8260f11e4 Aug 24 10:17:41.088110 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1668017167 Aug 24 10:17:41.088110 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:17:41.088110 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:17:41.089721 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d72ddf6b94134791a407f8b8260f11e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d72ddf6b94134791a407f8b8260f11e4", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d72ddf6b94134791a407f8b8260f11e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d72ddf6b94134791a407f8b8260f11e4"}]}] Aug 24 10:17:41.089721 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1668017167 Aug 24 10:17:41.089721 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: d72ddf6b94134791a407f8b8260f11e4 Aug 24 10:17:41.089721 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1668017167 Aug 24 10:17:41.089721 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ImagesMetadataNegativeTestJSON-1668017167-project Aug 24 10:17:41.089721 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:17:41.089721 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:17:41.089721 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: a40a204f72924d96be796ae961584c84 Aug 24 10:17:41.089721 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1668017167-project Aug 24 10:17:41.089721 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:17:41.089721 n-d-849328-3 devstack@n-api.service[122432]: exception: Image not found. Aug 24 10:17:41.089721 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'image_id': '51e17112-3c44-4a84-b195-53e7d57b4a8e'} Aug 24 10:17:41.089721 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:17:41.090549 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:41.090549 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 10:17:41.090549 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 10:17:41.090549 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:17:41.090549 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:17:41.090549 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 10:17:41.090549 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 10:17:41.090549 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:17:41.090549 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:17:41.090549 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 10:17:41.090549 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 10:17:41.090549 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 10:17:41.090549 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 10:17:41.090549 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:17:41.090549 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:17:41.090549 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:17:41.090549 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:17:41.090549 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 51e17112-3c44-4a84-b195-53e7d57b4a8e Aug 24 10:17:41.091639 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:17:41.091639 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:41.091639 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:17:41.091639 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:41.091639 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 24 10:17:41.091639 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 24 10:17:41.091639 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 10:17:41.091639 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 10:17:41.091639 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 10:17:41.091639 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 10:17:41.091639 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 10:17:41.091639 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 10:17:41.091639 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 10:17:41.091639 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 10:17:41.091639 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:17:41.091639 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:17:41.091639 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 10:17:41.091639 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 10:17:41.091639 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:17:41.091639 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:17:41.092904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 10:17:41.092904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 10:17:41.092904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 10:17:41.092904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 10:17:41.092904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:17:41.092904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:17:41.092904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:17:41.092904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:17:41.092904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 51e17112-3c44-4a84-b195-53e7d57b4a8e could not be found. Aug 24 10:17:41.092904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:17:41.092904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:41.092904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:17:41.092904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:41.092904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:17:41.092904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:17:41.092904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:17:41.092904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:17:41.092904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:17:41.092904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:17:41.095730 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:17:41.095730 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:17:41.095730 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 24 10:17:41.095730 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 24 10:17:41.095730 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 24 10:17:41.095730 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 10:17:41.095730 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 10:17:41.095730 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:17:41.095730 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:41.095730 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:17:41.095730 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:41.095730 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:17:41.095730 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:17:41.095730 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:17:41.095730 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:17:41.095730 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 10:17:41.095730 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:17:41.095730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f43907cb-5e06-4179-b132-6a1f48885949 tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] Returning 404 to user: Image not found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:17:41.099865 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f43907cb-5e06-4179-b132-6a1f48885949 tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] 10.222.0.85 "GET /compute/v2.1/images/51e17112-3c44-4a84-b195-53e7d57b4a8e/metadata" status: 404 len: 62 microversion: 2.1 time: 0.069247 Aug 24 10:17:41.099865 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 662/1427] 10.222.0.85 () {58 vars in 1260 bytes} [Wed Aug 24 10:17:41 2022] GET /compute/v2.1/images/51e17112-3c44-4a84-b195-53e7d57b4a8e/metadata => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:17:41.103333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cf2f5f98-f4fa-43a4-a832-77c587f87c9b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:41.107123 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-604a618a-b140-4f76-a46a-74eff2868198 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:41.108279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cf2f5f98-f4fa-43a4-a832-77c587f87c9b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:41.109657 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-604a618a-b140-4f76-a46a-74eff2868198 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:41.110449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-604a618a-b140-4f76-a46a-74eff2868198 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:41.114589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-604a618a-b140-4f76-a46a-74eff2868198 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:41.115448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-604a618a-b140-4f76-a46a-74eff2868198 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:41.120350 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-604a618a-b140-4f76-a46a-74eff2868198 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:41.128193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf2f5f98-f4fa-43a4-a832-77c587f87c9b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:41.129821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf2f5f98-f4fa-43a4-a832-77c587f87c9b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:41.130985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf2f5f98-f4fa-43a4-a832-77c587f87c9b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:41.133733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf2f5f98-f4fa-43a4-a832-77c587f87c9b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:41.134412 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf2f5f98-f4fa-43a4-a832-77c587f87c9b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:41.137270 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf2f5f98-f4fa-43a4-a832-77c587f87c9b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:41.172447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-604a618a-b140-4f76-a46a-74eff2868198 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Getting quotas for project 6f266868d6374a82a4ba5333915a9884. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:41.188799 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-604a618a-b140-4f76-a46a-74eff2868198 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Getting quotas for user b321b1490c2b4fe3aa1a1747b25408a1 and project 6f266868d6374a82a4ba5333915a9884. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:41.205105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-604a618a-b140-4f76-a46a-74eff2868198 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:17:41.207454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-604a618a-b140-4f76-a46a-74eff2868198 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:17:41.284844 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-604a618a-b140-4f76-a46a-74eff2868198 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.317879 Aug 24 10:17:41.285858 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 766/1428] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:17:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 2325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:17:41.291006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2ac02b89-f6a7-405a-a5fb-081a30014f35 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4654f5a820>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:41.376086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cf2f5f98-f4fa-43a4-a832-77c587f87c9b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:41.381729 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2ac02b89-f6a7-405a-a5fb-081a30014f35 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7" status: 200 len: 1440 microversion: 2.1 time: 0.093789 Aug 24 10:17:41.382338 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 767/1429] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:17:41 2022] GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7 => generated 1440 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:41.385642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cf2f5f98-f4fa-43a4-a832-77c587f87c9b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:41.387151 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cf2f5f98-f4fa-43a4-a832-77c587f87c9b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:41.388332 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cf2f5f98-f4fa-43a4-a832-77c587f87c9b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1477 microversion: 2.25 time: 0.293265 Aug 24 10:17:41.392141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b619db6d-fb2c-413d-a6b9-19f893150f3a tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] Action: 'update_all', calling method: .version_select at 0x7f4654ebc280>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:41.397424 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 663/1430] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:17:41 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1477 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:17:41.407894 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2c1b2363-5827-44e4-aba1-182d44358d0e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-909428451", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "a969b0fd-b630-4047-b3ad-4616a6620bdd"}, {"port": "8478aaa2-cb78-4f37-9c11-cebf1b8242a0", "tag": "port-1"}, {"port": "526b6293-9fd8-4d13-a1f7-daec4c52af4a", "tag": "port-2"}, {"uuid": "e2909c7d-0efb-48af-90b5-048721cf0841", "tag": "net-1"}, {"uuid": "e2909c7d-0efb-48af-90b5-048721cf0841"}, {"uuid": "db177bfc-1cb3-4a46-9381-26d608821cd6", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "db177bfc-1cb3-4a46-9381-26d608821cd6", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "84d93e82-18fd-4ebf-8831-8b55c7b094b9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "cae602c1-a8d6-48f6-a39a-db9009e63e15", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "5e7a0fa3-4432-4ed0-8a7d-44bf3b8d7527", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--928679015"}], "key_name": "tempest-keypair-1656422405", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:41.431718 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-b619db6d-fb2c-413d-a6b9-19f893150f3a tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] HTTP exception thrown: Image not found. Aug 24 10:17:41.438578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b619db6d-fb2c-413d-a6b9-19f893150f3a tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] Request method failure captured: Aug 24 10:17:41.438578 n-d-849328-3 devstack@n-api.service[122433]: request: PUT /compute/v2.1/images/d9370929-f775-48b8-9804-f63345146895/metadata HTTP/1.1 Aug 24 10:17:41.438578 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:17:41.438578 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:17:41.438578 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:17:41.438578 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 57 Aug 24 10:17:41.438578 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:17:41.438578 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:17:41.438578 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:17:41.438578 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:17:41.438578 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfrCpdP-MWnIVDjNHYhfLTUi-taRDCgJD6ZKV5BrMDjjUzmXR_xoKBH-zMp3hOjRHX_STpUJYDapbkl6os6CiEFmO0fTLzvZGDWk9-jV-cnuD8nBm6QEyqv5tGreSA2z12mFX8eJVdlLCTQNocqUpiOdxPCdL6ph_imsU_a6MO5xyCw Aug 24 10:17:41.438578 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:17:41.438578 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:17:41.438578 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:17:41.438578 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:17:41.438578 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:17:41.438578 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:17:41.438578 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d72ddf6b94134791a407f8b8260f11e4 Aug 24 10:17:41.438578 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1668017167 Aug 24 10:17:41.438578 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:17:41.438578 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:17:41.440443 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d72ddf6b94134791a407f8b8260f11e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d72ddf6b94134791a407f8b8260f11e4", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d72ddf6b94134791a407f8b8260f11e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d72ddf6b94134791a407f8b8260f11e4"}]}] Aug 24 10:17:41.440443 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1668017167 Aug 24 10:17:41.440443 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d72ddf6b94134791a407f8b8260f11e4 Aug 24 10:17:41.440443 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1668017167 Aug 24 10:17:41.440443 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesMetadataNegativeTestJSON-1668017167-project Aug 24 10:17:41.440443 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:17:41.440443 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:17:41.440443 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: a40a204f72924d96be796ae961584c84 Aug 24 10:17:41.440443 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1668017167-project Aug 24 10:17:41.440443 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:17:41.440443 n-d-849328-3 devstack@n-api.service[122433]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 24 10:17:41.440443 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:17:41.440443 n-d-849328-3 devstack@n-api.service[122433]: exception: Image not found. Aug 24 10:17:41.441424 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'image_id': 'd9370929-f775-48b8-9804-f63345146895', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 24 10:17:41.441424 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:17:41.441424 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:41.441424 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 10:17:41.441424 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 10:17:41.441424 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:17:41.441424 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:17:41.441424 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 10:17:41.441424 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 10:17:41.441424 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:17:41.441424 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:17:41.441424 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 10:17:41.441424 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 10:17:41.441424 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 10:17:41.441424 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 10:17:41.441424 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:17:41.441424 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:17:41.441424 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:17:41.442775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:17:41.442775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d9370929-f775-48b8-9804-f63345146895 Aug 24 10:17:41.442775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:41.442775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:41.442775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:41.442775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:41.442775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 24 10:17:41.442775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 24 10:17:41.442775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 10:17:41.442775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 10:17:41.442775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 10:17:41.442775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 10:17:41.442775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 10:17:41.442775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 10:17:41.442775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 10:17:41.442775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 10:17:41.442775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:17:41.442775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:17:41.442775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 10:17:41.442775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 10:17:41.444285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:17:41.444285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:17:41.444285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 10:17:41.444285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 10:17:41.444285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 10:17:41.444285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 10:17:41.444285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:17:41.444285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:17:41.444285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:17:41.444285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:17:41.444285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d9370929-f775-48b8-9804-f63345146895 could not be found. Aug 24 10:17:41.444285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:41.444285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:41.444285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:41.444285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:41.444285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:17:41.444285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:17:41.444285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:17:41.444285 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:17:41.446136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:17:41.446136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:17:41.446136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:17:41.446136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:17:41.446136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:17:41.446136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:17:41.446136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 24 10:17:41.446136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 24 10:17:41.446136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 24 10:17:41.446136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 10:17:41.446136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 10:17:41.446136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:41.446136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:41.446136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:41.446136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:41.446136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:17:41.446136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:17:41.446136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:17:41.446136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:17:41.446136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 10:17:41.446136 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:41.449276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b619db6d-fb2c-413d-a6b9-19f893150f3a tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] Returning 404 to user: Image not found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:17:41.464096 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b619db6d-fb2c-413d-a6b9-19f893150f3a tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] 10.222.0.85 "PUT /compute/v2.1/images/d9370929-f775-48b8-9804-f63345146895/metadata" status: 404 len: 62 microversion: 2.1 time: 0.074801 Aug 24 10:17:41.465434 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 768/1431] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:17:41 2022] PUT /compute/v2.1/images/d9370929-f775-48b8-9804-f63345146895/metadata => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:17:41.486512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-291b14fe-b41f-4dda-bb0c-116afeb1bc9d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:41.487540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-291b14fe-b41f-4dda-bb0c-116afeb1bc9d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:41.592013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-291b14fe-b41f-4dda-bb0c-116afeb1bc9d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:41.600186 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-291b14fe-b41f-4dda-bb0c-116afeb1bc9d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1234 microversion: 2.1 time: 0.132754 Aug 24 10:17:41.601788 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 769/1432] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:41 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1234 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:41.902003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-2c1b2363-5827-44e4-aba1-182d44358d0e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] validate_networks() for [('a969b0fd-b630-4047-b3ad-4616a6620bdd', None, None, None, None, None), (None, None, '8478aaa2-cb78-4f37-9c11-cebf1b8242a0', None, None, None), (None, None, '526b6293-9fd8-4d13-a1f7-daec4c52af4a', None, None, None), ('e2909c7d-0efb-48af-90b5-048721cf0841', None, None, None, None, None), ('e2909c7d-0efb-48af-90b5-048721cf0841', None, None, None, None, None), ('db177bfc-1cb3-4a46-9381-26d608821cd6', '10.2.2.100', None, None, None, None), ('db177bfc-1cb3-4a46-9381-26d608821cd6', '10.2.2.200', None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:17:42.091902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0e145401-1116-48d2-ae4f-223a0394209b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:42.092674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0e145401-1116-48d2-ae4f-223a0394209b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:42.107833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e145401-1116-48d2-ae4f-223a0394209b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:42.108594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e145401-1116-48d2-ae4f-223a0394209b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:42.109150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e145401-1116-48d2-ae4f-223a0394209b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:42.110147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e145401-1116-48d2-ae4f-223a0394209b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:42.111238 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e145401-1116-48d2-ae4f-223a0394209b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:42.116642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e145401-1116-48d2-ae4f-223a0394209b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:42.524510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-0e145401-1116-48d2-ae4f-223a0394209b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lazy-loading 'services' on Instance uuid 0e607951-c58f-41ce-bb92-a9399d534b2b {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:17:42.556869 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0e145401-1116-48d2-ae4f-223a0394209b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1970 microversion: 2.25 time: 0.940318 Aug 24 10:17:42.561008 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 770/1433] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:17:41 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1970 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:17:42.575698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d6fb7235-959d-42bf-9ad3-6d4a3439c4ab tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] Action: 'update', calling method: .version_select at 0x7f4654f3f3a0>, body: {"meta": {"os_distro": "alt"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:42.659001 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-d6fb7235-959d-42bf-9ad3-6d4a3439c4ab tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] HTTP exception thrown: Image not found. Aug 24 10:17:42.661555 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d6fb7235-959d-42bf-9ad3-6d4a3439c4ab tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] Request method failure captured: Aug 24 10:17:42.661555 n-d-849328-3 devstack@n-api.service[122433]: request: PUT /compute/v2.1/images/603dc4d5-50f5-4424-b91a-9b34696372ae/metadata/os_distro HTTP/1.1 Aug 24 10:17:42.661555 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:17:42.661555 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:17:42.661555 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:17:42.661555 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 30 Aug 24 10:17:42.661555 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:17:42.661555 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:17:42.661555 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:17:42.661555 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:17:42.661555 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfrCpdP-MWnIVDjNHYhfLTUi-taRDCgJD6ZKV5BrMDjjUzmXR_xoKBH-zMp3hOjRHX_STpUJYDapbkl6os6CiEFmO0fTLzvZGDWk9-jV-cnuD8nBm6QEyqv5tGreSA2z12mFX8eJVdlLCTQNocqUpiOdxPCdL6ph_imsU_a6MO5xyCw Aug 24 10:17:42.661555 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:17:42.661555 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:17:42.661555 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:17:42.661555 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:17:42.661555 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:17:42.661555 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:17:42.661555 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d72ddf6b94134791a407f8b8260f11e4 Aug 24 10:17:42.661555 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1668017167 Aug 24 10:17:42.661555 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:17:42.661555 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:17:42.663346 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d72ddf6b94134791a407f8b8260f11e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d72ddf6b94134791a407f8b8260f11e4", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d72ddf6b94134791a407f8b8260f11e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d72ddf6b94134791a407f8b8260f11e4"}]}] Aug 24 10:17:42.663346 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1668017167 Aug 24 10:17:42.663346 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d72ddf6b94134791a407f8b8260f11e4 Aug 24 10:17:42.663346 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1668017167 Aug 24 10:17:42.663346 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesMetadataNegativeTestJSON-1668017167-project Aug 24 10:17:42.663346 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:17:42.663346 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:17:42.663346 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: a40a204f72924d96be796ae961584c84 Aug 24 10:17:42.663346 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1668017167-project Aug 24 10:17:42.663346 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:17:42.663346 n-d-849328-3 devstack@n-api.service[122433]: {"meta": {"os_distro": "alt"}} Aug 24 10:17:42.663346 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:17:42.663346 n-d-849328-3 devstack@n-api.service[122433]: exception: Image not found. Aug 24 10:17:42.663346 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'image_id': '603dc4d5-50f5-4424-b91a-9b34696372ae', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 24 10:17:42.664442 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:17:42.664442 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:42.664442 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 10:17:42.664442 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 10:17:42.664442 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:17:42.664442 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:17:42.664442 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 10:17:42.664442 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 10:17:42.664442 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:17:42.664442 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:17:42.664442 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 10:17:42.664442 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 10:17:42.664442 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 10:17:42.664442 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 10:17:42.664442 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:17:42.664442 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:17:42.664442 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:17:42.664442 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:17:42.665709 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 603dc4d5-50f5-4424-b91a-9b34696372ae Aug 24 10:17:42.665709 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:42.665709 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:42.665709 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:42.665709 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:42.665709 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 24 10:17:42.665709 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 24 10:17:42.665709 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 10:17:42.665709 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 10:17:42.665709 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 10:17:42.665709 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 10:17:42.665709 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 10:17:42.665709 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 10:17:42.665709 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 10:17:42.665709 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 10:17:42.665709 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:17:42.665709 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:17:42.665709 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 10:17:42.665709 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 10:17:42.667193 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:17:42.667193 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:17:42.667193 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 10:17:42.667193 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 10:17:42.667193 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 10:17:42.667193 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 10:17:42.667193 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:17:42.667193 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:17:42.667193 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:17:42.667193 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:17:42.667193 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 603dc4d5-50f5-4424-b91a-9b34696372ae could not be found. Aug 24 10:17:42.667193 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:42.667193 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:42.667193 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:42.667193 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:42.667193 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:17:42.667193 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:17:42.667193 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:17:42.667193 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:17:42.668754 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:17:42.668754 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:17:42.668754 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:17:42.668754 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:17:42.668754 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:17:42.668754 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:17:42.668754 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 24 10:17:42.668754 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 24 10:17:42.668754 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 24 10:17:42.668754 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 10:17:42.668754 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 10:17:42.668754 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:42.668754 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:42.668754 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:42.668754 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:42.668754 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:17:42.668754 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:17:42.668754 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:17:42.668754 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:17:42.668754 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 10:17:42.668754 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:42.670455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d6fb7235-959d-42bf-9ad3-6d4a3439c4ab tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] Returning 404 to user: Image not found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:17:42.670455 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d6fb7235-959d-42bf-9ad3-6d4a3439c4ab tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] 10.222.0.85 "PUT /compute/v2.1/images/603dc4d5-50f5-4424-b91a-9b34696372ae/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.100894 Aug 24 10:17:42.670455 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 771/1434] 10.222.0.85 () {60 vars in 1310 bytes} [Wed Aug 24 10:17:42 2022] PUT /compute/v2.1/images/603dc4d5-50f5-4424-b91a-9b34696372ae/metadata/os_distro => generated 62 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:17:42.675873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f78733b2-e2eb-423e-ae08-08b9cfbc4865 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:42.676754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f78733b2-e2eb-423e-ae08-08b9cfbc4865 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:42.700851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f78733b2-e2eb-423e-ae08-08b9cfbc4865 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:42.702891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f78733b2-e2eb-423e-ae08-08b9cfbc4865 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:42.707032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f78733b2-e2eb-423e-ae08-08b9cfbc4865 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:42.710630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f78733b2-e2eb-423e-ae08-08b9cfbc4865 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:42.711414 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f78733b2-e2eb-423e-ae08-08b9cfbc4865 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:42.715971 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f78733b2-e2eb-423e-ae08-08b9cfbc4865 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:43.517020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f78733b2-e2eb-423e-ae08-08b9cfbc4865 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:43.533429 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f78733b2-e2eb-423e-ae08-08b9cfbc4865 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1477 microversion: 2.1 time: 0.866783 Aug 24 10:17:43.536346 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 772/1435] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:42 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1477 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:43.561327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-96ee184d-6748-47b0-871a-bdc09cc97075 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:43.562976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-96ee184d-6748-47b0-871a-bdc09cc97075 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:43.597438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96ee184d-6748-47b0-871a-bdc09cc97075 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:43.603619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96ee184d-6748-47b0-871a-bdc09cc97075 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:43.607090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96ee184d-6748-47b0-871a-bdc09cc97075 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:43.609404 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96ee184d-6748-47b0-871a-bdc09cc97075 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:43.610674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96ee184d-6748-47b0-871a-bdc09cc97075 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:43.612863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96ee184d-6748-47b0-871a-bdc09cc97075 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:44.006471 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-96ee184d-6748-47b0-871a-bdc09cc97075 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:44.019636 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-96ee184d-6748-47b0-871a-bdc09cc97075 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1470 microversion: 2.1 time: 0.479318 Aug 24 10:17:44.035922 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 773/1436] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:43 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1470 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:44.041024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-291feed5-04dc-4954-b2e9-8c3190b91f85 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4654f3f3a0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:44.112775 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-291feed5-04dc-4954-b2e9-8c3190b91f85 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7" status: 200 len: 1440 microversion: 2.1 time: 0.075395 Aug 24 10:17:44.113816 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 774/1437] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:17:44 2022] GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7 => generated 1440 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:44.119073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dde2bd2c-58e7-4c3e-b861-d37bf6a5543b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:44.119695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dde2bd2c-58e7-4c3e-b861-d37bf6a5543b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:44.145347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dde2bd2c-58e7-4c3e-b861-d37bf6a5543b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:44.145900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dde2bd2c-58e7-4c3e-b861-d37bf6a5543b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:44.146452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dde2bd2c-58e7-4c3e-b861-d37bf6a5543b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:44.150147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dde2bd2c-58e7-4c3e-b861-d37bf6a5543b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:44.150699 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dde2bd2c-58e7-4c3e-b861-d37bf6a5543b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:44.152356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dde2bd2c-58e7-4c3e-b861-d37bf6a5543b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:44.208706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:44.471574 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-dde2bd2c-58e7-4c3e-b861-d37bf6a5543b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lazy-loading 'services' on Instance uuid 0e607951-c58f-41ce-bb92-a9399d534b2b {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:17:44.540152 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dde2bd2c-58e7-4c3e-b861-d37bf6a5543b tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1970 microversion: 2.25 time: 0.423768 Aug 24 10:17:44.541369 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 775/1438] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:17:44 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1970 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:17:44.583788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-108b8a1e-e192-4334-9c27-808e42fe2b6b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:44.584559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-108b8a1e-e192-4334-9c27-808e42fe2b6b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:44.607594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-108b8a1e-e192-4334-9c27-808e42fe2b6b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:44.609109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-108b8a1e-e192-4334-9c27-808e42fe2b6b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:44.611473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-108b8a1e-e192-4334-9c27-808e42fe2b6b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:44.612417 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-108b8a1e-e192-4334-9c27-808e42fe2b6b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:44.616428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-108b8a1e-e192-4334-9c27-808e42fe2b6b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:44.619537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-108b8a1e-e192-4334-9c27-808e42fe2b6b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:44.822832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=24 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:44.999994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-108b8a1e-e192-4334-9c27-808e42fe2b6b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:45.023111 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-108b8a1e-e192-4334-9c27-808e42fe2b6b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1292 microversion: 2.1 time: 0.456657 Aug 24 10:17:45.029295 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 776/1439] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:44 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1292 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:45.054904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d5dd8c31-dabd-4cd9-a3a4-0c67b6870f66 tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] Action: 'create', calling method: .version_select at 0x7f4654f5a4c0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:45.109056 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-d5dd8c31-dabd-4cd9-a3a4-0c67b6870f66 tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] HTTP exception thrown: Image not found. Aug 24 10:17:45.113807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d5dd8c31-dabd-4cd9-a3a4-0c67b6870f66 tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] Request method failure captured: Aug 24 10:17:45.113807 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/images/8cd5a26b-f9ba-4645-9539-16ff89286755/metadata HTTP/1.1 Aug 24 10:17:45.113807 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:17:45.113807 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:17:45.113807 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:17:45.113807 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 57 Aug 24 10:17:45.113807 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:17:45.113807 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:17:45.113807 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:17:45.113807 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:17:45.113807 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfrCpdP-MWnIVDjNHYhfLTUi-taRDCgJD6ZKV5BrMDjjUzmXR_xoKBH-zMp3hOjRHX_STpUJYDapbkl6os6CiEFmO0fTLzvZGDWk9-jV-cnuD8nBm6QEyqv5tGreSA2z12mFX8eJVdlLCTQNocqUpiOdxPCdL6ph_imsU_a6MO5xyCw Aug 24 10:17:45.113807 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:17:45.113807 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:17:45.113807 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:17:45.113807 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:17:45.113807 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:17:45.113807 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:17:45.113807 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d72ddf6b94134791a407f8b8260f11e4 Aug 24 10:17:45.113807 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1668017167 Aug 24 10:17:45.113807 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:17:45.113807 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:17:45.118008 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d72ddf6b94134791a407f8b8260f11e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d72ddf6b94134791a407f8b8260f11e4", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d72ddf6b94134791a407f8b8260f11e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d72ddf6b94134791a407f8b8260f11e4"}]}] Aug 24 10:17:45.118008 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1668017167 Aug 24 10:17:45.118008 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d72ddf6b94134791a407f8b8260f11e4 Aug 24 10:17:45.118008 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1668017167 Aug 24 10:17:45.118008 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesMetadataNegativeTestJSON-1668017167-project Aug 24 10:17:45.118008 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:17:45.118008 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:17:45.118008 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: a40a204f72924d96be796ae961584c84 Aug 24 10:17:45.118008 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1668017167-project Aug 24 10:17:45.118008 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:17:45.118008 n-d-849328-3 devstack@n-api.service[122433]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 24 10:17:45.118008 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:17:45.118008 n-d-849328-3 devstack@n-api.service[122433]: exception: Image not found. Aug 24 10:17:45.118008 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'image_id': '8cd5a26b-f9ba-4645-9539-16ff89286755', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 24 10:17:45.119369 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:17:45.119369 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:45.119369 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 10:17:45.119369 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 10:17:45.119369 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:17:45.119369 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:17:45.119369 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 10:17:45.119369 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 10:17:45.119369 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:17:45.119369 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:17:45.119369 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 10:17:45.119369 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 10:17:45.119369 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 10:17:45.119369 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 10:17:45.119369 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:17:45.119369 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:17:45.119369 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:17:45.119369 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:17:45.120755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8cd5a26b-f9ba-4645-9539-16ff89286755 Aug 24 10:17:45.120755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:45.120755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:45.120755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:45.120755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:45.120755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 24 10:17:45.120755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 24 10:17:45.120755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 10:17:45.120755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 10:17:45.120755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 10:17:45.120755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 10:17:45.120755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 10:17:45.120755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 10:17:45.120755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 10:17:45.120755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 10:17:45.120755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:17:45.120755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:17:45.120755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 10:17:45.120755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 10:17:45.122218 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:17:45.122218 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:17:45.122218 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 10:17:45.122218 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 10:17:45.122218 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 10:17:45.122218 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 10:17:45.122218 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:17:45.122218 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:17:45.122218 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:17:45.122218 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:17:45.122218 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8cd5a26b-f9ba-4645-9539-16ff89286755 could not be found. Aug 24 10:17:45.122218 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:45.122218 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:45.122218 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:45.122218 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:45.122218 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:17:45.122218 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:17:45.122218 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:17:45.122218 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:17:45.123654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:17:45.123654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:17:45.123654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:17:45.123654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:17:45.123654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:17:45.123654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:17:45.123654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 24 10:17:45.123654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 24 10:17:45.123654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 24 10:17:45.123654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 10:17:45.123654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 10:17:45.123654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:45.123654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:17:45.123654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:45.123654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:17:45.123654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:17:45.123654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:17:45.123654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:17:45.123654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:17:45.123654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 10:17:45.123654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:17:45.134598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d5dd8c31-dabd-4cd9-a3a4-0c67b6870f66 tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] Returning 404 to user: Image not found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:17:45.136313 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d5dd8c31-dabd-4cd9-a3a4-0c67b6870f66 tempest-ImagesMetadataNegativeTestJSON-1668017167 tempest-ImagesMetadataNegativeTestJSON-1668017167-project] 10.222.0.85 "POST /compute/v2.1/images/8cd5a26b-f9ba-4645-9539-16ff89286755/metadata" status: 404 len: 62 microversion: 2.1 time: 0.105036 Aug 24 10:17:45.145309 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 777/1440] 10.222.0.85 () {60 vars in 1281 bytes} [Wed Aug 24 10:17:45 2022] POST /compute/v2.1/images/8cd5a26b-f9ba-4645-9539-16ff89286755/metadata => generated 62 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:17:45.156203 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6f2b544d-e9ef-43b4-809b-a3e7ace3aa86 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:45.158599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6f2b544d-e9ef-43b4-809b-a3e7ace3aa86 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:45.198458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f2b544d-e9ef-43b4-809b-a3e7ace3aa86 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:45.199249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f2b544d-e9ef-43b4-809b-a3e7ace3aa86 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:45.199903 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f2b544d-e9ef-43b4-809b-a3e7ace3aa86 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:45.200882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f2b544d-e9ef-43b4-809b-a3e7ace3aa86 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:45.207391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f2b544d-e9ef-43b4-809b-a3e7ace3aa86 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:45.210411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f2b544d-e9ef-43b4-809b-a3e7ace3aa86 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:46.023739 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6f2b544d-e9ef-43b4-809b-a3e7ace3aa86 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:46.038745 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6f2b544d-e9ef-43b4-809b-a3e7ace3aa86 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1477 microversion: 2.1 time: 0.891573 Aug 24 10:17:46.039499 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 778/1441] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:45 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1477 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:46.065617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6d99244e-30fd-4243-83ff-9f1576f3ff4e tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:46.070906 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:17:46.070906 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:17:46.089405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d99244e-30fd-4243-83ff-9f1576f3ff4e tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:46.093560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d99244e-30fd-4243-83ff-9f1576f3ff4e tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:46.094248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d99244e-30fd-4243-83ff-9f1576f3ff4e tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:46.096348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d99244e-30fd-4243-83ff-9f1576f3ff4e tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:46.097043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d99244e-30fd-4243-83ff-9f1576f3ff4e tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:46.099688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d99244e-30fd-4243-83ff-9f1576f3ff4e tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:46.195747 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6d99244e-30fd-4243-83ff-9f1576f3ff4e tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] 10.222.0.85 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.134312 Aug 24 10:17:46.204280 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 779/1442] 10.222.0.85 () {60 vars in 1217 bytes} [Wed Aug 24 10:17:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:17:46.214299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3b4d7a04-50a8-48c3-a1c5-84e9f03316dc tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:46.217362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3b4d7a04-50a8-48c3-a1c5-84e9f03316dc tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:46.242229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b4d7a04-50a8-48c3-a1c5-84e9f03316dc tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:46.242995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b4d7a04-50a8-48c3-a1c5-84e9f03316dc tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:46.243633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b4d7a04-50a8-48c3-a1c5-84e9f03316dc tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:46.247724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b4d7a04-50a8-48c3-a1c5-84e9f03316dc tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:46.258897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b4d7a04-50a8-48c3-a1c5-84e9f03316dc tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:46.263183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b4d7a04-50a8-48c3-a1c5-84e9f03316dc tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:46.799543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3b4d7a04-50a8-48c3-a1c5-84e9f03316dc tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:46.815658 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3b4d7a04-50a8-48c3-a1c5-84e9f03316dc tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1470 microversion: 2.1 time: 0.604385 Aug 24 10:17:46.817792 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 780/1443] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:46 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1470 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:46.828812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-88385890-1cfd-48a3-adb1-ffd6fb4e8218 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4654eef940>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:46.950532 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-88385890-1cfd-48a3-adb1-ffd6fb4e8218 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7" status: 200 len: 1440 microversion: 2.1 time: 0.129088 Aug 24 10:17:46.952669 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 781/1444] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:17:46 2022] GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7 => generated 1440 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:46.971761 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9a33cbd1-d1e1-4304-b9ed-2ebebf25efc3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:46.972644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9a33cbd1-d1e1-4304-b9ed-2ebebf25efc3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:46.998622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:47.010034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a33cbd1-d1e1-4304-b9ed-2ebebf25efc3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:47.012849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a33cbd1-d1e1-4304-b9ed-2ebebf25efc3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:47.014814 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a33cbd1-d1e1-4304-b9ed-2ebebf25efc3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:47.021352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a33cbd1-d1e1-4304-b9ed-2ebebf25efc3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:47.022890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a33cbd1-d1e1-4304-b9ed-2ebebf25efc3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:47.026775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a33cbd1-d1e1-4304-b9ed-2ebebf25efc3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:47.708148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9a33cbd1-d1e1-4304-b9ed-2ebebf25efc3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:47.731447 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9a33cbd1-d1e1-4304-b9ed-2ebebf25efc3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1360 microversion: 2.1 time: 0.773032 Aug 24 10:17:47.732682 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 782/1445] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:46 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1360 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:47.749094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0b51b3f6-2934-475f-9195-3c8ea5ec5751 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-849328-3", "block_migration": "auto"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:47.756450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0b51b3f6-2934-475f-9195-3c8ea5ec5751 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:47.780548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b51b3f6-2934-475f-9195-3c8ea5ec5751 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:47.783090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b51b3f6-2934-475f-9195-3c8ea5ec5751 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:47.784698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b51b3f6-2934-475f-9195-3c8ea5ec5751 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:47.788654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b51b3f6-2934-475f-9195-3c8ea5ec5751 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:47.789445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b51b3f6-2934-475f-9195-3c8ea5ec5751 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:47.789986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b51b3f6-2934-475f-9195-3c8ea5ec5751 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:48.001647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-0b51b3f6-2934-475f-9195-3c8ea5ec5751 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lazy-loading 'flavor' on Instance uuid 0e607951-c58f-41ce-bb92-a9399d534b2b {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:17:48.109918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0b51b3f6-2934-475f-9195-3c8ea5ec5751 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Going to try to live migrate instance to n-h2-849328-3 {{(pid=122433) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 10:17:48.430932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2c1b2363-5827-44e4-aba1-182d44358d0e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:17:48.431759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2c1b2363-5827-44e4-aba1-182d44358d0e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:17:48.432140 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2c1b2363-5827-44e4-aba1-182d44358d0e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:17:48.432550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2c1b2363-5827-44e4-aba1-182d44358d0e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:17:48.432962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2c1b2363-5827-44e4-aba1-182d44358d0e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:17:48.438561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:48.470086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c1b2363-5827-44e4-aba1-182d44358d0e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:48.470596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c1b2363-5827-44e4-aba1-182d44358d0e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:48.471051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c1b2363-5827-44e4-aba1-182d44358d0e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:48.471802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c1b2363-5827-44e4-aba1-182d44358d0e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:48.472261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c1b2363-5827-44e4-aba1-182d44358d0e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:48.472688 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c1b2363-5827-44e4-aba1-182d44358d0e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:48.511759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-2c1b2363-5827-44e4-aba1-182d44358d0e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Getting quotas for project ad01394db2334c029874ee8e14e227f5. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:48.522789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-2c1b2363-5827-44e4-aba1-182d44358d0e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Getting quotas for user b24e6810543444048cf6e0871f5521eb and project ad01394db2334c029874ee8e14e227f5. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:49.045343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2c1b2363-5827-44e4-aba1-182d44358d0e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:17:49.048222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2c1b2363-5827-44e4-aba1-182d44358d0e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='84d93e82-18fd-4ebf-8831-8b55c7b094b9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='cae602c1-a8d6-48f6-a39a-db9009e63e15',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e7a0fa3-4432-4ed0-8a7d-44bf3b8d7527',volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:17:49.762831 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2c1b2363-5827-44e4-aba1-182d44358d0e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 8.362713 Aug 24 10:17:49.766799 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 664/1446] 10.222.0.85 () {62 vars in 1189 bytes} [Wed Aug 24 10:17:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 8369 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 10:17:49.784455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-78f9ce98-52b9-42f8-b71c-462dc5b0d723 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:49.788241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-78f9ce98-52b9-42f8-b71c-462dc5b0d723 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:49.799663 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78f9ce98-52b9-42f8-b71c-462dc5b0d723 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:49.801689 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78f9ce98-52b9-42f8-b71c-462dc5b0d723 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:49.804334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78f9ce98-52b9-42f8-b71c-462dc5b0d723 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:49.814444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78f9ce98-52b9-42f8-b71c-462dc5b0d723 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:49.815301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78f9ce98-52b9-42f8-b71c-462dc5b0d723 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:49.816035 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78f9ce98-52b9-42f8-b71c-462dc5b0d723 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:51.118113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-78f9ce98-52b9-42f8-b71c-462dc5b0d723 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:51.151101 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-78f9ce98-52b9-42f8-b71c-462dc5b0d723 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1477 microversion: 2.1 time: 1.381599 Aug 24 10:17:51.155544 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 665/1447] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:49 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1477 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:51.172841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-93514e46-23a7-4489-99d2-474e88b79b1a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:51.176269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-93514e46-23a7-4489-99d2-474e88b79b1a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:51.194030 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93514e46-23a7-4489-99d2-474e88b79b1a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:51.194951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93514e46-23a7-4489-99d2-474e88b79b1a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:51.195635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93514e46-23a7-4489-99d2-474e88b79b1a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:51.201452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93514e46-23a7-4489-99d2-474e88b79b1a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:51.203766 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93514e46-23a7-4489-99d2-474e88b79b1a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:51.206232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93514e46-23a7-4489-99d2-474e88b79b1a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:51.596849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=28 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:52.002025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-93514e46-23a7-4489-99d2-474e88b79b1a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:52.021727 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-93514e46-23a7-4489-99d2-474e88b79b1a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1476 microversion: 2.1 time: 0.863114 Aug 24 10:17:52.027759 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 666/1448] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:51 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1476 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:52.058196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-089ff55f-96c2-46ad-a1e8-f2bb11f4f2af tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4654fd69d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:52.114148 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-089ff55f-96c2-46ad-a1e8-f2bb11f4f2af tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7" status: 200 len: 1440 microversion: 2.1 time: 0.083763 Aug 24 10:17:52.116334 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 667/1449] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:17:52 2022] GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7 => generated 1440 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:52.122026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0955f17b-b89d-4239-ab51-3db2aa7fc499 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:52.124151 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0955f17b-b89d-4239-ab51-3db2aa7fc499 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:52.132251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0955f17b-b89d-4239-ab51-3db2aa7fc499 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:52.132857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0955f17b-b89d-4239-ab51-3db2aa7fc499 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:52.133376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0955f17b-b89d-4239-ab51-3db2aa7fc499 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:52.134163 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0955f17b-b89d-4239-ab51-3db2aa7fc499 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:52.134642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0955f17b-b89d-4239-ab51-3db2aa7fc499 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:52.135085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0955f17b-b89d-4239-ab51-3db2aa7fc499 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:52.271868 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0b51b3f6-2934-475f-9195-3c8ea5ec5751 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b/action" status: 202 len: 0 microversion: 2.25 time: 4.535833 Aug 24 10:17:52.272603 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 783/1450] 10.222.0.85 () {62 vars in 1319 bytes} [Wed Aug 24 10:17:47 2022] POST /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b/action => generated 0 bytes in 4539 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:17:52.419890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fe87c39f-4982-44cc-bcf2-55296b5e3e62 tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] Action: 'create', calling method: .version_select at 0x7f46550dc700>, body: {"keypair": {"name": "tempest-keypair-2074841460", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuh2gO1limZFIwwudbWRrgtJO8FvSWI5d7ry+CVuL2I9xc2+snl8J0IuEngRvqo4GWK+g4GJ4bTPZ9sc5zonJhAc2LRXol7HCHh5pn6Vn5gOypSsGFd1+VFJ3X+QIdrMg=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:52.470508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-fe87c39f-4982-44cc-bcf2-55296b5e3e62 tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] Getting quotas for project c84e1f57b22445418dfef42fc6a6b644. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:52.479137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-fe87c39f-4982-44cc-bcf2-55296b5e3e62 tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] Getting quotas for user 7254513375ed4c5495973461b08a2486 and project c84e1f57b22445418dfef42fc6a6b644. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:52.558610 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fe87c39f-4982-44cc-bcf2-55296b5e3e62 tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.284868 Aug 24 10:17:52.564721 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 784/1451] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:17:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:52.584242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-38a88930-269e-40a6-8781-70f68f666321 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:52.584870 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-38a88930-269e-40a6-8781-70f68f666321 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:52.597662 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38a88930-269e-40a6-8781-70f68f666321 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:52.599805 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38a88930-269e-40a6-8781-70f68f666321 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:52.600567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38a88930-269e-40a6-8781-70f68f666321 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:52.608900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38a88930-269e-40a6-8781-70f68f666321 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:52.610627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38a88930-269e-40a6-8781-70f68f666321 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:52.611425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38a88930-269e-40a6-8781-70f68f666321 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:52.669333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0955f17b-b89d-4239-ab51-3db2aa7fc499 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:52.686624 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0955f17b-b89d-4239-ab51-3db2aa7fc499 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1360 microversion: 2.1 time: 0.568505 Aug 24 10:17:52.687232 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 668/1452] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:52 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1360 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:52.703630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-cc65c4fd-3dec-4365-b206-a3175ba13ed8 req-55eea8a4-bfbd-4ce4-a27f-f586d6639793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b390fef-6be9-4e24-b31e-b6f6252c88c1", "name": "network-vif-unplugged", "status": "completed", "tag": "50041625-3e09-4ff3-9bab-8be84832b786"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:52.725275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cc65c4fd-3dec-4365-b206-a3175ba13ed8 req-55eea8a4-bfbd-4ce4-a27f-f586d6639793 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:52.726449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cc65c4fd-3dec-4365-b206-a3175ba13ed8 req-55eea8a4-bfbd-4ce4-a27f-f586d6639793 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:52.726889 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cc65c4fd-3dec-4365-b206-a3175ba13ed8 req-55eea8a4-bfbd-4ce4-a27f-f586d6639793 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:52.758101 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-cc65c4fd-3dec-4365-b206-a3175ba13ed8 req-55eea8a4-bfbd-4ce4-a27f-f586d6639793 service nova] Creating event network-vif-unplugged:50041625-3e09-4ff3-9bab-8be84832b786 for instance 6b390fef-6be9-4e24-b31e-b6f6252c88c1 on n-h2-849328-3 Aug 24 10:17:52.770885 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-cc65c4fd-3dec-4365-b206-a3175ba13ed8 req-55eea8a4-bfbd-4ce4-a27f-f586d6639793 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076381 Aug 24 10:17:52.776059 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 669/1453] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:52.784037 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-fb5602b8-a952-477d-8cc4-f2ef35dac78c req-5b656aeb-eaaf-4b94-abec-5237b785bf6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d844e7a-a6af-4c55-957c-a997c42927af", "tag": "c818b602-5bd6-46ee-96c2-c41b38b25689"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:52.809155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fb5602b8-a952-477d-8cc4-f2ef35dac78c req-5b656aeb-eaaf-4b94-abec-5237b785bf6b service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:52.811465 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fb5602b8-a952-477d-8cc4-f2ef35dac78c req-5b656aeb-eaaf-4b94-abec-5237b785bf6b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:52.813824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fb5602b8-a952-477d-8cc4-f2ef35dac78c req-5b656aeb-eaaf-4b94-abec-5237b785bf6b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:52.814678 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-38a88930-269e-40a6-8781-70f68f666321 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:52.832646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-38a88930-269e-40a6-8781-70f68f666321 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:52.840069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-38a88930-269e-40a6-8781-70f68f666321 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:52.841518 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-38a88930-269e-40a6-8781-70f68f666321 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1593 microversion: 2.32 time: 0.275534 Aug 24 10:17:52.842183 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 785/1454] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:17:52 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1593 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:17:52.847125 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-fb5602b8-a952-477d-8cc4-f2ef35dac78c req-5b656aeb-eaaf-4b94-abec-5237b785bf6b service nova] Creating event network-changed:c818b602-5bd6-46ee-96c2-c41b38b25689 for instance 4d844e7a-a6af-4c55-957c-a997c42927af on n-h1-849328-3 Aug 24 10:17:52.858026 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-fb5602b8-a952-477d-8cc4-f2ef35dac78c req-5b656aeb-eaaf-4b94-abec-5237b785bf6b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079067 Aug 24 10:17:52.859799 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 670/1455] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:52.868863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-78d32125-8a1e-40bf-97cd-bf294d21fd28 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:52.870371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-78d32125-8a1e-40bf-97cd-bf294d21fd28 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:52.875428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1d2cce00-8737-4ba4-bc08-0084f67c4884 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:52.877550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1d2cce00-8737-4ba4-bc08-0084f67c4884 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:52.884773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d2cce00-8737-4ba4-bc08-0084f67c4884 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:52.885612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d2cce00-8737-4ba4-bc08-0084f67c4884 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:52.886240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d2cce00-8737-4ba4-bc08-0084f67c4884 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:52.887309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d2cce00-8737-4ba4-bc08-0084f67c4884 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:52.888186 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d2cce00-8737-4ba4-bc08-0084f67c4884 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:52.888857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d2cce00-8737-4ba4-bc08-0084f67c4884 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:52.889559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78d32125-8a1e-40bf-97cd-bf294d21fd28 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:52.890053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78d32125-8a1e-40bf-97cd-bf294d21fd28 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:52.890489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78d32125-8a1e-40bf-97cd-bf294d21fd28 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:52.891283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78d32125-8a1e-40bf-97cd-bf294d21fd28 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:52.891734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78d32125-8a1e-40bf-97cd-bf294d21fd28 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:52.892158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78d32125-8a1e-40bf-97cd-bf294d21fd28 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:53.228315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-78d32125-8a1e-40bf-97cd-bf294d21fd28 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:53.238593 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-78d32125-8a1e-40bf-97cd-bf294d21fd28 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1477 microversion: 2.1 time: 0.373611 Aug 24 10:17:53.241681 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 786/1456] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:52 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1477 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:53.261730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c17a1f1-1678-45ed-8000-902f39bbbff2 tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] Calling method '.version_select at 0x7f4654fbe160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:53.303030 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2c17a1f1-1678-45ed-8000-902f39bbbff2 tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] 10.222.0.85 "GET /compute/v2.1/os-keypairs/tempest-keypair-2074841460" status: 200 len: 498 microversion: 2.1 time: 0.058301 Aug 24 10:17:53.310894 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 787/1457] 10.222.0.85 () {58 vars in 1218 bytes} [Wed Aug 24 10:17:53 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2074841460 => generated 498 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:53.324212 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6bb275bc-c7bd-47e3-9d91-0604fa196f48 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:53.325397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6bb275bc-c7bd-47e3-9d91-0604fa196f48 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:53.341549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bb275bc-c7bd-47e3-9d91-0604fa196f48 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:53.342477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bb275bc-c7bd-47e3-9d91-0604fa196f48 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:53.343160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bb275bc-c7bd-47e3-9d91-0604fa196f48 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:53.345772 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bb275bc-c7bd-47e3-9d91-0604fa196f48 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:53.350081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bb275bc-c7bd-47e3-9d91-0604fa196f48 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:53.350788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bb275bc-c7bd-47e3-9d91-0604fa196f48 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:53.604829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6bb275bc-c7bd-47e3-9d91-0604fa196f48 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:53.616197 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6bb275bc-c7bd-47e3-9d91-0604fa196f48 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1476 microversion: 2.1 time: 0.300669 Aug 24 10:17:53.617546 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 788/1458] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:53 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1476 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:53.624296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ce15d94-2b93-4b15-88c7-9fbb5d88d2c5 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f46550739d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:53.699332 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8ce15d94-2b93-4b15-88c7-9fbb5d88d2c5 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7" status: 200 len: 1440 microversion: 2.1 time: 0.080297 Aug 24 10:17:53.700049 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 789/1459] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:17:53 2022] GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7 => generated 1440 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:53.718737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0e6692fa-9a1d-47b9-a007-3e6b5ce1a55f tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] Calling method '.version_select at 0x7f4654efb0d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:53.768640 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0e6692fa-9a1d-47b9-a007-3e6b5ce1a55f tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2074841460" status: 202 len: 0 microversion: 2.1 time: 0.064816 Aug 24 10:17:53.771016 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 790/1460] 10.222.0.85 () {58 vars in 1221 bytes} [Wed Aug 24 10:17:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2074841460 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:17:53.786184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-73b9a2f0-dd7c-4a9d-a3cf-42bdd67a026b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:53.787622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-73b9a2f0-dd7c-4a9d-a3cf-42bdd67a026b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:53.797219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73b9a2f0-dd7c-4a9d-a3cf-42bdd67a026b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:53.798124 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73b9a2f0-dd7c-4a9d-a3cf-42bdd67a026b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:53.798806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73b9a2f0-dd7c-4a9d-a3cf-42bdd67a026b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:53.799972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73b9a2f0-dd7c-4a9d-a3cf-42bdd67a026b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:53.800669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73b9a2f0-dd7c-4a9d-a3cf-42bdd67a026b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:53.801478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73b9a2f0-dd7c-4a9d-a3cf-42bdd67a026b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:53.832336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1d2cce00-8737-4ba4-bc08-0084f67c4884 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:53.851022 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1d2cce00-8737-4ba4-bc08-0084f67c4884 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:53.854533 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1d2cce00-8737-4ba4-bc08-0084f67c4884 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:53.857475 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1d2cce00-8737-4ba4-bc08-0084f67c4884 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1487 microversion: 2.25 time: 0.996221 Aug 24 10:17:53.858677 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 671/1461] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:17:52 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1487 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:17:53.865261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0cebc0b2-6294-46e3-808e-ed8d96c74f59 tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] Action: 'create', calling method: .version_select at 0x7f46550c23a0>, body: {"keypair": {"name": "tempest-keypair-876306390", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaAtxvxcEaGhI7aJU/m0tE5SvemPhaI3JGzsHLGUqpD9H6Ye71C3LlGynHXObOmlEfNnoVJzdd58Vr9CjzldcqAf4SRNRpHKs2YjaFYpNZdGTnROIzcVKcp0mBZ7VAZgw=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:53.901170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-0cebc0b2-6294-46e3-808e-ed8d96c74f59 tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] Getting quotas for project c84e1f57b22445418dfef42fc6a6b644. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:53.908280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-0cebc0b2-6294-46e3-808e-ed8d96c74f59 tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] Getting quotas for user 7254513375ed4c5495973461b08a2486 and project c84e1f57b22445418dfef42fc6a6b644. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:53.952876 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0cebc0b2-6294-46e3-808e-ed8d96c74f59 tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.091968 Aug 24 10:17:53.953663 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 672/1462] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:17:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:53.963981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ca83c7de-16c4-4199-86a3-a02307f496ce tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:53.964994 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ca83c7de-16c4-4199-86a3-a02307f496ce tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:53.973335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca83c7de-16c4-4199-86a3-a02307f496ce tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:53.974224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca83c7de-16c4-4199-86a3-a02307f496ce tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:53.974914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca83c7de-16c4-4199-86a3-a02307f496ce tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:53.976128 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca83c7de-16c4-4199-86a3-a02307f496ce tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:53.976847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca83c7de-16c4-4199-86a3-a02307f496ce tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:53.977543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca83c7de-16c4-4199-86a3-a02307f496ce tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:54.195733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ca83c7de-16c4-4199-86a3-a02307f496ce tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:54.211928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ca83c7de-16c4-4199-86a3-a02307f496ce tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:54.219925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ca83c7de-16c4-4199-86a3-a02307f496ce tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:54.221631 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ca83c7de-16c4-4199-86a3-a02307f496ce tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1593 microversion: 2.32 time: 0.266578 Aug 24 10:17:54.234907 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 673/1463] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:17:53 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1593 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:17:54.244314 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8716f753-ff78-4707-9883-5bc22d21c698 tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] Calling method '.version_select at 0x7f4655054ca0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:54.308143 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8716f753-ff78-4707-9883-5bc22d21c698 tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-876306390" status: 202 len: 0 microversion: 2.1 time: 0.071304 Aug 24 10:17:54.309059 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 674/1464] 10.222.0.85 () {58 vars in 1218 bytes} [Wed Aug 24 10:17:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-876306390 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:17:54.319372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-269b0bed-a35f-4ef5-a968-b7b425cc5373 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:54.320219 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-269b0bed-a35f-4ef5-a968-b7b425cc5373 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:54.332614 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-269b0bed-a35f-4ef5-a968-b7b425cc5373 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:54.333972 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-269b0bed-a35f-4ef5-a968-b7b425cc5373 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:54.334606 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-269b0bed-a35f-4ef5-a968-b7b425cc5373 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:54.335907 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-269b0bed-a35f-4ef5-a968-b7b425cc5373 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:54.336531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-269b0bed-a35f-4ef5-a968-b7b425cc5373 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:54.337073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-269b0bed-a35f-4ef5-a968-b7b425cc5373 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:54.481166 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-73b9a2f0-dd7c-4a9d-a3cf-42bdd67a026b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:54.491360 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-73b9a2f0-dd7c-4a9d-a3cf-42bdd67a026b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1360 microversion: 2.1 time: 0.718594 Aug 24 10:17:54.492582 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 791/1465] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:53 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1360 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:54.498370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-039b4d8b-a257-486c-a6cd-7afdc5eabf46 tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] Action: 'create', calling method: .version_select at 0x7f4654e7b430>, body: {"keypair": {"name": "tempest-keypair-365954101", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:54.531473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-039b4d8b-a257-486c-a6cd-7afdc5eabf46 tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] Getting quotas for project c84e1f57b22445418dfef42fc6a6b644. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:54.545720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-039b4d8b-a257-486c-a6cd-7afdc5eabf46 tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] Getting quotas for user 7254513375ed4c5495973461b08a2486 and project c84e1f57b22445418dfef42fc6a6b644. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:54.601392 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-039b4d8b-a257-486c-a6cd-7afdc5eabf46 tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.107434 Aug 24 10:17:54.604968 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 792/1466] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:17:54 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:54.618175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7114dd7d-d75b-4591-9334-4308f9ff16b9 tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] Calling method '.version_select at 0x7f46550dc940>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:54.661270 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7114dd7d-d75b-4591-9334-4308f9ff16b9 tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-365954101" status: 202 len: 0 microversion: 2.1 time: 0.049647 Aug 24 10:17:54.662874 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 793/1467] 10.222.0.85 () {58 vars in 1218 bytes} [Wed Aug 24 10:17:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-365954101 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:17:54.679921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-22482322-8272-4339-a006-cebf00210239 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:54.681420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-22482322-8272-4339-a006-cebf00210239 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:54.702077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22482322-8272-4339-a006-cebf00210239 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:54.703015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22482322-8272-4339-a006-cebf00210239 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:54.704035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22482322-8272-4339-a006-cebf00210239 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:54.704994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22482322-8272-4339-a006-cebf00210239 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:54.705716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22482322-8272-4339-a006-cebf00210239 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:54.706364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22482322-8272-4339-a006-cebf00210239 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:54.762067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-269b0bed-a35f-4ef5-a968-b7b425cc5373 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:54.776703 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-269b0bed-a35f-4ef5-a968-b7b425cc5373 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1477 microversion: 2.1 time: 0.466286 Aug 24 10:17:54.777350 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 675/1468] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:54 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1477 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:54.793912 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ab1638c0-f4cd-4115-ad8a-0052b5ace9ba tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] Action: 'create', calling method: .version_select at 0x7f4655054670>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2048541441", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIiH0DA07G1bieVhC0T4r0WOmeXhTXAGSGs1RylSWkzLEzvQU9ahXdqZD6VtA6yapCNEVBo02/L7CWvMxbiLkouIH+NJ++uUm9/tk0FnpZu1rfr2Pvr6byUMjXfpT/1LAQ=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:54.831738 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-ab1638c0-f4cd-4115-ad8a-0052b5ace9ba tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] Getting quotas for project c84e1f57b22445418dfef42fc6a6b644. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:54.847715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-ab1638c0-f4cd-4115-ad8a-0052b5ace9ba tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] Getting quotas for user 7254513375ed4c5495973461b08a2486 and project c84e1f57b22445418dfef42fc6a6b644. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:54.903221 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ab1638c0-f4cd-4115-ad8a-0052b5ace9ba tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.124780 Aug 24 10:17:54.903864 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 676/1469] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:17:54 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:54.909021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d04747c1-ee5b-48c1-bd95-507292830384 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4655012d30>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:54.972998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-22482322-8272-4339-a006-cebf00210239 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:54.985482 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-22482322-8272-4339-a006-cebf00210239 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1476 microversion: 2.1 time: 0.319553 Aug 24 10:17:54.986116 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 794/1470] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:54 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1476 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:54.987213 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d04747c1-ee5b-48c1-bd95-507292830384 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7" status: 200 len: 1440 microversion: 2.1 time: 0.082033 Aug 24 10:17:54.992685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-33f0edab-21f8-4b2a-a92e-0f1c87dcde70 req-f4f897df-c6d9-4eb5-a5f0-62272f33a71a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b390fef-6be9-4e24-b31e-b6f6252c88c1", "name": "network-vif-plugged", "status": "completed", "tag": "50041625-3e09-4ff3-9bab-8be84832b786"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:55.011222 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 677/1471] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:17:54 2022] GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7 => generated 1440 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:55.014683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-33f0edab-21f8-4b2a-a92e-0f1c87dcde70 req-f4f897df-c6d9-4eb5-a5f0-62272f33a71a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:55.015671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-33f0edab-21f8-4b2a-a92e-0f1c87dcde70 req-f4f897df-c6d9-4eb5-a5f0-62272f33a71a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:55.015671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-33f0edab-21f8-4b2a-a92e-0f1c87dcde70 req-f4f897df-c6d9-4eb5-a5f0-62272f33a71a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:55.019905 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bbc877e8-8159-4f51-bcd2-9f3762dc3cee tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:55.020584 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bbc877e8-8159-4f51-bcd2-9f3762dc3cee tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:55.031461 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-33f0edab-21f8-4b2a-a92e-0f1c87dcde70 req-f4f897df-c6d9-4eb5-a5f0-62272f33a71a service nova] Creating event network-vif-plugged:50041625-3e09-4ff3-9bab-8be84832b786 for instance 6b390fef-6be9-4e24-b31e-b6f6252c88c1 on n-h2-849328-3 Aug 24 10:17:55.044769 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-33f0edab-21f8-4b2a-a92e-0f1c87dcde70 req-f4f897df-c6d9-4eb5-a5f0-62272f33a71a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057351 Aug 24 10:17:55.045891 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 795/1472] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:55.056815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-938155d7-d573-488a-af0e-77defe29c797 tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] Action: 'create', calling method: .version_select at 0x7f4654de3820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-285483490", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGetHk7w/F2sdn+c1ybuCoeopnS8bYaKYTfO1Ki3CWn5NGIdLgNWGdE9Qckq0Vptb1BrmJWZI8Gd959d3LV7BVfkc5RlCEz+WfH3QNDPg0PYLzj/ZhGYxMewuUr7LqbuGg=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:55.057411 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbc877e8-8159-4f51-bcd2-9f3762dc3cee tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:55.057944 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbc877e8-8159-4f51-bcd2-9f3762dc3cee tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:55.058389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbc877e8-8159-4f51-bcd2-9f3762dc3cee tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:55.059126 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbc877e8-8159-4f51-bcd2-9f3762dc3cee tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:55.059583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbc877e8-8159-4f51-bcd2-9f3762dc3cee tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:55.065211 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbc877e8-8159-4f51-bcd2-9f3762dc3cee tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:55.148338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-938155d7-d573-488a-af0e-77defe29c797 tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] Getting quotas for project c84e1f57b22445418dfef42fc6a6b644. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:55.158100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-938155d7-d573-488a-af0e-77defe29c797 tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] Getting quotas for user 7254513375ed4c5495973461b08a2486 and project c84e1f57b22445418dfef42fc6a6b644. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:55.253079 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-938155d7-d573-488a-af0e-77defe29c797 tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.205862 Aug 24 10:17:55.254356 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 796/1473] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:17:55 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:55.262519 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b2f11b41-ba8b-46d5-9c3a-c1452783dc27 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:55.262861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b2f11b41-ba8b-46d5-9c3a-c1452783dc27 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:55.283183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2f11b41-ba8b-46d5-9c3a-c1452783dc27 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:55.283687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2f11b41-ba8b-46d5-9c3a-c1452783dc27 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:55.284121 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2f11b41-ba8b-46d5-9c3a-c1452783dc27 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:55.285790 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2f11b41-ba8b-46d5-9c3a-c1452783dc27 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:55.286350 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2f11b41-ba8b-46d5-9c3a-c1452783dc27 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:55.286733 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2f11b41-ba8b-46d5-9c3a-c1452783dc27 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:55.820849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bbc877e8-8159-4f51-bcd2-9f3762dc3cee tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:55.837073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bbc877e8-8159-4f51-bcd2-9f3762dc3cee tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:55.840162 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bbc877e8-8159-4f51-bcd2-9f3762dc3cee tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:55.859150 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bbc877e8-8159-4f51-bcd2-9f3762dc3cee tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1487 microversion: 2.25 time: 0.846457 Aug 24 10:17:55.883164 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 678/1474] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:17:55 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1487 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:17:55.901531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fcff7089-fb3d-4a8f-a50a-6e0979c7e9ce tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] Action: 'create', calling method: .version_select at 0x7f4655017ee0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-176436409", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZcyvv6GGtC4eKsXyBwTTgK2NDKAFlEo2uAm1JmgEP95NG6zma0B2F1lTUM1Aigsh6xVbFqHwjGYs+Bl0+OgO7kec0hjnl5HG5HtmNr5DkeiYwwvHtoJeyTfsJ3rku4IQ=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:56.002374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-fcff7089-fb3d-4a8f-a50a-6e0979c7e9ce tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] Getting quotas for project c84e1f57b22445418dfef42fc6a6b644. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:56.030818 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-fcff7089-fb3d-4a8f-a50a-6e0979c7e9ce tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] Getting quotas for user 7254513375ed4c5495973461b08a2486 and project c84e1f57b22445418dfef42fc6a6b644. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:56.117342 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:56.153065 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fcff7089-fb3d-4a8f-a50a-6e0979c7e9ce tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.267065 Aug 24 10:17:56.160990 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 679/1475] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:17:55 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:56.186214 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b2f11b41-ba8b-46d5-9c3a-c1452783dc27 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:56.222602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b2f11b41-ba8b-46d5-9c3a-c1452783dc27 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:56.236178 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b2f11b41-ba8b-46d5-9c3a-c1452783dc27 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:56.237582 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b2f11b41-ba8b-46d5-9c3a-c1452783dc27 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1660 microversion: 2.32 time: 0.981557 Aug 24 10:17:56.238252 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 797/1476] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:17:55 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1660 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:17:56.268140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a615babc-5b76-408b-983a-e5685b4f8fb6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:56.272572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a615babc-5b76-408b-983a-e5685b4f8fb6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:56.290737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a615babc-5b76-408b-983a-e5685b4f8fb6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:56.291214 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a615babc-5b76-408b-983a-e5685b4f8fb6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:56.291685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a615babc-5b76-408b-983a-e5685b4f8fb6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:56.292497 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a615babc-5b76-408b-983a-e5685b4f8fb6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:56.292964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a615babc-5b76-408b-983a-e5685b4f8fb6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:56.297512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a615babc-5b76-408b-983a-e5685b4f8fb6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:56.365731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-818de12b-dc25-4ec1-87f6-8c15be130598 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1332709571", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "fb3f2cc5-551a-4ee2-a1c9-53adbc2afa42"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:56.539478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-818de12b-dc25-4ec1-87f6-8c15be130598 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] validate_networks() for [('fb3f2cc5-551a-4ee2-a1c9-53adbc2afa42', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:17:57.321824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a615babc-5b76-408b-983a-e5685b4f8fb6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:57.339746 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a615babc-5b76-408b-983a-e5685b4f8fb6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1360 microversion: 2.1 time: 1.083290 Aug 24 10:17:57.353643 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 798/1477] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:56 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1360 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:57.355562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b4766d3d-e031-40ce-8dca-177754125ce8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:57.356730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b4766d3d-e031-40ce-8dca-177754125ce8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:57.369293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4766d3d-e031-40ce-8dca-177754125ce8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:57.369787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4766d3d-e031-40ce-8dca-177754125ce8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:57.370224 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4766d3d-e031-40ce-8dca-177754125ce8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:57.371662 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4766d3d-e031-40ce-8dca-177754125ce8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:57.372145 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4766d3d-e031-40ce-8dca-177754125ce8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:57.372569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4766d3d-e031-40ce-8dca-177754125ce8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:57.724802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b4766d3d-e031-40ce-8dca-177754125ce8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:57.741382 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b4766d3d-e031-40ce-8dca-177754125ce8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1476 microversion: 2.1 time: 0.397419 Aug 24 10:17:57.742894 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 799/1478] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:57 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1476 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:57.749555 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c633cc1c-645e-4971-8789-c809a32c09d5 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4654de3ee0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:57.828733 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c633cc1c-645e-4971-8789-c809a32c09d5 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7" status: 200 len: 1449 microversion: 2.1 time: 0.083477 Aug 24 10:17:57.831184 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 800/1479] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:17:57 2022] GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7 => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:57.846349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-449fe131-f455-41dd-a72c-49d51cc1b968 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:57.847464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-449fe131-f455-41dd-a72c-49d51cc1b968 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:57.864240 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-449fe131-f455-41dd-a72c-49d51cc1b968 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:57.865484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-449fe131-f455-41dd-a72c-49d51cc1b968 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:57.867575 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-449fe131-f455-41dd-a72c-49d51cc1b968 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:57.868654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-449fe131-f455-41dd-a72c-49d51cc1b968 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:57.873487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-449fe131-f455-41dd-a72c-49d51cc1b968 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:57.874431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-449fe131-f455-41dd-a72c-49d51cc1b968 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:57.882638 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:58.203350 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-449fe131-f455-41dd-a72c-49d51cc1b968 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:58.226899 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-449fe131-f455-41dd-a72c-49d51cc1b968 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1476 microversion: 2.1 time: 0.393107 Aug 24 10:17:58.228037 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 801/1480] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:57 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1476 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:58.236966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f5886590-c791-4e16-ae1e-d42122a1bd57 tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] Calling method '.version_select at 0x7f46550e1dc0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:58.282202 n-d-849328-3 devstack@n-api.service[122433]: WARNING oslo_db.sqlalchemy.utils [None req-f5886590-c791-4e16-ae1e-d42122a1bd57 tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 24 10:17:58.299457 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f5886590-c791-4e16-ae1e-d42122a1bd57 tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] 10.222.0.85 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.070119 Aug 24 10:17:58.300075 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 802/1481] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:17:58 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:58.304876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-35f08a46-7f34-43b4-85c7-67e06c8c4e0f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:58.309312 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-35f08a46-7f34-43b4-85c7-67e06c8c4e0f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:58.339257 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35f08a46-7f34-43b4-85c7-67e06c8c4e0f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:58.342278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35f08a46-7f34-43b4-85c7-67e06c8c4e0f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:58.358395 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35f08a46-7f34-43b4-85c7-67e06c8c4e0f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:58.359141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35f08a46-7f34-43b4-85c7-67e06c8c4e0f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:58.360067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35f08a46-7f34-43b4-85c7-67e06c8c4e0f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:58.360067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35f08a46-7f34-43b4-85c7-67e06c8c4e0f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:58.445863 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-818de12b-dc25-4ec1-87f6-8c15be130598 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:17:58.446363 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-818de12b-dc25-4ec1-87f6-8c15be130598 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:17:58.446739 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-818de12b-dc25-4ec1-87f6-8c15be130598 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:17:58.447277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-818de12b-dc25-4ec1-87f6-8c15be130598 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:17:58.447695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-818de12b-dc25-4ec1-87f6-8c15be130598 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:17:58.472108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-818de12b-dc25-4ec1-87f6-8c15be130598 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:58.472604 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-818de12b-dc25-4ec1-87f6-8c15be130598 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:58.473043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-818de12b-dc25-4ec1-87f6-8c15be130598 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:58.473881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-818de12b-dc25-4ec1-87f6-8c15be130598 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:58.474336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-818de12b-dc25-4ec1-87f6-8c15be130598 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:58.474750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-818de12b-dc25-4ec1-87f6-8c15be130598 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:58.516323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-818de12b-dc25-4ec1-87f6-8c15be130598 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Getting quotas for project 014076c393b148618aa03e8e8a0d5be7. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:58.533489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-818de12b-dc25-4ec1-87f6-8c15be130598 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Getting quotas for user a9111f8a2bae4e25a353ebb15eca2d5a and project 014076c393b148618aa03e8e8a0d5be7. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:58.575243 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-818de12b-dc25-4ec1-87f6-8c15be130598 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:17:58.578271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-818de12b-dc25-4ec1-87f6-8c15be130598 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:17:58.675792 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-818de12b-dc25-4ec1-87f6-8c15be130598 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.508489 Aug 24 10:17:58.678278 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 680/1482] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:17:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:17:58.698455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-67affda3-d341-420a-95a4-e67e21bd737b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:58.699509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-67affda3-d341-420a-95a4-e67e21bd737b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:58.735669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67affda3-d341-420a-95a4-e67e21bd737b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:58.741956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67affda3-d341-420a-95a4-e67e21bd737b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:58.743145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67affda3-d341-420a-95a4-e67e21bd737b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:58.744100 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67affda3-d341-420a-95a4-e67e21bd737b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:58.744747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67affda3-d341-420a-95a4-e67e21bd737b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:58.745791 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67affda3-d341-420a-95a4-e67e21bd737b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:58.859435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-35f08a46-7f34-43b4-85c7-67e06c8c4e0f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:58.875645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-35f08a46-7f34-43b4-85c7-67e06c8c4e0f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:58.880483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-35f08a46-7f34-43b4-85c7-67e06c8c4e0f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:58.886598 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-35f08a46-7f34-43b4-85c7-67e06c8c4e0f tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1487 microversion: 2.25 time: 0.580756 Aug 24 10:17:58.901306 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 803/1483] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:17:58 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1487 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:17:58.919961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-651ac6fd-1b44-45b6-a7a3-34645ef75422 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4655185790>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:59.029986 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-651ac6fd-1b44-45b6-a7a3-34645ef75422 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7" status: 200 len: 1449 microversion: 2.1 time: 0.127304 Aug 24 10:17:59.034017 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 804/1484] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:17:58 2022] GET /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7 => generated 1449 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:59.046920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c0d6a31a-3813-475f-bf86-ff22d5e7b0e1 req-55fea515-44c3-412b-93d8-c52bcda79780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6451db-5c2a-422c-84ff-c13e81621a71", "name": "network-vif-unplugged", "status": "completed", "tag": "7d183dba-e72f-4aa1-9c43-d620da8dd93b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:59.096986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c0d6a31a-3813-475f-bf86-ff22d5e7b0e1 req-55fea515-44c3-412b-93d8-c52bcda79780 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:59.097805 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c0d6a31a-3813-475f-bf86-ff22d5e7b0e1 req-55fea515-44c3-412b-93d8-c52bcda79780 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:59.098371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c0d6a31a-3813-475f-bf86-ff22d5e7b0e1 req-55fea515-44c3-412b-93d8-c52bcda79780 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:59.142066 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c0d6a31a-3813-475f-bf86-ff22d5e7b0e1 req-55fea515-44c3-412b-93d8-c52bcda79780 service nova] Creating event network-vif-unplugged:7d183dba-e72f-4aa1-9c43-d620da8dd93b for instance 1f6451db-5c2a-422c-84ff-c13e81621a71 on n-h2-849328-3 Aug 24 10:17:59.159487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-c0d6a31a-3813-475f-bf86-ff22d5e7b0e1 req-55fea515-44c3-412b-93d8-c52bcda79780 service nova] Instance 1f6451db-5c2a-422c-84ff-c13e81621a71 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 10:17:59.175003 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c0d6a31a-3813-475f-bf86-ff22d5e7b0e1 req-55fea515-44c3-412b-93d8-c52bcda79780 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.139530 Aug 24 10:17:59.176213 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 805/1485] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:59.185814 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-54617216-e903-4553-86ea-e18657da162a tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] Calling method '.version_select at 0x7f4654fa9430>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:59.234048 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-54617216-e903-4553-86ea-e18657da162a tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-176436409" status: 202 len: 0 microversion: 2.1 time: 0.054764 Aug 24 10:17:59.237684 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 806/1486] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Aug 24 10:17:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-176436409 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:17:59.244956 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-37e33019-5428-44aa-a71c-e3b881d25235 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:59.246092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-37e33019-5428-44aa-a71c-e3b881d25235 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:59.264630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37e33019-5428-44aa-a71c-e3b881d25235 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:59.268834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37e33019-5428-44aa-a71c-e3b881d25235 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:59.271010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37e33019-5428-44aa-a71c-e3b881d25235 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:59.275847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37e33019-5428-44aa-a71c-e3b881d25235 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:59.276963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37e33019-5428-44aa-a71c-e3b881d25235 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:59.280311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37e33019-5428-44aa-a71c-e3b881d25235 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:59.579930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-67affda3-d341-420a-95a4-e67e21bd737b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:59.615478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-67affda3-d341-420a-95a4-e67e21bd737b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:59.617486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-67affda3-d341-420a-95a4-e67e21bd737b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:59.623832 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-67affda3-d341-420a-95a4-e67e21bd737b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1660 microversion: 2.32 time: 0.943083 Aug 24 10:17:59.626363 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 681/1487] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:17:58 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1660 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:17:59.640906 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-286ce90a-4d8d-4664-8085-09ab34a8eec8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:59.644760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-286ce90a-4d8d-4664-8085-09ab34a8eec8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:59.722710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-37e33019-5428-44aa-a71c-e3b881d25235 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:59.732861 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-37e33019-5428-44aa-a71c-e3b881d25235 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1360 microversion: 2.1 time: 0.493132 Aug 24 10:17:59.744213 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 807/1488] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:59 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1360 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:59.752127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-286ce90a-4d8d-4664-8085-09ab34a8eec8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:59.763202 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-286ce90a-4d8d-4664-8085-09ab34a8eec8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 200 len: 1225 microversion: 2.1 time: 0.132119 Aug 24 10:17:59.763599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-028416e0-dd6d-40cc-987f-da85c2b7e733 req-9f5677d5-1624-4fe5-b2e9-86cfbbea7542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d844e7a-a6af-4c55-957c-a997c42927af", "name": "network-vif-plugged", "status": "completed", "tag": "c818b602-5bd6-46ee-96c2-c41b38b25689"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:59.767259 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 682/1489] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:59 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 1225 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:59.778065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-90f862d7-2391-4ed9-a5ab-d2628323b4e6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:59.781397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-90f862d7-2391-4ed9-a5ab-d2628323b4e6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:59.797079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90f862d7-2391-4ed9-a5ab-d2628323b4e6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:59.799271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90f862d7-2391-4ed9-a5ab-d2628323b4e6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:59.800950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90f862d7-2391-4ed9-a5ab-d2628323b4e6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:59.803149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90f862d7-2391-4ed9-a5ab-d2628323b4e6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:59.803984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-028416e0-dd6d-40cc-987f-da85c2b7e733 req-9f5677d5-1624-4fe5-b2e9-86cfbbea7542 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:59.804483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-028416e0-dd6d-40cc-987f-da85c2b7e733 req-9f5677d5-1624-4fe5-b2e9-86cfbbea7542 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:59.805261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90f862d7-2391-4ed9-a5ab-d2628323b4e6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:59.807655 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90f862d7-2391-4ed9-a5ab-d2628323b4e6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:59.809571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-028416e0-dd6d-40cc-987f-da85c2b7e733 req-9f5677d5-1624-4fe5-b2e9-86cfbbea7542 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:59.849822 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-028416e0-dd6d-40cc-987f-da85c2b7e733 req-9f5677d5-1624-4fe5-b2e9-86cfbbea7542 service nova] Creating event network-vif-plugged:c818b602-5bd6-46ee-96c2-c41b38b25689 for instance 4d844e7a-a6af-4c55-957c-a997c42927af on n-h1-849328-3 Aug 24 10:17:59.872600 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-028416e0-dd6d-40cc-987f-da85c2b7e733 req-9f5677d5-1624-4fe5-b2e9-86cfbbea7542 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126739 Aug 24 10:17:59.878219 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 808/1490] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:59.902361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3065f981-915a-4e9e-8f98-ea79d4cd1f94 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f46551c6670>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:00.425589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-90f862d7-2391-4ed9-a5ab-d2628323b4e6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:00.427966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:00.443312 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-90f862d7-2391-4ed9-a5ab-d2628323b4e6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1476 microversion: 2.1 time: 0.674372 Aug 24 10:18:00.443942 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 683/1491] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:59 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1476 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:00.457735 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-12202bd9-5348-4281-ade6-a197f937caab tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] Calling method '.version_select at 0x7f465505e790>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:00.525462 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-12202bd9-5348-4281-ade6-a197f937caab tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-285483490" status: 202 len: 0 microversion: 2.1 time: 0.079786 Aug 24 10:18:00.526452 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 684/1492] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Aug 24 10:18:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-285483490 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:18:00.534195 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8e614e01-4f6a-49ae-8997-272d17e28052 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:00.534790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8e614e01-4f6a-49ae-8997-272d17e28052 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:00.546065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:DELETE=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:00.558177 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e614e01-4f6a-49ae-8997-272d17e28052 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:00.558930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e614e01-4f6a-49ae-8997-272d17e28052 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:00.559578 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e614e01-4f6a-49ae-8997-272d17e28052 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:00.560915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e614e01-4f6a-49ae-8997-272d17e28052 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:00.562048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e614e01-4f6a-49ae-8997-272d17e28052 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:00.562640 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e614e01-4f6a-49ae-8997-272d17e28052 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:00.856038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8e614e01-4f6a-49ae-8997-272d17e28052 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:00.865651 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8e614e01-4f6a-49ae-8997-272d17e28052 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1462 microversion: 2.1 time: 0.337676 Aug 24 10:18:00.881713 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 685/1493] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:00 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1462 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:00.888320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-66078759-6ac4-4391-8489-9ab3ff071fe6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:00.889525 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-66078759-6ac4-4391-8489-9ab3ff071fe6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:00.896290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66078759-6ac4-4391-8489-9ab3ff071fe6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:00.897111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66078759-6ac4-4391-8489-9ab3ff071fe6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:00.897827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66078759-6ac4-4391-8489-9ab3ff071fe6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:00.898913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66078759-6ac4-4391-8489-9ab3ff071fe6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:00.901267 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66078759-6ac4-4391-8489-9ab3ff071fe6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:00.902178 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66078759-6ac4-4391-8489-9ab3ff071fe6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:00.939261 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3065f981-915a-4e9e-8f98-ea79d4cd1f94 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "DELETE /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7" status: 204 len: 0 microversion: 2.1 time: 1.059247 Aug 24 10:18:00.939952 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 809/1494] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:59 2022] DELETE /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7 => generated 0 bytes in 1061 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:18:00.948413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1ce5251e-9ed8-46dd-8eb9-4624fd22fe9c tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] Calling method '.version_select at 0x7f4655073d30>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:00.976736 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1ce5251e-9ed8-46dd-8eb9-4624fd22fe9c tempest-KeyPairsV2TestJSON-707359097 tempest-KeyPairsV2TestJSON-707359097-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2048541441" status: 202 len: 0 microversion: 2.1 time: 0.032010 Aug 24 10:18:00.977322 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 810/1495] 10.222.0.85 () {58 vars in 1278 bytes} [Wed Aug 24 10:18:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2048541441 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:18:00.985789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-38863409-b36a-4b13-9d99-b717da0ceaf6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:00.986538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-38863409-b36a-4b13-9d99-b717da0ceaf6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:00.995061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38863409-b36a-4b13-9d99-b717da0ceaf6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:00.995833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38863409-b36a-4b13-9d99-b717da0ceaf6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:00.996458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38863409-b36a-4b13-9d99-b717da0ceaf6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:00.997381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38863409-b36a-4b13-9d99-b717da0ceaf6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:00.997984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38863409-b36a-4b13-9d99-b717da0ceaf6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:00.998637 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38863409-b36a-4b13-9d99-b717da0ceaf6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:01.165636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-66078759-6ac4-4391-8489-9ab3ff071fe6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:01.181570 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-66078759-6ac4-4391-8489-9ab3ff071fe6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:01.184107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-66078759-6ac4-4391-8489-9ab3ff071fe6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:01.187218 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-66078759-6ac4-4391-8489-9ab3ff071fe6 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1487 microversion: 2.25 time: 0.303979 Aug 24 10:18:01.192573 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 686/1496] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:00 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1487 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:01.203474 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c4e6569d-e054-4301-abe7-c8b5c86367d8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:01.204119 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c4e6569d-e054-4301-abe7-c8b5c86367d8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:01.226585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4e6569d-e054-4301-abe7-c8b5c86367d8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:01.228607 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4e6569d-e054-4301-abe7-c8b5c86367d8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:01.229107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4e6569d-e054-4301-abe7-c8b5c86367d8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:01.230019 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4e6569d-e054-4301-abe7-c8b5c86367d8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:01.230613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4e6569d-e054-4301-abe7-c8b5c86367d8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:01.231303 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4e6569d-e054-4301-abe7-c8b5c86367d8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:01.329035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-38863409-b36a-4b13-9d99-b717da0ceaf6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:01.369431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-38863409-b36a-4b13-9d99-b717da0ceaf6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:01.380870 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-38863409-b36a-4b13-9d99-b717da0ceaf6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:01.386122 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-38863409-b36a-4b13-9d99-b717da0ceaf6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1706 microversion: 2.32 time: 0.404752 Aug 24 10:18:01.386800 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 811/1497] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:00 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1706 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:01.412321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-536fb4ac-90c3-404a-9ff7-9d62b879d5bd tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:01.416115 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-536fb4ac-90c3-404a-9ff7-9d62b879d5bd tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:01.440062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-536fb4ac-90c3-404a-9ff7-9d62b879d5bd tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:01.446088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-536fb4ac-90c3-404a-9ff7-9d62b879d5bd tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:01.446644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-536fb4ac-90c3-404a-9ff7-9d62b879d5bd tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:01.447409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-536fb4ac-90c3-404a-9ff7-9d62b879d5bd tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:01.452467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-536fb4ac-90c3-404a-9ff7-9d62b879d5bd tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:01.452885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-536fb4ac-90c3-404a-9ff7-9d62b879d5bd tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:01.704643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-536fb4ac-90c3-404a-9ff7-9d62b879d5bd tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:01.706808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c4e6569d-e054-4301-abe7-c8b5c86367d8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:01.716673 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-536fb4ac-90c3-404a-9ff7-9d62b879d5bd tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 200 len: 1285 microversion: 2.1 time: 0.323181 Aug 24 10:18:01.725746 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c4e6569d-e054-4301-abe7-c8b5c86367d8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1360 microversion: 2.1 time: 0.529369 Aug 24 10:18:01.730632 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 812/1498] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:01 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 1285 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:01.736239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-40c68cf8-3a8a-4d62-bed6-e78c482b78fb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:01.736870 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-40c68cf8-3a8a-4d62-bed6-e78c482b78fb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:01.742822 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 687/1499] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:01 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1360 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:01.758667 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3bb61708-d58d-4b59-a7be-5137727e7d79 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:01.787499 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3bb61708-d58d-4b59-a7be-5137727e7d79 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 1fd5ebf9-816f-442a-806d-4cf19678a3d2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:01.789551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40c68cf8-3a8a-4d62-bed6-e78c482b78fb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:01.797780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40c68cf8-3a8a-4d62-bed6-e78c482b78fb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:01.798220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40c68cf8-3a8a-4d62-bed6-e78c482b78fb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:01.803187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40c68cf8-3a8a-4d62-bed6-e78c482b78fb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:01.813548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40c68cf8-3a8a-4d62-bed6-e78c482b78fb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:01.817462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40c68cf8-3a8a-4d62-bed6-e78c482b78fb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:01.845031 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3bb61708-d58d-4b59-a7be-5137727e7d79 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:01.846069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3bb61708-d58d-4b59-a7be-5137727e7d79 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:01.846783 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3bb61708-d58d-4b59-a7be-5137727e7d79 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:01.852691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3bb61708-d58d-4b59-a7be-5137727e7d79 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:01.853453 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3bb61708-d58d-4b59-a7be-5137727e7d79 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:01.861944 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3bb61708-d58d-4b59-a7be-5137727e7d79 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:01.965764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3bb61708-d58d-4b59-a7be-5137727e7d79 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 1fd5ebf9-816f-442a-806d-4cf19678a3d2] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:18:02.159705 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3bb61708-d58d-4b59-a7be-5137727e7d79 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "DELETE /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2" status: 204 len: 0 microversion: 2.1 time: 0.414960 Aug 24 10:18:02.189157 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 688/1500] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:18:01 2022] DELETE /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:18:02.204470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-40c68cf8-3a8a-4d62-bed6-e78c482b78fb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:02.207540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-73933ab5-4d97-46c4-b94e-feed7de54b89 req-070ab31c-2c52-4b3e-bb1b-e58b3e829a8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f6451db-5c2a-422c-84ff-c13e81621a71", "tag": "7d183dba-e72f-4aa1-9c43-d620da8dd93b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:02.218723 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-40c68cf8-3a8a-4d62-bed6-e78c482b78fb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1462 microversion: 2.1 time: 0.484990 Aug 24 10:18:02.222886 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 813/1501] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:01 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1462 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:02.237958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0e2fbc14-9183-4217-8629-a7724a26d75f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:02.245571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0e2fbc14-9183-4217-8629-a7724a26d75f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:02.250755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-73933ab5-4d97-46c4-b94e-feed7de54b89 req-070ab31c-2c52-4b3e-bb1b-e58b3e829a8a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:02.251308 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-73933ab5-4d97-46c4-b94e-feed7de54b89 req-070ab31c-2c52-4b3e-bb1b-e58b3e829a8a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:02.252170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-73933ab5-4d97-46c4-b94e-feed7de54b89 req-070ab31c-2c52-4b3e-bb1b-e58b3e829a8a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:02.262699 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e2fbc14-9183-4217-8629-a7724a26d75f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:02.264211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e2fbc14-9183-4217-8629-a7724a26d75f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:02.267273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e2fbc14-9183-4217-8629-a7724a26d75f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:02.270122 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e2fbc14-9183-4217-8629-a7724a26d75f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:02.282745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e2fbc14-9183-4217-8629-a7724a26d75f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:02.283280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e2fbc14-9183-4217-8629-a7724a26d75f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:02.290376 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-73933ab5-4d97-46c4-b94e-feed7de54b89 req-070ab31c-2c52-4b3e-bb1b-e58b3e829a8a service nova] Creating event network-changed:7d183dba-e72f-4aa1-9c43-d620da8dd93b for instance 1f6451db-5c2a-422c-84ff-c13e81621a71 on n-h2-849328-3 Aug 24 10:18:02.313294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-73933ab5-4d97-46c4-b94e-feed7de54b89 req-070ab31c-2c52-4b3e-bb1b-e58b3e829a8a service nova] Instance 1f6451db-5c2a-422c-84ff-c13e81621a71 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 10:18:02.356503 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-73933ab5-4d97-46c4-b94e-feed7de54b89 req-070ab31c-2c52-4b3e-bb1b-e58b3e829a8a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176467 Aug 24 10:18:02.357685 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 689/1502] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:02.398895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-8a848043-1a2e-4fa8-a2cc-2f541c5e2ab7 req-a6a980cc-75b2-44d9-8e5e-a376ba57502d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fd5ebf9-816f-442a-806d-4cf19678a3d2", "name": "network-vif-unplugged", "status": "completed", "tag": "212e5fdb-8c9a-4d12-9b94-4e13e5984aa1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:02.430770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8a848043-1a2e-4fa8-a2cc-2f541c5e2ab7 req-a6a980cc-75b2-44d9-8e5e-a376ba57502d service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:02.432037 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8a848043-1a2e-4fa8-a2cc-2f541c5e2ab7 req-a6a980cc-75b2-44d9-8e5e-a376ba57502d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:02.444022 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8a848043-1a2e-4fa8-a2cc-2f541c5e2ab7 req-a6a980cc-75b2-44d9-8e5e-a376ba57502d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:02.478653 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-8a848043-1a2e-4fa8-a2cc-2f541c5e2ab7 req-a6a980cc-75b2-44d9-8e5e-a376ba57502d service nova] Creating event network-vif-unplugged:212e5fdb-8c9a-4d12-9b94-4e13e5984aa1 for instance 1fd5ebf9-816f-442a-806d-4cf19678a3d2 on n-h2-849328-3 Aug 24 10:18:02.497784 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-8a848043-1a2e-4fa8-a2cc-2f541c5e2ab7 req-a6a980cc-75b2-44d9-8e5e-a376ba57502d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115338 Aug 24 10:18:02.503101 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 690/1503] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:02.523447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-50032548-accd-4d32-87d0-5ab1b476a315 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:02.524714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-50032548-accd-4d32-87d0-5ab1b476a315 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:02.536902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50032548-accd-4d32-87d0-5ab1b476a315 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:02.537909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50032548-accd-4d32-87d0-5ab1b476a315 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:02.538671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50032548-accd-4d32-87d0-5ab1b476a315 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:02.540036 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50032548-accd-4d32-87d0-5ab1b476a315 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:02.540773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50032548-accd-4d32-87d0-5ab1b476a315 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:02.541661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50032548-accd-4d32-87d0-5ab1b476a315 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:02.793581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0e2fbc14-9183-4217-8629-a7724a26d75f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:02.819811 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0e2fbc14-9183-4217-8629-a7724a26d75f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1474 microversion: 2.1 time: 0.590796 Aug 24 10:18:02.822953 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 814/1504] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:02 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1474 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:02.836362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-87da1fe9-1bc0-47b7-aa81-f88fd815a536 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:02.844177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-87da1fe9-1bc0-47b7-aa81-f88fd815a536 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:02.860978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87da1fe9-1bc0-47b7-aa81-f88fd815a536 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:02.863060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87da1fe9-1bc0-47b7-aa81-f88fd815a536 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:02.864816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87da1fe9-1bc0-47b7-aa81-f88fd815a536 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:02.868060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87da1fe9-1bc0-47b7-aa81-f88fd815a536 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:02.869417 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87da1fe9-1bc0-47b7-aa81-f88fd815a536 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:02.871153 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87da1fe9-1bc0-47b7-aa81-f88fd815a536 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:02.980400 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-50032548-accd-4d32-87d0-5ab1b476a315 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:02.989620 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-50032548-accd-4d32-87d0-5ab1b476a315 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:02.991876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-50032548-accd-4d32-87d0-5ab1b476a315 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:02.993458 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-50032548-accd-4d32-87d0-5ab1b476a315 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1487 microversion: 2.25 time: 0.488587 Aug 24 10:18:02.994319 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 691/1505] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:02 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1487 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:03.015945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9b66c6b3-41fa-4055-9677-060eee88639a tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:03.016791 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9b66c6b3-41fa-4055-9677-060eee88639a tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:03.026917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b66c6b3-41fa-4055-9677-060eee88639a tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:03.028070 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b66c6b3-41fa-4055-9677-060eee88639a tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:03.028681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b66c6b3-41fa-4055-9677-060eee88639a tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:03.029924 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b66c6b3-41fa-4055-9677-060eee88639a tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:03.031713 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b66c6b3-41fa-4055-9677-060eee88639a tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:03.032338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b66c6b3-41fa-4055-9677-060eee88639a tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:03.088763 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:03.097185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-87da1fe9-1bc0-47b7-aa81-f88fd815a536 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:18:03.097603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-87da1fe9-1bc0-47b7-aa81-f88fd815a536 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:18:03.098076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-87da1fe9-1bc0-47b7-aa81-f88fd815a536 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:18:03.098488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-87da1fe9-1bc0-47b7-aa81-f88fd815a536 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:18:03.098900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-87da1fe9-1bc0-47b7-aa81-f88fd815a536 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:18:03.212173 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-87da1fe9-1bc0-47b7-aa81-f88fd815a536 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:03.233963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87da1fe9-1bc0-47b7-aa81-f88fd815a536 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:03.234750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87da1fe9-1bc0-47b7-aa81-f88fd815a536 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:03.236721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87da1fe9-1bc0-47b7-aa81-f88fd815a536 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:03.238762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87da1fe9-1bc0-47b7-aa81-f88fd815a536 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:03.241240 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87da1fe9-1bc0-47b7-aa81-f88fd815a536 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:03.242322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87da1fe9-1bc0-47b7-aa81-f88fd815a536 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:03.331946 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-87da1fe9-1bc0-47b7-aa81-f88fd815a536 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "POST /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1/action" status: 202 len: 1066 microversion: 2.1 time: 0.504765 Aug 24 10:18:03.337158 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 815/1506] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:18:02 2022] POST /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1/action => generated 1066 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 10:18:03.362024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-84345535-4493-4b9e-89d0-b1622c3c9cac tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-184996661", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "b3bbedfb-51dc-4363-a78d-44d0daaa6110"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:03.491669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-84345535-4493-4b9e-89d0-b1622c3c9cac tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] validate_networks() for [('b3bbedfb-51dc-4363-a78d-44d0daaa6110', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:18:03.526581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9b66c6b3-41fa-4055-9677-060eee88639a tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:03.543320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9b66c6b3-41fa-4055-9677-060eee88639a tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:03.545571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9b66c6b3-41fa-4055-9677-060eee88639a tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:03.547768 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9b66c6b3-41fa-4055-9677-060eee88639a tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1752 microversion: 2.32 time: 0.536399 Aug 24 10:18:03.549282 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 692/1507] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:03 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1752 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:03.556503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-87d96205-55cf-41d5-a59c-4460e5937b16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:03.557880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-87d96205-55cf-41d5-a59c-4460e5937b16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:03.565785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87d96205-55cf-41d5-a59c-4460e5937b16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:03.566934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87d96205-55cf-41d5-a59c-4460e5937b16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:03.568012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87d96205-55cf-41d5-a59c-4460e5937b16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:03.569687 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87d96205-55cf-41d5-a59c-4460e5937b16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:03.570357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87d96205-55cf-41d5-a59c-4460e5937b16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:03.570994 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87d96205-55cf-41d5-a59c-4460e5937b16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:03.688133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-87d96205-55cf-41d5-a59c-4460e5937b16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:03.723452 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-87d96205-55cf-41d5-a59c-4460e5937b16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 200 len: 1283 microversion: 2.1 time: 0.172731 Aug 24 10:18:03.727147 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 693/1508] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:03 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 1283 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:03.740518 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-209a9c64-9ee8-41d3-91d3-128eba5edda2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:03.743705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-209a9c64-9ee8-41d3-91d3-128eba5edda2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:03.767076 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-209a9c64-9ee8-41d3-91d3-128eba5edda2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:03.768058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-209a9c64-9ee8-41d3-91d3-128eba5edda2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:03.773703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-209a9c64-9ee8-41d3-91d3-128eba5edda2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:03.778515 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-209a9c64-9ee8-41d3-91d3-128eba5edda2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:03.783910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-209a9c64-9ee8-41d3-91d3-128eba5edda2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:03.785148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-209a9c64-9ee8-41d3-91d3-128eba5edda2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:04.477171 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-209a9c64-9ee8-41d3-91d3-128eba5edda2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:04.513103 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-209a9c64-9ee8-41d3-91d3-128eba5edda2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1542 microversion: 2.1 time: 0.782405 Aug 24 10:18:04.515885 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 694/1509] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:03 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1542 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:04.561761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-525eb1e1-d8bd-4d29-8661-7e9114911dbb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:04.569877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-525eb1e1-d8bd-4d29-8661-7e9114911dbb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:04.588904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-525eb1e1-d8bd-4d29-8661-7e9114911dbb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:04.590325 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-525eb1e1-d8bd-4d29-8661-7e9114911dbb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:04.591971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-525eb1e1-d8bd-4d29-8661-7e9114911dbb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:04.604594 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-525eb1e1-d8bd-4d29-8661-7e9114911dbb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:04.607206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-525eb1e1-d8bd-4d29-8661-7e9114911dbb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:04.608830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-525eb1e1-d8bd-4d29-8661-7e9114911dbb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:05.179964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=12 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:05.375302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-84345535-4493-4b9e-89d0-b1622c3c9cac tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:18:05.375987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-84345535-4493-4b9e-89d0-b1622c3c9cac tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:18:05.377437 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-84345535-4493-4b9e-89d0-b1622c3c9cac tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:18:05.377873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-84345535-4493-4b9e-89d0-b1622c3c9cac tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:18:05.378296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-84345535-4493-4b9e-89d0-b1622c3c9cac tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:18:05.399264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84345535-4493-4b9e-89d0-b1622c3c9cac tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:05.399264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84345535-4493-4b9e-89d0-b1622c3c9cac tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:05.399264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84345535-4493-4b9e-89d0-b1622c3c9cac tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:05.400168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84345535-4493-4b9e-89d0-b1622c3c9cac tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:05.400335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84345535-4493-4b9e-89d0-b1622c3c9cac tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:05.400639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84345535-4493-4b9e-89d0-b1622c3c9cac tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:05.438911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-84345535-4493-4b9e-89d0-b1622c3c9cac tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Getting quotas for project d30703728b2a4a569b6dd1608d8956b8. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:18:05.445680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-84345535-4493-4b9e-89d0-b1622c3c9cac tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Getting quotas for user 85db443623964ed381b2a4cfc7310202 and project d30703728b2a4a569b6dd1608d8956b8. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:18:05.478677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-84345535-4493-4b9e-89d0-b1622c3c9cac tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:18:05.482150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-84345535-4493-4b9e-89d0-b1622c3c9cac tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 29550762-7055-4641-9d00-46151f4a510f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:18:05.681386 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-84345535-4493-4b9e-89d0-b1622c3c9cac tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.342613 Aug 24 10:18:05.688909 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 816/1510] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:18:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:18:05.763812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4919a841-42f6-439f-8b47-55694a062904 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:05.765676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4919a841-42f6-439f-8b47-55694a062904 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:05.780802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4919a841-42f6-439f-8b47-55694a062904 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:05.782616 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4919a841-42f6-439f-8b47-55694a062904 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:05.784219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4919a841-42f6-439f-8b47-55694a062904 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:05.785414 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4919a841-42f6-439f-8b47-55694a062904 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:05.790371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4919a841-42f6-439f-8b47-55694a062904 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:05.791239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4919a841-42f6-439f-8b47-55694a062904 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:05.828213 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-525eb1e1-d8bd-4d29-8661-7e9114911dbb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:05.852114 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-525eb1e1-d8bd-4d29-8661-7e9114911dbb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1471 microversion: 2.1 time: 1.319303 Aug 24 10:18:05.856527 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 695/1511] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:04 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1471 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:05.885503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-66141875-d3df-498e-80c0-8c818f8ea5a4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:05.888710 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-66141875-d3df-498e-80c0-8c818f8ea5a4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:05.899858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66141875-d3df-498e-80c0-8c818f8ea5a4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:05.900777 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66141875-d3df-498e-80c0-8c818f8ea5a4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:05.901554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66141875-d3df-498e-80c0-8c818f8ea5a4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:05.902625 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66141875-d3df-498e-80c0-8c818f8ea5a4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:05.903549 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66141875-d3df-498e-80c0-8c818f8ea5a4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:05.904581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66141875-d3df-498e-80c0-8c818f8ea5a4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:06.553258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-66141875-d3df-498e-80c0-8c818f8ea5a4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:06.575298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-66141875-d3df-498e-80c0-8c818f8ea5a4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:06.577194 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-66141875-d3df-498e-80c0-8c818f8ea5a4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:06.578885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4919a841-42f6-439f-8b47-55694a062904 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:06.579957 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-66141875-d3df-498e-80c0-8c818f8ea5a4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1487 microversion: 2.25 time: 0.721530 Aug 24 10:18:06.593755 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 696/1512] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:05 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1487 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:06.595130 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4919a841-42f6-439f-8b47-55694a062904 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1471 microversion: 2.1 time: 0.903820 Aug 24 10:18:06.596004 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 817/1513] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:05 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1471 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:06.600830 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ef8049d1-d431-4cbe-a4cd-bc510208d110 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:06.613365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4166030e-d74f-47ea-81b3-0c059ae82e4d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:06.614500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4166030e-d74f-47ea-81b3-0c059ae82e4d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:06.615537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ef8049d1-d431-4cbe-a4cd-bc510208d110 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:06.623392 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4166030e-d74f-47ea-81b3-0c059ae82e4d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:06.623898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4166030e-d74f-47ea-81b3-0c059ae82e4d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:06.624343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4166030e-d74f-47ea-81b3-0c059ae82e4d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:06.625065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4166030e-d74f-47ea-81b3-0c059ae82e4d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:06.625555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4166030e-d74f-47ea-81b3-0c059ae82e4d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:06.625985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4166030e-d74f-47ea-81b3-0c059ae82e4d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:06.631405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef8049d1-d431-4cbe-a4cd-bc510208d110 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:06.633055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef8049d1-d431-4cbe-a4cd-bc510208d110 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:06.633796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef8049d1-d431-4cbe-a4cd-bc510208d110 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:06.638986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef8049d1-d431-4cbe-a4cd-bc510208d110 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:06.639686 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef8049d1-d431-4cbe-a4cd-bc510208d110 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:06.640318 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef8049d1-d431-4cbe-a4cd-bc510208d110 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:06.996867 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4166030e-d74f-47ea-81b3-0c059ae82e4d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.401966 Aug 24 10:18:06.997959 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 697/1514] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Aug 24 10:18:06 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af/os-interface => generated 284 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:07.010615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fd1c112c-6114-401c-8524-73866c06fc49 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:07.011271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fd1c112c-6114-401c-8524-73866c06fc49 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:07.025976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ef8049d1-d431-4cbe-a4cd-bc510208d110 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:07.034246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd1c112c-6114-401c-8524-73866c06fc49 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:07.034791 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd1c112c-6114-401c-8524-73866c06fc49 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:07.035241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd1c112c-6114-401c-8524-73866c06fc49 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:07.036042 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd1c112c-6114-401c-8524-73866c06fc49 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:07.036511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd1c112c-6114-401c-8524-73866c06fc49 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:07.036936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd1c112c-6114-401c-8524-73866c06fc49 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:07.070662 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ef8049d1-d431-4cbe-a4cd-bc510208d110 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:07.083441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ef8049d1-d431-4cbe-a4cd-bc510208d110 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:07.091198 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ef8049d1-d431-4cbe-a4cd-bc510208d110 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1798 microversion: 2.32 time: 0.493924 Aug 24 10:18:07.093459 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 818/1515] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:06 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1798 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:07.098712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b25b9f93-3762-4188-9864-af339f2f94ab tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:07.099736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b25b9f93-3762-4188-9864-af339f2f94ab tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 29550762-7055-4641-9d00-46151f4a510f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:07.122590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b25b9f93-3762-4188-9864-af339f2f94ab tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:07.123119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b25b9f93-3762-4188-9864-af339f2f94ab tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:07.123554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b25b9f93-3762-4188-9864-af339f2f94ab tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:07.124268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b25b9f93-3762-4188-9864-af339f2f94ab tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:07.124715 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b25b9f93-3762-4188-9864-af339f2f94ab tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:07.130537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b25b9f93-3762-4188-9864-af339f2f94ab tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:07.318760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b25b9f93-3762-4188-9864-af339f2f94ab tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:07.334840 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b25b9f93-3762-4188-9864-af339f2f94ab tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f" status: 200 len: 1203 microversion: 2.1 time: 0.238471 Aug 24 10:18:07.338154 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 819/1516] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:07 2022] GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f => generated 1203 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:07.357609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-6e4c4ae3-7039-4f6e-a85d-3b945b204fbb req-dcb50bd8-6e67-4ce7-a9ee-d00e1e8cd726 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6451db-5c2a-422c-84ff-c13e81621a71", "name": "network-vif-plugged", "status": "completed", "tag": "7d183dba-e72f-4aa1-9c43-d620da8dd93b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:07.379720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6e4c4ae3-7039-4f6e-a85d-3b945b204fbb req-dcb50bd8-6e67-4ce7-a9ee-d00e1e8cd726 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:07.381504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6e4c4ae3-7039-4f6e-a85d-3b945b204fbb req-dcb50bd8-6e67-4ce7-a9ee-d00e1e8cd726 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:07.382205 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6e4c4ae3-7039-4f6e-a85d-3b945b204fbb req-dcb50bd8-6e67-4ce7-a9ee-d00e1e8cd726 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:07.401581 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-6e4c4ae3-7039-4f6e-a85d-3b945b204fbb req-dcb50bd8-6e67-4ce7-a9ee-d00e1e8cd726 service nova] Creating event network-vif-plugged:7d183dba-e72f-4aa1-9c43-d620da8dd93b for instance 1f6451db-5c2a-422c-84ff-c13e81621a71 on n-h2-849328-3 Aug 24 10:18:07.409528 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-6e4c4ae3-7039-4f6e-a85d-3b945b204fbb req-dcb50bd8-6e67-4ce7-a9ee-d00e1e8cd726 service nova] Instance 1f6451db-5c2a-422c-84ff-c13e81621a71 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 10:18:07.429785 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-6e4c4ae3-7039-4f6e-a85d-3b945b204fbb req-dcb50bd8-6e67-4ce7-a9ee-d00e1e8cd726 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089292 Aug 24 10:18:07.430723 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 820/1517] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:07.444303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-785476db-a054-4937-aa4f-0a8ab621f3e4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:07.445445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-785476db-a054-4937-aa4f-0a8ab621f3e4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:07.454592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-785476db-a054-4937-aa4f-0a8ab621f3e4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:07.455464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-785476db-a054-4937-aa4f-0a8ab621f3e4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:07.456157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-785476db-a054-4937-aa4f-0a8ab621f3e4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:07.457173 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-785476db-a054-4937-aa4f-0a8ab621f3e4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:07.458603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-785476db-a054-4937-aa4f-0a8ab621f3e4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:07.459329 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-785476db-a054-4937-aa4f-0a8ab621f3e4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:07.608449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:07.685158 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-785476db-a054-4937-aa4f-0a8ab621f3e4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "POST /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71/action" status: 202 len: 0 microversion: 2.1 time: 0.246943 Aug 24 10:18:07.694914 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 821/1518] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:18:07 2022] POST /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:18:07.702155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-6dd1fd1b-6f62-4f42-beeb-5f2f92a95014 req-fae126bc-750b-4857-a5b7-cb1bda462f3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fd5ebf9-816f-442a-806d-4cf19678a3d2", "name": "network-vif-deleted", "tag": "212e5fdb-8c9a-4d12-9b94-4e13e5984aa1"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:07.725406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6dd1fd1b-6f62-4f42-beeb-5f2f92a95014 req-fae126bc-750b-4857-a5b7-cb1bda462f3c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:07.726098 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6dd1fd1b-6f62-4f42-beeb-5f2f92a95014 req-fae126bc-750b-4857-a5b7-cb1bda462f3c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:07.726896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6dd1fd1b-6f62-4f42-beeb-5f2f92a95014 req-fae126bc-750b-4857-a5b7-cb1bda462f3c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:07.757475 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-6dd1fd1b-6f62-4f42-beeb-5f2f92a95014 req-fae126bc-750b-4857-a5b7-cb1bda462f3c service nova] Creating event network-vif-deleted:212e5fdb-8c9a-4d12-9b94-4e13e5984aa1 for instance 1fd5ebf9-816f-442a-806d-4cf19678a3d2 on n-h2-849328-3 Aug 24 10:18:07.777217 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-6dd1fd1b-6f62-4f42-beeb-5f2f92a95014 req-fae126bc-750b-4857-a5b7-cb1bda462f3c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079378 Aug 24 10:18:07.781410 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 822/1519] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:07.798703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fccd5289-63a5-41f3-b4f3-c3836fa6f596 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:07.799436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fccd5289-63a5-41f3-b4f3-c3836fa6f596 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:07.810495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fccd5289-63a5-41f3-b4f3-c3836fa6f596 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:07.811394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fccd5289-63a5-41f3-b4f3-c3836fa6f596 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:07.812360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fccd5289-63a5-41f3-b4f3-c3836fa6f596 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:07.813635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fccd5289-63a5-41f3-b4f3-c3836fa6f596 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:07.815074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fccd5289-63a5-41f3-b4f3-c3836fa6f596 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:07.823187 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fd1c112c-6114-401c-8524-73866c06fc49 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:07.829234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fccd5289-63a5-41f3-b4f3-c3836fa6f596 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:07.836418 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fd1c112c-6114-401c-8524-73866c06fc49 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 200 len: 1325 microversion: 2.1 time: 0.827727 Aug 24 10:18:07.838935 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 698/1520] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:06 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 1325 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:07.865854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9f2a2c9c-e40c-4aff-8884-5700125bc190 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:07.866516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9f2a2c9c-e40c-4aff-8884-5700125bc190 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:07.884282 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f2a2c9c-e40c-4aff-8884-5700125bc190 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:07.886245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f2a2c9c-e40c-4aff-8884-5700125bc190 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:07.886897 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f2a2c9c-e40c-4aff-8884-5700125bc190 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:07.889561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f2a2c9c-e40c-4aff-8884-5700125bc190 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:07.890275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f2a2c9c-e40c-4aff-8884-5700125bc190 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:07.890931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f2a2c9c-e40c-4aff-8884-5700125bc190 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:08.497470 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:08.581949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9f2a2c9c-e40c-4aff-8884-5700125bc190 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:08.595206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9f2a2c9c-e40c-4aff-8884-5700125bc190 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:08.607279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9f2a2c9c-e40c-4aff-8884-5700125bc190 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:08.608976 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9f2a2c9c-e40c-4aff-8884-5700125bc190 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1487 microversion: 2.25 time: 0.753851 Aug 24 10:18:08.610184 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 699/1521] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:07 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1487 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:08.615564 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad2e9a67-f978-46e9-bc0e-e72d50e5c422 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:08.618006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ad2e9a67-f978-46e9-bc0e-e72d50e5c422 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:08.634641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad2e9a67-f978-46e9-bc0e-e72d50e5c422 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:08.635548 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad2e9a67-f978-46e9-bc0e-e72d50e5c422 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:08.636158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad2e9a67-f978-46e9-bc0e-e72d50e5c422 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:08.637104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad2e9a67-f978-46e9-bc0e-e72d50e5c422 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:08.637769 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad2e9a67-f978-46e9-bc0e-e72d50e5c422 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:08.638364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad2e9a67-f978-46e9-bc0e-e72d50e5c422 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:08.975085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fccd5289-63a5-41f3-b4f3-c3836fa6f596 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:08.998701 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fccd5289-63a5-41f3-b4f3-c3836fa6f596 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1471 microversion: 2.1 time: 1.215302 Aug 24 10:18:09.002017 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 823/1522] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:07 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1471 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:09.024903 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c8ab40a2-13e0-4fc5-a5c8-1f5cda80546a tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:09.026348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c8ab40a2-13e0-4fc5-a5c8-1f5cda80546a tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:09.039217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8ab40a2-13e0-4fc5-a5c8-1f5cda80546a tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:09.040477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8ab40a2-13e0-4fc5-a5c8-1f5cda80546a tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:09.042163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8ab40a2-13e0-4fc5-a5c8-1f5cda80546a tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:09.043942 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8ab40a2-13e0-4fc5-a5c8-1f5cda80546a tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:09.044838 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8ab40a2-13e0-4fc5-a5c8-1f5cda80546a tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:09.045737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8ab40a2-13e0-4fc5-a5c8-1f5cda80546a tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:09.222444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ad2e9a67-f978-46e9-bc0e-e72d50e5c422 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:09.241359 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ad2e9a67-f978-46e9-bc0e-e72d50e5c422 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1470 microversion: 2.1 time: 0.629715 Aug 24 10:18:09.245470 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 700/1523] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:08 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1470 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:09.258084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-91a04268-67a2-4325-bcff-96f22d096f62 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:09.259094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-91a04268-67a2-4325-bcff-96f22d096f62 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 29550762-7055-4641-9d00-46151f4a510f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:09.271203 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91a04268-67a2-4325-bcff-96f22d096f62 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:09.271978 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91a04268-67a2-4325-bcff-96f22d096f62 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:09.272586 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91a04268-67a2-4325-bcff-96f22d096f62 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:09.273573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91a04268-67a2-4325-bcff-96f22d096f62 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:09.274244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91a04268-67a2-4325-bcff-96f22d096f62 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:09.275000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91a04268-67a2-4325-bcff-96f22d096f62 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:09.278885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:09.518017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-91a04268-67a2-4325-bcff-96f22d096f62 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:09.528721 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-91a04268-67a2-4325-bcff-96f22d096f62 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f" status: 200 len: 1265 microversion: 2.1 time: 0.281781 Aug 24 10:18:09.529816 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 701/1524] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:09 2022] GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f => generated 1265 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:09.535503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6ea381fb-dc4c-4972-be29-8c4dad380a82 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:09.536818 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6ea381fb-dc4c-4972-be29-8c4dad380a82 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:09.544952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea381fb-dc4c-4972-be29-8c4dad380a82 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:09.546128 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea381fb-dc4c-4972-be29-8c4dad380a82 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:09.546838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea381fb-dc4c-4972-be29-8c4dad380a82 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:09.547995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea381fb-dc4c-4972-be29-8c4dad380a82 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:09.548729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea381fb-dc4c-4972-be29-8c4dad380a82 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:09.549421 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea381fb-dc4c-4972-be29-8c4dad380a82 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:09.760650 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=26 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:09.862149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c8ab40a2-13e0-4fc5-a5c8-1f5cda80546a tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:09.874668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c8ab40a2-13e0-4fc5-a5c8-1f5cda80546a tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:09.877274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c8ab40a2-13e0-4fc5-a5c8-1f5cda80546a tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:09.879118 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c8ab40a2-13e0-4fc5-a5c8-1f5cda80546a tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1844 microversion: 2.32 time: 0.874130 Aug 24 10:18:09.880440 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 824/1525] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:09 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1844 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:09.897874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-52abbd67-a9ec-4348-8cde-2a2854481abd req-daf6814e-737d-43a1-b7bb-e20e80c8f2e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2ed58ac-b16a-4f31-9394-f65217aea1d3", "tag": "6dbf42f1-fa54-4f7f-9f8b-ff03fe2fd957"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:09.915958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-52abbd67-a9ec-4348-8cde-2a2854481abd req-daf6814e-737d-43a1-b7bb-e20e80c8f2e0 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:09.917099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-52abbd67-a9ec-4348-8cde-2a2854481abd req-daf6814e-737d-43a1-b7bb-e20e80c8f2e0 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:09.918006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-52abbd67-a9ec-4348-8cde-2a2854481abd req-daf6814e-737d-43a1-b7bb-e20e80c8f2e0 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:09.936963 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-52abbd67-a9ec-4348-8cde-2a2854481abd req-daf6814e-737d-43a1-b7bb-e20e80c8f2e0 service nova] Creating event network-changed:6dbf42f1-fa54-4f7f-9f8b-ff03fe2fd957 for instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 on n-h1-849328-3 Aug 24 10:18:09.944792 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-52abbd67-a9ec-4348-8cde-2a2854481abd req-daf6814e-737d-43a1-b7bb-e20e80c8f2e0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061798 Aug 24 10:18:09.946839 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 825/1526] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:09.955230 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b8c96da4-ab29-48ca-bba9-b7e962466566 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:09.956796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b8c96da4-ab29-48ca-bba9-b7e962466566 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:09.966249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8c96da4-ab29-48ca-bba9-b7e962466566 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:09.967196 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8c96da4-ab29-48ca-bba9-b7e962466566 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:09.967831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8c96da4-ab29-48ca-bba9-b7e962466566 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:09.968814 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8c96da4-ab29-48ca-bba9-b7e962466566 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:09.969604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8c96da4-ab29-48ca-bba9-b7e962466566 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:09.970292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8c96da4-ab29-48ca-bba9-b7e962466566 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:10.178146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6ea381fb-dc4c-4972-be29-8c4dad380a82 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:10.187072 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6ea381fb-dc4c-4972-be29-8c4dad380a82 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 200 len: 1325 microversion: 2.1 time: 0.655982 Aug 24 10:18:10.187741 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 702/1527] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:09 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 1325 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:10.205508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c8724f3d-f234-400f-86ab-db8707194ba9 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:10.206668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c8724f3d-f234-400f-86ab-db8707194ba9 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:10.224337 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8724f3d-f234-400f-86ab-db8707194ba9 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:10.229994 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8724f3d-f234-400f-86ab-db8707194ba9 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:10.230702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8724f3d-f234-400f-86ab-db8707194ba9 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:10.231688 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8724f3d-f234-400f-86ab-db8707194ba9 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:10.232319 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8724f3d-f234-400f-86ab-db8707194ba9 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:10.233021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8724f3d-f234-400f-86ab-db8707194ba9 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:10.560542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b8c96da4-ab29-48ca-bba9-b7e962466566 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:10.581471 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b8c96da4-ab29-48ca-bba9-b7e962466566 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:10.583637 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b8c96da4-ab29-48ca-bba9-b7e962466566 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:10.586534 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b8c96da4-ab29-48ca-bba9-b7e962466566 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1487 microversion: 2.25 time: 0.636195 Aug 24 10:18:10.586534 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 826/1528] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:09 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1487 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:10.610129 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6cce3bb0-d161-4b3a-9a26-19dc67afa06f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:10.611143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6cce3bb0-d161-4b3a-9a26-19dc67afa06f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:10.618529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cce3bb0-d161-4b3a-9a26-19dc67afa06f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:10.619791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cce3bb0-d161-4b3a-9a26-19dc67afa06f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:10.620674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cce3bb0-d161-4b3a-9a26-19dc67afa06f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:10.622044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cce3bb0-d161-4b3a-9a26-19dc67afa06f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:10.623328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cce3bb0-d161-4b3a-9a26-19dc67afa06f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:10.624196 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cce3bb0-d161-4b3a-9a26-19dc67afa06f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:10.965194 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c8724f3d-f234-400f-86ab-db8707194ba9 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:10.998967 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c8724f3d-f234-400f-86ab-db8707194ba9 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1471 microversion: 2.1 time: 0.796485 Aug 24 10:18:11.001040 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 703/1529] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:10 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1471 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:11.019687 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6fdc2475-ffa8-4abd-aa94-6eaa23f62d5e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:11.021769 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6fdc2475-ffa8-4abd-aa94-6eaa23f62d5e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 29550762-7055-4641-9d00-46151f4a510f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:11.029966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6cce3bb0-d161-4b3a-9a26-19dc67afa06f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:11.059280 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6cce3bb0-d161-4b3a-9a26-19dc67afa06f tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1470 microversion: 2.1 time: 0.469203 Aug 24 10:18:11.063073 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 827/1530] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:10 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1470 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:11.066173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6fdc2475-ffa8-4abd-aa94-6eaa23f62d5e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:11.067576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6fdc2475-ffa8-4abd-aa94-6eaa23f62d5e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:11.069324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6fdc2475-ffa8-4abd-aa94-6eaa23f62d5e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:11.070455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6fdc2475-ffa8-4abd-aa94-6eaa23f62d5e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:11.071501 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6fdc2475-ffa8-4abd-aa94-6eaa23f62d5e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:11.072376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6fdc2475-ffa8-4abd-aa94-6eaa23f62d5e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:11.079759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec4953e8-7cb2-48b4-8d14-f11109db902d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:11.086585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ec4953e8-7cb2-48b4-8d14-f11109db902d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:11.107052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec4953e8-7cb2-48b4-8d14-f11109db902d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:11.108365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec4953e8-7cb2-48b4-8d14-f11109db902d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:11.112156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec4953e8-7cb2-48b4-8d14-f11109db902d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:11.114754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec4953e8-7cb2-48b4-8d14-f11109db902d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:11.116078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec4953e8-7cb2-48b4-8d14-f11109db902d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:11.119407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec4953e8-7cb2-48b4-8d14-f11109db902d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:11.615504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ec4953e8-7cb2-48b4-8d14-f11109db902d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:11.630768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ec4953e8-7cb2-48b4-8d14-f11109db902d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:11.632518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ec4953e8-7cb2-48b4-8d14-f11109db902d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:11.633937 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ec4953e8-7cb2-48b4-8d14-f11109db902d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1844 microversion: 2.32 time: 0.568383 Aug 24 10:18:11.640319 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 828/1531] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:11 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1844 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:11.646544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d5e229f7-32e7-496c-b071-f8a7d82e52ab tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:11.646544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d5e229f7-32e7-496c-b071-f8a7d82e52ab tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:11.673936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5e229f7-32e7-496c-b071-f8a7d82e52ab tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:11.674436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5e229f7-32e7-496c-b071-f8a7d82e52ab tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:11.674881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5e229f7-32e7-496c-b071-f8a7d82e52ab tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:11.675605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5e229f7-32e7-496c-b071-f8a7d82e52ab tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:11.676063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5e229f7-32e7-496c-b071-f8a7d82e52ab tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:11.676490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5e229f7-32e7-496c-b071-f8a7d82e52ab tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:11.778647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6fdc2475-ffa8-4abd-aa94-6eaa23f62d5e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:11.792799 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6fdc2475-ffa8-4abd-aa94-6eaa23f62d5e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f" status: 200 len: 1265 microversion: 2.1 time: 0.788627 Aug 24 10:18:11.836932 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 704/1532] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:11 2022] GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f => generated 1265 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:11.862571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-14811aea-7b48-4b0d-908d-12b7dfe21a03 req-cbee27d1-f1fe-4e20-a44b-47177dcd8ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d844e7a-a6af-4c55-957c-a997c42927af", "tag": "c818b602-5bd6-46ee-96c2-c41b38b25689"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:11.894207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-14811aea-7b48-4b0d-908d-12b7dfe21a03 req-cbee27d1-f1fe-4e20-a44b-47177dcd8ae8 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:11.894793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-14811aea-7b48-4b0d-908d-12b7dfe21a03 req-cbee27d1-f1fe-4e20-a44b-47177dcd8ae8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:11.895556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-14811aea-7b48-4b0d-908d-12b7dfe21a03 req-cbee27d1-f1fe-4e20-a44b-47177dcd8ae8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:11.928037 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-14811aea-7b48-4b0d-908d-12b7dfe21a03 req-cbee27d1-f1fe-4e20-a44b-47177dcd8ae8 service nova] Creating event network-changed:c818b602-5bd6-46ee-96c2-c41b38b25689 for instance 4d844e7a-a6af-4c55-957c-a997c42927af on n-h1-849328-3 Aug 24 10:18:11.951980 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-14811aea-7b48-4b0d-908d-12b7dfe21a03 req-cbee27d1-f1fe-4e20-a44b-47177dcd8ae8 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105499 Aug 24 10:18:11.953287 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 705/1533] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:11.959949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-85c7fb36-e7bb-4e20-9ccf-abe40d44af30 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:11.960764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-85c7fb36-e7bb-4e20-9ccf-abe40d44af30 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:11.975456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85c7fb36-e7bb-4e20-9ccf-abe40d44af30 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:11.976508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85c7fb36-e7bb-4e20-9ccf-abe40d44af30 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:11.976508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85c7fb36-e7bb-4e20-9ccf-abe40d44af30 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:11.977075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85c7fb36-e7bb-4e20-9ccf-abe40d44af30 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:11.982351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85c7fb36-e7bb-4e20-9ccf-abe40d44af30 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:11.983201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85c7fb36-e7bb-4e20-9ccf-abe40d44af30 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:12.368214 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-85c7fb36-e7bb-4e20-9ccf-abe40d44af30 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:12.379124 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-85c7fb36-e7bb-4e20-9ccf-abe40d44af30 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:12.381524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-85c7fb36-e7bb-4e20-9ccf-abe40d44af30 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:12.383416 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-85c7fb36-e7bb-4e20-9ccf-abe40d44af30 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1487 microversion: 2.25 time: 0.428715 Aug 24 10:18:12.384641 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 706/1534] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:11 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1487 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:12.403912 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b919d60f-7c96-4a90-816b-21ac69ce51e0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:12.406675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b919d60f-7c96-4a90-816b-21ac69ce51e0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:12.419354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b919d60f-7c96-4a90-816b-21ac69ce51e0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:12.420295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b919d60f-7c96-4a90-816b-21ac69ce51e0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:12.421225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b919d60f-7c96-4a90-816b-21ac69ce51e0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:12.422429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b919d60f-7c96-4a90-816b-21ac69ce51e0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:12.423242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b919d60f-7c96-4a90-816b-21ac69ce51e0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:12.423975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b919d60f-7c96-4a90-816b-21ac69ce51e0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:12.683442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b919d60f-7c96-4a90-816b-21ac69ce51e0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:12.716473 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b919d60f-7c96-4a90-816b-21ac69ce51e0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1471 microversion: 2.1 time: 0.329545 Aug 24 10:18:12.718172 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 707/1535] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:12 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1471 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:12.732144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eee32776-83bf-4a68-aa99-ebef5065c83b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:12.740324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eee32776-83bf-4a68-aa99-ebef5065c83b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:12.760729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eee32776-83bf-4a68-aa99-ebef5065c83b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:12.761278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eee32776-83bf-4a68-aa99-ebef5065c83b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:12.763781 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eee32776-83bf-4a68-aa99-ebef5065c83b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:12.765312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eee32776-83bf-4a68-aa99-ebef5065c83b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:12.768735 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eee32776-83bf-4a68-aa99-ebef5065c83b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:12.769686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eee32776-83bf-4a68-aa99-ebef5065c83b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:13.160508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d5e229f7-32e7-496c-b071-f8a7d82e52ab tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:13.176811 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d5e229f7-32e7-496c-b071-f8a7d82e52ab tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 200 len: 1325 microversion: 2.1 time: 1.531158 Aug 24 10:18:13.177547 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 829/1536] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:11 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 1325 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:13.190957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-7ffe583f-c91d-4476-93aa-95c6fa0dec6e req-13eaa06c-2d54-4c8f-9658-bb7cfc10de4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd", "tag": "6ed14169-2bb3-41fb-a411-6ef58f974592"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:13.213531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7ffe583f-c91d-4476-93aa-95c6fa0dec6e req-13eaa06c-2d54-4c8f-9658-bb7cfc10de4c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:13.214010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7ffe583f-c91d-4476-93aa-95c6fa0dec6e req-13eaa06c-2d54-4c8f-9658-bb7cfc10de4c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:13.217729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7ffe583f-c91d-4476-93aa-95c6fa0dec6e req-13eaa06c-2d54-4c8f-9658-bb7cfc10de4c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:13.244635 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-7ffe583f-c91d-4476-93aa-95c6fa0dec6e req-13eaa06c-2d54-4c8f-9658-bb7cfc10de4c service nova] Creating event network-changed:6ed14169-2bb3-41fb-a411-6ef58f974592 for instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd on n-h2-849328-3 Aug 24 10:18:13.262593 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-7ffe583f-c91d-4476-93aa-95c6fa0dec6e req-13eaa06c-2d54-4c8f-9658-bb7cfc10de4c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075838 Aug 24 10:18:13.263794 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 830/1537] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:13.272142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d2f52d2a-914b-46de-869f-757198d3a85c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:13.279159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d2f52d2a-914b-46de-869f-757198d3a85c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:13.301596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2f52d2a-914b-46de-869f-757198d3a85c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:13.302448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2f52d2a-914b-46de-869f-757198d3a85c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:13.303057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2f52d2a-914b-46de-869f-757198d3a85c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:13.304262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2f52d2a-914b-46de-869f-757198d3a85c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:13.304888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2f52d2a-914b-46de-869f-757198d3a85c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:13.305503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2f52d2a-914b-46de-869f-757198d3a85c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:13.330169 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eee32776-83bf-4a68-aa99-ebef5065c83b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:13.339585 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eee32776-83bf-4a68-aa99-ebef5065c83b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1470 microversion: 2.1 time: 0.617568 Aug 24 10:18:13.344532 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 708/1538] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:12 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1470 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:13.353928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0ec96a94-5fff-47db-94da-559432cf8298 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:13.369962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0ec96a94-5fff-47db-94da-559432cf8298 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 29550762-7055-4641-9d00-46151f4a510f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:13.390800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ec96a94-5fff-47db-94da-559432cf8298 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:13.391311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ec96a94-5fff-47db-94da-559432cf8298 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:13.391830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ec96a94-5fff-47db-94da-559432cf8298 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:13.398273 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ec96a94-5fff-47db-94da-559432cf8298 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:13.410828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ec96a94-5fff-47db-94da-559432cf8298 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:13.415845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ec96a94-5fff-47db-94da-559432cf8298 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:14.401998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0ec96a94-5fff-47db-94da-559432cf8298 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:14.416574 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0ec96a94-5fff-47db-94da-559432cf8298 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f" status: 200 len: 1307 microversion: 2.1 time: 1.068020 Aug 24 10:18:14.417381 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 709/1539] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:13 2022] GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f => generated 1307 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:14.433435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-227038b6-6ad7-4175-b802-b13c3d41f759 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:14.434403 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-227038b6-6ad7-4175-b802-b13c3d41f759 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:14.452475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-227038b6-6ad7-4175-b802-b13c3d41f759 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:14.453610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-227038b6-6ad7-4175-b802-b13c3d41f759 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:14.454244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-227038b6-6ad7-4175-b802-b13c3d41f759 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:14.455661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-227038b6-6ad7-4175-b802-b13c3d41f759 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:14.458576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-227038b6-6ad7-4175-b802-b13c3d41f759 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:14.459351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-227038b6-6ad7-4175-b802-b13c3d41f759 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:14.822996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d2f52d2a-914b-46de-869f-757198d3a85c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:14.853504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d2f52d2a-914b-46de-869f-757198d3a85c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:14.855478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d2f52d2a-914b-46de-869f-757198d3a85c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:14.856814 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d2f52d2a-914b-46de-869f-757198d3a85c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1844 microversion: 2.32 time: 1.591695 Aug 24 10:18:14.858128 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 831/1540] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:13 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1844 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:14.863173 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6242192c-42f2-4130-a857-9b1e8f9ce627 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:14.864138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6242192c-42f2-4130-a857-9b1e8f9ce627 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:14.882947 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6242192c-42f2-4130-a857-9b1e8f9ce627 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:14.883754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6242192c-42f2-4130-a857-9b1e8f9ce627 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:14.884466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6242192c-42f2-4130-a857-9b1e8f9ce627 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:14.885475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6242192c-42f2-4130-a857-9b1e8f9ce627 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:14.886177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6242192c-42f2-4130-a857-9b1e8f9ce627 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:14.886844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6242192c-42f2-4130-a857-9b1e8f9ce627 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:15.293729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-227038b6-6ad7-4175-b802-b13c3d41f759 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:15.306521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-227038b6-6ad7-4175-b802-b13c3d41f759 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:15.310821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-227038b6-6ad7-4175-b802-b13c3d41f759 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:15.316042 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-227038b6-6ad7-4175-b802-b13c3d41f759 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1487 microversion: 2.25 time: 0.893347 Aug 24 10:18:15.317636 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 710/1541] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:14 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1487 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:15.329389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-82d62214-e2d3-4b6b-a8d8-70b6fc870e16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:15.330276 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-82d62214-e2d3-4b6b-a8d8-70b6fc870e16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:15.340845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82d62214-e2d3-4b6b-a8d8-70b6fc870e16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:15.341686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82d62214-e2d3-4b6b-a8d8-70b6fc870e16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:15.342318 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82d62214-e2d3-4b6b-a8d8-70b6fc870e16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:15.343373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82d62214-e2d3-4b6b-a8d8-70b6fc870e16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:15.343982 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82d62214-e2d3-4b6b-a8d8-70b6fc870e16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:15.344563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82d62214-e2d3-4b6b-a8d8-70b6fc870e16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:15.417851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:15.459811 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:15.526383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6242192c-42f2-4130-a857-9b1e8f9ce627 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:15.537298 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6242192c-42f2-4130-a857-9b1e8f9ce627 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1471 microversion: 2.1 time: 0.677802 Aug 24 10:18:15.538469 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 832/1542] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:14 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1471 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:15.543928 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-13ba2a2c-be2b-4fb1-bd1e-9014c9b4fe10 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:15.545488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-13ba2a2c-be2b-4fb1-bd1e-9014c9b4fe10 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:15.559162 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13ba2a2c-be2b-4fb1-bd1e-9014c9b4fe10 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:15.562470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13ba2a2c-be2b-4fb1-bd1e-9014c9b4fe10 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:15.564040 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13ba2a2c-be2b-4fb1-bd1e-9014c9b4fe10 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:15.572438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13ba2a2c-be2b-4fb1-bd1e-9014c9b4fe10 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:15.572938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13ba2a2c-be2b-4fb1-bd1e-9014c9b4fe10 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:15.573795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13ba2a2c-be2b-4fb1-bd1e-9014c9b4fe10 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:15.942820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-82d62214-e2d3-4b6b-a8d8-70b6fc870e16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:15.969448 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-82d62214-e2d3-4b6b-a8d8-70b6fc870e16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 200 len: 1325 microversion: 2.1 time: 0.650635 Aug 24 10:18:15.970382 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 711/1543] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:15 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 1325 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:15.985367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-46060d6d-67e9-4604-9dd3-a4cc9e6bacc1 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:15.986565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-46060d6d-67e9-4604-9dd3-a4cc9e6bacc1 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 29550762-7055-4641-9d00-46151f4a510f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:16.002634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46060d6d-67e9-4604-9dd3-a4cc9e6bacc1 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:16.003420 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46060d6d-67e9-4604-9dd3-a4cc9e6bacc1 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:16.004082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46060d6d-67e9-4604-9dd3-a4cc9e6bacc1 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:16.015429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46060d6d-67e9-4604-9dd3-a4cc9e6bacc1 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:16.016262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46060d6d-67e9-4604-9dd3-a4cc9e6bacc1 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:16.018360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46060d6d-67e9-4604-9dd3-a4cc9e6bacc1 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:16.595456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-46060d6d-67e9-4604-9dd3-a4cc9e6bacc1 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:16.616759 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-46060d6d-67e9-4604-9dd3-a4cc9e6bacc1 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f" status: 200 len: 1307 microversion: 2.1 time: 0.643628 Aug 24 10:18:16.618741 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 712/1544] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:15 2022] GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f => generated 1307 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:16.630964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-81ab948a-6dae-4c4e-afec-9b50287007a8 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:16.632099 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-81ab948a-6dae-4c4e-afec-9b50287007a8 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:16.633287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-13ba2a2c-be2b-4fb1-bd1e-9014c9b4fe10 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:16.650084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81ab948a-6dae-4c4e-afec-9b50287007a8 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:16.651064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81ab948a-6dae-4c4e-afec-9b50287007a8 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:16.651738 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81ab948a-6dae-4c4e-afec-9b50287007a8 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:16.652693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81ab948a-6dae-4c4e-afec-9b50287007a8 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:16.653848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81ab948a-6dae-4c4e-afec-9b50287007a8 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:16.656854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81ab948a-6dae-4c4e-afec-9b50287007a8 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:16.662794 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-13ba2a2c-be2b-4fb1-bd1e-9014c9b4fe10 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1470 microversion: 2.1 time: 1.122464 Aug 24 10:18:16.665297 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 833/1545] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:15 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1470 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:16.683248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-306852a6-4ca8-43e1-9056-3ac04c20c6e9 req-c9e8a727-cf84-48f5-b62f-61102feaa2a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29550762-7055-4641-9d00-46151f4a510f", "tag": "a2984dcb-2faa-47d0-bc19-8651905514d6"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:16.719473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-306852a6-4ca8-43e1-9056-3ac04c20c6e9 req-c9e8a727-cf84-48f5-b62f-61102feaa2a2 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:16.719865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-306852a6-4ca8-43e1-9056-3ac04c20c6e9 req-c9e8a727-cf84-48f5-b62f-61102feaa2a2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:16.720619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-306852a6-4ca8-43e1-9056-3ac04c20c6e9 req-c9e8a727-cf84-48f5-b62f-61102feaa2a2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:16.752502 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-306852a6-4ca8-43e1-9056-3ac04c20c6e9 req-c9e8a727-cf84-48f5-b62f-61102feaa2a2 service nova] Creating event network-changed:a2984dcb-2faa-47d0-bc19-8651905514d6 for instance 29550762-7055-4641-9d00-46151f4a510f on n-h1-849328-3 Aug 24 10:18:16.759582 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-306852a6-4ca8-43e1-9056-3ac04c20c6e9 req-c9e8a727-cf84-48f5-b62f-61102feaa2a2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091403 Aug 24 10:18:16.761786 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 834/1546] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:16.769086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-ea0f01fe-e132-4417-a95f-5e28ae7b395c req-be175eb1-252a-4cc3-bd1d-28f3032099a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd", "tag": "8478aaa2-cb78-4f37-9c11-cebf1b8242a0"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:16.779219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ea0f01fe-e132-4417-a95f-5e28ae7b395c req-be175eb1-252a-4cc3-bd1d-28f3032099a8 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:16.779761 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ea0f01fe-e132-4417-a95f-5e28ae7b395c req-be175eb1-252a-4cc3-bd1d-28f3032099a8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:16.780187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ea0f01fe-e132-4417-a95f-5e28ae7b395c req-be175eb1-252a-4cc3-bd1d-28f3032099a8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:16.811346 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-ea0f01fe-e132-4417-a95f-5e28ae7b395c req-be175eb1-252a-4cc3-bd1d-28f3032099a8 service nova] Creating event network-changed:8478aaa2-cb78-4f37-9c11-cebf1b8242a0 for instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd on n-h2-849328-3 Aug 24 10:18:16.817952 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-ea0f01fe-e132-4417-a95f-5e28ae7b395c req-be175eb1-252a-4cc3-bd1d-28f3032099a8 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054524 Aug 24 10:18:16.818718 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 835/1547] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:16.825526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b1c625fe-6166-457a-b088-239a8959c56e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:16.826363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b1c625fe-6166-457a-b088-239a8959c56e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:16.847340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1c625fe-6166-457a-b088-239a8959c56e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:16.848242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1c625fe-6166-457a-b088-239a8959c56e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:16.848924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1c625fe-6166-457a-b088-239a8959c56e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:16.849936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1c625fe-6166-457a-b088-239a8959c56e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:16.851442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1c625fe-6166-457a-b088-239a8959c56e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:16.852103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1c625fe-6166-457a-b088-239a8959c56e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:17.629979 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-81ab948a-6dae-4c4e-afec-9b50287007a8 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:17.640869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-81ab948a-6dae-4c4e-afec-9b50287007a8 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:17.642416 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-81ab948a-6dae-4c4e-afec-9b50287007a8 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:17.643587 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-81ab948a-6dae-4c4e-afec-9b50287007a8 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1865 microversion: 2.32 time: 1.023685 Aug 24 10:18:17.654242 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 713/1548] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:16 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1865 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:17.654242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-91e38cf2-26dc-4088-8308-8e220ed9110c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:17.654242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-91e38cf2-26dc-4088-8308-8e220ed9110c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:17.672191 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91e38cf2-26dc-4088-8308-8e220ed9110c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:17.672660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91e38cf2-26dc-4088-8308-8e220ed9110c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:17.673096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91e38cf2-26dc-4088-8308-8e220ed9110c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:17.673838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91e38cf2-26dc-4088-8308-8e220ed9110c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:17.674284 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91e38cf2-26dc-4088-8308-8e220ed9110c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:17.681284 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91e38cf2-26dc-4088-8308-8e220ed9110c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:17.835432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b1c625fe-6166-457a-b088-239a8959c56e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:17.855774 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b1c625fe-6166-457a-b088-239a8959c56e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:17.857770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b1c625fe-6166-457a-b088-239a8959c56e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:17.859117 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b1c625fe-6166-457a-b088-239a8959c56e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1487 microversion: 2.25 time: 1.039253 Aug 24 10:18:17.873720 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 836/1549] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:16 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1487 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:17.891622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c1fd4aa-b208-4be5-b59e-509201926fb8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:17.892581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2c1fd4aa-b208-4be5-b59e-509201926fb8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:17.900859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c1fd4aa-b208-4be5-b59e-509201926fb8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:17.901673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c1fd4aa-b208-4be5-b59e-509201926fb8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:17.902292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c1fd4aa-b208-4be5-b59e-509201926fb8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:17.903207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c1fd4aa-b208-4be5-b59e-509201926fb8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:17.914007 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c1fd4aa-b208-4be5-b59e-509201926fb8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:17.914826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c1fd4aa-b208-4be5-b59e-509201926fb8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:18.254479 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-91e38cf2-26dc-4088-8308-8e220ed9110c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:18.266394 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-91e38cf2-26dc-4088-8308-8e220ed9110c tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1471 microversion: 2.1 time: 0.610046 Aug 24 10:18:18.267194 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 714/1550] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:17 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1471 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:18.272224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e4ffec7-35c8-4fed-ae63-63c51b0fc0e3 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:18.273194 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6e4ffec7-35c8-4fed-ae63-63c51b0fc0e3 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 29550762-7055-4641-9d00-46151f4a510f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:18.280211 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e4ffec7-35c8-4fed-ae63-63c51b0fc0e3 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:18.281159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e4ffec7-35c8-4fed-ae63-63c51b0fc0e3 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:18.281826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e4ffec7-35c8-4fed-ae63-63c51b0fc0e3 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:18.282794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e4ffec7-35c8-4fed-ae63-63c51b0fc0e3 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:18.283484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e4ffec7-35c8-4fed-ae63-63c51b0fc0e3 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:18.284222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e4ffec7-35c8-4fed-ae63-63c51b0fc0e3 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:18.582000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6e4ffec7-35c8-4fed-ae63-63c51b0fc0e3 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:18.594917 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6e4ffec7-35c8-4fed-ae63-63c51b0fc0e3 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f" status: 200 len: 1307 microversion: 2.1 time: 0.326398 Aug 24 10:18:18.599512 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 715/1551] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:18 2022] GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f => generated 1307 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:18.599736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2c1fd4aa-b208-4be5-b59e-509201926fb8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:18.606048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b5d9a420-cd26-42e7-a2da-c55e12f69d26 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:18.608455 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2c1fd4aa-b208-4be5-b59e-509201926fb8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 200 len: 1325 microversion: 2.1 time: 0.733220 Aug 24 10:18:18.610424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b5d9a420-cd26-42e7-a2da-c55e12f69d26 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:18.611182 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 837/1552] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:17 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 1325 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:18.624952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5d9a420-cd26-42e7-a2da-c55e12f69d26 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:18.627375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5d9a420-cd26-42e7-a2da-c55e12f69d26 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:18.629306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5d9a420-cd26-42e7-a2da-c55e12f69d26 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:18.630252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5d9a420-cd26-42e7-a2da-c55e12f69d26 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:18.636299 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5d9a420-cd26-42e7-a2da-c55e12f69d26 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:18.637352 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5d9a420-cd26-42e7-a2da-c55e12f69d26 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:18.688250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fd7a903f-85b1-4e64-9485-36df2036a43b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:18.690649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fd7a903f-85b1-4e64-9485-36df2036a43b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:18.702763 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd7a903f-85b1-4e64-9485-36df2036a43b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:18.703412 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd7a903f-85b1-4e64-9485-36df2036a43b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:18.709708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd7a903f-85b1-4e64-9485-36df2036a43b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:18.711005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd7a903f-85b1-4e64-9485-36df2036a43b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:18.711388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd7a903f-85b1-4e64-9485-36df2036a43b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:18.711920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd7a903f-85b1-4e64-9485-36df2036a43b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:19.252556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fd7a903f-85b1-4e64-9485-36df2036a43b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:19.274785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fd7a903f-85b1-4e64-9485-36df2036a43b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:19.276894 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fd7a903f-85b1-4e64-9485-36df2036a43b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:19.279227 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fd7a903f-85b1-4e64-9485-36df2036a43b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1886 microversion: 2.32 time: 0.595090 Aug 24 10:18:19.282060 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 838/1553] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:18 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1886 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:19.293060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-1052e01c-a06e-4168-856d-8265b5ac18d2 req-ec6a53f2-e65f-4de3-9505-48689d934fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e607951-c58f-41ce-bb92-a9399d534b2b", "name": "network-vif-unplugged", "status": "completed", "tag": "b61dbdd6-ed0f-44bc-b778-6a3d23999774"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:19.314368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1052e01c-a06e-4168-856d-8265b5ac18d2 req-ec6a53f2-e65f-4de3-9505-48689d934fc9 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:19.320445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1052e01c-a06e-4168-856d-8265b5ac18d2 req-ec6a53f2-e65f-4de3-9505-48689d934fc9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:19.321319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1052e01c-a06e-4168-856d-8265b5ac18d2 req-ec6a53f2-e65f-4de3-9505-48689d934fc9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:19.353316 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-1052e01c-a06e-4168-856d-8265b5ac18d2 req-ec6a53f2-e65f-4de3-9505-48689d934fc9 service nova] Creating event network-vif-unplugged:b61dbdd6-ed0f-44bc-b778-6a3d23999774 for instance 0e607951-c58f-41ce-bb92-a9399d534b2b on n-h1-849328-3 Aug 24 10:18:19.367739 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-1052e01c-a06e-4168-856d-8265b5ac18d2 req-ec6a53f2-e65f-4de3-9505-48689d934fc9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082924 Aug 24 10:18:19.369936 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 839/1554] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:19.386238 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a6ea031e-9e10-495a-973f-939b00ba4491 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:19.387462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a6ea031e-9e10-495a-973f-939b00ba4491 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:19.402427 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6ea031e-9e10-495a-973f-939b00ba4491 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:19.405005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6ea031e-9e10-495a-973f-939b00ba4491 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:19.405834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6ea031e-9e10-495a-973f-939b00ba4491 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:19.407581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6ea031e-9e10-495a-973f-939b00ba4491 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:19.411788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6ea031e-9e10-495a-973f-939b00ba4491 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:19.412597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6ea031e-9e10-495a-973f-939b00ba4491 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:19.610524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b5d9a420-cd26-42e7-a2da-c55e12f69d26 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:19.622504 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b5d9a420-cd26-42e7-a2da-c55e12f69d26 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1470 microversion: 2.1 time: 1.021416 Aug 24 10:18:19.623152 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 716/1555] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:18 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1470 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:19.637915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-300d7a7f-1432-48f4-97f6-fc7eeae50601 req-8187f8a1-5b64-4482-839b-5d60db0d1a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6451db-5c2a-422c-84ff-c13e81621a71", "name": "network-vif-unplugged", "status": "completed", "tag": "7d183dba-e72f-4aa1-9c43-d620da8dd93b"}, {"name": "network-changed", "server_uuid": "1f6451db-5c2a-422c-84ff-c13e81621a71", "tag": "7d183dba-e72f-4aa1-9c43-d620da8dd93b"}, {"name": "network-changed", "server_uuid": "4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd", "tag": "526b6293-9fd8-4d13-a1f7-daec4c52af4a"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:19.662390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-300d7a7f-1432-48f4-97f6-fc7eeae50601 req-8187f8a1-5b64-4482-839b-5d60db0d1a03 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:19.663194 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-300d7a7f-1432-48f4-97f6-fc7eeae50601 req-8187f8a1-5b64-4482-839b-5d60db0d1a03 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:19.666129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-300d7a7f-1432-48f4-97f6-fc7eeae50601 req-8187f8a1-5b64-4482-839b-5d60db0d1a03 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:19.702051 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-300d7a7f-1432-48f4-97f6-fc7eeae50601 req-8187f8a1-5b64-4482-839b-5d60db0d1a03 service nova] Creating event network-vif-unplugged:7d183dba-e72f-4aa1-9c43-d620da8dd93b for instance 1f6451db-5c2a-422c-84ff-c13e81621a71 on n-h1-849328-3 Aug 24 10:18:19.706649 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-300d7a7f-1432-48f4-97f6-fc7eeae50601 req-8187f8a1-5b64-4482-839b-5d60db0d1a03 service nova] Creating event network-changed:7d183dba-e72f-4aa1-9c43-d620da8dd93b for instance 1f6451db-5c2a-422c-84ff-c13e81621a71 on n-h1-849328-3 Aug 24 10:18:19.707939 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-300d7a7f-1432-48f4-97f6-fc7eeae50601 req-8187f8a1-5b64-4482-839b-5d60db0d1a03 service nova] Creating event network-changed:526b6293-9fd8-4d13-a1f7-daec4c52af4a for instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd on n-h2-849328-3 Aug 24 10:18:19.725819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-300d7a7f-1432-48f4-97f6-fc7eeae50601 req-8187f8a1-5b64-4482-839b-5d60db0d1a03 service nova] Instance 1f6451db-5c2a-422c-84ff-c13e81621a71 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 10:18:19.755708 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-300d7a7f-1432-48f4-97f6-fc7eeae50601 req-8187f8a1-5b64-4482-839b-5d60db0d1a03 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.125945 Aug 24 10:18:19.756337 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 717/1556] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:19.773854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d47768aa-0300-4680-9153-f9f24b149351 req-96a81045-34df-44ee-aeb8-8113d5b4ca93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2ed58ac-b16a-4f31-9394-f65217aea1d3", "name": "network-vif-plugged", "status": "completed", "tag": "6dbf42f1-fa54-4f7f-9f8b-ff03fe2fd957"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:19.804555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d47768aa-0300-4680-9153-f9f24b149351 req-96a81045-34df-44ee-aeb8-8113d5b4ca93 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:19.808967 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d47768aa-0300-4680-9153-f9f24b149351 req-96a81045-34df-44ee-aeb8-8113d5b4ca93 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:19.809699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d47768aa-0300-4680-9153-f9f24b149351 req-96a81045-34df-44ee-aeb8-8113d5b4ca93 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:19.842981 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d47768aa-0300-4680-9153-f9f24b149351 req-96a81045-34df-44ee-aeb8-8113d5b4ca93 service nova] Creating event network-vif-plugged:6dbf42f1-fa54-4f7f-9f8b-ff03fe2fd957 for instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 on n-h1-849328-3 Aug 24 10:18:19.849625 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d47768aa-0300-4680-9153-f9f24b149351 req-96a81045-34df-44ee-aeb8-8113d5b4ca93 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088767 Aug 24 10:18:19.851462 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 718/1557] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:19.880221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0c51bd53-a65f-4661-93b2-25e393ea8bb5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:19.884126 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0c51bd53-a65f-4661-93b2-25e393ea8bb5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:19.938460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c51bd53-a65f-4661-93b2-25e393ea8bb5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:19.939473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c51bd53-a65f-4661-93b2-25e393ea8bb5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:19.940151 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c51bd53-a65f-4661-93b2-25e393ea8bb5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:19.947051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c51bd53-a65f-4661-93b2-25e393ea8bb5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:19.950230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c51bd53-a65f-4661-93b2-25e393ea8bb5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:19.955041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c51bd53-a65f-4661-93b2-25e393ea8bb5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:20.020288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:20.300137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a6ea031e-9e10-495a-973f-939b00ba4491 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:20.313172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a6ea031e-9e10-495a-973f-939b00ba4491 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:20.317774 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a6ea031e-9e10-495a-973f-939b00ba4491 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:20.325449 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a6ea031e-9e10-495a-973f-939b00ba4491 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1487 microversion: 2.25 time: 0.951698 Aug 24 10:18:20.327502 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 840/1558] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:19 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1487 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:20.340702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-868bf133-9a59-4910-b954-01378b3f4559 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:20.343572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-868bf133-9a59-4910-b954-01378b3f4559 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 29550762-7055-4641-9d00-46151f4a510f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:20.358517 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-868bf133-9a59-4910-b954-01378b3f4559 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:20.365249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-868bf133-9a59-4910-b954-01378b3f4559 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:20.368830 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-868bf133-9a59-4910-b954-01378b3f4559 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:20.370389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-868bf133-9a59-4910-b954-01378b3f4559 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:20.371082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-868bf133-9a59-4910-b954-01378b3f4559 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:20.371753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-868bf133-9a59-4910-b954-01378b3f4559 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:20.486277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0c51bd53-a65f-4661-93b2-25e393ea8bb5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:20.495572 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0c51bd53-a65f-4661-93b2-25e393ea8bb5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1471 microversion: 2.1 time: 0.642213 Aug 24 10:18:20.497948 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 719/1559] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:19 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1471 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:20.503689 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4cee55e9-c1a2-4101-b87d-f53a11b17384 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:20.504544 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4cee55e9-c1a2-4101-b87d-f53a11b17384 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:20.512757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4cee55e9-c1a2-4101-b87d-f53a11b17384 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:20.513767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4cee55e9-c1a2-4101-b87d-f53a11b17384 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:20.514523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4cee55e9-c1a2-4101-b87d-f53a11b17384 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:20.515634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4cee55e9-c1a2-4101-b87d-f53a11b17384 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:20.516792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4cee55e9-c1a2-4101-b87d-f53a11b17384 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:20.517462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4cee55e9-c1a2-4101-b87d-f53a11b17384 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:20.933223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-868bf133-9a59-4910-b954-01378b3f4559 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:20.940750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:20.956772 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-868bf133-9a59-4910-b954-01378b3f4559 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f" status: 200 len: 1307 microversion: 2.1 time: 0.624155 Aug 24 10:18:20.961587 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 841/1560] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:20 2022] GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f => generated 1307 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:20.972313 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c097355b-0722-414f-b585-2f2c17def6ed tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:20.973593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c097355b-0722-414f-b585-2f2c17def6ed tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:20.982055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c097355b-0722-414f-b585-2f2c17def6ed tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:20.983035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c097355b-0722-414f-b585-2f2c17def6ed tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:20.983901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c097355b-0722-414f-b585-2f2c17def6ed tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:20.985229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c097355b-0722-414f-b585-2f2c17def6ed tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:20.986239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c097355b-0722-414f-b585-2f2c17def6ed tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:20.986969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c097355b-0722-414f-b585-2f2c17def6ed tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:21.134266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4cee55e9-c1a2-4101-b87d-f53a11b17384 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:21.171491 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4cee55e9-c1a2-4101-b87d-f53a11b17384 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 200 len: 1325 microversion: 2.1 time: 0.671625 Aug 24 10:18:21.175122 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 720/1561] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:20 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 1325 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:21.195454 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-11da28dc-ca15-4610-951c-4f69cc149d24 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:21.196771 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-11da28dc-ca15-4610-951c-4f69cc149d24 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:21.213480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11da28dc-ca15-4610-951c-4f69cc149d24 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:21.215014 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11da28dc-ca15-4610-951c-4f69cc149d24 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:21.215874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11da28dc-ca15-4610-951c-4f69cc149d24 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:21.217332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11da28dc-ca15-4610-951c-4f69cc149d24 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:21.218191 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11da28dc-ca15-4610-951c-4f69cc149d24 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:21.218970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11da28dc-ca15-4610-951c-4f69cc149d24 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:21.591960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c097355b-0722-414f-b585-2f2c17def6ed tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:21.625207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-11da28dc-ca15-4610-951c-4f69cc149d24 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:21.642622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c097355b-0722-414f-b585-2f2c17def6ed tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:21.643554 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-11da28dc-ca15-4610-951c-4f69cc149d24 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1470 microversion: 2.1 time: 0.465958 Aug 24 10:18:21.645751 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 721/1562] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:21 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1470 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:21.650163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c097355b-0722-414f-b585-2f2c17def6ed tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:21.656138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7c9f5f1c-e407-4abc-a944-bf561c925d91 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:21.657696 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c097355b-0722-414f-b585-2f2c17def6ed tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1886 microversion: 2.32 time: 0.692300 Aug 24 10:18:21.658569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7c9f5f1c-e407-4abc-a944-bf561c925d91 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:21.661385 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 842/1563] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:20 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1886 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:21.691714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-f0247f77-b7b9-4ef1-a404-90da23576574 req-35ccd6a1-77d8-4816-9c82-00f9e690aa39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e607951-c58f-41ce-bb92-a9399d534b2b", "tag": "b61dbdd6-ed0f-44bc-b778-6a3d23999774"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:21.710915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c9f5f1c-e407-4abc-a944-bf561c925d91 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:21.712243 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c9f5f1c-e407-4abc-a944-bf561c925d91 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:21.713392 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c9f5f1c-e407-4abc-a944-bf561c925d91 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:21.715128 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c9f5f1c-e407-4abc-a944-bf561c925d91 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:21.716336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c9f5f1c-e407-4abc-a944-bf561c925d91 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:21.717794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c9f5f1c-e407-4abc-a944-bf561c925d91 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:21.770252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f0247f77-b7b9-4ef1-a404-90da23576574 req-35ccd6a1-77d8-4816-9c82-00f9e690aa39 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:21.771696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f0247f77-b7b9-4ef1-a404-90da23576574 req-35ccd6a1-77d8-4816-9c82-00f9e690aa39 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:21.774161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f0247f77-b7b9-4ef1-a404-90da23576574 req-35ccd6a1-77d8-4816-9c82-00f9e690aa39 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:21.846501 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-f0247f77-b7b9-4ef1-a404-90da23576574 req-35ccd6a1-77d8-4816-9c82-00f9e690aa39 service nova] Creating event network-changed:b61dbdd6-ed0f-44bc-b778-6a3d23999774 for instance 0e607951-c58f-41ce-bb92-a9399d534b2b on n-h1-849328-3 Aug 24 10:18:21.871945 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-f0247f77-b7b9-4ef1-a404-90da23576574 req-35ccd6a1-77d8-4816-9c82-00f9e690aa39 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207095 Aug 24 10:18:21.875075 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 843/1564] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:21.900778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8deec13d-0e85-4bfe-8dc0-cafe1c937474 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:21.903062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8deec13d-0e85-4bfe-8dc0-cafe1c937474 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:21.935333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8deec13d-0e85-4bfe-8dc0-cafe1c937474 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:21.939659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8deec13d-0e85-4bfe-8dc0-cafe1c937474 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:21.940741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8deec13d-0e85-4bfe-8dc0-cafe1c937474 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:21.944482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8deec13d-0e85-4bfe-8dc0-cafe1c937474 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:21.945317 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8deec13d-0e85-4bfe-8dc0-cafe1c937474 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:21.950377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8deec13d-0e85-4bfe-8dc0-cafe1c937474 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:22.217158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7c9f5f1c-e407-4abc-a944-bf561c925d91 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:22.233902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7c9f5f1c-e407-4abc-a944-bf561c925d91 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:22.238445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7c9f5f1c-e407-4abc-a944-bf561c925d91 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:22.241627 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7c9f5f1c-e407-4abc-a944-bf561c925d91 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1487 microversion: 2.25 time: 0.593276 Aug 24 10:18:22.243791 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 722/1565] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:21 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1487 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:22.256231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-be534dde-a97e-4e45-9804-14faa72f3c16 req-ece542de-9d9e-4d2d-9b38-e6188adf026f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd", "tag": "0d17d5fc-1b53-4721-ba1b-68c986a9e1dc"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:22.276838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-be534dde-a97e-4e45-9804-14faa72f3c16 req-ece542de-9d9e-4d2d-9b38-e6188adf026f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:22.277654 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-be534dde-a97e-4e45-9804-14faa72f3c16 req-ece542de-9d9e-4d2d-9b38-e6188adf026f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:22.278348 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-be534dde-a97e-4e45-9804-14faa72f3c16 req-ece542de-9d9e-4d2d-9b38-e6188adf026f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:22.299005 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-be534dde-a97e-4e45-9804-14faa72f3c16 req-ece542de-9d9e-4d2d-9b38-e6188adf026f service nova] Creating event network-changed:0d17d5fc-1b53-4721-ba1b-68c986a9e1dc for instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd on n-h2-849328-3 Aug 24 10:18:22.306208 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-be534dde-a97e-4e45-9804-14faa72f3c16 req-ece542de-9d9e-4d2d-9b38-e6188adf026f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060176 Aug 24 10:18:22.307935 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 723/1566] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:22.343267 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ec54648d-c28b-47bd-aefa-bb6570c09d9d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:22.349816 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ec54648d-c28b-47bd-aefa-bb6570c09d9d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 29550762-7055-4641-9d00-46151f4a510f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:22.379773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec54648d-c28b-47bd-aefa-bb6570c09d9d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:22.380641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec54648d-c28b-47bd-aefa-bb6570c09d9d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:22.387612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec54648d-c28b-47bd-aefa-bb6570c09d9d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:22.393331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec54648d-c28b-47bd-aefa-bb6570c09d9d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:22.395083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec54648d-c28b-47bd-aefa-bb6570c09d9d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:22.397843 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec54648d-c28b-47bd-aefa-bb6570c09d9d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:22.798063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ec54648d-c28b-47bd-aefa-bb6570c09d9d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:22.807442 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ec54648d-c28b-47bd-aefa-bb6570c09d9d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f" status: 200 len: 1307 microversion: 2.1 time: 0.497527 Aug 24 10:18:22.821072 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 724/1567] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:22 2022] GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f => generated 1307 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:22.825913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5c1d21c8-4a00-41f9-bd46-6e3023ce7a08 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:22.829223 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5c1d21c8-4a00-41f9-bd46-6e3023ce7a08 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:22.847145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c1d21c8-4a00-41f9-bd46-6e3023ce7a08 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:22.847145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c1d21c8-4a00-41f9-bd46-6e3023ce7a08 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:22.847145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c1d21c8-4a00-41f9-bd46-6e3023ce7a08 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:22.847145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c1d21c8-4a00-41f9-bd46-6e3023ce7a08 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:22.855318 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c1d21c8-4a00-41f9-bd46-6e3023ce7a08 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:22.855318 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c1d21c8-4a00-41f9-bd46-6e3023ce7a08 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:23.100592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8deec13d-0e85-4bfe-8dc0-cafe1c937474 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:23.158519 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8deec13d-0e85-4bfe-8dc0-cafe1c937474 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1471 microversion: 2.1 time: 1.277445 Aug 24 10:18:23.160124 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 844/1568] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:21 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1471 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:23.167211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-49db9147-cf50-4e21-a4dc-af54dc0875f0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:23.169623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-49db9147-cf50-4e21-a4dc-af54dc0875f0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:23.183576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49db9147-cf50-4e21-a4dc-af54dc0875f0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:23.185316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49db9147-cf50-4e21-a4dc-af54dc0875f0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:23.186705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49db9147-cf50-4e21-a4dc-af54dc0875f0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:23.187857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49db9147-cf50-4e21-a4dc-af54dc0875f0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:23.188631 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49db9147-cf50-4e21-a4dc-af54dc0875f0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:23.189650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49db9147-cf50-4e21-a4dc-af54dc0875f0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:23.538103 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5c1d21c8-4a00-41f9-bd46-6e3023ce7a08 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:23.577317 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5c1d21c8-4a00-41f9-bd46-6e3023ce7a08 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 200 len: 1325 microversion: 2.1 time: 0.760280 Aug 24 10:18:23.594755 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 725/1569] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:22 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 1325 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:23.627012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a33b4887-12ce-47dd-aa71-0ea5cf04c20e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:23.628741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a33b4887-12ce-47dd-aa71-0ea5cf04c20e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:23.653195 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a33b4887-12ce-47dd-aa71-0ea5cf04c20e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:23.656243 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a33b4887-12ce-47dd-aa71-0ea5cf04c20e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:23.657473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a33b4887-12ce-47dd-aa71-0ea5cf04c20e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:23.658322 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a33b4887-12ce-47dd-aa71-0ea5cf04c20e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:23.660904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a33b4887-12ce-47dd-aa71-0ea5cf04c20e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:23.668680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a33b4887-12ce-47dd-aa71-0ea5cf04c20e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:23.811990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-49db9147-cf50-4e21-a4dc-af54dc0875f0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:23.821558 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-49db9147-cf50-4e21-a4dc-af54dc0875f0 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1470 microversion: 2.1 time: 0.659649 Aug 24 10:18:23.824120 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 845/1570] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:23 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1470 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:23.850833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ff861d50-091d-43ac-9875-c7fd7fac4ef4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:23.851493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ff861d50-091d-43ac-9875-c7fd7fac4ef4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:23.867151 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff861d50-091d-43ac-9875-c7fd7fac4ef4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:23.867680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff861d50-091d-43ac-9875-c7fd7fac4ef4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:23.874098 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff861d50-091d-43ac-9875-c7fd7fac4ef4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:23.875075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff861d50-091d-43ac-9875-c7fd7fac4ef4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:23.875585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff861d50-091d-43ac-9875-c7fd7fac4ef4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:23.876029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff861d50-091d-43ac-9875-c7fd7fac4ef4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:24.174272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a33b4887-12ce-47dd-aa71-0ea5cf04c20e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:24.191666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a33b4887-12ce-47dd-aa71-0ea5cf04c20e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:24.200239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a33b4887-12ce-47dd-aa71-0ea5cf04c20e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:24.201953 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a33b4887-12ce-47dd-aa71-0ea5cf04c20e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1886 microversion: 2.32 time: 0.605417 Aug 24 10:18:24.202794 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 726/1571] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:23 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1886 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:24.211878 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3503750f-dda3-4b20-af41-2874c01b1ead tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:24.215065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3503750f-dda3-4b20-af41-2874c01b1ead tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 29550762-7055-4641-9d00-46151f4a510f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:24.232244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3503750f-dda3-4b20-af41-2874c01b1ead tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:24.233276 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3503750f-dda3-4b20-af41-2874c01b1ead tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:24.233978 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3503750f-dda3-4b20-af41-2874c01b1ead tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:24.237542 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3503750f-dda3-4b20-af41-2874c01b1ead tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:24.238461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3503750f-dda3-4b20-af41-2874c01b1ead tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:24.239404 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3503750f-dda3-4b20-af41-2874c01b1ead tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:24.592490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ff861d50-091d-43ac-9875-c7fd7fac4ef4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:24.601822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ff861d50-091d-43ac-9875-c7fd7fac4ef4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:24.612600 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ff861d50-091d-43ac-9875-c7fd7fac4ef4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:24.614085 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ff861d50-091d-43ac-9875-c7fd7fac4ef4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1487 microversion: 2.25 time: 0.772264 Aug 24 10:18:24.619172 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 846/1572] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:23 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1487 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:24.625321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2e135a3b-ad47-4016-822d-fdea4a4b4ab3 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:24.633958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2e135a3b-ad47-4016-822d-fdea4a4b4ab3 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:24.645667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e135a3b-ad47-4016-822d-fdea4a4b4ab3 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:24.646571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e135a3b-ad47-4016-822d-fdea4a4b4ab3 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:24.647415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e135a3b-ad47-4016-822d-fdea4a4b4ab3 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:24.649640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e135a3b-ad47-4016-822d-fdea4a4b4ab3 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:24.662007 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e135a3b-ad47-4016-822d-fdea4a4b4ab3 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:24.662931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e135a3b-ad47-4016-822d-fdea4a4b4ab3 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:25.205594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2e135a3b-ad47-4016-822d-fdea4a4b4ab3 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:25.214275 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2e135a3b-ad47-4016-822d-fdea4a4b4ab3 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1471 microversion: 2.1 time: 0.593549 Aug 24 10:18:25.229215 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 847/1573] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:24 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1471 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:25.235327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-f5a10cdd-29db-4a5b-b4b5-c3d0e3a7a6ac req-06cad04d-772a-42e2-9c90-a6ec3441c24a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd", "tag": "ad5894fd-cc27-4c32-ae3e-406eea701b47"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:25.253448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f5a10cdd-29db-4a5b-b4b5-c3d0e3a7a6ac req-06cad04d-772a-42e2-9c90-a6ec3441c24a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:25.254087 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f5a10cdd-29db-4a5b-b4b5-c3d0e3a7a6ac req-06cad04d-772a-42e2-9c90-a6ec3441c24a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:25.254623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f5a10cdd-29db-4a5b-b4b5-c3d0e3a7a6ac req-06cad04d-772a-42e2-9c90-a6ec3441c24a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:25.277900 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-f5a10cdd-29db-4a5b-b4b5-c3d0e3a7a6ac req-06cad04d-772a-42e2-9c90-a6ec3441c24a service nova] Creating event network-changed:ad5894fd-cc27-4c32-ae3e-406eea701b47 for instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd on n-h2-849328-3 Aug 24 10:18:25.290064 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-f5a10cdd-29db-4a5b-b4b5-c3d0e3a7a6ac req-06cad04d-772a-42e2-9c90-a6ec3441c24a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059176 Aug 24 10:18:25.296553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3503750f-dda3-4b20-af41-2874c01b1ead tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:25.297505 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 848/1574] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:25.303796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3d7c5425-9843-4b07-8773-08c87b576402 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:25.307888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3d7c5425-9843-4b07-8773-08c87b576402 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:25.312972 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3503750f-dda3-4b20-af41-2874c01b1ead tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f" status: 200 len: 1307 microversion: 2.1 time: 1.108822 Aug 24 10:18:25.319861 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 727/1575] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:24 2022] GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f => generated 1307 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:25.333801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d7c5425-9843-4b07-8773-08c87b576402 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:25.334699 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d7c5425-9843-4b07-8773-08c87b576402 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:25.335511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d7c5425-9843-4b07-8773-08c87b576402 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:25.336458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d7c5425-9843-4b07-8773-08c87b576402 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:25.337183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d7c5425-9843-4b07-8773-08c87b576402 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:25.337441 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-712d3fcf-feb8-4851-9132-4119025a48d1 req-e09d7f10-2b5f-48dd-b65d-9653e7eb182a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29550762-7055-4641-9d00-46151f4a510f", "name": "network-vif-plugged", "status": "completed", "tag": "a2984dcb-2faa-47d0-bc19-8651905514d6"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:25.338068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d7c5425-9843-4b07-8773-08c87b576402 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:25.373754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-712d3fcf-feb8-4851-9132-4119025a48d1 req-e09d7f10-2b5f-48dd-b65d-9653e7eb182a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:25.375021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-712d3fcf-feb8-4851-9132-4119025a48d1 req-e09d7f10-2b5f-48dd-b65d-9653e7eb182a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:25.376644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-712d3fcf-feb8-4851-9132-4119025a48d1 req-e09d7f10-2b5f-48dd-b65d-9653e7eb182a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:25.399849 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-712d3fcf-feb8-4851-9132-4119025a48d1 req-e09d7f10-2b5f-48dd-b65d-9653e7eb182a service nova] Creating event network-vif-plugged:a2984dcb-2faa-47d0-bc19-8651905514d6 for instance 29550762-7055-4641-9d00-46151f4a510f on n-h1-849328-3 Aug 24 10:18:25.407048 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-712d3fcf-feb8-4851-9132-4119025a48d1 req-e09d7f10-2b5f-48dd-b65d-9653e7eb182a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084770 Aug 24 10:18:25.408589 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 728/1576] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:25.417574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0b2f1813-868c-4746-a7e5-3ec4edaf9d6b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:25.418575 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0b2f1813-868c-4746-a7e5-3ec4edaf9d6b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:25.428816 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b2f1813-868c-4746-a7e5-3ec4edaf9d6b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:25.431195 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b2f1813-868c-4746-a7e5-3ec4edaf9d6b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:25.440783 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b2f1813-868c-4746-a7e5-3ec4edaf9d6b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:25.444531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b2f1813-868c-4746-a7e5-3ec4edaf9d6b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:25.445395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b2f1813-868c-4746-a7e5-3ec4edaf9d6b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:25.449203 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b2f1813-868c-4746-a7e5-3ec4edaf9d6b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:25.930493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3d7c5425-9843-4b07-8773-08c87b576402 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:25.952597 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3d7c5425-9843-4b07-8773-08c87b576402 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 200 len: 1523 microversion: 2.1 time: 0.653157 Aug 24 10:18:25.952985 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 849/1577] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:25 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 1523 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:25.977111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e497d282-9f44-4440-a4bc-6b95bebe2526 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:25.978174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e497d282-9f44-4440-a4bc-6b95bebe2526 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:25.997489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e497d282-9f44-4440-a4bc-6b95bebe2526 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:25.999044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e497d282-9f44-4440-a4bc-6b95bebe2526 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:25.999531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e497d282-9f44-4440-a4bc-6b95bebe2526 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:26.000430 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e497d282-9f44-4440-a4bc-6b95bebe2526 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:26.001155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e497d282-9f44-4440-a4bc-6b95bebe2526 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:26.002722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e497d282-9f44-4440-a4bc-6b95bebe2526 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:26.049085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0b2f1813-868c-4746-a7e5-3ec4edaf9d6b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:26.073263 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0b2f1813-868c-4746-a7e5-3ec4edaf9d6b tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1463 microversion: 2.1 time: 0.662227 Aug 24 10:18:26.075178 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 729/1578] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:25 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1463 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:26.085507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-50dc428a-9446-489c-9227-f25a7ece3024 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:26.086422 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-50dc428a-9446-489c-9227-f25a7ece3024 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:26.100251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50dc428a-9446-489c-9227-f25a7ece3024 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:26.103841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50dc428a-9446-489c-9227-f25a7ece3024 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:26.104837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50dc428a-9446-489c-9227-f25a7ece3024 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:26.116322 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50dc428a-9446-489c-9227-f25a7ece3024 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:26.119514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50dc428a-9446-489c-9227-f25a7ece3024 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:26.121662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50dc428a-9446-489c-9227-f25a7ece3024 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:26.497794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e497d282-9f44-4440-a4bc-6b95bebe2526 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:26.512595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e497d282-9f44-4440-a4bc-6b95bebe2526 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:26.516861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e497d282-9f44-4440-a4bc-6b95bebe2526 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:26.520675 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e497d282-9f44-4440-a4bc-6b95bebe2526 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1886 microversion: 2.32 time: 0.554422 Aug 24 10:18:26.522983 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 850/1579] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:25 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1886 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:26.536098 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ef27627-6f94-4cbb-8409-fa54b155ea6a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:26.537019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0ef27627-6f94-4cbb-8409-fa54b155ea6a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:26.549545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ef27627-6f94-4cbb-8409-fa54b155ea6a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:26.552051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ef27627-6f94-4cbb-8409-fa54b155ea6a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:26.556847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ef27627-6f94-4cbb-8409-fa54b155ea6a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:26.557987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ef27627-6f94-4cbb-8409-fa54b155ea6a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:26.558457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ef27627-6f94-4cbb-8409-fa54b155ea6a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:26.558874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ef27627-6f94-4cbb-8409-fa54b155ea6a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:26.821561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0ef27627-6f94-4cbb-8409-fa54b155ea6a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:26.829805 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0ef27627-6f94-4cbb-8409-fa54b155ea6a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 200 len: 1523 microversion: 2.1 time: 0.299783 Aug 24 10:18:26.830398 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 851/1580] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:26 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 1523 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:26.900003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-50dc428a-9446-489c-9227-f25a7ece3024 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:26.930313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-50dc428a-9446-489c-9227-f25a7ece3024 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:26.939741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-50dc428a-9446-489c-9227-f25a7ece3024 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:26.942354 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-50dc428a-9446-489c-9227-f25a7ece3024 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1487 microversion: 2.25 time: 0.862704 Aug 24 10:18:26.947494 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 730/1581] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:26 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1487 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:26.956329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b917bded-4a68-42f6-8968-c22b186e7b34 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:26.968057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b917bded-4a68-42f6-8968-c22b186e7b34 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:26.992117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b917bded-4a68-42f6-8968-c22b186e7b34 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:26.993309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b917bded-4a68-42f6-8968-c22b186e7b34 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:26.994022 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b917bded-4a68-42f6-8968-c22b186e7b34 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:26.996277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b917bded-4a68-42f6-8968-c22b186e7b34 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:26.999286 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b917bded-4a68-42f6-8968-c22b186e7b34 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:26.999862 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b917bded-4a68-42f6-8968-c22b186e7b34 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:27.132762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-40e0c4b1-ce44-456f-94e3-cb734c5fbf75 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:27.133720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-40e0c4b1-ce44-456f-94e3-cb734c5fbf75 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:27.150063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40e0c4b1-ce44-456f-94e3-cb734c5fbf75 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:27.151951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40e0c4b1-ce44-456f-94e3-cb734c5fbf75 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:27.152905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40e0c4b1-ce44-456f-94e3-cb734c5fbf75 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:27.154375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40e0c4b1-ce44-456f-94e3-cb734c5fbf75 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:27.155482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40e0c4b1-ce44-456f-94e3-cb734c5fbf75 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:27.156446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40e0c4b1-ce44-456f-94e3-cb734c5fbf75 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:27.387168 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-40e0c4b1-ce44-456f-94e3-cb734c5fbf75 tempest-MigrationsAdminTest-637766083 tempest-MigrationsAdminTest-637766083-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1614 microversion: 2.1 time: 0.552923 Aug 24 10:18:27.388605 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 852/1582] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:26 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1614 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:27.394544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3a6d40c7-5f14-4927-825d-30c15cf417eb tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:27.396126 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3a6d40c7-5f14-4927-825d-30c15cf417eb tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 29550762-7055-4641-9d00-46151f4a510f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:27.406163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a6d40c7-5f14-4927-825d-30c15cf417eb tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:27.406901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a6d40c7-5f14-4927-825d-30c15cf417eb tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:27.407564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a6d40c7-5f14-4927-825d-30c15cf417eb tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:27.408542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a6d40c7-5f14-4927-825d-30c15cf417eb tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:27.409253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a6d40c7-5f14-4927-825d-30c15cf417eb tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:27.410058 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a6d40c7-5f14-4927-825d-30c15cf417eb tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:27.422647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b917bded-4a68-42f6-8968-c22b186e7b34 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:27.440001 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b917bded-4a68-42f6-8968-c22b186e7b34 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1471 microversion: 2.1 time: 0.490300 Aug 24 10:18:27.440936 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 731/1583] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:26 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1471 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:27.636714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c3e731be-73d4-4581-a57c-61befa012d1c tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Action: 'create', calling method: .version_select at 0x7f46558373a0>, body: {"keypair": {"name": "tempest-keypair-731354037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyPljK2I7JwgCE+ETPH6PYBhlGKXUvq/EaAYQ3Sd+Hmsf5Imb/sgHRgAz12d3pn4jLmFJajj/wNLBI7YhyrMt31yASG73qttfzTfvT2ofeG4+M/DPEEoz5/GekOVyErzQ=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:27.661381 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:27.698288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-c3e731be-73d4-4581-a57c-61befa012d1c tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Getting quotas for project 1c1d41b854f94d67be99f5926a96376c. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:18:27.711366 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-c3e731be-73d4-4581-a57c-61befa012d1c tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Getting quotas for user 72cfea45817848c5b0d3e20087d60d4b and project 1c1d41b854f94d67be99f5926a96376c. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:18:27.781276 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c3e731be-73d4-4581-a57c-61befa012d1c tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.338372 Aug 24 10:18:27.788137 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 732/1584] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:18:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:27.793386 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4b6cf826-36a1-413f-a80f-40643209c977 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1816508912", "metadata": {"": ""}}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:27.811757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4b6cf826-36a1-413f-a80f-40643209c977 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Request method failure captured: Aug 24 10:18:27.811757 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3/action HTTP/1.1 Aug 24 10:18:27.811757 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:18:27.811757 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:18:27.811757 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:18:27.811757 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 107 Aug 24 10:18:27.811757 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:18:27.811757 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:18:27.811757 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:18:27.811757 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:18:27.811757 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfrThttCsJVn6ZYJ5IPHV9fokEqNFKnmNalLL8nZmf_ei5N3zrV08QH1KmLggfkmBKerwFjLosb49uBsjyVeSxt3NJxRyvR4_2es1MonVPd0vwRK6vdPZfvD2BRibktcybuLmMjpd59h5dgQc8Mlu-A4JR-WB_EJM5jyYx0kRVbI5dw Aug 24 10:18:27.811757 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:18:27.811757 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:18:27.811757 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:18:27.811757 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:18:27.811757 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:18:27.811757 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:18:27.811757 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 014076c393b148618aa03e8e8a0d5be7 Aug 24 10:18:27.811757 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:18:27.811757 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:18:27.811757 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:18:27.814725 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/014076c393b148618aa03e8e8a0d5be7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_014076c393b148618aa03e8e8a0d5be7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/014076c393b148618aa03e8e8a0d5be7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/014076c393b148618aa03e8e8a0d5be7"}]}] Aug 24 10:18:27.814725 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:18:27.814725 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 014076c393b148618aa03e8e8a0d5be7 Aug 24 10:18:27.814725 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:18:27.814725 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ImagesOneServerNegativeTestJSON-949139278-project Aug 24 10:18:27.814725 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:18:27.814725 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:18:27.814725 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: a9111f8a2bae4e25a353ebb15eca2d5a Aug 24 10:18:27.814725 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-949139278-project Aug 24 10:18:27.814725 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:18:27.814725 n-d-849328-3 devstack@n-api.service[122432]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1816508912", "metadata": {"": ""}}} Aug 24 10:18:27.814725 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:18:27.815845 n-d-849328-3 devstack@n-api.service[122432]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 10:18:27.815845 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'd2ed58ac-b16a-4f31-9394-f65217aea1d3', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1816508912', 'metadata': {'': ''}}}} Aug 24 10:18:27.815845 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:18:27.815845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:27.815845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:18:27.815845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:18:27.815845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:18:27.815845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:18:27.815845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 10:18:27.815845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:27.815845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 24 10:18:27.815845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 24 10:18:27.815845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 24 10:18:27.815845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 24 10:18:27.815845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 24 10:18:27.815845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:27.815845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 24 10:18:27.815845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'': ''} Aug 24 10:18:27.815845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:27.815845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:27.815845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:27.818211 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:27.818211 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:27.818211 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:27.818211 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:18:27.818211 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:18:27.818211 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:18:27.818211 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:18:27.818211 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:18:27.818211 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:18:27.818211 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:18:27.818211 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:18:27.818211 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:18:27.818211 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:18:27.818211 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:18:27.818211 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:18:27.818211 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 10:18:27.818211 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:27.818211 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:27.818211 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:27.818211 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:27.820541 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:27.820541 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:27.820541 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:18:27.820541 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:18:27.820541 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 10:18:27.820541 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:27.820541 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4b6cf826-36a1-413f-a80f-40643209c977 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:18:27.820541 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4b6cf826-36a1-413f-a80f-40643209c977 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "POST /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3/action" status: 400 len: 170 microversion: 2.1 time: 0.030355 Aug 24 10:18:27.820541 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 733/1585] 10.222.0.85 () {60 vars in 1279 bytes} [Wed Aug 24 10:18:27 2022] POST /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3/action => generated 170 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:18:27.827883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3a6d40c7-5f14-4927-825d-30c15cf417eb tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:27.830002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-88877a83-41dd-49ac-b8ea-6d0f81862efe req-664bca95-c3d5-4c71-9228-42274a6b2772 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd", "tag": "86a08323-7386-4e0b-baa9-7af8e90f13c9"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:27.845063 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3a6d40c7-5f14-4927-825d-30c15cf417eb tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f" status: 200 len: 1486 microversion: 2.1 time: 0.454706 Aug 24 10:18:27.846124 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 853/1586] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:27 2022] GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f => generated 1486 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:27.848099 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-88877a83-41dd-49ac-b8ea-6d0f81862efe req-664bca95-c3d5-4c71-9228-42274a6b2772 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:27.850516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-88877a83-41dd-49ac-b8ea-6d0f81862efe req-664bca95-c3d5-4c71-9228-42274a6b2772 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:27.851212 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-88877a83-41dd-49ac-b8ea-6d0f81862efe req-664bca95-c3d5-4c71-9228-42274a6b2772 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:27.854488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-13b94ce5-cb5d-46f5-8d3f-4042fe031a64 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:27.858090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-13b94ce5-cb5d-46f5-8d3f-4042fe031a64 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:27.872903 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13b94ce5-cb5d-46f5-8d3f-4042fe031a64 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:27.874021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13b94ce5-cb5d-46f5-8d3f-4042fe031a64 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:27.877192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13b94ce5-cb5d-46f5-8d3f-4042fe031a64 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:27.877401 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-88877a83-41dd-49ac-b8ea-6d0f81862efe req-664bca95-c3d5-4c71-9228-42274a6b2772 service nova] Creating event network-changed:86a08323-7386-4e0b-baa9-7af8e90f13c9 for instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd on n-h2-849328-3 Aug 24 10:18:27.882347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13b94ce5-cb5d-46f5-8d3f-4042fe031a64 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:27.883309 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13b94ce5-cb5d-46f5-8d3f-4042fe031a64 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:27.884330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13b94ce5-cb5d-46f5-8d3f-4042fe031a64 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:27.893513 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-88877a83-41dd-49ac-b8ea-6d0f81862efe req-664bca95-c3d5-4c71-9228-42274a6b2772 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077807 Aug 24 10:18:27.896934 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 734/1587] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:27.919250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0a3df9b7-41e7-4fab-8a18-81e34ee383bf tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:27.921013 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0a3df9b7-41e7-4fab-8a18-81e34ee383bf tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:27.940814 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a3df9b7-41e7-4fab-8a18-81e34ee383bf tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:27.944874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a3df9b7-41e7-4fab-8a18-81e34ee383bf tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:27.945646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a3df9b7-41e7-4fab-8a18-81e34ee383bf tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:27.947515 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a3df9b7-41e7-4fab-8a18-81e34ee383bf tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:27.948232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a3df9b7-41e7-4fab-8a18-81e34ee383bf tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:27.948847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a3df9b7-41e7-4fab-8a18-81e34ee383bf tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:27.951537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-13b94ce5-cb5d-46f5-8d3f-4042fe031a64 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:18:28.091727 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:28.134767 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-13b94ce5-cb5d-46f5-8d3f-4042fe031a64 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "DELETE /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 204 len: 0 microversion: 2.1 time: 0.287069 Aug 24 10:18:28.138796 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 854/1588] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:18:27 2022] DELETE /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:18:28.148210 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-5a3c89ff-baba-4214-bc30-9a880075d46d req-d081a023-d0a1-4b40-93b1-4dbfa75c9ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6451db-5c2a-422c-84ff-c13e81621a71", "name": "network-vif-plugged", "status": "completed", "tag": "7d183dba-e72f-4aa1-9c43-d620da8dd93b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:28.165298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5a3c89ff-baba-4214-bc30-9a880075d46d req-d081a023-d0a1-4b40-93b1-4dbfa75c9ba6 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:28.168868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5a3c89ff-baba-4214-bc30-9a880075d46d req-d081a023-d0a1-4b40-93b1-4dbfa75c9ba6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:28.169441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5a3c89ff-baba-4214-bc30-9a880075d46d req-d081a023-d0a1-4b40-93b1-4dbfa75c9ba6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:28.217389 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-5a3c89ff-baba-4214-bc30-9a880075d46d req-d081a023-d0a1-4b40-93b1-4dbfa75c9ba6 service nova] Creating event network-vif-plugged:7d183dba-e72f-4aa1-9c43-d620da8dd93b for instance 1f6451db-5c2a-422c-84ff-c13e81621a71 on n-h1-849328-3 Aug 24 10:18:28.228796 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-5a3c89ff-baba-4214-bc30-9a880075d46d req-d081a023-d0a1-4b40-93b1-4dbfa75c9ba6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091523 Aug 24 10:18:28.232549 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 855/1589] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:28.244461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5b0f39c7-15f2-4ab9-99a8-f3a109c4130a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:28.248624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5b0f39c7-15f2-4ab9-99a8-f3a109c4130a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:28.264580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b0f39c7-15f2-4ab9-99a8-f3a109c4130a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:28.265066 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b0f39c7-15f2-4ab9-99a8-f3a109c4130a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:28.265887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b0f39c7-15f2-4ab9-99a8-f3a109c4130a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:28.266826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b0f39c7-15f2-4ab9-99a8-f3a109c4130a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:28.269523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b0f39c7-15f2-4ab9-99a8-f3a109c4130a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:28.270797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b0f39c7-15f2-4ab9-99a8-f3a109c4130a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:28.489003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0a3df9b7-41e7-4fab-8a18-81e34ee383bf tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:28.502962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0a3df9b7-41e7-4fab-8a18-81e34ee383bf tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:28.504641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0a3df9b7-41e7-4fab-8a18-81e34ee383bf tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:28.507934 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0a3df9b7-41e7-4fab-8a18-81e34ee383bf tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1874 microversion: 2.32 time: 0.609479 Aug 24 10:18:28.514222 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 735/1590] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:27 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1874 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:28.519265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-63544627-51bc-4d4f-a630-ea5d90083c7b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-886432397"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:28.532056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-63544627-51bc-4d4f-a630-ea5d90083c7b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 29550762-7055-4641-9d00-46151f4a510f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:28.539002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63544627-51bc-4d4f-a630-ea5d90083c7b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:28.543015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63544627-51bc-4d4f-a630-ea5d90083c7b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:28.543696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63544627-51bc-4d4f-a630-ea5d90083c7b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:28.544592 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63544627-51bc-4d4f-a630-ea5d90083c7b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:28.548376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5b0f39c7-15f2-4ab9-99a8-f3a109c4130a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:28.548741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63544627-51bc-4d4f-a630-ea5d90083c7b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:28.549414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63544627-51bc-4d4f-a630-ea5d90083c7b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:28.557985 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5b0f39c7-15f2-4ab9-99a8-f3a109c4130a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 200 len: 1523 microversion: 2.1 time: 0.323628 Aug 24 10:18:28.573980 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 856/1591] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:28 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 1523 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:28.585012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-103d8c0a-c3c0-4c88-b033-a67b541e6df4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:28.586101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-103d8c0a-c3c0-4c88-b033-a67b541e6df4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:28.592859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-103d8c0a-c3c0-4c88-b033-a67b541e6df4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:28.593687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-103d8c0a-c3c0-4c88-b033-a67b541e6df4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:28.594290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-103d8c0a-c3c0-4c88-b033-a67b541e6df4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:28.596840 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-103d8c0a-c3c0-4c88-b033-a67b541e6df4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:28.597521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-103d8c0a-c3c0-4c88-b033-a67b541e6df4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:28.598152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-103d8c0a-c3c0-4c88-b033-a67b541e6df4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:28.890404 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-103d8c0a-c3c0-4c88-b033-a67b541e6df4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:28.902729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-103d8c0a-c3c0-4c88-b033-a67b541e6df4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:28.904410 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-103d8c0a-c3c0-4c88-b033-a67b541e6df4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:28.905701 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-103d8c0a-c3c0-4c88-b033-a67b541e6df4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1487 microversion: 2.25 time: 0.330310 Aug 24 10:18:28.906302 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 857/1592] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:28 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1487 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:28.919431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bdd828d8-b14d-436f-8f8a-c630647797ea tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:28.920137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bdd828d8-b14d-436f-8f8a-c630647797ea tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:28.934174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdd828d8-b14d-436f-8f8a-c630647797ea tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:28.934688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdd828d8-b14d-436f-8f8a-c630647797ea tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:28.935141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdd828d8-b14d-436f-8f8a-c630647797ea tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:28.941731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdd828d8-b14d-436f-8f8a-c630647797ea tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:28.942273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdd828d8-b14d-436f-8f8a-c630647797ea tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:28.942735 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdd828d8-b14d-436f-8f8a-c630647797ea tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:28.987656 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-63544627-51bc-4d4f-a630-ea5d90083c7b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "POST /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f/action" status: 202 len: 0 microversion: 2.1 time: 0.471579 Aug 24 10:18:28.995226 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 736/1593] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:18:28 2022] POST /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 10:18:29.012570 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c5b0db7d-bf59-4c56-bd35-733aba13f353 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:29.013372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c5b0db7d-bf59-4c56-bd35-733aba13f353 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:29.046342 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5b0db7d-bf59-4c56-bd35-733aba13f353 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:29.047168 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5b0db7d-bf59-4c56-bd35-733aba13f353 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:29.048402 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5b0db7d-bf59-4c56-bd35-733aba13f353 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:29.049464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5b0db7d-bf59-4c56-bd35-733aba13f353 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:29.058426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5b0db7d-bf59-4c56-bd35-733aba13f353 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:29.059506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5b0db7d-bf59-4c56-bd35-733aba13f353 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:29.266989 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bdd828d8-b14d-436f-8f8a-c630647797ea tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:29.276100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:29.280465 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bdd828d8-b14d-436f-8f8a-c630647797ea tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1469 microversion: 2.1 time: 0.372924 Aug 24 10:18:29.282030 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 858/1594] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:28 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1469 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:29.288625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3289815e-51d2-46a7-b443-de59b7e4830f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:29.289634 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3289815e-51d2-46a7-b443-de59b7e4830f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:29.305406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3289815e-51d2-46a7-b443-de59b7e4830f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:29.305903 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3289815e-51d2-46a7-b443-de59b7e4830f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:29.306551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3289815e-51d2-46a7-b443-de59b7e4830f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:29.310893 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3289815e-51d2-46a7-b443-de59b7e4830f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:29.311602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3289815e-51d2-46a7-b443-de59b7e4830f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:29.312254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3289815e-51d2-46a7-b443-de59b7e4830f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:29.374815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c5b0db7d-bf59-4c56-bd35-733aba13f353 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:29.395224 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c5b0db7d-bf59-4c56-bd35-733aba13f353 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1471 microversion: 2.1 time: 0.398867 Aug 24 10:18:29.420563 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 737/1595] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:28 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1471 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:29.434574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f6fd290b-3eb1-45f8-ac23-83abd69d8524 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f465548f3a0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:29.524644 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f6fd290b-3eb1-45f8-ac23-83abd69d8524 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/58e9b0af-a4cd-43e6-9602-ceea13a414b0" status: 200 len: 1413 microversion: 2.1 time: 0.102713 Aug 24 10:18:29.538016 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 738/1596] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:18:29 2022] GET /compute/v2.1/images/58e9b0af-a4cd-43e6-9602-ceea13a414b0 => generated 1413 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:29.543559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-501ad890-14c4-4bd8-b2e0-89faaa251935 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:29.557749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-501ad890-14c4-4bd8-b2e0-89faaa251935 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:29.565229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-501ad890-14c4-4bd8-b2e0-89faaa251935 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:29.566253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-501ad890-14c4-4bd8-b2e0-89faaa251935 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:29.567319 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-501ad890-14c4-4bd8-b2e0-89faaa251935 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:29.569334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-501ad890-14c4-4bd8-b2e0-89faaa251935 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:29.570049 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-501ad890-14c4-4bd8-b2e0-89faaa251935 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:29.570734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-501ad890-14c4-4bd8-b2e0-89faaa251935 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:29.692524 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3289815e-51d2-46a7-b443-de59b7e4830f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:29.703270 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3289815e-51d2-46a7-b443-de59b7e4830f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 200 len: 1523 microversion: 2.1 time: 0.417595 Aug 24 10:18:29.721017 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 859/1597] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:29 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 1523 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:29.727185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8cd0a084-f998-4010-9f0c-a457be664016 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f465836e550>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:29.800469 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8cd0a084-f998-4010-9f0c-a457be664016 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/58e9b0af-a4cd-43e6-9602-ceea13a414b0" status: 200 len: 1413 microversion: 2.1 time: 0.077906 Aug 24 10:18:29.801672 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 860/1598] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:18:29 2022] GET /compute/v2.1/images/58e9b0af-a4cd-43e6-9602-ceea13a414b0 => generated 1413 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:29.806847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e05cccba-979a-46cb-b1e2-94c838cd70fc tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-927574733", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:29.813465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e05cccba-979a-46cb-b1e2-94c838cd70fc tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Request method failure captured: Aug 24 10:18:29.813465 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3/action HTTP/1.1 Aug 24 10:18:29.813465 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:18:29.813465 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:18:29.813465 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:18:29.813465 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 618 Aug 24 10:18:29.813465 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:18:29.813465 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:18:29.813465 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:18:29.813465 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:18:29.813465 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfrThttCsJVn6ZYJ5IPHV9fokEqNFKnmNalLL8nZmf_ei5N3zrV08QH1KmLggfkmBKerwFjLosb49uBsjyVeSxt3NJxRyvR4_2es1MonVPd0vwRK6vdPZfvD2BRibktcybuLmMjpd59h5dgQc8Mlu-A4JR-WB_EJM5jyYx0kRVbI5dw Aug 24 10:18:29.813465 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:18:29.813465 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:18:29.813465 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:18:29.813465 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:18:29.813465 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:18:29.813465 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:18:29.813465 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 014076c393b148618aa03e8e8a0d5be7 Aug 24 10:18:29.813465 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:18:29.813465 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:18:29.813465 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:18:29.815021 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/014076c393b148618aa03e8e8a0d5be7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_014076c393b148618aa03e8e8a0d5be7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/014076c393b148618aa03e8e8a0d5be7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/014076c393b148618aa03e8e8a0d5be7"}]}] Aug 24 10:18:29.815021 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:18:29.815021 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 014076c393b148618aa03e8e8a0d5be7 Aug 24 10:18:29.815021 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:18:29.815021 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesOneServerNegativeTestJSON-949139278-project Aug 24 10:18:29.815021 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:18:29.815021 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:18:29.815021 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: a9111f8a2bae4e25a353ebb15eca2d5a Aug 24 10:18:29.815021 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-949139278-project Aug 24 10:18:29.815021 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:18:29.815709 n-d-849328-3 devstack@n-api.service[122433]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-927574733", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 24 10:18:29.815709 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:18:29.815709 n-d-849328-3 devstack@n-api.service[122433]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 10:18:29.815974 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'd2ed58ac-b16a-4f31-9394-f65217aea1d3', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-927574733', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 24 10:18:29.815974 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:18:29.815974 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:29.815974 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:18:29.815974 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:18:29.815974 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:18:29.815974 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:18:29.815974 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 10:18:29.815974 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:29.815974 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 24 10:18:29.815974 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 24 10:18:29.816756 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 24 10:18:29.816756 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 24 10:18:29.816756 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 24 10:18:29.816756 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:29.816756 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 24 10:18:29.816756 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 24 10:18:29.816756 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:29.816756 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:29.816756 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:29.816756 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:29.816756 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:29.816756 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:29.816756 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:18:29.816756 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:18:29.816756 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:18:29.816756 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:18:29.816756 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:18:29.817922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:18:29.817922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:18:29.817922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:18:29.817922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:18:29.817922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:18:29.817922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:18:29.817922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:18:29.817922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 10:18:29.817922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:29.817922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:29.817922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:29.817922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:29.820657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:29.820657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:29.820657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:18:29.820657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:18:29.820657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 10:18:29.820657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:29.823206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e05cccba-979a-46cb-b1e2-94c838cd70fc tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:18:29.824150 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e05cccba-979a-46cb-b1e2-94c838cd70fc tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "POST /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3/action" status: 400 len: 938 microversion: 2.1 time: 0.021158 Aug 24 10:18:29.828438 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 861/1599] 10.222.0.85 () {60 vars in 1279 bytes} [Wed Aug 24 10:18:29 2022] POST /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3/action => generated 938 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:18:29.836416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dd6de405-a97d-48bb-997a-a19db7ca157d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f46550dc430>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:30.028036 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dd6de405-a97d-48bb-997a-a19db7ca157d tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "DELETE /compute/v2.1/images/58e9b0af-a4cd-43e6-9602-ceea13a414b0" status: 204 len: 0 microversion: 2.1 time: 0.200145 Aug 24 10:18:30.028752 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 862/1600] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:29 2022] DELETE /compute/v2.1/images/58e9b0af-a4cd-43e6-9602-ceea13a414b0 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:18:30.034212 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c5ddd539-dbe8-4d01-8194-bda00fa30c44 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:30.034861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c5ddd539-dbe8-4d01-8194-bda00fa30c44 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:30.048841 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5ddd539-dbe8-4d01-8194-bda00fa30c44 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:30.049793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5ddd539-dbe8-4d01-8194-bda00fa30c44 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:30.050493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5ddd539-dbe8-4d01-8194-bda00fa30c44 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:30.051223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5ddd539-dbe8-4d01-8194-bda00fa30c44 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:30.051681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5ddd539-dbe8-4d01-8194-bda00fa30c44 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:30.052751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5ddd539-dbe8-4d01-8194-bda00fa30c44 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:30.223891 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-501ad890-14c4-4bd8-b2e0-89faaa251935 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:30.227714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:30.244575 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-501ad890-14c4-4bd8-b2e0-89faaa251935 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:30.254418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-501ad890-14c4-4bd8-b2e0-89faaa251935 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:30.256100 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-501ad890-14c4-4bd8-b2e0-89faaa251935 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1874 microversion: 2.32 time: 0.716843 Aug 24 10:18:30.257624 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 739/1601] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:29 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1874 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:30.263478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b871faa5-5eba-4b66-be28-108f7aad29ae tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:30.264536 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b871faa5-5eba-4b66-be28-108f7aad29ae tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:30.275601 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b871faa5-5eba-4b66-be28-108f7aad29ae tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:30.277773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b871faa5-5eba-4b66-be28-108f7aad29ae tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:30.278732 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b871faa5-5eba-4b66-be28-108f7aad29ae tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:30.280477 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b871faa5-5eba-4b66-be28-108f7aad29ae tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:30.281234 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b871faa5-5eba-4b66-be28-108f7aad29ae tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:30.282521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b871faa5-5eba-4b66-be28-108f7aad29ae tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:30.653382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c5ddd539-dbe8-4d01-8194-bda00fa30c44 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:30.664690 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c5ddd539-dbe8-4d01-8194-bda00fa30c44 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 200 len: 1523 microversion: 2.1 time: 0.634533 Aug 24 10:18:30.675104 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 863/1602] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:30 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 1523 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:30.682969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2f894ed2-8fa2-456d-87a3-5f7a08afe9c2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f46552b3820>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:30.709662 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-2f894ed2-8fa2-456d-87a3-5f7a08afe9c2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] HTTP exception thrown: Image not found. Aug 24 10:18:30.719183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2f894ed2-8fa2-456d-87a3-5f7a08afe9c2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Request method failure captured: Aug 24 10:18:30.719183 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/images/58e9b0af-a4cd-43e6-9602-ceea13a414b0 HTTP/1.1 Aug 24 10:18:30.719183 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:18:30.719183 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:18:30.719183 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:18:30.719183 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:18:30.719183 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:18:30.719183 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:18:30.719183 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:18:30.719183 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:18:30.719183 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfnS1_tZbOMQjvYaau3fpxFbXnEM4RBrIfdbp3hX2eYjW1M0H2Qlq9p5wGGFYLUMm7XU2K341XMWnPZ568_ln9w-gSvZOZHHS9kU-GcaywNCBoZIK1eQ7RV12BNbej14sdWRNBqZB1kTp9pOmHHHvshAoEZcBClQ9VYEIBYwPoRiFB4 Aug 24 10:18:30.719183 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:18:30.719183 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:18:30.719183 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:18:30.719183 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:18:30.719183 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:18:30.719183 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:18:30.719183 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d30703728b2a4a569b6dd1608d8956b8 Aug 24 10:18:30.719183 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:30.719183 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:18:30.719183 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:18:30.721412 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d30703728b2a4a569b6dd1608d8956b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d30703728b2a4a569b6dd1608d8956b8", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d30703728b2a4a569b6dd1608d8956b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d30703728b2a4a569b6dd1608d8956b8"}]}] Aug 24 10:18:30.721412 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:30.721412 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d30703728b2a4a569b6dd1608d8956b8 Aug 24 10:18:30.721412 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:30.721412 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesTestJSON-1542816385-project Aug 24 10:18:30.721412 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:18:30.721412 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:18:30.721412 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 85db443623964ed381b2a4cfc7310202 Aug 24 10:18:30.721412 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesTestJSON-1542816385-project Aug 24 10:18:30.721412 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:18:30.721412 n-d-849328-3 devstack@n-api.service[122433]: exception: Image not found. Aug 24 10:18:30.721412 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '58e9b0af-a4cd-43e6-9602-ceea13a414b0'} Aug 24 10:18:30.721412 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:18:30.721412 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:30.722774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 10:18:30.722774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 10:18:30.722774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:18:30.722774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:18:30.722774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 10:18:30.722774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 10:18:30.722774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:18:30.722774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:18:30.722774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 10:18:30.722774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 10:18:30.722774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 10:18:30.722774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 10:18:30.722774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:18:30.722774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:18:30.722774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:18:30.722774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:18:30.722774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 58e9b0af-a4cd-43e6-9602-ceea13a414b0 Aug 24 10:18:30.722774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:30.724257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:30.724257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:30.724257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:30.724257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 24 10:18:30.724257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 24 10:18:30.724257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 10:18:30.724257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 10:18:30.724257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 10:18:30.724257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 10:18:30.724257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 10:18:30.724257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 10:18:30.724257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 10:18:30.724257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 10:18:30.724257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:18:30.724257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:18:30.724257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 10:18:30.724257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 10:18:30.724257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:18:30.724257 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:18:30.726101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 10:18:30.726101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 10:18:30.726101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 10:18:30.726101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 10:18:30.726101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:18:30.726101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:18:30.726101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:18:30.726101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:18:30.726101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 58e9b0af-a4cd-43e6-9602-ceea13a414b0 could not be found. Aug 24 10:18:30.726101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:30.726101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:30.726101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:30.726101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:30.726101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:30.726101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:30.726101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:18:30.726101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:18:30.726101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:18:30.726101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:18:30.727672 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:18:30.727672 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:18:30.727672 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 24 10:18:30.727672 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 10:18:30.727672 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 10:18:30.727672 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:30.727672 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:30.727672 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:30.727672 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:30.727672 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:30.727672 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:30.727672 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:18:30.727672 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:18:30.727672 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 10:18:30.727672 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:30.727672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2f894ed2-8fa2-456d-87a3-5f7a08afe9c2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Returning 404 to user: Image not found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:18:30.727672 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2f894ed2-8fa2-456d-87a3-5f7a08afe9c2 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/images/58e9b0af-a4cd-43e6-9602-ceea13a414b0" status: 404 len: 62 microversion: 2.1 time: 0.044387 Aug 24 10:18:30.729912 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 864/1603] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:18:30 2022] GET /compute/v2.1/images/58e9b0af-a4cd-43e6-9602-ceea13a414b0 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:18:30.730015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-886ab2b8-1351-41ae-b465-6f1547036b57 req-5f1703e6-7691-4faa-b5c2-0df24b642aff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd", "tag": "b514d0b1-f7ce-48d8-aa66-0c3c1daca01e"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:30.772184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-886ab2b8-1351-41ae-b465-6f1547036b57 req-5f1703e6-7691-4faa-b5c2-0df24b642aff service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:30.773277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-886ab2b8-1351-41ae-b465-6f1547036b57 req-5f1703e6-7691-4faa-b5c2-0df24b642aff service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:30.773934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-886ab2b8-1351-41ae-b465-6f1547036b57 req-5f1703e6-7691-4faa-b5c2-0df24b642aff service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:30.788434 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-886ab2b8-1351-41ae-b465-6f1547036b57 req-5f1703e6-7691-4faa-b5c2-0df24b642aff service nova] Creating event network-changed:b514d0b1-f7ce-48d8-aa66-0c3c1daca01e for instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd on n-h2-849328-3 Aug 24 10:18:30.794540 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-886ab2b8-1351-41ae-b465-6f1547036b57 req-5f1703e6-7691-4faa-b5c2-0df24b642aff service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067640 Aug 24 10:18:30.795750 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 865/1604] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:30.803224 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7d8cc372-734b-476f-bec8-5ded28e01bf4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:30.804297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7d8cc372-734b-476f-bec8-5ded28e01bf4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:30.812889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d8cc372-734b-476f-bec8-5ded28e01bf4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:30.813414 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d8cc372-734b-476f-bec8-5ded28e01bf4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:30.813876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d8cc372-734b-476f-bec8-5ded28e01bf4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:30.814602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d8cc372-734b-476f-bec8-5ded28e01bf4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:30.815053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d8cc372-734b-476f-bec8-5ded28e01bf4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:30.815476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d8cc372-734b-476f-bec8-5ded28e01bf4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:30.986833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7d8cc372-734b-476f-bec8-5ded28e01bf4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:30.995503 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7d8cc372-734b-476f-bec8-5ded28e01bf4 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1469 microversion: 2.1 time: 0.198042 Aug 24 10:18:30.996234 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 866/1605] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:30 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1469 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:31.000948 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-374a0b43-7842-4417-8258-e8c79c89b87a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:31.001583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-374a0b43-7842-4417-8258-e8c79c89b87a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:31.007741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-374a0b43-7842-4417-8258-e8c79c89b87a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:31.008535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-374a0b43-7842-4417-8258-e8c79c89b87a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:31.009878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-374a0b43-7842-4417-8258-e8c79c89b87a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:31.010758 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-374a0b43-7842-4417-8258-e8c79c89b87a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:31.011208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-374a0b43-7842-4417-8258-e8c79c89b87a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:31.011627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-374a0b43-7842-4417-8258-e8c79c89b87a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:31.125548 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b871faa5-5eba-4b66-be28-108f7aad29ae tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:31.135662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b871faa5-5eba-4b66-be28-108f7aad29ae tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:31.138310 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b871faa5-5eba-4b66-be28-108f7aad29ae tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:31.139687 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b871faa5-5eba-4b66-be28-108f7aad29ae tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1487 microversion: 2.25 time: 0.880686 Aug 24 10:18:31.140412 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 740/1606] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:30 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1487 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:31.145802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-36a471c4-df06-4750-9a6c-95acc294018e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:31.146493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-36a471c4-df06-4750-9a6c-95acc294018e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:31.153230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36a471c4-df06-4750-9a6c-95acc294018e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:31.153599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36a471c4-df06-4750-9a6c-95acc294018e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:31.154243 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36a471c4-df06-4750-9a6c-95acc294018e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:31.155150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36a471c4-df06-4750-9a6c-95acc294018e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:31.155783 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36a471c4-df06-4750-9a6c-95acc294018e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:31.156215 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36a471c4-df06-4750-9a6c-95acc294018e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:31.184170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-374a0b43-7842-4417-8258-e8c79c89b87a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:31.191129 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-374a0b43-7842-4417-8258-e8c79c89b87a tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1471 microversion: 2.1 time: 0.193820 Aug 24 10:18:31.192456 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 867/1607] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:30 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1471 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:31.199892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f2f42d9-0ae5-476b-938e-e37d91f29758 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:31.200946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0f2f42d9-0ae5-476b-938e-e37d91f29758 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 29550762-7055-4641-9d00-46151f4a510f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:31.208234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f2f42d9-0ae5-476b-938e-e37d91f29758 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:31.208885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f2f42d9-0ae5-476b-938e-e37d91f29758 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:31.209406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f2f42d9-0ae5-476b-938e-e37d91f29758 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:31.210207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f2f42d9-0ae5-476b-938e-e37d91f29758 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:31.210720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f2f42d9-0ae5-476b-938e-e37d91f29758 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:31.211197 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f2f42d9-0ae5-476b-938e-e37d91f29758 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:31.352359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0f2f42d9-0ae5-476b-938e-e37d91f29758 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:31.360562 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0f2f42d9-0ae5-476b-938e-e37d91f29758 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f" status: 200 len: 1504 microversion: 2.1 time: 0.165652 Aug 24 10:18:31.361173 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 868/1608] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:31 2022] GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:31.366242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-503adebb-fb75-4b9f-9761-dd76f0f4b574 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-623840226", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e8512093-5b87-461c-a7c8-0d7cbac3d3a3"}], "security_groups": [{"name": "tempest-securitygroup--1511610808"}], "key_name": "tempest-keypair-731354037", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:31.491567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-503adebb-fb75-4b9f-9761-dd76f0f4b574 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] validate_networks() for [('e8512093-5b87-461c-a7c8-0d7cbac3d3a3', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:18:31.633832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-36a471c4-df06-4750-9a6c-95acc294018e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:31.644794 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-36a471c4-df06-4750-9a6c-95acc294018e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 200 len: 1523 microversion: 2.1 time: 0.502832 Aug 24 10:18:31.646488 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 741/1609] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:31 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 1523 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:31.652090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-26456eba-8e8b-440d-a1b6-b45f399fed2b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:31.653004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-26456eba-8e8b-440d-a1b6-b45f399fed2b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:31.659542 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26456eba-8e8b-440d-a1b6-b45f399fed2b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:31.660270 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26456eba-8e8b-440d-a1b6-b45f399fed2b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:31.660895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26456eba-8e8b-440d-a1b6-b45f399fed2b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:31.663311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26456eba-8e8b-440d-a1b6-b45f399fed2b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:31.664069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26456eba-8e8b-440d-a1b6-b45f399fed2b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:31.664765 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26456eba-8e8b-440d-a1b6-b45f399fed2b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:32.070680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-26456eba-8e8b-440d-a1b6-b45f399fed2b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:32.081680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-26456eba-8e8b-440d-a1b6-b45f399fed2b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:32.088609 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-26456eba-8e8b-440d-a1b6-b45f399fed2b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:32.094158 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-26456eba-8e8b-440d-a1b6-b45f399fed2b tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1874 microversion: 2.32 time: 0.446356 Aug 24 10:18:32.096624 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 742/1610] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:31 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1874 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:32.101834 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1565d536-7064-462c-99ce-43a417b408e6 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:32.106511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1565d536-7064-462c-99ce-43a417b408e6 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Request method failure captured: Aug 24 10:18:32.106511 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3/action HTTP/1.1 Aug 24 10:18:32.106511 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:18:32.106511 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:18:32.106511 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:18:32.106511 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 285 Aug 24 10:18:32.106511 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:18:32.106511 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:18:32.106511 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:18:32.106511 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:18:32.106511 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfrThttCsJVn6ZYJ5IPHV9fokEqNFKnmNalLL8nZmf_ei5N3zrV08QH1KmLggfkmBKerwFjLosb49uBsjyVeSxt3NJxRyvR4_2es1MonVPd0vwRK6vdPZfvD2BRibktcybuLmMjpd59h5dgQc8Mlu-A4JR-WB_EJM5jyYx0kRVbI5dw Aug 24 10:18:32.106511 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:18:32.106511 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:18:32.106511 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:18:32.106511 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:18:32.106511 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:18:32.106511 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:18:32.106511 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 014076c393b148618aa03e8e8a0d5be7 Aug 24 10:18:32.106511 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:18:32.106511 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:18:32.106511 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:18:32.108338 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/014076c393b148618aa03e8e8a0d5be7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_014076c393b148618aa03e8e8a0d5be7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/014076c393b148618aa03e8e8a0d5be7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/014076c393b148618aa03e8e8a0d5be7"}]}] Aug 24 10:18:32.108338 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:18:32.108338 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 014076c393b148618aa03e8e8a0d5be7 Aug 24 10:18:32.108338 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:18:32.108338 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ImagesOneServerNegativeTestJSON-949139278-project Aug 24 10:18:32.108338 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:18:32.108338 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:18:32.108338 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: a9111f8a2bae4e25a353ebb15eca2d5a Aug 24 10:18:32.108338 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-949139278-project Aug 24 10:18:32.108338 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:18:32.108338 n-d-849328-3 devstack@n-api.service[122432]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 24 10:18:32.109362 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:18:32.109362 n-d-849328-3 devstack@n-api.service[122432]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 10:18:32.109362 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'd2ed58ac-b16a-4f31-9394-f65217aea1d3', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 24 10:18:32.109362 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:18:32.109362 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:32.109362 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:18:32.109362 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:18:32.109362 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:18:32.109362 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:18:32.109362 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 10:18:32.110200 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:32.110200 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 24 10:18:32.110200 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 10:18:32.110200 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:32.110200 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 24 10:18:32.110200 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 24 10:18:32.110200 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:32.110200 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:32.110200 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:32.110200 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:32.110200 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:32.110200 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:32.110200 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:18:32.110200 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:18:32.110200 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:18:32.110200 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:18:32.110200 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:18:32.110200 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:18:32.110200 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:18:32.110200 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:18:32.111920 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:18:32.111920 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:18:32.111920 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:18:32.111920 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:18:32.111920 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 10:18:32.111920 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:32.111920 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:32.111920 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:32.111920 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:32.111920 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:32.111920 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:32.111920 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:18:32.111920 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:18:32.112978 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 10:18:32.112978 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:32.116653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1565d536-7064-462c-99ce-43a417b408e6 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:18:32.126352 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1565d536-7064-462c-99ce-43a417b408e6 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "POST /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3/action" status: 400 len: 619 microversion: 2.1 time: 0.028372 Aug 24 10:18:32.133684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-503adebb-fb75-4b9f-9761-dd76f0f4b574 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Getting quotas for project 1c1d41b854f94d67be99f5926a96376c. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:18:32.134490 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 743/1611] 10.222.0.85 () {60 vars in 1279 bytes} [Wed Aug 24 10:18:32 2022] POST /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3/action => generated 619 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:18:32.143973 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8df0a1cd-8140-482a-9b6f-79484f3e8244 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:32.145821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8df0a1cd-8140-482a-9b6f-79484f3e8244 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:32.154911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-503adebb-fb75-4b9f-9761-dd76f0f4b574 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Getting quotas for user 72cfea45817848c5b0d3e20087d60d4b and project 1c1d41b854f94d67be99f5926a96376c. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:18:32.156352 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8df0a1cd-8140-482a-9b6f-79484f3e8244 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:32.157220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8df0a1cd-8140-482a-9b6f-79484f3e8244 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:32.157851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8df0a1cd-8140-482a-9b6f-79484f3e8244 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:32.158764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8df0a1cd-8140-482a-9b6f-79484f3e8244 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:32.159400 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8df0a1cd-8140-482a-9b6f-79484f3e8244 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:32.170358 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8df0a1cd-8140-482a-9b6f-79484f3e8244 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:32.223585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-503adebb-fb75-4b9f-9761-dd76f0f4b574 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:18:32.224007 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-503adebb-fb75-4b9f-9761-dd76f0f4b574 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:18:32.224478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-503adebb-fb75-4b9f-9761-dd76f0f4b574 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:18:32.224884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-503adebb-fb75-4b9f-9761-dd76f0f4b574 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:18:32.233197 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-503adebb-fb75-4b9f-9761-dd76f0f4b574 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:18:32.255875 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-503adebb-fb75-4b9f-9761-dd76f0f4b574 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:32.260820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-503adebb-fb75-4b9f-9761-dd76f0f4b574 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:32.261703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-503adebb-fb75-4b9f-9761-dd76f0f4b574 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:32.267917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-503adebb-fb75-4b9f-9761-dd76f0f4b574 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:32.268708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-503adebb-fb75-4b9f-9761-dd76f0f4b574 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:32.269607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-503adebb-fb75-4b9f-9761-dd76f0f4b574 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:32.281573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8df0a1cd-8140-482a-9b6f-79484f3e8244 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:32.294755 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8df0a1cd-8140-482a-9b6f-79484f3e8244 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 200 len: 1298 microversion: 2.1 time: 0.158655 Aug 24 10:18:32.295792 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 744/1612] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:32 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 1298 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:32.313003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-503adebb-fb75-4b9f-9761-dd76f0f4b574 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Getting quotas for project 1c1d41b854f94d67be99f5926a96376c. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:18:32.317311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d70dc75d-5905-42fa-a97c-3ebd9d0ea339 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:32.317957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d70dc75d-5905-42fa-a97c-3ebd9d0ea339 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:32.320621 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-503adebb-fb75-4b9f-9761-dd76f0f4b574 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Getting quotas for user 72cfea45817848c5b0d3e20087d60d4b and project 1c1d41b854f94d67be99f5926a96376c. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:18:32.325318 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d70dc75d-5905-42fa-a97c-3ebd9d0ea339 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:32.325866 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d70dc75d-5905-42fa-a97c-3ebd9d0ea339 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:32.326589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d70dc75d-5905-42fa-a97c-3ebd9d0ea339 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:32.327669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d70dc75d-5905-42fa-a97c-3ebd9d0ea339 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:32.328144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d70dc75d-5905-42fa-a97c-3ebd9d0ea339 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:32.328568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d70dc75d-5905-42fa-a97c-3ebd9d0ea339 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:32.341197 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-503adebb-fb75-4b9f-9761-dd76f0f4b574 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:18:32.344286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-503adebb-fb75-4b9f-9761-dd76f0f4b574 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] [instance: 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:18:32.433370 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-503adebb-fb75-4b9f-9761-dd76f0f4b574 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.070278 Aug 24 10:18:32.439822 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 869/1613] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:18:31 2022] POST /compute/v2.1/servers => generated 407 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:18:32.441988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ed1e0fd-3af9-438c-b2d0-1dddcab1db8b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:32.443314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8ed1e0fd-3af9-438c-b2d0-1dddcab1db8b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:32.452389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ed1e0fd-3af9-438c-b2d0-1dddcab1db8b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:32.452897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ed1e0fd-3af9-438c-b2d0-1dddcab1db8b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:32.453623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ed1e0fd-3af9-438c-b2d0-1dddcab1db8b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:32.454353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ed1e0fd-3af9-438c-b2d0-1dddcab1db8b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:32.454937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ed1e0fd-3af9-438c-b2d0-1dddcab1db8b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:32.455383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ed1e0fd-3af9-438c-b2d0-1dddcab1db8b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:32.559213 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d70dc75d-5905-42fa-a97c-3ebd9d0ea339 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:32.568855 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d70dc75d-5905-42fa-a97c-3ebd9d0ea339 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 200 len: 1523 microversion: 2.1 time: 0.257090 Aug 24 10:18:32.571536 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 745/1614] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:32 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 1523 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:32.604289 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8a4eca02-d0ae-4cfb-8829-a178bdb78548 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:32.605235 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8a4eca02-d0ae-4cfb-8829-a178bdb78548 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:32.620112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a4eca02-d0ae-4cfb-8829-a178bdb78548 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:32.620669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a4eca02-d0ae-4cfb-8829-a178bdb78548 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:32.621107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a4eca02-d0ae-4cfb-8829-a178bdb78548 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:32.621843 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a4eca02-d0ae-4cfb-8829-a178bdb78548 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:32.622294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a4eca02-d0ae-4cfb-8829-a178bdb78548 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:32.622717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a4eca02-d0ae-4cfb-8829-a178bdb78548 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:32.795281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8ed1e0fd-3af9-438c-b2d0-1dddcab1db8b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:32.810658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8ed1e0fd-3af9-438c-b2d0-1dddcab1db8b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:32.813153 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8ed1e0fd-3af9-438c-b2d0-1dddcab1db8b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:32.818879 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8ed1e0fd-3af9-438c-b2d0-1dddcab1db8b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1487 microversion: 2.25 time: 0.380636 Aug 24 10:18:32.820896 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 870/1615] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:32 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1487 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:32.830052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eed1e354-8f2a-42f5-851b-7271694e0e35 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:32.830681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-eed1e354-8f2a-42f5-851b-7271694e0e35 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 29550762-7055-4641-9d00-46151f4a510f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:32.857069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eed1e354-8f2a-42f5-851b-7271694e0e35 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:32.857846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eed1e354-8f2a-42f5-851b-7271694e0e35 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:32.858498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eed1e354-8f2a-42f5-851b-7271694e0e35 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:32.859267 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eed1e354-8f2a-42f5-851b-7271694e0e35 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:32.859863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eed1e354-8f2a-42f5-851b-7271694e0e35 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:32.860277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eed1e354-8f2a-42f5-851b-7271694e0e35 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:33.019065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8a4eca02-d0ae-4cfb-8829-a178bdb78548 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:33.033565 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8a4eca02-d0ae-4cfb-8829-a178bdb78548 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1471 microversion: 2.1 time: 0.438926 Aug 24 10:18:33.034286 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 746/1616] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:32 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1471 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:33.039526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1c883eae-dbd3-4ba3-9133-52318faa6256 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:33.040596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1c883eae-dbd3-4ba3-9133-52318faa6256 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] [instance: 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:33.134844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1c883eae-dbd3-4ba3-9133-52318faa6256 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cfea45817848c5b0d3e20087d60d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1d41b854f94d67be99f5926a96376c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:33.148018 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1c883eae-dbd3-4ba3-9133-52318faa6256 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4" status: 200 len: 1268 microversion: 2.1 time: 0.112351 Aug 24 10:18:33.149994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-eed1e354-8f2a-42f5-851b-7271694e0e35 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:33.164743 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eed1e354-8f2a-42f5-851b-7271694e0e35 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f" status: 200 len: 1504 microversion: 2.1 time: 0.342336 Aug 24 10:18:33.165036 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 871/1617] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:32 2022] GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f => generated 1504 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:33.166831 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 747/1618] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:33 2022] GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 => generated 1268 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:33.175392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b6e38c55-d6e0-4302-ab2e-cd552ee47e20 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:33.176009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b6e38c55-d6e0-4302-ab2e-cd552ee47e20 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:33.177721 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e3105475-d1a1-495b-953e-11196862ed48 req-f66f4e65-e802-4c7a-9dea-5d17694457d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6451db-5c2a-422c-84ff-c13e81621a71", "name": "network-vif-deleted", "tag": "7d183dba-e72f-4aa1-9c43-d620da8dd93b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:33.182951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6e38c55-d6e0-4302-ab2e-cd552ee47e20 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:33.183567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6e38c55-d6e0-4302-ab2e-cd552ee47e20 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:33.184951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6e38c55-d6e0-4302-ab2e-cd552ee47e20 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:33.186442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6e38c55-d6e0-4302-ab2e-cd552ee47e20 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:33.187177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6e38c55-d6e0-4302-ab2e-cd552ee47e20 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:33.187869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6e38c55-d6e0-4302-ab2e-cd552ee47e20 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:33.217885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e3105475-d1a1-495b-953e-11196862ed48 req-f66f4e65-e802-4c7a-9dea-5d17694457d7 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:33.223123 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e3105475-d1a1-495b-953e-11196862ed48 req-f66f4e65-e802-4c7a-9dea-5d17694457d7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:33.223718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e3105475-d1a1-495b-953e-11196862ed48 req-f66f4e65-e802-4c7a-9dea-5d17694457d7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:33.255135 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e3105475-d1a1-495b-953e-11196862ed48 req-f66f4e65-e802-4c7a-9dea-5d17694457d7 service nova] Creating event network-vif-deleted:7d183dba-e72f-4aa1-9c43-d620da8dd93b for instance 1f6451db-5c2a-422c-84ff-c13e81621a71 on n-h1-849328-3 Aug 24 10:18:33.270848 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e3105475-d1a1-495b-953e-11196862ed48 req-f66f4e65-e802-4c7a-9dea-5d17694457d7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102673 Aug 24 10:18:33.271925 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 748/1619] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:33.282672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-22f16305-313c-4cdc-bef6-c50c06518a06 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:33.283489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-22f16305-313c-4cdc-bef6-c50c06518a06 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:33.294598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22f16305-313c-4cdc-bef6-c50c06518a06 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:33.297774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22f16305-313c-4cdc-bef6-c50c06518a06 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:33.300927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22f16305-313c-4cdc-bef6-c50c06518a06 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:33.302067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22f16305-313c-4cdc-bef6-c50c06518a06 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:33.305171 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22f16305-313c-4cdc-bef6-c50c06518a06 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:33.305942 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22f16305-313c-4cdc-bef6-c50c06518a06 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:33.434010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b6e38c55-d6e0-4302-ab2e-cd552ee47e20 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:33.446194 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b6e38c55-d6e0-4302-ab2e-cd552ee47e20 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 200 len: 1523 microversion: 2.1 time: 0.279975 Aug 24 10:18:33.461157 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 872/1620] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:33 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 1523 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:33.461157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1add3e63-08c2-47d0-be20-37f7eda57ffa tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:33.461157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1add3e63-08c2-47d0-be20-37f7eda57ffa tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 1f6451db-5c2a-422c-84ff-c13e81621a71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:33.463323 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1add3e63-08c2-47d0-be20-37f7eda57ffa tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:33.463323 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1add3e63-08c2-47d0-be20-37f7eda57ffa tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:33.463323 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1add3e63-08c2-47d0-be20-37f7eda57ffa tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:33.463866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1add3e63-08c2-47d0-be20-37f7eda57ffa tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:33.464317 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1add3e63-08c2-47d0-be20-37f7eda57ffa tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:33.464774 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1add3e63-08c2-47d0-be20-37f7eda57ffa tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:33.484708 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-1add3e63-08c2-47d0-be20-37f7eda57ffa tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] HTTP exception thrown: Instance 1f6451db-5c2a-422c-84ff-c13e81621a71 could not be found. Aug 24 10:18:33.486574 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1add3e63-08c2-47d0-be20-37f7eda57ffa tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Request method failure captured: Aug 24 10:18:33.486574 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 HTTP/1.1 Aug 24 10:18:33.486574 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:18:33.486574 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:18:33.486574 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:18:33.486574 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:18:33.486574 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:18:33.486574 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:18:33.486574 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:18:33.486574 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:18:33.486574 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfluf5WMhltPE0D2xS8_BGCoOmTlCH2eBEOMFIUtA9FPZZR9DZIJd_DW99E6ZcQOBcSKD-DIGSH2aRtpk3snGczsSGx7soynXHHf3GrBj4Ucp-YVsvxSTBKIshG-vRfctk2mFYBB3hYwgSuW-uej7q8PvT9aTn6fsAkXfQUykpnq6uY Aug 24 10:18:33.486574 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:18:33.486574 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:18:33.486574 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:18:33.486574 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:18:33.486574 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:18:33.486574 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:18:33.486574 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 7947a063a37946b7870e95dfd7a2e7e6 Aug 24 10:18:33.486574 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-MigrationsAdminTest-2049550965 Aug 24 10:18:33.486574 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:18:33.486574 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:18:33.488383 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/7947a063a37946b7870e95dfd7a2e7e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_7947a063a37946b7870e95dfd7a2e7e6", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/7947a063a37946b7870e95dfd7a2e7e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/7947a063a37946b7870e95dfd7a2e7e6"}]}] Aug 24 10:18:33.488383 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-MigrationsAdminTest-2049550965 Aug 24 10:18:33.488383 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 7947a063a37946b7870e95dfd7a2e7e6 Aug 24 10:18:33.488383 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-MigrationsAdminTest-2049550965 Aug 24 10:18:33.488383 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-MigrationsAdminTest-2049550965-project Aug 24 10:18:33.488383 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:18:33.488383 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:18:33.488383 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 53af167c0c744cbb910ff5860767cb95 Aug 24 10:18:33.488383 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-MigrationsAdminTest-2049550965-project Aug 24 10:18:33.488383 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:18:33.488383 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 1f6451db-5c2a-422c-84ff-c13e81621a71 could not be found. Aug 24 10:18:33.488383 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '1f6451db-5c2a-422c-84ff-c13e81621a71'} Aug 24 10:18:33.489464 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:18:33.489464 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:33.489464 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:18:33.489464 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:18:33.489464 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:18:33.489464 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:18:33.489464 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:18:33.489464 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:18:33.489464 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:18:33.489464 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:18:33.489464 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f6451db-5c2a-422c-84ff-c13e81621a71 could not be found. Aug 24 10:18:33.489464 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:33.489464 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:33.489464 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:33.489464 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:33.489464 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:33.489464 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:33.489464 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:18:33.489464 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:18:33.489464 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:18:33.491040 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:18:33.491040 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:18:33.491040 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:18:33.491040 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:18:33.491040 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:18:33.491040 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:18:33.491040 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:18:33.491040 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f6451db-5c2a-422c-84ff-c13e81621a71 could not be found. Aug 24 10:18:33.491040 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:33.491040 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:33.491040 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:33.491040 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:33.491040 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:33.491040 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:33.491040 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:18:33.491040 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:18:33.491040 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f6451db-5c2a-422c-84ff-c13e81621a71 could not be found. Aug 24 10:18:33.491040 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:33.492976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1add3e63-08c2-47d0-be20-37f7eda57ffa tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Returning 404 to user: Instance 1f6451db-5c2a-422c-84ff-c13e81621a71 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:18:33.492976 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1add3e63-08c2-47d0-be20-37f7eda57ffa tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71" status: 404 len: 111 microversion: 2.1 time: 0.038928 Aug 24 10:18:33.492976 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 873/1621] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:33 2022] GET /compute/v2.1/servers/1f6451db-5c2a-422c-84ff-c13e81621a71 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:18:33.500453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-06db2531-c5e4-4e3d-b593-bc1fa9402310 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-432238608"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:33.503675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-06db2531-c5e4-4e3d-b593-bc1fa9402310 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:33.514426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06db2531-c5e4-4e3d-b593-bc1fa9402310 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:33.515890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06db2531-c5e4-4e3d-b593-bc1fa9402310 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:33.516343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06db2531-c5e4-4e3d-b593-bc1fa9402310 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:33.517057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06db2531-c5e4-4e3d-b593-bc1fa9402310 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:33.517593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06db2531-c5e4-4e3d-b593-bc1fa9402310 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:33.518028 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06db2531-c5e4-4e3d-b593-bc1fa9402310 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:33.738219 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-22f16305-313c-4cdc-bef6-c50c06518a06 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:33.749665 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-22f16305-313c-4cdc-bef6-c50c06518a06 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:33.751135 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-22f16305-313c-4cdc-bef6-c50c06518a06 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:33.752545 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-22f16305-313c-4cdc-bef6-c50c06518a06 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1874 microversion: 2.32 time: 0.479473 Aug 24 10:18:33.753622 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 749/1622] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:33 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1874 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:33.758370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0de4afa3-d9fd-4486-804a-e80bfedf82ce tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:33.759072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0de4afa3-d9fd-4486-804a-e80bfedf82ce tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:33.766960 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0de4afa3-d9fd-4486-804a-e80bfedf82ce tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:33.767819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0de4afa3-d9fd-4486-804a-e80bfedf82ce tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:33.768231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0de4afa3-d9fd-4486-804a-e80bfedf82ce tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:33.768980 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0de4afa3-d9fd-4486-804a-e80bfedf82ce tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:33.769618 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0de4afa3-d9fd-4486-804a-e80bfedf82ce tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:33.770376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0de4afa3-d9fd-4486-804a-e80bfedf82ce tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:33.779703 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-06db2531-c5e4-4e3d-b593-bc1fa9402310 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "POST /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3/action" status: 202 len: 0 microversion: 2.1 time: 0.289179 Aug 24 10:18:33.780548 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 874/1623] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:18:33 2022] POST /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 10:18:33.801754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0de4afa3-d9fd-4486-804a-e80bfedf82ce tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:18:33.802697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a4789d9a-e961-48a0-b2ec-670f5f19122f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-664230207"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:33.805484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a4789d9a-e961-48a0-b2ec-670f5f19122f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:33.818406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4789d9a-e961-48a0-b2ec-670f5f19122f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:33.818907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4789d9a-e961-48a0-b2ec-670f5f19122f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:33.821220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4789d9a-e961-48a0-b2ec-670f5f19122f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:33.822256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4789d9a-e961-48a0-b2ec-670f5f19122f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:33.823155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4789d9a-e961-48a0-b2ec-670f5f19122f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:33.823948 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4789d9a-e961-48a0-b2ec-670f5f19122f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:33.870638 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-a4789d9a-e961-48a0-b2ec-670f5f19122f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] HTTP exception thrown: Cannot 'createImage' instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 while it is in task_state image_snapshot_pending Aug 24 10:18:33.872882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a4789d9a-e961-48a0-b2ec-670f5f19122f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Request method failure captured: Aug 24 10:18:33.872882 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3/action HTTP/1.1 Aug 24 10:18:33.872882 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:18:33.872882 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:18:33.872882 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:18:33.872882 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 84 Aug 24 10:18:33.872882 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:18:33.872882 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:18:33.872882 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:18:33.872882 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:18:33.872882 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfrThttCsJVn6ZYJ5IPHV9fokEqNFKnmNalLL8nZmf_ei5N3zrV08QH1KmLggfkmBKerwFjLosb49uBsjyVeSxt3NJxRyvR4_2es1MonVPd0vwRK6vdPZfvD2BRibktcybuLmMjpd59h5dgQc8Mlu-A4JR-WB_EJM5jyYx0kRVbI5dw Aug 24 10:18:33.872882 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:18:33.872882 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:18:33.872882 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:18:33.872882 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:18:33.872882 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:18:33.872882 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:18:33.872882 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 014076c393b148618aa03e8e8a0d5be7 Aug 24 10:18:33.872882 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:18:33.872882 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:18:33.872882 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:18:33.874799 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/014076c393b148618aa03e8e8a0d5be7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_014076c393b148618aa03e8e8a0d5be7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/014076c393b148618aa03e8e8a0d5be7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/014076c393b148618aa03e8e8a0d5be7"}]}] Aug 24 10:18:33.874799 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:18:33.874799 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 014076c393b148618aa03e8e8a0d5be7 Aug 24 10:18:33.874799 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:18:33.874799 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesOneServerNegativeTestJSON-949139278-project Aug 24 10:18:33.874799 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:18:33.874799 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:18:33.874799 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: a9111f8a2bae4e25a353ebb15eca2d5a Aug 24 10:18:33.874799 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-949139278-project Aug 24 10:18:33.874799 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:18:33.874799 n-d-849328-3 devstack@n-api.service[122433]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-664230207"}} Aug 24 10:18:33.874799 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:18:33.875799 n-d-849328-3 devstack@n-api.service[122433]: exception: Cannot 'createImage' instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 while it is in task_state image_snapshot_pending Aug 24 10:18:33.875799 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'd2ed58ac-b16a-4f31-9394-f65217aea1d3', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-664230207'}}} Aug 24 10:18:33.875799 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:18:33.875799 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:33.875799 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 24 10:18:33.875799 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 24 10:18:33.875799 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Aug 24 10:18:33.875799 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 10:18:33.875799 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Aug 24 10:18:33.875799 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:33.875799 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:33.875799 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:33.875799 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:33.875799 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:33.875799 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:33.875799 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:18:33.875799 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:18:33.875799 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:18:33.875799 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:18:33.877553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:18:33.877553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:18:33.877553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:18:33.877553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:18:33.877553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 24 10:18:33.877553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 10:18:33.877553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 10:18:33.877553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 10:18:33.877553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 while it is in task_state image_snapshot_pending Aug 24 10:18:33.877553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:33.877553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:33.877553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:33.877553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:33.877553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:33.877553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:33.877553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:18:33.877553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:18:33.877553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 while it is in task_state image_snapshot_pending Aug 24 10:18:33.877553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:33.880523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a4789d9a-e961-48a0-b2ec-670f5f19122f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Returning 409 to user: Cannot 'createImage' instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 while it is in task_state image_snapshot_pending {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:18:33.882184 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a4789d9a-e961-48a0-b2ec-670f5f19122f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "POST /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3/action" status: 409 len: 167 microversion: 2.1 time: 0.094008 Aug 24 10:18:33.886391 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 875/1624] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:18:33 2022] POST /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3/action => generated 167 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 10:18:33.890623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b4a504d0-1d11-4d42-8866-a2d5244aaaa8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:33.891322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b4a504d0-1d11-4d42-8866-a2d5244aaaa8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:33.911038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4a504d0-1d11-4d42-8866-a2d5244aaaa8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:33.911547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4a504d0-1d11-4d42-8866-a2d5244aaaa8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:33.911975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4a504d0-1d11-4d42-8866-a2d5244aaaa8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:33.912771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4a504d0-1d11-4d42-8866-a2d5244aaaa8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:33.913401 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4a504d0-1d11-4d42-8866-a2d5244aaaa8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:33.913832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4a504d0-1d11-4d42-8866-a2d5244aaaa8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:33.914333 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0de4afa3-d9fd-4486-804a-e80bfedf82ce tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "DELETE /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 204 len: 0 microversion: 2.1 time: 0.159134 Aug 24 10:18:33.916106 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 750/1625] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:18:33 2022] DELETE /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:18:33.935365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b074eb14-3256-4491-a4a5-3a5c4860983f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '.version_select at 0x7f4655054af0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:34.111093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b4a504d0-1d11-4d42-8866-a2d5244aaaa8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:34.119138 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b074eb14-3256-4491-a4a5-3a5c4860983f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "DELETE /compute/v2.1/images/eb6fb396-8864-45e4-a198-73118e4d76e9" status: 204 len: 0 microversion: 2.1 time: 0.201747 Aug 24 10:18:34.121428 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 751/1626] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:33 2022] DELETE /compute/v2.1/images/eb6fb396-8864-45e4-a198-73118e4d76e9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:18:34.121556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b4a504d0-1d11-4d42-8866-a2d5244aaaa8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:34.122340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b4a504d0-1d11-4d42-8866-a2d5244aaaa8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:34.123852 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b4a504d0-1d11-4d42-8866-a2d5244aaaa8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1477 microversion: 2.25 time: 0.237762 Aug 24 10:18:34.124417 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 876/1627] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:33 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1477 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:34.125978 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fd30000c-44b5-4892-8724-4e2e9509bb80 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:34.126939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fd30000c-44b5-4892-8724-4e2e9509bb80 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:34.129422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-91d7447a-a3c9-4b59-82c3-b26676904be7 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:34.129931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-91d7447a-a3c9-4b59-82c3-b26676904be7 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:34.134419 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd30000c-44b5-4892-8724-4e2e9509bb80 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:34.135385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd30000c-44b5-4892-8724-4e2e9509bb80 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:34.135941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd30000c-44b5-4892-8724-4e2e9509bb80 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:34.136818 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd30000c-44b5-4892-8724-4e2e9509bb80 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:34.136939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91d7447a-a3c9-4b59-82c3-b26676904be7 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:34.137370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd30000c-44b5-4892-8724-4e2e9509bb80 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:34.137489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91d7447a-a3c9-4b59-82c3-b26676904be7 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:34.137800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91d7447a-a3c9-4b59-82c3-b26676904be7 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:34.137923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd30000c-44b5-4892-8724-4e2e9509bb80 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:34.138509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91d7447a-a3c9-4b59-82c3-b26676904be7 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:34.139036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91d7447a-a3c9-4b59-82c3-b26676904be7 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:34.139464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91d7447a-a3c9-4b59-82c3-b26676904be7 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:34.296608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fd30000c-44b5-4892-8724-4e2e9509bb80 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:34.304908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-91d7447a-a3c9-4b59-82c3-b26676904be7 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:34.311604 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fd30000c-44b5-4892-8724-4e2e9509bb80 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1534 microversion: 2.1 time: 0.190329 Aug 24 10:18:34.312231 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 752/1628] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:34 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1534 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:34.314399 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-91d7447a-a3c9-4b59-82c3-b26676904be7 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1471 microversion: 2.1 time: 0.188907 Aug 24 10:18:34.315216 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 877/1629] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:34 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1471 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:34.319964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7041bc59-9a53-4a7f-bc74-57cebb986d7d tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Calling method '.version_select at 0x7f465528ad30>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:34.323160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cda2759c-cd84-46bc-8204-d4675ef377f3 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:34.323853 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cda2759c-cd84-46bc-8204-d4675ef377f3 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:34.326403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7041bc59-9a53-4a7f-bc74-57cebb986d7d tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:34.326963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7041bc59-9a53-4a7f-bc74-57cebb986d7d tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:34.327403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7041bc59-9a53-4a7f-bc74-57cebb986d7d tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:34.334728 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cda2759c-cd84-46bc-8204-d4675ef377f3 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:34.335566 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cda2759c-cd84-46bc-8204-d4675ef377f3 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:34.336112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cda2759c-cd84-46bc-8204-d4675ef377f3 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:34.337231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cda2759c-cd84-46bc-8204-d4675ef377f3 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:34.337953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cda2759c-cd84-46bc-8204-d4675ef377f3 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:34.338603 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cda2759c-cd84-46bc-8204-d4675ef377f3 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:34.345059 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7041bc59-9a53-4a7f-bc74-57cebb986d7d tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] 10.222.0.85 "GET /compute/v2.1/os-migrations" status: 200 len: 4048 microversion: 2.25 time: 0.028665 Aug 24 10:18:34.346548 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 878/1630] 10.222.0.85 () {60 vars in 1184 bytes} [Wed Aug 24 10:18:34 2022] GET /compute/v2.1/os-migrations => generated 4048 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:34.352782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c5edff52-b015-4d0f-a7fa-3f57ace9ec12 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:34.353802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c5edff52-b015-4d0f-a7fa-3f57ace9ec12 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] [instance: 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:34.361743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5edff52-b015-4d0f-a7fa-3f57ace9ec12 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:34.362641 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5edff52-b015-4d0f-a7fa-3f57ace9ec12 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:34.363274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5edff52-b015-4d0f-a7fa-3f57ace9ec12 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:34.364250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5edff52-b015-4d0f-a7fa-3f57ace9ec12 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:34.364976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5edff52-b015-4d0f-a7fa-3f57ace9ec12 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:34.365601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5edff52-b015-4d0f-a7fa-3f57ace9ec12 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:34.443961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c5edff52-b015-4d0f-a7fa-3f57ace9ec12 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cfea45817848c5b0d3e20087d60d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1d41b854f94d67be99f5926a96376c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:34.452797 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c5edff52-b015-4d0f-a7fa-3f57ace9ec12 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4" status: 200 len: 1328 microversion: 2.1 time: 0.104963 Aug 24 10:18:34.453514 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 879/1631] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:34 2022] GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 => generated 1328 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:34.465563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-22e3bb09-f955-468b-8911-bdf7dd7d8c74 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:34.465563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-22e3bb09-f955-468b-8911-bdf7dd7d8c74 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 29550762-7055-4641-9d00-46151f4a510f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:34.470753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22e3bb09-f955-468b-8911-bdf7dd7d8c74 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:34.471378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22e3bb09-f955-468b-8911-bdf7dd7d8c74 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:34.471887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22e3bb09-f955-468b-8911-bdf7dd7d8c74 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:34.472678 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22e3bb09-f955-468b-8911-bdf7dd7d8c74 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:34.473234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22e3bb09-f955-468b-8911-bdf7dd7d8c74 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:34.474190 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22e3bb09-f955-468b-8911-bdf7dd7d8c74 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:34.602424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cda2759c-cd84-46bc-8204-d4675ef377f3 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:34.611292 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cda2759c-cd84-46bc-8204-d4675ef377f3 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 200 len: 1535 microversion: 2.1 time: 0.292928 Aug 24 10:18:34.612004 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 753/1632] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:34 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 1535 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:34.616470 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2ffc7464-e7df-4f45-9bc2-6669321a77c7 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:34.617502 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2ffc7464-e7df-4f45-9bc2-6669321a77c7 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:34.624071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ffc7464-e7df-4f45-9bc2-6669321a77c7 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:34.624738 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ffc7464-e7df-4f45-9bc2-6669321a77c7 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:34.625349 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ffc7464-e7df-4f45-9bc2-6669321a77c7 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:34.626158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ffc7464-e7df-4f45-9bc2-6669321a77c7 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:34.626677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ffc7464-e7df-4f45-9bc2-6669321a77c7 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:34.627176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ffc7464-e7df-4f45-9bc2-6669321a77c7 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:34.643028 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-22e3bb09-f955-468b-8911-bdf7dd7d8c74 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:34.645448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:34.653751 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-22e3bb09-f955-468b-8911-bdf7dd7d8c74 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f" status: 200 len: 1486 microversion: 2.1 time: 0.199111 Aug 24 10:18:34.654383 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 880/1633] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:34 2022] GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f => generated 1486 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:34.676313 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-671b5e83-ac90-408a-b02e-a8acf1ed1146 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:34.676916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-671b5e83-ac90-408a-b02e-a8acf1ed1146 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 29550762-7055-4641-9d00-46151f4a510f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:34.686194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-671b5e83-ac90-408a-b02e-a8acf1ed1146 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:34.686783 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-671b5e83-ac90-408a-b02e-a8acf1ed1146 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:34.687296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-671b5e83-ac90-408a-b02e-a8acf1ed1146 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:34.687957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-671b5e83-ac90-408a-b02e-a8acf1ed1146 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:34.688413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-671b5e83-ac90-408a-b02e-a8acf1ed1146 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:34.688835 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-671b5e83-ac90-408a-b02e-a8acf1ed1146 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:34.716881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-671b5e83-ac90-408a-b02e-a8acf1ed1146 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 29550762-7055-4641-9d00-46151f4a510f] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:18:34.809482 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-671b5e83-ac90-408a-b02e-a8acf1ed1146 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "DELETE /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f" status: 204 len: 0 microversion: 2.1 time: 0.138041 Aug 24 10:18:34.817323 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 881/1634] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:18:34 2022] DELETE /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:18:34.817323 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-89fb1041-0336-4f90-b34a-70cb321f1839 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:34.817926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-89fb1041-0336-4f90-b34a-70cb321f1839 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:34.820663 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-2ffc7464-e7df-4f45-9bc2-6669321a77c7 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] Lazy-loading 'services' on Instance uuid 0e607951-c58f-41ce-bb92-a9399d534b2b {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:18:34.824690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89fb1041-0336-4f90-b34a-70cb321f1839 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:34.825415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89fb1041-0336-4f90-b34a-70cb321f1839 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:34.825850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89fb1041-0336-4f90-b34a-70cb321f1839 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:34.826647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89fb1041-0336-4f90-b34a-70cb321f1839 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:34.827138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89fb1041-0336-4f90-b34a-70cb321f1839 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:34.827564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89fb1041-0336-4f90-b34a-70cb321f1839 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:34.836660 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2ffc7464-e7df-4f45-9bc2-6669321a77c7 tempest-LiveAutoBlockMigrationV225Test-1874297802 tempest-LiveAutoBlockMigrationV225Test-1874297802-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1970 microversion: 2.25 time: 0.222962 Aug 24 10:18:34.846962 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 754/1635] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:34 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1970 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:34.859362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e97f039c-40a2-49fa-94df-ec969a1456e6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f465545b820>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:34.918841 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-e97f039c-40a2-49fa-94df-ec969a1456e6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] HTTP exception thrown: Image not found. Aug 24 10:18:34.921922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e97f039c-40a2-49fa-94df-ec969a1456e6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Request method failure captured: Aug 24 10:18:34.921922 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/images/58e9b0af-a4cd-43e6-9602-ceea13a414b0 HTTP/1.1 Aug 24 10:18:34.921922 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:18:34.921922 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:18:34.921922 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:18:34.921922 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:18:34.921922 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:18:34.921922 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:18:34.921922 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:18:34.921922 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:18:34.921922 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfnS1_tZbOMQjvYaau3fpxFbXnEM4RBrIfdbp3hX2eYjW1M0H2Qlq9p5wGGFYLUMm7XU2K341XMWnPZ568_ln9w-gSvZOZHHS9kU-GcaywNCBoZIK1eQ7RV12BNbej14sdWRNBqZB1kTp9pOmHHHvshAoEZcBClQ9VYEIBYwPoRiFB4 Aug 24 10:18:34.921922 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:18:34.921922 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:18:34.921922 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:18:34.921922 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:18:34.921922 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:18:34.921922 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:18:34.921922 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: d30703728b2a4a569b6dd1608d8956b8 Aug 24 10:18:34.921922 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:34.921922 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:18:34.921922 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:18:34.924504 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d30703728b2a4a569b6dd1608d8956b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d30703728b2a4a569b6dd1608d8956b8", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d30703728b2a4a569b6dd1608d8956b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d30703728b2a4a569b6dd1608d8956b8"}]}] Aug 24 10:18:34.924504 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:34.924504 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: d30703728b2a4a569b6dd1608d8956b8 Aug 24 10:18:34.924504 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:34.924504 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ImagesTestJSON-1542816385-project Aug 24 10:18:34.924504 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:18:34.924504 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:18:34.924504 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 85db443623964ed381b2a4cfc7310202 Aug 24 10:18:34.924504 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesTestJSON-1542816385-project Aug 24 10:18:34.924504 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:18:34.924504 n-d-849328-3 devstack@n-api.service[122432]: exception: Image not found. Aug 24 10:18:34.924504 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '58e9b0af-a4cd-43e6-9602-ceea13a414b0'} Aug 24 10:18:34.924504 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:18:34.924504 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:34.927147 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 10:18:34.927147 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 10:18:34.927147 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:18:34.927147 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:18:34.927147 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:18:34.927147 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:18:34.927147 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 10:18:34.927147 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 10:18:34.927147 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 10:18:34.927147 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 10:18:34.927147 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:18:34.927147 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:18:34.927147 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:18:34.927147 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:18:34.927147 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 58e9b0af-a4cd-43e6-9602-ceea13a414b0 to delete Aug 24 10:18:34.927147 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:34.927147 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:34.927147 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:34.927147 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:34.930732 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 10:18:34.930732 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 10:18:34.930732 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 10:18:34.930732 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 10:18:34.930732 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 10:18:34.930732 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 10:18:34.930732 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 58e9b0af-a4cd-43e6-9602-ceea13a414b0 could not be found. Aug 24 10:18:34.930732 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:34.930732 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:34.930732 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:34.930732 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:34.930732 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:34.930732 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:34.930732 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:18:34.930732 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:18:34.930732 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:18:34.930732 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:18:34.930732 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:18:34.930732 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:18:34.930732 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 10:18:34.933759 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 10:18:34.933759 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 10:18:34.933759 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:34.933759 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:34.933759 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:34.933759 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:34.933759 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:34.933759 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:34.933759 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:18:34.933759 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:18:34.933759 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 10:18:34.933759 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:34.933759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e97f039c-40a2-49fa-94df-ec969a1456e6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Returning 404 to user: Image not found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:18:34.933759 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e97f039c-40a2-49fa-94df-ec969a1456e6 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "DELETE /compute/v2.1/images/58e9b0af-a4cd-43e6-9602-ceea13a414b0" status: 404 len: 62 microversion: 2.1 time: 0.075353 Aug 24 10:18:34.933759 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 755/1636] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:34 2022] DELETE /compute/v2.1/images/58e9b0af-a4cd-43e6-9602-ceea13a414b0 => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:18:34.935705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e9141b7f-caf0-4fb5-87cf-c5479c6aa05b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:34.935705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e9141b7f-caf0-4fb5-87cf-c5479c6aa05b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:34.941506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9141b7f-caf0-4fb5-87cf-c5479c6aa05b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:34.942082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9141b7f-caf0-4fb5-87cf-c5479c6aa05b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:34.942592 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9141b7f-caf0-4fb5-87cf-c5479c6aa05b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:34.943414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9141b7f-caf0-4fb5-87cf-c5479c6aa05b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:34.943935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9141b7f-caf0-4fb5-87cf-c5479c6aa05b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:34.944424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9141b7f-caf0-4fb5-87cf-c5479c6aa05b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:34.971783 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e9141b7f-caf0-4fb5-87cf-c5479c6aa05b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:18:35.043498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-89fb1041-0336-4f90-b34a-70cb321f1839 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:35.054651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-89fb1041-0336-4f90-b34a-70cb321f1839 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:35.055777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-89fb1041-0336-4f90-b34a-70cb321f1839 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:35.056703 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-89fb1041-0336-4f90-b34a-70cb321f1839 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1874 microversion: 2.32 time: 0.245012 Aug 24 10:18:35.057666 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 882/1637] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:34 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1874 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:35.063863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a6dd0dd0-d200-41d5-a411-3b1b1f79ac66 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:35.064358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a6dd0dd0-d200-41d5-a411-3b1b1f79ac66 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 29550762-7055-4641-9d00-46151f4a510f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:35.068534 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e9141b7f-caf0-4fb5-87cf-c5479c6aa05b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "DELETE /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 204 len: 0 microversion: 2.25 time: 0.142498 Aug 24 10:18:35.073359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6dd0dd0-d200-41d5-a411-3b1b1f79ac66 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:35.073359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6dd0dd0-d200-41d5-a411-3b1b1f79ac66 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:35.073359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6dd0dd0-d200-41d5-a411-3b1b1f79ac66 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:35.073359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6dd0dd0-d200-41d5-a411-3b1b1f79ac66 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:35.073977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6dd0dd0-d200-41d5-a411-3b1b1f79ac66 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:35.073977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6dd0dd0-d200-41d5-a411-3b1b1f79ac66 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:35.074723 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 756/1638] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:18:34 2022] DELETE /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:18:35.081922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4f51b013-fc86-4c1d-8f1e-b1d4b7fe1724 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:35.082765 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4f51b013-fc86-4c1d-8f1e-b1d4b7fe1724 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:35.089086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f51b013-fc86-4c1d-8f1e-b1d4b7fe1724 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:35.089600 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f51b013-fc86-4c1d-8f1e-b1d4b7fe1724 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:35.090028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f51b013-fc86-4c1d-8f1e-b1d4b7fe1724 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:35.090723 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f51b013-fc86-4c1d-8f1e-b1d4b7fe1724 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:35.091178 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f51b013-fc86-4c1d-8f1e-b1d4b7fe1724 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:35.091591 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f51b013-fc86-4c1d-8f1e-b1d4b7fe1724 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:35.099871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a6dd0dd0-d200-41d5-a411-3b1b1f79ac66 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 29550762-7055-4641-9d00-46151f4a510f] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:18:35.108121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:35.170926 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.compute.api [None req-a6dd0dd0-d200-41d5-a411-3b1b1f79ac66 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 29550762-7055-4641-9d00-46151f4a510f] Instance is already in deleting state, ignoring this request Aug 24 10:18:35.172698 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a6dd0dd0-d200-41d5-a411-3b1b1f79ac66 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "DELETE /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f" status: 204 len: 0 microversion: 2.1 time: 0.113098 Aug 24 10:18:35.172860 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 883/1639] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:18:35 2022] DELETE /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:18:35.184157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f64d4fd8-5bfa-4849-9df1-c0799286e868 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:35.184879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f64d4fd8-5bfa-4849-9df1-c0799286e868 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 29550762-7055-4641-9d00-46151f4a510f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:35.192905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f64d4fd8-5bfa-4849-9df1-c0799286e868 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:35.193452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f64d4fd8-5bfa-4849-9df1-c0799286e868 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:35.194421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f64d4fd8-5bfa-4849-9df1-c0799286e868 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:35.195423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f64d4fd8-5bfa-4849-9df1-c0799286e868 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:35.195890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f64d4fd8-5bfa-4849-9df1-c0799286e868 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:35.196317 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f64d4fd8-5bfa-4849-9df1-c0799286e868 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:35.251299 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4f51b013-fc86-4c1d-8f1e-b1d4b7fe1724 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:35.264501 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4f51b013-fc86-4c1d-8f1e-b1d4b7fe1724 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:35.265474 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4f51b013-fc86-4c1d-8f1e-b1d4b7fe1724 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:35.267101 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4f51b013-fc86-4c1d-8f1e-b1d4b7fe1724 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1483 microversion: 2.25 time: 0.190884 Aug 24 10:18:35.268149 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 757/1640] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:35 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1483 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:35.337723 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d9048692-d871-421f-b749-d6dcd6eedc15 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:35.338357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d9048692-d871-421f-b749-d6dcd6eedc15 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:35.346483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9048692-d871-421f-b749-d6dcd6eedc15 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:35.347193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9048692-d871-421f-b749-d6dcd6eedc15 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:35.347942 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9048692-d871-421f-b749-d6dcd6eedc15 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:35.352448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f64d4fd8-5bfa-4849-9df1-c0799286e868 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:35.356851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9048692-d871-421f-b749-d6dcd6eedc15 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:35.357485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9048692-d871-421f-b749-d6dcd6eedc15 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:35.358255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9048692-d871-421f-b749-d6dcd6eedc15 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:35.364312 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f64d4fd8-5bfa-4849-9df1-c0799286e868 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f" status: 200 len: 1492 microversion: 2.1 time: 0.185615 Aug 24 10:18:35.365430 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 884/1641] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:35 2022] GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f => generated 1492 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:35.371733 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1a0c4cba-0f38-449b-8b3d-210394a2d3ff tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:35.373970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1a0c4cba-0f38-449b-8b3d-210394a2d3ff tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:35.384409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a0c4cba-0f38-449b-8b3d-210394a2d3ff tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:35.384971 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a0c4cba-0f38-449b-8b3d-210394a2d3ff tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:35.385443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a0c4cba-0f38-449b-8b3d-210394a2d3ff tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:35.386187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a0c4cba-0f38-449b-8b3d-210394a2d3ff tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:35.386802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a0c4cba-0f38-449b-8b3d-210394a2d3ff tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:35.387280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a0c4cba-0f38-449b-8b3d-210394a2d3ff tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:35.567727 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1a0c4cba-0f38-449b-8b3d-210394a2d3ff tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:35.577748 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1a0c4cba-0f38-449b-8b3d-210394a2d3ff tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1471 microversion: 2.1 time: 0.210485 Aug 24 10:18:35.578373 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 885/1642] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:35 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1471 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:35.578876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d9048692-d871-421f-b749-d6dcd6eedc15 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:35.585678 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-4b242886-ecc7-4fb2-826e-0e0f8d288fbe req-4e838b32-6b4d-42a5-8b88-f52514a9a5eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29550762-7055-4641-9d00-46151f4a510f", "name": "network-vif-plugged", "status": "completed", "tag": "a2984dcb-2faa-47d0-bc19-8651905514d6"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:35.588223 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d9048692-d871-421f-b749-d6dcd6eedc15 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1534 microversion: 2.1 time: 0.257814 Aug 24 10:18:35.588811 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 758/1643] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:35 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1534 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:18:35.594971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c7af45f2-beb9-4a8c-bb34-73d828360c51 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:35.595967 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c7af45f2-beb9-4a8c-bb34-73d828360c51 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] [instance: 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:35.609953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7af45f2-beb9-4a8c-bb34-73d828360c51 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:35.611110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7af45f2-beb9-4a8c-bb34-73d828360c51 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:35.611929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7af45f2-beb9-4a8c-bb34-73d828360c51 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:35.612724 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7af45f2-beb9-4a8c-bb34-73d828360c51 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:35.613301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7af45f2-beb9-4a8c-bb34-73d828360c51 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:35.613773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4b242886-ecc7-4fb2-826e-0e0f8d288fbe req-4e838b32-6b4d-42a5-8b88-f52514a9a5eb service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:35.613886 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7af45f2-beb9-4a8c-bb34-73d828360c51 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:35.614264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4b242886-ecc7-4fb2-826e-0e0f8d288fbe req-4e838b32-6b4d-42a5-8b88-f52514a9a5eb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:35.614798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4b242886-ecc7-4fb2-826e-0e0f8d288fbe req-4e838b32-6b4d-42a5-8b88-f52514a9a5eb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:35.626947 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-4b242886-ecc7-4fb2-826e-0e0f8d288fbe req-4e838b32-6b4d-42a5-8b88-f52514a9a5eb service nova] Creating event network-vif-plugged:a2984dcb-2faa-47d0-bc19-8651905514d6 for instance 29550762-7055-4641-9d00-46151f4a510f on n-h1-849328-3 Aug 24 10:18:35.632117 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-4b242886-ecc7-4fb2-826e-0e0f8d288fbe req-4e838b32-6b4d-42a5-8b88-f52514a9a5eb service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052246 Aug 24 10:18:35.633051 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 886/1644] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:35.638424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b8c682e9-0d85-4402-a97d-2f3c1a20daa2 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:35.639204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b8c682e9-0d85-4402-a97d-2f3c1a20daa2 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:35.645674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8c682e9-0d85-4402-a97d-2f3c1a20daa2 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:35.646169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8c682e9-0d85-4402-a97d-2f3c1a20daa2 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:35.646654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8c682e9-0d85-4402-a97d-2f3c1a20daa2 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:35.647393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8c682e9-0d85-4402-a97d-2f3c1a20daa2 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:35.647827 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8c682e9-0d85-4402-a97d-2f3c1a20daa2 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:35.648251 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8c682e9-0d85-4402-a97d-2f3c1a20daa2 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:35.682187 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c7af45f2-beb9-4a8c-bb34-73d828360c51 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cfea45817848c5b0d3e20087d60d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1d41b854f94d67be99f5926a96376c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:35.690717 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c7af45f2-beb9-4a8c-bb34-73d828360c51 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4" status: 200 len: 1326 microversion: 2.1 time: 0.099602 Aug 24 10:18:35.691322 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 759/1645] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:35 2022] GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 => generated 1326 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:35.783998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b8c682e9-0d85-4402-a97d-2f3c1a20daa2 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:35.802051 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b8c682e9-0d85-4402-a97d-2f3c1a20daa2 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 200 len: 1535 microversion: 2.1 time: 0.167745 Aug 24 10:18:35.802655 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 887/1646] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:35 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 1535 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:36.084660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-916c1b8b-a7d8-4e0a-b6b8-92c3d549e69f tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:36.085710 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-916c1b8b-a7d8-4e0a-b6b8-92c3d549e69f tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:36.097547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-916c1b8b-a7d8-4e0a-b6b8-92c3d549e69f tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:36.098271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-916c1b8b-a7d8-4e0a-b6b8-92c3d549e69f tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:36.099007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-916c1b8b-a7d8-4e0a-b6b8-92c3d549e69f tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:36.100174 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-916c1b8b-a7d8-4e0a-b6b8-92c3d549e69f tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:36.100976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-916c1b8b-a7d8-4e0a-b6b8-92c3d549e69f tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:36.101750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-916c1b8b-a7d8-4e0a-b6b8-92c3d549e69f tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:36.293104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-916c1b8b-a7d8-4e0a-b6b8-92c3d549e69f tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:36.296046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-778337fa-4a36-4eb8-abc8-510668d99272 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:36.296654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-778337fa-4a36-4eb8-abc8-510668d99272 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:36.302161 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-916c1b8b-a7d8-4e0a-b6b8-92c3d549e69f tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:36.302790 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-778337fa-4a36-4eb8-abc8-510668d99272 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:36.303267 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-778337fa-4a36-4eb8-abc8-510668d99272 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:36.303671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-916c1b8b-a7d8-4e0a-b6b8-92c3d549e69f tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:36.303806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-778337fa-4a36-4eb8-abc8-510668d99272 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:36.304364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-778337fa-4a36-4eb8-abc8-510668d99272 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:36.304827 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-778337fa-4a36-4eb8-abc8-510668d99272 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:36.304978 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-916c1b8b-a7d8-4e0a-b6b8-92c3d549e69f tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1874 microversion: 2.32 time: 0.226487 Aug 24 10:18:36.305291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-778337fa-4a36-4eb8-abc8-510668d99272 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:36.305414 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 760/1647] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:36 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1874 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:36.386641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-84d655a1-49d9-47bc-87ae-acc15e78dcb7 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:36.387251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-84d655a1-49d9-47bc-87ae-acc15e78dcb7 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 29550762-7055-4641-9d00-46151f4a510f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:36.394466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84d655a1-49d9-47bc-87ae-acc15e78dcb7 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:36.394953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84d655a1-49d9-47bc-87ae-acc15e78dcb7 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:36.395383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84d655a1-49d9-47bc-87ae-acc15e78dcb7 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:36.396133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84d655a1-49d9-47bc-87ae-acc15e78dcb7 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:36.396524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84d655a1-49d9-47bc-87ae-acc15e78dcb7 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:36.396930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84d655a1-49d9-47bc-87ae-acc15e78dcb7 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:36.450130 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-778337fa-4a36-4eb8-abc8-510668d99272 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:36.459541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-778337fa-4a36-4eb8-abc8-510668d99272 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:36.461041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-778337fa-4a36-4eb8-abc8-510668d99272 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:36.462261 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-778337fa-4a36-4eb8-abc8-510668d99272 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1483 microversion: 2.25 time: 0.170203 Aug 24 10:18:36.463100 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 888/1648] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:36 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1483 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:18:36.534476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-84d655a1-49d9-47bc-87ae-acc15e78dcb7 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:36.543577 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-84d655a1-49d9-47bc-87ae-acc15e78dcb7 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f" status: 200 len: 1492 microversion: 2.1 time: 0.160799 Aug 24 10:18:36.544191 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 761/1649] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:36 2022] GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f => generated 1492 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:36.611402 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-abffc3f6-c0a6-4d73-8217-87f5510daaa1 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:36.612011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-abffc3f6-c0a6-4d73-8217-87f5510daaa1 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:36.617306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-358a2082-a1e5-4ca5-93e6-30d1652a09c6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:36.617921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-358a2082-a1e5-4ca5-93e6-30d1652a09c6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:36.618771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abffc3f6-c0a6-4d73-8217-87f5510daaa1 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:36.619295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abffc3f6-c0a6-4d73-8217-87f5510daaa1 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:36.620124 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abffc3f6-c0a6-4d73-8217-87f5510daaa1 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:36.621380 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abffc3f6-c0a6-4d73-8217-87f5510daaa1 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:36.621927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abffc3f6-c0a6-4d73-8217-87f5510daaa1 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:36.622425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abffc3f6-c0a6-4d73-8217-87f5510daaa1 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:36.624714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-358a2082-a1e5-4ca5-93e6-30d1652a09c6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:36.625253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-358a2082-a1e5-4ca5-93e6-30d1652a09c6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:36.625690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-358a2082-a1e5-4ca5-93e6-30d1652a09c6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:36.626628 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-358a2082-a1e5-4ca5-93e6-30d1652a09c6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:36.627094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-358a2082-a1e5-4ca5-93e6-30d1652a09c6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:36.627523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-358a2082-a1e5-4ca5-93e6-30d1652a09c6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:36.786204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-abffc3f6-c0a6-4d73-8217-87f5510daaa1 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:36.794244 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-abffc3f6-c0a6-4d73-8217-87f5510daaa1 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1471 microversion: 2.1 time: 0.187176 Aug 24 10:18:36.794841 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 889/1650] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:36 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1471 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:36.800552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2b6af339-e908-48ad-b028-d3bdb2128656 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:36.801266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2b6af339-e908-48ad-b028-d3bdb2128656 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] [instance: 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:36.811173 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b6af339-e908-48ad-b028-d3bdb2128656 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:36.811779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b6af339-e908-48ad-b028-d3bdb2128656 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:36.812220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b6af339-e908-48ad-b028-d3bdb2128656 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:36.813075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b6af339-e908-48ad-b028-d3bdb2128656 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:36.813557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b6af339-e908-48ad-b028-d3bdb2128656 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:36.813999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b6af339-e908-48ad-b028-d3bdb2128656 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:36.853692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-358a2082-a1e5-4ca5-93e6-30d1652a09c6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:36.868709 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-358a2082-a1e5-4ca5-93e6-30d1652a09c6 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1534 microversion: 2.1 time: 0.254559 Aug 24 10:18:36.883224 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 762/1651] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:36 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1534 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:36.888127 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2b6af339-e908-48ad-b028-d3bdb2128656 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cfea45817848c5b0d3e20087d60d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1d41b854f94d67be99f5926a96376c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:36.896801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fdca0ba7-ad50-4bf2-bf57-65da06bcbe1e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:36.897861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fdca0ba7-ad50-4bf2-bf57-65da06bcbe1e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:36.898135 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2b6af339-e908-48ad-b028-d3bdb2128656 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4" status: 200 len: 1326 microversion: 2.1 time: 0.101794 Aug 24 10:18:36.909180 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 890/1652] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:36 2022] GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 => generated 1326 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:36.916900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdca0ba7-ad50-4bf2-bf57-65da06bcbe1e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:36.917417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdca0ba7-ad50-4bf2-bf57-65da06bcbe1e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:36.917854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdca0ba7-ad50-4bf2-bf57-65da06bcbe1e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:36.918596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdca0ba7-ad50-4bf2-bf57-65da06bcbe1e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:36.919031 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdca0ba7-ad50-4bf2-bf57-65da06bcbe1e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:36.919482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdca0ba7-ad50-4bf2-bf57-65da06bcbe1e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:37.144134 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fdca0ba7-ad50-4bf2-bf57-65da06bcbe1e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:37.152259 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fdca0ba7-ad50-4bf2-bf57-65da06bcbe1e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 200 len: 1541 microversion: 2.1 time: 0.267571 Aug 24 10:18:37.152867 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 763/1653] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:36 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 1541 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:37.329896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5f99bfd1-070d-4d18-a39e-8722563314b5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:37.330670 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5f99bfd1-070d-4d18-a39e-8722563314b5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:37.337999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f99bfd1-070d-4d18-a39e-8722563314b5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:37.338566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f99bfd1-070d-4d18-a39e-8722563314b5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:37.339062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f99bfd1-070d-4d18-a39e-8722563314b5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:37.340017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f99bfd1-070d-4d18-a39e-8722563314b5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:37.340578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f99bfd1-070d-4d18-a39e-8722563314b5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:37.341049 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f99bfd1-070d-4d18-a39e-8722563314b5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:37.490552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0a895307-9b4e-43e1-bdd2-96e61911a2bc tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:37.491321 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0a895307-9b4e-43e1-bdd2-96e61911a2bc tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:37.500199 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a895307-9b4e-43e1-bdd2-96e61911a2bc tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:37.501495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a895307-9b4e-43e1-bdd2-96e61911a2bc tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:37.504143 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a895307-9b4e-43e1-bdd2-96e61911a2bc tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:37.506663 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a895307-9b4e-43e1-bdd2-96e61911a2bc tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:37.507401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a895307-9b4e-43e1-bdd2-96e61911a2bc tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:37.509104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a895307-9b4e-43e1-bdd2-96e61911a2bc tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:37.600314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5f99bfd1-070d-4d18-a39e-8722563314b5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:37.617093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5f99bfd1-070d-4d18-a39e-8722563314b5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:37.619970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5f99bfd1-070d-4d18-a39e-8722563314b5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:37.621502 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5f99bfd1-070d-4d18-a39e-8722563314b5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1874 microversion: 2.32 time: 0.295573 Aug 24 10:18:37.622558 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 891/1654] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:37 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1874 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:37.631094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e6c55cd9-9141-439f-a2a7-46ddcccfb55a tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:37.631934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e6c55cd9-9141-439f-a2a7-46ddcccfb55a tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 29550762-7055-4641-9d00-46151f4a510f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:37.634430 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:37.644971 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6c55cd9-9141-439f-a2a7-46ddcccfb55a tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:37.645867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6c55cd9-9141-439f-a2a7-46ddcccfb55a tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:37.658596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6c55cd9-9141-439f-a2a7-46ddcccfb55a tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:37.661103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6c55cd9-9141-439f-a2a7-46ddcccfb55a tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:37.661792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6c55cd9-9141-439f-a2a7-46ddcccfb55a tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:37.662980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6c55cd9-9141-439f-a2a7-46ddcccfb55a tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:38.087143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e6c55cd9-9141-439f-a2a7-46ddcccfb55a tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:38.108975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0a895307-9b4e-43e1-bdd2-96e61911a2bc tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:38.116445 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e6c55cd9-9141-439f-a2a7-46ddcccfb55a tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f" status: 200 len: 1492 microversion: 2.1 time: 0.492302 Aug 24 10:18:38.124327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0a895307-9b4e-43e1-bdd2-96e61911a2bc tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:38.137946 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 892/1655] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:37 2022] GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f => generated 1492 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:38.147555 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-e7933900-57c9-40f8-9904-1c90d38a9ca1 req-bd118c81-511a-407c-a8bf-135624ff60a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29550762-7055-4641-9d00-46151f4a510f", "name": "network-vif-unplugged", "status": "completed", "tag": "a2984dcb-2faa-47d0-bc19-8651905514d6"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:38.149842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0a895307-9b4e-43e1-bdd2-96e61911a2bc tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:38.158418 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0a895307-9b4e-43e1-bdd2-96e61911a2bc tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1483 microversion: 2.25 time: 0.677166 Aug 24 10:18:38.161437 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 764/1656] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:37 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1483 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:38.167508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-192b47ba-a9e7-4b36-84a0-1395d3d296b9 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:38.168118 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-192b47ba-a9e7-4b36-84a0-1395d3d296b9 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:38.173761 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e7933900-57c9-40f8-9904-1c90d38a9ca1 req-bd118c81-511a-407c-a8bf-135624ff60a3 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:38.174553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e7933900-57c9-40f8-9904-1c90d38a9ca1 req-bd118c81-511a-407c-a8bf-135624ff60a3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:38.177194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e7933900-57c9-40f8-9904-1c90d38a9ca1 req-bd118c81-511a-407c-a8bf-135624ff60a3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:38.186750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-192b47ba-a9e7-4b36-84a0-1395d3d296b9 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:38.188899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-192b47ba-a9e7-4b36-84a0-1395d3d296b9 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:38.197958 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-192b47ba-a9e7-4b36-84a0-1395d3d296b9 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:38.199205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-192b47ba-a9e7-4b36-84a0-1395d3d296b9 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:38.199889 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-192b47ba-a9e7-4b36-84a0-1395d3d296b9 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:38.200670 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-192b47ba-a9e7-4b36-84a0-1395d3d296b9 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:38.211548 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-e7933900-57c9-40f8-9904-1c90d38a9ca1 req-bd118c81-511a-407c-a8bf-135624ff60a3 service nova] Creating event network-vif-unplugged:a2984dcb-2faa-47d0-bc19-8651905514d6 for instance 29550762-7055-4641-9d00-46151f4a510f on n-h1-849328-3 Aug 24 10:18:38.232268 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-e7933900-57c9-40f8-9904-1c90d38a9ca1 req-bd118c81-511a-407c-a8bf-135624ff60a3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092127 Aug 24 10:18:38.233717 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 893/1657] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:38.242407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b4dc98a1-fe2d-44d7-8e14-a23815d779e3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:38.248444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b4dc98a1-fe2d-44d7-8e14-a23815d779e3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:38.259070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4dc98a1-fe2d-44d7-8e14-a23815d779e3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:38.265858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4dc98a1-fe2d-44d7-8e14-a23815d779e3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:38.267005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4dc98a1-fe2d-44d7-8e14-a23815d779e3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:38.270464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4dc98a1-fe2d-44d7-8e14-a23815d779e3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:38.274301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4dc98a1-fe2d-44d7-8e14-a23815d779e3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:38.274764 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4dc98a1-fe2d-44d7-8e14-a23815d779e3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:38.652804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b4dc98a1-fe2d-44d7-8e14-a23815d779e3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:38.679006 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b4dc98a1-fe2d-44d7-8e14-a23815d779e3 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1534 microversion: 2.1 time: 0.443641 Aug 24 10:18:38.697153 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 894/1658] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:38 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1534 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:38.713290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f9c2afad-539b-4e65-b692-56053e3acca8 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:38.714436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f9c2afad-539b-4e65-b692-56053e3acca8 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] [instance: 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:38.752255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9c2afad-539b-4e65-b692-56053e3acca8 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:38.754439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9c2afad-539b-4e65-b692-56053e3acca8 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:38.755477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9c2afad-539b-4e65-b692-56053e3acca8 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:38.756410 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9c2afad-539b-4e65-b692-56053e3acca8 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:38.757432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9c2afad-539b-4e65-b692-56053e3acca8 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:38.758246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9c2afad-539b-4e65-b692-56053e3acca8 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:38.891923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-192b47ba-a9e7-4b36-84a0-1395d3d296b9 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:38.902098 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-192b47ba-a9e7-4b36-84a0-1395d3d296b9 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1477 microversion: 2.1 time: 0.739511 Aug 24 10:18:38.904362 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 765/1659] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:38 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1477 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:38.910638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-03216165-af09-4629-b6bd-9659f2a510eb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:38.911862 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-03216165-af09-4629-b6bd-9659f2a510eb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:38.918866 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03216165-af09-4629-b6bd-9659f2a510eb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:38.919761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03216165-af09-4629-b6bd-9659f2a510eb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:38.920474 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03216165-af09-4629-b6bd-9659f2a510eb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:38.921511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03216165-af09-4629-b6bd-9659f2a510eb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:38.922202 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03216165-af09-4629-b6bd-9659f2a510eb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:38.922885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03216165-af09-4629-b6bd-9659f2a510eb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:39.192089 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-03216165-af09-4629-b6bd-9659f2a510eb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:39.199244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f9c2afad-539b-4e65-b692-56053e3acca8 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cfea45817848c5b0d3e20087d60d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1d41b854f94d67be99f5926a96376c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:39.201734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:39.206425 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-03216165-af09-4629-b6bd-9659f2a510eb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 200 len: 1541 microversion: 2.1 time: 0.299804 Aug 24 10:18:39.222274 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f9c2afad-539b-4e65-b692-56053e3acca8 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4" status: 200 len: 1394 microversion: 2.1 time: 0.524576 Aug 24 10:18:39.224688 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 766/1660] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:38 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 1541 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:39.226809 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 895/1661] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:38 2022] GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 => generated 1394 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:39.231461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-37dae45f-7bd6-42d3-993f-c2b08e969665 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:39.232091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-37dae45f-7bd6-42d3-993f-c2b08e969665 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:39.235082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a32f28b2-f059-4420-b082-bdb9c5d8c837 req-778e5696-a1d0-4394-91dd-059922223bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29550762-7055-4641-9d00-46151f4a510f", "name": "network-vif-deleted", "tag": "a2984dcb-2faa-47d0-bc19-8651905514d6"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:39.238867 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37dae45f-7bd6-42d3-993f-c2b08e969665 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:39.239364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37dae45f-7bd6-42d3-993f-c2b08e969665 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:39.239801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37dae45f-7bd6-42d3-993f-c2b08e969665 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:39.240514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37dae45f-7bd6-42d3-993f-c2b08e969665 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:39.240967 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37dae45f-7bd6-42d3-993f-c2b08e969665 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:39.241418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37dae45f-7bd6-42d3-993f-c2b08e969665 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:39.250079 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a32f28b2-f059-4420-b082-bdb9c5d8c837 req-778e5696-a1d0-4394-91dd-059922223bc9 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:39.251185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a32f28b2-f059-4420-b082-bdb9c5d8c837 req-778e5696-a1d0-4394-91dd-059922223bc9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:39.252007 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a32f28b2-f059-4420-b082-bdb9c5d8c837 req-778e5696-a1d0-4394-91dd-059922223bc9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:39.267715 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a32f28b2-f059-4420-b082-bdb9c5d8c837 req-778e5696-a1d0-4394-91dd-059922223bc9 service nova] Creating event network-vif-deleted:a2984dcb-2faa-47d0-bc19-8651905514d6 for instance 29550762-7055-4641-9d00-46151f4a510f on n-h1-849328-3 Aug 24 10:18:39.273520 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a32f28b2-f059-4420-b082-bdb9c5d8c837 req-778e5696-a1d0-4394-91dd-059922223bc9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043361 Aug 24 10:18:39.274768 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 896/1662] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:39.437504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b06cdf16-49bd-40b2-8f76-ffebbd4ba47a tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:39.438644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b06cdf16-49bd-40b2-8f76-ffebbd4ba47a tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 29550762-7055-4641-9d00-46151f4a510f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:39.464566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b06cdf16-49bd-40b2-8f76-ffebbd4ba47a tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:39.465778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b06cdf16-49bd-40b2-8f76-ffebbd4ba47a tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:39.466408 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b06cdf16-49bd-40b2-8f76-ffebbd4ba47a tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:39.467338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b06cdf16-49bd-40b2-8f76-ffebbd4ba47a tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:39.467952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b06cdf16-49bd-40b2-8f76-ffebbd4ba47a tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:39.468535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b06cdf16-49bd-40b2-8f76-ffebbd4ba47a tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:39.533893 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b06cdf16-49bd-40b2-8f76-ffebbd4ba47a tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:39.534526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b06cdf16-49bd-40b2-8f76-ffebbd4ba47a tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:39.535143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b06cdf16-49bd-40b2-8f76-ffebbd4ba47a tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:39.535820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-b06cdf16-49bd-40b2-8f76-ffebbd4ba47a tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lazy-loading 'fault' on Instance uuid 29550762-7055-4641-9d00-46151f4a510f {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:18:39.619314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b06cdf16-49bd-40b2-8f76-ffebbd4ba47a tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85db443623964ed381b2a4cfc7310202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30703728b2a4a569b6dd1608d8956b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:39.636617 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b06cdf16-49bd-40b2-8f76-ffebbd4ba47a tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f" status: 200 len: 1297 microversion: 2.1 time: 0.360132 Aug 24 10:18:39.649147 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 897/1663] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:39 2022] GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f => generated 1297 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:39.668801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3981ac43-0f79-49d5-a500-d3e67be058c9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:39.672299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3981ac43-0f79-49d5-a500-d3e67be058c9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:39.689378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3981ac43-0f79-49d5-a500-d3e67be058c9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:39.689922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3981ac43-0f79-49d5-a500-d3e67be058c9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:39.690388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3981ac43-0f79-49d5-a500-d3e67be058c9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:39.697047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3981ac43-0f79-49d5-a500-d3e67be058c9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:39.697934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3981ac43-0f79-49d5-a500-d3e67be058c9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:39.698396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3981ac43-0f79-49d5-a500-d3e67be058c9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:39.824949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3981ac43-0f79-49d5-a500-d3e67be058c9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:39.840866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3981ac43-0f79-49d5-a500-d3e67be058c9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:39.845333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3981ac43-0f79-49d5-a500-d3e67be058c9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:39.850151 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3981ac43-0f79-49d5-a500-d3e67be058c9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1266 microversion: 2.25 time: 0.198695 Aug 24 10:18:39.865570 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 898/1664] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:39 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:39.872305 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-73a47537-7aef-4bf8-a384-6925b742cbd0 req-cadb4797-f410-470b-9f56-4d3024c56896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e607951-c58f-41ce-bb92-a9399d534b2b", "name": "network-vif-deleted", "tag": "b61dbdd6-ed0f-44bc-b778-6a3d23999774"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:39.882356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-73a47537-7aef-4bf8-a384-6925b742cbd0 req-cadb4797-f410-470b-9f56-4d3024c56896 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:39.882844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-73a47537-7aef-4bf8-a384-6925b742cbd0 req-cadb4797-f410-470b-9f56-4d3024c56896 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:39.883281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-73a47537-7aef-4bf8-a384-6925b742cbd0 req-cadb4797-f410-470b-9f56-4d3024c56896 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:39.895114 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-73a47537-7aef-4bf8-a384-6925b742cbd0 req-cadb4797-f410-470b-9f56-4d3024c56896 service nova] Creating event network-vif-deleted:b61dbdd6-ed0f-44bc-b778-6a3d23999774 for instance 0e607951-c58f-41ce-bb92-a9399d534b2b on n-h2-849328-3 Aug 24 10:18:39.900333 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-73a47537-7aef-4bf8-a384-6925b742cbd0 req-cadb4797-f410-470b-9f56-4d3024c56896 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033224 Aug 24 10:18:39.901521 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 899/1665] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:39.908936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-38af3f71-6d98-467c-b91a-601979e90aa5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:39.910632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-38af3f71-6d98-467c-b91a-601979e90aa5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:39.919292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38af3f71-6d98-467c-b91a-601979e90aa5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:39.921005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38af3f71-6d98-467c-b91a-601979e90aa5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:39.921739 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38af3f71-6d98-467c-b91a-601979e90aa5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:39.923748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38af3f71-6d98-467c-b91a-601979e90aa5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:39.923748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38af3f71-6d98-467c-b91a-601979e90aa5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:39.924391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38af3f71-6d98-467c-b91a-601979e90aa5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:39.977025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38af3f71-6d98-467c-b91a-601979e90aa5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:39.978126 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38af3f71-6d98-467c-b91a-601979e90aa5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:39.979603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38af3f71-6d98-467c-b91a-601979e90aa5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:39.980040 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-38af3f71-6d98-467c-b91a-601979e90aa5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lazy-loading 'fault' on Instance uuid 35c8116a-830a-4f60-9d70-34eacd719c08 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:18:40.040290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-38af3f71-6d98-467c-b91a-601979e90aa5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:40.053783 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-38af3f71-6d98-467c-b91a-601979e90aa5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 200 len: 1368 microversion: 2.1 time: 0.148581 Aug 24 10:18:40.055080 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 900/1666] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:39 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:40.074361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-af661096-8e4c-44d0-b700-78f457ed9242 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:40.077216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-af661096-8e4c-44d0-b700-78f457ed9242 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:40.084918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af661096-8e4c-44d0-b700-78f457ed9242 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:40.085744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af661096-8e4c-44d0-b700-78f457ed9242 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:40.086876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af661096-8e4c-44d0-b700-78f457ed9242 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:40.088831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af661096-8e4c-44d0-b700-78f457ed9242 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:40.089711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af661096-8e4c-44d0-b700-78f457ed9242 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:40.090394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af661096-8e4c-44d0-b700-78f457ed9242 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:40.106997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37dae45f-7bd6-42d3-993f-c2b08e969665 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:40.123349 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37dae45f-7bd6-42d3-993f-c2b08e969665 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:40.124873 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37dae45f-7bd6-42d3-993f-c2b08e969665 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:40.126096 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-37dae45f-7bd6-42d3-993f-c2b08e969665 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1874 microversion: 2.32 time: 0.899998 Aug 24 10:18:40.130488 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 767/1667] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:39 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1874 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:40.231988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4a7bb792-f567-4b56-894c-ade71105b0e0 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:40.233318 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4a7bb792-f567-4b56-894c-ade71105b0e0 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:40.248239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a7bb792-f567-4b56-894c-ade71105b0e0 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:40.249032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a7bb792-f567-4b56-894c-ade71105b0e0 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:40.251002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a7bb792-f567-4b56-894c-ade71105b0e0 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:40.254774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a7bb792-f567-4b56-894c-ade71105b0e0 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:40.255519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a7bb792-f567-4b56-894c-ade71105b0e0 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:40.256181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a7bb792-f567-4b56-894c-ade71105b0e0 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:40.304164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-af661096-8e4c-44d0-b700-78f457ed9242 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:40.315025 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-af661096-8e4c-44d0-b700-78f457ed9242 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1477 microversion: 2.1 time: 0.250612 Aug 24 10:18:40.328614 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 901/1668] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:40 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1477 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:40.338924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a031f182-28a5-4f12-9028-d28f9aab0b90 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:40.340336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a031f182-28a5-4f12-9028-d28f9aab0b90 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] [instance: 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:40.348416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a031f182-28a5-4f12-9028-d28f9aab0b90 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:40.349440 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a031f182-28a5-4f12-9028-d28f9aab0b90 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:40.350494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a031f182-28a5-4f12-9028-d28f9aab0b90 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:40.352644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a031f182-28a5-4f12-9028-d28f9aab0b90 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:40.353625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a031f182-28a5-4f12-9028-d28f9aab0b90 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:40.354382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a031f182-28a5-4f12-9028-d28f9aab0b90 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:40.560064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a031f182-28a5-4f12-9028-d28f9aab0b90 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cfea45817848c5b0d3e20087d60d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1d41b854f94d67be99f5926a96376c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:40.569521 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a031f182-28a5-4f12-9028-d28f9aab0b90 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4" status: 200 len: 1394 microversion: 2.1 time: 0.243764 Aug 24 10:18:40.570289 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 902/1669] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:40 2022] GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 => generated 1394 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:40.578129 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8c49d76b-13f0-4649-b0a9-57e419bd9b19 req-76d4dd04-806e-4db8-b6bf-5cdc99946b4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b390fef-6be9-4e24-b31e-b6f6252c88c1", "name": "network-vif-unplugged", "status": "completed", "tag": "50041625-3e09-4ff3-9bab-8be84832b786"}, {"server_uuid": "35c8116a-830a-4f60-9d70-34eacd719c08", "name": "network-vif-unplugged", "status": "completed", "tag": "6676526f-444f-4a1b-94b1-f417a9a55ffa"}, {"server_uuid": "d2ed58ac-b16a-4f31-9394-f65217aea1d3", "name": "network-vif-plugged", "status": "completed", "tag": "6dbf42f1-fa54-4f7f-9f8b-ff03fe2fd957"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:40.589965 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4a7bb792-f567-4b56-894c-ade71105b0e0 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:40.592728 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8c49d76b-13f0-4649-b0a9-57e419bd9b19 req-76d4dd04-806e-4db8-b6bf-5cdc99946b4d service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:40.593562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8c49d76b-13f0-4649-b0a9-57e419bd9b19 req-76d4dd04-806e-4db8-b6bf-5cdc99946b4d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:40.594090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8c49d76b-13f0-4649-b0a9-57e419bd9b19 req-76d4dd04-806e-4db8-b6bf-5cdc99946b4d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:40.608516 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4a7bb792-f567-4b56-894c-ade71105b0e0 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 200 len: 1523 microversion: 2.1 time: 0.383149 Aug 24 10:18:40.616395 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8c49d76b-13f0-4649-b0a9-57e419bd9b19 req-76d4dd04-806e-4db8-b6bf-5cdc99946b4d service nova] Creating event network-vif-unplugged:50041625-3e09-4ff3-9bab-8be84832b786 for instance 6b390fef-6be9-4e24-b31e-b6f6252c88c1 on n-h2-849328-3 Aug 24 10:18:40.616710 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 768/1670] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:40 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 1523 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:18:40.617313 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8c49d76b-13f0-4649-b0a9-57e419bd9b19 req-76d4dd04-806e-4db8-b6bf-5cdc99946b4d service nova] Creating event network-vif-unplugged:6676526f-444f-4a1b-94b1-f417a9a55ffa for instance 35c8116a-830a-4f60-9d70-34eacd719c08 on n-h2-849328-3 Aug 24 10:18:40.617917 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8c49d76b-13f0-4649-b0a9-57e419bd9b19 req-76d4dd04-806e-4db8-b6bf-5cdc99946b4d service nova] Creating event network-vif-plugged:6dbf42f1-fa54-4f7f-9f8b-ff03fe2fd957 for instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 on n-h1-849328-3 Aug 24 10:18:40.636235 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f4c61d2b-d32a-44a7-9aab-2c55580cda19 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:40.636974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f4c61d2b-d32a-44a7-9aab-2c55580cda19 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:40.638489 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8c49d76b-13f0-4649-b0a9-57e419bd9b19 req-76d4dd04-806e-4db8-b6bf-5cdc99946b4d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.066677 Aug 24 10:18:40.639779 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 903/1671] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:40.647899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4c61d2b-d32a-44a7-9aab-2c55580cda19 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:40.648501 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4c61d2b-d32a-44a7-9aab-2c55580cda19 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:40.648940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4c61d2b-d32a-44a7-9aab-2c55580cda19 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:40.650459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4c61d2b-d32a-44a7-9aab-2c55580cda19 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:40.651185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4c61d2b-d32a-44a7-9aab-2c55580cda19 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:40.651618 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4c61d2b-d32a-44a7-9aab-2c55580cda19 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:40.664720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-af35f7c3-8867-41a2-816e-79309634c4ef tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:40.665481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-af35f7c3-8867-41a2-816e-79309634c4ef tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 29550762-7055-4641-9d00-46151f4a510f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:40.674374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af35f7c3-8867-41a2-816e-79309634c4ef tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:40.675598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af35f7c3-8867-41a2-816e-79309634c4ef tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:40.677457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af35f7c3-8867-41a2-816e-79309634c4ef tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:40.678570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af35f7c3-8867-41a2-816e-79309634c4ef tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:40.679208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af35f7c3-8867-41a2-816e-79309634c4ef tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:40.679799 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af35f7c3-8867-41a2-816e-79309634c4ef tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:40.688408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f4c61d2b-d32a-44a7-9aab-2c55580cda19 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:18:40.697528 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-af35f7c3-8867-41a2-816e-79309634c4ef tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] HTTP exception thrown: Instance 29550762-7055-4641-9d00-46151f4a510f could not be found. Aug 24 10:18:40.699499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-af35f7c3-8867-41a2-816e-79309634c4ef tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Request method failure captured: Aug 24 10:18:40.699499 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f HTTP/1.1 Aug 24 10:18:40.699499 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:18:40.699499 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:18:40.699499 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:18:40.699499 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:18:40.699499 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:18:40.699499 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:18:40.699499 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:18:40.699499 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:18:40.699499 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfnS1_tZbOMQjvYaau3fpxFbXnEM4RBrIfdbp3hX2eYjW1M0H2Qlq9p5wGGFYLUMm7XU2K341XMWnPZ568_ln9w-gSvZOZHHS9kU-GcaywNCBoZIK1eQ7RV12BNbej14sdWRNBqZB1kTp9pOmHHHvshAoEZcBClQ9VYEIBYwPoRiFB4 Aug 24 10:18:40.699499 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:18:40.699499 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:18:40.699499 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:18:40.699499 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:18:40.699499 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:18:40.699499 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:18:40.699499 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d30703728b2a4a569b6dd1608d8956b8 Aug 24 10:18:40.699499 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:40.699499 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:18:40.699499 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:18:40.701350 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d30703728b2a4a569b6dd1608d8956b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d30703728b2a4a569b6dd1608d8956b8", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d30703728b2a4a569b6dd1608d8956b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d30703728b2a4a569b6dd1608d8956b8"}]}] Aug 24 10:18:40.701350 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:40.701350 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d30703728b2a4a569b6dd1608d8956b8 Aug 24 10:18:40.701350 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:40.701350 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesTestJSON-1542816385-project Aug 24 10:18:40.701350 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:18:40.701350 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:18:40.701350 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 85db443623964ed381b2a4cfc7310202 Aug 24 10:18:40.701350 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesTestJSON-1542816385-project Aug 24 10:18:40.701350 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:18:40.701350 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 29550762-7055-4641-9d00-46151f4a510f could not be found. Aug 24 10:18:40.701350 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '29550762-7055-4641-9d00-46151f4a510f'} Aug 24 10:18:40.702353 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:18:40.702353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:40.702353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:18:40.702353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:18:40.702353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:18:40.702353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:18:40.702353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:18:40.702353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:18:40.702353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:18:40.702353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:18:40.702353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29550762-7055-4641-9d00-46151f4a510f could not be found. Aug 24 10:18:40.702353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:40.702353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:40.702353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:40.702353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:40.702353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:40.702353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:40.702353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:18:40.702353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:18:40.702353 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:18:40.703929 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:18:40.703929 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:18:40.703929 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:18:40.703929 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:18:40.703929 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:18:40.703929 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:18:40.703929 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:18:40.703929 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29550762-7055-4641-9d00-46151f4a510f could not be found. Aug 24 10:18:40.703929 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:40.703929 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:40.703929 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:40.703929 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:40.703929 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:40.703929 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:40.703929 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:18:40.703929 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:18:40.703929 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29550762-7055-4641-9d00-46151f4a510f could not be found. Aug 24 10:18:40.703929 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:40.706059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-af35f7c3-8867-41a2-816e-79309634c4ef tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Returning 404 to user: Instance 29550762-7055-4641-9d00-46151f4a510f could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:18:40.708912 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-af35f7c3-8867-41a2-816e-79309634c4ef tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f" status: 404 len: 111 microversion: 2.1 time: 0.048336 Aug 24 10:18:40.710493 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 904/1672] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:40 2022] GET /compute/v2.1/servers/29550762-7055-4641-9d00-46151f4a510f => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:18:40.718363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b8adab17-3f11-43ea-a15c-9a8e69462b3b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f465a1fb0d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:40.783525 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-b8adab17-3f11-43ea-a15c-9a8e69462b3b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] HTTP exception thrown: Image not found. Aug 24 10:18:40.785702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b8adab17-3f11-43ea-a15c-9a8e69462b3b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Request method failure captured: Aug 24 10:18:40.785702 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7 HTTP/1.1 Aug 24 10:18:40.785702 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:18:40.785702 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:18:40.785702 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:18:40.785702 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:18:40.785702 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:18:40.785702 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:18:40.785702 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:18:40.785702 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:18:40.785702 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfnS1_tZbOMQjvYaau3fpxFbXnEM4RBrIfdbp3hX2eYjW1M0H2Qlq9p5wGGFYLUMm7XU2K341XMWnPZ568_ln9w-gSvZOZHHS9kU-GcaywNCBoZIK1eQ7RV12BNbej14sdWRNBqZB1kTp9pOmHHHvshAoEZcBClQ9VYEIBYwPoRiFB4 Aug 24 10:18:40.785702 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:18:40.785702 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:18:40.785702 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:18:40.785702 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:18:40.785702 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:18:40.785702 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:18:40.785702 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d30703728b2a4a569b6dd1608d8956b8 Aug 24 10:18:40.785702 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:40.785702 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:18:40.785702 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:18:40.787536 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d30703728b2a4a569b6dd1608d8956b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d30703728b2a4a569b6dd1608d8956b8", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d30703728b2a4a569b6dd1608d8956b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d30703728b2a4a569b6dd1608d8956b8"}]}] Aug 24 10:18:40.787536 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:40.787536 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d30703728b2a4a569b6dd1608d8956b8 Aug 24 10:18:40.787536 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:40.787536 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesTestJSON-1542816385-project Aug 24 10:18:40.787536 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:18:40.787536 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:18:40.787536 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 85db443623964ed381b2a4cfc7310202 Aug 24 10:18:40.787536 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesTestJSON-1542816385-project Aug 24 10:18:40.787536 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:18:40.787536 n-d-849328-3 devstack@n-api.service[122433]: exception: Image not found. Aug 24 10:18:40.787536 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '6a85f466-c3f0-44fa-8a3d-862919e018f7'} Aug 24 10:18:40.787536 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:18:40.787536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:40.788703 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 10:18:40.788703 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 10:18:40.788703 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:18:40.788703 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:18:40.788703 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:18:40.788703 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:18:40.788703 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 10:18:40.788703 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 10:18:40.788703 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 10:18:40.788703 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 10:18:40.788703 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:18:40.788703 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:18:40.788703 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:18:40.788703 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:18:40.788703 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6a85f466-c3f0-44fa-8a3d-862919e018f7 to delete Aug 24 10:18:40.788703 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:40.788703 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:40.788703 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:40.788703 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:40.790431 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 10:18:40.790431 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 10:18:40.790431 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 10:18:40.790431 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 10:18:40.790431 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 10:18:40.790431 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 10:18:40.790431 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6a85f466-c3f0-44fa-8a3d-862919e018f7 could not be found. Aug 24 10:18:40.790431 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:40.790431 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:40.790431 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:40.790431 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:40.790431 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:40.790431 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:40.790431 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:18:40.790431 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:18:40.790431 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:18:40.790431 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:18:40.790431 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:18:40.790431 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:18:40.790431 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 10:18:40.792120 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 10:18:40.792120 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 10:18:40.792120 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:40.792120 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:40.792120 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:40.792120 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:40.792120 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:40.792120 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:40.792120 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:18:40.792120 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:18:40.792120 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 10:18:40.792120 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:40.794761 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b8adab17-3f11-43ea-a15c-9a8e69462b3b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Returning 404 to user: Image not found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:18:40.795885 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b8adab17-3f11-43ea-a15c-9a8e69462b3b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "DELETE /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7" status: 404 len: 62 microversion: 2.1 time: 0.081401 Aug 24 10:18:40.796763 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 905/1673] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:40 2022] DELETE /compute/v2.1/images/6a85f466-c3f0-44fa-8a3d-862919e018f7 => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 10:18:40.803052 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f4c61d2b-d32a-44a7-9aab-2c55580cda19 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 204 len: 0 microversion: 2.1 time: 0.173503 Aug 24 10:18:40.803839 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 769/1674] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:18:40 2022] DELETE /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 10:18:40.807072 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1bde89f7-429d-463b-b5e7-e92b92204106 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:40.813155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1bde89f7-429d-463b-b5e7-e92b92204106 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 1fd5ebf9-816f-442a-806d-4cf19678a3d2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:40.817664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fbec8d2d-69b2-4f03-8b93-e25396633227 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:40.818988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fbec8d2d-69b2-4f03-8b93-e25396633227 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:40.827582 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbec8d2d-69b2-4f03-8b93-e25396633227 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:40.828215 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbec8d2d-69b2-4f03-8b93-e25396633227 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:40.829470 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbec8d2d-69b2-4f03-8b93-e25396633227 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:40.830599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbec8d2d-69b2-4f03-8b93-e25396633227 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:40.831279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbec8d2d-69b2-4f03-8b93-e25396633227 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:40.831937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbec8d2d-69b2-4f03-8b93-e25396633227 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:40.835328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bde89f7-429d-463b-b5e7-e92b92204106 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:40.836075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bde89f7-429d-463b-b5e7-e92b92204106 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:40.836846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bde89f7-429d-463b-b5e7-e92b92204106 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:40.837835 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bde89f7-429d-463b-b5e7-e92b92204106 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:40.841422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bde89f7-429d-463b-b5e7-e92b92204106 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:40.842194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bde89f7-429d-463b-b5e7-e92b92204106 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:40.873607 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-1bde89f7-429d-463b-b5e7-e92b92204106 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] HTTP exception thrown: Instance 1fd5ebf9-816f-442a-806d-4cf19678a3d2 could not be found. Aug 24 10:18:40.875206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1bde89f7-429d-463b-b5e7-e92b92204106 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Request method failure captured: Aug 24 10:18:40.875206 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2 HTTP/1.1 Aug 24 10:18:40.875206 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:18:40.875206 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:18:40.875206 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:18:40.875206 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:18:40.875206 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:18:40.875206 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:18:40.875206 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:18:40.875206 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:18:40.875206 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfnS1_tZbOMQjvYaau3fpxFbXnEM4RBrIfdbp3hX2eYjW1M0H2Qlq9p5wGGFYLUMm7XU2K341XMWnPZ568_ln9w-gSvZOZHHS9kU-GcaywNCBoZIK1eQ7RV12BNbej14sdWRNBqZB1kTp9pOmHHHvshAoEZcBClQ9VYEIBYwPoRiFB4 Aug 24 10:18:40.875206 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:18:40.875206 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:18:40.875206 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:18:40.875206 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:18:40.875206 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:18:40.875206 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:18:40.875206 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d30703728b2a4a569b6dd1608d8956b8 Aug 24 10:18:40.875206 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:40.875206 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:18:40.875206 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:18:40.876956 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d30703728b2a4a569b6dd1608d8956b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d30703728b2a4a569b6dd1608d8956b8", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d30703728b2a4a569b6dd1608d8956b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d30703728b2a4a569b6dd1608d8956b8"}]}] Aug 24 10:18:40.876956 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:40.876956 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d30703728b2a4a569b6dd1608d8956b8 Aug 24 10:18:40.876956 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:40.876956 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesTestJSON-1542816385-project Aug 24 10:18:40.876956 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:18:40.876956 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:18:40.876956 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 85db443623964ed381b2a4cfc7310202 Aug 24 10:18:40.876956 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesTestJSON-1542816385-project Aug 24 10:18:40.876956 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:18:40.876956 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 1fd5ebf9-816f-442a-806d-4cf19678a3d2 could not be found. Aug 24 10:18:40.876956 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '1fd5ebf9-816f-442a-806d-4cf19678a3d2'} Aug 24 10:18:40.877982 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:18:40.877982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:40.877982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:18:40.877982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:18:40.877982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:18:40.877982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:18:40.877982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:18:40.877982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:18:40.877982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:18:40.877982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:18:40.877982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fd5ebf9-816f-442a-806d-4cf19678a3d2 could not be found. Aug 24 10:18:40.877982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:40.877982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:40.877982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:40.877982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:40.877982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:40.877982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:40.877982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:18:40.877982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:18:40.877982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:18:40.879811 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:18:40.879811 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:18:40.879811 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:18:40.879811 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:18:40.879811 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:18:40.879811 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:18:40.879811 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:18:40.879811 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:18:40.879811 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:18:40.879811 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fd5ebf9-816f-442a-806d-4cf19678a3d2 could not be found. Aug 24 10:18:40.879811 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:40.879811 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:40.879811 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:40.879811 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:40.879811 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:40.879811 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:40.879811 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:18:40.879811 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:18:40.879811 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fd5ebf9-816f-442a-806d-4cf19678a3d2 could not be found. Aug 24 10:18:40.879811 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:40.881695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1bde89f7-429d-463b-b5e7-e92b92204106 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Returning 404 to user: Instance 1fd5ebf9-816f-442a-806d-4cf19678a3d2 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:18:40.881695 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1bde89f7-429d-463b-b5e7-e92b92204106 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "DELETE /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2" status: 404 len: 111 microversion: 2.1 time: 0.073923 Aug 24 10:18:40.881695 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 906/1675] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:18:40 2022] DELETE /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:18:40.887914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-64226158-4d13-44c8-b6fa-c55e0843e820 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:40.888535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-64226158-4d13-44c8-b6fa-c55e0843e820 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:40.895216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64226158-4d13-44c8-b6fa-c55e0843e820 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:40.895714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64226158-4d13-44c8-b6fa-c55e0843e820 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:40.896148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64226158-4d13-44c8-b6fa-c55e0843e820 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:40.896855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64226158-4d13-44c8-b6fa-c55e0843e820 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:40.897337 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64226158-4d13-44c8-b6fa-c55e0843e820 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:40.897756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64226158-4d13-44c8-b6fa-c55e0843e820 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:40.987397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-64226158-4d13-44c8-b6fa-c55e0843e820 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:41.000274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-64226158-4d13-44c8-b6fa-c55e0843e820 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:41.002015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-64226158-4d13-44c8-b6fa-c55e0843e820 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:41.003526 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-64226158-4d13-44c8-b6fa-c55e0843e820 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1266 microversion: 2.25 time: 0.125130 Aug 24 10:18:41.013165 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 907/1676] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:40 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1266 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:41.013165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e7db523c-0c55-40ae-923e-29cb94d0a822 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:41.013165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e7db523c-0c55-40ae-923e-29cb94d0a822 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 1fd5ebf9-816f-442a-806d-4cf19678a3d2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:41.021207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7db523c-0c55-40ae-923e-29cb94d0a822 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:41.021207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7db523c-0c55-40ae-923e-29cb94d0a822 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:41.021207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7db523c-0c55-40ae-923e-29cb94d0a822 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:41.021207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7db523c-0c55-40ae-923e-29cb94d0a822 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:41.021733 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7db523c-0c55-40ae-923e-29cb94d0a822 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:41.021733 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7db523c-0c55-40ae-923e-29cb94d0a822 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:41.033858 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-e7db523c-0c55-40ae-923e-29cb94d0a822 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] HTTP exception thrown: Instance 1fd5ebf9-816f-442a-806d-4cf19678a3d2 could not be found. Aug 24 10:18:41.035450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e7db523c-0c55-40ae-923e-29cb94d0a822 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Request method failure captured: Aug 24 10:18:41.035450 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2 HTTP/1.1 Aug 24 10:18:41.035450 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:18:41.035450 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:18:41.035450 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:18:41.035450 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:18:41.035450 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:18:41.035450 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:18:41.035450 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:18:41.035450 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:18:41.035450 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfnS1_tZbOMQjvYaau3fpxFbXnEM4RBrIfdbp3hX2eYjW1M0H2Qlq9p5wGGFYLUMm7XU2K341XMWnPZ568_ln9w-gSvZOZHHS9kU-GcaywNCBoZIK1eQ7RV12BNbej14sdWRNBqZB1kTp9pOmHHHvshAoEZcBClQ9VYEIBYwPoRiFB4 Aug 24 10:18:41.035450 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:18:41.035450 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:18:41.035450 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:18:41.035450 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:18:41.035450 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:18:41.035450 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:18:41.035450 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d30703728b2a4a569b6dd1608d8956b8 Aug 24 10:18:41.035450 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:41.035450 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:18:41.035450 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:18:41.037572 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d30703728b2a4a569b6dd1608d8956b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d30703728b2a4a569b6dd1608d8956b8", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d30703728b2a4a569b6dd1608d8956b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d30703728b2a4a569b6dd1608d8956b8"}]}] Aug 24 10:18:41.037572 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:41.037572 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d30703728b2a4a569b6dd1608d8956b8 Aug 24 10:18:41.037572 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:41.037572 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesTestJSON-1542816385-project Aug 24 10:18:41.037572 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:18:41.037572 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:18:41.037572 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 85db443623964ed381b2a4cfc7310202 Aug 24 10:18:41.037572 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesTestJSON-1542816385-project Aug 24 10:18:41.037572 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:18:41.037572 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 1fd5ebf9-816f-442a-806d-4cf19678a3d2 could not be found. Aug 24 10:18:41.037572 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '1fd5ebf9-816f-442a-806d-4cf19678a3d2'} Aug 24 10:18:41.039687 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:18:41.039687 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:41.039687 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:18:41.039687 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:18:41.039687 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:18:41.039687 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:18:41.039687 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:18:41.039687 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:18:41.039687 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:18:41.039687 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:18:41.039687 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fd5ebf9-816f-442a-806d-4cf19678a3d2 could not be found. Aug 24 10:18:41.039687 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.039687 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:41.039687 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.039687 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:41.039687 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:41.039687 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:41.039687 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:18:41.039687 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:18:41.039687 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:18:41.044803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:18:41.044803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:18:41.044803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:18:41.044803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:18:41.044803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:18:41.044803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:18:41.044803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:18:41.044803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fd5ebf9-816f-442a-806d-4cf19678a3d2 could not be found. Aug 24 10:18:41.044803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.044803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:41.044803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.044803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:41.044803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:41.044803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:41.044803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:18:41.044803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:18:41.044803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fd5ebf9-816f-442a-806d-4cf19678a3d2 could not be found. Aug 24 10:18:41.044803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.047905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e7db523c-0c55-40ae-923e-29cb94d0a822 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Returning 404 to user: Instance 1fd5ebf9-816f-442a-806d-4cf19678a3d2 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:18:41.047905 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e7db523c-0c55-40ae-923e-29cb94d0a822 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2" status: 404 len: 111 microversion: 2.1 time: 0.031729 Aug 24 10:18:41.047905 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 908/1677] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:41 2022] GET /compute/v2.1/servers/1fd5ebf9-816f-442a-806d-4cf19678a3d2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:18:41.047905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1e1dd5b2-737a-4322-85bc-1dc78df6565c tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f465a207040>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:41.072732 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-1e1dd5b2-737a-4322-85bc-1dc78df6565c tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] HTTP exception thrown: Image not found. Aug 24 10:18:41.073772 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1e1dd5b2-737a-4322-85bc-1dc78df6565c tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Request method failure captured: Aug 24 10:18:41.073772 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a HTTP/1.1 Aug 24 10:18:41.073772 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:18:41.073772 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:18:41.073772 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:18:41.073772 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:18:41.073772 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:18:41.073772 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:18:41.073772 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:18:41.073772 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:18:41.073772 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfnS1_tZbOMQjvYaau3fpxFbXnEM4RBrIfdbp3hX2eYjW1M0H2Qlq9p5wGGFYLUMm7XU2K341XMWnPZ568_ln9w-gSvZOZHHS9kU-GcaywNCBoZIK1eQ7RV12BNbej14sdWRNBqZB1kTp9pOmHHHvshAoEZcBClQ9VYEIBYwPoRiFB4 Aug 24 10:18:41.073772 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:18:41.073772 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:18:41.073772 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:18:41.073772 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:18:41.073772 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:18:41.073772 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:18:41.073772 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d30703728b2a4a569b6dd1608d8956b8 Aug 24 10:18:41.073772 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:41.073772 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:18:41.073772 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:18:41.075368 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d30703728b2a4a569b6dd1608d8956b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d30703728b2a4a569b6dd1608d8956b8", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d30703728b2a4a569b6dd1608d8956b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d30703728b2a4a569b6dd1608d8956b8"}]}] Aug 24 10:18:41.075368 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:41.075368 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d30703728b2a4a569b6dd1608d8956b8 Aug 24 10:18:41.075368 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:41.075368 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesTestJSON-1542816385-project Aug 24 10:18:41.075368 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:18:41.075368 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:18:41.075368 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 85db443623964ed381b2a4cfc7310202 Aug 24 10:18:41.075368 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesTestJSON-1542816385-project Aug 24 10:18:41.075368 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:18:41.075368 n-d-849328-3 devstack@n-api.service[122433]: exception: Image not found. Aug 24 10:18:41.075368 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '2a2e75ff-a020-409e-becf-fae5529dce2a'} Aug 24 10:18:41.075368 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:18:41.075368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:41.077812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 10:18:41.077812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 10:18:41.077812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:18:41.077812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:18:41.077812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:18:41.077812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:18:41.077812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 10:18:41.077812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 10:18:41.077812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 10:18:41.077812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 10:18:41.077812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:18:41.077812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:18:41.077812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:18:41.077812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:18:41.077812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2a2e75ff-a020-409e-becf-fae5529dce2a to delete Aug 24 10:18:41.077812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.077812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:41.077812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.077812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:41.079944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 10:18:41.079944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 10:18:41.079944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 10:18:41.079944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 10:18:41.079944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 10:18:41.079944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 10:18:41.079944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2a2e75ff-a020-409e-becf-fae5529dce2a could not be found. Aug 24 10:18:41.079944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.079944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:41.079944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.079944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:41.079944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:41.079944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:41.079944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:18:41.079944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:18:41.079944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:18:41.079944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:18:41.079944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:18:41.079944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:18:41.079944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 10:18:41.081566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 10:18:41.081566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 10:18:41.081566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.081566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:41.081566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.081566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:41.081566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:41.081566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:41.081566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:18:41.081566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:18:41.081566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 10:18:41.081566 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.081566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1e1dd5b2-737a-4322-85bc-1dc78df6565c tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Returning 404 to user: Image not found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:18:41.081566 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1e1dd5b2-737a-4322-85bc-1dc78df6565c tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "DELETE /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a" status: 404 len: 62 microversion: 2.1 time: 0.033808 Aug 24 10:18:41.081566 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 909/1678] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:41 2022] DELETE /compute/v2.1/images/2a2e75ff-a020-409e-becf-fae5529dce2a => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:18:41.085280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-be353761-ef2f-41ba-97b1-5eb7323ef91e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:41.085943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-be353761-ef2f-41ba-97b1-5eb7323ef91e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: 35c8116a-830a-4f60-9d70-34eacd719c08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:41.093945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be353761-ef2f-41ba-97b1-5eb7323ef91e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:41.094582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be353761-ef2f-41ba-97b1-5eb7323ef91e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:41.095110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be353761-ef2f-41ba-97b1-5eb7323ef91e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:41.095918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be353761-ef2f-41ba-97b1-5eb7323ef91e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:41.096958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be353761-ef2f-41ba-97b1-5eb7323ef91e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:41.096958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be353761-ef2f-41ba-97b1-5eb7323ef91e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:41.111174 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-be353761-ef2f-41ba-97b1-5eb7323ef91e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] HTTP exception thrown: Instance 35c8116a-830a-4f60-9d70-34eacd719c08 could not be found. Aug 24 10:18:41.112861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-be353761-ef2f-41ba-97b1-5eb7323ef91e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Request method failure captured: Aug 24 10:18:41.112861 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 HTTP/1.1 Aug 24 10:18:41.112861 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:18:41.112861 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:18:41.112861 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:18:41.112861 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:18:41.112861 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:18:41.112861 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:18:41.112861 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:18:41.112861 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:18:41.112861 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfluf5WMhltPE0D2xS8_BGCoOmTlCH2eBEOMFIUtA9FPZZR9DZIJd_DW99E6ZcQOBcSKD-DIGSH2aRtpk3snGczsSGx7soynXHHf3GrBj4Ucp-YVsvxSTBKIshG-vRfctk2mFYBB3hYwgSuW-uej7q8PvT9aTn6fsAkXfQUykpnq6uY Aug 24 10:18:41.112861 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:18:41.112861 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:18:41.112861 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:18:41.112861 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:18:41.112861 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:18:41.112861 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:18:41.112861 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 7947a063a37946b7870e95dfd7a2e7e6 Aug 24 10:18:41.112861 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-MigrationsAdminTest-2049550965 Aug 24 10:18:41.112861 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:18:41.112861 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:18:41.114778 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/7947a063a37946b7870e95dfd7a2e7e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_7947a063a37946b7870e95dfd7a2e7e6", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/7947a063a37946b7870e95dfd7a2e7e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/7947a063a37946b7870e95dfd7a2e7e6"}]}] Aug 24 10:18:41.114778 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-MigrationsAdminTest-2049550965 Aug 24 10:18:41.114778 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 7947a063a37946b7870e95dfd7a2e7e6 Aug 24 10:18:41.114778 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-MigrationsAdminTest-2049550965 Aug 24 10:18:41.114778 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-MigrationsAdminTest-2049550965-project Aug 24 10:18:41.114778 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:18:41.114778 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:18:41.114778 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 53af167c0c744cbb910ff5860767cb95 Aug 24 10:18:41.114778 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-MigrationsAdminTest-2049550965-project Aug 24 10:18:41.114778 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:18:41.114778 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 35c8116a-830a-4f60-9d70-34eacd719c08 could not be found. Aug 24 10:18:41.114778 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '35c8116a-830a-4f60-9d70-34eacd719c08'} Aug 24 10:18:41.116088 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:18:41.116088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:41.116088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:18:41.116088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:18:41.116088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:18:41.116088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:18:41.116088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:18:41.116088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:18:41.116088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:18:41.116088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:18:41.116088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35c8116a-830a-4f60-9d70-34eacd719c08 could not be found. Aug 24 10:18:41.116088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.116088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:41.116088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.116088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:41.116088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:41.116088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:41.116088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:18:41.116088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:18:41.116088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:18:41.119632 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:18:41.119632 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:18:41.119632 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:18:41.119632 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:18:41.119632 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:18:41.119632 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:18:41.119632 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:18:41.119632 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35c8116a-830a-4f60-9d70-34eacd719c08 could not be found. Aug 24 10:18:41.119632 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.119632 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:41.119632 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.119632 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:41.119632 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:41.119632 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:41.119632 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:18:41.119632 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:18:41.119632 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35c8116a-830a-4f60-9d70-34eacd719c08 could not be found. Aug 24 10:18:41.119632 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.122253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-be353761-ef2f-41ba-97b1-5eb7323ef91e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Returning 404 to user: Instance 35c8116a-830a-4f60-9d70-34eacd719c08 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:18:41.122253 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-be353761-ef2f-41ba-97b1-5eb7323ef91e tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08" status: 404 len: 111 microversion: 2.1 time: 0.039047 Aug 24 10:18:41.122253 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 910/1679] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:41 2022] GET /compute/v2.1/servers/35c8116a-830a-4f60-9d70-34eacd719c08 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:18:41.125065 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-29f0de18-ad95-4c18-b661-944827b21f3b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:41.125688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-29f0de18-ad95-4c18-b661-944827b21f3b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:41.132428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29f0de18-ad95-4c18-b661-944827b21f3b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:41.133810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29f0de18-ad95-4c18-b661-944827b21f3b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:41.133810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29f0de18-ad95-4c18-b661-944827b21f3b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:41.134486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29f0de18-ad95-4c18-b661-944827b21f3b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:41.135063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29f0de18-ad95-4c18-b661-944827b21f3b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:41.136002 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29f0de18-ad95-4c18-b661-944827b21f3b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:41.156256 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-29f0de18-ad95-4c18-b661-944827b21f3b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] HTTP exception thrown: Instance a1ebe6bd-b2ae-45c2-8752-314356143de9 could not be found. Aug 24 10:18:41.157878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-29f0de18-ad95-4c18-b661-944827b21f3b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Request method failure captured: Aug 24 10:18:41.157878 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 HTTP/1.1 Aug 24 10:18:41.157878 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:18:41.157878 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:18:41.157878 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:18:41.157878 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:18:41.157878 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:18:41.157878 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:18:41.157878 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:18:41.157878 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:18:41.157878 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfnS1_tZbOMQjvYaau3fpxFbXnEM4RBrIfdbp3hX2eYjW1M0H2Qlq9p5wGGFYLUMm7XU2K341XMWnPZ568_ln9w-gSvZOZHHS9kU-GcaywNCBoZIK1eQ7RV12BNbej14sdWRNBqZB1kTp9pOmHHHvshAoEZcBClQ9VYEIBYwPoRiFB4 Aug 24 10:18:41.157878 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:18:41.157878 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:18:41.157878 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:18:41.157878 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:18:41.157878 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:18:41.157878 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:18:41.157878 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d30703728b2a4a569b6dd1608d8956b8 Aug 24 10:18:41.157878 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:41.157878 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:18:41.157878 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:18:41.159446 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d30703728b2a4a569b6dd1608d8956b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d30703728b2a4a569b6dd1608d8956b8", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d30703728b2a4a569b6dd1608d8956b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d30703728b2a4a569b6dd1608d8956b8"}]}] Aug 24 10:18:41.159446 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:41.159446 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d30703728b2a4a569b6dd1608d8956b8 Aug 24 10:18:41.159446 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:41.159446 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesTestJSON-1542816385-project Aug 24 10:18:41.159446 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:18:41.159446 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:18:41.159446 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 85db443623964ed381b2a4cfc7310202 Aug 24 10:18:41.159446 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesTestJSON-1542816385-project Aug 24 10:18:41.159446 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:18:41.159446 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance a1ebe6bd-b2ae-45c2-8752-314356143de9 could not be found. Aug 24 10:18:41.159446 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'a1ebe6bd-b2ae-45c2-8752-314356143de9'} Aug 24 10:18:41.161343 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:18:41.161343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:41.161343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:18:41.161343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:18:41.161343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:18:41.161343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:18:41.161343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:18:41.161343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:18:41.161343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:18:41.161343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:18:41.161343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1ebe6bd-b2ae-45c2-8752-314356143de9 could not be found. Aug 24 10:18:41.161343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.161343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:41.161343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.161343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:41.161343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:41.161343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:41.161343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:18:41.161343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:18:41.161343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:18:41.165612 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:18:41.165612 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:18:41.165612 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:18:41.165612 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:18:41.165612 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:18:41.165612 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:18:41.165612 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:18:41.165612 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:18:41.165612 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:18:41.165612 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1ebe6bd-b2ae-45c2-8752-314356143de9 could not be found. Aug 24 10:18:41.165612 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.165612 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:41.165612 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.165612 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:41.165612 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:41.165612 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:41.165612 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:18:41.165612 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:18:41.165612 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1ebe6bd-b2ae-45c2-8752-314356143de9 could not be found. Aug 24 10:18:41.165612 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.170665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-29f0de18-ad95-4c18-b661-944827b21f3b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Returning 404 to user: Instance a1ebe6bd-b2ae-45c2-8752-314356143de9 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:18:41.170665 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-29f0de18-ad95-4c18-b661-944827b21f3b tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 404 len: 111 microversion: 2.1 time: 0.040030 Aug 24 10:18:41.170665 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 911/1680] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:18:41 2022] DELETE /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:18:41.170665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-adfdb22f-e021-4a11-8195-5aaedbe69082 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '.version_select at 0x7f4655231790>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:41.190338 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-adfdb22f-e021-4a11-8195-5aaedbe69082 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2099809665" status: 202 len: 0 microversion: 2.1 time: 0.028949 Aug 24 10:18:41.190994 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 912/1681] 10.222.0.85 () {58 vars in 1221 bytes} [Wed Aug 24 10:18:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2099809665 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:18:41.197394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0060c4d9-dce5-42e3-bfea-73641947beab tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:41.198234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0060c4d9-dce5-42e3-bfea-73641947beab tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:41.205228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0060c4d9-dce5-42e3-bfea-73641947beab tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:41.206159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0060c4d9-dce5-42e3-bfea-73641947beab tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:41.206761 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0060c4d9-dce5-42e3-bfea-73641947beab tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:41.207646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0060c4d9-dce5-42e3-bfea-73641947beab tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:41.208321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0060c4d9-dce5-42e3-bfea-73641947beab tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:41.209028 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0060c4d9-dce5-42e3-bfea-73641947beab tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:41.246552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fbec8d2d-69b2-4f03-8b93-e25396633227 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:41.269511 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fbec8d2d-69b2-4f03-8b93-e25396633227 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 200 len: 1529 microversion: 2.1 time: 0.459295 Aug 24 10:18:41.285653 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 770/1682] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:40 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 1529 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:41.304170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6eadf469-0d1c-4570-a665-e07b3c615b54 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:41.305780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6eadf469-0d1c-4570-a665-e07b3c615b54 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: a1ebe6bd-b2ae-45c2-8752-314356143de9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:41.317425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6eadf469-0d1c-4570-a665-e07b3c615b54 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:41.319455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6eadf469-0d1c-4570-a665-e07b3c615b54 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:41.320454 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6eadf469-0d1c-4570-a665-e07b3c615b54 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:41.321949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6eadf469-0d1c-4570-a665-e07b3c615b54 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:41.323008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6eadf469-0d1c-4570-a665-e07b3c615b54 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:41.324036 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6eadf469-0d1c-4570-a665-e07b3c615b54 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:41.360569 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-6eadf469-0d1c-4570-a665-e07b3c615b54 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] HTTP exception thrown: Instance a1ebe6bd-b2ae-45c2-8752-314356143de9 could not be found. Aug 24 10:18:41.364293 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6eadf469-0d1c-4570-a665-e07b3c615b54 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Request method failure captured: Aug 24 10:18:41.364293 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 HTTP/1.1 Aug 24 10:18:41.364293 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:18:41.364293 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:18:41.364293 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:18:41.364293 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:18:41.364293 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:18:41.364293 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:18:41.364293 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:18:41.364293 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:18:41.364293 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfnS1_tZbOMQjvYaau3fpxFbXnEM4RBrIfdbp3hX2eYjW1M0H2Qlq9p5wGGFYLUMm7XU2K341XMWnPZ568_ln9w-gSvZOZHHS9kU-GcaywNCBoZIK1eQ7RV12BNbej14sdWRNBqZB1kTp9pOmHHHvshAoEZcBClQ9VYEIBYwPoRiFB4 Aug 24 10:18:41.364293 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:18:41.364293 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:18:41.364293 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:18:41.364293 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:18:41.364293 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:18:41.364293 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:18:41.364293 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: d30703728b2a4a569b6dd1608d8956b8 Aug 24 10:18:41.364293 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:41.364293 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:18:41.364293 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:18:41.367344 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d30703728b2a4a569b6dd1608d8956b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d30703728b2a4a569b6dd1608d8956b8", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d30703728b2a4a569b6dd1608d8956b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d30703728b2a4a569b6dd1608d8956b8"}]}] Aug 24 10:18:41.367344 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:41.367344 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: d30703728b2a4a569b6dd1608d8956b8 Aug 24 10:18:41.367344 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:41.367344 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ImagesTestJSON-1542816385-project Aug 24 10:18:41.367344 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:18:41.367344 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:18:41.367344 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 85db443623964ed381b2a4cfc7310202 Aug 24 10:18:41.367344 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesTestJSON-1542816385-project Aug 24 10:18:41.367344 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:18:41.367344 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance a1ebe6bd-b2ae-45c2-8752-314356143de9 could not be found. Aug 24 10:18:41.367344 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'a1ebe6bd-b2ae-45c2-8752-314356143de9'} Aug 24 10:18:41.368980 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:18:41.368980 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:41.368980 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:18:41.368980 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:18:41.368980 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:18:41.368980 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:18:41.368980 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:18:41.368980 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:18:41.368980 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:18:41.368980 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:18:41.368980 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1ebe6bd-b2ae-45c2-8752-314356143de9 could not be found. Aug 24 10:18:41.368980 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.368980 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:41.368980 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.368980 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:41.368980 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:41.368980 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:41.368980 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:18:41.368980 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:18:41.368980 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:18:41.371726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:18:41.371726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:18:41.371726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:18:41.371726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:18:41.371726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:18:41.371726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:18:41.371726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:18:41.371726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1ebe6bd-b2ae-45c2-8752-314356143de9 could not be found. Aug 24 10:18:41.371726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.371726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:41.371726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.371726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:41.371726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:41.371726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:41.371726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:18:41.371726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:18:41.371726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1ebe6bd-b2ae-45c2-8752-314356143de9 could not be found. Aug 24 10:18:41.371726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.378334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6eadf469-0d1c-4570-a665-e07b3c615b54 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Returning 404 to user: Instance a1ebe6bd-b2ae-45c2-8752-314356143de9 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:18:41.378334 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6eadf469-0d1c-4570-a665-e07b3c615b54 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9" status: 404 len: 111 microversion: 2.1 time: 0.088624 Aug 24 10:18:41.378334 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 771/1683] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:41 2022] GET /compute/v2.1/servers/a1ebe6bd-b2ae-45c2-8752-314356143de9 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:18:41.389715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9b2a5f9e-7344-4b5c-80b5-edaae55ff5f2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:41.391085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9b2a5f9e-7344-4b5c-80b5-edaae55ff5f2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:41.397320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:41.406250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b2a5f9e-7344-4b5c-80b5-edaae55ff5f2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:41.407437 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b2a5f9e-7344-4b5c-80b5-edaae55ff5f2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:41.408439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b2a5f9e-7344-4b5c-80b5-edaae55ff5f2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:41.410748 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b2a5f9e-7344-4b5c-80b5-edaae55ff5f2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:41.411769 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b2a5f9e-7344-4b5c-80b5-edaae55ff5f2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:41.413527 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b2a5f9e-7344-4b5c-80b5-edaae55ff5f2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:41.528724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0060c4d9-dce5-42e3-bfea-73641947beab tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:41.541868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0060c4d9-dce5-42e3-bfea-73641947beab tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:41.543990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0060c4d9-dce5-42e3-bfea-73641947beab tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:41.545538 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0060c4d9-dce5-42e3-bfea-73641947beab tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1874 microversion: 2.32 time: 0.353258 Aug 24 10:18:41.561708 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 913/1684] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:41 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1874 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:41.569508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8124a878-0e8b-457a-ac88-a0db539fc39f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '.version_select at 0x7f4655674d30>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:41.598190 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-8124a878-0e8b-457a-ac88-a0db539fc39f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] HTTP exception thrown: Image not found. Aug 24 10:18:41.601487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8124a878-0e8b-457a-ac88-a0db539fc39f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Request method failure captured: Aug 24 10:18:41.601487 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b HTTP/1.1 Aug 24 10:18:41.601487 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:18:41.601487 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:18:41.601487 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:18:41.601487 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:18:41.601487 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:18:41.601487 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:18:41.601487 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:18:41.601487 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:18:41.601487 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfnS1_tZbOMQjvYaau3fpxFbXnEM4RBrIfdbp3hX2eYjW1M0H2Qlq9p5wGGFYLUMm7XU2K341XMWnPZ568_ln9w-gSvZOZHHS9kU-GcaywNCBoZIK1eQ7RV12BNbej14sdWRNBqZB1kTp9pOmHHHvshAoEZcBClQ9VYEIBYwPoRiFB4 Aug 24 10:18:41.601487 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:18:41.601487 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:18:41.601487 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:18:41.601487 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:18:41.601487 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:18:41.601487 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:18:41.601487 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d30703728b2a4a569b6dd1608d8956b8 Aug 24 10:18:41.601487 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:41.601487 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:18:41.601487 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:18:41.603165 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d30703728b2a4a569b6dd1608d8956b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d30703728b2a4a569b6dd1608d8956b8", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d30703728b2a4a569b6dd1608d8956b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d30703728b2a4a569b6dd1608d8956b8"}]}] Aug 24 10:18:41.603165 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:41.603165 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d30703728b2a4a569b6dd1608d8956b8 Aug 24 10:18:41.603165 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:41.603165 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesTestJSON-1542816385-project Aug 24 10:18:41.603165 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:18:41.603165 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:18:41.603165 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 85db443623964ed381b2a4cfc7310202 Aug 24 10:18:41.603165 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesTestJSON-1542816385-project Aug 24 10:18:41.603165 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:18:41.603165 n-d-849328-3 devstack@n-api.service[122433]: exception: Image not found. Aug 24 10:18:41.603165 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '9b6e9569-c375-49f5-a9a9-a1f11370621b'} Aug 24 10:18:41.603165 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:18:41.603165 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:41.604284 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 10:18:41.604284 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 10:18:41.604284 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:18:41.604284 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:18:41.604284 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:18:41.604284 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:18:41.604284 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 10:18:41.604284 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 10:18:41.604284 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 10:18:41.604284 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 10:18:41.604284 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:18:41.604284 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:18:41.604284 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:18:41.604284 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:18:41.604284 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9b6e9569-c375-49f5-a9a9-a1f11370621b to delete Aug 24 10:18:41.604284 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.604284 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:41.604284 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.604284 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:41.605720 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 10:18:41.605720 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 10:18:41.605720 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 10:18:41.605720 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 10:18:41.605720 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 10:18:41.605720 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 10:18:41.605720 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9b6e9569-c375-49f5-a9a9-a1f11370621b could not be found. Aug 24 10:18:41.605720 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.605720 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:41.605720 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.605720 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:41.605720 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:41.605720 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:41.605720 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:18:41.605720 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:18:41.605720 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:18:41.605720 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:18:41.605720 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:18:41.605720 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:18:41.605720 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 10:18:41.607161 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 10:18:41.607161 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 10:18:41.607161 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.607161 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:41.607161 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.607161 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:41.607161 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:41.607161 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:41.607161 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:18:41.607161 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:18:41.607161 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 10:18:41.607161 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.610412 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8124a878-0e8b-457a-ac88-a0db539fc39f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Returning 404 to user: Image not found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:18:41.611890 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8124a878-0e8b-457a-ac88-a0db539fc39f tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "DELETE /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b" status: 404 len: 62 microversion: 2.1 time: 0.048405 Aug 24 10:18:41.614333 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 914/1685] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:41 2022] DELETE /compute/v2.1/images/9b6e9569-c375-49f5-a9a9-a1f11370621b => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:18:41.621331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-24307b33-a19e-47c5-acaf-ca02d941a282 req-d77a127c-3703-46ac-8556-26bafed9c648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4", "tag": "3aaa78a6-64c1-4bea-b5d7-4d0cab5d8596"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:41.638042 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-24307b33-a19e-47c5-acaf-ca02d941a282 req-d77a127c-3703-46ac-8556-26bafed9c648 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:41.638905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-24307b33-a19e-47c5-acaf-ca02d941a282 req-d77a127c-3703-46ac-8556-26bafed9c648 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:41.640290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-24307b33-a19e-47c5-acaf-ca02d941a282 req-d77a127c-3703-46ac-8556-26bafed9c648 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:41.673746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9b2a5f9e-7344-4b5c-80b5-edaae55ff5f2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:41.680448 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-24307b33-a19e-47c5-acaf-ca02d941a282 req-d77a127c-3703-46ac-8556-26bafed9c648 service nova] Creating event network-changed:3aaa78a6-64c1-4bea-b5d7-4d0cab5d8596 for instance 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 on n-h1-849328-3 Aug 24 10:18:41.689011 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9b2a5f9e-7344-4b5c-80b5-edaae55ff5f2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1477 microversion: 2.1 time: 0.306989 Aug 24 10:18:41.690387 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 772/1686] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:41 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1477 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:41.692279 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-24307b33-a19e-47c5-acaf-ca02d941a282 req-d77a127c-3703-46ac-8556-26bafed9c648 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073714 Aug 24 10:18:41.695759 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 915/1687] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:41.697879 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-05e177ac-0108-48b2-811a-6816dd110e14 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:41.698848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-05e177ac-0108-48b2-811a-6816dd110e14 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] [instance: 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:41.709001 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ac2d39df-4ed9-4a3f-a828-44abfd05744e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:41.709317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05e177ac-0108-48b2-811a-6816dd110e14 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:41.709849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ac2d39df-4ed9-4a3f-a828-44abfd05744e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:41.710251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05e177ac-0108-48b2-811a-6816dd110e14 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:41.710871 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05e177ac-0108-48b2-811a-6816dd110e14 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:41.711750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05e177ac-0108-48b2-811a-6816dd110e14 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:41.712604 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05e177ac-0108-48b2-811a-6816dd110e14 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:41.713318 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05e177ac-0108-48b2-811a-6816dd110e14 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:41.720335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac2d39df-4ed9-4a3f-a828-44abfd05744e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:41.721666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac2d39df-4ed9-4a3f-a828-44abfd05744e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:41.722754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac2d39df-4ed9-4a3f-a828-44abfd05744e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:41.724062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac2d39df-4ed9-4a3f-a828-44abfd05744e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:41.724993 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac2d39df-4ed9-4a3f-a828-44abfd05744e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:41.725670 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac2d39df-4ed9-4a3f-a828-44abfd05744e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:41.737029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:41.751131 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-ac2d39df-4ed9-4a3f-a828-44abfd05744e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] HTTP exception thrown: Instance 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab could not be found. Aug 24 10:18:41.752806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ac2d39df-4ed9-4a3f-a828-44abfd05744e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Request method failure captured: Aug 24 10:18:41.752806 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab HTTP/1.1 Aug 24 10:18:41.752806 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:18:41.752806 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:18:41.752806 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:18:41.752806 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:18:41.752806 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:18:41.752806 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:18:41.752806 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:18:41.752806 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:18:41.752806 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfnS1_tZbOMQjvYaau3fpxFbXnEM4RBrIfdbp3hX2eYjW1M0H2Qlq9p5wGGFYLUMm7XU2K341XMWnPZ568_ln9w-gSvZOZHHS9kU-GcaywNCBoZIK1eQ7RV12BNbej14sdWRNBqZB1kTp9pOmHHHvshAoEZcBClQ9VYEIBYwPoRiFB4 Aug 24 10:18:41.752806 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:18:41.752806 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:18:41.752806 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:18:41.752806 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:18:41.752806 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:18:41.752806 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:18:41.752806 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d30703728b2a4a569b6dd1608d8956b8 Aug 24 10:18:41.752806 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:41.752806 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:18:41.752806 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:18:41.754630 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d30703728b2a4a569b6dd1608d8956b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d30703728b2a4a569b6dd1608d8956b8", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d30703728b2a4a569b6dd1608d8956b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d30703728b2a4a569b6dd1608d8956b8"}]}] Aug 24 10:18:41.754630 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:41.754630 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d30703728b2a4a569b6dd1608d8956b8 Aug 24 10:18:41.754630 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:41.754630 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesTestJSON-1542816385-project Aug 24 10:18:41.754630 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:18:41.754630 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:18:41.754630 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 85db443623964ed381b2a4cfc7310202 Aug 24 10:18:41.754630 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesTestJSON-1542816385-project Aug 24 10:18:41.754630 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:18:41.754630 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab could not be found. Aug 24 10:18:41.754630 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '7953a2dc-785d-4cb0-a4ee-8bd420fc6fab'} Aug 24 10:18:41.755631 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:18:41.755631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:41.755631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:18:41.755631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:18:41.755631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:18:41.755631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:18:41.755631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:18:41.755631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:18:41.755631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:18:41.755631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:18:41.755631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab could not be found. Aug 24 10:18:41.755631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.755631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:41.755631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.755631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:41.755631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:41.755631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:41.755631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:18:41.755631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:18:41.755631 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:18:41.757238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:18:41.757238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:18:41.757238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:18:41.757238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:18:41.757238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:18:41.757238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:18:41.757238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:18:41.757238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:18:41.757238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:18:41.757238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab could not be found. Aug 24 10:18:41.757238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.757238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:41.757238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.757238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:41.757238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:41.757238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:41.757238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:18:41.757238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:18:41.757238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab could not be found. Aug 24 10:18:41.757238 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.761850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ac2d39df-4ed9-4a3f-a828-44abfd05744e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Returning 404 to user: Instance 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:18:41.763374 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ac2d39df-4ed9-4a3f-a828-44abfd05744e tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "DELETE /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab" status: 404 len: 111 microversion: 2.1 time: 0.064233 Aug 24 10:18:41.764067 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 916/1688] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:18:41 2022] DELETE /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:18:41.772205 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-870c660d-a962-4073-b144-fce3c3ca01c0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:41.772803 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-870c660d-a962-4073-b144-fce3c3ca01c0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] [instance: 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:41.779600 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-870c660d-a962-4073-b144-fce3c3ca01c0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:41.780083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-870c660d-a962-4073-b144-fce3c3ca01c0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:41.780507 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-870c660d-a962-4073-b144-fce3c3ca01c0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:41.781230 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-870c660d-a962-4073-b144-fce3c3ca01c0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:41.781851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-870c660d-a962-4073-b144-fce3c3ca01c0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:41.782547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-870c660d-a962-4073-b144-fce3c3ca01c0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:41.797563 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-870c660d-a962-4073-b144-fce3c3ca01c0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] HTTP exception thrown: Instance 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab could not be found. Aug 24 10:18:41.799094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-870c660d-a962-4073-b144-fce3c3ca01c0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Request method failure captured: Aug 24 10:18:41.799094 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab HTTP/1.1 Aug 24 10:18:41.799094 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:18:41.799094 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:18:41.799094 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:18:41.799094 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:18:41.799094 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:18:41.799094 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:18:41.799094 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:18:41.799094 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:18:41.799094 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfnS1_tZbOMQjvYaau3fpxFbXnEM4RBrIfdbp3hX2eYjW1M0H2Qlq9p5wGGFYLUMm7XU2K341XMWnPZ568_ln9w-gSvZOZHHS9kU-GcaywNCBoZIK1eQ7RV12BNbej14sdWRNBqZB1kTp9pOmHHHvshAoEZcBClQ9VYEIBYwPoRiFB4 Aug 24 10:18:41.799094 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:18:41.799094 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:18:41.799094 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:18:41.799094 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:18:41.799094 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:18:41.799094 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:18:41.799094 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d30703728b2a4a569b6dd1608d8956b8 Aug 24 10:18:41.799094 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:41.799094 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:18:41.799094 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:18:41.800685 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d30703728b2a4a569b6dd1608d8956b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d30703728b2a4a569b6dd1608d8956b8", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d30703728b2a4a569b6dd1608d8956b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d30703728b2a4a569b6dd1608d8956b8"}]}] Aug 24 10:18:41.800685 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:41.800685 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d30703728b2a4a569b6dd1608d8956b8 Aug 24 10:18:41.800685 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesTestJSON-1542816385 Aug 24 10:18:41.800685 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesTestJSON-1542816385-project Aug 24 10:18:41.800685 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:18:41.800685 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:18:41.800685 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 85db443623964ed381b2a4cfc7310202 Aug 24 10:18:41.800685 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesTestJSON-1542816385-project Aug 24 10:18:41.800685 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:18:41.800685 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab could not be found. Aug 24 10:18:41.800685 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '7953a2dc-785d-4cb0-a4ee-8bd420fc6fab'} Aug 24 10:18:41.801549 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:18:41.801549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:41.801549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:18:41.801549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:18:41.801549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:18:41.801549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:18:41.801549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:18:41.801549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:18:41.801549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:18:41.801549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:18:41.801549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab could not be found. Aug 24 10:18:41.801549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.801549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:41.801549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.801549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:41.801549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:41.801549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:41.801549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:18:41.801549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:18:41.801549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:18:41.803039 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:18:41.803039 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:18:41.803039 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:18:41.803039 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:18:41.803039 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:18:41.803039 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:18:41.803039 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:18:41.803039 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab could not be found. Aug 24 10:18:41.803039 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.803039 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:41.803039 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.803039 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:41.803039 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:41.803039 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:41.803039 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:18:41.803039 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:18:41.803039 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab could not be found. Aug 24 10:18:41.803039 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:41.804402 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-870c660d-a962-4073-b144-fce3c3ca01c0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] Returning 404 to user: Instance 7953a2dc-785d-4cb0-a4ee-8bd420fc6fab could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:18:41.804402 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-870c660d-a962-4073-b144-fce3c3ca01c0 tempest-ImagesTestJSON-1542816385 tempest-ImagesTestJSON-1542816385-project] 10.222.0.85 "GET /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab" status: 404 len: 111 microversion: 2.1 time: 0.032272 Aug 24 10:18:41.804808 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 917/1689] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:41 2022] GET /compute/v2.1/servers/7953a2dc-785d-4cb0-a4ee-8bd420fc6fab => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:18:41.922658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-4a9222ed-3564-42c8-8748-65cda0ef2fb1 req-e5495a7b-ad05-44c9-8419-155b2a2b287c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35c8116a-830a-4f60-9d70-34eacd719c08", "name": "network-vif-deleted", "tag": "6676526f-444f-4a1b-94b1-f417a9a55ffa"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:41.938167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4a9222ed-3564-42c8-8748-65cda0ef2fb1 req-e5495a7b-ad05-44c9-8419-155b2a2b287c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:41.939010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4a9222ed-3564-42c8-8748-65cda0ef2fb1 req-e5495a7b-ad05-44c9-8419-155b2a2b287c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:41.940980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4a9222ed-3564-42c8-8748-65cda0ef2fb1 req-e5495a7b-ad05-44c9-8419-155b2a2b287c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:41.965606 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-4a9222ed-3564-42c8-8748-65cda0ef2fb1 req-e5495a7b-ad05-44c9-8419-155b2a2b287c service nova] Creating event network-vif-deleted:6676526f-444f-4a1b-94b1-f417a9a55ffa for instance 35c8116a-830a-4f60-9d70-34eacd719c08 on n-h2-849328-3 Aug 24 10:18:41.974330 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-4a9222ed-3564-42c8-8748-65cda0ef2fb1 req-e5495a7b-ad05-44c9-8419-155b2a2b287c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058884 Aug 24 10:18:41.975130 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 918/1690] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:41.979665 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-05e177ac-0108-48b2-811a-6816dd110e14 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cfea45817848c5b0d3e20087d60d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1d41b854f94d67be99f5926a96376c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:41.998539 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-05e177ac-0108-48b2-811a-6816dd110e14 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4" status: 200 len: 1394 microversion: 2.1 time: 0.306201 Aug 24 10:18:41.999581 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 773/1691] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:41 2022] GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 => generated 1394 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:42.036734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d7c65854-f3b6-4282-bb94-421020c55a53 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:42.038100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d7c65854-f3b6-4282-bb94-421020c55a53 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:42.049556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7c65854-f3b6-4282-bb94-421020c55a53 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:42.050522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7c65854-f3b6-4282-bb94-421020c55a53 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:42.051385 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7c65854-f3b6-4282-bb94-421020c55a53 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:42.052772 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7c65854-f3b6-4282-bb94-421020c55a53 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:42.053684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7c65854-f3b6-4282-bb94-421020c55a53 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:42.054404 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7c65854-f3b6-4282-bb94-421020c55a53 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:42.147597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d7c65854-f3b6-4282-bb94-421020c55a53 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:42.159285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d7c65854-f3b6-4282-bb94-421020c55a53 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:42.163488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d7c65854-f3b6-4282-bb94-421020c55a53 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:42.164784 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d7c65854-f3b6-4282-bb94-421020c55a53 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1266 microversion: 2.25 time: 0.134222 Aug 24 10:18:42.166110 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 919/1692] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:42 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1266 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:42.309014 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3887313f-3b5f-4c68-914e-e31d74f79b79 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:42.310991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3887313f-3b5f-4c68-914e-e31d74f79b79 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:42.318399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3887313f-3b5f-4c68-914e-e31d74f79b79 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:42.319287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3887313f-3b5f-4c68-914e-e31d74f79b79 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:42.319996 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3887313f-3b5f-4c68-914e-e31d74f79b79 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:42.321144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3887313f-3b5f-4c68-914e-e31d74f79b79 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:42.321862 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3887313f-3b5f-4c68-914e-e31d74f79b79 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:42.322505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3887313f-3b5f-4c68-914e-e31d74f79b79 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:42.569060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:42.570397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=10 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:42.575796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bc31165b-51aa-4616-8e7c-7a31ed102d26 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:42.576714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bc31165b-51aa-4616-8e7c-7a31ed102d26 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:42.584038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc31165b-51aa-4616-8e7c-7a31ed102d26 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:42.584680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc31165b-51aa-4616-8e7c-7a31ed102d26 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:42.585237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc31165b-51aa-4616-8e7c-7a31ed102d26 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:42.586364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc31165b-51aa-4616-8e7c-7a31ed102d26 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:42.586989 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc31165b-51aa-4616-8e7c-7a31ed102d26 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:42.587593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc31165b-51aa-4616-8e7c-7a31ed102d26 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:42.735515 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3887313f-3b5f-4c68-914e-e31d74f79b79 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:42.748763 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3887313f-3b5f-4c68-914e-e31d74f79b79 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 200 len: 1529 microversion: 2.1 time: 0.445904 Aug 24 10:18:42.750666 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 774/1693] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:42 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 1529 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:42.756703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-cc2eb0b1-ffea-417a-9c78-d0029787e2ec req-ff62acc4-57ca-4884-b422-3e4e46e69413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b390fef-6be9-4e24-b31e-b6f6252c88c1", "name": "network-vif-plugged", "status": "completed", "tag": "50041625-3e09-4ff3-9bab-8be84832b786"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:42.770613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cc2eb0b1-ffea-417a-9c78-d0029787e2ec req-ff62acc4-57ca-4884-b422-3e4e46e69413 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:42.771454 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cc2eb0b1-ffea-417a-9c78-d0029787e2ec req-ff62acc4-57ca-4884-b422-3e4e46e69413 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:42.772746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cc2eb0b1-ffea-417a-9c78-d0029787e2ec req-ff62acc4-57ca-4884-b422-3e4e46e69413 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:42.787923 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-cc2eb0b1-ffea-417a-9c78-d0029787e2ec req-ff62acc4-57ca-4884-b422-3e4e46e69413 service nova] Creating event network-vif-plugged:50041625-3e09-4ff3-9bab-8be84832b786 for instance 6b390fef-6be9-4e24-b31e-b6f6252c88c1 on n-h2-849328-3 Aug 24 10:18:42.797182 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-cc2eb0b1-ffea-417a-9c78-d0029787e2ec req-ff62acc4-57ca-4884-b422-3e4e46e69413 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044436 Aug 24 10:18:42.798002 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 775/1694] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:42.802999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bc31165b-51aa-4616-8e7c-7a31ed102d26 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:42.806275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-351b8151-c3c5-42e6-93ff-e02eeaa48d68 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:42.807001 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-351b8151-c3c5-42e6-93ff-e02eeaa48d68 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:42.814875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-351b8151-c3c5-42e6-93ff-e02eeaa48d68 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:42.815424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-351b8151-c3c5-42e6-93ff-e02eeaa48d68 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:42.815985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-351b8151-c3c5-42e6-93ff-e02eeaa48d68 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:42.816757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-351b8151-c3c5-42e6-93ff-e02eeaa48d68 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:42.817248 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-351b8151-c3c5-42e6-93ff-e02eeaa48d68 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:42.817709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-351b8151-c3c5-42e6-93ff-e02eeaa48d68 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:42.823643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bc31165b-51aa-4616-8e7c-7a31ed102d26 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:42.848367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bc31165b-51aa-4616-8e7c-7a31ed102d26 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:42.853893 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bc31165b-51aa-4616-8e7c-7a31ed102d26 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1874 microversion: 2.32 time: 0.285562 Aug 24 10:18:42.858299 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 920/1695] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:42 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1874 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:42.866378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-10d6bf40-071e-48ab-9f0a-aebac53d8ae5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:42.869242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-10d6bf40-071e-48ab-9f0a-aebac53d8ae5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:42.880381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10d6bf40-071e-48ab-9f0a-aebac53d8ae5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:42.880886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10d6bf40-071e-48ab-9f0a-aebac53d8ae5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:42.881370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10d6bf40-071e-48ab-9f0a-aebac53d8ae5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:42.882114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10d6bf40-071e-48ab-9f0a-aebac53d8ae5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:42.882569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10d6bf40-071e-48ab-9f0a-aebac53d8ae5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:42.883000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10d6bf40-071e-48ab-9f0a-aebac53d8ae5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:42.927870 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-10d6bf40-071e-48ab-9f0a-aebac53d8ae5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:18:43.026478 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-10d6bf40-071e-48ab-9f0a-aebac53d8ae5 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "DELETE /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 204 len: 0 microversion: 2.1 time: 0.166471 Aug 24 10:18:43.027928 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 921/1696] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:18:42 2022] DELETE /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:18:43.033793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c44d1781-58f9-470d-9402-097793da49bc tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:43.034854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c44d1781-58f9-470d-9402-097793da49bc tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] [instance: 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:43.042367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c44d1781-58f9-470d-9402-097793da49bc tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:43.042873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c44d1781-58f9-470d-9402-097793da49bc tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:43.043282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c44d1781-58f9-470d-9402-097793da49bc tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:43.044005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c44d1781-58f9-470d-9402-097793da49bc tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:43.044464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c44d1781-58f9-470d-9402-097793da49bc tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:43.045059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c44d1781-58f9-470d-9402-097793da49bc tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:43.048608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:43.142568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:43.245649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c44d1781-58f9-470d-9402-097793da49bc tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cfea45817848c5b0d3e20087d60d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1d41b854f94d67be99f5926a96376c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:43.255279 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c44d1781-58f9-470d-9402-097793da49bc tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4" status: 200 len: 1394 microversion: 2.1 time: 0.225790 Aug 24 10:18:43.256144 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 922/1697] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:43 2022] GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 => generated 1394 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:43.261085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c78d9fef-acc7-4942-b7db-dd57f38f7d45 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:43.261736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c78d9fef-acc7-4942-b7db-dd57f38f7d45 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:43.268813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c78d9fef-acc7-4942-b7db-dd57f38f7d45 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:43.269293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c78d9fef-acc7-4942-b7db-dd57f38f7d45 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:43.269809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c78d9fef-acc7-4942-b7db-dd57f38f7d45 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:43.270766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c78d9fef-acc7-4942-b7db-dd57f38f7d45 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:43.271222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c78d9fef-acc7-4942-b7db-dd57f38f7d45 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:43.271648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c78d9fef-acc7-4942-b7db-dd57f38f7d45 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:43.440042 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-351b8151-c3c5-42e6-93ff-e02eeaa48d68 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:43.464075 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-351b8151-c3c5-42e6-93ff-e02eeaa48d68 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1477 microversion: 2.1 time: 0.663490 Aug 24 10:18:43.479737 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 776/1698] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:42 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1477 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:43.503039 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-01e7095a-0719-449b-b648-ce43cd215e90 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:43.506800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-01e7095a-0719-449b-b648-ce43cd215e90 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:43.524875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01e7095a-0719-449b-b648-ce43cd215e90 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:43.529706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01e7095a-0719-449b-b648-ce43cd215e90 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:43.530922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01e7095a-0719-449b-b648-ce43cd215e90 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:43.534482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01e7095a-0719-449b-b648-ce43cd215e90 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:43.535257 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01e7095a-0719-449b-b648-ce43cd215e90 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:43.535989 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01e7095a-0719-449b-b648-ce43cd215e90 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:43.550679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c78d9fef-acc7-4942-b7db-dd57f38f7d45 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:43.567930 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c78d9fef-acc7-4942-b7db-dd57f38f7d45 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1466 microversion: 2.1 time: 0.310473 Aug 24 10:18:43.579186 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 923/1699] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:43 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1466 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:43.679428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-01e7095a-0719-449b-b648-ce43cd215e90 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:43.702422 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-01e7095a-0719-449b-b648-ce43cd215e90 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:43.707138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-01e7095a-0719-449b-b648-ce43cd215e90 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:43.708636 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-01e7095a-0719-449b-b648-ce43cd215e90 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1266 microversion: 2.25 time: 0.226828 Aug 24 10:18:43.725097 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 777/1700] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:43 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:43.782737 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8210a971-b72a-4fb6-bdb6-412a472e565a tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:43.783448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8210a971-b72a-4fb6-bdb6-412a472e565a tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:43.783866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-be5db217-697a-4b1d-95a4-98ce747ecc82 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:43.790173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8210a971-b72a-4fb6-bdb6-412a472e565a tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:43.791085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8210a971-b72a-4fb6-bdb6-412a472e565a tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:43.792218 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8210a971-b72a-4fb6-bdb6-412a472e565a tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:43.793165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8210a971-b72a-4fb6-bdb6-412a472e565a tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:43.793807 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8210a971-b72a-4fb6-bdb6-412a472e565a tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:43.794616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8210a971-b72a-4fb6-bdb6-412a472e565a tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:43.799254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-be5db217-697a-4b1d-95a4-98ce747ecc82 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:43.828464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be5db217-697a-4b1d-95a4-98ce747ecc82 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:43.830422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be5db217-697a-4b1d-95a4-98ce747ecc82 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:43.831299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be5db217-697a-4b1d-95a4-98ce747ecc82 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:43.832531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be5db217-697a-4b1d-95a4-98ce747ecc82 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:43.833324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be5db217-697a-4b1d-95a4-98ce747ecc82 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:43.834000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be5db217-697a-4b1d-95a4-98ce747ecc82 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:44.013444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-be5db217-697a-4b1d-95a4-98ce747ecc82 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:44.022880 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-be5db217-697a-4b1d-95a4-98ce747ecc82 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 200 len: 1529 microversion: 2.1 time: 0.249298 Aug 24 10:18:44.024150 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 924/1701] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:43 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 1529 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:44.029801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-decb203f-0430-4ceb-a4b4-9d273dd7aaa0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:44.030537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-decb203f-0430-4ceb-a4b4-9d273dd7aaa0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:44.038195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-decb203f-0430-4ceb-a4b4-9d273dd7aaa0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:44.038683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-decb203f-0430-4ceb-a4b4-9d273dd7aaa0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:44.039114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-decb203f-0430-4ceb-a4b4-9d273dd7aaa0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:44.039811 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-decb203f-0430-4ceb-a4b4-9d273dd7aaa0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:44.040388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-decb203f-0430-4ceb-a4b4-9d273dd7aaa0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:44.040815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-decb203f-0430-4ceb-a4b4-9d273dd7aaa0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:44.322137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-decb203f-0430-4ceb-a4b4-9d273dd7aaa0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:44.337454 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8210a971-b72a-4fb6-bdb6-412a472e565a tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1811 microversion: 2.1 time: 0.556888 Aug 24 10:18:44.343770 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 778/1702] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:43 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1811 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:18:44.347265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-decb203f-0430-4ceb-a4b4-9d273dd7aaa0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:44.349456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-decb203f-0430-4ceb-a4b4-9d273dd7aaa0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:44.351481 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-decb203f-0430-4ceb-a4b4-9d273dd7aaa0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1874 microversion: 2.32 time: 0.326212 Aug 24 10:18:44.353198 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 925/1703] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:44 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1874 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:44.363512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6d5f3fa5-9140-4804-af6a-638b010c75a9 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:44.365201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6d5f3fa5-9140-4804-af6a-638b010c75a9 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] [instance: 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:44.379532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-846317f2-5359-46af-bd49-d53defbea456 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:44.382840 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:18:44.382840 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:18:44.384353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-846317f2-5359-46af-bd49-d53defbea456 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:44.384884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d5f3fa5-9140-4804-af6a-638b010c75a9 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:44.385024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-846317f2-5359-46af-bd49-d53defbea456 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:44.385432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d5f3fa5-9140-4804-af6a-638b010c75a9 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:44.385567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-846317f2-5359-46af-bd49-d53defbea456 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:44.385843 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d5f3fa5-9140-4804-af6a-638b010c75a9 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:44.386439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-846317f2-5359-46af-bd49-d53defbea456 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:44.386572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d5f3fa5-9140-4804-af6a-638b010c75a9 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:44.386965 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-846317f2-5359-46af-bd49-d53defbea456 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:44.387088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d5f3fa5-9140-4804-af6a-638b010c75a9 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:44.387389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d5f3fa5-9140-4804-af6a-638b010c75a9 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:44.387498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-846317f2-5359-46af-bd49-d53defbea456 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:44.423357 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-846317f2-5359-46af-bd49-d53defbea456 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] 10.222.0.85 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.049331 Aug 24 10:18:44.425836 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 926/1704] 10.222.0.85 () {58 vars in 1176 bytes} [Wed Aug 24 10:18:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:44.503508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ac3d252-7377-4633-939b-b8c1732b6248 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:44.504335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3ac3d252-7377-4633-939b-b8c1732b6248 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:44.516995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ac3d252-7377-4633-939b-b8c1732b6248 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:44.519560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ac3d252-7377-4633-939b-b8c1732b6248 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:44.519560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ac3d252-7377-4633-939b-b8c1732b6248 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:44.519560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ac3d252-7377-4633-939b-b8c1732b6248 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:44.520356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ac3d252-7377-4633-939b-b8c1732b6248 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:44.521444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ac3d252-7377-4633-939b-b8c1732b6248 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:44.771691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6d5f3fa5-9140-4804-af6a-638b010c75a9 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cfea45817848c5b0d3e20087d60d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1d41b854f94d67be99f5926a96376c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:44.772425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3ac3d252-7377-4633-939b-b8c1732b6248 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:44.786164 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6d5f3fa5-9140-4804-af6a-638b010c75a9 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4" status: 200 len: 1394 microversion: 2.1 time: 0.440634 Aug 24 10:18:44.786803 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 779/1705] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:44 2022] GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 => generated 1394 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:44.787841 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ac3d252-7377-4633-939b-b8c1732b6248 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1477 microversion: 2.1 time: 0.291067 Aug 24 10:18:44.791860 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-91edfb78-527d-44c0-a2e6-65254764978c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:44.792513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-91edfb78-527d-44c0-a2e6-65254764978c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:44.802640 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 927/1706] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:44 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1477 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:44.822207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91edfb78-527d-44c0-a2e6-65254764978c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:44.822711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91edfb78-527d-44c0-a2e6-65254764978c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:44.824185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91edfb78-527d-44c0-a2e6-65254764978c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:44.825179 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91edfb78-527d-44c0-a2e6-65254764978c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:44.826027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91edfb78-527d-44c0-a2e6-65254764978c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:44.826231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ff7e8bc-c2ee-4126-9c6a-8efade80709a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:44.826675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91edfb78-527d-44c0-a2e6-65254764978c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:44.827444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3ff7e8bc-c2ee-4126-9c6a-8efade80709a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:44.838506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ff7e8bc-c2ee-4126-9c6a-8efade80709a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:44.839420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ff7e8bc-c2ee-4126-9c6a-8efade80709a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:44.839812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ff7e8bc-c2ee-4126-9c6a-8efade80709a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:44.848591 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ff7e8bc-c2ee-4126-9c6a-8efade80709a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:44.850109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ff7e8bc-c2ee-4126-9c6a-8efade80709a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:44.851105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ff7e8bc-c2ee-4126-9c6a-8efade80709a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:44.980743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3ff7e8bc-c2ee-4126-9c6a-8efade80709a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:45.000029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3ff7e8bc-c2ee-4126-9c6a-8efade80709a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:45.003823 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3ff7e8bc-c2ee-4126-9c6a-8efade80709a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:45.006146 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ff7e8bc-c2ee-4126-9c6a-8efade80709a tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1266 microversion: 2.25 time: 0.194381 Aug 24 10:18:45.008161 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 928/1707] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:44 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:45.021540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-5902f4ba-5e81-4941-9d2f-187dc0423ec3 req-6a930440-0378-4ba9-b910-f0d61f1c88ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2ed58ac-b16a-4f31-9394-f65217aea1d3", "name": "network-vif-unplugged", "status": "completed", "tag": "6dbf42f1-fa54-4f7f-9f8b-ff03fe2fd957"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:45.051846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5902f4ba-5e81-4941-9d2f-187dc0423ec3 req-6a930440-0378-4ba9-b910-f0d61f1c88ba service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:45.052733 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5902f4ba-5e81-4941-9d2f-187dc0423ec3 req-6a930440-0378-4ba9-b910-f0d61f1c88ba service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:45.053934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5902f4ba-5e81-4941-9d2f-187dc0423ec3 req-6a930440-0378-4ba9-b910-f0d61f1c88ba service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:45.080492 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-5902f4ba-5e81-4941-9d2f-187dc0423ec3 req-6a930440-0378-4ba9-b910-f0d61f1c88ba service nova] Creating event network-vif-unplugged:6dbf42f1-fa54-4f7f-9f8b-ff03fe2fd957 for instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 on n-h1-849328-3 Aug 24 10:18:45.092330 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-5902f4ba-5e81-4941-9d2f-187dc0423ec3 req-6a930440-0378-4ba9-b910-f0d61f1c88ba service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081049 Aug 24 10:18:45.093669 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 929/1708] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:45.104749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1aef0fb0-b8cc-4c73-a7e5-4d4652a205e3 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:45.106892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1aef0fb0-b8cc-4c73-a7e5-4d4652a205e3 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:45.120398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aef0fb0-b8cc-4c73-a7e5-4d4652a205e3 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:45.121387 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aef0fb0-b8cc-4c73-a7e5-4d4652a205e3 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:45.122527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aef0fb0-b8cc-4c73-a7e5-4d4652a205e3 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:45.123689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aef0fb0-b8cc-4c73-a7e5-4d4652a205e3 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:45.124781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aef0fb0-b8cc-4c73-a7e5-4d4652a205e3 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:45.125642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aef0fb0-b8cc-4c73-a7e5-4d4652a205e3 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:45.448002 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1aef0fb0-b8cc-4c73-a7e5-4d4652a205e3 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:45.479786 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1aef0fb0-b8cc-4c73-a7e5-4d4652a205e3 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 200 len: 1529 microversion: 2.1 time: 0.382933 Aug 24 10:18:45.481335 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 930/1709] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:45 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 1529 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:45.517070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b1245ecd-e34c-48ee-b88c-9c355cbe8077 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:45.519547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b1245ecd-e34c-48ee-b88c-9c355cbe8077 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:45.547797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1245ecd-e34c-48ee-b88c-9c355cbe8077 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:45.549470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1245ecd-e34c-48ee-b88c-9c355cbe8077 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:45.550712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1245ecd-e34c-48ee-b88c-9c355cbe8077 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:45.558018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1245ecd-e34c-48ee-b88c-9c355cbe8077 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:45.561372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1245ecd-e34c-48ee-b88c-9c355cbe8077 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:45.562509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1245ecd-e34c-48ee-b88c-9c355cbe8077 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:45.734403 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-91edfb78-527d-44c0-a2e6-65254764978c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:45.767741 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-91edfb78-527d-44c0-a2e6-65254764978c tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1466 microversion: 2.1 time: 0.972571 Aug 24 10:18:45.782155 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 780/1710] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:44 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1466 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:45.831827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e4f496a9-6b84-4788-a5a2-b9dd7174a48f tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:45.834424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e4f496a9-6b84-4788-a5a2-b9dd7174a48f tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] [instance: 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:45.865236 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4f496a9-6b84-4788-a5a2-b9dd7174a48f tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:45.878413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4f496a9-6b84-4788-a5a2-b9dd7174a48f tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:45.879251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4f496a9-6b84-4788-a5a2-b9dd7174a48f tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:45.880611 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4f496a9-6b84-4788-a5a2-b9dd7174a48f tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:45.881456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4f496a9-6b84-4788-a5a2-b9dd7174a48f tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:45.882214 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4f496a9-6b84-4788-a5a2-b9dd7174a48f tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:46.090257 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b1245ecd-e34c-48ee-b88c-9c355cbe8077 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:46.130191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b1245ecd-e34c-48ee-b88c-9c355cbe8077 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:46.147158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b1245ecd-e34c-48ee-b88c-9c355cbe8077 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:46.154961 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b1245ecd-e34c-48ee-b88c-9c355cbe8077 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1874 microversion: 2.32 time: 0.670980 Aug 24 10:18:46.158972 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 931/1711] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:45 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1874 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:46.193553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb99182f-0025-4488-b911-55baf7c7dc0d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:46.206382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cb99182f-0025-4488-b911-55baf7c7dc0d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:46.234706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb99182f-0025-4488-b911-55baf7c7dc0d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:46.241912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb99182f-0025-4488-b911-55baf7c7dc0d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:46.247437 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb99182f-0025-4488-b911-55baf7c7dc0d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:46.254312 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb99182f-0025-4488-b911-55baf7c7dc0d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:46.257539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb99182f-0025-4488-b911-55baf7c7dc0d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:46.262748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb99182f-0025-4488-b911-55baf7c7dc0d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:46.774575 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cb99182f-0025-4488-b911-55baf7c7dc0d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:46.787830 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cb99182f-0025-4488-b911-55baf7c7dc0d tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1462 microversion: 2.1 time: 0.620632 Aug 24 10:18:46.790299 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 932/1712] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:46 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1462 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:46.802809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-137e26f2-eae1-45ee-868d-2d6afcf48e5c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:46.806222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-137e26f2-eae1-45ee-868d-2d6afcf48e5c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:46.831676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-137e26f2-eae1-45ee-868d-2d6afcf48e5c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:46.832746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-137e26f2-eae1-45ee-868d-2d6afcf48e5c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:46.836285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-137e26f2-eae1-45ee-868d-2d6afcf48e5c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:46.839733 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-137e26f2-eae1-45ee-868d-2d6afcf48e5c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:46.843775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-137e26f2-eae1-45ee-868d-2d6afcf48e5c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:46.845756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-137e26f2-eae1-45ee-868d-2d6afcf48e5c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:46.895196 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-137e26f2-eae1-45ee-868d-2d6afcf48e5c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:46.895946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-137e26f2-eae1-45ee-868d-2d6afcf48e5c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:46.897572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-137e26f2-eae1-45ee-868d-2d6afcf48e5c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:46.898420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-137e26f2-eae1-45ee-868d-2d6afcf48e5c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lazy-loading 'fault' on Instance uuid 0e607951-c58f-41ce-bb92-a9399d534b2b {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:18:46.905589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e4f496a9-6b84-4788-a5a2-b9dd7174a48f tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cfea45817848c5b0d3e20087d60d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1d41b854f94d67be99f5926a96376c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:46.923643 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e4f496a9-6b84-4788-a5a2-b9dd7174a48f tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4" status: 200 len: 1394 microversion: 2.1 time: 1.101442 Aug 24 10:18:46.924983 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 781/1713] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:45 2022] GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 => generated 1394 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:46.930357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-26a68b39-30d8-4f71-9a41-56fba38ef875 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:46.932375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-26a68b39-30d8-4f71-9a41-56fba38ef875 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:46.940092 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26a68b39-30d8-4f71-9a41-56fba38ef875 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:46.941298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26a68b39-30d8-4f71-9a41-56fba38ef875 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:46.942090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26a68b39-30d8-4f71-9a41-56fba38ef875 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:46.942988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26a68b39-30d8-4f71-9a41-56fba38ef875 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:46.943601 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26a68b39-30d8-4f71-9a41-56fba38ef875 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:46.944258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26a68b39-30d8-4f71-9a41-56fba38ef875 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:47.039825 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-137e26f2-eae1-45ee-868d-2d6afcf48e5c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:47.073587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-137e26f2-eae1-45ee-868d-2d6afcf48e5c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:47.076490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-137e26f2-eae1-45ee-868d-2d6afcf48e5c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:47.078104 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-137e26f2-eae1-45ee-868d-2d6afcf48e5c tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 200 len: 1271 microversion: 2.25 time: 0.285861 Aug 24 10:18:47.093167 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 933/1714] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:46 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 1271 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:47.109153 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e68d7ab5-a823-4f83-ba4b-6d5041747597 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:47.109153 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e68d7ab5-a823-4f83-ba4b-6d5041747597 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:47.118016 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e68d7ab5-a823-4f83-ba4b-6d5041747597 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:47.119466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e68d7ab5-a823-4f83-ba4b-6d5041747597 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:47.119777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e68d7ab5-a823-4f83-ba4b-6d5041747597 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:47.130347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e68d7ab5-a823-4f83-ba4b-6d5041747597 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:47.130974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e68d7ab5-a823-4f83-ba4b-6d5041747597 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:47.140338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e68d7ab5-a823-4f83-ba4b-6d5041747597 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:47.328945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e68d7ab5-a823-4f83-ba4b-6d5041747597 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:47.345989 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e68d7ab5-a823-4f83-ba4b-6d5041747597 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 200 len: 1424 microversion: 2.1 time: 0.265059 Aug 24 10:18:47.346400 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 934/1715] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:47 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 1424 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:47.383672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9106b232-2c78-46bf-aa15-6052e3c4f5ec tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:47.413113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9106b232-2c78-46bf-aa15-6052e3c4f5ec tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:47.440969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9106b232-2c78-46bf-aa15-6052e3c4f5ec tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:47.442923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9106b232-2c78-46bf-aa15-6052e3c4f5ec tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:47.461905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9106b232-2c78-46bf-aa15-6052e3c4f5ec tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:47.462685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9106b232-2c78-46bf-aa15-6052e3c4f5ec tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:47.463154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9106b232-2c78-46bf-aa15-6052e3c4f5ec tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:47.463580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9106b232-2c78-46bf-aa15-6052e3c4f5ec tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:47.696510 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9106b232-2c78-46bf-aa15-6052e3c4f5ec tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1/action" status: 202 len: 0 microversion: 2.1 time: 0.325101 Aug 24 10:18:47.705685 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 935/1716] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:18:47 2022] POST /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:18:47.721810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7e71e47d-de89-4d9e-9769-566b340d034d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:47.723398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7e71e47d-de89-4d9e-9769-566b340d034d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:47.737230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-26a68b39-30d8-4f71-9a41-56fba38ef875 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:47.754262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e71e47d-de89-4d9e-9769-566b340d034d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:47.755103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e71e47d-de89-4d9e-9769-566b340d034d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:47.755835 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-26a68b39-30d8-4f71-9a41-56fba38ef875 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 200 len: 1529 microversion: 2.1 time: 0.829174 Aug 24 10:18:47.755970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e71e47d-de89-4d9e-9769-566b340d034d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:47.757081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e71e47d-de89-4d9e-9769-566b340d034d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:47.773867 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 782/1717] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:46 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 1529 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:47.775394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-348a318a-daec-4f98-bdb7-f8c3bd2a043d req-385fa884-d189-436e-a94c-52eacac03bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce6709c-548b-4bdc-9667-fa678dbeb477", "name": "network-vif-deleted", "tag": "a5c8b983-3e85-49ee-93ef-994023d0a43c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:47.789458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e71e47d-de89-4d9e-9769-566b340d034d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:47.789910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e71e47d-de89-4d9e-9769-566b340d034d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:47.813814 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-348a318a-daec-4f98-bdb7-f8c3bd2a043d req-385fa884-d189-436e-a94c-52eacac03bc1 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:47.815456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-348a318a-daec-4f98-bdb7-f8c3bd2a043d req-385fa884-d189-436e-a94c-52eacac03bc1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:47.816056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-348a318a-daec-4f98-bdb7-f8c3bd2a043d req-385fa884-d189-436e-a94c-52eacac03bc1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:47.838731 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-348a318a-daec-4f98-bdb7-f8c3bd2a043d req-385fa884-d189-436e-a94c-52eacac03bc1 service nova] Creating event network-vif-deleted:a5c8b983-3e85-49ee-93ef-994023d0a43c for instance fce6709c-548b-4bdc-9667-fa678dbeb477 on n-h1-849328-3 Aug 24 10:18:47.849386 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-348a318a-daec-4f98-bdb7-f8c3bd2a043d req-385fa884-d189-436e-a94c-52eacac03bc1 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085228 Aug 24 10:18:47.851016 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 783/1718] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:47.859685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3f8941d9-de25-41c6-a300-b33b3abe5bf5 req-fb8dfdeb-393c-43da-8777-d2a58405b172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2ed58ac-b16a-4f31-9394-f65217aea1d3", "name": "network-vif-deleted", "tag": "6dbf42f1-fa54-4f7f-9f8b-ff03fe2fd957"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:47.879557 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3f8941d9-de25-41c6-a300-b33b3abe5bf5 req-fb8dfdeb-393c-43da-8777-d2a58405b172 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:47.899831 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3f8941d9-de25-41c6-a300-b33b3abe5bf5 req-fb8dfdeb-393c-43da-8777-d2a58405b172 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:47.900630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3f8941d9-de25-41c6-a300-b33b3abe5bf5 req-fb8dfdeb-393c-43da-8777-d2a58405b172 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:47.914438 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3f8941d9-de25-41c6-a300-b33b3abe5bf5 req-fb8dfdeb-393c-43da-8777-d2a58405b172 service nova] Creating event network-vif-deleted:6dbf42f1-fa54-4f7f-9f8b-ff03fe2fd957 for instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 on n-h1-849328-3 Aug 24 10:18:47.920247 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3f8941d9-de25-41c6-a300-b33b3abe5bf5 req-fb8dfdeb-393c-43da-8777-d2a58405b172 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067339 Aug 24 10:18:47.921387 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 784/1719] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:47.928439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ba31dcbc-263a-4d30-9932-539abe613eaa tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:47.929483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ba31dcbc-263a-4d30-9932-539abe613eaa tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:47.937876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba31dcbc-263a-4d30-9932-539abe613eaa tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:47.938651 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba31dcbc-263a-4d30-9932-539abe613eaa tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:47.939265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba31dcbc-263a-4d30-9932-539abe613eaa tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:47.941425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba31dcbc-263a-4d30-9932-539abe613eaa tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:47.942073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba31dcbc-263a-4d30-9932-539abe613eaa tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:47.942663 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba31dcbc-263a-4d30-9932-539abe613eaa tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:47.984380 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba31dcbc-263a-4d30-9932-539abe613eaa tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:47.984872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba31dcbc-263a-4d30-9932-539abe613eaa tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:47.985408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba31dcbc-263a-4d30-9932-539abe613eaa tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:47.986219 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-ba31dcbc-263a-4d30-9932-539abe613eaa tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lazy-loading 'fault' on Instance uuid 6b390fef-6be9-4e24-b31e-b6f6252c88c1 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:18:48.146172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7e71e47d-de89-4d9e-9769-566b340d034d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:48.156391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7e71e47d-de89-4d9e-9769-566b340d034d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:48.157974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7e71e47d-de89-4d9e-9769-566b340d034d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:48.159167 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7e71e47d-de89-4d9e-9769-566b340d034d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1874 microversion: 2.32 time: 0.451996 Aug 24 10:18:48.173228 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 936/1720] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:47 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1874 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:48.177464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d5b103d1-4a5f-41c9-a9be-02850c8dfa62 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:48.178546 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d5b103d1-4a5f-41c9-a9be-02850c8dfa62 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] [instance: 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:48.181033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:48.192995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5b103d1-4a5f-41c9-a9be-02850c8dfa62 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:48.193824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5b103d1-4a5f-41c9-a9be-02850c8dfa62 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:48.194696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5b103d1-4a5f-41c9-a9be-02850c8dfa62 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:48.195931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5b103d1-4a5f-41c9-a9be-02850c8dfa62 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:48.196809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5b103d1-4a5f-41c9-a9be-02850c8dfa62 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:48.197626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5b103d1-4a5f-41c9-a9be-02850c8dfa62 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:48.426733 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d5b103d1-4a5f-41c9-a9be-02850c8dfa62 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cfea45817848c5b0d3e20087d60d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1d41b854f94d67be99f5926a96376c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:48.439088 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d5b103d1-4a5f-41c9-a9be-02850c8dfa62 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4" status: 200 len: 1394 microversion: 2.1 time: 0.277823 Aug 24 10:18:48.453365 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 937/1721] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:48 2022] GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 => generated 1394 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:48.458690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5bec58e0-80e7-4738-9452-d125223c1821 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:48.459441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5bec58e0-80e7-4738-9452-d125223c1821 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 0e607951-c58f-41ce-bb92-a9399d534b2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:48.466068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5bec58e0-80e7-4738-9452-d125223c1821 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:48.466964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5bec58e0-80e7-4738-9452-d125223c1821 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:48.467682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5bec58e0-80e7-4738-9452-d125223c1821 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:48.468805 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5bec58e0-80e7-4738-9452-d125223c1821 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:48.469572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5bec58e0-80e7-4738-9452-d125223c1821 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:48.470229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5bec58e0-80e7-4738-9452-d125223c1821 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:48.475351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:48.488157 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-5bec58e0-80e7-4738-9452-d125223c1821 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] HTTP exception thrown: Instance 0e607951-c58f-41ce-bb92-a9399d534b2b could not be found. Aug 24 10:18:48.490533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5bec58e0-80e7-4738-9452-d125223c1821 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Request method failure captured: Aug 24 10:18:48.490533 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b HTTP/1.1 Aug 24 10:18:48.490533 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:18:48.490533 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:18:48.490533 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:18:48.490533 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:18:48.490533 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:18:48.490533 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:18:48.490533 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:18:48.490533 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:18:48.490533 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfldrKdWWwgO0XW__bQAWjGC52fxRL20rk6I6t2eKmY9-12ECHIqc8L1_2OEYmTV_PZU72KFY-HhmZUBgc7KK3rbu1N_1aNl-LGrcsfLFCQiOsVapHVjHI0UqR9nLYtVZhzlpA1soVu1vQGcsoRjo9Bj89t0F8yT-rvJOZDsorNLGJQ Aug 24 10:18:48.490533 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:18:48.490533 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:18:48.490533 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:18:48.490533 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:18:48.490533 n-d-849328-3 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.25 Aug 24 10:18:48.490533 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:18:48.490533 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:18:48.490533 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 34b2b8fc487d4a6abb08f132e0f0c1da Aug 24 10:18:48.490533 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1165112608 Aug 24 10:18:48.490533 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:18:48.490533 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:18:48.492176 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/34b2b8fc487d4a6abb08f132e0f0c1da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_34b2b8fc487d4a6abb08f132e0f0c1da", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/34b2b8fc487d4a6abb08f132e0f0c1da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/34b2b8fc487d4a6abb08f132e0f0c1da"}]}] Aug 24 10:18:48.492176 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1165112608 Aug 24 10:18:48.492176 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 34b2b8fc487d4a6abb08f132e0f0c1da Aug 24 10:18:48.492176 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1165112608 Aug 24 10:18:48.492176 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-LiveAutoBlockMigrationV225Test-1165112608-project Aug 24 10:18:48.492176 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:18:48.492176 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:18:48.492176 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: dfd26847179f4f2bab0c9f673de0c303 Aug 24 10:18:48.492176 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1165112608-project Aug 24 10:18:48.492176 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:18:48.492176 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 0e607951-c58f-41ce-bb92-a9399d534b2b could not be found. Aug 24 10:18:48.492176 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '0e607951-c58f-41ce-bb92-a9399d534b2b'} Aug 24 10:18:48.493076 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:18:48.493076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:48.493076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:18:48.493076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:18:48.493076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:18:48.493076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:18:48.493076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:18:48.493076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:18:48.493076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:18:48.493076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:18:48.493076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e607951-c58f-41ce-bb92-a9399d534b2b could not be found. Aug 24 10:18:48.493076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:48.493076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:48.493076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:48.493076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:48.493076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:48.493076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:48.493076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:18:48.493076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:18:48.493076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:18:48.494609 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:18:48.494609 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:18:48.494609 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:18:48.494609 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:18:48.494609 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:18:48.494609 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:18:48.494609 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:18:48.494609 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e607951-c58f-41ce-bb92-a9399d534b2b could not be found. Aug 24 10:18:48.494609 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:48.494609 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:48.494609 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:48.494609 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:48.494609 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:48.494609 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:48.494609 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:18:48.494609 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:18:48.494609 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e607951-c58f-41ce-bb92-a9399d534b2b could not be found. Aug 24 10:18:48.494609 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:48.500439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5bec58e0-80e7-4738-9452-d125223c1821 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Returning 404 to user: Instance 0e607951-c58f-41ce-bb92-a9399d534b2b could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:18:48.501657 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5bec58e0-80e7-4738-9452-d125223c1821 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b" status: 404 len: 111 microversion: 2.25 time: 0.047054 Aug 24 10:18:48.503328 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 938/1722] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:48 2022] GET /compute/v2.1/servers/0e607951-c58f-41ce-bb92-a9399d534b2b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:18:48.528649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d06505fc-fc89-40ef-9739-446cb24aa6bc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:48.534012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d06505fc-fc89-40ef-9739-446cb24aa6bc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: fce6709c-548b-4bdc-9667-fa678dbeb477] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:48.557345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d06505fc-fc89-40ef-9739-446cb24aa6bc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:48.559880 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d06505fc-fc89-40ef-9739-446cb24aa6bc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:48.560822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d06505fc-fc89-40ef-9739-446cb24aa6bc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:48.562003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d06505fc-fc89-40ef-9739-446cb24aa6bc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:48.563056 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d06505fc-fc89-40ef-9739-446cb24aa6bc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:48.563808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d06505fc-fc89-40ef-9739-446cb24aa6bc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:48.600804 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-d06505fc-fc89-40ef-9739-446cb24aa6bc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] HTTP exception thrown: Instance fce6709c-548b-4bdc-9667-fa678dbeb477 could not be found. Aug 24 10:18:48.610152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d06505fc-fc89-40ef-9739-446cb24aa6bc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Request method failure captured: Aug 24 10:18:48.610152 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 HTTP/1.1 Aug 24 10:18:48.610152 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:18:48.610152 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:18:48.610152 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:18:48.610152 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:18:48.610152 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:18:48.610152 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:18:48.610152 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:18:48.610152 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:18:48.610152 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfluf5WMhltPE0D2xS8_BGCoOmTlCH2eBEOMFIUtA9FPZZR9DZIJd_DW99E6ZcQOBcSKD-DIGSH2aRtpk3snGczsSGx7soynXHHf3GrBj4Ucp-YVsvxSTBKIshG-vRfctk2mFYBB3hYwgSuW-uej7q8PvT9aTn6fsAkXfQUykpnq6uY Aug 24 10:18:48.610152 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:18:48.610152 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:18:48.610152 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:18:48.610152 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:18:48.610152 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:18:48.610152 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:18:48.610152 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 7947a063a37946b7870e95dfd7a2e7e6 Aug 24 10:18:48.610152 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-MigrationsAdminTest-2049550965 Aug 24 10:18:48.610152 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:18:48.610152 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:18:48.611925 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/7947a063a37946b7870e95dfd7a2e7e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_7947a063a37946b7870e95dfd7a2e7e6", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/7947a063a37946b7870e95dfd7a2e7e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/7947a063a37946b7870e95dfd7a2e7e6"}]}] Aug 24 10:18:48.611925 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-MigrationsAdminTest-2049550965 Aug 24 10:18:48.611925 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 7947a063a37946b7870e95dfd7a2e7e6 Aug 24 10:18:48.611925 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-MigrationsAdminTest-2049550965 Aug 24 10:18:48.611925 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-MigrationsAdminTest-2049550965-project Aug 24 10:18:48.611925 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:18:48.611925 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:18:48.611925 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 53af167c0c744cbb910ff5860767cb95 Aug 24 10:18:48.611925 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-MigrationsAdminTest-2049550965-project Aug 24 10:18:48.611925 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:18:48.611925 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance fce6709c-548b-4bdc-9667-fa678dbeb477 could not be found. Aug 24 10:18:48.611925 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'fce6709c-548b-4bdc-9667-fa678dbeb477'} Aug 24 10:18:48.612777 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:18:48.612777 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:48.612777 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:18:48.612777 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:18:48.612777 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:18:48.612777 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:18:48.612777 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:18:48.612777 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:18:48.612777 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:18:48.612777 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:18:48.612777 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fce6709c-548b-4bdc-9667-fa678dbeb477 could not be found. Aug 24 10:18:48.612777 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:48.612777 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:48.612777 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:48.612777 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:48.612777 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:48.612777 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:48.612777 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:18:48.612777 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:18:48.612777 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:18:48.614221 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:18:48.614221 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:18:48.614221 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:18:48.614221 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:18:48.614221 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:18:48.614221 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:18:48.614221 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:18:48.614221 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fce6709c-548b-4bdc-9667-fa678dbeb477 could not be found. Aug 24 10:18:48.614221 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:48.614221 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:48.614221 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:48.614221 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:48.614221 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:48.614221 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:48.614221 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:18:48.614221 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:18:48.614221 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fce6709c-548b-4bdc-9667-fa678dbeb477 could not be found. Aug 24 10:18:48.614221 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:48.617914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d06505fc-fc89-40ef-9739-446cb24aa6bc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Returning 404 to user: Instance fce6709c-548b-4bdc-9667-fa678dbeb477 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:18:48.619211 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d06505fc-fc89-40ef-9739-446cb24aa6bc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477" status: 404 len: 111 microversion: 2.1 time: 0.114609 Aug 24 10:18:48.620386 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 939/1723] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:48 2022] GET /compute/v2.1/servers/fce6709c-548b-4bdc-9667-fa678dbeb477 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:18:48.654326 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-83b190dc-b938-486b-bacc-174a5380d3dc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:48.655076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-83b190dc-b938-486b-bacc-174a5380d3dc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:48.681075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83b190dc-b938-486b-bacc-174a5380d3dc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:48.681611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83b190dc-b938-486b-bacc-174a5380d3dc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:48.682057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83b190dc-b938-486b-bacc-174a5380d3dc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:48.683068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83b190dc-b938-486b-bacc-174a5380d3dc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:48.683527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83b190dc-b938-486b-bacc-174a5380d3dc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:48.683956 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83b190dc-b938-486b-bacc-174a5380d3dc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:48.755073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-83b190dc-b938-486b-bacc-174a5380d3dc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:18:48.959845 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-83b190dc-b938-486b-bacc-174a5380d3dc tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 204 len: 0 microversion: 2.1 time: 0.318105 Aug 24 10:18:48.960736 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 940/1724] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:18:48 2022] DELETE /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:18:48.972233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9d270555-8de6-43ad-b279-fd5208d55bcb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61038307-d000-4f73-8020-d1771d051ad4", "device": "/dev/xvdb"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:48.977648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9d270555-8de6-43ad-b279-fd5208d55bcb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:48.986146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d270555-8de6-43ad-b279-fd5208d55bcb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:48.987155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d270555-8de6-43ad-b279-fd5208d55bcb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:48.987934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d270555-8de6-43ad-b279-fd5208d55bcb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:48.989247 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d270555-8de6-43ad-b279-fd5208d55bcb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:48.990071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d270555-8de6-43ad-b279-fd5208d55bcb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:48.991726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d270555-8de6-43ad-b279-fd5208d55bcb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:49.623747 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ba31dcbc-263a-4d30-9932-539abe613eaa tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1596 microversion: 2.1 time: 1.700237 Aug 24 10:18:49.633584 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 785/1725] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:47 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1596 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:49.639612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-184a77bd-b7a1-4c41-ac55-1e4f81542169 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:49.640242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-184a77bd-b7a1-4c41-ac55-1e4f81542169 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:49.656939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-184a77bd-b7a1-4c41-ac55-1e4f81542169 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:49.657374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-184a77bd-b7a1-4c41-ac55-1e4f81542169 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:49.657995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-184a77bd-b7a1-4c41-ac55-1e4f81542169 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:49.658917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-184a77bd-b7a1-4c41-ac55-1e4f81542169 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:49.659555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-184a77bd-b7a1-4c41-ac55-1e4f81542169 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:49.660184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-184a77bd-b7a1-4c41-ac55-1e4f81542169 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:49.692824 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-184a77bd-b7a1-4c41-ac55-1e4f81542169 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] HTTP exception thrown: Instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 could not be found. Aug 24 10:18:49.700931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-184a77bd-b7a1-4c41-ac55-1e4f81542169 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Request method failure captured: Aug 24 10:18:49.700931 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 HTTP/1.1 Aug 24 10:18:49.700931 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:18:49.700931 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:18:49.700931 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:18:49.700931 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:18:49.700931 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:18:49.700931 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:18:49.700931 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:18:49.700931 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:18:49.700931 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfrThttCsJVn6ZYJ5IPHV9fokEqNFKnmNalLL8nZmf_ei5N3zrV08QH1KmLggfkmBKerwFjLosb49uBsjyVeSxt3NJxRyvR4_2es1MonVPd0vwRK6vdPZfvD2BRibktcybuLmMjpd59h5dgQc8Mlu-A4JR-WB_EJM5jyYx0kRVbI5dw Aug 24 10:18:49.700931 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:18:49.700931 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:18:49.700931 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:18:49.700931 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:18:49.700931 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:18:49.700931 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:18:49.700931 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 014076c393b148618aa03e8e8a0d5be7 Aug 24 10:18:49.700931 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:18:49.700931 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:18:49.700931 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:18:49.703376 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/014076c393b148618aa03e8e8a0d5be7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_014076c393b148618aa03e8e8a0d5be7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/014076c393b148618aa03e8e8a0d5be7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/014076c393b148618aa03e8e8a0d5be7"}]}] Aug 24 10:18:49.703376 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:18:49.703376 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 014076c393b148618aa03e8e8a0d5be7 Aug 24 10:18:49.703376 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:18:49.703376 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ImagesOneServerNegativeTestJSON-949139278-project Aug 24 10:18:49.703376 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:18:49.703376 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:18:49.703376 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: a9111f8a2bae4e25a353ebb15eca2d5a Aug 24 10:18:49.703376 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-949139278-project Aug 24 10:18:49.703376 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:18:49.703376 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 could not be found. Aug 24 10:18:49.703376 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'd2ed58ac-b16a-4f31-9394-f65217aea1d3'} Aug 24 10:18:49.704301 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:18:49.704301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:49.704301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:18:49.704301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:18:49.704301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:18:49.704301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:18:49.704301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:18:49.704301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:18:49.704301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:18:49.704301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:18:49.704301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 could not be found. Aug 24 10:18:49.704301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:49.704301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:49.704301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:49.704301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:49.704301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:49.704301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:49.704301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:18:49.704301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:18:49.704301 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:18:49.705811 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:18:49.705811 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:18:49.705811 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:18:49.705811 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:18:49.705811 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:18:49.705811 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:18:49.705811 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:18:49.705811 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 could not be found. Aug 24 10:18:49.705811 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:49.705811 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:49.705811 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:49.705811 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:49.705811 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:49.705811 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:49.705811 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:18:49.705811 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:18:49.705811 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 could not be found. Aug 24 10:18:49.705811 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:18:49.710153 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-184a77bd-b7a1-4c41-ac55-1e4f81542169 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Returning 404 to user: Instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:18:49.711520 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-184a77bd-b7a1-4c41-ac55-1e4f81542169 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 404 len: 111 microversion: 2.1 time: 0.076523 Aug 24 10:18:49.722904 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 786/1726] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:49 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:18:49.725166 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9d270555-8de6-43ad-b279-fd5208d55bcb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "POST /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.747108 Aug 24 10:18:49.737040 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 941/1727] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Aug 24 10:18:48 2022] POST /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af/os-volume_attachments => generated 194 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:49.749931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c0f19858-d480-4f7f-affd-789e00030cfd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:49.752743 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c0f19858-d480-4f7f-affd-789e00030cfd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:49.754553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-da9a746f-47d2-45bf-976c-979776ee1930 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:49.755565 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-da9a746f-47d2-45bf-976c-979776ee1930 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:49.768400 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0f19858-d480-4f7f-affd-789e00030cfd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:49.770575 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0f19858-d480-4f7f-affd-789e00030cfd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:49.771783 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da9a746f-47d2-45bf-976c-979776ee1930 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:49.772280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da9a746f-47d2-45bf-976c-979776ee1930 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:49.772751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da9a746f-47d2-45bf-976c-979776ee1930 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:49.773527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da9a746f-47d2-45bf-976c-979776ee1930 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:49.773951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da9a746f-47d2-45bf-976c-979776ee1930 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:49.774379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da9a746f-47d2-45bf-976c-979776ee1930 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:49.775269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0f19858-d480-4f7f-affd-789e00030cfd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:49.776482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0f19858-d480-4f7f-affd-789e00030cfd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:49.776999 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0f19858-d480-4f7f-affd-789e00030cfd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:49.777514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0f19858-d480-4f7f-affd-789e00030cfd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:50.161683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da9a746f-47d2-45bf-976c-979776ee1930 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:50.173036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da9a746f-47d2-45bf-976c-979776ee1930 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:50.174861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da9a746f-47d2-45bf-976c-979776ee1930 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:50.176876 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-da9a746f-47d2-45bf-976c-979776ee1930 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1874 microversion: 2.32 time: 0.436118 Aug 24 10:18:50.177942 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 942/1728] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:49 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1874 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:50.184473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-17eccbc4-2611-4de0-8c21-6044e76a3c08 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:50.185645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-17eccbc4-2611-4de0-8c21-6044e76a3c08 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] [instance: 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:50.192822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17eccbc4-2611-4de0-8c21-6044e76a3c08 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:50.193552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17eccbc4-2611-4de0-8c21-6044e76a3c08 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:50.194200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17eccbc4-2611-4de0-8c21-6044e76a3c08 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:50.195082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17eccbc4-2611-4de0-8c21-6044e76a3c08 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:50.195707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17eccbc4-2611-4de0-8c21-6044e76a3c08 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:50.196300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17eccbc4-2611-4de0-8c21-6044e76a3c08 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:50.410769 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c0f19858-d480-4f7f-affd-789e00030cfd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:50.421083 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c0f19858-d480-4f7f-affd-789e00030cfd tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1469 microversion: 2.1 time: 0.696599 Aug 24 10:18:50.422660 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 787/1729] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:49 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1469 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:50.430079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a1e31548-b4af-4f6d-b458-0942635e82bf tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:50.437770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a1e31548-b4af-4f6d-b458-0942635e82bf tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:50.443238 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-17eccbc4-2611-4de0-8c21-6044e76a3c08 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cfea45817848c5b0d3e20087d60d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1d41b854f94d67be99f5926a96376c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:50.445789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1e31548-b4af-4f6d-b458-0942635e82bf tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:50.446280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1e31548-b4af-4f6d-b458-0942635e82bf tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:50.446814 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1e31548-b4af-4f6d-b458-0942635e82bf tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:50.447733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1e31548-b4af-4f6d-b458-0942635e82bf tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:50.448350 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1e31548-b4af-4f6d-b458-0942635e82bf tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:50.448940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1e31548-b4af-4f6d-b458-0942635e82bf tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:50.457726 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-17eccbc4-2611-4de0-8c21-6044e76a3c08 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4" status: 200 len: 1394 microversion: 2.1 time: 0.278263 Aug 24 10:18:50.458688 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 943/1730] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:50 2022] GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 => generated 1394 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:50.463552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-373a97ef-dcb2-44f5-b71a-a6151c1dfd02 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Action: 'create', calling method: .version_select at 0x7f465a1b81f0>, body: {"keypair": {"name": "tempest-keypair-343863797", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwcqzamnyWVZgCszhu45co1Elmg+RGYGkTgYTgGLtPFh7USaoDeRjsuSGGGKJ+KQj0ArB8wnt4Bp6Mf0if1Jn6n/oZgRsTa5/uu5YW1WENK5YepLTqqTHmafffLjvSQ4g=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:50.524735 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-373a97ef-dcb2-44f5-b71a-a6151c1dfd02 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Getting quotas for project 014076c393b148618aa03e8e8a0d5be7. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:18:50.536677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-373a97ef-dcb2-44f5-b71a-a6151c1dfd02 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Getting quotas for user a9111f8a2bae4e25a353ebb15eca2d5a and project 014076c393b148618aa03e8e8a0d5be7. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:18:50.584330 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-373a97ef-dcb2-44f5-b71a-a6151c1dfd02 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.123350 Aug 24 10:18:50.587315 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 944/1731] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:18:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:50.617508 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a1e31548-b4af-4f6d-b458-0942635e82bf tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1/action" status: 202 len: 0 microversion: 2.1 time: 0.193674 Aug 24 10:18:50.621344 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 788/1732] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:18:50 2022] POST /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:18:50.627829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f3cede1b-fc20-4bb0-9f62-0249e62e8fbc tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:50.628719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f3cede1b-fc20-4bb0-9f62-0249e62e8fbc tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:50.646271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3cede1b-fc20-4bb0-9f62-0249e62e8fbc tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:50.648752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3cede1b-fc20-4bb0-9f62-0249e62e8fbc tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:50.652785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3cede1b-fc20-4bb0-9f62-0249e62e8fbc tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:50.653875 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3cede1b-fc20-4bb0-9f62-0249e62e8fbc tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:50.655765 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3cede1b-fc20-4bb0-9f62-0249e62e8fbc tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:50.658122 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3cede1b-fc20-4bb0-9f62-0249e62e8fbc tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:51.208098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-895d39c6-6346-4841-8260-d8c56042efc7 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:51.209230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-895d39c6-6346-4841-8260-d8c56042efc7 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:51.234128 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-895d39c6-6346-4841-8260-d8c56042efc7 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:51.244374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-895d39c6-6346-4841-8260-d8c56042efc7 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:51.244374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-895d39c6-6346-4841-8260-d8c56042efc7 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:51.250142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-895d39c6-6346-4841-8260-d8c56042efc7 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:51.251008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-895d39c6-6346-4841-8260-d8c56042efc7 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:51.251581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-895d39c6-6346-4841-8260-d8c56042efc7 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:51.547375 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f3cede1b-fc20-4bb0-9f62-0249e62e8fbc tempest-ServersAdminTestJSON-2135363654 tempest-ServersAdminTestJSON-2135363654-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1613 microversion: 2.1 time: 0.923306 Aug 24 10:18:51.548514 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 945/1733] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:50 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1613 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:51.579582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ce515557-a73a-4d4b-bb7f-9ac5ac28d713 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:51.581630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ce515557-a73a-4d4b-bb7f-9ac5ac28d713 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:51.605915 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce515557-a73a-4d4b-bb7f-9ac5ac28d713 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:51.606775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce515557-a73a-4d4b-bb7f-9ac5ac28d713 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:51.609301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce515557-a73a-4d4b-bb7f-9ac5ac28d713 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:51.610234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce515557-a73a-4d4b-bb7f-9ac5ac28d713 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:51.613455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce515557-a73a-4d4b-bb7f-9ac5ac28d713 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:51.614261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce515557-a73a-4d4b-bb7f-9ac5ac28d713 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:51.855375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ce515557-a73a-4d4b-bb7f-9ac5ac28d713 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af167c0c744cbb910ff5860767cb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7947a063a37946b7870e95dfd7a2e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:51.872815 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ce515557-a73a-4d4b-bb7f-9ac5ac28d713 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 200 len: 1298 microversion: 2.1 time: 0.304715 Aug 24 10:18:51.876762 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 946/1734] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:51 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 1298 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:51.908506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-19fb508a-6d05-4d26-98a8-25188592f7d1 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:51.918363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-19fb508a-6d05-4d26-98a8-25188592f7d1 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] [instance: 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:51.952397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19fb508a-6d05-4d26-98a8-25188592f7d1 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:51.952901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19fb508a-6d05-4d26-98a8-25188592f7d1 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:51.953369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19fb508a-6d05-4d26-98a8-25188592f7d1 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:51.958609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19fb508a-6d05-4d26-98a8-25188592f7d1 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:51.959110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19fb508a-6d05-4d26-98a8-25188592f7d1 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:51.964418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19fb508a-6d05-4d26-98a8-25188592f7d1 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:52.350964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-895d39c6-6346-4841-8260-d8c56042efc7 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:52.373847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-895d39c6-6346-4841-8260-d8c56042efc7 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:52.382146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-895d39c6-6346-4841-8260-d8c56042efc7 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:52.388489 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-895d39c6-6346-4841-8260-d8c56042efc7 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1874 microversion: 2.32 time: 1.184859 Aug 24 10:18:52.407145 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 789/1735] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:51 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1874 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:52.423295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-ab2e5679-fc26-4005-9679-9257da19c08e req-66a2a126-0f57-4aa1-bf2a-15d0ea2218f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f", "name": "network-vif-deleted", "tag": "29c5a4d8-1573-48ff-8439-153b2e7ce8e8"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:52.472879 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ab2e5679-fc26-4005-9679-9257da19c08e req-66a2a126-0f57-4aa1-bf2a-15d0ea2218f4 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:52.474657 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ab2e5679-fc26-4005-9679-9257da19c08e req-66a2a126-0f57-4aa1-bf2a-15d0ea2218f4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:52.481432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ab2e5679-fc26-4005-9679-9257da19c08e req-66a2a126-0f57-4aa1-bf2a-15d0ea2218f4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:52.589847 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-ab2e5679-fc26-4005-9679-9257da19c08e req-66a2a126-0f57-4aa1-bf2a-15d0ea2218f4 service nova] Creating event network-vif-deleted:29c5a4d8-1573-48ff-8439-153b2e7ce8e8 for instance a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f on n-h1-849328-3 Aug 24 10:18:52.595741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-19fb508a-6d05-4d26-98a8-25188592f7d1 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cfea45817848c5b0d3e20087d60d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1d41b854f94d67be99f5926a96376c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:52.609861 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-19fb508a-6d05-4d26-98a8-25188592f7d1 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4" status: 200 len: 1394 microversion: 2.1 time: 0.731591 Aug 24 10:18:52.613556 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-ab2e5679-fc26-4005-9679-9257da19c08e req-66a2a126-0f57-4aa1-bf2a-15d0ea2218f4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203362 Aug 24 10:18:52.618379 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 790/1736] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:52.628973 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 947/1737] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:51 2022] GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 => generated 1394 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:52.640250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-3ab27d01-96a1-4f8e-9167-5edec85a678b req-553b70e8-b18e-48ed-8bc4-545089262d0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4", "name": "network-vif-plugged", "status": "completed", "tag": "3aaa78a6-64c1-4bea-b5d7-4d0cab5d8596"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:52.647664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-51bba11b-0922-41ce-9bc0-e0747f070ef0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:52.654254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-51bba11b-0922-41ce-9bc0-e0747f070ef0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 912f291b-bf95-456e-a123-95c1314bbc09] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:52.675599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3ab27d01-96a1-4f8e-9167-5edec85a678b req-553b70e8-b18e-48ed-8bc4-545089262d0d service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:52.683842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3ab27d01-96a1-4f8e-9167-5edec85a678b req-553b70e8-b18e-48ed-8bc4-545089262d0d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:52.683842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3ab27d01-96a1-4f8e-9167-5edec85a678b req-553b70e8-b18e-48ed-8bc4-545089262d0d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:52.685494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51bba11b-0922-41ce-9bc0-e0747f070ef0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:52.687776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51bba11b-0922-41ce-9bc0-e0747f070ef0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:52.690107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51bba11b-0922-41ce-9bc0-e0747f070ef0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:52.692163 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51bba11b-0922-41ce-9bc0-e0747f070ef0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:52.693330 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51bba11b-0922-41ce-9bc0-e0747f070ef0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:52.694601 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51bba11b-0922-41ce-9bc0-e0747f070ef0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:52.791128 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-3ab27d01-96a1-4f8e-9167-5edec85a678b req-553b70e8-b18e-48ed-8bc4-545089262d0d service nova] Creating event network-vif-plugged:3aaa78a6-64c1-4bea-b5d7-4d0cab5d8596 for instance 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 on n-h1-849328-3 Aug 24 10:18:52.804409 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-3ab27d01-96a1-4f8e-9167-5edec85a678b req-553b70e8-b18e-48ed-8bc4-545089262d0d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173727 Aug 24 10:18:52.810120 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 948/1738] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:52.815372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:52.845207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-51bba11b-0922-41ce-9bc0-e0747f070ef0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 912f291b-bf95-456e-a123-95c1314bbc09] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:18:52.899295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-189ca32b-4193-422e-86ab-cc3e9b8355f8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:52.900188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-189ca32b-4193-422e-86ab-cc3e9b8355f8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] [instance: a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:52.913912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-189ca32b-4193-422e-86ab-cc3e9b8355f8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:52.920001 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-189ca32b-4193-422e-86ab-cc3e9b8355f8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:52.921969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-189ca32b-4193-422e-86ab-cc3e9b8355f8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:52.926452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-189ca32b-4193-422e-86ab-cc3e9b8355f8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:52.927327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-189ca32b-4193-422e-86ab-cc3e9b8355f8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:52.932131 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-189ca32b-4193-422e-86ab-cc3e9b8355f8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:52.991916 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-189ca32b-4193-422e-86ab-cc3e9b8355f8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] HTTP exception thrown: Instance a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f could not be found. Aug 24 10:18:53.000267 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-189ca32b-4193-422e-86ab-cc3e9b8355f8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Request method failure captured: Aug 24 10:18:53.000267 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f HTTP/1.1 Aug 24 10:18:53.000267 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:18:53.000267 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:18:53.000267 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:18:53.000267 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:18:53.000267 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:18:53.000267 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:18:53.000267 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:18:53.000267 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:18:53.000267 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfluf5WMhltPE0D2xS8_BGCoOmTlCH2eBEOMFIUtA9FPZZR9DZIJd_DW99E6ZcQOBcSKD-DIGSH2aRtpk3snGczsSGx7soynXHHf3GrBj4Ucp-YVsvxSTBKIshG-vRfctk2mFYBB3hYwgSuW-uej7q8PvT9aTn6fsAkXfQUykpnq6uY Aug 24 10:18:53.000267 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:18:53.000267 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:18:53.000267 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:18:53.000267 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:18:53.000267 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:18:53.000267 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:18:53.000267 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 7947a063a37946b7870e95dfd7a2e7e6 Aug 24 10:18:53.000267 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-MigrationsAdminTest-2049550965 Aug 24 10:18:53.000267 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:18:53.000267 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:18:53.001990 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/7947a063a37946b7870e95dfd7a2e7e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_7947a063a37946b7870e95dfd7a2e7e6", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/7947a063a37946b7870e95dfd7a2e7e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/7947a063a37946b7870e95dfd7a2e7e6"}]}] Aug 24 10:18:53.001990 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-MigrationsAdminTest-2049550965 Aug 24 10:18:53.001990 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 7947a063a37946b7870e95dfd7a2e7e6 Aug 24 10:18:53.001990 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-MigrationsAdminTest-2049550965 Aug 24 10:18:53.001990 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-MigrationsAdminTest-2049550965-project Aug 24 10:18:53.001990 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:18:53.001990 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:18:53.001990 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 53af167c0c744cbb910ff5860767cb95 Aug 24 10:18:53.001990 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-MigrationsAdminTest-2049550965-project Aug 24 10:18:53.001990 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:18:53.001990 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f could not be found. Aug 24 10:18:53.001990 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f'} Aug 24 10:18:53.002812 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:18:53.002812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:53.002812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:18:53.002812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:18:53.002812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:18:53.002812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:18:53.002812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:18:53.002812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:18:53.002812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:18:53.002812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:18:53.002812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f could not be found. Aug 24 10:18:53.002812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:53.002812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:53.002812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:53.002812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:53.002812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:53.002812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:53.002812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:18:53.002812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:18:53.002812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:18:53.004343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:18:53.004343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:18:53.004343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:18:53.004343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:18:53.004343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:18:53.004343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:18:53.004343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:18:53.004343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f could not be found. Aug 24 10:18:53.004343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:53.004343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:53.004343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:53.004343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:53.004343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:53.004343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:53.004343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:18:53.004343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:18:53.004343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f could not be found. Aug 24 10:18:53.004343 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:18:53.013533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-189ca32b-4193-422e-86ab-cc3e9b8355f8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] Returning 404 to user: Instance a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:18:53.014820 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-189ca32b-4193-422e-86ab-cc3e9b8355f8 tempest-MigrationsAdminTest-2049550965 tempest-MigrationsAdminTest-2049550965-project] 10.222.0.85 "GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f" status: 404 len: 111 microversion: 2.1 time: 0.120214 Aug 24 10:18:53.019551 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 949/1739] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:52 2022] GET /compute/v2.1/servers/a583acb3-c07c-4ab1-ad37-95e6f6d2fb4f => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:18:53.039254 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-51bba11b-0922-41ce-9bc0-e0747f070ef0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "DELETE /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09" status: 204 len: 0 microversion: 2.1 time: 0.415792 Aug 24 10:18:53.045733 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 791/1740] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:18:52 2022] DELETE /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:18:53.050522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-81dd8c49-dd3d-46c5-9fe4-db07a45faa42 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:53.051734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-81dd8c49-dd3d-46c5-9fe4-db07a45faa42 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 912f291b-bf95-456e-a123-95c1314bbc09] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:53.063961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81dd8c49-dd3d-46c5-9fe4-db07a45faa42 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:53.070409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81dd8c49-dd3d-46c5-9fe4-db07a45faa42 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:53.073832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81dd8c49-dd3d-46c5-9fe4-db07a45faa42 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:53.074957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81dd8c49-dd3d-46c5-9fe4-db07a45faa42 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:53.076077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81dd8c49-dd3d-46c5-9fe4-db07a45faa42 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:53.081702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81dd8c49-dd3d-46c5-9fe4-db07a45faa42 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:53.421347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f383ef3b-ee97-459a-91b5-ec49015a5034 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:53.422333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f383ef3b-ee97-459a-91b5-ec49015a5034 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:53.442138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f383ef3b-ee97-459a-91b5-ec49015a5034 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:53.442646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f383ef3b-ee97-459a-91b5-ec49015a5034 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:53.456190 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f383ef3b-ee97-459a-91b5-ec49015a5034 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:53.456983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f383ef3b-ee97-459a-91b5-ec49015a5034 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:53.457489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f383ef3b-ee97-459a-91b5-ec49015a5034 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:53.457923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f383ef3b-ee97-459a-91b5-ec49015a5034 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:53.912930 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-81dd8c49-dd3d-46c5-9fe4-db07a45faa42 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:53.962604 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-81dd8c49-dd3d-46c5-9fe4-db07a45faa42 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09" status: 200 len: 1469 microversion: 2.1 time: 0.917137 Aug 24 10:18:53.965436 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 950/1741] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:53 2022] GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09 => generated 1469 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:18:53.980188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4d383ad2-533e-4caa-aa51-fb418b5a0b59 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:53.982447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4d383ad2-533e-4caa-aa51-fb418b5a0b59 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] [instance: 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:54.001658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d383ad2-533e-4caa-aa51-fb418b5a0b59 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:54.002963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d383ad2-533e-4caa-aa51-fb418b5a0b59 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:54.003730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d383ad2-533e-4caa-aa51-fb418b5a0b59 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:54.004666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d383ad2-533e-4caa-aa51-fb418b5a0b59 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:54.012662 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d383ad2-533e-4caa-aa51-fb418b5a0b59 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:54.013642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d383ad2-533e-4caa-aa51-fb418b5a0b59 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:54.029836 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f383ef3b-ee97-459a-91b5-ec49015a5034 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:54.040077 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f383ef3b-ee97-459a-91b5-ec49015a5034 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:54.041626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f383ef3b-ee97-459a-91b5-ec49015a5034 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:54.042838 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f383ef3b-ee97-459a-91b5-ec49015a5034 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1874 microversion: 2.32 time: 0.625860 Aug 24 10:18:54.043405 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 792/1742] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:53 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1874 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:18:54.396153 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:54.951849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4d383ad2-533e-4caa-aa51-fb418b5a0b59 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cfea45817848c5b0d3e20087d60d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1d41b854f94d67be99f5926a96376c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:54.995149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad945344-5afe-49bd-a96c-5a6845a45dbe tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:54.996668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ad945344-5afe-49bd-a96c-5a6845a45dbe tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 912f291b-bf95-456e-a123-95c1314bbc09] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:55.014909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad945344-5afe-49bd-a96c-5a6845a45dbe tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:55.018381 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad945344-5afe-49bd-a96c-5a6845a45dbe tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:55.019326 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4d383ad2-533e-4caa-aa51-fb418b5a0b59 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4" status: 200 len: 1394 microversion: 2.1 time: 1.051802 Aug 24 10:18:55.020464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad945344-5afe-49bd-a96c-5a6845a45dbe tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:55.021650 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 951/1743] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:53 2022] GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 => generated 1394 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:55.039936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad945344-5afe-49bd-a96c-5a6845a45dbe tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:55.040545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad945344-5afe-49bd-a96c-5a6845a45dbe tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:55.042280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad945344-5afe-49bd-a96c-5a6845a45dbe tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:55.090347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5d7d9ec9-ce2a-44d0-9bf8-5d1444d14616 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:55.091445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5d7d9ec9-ce2a-44d0-9bf8-5d1444d14616 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:55.113970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d7d9ec9-ce2a-44d0-9bf8-5d1444d14616 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:55.120783 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d7d9ec9-ce2a-44d0-9bf8-5d1444d14616 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:55.121629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d7d9ec9-ce2a-44d0-9bf8-5d1444d14616 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:55.124446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d7d9ec9-ce2a-44d0-9bf8-5d1444d14616 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:55.125068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d7d9ec9-ce2a-44d0-9bf8-5d1444d14616 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:55.126516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d7d9ec9-ce2a-44d0-9bf8-5d1444d14616 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:55.474410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ad945344-5afe-49bd-a96c-5a6845a45dbe tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:55.495720 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ad945344-5afe-49bd-a96c-5a6845a45dbe tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09" status: 200 len: 1469 microversion: 2.1 time: 0.510732 Aug 24 10:18:55.497045 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 793/1744] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:54 2022] GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09 => generated 1469 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:18:55.722400 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5d7d9ec9-ce2a-44d0-9bf8-5d1444d14616 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:55.739604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5d7d9ec9-ce2a-44d0-9bf8-5d1444d14616 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:55.744276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5d7d9ec9-ce2a-44d0-9bf8-5d1444d14616 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:55.748697 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5d7d9ec9-ce2a-44d0-9bf8-5d1444d14616 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1874 microversion: 2.32 time: 0.663398 Aug 24 10:18:55.751641 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 952/1745] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:55 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1874 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:18:55.826375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ab257d64-0b67-485a-add2-03b0c408cbcd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:55.827175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ab257d64-0b67-485a-add2-03b0c408cbcd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:55.837729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab257d64-0b67-485a-add2-03b0c408cbcd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:55.844932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab257d64-0b67-485a-add2-03b0c408cbcd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:55.848851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab257d64-0b67-485a-add2-03b0c408cbcd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:55.850138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab257d64-0b67-485a-add2-03b0c408cbcd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:55.851117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab257d64-0b67-485a-add2-03b0c408cbcd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:55.854045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab257d64-0b67-485a-add2-03b0c408cbcd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:55.934896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ab257d64-0b67-485a-add2-03b0c408cbcd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:18:56.046061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2bb36f6a-ed37-41ce-9500-0f4458886c6e tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:56.046861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2bb36f6a-ed37-41ce-9500-0f4458886c6e tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] [instance: 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:56.057472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bb36f6a-ed37-41ce-9500-0f4458886c6e tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:56.059768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bb36f6a-ed37-41ce-9500-0f4458886c6e tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:56.061594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bb36f6a-ed37-41ce-9500-0f4458886c6e tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:56.065032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bb36f6a-ed37-41ce-9500-0f4458886c6e tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:56.066310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bb36f6a-ed37-41ce-9500-0f4458886c6e tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:56.069086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bb36f6a-ed37-41ce-9500-0f4458886c6e tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:56.178332 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ab257d64-0b67-485a-add2-03b0c408cbcd tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "DELETE /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 204 len: 0 microversion: 2.25 time: 0.356174 Aug 24 10:18:56.190498 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 794/1746] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:18:55 2022] DELETE /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 10:18:56.199534 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-36eb35d0-35f0-41fc-8b9b-850b9fa9a266 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:56.200640 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-36eb35d0-35f0-41fc-8b9b-850b9fa9a266 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:56.210674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36eb35d0-35f0-41fc-8b9b-850b9fa9a266 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:56.211769 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36eb35d0-35f0-41fc-8b9b-850b9fa9a266 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:56.212477 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36eb35d0-35f0-41fc-8b9b-850b9fa9a266 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:56.213656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36eb35d0-35f0-41fc-8b9b-850b9fa9a266 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:56.214391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36eb35d0-35f0-41fc-8b9b-850b9fa9a266 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:56.215039 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36eb35d0-35f0-41fc-8b9b-850b9fa9a266 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:56.569797 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-36eb35d0-35f0-41fc-8b9b-850b9fa9a266 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:56.579636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-36eb35d0-35f0-41fc-8b9b-850b9fa9a266 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:56.585543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-36eb35d0-35f0-41fc-8b9b-850b9fa9a266 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:56.588572 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-36eb35d0-35f0-41fc-8b9b-850b9fa9a266 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1731 microversion: 2.25 time: 0.396448 Aug 24 10:18:56.592572 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 795/1747] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:56 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1731 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:56.604718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a5ae0297-180f-4d21-bb00-7a9e03f3c2f4 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:56.605696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a5ae0297-180f-4d21-bb00-7a9e03f3c2f4 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 912f291b-bf95-456e-a123-95c1314bbc09] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:56.619573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5ae0297-180f-4d21-bb00-7a9e03f3c2f4 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:56.623230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5ae0297-180f-4d21-bb00-7a9e03f3c2f4 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:56.625305 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5ae0297-180f-4d21-bb00-7a9e03f3c2f4 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:56.626466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5ae0297-180f-4d21-bb00-7a9e03f3c2f4 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:56.628980 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5ae0297-180f-4d21-bb00-7a9e03f3c2f4 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:56.629665 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5ae0297-180f-4d21-bb00-7a9e03f3c2f4 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:56.959279 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2bb36f6a-ed37-41ce-9500-0f4458886c6e tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cfea45817848c5b0d3e20087d60d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1d41b854f94d67be99f5926a96376c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:56.993960 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2bb36f6a-ed37-41ce-9500-0f4458886c6e tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4" status: 200 len: 1574 microversion: 2.1 time: 0.942706 Aug 24 10:18:56.995022 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 953/1748] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:56 2022] GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 => generated 1574 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:57.031303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e22dbf99-ace1-425a-8d78-6d0f616adb25 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1746193300", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:57.128266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-e22dbf99-ace1-425a-8d78-6d0f616adb25 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] validate_networks() for [('fb3f2cc5-551a-4ee2-a1c9-53adbc2afa42', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:18:57.792232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a5ae0297-180f-4d21-bb00-7a9e03f3c2f4 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:57.806292 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a5ae0297-180f-4d21-bb00-7a9e03f3c2f4 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09" status: 200 len: 1469 microversion: 2.1 time: 1.212329 Aug 24 10:18:57.807216 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 796/1749] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:56 2022] GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09 => generated 1469 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:57.820693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-35ac4904-28ea-4eea-aa8c-4c1a857c76ca tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:57.821367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-35ac4904-28ea-4eea-aa8c-4c1a857c76ca tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:57.840531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35ac4904-28ea-4eea-aa8c-4c1a857c76ca tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:57.841331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35ac4904-28ea-4eea-aa8c-4c1a857c76ca tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:57.841869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35ac4904-28ea-4eea-aa8c-4c1a857c76ca tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:57.843913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35ac4904-28ea-4eea-aa8c-4c1a857c76ca tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:57.844383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35ac4904-28ea-4eea-aa8c-4c1a857c76ca tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:57.844814 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35ac4904-28ea-4eea-aa8c-4c1a857c76ca tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:58.963690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-35ac4904-28ea-4eea-aa8c-4c1a857c76ca tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:58.979776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e22dbf99-ace1-425a-8d78-6d0f616adb25 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:18:58.981106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e22dbf99-ace1-425a-8d78-6d0f616adb25 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:18:58.982705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e22dbf99-ace1-425a-8d78-6d0f616adb25 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:18:58.983390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-35ac4904-28ea-4eea-aa8c-4c1a857c76ca tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:58.983977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e22dbf99-ace1-425a-8d78-6d0f616adb25 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:18:58.985295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-35ac4904-28ea-4eea-aa8c-4c1a857c76ca tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:58.985712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e22dbf99-ace1-425a-8d78-6d0f616adb25 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:18:58.986744 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-35ac4904-28ea-4eea-aa8c-4c1a857c76ca tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1874 microversion: 2.32 time: 1.178496 Aug 24 10:18:58.998230 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e22dbf99-ace1-425a-8d78-6d0f616adb25 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:58.999034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e22dbf99-ace1-425a-8d78-6d0f616adb25 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:59.000233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e22dbf99-ace1-425a-8d78-6d0f616adb25 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:59.001241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e22dbf99-ace1-425a-8d78-6d0f616adb25 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:59.002520 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e22dbf99-ace1-425a-8d78-6d0f616adb25 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:59.003166 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e22dbf99-ace1-425a-8d78-6d0f616adb25 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:59.003384 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 797/1750] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:57 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1874 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:59.016832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df59c3d9-dc48-45bf-aa1d-8957a84ca3e2 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:59.019691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-df59c3d9-dc48-45bf-aa1d-8957a84ca3e2 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] [instance: 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:59.030008 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-e22dbf99-ace1-425a-8d78-6d0f616adb25 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Getting quotas for project 014076c393b148618aa03e8e8a0d5be7. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:18:59.038768 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df59c3d9-dc48-45bf-aa1d-8957a84ca3e2 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:59.039201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df59c3d9-dc48-45bf-aa1d-8957a84ca3e2 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:59.039631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df59c3d9-dc48-45bf-aa1d-8957a84ca3e2 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:59.040358 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df59c3d9-dc48-45bf-aa1d-8957a84ca3e2 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:59.040775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df59c3d9-dc48-45bf-aa1d-8957a84ca3e2 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:59.040964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-e22dbf99-ace1-425a-8d78-6d0f616adb25 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Getting quotas for user a9111f8a2bae4e25a353ebb15eca2d5a and project 014076c393b148618aa03e8e8a0d5be7. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:18:59.041250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df59c3d9-dc48-45bf-aa1d-8957a84ca3e2 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:59.058497 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e22dbf99-ace1-425a-8d78-6d0f616adb25 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:18:59.061466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e22dbf99-ace1-425a-8d78-6d0f616adb25 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 6f46192a-0f63-45dd-9ca9-7fda5730ef6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:18:59.142546 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e22dbf99-ace1-425a-8d78-6d0f616adb25 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.129894 Aug 24 10:18:59.148154 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 954/1751] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:18:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 2152 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:18:59.172301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1a53b3e9-b9aa-49ba-83be-b1a648838aa0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:59.174781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1a53b3e9-b9aa-49ba-83be-b1a648838aa0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:59.190323 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a53b3e9-b9aa-49ba-83be-b1a648838aa0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:59.192283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a53b3e9-b9aa-49ba-83be-b1a648838aa0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:59.193560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a53b3e9-b9aa-49ba-83be-b1a648838aa0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:59.195243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a53b3e9-b9aa-49ba-83be-b1a648838aa0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:59.196328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a53b3e9-b9aa-49ba-83be-b1a648838aa0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:59.197476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a53b3e9-b9aa-49ba-83be-b1a648838aa0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:59.453684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1a53b3e9-b9aa-49ba-83be-b1a648838aa0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:59.478824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1a53b3e9-b9aa-49ba-83be-b1a648838aa0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:59.485064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1a53b3e9-b9aa-49ba-83be-b1a648838aa0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:59.497228 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1a53b3e9-b9aa-49ba-83be-b1a648838aa0 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1664 microversion: 2.25 time: 0.345471 Aug 24 10:18:59.499260 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 955/1752] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:59 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1664 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:59.511370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-35c0398d-4f97-42ce-9025-83738483f6fa tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:59.512378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-35c0398d-4f97-42ce-9025-83738483f6fa tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 912f291b-bf95-456e-a123-95c1314bbc09] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:59.532416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35c0398d-4f97-42ce-9025-83738483f6fa tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:59.532996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35c0398d-4f97-42ce-9025-83738483f6fa tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:59.533539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35c0398d-4f97-42ce-9025-83738483f6fa tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:59.534335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35c0398d-4f97-42ce-9025-83738483f6fa tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:59.537968 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35c0398d-4f97-42ce-9025-83738483f6fa tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:59.538500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35c0398d-4f97-42ce-9025-83738483f6fa tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:59.555629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:59.680017 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-df59c3d9-dc48-45bf-aa1d-8957a84ca3e2 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.675025 Aug 24 10:18:59.681367 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 798/1753] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Aug 24 10:18:59 2022] GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4/os-interface => generated 284 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:59.874567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-35c0398d-4f97-42ce-9025-83738483f6fa tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:59.894738 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-35c0398d-4f97-42ce-9025-83738483f6fa tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09" status: 200 len: 1427 microversion: 2.1 time: 0.394019 Aug 24 10:18:59.906733 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 956/1754] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:59 2022] GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09 => generated 1427 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:59.911868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6c73dd35-4aff-4bc9-8245-e24cb7fe2a23 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:59.922043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6c73dd35-4aff-4bc9-8245-e24cb7fe2a23 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 6f46192a-0f63-45dd-9ca9-7fda5730ef6e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:00.389305 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6c73dd35-4aff-4bc9-8245-e24cb7fe2a23 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:00.412032 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6c73dd35-4aff-4bc9-8245-e24cb7fe2a23 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e" status: 200 len: 1225 microversion: 2.1 time: 0.499778 Aug 24 10:19:00.419843 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 957/1755] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:59 2022] GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e => generated 1225 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:00.450691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-32f7be18-ae9b-4998-b2b7-e0767d30168f req-78f73c62-8e93-48ea-8b5c-34d0ab49da05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd", "name": "network-vif-plugged", "status": "completed", "tag": "6ed14169-2bb3-41fb-a411-6ef58f974592"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:00.457436 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d2fcc86-dbfa-4410-a8ae-7e58b125f46a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-406130184", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": "none"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:00.569361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-32f7be18-ae9b-4998-b2b7-e0767d30168f req-78f73c62-8e93-48ea-8b5c-34d0ab49da05 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:00.573745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-32f7be18-ae9b-4998-b2b7-e0767d30168f req-78f73c62-8e93-48ea-8b5c-34d0ab49da05 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:00.574510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-32f7be18-ae9b-4998-b2b7-e0767d30168f req-78f73c62-8e93-48ea-8b5c-34d0ab49da05 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:00.614844 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-32f7be18-ae9b-4998-b2b7-e0767d30168f req-78f73c62-8e93-48ea-8b5c-34d0ab49da05 service nova] Creating event network-vif-plugged:6ed14169-2bb3-41fb-a411-6ef58f974592 for instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd on n-h2-849328-3 Aug 24 10:19:00.627171 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-32f7be18-ae9b-4998-b2b7-e0767d30168f req-78f73c62-8e93-48ea-8b5c-34d0ab49da05 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204762 Aug 24 10:19:00.628746 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 958/1756] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:00.639076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-01272580-6458-48ed-85ba-42da0df916d9 req-4e43a232-08b8-4d20-a7ac-23e730663665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "912f291b-bf95-456e-a123-95c1314bbc09", "name": "network-vif-deleted", "tag": "15ee8e44-fbbd-4e30-90ec-bb8bc625006f"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:00.657981 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-01272580-6458-48ed-85ba-42da0df916d9 req-4e43a232-08b8-4d20-a7ac-23e730663665 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:00.658727 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-01272580-6458-48ed-85ba-42da0df916d9 req-4e43a232-08b8-4d20-a7ac-23e730663665 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:00.659458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-01272580-6458-48ed-85ba-42da0df916d9 req-4e43a232-08b8-4d20-a7ac-23e730663665 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:00.696636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9d2fcc86-dbfa-4410-a8ae-7e58b125f46a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:19:00.697301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9d2fcc86-dbfa-4410-a8ae-7e58b125f46a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:19:00.704612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9d2fcc86-dbfa-4410-a8ae-7e58b125f46a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:19:00.706605 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9d2fcc86-dbfa-4410-a8ae-7e58b125f46a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:19:00.712942 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9d2fcc86-dbfa-4410-a8ae-7e58b125f46a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:19:00.733759 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-01272580-6458-48ed-85ba-42da0df916d9 req-4e43a232-08b8-4d20-a7ac-23e730663665 service nova] Creating event network-vif-deleted:15ee8e44-fbbd-4e30-90ec-bb8bc625006f for instance 912f291b-bf95-456e-a123-95c1314bbc09 on n-h2-849328-3 Aug 24 10:19:00.774983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d2fcc86-dbfa-4410-a8ae-7e58b125f46a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:00.775677 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-01272580-6458-48ed-85ba-42da0df916d9 req-4e43a232-08b8-4d20-a7ac-23e730663665 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138792 Aug 24 10:19:00.778958 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 959/1757] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:00.780878 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d2fcc86-dbfa-4410-a8ae-7e58b125f46a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:00.782203 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d2fcc86-dbfa-4410-a8ae-7e58b125f46a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:00.791021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d2fcc86-dbfa-4410-a8ae-7e58b125f46a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:00.792331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d2fcc86-dbfa-4410-a8ae-7e58b125f46a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:00.797104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d2fcc86-dbfa-4410-a8ae-7e58b125f46a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:00.822804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4c77638d-f695-41a1-9bcd-2066512216f0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:00.829219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4c77638d-f695-41a1-9bcd-2066512216f0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:00.868656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c77638d-f695-41a1-9bcd-2066512216f0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:00.869854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c77638d-f695-41a1-9bcd-2066512216f0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:00.873538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c77638d-f695-41a1-9bcd-2066512216f0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:00.878032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c77638d-f695-41a1-9bcd-2066512216f0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:00.882771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c77638d-f695-41a1-9bcd-2066512216f0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:00.885871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c77638d-f695-41a1-9bcd-2066512216f0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:00.907109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-9d2fcc86-dbfa-4410-a8ae-7e58b125f46a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Getting quotas for project 508d9d7771254855ac7e30c82e3ff0b8. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:19:00.924796 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-9d2fcc86-dbfa-4410-a8ae-7e58b125f46a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Getting quotas for user 9a04706d4e2e425a83c3a10965a331c2 and project 508d9d7771254855ac7e30c82e3ff0b8. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:19:00.965450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9d2fcc86-dbfa-4410-a8ae-7e58b125f46a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:19:00.973184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9d2fcc86-dbfa-4410-a8ae-7e58b125f46a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:19:01.162384 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9d2fcc86-dbfa-4410-a8ae-7e58b125f46a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 1.479485 Aug 24 10:19:01.167805 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 799/1758] 10.222.0.85 () {62 vars in 1188 bytes} [Wed Aug 24 10:18:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1485 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 10:19:01.184969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d7487d33-d715-48b7-a404-f2ae739ff830 req-5e615da9-3a13-4d78-a53f-26e9482bead5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0", "name": "network-vif-deleted", "tag": "24b3e11e-37a5-4b8e-b7ef-ba9e0ea1b0bc"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:01.244206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d7487d33-d715-48b7-a404-f2ae739ff830 req-5e615da9-3a13-4d78-a53f-26e9482bead5 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:01.249171 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d7487d33-d715-48b7-a404-f2ae739ff830 req-5e615da9-3a13-4d78-a53f-26e9482bead5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:01.252222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d7487d33-d715-48b7-a404-f2ae739ff830 req-5e615da9-3a13-4d78-a53f-26e9482bead5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:01.292771 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d7487d33-d715-48b7-a404-f2ae739ff830 req-5e615da9-3a13-4d78-a53f-26e9482bead5 service nova] Creating event network-vif-deleted:24b3e11e-37a5-4b8e-b7ef-ba9e0ea1b0bc for instance 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 on n-h2-849328-3 Aug 24 10:19:01.315154 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d7487d33-d715-48b7-a404-f2ae739ff830 req-5e615da9-3a13-4d78-a53f-26e9482bead5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143363 Aug 24 10:19:01.321840 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 800/1759] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:01.336963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-934f86fb-3521-4bc8-aa23-00dc18d6fff3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:01.339983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-934f86fb-3521-4bc8-aa23-00dc18d6fff3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:01.438238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-934f86fb-3521-4bc8-aa23-00dc18d6fff3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:01.446286 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-934f86fb-3521-4bc8-aa23-00dc18d6fff3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:01.450001 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-934f86fb-3521-4bc8-aa23-00dc18d6fff3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:01.451996 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-934f86fb-3521-4bc8-aa23-00dc18d6fff3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:01.454115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-934f86fb-3521-4bc8-aa23-00dc18d6fff3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:01.466011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-934f86fb-3521-4bc8-aa23-00dc18d6fff3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:01.642719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4c77638d-f695-41a1-9bcd-2066512216f0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:01.666792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-934f86fb-3521-4bc8-aa23-00dc18d6fff3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:01.671278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-934f86fb-3521-4bc8-aa23-00dc18d6fff3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:01.671991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-934f86fb-3521-4bc8-aa23-00dc18d6fff3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:01.672711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-934f86fb-3521-4bc8-aa23-00dc18d6fff3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lazy-loading 'fault' on Instance uuid 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:19:01.692413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4c77638d-f695-41a1-9bcd-2066512216f0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:01.694404 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4c77638d-f695-41a1-9bcd-2066512216f0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:01.696034 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4c77638d-f695-41a1-9bcd-2066512216f0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1874 microversion: 2.32 time: 0.912061 Aug 24 10:19:01.718667 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 960/1760] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:00 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1874 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:01.743448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ce52a628-06e6-4f5c-99ff-3b77f01c14ba tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:01.744591 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ce52a628-06e6-4f5c-99ff-3b77f01c14ba tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 912f291b-bf95-456e-a123-95c1314bbc09] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:01.768059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce52a628-06e6-4f5c-99ff-3b77f01c14ba tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:01.768824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce52a628-06e6-4f5c-99ff-3b77f01c14ba tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:01.769519 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce52a628-06e6-4f5c-99ff-3b77f01c14ba tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:01.770998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce52a628-06e6-4f5c-99ff-3b77f01c14ba tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:01.771701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce52a628-06e6-4f5c-99ff-3b77f01c14ba tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:01.772441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce52a628-06e6-4f5c-99ff-3b77f01c14ba tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:01.826973 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-ce52a628-06e6-4f5c-99ff-3b77f01c14ba tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] HTTP exception thrown: Instance 912f291b-bf95-456e-a123-95c1314bbc09 could not be found. Aug 24 10:19:01.829950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ce52a628-06e6-4f5c-99ff-3b77f01c14ba tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Request method failure captured: Aug 24 10:19:01.829950 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09 HTTP/1.1 Aug 24 10:19:01.829950 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:19:01.829950 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:19:01.829950 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:19:01.829950 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:19:01.829950 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:19:01.829950 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:19:01.829950 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:19:01.829950 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:19:01.829950 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfpDGwdcx8Dl_0RCgObkRMAdG8Unp7I9S9rTJJz2QvpkwYMyshTKU570fIQ_35DMTCTZN2WONzkw8Zt0vZ4eHEEqH2wZmj5xZhqYcVx037gtADb9QDvMV3liUoMZtmMY3ArGj9BorxxgYEoeMicBg2cMyZCUP75OcMRQW1zmFK1g-zg Aug 24 10:19:01.829950 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:19:01.829950 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:19:01.829950 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:19:01.829950 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:19:01.829950 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:19:01.829950 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:19:01.829950 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: e6dcc3fc5b544363b1fcaadd50ea948a Aug 24 10:19:01.829950 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersAdminTestJSON-853616280 Aug 24 10:19:01.829950 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:19:01.829950 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:19:01.832681 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6dcc3fc5b544363b1fcaadd50ea948a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e6dcc3fc5b544363b1fcaadd50ea948a", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6dcc3fc5b544363b1fcaadd50ea948a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e6dcc3fc5b544363b1fcaadd50ea948a"}]}] Aug 24 10:19:01.832681 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersAdminTestJSON-853616280 Aug 24 10:19:01.832681 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: e6dcc3fc5b544363b1fcaadd50ea948a Aug 24 10:19:01.832681 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersAdminTestJSON-853616280 Aug 24 10:19:01.832681 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersAdminTestJSON-853616280-project Aug 24 10:19:01.832681 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:19:01.832681 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:19:01.832681 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 965e7789d7d942a793b07f71dd407fd8 Aug 24 10:19:01.832681 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersAdminTestJSON-853616280-project Aug 24 10:19:01.832681 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:19:01.832681 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 912f291b-bf95-456e-a123-95c1314bbc09 could not be found. Aug 24 10:19:01.832681 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '912f291b-bf95-456e-a123-95c1314bbc09'} Aug 24 10:19:01.834255 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:19:01.834255 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:01.834255 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:19:01.834255 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:19:01.834255 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:19:01.834255 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:19:01.834255 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:19:01.834255 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:19:01.834255 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:19:01.834255 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:19:01.834255 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 912f291b-bf95-456e-a123-95c1314bbc09 could not be found. Aug 24 10:19:01.834255 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:01.834255 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:01.834255 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:01.834255 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:01.834255 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:01.834255 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:01.834255 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:19:01.834255 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:19:01.834255 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:19:01.836129 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:19:01.836129 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:19:01.836129 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:19:01.836129 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:19:01.836129 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:19:01.836129 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:19:01.836129 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:19:01.836129 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 912f291b-bf95-456e-a123-95c1314bbc09 could not be found. Aug 24 10:19:01.836129 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:01.836129 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:01.836129 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:01.836129 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:01.836129 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:01.836129 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:01.836129 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:19:01.836129 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:19:01.836129 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 912f291b-bf95-456e-a123-95c1314bbc09 could not be found. Aug 24 10:19:01.836129 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:01.838933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ce52a628-06e6-4f5c-99ff-3b77f01c14ba tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Returning 404 to user: Instance 912f291b-bf95-456e-a123-95c1314bbc09 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:19:01.840022 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ce52a628-06e6-4f5c-99ff-3b77f01c14ba tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09" status: 404 len: 111 microversion: 2.1 time: 0.120916 Aug 24 10:19:01.841169 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 961/1761] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:01 2022] GET /compute/v2.1/servers/912f291b-bf95-456e-a123-95c1314bbc09 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:19:01.861730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ac532d96-74e6-42cd-8527-3613c8ffa4d7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:01.878249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ac532d96-74e6-42cd-8527-3613c8ffa4d7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:02.078571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ac532d96-74e6-42cd-8527-3613c8ffa4d7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:02.091933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ac532d96-74e6-42cd-8527-3613c8ffa4d7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:02.093571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ac532d96-74e6-42cd-8527-3613c8ffa4d7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:02.116972 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ac532d96-74e6-42cd-8527-3613c8ffa4d7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "PUT /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1358 microversion: 2.75 time: 0.274156 Aug 24 10:19:02.133792 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 962/1762] 10.222.0.85 () {62 vars in 1297 bytes} [Wed Aug 24 10:19:01 2022] PUT /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1358 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:02.151635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-97f618d9-97d0-4f63-8a44-4420cc961d0d tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:02.152730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-97f618d9-97d0-4f63-8a44-4420cc961d0d tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 6f46192a-0f63-45dd-9ca9-7fda5730ef6e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:02.170956 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97f618d9-97d0-4f63-8a44-4420cc961d0d tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:02.171506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97f618d9-97d0-4f63-8a44-4420cc961d0d tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:02.173273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97f618d9-97d0-4f63-8a44-4420cc961d0d tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:02.181597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97f618d9-97d0-4f63-8a44-4420cc961d0d tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:02.182104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97f618d9-97d0-4f63-8a44-4420cc961d0d tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:02.182539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97f618d9-97d0-4f63-8a44-4420cc961d0d tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:02.381614 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-97f618d9-97d0-4f63-8a44-4420cc961d0d tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:02.394456 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-97f618d9-97d0-4f63-8a44-4420cc961d0d tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e" status: 200 len: 1295 microversion: 2.1 time: 0.258102 Aug 24 10:19:02.395721 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 963/1763] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:02 2022] GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e => generated 1295 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:02.413382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0d886aa5-00ca-4c5b-be00-e04d4ab0b5c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:02.415018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0d886aa5-00ca-4c5b-be00-e04d4ab0b5c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 7bbf838d-132a-449c-985e-3485e9c4b9fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:02.429955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d886aa5-00ca-4c5b-be00-e04d4ab0b5c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:02.434392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d886aa5-00ca-4c5b-be00-e04d4ab0b5c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:02.436466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d886aa5-00ca-4c5b-be00-e04d4ab0b5c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:02.438666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d886aa5-00ca-4c5b-be00-e04d4ab0b5c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:02.440352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d886aa5-00ca-4c5b-be00-e04d4ab0b5c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:02.443589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d886aa5-00ca-4c5b-be00-e04d4ab0b5c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:02.446482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-934f86fb-3521-4bc8-aa23-00dc18d6fff3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:02.475152 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-934f86fb-3521-4bc8-aa23-00dc18d6fff3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:02.479155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-934f86fb-3521-4bc8-aa23-00dc18d6fff3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:02.485141 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-934f86fb-3521-4bc8-aa23-00dc18d6fff3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 200 len: 1374 microversion: 2.25 time: 1.160785 Aug 24 10:19:02.509862 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 801/1764] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:01 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 1374 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:02.523648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0d886aa5-00ca-4c5b-be00-e04d4ab0b5c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 7bbf838d-132a-449c-985e-3485e9c4b9fe] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:19:02.540455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1126266c-c64c-45fc-979b-b589c64b2090 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:02.542040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1126266c-c64c-45fc-979b-b589c64b2090 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:02.564416 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1126266c-c64c-45fc-979b-b589c64b2090 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:02.574548 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1126266c-c64c-45fc-979b-b589c64b2090 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:02.575063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1126266c-c64c-45fc-979b-b589c64b2090 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:02.576120 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1126266c-c64c-45fc-979b-b589c64b2090 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:02.576909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1126266c-c64c-45fc-979b-b589c64b2090 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:02.577524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1126266c-c64c-45fc-979b-b589c64b2090 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:02.628327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:02.647838 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0d886aa5-00ca-4c5b-be00-e04d4ab0b5c2 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "DELETE /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe" status: 204 len: 0 microversion: 2.1 time: 0.248016 Aug 24 10:19:02.651894 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 964/1765] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:19:02 2022] DELETE /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:19:02.914111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5e28b00f-1044-463f-82fa-730c4f3c6bc8 tempest-ListImagesTestJSON-1096358245 tempest-ListImagesTestJSON-1096358245-project] Calling method '.version_select at 0x7f465a1dd280>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:02.981151 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5e28b00f-1044-463f-82fa-730c4f3c6bc8 tempest-ListImagesTestJSON-1096358245 tempest-ListImagesTestJSON-1096358245-project] 10.222.0.85 "GET /compute/v2.1/images/0a9df326-dcca-498d-8d8a-b320e539a1af" status: 200 len: 784 microversion: 2.1 time: 0.327607 Aug 24 10:19:02.982272 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 965/1766] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:19:02 2022] GET /compute/v2.1/images/0a9df326-dcca-498d-8d8a-b320e539a1af => generated 784 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:02.990744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c6609afa-fc30-4a21-889e-7576d4b4a2e6 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:02.991967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c6609afa-fc30-4a21-889e-7576d4b4a2e6 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 7bbf838d-132a-449c-985e-3485e9c4b9fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:03.014806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6609afa-fc30-4a21-889e-7576d4b4a2e6 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:03.015304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6609afa-fc30-4a21-889e-7576d4b4a2e6 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:03.016035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6609afa-fc30-4a21-889e-7576d4b4a2e6 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:03.016657 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6609afa-fc30-4a21-889e-7576d4b4a2e6 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:03.017110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6609afa-fc30-4a21-889e-7576d4b4a2e6 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:03.018107 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6609afa-fc30-4a21-889e-7576d4b4a2e6 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:03.063201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1126266c-c64c-45fc-979b-b589c64b2090 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:03.077582 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1126266c-c64c-45fc-979b-b589c64b2090 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:03.079135 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1126266c-c64c-45fc-979b-b589c64b2090 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:03.088375 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1126266c-c64c-45fc-979b-b589c64b2090 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1362 microversion: 2.75 time: 0.576269 Aug 24 10:19:03.093736 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 802/1767] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:02 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1362 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:03.116881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6290b9a5-172b-49b3-b048-545c513c70e5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:03.118104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6290b9a5-172b-49b3-b048-545c513c70e5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:03.125874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6290b9a5-172b-49b3-b048-545c513c70e5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:03.126503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6290b9a5-172b-49b3-b048-545c513c70e5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:03.127169 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6290b9a5-172b-49b3-b048-545c513c70e5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:03.127822 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6290b9a5-172b-49b3-b048-545c513c70e5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:03.128914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6290b9a5-172b-49b3-b048-545c513c70e5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:03.128914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6290b9a5-172b-49b3-b048-545c513c70e5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:03.250128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c6609afa-fc30-4a21-889e-7576d4b4a2e6 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:03.259939 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c6609afa-fc30-4a21-889e-7576d4b4a2e6 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe" status: 200 len: 1470 microversion: 2.1 time: 0.275854 Aug 24 10:19:03.260559 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 966/1768] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:02 2022] GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe => generated 1470 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:03.289379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f41e736a-d77d-4d3f-b66d-19f935554f0b tempest-ListImagesTestJSON-1096358245 tempest-ListImagesTestJSON-1096358245-project] Calling method '.version_select at 0x7f465a1ddd30>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:03.411158 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f41e736a-d77d-4d3f-b66d-19f935554f0b tempest-ListImagesTestJSON-1096358245 tempest-ListImagesTestJSON-1096358245-project] 10.222.0.85 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.149350 Aug 24 10:19:03.420969 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 967/1769] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 10:19:03 2022] GET /compute/v2.1/images => generated 445 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:03.431470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5ff2477a-d17c-41ac-b5ad-1ab08ee5a816 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:03.432664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5ff2477a-d17c-41ac-b5ad-1ab08ee5a816 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 6f46192a-0f63-45dd-9ca9-7fda5730ef6e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:03.456161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ff2477a-d17c-41ac-b5ad-1ab08ee5a816 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:03.457235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ff2477a-d17c-41ac-b5ad-1ab08ee5a816 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:03.458155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ff2477a-d17c-41ac-b5ad-1ab08ee5a816 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:03.458988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ff2477a-d17c-41ac-b5ad-1ab08ee5a816 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:03.459706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ff2477a-d17c-41ac-b5ad-1ab08ee5a816 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:03.460205 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ff2477a-d17c-41ac-b5ad-1ab08ee5a816 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:03.570430 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6290b9a5-172b-49b3-b048-545c513c70e5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:03.570928 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5ff2477a-d17c-41ac-b5ad-1ab08ee5a816 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:03.582699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6290b9a5-172b-49b3-b048-545c513c70e5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:03.584731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6290b9a5-172b-49b3-b048-545c513c70e5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:03.586284 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6290b9a5-172b-49b3-b048-545c513c70e5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1874 microversion: 2.32 time: 0.475167 Aug 24 10:19:03.587615 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 803/1770] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:03 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1874 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:03.593567 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e005bcd5-a9a6-4b0a-8e91-ba2f48ead53c tempest-ListImagesTestJSON-1096358245 tempest-ListImagesTestJSON-1096358245-project] Calling method '.version_select at 0x7f465540c5e0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:03.602172 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5ff2477a-d17c-41ac-b5ad-1ab08ee5a816 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e" status: 200 len: 1283 microversion: 2.1 time: 0.164340 Aug 24 10:19:03.603280 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 968/1771] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:03 2022] GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e => generated 1283 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:03.609931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-85d4a3a7-8718-4b42-b27c-fd8d45551fd3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:03.610936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-85d4a3a7-8718-4b42-b27c-fd8d45551fd3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:03.618778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85d4a3a7-8718-4b42-b27c-fd8d45551fd3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:03.619671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85d4a3a7-8718-4b42-b27c-fd8d45551fd3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:03.620382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85d4a3a7-8718-4b42-b27c-fd8d45551fd3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:03.621407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85d4a3a7-8718-4b42-b27c-fd8d45551fd3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:03.622122 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85d4a3a7-8718-4b42-b27c-fd8d45551fd3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:03.622811 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85d4a3a7-8718-4b42-b27c-fd8d45551fd3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:03.641578 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-85d4a3a7-8718-4b42-b27c-fd8d45551fd3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] HTTP exception thrown: Instance 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 could not be found. Aug 24 10:19:03.643742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-85d4a3a7-8718-4b42-b27c-fd8d45551fd3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Request method failure captured: Aug 24 10:19:03.643742 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 HTTP/1.1 Aug 24 10:19:03.643742 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:19:03.643742 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:19:03.643742 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:19:03.643742 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:19:03.643742 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:19:03.643742 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:19:03.643742 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:19:03.643742 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:19:03.643742 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfldrKdWWwgO0XW__bQAWjGC52fxRL20rk6I6t2eKmY9-12ECHIqc8L1_2OEYmTV_PZU72KFY-HhmZUBgc7KK3rbu1N_1aNl-LGrcsfLFCQiOsVapHVjHI0UqR9nLYtVZhzlpA1soVu1vQGcsoRjo9Bj89t0F8yT-rvJOZDsorNLGJQ Aug 24 10:19:03.643742 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:19:03.643742 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:19:03.643742 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:19:03.643742 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:19:03.643742 n-d-849328-3 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.25 Aug 24 10:19:03.643742 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:19:03.643742 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:19:03.643742 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 34b2b8fc487d4a6abb08f132e0f0c1da Aug 24 10:19:03.643742 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1165112608 Aug 24 10:19:03.643742 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:19:03.643742 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:19:03.645524 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/34b2b8fc487d4a6abb08f132e0f0c1da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_34b2b8fc487d4a6abb08f132e0f0c1da", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/34b2b8fc487d4a6abb08f132e0f0c1da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/34b2b8fc487d4a6abb08f132e0f0c1da"}]}] Aug 24 10:19:03.645524 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1165112608 Aug 24 10:19:03.645524 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 34b2b8fc487d4a6abb08f132e0f0c1da Aug 24 10:19:03.645524 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1165112608 Aug 24 10:19:03.645524 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-LiveAutoBlockMigrationV225Test-1165112608-project Aug 24 10:19:03.645524 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:19:03.645524 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:19:03.645524 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: dfd26847179f4f2bab0c9f673de0c303 Aug 24 10:19:03.645524 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1165112608-project Aug 24 10:19:03.645524 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:19:03.645524 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 could not be found. Aug 24 10:19:03.645524 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0'} Aug 24 10:19:03.646937 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:19:03.646937 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:03.646937 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:19:03.646937 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:19:03.646937 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:19:03.646937 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:19:03.646937 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:19:03.646937 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:19:03.646937 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:19:03.646937 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:19:03.646937 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 could not be found. Aug 24 10:19:03.646937 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:03.646937 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:03.646937 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:03.646937 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:03.646937 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:03.646937 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:03.646937 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:19:03.646937 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:19:03.646937 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:19:03.648833 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:19:03.648833 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:19:03.648833 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:19:03.648833 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:19:03.648833 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:19:03.648833 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:19:03.648833 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:19:03.648833 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 could not be found. Aug 24 10:19:03.648833 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:03.648833 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:03.648833 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:03.648833 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:03.648833 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:03.648833 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:03.648833 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:19:03.648833 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:19:03.648833 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 could not be found. Aug 24 10:19:03.648833 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:03.650158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-85d4a3a7-8718-4b42-b27c-fd8d45551fd3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Returning 404 to user: Instance 40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:19:03.650779 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-85d4a3a7-8718-4b42-b27c-fd8d45551fd3 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0" status: 404 len: 111 microversion: 2.25 time: 0.045990 Aug 24 10:19:03.654944 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 969/1772] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:03 2022] GET /compute/v2.1/servers/40ebf259-b6a5-4ed7-8dfa-0dee80ca29e0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:19:03.662170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f95993e7-d69c-4d00-b5e2-c58509da2f7b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '.version_select at 0x7f465a20eca0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:03.682485 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e005bcd5-a9a6-4b0a-8e91-ba2f48ead53c tempest-ListImagesTestJSON-1096358245 tempest-ListImagesTestJSON-1096358245-project] 10.222.0.85 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.093413 Aug 24 10:19:03.697818 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 804/1773] 10.222.0.85 () {58 vars in 1143 bytes} [Wed Aug 24 10:19:03 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:03.698739 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f95993e7-d69c-4d00-b5e2-c58509da2f7b tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-923277923" status: 204 len: 0 microversion: 2.25 time: 0.041641 Aug 24 10:19:03.701401 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 970/1774] 10.222.0.85 () {60 vars in 1259 bytes} [Wed Aug 24 10:19:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-923277923 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:19:04.123393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-762e7027-4de8-494f-a219-4e5b52581f86 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:04.124209 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-762e7027-4de8-494f-a219-4e5b52581f86 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:04.138779 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-762e7027-4de8-494f-a219-4e5b52581f86 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:04.141332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-762e7027-4de8-494f-a219-4e5b52581f86 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:04.142577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-762e7027-4de8-494f-a219-4e5b52581f86 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:04.144275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-762e7027-4de8-494f-a219-4e5b52581f86 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:04.146789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-762e7027-4de8-494f-a219-4e5b52581f86 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:04.149181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-762e7027-4de8-494f-a219-4e5b52581f86 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:04.301012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c33102d9-629f-4e49-8112-4954903a5d64 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:04.302757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c33102d9-629f-4e49-8112-4954903a5d64 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 7bbf838d-132a-449c-985e-3485e9c4b9fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:04.315699 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c33102d9-629f-4e49-8112-4954903a5d64 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:04.316209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c33102d9-629f-4e49-8112-4954903a5d64 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:04.316817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c33102d9-629f-4e49-8112-4954903a5d64 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:04.317596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c33102d9-629f-4e49-8112-4954903a5d64 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:04.318060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c33102d9-629f-4e49-8112-4954903a5d64 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:04.318487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c33102d9-629f-4e49-8112-4954903a5d64 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:04.344539 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-762e7027-4de8-494f-a219-4e5b52581f86 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:04.361377 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-762e7027-4de8-494f-a219-4e5b52581f86 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:04.365741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-762e7027-4de8-494f-a219-4e5b52581f86 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:04.375264 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-762e7027-4de8-494f-a219-4e5b52581f86 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1418 microversion: 2.75 time: 0.256269 Aug 24 10:19:04.390866 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 805/1775] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:04 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1418 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:04.625298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7d5da75f-a3cb-409a-9432-9ca2d7d6e508 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:04.626599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7d5da75f-a3cb-409a-9432-9ca2d7d6e508 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:04.634378 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:04.638153 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d5da75f-a3cb-409a-9432-9ca2d7d6e508 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:04.638933 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d5da75f-a3cb-409a-9432-9ca2d7d6e508 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:04.639549 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d5da75f-a3cb-409a-9432-9ca2d7d6e508 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:04.640444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d5da75f-a3cb-409a-9432-9ca2d7d6e508 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:04.641303 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d5da75f-a3cb-409a-9432-9ca2d7d6e508 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:04.641958 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d5da75f-a3cb-409a-9432-9ca2d7d6e508 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:04.858880 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c33102d9-629f-4e49-8112-4954903a5d64 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:04.872695 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c33102d9-629f-4e49-8112-4954903a5d64 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe" status: 200 len: 1470 microversion: 2.1 time: 0.588596 Aug 24 10:19:04.877547 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 971/1776] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:04 2022] GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe => generated 1470 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:04.883123 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8504de83-5936-4b2b-96a8-119e8ded1f1a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:04.883952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8504de83-5936-4b2b-96a8-119e8ded1f1a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 6f46192a-0f63-45dd-9ca9-7fda5730ef6e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:04.899903 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8504de83-5936-4b2b-96a8-119e8ded1f1a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:04.902172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8504de83-5936-4b2b-96a8-119e8ded1f1a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:04.904524 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8504de83-5936-4b2b-96a8-119e8ded1f1a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:04.905455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8504de83-5936-4b2b-96a8-119e8ded1f1a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:04.906516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8504de83-5936-4b2b-96a8-119e8ded1f1a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:04.907491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8504de83-5936-4b2b-96a8-119e8ded1f1a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:05.055539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8504de83-5936-4b2b-96a8-119e8ded1f1a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:05.070408 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8504de83-5936-4b2b-96a8-119e8ded1f1a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e" status: 200 len: 1283 microversion: 2.1 time: 0.191080 Aug 24 10:19:05.072011 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 972/1777] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:04 2022] GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e => generated 1283 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:05.128503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f485a337-656c-4391-b6a3-21353225f16a tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:05.130280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f485a337-656c-4391-b6a3-21353225f16a tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] [instance: 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:05.155065 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f485a337-656c-4391-b6a3-21353225f16a tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:05.155946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f485a337-656c-4391-b6a3-21353225f16a tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:05.158070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f485a337-656c-4391-b6a3-21353225f16a tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:05.159139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f485a337-656c-4391-b6a3-21353225f16a tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:05.164331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f485a337-656c-4391-b6a3-21353225f16a tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:05.165621 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f485a337-656c-4391-b6a3-21353225f16a tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:05.563861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f485a337-656c-4391-b6a3-21353225f16a tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cfea45817848c5b0d3e20087d60d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1d41b854f94d67be99f5926a96376c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:05.577665 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f485a337-656c-4391-b6a3-21353225f16a tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4" status: 200 len: 1574 microversion: 2.1 time: 0.459012 Aug 24 10:19:05.579936 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 973/1778] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:05 2022] GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 => generated 1574 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:05.599202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a5228d51-b617-4d30-883b-254e7f829c62 req-bfe07d45-c79d-4a16-9420-0318cb5ce22b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4", "tag": "3aaa78a6-64c1-4bea-b5d7-4d0cab5d8596"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:05.601382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7d5da75f-a3cb-409a-9432-9ca2d7d6e508 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:05.608331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:05.618643 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7d5da75f-a3cb-409a-9432-9ca2d7d6e508 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:05.621265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a5228d51-b617-4d30-883b-254e7f829c62 req-bfe07d45-c79d-4a16-9420-0318cb5ce22b service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:05.621743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a5228d51-b617-4d30-883b-254e7f829c62 req-bfe07d45-c79d-4a16-9420-0318cb5ce22b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:05.622168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a5228d51-b617-4d30-883b-254e7f829c62 req-bfe07d45-c79d-4a16-9420-0318cb5ce22b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:05.630783 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7d5da75f-a3cb-409a-9432-9ca2d7d6e508 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:05.632488 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7d5da75f-a3cb-409a-9432-9ca2d7d6e508 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1874 microversion: 2.32 time: 1.012504 Aug 24 10:19:05.633679 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 806/1779] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:04 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1874 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:19:05.640511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5a56e9c6-e03c-4ea3-9792-101b94ddebf4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:05.641523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5a56e9c6-e03c-4ea3-9792-101b94ddebf4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:05.658780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a56e9c6-e03c-4ea3-9792-101b94ddebf4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:05.659286 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a56e9c6-e03c-4ea3-9792-101b94ddebf4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:05.659563 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a5228d51-b617-4d30-883b-254e7f829c62 req-bfe07d45-c79d-4a16-9420-0318cb5ce22b service nova] Creating event network-changed:3aaa78a6-64c1-4bea-b5d7-4d0cab5d8596 for instance 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 on n-h1-849328-3 Aug 24 10:19:05.659956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a56e9c6-e03c-4ea3-9792-101b94ddebf4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:05.660717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a56e9c6-e03c-4ea3-9792-101b94ddebf4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:05.661216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a56e9c6-e03c-4ea3-9792-101b94ddebf4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:05.661653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a56e9c6-e03c-4ea3-9792-101b94ddebf4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:05.672979 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a5228d51-b617-4d30-883b-254e7f829c62 req-bfe07d45-c79d-4a16-9420-0318cb5ce22b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087119 Aug 24 10:19:05.674496 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 974/1780] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:05.684468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d5ae3dcd-f2ab-4d9b-b8ce-22f73b3657d9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:05.685865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d5ae3dcd-f2ab-4d9b-b8ce-22f73b3657d9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:05.702380 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5ae3dcd-f2ab-4d9b-b8ce-22f73b3657d9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:05.702985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5ae3dcd-f2ab-4d9b-b8ce-22f73b3657d9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:05.703860 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5ae3dcd-f2ab-4d9b-b8ce-22f73b3657d9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:05.704737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5ae3dcd-f2ab-4d9b-b8ce-22f73b3657d9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:05.706996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5ae3dcd-f2ab-4d9b-b8ce-22f73b3657d9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:05.707454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5ae3dcd-f2ab-4d9b-b8ce-22f73b3657d9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:05.760141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d5ae3dcd-f2ab-4d9b-b8ce-22f73b3657d9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:19:05.908698 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d5ae3dcd-f2ab-4d9b-b8ce-22f73b3657d9 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "DELETE /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 204 len: 0 microversion: 2.25 time: 0.231894 Aug 24 10:19:05.910177 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 975/1781] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:19:05 2022] DELETE /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:19:05.918215 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-75a5a987-c982-488a-a6f9-8eef02880ad5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:05.919443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-75a5a987-c982-488a-a6f9-8eef02880ad5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 7bbf838d-132a-449c-985e-3485e9c4b9fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:05.938319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75a5a987-c982-488a-a6f9-8eef02880ad5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:05.939807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75a5a987-c982-488a-a6f9-8eef02880ad5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:05.940906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75a5a987-c982-488a-a6f9-8eef02880ad5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:05.941646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5a56e9c6-e03c-4ea3-9792-101b94ddebf4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:05.942608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75a5a987-c982-488a-a6f9-8eef02880ad5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:05.943392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75a5a987-c982-488a-a6f9-8eef02880ad5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:05.944884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75a5a987-c982-488a-a6f9-8eef02880ad5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:05.954889 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5a56e9c6-e03c-4ea3-9792-101b94ddebf4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:05.957559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5a56e9c6-e03c-4ea3-9792-101b94ddebf4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:05.967126 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5a56e9c6-e03c-4ea3-9792-101b94ddebf4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1416 microversion: 2.75 time: 0.331361 Aug 24 10:19:05.968756 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 807/1782] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:05 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1416 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:05.977412 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-361a5ef6-73eb-40b0-ac3b-21ba87e1c0ed tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:05.978930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-361a5ef6-73eb-40b0-ac3b-21ba87e1c0ed tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:06.020942 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-361a5ef6-73eb-40b0-ac3b-21ba87e1c0ed tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:06.023015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-361a5ef6-73eb-40b0-ac3b-21ba87e1c0ed tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:06.023488 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-361a5ef6-73eb-40b0-ac3b-21ba87e1c0ed tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:06.024233 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-361a5ef6-73eb-40b0-ac3b-21ba87e1c0ed tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:06.032337 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-361a5ef6-73eb-40b0-ac3b-21ba87e1c0ed tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:06.032875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-361a5ef6-73eb-40b0-ac3b-21ba87e1c0ed tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:06.567645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-75a5a987-c982-488a-a6f9-8eef02880ad5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:06.582777 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-75a5a987-c982-488a-a6f9-8eef02880ad5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe" status: 200 len: 1470 microversion: 2.1 time: 0.670680 Aug 24 10:19:06.597724 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 976/1783] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:05 2022] GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe => generated 1470 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:06.622618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bbcc079b-c61c-4558-8986-b0a81cbc6cfd tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:06.623888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bbcc079b-c61c-4558-8986-b0a81cbc6cfd tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 6f46192a-0f63-45dd-9ca9-7fda5730ef6e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:06.647250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbcc079b-c61c-4558-8986-b0a81cbc6cfd tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:06.648251 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbcc079b-c61c-4558-8986-b0a81cbc6cfd tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:06.649006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbcc079b-c61c-4558-8986-b0a81cbc6cfd tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:06.651769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbcc079b-c61c-4558-8986-b0a81cbc6cfd tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:06.651769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbcc079b-c61c-4558-8986-b0a81cbc6cfd tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:06.652293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbcc079b-c61c-4558-8986-b0a81cbc6cfd tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:07.245065 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bbcc079b-c61c-4558-8986-b0a81cbc6cfd tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:07.263576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:07.271595 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bbcc079b-c61c-4558-8986-b0a81cbc6cfd tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e" status: 200 len: 1325 microversion: 2.1 time: 0.672048 Aug 24 10:19:07.272135 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 977/1784] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:06 2022] GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e => generated 1325 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:07.292787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-42790fd6-25a9-462c-9096-a6d910e0b1af tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:07.294401 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-42790fd6-25a9-462c-9096-a6d910e0b1af tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:07.310990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42790fd6-25a9-462c-9096-a6d910e0b1af tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:07.321056 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42790fd6-25a9-462c-9096-a6d910e0b1af tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:07.321644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42790fd6-25a9-462c-9096-a6d910e0b1af tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:07.322440 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42790fd6-25a9-462c-9096-a6d910e0b1af tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:07.322934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42790fd6-25a9-462c-9096-a6d910e0b1af tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:07.323381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42790fd6-25a9-462c-9096-a6d910e0b1af tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:08.017361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-361a5ef6-73eb-40b0-ac3b-21ba87e1c0ed tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:08.062492 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-361a5ef6-73eb-40b0-ac3b-21ba87e1c0ed tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:08.066307 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-361a5ef6-73eb-40b0-ac3b-21ba87e1c0ed tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:08.068087 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-361a5ef6-73eb-40b0-ac3b-21ba87e1c0ed tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 1548 microversion: 2.25 time: 2.097980 Aug 24 10:19:08.069958 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 808/1785] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:05 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 1548 bytes in 2100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:08.112194 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-33386821-0d36-42be-bc85-d27522499ab9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:08.113241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-33386821-0d36-42be-bc85-d27522499ab9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:08.125625 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33386821-0d36-42be-bc85-d27522499ab9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:08.126601 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33386821-0d36-42be-bc85-d27522499ab9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:08.127356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33386821-0d36-42be-bc85-d27522499ab9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:08.128528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33386821-0d36-42be-bc85-d27522499ab9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:08.129610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33386821-0d36-42be-bc85-d27522499ab9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:08.130279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33386821-0d36-42be-bc85-d27522499ab9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:08.449710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-42790fd6-25a9-462c-9096-a6d910e0b1af tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:08.468924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-42790fd6-25a9-462c-9096-a6d910e0b1af tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:08.472278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-42790fd6-25a9-462c-9096-a6d910e0b1af tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:08.474804 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-42790fd6-25a9-462c-9096-a6d910e0b1af tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1874 microversion: 2.32 time: 1.201301 Aug 24 10:19:08.476176 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 978/1786] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:07 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1874 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:08.489578 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-33386821-0d36-42be-bc85-d27522499ab9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:08.517336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-faadd411-47fe-47cf-895c-d0b055e97da0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:08.519482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-faadd411-47fe-47cf-895c-d0b055e97da0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 7bbf838d-132a-449c-985e-3485e9c4b9fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:08.532161 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-33386821-0d36-42be-bc85-d27522499ab9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:08.532546 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-faadd411-47fe-47cf-895c-d0b055e97da0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:08.533750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-faadd411-47fe-47cf-895c-d0b055e97da0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:08.534972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-faadd411-47fe-47cf-895c-d0b055e97da0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:08.536425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-faadd411-47fe-47cf-895c-d0b055e97da0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:08.537518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-faadd411-47fe-47cf-895c-d0b055e97da0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:08.537750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-33386821-0d36-42be-bc85-d27522499ab9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:08.538786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-faadd411-47fe-47cf-895c-d0b055e97da0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:08.560158 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-33386821-0d36-42be-bc85-d27522499ab9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1416 microversion: 2.75 time: 0.474450 Aug 24 10:19:08.562589 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 809/1787] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:08 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1416 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:08.574759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-0d26766e-e2ae-414b-bbce-a8e37f0179c5 req-25a2c696-8608-4a57-8f36-9087afd16603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bbf838d-132a-449c-985e-3485e9c4b9fe", "name": "network-vif-deleted", "tag": "929039dc-5f8e-4877-bfab-387d866840b0"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:08.598030 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0d26766e-e2ae-414b-bbce-a8e37f0179c5 req-25a2c696-8608-4a57-8f36-9087afd16603 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:08.599544 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0d26766e-e2ae-414b-bbce-a8e37f0179c5 req-25a2c696-8608-4a57-8f36-9087afd16603 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:08.600973 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0d26766e-e2ae-414b-bbce-a8e37f0179c5 req-25a2c696-8608-4a57-8f36-9087afd16603 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:08.624768 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-0d26766e-e2ae-414b-bbce-a8e37f0179c5 req-25a2c696-8608-4a57-8f36-9087afd16603 service nova] Creating event network-vif-deleted:929039dc-5f8e-4877-bfab-387d866840b0 for instance 7bbf838d-132a-449c-985e-3485e9c4b9fe on n-h1-849328-3 Aug 24 10:19:08.631023 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-0d26766e-e2ae-414b-bbce-a8e37f0179c5 req-25a2c696-8608-4a57-8f36-9087afd16603 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066592 Aug 24 10:19:08.632189 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 810/1788] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:08.639328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-faadd411-47fe-47cf-895c-d0b055e97da0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:08.640744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-faadd411-47fe-47cf-895c-d0b055e97da0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:08.641960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-faadd411-47fe-47cf-895c-d0b055e97da0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:08.642997 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-faadd411-47fe-47cf-895c-d0b055e97da0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lazy-loading 'fault' on Instance uuid 7bbf838d-132a-449c-985e-3485e9c4b9fe {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:19:08.644545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-43fe211e-1c7a-4e46-8328-ef204910a454 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:08.646127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-43fe211e-1c7a-4e46-8328-ef204910a454 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 6f46192a-0f63-45dd-9ca9-7fda5730ef6e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:08.661634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43fe211e-1c7a-4e46-8328-ef204910a454 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:08.662973 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43fe211e-1c7a-4e46-8328-ef204910a454 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:08.663976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43fe211e-1c7a-4e46-8328-ef204910a454 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:08.665914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43fe211e-1c7a-4e46-8328-ef204910a454 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:08.666813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43fe211e-1c7a-4e46-8328-ef204910a454 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:08.667441 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43fe211e-1c7a-4e46-8328-ef204910a454 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:08.900132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-faadd411-47fe-47cf-895c-d0b055e97da0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:08.922754 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-faadd411-47fe-47cf-895c-d0b055e97da0 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe" status: 200 len: 1304 microversion: 2.1 time: 0.430572 Aug 24 10:19:08.924766 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 979/1789] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:08 2022] GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe => generated 1304 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:08.953215 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-043accd3-b392-4506-b442-e53052c8885c tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:08.955603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-043accd3-b392-4506-b442-e53052c8885c tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:08.979177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-043accd3-b392-4506-b442-e53052c8885c tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:08.981996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-043accd3-b392-4506-b442-e53052c8885c tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:08.987036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-043accd3-b392-4506-b442-e53052c8885c tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:08.988905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-043accd3-b392-4506-b442-e53052c8885c tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:08.989652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-043accd3-b392-4506-b442-e53052c8885c tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:08.990308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-043accd3-b392-4506-b442-e53052c8885c tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:09.032777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:09.129434 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-43fe211e-1c7a-4e46-8328-ef204910a454 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:09.164668 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-43fe211e-1c7a-4e46-8328-ef204910a454 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e" status: 200 len: 1325 microversion: 2.1 time: 0.528284 Aug 24 10:19:09.168927 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 811/1790] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:08 2022] GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e => generated 1325 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:09.181312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9eec446a-9b19-4030-9dfd-2a4e3e88d3fe req-c2411858-90aa-435c-9d3f-23682c88ccfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26944760-9a04-4f1a-8d41-148a947f41f1", "name": "network-vif-deleted", "tag": "3139e3fc-0583-464d-9f47-1476780c5e66"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:09.208379 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9eec446a-9b19-4030-9dfd-2a4e3e88d3fe req-c2411858-90aa-435c-9d3f-23682c88ccfc service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:09.210214 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9eec446a-9b19-4030-9dfd-2a4e3e88d3fe req-c2411858-90aa-435c-9d3f-23682c88ccfc service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:09.211754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9eec446a-9b19-4030-9dfd-2a4e3e88d3fe req-c2411858-90aa-435c-9d3f-23682c88ccfc service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:09.240055 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9eec446a-9b19-4030-9dfd-2a4e3e88d3fe req-c2411858-90aa-435c-9d3f-23682c88ccfc service nova] Creating event network-vif-deleted:3139e3fc-0583-464d-9f47-1476780c5e66 for instance 26944760-9a04-4f1a-8d41-148a947f41f1 on n-h2-849328-3 Aug 24 10:19:09.254585 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9eec446a-9b19-4030-9dfd-2a4e3e88d3fe req-c2411858-90aa-435c-9d3f-23682c88ccfc service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082945 Aug 24 10:19:09.261200 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 812/1791] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:09.275776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd7dc4b8-a6fc-408f-9af5-ff3b4f3a4db7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:09.285726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dd7dc4b8-a6fc-408f-9af5-ff3b4f3a4db7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:09.302259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd7dc4b8-a6fc-408f-9af5-ff3b4f3a4db7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:09.303761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd7dc4b8-a6fc-408f-9af5-ff3b4f3a4db7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:09.304522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd7dc4b8-a6fc-408f-9af5-ff3b4f3a4db7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:09.305792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd7dc4b8-a6fc-408f-9af5-ff3b4f3a4db7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:09.306863 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd7dc4b8-a6fc-408f-9af5-ff3b4f3a4db7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:09.307929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd7dc4b8-a6fc-408f-9af5-ff3b4f3a4db7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:09.375823 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd7dc4b8-a6fc-408f-9af5-ff3b4f3a4db7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:09.376745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd7dc4b8-a6fc-408f-9af5-ff3b4f3a4db7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:09.377671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd7dc4b8-a6fc-408f-9af5-ff3b4f3a4db7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:09.378517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-dd7dc4b8-a6fc-408f-9af5-ff3b4f3a4db7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lazy-loading 'fault' on Instance uuid 26944760-9a04-4f1a-8d41-148a947f41f1 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:19:09.502448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dd7dc4b8-a6fc-408f-9af5-ff3b4f3a4db7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:09.527317 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-043accd3-b392-4506-b442-e53052c8885c tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1857 microversion: 2.1 time: 0.600187 Aug 24 10:19:09.529171 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 980/1792] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:08 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1857 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:09.541411 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dd7dc4b8-a6fc-408f-9af5-ff3b4f3a4db7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:09.542882 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dd7dc4b8-a6fc-408f-9af5-ff3b4f3a4db7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:09.548308 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dd7dc4b8-a6fc-408f-9af5-ff3b4f3a4db7 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 200 len: 1351 microversion: 2.25 time: 0.281918 Aug 24 10:19:09.557835 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 813/1793] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:09 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 1351 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:09.580511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ec5de71-ee80-4b1b-82cb-a9b04ae72266 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:09.583806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9b9a447b-170e-4978-b271-e465f1cc5e68 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-849328-3", "block_migration": true, "disk_over_commit": false}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:09.588981 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4ec5de71-ee80-4b1b-82cb-a9b04ae72266 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:09.589254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9b9a447b-170e-4978-b271-e465f1cc5e68 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:09.596699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b9a447b-170e-4978-b271-e465f1cc5e68 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:09.598903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b9a447b-170e-4978-b271-e465f1cc5e68 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:09.599661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b9a447b-170e-4978-b271-e465f1cc5e68 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:09.600873 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b9a447b-170e-4978-b271-e465f1cc5e68 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:09.601562 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b9a447b-170e-4978-b271-e465f1cc5e68 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:09.602165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b9a447b-170e-4978-b271-e465f1cc5e68 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:09.602570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ec5de71-ee80-4b1b-82cb-a9b04ae72266 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:09.603432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ec5de71-ee80-4b1b-82cb-a9b04ae72266 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:09.604285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ec5de71-ee80-4b1b-82cb-a9b04ae72266 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:09.606061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ec5de71-ee80-4b1b-82cb-a9b04ae72266 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:09.607642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ec5de71-ee80-4b1b-82cb-a9b04ae72266 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:09.608712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ec5de71-ee80-4b1b-82cb-a9b04ae72266 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:09.664512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-9b9a447b-170e-4978-b271-e465f1cc5e68 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lazy-loading 'flavor' on Instance uuid 4d844e7a-a6af-4c55-957c-a997c42927af {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:19:09.723789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9b9a447b-170e-4978-b271-e465f1cc5e68 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Going to try to live migrate instance to n-h2-849328-3 {{(pid=122432) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 10:19:10.225302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4ec5de71-ee80-4b1b-82cb-a9b04ae72266 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:10.237802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4ec5de71-ee80-4b1b-82cb-a9b04ae72266 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:10.240103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4ec5de71-ee80-4b1b-82cb-a9b04ae72266 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:10.242118 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4ec5de71-ee80-4b1b-82cb-a9b04ae72266 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1874 microversion: 2.32 time: 0.698747 Aug 24 10:19:10.243309 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 981/1794] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:09 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1874 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:10.260134 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4c27c2c4-e736-428b-8404-883a60456015 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:10.262449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4c27c2c4-e736-428b-8404-883a60456015 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:10.269104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c27c2c4-e736-428b-8404-883a60456015 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:10.269658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c27c2c4-e736-428b-8404-883a60456015 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:10.270109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c27c2c4-e736-428b-8404-883a60456015 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:10.270813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c27c2c4-e736-428b-8404-883a60456015 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:10.271544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c27c2c4-e736-428b-8404-883a60456015 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:10.271978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c27c2c4-e736-428b-8404-883a60456015 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:10.468004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4c27c2c4-e736-428b-8404-883a60456015 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:10.483289 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4c27c2c4-e736-428b-8404-883a60456015 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:10.485452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4c27c2c4-e736-428b-8404-883a60456015 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:10.492545 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4c27c2c4-e736-428b-8404-883a60456015 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1437 microversion: 2.75 time: 0.247340 Aug 24 10:19:10.499906 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 982/1795] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:10 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1437 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:10.507574 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7a937c80-44e6-4f5f-ac85-cd0c32035b81 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:10.509006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7a937c80-44e6-4f5f-ac85-cd0c32035b81 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 7bbf838d-132a-449c-985e-3485e9c4b9fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:10.526771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a937c80-44e6-4f5f-ac85-cd0c32035b81 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:10.527896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a937c80-44e6-4f5f-ac85-cd0c32035b81 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:10.529762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a937c80-44e6-4f5f-ac85-cd0c32035b81 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:10.531366 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a937c80-44e6-4f5f-ac85-cd0c32035b81 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:10.532213 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a937c80-44e6-4f5f-ac85-cd0c32035b81 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:10.532939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a937c80-44e6-4f5f-ac85-cd0c32035b81 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:10.561467 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-7a937c80-44e6-4f5f-ac85-cd0c32035b81 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] HTTP exception thrown: Instance 7bbf838d-132a-449c-985e-3485e9c4b9fe could not be found. Aug 24 10:19:10.564593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7a937c80-44e6-4f5f-ac85-cd0c32035b81 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Request method failure captured: Aug 24 10:19:10.564593 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe HTTP/1.1 Aug 24 10:19:10.564593 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:19:10.564593 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:19:10.564593 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:19:10.564593 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:19:10.564593 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:19:10.564593 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:19:10.564593 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:19:10.564593 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:19:10.564593 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfpDGwdcx8Dl_0RCgObkRMAdG8Unp7I9S9rTJJz2QvpkwYMyshTKU570fIQ_35DMTCTZN2WONzkw8Zt0vZ4eHEEqH2wZmj5xZhqYcVx037gtADb9QDvMV3liUoMZtmMY3ArGj9BorxxgYEoeMicBg2cMyZCUP75OcMRQW1zmFK1g-zg Aug 24 10:19:10.564593 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:19:10.564593 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:19:10.564593 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:19:10.564593 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:19:10.564593 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:19:10.564593 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:19:10.564593 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: e6dcc3fc5b544363b1fcaadd50ea948a Aug 24 10:19:10.564593 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersAdminTestJSON-853616280 Aug 24 10:19:10.564593 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:19:10.564593 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:19:10.567777 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6dcc3fc5b544363b1fcaadd50ea948a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e6dcc3fc5b544363b1fcaadd50ea948a", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6dcc3fc5b544363b1fcaadd50ea948a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e6dcc3fc5b544363b1fcaadd50ea948a"}]}] Aug 24 10:19:10.567777 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersAdminTestJSON-853616280 Aug 24 10:19:10.567777 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: e6dcc3fc5b544363b1fcaadd50ea948a Aug 24 10:19:10.567777 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersAdminTestJSON-853616280 Aug 24 10:19:10.567777 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersAdminTestJSON-853616280-project Aug 24 10:19:10.567777 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:19:10.567777 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:19:10.567777 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 965e7789d7d942a793b07f71dd407fd8 Aug 24 10:19:10.567777 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersAdminTestJSON-853616280-project Aug 24 10:19:10.567777 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:19:10.567777 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 7bbf838d-132a-449c-985e-3485e9c4b9fe could not be found. Aug 24 10:19:10.567777 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '7bbf838d-132a-449c-985e-3485e9c4b9fe'} Aug 24 10:19:10.569351 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:19:10.569351 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:10.569351 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:19:10.569351 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:19:10.569351 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:19:10.569351 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:19:10.569351 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:19:10.569351 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:19:10.569351 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:19:10.569351 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:19:10.569351 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bbf838d-132a-449c-985e-3485e9c4b9fe could not be found. Aug 24 10:19:10.569351 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:10.569351 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:10.569351 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:10.569351 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:10.569351 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:10.569351 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:10.569351 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:19:10.569351 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:19:10.569351 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:19:10.571912 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:19:10.571912 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:19:10.571912 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:19:10.571912 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:19:10.571912 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:19:10.571912 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:19:10.571912 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:19:10.571912 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bbf838d-132a-449c-985e-3485e9c4b9fe could not be found. Aug 24 10:19:10.571912 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:10.571912 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:10.571912 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:10.571912 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:10.571912 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:10.571912 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:10.571912 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:19:10.571912 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:19:10.571912 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bbf838d-132a-449c-985e-3485e9c4b9fe could not be found. Aug 24 10:19:10.571912 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:10.575307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7a937c80-44e6-4f5f-ac85-cd0c32035b81 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Returning 404 to user: Instance 7bbf838d-132a-449c-985e-3485e9c4b9fe could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:19:10.575307 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7a937c80-44e6-4f5f-ac85-cd0c32035b81 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe" status: 404 len: 111 microversion: 2.1 time: 0.065286 Aug 24 10:19:10.575307 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 983/1796] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:10 2022] GET /compute/v2.1/servers/7bbf838d-132a-449c-985e-3485e9c4b9fe => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:19:10.577684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3066edb-330b-4aaf-9b8e-9574ea52f84f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:10.579344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d3066edb-330b-4aaf-9b8e-9574ea52f84f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 6f46192a-0f63-45dd-9ca9-7fda5730ef6e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:10.598977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3066edb-330b-4aaf-9b8e-9574ea52f84f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:10.600045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3066edb-330b-4aaf-9b8e-9574ea52f84f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:10.601352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3066edb-330b-4aaf-9b8e-9574ea52f84f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:10.602757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3066edb-330b-4aaf-9b8e-9574ea52f84f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:10.603820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3066edb-330b-4aaf-9b8e-9574ea52f84f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:10.604861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3066edb-330b-4aaf-9b8e-9574ea52f84f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:10.866049 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:10.868411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d3066edb-330b-4aaf-9b8e-9574ea52f84f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:10.879880 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d3066edb-330b-4aaf-9b8e-9574ea52f84f tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e" status: 200 len: 1325 microversion: 2.1 time: 0.306973 Aug 24 10:19:10.880797 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 984/1797] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:10 2022] GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e => generated 1325 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:10.887566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9f3f7866-60b6-4367-b348-9eb6f0316df9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:10.891833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9f3f7866-60b6-4367-b348-9eb6f0316df9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:10.904268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f3f7866-60b6-4367-b348-9eb6f0316df9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:10.904787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f3f7866-60b6-4367-b348-9eb6f0316df9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:10.905245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f3f7866-60b6-4367-b348-9eb6f0316df9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:10.906175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f3f7866-60b6-4367-b348-9eb6f0316df9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:10.906636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f3f7866-60b6-4367-b348-9eb6f0316df9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:10.907058 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f3f7866-60b6-4367-b348-9eb6f0316df9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:10.948974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:11.044932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-9f3f7866-60b6-4367-b348-9eb6f0316df9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:19:11.045813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-9f3f7866-60b6-4367-b348-9eb6f0316df9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:19:11.046910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-9f3f7866-60b6-4367-b348-9eb6f0316df9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:19:11.047713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-9f3f7866-60b6-4367-b348-9eb6f0316df9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:19:11.048937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-9f3f7866-60b6-4367-b348-9eb6f0316df9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:19:11.179687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9f3f7866-60b6-4367-b348-9eb6f0316df9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:11.189579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f3f7866-60b6-4367-b348-9eb6f0316df9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:11.190516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f3f7866-60b6-4367-b348-9eb6f0316df9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:11.191484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f3f7866-60b6-4367-b348-9eb6f0316df9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:11.192619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f3f7866-60b6-4367-b348-9eb6f0316df9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:11.193196 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f3f7866-60b6-4367-b348-9eb6f0316df9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:11.193690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f3f7866-60b6-4367-b348-9eb6f0316df9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:11.303587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9f3f7866-60b6-4367-b348-9eb6f0316df9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:11.323309 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9f3f7866-60b6-4367-b348-9eb6f0316df9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:11.327653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9f3f7866-60b6-4367-b348-9eb6f0316df9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:11.343038 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9f3f7866-60b6-4367-b348-9eb6f0316df9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "POST /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc/action" status: 202 len: 1494 microversion: 2.75 time: 0.460186 Aug 24 10:19:11.345064 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 985/1798] 10.222.0.85 () {62 vars in 1319 bytes} [Wed Aug 24 10:19:10 2022] POST /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc/action => generated 1494 bytes in 463 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 24 10:19:11.350282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1f683353-93e8-42ef-8796-863204b26345 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:11.351037 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1f683353-93e8-42ef-8796-863204b26345 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:11.360818 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f683353-93e8-42ef-8796-863204b26345 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:11.361841 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f683353-93e8-42ef-8796-863204b26345 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:11.362839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f683353-93e8-42ef-8796-863204b26345 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:11.363851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f683353-93e8-42ef-8796-863204b26345 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:11.364527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f683353-93e8-42ef-8796-863204b26345 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:11.365348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f683353-93e8-42ef-8796-863204b26345 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:11.403911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1f683353-93e8-42ef-8796-863204b26345 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:19:11.590844 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1f683353-93e8-42ef-8796-863204b26345 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "DELETE /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 204 len: 0 microversion: 2.1 time: 0.243578 Aug 24 10:19:11.595412 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 986/1799] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:19:11 2022] DELETE /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:19:11.602387 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-253c9496-3a1f-4a81-a095-49f2cc187de8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:11.603252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-253c9496-3a1f-4a81-a095-49f2cc187de8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 26944760-9a04-4f1a-8d41-148a947f41f1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:11.611803 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-253c9496-3a1f-4a81-a095-49f2cc187de8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:11.612426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-253c9496-3a1f-4a81-a095-49f2cc187de8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:11.613102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-253c9496-3a1f-4a81-a095-49f2cc187de8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:11.613975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-253c9496-3a1f-4a81-a095-49f2cc187de8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:11.615935 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-253c9496-3a1f-4a81-a095-49f2cc187de8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:11.616922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-253c9496-3a1f-4a81-a095-49f2cc187de8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:11.635339 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-253c9496-3a1f-4a81-a095-49f2cc187de8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] HTTP exception thrown: Instance 26944760-9a04-4f1a-8d41-148a947f41f1 could not be found. Aug 24 10:19:11.637309 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-253c9496-3a1f-4a81-a095-49f2cc187de8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Request method failure captured: Aug 24 10:19:11.637309 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 HTTP/1.1 Aug 24 10:19:11.637309 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:19:11.637309 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:19:11.637309 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:19:11.637309 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:19:11.637309 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:19:11.637309 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:19:11.637309 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:19:11.637309 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:19:11.637309 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfldrKdWWwgO0XW__bQAWjGC52fxRL20rk6I6t2eKmY9-12ECHIqc8L1_2OEYmTV_PZU72KFY-HhmZUBgc7KK3rbu1N_1aNl-LGrcsfLFCQiOsVapHVjHI0UqR9nLYtVZhzlpA1soVu1vQGcsoRjo9Bj89t0F8yT-rvJOZDsorNLGJQ Aug 24 10:19:11.637309 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:19:11.637309 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:19:11.637309 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:19:11.637309 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:19:11.637309 n-d-849328-3 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.25 Aug 24 10:19:11.637309 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:19:11.637309 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:19:11.637309 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 34b2b8fc487d4a6abb08f132e0f0c1da Aug 24 10:19:11.637309 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1165112608 Aug 24 10:19:11.637309 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:19:11.637309 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:19:11.638945 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/34b2b8fc487d4a6abb08f132e0f0c1da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_34b2b8fc487d4a6abb08f132e0f0c1da", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/34b2b8fc487d4a6abb08f132e0f0c1da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/34b2b8fc487d4a6abb08f132e0f0c1da"}]}] Aug 24 10:19:11.638945 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1165112608 Aug 24 10:19:11.638945 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 34b2b8fc487d4a6abb08f132e0f0c1da Aug 24 10:19:11.638945 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1165112608 Aug 24 10:19:11.638945 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-LiveAutoBlockMigrationV225Test-1165112608-project Aug 24 10:19:11.638945 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:19:11.638945 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:19:11.638945 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: dfd26847179f4f2bab0c9f673de0c303 Aug 24 10:19:11.638945 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1165112608-project Aug 24 10:19:11.638945 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:19:11.638945 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 26944760-9a04-4f1a-8d41-148a947f41f1 could not be found. Aug 24 10:19:11.638945 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '26944760-9a04-4f1a-8d41-148a947f41f1'} Aug 24 10:19:11.639766 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:19:11.639766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:11.639766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:19:11.639766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:19:11.639766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:19:11.639766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:19:11.639766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:19:11.639766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:19:11.639766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:19:11.639766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:19:11.639766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26944760-9a04-4f1a-8d41-148a947f41f1 could not be found. Aug 24 10:19:11.639766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:11.639766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:11.639766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:11.639766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:11.639766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:11.639766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:11.639766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:19:11.639766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:19:11.639766 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:19:11.641195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:19:11.641195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:19:11.641195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:19:11.641195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:19:11.641195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:19:11.641195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:19:11.641195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:19:11.641195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26944760-9a04-4f1a-8d41-148a947f41f1 could not be found. Aug 24 10:19:11.641195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:11.641195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:11.641195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:11.641195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:11.641195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:11.641195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:11.641195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:19:11.641195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:19:11.641195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26944760-9a04-4f1a-8d41-148a947f41f1 could not be found. Aug 24 10:19:11.641195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:11.644419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-253c9496-3a1f-4a81-a095-49f2cc187de8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Returning 404 to user: Instance 26944760-9a04-4f1a-8d41-148a947f41f1 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:19:11.645699 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-253c9496-3a1f-4a81-a095-49f2cc187de8 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1" status: 404 len: 111 microversion: 2.25 time: 0.048798 Aug 24 10:19:11.646519 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 987/1800] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:11 2022] GET /compute/v2.1/servers/26944760-9a04-4f1a-8d41-148a947f41f1 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:19:11.651591 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-61bb803b-7506-454b-9ea7-a301aff29818 req-af2cb2a5-d61a-41c8-94b3-f0d66d0ae773 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f46192a-0f63-45dd-9ca9-7fda5730ef6e", "tag": "d1e13e32-aa4b-434a-8dbc-621e15239757"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:11.662802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-61bb803b-7506-454b-9ea7-a301aff29818 req-af2cb2a5-d61a-41c8-94b3-f0d66d0ae773 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:11.663688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-61bb803b-7506-454b-9ea7-a301aff29818 req-af2cb2a5-d61a-41c8-94b3-f0d66d0ae773 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:11.664458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-61bb803b-7506-454b-9ea7-a301aff29818 req-af2cb2a5-d61a-41c8-94b3-f0d66d0ae773 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:11.681007 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-61bb803b-7506-454b-9ea7-a301aff29818 req-af2cb2a5-d61a-41c8-94b3-f0d66d0ae773 service nova] Creating event network-changed:d1e13e32-aa4b-434a-8dbc-621e15239757 for instance 6f46192a-0f63-45dd-9ca9-7fda5730ef6e on n-h1-849328-3 Aug 24 10:19:11.687354 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-61bb803b-7506-454b-9ea7-a301aff29818 req-af2cb2a5-d61a-41c8-94b3-f0d66d0ae773 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039373 Aug 24 10:19:11.688131 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 988/1801] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:11.696447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f2ebd4e3-8566-46b6-bade-c12b4917dc46 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:11.698140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f2ebd4e3-8566-46b6-bade-c12b4917dc46 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:11.708236 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2ebd4e3-8566-46b6-bade-c12b4917dc46 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:11.709283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2ebd4e3-8566-46b6-bade-c12b4917dc46 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:11.709970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2ebd4e3-8566-46b6-bade-c12b4917dc46 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:11.711733 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2ebd4e3-8566-46b6-bade-c12b4917dc46 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:11.712632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2ebd4e3-8566-46b6-bade-c12b4917dc46 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:11.713315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2ebd4e3-8566-46b6-bade-c12b4917dc46 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:12.039548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f2ebd4e3-8566-46b6-bade-c12b4917dc46 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:12.050969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f2ebd4e3-8566-46b6-bade-c12b4917dc46 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:12.052484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f2ebd4e3-8566-46b6-bade-c12b4917dc46 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:12.053938 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f2ebd4e3-8566-46b6-bade-c12b4917dc46 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1874 microversion: 2.32 time: 0.364479 Aug 24 10:19:12.069197 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 989/1802] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:11 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1874 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:12.079316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-ec66605f-7a6c-457a-b090-5bac3e9a7ea5 req-cee2ca0b-ed8f-41c0-8364-6cab121f788a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd", "name": "network-vif-plugged", "status": "completed", "tag": "86a08323-7386-4e0b-baa9-7af8e90f13c9"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:12.091109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ec66605f-7a6c-457a-b090-5bac3e9a7ea5 req-cee2ca0b-ed8f-41c0-8364-6cab121f788a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:12.091942 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ec66605f-7a6c-457a-b090-5bac3e9a7ea5 req-cee2ca0b-ed8f-41c0-8364-6cab121f788a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:12.092592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ec66605f-7a6c-457a-b090-5bac3e9a7ea5 req-cee2ca0b-ed8f-41c0-8364-6cab121f788a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:12.098801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=14 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:12.113677 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-ec66605f-7a6c-457a-b090-5bac3e9a7ea5 req-cee2ca0b-ed8f-41c0-8364-6cab121f788a service nova] Creating event network-vif-plugged:86a08323-7386-4e0b-baa9-7af8e90f13c9 for instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd on n-h2-849328-3 Aug 24 10:19:12.122785 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-ec66605f-7a6c-457a-b090-5bac3e9a7ea5 req-cee2ca0b-ed8f-41c0-8364-6cab121f788a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051625 Aug 24 10:19:12.123664 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 990/1803] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:12.129972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-31665fa0-feed-4845-9011-4d9b118126d2 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:12.130675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-31665fa0-feed-4845-9011-4d9b118126d2 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:12.142201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31665fa0-feed-4845-9011-4d9b118126d2 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:12.143168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31665fa0-feed-4845-9011-4d9b118126d2 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:12.143937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31665fa0-feed-4845-9011-4d9b118126d2 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:12.145165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31665fa0-feed-4845-9011-4d9b118126d2 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:12.145930 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31665fa0-feed-4845-9011-4d9b118126d2 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:12.147178 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31665fa0-feed-4845-9011-4d9b118126d2 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:12.270538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-31665fa0-feed-4845-9011-4d9b118126d2 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:12.289187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-31665fa0-feed-4845-9011-4d9b118126d2 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:12.292387 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-31665fa0-feed-4845-9011-4d9b118126d2 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:12.301629 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-31665fa0-feed-4845-9011-4d9b118126d2 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1446 microversion: 2.75 time: 0.176472 Aug 24 10:19:12.325272 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 991/1804] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:12 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1446 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:12.339199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dcbdce43-4945-40fd-b8fb-eef05fa320d5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:12.339910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dcbdce43-4945-40fd-b8fb-eef05fa320d5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:12.347251 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcbdce43-4945-40fd-b8fb-eef05fa320d5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:12.347750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcbdce43-4945-40fd-b8fb-eef05fa320d5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:12.348382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcbdce43-4945-40fd-b8fb-eef05fa320d5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:12.349331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcbdce43-4945-40fd-b8fb-eef05fa320d5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:12.349959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcbdce43-4945-40fd-b8fb-eef05fa320d5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:12.350554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcbdce43-4945-40fd-b8fb-eef05fa320d5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:12.627354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dcbdce43-4945-40fd-b8fb-eef05fa320d5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:12.639104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:12.662343 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dcbdce43-4945-40fd-b8fb-eef05fa320d5 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1468 microversion: 2.1 time: 0.334824 Aug 24 10:19:12.673743 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 992/1805] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:12 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1468 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:12.716626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0cee341f-0ed3-4e76-9ed4-a16f3ce4e2d5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:12.719563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0cee341f-0ed3-4e76-9ed4-a16f3ce4e2d5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:12.731080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cee341f-0ed3-4e76-9ed4-a16f3ce4e2d5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:12.732028 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cee341f-0ed3-4e76-9ed4-a16f3ce4e2d5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:12.732912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cee341f-0ed3-4e76-9ed4-a16f3ce4e2d5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:12.734292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cee341f-0ed3-4e76-9ed4-a16f3ce4e2d5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:12.735134 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cee341f-0ed3-4e76-9ed4-a16f3ce4e2d5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:12.736374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cee341f-0ed3-4e76-9ed4-a16f3ce4e2d5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:12.790026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0cee341f-0ed3-4e76-9ed4-a16f3ce4e2d5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:19:12.938121 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0cee341f-0ed3-4e76-9ed4-a16f3ce4e2d5 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "DELETE /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 204 len: 0 microversion: 2.25 time: 0.261608 Aug 24 10:19:12.938783 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 993/1806] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:19:12 2022] DELETE /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:19:12.948115 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-20fbea64-677c-4d63-9bc8-2f1de470f0af tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:12.948852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-20fbea64-677c-4d63-9bc8-2f1de470f0af tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 6f46192a-0f63-45dd-9ca9-7fda5730ef6e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:12.955258 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20fbea64-677c-4d63-9bc8-2f1de470f0af tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:12.955786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20fbea64-677c-4d63-9bc8-2f1de470f0af tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:12.956159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20fbea64-677c-4d63-9bc8-2f1de470f0af tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:12.956862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20fbea64-677c-4d63-9bc8-2f1de470f0af tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:12.957351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20fbea64-677c-4d63-9bc8-2f1de470f0af tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:12.957772 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20fbea64-677c-4d63-9bc8-2f1de470f0af tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:13.119906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-20fbea64-677c-4d63-9bc8-2f1de470f0af tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:13.129020 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-20fbea64-677c-4d63-9bc8-2f1de470f0af tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e" status: 200 len: 1325 microversion: 2.1 time: 0.185242 Aug 24 10:19:13.129678 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 994/1807] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:12 2022] GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e => generated 1325 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:13.134576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d928ce71-cfac-4417-b923-d50e82663c7e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:13.135193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d928ce71-cfac-4417-b923-d50e82663c7e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:13.143898 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d928ce71-cfac-4417-b923-d50e82663c7e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:13.144399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d928ce71-cfac-4417-b923-d50e82663c7e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:13.144838 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d928ce71-cfac-4417-b923-d50e82663c7e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:13.145588 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d928ce71-cfac-4417-b923-d50e82663c7e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:13.146042 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d928ce71-cfac-4417-b923-d50e82663c7e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:13.146470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d928ce71-cfac-4417-b923-d50e82663c7e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:13.359211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d928ce71-cfac-4417-b923-d50e82663c7e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:13.377376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d928ce71-cfac-4417-b923-d50e82663c7e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:13.380675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d928ce71-cfac-4417-b923-d50e82663c7e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:13.383919 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d928ce71-cfac-4417-b923-d50e82663c7e tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 200 len: 1565 microversion: 2.25 time: 0.252086 Aug 24 10:19:13.405246 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 995/1808] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:13 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 1565 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:13.414212 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9ff80010-bbc8-4277-aa97-c4bcb149b9db tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:13.415262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9ff80010-bbc8-4277-aa97-c4bcb149b9db tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:13.424384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ff80010-bbc8-4277-aa97-c4bcb149b9db tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:13.424890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ff80010-bbc8-4277-aa97-c4bcb149b9db tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:13.425390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ff80010-bbc8-4277-aa97-c4bcb149b9db tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:13.426123 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ff80010-bbc8-4277-aa97-c4bcb149b9db tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:13.426591 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ff80010-bbc8-4277-aa97-c4bcb149b9db tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:13.427028 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ff80010-bbc8-4277-aa97-c4bcb149b9db tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:13.728587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9ff80010-bbc8-4277-aa97-c4bcb149b9db tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:13.738859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9ff80010-bbc8-4277-aa97-c4bcb149b9db tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:13.740398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9ff80010-bbc8-4277-aa97-c4bcb149b9db tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:13.742756 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9ff80010-bbc8-4277-aa97-c4bcb149b9db tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1874 microversion: 2.32 time: 0.336219 Aug 24 10:19:13.758003 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 996/1809] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:13 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1874 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:13.765531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-95d9b044-46f2-4b1d-83a3-147add5f8536 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:13.766270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-95d9b044-46f2-4b1d-83a3-147add5f8536 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:13.773066 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95d9b044-46f2-4b1d-83a3-147add5f8536 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:13.773609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95d9b044-46f2-4b1d-83a3-147add5f8536 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:13.774173 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95d9b044-46f2-4b1d-83a3-147add5f8536 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:13.774902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95d9b044-46f2-4b1d-83a3-147add5f8536 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:13.775366 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95d9b044-46f2-4b1d-83a3-147add5f8536 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:13.775796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95d9b044-46f2-4b1d-83a3-147add5f8536 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:13.935535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-95d9b044-46f2-4b1d-83a3-147add5f8536 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:13.964027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-95d9b044-46f2-4b1d-83a3-147add5f8536 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:13.967203 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-95d9b044-46f2-4b1d-83a3-147add5f8536 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:13.992921 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-95d9b044-46f2-4b1d-83a3-147add5f8536 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1446 microversion: 2.75 time: 0.233281 Aug 24 10:19:13.994208 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 997/1810] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:13 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1446 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:14.019832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7d0ac677-bd6a-46a8-992f-36410ffd850b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:14.020891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7d0ac677-bd6a-46a8-992f-36410ffd850b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:14.043010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d0ac677-bd6a-46a8-992f-36410ffd850b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:14.043872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d0ac677-bd6a-46a8-992f-36410ffd850b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:14.049294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d0ac677-bd6a-46a8-992f-36410ffd850b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:14.051302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d0ac677-bd6a-46a8-992f-36410ffd850b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:14.052167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d0ac677-bd6a-46a8-992f-36410ffd850b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:14.057474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d0ac677-bd6a-46a8-992f-36410ffd850b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:14.440945 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9b9a447b-170e-4978-b271-e465f1cc5e68 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af/action" status: 202 len: 0 microversion: 2.1 time: 4.868639 Aug 24 10:19:14.442266 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 814/1811] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:19:09 2022] POST /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af/action => generated 0 bytes in 4871 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 10:19:14.449316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f2e467dc-5a35-4667-88f7-db3fc2a36688 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:14.450363 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f2e467dc-5a35-4667-88f7-db3fc2a36688 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 6f46192a-0f63-45dd-9ca9-7fda5730ef6e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:14.460142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2e467dc-5a35-4667-88f7-db3fc2a36688 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:14.460983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2e467dc-5a35-4667-88f7-db3fc2a36688 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:14.461798 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2e467dc-5a35-4667-88f7-db3fc2a36688 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:14.462582 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2e467dc-5a35-4667-88f7-db3fc2a36688 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:14.464221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2e467dc-5a35-4667-88f7-db3fc2a36688 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:14.465431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2e467dc-5a35-4667-88f7-db3fc2a36688 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:14.521887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7d0ac677-bd6a-46a8-992f-36410ffd850b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:14.533216 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7d0ac677-bd6a-46a8-992f-36410ffd850b tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1468 microversion: 2.1 time: 0.537667 Aug 24 10:19:14.538361 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 998/1812] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:13 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1468 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:14.553209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-bed8d5f3-2261-4291-af68-a935dde81cfb req-ed828ff3-c87e-4008-a7d7-3a1bef81005c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd", "name": "network-vif-plugged", "status": "completed", "tag": "b514d0b1-f7ce-48d8-aa66-0c3c1daca01e"}, {"server_uuid": "4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd", "name": "network-vif-plugged", "status": "completed", "tag": "526b6293-9fd8-4d13-a1f7-daec4c52af4a"}, {"server_uuid": "4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd", "name": "network-vif-plugged", "status": "completed", "tag": "0d17d5fc-1b53-4721-ba1b-68c986a9e1dc"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:14.565530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:14.580959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bed8d5f3-2261-4291-af68-a935dde81cfb req-ed828ff3-c87e-4008-a7d7-3a1bef81005c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:14.581393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bed8d5f3-2261-4291-af68-a935dde81cfb req-ed828ff3-c87e-4008-a7d7-3a1bef81005c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:14.581829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bed8d5f3-2261-4291-af68-a935dde81cfb req-ed828ff3-c87e-4008-a7d7-3a1bef81005c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:14.610252 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-bed8d5f3-2261-4291-af68-a935dde81cfb req-ed828ff3-c87e-4008-a7d7-3a1bef81005c service nova] Creating event network-vif-plugged:b514d0b1-f7ce-48d8-aa66-0c3c1daca01e for instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd on n-h2-849328-3 Aug 24 10:19:14.610252 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-bed8d5f3-2261-4291-af68-a935dde81cfb req-ed828ff3-c87e-4008-a7d7-3a1bef81005c service nova] Creating event network-vif-plugged:526b6293-9fd8-4d13-a1f7-daec4c52af4a for instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd on n-h2-849328-3 Aug 24 10:19:14.610728 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-bed8d5f3-2261-4291-af68-a935dde81cfb req-ed828ff3-c87e-4008-a7d7-3a1bef81005c service nova] Creating event network-vif-plugged:0d17d5fc-1b53-4721-ba1b-68c986a9e1dc for instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd on n-h2-849328-3 Aug 24 10:19:14.631465 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-bed8d5f3-2261-4291-af68-a935dde81cfb req-ed828ff3-c87e-4008-a7d7-3a1bef81005c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.090223 Aug 24 10:19:14.632639 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 999/1813] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:14.658503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7982c7cd-29b9-44b9-b25c-b37e156cbf28 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:14.662052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7982c7cd-29b9-44b9-b25c-b37e156cbf28 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:14.688258 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7982c7cd-29b9-44b9-b25c-b37e156cbf28 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:14.689717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7982c7cd-29b9-44b9-b25c-b37e156cbf28 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:14.690766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7982c7cd-29b9-44b9-b25c-b37e156cbf28 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:14.694363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7982c7cd-29b9-44b9-b25c-b37e156cbf28 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:14.697583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7982c7cd-29b9-44b9-b25c-b37e156cbf28 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:14.702379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7982c7cd-29b9-44b9-b25c-b37e156cbf28 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:15.304646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7982c7cd-29b9-44b9-b25c-b37e156cbf28 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:15.317366 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7982c7cd-29b9-44b9-b25c-b37e156cbf28 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:15.323593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7982c7cd-29b9-44b9-b25c-b37e156cbf28 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:15.325254 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7982c7cd-29b9-44b9-b25c-b37e156cbf28 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 200 len: 1565 microversion: 2.25 time: 0.682520 Aug 24 10:19:15.331783 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1000/1814] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:14 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 1565 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:15.352089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bc8d62ef-b97e-4fee-b114-51450e809a2d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:15.353762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bc8d62ef-b97e-4fee-b114-51450e809a2d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:15.363231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc8d62ef-b97e-4fee-b114-51450e809a2d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:15.364053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc8d62ef-b97e-4fee-b114-51450e809a2d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:15.364722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc8d62ef-b97e-4fee-b114-51450e809a2d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:15.365813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc8d62ef-b97e-4fee-b114-51450e809a2d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:15.366514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc8d62ef-b97e-4fee-b114-51450e809a2d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:15.367576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc8d62ef-b97e-4fee-b114-51450e809a2d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:15.536732 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f2e467dc-5a35-4667-88f7-db3fc2a36688 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:15.551781 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f2e467dc-5a35-4667-88f7-db3fc2a36688 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e" status: 200 len: 1325 microversion: 2.1 time: 1.104189 Aug 24 10:19:15.552720 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 815/1815] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:14 2022] GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e => generated 1325 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:15.567735 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1d16cb08-01b6-4212-9e87-fe725dfe03fe tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:15.580569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1d16cb08-01b6-4212-9e87-fe725dfe03fe tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:15.604298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d16cb08-01b6-4212-9e87-fe725dfe03fe tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:15.605083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d16cb08-01b6-4212-9e87-fe725dfe03fe tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:15.606982 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d16cb08-01b6-4212-9e87-fe725dfe03fe tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:15.608574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d16cb08-01b6-4212-9e87-fe725dfe03fe tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:15.612579 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d16cb08-01b6-4212-9e87-fe725dfe03fe tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:15.613865 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d16cb08-01b6-4212-9e87-fe725dfe03fe tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:15.856679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bc8d62ef-b97e-4fee-b114-51450e809a2d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:15.867569 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bc8d62ef-b97e-4fee-b114-51450e809a2d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1716 microversion: 2.1 time: 0.520005 Aug 24 10:19:15.868535 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1001/1816] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:15 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1716 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:15.874784 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-421845ab-2b06-4f00-8345-f136448c70f3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:15.875668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-421845ab-2b06-4f00-8345-f136448c70f3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:15.885512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-421845ab-2b06-4f00-8345-f136448c70f3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:15.886375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-421845ab-2b06-4f00-8345-f136448c70f3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:15.886844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-421845ab-2b06-4f00-8345-f136448c70f3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:15.887633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-421845ab-2b06-4f00-8345-f136448c70f3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:15.888123 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-421845ab-2b06-4f00-8345-f136448c70f3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:15.888552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-421845ab-2b06-4f00-8345-f136448c70f3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:16.009083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-421845ab-2b06-4f00-8345-f136448c70f3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:16.023912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-421845ab-2b06-4f00-8345-f136448c70f3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:16.026647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-421845ab-2b06-4f00-8345-f136448c70f3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:16.042218 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-421845ab-2b06-4f00-8345-f136448c70f3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1446 microversion: 2.75 time: 0.172040 Aug 24 10:19:16.043019 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1002/1817] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:15 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1446 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:16.048744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-bfceb597-e2c0-4916-b30d-5351c475aa45 req-b8120c20-c312-423b-bb87-076488dbabfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b390fef-6be9-4e24-b31e-b6f6252c88c1", "name": "network-vif-deleted", "tag": "50041625-3e09-4ff3-9bab-8be84832b786"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:16.063437 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bfceb597-e2c0-4916-b30d-5351c475aa45 req-b8120c20-c312-423b-bb87-076488dbabfe service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:16.064220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bfceb597-e2c0-4916-b30d-5351c475aa45 req-b8120c20-c312-423b-bb87-076488dbabfe service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:16.064791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bfceb597-e2c0-4916-b30d-5351c475aa45 req-b8120c20-c312-423b-bb87-076488dbabfe service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:16.079902 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-bfceb597-e2c0-4916-b30d-5351c475aa45 req-b8120c20-c312-423b-bb87-076488dbabfe service nova] Creating event network-vif-deleted:50041625-3e09-4ff3-9bab-8be84832b786 for instance 6b390fef-6be9-4e24-b31e-b6f6252c88c1 on n-h2-849328-3 Aug 24 10:19:16.086729 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-bfceb597-e2c0-4916-b30d-5351c475aa45 req-b8120c20-c312-423b-bb87-076488dbabfe service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042328 Aug 24 10:19:16.087610 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1003/1818] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:16.101783 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3b31bb20-4b3b-4768-8653-4e480b565bfb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:16.102745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3b31bb20-4b3b-4768-8653-4e480b565bfb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:16.112265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b31bb20-4b3b-4768-8653-4e480b565bfb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:16.113176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b31bb20-4b3b-4768-8653-4e480b565bfb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:16.113781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b31bb20-4b3b-4768-8653-4e480b565bfb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:16.115367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b31bb20-4b3b-4768-8653-4e480b565bfb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:16.115997 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b31bb20-4b3b-4768-8653-4e480b565bfb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:16.116615 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b31bb20-4b3b-4768-8653-4e480b565bfb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:16.163221 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b31bb20-4b3b-4768-8653-4e480b565bfb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:16.164114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b31bb20-4b3b-4768-8653-4e480b565bfb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:16.164713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b31bb20-4b3b-4768-8653-4e480b565bfb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:16.165491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-3b31bb20-4b3b-4768-8653-4e480b565bfb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lazy-loading 'fault' on Instance uuid 6b390fef-6be9-4e24-b31e-b6f6252c88c1 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:19:16.252802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3b31bb20-4b3b-4768-8653-4e480b565bfb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e7789d7d942a793b07f71dd407fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dcc3fc5b544363b1fcaadd50ea948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:16.276125 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3b31bb20-4b3b-4768-8653-4e480b565bfb tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 200 len: 1303 microversion: 2.1 time: 0.185555 Aug 24 10:19:16.280491 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1004/1819] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:16 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 1303 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:16.360107 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cf0521d4-8c5b-4871-8bf1-71b383a213d4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:16.360689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cf0521d4-8c5b-4871-8bf1-71b383a213d4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:16.375598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0521d4-8c5b-4871-8bf1-71b383a213d4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:16.376372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0521d4-8c5b-4871-8bf1-71b383a213d4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:16.377089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0521d4-8c5b-4871-8bf1-71b383a213d4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:16.378302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0521d4-8c5b-4871-8bf1-71b383a213d4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:16.378988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0521d4-8c5b-4871-8bf1-71b383a213d4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:16.379642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0521d4-8c5b-4871-8bf1-71b383a213d4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:16.538347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1d16cb08-01b6-4212-9e87-fe725dfe03fe tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:16.548723 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1d16cb08-01b6-4212-9e87-fe725dfe03fe tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:16.550245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1d16cb08-01b6-4212-9e87-fe725dfe03fe tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:16.551642 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1d16cb08-01b6-4212-9e87-fe725dfe03fe tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1874 microversion: 2.32 time: 0.996520 Aug 24 10:19:16.552208 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 816/1820] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:15 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1874 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:16.573084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-2f7a6f14-25fa-4685-bf5c-9bf60d885d59 req-42339de8-6a76-465d-b59e-c0a0a2150d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "162790d5-1b97-47d9-b4df-c897b854a902", "name": "network-vif-deleted", "tag": "85bbaf28-5677-4b68-aba7-3a4c5c84ab6a"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:16.600739 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2f7a6f14-25fa-4685-bf5c-9bf60d885d59 req-42339de8-6a76-465d-b59e-c0a0a2150d72 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:16.601823 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2f7a6f14-25fa-4685-bf5c-9bf60d885d59 req-42339de8-6a76-465d-b59e-c0a0a2150d72 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:16.602686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2f7a6f14-25fa-4685-bf5c-9bf60d885d59 req-42339de8-6a76-465d-b59e-c0a0a2150d72 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:16.613929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cf0521d4-8c5b-4871-8bf1-71b383a213d4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:16.628934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cf0521d4-8c5b-4871-8bf1-71b383a213d4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:16.630377 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-2f7a6f14-25fa-4685-bf5c-9bf60d885d59 req-42339de8-6a76-465d-b59e-c0a0a2150d72 service nova] Creating event network-vif-deleted:85bbaf28-5677-4b68-aba7-3a4c5c84ab6a for instance 162790d5-1b97-47d9-b4df-c897b854a902 on n-h2-849328-3 Aug 24 10:19:16.630953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cf0521d4-8c5b-4871-8bf1-71b383a213d4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfd26847179f4f2bab0c9f673de0c303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b2b8fc487d4a6abb08f132e0f0c1da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:16.632450 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cf0521d4-8c5b-4871-8bf1-71b383a213d4 tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 200 len: 1523 microversion: 2.25 time: 0.276445 Aug 24 10:19:16.647694 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-2f7a6f14-25fa-4685-bf5c-9bf60d885d59 req-42339de8-6a76-465d-b59e-c0a0a2150d72 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078010 Aug 24 10:19:16.648562 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 817/1821] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:19:16.660298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b84db15b-a746-4cd8-be41-9fd4357e707d tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:16.662534 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1005/1822] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:16 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 1523 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:19:16.665100 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b84db15b-a746-4cd8-be41-9fd4357e707d tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 6f46192a-0f63-45dd-9ca9-7fda5730ef6e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:16.675835 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b84db15b-a746-4cd8-be41-9fd4357e707d tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:16.676340 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b84db15b-a746-4cd8-be41-9fd4357e707d tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:16.686040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b84db15b-a746-4cd8-be41-9fd4357e707d tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:16.688815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b84db15b-a746-4cd8-be41-9fd4357e707d tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:16.691806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b84db15b-a746-4cd8-be41-9fd4357e707d tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:16.692980 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b84db15b-a746-4cd8-be41-9fd4357e707d tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:16.698375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-47911503-9ce5-4704-ad31-e994eb80fbff req-f7fe5549-5164-4f33-877f-2483d1bfd6b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd", "name": "network-vif-plugged", "status": "completed", "tag": "8478aaa2-cb78-4f37-9c11-cebf1b8242a0"}, {"server_uuid": "4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd", "name": "network-vif-plugged", "status": "completed", "tag": "ad5894fd-cc27-4c32-ae3e-406eea701b47"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:16.711168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-47911503-9ce5-4704-ad31-e994eb80fbff req-f7fe5549-5164-4f33-877f-2483d1bfd6b8 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:16.712139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-47911503-9ce5-4704-ad31-e994eb80fbff req-f7fe5549-5164-4f33-877f-2483d1bfd6b8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:16.712831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-47911503-9ce5-4704-ad31-e994eb80fbff req-f7fe5549-5164-4f33-877f-2483d1bfd6b8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:16.726975 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-47911503-9ce5-4704-ad31-e994eb80fbff req-f7fe5549-5164-4f33-877f-2483d1bfd6b8 service nova] Creating event network-vif-plugged:8478aaa2-cb78-4f37-9c11-cebf1b8242a0 for instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd on n-h2-849328-3 Aug 24 10:19:16.727998 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-47911503-9ce5-4704-ad31-e994eb80fbff req-f7fe5549-5164-4f33-877f-2483d1bfd6b8 service nova] Creating event network-vif-plugged:ad5894fd-cc27-4c32-ae3e-406eea701b47 for instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd on n-h2-849328-3 Aug 24 10:19:16.734896 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-47911503-9ce5-4704-ad31-e994eb80fbff req-f7fe5549-5164-4f33-877f-2483d1bfd6b8 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041396 Aug 24 10:19:16.739513 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1006/1823] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:16.895723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-84478957-91c7-4566-b7e6-746836b5cb27 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:16.897075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-84478957-91c7-4566-b7e6-746836b5cb27 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:16.910766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84478957-91c7-4566-b7e6-746836b5cb27 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:16.911762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84478957-91c7-4566-b7e6-746836b5cb27 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:16.912213 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84478957-91c7-4566-b7e6-746836b5cb27 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:16.913008 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84478957-91c7-4566-b7e6-746836b5cb27 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:16.913500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84478957-91c7-4566-b7e6-746836b5cb27 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:16.913929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84478957-91c7-4566-b7e6-746836b5cb27 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:17.032575 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b84db15b-a746-4cd8-be41-9fd4357e707d tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:17.047250 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b84db15b-a746-4cd8-be41-9fd4357e707d tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e" status: 200 len: 1325 microversion: 2.1 time: 0.396914 Aug 24 10:19:17.077425 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 818/1824] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:16 2022] GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e => generated 1325 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:17.082722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b09c1bb4-c5ba-4faa-8575-cd49d9adbcb5 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:17.083632 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b09c1bb4-c5ba-4faa-8575-cd49d9adbcb5 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:17.092556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b09c1bb4-c5ba-4faa-8575-cd49d9adbcb5 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:17.096437 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b09c1bb4-c5ba-4faa-8575-cd49d9adbcb5 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:17.097061 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b09c1bb4-c5ba-4faa-8575-cd49d9adbcb5 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:17.098140 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b09c1bb4-c5ba-4faa-8575-cd49d9adbcb5 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:17.098838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b09c1bb4-c5ba-4faa-8575-cd49d9adbcb5 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:17.099808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b09c1bb4-c5ba-4faa-8575-cd49d9adbcb5 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:17.139590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-84478957-91c7-4566-b7e6-746836b5cb27 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:17.174746 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-84478957-91c7-4566-b7e6-746836b5cb27 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1716 microversion: 2.1 time: 0.284258 Aug 24 10:19:17.175626 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1007/1825] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:16 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1716 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:17.216587 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b09c1bb4-c5ba-4faa-8575-cd49d9adbcb5 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:17.228767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b09c1bb4-c5ba-4faa-8575-cd49d9adbcb5 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:17.231321 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b09c1bb4-c5ba-4faa-8575-cd49d9adbcb5 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:17.237499 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b09c1bb4-c5ba-4faa-8575-cd49d9adbcb5 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1446 microversion: 2.75 time: 0.158521 Aug 24 10:19:17.238851 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 819/1826] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:17 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1446 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:17.303363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8543a97f-944f-4afb-b384-d3b3c9a45551 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:17.304679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8543a97f-944f-4afb-b384-d3b3c9a45551 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] [instance: 6b390fef-6be9-4e24-b31e-b6f6252c88c1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:17.324261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8543a97f-944f-4afb-b384-d3b3c9a45551 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:17.325075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8543a97f-944f-4afb-b384-d3b3c9a45551 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:17.325722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8543a97f-944f-4afb-b384-d3b3c9a45551 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:17.327130 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8543a97f-944f-4afb-b384-d3b3c9a45551 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:17.327769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8543a97f-944f-4afb-b384-d3b3c9a45551 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:17.328356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8543a97f-944f-4afb-b384-d3b3c9a45551 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:17.354140 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-8543a97f-944f-4afb-b384-d3b3c9a45551 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] HTTP exception thrown: Instance 6b390fef-6be9-4e24-b31e-b6f6252c88c1 could not be found. Aug 24 10:19:17.356079 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8543a97f-944f-4afb-b384-d3b3c9a45551 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Request method failure captured: Aug 24 10:19:17.356079 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 HTTP/1.1 Aug 24 10:19:17.356079 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:19:17.356079 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:19:17.356079 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:19:17.356079 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:19:17.356079 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:19:17.356079 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:19:17.356079 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:19:17.356079 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:19:17.356079 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfpDGwdcx8Dl_0RCgObkRMAdG8Unp7I9S9rTJJz2QvpkwYMyshTKU570fIQ_35DMTCTZN2WONzkw8Zt0vZ4eHEEqH2wZmj5xZhqYcVx037gtADb9QDvMV3liUoMZtmMY3ArGj9BorxxgYEoeMicBg2cMyZCUP75OcMRQW1zmFK1g-zg Aug 24 10:19:17.356079 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:19:17.356079 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:19:17.356079 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:19:17.356079 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:19:17.356079 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:19:17.356079 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:19:17.356079 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: e6dcc3fc5b544363b1fcaadd50ea948a Aug 24 10:19:17.356079 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersAdminTestJSON-853616280 Aug 24 10:19:17.356079 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:19:17.356079 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:19:17.357901 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6dcc3fc5b544363b1fcaadd50ea948a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e6dcc3fc5b544363b1fcaadd50ea948a", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6dcc3fc5b544363b1fcaadd50ea948a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e6dcc3fc5b544363b1fcaadd50ea948a"}]}] Aug 24 10:19:17.357901 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersAdminTestJSON-853616280 Aug 24 10:19:17.357901 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: e6dcc3fc5b544363b1fcaadd50ea948a Aug 24 10:19:17.357901 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersAdminTestJSON-853616280 Aug 24 10:19:17.357901 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersAdminTestJSON-853616280-project Aug 24 10:19:17.357901 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:19:17.357901 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:19:17.357901 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 965e7789d7d942a793b07f71dd407fd8 Aug 24 10:19:17.357901 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersAdminTestJSON-853616280-project Aug 24 10:19:17.357901 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:19:17.357901 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 6b390fef-6be9-4e24-b31e-b6f6252c88c1 could not be found. Aug 24 10:19:17.357901 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '6b390fef-6be9-4e24-b31e-b6f6252c88c1'} Aug 24 10:19:17.358892 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:19:17.358892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:17.358892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:19:17.358892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:19:17.358892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:19:17.358892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:19:17.358892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:19:17.358892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:19:17.358892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:19:17.358892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:19:17.358892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b390fef-6be9-4e24-b31e-b6f6252c88c1 could not be found. Aug 24 10:19:17.358892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:17.358892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:17.358892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:17.358892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:17.358892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:17.358892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:17.358892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:19:17.358892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:19:17.358892 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:19:17.360889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:19:17.360889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:19:17.360889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:19:17.360889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:19:17.360889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:19:17.360889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:19:17.360889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:19:17.360889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b390fef-6be9-4e24-b31e-b6f6252c88c1 could not be found. Aug 24 10:19:17.360889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:17.360889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:17.360889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:17.360889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:17.360889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:17.360889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:17.360889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:19:17.360889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:19:17.360889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b390fef-6be9-4e24-b31e-b6f6252c88c1 could not be found. Aug 24 10:19:17.360889 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:17.363152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8543a97f-944f-4afb-b384-d3b3c9a45551 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] Returning 404 to user: Instance 6b390fef-6be9-4e24-b31e-b6f6252c88c1 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:19:17.364189 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8543a97f-944f-4afb-b384-d3b3c9a45551 tempest-ServersAdminTestJSON-853616280 tempest-ServersAdminTestJSON-853616280-project] 10.222.0.85 "GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1" status: 404 len: 111 microversion: 2.1 time: 0.068666 Aug 24 10:19:17.364924 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1008/1827] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:17 2022] GET /compute/v2.1/servers/6b390fef-6be9-4e24-b31e-b6f6252c88c1 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:19:17.580366 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e2476be8-603b-4ce9-9f14-6010dda04c29 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:17.583683 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e2476be8-603b-4ce9-9f14-6010dda04c29 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:17.607325 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2476be8-603b-4ce9-9f14-6010dda04c29 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:17.607894 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2476be8-603b-4ce9-9f14-6010dda04c29 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:17.610877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2476be8-603b-4ce9-9f14-6010dda04c29 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:17.613527 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2476be8-603b-4ce9-9f14-6010dda04c29 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:17.614369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2476be8-603b-4ce9-9f14-6010dda04c29 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:17.615223 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2476be8-603b-4ce9-9f14-6010dda04c29 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:17.693736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7051d2de-fdac-4146-8b59-f08dc15e308d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:17.694858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7051d2de-fdac-4146-8b59-f08dc15e308d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] [instance: 162790d5-1b97-47d9-b4df-c897b854a902] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:17.772105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7051d2de-fdac-4146-8b59-f08dc15e308d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:17.772919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7051d2de-fdac-4146-8b59-f08dc15e308d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:17.773665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7051d2de-fdac-4146-8b59-f08dc15e308d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:17.774659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7051d2de-fdac-4146-8b59-f08dc15e308d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:17.775368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7051d2de-fdac-4146-8b59-f08dc15e308d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:17.776076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7051d2de-fdac-4146-8b59-f08dc15e308d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:17.807402 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-7051d2de-fdac-4146-8b59-f08dc15e308d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] HTTP exception thrown: Instance 162790d5-1b97-47d9-b4df-c897b854a902 could not be found. Aug 24 10:19:17.809330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7051d2de-fdac-4146-8b59-f08dc15e308d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Request method failure captured: Aug 24 10:19:17.809330 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 HTTP/1.1 Aug 24 10:19:17.809330 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:19:17.809330 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:19:17.809330 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:19:17.809330 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:19:17.809330 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:19:17.809330 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:19:17.809330 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:19:17.809330 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:19:17.809330 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfldrKdWWwgO0XW__bQAWjGC52fxRL20rk6I6t2eKmY9-12ECHIqc8L1_2OEYmTV_PZU72KFY-HhmZUBgc7KK3rbu1N_1aNl-LGrcsfLFCQiOsVapHVjHI0UqR9nLYtVZhzlpA1soVu1vQGcsoRjo9Bj89t0F8yT-rvJOZDsorNLGJQ Aug 24 10:19:17.809330 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:19:17.809330 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:19:17.809330 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:19:17.809330 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:19:17.809330 n-d-849328-3 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.25 Aug 24 10:19:17.809330 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:19:17.809330 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:19:17.809330 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 34b2b8fc487d4a6abb08f132e0f0c1da Aug 24 10:19:17.809330 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1165112608 Aug 24 10:19:17.809330 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:19:17.809330 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:19:17.810972 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/34b2b8fc487d4a6abb08f132e0f0c1da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_34b2b8fc487d4a6abb08f132e0f0c1da", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/34b2b8fc487d4a6abb08f132e0f0c1da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/34b2b8fc487d4a6abb08f132e0f0c1da"}]}] Aug 24 10:19:17.810972 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1165112608 Aug 24 10:19:17.810972 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 34b2b8fc487d4a6abb08f132e0f0c1da Aug 24 10:19:17.810972 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1165112608 Aug 24 10:19:17.810972 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-LiveAutoBlockMigrationV225Test-1165112608-project Aug 24 10:19:17.810972 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:19:17.810972 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:19:17.810972 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: dfd26847179f4f2bab0c9f673de0c303 Aug 24 10:19:17.810972 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1165112608-project Aug 24 10:19:17.810972 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:19:17.810972 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 162790d5-1b97-47d9-b4df-c897b854a902 could not be found. Aug 24 10:19:17.810972 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '162790d5-1b97-47d9-b4df-c897b854a902'} Aug 24 10:19:17.811825 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:19:17.811825 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:17.811825 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:19:17.811825 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:19:17.811825 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:19:17.811825 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:19:17.811825 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:19:17.811825 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:19:17.811825 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:19:17.811825 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:19:17.811825 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 162790d5-1b97-47d9-b4df-c897b854a902 could not be found. Aug 24 10:19:17.811825 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:17.811825 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:17.811825 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:17.811825 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:17.811825 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:17.811825 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:17.811825 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:19:17.811825 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:19:17.811825 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:19:17.813235 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:19:17.813235 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:19:17.813235 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:19:17.813235 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:19:17.813235 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:19:17.813235 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:19:17.813235 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:19:17.813235 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 162790d5-1b97-47d9-b4df-c897b854a902 could not be found. Aug 24 10:19:17.813235 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:17.813235 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:17.813235 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:17.813235 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:17.813235 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:17.813235 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:17.813235 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:19:17.813235 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:19:17.813235 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 162790d5-1b97-47d9-b4df-c897b854a902 could not be found. Aug 24 10:19:17.813235 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:17.814519 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7051d2de-fdac-4146-8b59-f08dc15e308d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] Returning 404 to user: Instance 162790d5-1b97-47d9-b4df-c897b854a902 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:19:17.817404 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7051d2de-fdac-4146-8b59-f08dc15e308d tempest-LiveAutoBlockMigrationV225Test-1165112608 tempest-LiveAutoBlockMigrationV225Test-1165112608-project] 10.222.0.85 "GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902" status: 404 len: 111 microversion: 2.25 time: 0.138288 Aug 24 10:19:17.821404 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1009/1828] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:17 2022] GET /compute/v2.1/servers/162790d5-1b97-47d9-b4df-c897b854a902 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:19:18.028359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e2476be8-603b-4ce9-9f14-6010dda04c29 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:18.045664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e2476be8-603b-4ce9-9f14-6010dda04c29 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:18.047160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e2476be8-603b-4ce9-9f14-6010dda04c29 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:18.053782 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e2476be8-603b-4ce9-9f14-6010dda04c29 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1874 microversion: 2.32 time: 0.480577 Aug 24 10:19:18.065374 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 820/1829] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:17 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1874 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:18.089766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3e7006df-4d83-40a9-a9ed-968a09b9a171 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:18.090393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3e7006df-4d83-40a9-a9ed-968a09b9a171 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 6f46192a-0f63-45dd-9ca9-7fda5730ef6e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:18.112249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e7006df-4d83-40a9-a9ed-968a09b9a171 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:18.112748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e7006df-4d83-40a9-a9ed-968a09b9a171 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:18.117876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e7006df-4d83-40a9-a9ed-968a09b9a171 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:18.118650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e7006df-4d83-40a9-a9ed-968a09b9a171 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:18.121089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e7006df-4d83-40a9-a9ed-968a09b9a171 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:18.121550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e7006df-4d83-40a9-a9ed-968a09b9a171 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:18.200757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad2e3756-ea10-4105-9faa-368d5be1d241 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:18.202702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ad2e3756-ea10-4105-9faa-368d5be1d241 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:18.214971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad2e3756-ea10-4105-9faa-368d5be1d241 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:18.217749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad2e3756-ea10-4105-9faa-368d5be1d241 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:18.218241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad2e3756-ea10-4105-9faa-368d5be1d241 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:18.221599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad2e3756-ea10-4105-9faa-368d5be1d241 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:18.222162 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad2e3756-ea10-4105-9faa-368d5be1d241 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:18.222614 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad2e3756-ea10-4105-9faa-368d5be1d241 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:18.496112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3e7006df-4d83-40a9-a9ed-968a09b9a171 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:18.500119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:18.510151 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3e7006df-4d83-40a9-a9ed-968a09b9a171 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e" status: 200 len: 1325 microversion: 2.1 time: 0.425205 Aug 24 10:19:18.516430 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1010/1830] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:18 2022] GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e => generated 1325 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:18.521922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e0e473f6-061a-4459-bb8f-fba7ab5b9184 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:18.522798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e0e473f6-061a-4459-bb8f-fba7ab5b9184 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:18.537301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0e473f6-061a-4459-bb8f-fba7ab5b9184 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:18.538172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0e473f6-061a-4459-bb8f-fba7ab5b9184 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:18.538859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0e473f6-061a-4459-bb8f-fba7ab5b9184 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:18.548062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0e473f6-061a-4459-bb8f-fba7ab5b9184 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:18.548903 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0e473f6-061a-4459-bb8f-fba7ab5b9184 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:18.549563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0e473f6-061a-4459-bb8f-fba7ab5b9184 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:18.562309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ad2e3756-ea10-4105-9faa-368d5be1d241 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:18.603835 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ad2e3756-ea10-4105-9faa-368d5be1d241 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1716 microversion: 2.1 time: 0.407693 Aug 24 10:19:18.607630 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 821/1831] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:18 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1716 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:18.699774 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e0e473f6-061a-4459-bb8f-fba7ab5b9184 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:18.716601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e0e473f6-061a-4459-bb8f-fba7ab5b9184 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:18.718668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e0e473f6-061a-4459-bb8f-fba7ab5b9184 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:18.730605 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e0e473f6-061a-4459-bb8f-fba7ab5b9184 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1446 microversion: 2.75 time: 0.212710 Aug 24 10:19:18.735875 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1011/1832] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:18 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1446 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:18.767061 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9e89b572-4e8b-4a85-bbb4-8f49024083b7 req-15bc402a-7b8c-4822-be50-2deb5db6b994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f46192a-0f63-45dd-9ca9-7fda5730ef6e", "name": "network-vif-plugged", "status": "completed", "tag": "d1e13e32-aa4b-434a-8dbc-621e15239757"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:18.782084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9e89b572-4e8b-4a85-bbb4-8f49024083b7 req-15bc402a-7b8c-4822-be50-2deb5db6b994 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:18.783567 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9e89b572-4e8b-4a85-bbb4-8f49024083b7 req-15bc402a-7b8c-4822-be50-2deb5db6b994 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:18.784020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9e89b572-4e8b-4a85-bbb4-8f49024083b7 req-15bc402a-7b8c-4822-be50-2deb5db6b994 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:18.834055 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9e89b572-4e8b-4a85-bbb4-8f49024083b7 req-15bc402a-7b8c-4822-be50-2deb5db6b994 service nova] Creating event network-vif-plugged:d1e13e32-aa4b-434a-8dbc-621e15239757 for instance 6f46192a-0f63-45dd-9ca9-7fda5730ef6e on n-h1-849328-3 Aug 24 10:19:18.855046 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9e89b572-4e8b-4a85-bbb4-8f49024083b7 req-15bc402a-7b8c-4822-be50-2deb5db6b994 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094634 Aug 24 10:19:18.871226 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 822/1833] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:19.112199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-85754841-291f-4157-9c69-36211ccdcd2e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:19.121449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-85754841-291f-4157-9c69-36211ccdcd2e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:19.140110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85754841-291f-4157-9c69-36211ccdcd2e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:19.141382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85754841-291f-4157-9c69-36211ccdcd2e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:19.142377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85754841-291f-4157-9c69-36211ccdcd2e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:19.144458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85754841-291f-4157-9c69-36211ccdcd2e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:19.146222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85754841-291f-4157-9c69-36211ccdcd2e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:19.148259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85754841-291f-4157-9c69-36211ccdcd2e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:19.958500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f6fe4072-9cbb-4439-96e9-d2f459c2bda8 tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] Calling method '.version_select at 0x7f4654b4e550>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:20.008489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG neutronclient.v2_0.client [None req-f6fe4072-9cbb-4439-96e9-d2f459c2bda8 tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6b9de426-6b9f-4f7d-bdc1-0b22f15d0d78 does not exist", "detail": ""}} {{(pid=122432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 10:19:20.009173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.security_group_api [None req-f6fe4072-9cbb-4439-96e9-d2f459c2bda8 tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] Neutron security group 6b9de426-6b9f-4f7d-bdc1-0b22f15d0d78 not found {{(pid=122432) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 10:19:20.009702 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-f6fe4072-9cbb-4439-96e9-d2f459c2bda8 tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] HTTP exception thrown: Security group 6b9de426-6b9f-4f7d-bdc1-0b22f15d0d78 does not exist Aug 24 10:19:20.009702 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-b4c5881d-7c77-46b8-a9a8-d70530cb7582'] Aug 24 10:19:20.036466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f6fe4072-9cbb-4439-96e9-d2f459c2bda8 tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] Request method failure captured: Aug 24 10:19:20.036466 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/os-security-groups/6b9de426-6b9f-4f7d-bdc1-0b22f15d0d78 HTTP/1.1 Aug 24 10:19:20.036466 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:19:20.036466 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:19:20.036466 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:19:20.036466 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:19:20.036466 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:19:20.036466 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:19:20.036466 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:19:20.036466 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:19:20.036466 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfsnepacz0f04LOWaAMosx2UpidujKZZeEI5sBQ3wDUYDe6aEvN-QZMpEqQex81-X1tAP-ijF8rZoYdI2dUrq2Zxo7668to45qtONLlY7xaQvxTNphX1IERj4cinZr7dfiRhHQzoRmOwg_txEPKXr3ZG5axHMFd8cUtICWfIQFsur2o Aug 24 10:19:20.036466 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:19:20.036466 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:19:20.036466 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:19:20.036466 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:19:20.036466 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:19:20.036466 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:19:20.036466 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: d8915a23b5884c74bf3dbe9cdc78a90a Aug 24 10:19:20.036466 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-689258732 Aug 24 10:19:20.036466 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:19:20.036466 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:19:20.039755 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d8915a23b5884c74bf3dbe9cdc78a90a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d8915a23b5884c74bf3dbe9cdc78a90a", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d8915a23b5884c74bf3dbe9cdc78a90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d8915a23b5884c74bf3dbe9cdc78a90a"}]}] Aug 24 10:19:20.039755 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-689258732 Aug 24 10:19:20.039755 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: d8915a23b5884c74bf3dbe9cdc78a90a Aug 24 10:19:20.039755 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-689258732 Aug 24 10:19:20.039755 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-SecurityGroupsNegativeTestJSON-689258732-project Aug 24 10:19:20.039755 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:19:20.039755 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:19:20.039755 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 8e161090bc7d49bc87c56e08890be3af Aug 24 10:19:20.039755 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-689258732-project Aug 24 10:19:20.039755 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:19:20.039755 n-d-849328-3 devstack@n-api.service[122432]: exception: Security group 6b9de426-6b9f-4f7d-bdc1-0b22f15d0d78 does not exist Aug 24 10:19:20.039755 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-b4c5881d-7c77-46b8-a9a8-d70530cb7582'] Aug 24 10:19:20.039755 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '6b9de426-6b9f-4f7d-bdc1-0b22f15d0d78'} Aug 24 10:19:20.042850 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:19:20.042850 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:20.042850 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 10:19:20.042850 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 10:19:20.042850 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:19:20.042850 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:19:20.042850 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 10:19:20.042850 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 10:19:20.042850 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:19:20.042850 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:19:20.042850 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 10:19:20.042850 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 10:19:20.042850 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:19:20.042850 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:19:20.042850 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 10:19:20.042850 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 10:19:20.042850 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:19:20.042850 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:19:20.042850 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 10:19:20.047680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 10:19:20.047680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:19:20.047680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:19:20.047680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 10:19:20.047680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 10:19:20.047680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 10:19:20.047680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 10:19:20.047680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6b9de426-6b9f-4f7d-bdc1-0b22f15d0d78 does not exist Aug 24 10:19:20.047680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b4c5881d-7c77-46b8-a9a8-d70530cb7582'] Aug 24 10:19:20.047680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:19:20.047680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:20.047680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:19:20.047680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:20.047680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 24 10:19:20.047680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 10:19:20.047680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 10:19:20.047680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 10:19:20.047680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6b9de426-6b9f-4f7d-bdc1-0b22f15d0d78 does not exist Aug 24 10:19:20.050595 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b4c5881d-7c77-46b8-a9a8-d70530cb7582'] Aug 24 10:19:20.050595 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:19:20.050595 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:20.050595 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:19:20.050595 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:20.050595 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:20.050595 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:20.050595 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:19:20.050595 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:19:20.050595 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:19:20.050595 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:19:20.050595 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:19:20.050595 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:19:20.050595 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 24 10:19:20.050595 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 10:19:20.050595 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6b9de426-6b9f-4f7d-bdc1-0b22f15d0d78 does not exist Aug 24 10:19:20.050595 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b4c5881d-7c77-46b8-a9a8-d70530cb7582'] Aug 24 10:19:20.050595 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:19:20.050595 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:20.050595 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:19:20.050595 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:20.052297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:20.052297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:20.052297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:19:20.052297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:19:20.052297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6b9de426-6b9f-4f7d-bdc1-0b22f15d0d78 does not exist Aug 24 10:19:20.052297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b4c5881d-7c77-46b8-a9a8-d70530cb7582'] Aug 24 10:19:20.052297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:19:20.052297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f6fe4072-9cbb-4439-96e9-d2f459c2bda8 tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] Returning 404 to user: Security group 6b9de426-6b9f-4f7d-bdc1-0b22f15d0d78 does not exist Aug 24 10:19:20.052297 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-b4c5881d-7c77-46b8-a9a8-d70530cb7582'] {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:19:20.052297 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f6fe4072-9cbb-4439-96e9-d2f459c2bda8 tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/6b9de426-6b9f-4f7d-bdc1-0b22f15d0d78" status: 404 len: 194 microversion: 2.1 time: 0.560674 Aug 24 10:19:20.052297 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 823/1834] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:19:19 2022] DELETE /compute/v2.1/os-security-groups/6b9de426-6b9f-4f7d-bdc1-0b22f15d0d78 => generated 194 bytes in 567 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:19:20.059212 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e2e990b9-f02d-4bce-8e46-86a3ac3b94cf tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:20.063532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e2e990b9-f02d-4bce-8e46-86a3ac3b94cf tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 6f46192a-0f63-45dd-9ca9-7fda5730ef6e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:20.073402 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2e990b9-f02d-4bce-8e46-86a3ac3b94cf tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:20.074502 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2e990b9-f02d-4bce-8e46-86a3ac3b94cf tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:20.075338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2e990b9-f02d-4bce-8e46-86a3ac3b94cf tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:20.076294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2e990b9-f02d-4bce-8e46-86a3ac3b94cf tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:20.077165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2e990b9-f02d-4bce-8e46-86a3ac3b94cf tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:20.077950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2e990b9-f02d-4bce-8e46-86a3ac3b94cf tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:20.296766 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e2e990b9-f02d-4bce-8e46-86a3ac3b94cf tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:20.301852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:20.317961 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e2e990b9-f02d-4bce-8e46-86a3ac3b94cf tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e" status: 200 len: 1325 microversion: 2.1 time: 0.272616 Aug 24 10:19:20.332653 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 824/1835] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:20 2022] GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e => generated 1325 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:20.339759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aa954710-2011-407b-95ee-3c4b23065b64 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:20.340477 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aa954710-2011-407b-95ee-3c4b23065b64 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:20.349820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa954710-2011-407b-95ee-3c4b23065b64 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:20.364022 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa954710-2011-407b-95ee-3c4b23065b64 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:20.364778 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa954710-2011-407b-95ee-3c4b23065b64 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:20.366174 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa954710-2011-407b-95ee-3c4b23065b64 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:20.366820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa954710-2011-407b-95ee-3c4b23065b64 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:20.367921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa954710-2011-407b-95ee-3c4b23065b64 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:20.422647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-85754841-291f-4157-9c69-36211ccdcd2e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:20.434828 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-85754841-291f-4157-9c69-36211ccdcd2e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:20.445910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-85754841-291f-4157-9c69-36211ccdcd2e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:20.447181 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-85754841-291f-4157-9c69-36211ccdcd2e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1874 microversion: 2.32 time: 1.343917 Aug 24 10:19:20.448233 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1012/1836] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:19 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1874 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:20.453487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4bbd32fe-7428-47d4-a0bd-927d2d192cea tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:20.457898 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4bbd32fe-7428-47d4-a0bd-927d2d192cea tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:20.468165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bbd32fe-7428-47d4-a0bd-927d2d192cea tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:20.468998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bbd32fe-7428-47d4-a0bd-927d2d192cea tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:20.469673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bbd32fe-7428-47d4-a0bd-927d2d192cea tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:20.470625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bbd32fe-7428-47d4-a0bd-927d2d192cea tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:20.471383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bbd32fe-7428-47d4-a0bd-927d2d192cea tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:20.472011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bbd32fe-7428-47d4-a0bd-927d2d192cea tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:20.599425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4bbd32fe-7428-47d4-a0bd-927d2d192cea tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:20.614950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4bbd32fe-7428-47d4-a0bd-927d2d192cea tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:20.620011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4bbd32fe-7428-47d4-a0bd-927d2d192cea tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:20.630128 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aa954710-2011-407b-95ee-3c4b23065b64 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:20.639691 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aa954710-2011-407b-95ee-3c4b23065b64 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1716 microversion: 2.1 time: 0.305788 Aug 24 10:19:20.640324 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 825/1837] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:20 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1716 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:20.654655 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-467d3d63-0905-409e-8428-f1e3da889c69 tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.006458 Aug 24 10:19:20.658091 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4bbd32fe-7428-47d4-a0bd-927d2d192cea tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1446 microversion: 2.75 time: 0.208359 Aug 24 10:19:20.658803 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1013/1838] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:20 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1446 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:20.661461 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 826/1839] 10.222.0.85 () {58 vars in 1164 bytes} [Wed Aug 24 10:19:20 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 10:19:20.663950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d928c1bc-8c9b-4c11-86fc-fce2e2250082 tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] Calling method '.version_select at 0x7f4654688ca0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:20.962673 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d928c1bc-8c9b-4c11-86fc-fce2e2250082 tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] 10.222.0.85 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.302857 Aug 24 10:19:20.979537 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1014/1840] 10.222.0.85 () {58 vars in 1158 bytes} [Wed Aug 24 10:19:20 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:20.982222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-37e7f1d7-75e2-4e97-8a50-9531deb664b8 tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] Calling method '.version_select at 0x7f4654b4eaf0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:21.149026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG neutronclient.v2_0.client [None req-37e7f1d7-75e2-4e97-8a50-9531deb664b8 tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=122432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 10:19:21.149954 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-37e7f1d7-75e2-4e97-8a50-9531deb664b8 tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 24 10:19:21.149954 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-fe46e3a8-fb53-4f19-a6cc-7aef082783aa'] Aug 24 10:19:21.152416 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-37e7f1d7-75e2-4e97-8a50-9531deb664b8 tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] Request method failure captured: Aug 24 10:19:21.152416 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/os-security-groups/6eabb2b2-ddc6-45d1-bf36-1036c7838a3d HTTP/1.1 Aug 24 10:19:21.152416 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:19:21.152416 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:19:21.152416 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:19:21.152416 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:19:21.152416 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:19:21.152416 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:19:21.152416 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:19:21.152416 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:19:21.152416 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfsnepacz0f04LOWaAMosx2UpidujKZZeEI5sBQ3wDUYDe6aEvN-QZMpEqQex81-X1tAP-ijF8rZoYdI2dUrq2Zxo7668to45qtONLlY7xaQvxTNphX1IERj4cinZr7dfiRhHQzoRmOwg_txEPKXr3ZG5axHMFd8cUtICWfIQFsur2o Aug 24 10:19:21.152416 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:19:21.152416 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:19:21.152416 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:19:21.152416 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:19:21.152416 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:19:21.152416 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:19:21.152416 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: d8915a23b5884c74bf3dbe9cdc78a90a Aug 24 10:19:21.152416 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-689258732 Aug 24 10:19:21.152416 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:19:21.152416 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:19:21.154331 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d8915a23b5884c74bf3dbe9cdc78a90a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d8915a23b5884c74bf3dbe9cdc78a90a", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d8915a23b5884c74bf3dbe9cdc78a90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d8915a23b5884c74bf3dbe9cdc78a90a"}]}] Aug 24 10:19:21.154331 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-689258732 Aug 24 10:19:21.154331 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: d8915a23b5884c74bf3dbe9cdc78a90a Aug 24 10:19:21.154331 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-689258732 Aug 24 10:19:21.154331 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-SecurityGroupsNegativeTestJSON-689258732-project Aug 24 10:19:21.154331 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:19:21.154331 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:19:21.154331 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 8e161090bc7d49bc87c56e08890be3af Aug 24 10:19:21.154331 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-689258732-project Aug 24 10:19:21.154331 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:19:21.154331 n-d-849328-3 devstack@n-api.service[122432]: exception: Insufficient rights for removing default security group. Aug 24 10:19:21.154331 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-fe46e3a8-fb53-4f19-a6cc-7aef082783aa'] Aug 24 10:19:21.154331 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '6eabb2b2-ddc6-45d1-bf36-1036c7838a3d'} Aug 24 10:19:21.155378 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:19:21.155378 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:21.155378 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 24 10:19:21.155378 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 24 10:19:21.155378 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:19:21.155378 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:19:21.155378 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 24 10:19:21.155378 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 24 10:19:21.155378 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:19:21.155378 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:19:21.155378 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 24 10:19:21.155378 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 24 10:19:21.155378 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:19:21.155378 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:19:21.155378 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 10:19:21.155378 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 10:19:21.155378 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:19:21.155378 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:19:21.155378 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 10:19:21.156772 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 10:19:21.156772 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:19:21.156772 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:19:21.156772 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 10:19:21.156772 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 10:19:21.156772 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 10:19:21.156772 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 10:19:21.156772 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 24 10:19:21.156772 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fe46e3a8-fb53-4f19-a6cc-7aef082783aa'] Aug 24 10:19:21.156772 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:19:21.156772 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:21.156772 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:19:21.156772 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:21.156772 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 24 10:19:21.156772 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 24 10:19:21.156772 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 24 10:19:21.156772 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 24 10:19:21.156772 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 24 10:19:21.156772 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fe46e3a8-fb53-4f19-a6cc-7aef082783aa'] Aug 24 10:19:21.166951 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:19:21.166951 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:21.166951 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:19:21.166951 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:21.166951 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:21.166951 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:21.166951 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:19:21.166951 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:19:21.166951 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:19:21.166951 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:19:21.166951 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:19:21.166951 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:19:21.166951 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 24 10:19:21.166951 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 24 10:19:21.166951 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 24 10:19:21.166951 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fe46e3a8-fb53-4f19-a6cc-7aef082783aa'] Aug 24 10:19:21.166951 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:19:21.166951 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:21.166951 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:19:21.166951 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:21.166951 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:21.169936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:21.169936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:19:21.169936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:19:21.169936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 24 10:19:21.169936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fe46e3a8-fb53-4f19-a6cc-7aef082783aa'] Aug 24 10:19:21.169936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:19:21.169936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-37e7f1d7-75e2-4e97-8a50-9531deb664b8 tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 24 10:19:21.169936 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-fe46e3a8-fb53-4f19-a6cc-7aef082783aa'] {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:19:21.169936 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-37e7f1d7-75e2-4e97-8a50-9531deb664b8 tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/6eabb2b2-ddc6-45d1-bf36-1036c7838a3d" status: 400 len: 182 microversion: 2.1 time: 0.179523 Aug 24 10:19:21.169936 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 827/1841] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:19:20 2022] DELETE /compute/v2.1/os-security-groups/6eabb2b2-ddc6-45d1-bf36-1036c7838a3d => generated 182 bytes in 181 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:19:21.176431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3593b64c-496c-4e74-a4f1-589bc4b6d73e tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] Calling method '.version_select at 0x7f46546d2040>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:21.251909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG neutronclient.v2_0.client [None req-3593b64c-496c-4e74-a4f1-589bc4b6d73e tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6cbb743c-4285-4519-82c0-9c8a6f570733 does not exist", "detail": ""}} {{(pid=122433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 10:19:21.252534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.security_group_api [None req-3593b64c-496c-4e74-a4f1-589bc4b6d73e tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] Neutron security group 6cbb743c-4285-4519-82c0-9c8a6f570733 not found {{(pid=122433) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 10:19:21.253075 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-3593b64c-496c-4e74-a4f1-589bc4b6d73e tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] HTTP exception thrown: Security group 6cbb743c-4285-4519-82c0-9c8a6f570733 does not exist Aug 24 10:19:21.253075 n-d-849328-3 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-120930d8-10ed-4127-9688-1b4470d51373'] Aug 24 10:19:21.255709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3593b64c-496c-4e74-a4f1-589bc4b6d73e tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] Request method failure captured: Aug 24 10:19:21.255709 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-security-groups/6cbb743c-4285-4519-82c0-9c8a6f570733 HTTP/1.1 Aug 24 10:19:21.255709 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:19:21.255709 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:19:21.255709 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:19:21.255709 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:19:21.255709 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:19:21.255709 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:19:21.255709 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:19:21.255709 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:19:21.255709 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfsnepacz0f04LOWaAMosx2UpidujKZZeEI5sBQ3wDUYDe6aEvN-QZMpEqQex81-X1tAP-ijF8rZoYdI2dUrq2Zxo7668to45qtONLlY7xaQvxTNphX1IERj4cinZr7dfiRhHQzoRmOwg_txEPKXr3ZG5axHMFd8cUtICWfIQFsur2o Aug 24 10:19:21.255709 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:19:21.255709 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:19:21.255709 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:19:21.255709 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:19:21.255709 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:19:21.255709 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:19:21.255709 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d8915a23b5884c74bf3dbe9cdc78a90a Aug 24 10:19:21.255709 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-689258732 Aug 24 10:19:21.255709 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:19:21.255709 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:19:21.257539 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d8915a23b5884c74bf3dbe9cdc78a90a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d8915a23b5884c74bf3dbe9cdc78a90a", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d8915a23b5884c74bf3dbe9cdc78a90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d8915a23b5884c74bf3dbe9cdc78a90a"}]}] Aug 24 10:19:21.257539 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-689258732 Aug 24 10:19:21.257539 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d8915a23b5884c74bf3dbe9cdc78a90a Aug 24 10:19:21.257539 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-689258732 Aug 24 10:19:21.257539 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupsNegativeTestJSON-689258732-project Aug 24 10:19:21.257539 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:19:21.257539 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:19:21.257539 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 8e161090bc7d49bc87c56e08890be3af Aug 24 10:19:21.257539 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-689258732-project Aug 24 10:19:21.257539 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:19:21.257539 n-d-849328-3 devstack@n-api.service[122433]: exception: Security group 6cbb743c-4285-4519-82c0-9c8a6f570733 does not exist Aug 24 10:19:21.257539 n-d-849328-3 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-120930d8-10ed-4127-9688-1b4470d51373'] Aug 24 10:19:21.257539 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '6cbb743c-4285-4519-82c0-9c8a6f570733'} Aug 24 10:19:21.258815 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:19:21.258815 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:21.258815 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 10:19:21.258815 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 10:19:21.258815 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:19:21.258815 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:19:21.258815 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 10:19:21.258815 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 10:19:21.258815 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:19:21.258815 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:19:21.258815 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 10:19:21.258815 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 10:19:21.258815 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:19:21.258815 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:19:21.258815 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 10:19:21.258815 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 10:19:21.258815 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:19:21.258815 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:19:21.258815 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 10:19:21.260383 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 10:19:21.260383 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:19:21.260383 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:19:21.260383 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 10:19:21.260383 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 10:19:21.260383 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 10:19:21.260383 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 10:19:21.260383 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6cbb743c-4285-4519-82c0-9c8a6f570733 does not exist Aug 24 10:19:21.260383 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-120930d8-10ed-4127-9688-1b4470d51373'] Aug 24 10:19:21.260383 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:21.260383 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:21.260383 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:21.260383 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:21.260383 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 24 10:19:21.260383 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 10:19:21.260383 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 10:19:21.260383 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 10:19:21.260383 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6cbb743c-4285-4519-82c0-9c8a6f570733 does not exist Aug 24 10:19:21.261695 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-120930d8-10ed-4127-9688-1b4470d51373'] Aug 24 10:19:21.261695 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:21.261695 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:21.261695 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:21.261695 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:21.261695 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:21.261695 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:21.261695 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:19:21.261695 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:19:21.261695 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:19:21.261695 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:19:21.261695 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:19:21.261695 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:19:21.261695 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 24 10:19:21.261695 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 10:19:21.261695 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6cbb743c-4285-4519-82c0-9c8a6f570733 does not exist Aug 24 10:19:21.261695 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-120930d8-10ed-4127-9688-1b4470d51373'] Aug 24 10:19:21.261695 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:21.261695 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:21.261695 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:21.261695 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:21.263281 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:21.263281 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:21.263281 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:19:21.263281 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:19:21.263281 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6cbb743c-4285-4519-82c0-9c8a6f570733 does not exist Aug 24 10:19:21.263281 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-120930d8-10ed-4127-9688-1b4470d51373'] Aug 24 10:19:21.263281 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:21.263281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3593b64c-496c-4e74-a4f1-589bc4b6d73e tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] Returning 404 to user: Security group 6cbb743c-4285-4519-82c0-9c8a6f570733 does not exist Aug 24 10:19:21.263281 n-d-849328-3 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-120930d8-10ed-4127-9688-1b4470d51373'] {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:19:21.263281 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3593b64c-496c-4e74-a4f1-589bc4b6d73e tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] 10.222.0.85 "GET /compute/v2.1/os-security-groups/6cbb743c-4285-4519-82c0-9c8a6f570733" status: 404 len: 194 microversion: 2.1 time: 0.085233 Aug 24 10:19:21.267715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-284d69c0-7bc3-4471-944b-962a7e56f94d tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] Action: 'update', calling method: .version_select at 0x7f4654fbd5e0>, body: {"security_group": {"name": "tempest-sg-733714583", "description": "tempest-description-1617198671"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:21.273234 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1015/1842] 10.222.0.85 () {58 vars in 1269 bytes} [Wed Aug 24 10:19:21 2022] GET /compute/v2.1/os-security-groups/6cbb743c-4285-4519-82c0-9c8a6f570733 => generated 194 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:19:21.354401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG neutronclient.v2_0.client [None req-284d69c0-7bc3-4471-944b-962a7e56f94d tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group aef44ebb-eadc-4a78-b23f-6d6525032d25 does not exist", "detail": ""}} {{(pid=122432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 10:19:21.355323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.security_group_api [None req-284d69c0-7bc3-4471-944b-962a7e56f94d tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] Neutron security group aef44ebb-eadc-4a78-b23f-6d6525032d25 not found {{(pid=122432) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 10:19:21.355449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f2535ea8-8dc7-40ae-aa5a-153896af84c2 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:21.355994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f2535ea8-8dc7-40ae-aa5a-153896af84c2 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 6f46192a-0f63-45dd-9ca9-7fda5730ef6e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:21.356373 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-284d69c0-7bc3-4471-944b-962a7e56f94d tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] HTTP exception thrown: Security group aef44ebb-eadc-4a78-b23f-6d6525032d25 does not exist Aug 24 10:19:21.356373 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-287f3240-3b9e-4ee3-a5de-1a905a4141d5'] Aug 24 10:19:21.359390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-284d69c0-7bc3-4471-944b-962a7e56f94d tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] Request method failure captured: Aug 24 10:19:21.359390 n-d-849328-3 devstack@n-api.service[122432]: request: PUT /compute/v2.1/os-security-groups/aef44ebb-eadc-4a78-b23f-6d6525032d25 HTTP/1.1 Aug 24 10:19:21.359390 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:19:21.359390 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:19:21.359390 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:19:21.359390 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 101 Aug 24 10:19:21.359390 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:19:21.359390 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:19:21.359390 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:19:21.359390 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:19:21.359390 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfsnepacz0f04LOWaAMosx2UpidujKZZeEI5sBQ3wDUYDe6aEvN-QZMpEqQex81-X1tAP-ijF8rZoYdI2dUrq2Zxo7668to45qtONLlY7xaQvxTNphX1IERj4cinZr7dfiRhHQzoRmOwg_txEPKXr3ZG5axHMFd8cUtICWfIQFsur2o Aug 24 10:19:21.359390 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:19:21.359390 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:19:21.359390 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:19:21.359390 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:19:21.359390 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:19:21.359390 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:19:21.359390 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: d8915a23b5884c74bf3dbe9cdc78a90a Aug 24 10:19:21.359390 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-689258732 Aug 24 10:19:21.359390 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:19:21.359390 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:19:21.361308 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d8915a23b5884c74bf3dbe9cdc78a90a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d8915a23b5884c74bf3dbe9cdc78a90a", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d8915a23b5884c74bf3dbe9cdc78a90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d8915a23b5884c74bf3dbe9cdc78a90a"}]}] Aug 24 10:19:21.361308 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-689258732 Aug 24 10:19:21.361308 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: d8915a23b5884c74bf3dbe9cdc78a90a Aug 24 10:19:21.361308 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-689258732 Aug 24 10:19:21.361308 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-SecurityGroupsNegativeTestJSON-689258732-project Aug 24 10:19:21.361308 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:19:21.361308 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:19:21.361308 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 8e161090bc7d49bc87c56e08890be3af Aug 24 10:19:21.361308 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-689258732-project Aug 24 10:19:21.361308 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:19:21.361308 n-d-849328-3 devstack@n-api.service[122432]: {"security_group": {"name": "tempest-sg-733714583", "description": "tempest-description-1617198671"}} Aug 24 10:19:21.361308 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:19:21.361308 n-d-849328-3 devstack@n-api.service[122432]: exception: Security group aef44ebb-eadc-4a78-b23f-6d6525032d25 does not exist Aug 24 10:19:21.362394 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-287f3240-3b9e-4ee3-a5de-1a905a4141d5'] Aug 24 10:19:21.362394 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'aef44ebb-eadc-4a78-b23f-6d6525032d25', 'body': {'security_group': {'name': 'tempest-sg-733714583', 'description': 'tempest-description-1617198671'}}} Aug 24 10:19:21.362394 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:19:21.362394 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:21.362394 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 10:19:21.362394 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 10:19:21.362394 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:19:21.362394 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:19:21.362394 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 10:19:21.362394 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 10:19:21.362394 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:19:21.362394 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:19:21.362394 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 10:19:21.362394 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 10:19:21.362394 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:19:21.362394 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:19:21.362394 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 10:19:21.362394 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 10:19:21.363860 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:19:21.363860 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:19:21.363860 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 10:19:21.363860 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 10:19:21.363860 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:19:21.363860 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:19:21.363860 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 10:19:21.363860 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 10:19:21.363860 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 10:19:21.363860 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 10:19:21.363860 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group aef44ebb-eadc-4a78-b23f-6d6525032d25 does not exist Aug 24 10:19:21.363860 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-287f3240-3b9e-4ee3-a5de-1a905a4141d5'] Aug 24 10:19:21.363860 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:19:21.363860 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:21.363860 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:19:21.363860 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:21.363860 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 24 10:19:21.363860 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 10:19:21.363860 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 10:19:21.365484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 10:19:21.365484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group aef44ebb-eadc-4a78-b23f-6d6525032d25 does not exist Aug 24 10:19:21.365484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-287f3240-3b9e-4ee3-a5de-1a905a4141d5'] Aug 24 10:19:21.365484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:19:21.365484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:21.365484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:19:21.365484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:21.365484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:21.365484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:21.365484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:19:21.365484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:19:21.365484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:19:21.365484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:19:21.365484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:19:21.365484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:19:21.365484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 24 10:19:21.365484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 10:19:21.365484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group aef44ebb-eadc-4a78-b23f-6d6525032d25 does not exist Aug 24 10:19:21.365484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-287f3240-3b9e-4ee3-a5de-1a905a4141d5'] Aug 24 10:19:21.365484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:19:21.367194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:21.367194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:19:21.367194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:21.367194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:21.367194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:21.367194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:19:21.367194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:19:21.367194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group aef44ebb-eadc-4a78-b23f-6d6525032d25 does not exist Aug 24 10:19:21.367194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-287f3240-3b9e-4ee3-a5de-1a905a4141d5'] Aug 24 10:19:21.367194 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:19:21.370446 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-284d69c0-7bc3-4471-944b-962a7e56f94d tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] Returning 404 to user: Security group aef44ebb-eadc-4a78-b23f-6d6525032d25 does not exist Aug 24 10:19:21.370446 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-287f3240-3b9e-4ee3-a5de-1a905a4141d5'] {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:19:21.371656 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-284d69c0-7bc3-4471-944b-962a7e56f94d tempest-SecurityGroupsNegativeTestJSON-689258732 tempest-SecurityGroupsNegativeTestJSON-689258732-project] 10.222.0.85 "PUT /compute/v2.1/os-security-groups/aef44ebb-eadc-4a78-b23f-6d6525032d25" status: 404 len: 194 microversion: 2.1 time: 0.108087 Aug 24 10:19:21.372417 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 828/1843] 10.222.0.85 () {60 vars in 1290 bytes} [Wed Aug 24 10:19:21 2022] PUT /compute/v2.1/os-security-groups/aef44ebb-eadc-4a78-b23f-6d6525032d25 => generated 194 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:19:21.379143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2535ea8-8dc7-40ae-aa5a-153896af84c2 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:21.379450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2535ea8-8dc7-40ae-aa5a-153896af84c2 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:21.380078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2535ea8-8dc7-40ae-aa5a-153896af84c2 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:21.380983 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2535ea8-8dc7-40ae-aa5a-153896af84c2 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:21.383246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2535ea8-8dc7-40ae-aa5a-153896af84c2 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:21.384258 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2535ea8-8dc7-40ae-aa5a-153896af84c2 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:21.473997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5e152764-a563-46c3-8cf2-5f001c78197e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:21.474775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5e152764-a563-46c3-8cf2-5f001c78197e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:21.482762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e152764-a563-46c3-8cf2-5f001c78197e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:21.484227 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e152764-a563-46c3-8cf2-5f001c78197e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:21.484828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e152764-a563-46c3-8cf2-5f001c78197e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:21.485850 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e152764-a563-46c3-8cf2-5f001c78197e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:21.486465 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e152764-a563-46c3-8cf2-5f001c78197e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:21.487080 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e152764-a563-46c3-8cf2-5f001c78197e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:21.764378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f2535ea8-8dc7-40ae-aa5a-153896af84c2 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:21.791457 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f2535ea8-8dc7-40ae-aa5a-153896af84c2 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e" status: 200 len: 1522 microversion: 2.1 time: 0.441316 Aug 24 10:19:21.802832 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1016/1844] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:21 2022] GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e => generated 1522 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:21.823614 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3198edff-efc6-4645-bce0-f4d2cb8279bd tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:21.826918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3198edff-efc6-4645-bce0-f4d2cb8279bd tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:21.848560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3198edff-efc6-4645-bce0-f4d2cb8279bd tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:21.852020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3198edff-efc6-4645-bce0-f4d2cb8279bd tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:21.852946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3198edff-efc6-4645-bce0-f4d2cb8279bd tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:21.856308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3198edff-efc6-4645-bce0-f4d2cb8279bd tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:21.859831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3198edff-efc6-4645-bce0-f4d2cb8279bd tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:21.860637 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3198edff-efc6-4645-bce0-f4d2cb8279bd tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:21.899679 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5e152764-a563-46c3-8cf2-5f001c78197e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:21.924333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5e152764-a563-46c3-8cf2-5f001c78197e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:21.934286 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5e152764-a563-46c3-8cf2-5f001c78197e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:21.936794 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5e152764-a563-46c3-8cf2-5f001c78197e tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 2827 microversion: 2.32 time: 0.468462 Aug 24 10:19:21.943547 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 829/1845] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:21 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 2827 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:19:21.963817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-601b76c8-aafa-4fe3-949a-4b93c4b433ec tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:21.970272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-601b76c8-aafa-4fe3-949a-4b93c4b433ec tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:21.999306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-601b76c8-aafa-4fe3-949a-4b93c4b433ec tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:22.000207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-601b76c8-aafa-4fe3-949a-4b93c4b433ec tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:22.001421 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-601b76c8-aafa-4fe3-949a-4b93c4b433ec tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:22.003735 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-601b76c8-aafa-4fe3-949a-4b93c4b433ec tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:22.008187 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-601b76c8-aafa-4fe3-949a-4b93c4b433ec tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:22.009537 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-601b76c8-aafa-4fe3-949a-4b93c4b433ec tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:22.196591 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-601b76c8-aafa-4fe3-949a-4b93c4b433ec tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:22.227487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-601b76c8-aafa-4fe3-949a-4b93c4b433ec tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:22.229083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-601b76c8-aafa-4fe3-949a-4b93c4b433ec tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:22.244378 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-601b76c8-aafa-4fe3-949a-4b93c4b433ec tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1446 microversion: 2.75 time: 0.289595 Aug 24 10:19:22.245322 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 830/1846] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:21 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1446 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:22.261689 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b6f8f0d6-5b6a-4049-adfb-0e82b006c922 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:22.262534 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b6f8f0d6-5b6a-4049-adfb-0e82b006c922 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 6f46192a-0f63-45dd-9ca9-7fda5730ef6e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:22.269776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6f8f0d6-5b6a-4049-adfb-0e82b006c922 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:22.274094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6f8f0d6-5b6a-4049-adfb-0e82b006c922 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:22.285937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6f8f0d6-5b6a-4049-adfb-0e82b006c922 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:22.287043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6f8f0d6-5b6a-4049-adfb-0e82b006c922 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:22.287693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6f8f0d6-5b6a-4049-adfb-0e82b006c922 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:22.288762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6f8f0d6-5b6a-4049-adfb-0e82b006c922 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:22.530896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3198edff-efc6-4645-bce0-f4d2cb8279bd tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:22.563837 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3198edff-efc6-4645-bce0-f4d2cb8279bd tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1716 microversion: 2.1 time: 0.758869 Aug 24 10:19:22.564765 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1017/1847] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:21 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1716 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:22.588038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ce786a49-cef6-4e9e-8f09-92547e8755d6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:22.591206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ce786a49-cef6-4e9e-8f09-92547e8755d6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:22.613985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce786a49-cef6-4e9e-8f09-92547e8755d6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:22.615183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce786a49-cef6-4e9e-8f09-92547e8755d6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:22.616100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce786a49-cef6-4e9e-8f09-92547e8755d6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:22.617593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce786a49-cef6-4e9e-8f09-92547e8755d6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:22.618633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce786a49-cef6-4e9e-8f09-92547e8755d6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:22.620686 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce786a49-cef6-4e9e-8f09-92547e8755d6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:22.754504 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b6f8f0d6-5b6a-4049-adfb-0e82b006c922 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:22.773446 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b6f8f0d6-5b6a-4049-adfb-0e82b006c922 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e" status: 200 len: 1522 microversion: 2.1 time: 0.526583 Aug 24 10:19:22.775213 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 831/1848] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:22 2022] GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e => generated 1522 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:22.876549 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ce786a49-cef6-4e9e-8f09-92547e8755d6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.294982 Aug 24 10:19:22.879757 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1018/1849] 10.222.0.85 () {60 vars in 1316 bytes} [Wed Aug 24 10:19:22 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd/os-interface => generated 1832 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:22.894277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ff63dc2-c3dc-4441-b41f-007490bdb665 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-838724419"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:22.896711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8ff63dc2-c3dc-4441-b41f-007490bdb665 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 6f46192a-0f63-45dd-9ca9-7fda5730ef6e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:22.910485 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ff63dc2-c3dc-4441-b41f-007490bdb665 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:22.911369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ff63dc2-c3dc-4441-b41f-007490bdb665 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:22.914080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ff63dc2-c3dc-4441-b41f-007490bdb665 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:22.915204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ff63dc2-c3dc-4441-b41f-007490bdb665 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:22.915988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ff63dc2-c3dc-4441-b41f-007490bdb665 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:22.916674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ff63dc2-c3dc-4441-b41f-007490bdb665 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:23.155630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e3460a3f-bcdb-4251-a9a0-bdbaa8aeaad4 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:23.159224 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:19:23.159224 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:19:23.160713 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3460a3f-bcdb-4251-a9a0-bdbaa8aeaad4 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:23.165457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3460a3f-bcdb-4251-a9a0-bdbaa8aeaad4 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:23.166129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3460a3f-bcdb-4251-a9a0-bdbaa8aeaad4 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:23.167125 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3460a3f-bcdb-4251-a9a0-bdbaa8aeaad4 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:23.167747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3460a3f-bcdb-4251-a9a0-bdbaa8aeaad4 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:23.168634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3460a3f-bcdb-4251-a9a0-bdbaa8aeaad4 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:23.234159 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e3460a3f-bcdb-4251-a9a0-bdbaa8aeaad4 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.456491 Aug 24 10:19:23.235191 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 832/1850] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:19:22 2022] GET /compute/v2.1/os-services => generated 944 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:23.252203 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bec279eb-5b5a-4efa-a5c1-775cfb4c8106 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:23.255498 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:19:23.255498 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:19:23.257460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bec279eb-5b5a-4efa-a5c1-775cfb4c8106 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:23.258123 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bec279eb-5b5a-4efa-a5c1-775cfb4c8106 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:23.258789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bec279eb-5b5a-4efa-a5c1-775cfb4c8106 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:23.259732 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bec279eb-5b5a-4efa-a5c1-775cfb4c8106 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:23.260347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bec279eb-5b5a-4efa-a5c1-775cfb4c8106 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:23.260933 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bec279eb-5b5a-4efa-a5c1-775cfb4c8106 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:23.312061 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8ff63dc2-c3dc-4441-b41f-007490bdb665 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "POST /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e/action" status: 202 len: 0 microversion: 2.1 time: 0.427725 Aug 24 10:19:23.314946 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1019/1851] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:19:22 2022] POST /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 10:19:23.322308 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bec279eb-5b5a-4efa-a5c1-775cfb4c8106 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] 10.222.0.85 "GET /compute/v2.1/os-services?host=n-d-849328-3" status: 200 len: 578 microversion: 2.1 time: 0.074621 Aug 24 10:19:23.324761 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 833/1852] 10.222.0.85 () {58 vars in 1172 bytes} [Wed Aug 24 10:19:23 2022] GET /compute/v2.1/os-services?host=n-d-849328-3 => generated 578 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:23.335382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8f6ecdb2-6b5f-4c27-a2b2-a67946586391 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:23.339328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8f6ecdb2-6b5f-4c27-a2b2-a67946586391 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:23.348231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b82e376b-0fcb-42c2-91c6-0e391c523eff tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '.version_select at 0x7f4654fbdaf0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:23.359246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f6ecdb2-6b5f-4c27-a2b2-a67946586391 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:23.362502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f6ecdb2-6b5f-4c27-a2b2-a67946586391 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:23.363281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f6ecdb2-6b5f-4c27-a2b2-a67946586391 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:23.375330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f6ecdb2-6b5f-4c27-a2b2-a67946586391 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:23.377083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f6ecdb2-6b5f-4c27-a2b2-a67946586391 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:23.382008 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f6ecdb2-6b5f-4c27-a2b2-a67946586391 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:23.684269 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b82e376b-0fcb-42c2-91c6-0e391c523eff tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "DELETE /compute/v2.1/images/00e5ec09-38fb-41ee-953d-f209f4f3ced3" status: 204 len: 0 microversion: 2.1 time: 0.356531 Aug 24 10:19:23.686440 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 834/1853] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:23 2022] DELETE /compute/v2.1/images/00e5ec09-38fb-41ee-953d-f209f4f3ced3 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:19:23.704576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-778b0235-9600-4922-b49f-1b52acef1073 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:23.714666 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:19:23.714666 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:19:23.722864 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-778b0235-9600-4922-b49f-1b52acef1073 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:23.726071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-778b0235-9600-4922-b49f-1b52acef1073 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:23.726807 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-778b0235-9600-4922-b49f-1b52acef1073 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:23.729596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-778b0235-9600-4922-b49f-1b52acef1073 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:23.730410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-778b0235-9600-4922-b49f-1b52acef1073 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:23.731233 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-778b0235-9600-4922-b49f-1b52acef1073 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:23.792439 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-778b0235-9600-4922-b49f-1b52acef1073 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] 10.222.0.85 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.104411 Aug 24 10:19:23.793808 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 835/1854] 10.222.0.85 () {58 vars in 1176 bytes} [Wed Aug 24 10:19:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:23.804664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-75b2d9dc-1e52-4418-959e-ca5307b6b63f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:23.805996 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-75b2d9dc-1e52-4418-959e-ca5307b6b63f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:23.816156 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75b2d9dc-1e52-4418-959e-ca5307b6b63f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:23.817067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75b2d9dc-1e52-4418-959e-ca5307b6b63f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:23.819956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75b2d9dc-1e52-4418-959e-ca5307b6b63f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:23.820975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75b2d9dc-1e52-4418-959e-ca5307b6b63f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:23.827188 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75b2d9dc-1e52-4418-959e-ca5307b6b63f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:23.827956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75b2d9dc-1e52-4418-959e-ca5307b6b63f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:24.044692 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8f6ecdb2-6b5f-4c27-a2b2-a67946586391 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:24.060329 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8f6ecdb2-6b5f-4c27-a2b2-a67946586391 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:24.070487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8f6ecdb2-6b5f-4c27-a2b2-a67946586391 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:24.090446 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8f6ecdb2-6b5f-4c27-a2b2-a67946586391 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1446 microversion: 2.75 time: 0.770684 Aug 24 10:19:24.095580 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1020/1855] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:23 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1446 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:24.110854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7579cbdd-b8e9-4a03-88fa-cb600fadc7f8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '.version_select at 0x7f465a1d0ca0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:24.166764 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-7579cbdd-b8e9-4a03-88fa-cb600fadc7f8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] HTTP exception thrown: Image not found. Aug 24 10:19:24.170031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7579cbdd-b8e9-4a03-88fa-cb600fadc7f8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Request method failure captured: Aug 24 10:19:24.170031 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/images/00e5ec09-38fb-41ee-953d-f209f4f3ced3 HTTP/1.1 Aug 24 10:19:24.170031 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:19:24.170031 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:19:24.170031 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:19:24.170031 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:19:24.170031 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:19:24.170031 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:19:24.170031 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:19:24.170031 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:19:24.170031 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfrThttCsJVn6ZYJ5IPHV9fokEqNFKnmNalLL8nZmf_ei5N3zrV08QH1KmLggfkmBKerwFjLosb49uBsjyVeSxt3NJxRyvR4_2es1MonVPd0vwRK6vdPZfvD2BRibktcybuLmMjpd59h5dgQc8Mlu-A4JR-WB_EJM5jyYx0kRVbI5dw Aug 24 10:19:24.170031 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:19:24.170031 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:19:24.170031 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:19:24.170031 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:19:24.170031 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:19:24.170031 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:19:24.170031 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 014076c393b148618aa03e8e8a0d5be7 Aug 24 10:19:24.170031 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:19:24.170031 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:19:24.170031 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:19:24.171647 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/014076c393b148618aa03e8e8a0d5be7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_014076c393b148618aa03e8e8a0d5be7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/014076c393b148618aa03e8e8a0d5be7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/014076c393b148618aa03e8e8a0d5be7"}]}] Aug 24 10:19:24.171647 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:19:24.171647 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 014076c393b148618aa03e8e8a0d5be7 Aug 24 10:19:24.171647 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:19:24.171647 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesOneServerNegativeTestJSON-949139278-project Aug 24 10:19:24.171647 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:19:24.171647 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:19:24.171647 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: a9111f8a2bae4e25a353ebb15eca2d5a Aug 24 10:19:24.171647 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-949139278-project Aug 24 10:19:24.171647 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:19:24.171647 n-d-849328-3 devstack@n-api.service[122433]: exception: Image not found. Aug 24 10:19:24.171647 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '00e5ec09-38fb-41ee-953d-f209f4f3ced3'} Aug 24 10:19:24.171647 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:19:24.172592 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:24.172592 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 10:19:24.172592 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 10:19:24.172592 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:19:24.172592 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:19:24.172592 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 10:19:24.172592 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 10:19:24.172592 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:19:24.172592 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:19:24.172592 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 10:19:24.172592 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 10:19:24.172592 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 10:19:24.172592 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 10:19:24.172592 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:19:24.172592 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:19:24.172592 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:19:24.172592 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:19:24.172592 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 00e5ec09-38fb-41ee-953d-f209f4f3ced3 Aug 24 10:19:24.173966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:24.173966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:24.173966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:24.173966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:24.173966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 24 10:19:24.173966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 24 10:19:24.173966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 10:19:24.173966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 10:19:24.173966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 10:19:24.173966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 10:19:24.173966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 10:19:24.173966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 10:19:24.173966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 10:19:24.173966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 10:19:24.173966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:19:24.173966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:19:24.173966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 10:19:24.173966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 10:19:24.173966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:19:24.173966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:19:24.175386 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 10:19:24.175386 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 10:19:24.175386 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 10:19:24.175386 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 10:19:24.175386 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:19:24.175386 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:19:24.175386 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:19:24.175386 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:19:24.175386 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 00e5ec09-38fb-41ee-953d-f209f4f3ced3 could not be found. Aug 24 10:19:24.175386 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:24.175386 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:24.175386 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:24.175386 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:24.175386 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:24.175386 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:24.175386 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:19:24.175386 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:19:24.175386 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:19:24.175386 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:19:24.176701 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:19:24.176701 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:19:24.176701 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 24 10:19:24.176701 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 10:19:24.176701 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 10:19:24.176701 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:24.176701 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:24.176701 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:24.176701 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:24.176701 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:24.176701 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:24.176701 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:19:24.176701 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:19:24.176701 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 10:19:24.176701 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:24.176701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7579cbdd-b8e9-4a03-88fa-cb600fadc7f8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Returning 404 to user: Image not found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:19:24.180172 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7579cbdd-b8e9-4a03-88fa-cb600fadc7f8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/images/00e5ec09-38fb-41ee-953d-f209f4f3ced3" status: 404 len: 62 microversion: 2.1 time: 0.074800 Aug 24 10:19:24.180172 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1021/1856] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:19:24 2022] GET /compute/v2.1/images/00e5ec09-38fb-41ee-953d-f209f4f3ced3 => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:19:24.188746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ac4dcb6-5915-4b27-9e7b-a76629329273 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:24.192952 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:19:24.192952 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:19:24.205053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ac4dcb6-5915-4b27-9e7b-a76629329273 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:24.205939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ac4dcb6-5915-4b27-9e7b-a76629329273 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:24.206700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ac4dcb6-5915-4b27-9e7b-a76629329273 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:24.209360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ac4dcb6-5915-4b27-9e7b-a76629329273 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:24.210187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ac4dcb6-5915-4b27-9e7b-a76629329273 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:24.210937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ac4dcb6-5915-4b27-9e7b-a76629329273 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:24.268415 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ac4dcb6-5915-4b27-9e7b-a76629329273 tempest-ServicesAdminTestJSON-163643244 tempest-ServicesAdminTestJSON-163643244-project-admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.088537 Aug 24 10:19:24.269034 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1022/1857] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:19:24 2022] GET /compute/v2.1/os-services => generated 944 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:24.300037 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-99bccad1-81ed-436a-ad8e-2816a1ce4d16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:24.307918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-99bccad1-81ed-436a-ad8e-2816a1ce4d16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 6f46192a-0f63-45dd-9ca9-7fda5730ef6e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:24.328242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99bccad1-81ed-436a-ad8e-2816a1ce4d16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:24.328754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99bccad1-81ed-436a-ad8e-2816a1ce4d16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:24.329231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99bccad1-81ed-436a-ad8e-2816a1ce4d16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:24.329964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99bccad1-81ed-436a-ad8e-2816a1ce4d16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:24.330616 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99bccad1-81ed-436a-ad8e-2816a1ce4d16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:24.330843 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99bccad1-81ed-436a-ad8e-2816a1ce4d16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:24.918550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-75b2d9dc-1e52-4418-959e-ca5307b6b63f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:24.935798 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-75b2d9dc-1e52-4418-959e-ca5307b6b63f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1716 microversion: 2.1 time: 1.139143 Aug 24 10:19:24.937524 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 836/1858] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:23 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1716 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:25.018414 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-99bccad1-81ed-436a-ad8e-2816a1ce4d16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:25.054085 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-99bccad1-81ed-436a-ad8e-2816a1ce4d16 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e" status: 200 len: 1534 microversion: 2.1 time: 0.762418 Aug 24 10:19:25.055216 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1023/1859] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:24 2022] GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e => generated 1534 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:25.122131 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f5e1059e-949b-4af1-9730-c3e9e1927b35 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:25.123535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f5e1059e-949b-4af1-9730-c3e9e1927b35 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:25.131972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-60288c48-1444-40b6-a5c9-67e5a0e3a81d req-2c4d2cf0-0493-431e-b5f9-68cdd105bc29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd", "tag": "6ed14169-2bb3-41fb-a411-6ef58f974592"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:25.151440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5e1059e-949b-4af1-9730-c3e9e1927b35 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:25.155252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5e1059e-949b-4af1-9730-c3e9e1927b35 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:25.156054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5e1059e-949b-4af1-9730-c3e9e1927b35 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:25.157089 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5e1059e-949b-4af1-9730-c3e9e1927b35 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:25.160654 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5e1059e-949b-4af1-9730-c3e9e1927b35 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:25.161288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5e1059e-949b-4af1-9730-c3e9e1927b35 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:25.162299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-60288c48-1444-40b6-a5c9-67e5a0e3a81d req-2c4d2cf0-0493-431e-b5f9-68cdd105bc29 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:25.165086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-60288c48-1444-40b6-a5c9-67e5a0e3a81d req-2c4d2cf0-0493-431e-b5f9-68cdd105bc29 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:25.165615 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-60288c48-1444-40b6-a5c9-67e5a0e3a81d req-2c4d2cf0-0493-431e-b5f9-68cdd105bc29 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:25.194640 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-60288c48-1444-40b6-a5c9-67e5a0e3a81d req-2c4d2cf0-0493-431e-b5f9-68cdd105bc29 service nova] Creating event network-changed:6ed14169-2bb3-41fb-a411-6ef58f974592 for instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd on n-h2-849328-3 Aug 24 10:19:25.219877 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-60288c48-1444-40b6-a5c9-67e5a0e3a81d req-2c4d2cf0-0493-431e-b5f9-68cdd105bc29 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093621 Aug 24 10:19:25.221007 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1024/1860] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:25.294118 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f5e1059e-949b-4af1-9730-c3e9e1927b35 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:25.313482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f5e1059e-949b-4af1-9730-c3e9e1927b35 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:25.319711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f5e1059e-949b-4af1-9730-c3e9e1927b35 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:25.332803 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f5e1059e-949b-4af1-9730-c3e9e1927b35 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1446 microversion: 2.75 time: 0.217879 Aug 24 10:19:25.336386 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 837/1861] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:25 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1446 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:25.973655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-657713f7-8919-40fb-acf7-126cc6ec5d3c tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:25.974539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-657713f7-8919-40fb-acf7-126cc6ec5d3c tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:25.985992 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-657713f7-8919-40fb-acf7-126cc6ec5d3c tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:25.986210 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-657713f7-8919-40fb-acf7-126cc6ec5d3c tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:25.986602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-657713f7-8919-40fb-acf7-126cc6ec5d3c tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:25.987286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-657713f7-8919-40fb-acf7-126cc6ec5d3c tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:25.987722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-657713f7-8919-40fb-acf7-126cc6ec5d3c tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:25.988144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-657713f7-8919-40fb-acf7-126cc6ec5d3c tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:26.086061 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c70399c5-5712-4e4d-ac36-f23969de2bdb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:26.087181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c70399c5-5712-4e4d-ac36-f23969de2bdb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 6f46192a-0f63-45dd-9ca9-7fda5730ef6e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:26.104039 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c70399c5-5712-4e4d-ac36-f23969de2bdb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:26.104750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c70399c5-5712-4e4d-ac36-f23969de2bdb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:26.105402 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c70399c5-5712-4e4d-ac36-f23969de2bdb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:26.106330 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c70399c5-5712-4e4d-ac36-f23969de2bdb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:26.106962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c70399c5-5712-4e4d-ac36-f23969de2bdb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:26.107648 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c70399c5-5712-4e4d-ac36-f23969de2bdb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:26.284682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-657713f7-8919-40fb-acf7-126cc6ec5d3c tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:26.318419 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-657713f7-8919-40fb-acf7-126cc6ec5d3c tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1716 microversion: 2.1 time: 0.347564 Aug 24 10:19:26.321779 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1025/1862] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:25 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1716 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:26.371250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-718bfc13-50e7-4b44-a07d-195475464e33 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:26.376097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-718bfc13-50e7-4b44-a07d-195475464e33 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:26.402830 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-718bfc13-50e7-4b44-a07d-195475464e33 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:26.408482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-718bfc13-50e7-4b44-a07d-195475464e33 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:26.409188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-718bfc13-50e7-4b44-a07d-195475464e33 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:26.410432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-718bfc13-50e7-4b44-a07d-195475464e33 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:26.411113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-718bfc13-50e7-4b44-a07d-195475464e33 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:26.411723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-718bfc13-50e7-4b44-a07d-195475464e33 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:26.630155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-718bfc13-50e7-4b44-a07d-195475464e33 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:26.656314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-718bfc13-50e7-4b44-a07d-195475464e33 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:26.664970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-718bfc13-50e7-4b44-a07d-195475464e33 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:26.699805 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-718bfc13-50e7-4b44-a07d-195475464e33 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1446 microversion: 2.75 time: 0.337822 Aug 24 10:19:26.703347 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1026/1863] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:26 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1446 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:19:26.741802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c70399c5-5712-4e4d-ac36-f23969de2bdb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:26.751639 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c70399c5-5712-4e4d-ac36-f23969de2bdb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e" status: 200 len: 1540 microversion: 2.1 time: 0.669406 Aug 24 10:19:26.762421 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 838/1864] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:26 2022] GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e => generated 1540 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:27.358440 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a84177be-a103-4aa4-a766-fafdc40115de tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:27.359902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a84177be-a103-4aa4-a766-fafdc40115de tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:27.380949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a84177be-a103-4aa4-a766-fafdc40115de tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:27.387438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a84177be-a103-4aa4-a766-fafdc40115de tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:27.389532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a84177be-a103-4aa4-a766-fafdc40115de tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:27.399244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a84177be-a103-4aa4-a766-fafdc40115de tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:27.402061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a84177be-a103-4aa4-a766-fafdc40115de tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:27.403530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a84177be-a103-4aa4-a766-fafdc40115de tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:27.731349 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-38ffa0d4-ca8d-40cb-8f09-d1ee7ada070a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:27.732851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-38ffa0d4-ca8d-40cb-8f09-d1ee7ada070a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:27.744050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38ffa0d4-ca8d-40cb-8f09-d1ee7ada070a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:27.744818 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38ffa0d4-ca8d-40cb-8f09-d1ee7ada070a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:27.748779 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38ffa0d4-ca8d-40cb-8f09-d1ee7ada070a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:27.749806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38ffa0d4-ca8d-40cb-8f09-d1ee7ada070a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:27.750541 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38ffa0d4-ca8d-40cb-8f09-d1ee7ada070a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:27.754346 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38ffa0d4-ca8d-40cb-8f09-d1ee7ada070a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:27.767762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a84177be-a103-4aa4-a766-fafdc40115de tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:27.782817 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a84177be-a103-4aa4-a766-fafdc40115de tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1716 microversion: 2.1 time: 0.430643 Aug 24 10:19:27.797486 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1027/1865] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:27 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1716 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:27.809369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ad7654a4-6590-4fd5-9230-566efa6e126a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:27.809897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ad7654a4-6590-4fd5-9230-566efa6e126a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 6f46192a-0f63-45dd-9ca9-7fda5730ef6e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:27.827308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad7654a4-6590-4fd5-9230-566efa6e126a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:27.828111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad7654a4-6590-4fd5-9230-566efa6e126a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:27.828793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad7654a4-6590-4fd5-9230-566efa6e126a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:27.829765 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad7654a4-6590-4fd5-9230-566efa6e126a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:27.830374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad7654a4-6590-4fd5-9230-566efa6e126a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:27.830957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad7654a4-6590-4fd5-9230-566efa6e126a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:27.900521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-38ffa0d4-ca8d-40cb-8f09-d1ee7ada070a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:27.910891 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-38ffa0d4-ca8d-40cb-8f09-d1ee7ada070a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:27.916640 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-38ffa0d4-ca8d-40cb-8f09-d1ee7ada070a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:27.958816 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-38ffa0d4-ca8d-40cb-8f09-d1ee7ada070a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1446 microversion: 2.75 time: 0.231403 Aug 24 10:19:27.974772 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 839/1866] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:27 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1446 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:19:28.174649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ad7654a4-6590-4fd5-9230-566efa6e126a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:28.186099 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ad7654a4-6590-4fd5-9230-566efa6e126a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e" status: 200 len: 1522 microversion: 2.1 time: 0.381043 Aug 24 10:19:28.187009 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1028/1867] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:27 2022] GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e => generated 1522 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:28.231757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-96edccd2-7d06-4e17-a7b7-d5bedc079a0a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:28.233292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-96edccd2-7d06-4e17-a7b7-d5bedc079a0a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 6f46192a-0f63-45dd-9ca9-7fda5730ef6e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:28.248928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96edccd2-7d06-4e17-a7b7-d5bedc079a0a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:28.249795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96edccd2-7d06-4e17-a7b7-d5bedc079a0a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:28.250977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96edccd2-7d06-4e17-a7b7-d5bedc079a0a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:28.252487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96edccd2-7d06-4e17-a7b7-d5bedc079a0a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:28.254020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96edccd2-7d06-4e17-a7b7-d5bedc079a0a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:28.255141 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96edccd2-7d06-4e17-a7b7-d5bedc079a0a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:28.317141 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-96edccd2-7d06-4e17-a7b7-d5bedc079a0a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 6f46192a-0f63-45dd-9ca9-7fda5730ef6e] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:19:28.485933 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-96edccd2-7d06-4e17-a7b7-d5bedc079a0a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "DELETE /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e" status: 204 len: 0 microversion: 2.1 time: 0.261406 Aug 24 10:19:28.500034 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 840/1868] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:19:28 2022] DELETE /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:19:28.509309 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d63ea99b-1c53-4b40-a397-b71e776457a7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:28.510204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d63ea99b-1c53-4b40-a397-b71e776457a7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 6f46192a-0f63-45dd-9ca9-7fda5730ef6e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:28.523630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d63ea99b-1c53-4b40-a397-b71e776457a7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:28.524173 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d63ea99b-1c53-4b40-a397-b71e776457a7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:28.524626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d63ea99b-1c53-4b40-a397-b71e776457a7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:28.525376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d63ea99b-1c53-4b40-a397-b71e776457a7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:28.525831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d63ea99b-1c53-4b40-a397-b71e776457a7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:28.526251 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d63ea99b-1c53-4b40-a397-b71e776457a7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:28.814814 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8610dcf6-04fe-4884-8efc-4acbb6c78311 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:28.815487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8610dcf6-04fe-4884-8efc-4acbb6c78311 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:28.830024 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8610dcf6-04fe-4884-8efc-4acbb6c78311 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:28.830522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8610dcf6-04fe-4884-8efc-4acbb6c78311 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:28.833065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8610dcf6-04fe-4884-8efc-4acbb6c78311 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:28.834035 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8610dcf6-04fe-4884-8efc-4acbb6c78311 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:28.834515 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8610dcf6-04fe-4884-8efc-4acbb6c78311 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:28.834953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8610dcf6-04fe-4884-8efc-4acbb6c78311 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:28.862630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d63ea99b-1c53-4b40-a397-b71e776457a7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:28.872004 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d63ea99b-1c53-4b40-a397-b71e776457a7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e" status: 200 len: 1528 microversion: 2.1 time: 0.366893 Aug 24 10:19:28.885596 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1029/1869] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:28 2022] GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e => generated 1528 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:29.146992 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-64874502-dd6e-4415-9901-113e61bd7cfe tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:29.162028 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-64874502-dd6e-4415-9901-113e61bd7cfe tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] 10.222.0.85 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.200550 Aug 24 10:19:29.176562 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1030/1870] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:19:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:29.185316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cf86f8a1-9d87-443e-ac91-07804dded896 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:29.187610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cf86f8a1-9d87-443e-ac91-07804dded896 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:29.191190 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8610dcf6-04fe-4884-8efc-4acbb6c78311 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:29.197683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf86f8a1-9d87-443e-ac91-07804dded896 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:29.198774 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf86f8a1-9d87-443e-ac91-07804dded896 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:29.200647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf86f8a1-9d87-443e-ac91-07804dded896 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:29.202378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf86f8a1-9d87-443e-ac91-07804dded896 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:29.203432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf86f8a1-9d87-443e-ac91-07804dded896 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:29.204388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf86f8a1-9d87-443e-ac91-07804dded896 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:29.214968 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8610dcf6-04fe-4884-8efc-4acbb6c78311 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1716 microversion: 2.1 time: 0.400744 Aug 24 10:19:29.230282 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 841/1871] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:28 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1716 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:29.246552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4dbb28e9-789d-4d31-952b-b1f021aca462 tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:29.284921 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4dbb28e9-789d-4d31-952b-b1f021aca462 tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] 10.222.0.85 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.052917 Aug 24 10:19:29.285638 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 842/1872] 10.222.0.85 () {58 vars in 1125 bytes} [Wed Aug 24 10:19:29 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:29.302256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7743f969-2f98-46c8-82e2-07843257e0ba tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:29.329852 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7743f969-2f98-46c8-82e2-07843257e0ba tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] 10.222.0.85 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031583 Aug 24 10:19:29.330767 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 843/1873] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:19:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:29.344368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cf86f8a1-9d87-443e-ac91-07804dded896 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:29.348963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:29.360672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cf86f8a1-9d87-443e-ac91-07804dded896 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:29.363153 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-93c25757-585e-4557-8825-ca0e9c3565ee tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:29.369587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cf86f8a1-9d87-443e-ac91-07804dded896 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:29.390424 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cf86f8a1-9d87-443e-ac91-07804dded896 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1446 microversion: 2.75 time: 0.212073 Aug 24 10:19:29.391448 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1031/1874] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:29 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1446 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:29.405399 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-93c25757-585e-4557-8825-ca0e9c3565ee tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] 10.222.0.85 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.044902 Aug 24 10:19:29.409462 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 844/1875] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:19:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:19:29.415506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-00c9f0a4-0276-4b99-8c0c-ea9e916d402e tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:29.456093 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-00c9f0a4-0276-4b99-8c0c-ea9e916d402e tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] 10.222.0.85 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.048159 Aug 24 10:19:29.456697 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1032/1876] 10.222.0.85 () {58 vars in 1165 bytes} [Wed Aug 24 10:19:29 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:29.477372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f2686001-93c2-4639-8497-73e012b8d749 tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:29.493535 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f2686001-93c2-4639-8497-73e012b8d749 tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] 10.222.0.85 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016003 Aug 24 10:19:29.521721 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 845/1877] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:19:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:29.537344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-70e8ec8d-b638-4fd5-828a-f43a1cf6146d tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:29.589492 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-70e8ec8d-b638-4fd5-828a-f43a1cf6146d tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] 10.222.0.85 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.076758 Aug 24 10:19:29.591029 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1033/1878] 10.222.0.85 () {58 vars in 1169 bytes} [Wed Aug 24 10:19:29 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:29.611390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8d326b77-a491-423b-9974-9f5a56843b08 tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:29.643216 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8d326b77-a491-423b-9974-9f5a56843b08 tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] 10.222.0.85 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.038659 Aug 24 10:19:29.657878 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 846/1879] 10.222.0.85 () {58 vars in 1161 bytes} [Wed Aug 24 10:19:29 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:29.664128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b50648f8-55d2-487d-9066-d44d1f4c8935 tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:29.679795 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b50648f8-55d2-487d-9066-d44d1f4c8935 tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] 10.222.0.85 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019828 Aug 24 10:19:29.680711 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1034/1880] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:19:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:29.694320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b534d172-7ddd-45b1-90d0-4c6b7c4f9020 tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:29.730219 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:29.784950 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b534d172-7ddd-45b1-90d0-4c6b7c4f9020 tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] 10.222.0.85 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.093833 Aug 24 10:19:29.787030 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 847/1881] 10.222.0.85 () {58 vars in 1167 bytes} [Wed Aug 24 10:19:29 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:29.807290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-666a5f01-73da-4bd5-8d2a-4b52ddee978f tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:29.836041 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-666a5f01-73da-4bd5-8d2a-4b52ddee978f tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] 10.222.0.85 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033454 Aug 24 10:19:29.845294 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1035/1882] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:19:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:29.852515 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6d1d33a9-087b-43bd-b028-e01918cb0c76 tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:29.898500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1d22d694-2b18-412e-92f8-06c1846d05fe tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:29.899106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1d22d694-2b18-412e-92f8-06c1846d05fe tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 6f46192a-0f63-45dd-9ca9-7fda5730ef6e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:29.907107 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d22d694-2b18-412e-92f8-06c1846d05fe tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:29.907944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d22d694-2b18-412e-92f8-06c1846d05fe tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:29.908629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d22d694-2b18-412e-92f8-06c1846d05fe tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:29.909746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d22d694-2b18-412e-92f8-06c1846d05fe tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:29.910451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d22d694-2b18-412e-92f8-06c1846d05fe tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:29.911113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d22d694-2b18-412e-92f8-06c1846d05fe tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:29.929942 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6d1d33a9-087b-43bd-b028-e01918cb0c76 tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] 10.222.0.85 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.084445 Aug 24 10:19:29.931299 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 848/1883] 10.222.0.85 () {58 vars in 1144 bytes} [Wed Aug 24 10:19:29 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:29.955945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-98bf039a-2767-4332-8f3e-18a3d8d84215 tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:29.971596 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-98bf039a-2767-4332-8f3e-18a3d8d84215 tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] 10.222.0.85 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022387 Aug 24 10:19:29.973033 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 849/1884] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:19:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:29.998955 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7c522d8a-89f6-481f-8264-a75f7ae65c70 tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:30.024457 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7c522d8a-89f6-481f-8264-a75f7ae65c70 tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] 10.222.0.85 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.029743 Aug 24 10:19:30.025618 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 850/1885] 10.222.0.85 () {58 vars in 1148 bytes} [Wed Aug 24 10:19:29 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:30.042026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5092ef7b-a7ef-4c85-9c5f-0bd00c8421c8 tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:30.058014 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5092ef7b-a7ef-4c85-9c5f-0bd00c8421c8 tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] 10.222.0.85 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.021780 Aug 24 10:19:30.059032 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 851/1886] 10.222.0.85 () {58 vars in 1140 bytes} [Wed Aug 24 10:19:30 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:19:30.071202 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f12fefe2-4cc5-4f06-8728-8c24c435f02e tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:30.083586 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f12fefe2-4cc5-4f06-8728-8c24c435f02e tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] 10.222.0.85 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015780 Aug 24 10:19:30.084784 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 852/1887] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:19:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:19:30.100754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5c4e1ad9-d1ae-4745-a69e-263e2c8c8b87 tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:30.129104 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5c4e1ad9-d1ae-4745-a69e-263e2c8c8b87 tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] 10.222.0.85 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.035744 Aug 24 10:19:30.129713 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 853/1888] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:19:30 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:30.144346 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-591cfd56-7733-45fa-868d-ba1aaac10403 tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:30.166067 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-591cfd56-7733-45fa-868d-ba1aaac10403 tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025803 Aug 24 10:19:30.166988 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 854/1889] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:19:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:30.184308 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a40c8864-a041-4dea-b226-753eba7bd314 tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:30.194845 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a40c8864-a041-4dea-b226-753eba7bd314 tempest-FlavorsV2TestJSON-1319052585 tempest-FlavorsV2TestJSON-1319052585-project] 10.222.0.85 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014581 Aug 24 10:19:30.201278 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 855/1890] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:19:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:19:30.228578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1d22d694-2b18-412e-92f8-06c1846d05fe tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:30.244030 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1d22d694-2b18-412e-92f8-06c1846d05fe tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e" status: 200 len: 1528 microversion: 2.1 time: 0.351048 Aug 24 10:19:30.245048 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1036/1891] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:29 2022] GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e => generated 1528 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:30.264435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6aa68d88-5015-4336-956b-5b3b052f65d2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:30.265210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6aa68d88-5015-4336-956b-5b3b052f65d2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:30.274773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aa68d88-5015-4336-956b-5b3b052f65d2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:30.275563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aa68d88-5015-4336-956b-5b3b052f65d2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:30.276182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aa68d88-5015-4336-956b-5b3b052f65d2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:30.277083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aa68d88-5015-4336-956b-5b3b052f65d2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:30.278219 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aa68d88-5015-4336-956b-5b3b052f65d2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:30.279146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aa68d88-5015-4336-956b-5b3b052f65d2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:30.433997 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2ef58d1e-3412-434b-a432-90d891bab1e5 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:30.436174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2ef58d1e-3412-434b-a432-90d891bab1e5 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:30.448358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ef58d1e-3412-434b-a432-90d891bab1e5 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:30.448969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ef58d1e-3412-434b-a432-90d891bab1e5 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:30.449533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ef58d1e-3412-434b-a432-90d891bab1e5 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:30.450857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ef58d1e-3412-434b-a432-90d891bab1e5 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:30.451997 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ef58d1e-3412-434b-a432-90d891bab1e5 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:30.452430 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ef58d1e-3412-434b-a432-90d891bab1e5 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:30.625294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2ef58d1e-3412-434b-a432-90d891bab1e5 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:30.652536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2ef58d1e-3412-434b-a432-90d891bab1e5 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:30.655479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2ef58d1e-3412-434b-a432-90d891bab1e5 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:30.664824 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2ef58d1e-3412-434b-a432-90d891bab1e5 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1446 microversion: 2.75 time: 0.244785 Aug 24 10:19:30.666532 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1037/1892] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:30 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1446 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:30.756758 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6aa68d88-5015-4336-956b-5b3b052f65d2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:30.767327 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6aa68d88-5015-4336-956b-5b3b052f65d2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1716 microversion: 2.1 time: 0.509451 Aug 24 10:19:30.767946 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 856/1893] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:30 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1716 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:31.272292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bcb7b335-5e0a-4abd-838c-1f04dbcc829e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:31.275025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bcb7b335-5e0a-4abd-838c-1f04dbcc829e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 6f46192a-0f63-45dd-9ca9-7fda5730ef6e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:31.284175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcb7b335-5e0a-4abd-838c-1f04dbcc829e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:31.284644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcb7b335-5e0a-4abd-838c-1f04dbcc829e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:31.285234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcb7b335-5e0a-4abd-838c-1f04dbcc829e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:31.286727 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcb7b335-5e0a-4abd-838c-1f04dbcc829e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:31.287375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcb7b335-5e0a-4abd-838c-1f04dbcc829e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:31.288055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcb7b335-5e0a-4abd-838c-1f04dbcc829e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:31.651579 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-48f25224-21e6-4e72-85da-ec344728c076 req-c2546898-e632-4d07-bfdf-e9ac6191ecb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f46192a-0f63-45dd-9ca9-7fda5730ef6e", "name": "network-vif-deleted", "tag": "d1e13e32-aa4b-434a-8dbc-621e15239757"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:31.688245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-48f25224-21e6-4e72-85da-ec344728c076 req-c2546898-e632-4d07-bfdf-e9ac6191ecb7 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:31.700134 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-48f25224-21e6-4e72-85da-ec344728c076 req-c2546898-e632-4d07-bfdf-e9ac6191ecb7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:31.701070 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-48f25224-21e6-4e72-85da-ec344728c076 req-c2546898-e632-4d07-bfdf-e9ac6191ecb7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:31.723259 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-48f25224-21e6-4e72-85da-ec344728c076 req-c2546898-e632-4d07-bfdf-e9ac6191ecb7 service nova] Creating event network-vif-deleted:d1e13e32-aa4b-434a-8dbc-621e15239757 for instance 6f46192a-0f63-45dd-9ca9-7fda5730ef6e on n-h1-849328-3 Aug 24 10:19:31.729308 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-48f25224-21e6-4e72-85da-ec344728c076 req-c2546898-e632-4d07-bfdf-e9ac6191ecb7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088255 Aug 24 10:19:31.730542 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 857/1894] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:19:31.736424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bcb7b335-5e0a-4abd-838c-1f04dbcc829e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:31.739470 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-37b21f91-5581-410a-baa2-a6c0cda69dc9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:31.744099 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-37b21f91-5581-410a-baa2-a6c0cda69dc9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:31.751253 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bcb7b335-5e0a-4abd-838c-1f04dbcc829e tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e" status: 200 len: 1528 microversion: 2.1 time: 0.480203 Aug 24 10:19:31.761494 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1038/1895] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:31 2022] GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e => generated 1528 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:31.770299 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37b21f91-5581-410a-baa2-a6c0cda69dc9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:31.770802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37b21f91-5581-410a-baa2-a6c0cda69dc9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:31.771362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37b21f91-5581-410a-baa2-a6c0cda69dc9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:31.772413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37b21f91-5581-410a-baa2-a6c0cda69dc9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:31.772884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37b21f91-5581-410a-baa2-a6c0cda69dc9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:31.773439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37b21f91-5581-410a-baa2-a6c0cda69dc9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:31.790607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ea9a16ef-e40b-4e12-8310-96a7f5e89262 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:31.791729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ea9a16ef-e40b-4e12-8310-96a7f5e89262 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:31.818831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea9a16ef-e40b-4e12-8310-96a7f5e89262 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:31.821998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea9a16ef-e40b-4e12-8310-96a7f5e89262 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:31.826861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea9a16ef-e40b-4e12-8310-96a7f5e89262 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:31.840883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea9a16ef-e40b-4e12-8310-96a7f5e89262 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:31.841746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea9a16ef-e40b-4e12-8310-96a7f5e89262 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:31.842965 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea9a16ef-e40b-4e12-8310-96a7f5e89262 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:31.978063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37b21f91-5581-410a-baa2-a6c0cda69dc9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:31.989737 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37b21f91-5581-410a-baa2-a6c0cda69dc9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:31.991512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37b21f91-5581-410a-baa2-a6c0cda69dc9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:32.001571 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-37b21f91-5581-410a-baa2-a6c0cda69dc9 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1446 microversion: 2.75 time: 0.268805 Aug 24 10:19:32.002616 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 858/1896] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:31 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1446 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:32.085888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-54718c37-1b6f-4155-ad16-1a87c875bcee tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:32.091434 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-54718c37-1b6f-4155-ad16-1a87c875bcee tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '72cfea45817848c5b0d3e20087d60d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1d41b854f94d67be99f5926a96376c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:32.092730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-54718c37-1b6f-4155-ad16-1a87c875bcee tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Searching by: {'deleted': False, 'project_id': '1c1d41b854f94d67be99f5926a96376c'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:19:32.099300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54718c37-1b6f-4155-ad16-1a87c875bcee tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:32.100217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54718c37-1b6f-4155-ad16-1a87c875bcee tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:32.100917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54718c37-1b6f-4155-ad16-1a87c875bcee tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:32.102023 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54718c37-1b6f-4155-ad16-1a87c875bcee tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:32.102489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54718c37-1b6f-4155-ad16-1a87c875bcee tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:32.102924 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54718c37-1b6f-4155-ad16-1a87c875bcee tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:32.199918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-54718c37-1b6f-4155-ad16-1a87c875bcee tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:19:32.289914 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-54718c37-1b6f-4155-ad16-1a87c875bcee tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.209539 Aug 24 10:19:32.290912 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 859/1897] 10.222.0.85 () {58 vars in 1125 bytes} [Wed Aug 24 10:19:32 2022] GET /compute/v2.1/servers => generated 333 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:32.312480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0a259b65-4208-48a6-806d-3f22b4beffdc tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:32.320820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0a259b65-4208-48a6-806d-3f22b4beffdc tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '72cfea45817848c5b0d3e20087d60d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1d41b854f94d67be99f5926a96376c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:32.322237 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0a259b65-4208-48a6-806d-3f22b4beffdc tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Searching by: {'deleted': False, 'project_id': '1c1d41b854f94d67be99f5926a96376c'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:19:32.350090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a259b65-4208-48a6-806d-3f22b4beffdc tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:32.350848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a259b65-4208-48a6-806d-3f22b4beffdc tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:32.353915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a259b65-4208-48a6-806d-3f22b4beffdc tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:32.357599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a259b65-4208-48a6-806d-3f22b4beffdc tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:32.359706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a259b65-4208-48a6-806d-3f22b4beffdc tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:32.362081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a259b65-4208-48a6-806d-3f22b4beffdc tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:32.387517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:32.443664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-0a259b65-4208-48a6-806d-3f22b4beffdc tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:19:32.536702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0a259b65-4208-48a6-806d-3f22b4beffdc tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cfea45817848c5b0d3e20087d60d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1d41b854f94d67be99f5926a96376c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:32.548035 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a259b65-4208-48a6-806d-3f22b4beffdc tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:32.548876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a259b65-4208-48a6-806d-3f22b4beffdc tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:32.549961 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a259b65-4208-48a6-806d-3f22b4beffdc tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:32.686166 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ea9a16ef-e40b-4e12-8310-96a7f5e89262 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:32.696684 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ea9a16ef-e40b-4e12-8310-96a7f5e89262 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1716 microversion: 2.1 time: 0.909862 Aug 24 10:19:32.704258 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1039/1898] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:31 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1716 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:32.778580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-391ca2b0-ec60-41e2-a337-b94ca22eee6b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:32.780294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-391ca2b0-ec60-41e2-a337-b94ca22eee6b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 6f46192a-0f63-45dd-9ca9-7fda5730ef6e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:32.782540 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0a259b65-4208-48a6-806d-3f22b4beffdc tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.479541 Aug 24 10:19:32.783985 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 860/1899] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:19:32 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:32.802516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-391ca2b0-ec60-41e2-a337-b94ca22eee6b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:32.803873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-391ca2b0-ec60-41e2-a337-b94ca22eee6b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:32.805574 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-391ca2b0-ec60-41e2-a337-b94ca22eee6b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:32.807239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-391ca2b0-ec60-41e2-a337-b94ca22eee6b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:32.808449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-391ca2b0-ec60-41e2-a337-b94ca22eee6b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:32.809819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-391ca2b0-ec60-41e2-a337-b94ca22eee6b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:32.822523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9735bf5f-c6fd-4314-8415-f583a19f21b5 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:32.837748 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9735bf5f-c6fd-4314-8415-f583a19f21b5 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021948 Aug 24 10:19:32.843996 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 861/1900] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:19:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:32.859487 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-391ca2b0-ec60-41e2-a337-b94ca22eee6b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] HTTP exception thrown: Instance 6f46192a-0f63-45dd-9ca9-7fda5730ef6e could not be found. Aug 24 10:19:32.865372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-391ca2b0-ec60-41e2-a337-b94ca22eee6b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Request method failure captured: Aug 24 10:19:32.865372 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e HTTP/1.1 Aug 24 10:19:32.865372 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:19:32.865372 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:19:32.865372 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:19:32.865372 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:19:32.865372 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:19:32.865372 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:19:32.865372 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:19:32.865372 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:19:32.865372 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfrThttCsJVn6ZYJ5IPHV9fokEqNFKnmNalLL8nZmf_ei5N3zrV08QH1KmLggfkmBKerwFjLosb49uBsjyVeSxt3NJxRyvR4_2es1MonVPd0vwRK6vdPZfvD2BRibktcybuLmMjpd59h5dgQc8Mlu-A4JR-WB_EJM5jyYx0kRVbI5dw Aug 24 10:19:32.865372 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:19:32.865372 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:19:32.865372 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:19:32.865372 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:19:32.865372 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:19:32.865372 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:19:32.865372 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 014076c393b148618aa03e8e8a0d5be7 Aug 24 10:19:32.865372 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:19:32.865372 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:19:32.865372 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:19:32.867556 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/014076c393b148618aa03e8e8a0d5be7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_014076c393b148618aa03e8e8a0d5be7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/014076c393b148618aa03e8e8a0d5be7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/014076c393b148618aa03e8e8a0d5be7"}]}] Aug 24 10:19:32.867556 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:19:32.867556 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 014076c393b148618aa03e8e8a0d5be7 Aug 24 10:19:32.867556 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:19:32.867556 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesOneServerNegativeTestJSON-949139278-project Aug 24 10:19:32.867556 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:19:32.867556 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:19:32.867556 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: a9111f8a2bae4e25a353ebb15eca2d5a Aug 24 10:19:32.867556 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-949139278-project Aug 24 10:19:32.867556 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:19:32.867556 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 6f46192a-0f63-45dd-9ca9-7fda5730ef6e could not be found. Aug 24 10:19:32.867556 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '6f46192a-0f63-45dd-9ca9-7fda5730ef6e'} Aug 24 10:19:32.869339 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:19:32.869339 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:32.869339 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:19:32.869339 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:19:32.869339 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:19:32.869339 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:19:32.869339 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:19:32.869339 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:19:32.869339 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:19:32.869339 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:19:32.869339 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f46192a-0f63-45dd-9ca9-7fda5730ef6e could not be found. Aug 24 10:19:32.869339 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:32.869339 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:32.869339 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:32.869339 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:32.869339 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:32.869339 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:32.869339 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:19:32.869339 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:19:32.869339 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:19:32.871107 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:19:32.871107 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:19:32.871107 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:19:32.871107 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:19:32.871107 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:19:32.871107 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:19:32.871107 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:19:32.871107 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f46192a-0f63-45dd-9ca9-7fda5730ef6e could not be found. Aug 24 10:19:32.871107 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:32.871107 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:32.871107 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:32.871107 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:32.871107 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:32.871107 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:32.871107 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:19:32.871107 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:19:32.871107 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f46192a-0f63-45dd-9ca9-7fda5730ef6e could not be found. Aug 24 10:19:32.871107 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:32.874321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-391ca2b0-ec60-41e2-a337-b94ca22eee6b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Returning 404 to user: Instance 6f46192a-0f63-45dd-9ca9-7fda5730ef6e could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:19:32.874321 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-391ca2b0-ec60-41e2-a337-b94ca22eee6b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e" status: 404 len: 111 microversion: 2.1 time: 0.096457 Aug 24 10:19:32.874321 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1040/1901] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:32 2022] GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:19:33.033892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-237d7b51-8547-417b-a5eb-ffae039a995b tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:33.034524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-237d7b51-8547-417b-a5eb-ffae039a995b tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:33.048973 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-237d7b51-8547-417b-a5eb-ffae039a995b tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:33.052112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-237d7b51-8547-417b-a5eb-ffae039a995b tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:33.052676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-237d7b51-8547-417b-a5eb-ffae039a995b tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:33.053641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-237d7b51-8547-417b-a5eb-ffae039a995b tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:33.054237 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-237d7b51-8547-417b-a5eb-ffae039a995b tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:33.054710 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-237d7b51-8547-417b-a5eb-ffae039a995b tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:33.181855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-237d7b51-8547-417b-a5eb-ffae039a995b tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:33.195805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-237d7b51-8547-417b-a5eb-ffae039a995b tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:33.198424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-237d7b51-8547-417b-a5eb-ffae039a995b tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:33.253020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c0a17b58-c7dc-46b1-a4ef-91012c42b214 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2058186", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:33.256338 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-237d7b51-8547-417b-a5eb-ffae039a995b tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1446 microversion: 2.75 time: 0.226248 Aug 24 10:19:33.259149 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 862/1902] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:33 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1446 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:33.407057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-c0a17b58-c7dc-46b1-a4ef-91012c42b214 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] validate_networks() for [('fb3f2cc5-551a-4ee2-a1c9-53adbc2afa42', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:19:33.521482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-56c7c5d7-5920-49c2-9157-ef4c21c22f41 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:33.522777 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-56c7c5d7-5920-49c2-9157-ef4c21c22f41 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] [instance: 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:33.545653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56c7c5d7-5920-49c2-9157-ef4c21c22f41 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:33.551733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56c7c5d7-5920-49c2-9157-ef4c21c22f41 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:33.553312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56c7c5d7-5920-49c2-9157-ef4c21c22f41 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:33.558344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56c7c5d7-5920-49c2-9157-ef4c21c22f41 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:33.562657 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56c7c5d7-5920-49c2-9157-ef4c21c22f41 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:33.570970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56c7c5d7-5920-49c2-9157-ef4c21c22f41 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:33.665172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-56c7c5d7-5920-49c2-9157-ef4c21c22f41 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] [instance: 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:19:33.852527 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-56c7c5d7-5920-49c2-9157-ef4c21c22f41 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "DELETE /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4" status: 204 len: 0 microversion: 2.1 time: 0.340834 Aug 24 10:19:33.857449 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 863/1903] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:19:33 2022] DELETE /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:19:33.870230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-42fffd80-7bf5-4196-9bda-50b34c081466 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:33.874781 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-42fffd80-7bf5-4196-9bda-50b34c081466 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:33.889181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42fffd80-7bf5-4196-9bda-50b34c081466 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:33.892103 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42fffd80-7bf5-4196-9bda-50b34c081466 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:33.897059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42fffd80-7bf5-4196-9bda-50b34c081466 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:33.898111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42fffd80-7bf5-4196-9bda-50b34c081466 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:33.901520 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42fffd80-7bf5-4196-9bda-50b34c081466 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:33.902208 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42fffd80-7bf5-4196-9bda-50b34c081466 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:34.247832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:34.314466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c0a17b58-c7dc-46b1-a4ef-91012c42b214 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:19:34.316279 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c0a17b58-c7dc-46b1-a4ef-91012c42b214 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:19:34.317298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c0a17b58-c7dc-46b1-a4ef-91012c42b214 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:19:34.318259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c0a17b58-c7dc-46b1-a4ef-91012c42b214 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:19:34.319423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c0a17b58-c7dc-46b1-a4ef-91012c42b214 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:19:34.343491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0a17b58-c7dc-46b1-a4ef-91012c42b214 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:34.344479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0a17b58-c7dc-46b1-a4ef-91012c42b214 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:34.345627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0a17b58-c7dc-46b1-a4ef-91012c42b214 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:34.348339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0a17b58-c7dc-46b1-a4ef-91012c42b214 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:34.349012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0a17b58-c7dc-46b1-a4ef-91012c42b214 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:34.349665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0a17b58-c7dc-46b1-a4ef-91012c42b214 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:34.364527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:34.378527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-c0a17b58-c7dc-46b1-a4ef-91012c42b214 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Getting quotas for project 014076c393b148618aa03e8e8a0d5be7. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:19:34.390891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-c0a17b58-c7dc-46b1-a4ef-91012c42b214 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Getting quotas for user a9111f8a2bae4e25a353ebb15eca2d5a and project 014076c393b148618aa03e8e8a0d5be7. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:19:34.426690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c0a17b58-c7dc-46b1-a4ef-91012c42b214 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:19:34.429048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c0a17b58-c7dc-46b1-a4ef-91012c42b214 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 79f80505-bb77-41ee-9d20-794ccbf5c855] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:19:34.530557 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c0a17b58-c7dc-46b1-a4ef-91012c42b214 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.284941 Aug 24 10:19:34.531590 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1041/1904] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:19:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:19:34.537888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-42fffd80-7bf5-4196-9bda-50b34c081466 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:34.542424 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-42fffd80-7bf5-4196-9bda-50b34c081466 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1716 microversion: 2.1 time: 0.683325 Aug 24 10:19:34.543259 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 864/1905] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:33 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1716 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:34.545648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2b0d353e-d2e5-4347-b3a0-7e174aa575d2 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:34.546276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2b0d353e-d2e5-4347-b3a0-7e174aa575d2 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] [instance: 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:34.549762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-97d0db62-d383-4c8c-b7e1-41cc3627700d tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:34.550434 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-97d0db62-d383-4c8c-b7e1-41cc3627700d tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:34.556076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b0d353e-d2e5-4347-b3a0-7e174aa575d2 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:34.556592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b0d353e-d2e5-4347-b3a0-7e174aa575d2 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:34.557387 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b0d353e-d2e5-4347-b3a0-7e174aa575d2 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:34.558493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b0d353e-d2e5-4347-b3a0-7e174aa575d2 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:34.560024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b0d353e-d2e5-4347-b3a0-7e174aa575d2 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:34.561311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b0d353e-d2e5-4347-b3a0-7e174aa575d2 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:34.569699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97d0db62-d383-4c8c-b7e1-41cc3627700d tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:34.570204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97d0db62-d383-4c8c-b7e1-41cc3627700d tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:34.570636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97d0db62-d383-4c8c-b7e1-41cc3627700d tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:34.577364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97d0db62-d383-4c8c-b7e1-41cc3627700d tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:34.577766 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97d0db62-d383-4c8c-b7e1-41cc3627700d tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:34.578210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97d0db62-d383-4c8c-b7e1-41cc3627700d tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:34.730611 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-97d0db62-d383-4c8c-b7e1-41cc3627700d tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:34.759281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-97d0db62-d383-4c8c-b7e1-41cc3627700d tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:34.769604 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-97d0db62-d383-4c8c-b7e1-41cc3627700d tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:34.792898 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-97d0db62-d383-4c8c-b7e1-41cc3627700d tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1446 microversion: 2.75 time: 0.239987 Aug 24 10:19:34.793821 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 865/1906] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:34 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1446 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:34.803441 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fd320eea-5ad3-4ced-bc8c-87e556c80ff9 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:34.804219 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fd320eea-5ad3-4ced-bc8c-87e556c80ff9 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 79f80505-bb77-41ee-9d20-794ccbf5c855] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:34.905168 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fd320eea-5ad3-4ced-bc8c-87e556c80ff9 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:34.911993 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2b0d353e-d2e5-4347-b3a0-7e174aa575d2 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cfea45817848c5b0d3e20087d60d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1d41b854f94d67be99f5926a96376c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:34.919974 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fd320eea-5ad3-4ced-bc8c-87e556c80ff9 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855" status: 200 len: 1222 microversion: 2.1 time: 0.117657 Aug 24 10:19:34.922180 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 866/1907] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:34 2022] GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855 => generated 1222 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:34.934361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-494b27a1-644d-444c-85f1-cbab8bda5d2f req-d63443c9-bb4f-43c2-8856-356a3d2b6512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d844e7a-a6af-4c55-957c-a997c42927af", "name": "network-vif-unplugged", "status": "completed", "tag": "c818b602-5bd6-46ee-96c2-c41b38b25689"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:34.963311 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2b0d353e-d2e5-4347-b3a0-7e174aa575d2 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4" status: 200 len: 1699 microversion: 2.1 time: 0.423592 Aug 24 10:19:34.966236 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1042/1908] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:34 2022] GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 => generated 1699 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:34.968380 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-494b27a1-644d-444c-85f1-cbab8bda5d2f req-d63443c9-bb4f-43c2-8856-356a3d2b6512 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:34.968888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-494b27a1-644d-444c-85f1-cbab8bda5d2f req-d63443c9-bb4f-43c2-8856-356a3d2b6512 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:34.969551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-494b27a1-644d-444c-85f1-cbab8bda5d2f req-d63443c9-bb4f-43c2-8856-356a3d2b6512 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:34.991438 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-494b27a1-644d-444c-85f1-cbab8bda5d2f req-d63443c9-bb4f-43c2-8856-356a3d2b6512 service nova] Creating event network-vif-unplugged:c818b602-5bd6-46ee-96c2-c41b38b25689 for instance 4d844e7a-a6af-4c55-957c-a997c42927af on n-h1-849328-3 Aug 24 10:19:34.998446 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-494b27a1-644d-444c-85f1-cbab8bda5d2f req-d63443c9-bb4f-43c2-8856-356a3d2b6512 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074747 Aug 24 10:19:34.999725 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 867/1909] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:35.590072 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6b1af31a-245e-4f86-84e6-394b15d78039 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:35.592382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6b1af31a-245e-4f86-84e6-394b15d78039 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:35.606281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b1af31a-245e-4f86-84e6-394b15d78039 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:35.608909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b1af31a-245e-4f86-84e6-394b15d78039 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:35.609939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b1af31a-245e-4f86-84e6-394b15d78039 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:35.612269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b1af31a-245e-4f86-84e6-394b15d78039 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:35.613518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b1af31a-245e-4f86-84e6-394b15d78039 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:35.615053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b1af31a-245e-4f86-84e6-394b15d78039 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:35.830983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-051f73e2-38f9-4b2a-9e16-baa2f89bf2e4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:35.831970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-051f73e2-38f9-4b2a-9e16-baa2f89bf2e4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:35.843352 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-051f73e2-38f9-4b2a-9e16-baa2f89bf2e4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:35.849139 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-051f73e2-38f9-4b2a-9e16-baa2f89bf2e4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:35.849701 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-051f73e2-38f9-4b2a-9e16-baa2f89bf2e4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:35.850552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-051f73e2-38f9-4b2a-9e16-baa2f89bf2e4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:35.851118 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-051f73e2-38f9-4b2a-9e16-baa2f89bf2e4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:35.859113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-051f73e2-38f9-4b2a-9e16-baa2f89bf2e4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:36.182343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6b1af31a-245e-4f86-84e6-394b15d78039 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:36.193370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-051f73e2-38f9-4b2a-9e16-baa2f89bf2e4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:36.201002 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6b1af31a-245e-4f86-84e6-394b15d78039 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1716 microversion: 2.1 time: 0.620596 Aug 24 10:19:36.202045 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1043/1910] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:35 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1716 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:36.207211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0d44a818-c395-4351-8a6f-efca3053cffe tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:36.209895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0d44a818-c395-4351-8a6f-efca3053cffe tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 79f80505-bb77-41ee-9d20-794ccbf5c855] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:36.220704 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-051f73e2-38f9-4b2a-9e16-baa2f89bf2e4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:36.224579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d44a818-c395-4351-8a6f-efca3053cffe tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:36.225377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d44a818-c395-4351-8a6f-efca3053cffe tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:36.226091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d44a818-c395-4351-8a6f-efca3053cffe tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:36.228511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-051f73e2-38f9-4b2a-9e16-baa2f89bf2e4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:36.244627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d44a818-c395-4351-8a6f-efca3053cffe tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:36.246861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d44a818-c395-4351-8a6f-efca3053cffe tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:36.251444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d44a818-c395-4351-8a6f-efca3053cffe tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:36.285188 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-051f73e2-38f9-4b2a-9e16-baa2f89bf2e4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1446 microversion: 2.75 time: 0.459142 Aug 24 10:19:36.302655 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 868/1911] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:35 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1446 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:36.333981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6cffc60f-836f-4969-b091-ad27d8daee40 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:36.334744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6cffc60f-836f-4969-b091-ad27d8daee40 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] [instance: 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:36.353783 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cffc60f-836f-4969-b091-ad27d8daee40 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:36.355564 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cffc60f-836f-4969-b091-ad27d8daee40 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:36.356032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cffc60f-836f-4969-b091-ad27d8daee40 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:36.356772 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cffc60f-836f-4969-b091-ad27d8daee40 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:36.357252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cffc60f-836f-4969-b091-ad27d8daee40 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:36.357745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cffc60f-836f-4969-b091-ad27d8daee40 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:36.555941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0d44a818-c395-4351-8a6f-efca3053cffe tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:36.567930 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0d44a818-c395-4351-8a6f-efca3053cffe tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855" status: 200 len: 1274 microversion: 2.1 time: 0.364639 Aug 24 10:19:36.570727 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1044/1912] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:36 2022] GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855 => generated 1274 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:36.929787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9128658e-e948-44c2-9eb8-ce4775c12cbc tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f46545f29d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:37.040910 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9128658e-e948-44c2-9eb8-ce4775c12cbc tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/2ceceae6-4c27-49a4-adb2-e1e37ce140ac" status: 200 len: 662 microversion: 2.1 time: 0.116797 Aug 24 10:19:37.051776 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1045/1913] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:19:36 2022] GET /compute/v2.1/images/2ceceae6-4c27-49a4-adb2-e1e37ce140ac => generated 662 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:19:37.059349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-da7b310c-e8f0-4401-8d86-91e0174ac8cb tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f46545fce50>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:37.115373 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-da7b310c-e8f0-4401-8d86-91e0174ac8cb tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/2ceceae6-4c27-49a4-adb2-e1e37ce140ac" status: 200 len: 662 microversion: 2.1 time: 0.061865 Aug 24 10:19:37.116472 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1046/1914] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:19:37 2022] GET /compute/v2.1/images/2ceceae6-4c27-49a4-adb2-e1e37ce140ac => generated 662 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:37.223660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cbf555cf-9dff-4457-8243-5eaf5e1529f4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:37.224467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cbf555cf-9dff-4457-8243-5eaf5e1529f4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:37.235046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbf555cf-9dff-4457-8243-5eaf5e1529f4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:37.236083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbf555cf-9dff-4457-8243-5eaf5e1529f4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:37.236860 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbf555cf-9dff-4457-8243-5eaf5e1529f4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:37.238043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbf555cf-9dff-4457-8243-5eaf5e1529f4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:37.238746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbf555cf-9dff-4457-8243-5eaf5e1529f4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:37.239414 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbf555cf-9dff-4457-8243-5eaf5e1529f4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:37.518256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6cffc60f-836f-4969-b091-ad27d8daee40 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cfea45817848c5b0d3e20087d60d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1d41b854f94d67be99f5926a96376c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:37.535604 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6cffc60f-836f-4969-b091-ad27d8daee40 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4" status: 200 len: 1699 microversion: 2.1 time: 1.228499 Aug 24 10:19:37.537892 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 869/1915] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:36 2022] GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 => generated 1699 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:37.546260 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-8b9913d0-70e6-494b-ba8d-6a97eef4ee3b req-a1140ec6-db5a-43f1-ad19-e50ed8c175e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d844e7a-a6af-4c55-957c-a997c42927af", "tag": "c818b602-5bd6-46ee-96c2-c41b38b25689"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:37.594725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8b9913d0-70e6-494b-ba8d-6a97eef4ee3b req-a1140ec6-db5a-43f1-ad19-e50ed8c175e6 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:37.595757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8b9913d0-70e6-494b-ba8d-6a97eef4ee3b req-a1140ec6-db5a-43f1-ad19-e50ed8c175e6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:37.596708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8b9913d0-70e6-494b-ba8d-6a97eef4ee3b req-a1140ec6-db5a-43f1-ad19-e50ed8c175e6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:37.623133 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-8b9913d0-70e6-494b-ba8d-6a97eef4ee3b req-a1140ec6-db5a-43f1-ad19-e50ed8c175e6 service nova] Creating event network-changed:c818b602-5bd6-46ee-96c2-c41b38b25689 for instance 4d844e7a-a6af-4c55-957c-a997c42927af on n-h1-849328-3 Aug 24 10:19:37.632813 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-8b9913d0-70e6-494b-ba8d-6a97eef4ee3b req-a1140ec6-db5a-43f1-ad19-e50ed8c175e6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092313 Aug 24 10:19:37.634181 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 870/1916] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:37.646444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dc42071d-a666-450f-bed5-4ce6ce173be1 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:37.648645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dc42071d-a666-450f-bed5-4ce6ce173be1 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:37.661853 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc42071d-a666-450f-bed5-4ce6ce173be1 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:37.663301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc42071d-a666-450f-bed5-4ce6ce173be1 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:37.664564 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc42071d-a666-450f-bed5-4ce6ce173be1 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:37.678318 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc42071d-a666-450f-bed5-4ce6ce173be1 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:37.679735 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc42071d-a666-450f-bed5-4ce6ce173be1 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:37.681622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc42071d-a666-450f-bed5-4ce6ce173be1 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:37.876129 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cbf555cf-9dff-4457-8243-5eaf5e1529f4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:37.896628 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cbf555cf-9dff-4457-8243-5eaf5e1529f4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1716 microversion: 2.1 time: 0.676861 Aug 24 10:19:37.913166 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1047/1917] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:37 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1716 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:37.913614 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-63368c50-a9a7-4b8b-92ad-3ac1605edb69 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:37.917406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-63368c50-a9a7-4b8b-92ad-3ac1605edb69 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 79f80505-bb77-41ee-9d20-794ccbf5c855] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:37.934740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63368c50-a9a7-4b8b-92ad-3ac1605edb69 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:37.935608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63368c50-a9a7-4b8b-92ad-3ac1605edb69 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:37.935723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63368c50-a9a7-4b8b-92ad-3ac1605edb69 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:37.936557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63368c50-a9a7-4b8b-92ad-3ac1605edb69 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:37.937912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63368c50-a9a7-4b8b-92ad-3ac1605edb69 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:37.938581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63368c50-a9a7-4b8b-92ad-3ac1605edb69 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:38.043252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dc42071d-a666-450f-bed5-4ce6ce173be1 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:38.064641 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-63368c50-a9a7-4b8b-92ad-3ac1605edb69 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:38.072930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dc42071d-a666-450f-bed5-4ce6ce173be1 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:38.082476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dc42071d-a666-450f-bed5-4ce6ce173be1 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:38.083889 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-63368c50-a9a7-4b8b-92ad-3ac1605edb69 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855" status: 200 len: 1280 microversion: 2.1 time: 0.181035 Aug 24 10:19:38.084734 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1048/1918] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:37 2022] GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855 => generated 1280 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:38.106676 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dc42071d-a666-450f-bed5-4ce6ce173be1 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1446 microversion: 2.75 time: 0.467566 Aug 24 10:19:38.109186 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 871/1919] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:37 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1446 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:38.583657 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-30355167-80a3-45a8-ab9e-abcc99c6649a tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:38.584353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-30355167-80a3-45a8-ab9e-abcc99c6649a tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] [instance: 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:38.614138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30355167-80a3-45a8-ab9e-abcc99c6649a tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:38.616623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30355167-80a3-45a8-ab9e-abcc99c6649a tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:38.617400 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30355167-80a3-45a8-ab9e-abcc99c6649a tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:38.619681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30355167-80a3-45a8-ab9e-abcc99c6649a tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:38.623093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30355167-80a3-45a8-ab9e-abcc99c6649a tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:38.624132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30355167-80a3-45a8-ab9e-abcc99c6649a tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:38.726408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aed84f66-33b6-437a-b9c6-7cbd828834eb tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f465a2ced30>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:38.835057 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aed84f66-33b6-437a-b9c6-7cbd828834eb tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/bfcee4fd-af5d-4321-b5c3-ef893f5e16cd" status: 200 len: 662 microversion: 2.1 time: 0.112389 Aug 24 10:19:38.836684 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 872/1920] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:19:38 2022] GET /compute/v2.1/images/bfcee4fd-af5d-4321-b5c3-ef893f5e16cd => generated 662 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:38.853250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f50510da-b982-4972-af20-8baf898ad326 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f465a2d1280>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:38.940947 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f50510da-b982-4972-af20-8baf898ad326 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/bfcee4fd-af5d-4321-b5c3-ef893f5e16cd" status: 200 len: 662 microversion: 2.1 time: 0.088896 Aug 24 10:19:38.941810 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 873/1921] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:19:38 2022] GET /compute/v2.1/images/bfcee4fd-af5d-4321-b5c3-ef893f5e16cd => generated 662 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:19:38.962292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0941f7ab-b6ba-45a4-9bf6-03cc796ca414 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:38.966100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-30355167-80a3-45a8-ab9e-abcc99c6649a tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cfea45817848c5b0d3e20087d60d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1d41b854f94d67be99f5926a96376c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:38.969720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0941f7ab-b6ba-45a4-9bf6-03cc796ca414 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:38.992272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0941f7ab-b6ba-45a4-9bf6-03cc796ca414 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:38.993237 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0941f7ab-b6ba-45a4-9bf6-03cc796ca414 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:38.995164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0941f7ab-b6ba-45a4-9bf6-03cc796ca414 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:39.000101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0941f7ab-b6ba-45a4-9bf6-03cc796ca414 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:39.004749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0941f7ab-b6ba-45a4-9bf6-03cc796ca414 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:39.006746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0941f7ab-b6ba-45a4-9bf6-03cc796ca414 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:39.020772 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-30355167-80a3-45a8-ab9e-abcc99c6649a tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4" status: 200 len: 1631 microversion: 2.1 time: 0.442333 Aug 24 10:19:39.021698 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1049/1922] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:38 2022] GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 => generated 1631 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:39.121849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ea7ef004-d754-4dfb-84c8-04c7a49c0059 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:39.123434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ea7ef004-d754-4dfb-84c8-04c7a49c0059 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 79f80505-bb77-41ee-9d20-794ccbf5c855] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:39.145961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea7ef004-d754-4dfb-84c8-04c7a49c0059 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:39.147650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea7ef004-d754-4dfb-84c8-04c7a49c0059 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:39.148304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea7ef004-d754-4dfb-84c8-04c7a49c0059 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:39.149070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea7ef004-d754-4dfb-84c8-04c7a49c0059 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:39.149558 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea7ef004-d754-4dfb-84c8-04c7a49c0059 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:39.150028 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea7ef004-d754-4dfb-84c8-04c7a49c0059 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:39.797892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ea7ef004-d754-4dfb-84c8-04c7a49c0059 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:39.827550 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ea7ef004-d754-4dfb-84c8-04c7a49c0059 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855" status: 200 len: 1322 microversion: 2.1 time: 0.714527 Aug 24 10:19:39.844118 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1050/1923] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:39 2022] GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855 => generated 1322 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:39.865613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-261550db-e7df-4a08-9c2e-8560b443a97a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:39.867397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-261550db-e7df-4a08-9c2e-8560b443a97a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:39.884264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-261550db-e7df-4a08-9c2e-8560b443a97a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:39.884770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-261550db-e7df-4a08-9c2e-8560b443a97a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:39.885275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-261550db-e7df-4a08-9c2e-8560b443a97a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:39.886070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-261550db-e7df-4a08-9c2e-8560b443a97a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:39.886802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-261550db-e7df-4a08-9c2e-8560b443a97a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:39.887450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-261550db-e7df-4a08-9c2e-8560b443a97a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:40.141016 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-261550db-e7df-4a08-9c2e-8560b443a97a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:40.177715 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-261550db-e7df-4a08-9c2e-8560b443a97a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:40.180684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-261550db-e7df-4a08-9c2e-8560b443a97a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:40.197794 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-261550db-e7df-4a08-9c2e-8560b443a97a tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1446 microversion: 2.75 time: 0.348721 Aug 24 10:19:40.221753 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1051/1924] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:39 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1446 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:40.228102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c8d9c9d2-93c2-4bbc-93a5-ab077b2579a0 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:40.229153 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c8d9c9d2-93c2-4bbc-93a5-ab077b2579a0 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] [instance: 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:40.243397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8d9c9d2-93c2-4bbc-93a5-ab077b2579a0 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:40.244260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8d9c9d2-93c2-4bbc-93a5-ab077b2579a0 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:40.246663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8d9c9d2-93c2-4bbc-93a5-ab077b2579a0 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:40.247813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8d9c9d2-93c2-4bbc-93a5-ab077b2579a0 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:40.249847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8d9c9d2-93c2-4bbc-93a5-ab077b2579a0 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:40.251057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8d9c9d2-93c2-4bbc-93a5-ab077b2579a0 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:40.284369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0941f7ab-b6ba-45a4-9bf6-03cc796ca414 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:40.310309 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0941f7ab-b6ba-45a4-9bf6-03cc796ca414 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1716 microversion: 2.1 time: 1.366795 Aug 24 10:19:40.311938 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 874/1925] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:38 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1716 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:40.317344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-73f8d23f-00dd-487a-8730-356870a15411 req-20b54ec1-32f1-403d-a98c-1dec8789cc00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4", "name": "network-vif-deleted", "tag": "3aaa78a6-64c1-4bea-b5d7-4d0cab5d8596"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:40.353169 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-73f8d23f-00dd-487a-8730-356870a15411 req-20b54ec1-32f1-403d-a98c-1dec8789cc00 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:40.354042 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-73f8d23f-00dd-487a-8730-356870a15411 req-20b54ec1-32f1-403d-a98c-1dec8789cc00 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:40.354560 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-73f8d23f-00dd-487a-8730-356870a15411 req-20b54ec1-32f1-403d-a98c-1dec8789cc00 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:40.396121 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-73f8d23f-00dd-487a-8730-356870a15411 req-20b54ec1-32f1-403d-a98c-1dec8789cc00 service nova] Creating event network-vif-deleted:3aaa78a6-64c1-4bea-b5d7-4d0cab5d8596 for instance 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 on n-h1-849328-3 Aug 24 10:19:40.408860 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-73f8d23f-00dd-487a-8730-356870a15411 req-20b54ec1-32f1-403d-a98c-1dec8789cc00 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095268 Aug 24 10:19:40.422254 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 875/1926] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:40.553833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c8d9c9d2-93c2-4bbc-93a5-ab077b2579a0 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cfea45817848c5b0d3e20087d60d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1d41b854f94d67be99f5926a96376c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:40.590887 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c8d9c9d2-93c2-4bbc-93a5-ab077b2579a0 tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4" status: 200 len: 1631 microversion: 2.1 time: 0.366556 Aug 24 10:19:40.593948 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1052/1927] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:40 2022] GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 => generated 1631 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:40.872103 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8f73565f-8904-454f-8f48-3da9d030a2f8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:40.873172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8f73565f-8904-454f-8f48-3da9d030a2f8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 79f80505-bb77-41ee-9d20-794ccbf5c855] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:40.897432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f73565f-8904-454f-8f48-3da9d030a2f8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:40.900673 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f73565f-8904-454f-8f48-3da9d030a2f8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:40.904740 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f73565f-8904-454f-8f48-3da9d030a2f8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:40.922044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f73565f-8904-454f-8f48-3da9d030a2f8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:40.922986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f73565f-8904-454f-8f48-3da9d030a2f8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:40.923871 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f73565f-8904-454f-8f48-3da9d030a2f8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:41.229765 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-798a87c5-2882-41d5-bc12-b96ab2d6fdb7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:41.232009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-798a87c5-2882-41d5-bc12-b96ab2d6fdb7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:41.269864 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-798a87c5-2882-41d5-bc12-b96ab2d6fdb7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:41.273358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-798a87c5-2882-41d5-bc12-b96ab2d6fdb7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:41.274221 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-798a87c5-2882-41d5-bc12-b96ab2d6fdb7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:41.283684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-798a87c5-2882-41d5-bc12-b96ab2d6fdb7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:41.284210 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-798a87c5-2882-41d5-bc12-b96ab2d6fdb7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:41.286360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-798a87c5-2882-41d5-bc12-b96ab2d6fdb7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:41.534351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-798a87c5-2882-41d5-bc12-b96ab2d6fdb7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:41.535398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8f73565f-8904-454f-8f48-3da9d030a2f8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:41.557112 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8f73565f-8904-454f-8f48-3da9d030a2f8 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855" status: 200 len: 1322 microversion: 2.1 time: 0.689603 Aug 24 10:19:41.557827 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 876/1928] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:40 2022] GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855 => generated 1322 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:41.567210 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-798a87c5-2882-41d5-bc12-b96ab2d6fdb7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:41.578201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-798a87c5-2882-41d5-bc12-b96ab2d6fdb7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:41.595464 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-798a87c5-2882-41d5-bc12-b96ab2d6fdb7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1446 microversion: 2.75 time: 0.369383 Aug 24 10:19:41.596841 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1053/1929] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:41 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1446 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:19:41.607117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-221ed72f-c6d5-4368-a89e-1602ae89a1c0 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:41.614801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cfae6cd8-c57f-4ad3-99d1-e3ac86deaa4b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4654716700>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:41.618857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-221ed72f-c6d5-4368-a89e-1602ae89a1c0 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:41.656828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-221ed72f-c6d5-4368-a89e-1602ae89a1c0 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:41.661797 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-221ed72f-c6d5-4368-a89e-1602ae89a1c0 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:41.667860 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-221ed72f-c6d5-4368-a89e-1602ae89a1c0 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:41.669220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-221ed72f-c6d5-4368-a89e-1602ae89a1c0 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:41.671511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-221ed72f-c6d5-4368-a89e-1602ae89a1c0 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:41.674818 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-221ed72f-c6d5-4368-a89e-1602ae89a1c0 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:41.736831 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cfae6cd8-c57f-4ad3-99d1-e3ac86deaa4b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/a9ca6340-fb49-481f-bc39-746c12e680ff" status: 200 len: 661 microversion: 2.1 time: 0.138347 Aug 24 10:19:41.740063 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1054/1930] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:19:41 2022] GET /compute/v2.1/images/a9ca6340-fb49-481f-bc39-746c12e680ff => generated 661 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:41.760665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-929d5d8f-f8c8-4b16-a969-dd21f4f37d9c tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:41.765014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-929d5d8f-f8c8-4b16-a969-dd21f4f37d9c tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] [instance: 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:41.778563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-929d5d8f-f8c8-4b16-a969-dd21f4f37d9c tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:41.779077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-929d5d8f-f8c8-4b16-a969-dd21f4f37d9c tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:41.779582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-929d5d8f-f8c8-4b16-a969-dd21f4f37d9c tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:41.787674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-929d5d8f-f8c8-4b16-a969-dd21f4f37d9c tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:41.788336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-929d5d8f-f8c8-4b16-a969-dd21f4f37d9c tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:41.788952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-929d5d8f-f8c8-4b16-a969-dd21f4f37d9c tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:41.849105 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-929d5d8f-f8c8-4b16-a969-dd21f4f37d9c tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] HTTP exception thrown: Instance 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 could not be found. Aug 24 10:19:41.854809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-929d5d8f-f8c8-4b16-a969-dd21f4f37d9c tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Request method failure captured: Aug 24 10:19:41.854809 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 HTTP/1.1 Aug 24 10:19:41.854809 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:19:41.854809 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:19:41.854809 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:19:41.854809 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:19:41.854809 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:19:41.854809 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:19:41.854809 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:19:41.854809 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:19:41.854809 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfryqCLuzbX2B5_sTpc4Gx2JYvrNfqKjTKizLClvlXE2RXH7wlPpHCEPSJekE_NDRfZVGI9wrVAAWPGlMLqBe8P6O8BpvQvePeUdPwS1OPSsOWKF0PAbuSUR9woOZIYvf9ejWaytVT6lOjh7d2Gq5G-TADRw2eoIOqJyfBlpFUPQIwg Aug 24 10:19:41.854809 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:19:41.854809 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:19:41.854809 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:19:41.854809 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:19:41.854809 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:19:41.854809 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:19:41.854809 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 1c1d41b854f94d67be99f5926a96376c Aug 24 10:19:41.854809 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersTestJSON-1272480242 Aug 24 10:19:41.854809 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:19:41.854809 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:19:41.856814 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1c1d41b854f94d67be99f5926a96376c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_1c1d41b854f94d67be99f5926a96376c", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1c1d41b854f94d67be99f5926a96376c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/1c1d41b854f94d67be99f5926a96376c"}]}] Aug 24 10:19:41.856814 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersTestJSON-1272480242 Aug 24 10:19:41.856814 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 1c1d41b854f94d67be99f5926a96376c Aug 24 10:19:41.856814 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersTestJSON-1272480242 Aug 24 10:19:41.856814 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersTestJSON-1272480242-project Aug 24 10:19:41.856814 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:19:41.856814 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:19:41.856814 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 72cfea45817848c5b0d3e20087d60d4b Aug 24 10:19:41.856814 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersTestJSON-1272480242-project Aug 24 10:19:41.856814 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:19:41.856814 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 could not be found. Aug 24 10:19:41.856814 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4'} Aug 24 10:19:41.858066 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:19:41.858066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:41.858066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:19:41.858066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:19:41.858066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:19:41.858066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:19:41.858066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:19:41.858066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:19:41.858066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:19:41.858066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:19:41.858066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 could not be found. Aug 24 10:19:41.858066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:41.858066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:41.858066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:41.858066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:41.858066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:41.858066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:41.858066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:19:41.858066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:19:41.858066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:19:41.860140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:19:41.860140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:19:41.860140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:19:41.860140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:19:41.860140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:19:41.860140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:19:41.860140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:19:41.860140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 could not be found. Aug 24 10:19:41.860140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:41.860140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:41.860140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:41.860140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:41.860140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:41.860140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:41.860140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:19:41.860140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:19:41.860140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 could not be found. Aug 24 10:19:41.860140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:19:41.863518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-929d5d8f-f8c8-4b16-a969-dd21f4f37d9c tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Returning 404 to user: Instance 7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:19:41.863518 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-929d5d8f-f8c8-4b16-a969-dd21f4f37d9c tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4" status: 404 len: 111 microversion: 2.1 time: 0.118473 Aug 24 10:19:41.867534 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1055/1931] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:41 2022] GET /compute/v2.1/servers/7dce86e6-781e-4936-b7d0-c1e4f6d7f4c4 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:19:41.875123 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e4b4d4e7-3825-41e5-9b96-beb2fb516297 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f465a1d6700>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:41.944300 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e4b4d4e7-3825-41e5-9b96-beb2fb516297 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/a9ca6340-fb49-481f-bc39-746c12e680ff" status: 200 len: 661 microversion: 2.1 time: 0.074344 Aug 24 10:19:41.946754 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1056/1932] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:19:41 2022] GET /compute/v2.1/images/a9ca6340-fb49-481f-bc39-746c12e680ff => generated 661 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:41.956351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-420b9b8f-8f34-4b89-bd80-cba1228f2f5c tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] Calling method '.version_select at 0x7f46545f2310>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:41.998132 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-420b9b8f-8f34-4b89-bd80-cba1228f2f5c tempest-ServersTestJSON-1272480242 tempest-ServersTestJSON-1272480242-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-731354037" status: 202 len: 0 microversion: 2.1 time: 0.049627 Aug 24 10:19:41.999110 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1057/1933] 10.222.0.85 () {58 vars in 1218 bytes} [Wed Aug 24 10:19:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-731354037 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:19:42.167881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d730c439-79b7-4261-8931-54b48486438e tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2024871004", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:42.248264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-d730c439-79b7-4261-8931-54b48486438e tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:19:42.389323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-221ed72f-c6d5-4368-a89e-1602ae89a1c0 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:42.396151 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=10 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:42.412061 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-221ed72f-c6d5-4368-a89e-1602ae89a1c0 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1716 microversion: 2.1 time: 0.847599 Aug 24 10:19:42.413244 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 877/1934] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:41 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1716 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:42.465242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e2cfaa0c-3361-4f26-9001-12f48eaa8265 req-276e6eeb-e140-4394-af52-0d1bf770cd85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79f80505-bb77-41ee-9d20-794ccbf5c855", "tag": "db59d150-d0f6-4bb5-89f3-bcbc294baa82"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:42.487599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e2cfaa0c-3361-4f26-9001-12f48eaa8265 req-276e6eeb-e140-4394-af52-0d1bf770cd85 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:42.488529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e2cfaa0c-3361-4f26-9001-12f48eaa8265 req-276e6eeb-e140-4394-af52-0d1bf770cd85 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:42.489866 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e2cfaa0c-3361-4f26-9001-12f48eaa8265 req-276e6eeb-e140-4394-af52-0d1bf770cd85 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:42.540624 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e2cfaa0c-3361-4f26-9001-12f48eaa8265 req-276e6eeb-e140-4394-af52-0d1bf770cd85 service nova] Creating event network-changed:db59d150-d0f6-4bb5-89f3-bcbc294baa82 for instance 79f80505-bb77-41ee-9d20-794ccbf5c855 on n-h1-849328-3 Aug 24 10:19:42.555779 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e2cfaa0c-3361-4f26-9001-12f48eaa8265 req-276e6eeb-e140-4394-af52-0d1bf770cd85 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098682 Aug 24 10:19:42.557165 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 878/1935] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:42.598759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0c60117c-1c2a-4d21-b0d0-06e5edace71a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:42.600833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0c60117c-1c2a-4d21-b0d0-06e5edace71a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 79f80505-bb77-41ee-9d20-794ccbf5c855] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:42.615176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c60117c-1c2a-4d21-b0d0-06e5edace71a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:42.616713 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c60117c-1c2a-4d21-b0d0-06e5edace71a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:42.621763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c60117c-1c2a-4d21-b0d0-06e5edace71a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:42.622874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c60117c-1c2a-4d21-b0d0-06e5edace71a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:42.623589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c60117c-1c2a-4d21-b0d0-06e5edace71a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:42.624760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c60117c-1c2a-4d21-b0d0-06e5edace71a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:42.953723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d730c439-79b7-4261-8931-54b48486438e tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:19:42.954422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d730c439-79b7-4261-8931-54b48486438e tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:19:42.955240 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d730c439-79b7-4261-8931-54b48486438e tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:19:42.956136 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d730c439-79b7-4261-8931-54b48486438e tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:19:42.956872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d730c439-79b7-4261-8931-54b48486438e tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:19:42.988975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d730c439-79b7-4261-8931-54b48486438e tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:42.989842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d730c439-79b7-4261-8931-54b48486438e tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:42.990670 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d730c439-79b7-4261-8931-54b48486438e tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:42.991881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d730c439-79b7-4261-8931-54b48486438e tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:42.992655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d730c439-79b7-4261-8931-54b48486438e tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:42.993402 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d730c439-79b7-4261-8931-54b48486438e tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:43.074956 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-d730c439-79b7-4261-8931-54b48486438e tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Getting quotas for project 6b951c1be813434898ac93429f2064d6. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:19:43.097743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-d730c439-79b7-4261-8931-54b48486438e tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Getting quotas for user cba7af3841d9463ca5abc1a7de6f722a and project 6b951c1be813434898ac93429f2064d6. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:19:43.144428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0c60117c-1c2a-4d21-b0d0-06e5edace71a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:43.161707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d730c439-79b7-4261-8931-54b48486438e tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:19:43.172787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d730c439-79b7-4261-8931-54b48486438e tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:19:43.189945 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0c60117c-1c2a-4d21-b0d0-06e5edace71a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855" status: 200 len: 1322 microversion: 2.1 time: 0.601782 Aug 24 10:19:43.211748 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 879/1936] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:42 2022] GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855 => generated 1322 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:43.245630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3b0a3ef4-dfaa-44d4-82a3-492e7a8428e7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:43.247290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3b0a3ef4-dfaa-44d4-82a3-492e7a8428e7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:43.266970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b0a3ef4-dfaa-44d4-82a3-492e7a8428e7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:43.268182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b0a3ef4-dfaa-44d4-82a3-492e7a8428e7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:43.269386 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b0a3ef4-dfaa-44d4-82a3-492e7a8428e7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:43.286819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b0a3ef4-dfaa-44d4-82a3-492e7a8428e7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:43.288100 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b0a3ef4-dfaa-44d4-82a3-492e7a8428e7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:43.289079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b0a3ef4-dfaa-44d4-82a3-492e7a8428e7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:43.400585 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d730c439-79b7-4261-8931-54b48486438e tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.242698 Aug 24 10:19:43.404311 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1058/1937] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:19:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1248 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:19:43.455388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-77eeb151-2e66-4aff-828b-73249323d963 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:43.456469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-77eeb151-2e66-4aff-828b-73249323d963 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:43.468074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77eeb151-2e66-4aff-828b-73249323d963 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:43.469711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77eeb151-2e66-4aff-828b-73249323d963 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:43.471180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77eeb151-2e66-4aff-828b-73249323d963 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:43.473047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77eeb151-2e66-4aff-828b-73249323d963 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:43.474219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77eeb151-2e66-4aff-828b-73249323d963 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:43.475495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77eeb151-2e66-4aff-828b-73249323d963 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:44.310235 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3b0a3ef4-dfaa-44d4-82a3-492e7a8428e7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:44.328834 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3b0a3ef4-dfaa-44d4-82a3-492e7a8428e7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:44.337844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3b0a3ef4-dfaa-44d4-82a3-492e7a8428e7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:44.351972 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3b0a3ef4-dfaa-44d4-82a3-492e7a8428e7 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1446 microversion: 2.75 time: 1.128566 Aug 24 10:19:44.352960 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 880/1938] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:43 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1446 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:44.381200 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e670ca03-b95d-400b-a972-9c6c7803ebba tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-975712337", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:44.521729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-e670ca03-b95d-400b-a972-9c6c7803ebba tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:19:44.711770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-77eeb151-2e66-4aff-828b-73249323d963 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:44.722660 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-77eeb151-2e66-4aff-828b-73249323d963 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1716 microversion: 2.1 time: 1.277249 Aug 24 10:19:44.726537 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1059/1939] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:43 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1716 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:44.733813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bd1a4aea-cfde-49ee-9466-52cb24a87a3a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:44.739596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bd1a4aea-cfde-49ee-9466-52cb24a87a3a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 79f80505-bb77-41ee-9d20-794ccbf5c855] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:44.754966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd1a4aea-cfde-49ee-9466-52cb24a87a3a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:44.755776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd1a4aea-cfde-49ee-9466-52cb24a87a3a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:44.756508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd1a4aea-cfde-49ee-9466-52cb24a87a3a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:44.757698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd1a4aea-cfde-49ee-9466-52cb24a87a3a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:44.780403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd1a4aea-cfde-49ee-9466-52cb24a87a3a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:44.782694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd1a4aea-cfde-49ee-9466-52cb24a87a3a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:44.816152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:44.910842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:45.215324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e670ca03-b95d-400b-a972-9c6c7803ebba tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:19:45.216060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e670ca03-b95d-400b-a972-9c6c7803ebba tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:19:45.216730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e670ca03-b95d-400b-a972-9c6c7803ebba tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:19:45.217403 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e670ca03-b95d-400b-a972-9c6c7803ebba tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:19:45.217989 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e670ca03-b95d-400b-a972-9c6c7803ebba tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:19:45.235428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e670ca03-b95d-400b-a972-9c6c7803ebba tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:45.241375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e670ca03-b95d-400b-a972-9c6c7803ebba tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:45.242975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e670ca03-b95d-400b-a972-9c6c7803ebba tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:45.244040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e670ca03-b95d-400b-a972-9c6c7803ebba tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:45.244795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e670ca03-b95d-400b-a972-9c6c7803ebba tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:45.245554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e670ca03-b95d-400b-a972-9c6c7803ebba tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:45.273979 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:45.323335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-e670ca03-b95d-400b-a972-9c6c7803ebba tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Getting quotas for project 6b951c1be813434898ac93429f2064d6. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:19:45.339133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-e670ca03-b95d-400b-a972-9c6c7803ebba tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Getting quotas for user cba7af3841d9463ca5abc1a7de6f722a and project 6b951c1be813434898ac93429f2064d6. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:19:45.391642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e670ca03-b95d-400b-a972-9c6c7803ebba tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:19:45.395828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e670ca03-b95d-400b-a972-9c6c7803ebba tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: 8a4ddf34-af18-4e02-a306-c1c67f5c0b28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:19:45.486100 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:45.562368 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e670ca03-b95d-400b-a972-9c6c7803ebba tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.194461 Aug 24 10:19:45.571494 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 881/1940] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:19:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:19:45.608280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-112d0bc8-8cdf-47fb-b106-e8423f8a16fe tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:45.631038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-112d0bc8-8cdf-47fb-b106-e8423f8a16fe tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:45.660685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-112d0bc8-8cdf-47fb-b106-e8423f8a16fe tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:45.670525 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-112d0bc8-8cdf-47fb-b106-e8423f8a16fe tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:45.671177 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-112d0bc8-8cdf-47fb-b106-e8423f8a16fe tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:45.672152 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-112d0bc8-8cdf-47fb-b106-e8423f8a16fe tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:45.673775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-112d0bc8-8cdf-47fb-b106-e8423f8a16fe tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:45.674387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-112d0bc8-8cdf-47fb-b106-e8423f8a16fe tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:45.821408 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bd1a4aea-cfde-49ee-9466-52cb24a87a3a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:45.883757 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bd1a4aea-cfde-49ee-9466-52cb24a87a3a tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855" status: 200 len: 1322 microversion: 2.1 time: 1.153108 Aug 24 10:19:45.897166 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1060/1941] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:44 2022] GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855 => generated 1322 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:45.910788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-097f5cf4-8bb3-4566-ab5a-9e56b4e6adec tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:45.917316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-097f5cf4-8bb3-4566-ab5a-9e56b4e6adec tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: 8a4ddf34-af18-4e02-a306-c1c67f5c0b28] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:46.025997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-112d0bc8-8cdf-47fb-b106-e8423f8a16fe tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:46.054912 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-112d0bc8-8cdf-47fb-b106-e8423f8a16fe tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:46.058116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-112d0bc8-8cdf-47fb-b106-e8423f8a16fe tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:46.077499 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-112d0bc8-8cdf-47fb-b106-e8423f8a16fe tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1446 microversion: 2.75 time: 0.479793 Aug 24 10:19:46.083386 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 882/1942] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:45 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1446 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:46.101299 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-22f11186-f981-4c85-b0ad-aad0b3575b6f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:46.102335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-22f11186-f981-4c85-b0ad-aad0b3575b6f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:46.111144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22f11186-f981-4c85-b0ad-aad0b3575b6f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:46.111932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22f11186-f981-4c85-b0ad-aad0b3575b6f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:46.113757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22f11186-f981-4c85-b0ad-aad0b3575b6f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:46.118193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22f11186-f981-4c85-b0ad-aad0b3575b6f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:46.122415 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22f11186-f981-4c85-b0ad-aad0b3575b6f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:46.122982 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22f11186-f981-4c85-b0ad-aad0b3575b6f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:46.147644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-097f5cf4-8bb3-4566-ab5a-9e56b4e6adec tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:46.171206 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-097f5cf4-8bb3-4566-ab5a-9e56b4e6adec tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28" status: 200 len: 1217 microversion: 2.1 time: 0.278398 Aug 24 10:19:46.181299 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1061/1943] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:45 2022] GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28 => generated 1217 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:46.812776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-22f11186-f981-4c85-b0ad-aad0b3575b6f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:46.846239 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-22f11186-f981-4c85-b0ad-aad0b3575b6f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1716 microversion: 2.1 time: 0.752338 Aug 24 10:19:46.849968 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 883/1944] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:46 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1716 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:46.923368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e915a8f9-ef5d-4fb7-bdf8-f991d7ed0ff4 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:46.924004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e915a8f9-ef5d-4fb7-bdf8-f991d7ed0ff4 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 79f80505-bb77-41ee-9d20-794ccbf5c855] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:46.949853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e915a8f9-ef5d-4fb7-bdf8-f991d7ed0ff4 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:46.957551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e915a8f9-ef5d-4fb7-bdf8-f991d7ed0ff4 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:46.958780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e915a8f9-ef5d-4fb7-bdf8-f991d7ed0ff4 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:46.964141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e915a8f9-ef5d-4fb7-bdf8-f991d7ed0ff4 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:46.967987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e915a8f9-ef5d-4fb7-bdf8-f991d7ed0ff4 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:46.969062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e915a8f9-ef5d-4fb7-bdf8-f991d7ed0ff4 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:47.396017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3661a7bd-c7c1-4897-b6eb-1d0a3d42d723 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-928224941", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:47.503582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e915a8f9-ef5d-4fb7-bdf8-f991d7ed0ff4 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:47.521393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-3661a7bd-c7c1-4897-b6eb-1d0a3d42d723 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:19:47.535810 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e915a8f9-ef5d-4fb7-bdf8-f991d7ed0ff4 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855" status: 200 len: 1322 microversion: 2.1 time: 0.617504 Aug 24 10:19:47.550457 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1062/1945] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:46 2022] GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855 => generated 1322 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:47.565397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ea86c9d6-3e30-4f3a-a012-6ed52109a633 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:47.571466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ea86c9d6-3e30-4f3a-a012-6ed52109a633 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:47.593005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea86c9d6-3e30-4f3a-a012-6ed52109a633 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:47.594075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea86c9d6-3e30-4f3a-a012-6ed52109a633 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:47.594916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea86c9d6-3e30-4f3a-a012-6ed52109a633 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:47.595865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea86c9d6-3e30-4f3a-a012-6ed52109a633 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:47.596497 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea86c9d6-3e30-4f3a-a012-6ed52109a633 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:47.597145 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea86c9d6-3e30-4f3a-a012-6ed52109a633 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:48.223489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3661a7bd-c7c1-4897-b6eb-1d0a3d42d723 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:19:48.224376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3661a7bd-c7c1-4897-b6eb-1d0a3d42d723 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:19:48.224924 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3661a7bd-c7c1-4897-b6eb-1d0a3d42d723 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:19:48.225437 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3661a7bd-c7c1-4897-b6eb-1d0a3d42d723 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:19:48.225941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3661a7bd-c7c1-4897-b6eb-1d0a3d42d723 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:19:48.248586 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3661a7bd-c7c1-4897-b6eb-1d0a3d42d723 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:48.249493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3661a7bd-c7c1-4897-b6eb-1d0a3d42d723 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:48.250760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3661a7bd-c7c1-4897-b6eb-1d0a3d42d723 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:48.251942 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3661a7bd-c7c1-4897-b6eb-1d0a3d42d723 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:48.252607 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3661a7bd-c7c1-4897-b6eb-1d0a3d42d723 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:48.253969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3661a7bd-c7c1-4897-b6eb-1d0a3d42d723 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:48.285584 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-3661a7bd-c7c1-4897-b6eb-1d0a3d42d723 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Getting quotas for project e5b71b3aec6d45c3964585a8b11f2e81. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:19:48.315999 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-3661a7bd-c7c1-4897-b6eb-1d0a3d42d723 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Getting quotas for user 14047bac72234dc7b0384a99fbdabb67 and project e5b71b3aec6d45c3964585a8b11f2e81. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:19:48.347057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ea86c9d6-3e30-4f3a-a012-6ed52109a633 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:48.358897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ea86c9d6-3e30-4f3a-a012-6ed52109a633 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:48.362377 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3661a7bd-c7c1-4897-b6eb-1d0a3d42d723 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:19:48.363753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ea86c9d6-3e30-4f3a-a012-6ed52109a633 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:48.379220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3661a7bd-c7c1-4897-b6eb-1d0a3d42d723 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:19:48.386774 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ea86c9d6-3e30-4f3a-a012-6ed52109a633 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1446 microversion: 2.75 time: 0.834319 Aug 24 10:19:48.390015 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1063/1946] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:47 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1446 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:48.396890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4a0504e2-baef-43c6-9cc4-6799cb49be18 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:48.406449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4a0504e2-baef-43c6-9cc4-6799cb49be18 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: 8a4ddf34-af18-4e02-a306-c1c67f5c0b28] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:48.418701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a0504e2-baef-43c6-9cc4-6799cb49be18 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:48.421762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a0504e2-baef-43c6-9cc4-6799cb49be18 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:48.422503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a0504e2-baef-43c6-9cc4-6799cb49be18 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:48.423622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a0504e2-baef-43c6-9cc4-6799cb49be18 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:48.429926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a0504e2-baef-43c6-9cc4-6799cb49be18 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:48.430902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a0504e2-baef-43c6-9cc4-6799cb49be18 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:48.554086 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3661a7bd-c7c1-4897-b6eb-1d0a3d42d723 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.490946 Aug 24 10:19:48.554537 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 884/1947] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:19:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:19:48.587749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cbb3d12d-574f-4c42-8005-8a7343161847 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:48.636098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cbb3d12d-574f-4c42-8005-8a7343161847 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:48.682662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbb3d12d-574f-4c42-8005-8a7343161847 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:48.685049 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbb3d12d-574f-4c42-8005-8a7343161847 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:48.688798 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbb3d12d-574f-4c42-8005-8a7343161847 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:48.692529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbb3d12d-574f-4c42-8005-8a7343161847 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:48.694649 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbb3d12d-574f-4c42-8005-8a7343161847 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:48.701879 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbb3d12d-574f-4c42-8005-8a7343161847 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:48.778437 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4a0504e2-baef-43c6-9cc4-6799cb49be18 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:48.804528 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4a0504e2-baef-43c6-9cc4-6799cb49be18 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28" status: 200 len: 1287 microversion: 2.1 time: 0.401088 Aug 24 10:19:48.806975 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1064/1948] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:48 2022] GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28 => generated 1287 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:48.823552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-87c18311-0940-4f07-9b6f-5386cb3097e7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:48.833290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-87c18311-0940-4f07-9b6f-5386cb3097e7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 79f80505-bb77-41ee-9d20-794ccbf5c855] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:48.840655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87c18311-0940-4f07-9b6f-5386cb3097e7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:48.840655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87c18311-0940-4f07-9b6f-5386cb3097e7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:48.841192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87c18311-0940-4f07-9b6f-5386cb3097e7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:48.841926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87c18311-0940-4f07-9b6f-5386cb3097e7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:48.842500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87c18311-0940-4f07-9b6f-5386cb3097e7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:48.843010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87c18311-0940-4f07-9b6f-5386cb3097e7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:49.384051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-87c18311-0940-4f07-9b6f-5386cb3097e7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:49.407821 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-87c18311-0940-4f07-9b6f-5386cb3097e7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855" status: 200 len: 1322 microversion: 2.1 time: 0.596037 Aug 24 10:19:49.408577 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1065/1949] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:48 2022] GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855 => generated 1322 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:49.425374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-559b5bd2-9ca9-4322-b0f7-40c8e0e85c27 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:49.426006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-559b5bd2-9ca9-4322-b0f7-40c8e0e85c27 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:49.614739 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-559b5bd2-9ca9-4322-b0f7-40c8e0e85c27 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:49.631345 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-559b5bd2-9ca9-4322-b0f7-40c8e0e85c27 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b" status: 200 len: 1218 microversion: 2.1 time: 0.220291 Aug 24 10:19:49.634121 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1066/1950] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:49 2022] GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b => generated 1218 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:49.643344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e45d5be7-0fa1-4281-a170-f31e104607ce tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:49.646760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e45d5be7-0fa1-4281-a170-f31e104607ce tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:49.669772 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e45d5be7-0fa1-4281-a170-f31e104607ce tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:49.676542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e45d5be7-0fa1-4281-a170-f31e104607ce tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:49.677569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e45d5be7-0fa1-4281-a170-f31e104607ce tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:49.678950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e45d5be7-0fa1-4281-a170-f31e104607ce tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:49.679815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e45d5be7-0fa1-4281-a170-f31e104607ce tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:49.680584 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e45d5be7-0fa1-4281-a170-f31e104607ce tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:50.012087 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e45d5be7-0fa1-4281-a170-f31e104607ce tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:50.023516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e45d5be7-0fa1-4281-a170-f31e104607ce tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:50.037195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e45d5be7-0fa1-4281-a170-f31e104607ce tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:50.069228 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e45d5be7-0fa1-4281-a170-f31e104607ce tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1446 microversion: 2.75 time: 0.421317 Aug 24 10:19:50.070437 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1067/1951] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:49 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1446 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:50.085718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ba62c531-f4da-43b9-a235-02fbf13a41b9 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:50.086550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ba62c531-f4da-43b9-a235-02fbf13a41b9 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: 8a4ddf34-af18-4e02-a306-c1c67f5c0b28] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:50.095790 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba62c531-f4da-43b9-a235-02fbf13a41b9 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:50.098799 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba62c531-f4da-43b9-a235-02fbf13a41b9 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:50.099733 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba62c531-f4da-43b9-a235-02fbf13a41b9 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:50.105027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba62c531-f4da-43b9-a235-02fbf13a41b9 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:50.110626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba62c531-f4da-43b9-a235-02fbf13a41b9 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:50.111476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba62c531-f4da-43b9-a235-02fbf13a41b9 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:50.259173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cbb3d12d-574f-4c42-8005-8a7343161847 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:50.287239 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cbb3d12d-574f-4c42-8005-8a7343161847 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1716 microversion: 2.1 time: 1.717737 Aug 24 10:19:50.292738 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 885/1952] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:48 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1716 bytes in 1727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:50.310041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-08933d69-a4f7-4515-8290-dfb75f01ed9a req-07053e93-966c-459a-abf2-108f5d3e218a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f80505-bb77-41ee-9d20-794ccbf5c855", "name": "network-vif-plugged", "status": "completed", "tag": "db59d150-d0f6-4bb5-89f3-bcbc294baa82"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:50.350254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-08933d69-a4f7-4515-8290-dfb75f01ed9a req-07053e93-966c-459a-abf2-108f5d3e218a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:50.355482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-08933d69-a4f7-4515-8290-dfb75f01ed9a req-07053e93-966c-459a-abf2-108f5d3e218a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:50.356211 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-08933d69-a4f7-4515-8290-dfb75f01ed9a req-07053e93-966c-459a-abf2-108f5d3e218a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:50.378944 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-08933d69-a4f7-4515-8290-dfb75f01ed9a req-07053e93-966c-459a-abf2-108f5d3e218a service nova] Creating event network-vif-plugged:db59d150-d0f6-4bb5-89f3-bcbc294baa82 for instance 79f80505-bb77-41ee-9d20-794ccbf5c855 on n-h1-849328-3 Aug 24 10:19:50.401456 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-08933d69-a4f7-4515-8290-dfb75f01ed9a req-07053e93-966c-459a-abf2-108f5d3e218a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105992 Aug 24 10:19:50.403422 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 886/1953] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:50.444248 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-139a0482-de41-4683-914e-06317148d0aa tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:50.449669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-139a0482-de41-4683-914e-06317148d0aa tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 79f80505-bb77-41ee-9d20-794ccbf5c855] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:50.462006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-139a0482-de41-4683-914e-06317148d0aa tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:50.466071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-139a0482-de41-4683-914e-06317148d0aa tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:50.466945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-139a0482-de41-4683-914e-06317148d0aa tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:50.468184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-139a0482-de41-4683-914e-06317148d0aa tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:50.471425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-139a0482-de41-4683-914e-06317148d0aa tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:50.472407 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-139a0482-de41-4683-914e-06317148d0aa tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:50.682280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ba62c531-f4da-43b9-a235-02fbf13a41b9 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:50.703094 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ba62c531-f4da-43b9-a235-02fbf13a41b9 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28" status: 200 len: 1275 microversion: 2.1 time: 0.628966 Aug 24 10:19:50.704214 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1068/1954] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:50 2022] GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28 => generated 1275 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:50.710264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-15a611c7-4b7e-47e5-bd61-8ad8127dc273 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:50.710980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-15a611c7-4b7e-47e5-bd61-8ad8127dc273 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:50.724274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15a611c7-4b7e-47e5-bd61-8ad8127dc273 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:50.728606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15a611c7-4b7e-47e5-bd61-8ad8127dc273 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:50.729077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15a611c7-4b7e-47e5-bd61-8ad8127dc273 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:50.729897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15a611c7-4b7e-47e5-bd61-8ad8127dc273 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:50.730511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15a611c7-4b7e-47e5-bd61-8ad8127dc273 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:50.731372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15a611c7-4b7e-47e5-bd61-8ad8127dc273 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:50.888046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-15a611c7-4b7e-47e5-bd61-8ad8127dc273 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:50.909431 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-15a611c7-4b7e-47e5-bd61-8ad8127dc273 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b" status: 200 len: 1270 microversion: 2.1 time: 0.203677 Aug 24 10:19:50.918114 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1069/1955] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:50 2022] GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b => generated 1270 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:51.113711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d4cfa023-0f56-4fd6-8e4c-0c0024dcdcf4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:51.114576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d4cfa023-0f56-4fd6-8e4c-0c0024dcdcf4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:51.130121 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4cfa023-0f56-4fd6-8e4c-0c0024dcdcf4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:51.131271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4cfa023-0f56-4fd6-8e4c-0c0024dcdcf4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:51.131977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4cfa023-0f56-4fd6-8e4c-0c0024dcdcf4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:51.135388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4cfa023-0f56-4fd6-8e4c-0c0024dcdcf4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:51.136816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4cfa023-0f56-4fd6-8e4c-0c0024dcdcf4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:51.137576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4cfa023-0f56-4fd6-8e4c-0c0024dcdcf4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:51.732136 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d4cfa023-0f56-4fd6-8e4c-0c0024dcdcf4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:51.760600 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d4cfa023-0f56-4fd6-8e4c-0c0024dcdcf4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:51.764142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d4cfa023-0f56-4fd6-8e4c-0c0024dcdcf4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:51.775216 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d4cfa023-0f56-4fd6-8e4c-0c0024dcdcf4 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1446 microversion: 2.75 time: 0.670331 Aug 24 10:19:51.777434 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1070/1956] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:51 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1446 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:51.787441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-97aeafc7-3c1b-4bc7-9cad-88a167c278a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:51.788592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-97aeafc7-3c1b-4bc7-9cad-88a167c278a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:51.825160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97aeafc7-3c1b-4bc7-9cad-88a167c278a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:51.827094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97aeafc7-3c1b-4bc7-9cad-88a167c278a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:51.827911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97aeafc7-3c1b-4bc7-9cad-88a167c278a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:51.829375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97aeafc7-3c1b-4bc7-9cad-88a167c278a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:51.830529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97aeafc7-3c1b-4bc7-9cad-88a167c278a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:51.831448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97aeafc7-3c1b-4bc7-9cad-88a167c278a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:51.986569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-139a0482-de41-4683-914e-06317148d0aa tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:52.010083 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-139a0482-de41-4683-914e-06317148d0aa tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855" status: 200 len: 1322 microversion: 2.1 time: 1.570900 Aug 24 10:19:52.024910 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 887/1957] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:50 2022] GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855 => generated 1322 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:52.024910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8f09c287-cae5-4ecf-ad60-5e7977b8c12a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:52.024910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8f09c287-cae5-4ecf-ad60-5e7977b8c12a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: 8a4ddf34-af18-4e02-a306-c1c67f5c0b28] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:52.040380 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f09c287-cae5-4ecf-ad60-5e7977b8c12a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:52.043048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f09c287-cae5-4ecf-ad60-5e7977b8c12a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:52.044387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f09c287-cae5-4ecf-ad60-5e7977b8c12a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:52.046426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f09c287-cae5-4ecf-ad60-5e7977b8c12a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:52.047967 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f09c287-cae5-4ecf-ad60-5e7977b8c12a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:52.049662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f09c287-cae5-4ecf-ad60-5e7977b8c12a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:52.214740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-97aeafc7-3c1b-4bc7-9cad-88a167c278a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:52.225213 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-97aeafc7-3c1b-4bc7-9cad-88a167c278a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1716 microversion: 2.1 time: 0.446095 Aug 24 10:19:52.227100 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1071/1958] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:51 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1716 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:52.234129 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6c5e1004-a0a4-4fe9-90a5-c81b622bd456 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:52.234772 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6c5e1004-a0a4-4fe9-90a5-c81b622bd456 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:52.242245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c5e1004-a0a4-4fe9-90a5-c81b622bd456 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:52.243637 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c5e1004-a0a4-4fe9-90a5-c81b622bd456 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:52.244417 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c5e1004-a0a4-4fe9-90a5-c81b622bd456 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:52.245536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c5e1004-a0a4-4fe9-90a5-c81b622bd456 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:52.246260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c5e1004-a0a4-4fe9-90a5-c81b622bd456 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:52.247026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c5e1004-a0a4-4fe9-90a5-c81b622bd456 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:52.261267 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8f09c287-cae5-4ecf-ad60-5e7977b8c12a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:52.291604 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8f09c287-cae5-4ecf-ad60-5e7977b8c12a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28" status: 200 len: 1275 microversion: 2.1 time: 0.271507 Aug 24 10:19:52.321393 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 888/1959] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:52 2022] GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28 => generated 1275 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:52.386424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6c5e1004-a0a4-4fe9-90a5-c81b622bd456 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:52.416590 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6c5e1004-a0a4-4fe9-90a5-c81b622bd456 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b" status: 200 len: 1276 microversion: 2.1 time: 0.185645 Aug 24 10:19:52.427653 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1072/1960] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:52 2022] GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b => generated 1276 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:52.826682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-81a7a394-50d5-47e1-a52e-18801d3ba8b3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:52.827307 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-81a7a394-50d5-47e1-a52e-18801d3ba8b3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:52.841277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81a7a394-50d5-47e1-a52e-18801d3ba8b3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:52.842153 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81a7a394-50d5-47e1-a52e-18801d3ba8b3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:52.842792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81a7a394-50d5-47e1-a52e-18801d3ba8b3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:52.843720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81a7a394-50d5-47e1-a52e-18801d3ba8b3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:52.844496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81a7a394-50d5-47e1-a52e-18801d3ba8b3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:52.845182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81a7a394-50d5-47e1-a52e-18801d3ba8b3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:53.032230 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-35ddbc57-192d-44eb-8fc5-27b5429bb832 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:53.033668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-35ddbc57-192d-44eb-8fc5-27b5429bb832 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 79f80505-bb77-41ee-9d20-794ccbf5c855] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:53.037202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:53.045360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35ddbc57-192d-44eb-8fc5-27b5429bb832 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:53.058099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35ddbc57-192d-44eb-8fc5-27b5429bb832 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:53.058691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35ddbc57-192d-44eb-8fc5-27b5429bb832 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:53.059886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35ddbc57-192d-44eb-8fc5-27b5429bb832 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:53.060353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35ddbc57-192d-44eb-8fc5-27b5429bb832 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:53.060851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35ddbc57-192d-44eb-8fc5-27b5429bb832 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:53.132344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-81a7a394-50d5-47e1-a52e-18801d3ba8b3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:53.147279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-81a7a394-50d5-47e1-a52e-18801d3ba8b3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:53.149660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-81a7a394-50d5-47e1-a52e-18801d3ba8b3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:53.159695 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-81a7a394-50d5-47e1-a52e-18801d3ba8b3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1446 microversion: 2.75 time: 0.339246 Aug 24 10:19:53.161193 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 889/1961] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:52 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1446 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:53.254899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-67c8c806-338a-4e9e-b9e6-e12598fda7a1 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:53.255802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-67c8c806-338a-4e9e-b9e6-e12598fda7a1 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:53.275372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67c8c806-338a-4e9e-b9e6-e12598fda7a1 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:53.276888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67c8c806-338a-4e9e-b9e6-e12598fda7a1 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:53.277516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67c8c806-338a-4e9e-b9e6-e12598fda7a1 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:53.280600 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67c8c806-338a-4e9e-b9e6-e12598fda7a1 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:53.283899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67c8c806-338a-4e9e-b9e6-e12598fda7a1 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:53.287088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67c8c806-338a-4e9e-b9e6-e12598fda7a1 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:53.441103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-35ddbc57-192d-44eb-8fc5-27b5429bb832 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:53.457435 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-35ddbc57-192d-44eb-8fc5-27b5429bb832 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855" status: 200 len: 1520 microversion: 2.1 time: 0.429055 Aug 24 10:19:53.483415 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1073/1962] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:53 2022] GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855 => generated 1520 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:53.501572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ed11717-b801-429d-bc5c-04c20c8a4215 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:53.504734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4ed11717-b801-429d-bc5c-04c20c8a4215 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: 8a4ddf34-af18-4e02-a306-c1c67f5c0b28] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:53.515688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ed11717-b801-429d-bc5c-04c20c8a4215 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:53.516509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ed11717-b801-429d-bc5c-04c20c8a4215 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:53.517231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ed11717-b801-429d-bc5c-04c20c8a4215 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:53.518017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ed11717-b801-429d-bc5c-04c20c8a4215 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:53.518643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ed11717-b801-429d-bc5c-04c20c8a4215 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:53.519724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ed11717-b801-429d-bc5c-04c20c8a4215 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:53.658351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4ed11717-b801-429d-bc5c-04c20c8a4215 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:53.699426 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4ed11717-b801-429d-bc5c-04c20c8a4215 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28" status: 200 len: 1275 microversion: 2.1 time: 0.214182 Aug 24 10:19:53.712768 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1074/1963] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:53 2022] GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28 => generated 1275 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:53.712768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8b740556-9f81-4e6c-aac4-7b0ad7307c9b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:53.712768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8b740556-9f81-4e6c-aac4-7b0ad7307c9b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:53.715527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:53.718618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b740556-9f81-4e6c-aac4-7b0ad7307c9b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:53.722499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b740556-9f81-4e6c-aac4-7b0ad7307c9b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:53.723139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b740556-9f81-4e6c-aac4-7b0ad7307c9b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:53.724528 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b740556-9f81-4e6c-aac4-7b0ad7307c9b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:53.725201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b740556-9f81-4e6c-aac4-7b0ad7307c9b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:53.725649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b740556-9f81-4e6c-aac4-7b0ad7307c9b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:53.830146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-67c8c806-338a-4e9e-b9e6-e12598fda7a1 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:53.842123 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-67c8c806-338a-4e9e-b9e6-e12598fda7a1 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1716 microversion: 2.1 time: 0.590949 Aug 24 10:19:53.857791 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 890/1964] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:53 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1716 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:53.864124 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1749dd48-a1d1-48a3-8cef-0d8810944ff1 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:53.865631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1749dd48-a1d1-48a3-8cef-0d8810944ff1 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 79f80505-bb77-41ee-9d20-794ccbf5c855] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:53.873761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1749dd48-a1d1-48a3-8cef-0d8810944ff1 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:53.874687 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1749dd48-a1d1-48a3-8cef-0d8810944ff1 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:53.875352 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1749dd48-a1d1-48a3-8cef-0d8810944ff1 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:53.876390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1749dd48-a1d1-48a3-8cef-0d8810944ff1 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:53.878042 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1749dd48-a1d1-48a3-8cef-0d8810944ff1 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:53.878795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1749dd48-a1d1-48a3-8cef-0d8810944ff1 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:53.878923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8b740556-9f81-4e6c-aac4-7b0ad7307c9b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:53.902399 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8b740556-9f81-4e6c-aac4-7b0ad7307c9b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b" status: 200 len: 1276 microversion: 2.1 time: 0.199544 Aug 24 10:19:53.910027 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1075/1965] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:53 2022] GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b => generated 1276 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:53.932285 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1749dd48-a1d1-48a3-8cef-0d8810944ff1 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 79f80505-bb77-41ee-9d20-794ccbf5c855] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:19:54.071455 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1749dd48-a1d1-48a3-8cef-0d8810944ff1 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "DELETE /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855" status: 204 len: 0 microversion: 2.1 time: 0.210921 Aug 24 10:19:54.081068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ce008f9-7f55-4d25-9c4e-6328072004bb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:54.081784 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0ce008f9-7f55-4d25-9c4e-6328072004bb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 79f80505-bb77-41ee-9d20-794ccbf5c855] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:54.085880 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 891/1966] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:19:53 2022] DELETE /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:19:54.090510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ce008f9-7f55-4d25-9c4e-6328072004bb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:54.091415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ce008f9-7f55-4d25-9c4e-6328072004bb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:54.092118 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ce008f9-7f55-4d25-9c4e-6328072004bb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:54.093055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ce008f9-7f55-4d25-9c4e-6328072004bb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:54.093856 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ce008f9-7f55-4d25-9c4e-6328072004bb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:54.094556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ce008f9-7f55-4d25-9c4e-6328072004bb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:54.187028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e654b5f8-1f78-48b9-bb67-f32f9e8c7415 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:54.187750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e654b5f8-1f78-48b9-bb67-f32f9e8c7415 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:54.201838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e654b5f8-1f78-48b9-bb67-f32f9e8c7415 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:54.208346 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e654b5f8-1f78-48b9-bb67-f32f9e8c7415 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:54.209012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e654b5f8-1f78-48b9-bb67-f32f9e8c7415 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:54.212666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e654b5f8-1f78-48b9-bb67-f32f9e8c7415 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:54.214039 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e654b5f8-1f78-48b9-bb67-f32f9e8c7415 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:54.215099 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e654b5f8-1f78-48b9-bb67-f32f9e8c7415 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:54.438729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e654b5f8-1f78-48b9-bb67-f32f9e8c7415 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:54.452494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e654b5f8-1f78-48b9-bb67-f32f9e8c7415 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:54.454636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e654b5f8-1f78-48b9-bb67-f32f9e8c7415 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:54.462062 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e654b5f8-1f78-48b9-bb67-f32f9e8c7415 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1446 microversion: 2.75 time: 0.279814 Aug 24 10:19:54.462772 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 892/1967] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:54 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1446 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:54.527022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0ce008f9-7f55-4d25-9c4e-6328072004bb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:54.541516 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0ce008f9-7f55-4d25-9c4e-6328072004bb tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855" status: 200 len: 1526 microversion: 2.1 time: 0.464141 Aug 24 10:19:54.542503 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1076/1968] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:54 2022] GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855 => generated 1526 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:54.724267 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f475285d-5a95-4559-a9b1-9946cc68f1db tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:54.726232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f475285d-5a95-4559-a9b1-9946cc68f1db tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: 8a4ddf34-af18-4e02-a306-c1c67f5c0b28] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:54.738009 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f475285d-5a95-4559-a9b1-9946cc68f1db tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:54.739137 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f475285d-5a95-4559-a9b1-9946cc68f1db tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:54.739845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f475285d-5a95-4559-a9b1-9946cc68f1db tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:54.740986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f475285d-5a95-4559-a9b1-9946cc68f1db tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:54.741664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f475285d-5a95-4559-a9b1-9946cc68f1db tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:54.742261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f475285d-5a95-4559-a9b1-9946cc68f1db tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:54.867012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9ff5838c-574b-437f-9826-319cd09a53f5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:54.868118 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9ff5838c-574b-437f-9826-319cd09a53f5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:54.876345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ff5838c-574b-437f-9826-319cd09a53f5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:54.877311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ff5838c-574b-437f-9826-319cd09a53f5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:54.877970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ff5838c-574b-437f-9826-319cd09a53f5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:54.879034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ff5838c-574b-437f-9826-319cd09a53f5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:54.879765 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ff5838c-574b-437f-9826-319cd09a53f5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:54.880631 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ff5838c-574b-437f-9826-319cd09a53f5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:55.201621 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9ff5838c-574b-437f-9826-319cd09a53f5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:55.240323 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9ff5838c-574b-437f-9826-319cd09a53f5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1716 microversion: 2.1 time: 0.378448 Aug 24 10:19:55.244716 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1077/1969] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:54 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1716 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:55.254734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-216089a2-a12c-44d4-8099-bc2a23caedc4 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:55.256515 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-216089a2-a12c-44d4-8099-bc2a23caedc4 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:55.263605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-216089a2-a12c-44d4-8099-bc2a23caedc4 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:55.265344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-216089a2-a12c-44d4-8099-bc2a23caedc4 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:55.266108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-216089a2-a12c-44d4-8099-bc2a23caedc4 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:55.267115 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-216089a2-a12c-44d4-8099-bc2a23caedc4 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:55.267890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-216089a2-a12c-44d4-8099-bc2a23caedc4 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:55.268712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-216089a2-a12c-44d4-8099-bc2a23caedc4 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:55.377826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-216089a2-a12c-44d4-8099-bc2a23caedc4 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:55.387598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:55.409195 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-216089a2-a12c-44d4-8099-bc2a23caedc4 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b" status: 200 len: 1276 microversion: 2.1 time: 0.158833 Aug 24 10:19:55.436074 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1078/1970] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:55 2022] GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b => generated 1276 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:55.515565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f475285d-5a95-4559-a9b1-9946cc68f1db tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:55.521977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2ea5e6f7-a3b3-421e-b7dd-f14d574119df tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:55.522827 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2ea5e6f7-a3b3-421e-b7dd-f14d574119df tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:55.527879 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f475285d-5a95-4559-a9b1-9946cc68f1db tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28" status: 200 len: 1317 microversion: 2.1 time: 0.809621 Aug 24 10:19:55.528832 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 893/1971] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:54 2022] GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28 => generated 1317 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:55.557083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ea5e6f7-a3b3-421e-b7dd-f14d574119df tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:55.562419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ea5e6f7-a3b3-421e-b7dd-f14d574119df tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:55.566518 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d8a59a01-e01f-4416-b606-ad442804af34 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:55.567146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d8a59a01-e01f-4416-b606-ad442804af34 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 79f80505-bb77-41ee-9d20-794ccbf5c855] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:55.569483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ea5e6f7-a3b3-421e-b7dd-f14d574119df tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:55.570817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ea5e6f7-a3b3-421e-b7dd-f14d574119df tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:55.571435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ea5e6f7-a3b3-421e-b7dd-f14d574119df tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:55.571824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ea5e6f7-a3b3-421e-b7dd-f14d574119df tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:55.580632 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8a59a01-e01f-4416-b606-ad442804af34 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:55.581502 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8a59a01-e01f-4416-b606-ad442804af34 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:55.582119 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8a59a01-e01f-4416-b606-ad442804af34 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:55.583258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8a59a01-e01f-4416-b606-ad442804af34 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:55.583896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8a59a01-e01f-4416-b606-ad442804af34 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:55.609868 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8a59a01-e01f-4416-b606-ad442804af34 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:55.878411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2ea5e6f7-a3b3-421e-b7dd-f14d574119df tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:55.899105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2ea5e6f7-a3b3-421e-b7dd-f14d574119df tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:55.900809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2ea5e6f7-a3b3-421e-b7dd-f14d574119df tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:55.927966 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2ea5e6f7-a3b3-421e-b7dd-f14d574119df tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1446 microversion: 2.75 time: 0.441069 Aug 24 10:19:55.928756 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1079/1972] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:55 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1446 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:56.023394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8d024d0a-e90d-45d3-98ba-bc093e02fa2f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Action: 'create', calling method: .version_select at 0x7f46545e3790>, body: {"keypair": {"name": "tempest-keypair-359662861", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqwbjKSNKN1G0Uc/mJsEtY7zFty/Q6pjPelJbqlpdxMtt/PRUen7ZdI54tXkSlDDa+Hxkt35IMfbgOFbb1hmHL09IpOrRrO5GbK0LV32BCn65rQqH8rJ93mog/M4o+Nqg=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:56.045790 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-8d024d0a-e90d-45d3-98ba-bc093e02fa2f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Getting quotas for project 823f96998a0341559f6a637f9a5b840c. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:19:56.051412 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-8d024d0a-e90d-45d3-98ba-bc093e02fa2f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Getting quotas for user e52ac750849e4207bbc6e320210bb2b7 and project 823f96998a0341559f6a637f9a5b840c. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:19:56.107447 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8d024d0a-e90d-45d3-98ba-bc093e02fa2f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.176734 Aug 24 10:19:56.113879 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1080/1973] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:19:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:56.263038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-218b7e3b-4cb2-4084-a464-c90117741ec9 req-e1ab8a71-ea77-4320-8e7a-a8b549e3d5bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb", "tag": "c181228f-fe7e-4a76-bb5e-18f9995613d1"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:56.302769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-218b7e3b-4cb2-4084-a464-c90117741ec9 req-e1ab8a71-ea77-4320-8e7a-a8b549e3d5bb service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:56.304537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-218b7e3b-4cb2-4084-a464-c90117741ec9 req-e1ab8a71-ea77-4320-8e7a-a8b549e3d5bb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:56.306320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-218b7e3b-4cb2-4084-a464-c90117741ec9 req-e1ab8a71-ea77-4320-8e7a-a8b549e3d5bb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:56.327147 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-218b7e3b-4cb2-4084-a464-c90117741ec9 req-e1ab8a71-ea77-4320-8e7a-a8b549e3d5bb service nova] Creating event network-changed:c181228f-fe7e-4a76-bb5e-18f9995613d1 for instance fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb on n-h1-849328-3 Aug 24 10:19:56.338645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d8a59a01-e01f-4416-b606-ad442804af34 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:56.348642 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-218b7e3b-4cb2-4084-a464-c90117741ec9 req-e1ab8a71-ea77-4320-8e7a-a8b549e3d5bb service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094687 Aug 24 10:19:56.354254 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1081/1974] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:56.362613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-07d1efac-1c53-40b5-bf01-9d1a269ee9fb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:56.363660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-07d1efac-1c53-40b5-bf01-9d1a269ee9fb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:56.369039 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d8a59a01-e01f-4416-b606-ad442804af34 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855" status: 200 len: 1526 microversion: 2.1 time: 0.806052 Aug 24 10:19:56.375359 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 894/1975] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:55 2022] GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855 => generated 1526 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:56.390042 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07d1efac-1c53-40b5-bf01-9d1a269ee9fb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:56.392978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07d1efac-1c53-40b5-bf01-9d1a269ee9fb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:56.399631 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07d1efac-1c53-40b5-bf01-9d1a269ee9fb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:56.403499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07d1efac-1c53-40b5-bf01-9d1a269ee9fb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:56.404542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07d1efac-1c53-40b5-bf01-9d1a269ee9fb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:56.408296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07d1efac-1c53-40b5-bf01-9d1a269ee9fb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:56.449557 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4e2055d8-b4fb-4175-8409-8c2094e3601d tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:56.450474 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4e2055d8-b4fb-4175-8409-8c2094e3601d tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:56.465302 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e2055d8-b4fb-4175-8409-8c2094e3601d tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:56.467825 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e2055d8-b4fb-4175-8409-8c2094e3601d tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:56.468542 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e2055d8-b4fb-4175-8409-8c2094e3601d tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:56.470859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e2055d8-b4fb-4175-8409-8c2094e3601d tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:56.471854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e2055d8-b4fb-4175-8409-8c2094e3601d tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:56.472895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e2055d8-b4fb-4175-8409-8c2094e3601d tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:56.834966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-07d1efac-1c53-40b5-bf01-9d1a269ee9fb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:56.843815 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-07d1efac-1c53-40b5-bf01-9d1a269ee9fb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1716 microversion: 2.1 time: 0.487895 Aug 24 10:19:56.857676 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1082/1976] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:56 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1716 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:56.865082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bbdf8482-5942-4a21-9f1f-ffdc75673759 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:56.866673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bbdf8482-5942-4a21-9f1f-ffdc75673759 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: 8a4ddf34-af18-4e02-a306-c1c67f5c0b28] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:56.886253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbdf8482-5942-4a21-9f1f-ffdc75673759 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:56.887000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbdf8482-5942-4a21-9f1f-ffdc75673759 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:56.887752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbdf8482-5942-4a21-9f1f-ffdc75673759 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:56.888614 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbdf8482-5942-4a21-9f1f-ffdc75673759 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:56.889406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbdf8482-5942-4a21-9f1f-ffdc75673759 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:56.892481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbdf8482-5942-4a21-9f1f-ffdc75673759 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:57.220380 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bbdf8482-5942-4a21-9f1f-ffdc75673759 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:57.238736 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bbdf8482-5942-4a21-9f1f-ffdc75673759 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28" status: 200 len: 1317 microversion: 2.1 time: 0.379105 Aug 24 10:19:57.239459 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1083/1977] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:56 2022] GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28 => generated 1317 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:57.261480 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3a439834-a842-450a-bfdc-aa4ae5fff7f3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:57.262409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3a439834-a842-450a-bfdc-aa4ae5fff7f3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:57.270296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a439834-a842-450a-bfdc-aa4ae5fff7f3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:57.271758 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a439834-a842-450a-bfdc-aa4ae5fff7f3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:57.272377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a439834-a842-450a-bfdc-aa4ae5fff7f3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:57.273146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a439834-a842-450a-bfdc-aa4ae5fff7f3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:57.273652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a439834-a842-450a-bfdc-aa4ae5fff7f3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:57.274088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a439834-a842-450a-bfdc-aa4ae5fff7f3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:57.455686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4e2055d8-b4fb-4175-8409-8c2094e3601d tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:57.469901 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4e2055d8-b4fb-4175-8409-8c2094e3601d tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b" status: 200 len: 1318 microversion: 2.1 time: 1.023625 Aug 24 10:19:57.482569 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 895/1978] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:56 2022] GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b => generated 1318 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:57.494382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d170cc5e-a733-48a6-adfc-95d6ddee6120 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:57.498872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d170cc5e-a733-48a6-adfc-95d6ddee6120 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 79f80505-bb77-41ee-9d20-794ccbf5c855] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:57.514054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d170cc5e-a733-48a6-adfc-95d6ddee6120 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:57.516439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d170cc5e-a733-48a6-adfc-95d6ddee6120 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:57.519535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d170cc5e-a733-48a6-adfc-95d6ddee6120 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:57.521474 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d170cc5e-a733-48a6-adfc-95d6ddee6120 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:57.521977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d170cc5e-a733-48a6-adfc-95d6ddee6120 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:57.525345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d170cc5e-a733-48a6-adfc-95d6ddee6120 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:57.726514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3a439834-a842-450a-bfdc-aa4ae5fff7f3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:57.741788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3a439834-a842-450a-bfdc-aa4ae5fff7f3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:57.748095 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3a439834-a842-450a-bfdc-aa4ae5fff7f3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:57.762101 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3a439834-a842-450a-bfdc-aa4ae5fff7f3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1452 microversion: 2.75 time: 0.503496 Aug 24 10:19:57.781666 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1084/1979] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:57 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1452 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:57.886196 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8e2d95b4-112c-4cfa-a811-7a83e5a8570c tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:57.888235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8e2d95b4-112c-4cfa-a811-7a83e5a8570c tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:57.910205 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e2d95b4-112c-4cfa-a811-7a83e5a8570c tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:57.911039 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e2d95b4-112c-4cfa-a811-7a83e5a8570c tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:57.911687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e2d95b4-112c-4cfa-a811-7a83e5a8570c tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:57.915711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e2d95b4-112c-4cfa-a811-7a83e5a8570c tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:57.919201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e2d95b4-112c-4cfa-a811-7a83e5a8570c tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:57.919985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e2d95b4-112c-4cfa-a811-7a83e5a8570c tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:58.269659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:58.352067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=12 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:58.393562 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d170cc5e-a733-48a6-adfc-95d6ddee6120 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:58.409068 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d170cc5e-a733-48a6-adfc-95d6ddee6120 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855" status: 200 len: 1526 microversion: 2.1 time: 0.929626 Aug 24 10:19:58.411371 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 896/1980] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:57 2022] GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855 => generated 1526 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:58.420988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-863869dd-83c2-4484-ac34-987a6041b2af tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:58.422099 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-863869dd-83c2-4484-ac34-987a6041b2af tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: 8a4ddf34-af18-4e02-a306-c1c67f5c0b28] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:58.429417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-863869dd-83c2-4484-ac34-987a6041b2af tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:58.431116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-863869dd-83c2-4484-ac34-987a6041b2af tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:58.432182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-863869dd-83c2-4484-ac34-987a6041b2af tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:58.435812 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-863869dd-83c2-4484-ac34-987a6041b2af tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:58.435812 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-863869dd-83c2-4484-ac34-987a6041b2af tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:58.435812 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-863869dd-83c2-4484-ac34-987a6041b2af tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:58.567711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8e2d95b4-112c-4cfa-a811-7a83e5a8570c tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:58.595175 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8e2d95b4-112c-4cfa-a811-7a83e5a8570c tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1716 microversion: 2.1 time: 0.727266 Aug 24 10:19:58.599453 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1085/1981] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:57 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1716 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:58.610605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-76fd3313-926e-47f5-ad77-d3b7decb6825 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:58.613181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-76fd3313-926e-47f5-ad77-d3b7decb6825 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:58.629789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76fd3313-926e-47f5-ad77-d3b7decb6825 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:58.633221 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76fd3313-926e-47f5-ad77-d3b7decb6825 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:58.634316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76fd3313-926e-47f5-ad77-d3b7decb6825 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:58.636486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76fd3313-926e-47f5-ad77-d3b7decb6825 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:58.637084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76fd3313-926e-47f5-ad77-d3b7decb6825 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:58.640072 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76fd3313-926e-47f5-ad77-d3b7decb6825 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:59.543218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-76fd3313-926e-47f5-ad77-d3b7decb6825 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:59.557518 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-76fd3313-926e-47f5-ad77-d3b7decb6825 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b" status: 200 len: 1318 microversion: 2.1 time: 0.951456 Aug 24 10:19:59.561347 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1086/1982] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:58 2022] GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b => generated 1318 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:59.572904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ae73d8e8-9e41-429a-b2e5-a354a2c2fa8c tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:59.574299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ae73d8e8-9e41-429a-b2e5-a354a2c2fa8c tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:59.591556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae73d8e8-9e41-429a-b2e5-a354a2c2fa8c tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:59.592367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae73d8e8-9e41-429a-b2e5-a354a2c2fa8c tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:59.592988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae73d8e8-9e41-429a-b2e5-a354a2c2fa8c tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:59.593916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae73d8e8-9e41-429a-b2e5-a354a2c2fa8c tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:59.596388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae73d8e8-9e41-429a-b2e5-a354a2c2fa8c tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:59.597547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae73d8e8-9e41-429a-b2e5-a354a2c2fa8c tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:59.809270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ae73d8e8-9e41-429a-b2e5-a354a2c2fa8c tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:59.823422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ae73d8e8-9e41-429a-b2e5-a354a2c2fa8c tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:59.827165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ae73d8e8-9e41-429a-b2e5-a354a2c2fa8c tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:59.837559 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ae73d8e8-9e41-429a-b2e5-a354a2c2fa8c tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1437 microversion: 2.75 time: 0.274252 Aug 24 10:19:59.838990 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1087/1983] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:59 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1437 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:59.848181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-4251b41a-30a8-4bc0-bdcb-bf82866d45dc req-43d54f1b-5cbd-4bff-8121-efb89a4f981d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f80505-bb77-41ee-9d20-794ccbf5c855", "name": "network-vif-deleted", "tag": "db59d150-d0f6-4bb5-89f3-bcbc294baa82"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:59.873759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4251b41a-30a8-4bc0-bdcb-bf82866d45dc req-43d54f1b-5cbd-4bff-8121-efb89a4f981d service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:59.874710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4251b41a-30a8-4bc0-bdcb-bf82866d45dc req-43d54f1b-5cbd-4bff-8121-efb89a4f981d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:59.880677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4251b41a-30a8-4bc0-bdcb-bf82866d45dc req-43d54f1b-5cbd-4bff-8121-efb89a4f981d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:59.898923 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-4251b41a-30a8-4bc0-bdcb-bf82866d45dc req-43d54f1b-5cbd-4bff-8121-efb89a4f981d service nova] Creating event network-vif-deleted:db59d150-d0f6-4bb5-89f3-bcbc294baa82 for instance 79f80505-bb77-41ee-9d20-794ccbf5c855 on n-h1-849328-3 Aug 24 10:19:59.907430 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-4251b41a-30a8-4bc0-bdcb-bf82866d45dc req-43d54f1b-5cbd-4bff-8121-efb89a4f981d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066180 Aug 24 10:19:59.908650 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1088/1984] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:59.919866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-20c2eafa-a399-47ad-9702-aa7672cc0333 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:59.924190 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-20c2eafa-a399-47ad-9702-aa7672cc0333 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 79f80505-bb77-41ee-9d20-794ccbf5c855] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:59.936897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20c2eafa-a399-47ad-9702-aa7672cc0333 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:59.937870 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20c2eafa-a399-47ad-9702-aa7672cc0333 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:59.938525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20c2eafa-a399-47ad-9702-aa7672cc0333 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:59.939536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20c2eafa-a399-47ad-9702-aa7672cc0333 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:59.941839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20c2eafa-a399-47ad-9702-aa7672cc0333 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:59.942678 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20c2eafa-a399-47ad-9702-aa7672cc0333 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:59.951336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-863869dd-83c2-4484-ac34-987a6041b2af tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:59.964799 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-863869dd-83c2-4484-ac34-987a6041b2af tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28" status: 200 len: 1317 microversion: 2.1 time: 1.551310 Aug 24 10:19:59.969463 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 897/1985] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:58 2022] GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28 => generated 1317 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:59.981163 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-025d20af-a5c7-4d81-96fe-52fcc61c13c6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:59.982150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-025d20af-a5c7-4d81-96fe-52fcc61c13c6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:00.001793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025d20af-a5c7-4d81-96fe-52fcc61c13c6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:00.002807 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025d20af-a5c7-4d81-96fe-52fcc61c13c6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:00.003583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025d20af-a5c7-4d81-96fe-52fcc61c13c6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:00.005101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025d20af-a5c7-4d81-96fe-52fcc61c13c6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:00.005751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025d20af-a5c7-4d81-96fe-52fcc61c13c6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:00.006344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025d20af-a5c7-4d81-96fe-52fcc61c13c6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:00.011963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:00.075898 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-20c2eafa-a399-47ad-9702-aa7672cc0333 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9111f8a2bae4e25a353ebb15eca2d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014076c393b148618aa03e8e8a0d5be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:00.089042 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-20c2eafa-a399-47ad-9702-aa7672cc0333 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855" status: 200 len: 1307 microversion: 2.1 time: 0.178432 Aug 24 10:20:00.102128 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1089/1986] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:59 2022] GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855 => generated 1307 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:00.602923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-37a3a6e6-278e-4781-ba20-7c499a2d0960 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:00.606151 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-37a3a6e6-278e-4781-ba20-7c499a2d0960 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:00.612815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37a3a6e6-278e-4781-ba20-7c499a2d0960 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:00.613409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37a3a6e6-278e-4781-ba20-7c499a2d0960 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:00.613960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37a3a6e6-278e-4781-ba20-7c499a2d0960 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:00.614772 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37a3a6e6-278e-4781-ba20-7c499a2d0960 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:00.615487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37a3a6e6-278e-4781-ba20-7c499a2d0960 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:00.616144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37a3a6e6-278e-4781-ba20-7c499a2d0960 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:00.622738 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-025d20af-a5c7-4d81-96fe-52fcc61c13c6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:00.636738 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-025d20af-a5c7-4d81-96fe-52fcc61c13c6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1706 microversion: 2.1 time: 0.666082 Aug 24 10:20:00.649576 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 898/1987] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:59 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1706 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:00.658816 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f8fa228d-eb70-4bc7-8d69-dd35e9aaf793 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:00.659734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f8fa228d-eb70-4bc7-8d69-dd35e9aaf793 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:00.666980 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8fa228d-eb70-4bc7-8d69-dd35e9aaf793 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:00.667779 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8fa228d-eb70-4bc7-8d69-dd35e9aaf793 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:00.668396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8fa228d-eb70-4bc7-8d69-dd35e9aaf793 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:00.669459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8fa228d-eb70-4bc7-8d69-dd35e9aaf793 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:00.670303 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8fa228d-eb70-4bc7-8d69-dd35e9aaf793 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:00.670909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8fa228d-eb70-4bc7-8d69-dd35e9aaf793 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:00.740115 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-37a3a6e6-278e-4781-ba20-7c499a2d0960 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:20:00.741026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-37a3a6e6-278e-4781-ba20-7c499a2d0960 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:20:00.741801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-37a3a6e6-278e-4781-ba20-7c499a2d0960 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:20:00.742455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-37a3a6e6-278e-4781-ba20-7c499a2d0960 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:20:00.743180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-37a3a6e6-278e-4781-ba20-7c499a2d0960 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:20:00.855119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-37a3a6e6-278e-4781-ba20-7c499a2d0960 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:00.869200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37a3a6e6-278e-4781-ba20-7c499a2d0960 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:00.870048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37a3a6e6-278e-4781-ba20-7c499a2d0960 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:00.870764 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37a3a6e6-278e-4781-ba20-7c499a2d0960 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:00.871977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37a3a6e6-278e-4781-ba20-7c499a2d0960 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:00.872769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37a3a6e6-278e-4781-ba20-7c499a2d0960 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:00.873574 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37a3a6e6-278e-4781-ba20-7c499a2d0960 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:01.237817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-37a3a6e6-278e-4781-ba20-7c499a2d0960 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lazy-loading 'services' on Instance uuid 3576fbd4-5c72-4025-a40c-e0e1ad348acc {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:01.284771 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-37a3a6e6-278e-4781-ba20-7c499a2d0960 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc/action" status: 202 len: 1940 microversion: 2.75 time: 1.181111 Aug 24 10:20:01.285582 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1090/1988] 10.222.0.85 () {62 vars in 1319 bytes} [Wed Aug 24 10:20:00 2022] POST /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc/action => generated 1940 bytes in 1183 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 24 10:20:01.309929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f8fa228d-eb70-4bc7-8d69-dd35e9aaf793 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:01.332750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-74d8a392-30f0-4086-999d-c36199cd8539 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Calling method '.version_select at 0x7f46546ee700>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:01.338814 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f8fa228d-eb70-4bc7-8d69-dd35e9aaf793 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b" status: 200 len: 1318 microversion: 2.1 time: 0.681158 Aug 24 10:20:01.340485 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 899/1989] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:00 2022] GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b => generated 1318 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:01.351202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74d8a392-30f0-4086-999d-c36199cd8539 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:01.353261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74d8a392-30f0-4086-999d-c36199cd8539 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:01.360245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d6cf6275-5060-4537-8389-3a9ee789a216 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:01.361328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74d8a392-30f0-4086-999d-c36199cd8539 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:01.367714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d6cf6275-5060-4537-8389-3a9ee789a216 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: 8a4ddf34-af18-4e02-a306-c1c67f5c0b28] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:01.382256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6cf6275-5060-4537-8389-3a9ee789a216 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:01.383818 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6cf6275-5060-4537-8389-3a9ee789a216 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:01.384785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6cf6275-5060-4537-8389-3a9ee789a216 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:01.385769 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6cf6275-5060-4537-8389-3a9ee789a216 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:01.386597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6cf6275-5060-4537-8389-3a9ee789a216 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:01.388112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6cf6275-5060-4537-8389-3a9ee789a216 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:01.396026 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-74d8a392-30f0-4086-999d-c36199cd8539 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] 10.222.0.85 "GET /compute/v2.1/os-migrations" status: 200 len: 1167 microversion: 2.1 time: 0.100924 Aug 24 10:20:01.407993 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1091/1990] 10.222.0.85 () {58 vars in 1143 bytes} [Wed Aug 24 10:20:01 2022] GET /compute/v2.1/os-migrations => generated 1167 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:01.413340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c61cc42c-7d0b-4f7a-baee-80187d16264b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:01.414252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c61cc42c-7d0b-4f7a-baee-80187d16264b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 79f80505-bb77-41ee-9d20-794ccbf5c855] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:01.422141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c61cc42c-7d0b-4f7a-baee-80187d16264b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:01.422926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c61cc42c-7d0b-4f7a-baee-80187d16264b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:01.423554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c61cc42c-7d0b-4f7a-baee-80187d16264b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:01.424458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c61cc42c-7d0b-4f7a-baee-80187d16264b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:01.425085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c61cc42c-7d0b-4f7a-baee-80187d16264b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:01.425706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c61cc42c-7d0b-4f7a-baee-80187d16264b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:01.447038 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-c61cc42c-7d0b-4f7a-baee-80187d16264b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] HTTP exception thrown: Instance 79f80505-bb77-41ee-9d20-794ccbf5c855 could not be found. Aug 24 10:20:01.449717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c61cc42c-7d0b-4f7a-baee-80187d16264b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Request method failure captured: Aug 24 10:20:01.449717 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855 HTTP/1.1 Aug 24 10:20:01.449717 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:20:01.449717 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:20:01.449717 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:20:01.449717 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:20:01.449717 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:20:01.449717 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:20:01.449717 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:20:01.449717 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:20:01.449717 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfrThttCsJVn6ZYJ5IPHV9fokEqNFKnmNalLL8nZmf_ei5N3zrV08QH1KmLggfkmBKerwFjLosb49uBsjyVeSxt3NJxRyvR4_2es1MonVPd0vwRK6vdPZfvD2BRibktcybuLmMjpd59h5dgQc8Mlu-A4JR-WB_EJM5jyYx0kRVbI5dw Aug 24 10:20:01.449717 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:20:01.449717 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:20:01.449717 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:20:01.449717 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:20:01.449717 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:20:01.449717 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:20:01.449717 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 014076c393b148618aa03e8e8a0d5be7 Aug 24 10:20:01.449717 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:20:01.449717 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:20:01.449717 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:20:01.452523 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/014076c393b148618aa03e8e8a0d5be7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_014076c393b148618aa03e8e8a0d5be7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/014076c393b148618aa03e8e8a0d5be7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/014076c393b148618aa03e8e8a0d5be7"}]}] Aug 24 10:20:01.452523 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:20:01.452523 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 014076c393b148618aa03e8e8a0d5be7 Aug 24 10:20:01.452523 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:20:01.452523 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesOneServerNegativeTestJSON-949139278-project Aug 24 10:20:01.452523 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:20:01.452523 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:20:01.452523 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: a9111f8a2bae4e25a353ebb15eca2d5a Aug 24 10:20:01.452523 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-949139278-project Aug 24 10:20:01.452523 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:20:01.452523 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 79f80505-bb77-41ee-9d20-794ccbf5c855 could not be found. Aug 24 10:20:01.452523 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '79f80505-bb77-41ee-9d20-794ccbf5c855'} Aug 24 10:20:01.454335 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:20:01.454335 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:01.454335 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:20:01.454335 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:20:01.454335 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:20:01.454335 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:20:01.454335 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:20:01.454335 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:20:01.454335 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:20:01.454335 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:20:01.454335 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79f80505-bb77-41ee-9d20-794ccbf5c855 could not be found. Aug 24 10:20:01.454335 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:01.454335 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:01.454335 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:01.454335 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:01.454335 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:01.454335 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:01.454335 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:20:01.454335 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:20:01.454335 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:20:01.456469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:20:01.456469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:20:01.456469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:20:01.456469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:20:01.456469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:20:01.456469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:20:01.456469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:20:01.456469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79f80505-bb77-41ee-9d20-794ccbf5c855 could not be found. Aug 24 10:20:01.456469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:01.456469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:01.456469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:01.456469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:01.456469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:01.456469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:01.456469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:20:01.456469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:20:01.456469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79f80505-bb77-41ee-9d20-794ccbf5c855 could not be found. Aug 24 10:20:01.456469 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:01.458619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c61cc42c-7d0b-4f7a-baee-80187d16264b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Returning 404 to user: Instance 79f80505-bb77-41ee-9d20-794ccbf5c855 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:20:01.458619 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c61cc42c-7d0b-4f7a-baee-80187d16264b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855" status: 404 len: 111 microversion: 2.1 time: 0.042076 Aug 24 10:20:01.458619 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1092/1991] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:01 2022] GET /compute/v2.1/servers/79f80505-bb77-41ee-9d20-794ccbf5c855 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:20:01.463995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-654c6cba-7d4c-4d23-ad69-61fb40bdce7f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-903245922", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a8946a1a-1492-4a54-a22e-d6c998a7ee2b"}], "security_groups": [{"name": "tempest-securitygroup--169184474"}], "key_name": "tempest-keypair-359662861", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:01.684215 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-654c6cba-7d4c-4d23-ad69-61fb40bdce7f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] validate_networks() for [('a8946a1a-1492-4a54-a22e-d6c998a7ee2b', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:20:02.031930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d6cf6275-5060-4537-8389-3a9ee789a216 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:02.053279 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d6cf6275-5060-4537-8389-3a9ee789a216 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28" status: 200 len: 1317 microversion: 2.1 time: 0.705209 Aug 24 10:20:02.069155 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 900/1992] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:01 2022] GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28 => generated 1317 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:02.071035 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7a00b9b1-4290-495f-89b0-ba5725197ff3 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:02.072465 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7a00b9b1-4290-495f-89b0-ba5725197ff3 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:02.087200 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a00b9b1-4290-495f-89b0-ba5725197ff3 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:02.088744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a00b9b1-4290-495f-89b0-ba5725197ff3 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:02.089667 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a00b9b1-4290-495f-89b0-ba5725197ff3 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:02.092372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a00b9b1-4290-495f-89b0-ba5725197ff3 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:02.093003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a00b9b1-4290-495f-89b0-ba5725197ff3 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:02.096136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a00b9b1-4290-495f-89b0-ba5725197ff3 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:02.443811 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-7a00b9b1-4290-495f-89b0-ba5725197ff3 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lazy-loading 'services' on Instance uuid 3576fbd4-5c72-4025-a40c-e0e1ad348acc {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:02.492088 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7a00b9b1-4290-495f-89b0-ba5725197ff3 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1927 microversion: 2.75 time: 0.428932 Aug 24 10:20:02.505829 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 901/1993] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:02 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1927 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:02.505829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2dad8dfc-6719-420a-9292-83b0e787a9c5 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:02.505829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2dad8dfc-6719-420a-9292-83b0e787a9c5 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:02.522108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dad8dfc-6719-420a-9292-83b0e787a9c5 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:02.523907 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dad8dfc-6719-420a-9292-83b0e787a9c5 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:02.524536 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dad8dfc-6719-420a-9292-83b0e787a9c5 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:02.525574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dad8dfc-6719-420a-9292-83b0e787a9c5 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:02.527125 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dad8dfc-6719-420a-9292-83b0e787a9c5 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:02.527926 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dad8dfc-6719-420a-9292-83b0e787a9c5 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:02.709312 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=21 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:02.716653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-654c6cba-7d4c-4d23-ad69-61fb40bdce7f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Getting quotas for project 823f96998a0341559f6a637f9a5b840c. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:20:02.726699 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-654c6cba-7d4c-4d23-ad69-61fb40bdce7f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Getting quotas for user e52ac750849e4207bbc6e320210bb2b7 and project 823f96998a0341559f6a637f9a5b840c. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:20:02.752974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-654c6cba-7d4c-4d23-ad69-61fb40bdce7f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:20:02.753874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-654c6cba-7d4c-4d23-ad69-61fb40bdce7f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:20:02.755044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-654c6cba-7d4c-4d23-ad69-61fb40bdce7f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:20:02.755786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-654c6cba-7d4c-4d23-ad69-61fb40bdce7f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:20:02.756768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-654c6cba-7d4c-4d23-ad69-61fb40bdce7f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:20:02.772635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-654c6cba-7d4c-4d23-ad69-61fb40bdce7f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:02.774046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-654c6cba-7d4c-4d23-ad69-61fb40bdce7f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:02.775086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-654c6cba-7d4c-4d23-ad69-61fb40bdce7f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:02.776432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-654c6cba-7d4c-4d23-ad69-61fb40bdce7f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:02.777564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-654c6cba-7d4c-4d23-ad69-61fb40bdce7f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:02.778649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-654c6cba-7d4c-4d23-ad69-61fb40bdce7f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:02.814394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-654c6cba-7d4c-4d23-ad69-61fb40bdce7f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Getting quotas for project 823f96998a0341559f6a637f9a5b840c. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:20:02.824813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-654c6cba-7d4c-4d23-ad69-61fb40bdce7f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Getting quotas for user e52ac750849e4207bbc6e320210bb2b7 and project 823f96998a0341559f6a637f9a5b840c. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:20:02.848348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-654c6cba-7d4c-4d23-ad69-61fb40bdce7f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:20:02.853602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-654c6cba-7d4c-4d23-ad69-61fb40bdce7f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] [instance: e5cf9540-fba0-498d-890d-af316b16ceff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:20:02.957024 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-654c6cba-7d4c-4d23-ad69-61fb40bdce7f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.499569 Aug 24 10:20:02.958505 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1093/1994] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:20:01 2022] POST /compute/v2.1/servers => generated 408 bytes in 1502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:20:02.968223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aa097db7-358a-4b5d-8cb6-14289b258c3b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '.version_select at 0x7f465a1bdaf0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:03.008293 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-aa097db7-358a-4b5d-8cb6-14289b258c3b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] HTTP exception thrown: Image not found. Aug 24 10:20:03.011955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aa097db7-358a-4b5d-8cb6-14289b258c3b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Request method failure captured: Aug 24 10:20:03.011955 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/images/00e5ec09-38fb-41ee-953d-f209f4f3ced3 HTTP/1.1 Aug 24 10:20:03.011955 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:20:03.011955 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:20:03.011955 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:20:03.011955 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:20:03.011955 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:20:03.011955 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:20:03.011955 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:20:03.011955 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:20:03.011955 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfrThttCsJVn6ZYJ5IPHV9fokEqNFKnmNalLL8nZmf_ei5N3zrV08QH1KmLggfkmBKerwFjLosb49uBsjyVeSxt3NJxRyvR4_2es1MonVPd0vwRK6vdPZfvD2BRibktcybuLmMjpd59h5dgQc8Mlu-A4JR-WB_EJM5jyYx0kRVbI5dw Aug 24 10:20:03.011955 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:20:03.011955 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:20:03.011955 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:20:03.011955 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:20:03.011955 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:20:03.011955 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:20:03.011955 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 014076c393b148618aa03e8e8a0d5be7 Aug 24 10:20:03.011955 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:20:03.011955 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:20:03.011955 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:20:03.014636 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/014076c393b148618aa03e8e8a0d5be7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_014076c393b148618aa03e8e8a0d5be7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/014076c393b148618aa03e8e8a0d5be7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/014076c393b148618aa03e8e8a0d5be7"}]}] Aug 24 10:20:03.014636 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:20:03.014636 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 014076c393b148618aa03e8e8a0d5be7 Aug 24 10:20:03.014636 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:20:03.014636 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesOneServerNegativeTestJSON-949139278-project Aug 24 10:20:03.014636 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:20:03.014636 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:20:03.014636 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: a9111f8a2bae4e25a353ebb15eca2d5a Aug 24 10:20:03.014636 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-949139278-project Aug 24 10:20:03.014636 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:20:03.014636 n-d-849328-3 devstack@n-api.service[122433]: exception: Image not found. Aug 24 10:20:03.014636 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '00e5ec09-38fb-41ee-953d-f209f4f3ced3'} Aug 24 10:20:03.014636 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:20:03.015784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:03.015784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 10:20:03.015784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 10:20:03.015784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:20:03.015784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:20:03.015784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:20:03.015784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:20:03.015784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 10:20:03.015784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 10:20:03.015784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 10:20:03.015784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 10:20:03.015784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:20:03.015784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:20:03.015784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:20:03.015784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:20:03.015784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 00e5ec09-38fb-41ee-953d-f209f4f3ced3 to delete Aug 24 10:20:03.015784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:03.015784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:03.015784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:03.017553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:03.017553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 10:20:03.017553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 10:20:03.017553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 10:20:03.017553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 10:20:03.017553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 10:20:03.017553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 10:20:03.017553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 00e5ec09-38fb-41ee-953d-f209f4f3ced3 could not be found. Aug 24 10:20:03.017553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:03.017553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:03.017553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:03.017553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:03.017553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:03.017553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:03.017553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:20:03.017553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:20:03.017553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:20:03.017553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:20:03.017553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:20:03.017553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:20:03.018976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 10:20:03.018976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 10:20:03.018976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 10:20:03.018976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:03.018976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:03.018976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:03.018976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:03.018976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:03.018976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:03.018976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:20:03.018976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:20:03.018976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 10:20:03.018976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:03.018976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aa097db7-358a-4b5d-8cb6-14289b258c3b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Returning 404 to user: Image not found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:20:03.018976 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aa097db7-358a-4b5d-8cb6-14289b258c3b tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "DELETE /compute/v2.1/images/00e5ec09-38fb-41ee-953d-f209f4f3ced3" status: 404 len: 62 microversion: 2.1 time: 0.055356 Aug 24 10:20:03.020102 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1094/1995] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:02 2022] DELETE /compute/v2.1/images/00e5ec09-38fb-41ee-953d-f209f4f3ced3 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:20:03.026333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0952acd6-d756-4f4c-a246-798f68f6bef5 req-0e72e5bb-fdf5-4421-af53-cda925d7e776 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a4ddf34-af18-4e02-a306-c1c67f5c0b28", "tag": "21445c55-f24c-46da-9946-53b2566a219f"}, {"name": "network-changed", "server_uuid": "09ab167e-c8c7-417d-bc49-e9b8ccb8b06b", "tag": "c8226ca9-d3ae-4597-b639-5cf9aee131e9"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:03.036453 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2dad8dfc-6719-420a-9292-83b0e787a9c5 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1857 microversion: 2.1 time: 0.539285 Aug 24 10:20:03.038973 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 902/1996] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:02 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1857 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:03.044301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a3788f36-05f3-4d92-b47a-6bf34a79c2a0 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:03.044926 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a3788f36-05f3-4d92-b47a-6bf34a79c2a0 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:03.047047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0952acd6-d756-4f4c-a246-798f68f6bef5 req-0e72e5bb-fdf5-4421-af53-cda925d7e776 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:03.047917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0952acd6-d756-4f4c-a246-798f68f6bef5 req-0e72e5bb-fdf5-4421-af53-cda925d7e776 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:03.048700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0952acd6-d756-4f4c-a246-798f68f6bef5 req-0e72e5bb-fdf5-4421-af53-cda925d7e776 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:03.051852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3788f36-05f3-4d92-b47a-6bf34a79c2a0 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:03.052335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3788f36-05f3-4d92-b47a-6bf34a79c2a0 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:03.052975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3788f36-05f3-4d92-b47a-6bf34a79c2a0 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:03.054066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3788f36-05f3-4d92-b47a-6bf34a79c2a0 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:03.054609 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3788f36-05f3-4d92-b47a-6bf34a79c2a0 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:03.055105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3788f36-05f3-4d92-b47a-6bf34a79c2a0 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:03.078345 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0952acd6-d756-4f4c-a246-798f68f6bef5 req-0e72e5bb-fdf5-4421-af53-cda925d7e776 service nova] Creating event network-changed:21445c55-f24c-46da-9946-53b2566a219f for instance 8a4ddf34-af18-4e02-a306-c1c67f5c0b28 on n-h2-849328-3 Aug 24 10:20:03.078878 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0952acd6-d756-4f4c-a246-798f68f6bef5 req-0e72e5bb-fdf5-4421-af53-cda925d7e776 service nova] Creating event network-changed:c8226ca9-d3ae-4597-b639-5cf9aee131e9 for instance 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b on n-h1-849328-3 Aug 24 10:20:03.090363 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0952acd6-d756-4f4c-a246-798f68f6bef5 req-0e72e5bb-fdf5-4421-af53-cda925d7e776 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.070920 Aug 24 10:20:03.092026 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1095/1997] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:03.099538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-752a1d10-5b65-4798-9e96-985a874fb28e tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:03.100782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-752a1d10-5b65-4798-9e96-985a874fb28e tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] [instance: e5cf9540-fba0-498d-890d-af316b16ceff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:03.202540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-752a1d10-5b65-4798-9e96-985a874fb28e tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e52ac750849e4207bbc6e320210bb2b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823f96998a0341559f6a637f9a5b840c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:03.218936 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-752a1d10-5b65-4798-9e96-985a874fb28e tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff" status: 200 len: 1276 microversion: 2.1 time: 0.124785 Aug 24 10:20:03.237826 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1096/1998] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:03 2022] GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff => generated 1276 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:03.267768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3dfec880-f1d9-4482-a90c-211d748e9931 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:03.268603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3dfec880-f1d9-4482-a90c-211d748e9931 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 6f46192a-0f63-45dd-9ca9-7fda5730ef6e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:03.280103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3dfec880-f1d9-4482-a90c-211d748e9931 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:03.281351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3dfec880-f1d9-4482-a90c-211d748e9931 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:03.282360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3dfec880-f1d9-4482-a90c-211d748e9931 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:03.284267 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3dfec880-f1d9-4482-a90c-211d748e9931 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:03.285693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3dfec880-f1d9-4482-a90c-211d748e9931 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:03.286467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3dfec880-f1d9-4482-a90c-211d748e9931 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:03.312501 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-3dfec880-f1d9-4482-a90c-211d748e9931 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] HTTP exception thrown: Instance 6f46192a-0f63-45dd-9ca9-7fda5730ef6e could not be found. Aug 24 10:20:03.315306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3dfec880-f1d9-4482-a90c-211d748e9931 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Request method failure captured: Aug 24 10:20:03.315306 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e HTTP/1.1 Aug 24 10:20:03.315306 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:20:03.315306 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:20:03.315306 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:20:03.315306 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:20:03.315306 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:20:03.315306 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:20:03.315306 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:20:03.315306 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:20:03.315306 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfrThttCsJVn6ZYJ5IPHV9fokEqNFKnmNalLL8nZmf_ei5N3zrV08QH1KmLggfkmBKerwFjLosb49uBsjyVeSxt3NJxRyvR4_2es1MonVPd0vwRK6vdPZfvD2BRibktcybuLmMjpd59h5dgQc8Mlu-A4JR-WB_EJM5jyYx0kRVbI5dw Aug 24 10:20:03.315306 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:20:03.315306 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:20:03.315306 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:20:03.315306 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:20:03.315306 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:20:03.315306 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:20:03.315306 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 014076c393b148618aa03e8e8a0d5be7 Aug 24 10:20:03.315306 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:20:03.315306 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:20:03.315306 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:20:03.317234 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/014076c393b148618aa03e8e8a0d5be7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_014076c393b148618aa03e8e8a0d5be7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/014076c393b148618aa03e8e8a0d5be7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/014076c393b148618aa03e8e8a0d5be7"}]}] Aug 24 10:20:03.317234 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:20:03.317234 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 014076c393b148618aa03e8e8a0d5be7 Aug 24 10:20:03.317234 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:20:03.317234 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesOneServerNegativeTestJSON-949139278-project Aug 24 10:20:03.317234 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:20:03.317234 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:20:03.317234 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: a9111f8a2bae4e25a353ebb15eca2d5a Aug 24 10:20:03.317234 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-949139278-project Aug 24 10:20:03.317234 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:20:03.317234 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 6f46192a-0f63-45dd-9ca9-7fda5730ef6e could not be found. Aug 24 10:20:03.317234 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '6f46192a-0f63-45dd-9ca9-7fda5730ef6e'} Aug 24 10:20:03.318375 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:20:03.318375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:03.318375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:20:03.318375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:20:03.318375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:20:03.318375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:20:03.318375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:20:03.318375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:20:03.318375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:20:03.318375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:20:03.318375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f46192a-0f63-45dd-9ca9-7fda5730ef6e could not be found. Aug 24 10:20:03.318375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:03.318375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:03.318375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:03.318375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:03.318375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:03.318375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:03.318375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:20:03.318375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:20:03.318375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:20:03.320010 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:20:03.320010 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:20:03.320010 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:20:03.320010 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:20:03.320010 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:20:03.320010 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:20:03.320010 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:20:03.320010 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:20:03.320010 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:20:03.320010 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f46192a-0f63-45dd-9ca9-7fda5730ef6e could not be found. Aug 24 10:20:03.320010 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:03.320010 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:03.320010 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:03.320010 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:03.320010 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:03.320010 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:03.320010 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:20:03.320010 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:20:03.320010 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f46192a-0f63-45dd-9ca9-7fda5730ef6e could not be found. Aug 24 10:20:03.320010 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:03.322658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3dfec880-f1d9-4482-a90c-211d748e9931 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Returning 404 to user: Instance 6f46192a-0f63-45dd-9ca9-7fda5730ef6e could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:20:03.322658 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3dfec880-f1d9-4482-a90c-211d748e9931 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "DELETE /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e" status: 404 len: 111 microversion: 2.1 time: 0.076747 Aug 24 10:20:03.322658 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1097/1999] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:20:03 2022] DELETE /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:20:03.323091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bb18a778-e3ea-4e8c-b494-f608d5e05e1e tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:03.323637 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bb18a778-e3ea-4e8c-b494-f608d5e05e1e tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:03.331443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb18a778-e3ea-4e8c-b494-f608d5e05e1e tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:03.332131 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb18a778-e3ea-4e8c-b494-f608d5e05e1e tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:03.333691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb18a778-e3ea-4e8c-b494-f608d5e05e1e tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:03.334841 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb18a778-e3ea-4e8c-b494-f608d5e05e1e tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:03.335887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb18a778-e3ea-4e8c-b494-f608d5e05e1e tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:03.336533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb18a778-e3ea-4e8c-b494-f608d5e05e1e tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:03.500815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a3788f36-05f3-4d92-b47a-6bf34a79c2a0 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:03.520983 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a3788f36-05f3-4d92-b47a-6bf34a79c2a0 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b" status: 200 len: 1318 microversion: 2.1 time: 0.480600 Aug 24 10:20:03.525046 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 903/2000] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:03 2022] GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b => generated 1318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:03.539244 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bb18a778-e3ea-4e8c-b494-f608d5e05e1e tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1857 microversion: 2.1 time: 0.219968 Aug 24 10:20:03.540641 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1098/2001] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:03 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1857 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:03.548170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-351bc2a7-78ae-4a0a-b337-cad0dca59a0c tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:03.549232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-351bc2a7-78ae-4a0a-b337-cad0dca59a0c tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: 6f46192a-0f63-45dd-9ca9-7fda5730ef6e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:03.556088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-351bc2a7-78ae-4a0a-b337-cad0dca59a0c tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:03.556674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-351bc2a7-78ae-4a0a-b337-cad0dca59a0c tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:03.557225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-351bc2a7-78ae-4a0a-b337-cad0dca59a0c tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:03.558015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-351bc2a7-78ae-4a0a-b337-cad0dca59a0c tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:03.558576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-351bc2a7-78ae-4a0a-b337-cad0dca59a0c tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:03.559074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-351bc2a7-78ae-4a0a-b337-cad0dca59a0c tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:03.579166 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-29664736-8216-4d27-8583-746b320f5bab tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:03.581854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-29664736-8216-4d27-8583-746b320f5bab tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: 8a4ddf34-af18-4e02-a306-c1c67f5c0b28] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:03.589543 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-351bc2a7-78ae-4a0a-b337-cad0dca59a0c tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] HTTP exception thrown: Instance 6f46192a-0f63-45dd-9ca9-7fda5730ef6e could not be found. Aug 24 10:20:03.591242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-351bc2a7-78ae-4a0a-b337-cad0dca59a0c tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Request method failure captured: Aug 24 10:20:03.591242 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e HTTP/1.1 Aug 24 10:20:03.591242 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:20:03.591242 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:20:03.591242 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:20:03.591242 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:20:03.591242 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:20:03.591242 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:20:03.591242 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:20:03.591242 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:20:03.591242 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfrThttCsJVn6ZYJ5IPHV9fokEqNFKnmNalLL8nZmf_ei5N3zrV08QH1KmLggfkmBKerwFjLosb49uBsjyVeSxt3NJxRyvR4_2es1MonVPd0vwRK6vdPZfvD2BRibktcybuLmMjpd59h5dgQc8Mlu-A4JR-WB_EJM5jyYx0kRVbI5dw Aug 24 10:20:03.591242 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:20:03.591242 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:20:03.591242 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:20:03.591242 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:20:03.591242 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:20:03.591242 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:20:03.591242 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 014076c393b148618aa03e8e8a0d5be7 Aug 24 10:20:03.591242 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:20:03.591242 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:20:03.591242 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:20:03.592858 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/014076c393b148618aa03e8e8a0d5be7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_014076c393b148618aa03e8e8a0d5be7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/014076c393b148618aa03e8e8a0d5be7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/014076c393b148618aa03e8e8a0d5be7"}]}] Aug 24 10:20:03.592858 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:20:03.592858 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 014076c393b148618aa03e8e8a0d5be7 Aug 24 10:20:03.592858 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:20:03.592858 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesOneServerNegativeTestJSON-949139278-project Aug 24 10:20:03.592858 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:20:03.592858 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:20:03.592858 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: a9111f8a2bae4e25a353ebb15eca2d5a Aug 24 10:20:03.592858 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-949139278-project Aug 24 10:20:03.592858 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:20:03.592858 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 6f46192a-0f63-45dd-9ca9-7fda5730ef6e could not be found. Aug 24 10:20:03.592858 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '6f46192a-0f63-45dd-9ca9-7fda5730ef6e'} Aug 24 10:20:03.593837 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:20:03.593837 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:03.593837 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:20:03.593837 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:20:03.593837 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:20:03.593837 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:20:03.593837 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:20:03.593837 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:20:03.593837 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:20:03.593837 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:20:03.593837 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f46192a-0f63-45dd-9ca9-7fda5730ef6e could not be found. Aug 24 10:20:03.593837 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:03.593837 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:03.593837 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:03.593837 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:03.593837 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:03.593837 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:03.593837 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:20:03.593837 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:20:03.593837 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:20:03.595227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:20:03.595227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:20:03.595227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:20:03.595227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:20:03.595227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:20:03.595227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:20:03.595227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:20:03.595227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f46192a-0f63-45dd-9ca9-7fda5730ef6e could not be found. Aug 24 10:20:03.595227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:03.595227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:03.595227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:03.595227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:03.595227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:03.595227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:03.595227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:20:03.595227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:20:03.595227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f46192a-0f63-45dd-9ca9-7fda5730ef6e could not be found. Aug 24 10:20:03.595227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:03.596598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-351bc2a7-78ae-4a0a-b337-cad0dca59a0c tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Returning 404 to user: Instance 6f46192a-0f63-45dd-9ca9-7fda5730ef6e could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:20:03.596598 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-351bc2a7-78ae-4a0a-b337-cad0dca59a0c tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e" status: 404 len: 111 microversion: 2.1 time: 0.051334 Aug 24 10:20:03.599343 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1099/2002] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:03 2022] GET /compute/v2.1/servers/6f46192a-0f63-45dd-9ca9-7fda5730ef6e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:20:03.602721 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29664736-8216-4d27-8583-746b320f5bab tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:03.603183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e6a54ab3-e6ae-406b-b3ba-c2f9bab6b2c3 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:03.603804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29664736-8216-4d27-8583-746b320f5bab tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:03.604275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e6a54ab3-e6ae-406b-b3ba-c2f9bab6b2c3 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:03.605183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29664736-8216-4d27-8583-746b320f5bab tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:03.606164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29664736-8216-4d27-8583-746b320f5bab tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:03.607297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29664736-8216-4d27-8583-746b320f5bab tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:03.609670 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29664736-8216-4d27-8583-746b320f5bab tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:03.616337 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6a54ab3-e6ae-406b-b3ba-c2f9bab6b2c3 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:03.617341 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6a54ab3-e6ae-406b-b3ba-c2f9bab6b2c3 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:03.618051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6a54ab3-e6ae-406b-b3ba-c2f9bab6b2c3 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:03.618949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6a54ab3-e6ae-406b-b3ba-c2f9bab6b2c3 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:03.619713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6a54ab3-e6ae-406b-b3ba-c2f9bab6b2c3 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:03.620407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6a54ab3-e6ae-406b-b3ba-c2f9bab6b2c3 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:03.742204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-e6a54ab3-e6ae-406b-b3ba-c2f9bab6b2c3 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lazy-loading 'services' on Instance uuid 3576fbd4-5c72-4025-a40c-e0e1ad348acc {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:03.748169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:03.777491 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e6a54ab3-e6ae-406b-b3ba-c2f9bab6b2c3 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1927 microversion: 2.75 time: 0.178319 Aug 24 10:20:03.796349 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1100/2003] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:03 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1927 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:03.812553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b87ed15c-252e-4baa-8145-ce20fbeb2a85 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '.version_select at 0x7f465a242ee0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:03.861347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:03.878534 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b87ed15c-252e-4baa-8145-ce20fbeb2a85 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-343863797" status: 202 len: 0 microversion: 2.1 time: 0.081742 Aug 24 10:20:03.883276 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1101/2004] 10.222.0.85 () {58 vars in 1218 bytes} [Wed Aug 24 10:20:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-343863797 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:20:03.908397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7a706c8a-bd43-4fc4-85a7-45d0d3b52319 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:03.910488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7a706c8a-bd43-4fc4-85a7-45d0d3b52319 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:03.919679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a706c8a-bd43-4fc4-85a7-45d0d3b52319 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:03.924313 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a706c8a-bd43-4fc4-85a7-45d0d3b52319 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:03.930678 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a706c8a-bd43-4fc4-85a7-45d0d3b52319 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:03.931742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a706c8a-bd43-4fc4-85a7-45d0d3b52319 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:03.932386 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a706c8a-bd43-4fc4-85a7-45d0d3b52319 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:03.933003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a706c8a-bd43-4fc4-85a7-45d0d3b52319 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:04.173624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-7a706c8a-bd43-4fc4-85a7-45d0d3b52319 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lazy-loading 'services' on Instance uuid 4d844e7a-a6af-4c55-957c-a997c42927af {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:04.203559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-29664736-8216-4d27-8583-746b320f5bab tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:04.236774 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-29664736-8216-4d27-8583-746b320f5bab tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28" status: 200 len: 1317 microversion: 2.1 time: 0.691980 Aug 24 10:20:04.237216 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 904/2005] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:03 2022] GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28 => generated 1317 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:04.252071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-71ac1d19-a556-4818-ae3f-ce7d1a09b73c req-69373bd1-f60d-462d-98f4-236a538ba08e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb", "name": "network-vif-plugged", "status": "completed", "tag": "c181228f-fe7e-4a76-bb5e-18f9995613d1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:04.277349 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-71ac1d19-a556-4818-ae3f-ce7d1a09b73c req-69373bd1-f60d-462d-98f4-236a538ba08e service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:04.278122 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-71ac1d19-a556-4818-ae3f-ce7d1a09b73c req-69373bd1-f60d-462d-98f4-236a538ba08e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:04.278896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-71ac1d19-a556-4818-ae3f-ce7d1a09b73c req-69373bd1-f60d-462d-98f4-236a538ba08e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:04.302069 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-71ac1d19-a556-4818-ae3f-ce7d1a09b73c req-69373bd1-f60d-462d-98f4-236a538ba08e service nova] Creating event network-vif-plugged:c181228f-fe7e-4a76-bb5e-18f9995613d1 for instance fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb on n-h1-849328-3 Aug 24 10:20:04.310778 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7a706c8a-bd43-4fc4-85a7-45d0d3b52319 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "DELETE /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af/os-volume_attachments/61038307-d000-4f73-8020-d1771d051ad4" status: 202 len: 0 microversion: 2.1 time: 0.425462 Aug 24 10:20:04.312050 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1102/2006] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Aug 24 10:20:03 2022] DELETE /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af/os-volume_attachments/61038307-d000-4f73-8020-d1771d051ad4 => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:20:04.316285 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-71ac1d19-a556-4818-ae3f-ce7d1a09b73c req-69373bd1-f60d-462d-98f4-236a538ba08e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072387 Aug 24 10:20:04.320517 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 905/2007] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:04.329015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e9207b10-7099-4d89-9a1b-81982974cba4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:04.332336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e9207b10-7099-4d89-9a1b-81982974cba4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:04.335257 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b1b1e4b1-c44d-4bf4-afc1-15fb60451743 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:04.344468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b1b1e4b1-c44d-4bf4-afc1-15fb60451743 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] [instance: e5cf9540-fba0-498d-890d-af316b16ceff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:04.346842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9207b10-7099-4d89-9a1b-81982974cba4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:04.347245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9207b10-7099-4d89-9a1b-81982974cba4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:04.348428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9207b10-7099-4d89-9a1b-81982974cba4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:04.351124 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9207b10-7099-4d89-9a1b-81982974cba4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:04.351514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9207b10-7099-4d89-9a1b-81982974cba4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:04.352434 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9207b10-7099-4d89-9a1b-81982974cba4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:04.363573 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1b1e4b1-c44d-4bf4-afc1-15fb60451743 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:04.364073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1b1e4b1-c44d-4bf4-afc1-15fb60451743 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:04.364589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1b1e4b1-c44d-4bf4-afc1-15fb60451743 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:04.365341 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1b1e4b1-c44d-4bf4-afc1-15fb60451743 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:04.365798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1b1e4b1-c44d-4bf4-afc1-15fb60451743 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:04.366270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1b1e4b1-c44d-4bf4-afc1-15fb60451743 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:04.415286 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e9207b10-7099-4d89-9a1b-81982974cba4 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092548 Aug 24 10:20:04.415784 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 906/2008] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:20:04 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:04.546736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b1b1e4b1-c44d-4bf4-afc1-15fb60451743 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e52ac750849e4207bbc6e320210bb2b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823f96998a0341559f6a637f9a5b840c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:04.571260 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4576da6b-c5e6-480a-9deb-488c04daea64 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:04.572357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4576da6b-c5e6-480a-9deb-488c04daea64 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:04.572891 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b1b1e4b1-c44d-4bf4-afc1-15fb60451743 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff" status: 200 len: 1280 microversion: 2.1 time: 0.259174 Aug 24 10:20:04.573666 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1103/2009] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:04 2022] GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff => generated 1280 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:04.624331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4576da6b-c5e6-480a-9deb-488c04daea64 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:04.625225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4576da6b-c5e6-480a-9deb-488c04daea64 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:04.626015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4576da6b-c5e6-480a-9deb-488c04daea64 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:04.627255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4576da6b-c5e6-480a-9deb-488c04daea64 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:04.628221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4576da6b-c5e6-480a-9deb-488c04daea64 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:04.642357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4576da6b-c5e6-480a-9deb-488c04daea64 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:04.839200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6819d13a-d104-4f2b-83cb-d2c8df4c3fb8 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:04.841922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6819d13a-d104-4f2b-83cb-d2c8df4c3fb8 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:04.859653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6819d13a-d104-4f2b-83cb-d2c8df4c3fb8 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:04.860772 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6819d13a-d104-4f2b-83cb-d2c8df4c3fb8 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:04.862159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6819d13a-d104-4f2b-83cb-d2c8df4c3fb8 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:04.863690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6819d13a-d104-4f2b-83cb-d2c8df4c3fb8 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:04.864946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6819d13a-d104-4f2b-83cb-d2c8df4c3fb8 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:04.866184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6819d13a-d104-4f2b-83cb-d2c8df4c3fb8 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:05.009795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-6819d13a-d104-4f2b-83cb-d2c8df4c3fb8 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lazy-loading 'services' on Instance uuid 3576fbd4-5c72-4025-a40c-e0e1ad348acc {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:05.061431 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6819d13a-d104-4f2b-83cb-d2c8df4c3fb8 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1927 microversion: 2.75 time: 0.228369 Aug 24 10:20:05.064931 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1104/2010] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:04 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1927 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:05.086435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-11ca6e02-c147-44ac-9c85-ea8199b4ec31 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '.version_select at 0x7f465a207700>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:05.125945 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-11ca6e02-c147-44ac-9c85-ea8199b4ec31 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] HTTP exception thrown: Image not found. Aug 24 10:20:05.134538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-11ca6e02-c147-44ac-9c85-ea8199b4ec31 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Request method failure captured: Aug 24 10:20:05.134538 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/images/eb6fb396-8864-45e4-a198-73118e4d76e9 HTTP/1.1 Aug 24 10:20:05.134538 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:20:05.134538 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:20:05.134538 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:20:05.134538 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:20:05.134538 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:20:05.134538 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:20:05.134538 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:20:05.134538 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:20:05.134538 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfrThttCsJVn6ZYJ5IPHV9fokEqNFKnmNalLL8nZmf_ei5N3zrV08QH1KmLggfkmBKerwFjLosb49uBsjyVeSxt3NJxRyvR4_2es1MonVPd0vwRK6vdPZfvD2BRibktcybuLmMjpd59h5dgQc8Mlu-A4JR-WB_EJM5jyYx0kRVbI5dw Aug 24 10:20:05.134538 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:20:05.134538 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:20:05.134538 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:20:05.134538 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:20:05.134538 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:20:05.134538 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:20:05.134538 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 014076c393b148618aa03e8e8a0d5be7 Aug 24 10:20:05.134538 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:20:05.134538 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:20:05.134538 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:20:05.136270 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/014076c393b148618aa03e8e8a0d5be7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_014076c393b148618aa03e8e8a0d5be7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/014076c393b148618aa03e8e8a0d5be7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/014076c393b148618aa03e8e8a0d5be7"}]}] Aug 24 10:20:05.136270 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:20:05.136270 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 014076c393b148618aa03e8e8a0d5be7 Aug 24 10:20:05.136270 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:20:05.136270 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesOneServerNegativeTestJSON-949139278-project Aug 24 10:20:05.136270 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:20:05.136270 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:20:05.136270 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: a9111f8a2bae4e25a353ebb15eca2d5a Aug 24 10:20:05.136270 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-949139278-project Aug 24 10:20:05.136270 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:20:05.136270 n-d-849328-3 devstack@n-api.service[122433]: exception: Image not found. Aug 24 10:20:05.136270 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'eb6fb396-8864-45e4-a198-73118e4d76e9'} Aug 24 10:20:05.136270 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:20:05.137553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:05.137553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 10:20:05.137553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 10:20:05.137553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:20:05.137553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:20:05.137553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:20:05.137553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:20:05.137553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 10:20:05.137553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 10:20:05.137553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 10:20:05.137553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 10:20:05.137553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:20:05.137553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:20:05.137553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:20:05.137553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:20:05.137553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image eb6fb396-8864-45e4-a198-73118e4d76e9 to delete Aug 24 10:20:05.137553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:05.137553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:05.137553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:05.140277 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:05.140277 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 10:20:05.140277 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 10:20:05.140277 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 10:20:05.140277 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 10:20:05.140277 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 10:20:05.140277 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 10:20:05.140277 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image eb6fb396-8864-45e4-a198-73118e4d76e9 could not be found. Aug 24 10:20:05.140277 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:05.140277 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:05.140277 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:05.140277 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:05.140277 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:05.140277 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:05.140277 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:20:05.140277 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:20:05.140277 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:20:05.140277 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:20:05.140277 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:20:05.140277 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:20:05.148579 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 10:20:05.148579 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 10:20:05.148579 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 10:20:05.148579 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:05.148579 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:05.148579 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:05.148579 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:05.148579 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:05.148579 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:05.148579 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:20:05.148579 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:20:05.148579 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 10:20:05.148579 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:05.148579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-11ca6e02-c147-44ac-9c85-ea8199b4ec31 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Returning 404 to user: Image not found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:20:05.148579 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-11ca6e02-c147-44ac-9c85-ea8199b4ec31 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "DELETE /compute/v2.1/images/eb6fb396-8864-45e4-a198-73118e4d76e9" status: 404 len: 62 microversion: 2.1 time: 0.070452 Aug 24 10:20:05.157550 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1105/2011] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:05 2022] DELETE /compute/v2.1/images/eb6fb396-8864-45e4-a198-73118e4d76e9 => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 10:20:05.168834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0dafafcd-49b7-4e81-85d6-a508104e2738 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:05.169664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0dafafcd-49b7-4e81-85d6-a508104e2738 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:05.196626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0dafafcd-49b7-4e81-85d6-a508104e2738 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:05.197474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0dafafcd-49b7-4e81-85d6-a508104e2738 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:05.213913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0dafafcd-49b7-4e81-85d6-a508104e2738 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:05.215702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0dafafcd-49b7-4e81-85d6-a508104e2738 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:05.216679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0dafafcd-49b7-4e81-85d6-a508104e2738 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:05.217479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0dafafcd-49b7-4e81-85d6-a508104e2738 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:05.245578 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-0dafafcd-49b7-4e81-85d6-a508104e2738 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] HTTP exception thrown: Instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 could not be found. Aug 24 10:20:05.248395 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0dafafcd-49b7-4e81-85d6-a508104e2738 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Request method failure captured: Aug 24 10:20:05.248395 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 HTTP/1.1 Aug 24 10:20:05.248395 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:20:05.248395 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:20:05.248395 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:20:05.248395 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:20:05.248395 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:20:05.248395 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:20:05.248395 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:20:05.248395 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:20:05.248395 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfrThttCsJVn6ZYJ5IPHV9fokEqNFKnmNalLL8nZmf_ei5N3zrV08QH1KmLggfkmBKerwFjLosb49uBsjyVeSxt3NJxRyvR4_2es1MonVPd0vwRK6vdPZfvD2BRibktcybuLmMjpd59h5dgQc8Mlu-A4JR-WB_EJM5jyYx0kRVbI5dw Aug 24 10:20:05.248395 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:20:05.248395 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:20:05.248395 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:20:05.248395 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:20:05.248395 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:20:05.248395 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:20:05.248395 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 014076c393b148618aa03e8e8a0d5be7 Aug 24 10:20:05.248395 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:20:05.248395 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:20:05.248395 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:20:05.250439 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/014076c393b148618aa03e8e8a0d5be7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_014076c393b148618aa03e8e8a0d5be7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/014076c393b148618aa03e8e8a0d5be7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/014076c393b148618aa03e8e8a0d5be7"}]}] Aug 24 10:20:05.250439 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:20:05.250439 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 014076c393b148618aa03e8e8a0d5be7 Aug 24 10:20:05.250439 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:20:05.250439 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesOneServerNegativeTestJSON-949139278-project Aug 24 10:20:05.250439 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:20:05.250439 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:20:05.250439 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: a9111f8a2bae4e25a353ebb15eca2d5a Aug 24 10:20:05.250439 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-949139278-project Aug 24 10:20:05.250439 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:20:05.250439 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 could not be found. Aug 24 10:20:05.250439 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'd2ed58ac-b16a-4f31-9394-f65217aea1d3'} Aug 24 10:20:05.251654 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:20:05.251654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:05.251654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:20:05.251654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:20:05.251654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:20:05.251654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:20:05.251654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:20:05.251654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:20:05.251654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:20:05.251654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:20:05.251654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 could not be found. Aug 24 10:20:05.251654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:05.251654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:05.251654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:05.251654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:05.251654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:05.251654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:05.251654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:20:05.251654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:20:05.251654 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:20:05.254998 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:20:05.254998 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:20:05.254998 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:20:05.254998 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:20:05.254998 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:20:05.254998 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:20:05.254998 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:20:05.254998 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:20:05.254998 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:20:05.254998 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 could not be found. Aug 24 10:20:05.254998 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:05.254998 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:05.254998 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:05.254998 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:05.254998 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:05.254998 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:05.254998 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:20:05.254998 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:20:05.254998 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 could not be found. Aug 24 10:20:05.254998 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:05.261046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0dafafcd-49b7-4e81-85d6-a508104e2738 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Returning 404 to user: Instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:20:05.262779 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0dafafcd-49b7-4e81-85d6-a508104e2738 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 404 len: 111 microversion: 2.1 time: 0.103695 Aug 24 10:20:05.264008 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1106/2012] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:20:05 2022] DELETE /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:20:05.273948 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-209ada87-d238-4a0d-8d25-57d751e6b6b1 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:05.275306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-209ada87-d238-4a0d-8d25-57d751e6b6b1 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: 8a4ddf34-af18-4e02-a306-c1c67f5c0b28] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:05.289255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-209ada87-d238-4a0d-8d25-57d751e6b6b1 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:05.290213 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-209ada87-d238-4a0d-8d25-57d751e6b6b1 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:05.292550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-209ada87-d238-4a0d-8d25-57d751e6b6b1 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:05.293650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-209ada87-d238-4a0d-8d25-57d751e6b6b1 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:05.295157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-209ada87-d238-4a0d-8d25-57d751e6b6b1 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:05.295864 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-209ada87-d238-4a0d-8d25-57d751e6b6b1 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:05.574022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-209ada87-d238-4a0d-8d25-57d751e6b6b1 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:05.585233 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-209ada87-d238-4a0d-8d25-57d751e6b6b1 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28" status: 200 len: 1317 microversion: 2.1 time: 0.319645 Aug 24 10:20:05.586522 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1107/2013] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:05 2022] GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28 => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:05.593519 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d1881ddb-dde6-4c1f-81ba-92aa306c73d7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:05.594488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d1881ddb-dde6-4c1f-81ba-92aa306c73d7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] [instance: d2ed58ac-b16a-4f31-9394-f65217aea1d3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:05.601480 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1881ddb-dde6-4c1f-81ba-92aa306c73d7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:05.602775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1881ddb-dde6-4c1f-81ba-92aa306c73d7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:05.603491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1881ddb-dde6-4c1f-81ba-92aa306c73d7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:05.604900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1881ddb-dde6-4c1f-81ba-92aa306c73d7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:05.605847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1881ddb-dde6-4c1f-81ba-92aa306c73d7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:05.606476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1881ddb-dde6-4c1f-81ba-92aa306c73d7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:05.625455 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-d1881ddb-dde6-4c1f-81ba-92aa306c73d7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] HTTP exception thrown: Instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 could not be found. Aug 24 10:20:05.628161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d1881ddb-dde6-4c1f-81ba-92aa306c73d7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Request method failure captured: Aug 24 10:20:05.628161 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 HTTP/1.1 Aug 24 10:20:05.628161 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:20:05.628161 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:20:05.628161 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:20:05.628161 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:20:05.628161 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:20:05.628161 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:20:05.628161 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:20:05.628161 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:20:05.628161 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfrThttCsJVn6ZYJ5IPHV9fokEqNFKnmNalLL8nZmf_ei5N3zrV08QH1KmLggfkmBKerwFjLosb49uBsjyVeSxt3NJxRyvR4_2es1MonVPd0vwRK6vdPZfvD2BRibktcybuLmMjpd59h5dgQc8Mlu-A4JR-WB_EJM5jyYx0kRVbI5dw Aug 24 10:20:05.628161 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:20:05.628161 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:20:05.628161 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:20:05.628161 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:20:05.628161 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:20:05.628161 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:20:05.628161 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 014076c393b148618aa03e8e8a0d5be7 Aug 24 10:20:05.628161 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:20:05.628161 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:20:05.628161 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:20:05.630063 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/014076c393b148618aa03e8e8a0d5be7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_014076c393b148618aa03e8e8a0d5be7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/014076c393b148618aa03e8e8a0d5be7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/014076c393b148618aa03e8e8a0d5be7"}]}] Aug 24 10:20:05.630063 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:20:05.630063 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 014076c393b148618aa03e8e8a0d5be7 Aug 24 10:20:05.630063 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-949139278 Aug 24 10:20:05.630063 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesOneServerNegativeTestJSON-949139278-project Aug 24 10:20:05.630063 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:20:05.630063 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:20:05.630063 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: a9111f8a2bae4e25a353ebb15eca2d5a Aug 24 10:20:05.630063 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-949139278-project Aug 24 10:20:05.630063 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:20:05.630063 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 could not be found. Aug 24 10:20:05.630063 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'd2ed58ac-b16a-4f31-9394-f65217aea1d3'} Aug 24 10:20:05.633537 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:20:05.633537 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:05.633537 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:20:05.633537 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:20:05.633537 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:20:05.633537 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:20:05.633537 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:20:05.633537 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:20:05.633537 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:20:05.633537 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:20:05.633537 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 could not be found. Aug 24 10:20:05.633537 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:05.633537 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:05.633537 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:05.633537 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:05.633537 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:05.633537 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:05.633537 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:20:05.633537 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:20:05.633537 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:20:05.636231 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:20:05.636231 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:20:05.636231 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:20:05.636231 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:20:05.636231 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:20:05.636231 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:20:05.636231 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:20:05.636231 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 could not be found. Aug 24 10:20:05.636231 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:05.636231 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:05.636231 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:05.636231 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:05.636231 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:05.636231 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:05.636231 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:20:05.636231 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:20:05.636231 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 could not be found. Aug 24 10:20:05.636231 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:05.638220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d1881ddb-dde6-4c1f-81ba-92aa306c73d7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] Returning 404 to user: Instance d2ed58ac-b16a-4f31-9394-f65217aea1d3 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:20:05.638220 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d1881ddb-dde6-4c1f-81ba-92aa306c73d7 tempest-ImagesOneServerNegativeTestJSON-949139278 tempest-ImagesOneServerNegativeTestJSON-949139278-project] 10.222.0.85 "GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3" status: 404 len: 111 microversion: 2.1 time: 0.043163 Aug 24 10:20:05.641995 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1108/2014] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:05 2022] GET /compute/v2.1/servers/d2ed58ac-b16a-4f31-9394-f65217aea1d3 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:20:05.647938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-643d1d1c-4ad9-47fa-b651-e24856501913 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:05.663280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-643d1d1c-4ad9-47fa-b651-e24856501913 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:05.673369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-643d1d1c-4ad9-47fa-b651-e24856501913 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:05.673879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-643d1d1c-4ad9-47fa-b651-e24856501913 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:05.674328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-643d1d1c-4ad9-47fa-b651-e24856501913 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:05.675426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-643d1d1c-4ad9-47fa-b651-e24856501913 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:05.676052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-643d1d1c-4ad9-47fa-b651-e24856501913 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:05.676640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-643d1d1c-4ad9-47fa-b651-e24856501913 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:05.808856 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-643d1d1c-4ad9-47fa-b651-e24856501913 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162874 Aug 24 10:20:05.810269 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1109/2015] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:20:05 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:05.856027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-82429a69-799e-4689-afd5-09c6d1b86e6d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:05.861304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-82429a69-799e-4689-afd5-09c6d1b86e6d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] [instance: e5cf9540-fba0-498d-890d-af316b16ceff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:05.884168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82429a69-799e-4689-afd5-09c6d1b86e6d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:05.884673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82429a69-799e-4689-afd5-09c6d1b86e6d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:05.885176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82429a69-799e-4689-afd5-09c6d1b86e6d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:05.890342 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82429a69-799e-4689-afd5-09c6d1b86e6d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:05.894232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82429a69-799e-4689-afd5-09c6d1b86e6d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:05.894712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82429a69-799e-4689-afd5-09c6d1b86e6d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:05.963288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4576da6b-c5e6-480a-9deb-488c04daea64 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:05.981775 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4576da6b-c5e6-480a-9deb-488c04daea64 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b" status: 200 len: 1318 microversion: 2.1 time: 1.417452 Aug 24 10:20:05.995320 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 907/2016] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:04 2022] GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b => generated 1318 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:06.102014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-82429a69-799e-4689-afd5-09c6d1b86e6d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e52ac750849e4207bbc6e320210bb2b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823f96998a0341559f6a637f9a5b840c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:06.103418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-56d692ad-7e1c-417b-9b32-ef5a2589c09f tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:06.104240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-56d692ad-7e1c-417b-9b32-ef5a2589c09f tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:06.114883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56d692ad-7e1c-417b-9b32-ef5a2589c09f tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:06.115673 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56d692ad-7e1c-417b-9b32-ef5a2589c09f tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:06.116378 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-82429a69-799e-4689-afd5-09c6d1b86e6d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff" status: 200 len: 1334 microversion: 2.1 time: 0.301512 Aug 24 10:20:06.116738 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56d692ad-7e1c-417b-9b32-ef5a2589c09f tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:06.129152 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1110/2017] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:05 2022] GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff => generated 1334 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:06.132475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56d692ad-7e1c-417b-9b32-ef5a2589c09f tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:06.135373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56d692ad-7e1c-417b-9b32-ef5a2589c09f tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:06.136324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56d692ad-7e1c-417b-9b32-ef5a2589c09f tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:06.328448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-56d692ad-7e1c-417b-9b32-ef5a2589c09f tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lazy-loading 'services' on Instance uuid 3576fbd4-5c72-4025-a40c-e0e1ad348acc {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:06.371493 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-56d692ad-7e1c-417b-9b32-ef5a2589c09f tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1927 microversion: 2.75 time: 0.273833 Aug 24 10:20:06.386428 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 908/2018] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:06 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1927 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:06.616920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8d93fb57-85de-4246-a3ad-d294889ef386 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:06.620254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8d93fb57-85de-4246-a3ad-d294889ef386 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: 8a4ddf34-af18-4e02-a306-c1c67f5c0b28] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:06.641542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d93fb57-85de-4246-a3ad-d294889ef386 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:06.655137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d93fb57-85de-4246-a3ad-d294889ef386 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:06.661867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d93fb57-85de-4246-a3ad-d294889ef386 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:06.662988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d93fb57-85de-4246-a3ad-d294889ef386 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:06.672591 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d93fb57-85de-4246-a3ad-d294889ef386 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:06.673771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d93fb57-85de-4246-a3ad-d294889ef386 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:06.825763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-53fd01d7-aaa7-42da-900a-0b0f3955966d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:06.828432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-53fd01d7-aaa7-42da-900a-0b0f3955966d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:06.845763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53fd01d7-aaa7-42da-900a-0b0f3955966d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:06.846262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53fd01d7-aaa7-42da-900a-0b0f3955966d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:06.846706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53fd01d7-aaa7-42da-900a-0b0f3955966d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:06.847429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53fd01d7-aaa7-42da-900a-0b0f3955966d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:06.847884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53fd01d7-aaa7-42da-900a-0b0f3955966d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:06.848466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53fd01d7-aaa7-42da-900a-0b0f3955966d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:06.891250 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-53fd01d7-aaa7-42da-900a-0b0f3955966d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070647 Aug 24 10:20:06.892481 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 909/2019] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:20:06 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:07.036018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3b8e6b49-7aa8-4ee7-8884-980f8f5eb65b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:07.037425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3b8e6b49-7aa8-4ee7-8884-980f8f5eb65b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:07.047031 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b8e6b49-7aa8-4ee7-8884-980f8f5eb65b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:07.052115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b8e6b49-7aa8-4ee7-8884-980f8f5eb65b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:07.052890 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b8e6b49-7aa8-4ee7-8884-980f8f5eb65b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:07.054261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b8e6b49-7aa8-4ee7-8884-980f8f5eb65b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:07.056108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b8e6b49-7aa8-4ee7-8884-980f8f5eb65b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:07.060898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b8e6b49-7aa8-4ee7-8884-980f8f5eb65b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:07.182013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8d93fb57-85de-4246-a3ad-d294889ef386 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:07.199909 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8d93fb57-85de-4246-a3ad-d294889ef386 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28" status: 200 len: 1317 microversion: 2.1 time: 0.588094 Aug 24 10:20:07.201012 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1111/2020] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:06 2022] GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28 => generated 1317 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:07.240929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6d7cb7ad-dce9-4ba5-a57d-02ffe10d7d36 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:07.247103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6d7cb7ad-dce9-4ba5-a57d-02ffe10d7d36 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] [instance: e5cf9540-fba0-498d-890d-af316b16ceff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:07.299902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d7cb7ad-dce9-4ba5-a57d-02ffe10d7d36 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:07.300790 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d7cb7ad-dce9-4ba5-a57d-02ffe10d7d36 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:07.306524 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d7cb7ad-dce9-4ba5-a57d-02ffe10d7d36 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:07.307575 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d7cb7ad-dce9-4ba5-a57d-02ffe10d7d36 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:07.308075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d7cb7ad-dce9-4ba5-a57d-02ffe10d7d36 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:07.308531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d7cb7ad-dce9-4ba5-a57d-02ffe10d7d36 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:07.447096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6d7cb7ad-dce9-4ba5-a57d-02ffe10d7d36 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e52ac750849e4207bbc6e320210bb2b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823f96998a0341559f6a637f9a5b840c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:07.460577 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6d7cb7ad-dce9-4ba5-a57d-02ffe10d7d36 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff" status: 200 len: 1334 microversion: 2.1 time: 0.254428 Aug 24 10:20:07.478767 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1112/2021] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:07 2022] GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff => generated 1334 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:07.485422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-395df4bb-81d9-4f35-8764-02f24c49ec22 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:07.486054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-395df4bb-81d9-4f35-8764-02f24c49ec22 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:07.494029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-395df4bb-81d9-4f35-8764-02f24c49ec22 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:07.494530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-395df4bb-81d9-4f35-8764-02f24c49ec22 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:07.495033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-395df4bb-81d9-4f35-8764-02f24c49ec22 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:07.495777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-395df4bb-81d9-4f35-8764-02f24c49ec22 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:07.496250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-395df4bb-81d9-4f35-8764-02f24c49ec22 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:07.499368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-395df4bb-81d9-4f35-8764-02f24c49ec22 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:07.664203 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-395df4bb-81d9-4f35-8764-02f24c49ec22 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lazy-loading 'services' on Instance uuid 3576fbd4-5c72-4025-a40c-e0e1ad348acc {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:07.705615 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-395df4bb-81d9-4f35-8764-02f24c49ec22 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1927 microversion: 2.75 time: 0.225268 Aug 24 10:20:07.707349 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1113/2022] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:07 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1927 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:07.737923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3b8e6b49-7aa8-4ee7-8884-980f8f5eb65b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:07.757574 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3b8e6b49-7aa8-4ee7-8884-980f8f5eb65b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b" status: 200 len: 1318 microversion: 2.1 time: 0.721665 Aug 24 10:20:07.759497 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 910/2023] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:07 2022] GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b => generated 1318 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:20:07.907047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-36642560-2df1-4227-8aeb-80903dd8742a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:07.909371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-36642560-2df1-4227-8aeb-80903dd8742a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:07.927733 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36642560-2df1-4227-8aeb-80903dd8742a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:07.928265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36642560-2df1-4227-8aeb-80903dd8742a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:07.928707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36642560-2df1-4227-8aeb-80903dd8742a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:07.933904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36642560-2df1-4227-8aeb-80903dd8742a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:07.934370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36642560-2df1-4227-8aeb-80903dd8742a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:07.935142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36642560-2df1-4227-8aeb-80903dd8742a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:07.999163 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-36642560-2df1-4227-8aeb-80903dd8742a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096291 Aug 24 10:20:08.000583 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1114/2024] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:20:07 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:20:08.237311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eef9325b-090e-4ab4-af7f-abe6282e7cf2 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:08.239600 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eef9325b-090e-4ab4-af7f-abe6282e7cf2 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: 8a4ddf34-af18-4e02-a306-c1c67f5c0b28] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:08.262395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eef9325b-090e-4ab4-af7f-abe6282e7cf2 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:08.263230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eef9325b-090e-4ab4-af7f-abe6282e7cf2 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:08.269389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eef9325b-090e-4ab4-af7f-abe6282e7cf2 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:08.270803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eef9325b-090e-4ab4-af7f-abe6282e7cf2 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:08.271476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eef9325b-090e-4ab4-af7f-abe6282e7cf2 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:08.272251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eef9325b-090e-4ab4-af7f-abe6282e7cf2 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:08.320091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-7191b6b1-d22e-4432-a81d-b8331cbcea02 req-c87d10f0-b519-48c2-ab5e-3771277a9e32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ab167e-c8c7-417d-bc49-e9b8ccb8b06b", "name": "network-vif-plugged", "status": "completed", "tag": "c8226ca9-d3ae-4597-b639-5cf9aee131e9"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:08.350282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7191b6b1-d22e-4432-a81d-b8331cbcea02 req-c87d10f0-b519-48c2-ab5e-3771277a9e32 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:08.350771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7191b6b1-d22e-4432-a81d-b8331cbcea02 req-c87d10f0-b519-48c2-ab5e-3771277a9e32 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:08.351458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7191b6b1-d22e-4432-a81d-b8331cbcea02 req-c87d10f0-b519-48c2-ab5e-3771277a9e32 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:08.404234 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-7191b6b1-d22e-4432-a81d-b8331cbcea02 req-c87d10f0-b519-48c2-ab5e-3771277a9e32 service nova] Creating event network-vif-plugged:c8226ca9-d3ae-4597-b639-5cf9aee131e9 for instance 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b on n-h1-849328-3 Aug 24 10:20:08.420377 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-7191b6b1-d22e-4432-a81d-b8331cbcea02 req-c87d10f0-b519-48c2-ab5e-3771277a9e32 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105392 Aug 24 10:20:08.422121 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1115/2025] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:08.498247 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-98ff393f-a326-4f0b-b9c9-a602b9c4b19d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:08.499590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-98ff393f-a326-4f0b-b9c9-a602b9c4b19d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] [instance: e5cf9540-fba0-498d-890d-af316b16ceff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:08.537361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98ff393f-a326-4f0b-b9c9-a602b9c4b19d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:08.542035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98ff393f-a326-4f0b-b9c9-a602b9c4b19d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:08.543298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98ff393f-a326-4f0b-b9c9-a602b9c4b19d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:08.546907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98ff393f-a326-4f0b-b9c9-a602b9c4b19d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:08.549108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98ff393f-a326-4f0b-b9c9-a602b9c4b19d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:08.549915 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98ff393f-a326-4f0b-b9c9-a602b9c4b19d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:08.748686 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-98ff393f-a326-4f0b-b9c9-a602b9c4b19d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e52ac750849e4207bbc6e320210bb2b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823f96998a0341559f6a637f9a5b840c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:08.770462 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-98ff393f-a326-4f0b-b9c9-a602b9c4b19d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff" status: 200 len: 1334 microversion: 2.1 time: 0.287582 Aug 24 10:20:08.772149 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1116/2026] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:08 2022] GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff => generated 1334 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:20:08.791272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c38edb08-e82d-4201-852d-df3737935bd0 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:08.792292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c38edb08-e82d-4201-852d-df3737935bd0 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:08.803236 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c38edb08-e82d-4201-852d-df3737935bd0 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:08.804082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c38edb08-e82d-4201-852d-df3737935bd0 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:08.804879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c38edb08-e82d-4201-852d-df3737935bd0 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:08.806178 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c38edb08-e82d-4201-852d-df3737935bd0 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:08.807436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c38edb08-e82d-4201-852d-df3737935bd0 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:08.808285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c38edb08-e82d-4201-852d-df3737935bd0 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:09.383759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eef9325b-090e-4ab4-af7f-abe6282e7cf2 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:09.431036 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eef9325b-090e-4ab4-af7f-abe6282e7cf2 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28" status: 200 len: 1317 microversion: 2.1 time: 1.200367 Aug 24 10:20:09.442339 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 911/2027] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:08 2022] GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28 => generated 1317 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:09.477272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-18276c51-eeea-442f-93e6-35bfb2e8de3a tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:09.478790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-18276c51-eeea-442f-93e6-35bfb2e8de3a tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:09.490886 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18276c51-eeea-442f-93e6-35bfb2e8de3a tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:09.497086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18276c51-eeea-442f-93e6-35bfb2e8de3a tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:09.498355 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18276c51-eeea-442f-93e6-35bfb2e8de3a tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:09.499896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18276c51-eeea-442f-93e6-35bfb2e8de3a tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:09.504011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18276c51-eeea-442f-93e6-35bfb2e8de3a tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:09.505003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18276c51-eeea-442f-93e6-35bfb2e8de3a tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:09.649838 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-c38edb08-e82d-4201-852d-df3737935bd0 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lazy-loading 'services' on Instance uuid 3576fbd4-5c72-4025-a40c-e0e1ad348acc {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:09.699659 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c38edb08-e82d-4201-852d-df3737935bd0 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1927 microversion: 2.75 time: 0.923821 Aug 24 10:20:09.702627 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1117/2028] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:08 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1927 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:09.711030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fd0c423d-82c1-4375-907d-46af19030a6e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:09.719477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fd0c423d-82c1-4375-907d-46af19030a6e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:09.734135 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd0c423d-82c1-4375-907d-46af19030a6e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:09.736063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd0c423d-82c1-4375-907d-46af19030a6e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:09.737290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd0c423d-82c1-4375-907d-46af19030a6e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:09.738802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd0c423d-82c1-4375-907d-46af19030a6e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:09.741651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd0c423d-82c1-4375-907d-46af19030a6e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:09.742329 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd0c423d-82c1-4375-907d-46af19030a6e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:09.923000 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fd0c423d-82c1-4375-907d-46af19030a6e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.217662 Aug 24 10:20:09.934293 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1118/2029] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:20:09 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af/os-volume_attachments => generated 197 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:09.949972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ca9aa868-9764-411e-9a5e-1de31e4fd46d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:09.951051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ca9aa868-9764-411e-9a5e-1de31e4fd46d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] [instance: e5cf9540-fba0-498d-890d-af316b16ceff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:09.967048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca9aa868-9764-411e-9a5e-1de31e4fd46d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:09.970086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca9aa868-9764-411e-9a5e-1de31e4fd46d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:09.970968 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca9aa868-9764-411e-9a5e-1de31e4fd46d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:09.977351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca9aa868-9764-411e-9a5e-1de31e4fd46d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:09.978218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca9aa868-9764-411e-9a5e-1de31e4fd46d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:09.979005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca9aa868-9764-411e-9a5e-1de31e4fd46d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:10.216285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ca9aa868-9764-411e-9a5e-1de31e4fd46d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e52ac750849e4207bbc6e320210bb2b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823f96998a0341559f6a637f9a5b840c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:10.236446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:10.256488 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ca9aa868-9764-411e-9a5e-1de31e4fd46d tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff" status: 200 len: 1334 microversion: 2.1 time: 0.308108 Aug 24 10:20:10.269709 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1119/2030] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:09 2022] GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff => generated 1334 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:10.472535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-765d657e-a773-45e9-87ee-6f75f3ce1f48 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:10.473188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-765d657e-a773-45e9-87ee-6f75f3ce1f48 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: 8a4ddf34-af18-4e02-a306-c1c67f5c0b28] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:10.494511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-765d657e-a773-45e9-87ee-6f75f3ce1f48 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:10.495005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-765d657e-a773-45e9-87ee-6f75f3ce1f48 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:10.497869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-765d657e-a773-45e9-87ee-6f75f3ce1f48 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:10.501536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-765d657e-a773-45e9-87ee-6f75f3ce1f48 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:10.502047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-765d657e-a773-45e9-87ee-6f75f3ce1f48 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:10.506849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-765d657e-a773-45e9-87ee-6f75f3ce1f48 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:10.648014 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-18276c51-eeea-442f-93e6-35bfb2e8de3a tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:10.682440 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-18276c51-eeea-442f-93e6-35bfb2e8de3a tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b" status: 200 len: 1318 microversion: 2.1 time: 1.225076 Aug 24 10:20:10.690781 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 912/2031] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:09 2022] GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b => generated 1318 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:10.713268 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-657d857b-8cbd-42f3-b8b1-2974a5909ca0 req-437fafd5-7646-4be6-9471-fb31a0dabfc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a4ddf34-af18-4e02-a306-c1c67f5c0b28", "name": "network-vif-plugged", "status": "completed", "tag": "21445c55-f24c-46da-9946-53b2566a219f"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:10.757401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-657d857b-8cbd-42f3-b8b1-2974a5909ca0 req-437fafd5-7646-4be6-9471-fb31a0dabfc0 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:10.757937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-657d857b-8cbd-42f3-b8b1-2974a5909ca0 req-437fafd5-7646-4be6-9471-fb31a0dabfc0 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:10.758296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-657d857b-8cbd-42f3-b8b1-2974a5909ca0 req-437fafd5-7646-4be6-9471-fb31a0dabfc0 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:10.804480 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-657d857b-8cbd-42f3-b8b1-2974a5909ca0 req-437fafd5-7646-4be6-9471-fb31a0dabfc0 service nova] Creating event network-vif-plugged:21445c55-f24c-46da-9946-53b2566a219f for instance 8a4ddf34-af18-4e02-a306-c1c67f5c0b28 on n-h2-849328-3 Aug 24 10:20:10.825094 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-657d857b-8cbd-42f3-b8b1-2974a5909ca0 req-437fafd5-7646-4be6-9471-fb31a0dabfc0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131460 Aug 24 10:20:10.826149 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 913/2032] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:10.855447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c9ee0be6-7de0-4361-aaab-581e528cf194 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:10.856527 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c9ee0be6-7de0-4361-aaab-581e528cf194 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:10.874972 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9ee0be6-7de0-4361-aaab-581e528cf194 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:10.875806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9ee0be6-7de0-4361-aaab-581e528cf194 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:10.876481 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9ee0be6-7de0-4361-aaab-581e528cf194 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:10.877495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9ee0be6-7de0-4361-aaab-581e528cf194 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:10.881942 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9ee0be6-7de0-4361-aaab-581e528cf194 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:10.882816 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9ee0be6-7de0-4361-aaab-581e528cf194 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:11.153694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-765d657e-a773-45e9-87ee-6f75f3ce1f48 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:11.167370 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-765d657e-a773-45e9-87ee-6f75f3ce1f48 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28" status: 200 len: 1317 microversion: 2.1 time: 0.698780 Aug 24 10:20:11.168528 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1120/2033] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:10 2022] GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28 => generated 1317 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:11.176117 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-64b56984-88fa-4d91-9adf-e96f1d97b4e0 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:11.179309 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-64b56984-88fa-4d91-9adf-e96f1d97b4e0 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:11.190218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64b56984-88fa-4d91-9adf-e96f1d97b4e0 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:11.190778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64b56984-88fa-4d91-9adf-e96f1d97b4e0 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:11.191361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64b56984-88fa-4d91-9adf-e96f1d97b4e0 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:11.192396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64b56984-88fa-4d91-9adf-e96f1d97b4e0 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:11.193013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64b56984-88fa-4d91-9adf-e96f1d97b4e0 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:11.193512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64b56984-88fa-4d91-9adf-e96f1d97b4e0 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:11.252794 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-64b56984-88fa-4d91-9adf-e96f1d97b4e0 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081971 Aug 24 10:20:11.259620 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1121/2034] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:20:11 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:11.270890 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-c9ee0be6-7de0-4361-aaab-581e528cf194 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lazy-loading 'services' on Instance uuid 3576fbd4-5c72-4025-a40c-e0e1ad348acc {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:11.290140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d6a26842-5977-4458-9982-d0af644a2036 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:11.293770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d6a26842-5977-4458-9982-d0af644a2036 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] [instance: e5cf9540-fba0-498d-890d-af316b16ceff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:11.316064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6a26842-5977-4458-9982-d0af644a2036 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:11.316880 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6a26842-5977-4458-9982-d0af644a2036 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:11.317640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6a26842-5977-4458-9982-d0af644a2036 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:11.318842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6a26842-5977-4458-9982-d0af644a2036 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:11.319654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6a26842-5977-4458-9982-d0af644a2036 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:11.320418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6a26842-5977-4458-9982-d0af644a2036 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:11.324996 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:11.330940 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c9ee0be6-7de0-4361-aaab-581e528cf194 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1927 microversion: 2.75 time: 0.502147 Aug 24 10:20:11.331983 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 914/2035] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:10 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1927 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:11.716984 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c04d3b26-3a8f-4831-827a-cb0db572d18b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:11.719775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c04d3b26-3a8f-4831-827a-cb0db572d18b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:11.735554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c04d3b26-3a8f-4831-827a-cb0db572d18b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:11.736483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c04d3b26-3a8f-4831-827a-cb0db572d18b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:11.737213 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c04d3b26-3a8f-4831-827a-cb0db572d18b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:11.738301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c04d3b26-3a8f-4831-827a-cb0db572d18b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:11.738963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c04d3b26-3a8f-4831-827a-cb0db572d18b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:11.739556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c04d3b26-3a8f-4831-827a-cb0db572d18b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:11.749393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:11.859630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d6a26842-5977-4458-9982-d0af644a2036 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e52ac750849e4207bbc6e320210bb2b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823f96998a0341559f6a637f9a5b840c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:11.886329 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d6a26842-5977-4458-9982-d0af644a2036 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff" status: 200 len: 1401 microversion: 2.1 time: 0.603117 Aug 24 10:20:11.889653 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1122/2036] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:11 2022] GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff => generated 1401 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:12.197622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e354e41c-a617-47ac-8365-8d2a31fb58bf tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:12.197622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e354e41c-a617-47ac-8365-8d2a31fb58bf tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: 8a4ddf34-af18-4e02-a306-c1c67f5c0b28] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:12.211639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e354e41c-a617-47ac-8365-8d2a31fb58bf tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:12.212461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e354e41c-a617-47ac-8365-8d2a31fb58bf tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:12.212652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e354e41c-a617-47ac-8365-8d2a31fb58bf tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:12.213364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e354e41c-a617-47ac-8365-8d2a31fb58bf tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:12.213831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e354e41c-a617-47ac-8365-8d2a31fb58bf tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:12.214314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e354e41c-a617-47ac-8365-8d2a31fb58bf tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:12.229298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c04d3b26-3a8f-4831-827a-cb0db572d18b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:12.283308 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c04d3b26-3a8f-4831-827a-cb0db572d18b tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b" status: 200 len: 1468 microversion: 2.1 time: 0.576147 Aug 24 10:20:12.288331 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 915/2037] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:11 2022] GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b => generated 1468 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:20:12.344321 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b6bfea66-f0a1-4db5-b02d-2a7c091ca725 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:12.356800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b6bfea66-f0a1-4db5-b02d-2a7c091ca725 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:12.391289 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6bfea66-f0a1-4db5-b02d-2a7c091ca725 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:12.392692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6bfea66-f0a1-4db5-b02d-2a7c091ca725 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:12.394835 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6bfea66-f0a1-4db5-b02d-2a7c091ca725 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:12.396611 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6bfea66-f0a1-4db5-b02d-2a7c091ca725 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:12.397317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6bfea66-f0a1-4db5-b02d-2a7c091ca725 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:12.398690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6bfea66-f0a1-4db5-b02d-2a7c091ca725 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:12.491894 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b6bfea66-f0a1-4db5-b02d-2a7c091ca725 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.196519 Aug 24 10:20:12.505840 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 916/2038] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:20:12 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af/os-volume_attachments => generated 197 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:12.795947 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:12.860218 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-88b2d4d6-db0f-451e-925c-415002567749 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-823515576", "block_migration": true, "disk_over_commit": false}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:12.862802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-88b2d4d6-db0f-451e-925c-415002567749 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] [instance: 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:12.885864 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88b2d4d6-db0f-451e-925c-415002567749 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:12.886774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88b2d4d6-db0f-451e-925c-415002567749 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:12.887568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88b2d4d6-db0f-451e-925c-415002567749 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:12.888945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88b2d4d6-db0f-451e-925c-415002567749 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:12.889855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88b2d4d6-db0f-451e-925c-415002567749 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:12.890568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88b2d4d6-db0f-451e-925c-415002567749 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:13.032709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-88b2d4d6-db0f-451e-925c-415002567749 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Lazy-loading 'flavor' on Instance uuid 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:13.084262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-88b2d4d6-db0f-451e-925c-415002567749 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] [instance: 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b] Going to try to live migrate instance to tempest-host-823515576 {{(pid=122432) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 10:20:13.104965 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e354e41c-a617-47ac-8365-8d2a31fb58bf tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:13.120576 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e354e41c-a617-47ac-8365-8d2a31fb58bf tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28" status: 200 len: 1317 microversion: 2.1 time: 0.934833 Aug 24 10:20:13.121805 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1123/2039] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:12 2022] GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28 => generated 1317 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:13.129072 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-88b2d4d6-db0f-451e-925c-415002567749 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] HTTP exception thrown: Compute host tempest-host-823515576 could not be found. Aug 24 10:20:13.133220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fa668bd5-8950-44df-9647-868fa14a9bab tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:13.137255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fa668bd5-8950-44df-9647-868fa14a9bab tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:13.193483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-88b2d4d6-db0f-451e-925c-415002567749 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Request method failure captured: Aug 24 10:20:13.193483 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b/action HTTP/1.1 Aug 24 10:20:13.193483 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:20:13.193483 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:20:13.193483 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:20:13.193483 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 106 Aug 24 10:20:13.193483 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:20:13.193483 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:20:13.193483 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:20:13.193483 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:20:13.193483 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBftCFAH349QygIayfMr4xn402aZg7s_42AW8w3G85eo2_r3eYiM4LWGIfUYGmbrZqmrqvNsouLpMr7d-2XBrkIqAlJNQbP40DjY4e3gqkEDu9lFyr3TraV_aWBy8o4ftl_fb0_dGXG2joKOwYbvqNrEBw_Je_t6nams02JJD_eNCml8 Aug 24 10:20:13.193483 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:20:13.193483 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:20:13.193483 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:20:13.193483 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:20:13.193483 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:20:13.193483 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:20:13.193483 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 3ab8c833dbe64f46bda3197bb3fbc3a3 Aug 24 10:20:13.193483 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-LiveMigrationNegativeTest-1155257422 Aug 24 10:20:13.193483 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,admin,member Aug 24 10:20:13.193483 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,admin,member Aug 24 10:20:13.197163 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3ab8c833dbe64f46bda3197bb3fbc3a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3ab8c833dbe64f46bda3197bb3fbc3a3", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3ab8c833dbe64f46bda3197bb3fbc3a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3ab8c833dbe64f46bda3197bb3fbc3a3"}]}] Aug 24 10:20:13.197163 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-LiveMigrationNegativeTest-1155257422 Aug 24 10:20:13.197163 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 3ab8c833dbe64f46bda3197bb3fbc3a3 Aug 24 10:20:13.197163 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1155257422 Aug 24 10:20:13.197163 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-LiveMigrationNegativeTest-1155257422-project-admin Aug 24 10:20:13.197163 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:20:13.197163 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:20:13.197163 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: dc1956472c6444138fd0dc15f5dc6d21 Aug 24 10:20:13.197163 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-LiveMigrationNegativeTest-1155257422-project-admin Aug 24 10:20:13.197163 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:20:13.197163 n-d-849328-3 devstack@n-api.service[122432]: {"os-migrateLive": {"host": "tempest-host-823515576", "block_migration": true, "disk_over_commit": false}} Aug 24 10:20:13.197163 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:20:13.199062 n-d-849328-3 devstack@n-api.service[122432]: exception: Compute host tempest-host-823515576 could not be found. Aug 24 10:20:13.199062 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '09ab167e-c8c7-417d-bc49-e9b8ccb8b06b', 'body': {'os-migrateLive': {'host': 'tempest-host-823515576', 'block_migration': True, 'disk_over_commit': False}}} Aug 24 10:20:13.199062 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:20:13.199062 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:13.199062 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 24 10:20:13.199062 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 24 10:20:13.199062 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 24 10:20:13.199062 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 10:20:13.199062 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 24 10:20:13.199062 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 10:20:13.199062 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 24 10:20:13.199062 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 10:20:13.199062 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 24 10:20:13.199062 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 10:20:13.199062 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 24 10:20:13.199062 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 10:20:13.199062 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 24 10:20:13.199062 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 10:20:13.199062 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 10:20:13.203013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 10:20:13.203013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 10:20:13.203013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 10:20:13.203013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5483, in live_migrate Aug 24 10:20:13.203013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 24 10:20:13.203013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:20:13.203013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:20:13.203013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 24 10:20:13.203013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 24 10:20:13.203013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 24 10:20:13.203013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:20:13.203013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 24 10:20:13.203013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 24 10:20:13.203013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 24 10:20:13.203013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 24 10:20:13.203013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 24 10:20:13.203013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 24 10:20:13.203013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-823515576 could not be found. Aug 24 10:20:13.203013 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:13.210479 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:13.210479 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:13.210479 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:13.210479 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:13.210479 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:13.210479 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:20:13.210479 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:20:13.210479 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:20:13.210479 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:20:13.210479 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:20:13.210479 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:20:13.210479 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:20:13.210479 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:20:13.210479 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:20:13.210479 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:20:13.210479 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 24 10:20:13.210479 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 24 10:20:13.210479 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 10:20:13.210479 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-823515576 could not be found. Aug 24 10:20:13.210479 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:13.214095 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:13.214095 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:13.214095 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:13.214095 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:13.214095 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:13.214095 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:20:13.214095 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:20:13.214095 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-823515576 could not be found. Aug 24 10:20:13.214095 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:13.216939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=11 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:13.218963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-88b2d4d6-db0f-451e-925c-415002567749 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Returning 400 to user: Compute host tempest-host-823515576 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:20:13.221336 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-88b2d4d6-db0f-451e-925c-415002567749 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b/action" status: 400 len: 99 microversion: 2.1 time: 0.712819 Aug 24 10:20:13.228630 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 917/2040] 10.222.0.85 () {60 vars in 1279 bytes} [Wed Aug 24 10:20:12 2022] POST /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b/action => generated 99 bytes in 717 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 10:20:13.242259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2577971d-f21a-41c8-a8da-94a39c1d3916 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:13.242259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2577971d-f21a-41c8-a8da-94a39c1d3916 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] [instance: e5cf9540-fba0-498d-890d-af316b16ceff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:13.243622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa668bd5-8950-44df-9647-868fa14a9bab tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:13.250321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa668bd5-8950-44df-9647-868fa14a9bab tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:13.251646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa668bd5-8950-44df-9647-868fa14a9bab tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:13.257940 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa668bd5-8950-44df-9647-868fa14a9bab tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:13.278712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2577971d-f21a-41c8-a8da-94a39c1d3916 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:13.279756 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2577971d-f21a-41c8-a8da-94a39c1d3916 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:13.280751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2577971d-f21a-41c8-a8da-94a39c1d3916 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:13.280993 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa668bd5-8950-44df-9647-868fa14a9bab tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:13.283712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa668bd5-8950-44df-9647-868fa14a9bab tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:13.284024 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2577971d-f21a-41c8-a8da-94a39c1d3916 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:13.284722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2577971d-f21a-41c8-a8da-94a39c1d3916 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:13.285392 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2577971d-f21a-41c8-a8da-94a39c1d3916 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:13.593230 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-fa668bd5-8950-44df-9647-868fa14a9bab tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lazy-loading 'services' on Instance uuid 3576fbd4-5c72-4025-a40c-e0e1ad348acc {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:13.686154 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fa668bd5-8950-44df-9647-868fa14a9bab tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1927 microversion: 2.75 time: 0.558453 Aug 24 10:20:13.689456 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1124/2041] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:13 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1927 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:13.710495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2ff371bf-80b4-42c0-83b0-f40c3e66f5d6 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:13.715376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2ff371bf-80b4-42c0-83b0-f40c3e66f5d6 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:13.737324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ff371bf-80b4-42c0-83b0-f40c3e66f5d6 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:13.744195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ff371bf-80b4-42c0-83b0-f40c3e66f5d6 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:13.745509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ff371bf-80b4-42c0-83b0-f40c3e66f5d6 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:13.749219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ff371bf-80b4-42c0-83b0-f40c3e66f5d6 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:13.750198 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ff371bf-80b4-42c0-83b0-f40c3e66f5d6 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:13.751011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ff371bf-80b4-42c0-83b0-f40c3e66f5d6 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:14.195984 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2577971d-f21a-41c8-a8da-94a39c1d3916 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e52ac750849e4207bbc6e320210bb2b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823f96998a0341559f6a637f9a5b840c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:14.207523 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2577971d-f21a-41c8-a8da-94a39c1d3916 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff" status: 200 len: 1401 microversion: 2.1 time: 0.978258 Aug 24 10:20:14.225183 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 918/2042] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:13 2022] GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff => generated 1401 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:14.225183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-59512ca1-1f19-444a-a7ee-d5b756be4530 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:14.225183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-59512ca1-1f19-444a-a7ee-d5b756be4530 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:14.245819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59512ca1-1f19-444a-a7ee-d5b756be4530 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:14.251689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2ff371bf-80b4-42c0-83b0-f40c3e66f5d6 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:14.254792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59512ca1-1f19-444a-a7ee-d5b756be4530 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:14.256802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59512ca1-1f19-444a-a7ee-d5b756be4530 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:14.260685 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2ff371bf-80b4-42c0-83b0-f40c3e66f5d6 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b" status: 200 len: 1468 microversion: 2.1 time: 0.568597 Aug 24 10:20:14.261322 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1125/2043] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:13 2022] GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b => generated 1468 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:14.262063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59512ca1-1f19-444a-a7ee-d5b756be4530 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:14.263212 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59512ca1-1f19-444a-a7ee-d5b756be4530 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:14.264343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59512ca1-1f19-444a-a7ee-d5b756be4530 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:14.266134 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-290f3525-fd76-460f-8ed8-7ec8cff86ef1 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:14.266754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-290f3525-fd76-460f-8ed8-7ec8cff86ef1 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: 8a4ddf34-af18-4e02-a306-c1c67f5c0b28] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:14.282436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-290f3525-fd76-460f-8ed8-7ec8cff86ef1 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:14.283208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-290f3525-fd76-460f-8ed8-7ec8cff86ef1 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:14.283813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-290f3525-fd76-460f-8ed8-7ec8cff86ef1 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:14.284706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-290f3525-fd76-460f-8ed8-7ec8cff86ef1 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:14.285445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-290f3525-fd76-460f-8ed8-7ec8cff86ef1 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:14.286042 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-290f3525-fd76-460f-8ed8-7ec8cff86ef1 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:14.429837 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-59512ca1-1f19-444a-a7ee-d5b756be4530 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.203176 Aug 24 10:20:14.432411 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 919/2044] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:20:14 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af/os-volume_attachments => generated 25 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:20:14.455708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-23536414-40d5-4294-9a72-dd1ba48d3125 req-787e3c62-37dd-43eb-a65a-265a805f70ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5cf9540-fba0-498d-890d-af316b16ceff", "tag": "063e9896-ef6d-473a-b00e-f9778234fa16"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:14.479839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-23536414-40d5-4294-9a72-dd1ba48d3125 req-787e3c62-37dd-43eb-a65a-265a805f70ad service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:14.482203 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-23536414-40d5-4294-9a72-dd1ba48d3125 req-787e3c62-37dd-43eb-a65a-265a805f70ad service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:14.484882 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-23536414-40d5-4294-9a72-dd1ba48d3125 req-787e3c62-37dd-43eb-a65a-265a805f70ad service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:14.519380 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-23536414-40d5-4294-9a72-dd1ba48d3125 req-787e3c62-37dd-43eb-a65a-265a805f70ad service nova] Creating event network-changed:063e9896-ef6d-473a-b00e-f9778234fa16 for instance e5cf9540-fba0-498d-890d-af316b16ceff on n-h1-849328-3 Aug 24 10:20:14.538830 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-23536414-40d5-4294-9a72-dd1ba48d3125 req-787e3c62-37dd-43eb-a65a-265a805f70ad service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105020 Aug 24 10:20:14.539872 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 920/2045] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:14.604007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ac063097-a542-4865-ba3c-5910b907a34e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-895870712", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:14.699913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-290f3525-fd76-460f-8ed8-7ec8cff86ef1 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:14.721072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-ac063097-a542-4865-ba3c-5910b907a34e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:20:14.722898 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-290f3525-fd76-460f-8ed8-7ec8cff86ef1 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28" status: 200 len: 1467 microversion: 2.1 time: 0.460007 Aug 24 10:20:14.737670 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1126/2046] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:14 2022] GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28 => generated 1467 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:14.747423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-25dad8a5-b374-4300-a47a-567a6ae9bc2e tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:14.750251 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-25dad8a5-b374-4300-a47a-567a6ae9bc2e tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:14.757039 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25dad8a5-b374-4300-a47a-567a6ae9bc2e tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:14.757672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25dad8a5-b374-4300-a47a-567a6ae9bc2e tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:14.758487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25dad8a5-b374-4300-a47a-567a6ae9bc2e tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:14.759755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25dad8a5-b374-4300-a47a-567a6ae9bc2e tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:14.761114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25dad8a5-b374-4300-a47a-567a6ae9bc2e tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:14.761780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25dad8a5-b374-4300-a47a-567a6ae9bc2e tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:14.957573 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-25dad8a5-b374-4300-a47a-567a6ae9bc2e tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lazy-loading 'services' on Instance uuid 3576fbd4-5c72-4025-a40c-e0e1ad348acc {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:14.989896 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-25dad8a5-b374-4300-a47a-567a6ae9bc2e tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1927 microversion: 2.75 time: 0.248522 Aug 24 10:20:14.991414 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1127/2047] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:14 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1927 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:15.003145 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-311c0b36-5b10-4b1e-8974-5942c10512de tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:15.004584 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-311c0b36-5b10-4b1e-8974-5942c10512de tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:15.015222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-311c0b36-5b10-4b1e-8974-5942c10512de tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:15.016917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-311c0b36-5b10-4b1e-8974-5942c10512de tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:15.018044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-311c0b36-5b10-4b1e-8974-5942c10512de tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:15.019721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-311c0b36-5b10-4b1e-8974-5942c10512de tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:15.021106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-311c0b36-5b10-4b1e-8974-5942c10512de tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:15.022824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-311c0b36-5b10-4b1e-8974-5942c10512de tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:15.351046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-311c0b36-5b10-4b1e-8974-5942c10512de tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:15.372972 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-311c0b36-5b10-4b1e-8974-5942c10512de tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb" status: 200 len: 1468 microversion: 2.1 time: 0.379023 Aug 24 10:20:15.374795 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1128/2048] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:14 2022] GET /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb => generated 1468 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:15.385943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d5cacb7b-770a-45bd-a5a7-900192907a34 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:15.387924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d5cacb7b-770a-45bd-a5a7-900192907a34 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] [instance: e5cf9540-fba0-498d-890d-af316b16ceff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:15.406023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5cacb7b-770a-45bd-a5a7-900192907a34 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:15.408645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5cacb7b-770a-45bd-a5a7-900192907a34 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:15.412027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5cacb7b-770a-45bd-a5a7-900192907a34 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:15.413865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5cacb7b-770a-45bd-a5a7-900192907a34 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:15.415280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5cacb7b-770a-45bd-a5a7-900192907a34 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:15.418368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5cacb7b-770a-45bd-a5a7-900192907a34 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:15.752221 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d5cacb7b-770a-45bd-a5a7-900192907a34 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e52ac750849e4207bbc6e320210bb2b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823f96998a0341559f6a637f9a5b840c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:15.785574 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d5cacb7b-770a-45bd-a5a7-900192907a34 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff" status: 200 len: 1401 microversion: 2.1 time: 0.409007 Aug 24 10:20:15.788173 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1129/2049] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:15 2022] GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff => generated 1401 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:15.808157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0527882a-a03f-4737-b1eb-353b1f33e2eb tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1975027050"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:15.833345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0527882a-a03f-4737-b1eb-353b1f33e2eb tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:15.867553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0527882a-a03f-4737-b1eb-353b1f33e2eb tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:15.871038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0527882a-a03f-4737-b1eb-353b1f33e2eb tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:15.872169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0527882a-a03f-4737-b1eb-353b1f33e2eb tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:15.880330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0527882a-a03f-4737-b1eb-353b1f33e2eb tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:15.883296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0527882a-a03f-4737-b1eb-353b1f33e2eb tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:15.890271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0527882a-a03f-4737-b1eb-353b1f33e2eb tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:16.309369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-ac063097-a542-4865-ba3c-5910b907a34e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:20:16.312140 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-ac063097-a542-4865-ba3c-5910b907a34e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:20:16.312744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-ac063097-a542-4865-ba3c-5910b907a34e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:20:16.313293 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-ac063097-a542-4865-ba3c-5910b907a34e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:20:16.313785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-ac063097-a542-4865-ba3c-5910b907a34e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:20:16.339928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac063097-a542-4865-ba3c-5910b907a34e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:16.343034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac063097-a542-4865-ba3c-5910b907a34e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:16.343887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac063097-a542-4865-ba3c-5910b907a34e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:16.346016 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac063097-a542-4865-ba3c-5910b907a34e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:16.346652 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac063097-a542-4865-ba3c-5910b907a34e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:16.346822 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0527882a-a03f-4737-b1eb-353b1f33e2eb tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "POST /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb/action" status: 202 len: 0 microversion: 2.1 time: 0.555321 Aug 24 10:20:16.348307 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac063097-a542-4865-ba3c-5910b907a34e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:16.349008 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1130/2050] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:20:15 2022] POST /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 10:20:16.363873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de59f25a-8b3a-4d02-bd68-319ad581f353 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:16.370277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-de59f25a-8b3a-4d02-bd68-319ad581f353 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:16.391734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de59f25a-8b3a-4d02-bd68-319ad581f353 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:16.392593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de59f25a-8b3a-4d02-bd68-319ad581f353 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:16.397269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de59f25a-8b3a-4d02-bd68-319ad581f353 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:16.398159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de59f25a-8b3a-4d02-bd68-319ad581f353 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:16.398657 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de59f25a-8b3a-4d02-bd68-319ad581f353 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:16.399102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de59f25a-8b3a-4d02-bd68-319ad581f353 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:16.414966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-ac063097-a542-4865-ba3c-5910b907a34e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Getting quotas for project e5b71b3aec6d45c3964585a8b11f2e81. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:20:16.421939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-ac063097-a542-4865-ba3c-5910b907a34e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Getting quotas for user 14047bac72234dc7b0384a99fbdabb67 and project e5b71b3aec6d45c3964585a8b11f2e81. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:20:16.467396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ac063097-a542-4865-ba3c-5910b907a34e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:20:16.472274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ac063097-a542-4865-ba3c-5910b907a34e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: d5e1565f-a210-4fa8-b881-060432acb904] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:20:16.564135 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-de59f25a-8b3a-4d02-bd68-319ad581f353 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lazy-loading 'services' on Instance uuid 3576fbd4-5c72-4025-a40c-e0e1ad348acc {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:16.581365 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ac063097-a542-4865-ba3c-5910b907a34e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.984361 Aug 24 10:20:16.590136 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 921/2051] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:20:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:20:16.598516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4d468338-faf0-4417-94b5-4ab8151e7b54 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f465a2ce550>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:16.652584 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-de59f25a-8b3a-4d02-bd68-319ad581f353 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1927 microversion: 2.75 time: 0.302074 Aug 24 10:20:16.654490 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1131/2052] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:16 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1927 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:16.666825 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4d468338-faf0-4417-94b5-4ab8151e7b54 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/253f0edd-9ca3-4b50-b54e-fbb9518b9726" status: 200 len: 1455 microversion: 2.1 time: 0.074533 Aug 24 10:20:16.668624 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 922/2053] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:20:16 2022] GET /compute/v2.1/images/253f0edd-9ca3-4b50-b54e-fbb9518b9726 => generated 1455 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:16.669303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e5aa987f-6584-40e5-ab9d-dea5db48c12a tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:16.670233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e5aa987f-6584-40e5-ab9d-dea5db48c12a tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: d5e1565f-a210-4fa8-b881-060432acb904] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:16.783701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e5aa987f-6584-40e5-ab9d-dea5db48c12a tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:16.794378 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e5aa987f-6584-40e5-ab9d-dea5db48c12a tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904" status: 200 len: 1218 microversion: 2.1 time: 0.138010 Aug 24 10:20:16.798055 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1132/2054] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:16 2022] GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904 => generated 1218 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:16.830020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a263c13f-b098-480d-8734-02eb4e32c7c6 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:16.830961 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a263c13f-b098-480d-8734-02eb4e32c7c6 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] [instance: e5cf9540-fba0-498d-890d-af316b16ceff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:16.863351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a263c13f-b098-480d-8734-02eb4e32c7c6 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:16.865006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a263c13f-b098-480d-8734-02eb4e32c7c6 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:16.866557 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a263c13f-b098-480d-8734-02eb4e32c7c6 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:16.869343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a263c13f-b098-480d-8734-02eb4e32c7c6 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:16.870084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a263c13f-b098-480d-8734-02eb4e32c7c6 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:16.871680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a263c13f-b098-480d-8734-02eb4e32c7c6 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:17.210906 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a263c13f-b098-480d-8734-02eb4e32c7c6 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e52ac750849e4207bbc6e320210bb2b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823f96998a0341559f6a637f9a5b840c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:17.257881 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a263c13f-b098-480d-8734-02eb4e32c7c6 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff" status: 200 len: 1401 microversion: 2.1 time: 0.440556 Aug 24 10:20:17.263333 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 923/2055] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:16 2022] GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff => generated 1401 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:17.594863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-10c2e838-db56-47bb-89cc-af0f7c93b272 tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Action: 'create', calling method: .version_select at 0x7f465a2aa3a0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUDAOQmLMNQ39EwiKsZ+Nvr3vPcRb8rnSpK/l+V7XcECSb+6gj6jXBqwbFnaV/JsyysY0Lk1HQyWT9k7+pu4b2M/FxIFfGGtiP0FNFVsHFUwe6kspVrL84ty/eMd3AWxQ=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:17.617842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-10c2e838-db56-47bb-89cc-af0f7c93b272 tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Request method failure captured: Aug 24 10:20:17.617842 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 24 10:20:17.617842 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:20:17.617842 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:20:17.617842 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:20:17.617842 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 257 Aug 24 10:20:17.617842 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:20:17.617842 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:20:17.617842 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:20:17.617842 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:20:17.617842 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfthPT34ZPl-3xGMyZhMsVCZdKtIMF_KgwLKo8RLykbSeQ7gokjaE09FHTYQ1gyYLAfNziAaOvJQ12CWE1wg4yDFsnJHQa01fQkx9D8IwW0QSQL3b19i2LAD8o3cLu1qd6VKetoEgm6Pok-CElR5pZIT0Y0bb0sXRrqWsOlxhbZLMVQ Aug 24 10:20:17.617842 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:20:17.617842 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:20:17.617842 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:20:17.617842 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:20:17.617842 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:20:17.617842 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:20:17.617842 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: bdf65d0da3794da98c40c22b4195d4fc Aug 24 10:20:17.617842 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-348207909 Aug 24 10:20:17.617842 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:20:17.617842 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:20:17.619792 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bdf65d0da3794da98c40c22b4195d4fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bdf65d0da3794da98c40c22b4195d4fc", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bdf65d0da3794da98c40c22b4195d4fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bdf65d0da3794da98c40c22b4195d4fc"}]}] Aug 24 10:20:17.619792 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-KeyPairsNegativeTestJSON-348207909 Aug 24 10:20:17.619792 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: bdf65d0da3794da98c40c22b4195d4fc Aug 24 10:20:17.619792 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-348207909 Aug 24 10:20:17.619792 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-KeyPairsNegativeTestJSON-348207909-project Aug 24 10:20:17.619792 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:20:17.619792 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:20:17.619792 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: d3c625643f194be9bbff191f1105dc0c Aug 24 10:20:17.619792 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-KeyPairsNegativeTestJSON-348207909-project Aug 24 10:20:17.619792 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:20:17.619792 n-d-849328-3 devstack@n-api.service[122433]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUDAOQmLMNQ39EwiKsZ+Nvr3vPcRb8rnSpK/l+V7XcECSb+6gj6jXBqwbFnaV/JsyysY0Lk1HQyWT9k7+pu4b2M/FxIFfGGtiP0FNFVsHFUwe6kspVrL84ty/eMd3AWxQ=="}} Aug 24 10:20:17.621291 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:20:17.621291 n-d-849328-3 devstack@n-api.service[122433]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 24 10:20:17.621291 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUDAOQmLMNQ39EwiKsZ+Nvr3vPcRb8rnSpK/l+V7XcECSb+6gj6jXBqwbFnaV/JsyysY0Lk1HQyWT9k7+pu4b2M/FxIFfGGtiP0FNFVsHFUwe6kspVrL84ty/eMd3AWxQ=='}}} Aug 24 10:20:17.621291 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:20:17.621291 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:17.621291 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 24 10:20:17.621291 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 24 10:20:17.621291 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 24 10:20:17.621291 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 24 10:20:17.621291 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 24 10:20:17.621291 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 24 10:20:17.621291 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 24 10:20:17.621291 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:17.621291 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 24 10:20:17.621291 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:17.621291 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:17.621291 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:20:17.623214 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:20:17.623214 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:20:17.623214 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:20:17.623214 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 24 10:20:17.623214 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:17.623214 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 24 10:20:17.623214 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 24 10:20:17.623214 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 24 10:20:17.623214 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 24 10:20:17.623214 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 24 10:20:17.623214 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:17.623214 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 24 10:20:17.623214 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 24 10:20:17.623214 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:17.623214 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:17.623214 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:17.623214 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:17.623214 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:17.623214 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:17.623214 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:20:17.623214 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:20:17.623214 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:20:17.623214 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:20:17.625237 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:20:17.625237 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:20:17.625237 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:20:17.625237 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:20:17.625237 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:20:17.625237 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:20:17.625237 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:20:17.625237 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:20:17.625237 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:20:17.625237 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:20:17.625237 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 24 10:20:17.625237 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:17.625237 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:17.625237 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:17.625237 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:17.625237 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:17.625237 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:17.625237 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:20:17.625237 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:20:17.626992 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 24 10:20:17.626992 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:17.630255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-10c2e838-db56-47bb-89cc-af0f7c93b272 tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:20:17.632515 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-10c2e838-db56-47bb-89cc-af0f7c93b272 tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.285918 Aug 24 10:20:17.646537 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1133/2056] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:20:17 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 301 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:20:17.673045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ac2ffc5f-ab54-4bed-9aca-dd19dbbb112e tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Action: 'create', calling method: .version_select at 0x7f46545e2040>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2121961584", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:17.734453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-ac2ffc5f-ab54-4bed-9aca-dd19dbbb112e tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Getting quotas for project bdf65d0da3794da98c40c22b4195d4fc. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:20:17.740608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-708d6183-9948-46bd-8bc9-03679c35c37c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-2120898340", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "9dd595c1-4f84-4fce-b6b4-70da09d6756d"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:17.759877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-ac2ffc5f-ab54-4bed-9aca-dd19dbbb112e tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Getting quotas for user d3c625643f194be9bbff191f1105dc0c and project bdf65d0da3794da98c40c22b4195d4fc. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:20:17.830752 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-ac2ffc5f-ab54-4bed-9aca-dd19dbbb112e tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 24 10:20:17.853110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-708d6183-9948-46bd-8bc9-03679c35c37c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] validate_networks() for [('9dd595c1-4f84-4fce-b6b4-70da09d6756d', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ac2ffc5f-ab54-4bed-9aca-dd19dbbb112e tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Request method failure captured: Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 2167 Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfthPT34ZPl-3xGMyZhMsVCZdKtIMF_KgwLKo8RLykbSeQ7gokjaE09FHTYQ1gyYLAfNziAaOvJQ12CWE1wg4yDFsnJHQa01fQkx9D8IwW0QSQL3b19i2LAD8o3cLu1qd6VKetoEgm6Pok-CElR5pZIT0Y0bb0sXRrqWsOlxhbZLMVQ Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: bdf65d0da3794da98c40c22b4195d4fc Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-348207909 Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bdf65d0da3794da98c40c22b4195d4fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bdf65d0da3794da98c40c22b4195d4fc", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bdf65d0da3794da98c40c22b4195d4fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bdf65d0da3794da98c40c22b4195d4fc"}]}] Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-KeyPairsNegativeTestJSON-348207909 Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: bdf65d0da3794da98c40c22b4195d4fc Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-348207909 Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-KeyPairsNegativeTestJSON-348207909-project Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: d3c625643f194be9bbff191f1105dc0c Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-KeyPairsNegativeTestJSON-348207909-project Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2121961584", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:20:17.859064 n-d-849328-3 devstack@n-api.service[122433]: exception: Keypair data is invalid: failed to generate fingerprint Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2121961584', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6769, in import_key_pair Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6842, in _generate_fingerprint Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:20:17.862254 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:20:17.865788 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:20:17.865788 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:20:17.865788 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:20:17.865788 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:20:17.865788 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 24 10:20:17.865788 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 24 10:20:17.865788 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 24 10:20:17.865788 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 24 10:20:17.865788 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 24 10:20:17.865788 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:17.865788 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:17.865788 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:17.865788 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:17.865788 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:17.865788 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:17.865788 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:20:17.865788 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:20:17.865788 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 24 10:20:17.865788 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:17.865788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ac2ffc5f-ab54-4bed-9aca-dd19dbbb112e tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:20:17.865788 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ac2ffc5f-ab54-4bed-9aca-dd19dbbb112e tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.217047 Aug 24 10:20:17.867898 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1134/2057] 10.222.0.85 () {60 vars in 1160 bytes} [Wed Aug 24 10:20:17 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 219 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 10:20:17.883116 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b1159db4-5bf1-4b0e-a693-abe53d8db382 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f465528cd30>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:18.013227 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b1159db4-5bf1-4b0e-a693-abe53d8db382 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/253f0edd-9ca3-4b50-b54e-fbb9518b9726" status: 200 len: 1455 microversion: 2.1 time: 0.145296 Aug 24 10:20:18.014254 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1135/2058] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:20:17 2022] GET /compute/v2.1/images/253f0edd-9ca3-4b50-b54e-fbb9518b9726 => generated 1455 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:18.031057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-257f812c-e635-4b04-8d12-daa6f3b091b1 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:18.032075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-257f812c-e635-4b04-8d12-daa6f3b091b1 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:18.043854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-257f812c-e635-4b04-8d12-daa6f3b091b1 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:18.044867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-257f812c-e635-4b04-8d12-daa6f3b091b1 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:18.045620 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-257f812c-e635-4b04-8d12-daa6f3b091b1 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:18.046617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-257f812c-e635-4b04-8d12-daa6f3b091b1 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:18.047335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-257f812c-e635-4b04-8d12-daa6f3b091b1 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:18.048037 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-257f812c-e635-4b04-8d12-daa6f3b091b1 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:18.150273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-257f812c-e635-4b04-8d12-daa6f3b091b1 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lazy-loading 'services' on Instance uuid 3576fbd4-5c72-4025-a40c-e0e1ad348acc {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:18.185635 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-257f812c-e635-4b04-8d12-daa6f3b091b1 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1927 microversion: 2.75 time: 0.158592 Aug 24 10:20:18.189407 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1136/2059] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:18 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1927 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:18.203885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-da5bb815-6702-4eee-9516-d8a3324f2b09 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:18.205159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-da5bb815-6702-4eee-9516-d8a3324f2b09 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: d5e1565f-a210-4fa8-b881-060432acb904] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:18.224444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da5bb815-6702-4eee-9516-d8a3324f2b09 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:18.224907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da5bb815-6702-4eee-9516-d8a3324f2b09 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:18.225626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da5bb815-6702-4eee-9516-d8a3324f2b09 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:18.226606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da5bb815-6702-4eee-9516-d8a3324f2b09 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:18.227125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da5bb815-6702-4eee-9516-d8a3324f2b09 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:18.227499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da5bb815-6702-4eee-9516-d8a3324f2b09 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:18.357546 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da5bb815-6702-4eee-9516-d8a3324f2b09 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:18.362348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:18.369439 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-da5bb815-6702-4eee-9516-d8a3324f2b09 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904" status: 200 len: 1270 microversion: 2.1 time: 0.178616 Aug 24 10:20:18.384886 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1137/2060] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:18 2022] GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904 => generated 1270 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:18.392440 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e2045f5c-7ada-456d-9b23-50eff520f775 tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Action: 'create', calling method: .version_select at 0x7f465a27df70>, body: {"keypair": {"name": "tempest-keypair-1423763878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkDW4/2svF0siUYM3lAWZcl/IeUUBf6zdTrb4UKd7ZFFvDUo5GXAB1bb0jW1M4NEy187JXFy6Z0OZGT0uZMNyGFXd6BDUv4Y2tDn4Xr9M4R4kNiDD0WhfzD5lfAjdvmvw=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:18.421642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-e2045f5c-7ada-456d-9b23-50eff520f775 tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Getting quotas for project bdf65d0da3794da98c40c22b4195d4fc. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:20:18.431774 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-e2045f5c-7ada-456d-9b23-50eff520f775 tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Getting quotas for user d3c625643f194be9bbff191f1105dc0c and project bdf65d0da3794da98c40c22b4195d4fc. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:20:18.459846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=99 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:18.517995 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e2045f5c-7ada-456d-9b23-50eff520f775 tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.131774 Aug 24 10:20:18.518941 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1138/2061] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:20:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:18.524623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2ebabbdf-60aa-4d40-9e01-2656bf4531fc tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:18.526334 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2ebabbdf-60aa-4d40-9e01-2656bf4531fc tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] [instance: e5cf9540-fba0-498d-890d-af316b16ceff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:18.550895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ebabbdf-60aa-4d40-9e01-2656bf4531fc tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:18.555545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ebabbdf-60aa-4d40-9e01-2656bf4531fc tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:18.557548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ebabbdf-60aa-4d40-9e01-2656bf4531fc tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:18.558743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ebabbdf-60aa-4d40-9e01-2656bf4531fc tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:18.561012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ebabbdf-60aa-4d40-9e01-2656bf4531fc tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:18.562422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ebabbdf-60aa-4d40-9e01-2656bf4531fc tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:18.923456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2ebabbdf-60aa-4d40-9e01-2656bf4531fc tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e52ac750849e4207bbc6e320210bb2b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823f96998a0341559f6a637f9a5b840c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:18.935902 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2ebabbdf-60aa-4d40-9e01-2656bf4531fc tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff" status: 200 len: 1401 microversion: 2.1 time: 0.415580 Aug 24 10:20:18.949164 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1139/2062] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:18 2022] GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff => generated 1401 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:18.949164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ecc36959-dafd-41ad-8b25-361d5e12ef08 tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Action: 'create', calling method: .version_select at 0x7f46545fc670>, body: {"keypair": {"name": "tempest-keypair-1423763878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9aS7pco2N3zMj4TDHNiD35tYcKOYJpDU0LHgJxrxlNk2R3pJiu27VCBs67RuIWYz0BHg5aOp/Nd8ocHzE+QDj13TmnkWnzJ224dZIGm6tm+mim5ZvFK7AbZ7YJIFFWDg=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:19.001068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-ecc36959-dafd-41ad-8b25-361d5e12ef08 tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Getting quotas for project bdf65d0da3794da98c40c22b4195d4fc. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:20:19.014618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-ecc36959-dafd-41ad-8b25-361d5e12ef08 tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Getting quotas for user d3c625643f194be9bbff191f1105dc0c and project bdf65d0da3794da98c40c22b4195d4fc. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:20:19.073592 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-ecc36959-dafd-41ad-8b25-361d5e12ef08 tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] HTTP exception thrown: Key pair 'tempest-keypair-1423763878' already exists. Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ecc36959-dafd-41ad-8b25-361d5e12ef08 tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Request method failure captured: Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 273 Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfthPT34ZPl-3xGMyZhMsVCZdKtIMF_KgwLKo8RLykbSeQ7gokjaE09FHTYQ1gyYLAfNziAaOvJQ12CWE1wg4yDFsnJHQa01fQkx9D8IwW0QSQL3b19i2LAD8o3cLu1qd6VKetoEgm6Pok-CElR5pZIT0Y0bb0sXRrqWsOlxhbZLMVQ Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: bdf65d0da3794da98c40c22b4195d4fc Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-348207909 Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bdf65d0da3794da98c40c22b4195d4fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bdf65d0da3794da98c40c22b4195d4fc", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bdf65d0da3794da98c40c22b4195d4fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bdf65d0da3794da98c40c22b4195d4fc"}]}] Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-KeyPairsNegativeTestJSON-348207909 Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: bdf65d0da3794da98c40c22b4195d4fc Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-348207909 Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-KeyPairsNegativeTestJSON-348207909-project Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: d3c625643f194be9bbff191f1105dc0c Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-KeyPairsNegativeTestJSON-348207909-project Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: {"keypair": {"name": "tempest-keypair-1423763878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9aS7pco2N3zMj4TDHNiD35tYcKOYJpDU0LHgJxrxlNk2R3pJiu27VCBs67RuIWYz0BHg5aOp/Nd8ocHzE+QDj13TmnkWnzJ224dZIGm6tm+mim5ZvFK7AbZ7YJIFFWDg=="}} Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: exception: Key pair 'tempest-keypair-1423763878' already exists. Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1423763878', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9aS7pco2N3zMj4TDHNiD35tYcKOYJpDU0LHgJxrxlNk2R3pJiu27VCBs67RuIWYz0BHg5aOp/Nd8ocHzE+QDj13TmnkWnzJ224dZIGm6tm+mim5ZvFK7AbZ7YJIFFWDg=='}}} Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result.read() Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'd3c625643f194be9bbff191f1105dc0c-tempest-keypair-1423763878' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 24 10:20:19.079246 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi session.flush() Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result.read() Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 24 10:20:19.084052 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'd3c625643f194be9bbff191f1105dc0c-tempest-keypair-1423763878' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 24, 10, 20, 19, 64960), 'updated_at': None, 'name': 'tempest-keypair-1423763878', 'user_id': 'd3c625643f194be9bbff191f1105dc0c', 'fingerprint': '94:eb:06:7d:23:4a:96:c6:b2:92:6d:37:73:ad:3a:85', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9aS7pco2N3zMj4TDHNiD35tYcKOYJpDU0LHgJxrxlNk2R3pJiu27VCBs67RuIWYz0BHg5aOp/Nd8ocHzE+QDj13TmnkWnzJ224dZIGm6tm+mim5ZvFK7AbZ7YJIFFWDg==', 'type': 'ssh'}] Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi keypair.create() Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._create() Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1423763878' already exists. Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 24 10:20:19.095535 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1423763878' already exists. Aug 24 10:20:19.111140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.111140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:19.111140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.111140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:19.111140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:19.111140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:19.111140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:20:19.111140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:20:19.111140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1423763878' already exists. Aug 24 10:20:19.111140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.111140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ecc36959-dafd-41ad-8b25-361d5e12ef08 tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Returning 409 to user: Key pair 'tempest-keypair-1423763878' already exists. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:20:19.111140 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ecc36959-dafd-41ad-8b25-361d5e12ef08 tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.154649 Aug 24 10:20:19.111140 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1140/2063] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:20:18 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 157 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:20:19.114314 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-708d6183-9948-46bd-8bc9-03679c35c37c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:20:19.114314 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-708d6183-9948-46bd-8bc9-03679c35c37c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:20:19.114314 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-708d6183-9948-46bd-8bc9-03679c35c37c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:20:19.114314 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-708d6183-9948-46bd-8bc9-03679c35c37c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:20:19.114314 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-708d6183-9948-46bd-8bc9-03679c35c37c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:20:19.114314 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-708d6183-9948-46bd-8bc9-03679c35c37c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:19.116442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d0d32a6c-8495-4707-9bc1-ed9a9c44939e tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f46552f6790>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:19.116711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-708d6183-9948-46bd-8bc9-03679c35c37c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:19.116711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-708d6183-9948-46bd-8bc9-03679c35c37c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:19.116711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-708d6183-9948-46bd-8bc9-03679c35c37c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:19.116711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-708d6183-9948-46bd-8bc9-03679c35c37c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:19.116711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-708d6183-9948-46bd-8bc9-03679c35c37c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:19.158261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-708d6183-9948-46bd-8bc9-03679c35c37c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Getting quotas for project b78d9b1aee724032aa9eab0cab0f8562. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:20:19.171690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-708d6183-9948-46bd-8bc9-03679c35c37c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Getting quotas for user 4f13f6a21e25432f996be6920ee83343 and project b78d9b1aee724032aa9eab0cab0f8562. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:20:19.187028 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d0d32a6c-8495-4707-9bc1-ed9a9c44939e tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/253f0edd-9ca3-4b50-b54e-fbb9518b9726" status: 200 len: 1455 microversion: 2.1 time: 0.090068 Aug 24 10:20:19.197417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-708d6183-9948-46bd-8bc9-03679c35c37c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:20:19.199655 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1141/2064] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:20:19 2022] GET /compute/v2.1/images/253f0edd-9ca3-4b50-b54e-fbb9518b9726 => generated 1455 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:19.200390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-708d6183-9948-46bd-8bc9-03679c35c37c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] [instance: e5e27996-05a5-41e0-a286-28a6526a95c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:20:19.212808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ed5b669b-732a-4733-8306-63d64743e12c tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Calling method '.version_select at 0x7f4655230a60>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:19.289698 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ed5b669b-732a-4733-8306-63d64743e12c tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1423763878" status: 202 len: 0 microversion: 2.1 time: 0.085121 Aug 24 10:20:19.290827 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1142/2065] 10.222.0.85 () {58 vars in 1221 bytes} [Wed Aug 24 10:20:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1423763878 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:20:19.297267 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d185dfcf-1709-4e68-a077-abba938b6ccf tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:19.299463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d185dfcf-1709-4e68-a077-abba938b6ccf tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:19.306951 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-708d6183-9948-46bd-8bc9-03679c35c37c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.742692 Aug 24 10:20:19.307716 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 924/2066] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:20:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:20:19.314268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d185dfcf-1709-4e68-a077-abba938b6ccf tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:19.315169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d185dfcf-1709-4e68-a077-abba938b6ccf tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:19.316161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d185dfcf-1709-4e68-a077-abba938b6ccf tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:19.319603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d185dfcf-1709-4e68-a077-abba938b6ccf tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:19.320486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d185dfcf-1709-4e68-a077-abba938b6ccf tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:19.321105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d185dfcf-1709-4e68-a077-abba938b6ccf tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:19.341890 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-156cdec4-df02-4d87-82c1-c2773dc2846a tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Action: 'create', calling method: .version_select at 0x7f46545a2940>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKju+bFALUJxTelsvTGQSdv7+yA2eKwUbu57/XDRG9Ercclt11wuEQ0t3IYB4Q1xCyBTREFsG3f4jORZdP0tcmg9Lj3jER85ZFhRcdymC8INwa+DBc2+Q5hEox+P7ZcgKQ=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-156cdec4-df02-4d87-82c1-c2773dc2846a tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Request method failure captured: Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 247 Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfthPT34ZPl-3xGMyZhMsVCZdKtIMF_KgwLKo8RLykbSeQ7gokjaE09FHTYQ1gyYLAfNziAaOvJQ12CWE1wg4yDFsnJHQa01fQkx9D8IwW0QSQL3b19i2LAD8o3cLu1qd6VKetoEgm6Pok-CElR5pZIT0Y0bb0sXRrqWsOlxhbZLMVQ Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: bdf65d0da3794da98c40c22b4195d4fc Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-348207909 Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bdf65d0da3794da98c40c22b4195d4fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bdf65d0da3794da98c40c22b4195d4fc", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bdf65d0da3794da98c40c22b4195d4fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bdf65d0da3794da98c40c22b4195d4fc"}]}] Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-KeyPairsNegativeTestJSON-348207909 Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: bdf65d0da3794da98c40c22b4195d4fc Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-348207909 Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-KeyPairsNegativeTestJSON-348207909-project Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: d3c625643f194be9bbff191f1105dc0c Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-KeyPairsNegativeTestJSON-348207909-project Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKju+bFALUJxTelsvTGQSdv7+yA2eKwUbu57/XDRG9Ercclt11wuEQ0t3IYB4Q1xCyBTREFsG3f4jORZdP0tcmg9Lj3jER85ZFhRcdymC8INwa+DBc2+Q5hEox+P7ZcgKQ=="}} Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKju+bFALUJxTelsvTGQSdv7+yA2eKwUbu57/XDRG9Ercclt11wuEQ0t3IYB4Q1xCyBTREFsG3f4jORZdP0tcmg9Lj3jER85ZFhRcdymC8INwa+DBc2+Q5hEox+P7ZcgKQ=='}}} Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi '' Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:20:19.347376 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:20:19.369455 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:20:19.369455 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:20:19.369455 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:20:19.369455 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:20:19.369455 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 24 10:20:19.369455 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.369455 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:19.369455 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.369455 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:19.369455 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:19.369455 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:19.369455 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:20:19.369455 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:20:19.369455 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 24 10:20:19.369455 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.369455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-156cdec4-df02-4d87-82c1-c2773dc2846a tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:20:19.369455 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-156cdec4-df02-4d87-82c1-c2773dc2846a tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.038828 Aug 24 10:20:19.369455 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 925/2067] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:20:19 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:20:19.376489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c08f6456-a75a-460c-ac04-70170886d657 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:19.379201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c08f6456-a75a-460c-ac04-70170886d657 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] [instance: e5e27996-05a5-41e0-a286-28a6526a95c4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:19.564509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-d185dfcf-1709-4e68-a077-abba938b6ccf tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lazy-loading 'services' on Instance uuid 3576fbd4-5c72-4025-a40c-e0e1ad348acc {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:19.663680 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d185dfcf-1709-4e68-a077-abba938b6ccf tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1927 microversion: 2.75 time: 0.367774 Aug 24 10:20:19.666935 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1143/2068] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:19 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1927 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:19.704921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1514c259-17a8-478f-b247-0a0df1eeef47 tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Action: 'create', calling method: .version_select at 0x7f465a27d8b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1746778558", "public_key": " "}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:19.800487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-1514c259-17a8-478f-b247-0a0df1eeef47 tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Getting quotas for project bdf65d0da3794da98c40c22b4195d4fc. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:20:19.807408 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-1514c259-17a8-478f-b247-0a0df1eeef47 tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Getting quotas for user d3c625643f194be9bbff191f1105dc0c and project bdf65d0da3794da98c40c22b4195d4fc. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:20:19.837540 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-1514c259-17a8-478f-b247-0a0df1eeef47 tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1514c259-17a8-478f-b247-0a0df1eeef47 tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Request method failure captured: Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 95 Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfthPT34ZPl-3xGMyZhMsVCZdKtIMF_KgwLKo8RLykbSeQ7gokjaE09FHTYQ1gyYLAfNziAaOvJQ12CWE1wg4yDFsnJHQa01fQkx9D8IwW0QSQL3b19i2LAD8o3cLu1qd6VKetoEgm6Pok-CElR5pZIT0Y0bb0sXRrqWsOlxhbZLMVQ Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: bdf65d0da3794da98c40c22b4195d4fc Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-348207909 Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bdf65d0da3794da98c40c22b4195d4fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bdf65d0da3794da98c40c22b4195d4fc", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bdf65d0da3794da98c40c22b4195d4fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bdf65d0da3794da98c40c22b4195d4fc"}]}] Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-KeyPairsNegativeTestJSON-348207909 Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: bdf65d0da3794da98c40c22b4195d4fc Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-348207909 Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-KeyPairsNegativeTestJSON-348207909-project Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: d3c625643f194be9bbff191f1105dc0c Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-KeyPairsNegativeTestJSON-348207909-project Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1746778558", "public_key": " "}} Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: exception: Keypair data is invalid: failed to generate fingerprint Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1746778558', 'public_key': ' '}}} Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6769, in import_key_pair Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6842, in _generate_fingerprint Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:19.839738 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.845480 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:19.845480 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:19.845480 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:19.845480 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:20:19.845480 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:20:19.845480 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:20:19.845480 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:20:19.845480 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:20:19.845480 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:20:19.845480 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:20:19.845480 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:20:19.845480 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:20:19.845480 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:20:19.845480 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 24 10:20:19.845480 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 24 10:20:19.845480 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 24 10:20:19.845480 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 24 10:20:19.845480 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 24 10:20:19.845480 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.845480 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:19.845480 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.845480 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:19.845480 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:19.845480 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:19.845480 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:20:19.845480 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:20:19.845480 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 24 10:20:19.845480 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.848003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c08f6456-a75a-460c-ac04-70170886d657 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f13f6a21e25432f996be6920ee83343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78d9b1aee724032aa9eab0cab0f8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:19.850660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1514c259-17a8-478f-b247-0a0df1eeef47 tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:20:19.853385 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1514c259-17a8-478f-b247-0a0df1eeef47 tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.179295 Aug 24 10:20:19.855057 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c08f6456-a75a-460c-ac04-70170886d657 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] 10.222.0.85 "GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4" status: 200 len: 1225 microversion: 2.1 time: 0.495766 Aug 24 10:20:19.855294 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1144/2069] 10.222.0.85 () {60 vars in 1158 bytes} [Wed Aug 24 10:20:19 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 184 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 10:20:19.855481 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 926/2070] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:19 2022] GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4 => generated 1225 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:19.879877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b9324424-1aa5-49cb-93f4-981717f0dbd1 tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Action: 'create', calling method: .version_select at 0x7f465a204280>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjOHfvRzHdUB0vCgRH5teG+OulU7i8Emh6EYHhV6BGVFBJrl0FP7Qt9bLIOay6FneuPOlpBGp3p2FcPyu/tkGp2xGjB3Ee/FOgM/FLV3f/2+gI8WxfxbTamQebcD9sASw=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b9324424-1aa5-49cb-93f4-981717f0dbd1 tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Request method failure captured: Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 507 Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfthPT34ZPl-3xGMyZhMsVCZdKtIMF_KgwLKo8RLykbSeQ7gokjaE09FHTYQ1gyYLAfNziAaOvJQ12CWE1wg4yDFsnJHQa01fQkx9D8IwW0QSQL3b19i2LAD8o3cLu1qd6VKetoEgm6Pok-CElR5pZIT0Y0bb0sXRrqWsOlxhbZLMVQ Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: bdf65d0da3794da98c40c22b4195d4fc Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-348207909 Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bdf65d0da3794da98c40c22b4195d4fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bdf65d0da3794da98c40c22b4195d4fc", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bdf65d0da3794da98c40c22b4195d4fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bdf65d0da3794da98c40c22b4195d4fc"}]}] Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-KeyPairsNegativeTestJSON-348207909 Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: bdf65d0da3794da98c40c22b4195d4fc Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-348207909 Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-KeyPairsNegativeTestJSON-348207909-project Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: d3c625643f194be9bbff191f1105dc0c Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-KeyPairsNegativeTestJSON-348207909-project Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjOHfvRzHdUB0vCgRH5teG+OulU7i8Emh6EYHhV6BGVFBJrl0FP7Qt9bLIOay6FneuPOlpBGp3p2FcPyu/tkGp2xGjB3Ee/FOgM/FLV3f/2+gI8WxfxbTamQebcD9sASw=="}} Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjOHfvRzHdUB0vCgRH5teG+OulU7i8Emh6EYHhV6BGVFBJrl0FP7Qt9bLIOay6FneuPOlpBGp3p2FcPyu/tkGp2xGjB3Ee/FOgM/FLV3f/2+gI8WxfxbTamQebcD9sASw=='}}} Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 24 10:20:19.886053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b9324424-1aa5-49cb-93f4-981717f0dbd1 tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:20:19.894166 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b9324424-1aa5-49cb-93f4-981717f0dbd1 tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.021036 Aug 24 10:20:19.902175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c1f6f51a-5c2e-4b71-ae45-4fdeb55e498e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:19.902424 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 927/2071] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:20:19 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:20:19.902678 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c1f6f51a-5c2e-4b71-ae45-4fdeb55e498e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: d5e1565f-a210-4fa8-b881-060432acb904] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:19.910526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-56f75b4e-f5d9-4e40-b0fa-05a783073ebc tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Action: 'create', calling method: .version_select at 0x7f465a259430>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-646576449", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:19.925201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1f6f51a-5c2e-4b71-ae45-4fdeb55e498e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:19.926126 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1f6f51a-5c2e-4b71-ae45-4fdeb55e498e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:19.929552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1f6f51a-5c2e-4b71-ae45-4fdeb55e498e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:19.930926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1f6f51a-5c2e-4b71-ae45-4fdeb55e498e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:19.931781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1f6f51a-5c2e-4b71-ae45-4fdeb55e498e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:19.932591 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1f6f51a-5c2e-4b71-ae45-4fdeb55e498e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:19.965711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-56f75b4e-f5d9-4e40-b0fa-05a783073ebc tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Getting quotas for project bdf65d0da3794da98c40c22b4195d4fc. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:20:19.986663 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-56f75b4e-f5d9-4e40-b0fa-05a783073ebc tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Getting quotas for user d3c625643f194be9bbff191f1105dc0c and project bdf65d0da3794da98c40c22b4195d4fc. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:20:20.034317 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-56f75b4e-f5d9-4e40-b0fa-05a783073ebc tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-56f75b4e-f5d9-4e40-b0fa-05a783073ebc tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Request method failure captured: Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 117 Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfthPT34ZPl-3xGMyZhMsVCZdKtIMF_KgwLKo8RLykbSeQ7gokjaE09FHTYQ1gyYLAfNziAaOvJQ12CWE1wg4yDFsnJHQa01fQkx9D8IwW0QSQL3b19i2LAD8o3cLu1qd6VKetoEgm6Pok-CElR5pZIT0Y0bb0sXRrqWsOlxhbZLMVQ Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: bdf65d0da3794da98c40c22b4195d4fc Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-348207909 Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bdf65d0da3794da98c40c22b4195d4fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bdf65d0da3794da98c40c22b4195d4fc", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bdf65d0da3794da98c40c22b4195d4fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bdf65d0da3794da98c40c22b4195d4fc"}]}] Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-KeyPairsNegativeTestJSON-348207909 Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: bdf65d0da3794da98c40c22b4195d4fc Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-348207909 Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-KeyPairsNegativeTestJSON-348207909-project Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: d3c625643f194be9bbff191f1105dc0c Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-KeyPairsNegativeTestJSON-348207909-project Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-646576449", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: exception: Keypair data is invalid: failed to generate fingerprint Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-646576449', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6769, in import_key_pair Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6842, in _generate_fingerprint Aug 24 10:20:20.040770 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-56f75b4e-f5d9-4e40-b0fa-05a783073ebc tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-56f75b4e-f5d9-4e40-b0fa-05a783073ebc tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.144738 Aug 24 10:20:20.052085 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 928/2072] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:20:19 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 10:20:20.062486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1a09da0b-792c-42eb-a7c8-12a2390d2c98 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:20.062486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1a09da0b-792c-42eb-a7c8-12a2390d2c98 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] [instance: e5cf9540-fba0-498d-890d-af316b16ceff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:20.082007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a09da0b-792c-42eb-a7c8-12a2390d2c98 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:20.082527 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a09da0b-792c-42eb-a7c8-12a2390d2c98 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:20.082971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a09da0b-792c-42eb-a7c8-12a2390d2c98 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:20.083698 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a09da0b-792c-42eb-a7c8-12a2390d2c98 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:20.084157 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a09da0b-792c-42eb-a7c8-12a2390d2c98 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:20.087332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a09da0b-792c-42eb-a7c8-12a2390d2c98 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:20.117078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c1f6f51a-5c2e-4b71-ae45-4fdeb55e498e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:20.136983 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c1f6f51a-5c2e-4b71-ae45-4fdeb55e498e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904" status: 200 len: 1276 microversion: 2.1 time: 0.272277 Aug 24 10:20:20.140772 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1145/2073] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:19 2022] GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904 => generated 1276 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:20.157395 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-085b8670-6360-4ea5-880c-006dc11a7c7c tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Calling method '.version_select at 0x7f4654c9d9d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:20.208986 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-085b8670-6360-4ea5-880c-006dc11a7c7c tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-218147419 not found for user d3c625643f194be9bbff191f1105dc0c Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-085b8670-6360-4ea5-880c-006dc11a7c7c tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Request method failure captured: Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-218147419 HTTP/1.1 Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfthPT34ZPl-3xGMyZhMsVCZdKtIMF_KgwLKo8RLykbSeQ7gokjaE09FHTYQ1gyYLAfNziAaOvJQ12CWE1wg4yDFsnJHQa01fQkx9D8IwW0QSQL3b19i2LAD8o3cLu1qd6VKetoEgm6Pok-CElR5pZIT0Y0bb0sXRrqWsOlxhbZLMVQ Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: bdf65d0da3794da98c40c22b4195d4fc Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-348207909 Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bdf65d0da3794da98c40c22b4195d4fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bdf65d0da3794da98c40c22b4195d4fc", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bdf65d0da3794da98c40c22b4195d4fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bdf65d0da3794da98c40c22b4195d4fc"}]}] Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-KeyPairsNegativeTestJSON-348207909 Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: bdf65d0da3794da98c40c22b4195d4fc Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-348207909 Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-KeyPairsNegativeTestJSON-348207909-project Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: d3c625643f194be9bbff191f1105dc0c Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-KeyPairsNegativeTestJSON-348207909-project Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: exception: Keypair tempest-keypair-non-existent-218147419 not found for user d3c625643f194be9bbff191f1105dc0c Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'tempest-keypair-non-existent-218147419'} Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6856, in delete_key_pair Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6877, in get_key_pair Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-218147419 not found for user d3c625643f194be9bbff191f1105dc0c Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:20.212030 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:20.220731 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:20.220731 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:20.220731 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:20.220731 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:20.220731 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:20:20.220731 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:20:20.220731 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:20:20.220731 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:20:20.220731 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 10:20:20.220731 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:20:20.220731 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:20:20.220731 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:20:20.220731 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 24 10:20:20.220731 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 24 10:20:20.220731 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 24 10:20:20.220731 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 24 10:20:20.220731 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-218147419 not found for user d3c625643f194be9bbff191f1105dc0c Aug 24 10:20:20.220731 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:20.220731 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:20.220731 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:20.220731 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:20.220731 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:20.220731 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:20.220731 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:20:20.220731 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:20:20.220731 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-218147419 not found for user d3c625643f194be9bbff191f1105dc0c Aug 24 10:20:20.220731 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:20.229774 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-085b8670-6360-4ea5-880c-006dc11a7c7c tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] Returning 404 to user: Keypair tempest-keypair-non-existent-218147419 not found for user d3c625643f194be9bbff191f1105dc0c {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:20:20.229774 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-085b8670-6360-4ea5-880c-006dc11a7c7c tempest-KeyPairsNegativeTestJSON-348207909 tempest-KeyPairsNegativeTestJSON-348207909-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-218147419" status: 404 len: 144 microversion: 2.1 time: 0.081284 Aug 24 10:20:20.231661 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1146/2074] 10.222.0.85 () {58 vars in 1257 bytes} [Wed Aug 24 10:20:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-218147419 => generated 144 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:20:20.246618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c2792035-0076-4b90-ae89-25c64087822d tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f465a2aa790>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:20.348815 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c2792035-0076-4b90-ae89-25c64087822d tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/253f0edd-9ca3-4b50-b54e-fbb9518b9726" status: 200 len: 1455 microversion: 2.1 time: 0.114955 Aug 24 10:20:20.350231 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1147/2075] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:20:20 2022] GET /compute/v2.1/images/253f0edd-9ca3-4b50-b54e-fbb9518b9726 => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:20.559647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1a09da0b-792c-42eb-a7c8-12a2390d2c98 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e52ac750849e4207bbc6e320210bb2b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823f96998a0341559f6a637f9a5b840c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:20.614922 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1a09da0b-792c-42eb-a7c8-12a2390d2c98 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff" status: 200 len: 1401 microversion: 2.1 time: 0.565968 Aug 24 10:20:20.619111 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 929/2076] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:20 2022] GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff => generated 1401 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:20.699636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-28421243-288c-449f-bb44-2c6eddc5abb0 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:20.700768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-28421243-288c-449f-bb44-2c6eddc5abb0 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:20.734091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28421243-288c-449f-bb44-2c6eddc5abb0 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:20.742302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28421243-288c-449f-bb44-2c6eddc5abb0 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:20.743358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28421243-288c-449f-bb44-2c6eddc5abb0 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:20.744394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28421243-288c-449f-bb44-2c6eddc5abb0 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:20.749434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28421243-288c-449f-bb44-2c6eddc5abb0 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:20.750582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28421243-288c-449f-bb44-2c6eddc5abb0 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:20.875682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e2d383a9-3ccb-44d0-9cca-ba4a6bf3bf8c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:20.876302 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e2d383a9-3ccb-44d0-9cca-ba4a6bf3bf8c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] [instance: e5e27996-05a5-41e0-a286-28a6526a95c4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:20.896986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2d383a9-3ccb-44d0-9cca-ba4a6bf3bf8c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:20.904637 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2d383a9-3ccb-44d0-9cca-ba4a6bf3bf8c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:20.914575 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2d383a9-3ccb-44d0-9cca-ba4a6bf3bf8c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:20.916128 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2d383a9-3ccb-44d0-9cca-ba4a6bf3bf8c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:20.917850 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2d383a9-3ccb-44d0-9cca-ba4a6bf3bf8c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:20.919387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2d383a9-3ccb-44d0-9cca-ba4a6bf3bf8c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:21.081388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-28421243-288c-449f-bb44-2c6eddc5abb0 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lazy-loading 'services' on Instance uuid 3576fbd4-5c72-4025-a40c-e0e1ad348acc {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:21.124587 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-28421243-288c-449f-bb44-2c6eddc5abb0 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1927 microversion: 2.75 time: 0.432850 Aug 24 10:20:21.126675 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1148/2077] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:20 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1927 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:21.165961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-75680cd6-aeb2-48f4-8863-61e049b5a111 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:21.167294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-75680cd6-aeb2-48f4-8863-61e049b5a111 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: d5e1565f-a210-4fa8-b881-060432acb904] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:21.192023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75680cd6-aeb2-48f4-8863-61e049b5a111 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:21.197648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75680cd6-aeb2-48f4-8863-61e049b5a111 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:21.199182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75680cd6-aeb2-48f4-8863-61e049b5a111 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:21.200208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75680cd6-aeb2-48f4-8863-61e049b5a111 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:21.203800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75680cd6-aeb2-48f4-8863-61e049b5a111 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:21.205553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75680cd6-aeb2-48f4-8863-61e049b5a111 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:21.337717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e2d383a9-3ccb-44d0-9cca-ba4a6bf3bf8c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f13f6a21e25432f996be6920ee83343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78d9b1aee724032aa9eab0cab0f8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:21.386310 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e2d383a9-3ccb-44d0-9cca-ba4a6bf3bf8c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] 10.222.0.85 "GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4" status: 200 len: 1221 microversion: 2.1 time: 0.514179 Aug 24 10:20:21.399776 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 930/2078] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:20 2022] GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4 => generated 1221 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:20:21.432034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-15cbdb63-7098-4e1e-9044-84aaacfd9139 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f465a204160>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:21.829249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-75680cd6-aeb2-48f4-8863-61e049b5a111 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:21.840455 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-75680cd6-aeb2-48f4-8863-61e049b5a111 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904" status: 200 len: 1318 microversion: 2.1 time: 0.679577 Aug 24 10:20:21.844204 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1149/2079] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:21 2022] GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904 => generated 1318 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:21.858455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8a3fde87-a93d-499f-828d-d13c2ffc423f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:21.862506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8a3fde87-a93d-499f-828d-d13c2ffc423f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] [instance: e5cf9540-fba0-498d-890d-af316b16ceff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:21.876666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a3fde87-a93d-499f-828d-d13c2ffc423f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:21.877403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a3fde87-a93d-499f-828d-d13c2ffc423f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:21.877987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a3fde87-a93d-499f-828d-d13c2ffc423f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:21.879297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a3fde87-a93d-499f-828d-d13c2ffc423f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:21.879880 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a3fde87-a93d-499f-828d-d13c2ffc423f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:21.880479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a3fde87-a93d-499f-828d-d13c2ffc423f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:22.781081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8a3fde87-a93d-499f-828d-d13c2ffc423f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e52ac750849e4207bbc6e320210bb2b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823f96998a0341559f6a637f9a5b840c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:22.802926 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8a3fde87-a93d-499f-828d-d13c2ffc423f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff" status: 200 len: 1401 microversion: 2.1 time: 0.949999 Aug 24 10:20:22.808334 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1150/2080] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:21 2022] GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff => generated 1401 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:22.818208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-627fb13a-8e09-4179-9ae0-bfa4d71d4a0c tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:22.818947 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-627fb13a-8e09-4179-9ae0-bfa4d71d4a0c tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:22.845081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-627fb13a-8e09-4179-9ae0-bfa4d71d4a0c tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:22.848770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-627fb13a-8e09-4179-9ae0-bfa4d71d4a0c tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:22.855072 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-627fb13a-8e09-4179-9ae0-bfa4d71d4a0c tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:22.855965 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-627fb13a-8e09-4179-9ae0-bfa4d71d4a0c tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:22.856451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-627fb13a-8e09-4179-9ae0-bfa4d71d4a0c tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:22.863726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-627fb13a-8e09-4179-9ae0-bfa4d71d4a0c tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:23.235562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-627fb13a-8e09-4179-9ae0-bfa4d71d4a0c tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lazy-loading 'services' on Instance uuid 3576fbd4-5c72-4025-a40c-e0e1ad348acc {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:23.312476 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-627fb13a-8e09-4179-9ae0-bfa4d71d4a0c tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1927 microversion: 2.75 time: 0.502571 Aug 24 10:20:23.320282 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1151/2081] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:22 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1927 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:23.345320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-37e7ca1a-742c-4e36-847e-2e1a05fc0452 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:23.346566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-37e7ca1a-742c-4e36-847e-2e1a05fc0452 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] [instance: e5e27996-05a5-41e0-a286-28a6526a95c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:23.372211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37e7ca1a-742c-4e36-847e-2e1a05fc0452 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:23.373430 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37e7ca1a-742c-4e36-847e-2e1a05fc0452 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:23.374141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37e7ca1a-742c-4e36-847e-2e1a05fc0452 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:23.379753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37e7ca1a-742c-4e36-847e-2e1a05fc0452 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:23.380250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37e7ca1a-742c-4e36-847e-2e1a05fc0452 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:23.380951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37e7ca1a-742c-4e36-847e-2e1a05fc0452 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:23.491321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-37e7ca1a-742c-4e36-847e-2e1a05fc0452 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f13f6a21e25432f996be6920ee83343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78d9b1aee724032aa9eab0cab0f8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:23.508802 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-37e7ca1a-742c-4e36-847e-2e1a05fc0452 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] 10.222.0.85 "GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4" status: 200 len: 1283 microversion: 2.1 time: 0.186252 Aug 24 10:20:23.509792 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1152/2082] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:23 2022] GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4 => generated 1283 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:23.518216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d880d3bd-1478-46d5-b378-c3a947b9c1ba tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:23.519494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d880d3bd-1478-46d5-b378-c3a947b9c1ba tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: d5e1565f-a210-4fa8-b881-060432acb904] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:23.532277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d880d3bd-1478-46d5-b378-c3a947b9c1ba tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:23.533356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d880d3bd-1478-46d5-b378-c3a947b9c1ba tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:23.535593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d880d3bd-1478-46d5-b378-c3a947b9c1ba tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:23.537994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d880d3bd-1478-46d5-b378-c3a947b9c1ba tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:23.538827 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d880d3bd-1478-46d5-b378-c3a947b9c1ba tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:23.540055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d880d3bd-1478-46d5-b378-c3a947b9c1ba tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:23.897471 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d880d3bd-1478-46d5-b378-c3a947b9c1ba tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:23.923338 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d880d3bd-1478-46d5-b378-c3a947b9c1ba tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904" status: 200 len: 1318 microversion: 2.1 time: 0.411958 Aug 24 10:20:23.968276 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1153/2083] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:23 2022] GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904 => generated 1318 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:23.983572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ca971c26-0424-4d2f-9e23-d9ecab385a23 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:23.984832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ca971c26-0424-4d2f-9e23-d9ecab385a23 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] [instance: e5cf9540-fba0-498d-890d-af316b16ceff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:24.004636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca971c26-0424-4d2f-9e23-d9ecab385a23 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:24.005501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca971c26-0424-4d2f-9e23-d9ecab385a23 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:24.006168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca971c26-0424-4d2f-9e23-d9ecab385a23 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:24.010866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca971c26-0424-4d2f-9e23-d9ecab385a23 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:24.011561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca971c26-0424-4d2f-9e23-d9ecab385a23 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:24.012604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca971c26-0424-4d2f-9e23-d9ecab385a23 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:24.389528 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ca971c26-0424-4d2f-9e23-d9ecab385a23 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e52ac750849e4207bbc6e320210bb2b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823f96998a0341559f6a637f9a5b840c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:24.412894 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ca971c26-0424-4d2f-9e23-d9ecab385a23 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff" status: 200 len: 1401 microversion: 2.1 time: 0.434613 Aug 24 10:20:24.425219 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1154/2084] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:23 2022] GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff => generated 1401 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:24.487286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3e320683-c123-4a21-a42c-443267118781 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:24.492629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3e320683-c123-4a21-a42c-443267118781 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:24.523337 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e320683-c123-4a21-a42c-443267118781 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:24.525078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e320683-c123-4a21-a42c-443267118781 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:24.536645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e320683-c123-4a21-a42c-443267118781 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:24.543625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e320683-c123-4a21-a42c-443267118781 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:24.547852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e320683-c123-4a21-a42c-443267118781 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:24.548721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e320683-c123-4a21-a42c-443267118781 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:24.669295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-3e320683-c123-4a21-a42c-443267118781 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lazy-loading 'services' on Instance uuid 3576fbd4-5c72-4025-a40c-e0e1ad348acc {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:24.714542 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3e320683-c123-4a21-a42c-443267118781 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1927 microversion: 2.75 time: 0.286430 Aug 24 10:20:24.717924 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1155/2085] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:24 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1927 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:24.730588 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-fc597e55-7a71-4872-93c6-5e8a31a13d78 req-7621ec96-41b5-475f-b91d-9161f1e2060b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5e1565f-a210-4fa8-b881-060432acb904", "tag": "ee3a649b-1b3b-45fd-bb62-7a88b42d11e3"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:24.754750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fc597e55-7a71-4872-93c6-5e8a31a13d78 req-7621ec96-41b5-475f-b91d-9161f1e2060b service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:24.755791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fc597e55-7a71-4872-93c6-5e8a31a13d78 req-7621ec96-41b5-475f-b91d-9161f1e2060b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:24.756949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fc597e55-7a71-4872-93c6-5e8a31a13d78 req-7621ec96-41b5-475f-b91d-9161f1e2060b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:24.806233 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-fc597e55-7a71-4872-93c6-5e8a31a13d78 req-7621ec96-41b5-475f-b91d-9161f1e2060b service nova] Creating event network-changed:ee3a649b-1b3b-45fd-bb62-7a88b42d11e3 for instance d5e1565f-a210-4fa8-b881-060432acb904 on n-h1-849328-3 Aug 24 10:20:24.821610 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-fc597e55-7a71-4872-93c6-5e8a31a13d78 req-7621ec96-41b5-475f-b91d-9161f1e2060b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101301 Aug 24 10:20:24.822537 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1156/2086] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:24.838067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6037e7e6-027d-4ff5-ba69-f2b4fd3ae267 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:24.838900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6037e7e6-027d-4ff5-ba69-f2b4fd3ae267 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] [instance: e5e27996-05a5-41e0-a286-28a6526a95c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:24.857309 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6037e7e6-027d-4ff5-ba69-f2b4fd3ae267 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:24.857775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6037e7e6-027d-4ff5-ba69-f2b4fd3ae267 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:24.858241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6037e7e6-027d-4ff5-ba69-f2b4fd3ae267 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:24.858949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6037e7e6-027d-4ff5-ba69-f2b4fd3ae267 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:24.859406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6037e7e6-027d-4ff5-ba69-f2b4fd3ae267 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:24.859831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6037e7e6-027d-4ff5-ba69-f2b4fd3ae267 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:25.258198 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6037e7e6-027d-4ff5-ba69-f2b4fd3ae267 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f13f6a21e25432f996be6920ee83343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78d9b1aee724032aa9eab0cab0f8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:25.275438 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6037e7e6-027d-4ff5-ba69-f2b4fd3ae267 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] 10.222.0.85 "GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4" status: 200 len: 1325 microversion: 2.1 time: 0.451182 Aug 24 10:20:25.281804 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1157/2087] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:24 2022] GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4 => generated 1325 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:25.294540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-d96df998-fae2-456c-94c7-564e1da0235e req-d4076489-9400-46f0-842b-4b44d6f981a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb", "name": "network-vif-plugged", "status": "completed", "tag": "c181228f-fe7e-4a76-bb5e-18f9995613d1"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:25.308900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d96df998-fae2-456c-94c7-564e1da0235e req-d4076489-9400-46f0-842b-4b44d6f981a6 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:25.310515 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d96df998-fae2-456c-94c7-564e1da0235e req-d4076489-9400-46f0-842b-4b44d6f981a6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:25.311197 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d96df998-fae2-456c-94c7-564e1da0235e req-d4076489-9400-46f0-842b-4b44d6f981a6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:25.326133 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-d96df998-fae2-456c-94c7-564e1da0235e req-d4076489-9400-46f0-842b-4b44d6f981a6 service nova] Creating event network-vif-plugged:c181228f-fe7e-4a76-bb5e-18f9995613d1 for instance fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb on n-h1-849328-3 Aug 24 10:20:25.332730 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-d96df998-fae2-456c-94c7-564e1da0235e req-d4076489-9400-46f0-842b-4b44d6f981a6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048871 Aug 24 10:20:25.334116 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1158/2088] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:25.342347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fedb6842-b388-44a1-b3ee-fae7a4f90be9 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:25.344138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fedb6842-b388-44a1-b3ee-fae7a4f90be9 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: d5e1565f-a210-4fa8-b881-060432acb904] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:25.354370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fedb6842-b388-44a1-b3ee-fae7a4f90be9 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:25.355854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fedb6842-b388-44a1-b3ee-fae7a4f90be9 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:25.357296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fedb6842-b388-44a1-b3ee-fae7a4f90be9 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:25.358482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fedb6842-b388-44a1-b3ee-fae7a4f90be9 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:25.359119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fedb6842-b388-44a1-b3ee-fae7a4f90be9 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:25.360389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fedb6842-b388-44a1-b3ee-fae7a4f90be9 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:25.740140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fedb6842-b388-44a1-b3ee-fae7a4f90be9 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:25.750520 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fedb6842-b388-44a1-b3ee-fae7a4f90be9 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904" status: 200 len: 1318 microversion: 2.1 time: 0.413785 Aug 24 10:20:25.752027 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1159/2089] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:25 2022] GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904 => generated 1318 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:25.758745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d17c395d-3944-493a-8f5f-74817fdda116 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:25.759634 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d17c395d-3944-493a-8f5f-74817fdda116 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] [instance: e5cf9540-fba0-498d-890d-af316b16ceff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:25.767623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d17c395d-3944-493a-8f5f-74817fdda116 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:25.768605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d17c395d-3944-493a-8f5f-74817fdda116 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:25.769265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d17c395d-3944-493a-8f5f-74817fdda116 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:25.770149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d17c395d-3944-493a-8f5f-74817fdda116 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:25.770777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d17c395d-3944-493a-8f5f-74817fdda116 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:25.771373 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d17c395d-3944-493a-8f5f-74817fdda116 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:26.030231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d17c395d-3944-493a-8f5f-74817fdda116 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e52ac750849e4207bbc6e320210bb2b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823f96998a0341559f6a637f9a5b840c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:26.092791 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d17c395d-3944-493a-8f5f-74817fdda116 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff" status: 200 len: 1401 microversion: 2.1 time: 0.339432 Aug 24 10:20:26.093444 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1160/2090] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:25 2022] GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff => generated 1401 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:26.427399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fc16d36a-897f-45b0-b977-0216b63e6e12 tempest-AZV2TestJSON-843754702 tempest-AZV2TestJSON-843754702-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:26.428960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc16d36a-897f-45b0-b977-0216b63e6e12 tempest-AZV2TestJSON-843754702 tempest-AZV2TestJSON-843754702-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:26.429537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc16d36a-897f-45b0-b977-0216b63e6e12 tempest-AZV2TestJSON-843754702 tempest-AZV2TestJSON-843754702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:26.429975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc16d36a-897f-45b0-b977-0216b63e6e12 tempest-AZV2TestJSON-843754702 tempest-AZV2TestJSON-843754702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:26.430877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc16d36a-897f-45b0-b977-0216b63e6e12 tempest-AZV2TestJSON-843754702 tempest-AZV2TestJSON-843754702-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:26.433979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc16d36a-897f-45b0-b977-0216b63e6e12 tempest-AZV2TestJSON-843754702 tempest-AZV2TestJSON-843754702-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:26.434762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc16d36a-897f-45b0-b977-0216b63e6e12 tempest-AZV2TestJSON-843754702 tempest-AZV2TestJSON-843754702-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:26.530318 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fc16d36a-897f-45b0-b977-0216b63e6e12 tempest-AZV2TestJSON-843754702 tempest-AZV2TestJSON-843754702-project] 10.222.0.85 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.411613 Aug 24 10:20:26.531568 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1161/2091] 10.222.0.85 () {58 vars in 1164 bytes} [Wed Aug 24 10:20:26 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:20:26.575076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5a718a2d-2302-4e6e-855e-63815b9dbd67 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:26.583368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5a718a2d-2302-4e6e-855e-63815b9dbd67 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:26.617348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a718a2d-2302-4e6e-855e-63815b9dbd67 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:26.618223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a718a2d-2302-4e6e-855e-63815b9dbd67 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:26.619054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a718a2d-2302-4e6e-855e-63815b9dbd67 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:26.620295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a718a2d-2302-4e6e-855e-63815b9dbd67 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:26.621155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a718a2d-2302-4e6e-855e-63815b9dbd67 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:26.622247 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a718a2d-2302-4e6e-855e-63815b9dbd67 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:26.680055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:26.771321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-5a718a2d-2302-4e6e-855e-63815b9dbd67 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lazy-loading 'services' on Instance uuid 3576fbd4-5c72-4025-a40c-e0e1ad348acc {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:26.799470 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5a718a2d-2302-4e6e-855e-63815b9dbd67 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1927 microversion: 2.75 time: 0.242098 Aug 24 10:20:26.801684 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1162/2092] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:26 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1927 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:26.811873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c831d209-f116-4ff3-a78f-f64d097e401d tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:26.812796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c831d209-f116-4ff3-a78f-f64d097e401d tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] [instance: e5e27996-05a5-41e0-a286-28a6526a95c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:26.820135 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c831d209-f116-4ff3-a78f-f64d097e401d tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:26.821048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c831d209-f116-4ff3-a78f-f64d097e401d tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:26.821544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c831d209-f116-4ff3-a78f-f64d097e401d tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:26.822298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c831d209-f116-4ff3-a78f-f64d097e401d tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:26.822753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c831d209-f116-4ff3-a78f-f64d097e401d tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:26.823179 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c831d209-f116-4ff3-a78f-f64d097e401d tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:27.061663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c831d209-f116-4ff3-a78f-f64d097e401d tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f13f6a21e25432f996be6920ee83343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78d9b1aee724032aa9eab0cab0f8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:27.078953 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c831d209-f116-4ff3-a78f-f64d097e401d tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] 10.222.0.85 "GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4" status: 200 len: 1325 microversion: 2.1 time: 0.275171 Aug 24 10:20:27.080201 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1163/2093] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:26 2022] GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4 => generated 1325 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:27.085516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-789ebbf3-97ba-4b1b-8203-3d75f667378f tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:27.086450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-789ebbf3-97ba-4b1b-8203-3d75f667378f tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: d5e1565f-a210-4fa8-b881-060432acb904] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:27.093597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-789ebbf3-97ba-4b1b-8203-3d75f667378f tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:27.094645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-789ebbf3-97ba-4b1b-8203-3d75f667378f tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:27.095352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-789ebbf3-97ba-4b1b-8203-3d75f667378f tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:27.096636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-789ebbf3-97ba-4b1b-8203-3d75f667378f tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:27.097744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-789ebbf3-97ba-4b1b-8203-3d75f667378f tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:27.098700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-789ebbf3-97ba-4b1b-8203-3d75f667378f tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:27.478628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-789ebbf3-97ba-4b1b-8203-3d75f667378f tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:27.519638 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-789ebbf3-97ba-4b1b-8203-3d75f667378f tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904" status: 200 len: 1318 microversion: 2.1 time: 0.437941 Aug 24 10:20:27.533161 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1164/2094] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:27 2022] GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904 => generated 1318 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:27.535840 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-b4c15be3-64ad-4bf0-9e6e-c76af91f36ac req-148c0373-5267-4d15-8062-1d748f2b33f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e27996-05a5-41e0-a286-28a6526a95c4", "tag": "1a6d286f-5d67-4cbe-a84b-791e2bfef490"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:27.562427 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b4c15be3-64ad-4bf0-9e6e-c76af91f36ac req-148c0373-5267-4d15-8062-1d748f2b33f0 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:27.563218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b4c15be3-64ad-4bf0-9e6e-c76af91f36ac req-148c0373-5267-4d15-8062-1d748f2b33f0 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:27.563731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b4c15be3-64ad-4bf0-9e6e-c76af91f36ac req-148c0373-5267-4d15-8062-1d748f2b33f0 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:27.620395 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-b4c15be3-64ad-4bf0-9e6e-c76af91f36ac req-148c0373-5267-4d15-8062-1d748f2b33f0 service nova] Creating event network-changed:1a6d286f-5d67-4cbe-a84b-791e2bfef490 for instance e5e27996-05a5-41e0-a286-28a6526a95c4 on n-h2-849328-3 Aug 24 10:20:27.646882 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-b4c15be3-64ad-4bf0-9e6e-c76af91f36ac req-148c0373-5267-4d15-8062-1d748f2b33f0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122818 Aug 24 10:20:27.647859 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1165/2095] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:27.679916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f1b710b3-c9ae-4af1-986e-756ff82abce4 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:27.681297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f1b710b3-c9ae-4af1-986e-756ff82abce4 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] [instance: e5cf9540-fba0-498d-890d-af316b16ceff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:27.701786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1b710b3-c9ae-4af1-986e-756ff82abce4 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:27.702609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1b710b3-c9ae-4af1-986e-756ff82abce4 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:27.704242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1b710b3-c9ae-4af1-986e-756ff82abce4 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:27.706717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1b710b3-c9ae-4af1-986e-756ff82abce4 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:27.707469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1b710b3-c9ae-4af1-986e-756ff82abce4 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:27.708123 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1b710b3-c9ae-4af1-986e-756ff82abce4 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:27.937575 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f1b710b3-c9ae-4af1-986e-756ff82abce4 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e52ac750849e4207bbc6e320210bb2b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823f96998a0341559f6a637f9a5b840c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:27.948076 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f1b710b3-c9ae-4af1-986e-756ff82abce4 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff" status: 200 len: 1401 microversion: 2.1 time: 0.294968 Aug 24 10:20:27.948704 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1166/2096] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:27 2022] GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff => generated 1401 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:27.954342 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a7985037-6978-4454-85a7-f6d6c7dfd571 req-4302e666-8cda-4145-9921-8dbd961c72e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5cf9540-fba0-498d-890d-af316b16ceff", "name": "network-vif-plugged", "status": "completed", "tag": "063e9896-ef6d-473a-b00e-f9778234fa16"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:27.973965 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a7985037-6978-4454-85a7-f6d6c7dfd571 req-4302e666-8cda-4145-9921-8dbd961c72e5 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:27.975673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a7985037-6978-4454-85a7-f6d6c7dfd571 req-4302e666-8cda-4145-9921-8dbd961c72e5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:27.976139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a7985037-6978-4454-85a7-f6d6c7dfd571 req-4302e666-8cda-4145-9921-8dbd961c72e5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:27.999082 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a7985037-6978-4454-85a7-f6d6c7dfd571 req-4302e666-8cda-4145-9921-8dbd961c72e5 service nova] Creating event network-vif-plugged:063e9896-ef6d-473a-b00e-f9778234fa16 for instance e5cf9540-fba0-498d-890d-af316b16ceff on n-h1-849328-3 Aug 24 10:20:28.006304 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a7985037-6978-4454-85a7-f6d6c7dfd571 req-4302e666-8cda-4145-9921-8dbd961c72e5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055878 Aug 24 10:20:28.007713 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1167/2097] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:28.016287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3ae89fc-6a45-4f3e-a447-9f7d913997c2 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:28.018003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d3ae89fc-6a45-4f3e-a447-9f7d913997c2 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:28.028197 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3ae89fc-6a45-4f3e-a447-9f7d913997c2 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:28.030423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3ae89fc-6a45-4f3e-a447-9f7d913997c2 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:28.031491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3ae89fc-6a45-4f3e-a447-9f7d913997c2 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:28.032756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3ae89fc-6a45-4f3e-a447-9f7d913997c2 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:28.033727 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3ae89fc-6a45-4f3e-a447-9f7d913997c2 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:28.034929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3ae89fc-6a45-4f3e-a447-9f7d913997c2 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:28.173843 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-d3ae89fc-6a45-4f3e-a447-9f7d913997c2 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lazy-loading 'services' on Instance uuid 3576fbd4-5c72-4025-a40c-e0e1ad348acc {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:28.197185 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d3ae89fc-6a45-4f3e-a447-9f7d913997c2 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1927 microversion: 2.75 time: 0.187708 Aug 24 10:20:28.210080 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1168/2098] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:28 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1927 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:28.233461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-416931c0-2eae-43e8-974f-bd1a6a946326 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:28.233768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-416931c0-2eae-43e8-974f-bd1a6a946326 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] [instance: e5e27996-05a5-41e0-a286-28a6526a95c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:28.249529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-416931c0-2eae-43e8-974f-bd1a6a946326 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:28.250053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-416931c0-2eae-43e8-974f-bd1a6a946326 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:28.250496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-416931c0-2eae-43e8-974f-bd1a6a946326 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:28.251274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-416931c0-2eae-43e8-974f-bd1a6a946326 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:28.251746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-416931c0-2eae-43e8-974f-bd1a6a946326 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:28.252180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-416931c0-2eae-43e8-974f-bd1a6a946326 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:28.477343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-416931c0-2eae-43e8-974f-bd1a6a946326 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f13f6a21e25432f996be6920ee83343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78d9b1aee724032aa9eab0cab0f8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:28.500398 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-416931c0-2eae-43e8-974f-bd1a6a946326 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] 10.222.0.85 "GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4" status: 200 len: 1325 microversion: 2.1 time: 0.273846 Aug 24 10:20:28.524912 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1169/2099] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:28 2022] GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4 => generated 1325 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:28.553907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-08902bd3-456a-4c2b-9571-5093cb22d472 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:28.554738 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-08902bd3-456a-4c2b-9571-5093cb22d472 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: d5e1565f-a210-4fa8-b881-060432acb904] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:28.581459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08902bd3-456a-4c2b-9571-5093cb22d472 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:28.582660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08902bd3-456a-4c2b-9571-5093cb22d472 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:28.583335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08902bd3-456a-4c2b-9571-5093cb22d472 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:28.585034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08902bd3-456a-4c2b-9571-5093cb22d472 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:28.585034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08902bd3-456a-4c2b-9571-5093cb22d472 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:28.585439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08902bd3-456a-4c2b-9571-5093cb22d472 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:28.932746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-08902bd3-456a-4c2b-9571-5093cb22d472 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:28.965952 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-08902bd3-456a-4c2b-9571-5093cb22d472 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904" status: 200 len: 1318 microversion: 2.1 time: 0.420459 Aug 24 10:20:28.975953 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1170/2100] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:28 2022] GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904 => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:28.981270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d8fe57b1-8dad-4b8c-97ef-66e22db93323 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:28.982639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d8fe57b1-8dad-4b8c-97ef-66e22db93323 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] [instance: e5cf9540-fba0-498d-890d-af316b16ceff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:28.997966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8fe57b1-8dad-4b8c-97ef-66e22db93323 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:29.000595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8fe57b1-8dad-4b8c-97ef-66e22db93323 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:29.002452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8fe57b1-8dad-4b8c-97ef-66e22db93323 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:29.003455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8fe57b1-8dad-4b8c-97ef-66e22db93323 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:29.005752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8fe57b1-8dad-4b8c-97ef-66e22db93323 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:29.006556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8fe57b1-8dad-4b8c-97ef-66e22db93323 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:29.140956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:29.435997 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d8fe57b1-8dad-4b8c-97ef-66e22db93323 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e52ac750849e4207bbc6e320210bb2b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823f96998a0341559f6a637f9a5b840c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:29.447176 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d8fe57b1-8dad-4b8c-97ef-66e22db93323 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff" status: 200 len: 1401 microversion: 2.1 time: 0.474932 Aug 24 10:20:29.462687 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1171/2101] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:28 2022] GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff => generated 1401 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:29.462687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2ea7b9a2-6bd3-4f2f-b43b-63ad29f47582 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:29.462687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2ea7b9a2-6bd3-4f2f-b43b-63ad29f47582 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:29.470168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:29.472648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ea7b9a2-6bd3-4f2f-b43b-63ad29f47582 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:29.473296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ea7b9a2-6bd3-4f2f-b43b-63ad29f47582 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:29.473807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ea7b9a2-6bd3-4f2f-b43b-63ad29f47582 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:29.474846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ea7b9a2-6bd3-4f2f-b43b-63ad29f47582 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:29.475681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ea7b9a2-6bd3-4f2f-b43b-63ad29f47582 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:29.476443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ea7b9a2-6bd3-4f2f-b43b-63ad29f47582 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:29.802787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2ea7b9a2-6bd3-4f2f-b43b-63ad29f47582 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:29.816629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2ea7b9a2-6bd3-4f2f-b43b-63ad29f47582 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:29.819492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2ea7b9a2-6bd3-4f2f-b43b-63ad29f47582 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:29.822314 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2ea7b9a2-6bd3-4f2f-b43b-63ad29f47582 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 2945 microversion: 2.32 time: 0.372597 Aug 24 10:20:29.843765 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1172/2102] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:29 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 2945 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:29.870808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1968c5a3-9236-490d-909b-e452cea78b12 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:29.872199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1968c5a3-9236-490d-909b-e452cea78b12 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:29.876104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=18 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:29.886339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1968c5a3-9236-490d-909b-e452cea78b12 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:29.887237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1968c5a3-9236-490d-909b-e452cea78b12 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:29.887885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1968c5a3-9236-490d-909b-e452cea78b12 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:29.888936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1968c5a3-9236-490d-909b-e452cea78b12 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:29.889748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1968c5a3-9236-490d-909b-e452cea78b12 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:29.890526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1968c5a3-9236-490d-909b-e452cea78b12 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:30.009924 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=18 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:30.087179 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-1968c5a3-9236-490d-909b-e452cea78b12 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lazy-loading 'services' on Instance uuid 3576fbd4-5c72-4025-a40c-e0e1ad348acc {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:30.171878 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1968c5a3-9236-490d-909b-e452cea78b12 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1933 microversion: 2.75 time: 0.325548 Aug 24 10:20:30.173622 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1173/2103] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:29 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1933 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:30.193194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f91977c0-2e81-4a06-9e28-25c6536dba05 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:30.194775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f91977c0-2e81-4a06-9e28-25c6536dba05 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] [instance: e5e27996-05a5-41e0-a286-28a6526a95c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:30.208791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f91977c0-2e81-4a06-9e28-25c6536dba05 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:30.210221 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f91977c0-2e81-4a06-9e28-25c6536dba05 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:30.211029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f91977c0-2e81-4a06-9e28-25c6536dba05 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:30.212698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f91977c0-2e81-4a06-9e28-25c6536dba05 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:30.214377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f91977c0-2e81-4a06-9e28-25c6536dba05 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:30.214377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f91977c0-2e81-4a06-9e28-25c6536dba05 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:30.561762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f91977c0-2e81-4a06-9e28-25c6536dba05 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f13f6a21e25432f996be6920ee83343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78d9b1aee724032aa9eab0cab0f8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:30.582788 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f91977c0-2e81-4a06-9e28-25c6536dba05 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] 10.222.0.85 "GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4" status: 200 len: 1325 microversion: 2.1 time: 0.401469 Aug 24 10:20:30.586761 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1174/2104] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:30 2022] GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4 => generated 1325 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:30.598462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-61502e87-f375-4d47-8322-fd059d99a54d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:30.599857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-61502e87-f375-4d47-8322-fd059d99a54d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:30.617330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61502e87-f375-4d47-8322-fd059d99a54d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:30.618432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61502e87-f375-4d47-8322-fd059d99a54d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:30.619301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61502e87-f375-4d47-8322-fd059d99a54d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:30.620317 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61502e87-f375-4d47-8322-fd059d99a54d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:30.621184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61502e87-f375-4d47-8322-fd059d99a54d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:30.622420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61502e87-f375-4d47-8322-fd059d99a54d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:30.882320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:30.928141 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-61502e87-f375-4d47-8322-fd059d99a54d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.339045 Aug 24 10:20:30.941569 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1175/2105] 10.222.0.85 () {60 vars in 1316 bytes} [Wed Aug 24 10:20:30 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd/os-interface => generated 1832 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:30.949360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ae9fadb6-328f-4ce5-8622-b95d15766abe tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:30.950508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ae9fadb6-328f-4ce5-8622-b95d15766abe tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: d5e1565f-a210-4fa8-b881-060432acb904] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:30.958186 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae9fadb6-328f-4ce5-8622-b95d15766abe tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:30.960335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae9fadb6-328f-4ce5-8622-b95d15766abe tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:30.962643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae9fadb6-328f-4ce5-8622-b95d15766abe tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:30.965853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae9fadb6-328f-4ce5-8622-b95d15766abe tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:30.970916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae9fadb6-328f-4ce5-8622-b95d15766abe tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:30.975287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae9fadb6-328f-4ce5-8622-b95d15766abe tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:31.264465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ae9fadb6-328f-4ce5-8622-b95d15766abe tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:31.275503 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ae9fadb6-328f-4ce5-8622-b95d15766abe tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904" status: 200 len: 1318 microversion: 2.1 time: 0.331195 Aug 24 10:20:31.276216 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1176/2106] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:30 2022] GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904 => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:31.281702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ba08ddfe-1521-4434-9fd4-2a7616d62558 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:31.283273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ba08ddfe-1521-4434-9fd4-2a7616d62558 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] [instance: e5cf9540-fba0-498d-890d-af316b16ceff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:31.290743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba08ddfe-1521-4434-9fd4-2a7616d62558 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:31.291617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba08ddfe-1521-4434-9fd4-2a7616d62558 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:31.292397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba08ddfe-1521-4434-9fd4-2a7616d62558 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:31.293623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba08ddfe-1521-4434-9fd4-2a7616d62558 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:31.294346 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba08ddfe-1521-4434-9fd4-2a7616d62558 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:31.300052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba08ddfe-1521-4434-9fd4-2a7616d62558 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:31.354626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=54 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:31.553787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ba08ddfe-1521-4434-9fd4-2a7616d62558 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e52ac750849e4207bbc6e320210bb2b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823f96998a0341559f6a637f9a5b840c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:31.565172 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ba08ddfe-1521-4434-9fd4-2a7616d62558 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff" status: 200 len: 1588 microversion: 2.1 time: 0.286037 Aug 24 10:20:31.565172 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1177/2107] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:31 2022] GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff => generated 1588 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:31.570586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1d4379de-9ebd-42af-8a7b-305ed2702248 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:31.571206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1d4379de-9ebd-42af-8a7b-305ed2702248 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:31.581263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d4379de-9ebd-42af-8a7b-305ed2702248 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:31.583276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d4379de-9ebd-42af-8a7b-305ed2702248 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:31.583924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d4379de-9ebd-42af-8a7b-305ed2702248 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:31.584801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d4379de-9ebd-42af-8a7b-305ed2702248 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:31.585444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d4379de-9ebd-42af-8a7b-305ed2702248 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:31.585801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d4379de-9ebd-42af-8a7b-305ed2702248 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:31.771874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-1d4379de-9ebd-42af-8a7b-305ed2702248 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lazy-loading 'services' on Instance uuid 3576fbd4-5c72-4025-a40c-e0e1ad348acc {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:31.813912 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1d4379de-9ebd-42af-8a7b-305ed2702248 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1933 microversion: 2.75 time: 0.247762 Aug 24 10:20:31.816069 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1178/2108] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:31 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1933 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:31.828054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e1b5310c-c51d-42b5-9c29-115a41ff6cca tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:31.828913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e1b5310c-c51d-42b5-9c29-115a41ff6cca tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] [instance: e5cf9540-fba0-498d-890d-af316b16ceff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:31.844950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1b5310c-c51d-42b5-9c29-115a41ff6cca tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:31.845831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1b5310c-c51d-42b5-9c29-115a41ff6cca tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:31.846477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1b5310c-c51d-42b5-9c29-115a41ff6cca tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:31.847670 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1b5310c-c51d-42b5-9c29-115a41ff6cca tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:31.848323 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1b5310c-c51d-42b5-9c29-115a41ff6cca tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:31.848929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1b5310c-c51d-42b5-9c29-115a41ff6cca tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:31.853965 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:32.018413 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e1b5310c-c51d-42b5-9c29-115a41ff6cca tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.196698 Aug 24 10:20:32.020887 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1179/2109] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Aug 24 10:20:31 2022] GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff/os-interface => generated 284 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:32.059497 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-530b3430-2177-4546-8e2d-8699bf87ca3c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:32.064786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-530b3430-2177-4546-8e2d-8699bf87ca3c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] [instance: e5e27996-05a5-41e0-a286-28a6526a95c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:32.101685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-530b3430-2177-4546-8e2d-8699bf87ca3c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:32.104590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-530b3430-2177-4546-8e2d-8699bf87ca3c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:32.105780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-530b3430-2177-4546-8e2d-8699bf87ca3c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:32.109669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-530b3430-2177-4546-8e2d-8699bf87ca3c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:32.113648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-530b3430-2177-4546-8e2d-8699bf87ca3c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:32.122394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-530b3430-2177-4546-8e2d-8699bf87ca3c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:33.345701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-530b3430-2177-4546-8e2d-8699bf87ca3c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f13f6a21e25432f996be6920ee83343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78d9b1aee724032aa9eab0cab0f8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:33.374569 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-530b3430-2177-4546-8e2d-8699bf87ca3c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] 10.222.0.85 "GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4" status: 200 len: 1325 microversion: 2.1 time: 1.351399 Aug 24 10:20:33.376852 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1180/2110] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:32 2022] GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4 => generated 1325 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:33.404221 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3b8b6568-2f7a-4f9e-b2ad-02d9e2b13150 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:33.412692 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3b8b6568-2f7a-4f9e-b2ad-02d9e2b13150 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: d5e1565f-a210-4fa8-b881-060432acb904] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:33.441746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b8b6568-2f7a-4f9e-b2ad-02d9e2b13150 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:33.443306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b8b6568-2f7a-4f9e-b2ad-02d9e2b13150 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:33.446565 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b8b6568-2f7a-4f9e-b2ad-02d9e2b13150 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:33.449624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b8b6568-2f7a-4f9e-b2ad-02d9e2b13150 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:33.451117 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b8b6568-2f7a-4f9e-b2ad-02d9e2b13150 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:33.452163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b8b6568-2f7a-4f9e-b2ad-02d9e2b13150 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:33.930262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3b8b6568-2f7a-4f9e-b2ad-02d9e2b13150 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:33.982236 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3b8b6568-2f7a-4f9e-b2ad-02d9e2b13150 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904" status: 200 len: 1318 microversion: 2.1 time: 0.594887 Aug 24 10:20:34.009196 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1181/2111] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:33 2022] GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904 => generated 1318 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:34.050494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6e98b841-fafa-4319-a9c8-4fd963214079 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:34.056124 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6e98b841-fafa-4319-a9c8-4fd963214079 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:34.064392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e98b841-fafa-4319-a9c8-4fd963214079 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:34.064890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e98b841-fafa-4319-a9c8-4fd963214079 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:34.066664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e98b841-fafa-4319-a9c8-4fd963214079 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:34.067421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e98b841-fafa-4319-a9c8-4fd963214079 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:34.067879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e98b841-fafa-4319-a9c8-4fd963214079 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:34.071624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e98b841-fafa-4319-a9c8-4fd963214079 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:34.496611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-6e98b841-fafa-4319-a9c8-4fd963214079 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lazy-loading 'services' on Instance uuid 3576fbd4-5c72-4025-a40c-e0e1ad348acc {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:34.572086 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6e98b841-fafa-4319-a9c8-4fd963214079 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1933 microversion: 2.75 time: 0.563032 Aug 24 10:20:34.573946 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1182/2112] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:34 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1933 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:34.582694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-b77ed94d-b5e3-4561-b65e-2a784000e4ca req-90110091-5f6f-4708-b960-c8b643d633c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5e1565f-a210-4fa8-b881-060432acb904", "name": "network-vif-plugged", "status": "completed", "tag": "ee3a649b-1b3b-45fd-bb62-7a88b42d11e3"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:34.634057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b77ed94d-b5e3-4561-b65e-2a784000e4ca req-90110091-5f6f-4708-b960-c8b643d633c6 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:34.639490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b77ed94d-b5e3-4561-b65e-2a784000e4ca req-90110091-5f6f-4708-b960-c8b643d633c6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:34.645588 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b77ed94d-b5e3-4561-b65e-2a784000e4ca req-90110091-5f6f-4708-b960-c8b643d633c6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:34.701429 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-b77ed94d-b5e3-4561-b65e-2a784000e4ca req-90110091-5f6f-4708-b960-c8b643d633c6 service nova] Creating event network-vif-plugged:ee3a649b-1b3b-45fd-bb62-7a88b42d11e3 for instance d5e1565f-a210-4fa8-b881-060432acb904 on n-h1-849328-3 Aug 24 10:20:34.716184 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-b77ed94d-b5e3-4561-b65e-2a784000e4ca req-90110091-5f6f-4708-b960-c8b643d633c6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138001 Aug 24 10:20:34.719705 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1183/2113] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:35.209016 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ca19398c-8e66-4107-bebc-c628984027dc tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-379132465", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "34b8e8f2-e7b5-495a-968f-aa18042c24f0"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:36.456966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:40.541406 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-15cbdb63-7098-4e1e-9044-84aaacfd9139 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/253f0edd-9ca3-4b50-b54e-fbb9518b9726" status: 200 len: 1455 microversion: 2.1 time: 19.140209 Aug 24 10:20:40.555710 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 931/2114] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:20:21 2022] GET /compute/v2.1/images/253f0edd-9ca3-4b50-b54e-fbb9518b9726 => generated 1455 bytes in 19154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:40.561352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-ca19398c-8e66-4107-bebc-c628984027dc tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] validate_networks() for [('34b8e8f2-e7b5-495a-968f-aa18042c24f0', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:20:40.562102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5977ad3a-fe1c-46d7-bd8d-2b7a22eb496a tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:40.562693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5977ad3a-fe1c-46d7-bd8d-2b7a22eb496a tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] [instance: e5e27996-05a5-41e0-a286-28a6526a95c4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:40.569697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5977ad3a-fe1c-46d7-bd8d-2b7a22eb496a tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:40.570182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5977ad3a-fe1c-46d7-bd8d-2b7a22eb496a tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:40.571050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5977ad3a-fe1c-46d7-bd8d-2b7a22eb496a tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:40.571956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5977ad3a-fe1c-46d7-bd8d-2b7a22eb496a tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:40.572733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5977ad3a-fe1c-46d7-bd8d-2b7a22eb496a tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:40.573623 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5977ad3a-fe1c-46d7-bd8d-2b7a22eb496a tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:40.786108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5977ad3a-fe1c-46d7-bd8d-2b7a22eb496a tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f13f6a21e25432f996be6920ee83343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78d9b1aee724032aa9eab0cab0f8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:40.807836 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5977ad3a-fe1c-46d7-bd8d-2b7a22eb496a tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] 10.222.0.85 "GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4" status: 200 len: 1325 microversion: 2.1 time: 0.250446 Aug 24 10:20:40.809566 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 932/2115] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:40 2022] GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4 => generated 1325 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:40.814876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-130e6e96-df66-472c-9fb9-334e33143d6e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:40.815690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-130e6e96-df66-472c-9fb9-334e33143d6e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: d5e1565f-a210-4fa8-b881-060432acb904] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:40.825618 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-130e6e96-df66-472c-9fb9-334e33143d6e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:40.826467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-130e6e96-df66-472c-9fb9-334e33143d6e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:40.827068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-130e6e96-df66-472c-9fb9-334e33143d6e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:40.827953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-130e6e96-df66-472c-9fb9-334e33143d6e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:40.828575 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-130e6e96-df66-472c-9fb9-334e33143d6e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:40.829214 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-130e6e96-df66-472c-9fb9-334e33143d6e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:41.103878 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-130e6e96-df66-472c-9fb9-334e33143d6e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:41.105350 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-130e6e96-df66-472c-9fb9-334e33143d6e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904" status: 200 len: 1468 microversion: 2.1 time: 0.293957 Aug 24 10:20:41.106374 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 933/2116] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:40 2022] GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904 => generated 1468 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:41.114607 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8cc56207-133b-4977-a586-97a5c3d23404 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:41.116382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8cc56207-133b-4977-a586-97a5c3d23404 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:41.137837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc56207-133b-4977-a586-97a5c3d23404 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:41.138925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc56207-133b-4977-a586-97a5c3d23404 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:41.139625 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc56207-133b-4977-a586-97a5c3d23404 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:41.140613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc56207-133b-4977-a586-97a5c3d23404 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:41.141423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc56207-133b-4977-a586-97a5c3d23404 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:41.142303 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc56207-133b-4977-a586-97a5c3d23404 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:41.250471 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ca19398c-8e66-4107-bebc-c628984027dc tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:20:41.251114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ca19398c-8e66-4107-bebc-c628984027dc tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:20:41.251739 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ca19398c-8e66-4107-bebc-c628984027dc tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:20:41.252913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ca19398c-8e66-4107-bebc-c628984027dc tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:20:41.253580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ca19398c-8e66-4107-bebc-c628984027dc tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:20:41.260453 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-8cc56207-133b-4977-a586-97a5c3d23404 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] Lazy-loading 'services' on Instance uuid 3576fbd4-5c72-4025-a40c-e0e1ad348acc {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:41.272219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca19398c-8e66-4107-bebc-c628984027dc tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:41.273036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca19398c-8e66-4107-bebc-c628984027dc tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:41.273553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca19398c-8e66-4107-bebc-c628984027dc tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:41.274359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca19398c-8e66-4107-bebc-c628984027dc tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:41.276342 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca19398c-8e66-4107-bebc-c628984027dc tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:41.276853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca19398c-8e66-4107-bebc-c628984027dc tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:41.312220 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8cc56207-133b-4977-a586-97a5c3d23404 tempest-ServersAdmin275Test-759770492 tempest-ServersAdmin275Test-759770492-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1918 microversion: 2.75 time: 0.203925 Aug 24 10:20:41.313176 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 934/2117] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:41 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1918 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:41.313943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-ca19398c-8e66-4107-bebc-c628984027dc tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Getting quotas for project 4b648a28a11e4016a1fe87ea6b6f01b2. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:20:41.321487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-ca19398c-8e66-4107-bebc-c628984027dc tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Getting quotas for user d4163d2bb72c43e7b0315c5e782d5fa7 and project 4b648a28a11e4016a1fe87ea6b6f01b2. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:20:41.324445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-21d6e4f5-a924-4f5e-b093-fc94b5f73e58 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:41.334818 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-21d6e4f5-a924-4f5e-b093-fc94b5f73e58 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] [instance: e5cf9540-fba0-498d-890d-af316b16ceff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:41.340422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ca19398c-8e66-4107-bebc-c628984027dc tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:20:41.342058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21d6e4f5-a924-4f5e-b093-fc94b5f73e58 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:41.342618 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21d6e4f5-a924-4f5e-b093-fc94b5f73e58 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:41.343149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21d6e4f5-a924-4f5e-b093-fc94b5f73e58 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:41.343985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21d6e4f5-a924-4f5e-b093-fc94b5f73e58 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:41.344183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ca19398c-8e66-4107-bebc-c628984027dc tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: 2bc88682-b0f5-42fc-88e5-a74d75b8e241] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:20:41.344643 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21d6e4f5-a924-4f5e-b093-fc94b5f73e58 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:41.345482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21d6e4f5-a924-4f5e-b093-fc94b5f73e58 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:41.436907 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ca19398c-8e66-4107-bebc-c628984027dc tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.715180 Aug 24 10:20:41.437833 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1184/2118] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:20:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 6717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:20:41.449152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-48ed7a21-098c-4cd1-a187-bdaba73cc8dc req-a5b0446e-6fd0-47a8-bf19-f194d67a1cfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5cf9540-fba0-498d-890d-af316b16ceff", "tag": "063e9896-ef6d-473a-b00e-f9778234fa16"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:41.478471 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-48ed7a21-098c-4cd1-a187-bdaba73cc8dc req-a5b0446e-6fd0-47a8-bf19-f194d67a1cfe service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:41.478962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-48ed7a21-098c-4cd1-a187-bdaba73cc8dc req-a5b0446e-6fd0-47a8-bf19-f194d67a1cfe service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:41.479403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-48ed7a21-098c-4cd1-a187-bdaba73cc8dc req-a5b0446e-6fd0-47a8-bf19-f194d67a1cfe service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:41.507582 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-48ed7a21-098c-4cd1-a187-bdaba73cc8dc req-a5b0446e-6fd0-47a8-bf19-f194d67a1cfe service nova] Creating event network-changed:063e9896-ef6d-473a-b00e-f9778234fa16 for instance e5cf9540-fba0-498d-890d-af316b16ceff on n-h1-849328-3 Aug 24 10:20:41.519945 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-48ed7a21-098c-4cd1-a187-bdaba73cc8dc req-a5b0446e-6fd0-47a8-bf19-f194d67a1cfe service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080524 Aug 24 10:20:41.520575 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1185/2119] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:41.544244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-7d7d25ef-9225-4235-861b-dbbd37d03e9c req-f2499b75-6ffa-4c62-9213-2574be895236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e27996-05a5-41e0-a286-28a6526a95c4", "name": "network-vif-plugged", "status": "completed", "tag": "1a6d286f-5d67-4cbe-a84b-791e2bfef490"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:41.584667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7d7d25ef-9225-4235-861b-dbbd37d03e9c req-f2499b75-6ffa-4c62-9213-2574be895236 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:41.585247 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7d7d25ef-9225-4235-861b-dbbd37d03e9c req-f2499b75-6ffa-4c62-9213-2574be895236 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:41.585607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7d7d25ef-9225-4235-861b-dbbd37d03e9c req-f2499b75-6ffa-4c62-9213-2574be895236 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:41.662868 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-7d7d25ef-9225-4235-861b-dbbd37d03e9c req-f2499b75-6ffa-4c62-9213-2574be895236 service nova] Creating event network-vif-plugged:1a6d286f-5d67-4cbe-a84b-791e2bfef490 for instance e5e27996-05a5-41e0-a286-28a6526a95c4 on n-h2-849328-3 Aug 24 10:20:41.688358 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-7d7d25ef-9225-4235-861b-dbbd37d03e9c req-f2499b75-6ffa-4c62-9213-2574be895236 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158379 Aug 24 10:20:41.690451 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1186/2120] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:41.721587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ec2f0d6-e9c4-4100-956c-3c4571f77a3d tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:41.723245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0ec2f0d6-e9c4-4100-956c-3c4571f77a3d tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] [instance: d5e1565f-a210-4fa8-b881-060432acb904] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:41.745647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ec2f0d6-e9c4-4100-956c-3c4571f77a3d tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:41.747011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ec2f0d6-e9c4-4100-956c-3c4571f77a3d tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:41.751701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ec2f0d6-e9c4-4100-956c-3c4571f77a3d tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:41.754414 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ec2f0d6-e9c4-4100-956c-3c4571f77a3d tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:41.758280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ec2f0d6-e9c4-4100-956c-3c4571f77a3d tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:41.759379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ec2f0d6-e9c4-4100-956c-3c4571f77a3d tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:41.870373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-21d6e4f5-a924-4f5e-b093-fc94b5f73e58 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e52ac750849e4207bbc6e320210bb2b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823f96998a0341559f6a637f9a5b840c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:41.880802 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-21d6e4f5-a924-4f5e-b093-fc94b5f73e58 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff" status: 200 len: 1588 microversion: 2.1 time: 0.566097 Aug 24 10:20:41.888025 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 935/2121] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:41 2022] GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff => generated 1588 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:41.895062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-0ec2f0d6-e9c4-4100-956c-3c4571f77a3d tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Lazy-loading 'flavor' on Instance uuid d5e1565f-a210-4fa8-b881-060432acb904 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:41.895567 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-72a9cb23-6b6c-448a-a80d-00411b1266b3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:41.897747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-72a9cb23-6b6c-448a-a80d-00411b1266b3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:41.915845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72a9cb23-6b6c-448a-a80d-00411b1266b3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:41.919847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72a9cb23-6b6c-448a-a80d-00411b1266b3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:41.920891 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72a9cb23-6b6c-448a-a80d-00411b1266b3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:41.922207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72a9cb23-6b6c-448a-a80d-00411b1266b3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:41.924627 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72a9cb23-6b6c-448a-a80d-00411b1266b3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:41.925278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72a9cb23-6b6c-448a-a80d-00411b1266b3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:41.979465 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-72a9cb23-6b6c-448a-a80d-00411b1266b3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:20:42.135057 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0ec2f0d6-e9c4-4100-956c-3c4571f77a3d tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904/action" status: 202 len: 0 microversion: 2.1 time: 0.434810 Aug 24 10:20:42.140237 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1187/2122] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:20:41 2022] POST /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:20:42.153092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6b24a83a-1e50-485a-89f8-a2c8cf347e85 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-770316959", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "34b8e8f2-e7b5-495a-968f-aa18042c24f0"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:42.184593 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-72a9cb23-6b6c-448a-a80d-00411b1266b3 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "DELETE /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 204 len: 0 microversion: 2.75 time: 0.294455 Aug 24 10:20:42.186116 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 936/2123] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:20:41 2022] DELETE /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:20:42.247550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0ae4a280-7053-46f5-979a-e2ff57b8a61e tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f46554b9dc0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:42.309712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-6b24a83a-1e50-485a-89f8-a2c8cf347e85 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] validate_networks() for [('34b8e8f2-e7b5-495a-968f-aa18042c24f0', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:20:42.372898 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0ae4a280-7053-46f5-979a-e2ff57b8a61e tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/253f0edd-9ca3-4b50-b54e-fbb9518b9726" status: 200 len: 1455 microversion: 2.1 time: 0.182035 Aug 24 10:20:42.374146 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 937/2124] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:20:42 2022] GET /compute/v2.1/images/253f0edd-9ca3-4b50-b54e-fbb9518b9726 => generated 1455 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:42.398396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e17ffaf4-a602-4f9d-bddc-d84bc810c552 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:42.399646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e17ffaf4-a602-4f9d-bddc-d84bc810c552 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] [instance: e5e27996-05a5-41e0-a286-28a6526a95c4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:42.427625 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e17ffaf4-a602-4f9d-bddc-d84bc810c552 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:42.432047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e17ffaf4-a602-4f9d-bddc-d84bc810c552 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:42.432846 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e17ffaf4-a602-4f9d-bddc-d84bc810c552 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:42.437569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e17ffaf4-a602-4f9d-bddc-d84bc810c552 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:42.439105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e17ffaf4-a602-4f9d-bddc-d84bc810c552 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:42.441435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e17ffaf4-a602-4f9d-bddc-d84bc810c552 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:42.795577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e17ffaf4-a602-4f9d-bddc-d84bc810c552 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f13f6a21e25432f996be6920ee83343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78d9b1aee724032aa9eab0cab0f8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:42.805423 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e17ffaf4-a602-4f9d-bddc-d84bc810c552 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] 10.222.0.85 "GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4" status: 200 len: 1325 microversion: 2.1 time: 0.428920 Aug 24 10:20:42.806416 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 938/2125] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:42 2022] GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4 => generated 1325 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:42.815820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c29fddc6-6038-47f1-b130-ea69c1525465 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:42.816745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c29fddc6-6038-47f1-b130-ea69c1525465 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: d5e1565f-a210-4fa8-b881-060432acb904] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:42.828136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c29fddc6-6038-47f1-b130-ea69c1525465 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:42.828917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c29fddc6-6038-47f1-b130-ea69c1525465 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:42.829684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c29fddc6-6038-47f1-b130-ea69c1525465 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:42.831294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c29fddc6-6038-47f1-b130-ea69c1525465 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:42.832082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c29fddc6-6038-47f1-b130-ea69c1525465 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:42.832802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c29fddc6-6038-47f1-b130-ea69c1525465 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:43.088442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c29fddc6-6038-47f1-b130-ea69c1525465 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:43.097110 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c29fddc6-6038-47f1-b130-ea69c1525465 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904" status: 200 len: 1476 microversion: 2.1 time: 0.288836 Aug 24 10:20:43.113557 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 939/2126] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:42 2022] GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904 => generated 1476 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:43.123210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d40fd313-dd68-4fb8-816a-7efe29f319ac tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:43.125013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-6b24a83a-1e50-485a-89f8-a2c8cf347e85 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:20:43.126102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-6b24a83a-1e50-485a-89f8-a2c8cf347e85 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:20:43.127533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-6b24a83a-1e50-485a-89f8-a2c8cf347e85 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:20:43.127986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d40fd313-dd68-4fb8-816a-7efe29f319ac tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:43.128365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-6b24a83a-1e50-485a-89f8-a2c8cf347e85 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:20:43.130989 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-6b24a83a-1e50-485a-89f8-a2c8cf347e85 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:20:43.140880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d40fd313-dd68-4fb8-816a-7efe29f319ac tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:43.141589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d40fd313-dd68-4fb8-816a-7efe29f319ac tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:43.146139 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d40fd313-dd68-4fb8-816a-7efe29f319ac tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:43.146671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d40fd313-dd68-4fb8-816a-7efe29f319ac tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:43.147276 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d40fd313-dd68-4fb8-816a-7efe29f319ac tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:43.147826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d40fd313-dd68-4fb8-816a-7efe29f319ac tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:43.153629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b24a83a-1e50-485a-89f8-a2c8cf347e85 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:43.155002 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b24a83a-1e50-485a-89f8-a2c8cf347e85 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:43.156076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b24a83a-1e50-485a-89f8-a2c8cf347e85 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:43.158225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b24a83a-1e50-485a-89f8-a2c8cf347e85 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:43.159227 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b24a83a-1e50-485a-89f8-a2c8cf347e85 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:43.160691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b24a83a-1e50-485a-89f8-a2c8cf347e85 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:43.202779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-6b24a83a-1e50-485a-89f8-a2c8cf347e85 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Getting quotas for project 4b648a28a11e4016a1fe87ea6b6f01b2. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:20:43.227449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-6b24a83a-1e50-485a-89f8-a2c8cf347e85 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Getting quotas for user d4163d2bb72c43e7b0315c5e782d5fa7 and project 4b648a28a11e4016a1fe87ea6b6f01b2. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:20:43.255307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6b24a83a-1e50-485a-89f8-a2c8cf347e85 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:20:43.256278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d40fd313-dd68-4fb8-816a-7efe29f319ac tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:43.260464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6b24a83a-1e50-485a-89f8-a2c8cf347e85 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: ea87f606-60c3-4789-871d-8a8ffc4e0612] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:20:43.276497 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d40fd313-dd68-4fb8-816a-7efe29f319ac tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:43.280805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d40fd313-dd68-4fb8-816a-7efe29f319ac tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:43.290678 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d40fd313-dd68-4fb8-816a-7efe29f319ac tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1443 microversion: 2.75 time: 0.171654 Aug 24 10:20:43.291933 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 940/2127] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:43 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1443 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:43.352447 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6b24a83a-1e50-485a-89f8-a2c8cf347e85 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.213986 Aug 24 10:20:43.357787 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1188/2128] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:20:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:20:43.394083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f9e4c6fc-44d5-4c6e-82c9-a2a5dbffb8e7 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f46550f5670>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:43.486909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7253c40e-d707-4af9-bf50-ec794a0bdcfe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1292182986", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "451", "networks": [{"uuid": "34b8e8f2-e7b5-495a-968f-aa18042c24f0"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:43.538459 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f9e4c6fc-44d5-4c6e-82c9-a2a5dbffb8e7 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/253f0edd-9ca3-4b50-b54e-fbb9518b9726" status: 200 len: 1464 microversion: 2.1 time: 0.152303 Aug 24 10:20:43.540361 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 941/2129] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:20:43 2022] GET /compute/v2.1/images/253f0edd-9ca3-4b50-b54e-fbb9518b9726 => generated 1464 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:43.557019 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e8018ff7-e8f7-47d2-bf96-01085dde9b5d tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f465a259280>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:43.597017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-7253c40e-d707-4af9-bf50-ec794a0bdcfe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] validate_networks() for [('34b8e8f2-e7b5-495a-968f-aa18042c24f0', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:20:43.630123 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e8018ff7-e8f7-47d2-bf96-01085dde9b5d tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/253f0edd-9ca3-4b50-b54e-fbb9518b9726" status: 200 len: 1464 microversion: 2.1 time: 0.079038 Aug 24 10:20:43.631799 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 942/2130] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:20:43 2022] GET /compute/v2.1/images/253f0edd-9ca3-4b50-b54e-fbb9518b9726 => generated 1464 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:43.647505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a9d354cb-b389-402b-9477-379e3c1f0b3f tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:43.648129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a9d354cb-b389-402b-9477-379e3c1f0b3f tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:43.654800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9d354cb-b389-402b-9477-379e3c1f0b3f tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:43.655280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9d354cb-b389-402b-9477-379e3c1f0b3f tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:43.655683 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9d354cb-b389-402b-9477-379e3c1f0b3f tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:43.656423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9d354cb-b389-402b-9477-379e3c1f0b3f tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:43.656892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9d354cb-b389-402b-9477-379e3c1f0b3f tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:43.657372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9d354cb-b389-402b-9477-379e3c1f0b3f tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:43.894134 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a9d354cb-b389-402b-9477-379e3c1f0b3f tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:43.911208 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a9d354cb-b389-402b-9477-379e3c1f0b3f tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb" status: 200 len: 1468 microversion: 2.1 time: 0.266962 Aug 24 10:20:43.929881 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 943/2131] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:43 2022] GET /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb => generated 1468 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:43.936206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92aaea10-ae2c-4a2a-8db3-03dbf0085c9c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:43.936968 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-92aaea10-ae2c-4a2a-8db3-03dbf0085c9c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] [instance: e5e27996-05a5-41e0-a286-28a6526a95c4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:43.945247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92aaea10-ae2c-4a2a-8db3-03dbf0085c9c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:43.945829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92aaea10-ae2c-4a2a-8db3-03dbf0085c9c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:43.946364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92aaea10-ae2c-4a2a-8db3-03dbf0085c9c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:43.947184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92aaea10-ae2c-4a2a-8db3-03dbf0085c9c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:43.947706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92aaea10-ae2c-4a2a-8db3-03dbf0085c9c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:43.948199 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92aaea10-ae2c-4a2a-8db3-03dbf0085c9c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:44.350923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-7253c40e-d707-4af9-bf50-ec794a0bdcfe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:20:44.352662 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-7253c40e-d707-4af9-bf50-ec794a0bdcfe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:20:44.354061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-7253c40e-d707-4af9-bf50-ec794a0bdcfe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:20:44.354889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-7253c40e-d707-4af9-bf50-ec794a0bdcfe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:20:44.356011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-7253c40e-d707-4af9-bf50-ec794a0bdcfe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:20:44.372546 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7253c40e-d707-4af9-bf50-ec794a0bdcfe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:44.373914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7253c40e-d707-4af9-bf50-ec794a0bdcfe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:44.374807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7253c40e-d707-4af9-bf50-ec794a0bdcfe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:44.376459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7253c40e-d707-4af9-bf50-ec794a0bdcfe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:44.377492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7253c40e-d707-4af9-bf50-ec794a0bdcfe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:44.378396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7253c40e-d707-4af9-bf50-ec794a0bdcfe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:44.400727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-92aaea10-ae2c-4a2a-8db3-03dbf0085c9c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f13f6a21e25432f996be6920ee83343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78d9b1aee724032aa9eab0cab0f8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:44.420168 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-92aaea10-ae2c-4a2a-8db3-03dbf0085c9c tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] 10.222.0.85 "GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4" status: 200 len: 1325 microversion: 2.1 time: 0.485890 Aug 24 10:20:44.421803 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 944/2132] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:43 2022] GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4 => generated 1325 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:44.429009 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ca219db2-32b3-47f9-8bd3-45d0f0f754b2 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-672643688"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:44.429209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-7253c40e-d707-4af9-bf50-ec794a0bdcfe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Getting quotas for project 4b648a28a11e4016a1fe87ea6b6f01b2. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:20:44.432004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ca219db2-32b3-47f9-8bd3-45d0f0f754b2 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: 8a4ddf34-af18-4e02-a306-c1c67f5c0b28] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:44.440046 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca219db2-32b3-47f9-8bd3-45d0f0f754b2 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:44.440425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-7253c40e-d707-4af9-bf50-ec794a0bdcfe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Getting quotas for user d4163d2bb72c43e7b0315c5e782d5fa7 and project 4b648a28a11e4016a1fe87ea6b6f01b2. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:20:44.441163 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca219db2-32b3-47f9-8bd3-45d0f0f754b2 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:44.441776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca219db2-32b3-47f9-8bd3-45d0f0f754b2 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:44.442720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca219db2-32b3-47f9-8bd3-45d0f0f754b2 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:44.443380 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca219db2-32b3-47f9-8bd3-45d0f0f754b2 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:44.443960 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca219db2-32b3-47f9-8bd3-45d0f0f754b2 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:44.460844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7253c40e-d707-4af9-bf50-ec794a0bdcfe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:20:44.463548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7253c40e-d707-4af9-bf50-ec794a0bdcfe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: b47ddbf3-ca84-419b-ae08-916fb959be5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:20:44.585812 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7253c40e-d707-4af9-bf50-ec794a0bdcfe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.107156 Aug 24 10:20:44.590654 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1189/2133] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:20:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:20:44.600261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb912ffe-a276-4582-8170-39cf80625b73 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:44.601371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cb912ffe-a276-4582-8170-39cf80625b73 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: d5e1565f-a210-4fa8-b881-060432acb904] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:44.611487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb912ffe-a276-4582-8170-39cf80625b73 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:44.612618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb912ffe-a276-4582-8170-39cf80625b73 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:44.613959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb912ffe-a276-4582-8170-39cf80625b73 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:44.615892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb912ffe-a276-4582-8170-39cf80625b73 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:44.616995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb912ffe-a276-4582-8170-39cf80625b73 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:44.649555 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb912ffe-a276-4582-8170-39cf80625b73 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:44.785346 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ca219db2-32b3-47f9-8bd3-45d0f0f754b2 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "POST /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28/action" status: 202 len: 0 microversion: 2.1 time: 0.360404 Aug 24 10:20:44.785346 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 945/2134] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:20:44 2022] POST /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 10:20:44.806301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-14bf5405-44d4-4109-829b-949920fbd84b tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:44.809703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-14bf5405-44d4-4109-829b-949920fbd84b tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:44.830322 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14bf5405-44d4-4109-829b-949920fbd84b tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:44.830322 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14bf5405-44d4-4109-829b-949920fbd84b tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:44.830322 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14bf5405-44d4-4109-829b-949920fbd84b tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:44.830322 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14bf5405-44d4-4109-829b-949920fbd84b tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:44.830322 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14bf5405-44d4-4109-829b-949920fbd84b tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:44.845545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14bf5405-44d4-4109-829b-949920fbd84b tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:44.964852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cb912ffe-a276-4582-8170-39cf80625b73 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:44.979478 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cb912ffe-a276-4582-8170-39cf80625b73 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904" status: 200 len: 1459 microversion: 2.1 time: 0.384308 Aug 24 10:20:44.979478 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1190/2135] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:44 2022] GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904 => generated 1459 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:44.984303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f42dbe46-923e-43c5-bd93-f57ce057ea3f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:44.984937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f42dbe46-923e-43c5-bd93-f57ce057ea3f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: b47ddbf3-ca84-419b-ae08-916fb959be5c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:45.034707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-14bf5405-44d4-4109-829b-949920fbd84b tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:45.080990 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-14bf5405-44d4-4109-829b-949920fbd84b tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:45.085947 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-14bf5405-44d4-4109-829b-949920fbd84b tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:45.097678 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-14bf5405-44d4-4109-829b-949920fbd84b tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1443 microversion: 2.75 time: 0.303040 Aug 24 10:20:45.098629 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 946/2136] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:44 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1443 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:45.103858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1f184954-c3c3-4747-82d0-985a1f32553c tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f465a2591f0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:45.115644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f42dbe46-923e-43c5-bd93-f57ce057ea3f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:45.135381 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f42dbe46-923e-43c5-bd93-f57ce057ea3f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c" status: 200 len: 1221 microversion: 2.1 time: 0.154958 Aug 24 10:20:45.157170 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1191/2137] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:44 2022] GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c => generated 1221 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:45.167540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f23f266f-ee50-4f22-b1de-5da974352880 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:45.168844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f23f266f-ee50-4f22-b1de-5da974352880 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] [instance: d5e1565f-a210-4fa8-b881-060432acb904] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:45.181550 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1f184954-c3c3-4747-82d0-985a1f32553c tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1454 microversion: 2.1 time: 0.080988 Aug 24 10:20:45.182647 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 947/2138] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:20:45 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1454 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:45.193276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f23f266f-ee50-4f22-b1de-5da974352880 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:45.194350 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f23f266f-ee50-4f22-b1de-5da974352880 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:45.195175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f23f266f-ee50-4f22-b1de-5da974352880 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:45.196056 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f23f266f-ee50-4f22-b1de-5da974352880 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:45.197173 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f23f266f-ee50-4f22-b1de-5da974352880 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:45.197768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f23f266f-ee50-4f22-b1de-5da974352880 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:45.445308 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e0c50970-4d97-433e-8aa1-53fe2e466ed6 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:45.446790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e0c50970-4d97-433e-8aa1-53fe2e466ed6 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] [instance: e5e27996-05a5-41e0-a286-28a6526a95c4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:45.485187 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0c50970-4d97-433e-8aa1-53fe2e466ed6 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:45.496074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0c50970-4d97-433e-8aa1-53fe2e466ed6 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:45.496757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0c50970-4d97-433e-8aa1-53fe2e466ed6 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:45.497586 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0c50970-4d97-433e-8aa1-53fe2e466ed6 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:45.501888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0c50970-4d97-433e-8aa1-53fe2e466ed6 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:45.502383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0c50970-4d97-433e-8aa1-53fe2e466ed6 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:45.823156 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f23f266f-ee50-4f22-b1de-5da974352880 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904" status: 200 len: 1610 microversion: 2.1 time: 0.673581 Aug 24 10:20:45.824040 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1192/2139] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:45 2022] GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904 => generated 1610 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:45.844616 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1bef5a43-1d66-4caf-bf6e-3db51bd6b051 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:45.848093 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:20:45.848093 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:20:45.849568 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bef5a43-1d66-4caf-bf6e-3db51bd6b051 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:45.850076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bef5a43-1d66-4caf-bf6e-3db51bd6b051 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:45.850599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bef5a43-1d66-4caf-bf6e-3db51bd6b051 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:45.851367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bef5a43-1d66-4caf-bf6e-3db51bd6b051 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:45.851855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bef5a43-1d66-4caf-bf6e-3db51bd6b051 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:45.852297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bef5a43-1d66-4caf-bf6e-3db51bd6b051 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:45.887067 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1bef5a43-1d66-4caf-bf6e-3db51bd6b051 tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] 10.222.0.85 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.043880 Aug 24 10:20:45.893318 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1193/2140] 10.222.0.85 () {58 vars in 1176 bytes} [Wed Aug 24 10:20:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:20:45.899587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a99e3c3c-72ba-418b-8698-f8350a6af4fd tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-849328-3", "block_migration": true, "disk_over_commit": false}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:45.902702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a99e3c3c-72ba-418b-8698-f8350a6af4fd tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] [instance: d5e1565f-a210-4fa8-b881-060432acb904] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:45.931978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a99e3c3c-72ba-418b-8698-f8350a6af4fd tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:45.932938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a99e3c3c-72ba-418b-8698-f8350a6af4fd tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:45.934342 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a99e3c3c-72ba-418b-8698-f8350a6af4fd tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:45.936592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a99e3c3c-72ba-418b-8698-f8350a6af4fd tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:45.939600 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a99e3c3c-72ba-418b-8698-f8350a6af4fd tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:45.941520 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a99e3c3c-72ba-418b-8698-f8350a6af4fd tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:46.006129 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-a99e3c3c-72ba-418b-8698-f8350a6af4fd tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Lazy-loading 'flavor' on Instance uuid d5e1565f-a210-4fa8-b881-060432acb904 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:46.023176 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-a99e3c3c-72ba-418b-8698-f8350a6af4fd tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance d5e1565f-a210-4fa8-b881-060432acb904 while it is in vm_state suspended Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a99e3c3c-72ba-418b-8698-f8350a6af4fd tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Request method failure captured: Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904/action HTTP/1.1 Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 97 Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBftCFAH349QygIayfMr4xn402aZg7s_42AW8w3G85eo2_r3eYiM4LWGIfUYGmbrZqmrqvNsouLpMr7d-2XBrkIqAlJNQbP40DjY4e3gqkEDu9lFyr3TraV_aWBy8o4ftl_fb0_dGXG2joKOwYbvqNrEBw_Je_t6nams02JJD_eNCml8 Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 3ab8c833dbe64f46bda3197bb3fbc3a3 Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-LiveMigrationNegativeTest-1155257422 Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3ab8c833dbe64f46bda3197bb3fbc3a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3ab8c833dbe64f46bda3197bb3fbc3a3", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3ab8c833dbe64f46bda3197bb3fbc3a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3ab8c833dbe64f46bda3197bb3fbc3a3"}]}] Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-LiveMigrationNegativeTest-1155257422 Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 3ab8c833dbe64f46bda3197bb3fbc3a3 Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1155257422 Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-LiveMigrationNegativeTest-1155257422-project-admin Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: dc1956472c6444138fd0dc15f5dc6d21 Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-LiveMigrationNegativeTest-1155257422-project-admin Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: {"os-migrateLive": {"host": "n-h2-849328-3", "block_migration": true, "disk_over_commit": false}} Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: exception: Cannot 'os-migrateLive' instance d5e1565f-a210-4fa8-b881-060432acb904 while it is in vm_state suspended Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'd5e1565f-a210-4fa8-b881-060432acb904', 'body': {'os-migrateLive': {'host': 'n-h2-849328-3', 'block_migration': True, 'disk_over_commit': False}}} Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d5e1565f-a210-4fa8-b881-060432acb904 in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:46.026371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:46.029486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:46.029486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:20:46.029486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:20:46.029486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:20:46.029486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:20:46.029486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:20:46.029486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:20:46.029486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:20:46.029486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:20:46.029486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:20:46.029486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:20:46.029486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 24 10:20:46.029486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 24 10:20:46.029486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 10:20:46.029486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 10:20:46.029486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 10:20:46.029486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance d5e1565f-a210-4fa8-b881-060432acb904 while it is in vm_state suspended Aug 24 10:20:46.029486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:46.029486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:46.029486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:46.029486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:46.029486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:46.029486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:46.029486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:20:46.029486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:20:46.029486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance d5e1565f-a210-4fa8-b881-060432acb904 while it is in vm_state suspended Aug 24 10:20:46.029486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:46.032505 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a99e3c3c-72ba-418b-8698-f8350a6af4fd tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance d5e1565f-a210-4fa8-b881-060432acb904 while it is in vm_state suspended {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:20:46.035216 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a99e3c3c-72ba-418b-8698-f8350a6af4fd tempest-LiveMigrationNegativeTest-1155257422 tempest-LiveMigrationNegativeTest-1155257422-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904/action" status: 409 len: 155 microversion: 2.1 time: 0.139405 Aug 24 10:20:46.036124 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1194/2141] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:20:45 2022] POST /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904/action => generated 155 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:20:46.051293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aba663fb-c8c9-4256-9e03-b97f3e82ec89 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:46.053112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aba663fb-c8c9-4256-9e03-b97f3e82ec89 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: d5e1565f-a210-4fa8-b881-060432acb904] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:46.067595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aba663fb-c8c9-4256-9e03-b97f3e82ec89 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:46.073219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aba663fb-c8c9-4256-9e03-b97f3e82ec89 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:46.074064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aba663fb-c8c9-4256-9e03-b97f3e82ec89 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:46.074981 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aba663fb-c8c9-4256-9e03-b97f3e82ec89 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:46.075493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aba663fb-c8c9-4256-9e03-b97f3e82ec89 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:46.075939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aba663fb-c8c9-4256-9e03-b97f3e82ec89 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:46.110868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aba663fb-c8c9-4256-9e03-b97f3e82ec89 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: d5e1565f-a210-4fa8-b881-060432acb904] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:20:46.114861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e0c50970-4d97-433e-8aa1-53fe2e466ed6 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f13f6a21e25432f996be6920ee83343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78d9b1aee724032aa9eab0cab0f8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:46.132033 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e0c50970-4d97-433e-8aa1-53fe2e466ed6 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] 10.222.0.85 "GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4" status: 200 len: 1521 microversion: 2.1 time: 0.690869 Aug 24 10:20:46.134092 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 948/2142] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:45 2022] GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4 => generated 1521 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:46.142065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0d73f557-e15f-41d8-9564-ba2907a47154 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:46.142909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0d73f557-e15f-41d8-9564-ba2907a47154 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:46.162652 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d73f557-e15f-41d8-9564-ba2907a47154 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:46.163782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d73f557-e15f-41d8-9564-ba2907a47154 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:46.167675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d73f557-e15f-41d8-9564-ba2907a47154 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:46.171400 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d73f557-e15f-41d8-9564-ba2907a47154 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:46.172795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d73f557-e15f-41d8-9564-ba2907a47154 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:46.174896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d73f557-e15f-41d8-9564-ba2907a47154 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:46.191973 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:46.263971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d73f557-e15f-41d8-9564-ba2907a47154 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:46.264737 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d73f557-e15f-41d8-9564-ba2907a47154 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:46.265281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d73f557-e15f-41d8-9564-ba2907a47154 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:46.265822 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-0d73f557-e15f-41d8-9564-ba2907a47154 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lazy-loading 'fault' on Instance uuid 3576fbd4-5c72-4025-a40c-e0e1ad348acc {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:46.291254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:46.326169 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aba663fb-c8c9-4256-9e03-b97f3e82ec89 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904" status: 204 len: 0 microversion: 2.1 time: 0.280548 Aug 24 10:20:46.327362 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1195/2143] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:20:46 2022] DELETE /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:46.337961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-07485626-b7c3-4a31-95e0-c43a903b8e81 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:46.339321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-07485626-b7c3-4a31-95e0-c43a903b8e81 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] [instance: e5e27996-05a5-41e0-a286-28a6526a95c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:46.359800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0d73f557-e15f-41d8-9564-ba2907a47154 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:46.365765 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07485626-b7c3-4a31-95e0-c43a903b8e81 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:46.368133 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07485626-b7c3-4a31-95e0-c43a903b8e81 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:46.384565 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07485626-b7c3-4a31-95e0-c43a903b8e81 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:46.386174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07485626-b7c3-4a31-95e0-c43a903b8e81 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:46.386900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0d73f557-e15f-41d8-9564-ba2907a47154 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:46.387119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07485626-b7c3-4a31-95e0-c43a903b8e81 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:46.391152 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0d73f557-e15f-41d8-9564-ba2907a47154 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:46.396106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07485626-b7c3-4a31-95e0-c43a903b8e81 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:46.411543 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0d73f557-e15f-41d8-9564-ba2907a47154 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1448 microversion: 2.75 time: 0.274228 Aug 24 10:20:46.412881 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 949/2144] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:46 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1448 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:46.425176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e745a510-c9d4-443d-a1e1-52d6e3c56ec2 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:46.430031 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e745a510-c9d4-443d-a1e1-52d6e3c56ec2 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: b47ddbf3-ca84-419b-ae08-916fb959be5c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:46.448266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e745a510-c9d4-443d-a1e1-52d6e3c56ec2 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:46.449390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e745a510-c9d4-443d-a1e1-52d6e3c56ec2 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:46.449390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e745a510-c9d4-443d-a1e1-52d6e3c56ec2 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:46.457431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e745a510-c9d4-443d-a1e1-52d6e3c56ec2 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:46.458010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e745a510-c9d4-443d-a1e1-52d6e3c56ec2 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:46.460855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e745a510-c9d4-443d-a1e1-52d6e3c56ec2 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:46.484197 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-07485626-b7c3-4a31-95e0-c43a903b8e81 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] HTTP exception thrown: Action 999 not found Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-07485626-b7c3-4a31-95e0-c43a903b8e81 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Request method failure captured: Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4/os-instance-actions/999 HTTP/1.1 Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfth7-Ochtg1KqIilYdUB0HX_jWANliSGvY4TxlI2kLlZrrPGIqomtDo6CSLuhxIZ-_vHcZkgxJbXeLw66L3M0WJ8SSroLW85zoH0ImxGQmYgp6l59wFft_-bwiwd0TE2CkpK11dsjZwLFzpuuwJotSMUYI2vW2mYJ-pc4Ye_QD44fI Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: b78d9b1aee724032aa9eab0cab0f8562 Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1812481964 Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b78d9b1aee724032aa9eab0cab0f8562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b78d9b1aee724032aa9eab0cab0f8562", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b78d9b1aee724032aa9eab0cab0f8562"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b78d9b1aee724032aa9eab0cab0f8562"}]}] Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1812481964 Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: b78d9b1aee724032aa9eab0cab0f8562 Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1812481964 Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-InstanceActionsNegativeTestJSON-1812481964-project Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 4f13f6a21e25432f996be6920ee83343 Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1812481964-project Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: exception: Action 999 not found Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'server_id': 'e5e27996-05a5-41e0-a286-28a6526a95c4', 'id': '999'} Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 24 10:20:46.497740 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:46.501161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-07485626-b7c3-4a31-95e0-c43a903b8e81 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Returning 404 to user: Action 999 not found {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:20:46.501161 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-07485626-b7c3-4a31-95e0-c43a903b8e81 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] 10.222.0.85 "GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.170129 Aug 24 10:20:46.501161 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1196/2145] 10.222.0.85 () {58 vars in 1308 bytes} [Wed Aug 24 10:20:46 2022] GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4/os-instance-actions/999 => generated 66 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:20:46.537540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a5886388-7396-479a-ac27-d4e3196d6113 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4655092670>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:46.669452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e745a510-c9d4-443d-a1e1-52d6e3c56ec2 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:46.694327 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a5886388-7396-479a-ac27-d4e3196d6113 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1454 microversion: 2.1 time: 0.191006 Aug 24 10:20:46.694948 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e745a510-c9d4-443d-a1e1-52d6e3c56ec2 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c" status: 200 len: 1217 microversion: 2.1 time: 0.278499 Aug 24 10:20:46.700124 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1197/2147] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:20:46 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1454 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:46.700623 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 950/2147] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:46 2022] GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c => generated 1217 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:46.709063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aef7befc-3e64-4e7b-8af1-d49f995dd44e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:46.720320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-595ceba4-e8d8-46d1-8e8c-fe5a4f801164 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Calling method '.version_select at 0x7f465a259280>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:46.721883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-595ceba4-e8d8-46d1-8e8c-fe5a4f801164 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] [instance: bd117f2c-c7a8-4557-ad54-fc13909fd1ee] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:46.731305 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aef7befc-3e64-4e7b-8af1-d49f995dd44e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: d5e1565f-a210-4fa8-b881-060432acb904] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:46.744920 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-595ceba4-e8d8-46d1-8e8c-fe5a4f801164 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] HTTP exception thrown: Instance bd117f2c-c7a8-4557-ad54-fc13909fd1ee could not be found. Aug 24 10:20:46.751028 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aef7befc-3e64-4e7b-8af1-d49f995dd44e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-595ceba4-e8d8-46d1-8e8c-fe5a4f801164 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Request method failure captured: Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/bd117f2c-c7a8-4557-ad54-fc13909fd1ee/os-instance-actions HTTP/1.1 Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfth7-Ochtg1KqIilYdUB0HX_jWANliSGvY4TxlI2kLlZrrPGIqomtDo6CSLuhxIZ-_vHcZkgxJbXeLw66L3M0WJ8SSroLW85zoH0ImxGQmYgp6l59wFft_-bwiwd0TE2CkpK11dsjZwLFzpuuwJotSMUYI2vW2mYJ-pc4Ye_QD44fI Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: b78d9b1aee724032aa9eab0cab0f8562 Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1812481964 Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b78d9b1aee724032aa9eab0cab0f8562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b78d9b1aee724032aa9eab0cab0f8562", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b78d9b1aee724032aa9eab0cab0f8562"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b78d9b1aee724032aa9eab0cab0f8562"}]}] Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1812481964 Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: b78d9b1aee724032aa9eab0cab0f8562 Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1812481964 Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-InstanceActionsNegativeTestJSON-1812481964-project Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 4f13f6a21e25432f996be6920ee83343 Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1812481964-project Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance bd117f2c-c7a8-4557-ad54-fc13909fd1ee could not be found. Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'server_id': 'bd117f2c-c7a8-4557-ad54-fc13909fd1ee'} Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd117f2c-c7a8-4557-ad54-fc13909fd1ee could not be found. Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:20:46.752278 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:20:46.759028 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd117f2c-c7a8-4557-ad54-fc13909fd1ee could not be found. Aug 24 10:20:46.759028 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:46.759028 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:46.759028 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:46.759028 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:46.759028 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:46.759028 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:46.759028 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:20:46.759028 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:20:46.759028 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd117f2c-c7a8-4557-ad54-fc13909fd1ee could not be found. Aug 24 10:20:46.759028 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:46.761327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aef7befc-3e64-4e7b-8af1-d49f995dd44e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:46.762141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aef7befc-3e64-4e7b-8af1-d49f995dd44e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:46.763705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-595ceba4-e8d8-46d1-8e8c-fe5a4f801164 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Returning 404 to user: Instance bd117f2c-c7a8-4557-ad54-fc13909fd1ee could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:20:46.765343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aef7befc-3e64-4e7b-8af1-d49f995dd44e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:46.766186 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aef7befc-3e64-4e7b-8af1-d49f995dd44e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:46.767604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aef7befc-3e64-4e7b-8af1-d49f995dd44e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:46.769589 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-595ceba4-e8d8-46d1-8e8c-fe5a4f801164 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] 10.222.0.85 "GET /compute/v2.1/servers/bd117f2c-c7a8-4557-ad54-fc13909fd1ee/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.062479 Aug 24 10:20:46.770954 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 951/2148] 10.222.0.85 () {58 vars in 1296 bytes} [Wed Aug 24 10:20:46 2022] GET /compute/v2.1/servers/bd117f2c-c7a8-4557-ad54-fc13909fd1ee/os-instance-actions => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:20:46.790117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-10d51795-cb21-45f1-960a-884254efe05a req-8ff72301-28c5-4b7e-8184-c38a7e06d0bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb", "name": "network-vif-unplugged", "status": "completed", "tag": "c181228f-fe7e-4a76-bb5e-18f9995613d1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:46.824697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-10d51795-cb21-45f1-960a-884254efe05a req-8ff72301-28c5-4b7e-8184-c38a7e06d0bb service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:46.826677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-10d51795-cb21-45f1-960a-884254efe05a req-8ff72301-28c5-4b7e-8184-c38a7e06d0bb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:46.828440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-10d51795-cb21-45f1-960a-884254efe05a req-8ff72301-28c5-4b7e-8184-c38a7e06d0bb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:46.854641 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-10d51795-cb21-45f1-960a-884254efe05a req-8ff72301-28c5-4b7e-8184-c38a7e06d0bb service nova] Creating event network-vif-unplugged:c181228f-fe7e-4a76-bb5e-18f9995613d1 for instance fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb on n-h1-849328-3 Aug 24 10:20:46.870788 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-10d51795-cb21-45f1-960a-884254efe05a req-8ff72301-28c5-4b7e-8184-c38a7e06d0bb service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097418 Aug 24 10:20:46.872468 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 952/2149] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:46.878983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-70ef7426-c2bb-4660-af86-e88c24052d1d tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:46.880015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-70ef7426-c2bb-4660-af86-e88c24052d1d tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] [instance: e5e27996-05a5-41e0-a286-28a6526a95c4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:46.894365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70ef7426-c2bb-4660-af86-e88c24052d1d tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:46.895004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70ef7426-c2bb-4660-af86-e88c24052d1d tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:46.898061 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70ef7426-c2bb-4660-af86-e88c24052d1d tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:46.900747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70ef7426-c2bb-4660-af86-e88c24052d1d tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:46.901194 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70ef7426-c2bb-4660-af86-e88c24052d1d tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:46.903987 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70ef7426-c2bb-4660-af86-e88c24052d1d tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:46.965396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-70ef7426-c2bb-4660-af86-e88c24052d1d tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] [instance: e5e27996-05a5-41e0-a286-28a6526a95c4] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:20:47.115760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aef7befc-3e64-4e7b-8af1-d49f995dd44e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:47.129644 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aef7befc-3e64-4e7b-8af1-d49f995dd44e tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904" status: 200 len: 1465 microversion: 2.1 time: 0.427421 Aug 24 10:20:47.129900 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-70ef7426-c2bb-4660-af86-e88c24052d1d tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] 10.222.0.85 "DELETE /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4" status: 204 len: 0 microversion: 2.1 time: 0.255276 Aug 24 10:20:47.130648 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1198/2151] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:46 2022] GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904 => generated 1465 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:47.135348 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 953/2151] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:20:46 2022] DELETE /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:47.143832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-04a17d23-f0b9-4a0f-8a47-7833f4089033 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:47.144733 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-04a17d23-f0b9-4a0f-8a47-7833f4089033 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] [instance: e5e27996-05a5-41e0-a286-28a6526a95c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:47.161677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04a17d23-f0b9-4a0f-8a47-7833f4089033 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:47.162791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04a17d23-f0b9-4a0f-8a47-7833f4089033 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:47.163700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04a17d23-f0b9-4a0f-8a47-7833f4089033 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:47.168408 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04a17d23-f0b9-4a0f-8a47-7833f4089033 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:47.169591 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04a17d23-f0b9-4a0f-8a47-7833f4089033 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:47.170262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04a17d23-f0b9-4a0f-8a47-7833f4089033 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:47.180609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:47.437463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-04a17d23-f0b9-4a0f-8a47-7833f4089033 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f13f6a21e25432f996be6920ee83343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78d9b1aee724032aa9eab0cab0f8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:47.445783 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f865dc88-6148-4605-a6c0-fa8929dea001 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:47.446971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f865dc88-6148-4605-a6c0-fa8929dea001 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:47.448352 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-04a17d23-f0b9-4a0f-8a47-7833f4089033 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] 10.222.0.85 "GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4" status: 200 len: 1527 microversion: 2.1 time: 0.309116 Aug 24 10:20:47.448959 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1199/2152] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:47 2022] GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4 => generated 1527 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:47.459765 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f865dc88-6148-4605-a6c0-fa8929dea001 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:47.460344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f865dc88-6148-4605-a6c0-fa8929dea001 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:47.460783 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f865dc88-6148-4605-a6c0-fa8929dea001 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:47.461805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f865dc88-6148-4605-a6c0-fa8929dea001 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:47.462466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f865dc88-6148-4605-a6c0-fa8929dea001 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:47.463141 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f865dc88-6148-4605-a6c0-fa8929dea001 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:47.520972 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f865dc88-6148-4605-a6c0-fa8929dea001 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:47.521859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f865dc88-6148-4605-a6c0-fa8929dea001 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:47.522384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f865dc88-6148-4605-a6c0-fa8929dea001 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:47.522857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-f865dc88-6148-4605-a6c0-fa8929dea001 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lazy-loading 'fault' on Instance uuid 3576fbd4-5c72-4025-a40c-e0e1ad348acc {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:47.579992 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f865dc88-6148-4605-a6c0-fa8929dea001 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:47.589552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f865dc88-6148-4605-a6c0-fa8929dea001 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:47.591055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f865dc88-6148-4605-a6c0-fa8929dea001 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:47.597410 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f865dc88-6148-4605-a6c0-fa8929dea001 tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1448 microversion: 2.75 time: 0.157696 Aug 24 10:20:47.598362 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 954/2153] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:47 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1448 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:47.715055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3a990b65-4b23-442a-8a2b-f6770ec3365d tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4655036160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:47.728409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7501a76d-fbf1-4279-81ae-155b99e21579 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:47.732982 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7501a76d-fbf1-4279-81ae-155b99e21579 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: b47ddbf3-ca84-419b-ae08-916fb959be5c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:47.746482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7501a76d-fbf1-4279-81ae-155b99e21579 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:47.747579 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7501a76d-fbf1-4279-81ae-155b99e21579 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:47.748584 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7501a76d-fbf1-4279-81ae-155b99e21579 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:47.750574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7501a76d-fbf1-4279-81ae-155b99e21579 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:47.752822 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7501a76d-fbf1-4279-81ae-155b99e21579 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:47.754688 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7501a76d-fbf1-4279-81ae-155b99e21579 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:47.791708 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3a990b65-4b23-442a-8a2b-f6770ec3365d tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1454 microversion: 2.1 time: 0.081420 Aug 24 10:20:47.793443 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1200/2154] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:20:47 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1454 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:47.860422 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7501a76d-fbf1-4279-81ae-155b99e21579 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:47.875280 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7501a76d-fbf1-4279-81ae-155b99e21579 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c" status: 200 len: 1273 microversion: 2.1 time: 0.157688 Aug 24 10:20:47.887456 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 955/2155] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:47 2022] GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c => generated 1273 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:48.163500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ffe6e5ec-71ee-4589-b5d6-25cbd4fce43a tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:48.165037 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ffe6e5ec-71ee-4589-b5d6-25cbd4fce43a tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: d5e1565f-a210-4fa8-b881-060432acb904] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:48.192080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffe6e5ec-71ee-4589-b5d6-25cbd4fce43a tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:48.192797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffe6e5ec-71ee-4589-b5d6-25cbd4fce43a tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:48.193403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffe6e5ec-71ee-4589-b5d6-25cbd4fce43a tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:48.194290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffe6e5ec-71ee-4589-b5d6-25cbd4fce43a tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:48.195075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffe6e5ec-71ee-4589-b5d6-25cbd4fce43a tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:48.195639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffe6e5ec-71ee-4589-b5d6-25cbd4fce43a tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:48.421635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ffe6e5ec-71ee-4589-b5d6-25cbd4fce43a tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:48.438845 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ffe6e5ec-71ee-4589-b5d6-25cbd4fce43a tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904" status: 200 len: 1465 microversion: 2.1 time: 0.282738 Aug 24 10:20:48.440000 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1201/2156] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:48 2022] GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904 => generated 1465 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:48.476156 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-af6245f8-a659-4a2f-b77f-3de61eaeef99 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:48.477486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-af6245f8-a659-4a2f-b77f-3de61eaeef99 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] [instance: e5e27996-05a5-41e0-a286-28a6526a95c4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:48.491688 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af6245f8-a659-4a2f-b77f-3de61eaeef99 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:48.493030 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af6245f8-a659-4a2f-b77f-3de61eaeef99 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:48.494117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af6245f8-a659-4a2f-b77f-3de61eaeef99 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:48.495719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af6245f8-a659-4a2f-b77f-3de61eaeef99 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:48.496823 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af6245f8-a659-4a2f-b77f-3de61eaeef99 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:48.497929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af6245f8-a659-4a2f-b77f-3de61eaeef99 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:48.636665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a6c5c6f1-1897-4511-b48e-e14474b4006c tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:48.638280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a6c5c6f1-1897-4511-b48e-e14474b4006c tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:48.653557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6c5c6f1-1897-4511-b48e-e14474b4006c tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:48.654698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6c5c6f1-1897-4511-b48e-e14474b4006c tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:48.655508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6c5c6f1-1897-4511-b48e-e14474b4006c tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:48.657841 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6c5c6f1-1897-4511-b48e-e14474b4006c tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:48.658972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6c5c6f1-1897-4511-b48e-e14474b4006c tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:48.660829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6c5c6f1-1897-4511-b48e-e14474b4006c tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:48.738927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6c5c6f1-1897-4511-b48e-e14474b4006c tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:48.740698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6c5c6f1-1897-4511-b48e-e14474b4006c tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:48.741566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6c5c6f1-1897-4511-b48e-e14474b4006c tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:48.742402 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-a6c5c6f1-1897-4511-b48e-e14474b4006c tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lazy-loading 'fault' on Instance uuid 3576fbd4-5c72-4025-a40c-e0e1ad348acc {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:48.798958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a6c5c6f1-1897-4511-b48e-e14474b4006c tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:48.834385 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a6c5c6f1-1897-4511-b48e-e14474b4006c tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:48.836884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a6c5c6f1-1897-4511-b48e-e14474b4006c tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a04706d4e2e425a83c3a10965a331c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d9d7771254855ac7e30c82e3ff0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:48.845704 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a6c5c6f1-1897-4511-b48e-e14474b4006c tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 200 len: 1448 microversion: 2.75 time: 0.216990 Aug 24 10:20:48.846784 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1202/2157] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:48 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 1448 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:20:48.852076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-925df651-5515-48a3-b6b3-a595e140123d tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4654f2bb80>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:48.906608 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-925df651-5515-48a3-b6b3-a595e140123d tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1454 microversion: 2.1 time: 0.058599 Aug 24 10:20:48.917557 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1203/2158] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:20:48 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1454 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:48.917557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ba8f8adb-69c0-4ed1-b2f4-71493b873685 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:48.917557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ba8f8adb-69c0-4ed1-b2f4-71493b873685 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: b47ddbf3-ca84-419b-ae08-916fb959be5c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:48.920855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba8f8adb-69c0-4ed1-b2f4-71493b873685 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:48.921483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba8f8adb-69c0-4ed1-b2f4-71493b873685 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:48.921939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba8f8adb-69c0-4ed1-b2f4-71493b873685 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:48.922733 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba8f8adb-69c0-4ed1-b2f4-71493b873685 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:48.923219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba8f8adb-69c0-4ed1-b2f4-71493b873685 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:48.923679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba8f8adb-69c0-4ed1-b2f4-71493b873685 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:49.013456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-af6245f8-a659-4a2f-b77f-3de61eaeef99 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f13f6a21e25432f996be6920ee83343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78d9b1aee724032aa9eab0cab0f8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:49.017226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ba8f8adb-69c0-4ed1-b2f4-71493b873685 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:49.028061 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ba8f8adb-69c0-4ed1-b2f4-71493b873685 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c" status: 200 len: 1273 microversion: 2.1 time: 0.119199 Aug 24 10:20:49.029419 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1204/2159] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:48 2022] GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c => generated 1273 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:49.032167 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-af6245f8-a659-4a2f-b77f-3de61eaeef99 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] 10.222.0.85 "GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4" status: 200 len: 1527 microversion: 2.1 time: 0.563327 Aug 24 10:20:49.043107 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 956/2160] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:48 2022] GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4 => generated 1527 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:49.472524 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb1f6c08-5830-4c0e-9979-6264a4ebefa1 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:49.473837 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cb1f6c08-5830-4c0e-9979-6264a4ebefa1 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: d5e1565f-a210-4fa8-b881-060432acb904] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:49.483035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb1f6c08-5830-4c0e-9979-6264a4ebefa1 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:49.483802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb1f6c08-5830-4c0e-9979-6264a4ebefa1 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:49.484656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb1f6c08-5830-4c0e-9979-6264a4ebefa1 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:49.485668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb1f6c08-5830-4c0e-9979-6264a4ebefa1 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:49.486343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb1f6c08-5830-4c0e-9979-6264a4ebefa1 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:49.487793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb1f6c08-5830-4c0e-9979-6264a4ebefa1 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:49.506486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-80cef183-6f76-4b44-bfa1-a35d78bf5749 req-f32339be-a3bf-44a9-8606-3a5a97e7e1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bc88682-b0f5-42fc-88e5-a74d75b8e241", "tag": "5f373a77-7c6e-43b9-9e7b-44520530587d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:49.539079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-80cef183-6f76-4b44-bfa1-a35d78bf5749 req-f32339be-a3bf-44a9-8606-3a5a97e7e1f5 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:49.540218 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-80cef183-6f76-4b44-bfa1-a35d78bf5749 req-f32339be-a3bf-44a9-8606-3a5a97e7e1f5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:49.540877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-80cef183-6f76-4b44-bfa1-a35d78bf5749 req-f32339be-a3bf-44a9-8606-3a5a97e7e1f5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:49.589237 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-80cef183-6f76-4b44-bfa1-a35d78bf5749 req-f32339be-a3bf-44a9-8606-3a5a97e7e1f5 service nova] Creating event network-changed:5f373a77-7c6e-43b9-9e7b-44520530587d for instance 2bc88682-b0f5-42fc-88e5-a74d75b8e241 on n-h1-849328-3 Aug 24 10:20:49.612372 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-80cef183-6f76-4b44-bfa1-a35d78bf5749 req-f32339be-a3bf-44a9-8606-3a5a97e7e1f5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114254 Aug 24 10:20:49.614445 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 957/2161] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:49.786343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cb1f6c08-5830-4c0e-9979-6264a4ebefa1 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:49.823951 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cb1f6c08-5830-4c0e-9979-6264a4ebefa1 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904" status: 200 len: 1423 microversion: 2.1 time: 0.359342 Aug 24 10:20:49.826059 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1205/2162] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:49 2022] GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904 => generated 1423 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:49.896031 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-704f746f-c973-44d7-9d3f-68014d06b23e tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:49.906332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-704f746f-c973-44d7-9d3f-68014d06b23e tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] [instance: 3576fbd4-5c72-4025-a40c-e0e1ad348acc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:49.939983 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-40816676-9642-48f3-ad4d-a6180cbbe622 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f46553cb8b0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:49.970058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-704f746f-c973-44d7-9d3f-68014d06b23e tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:49.979207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-704f746f-c973-44d7-9d3f-68014d06b23e tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:49.980629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-704f746f-c973-44d7-9d3f-68014d06b23e tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:49.984597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-704f746f-c973-44d7-9d3f-68014d06b23e tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:49.987843 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-704f746f-c973-44d7-9d3f-68014d06b23e tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:49.989234 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-704f746f-c973-44d7-9d3f-68014d06b23e tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:50.031482 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-704f746f-c973-44d7-9d3f-68014d06b23e tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] HTTP exception thrown: Instance 3576fbd4-5c72-4025-a40c-e0e1ad348acc could not be found. Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-704f746f-c973-44d7-9d3f-68014d06b23e tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Request method failure captured: Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc HTTP/1.1 Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfsR4MHEo0rAUOx3-jZNbwVwrZNSUtDcj1__ja2wbvGYgm7yAGN30F6vcTxqezlBg1zJSJZn1_TB-kazLbhx9ztAD-Cw6K3W5-jpYfMWveB0DUV1kiu1NFkR9NaFzBIM2F4oPE30eW9cryF7ZNtkLnBOkzQlsHPn5YzkrpwykIUsCCo Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: X-Openstack-Nova-Api-Version: 2.75 Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 508d9d7771254855ac7e30c82e3ff0b8 Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersAdmin275Test-1177466728 Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/508d9d7771254855ac7e30c82e3ff0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_508d9d7771254855ac7e30c82e3ff0b8", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/508d9d7771254855ac7e30c82e3ff0b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/508d9d7771254855ac7e30c82e3ff0b8"}]}] Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersAdmin275Test-1177466728 Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 508d9d7771254855ac7e30c82e3ff0b8 Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersAdmin275Test-1177466728 Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersAdmin275Test-1177466728-project Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 9a04706d4e2e425a83c3a10965a331c2 Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersAdmin275Test-1177466728-project Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 3576fbd4-5c72-4025-a40c-e0e1ad348acc could not be found. Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '3576fbd4-5c72-4025-a40c-e0e1ad348acc'} Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3576fbd4-5c72-4025-a40c-e0e1ad348acc could not be found. Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3576fbd4-5c72-4025-a40c-e0e1ad348acc could not be found. Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:50.034596 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:50.038456 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:50.038456 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:50.038456 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:50.038456 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:20:50.038456 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:20:50.038456 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3576fbd4-5c72-4025-a40c-e0e1ad348acc could not be found. Aug 24 10:20:50.038456 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:50.041277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-704f746f-c973-44d7-9d3f-68014d06b23e tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] Returning 404 to user: Instance 3576fbd4-5c72-4025-a40c-e0e1ad348acc could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:20:50.043541 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-704f746f-c973-44d7-9d3f-68014d06b23e tempest-ServersAdmin275Test-1177466728 tempest-ServersAdmin275Test-1177466728-project] 10.222.0.85 "GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc" status: 404 len: 111 microversion: 2.75 time: 0.158064 Aug 24 10:20:50.044881 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 958/2163] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:49 2022] GET /compute/v2.1/servers/3576fbd4-5c72-4025-a40c-e0e1ad348acc => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 10:20:50.054391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f9fbd6ee-da90-4c18-aca0-f8d4ab0675b4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:50.055100 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f9fbd6ee-da90-4c18-aca0-f8d4ab0675b4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: b47ddbf3-ca84-419b-ae08-916fb959be5c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:50.085461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9fbd6ee-da90-4c18-aca0-f8d4ab0675b4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:50.089767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9fbd6ee-da90-4c18-aca0-f8d4ab0675b4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:50.093425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9fbd6ee-da90-4c18-aca0-f8d4ab0675b4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:50.100526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9fbd6ee-da90-4c18-aca0-f8d4ab0675b4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:50.103706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9fbd6ee-da90-4c18-aca0-f8d4ab0675b4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:50.105065 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-40816676-9642-48f3-ad4d-a6180cbbe622 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1454 microversion: 2.1 time: 0.173675 Aug 24 10:20:50.108132 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9fbd6ee-da90-4c18-aca0-f8d4ab0675b4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:50.109969 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1206/2164] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:20:49 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1454 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:50.115848 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bad046c8-cd63-4dc4-9671-d8882df35a36 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:50.131200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bad046c8-cd63-4dc4-9671-d8882df35a36 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] [instance: e5e27996-05a5-41e0-a286-28a6526a95c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:50.155962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bad046c8-cd63-4dc4-9671-d8882df35a36 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:50.162191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bad046c8-cd63-4dc4-9671-d8882df35a36 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:50.163708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bad046c8-cd63-4dc4-9671-d8882df35a36 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:50.166681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bad046c8-cd63-4dc4-9671-d8882df35a36 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:50.169398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bad046c8-cd63-4dc4-9671-d8882df35a36 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:50.170073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bad046c8-cd63-4dc4-9671-d8882df35a36 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:50.929944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bad046c8-cd63-4dc4-9671-d8882df35a36 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f13f6a21e25432f996be6920ee83343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78d9b1aee724032aa9eab0cab0f8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:50.944229 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bad046c8-cd63-4dc4-9671-d8882df35a36 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] 10.222.0.85 "GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4" status: 200 len: 1527 microversion: 2.1 time: 0.832556 Aug 24 10:20:50.944847 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1207/2165] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:50 2022] GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4 => generated 1527 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:50.952229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-e44479eb-7c60-4fac-9c60-5223c4db42f5 req-75e70681-fde9-4cab-9d1a-1d17d9263243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a4ddf34-af18-4e02-a306-c1c67f5c0b28", "name": "network-vif-plugged", "status": "completed", "tag": "21445c55-f24c-46da-9946-53b2566a219f"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:50.978668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e44479eb-7c60-4fac-9c60-5223c4db42f5 req-75e70681-fde9-4cab-9d1a-1d17d9263243 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:50.985703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e44479eb-7c60-4fac-9c60-5223c4db42f5 req-75e70681-fde9-4cab-9d1a-1d17d9263243 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:50.986831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e44479eb-7c60-4fac-9c60-5223c4db42f5 req-75e70681-fde9-4cab-9d1a-1d17d9263243 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:51.012855 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-e44479eb-7c60-4fac-9c60-5223c4db42f5 req-75e70681-fde9-4cab-9d1a-1d17d9263243 service nova] Creating event network-vif-plugged:21445c55-f24c-46da-9946-53b2566a219f for instance 8a4ddf34-af18-4e02-a306-c1c67f5c0b28 on n-h2-849328-3 Aug 24 10:20:51.023150 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-e44479eb-7c60-4fac-9c60-5223c4db42f5 req-75e70681-fde9-4cab-9d1a-1d17d9263243 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075066 Aug 24 10:20:51.024412 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1208/2166] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:51.041462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f0da9c8f-0f51-4e89-9bd3-d55470e273cb tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:51.042525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f0da9c8f-0f51-4e89-9bd3-d55470e273cb tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: d5e1565f-a210-4fa8-b881-060432acb904] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:51.058555 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0da9c8f-0f51-4e89-9bd3-d55470e273cb tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:51.059512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0da9c8f-0f51-4e89-9bd3-d55470e273cb tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:51.067126 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0da9c8f-0f51-4e89-9bd3-d55470e273cb tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:51.067812 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f9fbd6ee-da90-4c18-aca0-f8d4ab0675b4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:51.068328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0da9c8f-0f51-4e89-9bd3-d55470e273cb tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:51.068965 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0da9c8f-0f51-4e89-9bd3-d55470e273cb tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:51.069459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0da9c8f-0f51-4e89-9bd3-d55470e273cb tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:51.088666 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-f0da9c8f-0f51-4e89-9bd3-d55470e273cb tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] HTTP exception thrown: Instance d5e1565f-a210-4fa8-b881-060432acb904 could not be found. Aug 24 10:20:51.089081 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f9fbd6ee-da90-4c18-aca0-f8d4ab0675b4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c" status: 200 len: 1281 microversion: 2.1 time: 1.037281 Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f0da9c8f-0f51-4e89-9bd3-d55470e273cb tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Request method failure captured: Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904 HTTP/1.1 Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBftAaa47NsMS-lqiAPuW76SNRVuIyxvi0UwhZo809XsAf22cZ_tDcoTFvKacmnDOHr2F8-E21iIcz1gqEjCEywtCHW4DQfSNOyfN5eFoUpfm6LnbAJiqpYNnW0JZFC-nyJ2wnf7XQUmxYWLUYezJU5VAeVVHRysqTX81uPxmC9Xp12U Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: e5b71b3aec6d45c3964585a8b11f2e81 Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-LiveMigrationNegativeTest-100007439 Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e5b71b3aec6d45c3964585a8b11f2e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e5b71b3aec6d45c3964585a8b11f2e81", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e5b71b3aec6d45c3964585a8b11f2e81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e5b71b3aec6d45c3964585a8b11f2e81"}]}] Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-LiveMigrationNegativeTest-100007439 Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: e5b71b3aec6d45c3964585a8b11f2e81 Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-100007439 Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-LiveMigrationNegativeTest-100007439-project Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 14047bac72234dc7b0384a99fbdabb67 Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-LiveMigrationNegativeTest-100007439-project Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance d5e1565f-a210-4fa8-b881-060432acb904 could not be found. Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'd5e1565f-a210-4fa8-b881-060432acb904'} Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5e1565f-a210-4fa8-b881-060432acb904 could not be found. Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5e1565f-a210-4fa8-b881-060432acb904 could not be found. Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:51.091093 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:51.096485 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:51.096485 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:51.096485 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:51.096485 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:20:51.096485 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:20:51.096485 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5e1565f-a210-4fa8-b881-060432acb904 could not be found. Aug 24 10:20:51.096485 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:51.096485 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f0da9c8f-0f51-4e89-9bd3-d55470e273cb tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Returning 404 to user: Instance d5e1565f-a210-4fa8-b881-060432acb904 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:20:51.096485 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f0da9c8f-0f51-4e89-9bd3-d55470e273cb tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904" status: 404 len: 111 microversion: 2.1 time: 0.063886 Aug 24 10:20:51.097055 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1209/2167] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:51 2022] GET /compute/v2.1/servers/d5e1565f-a210-4fa8-b881-060432acb904 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:20:51.102176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec00ad9b-6fc5-452c-b0b3-74f36b6eda62 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:51.102689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ec00ad9b-6fc5-452c-b0b3-74f36b6eda62 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:51.102973 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 959/2168] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:50 2022] GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c => generated 1281 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:51.110639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec00ad9b-6fc5-452c-b0b3-74f36b6eda62 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:51.111403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec00ad9b-6fc5-452c-b0b3-74f36b6eda62 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:51.111999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec00ad9b-6fc5-452c-b0b3-74f36b6eda62 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:51.112932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec00ad9b-6fc5-452c-b0b3-74f36b6eda62 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:51.113590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec00ad9b-6fc5-452c-b0b3-74f36b6eda62 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:51.114187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec00ad9b-6fc5-452c-b0b3-74f36b6eda62 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:51.134161 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-688804bb-bf59-4430-b766-436f3cb1c547 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f465a28c280>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:51.153077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ec00ad9b-6fc5-452c-b0b3-74f36b6eda62 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:20:51.232589 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-688804bb-bf59-4430-b766-436f3cb1c547 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1454 microversion: 2.1 time: 0.107005 Aug 24 10:20:51.233930 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 960/2169] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:20:51 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1454 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:51.317567 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ec00ad9b-6fc5-452c-b0b3-74f36b6eda62 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "DELETE /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b" status: 204 len: 0 microversion: 2.1 time: 0.216787 Aug 24 10:20:51.319809 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1210/2170] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:20:51 2022] DELETE /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:51.328174 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f173dd04-a465-4cdc-8732-073b3d73d6c3 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:51.329194 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f173dd04-a465-4cdc-8732-073b3d73d6c3 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:51.336029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f173dd04-a465-4cdc-8732-073b3d73d6c3 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:51.336757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f173dd04-a465-4cdc-8732-073b3d73d6c3 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:51.337388 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f173dd04-a465-4cdc-8732-073b3d73d6c3 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:51.338270 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f173dd04-a465-4cdc-8732-073b3d73d6c3 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:51.339073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f173dd04-a465-4cdc-8732-073b3d73d6c3 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:51.339832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f173dd04-a465-4cdc-8732-073b3d73d6c3 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:51.691811 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-b63b2a0b-54ac-48e4-8d8a-f0f4372548f1 req-332fb50b-2356-4c79-85ff-bd4326caa418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5e1565f-a210-4fa8-b881-060432acb904", "name": "network-vif-deleted", "tag": "ee3a649b-1b3b-45fd-bb62-7a88b42d11e3"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:51.718698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b63b2a0b-54ac-48e4-8d8a-f0f4372548f1 req-332fb50b-2356-4c79-85ff-bd4326caa418 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:51.719426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b63b2a0b-54ac-48e4-8d8a-f0f4372548f1 req-332fb50b-2356-4c79-85ff-bd4326caa418 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:51.719882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b63b2a0b-54ac-48e4-8d8a-f0f4372548f1 req-332fb50b-2356-4c79-85ff-bd4326caa418 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:51.754790 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-b63b2a0b-54ac-48e4-8d8a-f0f4372548f1 req-332fb50b-2356-4c79-85ff-bd4326caa418 service nova] Creating event network-vif-deleted:ee3a649b-1b3b-45fd-bb62-7a88b42d11e3 for instance d5e1565f-a210-4fa8-b881-060432acb904 on n-h1-849328-3 Aug 24 10:20:51.765770 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-b63b2a0b-54ac-48e4-8d8a-f0f4372548f1 req-332fb50b-2356-4c79-85ff-bd4326caa418 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079745 Aug 24 10:20:51.768054 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1211/2171] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:20:51.782100 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f173dd04-a465-4cdc-8732-073b3d73d6c3 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:51.793679 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f173dd04-a465-4cdc-8732-073b3d73d6c3 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b" status: 200 len: 1474 microversion: 2.1 time: 0.469616 Aug 24 10:20:51.795000 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 961/2172] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:51 2022] GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b => generated 1474 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:51.970537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3e73420-b2e7-43d1-8623-c684fb9e941e tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:51.971919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d3e73420-b2e7-43d1-8623-c684fb9e941e tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] [instance: e5e27996-05a5-41e0-a286-28a6526a95c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:51.994651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3e73420-b2e7-43d1-8623-c684fb9e941e tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:51.995743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3e73420-b2e7-43d1-8623-c684fb9e941e tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:51.996490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3e73420-b2e7-43d1-8623-c684fb9e941e tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:51.997537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3e73420-b2e7-43d1-8623-c684fb9e941e tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:51.998355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3e73420-b2e7-43d1-8623-c684fb9e941e tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:52.000513 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3e73420-b2e7-43d1-8623-c684fb9e941e tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:52.124802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1cde60c2-f34d-40c6-b331-76e2537a3e7e tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:52.125477 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1cde60c2-f34d-40c6-b331-76e2537a3e7e tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: b47ddbf3-ca84-419b-ae08-916fb959be5c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:52.141281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cde60c2-f34d-40c6-b331-76e2537a3e7e tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:52.141928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cde60c2-f34d-40c6-b331-76e2537a3e7e tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:52.142402 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cde60c2-f34d-40c6-b331-76e2537a3e7e tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:52.143240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cde60c2-f34d-40c6-b331-76e2537a3e7e tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:52.143718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cde60c2-f34d-40c6-b331-76e2537a3e7e tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:52.144438 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cde60c2-f34d-40c6-b331-76e2537a3e7e tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:52.296031 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1cde60c2-f34d-40c6-b331-76e2537a3e7e tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:52.315267 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1cde60c2-f34d-40c6-b331-76e2537a3e7e tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c" status: 200 len: 1279 microversion: 2.1 time: 0.195100 Aug 24 10:20:52.329726 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 962/2173] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:52 2022] GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c => generated 1279 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:52.351161 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e25ef899-aea0-4a31-8d84-7874ad4afded tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f46557d69d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:52.470662 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e25ef899-aea0-4a31-8d84-7874ad4afded tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1454 microversion: 2.1 time: 0.138936 Aug 24 10:20:52.480481 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 963/2174] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:20:52 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1454 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:52.736254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-67ff9521-b350-41f4-a9f2-c10ed6715b9f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1095914503", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "f9d3da2a-e7f1-4061-b1c2-835192cdb5b7"}], "block_device_mapping_v2": [{"uuid": "5dada9b8-8d88-41c3-a4a5-1bb0bcc08418", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:52.769660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d3e73420-b2e7-43d1-8623-c684fb9e941e tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f13f6a21e25432f996be6920ee83343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78d9b1aee724032aa9eab0cab0f8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:52.784060 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d3e73420-b2e7-43d1-8623-c684fb9e941e tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] 10.222.0.85 "GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4" status: 200 len: 1527 microversion: 2.1 time: 0.820390 Aug 24 10:20:52.785387 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1212/2175] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:51 2022] GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4 => generated 1527 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:52.816379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-98ab9374-4d2c-4b13-b8c3-02e32e82879d tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:52.817287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-98ab9374-4d2c-4b13-b8c3-02e32e82879d tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:52.835888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98ab9374-4d2c-4b13-b8c3-02e32e82879d tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:52.836310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98ab9374-4d2c-4b13-b8c3-02e32e82879d tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:52.836747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98ab9374-4d2c-4b13-b8c3-02e32e82879d tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:52.839789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98ab9374-4d2c-4b13-b8c3-02e32e82879d tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:52.840303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98ab9374-4d2c-4b13-b8c3-02e32e82879d tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:52.840858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98ab9374-4d2c-4b13-b8c3-02e32e82879d tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:52.927712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-67ff9521-b350-41f4-a9f2-c10ed6715b9f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] validate_networks() for [('f9d3da2a-e7f1-4061-b1c2-835192cdb5b7', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:20:53.792356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-98ab9374-4d2c-4b13-b8c3-02e32e82879d tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:53.827197 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-98ab9374-4d2c-4b13-b8c3-02e32e82879d tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b" status: 200 len: 1474 microversion: 2.1 time: 1.014698 Aug 24 10:20:53.831449 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1213/2176] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:52 2022] GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b => generated 1474 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:53.841858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f8bbb545-0bd5-4567-a4c8-9698ceeb7510 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:53.844054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f8bbb545-0bd5-4567-a4c8-9698ceeb7510 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: b47ddbf3-ca84-419b-ae08-916fb959be5c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:53.854266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8bbb545-0bd5-4567-a4c8-9698ceeb7510 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:53.855651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8bbb545-0bd5-4567-a4c8-9698ceeb7510 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:53.856787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8bbb545-0bd5-4567-a4c8-9698ceeb7510 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:53.858283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8bbb545-0bd5-4567-a4c8-9698ceeb7510 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:53.858998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8bbb545-0bd5-4567-a4c8-9698ceeb7510 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:53.860293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8bbb545-0bd5-4567-a4c8-9698ceeb7510 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:54.304402 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-67ff9521-b350-41f4-a9f2-c10ed6715b9f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:20:54.304988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-67ff9521-b350-41f4-a9f2-c10ed6715b9f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:20:54.305856 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-67ff9521-b350-41f4-a9f2-c10ed6715b9f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:20:54.306518 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-67ff9521-b350-41f4-a9f2-c10ed6715b9f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:20:54.307091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-67ff9521-b350-41f4-a9f2-c10ed6715b9f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:20:54.326361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67ff9521-b350-41f4-a9f2-c10ed6715b9f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:54.327067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67ff9521-b350-41f4-a9f2-c10ed6715b9f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:54.328953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67ff9521-b350-41f4-a9f2-c10ed6715b9f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:54.332245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67ff9521-b350-41f4-a9f2-c10ed6715b9f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:54.338959 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67ff9521-b350-41f4-a9f2-c10ed6715b9f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:54.339716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67ff9521-b350-41f4-a9f2-c10ed6715b9f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:54.370072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-67ff9521-b350-41f4-a9f2-c10ed6715b9f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Getting quotas for project 6f266868d6374a82a4ba5333915a9884. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:20:54.376849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-67ff9521-b350-41f4-a9f2-c10ed6715b9f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Getting quotas for user b321b1490c2b4fe3aa1a1747b25408a1 and project 6f266868d6374a82a4ba5333915a9884. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:20:54.502450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-67ff9521-b350-41f4-a9f2-c10ed6715b9f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:20:54.515084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-67ff9521-b350-41f4-a9f2-c10ed6715b9f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5dada9b8-8d88-41c3-a4a5-1bb0bcc08418',volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:20:54.578626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f8bbb545-0bd5-4567-a4c8-9698ceeb7510 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:54.590701 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f8bbb545-0bd5-4567-a4c8-9698ceeb7510 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c" status: 200 len: 1321 microversion: 2.1 time: 0.756026 Aug 24 10:20:54.592588 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1214/2177] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:53 2022] GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c => generated 1321 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:54.618776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6af10c47-d050-4c6f-a104-13c88920d1ff tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f465a1d0e50>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:54.716532 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6af10c47-d050-4c6f-a104-13c88920d1ff tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1454 microversion: 2.1 time: 0.122407 Aug 24 10:20:54.728057 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1215/2178] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:20:54 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1454 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:54.754484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-af3289d7-a734-4f6a-acfa-2d3168272388 req-0e9bb2e5-2aed-4333-a44e-3b4681e213ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e27996-05a5-41e0-a286-28a6526a95c4", "name": "network-vif-deleted", "tag": "1a6d286f-5d67-4cbe-a84b-791e2bfef490"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:54.784849 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-67ff9521-b350-41f4-a9f2-c10ed6715b9f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.057457 Aug 24 10:20:54.791332 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-af3289d7-a734-4f6a-acfa-2d3168272388 req-0e9bb2e5-2aed-4333-a44e-3b4681e213ae service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:54.797097 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 964/2179] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:20:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:20:54.801724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-af3289d7-a734-4f6a-acfa-2d3168272388 req-0e9bb2e5-2aed-4333-a44e-3b4681e213ae service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:54.802232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-af3289d7-a734-4f6a-acfa-2d3168272388 req-0e9bb2e5-2aed-4333-a44e-3b4681e213ae service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:54.809417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92dcc14a-2700-41b1-b3c5-d6b3011602f8 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:54.810047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-92dcc14a-2700-41b1-b3c5-d6b3011602f8 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] [instance: e5e27996-05a5-41e0-a286-28a6526a95c4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:54.819559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92dcc14a-2700-41b1-b3c5-d6b3011602f8 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:54.825147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92dcc14a-2700-41b1-b3c5-d6b3011602f8 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:54.829042 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92dcc14a-2700-41b1-b3c5-d6b3011602f8 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:54.830109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92dcc14a-2700-41b1-b3c5-d6b3011602f8 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:54.833042 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92dcc14a-2700-41b1-b3c5-d6b3011602f8 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:54.833695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92dcc14a-2700-41b1-b3c5-d6b3011602f8 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:54.834491 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-af3289d7-a734-4f6a-acfa-2d3168272388 req-0e9bb2e5-2aed-4333-a44e-3b4681e213ae service nova] Creating event network-vif-deleted:1a6d286f-5d67-4cbe-a84b-791e2bfef490 for instance e5e27996-05a5-41e0-a286-28a6526a95c4 on n-h2-849328-3 Aug 24 10:20:54.865906 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-92dcc14a-2700-41b1-b3c5-d6b3011602f8 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] HTTP exception thrown: Instance e5e27996-05a5-41e0-a286-28a6526a95c4 could not be found. Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92dcc14a-2700-41b1-b3c5-d6b3011602f8 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Request method failure captured: Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4 HTTP/1.1 Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfth7-Ochtg1KqIilYdUB0HX_jWANliSGvY4TxlI2kLlZrrPGIqomtDo6CSLuhxIZ-_vHcZkgxJbXeLw66L3M0WJ8SSroLW85zoH0ImxGQmYgp6l59wFft_-bwiwd0TE2CkpK11dsjZwLFzpuuwJotSMUYI2vW2mYJ-pc4Ye_QD44fI Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: b78d9b1aee724032aa9eab0cab0f8562 Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1812481964 Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b78d9b1aee724032aa9eab0cab0f8562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b78d9b1aee724032aa9eab0cab0f8562", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b78d9b1aee724032aa9eab0cab0f8562"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b78d9b1aee724032aa9eab0cab0f8562"}]}] Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1812481964 Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: b78d9b1aee724032aa9eab0cab0f8562 Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1812481964 Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-InstanceActionsNegativeTestJSON-1812481964-project Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 4f13f6a21e25432f996be6920ee83343 Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1812481964-project Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance e5e27996-05a5-41e0-a286-28a6526a95c4 could not be found. Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'e5e27996-05a5-41e0-a286-28a6526a95c4'} Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5e27996-05a5-41e0-a286-28a6526a95c4 could not be found. Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5e27996-05a5-41e0-a286-28a6526a95c4 could not be found. Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:54.867841 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:54.874502 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:54.874502 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:54.874502 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:54.874502 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:54.874502 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:20:54.874502 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:20:54.874502 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5e27996-05a5-41e0-a286-28a6526a95c4 could not be found. Aug 24 10:20:54.874502 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:20:54.875457 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-af3289d7-a734-4f6a-acfa-2d3168272388 req-0e9bb2e5-2aed-4333-a44e-3b4681e213ae service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142519 Aug 24 10:20:54.875457 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1216/2180] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:54.883261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92dcc14a-2700-41b1-b3c5-d6b3011602f8 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] Returning 404 to user: Instance e5e27996-05a5-41e0-a286-28a6526a95c4 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:20:54.884450 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-92dcc14a-2700-41b1-b3c5-d6b3011602f8 tempest-InstanceActionsNegativeTestJSON-1812481964 tempest-InstanceActionsNegativeTestJSON-1812481964-project] 10.222.0.85 "GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4" status: 404 len: 111 microversion: 2.1 time: 0.084929 Aug 24 10:20:54.886294 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 965/2181] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:54 2022] GET /compute/v2.1/servers/e5e27996-05a5-41e0-a286-28a6526a95c4 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:20:54.895088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aa06f401-d1d9-4a90-9e1c-95290f22b418 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:54.896948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aa06f401-d1d9-4a90-9e1c-95290f22b418 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:54.904696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-efcebfa5-ac74-4ad8-9a17-b7d0bf4e95c3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:54.905413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-efcebfa5-ac74-4ad8-9a17-b7d0bf4e95c3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:54.906985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa06f401-d1d9-4a90-9e1c-95290f22b418 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:54.908048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa06f401-d1d9-4a90-9e1c-95290f22b418 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:54.908752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa06f401-d1d9-4a90-9e1c-95290f22b418 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:54.910120 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa06f401-d1d9-4a90-9e1c-95290f22b418 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:54.911002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa06f401-d1d9-4a90-9e1c-95290f22b418 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:54.911726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa06f401-d1d9-4a90-9e1c-95290f22b418 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:54.977531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:55.002383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa06f401-d1d9-4a90-9e1c-95290f22b418 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:55.003541 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa06f401-d1d9-4a90-9e1c-95290f22b418 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:55.004637 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa06f401-d1d9-4a90-9e1c-95290f22b418 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:55.005995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-aa06f401-d1d9-4a90-9e1c-95290f22b418 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lazy-loading 'fault' on Instance uuid 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:55.126112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=20 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:55.299470 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aa06f401-d1d9-4a90-9e1c-95290f22b418 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14047bac72234dc7b0384a99fbdabb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b71b3aec6d45c3964585a8b11f2e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:55.308814 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aa06f401-d1d9-4a90-9e1c-95290f22b418 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b" status: 200 len: 1308 microversion: 2.1 time: 0.418106 Aug 24 10:20:55.314589 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 966/2182] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:54 2022] GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b => generated 1308 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:55.385944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-efcebfa5-ac74-4ad8-9a17-b7d0bf4e95c3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:55.402885 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-efcebfa5-ac74-4ad8-9a17-b7d0bf4e95c3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1053 microversion: 2.1 time: 0.524673 Aug 24 10:20:55.418669 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1217/2183] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:54 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1053 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:55.617470 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-be10ee75-098f-45ee-ba08-6ec69cbb6efb tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:55.619603 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-be10ee75-098f-45ee-ba08-6ec69cbb6efb tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: b47ddbf3-ca84-419b-ae08-916fb959be5c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:55.662131 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-cfe15d55-4f5a-4fdc-ac9d-0963fb80e5b6 req-092a24a0-2685-417d-bb05-bd7b875573a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea87f606-60c3-4789-871d-8a8ffc4e0612", "tag": "f501317e-11b3-4f9f-8312-685e663cffdb"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:55.692916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be10ee75-098f-45ee-ba08-6ec69cbb6efb tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:55.702593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be10ee75-098f-45ee-ba08-6ec69cbb6efb tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:55.707010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be10ee75-098f-45ee-ba08-6ec69cbb6efb tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:55.712623 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be10ee75-098f-45ee-ba08-6ec69cbb6efb tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:55.717497 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be10ee75-098f-45ee-ba08-6ec69cbb6efb tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:55.721581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be10ee75-098f-45ee-ba08-6ec69cbb6efb tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:55.742448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-cfe15d55-4f5a-4fdc-ac9d-0963fb80e5b6 req-092a24a0-2685-417d-bb05-bd7b875573a2 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:55.749869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-cfe15d55-4f5a-4fdc-ac9d-0963fb80e5b6 req-092a24a0-2685-417d-bb05-bd7b875573a2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:55.750405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-cfe15d55-4f5a-4fdc-ac9d-0963fb80e5b6 req-092a24a0-2685-417d-bb05-bd7b875573a2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:55.818796 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-cfe15d55-4f5a-4fdc-ac9d-0963fb80e5b6 req-092a24a0-2685-417d-bb05-bd7b875573a2 service nova] Creating event network-changed:f501317e-11b3-4f9f-8312-685e663cffdb for instance ea87f606-60c3-4789-871d-8a8ffc4e0612 on n-h2-849328-3 Aug 24 10:20:55.843904 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-cfe15d55-4f5a-4fdc-ac9d-0963fb80e5b6 req-092a24a0-2685-417d-bb05-bd7b875573a2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185929 Aug 24 10:20:55.844873 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1218/2184] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:55.899629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-942350f4-616c-4ff6-ae39-b86e17d507be tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4654e19e50>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:55.980941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:56.108300 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-942350f4-616c-4ff6-ae39-b86e17d507be tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1454 microversion: 2.1 time: 0.261485 Aug 24 10:20:56.133188 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1219/2185] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:20:55 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1454 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:56.343071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c53ac28b-f0d4-4da5-9f60-4393a5fd8d23 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:56.344382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c53ac28b-f0d4-4da5-9f60-4393a5fd8d23 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] [instance: 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:56.364467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c53ac28b-f0d4-4da5-9f60-4393a5fd8d23 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:56.365986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c53ac28b-f0d4-4da5-9f60-4393a5fd8d23 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:56.366625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c53ac28b-f0d4-4da5-9f60-4393a5fd8d23 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:56.367628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c53ac28b-f0d4-4da5-9f60-4393a5fd8d23 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:56.371175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c53ac28b-f0d4-4da5-9f60-4393a5fd8d23 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:56.371979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c53ac28b-f0d4-4da5-9f60-4393a5fd8d23 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:56.434697 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-c53ac28b-f0d4-4da5-9f60-4393a5fd8d23 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] HTTP exception thrown: Instance 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b could not be found. Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c53ac28b-f0d4-4da5-9f60-4393a5fd8d23 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Request method failure captured: Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b HTTP/1.1 Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBftAaa47NsMS-lqiAPuW76SNRVuIyxvi0UwhZo809XsAf22cZ_tDcoTFvKacmnDOHr2F8-E21iIcz1gqEjCEywtCHW4DQfSNOyfN5eFoUpfm6LnbAJiqpYNnW0JZFC-nyJ2wnf7XQUmxYWLUYezJU5VAeVVHRysqTX81uPxmC9Xp12U Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: e5b71b3aec6d45c3964585a8b11f2e81 Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-LiveMigrationNegativeTest-100007439 Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e5b71b3aec6d45c3964585a8b11f2e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e5b71b3aec6d45c3964585a8b11f2e81", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e5b71b3aec6d45c3964585a8b11f2e81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e5b71b3aec6d45c3964585a8b11f2e81"}]}] Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-LiveMigrationNegativeTest-100007439 Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: e5b71b3aec6d45c3964585a8b11f2e81 Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-100007439 Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-LiveMigrationNegativeTest-100007439-project Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 14047bac72234dc7b0384a99fbdabb67 Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-LiveMigrationNegativeTest-100007439-project Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b could not be found. Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '09ab167e-c8c7-417d-bc49-e9b8ccb8b06b'} Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b could not be found. Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b could not be found. Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:56.439760 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:56.443447 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:56.443447 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:56.443447 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:56.443447 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:20:56.443447 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:20:56.443447 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b could not be found. Aug 24 10:20:56.443447 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:20:56.452222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c53ac28b-f0d4-4da5-9f60-4393a5fd8d23 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] Returning 404 to user: Instance 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:20:56.453512 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c53ac28b-f0d4-4da5-9f60-4393a5fd8d23 tempest-LiveMigrationNegativeTest-100007439 tempest-LiveMigrationNegativeTest-100007439-project] 10.222.0.85 "GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b" status: 404 len: 111 microversion: 2.1 time: 0.114929 Aug 24 10:20:56.456248 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1220/2186] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:56 2022] GET /compute/v2.1/servers/09ab167e-c8c7-417d-bc49-e9b8ccb8b06b => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:20:56.476379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c63ca63b-ddc9-4540-b077-8a1ad32f95d7 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:56.480505 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c63ca63b-ddc9-4540-b077-8a1ad32f95d7 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:56.512596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c63ca63b-ddc9-4540-b077-8a1ad32f95d7 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:56.513494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c63ca63b-ddc9-4540-b077-8a1ad32f95d7 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:56.514249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c63ca63b-ddc9-4540-b077-8a1ad32f95d7 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:56.516042 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c63ca63b-ddc9-4540-b077-8a1ad32f95d7 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:56.516827 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c63ca63b-ddc9-4540-b077-8a1ad32f95d7 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:56.517615 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c63ca63b-ddc9-4540-b077-8a1ad32f95d7 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:56.835047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c63ca63b-ddc9-4540-b077-8a1ad32f95d7 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:56.846272 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c63ca63b-ddc9-4540-b077-8a1ad32f95d7 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1151 microversion: 2.1 time: 0.388467 Aug 24 10:20:56.859943 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1221/2187] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:56 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1151 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:57.000618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c8fa51d6-31ea-4666-9f18-57639eb2b6ac req-15d43795-b75e-44a1-ae96-3960251e5325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ab167e-c8c7-417d-bc49-e9b8ccb8b06b", "name": "network-vif-deleted", "tag": "c8226ca9-d3ae-4597-b639-5cf9aee131e9"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:57.020223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c8fa51d6-31ea-4666-9f18-57639eb2b6ac req-15d43795-b75e-44a1-ae96-3960251e5325 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:57.020722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c8fa51d6-31ea-4666-9f18-57639eb2b6ac req-15d43795-b75e-44a1-ae96-3960251e5325 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:57.021188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c8fa51d6-31ea-4666-9f18-57639eb2b6ac req-15d43795-b75e-44a1-ae96-3960251e5325 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:57.069208 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c8fa51d6-31ea-4666-9f18-57639eb2b6ac req-15d43795-b75e-44a1-ae96-3960251e5325 service nova] Creating event network-vif-deleted:c8226ca9-d3ae-4597-b639-5cf9aee131e9 for instance 09ab167e-c8c7-417d-bc49-e9b8ccb8b06b on n-h1-849328-3 Aug 24 10:20:57.083098 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c8fa51d6-31ea-4666-9f18-57639eb2b6ac req-15d43795-b75e-44a1-ae96-3960251e5325 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094927 Aug 24 10:20:57.090337 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1222/2188] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 24 10:20:57.147349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-29615703-c286-485d-a895-8235fa33db2f tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4654e19af0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:57.248117 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-29615703-c286-485d-a895-8235fa33db2f tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1454 microversion: 2.1 time: 0.105695 Aug 24 10:20:57.249326 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1223/2189] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:20:57 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:20:57.502542 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-be10ee75-098f-45ee-ba08-6ec69cbb6efb tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:57.514575 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-be10ee75-098f-45ee-ba08-6ec69cbb6efb tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c" status: 200 len: 1321 microversion: 2.1 time: 1.905145 Aug 24 10:20:57.535372 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 967/2190] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:55 2022] GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c => generated 1321 bytes in 1915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:57.874030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-3fc0b3e3-05f3-44b8-b0d0-3de94ebb5f60 req-799ec922-30bf-40e7-bdbc-aa05ef203815 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b47ddbf3-ca84-419b-ae08-916fb959be5c", "tag": "a6b2f639-dad5-4400-beb9-77abcd596b1b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:57.885899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-53f02b0c-e25e-4c34-8ab4-873c97d901ea tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:57.887162 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-53f02b0c-e25e-4c34-8ab4-873c97d901ea tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:57.923233 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53f02b0c-e25e-4c34-8ab4-873c97d901ea tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:57.926283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53f02b0c-e25e-4c34-8ab4-873c97d901ea tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:57.929646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53f02b0c-e25e-4c34-8ab4-873c97d901ea tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:57.931375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53f02b0c-e25e-4c34-8ab4-873c97d901ea tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:57.934129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53f02b0c-e25e-4c34-8ab4-873c97d901ea tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:57.937479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3fc0b3e3-05f3-44b8-b0d0-3de94ebb5f60 req-799ec922-30bf-40e7-bdbc-aa05ef203815 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:57.938837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53f02b0c-e25e-4c34-8ab4-873c97d901ea tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:57.944856 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3fc0b3e3-05f3-44b8-b0d0-3de94ebb5f60 req-799ec922-30bf-40e7-bdbc-aa05ef203815 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:57.946165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3fc0b3e3-05f3-44b8-b0d0-3de94ebb5f60 req-799ec922-30bf-40e7-bdbc-aa05ef203815 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:57.983397 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-3fc0b3e3-05f3-44b8-b0d0-3de94ebb5f60 req-799ec922-30bf-40e7-bdbc-aa05ef203815 service nova] Creating event network-changed:a6b2f639-dad5-4400-beb9-77abcd596b1b for instance b47ddbf3-ca84-419b-ae08-916fb959be5c on n-h2-849328-3 Aug 24 10:20:57.996698 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-3fc0b3e3-05f3-44b8-b0d0-3de94ebb5f60 req-799ec922-30bf-40e7-bdbc-aa05ef203815 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132009 Aug 24 10:20:58.008883 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1224/2191] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:58.141847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-53f02b0c-e25e-4c34-8ab4-873c97d901ea tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:58.167749 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-53f02b0c-e25e-4c34-8ab4-873c97d901ea tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1169 microversion: 2.1 time: 0.290801 Aug 24 10:20:58.169029 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 968/2192] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:57 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1169 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:20:58.263932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0e8550be-25ce-4b37-80d5-8a021d4ab8f6 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4654de3160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:58.386332 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0e8550be-25ce-4b37-80d5-8a021d4ab8f6 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1454 microversion: 2.1 time: 0.127351 Aug 24 10:20:58.387422 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1225/2193] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:20:58 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1454 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:58.544777 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-78be1834-66f1-4f87-b25f-e6f0aa96ccfe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:58.547304 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-78be1834-66f1-4f87-b25f-e6f0aa96ccfe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: b47ddbf3-ca84-419b-ae08-916fb959be5c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:58.577511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78be1834-66f1-4f87-b25f-e6f0aa96ccfe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:58.578596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78be1834-66f1-4f87-b25f-e6f0aa96ccfe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:58.579632 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78be1834-66f1-4f87-b25f-e6f0aa96ccfe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:58.580834 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78be1834-66f1-4f87-b25f-e6f0aa96ccfe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:58.587429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78be1834-66f1-4f87-b25f-e6f0aa96ccfe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:58.588446 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78be1834-66f1-4f87-b25f-e6f0aa96ccfe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:58.664450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:58.864730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c2893289-a878-4d86-a5bb-570d82b451cd req-29931364-1aeb-4e25-a7ae-a6b36a0aa93c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bc88682-b0f5-42fc-88e5-a74d75b8e241", "name": "network-vif-plugged", "status": "completed", "tag": "5f373a77-7c6e-43b9-9e7b-44520530587d"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:58.921904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c2893289-a878-4d86-a5bb-570d82b451cd req-29931364-1aeb-4e25-a7ae-a6b36a0aa93c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:58.935155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c2893289-a878-4d86-a5bb-570d82b451cd req-29931364-1aeb-4e25-a7ae-a6b36a0aa93c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:58.937227 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c2893289-a878-4d86-a5bb-570d82b451cd req-29931364-1aeb-4e25-a7ae-a6b36a0aa93c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:58.977699 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c2893289-a878-4d86-a5bb-570d82b451cd req-29931364-1aeb-4e25-a7ae-a6b36a0aa93c service nova] Creating event network-vif-plugged:5f373a77-7c6e-43b9-9e7b-44520530587d for instance 2bc88682-b0f5-42fc-88e5-a74d75b8e241 on n-h1-849328-3 Aug 24 10:20:58.985606 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c2893289-a878-4d86-a5bb-570d82b451cd req-29931364-1aeb-4e25-a7ae-a6b36a0aa93c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134736 Aug 24 10:20:58.986633 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1226/2194] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:59.195013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bae90eba-a28c-49d9-bfd5-6be658e5f0ec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:59.196627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bae90eba-a28c-49d9-bfd5-6be658e5f0ec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:59.217661 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bae90eba-a28c-49d9-bfd5-6be658e5f0ec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:59.218604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bae90eba-a28c-49d9-bfd5-6be658e5f0ec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:59.221755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bae90eba-a28c-49d9-bfd5-6be658e5f0ec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:59.226112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bae90eba-a28c-49d9-bfd5-6be658e5f0ec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:59.227035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bae90eba-a28c-49d9-bfd5-6be658e5f0ec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:59.227648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bae90eba-a28c-49d9-bfd5-6be658e5f0ec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:59.338186 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-78be1834-66f1-4f87-b25f-e6f0aa96ccfe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:59.368153 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-78be1834-66f1-4f87-b25f-e6f0aa96ccfe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c" status: 200 len: 1321 microversion: 2.1 time: 0.827711 Aug 24 10:20:59.373313 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 969/2195] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:58 2022] GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c => generated 1321 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:59.402807 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0fd16a04-d1c0-47fe-914c-0a9824e2ceac tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f465a204280>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:59.495766 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0fd16a04-d1c0-47fe-914c-0a9824e2ceac tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1454 microversion: 2.1 time: 0.097885 Aug 24 10:20:59.512039 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 970/2196] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:20:59 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:59.710527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bae90eba-a28c-49d9-bfd5-6be658e5f0ec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:59.731076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:59.734493 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bae90eba-a28c-49d9-bfd5-6be658e5f0ec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1169 microversion: 2.1 time: 0.545936 Aug 24 10:20:59.735918 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1227/2197] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:59 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1169 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:21:00.406961 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-13cf9be5-8b74-49fc-b4d0-d951a81da7a4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:00.407740 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-13cf9be5-8b74-49fc-b4d0-d951a81da7a4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: b47ddbf3-ca84-419b-ae08-916fb959be5c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:00.451027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13cf9be5-8b74-49fc-b4d0-d951a81da7a4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:00.452316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13cf9be5-8b74-49fc-b4d0-d951a81da7a4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:00.455671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13cf9be5-8b74-49fc-b4d0-d951a81da7a4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:00.458978 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13cf9be5-8b74-49fc-b4d0-d951a81da7a4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:00.460683 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13cf9be5-8b74-49fc-b4d0-d951a81da7a4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:00.465785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13cf9be5-8b74-49fc-b4d0-d951a81da7a4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:00.522718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-95af48c3-6642-4b16-ad5e-af254b7d3056 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4654e1d550>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:00.640228 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-95af48c3-6642-4b16-ad5e-af254b7d3056 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1454 microversion: 2.1 time: 0.126801 Aug 24 10:21:00.641220 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1228/2198] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:21:00 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1454 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:00.761405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7ecaed59-7b43-4a8e-abef-f84490e620ec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:00.762673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7ecaed59-7b43-4a8e-abef-f84490e620ec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:00.772695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ecaed59-7b43-4a8e-abef-f84490e620ec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:00.773921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ecaed59-7b43-4a8e-abef-f84490e620ec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:00.774789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ecaed59-7b43-4a8e-abef-f84490e620ec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:00.776432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ecaed59-7b43-4a8e-abef-f84490e620ec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:00.777470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ecaed59-7b43-4a8e-abef-f84490e620ec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:00.782059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ecaed59-7b43-4a8e-abef-f84490e620ec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:01.801698 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-13cf9be5-8b74-49fc-b4d0-d951a81da7a4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:01.829702 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-13cf9be5-8b74-49fc-b4d0-d951a81da7a4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c" status: 200 len: 1321 microversion: 2.1 time: 1.433466 Aug 24 10:21:01.835003 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 971/2199] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:00 2022] GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c => generated 1321 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:01.856486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9f5b12d8-1fbf-4417-bdce-423041ed3f97 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f465a259550>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:01.951503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7ecaed59-7b43-4a8e-abef-f84490e620ec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:01.959960 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7ecaed59-7b43-4a8e-abef-f84490e620ec tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1211 microversion: 2.1 time: 1.204227 Aug 24 10:21:01.972243 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1229/2200] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:00 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1211 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:02.062035 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9f5b12d8-1fbf-4417-bdce-423041ed3f97 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1454 microversion: 2.1 time: 0.218482 Aug 24 10:21:02.064373 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 972/2201] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:21:01 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1454 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:02.855263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dd07f1fe-69a9-4625-b36f-db122f97db2c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:02.856060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dd07f1fe-69a9-4625-b36f-db122f97db2c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: b47ddbf3-ca84-419b-ae08-916fb959be5c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:02.873237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd07f1fe-69a9-4625-b36f-db122f97db2c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:02.876429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd07f1fe-69a9-4625-b36f-db122f97db2c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:02.879506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd07f1fe-69a9-4625-b36f-db122f97db2c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:02.885226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd07f1fe-69a9-4625-b36f-db122f97db2c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:02.890212 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd07f1fe-69a9-4625-b36f-db122f97db2c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:02.896711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd07f1fe-69a9-4625-b36f-db122f97db2c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:03.010430 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9adf5a5b-dbc0-4cd2-8fae-d47be07627a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:03.011081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9adf5a5b-dbc0-4cd2-8fae-d47be07627a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:03.042289 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9adf5a5b-dbc0-4cd2-8fae-d47be07627a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:03.044202 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9adf5a5b-dbc0-4cd2-8fae-d47be07627a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:03.045580 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9adf5a5b-dbc0-4cd2-8fae-d47be07627a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:03.046420 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9adf5a5b-dbc0-4cd2-8fae-d47be07627a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:03.048406 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9adf5a5b-dbc0-4cd2-8fae-d47be07627a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:03.050183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9adf5a5b-dbc0-4cd2-8fae-d47be07627a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:04.183024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dd07f1fe-69a9-4625-b36f-db122f97db2c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:04.194181 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dd07f1fe-69a9-4625-b36f-db122f97db2c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c" status: 200 len: 1321 microversion: 2.1 time: 1.342806 Aug 24 10:21:04.202653 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1230/2202] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:02 2022] GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c => generated 1321 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:04.215352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-48ec6571-155a-4381-873e-876e4c29b4e1 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4654e7b430>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:04.357941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:04.367337 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-48ec6571-155a-4381-873e-876e4c29b4e1 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1454 microversion: 2.1 time: 0.163043 Aug 24 10:21:04.387281 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1231/2203] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:21:04 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1454 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:04.388687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-76134236-9b6f-4dca-bad6-d8371f42a320 req-3d455d9c-773c-4c4f-9de3-c15e93372b89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea87f606-60c3-4789-871d-8a8ffc4e0612", "name": "network-vif-plugged", "status": "completed", "tag": "f501317e-11b3-4f9f-8312-685e663cffdb"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:04.389824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:04.421105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-76134236-9b6f-4dca-bad6-d8371f42a320 req-3d455d9c-773c-4c4f-9de3-c15e93372b89 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:04.422003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-76134236-9b6f-4dca-bad6-d8371f42a320 req-3d455d9c-773c-4c4f-9de3-c15e93372b89 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:04.431283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-76134236-9b6f-4dca-bad6-d8371f42a320 req-3d455d9c-773c-4c4f-9de3-c15e93372b89 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:04.454968 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-76134236-9b6f-4dca-bad6-d8371f42a320 req-3d455d9c-773c-4c4f-9de3-c15e93372b89 service nova] Creating event network-vif-plugged:f501317e-11b3-4f9f-8312-685e663cffdb for instance ea87f606-60c3-4789-871d-8a8ffc4e0612 on n-h2-849328-3 Aug 24 10:21:04.462800 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-76134236-9b6f-4dca-bad6-d8371f42a320 req-3d455d9c-773c-4c4f-9de3-c15e93372b89 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080487 Aug 24 10:21:04.463724 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1232/2204] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:04.610176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e0dfcbd1-50dd-4ef5-bef8-093e6373a8af tempest-QuotaClassesAdminTestJSON-312212454 tempest-QuotaClassesAdminTestJSON-312212454-project-admin] Calling method '.version_select at 0x7f4654e1d4c0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:04.611366 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:21:04.611366 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:21:04.638253 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e0dfcbd1-50dd-4ef5-bef8-093e6373a8af tempest-QuotaClassesAdminTestJSON-312212454 tempest-QuotaClassesAdminTestJSON-312212454-project-admin] 10.222.0.85 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.172947 Aug 24 10:21:04.645485 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1233/2205] 10.222.0.85 () {58 vars in 1185 bytes} [Wed Aug 24 10:21:04 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:04.659882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6d3e6536-72df-40f7-ae79-9d54949be695 tempest-QuotaClassesAdminTestJSON-312212454 tempest-QuotaClassesAdminTestJSON-312212454-project-admin] Action: 'update', calling method: .version_select at 0x7f465522c550>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:04.675867 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:21:04.675867 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:21:05.191889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=8,nova_api:INSERT=5 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:05.494577 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6d3e6536-72df-40f7-ae79-9d54949be695 tempest-QuotaClassesAdminTestJSON-312212454 tempest-QuotaClassesAdminTestJSON-312212454-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.831739 Aug 24 10:21:05.495615 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1234/2206] 10.222.0.85 () {60 vars in 1206 bytes} [Wed Aug 24 10:21:04 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:21:05.510506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b39c62de-d9af-4fbb-8db1-f44664275bd4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:05.511165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b39c62de-d9af-4fbb-8db1-f44664275bd4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: b47ddbf3-ca84-419b-ae08-916fb959be5c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:05.527635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9adf5a5b-dbc0-4cd2-8fae-d47be07627a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:05.532345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b39c62de-d9af-4fbb-8db1-f44664275bd4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:05.532858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b39c62de-d9af-4fbb-8db1-f44664275bd4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:05.549305 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b39c62de-d9af-4fbb-8db1-f44664275bd4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:05.549905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b39c62de-d9af-4fbb-8db1-f44664275bd4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:05.550406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b39c62de-d9af-4fbb-8db1-f44664275bd4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:05.550858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b39c62de-d9af-4fbb-8db1-f44664275bd4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:05.589820 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9adf5a5b-dbc0-4cd2-8fae-d47be07627a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1211 microversion: 2.1 time: 2.584807 Aug 24 10:21:05.592319 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 973/2207] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:03 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1211 bytes in 2589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:05.616379 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3bd61705-b91a-4555-b1a0-c5b0c45fe380 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f465a3ff550>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:05.835844 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3bd61705-b91a-4555-b1a0-c5b0c45fe380 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1454 microversion: 2.1 time: 0.228829 Aug 24 10:21:05.871502 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 974/2208] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:21:05 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1454 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:05.890897 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8e0c6d83-ba74-4db9-8c3e-00336bff56dd tempest-QuotaClassesAdminTestJSON-312212454 tempest-QuotaClassesAdminTestJSON-312212454-project-admin] Calling method '.version_select at 0x7f465556c4c0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:05.895588 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:21:05.895588 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:21:06.018936 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8e0c6d83-ba74-4db9-8c3e-00336bff56dd tempest-QuotaClassesAdminTestJSON-312212454 tempest-QuotaClassesAdminTestJSON-312212454-project-admin] 10.222.0.85 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.143456 Aug 24 10:21:06.045829 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 975/2209] 10.222.0.85 () {58 vars in 1185 bytes} [Wed Aug 24 10:21:05 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:06.076766 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ccec6da4-f47d-45ab-8183-13fd231abc4d tempest-QuotaClassesAdminTestJSON-312212454 tempest-QuotaClassesAdminTestJSON-312212454-project-admin] Action: 'update', calling method: .version_select at 0x7f46558370d0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:06.083495 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:21:06.083495 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:21:06.325537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b39c62de-d9af-4fbb-8db1-f44664275bd4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:06.348379 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b39c62de-d9af-4fbb-8db1-f44664275bd4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c" status: 200 len: 1321 microversion: 2.1 time: 0.844655 Aug 24 10:21:06.350903 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1235/2210] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:05 2022] GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c => generated 1321 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:06.378588 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ccec6da4-f47d-45ab-8183-13fd231abc4d tempest-QuotaClassesAdminTestJSON-312212454 tempest-QuotaClassesAdminTestJSON-312212454-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.327801 Aug 24 10:21:06.381310 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 976/2211] 10.222.0.85 () {60 vars in 1206 bytes} [Wed Aug 24 10:21:06 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:06.629165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1993ce5d-9797-4da9-92ee-018ccd755211 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:06.630541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1993ce5d-9797-4da9-92ee-018ccd755211 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:06.656759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1993ce5d-9797-4da9-92ee-018ccd755211 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:06.657394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1993ce5d-9797-4da9-92ee-018ccd755211 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:06.657842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1993ce5d-9797-4da9-92ee-018ccd755211 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:06.658603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1993ce5d-9797-4da9-92ee-018ccd755211 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:06.659059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1993ce5d-9797-4da9-92ee-018ccd755211 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:06.659506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1993ce5d-9797-4da9-92ee-018ccd755211 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:06.860758 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-941a9179-e03c-4c1d-b200-f1ca51703ba6 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f465587c4c0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:06.974722 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-941a9179-e03c-4c1d-b200-f1ca51703ba6 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1454 microversion: 2.1 time: 0.120239 Aug 24 10:21:06.977059 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 977/2212] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:21:06 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:07.277218 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e34f78cb-41f0-4ad3-aed5-0af6fc72473d req-334f1770-8c96-433a-bbc1-0662ebf9d454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c66c18-c34f-4916-aca3-da0ca33f9ba5", "tag": "7b95f9a5-8709-4c1d-8f96-0d1c5094bcb8"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:07.309613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e34f78cb-41f0-4ad3-aed5-0af6fc72473d req-334f1770-8c96-433a-bbc1-0662ebf9d454 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:07.316454 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e34f78cb-41f0-4ad3-aed5-0af6fc72473d req-334f1770-8c96-433a-bbc1-0662ebf9d454 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:07.317550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e34f78cb-41f0-4ad3-aed5-0af6fc72473d req-334f1770-8c96-433a-bbc1-0662ebf9d454 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:07.346658 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e34f78cb-41f0-4ad3-aed5-0af6fc72473d req-334f1770-8c96-433a-bbc1-0662ebf9d454 service nova] Creating event network-changed:7b95f9a5-8709-4c1d-8f96-0d1c5094bcb8 for instance 70c66c18-c34f-4916-aca3-da0ca33f9ba5 on n-h1-849328-3 Aug 24 10:21:07.369775 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e34f78cb-41f0-4ad3-aed5-0af6fc72473d req-334f1770-8c96-433a-bbc1-0662ebf9d454 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096654 Aug 24 10:21:07.374411 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 978/2213] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:21:07.382216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df10e78b-88fa-41ed-b943-3e96bad74da8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:07.394374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-df10e78b-88fa-41ed-b943-3e96bad74da8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: b47ddbf3-ca84-419b-ae08-916fb959be5c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:07.427012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df10e78b-88fa-41ed-b943-3e96bad74da8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:07.427910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df10e78b-88fa-41ed-b943-3e96bad74da8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:07.428600 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df10e78b-88fa-41ed-b943-3e96bad74da8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:07.429736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df10e78b-88fa-41ed-b943-3e96bad74da8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:07.430418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df10e78b-88fa-41ed-b943-3e96bad74da8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:07.431063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df10e78b-88fa-41ed-b943-3e96bad74da8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:08.724382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1993ce5d-9797-4da9-92ee-018ccd755211 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:08.739761 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1993ce5d-9797-4da9-92ee-018ccd755211 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1211 microversion: 2.1 time: 2.115307 Aug 24 10:21:08.747473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-df10e78b-88fa-41ed-b943-3e96bad74da8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:08.759064 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-df10e78b-88fa-41ed-b943-3e96bad74da8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c" status: 200 len: 1321 microversion: 2.1 time: 1.382917 Aug 24 10:21:08.761849 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1236/2214] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:06 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1211 bytes in 2138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:08.766564 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 979/2215] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:07 2022] GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c => generated 1321 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:08.767782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7c6f9514-8379-4491-83f1-5382edbc75b0 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4654f2bb80>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:08.867262 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7c6f9514-8379-4491-83f1-5382edbc75b0 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1454 microversion: 2.1 time: 0.103671 Aug 24 10:21:08.867886 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1237/2216] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:21:08 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:08.995817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ddcc9073-6649-4cf2-ac0a-0d5968c28ca2 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:09.001034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ddcc9073-6649-4cf2-ac0a-0d5968c28ca2 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e52ac750849e4207bbc6e320210bb2b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823f96998a0341559f6a637f9a5b840c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:09.002050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ddcc9073-6649-4cf2-ac0a-0d5968c28ca2 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Searching by: {'deleted': False, 'project_id': '823f96998a0341559f6a637f9a5b840c'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:21:09.017170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddcc9073-6649-4cf2-ac0a-0d5968c28ca2 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:09.017652 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddcc9073-6649-4cf2-ac0a-0d5968c28ca2 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:09.023441 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddcc9073-6649-4cf2-ac0a-0d5968c28ca2 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:09.024487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddcc9073-6649-4cf2-ac0a-0d5968c28ca2 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:09.025183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddcc9073-6649-4cf2-ac0a-0d5968c28ca2 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:09.025908 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddcc9073-6649-4cf2-ac0a-0d5968c28ca2 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:09.082935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-ddcc9073-6649-4cf2-ac0a-0d5968c28ca2 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:21:09.161092 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ddcc9073-6649-4cf2-ac0a-0d5968c28ca2 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.169239 Aug 24 10:21:09.162006 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 980/2217] 10.222.0.85 () {58 vars in 1125 bytes} [Wed Aug 24 10:21:08 2022] GET /compute/v2.1/servers => generated 339 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:09.175959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d2c66fde-aa6f-41d5-846a-8821ecc5276f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:09.184536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d2c66fde-aa6f-41d5-846a-8821ecc5276f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e52ac750849e4207bbc6e320210bb2b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823f96998a0341559f6a637f9a5b840c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:09.191769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d2c66fde-aa6f-41d5-846a-8821ecc5276f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Searching by: {'deleted': False, 'project_id': '823f96998a0341559f6a637f9a5b840c'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:21:09.199976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2c66fde-aa6f-41d5-846a-8821ecc5276f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:09.209939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2c66fde-aa6f-41d5-846a-8821ecc5276f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:09.210887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2c66fde-aa6f-41d5-846a-8821ecc5276f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:09.212103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2c66fde-aa6f-41d5-846a-8821ecc5276f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:09.212820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2c66fde-aa6f-41d5-846a-8821ecc5276f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:09.213699 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2c66fde-aa6f-41d5-846a-8821ecc5276f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:09.283517 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-d2c66fde-aa6f-41d5-846a-8821ecc5276f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:21:09.475900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e26e8b2a-152e-41c9-8664-480d7574f10a req-e0a9a8f9-c4de-44c8-bef3-799d4ba4bc38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b47ddbf3-ca84-419b-ae08-916fb959be5c", "name": "network-vif-plugged", "status": "completed", "tag": "a6b2f639-dad5-4400-beb9-77abcd596b1b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:09.520789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e26e8b2a-152e-41c9-8664-480d7574f10a req-e0a9a8f9-c4de-44c8-bef3-799d4ba4bc38 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:09.525376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e26e8b2a-152e-41c9-8664-480d7574f10a req-e0a9a8f9-c4de-44c8-bef3-799d4ba4bc38 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:09.526232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e26e8b2a-152e-41c9-8664-480d7574f10a req-e0a9a8f9-c4de-44c8-bef3-799d4ba4bc38 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:09.565299 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e26e8b2a-152e-41c9-8664-480d7574f10a req-e0a9a8f9-c4de-44c8-bef3-799d4ba4bc38 service nova] Creating event network-vif-plugged:a6b2f639-dad5-4400-beb9-77abcd596b1b for instance b47ddbf3-ca84-419b-ae08-916fb959be5c on n-h2-849328-3 Aug 24 10:21:09.577334 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e26e8b2a-152e-41c9-8664-480d7574f10a req-e0a9a8f9-c4de-44c8-bef3-799d4ba4bc38 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108536 Aug 24 10:21:09.585376 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 981/2218] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:09.593423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d2c66fde-aa6f-41d5-846a-8821ecc5276f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e52ac750849e4207bbc6e320210bb2b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823f96998a0341559f6a637f9a5b840c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:09.613718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2c66fde-aa6f-41d5-846a-8821ecc5276f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:09.614417 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2c66fde-aa6f-41d5-846a-8821ecc5276f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:09.615021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2c66fde-aa6f-41d5-846a-8821ecc5276f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:09.790037 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b127db1-003c-44d6-88e7-5b55bf0e7005 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:09.791390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2b127db1-003c-44d6-88e7-5b55bf0e7005 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:09.813771 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b127db1-003c-44d6-88e7-5b55bf0e7005 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:09.814463 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b127db1-003c-44d6-88e7-5b55bf0e7005 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:09.815054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b127db1-003c-44d6-88e7-5b55bf0e7005 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:09.818088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b127db1-003c-44d6-88e7-5b55bf0e7005 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:09.818785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b127db1-003c-44d6-88e7-5b55bf0e7005 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:09.819376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b127db1-003c-44d6-88e7-5b55bf0e7005 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:10.026130 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d2c66fde-aa6f-41d5-846a-8821ecc5276f tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "GET /compute/v2.1/servers/detail" status: 200 len: 1708 microversion: 2.1 time: 0.854140 Aug 24 10:21:10.028521 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1238/2219] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:21:09 2022] GET /compute/v2.1/servers/detail => generated 1708 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:10.034868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6acdccba-b914-47fd-97df-13276e4188a9 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:10.037103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6acdccba-b914-47fd-97df-13276e4188a9 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: b47ddbf3-ca84-419b-ae08-916fb959be5c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:10.058345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6acdccba-b914-47fd-97df-13276e4188a9 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:10.062547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6acdccba-b914-47fd-97df-13276e4188a9 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:10.063585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6acdccba-b914-47fd-97df-13276e4188a9 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:10.066677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6acdccba-b914-47fd-97df-13276e4188a9 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:10.067766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6acdccba-b914-47fd-97df-13276e4188a9 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:10.071920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6acdccba-b914-47fd-97df-13276e4188a9 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:10.204641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2b127db1-003c-44d6-88e7-5b55bf0e7005 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:10.223034 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2b127db1-003c-44d6-88e7-5b55bf0e7005 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1211 microversion: 2.1 time: 0.437150 Aug 24 10:21:10.224188 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 982/2220] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:09 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1211 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:21:10.237293 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6f34e9b7-c9aa-43c2-89bb-e01b64eb6e97 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4655176d30>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:10.322240 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6f34e9b7-c9aa-43c2-89bb-e01b64eb6e97 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1454 microversion: 2.1 time: 0.096636 Aug 24 10:21:10.324032 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 983/2221] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:21:10 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:10.341821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3c436599-be25-4468-bbc7-17eef90c4e05 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:10.371097 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3c436599-be25-4468-bbc7-17eef90c4e05 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.045543 Aug 24 10:21:10.383163 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 984/2222] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:21:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:10.855058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3b6d1033-b438-42cb-a502-8837b71e5a57 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:10.855712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3b6d1033-b438-42cb-a502-8837b71e5a57 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] [instance: e5cf9540-fba0-498d-890d-af316b16ceff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:10.893106 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b6d1033-b438-42cb-a502-8837b71e5a57 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:10.893647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b6d1033-b438-42cb-a502-8837b71e5a57 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:10.894089 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b6d1033-b438-42cb-a502-8837b71e5a57 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:10.910824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b6d1033-b438-42cb-a502-8837b71e5a57 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:10.916051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b6d1033-b438-42cb-a502-8837b71e5a57 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:10.918341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b6d1033-b438-42cb-a502-8837b71e5a57 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:11.040734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3b6d1033-b438-42cb-a502-8837b71e5a57 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] [instance: e5cf9540-fba0-498d-890d-af316b16ceff] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:21:11.244742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6acdccba-b914-47fd-97df-13276e4188a9 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:11.275948 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6acdccba-b914-47fd-97df-13276e4188a9 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c" status: 200 len: 1321 microversion: 2.1 time: 1.245259 Aug 24 10:21:11.286225 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1239/2223] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:10 2022] GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c => generated 1321 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:11.322848 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b073daed-4935-4b54-977f-894026aa99b3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:11.328102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b073daed-4935-4b54-977f-894026aa99b3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:11.364481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b073daed-4935-4b54-977f-894026aa99b3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:11.366152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b073daed-4935-4b54-977f-894026aa99b3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:11.367654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b073daed-4935-4b54-977f-894026aa99b3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:11.369688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b073daed-4935-4b54-977f-894026aa99b3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:11.382930 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b073daed-4935-4b54-977f-894026aa99b3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:11.384282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b073daed-4935-4b54-977f-894026aa99b3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:11.561002 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3b6d1033-b438-42cb-a502-8837b71e5a57 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "DELETE /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff" status: 204 len: 0 microversion: 2.1 time: 0.709041 Aug 24 10:21:11.562587 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 985/2224] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:21:10 2022] DELETE /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff => generated 0 bytes in 713 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 10:21:11.585986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0991b526-9510-4289-b9ab-ecc79980641e tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f465a28c160>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:11.737537 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0991b526-9510-4289-b9ab-ecc79980641e tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1454 microversion: 2.1 time: 0.162407 Aug 24 10:21:11.741348 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 986/2225] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:21:11 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1454 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:11.765759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7c05cfeb-1a9d-44f6-90f0-166b8944152b tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:11.766624 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7c05cfeb-1a9d-44f6-90f0-166b8944152b tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] [instance: e5cf9540-fba0-498d-890d-af316b16ceff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:11.783185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c05cfeb-1a9d-44f6-90f0-166b8944152b tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:11.783676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c05cfeb-1a9d-44f6-90f0-166b8944152b tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:11.784176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c05cfeb-1a9d-44f6-90f0-166b8944152b tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:11.786320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c05cfeb-1a9d-44f6-90f0-166b8944152b tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:11.787356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c05cfeb-1a9d-44f6-90f0-166b8944152b tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:11.787798 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c05cfeb-1a9d-44f6-90f0-166b8944152b tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:11.982518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b073daed-4935-4b54-977f-894026aa99b3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:12.002625 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b073daed-4935-4b54-977f-894026aa99b3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1211 microversion: 2.1 time: 0.712607 Aug 24 10:21:12.004230 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1240/2226] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:11 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1211 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:12.307545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c5973ab0-7012-45dc-b9c0-912653467a6c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:12.308550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c5973ab0-7012-45dc-b9c0-912653467a6c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: b47ddbf3-ca84-419b-ae08-916fb959be5c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:12.323225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5973ab0-7012-45dc-b9c0-912653467a6c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:12.330248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5973ab0-7012-45dc-b9c0-912653467a6c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:12.331662 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5973ab0-7012-45dc-b9c0-912653467a6c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:12.332546 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5973ab0-7012-45dc-b9c0-912653467a6c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:12.333149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5973ab0-7012-45dc-b9c0-912653467a6c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:12.333710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5973ab0-7012-45dc-b9c0-912653467a6c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:12.449889 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7c05cfeb-1a9d-44f6-90f0-166b8944152b tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e52ac750849e4207bbc6e320210bb2b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823f96998a0341559f6a637f9a5b840c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:12.501109 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7c05cfeb-1a9d-44f6-90f0-166b8944152b tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff" status: 200 len: 1711 microversion: 2.1 time: 0.757958 Aug 24 10:21:12.531374 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 987/2227] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:11 2022] GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff => generated 1711 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:12.662742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c5973ab0-7012-45dc-b9c0-912653467a6c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:12.676615 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c5973ab0-7012-45dc-b9c0-912653467a6c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c" status: 200 len: 1321 microversion: 2.1 time: 0.373476 Aug 24 10:21:12.685611 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1241/2228] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:12 2022] GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c => generated 1321 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:12.758675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0668d756-2779-4d74-a8a9-bfc2d224de5e tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4656430ca0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:12.913799 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0668d756-2779-4d74-a8a9-bfc2d224de5e tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1454 microversion: 2.1 time: 0.160233 Aug 24 10:21:12.925349 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 988/2229] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:21:12 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1454 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:13.038921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5aacbfc2-f7d1-4422-9a87-6d05e66fc0e2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:13.039875 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5aacbfc2-f7d1-4422-9a87-6d05e66fc0e2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:13.067283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5aacbfc2-f7d1-4422-9a87-6d05e66fc0e2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:13.070353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5aacbfc2-f7d1-4422-9a87-6d05e66fc0e2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:13.070933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5aacbfc2-f7d1-4422-9a87-6d05e66fc0e2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:13.078482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5aacbfc2-f7d1-4422-9a87-6d05e66fc0e2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:13.083353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5aacbfc2-f7d1-4422-9a87-6d05e66fc0e2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:13.087085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5aacbfc2-f7d1-4422-9a87-6d05e66fc0e2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:13.555204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ed3ce063-de4a-4777-bc86-db87a3ecd118 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:13.556396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ed3ce063-de4a-4777-bc86-db87a3ecd118 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] [instance: e5cf9540-fba0-498d-890d-af316b16ceff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:13.569881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed3ce063-de4a-4777-bc86-db87a3ecd118 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:13.570692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed3ce063-de4a-4777-bc86-db87a3ecd118 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:13.571297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed3ce063-de4a-4777-bc86-db87a3ecd118 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:13.572183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed3ce063-de4a-4777-bc86-db87a3ecd118 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:13.572799 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed3ce063-de4a-4777-bc86-db87a3ecd118 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:13.573553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed3ce063-de4a-4777-bc86-db87a3ecd118 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:13.590760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5aacbfc2-f7d1-4422-9a87-6d05e66fc0e2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:13.605097 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5aacbfc2-f7d1-4422-9a87-6d05e66fc0e2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1199 microversion: 2.1 time: 0.568289 Aug 24 10:21:13.605753 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1242/2230] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:13 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1199 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:13.711223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9d300289-7cf7-44d6-a404-0dd9e7e5c605 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:13.712075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9d300289-7cf7-44d6-a404-0dd9e7e5c605 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: b47ddbf3-ca84-419b-ae08-916fb959be5c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:13.723720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d300289-7cf7-44d6-a404-0dd9e7e5c605 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:13.724450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d300289-7cf7-44d6-a404-0dd9e7e5c605 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:13.725351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d300289-7cf7-44d6-a404-0dd9e7e5c605 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:13.726534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d300289-7cf7-44d6-a404-0dd9e7e5c605 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:13.741442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d300289-7cf7-44d6-a404-0dd9e7e5c605 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:13.742110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d300289-7cf7-44d6-a404-0dd9e7e5c605 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:14.149969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ed3ce063-de4a-4777-bc86-db87a3ecd118 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e52ac750849e4207bbc6e320210bb2b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823f96998a0341559f6a637f9a5b840c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:14.158700 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ed3ce063-de4a-4777-bc86-db87a3ecd118 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff" status: 200 len: 1711 microversion: 2.1 time: 0.607864 Aug 24 10:21:14.161163 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 989/2231] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:13 2022] GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff => generated 1711 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:21:14.166246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-41baf155-1dba-4718-ae77-8a2889958f8c tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f465564df70>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:14.259959 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-41baf155-1dba-4718-ae77-8a2889958f8c tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1454 microversion: 2.1 time: 0.097447 Aug 24 10:21:14.260579 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 990/2232] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:21:14 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:14.659343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5195eb98-8613-4661-94c5-761160bc8bf8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:14.660457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5195eb98-8613-4661-94c5-761160bc8bf8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:14.726823 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5195eb98-8613-4661-94c5-761160bc8bf8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:14.727709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5195eb98-8613-4661-94c5-761160bc8bf8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:14.728275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5195eb98-8613-4661-94c5-761160bc8bf8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:14.730651 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5195eb98-8613-4661-94c5-761160bc8bf8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:14.731356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5195eb98-8613-4661-94c5-761160bc8bf8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:14.731816 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5195eb98-8613-4661-94c5-761160bc8bf8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:14.772933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9d300289-7cf7-44d6-a404-0dd9e7e5c605 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:14.785332 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9d300289-7cf7-44d6-a404-0dd9e7e5c605 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c" status: 200 len: 1511 microversion: 2.1 time: 1.078636 Aug 24 10:21:14.793295 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1243/2233] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:13 2022] GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c => generated 1511 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:21:14.830689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-88a18ebb-f0c9-4c53-9d0b-1d78adfd2771 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:14.831929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-88a18ebb-f0c9-4c53-9d0b-1d78adfd2771 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: 2bc88682-b0f5-42fc-88e5-a74d75b8e241] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:14.842073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88a18ebb-f0c9-4c53-9d0b-1d78adfd2771 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:14.843177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88a18ebb-f0c9-4c53-9d0b-1d78adfd2771 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:14.844938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88a18ebb-f0c9-4c53-9d0b-1d78adfd2771 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:14.846273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88a18ebb-f0c9-4c53-9d0b-1d78adfd2771 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:14.848483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88a18ebb-f0c9-4c53-9d0b-1d78adfd2771 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:14.849407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88a18ebb-f0c9-4c53-9d0b-1d78adfd2771 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:15.492802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5195eb98-8613-4661-94c5-761160bc8bf8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:15.508244 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5195eb98-8613-4661-94c5-761160bc8bf8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1199 microversion: 2.1 time: 0.853015 Aug 24 10:21:15.511041 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 991/2234] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:14 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1199 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:15.528835 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-16af5d8e-d2fe-4368-bf16-d5d67267a573 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:15.531283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-16af5d8e-d2fe-4368-bf16-d5d67267a573 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] [instance: e5cf9540-fba0-498d-890d-af316b16ceff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:15.561779 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16af5d8e-d2fe-4368-bf16-d5d67267a573 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:15.562293 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16af5d8e-d2fe-4368-bf16-d5d67267a573 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:15.562806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16af5d8e-d2fe-4368-bf16-d5d67267a573 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:15.577199 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16af5d8e-d2fe-4368-bf16-d5d67267a573 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:15.583087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16af5d8e-d2fe-4368-bf16-d5d67267a573 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:15.584941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16af5d8e-d2fe-4368-bf16-d5d67267a573 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:15.706080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-88a18ebb-f0c9-4c53-9d0b-1d78adfd2771 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:15.722906 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-88a18ebb-f0c9-4c53-9d0b-1d78adfd2771 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241" status: 200 len: 1510 microversion: 2.1 time: 0.900812 Aug 24 10:21:15.723804 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1244/2235] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:14 2022] GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241 => generated 1510 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:15.745988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c1bd0fc2-751f-4cd4-9151-c47cab875d4b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4654f0b0d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:15.860780 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c1bd0fc2-751f-4cd4-9151-c47cab875d4b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1454 microversion: 2.1 time: 0.134436 Aug 24 10:21:15.868390 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1245/2236] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:21:15 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1454 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:15.884380 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c13a94e9-e672-42b2-ab84-57c316d5449e tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:15.885261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c13a94e9-e672-42b2-ab84-57c316d5449e tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: ea87f606-60c3-4789-871d-8a8ffc4e0612] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:15.894094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c13a94e9-e672-42b2-ab84-57c316d5449e tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:15.898504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c13a94e9-e672-42b2-ab84-57c316d5449e tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:15.899535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c13a94e9-e672-42b2-ab84-57c316d5449e tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:15.900515 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c13a94e9-e672-42b2-ab84-57c316d5449e tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:15.901215 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c13a94e9-e672-42b2-ab84-57c316d5449e tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:15.901843 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c13a94e9-e672-42b2-ab84-57c316d5449e tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:16.279039 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-16af5d8e-d2fe-4368-bf16-d5d67267a573 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e52ac750849e4207bbc6e320210bb2b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823f96998a0341559f6a637f9a5b840c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:16.293915 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-16af5d8e-d2fe-4368-bf16-d5d67267a573 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff" status: 200 len: 1711 microversion: 2.1 time: 0.773685 Aug 24 10:21:16.294585 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 992/2237] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:15 2022] GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff => generated 1711 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:16.532675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7b5ceac3-6e11-442b-81aa-13c4b761c999 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:16.533351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7b5ceac3-6e11-442b-81aa-13c4b761c999 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:16.535614 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:16.548817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b5ceac3-6e11-442b-81aa-13c4b761c999 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:16.549343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b5ceac3-6e11-442b-81aa-13c4b761c999 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:16.549809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b5ceac3-6e11-442b-81aa-13c4b761c999 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:16.562360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b5ceac3-6e11-442b-81aa-13c4b761c999 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:16.562894 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b5ceac3-6e11-442b-81aa-13c4b761c999 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:16.563342 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b5ceac3-6e11-442b-81aa-13c4b761c999 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:16.857747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7b5ceac3-6e11-442b-81aa-13c4b761c999 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:16.868875 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7b5ceac3-6e11-442b-81aa-13c4b761c999 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1199 microversion: 2.1 time: 0.341549 Aug 24 10:21:16.888942 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 993/2238] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:16 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1199 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:21:16.999749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c13a94e9-e672-42b2-ab84-57c316d5449e tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:17.026679 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c13a94e9-e672-42b2-ab84-57c316d5449e tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea87f606-60c3-4789-871d-8a8ffc4e0612" status: 200 len: 1511 microversion: 2.1 time: 1.156589 Aug 24 10:21:17.039289 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1246/2239] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:15 2022] GET /compute/v2.1/servers/ea87f606-60c3-4789-871d-8a8ffc4e0612 => generated 1511 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:17.065436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ace104cc-d607-4e5f-be7e-9781459ae3c1 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f46550dc0d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:17.182668 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ace104cc-d607-4e5f-be7e-9781459ae3c1 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1454 microversion: 2.1 time: 0.134935 Aug 24 10:21:17.189094 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1247/2240] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:21:17 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:17.203899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-846fdd44-1a94-41fd-9ef8-d2a3cbcf27e6 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:17.222775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-846fdd44-1a94-41fd-9ef8-d2a3cbcf27e6 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:17.224776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-846fdd44-1a94-41fd-9ef8-d2a3cbcf27e6 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:21:17.254599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-846fdd44-1a94-41fd-9ef8-d2a3cbcf27e6 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:17.256975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-846fdd44-1a94-41fd-9ef8-d2a3cbcf27e6 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:17.258050 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-846fdd44-1a94-41fd-9ef8-d2a3cbcf27e6 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:17.261379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-846fdd44-1a94-41fd-9ef8-d2a3cbcf27e6 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:17.262516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-846fdd44-1a94-41fd-9ef8-d2a3cbcf27e6 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:17.263900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-846fdd44-1a94-41fd-9ef8-d2a3cbcf27e6 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:17.387173 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-846fdd44-1a94-41fd-9ef8-d2a3cbcf27e6 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:21:17.631665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-846fdd44-1a94-41fd-9ef8-d2a3cbcf27e6 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:17.655944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-846fdd44-1a94-41fd-9ef8-d2a3cbcf27e6 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:17.656821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-846fdd44-1a94-41fd-9ef8-d2a3cbcf27e6 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:17.657581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-846fdd44-1a94-41fd-9ef8-d2a3cbcf27e6 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:17.858760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3c1ea672-a2dd-4ded-9678-64488eb49c59 tempest-SecurityGroupsTestAdminJSON-1280739978 tempest-SecurityGroupsTestAdminJSON-1280739978-project] Action: 'create', calling method: .version_select at 0x7f465540c670>, body: {"security_group": {"name": "tempest-securitygroup-914669719", "description": "tempest-description-514807837"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:17.973790 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-846fdd44-1a94-41fd-9ef8-d2a3cbcf27e6 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.782799 Aug 24 10:21:17.976209 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1248/2241] 10.222.0.85 () {58 vars in 1167 bytes} [Wed Aug 24 10:21:17 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:18.014209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-10fb4847-d350-47d6-9755-5d9a39c1c9b0 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:18.016562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-10fb4847-d350-47d6-9755-5d9a39c1c9b0 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] [instance: e5cf9540-fba0-498d-890d-af316b16ceff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:18.056802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10fb4847-d350-47d6-9755-5d9a39c1c9b0 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:18.057662 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10fb4847-d350-47d6-9755-5d9a39c1c9b0 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:18.058423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10fb4847-d350-47d6-9755-5d9a39c1c9b0 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:18.075989 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10fb4847-d350-47d6-9755-5d9a39c1c9b0 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:18.076958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10fb4847-d350-47d6-9755-5d9a39c1c9b0 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:18.077769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10fb4847-d350-47d6-9755-5d9a39c1c9b0 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:18.351848 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-10fb4847-d350-47d6-9755-5d9a39c1c9b0 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e52ac750849e4207bbc6e320210bb2b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823f96998a0341559f6a637f9a5b840c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:18.363791 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-10fb4847-d350-47d6-9755-5d9a39c1c9b0 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff" status: 200 len: 1644 microversion: 2.1 time: 0.385603 Aug 24 10:21:18.367568 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1249/2242] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:17 2022] GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff => generated 1644 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:18.473099 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3c1ea672-a2dd-4ded-9678-64488eb49c59 tempest-SecurityGroupsTestAdminJSON-1280739978 tempest-SecurityGroupsTestAdminJSON-1280739978-project] 10.222.0.85 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.582436 Aug 24 10:21:18.473742 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 994/2243] 10.222.0.85 () {60 vars in 1180 bytes} [Wed Aug 24 10:21:16 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:18.478526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e7f0d850-3ef3-42ee-83ce-98432c71fe7f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:18.479149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e7f0d850-3ef3-42ee-83ce-98432c71fe7f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:18.511485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7f0d850-3ef3-42ee-83ce-98432c71fe7f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:18.517960 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7f0d850-3ef3-42ee-83ce-98432c71fe7f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:18.518999 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7f0d850-3ef3-42ee-83ce-98432c71fe7f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:18.523592 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7f0d850-3ef3-42ee-83ce-98432c71fe7f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:18.525256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7f0d850-3ef3-42ee-83ce-98432c71fe7f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:18.526080 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7f0d850-3ef3-42ee-83ce-98432c71fe7f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:18.853498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-633e3247-5e50-43a7-b2dd-837ef0cbc51e tempest-MultipleCreateNegativeTestJSON-1874328380 tempest-MultipleCreateNegativeTestJSON-1874328380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-778616782", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:18.857178 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-633e3247-5e50-43a7-b2dd-837ef0cbc51e tempest-MultipleCreateNegativeTestJSON-1874328380 tempest-MultipleCreateNegativeTestJSON-1874328380-project] HTTP exception thrown: min_count must be <= max_count Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-633e3247-5e50-43a7-b2dd-837ef0cbc51e tempest-MultipleCreateNegativeTestJSON-1874328380 tempest-MultipleCreateNegativeTestJSON-1874328380-project] Request method failure captured: Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 183 Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfudhPNci2VpTF0a-Sk7Beym6MeqeyCkwPWGASRaAU6WYpvea4yh-uaw3VIcvb9EHelA76cPeJkfaFZLrxanq61J5N-vGqO0MkpqrFg9m-4xLJHI6Ciqo6qlSn41uyGFrz7x8_zME96SSEC1Kg5lOOOK6fIlnEQXSHrHvbL9USO63tQ Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 09efe38587bd4b24b5ff9faecb3e3653 Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1874328380 Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/09efe38587bd4b24b5ff9faecb3e3653"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_09efe38587bd4b24b5ff9faecb3e3653", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/09efe38587bd4b24b5ff9faecb3e3653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/09efe38587bd4b24b5ff9faecb3e3653"}]}] Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1874328380 Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 09efe38587bd4b24b5ff9faecb3e3653 Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1874328380 Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-MultipleCreateNegativeTestJSON-1874328380-project Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 6cf81f0c454a42ae9145a1ddadeaec0d Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1874328380-project Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-778616782", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: exception: min_count must be <= max_count Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-778616782', 'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 24 10:21:18.860549 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:21:18.869928 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-633e3247-5e50-43a7-b2dd-837ef0cbc51e tempest-MultipleCreateNegativeTestJSON-1874328380 tempest-MultipleCreateNegativeTestJSON-1874328380-project] Returning 400 to user: min_count must be <= max_count {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:21:18.872103 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e7f0d850-3ef3-42ee-83ce-98432c71fe7f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:18.874019 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-633e3247-5e50-43a7-b2dd-837ef0cbc51e tempest-MultipleCreateNegativeTestJSON-1874328380 tempest-MultipleCreateNegativeTestJSON-1874328380-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.504547 Aug 24 10:21:18.881493 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1250/2244] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:21:18 2022] POST /compute/v2.1/servers => generated 74 bytes in 512 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 10:21:18.888236 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e7f0d850-3ef3-42ee-83ce-98432c71fe7f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1199 microversion: 2.1 time: 0.412948 Aug 24 10:21:18.890945 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 995/2245] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:18 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1199 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:18.896370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e8b46456-2e9a-461b-9492-8c90588d135e tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4655692040>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:18.906925 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-88ba9136-7dca-429e-8a0c-4f37bea4f07c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:18.992865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-88ba9136-7dca-429e-8a0c-4f37bea4f07c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:18.998410 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-88ba9136-7dca-429e-8a0c-4f37bea4f07c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-379132465', 'deleted': False, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:21:19.030248 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e8b46456-2e9a-461b-9492-8c90588d135e tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1454 microversion: 2.1 time: 0.138009 Aug 24 10:21:19.030857 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 996/2246] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:21:18 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1454 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:19.038088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88ba9136-7dca-429e-8a0c-4f37bea4f07c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:19.039830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:19.045536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88ba9136-7dca-429e-8a0c-4f37bea4f07c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:19.046365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88ba9136-7dca-429e-8a0c-4f37bea4f07c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:19.047328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88ba9136-7dca-429e-8a0c-4f37bea4f07c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:19.048019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88ba9136-7dca-429e-8a0c-4f37bea4f07c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:19.048599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88ba9136-7dca-429e-8a0c-4f37bea4f07c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:19.062069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-235d82a1-63b0-42b3-805d-66689d1083c1 req-74d43185-64f4-4319-bd0a-8a779e176cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5cf9540-fba0-498d-890d-af316b16ceff", "name": "network-vif-deleted", "tag": "063e9896-ef6d-473a-b00e-f9778234fa16"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:19.082133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-235d82a1-63b0-42b3-805d-66689d1083c1 req-74d43185-64f4-4319-bd0a-8a779e176cbf service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:19.083118 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-235d82a1-63b0-42b3-805d-66689d1083c1 req-74d43185-64f4-4319-bd0a-8a779e176cbf service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:19.083807 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-235d82a1-63b0-42b3-805d-66689d1083c1 req-74d43185-64f4-4319-bd0a-8a779e176cbf service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:19.100218 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-235d82a1-63b0-42b3-805d-66689d1083c1 req-74d43185-64f4-4319-bd0a-8a779e176cbf service nova] Creating event network-vif-deleted:063e9896-ef6d-473a-b00e-f9778234fa16 for instance e5cf9540-fba0-498d-890d-af316b16ceff on n-h1-849328-3 Aug 24 10:21:19.111363 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-235d82a1-63b0-42b3-805d-66689d1083c1 req-74d43185-64f4-4319-bd0a-8a779e176cbf service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073363 Aug 24 10:21:19.118629 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 997/2247] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:19.127228 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cb9ecde5-b5c1-47d0-9a8f-1fd5fcba2079 tempest-SecurityGroupsTestAdminJSON-1280739978 tempest-SecurityGroupsTestAdminJSON-1280739978-project] Action: 'create', calling method: .version_select at 0x7f465556c940>, body: {"security_group": {"name": "tempest-securitygroup-375210922", "description": "tempest-description-357287021"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:19.229255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-88ba9136-7dca-429e-8a0c-4f37bea4f07c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:21:19.261712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:19.481786 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cb9ecde5-b5c1-47d0-9a8f-1fd5fcba2079 tempest-SecurityGroupsTestAdminJSON-1280739978 tempest-SecurityGroupsTestAdminJSON-1280739978-project] 10.222.0.85 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.361316 Aug 24 10:21:19.482634 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 998/2248] 10.222.0.85 () {60 vars in 1180 bytes} [Wed Aug 24 10:21:19 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:19.499827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0fd65fad-0863-428c-a1fd-98d13033a8a2 tempest-MultipleCreateNegativeTestJSON-1874328380 tempest-MultipleCreateNegativeTestJSON-1874328380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-281180250", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "max_count": 0}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:19.502246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-88ba9136-7dca-429e-8a0c-4f37bea4f07c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:19.514830 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88ba9136-7dca-429e-8a0c-4f37bea4f07c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:19.515323 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88ba9136-7dca-429e-8a0c-4f37bea4f07c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:19.515769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88ba9136-7dca-429e-8a0c-4f37bea4f07c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0fd65fad-0863-428c-a1fd-98d13033a8a2 tempest-MultipleCreateNegativeTestJSON-1874328380 tempest-MultipleCreateNegativeTestJSON-1874328380-project] Request method failure captured: Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 167 Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfudhPNci2VpTF0a-Sk7Beym6MeqeyCkwPWGASRaAU6WYpvea4yh-uaw3VIcvb9EHelA76cPeJkfaFZLrxanq61J5N-vGqO0MkpqrFg9m-4xLJHI6Ciqo6qlSn41uyGFrz7x8_zME96SSEC1Kg5lOOOK6fIlnEQXSHrHvbL9USO63tQ Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 09efe38587bd4b24b5ff9faecb3e3653 Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1874328380 Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/09efe38587bd4b24b5ff9faecb3e3653"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_09efe38587bd4b24b5ff9faecb3e3653", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/09efe38587bd4b24b5ff9faecb3e3653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/09efe38587bd4b24b5ff9faecb3e3653"}]}] Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1874328380 Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 09efe38587bd4b24b5ff9faecb3e3653 Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1874328380 Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-MultipleCreateNegativeTestJSON-1874328380-project Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 6cf81f0c454a42ae9145a1ddadeaec0d Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1874328380-project Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-281180250", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "max_count": 0}} Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-281180250', 'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af', 'flavorRef': '452', 'max_count': 0}}} Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 0 Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:21:19.522359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:21:19.526489 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:21:19.526489 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:21:19.526489 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:21:19.526489 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:21:19.526489 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 24 10:21:19.526489 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:21:19.526489 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:21:19.526489 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:21:19.526489 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:19.526489 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:21:19.526489 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:21:19.526489 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:21:19.526489 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:21:19.526489 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 24 10:21:19.526489 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:21:19.543846 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0fd65fad-0863-428c-a1fd-98d13033a8a2 tempest-MultipleCreateNegativeTestJSON-1874328380 tempest-MultipleCreateNegativeTestJSON-1874328380-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:21:19.552847 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0fd65fad-0863-428c-a1fd-98d13033a8a2 tempest-MultipleCreateNegativeTestJSON-1874328380 tempest-MultipleCreateNegativeTestJSON-1874328380-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.068534 Aug 24 10:21:19.556596 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 999/2249] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:21:19 2022] POST /compute/v2.1/servers => generated 130 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:21:19.577746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0ad2bbbf-7075-4a0e-b4f0-056589d73098 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:19.578975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0ad2bbbf-7075-4a0e-b4f0-056589d73098 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] [instance: e5cf9540-fba0-498d-890d-af316b16ceff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:19.596757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ad2bbbf-7075-4a0e-b4f0-056589d73098 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:19.607694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ad2bbbf-7075-4a0e-b4f0-056589d73098 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:19.610147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ad2bbbf-7075-4a0e-b4f0-056589d73098 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:19.612299 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ad2bbbf-7075-4a0e-b4f0-056589d73098 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:19.613425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ad2bbbf-7075-4a0e-b4f0-056589d73098 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:19.614642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ad2bbbf-7075-4a0e-b4f0-056589d73098 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:19.670209 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-0ad2bbbf-7075-4a0e-b4f0-056589d73098 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] HTTP exception thrown: Instance e5cf9540-fba0-498d-890d-af316b16ceff could not be found. Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0ad2bbbf-7075-4a0e-b4f0-056589d73098 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Request method failure captured: Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff HTTP/1.1 Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBftL_QnfE6GymYuq4FTmCartIJVgQL-lKnpPQkJOD_J-R70VAP4raTRo3W8BEkZssOzo7tENKv5kBFph86GDW7mEpHGumywYAe_5uEGWTMID09iJAxVWJ4l97c0rjEfTzZOq7702423tUkBagemcHl2Ry3Iy5KhFJB2HvI8N1OAYUM4 Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 823f96998a0341559f6a637f9a5b840c Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestManualDisk-996464199 Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/823f96998a0341559f6a637f9a5b840c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_823f96998a0341559f6a637f9a5b840c", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/823f96998a0341559f6a637f9a5b840c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/823f96998a0341559f6a637f9a5b840c"}]}] Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestManualDisk-996464199 Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 823f96998a0341559f6a637f9a5b840c Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestManualDisk-996464199 Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersTestManualDisk-996464199-project Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: e52ac750849e4207bbc6e320210bb2b7 Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestManualDisk-996464199-project Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance e5cf9540-fba0-498d-890d-af316b16ceff could not be found. Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'e5cf9540-fba0-498d-890d-af316b16ceff'} Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5cf9540-fba0-498d-890d-af316b16ceff could not be found. Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5cf9540-fba0-498d-890d-af316b16ceff could not be found. Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:21:19.672548 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:21:19.675990 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:19.675990 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:21:19.675990 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:21:19.675990 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:21:19.675990 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:21:19.675990 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5cf9540-fba0-498d-890d-af316b16ceff could not be found. Aug 24 10:21:19.675990 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:21:19.678446 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0ad2bbbf-7075-4a0e-b4f0-056589d73098 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Returning 404 to user: Instance e5cf9540-fba0-498d-890d-af316b16ceff could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:21:19.679813 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0ad2bbbf-7075-4a0e-b4f0-056589d73098 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff" status: 404 len: 111 microversion: 2.1 time: 0.121876 Aug 24 10:21:19.687055 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1000/2250] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:19 2022] GET /compute/v2.1/servers/e5cf9540-fba0-498d-890d-af316b16ceff => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:21:19.879956 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-88ba9136-7dca-429e-8a0c-4f37bea4f07c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-379132465" status: 200 len: 1513 microversion: 2.1 time: 0.997380 Aug 24 10:21:19.895346 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1251/2251] 10.222.0.85 () {58 vars in 1261 bytes} [Wed Aug 24 10:21:18 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-379132465 => generated 1513 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:19.902526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-31cf54ba-d779-4ea8-a39a-f6478d0041e9 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] Calling method '.version_select at 0x7f4654f0b670>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:19.953940 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-31cf54ba-d779-4ea8-a39a-f6478d0041e9 tempest-ServersTestManualDisk-996464199 tempest-ServersTestManualDisk-996464199-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-359662861" status: 202 len: 0 microversion: 2.1 time: 0.057194 Aug 24 10:21:19.956361 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1252/2252] 10.222.0.85 () {58 vars in 1218 bytes} [Wed Aug 24 10:21:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-359662861 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:21:19.968055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a5f0aec2-85b4-4b34-884b-abc968df301e tempest-MultipleCreateNegativeTestJSON-1874328380 tempest-MultipleCreateNegativeTestJSON-1874328380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1974773119", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "max_count": 2.5}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a5f0aec2-85b4-4b34-884b-abc968df301e tempest-MultipleCreateNegativeTestJSON-1874328380 tempest-MultipleCreateNegativeTestJSON-1874328380-project] Request method failure captured: Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 170 Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfudhPNci2VpTF0a-Sk7Beym6MeqeyCkwPWGASRaAU6WYpvea4yh-uaw3VIcvb9EHelA76cPeJkfaFZLrxanq61J5N-vGqO0MkpqrFg9m-4xLJHI6Ciqo6qlSn41uyGFrz7x8_zME96SSEC1Kg5lOOOK6fIlnEQXSHrHvbL9USO63tQ Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 09efe38587bd4b24b5ff9faecb3e3653 Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1874328380 Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/09efe38587bd4b24b5ff9faecb3e3653"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_09efe38587bd4b24b5ff9faecb3e3653", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/09efe38587bd4b24b5ff9faecb3e3653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/09efe38587bd4b24b5ff9faecb3e3653"}]}] Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1874328380 Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 09efe38587bd4b24b5ff9faecb3e3653 Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1874328380 Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-MultipleCreateNegativeTestJSON-1874328380-project Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 6cf81f0c454a42ae9145a1ddadeaec0d Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1874328380-project Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1974773119", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "max_count": 2.5}} Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1974773119', 'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af', 'flavorRef': '452', 'max_count': 2.5}}} Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 2.5 Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:21:19.986252 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:21:19.990076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:21:19.990076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:21:19.990076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:21:19.990076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:21:19.990076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 24 10:21:19.990076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:21:19.990076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:21:19.990076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:21:19.990076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:19.990076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:21:19.990076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:21:19.990076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:21:19.990076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:21:19.990076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 24 10:21:19.990076 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:21:19.991977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a5f0aec2-85b4-4b34-884b-abc968df301e tempest-MultipleCreateNegativeTestJSON-1874328380 tempest-MultipleCreateNegativeTestJSON-1874328380-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:21:19.991977 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a5f0aec2-85b4-4b34-884b-abc968df301e tempest-MultipleCreateNegativeTestJSON-1874328380 tempest-MultipleCreateNegativeTestJSON-1874328380-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.034374 Aug 24 10:21:19.994431 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1253/2253] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:21:19 2022] POST /compute/v2.1/servers => generated 139 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:21:19.999803 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a326668e-d812-4bbb-a637-03f468e5934b tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:20.022751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a326668e-d812-4bbb-a637-03f468e5934b tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:20.024675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a326668e-d812-4bbb-a637-03f468e5934b tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:21:20.035604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a326668e-d812-4bbb-a637-03f468e5934b tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:20.042106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a326668e-d812-4bbb-a637-03f468e5934b tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:20.044828 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a326668e-d812-4bbb-a637-03f468e5934b tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:20.046118 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a326668e-d812-4bbb-a637-03f468e5934b tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:20.047234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a326668e-d812-4bbb-a637-03f468e5934b tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:20.050250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a326668e-d812-4bbb-a637-03f468e5934b tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:20.231715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e23b3b8c-8c41-4ba7-a277-48231ece55eb tempest-SecurityGroupsTestAdminJSON-725069492 tempest-SecurityGroupsTestAdminJSON-725069492-project-admin] Action: 'create', calling method: .version_select at 0x7f4654e60700>, body: {"security_group": {"name": "tempest-securitygroup-805121418", "description": "tempest-description-40931029"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:20.267410 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-a326668e-d812-4bbb-a637-03f468e5934b tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:21:20.350014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a326668e-d812-4bbb-a637-03f468e5934b tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:20.369661 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a326668e-d812-4bbb-a637-03f468e5934b tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:20.370275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a326668e-d812-4bbb-a637-03f468e5934b tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:20.370824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a326668e-d812-4bbb-a637-03f468e5934b tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:20.653509 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a326668e-d812-4bbb-a637-03f468e5934b tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4515 microversion: 2.1 time: 0.657510 Aug 24 10:21:20.654931 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1254/2254] 10.222.0.85 () {58 vars in 1173 bytes} [Wed Aug 24 10:21:19 2022] GET /compute/v2.1/servers/detail?status=active => generated 4515 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:20.661871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a6e1394c-7621-4dcc-942b-11a0c2b4df2a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:20.663809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a6e1394c-7621-4dcc-942b-11a0c2b4df2a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:20.683990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6e1394c-7621-4dcc-942b-11a0c2b4df2a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:20.684594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6e1394c-7621-4dcc-942b-11a0c2b4df2a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:20.685110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6e1394c-7621-4dcc-942b-11a0c2b4df2a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:20.685982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6e1394c-7621-4dcc-942b-11a0c2b4df2a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:20.686939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6e1394c-7621-4dcc-942b-11a0c2b4df2a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:20.687456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6e1394c-7621-4dcc-942b-11a0c2b4df2a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:20.956446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a6e1394c-7621-4dcc-942b-11a0c2b4df2a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:20.972395 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a6e1394c-7621-4dcc-942b-11a0c2b4df2a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1199 microversion: 2.1 time: 0.315888 Aug 24 10:21:20.973590 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1255/2255] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:20 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1199 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:20.985024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7600c927-a6ba-4cc6-b2c1-3022f54ac593 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f46552b3dc0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:21.142187 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7600c927-a6ba-4cc6-b2c1-3022f54ac593 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1454 microversion: 2.1 time: 0.166113 Aug 24 10:21:21.145364 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1256/2256] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:21:20 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1454 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:21.164323 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fec54e56-3498-4357-8ef2-428ffcca8ddf tempest-MultipleCreateNegativeTestJSON-1874328380 tempest-MultipleCreateNegativeTestJSON-1874328380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1725183361", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "min_count": 0}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fec54e56-3498-4357-8ef2-428ffcca8ddf tempest-MultipleCreateNegativeTestJSON-1874328380 tempest-MultipleCreateNegativeTestJSON-1874328380-project] Request method failure captured: Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 168 Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfudhPNci2VpTF0a-Sk7Beym6MeqeyCkwPWGASRaAU6WYpvea4yh-uaw3VIcvb9EHelA76cPeJkfaFZLrxanq61J5N-vGqO0MkpqrFg9m-4xLJHI6Ciqo6qlSn41uyGFrz7x8_zME96SSEC1Kg5lOOOK6fIlnEQXSHrHvbL9USO63tQ Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 09efe38587bd4b24b5ff9faecb3e3653 Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1874328380 Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/09efe38587bd4b24b5ff9faecb3e3653"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_09efe38587bd4b24b5ff9faecb3e3653", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/09efe38587bd4b24b5ff9faecb3e3653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/09efe38587bd4b24b5ff9faecb3e3653"}]}] Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1874328380 Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 09efe38587bd4b24b5ff9faecb3e3653 Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1874328380 Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-MultipleCreateNegativeTestJSON-1874328380-project Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 6cf81f0c454a42ae9145a1ddadeaec0d Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1874328380-project Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1725183361", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "min_count": 0}} Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1725183361', 'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af', 'flavorRef': '452', 'min_count': 0}}} Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 0 Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:21:21.182345 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:21:21.186699 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:21:21.186699 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:21:21.186699 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:21:21.186699 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:21:21.186699 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 24 10:21:21.186699 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:21:21.186699 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:21:21.186699 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:21:21.186699 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:21.186699 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:21:21.186699 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:21:21.186699 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:21:21.186699 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:21:21.186699 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 24 10:21:21.186699 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:21:21.190676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fec54e56-3498-4357-8ef2-428ffcca8ddf tempest-MultipleCreateNegativeTestJSON-1874328380 tempest-MultipleCreateNegativeTestJSON-1874328380-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:21:21.191706 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fec54e56-3498-4357-8ef2-428ffcca8ddf tempest-MultipleCreateNegativeTestJSON-1874328380 tempest-MultipleCreateNegativeTestJSON-1874328380-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.044911 Aug 24 10:21:21.192795 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1257/2257] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:21:21 2022] POST /compute/v2.1/servers => generated 130 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:21:21.218494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6c10d284-02ed-4e0b-a523-c6a9622f53ba tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:21.244311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6c10d284-02ed-4e0b-a523-c6a9622f53ba tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:21.250766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.compute.servers [None req-6c10d284-02ed-4e0b-a523-c6a9622f53ba tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Removing options 'limit' from query {{(pid=122433) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 24 10:21:21.256198 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6c10d284-02ed-4e0b-a523-c6a9622f53ba tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Searching by: {'deleted': False, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:21:21.269649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c10d284-02ed-4e0b-a523-c6a9622f53ba tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:21.270811 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c10d284-02ed-4e0b-a523-c6a9622f53ba tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:21.278260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c10d284-02ed-4e0b-a523-c6a9622f53ba tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:21.281030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c10d284-02ed-4e0b-a523-c6a9622f53ba tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:21.281997 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c10d284-02ed-4e0b-a523-c6a9622f53ba tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:21.282868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c10d284-02ed-4e0b-a523-c6a9622f53ba tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:21.426304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6c10d284-02ed-4e0b-a523-c6a9622f53ba tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:21.442633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c10d284-02ed-4e0b-a523-c6a9622f53ba tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:21.444577 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c10d284-02ed-4e0b-a523-c6a9622f53ba tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:21.446717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c10d284-02ed-4e0b-a523-c6a9622f53ba tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:21.580822 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e23b3b8c-8c41-4ba7-a277-48231ece55eb tempest-SecurityGroupsTestAdminJSON-725069492 tempest-SecurityGroupsTestAdminJSON-725069492-project-admin] 10.222.0.85 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 1.892112 Aug 24 10:21:21.585673 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1001/2258] 10.222.0.85 () {60 vars in 1180 bytes} [Wed Aug 24 10:21:19 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 1898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:21.599223 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eafb9574-d4cd-4843-9d7b-ab6497a13605 tempest-MultipleCreateNegativeTestJSON-1874328380 tempest-MultipleCreateNegativeTestJSON-1874328380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1945449743", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "min_count": 2.5}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eafb9574-d4cd-4843-9d7b-ab6497a13605 tempest-MultipleCreateNegativeTestJSON-1874328380 tempest-MultipleCreateNegativeTestJSON-1874328380-project] Request method failure captured: Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 170 Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfudhPNci2VpTF0a-Sk7Beym6MeqeyCkwPWGASRaAU6WYpvea4yh-uaw3VIcvb9EHelA76cPeJkfaFZLrxanq61J5N-vGqO0MkpqrFg9m-4xLJHI6Ciqo6qlSn41uyGFrz7x8_zME96SSEC1Kg5lOOOK6fIlnEQXSHrHvbL9USO63tQ Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 09efe38587bd4b24b5ff9faecb3e3653 Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1874328380 Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/09efe38587bd4b24b5ff9faecb3e3653"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_09efe38587bd4b24b5ff9faecb3e3653", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/09efe38587bd4b24b5ff9faecb3e3653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/09efe38587bd4b24b5ff9faecb3e3653"}]}] Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1874328380 Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 09efe38587bd4b24b5ff9faecb3e3653 Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1874328380 Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-MultipleCreateNegativeTestJSON-1874328380-project Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 6cf81f0c454a42ae9145a1ddadeaec0d Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1874328380-project Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1945449743", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "min_count": 2.5}} Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1945449743', 'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af', 'flavorRef': '452', 'min_count': 2.5}}} Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 2.5 Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:21:21.613452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:21:21.616878 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:21:21.616878 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:21:21.616878 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:21:21.616878 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:21:21.616878 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 24 10:21:21.616878 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:21:21.616878 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:21:21.616878 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:21:21.616878 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:21.616878 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:21:21.616878 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:21:21.616878 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:21:21.616878 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:21:21.616878 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 24 10:21:21.616878 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:21:21.625170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eafb9574-d4cd-4843-9d7b-ab6497a13605 tempest-MultipleCreateNegativeTestJSON-1874328380 tempest-MultipleCreateNegativeTestJSON-1874328380-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:21:21.626611 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eafb9574-d4cd-4843-9d7b-ab6497a13605 tempest-MultipleCreateNegativeTestJSON-1874328380 tempest-MultipleCreateNegativeTestJSON-1874328380-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.037711 Aug 24 10:21:21.627643 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1002/2259] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:21:21 2022] POST /compute/v2.1/servers => generated 139 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:21:21.660432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f3a6a7d9-afbd-4733-8250-c5b9efd338ba tempest-SecurityGroupsTestAdminJSON-725069492 tempest-SecurityGroupsTestAdminJSON-725069492-project-admin] Action: 'create', calling method: .version_select at 0x7f4654fbdb80>, body: {"security_group": {"name": "tempest-securitygroup-952596172", "description": "tempest-description-1881363728"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:21.957086 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6c10d284-02ed-4e0b-a523-c6a9622f53ba tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.762382 Aug 24 10:21:21.973962 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1258/2260] 10.222.0.85 () {58 vars in 1161 bytes} [Wed Aug 24 10:21:21 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:22.010103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e7e1625c-ac81-4469-8cb8-0186503316f8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:22.034580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e7e1625c-ac81-4469-8cb8-0186503316f8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:22.037966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e7e1625c-ac81-4469-8cb8-0186503316f8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:21:22.080656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7e1625c-ac81-4469-8cb8-0186503316f8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:22.084560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7e1625c-ac81-4469-8cb8-0186503316f8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:22.087629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7e1625c-ac81-4469-8cb8-0186503316f8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:22.090336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7e1625c-ac81-4469-8cb8-0186503316f8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:22.094216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7e1625c-ac81-4469-8cb8-0186503316f8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:22.095389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7e1625c-ac81-4469-8cb8-0186503316f8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:22.202944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-e7e1625c-ac81-4469-8cb8-0186503316f8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:21:22.281213 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e7e1625c-ac81-4469-8cb8-0186503316f8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.281749 Aug 24 10:21:22.288120 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1259/2261] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:21:21 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:21:22.299170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5418396f-9467-4789-8e7c-0bfd5ac034df tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:22.300975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5418396f-9467-4789-8e7c-0bfd5ac034df tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:22.319237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5418396f-9467-4789-8e7c-0bfd5ac034df tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:22.319990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5418396f-9467-4789-8e7c-0bfd5ac034df tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:22.320955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5418396f-9467-4789-8e7c-0bfd5ac034df tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:22.321884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5418396f-9467-4789-8e7c-0bfd5ac034df tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:22.325825 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5418396f-9467-4789-8e7c-0bfd5ac034df tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:22.326514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5418396f-9467-4789-8e7c-0bfd5ac034df tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:22.761403 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f3a6a7d9-afbd-4733-8250-c5b9efd338ba tempest-SecurityGroupsTestAdminJSON-725069492 tempest-SecurityGroupsTestAdminJSON-725069492-project-admin] 10.222.0.85 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.129806 Aug 24 10:21:22.765109 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1003/2262] 10.222.0.85 () {60 vars in 1180 bytes} [Wed Aug 24 10:21:21 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:22.775230 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5418396f-9467-4789-8e7c-0bfd5ac034df tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:22.778665 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-631a2f22-b310-4f69-ae1c-14ff009ec3c4 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4655630e50>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:22.804292 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5418396f-9467-4789-8e7c-0bfd5ac034df tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1199 microversion: 2.1 time: 0.514560 Aug 24 10:21:22.828868 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1260/2263] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:22 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1199 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:22.858705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d55282f3-1cac-49bc-9d7f-703e8e9bb168 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:22.885713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d55282f3-1cac-49bc-9d7f-703e8e9bb168 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:22.888896 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-631a2f22-b310-4f69-ae1c-14ff009ec3c4 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1454 microversion: 2.1 time: 0.122009 Aug 24 10:21:22.889421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.compute.servers [None req-d55282f3-1cac-49bc-9d7f-703e8e9bb168 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Removing options 'limit' from query {{(pid=122433) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 24 10:21:22.889614 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1004/2264] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:21:22 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:22.891677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d55282f3-1cac-49bc-9d7f-703e8e9bb168 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Searching by: {'deleted': False, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:21:22.894442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5290a227-c340-4b50-9e15-d98260a66b0a tempest-SecurityGroupsTestAdminJSON-725069492 tempest-SecurityGroupsTestAdminJSON-725069492-project-admin] Calling method '.version_select at 0x7f465a259670>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:22.921007 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d55282f3-1cac-49bc-9d7f-703e8e9bb168 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:22.924428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d55282f3-1cac-49bc-9d7f-703e8e9bb168 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:22.926645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d55282f3-1cac-49bc-9d7f-703e8e9bb168 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:22.928186 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d55282f3-1cac-49bc-9d7f-703e8e9bb168 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:22.929944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d55282f3-1cac-49bc-9d7f-703e8e9bb168 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:22.932889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d55282f3-1cac-49bc-9d7f-703e8e9bb168 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:23.044458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-d55282f3-1cac-49bc-9d7f-703e8e9bb168 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:21:23.181504 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d55282f3-1cac-49bc-9d7f-703e8e9bb168 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.347476 Aug 24 10:21:23.202136 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1261/2265] 10.222.0.85 () {58 vars in 1150 bytes} [Wed Aug 24 10:21:22 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:23.214281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-46a0bd98-6315-4222-93d2-74fba6dc70cd tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:23.237441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-46a0bd98-6315-4222-93d2-74fba6dc70cd tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:23.242096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-46a0bd98-6315-4222-93d2-74fba6dc70cd tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Searching by: {'deleted': False, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:21:23.260040 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46a0bd98-6315-4222-93d2-74fba6dc70cd tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:23.262986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46a0bd98-6315-4222-93d2-74fba6dc70cd tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:23.266275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46a0bd98-6315-4222-93d2-74fba6dc70cd tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:23.268795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46a0bd98-6315-4222-93d2-74fba6dc70cd tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:23.272963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46a0bd98-6315-4222-93d2-74fba6dc70cd tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:23.273853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46a0bd98-6315-4222-93d2-74fba6dc70cd tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:23.377905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-46a0bd98-6315-4222-93d2-74fba6dc70cd tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:21:23.462772 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-46a0bd98-6315-4222-93d2-74fba6dc70cd tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.258960 Aug 24 10:21:23.466804 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1262/2266] 10.222.0.85 () {58 vars in 1125 bytes} [Wed Aug 24 10:21:23 2022] GET /compute/v2.1/servers => generated 1010 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:23.482480 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-22b417ac-cc13-4d75-ba69-9c2e09bb2f24 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:23.493985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-22b417ac-cc13-4d75-ba69-9c2e09bb2f24 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:23.504978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-22b417ac-cc13-4d75-ba69-9c2e09bb2f24 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:21:23.556170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22b417ac-cc13-4d75-ba69-9c2e09bb2f24 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:23.557070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22b417ac-cc13-4d75-ba69-9c2e09bb2f24 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:23.563908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22b417ac-cc13-4d75-ba69-9c2e09bb2f24 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:23.568816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22b417ac-cc13-4d75-ba69-9c2e09bb2f24 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:23.572024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22b417ac-cc13-4d75-ba69-9c2e09bb2f24 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:23.573402 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22b417ac-cc13-4d75-ba69-9c2e09bb2f24 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:23.913296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-22b417ac-cc13-4d75-ba69-9c2e09bb2f24 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:21:24.057160 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-22b417ac-cc13-4d75-ba69-9c2e09bb2f24 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.578915 Aug 24 10:21:24.074438 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1263/2267] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:21:23 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:24.080521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-264adf88-2b75-473e-9e15-7c5ea562e1c9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:24.081574 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-264adf88-2b75-473e-9e15-7c5ea562e1c9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:24.088693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-264adf88-2b75-473e-9e15-7c5ea562e1c9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:24.089667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-264adf88-2b75-473e-9e15-7c5ea562e1c9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:24.090632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-264adf88-2b75-473e-9e15-7c5ea562e1c9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:24.092134 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-264adf88-2b75-473e-9e15-7c5ea562e1c9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:24.092895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-264adf88-2b75-473e-9e15-7c5ea562e1c9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:24.093584 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-264adf88-2b75-473e-9e15-7c5ea562e1c9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:24.715620 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-264adf88-2b75-473e-9e15-7c5ea562e1c9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:24.730329 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-264adf88-2b75-473e-9e15-7c5ea562e1c9 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1199 microversion: 2.1 time: 0.654398 Aug 24 10:21:24.744504 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1264/2268] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:24 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1199 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:24.744504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ef679dc0-8322-4d37-8b6d-91d28cf67ddc tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4654eec700>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:24.802472 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ef679dc0-8322-4d37-8b6d-91d28cf67ddc tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1454 microversion: 2.1 time: 0.070377 Aug 24 10:21:24.804429 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1265/2269] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:21:24 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1454 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:24.809712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d4ae3dc3-f2bd-43b9-a34e-fd341179f2d5 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:24.815533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d4ae3dc3-f2bd-43b9-a34e-fd341179f2d5 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:24.816065 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.compute.servers [None req-d4ae3dc3-f2bd-43b9-a34e-fd341179f2d5 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Removing options 'limit' from query {{(pid=122433) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 24 10:21:24.817385 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d4ae3dc3-f2bd-43b9-a34e-fd341179f2d5 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Searching by: {'deleted': False, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:21:24.822985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4ae3dc3-f2bd-43b9-a34e-fd341179f2d5 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:24.823854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4ae3dc3-f2bd-43b9-a34e-fd341179f2d5 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:24.824531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4ae3dc3-f2bd-43b9-a34e-fd341179f2d5 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:24.826000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4ae3dc3-f2bd-43b9-a34e-fd341179f2d5 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:24.826000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4ae3dc3-f2bd-43b9-a34e-fd341179f2d5 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:24.826592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4ae3dc3-f2bd-43b9-a34e-fd341179f2d5 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:24.886034 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d4ae3dc3-f2bd-43b9-a34e-fd341179f2d5 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.079628 Aug 24 10:21:24.887276 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1266/2270] 10.222.0.85 () {58 vars in 1140 bytes} [Wed Aug 24 10:21:24 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:24.902362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b98bcc20-161c-411d-8217-d0176c614847 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:24.917536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b98bcc20-161c-411d-8217-d0176c614847 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:24.918642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b98bcc20-161c-411d-8217-d0176c614847 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-379132465', 'deleted': False, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:21:24.933895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b98bcc20-161c-411d-8217-d0176c614847 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:24.934388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b98bcc20-161c-411d-8217-d0176c614847 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:24.934814 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b98bcc20-161c-411d-8217-d0176c614847 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:24.935545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b98bcc20-161c-411d-8217-d0176c614847 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:24.936028 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b98bcc20-161c-411d-8217-d0176c614847 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:24.936785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b98bcc20-161c-411d-8217-d0176c614847 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:25.147320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-b98bcc20-161c-411d-8217-d0176c614847 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:21:25.262046 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b98bcc20-161c-411d-8217-d0176c614847 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-379132465" status: 200 len: 345 microversion: 2.1 time: 0.365662 Aug 24 10:21:25.280031 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1267/2271] 10.222.0.85 () {58 vars in 1240 bytes} [Wed Aug 24 10:21:24 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-379132465 => generated 345 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:21:25.291749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-473c08f5-c0ed-47c7-b6de-6687a6ece00c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:25.303626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-473c08f5-c0ed-47c7-b6de-6687a6ece00c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:25.307791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-473c08f5-c0ed-47c7-b6de-6687a6ece00c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:25.308254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-473c08f5-c0ed-47c7-b6de-6687a6ece00c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:25.436050 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-473c08f5-c0ed-47c7-b6de-6687a6ece00c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: 2bc88682-b0f5-42fc-88e5-a74d75b8e241] Going to try to stop instance {{(pid=122433) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 10:21:25.546520 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-473c08f5-c0ed-47c7-b6de-6687a6ece00c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "POST /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241/action" status: 202 len: 0 microversion: 2.1 time: 0.264922 Aug 24 10:21:25.547394 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1268/2272] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:21:25 2022] POST /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:21:25.569166 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-825b7b04-244f-4642-ab83-9fe57cd7f1a6 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:25.571238 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-825b7b04-244f-4642-ab83-9fe57cd7f1a6 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: 2bc88682-b0f5-42fc-88e5-a74d75b8e241] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:25.593050 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-825b7b04-244f-4642-ab83-9fe57cd7f1a6 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:25.593603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-825b7b04-244f-4642-ab83-9fe57cd7f1a6 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:25.594516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-825b7b04-244f-4642-ab83-9fe57cd7f1a6 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:25.596405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-825b7b04-244f-4642-ab83-9fe57cd7f1a6 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:25.597428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-825b7b04-244f-4642-ab83-9fe57cd7f1a6 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:25.599005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-825b7b04-244f-4642-ab83-9fe57cd7f1a6 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:25.929258 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-825b7b04-244f-4642-ab83-9fe57cd7f1a6 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:25.950279 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-825b7b04-244f-4642-ab83-9fe57cd7f1a6 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241" status: 200 len: 1520 microversion: 2.1 time: 0.397940 Aug 24 10:21:25.951215 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1269/2273] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:25 2022] GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241 => generated 1520 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:25.957855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e8a15e86-2a3c-44ed-b1a7-1273b1d651a8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:25.958480 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e8a15e86-2a3c-44ed-b1a7-1273b1d651a8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:25.973442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8a15e86-2a3c-44ed-b1a7-1273b1d651a8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:25.974312 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8a15e86-2a3c-44ed-b1a7-1273b1d651a8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:25.975099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8a15e86-2a3c-44ed-b1a7-1273b1d651a8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:25.976247 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8a15e86-2a3c-44ed-b1a7-1273b1d651a8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:25.977028 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8a15e86-2a3c-44ed-b1a7-1273b1d651a8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:25.981213 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8a15e86-2a3c-44ed-b1a7-1273b1d651a8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:25.986327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:26.380170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e8a15e86-2a3c-44ed-b1a7-1273b1d651a8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:26.393184 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e8a15e86-2a3c-44ed-b1a7-1273b1d651a8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1199 microversion: 2.1 time: 0.438823 Aug 24 10:21:26.410090 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1270/2274] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:25 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1199 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:26.418038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-10f6c7c0-1e4d-4d80-b1f2-d9f05f88ee11 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4654f2bb80>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:26.510725 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-10f6c7c0-1e4d-4d80-b1f2-d9f05f88ee11 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1463 microversion: 2.1 time: 0.099343 Aug 24 10:21:26.514888 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1271/2275] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:21:26 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1463 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:26.538138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8e79c99e-a356-411a-833e-da9320ed1c2f tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f465528cd30>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:26.692786 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8e79c99e-a356-411a-833e-da9320ed1c2f tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 200 len: 1463 microversion: 2.1 time: 0.163002 Aug 24 10:21:26.701084 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1272/2276] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:21:26 2022] GET /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 1463 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:21:27.049222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2f25b1d2-6609-4297-9797-0663df30bc0b tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-2054760907", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": "none"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:27.147268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-2f25b1d2-6609-4297-9797-0663df30bc0b tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:21:27.148108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-2f25b1d2-6609-4297-9797-0663df30bc0b tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:21:27.149232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-2f25b1d2-6609-4297-9797-0663df30bc0b tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:21:27.150085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-2f25b1d2-6609-4297-9797-0663df30bc0b tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:21:27.150898 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-2f25b1d2-6609-4297-9797-0663df30bc0b tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:21:27.179087 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=38,nova_cell0:UPDATE=7 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:27.207883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f25b1d2-6609-4297-9797-0663df30bc0b tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:27.217476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f25b1d2-6609-4297-9797-0663df30bc0b tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:27.218716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f25b1d2-6609-4297-9797-0663df30bc0b tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:27.223657 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f25b1d2-6609-4297-9797-0663df30bc0b tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:27.225943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f25b1d2-6609-4297-9797-0663df30bc0b tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:27.227031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f25b1d2-6609-4297-9797-0663df30bc0b tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:27.278447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-2f25b1d2-6609-4297-9797-0663df30bc0b tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Getting quotas for project 5fdff55e053d42ad8bd851a0654f2920. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:21:27.290701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=6,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:27.293639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-2f25b1d2-6609-4297-9797-0663df30bc0b tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Getting quotas for user cc6e40773b254ef68b23406990d4ca01 and project 5fdff55e053d42ad8bd851a0654f2920. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:21:27.356457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2f25b1d2-6609-4297-9797-0663df30bc0b tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:21:27.363552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2f25b1d2-6609-4297-9797-0663df30bc0b tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] [instance: 6fb85ae1-26a3-4862-82ff-a43a61ffc2e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:21:27.450389 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2f25b1d2-6609-4297-9797-0663df30bc0b tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.736859 Aug 24 10:21:27.451741 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1273/2277] 10.222.0.85 () {62 vars in 1188 bytes} [Wed Aug 24 10:21:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 10:21:27.472839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-71d72d63-0d31-4116-a7ec-29b8d1d2759a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:27.473724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-71d72d63-0d31-4116-a7ec-29b8d1d2759a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: 8a4ddf34-af18-4e02-a306-c1c67f5c0b28] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:27.482098 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71d72d63-0d31-4116-a7ec-29b8d1d2759a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:27.482659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71d72d63-0d31-4116-a7ec-29b8d1d2759a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:27.485222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71d72d63-0d31-4116-a7ec-29b8d1d2759a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:27.486054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71d72d63-0d31-4116-a7ec-29b8d1d2759a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:27.486529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71d72d63-0d31-4116-a7ec-29b8d1d2759a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:27.493333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71d72d63-0d31-4116-a7ec-29b8d1d2759a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:28.483220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-71d72d63-0d31-4116-a7ec-29b8d1d2759a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:28.495938 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-71d72d63-0d31-4116-a7ec-29b8d1d2759a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28" status: 200 len: 1467 microversion: 2.1 time: 1.042572 Aug 24 10:21:28.496847 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1274/2278] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:27 2022] GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28 => generated 1467 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:28.501956 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bb185d53-560d-456c-b5b3-9bc2223cd4d8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:28.516159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bb185d53-560d-456c-b5b3-9bc2223cd4d8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: 2bc88682-b0f5-42fc-88e5-a74d75b8e241] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:28.536597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb185d53-560d-456c-b5b3-9bc2223cd4d8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:28.538174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb185d53-560d-456c-b5b3-9bc2223cd4d8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:28.539483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb185d53-560d-456c-b5b3-9bc2223cd4d8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:28.540878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb185d53-560d-456c-b5b3-9bc2223cd4d8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:28.541869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb185d53-560d-456c-b5b3-9bc2223cd4d8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:28.546063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb185d53-560d-456c-b5b3-9bc2223cd4d8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:29.400203 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5290a227-c340-4b50-9e15-d98260a66b0a tempest-SecurityGroupsTestAdminJSON-725069492 tempest-SecurityGroupsTestAdminJSON-725069492-project-admin] 10.222.0.85 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11671 microversion: 2.1 time: 6.509531 Aug 24 10:21:29.401778 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1005/2279] 10.222.0.85 () {58 vars in 1191 bytes} [Wed Aug 24 10:21:22 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11671 bytes in 6511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:21:29.418948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d60ea6cf-de7e-4558-a92e-737b733b5b38 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:29.419548 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d60ea6cf-de7e-4558-a92e-737b733b5b38 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:29.422124 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=13 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:29.437434 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d60ea6cf-de7e-4558-a92e-737b733b5b38 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:29.438508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d60ea6cf-de7e-4558-a92e-737b733b5b38 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:29.439294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d60ea6cf-de7e-4558-a92e-737b733b5b38 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:29.443835 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d60ea6cf-de7e-4558-a92e-737b733b5b38 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:29.444744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d60ea6cf-de7e-4558-a92e-737b733b5b38 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:29.445562 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d60ea6cf-de7e-4558-a92e-737b733b5b38 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:29.470165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:29.682516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d60ea6cf-de7e-4558-a92e-737b733b5b38 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:29.694115 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d60ea6cf-de7e-4558-a92e-737b733b5b38 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1199 microversion: 2.1 time: 0.291218 Aug 24 10:21:29.695001 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1006/2280] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:29 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1199 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:29.714352 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b1ac8eb4-16f2-4298-a284-ff8759117a95 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:29.714917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b1ac8eb4-16f2-4298-a284-ff8759117a95 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] [instance: 6fb85ae1-26a3-4862-82ff-a43a61ffc2e9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:29.723288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1ac8eb4-16f2-4298-a284-ff8759117a95 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:29.723716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1ac8eb4-16f2-4298-a284-ff8759117a95 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:29.724182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1ac8eb4-16f2-4298-a284-ff8759117a95 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:29.724880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1ac8eb4-16f2-4298-a284-ff8759117a95 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:29.725369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1ac8eb4-16f2-4298-a284-ff8759117a95 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:29.725800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1ac8eb4-16f2-4298-a284-ff8759117a95 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:29.818646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b1ac8eb4-16f2-4298-a284-ff8759117a95 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc6e40773b254ef68b23406990d4ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fdff55e053d42ad8bd851a0654f2920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:29.834476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b1ac8eb4-16f2-4298-a284-ff8759117a95 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc6e40773b254ef68b23406990d4ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fdff55e053d42ad8bd851a0654f2920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:29.838485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b1ac8eb4-16f2-4298-a284-ff8759117a95 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc6e40773b254ef68b23406990d4ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fdff55e053d42ad8bd851a0654f2920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:29.844561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bb185d53-560d-456c-b5b3-9bc2223cd4d8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:29.856698 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b1ac8eb4-16f2-4298-a284-ff8759117a95 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] 10.222.0.85 "GET /compute/v2.1/servers/6fb85ae1-26a3-4862-82ff-a43a61ffc2e9" status: 200 len: 1333 microversion: 2.47 time: 0.145432 Aug 24 10:21:29.857708 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1007/2281] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:21:29 2022] GET /compute/v2.1/servers/6fb85ae1-26a3-4862-82ff-a43a61ffc2e9 => generated 1333 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:21:29.863347 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bb185d53-560d-456c-b5b3-9bc2223cd4d8 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241" status: 200 len: 1520 microversion: 2.1 time: 1.365209 Aug 24 10:21:29.864299 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1275/2282] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:28 2022] GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241 => generated 1520 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:29.871673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-663116a2-0a3c-4df6-83ba-29f7de7a10c4 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1872269084"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:29.884530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-5d240043-754d-4ac2-a68c-ffb1208f08af req-b0745e10-33b4-49b2-a53a-41ac860f7a55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c66c18-c34f-4916-aca3-da0ca33f9ba5", "name": "network-vif-plugged", "status": "completed", "tag": "7b95f9a5-8709-4c1d-8f96-0d1c5094bcb8"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:29.889138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-663116a2-0a3c-4df6-83ba-29f7de7a10c4 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:29.906123 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5d240043-754d-4ac2-a68c-ffb1208f08af req-b0745e10-33b4-49b2-a53a-41ac860f7a55 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:29.906840 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5d240043-754d-4ac2-a68c-ffb1208f08af req-b0745e10-33b4-49b2-a53a-41ac860f7a55 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:29.908127 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-663116a2-0a3c-4df6-83ba-29f7de7a10c4 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:29.911339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-663116a2-0a3c-4df6-83ba-29f7de7a10c4 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:29.911829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5d240043-754d-4ac2-a68c-ffb1208f08af req-b0745e10-33b4-49b2-a53a-41ac860f7a55 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:29.914297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-663116a2-0a3c-4df6-83ba-29f7de7a10c4 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:29.916390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-663116a2-0a3c-4df6-83ba-29f7de7a10c4 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:29.917585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-663116a2-0a3c-4df6-83ba-29f7de7a10c4 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:29.923143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-663116a2-0a3c-4df6-83ba-29f7de7a10c4 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:29.957541 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-5d240043-754d-4ac2-a68c-ffb1208f08af req-b0745e10-33b4-49b2-a53a-41ac860f7a55 service nova] Creating event network-vif-plugged:7b95f9a5-8709-4c1d-8f96-0d1c5094bcb8 for instance 70c66c18-c34f-4916-aca3-da0ca33f9ba5 on n-h1-849328-3 Aug 24 10:21:29.974346 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-5d240043-754d-4ac2-a68c-ffb1208f08af req-b0745e10-33b4-49b2-a53a-41ac860f7a55 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115231 Aug 24 10:21:29.975370 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1008/2283] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:29.983292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-71c36946-c536-4c54-9b0b-6a3b853d8946 tempest-SecurityGroupsTestAdminJSON-1280739978 tempest-SecurityGroupsTestAdminJSON-1280739978-project] Calling method '.version_select at 0x7f46555e15e0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:30.427813 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-663116a2-0a3c-4df6-83ba-29f7de7a10c4 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "POST /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb/action" status: 202 len: 0 microversion: 2.1 time: 0.562031 Aug 24 10:21:30.436027 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1276/2284] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:21:29 2022] POST /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb/action => generated 0 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 10:21:30.443225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e604a4e3-2ffd-45cf-8e00-25019c52d139 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f465a1d6430>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:30.518535 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e604a4e3-2ffd-45cf-8e00-25019c52d139 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/d81b1bef-ab64-4f84-bf62-d539dd7cb14d" status: 200 len: 1455 microversion: 2.1 time: 0.080459 Aug 24 10:21:30.519146 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1277/2285] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:21:30 2022] GET /compute/v2.1/images/d81b1bef-ab64-4f84-bf62-d539dd7cb14d => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:30.627655 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-71c36946-c536-4c54-9b0b-6a3b853d8946 tempest-SecurityGroupsTestAdminJSON-1280739978 tempest-SecurityGroupsTestAdminJSON-1280739978-project] 10.222.0.85 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1109 microversion: 2.1 time: 0.650564 Aug 24 10:21:30.629971 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1009/2286] 10.222.0.85 () {58 vars in 1191 bytes} [Wed Aug 24 10:21:29 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1109 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:30.644860 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-df9dba63-db80-42a6-9a10-1c2dc47e90a2 tempest-SecurityGroupsTestAdminJSON-725069492 tempest-SecurityGroupsTestAdminJSON-725069492-project-admin] Calling method '.version_select at 0x7f46541d6a60>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:30.719853 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f30b7f77-cd9e-4079-9bbf-087441ba03be tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:30.720695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f30b7f77-cd9e-4079-9bbf-087441ba03be tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:30.736256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f30b7f77-cd9e-4079-9bbf-087441ba03be tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:30.738851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f30b7f77-cd9e-4079-9bbf-087441ba03be tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:30.739645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f30b7f77-cd9e-4079-9bbf-087441ba03be tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:30.742331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f30b7f77-cd9e-4079-9bbf-087441ba03be tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:30.742952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f30b7f77-cd9e-4079-9bbf-087441ba03be tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:30.745396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f30b7f77-cd9e-4079-9bbf-087441ba03be tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:31.062449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f30b7f77-cd9e-4079-9bbf-087441ba03be tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:31.079252 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f30b7f77-cd9e-4079-9bbf-087441ba03be tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1199 microversion: 2.1 time: 0.363562 Aug 24 10:21:31.094921 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1010/2287] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:30 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1199 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:31.123774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4e28eee6-6ed9-4d99-9772-9c36e44ec92f tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:31.126082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4e28eee6-6ed9-4d99-9772-9c36e44ec92f tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] [instance: 6fb85ae1-26a3-4862-82ff-a43a61ffc2e9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:31.138015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e28eee6-6ed9-4d99-9772-9c36e44ec92f tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:31.139210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e28eee6-6ed9-4d99-9772-9c36e44ec92f tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:31.140274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e28eee6-6ed9-4d99-9772-9c36e44ec92f tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:31.141847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e28eee6-6ed9-4d99-9772-9c36e44ec92f tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:31.142916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e28eee6-6ed9-4d99-9772-9c36e44ec92f tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:31.143959 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e28eee6-6ed9-4d99-9772-9c36e44ec92f tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:31.158338 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-df9dba63-db80-42a6-9a10-1c2dc47e90a2 tempest-SecurityGroupsTestAdminJSON-725069492 tempest-SecurityGroupsTestAdminJSON-725069492-project-admin] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/b412c535-d910-4e7a-9afe-645b5a169c67" status: 202 len: 0 microversion: 2.1 time: 0.518159 Aug 24 10:21:31.160518 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1278/2288] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:21:30 2022] DELETE /compute/v2.1/os-security-groups/b412c535-d910-4e7a-9afe-645b5a169c67 => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:21:31.182390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bc899058-73af-4ee6-8393-93c44696fe90 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:31.184192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bc899058-73af-4ee6-8393-93c44696fe90 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: 2bc88682-b0f5-42fc-88e5-a74d75b8e241] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:31.205421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc899058-73af-4ee6-8393-93c44696fe90 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:31.206299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc899058-73af-4ee6-8393-93c44696fe90 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:31.206789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc899058-73af-4ee6-8393-93c44696fe90 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:31.207537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc899058-73af-4ee6-8393-93c44696fe90 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:31.207991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc899058-73af-4ee6-8393-93c44696fe90 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:31.219836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc899058-73af-4ee6-8393-93c44696fe90 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:31.380491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4e28eee6-6ed9-4d99-9772-9c36e44ec92f tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc6e40773b254ef68b23406990d4ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fdff55e053d42ad8bd851a0654f2920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:31.395456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4e28eee6-6ed9-4d99-9772-9c36e44ec92f tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc6e40773b254ef68b23406990d4ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fdff55e053d42ad8bd851a0654f2920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:31.397466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4e28eee6-6ed9-4d99-9772-9c36e44ec92f tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc6e40773b254ef68b23406990d4ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fdff55e053d42ad8bd851a0654f2920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:31.399155 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4e28eee6-6ed9-4d99-9772-9c36e44ec92f tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] 10.222.0.85 "GET /compute/v2.1/servers/6fb85ae1-26a3-4862-82ff-a43a61ffc2e9" status: 200 len: 1339 microversion: 2.47 time: 0.302462 Aug 24 10:21:31.414873 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1011/2289] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:21:31 2022] GET /compute/v2.1/servers/6fb85ae1-26a3-4862-82ff-a43a61ffc2e9 => generated 1339 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:21:31.422302 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-88ee3c04-50c6-4495-8d76-a61b6b778f8e tempest-SecurityGroupsTestAdminJSON-725069492 tempest-SecurityGroupsTestAdminJSON-725069492-project-admin] Calling method '.version_select at 0x7f465564daf0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:31.563078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bc899058-73af-4ee6-8393-93c44696fe90 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:31.631502 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bc899058-73af-4ee6-8393-93c44696fe90 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241" status: 200 len: 1520 microversion: 2.1 time: 0.468827 Aug 24 10:21:31.643185 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1279/2290] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:31 2022] GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241 => generated 1520 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:31.662347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-611cebc5-e1a8-4772-b648-da45fdd4df6c tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f465415f280>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:31.808279 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-611cebc5-e1a8-4772-b648-da45fdd4df6c tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/d81b1bef-ab64-4f84-bf62-d539dd7cb14d" status: 200 len: 1455 microversion: 2.1 time: 0.162877 Aug 24 10:21:31.810746 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1280/2291] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:21:31 2022] GET /compute/v2.1/images/d81b1bef-ab64-4f84-bf62-d539dd7cb14d => generated 1455 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:31.970453 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-88ee3c04-50c6-4495-8d76-a61b6b778f8e tempest-SecurityGroupsTestAdminJSON-725069492 tempest-SecurityGroupsTestAdminJSON-725069492-project-admin] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/d8552b56-7127-45cd-9078-5b7024ae2b48" status: 202 len: 0 microversion: 2.1 time: 0.563803 Aug 24 10:21:31.971970 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1012/2292] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:21:31 2022] DELETE /compute/v2.1/os-security-groups/d8552b56-7127-45cd-9078-5b7024ae2b48 => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:21:31.982955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1dc2446f-81fe-4c1e-8126-31a8f0c9d955 tempest-SecurityGroupsTestAdminJSON-1280739978 tempest-SecurityGroupsTestAdminJSON-1280739978-project] Calling method '.version_select at 0x7f4654167790>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:31.998926 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-5e3d1d3d-61f7-4c08-9848-775a3bbe56c6 req-4c0f8296-1f7f-4b13-8195-59022a21b8b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a4ddf34-af18-4e02-a306-c1c67f5c0b28", "name": "network-vif-unplugged", "status": "completed", "tag": "21445c55-f24c-46da-9946-53b2566a219f"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:32.028762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5e3d1d3d-61f7-4c08-9848-775a3bbe56c6 req-4c0f8296-1f7f-4b13-8195-59022a21b8b0 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:32.031338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5e3d1d3d-61f7-4c08-9848-775a3bbe56c6 req-4c0f8296-1f7f-4b13-8195-59022a21b8b0 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:32.033071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5e3d1d3d-61f7-4c08-9848-775a3bbe56c6 req-4c0f8296-1f7f-4b13-8195-59022a21b8b0 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:32.071865 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-5e3d1d3d-61f7-4c08-9848-775a3bbe56c6 req-4c0f8296-1f7f-4b13-8195-59022a21b8b0 service nova] Creating event network-vif-unplugged:21445c55-f24c-46da-9946-53b2566a219f for instance 8a4ddf34-af18-4e02-a306-c1c67f5c0b28 on n-h2-849328-3 Aug 24 10:21:32.096384 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-5e3d1d3d-61f7-4c08-9848-775a3bbe56c6 req-4c0f8296-1f7f-4b13-8195-59022a21b8b0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103349 Aug 24 10:21:32.098162 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1013/2293] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:21:32.140643 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-310e7efd-ac90-465e-b23f-dd35fab8597d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:32.147018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-310e7efd-ac90-465e-b23f-dd35fab8597d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:32.199246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-310e7efd-ac90-465e-b23f-dd35fab8597d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:32.204315 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-310e7efd-ac90-465e-b23f-dd35fab8597d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:32.205837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-310e7efd-ac90-465e-b23f-dd35fab8597d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:32.207239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-310e7efd-ac90-465e-b23f-dd35fab8597d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:32.211034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-310e7efd-ac90-465e-b23f-dd35fab8597d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:32.211591 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-310e7efd-ac90-465e-b23f-dd35fab8597d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:32.720286 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1dc2446f-81fe-4c1e-8126-31a8f0c9d955 tempest-SecurityGroupsTestAdminJSON-1280739978 tempest-SecurityGroupsTestAdminJSON-1280739978-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/e930d6c8-070b-41a3-9c8d-73acb563a083" status: 202 len: 0 microversion: 2.1 time: 0.742938 Aug 24 10:21:32.720286 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1281/2294] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:21:31 2022] DELETE /compute/v2.1/os-security-groups/e930d6c8-070b-41a3-9c8d-73acb563a083 => generated 0 bytes in 745 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:21:32.729836 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-310e7efd-ac90-465e-b23f-dd35fab8597d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:32.731345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-48ca6ed4-99d6-421d-bacf-1e87d9c5057c tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:32.732050 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-48ca6ed4-99d6-421d-bacf-1e87d9c5057c tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] [instance: 6fb85ae1-26a3-4862-82ff-a43a61ffc2e9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:32.740298 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-310e7efd-ac90-465e-b23f-dd35fab8597d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1199 microversion: 2.1 time: 0.627653 Aug 24 10:21:32.747276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48ca6ed4-99d6-421d-bacf-1e87d9c5057c tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:32.747806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48ca6ed4-99d6-421d-bacf-1e87d9c5057c tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:32.749113 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1014/2295] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:32 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1199 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:21:32.749853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48ca6ed4-99d6-421d-bacf-1e87d9c5057c tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:32.752260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48ca6ed4-99d6-421d-bacf-1e87d9c5057c tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:32.753291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48ca6ed4-99d6-421d-bacf-1e87d9c5057c tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:32.756406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48ca6ed4-99d6-421d-bacf-1e87d9c5057c tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:32.768902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-21ea9638-d1d3-4147-b528-96843a967ed5 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:32.770305 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-21ea9638-d1d3-4147-b528-96843a967ed5 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: 2bc88682-b0f5-42fc-88e5-a74d75b8e241] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:32.784191 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21ea9638-d1d3-4147-b528-96843a967ed5 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:32.785921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21ea9638-d1d3-4147-b528-96843a967ed5 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:32.786969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21ea9638-d1d3-4147-b528-96843a967ed5 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:32.788958 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21ea9638-d1d3-4147-b528-96843a967ed5 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:32.790294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21ea9638-d1d3-4147-b528-96843a967ed5 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:32.791393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21ea9638-d1d3-4147-b528-96843a967ed5 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:32.900127 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-48ca6ed4-99d6-421d-bacf-1e87d9c5057c tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc6e40773b254ef68b23406990d4ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fdff55e053d42ad8bd851a0654f2920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:32.931770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-48ca6ed4-99d6-421d-bacf-1e87d9c5057c tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc6e40773b254ef68b23406990d4ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fdff55e053d42ad8bd851a0654f2920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:32.942320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-48ca6ed4-99d6-421d-bacf-1e87d9c5057c tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc6e40773b254ef68b23406990d4ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fdff55e053d42ad8bd851a0654f2920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:32.945110 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-48ca6ed4-99d6-421d-bacf-1e87d9c5057c tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] 10.222.0.85 "GET /compute/v2.1/servers/6fb85ae1-26a3-4862-82ff-a43a61ffc2e9" status: 200 len: 1339 microversion: 2.47 time: 0.223488 Aug 24 10:21:32.946260 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1282/2296] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:21:32 2022] GET /compute/v2.1/servers/6fb85ae1-26a3-4862-82ff-a43a61ffc2e9 => generated 1339 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:21:32.955806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5a7ae07b-6db6-4138-b560-5124fc860512 tempest-SecurityGroupsTestAdminJSON-1280739978 tempest-SecurityGroupsTestAdminJSON-1280739978-project] Calling method '.version_select at 0x7f46541d6430>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:33.209630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-21ea9638-d1d3-4147-b528-96843a967ed5 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:33.232490 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-21ea9638-d1d3-4147-b528-96843a967ed5 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241" status: 200 len: 1497 microversion: 2.1 time: 0.479584 Aug 24 10:21:33.266597 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1015/2297] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:32 2022] GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241 => generated 1497 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:33.279729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-506a1112-4246-4aeb-a851-11caff2e621b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4655280700>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:33.463910 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5a7ae07b-6db6-4138-b560-5124fc860512 tempest-SecurityGroupsTestAdminJSON-1280739978 tempest-SecurityGroupsTestAdminJSON-1280739978-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/8fc3ae54-0b59-46ed-b4a5-7725ba2b92c7" status: 202 len: 0 microversion: 2.1 time: 0.515871 Aug 24 10:21:33.464676 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1283/2298] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:21:32 2022] DELETE /compute/v2.1/os-security-groups/8fc3ae54-0b59-46ed-b4a5-7725ba2b92c7 => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:21:33.482256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e3d61be5-ec44-4108-b3b7-7e2fc234036c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:33.519140 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-506a1112-4246-4aeb-a851-11caff2e621b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/d81b1bef-ab64-4f84-bf62-d539dd7cb14d" status: 200 len: 1455 microversion: 2.1 time: 0.250219 Aug 24 10:21:33.552035 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1016/2299] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:21:33 2022] GET /compute/v2.1/images/d81b1bef-ab64-4f84-bf62-d539dd7cb14d => generated 1455 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:33.568020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e3d61be5-ec44-4108-b3b7-7e2fc234036c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:33.569171 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e3d61be5-ec44-4108-b3b7-7e2fc234036c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:21:33.592295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3d61be5-ec44-4108-b3b7-7e2fc234036c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:33.593105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3d61be5-ec44-4108-b3b7-7e2fc234036c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:33.594183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3d61be5-ec44-4108-b3b7-7e2fc234036c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:33.608102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3d61be5-ec44-4108-b3b7-7e2fc234036c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:33.613427 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3d61be5-ec44-4108-b3b7-7e2fc234036c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:33.614573 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3d61be5-ec44-4108-b3b7-7e2fc234036c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:33.778589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-90aabdeb-3218-4d53-88b1-427308e68d1f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:33.784585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-90aabdeb-3218-4d53-88b1-427308e68d1f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:33.813277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90aabdeb-3218-4d53-88b1-427308e68d1f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:33.815403 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90aabdeb-3218-4d53-88b1-427308e68d1f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:33.816378 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90aabdeb-3218-4d53-88b1-427308e68d1f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:33.820021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90aabdeb-3218-4d53-88b1-427308e68d1f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:33.821104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90aabdeb-3218-4d53-88b1-427308e68d1f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:33.826341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90aabdeb-3218-4d53-88b1-427308e68d1f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:33.875274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-e3d61be5-ec44-4108-b3b7-7e2fc234036c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:21:33.997988 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e3d61be5-ec44-4108-b3b7-7e2fc234036c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.530285 Aug 24 10:21:34.009574 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1284/2300] 10.222.0.85 () {58 vars in 1154 bytes} [Wed Aug 24 10:21:33 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:34.035127 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-15c3ade3-5f2b-41f1-b92e-9db0bce12f25 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:34.036185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-15c3ade3-5f2b-41f1-b92e-9db0bce12f25 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] [instance: 6fb85ae1-26a3-4862-82ff-a43a61ffc2e9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:34.068473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15c3ade3-5f2b-41f1-b92e-9db0bce12f25 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:34.069671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15c3ade3-5f2b-41f1-b92e-9db0bce12f25 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:34.070429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15c3ade3-5f2b-41f1-b92e-9db0bce12f25 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:34.071714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15c3ade3-5f2b-41f1-b92e-9db0bce12f25 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:34.072840 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15c3ade3-5f2b-41f1-b92e-9db0bce12f25 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:34.073868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15c3ade3-5f2b-41f1-b92e-9db0bce12f25 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:34.395739 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-15c3ade3-5f2b-41f1-b92e-9db0bce12f25 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc6e40773b254ef68b23406990d4ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fdff55e053d42ad8bd851a0654f2920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:34.420210 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-15c3ade3-5f2b-41f1-b92e-9db0bce12f25 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc6e40773b254ef68b23406990d4ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fdff55e053d42ad8bd851a0654f2920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:34.435838 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-15c3ade3-5f2b-41f1-b92e-9db0bce12f25 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc6e40773b254ef68b23406990d4ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fdff55e053d42ad8bd851a0654f2920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:34.438434 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-15c3ade3-5f2b-41f1-b92e-9db0bce12f25 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] 10.222.0.85 "GET /compute/v2.1/servers/6fb85ae1-26a3-4862-82ff-a43a61ffc2e9" status: 200 len: 1339 microversion: 2.47 time: 0.426688 Aug 24 10:21:34.453802 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1285/2301] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:21:34 2022] GET /compute/v2.1/servers/6fb85ae1-26a3-4862-82ff-a43a61ffc2e9 => generated 1339 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:21:34.482657 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c34117a6-7cf1-4383-bd2e-08eb6210124f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:34.507156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c34117a6-7cf1-4383-bd2e-08eb6210124f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:34.507999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c34117a6-7cf1-4383-bd2e-08eb6210124f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:34.508787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c34117a6-7cf1-4383-bd2e-08eb6210124f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:34.600660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c34117a6-7cf1-4383-bd2e-08eb6210124f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: 2bc88682-b0f5-42fc-88e5-a74d75b8e241] Going to try to start instance {{(pid=122433) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 10:21:34.849193 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c34117a6-7cf1-4383-bd2e-08eb6210124f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "POST /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241/action" status: 202 len: 0 microversion: 2.1 time: 0.389736 Aug 24 10:21:34.855428 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1286/2302] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:21:34 2022] POST /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:21:34.870232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-943afd77-a827-46a8-bced-068180816228 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f46541c0430>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:35.064317 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-943afd77-a827-46a8-bced-068180816228 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/d81b1bef-ab64-4f84-bf62-d539dd7cb14d" status: 200 len: 1455 microversion: 2.1 time: 0.205715 Aug 24 10:21:35.078338 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1287/2303] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:21:34 2022] GET /compute/v2.1/images/d81b1bef-ab64-4f84-bf62-d539dd7cb14d => generated 1455 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:35.102800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-90aabdeb-3218-4d53-88b1-427308e68d1f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:35.107022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b1efdbb0-11ad-403e-b5b1-884ac1a8496c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:35.113806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b1efdbb0-11ad-403e-b5b1-884ac1a8496c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: 2bc88682-b0f5-42fc-88e5-a74d75b8e241] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:35.120845 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-90aabdeb-3218-4d53-88b1-427308e68d1f tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1381 microversion: 2.1 time: 1.352776 Aug 24 10:21:35.133404 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1efdbb0-11ad-403e-b5b1-884ac1a8496c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:35.133404 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1efdbb0-11ad-403e-b5b1-884ac1a8496c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:35.133404 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1efdbb0-11ad-403e-b5b1-884ac1a8496c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:35.140656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1efdbb0-11ad-403e-b5b1-884ac1a8496c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:35.141025 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1017/2304] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:33 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1381 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:35.141713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1efdbb0-11ad-403e-b5b1-884ac1a8496c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:35.142360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1efdbb0-11ad-403e-b5b1-884ac1a8496c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:35.889801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b1efdbb0-11ad-403e-b5b1-884ac1a8496c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:35.922012 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b1efdbb0-11ad-403e-b5b1-884ac1a8496c tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241" status: 200 len: 1506 microversion: 2.1 time: 0.839133 Aug 24 10:21:35.923577 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1288/2305] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:35 2022] GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241 => generated 1506 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:35.961700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-344d0972-a709-402c-8e21-00c208c5d664 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:35.968797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-344d0972-a709-402c-8e21-00c208c5d664 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] [instance: 6fb85ae1-26a3-4862-82ff-a43a61ffc2e9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:36.006356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-344d0972-a709-402c-8e21-00c208c5d664 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:36.018006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-344d0972-a709-402c-8e21-00c208c5d664 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:36.020300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-344d0972-a709-402c-8e21-00c208c5d664 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:36.029471 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-344d0972-a709-402c-8e21-00c208c5d664 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:36.032564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-344d0972-a709-402c-8e21-00c208c5d664 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:36.036207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-344d0972-a709-402c-8e21-00c208c5d664 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:36.509235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-344d0972-a709-402c-8e21-00c208c5d664 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc6e40773b254ef68b23406990d4ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fdff55e053d42ad8bd851a0654f2920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:36.523248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-344d0972-a709-402c-8e21-00c208c5d664 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc6e40773b254ef68b23406990d4ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fdff55e053d42ad8bd851a0654f2920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:36.537196 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-344d0972-a709-402c-8e21-00c208c5d664 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc6e40773b254ef68b23406990d4ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fdff55e053d42ad8bd851a0654f2920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:36.545265 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-344d0972-a709-402c-8e21-00c208c5d664 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] 10.222.0.85 "GET /compute/v2.1/servers/6fb85ae1-26a3-4862-82ff-a43a61ffc2e9" status: 200 len: 1360 microversion: 2.47 time: 0.611791 Aug 24 10:21:36.568964 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1289/2306] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:21:35 2022] GET /compute/v2.1/servers/6fb85ae1-26a3-4862-82ff-a43a61ffc2e9 => generated 1360 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:21:36.574869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f5c08cc7-fa11-4f65-be00-3de12709c218 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:36.575509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f5c08cc7-fa11-4f65-be00-3de12709c218 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:36.601329 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-08650834-fc04-42b4-8fce-5c176a8f4b6b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f465a1edca0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:36.654145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5c08cc7-fa11-4f65-be00-3de12709c218 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:36.663134 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5c08cc7-fa11-4f65-be00-3de12709c218 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:36.664500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5c08cc7-fa11-4f65-be00-3de12709c218 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:36.669760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5c08cc7-fa11-4f65-be00-3de12709c218 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:36.671007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5c08cc7-fa11-4f65-be00-3de12709c218 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:36.677907 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5c08cc7-fa11-4f65-be00-3de12709c218 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:37.263500 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-08650834-fc04-42b4-8fce-5c176a8f4b6b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/d81b1bef-ab64-4f84-bf62-d539dd7cb14d" status: 200 len: 1455 microversion: 2.1 time: 0.681360 Aug 24 10:21:37.272995 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1290/2307] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:21:36 2022] GET /compute/v2.1/images/d81b1bef-ab64-4f84-bf62-d539dd7cb14d => generated 1455 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:37.279484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6cc6d58d-afc0-4083-8d60-d7851b62b9c0 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1769978764"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:37.285435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6cc6d58d-afc0-4083-8d60-d7851b62b9c0 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] [instance: 6fb85ae1-26a3-4862-82ff-a43a61ffc2e9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:37.293766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cc6d58d-afc0-4083-8d60-d7851b62b9c0 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:37.294680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cc6d58d-afc0-4083-8d60-d7851b62b9c0 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:37.295602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cc6d58d-afc0-4083-8d60-d7851b62b9c0 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:37.296672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cc6d58d-afc0-4083-8d60-d7851b62b9c0 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:37.297509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cc6d58d-afc0-4083-8d60-d7851b62b9c0 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:37.301874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cc6d58d-afc0-4083-8d60-d7851b62b9c0 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:37.336049 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=5 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:37.459279 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f5c08cc7-fa11-4f65-be00-3de12709c218 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1532 microversion: 2.1 time: 2.316576 Aug 24 10:21:37.481367 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1018/2308] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:35 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1532 bytes in 2340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:37.489945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4c1b5bb1-6b5f-4873-878d-fbd9a251bb5b tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:37.498099 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4c1b5bb1-6b5f-4873-878d-fbd9a251bb5b tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: 2bc88682-b0f5-42fc-88e5-a74d75b8e241] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:37.527552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c1b5bb1-6b5f-4873-878d-fbd9a251bb5b tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:37.543558 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c1b5bb1-6b5f-4873-878d-fbd9a251bb5b tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:37.553529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c1b5bb1-6b5f-4873-878d-fbd9a251bb5b tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:37.556130 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c1b5bb1-6b5f-4873-878d-fbd9a251bb5b tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:37.560354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c1b5bb1-6b5f-4873-878d-fbd9a251bb5b tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:37.564933 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c1b5bb1-6b5f-4873-878d-fbd9a251bb5b tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:38.133836 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4c1b5bb1-6b5f-4873-878d-fbd9a251bb5b tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:38.168288 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4c1b5bb1-6b5f-4873-878d-fbd9a251bb5b tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241" status: 200 len: 1506 microversion: 2.1 time: 0.684049 Aug 24 10:21:38.179411 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1019/2309] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:37 2022] GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241 => generated 1506 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:38.192067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f129277c-41ec-4cbc-9338-b31c6371e258 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:38.197473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f129277c-41ec-4cbc-9338-b31c6371e258 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:38.209397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f129277c-41ec-4cbc-9338-b31c6371e258 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:38.212227 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f129277c-41ec-4cbc-9338-b31c6371e258 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:38.213894 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f129277c-41ec-4cbc-9338-b31c6371e258 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:38.216097 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f129277c-41ec-4cbc-9338-b31c6371e258 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:38.216899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f129277c-41ec-4cbc-9338-b31c6371e258 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:38.218218 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f129277c-41ec-4cbc-9338-b31c6371e258 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:38.516006 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6cc6d58d-afc0-4083-8d60-d7851b62b9c0 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] 10.222.0.85 "POST /compute/v2.1/servers/6fb85ae1-26a3-4862-82ff-a43a61ffc2e9/action" status: 202 len: 52 microversion: 2.47 time: 1.240735 Aug 24 10:21:38.518868 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1291/2310] 10.222.0.85 () {62 vars in 1319 bytes} [Wed Aug 24 10:21:37 2022] POST /compute/v2.1/servers/6fb85ae1-26a3-4862-82ff-a43a61ffc2e9/action => generated 52 bytes in 1245 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 24 10:21:38.577055 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f129277c-41ec-4cbc-9338-b31c6371e258 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1532 microversion: 2.1 time: 0.396013 Aug 24 10:21:38.587926 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1020/2311] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:38 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1532 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:38.604966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4373e954-531c-49ab-8e18-49115d0506bc tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4655280430>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:38.787636 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4373e954-531c-49ab-8e18-49115d0506bc tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/d81b1bef-ab64-4f84-bf62-d539dd7cb14d" status: 200 len: 1455 microversion: 2.1 time: 0.197892 Aug 24 10:21:38.788572 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1021/2312] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:21:38 2022] GET /compute/v2.1/images/d81b1bef-ab64-4f84-bf62-d539dd7cb14d => generated 1455 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:38.800522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7d6fc659-efc7-4822-b71f-2b50078e04aa tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:38.801034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7d6fc659-efc7-4822-b71f-2b50078e04aa tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] [instance: 6fb85ae1-26a3-4862-82ff-a43a61ffc2e9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:38.828332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d6fc659-efc7-4822-b71f-2b50078e04aa tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:38.831047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d6fc659-efc7-4822-b71f-2b50078e04aa tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:38.831942 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d6fc659-efc7-4822-b71f-2b50078e04aa tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:38.836064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d6fc659-efc7-4822-b71f-2b50078e04aa tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:38.841528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d6fc659-efc7-4822-b71f-2b50078e04aa tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:38.842380 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d6fc659-efc7-4822-b71f-2b50078e04aa tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:38.918730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7d6fc659-efc7-4822-b71f-2b50078e04aa tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] [instance: 6fb85ae1-26a3-4862-82ff-a43a61ffc2e9] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:21:39.163785 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7d6fc659-efc7-4822-b71f-2b50078e04aa tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] 10.222.0.85 "DELETE /compute/v2.1/servers/6fb85ae1-26a3-4862-82ff-a43a61ffc2e9" status: 204 len: 0 microversion: 2.47 time: 0.370789 Aug 24 10:21:39.166907 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1022/2313] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:21:38 2022] DELETE /compute/v2.1/servers/6fb85ae1-26a3-4862-82ff-a43a61ffc2e9 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:21:39.182945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-43e9978b-2917-4e63-8333-a5b9d4938a91 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:39.231635 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:21:39.231635 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:21:39.233079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e9978b-2917-4e63-8333-a5b9d4938a91 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:39.249867 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e9978b-2917-4e63-8333-a5b9d4938a91 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:39.250395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e9978b-2917-4e63-8333-a5b9d4938a91 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:39.251257 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e9978b-2917-4e63-8333-a5b9d4938a91 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:39.251765 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e9978b-2917-4e63-8333-a5b9d4938a91 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:39.252205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e9978b-2917-4e63-8333-a5b9d4938a91 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:39.321038 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-43e9978b-2917-4e63-8333-a5b9d4938a91 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] 10.222.0.85 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.150532 Aug 24 10:21:39.337241 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1023/2314] 10.222.0.85 () {58 vars in 1176 bytes} [Wed Aug 24 10:21:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:39.358785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f4d4a73a-65f0-4c4f-926f-b32cdab6cc10 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:39.365215 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f4d4a73a-65f0-4c4f-926f-b32cdab6cc10 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] [instance: 6fb85ae1-26a3-4862-82ff-a43a61ffc2e9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:39.404989 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4d4a73a-65f0-4c4f-926f-b32cdab6cc10 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:39.405519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4d4a73a-65f0-4c4f-926f-b32cdab6cc10 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:39.405960 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4d4a73a-65f0-4c4f-926f-b32cdab6cc10 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:39.406680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4d4a73a-65f0-4c4f-926f-b32cdab6cc10 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:39.406945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-530941b4-8d41-4b41-aba0-3af58ee27404 req-07577f51-63d8-487a-bf32-3130b4f152da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb", "name": "network-vif-plugged", "status": "completed", "tag": "c181228f-fe7e-4a76-bb5e-18f9995613d1"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:39.407138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4d4a73a-65f0-4c4f-926f-b32cdab6cc10 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:39.407556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4d4a73a-65f0-4c4f-926f-b32cdab6cc10 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:39.484589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-530941b4-8d41-4b41-aba0-3af58ee27404 req-07577f51-63d8-487a-bf32-3130b4f152da service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:39.485470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-530941b4-8d41-4b41-aba0-3af58ee27404 req-07577f51-63d8-487a-bf32-3130b4f152da service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:39.504295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-530941b4-8d41-4b41-aba0-3af58ee27404 req-07577f51-63d8-487a-bf32-3130b4f152da service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:39.587952 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-530941b4-8d41-4b41-aba0-3af58ee27404 req-07577f51-63d8-487a-bf32-3130b4f152da service nova] Creating event network-vif-plugged:c181228f-fe7e-4a76-bb5e-18f9995613d1 for instance fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb on n-h1-849328-3 Aug 24 10:21:39.621178 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-530941b4-8d41-4b41-aba0-3af58ee27404 req-07577f51-63d8-487a-bf32-3130b4f152da service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.094216 Aug 24 10:21:39.626486 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1292/2315] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:39.648644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-55f34b9b-cbd7-4bc9-bd6c-452eb21fc1ae tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:39.651785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-55f34b9b-cbd7-4bc9-bd6c-452eb21fc1ae tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: 2bc88682-b0f5-42fc-88e5-a74d75b8e241] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:39.672198 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55f34b9b-cbd7-4bc9-bd6c-452eb21fc1ae tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:39.680725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55f34b9b-cbd7-4bc9-bd6c-452eb21fc1ae tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:39.681666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55f34b9b-cbd7-4bc9-bd6c-452eb21fc1ae tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:39.682647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55f34b9b-cbd7-4bc9-bd6c-452eb21fc1ae tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:39.683303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55f34b9b-cbd7-4bc9-bd6c-452eb21fc1ae tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:39.685895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55f34b9b-cbd7-4bc9-bd6c-452eb21fc1ae tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:39.700025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:39.817175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f4d4a73a-65f0-4c4f-926f-b32cdab6cc10 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc6e40773b254ef68b23406990d4ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fdff55e053d42ad8bd851a0654f2920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:39.839874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f4d4a73a-65f0-4c4f-926f-b32cdab6cc10 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc6e40773b254ef68b23406990d4ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fdff55e053d42ad8bd851a0654f2920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:39.847615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f4d4a73a-65f0-4c4f-926f-b32cdab6cc10 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc6e40773b254ef68b23406990d4ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fdff55e053d42ad8bd851a0654f2920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:39.851176 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f4d4a73a-65f0-4c4f-926f-b32cdab6cc10 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] 10.222.0.85 "GET /compute/v2.1/servers/6fb85ae1-26a3-4862-82ff-a43a61ffc2e9" status: 200 len: 1366 microversion: 2.47 time: 0.511310 Aug 24 10:21:39.855384 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1024/2316] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:21:39 2022] GET /compute/v2.1/servers/6fb85ae1-26a3-4862-82ff-a43a61ffc2e9 => generated 1366 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:21:39.887472 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-468b50e6-927e-413f-94eb-9e26c0f9c044 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-849328-3", "block_migration": false, "disk_over_commit": false}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:39.894583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-468b50e6-927e-413f-94eb-9e26c0f9c044 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:39.914687 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-468b50e6-927e-413f-94eb-9e26c0f9c044 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:39.917699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-468b50e6-927e-413f-94eb-9e26c0f9c044 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:39.919753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-468b50e6-927e-413f-94eb-9e26c0f9c044 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:39.928686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-468b50e6-927e-413f-94eb-9e26c0f9c044 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:39.930368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-468b50e6-927e-413f-94eb-9e26c0f9c044 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:39.931377 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-468b50e6-927e-413f-94eb-9e26c0f9c044 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:40.056500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-468b50e6-927e-413f-94eb-9e26c0f9c044 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lazy-loading 'flavor' on Instance uuid 70c66c18-c34f-4916-aca3-da0ca33f9ba5 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:21:40.108636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-468b50e6-927e-413f-94eb-9e26c0f9c044 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Going to try to live migrate instance to n-h2-849328-3 {{(pid=122432) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 10:21:40.205919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-55f34b9b-cbd7-4bc9-bd6c-452eb21fc1ae tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:40.222586 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-55f34b9b-cbd7-4bc9-bd6c-452eb21fc1ae tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241" status: 200 len: 1510 microversion: 2.1 time: 0.592081 Aug 24 10:21:40.235219 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1293/2317] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:39 2022] GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241 => generated 1510 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:40.267266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-44aa7544-152d-4e6f-a1ab-b0db392e6469 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f46541c0ca0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:40.399921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:40.882903 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-44aa7544-152d-4e6f-a1ab-b0db392e6469 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/d81b1bef-ab64-4f84-bf62-d539dd7cb14d" status: 200 len: 1455 microversion: 2.1 time: 0.645715 Aug 24 10:21:40.883773 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1294/2318] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:21:40 2022] GET /compute/v2.1/images/d81b1bef-ab64-4f84-bf62-d539dd7cb14d => generated 1455 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:40.906921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-75f21145-dc48-486c-9175-62ac500eb8a0 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:40.965241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-75f21145-dc48-486c-9175-62ac500eb8a0 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:40.974540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.compute.servers [None req-75f21145-dc48-486c-9175-62ac500eb8a0 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Removing options 'limit' from query {{(pid=122433) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 24 10:21:40.981050 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-75f21145-dc48-486c-9175-62ac500eb8a0 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Searching by: {'deleted': False, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:21:40.990695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75f21145-dc48-486c-9175-62ac500eb8a0 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:41.004376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75f21145-dc48-486c-9175-62ac500eb8a0 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:41.008376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75f21145-dc48-486c-9175-62ac500eb8a0 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:41.016132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75f21145-dc48-486c-9175-62ac500eb8a0 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:41.027393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75f21145-dc48-486c-9175-62ac500eb8a0 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:41.027851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75f21145-dc48-486c-9175-62ac500eb8a0 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:41.038736 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-75f21145-dc48-486c-9175-62ac500eb8a0 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.154341 Aug 24 10:21:41.043927 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1295/2319] 10.222.0.85 () {58 vars in 1140 bytes} [Wed Aug 24 10:21:40 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:21:41.094190 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-61822a5e-1b7e-45c1-ba85-ab2aa185c116 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:41.094828 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-61822a5e-1b7e-45c1-ba85-ab2aa185c116 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] [instance: 6fb85ae1-26a3-4862-82ff-a43a61ffc2e9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:41.136968 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61822a5e-1b7e-45c1-ba85-ab2aa185c116 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:41.137501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61822a5e-1b7e-45c1-ba85-ab2aa185c116 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:41.137947 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61822a5e-1b7e-45c1-ba85-ab2aa185c116 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:41.138682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61822a5e-1b7e-45c1-ba85-ab2aa185c116 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:41.139175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61822a5e-1b7e-45c1-ba85-ab2aa185c116 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:41.139605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61822a5e-1b7e-45c1-ba85-ab2aa185c116 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:41.584880 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-61822a5e-1b7e-45c1-ba85-ab2aa185c116 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc6e40773b254ef68b23406990d4ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fdff55e053d42ad8bd851a0654f2920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:41.646149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-61822a5e-1b7e-45c1-ba85-ab2aa185c116 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc6e40773b254ef68b23406990d4ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fdff55e053d42ad8bd851a0654f2920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:41.651112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-61822a5e-1b7e-45c1-ba85-ab2aa185c116 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc6e40773b254ef68b23406990d4ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fdff55e053d42ad8bd851a0654f2920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:41.656914 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-61822a5e-1b7e-45c1-ba85-ab2aa185c116 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] 10.222.0.85 "GET /compute/v2.1/servers/6fb85ae1-26a3-4862-82ff-a43a61ffc2e9" status: 200 len: 1366 microversion: 2.47 time: 0.603266 Aug 24 10:21:41.671281 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1296/2320] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:21:41 2022] GET /compute/v2.1/servers/6fb85ae1-26a3-4862-82ff-a43a61ffc2e9 => generated 1366 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:21:41.707916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-481bf074-5dd8-46ad-8e16-e52b6c99fe44 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:41.713639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-481bf074-5dd8-46ad-8e16-e52b6c99fe44 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: 2bc88682-b0f5-42fc-88e5-a74d75b8e241] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:41.750543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-481bf074-5dd8-46ad-8e16-e52b6c99fe44 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:41.751127 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-481bf074-5dd8-46ad-8e16-e52b6c99fe44 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:41.751580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-481bf074-5dd8-46ad-8e16-e52b6c99fe44 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:41.757438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-481bf074-5dd8-46ad-8e16-e52b6c99fe44 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:41.758108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-481bf074-5dd8-46ad-8e16-e52b6c99fe44 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:41.758533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-481bf074-5dd8-46ad-8e16-e52b6c99fe44 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:42.495634 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-481bf074-5dd8-46ad-8e16-e52b6c99fe44 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:42.505955 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-481bf074-5dd8-46ad-8e16-e52b6c99fe44 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241" status: 200 len: 1510 microversion: 2.1 time: 0.840091 Aug 24 10:21:42.507124 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1297/2321] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:41 2022] GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241 => generated 1510 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:42.513181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-89c85b98-1944-4c8c-93e5-c04094320903 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f465418af70>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:42.666198 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-89c85b98-1944-4c8c-93e5-c04094320903 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/d81b1bef-ab64-4f84-bf62-d539dd7cb14d" status: 200 len: 1455 microversion: 2.1 time: 0.157672 Aug 24 10:21:42.666987 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1298/2322] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:21:42 2022] GET /compute/v2.1/images/d81b1bef-ab64-4f84-bf62-d539dd7cb14d => generated 1455 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:42.692806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b94c0051-9f3a-40ba-97ce-37466705a720 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:42.693486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b94c0051-9f3a-40ba-97ce-37466705a720 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: ea87f606-60c3-4789-871d-8a8ffc4e0612] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:42.711320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b94c0051-9f3a-40ba-97ce-37466705a720 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:42.724806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b94c0051-9f3a-40ba-97ce-37466705a720 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:42.726993 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b94c0051-9f3a-40ba-97ce-37466705a720 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:42.728061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b94c0051-9f3a-40ba-97ce-37466705a720 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:42.729746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b94c0051-9f3a-40ba-97ce-37466705a720 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:42.730682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b94c0051-9f3a-40ba-97ce-37466705a720 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:43.292352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b94c0051-9f3a-40ba-97ce-37466705a720 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:43.314799 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b94c0051-9f3a-40ba-97ce-37466705a720 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea87f606-60c3-4789-871d-8a8ffc4e0612" status: 200 len: 1511 microversion: 2.1 time: 0.639480 Aug 24 10:21:43.316995 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1299/2323] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:42 2022] GET /compute/v2.1/servers/ea87f606-60c3-4789-871d-8a8ffc4e0612 => generated 1511 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:43.326905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f7813859-ad93-4c78-8575-6f2bd76879e6 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:43.328427 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f7813859-ad93-4c78-8575-6f2bd76879e6 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] [instance: 6fb85ae1-26a3-4862-82ff-a43a61ffc2e9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:43.341314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7813859-ad93-4c78-8575-6f2bd76879e6 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:43.343671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7813859-ad93-4c78-8575-6f2bd76879e6 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:43.344806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7813859-ad93-4c78-8575-6f2bd76879e6 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:43.346386 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7813859-ad93-4c78-8575-6f2bd76879e6 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:43.347709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7813859-ad93-4c78-8575-6f2bd76879e6 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:43.348782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7813859-ad93-4c78-8575-6f2bd76879e6 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:43.443472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7813859-ad93-4c78-8575-6f2bd76879e6 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:43.444167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7813859-ad93-4c78-8575-6f2bd76879e6 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:43.445014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7813859-ad93-4c78-8575-6f2bd76879e6 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:43.445725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-f7813859-ad93-4c78-8575-6f2bd76879e6 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lazy-loading 'fault' on Instance uuid 6fb85ae1-26a3-4862-82ff-a43a61ffc2e9 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:21:43.639782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=26 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:43.662255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f7813859-ad93-4c78-8575-6f2bd76879e6 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc6e40773b254ef68b23406990d4ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fdff55e053d42ad8bd851a0654f2920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:43.714395 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f7813859-ad93-4c78-8575-6f2bd76879e6 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc6e40773b254ef68b23406990d4ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fdff55e053d42ad8bd851a0654f2920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:43.719934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f7813859-ad93-4c78-8575-6f2bd76879e6 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc6e40773b254ef68b23406990d4ca01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fdff55e053d42ad8bd851a0654f2920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:43.751019 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f7813859-ad93-4c78-8575-6f2bd76879e6 tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] 10.222.0.85 "GET /compute/v2.1/servers/6fb85ae1-26a3-4862-82ff-a43a61ffc2e9" status: 200 len: 1371 microversion: 2.47 time: 0.431490 Aug 24 10:21:43.760736 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1300/2324] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:21:43 2022] GET /compute/v2.1/servers/6fb85ae1-26a3-4862-82ff-a43a61ffc2e9 => generated 1371 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:21:43.768802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c4894252-7f58-4bb7-9f22-45185ecdd758 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:43.788095 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c4894252-7f58-4bb7-9f22-45185ecdd758 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: b47ddbf3-ca84-419b-ae08-916fb959be5c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:43.830269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4894252-7f58-4bb7-9f22-45185ecdd758 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:43.839191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4894252-7f58-4bb7-9f22-45185ecdd758 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:43.844311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4894252-7f58-4bb7-9f22-45185ecdd758 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:43.849789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4894252-7f58-4bb7-9f22-45185ecdd758 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:43.852610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4894252-7f58-4bb7-9f22-45185ecdd758 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:43.866233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4894252-7f58-4bb7-9f22-45185ecdd758 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:44.798807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c4894252-7f58-4bb7-9f22-45185ecdd758 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:44.818174 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c4894252-7f58-4bb7-9f22-45185ecdd758 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c" status: 200 len: 1511 microversion: 2.1 time: 1.050000 Aug 24 10:21:44.821262 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1301/2325] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:43 2022] GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c => generated 1511 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:44.845162 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dcc2676a-4ad9-4ee4-8050-50545b9c2566 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f46541d65e0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:45.023351 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dcc2676a-4ad9-4ee4-8050-50545b9c2566 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/d81b1bef-ab64-4f84-bf62-d539dd7cb14d" status: 200 len: 1455 microversion: 2.1 time: 0.198469 Aug 24 10:21:45.027216 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1302/2326] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:21:44 2022] GET /compute/v2.1/images/d81b1bef-ab64-4f84-bf62-d539dd7cb14d => generated 1455 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:45.195784 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-468b50e6-927e-413f-94eb-9e26c0f9c044 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5/action" status: 202 len: 0 microversion: 2.1 time: 5.327707 Aug 24 10:21:45.198144 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1025/2327] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:21:39 2022] POST /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5/action => generated 0 bytes in 5331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:21:45.208628 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b2a05cba-dee9-47c0-b0ad-5afba0165f2d tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:45.213590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b2a05cba-dee9-47c0-b0ad-5afba0165f2d tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] [instance: 6fb85ae1-26a3-4862-82ff-a43a61ffc2e9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:45.256306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2a05cba-dee9-47c0-b0ad-5afba0165f2d tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:45.256917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2a05cba-dee9-47c0-b0ad-5afba0165f2d tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:45.262263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2a05cba-dee9-47c0-b0ad-5afba0165f2d tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:45.268917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2a05cba-dee9-47c0-b0ad-5afba0165f2d tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:45.288563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2a05cba-dee9-47c0-b0ad-5afba0165f2d tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:45.294019 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2a05cba-dee9-47c0-b0ad-5afba0165f2d tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:45.444974 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-b2a05cba-dee9-47c0-b0ad-5afba0165f2d tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] HTTP exception thrown: Instance 6fb85ae1-26a3-4862-82ff-a43a61ffc2e9 could not be found. Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b2a05cba-dee9-47c0-b0ad-5afba0165f2d tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Request method failure captured: Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/6fb85ae1-26a3-4862-82ff-a43a61ffc2e9 HTTP/1.1 Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfuma5VW7s_Q3KnNBFbc0ZU-y_O84Pe7Z_Lm0G1iG_pGr2RQtvgSLrPKPgu9kmdo7ZMJJGzK1LTKDxPjjFo1rJ5p8Zzf4YrQUnorWXNVs1Yt3eMQMgt4AavEsh_VOrlZk-vPhm78yX9_XW_VNayefWsCUFp8Z1vxinPeLCNazbuHh1s Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: X-Openstack-Nova-Api-Version: 2.47 Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 5fdff55e053d42ad8bd851a0654f2920 Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersAaction247Test-1027886372 Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5fdff55e053d42ad8bd851a0654f2920"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_5fdff55e053d42ad8bd851a0654f2920", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5fdff55e053d42ad8bd851a0654f2920"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/5fdff55e053d42ad8bd851a0654f2920"}]}] Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersAaction247Test-1027886372 Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 5fdff55e053d42ad8bd851a0654f2920 Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersAaction247Test-1027886372 Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersAaction247Test-1027886372-project Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: cc6e40773b254ef68b23406990d4ca01 Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersAaction247Test-1027886372-project Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 6fb85ae1-26a3-4862-82ff-a43a61ffc2e9 could not be found. Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '6fb85ae1-26a3-4862-82ff-a43a61ffc2e9'} Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fb85ae1-26a3-4862-82ff-a43a61ffc2e9 could not be found. Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fb85ae1-26a3-4862-82ff-a43a61ffc2e9 could not be found. Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:21:45.482812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:21:45.492722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:21:45.492722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:45.492722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:21:45.492722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:21:45.492722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:21:45.492722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:21:45.492722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fb85ae1-26a3-4862-82ff-a43a61ffc2e9 could not be found. Aug 24 10:21:45.492722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:21:45.492722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b2a05cba-dee9-47c0-b0ad-5afba0165f2d tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] Returning 404 to user: Instance 6fb85ae1-26a3-4862-82ff-a43a61ffc2e9 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:21:45.492722 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b2a05cba-dee9-47c0-b0ad-5afba0165f2d tempest-ServersAaction247Test-1027886372 tempest-ServersAaction247Test-1027886372-project] 10.222.0.85 "GET /compute/v2.1/servers/6fb85ae1-26a3-4862-82ff-a43a61ffc2e9" status: 404 len: 111 microversion: 2.47 time: 0.282754 Aug 24 10:21:45.526021 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1026/2328] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:21:45 2022] GET /compute/v2.1/servers/6fb85ae1-26a3-4862-82ff-a43a61ffc2e9 => generated 111 bytes in 326 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:21:45.560359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a0f9b43f-a490-4428-b838-1c0cc798dd39 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:45.585177 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a0f9b43f-a490-4428-b838-1c0cc798dd39 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:45.587978 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a0f9b43f-a490-4428-b838-1c0cc798dd39 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:21:45.726149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-368f2dc6-22ea-48e9-9dbf-196c0e8c971d tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1608213847", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:45.875203 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0f9b43f-a490-4428-b838-1c0cc798dd39 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:45.876094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0f9b43f-a490-4428-b838-1c0cc798dd39 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:45.878514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0f9b43f-a490-4428-b838-1c0cc798dd39 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:45.879362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0f9b43f-a490-4428-b838-1c0cc798dd39 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:45.880516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0f9b43f-a490-4428-b838-1c0cc798dd39 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:45.881198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0f9b43f-a490-4428-b838-1c0cc798dd39 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:46.031740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-368f2dc6-22ea-48e9-9dbf-196c0e8c971d tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:21:46.305187 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-a0f9b43f-a490-4428-b838-1c0cc798dd39 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:21:46.500815 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a0f9b43f-a490-4428-b838-1c0cc798dd39 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 345 microversion: 2.1 time: 0.973499 Aug 24 10:21:46.513543 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1027/2329] 10.222.0.85 () {58 vars in 1154 bytes} [Wed Aug 24 10:21:45 2022] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 345 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:46.546559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0766b473-14f2-4221-8b67-90ba46170527 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:46.547220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0766b473-14f2-4221-8b67-90ba46170527 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:46.637439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0766b473-14f2-4221-8b67-90ba46170527 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:46.637439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0766b473-14f2-4221-8b67-90ba46170527 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:46.637439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0766b473-14f2-4221-8b67-90ba46170527 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:46.637439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0766b473-14f2-4221-8b67-90ba46170527 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:46.677937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0766b473-14f2-4221-8b67-90ba46170527 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:46.677937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0766b473-14f2-4221-8b67-90ba46170527 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:47.764413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-368f2dc6-22ea-48e9-9dbf-196c0e8c971d tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:21:47.766211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-368f2dc6-22ea-48e9-9dbf-196c0e8c971d tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:21:47.767342 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-368f2dc6-22ea-48e9-9dbf-196c0e8c971d tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:21:47.768336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-368f2dc6-22ea-48e9-9dbf-196c0e8c971d tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:21:47.770882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-368f2dc6-22ea-48e9-9dbf-196c0e8c971d tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:21:47.821622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-368f2dc6-22ea-48e9-9dbf-196c0e8c971d tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:47.822710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-368f2dc6-22ea-48e9-9dbf-196c0e8c971d tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:47.823425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-368f2dc6-22ea-48e9-9dbf-196c0e8c971d tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:47.824533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-368f2dc6-22ea-48e9-9dbf-196c0e8c971d tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:47.825304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-368f2dc6-22ea-48e9-9dbf-196c0e8c971d tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:47.825999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-368f2dc6-22ea-48e9-9dbf-196c0e8c971d tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:47.901268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-368f2dc6-22ea-48e9-9dbf-196c0e8c971d tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Getting quotas for project 9f9f51d9eede462186be9ba212b4b18d. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:21:47.925211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-368f2dc6-22ea-48e9-9dbf-196c0e8c971d tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Getting quotas for user 40868a3ee54348379b95ac9902d2fb22 and project 9f9f51d9eede462186be9ba212b4b18d. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:21:47.961419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-368f2dc6-22ea-48e9-9dbf-196c0e8c971d tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:21:47.971093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-368f2dc6-22ea-48e9-9dbf-196c0e8c971d tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] [instance: 3765cbca-99e6-4596-9b57-c846ac289dd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:21:48.152686 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-368f2dc6-22ea-48e9-9dbf-196c0e8c971d tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.113742 Aug 24 10:21:48.163951 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1303/2330] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:21:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:21:48.227820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-32a4dd1c-8e82-46d8-b0b4-98486bf7e4cd tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f46541a9670>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:48.361234 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0766b473-14f2-4221-8b67-90ba46170527 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:48.385335 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0766b473-14f2-4221-8b67-90ba46170527 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1391 microversion: 2.1 time: 1.854932 Aug 24 10:21:48.386048 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1028/2331] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:46 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1391 bytes in 1872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:48.421898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5d78e7b7-0d9c-412f-9a73-8070af1c1f12 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:48.434061 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5d78e7b7-0d9c-412f-9a73-8070af1c1f12 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: 2bc88682-b0f5-42fc-88e5-a74d75b8e241] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:48.486922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d78e7b7-0d9c-412f-9a73-8070af1c1f12 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:48.487524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d78e7b7-0d9c-412f-9a73-8070af1c1f12 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:48.488034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d78e7b7-0d9c-412f-9a73-8070af1c1f12 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:48.496274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d78e7b7-0d9c-412f-9a73-8070af1c1f12 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:48.497071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d78e7b7-0d9c-412f-9a73-8070af1c1f12 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:48.497799 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d78e7b7-0d9c-412f-9a73-8070af1c1f12 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:49.175127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5d78e7b7-0d9c-412f-9a73-8070af1c1f12 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:49.190484 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5d78e7b7-0d9c-412f-9a73-8070af1c1f12 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241" status: 200 len: 1510 microversion: 2.1 time: 0.795491 Aug 24 10:21:49.192977 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1029/2332] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:48 2022] GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241 => generated 1510 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:49.202123 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ced1bc42-f595-43e6-abcb-a6d24ddf4966 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:49.208847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ced1bc42-f595-43e6-abcb-a6d24ddf4966 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] [instance: 3765cbca-99e6-4596-9b57-c846ac289dd8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:49.783436 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ced1bc42-f595-43e6-abcb-a6d24ddf4966 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40868a3ee54348379b95ac9902d2fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f51d9eede462186be9ba212b4b18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:49.798903 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ced1bc42-f595-43e6-abcb-a6d24ddf4966 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] 10.222.0.85 "GET /compute/v2.1/servers/3765cbca-99e6-4596-9b57-c846ac289dd8" status: 200 len: 1223 microversion: 2.1 time: 0.599666 Aug 24 10:21:49.800498 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1030/2333] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:49 2022] GET /compute/v2.1/servers/3765cbca-99e6-4596-9b57-c846ac289dd8 => generated 1223 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:49.825937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e79e0323-1f2c-4731-b58a-ef30c563a003 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:49.835050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e79e0323-1f2c-4731-b58a-ef30c563a003 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: ea87f606-60c3-4789-871d-8a8ffc4e0612] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:49.870102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e79e0323-1f2c-4731-b58a-ef30c563a003 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:49.873026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e79e0323-1f2c-4731-b58a-ef30c563a003 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:49.876063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e79e0323-1f2c-4731-b58a-ef30c563a003 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:49.877036 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e79e0323-1f2c-4731-b58a-ef30c563a003 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:49.881828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e79e0323-1f2c-4731-b58a-ef30c563a003 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:49.882451 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e79e0323-1f2c-4731-b58a-ef30c563a003 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:50.406192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e79e0323-1f2c-4731-b58a-ef30c563a003 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:50.436851 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e79e0323-1f2c-4731-b58a-ef30c563a003 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea87f606-60c3-4789-871d-8a8ffc4e0612" status: 200 len: 1511 microversion: 2.1 time: 0.618381 Aug 24 10:21:50.442487 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1031/2334] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:49 2022] GET /compute/v2.1/servers/ea87f606-60c3-4789-871d-8a8ffc4e0612 => generated 1511 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:50.467693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ac21cde3-c684-44dc-9c85-377d95d89421 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:50.477334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ac21cde3-c684-44dc-9c85-377d95d89421 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:50.499193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac21cde3-c684-44dc-9c85-377d95d89421 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:50.507560 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac21cde3-c684-44dc-9c85-377d95d89421 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:50.508601 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac21cde3-c684-44dc-9c85-377d95d89421 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:50.511648 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac21cde3-c684-44dc-9c85-377d95d89421 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:50.514593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac21cde3-c684-44dc-9c85-377d95d89421 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:50.519022 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac21cde3-c684-44dc-9c85-377d95d89421 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:51.014767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ac21cde3-c684-44dc-9c85-377d95d89421 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:51.038241 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ac21cde3-c684-44dc-9c85-377d95d89421 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1391 microversion: 2.1 time: 0.593478 Aug 24 10:21:51.065252 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1032/2335] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:50 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1391 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:51.073389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-107df94a-0270-48a7-bfa8-ccb62ec376e1 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:51.075725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-107df94a-0270-48a7-bfa8-ccb62ec376e1 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: b47ddbf3-ca84-419b-ae08-916fb959be5c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:51.105222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-107df94a-0270-48a7-bfa8-ccb62ec376e1 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:51.106150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-107df94a-0270-48a7-bfa8-ccb62ec376e1 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:51.106741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-107df94a-0270-48a7-bfa8-ccb62ec376e1 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:51.107741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-107df94a-0270-48a7-bfa8-ccb62ec376e1 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:51.108650 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-107df94a-0270-48a7-bfa8-ccb62ec376e1 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:51.109509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-107df94a-0270-48a7-bfa8-ccb62ec376e1 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:51.894572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-107df94a-0270-48a7-bfa8-ccb62ec376e1 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:51.923590 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-107df94a-0270-48a7-bfa8-ccb62ec376e1 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c" status: 200 len: 1511 microversion: 2.1 time: 0.856759 Aug 24 10:21:51.939216 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1033/2336] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:51 2022] GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c => generated 1511 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:51.964503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cf7ee796-0203-4219-a6d2-746f26a47a48 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:51.969792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cf7ee796-0203-4219-a6d2-746f26a47a48 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] [instance: 3765cbca-99e6-4596-9b57-c846ac289dd8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:51.992032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf7ee796-0203-4219-a6d2-746f26a47a48 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:52.004011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf7ee796-0203-4219-a6d2-746f26a47a48 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:52.006252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf7ee796-0203-4219-a6d2-746f26a47a48 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:52.013931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf7ee796-0203-4219-a6d2-746f26a47a48 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:52.015040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf7ee796-0203-4219-a6d2-746f26a47a48 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:52.016116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf7ee796-0203-4219-a6d2-746f26a47a48 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:52.309279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cf7ee796-0203-4219-a6d2-746f26a47a48 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40868a3ee54348379b95ac9902d2fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f51d9eede462186be9ba212b4b18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:52.319485 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cf7ee796-0203-4219-a6d2-746f26a47a48 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] 10.222.0.85 "GET /compute/v2.1/servers/3765cbca-99e6-4596-9b57-c846ac289dd8" status: 200 len: 1281 microversion: 2.1 time: 0.377811 Aug 24 10:21:52.325342 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1034/2337] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:51 2022] GET /compute/v2.1/servers/3765cbca-99e6-4596-9b57-c846ac289dd8 => generated 1281 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:52.338891 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e0d925a-cedc-48a2-bc13-473063c81cf0 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:52.348491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6e0d925a-cedc-48a2-bc13-473063c81cf0 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:52.355301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6e0d925a-cedc-48a2-bc13-473063c81cf0 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Searching by: {'deleted': False, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:21:52.367789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e0d925a-cedc-48a2-bc13-473063c81cf0 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:52.368281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e0d925a-cedc-48a2-bc13-473063c81cf0 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:52.368860 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e0d925a-cedc-48a2-bc13-473063c81cf0 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:52.372711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e0d925a-cedc-48a2-bc13-473063c81cf0 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:52.374881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e0d925a-cedc-48a2-bc13-473063c81cf0 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:52.375466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e0d925a-cedc-48a2-bc13-473063c81cf0 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:52.450991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-6e0d925a-cedc-48a2-bc13-473063c81cf0 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:21:52.557640 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6e0d925a-cedc-48a2-bc13-473063c81cf0 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:52.579884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e0d925a-cedc-48a2-bc13-473063c81cf0 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:52.580494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e0d925a-cedc-48a2-bc13-473063c81cf0 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:52.581055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e0d925a-cedc-48a2-bc13-473063c81cf0 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:52.962327 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6e0d925a-cedc-48a2-bc13-473063c81cf0 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/detail" status: 200 len: 4515 microversion: 2.1 time: 0.631095 Aug 24 10:21:52.963018 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1035/2338] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:21:52 2022] GET /compute/v2.1/servers/detail => generated 4515 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:53.369550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9b5a9da8-cb1e-4301-bfde-56e669ee2e58 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1269380778", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": "none"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:57.854464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:57.855341 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=38 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:57.947421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:58.082355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:02.410069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:02.551206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:02.592734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:03.409146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:07.450190 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-32a4dd1c-8e82-46d8-b0b4-98486bf7e4cd tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/d81b1bef-ab64-4f84-bf62-d539dd7cb14d" status: 200 len: 1455 microversion: 2.1 time: 19.283924 Aug 24 10:22:07.462826 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1304/2339] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:21:48 2022] GET /compute/v2.1/images/d81b1bef-ab64-4f84-bf62-d539dd7cb14d => generated 1455 bytes in 19288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:07.469253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dccf6a1b-04ce-47e3-afad-2ae1d29e3ca2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:07.470067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dccf6a1b-04ce-47e3-afad-2ae1d29e3ca2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:07.479824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dccf6a1b-04ce-47e3-afad-2ae1d29e3ca2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:07.480306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dccf6a1b-04ce-47e3-afad-2ae1d29e3ca2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:07.480793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dccf6a1b-04ce-47e3-afad-2ae1d29e3ca2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:07.481943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dccf6a1b-04ce-47e3-afad-2ae1d29e3ca2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:07.482321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dccf6a1b-04ce-47e3-afad-2ae1d29e3ca2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:07.482804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dccf6a1b-04ce-47e3-afad-2ae1d29e3ca2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:07.573231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9b5a9da8-cb1e-4301-bfde-56e669ee2e58 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:22:07.574504 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9b5a9da8-cb1e-4301-bfde-56e669ee2e58 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:22:07.575182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9b5a9da8-cb1e-4301-bfde-56e669ee2e58 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:22:07.575838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9b5a9da8-cb1e-4301-bfde-56e669ee2e58 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:22:07.576573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9b5a9da8-cb1e-4301-bfde-56e669ee2e58 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:22:07.596480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b5a9da8-cb1e-4301-bfde-56e669ee2e58 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:07.597051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b5a9da8-cb1e-4301-bfde-56e669ee2e58 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:07.598662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b5a9da8-cb1e-4301-bfde-56e669ee2e58 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:07.599590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b5a9da8-cb1e-4301-bfde-56e669ee2e58 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:07.600192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b5a9da8-cb1e-4301-bfde-56e669ee2e58 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:07.601253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b5a9da8-cb1e-4301-bfde-56e669ee2e58 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:07.630907 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-9b5a9da8-cb1e-4301-bfde-56e669ee2e58 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Getting quotas for project bcb5c4e7e532413685ae86f24d86751b. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:22:07.652686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-9b5a9da8-cb1e-4301-bfde-56e669ee2e58 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Getting quotas for user 6d0112a16f86400289bfc60258957aaa and project bcb5c4e7e532413685ae86f24d86751b. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:22:07.669453 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9b5a9da8-cb1e-4301-bfde-56e669ee2e58 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:22:07.672835 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9b5a9da8-cb1e-4301-bfde-56e669ee2e58 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 36aa270e-6a92-4d10-8b11-9bb3ce5595a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:22:07.702907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dccf6a1b-04ce-47e3-afad-2ae1d29e3ca2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:07.718864 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dccf6a1b-04ce-47e3-afad-2ae1d29e3ca2 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1391 microversion: 2.1 time: 0.254496 Aug 24 10:22:07.719945 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1305/2340] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:07 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1391 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:07.726058 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1d3e6a58-747d-4e7a-8e37-40f62b9e5598 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:07.732015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1d3e6a58-747d-4e7a-8e37-40f62b9e5598 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:07.733081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1d3e6a58-747d-4e7a-8e37-40f62b9e5598 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:22:07.784073 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9b5a9da8-cb1e-4301-bfde-56e669ee2e58 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 14.818499 Aug 24 10:22:07.786572 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1036/2341] 10.222.0.85 () {62 vars in 1188 bytes} [Wed Aug 24 10:21:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 14823 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 10:22:07.800057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0c2de760-173e-408a-89a9-c6a559fb9bf6 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:07.820585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0c2de760-173e-408a-89a9-c6a559fb9bf6 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] [instance: 3765cbca-99e6-4596-9b57-c846ac289dd8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:07.835117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c2de760-173e-408a-89a9-c6a559fb9bf6 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:07.844586 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c2de760-173e-408a-89a9-c6a559fb9bf6 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:07.846102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c2de760-173e-408a-89a9-c6a559fb9bf6 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:07.848023 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c2de760-173e-408a-89a9-c6a559fb9bf6 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:07.849820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c2de760-173e-408a-89a9-c6a559fb9bf6 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:07.855551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c2de760-173e-408a-89a9-c6a559fb9bf6 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:07.907719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d3e6a58-747d-4e7a-8e37-40f62b9e5598 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:07.908621 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d3e6a58-747d-4e7a-8e37-40f62b9e5598 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:07.909497 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d3e6a58-747d-4e7a-8e37-40f62b9e5598 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:07.910716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d3e6a58-747d-4e7a-8e37-40f62b9e5598 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:07.911468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d3e6a58-747d-4e7a-8e37-40f62b9e5598 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:07.912250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d3e6a58-747d-4e7a-8e37-40f62b9e5598 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:08.122529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0c2de760-173e-408a-89a9-c6a559fb9bf6 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40868a3ee54348379b95ac9902d2fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f51d9eede462186be9ba212b4b18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:08.136790 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0c2de760-173e-408a-89a9-c6a559fb9bf6 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] 10.222.0.85 "GET /compute/v2.1/servers/3765cbca-99e6-4596-9b57-c846ac289dd8" status: 200 len: 1323 microversion: 2.1 time: 0.347107 Aug 24 10:22:08.137723 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1037/2342] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:07 2022] GET /compute/v2.1/servers/3765cbca-99e6-4596-9b57-c846ac289dd8 => generated 1323 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:08.188247 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-1d3e6a58-747d-4e7a-8e37-40f62b9e5598 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:22:08.210914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-4d4cb698-cdcd-4d35-aa87-31e7eb6f738e req-3519289c-c01c-4f0c-bb12-5c77e207bee6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3765cbca-99e6-4596-9b57-c846ac289dd8", "tag": "f44afbfe-d144-4d60-9452-f86f341f60d8"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:08.223174 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4d4cb698-cdcd-4d35-aa87-31e7eb6f738e req-3519289c-c01c-4f0c-bb12-5c77e207bee6 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:08.224493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4d4cb698-cdcd-4d35-aa87-31e7eb6f738e req-3519289c-c01c-4f0c-bb12-5c77e207bee6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:08.225177 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4d4cb698-cdcd-4d35-aa87-31e7eb6f738e req-3519289c-c01c-4f0c-bb12-5c77e207bee6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:08.246450 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-4d4cb698-cdcd-4d35-aa87-31e7eb6f738e req-3519289c-c01c-4f0c-bb12-5c77e207bee6 service nova] Creating event network-changed:f44afbfe-d144-4d60-9452-f86f341f60d8 for instance 3765cbca-99e6-4596-9b57-c846ac289dd8 on n-h1-849328-3 Aug 24 10:22:08.253038 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-4d4cb698-cdcd-4d35-aa87-31e7eb6f738e req-3519289c-c01c-4f0c-bb12-5c77e207bee6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113947 Aug 24 10:22:08.270334 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1038/2343] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:08.282006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8af8d2a9-77b5-455a-8922-1c86ab96190b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1797686735", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "b9b1dd8f-cc6a-49a1-92cf-dcff737a21ea"}, {"uuid": "e5ec7143-9510-4202-bd64-17858ebbac00"}, {"uuid": "b9b1dd8f-cc6a-49a1-92cf-dcff737a21ea"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:08.295748 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1d3e6a58-747d-4e7a-8e37-40f62b9e5598 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.574356 Aug 24 10:22:08.296513 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1306/2344] 10.222.0.85 () {58 vars in 1150 bytes} [Wed Aug 24 10:22:07 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:08.302368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-83b55e26-dfd9-431b-8a0b-c841ae4887a6 req-e64292b9-d363-49c7-af13-8fd3d91cc3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3765cbca-99e6-4596-9b57-c846ac289dd8", "name": "network-vif-plugged", "status": "completed", "tag": "f44afbfe-d144-4d60-9452-f86f341f60d8"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:08.319118 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-83b55e26-dfd9-431b-8a0b-c841ae4887a6 req-e64292b9-d363-49c7-af13-8fd3d91cc3f4 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:08.319740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-83b55e26-dfd9-431b-8a0b-c841ae4887a6 req-e64292b9-d363-49c7-af13-8fd3d91cc3f4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:08.320487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-83b55e26-dfd9-431b-8a0b-c841ae4887a6 req-e64292b9-d363-49c7-af13-8fd3d91cc3f4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:08.349801 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-83b55e26-dfd9-431b-8a0b-c841ae4887a6 req-e64292b9-d363-49c7-af13-8fd3d91cc3f4 service nova] Creating event network-vif-plugged:f44afbfe-d144-4d60-9452-f86f341f60d8 for instance 3765cbca-99e6-4596-9b57-c846ac289dd8 on n-h1-849328-3 Aug 24 10:22:08.356353 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-83b55e26-dfd9-431b-8a0b-c841ae4887a6 req-e64292b9-d363-49c7-af13-8fd3d91cc3f4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058096 Aug 24 10:22:08.357850 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1307/2345] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:08.367690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9c3212f0-189d-49c0-977b-d05f43e9acaf tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:08.368842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9c3212f0-189d-49c0-977b-d05f43e9acaf tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 36aa270e-6a92-4d10-8b11-9bb3ce5595a8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:08.443853 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-8af8d2a9-77b5-455a-8922-1c86ab96190b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] validate_networks() for [('b9b1dd8f-cc6a-49a1-92cf-dcff737a21ea', None, None, None, None, None), ('e5ec7143-9510-4202-bd64-17858ebbac00', None, None, None, None, None), ('b9b1dd8f-cc6a-49a1-92cf-dcff737a21ea', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:22:08.508382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9c3212f0-189d-49c0-977b-d05f43e9acaf tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:08.522787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9c3212f0-189d-49c0-977b-d05f43e9acaf tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:08.530294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9c3212f0-189d-49c0-977b-d05f43e9acaf tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:08.531795 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9c3212f0-189d-49c0-977b-d05f43e9acaf tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/36aa270e-6a92-4d10-8b11-9bb3ce5595a8" status: 200 len: 1278 microversion: 2.47 time: 0.172352 Aug 24 10:22:08.532647 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1308/2346] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:08 2022] GET /compute/v2.1/servers/36aa270e-6a92-4d10-8b11-9bb3ce5595a8 => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:08.537551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dedd32f5-752d-49b3-89cc-2f2fb43f8912 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:08.586344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dedd32f5-752d-49b3-89cc-2f2fb43f8912 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:08.587152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dedd32f5-752d-49b3-89cc-2f2fb43f8912 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:22:08.609975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dedd32f5-752d-49b3-89cc-2f2fb43f8912 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:08.620298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dedd32f5-752d-49b3-89cc-2f2fb43f8912 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:08.621067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dedd32f5-752d-49b3-89cc-2f2fb43f8912 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:08.622136 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dedd32f5-752d-49b3-89cc-2f2fb43f8912 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:08.623642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dedd32f5-752d-49b3-89cc-2f2fb43f8912 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:08.624326 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dedd32f5-752d-49b3-89cc-2f2fb43f8912 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:08.783116 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-dedd32f5-752d-49b3-89cc-2f2fb43f8912 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:22:08.880540 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dedd32f5-752d-49b3-89cc-2f2fb43f8912 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.345665 Aug 24 10:22:08.890027 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1309/2347] 10.222.0.85 () {58 vars in 1212 bytes} [Wed Aug 24 10:22:08 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:08.898260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-470bce1d-7e0b-4e35-95c3-3d3d63ac3c36 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4654167310>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:08.999559 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-470bce1d-7e0b-4e35-95c3-3d3d63ac3c36 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/d81b1bef-ab64-4f84-bf62-d539dd7cb14d" status: 200 len: 1464 microversion: 2.1 time: 0.107991 Aug 24 10:22:09.005496 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1310/2348] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:22:08 2022] GET /compute/v2.1/images/d81b1bef-ab64-4f84-bf62-d539dd7cb14d => generated 1464 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:09.012324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b5506d8b-9ffe-44ac-8e39-705ad245df29 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-377113528", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": "none"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:09.169783 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b5506d8b-9ffe-44ac-8e39-705ad245df29 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:22:09.174372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b5506d8b-9ffe-44ac-8e39-705ad245df29 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:22:09.175498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b5506d8b-9ffe-44ac-8e39-705ad245df29 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:22:09.176167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b5506d8b-9ffe-44ac-8e39-705ad245df29 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:22:09.176623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b5506d8b-9ffe-44ac-8e39-705ad245df29 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:22:09.190325 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5506d8b-9ffe-44ac-8e39-705ad245df29 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:09.191392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5506d8b-9ffe-44ac-8e39-705ad245df29 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:09.192055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5506d8b-9ffe-44ac-8e39-705ad245df29 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:09.194136 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5506d8b-9ffe-44ac-8e39-705ad245df29 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:09.194943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5506d8b-9ffe-44ac-8e39-705ad245df29 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:09.195570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5506d8b-9ffe-44ac-8e39-705ad245df29 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:09.218477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b5506d8b-9ffe-44ac-8e39-705ad245df29 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Getting quotas for project bcb5c4e7e532413685ae86f24d86751b. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:22:09.229162 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b5506d8b-9ffe-44ac-8e39-705ad245df29 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Getting quotas for user 6d0112a16f86400289bfc60258957aaa and project bcb5c4e7e532413685ae86f24d86751b. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:22:09.262059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b5506d8b-9ffe-44ac-8e39-705ad245df29 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:22:09.265198 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b5506d8b-9ffe-44ac-8e39-705ad245df29 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:22:09.379397 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b5506d8b-9ffe-44ac-8e39-705ad245df29 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.371190 Aug 24 10:22:09.381281 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1311/2349] 10.222.0.85 () {62 vars in 1188 bytes} [Wed Aug 24 10:22:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 375 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 10:22:09.394747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-41883aee-cf58-40f6-a466-83aae7303722 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:09.395868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-41883aee-cf58-40f6-a466-83aae7303722 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:09.426310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41883aee-cf58-40f6-a466-83aae7303722 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:09.426829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41883aee-cf58-40f6-a466-83aae7303722 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:09.427340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41883aee-cf58-40f6-a466-83aae7303722 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:09.428087 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41883aee-cf58-40f6-a466-83aae7303722 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:09.428549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41883aee-cf58-40f6-a466-83aae7303722 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:09.428974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41883aee-cf58-40f6-a466-83aae7303722 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:09.628963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-41883aee-cf58-40f6-a466-83aae7303722 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:09.646703 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-41883aee-cf58-40f6-a466-83aae7303722 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1391 microversion: 2.1 time: 0.261269 Aug 24 10:22:09.650162 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1312/2350] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:09 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1391 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:09.656382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c3bd9b0d-1666-4022-b27d-8e652bef1c2f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:09.668545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c3bd9b0d-1666-4022-b27d-8e652bef1c2f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:09.669608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c3bd9b0d-1666-4022-b27d-8e652bef1c2f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:22:09.687031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3bd9b0d-1666-4022-b27d-8e652bef1c2f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:09.687835 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3bd9b0d-1666-4022-b27d-8e652bef1c2f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:09.688273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3bd9b0d-1666-4022-b27d-8e652bef1c2f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:09.689863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3bd9b0d-1666-4022-b27d-8e652bef1c2f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:09.690516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3bd9b0d-1666-4022-b27d-8e652bef1c2f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:09.691084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3bd9b0d-1666-4022-b27d-8e652bef1c2f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:10.220481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-c3bd9b0d-1666-4022-b27d-8e652bef1c2f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:22:10.299421 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c3bd9b0d-1666-4022-b27d-8e652bef1c2f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.647283 Aug 24 10:22:10.300329 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1313/2351] 10.222.0.85 () {58 vars in 1196 bytes} [Wed Aug 24 10:22:09 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:10.306086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2fa7ebfd-5ff6-4640-bed6-63147d61cdc8 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f465414f940>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:10.399829 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2fa7ebfd-5ff6-4640-bed6-63147d61cdc8 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/d81b1bef-ab64-4f84-bf62-d539dd7cb14d" status: 200 len: 1464 microversion: 2.1 time: 0.097745 Aug 24 10:22:10.405793 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1314/2352] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:22:10 2022] GET /compute/v2.1/images/d81b1bef-ab64-4f84-bf62-d539dd7cb14d => generated 1464 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:10.420247 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c44feb8b-27a9-4873-88dc-99c61e736202 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:10.422182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c44feb8b-27a9-4873-88dc-99c61e736202 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] [instance: 3765cbca-99e6-4596-9b57-c846ac289dd8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:10.448991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c44feb8b-27a9-4873-88dc-99c61e736202 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:10.449541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c44feb8b-27a9-4873-88dc-99c61e736202 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:10.450040 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c44feb8b-27a9-4873-88dc-99c61e736202 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:10.453507 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c44feb8b-27a9-4873-88dc-99c61e736202 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:10.453996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c44feb8b-27a9-4873-88dc-99c61e736202 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:10.456405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c44feb8b-27a9-4873-88dc-99c61e736202 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:10.766953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c44feb8b-27a9-4873-88dc-99c61e736202 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40868a3ee54348379b95ac9902d2fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f51d9eede462186be9ba212b4b18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:10.781330 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c44feb8b-27a9-4873-88dc-99c61e736202 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] 10.222.0.85 "GET /compute/v2.1/servers/3765cbca-99e6-4596-9b57-c846ac289dd8" status: 200 len: 1472 microversion: 2.1 time: 0.376679 Aug 24 10:22:10.799358 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1315/2353] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:10 2022] GET /compute/v2.1/servers/3765cbca-99e6-4596-9b57-c846ac289dd8 => generated 1472 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:10.815480 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c7fa9eb7-52d3-40ee-bc13-dc5f83cdd5b9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:10.821754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c7fa9eb7-52d3-40ee-bc13-dc5f83cdd5b9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:10.840247 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7fa9eb7-52d3-40ee-bc13-dc5f83cdd5b9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:10.840933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7fa9eb7-52d3-40ee-bc13-dc5f83cdd5b9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:10.841483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7fa9eb7-52d3-40ee-bc13-dc5f83cdd5b9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:10.842286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7fa9eb7-52d3-40ee-bc13-dc5f83cdd5b9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:10.842743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7fa9eb7-52d3-40ee-bc13-dc5f83cdd5b9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:10.843170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7fa9eb7-52d3-40ee-bc13-dc5f83cdd5b9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:10.928242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8af8d2a9-77b5-455a-8922-1c86ab96190b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:22:10.929277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8af8d2a9-77b5-455a-8922-1c86ab96190b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:22:10.929907 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8af8d2a9-77b5-455a-8922-1c86ab96190b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:22:10.930467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8af8d2a9-77b5-455a-8922-1c86ab96190b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:22:10.931032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8af8d2a9-77b5-455a-8922-1c86ab96190b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:22:10.934933 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c7fa9eb7-52d3-40ee-bc13-dc5f83cdd5b9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "PUT /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 991 microversion: 2.47 time: 0.132976 Aug 24 10:22:10.935944 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1316/2354] 10.222.0.85 () {62 vars in 1297 bytes} [Wed Aug 24 10:22:10 2022] PUT /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 991 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:22:10.941396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a09e9fc0-cf80-4099-8422-979bbcbc8078 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:10.944428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8af8d2a9-77b5-455a-8922-1c86ab96190b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:10.945096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8af8d2a9-77b5-455a-8922-1c86ab96190b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:10.945716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8af8d2a9-77b5-455a-8922-1c86ab96190b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:10.946633 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8af8d2a9-77b5-455a-8922-1c86ab96190b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:10.947240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8af8d2a9-77b5-455a-8922-1c86ab96190b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:10.947817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8af8d2a9-77b5-455a-8922-1c86ab96190b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:10.947932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a09e9fc0-cf80-4099-8422-979bbcbc8078 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:10.948691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a09e9fc0-cf80-4099-8422-979bbcbc8078 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Searching by: {'name': '-379132465', 'deleted': False, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:22:10.956013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a09e9fc0-cf80-4099-8422-979bbcbc8078 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:10.956777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a09e9fc0-cf80-4099-8422-979bbcbc8078 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:10.957762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a09e9fc0-cf80-4099-8422-979bbcbc8078 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:10.958821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a09e9fc0-cf80-4099-8422-979bbcbc8078 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:10.959561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a09e9fc0-cf80-4099-8422-979bbcbc8078 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:10.960307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a09e9fc0-cf80-4099-8422-979bbcbc8078 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:10.975088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-8af8d2a9-77b5-455a-8922-1c86ab96190b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Getting quotas for project e861e247176c4ebda68404fe30c2b561. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:22:10.981346 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-8af8d2a9-77b5-455a-8922-1c86ab96190b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Getting quotas for user 6878521252244be0a32ab2f056ec54c9 and project e861e247176c4ebda68404fe30c2b561. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:22:11.026016 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8af8d2a9-77b5-455a-8922-1c86ab96190b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:22:11.028832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8af8d2a9-77b5-455a-8922-1c86ab96190b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:22:11.130545 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8af8d2a9-77b5-455a-8922-1c86ab96190b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.857135 Aug 24 10:22:11.131227 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1039/2355] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:22:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:22:11.146375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-05afe474-3198-4a83-b33d-44c5d8ed2cdf tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:11.148632 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-05afe474-3198-4a83-b33d-44c5d8ed2cdf tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:11.166802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05afe474-3198-4a83-b33d-44c5d8ed2cdf tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:11.167234 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05afe474-3198-4a83-b33d-44c5d8ed2cdf tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:11.167821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05afe474-3198-4a83-b33d-44c5d8ed2cdf tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:11.172268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-a09e9fc0-cf80-4099-8422-979bbcbc8078 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:22:11.181407 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05afe474-3198-4a83-b33d-44c5d8ed2cdf tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:11.182072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05afe474-3198-4a83-b33d-44c5d8ed2cdf tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:11.182570 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05afe474-3198-4a83-b33d-44c5d8ed2cdf tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:11.319688 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a09e9fc0-cf80-4099-8422-979bbcbc8078 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers?name=-379132465" status: 200 len: 345 microversion: 2.1 time: 0.382554 Aug 24 10:22:11.329501 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1317/2356] 10.222.0.85 () {58 vars in 1156 bytes} [Wed Aug 24 10:22:10 2022] GET /compute/v2.1/servers?name=-379132465 => generated 345 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:11.341830 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-18206cae-fd3c-43fb-a856-b887914b4107 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:11.342850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-18206cae-fd3c-43fb-a856-b887914b4107 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:11.359125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18206cae-fd3c-43fb-a856-b887914b4107 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:11.359612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18206cae-fd3c-43fb-a856-b887914b4107 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:11.360059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18206cae-fd3c-43fb-a856-b887914b4107 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:11.363308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18206cae-fd3c-43fb-a856-b887914b4107 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:11.363781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18206cae-fd3c-43fb-a856-b887914b4107 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:11.364221 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18206cae-fd3c-43fb-a856-b887914b4107 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:11.507180 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-05afe474-3198-4a83-b33d-44c5d8ed2cdf tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:11.546226 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-05afe474-3198-4a83-b33d-44c5d8ed2cdf tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb" status: 200 len: 1468 microversion: 2.1 time: 0.406768 Aug 24 10:22:11.552565 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1040/2357] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:11 2022] GET /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb => generated 1468 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:11.574144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e3c01423-157a-4740-8fb9-1cb99517505b tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:11.576052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e3c01423-157a-4740-8fb9-1cb99517505b tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] [instance: 3765cbca-99e6-4596-9b57-c846ac289dd8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:11.607801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3c01423-157a-4740-8fb9-1cb99517505b tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:11.610325 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3c01423-157a-4740-8fb9-1cb99517505b tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:11.611103 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3c01423-157a-4740-8fb9-1cb99517505b tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:11.613639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3c01423-157a-4740-8fb9-1cb99517505b tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:11.615408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3c01423-157a-4740-8fb9-1cb99517505b tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:11.616182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3c01423-157a-4740-8fb9-1cb99517505b tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:11.685670 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e3c01423-157a-4740-8fb9-1cb99517505b tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '40868a3ee54348379b95ac9902d2fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f51d9eede462186be9ba212b4b18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e3c01423-157a-4740-8fb9-1cb99517505b tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Request method failure captured: Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/3765cbca-99e6-4596-9b57-c846ac289dd8/diagnostics HTTP/1.1 Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfu0FDMJdrjgRpgtW3MICFjxd_SXEa5CuPLMEvW-K-TEfGguaUClGD0EaEvFtj0alOBoXsFdVoPBhy2DnJZY7wvC7S1cdHc3kNJnkOYq3bEHPG8SirkiiUEIfCFgoC5WwwxhRyoMuinHBUOzEdvW3OfHx0uMajQCN9iIuCQ_E2QAjKc Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 9f9f51d9eede462186be9ba212b4b18d Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-539675815 Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9f9f51d9eede462186be9ba212b4b18d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9f9f51d9eede462186be9ba212b4b18d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9f9f51d9eede462186be9ba212b4b18d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9f9f51d9eede462186be9ba212b4b18d"}]}] Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-539675815 Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 9f9f51d9eede462186be9ba212b4b18d Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-539675815 Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerDiagnosticsNegativeTest-539675815-project Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 40868a3ee54348379b95ac9902d2fb22 Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-539675815-project Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'server_id': '3765cbca-99e6-4596-9b57-c846ac289dd8'} Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:22:11.698851 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:11.703930 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:11.703930 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:11.703930 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:22:11.703930 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:22:11.703930 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 24 10:22:11.703930 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:22:11.706855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e3c01423-157a-4740-8fb9-1cb99517505b tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:22:11.708980 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e3c01423-157a-4740-8fb9-1cb99517505b tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] 10.222.0.85 "GET /compute/v2.1/servers/3765cbca-99e6-4596-9b57-c846ac289dd8/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.154304 Aug 24 10:22:11.715592 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1041/2358] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:22:11 2022] GET /compute/v2.1/servers/3765cbca-99e6-4596-9b57-c846ac289dd8/diagnostics => generated 117 bytes in 162 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:22:11.721960 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1cce555c-9640-4184-9e8d-abfd45652122 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:11.723142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1cce555c-9640-4184-9e8d-abfd45652122 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:11.730870 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cce555c-9640-4184-9e8d-abfd45652122 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:11.731952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cce555c-9640-4184-9e8d-abfd45652122 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:11.732732 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cce555c-9640-4184-9e8d-abfd45652122 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:11.733711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cce555c-9640-4184-9e8d-abfd45652122 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:11.734353 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cce555c-9640-4184-9e8d-abfd45652122 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:11.734966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cce555c-9640-4184-9e8d-abfd45652122 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:11.832151 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-18206cae-fd3c-43fb-a856-b887914b4107 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:11.835917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1cce555c-9640-4184-9e8d-abfd45652122 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:11.846385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1cce555c-9640-4184-9e8d-abfd45652122 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:11.848227 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1cce555c-9640-4184-9e8d-abfd45652122 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:11.849901 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1cce555c-9640-4184-9e8d-abfd45652122 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1337 microversion: 2.47 time: 0.132588 Aug 24 10:22:11.850833 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1042/2359] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:11 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1337 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:11.855582 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-18206cae-fd3c-43fb-a856-b887914b4107 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1391 microversion: 2.1 time: 0.524666 Aug 24 10:22:11.856198 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1318/2360] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:11 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1391 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:11.857021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-212b8d34-1db2-4f3a-bef3-4e99f1449e82 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:11.858044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-212b8d34-1db2-4f3a-bef3-4e99f1449e82 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:11.861074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0b8047a6-dc80-4bdf-b322-efbafbf86ac4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:11.867822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0b8047a6-dc80-4bdf-b322-efbafbf86ac4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:11.880859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0b8047a6-dc80-4bdf-b322-efbafbf86ac4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:22:11.901694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b8047a6-dc80-4bdf-b322-efbafbf86ac4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:11.902384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b8047a6-dc80-4bdf-b322-efbafbf86ac4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:11.902986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b8047a6-dc80-4bdf-b322-efbafbf86ac4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:11.907978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b8047a6-dc80-4bdf-b322-efbafbf86ac4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:11.908507 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b8047a6-dc80-4bdf-b322-efbafbf86ac4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:11.910783 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b8047a6-dc80-4bdf-b322-efbafbf86ac4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:11.995613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-212b8d34-1db2-4f3a-bef3-4e99f1449e82 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:12.005672 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-212b8d34-1db2-4f3a-bef3-4e99f1449e82 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1213 microversion: 2.1 time: 0.153307 Aug 24 10:22:12.019361 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1043/2361] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:11 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1213 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:12.076698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-0b8047a6-dc80-4bdf-b322-efbafbf86ac4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:22:12.113711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-130bc884-8e85-46e4-a56d-9878d9163aad req-9a6b9f13-2ce7-4ade-9fa8-8165a9036672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c66c18-c34f-4916-aca3-da0ca33f9ba5", "name": "network-vif-unplugged", "status": "completed", "tag": "7b95f9a5-8709-4c1d-8f96-0d1c5094bcb8"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:12.138564 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-130bc884-8e85-46e4-a56d-9878d9163aad req-9a6b9f13-2ce7-4ade-9fa8-8165a9036672 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:12.139426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-130bc884-8e85-46e4-a56d-9878d9163aad req-9a6b9f13-2ce7-4ade-9fa8-8165a9036672 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:12.140052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-130bc884-8e85-46e4-a56d-9878d9163aad req-9a6b9f13-2ce7-4ade-9fa8-8165a9036672 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:12.153466 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-130bc884-8e85-46e4-a56d-9878d9163aad req-9a6b9f13-2ce7-4ade-9fa8-8165a9036672 service nova] Creating event network-vif-unplugged:7b95f9a5-8709-4c1d-8f96-0d1c5094bcb8 for instance 70c66c18-c34f-4916-aca3-da0ca33f9ba5 on n-h1-849328-3 Aug 24 10:22:12.159931 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-130bc884-8e85-46e4-a56d-9878d9163aad req-9a6b9f13-2ce7-4ade-9fa8-8165a9036672 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.140549 Aug 24 10:22:12.161187 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1044/2362] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:12.167127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d39a4c80-d629-4839-a878-2e02b9f582f6 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f46550e5040>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:12.189344 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0b8047a6-dc80-4bdf-b322-efbafbf86ac4 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.331778 Aug 24 10:22:12.190330 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1319/2363] 10.222.0.85 () {58 vars in 1154 bytes} [Wed Aug 24 10:22:11 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:12.199130 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ba47ee63-10cc-4ef7-9926-2850f2e294c0 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:12.200278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ba47ee63-10cc-4ef7-9926-2850f2e294c0 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] [instance: 3765cbca-99e6-4596-9b57-c846ac289dd8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:12.209611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba47ee63-10cc-4ef7-9926-2850f2e294c0 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:12.211029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba47ee63-10cc-4ef7-9926-2850f2e294c0 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:12.212185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba47ee63-10cc-4ef7-9926-2850f2e294c0 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:12.212522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba47ee63-10cc-4ef7-9926-2850f2e294c0 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:12.213756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba47ee63-10cc-4ef7-9926-2850f2e294c0 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:12.214300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba47ee63-10cc-4ef7-9926-2850f2e294c0 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:12.275490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ba47ee63-10cc-4ef7-9926-2850f2e294c0 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] [instance: 3765cbca-99e6-4596-9b57-c846ac289dd8] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:22:12.336837 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d39a4c80-d629-4839-a878-2e02b9f582f6 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images?changes-since=2022-08-24T10%3A19%3A39Z" status: 200 len: 2801 microversion: 2.1 time: 0.173316 Aug 24 10:22:12.348299 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1045/2364] 10.222.0.85 () {58 vars in 1199 bytes} [Wed Aug 24 10:22:12 2022] GET /compute/v2.1/images?changes-since=2022-08-24T10%3A19%3A39Z => generated 2801 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:12.356879 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-57f9a4dc-d8ed-4337-a36c-2d484aa32146 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:12.366167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-57f9a4dc-d8ed-4337-a36c-2d484aa32146 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:12.367561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-57f9a4dc-d8ed-4337-a36c-2d484aa32146 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-37913246', 'deleted': False, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:22:12.376345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57f9a4dc-d8ed-4337-a36c-2d484aa32146 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:12.377176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57f9a4dc-d8ed-4337-a36c-2d484aa32146 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:12.378103 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57f9a4dc-d8ed-4337-a36c-2d484aa32146 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:12.380075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57f9a4dc-d8ed-4337-a36c-2d484aa32146 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:12.380804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57f9a4dc-d8ed-4337-a36c-2d484aa32146 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:12.382135 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57f9a4dc-d8ed-4337-a36c-2d484aa32146 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:12.437105 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ba47ee63-10cc-4ef7-9926-2850f2e294c0 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] 10.222.0.85 "DELETE /compute/v2.1/servers/3765cbca-99e6-4596-9b57-c846ac289dd8" status: 204 len: 0 microversion: 2.1 time: 0.243882 Aug 24 10:22:12.439420 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1320/2365] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:22:12 2022] DELETE /compute/v2.1/servers/3765cbca-99e6-4596-9b57-c846ac289dd8 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:22:12.502385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-57f9a4dc-d8ed-4337-a36c-2d484aa32146 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:22:12.593414 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-57f9a4dc-d8ed-4337-a36c-2d484aa32146 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-37913246" status: 200 len: 345 microversion: 2.1 time: 0.240696 Aug 24 10:22:12.594346 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1046/2366] 10.222.0.85 () {58 vars in 1226 bytes} [Wed Aug 24 10:22:12 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-37913246 => generated 345 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:12.601820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4d2bcca0-8c15-4470-9274-2e790a7496bd tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f46550e5dc0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:12.618084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a9a4c940-c940-4d2d-88c2-c6d9809061dd tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Action: 'create', calling method: .version_select at 0x7f4654716a60>, body: {"keypair": {"name": "tempest-keypair-860357472", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLe9J3bW/3DxhK0PTbFQ5kR5INEJbyM7z5yjL5sKrDrqyyQ0ZOB+hsFb1AkNr4xKf2ZItKdzaN8U1dtLzJImoCITAl9dOnHjgAPL9o7fQ5LvrI1y983+DTUYuxhOSKferg=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:12.635343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-a9a4c940-c940-4d2d-88c2-c6d9809061dd tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Getting quotas for project 1d5264f4afb64ba9927050b9b94d37a8. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:22:12.643003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-a9a4c940-c940-4d2d-88c2-c6d9809061dd tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Getting quotas for user 3d264ad8190a4cd9be236d05564fe1a2 and project 1d5264f4afb64ba9927050b9b94d37a8. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:22:12.675122 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a9a4c940-c940-4d2d-88c2-c6d9809061dd tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.233897 Aug 24 10:22:12.676396 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1321/2367] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:22:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:12.682845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-af81b223-d8c5-4c97-9a57-7f8fd0ba1ea6 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:12.683497 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-af81b223-d8c5-4c97-9a57-7f8fd0ba1ea6 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] [instance: 3765cbca-99e6-4596-9b57-c846ac289dd8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:12.695144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af81b223-d8c5-4c97-9a57-7f8fd0ba1ea6 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:12.696243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af81b223-d8c5-4c97-9a57-7f8fd0ba1ea6 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:12.697241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af81b223-d8c5-4c97-9a57-7f8fd0ba1ea6 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:12.699248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af81b223-d8c5-4c97-9a57-7f8fd0ba1ea6 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:12.700527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af81b223-d8c5-4c97-9a57-7f8fd0ba1ea6 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:12.701610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af81b223-d8c5-4c97-9a57-7f8fd0ba1ea6 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:12.705003 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4d2bcca0-8c15-4470-9274-2e790a7496bd tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1155855310" status: 200 len: 485 microversion: 2.1 time: 0.108950 Aug 24 10:22:12.711173 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1047/2368] 10.222.0.85 () {58 vars in 1231 bytes} [Wed Aug 24 10:22:12 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1155855310 => generated 485 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:12.718843 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-052f2000-c27a-4524-83d3-b741265fe5fe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:12.719663 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-052f2000-c27a-4524-83d3-b741265fe5fe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: b47ddbf3-ca84-419b-ae08-916fb959be5c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:12.726310 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-052f2000-c27a-4524-83d3-b741265fe5fe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:12.726833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-052f2000-c27a-4524-83d3-b741265fe5fe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:12.727280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-052f2000-c27a-4524-83d3-b741265fe5fe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:12.728008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-052f2000-c27a-4524-83d3-b741265fe5fe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:12.729353 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-052f2000-c27a-4524-83d3-b741265fe5fe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:12.729772 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-052f2000-c27a-4524-83d3-b741265fe5fe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:12.768497 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-052f2000-c27a-4524-83d3-b741265fe5fe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: b47ddbf3-ca84-419b-ae08-916fb959be5c] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:22:12.930126 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-af81b223-d8c5-4c97-9a57-7f8fd0ba1ea6 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40868a3ee54348379b95ac9902d2fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f51d9eede462186be9ba212b4b18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:12.930986 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-052f2000-c27a-4524-83d3-b741265fe5fe tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c" status: 204 len: 0 microversion: 2.1 time: 0.217595 Aug 24 10:22:12.931151 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1048/2369] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:22:12 2022] DELETE /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:22:12.938295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8d783bf7-04fa-4951-b100-8ee1f2dbcaa5 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4655630700>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:12.950904 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-af81b223-d8c5-4c97-9a57-7f8fd0ba1ea6 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] 10.222.0.85 "GET /compute/v2.1/servers/3765cbca-99e6-4596-9b57-c846ac289dd8" status: 200 len: 1478 microversion: 2.1 time: 0.271376 Aug 24 10:22:12.952731 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1322/2370] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:12 2022] GET /compute/v2.1/servers/3765cbca-99e6-4596-9b57-c846ac289dd8 => generated 1478 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:12.959810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-750b5ac8-0ee8-48a3-a7e6-5bc878630693 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:12.960431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-750b5ac8-0ee8-48a3-a7e6-5bc878630693 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:12.968178 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-750b5ac8-0ee8-48a3-a7e6-5bc878630693 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:12.968676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-750b5ac8-0ee8-48a3-a7e6-5bc878630693 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:12.969108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-750b5ac8-0ee8-48a3-a7e6-5bc878630693 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:12.969952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-750b5ac8-0ee8-48a3-a7e6-5bc878630693 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:12.970691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-750b5ac8-0ee8-48a3-a7e6-5bc878630693 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:12.971423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-750b5ac8-0ee8-48a3-a7e6-5bc878630693 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:13.075616 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8d783bf7-04fa-4951-b100-8ee1f2dbcaa5 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images?server=fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb" status: 200 len: 958 microversion: 2.1 time: 0.142898 Aug 24 10:22:13.082354 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1049/2371] 10.222.0.85 () {58 vars in 1209 bytes} [Wed Aug 24 10:22:12 2022] GET /compute/v2.1/images?server=fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb => generated 958 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:13.087490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-750b5ac8-0ee8-48a3-a7e6-5bc878630693 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:13.090622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c5e23fa9-dd07-42d3-a2ed-6df9f4f57c63 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:13.092186 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c5e23fa9-dd07-42d3-a2ed-6df9f4f57c63 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:13.094958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:13.098575 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-750b5ac8-0ee8-48a3-a7e6-5bc878630693 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:13.100690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-750b5ac8-0ee8-48a3-a7e6-5bc878630693 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:13.102364 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-750b5ac8-0ee8-48a3-a7e6-5bc878630693 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1337 microversion: 2.47 time: 0.147655 Aug 24 10:22:13.103487 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1323/2372] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:12 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1337 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:13.105356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5e23fa9-dd07-42d3-a2ed-6df9f4f57c63 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:13.106229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5e23fa9-dd07-42d3-a2ed-6df9f4f57c63 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:13.106842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5e23fa9-dd07-42d3-a2ed-6df9f4f57c63 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:13.108027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5e23fa9-dd07-42d3-a2ed-6df9f4f57c63 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:13.108552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5e23fa9-dd07-42d3-a2ed-6df9f4f57c63 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:13.108988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5e23fa9-dd07-42d3-a2ed-6df9f4f57c63 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:13.109105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-912d080a-5d48-4bff-98eb-0cff9bc13c89 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:13.109832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-912d080a-5d48-4bff-98eb-0cff9bc13c89 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: b47ddbf3-ca84-419b-ae08-916fb959be5c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:13.117448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-912d080a-5d48-4bff-98eb-0cff9bc13c89 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:13.118247 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-912d080a-5d48-4bff-98eb-0cff9bc13c89 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:13.118889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-912d080a-5d48-4bff-98eb-0cff9bc13c89 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:13.119788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-912d080a-5d48-4bff-98eb-0cff9bc13c89 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:13.120454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-912d080a-5d48-4bff-98eb-0cff9bc13c89 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:13.121077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-912d080a-5d48-4bff-98eb-0cff9bc13c89 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:13.331543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c5e23fa9-dd07-42d3-a2ed-6df9f4f57c63 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:13.345057 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c5e23fa9-dd07-42d3-a2ed-6df9f4f57c63 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1391 microversion: 2.1 time: 0.260248 Aug 24 10:22:13.346026 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1050/2373] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:13 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1391 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:13.353785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5b6c0d25-d2d4-4e1c-937a-da4442bfb448 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:13.354858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5b6c0d25-d2d4-4e1c-937a-da4442bfb448 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:13.362793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b6c0d25-d2d4-4e1c-937a-da4442bfb448 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:13.363291 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b6c0d25-d2d4-4e1c-937a-da4442bfb448 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:13.363719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b6c0d25-d2d4-4e1c-937a-da4442bfb448 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:13.364466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b6c0d25-d2d4-4e1c-937a-da4442bfb448 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:13.365208 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b6c0d25-d2d4-4e1c-937a-da4442bfb448 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:13.365357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b6c0d25-d2d4-4e1c-937a-da4442bfb448 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:13.377881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-912d080a-5d48-4bff-98eb-0cff9bc13c89 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:13.392412 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-912d080a-5d48-4bff-98eb-0cff9bc13c89 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c" status: 200 len: 1517 microversion: 2.1 time: 0.287070 Aug 24 10:22:13.394353 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1324/2374] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:13 2022] GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c => generated 1517 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:13.433154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1388adec-e86f-4c5a-9a58-aaaa1f293918 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f46541c0c10>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:13.481918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5b6c0d25-d2d4-4e1c-937a-da4442bfb448 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:13.516793 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5b6c0d25-d2d4-4e1c-937a-da4442bfb448 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1265 microversion: 2.1 time: 0.158884 Aug 24 10:22:13.516793 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1051/2375] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:13 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:13.517542 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1388adec-e86f-4c5a-9a58-aaaa1f293918 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.85%2Fcompute%2Fv2.1%2Fservers%2F8a4ddf34-af18-4e02-a306-c1c67f5c0b28" status: 200 len: 484 microversion: 2.1 time: 0.106850 Aug 24 10:22:13.527386 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1325/2376] 10.222.0.85 () {58 vars in 1317 bytes} [Wed Aug 24 10:22:13 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.85%2Fcompute%2Fv2.1%2Fservers%2F8a4ddf34-af18-4e02-a306-c1c67f5c0b28 => generated 484 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:13.534097 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f5352ca7-fd38-4b56-98b4-d98a65cb84a7 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4655074160>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:13.559273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-4785b213-26e2-43a4-8131-d752e3592f40 req-a78e9f2f-6e6f-48ec-9101-623da8c3c109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb", "name": "network-vif-unplugged", "status": "completed", "tag": "c181228f-fe7e-4a76-bb5e-18f9995613d1"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:13.574629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4785b213-26e2-43a4-8131-d752e3592f40 req-a78e9f2f-6e6f-48ec-9101-623da8c3c109 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:13.575123 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4785b213-26e2-43a4-8131-d752e3592f40 req-a78e9f2f-6e6f-48ec-9101-623da8c3c109 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:13.575557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4785b213-26e2-43a4-8131-d752e3592f40 req-a78e9f2f-6e6f-48ec-9101-623da8c3c109 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:13.593660 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-4785b213-26e2-43a4-8131-d752e3592f40 req-a78e9f2f-6e6f-48ec-9101-623da8c3c109 service nova] Creating event network-vif-unplugged:c181228f-fe7e-4a76-bb5e-18f9995613d1 for instance fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb on n-h1-849328-3 Aug 24 10:22:13.603105 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f5352ca7-fd38-4b56-98b4-d98a65cb84a7 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.85%2Fcompute%2Fservers%2F8a4ddf34-af18-4e02-a306-c1c67f5c0b28" status: 200 len: 484 microversion: 2.1 time: 0.074069 Aug 24 10:22:13.603718 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1052/2377] 10.222.0.85 () {58 vars in 1303 bytes} [Wed Aug 24 10:22:13 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.85%2Fcompute%2Fservers%2F8a4ddf34-af18-4e02-a306-c1c67f5c0b28 => generated 484 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:13.617150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ea71a0b4-eee0-4426-bd68-a014e462c65b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f46552808b0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:13.625818 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-4785b213-26e2-43a4-8131-d752e3592f40 req-a78e9f2f-6e6f-48ec-9101-623da8c3c109 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066975 Aug 24 10:22:13.626852 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1326/2378] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:13.775993 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ea71a0b4-eee0-4426-bd68-a014e462c65b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3707 microversion: 2.1 time: 0.162144 Aug 24 10:22:13.777060 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1053/2379] 10.222.0.85 () {58 vars in 1149 bytes} [Wed Aug 24 10:22:13 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3707 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:13.799383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-52fbbe56-ba93-493f-9c3d-4a7356aa5d0a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4654f2b0d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:13.873959 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-52fbbe56-ba93-493f-9c3d-4a7356aa5d0a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.080100 Aug 24 10:22:13.874828 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1327/2380] 10.222.0.85 () {58 vars in 1149 bytes} [Wed Aug 24 10:22:13 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:13.891411 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9ed8af56-6d4c-4123-b954-d12e79dc2842 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f46550e1c10>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:13.975627 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9ed8af56-6d4c-4123-b954-d12e79dc2842 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images?limit=1" status: 200 len: 575 microversion: 2.1 time: 0.088655 Aug 24 10:22:13.976618 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1054/2381] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:22:13 2022] GET /compute/v2.1/images?limit=1 => generated 575 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:13.986470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9d5c8562-1464-4d63-bec9-561a372a47a0 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:13.987509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9d5c8562-1464-4d63-bec9-561a372a47a0 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] [instance: 3765cbca-99e6-4596-9b57-c846ac289dd8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:13.990754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-717c3e60-ef3a-43f2-8b75-2da417899548 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f46550548b0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:13.998366 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d5c8562-1464-4d63-bec9-561a372a47a0 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:13.998870 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d5c8562-1464-4d63-bec9-561a372a47a0 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:14.000159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d5c8562-1464-4d63-bec9-561a372a47a0 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:14.001633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d5c8562-1464-4d63-bec9-561a372a47a0 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:14.002420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d5c8562-1464-4d63-bec9-561a372a47a0 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:14.003171 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d5c8562-1464-4d63-bec9-561a372a47a0 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:14.124220 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-717c3e60-ef3a-43f2-8b75-2da417899548 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/detail?changes-since=2022-08-24T10%3A19%3A35Z" status: 200 len: 7022 microversion: 2.1 time: 0.137105 Aug 24 10:22:14.125006 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1055/2382] 10.222.0.85 () {58 vars in 1220 bytes} [Wed Aug 24 10:22:13 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-24T10%3A19%3A35Z => generated 7022 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:14.145342 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c901352b-1c69-4fe0-8f26-fc17734b9a28 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:14.147000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c901352b-1c69-4fe0-8f26-fc17734b9a28 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:14.161018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c901352b-1c69-4fe0-8f26-fc17734b9a28 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:14.163167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c901352b-1c69-4fe0-8f26-fc17734b9a28 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:14.163893 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c901352b-1c69-4fe0-8f26-fc17734b9a28 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:14.165219 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c901352b-1c69-4fe0-8f26-fc17734b9a28 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:14.167124 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c901352b-1c69-4fe0-8f26-fc17734b9a28 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:14.167841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c901352b-1c69-4fe0-8f26-fc17734b9a28 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:14.191709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9d5c8562-1464-4d63-bec9-561a372a47a0 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40868a3ee54348379b95ac9902d2fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f51d9eede462186be9ba212b4b18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:14.203052 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9d5c8562-1464-4d63-bec9-561a372a47a0 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] 10.222.0.85 "GET /compute/v2.1/servers/3765cbca-99e6-4596-9b57-c846ac289dd8" status: 200 len: 1478 microversion: 2.1 time: 0.221736 Aug 24 10:22:14.204159 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1328/2383] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:13 2022] GET /compute/v2.1/servers/3765cbca-99e6-4596-9b57-c846ac289dd8 => generated 1478 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:22:14.209707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ecaf723d-de2a-4ad7-94c8-7d5ea96136d0 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4654f2b280>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:14.281331 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ecaf723d-de2a-4ad7-94c8-7d5ea96136d0 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1155855310" status: 200 len: 665 microversion: 2.1 time: 0.075490 Aug 24 10:22:14.282793 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1329/2384] 10.222.0.85 () {58 vars in 1252 bytes} [Wed Aug 24 10:22:14 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1155855310 => generated 665 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:14.289845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0e0f6d16-ba12-451d-9867-b7bfca99b9cc req-35b826af-c466-4894-ab90-5953e4caedaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c66c18-c34f-4916-aca3-da0ca33f9ba5", "tag": "7b95f9a5-8709-4c1d-8f96-0d1c5094bcb8"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:14.296452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c901352b-1c69-4fe0-8f26-fc17734b9a28 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:14.306209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0e0f6d16-ba12-451d-9867-b7bfca99b9cc req-35b826af-c466-4894-ab90-5953e4caedaa service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:14.307060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0e0f6d16-ba12-451d-9867-b7bfca99b9cc req-35b826af-c466-4894-ab90-5953e4caedaa service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:14.307736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0e0f6d16-ba12-451d-9867-b7bfca99b9cc req-35b826af-c466-4894-ab90-5953e4caedaa service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:14.314372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c901352b-1c69-4fe0-8f26-fc17734b9a28 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:14.317516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c901352b-1c69-4fe0-8f26-fc17734b9a28 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:14.320625 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c901352b-1c69-4fe0-8f26-fc17734b9a28 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1347 microversion: 2.47 time: 0.185225 Aug 24 10:22:14.333151 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1056/2385] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:14 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1347 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:22:14.333359 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0e0f6d16-ba12-451d-9867-b7bfca99b9cc req-35b826af-c466-4894-ab90-5953e4caedaa service nova] Creating event network-changed:7b95f9a5-8709-4c1d-8f96-0d1c5094bcb8 for instance 70c66c18-c34f-4916-aca3-da0ca33f9ba5 on n-h1-849328-3 Aug 24 10:22:14.336442 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0e0f6d16-ba12-451d-9867-b7bfca99b9cc req-35b826af-c466-4894-ab90-5953e4caedaa service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051910 Aug 24 10:22:14.337813 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1330/2386] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:14.338887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0b1705c3-2f15-491d-af08-56b72cedb7ab tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4655212280>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:14.368568 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ff774235-30f2-4821-a23b-fad0cd57ccfe tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:14.369363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ff774235-30f2-4821-a23b-fad0cd57ccfe tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:14.380172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff774235-30f2-4821-a23b-fad0cd57ccfe tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:14.380693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff774235-30f2-4821-a23b-fad0cd57ccfe tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:14.381143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff774235-30f2-4821-a23b-fad0cd57ccfe tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:14.381858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff774235-30f2-4821-a23b-fad0cd57ccfe tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:14.382313 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff774235-30f2-4821-a23b-fad0cd57ccfe tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:14.382736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff774235-30f2-4821-a23b-fad0cd57ccfe tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:14.471106 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0b1705c3-2f15-491d-af08-56b72cedb7ab tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.85%2Fcompute%2Fv2.1%2Fservers%2F8a4ddf34-af18-4e02-a306-c1c67f5c0b28" status: 200 len: 1466 microversion: 2.1 time: 0.143252 Aug 24 10:22:14.481595 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1057/2387] 10.222.0.85 () {58 vars in 1338 bytes} [Wed Aug 24 10:22:14 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.85%2Fcompute%2Fv2.1%2Fservers%2F8a4ddf34-af18-4e02-a306-c1c67f5c0b28 => generated 1466 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:14.487658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1b6aa91b-c598-4374-8d73-4737b4e585ff tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:14.488628 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1b6aa91b-c598-4374-8d73-4737b4e585ff tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: b47ddbf3-ca84-419b-ae08-916fb959be5c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:14.529874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b6aa91b-c598-4374-8d73-4737b4e585ff tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:14.530233 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b6aa91b-c598-4374-8d73-4737b4e585ff tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:14.534177 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b6aa91b-c598-4374-8d73-4737b4e585ff tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:14.539076 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b6aa91b-c598-4374-8d73-4737b4e585ff tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:14.540547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b6aa91b-c598-4374-8d73-4737b4e585ff tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:14.543334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b6aa91b-c598-4374-8d73-4737b4e585ff tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:14.652476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ff774235-30f2-4821-a23b-fad0cd57ccfe tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:14.660821 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ff774235-30f2-4821-a23b-fad0cd57ccfe tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1391 microversion: 2.1 time: 0.296557 Aug 24 10:22:14.661512 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1331/2388] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:14 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1391 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:14.666140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8a0bb313-7f23-4d8f-9de5-54e6811b8502 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f46541c0c10>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:14.728082 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8a0bb313-7f23-4d8f-9de5-54e6811b8502 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.85%2Fcompute%2Fservers%2F8a4ddf34-af18-4e02-a306-c1c67f5c0b28" status: 200 len: 1466 microversion: 2.1 time: 0.065331 Aug 24 10:22:14.728749 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1332/2389] 10.222.0.85 () {58 vars in 1324 bytes} [Wed Aug 24 10:22:14 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.85%2Fcompute%2Fservers%2F8a4ddf34-af18-4e02-a306-c1c67f5c0b28 => generated 1466 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:14.737438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-65a08967-3fd5-4dbd-976a-eb4ce79e4f2c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:14.738333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-65a08967-3fd5-4dbd-976a-eb4ce79e4f2c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:14.750863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65a08967-3fd5-4dbd-976a-eb4ce79e4f2c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:14.751782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65a08967-3fd5-4dbd-976a-eb4ce79e4f2c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:14.752887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65a08967-3fd5-4dbd-976a-eb4ce79e4f2c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:14.754200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65a08967-3fd5-4dbd-976a-eb4ce79e4f2c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:14.755265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65a08967-3fd5-4dbd-976a-eb4ce79e4f2c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:14.756054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65a08967-3fd5-4dbd-976a-eb4ce79e4f2c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:14.860775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-65a08967-3fd5-4dbd-976a-eb4ce79e4f2c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:14.875389 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-65a08967-3fd5-4dbd-976a-eb4ce79e4f2c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1271 microversion: 2.1 time: 0.144302 Aug 24 10:22:14.876443 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1333/2390] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:14 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1271 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:14.882750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fa18083b-d44c-4363-924e-6b7fdb2e6db9 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4654e7b280>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:15.028115 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fa18083b-d44c-4363-924e-6b7fdb2e6db9 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7797 microversion: 2.1 time: 0.150399 Aug 24 10:22:15.028920 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1334/2391] 10.222.0.85 () {58 vars in 1170 bytes} [Wed Aug 24 10:22:14 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7797 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:15.051236 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8f85e823-7862-4b25-aefa-73a9bf3f3c28 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4654f2b550>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:15.138104 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8f85e823-7862-4b25-aefa-73a9bf3f3c28 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.090984 Aug 24 10:22:15.139249 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1335/2392] 10.222.0.85 () {58 vars in 1170 bytes} [Wed Aug 24 10:22:15 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:22:15.159504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fdc4908a-92d2-40d2-894e-7cb9a5b34e0b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f465a21ff70>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:15.236782 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fdc4908a-92d2-40d2-894e-7cb9a5b34e0b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/0a9df326-dcca-498d-8d8a-b320e539a1af" status: 200 len: 784 microversion: 2.1 time: 0.082982 Aug 24 10:22:15.237408 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1336/2393] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:22:15 2022] GET /compute/v2.1/images/0a9df326-dcca-498d-8d8a-b320e539a1af => generated 784 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:15.250429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-91f61f56-bbcc-4221-a5af-dbf5b602130d tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:15.250429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-91f61f56-bbcc-4221-a5af-dbf5b602130d tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] [instance: 3765cbca-99e6-4596-9b57-c846ac289dd8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:15.251146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91f61f56-bbcc-4221-a5af-dbf5b602130d tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:15.251653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91f61f56-bbcc-4221-a5af-dbf5b602130d tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:15.252090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91f61f56-bbcc-4221-a5af-dbf5b602130d tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:15.252804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91f61f56-bbcc-4221-a5af-dbf5b602130d tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:15.253302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91f61f56-bbcc-4221-a5af-dbf5b602130d tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:15.253729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91f61f56-bbcc-4221-a5af-dbf5b602130d tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:15.291471 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1b6aa91b-c598-4374-8d73-4737b4e585ff tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:15.317998 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1b6aa91b-c598-4374-8d73-4737b4e585ff tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c" status: 200 len: 1517 microversion: 2.1 time: 0.841091 Aug 24 10:22:15.318779 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1058/2394] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:14 2022] GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c => generated 1517 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:15.331027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f18946db-dda0-41e6-9ae0-89e50c0ef0af tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f46550120d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:15.412575 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f18946db-dda0-41e6-9ae0-89e50c0ef0af tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 844 microversion: 2.1 time: 0.092350 Aug 24 10:22:15.413242 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1059/2395] 10.222.0.85 () {58 vars in 1158 bytes} [Wed Aug 24 10:22:15 2022] GET /compute/v2.1/images/detail?limit=1 => generated 844 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:15.418739 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-99e71333-a97c-431e-bcca-7ad7fdc41ca4 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:15.419803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-99e71333-a97c-431e-bcca-7ad7fdc41ca4 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:15.428182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99e71333-a97c-431e-bcca-7ad7fdc41ca4 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:15.429011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99e71333-a97c-431e-bcca-7ad7fdc41ca4 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:15.429645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99e71333-a97c-431e-bcca-7ad7fdc41ca4 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:15.430720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99e71333-a97c-431e-bcca-7ad7fdc41ca4 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:15.431466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99e71333-a97c-431e-bcca-7ad7fdc41ca4 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:15.431951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99e71333-a97c-431e-bcca-7ad7fdc41ca4 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:15.584375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-91f61f56-bbcc-4221-a5af-dbf5b602130d tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40868a3ee54348379b95ac9902d2fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9f51d9eede462186be9ba212b4b18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:15.599759 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-91f61f56-bbcc-4221-a5af-dbf5b602130d tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] 10.222.0.85 "GET /compute/v2.1/servers/3765cbca-99e6-4596-9b57-c846ac289dd8" status: 200 len: 1478 microversion: 2.1 time: 0.360868 Aug 24 10:22:15.601259 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1337/2396] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:15 2022] GET /compute/v2.1/servers/3765cbca-99e6-4596-9b57-c846ac289dd8 => generated 1478 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:15.609586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1835486e-219a-430a-8acf-3c2faf084a67 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f465462e670>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:15.976135 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-99e71333-a97c-431e-bcca-7ad7fdc41ca4 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:15.996295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-99e71333-a97c-431e-bcca-7ad7fdc41ca4 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:16.000617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-99e71333-a97c-431e-bcca-7ad7fdc41ca4 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:16.016140 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-99e71333-a97c-431e-bcca-7ad7fdc41ca4 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1335 microversion: 2.47 time: 0.589057 Aug 24 10:22:16.016140 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1060/2397] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:15 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1335 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:16.016140 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-45c10a7a-b73d-4f63-92a2-30d844915ecb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:16.016140 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-45c10a7a-b73d-4f63-92a2-30d844915ecb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:16.025546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-45c10a7a-b73d-4f63-92a2-30d844915ecb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:16.026316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-45c10a7a-b73d-4f63-92a2-30d844915ecb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:16.026946 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-45c10a7a-b73d-4f63-92a2-30d844915ecb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:16.028626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-45c10a7a-b73d-4f63-92a2-30d844915ecb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:16.029488 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-45c10a7a-b73d-4f63-92a2-30d844915ecb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:16.030303 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-45c10a7a-b73d-4f63-92a2-30d844915ecb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:16.583907 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1835486e-219a-430a-8acf-3c2faf084a67 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "DELETE /compute/v2.1/images/d81b1bef-ab64-4f84-bf62-d539dd7cb14d" status: 204 len: 0 microversion: 2.1 time: 0.981053 Aug 24 10:22:16.585262 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1338/2398] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:15 2022] DELETE /compute/v2.1/images/d81b1bef-ab64-4f84-bf62-d539dd7cb14d => generated 0 bytes in 983 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:22:16.595177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9e6faa85-6409-4f6d-b25b-cc6727a3daef tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:16.596216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9e6faa85-6409-4f6d-b25b-cc6727a3daef tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:16.609401 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e6faa85-6409-4f6d-b25b-cc6727a3daef tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:16.610305 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e6faa85-6409-4f6d-b25b-cc6727a3daef tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:16.610983 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e6faa85-6409-4f6d-b25b-cc6727a3daef tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:16.612229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e6faa85-6409-4f6d-b25b-cc6727a3daef tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:16.613014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e6faa85-6409-4f6d-b25b-cc6727a3daef tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:16.613789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e6faa85-6409-4f6d-b25b-cc6727a3daef tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:16.706477 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-45c10a7a-b73d-4f63-92a2-30d844915ecb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:16.727306 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-45c10a7a-b73d-4f63-92a2-30d844915ecb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1391 microversion: 2.1 time: 0.719880 Aug 24 10:22:16.730279 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1061/2399] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:16 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1391 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:16.736367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9e6faa85-6409-4f6d-b25b-cc6727a3daef tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:16.741019 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aa6bf817-2eea-4041-9e94-f61b87c1006a tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-416195790", "imageRef": "c41e1373-2423-4539-8763-216b0fdc2303", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e0dbdab4-d591-4dad-b0e3-1fb18c9081b5"}], "security_groups": [{"name": "tempest-securitygroup--721881505"}], "key_name": "tempest-keypair-860357472", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:16.765377 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9e6faa85-6409-4f6d-b25b-cc6727a3daef tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1271 microversion: 2.1 time: 0.177268 Aug 24 10:22:16.769242 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1339/2400] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:16 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1271 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:16.781494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a8f46f63-c945-4a2b-b96f-631f721b1712 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:16.781494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a8f46f63-c945-4a2b-b96f-631f721b1712 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: b47ddbf3-ca84-419b-ae08-916fb959be5c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:16.792410 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8f46f63-c945-4a2b-b96f-631f721b1712 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:16.795707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8f46f63-c945-4a2b-b96f-631f721b1712 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:16.796756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8f46f63-c945-4a2b-b96f-631f721b1712 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:16.797853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8f46f63-c945-4a2b-b96f-631f721b1712 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:16.798674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8f46f63-c945-4a2b-b96f-631f721b1712 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:16.799460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8f46f63-c945-4a2b-b96f-631f721b1712 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:17.088670 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a8f46f63-c945-4a2b-b96f-631f721b1712 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:17.106406 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a8f46f63-c945-4a2b-b96f-631f721b1712 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c" status: 200 len: 1517 microversion: 2.1 time: 0.337001 Aug 24 10:22:17.109697 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1340/2401] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:16 2022] GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c => generated 1517 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:17.119331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-31f4d11b-1b22-4632-9e61-77dda3a5fcb6 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f465a1ed3a0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:17.258931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-aa6bf817-2eea-4041-9e94-f61b87c1006a tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] validate_networks() for [('e0dbdab4-d591-4dad-b0e3-1fb18c9081b5', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:22:18.117577 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-31f4d11b-1b22-4632-9e61-77dda3a5fcb6 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "DELETE /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa" status: 204 len: 0 microversion: 2.1 time: 1.005636 Aug 24 10:22:18.118554 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1341/2402] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:17 2022] DELETE /compute/v2.1/images/66782c09-9373-438c-8f8e-5eff4de962fa => generated 0 bytes in 1008 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:22:18.131208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ac9e4d94-1223-4c29-b483-f8bebf60a318 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:18.132345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ac9e4d94-1223-4c29-b483-f8bebf60a318 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] [instance: 3765cbca-99e6-4596-9b57-c846ac289dd8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:18.146131 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac9e4d94-1223-4c29-b483-f8bebf60a318 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:18.147319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac9e4d94-1223-4c29-b483-f8bebf60a318 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:18.148282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac9e4d94-1223-4c29-b483-f8bebf60a318 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:18.149663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac9e4d94-1223-4c29-b483-f8bebf60a318 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:18.150672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac9e4d94-1223-4c29-b483-f8bebf60a318 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:18.151638 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac9e4d94-1223-4c29-b483-f8bebf60a318 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:18.179491 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-ac9e4d94-1223-4c29-b483-f8bebf60a318 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] HTTP exception thrown: Instance 3765cbca-99e6-4596-9b57-c846ac289dd8 could not be found. Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ac9e4d94-1223-4c29-b483-f8bebf60a318 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Request method failure captured: Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/3765cbca-99e6-4596-9b57-c846ac289dd8 HTTP/1.1 Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfu0FDMJdrjgRpgtW3MICFjxd_SXEa5CuPLMEvW-K-TEfGguaUClGD0EaEvFtj0alOBoXsFdVoPBhy2DnJZY7wvC7S1cdHc3kNJnkOYq3bEHPG8SirkiiUEIfCFgoC5WwwxhRyoMuinHBUOzEdvW3OfHx0uMajQCN9iIuCQ_E2QAjKc Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 9f9f51d9eede462186be9ba212b4b18d Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-539675815 Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9f9f51d9eede462186be9ba212b4b18d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9f9f51d9eede462186be9ba212b4b18d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9f9f51d9eede462186be9ba212b4b18d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9f9f51d9eede462186be9ba212b4b18d"}]}] Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-539675815 Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 9f9f51d9eede462186be9ba212b4b18d Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-539675815 Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerDiagnosticsNegativeTest-539675815-project Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 40868a3ee54348379b95ac9902d2fb22 Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-539675815-project Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 3765cbca-99e6-4596-9b57-c846ac289dd8 could not be found. Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '3765cbca-99e6-4596-9b57-c846ac289dd8'} Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3765cbca-99e6-4596-9b57-c846ac289dd8 could not be found. Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3765cbca-99e6-4596-9b57-c846ac289dd8 could not be found. Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:22:18.183414 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:18.194792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:22:18.194792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:18.194792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:18.194792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:18.194792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:22:18.194792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:22:18.194792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3765cbca-99e6-4596-9b57-c846ac289dd8 could not be found. Aug 24 10:22:18.194792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:22:18.198721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ac9e4d94-1223-4c29-b483-f8bebf60a318 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] Returning 404 to user: Instance 3765cbca-99e6-4596-9b57-c846ac289dd8 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:22:18.200729 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ac9e4d94-1223-4c29-b483-f8bebf60a318 tempest-ServerDiagnosticsNegativeTest-539675815 tempest-ServerDiagnosticsNegativeTest-539675815-project] 10.222.0.85 "GET /compute/v2.1/servers/3765cbca-99e6-4596-9b57-c846ac289dd8" status: 404 len: 111 microversion: 2.1 time: 0.075507 Aug 24 10:22:18.208640 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1342/2403] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:18 2022] GET /compute/v2.1/servers/3765cbca-99e6-4596-9b57-c846ac289dd8 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:22:18.219607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3bfeb9cc-b97e-4a40-a559-5682c0cccad5 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:18.220979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3bfeb9cc-b97e-4a40-a559-5682c0cccad5 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:18.232618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bfeb9cc-b97e-4a40-a559-5682c0cccad5 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:18.233912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bfeb9cc-b97e-4a40-a559-5682c0cccad5 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:18.234792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bfeb9cc-b97e-4a40-a559-5682c0cccad5 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:18.236191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bfeb9cc-b97e-4a40-a559-5682c0cccad5 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:18.237869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bfeb9cc-b97e-4a40-a559-5682c0cccad5 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:18.239608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bfeb9cc-b97e-4a40-a559-5682c0cccad5 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:18.402041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3bfeb9cc-b97e-4a40-a559-5682c0cccad5 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:18.426352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3bfeb9cc-b97e-4a40-a559-5682c0cccad5 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:18.439998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3bfeb9cc-b97e-4a40-a559-5682c0cccad5 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:18.441839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-aa6bf817-2eea-4041-9e94-f61b87c1006a tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:22:18.442583 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3bfeb9cc-b97e-4a40-a559-5682c0cccad5 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1335 microversion: 2.47 time: 0.230703 Aug 24 10:22:18.442733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-aa6bf817-2eea-4041-9e94-f61b87c1006a tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:22:18.442874 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1343/2404] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:18 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1335 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:18.443985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-aa6bf817-2eea-4041-9e94-f61b87c1006a tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:22:18.444512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-aa6bf817-2eea-4041-9e94-f61b87c1006a tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:22:18.445350 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-aa6bf817-2eea-4041-9e94-f61b87c1006a tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:22:18.480131 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa6bf817-2eea-4041-9e94-f61b87c1006a tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:18.480989 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa6bf817-2eea-4041-9e94-f61b87c1006a tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:18.484496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a3861e4e-2f05-4e48-ae5d-2d068328986c req-c08d5a66-29da-4a1b-836d-c97012b923d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3765cbca-99e6-4596-9b57-c846ac289dd8", "name": "network-vif-deleted", "tag": "f44afbfe-d144-4d60-9452-f86f341f60d8"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:18.485986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa6bf817-2eea-4041-9e94-f61b87c1006a tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:18.487442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa6bf817-2eea-4041-9e94-f61b87c1006a tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:18.488287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa6bf817-2eea-4041-9e94-f61b87c1006a tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:18.489067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa6bf817-2eea-4041-9e94-f61b87c1006a tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:18.502959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a3861e4e-2f05-4e48-ae5d-2d068328986c req-c08d5a66-29da-4a1b-836d-c97012b923d8 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:18.504076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a3861e4e-2f05-4e48-ae5d-2d068328986c req-c08d5a66-29da-4a1b-836d-c97012b923d8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:18.504857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a3861e4e-2f05-4e48-ae5d-2d068328986c req-c08d5a66-29da-4a1b-836d-c97012b923d8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:18.525181 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a3861e4e-2f05-4e48-ae5d-2d068328986c req-c08d5a66-29da-4a1b-836d-c97012b923d8 service nova] Creating event network-vif-deleted:f44afbfe-d144-4d60-9452-f86f341f60d8 for instance 3765cbca-99e6-4596-9b57-c846ac289dd8 on n-h1-849328-3 Aug 24 10:22:18.534478 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a3861e4e-2f05-4e48-ae5d-2d068328986c req-c08d5a66-29da-4a1b-836d-c97012b923d8 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057022 Aug 24 10:22:18.536359 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1344/2405] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:18.547796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c8c170de-5bb3-4cd0-b6fe-3fc55d1a4d3a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:18.549261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c8c170de-5bb3-4cd0-b6fe-3fc55d1a4d3a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:18.561571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8c170de-5bb3-4cd0-b6fe-3fc55d1a4d3a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:18.562646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8c170de-5bb3-4cd0-b6fe-3fc55d1a4d3a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:18.563876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8c170de-5bb3-4cd0-b6fe-3fc55d1a4d3a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:18.565297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8c170de-5bb3-4cd0-b6fe-3fc55d1a4d3a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:18.566268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8c170de-5bb3-4cd0-b6fe-3fc55d1a4d3a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:18.567161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8c170de-5bb3-4cd0-b6fe-3fc55d1a4d3a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:18.584628 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-aa6bf817-2eea-4041-9e94-f61b87c1006a tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Getting quotas for project 1d5264f4afb64ba9927050b9b94d37a8. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:22:18.609513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-aa6bf817-2eea-4041-9e94-f61b87c1006a tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Getting quotas for user 3d264ad8190a4cd9be236d05564fe1a2 and project 1d5264f4afb64ba9927050b9b94d37a8. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:22:18.639204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aa6bf817-2eea-4041-9e94-f61b87c1006a tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:22:18.643885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aa6bf817-2eea-4041-9e94-f61b87c1006a tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c41e1373-2423-4539-8763-216b0fdc2303',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:22:18.778025 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aa6bf817-2eea-4041-9e94-f61b87c1006a tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.045424 Aug 24 10:22:18.794318 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1062/2406] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:22:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 2063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:22:18.804849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-417bf484-1257-49af-95eb-4e58b7f6cd99 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:18.807063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-417bf484-1257-49af-95eb-4e58b7f6cd99 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:18.858748 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-417bf484-1257-49af-95eb-4e58b7f6cd99 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:18.861071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-417bf484-1257-49af-95eb-4e58b7f6cd99 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:18.866151 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-417bf484-1257-49af-95eb-4e58b7f6cd99 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:18.867683 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-417bf484-1257-49af-95eb-4e58b7f6cd99 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:18.869218 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-417bf484-1257-49af-95eb-4e58b7f6cd99 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:18.872982 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-417bf484-1257-49af-95eb-4e58b7f6cd99 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:19.000907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c8c170de-5bb3-4cd0-b6fe-3fc55d1a4d3a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:19.040653 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c8c170de-5bb3-4cd0-b6fe-3fc55d1a4d3a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1391 microversion: 2.1 time: 0.496773 Aug 24 10:22:19.043850 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1345/2407] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:18 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1391 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:19.074399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-47df300e-bf0b-43ce-aa4e-3bd5b2ff3f74 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f465418a940>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:20.166756 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-417bf484-1257-49af-95eb-4e58b7f6cd99 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:20.272373 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-417bf484-1257-49af-95eb-4e58b7f6cd99 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1334 microversion: 2.1 time: 1.465522 Aug 24 10:22:20.290150 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1063/2408] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:18 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1334 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:20.322297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e58ca2bb-2807-48e9-a0fc-fc18a817ed7d tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:20.335472 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e58ca2bb-2807-48e9-a0fc-fc18a817ed7d tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: b47ddbf3-ca84-419b-ae08-916fb959be5c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:20.354507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e58ca2bb-2807-48e9-a0fc-fc18a817ed7d tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:20.357852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e58ca2bb-2807-48e9-a0fc-fc18a817ed7d tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:20.359276 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e58ca2bb-2807-48e9-a0fc-fc18a817ed7d tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:20.381756 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e58ca2bb-2807-48e9-a0fc-fc18a817ed7d tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:20.383290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e58ca2bb-2807-48e9-a0fc-fc18a817ed7d tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:20.384437 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e58ca2bb-2807-48e9-a0fc-fc18a817ed7d tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:20.399488 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:20.436160 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-e58ca2bb-2807-48e9-a0fc-fc18a817ed7d tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] HTTP exception thrown: Instance b47ddbf3-ca84-419b-ae08-916fb959be5c could not be found. Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e58ca2bb-2807-48e9-a0fc-fc18a817ed7d tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Request method failure captured: Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c HTTP/1.1 Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBftwtkhYP4zVF4PKA_bbCUujMmaUgoOlVaJMarOwcdHu-Cd_fF_suW9VbHy5cTzlyLKYgAm3UtbAsusltb4Lqx0usRchQC4NUtKIzb7RzB_Wo4hVkJ-Yah_B2FWA6LQhnHChV92UclDGeBzsxsDDJri9vE4dJhKtXY4OkSfVmRZaA_k Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 4b648a28a11e4016a1fe87ea6b6f01b2 Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ListServerFiltersTestJSON-769713699 Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/4b648a28a11e4016a1fe87ea6b6f01b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_4b648a28a11e4016a1fe87ea6b6f01b2", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/4b648a28a11e4016a1fe87ea6b6f01b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/4b648a28a11e4016a1fe87ea6b6f01b2"}]}] Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ListServerFiltersTestJSON-769713699 Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 4b648a28a11e4016a1fe87ea6b6f01b2 Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-769713699 Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ListServerFiltersTestJSON-769713699-project Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: d4163d2bb72c43e7b0315c5e782d5fa7 Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ListServerFiltersTestJSON-769713699-project Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance b47ddbf3-ca84-419b-ae08-916fb959be5c could not be found. Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'b47ddbf3-ca84-419b-ae08-916fb959be5c'} Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b47ddbf3-ca84-419b-ae08-916fb959be5c could not be found. Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b47ddbf3-ca84-419b-ae08-916fb959be5c could not be found. Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:20.441722 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:22:20.453173 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:20.453173 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:20.453173 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:20.453173 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:22:20.453173 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:22:20.453173 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b47ddbf3-ca84-419b-ae08-916fb959be5c could not be found. Aug 24 10:22:20.453173 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:22:20.453173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e58ca2bb-2807-48e9-a0fc-fc18a817ed7d tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Returning 404 to user: Instance b47ddbf3-ca84-419b-ae08-916fb959be5c could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:22:20.462386 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e58ca2bb-2807-48e9-a0fc-fc18a817ed7d tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c" status: 404 len: 111 microversion: 2.1 time: 0.184495 Aug 24 10:22:20.463819 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1064/2409] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:20 2022] GET /compute/v2.1/servers/b47ddbf3-ca84-419b-ae08-916fb959be5c => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:22:20.509649 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-991f9426-65fe-4e73-91cd-77ac8e7472db req-5c8e3a96-d7af-4ed2-b764-1a44776feaa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b47ddbf3-ca84-419b-ae08-916fb959be5c", "name": "network-vif-deleted", "tag": "a6b2f639-dad5-4400-beb9-77abcd596b1b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:20.537012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-991f9426-65fe-4e73-91cd-77ac8e7472db req-5c8e3a96-d7af-4ed2-b764-1a44776feaa1 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:20.537544 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-991f9426-65fe-4e73-91cd-77ac8e7472db req-5c8e3a96-d7af-4ed2-b764-1a44776feaa1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:20.538009 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-991f9426-65fe-4e73-91cd-77ac8e7472db req-5c8e3a96-d7af-4ed2-b764-1a44776feaa1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:20.567280 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-991f9426-65fe-4e73-91cd-77ac8e7472db req-5c8e3a96-d7af-4ed2-b764-1a44776feaa1 service nova] Creating event network-vif-deleted:a6b2f639-dad5-4400-beb9-77abcd596b1b for instance b47ddbf3-ca84-419b-ae08-916fb959be5c on n-h2-849328-3 Aug 24 10:22:20.582184 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-991f9426-65fe-4e73-91cd-77ac8e7472db req-5c8e3a96-d7af-4ed2-b764-1a44776feaa1 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098412 Aug 24 10:22:20.588645 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1065/2410] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:20.608172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-872eee51-be02-4d57-b77f-5f936d6f5e85 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:20.610579 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-872eee51-be02-4d57-b77f-5f936d6f5e85 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:20.783678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-872eee51-be02-4d57-b77f-5f936d6f5e85 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d264ad8190a4cd9be236d05564fe1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5264f4afb64ba9927050b9b94d37a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:20.803763 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-872eee51-be02-4d57-b77f-5f936d6f5e85 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08" status: 200 len: 1244 microversion: 2.1 time: 0.212723 Aug 24 10:22:20.807968 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1066/2411] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:20 2022] GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 => generated 1244 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:20.827247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e2595e54-5c27-4291-95f3-c9e4e71ee544 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:20.833661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e2595e54-5c27-4291-95f3-c9e4e71ee544 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:20.862245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2595e54-5c27-4291-95f3-c9e4e71ee544 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:20.862802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2595e54-5c27-4291-95f3-c9e4e71ee544 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:20.863347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2595e54-5c27-4291-95f3-c9e4e71ee544 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:20.864221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2595e54-5c27-4291-95f3-c9e4e71ee544 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:20.865015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2595e54-5c27-4291-95f3-c9e4e71ee544 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:20.865808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2595e54-5c27-4291-95f3-c9e4e71ee544 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:20.910439 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-47df300e-bf0b-43ce-aa4e-3bd5b2ff3f74 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "DELETE /compute/v2.1/images/253f0edd-9ca3-4b50-b54e-fbb9518b9726" status: 204 len: 0 microversion: 2.1 time: 1.861126 Aug 24 10:22:20.911061 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1346/2412] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:19 2022] DELETE /compute/v2.1/images/253f0edd-9ca3-4b50-b54e-fbb9518b9726 => generated 0 bytes in 1863 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:22:20.917296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-10462e90-4466-4fac-a4b3-0dea085a1433 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:20.917900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-10462e90-4466-4fac-a4b3-0dea085a1433 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:20.937089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10462e90-4466-4fac-a4b3-0dea085a1433 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:20.938093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10462e90-4466-4fac-a4b3-0dea085a1433 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:20.940637 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10462e90-4466-4fac-a4b3-0dea085a1433 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:20.942118 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10462e90-4466-4fac-a4b3-0dea085a1433 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:20.946263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10462e90-4466-4fac-a4b3-0dea085a1433 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:20.948749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10462e90-4466-4fac-a4b3-0dea085a1433 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:21.007850 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e2595e54-5c27-4291-95f3-c9e4e71ee544 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:21.024387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e2595e54-5c27-4291-95f3-c9e4e71ee544 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:21.027874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e2595e54-5c27-4291-95f3-c9e4e71ee544 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:21.029902 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e2595e54-5c27-4291-95f3-c9e4e71ee544 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1356 microversion: 2.47 time: 0.214684 Aug 24 10:22:21.037215 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1067/2413] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:20 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1356 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:21.044274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fe925e8a-2d5a-4018-b3bb-55aefb65ba84 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:21.045608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fe925e8a-2d5a-4018-b3bb-55aefb65ba84 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: ea87f606-60c3-4789-871d-8a8ffc4e0612] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:21.053766 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:21.056016 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe925e8a-2d5a-4018-b3bb-55aefb65ba84 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:21.058873 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe925e8a-2d5a-4018-b3bb-55aefb65ba84 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:21.059690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe925e8a-2d5a-4018-b3bb-55aefb65ba84 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:21.060861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe925e8a-2d5a-4018-b3bb-55aefb65ba84 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:21.061752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe925e8a-2d5a-4018-b3bb-55aefb65ba84 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:21.062480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe925e8a-2d5a-4018-b3bb-55aefb65ba84 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:21.147086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fe925e8a-2d5a-4018-b3bb-55aefb65ba84 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: ea87f606-60c3-4789-871d-8a8ffc4e0612] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:22:21.265258 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-10462e90-4466-4fac-a4b3-0dea085a1433 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:21.299673 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-10462e90-4466-4fac-a4b3-0dea085a1433 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1391 microversion: 2.1 time: 0.385296 Aug 24 10:22:21.300670 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1347/2414] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:20 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1391 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:21.306578 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fe925e8a-2d5a-4018-b3bb-55aefb65ba84 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "DELETE /compute/v2.1/servers/ea87f606-60c3-4789-871d-8a8ffc4e0612" status: 204 len: 0 microversion: 2.1 time: 0.265132 Aug 24 10:22:21.308643 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1068/2415] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:22:21 2022] DELETE /compute/v2.1/servers/ea87f606-60c3-4789-871d-8a8ffc4e0612 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:22:21.310721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a28e9e47-0de8-4c02-8282-3853d9b30fb6 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:21.311436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a28e9e47-0de8-4c02-8282-3853d9b30fb6 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: 8a4ddf34-af18-4e02-a306-c1c67f5c0b28] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:21.320645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a28e9e47-0de8-4c02-8282-3853d9b30fb6 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:21.321088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bfc1ee03-6d6b-4212-8d8f-3ef82c581af3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:21.321667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a28e9e47-0de8-4c02-8282-3853d9b30fb6 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:21.322283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a28e9e47-0de8-4c02-8282-3853d9b30fb6 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:21.323236 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a28e9e47-0de8-4c02-8282-3853d9b30fb6 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:21.323837 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a28e9e47-0de8-4c02-8282-3853d9b30fb6 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:21.324421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a28e9e47-0de8-4c02-8282-3853d9b30fb6 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:21.325613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bfc1ee03-6d6b-4212-8d8f-3ef82c581af3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:21.336160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfc1ee03-6d6b-4212-8d8f-3ef82c581af3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:21.337159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfc1ee03-6d6b-4212-8d8f-3ef82c581af3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:21.338075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfc1ee03-6d6b-4212-8d8f-3ef82c581af3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:21.339025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfc1ee03-6d6b-4212-8d8f-3ef82c581af3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:21.339880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfc1ee03-6d6b-4212-8d8f-3ef82c581af3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:21.340715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfc1ee03-6d6b-4212-8d8f-3ef82c581af3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:21.377852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a28e9e47-0de8-4c02-8282-3853d9b30fb6 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: 8a4ddf34-af18-4e02-a306-c1c67f5c0b28] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:22:21.505579 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bfc1ee03-6d6b-4212-8d8f-3ef82c581af3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:22:21.506014 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bfc1ee03-6d6b-4212-8d8f-3ef82c581af3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:22:21.506510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bfc1ee03-6d6b-4212-8d8f-3ef82c581af3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:22:21.507013 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bfc1ee03-6d6b-4212-8d8f-3ef82c581af3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:22:21.507438 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bfc1ee03-6d6b-4212-8d8f-3ef82c581af3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:22:21.625395 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:21.633312 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a28e9e47-0de8-4c02-8282-3853d9b30fb6 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "DELETE /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28" status: 204 len: 0 microversion: 2.1 time: 0.329397 Aug 24 10:22:21.635088 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1348/2416] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:22:21 2022] DELETE /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:22:21.648792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a61cbbd7-5976-442d-b486-4a9d81437fdc tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:21.650612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a61cbbd7-5976-442d-b486-4a9d81437fdc tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: ea87f606-60c3-4789-871d-8a8ffc4e0612] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:21.662667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a61cbbd7-5976-442d-b486-4a9d81437fdc tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:21.665313 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a61cbbd7-5976-442d-b486-4a9d81437fdc tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:21.666464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a61cbbd7-5976-442d-b486-4a9d81437fdc tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:21.668003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a61cbbd7-5976-442d-b486-4a9d81437fdc tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:21.669216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a61cbbd7-5976-442d-b486-4a9d81437fdc tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:21.670388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a61cbbd7-5976-442d-b486-4a9d81437fdc tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:21.699203 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bfc1ee03-6d6b-4212-8d8f-3ef82c581af3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:21.729560 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfc1ee03-6d6b-4212-8d8f-3ef82c581af3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:21.733888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfc1ee03-6d6b-4212-8d8f-3ef82c581af3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:21.736995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfc1ee03-6d6b-4212-8d8f-3ef82c581af3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:21.738950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfc1ee03-6d6b-4212-8d8f-3ef82c581af3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:21.760410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfc1ee03-6d6b-4212-8d8f-3ef82c581af3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:21.762858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfc1ee03-6d6b-4212-8d8f-3ef82c581af3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:21.866891 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bfc1ee03-6d6b-4212-8d8f-3ef82c581af3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "POST /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270/action" status: 202 len: 1078 microversion: 2.47 time: 0.555503 Aug 24 10:22:21.886519 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1069/2417] 10.222.0.85 () {62 vars in 1319 bytes} [Wed Aug 24 10:22:21 2022] POST /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270/action => generated 1078 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 24 10:22:21.903233 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-944f504f-8750-4ec6-91dd-94c03c8576c4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:21.904986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-944f504f-8750-4ec6-91dd-94c03c8576c4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:21.921865 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-944f504f-8750-4ec6-91dd-94c03c8576c4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:21.922942 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-944f504f-8750-4ec6-91dd-94c03c8576c4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:21.924189 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-944f504f-8750-4ec6-91dd-94c03c8576c4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:21.925653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-944f504f-8750-4ec6-91dd-94c03c8576c4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:21.926751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-944f504f-8750-4ec6-91dd-94c03c8576c4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:21.938635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-944f504f-8750-4ec6-91dd-94c03c8576c4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:22.003032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=12 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:22.183997 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a61cbbd7-5976-442d-b486-4a9d81437fdc tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:22.196786 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a61cbbd7-5976-442d-b486-4a9d81437fdc tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea87f606-60c3-4789-871d-8a8ffc4e0612" status: 200 len: 1517 microversion: 2.1 time: 0.559223 Aug 24 10:22:22.211287 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1349/2418] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:21 2022] GET /compute/v2.1/servers/ea87f606-60c3-4789-871d-8a8ffc4e0612 => generated 1517 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:22.217742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c131422b-80af-4343-a008-6ca08da2d2ac tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:22.218765 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c131422b-80af-4343-a008-6ca08da2d2ac tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: 8a4ddf34-af18-4e02-a306-c1c67f5c0b28] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:22.243820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c131422b-80af-4343-a008-6ca08da2d2ac tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:22.246331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c131422b-80af-4343-a008-6ca08da2d2ac tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:22.247862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c131422b-80af-4343-a008-6ca08da2d2ac tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:22.251015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c131422b-80af-4343-a008-6ca08da2d2ac tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:22.251833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c131422b-80af-4343-a008-6ca08da2d2ac tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:22.253520 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c131422b-80af-4343-a008-6ca08da2d2ac tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:22.551977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c131422b-80af-4343-a008-6ca08da2d2ac tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:22.561736 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c131422b-80af-4343-a008-6ca08da2d2ac tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28" status: 200 len: 1473 microversion: 2.1 time: 0.362223 Aug 24 10:22:22.562498 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1350/2419] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:22 2022] GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28 => generated 1473 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:22.589356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5d98931a-7a98-4fb4-9fd3-b7051d959b39 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:22.592582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5d98931a-7a98-4fb4-9fd3-b7051d959b39 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:22.604135 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d98931a-7a98-4fb4-9fd3-b7051d959b39 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:22.605099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d98931a-7a98-4fb4-9fd3-b7051d959b39 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:22.605917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d98931a-7a98-4fb4-9fd3-b7051d959b39 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:22.607000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d98931a-7a98-4fb4-9fd3-b7051d959b39 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:22.608726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d98931a-7a98-4fb4-9fd3-b7051d959b39 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:22.609858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d98931a-7a98-4fb4-9fd3-b7051d959b39 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:22.647909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:22.652939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=12 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:22.753616 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5d98931a-7a98-4fb4-9fd3-b7051d959b39 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d264ad8190a4cd9be236d05564fe1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5264f4afb64ba9927050b9b94d37a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:22.770391 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5d98931a-7a98-4fb4-9fd3-b7051d959b39 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08" status: 200 len: 1302 microversion: 2.1 time: 0.198344 Aug 24 10:22:22.789914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-944f504f-8750-4ec6-91dd-94c03c8576c4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:22.796489 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1351/2420] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:22 2022] GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 => generated 1302 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:22.806667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-376b549b-6acf-4780-bfdf-c4bb97f14112 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:22.807758 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-376b549b-6acf-4780-bfdf-c4bb97f14112 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:22.821746 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-944f504f-8750-4ec6-91dd-94c03c8576c4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1355 microversion: 2.1 time: 0.932317 Aug 24 10:22:22.822885 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1070/2421] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:21 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1355 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:22.830289 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9aad3551-fb15-4d47-a420-bb99305fc504 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:22.831115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9aad3551-fb15-4d47-a420-bb99305fc504 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:22.847885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376b549b-6acf-4780-bfdf-c4bb97f14112 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:22.848955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376b549b-6acf-4780-bfdf-c4bb97f14112 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:22.849936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376b549b-6acf-4780-bfdf-c4bb97f14112 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:22.857195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376b549b-6acf-4780-bfdf-c4bb97f14112 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:22.857472 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9aad3551-fb15-4d47-a420-bb99305fc504 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:22.858210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9aad3551-fb15-4d47-a420-bb99305fc504 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:22.858682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9aad3551-fb15-4d47-a420-bb99305fc504 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:22.859462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9aad3551-fb15-4d47-a420-bb99305fc504 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:22.860007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9aad3551-fb15-4d47-a420-bb99305fc504 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:22.860275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376b549b-6acf-4780-bfdf-c4bb97f14112 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:22.860462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9aad3551-fb15-4d47-a420-bb99305fc504 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:22.861585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376b549b-6acf-4780-bfdf-c4bb97f14112 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:23.122552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-376b549b-6acf-4780-bfdf-c4bb97f14112 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:23.141462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-376b549b-6acf-4780-bfdf-c4bb97f14112 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:23.144104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-376b549b-6acf-4780-bfdf-c4bb97f14112 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:23.146754 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-376b549b-6acf-4780-bfdf-c4bb97f14112 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1365 microversion: 2.47 time: 0.348541 Aug 24 10:22:23.147831 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1352/2422] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:22 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1365 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:23.225523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-df93b415-8b82-45f8-b815-4918f9cb2489 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:23.238009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-df93b415-8b82-45f8-b815-4918f9cb2489 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: ea87f606-60c3-4789-871d-8a8ffc4e0612] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:23.273011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df93b415-8b82-45f8-b815-4918f9cb2489 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:23.282393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df93b415-8b82-45f8-b815-4918f9cb2489 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:23.283032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df93b415-8b82-45f8-b815-4918f9cb2489 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:23.284822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df93b415-8b82-45f8-b815-4918f9cb2489 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:23.286284 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df93b415-8b82-45f8-b815-4918f9cb2489 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:23.287011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df93b415-8b82-45f8-b815-4918f9cb2489 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:23.681058 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-df93b415-8b82-45f8-b815-4918f9cb2489 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:23.692414 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-df93b415-8b82-45f8-b815-4918f9cb2489 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea87f606-60c3-4789-871d-8a8ffc4e0612" status: 200 len: 1517 microversion: 2.1 time: 0.474956 Aug 24 10:22:23.709758 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1353/2423] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:23 2022] GET /compute/v2.1/servers/ea87f606-60c3-4789-871d-8a8ffc4e0612 => generated 1517 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:23.716204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1d7d1bb7-01ac-4152-bc76-504cf52483b6 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:23.716888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1d7d1bb7-01ac-4152-bc76-504cf52483b6 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: 8a4ddf34-af18-4e02-a306-c1c67f5c0b28] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:23.726140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d7d1bb7-01ac-4152-bc76-504cf52483b6 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:23.727103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d7d1bb7-01ac-4152-bc76-504cf52483b6 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:23.728347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d7d1bb7-01ac-4152-bc76-504cf52483b6 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:23.729441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d7d1bb7-01ac-4152-bc76-504cf52483b6 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:23.730415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d7d1bb7-01ac-4152-bc76-504cf52483b6 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:23.731265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d7d1bb7-01ac-4152-bc76-504cf52483b6 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:23.918984 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9aad3551-fb15-4d47-a420-bb99305fc504 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:23.931453 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9aad3551-fb15-4d47-a420-bb99305fc504 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1391 microversion: 2.1 time: 1.107447 Aug 24 10:22:23.932050 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1071/2424] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:22 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1391 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:23.942512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-662dd5b6-e731-49cf-8827-a39f21d21ff4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:23.943122 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-662dd5b6-e731-49cf-8827-a39f21d21ff4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:23.962598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-662dd5b6-e731-49cf-8827-a39f21d21ff4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:23.963347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-662dd5b6-e731-49cf-8827-a39f21d21ff4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:23.963979 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-662dd5b6-e731-49cf-8827-a39f21d21ff4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:23.964880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-662dd5b6-e731-49cf-8827-a39f21d21ff4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:23.965732 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-662dd5b6-e731-49cf-8827-a39f21d21ff4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:23.966501 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-662dd5b6-e731-49cf-8827-a39f21d21ff4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:23.986386 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1d7d1bb7-01ac-4152-bc76-504cf52483b6 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:24.008157 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1d7d1bb7-01ac-4152-bc76-504cf52483b6 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28" status: 200 len: 1473 microversion: 2.1 time: 0.297140 Aug 24 10:22:24.008774 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1354/2425] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:23 2022] GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28 => generated 1473 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:24.026849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-214b3c7b-742d-40a5-a04e-86183f98a675 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:24.027942 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-214b3c7b-742d-40a5-a04e-86183f98a675 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:24.040706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-214b3c7b-742d-40a5-a04e-86183f98a675 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:24.043527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-214b3c7b-742d-40a5-a04e-86183f98a675 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:24.045641 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-214b3c7b-742d-40a5-a04e-86183f98a675 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:24.046633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-214b3c7b-742d-40a5-a04e-86183f98a675 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:24.049624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-214b3c7b-742d-40a5-a04e-86183f98a675 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:24.051103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-214b3c7b-742d-40a5-a04e-86183f98a675 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:24.111131 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-662dd5b6-e731-49cf-8827-a39f21d21ff4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d264ad8190a4cd9be236d05564fe1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5264f4afb64ba9927050b9b94d37a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:24.123912 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-662dd5b6-e731-49cf-8827-a39f21d21ff4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08" status: 200 len: 1302 microversion: 2.1 time: 0.186080 Aug 24 10:22:24.125160 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1072/2426] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:23 2022] GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 => generated 1302 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:24.186885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-33946895-fa14-4134-989f-eff8677d88c6 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:24.188177 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-33946895-fa14-4134-989f-eff8677d88c6 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:24.225542 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33946895-fa14-4134-989f-eff8677d88c6 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:24.226984 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33946895-fa14-4134-989f-eff8677d88c6 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:24.231139 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33946895-fa14-4134-989f-eff8677d88c6 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:24.232067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33946895-fa14-4134-989f-eff8677d88c6 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:24.233577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33946895-fa14-4134-989f-eff8677d88c6 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:24.239041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33946895-fa14-4134-989f-eff8677d88c6 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:24.457669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-214b3c7b-742d-40a5-a04e-86183f98a675 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:24.490763 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-214b3c7b-742d-40a5-a04e-86183f98a675 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1355 microversion: 2.1 time: 0.461936 Aug 24 10:22:24.492384 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1355/2427] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:24 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1355 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:24.655073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-33946895-fa14-4134-989f-eff8677d88c6 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:24.685510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-33946895-fa14-4134-989f-eff8677d88c6 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:24.694957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-33946895-fa14-4134-989f-eff8677d88c6 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:24.712336 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-33946895-fa14-4134-989f-eff8677d88c6 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1365 microversion: 2.47 time: 0.531198 Aug 24 10:22:24.716179 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1073/2428] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:24 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1365 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:22:24.716895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-05611b73-d208-4a18-a0e7-eff3c530bb36 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:24.717874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-05611b73-d208-4a18-a0e7-eff3c530bb36 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: ea87f606-60c3-4789-871d-8a8ffc4e0612] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:24.729871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05611b73-d208-4a18-a0e7-eff3c530bb36 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:24.730748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05611b73-d208-4a18-a0e7-eff3c530bb36 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:24.731344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05611b73-d208-4a18-a0e7-eff3c530bb36 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:24.734957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05611b73-d208-4a18-a0e7-eff3c530bb36 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:24.735753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05611b73-d208-4a18-a0e7-eff3c530bb36 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:24.736343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05611b73-d208-4a18-a0e7-eff3c530bb36 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:24.956312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b9f56065-3677-400c-a19d-c048da28c7fa tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:24.958202 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b9f56065-3677-400c-a19d-c048da28c7fa tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:24.976336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9f56065-3677-400c-a19d-c048da28c7fa tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:24.984312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9f56065-3677-400c-a19d-c048da28c7fa tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:24.985025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9f56065-3677-400c-a19d-c048da28c7fa tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:24.986028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9f56065-3677-400c-a19d-c048da28c7fa tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:24.988149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9f56065-3677-400c-a19d-c048da28c7fa tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:24.989316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9f56065-3677-400c-a19d-c048da28c7fa tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:25.153356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-05611b73-d208-4a18-a0e7-eff3c530bb36 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:25.176500 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-05611b73-d208-4a18-a0e7-eff3c530bb36 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea87f606-60c3-4789-871d-8a8ffc4e0612" status: 200 len: 1517 microversion: 2.1 time: 0.463854 Aug 24 10:22:25.197814 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1356/2429] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:24 2022] GET /compute/v2.1/servers/ea87f606-60c3-4789-871d-8a8ffc4e0612 => generated 1517 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:22:25.226107 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bc3581be-51a7-46bb-a486-4bc9d11d4e9b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:25.227251 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bc3581be-51a7-46bb-a486-4bc9d11d4e9b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: 8a4ddf34-af18-4e02-a306-c1c67f5c0b28] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:25.240875 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc3581be-51a7-46bb-a486-4bc9d11d4e9b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:25.241408 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc3581be-51a7-46bb-a486-4bc9d11d4e9b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:25.243639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc3581be-51a7-46bb-a486-4bc9d11d4e9b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:25.244950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc3581be-51a7-46bb-a486-4bc9d11d4e9b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:25.247895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc3581be-51a7-46bb-a486-4bc9d11d4e9b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:25.248500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc3581be-51a7-46bb-a486-4bc9d11d4e9b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:25.825218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bc3581be-51a7-46bb-a486-4bc9d11d4e9b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:25.840739 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bc3581be-51a7-46bb-a486-4bc9d11d4e9b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28" status: 200 len: 1473 microversion: 2.1 time: 0.638573 Aug 24 10:22:25.862877 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1357/2430] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:25 2022] GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28 => generated 1473 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:25.868923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ed883836-6efd-4317-be72-9156a5095798 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:25.869911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ed883836-6efd-4317-be72-9156a5095798 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:25.877429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed883836-6efd-4317-be72-9156a5095798 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:25.878251 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed883836-6efd-4317-be72-9156a5095798 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:25.878946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed883836-6efd-4317-be72-9156a5095798 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:25.879960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed883836-6efd-4317-be72-9156a5095798 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:25.880744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed883836-6efd-4317-be72-9156a5095798 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:25.881407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed883836-6efd-4317-be72-9156a5095798 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:26.022213 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ed883836-6efd-4317-be72-9156a5095798 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d264ad8190a4cd9be236d05564fe1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5264f4afb64ba9927050b9b94d37a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:26.034091 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ed883836-6efd-4317-be72-9156a5095798 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08" status: 200 len: 1302 microversion: 2.1 time: 0.169506 Aug 24 10:22:26.037487 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1358/2431] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:25 2022] GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 => generated 1302 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:26.335902 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-16a5f418-f6e6-4b31-9a6d-3b08bd687c2f tempest-TenantUsagesNegativeTestJSON-687064684 tempest-TenantUsagesNegativeTestJSON-687064684-project-admin] 10.222.0.85 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-23T10%3A22%3A25.351591&end=2022-08-25T10%3A22%3A25.351591" status: 404 len: 112 microversion: - time: 0.297030 Aug 24 10:22:26.336834 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1359/2432] 10.222.0.85 () {58 vars in 1316 bytes} [Wed Aug 24 10:22:26 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-23T10%3A22%3A25.351591&end=2022-08-25T10%3A22%3A25.351591 => generated 112 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 10:22:26.345233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fdbd376d-3ed1-4e9d-aa13-572631458173 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:26.345865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fdbd376d-3ed1-4e9d-aa13-572631458173 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:26.366414 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdbd376d-3ed1-4e9d-aa13-572631458173 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:26.366925 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdbd376d-3ed1-4e9d-aa13-572631458173 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:26.367475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdbd376d-3ed1-4e9d-aa13-572631458173 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:26.368187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdbd376d-3ed1-4e9d-aa13-572631458173 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:26.368652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdbd376d-3ed1-4e9d-aa13-572631458173 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:26.369539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdbd376d-3ed1-4e9d-aa13-572631458173 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:26.597770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b9f56065-3677-400c-a19d-c048da28c7fa tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:26.615808 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b9f56065-3677-400c-a19d-c048da28c7fa tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1391 microversion: 2.1 time: 1.664490 Aug 24 10:22:26.617166 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1074/2433] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:24 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1391 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:22:26.628510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3f7db2db-4d6b-499c-bc18-73f686483239 req-499f6c31-12ec-4a8c-82bf-fe0d24ecca55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a599e1a2-3ca0-4cde-b11c-ef5e069065f9", "tag": "1799c04a-1694-4f6d-a4a7-2c35d555e841"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:26.652033 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3f7db2db-4d6b-499c-bc18-73f686483239 req-499f6c31-12ec-4a8c-82bf-fe0d24ecca55 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:26.652985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3f7db2db-4d6b-499c-bc18-73f686483239 req-499f6c31-12ec-4a8c-82bf-fe0d24ecca55 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:26.653668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3f7db2db-4d6b-499c-bc18-73f686483239 req-499f6c31-12ec-4a8c-82bf-fe0d24ecca55 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:26.700009 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3f7db2db-4d6b-499c-bc18-73f686483239 req-499f6c31-12ec-4a8c-82bf-fe0d24ecca55 service nova] Creating event network-changed:1799c04a-1694-4f6d-a4a7-2c35d555e841 for instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 on n-h1-849328-3 Aug 24 10:22:26.712601 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3f7db2db-4d6b-499c-bc18-73f686483239 req-499f6c31-12ec-4a8c-82bf-fe0d24ecca55 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092262 Aug 24 10:22:26.714068 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1075/2434] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:26.725586 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f34dbc2b-0041-4580-b024-cfdba3899b03 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:26.727322 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f34dbc2b-0041-4580-b024-cfdba3899b03 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:26.735153 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f34dbc2b-0041-4580-b024-cfdba3899b03 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:26.735646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f34dbc2b-0041-4580-b024-cfdba3899b03 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:26.736091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f34dbc2b-0041-4580-b024-cfdba3899b03 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:26.736806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f34dbc2b-0041-4580-b024-cfdba3899b03 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:26.737410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f34dbc2b-0041-4580-b024-cfdba3899b03 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:26.738003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f34dbc2b-0041-4580-b024-cfdba3899b03 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:27.005449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fdbd376d-3ed1-4e9d-aa13-572631458173 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:27.014621 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fdbd376d-3ed1-4e9d-aa13-572631458173 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1355 microversion: 2.1 time: 0.676499 Aug 24 10:22:27.024412 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1360/2435] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:26 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1355 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:27.041988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a7f23827-62ba-48a5-bcfa-e10cb75423fb tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:27.054272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a7f23827-62ba-48a5-bcfa-e10cb75423fb tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: ea87f606-60c3-4789-871d-8a8ffc4e0612] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:27.062865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7f23827-62ba-48a5-bcfa-e10cb75423fb tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:27.063883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7f23827-62ba-48a5-bcfa-e10cb75423fb tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:27.064293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7f23827-62ba-48a5-bcfa-e10cb75423fb tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:27.065092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7f23827-62ba-48a5-bcfa-e10cb75423fb tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:27.065582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7f23827-62ba-48a5-bcfa-e10cb75423fb tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:27.066089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7f23827-62ba-48a5-bcfa-e10cb75423fb tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:27.297564 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f34dbc2b-0041-4580-b024-cfdba3899b03 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:27.309108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f34dbc2b-0041-4580-b024-cfdba3899b03 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:27.316436 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f34dbc2b-0041-4580-b024-cfdba3899b03 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:27.318539 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f34dbc2b-0041-4580-b024-cfdba3899b03 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1365 microversion: 2.47 time: 0.600701 Aug 24 10:22:27.334989 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1076/2436] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:26 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1365 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:27.373094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5d19de9b-cba3-4052-9460-b95fed345201 tempest-TenantUsagesNegativeTestJSON-687064684 tempest-TenantUsagesNegativeTestJSON-687064684-project-admin] Calling method '.version_select at 0x7f4655345280>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:27.380564 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-5d19de9b-cba3-4052-9460-b95fed345201 tempest-TenantUsagesNegativeTestJSON-687064684 tempest-TenantUsagesNegativeTestJSON-687064684-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5d19de9b-cba3-4052-9460-b95fed345201 tempest-TenantUsagesNegativeTestJSON-687064684 tempest-TenantUsagesNegativeTestJSON-687064684-project-admin] Request method failure captured: Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-simple-tenant-usage/d1e7af63c0994601b984819714a72540?start=2022-08-25T10%3A22%3A25.351591&end=2022-08-23T10%3A22%3A25.351591 HTTP/1.1 Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfvhxlrDj8x61FEiuzuzBOkssrPpY0-ATX1k9J7z6qmvwIPnrvz5Ewzrb4cB7KgE2FJ0CNqSoYhI1nSL897OkU4oeK9oEu9LjiJ7wLkCuMgzhS6vxL5b2tUILEZJkl9LvezYhtH2TH1DOeI2Bqu-nDXDD5EN748_ms3ZIo0yzeMdfSA Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: dff55781f4534552842cc492e607c56e Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-687064684 Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,admin,member Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,admin,member Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/dff55781f4534552842cc492e607c56e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_dff55781f4534552842cc492e607c56e", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/dff55781f4534552842cc492e607c56e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/dff55781f4534552842cc492e607c56e"}]}] Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-687064684 Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: dff55781f4534552842cc492e607c56e Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-687064684 Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-TenantUsagesNegativeTestJSON-687064684-project-admin Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 3819892568654869aaede73919e530b1 Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-687064684-project-admin Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: exception: Invalid start time. The start time cannot occur after the end time. Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'd1e7af63c0994601b984819714a72540'} Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 24 10:22:27.396397 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:22:27.403776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5d19de9b-cba3-4052-9460-b95fed345201 tempest-TenantUsagesNegativeTestJSON-687064684 tempest-TenantUsagesNegativeTestJSON-687064684-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:22:27.406047 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5d19de9b-cba3-4052-9460-b95fed345201 tempest-TenantUsagesNegativeTestJSON-687064684 tempest-TenantUsagesNegativeTestJSON-687064684-project-admin] 10.222.0.85 "GET /compute/v2.1/os-simple-tenant-usage/d1e7af63c0994601b984819714a72540?start=2022-08-25T10%3A22%3A25.351591&end=2022-08-23T10%3A22%3A25.351591" status: 400 len: 111 microversion: 2.1 time: 0.069827 Aug 24 10:22:27.407388 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1077/2437] 10.222.0.85 () {58 vars in 1412 bytes} [Wed Aug 24 10:22:27 2022] GET /compute/v2.1/os-simple-tenant-usage/d1e7af63c0994601b984819714a72540?start=2022-08-25T10%3A22%3A25.351591&end=2022-08-23T10%3A22%3A25.351591 => generated 111 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:22:27.425510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d3e7574e-3b3f-4efa-9d5c-f7d514596d83 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:27.428707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d3e7574e-3b3f-4efa-9d5c-f7d514596d83 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: 8a4ddf34-af18-4e02-a306-c1c67f5c0b28] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:27.462615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3e7574e-3b3f-4efa-9d5c-f7d514596d83 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:27.463492 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3e7574e-3b3f-4efa-9d5c-f7d514596d83 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:27.465059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3e7574e-3b3f-4efa-9d5c-f7d514596d83 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:27.466394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3e7574e-3b3f-4efa-9d5c-f7d514596d83 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:27.467307 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3e7574e-3b3f-4efa-9d5c-f7d514596d83 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:27.468893 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3e7574e-3b3f-4efa-9d5c-f7d514596d83 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:27.611797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a7f23827-62ba-48a5-bcfa-e10cb75423fb tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:27.637374 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a7f23827-62ba-48a5-bcfa-e10cb75423fb tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea87f606-60c3-4789-871d-8a8ffc4e0612" status: 200 len: 1517 microversion: 2.1 time: 0.611561 Aug 24 10:22:27.638094 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1361/2438] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:27 2022] GET /compute/v2.1/servers/ea87f606-60c3-4789-871d-8a8ffc4e0612 => generated 1517 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:27.656215 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-74a19e24-a998-4ba4-938a-374872f36235 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:27.663618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-74a19e24-a998-4ba4-938a-374872f36235 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:27.687054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74a19e24-a998-4ba4-938a-374872f36235 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:27.687829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74a19e24-a998-4ba4-938a-374872f36235 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:27.690372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74a19e24-a998-4ba4-938a-374872f36235 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:27.691478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74a19e24-a998-4ba4-938a-374872f36235 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:27.695685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74a19e24-a998-4ba4-938a-374872f36235 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:27.696451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74a19e24-a998-4ba4-938a-374872f36235 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:28.066015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-74a19e24-a998-4ba4-938a-374872f36235 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d264ad8190a4cd9be236d05564fe1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5264f4afb64ba9927050b9b94d37a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:28.085530 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-74a19e24-a998-4ba4-938a-374872f36235 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08" status: 200 len: 1369 microversion: 2.1 time: 0.433712 Aug 24 10:22:28.091098 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1362/2439] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:27 2022] GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 => generated 1369 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:28.390847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-02ea0d82-6f21-4673-9467-ce62437d7714 tempest-TenantUsagesNegativeTestJSON-1337020464 tempest-TenantUsagesNegativeTestJSON-1337020464-project] Calling method '.version_select at 0x7f465462e790>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:28.400560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-02ea0d82-6f21-4673-9467-ce62437d7714 tempest-TenantUsagesNegativeTestJSON-1337020464 tempest-TenantUsagesNegativeTestJSON-1337020464-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '2664fe91f66145dc957453fbc4b91867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e7af63c0994601b984819714a72540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-02ea0d82-6f21-4673-9467-ce62437d7714 tempest-TenantUsagesNegativeTestJSON-1337020464 tempest-TenantUsagesNegativeTestJSON-1337020464-project] Request method failure captured: Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-23T10%3A22%3A25.351591&end=2022-08-25T10%3A22%3A25.351591&detailed=1 HTTP/1.1 Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfvfFp-FmW5cYbp1lx4J12c5dxBWppM-npMtJcfkUnZrpCa7v62rLymVUCt3jmx1WLcRDIjBKfZlk-k8RK9QUeK54DA9bZEsp6RPu_UmPaLYfLC_Z4TlBqpVRKnZB6TsLwjZMyUfVbk55CkIDZsF_o1NW82h3GDkTHuP1fmjSAnRPkk Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d1e7af63c0994601b984819714a72540 Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1337020464 Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1e7af63c0994601b984819714a72540"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d1e7af63c0994601b984819714a72540", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1e7af63c0994601b984819714a72540"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d1e7af63c0994601b984819714a72540"}]}] Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1337020464 Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d1e7af63c0994601b984819714a72540 Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1337020464 Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TenantUsagesNegativeTestJSON-1337020464-project Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 2664fe91f66145dc957453fbc4b91867 Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1337020464-project Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: action_args: {} Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:22:28.407169 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:22:28.411661 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:22:28.411661 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 24 10:22:28.411661 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:22:28.411661 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:28.411661 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:22:28.411661 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:28.411661 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:28.411661 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:28.411661 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:22:28.411661 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:22:28.411661 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 24 10:22:28.411661 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:22:28.411661 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-02ea0d82-6f21-4673-9467-ce62437d7714 tempest-TenantUsagesNegativeTestJSON-1337020464 tempest-TenantUsagesNegativeTestJSON-1337020464-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:22:28.411661 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-02ea0d82-6f21-4673-9467-ce62437d7714 tempest-TenantUsagesNegativeTestJSON-1337020464 tempest-TenantUsagesNegativeTestJSON-1337020464-project] 10.222.0.85 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-23T10%3A22%3A25.351591&end=2022-08-25T10%3A22%3A25.351591&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.316931 Aug 24 10:22:28.416013 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1363/2440] 10.222.0.85 () {58 vars in 1335 bytes} [Wed Aug 24 10:22:28 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-23T10%3A22%3A25.351591&end=2022-08-25T10%3A22%3A25.351591&detailed=1 => generated 123 bytes in 324 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:22:28.434301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5ba62275-2272-451c-b5ce-1d2e62ce68e3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:28.435587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5ba62275-2272-451c-b5ce-1d2e62ce68e3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:28.467443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ba62275-2272-451c-b5ce-1d2e62ce68e3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:28.471447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ba62275-2272-451c-b5ce-1d2e62ce68e3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:28.473356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ba62275-2272-451c-b5ce-1d2e62ce68e3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:28.474728 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ba62275-2272-451c-b5ce-1d2e62ce68e3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:28.475287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ba62275-2272-451c-b5ce-1d2e62ce68e3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:28.475762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ba62275-2272-451c-b5ce-1d2e62ce68e3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:28.519148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d3e7574e-3b3f-4efa-9d5c-f7d514596d83 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:28.528047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:28.531812 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d3e7574e-3b3f-4efa-9d5c-f7d514596d83 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28" status: 200 len: 1431 microversion: 2.1 time: 1.122936 Aug 24 10:22:28.546039 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1078/2441] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:27 2022] GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28 => generated 1431 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:28.554148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9dbee007-ef0b-4f8f-b689-2d505bf1d0ac req-ce77e9a8-eb0c-4a4f-902a-98b9cf937f44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a4ddf34-af18-4e02-a306-c1c67f5c0b28", "name": "network-vif-deleted", "tag": "21445c55-f24c-46da-9946-53b2566a219f"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:28.566509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9dbee007-ef0b-4f8f-b689-2d505bf1d0ac req-ce77e9a8-eb0c-4a4f-902a-98b9cf937f44 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:28.567374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9dbee007-ef0b-4f8f-b689-2d505bf1d0ac req-ce77e9a8-eb0c-4a4f-902a-98b9cf937f44 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:28.568033 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9dbee007-ef0b-4f8f-b689-2d505bf1d0ac req-ce77e9a8-eb0c-4a4f-902a-98b9cf937f44 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:28.581745 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9dbee007-ef0b-4f8f-b689-2d505bf1d0ac req-ce77e9a8-eb0c-4a4f-902a-98b9cf937f44 service nova] Creating event network-vif-deleted:21445c55-f24c-46da-9946-53b2566a219f for instance 8a4ddf34-af18-4e02-a306-c1c67f5c0b28 on n-h2-849328-3 Aug 24 10:22:28.588431 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9dbee007-ef0b-4f8f-b689-2d505bf1d0ac req-ce77e9a8-eb0c-4a4f-902a-98b9cf937f44 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040096 Aug 24 10:22:28.589872 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1079/2442] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:28.600977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-82ede1a1-2111-4692-ba8e-563f4bb74bb4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:28.602285 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-82ede1a1-2111-4692-ba8e-563f4bb74bb4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:28.626056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82ede1a1-2111-4692-ba8e-563f4bb74bb4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:28.632619 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82ede1a1-2111-4692-ba8e-563f4bb74bb4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:28.633397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82ede1a1-2111-4692-ba8e-563f4bb74bb4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:28.639947 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82ede1a1-2111-4692-ba8e-563f4bb74bb4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:28.640454 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82ede1a1-2111-4692-ba8e-563f4bb74bb4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:28.641039 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82ede1a1-2111-4692-ba8e-563f4bb74bb4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:28.758074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5ba62275-2272-451c-b5ce-1d2e62ce68e3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:28.781094 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5ba62275-2272-451c-b5ce-1d2e62ce68e3 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1391 microversion: 2.1 time: 0.363541 Aug 24 10:22:28.783086 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1364/2443] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:28 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1391 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:28.796002 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e08a06bd-79a3-4dea-aa53-e7ef980418e9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:28.797215 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e08a06bd-79a3-4dea-aa53-e7ef980418e9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:28.816882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e08a06bd-79a3-4dea-aa53-e7ef980418e9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:28.818510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e08a06bd-79a3-4dea-aa53-e7ef980418e9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:28.820293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e08a06bd-79a3-4dea-aa53-e7ef980418e9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:28.824009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e08a06bd-79a3-4dea-aa53-e7ef980418e9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:28.825646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e08a06bd-79a3-4dea-aa53-e7ef980418e9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:28.826791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e08a06bd-79a3-4dea-aa53-e7ef980418e9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:29.253719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e08a06bd-79a3-4dea-aa53-e7ef980418e9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:29.279003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e08a06bd-79a3-4dea-aa53-e7ef980418e9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:29.285511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e08a06bd-79a3-4dea-aa53-e7ef980418e9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:29.294338 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e08a06bd-79a3-4dea-aa53-e7ef980418e9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1365 microversion: 2.47 time: 0.507235 Aug 24 10:22:29.307161 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1365/2444] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:28 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1365 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:29.321065 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1e26c808-f877-4b9b-990f-97ccb7c3210a tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:29.324068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1e26c808-f877-4b9b-990f-97ccb7c3210a tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: ea87f606-60c3-4789-871d-8a8ffc4e0612] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:29.340431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e26c808-f877-4b9b-990f-97ccb7c3210a tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:29.342149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e26c808-f877-4b9b-990f-97ccb7c3210a tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:29.343589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e26c808-f877-4b9b-990f-97ccb7c3210a tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:29.346061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e26c808-f877-4b9b-990f-97ccb7c3210a tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:29.348135 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e26c808-f877-4b9b-990f-97ccb7c3210a tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:29.349732 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e26c808-f877-4b9b-990f-97ccb7c3210a tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:29.410555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-82ede1a1-2111-4692-ba8e-563f4bb74bb4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:29.452410 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-82ede1a1-2111-4692-ba8e-563f4bb74bb4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1355 microversion: 2.1 time: 0.860512 Aug 24 10:22:29.458578 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1080/2445] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:28 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1355 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:29.473320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-98169939-0a5a-4f02-99a7-abd1aa5567ae tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:29.475365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-98169939-0a5a-4f02-99a7-abd1aa5567ae tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:29.488259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e26c808-f877-4b9b-990f-97ccb7c3210a tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:29.489479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e26c808-f877-4b9b-990f-97ccb7c3210a tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:29.492012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e26c808-f877-4b9b-990f-97ccb7c3210a tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:29.496885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-1e26c808-f877-4b9b-990f-97ccb7c3210a tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lazy-loading 'fault' on Instance uuid ea87f606-60c3-4789-871d-8a8ffc4e0612 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:22:29.497024 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98169939-0a5a-4f02-99a7-abd1aa5567ae tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:29.500057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98169939-0a5a-4f02-99a7-abd1aa5567ae tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:29.500786 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98169939-0a5a-4f02-99a7-abd1aa5567ae tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:29.501772 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98169939-0a5a-4f02-99a7-abd1aa5567ae tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:29.503105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98169939-0a5a-4f02-99a7-abd1aa5567ae tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:29.505369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98169939-0a5a-4f02-99a7-abd1aa5567ae tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:29.628609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1e26c808-f877-4b9b-990f-97ccb7c3210a tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:29.640446 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1e26c808-f877-4b9b-990f-97ccb7c3210a tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea87f606-60c3-4789-871d-8a8ffc4e0612" status: 200 len: 1310 microversion: 2.1 time: 0.338062 Aug 24 10:22:29.641076 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1366/2446] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:29 2022] GET /compute/v2.1/servers/ea87f606-60c3-4789-871d-8a8ffc4e0612 => generated 1310 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:29.657668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-af1bc0d2-f6c4-4d7d-9aba-12667da0af9b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:29.658294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-af1bc0d2-f6c4-4d7d-9aba-12667da0af9b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: 8a4ddf34-af18-4e02-a306-c1c67f5c0b28] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:29.669434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af1bc0d2-f6c4-4d7d-9aba-12667da0af9b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:29.669928 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af1bc0d2-f6c4-4d7d-9aba-12667da0af9b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:29.670428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af1bc0d2-f6c4-4d7d-9aba-12667da0af9b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:29.671140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af1bc0d2-f6c4-4d7d-9aba-12667da0af9b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:29.671603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af1bc0d2-f6c4-4d7d-9aba-12667da0af9b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:29.677368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af1bc0d2-f6c4-4d7d-9aba-12667da0af9b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:29.710068 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-af1bc0d2-f6c4-4d7d-9aba-12667da0af9b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] HTTP exception thrown: Instance 8a4ddf34-af18-4e02-a306-c1c67f5c0b28 could not be found. Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-af1bc0d2-f6c4-4d7d-9aba-12667da0af9b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Request method failure captured: Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28 HTTP/1.1 Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfs261LzsKgWADAKqtH5FXD2KrvVOdGixTvLaPQOF4IzI3yce50JOpfKAgifoGowIyP5WLjePeCoC89Wm1LJACIddiDIWAQl8p0qqSFIUffDLAxmq_m6HdvZrEEdDppj11hD-8m5C7k5Ori0mOcXCRWDkmQXaxKpu7x2Js2aGUJWmtY Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 6b951c1be813434898ac93429f2064d6 Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ListImageFiltersTestJSON-1534391697 Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6b951c1be813434898ac93429f2064d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6b951c1be813434898ac93429f2064d6", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6b951c1be813434898ac93429f2064d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6b951c1be813434898ac93429f2064d6"}]}] Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ListImageFiltersTestJSON-1534391697 Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 6b951c1be813434898ac93429f2064d6 Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1534391697 Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ListImageFiltersTestJSON-1534391697-project Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: cba7af3841d9463ca5abc1a7de6f722a Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ListImageFiltersTestJSON-1534391697-project Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 8a4ddf34-af18-4e02-a306-c1c67f5c0b28 could not be found. Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '8a4ddf34-af18-4e02-a306-c1c67f5c0b28'} Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a4ddf34-af18-4e02-a306-c1c67f5c0b28 could not be found. Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a4ddf34-af18-4e02-a306-c1c67f5c0b28 could not be found. Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:29.711803 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:22:29.715552 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:29.715552 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:29.715552 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:29.715552 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:22:29.715552 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:22:29.715552 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a4ddf34-af18-4e02-a306-c1c67f5c0b28 could not be found. Aug 24 10:22:29.715552 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:22:29.719159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-af1bc0d2-f6c4-4d7d-9aba-12667da0af9b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Returning 404 to user: Instance 8a4ddf34-af18-4e02-a306-c1c67f5c0b28 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:22:29.720167 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-af1bc0d2-f6c4-4d7d-9aba-12667da0af9b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28" status: 404 len: 111 microversion: 2.1 time: 0.078013 Aug 24 10:22:29.721346 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1367/2447] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:29 2022] GET /compute/v2.1/servers/8a4ddf34-af18-4e02-a306-c1c67f5c0b28 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:22:29.730599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-68ca140d-0f24-4fd9-b48a-06ab515def3b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:29.731098 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-68ca140d-0f24-4fd9-b48a-06ab515def3b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:29.745227 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68ca140d-0f24-4fd9-b48a-06ab515def3b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:29.745726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68ca140d-0f24-4fd9-b48a-06ab515def3b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:29.746160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68ca140d-0f24-4fd9-b48a-06ab515def3b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:29.746867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68ca140d-0f24-4fd9-b48a-06ab515def3b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:29.747320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68ca140d-0f24-4fd9-b48a-06ab515def3b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:29.747739 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68ca140d-0f24-4fd9-b48a-06ab515def3b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:29.793110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-68ca140d-0f24-4fd9-b48a-06ab515def3b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:22:29.877358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:29.951293 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-68ca140d-0f24-4fd9-b48a-06ab515def3b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "DELETE /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb" status: 204 len: 0 microversion: 2.1 time: 0.224120 Aug 24 10:22:29.955635 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1368/2448] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:22:29 2022] DELETE /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 10:22:29.960890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de68472a-c672-4c2a-9f10-adc1fbccf0d8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:29.961970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-de68472a-c672-4c2a-9f10-adc1fbccf0d8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:29.972078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de68472a-c672-4c2a-9f10-adc1fbccf0d8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:29.972767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de68472a-c672-4c2a-9f10-adc1fbccf0d8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:29.973602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de68472a-c672-4c2a-9f10-adc1fbccf0d8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:29.974434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de68472a-c672-4c2a-9f10-adc1fbccf0d8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:29.975147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de68472a-c672-4c2a-9f10-adc1fbccf0d8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:29.975870 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de68472a-c672-4c2a-9f10-adc1fbccf0d8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:30.035502 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-98169939-0a5a-4f02-99a7-abd1aa5567ae tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d264ad8190a4cd9be236d05564fe1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5264f4afb64ba9927050b9b94d37a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:30.045706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:30.051247 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-98169939-0a5a-4f02-99a7-abd1aa5567ae tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08" status: 200 len: 1369 microversion: 2.1 time: 0.590355 Aug 24 10:22:30.058188 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1081/2449] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:29 2022] GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 => generated 1369 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:30.064099 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3cfbb628-82b2-4556-b5eb-c578f036256d tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:30.074364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3cfbb628-82b2-4556-b5eb-c578f036256d tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:30.081015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cfbb628-82b2-4556-b5eb-c578f036256d tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:30.081845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cfbb628-82b2-4556-b5eb-c578f036256d tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:30.082510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cfbb628-82b2-4556-b5eb-c578f036256d tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:30.083436 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cfbb628-82b2-4556-b5eb-c578f036256d tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:30.084087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cfbb628-82b2-4556-b5eb-c578f036256d tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:30.084733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cfbb628-82b2-4556-b5eb-c578f036256d tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:30.179546 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-de68472a-c672-4c2a-9f10-adc1fbccf0d8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:30.215520 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-de68472a-c672-4c2a-9f10-adc1fbccf0d8 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1391 microversion: 2.1 time: 0.258951 Aug 24 10:22:30.233219 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1369/2450] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:29 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1391 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:30.253623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-85a6cf11-0e27-4cdc-8422-7e456b0c18f3 req-8f2c044b-4da6-4b31-8663-65062885e2ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a599e1a2-3ca0-4cde-b11c-ef5e069065f9", "tag": "bb7f920a-c727-4e7e-a723-2d9a8f9a07b9"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:30.265848 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-85a6cf11-0e27-4cdc-8422-7e456b0c18f3 req-8f2c044b-4da6-4b31-8663-65062885e2ce service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:30.267153 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-85a6cf11-0e27-4cdc-8422-7e456b0c18f3 req-8f2c044b-4da6-4b31-8663-65062885e2ce service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:30.267954 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-85a6cf11-0e27-4cdc-8422-7e456b0c18f3 req-8f2c044b-4da6-4b31-8663-65062885e2ce service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:30.282819 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-85a6cf11-0e27-4cdc-8422-7e456b0c18f3 req-8f2c044b-4da6-4b31-8663-65062885e2ce service nova] Creating event network-changed:bb7f920a-c727-4e7e-a723-2d9a8f9a07b9 for instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 on n-h1-849328-3 Aug 24 10:22:30.289734 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-85a6cf11-0e27-4cdc-8422-7e456b0c18f3 req-8f2c044b-4da6-4b31-8663-65062885e2ce service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040959 Aug 24 10:22:30.291149 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1370/2451] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:30.360840 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ef6fe95-201f-49df-999e-01cac50e65bc tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:30.363140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0ef6fe95-201f-49df-999e-01cac50e65bc tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:30.386871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ef6fe95-201f-49df-999e-01cac50e65bc tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:30.387953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ef6fe95-201f-49df-999e-01cac50e65bc tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:30.388956 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ef6fe95-201f-49df-999e-01cac50e65bc tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:30.390616 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ef6fe95-201f-49df-999e-01cac50e65bc tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:30.391517 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ef6fe95-201f-49df-999e-01cac50e65bc tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:30.392278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ef6fe95-201f-49df-999e-01cac50e65bc tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:30.470494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3cfbb628-82b2-4556-b5eb-c578f036256d tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:30.484774 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3cfbb628-82b2-4556-b5eb-c578f036256d tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb" status: 200 len: 1474 microversion: 2.1 time: 0.424753 Aug 24 10:22:30.486146 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1082/2452] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:30 2022] GET /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb => generated 1474 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:30.521589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-33511f10-ec36-42fe-a3dc-ab53e89556e8 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:30.523806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-33511f10-ec36-42fe-a3dc-ab53e89556e8 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:30.539022 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33511f10-ec36-42fe-a3dc-ab53e89556e8 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:30.540108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33511f10-ec36-42fe-a3dc-ab53e89556e8 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:30.541435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33511f10-ec36-42fe-a3dc-ab53e89556e8 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:30.542884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33511f10-ec36-42fe-a3dc-ab53e89556e8 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:30.544075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33511f10-ec36-42fe-a3dc-ab53e89556e8 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:30.544835 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33511f10-ec36-42fe-a3dc-ab53e89556e8 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:30.595922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0ef6fe95-201f-49df-999e-01cac50e65bc tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:30.606313 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0ef6fe95-201f-49df-999e-01cac50e65bc tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:30.607894 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0ef6fe95-201f-49df-999e-01cac50e65bc tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:30.609151 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0ef6fe95-201f-49df-999e-01cac50e65bc tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1365 microversion: 2.47 time: 0.260108 Aug 24 10:22:30.609733 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1371/2453] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:30 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1365 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:30.634040 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-53e2c929-6f12-4d49-8345-4449b2fd158b req-ed7cc4d4-02d1-432b-ac2a-a6f50b209030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea87f606-60c3-4789-871d-8a8ffc4e0612", "name": "network-vif-deleted", "tag": "f501317e-11b3-4f9f-8312-685e663cffdb"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:30.644720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-53e2c929-6f12-4d49-8345-4449b2fd158b req-ed7cc4d4-02d1-432b-ac2a-a6f50b209030 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:30.645269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-53e2c929-6f12-4d49-8345-4449b2fd158b req-ed7cc4d4-02d1-432b-ac2a-a6f50b209030 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:30.645706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-53e2c929-6f12-4d49-8345-4449b2fd158b req-ed7cc4d4-02d1-432b-ac2a-a6f50b209030 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:30.658523 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-53e2c929-6f12-4d49-8345-4449b2fd158b req-ed7cc4d4-02d1-432b-ac2a-a6f50b209030 service nova] Creating event network-vif-deleted:f501317e-11b3-4f9f-8312-685e663cffdb for instance ea87f606-60c3-4789-871d-8a8ffc4e0612 on n-h2-849328-3 Aug 24 10:22:30.664862 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-53e2c929-6f12-4d49-8345-4449b2fd158b req-ed7cc4d4-02d1-432b-ac2a-a6f50b209030 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034538 Aug 24 10:22:30.665877 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1372/2454] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:22:30.672810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-18b5f79b-2524-41f6-8cf7-71fd8ac5d45f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:30.673546 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-18b5f79b-2524-41f6-8cf7-71fd8ac5d45f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: ea87f606-60c3-4789-871d-8a8ffc4e0612] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:30.684763 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18b5f79b-2524-41f6-8cf7-71fd8ac5d45f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:30.685306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18b5f79b-2524-41f6-8cf7-71fd8ac5d45f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:30.685741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18b5f79b-2524-41f6-8cf7-71fd8ac5d45f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:30.687196 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18b5f79b-2524-41f6-8cf7-71fd8ac5d45f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:30.687196 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18b5f79b-2524-41f6-8cf7-71fd8ac5d45f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:30.687385 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18b5f79b-2524-41f6-8cf7-71fd8ac5d45f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:30.702136 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-18b5f79b-2524-41f6-8cf7-71fd8ac5d45f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] HTTP exception thrown: Instance ea87f606-60c3-4789-871d-8a8ffc4e0612 could not be found. Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-18b5f79b-2524-41f6-8cf7-71fd8ac5d45f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Request method failure captured: Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/ea87f606-60c3-4789-871d-8a8ffc4e0612 HTTP/1.1 Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBftwtkhYP4zVF4PKA_bbCUujMmaUgoOlVaJMarOwcdHu-Cd_fF_suW9VbHy5cTzlyLKYgAm3UtbAsusltb4Lqx0usRchQC4NUtKIzb7RzB_Wo4hVkJ-Yah_B2FWA6LQhnHChV92UclDGeBzsxsDDJri9vE4dJhKtXY4OkSfVmRZaA_k Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 4b648a28a11e4016a1fe87ea6b6f01b2 Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ListServerFiltersTestJSON-769713699 Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/4b648a28a11e4016a1fe87ea6b6f01b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_4b648a28a11e4016a1fe87ea6b6f01b2", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/4b648a28a11e4016a1fe87ea6b6f01b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/4b648a28a11e4016a1fe87ea6b6f01b2"}]}] Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ListServerFiltersTestJSON-769713699 Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 4b648a28a11e4016a1fe87ea6b6f01b2 Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-769713699 Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ListServerFiltersTestJSON-769713699-project Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: d4163d2bb72c43e7b0315c5e782d5fa7 Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ListServerFiltersTestJSON-769713699-project Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance ea87f606-60c3-4789-871d-8a8ffc4e0612 could not be found. Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'ea87f606-60c3-4789-871d-8a8ffc4e0612'} Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea87f606-60c3-4789-871d-8a8ffc4e0612 could not be found. Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea87f606-60c3-4789-871d-8a8ffc4e0612 could not be found. Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:30.703819 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:22:30.713145 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:30.713145 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:30.713145 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:30.713145 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:22:30.713145 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:22:30.713145 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea87f606-60c3-4789-871d-8a8ffc4e0612 could not be found. Aug 24 10:22:30.713145 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:22:30.713145 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-18b5f79b-2524-41f6-8cf7-71fd8ac5d45f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Returning 404 to user: Instance ea87f606-60c3-4789-871d-8a8ffc4e0612 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:22:30.713145 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-18b5f79b-2524-41f6-8cf7-71fd8ac5d45f tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea87f606-60c3-4789-871d-8a8ffc4e0612" status: 404 len: 111 microversion: 2.1 time: 0.038283 Aug 24 10:22:30.713145 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1373/2455] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:30 2022] GET /compute/v2.1/servers/ea87f606-60c3-4789-871d-8a8ffc4e0612 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:22:30.715674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-02a54d6c-b9a1-41a3-a58a-1ef41d37c181 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:30.715674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-02a54d6c-b9a1-41a3-a58a-1ef41d37c181 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: 2bc88682-b0f5-42fc-88e5-a74d75b8e241] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:30.723351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02a54d6c-b9a1-41a3-a58a-1ef41d37c181 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:30.724401 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02a54d6c-b9a1-41a3-a58a-1ef41d37c181 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:30.724847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02a54d6c-b9a1-41a3-a58a-1ef41d37c181 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:30.725594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02a54d6c-b9a1-41a3-a58a-1ef41d37c181 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:30.726162 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02a54d6c-b9a1-41a3-a58a-1ef41d37c181 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:30.727329 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02a54d6c-b9a1-41a3-a58a-1ef41d37c181 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:30.763289 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-02a54d6c-b9a1-41a3-a58a-1ef41d37c181 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: 2bc88682-b0f5-42fc-88e5-a74d75b8e241] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:22:30.801647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=22 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:30.870369 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-02a54d6c-b9a1-41a3-a58a-1ef41d37c181 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "DELETE /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241" status: 204 len: 0 microversion: 2.1 time: 0.157910 Aug 24 10:22:30.874669 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1374/2456] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:22:30 2022] DELETE /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 10:22:30.888035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-989b4881-547e-42b7-888c-1f720cc17414 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:30.888723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-989b4881-547e-42b7-888c-1f720cc17414 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: 2bc88682-b0f5-42fc-88e5-a74d75b8e241] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:30.897306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-989b4881-547e-42b7-888c-1f720cc17414 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:30.897940 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-989b4881-547e-42b7-888c-1f720cc17414 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:30.898389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-989b4881-547e-42b7-888c-1f720cc17414 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:30.899588 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-989b4881-547e-42b7-888c-1f720cc17414 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:30.900049 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-989b4881-547e-42b7-888c-1f720cc17414 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:30.900598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-989b4881-547e-42b7-888c-1f720cc17414 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:30.948961 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-33511f10-ec36-42fe-a3dc-ab53e89556e8 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:30.958770 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-33511f10-ec36-42fe-a3dc-ab53e89556e8 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1355 microversion: 2.1 time: 0.459105 Aug 24 10:22:30.962647 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1083/2457] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:30 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1355 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:31.081051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2378e403-70df-4322-9aa5-c744c8819594 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:31.082530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2378e403-70df-4322-9aa5-c744c8819594 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:31.094096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2378e403-70df-4322-9aa5-c744c8819594 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:31.094978 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2378e403-70df-4322-9aa5-c744c8819594 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:31.095777 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2378e403-70df-4322-9aa5-c744c8819594 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:31.097045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2378e403-70df-4322-9aa5-c744c8819594 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:31.097934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2378e403-70df-4322-9aa5-c744c8819594 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:31.098727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2378e403-70df-4322-9aa5-c744c8819594 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:31.298738 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2378e403-70df-4322-9aa5-c744c8819594 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d264ad8190a4cd9be236d05564fe1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5264f4afb64ba9927050b9b94d37a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:31.309872 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2378e403-70df-4322-9aa5-c744c8819594 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08" status: 200 len: 1369 microversion: 2.1 time: 0.233896 Aug 24 10:22:31.325151 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1084/2458] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:31 2022] GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 => generated 1369 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:31.333589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6783e33f-5a2f-4b95-987b-710126e10627 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:31.334677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6783e33f-5a2f-4b95-987b-710126e10627 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:31.353880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6783e33f-5a2f-4b95-987b-710126e10627 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:31.354564 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6783e33f-5a2f-4b95-987b-710126e10627 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:31.355317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6783e33f-5a2f-4b95-987b-710126e10627 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:31.356311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6783e33f-5a2f-4b95-987b-710126e10627 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:31.357023 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6783e33f-5a2f-4b95-987b-710126e10627 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:31.358805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6783e33f-5a2f-4b95-987b-710126e10627 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:31.374554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-989b4881-547e-42b7-888c-1f720cc17414 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:31.383058 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-989b4881-547e-42b7-888c-1f720cc17414 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241" status: 200 len: 1516 microversion: 2.1 time: 0.504066 Aug 24 10:22:31.385174 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1375/2459] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:30 2022] GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241 => generated 1516 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:31.535831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b241944f-d6c6-405b-b0e7-a04db0243ce9 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:31.537337 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b241944f-d6c6-405b-b0e7-a04db0243ce9 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:31.550078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b241944f-d6c6-405b-b0e7-a04db0243ce9 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:31.552373 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b241944f-d6c6-405b-b0e7-a04db0243ce9 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:31.553714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b241944f-d6c6-405b-b0e7-a04db0243ce9 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:31.554988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b241944f-d6c6-405b-b0e7-a04db0243ce9 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:31.555838 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b241944f-d6c6-405b-b0e7-a04db0243ce9 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:31.556998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b241944f-d6c6-405b-b0e7-a04db0243ce9 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:31.586673 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6783e33f-5a2f-4b95-987b-710126e10627 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:31.625967 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6783e33f-5a2f-4b95-987b-710126e10627 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1391 microversion: 2.1 time: 0.302513 Aug 24 10:22:31.662681 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1085/2460] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:31 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1391 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:31.674515 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-87d38a88-ebcf-4235-a9a2-7a1269319560 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:31.675529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-87d38a88-ebcf-4235-a9a2-7a1269319560 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:31.688555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87d38a88-ebcf-4235-a9a2-7a1269319560 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:31.695144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87d38a88-ebcf-4235-a9a2-7a1269319560 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:31.698489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87d38a88-ebcf-4235-a9a2-7a1269319560 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:31.700958 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87d38a88-ebcf-4235-a9a2-7a1269319560 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:31.704849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87d38a88-ebcf-4235-a9a2-7a1269319560 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:31.707112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87d38a88-ebcf-4235-a9a2-7a1269319560 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:31.928736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-87d38a88-ebcf-4235-a9a2-7a1269319560 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:31.980385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-87d38a88-ebcf-4235-a9a2-7a1269319560 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:31.983737 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-87d38a88-ebcf-4235-a9a2-7a1269319560 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:31.986529 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-87d38a88-ebcf-4235-a9a2-7a1269319560 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1365 microversion: 2.47 time: 0.321681 Aug 24 10:22:32.005473 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1086/2461] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:31 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1365 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:32.035931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b3d2afae-11fe-4339-a1ce-e8414b5667fe tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:32.037751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b3d2afae-11fe-4339-a1ce-e8414b5667fe tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:32.054418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3d2afae-11fe-4339-a1ce-e8414b5667fe tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:32.055722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3d2afae-11fe-4339-a1ce-e8414b5667fe tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:32.057016 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3d2afae-11fe-4339-a1ce-e8414b5667fe tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:32.059096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3d2afae-11fe-4339-a1ce-e8414b5667fe tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:32.060524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3d2afae-11fe-4339-a1ce-e8414b5667fe tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:32.073918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3d2afae-11fe-4339-a1ce-e8414b5667fe tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:32.323950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b241944f-d6c6-405b-b0e7-a04db0243ce9 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:32.341175 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b241944f-d6c6-405b-b0e7-a04db0243ce9 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb" status: 200 len: 1474 microversion: 2.1 time: 0.815880 Aug 24 10:22:32.343154 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1376/2462] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:31 2022] GET /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb => generated 1474 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:32.351976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e85eca3c-fd94-41a3-931a-d959055ea0b4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:32.353425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e85eca3c-fd94-41a3-931a-d959055ea0b4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:32.365693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85eca3c-fd94-41a3-931a-d959055ea0b4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:32.366919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85eca3c-fd94-41a3-931a-d959055ea0b4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:32.367949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85eca3c-fd94-41a3-931a-d959055ea0b4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:32.369512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85eca3c-fd94-41a3-931a-d959055ea0b4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:32.370441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85eca3c-fd94-41a3-931a-d959055ea0b4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:32.371338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85eca3c-fd94-41a3-931a-d959055ea0b4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:32.436927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b3d2afae-11fe-4339-a1ce-e8414b5667fe tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:32.459202 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b3d2afae-11fe-4339-a1ce-e8414b5667fe tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1355 microversion: 2.1 time: 0.446111 Aug 24 10:22:32.464662 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1087/2463] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:32 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1355 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:32.466621 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-94649915-f989-4d08-a870-4f37289070d9 req-8281db43-9e90-4a84-813b-bc1eb01c9a4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f6298f4-4be1-47e8-a260-c43d83731e08", "tag": "a849beed-fe2d-49fa-a6c1-d0686458269b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:32.481836 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-94649915-f989-4d08-a870-4f37289070d9 req-8281db43-9e90-4a84-813b-bc1eb01c9a4d service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:32.482950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-94649915-f989-4d08-a870-4f37289070d9 req-8281db43-9e90-4a84-813b-bc1eb01c9a4d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:32.483688 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-94649915-f989-4d08-a870-4f37289070d9 req-8281db43-9e90-4a84-813b-bc1eb01c9a4d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:32.504305 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-94649915-f989-4d08-a870-4f37289070d9 req-8281db43-9e90-4a84-813b-bc1eb01c9a4d service nova] Creating event network-changed:a849beed-fe2d-49fa-a6c1-d0686458269b for instance 0f6298f4-4be1-47e8-a260-c43d83731e08 on n-h1-849328-3 Aug 24 10:22:32.514648 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-94649915-f989-4d08-a870-4f37289070d9 req-8281db43-9e90-4a84-813b-bc1eb01c9a4d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052524 Aug 24 10:22:32.516851 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1088/2464] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:32.527835 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d0b74683-ed9e-4c7f-bc93-43900b2c76ef tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:32.529691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d0b74683-ed9e-4c7f-bc93-43900b2c76ef tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: 2bc88682-b0f5-42fc-88e5-a74d75b8e241] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:32.537512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0b74683-ed9e-4c7f-bc93-43900b2c76ef tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:32.538392 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0b74683-ed9e-4c7f-bc93-43900b2c76ef tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:32.539580 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0b74683-ed9e-4c7f-bc93-43900b2c76ef tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:32.540541 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0b74683-ed9e-4c7f-bc93-43900b2c76ef tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:32.541247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0b74683-ed9e-4c7f-bc93-43900b2c76ef tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:32.541855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0b74683-ed9e-4c7f-bc93-43900b2c76ef tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:32.680504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e85eca3c-fd94-41a3-931a-d959055ea0b4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d264ad8190a4cd9be236d05564fe1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5264f4afb64ba9927050b9b94d37a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:32.736922 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e85eca3c-fd94-41a3-931a-d959055ea0b4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08" status: 200 len: 1369 microversion: 2.1 time: 0.391731 Aug 24 10:22:32.759261 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1377/2465] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:32 2022] GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 => generated 1369 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:32.771174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9954193c-d40f-43fc-a6d1-d8d5e597e89d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:32.772646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9954193c-d40f-43fc-a6d1-d8d5e597e89d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:32.798814 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d0b74683-ed9e-4c7f-bc93-43900b2c76ef tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:32.808196 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d0b74683-ed9e-4c7f-bc93-43900b2c76ef tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241" status: 200 len: 1516 microversion: 2.1 time: 0.286935 Aug 24 10:22:32.808954 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1089/2466] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:32 2022] GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241 => generated 1516 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:32.809152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9954193c-d40f-43fc-a6d1-d8d5e597e89d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:32.810053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9954193c-d40f-43fc-a6d1-d8d5e597e89d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:32.810987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9954193c-d40f-43fc-a6d1-d8d5e597e89d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:32.812318 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9954193c-d40f-43fc-a6d1-d8d5e597e89d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:32.814253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9954193c-d40f-43fc-a6d1-d8d5e597e89d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:32.815232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9954193c-d40f-43fc-a6d1-d8d5e597e89d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:33.051023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9954193c-d40f-43fc-a6d1-d8d5e597e89d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:33.059176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-49bf347a-ea80-4c50-b651-d37b651c0f2a tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:33.064027 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9954193c-d40f-43fc-a6d1-d8d5e597e89d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1381 microversion: 2.1 time: 0.303013 Aug 24 10:22:33.064968 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-49bf347a-ea80-4c50-b651-d37b651c0f2a tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:33.066293 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1378/2467] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:32 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1381 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:33.081410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49bf347a-ea80-4c50-b651-d37b651c0f2a tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:33.083134 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49bf347a-ea80-4c50-b651-d37b651c0f2a tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:33.084790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49bf347a-ea80-4c50-b651-d37b651c0f2a tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:33.086315 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49bf347a-ea80-4c50-b651-d37b651c0f2a tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:33.087421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4a74b71d-c7cc-468f-86ac-d3f62277f942 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Calling method '.version_select at 0x7f4654fbe5e0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:33.087597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49bf347a-ea80-4c50-b651-d37b651c0f2a tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:33.088448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49bf347a-ea80-4c50-b651-d37b651c0f2a tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:33.093074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a74b71d-c7cc-468f-86ac-d3f62277f942 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:33.093857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a74b71d-c7cc-468f-86ac-d3f62277f942 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:33.094690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a74b71d-c7cc-468f-86ac-d3f62277f942 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:33.108028 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4a74b71d-c7cc-468f-86ac-d3f62277f942 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] 10.222.0.85 "GET /compute/v2.1/os-migrations" status: 200 len: 1552 microversion: 2.1 time: 0.023889 Aug 24 10:22:33.123463 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1379/2468] 10.222.0.85 () {58 vars in 1143 bytes} [Wed Aug 24 10:22:33 2022] GET /compute/v2.1/os-migrations => generated 1552 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:33.130957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f6c0a7ad-dc17-4454-b99a-d0bf7c286507 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:33.154367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f6c0a7ad-dc17-4454-b99a-d0bf7c286507 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:33.164209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6c0a7ad-dc17-4454-b99a-d0bf7c286507 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:33.165106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6c0a7ad-dc17-4454-b99a-d0bf7c286507 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:33.166293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6c0a7ad-dc17-4454-b99a-d0bf7c286507 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:33.167583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6c0a7ad-dc17-4454-b99a-d0bf7c286507 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:33.168299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6c0a7ad-dc17-4454-b99a-d0bf7c286507 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:33.171930 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6c0a7ad-dc17-4454-b99a-d0bf7c286507 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:33.195751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-49bf347a-ea80-4c50-b651-d37b651c0f2a tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:33.208080 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-49bf347a-ea80-4c50-b651-d37b651c0f2a tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:33.210011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-49bf347a-ea80-4c50-b651-d37b651c0f2a tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:33.211516 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-49bf347a-ea80-4c50-b651-d37b651c0f2a tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1365 microversion: 2.47 time: 0.174596 Aug 24 10:22:33.212642 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1090/2469] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:33 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:33.363596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1faacd47-0fa7-4751-8e15-99f6cd8d9bd8 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:33.364832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1faacd47-0fa7-4751-8e15-99f6cd8d9bd8 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:33.379083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1faacd47-0fa7-4751-8e15-99f6cd8d9bd8 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:33.379991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1faacd47-0fa7-4751-8e15-99f6cd8d9bd8 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:33.383261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1faacd47-0fa7-4751-8e15-99f6cd8d9bd8 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:33.384454 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1faacd47-0fa7-4751-8e15-99f6cd8d9bd8 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:33.386094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1faacd47-0fa7-4751-8e15-99f6cd8d9bd8 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:33.388239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1faacd47-0fa7-4751-8e15-99f6cd8d9bd8 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:33.438735 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f6c0a7ad-dc17-4454-b99a-d0bf7c286507 tempest-LiveMigrationTest-2052213539 tempest-LiveMigrationTest-2052213539-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1532 microversion: 2.1 time: 0.309213 Aug 24 10:22:33.440267 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1380/2470] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:33 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1532 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:33.487266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7bd8e4e5-2f98-4b67-916c-052d01897c50 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:33.487946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7bd8e4e5-2f98-4b67-916c-052d01897c50 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:33.497929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bd8e4e5-2f98-4b67-916c-052d01897c50 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:33.498765 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bd8e4e5-2f98-4b67-916c-052d01897c50 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:33.499408 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bd8e4e5-2f98-4b67-916c-052d01897c50 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:33.500842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bd8e4e5-2f98-4b67-916c-052d01897c50 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:33.501560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bd8e4e5-2f98-4b67-916c-052d01897c50 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:33.502158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bd8e4e5-2f98-4b67-916c-052d01897c50 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:33.593853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7bd8e4e5-2f98-4b67-916c-052d01897c50 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:22:33.772496 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7bd8e4e5-2f98-4b67-916c-052d01897c50 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "DELETE /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 204 len: 0 microversion: 2.1 time: 0.296214 Aug 24 10:22:33.780529 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1381/2471] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:22:33 2022] DELETE /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:22:33.787123 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1faacd47-0fa7-4751-8e15-99f6cd8d9bd8 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:33.796523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-082dd6e8-5f65-46e5-91b1-3cc43a837391 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:33.798022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-082dd6e8-5f65-46e5-91b1-3cc43a837391 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:33.804748 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1faacd47-0fa7-4751-8e15-99f6cd8d9bd8 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb" status: 200 len: 1474 microversion: 2.1 time: 0.445438 Aug 24 10:22:33.807077 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1091/2472] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:33 2022] GET /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb => generated 1474 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:33.809921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-082dd6e8-5f65-46e5-91b1-3cc43a837391 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:33.810710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-082dd6e8-5f65-46e5-91b1-3cc43a837391 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:33.811690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-082dd6e8-5f65-46e5-91b1-3cc43a837391 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:33.813601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-082dd6e8-5f65-46e5-91b1-3cc43a837391 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:33.814329 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-082dd6e8-5f65-46e5-91b1-3cc43a837391 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:33.814927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-082dd6e8-5f65-46e5-91b1-3cc43a837391 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:34.047398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ccdc6566-e35c-4c88-97b8-800dc828d6c3 tempest-ListImageFiltersNegativeTestJSON-1605404110 tempest-ListImageFiltersNegativeTestJSON-1605404110-project] Calling method '.version_select at 0x7f4655001a60>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:34.074236 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-ccdc6566-e35c-4c88-97b8-800dc828d6c3 tempest-ListImageFiltersNegativeTestJSON-1605404110 tempest-ListImageFiltersNegativeTestJSON-1605404110-project] HTTP exception thrown: Image not found. Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ccdc6566-e35c-4c88-97b8-800dc828d6c3 tempest-ListImageFiltersNegativeTestJSON-1605404110 tempest-ListImageFiltersNegativeTestJSON-1605404110-project] Request method failure captured: Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/images/5f6802ed-ff6d-4cba-8594-5fad14cf2e99 HTTP/1.1 Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfvp2b4yH-0jX4N33c1PRN0OLRhWCt913EH1rxHNMSAqMEYOlxmcF7VJUMhq8bDpOLJESn3DEu_N9BnlMkpKtaCU06EuFfBbNp9_jsoXXCTY8saFTFbJE-Q4T3K78XOoZXUHcH0M-ZUx0IiylBknff2Mp5ObQJ2_1kETbr2RIjOqc1M Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: d25d33e3b69b46c1b83bb5120a251b00 Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1605404110 Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d25d33e3b69b46c1b83bb5120a251b00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d25d33e3b69b46c1b83bb5120a251b00", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d25d33e3b69b46c1b83bb5120a251b00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d25d33e3b69b46c1b83bb5120a251b00"}]}] Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1605404110 Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: d25d33e3b69b46c1b83bb5120a251b00 Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1605404110 Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ListImageFiltersNegativeTestJSON-1605404110-project Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 90c4f2dfe53046ca965aab967d67dcc6 Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1605404110-project Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: exception: Image not found. Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '5f6802ed-ff6d-4cba-8594-5fad14cf2e99'} Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5f6802ed-ff6d-4cba-8594-5fad14cf2e99 Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 10:22:34.076702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5f6802ed-ff6d-4cba-8594-5fad14cf2e99 could not be found. Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 10:22:34.082197 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:22:34.085062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-082dd6e8-5f65-46e5-91b1-3cc43a837391 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:34.086224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ccdc6566-e35c-4c88-97b8-800dc828d6c3 tempest-ListImageFiltersNegativeTestJSON-1605404110 tempest-ListImageFiltersNegativeTestJSON-1605404110-project] Returning 404 to user: Image not found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:22:34.087360 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ccdc6566-e35c-4c88-97b8-800dc828d6c3 tempest-ListImageFiltersNegativeTestJSON-1605404110 tempest-ListImageFiltersNegativeTestJSON-1605404110-project] 10.222.0.85 "GET /compute/v2.1/images/5f6802ed-ff6d-4cba-8594-5fad14cf2e99" status: 404 len: 62 microversion: 2.1 time: 0.278297 Aug 24 10:22:34.088707 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1092/2473] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:22:33 2022] GET /compute/v2.1/images/5f6802ed-ff6d-4cba-8594-5fad14cf2e99 => generated 62 bytes in 281 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:22:34.094371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-90b652c9-0ed3-462c-8122-4d0d9c071c7d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:34.095578 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-90b652c9-0ed3-462c-8122-4d0d9c071c7d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:34.103388 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90b652c9-0ed3-462c-8122-4d0d9c071c7d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:34.104197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90b652c9-0ed3-462c-8122-4d0d9c071c7d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:34.104847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90b652c9-0ed3-462c-8122-4d0d9c071c7d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:34.105578 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-082dd6e8-5f65-46e5-91b1-3cc43a837391 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1355 microversion: 2.1 time: 0.312472 Aug 24 10:22:34.106156 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90b652c9-0ed3-462c-8122-4d0d9c071c7d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:34.106827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90b652c9-0ed3-462c-8122-4d0d9c071c7d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:34.107513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90b652c9-0ed3-462c-8122-4d0d9c071c7d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:34.108428 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1382/2474] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:33 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1355 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:34.126226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-45516fde-042b-40ef-a043-d694eb12985c tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:34.130342 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-45516fde-042b-40ef-a043-d694eb12985c tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:34.142973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45516fde-042b-40ef-a043-d694eb12985c tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:34.144447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45516fde-042b-40ef-a043-d694eb12985c tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:34.149559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45516fde-042b-40ef-a043-d694eb12985c tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:34.153203 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45516fde-042b-40ef-a043-d694eb12985c tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:34.154301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45516fde-042b-40ef-a043-d694eb12985c tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:34.156661 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45516fde-042b-40ef-a043-d694eb12985c tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:34.419498 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-90b652c9-0ed3-462c-8122-4d0d9c071c7d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:34.464605 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-90b652c9-0ed3-462c-8122-4d0d9c071c7d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1387 microversion: 2.1 time: 0.374191 Aug 24 10:22:34.489191 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1093/2475] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:34 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1387 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:34.499975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-50d596c6-d50f-459d-bd2f-95ba42533ef7 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:34.512602 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-50d596c6-d50f-459d-bd2f-95ba42533ef7 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: 2bc88682-b0f5-42fc-88e5-a74d75b8e241] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:34.528523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50d596c6-d50f-459d-bd2f-95ba42533ef7 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:34.530634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50d596c6-d50f-459d-bd2f-95ba42533ef7 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:34.531265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50d596c6-d50f-459d-bd2f-95ba42533ef7 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:34.532377 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50d596c6-d50f-459d-bd2f-95ba42533ef7 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:34.533168 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50d596c6-d50f-459d-bd2f-95ba42533ef7 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:34.533927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50d596c6-d50f-459d-bd2f-95ba42533ef7 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:34.534807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-45516fde-042b-40ef-a043-d694eb12985c tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d264ad8190a4cd9be236d05564fe1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5264f4afb64ba9927050b9b94d37a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:34.552996 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-45516fde-042b-40ef-a043-d694eb12985c tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08" status: 200 len: 1369 microversion: 2.1 time: 0.442133 Aug 24 10:22:34.559316 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1383/2476] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:34 2022] GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 => generated 1369 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:34.579786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-da324a70-72f4-4859-b800-6e006aaf5109 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:34.582792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-da324a70-72f4-4859-b800-6e006aaf5109 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:34.610795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da324a70-72f4-4859-b800-6e006aaf5109 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:34.612542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da324a70-72f4-4859-b800-6e006aaf5109 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:34.614467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da324a70-72f4-4859-b800-6e006aaf5109 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:34.616360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da324a70-72f4-4859-b800-6e006aaf5109 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:34.619576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da324a70-72f4-4859-b800-6e006aaf5109 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:34.621100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da324a70-72f4-4859-b800-6e006aaf5109 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:34.794290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da324a70-72f4-4859-b800-6e006aaf5109 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:34.801798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:34.808101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da324a70-72f4-4859-b800-6e006aaf5109 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:34.809690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da324a70-72f4-4859-b800-6e006aaf5109 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:34.810985 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-da324a70-72f4-4859-b800-6e006aaf5109 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1365 microversion: 2.47 time: 0.246697 Aug 24 10:22:34.815561 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1384/2477] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:34 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1365 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:34.823245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-50d596c6-d50f-459d-bd2f-95ba42533ef7 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:34.832105 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-50d596c6-d50f-459d-bd2f-95ba42533ef7 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241" status: 200 len: 1516 microversion: 2.1 time: 0.342611 Aug 24 10:22:34.833169 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1094/2478] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:34 2022] GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241 => generated 1516 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:34.849331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-16d2b1bf-1646-4ff1-9d1f-9047771ac124 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:34.849331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-16d2b1bf-1646-4ff1-9d1f-9047771ac124 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:34.875503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16d2b1bf-1646-4ff1-9d1f-9047771ac124 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:34.876467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16d2b1bf-1646-4ff1-9d1f-9047771ac124 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:34.877168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16d2b1bf-1646-4ff1-9d1f-9047771ac124 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:34.878338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16d2b1bf-1646-4ff1-9d1f-9047771ac124 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:34.879187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16d2b1bf-1646-4ff1-9d1f-9047771ac124 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:34.879957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16d2b1bf-1646-4ff1-9d1f-9047771ac124 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:35.133007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2271f23d-ee32-41e7-be2b-c5ce758f1d6a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:35.133672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2271f23d-ee32-41e7-be2b-c5ce758f1d6a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:35.140855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2271f23d-ee32-41e7-be2b-c5ce758f1d6a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:35.141408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2271f23d-ee32-41e7-be2b-c5ce758f1d6a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:35.141859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2271f23d-ee32-41e7-be2b-c5ce758f1d6a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:35.142615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2271f23d-ee32-41e7-be2b-c5ce758f1d6a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:35.143639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2271f23d-ee32-41e7-be2b-c5ce758f1d6a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:35.144096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2271f23d-ee32-41e7-be2b-c5ce758f1d6a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:35.222132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-16d2b1bf-1646-4ff1-9d1f-9047771ac124 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:35.233099 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-16d2b1bf-1646-4ff1-9d1f-9047771ac124 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb" status: 200 len: 1474 microversion: 2.1 time: 0.396660 Aug 24 10:22:35.247600 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1385/2479] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:34 2022] GET /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb => generated 1474 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:35.417682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2271f23d-ee32-41e7-be2b-c5ce758f1d6a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:35.430494 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2271f23d-ee32-41e7-be2b-c5ce758f1d6a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1355 microversion: 2.1 time: 0.301086 Aug 24 10:22:35.441270 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1095/2480] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:35 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1355 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:22:35.505998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-748d2b57-681e-48c7-a3b5-891788751ea7 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:35.507214 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-748d2b57-681e-48c7-a3b5-891788751ea7 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:35.519580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-748d2b57-681e-48c7-a3b5-891788751ea7 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:35.520281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-748d2b57-681e-48c7-a3b5-891788751ea7 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:35.521005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-748d2b57-681e-48c7-a3b5-891788751ea7 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:35.522322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-748d2b57-681e-48c7-a3b5-891788751ea7 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:35.523149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-748d2b57-681e-48c7-a3b5-891788751ea7 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:35.524522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-748d2b57-681e-48c7-a3b5-891788751ea7 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:35.604796 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-73aa77d0-0f5d-413e-bfda-fc86f08cd080 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:35.607950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-73aa77d0-0f5d-413e-bfda-fc86f08cd080 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:35.634548 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73aa77d0-0f5d-413e-bfda-fc86f08cd080 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:35.635408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73aa77d0-0f5d-413e-bfda-fc86f08cd080 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:35.637136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73aa77d0-0f5d-413e-bfda-fc86f08cd080 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:35.639236 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73aa77d0-0f5d-413e-bfda-fc86f08cd080 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:35.640182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73aa77d0-0f5d-413e-bfda-fc86f08cd080 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:35.640884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73aa77d0-0f5d-413e-bfda-fc86f08cd080 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:35.667386 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-748d2b57-681e-48c7-a3b5-891788751ea7 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:35.685334 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-748d2b57-681e-48c7-a3b5-891788751ea7 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1345 microversion: 2.1 time: 0.182791 Aug 24 10:22:35.687002 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1386/2481] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:35 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1345 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:35.765073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-b4020ede-d185-493a-ac81-eaf2c518a3f4 req-8443356a-e9d4-4437-bf40-cfd82e28a7c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c66c18-c34f-4916-aca3-da0ca33f9ba5", "name": "network-vif-deleted", "tag": "7b95f9a5-8709-4c1d-8f96-0d1c5094bcb8"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:35.792905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b4020ede-d185-493a-ac81-eaf2c518a3f4 req-8443356a-e9d4-4437-bf40-cfd82e28a7c0 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:35.793423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b4020ede-d185-493a-ac81-eaf2c518a3f4 req-8443356a-e9d4-4437-bf40-cfd82e28a7c0 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:35.794109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b4020ede-d185-493a-ac81-eaf2c518a3f4 req-8443356a-e9d4-4437-bf40-cfd82e28a7c0 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:35.807838 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-b4020ede-d185-493a-ac81-eaf2c518a3f4 req-8443356a-e9d4-4437-bf40-cfd82e28a7c0 service nova] Creating event network-vif-deleted:7b95f9a5-8709-4c1d-8f96-0d1c5094bcb8 for instance 70c66c18-c34f-4916-aca3-da0ca33f9ba5 on n-h2-849328-3 Aug 24 10:22:35.814348 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-b4020ede-d185-493a-ac81-eaf2c518a3f4 req-8443356a-e9d4-4437-bf40-cfd82e28a7c0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053688 Aug 24 10:22:35.815936 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1387/2482] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:35.845663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7667e1b2-9639-41d5-a874-bda60b39c156 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:35.851099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7667e1b2-9639-41d5-a874-bda60b39c156 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:35.859559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7667e1b2-9639-41d5-a874-bda60b39c156 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:35.860061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7667e1b2-9639-41d5-a874-bda60b39c156 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:35.860505 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7667e1b2-9639-41d5-a874-bda60b39c156 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:35.861271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7667e1b2-9639-41d5-a874-bda60b39c156 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:35.861739 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7667e1b2-9639-41d5-a874-bda60b39c156 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:35.862204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7667e1b2-9639-41d5-a874-bda60b39c156 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:35.952036 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-73aa77d0-0f5d-413e-bfda-fc86f08cd080 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d264ad8190a4cd9be236d05564fe1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5264f4afb64ba9927050b9b94d37a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:35.958336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7667e1b2-9639-41d5-a874-bda60b39c156 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:35.971152 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-73aa77d0-0f5d-413e-bfda-fc86f08cd080 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08" status: 200 len: 1369 microversion: 2.1 time: 0.379189 Aug 24 10:22:35.974148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7667e1b2-9639-41d5-a874-bda60b39c156 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:35.975318 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1096/2483] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:35 2022] GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 => generated 1369 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:22:35.978051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7667e1b2-9639-41d5-a874-bda60b39c156 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:35.980513 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7667e1b2-9639-41d5-a874-bda60b39c156 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1365 microversion: 2.47 time: 0.140038 Aug 24 10:22:35.993269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-07c6e705-bf7a-4bfe-a8bf-922cecc84143 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:35.993269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-07c6e705-bf7a-4bfe-a8bf-922cecc84143 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: 2bc88682-b0f5-42fc-88e5-a74d75b8e241] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:36.000311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07c6e705-bf7a-4bfe-a8bf-922cecc84143 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:36.001114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07c6e705-bf7a-4bfe-a8bf-922cecc84143 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:36.002023 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07c6e705-bf7a-4bfe-a8bf-922cecc84143 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:36.003835 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07c6e705-bf7a-4bfe-a8bf-922cecc84143 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:36.004030 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1388/2484] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:35 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:36.004711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07c6e705-bf7a-4bfe-a8bf-922cecc84143 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:36.005354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07c6e705-bf7a-4bfe-a8bf-922cecc84143 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:36.266828 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-50f91eb0-1563-4ead-ae7e-d9e6e6b7714a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:36.268286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-50f91eb0-1563-4ead-ae7e-d9e6e6b7714a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:36.277090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50f91eb0-1563-4ead-ae7e-d9e6e6b7714a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:36.278301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50f91eb0-1563-4ead-ae7e-d9e6e6b7714a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:36.279269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50f91eb0-1563-4ead-ae7e-d9e6e6b7714a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:36.280553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50f91eb0-1563-4ead-ae7e-d9e6e6b7714a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:36.281293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50f91eb0-1563-4ead-ae7e-d9e6e6b7714a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:36.281994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50f91eb0-1563-4ead-ae7e-d9e6e6b7714a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:36.503102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-07c6e705-bf7a-4bfe-a8bf-922cecc84143 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:36.514633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-50f91eb0-1563-4ead-ae7e-d9e6e6b7714a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:36.521782 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-07c6e705-bf7a-4bfe-a8bf-922cecc84143 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241" status: 200 len: 1516 microversion: 2.1 time: 0.544238 Aug 24 10:22:36.523353 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1097/2485] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:35 2022] GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241 => generated 1516 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:36.538521 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-50f91eb0-1563-4ead-ae7e-d9e6e6b7714a tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb" status: 200 len: 1474 microversion: 2.1 time: 0.277241 Aug 24 10:22:36.540109 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1389/2486] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:36 2022] GET /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb => generated 1474 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:22:36.547530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6bba2511-e93c-454c-bf3d-dd12e8a5a14b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:36.548694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6bba2511-e93c-454c-bf3d-dd12e8a5a14b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:36.559793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bba2511-e93c-454c-bf3d-dd12e8a5a14b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:36.560713 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bba2511-e93c-454c-bf3d-dd12e8a5a14b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:36.561640 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bba2511-e93c-454c-bf3d-dd12e8a5a14b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:36.563114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bba2511-e93c-454c-bf3d-dd12e8a5a14b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:36.564352 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bba2511-e93c-454c-bf3d-dd12e8a5a14b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:36.565664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bba2511-e93c-454c-bf3d-dd12e8a5a14b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:36.729243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4cf5b90e-fbf1-44e0-9084-edfd66653bfc tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:36.730576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4cf5b90e-fbf1-44e0-9084-edfd66653bfc tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:36.772182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cf5b90e-fbf1-44e0-9084-edfd66653bfc tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:36.783957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cf5b90e-fbf1-44e0-9084-edfd66653bfc tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:36.785294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cf5b90e-fbf1-44e0-9084-edfd66653bfc tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:36.786982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cf5b90e-fbf1-44e0-9084-edfd66653bfc tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:36.788398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cf5b90e-fbf1-44e0-9084-edfd66653bfc tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:36.789566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cf5b90e-fbf1-44e0-9084-edfd66653bfc tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:36.946603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4cf5b90e-fbf1-44e0-9084-edfd66653bfc tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:36.959073 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4cf5b90e-fbf1-44e0-9084-edfd66653bfc tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1184 microversion: 2.1 time: 0.243045 Aug 24 10:22:36.962078 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1390/2487] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:36 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1184 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:37.004617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-110b4668-f84f-4a00-af68-fe29e437286e tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:37.010079 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-110b4668-f84f-4a00-af68-fe29e437286e tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:37.032997 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:37.049946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-110b4668-f84f-4a00-af68-fe29e437286e tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:37.058155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-110b4668-f84f-4a00-af68-fe29e437286e tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:37.059192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-110b4668-f84f-4a00-af68-fe29e437286e tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:37.060141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-110b4668-f84f-4a00-af68-fe29e437286e tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:37.061956 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-110b4668-f84f-4a00-af68-fe29e437286e tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:37.065845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-110b4668-f84f-4a00-af68-fe29e437286e tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:37.508378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-110b4668-f84f-4a00-af68-fe29e437286e tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d264ad8190a4cd9be236d05564fe1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5264f4afb64ba9927050b9b94d37a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:37.523169 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-110b4668-f84f-4a00-af68-fe29e437286e tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08" status: 200 len: 1369 microversion: 2.1 time: 0.528497 Aug 24 10:22:37.543055 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1391/2488] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:36 2022] GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 => generated 1369 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:37.552675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-42f5e57f-3c29-4335-a62c-804a51ac6b59 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:37.557024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-42f5e57f-3c29-4335-a62c-804a51ac6b59 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:37.575186 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42f5e57f-3c29-4335-a62c-804a51ac6b59 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:37.575769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42f5e57f-3c29-4335-a62c-804a51ac6b59 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:37.576126 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42f5e57f-3c29-4335-a62c-804a51ac6b59 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:37.576885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42f5e57f-3c29-4335-a62c-804a51ac6b59 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:37.577921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42f5e57f-3c29-4335-a62c-804a51ac6b59 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:37.578362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42f5e57f-3c29-4335-a62c-804a51ac6b59 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:37.721302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-42f5e57f-3c29-4335-a62c-804a51ac6b59 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:37.732406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-42f5e57f-3c29-4335-a62c-804a51ac6b59 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:37.734218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-42f5e57f-3c29-4335-a62c-804a51ac6b59 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:37.735632 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-42f5e57f-3c29-4335-a62c-804a51ac6b59 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1365 microversion: 2.47 time: 0.191495 Aug 24 10:22:37.746975 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1392/2489] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:37 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:37.842414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6bba2511-e93c-454c-bf3d-dd12e8a5a14b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:37.858151 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6bba2511-e93c-454c-bf3d-dd12e8a5a14b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1355 microversion: 2.1 time: 1.332894 Aug 24 10:22:37.858752 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1098/2490] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:36 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1355 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:37.877189 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-691ff5ed-2d17-4c7f-b1c4-62562b0aed30 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:37.878064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-691ff5ed-2d17-4c7f-b1c4-62562b0aed30 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: 2bc88682-b0f5-42fc-88e5-a74d75b8e241] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:37.887644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-691ff5ed-2d17-4c7f-b1c4-62562b0aed30 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:37.898281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-691ff5ed-2d17-4c7f-b1c4-62562b0aed30 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:37.899360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-691ff5ed-2d17-4c7f-b1c4-62562b0aed30 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:37.900787 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-691ff5ed-2d17-4c7f-b1c4-62562b0aed30 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:37.901855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-691ff5ed-2d17-4c7f-b1c4-62562b0aed30 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:37.902978 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-691ff5ed-2d17-4c7f-b1c4-62562b0aed30 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:38.008789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-062d1d27-160c-495c-b16e-1f2b0da0881c tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Action: 'create', calling method: .version_select at 0x7f4654eec8b0>, body: {"keypair": {"name": "tempest-keypair-1713853930", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIrP4cQBmZhvWKkL6iR5Edt1VCzZ53ab6Op9AgCRqRhV1mL2EHQUORBQAkmQh42PX5dLBdkl6/p5V68Wic+xJhw+wVIuTivGA+1ddQxhvsp7sq/1c0Ai2nAXKu/B84Deg=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:38.053664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-062d1d27-160c-495c-b16e-1f2b0da0881c tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Getting quotas for project 2b13bffae080413fa3fce3a1f0774f69. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:22:38.069869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-062d1d27-160c-495c-b16e-1f2b0da0881c tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Getting quotas for user 3b297139b9434b8fb9c4e61ffb096faf and project 2b13bffae080413fa3fce3a1f0774f69. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:22:38.111740 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-062d1d27-160c-495c-b16e-1f2b0da0881c tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.373863 Aug 24 10:22:38.123159 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1393/2491] 10.222.0.85 () {62 vars in 1199 bytes} [Wed Aug 24 10:22:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 386 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 24 10:22:38.129557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6aa9d529-a3a3-4871-9010-5d5624ac4378 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:38.130452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6aa9d529-a3a3-4871-9010-5d5624ac4378 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:38.145059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa9d529-a3a3-4871-9010-5d5624ac4378 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:38.145826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa9d529-a3a3-4871-9010-5d5624ac4378 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:38.146319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa9d529-a3a3-4871-9010-5d5624ac4378 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:38.147314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa9d529-a3a3-4871-9010-5d5624ac4378 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:38.148073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa9d529-a3a3-4871-9010-5d5624ac4378 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:38.149218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa9d529-a3a3-4871-9010-5d5624ac4378 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:38.156099 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-691ff5ed-2d17-4c7f-b1c4-62562b0aed30 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4163d2bb72c43e7b0315c5e782d5fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b648a28a11e4016a1fe87ea6b6f01b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:38.176675 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-691ff5ed-2d17-4c7f-b1c4-62562b0aed30 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241" status: 200 len: 1474 microversion: 2.1 time: 0.303838 Aug 24 10:22:38.178143 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1099/2492] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:37 2022] GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241 => generated 1474 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:38.204680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e7e501f-c19d-43bf-a237-fea481c37737 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:38.206360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6e7e501f-c19d-43bf-a237-fea481c37737 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:38.218009 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e7e501f-c19d-43bf-a237-fea481c37737 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:38.219113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e7e501f-c19d-43bf-a237-fea481c37737 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:38.220008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e7e501f-c19d-43bf-a237-fea481c37737 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:38.221455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e7e501f-c19d-43bf-a237-fea481c37737 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:38.222544 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e7e501f-c19d-43bf-a237-fea481c37737 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:38.223243 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e7e501f-c19d-43bf-a237-fea481c37737 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:38.243484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:38.395581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6aa9d529-a3a3-4871-9010-5d5624ac4378 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:38.406778 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6aa9d529-a3a3-4871-9010-5d5624ac4378 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb" status: 200 len: 1474 microversion: 2.1 time: 0.281470 Aug 24 10:22:38.407643 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1394/2493] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:38 2022] GET /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb => generated 1474 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:38.428868 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6e7e501f-c19d-43bf-a237-fea481c37737 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:38.442528 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6e7e501f-c19d-43bf-a237-fea481c37737 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1184 microversion: 2.1 time: 0.262402 Aug 24 10:22:38.443740 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1100/2494] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:38 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1184 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:38.448672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-4d133acf-0e54-4458-9d28-04c634644820 req-ffb77ffa-7b14-45ce-a087-b8d2df56c21a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bc88682-b0f5-42fc-88e5-a74d75b8e241", "name": "network-vif-deleted", "tag": "5f373a77-7c6e-43b9-9e7b-44520530587d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:38.464707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4d133acf-0e54-4458-9d28-04c634644820 req-ffb77ffa-7b14-45ce-a087-b8d2df56c21a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:38.466484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4d133acf-0e54-4458-9d28-04c634644820 req-ffb77ffa-7b14-45ce-a087-b8d2df56c21a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:38.469884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4d133acf-0e54-4458-9d28-04c634644820 req-ffb77ffa-7b14-45ce-a087-b8d2df56c21a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:38.498559 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-4d133acf-0e54-4458-9d28-04c634644820 req-ffb77ffa-7b14-45ce-a087-b8d2df56c21a service nova] Creating event network-vif-deleted:5f373a77-7c6e-43b9-9e7b-44520530587d for instance 2bc88682-b0f5-42fc-88e5-a74d75b8e241 on n-h1-849328-3 Aug 24 10:22:38.509005 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-4d133acf-0e54-4458-9d28-04c634644820 req-ffb77ffa-7b14-45ce-a087-b8d2df56c21a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062652 Aug 24 10:22:38.510981 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1101/2495] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:38.524939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-86dec09d-b1fe-4603-a32d-b14e0beb0d68 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Calling method '.version_select at 0x7f4654d53f70>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:38.540933 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-86dec09d-b1fe-4603-a32d-b14e0beb0d68 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] 10.222.0.85 "GET /compute/v2.1/os-keypairs/tempest-keypair-1713853930" status: 200 len: 513 microversion: 2.2 time: 0.027741 Aug 24 10:22:38.542580 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1102/2496] 10.222.0.85 () {60 vars in 1258 bytes} [Wed Aug 24 10:22:38 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1713853930 => generated 513 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:38.551973 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1eaf1693-b327-4639-bd55-5ef56a2ad7d7 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:38.553659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1eaf1693-b327-4639-bd55-5ef56a2ad7d7 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:38.568049 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eaf1693-b327-4639-bd55-5ef56a2ad7d7 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:38.569358 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eaf1693-b327-4639-bd55-5ef56a2ad7d7 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:38.570380 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eaf1693-b327-4639-bd55-5ef56a2ad7d7 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:38.571908 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eaf1693-b327-4639-bd55-5ef56a2ad7d7 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:38.573247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eaf1693-b327-4639-bd55-5ef56a2ad7d7 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:38.574278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eaf1693-b327-4639-bd55-5ef56a2ad7d7 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:38.704292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1e4940e6-3349-4d43-ba18-1a1e8e58bb36 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:38.704938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1e4940e6-3349-4d43-ba18-1a1e8e58bb36 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:38.717359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e4940e6-3349-4d43-ba18-1a1e8e58bb36 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:38.719584 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e4940e6-3349-4d43-ba18-1a1e8e58bb36 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:38.721473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e4940e6-3349-4d43-ba18-1a1e8e58bb36 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:38.723363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e4940e6-3349-4d43-ba18-1a1e8e58bb36 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:38.724386 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e4940e6-3349-4d43-ba18-1a1e8e58bb36 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:38.726102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e4940e6-3349-4d43-ba18-1a1e8e58bb36 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:38.791186 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1e4940e6-3349-4d43-ba18-1a1e8e58bb36 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:22:38.945024 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1e4940e6-3349-4d43-ba18-1a1e8e58bb36 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "DELETE /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 204 len: 0 microversion: 2.32 time: 0.535166 Aug 24 10:22:38.951293 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1395/2497] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:22:38 2022] DELETE /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:22:38.963140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2ecc1297-9978-4725-82e1-31890972be23 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Calling method '.version_select at 0x7f4654e1dca0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:38.994529 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2ecc1297-9978-4725-82e1-31890972be23 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1713853930" status: 204 len: 0 microversion: 2.2 time: 0.040444 Aug 24 10:22:38.996611 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1396/2498] 10.222.0.85 () {60 vars in 1261 bytes} [Wed Aug 24 10:22:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1713853930 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:22:39.016364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb654c8c-582b-497d-8931-aaaa1b63662b tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:39.017478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cb654c8c-582b-497d-8931-aaaa1b63662b tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:39.025092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb654c8c-582b-497d-8931-aaaa1b63662b tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:39.025946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb654c8c-582b-497d-8931-aaaa1b63662b tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:39.026710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb654c8c-582b-497d-8931-aaaa1b63662b tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:39.027887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb654c8c-582b-497d-8931-aaaa1b63662b tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:39.028698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb654c8c-582b-497d-8931-aaaa1b63662b tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:39.029517 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb654c8c-582b-497d-8931-aaaa1b63662b tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:39.115085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1eaf1693-b327-4639-bd55-5ef56a2ad7d7 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d264ad8190a4cd9be236d05564fe1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5264f4afb64ba9927050b9b94d37a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:39.142438 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1eaf1693-b327-4639-bd55-5ef56a2ad7d7 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08" status: 200 len: 1369 microversion: 2.1 time: 0.596756 Aug 24 10:22:39.150928 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1103/2499] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:38 2022] GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 => generated 1369 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:39.176086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5ca35608-4348-41de-8502-009a7209df2c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:39.180535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5ca35608-4348-41de-8502-009a7209df2c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:39.181261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cb654c8c-582b-497d-8931-aaaa1b63662b tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:39.194259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ca35608-4348-41de-8502-009a7209df2c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:39.195391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ca35608-4348-41de-8502-009a7209df2c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:39.196067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ca35608-4348-41de-8502-009a7209df2c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:39.197647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ca35608-4348-41de-8502-009a7209df2c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:39.198405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ca35608-4348-41de-8502-009a7209df2c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:39.199820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ca35608-4348-41de-8502-009a7209df2c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:39.204687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cb654c8c-582b-497d-8931-aaaa1b63662b tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:39.210711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cb654c8c-582b-497d-8931-aaaa1b63662b tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:39.213442 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cb654c8c-582b-497d-8931-aaaa1b63662b tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1365 microversion: 2.47 time: 0.214558 Aug 24 10:22:39.214716 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1397/2500] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:38 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:39.234885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4e0738df-af19-48d7-ba8b-63c9ab6b6ba3 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:39.236561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4e0738df-af19-48d7-ba8b-63c9ab6b6ba3 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:39.261199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e0738df-af19-48d7-ba8b-63c9ab6b6ba3 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:39.261199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e0738df-af19-48d7-ba8b-63c9ab6b6ba3 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:39.261199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e0738df-af19-48d7-ba8b-63c9ab6b6ba3 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:39.261199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e0738df-af19-48d7-ba8b-63c9ab6b6ba3 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:39.261199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e0738df-af19-48d7-ba8b-63c9ab6b6ba3 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:39.261199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e0738df-af19-48d7-ba8b-63c9ab6b6ba3 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:39.545559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4e0738df-af19-48d7-ba8b-63c9ab6b6ba3 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:39.560293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4e0738df-af19-48d7-ba8b-63c9ab6b6ba3 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:39.565335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4e0738df-af19-48d7-ba8b-63c9ab6b6ba3 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:39.567462 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4e0738df-af19-48d7-ba8b-63c9ab6b6ba3 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 2951 microversion: 2.32 time: 0.344635 Aug 24 10:22:39.568994 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1398/2501] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:39 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 2951 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:39.575221 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a715ad36-ae0b-432a-9995-830cb0506cea tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Action: 'create', calling method: .version_select at 0x7f4655073a60>, body: {"keypair": {"name": "tempest-keypair-86060321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8Xjal1VMGmT2sAkVYzhrPA68gI4XB2ROIJhn16C1qFQ2nRrp3FJC9pE49b9RE4D0uWQy3JcjTKjT3VcBz+yEwTsxPF2+6fOlT/EdYBCXcPK9QhUi5Ugcwlv2Cid28c9w=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:39.596813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-a715ad36-ae0b-432a-9995-830cb0506cea tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Getting quotas for project 2b13bffae080413fa3fce3a1f0774f69. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:22:39.607433 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-a715ad36-ae0b-432a-9995-830cb0506cea tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Getting quotas for user 3b297139b9434b8fb9c4e61ffb096faf and project 2b13bffae080413fa3fce3a1f0774f69. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:22:39.654548 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a715ad36-ae0b-432a-9995-830cb0506cea tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.2 time: 0.083681 Aug 24 10:22:39.664458 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1399/2502] 10.222.0.85 () {62 vars in 1199 bytes} [Wed Aug 24 10:22:39 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 95 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 24 10:22:39.671974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-46f5ceef-3bf6-4991-b54e-9996e6bfde30 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:39.673349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-46f5ceef-3bf6-4991-b54e-9996e6bfde30 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] [instance: 2bc88682-b0f5-42fc-88e5-a74d75b8e241] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:39.683636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46f5ceef-3bf6-4991-b54e-9996e6bfde30 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:39.686231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46f5ceef-3bf6-4991-b54e-9996e6bfde30 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:39.687011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46f5ceef-3bf6-4991-b54e-9996e6bfde30 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:39.688623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46f5ceef-3bf6-4991-b54e-9996e6bfde30 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:39.689570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46f5ceef-3bf6-4991-b54e-9996e6bfde30 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:39.690452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46f5ceef-3bf6-4991-b54e-9996e6bfde30 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:39.703037 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5ca35608-4348-41de-8502-009a7209df2c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:39.717591 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-46f5ceef-3bf6-4991-b54e-9996e6bfde30 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] HTTP exception thrown: Instance 2bc88682-b0f5-42fc-88e5-a74d75b8e241 could not be found. Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-46f5ceef-3bf6-4991-b54e-9996e6bfde30 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Request method failure captured: Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241 HTTP/1.1 Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBftwtkhYP4zVF4PKA_bbCUujMmaUgoOlVaJMarOwcdHu-Cd_fF_suW9VbHy5cTzlyLKYgAm3UtbAsusltb4Lqx0usRchQC4NUtKIzb7RzB_Wo4hVkJ-Yah_B2FWA6LQhnHChV92UclDGeBzsxsDDJri9vE4dJhKtXY4OkSfVmRZaA_k Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 4b648a28a11e4016a1fe87ea6b6f01b2 Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ListServerFiltersTestJSON-769713699 Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/4b648a28a11e4016a1fe87ea6b6f01b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_4b648a28a11e4016a1fe87ea6b6f01b2", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/4b648a28a11e4016a1fe87ea6b6f01b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/4b648a28a11e4016a1fe87ea6b6f01b2"}]}] Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ListServerFiltersTestJSON-769713699 Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 4b648a28a11e4016a1fe87ea6b6f01b2 Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-769713699 Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ListServerFiltersTestJSON-769713699-project Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: d4163d2bb72c43e7b0315c5e782d5fa7 Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ListServerFiltersTestJSON-769713699-project Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 2bc88682-b0f5-42fc-88e5-a74d75b8e241 could not be found. Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '2bc88682-b0f5-42fc-88e5-a74d75b8e241'} Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bc88682-b0f5-42fc-88e5-a74d75b8e241 could not be found. Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bc88682-b0f5-42fc-88e5-a74d75b8e241 could not be found. Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:39.720995 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:22:39.728968 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:39.728968 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:39.728968 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:39.728968 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:22:39.728968 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:22:39.728968 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bc88682-b0f5-42fc-88e5-a74d75b8e241 could not be found. Aug 24 10:22:39.728968 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:22:39.728968 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-46f5ceef-3bf6-4991-b54e-9996e6bfde30 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] Returning 404 to user: Instance 2bc88682-b0f5-42fc-88e5-a74d75b8e241 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:22:39.728968 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-46f5ceef-3bf6-4991-b54e-9996e6bfde30 tempest-ListServerFiltersTestJSON-769713699 tempest-ListServerFiltersTestJSON-769713699-project] 10.222.0.85 "GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241" status: 404 len: 111 microversion: 2.1 time: 0.057321 Aug 24 10:22:39.731491 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1400/2503] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:39 2022] GET /compute/v2.1/servers/2bc88682-b0f5-42fc-88e5-a74d75b8e241 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:22:39.740628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cac0ed2c-7b27-42d2-b5e4-4d83ed87f884 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:39.742516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cac0ed2c-7b27-42d2-b5e4-4d83ed87f884 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:39.757753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cac0ed2c-7b27-42d2-b5e4-4d83ed87f884 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:39.757753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cac0ed2c-7b27-42d2-b5e4-4d83ed87f884 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:39.757753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cac0ed2c-7b27-42d2-b5e4-4d83ed87f884 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:39.758351 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5ca35608-4348-41de-8502-009a7209df2c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1355 microversion: 2.1 time: 0.603118 Aug 24 10:22:39.758508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cac0ed2c-7b27-42d2-b5e4-4d83ed87f884 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:39.758658 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1104/2504] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:39 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1355 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:39.758801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cac0ed2c-7b27-42d2-b5e4-4d83ed87f884 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:39.758801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cac0ed2c-7b27-42d2-b5e4-4d83ed87f884 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:39.772378 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-2f8b70fd-f672-41ea-87e0-b35165bcbad0 req-0199eceb-464c-4fb2-a95d-4e3b3cbaeb26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb", "name": "network-vif-deleted", "tag": "c181228f-fe7e-4a76-bb5e-18f9995613d1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:39.794499 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2f8b70fd-f672-41ea-87e0-b35165bcbad0 req-0199eceb-464c-4fb2-a95d-4e3b3cbaeb26 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:39.795368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2f8b70fd-f672-41ea-87e0-b35165bcbad0 req-0199eceb-464c-4fb2-a95d-4e3b3cbaeb26 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:39.796092 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2f8b70fd-f672-41ea-87e0-b35165bcbad0 req-0199eceb-464c-4fb2-a95d-4e3b3cbaeb26 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:39.830512 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-2f8b70fd-f672-41ea-87e0-b35165bcbad0 req-0199eceb-464c-4fb2-a95d-4e3b3cbaeb26 service nova] Creating event network-vif-deleted:c181228f-fe7e-4a76-bb5e-18f9995613d1 for instance fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb on n-h1-849328-3 Aug 24 10:22:39.840655 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-2f8b70fd-f672-41ea-87e0-b35165bcbad0 req-0199eceb-464c-4fb2-a95d-4e3b3cbaeb26 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079537 Aug 24 10:22:39.846616 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1105/2505] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:39.853098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d12a9f80-1b53-4b70-92c4-626ae6998247 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:39.853839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d12a9f80-1b53-4b70-92c4-626ae6998247 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:39.862490 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d12a9f80-1b53-4b70-92c4-626ae6998247 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:39.862997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d12a9f80-1b53-4b70-92c4-626ae6998247 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:39.863441 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d12a9f80-1b53-4b70-92c4-626ae6998247 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:39.864168 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d12a9f80-1b53-4b70-92c4-626ae6998247 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:39.865109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d12a9f80-1b53-4b70-92c4-626ae6998247 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:39.865757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d12a9f80-1b53-4b70-92c4-626ae6998247 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:40.028012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cac0ed2c-7b27-42d2-b5e4-4d83ed87f884 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba7af3841d9463ca5abc1a7de6f722a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b951c1be813434898ac93429f2064d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:40.042478 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cac0ed2c-7b27-42d2-b5e4-4d83ed87f884 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb" status: 200 len: 1432 microversion: 2.1 time: 0.310593 Aug 24 10:22:40.059244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d12a9f80-1b53-4b70-92c4-626ae6998247 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:40.062689 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1401/2506] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:39 2022] GET /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb => generated 1432 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:40.070594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-feff8543-715f-4da7-9ee7-764494a2e013 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Calling method '.version_select at 0x7f465462ea60>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:40.075177 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d12a9f80-1b53-4b70-92c4-626ae6998247 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1184 microversion: 2.1 time: 0.225135 Aug 24 10:22:40.075895 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1106/2507] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:39 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1184 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:40.114865 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-feff8543-715f-4da7-9ee7-764494a2e013 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-86060321" status: 204 len: 0 microversion: 2.2 time: 0.050582 Aug 24 10:22:40.115475 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1402/2508] 10.222.0.85 () {60 vars in 1255 bytes} [Wed Aug 24 10:22:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-86060321 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:22:40.129631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0dbc2266-c0d1-4893-8e90-6c27552b85d7 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Action: 'create', calling method: .version_select at 0x7f4654cdf3a0>, body: {"keypair": {"name": "tempest-keypair-1029807641", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:40.172214 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-0dbc2266-c0d1-4893-8e90-6c27552b85d7 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Getting quotas for project 2b13bffae080413fa3fce3a1f0774f69. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:22:40.180848 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e78493ad-d01b-4dc8-86fc-fc6c2952fa4e tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:40.182117 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e78493ad-d01b-4dc8-86fc-fc6c2952fa4e tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:40.188076 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-0dbc2266-c0d1-4893-8e90-6c27552b85d7 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Getting quotas for user 3b297139b9434b8fb9c4e61ffb096faf and project 2b13bffae080413fa3fce3a1f0774f69. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:22:40.196012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e78493ad-d01b-4dc8-86fc-fc6c2952fa4e tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:40.198286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e78493ad-d01b-4dc8-86fc-fc6c2952fa4e tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:40.201152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e78493ad-d01b-4dc8-86fc-fc6c2952fa4e tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:40.202926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e78493ad-d01b-4dc8-86fc-fc6c2952fa4e tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:40.210296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e78493ad-d01b-4dc8-86fc-fc6c2952fa4e tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:40.211620 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e78493ad-d01b-4dc8-86fc-fc6c2952fa4e tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:40.222621 n-d-849328-3 devstack@n-api.service[122432]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0dbc2266-c0d1-4893-8e90-6c27552b85d7 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] [b60230c6-5780-45e5-a183-c06fec8b377e] AMQP server on 10.222.0.85:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 10:22:40.568540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e78493ad-d01b-4dc8-86fc-fc6c2952fa4e tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d264ad8190a4cd9be236d05564fe1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5264f4afb64ba9927050b9b94d37a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:40.594739 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e78493ad-d01b-4dc8-86fc-fc6c2952fa4e tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08" status: 200 len: 1369 microversion: 2.1 time: 0.416839 Aug 24 10:22:40.612047 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1403/2509] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:40 2022] GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 => generated 1369 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:40.629854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-26d8cecc-4ee2-443d-a33b-8d7609ccf3ec tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:40.630913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-26d8cecc-4ee2-443d-a33b-8d7609ccf3ec tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:40.641721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26d8cecc-4ee2-443d-a33b-8d7609ccf3ec tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:40.642555 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26d8cecc-4ee2-443d-a33b-8d7609ccf3ec tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:40.643347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26d8cecc-4ee2-443d-a33b-8d7609ccf3ec tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:40.644559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26d8cecc-4ee2-443d-a33b-8d7609ccf3ec tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:40.645403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26d8cecc-4ee2-443d-a33b-8d7609ccf3ec tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:40.646199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26d8cecc-4ee2-443d-a33b-8d7609ccf3ec tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:40.799867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-26d8cecc-4ee2-443d-a33b-8d7609ccf3ec tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:40.832377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-26d8cecc-4ee2-443d-a33b-8d7609ccf3ec tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:40.834446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-26d8cecc-4ee2-443d-a33b-8d7609ccf3ec tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:40.837568 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-26d8cecc-4ee2-443d-a33b-8d7609ccf3ec tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1365 microversion: 2.47 time: 0.223866 Aug 24 10:22:40.839361 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1404/2510] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:40 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1365 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:40.844817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a588680e-82cf-445f-9223-18ad0ee365d6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:40.845439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a588680e-82cf-445f-9223-18ad0ee365d6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:40.854668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a588680e-82cf-445f-9223-18ad0ee365d6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:40.855391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a588680e-82cf-445f-9223-18ad0ee365d6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:40.856169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a588680e-82cf-445f-9223-18ad0ee365d6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:40.859922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a588680e-82cf-445f-9223-18ad0ee365d6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:40.859922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a588680e-82cf-445f-9223-18ad0ee365d6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:40.860288 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a588680e-82cf-445f-9223-18ad0ee365d6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:40.916630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:41.237731 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [None req-0dbc2266-c0d1-4893-8e90-6c27552b85d7 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] [b60230c6-5780-45e5-a183-c06fec8b377e] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 59692. Aug 24 10:22:41.267281 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0dbc2266-c0d1-4893-8e90-6c27552b85d7 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 1.144159 Aug 24 10:22:41.268710 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1107/2511] 10.222.0.85 () {62 vars in 1199 bytes} [Wed Aug 24 10:22:40 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 1146 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 24 10:22:41.280572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2295e7ae-f7b7-4fb1-85d1-bc3f2e636346 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:41.284983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2295e7ae-f7b7-4fb1-85d1-bc3f2e636346 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:41.292258 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a588680e-82cf-445f-9223-18ad0ee365d6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:41.307063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2295e7ae-f7b7-4fb1-85d1-bc3f2e636346 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:41.310138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2295e7ae-f7b7-4fb1-85d1-bc3f2e636346 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:41.311069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2295e7ae-f7b7-4fb1-85d1-bc3f2e636346 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:41.312359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2295e7ae-f7b7-4fb1-85d1-bc3f2e636346 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:41.313616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2295e7ae-f7b7-4fb1-85d1-bc3f2e636346 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:41.314417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2295e7ae-f7b7-4fb1-85d1-bc3f2e636346 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:41.335381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a588680e-82cf-445f-9223-18ad0ee365d6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:41.341697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a588680e-82cf-445f-9223-18ad0ee365d6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:41.350709 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a588680e-82cf-445f-9223-18ad0ee365d6 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 2951 microversion: 2.32 time: 0.509175 Aug 24 10:22:41.353604 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1405/2512] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:40 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 2951 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:41.387824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9d6ea304-f22e-4d30-a1e4-2736e0bf825b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:41.396667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9d6ea304-f22e-4d30-a1e4-2736e0bf825b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] [instance: fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:41.423977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d6ea304-f22e-4d30-a1e4-2736e0bf825b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:41.424608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d6ea304-f22e-4d30-a1e4-2736e0bf825b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:41.425327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d6ea304-f22e-4d30-a1e4-2736e0bf825b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:41.426236 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d6ea304-f22e-4d30-a1e4-2736e0bf825b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:41.427144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d6ea304-f22e-4d30-a1e4-2736e0bf825b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:41.427669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d6ea304-f22e-4d30-a1e4-2736e0bf825b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:41.463185 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-9d6ea304-f22e-4d30-a1e4-2736e0bf825b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] HTTP exception thrown: Instance fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb could not be found. Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9d6ea304-f22e-4d30-a1e4-2736e0bf825b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Request method failure captured: Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb HTTP/1.1 Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfs261LzsKgWADAKqtH5FXD2KrvVOdGixTvLaPQOF4IzI3yce50JOpfKAgifoGowIyP5WLjePeCoC89Wm1LJACIddiDIWAQl8p0qqSFIUffDLAxmq_m6HdvZrEEdDppj11hD-8m5C7k5Ori0mOcXCRWDkmQXaxKpu7x2Js2aGUJWmtY Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 6b951c1be813434898ac93429f2064d6 Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ListImageFiltersTestJSON-1534391697 Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6b951c1be813434898ac93429f2064d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6b951c1be813434898ac93429f2064d6", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6b951c1be813434898ac93429f2064d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6b951c1be813434898ac93429f2064d6"}]}] Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ListImageFiltersTestJSON-1534391697 Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 6b951c1be813434898ac93429f2064d6 Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1534391697 Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ListImageFiltersTestJSON-1534391697-project Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: cba7af3841d9463ca5abc1a7de6f722a Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ListImageFiltersTestJSON-1534391697-project Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb could not be found. Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb'} Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb could not be found. Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb could not be found. Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:41.467118 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:22:41.475644 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:41.475644 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:41.475644 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:41.475644 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:22:41.475644 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:22:41.475644 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb could not be found. Aug 24 10:22:41.475644 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:22:41.475644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9d6ea304-f22e-4d30-a1e4-2736e0bf825b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Returning 404 to user: Instance fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:22:41.475644 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9d6ea304-f22e-4d30-a1e4-2736e0bf825b tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "GET /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb" status: 404 len: 111 microversion: 2.1 time: 0.114412 Aug 24 10:22:41.475644 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1406/2513] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:41 2022] GET /compute/v2.1/servers/fe79f5ac-2a2a-4f7c-b3b7-3dae2fcbc6eb => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:22:41.480443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a2153eaf-b2a7-44c1-8fd8-b7eb8f450a29 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:41.481597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a2153eaf-b2a7-44c1-8fd8-b7eb8f450a29 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:41.515362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2153eaf-b2a7-44c1-8fd8-b7eb8f450a29 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:41.517745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2153eaf-b2a7-44c1-8fd8-b7eb8f450a29 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:41.518232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2153eaf-b2a7-44c1-8fd8-b7eb8f450a29 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:41.518999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2153eaf-b2a7-44c1-8fd8-b7eb8f450a29 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:41.519479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2153eaf-b2a7-44c1-8fd8-b7eb8f450a29 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:41.519904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2153eaf-b2a7-44c1-8fd8-b7eb8f450a29 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:41.627718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a2153eaf-b2a7-44c1-8fd8-b7eb8f450a29 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:41.640529 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a2153eaf-b2a7-44c1-8fd8-b7eb8f450a29 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1184 microversion: 2.1 time: 0.165612 Aug 24 10:22:41.649163 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1407/2514] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:41 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1184 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:41.658708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d1aa947c-7583-4742-bb0b-f1721538d239 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Calling method '.version_select at 0x7f465a21ff70>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:41.684277 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d1aa947c-7583-4742-bb0b-f1721538d239 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1029807641" status: 204 len: 0 microversion: 2.2 time: 0.031598 Aug 24 10:22:41.686198 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1408/2515] 10.222.0.85 () {60 vars in 1261 bytes} [Wed Aug 24 10:22:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1029807641 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:22:41.699343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b5a948e6-7f2e-400f-b3d4-f851de58b110 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4654e7b280>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:41.810424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2295e7ae-f7b7-4fb1-85d1-bc3f2e636346 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:41.821908 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2295e7ae-f7b7-4fb1-85d1-bc3f2e636346 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1355 microversion: 2.1 time: 0.551397 Aug 24 10:22:41.823842 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1108/2516] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:41 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1355 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:41.830720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-35e88ede-edf5-45df-9e3a-97745aa662ca tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:41.832503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-35e88ede-edf5-45df-9e3a-97745aa662ca tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:41.844093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35e88ede-edf5-45df-9e3a-97745aa662ca tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:41.845478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35e88ede-edf5-45df-9e3a-97745aa662ca tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:41.846798 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35e88ede-edf5-45df-9e3a-97745aa662ca tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:41.848909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35e88ede-edf5-45df-9e3a-97745aa662ca tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:41.850053 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35e88ede-edf5-45df-9e3a-97745aa662ca tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:41.851493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35e88ede-edf5-45df-9e3a-97745aa662ca tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:42.273415 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b5a948e6-7f2e-400f-b3d4-f851de58b110 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "DELETE /compute/v2.1/images/a9ca6340-fb49-481f-bc39-746c12e680ff" status: 204 len: 0 microversion: 2.1 time: 0.582253 Aug 24 10:22:42.277930 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1409/2517] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:41 2022] DELETE /compute/v2.1/images/a9ca6340-fb49-481f-bc39-746c12e680ff => generated 0 bytes in 584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:22:42.283127 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de2e30f8-1232-4b50-a367-af6a0c3085d7 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Action: 'create', calling method: .version_select at 0x7f46550928b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1761320791", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrrjLMpIvP4zuRypzI/yWv0spRwOVuM7YTc/+7nv05QOYThqHAgl7L2mhM6Tj9dnpi4PH8j+gzfstRrrybah9P+Cf0VJnjPQ3ip6pzSwKdf0x91+t0iQjZDRm3crBkY5g=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:42.322732 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-de2e30f8-1232-4b50-a367-af6a0c3085d7 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Getting quotas for project 2b13bffae080413fa3fce3a1f0774f69. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:22:42.330419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-de2e30f8-1232-4b50-a367-af6a0c3085d7 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Getting quotas for user 3b297139b9434b8fb9c4e61ffb096faf and project 2b13bffae080413fa3fce3a1f0774f69. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:22:42.371582 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-de2e30f8-1232-4b50-a367-af6a0c3085d7 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.092411 Aug 24 10:22:42.381383 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1410/2518] 10.222.0.85 () {62 vars in 1199 bytes} [Wed Aug 24 10:22:42 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 95 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 24 10:22:42.390968 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-868c28d5-c18f-4dfd-9060-4badd96785c7 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:42.392312 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-868c28d5-c18f-4dfd-9060-4badd96785c7 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:42.405464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-868c28d5-c18f-4dfd-9060-4badd96785c7 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:42.406721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-868c28d5-c18f-4dfd-9060-4badd96785c7 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:42.407751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-868c28d5-c18f-4dfd-9060-4badd96785c7 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:42.409240 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-868c28d5-c18f-4dfd-9060-4badd96785c7 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:42.410022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-868c28d5-c18f-4dfd-9060-4badd96785c7 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:42.410949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-868c28d5-c18f-4dfd-9060-4badd96785c7 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:42.416612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-35e88ede-edf5-45df-9e3a-97745aa662ca tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d264ad8190a4cd9be236d05564fe1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5264f4afb64ba9927050b9b94d37a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:42.438695 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-35e88ede-edf5-45df-9e3a-97745aa662ca tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08" status: 200 len: 1369 microversion: 2.1 time: 0.612989 Aug 24 10:22:42.439558 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1109/2519] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:41 2022] GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 => generated 1369 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:42.446510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-15829d50-50b4-4fa7-b75b-3529559ba65c req-b06cdca6-e9d6-47c2-b303-b1687fc16e8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a599e1a2-3ca0-4cde-b11c-ef5e069065f9", "tag": "4510534e-d3d1-48b3-a1c6-bd96fc223506"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:42.455863 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:42.461433 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-15829d50-50b4-4fa7-b75b-3529559ba65c req-b06cdca6-e9d6-47c2-b303-b1687fc16e8e service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:42.467883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-15829d50-50b4-4fa7-b75b-3529559ba65c req-b06cdca6-e9d6-47c2-b303-b1687fc16e8e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:42.469738 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-15829d50-50b4-4fa7-b75b-3529559ba65c req-b06cdca6-e9d6-47c2-b303-b1687fc16e8e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:42.500328 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-15829d50-50b4-4fa7-b75b-3529559ba65c req-b06cdca6-e9d6-47c2-b303-b1687fc16e8e service nova] Creating event network-changed:4510534e-d3d1-48b3-a1c6-bd96fc223506 for instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 on n-h1-849328-3 Aug 24 10:22:42.509610 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-15829d50-50b4-4fa7-b75b-3529559ba65c req-b06cdca6-e9d6-47c2-b303-b1687fc16e8e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067666 Aug 24 10:22:42.511623 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1110/2520] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:42.524513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-14c2b2d8-916c-4a15-aec1-e9bac22c0745 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f465564daf0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:42.557745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-868c28d5-c18f-4dfd-9060-4badd96785c7 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:42.568484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-868c28d5-c18f-4dfd-9060-4badd96785c7 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:42.571691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-868c28d5-c18f-4dfd-9060-4badd96785c7 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:42.573388 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-868c28d5-c18f-4dfd-9060-4badd96785c7 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1365 microversion: 2.47 time: 0.198750 Aug 24 10:22:42.575187 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1411/2521] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:42 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:42.594027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a9c5a43a-64c1-4788-9a55-1f5b1ad64dcf tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:42.599586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a9c5a43a-64c1-4788-9a55-1f5b1ad64dcf tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:42.608239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9c5a43a-64c1-4788-9a55-1f5b1ad64dcf tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:42.609451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9c5a43a-64c1-4788-9a55-1f5b1ad64dcf tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:42.611015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9c5a43a-64c1-4788-9a55-1f5b1ad64dcf tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:42.613986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9c5a43a-64c1-4788-9a55-1f5b1ad64dcf tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:42.614897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9c5a43a-64c1-4788-9a55-1f5b1ad64dcf tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:42.615574 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9c5a43a-64c1-4788-9a55-1f5b1ad64dcf tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:42.938643 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-14c2b2d8-916c-4a15-aec1-e9bac22c0745 tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "DELETE /compute/v2.1/images/bfcee4fd-af5d-4321-b5c3-ef893f5e16cd" status: 204 len: 0 microversion: 2.1 time: 0.421487 Aug 24 10:22:42.939874 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1111/2522] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:42 2022] DELETE /compute/v2.1/images/bfcee4fd-af5d-4321-b5c3-ef893f5e16cd => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:22:42.948656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-278c0ab8-e663-4857-beed-c42053cafc33 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Action: 'create', calling method: .version_select at 0x7f46555e14c0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-974591720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMsTZmp1aVsDjTK/gP96DeUeEUWNM9Gk4yIa2dP88nGtcBJ+VX/kK2180dD8t8zBM/e5xkDbsQbFyRI3o+Z4Y0oH/O4bt/pN+gAFGkw7AL5zRjxDVFYrFSW+Pq31Gk9fA=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:42.975278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-278c0ab8-e663-4857-beed-c42053cafc33 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Getting quotas for project 2b13bffae080413fa3fce3a1f0774f69. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:22:42.983714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-278c0ab8-e663-4857-beed-c42053cafc33 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Getting quotas for user 3b297139b9434b8fb9c4e61ffb096faf and project 2b13bffae080413fa3fce3a1f0774f69. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:22:42.987052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a9c5a43a-64c1-4788-9a55-1f5b1ad64dcf tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:43.011381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a9c5a43a-64c1-4788-9a55-1f5b1ad64dcf tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:43.018475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a9c5a43a-64c1-4788-9a55-1f5b1ad64dcf tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:43.020876 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a9c5a43a-64c1-4788-9a55-1f5b1ad64dcf tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 2951 microversion: 2.32 time: 0.444273 Aug 24 10:22:43.022202 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1412/2523] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:42 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 2951 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:43.034353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7d5405f9-b95b-4d38-964e-b78bf4dcb2eb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:43.036503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7d5405f9-b95b-4d38-964e-b78bf4dcb2eb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:43.043708 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-278c0ab8-e663-4857-beed-c42053cafc33 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.101889 Aug 24 10:22:43.049069 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1112/2524] 10.222.0.85 () {62 vars in 1199 bytes} [Wed Aug 24 10:22:42 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 105 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 24 10:22:43.054311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a6f11a42-209c-405c-bc4a-d4192b9f6e64 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:43.071938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a6f11a42-209c-405c-bc4a-d4192b9f6e64 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:43.077359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6f11a42-209c-405c-bc4a-d4192b9f6e64 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:43.078440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6f11a42-209c-405c-bc4a-d4192b9f6e64 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:43.078881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6f11a42-209c-405c-bc4a-d4192b9f6e64 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:43.079642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6f11a42-209c-405c-bc4a-d4192b9f6e64 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:43.080283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6f11a42-209c-405c-bc4a-d4192b9f6e64 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:43.080872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6f11a42-209c-405c-bc4a-d4192b9f6e64 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:43.096934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d5405f9-b95b-4d38-964e-b78bf4dcb2eb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:43.104681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d5405f9-b95b-4d38-964e-b78bf4dcb2eb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:43.106880 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d5405f9-b95b-4d38-964e-b78bf4dcb2eb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:43.108779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d5405f9-b95b-4d38-964e-b78bf4dcb2eb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:43.108779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d5405f9-b95b-4d38-964e-b78bf4dcb2eb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:43.108779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d5405f9-b95b-4d38-964e-b78bf4dcb2eb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:43.211074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d5405f9-b95b-4d38-964e-b78bf4dcb2eb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:43.211718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d5405f9-b95b-4d38-964e-b78bf4dcb2eb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:43.212745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d5405f9-b95b-4d38-964e-b78bf4dcb2eb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:43.213831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-7d5405f9-b95b-4d38-964e-b78bf4dcb2eb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lazy-loading 'fault' on Instance uuid 70c66c18-c34f-4916-aca3-da0ca33f9ba5 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:22:43.319276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7d5405f9-b95b-4d38-964e-b78bf4dcb2eb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:43.335908 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7d5405f9-b95b-4d38-964e-b78bf4dcb2eb tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 200 len: 1189 microversion: 2.1 time: 0.308325 Aug 24 10:22:43.353244 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1413/2525] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:43 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 1189 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:43.365039 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-00e63894-1537-4ca8-aa8f-d3d56739dfde tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] Calling method '.version_select at 0x7f4655036af0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:43.689059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a6f11a42-209c-405c-bc4a-d4192b9f6e64 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:43.703514 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a6f11a42-209c-405c-bc4a-d4192b9f6e64 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1355 microversion: 2.1 time: 0.652789 Aug 24 10:22:43.713922 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1113/2526] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:43 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1355 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:43.734177 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9c7933c5-b5be-46eb-9d59-7b00a208a3ab tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Action: 'create', calling method: .version_select at 0x7f46550015e0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-340154631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDafza2eDzI/Tq1lHgEl/1jG6Ob4/9NcowYDEQ7Rvh+pl1J63sAmw72meg0EQGoZ/QpxVyVSoNFcG2LxGsIWjF8LrAtCUpjxfY6ZmWMnikq+N8CL/mqhnmQoN0csQGuZ2Q=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:43.807230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-9c7933c5-b5be-46eb-9d59-7b00a208a3ab tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Getting quotas for project 2b13bffae080413fa3fce3a1f0774f69. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:22:43.818327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-9c7933c5-b5be-46eb-9d59-7b00a208a3ab tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Getting quotas for user 3b297139b9434b8fb9c4e61ffb096faf and project 2b13bffae080413fa3fce3a1f0774f69. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:22:43.874336 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9c7933c5-b5be-46eb-9d59-7b00a208a3ab tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.158508 Aug 24 10:22:43.875153 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1114/2527] 10.222.0.85 () {62 vars in 1199 bytes} [Wed Aug 24 10:22:43 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 160 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 24 10:22:43.887910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b462a7a3-0871-4921-834f-091c0f0b0282 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:43.898987 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-00e63894-1537-4ca8-aa8f-d3d56739dfde tempest-ListImageFiltersTestJSON-1534391697 tempest-ListImageFiltersTestJSON-1534391697-project] 10.222.0.85 "DELETE /compute/v2.1/images/2ceceae6-4c27-49a4-adb2-e1e37ce140ac" status: 204 len: 0 microversion: 2.1 time: 0.554352 Aug 24 10:22:43.900289 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b462a7a3-0871-4921-834f-091c0f0b0282 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:43.900625 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1414/2528] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:43 2022] DELETE /compute/v2.1/images/2ceceae6-4c27-49a4-adb2-e1e37ce140ac => generated 0 bytes in 560 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:22:43.911144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b462a7a3-0871-4921-834f-091c0f0b0282 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:43.912056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b462a7a3-0871-4921-834f-091c0f0b0282 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:43.912793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b462a7a3-0871-4921-834f-091c0f0b0282 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:43.920626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f1c8887d-a557-4c2d-9fa9-e3e28627cf2c tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:43.925219 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b462a7a3-0871-4921-834f-091c0f0b0282 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:43.925852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b462a7a3-0871-4921-834f-091c0f0b0282 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:43.926453 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b462a7a3-0871-4921-834f-091c0f0b0282 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:43.926671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f1c8887d-a557-4c2d-9fa9-e3e28627cf2c tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:43.947652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1c8887d-a557-4c2d-9fa9-e3e28627cf2c tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:43.948439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1c8887d-a557-4c2d-9fa9-e3e28627cf2c tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:43.949024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1c8887d-a557-4c2d-9fa9-e3e28627cf2c tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:43.949933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1c8887d-a557-4c2d-9fa9-e3e28627cf2c tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:43.950664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1c8887d-a557-4c2d-9fa9-e3e28627cf2c tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:43.950976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1c8887d-a557-4c2d-9fa9-e3e28627cf2c tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:44.200973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f1c8887d-a557-4c2d-9fa9-e3e28627cf2c tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:44.216960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f1c8887d-a557-4c2d-9fa9-e3e28627cf2c tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:44.221762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f1c8887d-a557-4c2d-9fa9-e3e28627cf2c tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:44.227099 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f1c8887d-a557-4c2d-9fa9-e3e28627cf2c tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1365 microversion: 2.47 time: 0.324044 Aug 24 10:22:44.243422 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1415/2529] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:43 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1365 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:44.262122 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-828097c6-ccb3-408a-b333-1db6ecfab7d4 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Calling method '.version_select at 0x7f4655230700>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:44.275163 n-d-849328-3 devstack@n-api.service[122433]: WARNING oslo_db.sqlalchemy.utils [None req-828097c6-ccb3-408a-b333-1db6ecfab7d4 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 24 10:22:44.288794 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-828097c6-ccb3-408a-b333-1db6ecfab7d4 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] 10.222.0.85 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.043805 Aug 24 10:22:44.294347 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1416/2530] 10.222.0.85 () {60 vars in 1177 bytes} [Wed Aug 24 10:22:44 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:44.306615 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0cd7e0b5-c421-491a-8f82-b76e834a07fc tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:44.307628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0cd7e0b5-c421-491a-8f82-b76e834a07fc tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:44.320767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cd7e0b5-c421-491a-8f82-b76e834a07fc tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:44.324021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cd7e0b5-c421-491a-8f82-b76e834a07fc tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:44.325026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cd7e0b5-c421-491a-8f82-b76e834a07fc tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:44.325876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cd7e0b5-c421-491a-8f82-b76e834a07fc tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:44.326366 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cd7e0b5-c421-491a-8f82-b76e834a07fc tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:44.329840 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cd7e0b5-c421-491a-8f82-b76e834a07fc tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:44.351024 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b462a7a3-0871-4921-834f-091c0f0b0282 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d264ad8190a4cd9be236d05564fe1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5264f4afb64ba9927050b9b94d37a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:44.368566 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b462a7a3-0871-4921-834f-091c0f0b0282 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08" status: 200 len: 1369 microversion: 2.1 time: 0.491689 Aug 24 10:22:44.369529 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1115/2531] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:43 2022] GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 => generated 1369 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:44.377587 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-472bb7e3-91f8-4931-900b-61504f66c2b6 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Calling method '.version_select at 0x7f4654d33550>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:44.451185 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-472bb7e3-91f8-4931-900b-61504f66c2b6 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-340154631" status: 204 len: 0 microversion: 2.2 time: 0.078999 Aug 24 10:22:44.461867 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1116/2532] 10.222.0.85 () {60 vars in 1318 bytes} [Wed Aug 24 10:22:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-340154631 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:22:44.478362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c42ed62e-59e5-461c-a1c3-4de53466f143 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:44.479429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c42ed62e-59e5-461c-a1c3-4de53466f143 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 70c66c18-c34f-4916-aca3-da0ca33f9ba5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:44.508000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c42ed62e-59e5-461c-a1c3-4de53466f143 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:44.509155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c42ed62e-59e5-461c-a1c3-4de53466f143 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:44.510942 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c42ed62e-59e5-461c-a1c3-4de53466f143 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:44.513399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c42ed62e-59e5-461c-a1c3-4de53466f143 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:44.517703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c42ed62e-59e5-461c-a1c3-4de53466f143 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:44.518573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c42ed62e-59e5-461c-a1c3-4de53466f143 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:44.562113 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-c42ed62e-59e5-461c-a1c3-4de53466f143 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] HTTP exception thrown: Instance 70c66c18-c34f-4916-aca3-da0ca33f9ba5 could not be found. Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c42ed62e-59e5-461c-a1c3-4de53466f143 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Request method failure captured: Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 HTTP/1.1 Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfopYPNODIjgyV0ghZgKGzaV6sR703fZMFE85piXFs7iToEiJtoRq97UvfpuesyKlStryOHX0Cd03kzmhSe80oezylVMIQdXboIk7utG8cR-2jHBjltAOE6fhy1pAB-jxOO7rOHXL1Y33J4_ydce_QqZibRdb3tO5zwih50Wa5huyaA Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 6f266868d6374a82a4ba5333915a9884 Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-LiveMigrationTest-94062731 Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6f266868d6374a82a4ba5333915a9884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6f266868d6374a82a4ba5333915a9884", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6f266868d6374a82a4ba5333915a9884"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6f266868d6374a82a4ba5333915a9884"}]}] Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-LiveMigrationTest-94062731 Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 6f266868d6374a82a4ba5333915a9884 Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-LiveMigrationTest-94062731 Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-LiveMigrationTest-94062731-project Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: b321b1490c2b4fe3aa1a1747b25408a1 Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-LiveMigrationTest-94062731-project Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 70c66c18-c34f-4916-aca3-da0ca33f9ba5 could not be found. Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '70c66c18-c34f-4916-aca3-da0ca33f9ba5'} Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70c66c18-c34f-4916-aca3-da0ca33f9ba5 could not be found. Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c66c18-c34f-4916-aca3-da0ca33f9ba5 could not be found. Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:44.567449 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:22:44.578130 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:44.578130 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:44.578130 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:44.578130 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:22:44.578130 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:22:44.578130 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c66c18-c34f-4916-aca3-da0ca33f9ba5 could not be found. Aug 24 10:22:44.578130 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:22:44.582012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c42ed62e-59e5-461c-a1c3-4de53466f143 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Returning 404 to user: Instance 70c66c18-c34f-4916-aca3-da0ca33f9ba5 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:22:44.589013 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c42ed62e-59e5-461c-a1c3-4de53466f143 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5" status: 404 len: 111 microversion: 2.1 time: 0.123635 Aug 24 10:22:44.594645 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1117/2533] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:44 2022] GET /compute/v2.1/servers/70c66c18-c34f-4916-aca3-da0ca33f9ba5 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:22:44.616928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9db455dc-c7f9-4d08-a43d-8fc4fdfcab49 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Calling method '.version_select at 0x7f4654d3e0d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:44.721883 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9db455dc-c7f9-4d08-a43d-8fc4fdfcab49 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-974591720" status: 204 len: 0 microversion: 2.2 time: 0.124000 Aug 24 10:22:44.727266 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1118/2534] 10.222.0.85 () {60 vars in 1318 bytes} [Wed Aug 24 10:22:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-974591720 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:22:44.752258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bed11960-44f7-489d-811f-87e708c8366a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:44.758099 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bed11960-44f7-489d-811f-87e708c8366a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:44.794185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bed11960-44f7-489d-811f-87e708c8366a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:44.796391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bed11960-44f7-489d-811f-87e708c8366a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:44.806227 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bed11960-44f7-489d-811f-87e708c8366a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:44.809432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bed11960-44f7-489d-811f-87e708c8366a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:44.811558 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bed11960-44f7-489d-811f-87e708c8366a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:44.815461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bed11960-44f7-489d-811f-87e708c8366a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:45.069272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0cd7e0b5-c421-491a-8f82-b76e834a07fc tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:45.106018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0cd7e0b5-c421-491a-8f82-b76e834a07fc tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:45.119126 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0cd7e0b5-c421-491a-8f82-b76e834a07fc tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:45.121425 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0cd7e0b5-c421-491a-8f82-b76e834a07fc tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 2951 microversion: 2.32 time: 0.825553 Aug 24 10:22:45.166039 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1417/2535] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:44 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 2951 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:45.210284 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f107fb93-2fe2-47b0-a95c-4c993d62e8ff tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Calling method '.version_select at 0x7f4655185940>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:45.292227 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f107fb93-2fe2-47b0-a95c-4c993d62e8ff tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1761320791" status: 204 len: 0 microversion: 2.2 time: 0.122008 Aug 24 10:22:45.305531 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1418/2536] 10.222.0.85 () {60 vars in 1321 bytes} [Wed Aug 24 10:22:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1761320791 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:22:45.316785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c10e58ec-27a4-4c61-b8cd-3dd5421d59e1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:45.317472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c10e58ec-27a4-4c61-b8cd-3dd5421d59e1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:45.343424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c10e58ec-27a4-4c61-b8cd-3dd5421d59e1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:45.344168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c10e58ec-27a4-4c61-b8cd-3dd5421d59e1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:45.344765 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c10e58ec-27a4-4c61-b8cd-3dd5421d59e1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:45.347889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c10e58ec-27a4-4c61-b8cd-3dd5421d59e1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:45.348531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c10e58ec-27a4-4c61-b8cd-3dd5421d59e1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:45.349182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c10e58ec-27a4-4c61-b8cd-3dd5421d59e1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:45.559392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c10e58ec-27a4-4c61-b8cd-3dd5421d59e1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:45.573890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c10e58ec-27a4-4c61-b8cd-3dd5421d59e1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:45.576624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c10e58ec-27a4-4c61-b8cd-3dd5421d59e1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:45.579957 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c10e58ec-27a4-4c61-b8cd-3dd5421d59e1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1365 microversion: 2.47 time: 0.273211 Aug 24 10:22:45.583522 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1419/2537] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:45 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1365 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:45.588676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fb7609b4-f8b0-46c3-bd29-848b905220c0 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Action: 'create', calling method: .version_select at 0x7f4655230a60>, body: {"keypair": {"name": "tempest-keypair-1272777695", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZNtZzc7XewauYS06nuiLLOxeUWw25rsu7NIZvEBdYyG9V5YxkTSNYj5R7/JhrDhW86dmgs7G5LxoeTQE9kdjGc1xy180c7aL5ZDm9UHqVO3w44/61teh0BmDafbzc8jg=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:45.611454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:45.631304 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bed11960-44f7-489d-811f-87e708c8366a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:45.665914 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bed11960-44f7-489d-811f-87e708c8366a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1355 microversion: 2.1 time: 0.928416 Aug 24 10:22:45.668150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-fb7609b4-f8b0-46c3-bd29-848b905220c0 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Getting quotas for project 2b13bffae080413fa3fce3a1f0774f69. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:22:45.670127 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1119/2538] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:44 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1355 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:45.679556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-fb7609b4-f8b0-46c3-bd29-848b905220c0 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Getting quotas for user 3b297139b9434b8fb9c4e61ffb096faf and project 2b13bffae080413fa3fce3a1f0774f69. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:22:45.695110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-810caea8-8344-4bef-a8e0-35b78e8b4d28 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:45.695110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-810caea8-8344-4bef-a8e0-35b78e8b4d28 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:45.736134 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fb7609b4-f8b0-46c3-bd29-848b905220c0 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.151069 Aug 24 10:22:45.737269 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1420/2539] 10.222.0.85 () {62 vars in 1199 bytes} [Wed Aug 24 10:22:45 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 153 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 24 10:22:45.748004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2961a9ca-de62-41bf-b6c3-cf48dd642d67 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Calling method '.version_select at 0x7f46550e1160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:45.749032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-810caea8-8344-4bef-a8e0-35b78e8b4d28 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:45.752351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-810caea8-8344-4bef-a8e0-35b78e8b4d28 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:45.752828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-810caea8-8344-4bef-a8e0-35b78e8b4d28 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:45.763132 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-810caea8-8344-4bef-a8e0-35b78e8b4d28 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:45.765874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-810caea8-8344-4bef-a8e0-35b78e8b4d28 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:45.766335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-810caea8-8344-4bef-a8e0-35b78e8b4d28 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:45.768918 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2961a9ca-de62-41bf-b6c3-cf48dd642d67 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] 10.222.0.85 "GET /compute/v2.1/os-keypairs/tempest-keypair-1272777695" status: 200 len: 513 microversion: 2.2 time: 0.025124 Aug 24 10:22:45.770097 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1421/2540] 10.222.0.85 () {60 vars in 1258 bytes} [Wed Aug 24 10:22:45 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1272777695 => generated 513 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:45.781388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d4f9529a-8c27-4b37-8536-3b3469a7595a tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Calling method '.version_select at 0x7f46550364c0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:45.798138 n-d-849328-3 devstack@n-api.service[122433]: WARNING oslo_db.sqlalchemy.utils [None req-d4f9529a-8c27-4b37-8536-3b3469a7595a tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 24 10:22:45.812752 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d4f9529a-8c27-4b37-8536-3b3469a7595a tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] 10.222.0.85 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.035434 Aug 24 10:22:45.820971 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1422/2541] 10.222.0.85 () {60 vars in 1177 bytes} [Wed Aug 24 10:22:45 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:45.834481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dae19870-e64f-4cfb-9d5e-7eb011295541 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Calling method '.version_select at 0x7f465516c790>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:45.898948 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dae19870-e64f-4cfb-9d5e-7eb011295541 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1272777695" status: 204 len: 0 microversion: 2.2 time: 0.076377 Aug 24 10:22:45.900963 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1423/2542] 10.222.0.85 () {60 vars in 1261 bytes} [Wed Aug 24 10:22:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1272777695 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:22:45.915621 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6387914a-40b7-4f7d-947f-d99069186964 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Action: 'create', calling method: .version_select at 0x7f46546d2310>, body: {"keypair": {"name": "tempest-keypair-757012679", "type": "x509"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:45.958356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-6387914a-40b7-4f7d-947f-d99069186964 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Getting quotas for project 2b13bffae080413fa3fce3a1f0774f69. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:22:45.973643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-6387914a-40b7-4f7d-947f-d99069186964 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Getting quotas for user 3b297139b9434b8fb9c4e61ffb096faf and project 2b13bffae080413fa3fce3a1f0774f69. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:22:46.022049 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.processutils [None req-6387914a-40b7-4f7d-947f-d99069186964 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp6grkt1yf/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp6grkt1yf/temp.key -subj /CN=3b297139b9434b8fb9c4e61ffb096faf -extensions v3_req_client {{(pid=122433) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 24 10:22:46.655013 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-810caea8-8344-4bef-a8e0-35b78e8b4d28 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d264ad8190a4cd9be236d05564fe1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5264f4afb64ba9927050b9b94d37a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:46.664478 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-810caea8-8344-4bef-a8e0-35b78e8b4d28 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08" status: 200 len: 1369 microversion: 2.1 time: 0.992542 Aug 24 10:22:46.672150 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1120/2543] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:45 2022] GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 => generated 1369 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:46.696669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7cd6f554-80ce-4837-b4f3-d2ce56268531 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:46.697848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7cd6f554-80ce-4837-b4f3-d2ce56268531 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:46.722097 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cd6f554-80ce-4837-b4f3-d2ce56268531 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:46.723999 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cd6f554-80ce-4837-b4f3-d2ce56268531 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:46.728581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cd6f554-80ce-4837-b4f3-d2ce56268531 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:46.729749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cd6f554-80ce-4837-b4f3-d2ce56268531 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:46.730943 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cd6f554-80ce-4837-b4f3-d2ce56268531 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:46.733214 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cd6f554-80ce-4837-b4f3-d2ce56268531 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:47.308414 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.processutils [None req-6387914a-40b7-4f7d-947f-d99069186964 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp6grkt1yf/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp6grkt1yf/temp.key -subj /CN=3b297139b9434b8fb9c4e61ffb096faf -extensions v3_req_client" returned: 0 in 1.286s {{(pid=122433) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 24 10:22:47.310139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.processutils [None req-6387914a-40b7-4f7d-947f-d99069186964 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp6grkt1yf/temp.key -password pass: {{(pid=122433) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 24 10:22:47.382488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.processutils [None req-6387914a-40b7-4f7d-947f-d99069186964 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp6grkt1yf/temp.key -password pass:" returned: 0 in 0.071s {{(pid=122433) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 24 10:22:47.442457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7cd6f554-80ce-4837-b4f3-d2ce56268531 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:47.469182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7cd6f554-80ce-4837-b4f3-d2ce56268531 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:47.472509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-6387914a-40b7-4f7d-947f-d99069186964 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Getting quotas for project 2b13bffae080413fa3fce3a1f0774f69. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:22:47.476824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7cd6f554-80ce-4837-b4f3-d2ce56268531 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:47.479682 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7cd6f554-80ce-4837-b4f3-d2ce56268531 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 2909 microversion: 2.32 time: 0.806374 Aug 24 10:22:47.487182 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1121/2544] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:46 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 2909 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:47.505411 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-14501486-e3e4-4191-ba5a-2a283371dca2 req-dbb27912-3990-433f-83f5-374e4b840e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f6298f4-4be1-47e8-a260-c43d83731e08", "name": "network-vif-plugged", "status": "completed", "tag": "a849beed-fe2d-49fa-a6c1-d0686458269b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:47.517517 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-6387914a-40b7-4f7d-947f-d99069186964 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Getting quotas for user 3b297139b9434b8fb9c4e61ffb096faf and project 2b13bffae080413fa3fce3a1f0774f69. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:22:47.543490 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-14501486-e3e4-4191-ba5a-2a283371dca2 req-dbb27912-3990-433f-83f5-374e4b840e75 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:47.547798 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-14501486-e3e4-4191-ba5a-2a283371dca2 req-dbb27912-3990-433f-83f5-374e4b840e75 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:47.548229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-14501486-e3e4-4191-ba5a-2a283371dca2 req-dbb27912-3990-433f-83f5-374e4b840e75 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:47.601611 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6387914a-40b7-4f7d-947f-d99069186964 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 1.680823 Aug 24 10:22:47.605612 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1424/2545] 10.222.0.85 () {62 vars in 1198 bytes} [Wed Aug 24 10:22:45 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 1697 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Aug 24 10:22:47.615236 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-14501486-e3e4-4191-ba5a-2a283371dca2 req-dbb27912-3990-433f-83f5-374e4b840e75 service nova] Creating event network-vif-plugged:a849beed-fe2d-49fa-a6c1-d0686458269b for instance 0f6298f4-4be1-47e8-a260-c43d83731e08 on n-h1-849328-3 Aug 24 10:22:47.615725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1cda1fb4-d322-45bc-b1df-435733813db3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:47.616460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1cda1fb4-d322-45bc-b1df-435733813db3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:47.643261 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-14501486-e3e4-4191-ba5a-2a283371dca2 req-dbb27912-3990-433f-83f5-374e4b840e75 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151152 Aug 24 10:22:47.644453 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1122/2546] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:47.667327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cda1fb4-d322-45bc-b1df-435733813db3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:47.668255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cda1fb4-d322-45bc-b1df-435733813db3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:47.668947 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cda1fb4-d322-45bc-b1df-435733813db3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:47.675436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cda1fb4-d322-45bc-b1df-435733813db3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:47.675943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cda1fb4-d322-45bc-b1df-435733813db3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:47.676598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cda1fb4-d322-45bc-b1df-435733813db3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:47.680735 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a826a88c-1d54-4e31-ae1d-072329f4ff09 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:47.684784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a826a88c-1d54-4e31-ae1d-072329f4ff09 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:47.707034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a826a88c-1d54-4e31-ae1d-072329f4ff09 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:47.707529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a826a88c-1d54-4e31-ae1d-072329f4ff09 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:47.711891 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a826a88c-1d54-4e31-ae1d-072329f4ff09 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:47.712787 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a826a88c-1d54-4e31-ae1d-072329f4ff09 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:47.715824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a826a88c-1d54-4e31-ae1d-072329f4ff09 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:47.716339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a826a88c-1d54-4e31-ae1d-072329f4ff09 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:47.886877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1cda1fb4-d322-45bc-b1df-435733813db3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:47.896261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1cda1fb4-d322-45bc-b1df-435733813db3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:47.908587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1cda1fb4-d322-45bc-b1df-435733813db3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:47.910338 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1cda1fb4-d322-45bc-b1df-435733813db3 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1365 microversion: 2.47 time: 0.303029 Aug 24 10:22:47.914366 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1425/2547] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:47 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1365 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:47.918754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ed754447-1752-4d31-a0db-83283769b2d2 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Calling method '.version_select at 0x7f4654fbedc0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:47.948260 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ed754447-1752-4d31-a0db-83283769b2d2 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] 10.222.0.85 "GET /compute/v2.1/os-keypairs/tempest-keypair-757012679" status: 200 len: 1533 microversion: 2.2 time: 0.035716 Aug 24 10:22:47.957298 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1426/2548] 10.222.0.85 () {60 vars in 1255 bytes} [Wed Aug 24 10:22:47 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-757012679 => generated 1533 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:47.968310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-90757f2b-a66c-41fa-8b3a-68083bd79906 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:47.971672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-90757f2b-a66c-41fa-8b3a-68083bd79906 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:47.986002 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90757f2b-a66c-41fa-8b3a-68083bd79906 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:47.988893 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90757f2b-a66c-41fa-8b3a-68083bd79906 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:47.989389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90757f2b-a66c-41fa-8b3a-68083bd79906 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:47.990149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90757f2b-a66c-41fa-8b3a-68083bd79906 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:47.993067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90757f2b-a66c-41fa-8b3a-68083bd79906 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:47.993582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90757f2b-a66c-41fa-8b3a-68083bd79906 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:48.355185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a826a88c-1d54-4e31-ae1d-072329f4ff09 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:48.378638 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a826a88c-1d54-4e31-ae1d-072329f4ff09 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1355 microversion: 2.1 time: 0.731882 Aug 24 10:22:48.399430 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1123/2549] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:47 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1355 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:48.416573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9f727355-3604-409c-b0ae-d472c307865c tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Calling method '.version_select at 0x7f465508aaf0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:48.425428 n-d-849328-3 devstack@n-api.service[122432]: WARNING oslo_db.sqlalchemy.utils [None req-9f727355-3604-409c-b0ae-d472c307865c tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 24 10:22:48.436570 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9f727355-3604-409c-b0ae-d472c307865c tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] 10.222.0.85 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.031636 Aug 24 10:22:48.437762 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1124/2550] 10.222.0.85 () {60 vars in 1177 bytes} [Wed Aug 24 10:22:48 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:48.448874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-550f2aee-4f7b-4365-878b-6dc073af9b64 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] Calling method '.version_select at 0x7f4654f613a0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:48.491587 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-550f2aee-4f7b-4365-878b-6dc073af9b64 tempest-KeyPairsV22TestJSON-536626375 tempest-KeyPairsV22TestJSON-536626375-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-757012679" status: 204 len: 0 microversion: 2.2 time: 0.046449 Aug 24 10:22:48.492621 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1125/2551] 10.222.0.85 () {60 vars in 1258 bytes} [Wed Aug 24 10:22:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-757012679 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 10:22:48.526900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-77f131e1-5f36-489e-bb2d-999af4296101 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:48.528848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-77f131e1-5f36-489e-bb2d-999af4296101 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:48.555653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77f131e1-5f36-489e-bb2d-999af4296101 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:48.556313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77f131e1-5f36-489e-bb2d-999af4296101 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:48.557073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77f131e1-5f36-489e-bb2d-999af4296101 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:48.558440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77f131e1-5f36-489e-bb2d-999af4296101 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:48.558960 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77f131e1-5f36-489e-bb2d-999af4296101 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:48.559405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77f131e1-5f36-489e-bb2d-999af4296101 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:49.111752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-90757f2b-a66c-41fa-8b3a-68083bd79906 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d264ad8190a4cd9be236d05564fe1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5264f4afb64ba9927050b9b94d37a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:49.148705 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-90757f2b-a66c-41fa-8b3a-68083bd79906 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08" status: 200 len: 1369 microversion: 2.1 time: 1.189911 Aug 24 10:22:49.166649 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1427/2552] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:47 2022] GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 => generated 1369 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:49.179883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-259f549a-243a-474d-a58c-60dc2cc3ed2f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:49.183080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-259f549a-243a-474d-a58c-60dc2cc3ed2f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:49.203992 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-259f549a-243a-474d-a58c-60dc2cc3ed2f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:49.207405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-259f549a-243a-474d-a58c-60dc2cc3ed2f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:49.211488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-259f549a-243a-474d-a58c-60dc2cc3ed2f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:49.215233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-259f549a-243a-474d-a58c-60dc2cc3ed2f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:49.218115 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-259f549a-243a-474d-a58c-60dc2cc3ed2f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:49.219439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-259f549a-243a-474d-a58c-60dc2cc3ed2f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:49.573872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-259f549a-243a-474d-a58c-60dc2cc3ed2f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:49.603869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-259f549a-243a-474d-a58c-60dc2cc3ed2f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:49.606132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-259f549a-243a-474d-a58c-60dc2cc3ed2f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:49.616402 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-259f549a-243a-474d-a58c-60dc2cc3ed2f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1365 microversion: 2.47 time: 0.448085 Aug 24 10:22:49.620595 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1428/2553] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:49 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1365 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:49.640877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cef106a8-a025-4b08-9171-5925b1fc394f tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:49.641770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cef106a8-a025-4b08-9171-5925b1fc394f tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:49.665864 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cef106a8-a025-4b08-9171-5925b1fc394f tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:49.667103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cef106a8-a025-4b08-9171-5925b1fc394f tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:49.667824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cef106a8-a025-4b08-9171-5925b1fc394f tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:49.668854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cef106a8-a025-4b08-9171-5925b1fc394f tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:49.669649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cef106a8-a025-4b08-9171-5925b1fc394f tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:49.670338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cef106a8-a025-4b08-9171-5925b1fc394f tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:49.844961 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-77f131e1-5f36-489e-bb2d-999af4296101 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:49.857901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-77f131e1-5f36-489e-bb2d-999af4296101 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:49.867435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-77f131e1-5f36-489e-bb2d-999af4296101 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:49.869059 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-77f131e1-5f36-489e-bb2d-999af4296101 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 2909 microversion: 2.32 time: 1.355662 Aug 24 10:22:49.869906 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1126/2554] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:48 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 2909 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:49.875850 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-22175c7c-f48f-4cd8-8de9-9ee98548e303 req-b688af07-4b69-49b3-a580-9e2e24ae7d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd", "name": "network-vif-unplugged", "status": "completed", "tag": "86a08323-7386-4e0b-baa9-7af8e90f13c9"}, {"server_uuid": "4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd", "name": "network-vif-unplugged", "status": "completed", "tag": "6ed14169-2bb3-41fb-a411-6ef58f974592"}, {"server_uuid": "4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd", "name": "network-vif-unplugged", "status": "completed", "tag": "0d17d5fc-1b53-4721-ba1b-68c986a9e1dc"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:49.905627 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-22175c7c-f48f-4cd8-8de9-9ee98548e303 req-b688af07-4b69-49b3-a580-9e2e24ae7d16 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:49.906852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-22175c7c-f48f-4cd8-8de9-9ee98548e303 req-b688af07-4b69-49b3-a580-9e2e24ae7d16 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:49.908822 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-22175c7c-f48f-4cd8-8de9-9ee98548e303 req-b688af07-4b69-49b3-a580-9e2e24ae7d16 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:49.934895 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-22175c7c-f48f-4cd8-8de9-9ee98548e303 req-b688af07-4b69-49b3-a580-9e2e24ae7d16 service nova] Creating event network-vif-unplugged:86a08323-7386-4e0b-baa9-7af8e90f13c9 for instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd on n-h2-849328-3 Aug 24 10:22:49.941385 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-22175c7c-f48f-4cd8-8de9-9ee98548e303 req-b688af07-4b69-49b3-a580-9e2e24ae7d16 service nova] Creating event network-vif-unplugged:6ed14169-2bb3-41fb-a411-6ef58f974592 for instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd on n-h2-849328-3 Aug 24 10:22:49.942324 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-22175c7c-f48f-4cd8-8de9-9ee98548e303 req-b688af07-4b69-49b3-a580-9e2e24ae7d16 service nova] Creating event network-vif-unplugged:0d17d5fc-1b53-4721-ba1b-68c986a9e1dc for instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd on n-h2-849328-3 Aug 24 10:22:49.952264 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-22175c7c-f48f-4cd8-8de9-9ee98548e303 req-b688af07-4b69-49b3-a580-9e2e24ae7d16 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.080073 Aug 24 10:22:49.954611 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1127/2555] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:50.020572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-fec5cd23-2ee0-4457-b16a-d09cfd472e0d req-a912d3fe-2dcd-4b42-8d91-6968173c84df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd", "name": "network-vif-deleted", "tag": "0d17d5fc-1b53-4721-ba1b-68c986a9e1dc"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:50.034275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fec5cd23-2ee0-4457-b16a-d09cfd472e0d req-a912d3fe-2dcd-4b42-8d91-6968173c84df service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:50.035518 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fec5cd23-2ee0-4457-b16a-d09cfd472e0d req-a912d3fe-2dcd-4b42-8d91-6968173c84df service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:50.036487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fec5cd23-2ee0-4457-b16a-d09cfd472e0d req-a912d3fe-2dcd-4b42-8d91-6968173c84df service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:50.073020 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-fec5cd23-2ee0-4457-b16a-d09cfd472e0d req-a912d3fe-2dcd-4b42-8d91-6968173c84df service nova] Creating event network-vif-deleted:0d17d5fc-1b53-4721-ba1b-68c986a9e1dc for instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd on n-h2-849328-3 Aug 24 10:22:50.079957 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-fec5cd23-2ee0-4457-b16a-d09cfd472e0d req-a912d3fe-2dcd-4b42-8d91-6968173c84df service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064030 Aug 24 10:22:50.081423 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1128/2556] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:50.178438 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-84fc9084-0dca-4eea-b906-fc4274299853 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:50.179671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-84fc9084-0dca-4eea-b906-fc4274299853 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:50.201946 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84fc9084-0dca-4eea-b906-fc4274299853 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:50.203657 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84fc9084-0dca-4eea-b906-fc4274299853 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:50.206593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84fc9084-0dca-4eea-b906-fc4274299853 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:50.207930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84fc9084-0dca-4eea-b906-fc4274299853 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:50.209593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84fc9084-0dca-4eea-b906-fc4274299853 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:50.211790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84fc9084-0dca-4eea-b906-fc4274299853 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:50.648446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cef106a8-a025-4b08-9171-5925b1fc394f tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:50.662406 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cef106a8-a025-4b08-9171-5925b1fc394f tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1355 microversion: 2.1 time: 1.037268 Aug 24 10:22:50.665208 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1429/2557] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:49 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1355 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:50.680642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9eb27be6-6e4c-419c-9e10-230e6e9a115e tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:50.681616 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9eb27be6-6e4c-419c-9e10-230e6e9a115e tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:50.701057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9eb27be6-6e4c-419c-9e10-230e6e9a115e tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:50.701737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9eb27be6-6e4c-419c-9e10-230e6e9a115e tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:50.702304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9eb27be6-6e4c-419c-9e10-230e6e9a115e tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:50.703197 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9eb27be6-6e4c-419c-9e10-230e6e9a115e tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:50.703658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9eb27be6-6e4c-419c-9e10-230e6e9a115e tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:50.704083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9eb27be6-6e4c-419c-9e10-230e6e9a115e tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:50.933261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9eb27be6-6e4c-419c-9e10-230e6e9a115e tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:50.970387 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9eb27be6-6e4c-419c-9e10-230e6e9a115e tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:50.976787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9eb27be6-6e4c-419c-9e10-230e6e9a115e tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:50.982050 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9eb27be6-6e4c-419c-9e10-230e6e9a115e tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1365 microversion: 2.47 time: 0.312276 Aug 24 10:22:51.001160 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1430/2558] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:50 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1365 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:51.008677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-584843a7-c9f7-4641-ad9a-221fde01ae6c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:51.009674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-584843a7-c9f7-4641-ad9a-221fde01ae6c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:51.017634 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-584843a7-c9f7-4641-ad9a-221fde01ae6c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:51.022613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-584843a7-c9f7-4641-ad9a-221fde01ae6c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:51.027153 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-584843a7-c9f7-4641-ad9a-221fde01ae6c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:51.030850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-584843a7-c9f7-4641-ad9a-221fde01ae6c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:51.035277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-584843a7-c9f7-4641-ad9a-221fde01ae6c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:51.039042 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-584843a7-c9f7-4641-ad9a-221fde01ae6c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:51.128767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-84fc9084-0dca-4eea-b906-fc4274299853 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d264ad8190a4cd9be236d05564fe1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5264f4afb64ba9927050b9b94d37a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:51.141798 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-84fc9084-0dca-4eea-b906-fc4274299853 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08" status: 200 len: 1555 microversion: 2.1 time: 0.971172 Aug 24 10:22:51.151535 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1129/2559] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:50 2022] GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 => generated 1555 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:22:51.179362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0b77d204-cfde-44f5-adb2-e8403690ea8c tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:51.180136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0b77d204-cfde-44f5-adb2-e8403690ea8c tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:51.196269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b77d204-cfde-44f5-adb2-e8403690ea8c tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:51.197060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b77d204-cfde-44f5-adb2-e8403690ea8c tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:51.197757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b77d204-cfde-44f5-adb2-e8403690ea8c tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:51.198711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b77d204-cfde-44f5-adb2-e8403690ea8c tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:51.199367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b77d204-cfde-44f5-adb2-e8403690ea8c tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:51.202176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b77d204-cfde-44f5-adb2-e8403690ea8c tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:51.259066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:51.501646 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0b77d204-cfde-44f5-adb2-e8403690ea8c tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.326635 Aug 24 10:22:51.512738 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1130/2560] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Aug 24 10:22:51 2022] GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08/os-interface => generated 285 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:22:51.686923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-63d7aa33-5718-4ce2-be49-51ba6651433d tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:51.688823 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-63d7aa33-5718-4ce2-be49-51ba6651433d tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:51.718695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63d7aa33-5718-4ce2-be49-51ba6651433d tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:51.719972 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63d7aa33-5718-4ce2-be49-51ba6651433d tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:51.721080 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63d7aa33-5718-4ce2-be49-51ba6651433d tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:51.722692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63d7aa33-5718-4ce2-be49-51ba6651433d tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:51.723802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63d7aa33-5718-4ce2-be49-51ba6651433d tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:51.736162 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63d7aa33-5718-4ce2-be49-51ba6651433d tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:52.182975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-584843a7-c9f7-4641-ad9a-221fde01ae6c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:52.226920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-584843a7-c9f7-4641-ad9a-221fde01ae6c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:52.232891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-584843a7-c9f7-4641-ad9a-221fde01ae6c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:52.249334 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-584843a7-c9f7-4641-ad9a-221fde01ae6c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 2749 microversion: 2.32 time: 1.244326 Aug 24 10:22:52.269562 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1431/2561] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:51 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 2749 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:52.273579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-43db9476-9b52-499a-bece-8c182d0a6a32 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:52.279083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-43db9476-9b52-499a-bece-8c182d0a6a32 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:52.292079 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43db9476-9b52-499a-bece-8c182d0a6a32 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:52.295365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43db9476-9b52-499a-bece-8c182d0a6a32 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:52.297314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43db9476-9b52-499a-bece-8c182d0a6a32 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:52.298457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43db9476-9b52-499a-bece-8c182d0a6a32 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:52.309946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43db9476-9b52-499a-bece-8c182d0a6a32 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:52.310741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43db9476-9b52-499a-bece-8c182d0a6a32 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:52.363338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-43db9476-9b52-499a-bece-8c182d0a6a32 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:22:52.533384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:52.653417 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-43db9476-9b52-499a-bece-8c182d0a6a32 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "DELETE /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 204 len: 0 microversion: 2.1 time: 0.383975 Aug 24 10:22:52.659650 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1432/2562] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:22:52 2022] DELETE /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:22:52.666668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8fa73f13-016f-403d-9754-09390018a98d req-c7e85ac1-c2a3-4224-9c3a-5c6ee89343dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd", "name": "network-vif-unplugged", "status": "completed", "tag": "ad5894fd-cc27-4c32-ae3e-406eea701b47"}, {"server_uuid": "4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd", "name": "network-vif-unplugged", "status": "completed", "tag": "b514d0b1-f7ce-48d8-aa66-0c3c1daca01e"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:52.680508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8fa73f13-016f-403d-9754-09390018a98d req-c7e85ac1-c2a3-4224-9c3a-5c6ee89343dd service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:52.681481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8fa73f13-016f-403d-9754-09390018a98d req-c7e85ac1-c2a3-4224-9c3a-5c6ee89343dd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:52.682041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8fa73f13-016f-403d-9754-09390018a98d req-c7e85ac1-c2a3-4224-9c3a-5c6ee89343dd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:52.692930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-63d7aa33-5718-4ce2-be49-51ba6651433d tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:52.700465 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8fa73f13-016f-403d-9754-09390018a98d req-c7e85ac1-c2a3-4224-9c3a-5c6ee89343dd service nova] Creating event network-vif-unplugged:ad5894fd-cc27-4c32-ae3e-406eea701b47 for instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd on n-h2-849328-3 Aug 24 10:22:52.701418 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8fa73f13-016f-403d-9754-09390018a98d req-c7e85ac1-c2a3-4224-9c3a-5c6ee89343dd service nova] Creating event network-vif-unplugged:b514d0b1-f7ce-48d8-aa66-0c3c1daca01e for instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd on n-h2-849328-3 Aug 24 10:22:52.716600 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-63d7aa33-5718-4ce2-be49-51ba6651433d tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1355 microversion: 2.1 time: 1.036544 Aug 24 10:22:52.717471 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1131/2563] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:51 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1355 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:22:52.723784 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8fa73f13-016f-403d-9754-09390018a98d req-c7e85ac1-c2a3-4224-9c3a-5c6ee89343dd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.061988 Aug 24 10:22:52.725301 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1433/2564] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:52.732798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f2f59205-d160-46c9-8f72-7d1a13f5c0a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:52.733845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f2f59205-d160-46c9-8f72-7d1a13f5c0a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:52.750978 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d70865ad-339e-4913-88d6-c551f3a806f2 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:52.755292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d70865ad-339e-4913-88d6-c551f3a806f2 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:52.765089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2f59205-d160-46c9-8f72-7d1a13f5c0a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:52.768594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2f59205-d160-46c9-8f72-7d1a13f5c0a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:52.769595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2f59205-d160-46c9-8f72-7d1a13f5c0a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:52.772363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2f59205-d160-46c9-8f72-7d1a13f5c0a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:52.776044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2f59205-d160-46c9-8f72-7d1a13f5c0a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:52.776823 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2f59205-d160-46c9-8f72-7d1a13f5c0a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:52.782777 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d70865ad-339e-4913-88d6-c551f3a806f2 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:52.783292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d70865ad-339e-4913-88d6-c551f3a806f2 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:52.783773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d70865ad-339e-4913-88d6-c551f3a806f2 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:52.784655 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d70865ad-339e-4913-88d6-c551f3a806f2 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:52.785153 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d70865ad-339e-4913-88d6-c551f3a806f2 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:52.785608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d70865ad-339e-4913-88d6-c551f3a806f2 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:53.645832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f2f59205-d160-46c9-8f72-7d1a13f5c0a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:53.647778 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d70865ad-339e-4913-88d6-c551f3a806f2 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:53.670827 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f2f59205-d160-46c9-8f72-7d1a13f5c0a5 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1666 microversion: 2.1 time: 0.942693 Aug 24 10:22:53.687133 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1434/2565] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:52 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1666 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:53.697947 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-cdc4bef7-5cd0-405b-9d81-beeaa04f9bf6 req-36bbe1fe-27d7-4340-be1e-c6553e980d20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd", "name": "network-vif-deleted", "tag": "b514d0b1-f7ce-48d8-aa66-0c3c1daca01e"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:53.700452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d70865ad-339e-4913-88d6-c551f3a806f2 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:53.708063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d70865ad-339e-4913-88d6-c551f3a806f2 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:53.715100 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d70865ad-339e-4913-88d6-c551f3a806f2 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1365 microversion: 2.47 time: 0.984788 Aug 24 10:22:53.721044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-cdc4bef7-5cd0-405b-9d81-beeaa04f9bf6 req-36bbe1fe-27d7-4340-be1e-c6553e980d20 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:53.721727 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-cdc4bef7-5cd0-405b-9d81-beeaa04f9bf6 req-36bbe1fe-27d7-4340-be1e-c6553e980d20 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:53.721943 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1132/2566] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:52 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1365 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:53.725563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-cdc4bef7-5cd0-405b-9d81-beeaa04f9bf6 req-36bbe1fe-27d7-4340-be1e-c6553e980d20 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:53.738010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1cb76828-9221-4a8b-b649-b678aafbb02d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:53.739472 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1cb76828-9221-4a8b-b649-b678aafbb02d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:53.749746 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-cdc4bef7-5cd0-405b-9d81-beeaa04f9bf6 req-36bbe1fe-27d7-4340-be1e-c6553e980d20 service nova] Creating event network-vif-deleted:b514d0b1-f7ce-48d8-aa66-0c3c1daca01e for instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd on n-h2-849328-3 Aug 24 10:22:53.758476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cb76828-9221-4a8b-b649-b678aafbb02d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:53.763112 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-cdc4bef7-5cd0-405b-9d81-beeaa04f9bf6 req-36bbe1fe-27d7-4340-be1e-c6553e980d20 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072875 Aug 24 10:22:53.764490 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cb76828-9221-4a8b-b649-b678aafbb02d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:53.765453 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cb76828-9221-4a8b-b649-b678aafbb02d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:53.767149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cb76828-9221-4a8b-b649-b678aafbb02d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:53.769537 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cb76828-9221-4a8b-b649-b678aafbb02d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:53.770225 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1435/2567] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:53.777763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cb76828-9221-4a8b-b649-b678aafbb02d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:53.795816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-08b45dae-14be-4ce0-af3b-889fbc39e382 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:53.797261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-08b45dae-14be-4ce0-af3b-889fbc39e382 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:53.816118 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08b45dae-14be-4ce0-af3b-889fbc39e382 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:53.816665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08b45dae-14be-4ce0-af3b-889fbc39e382 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:53.817365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08b45dae-14be-4ce0-af3b-889fbc39e382 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:53.818105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08b45dae-14be-4ce0-af3b-889fbc39e382 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:53.818567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08b45dae-14be-4ce0-af3b-889fbc39e382 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:53.818992 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08b45dae-14be-4ce0-af3b-889fbc39e382 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:53.837304 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=12 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:54.372987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-08b45dae-14be-4ce0-af3b-889fbc39e382 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:54.407239 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-08b45dae-14be-4ce0-af3b-889fbc39e382 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1355 microversion: 2.1 time: 0.635298 Aug 24 10:22:54.438558 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1436/2568] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:53 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1355 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:54.666161 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1cb76828-9221-4a8b-b649-b678aafbb02d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:54.700672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1cb76828-9221-4a8b-b649-b678aafbb02d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:54.701863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d4af2a0d-8269-4ff1-bb86-363bb3dd486a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:54.703682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1cb76828-9221-4a8b-b649-b678aafbb02d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:54.704936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d4af2a0d-8269-4ff1-bb86-363bb3dd486a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:54.705884 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1cb76828-9221-4a8b-b649-b678aafbb02d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 2703 microversion: 2.32 time: 0.981886 Aug 24 10:22:54.715001 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1133/2569] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:53 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 2703 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:54.734789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4af2a0d-8269-4ff1-bb86-363bb3dd486a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:54.737183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4af2a0d-8269-4ff1-bb86-363bb3dd486a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:54.739083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4af2a0d-8269-4ff1-bb86-363bb3dd486a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:54.740492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4af2a0d-8269-4ff1-bb86-363bb3dd486a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:54.743285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4af2a0d-8269-4ff1-bb86-363bb3dd486a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:54.743912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4af2a0d-8269-4ff1-bb86-363bb3dd486a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:54.751957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a6e90b27-cabb-400c-b457-c91105de6e73 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:54.753370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a6e90b27-cabb-400c-b457-c91105de6e73 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:54.784292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6e90b27-cabb-400c-b457-c91105de6e73 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:54.784944 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6e90b27-cabb-400c-b457-c91105de6e73 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:54.786002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6e90b27-cabb-400c-b457-c91105de6e73 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:54.787123 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6e90b27-cabb-400c-b457-c91105de6e73 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:54.787796 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6e90b27-cabb-400c-b457-c91105de6e73 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:54.788393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6e90b27-cabb-400c-b457-c91105de6e73 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:55.013334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a6e90b27-cabb-400c-b457-c91105de6e73 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:55.077776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a6e90b27-cabb-400c-b457-c91105de6e73 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:55.095251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a6e90b27-cabb-400c-b457-c91105de6e73 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:55.096511 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a6e90b27-cabb-400c-b457-c91105de6e73 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1365 microversion: 2.47 time: 0.351808 Aug 24 10:22:55.097105 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1134/2570] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:54 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1365 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:22:55.460935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-90f6e320-488b-4558-b5d4-16a5078d5c73 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:55.462146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-90f6e320-488b-4558-b5d4-16a5078d5c73 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:55.470582 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90f6e320-488b-4558-b5d4-16a5078d5c73 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:55.471338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90f6e320-488b-4558-b5d4-16a5078d5c73 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:55.472116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90f6e320-488b-4558-b5d4-16a5078d5c73 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:55.473006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90f6e320-488b-4558-b5d4-16a5078d5c73 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:55.473637 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90f6e320-488b-4558-b5d4-16a5078d5c73 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:55.474617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90f6e320-488b-4558-b5d4-16a5078d5c73 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:55.526509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d4af2a0d-8269-4ff1-bb86-363bb3dd486a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:55.548427 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d4af2a0d-8269-4ff1-bb86-363bb3dd486a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1666 microversion: 2.1 time: 0.859408 Aug 24 10:22:55.549007 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1437/2571] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:54 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1666 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:22:55.739631 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ac7bb126-1bea-4b49-9347-7aac9d4fc488 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:55.740287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ac7bb126-1bea-4b49-9347-7aac9d4fc488 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:55.753498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac7bb126-1bea-4b49-9347-7aac9d4fc488 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:55.754387 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac7bb126-1bea-4b49-9347-7aac9d4fc488 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:55.755104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac7bb126-1bea-4b49-9347-7aac9d4fc488 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:55.760377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac7bb126-1bea-4b49-9347-7aac9d4fc488 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:55.761097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac7bb126-1bea-4b49-9347-7aac9d4fc488 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:55.769976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac7bb126-1bea-4b49-9347-7aac9d4fc488 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:56.223379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ac7bb126-1bea-4b49-9347-7aac9d4fc488 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:56.243928 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ac7bb126-1bea-4b49-9347-7aac9d4fc488 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:56.245552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ac7bb126-1bea-4b49-9347-7aac9d4fc488 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:56.257690 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ac7bb126-1bea-4b49-9347-7aac9d4fc488 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 2543 microversion: 2.32 time: 0.517693 Aug 24 10:22:56.259040 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1438/2572] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:55 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 2543 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:22:56.264157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-65d16d30-ec42-4f3f-bf31-b2020cea518a req-f889cca1-044f-45ae-b144-32876a265796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd", "name": "network-vif-deleted", "tag": "86a08323-7386-4e0b-baa9-7af8e90f13c9"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:56.309578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-65d16d30-ec42-4f3f-bf31-b2020cea518a req-f889cca1-044f-45ae-b144-32876a265796 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:56.310055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-65d16d30-ec42-4f3f-bf31-b2020cea518a req-f889cca1-044f-45ae-b144-32876a265796 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:56.310485 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-65d16d30-ec42-4f3f-bf31-b2020cea518a req-f889cca1-044f-45ae-b144-32876a265796 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:56.333063 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-65d16d30-ec42-4f3f-bf31-b2020cea518a req-f889cca1-044f-45ae-b144-32876a265796 service nova] Creating event network-vif-deleted:86a08323-7386-4e0b-baa9-7af8e90f13c9 for instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd on n-h2-849328-3 Aug 24 10:22:56.363574 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-65d16d30-ec42-4f3f-bf31-b2020cea518a req-f889cca1-044f-45ae-b144-32876a265796 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102939 Aug 24 10:22:56.364782 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1439/2573] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:56.372172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3a830f4a-eac2-4b08-a8f5-4331aaa4f7bb tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:56.378306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3a830f4a-eac2-4b08-a8f5-4331aaa4f7bb tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:56.392466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a830f4a-eac2-4b08-a8f5-4331aaa4f7bb tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:56.392466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a830f4a-eac2-4b08-a8f5-4331aaa4f7bb tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:56.392466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a830f4a-eac2-4b08-a8f5-4331aaa4f7bb tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:56.395551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a830f4a-eac2-4b08-a8f5-4331aaa4f7bb tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:56.395551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a830f4a-eac2-4b08-a8f5-4331aaa4f7bb tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:56.395551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a830f4a-eac2-4b08-a8f5-4331aaa4f7bb tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:56.554366 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3a830f4a-eac2-4b08-a8f5-4331aaa4f7bb tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:56.569581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3a830f4a-eac2-4b08-a8f5-4331aaa4f7bb tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:56.572183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3a830f4a-eac2-4b08-a8f5-4331aaa4f7bb tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:56.573896 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3a830f4a-eac2-4b08-a8f5-4331aaa4f7bb tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1365 microversion: 2.47 time: 0.207361 Aug 24 10:22:56.575312 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1440/2574] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:56 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:56.581924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-87807745-2157-43d7-8d28-88545f1efa24 req-014517dd-bbce-4570-9c76-78d6fb0341bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a599e1a2-3ca0-4cde-b11c-ef5e069065f9", "name": "network-vif-plugged", "status": "completed", "tag": "4510534e-d3d1-48b3-a1c6-bd96fc223506"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:56.619937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-87807745-2157-43d7-8d28-88545f1efa24 req-014517dd-bbce-4570-9c76-78d6fb0341bb service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:56.623425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-87807745-2157-43d7-8d28-88545f1efa24 req-014517dd-bbce-4570-9c76-78d6fb0341bb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:56.626657 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-87807745-2157-43d7-8d28-88545f1efa24 req-014517dd-bbce-4570-9c76-78d6fb0341bb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:56.655450 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-87807745-2157-43d7-8d28-88545f1efa24 req-014517dd-bbce-4570-9c76-78d6fb0341bb service nova] Creating event network-vif-plugged:4510534e-d3d1-48b3-a1c6-bd96fc223506 for instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 on n-h1-849328-3 Aug 24 10:22:56.665730 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-87807745-2157-43d7-8d28-88545f1efa24 req-014517dd-bbce-4570-9c76-78d6fb0341bb service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087785 Aug 24 10:22:56.667657 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1441/2575] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:56.677268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9e589e8f-7026-4d0c-bbf2-13ea20ac3ea6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:56.678576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9e589e8f-7026-4d0c-bbf2-13ea20ac3ea6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:56.700754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e589e8f-7026-4d0c-bbf2-13ea20ac3ea6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:56.702915 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e589e8f-7026-4d0c-bbf2-13ea20ac3ea6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:56.704075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e589e8f-7026-4d0c-bbf2-13ea20ac3ea6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:56.705487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e589e8f-7026-4d0c-bbf2-13ea20ac3ea6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:56.706445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e589e8f-7026-4d0c-bbf2-13ea20ac3ea6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:56.707245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e589e8f-7026-4d0c-bbf2-13ea20ac3ea6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:57.079440 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9e589e8f-7026-4d0c-bbf2-13ea20ac3ea6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:57.095007 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9e589e8f-7026-4d0c-bbf2-13ea20ac3ea6 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1666 microversion: 2.1 time: 0.423642 Aug 24 10:22:57.096521 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1442/2576] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:56 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1666 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:57.302053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-017c9e1c-d345-4140-ba72-3d366cdfccf7 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:57.302913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-017c9e1c-d345-4140-ba72-3d366cdfccf7 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:57.318979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-017c9e1c-d345-4140-ba72-3d366cdfccf7 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:57.325867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-017c9e1c-d345-4140-ba72-3d366cdfccf7 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:57.329041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-017c9e1c-d345-4140-ba72-3d366cdfccf7 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:57.335760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-017c9e1c-d345-4140-ba72-3d366cdfccf7 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:57.336522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-017c9e1c-d345-4140-ba72-3d366cdfccf7 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:57.337141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-017c9e1c-d345-4140-ba72-3d366cdfccf7 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:57.542473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=24 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:57.656902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-017c9e1c-d345-4140-ba72-3d366cdfccf7 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:57.714364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-017c9e1c-d345-4140-ba72-3d366cdfccf7 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:57.724278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-017c9e1c-d345-4140-ba72-3d366cdfccf7 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:57.728760 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-017c9e1c-d345-4140-ba72-3d366cdfccf7 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 2497 microversion: 2.32 time: 0.427818 Aug 24 10:22:57.730404 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1443/2577] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:57 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 2497 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:57.738803 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5b0d8b97-e604-4ea0-b173-e25eb24a5002 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:57.739833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5b0d8b97-e604-4ea0-b173-e25eb24a5002 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:57.753113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b0d8b97-e604-4ea0-b173-e25eb24a5002 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:57.755329 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b0d8b97-e604-4ea0-b173-e25eb24a5002 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:57.755797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b0d8b97-e604-4ea0-b173-e25eb24a5002 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:57.756795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b0d8b97-e604-4ea0-b173-e25eb24a5002 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:57.757300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b0d8b97-e604-4ea0-b173-e25eb24a5002 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:57.757728 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b0d8b97-e604-4ea0-b173-e25eb24a5002 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:57.882091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5b0d8b97-e604-4ea0-b173-e25eb24a5002 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:57.904262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5b0d8b97-e604-4ea0-b173-e25eb24a5002 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:57.906370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5b0d8b97-e604-4ea0-b173-e25eb24a5002 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:57.907486 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5b0d8b97-e604-4ea0-b173-e25eb24a5002 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1365 microversion: 2.47 time: 0.175095 Aug 24 10:22:57.908241 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1444/2578] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:57 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:57.994841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-90f6e320-488b-4558-b5d4-16a5078d5c73 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:58.005423 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-90f6e320-488b-4558-b5d4-16a5078d5c73 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1355 microversion: 2.1 time: 2.553910 Aug 24 10:22:58.008156 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1135/2579] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:55 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1355 bytes in 2557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:58.128395 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2e841171-4655-4ce2-b85b-4aee16194c91 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:58.130815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2e841171-4655-4ce2-b85b-4aee16194c91 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:58.140719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e841171-4655-4ce2-b85b-4aee16194c91 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:58.141977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e841171-4655-4ce2-b85b-4aee16194c91 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:58.143019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e841171-4655-4ce2-b85b-4aee16194c91 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:58.144372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e841171-4655-4ce2-b85b-4aee16194c91 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:58.147825 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e841171-4655-4ce2-b85b-4aee16194c91 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:58.149220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e841171-4655-4ce2-b85b-4aee16194c91 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:58.342306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2e841171-4655-4ce2-b85b-4aee16194c91 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:58.354125 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2e841171-4655-4ce2-b85b-4aee16194c91 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1598 microversion: 2.1 time: 0.233406 Aug 24 10:22:58.371872 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1445/2580] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:58 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1598 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:58.438467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-77c69b80-b00e-4ffc-8821-e9265c839454 req-923557a8-e4c9-4210-b49d-c290d54879ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd", "name": "network-vif-deleted", "tag": "6ed14169-2bb3-41fb-a411-6ef58f974592"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:58.461106 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-77c69b80-b00e-4ffc-8821-e9265c839454 req-923557a8-e4c9-4210-b49d-c290d54879ea service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:58.461750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-77c69b80-b00e-4ffc-8821-e9265c839454 req-923557a8-e4c9-4210-b49d-c290d54879ea service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:58.462368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-77c69b80-b00e-4ffc-8821-e9265c839454 req-923557a8-e4c9-4210-b49d-c290d54879ea service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:58.483554 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-77c69b80-b00e-4ffc-8821-e9265c839454 req-923557a8-e4c9-4210-b49d-c290d54879ea service nova] Creating event network-vif-deleted:6ed14169-2bb3-41fb-a411-6ef58f974592 for instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd on n-h2-849328-3 Aug 24 10:22:58.494976 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-77c69b80-b00e-4ffc-8821-e9265c839454 req-923557a8-e4c9-4210-b49d-c290d54879ea service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060054 Aug 24 10:22:58.498939 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1136/2581] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:22:58.744690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-9c4fd5cf-2c87-436c-8abd-871c6e5d58cc req-3ba2e040-1498-475b-a03c-823b1df67d8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a599e1a2-3ca0-4cde-b11c-ef5e069065f9", "name": "network-vif-plugged", "status": "completed", "tag": "1799c04a-1694-4f6d-a4a7-2c35d555e841"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:58.763467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-09d119ca-7503-4036-a19b-aeaada74ba4e req-4e56d165-1ffd-4390-99ef-07b857321ebd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f6298f4-4be1-47e8-a260-c43d83731e08", "tag": "a849beed-fe2d-49fa-a6c1-d0686458269b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:58.870805 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9c4fd5cf-2c87-436c-8abd-871c6e5d58cc req-3ba2e040-1498-475b-a03c-823b1df67d8f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:58.871326 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9c4fd5cf-2c87-436c-8abd-871c6e5d58cc req-3ba2e040-1498-475b-a03c-823b1df67d8f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:58.871758 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9c4fd5cf-2c87-436c-8abd-871c6e5d58cc req-3ba2e040-1498-475b-a03c-823b1df67d8f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:58.874116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-09d119ca-7503-4036-a19b-aeaada74ba4e req-4e56d165-1ffd-4390-99ef-07b857321ebd service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:58.877918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-09d119ca-7503-4036-a19b-aeaada74ba4e req-4e56d165-1ffd-4390-99ef-07b857321ebd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:58.882034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-09d119ca-7503-4036-a19b-aeaada74ba4e req-4e56d165-1ffd-4390-99ef-07b857321ebd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:58.932216 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-9c4fd5cf-2c87-436c-8abd-871c6e5d58cc req-3ba2e040-1498-475b-a03c-823b1df67d8f service nova] Creating event network-vif-plugged:1799c04a-1694-4f6d-a4a7-2c35d555e841 for instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 on n-h1-849328-3 Aug 24 10:22:58.940537 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-09d119ca-7503-4036-a19b-aeaada74ba4e req-4e56d165-1ffd-4390-99ef-07b857321ebd service nova] Creating event network-changed:a849beed-fe2d-49fa-a6c1-d0686458269b for instance 0f6298f4-4be1-47e8-a260-c43d83731e08 on n-h1-849328-3 Aug 24 10:22:58.965583 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-9c4fd5cf-2c87-436c-8abd-871c6e5d58cc req-3ba2e040-1498-475b-a03c-823b1df67d8f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227082 Aug 24 10:22:58.969115 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1446/2582] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:58.971151 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-09d119ca-7503-4036-a19b-aeaada74ba4e req-4e56d165-1ffd-4390-99ef-07b857321ebd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207682 Aug 24 10:22:58.974097 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1137/2583] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:58.991777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cd096f01-938b-4550-9f22-67913958f272 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:58.992866 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-276ba775-4af8-4365-9df8-69b1d13ff713 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:58.996352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cd096f01-938b-4550-9f22-67913958f272 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:58.998587 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-276ba775-4af8-4365-9df8-69b1d13ff713 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:59.017694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd096f01-938b-4550-9f22-67913958f272 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:59.018233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd096f01-938b-4550-9f22-67913958f272 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:59.018855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-276ba775-4af8-4365-9df8-69b1d13ff713 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:59.019546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-276ba775-4af8-4365-9df8-69b1d13ff713 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:59.021395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-276ba775-4af8-4365-9df8-69b1d13ff713 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:59.023439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-276ba775-4af8-4365-9df8-69b1d13ff713 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:59.023665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd096f01-938b-4550-9f22-67913958f272 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:59.024809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd096f01-938b-4550-9f22-67913958f272 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:59.026229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-276ba775-4af8-4365-9df8-69b1d13ff713 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:59.026431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd096f01-938b-4550-9f22-67913958f272 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:59.027027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd096f01-938b-4550-9f22-67913958f272 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:59.027615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-276ba775-4af8-4365-9df8-69b1d13ff713 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:59.181486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cd096f01-938b-4550-9f22-67913958f272 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:59.215999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cd096f01-938b-4550-9f22-67913958f272 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:59.224927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cd096f01-938b-4550-9f22-67913958f272 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:59.230777 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cd096f01-938b-4550-9f22-67913958f272 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 2273 microversion: 2.32 time: 0.258467 Aug 24 10:22:59.235031 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1447/2584] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:58 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 2273 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:59.240954 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-276ba775-4af8-4365-9df8-69b1d13ff713 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:59.251048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fb6393bd-85d7-4870-9731-032d23055a95 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:59.252009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fb6393bd-85d7-4870-9731-032d23055a95 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:59.266954 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-276ba775-4af8-4365-9df8-69b1d13ff713 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:59.269838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-276ba775-4af8-4365-9df8-69b1d13ff713 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:59.272391 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-276ba775-4af8-4365-9df8-69b1d13ff713 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1371 microversion: 2.47 time: 0.295179 Aug 24 10:22:59.273183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb6393bd-85d7-4870-9731-032d23055a95 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:59.273704 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb6393bd-85d7-4870-9731-032d23055a95 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:59.274145 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb6393bd-85d7-4870-9731-032d23055a95 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:59.276504 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1138/2585] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:58 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1371 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:59.279468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb6393bd-85d7-4870-9731-032d23055a95 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:59.279961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb6393bd-85d7-4870-9731-032d23055a95 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:59.280080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb6393bd-85d7-4870-9731-032d23055a95 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:59.374752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c35d79c5-ac93-46b1-bbf9-0aad97d1dc1b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:59.375537 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c35d79c5-ac93-46b1-bbf9-0aad97d1dc1b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:59.384280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c35d79c5-ac93-46b1-bbf9-0aad97d1dc1b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:59.391948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c35d79c5-ac93-46b1-bbf9-0aad97d1dc1b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:59.396700 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c35d79c5-ac93-46b1-bbf9-0aad97d1dc1b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:59.397931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c35d79c5-ac93-46b1-bbf9-0aad97d1dc1b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:59.401417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c35d79c5-ac93-46b1-bbf9-0aad97d1dc1b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:59.402240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c35d79c5-ac93-46b1-bbf9-0aad97d1dc1b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:59.758566 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c35d79c5-ac93-46b1-bbf9-0aad97d1dc1b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:59.780766 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c35d79c5-ac93-46b1-bbf9-0aad97d1dc1b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1598 microversion: 2.1 time: 0.409928 Aug 24 10:22:59.786432 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1139/2586] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:59 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1598 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:59.894094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fb6393bd-85d7-4870-9731-032d23055a95 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:59.913396 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fb6393bd-85d7-4870-9731-032d23055a95 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1355 microversion: 2.1 time: 0.676713 Aug 24 10:22:59.929910 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1448/2587] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:59 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1355 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:00.281943 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4245491c-5d30-448e-b534-4a9fbb3768a1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:00.290075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4245491c-5d30-448e-b534-4a9fbb3768a1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:00.310268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b9643a12-3e58-4cfb-9e07-e44884516e2b tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:00.311441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b9643a12-3e58-4cfb-9e07-e44884516e2b tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:00.335165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4245491c-5d30-448e-b534-4a9fbb3768a1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:00.337828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4245491c-5d30-448e-b534-4a9fbb3768a1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:00.343953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9643a12-3e58-4cfb-9e07-e44884516e2b tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:00.344843 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4245491c-5d30-448e-b534-4a9fbb3768a1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:00.345616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4245491c-5d30-448e-b534-4a9fbb3768a1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:00.345904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9643a12-3e58-4cfb-9e07-e44884516e2b tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:00.346528 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9643a12-3e58-4cfb-9e07-e44884516e2b tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:00.346781 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4245491c-5d30-448e-b534-4a9fbb3768a1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:00.347506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9643a12-3e58-4cfb-9e07-e44884516e2b tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:00.347723 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4245491c-5d30-448e-b534-4a9fbb3768a1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:00.348233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9643a12-3e58-4cfb-9e07-e44884516e2b tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:00.351229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9643a12-3e58-4cfb-9e07-e44884516e2b tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:00.712470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b9643a12-3e58-4cfb-9e07-e44884516e2b tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:00.727403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b9643a12-3e58-4cfb-9e07-e44884516e2b tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:00.732851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b9643a12-3e58-4cfb-9e07-e44884516e2b tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:00.736148 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b9643a12-3e58-4cfb-9e07-e44884516e2b tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1371 microversion: 2.47 time: 0.430503 Aug 24 10:23:00.736785 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1449/2588] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:00 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1371 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:23:00.769873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-e7e01269-a498-42a8-9750-ac9ec9467b60 req-4e3c29fb-e4f3-4f41-854a-7342140c4616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd", "name": "network-vif-deleted", "tag": "ad5894fd-cc27-4c32-ae3e-406eea701b47"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:00.787472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e7e01269-a498-42a8-9750-ac9ec9467b60 req-4e3c29fb-e4f3-4f41-854a-7342140c4616 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:00.787959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e7e01269-a498-42a8-9750-ac9ec9467b60 req-4e3c29fb-e4f3-4f41-854a-7342140c4616 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:00.788396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e7e01269-a498-42a8-9750-ac9ec9467b60 req-4e3c29fb-e4f3-4f41-854a-7342140c4616 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:00.822124 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-e7e01269-a498-42a8-9750-ac9ec9467b60 req-4e3c29fb-e4f3-4f41-854a-7342140c4616 service nova] Creating event network-vif-deleted:ad5894fd-cc27-4c32-ae3e-406eea701b47 for instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd on n-h2-849328-3 Aug 24 10:23:00.833708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4245491c-5d30-448e-b534-4a9fbb3768a1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:00.836188 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-e7e01269-a498-42a8-9750-ac9ec9467b60 req-4e3c29fb-e4f3-4f41-854a-7342140c4616 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071421 Aug 24 10:23:00.837205 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1450/2589] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:00.856361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7073f1c5-6690-4022-a80a-045948812f80 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:00.857383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7073f1c5-6690-4022-a80a-045948812f80 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:00.869179 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:00.869948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4245491c-5d30-448e-b534-4a9fbb3768a1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:00.875400 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7073f1c5-6690-4022-a80a-045948812f80 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:00.875922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7073f1c5-6690-4022-a80a-045948812f80 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:00.877869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7073f1c5-6690-4022-a80a-045948812f80 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:00.878444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4245491c-5d30-448e-b534-4a9fbb3768a1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:00.879163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7073f1c5-6690-4022-a80a-045948812f80 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:00.884823 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7073f1c5-6690-4022-a80a-045948812f80 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:00.885763 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7073f1c5-6690-4022-a80a-045948812f80 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:00.885891 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4245491c-5d30-448e-b534-4a9fbb3768a1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1604 microversion: 2.32 time: 0.611003 Aug 24 10:23:00.886929 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1140/2590] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:00 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1604 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:00.945092 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-484fe400-9ba0-4256-ae1c-c2969b6bf338 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:00.945580 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-484fe400-9ba0-4256-ae1c-c2969b6bf338 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:00.959112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-484fe400-9ba0-4256-ae1c-c2969b6bf338 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:00.959610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-484fe400-9ba0-4256-ae1c-c2969b6bf338 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:00.960136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-484fe400-9ba0-4256-ae1c-c2969b6bf338 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:00.960757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-484fe400-9ba0-4256-ae1c-c2969b6bf338 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:00.961234 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-484fe400-9ba0-4256-ae1c-c2969b6bf338 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:00.965673 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-484fe400-9ba0-4256-ae1c-c2969b6bf338 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:01.011196 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7073f1c5-6690-4022-a80a-045948812f80 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:01.016006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7073f1c5-6690-4022-a80a-045948812f80 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:01.016827 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7073f1c5-6690-4022-a80a-045948812f80 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:01.021709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-7073f1c5-6690-4022-a80a-045948812f80 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lazy-loading 'fault' on Instance uuid 4d844e7a-a6af-4c55-957c-a997c42927af {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:23:01.196695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7073f1c5-6690-4022-a80a-045948812f80 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:01.239714 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7073f1c5-6690-4022-a80a-045948812f80 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 200 len: 1324 microversion: 2.1 time: 0.400775 Aug 24 10:23:01.245856 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1451/2591] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:00 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 1324 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:01.270777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-3cd711de-dee2-4bf1-b995-800b8c5520a9 req-737b03a4-6ffa-4fbc-b862-db16ae910462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d844e7a-a6af-4c55-957c-a997c42927af", "name": "network-vif-deleted", "tag": "c818b602-5bd6-46ee-96c2-c41b38b25689"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:01.291389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3cd711de-dee2-4bf1-b995-800b8c5520a9 req-737b03a4-6ffa-4fbc-b862-db16ae910462 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:01.292550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3cd711de-dee2-4bf1-b995-800b8c5520a9 req-737b03a4-6ffa-4fbc-b862-db16ae910462 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:01.295359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3cd711de-dee2-4bf1-b995-800b8c5520a9 req-737b03a4-6ffa-4fbc-b862-db16ae910462 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:01.325482 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-3cd711de-dee2-4bf1-b995-800b8c5520a9 req-737b03a4-6ffa-4fbc-b862-db16ae910462 service nova] Creating event network-vif-deleted:c818b602-5bd6-46ee-96c2-c41b38b25689 for instance 4d844e7a-a6af-4c55-957c-a997c42927af on n-h2-849328-3 Aug 24 10:23:01.363226 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-3cd711de-dee2-4bf1-b995-800b8c5520a9 req-737b03a4-6ffa-4fbc-b862-db16ae910462 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110988 Aug 24 10:23:01.367009 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1452/2592] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:01.389934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-06419cdd-b633-4db1-8bb4-0c55af81ad84 req-8621c4fd-202c-4307-b55e-a391511125c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a599e1a2-3ca0-4cde-b11c-ef5e069065f9", "name": "network-vif-plugged", "status": "completed", "tag": "bb7f920a-c727-4e7e-a723-2d9a8f9a07b9"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:01.407096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-06419cdd-b633-4db1-8bb4-0c55af81ad84 req-8621c4fd-202c-4307-b55e-a391511125c8 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:01.409559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-06419cdd-b633-4db1-8bb4-0c55af81ad84 req-8621c4fd-202c-4307-b55e-a391511125c8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:01.410581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-06419cdd-b633-4db1-8bb4-0c55af81ad84 req-8621c4fd-202c-4307-b55e-a391511125c8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:01.455286 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-06419cdd-b633-4db1-8bb4-0c55af81ad84 req-8621c4fd-202c-4307-b55e-a391511125c8 service nova] Creating event network-vif-plugged:bb7f920a-c727-4e7e-a723-2d9a8f9a07b9 for instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 on n-h1-849328-3 Aug 24 10:23:01.475144 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-06419cdd-b633-4db1-8bb4-0c55af81ad84 req-8621c4fd-202c-4307-b55e-a391511125c8 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104137 Aug 24 10:23:01.476232 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1453/2593] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:01.768016 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-96a00959-4a57-4581-9845-fb44b86937b1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:01.769247 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-96a00959-4a57-4581-9845-fb44b86937b1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:01.796452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96a00959-4a57-4581-9845-fb44b86937b1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:01.798300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96a00959-4a57-4581-9845-fb44b86937b1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:01.798902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96a00959-4a57-4581-9845-fb44b86937b1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:01.800065 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96a00959-4a57-4581-9845-fb44b86937b1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:01.801253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96a00959-4a57-4581-9845-fb44b86937b1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:01.801718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96a00959-4a57-4581-9845-fb44b86937b1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:01.887957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:02.886373 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-96a00959-4a57-4581-9845-fb44b86937b1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:02.905329 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-96a00959-4a57-4581-9845-fb44b86937b1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:02.915103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-96a00959-4a57-4581-9845-fb44b86937b1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:02.920742 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-96a00959-4a57-4581-9845-fb44b86937b1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1371 microversion: 2.47 time: 1.159462 Aug 24 10:23:02.921628 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1454/2594] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:01 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1371 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:02.945493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-981bc90a-3437-4be4-9728-a719334fc261 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:02.948004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-981bc90a-3437-4be4-9728-a719334fc261 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:02.976089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-981bc90a-3437-4be4-9728-a719334fc261 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:02.979721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-981bc90a-3437-4be4-9728-a719334fc261 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:02.982089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-981bc90a-3437-4be4-9728-a719334fc261 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:02.990677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-981bc90a-3437-4be4-9728-a719334fc261 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:02.991800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-981bc90a-3437-4be4-9728-a719334fc261 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:02.992545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-981bc90a-3437-4be4-9728-a719334fc261 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:03.322708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-981bc90a-3437-4be4-9728-a719334fc261 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:03.336989 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-981bc90a-3437-4be4-9728-a719334fc261 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:03.339810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-981bc90a-3437-4be4-9728-a719334fc261 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:03.341865 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-981bc90a-3437-4be4-9728-a719334fc261 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1604 microversion: 2.32 time: 0.414716 Aug 24 10:23:03.361600 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1455/2595] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:02 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1604 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:03.371361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cfa0195e-f9b4-499c-9e03-8879807d6d06 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:03.372284 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cfa0195e-f9b4-499c-9e03-8879807d6d06 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 4d844e7a-a6af-4c55-957c-a997c42927af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:03.380468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cfa0195e-f9b4-499c-9e03-8879807d6d06 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:03.381187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cfa0195e-f9b4-499c-9e03-8879807d6d06 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:03.382080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cfa0195e-f9b4-499c-9e03-8879807d6d06 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:03.386400 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cfa0195e-f9b4-499c-9e03-8879807d6d06 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:03.387666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cfa0195e-f9b4-499c-9e03-8879807d6d06 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:03.388755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cfa0195e-f9b4-499c-9e03-8879807d6d06 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:03.407324 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-cfa0195e-f9b4-499c-9e03-8879807d6d06 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] HTTP exception thrown: Instance 4d844e7a-a6af-4c55-957c-a997c42927af could not be found. Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cfa0195e-f9b4-499c-9e03-8879807d6d06 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Request method failure captured: Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af HTTP/1.1 Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfopYPNODIjgyV0ghZgKGzaV6sR703fZMFE85piXFs7iToEiJtoRq97UvfpuesyKlStryOHX0Cd03kzmhSe80oezylVMIQdXboIk7utG8cR-2jHBjltAOE6fhy1pAB-jxOO7rOHXL1Y33J4_ydce_QqZibRdb3tO5zwih50Wa5huyaA Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 6f266868d6374a82a4ba5333915a9884 Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-LiveMigrationTest-94062731 Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6f266868d6374a82a4ba5333915a9884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6f266868d6374a82a4ba5333915a9884", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6f266868d6374a82a4ba5333915a9884"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6f266868d6374a82a4ba5333915a9884"}]}] Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-LiveMigrationTest-94062731 Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 6f266868d6374a82a4ba5333915a9884 Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-LiveMigrationTest-94062731 Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-LiveMigrationTest-94062731-project Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: b321b1490c2b4fe3aa1a1747b25408a1 Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-LiveMigrationTest-94062731-project Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 4d844e7a-a6af-4c55-957c-a997c42927af could not be found. Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '4d844e7a-a6af-4c55-957c-a997c42927af'} Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d844e7a-a6af-4c55-957c-a997c42927af could not be found. Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d844e7a-a6af-4c55-957c-a997c42927af could not be found. Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:03.409599 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:03.414131 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:03.414131 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:03.414131 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:03.414131 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:03.414131 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:03.414131 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d844e7a-a6af-4c55-957c-a997c42927af could not be found. Aug 24 10:23:03.414131 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:03.415501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cfa0195e-f9b4-499c-9e03-8879807d6d06 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Returning 404 to user: Instance 4d844e7a-a6af-4c55-957c-a997c42927af could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:03.416993 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cfa0195e-f9b4-499c-9e03-8879807d6d06 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af" status: 404 len: 111 microversion: 2.1 time: 0.053109 Aug 24 10:23:03.418171 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1456/2596] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:03 2022] GET /compute/v2.1/servers/4d844e7a-a6af-4c55-957c-a997c42927af => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:23:03.445554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6afdc8f2-6cfb-4cbd-8fcc-ac40034b643d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '.version_select at 0x7f4654e1db80>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:03.501233 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6afdc8f2-6cfb-4cbd-8fcc-ac40034b643d tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1970654174" status: 202 len: 0 microversion: 2.1 time: 0.060095 Aug 24 10:23:03.504893 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1457/2597] 10.222.0.85 () {58 vars in 1221 bytes} [Wed Aug 24 10:23:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1970654174 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:23:03.835457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-484fe400-9ba0-4256-ae1c-c2969b6bf338 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:03.851582 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-484fe400-9ba0-4256-ae1c-c2969b6bf338 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1355 microversion: 2.1 time: 2.910569 Aug 24 10:23:03.854122 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1141/2598] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:00 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1355 bytes in 2913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:03.949280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c976014b-73d1-49ef-bf59-d62f9af93dea tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:03.950501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c976014b-73d1-49ef-bf59-d62f9af93dea tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:03.972662 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c976014b-73d1-49ef-bf59-d62f9af93dea tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:03.973551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c976014b-73d1-49ef-bf59-d62f9af93dea tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:03.981034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c976014b-73d1-49ef-bf59-d62f9af93dea tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:03.983413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c976014b-73d1-49ef-bf59-d62f9af93dea tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:03.984075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c976014b-73d1-49ef-bf59-d62f9af93dea tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:03.986934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c976014b-73d1-49ef-bf59-d62f9af93dea tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:04.152344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c976014b-73d1-49ef-bf59-d62f9af93dea tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:04.167663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c976014b-73d1-49ef-bf59-d62f9af93dea tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:04.169315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c976014b-73d1-49ef-bf59-d62f9af93dea tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:04.171029 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c976014b-73d1-49ef-bf59-d62f9af93dea tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1356 microversion: 2.47 time: 0.228769 Aug 24 10:23:04.176038 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1458/2599] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:03 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1356 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:04.210716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b88d88e3-3fb3-4b91-ad06-263b35c2e19f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:04.222907 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b88d88e3-3fb3-4b91-ad06-263b35c2e19f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:04.225276 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b88d88e3-3fb3-4b91-ad06-263b35c2e19f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Searching by: {'deleted': False, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:23:04.237721 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b88d88e3-3fb3-4b91-ad06-263b35c2e19f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:04.238369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b88d88e3-3fb3-4b91-ad06-263b35c2e19f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:04.238950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b88d88e3-3fb3-4b91-ad06-263b35c2e19f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:04.242704 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b88d88e3-3fb3-4b91-ad06-263b35c2e19f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:04.243519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b88d88e3-3fb3-4b91-ad06-263b35c2e19f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:04.245743 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b88d88e3-3fb3-4b91-ad06-263b35c2e19f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:04.375410 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-06f2841a-bb74-4f88-8c78-70bc7709795c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:04.376625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-06f2841a-bb74-4f88-8c78-70bc7709795c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:04.408954 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06f2841a-bb74-4f88-8c78-70bc7709795c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:04.409484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06f2841a-bb74-4f88-8c78-70bc7709795c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:04.409918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06f2841a-bb74-4f88-8c78-70bc7709795c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:04.410643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06f2841a-bb74-4f88-8c78-70bc7709795c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:04.411100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06f2841a-bb74-4f88-8c78-70bc7709795c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:04.424062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06f2841a-bb74-4f88-8c78-70bc7709795c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:04.697425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-b88d88e3-3fb3-4b91-ad06-263b35c2e19f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:23:04.846413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-06f2841a-bb74-4f88-8c78-70bc7709795c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:04.862548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-06f2841a-bb74-4f88-8c78-70bc7709795c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:04.864929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-06f2841a-bb74-4f88-8c78-70bc7709795c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:04.868122 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-06f2841a-bb74-4f88-8c78-70bc7709795c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1604 microversion: 2.32 time: 0.497145 Aug 24 10:23:04.872709 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1459/2600] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:04 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1604 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:04.891040 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d225b906-696a-42e3-92af-66491a8f8d66 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:04.893896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d225b906-696a-42e3-92af-66491a8f8d66 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:04.921142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d225b906-696a-42e3-92af-66491a8f8d66 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:04.926037 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d225b906-696a-42e3-92af-66491a8f8d66 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:04.926654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d225b906-696a-42e3-92af-66491a8f8d66 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:04.928173 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d225b906-696a-42e3-92af-66491a8f8d66 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:04.928886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d225b906-696a-42e3-92af-66491a8f8d66 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:04.931750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d225b906-696a-42e3-92af-66491a8f8d66 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:04.974946 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b88d88e3-3fb3-4b91-ad06-263b35c2e19f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:04.991888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b88d88e3-3fb3-4b91-ad06-263b35c2e19f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:04.992865 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b88d88e3-3fb3-4b91-ad06-263b35c2e19f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:04.993754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b88d88e3-3fb3-4b91-ad06-263b35c2e19f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:05.034271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b88d88e3-3fb3-4b91-ad06-263b35c2e19f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:05.047809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b88d88e3-3fb3-4b91-ad06-263b35c2e19f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:05.501109 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b88d88e3-3fb3-4b91-ad06-263b35c2e19f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 1.278898 Aug 24 10:23:05.517249 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1142/2601] 10.222.0.85 () {60 vars in 1187 bytes} [Wed Aug 24 10:23:04 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:05.547559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8cda2dff-7e82-4e6a-a003-53486542d666 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:05.551189 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8cda2dff-7e82-4e6a-a003-53486542d666 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:05.573877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cda2dff-7e82-4e6a-a003-53486542d666 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:05.574659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cda2dff-7e82-4e6a-a003-53486542d666 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:05.575118 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cda2dff-7e82-4e6a-a003-53486542d666 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:05.575943 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cda2dff-7e82-4e6a-a003-53486542d666 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:05.576576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cda2dff-7e82-4e6a-a003-53486542d666 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:05.577048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cda2dff-7e82-4e6a-a003-53486542d666 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:05.660857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8cda2dff-7e82-4e6a-a003-53486542d666 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:23:05.889097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d225b906-696a-42e3-92af-66491a8f8d66 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:05.913987 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d225b906-696a-42e3-92af-66491a8f8d66 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1355 microversion: 2.1 time: 1.034714 Aug 24 10:23:05.928333 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1460/2602] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:04 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1355 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:05.953377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7cabeda0-f15a-4bba-8ceb-de34ca783a3c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:05.954956 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7cabeda0-f15a-4bba-8ceb-de34ca783a3c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:05.962011 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8cda2dff-7e82-4e6a-a003-53486542d666 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "DELETE /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 204 len: 0 microversion: 2.47 time: 0.420610 Aug 24 10:23:05.963994 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1143/2603] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:23:05 2022] DELETE /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:23:05.975882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7cabeda0-f15a-4bba-8ceb-de34ca783a3c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:05.977422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7cabeda0-f15a-4bba-8ceb-de34ca783a3c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:05.977841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4e3c8db4-8b3b-466c-bc67-768d6e61dea9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:05.978980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7cabeda0-f15a-4bba-8ceb-de34ca783a3c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:05.981488 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4e3c8db4-8b3b-466c-bc67-768d6e61dea9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:05.984583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7cabeda0-f15a-4bba-8ceb-de34ca783a3c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:05.985565 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7cabeda0-f15a-4bba-8ceb-de34ca783a3c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:05.988027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7cabeda0-f15a-4bba-8ceb-de34ca783a3c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:05.998554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:06.002183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e3c8db4-8b3b-466c-bc67-768d6e61dea9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:06.002935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e3c8db4-8b3b-466c-bc67-768d6e61dea9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:06.009149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e3c8db4-8b3b-466c-bc67-768d6e61dea9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:06.010767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e3c8db4-8b3b-466c-bc67-768d6e61dea9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:06.011803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e3c8db4-8b3b-466c-bc67-768d6e61dea9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:06.013297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e3c8db4-8b3b-466c-bc67-768d6e61dea9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:06.196591 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7cabeda0-f15a-4bba-8ceb-de34ca783a3c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:06.217864 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7cabeda0-f15a-4bba-8ceb-de34ca783a3c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:06.222833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7cabeda0-f15a-4bba-8ceb-de34ca783a3c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:06.225617 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7cabeda0-f15a-4bba-8ceb-de34ca783a3c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1604 microversion: 2.32 time: 0.292094 Aug 24 10:23:06.227816 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1461/2604] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:05 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1604 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:06.291347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4e3c8db4-8b3b-466c-bc67-768d6e61dea9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:06.306916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4e3c8db4-8b3b-466c-bc67-768d6e61dea9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:06.313242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4e3c8db4-8b3b-466c-bc67-768d6e61dea9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:06.315122 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4e3c8db4-8b3b-466c-bc67-768d6e61dea9 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1362 microversion: 2.47 time: 0.346576 Aug 24 10:23:06.318783 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1144/2605] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:05 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1362 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:06.347404 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-95b72930-2f07-49dd-9600-ea23a0b40b2b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:06.348160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-95b72930-2f07-49dd-9600-ea23a0b40b2b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:06.375322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95b72930-2f07-49dd-9600-ea23a0b40b2b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:06.375835 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95b72930-2f07-49dd-9600-ea23a0b40b2b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:06.376569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95b72930-2f07-49dd-9600-ea23a0b40b2b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:06.380888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95b72930-2f07-49dd-9600-ea23a0b40b2b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:06.381959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95b72930-2f07-49dd-9600-ea23a0b40b2b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:06.382819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95b72930-2f07-49dd-9600-ea23a0b40b2b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:06.477259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-95b72930-2f07-49dd-9600-ea23a0b40b2b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:23:06.640570 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-95b72930-2f07-49dd-9600-ea23a0b40b2b tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "DELETE /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b" status: 204 len: 0 microversion: 2.1 time: 0.297765 Aug 24 10:23:06.643138 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1462/2606] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:23:06 2022] DELETE /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:23:06.658858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7aa0366c-fd47-48f8-9ff1-e17f2e7dbf13 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:06.660403 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7aa0366c-fd47-48f8-9ff1-e17f2e7dbf13 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:06.682950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7aa0366c-fd47-48f8-9ff1-e17f2e7dbf13 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:06.683695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7aa0366c-fd47-48f8-9ff1-e17f2e7dbf13 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:06.684722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7aa0366c-fd47-48f8-9ff1-e17f2e7dbf13 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:06.690880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7aa0366c-fd47-48f8-9ff1-e17f2e7dbf13 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:06.692988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7aa0366c-fd47-48f8-9ff1-e17f2e7dbf13 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:06.694010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7aa0366c-fd47-48f8-9ff1-e17f2e7dbf13 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:06.963958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec44e28f-4219-44c2-b6e4-2c3cc73a6e24 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:06.967695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ec44e28f-4219-44c2-b6e4-2c3cc73a6e24 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:06.995819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec44e28f-4219-44c2-b6e4-2c3cc73a6e24 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:06.997453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec44e28f-4219-44c2-b6e4-2c3cc73a6e24 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:06.998241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec44e28f-4219-44c2-b6e4-2c3cc73a6e24 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:07.000211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec44e28f-4219-44c2-b6e4-2c3cc73a6e24 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:07.003649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec44e28f-4219-44c2-b6e4-2c3cc73a6e24 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:07.004464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec44e28f-4219-44c2-b6e4-2c3cc73a6e24 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:07.589065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7aa0366c-fd47-48f8-9ff1-e17f2e7dbf13 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:07.672647 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7aa0366c-fd47-48f8-9ff1-e17f2e7dbf13 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b" status: 200 len: 1485 microversion: 2.1 time: 1.025159 Aug 24 10:23:07.683036 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1145/2607] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:06 2022] GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b => generated 1485 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:07.716417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8658c1e2-e587-404f-802d-b72d032045db tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:07.720204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8658c1e2-e587-404f-802d-b72d032045db tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:07.738502 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8658c1e2-e587-404f-802d-b72d032045db tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:07.742202 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8658c1e2-e587-404f-802d-b72d032045db tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:07.742963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8658c1e2-e587-404f-802d-b72d032045db tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:07.745163 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8658c1e2-e587-404f-802d-b72d032045db tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:07.747379 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8658c1e2-e587-404f-802d-b72d032045db tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:07.748085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8658c1e2-e587-404f-802d-b72d032045db tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:07.794763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:07.905024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ec44e28f-4219-44c2-b6e4-2c3cc73a6e24 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:07.922607 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ec44e28f-4219-44c2-b6e4-2c3cc73a6e24 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1803 microversion: 2.1 time: 0.974272 Aug 24 10:23:07.923242 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1463/2608] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:06 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1803 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:07.935058 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-da18fc1f-fc12-495f-ae45-4639ec4d8aa2 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:07.935985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-da18fc1f-fc12-495f-ae45-4639ec4d8aa2 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:07.953148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da18fc1f-fc12-495f-ae45-4639ec4d8aa2 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:07.954056 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da18fc1f-fc12-495f-ae45-4639ec4d8aa2 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:07.954357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8658c1e2-e587-404f-802d-b72d032045db tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:07.954833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da18fc1f-fc12-495f-ae45-4639ec4d8aa2 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:07.955709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da18fc1f-fc12-495f-ae45-4639ec4d8aa2 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:07.957006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da18fc1f-fc12-495f-ae45-4639ec4d8aa2 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:07.959142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da18fc1f-fc12-495f-ae45-4639ec4d8aa2 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:07.986506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8658c1e2-e587-404f-802d-b72d032045db tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:07.988399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8658c1e2-e587-404f-802d-b72d032045db tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:07.997223 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8658c1e2-e587-404f-802d-b72d032045db tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1604 microversion: 2.32 time: 0.286641 Aug 24 10:23:08.005525 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1146/2609] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:07 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1604 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:08.011335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3ecbcf6b-3015-4e17-a27b-1c1b9072bd65 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:08.011844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3ecbcf6b-3015-4e17-a27b-1c1b9072bd65 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:08.035077 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ecbcf6b-3015-4e17-a27b-1c1b9072bd65 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:08.035581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ecbcf6b-3015-4e17-a27b-1c1b9072bd65 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:08.036029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ecbcf6b-3015-4e17-a27b-1c1b9072bd65 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:08.036755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ecbcf6b-3015-4e17-a27b-1c1b9072bd65 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:08.037248 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ecbcf6b-3015-4e17-a27b-1c1b9072bd65 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:08.037664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ecbcf6b-3015-4e17-a27b-1c1b9072bd65 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:08.105985 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3ecbcf6b-3015-4e17-a27b-1c1b9072bd65 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9/ips" status: 200 len: 216 microversion: 2.1 time: 0.099221 Aug 24 10:23:08.125580 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1147/2610] 10.222.0.85 () {58 vars in 1248 bytes} [Wed Aug 24 10:23:08 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9/ips => generated 216 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:08.131861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-88ee8e7b-6f95-4063-9729-bbf6f593a63b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:08.132636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-88ee8e7b-6f95-4063-9729-bbf6f593a63b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:08.139072 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da18fc1f-fc12-495f-ae45-4639ec4d8aa2 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:08.143531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88ee8e7b-6f95-4063-9729-bbf6f593a63b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:08.154006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88ee8e7b-6f95-4063-9729-bbf6f593a63b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:08.154833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88ee8e7b-6f95-4063-9729-bbf6f593a63b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:08.155755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88ee8e7b-6f95-4063-9729-bbf6f593a63b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:08.156376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88ee8e7b-6f95-4063-9729-bbf6f593a63b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:08.156732 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da18fc1f-fc12-495f-ae45-4639ec4d8aa2 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:08.157174 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88ee8e7b-6f95-4063-9729-bbf6f593a63b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:08.158544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da18fc1f-fc12-495f-ae45-4639ec4d8aa2 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:08.159787 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-da18fc1f-fc12-495f-ae45-4639ec4d8aa2 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1362 microversion: 2.47 time: 0.235591 Aug 24 10:23:08.160382 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1464/2611] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:07 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:08.225667 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-88ee8e7b-6f95-4063-9729-bbf6f593a63b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:23:08.430150 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-88ee8e7b-6f95-4063-9729-bbf6f593a63b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 204 len: 0 microversion: 2.1 time: 0.302729 Aug 24 10:23:08.434073 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1148/2612] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:23:08 2022] DELETE /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:23:08.439609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ea9cec7-78f1-4505-8fd5-630f68b5bb1e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:08.440602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4ea9cec7-78f1-4505-8fd5-630f68b5bb1e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:08.461406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ea9cec7-78f1-4505-8fd5-630f68b5bb1e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:08.462269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ea9cec7-78f1-4505-8fd5-630f68b5bb1e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:08.463028 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ea9cec7-78f1-4505-8fd5-630f68b5bb1e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:08.469488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ea9cec7-78f1-4505-8fd5-630f68b5bb1e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:08.470468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ea9cec7-78f1-4505-8fd5-630f68b5bb1e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:08.471191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ea9cec7-78f1-4505-8fd5-630f68b5bb1e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:08.712313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f98eaa0f-f5fa-4b5f-ab1a-114f0d8b835a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:08.713725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f98eaa0f-f5fa-4b5f-ab1a-114f0d8b835a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:08.722924 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f98eaa0f-f5fa-4b5f-ab1a-114f0d8b835a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:08.723418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f98eaa0f-f5fa-4b5f-ab1a-114f0d8b835a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:08.723861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f98eaa0f-f5fa-4b5f-ab1a-114f0d8b835a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:08.724600 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f98eaa0f-f5fa-4b5f-ab1a-114f0d8b835a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:08.725057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f98eaa0f-f5fa-4b5f-ab1a-114f0d8b835a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:08.725520 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f98eaa0f-f5fa-4b5f-ab1a-114f0d8b835a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:09.353239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f98eaa0f-f5fa-4b5f-ab1a-114f0d8b835a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:09.361980 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f98eaa0f-f5fa-4b5f-ab1a-114f0d8b835a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b" status: 200 len: 1485 microversion: 2.1 time: 0.653937 Aug 24 10:23:09.362591 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1149/2613] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:08 2022] GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b => generated 1485 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:23:09.391587 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1f42cb0e-35b3-4365-8f29-f5c9fb9d3b98 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:09.391992 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1f42cb0e-35b3-4365-8f29-f5c9fb9d3b98 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:09.411124 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f42cb0e-35b3-4365-8f29-f5c9fb9d3b98 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:09.411621 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f42cb0e-35b3-4365-8f29-f5c9fb9d3b98 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:09.412062 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f42cb0e-35b3-4365-8f29-f5c9fb9d3b98 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:09.412793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f42cb0e-35b3-4365-8f29-f5c9fb9d3b98 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:09.413466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f42cb0e-35b3-4365-8f29-f5c9fb9d3b98 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:09.413890 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f42cb0e-35b3-4365-8f29-f5c9fb9d3b98 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:09.428361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4ea9cec7-78f1-4505-8fd5-630f68b5bb1e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:09.462001 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4ea9cec7-78f1-4505-8fd5-630f68b5bb1e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1809 microversion: 2.1 time: 1.024895 Aug 24 10:23:09.480712 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1465/2614] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:08 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1809 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:23:09.519706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-65bf76cb-5e39-493d-8253-5b6787738be6 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:09.524222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-65bf76cb-5e39-493d-8253-5b6787738be6 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:09.571167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65bf76cb-5e39-493d-8253-5b6787738be6 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:09.573961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65bf76cb-5e39-493d-8253-5b6787738be6 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:09.576888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65bf76cb-5e39-493d-8253-5b6787738be6 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:09.577689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65bf76cb-5e39-493d-8253-5b6787738be6 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:09.581369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65bf76cb-5e39-493d-8253-5b6787738be6 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:09.582042 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65bf76cb-5e39-493d-8253-5b6787738be6 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:09.590837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1f42cb0e-35b3-4365-8f29-f5c9fb9d3b98 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:09.601532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1f42cb0e-35b3-4365-8f29-f5c9fb9d3b98 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:09.608360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1f42cb0e-35b3-4365-8f29-f5c9fb9d3b98 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:09.609646 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1f42cb0e-35b3-4365-8f29-f5c9fb9d3b98 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1604 microversion: 2.32 time: 0.222497 Aug 24 10:23:09.620837 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1150/2615] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:09 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1604 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:09.741775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-aeb30037-6ebf-4e86-ac48-55039d911422 req-02e2184a-1d06-42a0-a8ea-044badd695e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b", "name": "network-vif-deleted", "tag": "66efbfd1-4256-420a-b036-8c92ce86deea"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:09.766798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-65bf76cb-5e39-493d-8253-5b6787738be6 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:09.775536 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-aeb30037-6ebf-4e86-ac48-55039d911422 req-02e2184a-1d06-42a0-a8ea-044badd695e7 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:09.776028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-aeb30037-6ebf-4e86-ac48-55039d911422 req-02e2184a-1d06-42a0-a8ea-044badd695e7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:09.788439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-65bf76cb-5e39-493d-8253-5b6787738be6 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:09.795505 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-65bf76cb-5e39-493d-8253-5b6787738be6 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:09.801288 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-65bf76cb-5e39-493d-8253-5b6787738be6 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 200 len: 1362 microversion: 2.47 time: 0.315530 Aug 24 10:23:09.802237 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-aeb30037-6ebf-4e86-ac48-55039d911422 req-02e2184a-1d06-42a0-a8ea-044badd695e7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:09.803061 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1466/2616] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:09 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 1362 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:09.839446 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-aeb30037-6ebf-4e86-ac48-55039d911422 req-02e2184a-1d06-42a0-a8ea-044badd695e7 service nova] Creating event network-vif-deleted:66efbfd1-4256-420a-b036-8c92ce86deea for instance 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b on n-h2-849328-3 Aug 24 10:23:09.853565 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-aeb30037-6ebf-4e86-ac48-55039d911422 req-02e2184a-1d06-42a0-a8ea-044badd695e7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122273 Aug 24 10:23:09.854931 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1151/2617] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:10.385654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4cbbca96-cb29-42ea-bcf0-ad38a9f24b7e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:10.386392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4cbbca96-cb29-42ea-bcf0-ad38a9f24b7e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:10.395493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cbbca96-cb29-42ea-bcf0-ad38a9f24b7e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:10.400121 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cbbca96-cb29-42ea-bcf0-ad38a9f24b7e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:10.400968 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cbbca96-cb29-42ea-bcf0-ad38a9f24b7e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:10.402255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cbbca96-cb29-42ea-bcf0-ad38a9f24b7e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:10.403044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cbbca96-cb29-42ea-bcf0-ad38a9f24b7e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:10.403758 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cbbca96-cb29-42ea-bcf0-ad38a9f24b7e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:10.494893 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c3e79aa0-c9a9-4368-bac8-854fdb4eee28 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:10.495505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c3e79aa0-c9a9-4368-bac8-854fdb4eee28 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:10.507687 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3e79aa0-c9a9-4368-bac8-854fdb4eee28 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:10.508174 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3e79aa0-c9a9-4368-bac8-854fdb4eee28 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:10.508612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3e79aa0-c9a9-4368-bac8-854fdb4eee28 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:10.509349 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3e79aa0-c9a9-4368-bac8-854fdb4eee28 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:10.509808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3e79aa0-c9a9-4368-bac8-854fdb4eee28 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:10.510233 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3e79aa0-c9a9-4368-bac8-854fdb4eee28 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:10.525879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cbbca96-cb29-42ea-bcf0-ad38a9f24b7e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:10.527443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cbbca96-cb29-42ea-bcf0-ad38a9f24b7e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:10.528495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cbbca96-cb29-42ea-bcf0-ad38a9f24b7e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:10.529779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-4cbbca96-cb29-42ea-bcf0-ad38a9f24b7e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lazy-loading 'fault' on Instance uuid 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:23:10.897785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4cbbca96-cb29-42ea-bcf0-ad38a9f24b7e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:10.907906 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4cbbca96-cb29-42ea-bcf0-ad38a9f24b7e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b" status: 200 len: 1301 microversion: 2.1 time: 0.526318 Aug 24 10:23:10.911394 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1467/2618] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:10 2022] GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b => generated 1301 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:10.920575 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-30118028-7d4a-4020-acf1-753222eae6d9 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:10.928204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-30118028-7d4a-4020-acf1-753222eae6d9 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:10.942444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30118028-7d4a-4020-acf1-753222eae6d9 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:10.942787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30118028-7d4a-4020-acf1-753222eae6d9 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:10.943226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30118028-7d4a-4020-acf1-753222eae6d9 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:10.943955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30118028-7d4a-4020-acf1-753222eae6d9 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:10.944399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30118028-7d4a-4020-acf1-753222eae6d9 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:10.949194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30118028-7d4a-4020-acf1-753222eae6d9 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:11.085327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c3e79aa0-c9a9-4368-bac8-854fdb4eee28 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:11.098975 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c3e79aa0-c9a9-4368-bac8-854fdb4eee28 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1809 microversion: 2.1 time: 0.609500 Aug 24 10:23:11.110337 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1152/2619] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:10 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1809 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:11.118207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3ce66d8a-cdc4-409a-a888-552b406b856f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:11.118818 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3ce66d8a-cdc4-409a-a888-552b406b856f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 6cf9dc21-480e-4dd0-9ab7-68fb8571f270] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:11.147846 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ce66d8a-cdc4-409a-a888-552b406b856f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:11.148346 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ce66d8a-cdc4-409a-a888-552b406b856f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:11.156978 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ce66d8a-cdc4-409a-a888-552b406b856f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:11.162458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ce66d8a-cdc4-409a-a888-552b406b856f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:11.163595 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ce66d8a-cdc4-409a-a888-552b406b856f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:11.164841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ce66d8a-cdc4-409a-a888-552b406b856f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:11.188769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-30118028-7d4a-4020-acf1-753222eae6d9 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:11.207027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-30118028-7d4a-4020-acf1-753222eae6d9 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:11.215962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-30118028-7d4a-4020-acf1-753222eae6d9 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:11.217524 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-30118028-7d4a-4020-acf1-753222eae6d9 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1604 microversion: 2.32 time: 0.304558 Aug 24 10:23:11.220675 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1468/2620] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:10 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1604 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:11.235503 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-3ce66d8a-cdc4-409a-a888-552b406b856f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] HTTP exception thrown: Instance 6cf9dc21-480e-4dd0-9ab7-68fb8571f270 could not be found. Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3ce66d8a-cdc4-409a-a888-552b406b856f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Request method failure captured: Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 HTTP/1.1 Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfu_Z1UYX6iOGeXnWZPPmLqOnoGeMJCFXvAqzIsdTLDxtNn2Kf1UjAGZF6Z21xnhf0EanA4In-3udjjDJMAjOoXiJkSLym9xDmyS5jAyyCd0fPC413m_hGPBBy9ngJaK0sG-6itada5BsfNas0htJmhqtur1CE93E7M0WFiQg1y8fhg Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: X-Openstack-Nova-Api-Version: 2.47 Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: bcb5c4e7e532413685ae86f24d86751b Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerShowV247Test-829256047 Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bcb5c4e7e532413685ae86f24d86751b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bcb5c4e7e532413685ae86f24d86751b", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bcb5c4e7e532413685ae86f24d86751b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bcb5c4e7e532413685ae86f24d86751b"}]}] Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerShowV247Test-829256047 Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: bcb5c4e7e532413685ae86f24d86751b Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerShowV247Test-829256047 Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerShowV247Test-829256047-project Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 6d0112a16f86400289bfc60258957aaa Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerShowV247Test-829256047-project Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 6cf9dc21-480e-4dd0-9ab7-68fb8571f270 could not be found. Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '6cf9dc21-480e-4dd0-9ab7-68fb8571f270'} Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cf9dc21-480e-4dd0-9ab7-68fb8571f270 could not be found. Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cf9dc21-480e-4dd0-9ab7-68fb8571f270 could not be found. Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:11.237776 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:11.243702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:11.243702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:11.243702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:11.243702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:11.243702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:11.243702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cf9dc21-480e-4dd0-9ab7-68fb8571f270 could not be found. Aug 24 10:23:11.243702 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:11.244555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3ce66d8a-cdc4-409a-a888-552b406b856f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Returning 404 to user: Instance 6cf9dc21-480e-4dd0-9ab7-68fb8571f270 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:11.246060 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3ce66d8a-cdc4-409a-a888-552b406b856f tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270" status: 404 len: 111 microversion: 2.47 time: 0.131818 Aug 24 10:23:11.246664 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1153/2621] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:11 2022] GET /compute/v2.1/servers/6cf9dc21-480e-4dd0-9ab7-68fb8571f270 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:23:11.257925 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3115dc88-27c9-4fac-b3f9-351e99b0aa73 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:11.258590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3115dc88-27c9-4fac-b3f9-351e99b0aa73 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 36aa270e-6a92-4d10-8b11-9bb3ce5595a8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:11.271166 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3115dc88-27c9-4fac-b3f9-351e99b0aa73 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:11.271675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3115dc88-27c9-4fac-b3f9-351e99b0aa73 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:11.272121 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3115dc88-27c9-4fac-b3f9-351e99b0aa73 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:11.272851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3115dc88-27c9-4fac-b3f9-351e99b0aa73 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:11.273603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3115dc88-27c9-4fac-b3f9-351e99b0aa73 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:11.273784 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3115dc88-27c9-4fac-b3f9-351e99b0aa73 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:11.326811 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3115dc88-27c9-4fac-b3f9-351e99b0aa73 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 36aa270e-6a92-4d10-8b11-9bb3ce5595a8] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:23:11.437533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:11.567200 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3115dc88-27c9-4fac-b3f9-351e99b0aa73 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "DELETE /compute/v2.1/servers/36aa270e-6a92-4d10-8b11-9bb3ce5595a8" status: 204 len: 0 microversion: 2.47 time: 0.315441 Aug 24 10:23:11.571341 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1469/2622] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:23:11 2022] DELETE /compute/v2.1/servers/36aa270e-6a92-4d10-8b11-9bb3ce5595a8 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:23:11.582234 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0c4b99fc-e33a-4c01-926a-ee38b709f1b7 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:11.582913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0c4b99fc-e33a-4c01-926a-ee38b709f1b7 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 36aa270e-6a92-4d10-8b11-9bb3ce5595a8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:11.600568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c4b99fc-e33a-4c01-926a-ee38b709f1b7 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:11.601458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c4b99fc-e33a-4c01-926a-ee38b709f1b7 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:11.605457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c4b99fc-e33a-4c01-926a-ee38b709f1b7 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:11.607147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c4b99fc-e33a-4c01-926a-ee38b709f1b7 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:11.608289 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c4b99fc-e33a-4c01-926a-ee38b709f1b7 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:11.609938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c4b99fc-e33a-4c01-926a-ee38b709f1b7 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:12.091448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fcf272f1-cb08-4c51-b421-a6876a7498e2 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Action: 'create', calling method: .version_select at 0x7f465528a8b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-921644752", "description": "tempest-description-1124077745"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:12.093367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0c4b99fc-e33a-4c01-926a-ee38b709f1b7 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:12.115728 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0c4b99fc-e33a-4c01-926a-ee38b709f1b7 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:12.117701 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0c4b99fc-e33a-4c01-926a-ee38b709f1b7 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:12.119121 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0c4b99fc-e33a-4c01-926a-ee38b709f1b7 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/36aa270e-6a92-4d10-8b11-9bb3ce5595a8" status: 200 len: 1363 microversion: 2.47 time: 0.542895 Aug 24 10:23:12.120169 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1154/2623] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:11 2022] GET /compute/v2.1/servers/36aa270e-6a92-4d10-8b11-9bb3ce5595a8 => generated 1363 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:12.125158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a398a35a-5ec0-4f9d-b0b9-b261f932d35e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:12.136752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a398a35a-5ec0-4f9d-b0b9-b261f932d35e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:12.143608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a398a35a-5ec0-4f9d-b0b9-b261f932d35e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:12.144455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a398a35a-5ec0-4f9d-b0b9-b261f932d35e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:12.145114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a398a35a-5ec0-4f9d-b0b9-b261f932d35e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:12.146488 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a398a35a-5ec0-4f9d-b0b9-b261f932d35e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:12.153426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a398a35a-5ec0-4f9d-b0b9-b261f932d35e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:12.154244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a398a35a-5ec0-4f9d-b0b9-b261f932d35e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:12.191450 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-a398a35a-5ec0-4f9d-b0b9-b261f932d35e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] HTTP exception thrown: Instance 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b could not be found. Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a398a35a-5ec0-4f9d-b0b9-b261f932d35e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Request method failure captured: Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b HTTP/1.1 Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfopYPNODIjgyV0ghZgKGzaV6sR703fZMFE85piXFs7iToEiJtoRq97UvfpuesyKlStryOHX0Cd03kzmhSe80oezylVMIQdXboIk7utG8cR-2jHBjltAOE6fhy1pAB-jxOO7rOHXL1Y33J4_ydce_QqZibRdb3tO5zwih50Wa5huyaA Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 6f266868d6374a82a4ba5333915a9884 Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-LiveMigrationTest-94062731 Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6f266868d6374a82a4ba5333915a9884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6f266868d6374a82a4ba5333915a9884", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6f266868d6374a82a4ba5333915a9884"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6f266868d6374a82a4ba5333915a9884"}]}] Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-LiveMigrationTest-94062731 Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 6f266868d6374a82a4ba5333915a9884 Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-LiveMigrationTest-94062731 Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-LiveMigrationTest-94062731-project Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: b321b1490c2b4fe3aa1a1747b25408a1 Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-LiveMigrationTest-94062731-project Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b could not be found. Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b'} Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b could not be found. Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b could not be found. Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:12.195128 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:12.198728 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:12.198728 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:12.198728 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:12.198728 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:12.198728 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:12.198728 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b could not be found. Aug 24 10:23:12.198728 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:12.202869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a398a35a-5ec0-4f9d-b0b9-b261f932d35e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Returning 404 to user: Instance 2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:12.204122 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a398a35a-5ec0-4f9d-b0b9-b261f932d35e tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b" status: 404 len: 111 microversion: 2.1 time: 0.082849 Aug 24 10:23:12.210405 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1155/2624] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:12 2022] GET /compute/v2.1/servers/2bf00d38-f2e6-4dd4-857c-2fdfa4f9c19b => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:23:12.224176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aa975c22-b559-4d4b-b970-8166564acd2d tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:12.225292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aa975c22-b559-4d4b-b970-8166564acd2d tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:12.245778 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa975c22-b559-4d4b-b970-8166564acd2d tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:12.246948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa975c22-b559-4d4b-b970-8166564acd2d tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:12.247870 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa975c22-b559-4d4b-b970-8166564acd2d tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:12.249407 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa975c22-b559-4d4b-b970-8166564acd2d tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:12.254345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa975c22-b559-4d4b-b970-8166564acd2d tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:12.255699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa975c22-b559-4d4b-b970-8166564acd2d tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:12.542216 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fcf272f1-cb08-4c51-b421-a6876a7498e2 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.786295 Aug 24 10:23:12.543737 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1470/2625] 10.222.0.85 () {60 vars in 1180 bytes} [Wed Aug 24 10:23:11 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:12.553229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3c5517bb-b69b-4db9-ac53-acc8b299f9ad tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:12.554468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3c5517bb-b69b-4db9-ac53-acc8b299f9ad tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:12.565424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c5517bb-b69b-4db9-ac53-acc8b299f9ad tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:12.566213 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c5517bb-b69b-4db9-ac53-acc8b299f9ad tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:12.566836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c5517bb-b69b-4db9-ac53-acc8b299f9ad tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:12.567993 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c5517bb-b69b-4db9-ac53-acc8b299f9ad tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:12.569611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c5517bb-b69b-4db9-ac53-acc8b299f9ad tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:12.570742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c5517bb-b69b-4db9-ac53-acc8b299f9ad tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:12.619367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3c5517bb-b69b-4db9-ac53-acc8b299f9ad tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:23:12.871293 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3c5517bb-b69b-4db9-ac53-acc8b299f9ad tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "DELETE /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 204 len: 0 microversion: 2.1 time: 0.322913 Aug 24 10:23:12.877040 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1471/2626] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:23:12 2022] DELETE /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:23:12.891130 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f247f30e-320f-4881-869e-ef6d6cf520a5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:12.893434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f247f30e-320f-4881-869e-ef6d6cf520a5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:12.912867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f247f30e-320f-4881-869e-ef6d6cf520a5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:12.913395 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f247f30e-320f-4881-869e-ef6d6cf520a5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:12.915413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f247f30e-320f-4881-869e-ef6d6cf520a5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:12.916488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f247f30e-320f-4881-869e-ef6d6cf520a5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:12.918768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f247f30e-320f-4881-869e-ef6d6cf520a5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:12.919479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f247f30e-320f-4881-869e-ef6d6cf520a5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:13.110980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f247f30e-320f-4881-869e-ef6d6cf520a5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:13.136172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f247f30e-320f-4881-869e-ef6d6cf520a5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:13.140428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f247f30e-320f-4881-869e-ef6d6cf520a5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:13.145109 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f247f30e-320f-4881-869e-ef6d6cf520a5 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1604 microversion: 2.32 time: 0.267914 Aug 24 10:23:13.145109 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1472/2627] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:12 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1604 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:13.173840 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c19ee594-b7ae-492d-bfe3-b1f4ef0cdfc4 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Action: 'create', calling method: .version_select at 0x7f465a1b83a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2002121794", "description": "tempest-description-1839900989"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:13.186376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aa975c22-b559-4d4b-b970-8166564acd2d tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:13.205174 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aa975c22-b559-4d4b-b970-8166564acd2d tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1809 microversion: 2.1 time: 0.984902 Aug 24 10:23:13.211111 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1156/2628] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:12 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1809 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:13.221100 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cadd2d0c-2258-450a-8b71-198984ba0c95 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:13.226571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cadd2d0c-2258-450a-8b71-198984ba0c95 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:13.248371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cadd2d0c-2258-450a-8b71-198984ba0c95 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:13.253722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cadd2d0c-2258-450a-8b71-198984ba0c95 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:13.254398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cadd2d0c-2258-450a-8b71-198984ba0c95 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:13.255482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cadd2d0c-2258-450a-8b71-198984ba0c95 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:13.256150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cadd2d0c-2258-450a-8b71-198984ba0c95 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:13.256697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cadd2d0c-2258-450a-8b71-198984ba0c95 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:13.717723 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c19ee594-b7ae-492d-bfe3-b1f4ef0cdfc4 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.561066 Aug 24 10:23:13.720344 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1473/2629] 10.222.0.85 () {60 vars in 1180 bytes} [Wed Aug 24 10:23:13 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:13.870941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d8867f16-f994-4baf-a3be-40cfb031c48b tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-994638541", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "ae1c6afa-18d9-4503-b020-5983b3e72612"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:14.028603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-d8867f16-f994-4baf-a3be-40cfb031c48b tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] validate_networks() for [('ae1c6afa-18d9-4503-b020-5983b3e72612', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:23:14.398257 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cadd2d0c-2258-450a-8b71-198984ba0c95 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:14.436723 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cadd2d0c-2258-450a-8b71-198984ba0c95 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1500 microversion: 2.1 time: 1.223799 Aug 24 10:23:14.438488 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1157/2630] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:13 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1500 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:14.467716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4a544fa2-38a1-4844-a323-1e6c9738d7ba tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:14.470338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4a544fa2-38a1-4844-a323-1e6c9738d7ba tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 36aa270e-6a92-4d10-8b11-9bb3ce5595a8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:14.505182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:14.509681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a544fa2-38a1-4844-a323-1e6c9738d7ba tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:14.510826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a544fa2-38a1-4844-a323-1e6c9738d7ba tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:14.514844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a544fa2-38a1-4844-a323-1e6c9738d7ba tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:14.516370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a544fa2-38a1-4844-a323-1e6c9738d7ba tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:14.522709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a544fa2-38a1-4844-a323-1e6c9738d7ba tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:14.524876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a544fa2-38a1-4844-a323-1e6c9738d7ba tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:14.892286 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4a544fa2-38a1-4844-a323-1e6c9738d7ba tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:14.941897 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4a544fa2-38a1-4844-a323-1e6c9738d7ba tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:14.951597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4a544fa2-38a1-4844-a323-1e6c9738d7ba tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0112a16f86400289bfc60258957aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb5c4e7e532413685ae86f24d86751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:14.954283 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4a544fa2-38a1-4844-a323-1e6c9738d7ba tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/36aa270e-6a92-4d10-8b11-9bb3ce5595a8" status: 200 len: 1363 microversion: 2.47 time: 0.513528 Aug 24 10:23:14.966869 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1158/2631] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:14 2022] GET /compute/v2.1/servers/36aa270e-6a92-4d10-8b11-9bb3ce5595a8 => generated 1363 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:14.976672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-130c69ba-1690-45df-a674-770061763e37 req-bac03b5a-fb8f-4bff-89e0-43ad325f9b45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a599e1a2-3ca0-4cde-b11c-ef5e069065f9", "name": "network-vif-deleted", "tag": "1799c04a-1694-4f6d-a4a7-2c35d555e841"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:14.999121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:15.001574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-130c69ba-1690-45df-a674-770061763e37 req-bac03b5a-fb8f-4bff-89e0-43ad325f9b45 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:15.002801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-130c69ba-1690-45df-a674-770061763e37 req-bac03b5a-fb8f-4bff-89e0-43ad325f9b45 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:15.003929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-130c69ba-1690-45df-a674-770061763e37 req-bac03b5a-fb8f-4bff-89e0-43ad325f9b45 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:15.045057 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-130c69ba-1690-45df-a674-770061763e37 req-bac03b5a-fb8f-4bff-89e0-43ad325f9b45 service nova] Creating event network-vif-deleted:1799c04a-1694-4f6d-a4a7-2c35d555e841 for instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 on n-h1-849328-3 Aug 24 10:23:15.058963 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-130c69ba-1690-45df-a674-770061763e37 req-bac03b5a-fb8f-4bff-89e0-43ad325f9b45 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087431 Aug 24 10:23:15.062855 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1159/2632] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:15.079282 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ace333b0-09ab-4ad2-a022-a7b8b6f142de tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-17810677", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "ad61c78e-599f-4990-9541-58be77897c55"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:15.194543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-ace333b0-09ab-4ad2-a022-a7b8b6f142de tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] validate_networks() for [('ad61c78e-599f-4990-9541-58be77897c55', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:23:15.812980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d8867f16-f994-4baf-a3be-40cfb031c48b tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:23:15.814770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d8867f16-f994-4baf-a3be-40cfb031c48b tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:23:15.815823 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d8867f16-f994-4baf-a3be-40cfb031c48b tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:23:15.816543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d8867f16-f994-4baf-a3be-40cfb031c48b tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:23:15.817386 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d8867f16-f994-4baf-a3be-40cfb031c48b tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:23:15.839426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8867f16-f994-4baf-a3be-40cfb031c48b tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:15.840218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8867f16-f994-4baf-a3be-40cfb031c48b tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:15.841047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8867f16-f994-4baf-a3be-40cfb031c48b tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:15.842260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8867f16-f994-4baf-a3be-40cfb031c48b tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:15.842891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8867f16-f994-4baf-a3be-40cfb031c48b tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:15.843615 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8867f16-f994-4baf-a3be-40cfb031c48b tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:15.890215 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-d8867f16-f994-4baf-a3be-40cfb031c48b tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Getting quotas for project f539617fa0074e2fbd6aaedc8b63773f. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:23:15.895886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-d8867f16-f994-4baf-a3be-40cfb031c48b tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Getting quotas for user f0b28596ad9a4f259695e4705ae02f4e and project f539617fa0074e2fbd6aaedc8b63773f. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:23:15.929472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d8867f16-f994-4baf-a3be-40cfb031c48b tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:23:15.931937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d8867f16-f994-4baf-a3be-40cfb031c48b tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] [instance: 98710ee1-1634-4370-b3c1-51d5df2ab889] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:23:16.005044 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d8867f16-f994-4baf-a3be-40cfb031c48b tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.266300 Aug 24 10:23:16.011608 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1474/2633] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:23:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:23:16.011922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a292d0c7-4f9f-46fa-95a5-398d4d503696 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:16.012740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a292d0c7-4f9f-46fa-95a5-398d4d503696 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:16.019542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a292d0c7-4f9f-46fa-95a5-398d4d503696 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:16.020527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a292d0c7-4f9f-46fa-95a5-398d4d503696 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:16.021169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a292d0c7-4f9f-46fa-95a5-398d4d503696 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:16.022068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a292d0c7-4f9f-46fa-95a5-398d4d503696 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:16.022687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a292d0c7-4f9f-46fa-95a5-398d4d503696 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:16.023290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a292d0c7-4f9f-46fa-95a5-398d4d503696 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:16.140368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a292d0c7-4f9f-46fa-95a5-398d4d503696 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:16.156248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a292d0c7-4f9f-46fa-95a5-398d4d503696 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:16.162277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a292d0c7-4f9f-46fa-95a5-398d4d503696 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:16.166007 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a292d0c7-4f9f-46fa-95a5-398d4d503696 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1604 microversion: 2.32 time: 0.158598 Aug 24 10:23:16.166640 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1475/2634] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:16 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1604 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:16.181435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-149fa79c-4641-4ae7-94d0-448c6ed02483 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:16.188363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-149fa79c-4641-4ae7-94d0-448c6ed02483 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:16.206481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-149fa79c-4641-4ae7-94d0-448c6ed02483 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:16.208949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-149fa79c-4641-4ae7-94d0-448c6ed02483 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:16.209592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-149fa79c-4641-4ae7-94d0-448c6ed02483 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:16.211972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-149fa79c-4641-4ae7-94d0-448c6ed02483 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:16.213263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-149fa79c-4641-4ae7-94d0-448c6ed02483 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:16.217420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-149fa79c-4641-4ae7-94d0-448c6ed02483 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:16.469744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-149fa79c-4641-4ae7-94d0-448c6ed02483 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:16.483415 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-149fa79c-4641-4ae7-94d0-448c6ed02483 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1674 microversion: 2.1 time: 0.308337 Aug 24 10:23:16.511817 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1476/2635] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:16 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1674 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:16.530997 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-ac63b937-7910-4635-95cd-568e43dfc348 req-f18eca19-7ede-40e9-a6d7-234b457506c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a599e1a2-3ca0-4cde-b11c-ef5e069065f9", "name": "network-vif-unplugged", "status": "completed", "tag": "4510534e-d3d1-48b3-a1c6-bd96fc223506"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:16.569752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ac63b937-7910-4635-95cd-568e43dfc348 req-f18eca19-7ede-40e9-a6d7-234b457506c7 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:16.575891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ac63b937-7910-4635-95cd-568e43dfc348 req-f18eca19-7ede-40e9-a6d7-234b457506c7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:16.577107 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ac63b937-7910-4635-95cd-568e43dfc348 req-f18eca19-7ede-40e9-a6d7-234b457506c7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:16.630769 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-ac63b937-7910-4635-95cd-568e43dfc348 req-f18eca19-7ede-40e9-a6d7-234b457506c7 service nova] Creating event network-vif-unplugged:4510534e-d3d1-48b3-a1c6-bd96fc223506 for instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 on n-h1-849328-3 Aug 24 10:23:16.670316 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-ac63b937-7910-4635-95cd-568e43dfc348 req-f18eca19-7ede-40e9-a6d7-234b457506c7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.156111 Aug 24 10:23:16.671385 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1477/2636] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:16.694898 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ab2fba55-f724-41d4-ba77-23433da12a80 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:16.697702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ab2fba55-f724-41d4-ba77-23433da12a80 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:16.735151 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab2fba55-f724-41d4-ba77-23433da12a80 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:16.736042 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab2fba55-f724-41d4-ba77-23433da12a80 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:16.736753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab2fba55-f724-41d4-ba77-23433da12a80 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:16.737892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab2fba55-f724-41d4-ba77-23433da12a80 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:16.738433 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab2fba55-f724-41d4-ba77-23433da12a80 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:16.738983 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab2fba55-f724-41d4-ba77-23433da12a80 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:16.851169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab2fba55-f724-41d4-ba77-23433da12a80 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:16.851630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab2fba55-f724-41d4-ba77-23433da12a80 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:16.851872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab2fba55-f724-41d4-ba77-23433da12a80 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:16.852467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-ab2fba55-f724-41d4-ba77-23433da12a80 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lazy-loading 'fault' on Instance uuid e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:23:16.912405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ab2fba55-f724-41d4-ba77-23433da12a80 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b321b1490c2b4fe3aa1a1747b25408a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f266868d6374a82a4ba5333915a9884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:16.923283 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ab2fba55-f724-41d4-ba77-23433da12a80 tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 200 len: 1301 microversion: 2.1 time: 0.250068 Aug 24 10:23:16.926376 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1478/2637] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:16 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 1301 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:16.952418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7c0d9447-ed0a-463f-845f-2158a636a0a1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:16.953269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7c0d9447-ed0a-463f-845f-2158a636a0a1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] [instance: 36aa270e-6a92-4d10-8b11-9bb3ce5595a8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:16.961540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c0d9447-ed0a-463f-845f-2158a636a0a1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:16.962065 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c0d9447-ed0a-463f-845f-2158a636a0a1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:16.966071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c0d9447-ed0a-463f-845f-2158a636a0a1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:16.967831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c0d9447-ed0a-463f-845f-2158a636a0a1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:16.969018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c0d9447-ed0a-463f-845f-2158a636a0a1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:16.970359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c0d9447-ed0a-463f-845f-2158a636a0a1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:16.992885 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-7c0d9447-ed0a-463f-845f-2158a636a0a1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] HTTP exception thrown: Instance 36aa270e-6a92-4d10-8b11-9bb3ce5595a8 could not be found. Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7c0d9447-ed0a-463f-845f-2158a636a0a1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Request method failure captured: Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/36aa270e-6a92-4d10-8b11-9bb3ce5595a8 HTTP/1.1 Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfu_Z1UYX6iOGeXnWZPPmLqOnoGeMJCFXvAqzIsdTLDxtNn2Kf1UjAGZF6Z21xnhf0EanA4In-3udjjDJMAjOoXiJkSLym9xDmyS5jAyyCd0fPC413m_hGPBBy9ngJaK0sG-6itada5BsfNas0htJmhqtur1CE93E7M0WFiQg1y8fhg Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.47 Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: bcb5c4e7e532413685ae86f24d86751b Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerShowV247Test-829256047 Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bcb5c4e7e532413685ae86f24d86751b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bcb5c4e7e532413685ae86f24d86751b", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bcb5c4e7e532413685ae86f24d86751b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bcb5c4e7e532413685ae86f24d86751b"}]}] Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerShowV247Test-829256047 Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: bcb5c4e7e532413685ae86f24d86751b Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerShowV247Test-829256047 Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerShowV247Test-829256047-project Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 6d0112a16f86400289bfc60258957aaa Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerShowV247Test-829256047-project Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 36aa270e-6a92-4d10-8b11-9bb3ce5595a8 could not be found. Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '36aa270e-6a92-4d10-8b11-9bb3ce5595a8'} Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36aa270e-6a92-4d10-8b11-9bb3ce5595a8 could not be found. Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36aa270e-6a92-4d10-8b11-9bb3ce5595a8 could not be found. Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:16.996500 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:17.001764 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:17.001764 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:17.001764 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:17.001764 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:17.001764 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:17.001764 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36aa270e-6a92-4d10-8b11-9bb3ce5595a8 could not be found. Aug 24 10:23:17.001764 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:17.004144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7c0d9447-ed0a-463f-845f-2158a636a0a1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] Returning 404 to user: Instance 36aa270e-6a92-4d10-8b11-9bb3ce5595a8 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:17.005444 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7c0d9447-ed0a-463f-845f-2158a636a0a1 tempest-ServerShowV247Test-829256047 tempest-ServerShowV247Test-829256047-project] 10.222.0.85 "GET /compute/v2.1/servers/36aa270e-6a92-4d10-8b11-9bb3ce5595a8" status: 404 len: 111 microversion: 2.47 time: 0.077417 Aug 24 10:23:17.007650 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1479/2638] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:16 2022] GET /compute/v2.1/servers/36aa270e-6a92-4d10-8b11-9bb3ce5595a8 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:23:17.025556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9b857783-cf64-4f54-924f-63bc860a1563 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:17.026588 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9b857783-cf64-4f54-924f-63bc860a1563 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] [instance: 98710ee1-1634-4370-b3c1-51d5df2ab889] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:17.124591 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9b857783-cf64-4f54-924f-63bc860a1563 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b28596ad9a4f259695e4705ae02f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f539617fa0074e2fbd6aaedc8b63773f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:17.141796 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9b857783-cf64-4f54-924f-63bc860a1563 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] 10.222.0.85 "GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889" status: 200 len: 1224 microversion: 2.1 time: 0.132783 Aug 24 10:23:17.159924 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1480/2639] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:17 2022] GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889 => generated 1224 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:17.196724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1a8ad2b5-3262-4d99-85f0-fedba523f165 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:17.197936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1a8ad2b5-3262-4d99-85f0-fedba523f165 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:17.207444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a8ad2b5-3262-4d99-85f0-fedba523f165 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:17.213668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a8ad2b5-3262-4d99-85f0-fedba523f165 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:17.214517 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a8ad2b5-3262-4d99-85f0-fedba523f165 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:17.216568 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a8ad2b5-3262-4d99-85f0-fedba523f165 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:17.218832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a8ad2b5-3262-4d99-85f0-fedba523f165 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:17.219522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a8ad2b5-3262-4d99-85f0-fedba523f165 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:17.372242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1a8ad2b5-3262-4d99-85f0-fedba523f165 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:17.405755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1a8ad2b5-3262-4d99-85f0-fedba523f165 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:17.415860 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1a8ad2b5-3262-4d99-85f0-fedba523f165 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:17.424018 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1a8ad2b5-3262-4d99-85f0-fedba523f165 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1604 microversion: 2.32 time: 0.234515 Aug 24 10:23:17.434558 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1481/2640] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:17 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1604 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:17.438499 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-ace333b0-09ab-4ad2-a022-a7b8b6f142de tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:23:17.438951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-ace333b0-09ab-4ad2-a022-a7b8b6f142de tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:23:17.440011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-ace333b0-09ab-4ad2-a022-a7b8b6f142de tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:23:17.440592 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-ace333b0-09ab-4ad2-a022-a7b8b6f142de tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:23:17.443377 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-ace333b0-09ab-4ad2-a022-a7b8b6f142de tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:23:17.466137 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ace333b0-09ab-4ad2-a022-a7b8b6f142de tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:17.468396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ace333b0-09ab-4ad2-a022-a7b8b6f142de tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:17.469854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ace333b0-09ab-4ad2-a022-a7b8b6f142de tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:17.472173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ace333b0-09ab-4ad2-a022-a7b8b6f142de tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:17.472686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ace333b0-09ab-4ad2-a022-a7b8b6f142de tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:17.473487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ace333b0-09ab-4ad2-a022-a7b8b6f142de tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:17.523321 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-ace333b0-09ab-4ad2-a022-a7b8b6f142de tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Getting quotas for project 44f050698fc54fb6b8fdf2866472dd7d. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:23:17.537913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-457776e8-8239-43bd-93c6-178993751ee9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:17.538543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-457776e8-8239-43bd-93c6-178993751ee9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:17.544605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:17.553168 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-ace333b0-09ab-4ad2-a022-a7b8b6f142de tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Getting quotas for user cf7304a4a0bb486fbf52f1c84cad702a and project 44f050698fc54fb6b8fdf2866472dd7d. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:23:17.558630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-457776e8-8239-43bd-93c6-178993751ee9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:17.559124 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-457776e8-8239-43bd-93c6-178993751ee9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:17.559624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-457776e8-8239-43bd-93c6-178993751ee9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:17.560362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-457776e8-8239-43bd-93c6-178993751ee9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:17.572314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-457776e8-8239-43bd-93c6-178993751ee9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:17.573666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-457776e8-8239-43bd-93c6-178993751ee9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:17.607591 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ace333b0-09ab-4ad2-a022-a7b8b6f142de tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:23:17.610164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ace333b0-09ab-4ad2-a022-a7b8b6f142de tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: d49761ab-ce76-45fc-9754-3366ce58e6b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:23:17.793238 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ace333b0-09ab-4ad2-a022-a7b8b6f142de tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.722299 Aug 24 10:23:17.811281 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1160/2641] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:23:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:23:18.218436 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9a1da143-9058-43ca-aa34-2804d2b5dce8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1492030744", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "fb7883d4-b081-478d-b08b-6c818132f5bd"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:18.219478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-457776e8-8239-43bd-93c6-178993751ee9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:18.231990 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-457776e8-8239-43bd-93c6-178993751ee9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1653 microversion: 2.1 time: 0.698322 Aug 24 10:23:18.234699 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1482/2642] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:17 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1653 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:23:18.244833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-95ab77f4-1fed-4811-b0f6-a85bed3d1e0d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:18.247112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-95ab77f4-1fed-4811-b0f6-a85bed3d1e0d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: d49761ab-ce76-45fc-9754-3366ce58e6b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:18.379732 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-9a1da143-9058-43ca-aa34-2804d2b5dce8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] validate_networks() for [('fb7883d4-b081-478d-b08b-6c818132f5bd', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:23:18.595553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-95ab77f4-1fed-4811-b0f6-a85bed3d1e0d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:18.616405 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-95ab77f4-1fed-4811-b0f6-a85bed3d1e0d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2" status: 200 len: 1214 microversion: 2.1 time: 0.379087 Aug 24 10:23:18.621977 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1483/2643] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:18 2022] GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2 => generated 1214 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:18.631973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-b38a65cb-010c-4a33-bde3-5f22e3c4244e req-a9644066-6687-4cc3-8ea7-d98b1f7fb143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e35cb9a6-5d75-4272-9a0c-dd6d092e96f8", "name": "network-vif-deleted", "tag": "0d6b8ccb-507f-46f4-8fc1-680ff0bcd84b"}, {"server_uuid": "a599e1a2-3ca0-4cde-b11c-ef5e069065f9", "name": "network-vif-deleted", "tag": "4510534e-d3d1-48b3-a1c6-bd96fc223506"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:18.684795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b38a65cb-010c-4a33-bde3-5f22e3c4244e req-a9644066-6687-4cc3-8ea7-d98b1f7fb143 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:18.689151 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b38a65cb-010c-4a33-bde3-5f22e3c4244e req-a9644066-6687-4cc3-8ea7-d98b1f7fb143 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:18.693572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b38a65cb-010c-4a33-bde3-5f22e3c4244e req-a9644066-6687-4cc3-8ea7-d98b1f7fb143 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:18.766879 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-b38a65cb-010c-4a33-bde3-5f22e3c4244e req-a9644066-6687-4cc3-8ea7-d98b1f7fb143 service nova] Creating event network-vif-deleted:0d6b8ccb-507f-46f4-8fc1-680ff0bcd84b for instance e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 on n-h2-849328-3 Aug 24 10:23:18.767413 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-b38a65cb-010c-4a33-bde3-5f22e3c4244e req-a9644066-6687-4cc3-8ea7-d98b1f7fb143 service nova] Creating event network-vif-deleted:4510534e-d3d1-48b3-a1c6-bd96fc223506 for instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 on n-h1-849328-3 Aug 24 10:23:18.795097 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-b38a65cb-010c-4a33-bde3-5f22e3c4244e req-a9644066-6687-4cc3-8ea7-d98b1f7fb143 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.169052 Aug 24 10:23:18.797397 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1484/2644] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:18.824308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f5294c9f-7222-4a8e-9b85-afc2c3c3813a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:18.825089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f5294c9f-7222-4a8e-9b85-afc2c3c3813a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] [instance: e35cb9a6-5d75-4272-9a0c-dd6d092e96f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:18.858390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5294c9f-7222-4a8e-9b85-afc2c3c3813a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:18.858906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5294c9f-7222-4a8e-9b85-afc2c3c3813a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:18.859353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5294c9f-7222-4a8e-9b85-afc2c3c3813a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:18.860083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5294c9f-7222-4a8e-9b85-afc2c3c3813a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:18.860547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5294c9f-7222-4a8e-9b85-afc2c3c3813a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:18.860978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5294c9f-7222-4a8e-9b85-afc2c3c3813a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:18.912492 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-f5294c9f-7222-4a8e-9b85-afc2c3c3813a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] HTTP exception thrown: Instance e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 could not be found. Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f5294c9f-7222-4a8e-9b85-afc2c3c3813a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Request method failure captured: Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 HTTP/1.1 Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfopYPNODIjgyV0ghZgKGzaV6sR703fZMFE85piXFs7iToEiJtoRq97UvfpuesyKlStryOHX0Cd03kzmhSe80oezylVMIQdXboIk7utG8cR-2jHBjltAOE6fhy1pAB-jxOO7rOHXL1Y33J4_ydce_QqZibRdb3tO5zwih50Wa5huyaA Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 6f266868d6374a82a4ba5333915a9884 Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-LiveMigrationTest-94062731 Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6f266868d6374a82a4ba5333915a9884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6f266868d6374a82a4ba5333915a9884", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6f266868d6374a82a4ba5333915a9884"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6f266868d6374a82a4ba5333915a9884"}]}] Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-LiveMigrationTest-94062731 Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 6f266868d6374a82a4ba5333915a9884 Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-LiveMigrationTest-94062731 Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-LiveMigrationTest-94062731-project Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: b321b1490c2b4fe3aa1a1747b25408a1 Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-LiveMigrationTest-94062731-project Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 could not be found. Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'e35cb9a6-5d75-4272-9a0c-dd6d092e96f8'} Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 could not be found. Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 could not be found. Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:18.916876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:18.921422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:18.921422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:18.921422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:18.921422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:18.921422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:18.921422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 could not be found. Aug 24 10:23:18.921422 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:18.921422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f5294c9f-7222-4a8e-9b85-afc2c3c3813a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] Returning 404 to user: Instance e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:18.923044 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f5294c9f-7222-4a8e-9b85-afc2c3c3813a tempest-LiveMigrationTest-94062731 tempest-LiveMigrationTest-94062731-project] 10.222.0.85 "GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8" status: 404 len: 111 microversion: 2.1 time: 0.122122 Aug 24 10:23:18.941978 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1485/2645] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:18 2022] GET /compute/v2.1/servers/e35cb9a6-5d75-4272-9a0c-dd6d092e96f8 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:23:18.957551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-58186c4c-b3f3-4c52-a9ab-cefeb351f32a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:18.959049 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-58186c4c-b3f3-4c52-a9ab-cefeb351f32a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] [instance: 98710ee1-1634-4370-b3c1-51d5df2ab889] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:18.977681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58186c4c-b3f3-4c52-a9ab-cefeb351f32a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:18.978861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58186c4c-b3f3-4c52-a9ab-cefeb351f32a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:18.980801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58186c4c-b3f3-4c52-a9ab-cefeb351f32a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:18.982215 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58186c4c-b3f3-4c52-a9ab-cefeb351f32a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:18.985890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58186c4c-b3f3-4c52-a9ab-cefeb351f32a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:18.986831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58186c4c-b3f3-4c52-a9ab-cefeb351f32a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:19.338607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-58186c4c-b3f3-4c52-a9ab-cefeb351f32a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b28596ad9a4f259695e4705ae02f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f539617fa0074e2fbd6aaedc8b63773f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:19.350392 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-58186c4c-b3f3-4c52-a9ab-cefeb351f32a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] 10.222.0.85 "GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889" status: 200 len: 1282 microversion: 2.1 time: 0.406020 Aug 24 10:23:19.365757 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1486/2646] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:18 2022] GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889 => generated 1282 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:19.374529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-48a3333b-7a02-4c01-b45a-02f02fced9b1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:19.375578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-48a3333b-7a02-4c01-b45a-02f02fced9b1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:19.382786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48a3333b-7a02-4c01-b45a-02f02fced9b1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:19.383596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48a3333b-7a02-4c01-b45a-02f02fced9b1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:19.384853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48a3333b-7a02-4c01-b45a-02f02fced9b1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:19.385979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48a3333b-7a02-4c01-b45a-02f02fced9b1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:19.389542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48a3333b-7a02-4c01-b45a-02f02fced9b1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:19.390224 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48a3333b-7a02-4c01-b45a-02f02fced9b1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:19.677446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-48a3333b-7a02-4c01-b45a-02f02fced9b1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:19.697693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-48a3333b-7a02-4c01-b45a-02f02fced9b1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:19.699955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-48a3333b-7a02-4c01-b45a-02f02fced9b1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:19.702603 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-48a3333b-7a02-4c01-b45a-02f02fced9b1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1604 microversion: 2.32 time: 0.334741 Aug 24 10:23:19.704374 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1487/2647] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:19 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1604 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:19.710837 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-7d957496-bd79-47c3-9b38-84dc51a47dd4 req-de7cd772-417c-42cb-bdb9-063e5d6568ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a599e1a2-3ca0-4cde-b11c-ef5e069065f9", "name": "network-vif-unplugged", "status": "completed", "tag": "bb7f920a-c727-4e7e-a723-2d9a8f9a07b9"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:19.750247 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7d957496-bd79-47c3-9b38-84dc51a47dd4 req-de7cd772-417c-42cb-bdb9-063e5d6568ba service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:19.751668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7d957496-bd79-47c3-9b38-84dc51a47dd4 req-de7cd772-417c-42cb-bdb9-063e5d6568ba service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:19.752159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7d957496-bd79-47c3-9b38-84dc51a47dd4 req-de7cd772-417c-42cb-bdb9-063e5d6568ba service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:19.808255 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-7d957496-bd79-47c3-9b38-84dc51a47dd4 req-de7cd772-417c-42cb-bdb9-063e5d6568ba service nova] Creating event network-vif-unplugged:bb7f920a-c727-4e7e-a723-2d9a8f9a07b9 for instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 on n-h1-849328-3 Aug 24 10:23:19.829840 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-7d957496-bd79-47c3-9b38-84dc51a47dd4 req-de7cd772-417c-42cb-bdb9-063e5d6568ba service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123808 Aug 24 10:23:19.831150 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1488/2648] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:19.844055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-88309475-43d0-4275-a936-b290e408dbdf tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:19.848977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-88309475-43d0-4275-a936-b290e408dbdf tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:19.859895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88309475-43d0-4275-a936-b290e408dbdf tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:19.860838 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88309475-43d0-4275-a936-b290e408dbdf tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:19.861549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88309475-43d0-4275-a936-b290e408dbdf tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:19.862501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88309475-43d0-4275-a936-b290e408dbdf tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:19.863788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88309475-43d0-4275-a936-b290e408dbdf tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:19.864469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88309475-43d0-4275-a936-b290e408dbdf tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:20.448947 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-88309475-43d0-4275-a936-b290e408dbdf tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:20.462609 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-88309475-43d0-4275-a936-b290e408dbdf tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1496 microversion: 2.1 time: 0.623964 Aug 24 10:23:20.463780 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1489/2649] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:19 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1496 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:20.469328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-123d6567-53f4-437a-bcbb-1a1b30f824c5 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:20.475964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-123d6567-53f4-437a-bcbb-1a1b30f824c5 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: d49761ab-ce76-45fc-9754-3366ce58e6b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:20.496759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-123d6567-53f4-437a-bcbb-1a1b30f824c5 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:20.497292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-123d6567-53f4-437a-bcbb-1a1b30f824c5 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:20.500392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-123d6567-53f4-437a-bcbb-1a1b30f824c5 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:20.505663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-123d6567-53f4-437a-bcbb-1a1b30f824c5 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:20.506241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-123d6567-53f4-437a-bcbb-1a1b30f824c5 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:20.506685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-123d6567-53f4-437a-bcbb-1a1b30f824c5 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:20.803974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-123d6567-53f4-437a-bcbb-1a1b30f824c5 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:20.820980 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-123d6567-53f4-437a-bcbb-1a1b30f824c5 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2" status: 200 len: 1272 microversion: 2.1 time: 0.354042 Aug 24 10:23:20.823839 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1490/2650] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:20 2022] GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2 => generated 1272 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:20.830030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fe5267f2-ce9f-4004-a387-7e677bf57016 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:20.830859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fe5267f2-ce9f-4004-a387-7e677bf57016 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] [instance: 98710ee1-1634-4370-b3c1-51d5df2ab889] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:20.853386 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe5267f2-ce9f-4004-a387-7e677bf57016 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:20.853895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe5267f2-ce9f-4004-a387-7e677bf57016 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:20.854434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe5267f2-ce9f-4004-a387-7e677bf57016 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:20.855253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe5267f2-ce9f-4004-a387-7e677bf57016 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:20.857571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe5267f2-ce9f-4004-a387-7e677bf57016 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:20.858134 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe5267f2-ce9f-4004-a387-7e677bf57016 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:20.918222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:21.006222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fe5267f2-ce9f-4004-a387-7e677bf57016 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b28596ad9a4f259695e4705ae02f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f539617fa0074e2fbd6aaedc8b63773f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:21.020144 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fe5267f2-ce9f-4004-a387-7e677bf57016 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] 10.222.0.85 "GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889" status: 200 len: 1282 microversion: 2.1 time: 0.194942 Aug 24 10:23:21.022221 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1491/2651] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:20 2022] GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889 => generated 1282 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:21.037215 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-71410cd9-e7ee-4e27-9a9e-6cf39cac015d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:21.038469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-71410cd9-e7ee-4e27-9a9e-6cf39cac015d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:21.054566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71410cd9-e7ee-4e27-9a9e-6cf39cac015d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:21.055670 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71410cd9-e7ee-4e27-9a9e-6cf39cac015d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:21.056748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71410cd9-e7ee-4e27-9a9e-6cf39cac015d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:21.059416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71410cd9-e7ee-4e27-9a9e-6cf39cac015d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:21.060407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71410cd9-e7ee-4e27-9a9e-6cf39cac015d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:21.062333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71410cd9-e7ee-4e27-9a9e-6cf39cac015d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:21.182082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9a1da143-9058-43ca-aa34-2804d2b5dce8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:23:21.182651 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9a1da143-9058-43ca-aa34-2804d2b5dce8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:23:21.183049 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9a1da143-9058-43ca-aa34-2804d2b5dce8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:23:21.183459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9a1da143-9058-43ca-aa34-2804d2b5dce8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:23:21.184510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9a1da143-9058-43ca-aa34-2804d2b5dce8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:23:21.200516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-71410cd9-e7ee-4e27-9a9e-6cf39cac015d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:21.221677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-71410cd9-e7ee-4e27-9a9e-6cf39cac015d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:21.224918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-71410cd9-e7ee-4e27-9a9e-6cf39cac015d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:21.227862 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-71410cd9-e7ee-4e27-9a9e-6cf39cac015d tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1604 microversion: 2.32 time: 0.202928 Aug 24 10:23:21.230373 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1492/2652] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:21 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1604 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:21.235654 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a1da143-9058-43ca-aa34-2804d2b5dce8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:21.236172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a1da143-9058-43ca-aa34-2804d2b5dce8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:21.236631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a1da143-9058-43ca-aa34-2804d2b5dce8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:21.240949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-6717d9f2-cf0e-45f9-af2b-9ca197fe8a02 req-c922943f-6c1a-46e7-8e64-c123014fbb5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a599e1a2-3ca0-4cde-b11c-ef5e069065f9", "name": "network-vif-deleted", "tag": "bb7f920a-c727-4e7e-a723-2d9a8f9a07b9"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:21.244158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a1da143-9058-43ca-aa34-2804d2b5dce8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:21.244695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a1da143-9058-43ca-aa34-2804d2b5dce8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:21.247686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a1da143-9058-43ca-aa34-2804d2b5dce8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:21.272761 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6717d9f2-cf0e-45f9-af2b-9ca197fe8a02 req-c922943f-6c1a-46e7-8e64-c123014fbb5c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:21.273837 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6717d9f2-cf0e-45f9-af2b-9ca197fe8a02 req-c922943f-6c1a-46e7-8e64-c123014fbb5c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:21.274503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6717d9f2-cf0e-45f9-af2b-9ca197fe8a02 req-c922943f-6c1a-46e7-8e64-c123014fbb5c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:21.309628 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-6717d9f2-cf0e-45f9-af2b-9ca197fe8a02 req-c922943f-6c1a-46e7-8e64-c123014fbb5c service nova] Creating event network-vif-deleted:bb7f920a-c727-4e7e-a723-2d9a8f9a07b9 for instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 on n-h1-849328-3 Aug 24 10:23:21.321814 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-6717d9f2-cf0e-45f9-af2b-9ca197fe8a02 req-c922943f-6c1a-46e7-8e64-c123014fbb5c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088198 Aug 24 10:23:21.323174 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1493/2653] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:21.325898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-9a1da143-9058-43ca-aa34-2804d2b5dce8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Getting quotas for project b324a37b01b644dfa301a561e6125672. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:23:21.337064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-9a1da143-9058-43ca-aa34-2804d2b5dce8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Getting quotas for user b49cb438da9f4b309d54bfef9fc19bda and project b324a37b01b644dfa301a561e6125672. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:23:21.363713 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9a1da143-9058-43ca-aa34-2804d2b5dce8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:23:21.369420 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9a1da143-9058-43ca-aa34-2804d2b5dce8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 56dc2f7d-cae7-4b36-81e0-594f9b5a0623] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:23:21.496421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6e0362e8-4851-4579-8d64-3e06b52255c6 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:21.497907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6e0362e8-4851-4579-8d64-3e06b52255c6 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:21.501415 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9a1da143-9058-43ca-aa34-2804d2b5dce8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.675663 Aug 24 10:23:21.502195 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1161/2654] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:23:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 3692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:23:21.520603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e0362e8-4851-4579-8d64-3e06b52255c6 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:21.521736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e0362e8-4851-4579-8d64-3e06b52255c6 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:21.523276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e0362e8-4851-4579-8d64-3e06b52255c6 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:21.524978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e0362e8-4851-4579-8d64-3e06b52255c6 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:21.530922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e0362e8-4851-4579-8d64-3e06b52255c6 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:21.531991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e0362e8-4851-4579-8d64-3e06b52255c6 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:21.563214 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-07d46312-00be-4346-a1b9-24cc9aefe6bd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:21.564215 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-07d46312-00be-4346-a1b9-24cc9aefe6bd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 56dc2f7d-cae7-4b36-81e0-594f9b5a0623] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:21.687252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e0362e8-4851-4579-8d64-3e06b52255c6 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:21.694901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e0362e8-4851-4579-8d64-3e06b52255c6 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:21.696318 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e0362e8-4851-4579-8d64-3e06b52255c6 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:21.696910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-6e0362e8-4851-4579-8d64-3e06b52255c6 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lazy-loading 'fault' on Instance uuid a599e1a2-3ca0-4cde-b11c-ef5e069065f9 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:23:21.787623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6e0362e8-4851-4579-8d64-3e06b52255c6 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:21.815673 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6e0362e8-4851-4579-8d64-3e06b52255c6 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 200 len: 1303 microversion: 2.1 time: 0.324034 Aug 24 10:23:21.837816 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1494/2655] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:21 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 1303 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:21.852501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-084334c7-d635-4e8d-90c2-3f4980585081 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:21.860394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-084334c7-d635-4e8d-90c2-3f4980585081 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: d49761ab-ce76-45fc-9754-3366ce58e6b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:21.875706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-084334c7-d635-4e8d-90c2-3f4980585081 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:21.880873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-084334c7-d635-4e8d-90c2-3f4980585081 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:21.882895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-084334c7-d635-4e8d-90c2-3f4980585081 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:21.883901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-084334c7-d635-4e8d-90c2-3f4980585081 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:21.884650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-084334c7-d635-4e8d-90c2-3f4980585081 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:21.886401 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-084334c7-d635-4e8d-90c2-3f4980585081 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:21.910822 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-07d46312-00be-4346-a1b9-24cc9aefe6bd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:21.940913 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-07d46312-00be-4346-a1b9-24cc9aefe6bd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623" status: 200 len: 1215 microversion: 2.1 time: 0.426741 Aug 24 10:23:21.944400 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1162/2656] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:21 2022] GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623 => generated 1215 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:22.043306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ef78def4-6871-41ce-ab9b-103875d9d014 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:22.044128 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ef78def4-6871-41ce-ab9b-103875d9d014 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] [instance: 98710ee1-1634-4370-b3c1-51d5df2ab889] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:22.057041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef78def4-6871-41ce-ab9b-103875d9d014 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:22.058114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef78def4-6871-41ce-ab9b-103875d9d014 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:22.058686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef78def4-6871-41ce-ab9b-103875d9d014 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:22.059695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef78def4-6871-41ce-ab9b-103875d9d014 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:22.060368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef78def4-6871-41ce-ab9b-103875d9d014 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:22.061110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef78def4-6871-41ce-ab9b-103875d9d014 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:22.117184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-084334c7-d635-4e8d-90c2-3f4980585081 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:22.132650 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-084334c7-d635-4e8d-90c2-3f4980585081 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2" status: 200 len: 1272 microversion: 2.1 time: 0.292159 Aug 24 10:23:22.151280 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1495/2657] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:21 2022] GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2 => generated 1272 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:22.262206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5d585a08-4790-4fda-9243-fa837aeb22d3 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:22.263159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5d585a08-4790-4fda-9243-fa837aeb22d3 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:22.283022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d585a08-4790-4fda-9243-fa837aeb22d3 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:22.283879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d585a08-4790-4fda-9243-fa837aeb22d3 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:22.284561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d585a08-4790-4fda-9243-fa837aeb22d3 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:22.285615 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d585a08-4790-4fda-9243-fa837aeb22d3 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:22.286850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d585a08-4790-4fda-9243-fa837aeb22d3 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:22.287459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d585a08-4790-4fda-9243-fa837aeb22d3 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:22.576697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5d585a08-4790-4fda-9243-fa837aeb22d3 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:22.589583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5d585a08-4790-4fda-9243-fa837aeb22d3 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:22.594682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5d585a08-4790-4fda-9243-fa837aeb22d3 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:22.596361 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5d585a08-4790-4fda-9243-fa837aeb22d3 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1604 microversion: 2.32 time: 0.342263 Aug 24 10:23:22.600429 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1496/2658] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:22 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1604 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:23:22.838502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a8f4122f-2e77-43ee-84d7-fdbda27fb8ef tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1634435011", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": "none"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:22.931836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a8f4122f-2e77-43ee-84d7-fdbda27fb8ef tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:23:22.932724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a8f4122f-2e77-43ee-84d7-fdbda27fb8ef tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:23:22.935696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a8f4122f-2e77-43ee-84d7-fdbda27fb8ef tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:23:22.936511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a8f4122f-2e77-43ee-84d7-fdbda27fb8ef tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:23:22.937176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a8f4122f-2e77-43ee-84d7-fdbda27fb8ef tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:23:22.952475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8f4122f-2e77-43ee-84d7-fdbda27fb8ef tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:22.953498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8f4122f-2e77-43ee-84d7-fdbda27fb8ef tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:22.954153 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8f4122f-2e77-43ee-84d7-fdbda27fb8ef tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:22.955680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8f4122f-2e77-43ee-84d7-fdbda27fb8ef tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:22.956512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8f4122f-2e77-43ee-84d7-fdbda27fb8ef tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:22.957211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8f4122f-2e77-43ee-84d7-fdbda27fb8ef tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:22.985948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ef78def4-6871-41ce-ab9b-103875d9d014 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b28596ad9a4f259695e4705ae02f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f539617fa0074e2fbd6aaedc8b63773f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:23.001246 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ef78def4-6871-41ce-ab9b-103875d9d014 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] 10.222.0.85 "GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889" status: 200 len: 1324 microversion: 2.1 time: 0.959948 Aug 24 10:23:23.005169 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1163/2659] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:22 2022] GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889 => generated 1324 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:23.017313 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-a8f4122f-2e77-43ee-84d7-fdbda27fb8ef tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Getting quotas for project 0020519f2cb541348a73961f00a80e74. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:23:23.020517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-67e4b365-7aea-4ffc-a901-4a1ffa26335b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:23.021556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-67e4b365-7aea-4ffc-a901-4a1ffa26335b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:23.026465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-a8f4122f-2e77-43ee-84d7-fdbda27fb8ef tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Getting quotas for user 3705176d7c994a55b01c4eb77a4d7ec1 and project 0020519f2cb541348a73961f00a80e74. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:23:23.044689 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67e4b365-7aea-4ffc-a901-4a1ffa26335b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:23.045249 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67e4b365-7aea-4ffc-a901-4a1ffa26335b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:23.046005 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67e4b365-7aea-4ffc-a901-4a1ffa26335b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:23.046494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67e4b365-7aea-4ffc-a901-4a1ffa26335b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:23.046940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67e4b365-7aea-4ffc-a901-4a1ffa26335b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:23.047366 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67e4b365-7aea-4ffc-a901-4a1ffa26335b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:23.064255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a8f4122f-2e77-43ee-84d7-fdbda27fb8ef tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:23:23.073349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a8f4122f-2e77-43ee-84d7-fdbda27fb8ef tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:23:23.091875 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-67e4b365-7aea-4ffc-a901-4a1ffa26335b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] HTTP exception thrown: Instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 could not be found. Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-67e4b365-7aea-4ffc-a901-4a1ffa26335b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Request method failure captured: Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 HTTP/1.1 Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfvFrrhMIS895qcNi3E08Z2aCgBtfLh_BkMMLPs4DpG9nRgLmCgu8EyCUwMhPTQGcwKO-Gw9OThM2v_iz8exI6DsU8JZHRflmopnuwnES8EioScbwlrWCk3h4yi_cgKNu7YSZCdr88-t_-mkGN2HzH5bstYwf0PNwW-60ViXVx67f98 Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: e861e247176c4ebda68404fe30c2b561 Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestMultiNic-2011698794 Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e861e247176c4ebda68404fe30c2b561"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e861e247176c4ebda68404fe30c2b561", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e861e247176c4ebda68404fe30c2b561"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e861e247176c4ebda68404fe30c2b561"}]}] Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestMultiNic-2011698794 Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: e861e247176c4ebda68404fe30c2b561 Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestMultiNic-2011698794 Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersTestMultiNic-2011698794-project Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 6878521252244be0a32ab2f056ec54c9 Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestMultiNic-2011698794-project Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 could not be found. Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'a599e1a2-3ca0-4cde-b11c-ef5e069065f9'} Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 could not be found. Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 could not be found. Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:23.099053 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:23.103327 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:23.103327 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:23.103327 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:23.103327 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:23.103327 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:23.103327 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 could not be found. Aug 24 10:23:23.103327 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:23.104842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-67e4b365-7aea-4ffc-a901-4a1ffa26335b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Returning 404 to user: Instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:23.105955 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-67e4b365-7aea-4ffc-a901-4a1ffa26335b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 404 len: 111 microversion: 2.1 time: 0.099533 Aug 24 10:23:23.111889 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1164/2660] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:23 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:23:23.118626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-65d68e39-372e-4dcc-bef5-a00ab3458bbd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:23.125253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-65d68e39-372e-4dcc-bef5-a00ab3458bbd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 56dc2f7d-cae7-4b36-81e0-594f9b5a0623] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:23.135736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65d68e39-372e-4dcc-bef5-a00ab3458bbd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:23.150817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65d68e39-372e-4dcc-bef5-a00ab3458bbd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:23.151780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65d68e39-372e-4dcc-bef5-a00ab3458bbd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:23.154548 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65d68e39-372e-4dcc-bef5-a00ab3458bbd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:23.155403 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65d68e39-372e-4dcc-bef5-a00ab3458bbd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:23.156592 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65d68e39-372e-4dcc-bef5-a00ab3458bbd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:23.232519 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a8f4122f-2e77-43ee-84d7-fdbda27fb8ef tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.629606 Aug 24 10:23:23.237226 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1497/2661] 10.222.0.85 () {62 vars in 1188 bytes} [Wed Aug 24 10:23:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 10:23:23.252231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1b9765e5-cd46-4095-aac2-af7d2283b684 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:23.253769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1b9765e5-cd46-4095-aac2-af7d2283b684 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: d49761ab-ce76-45fc-9754-3366ce58e6b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:23.270790 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b9765e5-cd46-4095-aac2-af7d2283b684 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:23.271374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b9765e5-cd46-4095-aac2-af7d2283b684 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:23.273535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b9765e5-cd46-4095-aac2-af7d2283b684 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:23.273535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b9765e5-cd46-4095-aac2-af7d2283b684 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:23.274353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b9765e5-cd46-4095-aac2-af7d2283b684 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:23.274839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b9765e5-cd46-4095-aac2-af7d2283b684 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:23.376236 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-65d68e39-372e-4dcc-bef5-a00ab3458bbd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:23.387102 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-65d68e39-372e-4dcc-bef5-a00ab3458bbd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623" status: 200 len: 1267 microversion: 2.1 time: 0.273764 Aug 24 10:23:23.390416 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1165/2662] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:23 2022] GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623 => generated 1267 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:23.396657 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-15ee3198-24a6-4b10-99a1-ea0365e3d413 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:23.397716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-15ee3198-24a6-4b10-99a1-ea0365e3d413 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:23.685386 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-15ee3198-24a6-4b10-99a1-ea0365e3d413 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:23.715660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-15ee3198-24a6-4b10-99a1-ea0365e3d413 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:23.723425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-15ee3198-24a6-4b10-99a1-ea0365e3d413 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:23.731475 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-15ee3198-24a6-4b10-99a1-ea0365e3d413 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1278 microversion: 2.54 time: 0.335779 Aug 24 10:23:23.734605 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1166/2663] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:23 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1278 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:23.755440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-019a33e7-ac65-4aa8-b7f5-55348927712c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:23.757658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-019a33e7-ac65-4aa8-b7f5-55348927712c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:23.783360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-019a33e7-ac65-4aa8-b7f5-55348927712c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:23.788151 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-019a33e7-ac65-4aa8-b7f5-55348927712c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:23.788889 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-019a33e7-ac65-4aa8-b7f5-55348927712c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:23.789935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-019a33e7-ac65-4aa8-b7f5-55348927712c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:23.790800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-019a33e7-ac65-4aa8-b7f5-55348927712c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:23.791505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-019a33e7-ac65-4aa8-b7f5-55348927712c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:23.987384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-019a33e7-ac65-4aa8-b7f5-55348927712c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:24.017441 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-019a33e7-ac65-4aa8-b7f5-55348927712c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:24.019543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-019a33e7-ac65-4aa8-b7f5-55348927712c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:24.021078 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-019a33e7-ac65-4aa8-b7f5-55348927712c tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1604 microversion: 2.32 time: 0.283563 Aug 24 10:23:24.022332 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1167/2664] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:23 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1604 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:24.043052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0211c583-c008-4ee3-a34f-430f486409c3 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:24.047125 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0211c583-c008-4ee3-a34f-430f486409c3 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] [instance: 98710ee1-1634-4370-b3c1-51d5df2ab889] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:24.069926 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0211c583-c008-4ee3-a34f-430f486409c3 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:24.070950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0211c583-c008-4ee3-a34f-430f486409c3 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:24.071642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0211c583-c008-4ee3-a34f-430f486409c3 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:24.098311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0211c583-c008-4ee3-a34f-430f486409c3 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:24.099183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0211c583-c008-4ee3-a34f-430f486409c3 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:24.100576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0211c583-c008-4ee3-a34f-430f486409c3 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:24.169552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:24.350590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1b9765e5-cd46-4095-aac2-af7d2283b684 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:24.361889 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1b9765e5-cd46-4095-aac2-af7d2283b684 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2" status: 200 len: 1314 microversion: 2.1 time: 1.123123 Aug 24 10:23:24.367993 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1498/2665] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:23 2022] GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2 => generated 1314 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:24.411052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bd1e19fe-fa79-4805-86e1-e75b1ef093fe tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:24.411688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bd1e19fe-fa79-4805-86e1-e75b1ef093fe tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 56dc2f7d-cae7-4b36-81e0-594f9b5a0623] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:24.425241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd1e19fe-fa79-4805-86e1-e75b1ef093fe tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:24.428545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd1e19fe-fa79-4805-86e1-e75b1ef093fe tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:24.429279 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd1e19fe-fa79-4805-86e1-e75b1ef093fe tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:24.430827 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd1e19fe-fa79-4805-86e1-e75b1ef093fe tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:24.434371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd1e19fe-fa79-4805-86e1-e75b1ef093fe tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:24.435047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd1e19fe-fa79-4805-86e1-e75b1ef093fe tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:24.866717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bd1e19fe-fa79-4805-86e1-e75b1ef093fe tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:24.882736 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bd1e19fe-fa79-4805-86e1-e75b1ef093fe tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623" status: 200 len: 1273 microversion: 2.1 time: 0.473974 Aug 24 10:23:24.897974 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1499/2666] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:24 2022] GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623 => generated 1273 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:24.915874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-04fe1102-7b75-407f-acb0-6981bf838669 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:24.921837 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-04fe1102-7b75-407f-acb0-6981bf838669 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:24.935286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04fe1102-7b75-407f-acb0-6981bf838669 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:24.938386 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04fe1102-7b75-407f-acb0-6981bf838669 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:24.938873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04fe1102-7b75-407f-acb0-6981bf838669 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:24.940012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04fe1102-7b75-407f-acb0-6981bf838669 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:24.946379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04fe1102-7b75-407f-acb0-6981bf838669 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:24.947011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04fe1102-7b75-407f-acb0-6981bf838669 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:25.222696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-04fe1102-7b75-407f-acb0-6981bf838669 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:25.266740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-04fe1102-7b75-407f-acb0-6981bf838669 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:25.268507 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-04fe1102-7b75-407f-acb0-6981bf838669 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:25.269834 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-04fe1102-7b75-407f-acb0-6981bf838669 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1330 microversion: 2.54 time: 0.368835 Aug 24 10:23:25.270560 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1500/2667] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:24 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1330 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:25.290994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9c31a69a-6e4a-4d07-b736-1c3e129a8fe0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:25.296848 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9c31a69a-6e4a-4d07-b736-1c3e129a8fe0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:25.318201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c31a69a-6e4a-4d07-b736-1c3e129a8fe0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:25.325677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c31a69a-6e4a-4d07-b736-1c3e129a8fe0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:25.334014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c31a69a-6e4a-4d07-b736-1c3e129a8fe0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:25.335069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c31a69a-6e4a-4d07-b736-1c3e129a8fe0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:25.335735 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c31a69a-6e4a-4d07-b736-1c3e129a8fe0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:25.336520 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c31a69a-6e4a-4d07-b736-1c3e129a8fe0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:25.494898 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9c31a69a-6e4a-4d07-b736-1c3e129a8fe0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:25.513855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9c31a69a-6e4a-4d07-b736-1c3e129a8fe0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:25.519980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9c31a69a-6e4a-4d07-b736-1c3e129a8fe0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:25.525968 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9c31a69a-6e4a-4d07-b736-1c3e129a8fe0 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1604 microversion: 2.32 time: 0.248306 Aug 24 10:23:25.526985 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1501/2668] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:25 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1604 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:25.537318 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-80db7b7d-fdfa-4781-9ba4-8b04d0aef51e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:25.537936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-80db7b7d-fdfa-4781-9ba4-8b04d0aef51e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: d49761ab-ce76-45fc-9754-3366ce58e6b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:25.554033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80db7b7d-fdfa-4781-9ba4-8b04d0aef51e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:25.555458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80db7b7d-fdfa-4781-9ba4-8b04d0aef51e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:25.556558 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80db7b7d-fdfa-4781-9ba4-8b04d0aef51e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:25.556690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80db7b7d-fdfa-4781-9ba4-8b04d0aef51e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:25.557148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80db7b7d-fdfa-4781-9ba4-8b04d0aef51e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:25.565986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80db7b7d-fdfa-4781-9ba4-8b04d0aef51e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:25.644062 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0211c583-c008-4ee3-a34f-430f486409c3 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b28596ad9a4f259695e4705ae02f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f539617fa0074e2fbd6aaedc8b63773f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:25.662652 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0211c583-c008-4ee3-a34f-430f486409c3 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] 10.222.0.85 "GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889" status: 200 len: 1324 microversion: 2.1 time: 1.635642 Aug 24 10:23:25.665473 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1168/2669] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:24 2022] GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889 => generated 1324 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:25.908346 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c6aa0741-1127-4f6d-8b4c-30b1e1431644 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:25.908997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c6aa0741-1127-4f6d-8b4c-30b1e1431644 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 56dc2f7d-cae7-4b36-81e0-594f9b5a0623] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:25.921685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6aa0741-1127-4f6d-8b4c-30b1e1431644 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:25.922198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6aa0741-1127-4f6d-8b4c-30b1e1431644 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:25.922647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6aa0741-1127-4f6d-8b4c-30b1e1431644 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:25.923411 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6aa0741-1127-4f6d-8b4c-30b1e1431644 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:25.923880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6aa0741-1127-4f6d-8b4c-30b1e1431644 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:25.924313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6aa0741-1127-4f6d-8b4c-30b1e1431644 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:26.374046 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c6aa0741-1127-4f6d-8b4c-30b1e1431644 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:26.389873 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c6aa0741-1127-4f6d-8b4c-30b1e1431644 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623" status: 200 len: 1273 microversion: 2.1 time: 0.484573 Aug 24 10:23:26.392695 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1169/2670] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:25 2022] GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623 => generated 1273 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:26.407384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-710d52fe-c563-4840-a59f-87fe80f38caa tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:26.412220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-710d52fe-c563-4840-a59f-87fe80f38caa tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:26.434745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-710d52fe-c563-4840-a59f-87fe80f38caa tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:26.436838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-710d52fe-c563-4840-a59f-87fe80f38caa tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:26.438654 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-710d52fe-c563-4840-a59f-87fe80f38caa tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:26.443070 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-710d52fe-c563-4840-a59f-87fe80f38caa tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:26.444178 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-710d52fe-c563-4840-a59f-87fe80f38caa tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:26.448686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-710d52fe-c563-4840-a59f-87fe80f38caa tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:26.807920 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-710d52fe-c563-4840-a59f-87fe80f38caa tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:26.828179 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-710d52fe-c563-4840-a59f-87fe80f38caa tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:26.830982 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-710d52fe-c563-4840-a59f-87fe80f38caa tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:26.833060 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-710d52fe-c563-4840-a59f-87fe80f38caa tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1336 microversion: 2.54 time: 0.438569 Aug 24 10:23:26.845325 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1170/2671] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:26 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1336 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:26.850844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9557d0ce-1b33-4ca0-a17d-51ef329074c8 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:26.851773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9557d0ce-1b33-4ca0-a17d-51ef329074c8 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:26.874253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9557d0ce-1b33-4ca0-a17d-51ef329074c8 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:26.874881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9557d0ce-1b33-4ca0-a17d-51ef329074c8 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:26.880419 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9557d0ce-1b33-4ca0-a17d-51ef329074c8 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:26.881658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9557d0ce-1b33-4ca0-a17d-51ef329074c8 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:26.882296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9557d0ce-1b33-4ca0-a17d-51ef329074c8 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:26.882883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9557d0ce-1b33-4ca0-a17d-51ef329074c8 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:26.979534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-80db7b7d-fdfa-4781-9ba4-8b04d0aef51e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:26.988388 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-80db7b7d-fdfa-4781-9ba4-8b04d0aef51e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2" status: 200 len: 1314 microversion: 2.1 time: 1.460170 Aug 24 10:23:26.994646 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1502/2672] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:25 2022] GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2 => generated 1314 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:27.009406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1415cae4-d40b-44a2-8e95-a99d4e90c727 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:27.011655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1415cae4-d40b-44a2-8e95-a99d4e90c727 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] [instance: 98710ee1-1634-4370-b3c1-51d5df2ab889] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:27.016376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9557d0ce-1b33-4ca0-a17d-51ef329074c8 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:27.028482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1415cae4-d40b-44a2-8e95-a99d4e90c727 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:27.029002 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1415cae4-d40b-44a2-8e95-a99d4e90c727 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:27.029912 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9557d0ce-1b33-4ca0-a17d-51ef329074c8 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:27.030682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1415cae4-d40b-44a2-8e95-a99d4e90c727 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:27.033016 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1415cae4-d40b-44a2-8e95-a99d4e90c727 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:27.033994 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9557d0ce-1b33-4ca0-a17d-51ef329074c8 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:27.036217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1415cae4-d40b-44a2-8e95-a99d4e90c727 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:27.036905 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9557d0ce-1b33-4ca0-a17d-51ef329074c8 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1604 microversion: 2.32 time: 0.190015 Aug 24 10:23:27.038101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1415cae4-d40b-44a2-8e95-a99d4e90c727 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:27.038500 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1171/2673] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:26 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1604 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:27.196279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e813868c-c1e9-4237-b43d-2caa375b0754 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5908397a-3f30-4873-86f6-4567c4fef350"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:27.198799 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e813868c-c1e9-4237-b43d-2caa375b0754 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:27.206816 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e813868c-c1e9-4237-b43d-2caa375b0754 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:27.207309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e813868c-c1e9-4237-b43d-2caa375b0754 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:27.207794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e813868c-c1e9-4237-b43d-2caa375b0754 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:27.208681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e813868c-c1e9-4237-b43d-2caa375b0754 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:27.209450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e813868c-c1e9-4237-b43d-2caa375b0754 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:27.210711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e813868c-c1e9-4237-b43d-2caa375b0754 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:27.759558 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e813868c-c1e9-4237-b43d-2caa375b0754 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "POST /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.567310 Aug 24 10:23:27.761433 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1172/2674] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Aug 24 10:23:27 2022] POST /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08/os-volume_attachments => generated 194 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:27.817764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-19e12aa7-eb63-47d8-802a-78b2675beb90 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:27.854646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-19e12aa7-eb63-47d8-802a-78b2675beb90 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 56dc2f7d-cae7-4b36-81e0-594f9b5a0623] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:27.870655 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19e12aa7-eb63-47d8-802a-78b2675beb90 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:27.871167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19e12aa7-eb63-47d8-802a-78b2675beb90 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:27.871613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19e12aa7-eb63-47d8-802a-78b2675beb90 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:27.872362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19e12aa7-eb63-47d8-802a-78b2675beb90 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:27.872823 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19e12aa7-eb63-47d8-802a-78b2675beb90 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:27.878285 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19e12aa7-eb63-47d8-802a-78b2675beb90 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:27.907617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1415cae4-d40b-44a2-8e95-a99d4e90c727 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b28596ad9a4f259695e4705ae02f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f539617fa0074e2fbd6aaedc8b63773f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:27.934129 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1415cae4-d40b-44a2-8e95-a99d4e90c727 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] 10.222.0.85 "GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889" status: 200 len: 1324 microversion: 2.1 time: 0.936870 Aug 24 10:23:27.937757 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1503/2675] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:26 2022] GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889 => generated 1324 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:27.953549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a67e223e-c6d0-477a-bcf9-22310ce21b68 req-1337f92f-dcc2-41ed-b4ad-cae7041b18af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d49761ab-ce76-45fc-9754-3366ce58e6b2", "tag": "29f51102-f85d-465a-b06a-dc1cf699dbf4"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:27.976092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a67e223e-c6d0-477a-bcf9-22310ce21b68 req-1337f92f-dcc2-41ed-b4ad-cae7041b18af service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:27.977074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a67e223e-c6d0-477a-bcf9-22310ce21b68 req-1337f92f-dcc2-41ed-b4ad-cae7041b18af service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:27.978423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a67e223e-c6d0-477a-bcf9-22310ce21b68 req-1337f92f-dcc2-41ed-b4ad-cae7041b18af service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:28.017060 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a67e223e-c6d0-477a-bcf9-22310ce21b68 req-1337f92f-dcc2-41ed-b4ad-cae7041b18af service nova] Creating event network-changed:29f51102-f85d-465a-b06a-dc1cf699dbf4 for instance d49761ab-ce76-45fc-9754-3366ce58e6b2 on n-h1-849328-3 Aug 24 10:23:28.035095 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a67e223e-c6d0-477a-bcf9-22310ce21b68 req-1337f92f-dcc2-41ed-b4ad-cae7041b18af service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094105 Aug 24 10:23:28.038514 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1504/2676] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:28.046861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-90bbadf8-4220-4d04-9686-74a48378ed4e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:28.054883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-90bbadf8-4220-4d04-9686-74a48378ed4e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:28.077039 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90bbadf8-4220-4d04-9686-74a48378ed4e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:28.083961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90bbadf8-4220-4d04-9686-74a48378ed4e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:28.085407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90bbadf8-4220-4d04-9686-74a48378ed4e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:28.089787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90bbadf8-4220-4d04-9686-74a48378ed4e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:28.090826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90bbadf8-4220-4d04-9686-74a48378ed4e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:28.091429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90bbadf8-4220-4d04-9686-74a48378ed4e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:28.383138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-90bbadf8-4220-4d04-9686-74a48378ed4e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:28.405753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-90bbadf8-4220-4d04-9686-74a48378ed4e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:28.408607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-90bbadf8-4220-4d04-9686-74a48378ed4e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:28.419599 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-90bbadf8-4220-4d04-9686-74a48378ed4e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1336 microversion: 2.54 time: 0.374324 Aug 24 10:23:28.442849 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1505/2677] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:28 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1336 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:28.461790 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-69b91b74-65f2-4ec0-8fec-5105e7ea5a4c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:28.462730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-69b91b74-65f2-4ec0-8fec-5105e7ea5a4c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: d49761ab-ce76-45fc-9754-3366ce58e6b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:28.478627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69b91b74-65f2-4ec0-8fec-5105e7ea5a4c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:28.481933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69b91b74-65f2-4ec0-8fec-5105e7ea5a4c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:28.482777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69b91b74-65f2-4ec0-8fec-5105e7ea5a4c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:28.484639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69b91b74-65f2-4ec0-8fec-5105e7ea5a4c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:28.485788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69b91b74-65f2-4ec0-8fec-5105e7ea5a4c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:28.492603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69b91b74-65f2-4ec0-8fec-5105e7ea5a4c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:28.528728 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-19e12aa7-eb63-47d8-802a-78b2675beb90 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:28.573250 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-19e12aa7-eb63-47d8-802a-78b2675beb90 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623" status: 200 len: 1273 microversion: 2.1 time: 0.806671 Aug 24 10:23:28.581254 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1173/2678] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:27 2022] GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623 => generated 1273 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:28.590127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d289dc69-8dde-4b37-bc62-e13310bf25f1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:28.590920 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d289dc69-8dde-4b37-bc62-e13310bf25f1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:28.606262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d289dc69-8dde-4b37-bc62-e13310bf25f1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:28.606926 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d289dc69-8dde-4b37-bc62-e13310bf25f1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:28.607496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d289dc69-8dde-4b37-bc62-e13310bf25f1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:28.609075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d289dc69-8dde-4b37-bc62-e13310bf25f1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:28.609758 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d289dc69-8dde-4b37-bc62-e13310bf25f1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:28.610294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d289dc69-8dde-4b37-bc62-e13310bf25f1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:28.648561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:28.655295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d289dc69-8dde-4b37-bc62-e13310bf25f1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:28.656113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d289dc69-8dde-4b37-bc62-e13310bf25f1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:28.656794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d289dc69-8dde-4b37-bc62-e13310bf25f1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:28.657491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-d289dc69-8dde-4b37-bc62-e13310bf25f1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lazy-loading 'fault' on Instance uuid 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:23:28.815200 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d289dc69-8dde-4b37-bc62-e13310bf25f1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:28.870787 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d289dc69-8dde-4b37-bc62-e13310bf25f1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:28.891467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d289dc69-8dde-4b37-bc62-e13310bf25f1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24e6810543444048cf6e0871f5521eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad01394db2334c029874ee8e14e227f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:28.897574 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d289dc69-8dde-4b37-bc62-e13310bf25f1 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 200 len: 1609 microversion: 2.32 time: 0.317044 Aug 24 10:23:28.903733 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1174/2679] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:28 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 1609 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:28.923108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-69b91b74-65f2-4ec0-8fec-5105e7ea5a4c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:28.943897 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-69b91b74-65f2-4ec0-8fec-5105e7ea5a4c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2" status: 200 len: 1314 microversion: 2.1 time: 0.499148 Aug 24 10:23:28.945072 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1506/2680] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:28 2022] GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2 => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:28.962126 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ef2be154-3fc4-4c5f-b56d-ec51c9dda20a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:28.963489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ef2be154-3fc4-4c5f-b56d-ec51c9dda20a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] [instance: 98710ee1-1634-4370-b3c1-51d5df2ab889] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:28.974091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef2be154-3fc4-4c5f-b56d-ec51c9dda20a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:28.975129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef2be154-3fc4-4c5f-b56d-ec51c9dda20a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:28.976044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef2be154-3fc4-4c5f-b56d-ec51c9dda20a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:28.977396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef2be154-3fc4-4c5f-b56d-ec51c9dda20a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:28.978314 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef2be154-3fc4-4c5f-b56d-ec51c9dda20a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:28.979168 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef2be154-3fc4-4c5f-b56d-ec51c9dda20a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:29.450041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8c9d4f2d-5b9f-4d98-8330-caec94ab3067 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:29.451303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8c9d4f2d-5b9f-4d98-8330-caec94ab3067 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:29.462217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c9d4f2d-5b9f-4d98-8330-caec94ab3067 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:29.468876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c9d4f2d-5b9f-4d98-8330-caec94ab3067 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:29.469653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c9d4f2d-5b9f-4d98-8330-caec94ab3067 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:29.470562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c9d4f2d-5b9f-4d98-8330-caec94ab3067 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:29.471237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c9d4f2d-5b9f-4d98-8330-caec94ab3067 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:29.474042 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c9d4f2d-5b9f-4d98-8330-caec94ab3067 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:29.662430 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8c9d4f2d-5b9f-4d98-8330-caec94ab3067 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:29.678665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8c9d4f2d-5b9f-4d98-8330-caec94ab3067 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:29.701054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8c9d4f2d-5b9f-4d98-8330-caec94ab3067 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:29.706764 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8c9d4f2d-5b9f-4d98-8330-caec94ab3067 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1357 microversion: 2.54 time: 0.262152 Aug 24 10:23:29.709299 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1507/2681] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:29 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1357 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:29.717499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4d3a6aef-2ae9-4017-afe4-68234e8926a5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:29.718558 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4d3a6aef-2ae9-4017-afe4-68234e8926a5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 56dc2f7d-cae7-4b36-81e0-594f9b5a0623] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:29.735615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ef2be154-3fc4-4c5f-b56d-ec51c9dda20a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b28596ad9a4f259695e4705ae02f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f539617fa0074e2fbd6aaedc8b63773f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:29.751166 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ef2be154-3fc4-4c5f-b56d-ec51c9dda20a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] 10.222.0.85 "GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889" status: 200 len: 1324 microversion: 2.1 time: 0.791772 Aug 24 10:23:29.752756 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1175/2682] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:28 2022] GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889 => generated 1324 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:29.757813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e665e041-6995-4787-b209-35862eeea4c4 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Action: 'create', calling method: .version_select at 0x7f4654d8aee0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-638569797", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7YaZbZDsgBrvNV3LgnvL/Wv3zM/wpmUZyZNr8eS1xWm4x7Cbj2s+Ps2e3XDgyAq6F1tAIEQMhWbKvS3CJ146aE7V2R7ga5qcEphZTwwqZFdcGlhmQTDf5/fRj7KXKSoA=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:29.783755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d3a6aef-2ae9-4017-afe4-68234e8926a5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:29.785726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d3a6aef-2ae9-4017-afe4-68234e8926a5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:29.786182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d3a6aef-2ae9-4017-afe4-68234e8926a5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:29.793003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d3a6aef-2ae9-4017-afe4-68234e8926a5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:29.795535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d3a6aef-2ae9-4017-afe4-68234e8926a5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:29.795994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d3a6aef-2ae9-4017-afe4-68234e8926a5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:29.809637 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-e665e041-6995-4787-b209-35862eeea4c4 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Getting quotas for project 0020519f2cb541348a73961f00a80e74. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:23:29.822428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-e665e041-6995-4787-b209-35862eeea4c4 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Getting quotas for user 3705176d7c994a55b01c4eb77a4d7ec1 and project 0020519f2cb541348a73961f00a80e74. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:23:29.891542 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e665e041-6995-4787-b209-35862eeea4c4 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.137231 Aug 24 10:23:29.893103 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1176/2683] 10.222.0.85 () {62 vars in 1200 bytes} [Wed Aug 24 10:23:29 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 140 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 10:23:29.904433 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d0d3a38-b0c6-4c67-8108-90b0e51ec203 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-638569797", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:29.907368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9d0d3a38-b0c6-4c67-8108-90b0e51ec203 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:29.914370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d0d3a38-b0c6-4c67-8108-90b0e51ec203 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:29.914862 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d0d3a38-b0c6-4c67-8108-90b0e51ec203 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:29.915299 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d0d3a38-b0c6-4c67-8108-90b0e51ec203 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:29.916039 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d0d3a38-b0c6-4c67-8108-90b0e51ec203 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:29.916615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d0d3a38-b0c6-4c67-8108-90b0e51ec203 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:29.916910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d0d3a38-b0c6-4c67-8108-90b0e51ec203 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:30.021940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9d0d3a38-b0c6-4c67-8108-90b0e51ec203 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:23:30.022565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9d0d3a38-b0c6-4c67-8108-90b0e51ec203 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:23:30.023244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9d0d3a38-b0c6-4c67-8108-90b0e51ec203 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:23:30.023862 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9d0d3a38-b0c6-4c67-8108-90b0e51ec203 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:23:30.024474 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9d0d3a38-b0c6-4c67-8108-90b0e51ec203 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:23:30.155826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9d0d3a38-b0c6-4c67-8108-90b0e51ec203 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:30.164847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d0d3a38-b0c6-4c67-8108-90b0e51ec203 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:30.165503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d0d3a38-b0c6-4c67-8108-90b0e51ec203 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:30.166112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d0d3a38-b0c6-4c67-8108-90b0e51ec203 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:30.167080 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d0d3a38-b0c6-4c67-8108-90b0e51ec203 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:30.167641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d0d3a38-b0c6-4c67-8108-90b0e51ec203 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:30.168490 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d0d3a38-b0c6-4c67-8108-90b0e51ec203 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:30.242709 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9d0d3a38-b0c6-4c67-8108-90b0e51ec203 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "POST /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400/action" status: 202 len: 1139 microversion: 2.54 time: 0.338866 Aug 24 10:23:30.244465 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1177/2684] 10.222.0.85 () {62 vars in 1320 bytes} [Wed Aug 24 10:23:29 2022] POST /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400/action => generated 1139 bytes in 345 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 24 10:23:30.274431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a0845a9b-36a9-453f-9d88-23f827dbad83 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:30.275733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a0845a9b-36a9-453f-9d88-23f827dbad83 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:30.294161 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0845a9b-36a9-453f-9d88-23f827dbad83 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:30.294795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0845a9b-36a9-453f-9d88-23f827dbad83 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:30.295335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0845a9b-36a9-453f-9d88-23f827dbad83 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:30.296219 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0845a9b-36a9-453f-9d88-23f827dbad83 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:30.296899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0845a9b-36a9-453f-9d88-23f827dbad83 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:30.297622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0845a9b-36a9-453f-9d88-23f827dbad83 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:30.340828 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4d3a6aef-2ae9-4017-afe4-68234e8926a5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:30.354947 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4d3a6aef-2ae9-4017-afe4-68234e8926a5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623" status: 200 len: 1315 microversion: 2.1 time: 0.638174 Aug 24 10:23:30.355954 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1508/2685] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:29 2022] GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623 => generated 1315 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:30.366302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-195e36e5-7e1c-4d75-87db-7f94217d9f1e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:30.367968 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-195e36e5-7e1c-4d75-87db-7f94217d9f1e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: d49761ab-ce76-45fc-9754-3366ce58e6b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:30.388493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-195e36e5-7e1c-4d75-87db-7f94217d9f1e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:30.389329 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-195e36e5-7e1c-4d75-87db-7f94217d9f1e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:30.390541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-195e36e5-7e1c-4d75-87db-7f94217d9f1e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:30.392707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-195e36e5-7e1c-4d75-87db-7f94217d9f1e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:30.395243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-195e36e5-7e1c-4d75-87db-7f94217d9f1e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:30.395828 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-195e36e5-7e1c-4d75-87db-7f94217d9f1e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:30.436298 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-a0845a9b-36a9-453f-9d88-23f827dbad83 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] HTTP exception thrown: Instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd could not be found. Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a0845a9b-36a9-453f-9d88-23f827dbad83 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Request method failure captured: Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd HTTP/1.1 Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfpn5r3-bo_-ekPZ3CYv5IFBdhoWsZG0PMk5rwR0Vo_3wxwSH0k1LCm6Wp9yUn-uTRvcvzTrnZjRNPB_ytyGyOHNN0Yvkmhn8kQX-PM3AyYOjgAGs9JopVpFP_srSJtubcdVQplbwLeyMLcOK5A_odnbCcvRMgtSMlXRHEwTB-v6uPA Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: X-Openstack-Nova-Api-Version: 2.32 Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: ad01394db2334c029874ee8e14e227f5 Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-TaggedBootDevicesTest-957457665 Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ad01394db2334c029874ee8e14e227f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_ad01394db2334c029874ee8e14e227f5", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ad01394db2334c029874ee8e14e227f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/ad01394db2334c029874ee8e14e227f5"}]}] Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-TaggedBootDevicesTest-957457665 Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: ad01394db2334c029874ee8e14e227f5 Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TaggedBootDevicesTest-957457665 Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-TaggedBootDevicesTest-957457665-project Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: b24e6810543444048cf6e0871f5521eb Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-TaggedBootDevicesTest-957457665-project Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd could not be found. Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd'} Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd could not be found. Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd could not be found. Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:30.448439 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:30.453309 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:30.453309 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:30.453309 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:30.453309 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:30.453309 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:30.453309 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd could not be found. Aug 24 10:23:30.453309 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:30.453309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a0845a9b-36a9-453f-9d88-23f827dbad83 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Returning 404 to user: Instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:30.455500 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a0845a9b-36a9-453f-9d88-23f827dbad83 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 404 len: 111 microversion: 2.32 time: 0.195623 Aug 24 10:23:30.456984 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1178/2686] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:30 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 111 bytes in 212 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:23:30.468485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-f22d3254-c4d3-4ae7-9b41-ed3fbb4d9335 req-57d222e7-57f9-4101-88ce-7692d30ef803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98710ee1-1634-4370-b3c1-51d5df2ab889", "tag": "a56be047-3952-434f-bd82-2ed9c4c0e56a"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:30.508964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f22d3254-c4d3-4ae7-9b41-ed3fbb4d9335 req-57d222e7-57f9-4101-88ce-7692d30ef803 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:30.510125 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f22d3254-c4d3-4ae7-9b41-ed3fbb4d9335 req-57d222e7-57f9-4101-88ce-7692d30ef803 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:30.516223 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f22d3254-c4d3-4ae7-9b41-ed3fbb4d9335 req-57d222e7-57f9-4101-88ce-7692d30ef803 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:30.566084 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-f22d3254-c4d3-4ae7-9b41-ed3fbb4d9335 req-57d222e7-57f9-4101-88ce-7692d30ef803 service nova] Creating event network-changed:a56be047-3952-434f-bd82-2ed9c4c0e56a for instance 98710ee1-1634-4370-b3c1-51d5df2ab889 on n-h2-849328-3 Aug 24 10:23:30.577642 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-f22d3254-c4d3-4ae7-9b41-ed3fbb4d9335 req-57d222e7-57f9-4101-88ce-7692d30ef803 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117633 Aug 24 10:23:30.579473 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1179/2687] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:30.590134 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0cffe804-40f6-4dc7-a080-7feb39893011 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:30.592171 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0cffe804-40f6-4dc7-a080-7feb39893011 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:30.606617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cffe804-40f6-4dc7-a080-7feb39893011 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:30.607456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cffe804-40f6-4dc7-a080-7feb39893011 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:30.608534 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cffe804-40f6-4dc7-a080-7feb39893011 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:30.609781 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cffe804-40f6-4dc7-a080-7feb39893011 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:30.611396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cffe804-40f6-4dc7-a080-7feb39893011 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:30.612110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cffe804-40f6-4dc7-a080-7feb39893011 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:30.700381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-195e36e5-7e1c-4d75-87db-7f94217d9f1e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:30.704945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:30.711763 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-195e36e5-7e1c-4d75-87db-7f94217d9f1e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2" status: 200 len: 1314 microversion: 2.1 time: 0.354459 Aug 24 10:23:30.713782 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1509/2688] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:30 2022] GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:30.720212 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-84c13c78-4f68-4a1f-bba6-e9640a1c208f tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '.version_select at 0x7f4654688280>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:30.754447 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-84c13c78-4f68-4a1f-bba6-e9640a1c208f tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1656422405" status: 204 len: 0 microversion: 2.32 time: 0.039369 Aug 24 10:23:30.755351 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1510/2689] 10.222.0.85 () {60 vars in 1262 bytes} [Wed Aug 24 10:23:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1656422405 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:23:30.776009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-23a6270e-0ed3-46a1-99e9-16db192072e1 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:30.776890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-23a6270e-0ed3-46a1-99e9-16db192072e1 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] [instance: 98710ee1-1634-4370-b3c1-51d5df2ab889] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:30.787923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23a6270e-0ed3-46a1-99e9-16db192072e1 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:30.788669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23a6270e-0ed3-46a1-99e9-16db192072e1 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:30.789361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23a6270e-0ed3-46a1-99e9-16db192072e1 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:30.790254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23a6270e-0ed3-46a1-99e9-16db192072e1 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:30.790874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23a6270e-0ed3-46a1-99e9-16db192072e1 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:30.791455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23a6270e-0ed3-46a1-99e9-16db192072e1 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:30.893617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0cffe804-40f6-4dc7-a080-7feb39893011 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:30.910108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0cffe804-40f6-4dc7-a080-7feb39893011 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:30.912723 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0cffe804-40f6-4dc7-a080-7feb39893011 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:30.914293 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0cffe804-40f6-4dc7-a080-7feb39893011 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1408 microversion: 2.54 time: 0.333200 Aug 24 10:23:30.915402 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1180/2690] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:30 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1408 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:31.376868 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e8a163b3-5217-45ba-ad3e-e20acdd0ab18 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:31.377885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e8a163b3-5217-45ba-ad3e-e20acdd0ab18 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 56dc2f7d-cae7-4b36-81e0-594f9b5a0623] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:31.380710 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:31.393465 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8a163b3-5217-45ba-ad3e-e20acdd0ab18 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:31.396331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8a163b3-5217-45ba-ad3e-e20acdd0ab18 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:31.397153 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8a163b3-5217-45ba-ad3e-e20acdd0ab18 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:31.400038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8a163b3-5217-45ba-ad3e-e20acdd0ab18 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:31.400784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8a163b3-5217-45ba-ad3e-e20acdd0ab18 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:31.402069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8a163b3-5217-45ba-ad3e-e20acdd0ab18 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:31.447210 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-23a6270e-0ed3-46a1-99e9-16db192072e1 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b28596ad9a4f259695e4705ae02f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f539617fa0074e2fbd6aaedc8b63773f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:31.459454 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-23a6270e-0ed3-46a1-99e9-16db192072e1 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] 10.222.0.85 "GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889" status: 200 len: 1324 microversion: 2.1 time: 0.687335 Aug 24 10:23:31.473741 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1511/2691] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:30 2022] GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889 => generated 1324 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:23:31.751077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b17cb940-df7f-40e4-abb3-045dd5cf9ea5 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:31.751751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b17cb940-df7f-40e4-abb3-045dd5cf9ea5 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: d49761ab-ce76-45fc-9754-3366ce58e6b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:31.765672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b17cb940-df7f-40e4-abb3-045dd5cf9ea5 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:31.766174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b17cb940-df7f-40e4-abb3-045dd5cf9ea5 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:31.768394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b17cb940-df7f-40e4-abb3-045dd5cf9ea5 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:31.769688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b17cb940-df7f-40e4-abb3-045dd5cf9ea5 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:31.771289 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b17cb940-df7f-40e4-abb3-045dd5cf9ea5 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:31.771872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b17cb940-df7f-40e4-abb3-045dd5cf9ea5 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:32.035942 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b17cb940-df7f-40e4-abb3-045dd5cf9ea5 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:32.047871 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b17cb940-df7f-40e4-abb3-045dd5cf9ea5 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2" status: 200 len: 1314 microversion: 2.1 time: 0.300632 Aug 24 10:23:32.049593 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1512/2692] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:31 2022] GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:23:32.056978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d4b4e97f-a62f-4adb-909c-345958b1ba8d tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:32.058161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d4b4e97f-a62f-4adb-909c-345958b1ba8d tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:32.069845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4b4e97f-a62f-4adb-909c-345958b1ba8d tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:32.071172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4b4e97f-a62f-4adb-909c-345958b1ba8d tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:32.071833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4b4e97f-a62f-4adb-909c-345958b1ba8d tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:32.073863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4b4e97f-a62f-4adb-909c-345958b1ba8d tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:32.074676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4b4e97f-a62f-4adb-909c-345958b1ba8d tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:32.075615 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4b4e97f-a62f-4adb-909c-345958b1ba8d tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:32.188786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d4b4e97f-a62f-4adb-909c-345958b1ba8d tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:32.203071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d4b4e97f-a62f-4adb-909c-345958b1ba8d tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:32.206605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d4b4e97f-a62f-4adb-909c-345958b1ba8d tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:32.208356 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d4b4e97f-a62f-4adb-909c-345958b1ba8d tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1408 microversion: 2.54 time: 0.157550 Aug 24 10:23:32.209928 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1513/2693] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:32 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:32.490954 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c9a8d013-799f-44af-9f7a-396720afd3a1 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:32.493403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c9a8d013-799f-44af-9f7a-396720afd3a1 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] [instance: 98710ee1-1634-4370-b3c1-51d5df2ab889] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:32.515009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9a8d013-799f-44af-9f7a-396720afd3a1 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:32.515831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9a8d013-799f-44af-9f7a-396720afd3a1 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:32.518910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9a8d013-799f-44af-9f7a-396720afd3a1 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:32.520408 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9a8d013-799f-44af-9f7a-396720afd3a1 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:32.521335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9a8d013-799f-44af-9f7a-396720afd3a1 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:32.525082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9a8d013-799f-44af-9f7a-396720afd3a1 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:32.735807 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e8a163b3-5217-45ba-ad3e-e20acdd0ab18 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:32.750045 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e8a163b3-5217-45ba-ad3e-e20acdd0ab18 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623" status: 200 len: 1315 microversion: 2.1 time: 1.377201 Aug 24 10:23:32.750920 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1181/2694] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:31 2022] GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623 => generated 1315 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:23:32.770021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-bfd422ea-dd2d-42a1-8d8c-4d45505b9001 req-38cfc643-2274-41a5-9da6-9520ce180c6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56dc2f7d-cae7-4b36-81e0-594f9b5a0623", "tag": "7139550e-c163-4eac-8f5a-900b59ce79b0"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:32.786706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-bfd422ea-dd2d-42a1-8d8c-4d45505b9001 req-38cfc643-2274-41a5-9da6-9520ce180c6a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:32.787966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-bfd422ea-dd2d-42a1-8d8c-4d45505b9001 req-38cfc643-2274-41a5-9da6-9520ce180c6a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:32.789500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-bfd422ea-dd2d-42a1-8d8c-4d45505b9001 req-38cfc643-2274-41a5-9da6-9520ce180c6a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:32.835276 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-bfd422ea-dd2d-42a1-8d8c-4d45505b9001 req-38cfc643-2274-41a5-9da6-9520ce180c6a service nova] Creating event network-changed:7139550e-c163-4eac-8f5a-900b59ce79b0 for instance 56dc2f7d-cae7-4b36-81e0-594f9b5a0623 on n-h1-849328-3 Aug 24 10:23:32.841385 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-bfd422ea-dd2d-42a1-8d8c-4d45505b9001 req-38cfc643-2274-41a5-9da6-9520ce180c6a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076743 Aug 24 10:23:32.842816 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1182/2695] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:32.979324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:33.019272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c9a8d013-799f-44af-9f7a-396720afd3a1 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b28596ad9a4f259695e4705ae02f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f539617fa0074e2fbd6aaedc8b63773f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:33.032293 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c9a8d013-799f-44af-9f7a-396720afd3a1 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] 10.222.0.85 "GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889" status: 200 len: 1324 microversion: 2.1 time: 0.554708 Aug 24 10:23:33.039044 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1514/2696] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:32 2022] GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889 => generated 1324 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:33.098545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a32972a9-fd68-4be0-b9b8-e7a8b18a476d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:33.100241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a32972a9-fd68-4be0-b9b8-e7a8b18a476d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: d49761ab-ce76-45fc-9754-3366ce58e6b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:33.115337 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a32972a9-fd68-4be0-b9b8-e7a8b18a476d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:33.116503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a32972a9-fd68-4be0-b9b8-e7a8b18a476d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:33.117809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a32972a9-fd68-4be0-b9b8-e7a8b18a476d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:33.119646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a32972a9-fd68-4be0-b9b8-e7a8b18a476d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:33.122085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a32972a9-fd68-4be0-b9b8-e7a8b18a476d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:33.123321 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a32972a9-fd68-4be0-b9b8-e7a8b18a476d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:33.240113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4bd94c33-1940-4ec8-991a-0729910b4bcf tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:33.241535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4bd94c33-1940-4ec8-991a-0729910b4bcf tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:33.276282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=16 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:33.282571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bd94c33-1940-4ec8-991a-0729910b4bcf tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:33.283438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bd94c33-1940-4ec8-991a-0729910b4bcf tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:33.292939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bd94c33-1940-4ec8-991a-0729910b4bcf tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:33.295077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bd94c33-1940-4ec8-991a-0729910b4bcf tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:33.297180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bd94c33-1940-4ec8-991a-0729910b4bcf tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:33.300294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bd94c33-1940-4ec8-991a-0729910b4bcf tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:33.539344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4bd94c33-1940-4ec8-991a-0729910b4bcf tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:33.549731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4bd94c33-1940-4ec8-991a-0729910b4bcf tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:33.551693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4bd94c33-1940-4ec8-991a-0729910b4bcf tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:33.553460 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4bd94c33-1940-4ec8-991a-0729910b4bcf tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1408 microversion: 2.54 time: 0.324163 Aug 24 10:23:33.569162 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1515/2697] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:33 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1408 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:33.773550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3be21aa7-fb48-4700-be4a-90d63ec8fa09 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:33.774358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3be21aa7-fb48-4700-be4a-90d63ec8fa09 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 56dc2f7d-cae7-4b36-81e0-594f9b5a0623] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:33.790585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3be21aa7-fb48-4700-be4a-90d63ec8fa09 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:33.792029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3be21aa7-fb48-4700-be4a-90d63ec8fa09 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:33.794150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3be21aa7-fb48-4700-be4a-90d63ec8fa09 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:33.798204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3be21aa7-fb48-4700-be4a-90d63ec8fa09 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:33.801826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3be21aa7-fb48-4700-be4a-90d63ec8fa09 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:33.802498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3be21aa7-fb48-4700-be4a-90d63ec8fa09 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:33.827891 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a32972a9-fd68-4be0-b9b8-e7a8b18a476d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:33.840426 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a32972a9-fd68-4be0-b9b8-e7a8b18a476d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2" status: 200 len: 1314 microversion: 2.1 time: 0.751995 Aug 24 10:23:33.841403 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1183/2698] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:33 2022] GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2 => generated 1314 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:34.059284 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3847a4cc-0ae9-4817-bb90-a888da9552d9 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:34.059909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3847a4cc-0ae9-4817-bb90-a888da9552d9 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] [instance: 98710ee1-1634-4370-b3c1-51d5df2ab889] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:34.069187 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3847a4cc-0ae9-4817-bb90-a888da9552d9 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:34.069620 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3847a4cc-0ae9-4817-bb90-a888da9552d9 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:34.070049 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3847a4cc-0ae9-4817-bb90-a888da9552d9 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:34.070774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3847a4cc-0ae9-4817-bb90-a888da9552d9 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:34.075391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3847a4cc-0ae9-4817-bb90-a888da9552d9 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:34.076033 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3847a4cc-0ae9-4817-bb90-a888da9552d9 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:34.129378 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:34.412863 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3847a4cc-0ae9-4817-bb90-a888da9552d9 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b28596ad9a4f259695e4705ae02f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f539617fa0074e2fbd6aaedc8b63773f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:34.421403 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3847a4cc-0ae9-4817-bb90-a888da9552d9 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] 10.222.0.85 "GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889" status: 200 len: 1324 microversion: 2.1 time: 0.366058 Aug 24 10:23:34.428742 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1184/2699] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:34 2022] GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889 => generated 1324 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:23:34.583319 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-42c31680-ad93-45cb-906d-e2682af04bd7 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:34.584888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-42c31680-ad93-45cb-906d-e2682af04bd7 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:34.597190 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42c31680-ad93-45cb-906d-e2682af04bd7 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:34.598207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42c31680-ad93-45cb-906d-e2682af04bd7 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:34.603550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42c31680-ad93-45cb-906d-e2682af04bd7 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:34.606734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42c31680-ad93-45cb-906d-e2682af04bd7 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:34.608747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42c31680-ad93-45cb-906d-e2682af04bd7 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:34.610242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42c31680-ad93-45cb-906d-e2682af04bd7 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:34.699752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3be21aa7-fb48-4700-be4a-90d63ec8fa09 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:34.713891 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3be21aa7-fb48-4700-be4a-90d63ec8fa09 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623" status: 200 len: 1315 microversion: 2.1 time: 0.946174 Aug 24 10:23:34.726817 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1516/2700] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:33 2022] GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623 => generated 1315 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:34.862185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-81b8ddc1-9411-4a4e-8994-6e4978a1fb02 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:34.862809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-81b8ddc1-9411-4a4e-8994-6e4978a1fb02 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: d49761ab-ce76-45fc-9754-3366ce58e6b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:34.881454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81b8ddc1-9411-4a4e-8994-6e4978a1fb02 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:34.882376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81b8ddc1-9411-4a4e-8994-6e4978a1fb02 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:34.882767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81b8ddc1-9411-4a4e-8994-6e4978a1fb02 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:34.883529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81b8ddc1-9411-4a4e-8994-6e4978a1fb02 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:34.883998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81b8ddc1-9411-4a4e-8994-6e4978a1fb02 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:34.884426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81b8ddc1-9411-4a4e-8994-6e4978a1fb02 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:34.998128 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-42c31680-ad93-45cb-906d-e2682af04bd7 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:35.055601 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-42c31680-ad93-45cb-906d-e2682af04bd7 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:35.058639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-42c31680-ad93-45cb-906d-e2682af04bd7 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:35.064174 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-42c31680-ad93-45cb-906d-e2682af04bd7 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1408 microversion: 2.54 time: 0.486052 Aug 24 10:23:35.079174 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1185/2701] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:34 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1408 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:35.300077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-81b8ddc1-9411-4a4e-8994-6e4978a1fb02 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:35.331389 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-81b8ddc1-9411-4a4e-8994-6e4978a1fb02 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2" status: 200 len: 1314 microversion: 2.1 time: 0.473282 Aug 24 10:23:35.335130 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1517/2702] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:34 2022] GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:23:35.449847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-611753fa-f153-48ce-b243-543ec42e9f7d tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:35.450460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-611753fa-f153-48ce-b243-543ec42e9f7d tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] [instance: 98710ee1-1634-4370-b3c1-51d5df2ab889] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:35.461742 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-611753fa-f153-48ce-b243-543ec42e9f7d tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:35.470503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-611753fa-f153-48ce-b243-543ec42e9f7d tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:35.477613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-611753fa-f153-48ce-b243-543ec42e9f7d tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:35.481262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-611753fa-f153-48ce-b243-543ec42e9f7d tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:35.486428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-611753fa-f153-48ce-b243-543ec42e9f7d tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:35.487973 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-611753fa-f153-48ce-b243-543ec42e9f7d tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:35.780475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d5f2531d-1b52-41cc-ad4b-9358899fb079 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:35.790281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d5f2531d-1b52-41cc-ad4b-9358899fb079 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 56dc2f7d-cae7-4b36-81e0-594f9b5a0623] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:35.830784 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5f2531d-1b52-41cc-ad4b-9358899fb079 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:35.832211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5f2531d-1b52-41cc-ad4b-9358899fb079 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:35.834899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5f2531d-1b52-41cc-ad4b-9358899fb079 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:35.836943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5f2531d-1b52-41cc-ad4b-9358899fb079 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:35.838186 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5f2531d-1b52-41cc-ad4b-9358899fb079 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:35.839273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5f2531d-1b52-41cc-ad4b-9358899fb079 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:36.031627 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-611753fa-f153-48ce-b243-543ec42e9f7d tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b28596ad9a4f259695e4705ae02f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f539617fa0074e2fbd6aaedc8b63773f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:36.048181 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-611753fa-f153-48ce-b243-543ec42e9f7d tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] 10.222.0.85 "GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889" status: 200 len: 1324 microversion: 2.1 time: 0.602776 Aug 24 10:23:36.049491 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1186/2703] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:35 2022] GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889 => generated 1324 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:36.058375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0d83dd91-5d19-4964-87c6-e628052c3732 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-208011130", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "f193fbbf-f0db-4018-8b63-5fad43f6c15d"}, {"uuid": "9343c977-b700-4103-b064-65bec223f099"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:36.166456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-0d83dd91-5d19-4964-87c6-e628052c3732 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] validate_networks() for [('f193fbbf-f0db-4018-8b63-5fad43f6c15d', None, None, None, None, None), ('9343c977-b700-4103-b064-65bec223f099', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:23:36.355221 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d5f2531d-1b52-41cc-ad4b-9358899fb079 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:36.376558 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d5f2531d-1b52-41cc-ad4b-9358899fb079 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623" status: 200 len: 1315 microversion: 2.1 time: 0.638623 Aug 24 10:23:36.378200 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1518/2704] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:35 2022] GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623 => generated 1315 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:36.389565 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-93d0da6c-c807-43d0-a681-dcaaca2c4860 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:36.391504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-93d0da6c-c807-43d0-a681-dcaaca2c4860 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:36.411922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93d0da6c-c807-43d0-a681-dcaaca2c4860 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:36.412809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93d0da6c-c807-43d0-a681-dcaaca2c4860 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:36.414348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93d0da6c-c807-43d0-a681-dcaaca2c4860 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:36.416800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93d0da6c-c807-43d0-a681-dcaaca2c4860 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:36.419469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93d0da6c-c807-43d0-a681-dcaaca2c4860 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:36.420433 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93d0da6c-c807-43d0-a681-dcaaca2c4860 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:36.566521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-93d0da6c-c807-43d0-a681-dcaaca2c4860 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:36.580833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-93d0da6c-c807-43d0-a681-dcaaca2c4860 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:36.583995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-93d0da6c-c807-43d0-a681-dcaaca2c4860 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:36.585352 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-93d0da6c-c807-43d0-a681-dcaaca2c4860 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1408 microversion: 2.54 time: 0.205231 Aug 24 10:23:36.585959 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1519/2705] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:36 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:36.596748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b5ab942e-9218-4c03-ad93-2fabdc3a5810 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:36.600734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b5ab942e-9218-4c03-ad93-2fabdc3a5810 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: d49761ab-ce76-45fc-9754-3366ce58e6b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:36.616660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5ab942e-9218-4c03-ad93-2fabdc3a5810 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:36.617469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5ab942e-9218-4c03-ad93-2fabdc3a5810 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:36.618085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5ab942e-9218-4c03-ad93-2fabdc3a5810 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:36.618968 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5ab942e-9218-4c03-ad93-2fabdc3a5810 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:36.619608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5ab942e-9218-4c03-ad93-2fabdc3a5810 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:36.622508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5ab942e-9218-4c03-ad93-2fabdc3a5810 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:37.251170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b5ab942e-9218-4c03-ad93-2fabdc3a5810 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:37.273536 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b5ab942e-9218-4c03-ad93-2fabdc3a5810 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2" status: 200 len: 1314 microversion: 2.1 time: 0.677796 Aug 24 10:23:37.275458 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1520/2706] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:36 2022] GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2 => generated 1314 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:37.284889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5bf7a4c7-83b6-494a-9084-50574493e392 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:37.293711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5bf7a4c7-83b6-494a-9084-50574493e392 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] [instance: 98710ee1-1634-4370-b3c1-51d5df2ab889] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:37.311319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5bf7a4c7-83b6-494a-9084-50574493e392 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:37.312239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5bf7a4c7-83b6-494a-9084-50574493e392 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:37.312926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5bf7a4c7-83b6-494a-9084-50574493e392 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:37.314486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5bf7a4c7-83b6-494a-9084-50574493e392 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:37.315624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5bf7a4c7-83b6-494a-9084-50574493e392 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:37.316432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5bf7a4c7-83b6-494a-9084-50574493e392 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:37.662814 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5bf7a4c7-83b6-494a-9084-50574493e392 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b28596ad9a4f259695e4705ae02f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f539617fa0074e2fbd6aaedc8b63773f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:37.672343 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5bf7a4c7-83b6-494a-9084-50574493e392 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] 10.222.0.85 "GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889" status: 200 len: 1324 microversion: 2.1 time: 0.395766 Aug 24 10:23:37.673273 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1521/2707] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:37 2022] GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889 => generated 1324 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:37.679814 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8291acd0-7080-49b3-a423-57de204e16e0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:37.680708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8291acd0-7080-49b3-a423-57de204e16e0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 56dc2f7d-cae7-4b36-81e0-594f9b5a0623] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:37.686890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:37.688797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8291acd0-7080-49b3-a423-57de204e16e0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:37.694214 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8291acd0-7080-49b3-a423-57de204e16e0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:37.695031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8291acd0-7080-49b3-a423-57de204e16e0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:37.695997 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8291acd0-7080-49b3-a423-57de204e16e0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:37.696677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8291acd0-7080-49b3-a423-57de204e16e0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:37.697361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8291acd0-7080-49b3-a423-57de204e16e0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:38.098021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8291acd0-7080-49b3-a423-57de204e16e0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:38.133771 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8291acd0-7080-49b3-a423-57de204e16e0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623" status: 200 len: 1315 microversion: 2.1 time: 0.459115 Aug 24 10:23:38.147686 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1522/2708] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:37 2022] GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623 => generated 1315 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:38.153160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5f3477d6-39d7-445c-91c7-2cbe039c86cd tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:38.153797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5f3477d6-39d7-445c-91c7-2cbe039c86cd tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:38.164542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f3477d6-39d7-445c-91c7-2cbe039c86cd tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:38.165053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f3477d6-39d7-445c-91c7-2cbe039c86cd tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:38.165526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f3477d6-39d7-445c-91c7-2cbe039c86cd tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:38.166423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f3477d6-39d7-445c-91c7-2cbe039c86cd tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:38.173871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f3477d6-39d7-445c-91c7-2cbe039c86cd tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:38.174583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f3477d6-39d7-445c-91c7-2cbe039c86cd tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:38.421798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5f3477d6-39d7-445c-91c7-2cbe039c86cd tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:38.443049 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5f3477d6-39d7-445c-91c7-2cbe039c86cd tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:38.445084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5f3477d6-39d7-445c-91c7-2cbe039c86cd tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:38.448691 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5f3477d6-39d7-445c-91c7-2cbe039c86cd tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1408 microversion: 2.54 time: 0.299764 Aug 24 10:23:38.449327 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1523/2709] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:38 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1408 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:38.479228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-65a32ecb-9bdd-48fc-9798-601a2f9b9f5e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:38.489997 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-65a32ecb-9bdd-48fc-9798-601a2f9b9f5e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: d49761ab-ce76-45fc-9754-3366ce58e6b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:38.506141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65a32ecb-9bdd-48fc-9798-601a2f9b9f5e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:38.506482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65a32ecb-9bdd-48fc-9798-601a2f9b9f5e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:38.514957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65a32ecb-9bdd-48fc-9798-601a2f9b9f5e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:38.517508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65a32ecb-9bdd-48fc-9798-601a2f9b9f5e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:38.523492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65a32ecb-9bdd-48fc-9798-601a2f9b9f5e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:38.524252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65a32ecb-9bdd-48fc-9798-601a2f9b9f5e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:38.667594 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0d83dd91-5d19-4964-87c6-e628052c3732 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:23:38.668072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0d83dd91-5d19-4964-87c6-e628052c3732 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:23:38.669077 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0d83dd91-5d19-4964-87c6-e628052c3732 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:23:38.669077 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0d83dd91-5d19-4964-87c6-e628052c3732 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:23:38.669855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0d83dd91-5d19-4964-87c6-e628052c3732 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:23:38.688053 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d83dd91-5d19-4964-87c6-e628052c3732 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:38.688763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d83dd91-5d19-4964-87c6-e628052c3732 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:38.689474 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d83dd91-5d19-4964-87c6-e628052c3732 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:38.692445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d83dd91-5d19-4964-87c6-e628052c3732 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:38.693365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d83dd91-5d19-4964-87c6-e628052c3732 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:38.694037 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d83dd91-5d19-4964-87c6-e628052c3732 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:38.740071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-0d83dd91-5d19-4964-87c6-e628052c3732 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Getting quotas for project e861e247176c4ebda68404fe30c2b561. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:23:38.753752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-0d83dd91-5d19-4964-87c6-e628052c3732 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Getting quotas for user 6878521252244be0a32ab2f056ec54c9 and project e861e247176c4ebda68404fe30c2b561. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:23:38.775240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0d83dd91-5d19-4964-87c6-e628052c3732 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:23:38.778120 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0d83dd91-5d19-4964-87c6-e628052c3732 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:23:38.873103 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0d83dd91-5d19-4964-87c6-e628052c3732 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.822161 Aug 24 10:23:38.873964 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1187/2710] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:23:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:23:38.878908 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d08c74e3-59b4-453c-bc29-ec93be1f779f tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:38.879820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d08c74e3-59b4-453c-bc29-ec93be1f779f tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] [instance: 98710ee1-1634-4370-b3c1-51d5df2ab889] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:38.889522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d08c74e3-59b4-453c-bc29-ec93be1f779f tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:38.890350 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d08c74e3-59b4-453c-bc29-ec93be1f779f tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:38.890956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d08c74e3-59b4-453c-bc29-ec93be1f779f tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:38.891893 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d08c74e3-59b4-453c-bc29-ec93be1f779f tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:38.892503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d08c74e3-59b4-453c-bc29-ec93be1f779f tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:38.893086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d08c74e3-59b4-453c-bc29-ec93be1f779f tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:38.979671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-65a32ecb-9bdd-48fc-9798-601a2f9b9f5e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:38.999974 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-65a32ecb-9bdd-48fc-9798-601a2f9b9f5e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2" status: 200 len: 1314 microversion: 2.1 time: 0.545220 Aug 24 10:23:39.001229 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1524/2711] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:38 2022] GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2 => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:39.007056 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8922c1c5-5494-46b0-8153-b9926484412b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:39.008337 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8922c1c5-5494-46b0-8153-b9926484412b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:39.270734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8922c1c5-5494-46b0-8153-b9926484412b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:39.279252 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8922c1c5-5494-46b0-8153-b9926484412b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d" status: 200 len: 1212 microversion: 2.1 time: 0.276605 Aug 24 10:23:39.279815 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1525/2712] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:39 2022] GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d => generated 1212 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:39.313914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-03d0c8ff-2b24-48d7-9976-3acd9021fb20 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:39.314614 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-03d0c8ff-2b24-48d7-9976-3acd9021fb20 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 56dc2f7d-cae7-4b36-81e0-594f9b5a0623] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:39.335996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03d0c8ff-2b24-48d7-9976-3acd9021fb20 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:39.336530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03d0c8ff-2b24-48d7-9976-3acd9021fb20 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:39.336978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03d0c8ff-2b24-48d7-9976-3acd9021fb20 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:39.337742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03d0c8ff-2b24-48d7-9976-3acd9021fb20 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:39.338200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03d0c8ff-2b24-48d7-9976-3acd9021fb20 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:39.338627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03d0c8ff-2b24-48d7-9976-3acd9021fb20 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:39.724333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d08c74e3-59b4-453c-bc29-ec93be1f779f tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b28596ad9a4f259695e4705ae02f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f539617fa0074e2fbd6aaedc8b63773f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:39.734206 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d08c74e3-59b4-453c-bc29-ec93be1f779f tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] 10.222.0.85 "GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889" status: 200 len: 1324 microversion: 2.1 time: 0.859148 Aug 24 10:23:39.737954 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1188/2713] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:38 2022] GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889 => generated 1324 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:39.755187 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0de24276-dff5-46c7-a7d4-334e055a2470 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:39.756400 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0de24276-dff5-46c7-a7d4-334e055a2470 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:39.773441 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0de24276-dff5-46c7-a7d4-334e055a2470 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:39.774087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0de24276-dff5-46c7-a7d4-334e055a2470 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:39.774852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0de24276-dff5-46c7-a7d4-334e055a2470 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:39.775941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0de24276-dff5-46c7-a7d4-334e055a2470 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:39.776828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0de24276-dff5-46c7-a7d4-334e055a2470 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:39.777908 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0de24276-dff5-46c7-a7d4-334e055a2470 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:39.889638 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-03d0c8ff-2b24-48d7-9976-3acd9021fb20 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:39.902835 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0de24276-dff5-46c7-a7d4-334e055a2470 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:39.950952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0de24276-dff5-46c7-a7d4-334e055a2470 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:39.951897 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-03d0c8ff-2b24-48d7-9976-3acd9021fb20 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623" status: 200 len: 1315 microversion: 2.1 time: 0.640621 Aug 24 10:23:39.961971 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1526/2714] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:39 2022] GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623 => generated 1315 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:39.967342 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0de24276-dff5-46c7-a7d4-334e055a2470 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:39.968938 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0de24276-dff5-46c7-a7d4-334e055a2470 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1408 microversion: 2.54 time: 0.229621 Aug 24 10:23:39.972750 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1189/2715] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:39 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1408 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:40.022133 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-efde5eaf-4036-45d2-8cc3-b913795c9c62 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:40.023225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-efde5eaf-4036-45d2-8cc3-b913795c9c62 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: d49761ab-ce76-45fc-9754-3366ce58e6b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:40.034780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efde5eaf-4036-45d2-8cc3-b913795c9c62 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:40.037142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efde5eaf-4036-45d2-8cc3-b913795c9c62 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:40.040318 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efde5eaf-4036-45d2-8cc3-b913795c9c62 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:40.041303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efde5eaf-4036-45d2-8cc3-b913795c9c62 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:40.045845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efde5eaf-4036-45d2-8cc3-b913795c9c62 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:40.046644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efde5eaf-4036-45d2-8cc3-b913795c9c62 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:40.305752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ab7af4de-c7ad-463b-9b18-63bf4b8e3257 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:40.306860 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ab7af4de-c7ad-463b-9b18-63bf4b8e3257 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:40.338076 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab7af4de-c7ad-463b-9b18-63bf4b8e3257 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:40.344489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab7af4de-c7ad-463b-9b18-63bf4b8e3257 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:40.345744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab7af4de-c7ad-463b-9b18-63bf4b8e3257 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:40.349102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab7af4de-c7ad-463b-9b18-63bf4b8e3257 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:40.349785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab7af4de-c7ad-463b-9b18-63bf4b8e3257 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:40.354440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab7af4de-c7ad-463b-9b18-63bf4b8e3257 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:40.459640 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ab7af4de-c7ad-463b-9b18-63bf4b8e3257 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:40.471993 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ab7af4de-c7ad-463b-9b18-63bf4b8e3257 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d" status: 200 len: 1264 microversion: 2.1 time: 0.171673 Aug 24 10:23:40.473755 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1190/2716] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:40 2022] GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:40.500015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-aa8e07b9-1d44-484a-a152-c6a13fe95d4f req-e1c7f8f3-f089-4250-af17-40d88361b19d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49761ab-ce76-45fc-9754-3366ce58e6b2", "name": "network-vif-plugged", "status": "completed", "tag": "29f51102-f85d-465a-b06a-dc1cf699dbf4"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:40.520948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-aa8e07b9-1d44-484a-a152-c6a13fe95d4f req-e1c7f8f3-f089-4250-af17-40d88361b19d service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:40.523432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-aa8e07b9-1d44-484a-a152-c6a13fe95d4f req-e1c7f8f3-f089-4250-af17-40d88361b19d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:40.524310 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-aa8e07b9-1d44-484a-a152-c6a13fe95d4f req-e1c7f8f3-f089-4250-af17-40d88361b19d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:40.551004 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-aa8e07b9-1d44-484a-a152-c6a13fe95d4f req-e1c7f8f3-f089-4250-af17-40d88361b19d service nova] Creating event network-vif-plugged:29f51102-f85d-465a-b06a-dc1cf699dbf4 for instance d49761ab-ce76-45fc-9754-3366ce58e6b2 on n-h1-849328-3 Aug 24 10:23:40.559788 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-aa8e07b9-1d44-484a-a152-c6a13fe95d4f req-e1c7f8f3-f089-4250-af17-40d88361b19d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062475 Aug 24 10:23:40.561050 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1191/2717] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:40.724921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e2a8f4dc-4451-4c0a-b0e5-393b9131fbed tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:40.728983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e2a8f4dc-4451-4c0a-b0e5-393b9131fbed tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:40.740302 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2a8f4dc-4451-4c0a-b0e5-393b9131fbed tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:40.741493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2a8f4dc-4451-4c0a-b0e5-393b9131fbed tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:40.743382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2a8f4dc-4451-4c0a-b0e5-393b9131fbed tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:40.744751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2a8f4dc-4451-4c0a-b0e5-393b9131fbed tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:40.745680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2a8f4dc-4451-4c0a-b0e5-393b9131fbed tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:40.746549 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2a8f4dc-4451-4c0a-b0e5-393b9131fbed tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:40.777484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-efde5eaf-4036-45d2-8cc3-b913795c9c62 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:40.780261 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-e2a8f4dc-4451-4c0a-b0e5-393b9131fbed tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] HTTP exception thrown: Instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd could not be found. Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e2a8f4dc-4451-4c0a-b0e5-393b9131fbed tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Request method failure captured: Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd HTTP/1.1 Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfpn5r3-bo_-ekPZ3CYv5IFBdhoWsZG0PMk5rwR0Vo_3wxwSH0k1LCm6Wp9yUn-uTRvcvzTrnZjRNPB_ytyGyOHNN0Yvkmhn8kQX-PM3AyYOjgAGs9JopVpFP_srSJtubcdVQplbwLeyMLcOK5A_odnbCcvRMgtSMlXRHEwTB-v6uPA Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: X-Openstack-Nova-Api-Version: 2.32 Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: ad01394db2334c029874ee8e14e227f5 Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-TaggedBootDevicesTest-957457665 Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ad01394db2334c029874ee8e14e227f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_ad01394db2334c029874ee8e14e227f5", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ad01394db2334c029874ee8e14e227f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/ad01394db2334c029874ee8e14e227f5"}]}] Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-TaggedBootDevicesTest-957457665 Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: ad01394db2334c029874ee8e14e227f5 Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TaggedBootDevicesTest-957457665 Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-TaggedBootDevicesTest-957457665-project Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: b24e6810543444048cf6e0871f5521eb Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-TaggedBootDevicesTest-957457665-project Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd could not be found. Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd'} Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd could not be found. Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:40.784600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:40.791973 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd could not be found. Aug 24 10:23:40.791973 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:40.791973 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:40.791973 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:40.791973 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:40.791973 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:40.791973 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:40.791973 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:40.791973 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:40.791973 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd could not be found. Aug 24 10:23:40.791973 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:40.793998 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-efde5eaf-4036-45d2-8cc3-b913795c9c62 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2" status: 200 len: 1314 microversion: 2.1 time: 0.776632 Aug 24 10:23:40.797230 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1527/2718] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:40 2022] GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2 => generated 1314 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:40.797743 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e2a8f4dc-4451-4c0a-b0e5-393b9131fbed tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Returning 404 to user: Instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:40.801807 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e2a8f4dc-4451-4c0a-b0e5-393b9131fbed tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "DELETE /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 404 len: 111 microversion: 2.32 time: 0.083592 Aug 24 10:23:40.803256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2cb036c2-08d4-4f83-9322-d549c3dc93a5 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:40.803944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2cb036c2-08d4-4f83-9322-d549c3dc93a5 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] [instance: 98710ee1-1634-4370-b3c1-51d5df2ab889] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:40.805805 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1192/2719] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:23:40 2022] DELETE /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:23:40.821729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1f00bdf1-134c-4ca5-bee5-7af5f1aff9c2 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:40.822907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cb036c2-08d4-4f83-9322-d549c3dc93a5 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:40.823189 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1f00bdf1-134c-4ca5-bee5-7af5f1aff9c2 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] [instance: 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:40.823412 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cb036c2-08d4-4f83-9322-d549c3dc93a5 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:40.823849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cb036c2-08d4-4f83-9322-d549c3dc93a5 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:40.830957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cb036c2-08d4-4f83-9322-d549c3dc93a5 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:40.831600 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cb036c2-08d4-4f83-9322-d549c3dc93a5 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:40.832048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cb036c2-08d4-4f83-9322-d549c3dc93a5 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:40.851987 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f00bdf1-134c-4ca5-bee5-7af5f1aff9c2 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:40.854002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f00bdf1-134c-4ca5-bee5-7af5f1aff9c2 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:40.856007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f00bdf1-134c-4ca5-bee5-7af5f1aff9c2 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:40.858051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f00bdf1-134c-4ca5-bee5-7af5f1aff9c2 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:40.860900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f00bdf1-134c-4ca5-bee5-7af5f1aff9c2 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:40.862510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f00bdf1-134c-4ca5-bee5-7af5f1aff9c2 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:40.886076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:40.927164 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-1f00bdf1-134c-4ca5-bee5-7af5f1aff9c2 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] HTTP exception thrown: Instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd could not be found. Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1f00bdf1-134c-4ca5-bee5-7af5f1aff9c2 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Request method failure captured: Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd HTTP/1.1 Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfpn5r3-bo_-ekPZ3CYv5IFBdhoWsZG0PMk5rwR0Vo_3wxwSH0k1LCm6Wp9yUn-uTRvcvzTrnZjRNPB_ytyGyOHNN0Yvkmhn8kQX-PM3AyYOjgAGs9JopVpFP_srSJtubcdVQplbwLeyMLcOK5A_odnbCcvRMgtSMlXRHEwTB-v6uPA Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: X-Openstack-Nova-Api-Version: 2.32 Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: ad01394db2334c029874ee8e14e227f5 Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-TaggedBootDevicesTest-957457665 Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ad01394db2334c029874ee8e14e227f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_ad01394db2334c029874ee8e14e227f5", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ad01394db2334c029874ee8e14e227f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/ad01394db2334c029874ee8e14e227f5"}]}] Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-TaggedBootDevicesTest-957457665 Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: ad01394db2334c029874ee8e14e227f5 Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TaggedBootDevicesTest-957457665 Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-TaggedBootDevicesTest-957457665-project Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: b24e6810543444048cf6e0871f5521eb Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-TaggedBootDevicesTest-957457665-project Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd could not be found. Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd'} Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd could not be found. Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd could not be found. Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:40.951560 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:40.956316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:40.956316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:40.956316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:40.956316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:40.956316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:40.956316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd could not be found. Aug 24 10:23:40.956316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:40.956316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1f00bdf1-134c-4ca5-bee5-7af5f1aff9c2 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] Returning 404 to user: Instance 4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:40.956316 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1f00bdf1-134c-4ca5-bee5-7af5f1aff9c2 tempest-TaggedBootDevicesTest-957457665 tempest-TaggedBootDevicesTest-957457665-project] 10.222.0.85 "GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd" status: 404 len: 111 microversion: 2.32 time: 0.140798 Aug 24 10:23:40.961626 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1193/2720] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:40 2022] GET /compute/v2.1/servers/4fcf8e33-6a7b-4fb0-977c-7f6fd14f55dd => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 10:23:40.976734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e38bbe0a-9917-48e3-8974-b639bc668728 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:40.977425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e38bbe0a-9917-48e3-8974-b639bc668728 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 56dc2f7d-cae7-4b36-81e0-594f9b5a0623] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:40.986665 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e38bbe0a-9917-48e3-8974-b639bc668728 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:40.989638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e38bbe0a-9917-48e3-8974-b639bc668728 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:40.990108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e38bbe0a-9917-48e3-8974-b639bc668728 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:40.992848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e38bbe0a-9917-48e3-8974-b639bc668728 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:40.993369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e38bbe0a-9917-48e3-8974-b639bc668728 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:40.993820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e38bbe0a-9917-48e3-8974-b639bc668728 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:41.161458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2cb036c2-08d4-4f83-9322-d549c3dc93a5 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b28596ad9a4f259695e4705ae02f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f539617fa0074e2fbd6aaedc8b63773f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:41.176486 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2cb036c2-08d4-4f83-9322-d549c3dc93a5 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] 10.222.0.85 "GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889" status: 200 len: 1324 microversion: 2.1 time: 0.380275 Aug 24 10:23:41.179213 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1528/2721] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:40 2022] GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889 => generated 1324 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:41.202956 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7e248f37-2a59-4803-8d03-289fdfae5ed0 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:41.203897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7e248f37-2a59-4803-8d03-289fdfae5ed0 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:41.216896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e248f37-2a59-4803-8d03-289fdfae5ed0 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:41.220354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e248f37-2a59-4803-8d03-289fdfae5ed0 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:41.220885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e248f37-2a59-4803-8d03-289fdfae5ed0 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:41.225151 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e248f37-2a59-4803-8d03-289fdfae5ed0 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:41.225873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e248f37-2a59-4803-8d03-289fdfae5ed0 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:41.226466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e248f37-2a59-4803-8d03-289fdfae5ed0 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:41.379102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7e248f37-2a59-4803-8d03-289fdfae5ed0 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:41.393176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7e248f37-2a59-4803-8d03-289fdfae5ed0 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:41.397594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7e248f37-2a59-4803-8d03-289fdfae5ed0 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:41.405804 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7e248f37-2a59-4803-8d03-289fdfae5ed0 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1408 microversion: 2.54 time: 0.223328 Aug 24 10:23:41.407200 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1529/2722] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:41 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1408 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:41.499839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-73d07be5-d8fd-4c49-8eb8-50778b303b6c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:41.500970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-73d07be5-d8fd-4c49-8eb8-50778b303b6c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:41.511899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73d07be5-d8fd-4c49-8eb8-50778b303b6c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:41.512734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73d07be5-d8fd-4c49-8eb8-50778b303b6c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:41.513372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73d07be5-d8fd-4c49-8eb8-50778b303b6c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:41.514940 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73d07be5-d8fd-4c49-8eb8-50778b303b6c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:41.515590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73d07be5-d8fd-4c49-8eb8-50778b303b6c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:41.516200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73d07be5-d8fd-4c49-8eb8-50778b303b6c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:41.639626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-73d07be5-d8fd-4c49-8eb8-50778b303b6c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:41.650450 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-73d07be5-d8fd-4c49-8eb8-50778b303b6c tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d" status: 200 len: 1270 microversion: 2.1 time: 0.157560 Aug 24 10:23:41.662861 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1530/2723] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:41 2022] GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d => generated 1270 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:23:41.776291 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e38bbe0a-9917-48e3-8974-b639bc668728 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:41.786370 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e38bbe0a-9917-48e3-8974-b639bc668728 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623" status: 200 len: 1315 microversion: 2.1 time: 0.814270 Aug 24 10:23:41.806780 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1194/2724] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:40 2022] GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623 => generated 1315 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:23:41.828328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d73b9851-90e1-4ade-8bc6-d6ad4327d84d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:41.829217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d73b9851-90e1-4ade-8bc6-d6ad4327d84d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: d49761ab-ce76-45fc-9754-3366ce58e6b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:41.840974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d73b9851-90e1-4ade-8bc6-d6ad4327d84d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:41.842301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d73b9851-90e1-4ade-8bc6-d6ad4327d84d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:41.846546 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d73b9851-90e1-4ade-8bc6-d6ad4327d84d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:41.847739 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d73b9851-90e1-4ade-8bc6-d6ad4327d84d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:41.848905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d73b9851-90e1-4ade-8bc6-d6ad4327d84d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:41.849537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d73b9851-90e1-4ade-8bc6-d6ad4327d84d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:41.962928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-11a5e656-4c5d-4e69-9c09-169b1b128f07 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:41.965593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-11a5e656-4c5d-4e69-9c09-169b1b128f07 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:41.981323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11a5e656-4c5d-4e69-9c09-169b1b128f07 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:41.984400 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11a5e656-4c5d-4e69-9c09-169b1b128f07 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:41.986797 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11a5e656-4c5d-4e69-9c09-169b1b128f07 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:41.989087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11a5e656-4c5d-4e69-9c09-169b1b128f07 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:41.990385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11a5e656-4c5d-4e69-9c09-169b1b128f07 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:41.992386 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11a5e656-4c5d-4e69-9c09-169b1b128f07 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:42.088344 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-11a5e656-4c5d-4e69-9c09-169b1b128f07 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130180 Aug 24 10:23:42.089001 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1195/2725] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:23:41 2022] GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:23:42.118743 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-10b62a6e-2697-40ee-b97f-5c74b6056c74 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:42.123472 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-10b62a6e-2697-40ee-b97f-5c74b6056c74 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:42.137589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d73b9851-90e1-4ade-8bc6-d6ad4327d84d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:42.145852 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d73b9851-90e1-4ade-8bc6-d6ad4327d84d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2" status: 200 len: 1314 microversion: 2.1 time: 0.321694 Aug 24 10:23:42.146451 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1531/2726] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:41 2022] GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:42.151075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10b62a6e-2697-40ee-b97f-5c74b6056c74 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:42.160125 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10b62a6e-2697-40ee-b97f-5c74b6056c74 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:42.165395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10b62a6e-2697-40ee-b97f-5c74b6056c74 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:42.166379 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10b62a6e-2697-40ee-b97f-5c74b6056c74 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:42.167007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10b62a6e-2697-40ee-b97f-5c74b6056c74 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:42.167597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10b62a6e-2697-40ee-b97f-5c74b6056c74 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:42.203669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8dee6553-48eb-4c79-bb2b-41e9f0f0c115 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:42.204979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8dee6553-48eb-4c79-bb2b-41e9f0f0c115 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] [instance: 98710ee1-1634-4370-b3c1-51d5df2ab889] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:42.217944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8dee6553-48eb-4c79-bb2b-41e9f0f0c115 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:42.222780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8dee6553-48eb-4c79-bb2b-41e9f0f0c115 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:42.223589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8dee6553-48eb-4c79-bb2b-41e9f0f0c115 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:42.224523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8dee6553-48eb-4c79-bb2b-41e9f0f0c115 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:42.225177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8dee6553-48eb-4c79-bb2b-41e9f0f0c115 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:42.225793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8dee6553-48eb-4c79-bb2b-41e9f0f0c115 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:42.464446 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-10b62a6e-2697-40ee-b97f-5c74b6056c74 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lazy-loading 'services' on Instance uuid 0f6298f4-4be1-47e8-a260-c43d83731e08 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:23:42.584887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8dee6553-48eb-4c79-bb2b-41e9f0f0c115 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b28596ad9a4f259695e4705ae02f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f539617fa0074e2fbd6aaedc8b63773f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:42.599203 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8dee6553-48eb-4c79-bb2b-41e9f0f0c115 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] 10.222.0.85 "GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889" status: 200 len: 1324 microversion: 2.1 time: 0.403338 Aug 24 10:23:42.602483 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1532/2727] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:42 2022] GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889 => generated 1324 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:23:42.609443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4556e1b7-cf22-4c9c-8762-07081a8bc614 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:42.610357 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4556e1b7-cf22-4c9c-8762-07081a8bc614 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:42.618287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4556e1b7-cf22-4c9c-8762-07081a8bc614 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:42.620824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4556e1b7-cf22-4c9c-8762-07081a8bc614 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:42.622137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4556e1b7-cf22-4c9c-8762-07081a8bc614 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:42.623157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4556e1b7-cf22-4c9c-8762-07081a8bc614 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:42.623984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4556e1b7-cf22-4c9c-8762-07081a8bc614 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:42.625388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4556e1b7-cf22-4c9c-8762-07081a8bc614 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:42.728572 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-10b62a6e-2697-40ee-b97f-5c74b6056c74 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "DELETE /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08/os-volume_attachments/5908397a-3f30-4873-86f6-4567c4fef350" status: 202 len: 0 microversion: 2.1 time: 0.619255 Aug 24 10:23:42.729459 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1196/2728] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Aug 24 10:23:42 2022] DELETE /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08/os-volume_attachments/5908397a-3f30-4873-86f6-4567c4fef350 => generated 0 bytes in 621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:23:42.744304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4556e1b7-cf22-4c9c-8762-07081a8bc614 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:42.749258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-099966b2-c511-4dec-b5f1-18b1030210e0 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:42.753936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-099966b2-c511-4dec-b5f1-18b1030210e0 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:42.774720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-099966b2-c511-4dec-b5f1-18b1030210e0 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:42.776223 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-099966b2-c511-4dec-b5f1-18b1030210e0 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:42.776365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4556e1b7-cf22-4c9c-8762-07081a8bc614 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:42.777149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-099966b2-c511-4dec-b5f1-18b1030210e0 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:42.780755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-099966b2-c511-4dec-b5f1-18b1030210e0 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:42.784574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-099966b2-c511-4dec-b5f1-18b1030210e0 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:42.785498 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-099966b2-c511-4dec-b5f1-18b1030210e0 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:42.787446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4556e1b7-cf22-4c9c-8762-07081a8bc614 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:42.790405 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4556e1b7-cf22-4c9c-8762-07081a8bc614 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1408 microversion: 2.54 time: 0.186283 Aug 24 10:23:42.794669 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1533/2729] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:42 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1408 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:42.817223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c080852-76fe-40e1-a129-0acd4fead0e0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:42.820985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2c080852-76fe-40e1-a129-0acd4fead0e0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 56dc2f7d-cae7-4b36-81e0-594f9b5a0623] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:42.848477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c080852-76fe-40e1-a129-0acd4fead0e0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:42.851671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c080852-76fe-40e1-a129-0acd4fead0e0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:42.852747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c080852-76fe-40e1-a129-0acd4fead0e0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:42.856337 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c080852-76fe-40e1-a129-0acd4fead0e0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:42.859402 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c080852-76fe-40e1-a129-0acd4fead0e0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:42.860803 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c080852-76fe-40e1-a129-0acd4fead0e0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:43.194483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2c080852-76fe-40e1-a129-0acd4fead0e0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:43.209709 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2c080852-76fe-40e1-a129-0acd4fead0e0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623" status: 200 len: 1315 microversion: 2.1 time: 0.401030 Aug 24 10:23:43.231699 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1534/2730] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:42 2022] GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623 => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:23:43.238646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-853c3e93-6165-486c-9b5c-a6c3eed98981 req-2beb72bd-9a56-44af-8099-e4df938aef3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98710ee1-1634-4370-b3c1-51d5df2ab889", "name": "network-vif-plugged", "status": "completed", "tag": "a56be047-3952-434f-bd82-2ed9c4c0e56a"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:43.253615 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-853c3e93-6165-486c-9b5c-a6c3eed98981 req-2beb72bd-9a56-44af-8099-e4df938aef3f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:43.254321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-853c3e93-6165-486c-9b5c-a6c3eed98981 req-2beb72bd-9a56-44af-8099-e4df938aef3f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:43.254937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-853c3e93-6165-486c-9b5c-a6c3eed98981 req-2beb72bd-9a56-44af-8099-e4df938aef3f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:43.272357 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-853c3e93-6165-486c-9b5c-a6c3eed98981 req-2beb72bd-9a56-44af-8099-e4df938aef3f service nova] Creating event network-vif-plugged:a56be047-3952-434f-bd82-2ed9c4c0e56a for instance 98710ee1-1634-4370-b3c1-51d5df2ab889 on n-h2-849328-3 Aug 24 10:23:43.282453 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-853c3e93-6165-486c-9b5c-a6c3eed98981 req-2beb72bd-9a56-44af-8099-e4df938aef3f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047917 Aug 24 10:23:43.286473 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1535/2731] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:43.295117 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d09f649c-cf19-42a2-bab1-4ddce96284ee tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:43.296367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d09f649c-cf19-42a2-bab1-4ddce96284ee tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: d49761ab-ce76-45fc-9754-3366ce58e6b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:43.296810 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-099966b2-c511-4dec-b5f1-18b1030210e0 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:43.307583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d09f649c-cf19-42a2-bab1-4ddce96284ee tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:43.307792 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-099966b2-c511-4dec-b5f1-18b1030210e0 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d" status: 200 len: 1312 microversion: 2.1 time: 0.571793 Aug 24 10:23:43.308813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d09f649c-cf19-42a2-bab1-4ddce96284ee tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:43.313985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d09f649c-cf19-42a2-bab1-4ddce96284ee tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:43.314224 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1197/2732] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:42 2022] GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d => generated 1312 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:43.316332 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d09f649c-cf19-42a2-bab1-4ddce96284ee tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:43.317560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d09f649c-cf19-42a2-bab1-4ddce96284ee tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:43.318593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d09f649c-cf19-42a2-bab1-4ddce96284ee tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:43.625799 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d09f649c-cf19-42a2-bab1-4ddce96284ee tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:43.632752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a021781e-878b-48d2-93f5-b03879c2a3fe tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:43.633588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a021781e-878b-48d2-93f5-b03879c2a3fe tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] [instance: 98710ee1-1634-4370-b3c1-51d5df2ab889] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:43.636156 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d09f649c-cf19-42a2-bab1-4ddce96284ee tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2" status: 200 len: 1502 microversion: 2.1 time: 0.347914 Aug 24 10:23:43.645398 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1536/2733] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:43 2022] GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2 => generated 1502 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:43.652432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a021781e-878b-48d2-93f5-b03879c2a3fe tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:43.655284 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a021781e-878b-48d2-93f5-b03879c2a3fe tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:43.656459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a021781e-878b-48d2-93f5-b03879c2a3fe tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:43.658461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a021781e-878b-48d2-93f5-b03879c2a3fe tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:43.660725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a021781e-878b-48d2-93f5-b03879c2a3fe tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:43.662078 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a021781e-878b-48d2-93f5-b03879c2a3fe tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:43.670211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8a5eabde-6201-4fad-8bab-d4aaf3d94b00 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-921644752"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:43.671043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8a5eabde-6201-4fad-8bab-d4aaf3d94b00 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: d49761ab-ce76-45fc-9754-3366ce58e6b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:43.691071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a5eabde-6201-4fad-8bab-d4aaf3d94b00 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:43.692142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a5eabde-6201-4fad-8bab-d4aaf3d94b00 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:43.692599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a5eabde-6201-4fad-8bab-d4aaf3d94b00 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:43.693375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a5eabde-6201-4fad-8bab-d4aaf3d94b00 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:43.693845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a5eabde-6201-4fad-8bab-d4aaf3d94b00 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:43.694286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a5eabde-6201-4fad-8bab-d4aaf3d94b00 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:44.030368 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.network.security_group_api [None req-8a5eabde-6201-4fad-8bab-d4aaf3d94b00 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Adding security group 793a5ba6-48d2-42fa-b06a-27dbe0fd880d to port 29f51102-f85d-465a-b06a-dc1cf699dbf4 Aug 24 10:23:45.028604 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8a5eabde-6201-4fad-8bab-d4aaf3d94b00 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "POST /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2/action" status: 202 len: 0 microversion: 2.1 time: 1.362894 Aug 24 10:23:45.033834 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1537/2734] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:23:43 2022] POST /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2/action => generated 0 bytes in 1365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 10:23:45.037056 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-58703816-e8b2-427e-a966-8ad7074a5940 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:45.037748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-58703816-e8b2-427e-a966-8ad7074a5940 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:45.056611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58703816-e8b2-427e-a966-8ad7074a5940 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:45.057309 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58703816-e8b2-427e-a966-8ad7074a5940 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:45.057581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58703816-e8b2-427e-a966-8ad7074a5940 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:45.059375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58703816-e8b2-427e-a966-8ad7074a5940 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:45.059841 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58703816-e8b2-427e-a966-8ad7074a5940 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:45.060401 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58703816-e8b2-427e-a966-8ad7074a5940 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:45.324229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-58703816-e8b2-427e-a966-8ad7074a5940 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:45.375264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-58703816-e8b2-427e-a966-8ad7074a5940 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:45.386551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-58703816-e8b2-427e-a966-8ad7074a5940 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:45.392740 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-58703816-e8b2-427e-a966-8ad7074a5940 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1408 microversion: 2.54 time: 0.359237 Aug 24 10:23:45.409992 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1538/2735] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:45 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1408 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:45.422327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-93ccc3ac-cf9c-4f49-9f88-398c60935c48 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:45.423106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-93ccc3ac-cf9c-4f49-9f88-398c60935c48 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 56dc2f7d-cae7-4b36-81e0-594f9b5a0623] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:45.452479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93ccc3ac-cf9c-4f49-9f88-398c60935c48 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:45.453232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93ccc3ac-cf9c-4f49-9f88-398c60935c48 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:45.453681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93ccc3ac-cf9c-4f49-9f88-398c60935c48 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:45.455305 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93ccc3ac-cf9c-4f49-9f88-398c60935c48 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:45.456943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93ccc3ac-cf9c-4f49-9f88-398c60935c48 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:45.457406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93ccc3ac-cf9c-4f49-9f88-398c60935c48 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:45.606334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a021781e-878b-48d2-93f5-b03879c2a3fe tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b28596ad9a4f259695e4705ae02f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f539617fa0074e2fbd6aaedc8b63773f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:45.622403 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a021781e-878b-48d2-93f5-b03879c2a3fe tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] 10.222.0.85 "GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889" status: 200 len: 1324 microversion: 2.1 time: 1.994846 Aug 24 10:23:45.627581 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1198/2736] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:43 2022] GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889 => generated 1324 bytes in 2008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:23:45.641245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aedc81d3-7974-47e0-aa13-0d5f0305b27e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:45.647013 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aedc81d3-7974-47e0-aa13-0d5f0305b27e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:45.681313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aedc81d3-7974-47e0-aa13-0d5f0305b27e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:45.694479 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aedc81d3-7974-47e0-aa13-0d5f0305b27e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:45.695145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aedc81d3-7974-47e0-aa13-0d5f0305b27e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:45.696833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aedc81d3-7974-47e0-aa13-0d5f0305b27e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:45.698397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aedc81d3-7974-47e0-aa13-0d5f0305b27e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:45.704244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aedc81d3-7974-47e0-aa13-0d5f0305b27e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:45.857277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-93ccc3ac-cf9c-4f49-9f88-398c60935c48 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:45.882409 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-93ccc3ac-cf9c-4f49-9f88-398c60935c48 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623" status: 200 len: 1315 microversion: 2.1 time: 0.478238 Aug 24 10:23:45.888360 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1539/2737] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:45 2022] GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623 => generated 1315 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:45.905029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e0e30273-c19d-470d-9eea-d27255f1f44d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2002121794"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:45.910009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e0e30273-c19d-470d-9eea-d27255f1f44d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: d49761ab-ce76-45fc-9754-3366ce58e6b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:45.934086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0e30273-c19d-470d-9eea-d27255f1f44d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:45.937503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0e30273-c19d-470d-9eea-d27255f1f44d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:45.940295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0e30273-c19d-470d-9eea-d27255f1f44d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:45.942411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0e30273-c19d-470d-9eea-d27255f1f44d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:45.945099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0e30273-c19d-470d-9eea-d27255f1f44d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:45.946018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0e30273-c19d-470d-9eea-d27255f1f44d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:46.329640 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.network.security_group_api [None req-e0e30273-c19d-470d-9eea-d27255f1f44d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Adding security group ca675845-4e4a-416b-9e8f-d6bd827cffaf to port 29f51102-f85d-465a-b06a-dc1cf699dbf4 Aug 24 10:23:46.417347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aedc81d3-7974-47e0-aa13-0d5f0305b27e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:46.436507 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aedc81d3-7974-47e0-aa13-0d5f0305b27e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d" status: 200 len: 1333 microversion: 2.1 time: 0.807457 Aug 24 10:23:46.438105 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1199/2738] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:45 2022] GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d => generated 1333 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:46.451138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-de403c97-61cd-499c-a3bf-7a42131db487 req-4d17d8f2-2cc1-42ad-82b2-fbce1d84ea68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d49761ab-ce76-45fc-9754-3366ce58e6b2", "tag": "29f51102-f85d-465a-b06a-dc1cf699dbf4"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:46.483475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-de403c97-61cd-499c-a3bf-7a42131db487 req-4d17d8f2-2cc1-42ad-82b2-fbce1d84ea68 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:46.486979 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-de403c97-61cd-499c-a3bf-7a42131db487 req-4d17d8f2-2cc1-42ad-82b2-fbce1d84ea68 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:46.487730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-de403c97-61cd-499c-a3bf-7a42131db487 req-4d17d8f2-2cc1-42ad-82b2-fbce1d84ea68 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:46.520018 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-de403c97-61cd-499c-a3bf-7a42131db487 req-4d17d8f2-2cc1-42ad-82b2-fbce1d84ea68 service nova] Creating event network-changed:29f51102-f85d-465a-b06a-dc1cf699dbf4 for instance d49761ab-ce76-45fc-9754-3366ce58e6b2 on n-h1-849328-3 Aug 24 10:23:46.536430 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-de403c97-61cd-499c-a3bf-7a42131db487 req-4d17d8f2-2cc1-42ad-82b2-fbce1d84ea68 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096813 Aug 24 10:23:46.537791 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1200/2739] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:46.545877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-162d0a34-a61f-4912-8d69-4b6d0be4ad45 req-5c3ad337-11f5-445c-ab55-ddbb944c21d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56dc2f7d-cae7-4b36-81e0-594f9b5a0623", "name": "network-vif-plugged", "status": "completed", "tag": "7139550e-c163-4eac-8f5a-900b59ce79b0"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:46.575832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-162d0a34-a61f-4912-8d69-4b6d0be4ad45 req-5c3ad337-11f5-445c-ab55-ddbb944c21d7 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:46.579608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-162d0a34-a61f-4912-8d69-4b6d0be4ad45 req-5c3ad337-11f5-445c-ab55-ddbb944c21d7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:46.581274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-162d0a34-a61f-4912-8d69-4b6d0be4ad45 req-5c3ad337-11f5-445c-ab55-ddbb944c21d7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:46.611634 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-162d0a34-a61f-4912-8d69-4b6d0be4ad45 req-5c3ad337-11f5-445c-ab55-ddbb944c21d7 service nova] Creating event network-vif-plugged:7139550e-c163-4eac-8f5a-900b59ce79b0 for instance 56dc2f7d-cae7-4b36-81e0-594f9b5a0623 on n-h1-849328-3 Aug 24 10:23:46.626690 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-162d0a34-a61f-4912-8d69-4b6d0be4ad45 req-5c3ad337-11f5-445c-ab55-ddbb944c21d7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087258 Aug 24 10:23:46.627904 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1201/2740] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:46.639969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-117a2d70-4de8-499c-bb45-a0c65c588f5e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:46.641793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-117a2d70-4de8-499c-bb45-a0c65c588f5e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:46.657483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-117a2d70-4de8-499c-bb45-a0c65c588f5e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:46.663843 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-117a2d70-4de8-499c-bb45-a0c65c588f5e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:46.664589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-117a2d70-4de8-499c-bb45-a0c65c588f5e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:46.665959 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-117a2d70-4de8-499c-bb45-a0c65c588f5e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:46.669220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-117a2d70-4de8-499c-bb45-a0c65c588f5e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:46.670020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-117a2d70-4de8-499c-bb45-a0c65c588f5e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:46.824417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-117a2d70-4de8-499c-bb45-a0c65c588f5e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:46.839569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-117a2d70-4de8-499c-bb45-a0c65c588f5e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:46.844093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-117a2d70-4de8-499c-bb45-a0c65c588f5e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:46.845367 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-117a2d70-4de8-499c-bb45-a0c65c588f5e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1408 microversion: 2.54 time: 0.216027 Aug 24 10:23:46.854020 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1202/2741] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:46 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:46.870442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aa791183-423c-48e1-a11f-3dc3ca24f73e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:46.871566 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aa791183-423c-48e1-a11f-3dc3ca24f73e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] [instance: 98710ee1-1634-4370-b3c1-51d5df2ab889] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:46.901641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa791183-423c-48e1-a11f-3dc3ca24f73e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:46.906380 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa791183-423c-48e1-a11f-3dc3ca24f73e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:46.908540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa791183-423c-48e1-a11f-3dc3ca24f73e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:46.912319 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa791183-423c-48e1-a11f-3dc3ca24f73e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:46.913187 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa791183-423c-48e1-a11f-3dc3ca24f73e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:46.914631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa791183-423c-48e1-a11f-3dc3ca24f73e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:47.290952 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e0e30273-c19d-470d-9eea-d27255f1f44d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "POST /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2/action" status: 202 len: 0 microversion: 2.1 time: 1.397576 Aug 24 10:23:47.291794 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1540/2742] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:23:45 2022] POST /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2/action => generated 0 bytes in 1403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:23:47.297355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-334acab0-ca4e-4e45-9f7f-a45df4600ee0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:47.298146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-334acab0-ca4e-4e45-9f7f-a45df4600ee0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 56dc2f7d-cae7-4b36-81e0-594f9b5a0623] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:47.314561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-334acab0-ca4e-4e45-9f7f-a45df4600ee0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:47.315510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-334acab0-ca4e-4e45-9f7f-a45df4600ee0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:47.321472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-334acab0-ca4e-4e45-9f7f-a45df4600ee0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:47.324475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-334acab0-ca4e-4e45-9f7f-a45df4600ee0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:47.325158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-334acab0-ca4e-4e45-9f7f-a45df4600ee0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:47.325712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-334acab0-ca4e-4e45-9f7f-a45df4600ee0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:47.541255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aa791183-423c-48e1-a11f-3dc3ca24f73e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b28596ad9a4f259695e4705ae02f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f539617fa0074e2fbd6aaedc8b63773f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:47.560696 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aa791183-423c-48e1-a11f-3dc3ca24f73e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] 10.222.0.85 "GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889" status: 200 len: 1520 microversion: 2.1 time: 0.704655 Aug 24 10:23:47.574283 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1203/2743] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:46 2022] GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889 => generated 1520 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:47.580585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e3c88baa-9588-4330-865a-f303a63275b4 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:47.585494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e3c88baa-9588-4330-865a-f303a63275b4 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: d49761ab-ce76-45fc-9754-3366ce58e6b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:47.606784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3c88baa-9588-4330-865a-f303a63275b4 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:47.608050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3c88baa-9588-4330-865a-f303a63275b4 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:47.613642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3c88baa-9588-4330-865a-f303a63275b4 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:47.615685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3c88baa-9588-4330-865a-f303a63275b4 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:47.616939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3c88baa-9588-4330-865a-f303a63275b4 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:47.617828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3c88baa-9588-4330-865a-f303a63275b4 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:47.630080 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:47.737552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-334acab0-ca4e-4e45-9f7f-a45df4600ee0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:47.749574 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-334acab0-ca4e-4e45-9f7f-a45df4600ee0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623" status: 200 len: 1315 microversion: 2.1 time: 0.456513 Aug 24 10:23:47.751130 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1541/2744] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:47 2022] GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623 => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:48.017473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fb56d0b8-3143-4fe0-a959-9c2e1cc833b2 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Calling method '.version_select at 0x7f4654688c10>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:48.236712 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fb56d0b8-3143-4fe0-a959-9c2e1cc833b2 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] 10.222.0.85 "GET /compute/v2.1/os-quota-sets/cc6acbc2888140e599fcf7b4e975d737" status: 200 len: 371 microversion: 2.1 time: 0.483779 Aug 24 10:23:48.240973 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1542/2745] 10.222.0.85 () {58 vars in 1242 bytes} [Wed Aug 24 10:23:47 2022] GET /compute/v2.1/os-quota-sets/cc6acbc2888140e599fcf7b4e975d737 => generated 371 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:48.258210 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-62f56c06-5678-43b0-9cf5-826e5bc9ae6a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:48.260916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-62f56c06-5678-43b0-9cf5-826e5bc9ae6a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:48.273727 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62f56c06-5678-43b0-9cf5-826e5bc9ae6a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:48.274478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62f56c06-5678-43b0-9cf5-826e5bc9ae6a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:48.275114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62f56c06-5678-43b0-9cf5-826e5bc9ae6a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:48.276001 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62f56c06-5678-43b0-9cf5-826e5bc9ae6a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:48.277431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62f56c06-5678-43b0-9cf5-826e5bc9ae6a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:48.278038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62f56c06-5678-43b0-9cf5-826e5bc9ae6a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:48.435807 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e3c88baa-9588-4330-865a-f303a63275b4 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.859810 Aug 24 10:23:48.437053 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1204/2746] 10.222.0.85 () {58 vars in 1293 bytes} [Wed Aug 24 10:23:47 2022] GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2/os-security-groups => generated 1158 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:48.443311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bff0c4f1-c7e2-4aad-b2fc-477d4fa51150 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:48.443922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bff0c4f1-c7e2-4aad-b2fc-477d4fa51150 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] [instance: 98710ee1-1634-4370-b3c1-51d5df2ab889] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:48.475417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bff0c4f1-c7e2-4aad-b2fc-477d4fa51150 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:48.478306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bff0c4f1-c7e2-4aad-b2fc-477d4fa51150 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:48.478912 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bff0c4f1-c7e2-4aad-b2fc-477d4fa51150 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:48.479753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bff0c4f1-c7e2-4aad-b2fc-477d4fa51150 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:48.482941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bff0c4f1-c7e2-4aad-b2fc-477d4fa51150 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:48.485278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bff0c4f1-c7e2-4aad-b2fc-477d4fa51150 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:48.641834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-62f56c06-5678-43b0-9cf5-826e5bc9ae6a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:48.665558 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-62f56c06-5678-43b0-9cf5-826e5bc9ae6a tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d" status: 200 len: 1333 microversion: 2.1 time: 0.422978 Aug 24 10:23:48.668074 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-bff0c4f1-c7e2-4aad-b2fc-477d4fa51150 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] HTTP exception thrown: Instance is not a member of specified network Aug 24 10:23:48.674599 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1543/2747] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:48 2022] GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d => generated 1333 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bff0c4f1-c7e2-4aad-b2fc-477d4fa51150 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Request method failure captured: Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889/ips/invalid HTTP/1.1 Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfwQESrg0C9Q2jkCFeeI6GcT74LQZSK2LKfrU9c6OmuUzAOdUYj2l0gc2OATLtYBjmpkxxJ7fjI5DKtnwoXUW30e3L-asio_y2-09Nf3LfbhonsRy7rrMErV-7tp-MIQ2LPKr5uAEDGYpzrQw-Ule5VkvEmXEwJdTzur9R5_wt7sjc0 Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: f539617fa0074e2fbd6aaedc8b63773f Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1310719998 Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f539617fa0074e2fbd6aaedc8b63773f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f539617fa0074e2fbd6aaedc8b63773f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f539617fa0074e2fbd6aaedc8b63773f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f539617fa0074e2fbd6aaedc8b63773f"}]}] Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1310719998 Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: f539617fa0074e2fbd6aaedc8b63773f Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1310719998 Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerAddressesNegativeTestJSON-1310719998-project Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: f0b28596ad9a4f259695e4705ae02f4e Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1310719998-project Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance is not a member of specified network Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'server_id': '98710ee1-1634-4370-b3c1-51d5df2ab889', 'id': 'invalid'} Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 24 10:23:48.680002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:48.684134 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bff0c4f1-c7e2-4aad-b2fc-477d4fa51150 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Returning 404 to user: Instance is not a member of specified network {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:48.686942 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bff0c4f1-c7e2-4aad-b2fc-477d4fa51150 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] 10.222.0.85 "GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.243382 Aug 24 10:23:48.688060 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1205/2748] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:23:48 2022] GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889/ips/invalid => generated 91 bytes in 250 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:23:48.694069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ae3a327-f81e-4a96-beba-ebb408b08064 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:48.696804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0ae3a327-f81e-4a96-beba-ebb408b08064 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:48.699225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a0600239-02f8-4b9f-8d1f-2b96c650bcbe tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Action: 'update', calling method: .version_select at 0x7f46543550d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:48.713880 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ae3a327-f81e-4a96-beba-ebb408b08064 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:48.717089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ae3a327-f81e-4a96-beba-ebb408b08064 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:48.718826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ae3a327-f81e-4a96-beba-ebb408b08064 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:48.720851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ae3a327-f81e-4a96-beba-ebb408b08064 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:48.721521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ae3a327-f81e-4a96-beba-ebb408b08064 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:48.725583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ae3a327-f81e-4a96-beba-ebb408b08064 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:48.725794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:48.762804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=26 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:48.890000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0600239-02f8-4b9f-8d1f-2b96c650bcbe tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:48.894214 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0600239-02f8-4b9f-8d1f-2b96c650bcbe tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:48.896779 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0600239-02f8-4b9f-8d1f-2b96c650bcbe tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:48.900894 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0600239-02f8-4b9f-8d1f-2b96c650bcbe tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:48.903463 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0600239-02f8-4b9f-8d1f-2b96c650bcbe tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:48.904402 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0600239-02f8-4b9f-8d1f-2b96c650bcbe tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:48.931718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0ae3a327-f81e-4a96-beba-ebb408b08064 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:48.950583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0ae3a327-f81e-4a96-beba-ebb408b08064 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:48.952537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0ae3a327-f81e-4a96-beba-ebb408b08064 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:48.954026 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0ae3a327-f81e-4a96-beba-ebb408b08064 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1408 microversion: 2.54 time: 0.275674 Aug 24 10:23:48.955079 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1544/2749] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:48 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1408 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:48.966128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8c6c7700-8f0e-4643-b5a1-cf75c886f491 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Action: 'create', calling method: .version_select at 0x7f4654688310>, body: {"security_group": {"name": " tempest-securitygroup -291480242 ", "description": "tempest-description-556725304"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:48.975584 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:49.136129 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a0600239-02f8-4b9f-8d1f-2b96c650bcbe tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-quota-sets/cc6acbc2888140e599fcf7b4e975d737" status: 200 len: 328 microversion: 2.1 time: 0.443401 Aug 24 10:23:49.139715 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1206/2750] 10.222.0.85 () {60 vars in 1262 bytes} [Wed Aug 24 10:23:48 2022] PUT /compute/v2.1/os-quota-sets/cc6acbc2888140e599fcf7b4e975d737 => generated 328 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:49.151879 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-111130ed-a0f3-4a97-8163-724f31d57cf8 req-6203ccda-40b4-42b0-88d8-fb1ec49d853f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d49761ab-ce76-45fc-9754-3366ce58e6b2", "tag": "29f51102-f85d-465a-b06a-dc1cf699dbf4"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:49.191367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-111130ed-a0f3-4a97-8163-724f31d57cf8 req-6203ccda-40b4-42b0-88d8-fb1ec49d853f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:49.192629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-111130ed-a0f3-4a97-8163-724f31d57cf8 req-6203ccda-40b4-42b0-88d8-fb1ec49d853f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:49.193431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-111130ed-a0f3-4a97-8163-724f31d57cf8 req-6203ccda-40b4-42b0-88d8-fb1ec49d853f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:49.219295 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-111130ed-a0f3-4a97-8163-724f31d57cf8 req-6203ccda-40b4-42b0-88d8-fb1ec49d853f service nova] Creating event network-changed:29f51102-f85d-465a-b06a-dc1cf699dbf4 for instance d49761ab-ce76-45fc-9754-3366ce58e6b2 on n-h1-849328-3 Aug 24 10:23:49.231126 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-111130ed-a0f3-4a97-8163-724f31d57cf8 req-6203ccda-40b4-42b0-88d8-fb1ec49d853f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087805 Aug 24 10:23:49.233360 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1207/2751] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:49.252509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f1bec119-83cd-4044-a364-49c046de9156 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:49.254595 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f1bec119-83cd-4044-a364-49c046de9156 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Failed to fetch instance by id 999 {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 24 10:23:49.255753 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-f1bec119-83cd-4044-a364-49c046de9156 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] HTTP exception thrown: Instance 999 could not be found. Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f1bec119-83cd-4044-a364-49c046de9156 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Request method failure captured: Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfwQESrg0C9Q2jkCFeeI6GcT74LQZSK2LKfrU9c6OmuUzAOdUYj2l0gc2OATLtYBjmpkxxJ7fjI5DKtnwoXUW30e3L-asio_y2-09Nf3LfbhonsRy7rrMErV-7tp-MIQ2LPKr5uAEDGYpzrQw-Ule5VkvEmXEwJdTzur9R5_wt7sjc0 Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: f539617fa0074e2fbd6aaedc8b63773f Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1310719998 Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f539617fa0074e2fbd6aaedc8b63773f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f539617fa0074e2fbd6aaedc8b63773f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f539617fa0074e2fbd6aaedc8b63773f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f539617fa0074e2fbd6aaedc8b63773f"}]}] Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1310719998 Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: f539617fa0074e2fbd6aaedc8b63773f Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1310719998 Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerAddressesNegativeTestJSON-1310719998-project Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: f0b28596ad9a4f259695e4705ae02f4e Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1310719998-project Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 999 could not be found. Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'server_id': '999'} Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 24 10:23:49.262310 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:49.272508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f1bec119-83cd-4044-a364-49c046de9156 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Returning 404 to user: Instance 999 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:49.274544 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f1bec119-83cd-4044-a364-49c046de9156 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] 10.222.0.85 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.038213 Aug 24 10:23:49.276222 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1208/2752] 10.222.0.85 () {58 vars in 1149 bytes} [Wed Aug 24 10:23:49 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:23:49.287388 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8c03de23-ec95-44e3-bc11-07ec488951d1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:49.289517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8c03de23-ec95-44e3-bc11-07ec488951d1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 56dc2f7d-cae7-4b36-81e0-594f9b5a0623] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:49.299676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c03de23-ec95-44e3-bc11-07ec488951d1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:49.300417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c03de23-ec95-44e3-bc11-07ec488951d1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:49.301793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c03de23-ec95-44e3-bc11-07ec488951d1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:49.302859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c03de23-ec95-44e3-bc11-07ec488951d1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:49.303730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c03de23-ec95-44e3-bc11-07ec488951d1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:49.304370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c03de23-ec95-44e3-bc11-07ec488951d1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:49.348024 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8c6c7700-8f0e-4643-b5a1-cf75c886f491 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.386608 Aug 24 10:23:49.349170 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1545/2753] 10.222.0.85 () {60 vars in 1180 bytes} [Wed Aug 24 10:23:48 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:49.367395 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8fbfbc23-ade8-4406-aec6-63b4a457365f req-bb5e7f0d-2898-4a80-9f1d-b204c6761780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a02ab88-8424-479f-8bdd-d1e671d8bb6d", "tag": "1445ad95-4177-419a-9130-67c0f1f9162a"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:49.413033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8fbfbc23-ade8-4406-aec6-63b4a457365f req-bb5e7f0d-2898-4a80-9f1d-b204c6761780 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:49.413731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8fbfbc23-ade8-4406-aec6-63b4a457365f req-bb5e7f0d-2898-4a80-9f1d-b204c6761780 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:49.414341 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8fbfbc23-ade8-4406-aec6-63b4a457365f req-bb5e7f0d-2898-4a80-9f1d-b204c6761780 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:49.427063 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8fbfbc23-ade8-4406-aec6-63b4a457365f req-bb5e7f0d-2898-4a80-9f1d-b204c6761780 service nova] Creating event network-changed:1445ad95-4177-419a-9130-67c0f1f9162a for instance 0a02ab88-8424-479f-8bdd-d1e671d8bb6d on n-h2-849328-3 Aug 24 10:23:49.433891 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8fbfbc23-ade8-4406-aec6-63b4a457365f req-bb5e7f0d-2898-4a80-9f1d-b204c6761780 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082855 Aug 24 10:23:49.435888 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1546/2754] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:49.447368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d9d8db33-6de2-4937-9eb0-157126eb3305 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:49.465393 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d9d8db33-6de2-4937-9eb0-157126eb3305 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] 10.222.0.85 "DELETE /compute/v2.1/os-quota-sets/cc6acbc2888140e599fcf7b4e975d737" status: 202 len: 0 microversion: 2.1 time: 0.025756 Aug 24 10:23:49.472951 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1547/2755] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Aug 24 10:23:49 2022] DELETE /compute/v2.1/os-quota-sets/cc6acbc2888140e599fcf7b4e975d737 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:23:49.500689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5e63cba2-65c4-4b8f-a1fb-116e54585b8e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:49.501681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5e63cba2-65c4-4b8f-a1fb-116e54585b8e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] [instance: 98710ee1-1634-4370-b3c1-51d5df2ab889] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:49.519518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e63cba2-65c4-4b8f-a1fb-116e54585b8e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:49.520327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e63cba2-65c4-4b8f-a1fb-116e54585b8e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:49.520982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e63cba2-65c4-4b8f-a1fb-116e54585b8e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:49.521944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e63cba2-65c4-4b8f-a1fb-116e54585b8e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:49.524921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e63cba2-65c4-4b8f-a1fb-116e54585b8e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:49.525656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e63cba2-65c4-4b8f-a1fb-116e54585b8e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:49.607561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5e63cba2-65c4-4b8f-a1fb-116e54585b8e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] [instance: 98710ee1-1634-4370-b3c1-51d5df2ab889] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:23:49.744832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:49.800662 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5e63cba2-65c4-4b8f-a1fb-116e54585b8e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] 10.222.0.85 "DELETE /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889" status: 204 len: 0 microversion: 2.1 time: 0.325418 Aug 24 10:23:49.803136 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1548/2756] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:23:49 2022] DELETE /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:23:49.822781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-415d2f0e-0c0b-4b9e-8734-12f6f64dd59a tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '.version_select at 0x7f4647e3b0d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:49.949734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8c03de23-ec95-44e3-bc11-07ec488951d1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:49.959787 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-415d2f0e-0c0b-4b9e-8734-12f6f64dd59a tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/os-security-groups/827c7833-673e-484f-a39c-967a1f016e3e" status: 200 len: 222 microversion: 2.1 time: 0.154667 Aug 24 10:23:49.960693 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1549/2757] 10.222.0.85 () {58 vars in 1269 bytes} [Wed Aug 24 10:23:49 2022] GET /compute/v2.1/os-security-groups/827c7833-673e-484f-a39c-967a1f016e3e => generated 222 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:49.981555 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3b7a56b1-86d6-4af8-98ae-79da90f77b56 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Calling method '.version_select at 0x7f4647e3b1f0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:49.988858 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8c03de23-ec95-44e3-bc11-07ec488951d1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623" status: 200 len: 1502 microversion: 2.1 time: 0.710707 Aug 24 10:23:49.989808 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1209/2758] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:49 2022] GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623 => generated 1502 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:50.013261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-922b7791-f0a5-48fc-bf37-7bd7335c0d60 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:50.013979 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-922b7791-f0a5-48fc-bf37-7bd7335c0d60 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:50.022641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-922b7791-f0a5-48fc-bf37-7bd7335c0d60 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:50.023573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-922b7791-f0a5-48fc-bf37-7bd7335c0d60 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:50.024703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-922b7791-f0a5-48fc-bf37-7bd7335c0d60 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:50.026220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-922b7791-f0a5-48fc-bf37-7bd7335c0d60 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:50.026968 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-922b7791-f0a5-48fc-bf37-7bd7335c0d60 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:50.027751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-922b7791-f0a5-48fc-bf37-7bd7335c0d60 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:50.129456 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3b7a56b1-86d6-4af8-98ae-79da90f77b56 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] 10.222.0.85 "GET /compute/v2.1/os-quota-sets/cc6acbc2888140e599fcf7b4e975d737" status: 200 len: 371 microversion: 2.1 time: 0.155506 Aug 24 10:23:50.130651 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1550/2759] 10.222.0.85 () {58 vars in 1242 bytes} [Wed Aug 24 10:23:49 2022] GET /compute/v2.1/os-quota-sets/cc6acbc2888140e599fcf7b4e975d737 => generated 371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:50.137437 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e86444e0-96cf-4c89-bce7-a917f371d51e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:50.139316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e86444e0-96cf-4c89-bce7-a917f371d51e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] [instance: 98710ee1-1634-4370-b3c1-51d5df2ab889] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:50.153281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e86444e0-96cf-4c89-bce7-a917f371d51e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:50.153281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e86444e0-96cf-4c89-bce7-a917f371d51e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:50.154019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e86444e0-96cf-4c89-bce7-a917f371d51e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:50.155199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e86444e0-96cf-4c89-bce7-a917f371d51e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:50.155975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e86444e0-96cf-4c89-bce7-a917f371d51e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:50.156860 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e86444e0-96cf-4c89-bce7-a917f371d51e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:50.413454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e86444e0-96cf-4c89-bce7-a917f371d51e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b28596ad9a4f259695e4705ae02f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f539617fa0074e2fbd6aaedc8b63773f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:50.427131 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e86444e0-96cf-4c89-bce7-a917f371d51e tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] 10.222.0.85 "GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889" status: 200 len: 1526 microversion: 2.1 time: 0.294065 Aug 24 10:23:50.428477 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1551/2760] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:50 2022] GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889 => generated 1526 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:50.437902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-14648498-9bfe-48f2-932f-8cdf33980d4a tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '.version_select at 0x7f465a2429d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:50.459813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-922b7791-f0a5-48fc-bf37-7bd7335c0d60 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:50.476928 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-922b7791-f0a5-48fc-bf37-7bd7335c0d60 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d" status: 200 len: 1333 microversion: 2.1 time: 0.474054 Aug 24 10:23:50.477855 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1210/2761] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:50 2022] GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d => generated 1333 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:50.490848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e283eae5-b282-4ab2-9b08-dc7c53a7b9d7 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:50.492335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e283eae5-b282-4ab2-9b08-dc7c53a7b9d7 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:50.506674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e283eae5-b282-4ab2-9b08-dc7c53a7b9d7 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:50.511792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e283eae5-b282-4ab2-9b08-dc7c53a7b9d7 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:50.513905 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e283eae5-b282-4ab2-9b08-dc7c53a7b9d7 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:50.518879 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e283eae5-b282-4ab2-9b08-dc7c53a7b9d7 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:50.519361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e283eae5-b282-4ab2-9b08-dc7c53a7b9d7 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:50.520473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e283eae5-b282-4ab2-9b08-dc7c53a7b9d7 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:50.656844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e283eae5-b282-4ab2-9b08-dc7c53a7b9d7 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:50.684433 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e283eae5-b282-4ab2-9b08-dc7c53a7b9d7 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:50.686646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e283eae5-b282-4ab2-9b08-dc7c53a7b9d7 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:50.688309 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e283eae5-b282-4ab2-9b08-dc7c53a7b9d7 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1408 microversion: 2.54 time: 0.209798 Aug 24 10:23:50.689389 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1211/2762] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:50 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:50.698186 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-724143e3-feb9-46dd-abf3-da148ffbcec4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:50.698976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-724143e3-feb9-46dd-abf3-da148ffbcec4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 56dc2f7d-cae7-4b36-81e0-594f9b5a0623] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:50.707957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-724143e3-feb9-46dd-abf3-da148ffbcec4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:50.708705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-724143e3-feb9-46dd-abf3-da148ffbcec4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:50.709327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-724143e3-feb9-46dd-abf3-da148ffbcec4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:50.710190 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-724143e3-feb9-46dd-abf3-da148ffbcec4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:50.710824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-724143e3-feb9-46dd-abf3-da148ffbcec4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:50.712324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-724143e3-feb9-46dd-abf3-da148ffbcec4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:50.757678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-724143e3-feb9-46dd-abf3-da148ffbcec4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 56dc2f7d-cae7-4b36-81e0-594f9b5a0623] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:23:50.761751 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-14648498-9bfe-48f2-932f-8cdf33980d4a tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/827c7833-673e-484f-a39c-967a1f016e3e" status: 202 len: 0 microversion: 2.1 time: 0.331404 Aug 24 10:23:50.762760 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1552/2763] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:23:50 2022] DELETE /compute/v2.1/os-security-groups/827c7833-673e-484f-a39c-967a1f016e3e => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:23:50.768438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9e6f6e9f-d324-4568-8b88-30a9df3566bc tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Calling method '.version_select at 0x7f465a242820>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:50.968020 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-724143e3-feb9-46dd-abf3-da148ffbcec4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "DELETE /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623" status: 204 len: 0 microversion: 2.1 time: 0.274829 Aug 24 10:23:50.969054 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1212/2764] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:23:50 2022] DELETE /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:23:50.981369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9e786f71-ce9b-4500-ad4e-45318a4cbd6f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '.version_select at 0x7f465a215e50>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:51.025977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG neutronclient.v2_0.client [None req-9e786f71-ce9b-4500-ad4e-45318a4cbd6f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 827c7833-673e-484f-a39c-967a1f016e3e does not exist", "detail": ""}} {{(pid=122432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 10:23:51.026591 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.security_group_api [None req-9e786f71-ce9b-4500-ad4e-45318a4cbd6f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Neutron security group 827c7833-673e-484f-a39c-967a1f016e3e not found {{(pid=122432) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 10:23:51.027121 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-9e786f71-ce9b-4500-ad4e-45318a4cbd6f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] HTTP exception thrown: Security group 827c7833-673e-484f-a39c-967a1f016e3e does not exist Aug 24 10:23:51.027121 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-c5d8a380-92b0-4d32-82d9-9f6ed83c4966'] Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9e786f71-ce9b-4500-ad4e-45318a4cbd6f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Request method failure captured: Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-security-groups/827c7833-673e-484f-a39c-967a1f016e3e HTTP/1.1 Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfwP4tkKyJr5Gg7qNaTDv0qB585z-EGLWhAIlAiiw7niuSBtf4-Q9XJ2RClgHF5tG0tqoI1dsizKyw5H-SwLhXdRiM6qVR9NPoSFDWFDAiYHpCUOyNdaDsUmsdQydv3MYAQ3enYS0IGacLv6Rxy4kcYdhL4YEU_p2c-vtfjTt6PXS-o Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_44f050698fc54fb6b8fdf2866472dd7d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/44f050698fc54fb6b8fdf2866472dd7d"}]}] Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: cf7304a4a0bb486fbf52f1c84cad702a Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: exception: Security group 827c7833-673e-484f-a39c-967a1f016e3e does not exist Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-c5d8a380-92b0-4d32-82d9-9f6ed83c4966'] Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '827c7833-673e-484f-a39c-967a1f016e3e'} Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 10:23:51.029068 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 827c7833-673e-484f-a39c-967a1f016e3e does not exist Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5d8a380-92b0-4d32-82d9-9f6ed83c4966'] Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 827c7833-673e-484f-a39c-967a1f016e3e does not exist Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5d8a380-92b0-4d32-82d9-9f6ed83c4966'] Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 827c7833-673e-484f-a39c-967a1f016e3e does not exist Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5d8a380-92b0-4d32-82d9-9f6ed83c4966'] Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 827c7833-673e-484f-a39c-967a1f016e3e does not exist Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5d8a380-92b0-4d32-82d9-9f6ed83c4966'] Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9e786f71-ce9b-4500-ad4e-45318a4cbd6f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Returning 404 to user: Security group 827c7833-673e-484f-a39c-967a1f016e3e does not exist Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-c5d8a380-92b0-4d32-82d9-9f6ed83c4966'] {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9e786f71-ce9b-4500-ad4e-45318a4cbd6f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/os-security-groups/827c7833-673e-484f-a39c-967a1f016e3e" status: 404 len: 194 microversion: 2.1 time: 0.055094 Aug 24 10:23:51.032892 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1213/2765] 10.222.0.85 () {58 vars in 1269 bytes} [Wed Aug 24 10:23:50 2022] GET /compute/v2.1/os-security-groups/827c7833-673e-484f-a39c-967a1f016e3e => generated 194 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:23:51.045290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-90019fbb-457e-4ba4-8062-a05b4ccf9aa5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:51.047063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-90019fbb-457e-4ba4-8062-a05b4ccf9aa5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 56dc2f7d-cae7-4b36-81e0-594f9b5a0623] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:51.055068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90019fbb-457e-4ba4-8062-a05b4ccf9aa5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:51.055762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90019fbb-457e-4ba4-8062-a05b4ccf9aa5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:51.056210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90019fbb-457e-4ba4-8062-a05b4ccf9aa5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:51.057313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90019fbb-457e-4ba4-8062-a05b4ccf9aa5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:51.058118 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90019fbb-457e-4ba4-8062-a05b4ccf9aa5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:51.058868 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90019fbb-457e-4ba4-8062-a05b4ccf9aa5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:51.127567 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9e6f6e9f-d324-4568-8b88-30a9df3566bc tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] 10.222.0.85 "GET /compute/v2.1/os-quota-sets/4f2e107a44134431bc9f69efc1e0463b/defaults" status: 200 len: 371 microversion: 2.1 time: 0.363055 Aug 24 10:23:51.129771 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1553/2766] 10.222.0.85 () {58 vars in 1269 bytes} [Wed Aug 24 10:23:50 2022] GET /compute/v2.1/os-quota-sets/4f2e107a44134431bc9f69efc1e0463b/defaults => generated 371 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:51.136899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-96447a07-c5cf-41be-b7e9-f087eafd9041 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Action: 'create', calling method: .version_select at 0x7f46546885e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-357282344", "description": "tempest-description-182707669"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:51.307230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-90019fbb-457e-4ba4-8062-a05b4ccf9aa5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:51.333045 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-90019fbb-457e-4ba4-8062-a05b4ccf9aa5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623" status: 200 len: 1508 microversion: 2.1 time: 0.299656 Aug 24 10:23:51.353601 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1214/2767] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:51 2022] GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623 => generated 1508 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:51.406289 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-96447a07-c5cf-41be-b7e9-f087eafd9041 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.274135 Aug 24 10:23:51.414578 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1554/2768] 10.222.0.85 () {60 vars in 1180 bytes} [Wed Aug 24 10:23:51 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:51.424597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9bf52792-92c3-41a9-becc-bebfd782ebb2 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Action: 'create', calling method: .version_select at 0x7f465a2d1310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1817291047", "description": "tempest-description-1321571070"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:51.456881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-376a502b-0efa-4008-83e8-c1be0e11d092 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:51.458084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-376a502b-0efa-4008-83e8-c1be0e11d092 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] [instance: 98710ee1-1634-4370-b3c1-51d5df2ab889] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:51.471117 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376a502b-0efa-4008-83e8-c1be0e11d092 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:51.473508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376a502b-0efa-4008-83e8-c1be0e11d092 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:51.474919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376a502b-0efa-4008-83e8-c1be0e11d092 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:51.476704 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376a502b-0efa-4008-83e8-c1be0e11d092 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:51.477565 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376a502b-0efa-4008-83e8-c1be0e11d092 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:51.478282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376a502b-0efa-4008-83e8-c1be0e11d092 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:51.693058 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9bf52792-92c3-41a9-becc-bebfd782ebb2 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.276474 Aug 24 10:23:51.702557 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1215/2769] 10.222.0.85 () {60 vars in 1180 bytes} [Wed Aug 24 10:23:51 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:51.714624 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0c40aae7-7a10-4946-8a1c-736d27e0f779 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:51.716108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0c40aae7-7a10-4946-8a1c-736d27e0f779 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:51.731254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c40aae7-7a10-4946-8a1c-736d27e0f779 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:51.732300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c40aae7-7a10-4946-8a1c-736d27e0f779 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:51.733152 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c40aae7-7a10-4946-8a1c-736d27e0f779 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:51.734098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c40aae7-7a10-4946-8a1c-736d27e0f779 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:51.734685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c40aae7-7a10-4946-8a1c-736d27e0f779 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:51.736166 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c40aae7-7a10-4946-8a1c-736d27e0f779 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:51.991722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0c40aae7-7a10-4946-8a1c-736d27e0f779 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:52.009790 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0c40aae7-7a10-4946-8a1c-736d27e0f779 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d" status: 200 len: 1333 microversion: 2.1 time: 0.313641 Aug 24 10:23:52.010723 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1216/2770] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:51 2022] GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d => generated 1333 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:52.017207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7ee68c90-bc39-49e1-a3f5-9b8131ac6013 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Action: 'update', calling method: .version_select at 0x7f465a2d1ca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:52.258288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ee68c90-bc39-49e1-a3f5-9b8131ac6013 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:52.264109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ee68c90-bc39-49e1-a3f5-9b8131ac6013 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:52.265267 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ee68c90-bc39-49e1-a3f5-9b8131ac6013 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:52.266819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ee68c90-bc39-49e1-a3f5-9b8131ac6013 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:52.269522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ee68c90-bc39-49e1-a3f5-9b8131ac6013 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:52.270483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ee68c90-bc39-49e1-a3f5-9b8131ac6013 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:52.272306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-376a502b-0efa-4008-83e8-c1be0e11d092 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b28596ad9a4f259695e4705ae02f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f539617fa0074e2fbd6aaedc8b63773f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:52.310532 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-376a502b-0efa-4008-83e8-c1be0e11d092 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] 10.222.0.85 "GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889" status: 200 len: 1526 microversion: 2.1 time: 0.862181 Aug 24 10:23:52.326286 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1555/2771] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:51 2022] GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889 => generated 1526 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:52.338207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-569e02ee-a9da-442f-84c0-8d868a0f115c req-3f7d39ac-dfdf-4d68-809c-cb12b3723268 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a02ab88-8424-479f-8bdd-d1e671d8bb6d", "tag": "f559473b-80a3-43ce-8939-16ffa1b2a0de"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:52.364666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-569e02ee-a9da-442f-84c0-8d868a0f115c req-3f7d39ac-dfdf-4d68-809c-cb12b3723268 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:52.369216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-569e02ee-a9da-442f-84c0-8d868a0f115c req-3f7d39ac-dfdf-4d68-809c-cb12b3723268 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:52.369863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-569e02ee-a9da-442f-84c0-8d868a0f115c req-3f7d39ac-dfdf-4d68-809c-cb12b3723268 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:52.393327 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7ee68c90-bc39-49e1-a3f5-9b8131ac6013 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-quota-sets/14cdb37cb5254114beb251eb35cbdf22" status: 200 len: 328 microversion: 2.1 time: 0.379668 Aug 24 10:23:52.405937 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1217/2772] 10.222.0.85 () {60 vars in 1262 bytes} [Wed Aug 24 10:23:52 2022] PUT /compute/v2.1/os-quota-sets/14cdb37cb5254114beb251eb35cbdf22 => generated 328 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:52.419251 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-569e02ee-a9da-442f-84c0-8d868a0f115c req-3f7d39ac-dfdf-4d68-809c-cb12b3723268 service nova] Creating event network-changed:f559473b-80a3-43ce-8939-16ffa1b2a0de for instance 0a02ab88-8424-479f-8bdd-d1e671d8bb6d on n-h2-849328-3 Aug 24 10:23:52.425004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cff4d52d-a298-4684-97ed-707ecbf6887c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Action: 'create', calling method: .version_select at 0x7f46542f3dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-46511574", "description": "tempest-description-1123955828"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:52.434985 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-569e02ee-a9da-442f-84c0-8d868a0f115c req-3f7d39ac-dfdf-4d68-809c-cb12b3723268 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105140 Aug 24 10:23:52.437815 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1556/2773] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:52.454476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3e01ff73-61a9-4fde-ace8-d459a37104ea tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:52.455393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3e01ff73-61a9-4fde-ace8-d459a37104ea tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:52.463149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e01ff73-61a9-4fde-ace8-d459a37104ea tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:52.463870 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e01ff73-61a9-4fde-ace8-d459a37104ea tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:52.464463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e01ff73-61a9-4fde-ace8-d459a37104ea tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:52.465394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e01ff73-61a9-4fde-ace8-d459a37104ea tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:52.466111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e01ff73-61a9-4fde-ace8-d459a37104ea tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:52.466748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e01ff73-61a9-4fde-ace8-d459a37104ea tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:52.636040 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3e01ff73-61a9-4fde-ace8-d459a37104ea tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:52.649910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3e01ff73-61a9-4fde-ace8-d459a37104ea tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:52.655811 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3e01ff73-61a9-4fde-ace8-d459a37104ea tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:52.658853 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3e01ff73-61a9-4fde-ace8-d459a37104ea tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1408 microversion: 2.54 time: 0.219503 Aug 24 10:23:52.659619 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1557/2774] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:52 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1408 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:52.665593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-91565704-38ca-4fab-9487-82c31e88e485 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:52.667354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-91565704-38ca-4fab-9487-82c31e88e485 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 56dc2f7d-cae7-4b36-81e0-594f9b5a0623] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:52.675303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91565704-38ca-4fab-9487-82c31e88e485 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:52.676084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91565704-38ca-4fab-9487-82c31e88e485 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:52.676972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91565704-38ca-4fab-9487-82c31e88e485 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:52.678001 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91565704-38ca-4fab-9487-82c31e88e485 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:52.679831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91565704-38ca-4fab-9487-82c31e88e485 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:52.680416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91565704-38ca-4fab-9487-82c31e88e485 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:52.906006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-91565704-38ca-4fab-9487-82c31e88e485 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:52.918110 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-91565704-38ca-4fab-9487-82c31e88e485 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623" status: 200 len: 1508 microversion: 2.1 time: 0.257196 Aug 24 10:23:52.919424 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1558/2775] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:52 2022] GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623 => generated 1508 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:52.926647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-47f6e7e9-68e2-4f35-b2a6-40a8b58139c6 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Calling method '.version_select at 0x7f465a242c10>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:53.105590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47f6e7e9-68e2-4f35-b2a6-40a8b58139c6 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:53.106793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47f6e7e9-68e2-4f35-b2a6-40a8b58139c6 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:53.107760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47f6e7e9-68e2-4f35-b2a6-40a8b58139c6 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:53.109869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47f6e7e9-68e2-4f35-b2a6-40a8b58139c6 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:53.111096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47f6e7e9-68e2-4f35-b2a6-40a8b58139c6 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:53.112095 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47f6e7e9-68e2-4f35-b2a6-40a8b58139c6 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:53.160986 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-47f6e7e9-68e2-4f35-b2a6-40a8b58139c6 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] 10.222.0.85 "GET /compute/v2.1/os-quota-sets/14cdb37cb5254114beb251eb35cbdf22/detail" status: 200 len: 916 microversion: 2.1 time: 0.239729 Aug 24 10:23:53.163138 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1559/2776] 10.222.0.85 () {58 vars in 1263 bytes} [Wed Aug 24 10:23:52 2022] GET /compute/v2.1/os-quota-sets/14cdb37cb5254114beb251eb35cbdf22/detail => generated 916 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:53.180332 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3bb690df-f094-4928-b82d-063c2d9aec57 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:53.181268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3bb690df-f094-4928-b82d-063c2d9aec57 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:53.191166 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bb690df-f094-4928-b82d-063c2d9aec57 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:53.192431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bb690df-f094-4928-b82d-063c2d9aec57 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:53.193273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bb690df-f094-4928-b82d-063c2d9aec57 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:53.194197 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bb690df-f094-4928-b82d-063c2d9aec57 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:53.194976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bb690df-f094-4928-b82d-063c2d9aec57 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:53.195709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bb690df-f094-4928-b82d-063c2d9aec57 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:53.330521 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cff4d52d-a298-4684-97ed-707ecbf6887c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.924348 Aug 24 10:23:53.332104 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1218/2777] 10.222.0.85 () {60 vars in 1180 bytes} [Wed Aug 24 10:23:52 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:53.337854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-177b9711-86da-4cb8-bd3a-90a7800b4463 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:53.340707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-177b9711-86da-4cb8-bd3a-90a7800b4463 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:53.350740 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-177b9711-86da-4cb8-bd3a-90a7800b4463 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:53.351855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-177b9711-86da-4cb8-bd3a-90a7800b4463 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:53.352535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-177b9711-86da-4cb8-bd3a-90a7800b4463 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:53.353723 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-177b9711-86da-4cb8-bd3a-90a7800b4463 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:53.354521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-177b9711-86da-4cb8-bd3a-90a7800b4463 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:53.355981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-177b9711-86da-4cb8-bd3a-90a7800b4463 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:53.443001 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-177b9711-86da-4cb8-bd3a-90a7800b4463 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.109529 Aug 24 10:23:53.447238 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1219/2778] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:23:53 2022] GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08/os-volume_attachments => generated 25 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:23:53.475113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0cf3993f-de52-45bb-9ed7-86606dac2b43 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:53.478321 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0cf3993f-de52-45bb-9ed7-86606dac2b43 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] [instance: 98710ee1-1634-4370-b3c1-51d5df2ab889] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:53.529305 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cf3993f-de52-45bb-9ed7-86606dac2b43 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:53.531387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cf3993f-de52-45bb-9ed7-86606dac2b43 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:53.535034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cf3993f-de52-45bb-9ed7-86606dac2b43 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:53.536653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cf3993f-de52-45bb-9ed7-86606dac2b43 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:53.539478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cf3993f-de52-45bb-9ed7-86606dac2b43 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:53.540156 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cf3993f-de52-45bb-9ed7-86606dac2b43 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:53.552963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3bb690df-f094-4928-b82d-063c2d9aec57 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:53.563287 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3bb690df-f094-4928-b82d-063c2d9aec57 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d" status: 200 len: 1333 microversion: 2.1 time: 0.397933 Aug 24 10:23:53.568305 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1560/2779] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:53 2022] GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d => generated 1333 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:53.580540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-79d7837b-3341-4a07-97f1-e0cb5c640b33 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '.version_select at 0x7f465a1bd1f0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:53.964345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0cf3993f-de52-45bb-9ed7-86606dac2b43 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b28596ad9a4f259695e4705ae02f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f539617fa0074e2fbd6aaedc8b63773f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:53.980480 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0cf3993f-de52-45bb-9ed7-86606dac2b43 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] 10.222.0.85 "GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889" status: 200 len: 1484 microversion: 2.1 time: 0.531741 Aug 24 10:23:53.981387 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1220/2780] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:53 2022] GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889 => generated 1484 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:53.992420 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0792027d-cbab-41bb-bac6-dda650cbd70e tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Action: 'update', calling method: .version_select at 0x7f465a2f0ee0>, body: {"quota_set": {"ram": "2048"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:54.113926 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0792027d-cbab-41bb-bac6-dda650cbd70e tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:54.114418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0792027d-cbab-41bb-bac6-dda650cbd70e tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:54.114856 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0792027d-cbab-41bb-bac6-dda650cbd70e tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:54.115722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0792027d-cbab-41bb-bac6-dda650cbd70e tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:54.116187 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0792027d-cbab-41bb-bac6-dda650cbd70e tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:54.116614 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0792027d-cbab-41bb-bac6-dda650cbd70e tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:54.239558 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0792027d-cbab-41bb-bac6-dda650cbd70e tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:54.240041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0792027d-cbab-41bb-bac6-dda650cbd70e tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:54.240473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0792027d-cbab-41bb-bac6-dda650cbd70e tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:54.241376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0792027d-cbab-41bb-bac6-dda650cbd70e tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:54.242011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0792027d-cbab-41bb-bac6-dda650cbd70e tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:54.242633 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0792027d-cbab-41bb-bac6-dda650cbd70e tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:54.446632 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0792027d-cbab-41bb-bac6-dda650cbd70e tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-quota-sets/14cdb37cb5254114beb251eb35cbdf22?user_id=f4ff2ffe8b264ca48833a2a343eb523a" status: 200 len: 328 microversion: 2.1 time: 0.463944 Aug 24 10:23:54.447887 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1221/2781] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Aug 24 10:23:53 2022] PUT /compute/v2.1/os-quota-sets/14cdb37cb5254114beb251eb35cbdf22?user_id=f4ff2ffe8b264ca48833a2a343eb523a => generated 328 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:54.453238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-127cb9bf-7109-40bb-9ce6-fe8944c028d2 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:54.456163 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-127cb9bf-7109-40bb-9ce6-fe8944c028d2 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:54.463546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-127cb9bf-7109-40bb-9ce6-fe8944c028d2 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:54.464070 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-127cb9bf-7109-40bb-9ce6-fe8944c028d2 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:54.464510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-127cb9bf-7109-40bb-9ce6-fe8944c028d2 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:54.465280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-127cb9bf-7109-40bb-9ce6-fe8944c028d2 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:54.465741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-127cb9bf-7109-40bb-9ce6-fe8944c028d2 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:54.466155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-127cb9bf-7109-40bb-9ce6-fe8944c028d2 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:54.501035 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-79d7837b-3341-4a07-97f1-e0cb5c640b33 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 0.933062 Aug 24 10:23:54.501682 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1561/2782] 10.222.0.85 () {58 vars in 1158 bytes} [Wed Aug 24 10:23:53 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:54.515064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0686163e-278d-43cb-a171-432fe827fc35 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:54.515945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0686163e-278d-43cb-a171-432fe827fc35 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:54.518215 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-127cb9bf-7109-40bb-9ce6-fe8944c028d2 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068962 Aug 24 10:23:54.519091 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1222/2783] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:23:54 2022] GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:23:54.523554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-10199351-9696-4a40-b57f-fd59628322d7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:54.523554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-10199351-9696-4a40-b57f-fd59628322d7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 56dc2f7d-cae7-4b36-81e0-594f9b5a0623] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:54.531172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10199351-9696-4a40-b57f-fd59628322d7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:54.531654 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10199351-9696-4a40-b57f-fd59628322d7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:54.532091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10199351-9696-4a40-b57f-fd59628322d7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:54.532921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10199351-9696-4a40-b57f-fd59628322d7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:54.533409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10199351-9696-4a40-b57f-fd59628322d7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:54.533934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10199351-9696-4a40-b57f-fd59628322d7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:54.534830 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0686163e-278d-43cb-a171-432fe827fc35 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:54.535821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0686163e-278d-43cb-a171-432fe827fc35 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:54.536266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0686163e-278d-43cb-a171-432fe827fc35 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:54.536983 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0686163e-278d-43cb-a171-432fe827fc35 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:54.537465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0686163e-278d-43cb-a171-432fe827fc35 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:54.538061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0686163e-278d-43cb-a171-432fe827fc35 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:54.577493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10199351-9696-4a40-b57f-fd59628322d7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:54.578047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10199351-9696-4a40-b57f-fd59628322d7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:54.578543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10199351-9696-4a40-b57f-fd59628322d7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:54.579217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-10199351-9696-4a40-b57f-fd59628322d7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lazy-loading 'fault' on Instance uuid 56dc2f7d-cae7-4b36-81e0-594f9b5a0623 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:23:54.642974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-10199351-9696-4a40-b57f-fd59628322d7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:54.645530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0686163e-278d-43cb-a171-432fe827fc35 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:54.653399 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-10199351-9696-4a40-b57f-fd59628322d7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623" status: 200 len: 1305 microversion: 2.1 time: 0.133665 Aug 24 10:23:54.654410 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1223/2784] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:54 2022] GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623 => generated 1305 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:54.656810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0686163e-278d-43cb-a171-432fe827fc35 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:54.658440 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0686163e-278d-43cb-a171-432fe827fc35 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:54.659835 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0686163e-278d-43cb-a171-432fe827fc35 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1408 microversion: 2.54 time: 0.157222 Aug 24 10:23:54.668206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d5521c75-7dc4-418b-9118-b3def6546ce3 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Calling method '.version_select at 0x7f465a2a33a0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:54.678084 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1562/2785] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:54 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:54.684932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2bb0c646-3601-4ac3-97a5-788339b48680 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '.version_select at 0x7f465a1bde50>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:54.774340 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d5521c75-7dc4-418b-9118-b3def6546ce3 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] 10.222.0.85 "GET /compute/v2.1/os-quota-sets/14cdb37cb5254114beb251eb35cbdf22?user_id=f4ff2ffe8b264ca48833a2a343eb523a" status: 200 len: 370 microversion: 2.1 time: 0.118420 Aug 24 10:23:54.775490 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1224/2786] 10.222.0.85 () {58 vars in 1323 bytes} [Wed Aug 24 10:23:54 2022] GET /compute/v2.1/os-quota-sets/14cdb37cb5254114beb251eb35cbdf22?user_id=f4ff2ffe8b264ca48833a2a343eb523a => generated 370 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:54.780325 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3c757392-df0f-434e-a0a7-fa11c530e955 req-09f589bd-4a2c-4e72-8b97-50819316040c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98710ee1-1634-4370-b3c1-51d5df2ab889", "name": "network-vif-deleted", "tag": "a56be047-3952-434f-bd82-2ed9c4c0e56a"}, {"server_uuid": "56dc2f7d-cae7-4b36-81e0-594f9b5a0623", "name": "network-vif-deleted", "tag": "7139550e-c163-4eac-8f5a-900b59ce79b0"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:54.801947 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3c757392-df0f-434e-a0a7-fa11c530e955 req-09f589bd-4a2c-4e72-8b97-50819316040c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:54.802440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3c757392-df0f-434e-a0a7-fa11c530e955 req-09f589bd-4a2c-4e72-8b97-50819316040c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:54.802886 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3c757392-df0f-434e-a0a7-fa11c530e955 req-09f589bd-4a2c-4e72-8b97-50819316040c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:54.816788 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3c757392-df0f-434e-a0a7-fa11c530e955 req-09f589bd-4a2c-4e72-8b97-50819316040c service nova] Creating event network-vif-deleted:a56be047-3952-434f-bd82-2ed9c4c0e56a for instance 98710ee1-1634-4370-b3c1-51d5df2ab889 on n-h2-849328-3 Aug 24 10:23:54.817338 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3c757392-df0f-434e-a0a7-fa11c530e955 req-09f589bd-4a2c-4e72-8b97-50819316040c service nova] Creating event network-vif-deleted:7139550e-c163-4eac-8f5a-900b59ce79b0 for instance 56dc2f7d-cae7-4b36-81e0-594f9b5a0623 on n-h1-849328-3 Aug 24 10:23:54.827301 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3c757392-df0f-434e-a0a7-fa11c530e955 req-09f589bd-4a2c-4e72-8b97-50819316040c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050861 Aug 24 10:23:54.828307 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1225/2787] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:54.833731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0f8721e8-e74e-4261-840f-2bb919dfe71b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:54.834170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0f8721e8-e74e-4261-840f-2bb919dfe71b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:54.840602 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f8721e8-e74e-4261-840f-2bb919dfe71b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:54.841092 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f8721e8-e74e-4261-840f-2bb919dfe71b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:54.841576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f8721e8-e74e-4261-840f-2bb919dfe71b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:54.842290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f8721e8-e74e-4261-840f-2bb919dfe71b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:54.843012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f8721e8-e74e-4261-840f-2bb919dfe71b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:54.843451 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f8721e8-e74e-4261-840f-2bb919dfe71b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:55.023449 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2bb0c646-3601-4ac3-97a5-788339b48680 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/2c0e265a-8ebd-4ad1-a5e0-68bb55c95586" status: 202 len: 0 microversion: 2.1 time: 0.344252 Aug 24 10:23:55.024770 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1563/2788] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:23:54 2022] DELETE /compute/v2.1/os-security-groups/2c0e265a-8ebd-4ad1-a5e0-68bb55c95586 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:23:55.033115 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1899b53a-2682-4082-a91e-4f9cc2cab8a0 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:55.035161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1899b53a-2682-4082-a91e-4f9cc2cab8a0 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:55.052109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1899b53a-2682-4082-a91e-4f9cc2cab8a0 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:55.053832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1899b53a-2682-4082-a91e-4f9cc2cab8a0 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:55.053832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1899b53a-2682-4082-a91e-4f9cc2cab8a0 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:55.053832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1899b53a-2682-4082-a91e-4f9cc2cab8a0 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:55.054282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1899b53a-2682-4082-a91e-4f9cc2cab8a0 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:55.054909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1899b53a-2682-4082-a91e-4f9cc2cab8a0 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:55.086992 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1899b53a-2682-4082-a91e-4f9cc2cab8a0 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:23:55.197190 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1899b53a-2682-4082-a91e-4f9cc2cab8a0 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "DELETE /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08" status: 204 len: 0 microversion: 2.1 time: 0.169652 Aug 24 10:23:55.199192 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1564/2789] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:23:55 2022] DELETE /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:23:55.212800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ce471b78-9d78-4d65-96ee-1b35deb80ba2 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:55.214345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ce471b78-9d78-4d65-96ee-1b35deb80ba2 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] [instance: 98710ee1-1634-4370-b3c1-51d5df2ab889] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:55.224580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce471b78-9d78-4d65-96ee-1b35deb80ba2 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:55.226175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce471b78-9d78-4d65-96ee-1b35deb80ba2 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:55.227265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce471b78-9d78-4d65-96ee-1b35deb80ba2 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:55.228797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce471b78-9d78-4d65-96ee-1b35deb80ba2 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:55.230091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce471b78-9d78-4d65-96ee-1b35deb80ba2 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:55.231160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce471b78-9d78-4d65-96ee-1b35deb80ba2 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:55.297608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce471b78-9d78-4d65-96ee-1b35deb80ba2 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:55.298771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce471b78-9d78-4d65-96ee-1b35deb80ba2 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:55.299879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce471b78-9d78-4d65-96ee-1b35deb80ba2 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:55.300924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-ce471b78-9d78-4d65-96ee-1b35deb80ba2 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lazy-loading 'fault' on Instance uuid 98710ee1-1634-4370-b3c1-51d5df2ab889 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:23:55.368339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ce471b78-9d78-4d65-96ee-1b35deb80ba2 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b28596ad9a4f259695e4705ae02f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f539617fa0074e2fbd6aaedc8b63773f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:55.382075 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ce471b78-9d78-4d65-96ee-1b35deb80ba2 tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] 10.222.0.85 "GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889" status: 200 len: 1314 microversion: 2.1 time: 0.180400 Aug 24 10:23:55.382628 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1565/2790] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:55 2022] GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:55.388023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7175a760-fa28-4287-aabd-ce608dbad72a tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '.version_select at 0x7f46545fc310>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:55.419677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG neutronclient.v2_0.client [None req-7175a760-fa28-4287-aabd-ce608dbad72a tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2c0e265a-8ebd-4ad1-a5e0-68bb55c95586 does not exist", "detail": ""}} {{(pid=122433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 10:23:55.420547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.security_group_api [None req-7175a760-fa28-4287-aabd-ce608dbad72a tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Neutron security group 2c0e265a-8ebd-4ad1-a5e0-68bb55c95586 not found {{(pid=122433) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 10:23:55.421396 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-7175a760-fa28-4287-aabd-ce608dbad72a tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] HTTP exception thrown: Security group 2c0e265a-8ebd-4ad1-a5e0-68bb55c95586 does not exist Aug 24 10:23:55.421396 n-d-849328-3 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-5d297c4d-de36-40cd-a125-e8d773ee0c2f'] Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7175a760-fa28-4287-aabd-ce608dbad72a tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Request method failure captured: Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-security-groups/2c0e265a-8ebd-4ad1-a5e0-68bb55c95586 HTTP/1.1 Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfwP4tkKyJr5Gg7qNaTDv0qB585z-EGLWhAIlAiiw7niuSBtf4-Q9XJ2RClgHF5tG0tqoI1dsizKyw5H-SwLhXdRiM6qVR9NPoSFDWFDAiYHpCUOyNdaDsUmsdQydv3MYAQ3enYS0IGacLv6Rxy4kcYdhL4YEU_p2c-vtfjTt6PXS-o Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_44f050698fc54fb6b8fdf2866472dd7d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/44f050698fc54fb6b8fdf2866472dd7d"}]}] Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: cf7304a4a0bb486fbf52f1c84cad702a Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: exception: Security group 2c0e265a-8ebd-4ad1-a5e0-68bb55c95586 does not exist Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-5d297c4d-de36-40cd-a125-e8d773ee0c2f'] Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '2c0e265a-8ebd-4ad1-a5e0-68bb55c95586'} Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 10:23:55.424767 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2c0e265a-8ebd-4ad1-a5e0-68bb55c95586 does not exist Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d297c4d-de36-40cd-a125-e8d773ee0c2f'] Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2c0e265a-8ebd-4ad1-a5e0-68bb55c95586 does not exist Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d297c4d-de36-40cd-a125-e8d773ee0c2f'] Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2c0e265a-8ebd-4ad1-a5e0-68bb55c95586 does not exist Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d297c4d-de36-40cd-a125-e8d773ee0c2f'] Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2c0e265a-8ebd-4ad1-a5e0-68bb55c95586 does not exist Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d297c4d-de36-40cd-a125-e8d773ee0c2f'] Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7175a760-fa28-4287-aabd-ce608dbad72a tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Returning 404 to user: Security group 2c0e265a-8ebd-4ad1-a5e0-68bb55c95586 does not exist Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-5d297c4d-de36-40cd-a125-e8d773ee0c2f'] {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7175a760-fa28-4287-aabd-ce608dbad72a tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/os-security-groups/2c0e265a-8ebd-4ad1-a5e0-68bb55c95586" status: 404 len: 194 microversion: 2.1 time: 0.042755 Aug 24 10:23:55.434864 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1566/2791] 10.222.0.85 () {58 vars in 1269 bytes} [Wed Aug 24 10:23:55 2022] GET /compute/v2.1/os-security-groups/2c0e265a-8ebd-4ad1-a5e0-68bb55c95586 => generated 194 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:23:55.443428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-76a89d02-eaf9-47e4-b692-33b89d5ae1b1 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:55.443428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-76a89d02-eaf9-47e4-b692-33b89d5ae1b1 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:55.443428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:55.452823 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76a89d02-eaf9-47e4-b692-33b89d5ae1b1 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:55.453600 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76a89d02-eaf9-47e4-b692-33b89d5ae1b1 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:55.454718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76a89d02-eaf9-47e4-b692-33b89d5ae1b1 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:55.455851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76a89d02-eaf9-47e4-b692-33b89d5ae1b1 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:55.457907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76a89d02-eaf9-47e4-b692-33b89d5ae1b1 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:55.457907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76a89d02-eaf9-47e4-b692-33b89d5ae1b1 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:55.490644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0f8721e8-e74e-4261-840f-2bb919dfe71b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:55.501931 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0f8721e8-e74e-4261-840f-2bb919dfe71b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d" status: 200 len: 1333 microversion: 2.1 time: 0.672368 Aug 24 10:23:55.502537 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1226/2792] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:54 2022] GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d => generated 1333 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:55.507894 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-124d3bd4-cd70-4662-be94-f77acd2178e0 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Calling method '.version_select at 0x7f465a2a35e0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:55.640632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-76a89d02-eaf9-47e4-b692-33b89d5ae1b1 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d264ad8190a4cd9be236d05564fe1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5264f4afb64ba9927050b9b94d37a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:55.651913 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-76a89d02-eaf9-47e4-b692-33b89d5ae1b1 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08" status: 200 len: 1680 microversion: 2.1 time: 0.220421 Aug 24 10:23:55.653473 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1567/2793] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:55 2022] GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 => generated 1680 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:55.666029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1e040a7b-166a-44ab-a039-12d10142ff4c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '.version_select at 0x7f46541d6790>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:55.777309 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-124d3bd4-cd70-4662-be94-f77acd2178e0 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] 10.222.0.85 "GET /compute/v2.1/os-quota-sets/4f2e107a44134431bc9f69efc1e0463b/defaults" status: 200 len: 371 microversion: 2.1 time: 0.273415 Aug 24 10:23:55.778367 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1227/2794] 10.222.0.85 () {58 vars in 1269 bytes} [Wed Aug 24 10:23:55 2022] GET /compute/v2.1/os-quota-sets/4f2e107a44134431bc9f69efc1e0463b/defaults => generated 371 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:55.784190 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cf28e8ba-9427-46bf-ae55-88e07c563e8e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:55.784873 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cf28e8ba-9427-46bf-ae55-88e07c563e8e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 56dc2f7d-cae7-4b36-81e0-594f9b5a0623] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:55.792934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf28e8ba-9427-46bf-ae55-88e07c563e8e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:55.794146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf28e8ba-9427-46bf-ae55-88e07c563e8e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:55.794779 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf28e8ba-9427-46bf-ae55-88e07c563e8e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:55.795770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf28e8ba-9427-46bf-ae55-88e07c563e8e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:55.796288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf28e8ba-9427-46bf-ae55-88e07c563e8e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:55.796878 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf28e8ba-9427-46bf-ae55-88e07c563e8e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:55.812093 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-cf28e8ba-9427-46bf-ae55-88e07c563e8e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] HTTP exception thrown: Instance 56dc2f7d-cae7-4b36-81e0-594f9b5a0623 could not be found. Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cf28e8ba-9427-46bf-ae55-88e07c563e8e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Request method failure captured: Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623 HTTP/1.1 Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfwVOwKbAI3HcYW4vDUwX5tmvWZcMN8iYYPbyv0cT05fZ_Z-LEPCm4LinUuprRdXqkjYpTNDBQ5PMwhn6CDfWO2m5UgqK-Sr-pjjwg2dd34HghINyEVE3T5Itg-PYKj0YMEqYVC5uIroOumu3tZy7M7156OT9EtIM2-BMTg5dhnnzv0 Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b324a37b01b644dfa301a561e6125672", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b324a37b01b644dfa301a561e6125672"}]}] Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: b49cb438da9f4b309d54bfef9fc19bda Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 56dc2f7d-cae7-4b36-81e0-594f9b5a0623 could not be found. Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '56dc2f7d-cae7-4b36-81e0-594f9b5a0623'} Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56dc2f7d-cae7-4b36-81e0-594f9b5a0623 could not be found. Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56dc2f7d-cae7-4b36-81e0-594f9b5a0623 could not be found. Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:55.814065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:55.821861 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:55.821861 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:55.821861 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:55.821861 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:55.821861 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:55.821861 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56dc2f7d-cae7-4b36-81e0-594f9b5a0623 could not be found. Aug 24 10:23:55.821861 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:55.821861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cf28e8ba-9427-46bf-ae55-88e07c563e8e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Returning 404 to user: Instance 56dc2f7d-cae7-4b36-81e0-594f9b5a0623 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:55.821861 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cf28e8ba-9427-46bf-ae55-88e07c563e8e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623" status: 404 len: 111 microversion: 2.1 time: 0.037435 Aug 24 10:23:55.821861 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1228/2795] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:55 2022] GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:23:55.839378 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-950ec990-7f96-4311-8c53-e491da532b7a tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:55.840379 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-950ec990-7f96-4311-8c53-e491da532b7a tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:55.851290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-950ec990-7f96-4311-8c53-e491da532b7a tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:55.852146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-950ec990-7f96-4311-8c53-e491da532b7a tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:55.852953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-950ec990-7f96-4311-8c53-e491da532b7a tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:55.853929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-950ec990-7f96-4311-8c53-e491da532b7a tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:55.854837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-950ec990-7f96-4311-8c53-e491da532b7a tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:55.856219 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-950ec990-7f96-4311-8c53-e491da532b7a tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:55.890159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:55.969042 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-950ec990-7f96-4311-8c53-e491da532b7a tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:55.978825 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-950ec990-7f96-4311-8c53-e491da532b7a tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:55.982052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-950ec990-7f96-4311-8c53-e491da532b7a tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:55.984053 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-950ec990-7f96-4311-8c53-e491da532b7a tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1408 microversion: 2.54 time: 0.155224 Aug 24 10:23:55.984786 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1229/2796] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:55 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:56.010636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7a5c0e69-a399-40a5-a367-7568b7f82101 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Action: 'update', calling method: .version_select at 0x7f46550120d0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:56.147094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a5c0e69-a399-40a5-a367-7568b7f82101 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:56.147588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a5c0e69-a399-40a5-a367-7568b7f82101 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:56.148024 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a5c0e69-a399-40a5-a367-7568b7f82101 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:56.148950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a5c0e69-a399-40a5-a367-7568b7f82101 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:56.149177 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1e040a7b-166a-44ab-a039-12d10142ff4c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/1c841ab2-527b-4954-bc74-48dc678cd13d" status: 202 len: 0 microversion: 2.1 time: 0.494337 Aug 24 10:23:56.149448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a5c0e69-a399-40a5-a367-7568b7f82101 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:56.149877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a5c0e69-a399-40a5-a367-7568b7f82101 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:56.150008 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1568/2797] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:23:55 2022] DELETE /compute/v2.1/os-security-groups/1c841ab2-527b-4954-bc74-48dc678cd13d => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:23:56.154732 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-69abb6f0-1ddd-46fa-b218-73471a8c269c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1260500076", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "fb7883d4-b081-478d-b08b-6c818132f5bd"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:56.244516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-69abb6f0-1ddd-46fa-b218-73471a8c269c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] validate_networks() for [('fb7883d4-b081-478d-b08b-6c818132f5bd', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:23:56.265306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:56.542832 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7a5c0e69-a399-40a5-a367-7568b7f82101 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-quota-sets/4f2e107a44134431bc9f69efc1e0463b" status: 200 len: 329 microversion: 2.1 time: 0.535403 Aug 24 10:23:56.553269 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1230/2798] 10.222.0.85 () {60 vars in 1263 bytes} [Wed Aug 24 10:23:55 2022] PUT /compute/v2.1/os-quota-sets/4f2e107a44134431bc9f69efc1e0463b => generated 329 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:56.553733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-95e7c769-6641-43c8-9af6-0fbd24b0af6b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '.version_select at 0x7f465a2f0940>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:56.587446 n-d-849328-3 devstack@n-api.service[122432]: DEBUG neutronclient.v2_0.client [None req-95e7c769-6641-43c8-9af6-0fbd24b0af6b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1c841ab2-527b-4954-bc74-48dc678cd13d does not exist", "detail": ""}} {{(pid=122432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 10:23:56.588432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.security_group_api [None req-95e7c769-6641-43c8-9af6-0fbd24b0af6b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Neutron security group 1c841ab2-527b-4954-bc74-48dc678cd13d not found {{(pid=122432) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 10:23:56.589686 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-95e7c769-6641-43c8-9af6-0fbd24b0af6b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] HTTP exception thrown: Security group 1c841ab2-527b-4954-bc74-48dc678cd13d does not exist Aug 24 10:23:56.589686 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-140a213a-516e-495a-b7b2-6416dd09a095'] Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-95e7c769-6641-43c8-9af6-0fbd24b0af6b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Request method failure captured: Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-security-groups/1c841ab2-527b-4954-bc74-48dc678cd13d HTTP/1.1 Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfwP4tkKyJr5Gg7qNaTDv0qB585z-EGLWhAIlAiiw7niuSBtf4-Q9XJ2RClgHF5tG0tqoI1dsizKyw5H-SwLhXdRiM6qVR9NPoSFDWFDAiYHpCUOyNdaDsUmsdQydv3MYAQ3enYS0IGacLv6Rxy4kcYdhL4YEU_p2c-vtfjTt6PXS-o Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_44f050698fc54fb6b8fdf2866472dd7d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/44f050698fc54fb6b8fdf2866472dd7d"}]}] Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: cf7304a4a0bb486fbf52f1c84cad702a Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: exception: Security group 1c841ab2-527b-4954-bc74-48dc678cd13d does not exist Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-140a213a-516e-495a-b7b2-6416dd09a095'] Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '1c841ab2-527b-4954-bc74-48dc678cd13d'} Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 10:23:56.592453 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1c841ab2-527b-4954-bc74-48dc678cd13d does not exist Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-140a213a-516e-495a-b7b2-6416dd09a095'] Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1c841ab2-527b-4954-bc74-48dc678cd13d does not exist Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-140a213a-516e-495a-b7b2-6416dd09a095'] Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1c841ab2-527b-4954-bc74-48dc678cd13d does not exist Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-140a213a-516e-495a-b7b2-6416dd09a095'] Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1c841ab2-527b-4954-bc74-48dc678cd13d does not exist Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-140a213a-516e-495a-b7b2-6416dd09a095'] Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-95e7c769-6641-43c8-9af6-0fbd24b0af6b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Returning 404 to user: Security group 1c841ab2-527b-4954-bc74-48dc678cd13d does not exist Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-140a213a-516e-495a-b7b2-6416dd09a095'] {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-95e7c769-6641-43c8-9af6-0fbd24b0af6b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/os-security-groups/1c841ab2-527b-4954-bc74-48dc678cd13d" status: 404 len: 194 microversion: 2.1 time: 0.047928 Aug 24 10:23:56.597367 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1231/2799] 10.222.0.85 () {58 vars in 1269 bytes} [Wed Aug 24 10:23:56 2022] GET /compute/v2.1/os-security-groups/1c841ab2-527b-4954-bc74-48dc678cd13d => generated 194 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:23:56.601936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b7b2989f-814e-4644-ad46-724d409f9d6a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:56.601936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b7b2989f-814e-4644-ad46-724d409f9d6a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] [instance: 98710ee1-1634-4370-b3c1-51d5df2ab889] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:56.608512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7b2989f-814e-4644-ad46-724d409f9d6a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:56.610114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7b2989f-814e-4644-ad46-724d409f9d6a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:56.610848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7b2989f-814e-4644-ad46-724d409f9d6a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:56.611717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7b2989f-814e-4644-ad46-724d409f9d6a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:56.612221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7b2989f-814e-4644-ad46-724d409f9d6a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:56.612654 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7b2989f-814e-4644-ad46-724d409f9d6a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:56.632960 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-b7b2989f-814e-4644-ad46-724d409f9d6a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] HTTP exception thrown: Instance 98710ee1-1634-4370-b3c1-51d5df2ab889 could not be found. Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b7b2989f-814e-4644-ad46-724d409f9d6a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Request method failure captured: Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889 HTTP/1.1 Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfwQESrg0C9Q2jkCFeeI6GcT74LQZSK2LKfrU9c6OmuUzAOdUYj2l0gc2OATLtYBjmpkxxJ7fjI5DKtnwoXUW30e3L-asio_y2-09Nf3LfbhonsRy7rrMErV-7tp-MIQ2LPKr5uAEDGYpzrQw-Ule5VkvEmXEwJdTzur9R5_wt7sjc0 Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: f539617fa0074e2fbd6aaedc8b63773f Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1310719998 Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f539617fa0074e2fbd6aaedc8b63773f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f539617fa0074e2fbd6aaedc8b63773f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f539617fa0074e2fbd6aaedc8b63773f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f539617fa0074e2fbd6aaedc8b63773f"}]}] Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1310719998 Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: f539617fa0074e2fbd6aaedc8b63773f Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1310719998 Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerAddressesNegativeTestJSON-1310719998-project Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: f0b28596ad9a4f259695e4705ae02f4e Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1310719998-project Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 98710ee1-1634-4370-b3c1-51d5df2ab889 could not be found. Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '98710ee1-1634-4370-b3c1-51d5df2ab889'} Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98710ee1-1634-4370-b3c1-51d5df2ab889 could not be found. Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98710ee1-1634-4370-b3c1-51d5df2ab889 could not be found. Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:56.634576 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:56.640252 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:56.640252 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:56.640252 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:56.640252 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:56.640252 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:56.640252 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:56.640252 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98710ee1-1634-4370-b3c1-51d5df2ab889 could not be found. Aug 24 10:23:56.640252 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:23:56.640252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b7b2989f-814e-4644-ad46-724d409f9d6a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] Returning 404 to user: Instance 98710ee1-1634-4370-b3c1-51d5df2ab889 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:56.640252 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b7b2989f-814e-4644-ad46-724d409f9d6a tempest-ServerAddressesNegativeTestJSON-1310719998 tempest-ServerAddressesNegativeTestJSON-1310719998-project] 10.222.0.85 "GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889" status: 404 len: 111 microversion: 2.1 time: 0.040433 Aug 24 10:23:56.641797 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1232/2800] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:56 2022] GET /compute/v2.1/servers/98710ee1-1634-4370-b3c1-51d5df2ab889 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:23:56.646545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1187078f-09b1-4be6-9624-18298f65d042 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:56.647171 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1187078f-09b1-4be6-9624-18298f65d042 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:56.654193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1187078f-09b1-4be6-9624-18298f65d042 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:56.654696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1187078f-09b1-4be6-9624-18298f65d042 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:56.655182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1187078f-09b1-4be6-9624-18298f65d042 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:56.655890 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1187078f-09b1-4be6-9624-18298f65d042 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:56.656348 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1187078f-09b1-4be6-9624-18298f65d042 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:56.657045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1187078f-09b1-4be6-9624-18298f65d042 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:57.027898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1187078f-09b1-4be6-9624-18298f65d042 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:57.040215 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1187078f-09b1-4be6-9624-18298f65d042 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d" status: 200 len: 1333 microversion: 2.1 time: 0.398234 Aug 24 10:23:57.041082 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1233/2801] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:56 2022] GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d => generated 1333 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:57.061091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-87640b77-6a4d-4f19-8152-703e0f449184 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Action: 'update', calling method: .version_select at 0x7f465434aaf0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:57.062165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-69abb6f0-1ddd-46fa-b218-73471a8c269c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:23:57.063125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-69abb6f0-1ddd-46fa-b218-73471a8c269c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:23:57.063799 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-69abb6f0-1ddd-46fa-b218-73471a8c269c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:23:57.064374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-69abb6f0-1ddd-46fa-b218-73471a8c269c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:23:57.064964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-69abb6f0-1ddd-46fa-b218-73471a8c269c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:23:57.076099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69abb6f0-1ddd-46fa-b218-73471a8c269c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:57.077199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69abb6f0-1ddd-46fa-b218-73471a8c269c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:57.077989 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69abb6f0-1ddd-46fa-b218-73471a8c269c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:57.078946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69abb6f0-1ddd-46fa-b218-73471a8c269c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:57.079587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69abb6f0-1ddd-46fa-b218-73471a8c269c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:57.080201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69abb6f0-1ddd-46fa-b218-73471a8c269c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:57.103873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-69abb6f0-1ddd-46fa-b218-73471a8c269c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Getting quotas for project b324a37b01b644dfa301a561e6125672. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:23:57.110827 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-69abb6f0-1ddd-46fa-b218-73471a8c269c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Getting quotas for user b49cb438da9f4b309d54bfef9fc19bda and project b324a37b01b644dfa301a561e6125672. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:23:57.126314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-69abb6f0-1ddd-46fa-b218-73471a8c269c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:23:57.129721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-69abb6f0-1ddd-46fa-b218-73471a8c269c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:23:57.142186 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87640b77-6a4d-4f19-8152-703e0f449184 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:57.142874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87640b77-6a4d-4f19-8152-703e0f449184 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:57.143464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87640b77-6a4d-4f19-8152-703e0f449184 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:57.144413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87640b77-6a4d-4f19-8152-703e0f449184 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:57.145055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87640b77-6a4d-4f19-8152-703e0f449184 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:57.145816 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87640b77-6a4d-4f19-8152-703e0f449184 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:57.191223 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-69abb6f0-1ddd-46fa-b218-73471a8c269c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.039664 Aug 24 10:23:57.198766 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1569/2802] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:23:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:23:57.206689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bac18d63-2f75-490e-a10c-f2a87f8936d8 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '.version_select at 0x7f46541d6af0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:57.718774 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bac18d63-2f75-490e-a10c-f2a87f8936d8 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/dde65f3a-6f8b-4789-9472-54cc7cfd8d4e" status: 202 len: 0 microversion: 2.1 time: 0.517756 Aug 24 10:23:57.723049 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1570/2803] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:23:57 2022] DELETE /compute/v2.1/os-security-groups/dde65f3a-6f8b-4789-9472-54cc7cfd8d4e => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:23:57.726437 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ddf8b3ab-1e0f-4b78-9d10-8dbb010ebef4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:57.728996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ddf8b3ab-1e0f-4b78-9d10-8dbb010ebef4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:57.758484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddf8b3ab-1e0f-4b78-9d10-8dbb010ebef4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:57.760288 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddf8b3ab-1e0f-4b78-9d10-8dbb010ebef4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:57.766148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddf8b3ab-1e0f-4b78-9d10-8dbb010ebef4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:57.767952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddf8b3ab-1e0f-4b78-9d10-8dbb010ebef4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:57.768688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddf8b3ab-1e0f-4b78-9d10-8dbb010ebef4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:57.770111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddf8b3ab-1e0f-4b78-9d10-8dbb010ebef4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:57.780514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:57.786155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:INSERT=27,nova_api:SELECT=59,nova_api:UPDATE=14 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:57.802291 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-87640b77-6a4d-4f19-8152-703e0f449184 tempest-QuotasAdminTestJSON-505678853 tempest-QuotasAdminTestJSON-505678853-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-quota-sets/4f2e107a44134431bc9f69efc1e0463b" status: 200 len: 329 microversion: 2.1 time: 0.747578 Aug 24 10:23:57.802969 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1234/2804] 10.222.0.85 () {60 vars in 1263 bytes} [Wed Aug 24 10:23:57 2022] PUT /compute/v2.1/os-quota-sets/4f2e107a44134431bc9f69efc1e0463b => generated 329 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:57.849862 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cf6db5de-186d-43fa-904d-9a6c90b9b072 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:57.851797 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cf6db5de-186d-43fa-904d-9a6c90b9b072 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:57.871330 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf6db5de-186d-43fa-904d-9a6c90b9b072 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:57.872753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf6db5de-186d-43fa-904d-9a6c90b9b072 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:57.873756 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf6db5de-186d-43fa-904d-9a6c90b9b072 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:57.875465 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf6db5de-186d-43fa-904d-9a6c90b9b072 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:57.877367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf6db5de-186d-43fa-904d-9a6c90b9b072 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:57.878305 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf6db5de-186d-43fa-904d-9a6c90b9b072 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:58.042923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cf6db5de-186d-43fa-904d-9a6c90b9b072 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:58.065543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cf6db5de-186d-43fa-904d-9a6c90b9b072 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:58.074707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cf6db5de-186d-43fa-904d-9a6c90b9b072 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:58.079486 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cf6db5de-186d-43fa-904d-9a6c90b9b072 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1408 microversion: 2.54 time: 0.238526 Aug 24 10:23:58.080565 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1235/2805] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:57 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1408 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:58.094336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-93e949f0-b4ab-4c4d-904f-ef900d702923 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:58.097980 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-93e949f0-b4ab-4c4d-904f-ef900d702923 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:58.218424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ddf8b3ab-1e0f-4b78-9d10-8dbb010ebef4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d264ad8190a4cd9be236d05564fe1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5264f4afb64ba9927050b9b94d37a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:58.232840 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ddf8b3ab-1e0f-4b78-9d10-8dbb010ebef4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08" status: 200 len: 1680 microversion: 2.1 time: 0.511173 Aug 24 10:23:58.238308 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1571/2806] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:57 2022] GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 => generated 1680 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:58.256087 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e1c16fcf-6db8-43f9-aba8-60be8ade4f3d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '.version_select at 0x7f465a2aa940>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:58.280701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG neutronclient.v2_0.client [None req-e1c16fcf-6db8-43f9-aba8-60be8ade4f3d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dde65f3a-6f8b-4789-9472-54cc7cfd8d4e does not exist", "detail": ""}} {{(pid=122433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 10:23:58.281435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.security_group_api [None req-e1c16fcf-6db8-43f9-aba8-60be8ade4f3d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Neutron security group dde65f3a-6f8b-4789-9472-54cc7cfd8d4e not found {{(pid=122433) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 10:23:58.281995 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-e1c16fcf-6db8-43f9-aba8-60be8ade4f3d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] HTTP exception thrown: Security group dde65f3a-6f8b-4789-9472-54cc7cfd8d4e does not exist Aug 24 10:23:58.281995 n-d-849328-3 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-00d90461-090e-4637-8e01-0193f28a3227'] Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e1c16fcf-6db8-43f9-aba8-60be8ade4f3d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Request method failure captured: Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-security-groups/dde65f3a-6f8b-4789-9472-54cc7cfd8d4e HTTP/1.1 Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfwP4tkKyJr5Gg7qNaTDv0qB585z-EGLWhAIlAiiw7niuSBtf4-Q9XJ2RClgHF5tG0tqoI1dsizKyw5H-SwLhXdRiM6qVR9NPoSFDWFDAiYHpCUOyNdaDsUmsdQydv3MYAQ3enYS0IGacLv6Rxy4kcYdhL4YEU_p2c-vtfjTt6PXS-o Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_44f050698fc54fb6b8fdf2866472dd7d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/44f050698fc54fb6b8fdf2866472dd7d"}]}] Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: cf7304a4a0bb486fbf52f1c84cad702a Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: exception: Security group dde65f3a-6f8b-4789-9472-54cc7cfd8d4e does not exist Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-00d90461-090e-4637-8e01-0193f28a3227'] Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'dde65f3a-6f8b-4789-9472-54cc7cfd8d4e'} Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 10:23:58.283901 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dde65f3a-6f8b-4789-9472-54cc7cfd8d4e does not exist Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-00d90461-090e-4637-8e01-0193f28a3227'] Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dde65f3a-6f8b-4789-9472-54cc7cfd8d4e does not exist Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-00d90461-090e-4637-8e01-0193f28a3227'] Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dde65f3a-6f8b-4789-9472-54cc7cfd8d4e does not exist Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-00d90461-090e-4637-8e01-0193f28a3227'] Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dde65f3a-6f8b-4789-9472-54cc7cfd8d4e does not exist Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-00d90461-090e-4637-8e01-0193f28a3227'] Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e1c16fcf-6db8-43f9-aba8-60be8ade4f3d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Returning 404 to user: Security group dde65f3a-6f8b-4789-9472-54cc7cfd8d4e does not exist Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-00d90461-090e-4637-8e01-0193f28a3227'] {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e1c16fcf-6db8-43f9-aba8-60be8ade4f3d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/os-security-groups/dde65f3a-6f8b-4789-9472-54cc7cfd8d4e" status: 404 len: 194 microversion: 2.1 time: 0.043808 Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1572/2807] 10.222.0.85 () {58 vars in 1269 bytes} [Wed Aug 24 10:23:58 2022] GET /compute/v2.1/os-security-groups/dde65f3a-6f8b-4789-9472-54cc7cfd8d4e => generated 194 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:23:58.291477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-484f7e25-a4ff-4681-b30f-7155c25c35ce tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:58.296923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-484f7e25-a4ff-4681-b30f-7155c25c35ce tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:58.306952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-484f7e25-a4ff-4681-b30f-7155c25c35ce tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:58.307554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-484f7e25-a4ff-4681-b30f-7155c25c35ce tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:58.308014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-484f7e25-a4ff-4681-b30f-7155c25c35ce tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:58.308732 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-484f7e25-a4ff-4681-b30f-7155c25c35ce tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:58.309219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-484f7e25-a4ff-4681-b30f-7155c25c35ce tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:58.309647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-484f7e25-a4ff-4681-b30f-7155c25c35ce tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:58.342159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-93e949f0-b4ab-4c4d-904f-ef900d702923 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:58.377436 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-93e949f0-b4ab-4c4d-904f-ef900d702923 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6" status: 200 len: 1215 microversion: 2.1 time: 0.290107 Aug 24 10:23:58.386508 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1236/2808] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:58 2022] GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 => generated 1215 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:58.400015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1735e887-272a-4437-8680-87ee467dab26 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '.version_select at 0x7f46542b2790>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:58.616394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-484f7e25-a4ff-4681-b30f-7155c25c35ce tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:58.630722 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-484f7e25-a4ff-4681-b30f-7155c25c35ce tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d" status: 200 len: 1333 microversion: 2.1 time: 0.342742 Aug 24 10:23:58.633087 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1573/2809] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:58 2022] GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d => generated 1333 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:59.062832 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1735e887-272a-4437-8680-87ee467dab26 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.679243 Aug 24 10:23:59.067965 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1237/2810] 10.222.0.85 () {58 vars in 1158 bytes} [Wed Aug 24 10:23:58 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:59.083940 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d50ca3d2-b6c6-4081-a764-df32f710af25 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Action: 'create', calling method: .version_select at 0x7f4654688f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2075036255", "description": "tempest-description-677455856"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:59.119201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7f85fb5a-e6b8-4fad-83be-b8af4eae8f49 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:59.119201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7f85fb5a-e6b8-4fad-83be-b8af4eae8f49 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:59.128842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f85fb5a-e6b8-4fad-83be-b8af4eae8f49 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:59.130752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f85fb5a-e6b8-4fad-83be-b8af4eae8f49 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:59.132917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f85fb5a-e6b8-4fad-83be-b8af4eae8f49 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:59.135301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f85fb5a-e6b8-4fad-83be-b8af4eae8f49 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:59.136159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f85fb5a-e6b8-4fad-83be-b8af4eae8f49 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:59.136720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f85fb5a-e6b8-4fad-83be-b8af4eae8f49 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:59.497579 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d50ca3d2-b6c6-4081-a764-df32f710af25 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.417932 Aug 24 10:23:59.498945 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1574/2811] 10.222.0.85 () {60 vars in 1180 bytes} [Wed Aug 24 10:23:59 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:59.506120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9eaaee7e-c1c9-4824-aba4-74167bedeed4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:59.508346 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9eaaee7e-c1c9-4824-aba4-74167bedeed4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:59.517320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9eaaee7e-c1c9-4824-aba4-74167bedeed4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:59.518095 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9eaaee7e-c1c9-4824-aba4-74167bedeed4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:59.518759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9eaaee7e-c1c9-4824-aba4-74167bedeed4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:59.519793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9eaaee7e-c1c9-4824-aba4-74167bedeed4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:59.520469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9eaaee7e-c1c9-4824-aba4-74167bedeed4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:59.521078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9eaaee7e-c1c9-4824-aba4-74167bedeed4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:59.649302 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7f85fb5a-e6b8-4fad-83be-b8af4eae8f49 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:59.676302 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7f85fb5a-e6b8-4fad-83be-b8af4eae8f49 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:59.679498 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7f85fb5a-e6b8-4fad-83be-b8af4eae8f49 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:59.687029 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7f85fb5a-e6b8-4fad-83be-b8af4eae8f49 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1408 microversion: 2.54 time: 0.586263 Aug 24 10:23:59.701550 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1238/2812] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:59 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1408 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:59.709892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-619a5c1a-d0a5-495b-9b80-dbf95a0c0f38 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:59.710736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-619a5c1a-d0a5-495b-9b80-dbf95a0c0f38 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:59.717637 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-619a5c1a-d0a5-495b-9b80-dbf95a0c0f38 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:59.720053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9eaaee7e-c1c9-4824-aba4-74167bedeed4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d264ad8190a4cd9be236d05564fe1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5264f4afb64ba9927050b9b94d37a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:59.725066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-619a5c1a-d0a5-495b-9b80-dbf95a0c0f38 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:59.725740 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-619a5c1a-d0a5-495b-9b80-dbf95a0c0f38 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:59.726646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-619a5c1a-d0a5-495b-9b80-dbf95a0c0f38 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:59.727250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-619a5c1a-d0a5-495b-9b80-dbf95a0c0f38 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:59.730234 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-619a5c1a-d0a5-495b-9b80-dbf95a0c0f38 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:59.734174 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9eaaee7e-c1c9-4824-aba4-74167bedeed4 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08" status: 200 len: 1613 microversion: 2.1 time: 0.230168 Aug 24 10:23:59.735705 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1575/2813] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:59 2022] GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 => generated 1613 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:59.749023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-46654c14-328b-4c75-93b6-86cf4557e52b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Action: 'create', calling method: .version_select at 0x7f465a1d3940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-539861875", "description": "tempest-description-1859626433"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:00.154910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-619a5c1a-d0a5-495b-9b80-dbf95a0c0f38 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:00.170472 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-619a5c1a-d0a5-495b-9b80-dbf95a0c0f38 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6" status: 200 len: 1273 microversion: 2.1 time: 0.467409 Aug 24 10:24:00.172236 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1239/2814] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:59 2022] GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 => generated 1273 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:00.178660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0d9f612f-42e0-400a-b13d-732803c4174e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:00.179677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0d9f612f-42e0-400a-b13d-732803c4174e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:00.187198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d9f612f-42e0-400a-b13d-732803c4174e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:00.187977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d9f612f-42e0-400a-b13d-732803c4174e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:00.188585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d9f612f-42e0-400a-b13d-732803c4174e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:00.189478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d9f612f-42e0-400a-b13d-732803c4174e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:00.190088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d9f612f-42e0-400a-b13d-732803c4174e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:00.190954 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d9f612f-42e0-400a-b13d-732803c4174e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:00.296909 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-46654c14-328b-4c75-93b6-86cf4557e52b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.559828 Aug 24 10:24:00.297970 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1576/2815] 10.222.0.85 () {60 vars in 1180 bytes} [Wed Aug 24 10:23:59 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:24:00.523951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cbcbe0c4-a4e5-4d5d-8c6f-6c1927b68ef0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1784261920", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "ad61c78e-599f-4990-9541-58be77897c55"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:00.632284 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-cbcbe0c4-a4e5-4d5d-8c6f-6c1927b68ef0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] validate_networks() for [('ad61c78e-599f-4990-9541-58be77897c55', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:24:01.301862 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0d9f612f-42e0-400a-b13d-732803c4174e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:01.318522 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0d9f612f-42e0-400a-b13d-732803c4174e tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d" status: 200 len: 1333 microversion: 2.1 time: 1.144135 Aug 24 10:24:01.319119 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1240/2816] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:00 2022] GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d => generated 1333 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:01.330778 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ff0c5f4d-31eb-48b9-a11e-86e21c80e116 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:01.342156 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ff0c5f4d-31eb-48b9-a11e-86e21c80e116 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:01.348699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff0c5f4d-31eb-48b9-a11e-86e21c80e116 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:01.349463 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff0c5f4d-31eb-48b9-a11e-86e21c80e116 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:01.349896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff0c5f4d-31eb-48b9-a11e-86e21c80e116 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:01.353063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff0c5f4d-31eb-48b9-a11e-86e21c80e116 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:01.353747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff0c5f4d-31eb-48b9-a11e-86e21c80e116 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:01.354362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff0c5f4d-31eb-48b9-a11e-86e21c80e116 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:01.466929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-cbcbe0c4-a4e5-4d5d-8c6f-6c1927b68ef0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:24:01.467434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-cbcbe0c4-a4e5-4d5d-8c6f-6c1927b68ef0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:24:01.467969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-cbcbe0c4-a4e5-4d5d-8c6f-6c1927b68ef0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:24:01.468390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-cbcbe0c4-a4e5-4d5d-8c6f-6c1927b68ef0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:24:01.468974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-cbcbe0c4-a4e5-4d5d-8c6f-6c1927b68ef0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:24:01.490703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ff0c5f4d-31eb-48b9-a11e-86e21c80e116 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:01.500482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbcbe0c4-a4e5-4d5d-8c6f-6c1927b68ef0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:01.501746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbcbe0c4-a4e5-4d5d-8c6f-6c1927b68ef0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:01.502564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbcbe0c4-a4e5-4d5d-8c6f-6c1927b68ef0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:01.505746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ff0c5f4d-31eb-48b9-a11e-86e21c80e116 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:01.507250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ff0c5f4d-31eb-48b9-a11e-86e21c80e116 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:01.508457 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ff0c5f4d-31eb-48b9-a11e-86e21c80e116 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1408 microversion: 2.54 time: 0.181787 Aug 24 10:24:01.509109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbcbe0c4-a4e5-4d5d-8c6f-6c1927b68ef0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:01.509739 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbcbe0c4-a4e5-4d5d-8c6f-6c1927b68ef0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:01.510280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbcbe0c4-a4e5-4d5d-8c6f-6c1927b68ef0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:01.515014 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1241/2817] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:01 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:01.537231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0f567485-7223-4e7e-bd8f-9c611ae2bc6f tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:01.538138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0f567485-7223-4e7e-bd8f-9c611ae2bc6f tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:01.546264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f567485-7223-4e7e-bd8f-9c611ae2bc6f tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:01.546759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f567485-7223-4e7e-bd8f-9c611ae2bc6f tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:01.547196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f567485-7223-4e7e-bd8f-9c611ae2bc6f tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:01.547913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f567485-7223-4e7e-bd8f-9c611ae2bc6f tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:01.548371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f567485-7223-4e7e-bd8f-9c611ae2bc6f tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:01.548822 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f567485-7223-4e7e-bd8f-9c611ae2bc6f tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:01.595585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-cbcbe0c4-a4e5-4d5d-8c6f-6c1927b68ef0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Getting quotas for project 44f050698fc54fb6b8fdf2866472dd7d. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:24:01.617431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-cbcbe0c4-a4e5-4d5d-8c6f-6c1927b68ef0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Getting quotas for user cf7304a4a0bb486fbf52f1c84cad702a and project 44f050698fc54fb6b8fdf2866472dd7d. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:24:01.664264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cbcbe0c4-a4e5-4d5d-8c6f-6c1927b68ef0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:24:01.666898 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cbcbe0c4-a4e5-4d5d-8c6f-6c1927b68ef0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:24:01.727057 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cbcbe0c4-a4e5-4d5d-8c6f-6c1927b68ef0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.221437 Aug 24 10:24:01.728711 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1577/2818] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:24:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:24:01.734262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7bef5116-c542-4b61-8d9d-d0a492373586 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:01.735123 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7bef5116-c542-4b61-8d9d-d0a492373586 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:01.743805 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bef5116-c542-4b61-8d9d-d0a492373586 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:01.746090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bef5116-c542-4b61-8d9d-d0a492373586 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:01.748149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bef5116-c542-4b61-8d9d-d0a492373586 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:01.750019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bef5116-c542-4b61-8d9d-d0a492373586 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:01.750862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bef5116-c542-4b61-8d9d-d0a492373586 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:01.753299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bef5116-c542-4b61-8d9d-d0a492373586 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:01.926777 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0f567485-7223-4e7e-bd8f-9c611ae2bc6f tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d264ad8190a4cd9be236d05564fe1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5264f4afb64ba9927050b9b94d37a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:01.946995 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0f567485-7223-4e7e-bd8f-9c611ae2bc6f tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08" status: 200 len: 1613 microversion: 2.1 time: 0.430759 Aug 24 10:24:01.947644 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1242/2819] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:01 2022] GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 => generated 1613 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:01.953281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-176ac057-d949-4e81-9f38-47aa33e0d49b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:01.953916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-176ac057-d949-4e81-9f38-47aa33e0d49b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:01.984882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7bef5116-c542-4b61-8d9d-d0a492373586 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:01.988834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:02.008387 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7bef5116-c542-4b61-8d9d-d0a492373586 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6" status: 200 len: 1273 microversion: 2.1 time: 0.278041 Aug 24 10:24:02.025706 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1578/2820] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:01 2022] GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 => generated 1273 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:02.047122 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-7896fd03-5400-4e85-b9a2-c764a2eb2ed0 req-0074d582-111c-4a1b-bd69-9accd257bda9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a02ab88-8424-479f-8bdd-d1e671d8bb6d", "name": "network-vif-plugged", "status": "completed", "tag": "f559473b-80a3-43ce-8939-16ffa1b2a0de"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:02.081187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7896fd03-5400-4e85-b9a2-c764a2eb2ed0 req-0074d582-111c-4a1b-bd69-9accd257bda9 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:02.086808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7896fd03-5400-4e85-b9a2-c764a2eb2ed0 req-0074d582-111c-4a1b-bd69-9accd257bda9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:02.095398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7896fd03-5400-4e85-b9a2-c764a2eb2ed0 req-0074d582-111c-4a1b-bd69-9accd257bda9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:02.118801 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-7896fd03-5400-4e85-b9a2-c764a2eb2ed0 req-0074d582-111c-4a1b-bd69-9accd257bda9 service nova] Creating event network-vif-plugged:f559473b-80a3-43ce-8939-16ffa1b2a0de for instance 0a02ab88-8424-479f-8bdd-d1e671d8bb6d on n-h2-849328-3 Aug 24 10:24:02.131850 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-7896fd03-5400-4e85-b9a2-c764a2eb2ed0 req-0074d582-111c-4a1b-bd69-9accd257bda9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090305 Aug 24 10:24:02.134886 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1579/2821] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:24:02.147935 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-58175392-0508-4f9d-af19-236e273ae032 req-b2b6375a-ab3a-40e5-ab2b-409eabefac82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f6298f4-4be1-47e8-a260-c43d83731e08", "name": "network-vif-deleted", "tag": "a849beed-fe2d-49fa-a6c1-d0686458269b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:02.165332 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-58175392-0508-4f9d-af19-236e273ae032 req-b2b6375a-ab3a-40e5-ab2b-409eabefac82 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:02.166102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-58175392-0508-4f9d-af19-236e273ae032 req-b2b6375a-ab3a-40e5-ab2b-409eabefac82 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:02.167173 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-58175392-0508-4f9d-af19-236e273ae032 req-b2b6375a-ab3a-40e5-ab2b-409eabefac82 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:02.197250 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-58175392-0508-4f9d-af19-236e273ae032 req-b2b6375a-ab3a-40e5-ab2b-409eabefac82 service nova] Creating event network-vif-deleted:a849beed-fe2d-49fa-a6c1-d0686458269b for instance 0f6298f4-4be1-47e8-a260-c43d83731e08 on n-h1-849328-3 Aug 24 10:24:02.204748 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-58175392-0508-4f9d-af19-236e273ae032 req-b2b6375a-ab3a-40e5-ab2b-409eabefac82 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066819 Aug 24 10:24:02.206152 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1580/2822] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:24:02.350674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aff8d8a1-9aac-4758-81e7-632ac7c6d1dc tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:02.355016 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aff8d8a1-9aac-4758-81e7-632ac7c6d1dc tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:02.379745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aff8d8a1-9aac-4758-81e7-632ac7c6d1dc tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:02.380542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aff8d8a1-9aac-4758-81e7-632ac7c6d1dc tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:02.381646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aff8d8a1-9aac-4758-81e7-632ac7c6d1dc tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:02.386952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aff8d8a1-9aac-4758-81e7-632ac7c6d1dc tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:02.388007 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aff8d8a1-9aac-4758-81e7-632ac7c6d1dc tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:02.388624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aff8d8a1-9aac-4758-81e7-632ac7c6d1dc tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:02.423968 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-176ac057-d949-4e81-9f38-47aa33e0d49b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:02.437565 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-176ac057-d949-4e81-9f38-47aa33e0d49b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e" status: 200 len: 1216 microversion: 2.1 time: 0.486731 Aug 24 10:24:02.441226 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1243/2823] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:01 2022] GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e => generated 1216 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:02.545841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-99775041-3edf-43ba-ad28-7958599b3a95 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:02.546502 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-99775041-3edf-43ba-ad28-7958599b3a95 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:02.563731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99775041-3edf-43ba-ad28-7958599b3a95 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:02.567634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99775041-3edf-43ba-ad28-7958599b3a95 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:02.568377 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99775041-3edf-43ba-ad28-7958599b3a95 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:02.569478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99775041-3edf-43ba-ad28-7958599b3a95 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:02.570105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99775041-3edf-43ba-ad28-7958599b3a95 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:02.570724 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99775041-3edf-43ba-ad28-7958599b3a95 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:02.737188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aff8d8a1-9aac-4758-81e7-632ac7c6d1dc tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:02.753353 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aff8d8a1-9aac-4758-81e7-632ac7c6d1dc tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d" status: 200 len: 1333 microversion: 2.1 time: 0.411645 Aug 24 10:24:02.769486 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1581/2824] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:02 2022] GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d => generated 1333 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:02.850434 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-99775041-3edf-43ba-ad28-7958599b3a95 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:02.867782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-99775041-3edf-43ba-ad28-7958599b3a95 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:02.875672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-99775041-3edf-43ba-ad28-7958599b3a95 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:02.876924 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-99775041-3edf-43ba-ad28-7958599b3a95 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1408 microversion: 2.54 time: 0.337087 Aug 24 10:24:02.891184 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1244/2825] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:02 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1408 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:02.968648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7b2f8059-d0be-48a5-ac0a-a77900db631f tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:02.969313 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7b2f8059-d0be-48a5-ac0a-a77900db631f tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:02.983854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b2f8059-d0be-48a5-ac0a-a77900db631f tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:02.984345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b2f8059-d0be-48a5-ac0a-a77900db631f tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:02.984770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b2f8059-d0be-48a5-ac0a-a77900db631f tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:02.985687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b2f8059-d0be-48a5-ac0a-a77900db631f tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:02.986151 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b2f8059-d0be-48a5-ac0a-a77900db631f tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:02.986572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b2f8059-d0be-48a5-ac0a-a77900db631f tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:03.015578 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-7b2f8059-d0be-48a5-ac0a-a77900db631f tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] HTTP exception thrown: Instance 0f6298f4-4be1-47e8-a260-c43d83731e08 could not be found. Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7b2f8059-d0be-48a5-ac0a-a77900db631f tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Request method failure captured: Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 HTTP/1.1 Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfudiGwgQR8hKNArlntC2-dsrrKYTIBlVuqrLiKtM4eZghwt1HeSFJ5N9-48WnbytHcTbPaBfCxYfyMVtlusuM5dascE6lo4JZ82bLT9CTJVIVT7B5x8VyNNJsS1rVsBWV75VPq-6am2EoKTaDa4KN-Snb_8XELQ6zu0yLTEh-41L48 Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 1d5264f4afb64ba9927050b9b94d37a8 Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-662179688 Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1d5264f4afb64ba9927050b9b94d37a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_1d5264f4afb64ba9927050b9b94d37a8", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1d5264f4afb64ba9927050b9b94d37a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/1d5264f4afb64ba9927050b9b94d37a8"}]}] Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-662179688 Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 1d5264f4afb64ba9927050b9b94d37a8 Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-662179688 Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AttachSCSIVolumeTestJSON-662179688-project Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 3d264ad8190a4cd9be236d05564fe1a2 Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-662179688-project Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 0f6298f4-4be1-47e8-a260-c43d83731e08 could not be found. Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '0f6298f4-4be1-47e8-a260-c43d83731e08'} Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f6298f4-4be1-47e8-a260-c43d83731e08 could not be found. Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f6298f4-4be1-47e8-a260-c43d83731e08 could not be found. Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:03.019749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:03.028837 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:03.028837 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:03.028837 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:03.028837 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:03.028837 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:03.028837 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f6298f4-4be1-47e8-a260-c43d83731e08 could not be found. Aug 24 10:24:03.028837 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:03.031588 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7b2f8059-d0be-48a5-ac0a-a77900db631f tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Returning 404 to user: Instance 0f6298f4-4be1-47e8-a260-c43d83731e08 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:03.032825 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7b2f8059-d0be-48a5-ac0a-a77900db631f tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08" status: 404 len: 111 microversion: 2.1 time: 0.068821 Aug 24 10:24:03.034038 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1582/2826] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:02 2022] GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:24:03.042093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-90a6f4a5-91a5-4673-a679-74f9bfaab6d5 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '.version_select at 0x7f465a2d1ee0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:03.056508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4a503576-ed07-459a-8762-5fa7d9cf0873 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:03.057233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4a503576-ed07-459a-8762-5fa7d9cf0873 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:03.064129 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a503576-ed07-459a-8762-5fa7d9cf0873 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:03.064573 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a503576-ed07-459a-8762-5fa7d9cf0873 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:03.065007 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a503576-ed07-459a-8762-5fa7d9cf0873 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:03.066093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a503576-ed07-459a-8762-5fa7d9cf0873 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:03.066787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a503576-ed07-459a-8762-5fa7d9cf0873 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:03.067381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a503576-ed07-459a-8762-5fa7d9cf0873 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:03.093006 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-90a6f4a5-91a5-4673-a679-74f9bfaab6d5 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-860357472" status: 202 len: 0 microversion: 2.1 time: 0.054640 Aug 24 10:24:03.097238 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1245/2827] 10.222.0.85 () {58 vars in 1218 bytes} [Wed Aug 24 10:24:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-860357472 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:24:03.462120 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e7f8cfb5-4ad8-4320-86bc-260b12849f88 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:03.462746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e7f8cfb5-4ad8-4320-86bc-260b12849f88 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:03.480174 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7f8cfb5-4ad8-4320-86bc-260b12849f88 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:03.486588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7f8cfb5-4ad8-4320-86bc-260b12849f88 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:03.513084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7f8cfb5-4ad8-4320-86bc-260b12849f88 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:03.514035 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7f8cfb5-4ad8-4320-86bc-260b12849f88 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:03.517628 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7f8cfb5-4ad8-4320-86bc-260b12849f88 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:03.518089 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7f8cfb5-4ad8-4320-86bc-260b12849f88 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:03.642929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4a503576-ed07-459a-8762-5fa7d9cf0873 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:03.652266 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4a503576-ed07-459a-8762-5fa7d9cf0873 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6" status: 200 len: 1315 microversion: 2.1 time: 0.599542 Aug 24 10:24:03.660175 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1583/2828] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:03 2022] GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 => generated 1315 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:03.779564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d8fbffc1-a08b-4192-ad64-4713d23e75d9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:03.780346 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d8fbffc1-a08b-4192-ad64-4713d23e75d9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:03.787251 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8fbffc1-a08b-4192-ad64-4713d23e75d9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:03.787749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8fbffc1-a08b-4192-ad64-4713d23e75d9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:03.788190 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8fbffc1-a08b-4192-ad64-4713d23e75d9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:03.788909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8fbffc1-a08b-4192-ad64-4713d23e75d9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:03.801783 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8fbffc1-a08b-4192-ad64-4713d23e75d9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:03.802247 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8fbffc1-a08b-4192-ad64-4713d23e75d9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:04.431146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e7f8cfb5-4ad8-4320-86bc-260b12849f88 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:04.443365 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e7f8cfb5-4ad8-4320-86bc-260b12849f88 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e" status: 200 len: 1268 microversion: 2.1 time: 0.984644 Aug 24 10:24:04.444374 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1246/2829] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:03 2022] GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e => generated 1268 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:04.458618 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f13437f8-b0e1-4876-82ee-f83463cabd42 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:04.459245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f13437f8-b0e1-4876-82ee-f83463cabd42 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:04.470913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f13437f8-b0e1-4876-82ee-f83463cabd42 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:04.474056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f13437f8-b0e1-4876-82ee-f83463cabd42 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:04.475694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f13437f8-b0e1-4876-82ee-f83463cabd42 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:04.476519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f13437f8-b0e1-4876-82ee-f83463cabd42 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:04.476987 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f13437f8-b0e1-4876-82ee-f83463cabd42 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:04.477505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f13437f8-b0e1-4876-82ee-f83463cabd42 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:04.844992 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f13437f8-b0e1-4876-82ee-f83463cabd42 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:04.861813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f13437f8-b0e1-4876-82ee-f83463cabd42 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:04.863506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d8fbffc1-a08b-4192-ad64-4713d23e75d9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:04.872561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f13437f8-b0e1-4876-82ee-f83463cabd42 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:04.877751 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f13437f8-b0e1-4876-82ee-f83463cabd42 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1414 microversion: 2.54 time: 0.427886 Aug 24 10:24:04.879479 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1247/2830] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:04 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1414 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:04.895433 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-f7a2f2a8-e523-4c66-8bff-f18b60537e0c req-13d9f9ea-1d51-41e2-8704-fa8b0be44729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a02ab88-8424-479f-8bdd-d1e671d8bb6d", "name": "network-vif-plugged", "status": "completed", "tag": "1445ad95-4177-419a-9130-67c0f1f9162a"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:04.896152 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d8fbffc1-a08b-4192-ad64-4713d23e75d9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d" status: 200 len: 1333 microversion: 2.1 time: 1.101447 Aug 24 10:24:04.897059 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1584/2831] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:03 2022] GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d => generated 1333 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:24:04.908363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2bda18d0-9998-4c4f-9148-451ac89434bc tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:04.913905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2bda18d0-9998-4c4f-9148-451ac89434bc tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:04.917529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f7a2f2a8-e523-4c66-8bff-f18b60537e0c req-13d9f9ea-1d51-41e2-8704-fa8b0be44729 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:04.920176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f7a2f2a8-e523-4c66-8bff-f18b60537e0c req-13d9f9ea-1d51-41e2-8704-fa8b0be44729 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:04.920779 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f7a2f2a8-e523-4c66-8bff-f18b60537e0c req-13d9f9ea-1d51-41e2-8704-fa8b0be44729 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:04.945933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bda18d0-9998-4c4f-9148-451ac89434bc tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:04.947351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bda18d0-9998-4c4f-9148-451ac89434bc tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:04.952671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bda18d0-9998-4c4f-9148-451ac89434bc tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:04.960343 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-f7a2f2a8-e523-4c66-8bff-f18b60537e0c req-13d9f9ea-1d51-41e2-8704-fa8b0be44729 service nova] Creating event network-vif-plugged:1445ad95-4177-419a-9130-67c0f1f9162a for instance 0a02ab88-8424-479f-8bdd-d1e671d8bb6d on n-h2-849328-3 Aug 24 10:24:04.966700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bda18d0-9998-4c4f-9148-451ac89434bc tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:04.968107 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bda18d0-9998-4c4f-9148-451ac89434bc tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:04.971552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bda18d0-9998-4c4f-9148-451ac89434bc tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:04.974477 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-f7a2f2a8-e523-4c66-8bff-f18b60537e0c req-13d9f9ea-1d51-41e2-8704-fa8b0be44729 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088181 Aug 24 10:24:04.979186 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1248/2832] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:24:05.405645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3776f8dc-eb5e-4d04-81b6-02a6982e59f3 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] Action: 'update', calling method: .version_select at 0x7f465432fc10>, body: {"quota_set": {"ram": "5120"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:05.505251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3776f8dc-eb5e-4d04-81b6-02a6982e59f3 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:05.506487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3776f8dc-eb5e-4d04-81b6-02a6982e59f3 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:05.507087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3776f8dc-eb5e-4d04-81b6-02a6982e59f3 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:05.511174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2bda18d0-9998-4c4f-9148-451ac89434bc tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:05.513520 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3776f8dc-eb5e-4d04-81b6-02a6982e59f3 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:05.514987 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3776f8dc-eb5e-4d04-81b6-02a6982e59f3 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:05.515747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3776f8dc-eb5e-4d04-81b6-02a6982e59f3 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:05.525172 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2bda18d0-9998-4c4f-9148-451ac89434bc tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6" status: 200 len: 1315 microversion: 2.1 time: 0.624125 Aug 24 10:24:05.537407 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1585/2833] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:04 2022] GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 => generated 1315 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:05.545871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9fe6979f-f8b6-42af-9ffe-dbc052578f0d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:05.546578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9fe6979f-f8b6-42af-9ffe-dbc052578f0d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:05.563047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9fe6979f-f8b6-42af-9ffe-dbc052578f0d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:05.563446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9fe6979f-f8b6-42af-9ffe-dbc052578f0d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:05.563759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9fe6979f-f8b6-42af-9ffe-dbc052578f0d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:05.564584 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9fe6979f-f8b6-42af-9ffe-dbc052578f0d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:05.564979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9fe6979f-f8b6-42af-9ffe-dbc052578f0d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:05.570804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9fe6979f-f8b6-42af-9ffe-dbc052578f0d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:05.629172 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3776f8dc-eb5e-4d04-81b6-02a6982e59f3 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-quota-sets/280a49630bdd4edf99e3175d903516c0" status: 200 len: 148 microversion: 2.57 time: 0.393461 Aug 24 10:24:05.629808 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1249/2834] 10.222.0.85 () {62 vars in 1303 bytes} [Wed Aug 24 10:24:05 2022] PUT /compute/v2.1/os-quota-sets/280a49630bdd4edf99e3175d903516c0 => generated 148 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 10:24:05.652726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2658e619-2fc3-42a2-b2b5-b2813e7a3596 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] Calling method '.version_select at 0x7f46542d0940>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:05.801164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2658e619-2fc3-42a2-b2b5-b2813e7a3596 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:05.801649 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2658e619-2fc3-42a2-b2b5-b2813e7a3596 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:05.802556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2658e619-2fc3-42a2-b2b5-b2813e7a3596 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:05.803645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2658e619-2fc3-42a2-b2b5-b2813e7a3596 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:05.804471 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2658e619-2fc3-42a2-b2b5-b2813e7a3596 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:05.804904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2658e619-2fc3-42a2-b2b5-b2813e7a3596 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:05.817056 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9fe6979f-f8b6-42af-9ffe-dbc052578f0d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:05.831016 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9fe6979f-f8b6-42af-9ffe-dbc052578f0d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e" status: 200 len: 1274 microversion: 2.1 time: 0.296344 Aug 24 10:24:05.833363 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1586/2835] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:05 2022] GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e => generated 1274 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:05.868605 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2658e619-2fc3-42a2-b2b5-b2813e7a3596 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] 10.222.0.85 "GET /compute/v2.1/os-quota-sets/280a49630bdd4edf99e3175d903516c0/detail" status: 200 len: 463 microversion: 2.57 time: 0.229388 Aug 24 10:24:05.869804 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1250/2836] 10.222.0.85 () {60 vars in 1304 bytes} [Wed Aug 24 10:24:05 2022] GET /compute/v2.1/os-quota-sets/280a49630bdd4edf99e3175d903516c0/detail => generated 463 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:24:05.908890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e4606c98-b5e0-482f-93b6-1d25252e14ee tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:05.910117 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e4606c98-b5e0-482f-93b6-1d25252e14ee tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:05.920501 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-647c755e-94ca-4daf-9394-8017ee16f690 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:05.921365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-647c755e-94ca-4daf-9394-8017ee16f690 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:05.939170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4606c98-b5e0-482f-93b6-1d25252e14ee tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:05.939677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4606c98-b5e0-482f-93b6-1d25252e14ee tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:05.940119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4606c98-b5e0-482f-93b6-1d25252e14ee tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:05.943272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-647c755e-94ca-4daf-9394-8017ee16f690 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:05.943775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-647c755e-94ca-4daf-9394-8017ee16f690 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:05.944218 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-647c755e-94ca-4daf-9394-8017ee16f690 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:05.944949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-647c755e-94ca-4daf-9394-8017ee16f690 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:05.945428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-647c755e-94ca-4daf-9394-8017ee16f690 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:05.947156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4606c98-b5e0-482f-93b6-1d25252e14ee tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:05.947925 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4606c98-b5e0-482f-93b6-1d25252e14ee tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:05.948595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4606c98-b5e0-482f-93b6-1d25252e14ee tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:05.949479 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-647c755e-94ca-4daf-9394-8017ee16f690 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:06.118373 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e4606c98-b5e0-482f-93b6-1d25252e14ee tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:06.160021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e4606c98-b5e0-482f-93b6-1d25252e14ee tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:06.186653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e4606c98-b5e0-482f-93b6-1d25252e14ee tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:06.192765 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e4606c98-b5e0-482f-93b6-1d25252e14ee tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1414 microversion: 2.54 time: 0.287727 Aug 24 10:24:06.194429 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1587/2837] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:05 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1414 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:06.258129 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5272dd61-7467-482f-9c66-3d089a07e690 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] Action: 'update', calling method: .version_select at 0x7f4647df0700>, body: {"quota_set": {"ram": "2048"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:06.393437 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=21 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:06.395964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5272dd61-7467-482f-9c66-3d089a07e690 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:06.397795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5272dd61-7467-482f-9c66-3d089a07e690 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:06.398578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5272dd61-7467-482f-9c66-3d089a07e690 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:06.400299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5272dd61-7467-482f-9c66-3d089a07e690 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:06.401107 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5272dd61-7467-482f-9c66-3d089a07e690 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:06.401827 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5272dd61-7467-482f-9c66-3d089a07e690 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:06.557181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5272dd61-7467-482f-9c66-3d089a07e690 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:06.557948 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5272dd61-7467-482f-9c66-3d089a07e690 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:06.558609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5272dd61-7467-482f-9c66-3d089a07e690 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:06.559717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5272dd61-7467-482f-9c66-3d089a07e690 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:06.560429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5272dd61-7467-482f-9c66-3d089a07e690 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:06.561761 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5272dd61-7467-482f-9c66-3d089a07e690 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:06.696337 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5272dd61-7467-482f-9c66-3d089a07e690 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-quota-sets/280a49630bdd4edf99e3175d903516c0?user_id=4ee876c416954190b1c7401a72cff730" status: 200 len: 148 microversion: 2.57 time: 0.442220 Aug 24 10:24:06.710011 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1588/2838] 10.222.0.85 () {62 vars in 1384 bytes} [Wed Aug 24 10:24:06 2022] PUT /compute/v2.1/os-quota-sets/280a49630bdd4edf99e3175d903516c0?user_id=4ee876c416954190b1c7401a72cff730 => generated 148 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:24:06.715178 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-90b4e9bc-e4fc-44b0-8aa8-037b635ad03b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:06.715904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-90b4e9bc-e4fc-44b0-8aa8-037b635ad03b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:06.734584 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90b4e9bc-e4fc-44b0-8aa8-037b635ad03b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:06.735139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90b4e9bc-e4fc-44b0-8aa8-037b635ad03b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:06.735967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90b4e9bc-e4fc-44b0-8aa8-037b635ad03b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:06.737107 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90b4e9bc-e4fc-44b0-8aa8-037b635ad03b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:06.737729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90b4e9bc-e4fc-44b0-8aa8-037b635ad03b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:06.738573 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90b4e9bc-e4fc-44b0-8aa8-037b635ad03b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:07.125368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-90b4e9bc-e4fc-44b0-8aa8-037b635ad03b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:07.148848 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-90b4e9bc-e4fc-44b0-8aa8-037b635ad03b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6" status: 200 len: 1315 microversion: 2.1 time: 0.437325 Aug 24 10:24:07.150389 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1589/2839] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:06 2022] GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 => generated 1315 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:07.171125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9de685d0-580b-4cf7-a484-42770c3c3c02 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] Calling method '.version_select at 0x7f4647e021f0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:07.282386 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-647c755e-94ca-4daf-9394-8017ee16f690 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:07.296593 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-647c755e-94ca-4daf-9394-8017ee16f690 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d" status: 200 len: 1333 microversion: 2.1 time: 1.377848 Aug 24 10:24:07.299721 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1251/2840] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:05 2022] GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d => generated 1333 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:07.308232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7ce0d2d4-5a2f-4f73-aaf7-610a20b6310e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:07.308867 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7ce0d2d4-5a2f-4f73-aaf7-610a20b6310e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:07.327210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ce0d2d4-5a2f-4f73-aaf7-610a20b6310e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:07.328726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ce0d2d4-5a2f-4f73-aaf7-610a20b6310e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:07.329691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ce0d2d4-5a2f-4f73-aaf7-610a20b6310e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:07.331601 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ce0d2d4-5a2f-4f73-aaf7-610a20b6310e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:07.332499 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ce0d2d4-5a2f-4f73-aaf7-610a20b6310e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:07.333571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ce0d2d4-5a2f-4f73-aaf7-610a20b6310e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:07.399534 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9de685d0-580b-4cf7-a484-42770c3c3c02 tempest-QuotasAdminTestV257-936639170 tempest-QuotasAdminTestV257-936639170-project-admin] 10.222.0.85 "GET /compute/v2.1/os-quota-sets/280a49630bdd4edf99e3175d903516c0?user_id=4ee876c416954190b1c7401a72cff730" status: 200 len: 190 microversion: 2.57 time: 0.245799 Aug 24 10:24:07.400151 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1590/2841] 10.222.0.85 () {60 vars in 1364 bytes} [Wed Aug 24 10:24:07 2022] GET /compute/v2.1/os-quota-sets/280a49630bdd4edf99e3175d903516c0?user_id=4ee876c416954190b1c7401a72cff730 => generated 190 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:24:07.419636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d6d4f94e-74f9-43da-ba9c-d1688c98b613 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:07.421025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d6d4f94e-74f9-43da-ba9c-d1688c98b613 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:07.428701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6d4f94e-74f9-43da-ba9c-d1688c98b613 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:07.429823 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6d4f94e-74f9-43da-ba9c-d1688c98b613 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:07.430449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6d4f94e-74f9-43da-ba9c-d1688c98b613 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:07.431358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6d4f94e-74f9-43da-ba9c-d1688c98b613 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:07.437256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6d4f94e-74f9-43da-ba9c-d1688c98b613 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:07.438316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6d4f94e-74f9-43da-ba9c-d1688c98b613 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:07.703143 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7ce0d2d4-5a2f-4f73-aaf7-610a20b6310e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:07.744250 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7ce0d2d4-5a2f-4f73-aaf7-610a20b6310e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e" status: 200 len: 1274 microversion: 2.1 time: 0.442412 Aug 24 10:24:07.747816 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1252/2842] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:07 2022] GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e => generated 1274 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:07.974240 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d6d4f94e-74f9-43da-ba9c-d1688c98b613 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:07.985531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d6d4f94e-74f9-43da-ba9c-d1688c98b613 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:07.988906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d6d4f94e-74f9-43da-ba9c-d1688c98b613 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:07.990451 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d6d4f94e-74f9-43da-ba9c-d1688c98b613 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1399 microversion: 2.54 time: 0.580508 Aug 24 10:24:08.010979 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1591/2843] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:07 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1399 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:08.026839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1c22c39d-84a2-4444-806f-b430db291c5e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '.version_select at 0x7f4655039dc0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:08.093773 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1c22c39d-84a2-4444-806f-b430db291c5e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-638569797" status: 204 len: 0 microversion: 2.54 time: 0.076336 Aug 24 10:24:08.094761 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1253/2844] 10.222.0.85 () {60 vars in 1316 bytes} [Wed Aug 24 10:24:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-638569797 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:24:08.107349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1350a201-4062-4bdc-93c8-f50482a97df2 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:08.107631 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1350a201-4062-4bdc-93c8-f50482a97df2 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:08.119327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1350a201-4062-4bdc-93c8-f50482a97df2 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:08.119967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1350a201-4062-4bdc-93c8-f50482a97df2 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:08.120477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1350a201-4062-4bdc-93c8-f50482a97df2 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:08.122905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1350a201-4062-4bdc-93c8-f50482a97df2 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:08.123439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1350a201-4062-4bdc-93c8-f50482a97df2 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:08.149733 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1350a201-4062-4bdc-93c8-f50482a97df2 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:08.190986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b83564a7-5477-483b-8bd7-5f7b9e395f88 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:08.191862 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b83564a7-5477-483b-8bd7-5f7b9e395f88 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:08.215921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b83564a7-5477-483b-8bd7-5f7b9e395f88 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:08.217550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b83564a7-5477-483b-8bd7-5f7b9e395f88 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:08.222250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b83564a7-5477-483b-8bd7-5f7b9e395f88 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:08.225419 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b83564a7-5477-483b-8bd7-5f7b9e395f88 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:08.229159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b83564a7-5477-483b-8bd7-5f7b9e395f88 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:08.233103 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b83564a7-5477-483b-8bd7-5f7b9e395f88 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:08.292201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1350a201-4062-4bdc-93c8-f50482a97df2 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:24:08.526322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:08.535830 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1350a201-4062-4bdc-93c8-f50482a97df2 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "DELETE /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 204 len: 0 microversion: 2.54 time: 0.433094 Aug 24 10:24:08.538220 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1592/2845] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:24:08 2022] DELETE /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 10:24:08.554976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e8c682f8-b1f7-4eaa-ac99-0cb2d90065fa tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:08.557403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e8c682f8-b1f7-4eaa-ac99-0cb2d90065fa tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:08.580411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8c682f8-b1f7-4eaa-ac99-0cb2d90065fa tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:08.581631 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8c682f8-b1f7-4eaa-ac99-0cb2d90065fa tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:08.583223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8c682f8-b1f7-4eaa-ac99-0cb2d90065fa tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:08.588022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8c682f8-b1f7-4eaa-ac99-0cb2d90065fa tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:08.588893 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8c682f8-b1f7-4eaa-ac99-0cb2d90065fa tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:08.589685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8c682f8-b1f7-4eaa-ac99-0cb2d90065fa tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:09.281881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b83564a7-5477-483b-8bd7-5f7b9e395f88 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:09.297363 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b83564a7-5477-483b-8bd7-5f7b9e395f88 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6" status: 200 len: 1315 microversion: 2.1 time: 1.110772 Aug 24 10:24:09.300898 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1254/2846] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:08 2022] GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 => generated 1315 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:09.311121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a84f060b-ae77-48d4-a22e-17c6fce747fa tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:09.314363 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a84f060b-ae77-48d4-a22e-17c6fce747fa tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:09.330033 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a84f060b-ae77-48d4-a22e-17c6fce747fa tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:09.330985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a84f060b-ae77-48d4-a22e-17c6fce747fa tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:09.331661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a84f060b-ae77-48d4-a22e-17c6fce747fa tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:09.332630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a84f060b-ae77-48d4-a22e-17c6fce747fa tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:09.333366 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a84f060b-ae77-48d4-a22e-17c6fce747fa tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:09.334004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a84f060b-ae77-48d4-a22e-17c6fce747fa tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:09.573309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a84f060b-ae77-48d4-a22e-17c6fce747fa tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:09.589156 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:09.598939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a84f060b-ae77-48d4-a22e-17c6fce747fa tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:09.604650 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a84f060b-ae77-48d4-a22e-17c6fce747fa tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:09.611344 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a84f060b-ae77-48d4-a22e-17c6fce747fa tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1405 microversion: 2.54 time: 0.308776 Aug 24 10:24:09.612187 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1255/2847] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:09 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1405 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:09.632417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-91dc0f6c-d7d7-412b-9830-5187f4121720 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:09.638350 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-91dc0f6c-d7d7-412b-9830-5187f4121720 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:09.662872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91dc0f6c-d7d7-412b-9830-5187f4121720 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:09.664043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91dc0f6c-d7d7-412b-9830-5187f4121720 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:09.665058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91dc0f6c-d7d7-412b-9830-5187f4121720 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:09.670216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91dc0f6c-d7d7-412b-9830-5187f4121720 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:09.671452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91dc0f6c-d7d7-412b-9830-5187f4121720 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:09.672460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91dc0f6c-d7d7-412b-9830-5187f4121720 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:09.749867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e8c682f8-b1f7-4eaa-ac99-0cb2d90065fa tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:09.791123 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e8c682f8-b1f7-4eaa-ac99-0cb2d90065fa tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d" status: 200 len: 1670 microversion: 2.1 time: 1.246569 Aug 24 10:24:09.794263 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1593/2848] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:08 2022] GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d => generated 1670 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:09.816199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-f9b2895f-5d1a-4e57-ba93-dd6b4b65ea3c req-e5830300-8d49-4beb-ad5a-eddef6997f7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6", "tag": "04d1717f-046b-4c08-9776-84ba02839aeb"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:09.847091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f9b2895f-5d1a-4e57-ba93-dd6b4b65ea3c req-e5830300-8d49-4beb-ad5a-eddef6997f7a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:09.849619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f9b2895f-5d1a-4e57-ba93-dd6b4b65ea3c req-e5830300-8d49-4beb-ad5a-eddef6997f7a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:09.858734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f9b2895f-5d1a-4e57-ba93-dd6b4b65ea3c req-e5830300-8d49-4beb-ad5a-eddef6997f7a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:09.880976 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-f9b2895f-5d1a-4e57-ba93-dd6b4b65ea3c req-e5830300-8d49-4beb-ad5a-eddef6997f7a service nova] Creating event network-changed:04d1717f-046b-4c08-9776-84ba02839aeb for instance 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 on n-h1-849328-3 Aug 24 10:24:09.890252 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-f9b2895f-5d1a-4e57-ba93-dd6b4b65ea3c req-e5830300-8d49-4beb-ad5a-eddef6997f7a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091702 Aug 24 10:24:09.898947 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1594/2849] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:24:09.904953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cd79da07-6010-433b-bb78-5ad0f23021b6 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:09.908347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cd79da07-6010-433b-bb78-5ad0f23021b6 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:09.925570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd79da07-6010-433b-bb78-5ad0f23021b6 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:09.927426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd79da07-6010-433b-bb78-5ad0f23021b6 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:09.932326 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd79da07-6010-433b-bb78-5ad0f23021b6 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:09.933451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd79da07-6010-433b-bb78-5ad0f23021b6 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:09.933946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd79da07-6010-433b-bb78-5ad0f23021b6 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:09.936811 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd79da07-6010-433b-bb78-5ad0f23021b6 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:09.973495 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cd79da07-6010-433b-bb78-5ad0f23021b6 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d/ips" status: 200 len: 181 microversion: 2.1 time: 0.072829 Aug 24 10:24:09.981226 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1595/2850] 10.222.0.85 () {58 vars in 1248 bytes} [Wed Aug 24 10:24:09 2022] GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d/ips => generated 181 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:24:09.987799 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cc9a3830-67a1-4eda-8f67-b6230f68c92b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:09.988737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cc9a3830-67a1-4eda-8f67-b6230f68c92b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:10.003140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc9a3830-67a1-4eda-8f67-b6230f68c92b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:10.003975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc9a3830-67a1-4eda-8f67-b6230f68c92b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:10.006296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc9a3830-67a1-4eda-8f67-b6230f68c92b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:10.007375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc9a3830-67a1-4eda-8f67-b6230f68c92b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:10.011190 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc9a3830-67a1-4eda-8f67-b6230f68c92b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:10.011887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc9a3830-67a1-4eda-8f67-b6230f68c92b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:10.149435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cc9a3830-67a1-4eda-8f67-b6230f68c92b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:24:10.343074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:10.456364 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cc9a3830-67a1-4eda-8f67-b6230f68c92b tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "DELETE /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d" status: 204 len: 0 microversion: 2.1 time: 0.473148 Aug 24 10:24:10.457735 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1596/2851] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:24:09 2022] DELETE /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:10.468250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-72e82e4e-e811-4e4a-a4d2-395212531a7b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:10.469886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-72e82e4e-e811-4e4a-a4d2-395212531a7b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:10.482029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72e82e4e-e811-4e4a-a4d2-395212531a7b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:10.482862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72e82e4e-e811-4e4a-a4d2-395212531a7b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:10.483696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72e82e4e-e811-4e4a-a4d2-395212531a7b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:10.484992 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72e82e4e-e811-4e4a-a4d2-395212531a7b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:10.485851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72e82e4e-e811-4e4a-a4d2-395212531a7b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:10.486495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72e82e4e-e811-4e4a-a4d2-395212531a7b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:11.048986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-72e82e4e-e811-4e4a-a4d2-395212531a7b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:11.052635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-91dc0f6c-d7d7-412b-9830-5187f4121720 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:11.090610 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-72e82e4e-e811-4e4a-a4d2-395212531a7b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6" status: 200 len: 1315 microversion: 2.1 time: 0.630492 Aug 24 10:24:11.105502 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-91dc0f6c-d7d7-412b-9830-5187f4121720 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e" status: 200 len: 1316 microversion: 2.1 time: 1.468248 Aug 24 10:24:11.105502 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1256/2852] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:09 2022] GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e => generated 1316 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:11.106894 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1597/2853] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:10 2022] GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 => generated 1315 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:11.112377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dd0edf4d-e926-4282-a420-c47cf112e75e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:11.113361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dd0edf4d-e926-4282-a420-c47cf112e75e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:11.125527 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-29d5d863-c976-43a5-971e-18405e42be56 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:11.129373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-29d5d863-c976-43a5-971e-18405e42be56 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:11.131253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd0edf4d-e926-4282-a420-c47cf112e75e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:11.145221 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd0edf4d-e926-4282-a420-c47cf112e75e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:11.146017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd0edf4d-e926-4282-a420-c47cf112e75e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:11.147916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd0edf4d-e926-4282-a420-c47cf112e75e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:11.153200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd0edf4d-e926-4282-a420-c47cf112e75e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:11.153910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd0edf4d-e926-4282-a420-c47cf112e75e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:11.158021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29d5d863-c976-43a5-971e-18405e42be56 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:11.158546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29d5d863-c976-43a5-971e-18405e42be56 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:11.161584 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29d5d863-c976-43a5-971e-18405e42be56 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:11.162823 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29d5d863-c976-43a5-971e-18405e42be56 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:11.163635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29d5d863-c976-43a5-971e-18405e42be56 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:11.164233 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29d5d863-c976-43a5-971e-18405e42be56 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:11.489961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dd0edf4d-e926-4282-a420-c47cf112e75e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:11.510460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dd0edf4d-e926-4282-a420-c47cf112e75e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:11.514418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dd0edf4d-e926-4282-a420-c47cf112e75e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:11.515749 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dd0edf4d-e926-4282-a420-c47cf112e75e tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1405 microversion: 2.54 time: 0.407568 Aug 24 10:24:11.530818 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1598/2854] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:11 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1405 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:11.722673 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-29d5d863-c976-43a5-971e-18405e42be56 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:11.733530 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-29d5d863-c976-43a5-971e-18405e42be56 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d" status: 200 len: 1676 microversion: 2.1 time: 0.626518 Aug 24 10:24:11.737661 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1257/2855] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:11 2022] GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d => generated 1676 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:12.115052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d5fa5a31-0a71-471f-8aa3-8bfa618b2aaa tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:12.116532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d5fa5a31-0a71-471f-8aa3-8bfa618b2aaa tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:12.121624 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0c1a25c2-3989-4824-a9cd-b71f7c9b1e24 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:12.125103 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0c1a25c2-3989-4824-a9cd-b71f7c9b1e24 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:12.130867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5fa5a31-0a71-471f-8aa3-8bfa618b2aaa tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:12.131760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5fa5a31-0a71-471f-8aa3-8bfa618b2aaa tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:12.132591 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5fa5a31-0a71-471f-8aa3-8bfa618b2aaa tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:12.139554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5fa5a31-0a71-471f-8aa3-8bfa618b2aaa tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:12.139781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5fa5a31-0a71-471f-8aa3-8bfa618b2aaa tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:12.140409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5fa5a31-0a71-471f-8aa3-8bfa618b2aaa tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:12.144795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c1a25c2-3989-4824-a9cd-b71f7c9b1e24 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:12.146691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c1a25c2-3989-4824-a9cd-b71f7c9b1e24 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:12.146691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c1a25c2-3989-4824-a9cd-b71f7c9b1e24 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:12.146691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c1a25c2-3989-4824-a9cd-b71f7c9b1e24 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:12.147139 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c1a25c2-3989-4824-a9cd-b71f7c9b1e24 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:12.147139 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c1a25c2-3989-4824-a9cd-b71f7c9b1e24 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:12.572432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0c1a25c2-3989-4824-a9cd-b71f7c9b1e24 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:12.594841 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0c1a25c2-3989-4824-a9cd-b71f7c9b1e24 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e" status: 200 len: 1316 microversion: 2.1 time: 0.479751 Aug 24 10:24:12.606548 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1258/2856] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:12 2022] GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e => generated 1316 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:24:12.623035 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fbb6137d-32e9-4553-9c59-4a066d9805b0 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:12.626213 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fbb6137d-32e9-4553-9c59-4a066d9805b0 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:12.644958 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbb6137d-32e9-4553-9c59-4a066d9805b0 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:12.661544 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbb6137d-32e9-4553-9c59-4a066d9805b0 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:12.664800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbb6137d-32e9-4553-9c59-4a066d9805b0 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:12.667558 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbb6137d-32e9-4553-9c59-4a066d9805b0 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:12.669149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbb6137d-32e9-4553-9c59-4a066d9805b0 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:12.669902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbb6137d-32e9-4553-9c59-4a066d9805b0 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:12.698302 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-fbb6137d-32e9-4553-9c59-4a066d9805b0 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] HTTP exception thrown: Instance 0f6298f4-4be1-47e8-a260-c43d83731e08 could not be found. Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fbb6137d-32e9-4553-9c59-4a066d9805b0 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Request method failure captured: Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 HTTP/1.1 Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfudiGwgQR8hKNArlntC2-dsrrKYTIBlVuqrLiKtM4eZghwt1HeSFJ5N9-48WnbytHcTbPaBfCxYfyMVtlusuM5dascE6lo4JZ82bLT9CTJVIVT7B5x8VyNNJsS1rVsBWV75VPq-6am2EoKTaDa4KN-Snb_8XELQ6zu0yLTEh-41L48 Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 1d5264f4afb64ba9927050b9b94d37a8 Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-662179688 Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1d5264f4afb64ba9927050b9b94d37a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_1d5264f4afb64ba9927050b9b94d37a8", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1d5264f4afb64ba9927050b9b94d37a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/1d5264f4afb64ba9927050b9b94d37a8"}]}] Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-662179688 Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 1d5264f4afb64ba9927050b9b94d37a8 Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-662179688 Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-AttachSCSIVolumeTestJSON-662179688-project Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 3d264ad8190a4cd9be236d05564fe1a2 Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-662179688-project Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 0f6298f4-4be1-47e8-a260-c43d83731e08 could not be found. Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '0f6298f4-4be1-47e8-a260-c43d83731e08'} Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f6298f4-4be1-47e8-a260-c43d83731e08 could not be found. Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:24:12.702807 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:24:12.707922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f6298f4-4be1-47e8-a260-c43d83731e08 could not be found. Aug 24 10:24:12.707922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:12.707922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:12.707922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:12.707922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:12.707922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:12.707922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:12.707922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:12.707922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:12.707922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f6298f4-4be1-47e8-a260-c43d83731e08 could not be found. Aug 24 10:24:12.707922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:12.707922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fbb6137d-32e9-4553-9c59-4a066d9805b0 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Returning 404 to user: Instance 0f6298f4-4be1-47e8-a260-c43d83731e08 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:12.707922 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fbb6137d-32e9-4553-9c59-4a066d9805b0 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "DELETE /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08" status: 404 len: 111 microversion: 2.1 time: 0.097697 Aug 24 10:24:12.707922 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1259/2857] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:24:12 2022] DELETE /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:24:12.719565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-325769ce-6dee-4c9a-863e-1f892714e380 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:12.720803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-325769ce-6dee-4c9a-863e-1f892714e380 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:12.736551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-325769ce-6dee-4c9a-863e-1f892714e380 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:12.737457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-325769ce-6dee-4c9a-863e-1f892714e380 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:12.738231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-325769ce-6dee-4c9a-863e-1f892714e380 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:12.739536 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-325769ce-6dee-4c9a-863e-1f892714e380 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:12.740841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-325769ce-6dee-4c9a-863e-1f892714e380 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:12.742237 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-325769ce-6dee-4c9a-863e-1f892714e380 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:12.975222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-325769ce-6dee-4c9a-863e-1f892714e380 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:12.995523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-325769ce-6dee-4c9a-863e-1f892714e380 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:13.004986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-325769ce-6dee-4c9a-863e-1f892714e380 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3705176d7c994a55b01c4eb77a4d7ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020519f2cb541348a73961f00a80e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:13.010688 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-325769ce-6dee-4c9a-863e-1f892714e380 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 200 len: 1405 microversion: 2.54 time: 0.301214 Aug 24 10:24:13.011412 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1260/2858] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:12 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 1405 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:13.029551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-14c02d80-b17e-4ccb-b95f-7f22632e1da3 req-c378ce8d-08f3-45d9-920a-4266286686c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0a30de6-ae02-49e5-87d5-558660bd9b1e", "tag": "3cfea031-56f2-4af5-9636-0ed3c213c5c8"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:13.055542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d5fa5a31-0a71-471f-8aa3-8bfa618b2aaa tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:13.064362 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d5fa5a31-0a71-471f-8aa3-8bfa618b2aaa tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6" status: 200 len: 1315 microversion: 2.1 time: 0.954712 Aug 24 10:24:13.065399 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1599/2859] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:12 2022] GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 => generated 1315 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:24:13.067298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-14c02d80-b17e-4ccb-b95f-7f22632e1da3 req-c378ce8d-08f3-45d9-920a-4266286686c0 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:13.068652 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-14c02d80-b17e-4ccb-b95f-7f22632e1da3 req-c378ce8d-08f3-45d9-920a-4266286686c0 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:13.069109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-14c02d80-b17e-4ccb-b95f-7f22632e1da3 req-c378ce8d-08f3-45d9-920a-4266286686c0 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:13.081407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c602d698-b001-4f96-b18d-962a209adc79 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:13.082376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c602d698-b001-4f96-b18d-962a209adc79 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] [instance: 0f6298f4-4be1-47e8-a260-c43d83731e08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:13.097305 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c602d698-b001-4f96-b18d-962a209adc79 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:13.098148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c602d698-b001-4f96-b18d-962a209adc79 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:13.098777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c602d698-b001-4f96-b18d-962a209adc79 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:13.099710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c602d698-b001-4f96-b18d-962a209adc79 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:13.100335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c602d698-b001-4f96-b18d-962a209adc79 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:13.100949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c602d698-b001-4f96-b18d-962a209adc79 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:13.130183 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-14c02d80-b17e-4ccb-b95f-7f22632e1da3 req-c378ce8d-08f3-45d9-920a-4266286686c0 service nova] Creating event network-changed:3cfea031-56f2-4af5-9636-0ed3c213c5c8 for instance b0a30de6-ae02-49e5-87d5-558660bd9b1e on n-h1-849328-3 Aug 24 10:24:13.137571 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-c602d698-b001-4f96-b18d-962a209adc79 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] HTTP exception thrown: Instance 0f6298f4-4be1-47e8-a260-c43d83731e08 could not be found. Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c602d698-b001-4f96-b18d-962a209adc79 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Request method failure captured: Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 HTTP/1.1 Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfudiGwgQR8hKNArlntC2-dsrrKYTIBlVuqrLiKtM4eZghwt1HeSFJ5N9-48WnbytHcTbPaBfCxYfyMVtlusuM5dascE6lo4JZ82bLT9CTJVIVT7B5x8VyNNJsS1rVsBWV75VPq-6am2EoKTaDa4KN-Snb_8XELQ6zu0yLTEh-41L48 Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 1d5264f4afb64ba9927050b9b94d37a8 Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-662179688 Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1d5264f4afb64ba9927050b9b94d37a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_1d5264f4afb64ba9927050b9b94d37a8", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1d5264f4afb64ba9927050b9b94d37a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/1d5264f4afb64ba9927050b9b94d37a8"}]}] Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-662179688 Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 1d5264f4afb64ba9927050b9b94d37a8 Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-662179688 Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AttachSCSIVolumeTestJSON-662179688-project Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 3d264ad8190a4cd9be236d05564fe1a2 Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-662179688-project Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 0f6298f4-4be1-47e8-a260-c43d83731e08 could not be found. Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '0f6298f4-4be1-47e8-a260-c43d83731e08'} Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f6298f4-4be1-47e8-a260-c43d83731e08 could not be found. Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f6298f4-4be1-47e8-a260-c43d83731e08 could not be found. Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:13.140207 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:13.144981 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:13.144981 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:13.144981 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:13.144981 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:13.144981 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:13.144981 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f6298f4-4be1-47e8-a260-c43d83731e08 could not be found. Aug 24 10:24:13.144981 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:13.145511 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-14c02d80-b17e-4ccb-b95f-7f22632e1da3 req-c378ce8d-08f3-45d9-920a-4266286686c0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125228 Aug 24 10:24:13.145511 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1261/2860] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:24:13.156796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c602d698-b001-4f96-b18d-962a209adc79 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] Returning 404 to user: Instance 0f6298f4-4be1-47e8-a260-c43d83731e08 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:13.158172 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c602d698-b001-4f96-b18d-962a209adc79 tempest-AttachSCSIVolumeTestJSON-662179688 tempest-AttachSCSIVolumeTestJSON-662179688-project] 10.222.0.85 "GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08" status: 404 len: 111 microversion: 2.1 time: 0.089909 Aug 24 10:24:13.159296 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1600/2861] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:13 2022] GET /compute/v2.1/servers/0f6298f4-4be1-47e8-a260-c43d83731e08 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:24:13.162974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e10fbfe4-578e-4204-ab22-54ec64dd86c1 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:13.164513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e10fbfe4-578e-4204-ab22-54ec64dd86c1 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:13.183479 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e10fbfe4-578e-4204-ab22-54ec64dd86c1 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:13.184425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e10fbfe4-578e-4204-ab22-54ec64dd86c1 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:13.187164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e10fbfe4-578e-4204-ab22-54ec64dd86c1 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:13.188129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e10fbfe4-578e-4204-ab22-54ec64dd86c1 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:13.188624 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e10fbfe4-578e-4204-ab22-54ec64dd86c1 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:13.189066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e10fbfe4-578e-4204-ab22-54ec64dd86c1 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:13.635960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a24e4dda-5654-483b-8f39-6b98190139ad tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:13.636976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a24e4dda-5654-483b-8f39-6b98190139ad tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:13.656454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a24e4dda-5654-483b-8f39-6b98190139ad tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:13.658728 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a24e4dda-5654-483b-8f39-6b98190139ad tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:13.661607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a24e4dda-5654-483b-8f39-6b98190139ad tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:13.663431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a24e4dda-5654-483b-8f39-6b98190139ad tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:13.664695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a24e4dda-5654-483b-8f39-6b98190139ad tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:13.666078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a24e4dda-5654-483b-8f39-6b98190139ad tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:13.749232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e10fbfe4-578e-4204-ab22-54ec64dd86c1 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:13.765062 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e10fbfe4-578e-4204-ab22-54ec64dd86c1 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d" status: 200 len: 1676 microversion: 2.1 time: 0.615528 Aug 24 10:24:13.787986 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1262/2862] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:13 2022] GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d => generated 1676 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:14.042169 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d2b2c685-f0eb-4613-8c6b-f128ced3bee0 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:14.043138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d2b2c685-f0eb-4613-8c6b-f128ced3bee0 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] [instance: 596766ec-31a4-421f-b15e-329959f5a400] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:14.055924 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2b2c685-f0eb-4613-8c6b-f128ced3bee0 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:14.056673 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2b2c685-f0eb-4613-8c6b-f128ced3bee0 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:14.059140 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2b2c685-f0eb-4613-8c6b-f128ced3bee0 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:14.064893 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2b2c685-f0eb-4613-8c6b-f128ced3bee0 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:14.067850 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2b2c685-f0eb-4613-8c6b-f128ced3bee0 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:14.070511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2b2c685-f0eb-4613-8c6b-f128ced3bee0 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:14.134921 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-d2b2c685-f0eb-4613-8c6b-f128ced3bee0 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] HTTP exception thrown: Instance 596766ec-31a4-421f-b15e-329959f5a400 could not be found. Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d2b2c685-f0eb-4613-8c6b-f128ced3bee0 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Request method failure captured: Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 HTTP/1.1 Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfwahgbmfOHJgoRNZaisNVegJBFT3lJKnwTzz7_hO9cPIyB8tPOsqMT2uzuaU__7qpMXCfNpZwrJFXlJKbLVI10Kw28WyND_gafuZeUC4kAJkQ5VY18p6j415jT74BFdgwWuv2fXRpyzP-ROibaq7xx-_ejQoc630yeTIZjS1t2nc-U Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: X-Openstack-Nova-Api-Version: 2.54 Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 0020519f2cb541348a73961f00a80e74 Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerShowV254Test-380657582 Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0020519f2cb541348a73961f00a80e74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0020519f2cb541348a73961f00a80e74", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0020519f2cb541348a73961f00a80e74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0020519f2cb541348a73961f00a80e74"}]}] Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerShowV254Test-380657582 Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 0020519f2cb541348a73961f00a80e74 Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerShowV254Test-380657582 Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerShowV254Test-380657582-project Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 3705176d7c994a55b01c4eb77a4d7ec1 Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerShowV254Test-380657582-project Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 596766ec-31a4-421f-b15e-329959f5a400 could not be found. Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '596766ec-31a4-421f-b15e-329959f5a400'} Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 596766ec-31a4-421f-b15e-329959f5a400 could not be found. Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 596766ec-31a4-421f-b15e-329959f5a400 could not be found. Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:14.139305 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:14.144349 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:14.144349 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:14.144349 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:14.144349 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:14.144349 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:14.144349 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 596766ec-31a4-421f-b15e-329959f5a400 could not be found. Aug 24 10:24:14.144349 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:14.154645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d2b2c685-f0eb-4613-8c6b-f128ced3bee0 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] Returning 404 to user: Instance 596766ec-31a4-421f-b15e-329959f5a400 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:14.158187 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d2b2c685-f0eb-4613-8c6b-f128ced3bee0 tempest-ServerShowV254Test-380657582 tempest-ServerShowV254Test-380657582-project] 10.222.0.85 "GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400" status: 404 len: 111 microversion: 2.54 time: 0.122590 Aug 24 10:24:14.160301 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1263/2863] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:14 2022] GET /compute/v2.1/servers/596766ec-31a4-421f-b15e-329959f5a400 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:24:14.166222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-38809a7b-39e5-4e81-89a2-d731fef1b242 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:14.167045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-38809a7b-39e5-4e81-89a2-d731fef1b242 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:14.173390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38809a7b-39e5-4e81-89a2-d731fef1b242 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:14.174096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38809a7b-39e5-4e81-89a2-d731fef1b242 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:14.174718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38809a7b-39e5-4e81-89a2-d731fef1b242 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:14.175574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38809a7b-39e5-4e81-89a2-d731fef1b242 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:14.176177 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38809a7b-39e5-4e81-89a2-d731fef1b242 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:14.176755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38809a7b-39e5-4e81-89a2-d731fef1b242 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:14.372125 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-38809a7b-39e5-4e81-89a2-d731fef1b242 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:14.384623 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-38809a7b-39e5-4e81-89a2-d731fef1b242 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6" status: 200 len: 1315 microversion: 2.1 time: 0.223068 Aug 24 10:24:14.398674 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1264/2864] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:14 2022] GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:14.687736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a24e4dda-5654-483b-8f39-6b98190139ad tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:14.711544 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a24e4dda-5654-483b-8f39-6b98190139ad tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e" status: 200 len: 1316 microversion: 2.1 time: 1.085251 Aug 24 10:24:14.714394 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1601/2865] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:13 2022] GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e => generated 1316 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:14.790603 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-97ee9067-e351-4223-a507-f4e586753f86 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:14.791502 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-97ee9067-e351-4223-a507-f4e586753f86 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:14.800466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97ee9067-e351-4223-a507-f4e586753f86 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:14.801485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97ee9067-e351-4223-a507-f4e586753f86 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:14.802066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97ee9067-e351-4223-a507-f4e586753f86 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:14.804133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97ee9067-e351-4223-a507-f4e586753f86 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:14.804847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97ee9067-e351-4223-a507-f4e586753f86 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:14.805551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97ee9067-e351-4223-a507-f4e586753f86 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:15.147790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-97ee9067-e351-4223-a507-f4e586753f86 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:15.162984 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-97ee9067-e351-4223-a507-f4e586753f86 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d" status: 200 len: 1676 microversion: 2.1 time: 0.376792 Aug 24 10:24:15.177104 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1265/2866] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:14 2022] GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d => generated 1676 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:15.408625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fec8cd4f-ea74-4ba1-b7b9-c076d6b21daf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:15.409492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fec8cd4f-ea74-4ba1-b7b9-c076d6b21daf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:15.426996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fec8cd4f-ea74-4ba1-b7b9-c076d6b21daf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:15.435884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fec8cd4f-ea74-4ba1-b7b9-c076d6b21daf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:15.437825 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fec8cd4f-ea74-4ba1-b7b9-c076d6b21daf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:15.441591 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fec8cd4f-ea74-4ba1-b7b9-c076d6b21daf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:15.442222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fec8cd4f-ea74-4ba1-b7b9-c076d6b21daf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:15.442913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fec8cd4f-ea74-4ba1-b7b9-c076d6b21daf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:15.753709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5d34e8ae-49c6-44eb-8a67-9364f2f66aed tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:15.756404 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5d34e8ae-49c6-44eb-8a67-9364f2f66aed tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:15.788197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d34e8ae-49c6-44eb-8a67-9364f2f66aed tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:15.789067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d34e8ae-49c6-44eb-8a67-9364f2f66aed tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:15.789991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d34e8ae-49c6-44eb-8a67-9364f2f66aed tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:15.793445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d34e8ae-49c6-44eb-8a67-9364f2f66aed tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:15.795545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d34e8ae-49c6-44eb-8a67-9364f2f66aed tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:15.797752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d34e8ae-49c6-44eb-8a67-9364f2f66aed tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:15.803551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=14 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:15.836232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=17 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:15.919770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fec8cd4f-ea74-4ba1-b7b9-c076d6b21daf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:15.938879 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fec8cd4f-ea74-4ba1-b7b9-c076d6b21daf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6" status: 200 len: 1315 microversion: 2.1 time: 0.534435 Aug 24 10:24:15.953733 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1602/2867] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:15 2022] GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:16.185562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-18fc5728-1520-4cf9-a464-483dcafc6b0f tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:16.186418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-18fc5728-1520-4cf9-a464-483dcafc6b0f tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:16.195343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18fc5728-1520-4cf9-a464-483dcafc6b0f tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:16.196064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18fc5728-1520-4cf9-a464-483dcafc6b0f tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:16.196666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18fc5728-1520-4cf9-a464-483dcafc6b0f tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:16.197671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18fc5728-1520-4cf9-a464-483dcafc6b0f tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:16.198505 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18fc5728-1520-4cf9-a464-483dcafc6b0f tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:16.199096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18fc5728-1520-4cf9-a464-483dcafc6b0f tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:16.363990 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5d34e8ae-49c6-44eb-8a67-9364f2f66aed tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:16.375978 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5d34e8ae-49c6-44eb-8a67-9364f2f66aed tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e" status: 200 len: 1316 microversion: 2.1 time: 0.644881 Aug 24 10:24:16.387038 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1266/2868] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:15 2022] GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e => generated 1316 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:16.575496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a933e2cd-7553-46f1-bda5-297920d19e19 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Action: 'update', calling method: .version_select at 0x7f46542613a0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:16.579087 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:24:16.579087 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:24:16.581097 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a933e2cd-7553-46f1-bda5-297920d19e19 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:16.581797 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a933e2cd-7553-46f1-bda5-297920d19e19 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:16.582344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a933e2cd-7553-46f1-bda5-297920d19e19 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:16.590493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=11 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:16.596335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a933e2cd-7553-46f1-bda5-297920d19e19 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:16.598455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a933e2cd-7553-46f1-bda5-297920d19e19 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:16.599568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a933e2cd-7553-46f1-bda5-297920d19e19 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:16.622458 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-a933e2cd-7553-46f1-bda5-297920d19e19 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] HTTP exception thrown: Service 27e2b638-8ee6-4d4b-86ca-3a49c85d49cc could not be found. Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a933e2cd-7553-46f1-bda5-297920d19e19 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Request method failure captured: Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: request: PUT /compute/v2.1/os-services/27e2b638-8ee6-4d4b-86ca-3a49c85d49cc HTTP/1.1 Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 56 Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfxQQ5cv1OgvYsF1SMMTOmmOfS_wKpwUGYmFJrGQZAO4sM_BG6b47XusjonJ9GJQC6FKbBR-ftA3NFMm2ni_zqHRRZLWjRCrD5drozPNpGaufwnWhkVqkA1fwT8opnqT7RXnY_yDBlQWx_87oVQl2-6J7xWsGyntOoVeMboXiTAxB30 Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: X-Openstack-Nova-Api-Version: 2.53 Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 85776814aeab48a3b242971007f9b495 Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-631920343 Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,admin,member Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,admin,member Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/85776814aeab48a3b242971007f9b495"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_85776814aeab48a3b242971007f9b495", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/85776814aeab48a3b242971007f9b495"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/85776814aeab48a3b242971007f9b495"}]}] Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-631920343 Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 85776814aeab48a3b242971007f9b495 Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-631920343 Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 51cbe52ffb054cf094c84792a33b4009 Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: exception: Service 27e2b638-8ee6-4d4b-86ca-3a49c85d49cc could not be found. Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '27e2b638-8ee6-4d4b-86ca-3a49c85d49cc', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6202, in service_get_by_id Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6204, in service_get_by_id Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 27e2b638-8ee6-4d4b-86ca-3a49c85d49cc could not be found. Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:24:16.624780 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:24:16.628903 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 24 10:24:16.628903 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:24:16.628903 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 27e2b638-8ee6-4d4b-86ca-3a49c85d49cc could not be found. Aug 24 10:24:16.628903 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:16.628903 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:16.628903 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:16.628903 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:16.628903 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:16.628903 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:16.628903 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:16.628903 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:16.628903 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 27e2b638-8ee6-4d4b-86ca-3a49c85d49cc could not be found. Aug 24 10:24:16.628903 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:16.628903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a933e2cd-7553-46f1-bda5-297920d19e19 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Returning 404 to user: Service 27e2b638-8ee6-4d4b-86ca-3a49c85d49cc could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:16.631466 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a933e2cd-7553-46f1-bda5-297920d19e19 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-services/27e2b638-8ee6-4d4b-86ca-3a49c85d49cc" status: 404 len: 110 microversion: 2.53 time: 0.242424 Aug 24 10:24:16.639210 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1267/2869] 10.222.0.85 () {62 vars in 1309 bytes} [Wed Aug 24 10:24:16 2022] PUT /compute/v2.1/os-services/27e2b638-8ee6-4d4b-86ca-3a49c85d49cc => generated 110 bytes in 251 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:24:16.666727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-b9f75f92-23d4-4114-81b0-a76618d82bb2 req-ade86e07-c4a3-4162-a8c1-ba75159f703d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6", "name": "network-vif-plugged", "status": "completed", "tag": "04d1717f-046b-4c08-9776-84ba02839aeb"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:16.702407 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b9f75f92-23d4-4114-81b0-a76618d82bb2 req-ade86e07-c4a3-4162-a8c1-ba75159f703d service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:16.705309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b9f75f92-23d4-4114-81b0-a76618d82bb2 req-ade86e07-c4a3-4162-a8c1-ba75159f703d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:16.705877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b9f75f92-23d4-4114-81b0-a76618d82bb2 req-ade86e07-c4a3-4162-a8c1-ba75159f703d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:16.737258 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b9f75f92-23d4-4114-81b0-a76618d82bb2 req-ade86e07-c4a3-4162-a8c1-ba75159f703d service nova] Creating event network-vif-plugged:04d1717f-046b-4c08-9776-84ba02839aeb for instance 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 on n-h1-849328-3 Aug 24 10:24:16.746930 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-b9f75f92-23d4-4114-81b0-a76618d82bb2 req-ade86e07-c4a3-4162-a8c1-ba75159f703d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106182 Aug 24 10:24:16.747557 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1268/2870] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:24:16.758989 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-38ba522a-5763-4aac-ab8c-a802fc209d3b req-d1619d3c-a684-456f-8bf4-396946b5ca63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a02ab88-8424-479f-8bdd-d1e671d8bb6d", "name": "network-vif-deleted", "tag": "f559473b-80a3-43ce-8939-16ffa1b2a0de"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:16.810477 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-38ba522a-5763-4aac-ab8c-a802fc209d3b req-d1619d3c-a684-456f-8bf4-396946b5ca63 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:16.813802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-38ba522a-5763-4aac-ab8c-a802fc209d3b req-d1619d3c-a684-456f-8bf4-396946b5ca63 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:16.815465 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-38ba522a-5763-4aac-ab8c-a802fc209d3b req-d1619d3c-a684-456f-8bf4-396946b5ca63 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:16.843471 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-38ba522a-5763-4aac-ab8c-a802fc209d3b req-d1619d3c-a684-456f-8bf4-396946b5ca63 service nova] Creating event network-vif-deleted:f559473b-80a3-43ce-8939-16ffa1b2a0de for instance 0a02ab88-8424-479f-8bdd-d1e671d8bb6d on n-h2-849328-3 Aug 24 10:24:16.869880 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-38ba522a-5763-4aac-ab8c-a802fc209d3b req-d1619d3c-a684-456f-8bf4-396946b5ca63 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114495 Aug 24 10:24:16.875842 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1269/2871] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:24:16.888898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4075874d-6df9-4991-a149-6d5cbc120f6c tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Action: 'update', calling method: .version_select at 0x7f465432f3a0>, body: {"status": "disabled"} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:16.893996 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:24:16.893996 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:24:16.898617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4075874d-6df9-4991-a149-6d5cbc120f6c tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:16.901934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4075874d-6df9-4991-a149-6d5cbc120f6c tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:16.903591 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4075874d-6df9-4991-a149-6d5cbc120f6c tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:16.921176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4075874d-6df9-4991-a149-6d5cbc120f6c tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:16.922082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4075874d-6df9-4991-a149-6d5cbc120f6c tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:16.922764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4075874d-6df9-4991-a149-6d5cbc120f6c tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:16.937617 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-4075874d-6df9-4991-a149-6d5cbc120f6c tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] HTTP exception thrown: Service 27e2b638-8ee6-4d4b-86ca-3a49c85d49cc could not be found. Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4075874d-6df9-4991-a149-6d5cbc120f6c tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Request method failure captured: Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: request: PUT /compute/v2.1/os-services/27e2b638-8ee6-4d4b-86ca-3a49c85d49cc HTTP/1.1 Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 22 Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfxQQ5cv1OgvYsF1SMMTOmmOfS_wKpwUGYmFJrGQZAO4sM_BG6b47XusjonJ9GJQC6FKbBR-ftA3NFMm2ni_zqHRRZLWjRCrD5drozPNpGaufwnWhkVqkA1fwT8opnqT7RXnY_yDBlQWx_87oVQl2-6J7xWsGyntOoVeMboXiTAxB30 Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: X-Openstack-Nova-Api-Version: 2.53 Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 85776814aeab48a3b242971007f9b495 Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-631920343 Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,admin,member Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,admin,member Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/85776814aeab48a3b242971007f9b495"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_85776814aeab48a3b242971007f9b495", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/85776814aeab48a3b242971007f9b495"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/85776814aeab48a3b242971007f9b495"}]}] Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-631920343 Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 85776814aeab48a3b242971007f9b495 Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-631920343 Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 51cbe52ffb054cf094c84792a33b4009 Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: {"status": "disabled"} Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: exception: Service 27e2b638-8ee6-4d4b-86ca-3a49c85d49cc could not be found. Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '27e2b638-8ee6-4d4b-86ca-3a49c85d49cc', 'body': {'status': 'disabled'}} Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6202, in service_get_by_id Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6204, in service_get_by_id Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 27e2b638-8ee6-4d4b-86ca-3a49c85d49cc could not be found. Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:24:16.939950 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:24:16.944996 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 24 10:24:16.944996 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:24:16.944996 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 27e2b638-8ee6-4d4b-86ca-3a49c85d49cc could not be found. Aug 24 10:24:16.944996 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:16.944996 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:16.944996 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:16.944996 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:16.944996 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:16.944996 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:16.944996 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:16.944996 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:16.944996 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 27e2b638-8ee6-4d4b-86ca-3a49c85d49cc could not be found. Aug 24 10:24:16.944996 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:16.944996 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4075874d-6df9-4991-a149-6d5cbc120f6c tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Returning 404 to user: Service 27e2b638-8ee6-4d4b-86ca-3a49c85d49cc could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:16.946572 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4075874d-6df9-4991-a149-6d5cbc120f6c tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-services/27e2b638-8ee6-4d4b-86ca-3a49c85d49cc" status: 404 len: 110 microversion: 2.53 time: 0.063493 Aug 24 10:24:16.953537 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1270/2872] 10.222.0.85 () {62 vars in 1309 bytes} [Wed Aug 24 10:24:16 2022] PUT /compute/v2.1/os-services/27e2b638-8ee6-4d4b-86ca-3a49c85d49cc => generated 110 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:24:16.969945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-89aa7b70-e570-441c-a022-4be728e6302f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:16.970702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-89aa7b70-e570-441c-a022-4be728e6302f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:16.989859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89aa7b70-e570-441c-a022-4be728e6302f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:16.993060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89aa7b70-e570-441c-a022-4be728e6302f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:16.993753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89aa7b70-e570-441c-a022-4be728e6302f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:16.996001 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89aa7b70-e570-441c-a022-4be728e6302f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:16.996687 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89aa7b70-e570-441c-a022-4be728e6302f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:16.997978 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89aa7b70-e570-441c-a022-4be728e6302f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:17.002847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-18fc5728-1520-4cf9-a464-483dcafc6b0f tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:17.013969 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-18fc5728-1520-4cf9-a464-483dcafc6b0f tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d" status: 200 len: 1655 microversion: 2.1 time: 0.833470 Aug 24 10:24:17.017145 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1603/2873] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:16 2022] GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d => generated 1655 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:24:17.027850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2fb13c38-7724-4d17-9cc5-98b7f35fa719 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Action: 'update', calling method: .version_select at 0x7f4647dc2a60>, body: {"status": "enabled"} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:17.036890 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:24:17.036890 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:24:17.038880 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fb13c38-7724-4d17-9cc5-98b7f35fa719 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:17.039489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fb13c38-7724-4d17-9cc5-98b7f35fa719 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:17.040047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fb13c38-7724-4d17-9cc5-98b7f35fa719 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:17.056995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fb13c38-7724-4d17-9cc5-98b7f35fa719 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:17.057757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fb13c38-7724-4d17-9cc5-98b7f35fa719 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:17.066228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fb13c38-7724-4d17-9cc5-98b7f35fa719 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:17.076391 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-2fb13c38-7724-4d17-9cc5-98b7f35fa719 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] HTTP exception thrown: Service 27e2b638-8ee6-4d4b-86ca-3a49c85d49cc could not be found. Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2fb13c38-7724-4d17-9cc5-98b7f35fa719 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Request method failure captured: Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: request: PUT /compute/v2.1/os-services/27e2b638-8ee6-4d4b-86ca-3a49c85d49cc HTTP/1.1 Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 21 Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfxQQ5cv1OgvYsF1SMMTOmmOfS_wKpwUGYmFJrGQZAO4sM_BG6b47XusjonJ9GJQC6FKbBR-ftA3NFMm2ni_zqHRRZLWjRCrD5drozPNpGaufwnWhkVqkA1fwT8opnqT7RXnY_yDBlQWx_87oVQl2-6J7xWsGyntOoVeMboXiTAxB30 Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.53 Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 85776814aeab48a3b242971007f9b495 Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-631920343 Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/85776814aeab48a3b242971007f9b495"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_85776814aeab48a3b242971007f9b495", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/85776814aeab48a3b242971007f9b495"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/85776814aeab48a3b242971007f9b495"}]}] Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-631920343 Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 85776814aeab48a3b242971007f9b495 Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-631920343 Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 51cbe52ffb054cf094c84792a33b4009 Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: {"status": "enabled"} Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: exception: Service 27e2b638-8ee6-4d4b-86ca-3a49c85d49cc could not be found. Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '27e2b638-8ee6-4d4b-86ca-3a49c85d49cc', 'body': {'status': 'enabled'}} Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6202, in service_get_by_id Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6204, in service_get_by_id Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 27e2b638-8ee6-4d4b-86ca-3a49c85d49cc could not be found. Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:24:17.078770 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:24:17.083471 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 24 10:24:17.083471 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:24:17.083471 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 27e2b638-8ee6-4d4b-86ca-3a49c85d49cc could not be found. Aug 24 10:24:17.083471 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:17.083471 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:17.083471 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:17.083471 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:17.083471 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:17.083471 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:17.083471 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:17.083471 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:17.083471 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 27e2b638-8ee6-4d4b-86ca-3a49c85d49cc could not be found. Aug 24 10:24:17.083471 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:17.087895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2fb13c38-7724-4d17-9cc5-98b7f35fa719 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Returning 404 to user: Service 27e2b638-8ee6-4d4b-86ca-3a49c85d49cc could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:17.088809 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2fb13c38-7724-4d17-9cc5-98b7f35fa719 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-services/27e2b638-8ee6-4d4b-86ca-3a49c85d49cc" status: 404 len: 110 microversion: 2.53 time: 0.070420 Aug 24 10:24:17.089454 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1604/2874] 10.222.0.85 () {62 vars in 1309 bytes} [Wed Aug 24 10:24:17 2022] PUT /compute/v2.1/os-services/27e2b638-8ee6-4d4b-86ca-3a49c85d49cc => generated 110 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:24:17.100107 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-850fdba8-b6d6-4fc3-8246-60ea6e3cc925 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:17.102826 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:24:17.102826 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:24:17.104010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-850fdba8-b6d6-4fc3-8246-60ea6e3cc925 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:17.104505 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-850fdba8-b6d6-4fc3-8246-60ea6e3cc925 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:17.105161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-850fdba8-b6d6-4fc3-8246-60ea6e3cc925 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:17.106083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-850fdba8-b6d6-4fc3-8246-60ea6e3cc925 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:17.106689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-850fdba8-b6d6-4fc3-8246-60ea6e3cc925 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:17.107288 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-850fdba8-b6d6-4fc3-8246-60ea6e3cc925 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:17.137943 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-850fdba8-b6d6-4fc3-8246-60ea6e3cc925 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.042732 Aug 24 10:24:17.146811 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1605/2875] 10.222.0.85 () {60 vars in 1178 bytes} [Wed Aug 24 10:24:17 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:17.157304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c0f2a753-4e4c-4426-8691-fd176d6337ca tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:17.159837 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:24:17.159837 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:24:17.161008 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0f2a753-4e4c-4426-8691-fd176d6337ca tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:17.173958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0f2a753-4e4c-4426-8691-fd176d6337ca tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:17.174411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0f2a753-4e4c-4426-8691-fd176d6337ca tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:17.175231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0f2a753-4e4c-4426-8691-fd176d6337ca tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:17.175690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0f2a753-4e4c-4426-8691-fd176d6337ca tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:17.176116 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0f2a753-4e4c-4426-8691-fd176d6337ca tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:17.220766 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c0f2a753-4e4c-4426-8691-fd176d6337ca tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.070158 Aug 24 10:24:17.233683 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1606/2876] 10.222.0.85 () {60 vars in 1211 bytes} [Wed Aug 24 10:24:17 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:17.239087 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c75a5a0-fea9-448f-a657-bc814371169c tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:17.242036 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:24:17.242036 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:24:17.243688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c75a5a0-fea9-448f-a657-bc814371169c tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:17.244359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c75a5a0-fea9-448f-a657-bc814371169c tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:17.244982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c75a5a0-fea9-448f-a657-bc814371169c tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:17.246251 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c75a5a0-fea9-448f-a657-bc814371169c tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:17.246895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c75a5a0-fea9-448f-a657-bc814371169c tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:17.247478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c75a5a0-fea9-448f-a657-bc814371169c tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:17.276550 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2c75a5a0-fea9-448f-a657-bc814371169c tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.041026 Aug 24 10:24:17.285146 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1607/2877] 10.222.0.85 () {60 vars in 1178 bytes} [Wed Aug 24 10:24:17 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:17.290241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7d48759a-c500-40f9-865a-da5c248bba06 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:17.292994 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:24:17.292994 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:24:17.294582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d48759a-c500-40f9-865a-da5c248bba06 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:17.295271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d48759a-c500-40f9-865a-da5c248bba06 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:17.295958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d48759a-c500-40f9-865a-da5c248bba06 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:17.296867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d48759a-c500-40f9-865a-da5c248bba06 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:17.297687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d48759a-c500-40f9-865a-da5c248bba06 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:17.298291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d48759a-c500-40f9-865a-da5c248bba06 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:17.325523 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7d48759a-c500-40f9-865a-da5c248bba06 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] 10.222.0.85 "GET /compute/v2.1/os-services?host=n-d-849328-3&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.039171 Aug 24 10:24:17.326455 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1608/2878] 10.222.0.85 () {60 vars in 1235 bytes} [Wed Aug 24 10:24:17 2022] GET /compute/v2.1/os-services?host=n-d-849328-3&binary=xxx => generated 16 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:17.338089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fad3769e-f4d4-49ef-96c5-b844ca76b87b tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:17.341162 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:24:17.341162 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:24:17.342987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad3769e-f4d4-49ef-96c5-b844ca76b87b tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:17.343764 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad3769e-f4d4-49ef-96c5-b844ca76b87b tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:17.344377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad3769e-f4d4-49ef-96c5-b844ca76b87b tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:17.345379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad3769e-f4d4-49ef-96c5-b844ca76b87b tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:17.346176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad3769e-f4d4-49ef-96c5-b844ca76b87b tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:17.346753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad3769e-f4d4-49ef-96c5-b844ca76b87b tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:17.378543 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fad3769e-f4d4-49ef-96c5-b844ca76b87b tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.044118 Aug 24 10:24:17.380473 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1609/2879] 10.222.0.85 () {60 vars in 1178 bytes} [Wed Aug 24 10:24:17 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:17.394411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4232f4a7-5c2e-4a80-89a5-cbb142cdf096 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:17.397331 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:24:17.397331 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:24:17.398751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4232f4a7-5c2e-4a80-89a5-cbb142cdf096 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:17.399540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4232f4a7-5c2e-4a80-89a5-cbb142cdf096 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:17.400139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4232f4a7-5c2e-4a80-89a5-cbb142cdf096 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:17.401065 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4232f4a7-5c2e-4a80-89a5-cbb142cdf096 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:17.401959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4232f4a7-5c2e-4a80-89a5-cbb142cdf096 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:17.402745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4232f4a7-5c2e-4a80-89a5-cbb142cdf096 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:17.403212 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=15 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:17.430345 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4232f4a7-5c2e-4a80-89a5-cbb142cdf096 tempest-ServicesAdminNegativeV253TestJSON-631920343 tempest-ServicesAdminNegativeV253TestJSON-631920343-project-admin] 10.222.0.85 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.040092 Aug 24 10:24:17.430984 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1610/2880] 10.222.0.85 () {60 vars in 1239 bytes} [Wed Aug 24 10:24:17 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:17.442668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-587985e9-e15d-42eb-b2b0-82f8ff767a2b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:17.443297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-587985e9-e15d-42eb-b2b0-82f8ff767a2b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:17.450344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-587985e9-e15d-42eb-b2b0-82f8ff767a2b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:17.451080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-587985e9-e15d-42eb-b2b0-82f8ff767a2b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:17.451729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-587985e9-e15d-42eb-b2b0-82f8ff767a2b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:17.452658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-587985e9-e15d-42eb-b2b0-82f8ff767a2b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:17.453334 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-587985e9-e15d-42eb-b2b0-82f8ff767a2b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:17.453913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-587985e9-e15d-42eb-b2b0-82f8ff767a2b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:17.458656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-89aa7b70-e570-441c-a022-4be728e6302f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:17.472582 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-89aa7b70-e570-441c-a022-4be728e6302f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6" status: 200 len: 1315 microversion: 2.1 time: 0.514979 Aug 24 10:24:17.486013 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1271/2881] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:16 2022] GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:17.652118 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9ea08b79-f9b4-4744-af60-56d4762e257d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1424130672", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": "none"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:17.722432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9ea08b79-f9b4-4744-af60-56d4762e257d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:24:17.726183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9ea08b79-f9b4-4744-af60-56d4762e257d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:24:17.726685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9ea08b79-f9b4-4744-af60-56d4762e257d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:24:17.727503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9ea08b79-f9b4-4744-af60-56d4762e257d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:24:17.727934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9ea08b79-f9b4-4744-af60-56d4762e257d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:24:17.755816 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ea08b79-f9b4-4744-af60-56d4762e257d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:17.756308 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ea08b79-f9b4-4744-af60-56d4762e257d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:17.756748 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ea08b79-f9b4-4744-af60-56d4762e257d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:17.757492 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ea08b79-f9b4-4744-af60-56d4762e257d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:17.757941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ea08b79-f9b4-4744-af60-56d4762e257d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:17.758363 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ea08b79-f9b4-4744-af60-56d4762e257d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:17.798277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-9ea08b79-f9b4-4744-af60-56d4762e257d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Getting quotas for project 96397ad30b9e40c9840bfc64d551612c. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:24:17.810787 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:17.812605 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-9ea08b79-f9b4-4744-af60-56d4762e257d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Getting quotas for user 64d2ea3205fe413d84ff2e2dd39ef1ac and project 96397ad30b9e40c9840bfc64d551612c. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:24:17.829594 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9ea08b79-f9b4-4744-af60-56d4762e257d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:24:17.832771 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9ea08b79-f9b4-4744-af60-56d4762e257d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:24:17.908568 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9ea08b79-f9b4-4744-af60-56d4762e257d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.431895 Aug 24 10:24:17.910995 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1272/2882] 10.222.0.85 () {62 vars in 1188 bytes} [Wed Aug 24 10:24:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 435 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 10:24:18.002650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-587985e9-e15d-42eb-b2b0-82f8ff767a2b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:18.015904 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-587985e9-e15d-42eb-b2b0-82f8ff767a2b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e" status: 200 len: 1316 microversion: 2.1 time: 0.583780 Aug 24 10:24:18.021147 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1611/2883] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:17 2022] GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e => generated 1316 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:18.032527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ddcaf54a-311e-4bdf-b473-0a5e1ecad53a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:18.033375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ddcaf54a-311e-4bdf-b473-0a5e1ecad53a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:18.083063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6dd9f31c-89dc-441a-9adb-17b6ea41148b tempest-ServicesAdminNegativeV253TestJSON-1147033903 tempest-ServicesAdminNegativeV253TestJSON-1147033903-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:18.086791 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:24:18.086791 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:24:18.088577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6dd9f31c-89dc-441a-9adb-17b6ea41148b tempest-ServicesAdminNegativeV253TestJSON-1147033903 tempest-ServicesAdminNegativeV253TestJSON-1147033903-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '1b74aec0e6e2413bb601864f03d1f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e075f46ff99944d69caae30fa6ece4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6dd9f31c-89dc-441a-9adb-17b6ea41148b tempest-ServicesAdminNegativeV253TestJSON-1147033903 tempest-ServicesAdminNegativeV253TestJSON-1147033903-project] Request method failure captured: Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfxPr0EERalMj1KG2GZetRJggLEquqHbeB4hvrnAAdUN-1jRFk5uXlEg_KdOOlk2EUhq7KtA239Sb_LSx05QrhWoFrSRsan91THafmqoFdbXO1AjtSr9W_Oepkr5gPccg_nGr5MR_ijJI1wbGG5vnwcLw3RF7-t9iGctpo8t86df5Do Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: X-Openstack-Nova-Api-Version: 2.53 Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: e075f46ff99944d69caae30fa6ece4a5 Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1147033903 Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e075f46ff99944d69caae30fa6ece4a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e075f46ff99944d69caae30fa6ece4a5", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e075f46ff99944d69caae30fa6ece4a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e075f46ff99944d69caae30fa6ece4a5"}]}] Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1147033903 Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: e075f46ff99944d69caae30fa6ece4a5 Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1147033903 Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1147033903-project Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 1b74aec0e6e2413bb601864f03d1f41a Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1147033903-project Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: action_args: {} Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 10:24:18.092922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 24 10:24:18.097619 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:18.097619 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:18.097619 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:18.097619 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:18.097619 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:18.097619 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:18.097619 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 10:24:18.097619 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 10:24:18.097619 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 24 10:24:18.097619 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:18.101785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6dd9f31c-89dc-441a-9adb-17b6ea41148b tempest-ServicesAdminNegativeV253TestJSON-1147033903 tempest-ServicesAdminNegativeV253TestJSON-1147033903-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:18.104401 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6dd9f31c-89dc-441a-9adb-17b6ea41148b tempest-ServicesAdminNegativeV253TestJSON-1147033903 tempest-ServicesAdminNegativeV253TestJSON-1147033903-project] 10.222.0.85 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.189614 Aug 24 10:24:18.109346 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1273/2884] 10.222.0.85 () {60 vars in 1178 bytes} [Wed Aug 24 10:24:17 2022] GET /compute/v2.1/os-services => generated 112 bytes in 197 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:24:18.122450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-662f9096-87b5-4169-8a7f-5c3e2c3b7cd4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:18.123254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-662f9096-87b5-4169-8a7f-5c3e2c3b7cd4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:18.130095 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-662f9096-87b5-4169-8a7f-5c3e2c3b7cd4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:18.131218 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-662f9096-87b5-4169-8a7f-5c3e2c3b7cd4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:18.134849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-662f9096-87b5-4169-8a7f-5c3e2c3b7cd4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:18.140696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-662f9096-87b5-4169-8a7f-5c3e2c3b7cd4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:18.141851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-662f9096-87b5-4169-8a7f-5c3e2c3b7cd4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:18.143083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-662f9096-87b5-4169-8a7f-5c3e2c3b7cd4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:18.216007 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ddcaf54a-311e-4bdf-b473-0a5e1ecad53a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:18.235927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ddcaf54a-311e-4bdf-b473-0a5e1ecad53a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:18.242186 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ddcaf54a-311e-4bdf-b473-0a5e1ecad53a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:18.243936 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ddcaf54a-311e-4bdf-b473-0a5e1ecad53a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1278 microversion: 2.57 time: 0.221789 Aug 24 10:24:18.252487 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1612/2885] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:18 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1278 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:18.499777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d4a574d8-3893-47ad-a581-c9d9dc40df96 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:18.500837 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d4a574d8-3893-47ad-a581-c9d9dc40df96 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:18.516277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4a574d8-3893-47ad-a581-c9d9dc40df96 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:18.517331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4a574d8-3893-47ad-a581-c9d9dc40df96 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:18.517745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4a574d8-3893-47ad-a581-c9d9dc40df96 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:18.521381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4a574d8-3893-47ad-a581-c9d9dc40df96 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:18.521952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4a574d8-3893-47ad-a581-c9d9dc40df96 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:18.523533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4a574d8-3893-47ad-a581-c9d9dc40df96 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:18.780300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-662f9096-87b5-4169-8a7f-5c3e2c3b7cd4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6878521252244be0a32ab2f056ec54c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e861e247176c4ebda68404fe30c2b561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:18.792470 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-662f9096-87b5-4169-8a7f-5c3e2c3b7cd4 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d" status: 200 len: 1496 microversion: 2.1 time: 0.678164 Aug 24 10:24:18.793880 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1274/2886] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:18 2022] GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d => generated 1496 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:18.817339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-63c673de-e307-4de7-9594-5cd91fba012c req-5c624269-c339-4b66-b18e-3b837872e099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a02ab88-8424-479f-8bdd-d1e671d8bb6d", "name": "network-vif-unplugged", "status": "completed", "tag": "1445ad95-4177-419a-9130-67c0f1f9162a"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:18.832813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-63c673de-e307-4de7-9594-5cd91fba012c req-5c624269-c339-4b66-b18e-3b837872e099 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:18.843751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-63c673de-e307-4de7-9594-5cd91fba012c req-5c624269-c339-4b66-b18e-3b837872e099 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:18.844207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-63c673de-e307-4de7-9594-5cd91fba012c req-5c624269-c339-4b66-b18e-3b837872e099 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:18.944973 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-63c673de-e307-4de7-9594-5cd91fba012c req-5c624269-c339-4b66-b18e-3b837872e099 service nova] Creating event network-vif-unplugged:1445ad95-4177-419a-9130-67c0f1f9162a for instance 0a02ab88-8424-479f-8bdd-d1e671d8bb6d on n-h2-849328-3 Aug 24 10:24:18.966931 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-63c673de-e307-4de7-9594-5cd91fba012c req-5c624269-c339-4b66-b18e-3b837872e099 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154035 Aug 24 10:24:18.969982 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1275/2887] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:24:18.981082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-8fbc86d6-b947-4ce7-9386-40876b856148 req-1d749fd7-62dd-4c26-a797-e42b384ed8dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a02ab88-8424-479f-8bdd-d1e671d8bb6d", "name": "network-vif-deleted", "tag": "1445ad95-4177-419a-9130-67c0f1f9162a"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:18.997236 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8fbc86d6-b947-4ce7-9386-40876b856148 req-1d749fd7-62dd-4c26-a797-e42b384ed8dd service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:18.997797 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8fbc86d6-b947-4ce7-9386-40876b856148 req-1d749fd7-62dd-4c26-a797-e42b384ed8dd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:18.998343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8fbc86d6-b947-4ce7-9386-40876b856148 req-1d749fd7-62dd-4c26-a797-e42b384ed8dd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:19.010888 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-8fbc86d6-b947-4ce7-9386-40876b856148 req-1d749fd7-62dd-4c26-a797-e42b384ed8dd service nova] Creating event network-vif-deleted:1445ad95-4177-419a-9130-67c0f1f9162a for instance 0a02ab88-8424-479f-8bdd-d1e671d8bb6d on n-h2-849328-3 Aug 24 10:24:19.016300 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-8fbc86d6-b947-4ce7-9386-40876b856148 req-1d749fd7-62dd-4c26-a797-e42b384ed8dd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044649 Aug 24 10:24:19.017572 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1276/2888] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:24:19.044228 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1cb3eb1a-4915-4542-be90-d74eb341d880 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:19.052604 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1cb3eb1a-4915-4542-be90-d74eb341d880 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:19.068132 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cb3eb1a-4915-4542-be90-d74eb341d880 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:19.084969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cb3eb1a-4915-4542-be90-d74eb341d880 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:19.087457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cb3eb1a-4915-4542-be90-d74eb341d880 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:19.089046 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cb3eb1a-4915-4542-be90-d74eb341d880 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:19.093781 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cb3eb1a-4915-4542-be90-d74eb341d880 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:19.097517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cb3eb1a-4915-4542-be90-d74eb341d880 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:19.685492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d4a574d8-3893-47ad-a581-c9d9dc40df96 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:19.706384 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d4a574d8-3893-47ad-a581-c9d9dc40df96 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6" status: 200 len: 1503 microversion: 2.1 time: 1.216271 Aug 24 10:24:19.710356 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1613/2889] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:18 2022] GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 => generated 1503 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:19.718651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-da7b13b1-d524-48dc-95b2-2d74e68ec64d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:19.721708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-da7b13b1-d524-48dc-95b2-2d74e68ec64d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:19.739000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da7b13b1-d524-48dc-95b2-2d74e68ec64d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:19.741389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da7b13b1-d524-48dc-95b2-2d74e68ec64d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:19.742086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da7b13b1-d524-48dc-95b2-2d74e68ec64d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:19.742991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da7b13b1-d524-48dc-95b2-2d74e68ec64d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:19.743465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da7b13b1-d524-48dc-95b2-2d74e68ec64d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:19.746376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da7b13b1-d524-48dc-95b2-2d74e68ec64d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:19.862978 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1cb3eb1a-4915-4542-be90-d74eb341d880 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:19.876639 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1cb3eb1a-4915-4542-be90-d74eb341d880 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e" status: 200 len: 1316 microversion: 2.1 time: 0.839310 Aug 24 10:24:19.877855 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1277/2890] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:19 2022] GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e => generated 1316 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:19.887158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4dfb376f-b518-4209-a3a6-6f6452b7d648 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:19.887796 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4dfb376f-b518-4209-a3a6-6f6452b7d648 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:19.888365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da7b13b1-d524-48dc-95b2-2d74e68ec64d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:19.901421 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4dfb376f-b518-4209-a3a6-6f6452b7d648 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:19.901954 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4dfb376f-b518-4209-a3a6-6f6452b7d648 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:19.902393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4dfb376f-b518-4209-a3a6-6f6452b7d648 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:19.903113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4dfb376f-b518-4209-a3a6-6f6452b7d648 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:19.903572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4dfb376f-b518-4209-a3a6-6f6452b7d648 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:19.903997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4dfb376f-b518-4209-a3a6-6f6452b7d648 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:19.908086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da7b13b1-d524-48dc-95b2-2d74e68ec64d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:19.915726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da7b13b1-d524-48dc-95b2-2d74e68ec64d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:19.918025 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-da7b13b1-d524-48dc-95b2-2d74e68ec64d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1330 microversion: 2.57 time: 0.204287 Aug 24 10:24:19.933395 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1614/2891] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:19 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1330 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:19.934431 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-4dfb376f-b518-4209-a3a6-6f6452b7d648 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] HTTP exception thrown: Instance 0a02ab88-8424-479f-8bdd-d1e671d8bb6d could not be found. Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4dfb376f-b518-4209-a3a6-6f6452b7d648 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Request method failure captured: Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d HTTP/1.1 Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfvFrrhMIS895qcNi3E08Z2aCgBtfLh_BkMMLPs4DpG9nRgLmCgu8EyCUwMhPTQGcwKO-Gw9OThM2v_iz8exI6DsU8JZHRflmopnuwnES8EioScbwlrWCk3h4yi_cgKNu7YSZCdr88-t_-mkGN2HzH5bstYwf0PNwW-60ViXVx67f98 Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: e861e247176c4ebda68404fe30c2b561 Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestMultiNic-2011698794 Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e861e247176c4ebda68404fe30c2b561"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e861e247176c4ebda68404fe30c2b561", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e861e247176c4ebda68404fe30c2b561"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e861e247176c4ebda68404fe30c2b561"}]}] Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestMultiNic-2011698794 Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: e861e247176c4ebda68404fe30c2b561 Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestMultiNic-2011698794 Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersTestMultiNic-2011698794-project Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 6878521252244be0a32ab2f056ec54c9 Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestMultiNic-2011698794-project Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 0a02ab88-8424-479f-8bdd-d1e671d8bb6d could not be found. Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '0a02ab88-8424-479f-8bdd-d1e671d8bb6d'} Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a02ab88-8424-479f-8bdd-d1e671d8bb6d could not be found. Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a02ab88-8424-479f-8bdd-d1e671d8bb6d could not be found. Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:19.936188 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:19.940026 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:19.940026 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:19.940026 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:19.940026 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:19.940026 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:19.940026 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a02ab88-8424-479f-8bdd-d1e671d8bb6d could not be found. Aug 24 10:24:19.940026 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:19.940026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4dfb376f-b518-4209-a3a6-6f6452b7d648 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Returning 404 to user: Instance 0a02ab88-8424-479f-8bdd-d1e671d8bb6d could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:19.945868 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4dfb376f-b518-4209-a3a6-6f6452b7d648 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d" status: 404 len: 111 microversion: 2.1 time: 0.066772 Aug 24 10:24:19.948494 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1278/2892] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:19 2022] GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:24:20.922332 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c091592a-450d-4eed-ae1e-9d60f2a27c82 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:20.922974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c091592a-450d-4eed-ae1e-9d60f2a27c82 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:20.937872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c091592a-450d-4eed-ae1e-9d60f2a27c82 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:20.938645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c091592a-450d-4eed-ae1e-9d60f2a27c82 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:20.939287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c091592a-450d-4eed-ae1e-9d60f2a27c82 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:20.940200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c091592a-450d-4eed-ae1e-9d60f2a27c82 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:20.941164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c091592a-450d-4eed-ae1e-9d60f2a27c82 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:20.941741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c091592a-450d-4eed-ae1e-9d60f2a27c82 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:20.952116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eb82c42b-09fd-4cd6-a278-c959203829c2 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:20.952732 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eb82c42b-09fd-4cd6-a278-c959203829c2 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:20.973991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb82c42b-09fd-4cd6-a278-c959203829c2 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:20.974483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb82c42b-09fd-4cd6-a278-c959203829c2 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:20.975159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb82c42b-09fd-4cd6-a278-c959203829c2 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:20.976145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb82c42b-09fd-4cd6-a278-c959203829c2 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:20.976773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb82c42b-09fd-4cd6-a278-c959203829c2 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:20.977378 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb82c42b-09fd-4cd6-a278-c959203829c2 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:21.284121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eb82c42b-09fd-4cd6-a278-c959203829c2 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:21.321770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eb82c42b-09fd-4cd6-a278-c959203829c2 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:21.323929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eb82c42b-09fd-4cd6-a278-c959203829c2 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:21.325224 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eb82c42b-09fd-4cd6-a278-c959203829c2 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1336 microversion: 2.57 time: 0.377857 Aug 24 10:24:21.326109 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1279/2893] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:20 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1336 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:24:21.347275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-039f0aae-8725-41c2-ba2f-52b8bb767a1a req-dd8673f3-b998-4b75-bbad-3d6c4ee06a56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a30de6-ae02-49e5-87d5-558660bd9b1e", "name": "network-vif-plugged", "status": "completed", "tag": "3cfea031-56f2-4af5-9636-0ed3c213c5c8"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:21.369916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-039f0aae-8725-41c2-ba2f-52b8bb767a1a req-dd8673f3-b998-4b75-bbad-3d6c4ee06a56 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:21.370736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-039f0aae-8725-41c2-ba2f-52b8bb767a1a req-dd8673f3-b998-4b75-bbad-3d6c4ee06a56 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:21.371463 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-039f0aae-8725-41c2-ba2f-52b8bb767a1a req-dd8673f3-b998-4b75-bbad-3d6c4ee06a56 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:21.402808 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-039f0aae-8725-41c2-ba2f-52b8bb767a1a req-dd8673f3-b998-4b75-bbad-3d6c4ee06a56 service nova] Creating event network-vif-plugged:3cfea031-56f2-4af5-9636-0ed3c213c5c8 for instance b0a30de6-ae02-49e5-87d5-558660bd9b1e on n-h1-849328-3 Aug 24 10:24:21.419547 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-039f0aae-8725-41c2-ba2f-52b8bb767a1a req-dd8673f3-b998-4b75-bbad-3d6c4ee06a56 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089558 Aug 24 10:24:21.421168 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1280/2894] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:24:21.624304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c091592a-450d-4eed-ae1e-9d60f2a27c82 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:21.640376 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c091592a-450d-4eed-ae1e-9d60f2a27c82 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e" status: 200 len: 1316 microversion: 2.1 time: 0.740327 Aug 24 10:24:21.646944 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1615/2895] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:20 2022] GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e => generated 1316 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:22.374048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-223a464e-7fc9-4104-a47f-df084a7e6cda tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:22.377442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-223a464e-7fc9-4104-a47f-df084a7e6cda tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:22.389283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-223a464e-7fc9-4104-a47f-df084a7e6cda tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:22.390172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-223a464e-7fc9-4104-a47f-df084a7e6cda tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:22.390773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-223a464e-7fc9-4104-a47f-df084a7e6cda tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:22.391788 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-223a464e-7fc9-4104-a47f-df084a7e6cda tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:22.392460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-223a464e-7fc9-4104-a47f-df084a7e6cda tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:22.393049 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-223a464e-7fc9-4104-a47f-df084a7e6cda tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:22.410142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:22.530421 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-223a464e-7fc9-4104-a47f-df084a7e6cda tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:22.548812 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-223a464e-7fc9-4104-a47f-df084a7e6cda tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:22.557959 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-223a464e-7fc9-4104-a47f-df084a7e6cda tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:22.562170 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-223a464e-7fc9-4104-a47f-df084a7e6cda tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1336 microversion: 2.57 time: 0.206737 Aug 24 10:24:22.569290 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1281/2896] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:22 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1336 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:22.620866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3e8410d0-09cf-4a8b-9359-cd283702186d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9da60259-6335-448a-bdc8-fb9c290d9a08"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:22.624233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3e8410d0-09cf-4a8b-9359-cd283702186d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:22.633076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e8410d0-09cf-4a8b-9359-cd283702186d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:22.634024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e8410d0-09cf-4a8b-9359-cd283702186d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:22.634808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e8410d0-09cf-4a8b-9359-cd283702186d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:22.636683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e8410d0-09cf-4a8b-9359-cd283702186d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:22.637676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e8410d0-09cf-4a8b-9359-cd283702186d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:22.638649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e8410d0-09cf-4a8b-9359-cd283702186d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:22.666573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5666e7e0-ce1c-490a-b6d2-3587121dae48 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:22.667964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5666e7e0-ce1c-490a-b6d2-3587121dae48 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:22.683779 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5666e7e0-ce1c-490a-b6d2-3587121dae48 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:22.684646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5666e7e0-ce1c-490a-b6d2-3587121dae48 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:22.686015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5666e7e0-ce1c-490a-b6d2-3587121dae48 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:22.687539 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5666e7e0-ce1c-490a-b6d2-3587121dae48 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:22.691492 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5666e7e0-ce1c-490a-b6d2-3587121dae48 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:22.692777 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5666e7e0-ce1c-490a-b6d2-3587121dae48 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:23.141713 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5666e7e0-ce1c-490a-b6d2-3587121dae48 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:23.160819 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3e8410d0-09cf-4a8b-9359-cd283702186d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "POST /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.543810 Aug 24 10:24:23.163308 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1616/2897] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Aug 24 10:24:22 2022] POST /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6/os-volume_attachments => generated 194 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:24:23.189913 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5666e7e0-ce1c-490a-b6d2-3587121dae48 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e" status: 200 len: 1316 microversion: 2.1 time: 0.529385 Aug 24 10:24:23.191587 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1282/2898] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:22 2022] GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e => generated 1316 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:23.594248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aa4b2ea6-df3f-4ac7-9979-889e15f5d7ae tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:23.595361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aa4b2ea6-df3f-4ac7-9979-889e15f5d7ae tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:23.613904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa4b2ea6-df3f-4ac7-9979-889e15f5d7ae tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:23.617374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa4b2ea6-df3f-4ac7-9979-889e15f5d7ae tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:23.618207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa4b2ea6-df3f-4ac7-9979-889e15f5d7ae tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:23.620462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa4b2ea6-df3f-4ac7-9979-889e15f5d7ae tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:23.622322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa4b2ea6-df3f-4ac7-9979-889e15f5d7ae tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:23.624701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa4b2ea6-df3f-4ac7-9979-889e15f5d7ae tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:24.216709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a05a848b-d8d7-4333-a1fe-768ecae3685f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:24.217805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a05a848b-d8d7-4333-a1fe-768ecae3685f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:24.250238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a05a848b-d8d7-4333-a1fe-768ecae3685f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:24.251054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a05a848b-d8d7-4333-a1fe-768ecae3685f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:24.251622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a05a848b-d8d7-4333-a1fe-768ecae3685f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:24.253699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a05a848b-d8d7-4333-a1fe-768ecae3685f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:24.255717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a05a848b-d8d7-4333-a1fe-768ecae3685f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:24.256896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a05a848b-d8d7-4333-a1fe-768ecae3685f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:24.718967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aa4b2ea6-df3f-4ac7-9979-889e15f5d7ae tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:24.740710 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a05a848b-d8d7-4333-a1fe-768ecae3685f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:24.758313 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aa4b2ea6-df3f-4ac7-9979-889e15f5d7ae tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:24.765152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aa4b2ea6-df3f-4ac7-9979-889e15f5d7ae tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:24.775275 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aa4b2ea6-df3f-4ac7-9979-889e15f5d7ae tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1357 microversion: 2.57 time: 1.188106 Aug 24 10:24:24.778427 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1617/2899] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:23 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1357 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:24.788658 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a05a848b-d8d7-4333-a1fe-768ecae3685f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e" status: 200 len: 1505 microversion: 2.1 time: 0.577025 Aug 24 10:24:24.792065 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1283/2900] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:24 2022] GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e => generated 1505 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:24.821581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6e5e9489-3fd6-4be5-9d7e-cfca8fca9a45 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:24.825867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6e5e9489-3fd6-4be5-9d7e-cfca8fca9a45 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:24.828764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e70ff72a-caf6-4a37-8203-bab1327cd917 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2075036255"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:24.829341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e70ff72a-caf6-4a37-8203-bab1327cd917 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:24.834923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e5e9489-3fd6-4be5-9d7e-cfca8fca9a45 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:24.835940 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e5e9489-3fd6-4be5-9d7e-cfca8fca9a45 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:24.837199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e5e9489-3fd6-4be5-9d7e-cfca8fca9a45 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:24.838832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e5e9489-3fd6-4be5-9d7e-cfca8fca9a45 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:24.839532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e5e9489-3fd6-4be5-9d7e-cfca8fca9a45 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:24.840124 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e70ff72a-caf6-4a37-8203-bab1327cd917 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:24.840521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e70ff72a-caf6-4a37-8203-bab1327cd917 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:24.840693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e5e9489-3fd6-4be5-9d7e-cfca8fca9a45 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:24.840964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e70ff72a-caf6-4a37-8203-bab1327cd917 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:24.842331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e70ff72a-caf6-4a37-8203-bab1327cd917 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:24.842914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e70ff72a-caf6-4a37-8203-bab1327cd917 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:24.843354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e70ff72a-caf6-4a37-8203-bab1327cd917 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:24.849111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:25.001422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-6e5e9489-3fd6-4be5-9d7e-cfca8fca9a45 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:24:25.006875 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-6e5e9489-3fd6-4be5-9d7e-cfca8fca9a45 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:24:25.007407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-6e5e9489-3fd6-4be5-9d7e-cfca8fca9a45 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:24:25.007827 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-6e5e9489-3fd6-4be5-9d7e-cfca8fca9a45 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:24:25.008239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-6e5e9489-3fd6-4be5-9d7e-cfca8fca9a45 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:24:25.121074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6e5e9489-3fd6-4be5-9d7e-cfca8fca9a45 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:25.129810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e5e9489-3fd6-4be5-9d7e-cfca8fca9a45 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:25.130552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e5e9489-3fd6-4be5-9d7e-cfca8fca9a45 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:25.131165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e5e9489-3fd6-4be5-9d7e-cfca8fca9a45 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:25.132027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e5e9489-3fd6-4be5-9d7e-cfca8fca9a45 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:25.132627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e5e9489-3fd6-4be5-9d7e-cfca8fca9a45 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:25.133221 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e5e9489-3fd6-4be5-9d7e-cfca8fca9a45 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:25.172608 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.network.security_group_api [None req-e70ff72a-caf6-4a37-8203-bab1327cd917 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Adding security group 5ee9f659-096c-43d5-8ff9-0183fd9c2519 to port 3cfea031-56f2-4af5-9636-0ed3c213c5c8 Aug 24 10:24:25.176639 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6e5e9489-3fd6-4be5-9d7e-cfca8fca9a45 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "POST /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99/action" status: 202 len: 1138 microversion: 2.57 time: 0.369807 Aug 24 10:24:25.177645 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1618/2901] 10.222.0.85 () {62 vars in 1320 bytes} [Wed Aug 24 10:24:24 2022] POST /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99/action => generated 1138 bytes in 372 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 24 10:24:25.206947 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7a69cd49-8d6e-43e5-a3f7-c980b77186cf tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:25.208483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7a69cd49-8d6e-43e5-a3f7-c980b77186cf tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:25.225742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a69cd49-8d6e-43e5-a3f7-c980b77186cf tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:25.227597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a69cd49-8d6e-43e5-a3f7-c980b77186cf tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:25.228626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a69cd49-8d6e-43e5-a3f7-c980b77186cf tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:25.229560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a69cd49-8d6e-43e5-a3f7-c980b77186cf tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:25.230177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a69cd49-8d6e-43e5-a3f7-c980b77186cf tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:25.230915 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a69cd49-8d6e-43e5-a3f7-c980b77186cf tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:25.308447 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-7a69cd49-8d6e-43e5-a3f7-c980b77186cf tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] HTTP exception thrown: Instance 0a02ab88-8424-479f-8bdd-d1e671d8bb6d could not be found. Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7a69cd49-8d6e-43e5-a3f7-c980b77186cf tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Request method failure captured: Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d HTTP/1.1 Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfvFrrhMIS895qcNi3E08Z2aCgBtfLh_BkMMLPs4DpG9nRgLmCgu8EyCUwMhPTQGcwKO-Gw9OThM2v_iz8exI6DsU8JZHRflmopnuwnES8EioScbwlrWCk3h4yi_cgKNu7YSZCdr88-t_-mkGN2HzH5bstYwf0PNwW-60ViXVx67f98 Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: e861e247176c4ebda68404fe30c2b561 Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersTestMultiNic-2011698794 Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e861e247176c4ebda68404fe30c2b561"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e861e247176c4ebda68404fe30c2b561", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e861e247176c4ebda68404fe30c2b561"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e861e247176c4ebda68404fe30c2b561"}]}] Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersTestMultiNic-2011698794 Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: e861e247176c4ebda68404fe30c2b561 Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersTestMultiNic-2011698794 Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersTestMultiNic-2011698794-project Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 6878521252244be0a32ab2f056ec54c9 Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersTestMultiNic-2011698794-project Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 0a02ab88-8424-479f-8bdd-d1e671d8bb6d could not be found. Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '0a02ab88-8424-479f-8bdd-d1e671d8bb6d'} Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a02ab88-8424-479f-8bdd-d1e671d8bb6d could not be found. Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:24:25.310195 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:24:25.314364 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a02ab88-8424-479f-8bdd-d1e671d8bb6d could not be found. Aug 24 10:24:25.314364 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:25.314364 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:25.314364 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:25.314364 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:25.314364 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:25.314364 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:25.314364 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:25.314364 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:25.314364 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a02ab88-8424-479f-8bdd-d1e671d8bb6d could not be found. Aug 24 10:24:25.314364 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:25.330737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7a69cd49-8d6e-43e5-a3f7-c980b77186cf tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Returning 404 to user: Instance 0a02ab88-8424-479f-8bdd-d1e671d8bb6d could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:25.331598 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7a69cd49-8d6e-43e5-a3f7-c980b77186cf tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "DELETE /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d" status: 404 len: 111 microversion: 2.1 time: 0.152496 Aug 24 10:24:25.339874 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1619/2902] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:24:25 2022] DELETE /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:24:25.369760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ea6ce33-5a43-449a-8abb-818a03d8aa39 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:25.370475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8ea6ce33-5a43-449a-8abb-818a03d8aa39 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:25.410599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ea6ce33-5a43-449a-8abb-818a03d8aa39 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:25.411098 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ea6ce33-5a43-449a-8abb-818a03d8aa39 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:25.411532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ea6ce33-5a43-449a-8abb-818a03d8aa39 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:25.412316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ea6ce33-5a43-449a-8abb-818a03d8aa39 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:25.412750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ea6ce33-5a43-449a-8abb-818a03d8aa39 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:25.413077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ea6ce33-5a43-449a-8abb-818a03d8aa39 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:25.744490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8ea6ce33-5a43-449a-8abb-818a03d8aa39 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:25.758700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8ea6ce33-5a43-449a-8abb-818a03d8aa39 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:25.759778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8ea6ce33-5a43-449a-8abb-818a03d8aa39 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:25.760968 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8ea6ce33-5a43-449a-8abb-818a03d8aa39 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1366 microversion: 2.57 time: 0.418772 Aug 24 10:24:25.761764 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1620/2903] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:25 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1366 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:25.779439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ba63d34-7c56-47a1-bebb-dfc2fdf3c1d2 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:25.780302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4ba63d34-7c56-47a1-bebb-dfc2fdf3c1d2 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: 0a02ab88-8424-479f-8bdd-d1e671d8bb6d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:25.790388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ba63d34-7c56-47a1-bebb-dfc2fdf3c1d2 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:25.793008 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ba63d34-7c56-47a1-bebb-dfc2fdf3c1d2 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:25.794864 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ba63d34-7c56-47a1-bebb-dfc2fdf3c1d2 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:25.796709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ba63d34-7c56-47a1-bebb-dfc2fdf3c1d2 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:25.799688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ba63d34-7c56-47a1-bebb-dfc2fdf3c1d2 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:25.801405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ba63d34-7c56-47a1-bebb-dfc2fdf3c1d2 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:25.836826 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-4ba63d34-7c56-47a1-bebb-dfc2fdf3c1d2 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] HTTP exception thrown: Instance 0a02ab88-8424-479f-8bdd-d1e671d8bb6d could not be found. Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ba63d34-7c56-47a1-bebb-dfc2fdf3c1d2 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Request method failure captured: Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d HTTP/1.1 Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfvFrrhMIS895qcNi3E08Z2aCgBtfLh_BkMMLPs4DpG9nRgLmCgu8EyCUwMhPTQGcwKO-Gw9OThM2v_iz8exI6DsU8JZHRflmopnuwnES8EioScbwlrWCk3h4yi_cgKNu7YSZCdr88-t_-mkGN2HzH5bstYwf0PNwW-60ViXVx67f98 Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: e861e247176c4ebda68404fe30c2b561 Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersTestMultiNic-2011698794 Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e861e247176c4ebda68404fe30c2b561"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e861e247176c4ebda68404fe30c2b561", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e861e247176c4ebda68404fe30c2b561"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e861e247176c4ebda68404fe30c2b561"}]}] Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersTestMultiNic-2011698794 Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: e861e247176c4ebda68404fe30c2b561 Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersTestMultiNic-2011698794 Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersTestMultiNic-2011698794-project Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 6878521252244be0a32ab2f056ec54c9 Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersTestMultiNic-2011698794-project Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 0a02ab88-8424-479f-8bdd-d1e671d8bb6d could not be found. Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '0a02ab88-8424-479f-8bdd-d1e671d8bb6d'} Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a02ab88-8424-479f-8bdd-d1e671d8bb6d could not be found. Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a02ab88-8424-479f-8bdd-d1e671d8bb6d could not be found. Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:25.840428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:25.850705 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:25.850705 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:25.850705 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:25.850705 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:25.850705 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:25.850705 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a02ab88-8424-479f-8bdd-d1e671d8bb6d could not be found. Aug 24 10:24:25.850705 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:25.850705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ba63d34-7c56-47a1-bebb-dfc2fdf3c1d2 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Returning 404 to user: Instance 0a02ab88-8424-479f-8bdd-d1e671d8bb6d could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:25.850705 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4ba63d34-7c56-47a1-bebb-dfc2fdf3c1d2 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d" status: 404 len: 111 microversion: 2.1 time: 0.081499 Aug 24 10:24:25.850705 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1621/2904] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:25 2022] GET /compute/v2.1/servers/0a02ab88-8424-479f-8bdd-d1e671d8bb6d => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:24:25.862130 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f928236e-d0ce-4961-a1ec-9754cc815582 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:25.862861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f928236e-d0ce-4961-a1ec-9754cc815582 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:25.880046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f928236e-d0ce-4961-a1ec-9754cc815582 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:25.880995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f928236e-d0ce-4961-a1ec-9754cc815582 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:25.881668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f928236e-d0ce-4961-a1ec-9754cc815582 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:25.883305 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f928236e-d0ce-4961-a1ec-9754cc815582 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:25.884324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f928236e-d0ce-4961-a1ec-9754cc815582 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:25.884964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f928236e-d0ce-4961-a1ec-9754cc815582 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:25.905868 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-f928236e-d0ce-4961-a1ec-9754cc815582 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] HTTP exception thrown: Instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 could not be found. Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f928236e-d0ce-4961-a1ec-9754cc815582 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Request method failure captured: Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 HTTP/1.1 Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfvFrrhMIS895qcNi3E08Z2aCgBtfLh_BkMMLPs4DpG9nRgLmCgu8EyCUwMhPTQGcwKO-Gw9OThM2v_iz8exI6DsU8JZHRflmopnuwnES8EioScbwlrWCk3h4yi_cgKNu7YSZCdr88-t_-mkGN2HzH5bstYwf0PNwW-60ViXVx67f98 Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: e861e247176c4ebda68404fe30c2b561 Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersTestMultiNic-2011698794 Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e861e247176c4ebda68404fe30c2b561"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e861e247176c4ebda68404fe30c2b561", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e861e247176c4ebda68404fe30c2b561"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e861e247176c4ebda68404fe30c2b561"}]}] Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersTestMultiNic-2011698794 Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: e861e247176c4ebda68404fe30c2b561 Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersTestMultiNic-2011698794 Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersTestMultiNic-2011698794-project Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 6878521252244be0a32ab2f056ec54c9 Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersTestMultiNic-2011698794-project Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 could not be found. Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'a599e1a2-3ca0-4cde-b11c-ef5e069065f9'} Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 could not be found. Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:24:25.909841 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:24:25.915293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 could not be found. Aug 24 10:24:25.915293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:25.915293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:25.915293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:25.915293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:25.915293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:25.915293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:25.915293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:25.915293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:25.915293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 could not be found. Aug 24 10:24:25.915293 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:25.918004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f928236e-d0ce-4961-a1ec-9754cc815582 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Returning 404 to user: Instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:25.919579 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f928236e-d0ce-4961-a1ec-9754cc815582 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 404 len: 111 microversion: 2.1 time: 0.066084 Aug 24 10:24:25.920440 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1622/2905] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:24:25 2022] DELETE /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:24:25.931252 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e70ff72a-caf6-4a37-8203-bab1327cd917 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "POST /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e/action" status: 202 len: 0 microversion: 2.1 time: 1.114483 Aug 24 10:24:25.933229 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1284/2906] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:24:24 2022] POST /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e/action => generated 0 bytes in 1118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:24:25.945879 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d442988d-92d8-44ed-96c1-7839e61e7428 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '.version_select at 0x7f4654281430>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:25.960850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-88375952-b2b0-4f06-9528-48ec15ace8a9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:25.962207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-88375952-b2b0-4f06-9528-48ec15ace8a9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] [instance: a599e1a2-3ca0-4cde-b11c-ef5e069065f9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:25.986683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88375952-b2b0-4f06-9528-48ec15ace8a9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:25.988102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88375952-b2b0-4f06-9528-48ec15ace8a9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:25.989135 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88375952-b2b0-4f06-9528-48ec15ace8a9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:25.990601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88375952-b2b0-4f06-9528-48ec15ace8a9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:25.992139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88375952-b2b0-4f06-9528-48ec15ace8a9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:25.993912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88375952-b2b0-4f06-9528-48ec15ace8a9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:26.033365 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-88375952-b2b0-4f06-9528-48ec15ace8a9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] HTTP exception thrown: Instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 could not be found. Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-88375952-b2b0-4f06-9528-48ec15ace8a9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Request method failure captured: Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 HTTP/1.1 Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfvFrrhMIS895qcNi3E08Z2aCgBtfLh_BkMMLPs4DpG9nRgLmCgu8EyCUwMhPTQGcwKO-Gw9OThM2v_iz8exI6DsU8JZHRflmopnuwnES8EioScbwlrWCk3h4yi_cgKNu7YSZCdr88-t_-mkGN2HzH5bstYwf0PNwW-60ViXVx67f98 Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: e861e247176c4ebda68404fe30c2b561 Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersTestMultiNic-2011698794 Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e861e247176c4ebda68404fe30c2b561"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e861e247176c4ebda68404fe30c2b561", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e861e247176c4ebda68404fe30c2b561"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e861e247176c4ebda68404fe30c2b561"}]}] Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersTestMultiNic-2011698794 Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: e861e247176c4ebda68404fe30c2b561 Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersTestMultiNic-2011698794 Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersTestMultiNic-2011698794-project Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 6878521252244be0a32ab2f056ec54c9 Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersTestMultiNic-2011698794-project Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 could not be found. Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'a599e1a2-3ca0-4cde-b11c-ef5e069065f9'} Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 could not be found. Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 could not be found. Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:26.038564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:26.044370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:26.044370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:26.044370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:26.044370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:26.044370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:26.044370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 could not be found. Aug 24 10:24:26.044370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:26.049158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-88375952-b2b0-4f06-9528-48ec15ace8a9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] Returning 404 to user: Instance a599e1a2-3ca0-4cde-b11c-ef5e069065f9 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:26.051319 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-88375952-b2b0-4f06-9528-48ec15ace8a9 tempest-ServersTestMultiNic-2011698794 tempest-ServersTestMultiNic-2011698794-project] 10.222.0.85 "GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9" status: 404 len: 111 microversion: 2.1 time: 0.116143 Aug 24 10:24:26.053934 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1623/2907] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:25 2022] GET /compute/v2.1/servers/a599e1a2-3ca0-4cde-b11c-ef5e069065f9 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:24:26.067652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a34a330f-4306-404a-b6cd-f146ea774df1 req-d9cc34a1-26c8-44e5-94ec-85b0f835c63f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0a30de6-ae02-49e5-87d5-558660bd9b1e", "tag": "3cfea031-56f2-4af5-9636-0ed3c213c5c8"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:26.093338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a34a330f-4306-404a-b6cd-f146ea774df1 req-d9cc34a1-26c8-44e5-94ec-85b0f835c63f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:26.094148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a34a330f-4306-404a-b6cd-f146ea774df1 req-d9cc34a1-26c8-44e5-94ec-85b0f835c63f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:26.094880 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a34a330f-4306-404a-b6cd-f146ea774df1 req-d9cc34a1-26c8-44e5-94ec-85b0f835c63f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:26.112492 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a34a330f-4306-404a-b6cd-f146ea774df1 req-d9cc34a1-26c8-44e5-94ec-85b0f835c63f service nova] Creating event network-changed:3cfea031-56f2-4af5-9636-0ed3c213c5c8 for instance b0a30de6-ae02-49e5-87d5-558660bd9b1e on n-h1-849328-3 Aug 24 10:24:26.120700 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a34a330f-4306-404a-b6cd-f146ea774df1 req-d9cc34a1-26c8-44e5-94ec-85b0f835c63f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063527 Aug 24 10:24:26.122857 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1624/2908] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:24:26.792635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2cf16de2-a000-4bcc-bc4b-5400386ea657 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:26.795276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2cf16de2-a000-4bcc-bc4b-5400386ea657 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:26.815119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cf16de2-a000-4bcc-bc4b-5400386ea657 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:26.815984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cf16de2-a000-4bcc-bc4b-5400386ea657 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:26.816429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cf16de2-a000-4bcc-bc4b-5400386ea657 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:26.817271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cf16de2-a000-4bcc-bc4b-5400386ea657 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:26.817630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cf16de2-a000-4bcc-bc4b-5400386ea657 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:26.818137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cf16de2-a000-4bcc-bc4b-5400386ea657 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:27.064710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2cf16de2-a000-4bcc-bc4b-5400386ea657 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:27.075730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2cf16de2-a000-4bcc-bc4b-5400386ea657 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:27.089198 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2cf16de2-a000-4bcc-bc4b-5400386ea657 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:27.090840 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2cf16de2-a000-4bcc-bc4b-5400386ea657 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1366 microversion: 2.57 time: 0.304547 Aug 24 10:24:27.091828 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1625/2909] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:26 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:24:27.362451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eff005cf-a31f-4fb1-9cc4-4a43e7993e61 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-436589754", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:27.411625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=14 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:27.448149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG neutronclient.v2_0.client [None req-d442988d-92d8-44ed-96c1-7839e61e7428 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 5ee9f659-096c-43d5-8ff9-0183fd9c2519 in use.", "detail": ""}} {{(pid=122432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 10:24:27.448872 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-d442988d-92d8-44ed-96c1-7839e61e7428 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] HTTP exception thrown: Security Group 5ee9f659-096c-43d5-8ff9-0183fd9c2519 in use. Aug 24 10:24:27.448872 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-53ef58b1-01bf-455b-8041-cf5d357700de'] Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d442988d-92d8-44ed-96c1-7839e61e7428 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Request method failure captured: Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/os-security-groups/5ee9f659-096c-43d5-8ff9-0183fd9c2519 HTTP/1.1 Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfwP4tkKyJr5Gg7qNaTDv0qB585z-EGLWhAIlAiiw7niuSBtf4-Q9XJ2RClgHF5tG0tqoI1dsizKyw5H-SwLhXdRiM6qVR9NPoSFDWFDAiYHpCUOyNdaDsUmsdQydv3MYAQ3enYS0IGacLv6Rxy4kcYdhL4YEU_p2c-vtfjTt6PXS-o Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_44f050698fc54fb6b8fdf2866472dd7d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/44f050698fc54fb6b8fdf2866472dd7d"}]}] Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: cf7304a4a0bb486fbf52f1c84cad702a Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: exception: Security Group 5ee9f659-096c-43d5-8ff9-0183fd9c2519 in use. Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-53ef58b1-01bf-455b-8041-cf5d357700de'] Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '5ee9f659-096c-43d5-8ff9-0183fd9c2519'} Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 10:24:27.455274 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 5ee9f659-096c-43d5-8ff9-0183fd9c2519 in use. Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53ef58b1-01bf-455b-8041-cf5d357700de'] Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 5ee9f659-096c-43d5-8ff9-0183fd9c2519 in use. Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53ef58b1-01bf-455b-8041-cf5d357700de'] Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 5ee9f659-096c-43d5-8ff9-0183fd9c2519 in use. Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53ef58b1-01bf-455b-8041-cf5d357700de'] Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 5ee9f659-096c-43d5-8ff9-0183fd9c2519 in use. Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53ef58b1-01bf-455b-8041-cf5d357700de'] Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d442988d-92d8-44ed-96c1-7839e61e7428 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Returning 400 to user: Security Group 5ee9f659-096c-43d5-8ff9-0183fd9c2519 in use. Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-53ef58b1-01bf-455b-8041-cf5d357700de'] {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:27.459040 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d442988d-92d8-44ed-96c1-7839e61e7428 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/5ee9f659-096c-43d5-8ff9-0183fd9c2519" status: 400 len: 185 microversion: 2.1 time: 1.517904 Aug 24 10:24:27.461613 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1285/2910] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:24:25 2022] DELETE /compute/v2.1/os-security-groups/5ee9f659-096c-43d5-8ff9-0183fd9c2519 => generated 185 bytes in 1523 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:24:27.473497 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-eff005cf-a31f-4fb1-9cc4-4a43e7993e61 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:24:27.484570 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4a73c9c9-61b7-483d-ad2a-a0365bbb6595 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:27.491825 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4a73c9c9-61b7-483d-ad2a-a0365bbb6595 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:27.508719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a73c9c9-61b7-483d-ad2a-a0365bbb6595 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:27.509249 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a73c9c9-61b7-483d-ad2a-a0365bbb6595 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:27.512121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a73c9c9-61b7-483d-ad2a-a0365bbb6595 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:27.516596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a73c9c9-61b7-483d-ad2a-a0365bbb6595 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:27.518005 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a73c9c9-61b7-483d-ad2a-a0365bbb6595 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:27.518454 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a73c9c9-61b7-483d-ad2a-a0365bbb6595 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:27.692359 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4a73c9c9-61b7-483d-ad2a-a0365bbb6595 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "POST /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e/action" status: 202 len: 0 microversion: 2.1 time: 0.220650 Aug 24 10:24:27.694448 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1286/2911] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:24:27 2022] POST /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:24:27.733853 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-43e0e4d1-ef51-4d8b-b82b-505f556c122f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:27.734999 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-43e0e4d1-ef51-4d8b-b82b-505f556c122f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:27.749764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e0e4d1-ef51-4d8b-b82b-505f556c122f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:27.750450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e0e4d1-ef51-4d8b-b82b-505f556c122f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:27.751069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e0e4d1-ef51-4d8b-b82b-505f556c122f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:27.751943 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e0e4d1-ef51-4d8b-b82b-505f556c122f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:27.753571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e0e4d1-ef51-4d8b-b82b-505f556c122f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:27.756603 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e0e4d1-ef51-4d8b-b82b-505f556c122f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:27.791384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:27.824489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:28.231562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:28.264898 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-eff005cf-a31f-4fb1-9cc4-4a43e7993e61 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:24:28.266209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-eff005cf-a31f-4fb1-9cc4-4a43e7993e61 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:24:28.266944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-eff005cf-a31f-4fb1-9cc4-4a43e7993e61 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:24:28.267570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-eff005cf-a31f-4fb1-9cc4-4a43e7993e61 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:24:28.268204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-eff005cf-a31f-4fb1-9cc4-4a43e7993e61 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:24:28.291585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eff005cf-a31f-4fb1-9cc4-4a43e7993e61 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:28.292799 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eff005cf-a31f-4fb1-9cc4-4a43e7993e61 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:28.294913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eff005cf-a31f-4fb1-9cc4-4a43e7993e61 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:28.296606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eff005cf-a31f-4fb1-9cc4-4a43e7993e61 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:28.299311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eff005cf-a31f-4fb1-9cc4-4a43e7993e61 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:28.300163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eff005cf-a31f-4fb1-9cc4-4a43e7993e61 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:28.327740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-eff005cf-a31f-4fb1-9cc4-4a43e7993e61 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Getting quotas for project 396c23b60923463b9a82af15a7dcf771. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:24:28.352583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-eff005cf-a31f-4fb1-9cc4-4a43e7993e61 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Getting quotas for user 578a67fe95b3453cb7d6bc90acce0478 and project 396c23b60923463b9a82af15a7dcf771. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:24:28.382275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:28.401793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-eff005cf-a31f-4fb1-9cc4-4a43e7993e61 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:24:28.404921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-eff005cf-a31f-4fb1-9cc4-4a43e7993e61 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] [instance: 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:24:28.536244 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eff005cf-a31f-4fb1-9cc4-4a43e7993e61 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.442998 Aug 24 10:24:28.536928 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1626/2912] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:24:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:24:28.545685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aed3c8b0-4dc6-43df-b51b-67ae0b9cd96a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:28.546565 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aed3c8b0-4dc6-43df-b51b-67ae0b9cd96a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:28.561211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aed3c8b0-4dc6-43df-b51b-67ae0b9cd96a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:28.563367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aed3c8b0-4dc6-43df-b51b-67ae0b9cd96a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:28.564017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aed3c8b0-4dc6-43df-b51b-67ae0b9cd96a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:28.564924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aed3c8b0-4dc6-43df-b51b-67ae0b9cd96a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:28.566691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aed3c8b0-4dc6-43df-b51b-67ae0b9cd96a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:28.568085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aed3c8b0-4dc6-43df-b51b-67ae0b9cd96a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:28.872153 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aed3c8b0-4dc6-43df-b51b-67ae0b9cd96a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:28.888690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aed3c8b0-4dc6-43df-b51b-67ae0b9cd96a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:28.892029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-43e0e4d1-ef51-4d8b-b82b-505f556c122f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:28.893968 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aed3c8b0-4dc6-43df-b51b-67ae0b9cd96a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:28.896006 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aed3c8b0-4dc6-43df-b51b-67ae0b9cd96a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1366 microversion: 2.57 time: 0.358066 Aug 24 10:24:28.907591 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-43e0e4d1-ef51-4d8b-b82b-505f556c122f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e" status: 200 len: 1576 microversion: 2.1 time: 1.188275 Aug 24 10:24:28.913971 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1627/2913] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:28 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1366 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:28.922633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-76cbff53-42d0-45f9-8c2e-3b0d5d07bd08 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:28.925014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-76cbff53-42d0-45f9-8c2e-3b0d5d07bd08 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] [instance: 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:28.935674 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1287/2914] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:27 2022] GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e => generated 1576 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:29.104439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-76cbff53-42d0-45f9-8c2e-3b0d5d07bd08 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578a67fe95b3453cb7d6bc90acce0478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396c23b60923463b9a82af15a7dcf771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:29.112888 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-76cbff53-42d0-45f9-8c2e-3b0d5d07bd08 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] 10.222.0.85 "GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54" status: 200 len: 1213 microversion: 2.1 time: 0.197781 Aug 24 10:24:29.115386 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1628/2915] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:28 2022] GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 => generated 1213 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:29.933164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-62ca6392-3f04-4db1-b8c4-9eaf70fe6f20 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:29.935279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-62ca6392-3f04-4db1-b8c4-9eaf70fe6f20 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:29.948943 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62ca6392-3f04-4db1-b8c4-9eaf70fe6f20 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:29.950093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62ca6392-3f04-4db1-b8c4-9eaf70fe6f20 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:29.950984 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62ca6392-3f04-4db1-b8c4-9eaf70fe6f20 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:29.952974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62ca6392-3f04-4db1-b8c4-9eaf70fe6f20 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:29.954000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62ca6392-3f04-4db1-b8c4-9eaf70fe6f20 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:29.954861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62ca6392-3f04-4db1-b8c4-9eaf70fe6f20 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:29.964684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c7b13bd7-1802-465a-a4d3-da5a108bcfb3 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:29.966531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c7b13bd7-1802-465a-a4d3-da5a108bcfb3 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:30.001301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7b13bd7-1802-465a-a4d3-da5a108bcfb3 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:30.002165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7b13bd7-1802-465a-a4d3-da5a108bcfb3 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:30.002921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7b13bd7-1802-465a-a4d3-da5a108bcfb3 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:30.004077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7b13bd7-1802-465a-a4d3-da5a108bcfb3 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:30.004869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7b13bd7-1802-465a-a4d3-da5a108bcfb3 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:30.023415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7b13bd7-1802-465a-a4d3-da5a108bcfb3 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:30.127165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-62ca6392-3f04-4db1-b8c4-9eaf70fe6f20 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:30.149899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-62ca6392-3f04-4db1-b8c4-9eaf70fe6f20 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:30.151457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-62ca6392-3f04-4db1-b8c4-9eaf70fe6f20 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:30.158837 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-62ca6392-3f04-4db1-b8c4-9eaf70fe6f20 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1366 microversion: 2.57 time: 0.238049 Aug 24 10:24:30.160109 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1288/2916] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:29 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:30.189410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e560079-36db-449b-a1b2-3b3d237fb81c tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:30.190859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6e560079-36db-449b-a1b2-3b3d237fb81c tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] [instance: 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:30.201938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e560079-36db-449b-a1b2-3b3d237fb81c tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:30.202698 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e560079-36db-449b-a1b2-3b3d237fb81c tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:30.225762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e560079-36db-449b-a1b2-3b3d237fb81c tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:30.227017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e560079-36db-449b-a1b2-3b3d237fb81c tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:30.227755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e560079-36db-449b-a1b2-3b3d237fb81c tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:30.229766 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e560079-36db-449b-a1b2-3b3d237fb81c tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:30.421886 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6e560079-36db-449b-a1b2-3b3d237fb81c tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578a67fe95b3453cb7d6bc90acce0478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396c23b60923463b9a82af15a7dcf771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:30.435726 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6e560079-36db-449b-a1b2-3b3d237fb81c tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] 10.222.0.85 "GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54" status: 200 len: 1265 microversion: 2.1 time: 0.274092 Aug 24 10:24:30.445586 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1289/2917] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:30 2022] GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 => generated 1265 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:30.491970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c7b13bd7-1802-465a-a4d3-da5a108bcfb3 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:30.534893 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c7b13bd7-1802-465a-a4d3-da5a108bcfb3 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e" status: 200 len: 1576 microversion: 2.1 time: 0.595407 Aug 24 10:24:30.537506 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1629/2918] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:29 2022] GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e => generated 1576 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:31.192949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bb4b900f-8b10-4245-9c95-9e2b4a873d32 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:31.193838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bb4b900f-8b10-4245-9c95-9e2b4a873d32 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:31.204096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb4b900f-8b10-4245-9c95-9e2b4a873d32 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:31.204979 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb4b900f-8b10-4245-9c95-9e2b4a873d32 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:31.209550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb4b900f-8b10-4245-9c95-9e2b4a873d32 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:31.225234 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb4b900f-8b10-4245-9c95-9e2b4a873d32 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:31.225977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb4b900f-8b10-4245-9c95-9e2b4a873d32 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:31.226644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb4b900f-8b10-4245-9c95-9e2b4a873d32 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:31.433296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bb4b900f-8b10-4245-9c95-9e2b4a873d32 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:31.446028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bb4b900f-8b10-4245-9c95-9e2b4a873d32 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:31.453821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bb4b900f-8b10-4245-9c95-9e2b4a873d32 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:31.455037 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bb4b900f-8b10-4245-9c95-9e2b4a873d32 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1366 microversion: 2.57 time: 0.268538 Aug 24 10:24:31.455612 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1290/2919] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:31 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:31.465082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f7cc6b2d-4cc8-4255-a33e-3972bea9da17 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:31.467074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f7cc6b2d-4cc8-4255-a33e-3972bea9da17 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] [instance: 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:31.484716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7cc6b2d-4cc8-4255-a33e-3972bea9da17 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:31.489801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7cc6b2d-4cc8-4255-a33e-3972bea9da17 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:31.490542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7cc6b2d-4cc8-4255-a33e-3972bea9da17 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:31.491468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7cc6b2d-4cc8-4255-a33e-3972bea9da17 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:31.492160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7cc6b2d-4cc8-4255-a33e-3972bea9da17 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:31.492809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7cc6b2d-4cc8-4255-a33e-3972bea9da17 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:31.560251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bf2bb8ad-dca9-4a7b-890c-4b5cd6b67c93 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:31.561335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bf2bb8ad-dca9-4a7b-890c-4b5cd6b67c93 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:31.574355 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf2bb8ad-dca9-4a7b-890c-4b5cd6b67c93 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:31.575127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf2bb8ad-dca9-4a7b-890c-4b5cd6b67c93 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:31.577574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf2bb8ad-dca9-4a7b-890c-4b5cd6b67c93 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:31.581263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf2bb8ad-dca9-4a7b-890c-4b5cd6b67c93 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:31.582602 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf2bb8ad-dca9-4a7b-890c-4b5cd6b67c93 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:31.590831 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf2bb8ad-dca9-4a7b-890c-4b5cd6b67c93 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:31.682847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f7cc6b2d-4cc8-4255-a33e-3972bea9da17 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578a67fe95b3453cb7d6bc90acce0478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396c23b60923463b9a82af15a7dcf771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:31.717027 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f7cc6b2d-4cc8-4255-a33e-3972bea9da17 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] 10.222.0.85 "GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54" status: 200 len: 1271 microversion: 2.1 time: 0.264121 Aug 24 10:24:31.723055 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1630/2920] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:31 2022] GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 => generated 1271 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:24:31.846168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-051420bc-3d4b-4e19-aa34-d3939b8486f4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1717934442", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:31.942750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-051420bc-3d4b-4e19-aa34-d3939b8486f4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] validate_networks() for [('778f7c02-32bb-4be3-a246-e526b0beccd6', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:24:32.617712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bf2bb8ad-dca9-4a7b-890c-4b5cd6b67c93 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:32.627008 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bf2bb8ad-dca9-4a7b-890c-4b5cd6b67c93 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e" status: 200 len: 1574 microversion: 2.1 time: 1.072088 Aug 24 10:24:32.628404 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1291/2921] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:31 2022] GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e => generated 1574 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:32.655109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ebec3dbc-07be-48d5-8abd-57991b67524a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:32.656943 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ebec3dbc-07be-48d5-8abd-57991b67524a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:32.680455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebec3dbc-07be-48d5-8abd-57991b67524a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:32.681043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebec3dbc-07be-48d5-8abd-57991b67524a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:32.681547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebec3dbc-07be-48d5-8abd-57991b67524a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:32.682361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebec3dbc-07be-48d5-8abd-57991b67524a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:32.683954 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebec3dbc-07be-48d5-8abd-57991b67524a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:32.684461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebec3dbc-07be-48d5-8abd-57991b67524a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:33.184513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ebec3dbc-07be-48d5-8abd-57991b67524a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:33.196771 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ebec3dbc-07be-48d5-8abd-57991b67524a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:33.199060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ebec3dbc-07be-48d5-8abd-57991b67524a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:33.207264 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ebec3dbc-07be-48d5-8abd-57991b67524a tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1366 microversion: 2.57 time: 0.576747 Aug 24 10:24:33.207560 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1292/2922] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:32 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1366 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:33.230830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6f371f7b-2523-4462-81d3-9d7f7bca109c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-539861875"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:33.231369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6f371f7b-2523-4462-81d3-9d7f7bca109c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:33.240119 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f371f7b-2523-4462-81d3-9d7f7bca109c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:33.240119 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f371f7b-2523-4462-81d3-9d7f7bca109c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:33.240507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f371f7b-2523-4462-81d3-9d7f7bca109c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:33.241272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f371f7b-2523-4462-81d3-9d7f7bca109c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:33.241733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f371f7b-2523-4462-81d3-9d7f7bca109c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:33.242159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f371f7b-2523-4462-81d3-9d7f7bca109c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:33.621929 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.network.security_group_api [None req-6f371f7b-2523-4462-81d3-9d7f7bca109c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Adding security group ac3b7da7-9123-404b-bef4-5513b66b6424 to port 3cfea031-56f2-4af5-9636-0ed3c213c5c8 Aug 24 10:24:34.519500 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6f371f7b-2523-4462-81d3-9d7f7bca109c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "POST /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e/action" status: 202 len: 0 microversion: 2.1 time: 1.310805 Aug 24 10:24:34.520568 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1293/2923] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:24:33 2022] POST /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e/action => generated 0 bytes in 1312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:24:34.527315 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92fd543d-2546-40aa-9b31-13407ea6899f tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:34.528255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-92fd543d-2546-40aa-9b31-13407ea6899f tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] [instance: 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:34.549169 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92fd543d-2546-40aa-9b31-13407ea6899f tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:34.560696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92fd543d-2546-40aa-9b31-13407ea6899f tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:34.562396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92fd543d-2546-40aa-9b31-13407ea6899f tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:34.563334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92fd543d-2546-40aa-9b31-13407ea6899f tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:34.563911 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92fd543d-2546-40aa-9b31-13407ea6899f tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:34.568118 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92fd543d-2546-40aa-9b31-13407ea6899f tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:34.587637 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-051420bc-3d4b-4e19-aa34-d3939b8486f4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:24:34.588141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-051420bc-3d4b-4e19-aa34-d3939b8486f4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:24:34.588711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-051420bc-3d4b-4e19-aa34-d3939b8486f4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:24:34.589238 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-051420bc-3d4b-4e19-aa34-d3939b8486f4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:24:34.589750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-051420bc-3d4b-4e19-aa34-d3939b8486f4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:24:34.620606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-051420bc-3d4b-4e19-aa34-d3939b8486f4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:34.632481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-051420bc-3d4b-4e19-aa34-d3939b8486f4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:34.633398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-051420bc-3d4b-4e19-aa34-d3939b8486f4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:34.641674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-051420bc-3d4b-4e19-aa34-d3939b8486f4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:34.642925 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-051420bc-3d4b-4e19-aa34-d3939b8486f4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:34.643579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-051420bc-3d4b-4e19-aa34-d3939b8486f4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:34.711972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-051420bc-3d4b-4e19-aa34-d3939b8486f4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Getting quotas for project de173a86ff8a446289ea3e98de1fd06b. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:24:34.729939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-051420bc-3d4b-4e19-aa34-d3939b8486f4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Getting quotas for user 812c7ee5dd0f4be9b9745e10a89d5cf6 and project de173a86ff8a446289ea3e98de1fd06b. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:24:34.752231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-051420bc-3d4b-4e19-aa34-d3939b8486f4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:24:34.772588 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-051420bc-3d4b-4e19-aa34-d3939b8486f4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:24:34.885109 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-051420bc-3d4b-4e19-aa34-d3939b8486f4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.135379 Aug 24 10:24:34.889950 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1631/2924] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:24:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 3141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:24:34.896497 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-815e22c1-80dc-4bd8-99b0-117803bba024 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:34.908816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-815e22c1-80dc-4bd8-99b0-117803bba024 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:34.935135 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-815e22c1-80dc-4bd8-99b0-117803bba024 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:34.935653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-815e22c1-80dc-4bd8-99b0-117803bba024 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:34.936156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-815e22c1-80dc-4bd8-99b0-117803bba024 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:34.936993 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-815e22c1-80dc-4bd8-99b0-117803bba024 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:34.937480 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-815e22c1-80dc-4bd8-99b0-117803bba024 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:34.937911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-815e22c1-80dc-4bd8-99b0-117803bba024 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:35.246087 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-815e22c1-80dc-4bd8-99b0-117803bba024 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:35.283798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-815e22c1-80dc-4bd8-99b0-117803bba024 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:35.290876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-815e22c1-80dc-4bd8-99b0-117803bba024 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:35.294058 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-815e22c1-80dc-4bd8-99b0-117803bba024 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1366 microversion: 2.57 time: 0.401658 Aug 24 10:24:35.296472 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1632/2925] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:34 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1366 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:35.325151 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-34a2bc12-06a0-437d-a621-40feaa985f26 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '.version_select at 0x7f4647d53820>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:35.363502 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-92fd543d-2546-40aa-9b31-13407ea6899f tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578a67fe95b3453cb7d6bc90acce0478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396c23b60923463b9a82af15a7dcf771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:35.388116 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-92fd543d-2546-40aa-9b31-13407ea6899f tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] 10.222.0.85 "GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54" status: 200 len: 1313 microversion: 2.1 time: 0.866028 Aug 24 10:24:35.389042 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1294/2926] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:34 2022] GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 => generated 1313 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:35.395499 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-dd9326f2-0537-443e-a772-7f4535bb1ded req-370873d5-6a1a-487b-95a9-0257c3c3c909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0a30de6-ae02-49e5-87d5-558660bd9b1e", "tag": "3cfea031-56f2-4af5-9636-0ed3c213c5c8"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:35.426516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dd9326f2-0537-443e-a772-7f4535bb1ded req-370873d5-6a1a-487b-95a9-0257c3c3c909 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:35.427503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dd9326f2-0537-443e-a772-7f4535bb1ded req-370873d5-6a1a-487b-95a9-0257c3c3c909 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:35.428241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dd9326f2-0537-443e-a772-7f4535bb1ded req-370873d5-6a1a-487b-95a9-0257c3c3c909 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:35.447082 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-dd9326f2-0537-443e-a772-7f4535bb1ded req-370873d5-6a1a-487b-95a9-0257c3c3c909 service nova] Creating event network-changed:3cfea031-56f2-4af5-9636-0ed3c213c5c8 for instance b0a30de6-ae02-49e5-87d5-558660bd9b1e on n-h1-849328-3 Aug 24 10:24:35.455633 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-dd9326f2-0537-443e-a772-7f4535bb1ded req-370873d5-6a1a-487b-95a9-0257c3c3c909 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063836 Aug 24 10:24:35.464202 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1295/2927] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:24:35.473845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-58abbad9-4a76-4cc8-a74a-8396d6a56848 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:35.477852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-58abbad9-4a76-4cc8-a74a-8396d6a56848 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:35.828145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-58abbad9-4a76-4cc8-a74a-8396d6a56848 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:35.852093 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-58abbad9-4a76-4cc8-a74a-8396d6a56848 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 200 len: 1214 microversion: 2.1 time: 0.385810 Aug 24 10:24:35.865149 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1296/2928] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:35 2022] GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 1214 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:36.331517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-799c8a67-ad45-44a8-ac9c-3c887161d57e tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:36.332384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-799c8a67-ad45-44a8-ac9c-3c887161d57e tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:36.354969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-799c8a67-ad45-44a8-ac9c-3c887161d57e tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:36.356312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-799c8a67-ad45-44a8-ac9c-3c887161d57e tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:36.357382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-799c8a67-ad45-44a8-ac9c-3c887161d57e tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:36.359402 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-799c8a67-ad45-44a8-ac9c-3c887161d57e tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:36.359876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-799c8a67-ad45-44a8-ac9c-3c887161d57e tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:36.362531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-799c8a67-ad45-44a8-ac9c-3c887161d57e tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:36.785825 n-d-849328-3 devstack@n-api.service[122433]: DEBUG neutronclient.v2_0.client [None req-34a2bc12-06a0-437d-a621-40feaa985f26 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group ac3b7da7-9123-404b-bef4-5513b66b6424 in use.", "detail": ""}} {{(pid=122433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 10:24:36.787062 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-34a2bc12-06a0-437d-a621-40feaa985f26 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] HTTP exception thrown: Security Group ac3b7da7-9123-404b-bef4-5513b66b6424 in use. Aug 24 10:24:36.787062 n-d-849328-3 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-d7399d51-1e95-4a5c-bca3-113e13875ef3'] Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-34a2bc12-06a0-437d-a621-40feaa985f26 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Request method failure captured: Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-security-groups/ac3b7da7-9123-404b-bef4-5513b66b6424 HTTP/1.1 Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfwP4tkKyJr5Gg7qNaTDv0qB585z-EGLWhAIlAiiw7niuSBtf4-Q9XJ2RClgHF5tG0tqoI1dsizKyw5H-SwLhXdRiM6qVR9NPoSFDWFDAiYHpCUOyNdaDsUmsdQydv3MYAQ3enYS0IGacLv6Rxy4kcYdhL4YEU_p2c-vtfjTt6PXS-o Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_44f050698fc54fb6b8fdf2866472dd7d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/44f050698fc54fb6b8fdf2866472dd7d"}]}] Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: cf7304a4a0bb486fbf52f1c84cad702a Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: exception: Security Group ac3b7da7-9123-404b-bef4-5513b66b6424 in use. Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-d7399d51-1e95-4a5c-bca3-113e13875ef3'] Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'ac3b7da7-9123-404b-bef4-5513b66b6424'} Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 10:24:36.801691 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group ac3b7da7-9123-404b-bef4-5513b66b6424 in use. Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7399d51-1e95-4a5c-bca3-113e13875ef3'] Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group ac3b7da7-9123-404b-bef4-5513b66b6424 in use. Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7399d51-1e95-4a5c-bca3-113e13875ef3'] Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group ac3b7da7-9123-404b-bef4-5513b66b6424 in use. Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7399d51-1e95-4a5c-bca3-113e13875ef3'] Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group ac3b7da7-9123-404b-bef4-5513b66b6424 in use. Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7399d51-1e95-4a5c-bca3-113e13875ef3'] Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-34a2bc12-06a0-437d-a621-40feaa985f26 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Returning 400 to user: Security Group ac3b7da7-9123-404b-bef4-5513b66b6424 in use. Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-d7399d51-1e95-4a5c-bca3-113e13875ef3'] {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:36.806529 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-34a2bc12-06a0-437d-a621-40feaa985f26 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/ac3b7da7-9123-404b-bef4-5513b66b6424" status: 400 len: 185 microversion: 2.1 time: 1.504382 Aug 24 10:24:36.812579 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1633/2929] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:24:35 2022] DELETE /compute/v2.1/os-security-groups/ac3b7da7-9123-404b-bef4-5513b66b6424 => generated 185 bytes in 1515 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:24:36.835732 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9fd7c1ba-0b47-4933-83a2-4fdec6361301 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:36.836851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9fd7c1ba-0b47-4933-83a2-4fdec6361301 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] [instance: 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:36.862815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9fd7c1ba-0b47-4933-83a2-4fdec6361301 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:36.877144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-799c8a67-ad45-44a8-ac9c-3c887161d57e tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:36.891101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9fd7c1ba-0b47-4933-83a2-4fdec6361301 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:36.902672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-799c8a67-ad45-44a8-ac9c-3c887161d57e tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:36.903118 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9fd7c1ba-0b47-4933-83a2-4fdec6361301 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:36.905881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9fd7c1ba-0b47-4933-83a2-4fdec6361301 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:36.906685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9fd7c1ba-0b47-4933-83a2-4fdec6361301 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:36.907554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9fd7c1ba-0b47-4933-83a2-4fdec6361301 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:36.916741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-799c8a67-ad45-44a8-ac9c-3c887161d57e tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:36.919279 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-799c8a67-ad45-44a8-ac9c-3c887161d57e tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1366 microversion: 2.57 time: 0.592155 Aug 24 10:24:36.965870 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1297/2930] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:36 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1366 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:24:36.992086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7291f789-ca5f-496a-b89f-fa76af69bd7c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:36.995221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7291f789-ca5f-496a-b89f-fa76af69bd7c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:37.014230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7291f789-ca5f-496a-b89f-fa76af69bd7c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:37.017668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7291f789-ca5f-496a-b89f-fa76af69bd7c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:37.018415 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7291f789-ca5f-496a-b89f-fa76af69bd7c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:37.019405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7291f789-ca5f-496a-b89f-fa76af69bd7c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:37.020235 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7291f789-ca5f-496a-b89f-fa76af69bd7c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:37.020874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7291f789-ca5f-496a-b89f-fa76af69bd7c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:37.067850 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7291f789-ca5f-496a-b89f-fa76af69bd7c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:24:37.211501 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:37.276075 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7291f789-ca5f-496a-b89f-fa76af69bd7c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e" status: 204 len: 0 microversion: 2.1 time: 0.308613 Aug 24 10:24:37.280458 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1298/2931] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:24:36 2022] DELETE /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:37.295645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-038333c2-b623-4422-83aa-ec07a6b9d3e6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:37.297305 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-038333c2-b623-4422-83aa-ec07a6b9d3e6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:37.328624 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-038333c2-b623-4422-83aa-ec07a6b9d3e6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:37.332405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-038333c2-b623-4422-83aa-ec07a6b9d3e6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:37.332936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-038333c2-b623-4422-83aa-ec07a6b9d3e6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:37.334219 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-038333c2-b623-4422-83aa-ec07a6b9d3e6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:37.334910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-038333c2-b623-4422-83aa-ec07a6b9d3e6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:37.337265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-038333c2-b623-4422-83aa-ec07a6b9d3e6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:37.558210 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9fd7c1ba-0b47-4933-83a2-4fdec6361301 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578a67fe95b3453cb7d6bc90acce0478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396c23b60923463b9a82af15a7dcf771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:37.572309 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9fd7c1ba-0b47-4933-83a2-4fdec6361301 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] 10.222.0.85 "GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54" status: 200 len: 1313 microversion: 2.1 time: 0.757688 Aug 24 10:24:37.577077 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1634/2932] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:36 2022] GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 => generated 1313 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:37.586466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9cba9c45-0496-4be3-8e4a-8af90688ea8b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:37.588766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9cba9c45-0496-4be3-8e4a-8af90688ea8b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:37.604431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cba9c45-0496-4be3-8e4a-8af90688ea8b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:37.604996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cba9c45-0496-4be3-8e4a-8af90688ea8b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:37.605668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cba9c45-0496-4be3-8e4a-8af90688ea8b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:37.606386 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cba9c45-0496-4be3-8e4a-8af90688ea8b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:37.606928 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cba9c45-0496-4be3-8e4a-8af90688ea8b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:37.607327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cba9c45-0496-4be3-8e4a-8af90688ea8b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:37.689483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-038333c2-b623-4422-83aa-ec07a6b9d3e6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:37.698706 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-038333c2-b623-4422-83aa-ec07a6b9d3e6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 200 len: 1274 microversion: 2.1 time: 0.410173 Aug 24 10:24:37.716918 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1299/2933] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:37 2022] GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 1274 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:37.921508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-a218e129-d34f-4433-b147-9be199e7654a req-5db4f0da-a8f5-4253-b7db-fc6d63aa372a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dc626f8-e0ea-469a-bacb-a6e79c0e8d54", "tag": "20c7b980-98a4-450e-a121-ad8a54c69575"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:37.938363 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a218e129-d34f-4433-b147-9be199e7654a req-5db4f0da-a8f5-4253-b7db-fc6d63aa372a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:37.938845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a218e129-d34f-4433-b147-9be199e7654a req-5db4f0da-a8f5-4253-b7db-fc6d63aa372a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:37.939274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a218e129-d34f-4433-b147-9be199e7654a req-5db4f0da-a8f5-4253-b7db-fc6d63aa372a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:37.953938 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-a218e129-d34f-4433-b147-9be199e7654a req-5db4f0da-a8f5-4253-b7db-fc6d63aa372a service nova] Creating event network-changed:20c7b980-98a4-450e-a121-ad8a54c69575 for instance 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 on n-h2-849328-3 Aug 24 10:24:37.959463 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-a218e129-d34f-4433-b147-9be199e7654a req-5db4f0da-a8f5-4253-b7db-fc6d63aa372a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042584 Aug 24 10:24:37.960080 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1300/2934] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:24:37.979937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-95f78d3a-87f9-4803-a504-211e47af1069 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:37.983915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-95f78d3a-87f9-4803-a504-211e47af1069 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:38.002814 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95f78d3a-87f9-4803-a504-211e47af1069 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:38.006638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95f78d3a-87f9-4803-a504-211e47af1069 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:38.007309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95f78d3a-87f9-4803-a504-211e47af1069 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:38.010944 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95f78d3a-87f9-4803-a504-211e47af1069 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:38.011805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95f78d3a-87f9-4803-a504-211e47af1069 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:38.012467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95f78d3a-87f9-4803-a504-211e47af1069 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:38.305013 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-95f78d3a-87f9-4803-a504-211e47af1069 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:38.327076 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-95f78d3a-87f9-4803-a504-211e47af1069 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:38.332553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-95f78d3a-87f9-4803-a504-211e47af1069 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:38.334169 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-95f78d3a-87f9-4803-a504-211e47af1069 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1366 microversion: 2.57 time: 0.359282 Aug 24 10:24:38.340124 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1301/2935] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:37 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1366 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:38.380258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e7062b0f-71b1-440c-b5cc-77f820111f15 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:38.389748 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e7062b0f-71b1-440c-b5cc-77f820111f15 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:38.419982 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7062b0f-71b1-440c-b5cc-77f820111f15 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:38.424536 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7062b0f-71b1-440c-b5cc-77f820111f15 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:38.425727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7062b0f-71b1-440c-b5cc-77f820111f15 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:38.427239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7062b0f-71b1-440c-b5cc-77f820111f15 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:38.434548 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7062b0f-71b1-440c-b5cc-77f820111f15 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:38.436182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7062b0f-71b1-440c-b5cc-77f820111f15 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:38.470530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e7062b0f-71b1-440c-b5cc-77f820111f15 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:24:38.508529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9cba9c45-0496-4be3-8e4a-8af90688ea8b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:38.518799 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9cba9c45-0496-4be3-8e4a-8af90688ea8b tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e" status: 200 len: 1648 microversion: 2.1 time: 0.940359 Aug 24 10:24:38.535699 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1635/2936] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:37 2022] GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e => generated 1648 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:38.600218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-51ba88cf-f81d-4256-86f7-dc01b121635b tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:38.600922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-51ba88cf-f81d-4256-86f7-dc01b121635b tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] [instance: 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:38.610222 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e7062b0f-71b1-440c-b5cc-77f820111f15 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "DELETE /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6" status: 204 len: 0 microversion: 2.1 time: 0.255985 Aug 24 10:24:38.612116 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1302/2937] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:24:38 2022] DELETE /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:38.613294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51ba88cf-f81d-4256-86f7-dc01b121635b tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:38.614137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51ba88cf-f81d-4256-86f7-dc01b121635b tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:38.614790 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51ba88cf-f81d-4256-86f7-dc01b121635b tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:38.621845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51ba88cf-f81d-4256-86f7-dc01b121635b tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:38.622730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51ba88cf-f81d-4256-86f7-dc01b121635b tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:38.623168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51ba88cf-f81d-4256-86f7-dc01b121635b tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:38.624977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d82082d6-eac4-4b5a-be40-5284653ef244 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:38.630144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d82082d6-eac4-4b5a-be40-5284653ef244 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:38.643480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d82082d6-eac4-4b5a-be40-5284653ef244 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:38.644794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d82082d6-eac4-4b5a-be40-5284653ef244 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:38.646773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d82082d6-eac4-4b5a-be40-5284653ef244 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:38.647732 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d82082d6-eac4-4b5a-be40-5284653ef244 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:38.650788 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d82082d6-eac4-4b5a-be40-5284653ef244 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:38.651499 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d82082d6-eac4-4b5a-be40-5284653ef244 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:39.082344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d82082d6-eac4-4b5a-be40-5284653ef244 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:39.100061 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d82082d6-eac4-4b5a-be40-5284653ef244 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6" status: 200 len: 1555 microversion: 2.1 time: 0.482803 Aug 24 10:24:39.101023 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1303/2938] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:38 2022] GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 => generated 1555 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:39.107465 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d712d23d-fbc7-4f5c-87d7-d28065d58883 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:39.109550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d712d23d-fbc7-4f5c-87d7-d28065d58883 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:39.117873 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d712d23d-fbc7-4f5c-87d7-d28065d58883 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:39.118669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d712d23d-fbc7-4f5c-87d7-d28065d58883 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:39.119425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d712d23d-fbc7-4f5c-87d7-d28065d58883 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:39.120357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d712d23d-fbc7-4f5c-87d7-d28065d58883 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:39.121981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d712d23d-fbc7-4f5c-87d7-d28065d58883 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:39.122753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d712d23d-fbc7-4f5c-87d7-d28065d58883 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:39.210714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-51ba88cf-f81d-4256-86f7-dc01b121635b tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578a67fe95b3453cb7d6bc90acce0478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396c23b60923463b9a82af15a7dcf771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:39.224564 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-51ba88cf-f81d-4256-86f7-dc01b121635b tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] 10.222.0.85 "GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54" status: 200 len: 1313 microversion: 2.1 time: 0.629059 Aug 24 10:24:39.238718 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1636/2939] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:38 2022] GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 => generated 1313 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:24:39.386406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b274b01d-c385-40ae-ba38-ea4b6e7b1beb tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:39.390510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b274b01d-c385-40ae-ba38-ea4b6e7b1beb tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:39.411905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b274b01d-c385-40ae-ba38-ea4b6e7b1beb tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:39.415429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b274b01d-c385-40ae-ba38-ea4b6e7b1beb tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:39.416467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b274b01d-c385-40ae-ba38-ea4b6e7b1beb tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:39.419241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b274b01d-c385-40ae-ba38-ea4b6e7b1beb tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:39.419832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b274b01d-c385-40ae-ba38-ea4b6e7b1beb tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:39.420295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b274b01d-c385-40ae-ba38-ea4b6e7b1beb tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:39.420656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d712d23d-fbc7-4f5c-87d7-d28065d58883 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:39.434231 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d712d23d-fbc7-4f5c-87d7-d28065d58883 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 200 len: 1314 microversion: 2.1 time: 0.331449 Aug 24 10:24:39.434648 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1304/2940] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:39 2022] GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:39.543249 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f993d6c4-1e59-4ddb-81e2-f87d5637f709 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:39.546275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f993d6c4-1e59-4ddb-81e2-f87d5637f709 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:39.558402 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f993d6c4-1e59-4ddb-81e2-f87d5637f709 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:39.558678 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b274b01d-c385-40ae-ba38-ea4b6e7b1beb tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:39.559313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f993d6c4-1e59-4ddb-81e2-f87d5637f709 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:39.559516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f993d6c4-1e59-4ddb-81e2-f87d5637f709 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:39.560521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f993d6c4-1e59-4ddb-81e2-f87d5637f709 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:39.561467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f993d6c4-1e59-4ddb-81e2-f87d5637f709 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:39.562094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f993d6c4-1e59-4ddb-81e2-f87d5637f709 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:39.583968 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b274b01d-c385-40ae-ba38-ea4b6e7b1beb tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:39.589658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b274b01d-c385-40ae-ba38-ea4b6e7b1beb tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:39.590960 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b274b01d-c385-40ae-ba38-ea4b6e7b1beb tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1366 microversion: 2.57 time: 0.224489 Aug 24 10:24:39.591635 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1637/2941] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:39 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:39.998044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f993d6c4-1e59-4ddb-81e2-f87d5637f709 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:40.007475 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f993d6c4-1e59-4ddb-81e2-f87d5637f709 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e" status: 200 len: 1648 microversion: 2.1 time: 0.470130 Aug 24 10:24:40.009172 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1305/2942] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:39 2022] GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e => generated 1648 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:24:40.130583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f370efb9-116a-4362-a747-b6ee9141cb41 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:40.131670 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f370efb9-116a-4362-a747-b6ee9141cb41 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:40.150032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f370efb9-116a-4362-a747-b6ee9141cb41 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:40.151672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f370efb9-116a-4362-a747-b6ee9141cb41 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:40.153028 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f370efb9-116a-4362-a747-b6ee9141cb41 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:40.155044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f370efb9-116a-4362-a747-b6ee9141cb41 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:40.156628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f370efb9-116a-4362-a747-b6ee9141cb41 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:40.158177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f370efb9-116a-4362-a747-b6ee9141cb41 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:40.249686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cefe3006-a3e9-4a0c-8c3f-9c88d3ebb107 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:40.251309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cefe3006-a3e9-4a0c-8c3f-9c88d3ebb107 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] [instance: 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:40.275675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cefe3006-a3e9-4a0c-8c3f-9c88d3ebb107 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:40.276640 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cefe3006-a3e9-4a0c-8c3f-9c88d3ebb107 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:40.277382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cefe3006-a3e9-4a0c-8c3f-9c88d3ebb107 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:40.278284 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cefe3006-a3e9-4a0c-8c3f-9c88d3ebb107 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:40.287655 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cefe3006-a3e9-4a0c-8c3f-9c88d3ebb107 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:40.288461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cefe3006-a3e9-4a0c-8c3f-9c88d3ebb107 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:40.429869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f370efb9-116a-4362-a747-b6ee9141cb41 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:40.443707 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f370efb9-116a-4362-a747-b6ee9141cb41 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6" status: 200 len: 1555 microversion: 2.1 time: 0.321191 Aug 24 10:24:40.444316 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1638/2943] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:40 2022] GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 => generated 1555 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:40.469839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4a8726f8-6839-4776-84d2-dbc08ff7a2c2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:40.471120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4a8726f8-6839-4776-84d2-dbc08ff7a2c2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:40.478995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a8726f8-6839-4776-84d2-dbc08ff7a2c2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:40.479571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a8726f8-6839-4776-84d2-dbc08ff7a2c2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:40.480105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a8726f8-6839-4776-84d2-dbc08ff7a2c2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:40.481054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a8726f8-6839-4776-84d2-dbc08ff7a2c2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:40.481650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a8726f8-6839-4776-84d2-dbc08ff7a2c2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:40.482197 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a8726f8-6839-4776-84d2-dbc08ff7a2c2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:40.530422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:40.906896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cefe3006-a3e9-4a0c-8c3f-9c88d3ebb107 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578a67fe95b3453cb7d6bc90acce0478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396c23b60923463b9a82af15a7dcf771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:40.923296 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cefe3006-a3e9-4a0c-8c3f-9c88d3ebb107 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] 10.222.0.85 "GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54" status: 200 len: 1313 microversion: 2.1 time: 0.677121 Aug 24 10:24:40.925038 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1306/2944] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:40 2022] GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 => generated 1313 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:24:40.932962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8920e9ed-e4c9-4edb-8478-cfe1ee251a74 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:40.933975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8920e9ed-e4c9-4edb-8478-cfe1ee251a74 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:40.942315 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8920e9ed-e4c9-4edb-8478-cfe1ee251a74 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:40.942869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8920e9ed-e4c9-4edb-8478-cfe1ee251a74 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:40.943680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8920e9ed-e4c9-4edb-8478-cfe1ee251a74 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:40.944582 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8920e9ed-e4c9-4edb-8478-cfe1ee251a74 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:40.945273 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8920e9ed-e4c9-4edb-8478-cfe1ee251a74 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:40.945889 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8920e9ed-e4c9-4edb-8478-cfe1ee251a74 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:41.132799 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8920e9ed-e4c9-4edb-8478-cfe1ee251a74 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:41.143780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8920e9ed-e4c9-4edb-8478-cfe1ee251a74 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:41.145723 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8920e9ed-e4c9-4edb-8478-cfe1ee251a74 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:41.147094 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8920e9ed-e4c9-4edb-8478-cfe1ee251a74 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1366 microversion: 2.57 time: 0.220724 Aug 24 10:24:41.147845 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1307/2945] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:40 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:41.157104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fa15ef29-27ed-4346-8ffc-9353cecc981f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:41.157747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fa15ef29-27ed-4346-8ffc-9353cecc981f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:41.171274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa15ef29-27ed-4346-8ffc-9353cecc981f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:41.172113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa15ef29-27ed-4346-8ffc-9353cecc981f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:41.172715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa15ef29-27ed-4346-8ffc-9353cecc981f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:41.173644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa15ef29-27ed-4346-8ffc-9353cecc981f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:41.174271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa15ef29-27ed-4346-8ffc-9353cecc981f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:41.174869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa15ef29-27ed-4346-8ffc-9353cecc981f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:41.286073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4a8726f8-6839-4776-84d2-dbc08ff7a2c2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:41.311069 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4a8726f8-6839-4776-84d2-dbc08ff7a2c2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 200 len: 1314 microversion: 2.1 time: 0.848463 Aug 24 10:24:41.328112 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1639/2946] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:40 2022] GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 1314 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:24:41.360520 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-5230714d-7f17-488e-9b90-0e25719f11cb req-8bba6d61-ffec-49f9-bf0a-1ffb6ea57e2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6cdec98-2454-4ba9-8859-25231e4e28ab", "tag": "d8ac64f8-d1a4-4fb4-aa57-201fbd4205c2"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:41.387410 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5230714d-7f17-488e-9b90-0e25719f11cb req-8bba6d61-ffec-49f9-bf0a-1ffb6ea57e2c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:41.388495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5230714d-7f17-488e-9b90-0e25719f11cb req-8bba6d61-ffec-49f9-bf0a-1ffb6ea57e2c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:41.389354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5230714d-7f17-488e-9b90-0e25719f11cb req-8bba6d61-ffec-49f9-bf0a-1ffb6ea57e2c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:41.413262 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-5230714d-7f17-488e-9b90-0e25719f11cb req-8bba6d61-ffec-49f9-bf0a-1ffb6ea57e2c service nova] Creating event network-changed:d8ac64f8-d1a4-4fb4-aa57-201fbd4205c2 for instance d6cdec98-2454-4ba9-8859-25231e4e28ab on n-h2-849328-3 Aug 24 10:24:41.422418 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-5230714d-7f17-488e-9b90-0e25719f11cb req-8bba6d61-ffec-49f9-bf0a-1ffb6ea57e2c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088561 Aug 24 10:24:41.423742 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1640/2947] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:24:41.474268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-461ea91f-2d66-4b61-aa13-69059d00cdfd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:41.475420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-461ea91f-2d66-4b61-aa13-69059d00cdfd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:41.483172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-461ea91f-2d66-4b61-aa13-69059d00cdfd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:41.484196 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-461ea91f-2d66-4b61-aa13-69059d00cdfd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:41.484887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-461ea91f-2d66-4b61-aa13-69059d00cdfd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:41.485843 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-461ea91f-2d66-4b61-aa13-69059d00cdfd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:41.486518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-461ea91f-2d66-4b61-aa13-69059d00cdfd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:41.487155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-461ea91f-2d66-4b61-aa13-69059d00cdfd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:41.811867 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fa15ef29-27ed-4346-8ffc-9353cecc981f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:41.820351 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fa15ef29-27ed-4346-8ffc-9353cecc981f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e" status: 200 len: 1648 microversion: 2.1 time: 0.671097 Aug 24 10:24:41.821650 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1308/2948] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:41 2022] GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e => generated 1648 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:41.962355 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b20c497b-dbd8-45a6-b602-1394aa08ca93 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:41.963343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b20c497b-dbd8-45a6-b602-1394aa08ca93 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] [instance: 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:41.990893 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b20c497b-dbd8-45a6-b602-1394aa08ca93 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:41.992138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b20c497b-dbd8-45a6-b602-1394aa08ca93 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:41.994864 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b20c497b-dbd8-45a6-b602-1394aa08ca93 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:41.996650 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b20c497b-dbd8-45a6-b602-1394aa08ca93 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:42.007924 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b20c497b-dbd8-45a6-b602-1394aa08ca93 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:42.014516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b20c497b-dbd8-45a6-b602-1394aa08ca93 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:42.019367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-461ea91f-2d66-4b61-aa13-69059d00cdfd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:42.061177 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-461ea91f-2d66-4b61-aa13-69059d00cdfd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6" status: 200 len: 1555 microversion: 2.1 time: 0.592245 Aug 24 10:24:42.062836 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1641/2949] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:41 2022] GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 => generated 1555 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:24:42.177447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6df5f718-3abc-4f77-a1a1-771d744c12f5 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:42.178905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6df5f718-3abc-4f77-a1a1-771d744c12f5 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:42.188298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6df5f718-3abc-4f77-a1a1-771d744c12f5 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:42.189861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6df5f718-3abc-4f77-a1a1-771d744c12f5 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:42.191743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6df5f718-3abc-4f77-a1a1-771d744c12f5 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:42.193684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6df5f718-3abc-4f77-a1a1-771d744c12f5 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:42.194637 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6df5f718-3abc-4f77-a1a1-771d744c12f5 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:42.195432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6df5f718-3abc-4f77-a1a1-771d744c12f5 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:42.429755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6df5f718-3abc-4f77-a1a1-771d744c12f5 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:42.439907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6df5f718-3abc-4f77-a1a1-771d744c12f5 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:42.451277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6df5f718-3abc-4f77-a1a1-771d744c12f5 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:42.453018 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6df5f718-3abc-4f77-a1a1-771d744c12f5 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1366 microversion: 2.57 time: 0.284700 Aug 24 10:24:42.454087 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1642/2950] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:42 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:42.463688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1571dbce-45e2-4470-858d-24eba4e55392 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:42.464327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1571dbce-45e2-4470-858d-24eba4e55392 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:42.488289 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1571dbce-45e2-4470-858d-24eba4e55392 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:42.495462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1571dbce-45e2-4470-858d-24eba4e55392 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:42.497535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1571dbce-45e2-4470-858d-24eba4e55392 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:42.498702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1571dbce-45e2-4470-858d-24eba4e55392 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:42.501735 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1571dbce-45e2-4470-858d-24eba4e55392 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:42.502465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1571dbce-45e2-4470-858d-24eba4e55392 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:43.008576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b20c497b-dbd8-45a6-b602-1394aa08ca93 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578a67fe95b3453cb7d6bc90acce0478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396c23b60923463b9a82af15a7dcf771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:43.029908 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b20c497b-dbd8-45a6-b602-1394aa08ca93 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] 10.222.0.85 "GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54" status: 200 len: 1313 microversion: 2.1 time: 1.064669 Aug 24 10:24:43.030960 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1309/2951] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:41 2022] GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 => generated 1313 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:43.036206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-571b1e51-e768-4805-a21e-14c498f32ff9 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:43.036939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-571b1e51-e768-4805-a21e-14c498f32ff9 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:43.054485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-571b1e51-e768-4805-a21e-14c498f32ff9 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:43.055329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-571b1e51-e768-4805-a21e-14c498f32ff9 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:43.055964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-571b1e51-e768-4805-a21e-14c498f32ff9 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:43.056878 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-571b1e51-e768-4805-a21e-14c498f32ff9 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:43.057573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-571b1e51-e768-4805-a21e-14c498f32ff9 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:43.058160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-571b1e51-e768-4805-a21e-14c498f32ff9 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:43.113009 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-571b1e51-e768-4805-a21e-14c498f32ff9 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:43.114895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-571b1e51-e768-4805-a21e-14c498f32ff9 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:43.115550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-571b1e51-e768-4805-a21e-14c498f32ff9 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:43.117328 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-571b1e51-e768-4805-a21e-14c498f32ff9 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lazy-loading 'fault' on Instance uuid b0a30de6-ae02-49e5-87d5-558660bd9b1e {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:24:43.319317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-571b1e51-e768-4805-a21e-14c498f32ff9 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:43.334273 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-571b1e51-e768-4805-a21e-14c498f32ff9 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e" status: 200 len: 1306 microversion: 2.1 time: 0.301828 Aug 24 10:24:43.338062 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1310/2952] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:43 2022] GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e => generated 1306 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:43.369517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-59531493-6b34-4a15-b8cd-f8e049c465eb tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:43.373459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-59531493-6b34-4a15-b8cd-f8e049c465eb tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:43.400979 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59531493-6b34-4a15-b8cd-f8e049c465eb tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:43.404180 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59531493-6b34-4a15-b8cd-f8e049c465eb tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:43.405556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59531493-6b34-4a15-b8cd-f8e049c465eb tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:43.406559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59531493-6b34-4a15-b8cd-f8e049c465eb tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:43.408229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59531493-6b34-4a15-b8cd-f8e049c465eb tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:43.408680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59531493-6b34-4a15-b8cd-f8e049c465eb tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:43.429244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1571dbce-45e2-4470-858d-24eba4e55392 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:43.464272 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1571dbce-45e2-4470-858d-24eba4e55392 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 200 len: 1314 microversion: 2.1 time: 1.008873 Aug 24 10:24:43.467926 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1643/2953] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:42 2022] GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 1314 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:43.498239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-e0f17ea2-5bc3-4e50-87be-389376435378 req-4ff2dac5-fd27-4593-92eb-d775309288c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a30de6-ae02-49e5-87d5-558660bd9b1e", "name": "network-vif-deleted", "tag": "3cfea031-56f2-4af5-9636-0ed3c213c5c8"}, {"server_uuid": "30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6", "name": "network-vif-deleted", "tag": "04d1717f-046b-4c08-9776-84ba02839aeb"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:43.532033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e0f17ea2-5bc3-4e50-87be-389376435378 req-4ff2dac5-fd27-4593-92eb-d775309288c4 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:43.532535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e0f17ea2-5bc3-4e50-87be-389376435378 req-4ff2dac5-fd27-4593-92eb-d775309288c4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:43.532975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e0f17ea2-5bc3-4e50-87be-389376435378 req-4ff2dac5-fd27-4593-92eb-d775309288c4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:43.548812 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-e0f17ea2-5bc3-4e50-87be-389376435378 req-4ff2dac5-fd27-4593-92eb-d775309288c4 service nova] Creating event network-vif-deleted:3cfea031-56f2-4af5-9636-0ed3c213c5c8 for instance b0a30de6-ae02-49e5-87d5-558660bd9b1e on n-h1-849328-3 Aug 24 10:24:43.549357 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-e0f17ea2-5bc3-4e50-87be-389376435378 req-4ff2dac5-fd27-4593-92eb-d775309288c4 service nova] Creating event network-vif-deleted:04d1717f-046b-4c08-9776-84ba02839aeb for instance 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 on n-h1-849328-3 Aug 24 10:24:43.558678 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-e0f17ea2-5bc3-4e50-87be-389376435378 req-4ff2dac5-fd27-4593-92eb-d775309288c4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.089358 Aug 24 10:24:43.560325 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1644/2954] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:24:43.568951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a35b8b2f-47f8-4f39-b527-c5d542af8d74 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:43.570099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a35b8b2f-47f8-4f39-b527-c5d542af8d74 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:43.579685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a35b8b2f-47f8-4f39-b527-c5d542af8d74 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:43.580431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a35b8b2f-47f8-4f39-b527-c5d542af8d74 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:43.581214 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a35b8b2f-47f8-4f39-b527-c5d542af8d74 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:43.582927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a35b8b2f-47f8-4f39-b527-c5d542af8d74 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:43.583815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a35b8b2f-47f8-4f39-b527-c5d542af8d74 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:43.584518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a35b8b2f-47f8-4f39-b527-c5d542af8d74 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:43.664232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-59531493-6b34-4a15-b8cd-f8e049c465eb tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:43.699856 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-59531493-6b34-4a15-b8cd-f8e049c465eb tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6" status: 200 len: 1346 microversion: 2.1 time: 0.360454 Aug 24 10:24:43.717259 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1311/2955] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:43 2022] GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 => generated 1346 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:43.726831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a35b8b2f-47f8-4f39-b527-c5d542af8d74 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:43.736954 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a35b8b2f-47f8-4f39-b527-c5d542af8d74 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:43.738751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a35b8b2f-47f8-4f39-b527-c5d542af8d74 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:43.739866 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a35b8b2f-47f8-4f39-b527-c5d542af8d74 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1366 microversion: 2.57 time: 0.176561 Aug 24 10:24:43.740848 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1645/2956] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:43 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:44.054910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ec264c0b-dcc4-44ed-9b8b-29564cdfd0d9 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:44.056838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ec264c0b-dcc4-44ed-9b8b-29564cdfd0d9 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] [instance: 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:44.069992 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:44.074848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec264c0b-dcc4-44ed-9b8b-29564cdfd0d9 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:44.075398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec264c0b-dcc4-44ed-9b8b-29564cdfd0d9 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:44.080274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec264c0b-dcc4-44ed-9b8b-29564cdfd0d9 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:44.081619 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec264c0b-dcc4-44ed-9b8b-29564cdfd0d9 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:44.082281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec264c0b-dcc4-44ed-9b8b-29564cdfd0d9 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:44.086236 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec264c0b-dcc4-44ed-9b8b-29564cdfd0d9 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:44.354716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ec264c0b-dcc4-44ed-9b8b-29564cdfd0d9 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578a67fe95b3453cb7d6bc90acce0478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396c23b60923463b9a82af15a7dcf771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:44.371305 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ec264c0b-dcc4-44ed-9b8b-29564cdfd0d9 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] 10.222.0.85 "GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54" status: 200 len: 1313 microversion: 2.1 time: 0.321995 Aug 24 10:24:44.373362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-22d632a9-c31b-4127-ae7c-b9f82f72d60d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:44.373909 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1312/2957] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:44 2022] GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 => generated 1313 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:44.377270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-22d632a9-c31b-4127-ae7c-b9f82f72d60d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:44.418134 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22d632a9-c31b-4127-ae7c-b9f82f72d60d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:44.419160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22d632a9-c31b-4127-ae7c-b9f82f72d60d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:44.420046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22d632a9-c31b-4127-ae7c-b9f82f72d60d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:44.428618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22d632a9-c31b-4127-ae7c-b9f82f72d60d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:44.432226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22d632a9-c31b-4127-ae7c-b9f82f72d60d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:44.433855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22d632a9-c31b-4127-ae7c-b9f82f72d60d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:44.491823 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-408c09e5-cc07-4ade-9566-e9d4537eaf25 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:44.492796 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-408c09e5-cc07-4ade-9566-e9d4537eaf25 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:44.514482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-408c09e5-cc07-4ade-9566-e9d4537eaf25 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:44.515246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-408c09e5-cc07-4ade-9566-e9d4537eaf25 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:44.515847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-408c09e5-cc07-4ade-9566-e9d4537eaf25 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:44.516755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-408c09e5-cc07-4ade-9566-e9d4537eaf25 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:44.520324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-408c09e5-cc07-4ade-9566-e9d4537eaf25 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:44.520793 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-22d632a9-c31b-4127-ae7c-b9f82f72d60d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] HTTP exception thrown: Instance b0a30de6-ae02-49e5-87d5-558660bd9b1e could not be found. Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-22d632a9-c31b-4127-ae7c-b9f82f72d60d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Request method failure captured: Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e HTTP/1.1 Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfwP4tkKyJr5Gg7qNaTDv0qB585z-EGLWhAIlAiiw7niuSBtf4-Q9XJ2RClgHF5tG0tqoI1dsizKyw5H-SwLhXdRiM6qVR9NPoSFDWFDAiYHpCUOyNdaDsUmsdQydv3MYAQ3enYS0IGacLv6Rxy4kcYdhL4YEU_p2c-vtfjTt6PXS-o Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_44f050698fc54fb6b8fdf2866472dd7d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/44f050698fc54fb6b8fdf2866472dd7d"}]}] Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: cf7304a4a0bb486fbf52f1c84cad702a Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance b0a30de6-ae02-49e5-87d5-558660bd9b1e could not be found. Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'b0a30de6-ae02-49e5-87d5-558660bd9b1e'} Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0a30de6-ae02-49e5-87d5-558660bd9b1e could not be found. Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0a30de6-ae02-49e5-87d5-558660bd9b1e could not be found. Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:44.524496 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:44.531587 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:44.531587 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:44.531587 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:44.531587 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:44.531587 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:44.531587 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0a30de6-ae02-49e5-87d5-558660bd9b1e could not be found. Aug 24 10:24:44.531587 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:44.531587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-22d632a9-c31b-4127-ae7c-b9f82f72d60d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Returning 404 to user: Instance b0a30de6-ae02-49e5-87d5-558660bd9b1e could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:44.532513 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-22d632a9-c31b-4127-ae7c-b9f82f72d60d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e" status: 404 len: 111 microversion: 2.1 time: 0.172903 Aug 24 10:24:44.533698 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-408c09e5-cc07-4ade-9566-e9d4537eaf25 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:44.537386 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1646/2958] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:44 2022] GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:24:44.546204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ccd20c74-d242-4f8b-b4bc-c5dc1ac97b79 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '.version_select at 0x7f4647d53310>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:44.667332 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:44.746077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=14 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:45.290739 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-408c09e5-cc07-4ade-9566-e9d4537eaf25 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:45.310942 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-408c09e5-cc07-4ade-9566-e9d4537eaf25 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 200 len: 1314 microversion: 2.1 time: 0.825650 Aug 24 10:24:45.321473 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1313/2959] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:44 2022] GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 1314 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:24:45.328542 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32bfe404-7d3f-49c6-878d-0ab775e7b2a0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:45.329876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-32bfe404-7d3f-49c6-878d-0ab775e7b2a0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:45.363568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32bfe404-7d3f-49c6-878d-0ab775e7b2a0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:45.372773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32bfe404-7d3f-49c6-878d-0ab775e7b2a0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:45.373840 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32bfe404-7d3f-49c6-878d-0ab775e7b2a0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:45.375201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32bfe404-7d3f-49c6-878d-0ab775e7b2a0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:45.376499 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32bfe404-7d3f-49c6-878d-0ab775e7b2a0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:45.377540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32bfe404-7d3f-49c6-878d-0ab775e7b2a0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:45.389224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:45.721050 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ccd20c74-d242-4f8b-b4bc-c5dc1ac97b79 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/5ee9f659-096c-43d5-8ff9-0183fd9c2519" status: 202 len: 0 microversion: 2.1 time: 1.179594 Aug 24 10:24:45.722377 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1647/2960] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:24:44 2022] DELETE /compute/v2.1/os-security-groups/5ee9f659-096c-43d5-8ff9-0183fd9c2519 => generated 0 bytes in 1181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:24:45.730811 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7fdc9a72-6105-48f7-be8b-ee53fbd95aa3 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:45.732335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7fdc9a72-6105-48f7-be8b-ee53fbd95aa3 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:45.745693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7fdc9a72-6105-48f7-be8b-ee53fbd95aa3 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:45.750386 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7fdc9a72-6105-48f7-be8b-ee53fbd95aa3 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:45.751176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7fdc9a72-6105-48f7-be8b-ee53fbd95aa3 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:45.752541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7fdc9a72-6105-48f7-be8b-ee53fbd95aa3 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:45.753327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7fdc9a72-6105-48f7-be8b-ee53fbd95aa3 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:45.754024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7fdc9a72-6105-48f7-be8b-ee53fbd95aa3 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:45.788180 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-32bfe404-7d3f-49c6-878d-0ab775e7b2a0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:45.818423 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-32bfe404-7d3f-49c6-878d-0ab775e7b2a0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6" status: 200 len: 1346 microversion: 2.1 time: 0.495078 Aug 24 10:24:45.849984 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1314/2961] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:45 2022] GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 => generated 1346 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:45.866075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e8616000-21e2-490c-81c8-c37f4f6dca8d tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:45.873385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e8616000-21e2-490c-81c8-c37f4f6dca8d tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] [instance: 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:45.882438 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:45.886098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8616000-21e2-490c-81c8-c37f4f6dca8d tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:45.886787 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8616000-21e2-490c-81c8-c37f4f6dca8d tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:45.887694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8616000-21e2-490c-81c8-c37f4f6dca8d tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:45.888832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8616000-21e2-490c-81c8-c37f4f6dca8d tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:45.889523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8616000-21e2-490c-81c8-c37f4f6dca8d tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:45.890250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8616000-21e2-490c-81c8-c37f4f6dca8d tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:46.003820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7fdc9a72-6105-48f7-be8b-ee53fbd95aa3 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:46.065884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7fdc9a72-6105-48f7-be8b-ee53fbd95aa3 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:46.067587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7fdc9a72-6105-48f7-be8b-ee53fbd95aa3 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:46.068774 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7fdc9a72-6105-48f7-be8b-ee53fbd95aa3 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1366 microversion: 2.57 time: 0.345275 Aug 24 10:24:46.069407 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1648/2962] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:45 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1366 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:46.091601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cc2c40bc-a552-48e4-85be-2443b8b951cc tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '.version_select at 0x7f4647d53940>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:46.327415 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e8616000-21e2-490c-81c8-c37f4f6dca8d tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578a67fe95b3453cb7d6bc90acce0478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396c23b60923463b9a82af15a7dcf771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:46.342695 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e8616000-21e2-490c-81c8-c37f4f6dca8d tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] 10.222.0.85 "GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54" status: 200 len: 1313 microversion: 2.1 time: 0.491102 Aug 24 10:24:46.347605 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1315/2963] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:45 2022] GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 => generated 1313 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:46.360239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-79471f96-01a7-437f-8e98-af702c343fe3 req-593f37ad-1a1f-4ba1-850a-a4341fd51ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dc626f8-e0ea-469a-bacb-a6e79c0e8d54", "name": "network-vif-plugged", "status": "completed", "tag": "20c7b980-98a4-450e-a121-ad8a54c69575"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:46.399904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-79471f96-01a7-437f-8e98-af702c343fe3 req-593f37ad-1a1f-4ba1-850a-a4341fd51ff3 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:46.400394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-79471f96-01a7-437f-8e98-af702c343fe3 req-593f37ad-1a1f-4ba1-850a-a4341fd51ff3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:46.400825 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-79471f96-01a7-437f-8e98-af702c343fe3 req-593f37ad-1a1f-4ba1-850a-a4341fd51ff3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:46.434531 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-79471f96-01a7-437f-8e98-af702c343fe3 req-593f37ad-1a1f-4ba1-850a-a4341fd51ff3 service nova] Creating event network-vif-plugged:20c7b980-98a4-450e-a121-ad8a54c69575 for instance 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 on n-h2-849328-3 Aug 24 10:24:46.459598 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-79471f96-01a7-437f-8e98-af702c343fe3 req-593f37ad-1a1f-4ba1-850a-a4341fd51ff3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107887 Aug 24 10:24:46.461625 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1316/2964] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:24:46.468353 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-847dcca7-aca8-4e5e-b13a-0cb0cd6a52b6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:46.470862 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-847dcca7-aca8-4e5e-b13a-0cb0cd6a52b6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:46.494255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-847dcca7-aca8-4e5e-b13a-0cb0cd6a52b6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:46.497583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-847dcca7-aca8-4e5e-b13a-0cb0cd6a52b6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:46.498261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-847dcca7-aca8-4e5e-b13a-0cb0cd6a52b6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:46.499175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-847dcca7-aca8-4e5e-b13a-0cb0cd6a52b6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:46.499809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-847dcca7-aca8-4e5e-b13a-0cb0cd6a52b6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:46.500399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-847dcca7-aca8-4e5e-b13a-0cb0cd6a52b6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:47.526731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-847dcca7-aca8-4e5e-b13a-0cb0cd6a52b6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:47.543494 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-847dcca7-aca8-4e5e-b13a-0cb0cd6a52b6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 200 len: 1314 microversion: 2.1 time: 1.080130 Aug 24 10:24:47.559449 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1317/2965] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:46 2022] GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 1314 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:47.573915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d5d28fab-19e5-4f2f-9b01-5b0d9b40b6db tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:47.576650 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d5d28fab-19e5-4f2f-9b01-5b0d9b40b6db tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:47.591389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5d28fab-19e5-4f2f-9b01-5b0d9b40b6db tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:47.592430 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5d28fab-19e5-4f2f-9b01-5b0d9b40b6db tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:47.594292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5d28fab-19e5-4f2f-9b01-5b0d9b40b6db tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:47.598478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5d28fab-19e5-4f2f-9b01-5b0d9b40b6db tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:47.599479 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5d28fab-19e5-4f2f-9b01-5b0d9b40b6db tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:47.600329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5d28fab-19e5-4f2f-9b01-5b0d9b40b6db tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:47.748235 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cc2c40bc-a552-48e4-85be-2443b8b951cc tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/ac3b7da7-9123-404b-bef4-5513b66b6424" status: 202 len: 0 microversion: 2.1 time: 1.668818 Aug 24 10:24:47.749172 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1649/2966] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:24:46 2022] DELETE /compute/v2.1/os-security-groups/ac3b7da7-9123-404b-bef4-5513b66b6424 => generated 0 bytes in 1670 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:24:47.756748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-38786119-b26b-4da4-8d37-6ad0c714cbe1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:47.757398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-38786119-b26b-4da4-8d37-6ad0c714cbe1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:47.772255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38786119-b26b-4da4-8d37-6ad0c714cbe1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:47.776635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38786119-b26b-4da4-8d37-6ad0c714cbe1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:47.777209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38786119-b26b-4da4-8d37-6ad0c714cbe1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:47.778392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38786119-b26b-4da4-8d37-6ad0c714cbe1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:47.778929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38786119-b26b-4da4-8d37-6ad0c714cbe1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:47.783486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38786119-b26b-4da4-8d37-6ad0c714cbe1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:47.784068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d5d28fab-19e5-4f2f-9b01-5b0d9b40b6db tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:47.807886 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d5d28fab-19e5-4f2f-9b01-5b0d9b40b6db tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6" status: 200 len: 1346 microversion: 2.1 time: 0.246792 Aug 24 10:24:47.811917 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1318/2967] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:47 2022] GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 => generated 1346 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:47.836530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7d33a09c-e0f0-4a7e-b33f-eda950613504 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:47.839759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7d33a09c-e0f0-4a7e-b33f-eda950613504 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] [instance: 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:47.853450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d33a09c-e0f0-4a7e-b33f-eda950613504 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:47.856454 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d33a09c-e0f0-4a7e-b33f-eda950613504 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:47.857212 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d33a09c-e0f0-4a7e-b33f-eda950613504 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:47.864348 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d33a09c-e0f0-4a7e-b33f-eda950613504 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:47.865667 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d33a09c-e0f0-4a7e-b33f-eda950613504 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:47.866757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d33a09c-e0f0-4a7e-b33f-eda950613504 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:48.220378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-38786119-b26b-4da4-8d37-6ad0c714cbe1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:48.247382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-38786119-b26b-4da4-8d37-6ad0c714cbe1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:48.248867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-38786119-b26b-4da4-8d37-6ad0c714cbe1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:48.250398 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-38786119-b26b-4da4-8d37-6ad0c714cbe1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1366 microversion: 2.57 time: 0.500172 Aug 24 10:24:48.251093 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1650/2968] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:47 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1366 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:48.257324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6fe2aa5b-d0f6-4e7e-882a-5259772b4356 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Action: 'create', calling method: .version_select at 0x7f4647d53550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1514590067", "description": "tempest-description-987985884"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:48.333405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7d33a09c-e0f0-4a7e-b33f-eda950613504 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578a67fe95b3453cb7d6bc90acce0478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396c23b60923463b9a82af15a7dcf771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:48.360779 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7d33a09c-e0f0-4a7e-b33f-eda950613504 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] 10.222.0.85 "GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54" status: 200 len: 1313 microversion: 2.1 time: 0.528691 Aug 24 10:24:48.362101 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1319/2969] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:47 2022] GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 => generated 1313 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:48.566769 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ab9738c2-12c8-47b9-9c58-b81058f4bb37 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:48.567753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ab9738c2-12c8-47b9-9c58-b81058f4bb37 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:48.577091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab9738c2-12c8-47b9-9c58-b81058f4bb37 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:48.577637 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab9738c2-12c8-47b9-9c58-b81058f4bb37 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:48.578339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab9738c2-12c8-47b9-9c58-b81058f4bb37 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:48.579091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab9738c2-12c8-47b9-9c58-b81058f4bb37 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:48.579550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab9738c2-12c8-47b9-9c58-b81058f4bb37 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:48.579978 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab9738c2-12c8-47b9-9c58-b81058f4bb37 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:49.102368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ab9738c2-12c8-47b9-9c58-b81058f4bb37 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:49.126958 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ab9738c2-12c8-47b9-9c58-b81058f4bb37 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 200 len: 1314 microversion: 2.1 time: 0.566476 Aug 24 10:24:49.132728 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1320/2970] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:48 2022] GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:24:49.148729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f3b9a46f-d561-440e-92e5-09116f2b5683 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:49.149776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f3b9a46f-d561-440e-92e5-09116f2b5683 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:49.162304 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3b9a46f-d561-440e-92e5-09116f2b5683 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:49.163173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3b9a46f-d561-440e-92e5-09116f2b5683 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:49.163876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3b9a46f-d561-440e-92e5-09116f2b5683 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:49.164827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3b9a46f-d561-440e-92e5-09116f2b5683 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:49.165558 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3b9a46f-d561-440e-92e5-09116f2b5683 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:49.166207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3b9a46f-d561-440e-92e5-09116f2b5683 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:49.432572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f3b9a46f-d561-440e-92e5-09116f2b5683 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:49.478197 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f3b9a46f-d561-440e-92e5-09116f2b5683 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6" status: 200 len: 1346 microversion: 2.1 time: 0.338314 Aug 24 10:24:49.481303 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1321/2971] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:49 2022] GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 => generated 1346 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:49.496300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-94ed02a4-43e0-4d26-8ce8-2c3989a84ccf tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:49.497363 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-94ed02a4-43e0-4d26-8ce8-2c3989a84ccf tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:49.512752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94ed02a4-43e0-4d26-8ce8-2c3989a84ccf tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:49.513400 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94ed02a4-43e0-4d26-8ce8-2c3989a84ccf tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:49.513843 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94ed02a4-43e0-4d26-8ce8-2c3989a84ccf tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:49.518980 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94ed02a4-43e0-4d26-8ce8-2c3989a84ccf tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:49.519515 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94ed02a4-43e0-4d26-8ce8-2c3989a84ccf tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:49.521408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94ed02a4-43e0-4d26-8ce8-2c3989a84ccf tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:49.764146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-94ed02a4-43e0-4d26-8ce8-2c3989a84ccf tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:49.788308 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-94ed02a4-43e0-4d26-8ce8-2c3989a84ccf tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:49.789848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-94ed02a4-43e0-4d26-8ce8-2c3989a84ccf tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:49.791058 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-94ed02a4-43e0-4d26-8ce8-2c3989a84ccf tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1366 microversion: 2.57 time: 0.308106 Aug 24 10:24:49.797065 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1322/2972] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:49 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1366 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:49.811134 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cad94bc8-549e-4a6b-acd1-8f57c2cc726a tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:49.811775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cad94bc8-549e-4a6b-acd1-8f57c2cc726a tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] [instance: 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:49.826110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cad94bc8-549e-4a6b-acd1-8f57c2cc726a tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:49.826645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cad94bc8-549e-4a6b-acd1-8f57c2cc726a tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:49.830131 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cad94bc8-549e-4a6b-acd1-8f57c2cc726a tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:49.831589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cad94bc8-549e-4a6b-acd1-8f57c2cc726a tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:49.835101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cad94bc8-549e-4a6b-acd1-8f57c2cc726a tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:49.840506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cad94bc8-549e-4a6b-acd1-8f57c2cc726a tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:49.933078 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6fe2aa5b-d0f6-4e7e-882a-5259772b4356 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.680185 Aug 24 10:24:49.933776 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1651/2973] 10.222.0.85 () {60 vars in 1180 bytes} [Wed Aug 24 10:24:48 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:24:49.946780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-71fbd89c-ae13-40ba-b645-f10fba86cd10 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Action: 'update', calling method: .version_select at 0x7f4647d1c160>, body: {"security_group": {"name": "tempest-sg-hth-1124710365", "description": "tempest-description-hth-809158625"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:50.212433 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cad94bc8-549e-4a6b-acd1-8f57c2cc726a tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578a67fe95b3453cb7d6bc90acce0478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396c23b60923463b9a82af15a7dcf771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:50.221967 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cad94bc8-549e-4a6b-acd1-8f57c2cc726a tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] 10.222.0.85 "GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54" status: 200 len: 1462 microversion: 2.1 time: 0.423637 Aug 24 10:24:50.240125 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1323/2974] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:49 2022] GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 => generated 1462 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:50.240125 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd09e6f7-0b8e-4b82-91e5-14e45b5ed0e9 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:50.240125 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dd09e6f7-0b8e-4b82-91e5-14e45b5ed0e9 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:50.251630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd09e6f7-0b8e-4b82-91e5-14e45b5ed0e9 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:50.251630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd09e6f7-0b8e-4b82-91e5-14e45b5ed0e9 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:50.251630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd09e6f7-0b8e-4b82-91e5-14e45b5ed0e9 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:50.251630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd09e6f7-0b8e-4b82-91e5-14e45b5ed0e9 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:50.251630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd09e6f7-0b8e-4b82-91e5-14e45b5ed0e9 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:50.251630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd09e6f7-0b8e-4b82-91e5-14e45b5ed0e9 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:50.422106 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-71fbd89c-ae13-40ba-b645-f10fba86cd10 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "PUT /compute/v2.1/os-security-groups/bf0d0a43-55be-464b-bbbc-60a4624df46e" status: 200 len: 217 microversion: 2.1 time: 0.478899 Aug 24 10:24:50.423380 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1652/2975] 10.222.0.85 () {60 vars in 1290 bytes} [Wed Aug 24 10:24:49 2022] PUT /compute/v2.1/os-security-groups/bf0d0a43-55be-464b-bbbc-60a4624df46e => generated 217 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:24:50.808690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dd09e6f7-0b8e-4b82-91e5-14e45b5ed0e9 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:50.832781 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dd09e6f7-0b8e-4b82-91e5-14e45b5ed0e9 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 200 len: 1314 microversion: 2.1 time: 0.605132 Aug 24 10:24:50.836988 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1324/2976] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:50 2022] GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 1314 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:50.867922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ca284270-471c-4558-b890-a5417613597d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '.version_select at 0x7f4655039ca0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:50.957853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5d10907c-f2a4-4a5e-9fe0-9118fcb6df39 tempest-TenantUsagesTestJSON-1005968454 tempest-TenantUsagesTestJSON-1005968454-project-admin] Calling method '.version_select at 0x7f4647d1c430>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:50.996940 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d10907c-f2a4-4a5e-9fe0-9118fcb6df39 tempest-TenantUsagesTestJSON-1005968454 tempest-TenantUsagesTestJSON-1005968454-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:51.003451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d10907c-f2a4-4a5e-9fe0-9118fcb6df39 tempest-TenantUsagesTestJSON-1005968454 tempest-TenantUsagesTestJSON-1005968454-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:51.003964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d10907c-f2a4-4a5e-9fe0-9118fcb6df39 tempest-TenantUsagesTestJSON-1005968454 tempest-TenantUsagesTestJSON-1005968454-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:51.044664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d10907c-f2a4-4a5e-9fe0-9118fcb6df39 tempest-TenantUsagesTestJSON-1005968454 tempest-TenantUsagesTestJSON-1005968454-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:51.051235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d10907c-f2a4-4a5e-9fe0-9118fcb6df39 tempest-TenantUsagesTestJSON-1005968454 tempest-TenantUsagesTestJSON-1005968454-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:51.052352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d10907c-f2a4-4a5e-9fe0-9118fcb6df39 tempest-TenantUsagesTestJSON-1005968454 tempest-TenantUsagesTestJSON-1005968454-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:51.124097 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5d10907c-f2a4-4a5e-9fe0-9118fcb6df39 tempest-TenantUsagesTestJSON-1005968454 tempest-TenantUsagesTestJSON-1005968454-project-admin] 10.222.0.85 "GET /compute/v2.1/os-simple-tenant-usage/396c23b60923463b9a82af15a7dcf771?start=2022-08-23T10%3A24%3A50.255564&end=2022-08-25T10%3A24%3A50.255564" status: 200 len: 694 microversion: 2.1 time: 0.695313 Aug 24 10:24:51.139412 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1653/2977] 10.222.0.85 () {58 vars in 1412 bytes} [Wed Aug 24 10:24:50 2022] GET /compute/v2.1/os-simple-tenant-usage/396c23b60923463b9a82af15a7dcf771?start=2022-08-23T10%3A24%3A50.255564&end=2022-08-25T10%3A24%3A50.255564 => generated 694 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:24:51.161639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c11be1d5-26ce-4a82-b65c-3b24725c43a7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:51.164821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c11be1d5-26ce-4a82-b65c-3b24725c43a7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:51.188226 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ca284270-471c-4558-b890-a5417613597d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/os-security-groups/bf0d0a43-55be-464b-bbbc-60a4624df46e" status: 200 len: 217 microversion: 2.1 time: 0.343616 Aug 24 10:24:51.200203 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1325/2978] 10.222.0.85 () {58 vars in 1269 bytes} [Wed Aug 24 10:24:50 2022] GET /compute/v2.1/os-security-groups/bf0d0a43-55be-464b-bbbc-60a4624df46e => generated 217 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:24:51.200203 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c70fdd6b-3c68-43f3-9cbf-a816948022a4 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:51.200203 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c70fdd6b-3c68-43f3-9cbf-a816948022a4 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:51.241695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c11be1d5-26ce-4a82-b65c-3b24725c43a7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:51.243794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c11be1d5-26ce-4a82-b65c-3b24725c43a7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:51.244177 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c70fdd6b-3c68-43f3-9cbf-a816948022a4 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:51.246094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c11be1d5-26ce-4a82-b65c-3b24725c43a7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:51.247801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c70fdd6b-3c68-43f3-9cbf-a816948022a4 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:51.249801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c70fdd6b-3c68-43f3-9cbf-a816948022a4 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:51.250651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c11be1d5-26ce-4a82-b65c-3b24725c43a7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:51.253876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c70fdd6b-3c68-43f3-9cbf-a816948022a4 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:51.254544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c11be1d5-26ce-4a82-b65c-3b24725c43a7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:51.255854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c11be1d5-26ce-4a82-b65c-3b24725c43a7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:51.256469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c70fdd6b-3c68-43f3-9cbf-a816948022a4 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:51.258132 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c70fdd6b-3c68-43f3-9cbf-a816948022a4 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:51.459533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c11be1d5-26ce-4a82-b65c-3b24725c43a7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:51.517457 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c11be1d5-26ce-4a82-b65c-3b24725c43a7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6" status: 200 len: 1346 microversion: 2.1 time: 0.371377 Aug 24 10:24:51.526118 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1654/2979] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:51 2022] GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 => generated 1346 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:51.545431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c70fdd6b-3c68-43f3-9cbf-a816948022a4 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:51.546310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-06b838b0-c79a-4e98-9845-7ece690a6540 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Calling method '.version_select at 0x7f4647d535e0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:51.555588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c70fdd6b-3c68-43f3-9cbf-a816948022a4 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:51.566231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06b838b0-c79a-4e98-9845-7ece690a6540 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:51.573286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06b838b0-c79a-4e98-9845-7ece690a6540 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:51.573969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06b838b0-c79a-4e98-9845-7ece690a6540 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:51.578883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c70fdd6b-3c68-43f3-9cbf-a816948022a4 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:51.582234 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c70fdd6b-3c68-43f3-9cbf-a816948022a4 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1366 microversion: 2.57 time: 0.391117 Aug 24 10:24:51.596533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06b838b0-c79a-4e98-9845-7ece690a6540 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:51.604603 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1326/2980] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:51 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1366 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:51.605264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06b838b0-c79a-4e98-9845-7ece690a6540 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:51.605909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06b838b0-c79a-4e98-9845-7ece690a6540 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:51.614667 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8b9ff8cd-9d99-42b1-96bf-ade53b82c0e1 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '.version_select at 0x7f46550f2790>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:51.651736 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-06b838b0-c79a-4e98-9845-7ece690a6540 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] 10.222.0.85 "GET /compute/v2.1/os-simple-tenant-usage/396c23b60923463b9a82af15a7dcf771?start=2022-08-23T10%3A24%3A50.255564&end=2022-08-25T10%3A24%3A50.255564" status: 200 len: 694 microversion: 2.1 time: 0.123342 Aug 24 10:24:51.652869 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1655/2981] 10.222.0.85 () {58 vars in 1412 bytes} [Wed Aug 24 10:24:51 2022] GET /compute/v2.1/os-simple-tenant-usage/396c23b60923463b9a82af15a7dcf771?start=2022-08-23T10%3A24%3A50.255564&end=2022-08-25T10%3A24%3A50.255564 => generated 694 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:24:51.687379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d66cc907-0560-4be7-83f7-2dcceb07876b tempest-TenantUsagesTestJSON-1005968454 tempest-TenantUsagesTestJSON-1005968454-project-admin] Calling method '.version_select at 0x7f4647d531f0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:51.728382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d66cc907-0560-4be7-83f7-2dcceb07876b tempest-TenantUsagesTestJSON-1005968454 tempest-TenantUsagesTestJSON-1005968454-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:51.729852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d66cc907-0560-4be7-83f7-2dcceb07876b tempest-TenantUsagesTestJSON-1005968454 tempest-TenantUsagesTestJSON-1005968454-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:51.732389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d66cc907-0560-4be7-83f7-2dcceb07876b tempest-TenantUsagesTestJSON-1005968454 tempest-TenantUsagesTestJSON-1005968454-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:51.774666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d66cc907-0560-4be7-83f7-2dcceb07876b tempest-TenantUsagesTestJSON-1005968454 tempest-TenantUsagesTestJSON-1005968454-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:51.775176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d66cc907-0560-4be7-83f7-2dcceb07876b tempest-TenantUsagesTestJSON-1005968454 tempest-TenantUsagesTestJSON-1005968454-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:51.775621 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d66cc907-0560-4be7-83f7-2dcceb07876b tempest-TenantUsagesTestJSON-1005968454 tempest-TenantUsagesTestJSON-1005968454-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:52.097812 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d66cc907-0560-4be7-83f7-2dcceb07876b tempest-TenantUsagesTestJSON-1005968454 tempest-TenantUsagesTestJSON-1005968454-project-admin] 10.222.0.85 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-23T10%3A24%3A50.255564&end=2022-08-25T10%3A24%3A50.255564&detailed=1" status: 200 len: 37020 microversion: 2.1 time: 0.423557 Aug 24 10:24:52.113922 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1656/2982] 10.222.0.85 () {58 vars in 1335 bytes} [Wed Aug 24 10:24:51 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-23T10%3A24%3A50.255564&end=2022-08-25T10%3A24%3A50.255564&detailed=1 => generated 37020 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:24:52.149923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9381287b-952c-49db-a36c-8955a13fb1c5 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:52.150684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9381287b-952c-49db-a36c-8955a13fb1c5 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:52.161764 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9381287b-952c-49db-a36c-8955a13fb1c5 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:52.162699 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9381287b-952c-49db-a36c-8955a13fb1c5 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:52.163318 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9381287b-952c-49db-a36c-8955a13fb1c5 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:52.164274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9381287b-952c-49db-a36c-8955a13fb1c5 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:52.165163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9381287b-952c-49db-a36c-8955a13fb1c5 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:52.165920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9381287b-952c-49db-a36c-8955a13fb1c5 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:52.693576 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8b9ff8cd-9d99-42b1-96bf-ade53b82c0e1 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/bf0d0a43-55be-464b-bbbc-60a4624df46e" status: 202 len: 0 microversion: 2.1 time: 1.086505 Aug 24 10:24:52.694872 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1327/2983] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:24:51 2022] DELETE /compute/v2.1/os-security-groups/bf0d0a43-55be-464b-bbbc-60a4624df46e => generated 0 bytes in 1089 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:24:52.702240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-76a00261-3b26-4cb9-975c-773a5ca022be tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:52.702752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-76a00261-3b26-4cb9-975c-773a5ca022be tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] [instance: 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:52.724488 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76a00261-3b26-4cb9-975c-773a5ca022be tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:52.725374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76a00261-3b26-4cb9-975c-773a5ca022be tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:52.730808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76a00261-3b26-4cb9-975c-773a5ca022be tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:52.732154 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76a00261-3b26-4cb9-975c-773a5ca022be tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:52.732812 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76a00261-3b26-4cb9-975c-773a5ca022be tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:52.733467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76a00261-3b26-4cb9-975c-773a5ca022be tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:52.803745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9381287b-952c-49db-a36c-8955a13fb1c5 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:52.835275 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9381287b-952c-49db-a36c-8955a13fb1c5 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 200 len: 1314 microversion: 2.1 time: 0.719440 Aug 24 10:24:52.838885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-76a00261-3b26-4cb9-975c-773a5ca022be tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] [instance: 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:24:52.840341 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1657/2984] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:52 2022] GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 1314 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:52.854906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-976d56fe-d342-484b-8376-986b36b1c485 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:52.866631 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-976d56fe-d342-484b-8376-986b36b1c485 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:52.883158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-976d56fe-d342-484b-8376-986b36b1c485 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:52.886316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-976d56fe-d342-484b-8376-986b36b1c485 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:52.891165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-976d56fe-d342-484b-8376-986b36b1c485 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:52.896229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-976d56fe-d342-484b-8376-986b36b1c485 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:52.897612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-976d56fe-d342-484b-8376-986b36b1c485 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:52.898705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-976d56fe-d342-484b-8376-986b36b1c485 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:53.044050 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-76a00261-3b26-4cb9-975c-773a5ca022be tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] 10.222.0.85 "DELETE /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54" status: 204 len: 0 microversion: 2.1 time: 0.346163 Aug 24 10:24:53.044829 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1328/2985] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:24:52 2022] DELETE /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:53.051604 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-479ed62f-644c-4ee1-9f6c-5476615d4ef1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:53.052607 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-479ed62f-644c-4ee1-9f6c-5476615d4ef1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:53.062224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-479ed62f-644c-4ee1-9f6c-5476615d4ef1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:53.063056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-479ed62f-644c-4ee1-9f6c-5476615d4ef1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:53.063808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-479ed62f-644c-4ee1-9f6c-5476615d4ef1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:53.064988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-479ed62f-644c-4ee1-9f6c-5476615d4ef1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:53.066141 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-479ed62f-644c-4ee1-9f6c-5476615d4ef1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:53.067088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-479ed62f-644c-4ee1-9f6c-5476615d4ef1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:53.071339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-976d56fe-d342-484b-8376-986b36b1c485 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:53.072288 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-976d56fe-d342-484b-8376-986b36b1c485 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:53.078503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-976d56fe-d342-484b-8376-986b36b1c485 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:53.079467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-976d56fe-d342-484b-8376-986b36b1c485 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lazy-loading 'fault' on Instance uuid 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:24:53.211754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-479ed62f-644c-4ee1-9f6c-5476615d4ef1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:53.237164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-479ed62f-644c-4ee1-9f6c-5476615d4ef1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:53.241274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-479ed62f-644c-4ee1-9f6c-5476615d4ef1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:53.251845 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-479ed62f-644c-4ee1-9f6c-5476615d4ef1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1366 microversion: 2.57 time: 0.205372 Aug 24 10:24:53.253141 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1329/2986] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:53 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:53.274064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-14e750d2-ce23-42f5-ba32-ee5589f44dce tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:53.274858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-14e750d2-ce23-42f5-ba32-ee5589f44dce tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:53.291259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14e750d2-ce23-42f5-ba32-ee5589f44dce tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:53.295704 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14e750d2-ce23-42f5-ba32-ee5589f44dce tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:53.296418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14e750d2-ce23-42f5-ba32-ee5589f44dce tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:53.297678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14e750d2-ce23-42f5-ba32-ee5589f44dce tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:53.298421 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14e750d2-ce23-42f5-ba32-ee5589f44dce tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:53.299168 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14e750d2-ce23-42f5-ba32-ee5589f44dce tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:53.338329 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-14e750d2-ce23-42f5-ba32-ee5589f44dce tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] HTTP exception thrown: Instance b0a30de6-ae02-49e5-87d5-558660bd9b1e could not be found. Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-14e750d2-ce23-42f5-ba32-ee5589f44dce tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Request method failure captured: Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e HTTP/1.1 Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfwP4tkKyJr5Gg7qNaTDv0qB585z-EGLWhAIlAiiw7niuSBtf4-Q9XJ2RClgHF5tG0tqoI1dsizKyw5H-SwLhXdRiM6qVR9NPoSFDWFDAiYHpCUOyNdaDsUmsdQydv3MYAQ3enYS0IGacLv6Rxy4kcYdhL4YEU_p2c-vtfjTt6PXS-o Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_44f050698fc54fb6b8fdf2866472dd7d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/44f050698fc54fb6b8fdf2866472dd7d"}]}] Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: cf7304a4a0bb486fbf52f1c84cad702a Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance b0a30de6-ae02-49e5-87d5-558660bd9b1e could not be found. Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'b0a30de6-ae02-49e5-87d5-558660bd9b1e'} Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0a30de6-ae02-49e5-87d5-558660bd9b1e could not be found. Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:24:53.340408 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:24:53.347661 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0a30de6-ae02-49e5-87d5-558660bd9b1e could not be found. Aug 24 10:24:53.347661 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:53.347661 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:53.347661 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:53.347661 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:53.347661 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:53.347661 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:53.347661 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:53.347661 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:53.347661 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0a30de6-ae02-49e5-87d5-558660bd9b1e could not be found. Aug 24 10:24:53.347661 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:53.347661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-14e750d2-ce23-42f5-ba32-ee5589f44dce tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Returning 404 to user: Instance b0a30de6-ae02-49e5-87d5-558660bd9b1e could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:53.358559 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-14e750d2-ce23-42f5-ba32-ee5589f44dce tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e" status: 404 len: 111 microversion: 2.1 time: 0.104504 Aug 24 10:24:53.368423 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1330/2987] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:24:53 2022] DELETE /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:24:53.377110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3d275179-3057-4bf9-8cbb-4df24bd00b54 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:53.378790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3d275179-3057-4bf9-8cbb-4df24bd00b54 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] [instance: 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:53.388594 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d275179-3057-4bf9-8cbb-4df24bd00b54 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:53.389510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d275179-3057-4bf9-8cbb-4df24bd00b54 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:53.390105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d275179-3057-4bf9-8cbb-4df24bd00b54 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:53.390864 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d275179-3057-4bf9-8cbb-4df24bd00b54 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:53.391334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d275179-3057-4bf9-8cbb-4df24bd00b54 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:53.391774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d275179-3057-4bf9-8cbb-4df24bd00b54 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:53.452376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-976d56fe-d342-484b-8376-986b36b1c485 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:53.471187 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-976d56fe-d342-484b-8376-986b36b1c485 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6" status: 200 len: 1305 microversion: 2.1 time: 0.628769 Aug 24 10:24:53.484874 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1658/2988] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:52 2022] GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 => generated 1305 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:53.484874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-410180c9-7657-43ab-a694-f1e8af1b57cb tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:53.484874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-410180c9-7657-43ab-a694-f1e8af1b57cb tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: b0a30de6-ae02-49e5-87d5-558660bd9b1e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:53.497258 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-410180c9-7657-43ab-a694-f1e8af1b57cb tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:53.497769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-410180c9-7657-43ab-a694-f1e8af1b57cb tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:53.498335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-410180c9-7657-43ab-a694-f1e8af1b57cb tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:53.499265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-410180c9-7657-43ab-a694-f1e8af1b57cb tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:53.499737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-410180c9-7657-43ab-a694-f1e8af1b57cb tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:53.500246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-410180c9-7657-43ab-a694-f1e8af1b57cb tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:53.550442 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-410180c9-7657-43ab-a694-f1e8af1b57cb tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] HTTP exception thrown: Instance b0a30de6-ae02-49e5-87d5-558660bd9b1e could not be found. Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-410180c9-7657-43ab-a694-f1e8af1b57cb tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Request method failure captured: Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e HTTP/1.1 Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfwP4tkKyJr5Gg7qNaTDv0qB585z-EGLWhAIlAiiw7niuSBtf4-Q9XJ2RClgHF5tG0tqoI1dsizKyw5H-SwLhXdRiM6qVR9NPoSFDWFDAiYHpCUOyNdaDsUmsdQydv3MYAQ3enYS0IGacLv6Rxy4kcYdhL4YEU_p2c-vtfjTt6PXS-o Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_44f050698fc54fb6b8fdf2866472dd7d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/44f050698fc54fb6b8fdf2866472dd7d"}]}] Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: cf7304a4a0bb486fbf52f1c84cad702a Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance b0a30de6-ae02-49e5-87d5-558660bd9b1e could not be found. Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'b0a30de6-ae02-49e5-87d5-558660bd9b1e'} Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0a30de6-ae02-49e5-87d5-558660bd9b1e could not be found. Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0a30de6-ae02-49e5-87d5-558660bd9b1e could not be found. Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:53.552481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:53.556508 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:53.556508 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:53.556508 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:53.556508 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:53.556508 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:53.556508 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0a30de6-ae02-49e5-87d5-558660bd9b1e could not be found. Aug 24 10:24:53.556508 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:53.556508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-410180c9-7657-43ab-a694-f1e8af1b57cb tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Returning 404 to user: Instance b0a30de6-ae02-49e5-87d5-558660bd9b1e could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:53.556508 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-410180c9-7657-43ab-a694-f1e8af1b57cb tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e" status: 404 len: 111 microversion: 2.1 time: 0.080855 Aug 24 10:24:53.565712 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1659/2989] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:53 2022] GET /compute/v2.1/servers/b0a30de6-ae02-49e5-87d5-558660bd9b1e => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:24:53.571652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1635966f-a76b-40b7-a7b6-568e88a18cff tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '.version_select at 0x7f4647df00d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:53.687120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG neutronclient.v2_0.client [None req-1635966f-a76b-40b7-a7b6-568e88a18cff tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ac3b7da7-9123-404b-bef4-5513b66b6424 does not exist", "detail": ""}} {{(pid=122433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 10:24:53.688042 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.security_group_api [None req-1635966f-a76b-40b7-a7b6-568e88a18cff tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Neutron security group ac3b7da7-9123-404b-bef4-5513b66b6424 not found {{(pid=122433) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 10:24:53.688895 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-1635966f-a76b-40b7-a7b6-568e88a18cff tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] HTTP exception thrown: Security group ac3b7da7-9123-404b-bef4-5513b66b6424 does not exist Aug 24 10:24:53.688895 n-d-849328-3 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-cf5cc0d9-a9c3-4372-a12f-f637c461128d'] Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1635966f-a76b-40b7-a7b6-568e88a18cff tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Request method failure captured: Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-security-groups/ac3b7da7-9123-404b-bef4-5513b66b6424 HTTP/1.1 Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfwP4tkKyJr5Gg7qNaTDv0qB585z-EGLWhAIlAiiw7niuSBtf4-Q9XJ2RClgHF5tG0tqoI1dsizKyw5H-SwLhXdRiM6qVR9NPoSFDWFDAiYHpCUOyNdaDsUmsdQydv3MYAQ3enYS0IGacLv6Rxy4kcYdhL4YEU_p2c-vtfjTt6PXS-o Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_44f050698fc54fb6b8fdf2866472dd7d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/44f050698fc54fb6b8fdf2866472dd7d"}]}] Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: cf7304a4a0bb486fbf52f1c84cad702a Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: exception: Security group ac3b7da7-9123-404b-bef4-5513b66b6424 does not exist Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-cf5cc0d9-a9c3-4372-a12f-f637c461128d'] Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'ac3b7da7-9123-404b-bef4-5513b66b6424'} Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 10:24:53.692620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ac3b7da7-9123-404b-bef4-5513b66b6424 does not exist Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf5cc0d9-a9c3-4372-a12f-f637c461128d'] Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ac3b7da7-9123-404b-bef4-5513b66b6424 does not exist Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf5cc0d9-a9c3-4372-a12f-f637c461128d'] Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ac3b7da7-9123-404b-bef4-5513b66b6424 does not exist Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf5cc0d9-a9c3-4372-a12f-f637c461128d'] Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ac3b7da7-9123-404b-bef4-5513b66b6424 does not exist Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf5cc0d9-a9c3-4372-a12f-f637c461128d'] Aug 24 10:24:53.697544 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:53.707070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1635966f-a76b-40b7-a7b6-568e88a18cff tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Returning 404 to user: Security group ac3b7da7-9123-404b-bef4-5513b66b6424 does not exist Aug 24 10:24:53.707070 n-d-849328-3 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-cf5cc0d9-a9c3-4372-a12f-f637c461128d'] {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:53.707070 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1635966f-a76b-40b7-a7b6-568e88a18cff tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/ac3b7da7-9123-404b-bef4-5513b66b6424" status: 404 len: 194 microversion: 2.1 time: 0.138001 Aug 24 10:24:53.712015 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1660/2990] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:24:53 2022] DELETE /compute/v2.1/os-security-groups/ac3b7da7-9123-404b-bef4-5513b66b6424 => generated 194 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:24:53.718282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-43c6b16c-02e3-48ef-9bfc-6cae724d19ce req-1defbbb3-f990-4cae-beb3-31f3111f219b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6cdec98-2454-4ba9-8859-25231e4e28ab", "name": "network-vif-plugged", "status": "completed", "tag": "d8ac64f8-d1a4-4fb4-aa57-201fbd4205c2"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:53.752266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-43c6b16c-02e3-48ef-9bfc-6cae724d19ce req-1defbbb3-f990-4cae-beb3-31f3111f219b service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:53.754262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-43c6b16c-02e3-48ef-9bfc-6cae724d19ce req-1defbbb3-f990-4cae-beb3-31f3111f219b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:53.755376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-43c6b16c-02e3-48ef-9bfc-6cae724d19ce req-1defbbb3-f990-4cae-beb3-31f3111f219b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:53.771935 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-43c6b16c-02e3-48ef-9bfc-6cae724d19ce req-1defbbb3-f990-4cae-beb3-31f3111f219b service nova] Creating event network-vif-plugged:d8ac64f8-d1a4-4fb4-aa57-201fbd4205c2 for instance d6cdec98-2454-4ba9-8859-25231e4e28ab on n-h2-849328-3 Aug 24 10:24:53.780003 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-43c6b16c-02e3-48ef-9bfc-6cae724d19ce req-1defbbb3-f990-4cae-beb3-31f3111f219b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065026 Aug 24 10:24:53.780934 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1661/2991] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:24:53.790680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4a084b7b-c326-4794-b69d-b4099f9c86e4 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '.version_select at 0x7f4647df0790>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:53.870635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG neutronclient.v2_0.client [None req-4a084b7b-c326-4794-b69d-b4099f9c86e4 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5ee9f659-096c-43d5-8ff9-0183fd9c2519 does not exist", "detail": ""}} {{(pid=122433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 10:24:53.872214 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.security_group_api [None req-4a084b7b-c326-4794-b69d-b4099f9c86e4 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Neutron security group 5ee9f659-096c-43d5-8ff9-0183fd9c2519 not found {{(pid=122433) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 10:24:53.872891 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-4a084b7b-c326-4794-b69d-b4099f9c86e4 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] HTTP exception thrown: Security group 5ee9f659-096c-43d5-8ff9-0183fd9c2519 does not exist Aug 24 10:24:53.872891 n-d-849328-3 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-b1a9554f-e7f6-4e47-af6c-e177927b50a4'] Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4a084b7b-c326-4794-b69d-b4099f9c86e4 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Request method failure captured: Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-security-groups/5ee9f659-096c-43d5-8ff9-0183fd9c2519 HTTP/1.1 Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfwP4tkKyJr5Gg7qNaTDv0qB585z-EGLWhAIlAiiw7niuSBtf4-Q9XJ2RClgHF5tG0tqoI1dsizKyw5H-SwLhXdRiM6qVR9NPoSFDWFDAiYHpCUOyNdaDsUmsdQydv3MYAQ3enYS0IGacLv6Rxy4kcYdhL4YEU_p2c-vtfjTt6PXS-o Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_44f050698fc54fb6b8fdf2866472dd7d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/44f050698fc54fb6b8fdf2866472dd7d"}]}] Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: cf7304a4a0bb486fbf52f1c84cad702a Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: exception: Security group 5ee9f659-096c-43d5-8ff9-0183fd9c2519 does not exist Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-b1a9554f-e7f6-4e47-af6c-e177927b50a4'] Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '5ee9f659-096c-43d5-8ff9-0183fd9c2519'} Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 10:24:53.876077 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5ee9f659-096c-43d5-8ff9-0183fd9c2519 does not exist Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1a9554f-e7f6-4e47-af6c-e177927b50a4'] Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5ee9f659-096c-43d5-8ff9-0183fd9c2519 does not exist Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1a9554f-e7f6-4e47-af6c-e177927b50a4'] Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5ee9f659-096c-43d5-8ff9-0183fd9c2519 does not exist Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1a9554f-e7f6-4e47-af6c-e177927b50a4'] Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5ee9f659-096c-43d5-8ff9-0183fd9c2519 does not exist Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1a9554f-e7f6-4e47-af6c-e177927b50a4'] Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4a084b7b-c326-4794-b69d-b4099f9c86e4 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Returning 404 to user: Security group 5ee9f659-096c-43d5-8ff9-0183fd9c2519 does not exist Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-b1a9554f-e7f6-4e47-af6c-e177927b50a4'] {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:53.880154 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4a084b7b-c326-4794-b69d-b4099f9c86e4 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/5ee9f659-096c-43d5-8ff9-0183fd9c2519" status: 404 len: 194 microversion: 2.1 time: 0.096359 Aug 24 10:24:53.882972 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1662/2992] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:24:53 2022] DELETE /compute/v2.1/os-security-groups/5ee9f659-096c-43d5-8ff9-0183fd9c2519 => generated 194 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:24:53.883629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3d275179-3057-4bf9-8cbb-4df24bd00b54 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578a67fe95b3453cb7d6bc90acce0478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396c23b60923463b9a82af15a7dcf771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:53.895663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3a95d704-d730-4365-859e-70a7f6ff89f3 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:53.896911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3a95d704-d730-4365-859e-70a7f6ff89f3 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:53.909809 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3d275179-3057-4bf9-8cbb-4df24bd00b54 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] 10.222.0.85 "GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54" status: 200 len: 1468 microversion: 2.1 time: 0.538975 Aug 24 10:24:53.922812 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1331/2993] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:53 2022] GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 => generated 1468 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:53.929964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a95d704-d730-4365-859e-70a7f6ff89f3 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:53.930612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a95d704-d730-4365-859e-70a7f6ff89f3 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:53.931138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a95d704-d730-4365-859e-70a7f6ff89f3 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:53.932059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a95d704-d730-4365-859e-70a7f6ff89f3 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:53.932698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a95d704-d730-4365-859e-70a7f6ff89f3 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:53.932698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a95d704-d730-4365-859e-70a7f6ff89f3 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:53.933641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c517a4b6-f965-4ed0-aed2-418377238892 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '.version_select at 0x7f4654f871f0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:54.059280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG neutronclient.v2_0.client [None req-c517a4b6-f965-4ed0-aed2-418377238892 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dde65f3a-6f8b-4789-9472-54cc7cfd8d4e does not exist", "detail": ""}} {{(pid=122432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 10:24:54.060215 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.security_group_api [None req-c517a4b6-f965-4ed0-aed2-418377238892 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Neutron security group dde65f3a-6f8b-4789-9472-54cc7cfd8d4e not found {{(pid=122432) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 10:24:54.061004 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-c517a4b6-f965-4ed0-aed2-418377238892 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] HTTP exception thrown: Security group dde65f3a-6f8b-4789-9472-54cc7cfd8d4e does not exist Aug 24 10:24:54.061004 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-0d8091f9-764a-41a8-9598-63558da23b4a'] Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c517a4b6-f965-4ed0-aed2-418377238892 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Request method failure captured: Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/os-security-groups/dde65f3a-6f8b-4789-9472-54cc7cfd8d4e HTTP/1.1 Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfwP4tkKyJr5Gg7qNaTDv0qB585z-EGLWhAIlAiiw7niuSBtf4-Q9XJ2RClgHF5tG0tqoI1dsizKyw5H-SwLhXdRiM6qVR9NPoSFDWFDAiYHpCUOyNdaDsUmsdQydv3MYAQ3enYS0IGacLv6Rxy4kcYdhL4YEU_p2c-vtfjTt6PXS-o Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_44f050698fc54fb6b8fdf2866472dd7d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/44f050698fc54fb6b8fdf2866472dd7d"}]}] Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: cf7304a4a0bb486fbf52f1c84cad702a Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: exception: Security group dde65f3a-6f8b-4789-9472-54cc7cfd8d4e does not exist Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-0d8091f9-764a-41a8-9598-63558da23b4a'] Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'dde65f3a-6f8b-4789-9472-54cc7cfd8d4e'} Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 10:24:54.063708 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dde65f3a-6f8b-4789-9472-54cc7cfd8d4e does not exist Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0d8091f9-764a-41a8-9598-63558da23b4a'] Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dde65f3a-6f8b-4789-9472-54cc7cfd8d4e does not exist Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0d8091f9-764a-41a8-9598-63558da23b4a'] Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dde65f3a-6f8b-4789-9472-54cc7cfd8d4e does not exist Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0d8091f9-764a-41a8-9598-63558da23b4a'] Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dde65f3a-6f8b-4789-9472-54cc7cfd8d4e does not exist Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0d8091f9-764a-41a8-9598-63558da23b4a'] Aug 24 10:24:54.069496 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.079366 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c517a4b6-f965-4ed0-aed2-418377238892 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Returning 404 to user: Security group dde65f3a-6f8b-4789-9472-54cc7cfd8d4e does not exist Aug 24 10:24:54.079366 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-0d8091f9-764a-41a8-9598-63558da23b4a'] {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:54.082427 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c517a4b6-f965-4ed0-aed2-418377238892 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/dde65f3a-6f8b-4789-9472-54cc7cfd8d4e" status: 404 len: 194 microversion: 2.1 time: 0.158287 Aug 24 10:24:54.083439 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1332/2994] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:24:53 2022] DELETE /compute/v2.1/os-security-groups/dde65f3a-6f8b-4789-9472-54cc7cfd8d4e => generated 194 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:24:54.110308 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-827191ac-79f5-4db3-af97-e8d093a30bf0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '.version_select at 0x7f465421f820>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:54.251744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG neutronclient.v2_0.client [None req-827191ac-79f5-4db3-af97-e8d093a30bf0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1c841ab2-527b-4954-bc74-48dc678cd13d does not exist", "detail": ""}} {{(pid=122432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 10:24:54.252475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.security_group_api [None req-827191ac-79f5-4db3-af97-e8d093a30bf0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Neutron security group 1c841ab2-527b-4954-bc74-48dc678cd13d not found {{(pid=122432) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 10:24:54.253161 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-827191ac-79f5-4db3-af97-e8d093a30bf0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] HTTP exception thrown: Security group 1c841ab2-527b-4954-bc74-48dc678cd13d does not exist Aug 24 10:24:54.253161 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-f6a2df9d-a7d4-4c3a-8f94-8d96bf76d164'] Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-827191ac-79f5-4db3-af97-e8d093a30bf0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Request method failure captured: Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/os-security-groups/1c841ab2-527b-4954-bc74-48dc678cd13d HTTP/1.1 Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfwP4tkKyJr5Gg7qNaTDv0qB585z-EGLWhAIlAiiw7niuSBtf4-Q9XJ2RClgHF5tG0tqoI1dsizKyw5H-SwLhXdRiM6qVR9NPoSFDWFDAiYHpCUOyNdaDsUmsdQydv3MYAQ3enYS0IGacLv6Rxy4kcYdhL4YEU_p2c-vtfjTt6PXS-o Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_44f050698fc54fb6b8fdf2866472dd7d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/44f050698fc54fb6b8fdf2866472dd7d"}]}] Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: cf7304a4a0bb486fbf52f1c84cad702a Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: exception: Security group 1c841ab2-527b-4954-bc74-48dc678cd13d does not exist Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-f6a2df9d-a7d4-4c3a-8f94-8d96bf76d164'] Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '1c841ab2-527b-4954-bc74-48dc678cd13d'} Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 10:24:54.255437 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1c841ab2-527b-4954-bc74-48dc678cd13d does not exist Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f6a2df9d-a7d4-4c3a-8f94-8d96bf76d164'] Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1c841ab2-527b-4954-bc74-48dc678cd13d does not exist Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f6a2df9d-a7d4-4c3a-8f94-8d96bf76d164'] Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1c841ab2-527b-4954-bc74-48dc678cd13d does not exist Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f6a2df9d-a7d4-4c3a-8f94-8d96bf76d164'] Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1c841ab2-527b-4954-bc74-48dc678cd13d does not exist Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f6a2df9d-a7d4-4c3a-8f94-8d96bf76d164'] Aug 24 10:24:54.260145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.267435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-827191ac-79f5-4db3-af97-e8d093a30bf0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Returning 404 to user: Security group 1c841ab2-527b-4954-bc74-48dc678cd13d does not exist Aug 24 10:24:54.267435 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-f6a2df9d-a7d4-4c3a-8f94-8d96bf76d164'] {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:54.269609 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-827191ac-79f5-4db3-af97-e8d093a30bf0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/1c841ab2-527b-4954-bc74-48dc678cd13d" status: 404 len: 194 microversion: 2.1 time: 0.168148 Aug 24 10:24:54.270854 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1333/2995] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:24:54 2022] DELETE /compute/v2.1/os-security-groups/1c841ab2-527b-4954-bc74-48dc678cd13d => generated 194 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:24:54.295103 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e9ff22b6-5eb7-4d33-8556-fc44ec3f5668 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:54.305473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e9ff22b6-5eb7-4d33-8556-fc44ec3f5668 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:54.324833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9ff22b6-5eb7-4d33-8556-fc44ec3f5668 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:54.325682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9ff22b6-5eb7-4d33-8556-fc44ec3f5668 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:54.326283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9ff22b6-5eb7-4d33-8556-fc44ec3f5668 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:54.327057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9ff22b6-5eb7-4d33-8556-fc44ec3f5668 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:54.327522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9ff22b6-5eb7-4d33-8556-fc44ec3f5668 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:54.327976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9ff22b6-5eb7-4d33-8556-fc44ec3f5668 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:54.374939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:54.514008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e9ff22b6-5eb7-4d33-8556-fc44ec3f5668 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:54.532192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e9ff22b6-5eb7-4d33-8556-fc44ec3f5668 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:54.540173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e9ff22b6-5eb7-4d33-8556-fc44ec3f5668 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:54.543969 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e9ff22b6-5eb7-4d33-8556-fc44ec3f5668 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1366 microversion: 2.57 time: 0.253496 Aug 24 10:24:54.545371 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1334/2996] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:54 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:54.550702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f40a6cab-6573-4343-9395-c545e253630e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '.version_select at 0x7f4654f82b80>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:54.573178 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3a95d704-d730-4365-859e-70a7f6ff89f3 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:54.589313 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3a95d704-d730-4365-859e-70a7f6ff89f3 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 200 len: 1314 microversion: 2.1 time: 0.706299 Aug 24 10:24:54.610045 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1663/2997] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:53 2022] GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 1314 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:54.616882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d71b81fa-2e07-4c49-a5a5-364d1c07c41f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:54.617812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d71b81fa-2e07-4c49-a5a5-364d1c07c41f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:54.627822 n-d-849328-3 devstack@n-api.service[122432]: DEBUG neutronclient.v2_0.client [None req-f40a6cab-6573-4343-9395-c545e253630e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2c0e265a-8ebd-4ad1-a5e0-68bb55c95586 does not exist", "detail": ""}} {{(pid=122432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 10:24:54.628354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d71b81fa-2e07-4c49-a5a5-364d1c07c41f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:54.628699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.security_group_api [None req-f40a6cab-6573-4343-9395-c545e253630e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Neutron security group 2c0e265a-8ebd-4ad1-a5e0-68bb55c95586 not found {{(pid=122432) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 10:24:54.629359 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-f40a6cab-6573-4343-9395-c545e253630e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] HTTP exception thrown: Security group 2c0e265a-8ebd-4ad1-a5e0-68bb55c95586 does not exist Aug 24 10:24:54.629359 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-25b4da58-fd36-49bc-964b-3bd4e326cdae'] Aug 24 10:24:54.629665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d71b81fa-2e07-4c49-a5a5-364d1c07c41f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:54.630263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d71b81fa-2e07-4c49-a5a5-364d1c07c41f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f40a6cab-6573-4343-9395-c545e253630e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Request method failure captured: Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/os-security-groups/2c0e265a-8ebd-4ad1-a5e0-68bb55c95586 HTTP/1.1 Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfwP4tkKyJr5Gg7qNaTDv0qB585z-EGLWhAIlAiiw7niuSBtf4-Q9XJ2RClgHF5tG0tqoI1dsizKyw5H-SwLhXdRiM6qVR9NPoSFDWFDAiYHpCUOyNdaDsUmsdQydv3MYAQ3enYS0IGacLv6Rxy4kcYdhL4YEU_p2c-vtfjTt6PXS-o Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_44f050698fc54fb6b8fdf2866472dd7d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/44f050698fc54fb6b8fdf2866472dd7d"}]}] Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: cf7304a4a0bb486fbf52f1c84cad702a Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: exception: Security group 2c0e265a-8ebd-4ad1-a5e0-68bb55c95586 does not exist Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-25b4da58-fd36-49bc-964b-3bd4e326cdae'] Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '2c0e265a-8ebd-4ad1-a5e0-68bb55c95586'} Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 10:24:54.631647 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2c0e265a-8ebd-4ad1-a5e0-68bb55c95586 does not exist Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-25b4da58-fd36-49bc-964b-3bd4e326cdae'] Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2c0e265a-8ebd-4ad1-a5e0-68bb55c95586 does not exist Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-25b4da58-fd36-49bc-964b-3bd4e326cdae'] Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2c0e265a-8ebd-4ad1-a5e0-68bb55c95586 does not exist Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-25b4da58-fd36-49bc-964b-3bd4e326cdae'] Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2c0e265a-8ebd-4ad1-a5e0-68bb55c95586 does not exist Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-25b4da58-fd36-49bc-964b-3bd4e326cdae'] Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f40a6cab-6573-4343-9395-c545e253630e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Returning 404 to user: Security group 2c0e265a-8ebd-4ad1-a5e0-68bb55c95586 does not exist Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-25b4da58-fd36-49bc-964b-3bd4e326cdae'] {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f40a6cab-6573-4343-9395-c545e253630e tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/2c0e265a-8ebd-4ad1-a5e0-68bb55c95586" status: 404 len: 194 microversion: 2.1 time: 0.086407 Aug 24 10:24:54.639726 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1335/2998] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:24:54 2022] DELETE /compute/v2.1/os-security-groups/2c0e265a-8ebd-4ad1-a5e0-68bb55c95586 => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:24:54.649658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d71b81fa-2e07-4c49-a5a5-364d1c07c41f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:54.649658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d71b81fa-2e07-4c49-a5a5-364d1c07c41f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:54.649658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d71b81fa-2e07-4c49-a5a5-364d1c07c41f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:54.653173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9674e6dc-af48-494c-81de-4a5c2a494345 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '.version_select at 0x7f46550f24c0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:54.671402 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-d71b81fa-2e07-4c49-a5a5-364d1c07c41f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] HTTP exception thrown: Instance 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 could not be found. Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d71b81fa-2e07-4c49-a5a5-364d1c07c41f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Request method failure captured: Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 HTTP/1.1 Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfwVOwKbAI3HcYW4vDUwX5tmvWZcMN8iYYPbyv0cT05fZ_Z-LEPCm4LinUuprRdXqkjYpTNDBQ5PMwhn6CDfWO2m5UgqK-Sr-pjjwg2dd34HghINyEVE3T5Itg-PYKj0YMEqYVC5uIroOumu3tZy7M7156OT9EtIM2-BMTg5dhnnzv0 Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b324a37b01b644dfa301a561e6125672", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b324a37b01b644dfa301a561e6125672"}]}] Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: b49cb438da9f4b309d54bfef9fc19bda Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 could not be found. Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6'} Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 could not be found. Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 could not be found. Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:54.683564 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.687696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:54.687696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:54.687696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:54.687696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:54.687696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:54.687696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 could not be found. Aug 24 10:24:54.687696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.690719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d71b81fa-2e07-4c49-a5a5-364d1c07c41f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Returning 404 to user: Instance 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:54.691869 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d71b81fa-2e07-4c49-a5a5-364d1c07c41f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6" status: 404 len: 111 microversion: 2.1 time: 0.079161 Aug 24 10:24:54.692656 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1664/2999] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:54 2022] GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:24:54.787342 n-d-849328-3 devstack@n-api.service[122432]: DEBUG neutronclient.v2_0.client [None req-9674e6dc-af48-494c-81de-4a5c2a494345 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 827c7833-673e-484f-a39c-967a1f016e3e does not exist", "detail": ""}} {{(pid=122432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 10:24:54.790369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.security_group_api [None req-9674e6dc-af48-494c-81de-4a5c2a494345 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Neutron security group 827c7833-673e-484f-a39c-967a1f016e3e not found {{(pid=122432) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 10:24:54.791341 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-9674e6dc-af48-494c-81de-4a5c2a494345 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] HTTP exception thrown: Security group 827c7833-673e-484f-a39c-967a1f016e3e does not exist Aug 24 10:24:54.791341 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-9b380d4d-74c7-4a88-81c3-b8123a52e2fe'] Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9674e6dc-af48-494c-81de-4a5c2a494345 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Request method failure captured: Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/os-security-groups/827c7833-673e-484f-a39c-967a1f016e3e HTTP/1.1 Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfwP4tkKyJr5Gg7qNaTDv0qB585z-EGLWhAIlAiiw7niuSBtf4-Q9XJ2RClgHF5tG0tqoI1dsizKyw5H-SwLhXdRiM6qVR9NPoSFDWFDAiYHpCUOyNdaDsUmsdQydv3MYAQ3enYS0IGacLv6Rxy4kcYdhL4YEU_p2c-vtfjTt6PXS-o Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_44f050698fc54fb6b8fdf2866472dd7d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/44f050698fc54fb6b8fdf2866472dd7d"}]}] Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: cf7304a4a0bb486fbf52f1c84cad702a Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: exception: Security group 827c7833-673e-484f-a39c-967a1f016e3e does not exist Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-9b380d4d-74c7-4a88-81c3-b8123a52e2fe'] Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '827c7833-673e-484f-a39c-967a1f016e3e'} Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 10:24:54.794099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 827c7833-673e-484f-a39c-967a1f016e3e does not exist Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b380d4d-74c7-4a88-81c3-b8123a52e2fe'] Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 827c7833-673e-484f-a39c-967a1f016e3e does not exist Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b380d4d-74c7-4a88-81c3-b8123a52e2fe'] Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 827c7833-673e-484f-a39c-967a1f016e3e does not exist Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b380d4d-74c7-4a88-81c3-b8123a52e2fe'] Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 827c7833-673e-484f-a39c-967a1f016e3e does not exist Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b380d4d-74c7-4a88-81c3-b8123a52e2fe'] Aug 24 10:24:54.797994 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.804670 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9674e6dc-af48-494c-81de-4a5c2a494345 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Returning 404 to user: Security group 827c7833-673e-484f-a39c-967a1f016e3e does not exist Aug 24 10:24:54.804670 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-9b380d4d-74c7-4a88-81c3-b8123a52e2fe'] {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:54.804670 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9674e6dc-af48-494c-81de-4a5c2a494345 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/827c7833-673e-484f-a39c-967a1f016e3e" status: 404 len: 194 microversion: 2.1 time: 0.159873 Aug 24 10:24:54.804670 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1336/3000] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:24:54 2022] DELETE /compute/v2.1/os-security-groups/827c7833-673e-484f-a39c-967a1f016e3e => generated 194 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:24:54.814428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-47e39fb1-2a16-4407-98f9-225317439ade tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:54.815274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-47e39fb1-2a16-4407-98f9-225317439ade tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: d49761ab-ce76-45fc-9754-3366ce58e6b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:54.834126 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47e39fb1-2a16-4407-98f9-225317439ade tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:54.834676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47e39fb1-2a16-4407-98f9-225317439ade tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:54.835129 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47e39fb1-2a16-4407-98f9-225317439ade tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:54.835876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47e39fb1-2a16-4407-98f9-225317439ade tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:54.836361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47e39fb1-2a16-4407-98f9-225317439ade tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:54.842390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47e39fb1-2a16-4407-98f9-225317439ade tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:54.930795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-47e39fb1-2a16-4407-98f9-225317439ade tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: d49761ab-ce76-45fc-9754-3366ce58e6b2] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:24:54.961567 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e149c9bc-a515-44b3-9f9e-355d8a991a27 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:54.966819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e149c9bc-a515-44b3-9f9e-355d8a991a27 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] [instance: 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:54.993474 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e149c9bc-a515-44b3-9f9e-355d8a991a27 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:54.994047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e149c9bc-a515-44b3-9f9e-355d8a991a27 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:54.994539 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e149c9bc-a515-44b3-9f9e-355d8a991a27 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:54.995759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e149c9bc-a515-44b3-9f9e-355d8a991a27 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:54.996543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e149c9bc-a515-44b3-9f9e-355d8a991a27 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:55.003967 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e149c9bc-a515-44b3-9f9e-355d8a991a27 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:55.233708 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-47e39fb1-2a16-4407-98f9-225317439ade tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2" status: 204 len: 0 microversion: 2.1 time: 0.423878 Aug 24 10:24:55.237547 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1665/3001] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:24:54 2022] DELETE /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:55.244240 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6642d672-662d-4bc5-ae17-327586ccf3ec tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:55.247104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6642d672-662d-4bc5-ae17-327586ccf3ec tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:55.253888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6642d672-662d-4bc5-ae17-327586ccf3ec tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:55.254935 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6642d672-662d-4bc5-ae17-327586ccf3ec tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:55.255536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6642d672-662d-4bc5-ae17-327586ccf3ec tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:55.256447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6642d672-662d-4bc5-ae17-327586ccf3ec tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:55.257081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6642d672-662d-4bc5-ae17-327586ccf3ec tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:55.257842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6642d672-662d-4bc5-ae17-327586ccf3ec tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:55.272503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:55.274130 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-6642d672-662d-4bc5-ae17-327586ccf3ec tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] HTTP exception thrown: Instance 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 could not be found. Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6642d672-662d-4bc5-ae17-327586ccf3ec tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Request method failure captured: Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6/os-volume_attachments HTTP/1.1 Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfwVOwKbAI3HcYW4vDUwX5tmvWZcMN8iYYPbyv0cT05fZ_Z-LEPCm4LinUuprRdXqkjYpTNDBQ5PMwhn6CDfWO2m5UgqK-Sr-pjjwg2dd34HghINyEVE3T5Itg-PYKj0YMEqYVC5uIroOumu3tZy7M7156OT9EtIM2-BMTg5dhnnzv0 Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b324a37b01b644dfa301a561e6125672", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b324a37b01b644dfa301a561e6125672"}]}] Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: b49cb438da9f4b309d54bfef9fc19bda Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 could not be found. Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'server_id': '30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6'} Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 could not be found. Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:24:55.276260 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:24:55.280322 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 could not be found. Aug 24 10:24:55.280322 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:55.280322 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:55.280322 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:55.280322 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:55.280322 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:55.280322 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:55.280322 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:55.280322 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:55.280322 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 could not be found. Aug 24 10:24:55.280322 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:24:55.286136 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6642d672-662d-4bc5-ae17-327586ccf3ec tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Returning 404 to user: Instance 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:55.287449 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6642d672-662d-4bc5-ae17-327586ccf3ec tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.048361 Aug 24 10:24:55.288274 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1666/3002] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:24:55 2022] GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6/os-volume_attachments => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:24:55.308218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ea10e155-0d99-4687-8c58-59932f6662b0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:55.315502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ea10e155-0d99-4687-8c58-59932f6662b0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: d49761ab-ce76-45fc-9754-3366ce58e6b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:55.333199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea10e155-0d99-4687-8c58-59932f6662b0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:55.337321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea10e155-0d99-4687-8c58-59932f6662b0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:55.339438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea10e155-0d99-4687-8c58-59932f6662b0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:55.340643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea10e155-0d99-4687-8c58-59932f6662b0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:55.343322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea10e155-0d99-4687-8c58-59932f6662b0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:55.344249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea10e155-0d99-4687-8c58-59932f6662b0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:55.483278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e149c9bc-a515-44b3-9f9e-355d8a991a27 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578a67fe95b3453cb7d6bc90acce0478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396c23b60923463b9a82af15a7dcf771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:55.494228 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e149c9bc-a515-44b3-9f9e-355d8a991a27 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] 10.222.0.85 "GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54" status: 200 len: 1468 microversion: 2.1 time: 0.539529 Aug 24 10:24:55.495024 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1337/3003] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:54 2022] GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 => generated 1468 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:55.575848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-178e188e-5c6f-466e-ba97-b812a76a857d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:55.576026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-178e188e-5c6f-466e-ba97-b812a76a857d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:55.590486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-178e188e-5c6f-466e-ba97-b812a76a857d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:55.591125 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-178e188e-5c6f-466e-ba97-b812a76a857d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:55.591628 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-178e188e-5c6f-466e-ba97-b812a76a857d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:55.592563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-178e188e-5c6f-466e-ba97-b812a76a857d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:55.593777 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-178e188e-5c6f-466e-ba97-b812a76a857d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:55.597888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-178e188e-5c6f-466e-ba97-b812a76a857d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:55.859750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-178e188e-5c6f-466e-ba97-b812a76a857d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:55.888774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-178e188e-5c6f-466e-ba97-b812a76a857d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:55.891521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-178e188e-5c6f-466e-ba97-b812a76a857d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:55.898448 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-178e188e-5c6f-466e-ba97-b812a76a857d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1366 microversion: 2.57 time: 0.328389 Aug 24 10:24:55.909318 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1338/3004] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:55 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:55.920545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a5144972-b590-4701-8639-87fa45071ec6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:55.921591 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a5144972-b590-4701-8639-87fa45071ec6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:55.936901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5144972-b590-4701-8639-87fa45071ec6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:55.937814 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5144972-b590-4701-8639-87fa45071ec6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:55.938459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5144972-b590-4701-8639-87fa45071ec6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:55.942401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5144972-b590-4701-8639-87fa45071ec6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:55.943272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5144972-b590-4701-8639-87fa45071ec6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:55.946148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5144972-b590-4701-8639-87fa45071ec6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:56.369591 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a5144972-b590-4701-8639-87fa45071ec6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:56.380691 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a5144972-b590-4701-8639-87fa45071ec6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 200 len: 1314 microversion: 2.1 time: 0.469731 Aug 24 10:24:56.397174 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1339/3005] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:55 2022] GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:56.412746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b090d3e5-77f4-4b8f-b1f1-512eb38a6799 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1133755038", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "fb7883d4-b081-478d-b08b-6c818132f5bd"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:56.547448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-b090d3e5-77f4-4b8f-b1f1-512eb38a6799 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] validate_networks() for [('fb7883d4-b081-478d-b08b-6c818132f5bd', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:24:56.999474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ea10e155-0d99-4687-8c58-59932f6662b0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:57.013821 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ea10e155-0d99-4687-8c58-59932f6662b0 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2" status: 200 len: 1645 microversion: 2.1 time: 1.724042 Aug 24 10:24:57.027515 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1667/3006] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:55 2022] GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2 => generated 1645 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:57.039785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-623205da-071d-4b2a-af1f-1fa1b27eeb2b tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:57.040248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-623205da-071d-4b2a-af1f-1fa1b27eeb2b tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] [instance: 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:57.063000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-623205da-071d-4b2a-af1f-1fa1b27eeb2b tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:57.063510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-623205da-071d-4b2a-af1f-1fa1b27eeb2b tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:57.063958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-623205da-071d-4b2a-af1f-1fa1b27eeb2b tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:57.064754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-623205da-071d-4b2a-af1f-1fa1b27eeb2b tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:57.065563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-623205da-071d-4b2a-af1f-1fa1b27eeb2b tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:57.066012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-623205da-071d-4b2a-af1f-1fa1b27eeb2b tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:57.253923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-623205da-071d-4b2a-af1f-1fa1b27eeb2b tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578a67fe95b3453cb7d6bc90acce0478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396c23b60923463b9a82af15a7dcf771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:57.270145 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-623205da-071d-4b2a-af1f-1fa1b27eeb2b tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] 10.222.0.85 "GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54" status: 200 len: 1426 microversion: 2.1 time: 0.241302 Aug 24 10:24:57.271009 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1668/3007] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:57 2022] GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 => generated 1426 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:57.277726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ccc8b036-c3b9-4c0b-9063-01f9ba22bf76 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:57.280640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ccc8b036-c3b9-4c0b-9063-01f9ba22bf76 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:57.300728 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:57.303760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ccc8b036-c3b9-4c0b-9063-01f9ba22bf76 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:57.304878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ccc8b036-c3b9-4c0b-9063-01f9ba22bf76 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:57.305917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ccc8b036-c3b9-4c0b-9063-01f9ba22bf76 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:57.307038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ccc8b036-c3b9-4c0b-9063-01f9ba22bf76 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:57.307845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ccc8b036-c3b9-4c0b-9063-01f9ba22bf76 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:57.317927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ccc8b036-c3b9-4c0b-9063-01f9ba22bf76 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:57.534213 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ccc8b036-c3b9-4c0b-9063-01f9ba22bf76 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:57.546946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ccc8b036-c3b9-4c0b-9063-01f9ba22bf76 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:57.567076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ccc8b036-c3b9-4c0b-9063-01f9ba22bf76 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:57.570420 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ccc8b036-c3b9-4c0b-9063-01f9ba22bf76 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1366 microversion: 2.57 time: 0.296858 Aug 24 10:24:57.571933 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1669/3008] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:57 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:57.578175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1d3a7be8-490a-4211-b544-e18ae3d45c35 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:57.579172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1d3a7be8-490a-4211-b544-e18ae3d45c35 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:57.587244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d3a7be8-490a-4211-b544-e18ae3d45c35 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:57.588706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d3a7be8-490a-4211-b544-e18ae3d45c35 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:57.589828 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d3a7be8-490a-4211-b544-e18ae3d45c35 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:57.591841 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d3a7be8-490a-4211-b544-e18ae3d45c35 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:57.592988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d3a7be8-490a-4211-b544-e18ae3d45c35 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:57.594170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d3a7be8-490a-4211-b544-e18ae3d45c35 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:58.207831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1d3a7be8-490a-4211-b544-e18ae3d45c35 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:58.240482 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1d3a7be8-490a-4211-b544-e18ae3d45c35 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 200 len: 1314 microversion: 2.1 time: 0.666813 Aug 24 10:24:58.243803 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1670/3009] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:57 2022] GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 1314 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:58.261416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-4c66786a-bc06-4391-a9d9-545e7ff71a08 req-454e870c-99a8-4bc5-80af-8f1abbe8b43d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dc626f8-e0ea-469a-bacb-a6e79c0e8d54", "name": "network-vif-deleted", "tag": "20c7b980-98a4-450e-a121-ad8a54c69575"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:58.291946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4c66786a-bc06-4391-a9d9-545e7ff71a08 req-454e870c-99a8-4bc5-80af-8f1abbe8b43d service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:58.298603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4c66786a-bc06-4391-a9d9-545e7ff71a08 req-454e870c-99a8-4bc5-80af-8f1abbe8b43d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:58.298603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4c66786a-bc06-4391-a9d9-545e7ff71a08 req-454e870c-99a8-4bc5-80af-8f1abbe8b43d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:58.329688 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-4c66786a-bc06-4391-a9d9-545e7ff71a08 req-454e870c-99a8-4bc5-80af-8f1abbe8b43d service nova] Creating event network-vif-deleted:20c7b980-98a4-450e-a121-ad8a54c69575 for instance 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 on n-h2-849328-3 Aug 24 10:24:58.339971 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-4c66786a-bc06-4391-a9d9-545e7ff71a08 req-454e870c-99a8-4bc5-80af-8f1abbe8b43d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090754 Aug 24 10:24:58.345074 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1671/3010] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:24:58.353785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b437c639-9dba-4857-8f5f-9c4271aea22f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:58.361907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b437c639-9dba-4857-8f5f-9c4271aea22f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: d49761ab-ce76-45fc-9754-3366ce58e6b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:58.372376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b437c639-9dba-4857-8f5f-9c4271aea22f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:58.373359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b437c639-9dba-4857-8f5f-9c4271aea22f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:58.374077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b437c639-9dba-4857-8f5f-9c4271aea22f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:58.375883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b437c639-9dba-4857-8f5f-9c4271aea22f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:58.378219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b437c639-9dba-4857-8f5f-9c4271aea22f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:58.378715 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b437c639-9dba-4857-8f5f-9c4271aea22f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:58.458201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b090d3e5-77f4-4b8f-b1f1-512eb38a6799 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:24:58.458836 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b090d3e5-77f4-4b8f-b1f1-512eb38a6799 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:24:58.459820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b090d3e5-77f4-4b8f-b1f1-512eb38a6799 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:24:58.460443 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b090d3e5-77f4-4b8f-b1f1-512eb38a6799 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:24:58.461361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b090d3e5-77f4-4b8f-b1f1-512eb38a6799 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:24:58.481735 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b090d3e5-77f4-4b8f-b1f1-512eb38a6799 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:58.482985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b090d3e5-77f4-4b8f-b1f1-512eb38a6799 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:58.483847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b090d3e5-77f4-4b8f-b1f1-512eb38a6799 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:58.484903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b090d3e5-77f4-4b8f-b1f1-512eb38a6799 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:58.487401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b090d3e5-77f4-4b8f-b1f1-512eb38a6799 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:58.488057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b090d3e5-77f4-4b8f-b1f1-512eb38a6799 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:58.535691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-b090d3e5-77f4-4b8f-b1f1-512eb38a6799 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Getting quotas for project b324a37b01b644dfa301a561e6125672. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:24:58.557664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-b090d3e5-77f4-4b8f-b1f1-512eb38a6799 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Getting quotas for user b49cb438da9f4b309d54bfef9fc19bda and project b324a37b01b644dfa301a561e6125672. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:24:58.579456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b090d3e5-77f4-4b8f-b1f1-512eb38a6799 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:24:58.583161 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b090d3e5-77f4-4b8f-b1f1-512eb38a6799 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 43734320-cfe5-4cc4-afbe-06296b4eeaac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:24:58.693209 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b090d3e5-77f4-4b8f-b1f1-512eb38a6799 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.302411 Aug 24 10:24:58.696606 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1340/3011] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:24:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:24:58.709481 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-34aadd8a-80e8-4571-b184-5f6548798d3a tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:58.713986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-34aadd8a-80e8-4571-b184-5f6548798d3a tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] [instance: 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:58.744542 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34aadd8a-80e8-4571-b184-5f6548798d3a tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:58.760606 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34aadd8a-80e8-4571-b184-5f6548798d3a tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:58.761162 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34aadd8a-80e8-4571-b184-5f6548798d3a tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:58.762045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34aadd8a-80e8-4571-b184-5f6548798d3a tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:58.770353 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34aadd8a-80e8-4571-b184-5f6548798d3a tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:58.771043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34aadd8a-80e8-4571-b184-5f6548798d3a tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:58.903689 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34aadd8a-80e8-4571-b184-5f6548798d3a tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:58.904205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34aadd8a-80e8-4571-b184-5f6548798d3a tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:58.904701 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34aadd8a-80e8-4571-b184-5f6548798d3a tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:58.905095 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-34aadd8a-80e8-4571-b184-5f6548798d3a tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lazy-loading 'fault' on Instance uuid 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:24:58.967530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-34aadd8a-80e8-4571-b184-5f6548798d3a tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578a67fe95b3453cb7d6bc90acce0478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396c23b60923463b9a82af15a7dcf771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:58.977819 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-34aadd8a-80e8-4571-b184-5f6548798d3a tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] 10.222.0.85 "GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54" status: 200 len: 1303 microversion: 2.1 time: 0.279664 Aug 24 10:24:58.979000 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1341/3012] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:58 2022] GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 => generated 1303 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:58.987300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cea7474d-95c3-46a6-b1a2-dffb56b78cf1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:58.990540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cea7474d-95c3-46a6-b1a2-dffb56b78cf1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:58.999702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cea7474d-95c3-46a6-b1a2-dffb56b78cf1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:59.000286 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cea7474d-95c3-46a6-b1a2-dffb56b78cf1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:59.000810 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cea7474d-95c3-46a6-b1a2-dffb56b78cf1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:59.001806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cea7474d-95c3-46a6-b1a2-dffb56b78cf1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:59.002492 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cea7474d-95c3-46a6-b1a2-dffb56b78cf1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:59.003367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cea7474d-95c3-46a6-b1a2-dffb56b78cf1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:59.108281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cea7474d-95c3-46a6-b1a2-dffb56b78cf1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:59.117627 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cea7474d-95c3-46a6-b1a2-dffb56b78cf1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:59.120927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cea7474d-95c3-46a6-b1a2-dffb56b78cf1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:59.122731 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cea7474d-95c3-46a6-b1a2-dffb56b78cf1 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1366 microversion: 2.57 time: 0.142451 Aug 24 10:24:59.124824 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1342/3013] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:58 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:59.130024 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3a016188-3874-49d3-8606-60169a6da4d9 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:59.131730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3a016188-3874-49d3-8606-60169a6da4d9 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 43734320-cfe5-4cc4-afbe-06296b4eeaac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:59.195013 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3a016188-3874-49d3-8606-60169a6da4d9 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:59.220391 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3a016188-3874-49d3-8606-60169a6da4d9 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/43734320-cfe5-4cc4-afbe-06296b4eeaac" status: 200 len: 1215 microversion: 2.1 time: 0.093864 Aug 24 10:24:59.237770 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1343/3014] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:59 2022] GET /compute/v2.1/servers/43734320-cfe5-4cc4-afbe-06296b4eeaac => generated 1215 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:59.253471 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-57d7a48a-ee83-4625-8e67-e67bb443e1c5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:59.256303 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-57d7a48a-ee83-4625-8e67-e67bb443e1c5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 43734320-cfe5-4cc4-afbe-06296b4eeaac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:59.290733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-57d7a48a-ee83-4625-8e67-e67bb443e1c5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 43734320-cfe5-4cc4-afbe-06296b4eeaac] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:24:59.644330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b437c639-9dba-4857-8f5f-9c4271aea22f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7304a4a0bb486fbf52f1c84cad702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f050698fc54fb6b8fdf2866472dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:59.667241 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b437c639-9dba-4857-8f5f-9c4271aea22f tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2" status: 200 len: 1645 microversion: 2.1 time: 1.314053 Aug 24 10:24:59.668256 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1672/3015] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:58 2022] GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2 => generated 1645 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:59.686031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8164bac6-fffb-4509-89bb-89a5e39484e0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:59.697639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8164bac6-fffb-4509-89bb-89a5e39484e0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:59.714225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8164bac6-fffb-4509-89bb-89a5e39484e0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:59.716246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8164bac6-fffb-4509-89bb-89a5e39484e0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:59.717920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8164bac6-fffb-4509-89bb-89a5e39484e0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:59.718719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8164bac6-fffb-4509-89bb-89a5e39484e0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:59.720900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8164bac6-fffb-4509-89bb-89a5e39484e0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:59.721436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8164bac6-fffb-4509-89bb-89a5e39484e0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:59.885957 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.scheduler.client.report [None req-57d7a48a-ee83-4625-8e67-e67bb443e1c5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Deleted allocations for instance 43734320-cfe5-4cc4-afbe-06296b4eeaac Aug 24 10:24:59.893046 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.compute.api [None req-57d7a48a-ee83-4625-8e67-e67bb443e1c5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 43734320-cfe5-4cc4-afbe-06296b4eeaac] Instance Mapping does not exist while attempting local delete cleanup. Aug 24 10:24:59.894251 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-57d7a48a-ee83-4625-8e67-e67bb443e1c5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "DELETE /compute/v2.1/servers/43734320-cfe5-4cc4-afbe-06296b4eeaac" status: 204 len: 0 microversion: 2.1 time: 0.646699 Aug 24 10:24:59.900632 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1344/3016] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:24:59 2022] DELETE /compute/v2.1/servers/43734320-cfe5-4cc4-afbe-06296b4eeaac => generated 0 bytes in 651 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:59.906254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-52480d24-4dab-416b-82d9-8ef20dc22249 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:59.906885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-52480d24-4dab-416b-82d9-8ef20dc22249 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 43734320-cfe5-4cc4-afbe-06296b4eeaac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:59.941895 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-52480d24-4dab-416b-82d9-8ef20dc22249 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] HTTP exception thrown: Instance 43734320-cfe5-4cc4-afbe-06296b4eeaac could not be found. Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-52480d24-4dab-416b-82d9-8ef20dc22249 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Request method failure captured: Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/43734320-cfe5-4cc4-afbe-06296b4eeaac HTTP/1.1 Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfwVOwKbAI3HcYW4vDUwX5tmvWZcMN8iYYPbyv0cT05fZ_Z-LEPCm4LinUuprRdXqkjYpTNDBQ5PMwhn6CDfWO2m5UgqK-Sr-pjjwg2dd34HghINyEVE3T5Itg-PYKj0YMEqYVC5uIroOumu3tZy7M7156OT9EtIM2-BMTg5dhnnzv0 Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b324a37b01b644dfa301a561e6125672", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b324a37b01b644dfa301a561e6125672"}]}] Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: b49cb438da9f4b309d54bfef9fc19bda Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 43734320-cfe5-4cc4-afbe-06296b4eeaac could not be found. Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '43734320-cfe5-4cc4-afbe-06296b4eeaac'} Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43734320-cfe5-4cc4-afbe-06296b4eeaac could not be found. Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43734320-cfe5-4cc4-afbe-06296b4eeaac could not be found. Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:59.943786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:59.948414 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:59.948414 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:59.948414 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:59.948414 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43734320-cfe5-4cc4-afbe-06296b4eeaac could not be found. Aug 24 10:24:59.948414 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:24:59.962242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-52480d24-4dab-416b-82d9-8ef20dc22249 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Returning 404 to user: Instance 43734320-cfe5-4cc4-afbe-06296b4eeaac could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:59.963263 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-52480d24-4dab-416b-82d9-8ef20dc22249 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/43734320-cfe5-4cc4-afbe-06296b4eeaac" status: 404 len: 111 microversion: 2.1 time: 0.061194 Aug 24 10:24:59.969775 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1345/3017] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:59 2022] GET /compute/v2.1/servers/43734320-cfe5-4cc4-afbe-06296b4eeaac => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:25:00.005740 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5ceaf37c-a618-41a9-93ad-e2d231ded797 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:00.010151 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5ceaf37c-a618-41a9-93ad-e2d231ded797 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] [instance: 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:00.038147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ceaf37c-a618-41a9-93ad-e2d231ded797 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:00.038661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ceaf37c-a618-41a9-93ad-e2d231ded797 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:00.039111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ceaf37c-a618-41a9-93ad-e2d231ded797 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:00.039859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ceaf37c-a618-41a9-93ad-e2d231ded797 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:00.040326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ceaf37c-a618-41a9-93ad-e2d231ded797 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:00.040774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ceaf37c-a618-41a9-93ad-e2d231ded797 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:00.083154 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-5ceaf37c-a618-41a9-93ad-e2d231ded797 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] HTTP exception thrown: Instance 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 could not be found. Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5ceaf37c-a618-41a9-93ad-e2d231ded797 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Request method failure captured: Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 HTTP/1.1 Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfxZSg0Z1M4cYbwqD-7l30m5hyiEs92jGjE6sjmErgO3grgymBail4fZbc7tG-WgY1JDwPerjjLQi0cHokMfB0ey-z4L8-88O00uKl-FIgW5RTjwRlHAsB4AdgzFZRCxYrlMCszwgBrkKBL8WG2grviULG9qd9nWHALPDzzjwWx_Xps Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 396c23b60923463b9a82af15a7dcf771 Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-TenantUsagesTestJSON-414481695 Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/396c23b60923463b9a82af15a7dcf771"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_396c23b60923463b9a82af15a7dcf771", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/396c23b60923463b9a82af15a7dcf771"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/396c23b60923463b9a82af15a7dcf771"}]}] Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-TenantUsagesTestJSON-414481695 Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 396c23b60923463b9a82af15a7dcf771 Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TenantUsagesTestJSON-414481695 Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-TenantUsagesTestJSON-414481695-project Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 578a67fe95b3453cb7d6bc90acce0478 Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-TenantUsagesTestJSON-414481695-project Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 could not be found. Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '8dc626f8-e0ea-469a-bacb-a6e79c0e8d54'} Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 could not be found. Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 could not be found. Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:00.084779 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:25:00.089355 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:00.089355 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:25:00.089355 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:25:00.089355 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:25:00.089355 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:25:00.089355 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 could not be found. Aug 24 10:25:00.089355 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:25:00.093430 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5ceaf37c-a618-41a9-93ad-e2d231ded797 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] Returning 404 to user: Instance 8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:25:00.094951 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5ceaf37c-a618-41a9-93ad-e2d231ded797 tempest-TenantUsagesTestJSON-414481695 tempest-TenantUsagesTestJSON-414481695-project] 10.222.0.85 "GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54" status: 404 len: 111 microversion: 2.1 time: 0.098792 Aug 24 10:25:00.098432 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1346/3018] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:59 2022] GET /compute/v2.1/servers/8dc626f8-e0ea-469a-bacb-a6e79c0e8d54 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:25:00.149963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f4b4aeb1-c624-4419-80e9-f3e101f05157 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:00.150813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f4b4aeb1-c624-4419-80e9-f3e101f05157 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:00.165387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4b4aeb1-c624-4419-80e9-f3e101f05157 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:00.166279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4b4aeb1-c624-4419-80e9-f3e101f05157 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:00.167608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4b4aeb1-c624-4419-80e9-f3e101f05157 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:00.169519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4b4aeb1-c624-4419-80e9-f3e101f05157 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:00.171265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4b4aeb1-c624-4419-80e9-f3e101f05157 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:00.173634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4b4aeb1-c624-4419-80e9-f3e101f05157 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:00.569585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f4b4aeb1-c624-4419-80e9-f3e101f05157 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:00.586624 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f4b4aeb1-c624-4419-80e9-f3e101f05157 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:00.592430 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f4b4aeb1-c624-4419-80e9-f3e101f05157 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:00.594543 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f4b4aeb1-c624-4419-80e9-f3e101f05157 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1366 microversion: 2.57 time: 0.448727 Aug 24 10:25:00.596139 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1347/3019] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:25:00 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1366 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:25:00.623254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0aac37b7-e2e9-43db-a477-a7146cea6f43 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-185087342", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "fb7883d4-b081-478d-b08b-6c818132f5bd"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:25:00.703691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-0aac37b7-e2e9-43db-a477-a7146cea6f43 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] validate_networks() for [('fb7883d4-b081-478d-b08b-6c818132f5bd', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:25:00.926128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8164bac6-fffb-4509-89bb-89a5e39484e0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:00.948869 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8164bac6-fffb-4509-89bb-89a5e39484e0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 200 len: 1501 microversion: 2.1 time: 1.277579 Aug 24 10:25:00.949678 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1673/3020] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:59 2022] GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 1501 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:00.974158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0973df0d-199a-4eea-9d6f-eb9d5ac2959d req-bfca4c33-30f7-4084-8240-d334ddfffb3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49761ab-ce76-45fc-9754-3366ce58e6b2", "name": "network-vif-deleted", "tag": "29f51102-f85d-465a-b06a-dc1cf699dbf4"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:25:01.014853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0973df0d-199a-4eea-9d6f-eb9d5ac2959d req-bfca4c33-30f7-4084-8240-d334ddfffb3f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:01.015169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0973df0d-199a-4eea-9d6f-eb9d5ac2959d req-bfca4c33-30f7-4084-8240-d334ddfffb3f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:01.015857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0973df0d-199a-4eea-9d6f-eb9d5ac2959d req-bfca4c33-30f7-4084-8240-d334ddfffb3f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:01.071212 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0973df0d-199a-4eea-9d6f-eb9d5ac2959d req-bfca4c33-30f7-4084-8240-d334ddfffb3f service nova] Creating event network-vif-deleted:29f51102-f85d-465a-b06a-dc1cf699dbf4 for instance d49761ab-ce76-45fc-9754-3366ce58e6b2 on n-h1-849328-3 Aug 24 10:25:01.085805 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0973df0d-199a-4eea-9d6f-eb9d5ac2959d req-bfca4c33-30f7-4084-8240-d334ddfffb3f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134288 Aug 24 10:25:01.088506 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1674/3021] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:01.104121 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-52b3214c-6804-4ce1-b88a-0165581b2604 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:01.110448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-52b3214c-6804-4ce1-b88a-0165581b2604 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] [instance: d49761ab-ce76-45fc-9754-3366ce58e6b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:01.131218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52b3214c-6804-4ce1-b88a-0165581b2604 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:01.137586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52b3214c-6804-4ce1-b88a-0165581b2604 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:01.138629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52b3214c-6804-4ce1-b88a-0165581b2604 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:01.142299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52b3214c-6804-4ce1-b88a-0165581b2604 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:01.143126 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52b3214c-6804-4ce1-b88a-0165581b2604 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:01.143941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52b3214c-6804-4ce1-b88a-0165581b2604 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:01.197317 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-52b3214c-6804-4ce1-b88a-0165581b2604 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] HTTP exception thrown: Instance d49761ab-ce76-45fc-9754-3366ce58e6b2 could not be found. Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-52b3214c-6804-4ce1-b88a-0165581b2604 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Request method failure captured: Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2 HTTP/1.1 Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfwP4tkKyJr5Gg7qNaTDv0qB585z-EGLWhAIlAiiw7niuSBtf4-Q9XJ2RClgHF5tG0tqoI1dsizKyw5H-SwLhXdRiM6qVR9NPoSFDWFDAiYHpCUOyNdaDsUmsdQydv3MYAQ3enYS0IGacLv6Rxy4kcYdhL4YEU_p2c-vtfjTt6PXS-o Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_44f050698fc54fb6b8fdf2866472dd7d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/44f050698fc54fb6b8fdf2866472dd7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/44f050698fc54fb6b8fdf2866472dd7d"}]}] Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 44f050698fc54fb6b8fdf2866472dd7d Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-198246391 Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: cf7304a4a0bb486fbf52f1c84cad702a Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupsTestJSON-198246391-project Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance d49761ab-ce76-45fc-9754-3366ce58e6b2 could not be found. Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'd49761ab-ce76-45fc-9754-3366ce58e6b2'} Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d49761ab-ce76-45fc-9754-3366ce58e6b2 could not be found. Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d49761ab-ce76-45fc-9754-3366ce58e6b2 could not be found. Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:01.201080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:01.206125 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:01.206125 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:25:01.206125 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:25:01.206125 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:25:01.206125 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:25:01.206125 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d49761ab-ce76-45fc-9754-3366ce58e6b2 could not be found. Aug 24 10:25:01.206125 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:01.209749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-52b3214c-6804-4ce1-b88a-0165581b2604 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Returning 404 to user: Instance d49761ab-ce76-45fc-9754-3366ce58e6b2 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:25:01.213953 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-52b3214c-6804-4ce1-b88a-0165581b2604 tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2" status: 404 len: 111 microversion: 2.1 time: 0.119546 Aug 24 10:25:01.222948 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1675/3022] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:01 2022] GET /compute/v2.1/servers/d49761ab-ce76-45fc-9754-3366ce58e6b2 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:25:01.230168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bbc0b69e-0090-479e-8066-344011b67809 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:25:01.234936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bbc0b69e-0090-479e-8066-344011b67809 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:01.245488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbc0b69e-0090-479e-8066-344011b67809 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:01.246195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbc0b69e-0090-479e-8066-344011b67809 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:01.246854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbc0b69e-0090-479e-8066-344011b67809 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:01.247850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbc0b69e-0090-479e-8066-344011b67809 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:01.248474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbc0b69e-0090-479e-8066-344011b67809 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:01.249065 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbc0b69e-0090-479e-8066-344011b67809 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:01.310079 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-bbc0b69e-0090-479e-8066-344011b67809 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lazy-loading 'flavor' on Instance uuid d6cdec98-2454-4ba9-8859-25231e4e28ab {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:25:01.534208 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bbc0b69e-0090-479e-8066-344011b67809 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "POST /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab/action" status: 200 len: 32 microversion: 2.1 time: 0.309198 Aug 24 10:25:01.536137 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1676/3023] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:25:01 2022] POST /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab/action => generated 32 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:25:01.548787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ee8bee23-5e82-4a87-96eb-e8b20dda755c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '.version_select at 0x7f4647d7e040>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:01.772272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:02.273515 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ee8bee23-5e82-4a87-96eb-e8b20dda755c tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/ca675845-4e4a-416b-9e8f-d6bd827cffaf" status: 202 len: 0 microversion: 2.1 time: 0.735372 Aug 24 10:25:02.274343 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1677/3024] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:25:01 2022] DELETE /compute/v2.1/os-security-groups/ca675845-4e4a-416b-9e8f-d6bd827cffaf => generated 0 bytes in 737 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:25:02.284890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ff8049e0-62bf-4d9b-8e87-a1db39f7f5c7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:02.286078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ff8049e0-62bf-4d9b-8e87-a1db39f7f5c7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:02.300073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff8049e0-62bf-4d9b-8e87-a1db39f7f5c7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:02.306078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff8049e0-62bf-4d9b-8e87-a1db39f7f5c7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:02.306712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff8049e0-62bf-4d9b-8e87-a1db39f7f5c7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:02.312918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff8049e0-62bf-4d9b-8e87-a1db39f7f5c7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:02.313753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff8049e0-62bf-4d9b-8e87-a1db39f7f5c7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:02.314617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff8049e0-62bf-4d9b-8e87-a1db39f7f5c7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:02.580354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0aac37b7-e2e9-43db-a477-a7146cea6f43 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:25:02.581592 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0aac37b7-e2e9-43db-a477-a7146cea6f43 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:25:02.582299 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0aac37b7-e2e9-43db-a477-a7146cea6f43 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:25:02.583002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0aac37b7-e2e9-43db-a477-a7146cea6f43 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:25:02.583656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0aac37b7-e2e9-43db-a477-a7146cea6f43 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:25:02.613859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0aac37b7-e2e9-43db-a477-a7146cea6f43 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:02.614726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0aac37b7-e2e9-43db-a477-a7146cea6f43 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:02.615356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0aac37b7-e2e9-43db-a477-a7146cea6f43 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:02.616297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0aac37b7-e2e9-43db-a477-a7146cea6f43 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:02.622685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0aac37b7-e2e9-43db-a477-a7146cea6f43 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:02.623636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0aac37b7-e2e9-43db-a477-a7146cea6f43 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:02.695593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-0aac37b7-e2e9-43db-a477-a7146cea6f43 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Getting quotas for project b324a37b01b644dfa301a561e6125672. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:25:02.707877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ff8049e0-62bf-4d9b-8e87-a1db39f7f5c7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:02.724318 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ff8049e0-62bf-4d9b-8e87-a1db39f7f5c7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 200 len: 1507 microversion: 2.1 time: 0.448890 Aug 24 10:25:02.726255 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1678/3025] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:02 2022] GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 1507 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:02.728631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:02.730079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-0aac37b7-e2e9-43db-a477-a7146cea6f43 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Getting quotas for user b49cb438da9f4b309d54bfef9fc19bda and project b324a37b01b644dfa301a561e6125672. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:25:02.746491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9926b4fd-894f-4d5e-999f-4420646f875d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:02.751331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9926b4fd-894f-4d5e-999f-4420646f875d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:02.781305 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9926b4fd-894f-4d5e-999f-4420646f875d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:02.784067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9926b4fd-894f-4d5e-999f-4420646f875d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:02.785140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9926b4fd-894f-4d5e-999f-4420646f875d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:02.786294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9926b4fd-894f-4d5e-999f-4420646f875d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:02.789488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9926b4fd-894f-4d5e-999f-4420646f875d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:02.790243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9926b4fd-894f-4d5e-999f-4420646f875d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:02.796764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0aac37b7-e2e9-43db-a477-a7146cea6f43 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:25:02.802949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0aac37b7-e2e9-43db-a477-a7146cea6f43 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 84e1c064-02ae-48d5-9b75-ce57b9a3758f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:25:02.949920 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0aac37b7-e2e9-43db-a477-a7146cea6f43 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.352036 Aug 24 10:25:02.951888 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1348/3026] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:25:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:25:02.966821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9926b4fd-894f-4d5e-999f-4420646f875d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:02.993981 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9926b4fd-894f-4d5e-999f-4420646f875d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:02.995524 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9926b4fd-894f-4d5e-999f-4420646f875d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:02.996778 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9926b4fd-894f-4d5e-999f-4420646f875d tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1372 microversion: 2.57 time: 0.268965 Aug 24 10:25:03.039589 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1679/3027] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:25:02 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1372 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:25:03.055817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bf510a64-e138-4509-9224-8e284091224d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] Calling method '.version_select at 0x7f4647db7e50>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:03.231252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d666b92b-9b5d-4645-8f69-87f5b1b2e3e2 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1890102241", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "539f94a6-9656-4a84-bb60-3b030500b63e"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:25:03.418011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-d666b92b-9b5d-4645-8f69-87f5b1b2e3e2 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] validate_networks() for [('539f94a6-9656-4a84-bb60-3b030500b63e', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:25:04.744832 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bf510a64-e138-4509-9224-8e284091224d tempest-SecurityGroupsTestJSON-198246391 tempest-SecurityGroupsTestJSON-198246391-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/793a5ba6-48d2-42fa-b06a-27dbe0fd880d" status: 202 len: 0 microversion: 2.1 time: 1.703538 Aug 24 10:25:04.751708 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1680/3028] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:25:03 2022] DELETE /compute/v2.1/os-security-groups/793a5ba6-48d2-42fa-b06a-27dbe0fd880d => generated 0 bytes in 1711 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:25:04.776366 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d7a21c4d-04cd-427d-97c0-631efdd89d79 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:04.777266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d7a21c4d-04cd-427d-97c0-631efdd89d79 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 84e1c064-02ae-48d5-9b75-ce57b9a3758f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:04.798606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7a21c4d-04cd-427d-97c0-631efdd89d79 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:04.809512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7a21c4d-04cd-427d-97c0-631efdd89d79 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:04.811473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7a21c4d-04cd-427d-97c0-631efdd89d79 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:04.816628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7a21c4d-04cd-427d-97c0-631efdd89d79 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:04.823924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7a21c4d-04cd-427d-97c0-631efdd89d79 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:04.825060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7a21c4d-04cd-427d-97c0-631efdd89d79 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:05.271057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d7a21c4d-04cd-427d-97c0-631efdd89d79 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:05.288932 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d7a21c4d-04cd-427d-97c0-631efdd89d79 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f" status: 200 len: 1266 microversion: 2.1 time: 0.534452 Aug 24 10:25:05.293625 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1681/3029] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:04 2022] GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f => generated 1266 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:05.327090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d23f4687-6077-4bf3-85b3-95dc585cdee6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:05.331965 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d23f4687-6077-4bf3-85b3-95dc585cdee6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:05.362147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d23f4687-6077-4bf3-85b3-95dc585cdee6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:05.363402 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d23f4687-6077-4bf3-85b3-95dc585cdee6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:05.366282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d23f4687-6077-4bf3-85b3-95dc585cdee6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:05.367369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d23f4687-6077-4bf3-85b3-95dc585cdee6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:05.370031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d23f4687-6077-4bf3-85b3-95dc585cdee6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:05.370696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d23f4687-6077-4bf3-85b3-95dc585cdee6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:06.421530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d23f4687-6077-4bf3-85b3-95dc585cdee6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:06.447961 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d23f4687-6077-4bf3-85b3-95dc585cdee6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 200 len: 1507 microversion: 2.1 time: 1.140414 Aug 24 10:25:06.452487 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1682/3030] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:05 2022] GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 1507 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:06.469348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-375d8957-1e47-4f7c-83a7-244973ffcca5 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:06.475144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-375d8957-1e47-4f7c-83a7-244973ffcca5 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:06.502263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-375d8957-1e47-4f7c-83a7-244973ffcca5 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:06.502783 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-375d8957-1e47-4f7c-83a7-244973ffcca5 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:06.503300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-375d8957-1e47-4f7c-83a7-244973ffcca5 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:06.508730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-375d8957-1e47-4f7c-83a7-244973ffcca5 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:06.509569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-375d8957-1e47-4f7c-83a7-244973ffcca5 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:06.512658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-375d8957-1e47-4f7c-83a7-244973ffcca5 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:06.748988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-375d8957-1e47-4f7c-83a7-244973ffcca5 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:06.763967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-375d8957-1e47-4f7c-83a7-244973ffcca5 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:06.765530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-375d8957-1e47-4f7c-83a7-244973ffcca5 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:06.766824 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-375d8957-1e47-4f7c-83a7-244973ffcca5 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1357 microversion: 2.57 time: 0.312837 Aug 24 10:25:06.767438 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1683/3031] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:25:06 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1357 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:25:07.022653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d666b92b-9b5d-4645-8f69-87f5b1b2e3e2 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:25:07.023706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d666b92b-9b5d-4645-8f69-87f5b1b2e3e2 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:25:07.024410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d666b92b-9b5d-4645-8f69-87f5b1b2e3e2 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:25:07.025348 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d666b92b-9b5d-4645-8f69-87f5b1b2e3e2 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:25:07.026197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d666b92b-9b5d-4645-8f69-87f5b1b2e3e2 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:25:07.050688 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d666b92b-9b5d-4645-8f69-87f5b1b2e3e2 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:07.056270 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d666b92b-9b5d-4645-8f69-87f5b1b2e3e2 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:07.058958 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d666b92b-9b5d-4645-8f69-87f5b1b2e3e2 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:07.060457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d666b92b-9b5d-4645-8f69-87f5b1b2e3e2 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:07.068817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d666b92b-9b5d-4645-8f69-87f5b1b2e3e2 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:07.070232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d666b92b-9b5d-4645-8f69-87f5b1b2e3e2 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:07.152623 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-d666b92b-9b5d-4645-8f69-87f5b1b2e3e2 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Getting quotas for project a3c26ec50b7740b5b0b58878c1c99097. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:25:07.176253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-d666b92b-9b5d-4645-8f69-87f5b1b2e3e2 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Getting quotas for user d0f0e4fb1dae471eadb630004ba3e36b and project a3c26ec50b7740b5b0b58878c1c99097. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:25:07.241647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d666b92b-9b5d-4645-8f69-87f5b1b2e3e2 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:25:07.246760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d666b92b-9b5d-4645-8f69-87f5b1b2e3e2 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] [instance: c7361027-6bfd-4d6a-b6fb-5207f4291812] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:25:07.405365 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d666b92b-9b5d-4645-8f69-87f5b1b2e3e2 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.444452 Aug 24 10:25:07.413311 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1349/3032] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:25:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 4460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:25:07.424863 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e8281891-1bff-4cc6-b05e-a9ec25ffee05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:07.431186 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e8281891-1bff-4cc6-b05e-a9ec25ffee05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 84e1c064-02ae-48d5-9b75-ce57b9a3758f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:07.456846 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8281891-1bff-4cc6-b05e-a9ec25ffee05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:07.457637 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8281891-1bff-4cc6-b05e-a9ec25ffee05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:07.458455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8281891-1bff-4cc6-b05e-a9ec25ffee05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:07.459399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8281891-1bff-4cc6-b05e-a9ec25ffee05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:07.460765 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8281891-1bff-4cc6-b05e-a9ec25ffee05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:07.461567 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8281891-1bff-4cc6-b05e-a9ec25ffee05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:07.593768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dd8775da-9493-45c4-9fcb-78aa042e984d tempest-FloatingIPDetailsTestJSON-1559920032 tempest-FloatingIPDetailsTestJSON-1559920032-project] Action: 'create', calling method: .version_select at 0x7f4647d0d0d0>, body: {"pool": null} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:25:07.775797 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e8281891-1bff-4cc6-b05e-a9ec25ffee05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:07.797536 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e8281891-1bff-4cc6-b05e-a9ec25ffee05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f" status: 200 len: 1272 microversion: 2.1 time: 0.380086 Aug 24 10:25:07.799249 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1350/3033] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:07 2022] GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f => generated 1272 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:07.821107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f527988d-01c3-4c82-b0e1-11b1695ffbdb tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:07.821663 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f527988d-01c3-4c82-b0e1-11b1695ffbdb tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:07.839068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f527988d-01c3-4c82-b0e1-11b1695ffbdb tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:07.839586 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f527988d-01c3-4c82-b0e1-11b1695ffbdb tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:07.840031 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f527988d-01c3-4c82-b0e1-11b1695ffbdb tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:07.840808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f527988d-01c3-4c82-b0e1-11b1695ffbdb tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:07.841298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f527988d-01c3-4c82-b0e1-11b1695ffbdb tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:07.841868 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f527988d-01c3-4c82-b0e1-11b1695ffbdb tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:07.913475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f527988d-01c3-4c82-b0e1-11b1695ffbdb tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:25:08.146377 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f527988d-01c3-4c82-b0e1-11b1695ffbdb tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "DELETE /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 204 len: 0 microversion: 2.57 time: 0.341124 Aug 24 10:25:08.168901 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1351/3034] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:25:07 2022] DELETE /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:25:08.196500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d3f15a7a-3a5a-4895-b19d-ef47b8a7d196 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:08.201912 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d3f15a7a-3a5a-4895-b19d-ef47b8a7d196 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] [instance: c7361027-6bfd-4d6a-b6fb-5207f4291812] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:08.827002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d3f15a7a-3a5a-4895-b19d-ef47b8a7d196 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f0e4fb1dae471eadb630004ba3e36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c26ec50b7740b5b0b58878c1c99097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:08.841958 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d3f15a7a-3a5a-4895-b19d-ef47b8a7d196 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] 10.222.0.85 "GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812" status: 200 len: 1217 microversion: 2.1 time: 0.670440 Aug 24 10:25:08.843326 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1352/3035] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:08 2022] GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812 => generated 1217 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:08.857025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5f911848-98bb-4eea-83f1-ae21d1844da8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:08.860229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5f911848-98bb-4eea-83f1-ae21d1844da8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:08.917478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f911848-98bb-4eea-83f1-ae21d1844da8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:08.924210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f911848-98bb-4eea-83f1-ae21d1844da8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:08.925151 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f911848-98bb-4eea-83f1-ae21d1844da8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:08.927115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f911848-98bb-4eea-83f1-ae21d1844da8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:08.929779 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f911848-98bb-4eea-83f1-ae21d1844da8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:08.934945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f911848-98bb-4eea-83f1-ae21d1844da8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:09.832155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5f911848-98bb-4eea-83f1-ae21d1844da8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:09.850482 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5f911848-98bb-4eea-83f1-ae21d1844da8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 200 len: 1507 microversion: 2.1 time: 1.005393 Aug 24 10:25:09.852770 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1353/3036] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:08 2022] GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 1507 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:09.864893 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-27ddd2a2-4157-42eb-bafe-c5c6a3700d97 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:09.865961 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-27ddd2a2-4157-42eb-bafe-c5c6a3700d97 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:09.886193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27ddd2a2-4157-42eb-bafe-c5c6a3700d97 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:09.888389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27ddd2a2-4157-42eb-bafe-c5c6a3700d97 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:09.889086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27ddd2a2-4157-42eb-bafe-c5c6a3700d97 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:09.890203 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27ddd2a2-4157-42eb-bafe-c5c6a3700d97 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:09.890841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27ddd2a2-4157-42eb-bafe-c5c6a3700d97 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:09.891540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27ddd2a2-4157-42eb-bafe-c5c6a3700d97 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:10.300198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-27ddd2a2-4157-42eb-bafe-c5c6a3700d97 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:10.319751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-27ddd2a2-4157-42eb-bafe-c5c6a3700d97 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:10.327168 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-27ddd2a2-4157-42eb-bafe-c5c6a3700d97 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64d2ea3205fe413d84ff2e2dd39ef1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96397ad30b9e40c9840bfc64d551612c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:10.330197 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-27ddd2a2-4157-42eb-bafe-c5c6a3700d97 tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 200 len: 1363 microversion: 2.57 time: 0.475922 Aug 24 10:25:10.348497 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1354/3037] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:25:09 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 1363 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:25:10.357071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad2956c8-0513-41f5-819f-4404a83bf07d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:10.357733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ad2956c8-0513-41f5-819f-4404a83bf07d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 84e1c064-02ae-48d5-9b75-ce57b9a3758f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:10.384148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad2956c8-0513-41f5-819f-4404a83bf07d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:10.388163 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad2956c8-0513-41f5-819f-4404a83bf07d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:10.388700 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad2956c8-0513-41f5-819f-4404a83bf07d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:10.389562 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad2956c8-0513-41f5-819f-4404a83bf07d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:10.394284 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad2956c8-0513-41f5-819f-4404a83bf07d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:10.394853 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad2956c8-0513-41f5-819f-4404a83bf07d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:10.990317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ad2956c8-0513-41f5-819f-4404a83bf07d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:11.003071 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ad2956c8-0513-41f5-819f-4404a83bf07d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f" status: 200 len: 1272 microversion: 2.1 time: 0.652894 Aug 24 10:25:11.003741 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1355/3038] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:10 2022] GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f => generated 1272 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:11.011478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b9f2eefd-9703-413a-bade-8ae977db70cf tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:11.012191 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b9f2eefd-9703-413a-bade-8ae977db70cf tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] [instance: c7361027-6bfd-4d6a-b6fb-5207f4291812] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:11.030296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9f2eefd-9703-413a-bade-8ae977db70cf tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:11.035491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9f2eefd-9703-413a-bade-8ae977db70cf tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:11.036311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9f2eefd-9703-413a-bade-8ae977db70cf tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:11.037279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9f2eefd-9703-413a-bade-8ae977db70cf tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:11.038143 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9f2eefd-9703-413a-bade-8ae977db70cf tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:11.038588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9f2eefd-9703-413a-bade-8ae977db70cf tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:11.278457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b9f2eefd-9703-413a-bade-8ae977db70cf tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f0e4fb1dae471eadb630004ba3e36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c26ec50b7740b5b0b58878c1c99097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:11.302111 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b9f2eefd-9703-413a-bade-8ae977db70cf tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] 10.222.0.85 "GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812" status: 200 len: 1275 microversion: 2.1 time: 0.294304 Aug 24 10:25:11.303152 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1356/3039] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:11 2022] GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812 => generated 1275 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:11.329956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f6ff55c0-bb8f-49ac-80be-54ee5f40e2ed tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:11.331154 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f6ff55c0-bb8f-49ac-80be-54ee5f40e2ed tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:11.353261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6ff55c0-bb8f-49ac-80be-54ee5f40e2ed tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:11.354146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6ff55c0-bb8f-49ac-80be-54ee5f40e2ed tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:11.355137 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6ff55c0-bb8f-49ac-80be-54ee5f40e2ed tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:11.356458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6ff55c0-bb8f-49ac-80be-54ee5f40e2ed tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:11.357499 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6ff55c0-bb8f-49ac-80be-54ee5f40e2ed tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:11.359582 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6ff55c0-bb8f-49ac-80be-54ee5f40e2ed tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:11.971144 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dd8775da-9493-45c4-9fcb-78aa042e984d tempest-FloatingIPDetailsTestJSON-1559920032 tempest-FloatingIPDetailsTestJSON-1559920032-project] 10.222.0.85 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.201495 Aug 24 10:25:11.979277 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1684/3040] 10.222.0.85 () {60 vars in 1170 bytes} [Wed Aug 24 10:25:06 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:11.982332 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9a2ff716-5f1c-4107-965f-eaafd010927c tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:11.983683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9a2ff716-5f1c-4107-965f-eaafd010927c tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] [instance: f5e7b786-9dc3-47fa-b86e-46fe8af8bf99] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:11.995516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a2ff716-5f1c-4107-965f-eaafd010927c tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:11.996481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a2ff716-5f1c-4107-965f-eaafd010927c tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:11.997407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a2ff716-5f1c-4107-965f-eaafd010927c tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:11.998714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a2ff716-5f1c-4107-965f-eaafd010927c tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:11.999329 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a2ff716-5f1c-4107-965f-eaafd010927c tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:12.000018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a2ff716-5f1c-4107-965f-eaafd010927c tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:12.032546 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-9a2ff716-5f1c-4107-965f-eaafd010927c tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] HTTP exception thrown: Instance f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 could not be found. Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9a2ff716-5f1c-4107-965f-eaafd010927c tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Request method failure captured: Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 HTTP/1.1 Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfxRwLQXvjY1JeGH8Xe6cDQYSHwzIOyo5qc0O6lJ1s-F2oU5tMO1rba15ZDBA6gpt3Hf0H04K9Q5BZhl0rFHi0xzTSz1pBe2TsUi18WG1ineTC8ywpX5uZeO6pZkZhN_vPaXeB_5W5-kSgqGZEMLNVndIGkX_BGt6RX-rXQVuSbIS8M Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.57 Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 96397ad30b9e40c9840bfc64d551612c Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerShowV257Test-1575832957 Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/96397ad30b9e40c9840bfc64d551612c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_96397ad30b9e40c9840bfc64d551612c", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/96397ad30b9e40c9840bfc64d551612c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/96397ad30b9e40c9840bfc64d551612c"}]}] Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerShowV257Test-1575832957 Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 96397ad30b9e40c9840bfc64d551612c Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerShowV257Test-1575832957 Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerShowV257Test-1575832957-project Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 64d2ea3205fe413d84ff2e2dd39ef1ac Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerShowV257Test-1575832957-project Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 could not be found. Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'f5e7b786-9dc3-47fa-b86e-46fe8af8bf99'} Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 could not be found. Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 could not be found. Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:12.038953 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:12.049963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:12.049963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:25:12.049963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:25:12.049963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:25:12.049963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:25:12.049963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 could not be found. Aug 24 10:25:12.049963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:12.049963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9a2ff716-5f1c-4107-965f-eaafd010927c tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] Returning 404 to user: Instance f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:25:12.049963 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9a2ff716-5f1c-4107-965f-eaafd010927c tempest-ServerShowV257Test-1575832957 tempest-ServerShowV257Test-1575832957-project] 10.222.0.85 "GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99" status: 404 len: 111 microversion: 2.57 time: 0.073496 Aug 24 10:25:12.057930 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1685/3041] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:25:11 2022] GET /compute/v2.1/servers/f5e7b786-9dc3-47fa-b86e-46fe8af8bf99 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:25:12.062614 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cae74b3c-3b7e-4dbd-a3b8-6f695a463507 tempest-FloatingIPDetailsTestJSON-1559920032 tempest-FloatingIPDetailsTestJSON-1559920032-project] Action: 'create', calling method: .version_select at 0x7f4647df01f0>, body: {"pool": null} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:25:12.164696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f6ff55c0-bb8f-49ac-80be-54ee5f40e2ed tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:12.173278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:12.179445 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f6ff55c0-bb8f-49ac-80be-54ee5f40e2ed tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 200 len: 1507 microversion: 2.1 time: 0.870077 Aug 24 10:25:12.181761 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1357/3042] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:11 2022] GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 1507 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:12.194644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c307f34d-3c85-4d79-a13c-45ba41551a23 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:12.195363 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c307f34d-3c85-4d79-a13c-45ba41551a23 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 84e1c064-02ae-48d5-9b75-ce57b9a3758f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:12.214434 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c307f34d-3c85-4d79-a13c-45ba41551a23 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:12.215041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c307f34d-3c85-4d79-a13c-45ba41551a23 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:12.215612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c307f34d-3c85-4d79-a13c-45ba41551a23 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:12.216500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c307f34d-3c85-4d79-a13c-45ba41551a23 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:12.216950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c307f34d-3c85-4d79-a13c-45ba41551a23 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:12.218382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c307f34d-3c85-4d79-a13c-45ba41551a23 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:12.503304 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c307f34d-3c85-4d79-a13c-45ba41551a23 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:12.513691 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c307f34d-3c85-4d79-a13c-45ba41551a23 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f" status: 200 len: 1272 microversion: 2.1 time: 0.323394 Aug 24 10:25:12.523777 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1358/3043] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:12 2022] GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f => generated 1272 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:12.530084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-162908de-143e-4818-a048-07552bcf3ae9 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:12.531059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-162908de-143e-4818-a048-07552bcf3ae9 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] [instance: c7361027-6bfd-4d6a-b6fb-5207f4291812] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:12.547506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-162908de-143e-4818-a048-07552bcf3ae9 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:12.548006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-162908de-143e-4818-a048-07552bcf3ae9 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:12.552610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-162908de-143e-4818-a048-07552bcf3ae9 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:12.554117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-162908de-143e-4818-a048-07552bcf3ae9 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:12.554543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-162908de-143e-4818-a048-07552bcf3ae9 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:12.554996 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-162908de-143e-4818-a048-07552bcf3ae9 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:13.352093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-162908de-143e-4818-a048-07552bcf3ae9 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f0e4fb1dae471eadb630004ba3e36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c26ec50b7740b5b0b58878c1c99097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:13.373490 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-162908de-143e-4818-a048-07552bcf3ae9 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] 10.222.0.85 "GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812" status: 200 len: 1275 microversion: 2.1 time: 0.846428 Aug 24 10:25:13.374172 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1359/3044] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:12 2022] GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812 => generated 1275 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:13.403792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-072fc4d7-21a0-45ce-88b9-40a5e449bdc4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:13.404455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-072fc4d7-21a0-45ce-88b9-40a5e449bdc4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:13.440340 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-072fc4d7-21a0-45ce-88b9-40a5e449bdc4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:13.441035 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-072fc4d7-21a0-45ce-88b9-40a5e449bdc4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:13.441529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-072fc4d7-21a0-45ce-88b9-40a5e449bdc4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:13.442297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-072fc4d7-21a0-45ce-88b9-40a5e449bdc4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:13.442769 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-072fc4d7-21a0-45ce-88b9-40a5e449bdc4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:13.454572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-072fc4d7-21a0-45ce-88b9-40a5e449bdc4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:14.266434 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-072fc4d7-21a0-45ce-88b9-40a5e449bdc4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:14.280505 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-072fc4d7-21a0-45ce-88b9-40a5e449bdc4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 200 len: 1507 microversion: 2.1 time: 0.899910 Aug 24 10:25:14.293733 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1360/3045] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:13 2022] GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 1507 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:14.306840 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3309c3ee-0f2f-4d41-97d6-abdfcd638f78 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:14.309837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3309c3ee-0f2f-4d41-97d6-abdfcd638f78 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 84e1c064-02ae-48d5-9b75-ce57b9a3758f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:14.317782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3309c3ee-0f2f-4d41-97d6-abdfcd638f78 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:14.318712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3309c3ee-0f2f-4d41-97d6-abdfcd638f78 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:14.319366 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3309c3ee-0f2f-4d41-97d6-abdfcd638f78 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:14.326034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3309c3ee-0f2f-4d41-97d6-abdfcd638f78 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:14.326829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3309c3ee-0f2f-4d41-97d6-abdfcd638f78 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:14.327463 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3309c3ee-0f2f-4d41-97d6-abdfcd638f78 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:15.280125 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3309c3ee-0f2f-4d41-97d6-abdfcd638f78 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:15.301345 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3309c3ee-0f2f-4d41-97d6-abdfcd638f78 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f" status: 200 len: 1314 microversion: 2.1 time: 1.006150 Aug 24 10:25:15.319050 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1361/3046] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:14 2022] GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f => generated 1314 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:15.331647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-72bf35b8-05bf-46f0-8a0e-6c86cad23887 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:15.332457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-72bf35b8-05bf-46f0-8a0e-6c86cad23887 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] [instance: c7361027-6bfd-4d6a-b6fb-5207f4291812] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:15.349506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72bf35b8-05bf-46f0-8a0e-6c86cad23887 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:15.350184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72bf35b8-05bf-46f0-8a0e-6c86cad23887 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:15.352893 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72bf35b8-05bf-46f0-8a0e-6c86cad23887 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:15.353742 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72bf35b8-05bf-46f0-8a0e-6c86cad23887 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:15.354232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72bf35b8-05bf-46f0-8a0e-6c86cad23887 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:15.361576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72bf35b8-05bf-46f0-8a0e-6c86cad23887 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:16.619647 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cae74b3c-3b7e-4dbd-a3b8-6f695a463507 tempest-FloatingIPDetailsTestJSON-1559920032 tempest-FloatingIPDetailsTestJSON-1559920032-project] 10.222.0.85 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.554937 Aug 24 10:25:16.628198 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1686/3047] 10.222.0.85 () {60 vars in 1170 bytes} [Wed Aug 24 10:25:12 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:16.640500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ddf5b068-6e22-4554-a569-d7b639417b56 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:16.641399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ddf5b068-6e22-4554-a569-d7b639417b56 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:16.660581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddf5b068-6e22-4554-a569-d7b639417b56 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:16.661653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddf5b068-6e22-4554-a569-d7b639417b56 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:16.662403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddf5b068-6e22-4554-a569-d7b639417b56 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:16.664079 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddf5b068-6e22-4554-a569-d7b639417b56 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:16.665875 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddf5b068-6e22-4554-a569-d7b639417b56 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:16.666572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddf5b068-6e22-4554-a569-d7b639417b56 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:16.697960 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-72bf35b8-05bf-46f0-8a0e-6c86cad23887 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f0e4fb1dae471eadb630004ba3e36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c26ec50b7740b5b0b58878c1c99097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:16.709397 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-72bf35b8-05bf-46f0-8a0e-6c86cad23887 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] 10.222.0.85 "GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812" status: 200 len: 1317 microversion: 2.1 time: 1.399670 Aug 24 10:25:16.710006 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1362/3048] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:15 2022] GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812 => generated 1317 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:16.727063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-81313127-bdde-452c-84b9-ed74cab0a56a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:16.727928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-81313127-bdde-452c-84b9-ed74cab0a56a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 84e1c064-02ae-48d5-9b75-ce57b9a3758f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:16.738550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81313127-bdde-452c-84b9-ed74cab0a56a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:16.745928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81313127-bdde-452c-84b9-ed74cab0a56a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:16.750577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81313127-bdde-452c-84b9-ed74cab0a56a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:16.751887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81313127-bdde-452c-84b9-ed74cab0a56a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:16.752527 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81313127-bdde-452c-84b9-ed74cab0a56a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:16.753214 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81313127-bdde-452c-84b9-ed74cab0a56a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:17.081424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:17.155605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ddf5b068-6e22-4554-a569-d7b639417b56 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:17.180111 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ddf5b068-6e22-4554-a569-d7b639417b56 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 200 len: 1507 microversion: 2.1 time: 0.556478 Aug 24 10:25:17.189448 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1687/3049] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:16 2022] GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 1507 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:17.189448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b5cb46ab-36fe-4128-bf34-5b9a96b57387 tempest-FloatingIPDetailsTestJSON-1559920032 tempest-FloatingIPDetailsTestJSON-1559920032-project] Action: 'create', calling method: .version_select at 0x7f4647cafb80>, body: {"pool": null} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:25:17.766112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-81313127-bdde-452c-84b9-ed74cab0a56a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:17.775919 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-81313127-bdde-452c-84b9-ed74cab0a56a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f" status: 200 len: 1314 microversion: 2.1 time: 1.058051 Aug 24 10:25:17.776775 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1363/3050] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:16 2022] GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f => generated 1314 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:17.985163 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4023cf0e-57f5-4317-8d9a-25aed3b7d8eb tempest-QuotasTestJSON-723034613 tempest-QuotasTestJSON-723034613-project] Calling method '.version_select at 0x7f46552dde50>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:18.072313 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4023cf0e-57f5-4317-8d9a-25aed3b7d8eb tempest-QuotasTestJSON-723034613 tempest-QuotasTestJSON-723034613-project] 10.222.0.85 "GET /compute/v2.1/os-quota-sets/14e13579dc804978b59be34323ceb666/defaults" status: 200 len: 371 microversion: 2.1 time: 0.293966 Aug 24 10:25:18.074532 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1364/3051] 10.222.0.85 () {58 vars in 1269 bytes} [Wed Aug 24 10:25:17 2022] GET /compute/v2.1/os-quota-sets/14e13579dc804978b59be34323ceb666/defaults => generated 371 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:18.088441 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-65a29705-8d27-4eff-b3ab-d3806d219649 req-871c6970-a50d-48e5-aaca-0d910a846271 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84e1c064-02ae-48d5-9b75-ce57b9a3758f", "tag": "e59f3c6f-c02e-47ea-ba5c-3390444e8bec"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:25:18.100294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-65a29705-8d27-4eff-b3ab-d3806d219649 req-871c6970-a50d-48e5-aaca-0d910a846271 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:18.100790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-65a29705-8d27-4eff-b3ab-d3806d219649 req-871c6970-a50d-48e5-aaca-0d910a846271 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:18.101256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-65a29705-8d27-4eff-b3ab-d3806d219649 req-871c6970-a50d-48e5-aaca-0d910a846271 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:18.116193 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-65a29705-8d27-4eff-b3ab-d3806d219649 req-871c6970-a50d-48e5-aaca-0d910a846271 service nova] Creating event network-changed:e59f3c6f-c02e-47ea-ba5c-3390444e8bec for instance 84e1c064-02ae-48d5-9b75-ce57b9a3758f on n-h1-849328-3 Aug 24 10:25:18.123843 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-65a29705-8d27-4eff-b3ab-d3806d219649 req-871c6970-a50d-48e5-aaca-0d910a846271 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047893 Aug 24 10:25:18.125416 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1365/3052] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:18.131715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d97157c2-7b30-462e-bc71-f14ec256a88d tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:18.133275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d97157c2-7b30-462e-bc71-f14ec256a88d tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] [instance: c7361027-6bfd-4d6a-b6fb-5207f4291812] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:18.143123 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d97157c2-7b30-462e-bc71-f14ec256a88d tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:18.144177 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d97157c2-7b30-462e-bc71-f14ec256a88d tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:18.144795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d97157c2-7b30-462e-bc71-f14ec256a88d tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:18.145914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d97157c2-7b30-462e-bc71-f14ec256a88d tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:18.146612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d97157c2-7b30-462e-bc71-f14ec256a88d tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:18.147345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d97157c2-7b30-462e-bc71-f14ec256a88d tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:18.838859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=24 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:19.044883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d97157c2-7b30-462e-bc71-f14ec256a88d tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f0e4fb1dae471eadb630004ba3e36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c26ec50b7740b5b0b58878c1c99097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:19.067853 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d97157c2-7b30-462e-bc71-f14ec256a88d tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] 10.222.0.85 "GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812" status: 200 len: 1317 microversion: 2.1 time: 0.940915 Aug 24 10:25:19.077148 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1366/3053] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:18 2022] GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812 => generated 1317 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:19.077148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bdd6355b-19d1-456b-9ed9-9860d557793f tempest-QuotasTestJSON-723034613 tempest-QuotasTestJSON-723034613-project] Calling method '.version_select at 0x7f4654d3ec10>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:19.403597 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bdd6355b-19d1-456b-9ed9-9860d557793f tempest-QuotasTestJSON-723034613 tempest-QuotasTestJSON-723034613-project] 10.222.0.85 "GET /compute/v2.1/os-quota-sets/14e13579dc804978b59be34323ceb666" status: 200 len: 371 microversion: 2.1 time: 0.333649 Aug 24 10:25:19.413214 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1367/3054] 10.222.0.85 () {58 vars in 1242 bytes} [Wed Aug 24 10:25:19 2022] GET /compute/v2.1/os-quota-sets/14e13579dc804978b59be34323ceb666 => generated 371 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:19.418996 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d483fcf4-ec43-455e-b79e-968817f2cfa8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:19.419628 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d483fcf4-ec43-455e-b79e-968817f2cfa8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:19.425993 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d483fcf4-ec43-455e-b79e-968817f2cfa8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:19.426464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d483fcf4-ec43-455e-b79e-968817f2cfa8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:19.427095 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d483fcf4-ec43-455e-b79e-968817f2cfa8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:19.427989 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d483fcf4-ec43-455e-b79e-968817f2cfa8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:19.428752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d483fcf4-ec43-455e-b79e-968817f2cfa8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:19.429373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d483fcf4-ec43-455e-b79e-968817f2cfa8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:20.022549 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d483fcf4-ec43-455e-b79e-968817f2cfa8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:20.031752 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d483fcf4-ec43-455e-b79e-968817f2cfa8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 200 len: 1507 microversion: 2.1 time: 0.617105 Aug 24 10:25:20.035667 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1368/3055] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:19 2022] GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 1507 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:20.059379 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2e4faf3c-4628-4189-99ea-df00693775e8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:20.059379 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2e4faf3c-4628-4189-99ea-df00693775e8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 84e1c064-02ae-48d5-9b75-ce57b9a3758f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:20.083241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e4faf3c-4628-4189-99ea-df00693775e8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:20.084032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e4faf3c-4628-4189-99ea-df00693775e8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:20.084638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e4faf3c-4628-4189-99ea-df00693775e8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:20.085529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e4faf3c-4628-4189-99ea-df00693775e8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:20.086236 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e4faf3c-4628-4189-99ea-df00693775e8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:20.086879 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e4faf3c-4628-4189-99ea-df00693775e8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:20.419726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2e4faf3c-4628-4189-99ea-df00693775e8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:20.432026 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2e4faf3c-4628-4189-99ea-df00693775e8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f" status: 200 len: 1314 microversion: 2.1 time: 0.377200 Aug 24 10:25:20.434576 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1369/3056] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:20 2022] GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:20.439532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-49785ab9-d4f1-4a60-9c11-22b08f0ce98a tempest-QuotasTestJSON-723034613 tempest-QuotasTestJSON-723034613-project] Calling method '.version_select at 0x7f4654cdf1f0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:20.976642 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-49785ab9-d4f1-4a60-9c11-22b08f0ce98a tempest-QuotasTestJSON-723034613 tempest-QuotasTestJSON-723034613-project] 10.222.0.85 "GET /compute/v2.1/os-quota-sets/14e13579dc804978b59be34323ceb666/defaults" status: 200 len: 371 microversion: 2.1 time: 0.540453 Aug 24 10:25:20.977075 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1370/3057] 10.222.0.85 () {58 vars in 1269 bytes} [Wed Aug 24 10:25:20 2022] GET /compute/v2.1/os-quota-sets/14e13579dc804978b59be34323ceb666/defaults => generated 371 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:20.994182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92647170-7872-4dda-b032-296ba23bf228 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:20.994182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-92647170-7872-4dda-b032-296ba23bf228 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] [instance: c7361027-6bfd-4d6a-b6fb-5207f4291812] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:21.021810 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92647170-7872-4dda-b032-296ba23bf228 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:21.023249 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92647170-7872-4dda-b032-296ba23bf228 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:21.024478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92647170-7872-4dda-b032-296ba23bf228 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:21.027390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92647170-7872-4dda-b032-296ba23bf228 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:21.028081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92647170-7872-4dda-b032-296ba23bf228 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:21.028847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92647170-7872-4dda-b032-296ba23bf228 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:21.283464 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b5cb46ab-36fe-4128-bf34-5b9a96b57387 tempest-FloatingIPDetailsTestJSON-1559920032 tempest-FloatingIPDetailsTestJSON-1559920032-project] 10.222.0.85 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.101655 Aug 24 10:25:21.284120 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1688/3058] 10.222.0.85 () {60 vars in 1170 bytes} [Wed Aug 24 10:25:17 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:21.292757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-78834959-baeb-45a6-b3aa-886b5ad6883c req-0c85ac54-a501-405c-a1cc-337b63bce8ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7361027-6bfd-4d6a-b6fb-5207f4291812", "tag": "3992b73c-3901-4833-8c5d-0ada6e74a1c3"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:25:21.311855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-78834959-baeb-45a6-b3aa-886b5ad6883c req-0c85ac54-a501-405c-a1cc-337b63bce8ee service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:21.312663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-78834959-baeb-45a6-b3aa-886b5ad6883c req-0c85ac54-a501-405c-a1cc-337b63bce8ee service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:21.313453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-78834959-baeb-45a6-b3aa-886b5ad6883c req-0c85ac54-a501-405c-a1cc-337b63bce8ee service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:21.327140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:21.329344 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-78834959-baeb-45a6-b3aa-886b5ad6883c req-0c85ac54-a501-405c-a1cc-337b63bce8ee service nova] Creating event network-changed:3992b73c-3901-4833-8c5d-0ada6e74a1c3 for instance c7361027-6bfd-4d6a-b6fb-5207f4291812 on n-h1-849328-3 Aug 24 10:25:21.336157 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-78834959-baeb-45a6-b3aa-886b5ad6883c req-0c85ac54-a501-405c-a1cc-337b63bce8ee service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050395 Aug 24 10:25:21.337028 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1689/3059] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:21.343468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1b7647f8-c3ae-424e-b89e-1f64c2fc8223 tempest-QuotasTestJSON-723034613 tempest-QuotasTestJSON-723034613-project] Calling method '.version_select at 0x7f4647caf3a0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:21.560931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-92647170-7872-4dda-b032-296ba23bf228 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f0e4fb1dae471eadb630004ba3e36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c26ec50b7740b5b0b58878c1c99097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:21.579077 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-92647170-7872-4dda-b032-296ba23bf228 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] 10.222.0.85 "GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812" status: 200 len: 1317 microversion: 2.1 time: 0.597964 Aug 24 10:25:21.583556 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1371/3060] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:20 2022] GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812 => generated 1317 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:21.613056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-18718463-ee6a-41b6-8fc7-3fd6b736aa84 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:21.619685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-18718463-ee6a-41b6-8fc7-3fd6b736aa84 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:21.646946 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18718463-ee6a-41b6-8fc7-3fd6b736aa84 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:21.649971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18718463-ee6a-41b6-8fc7-3fd6b736aa84 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:21.656050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18718463-ee6a-41b6-8fc7-3fd6b736aa84 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:21.657522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18718463-ee6a-41b6-8fc7-3fd6b736aa84 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:21.659162 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18718463-ee6a-41b6-8fc7-3fd6b736aa84 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:21.662890 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18718463-ee6a-41b6-8fc7-3fd6b736aa84 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:22.021207 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1b7647f8-c3ae-424e-b89e-1f64c2fc8223 tempest-QuotasTestJSON-723034613 tempest-QuotasTestJSON-723034613-project] 10.222.0.85 "GET /compute/v2.1/os-quota-sets/14e13579dc804978b59be34323ceb666" status: 200 len: 371 microversion: 2.1 time: 0.682672 Aug 24 10:25:22.021828 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1690/3061] 10.222.0.85 () {58 vars in 1242 bytes} [Wed Aug 24 10:25:21 2022] GET /compute/v2.1/os-quota-sets/14e13579dc804978b59be34323ceb666 => generated 371 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:22.033769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e7b6ba6d-1bb6-4f5b-bd12-2e2bd8a679f0 tempest-FloatingIPDetailsTestJSON-1559920032 tempest-FloatingIPDetailsTestJSON-1559920032-project] Action: 'create', calling method: .version_select at 0x7f4647d53670>, body: {"pool": null} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:25:22.182577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-18718463-ee6a-41b6-8fc7-3fd6b736aa84 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:22.208784 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-18718463-ee6a-41b6-8fc7-3fd6b736aa84 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 200 len: 1507 microversion: 2.1 time: 0.618825 Aug 24 10:25:22.228090 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1372/3062] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:21 2022] GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 1507 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:22.253798 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-344d298e-2418-4a1d-8bc0-21b8f59f24ea tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:22.261670 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-344d298e-2418-4a1d-8bc0-21b8f59f24ea tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 84e1c064-02ae-48d5-9b75-ce57b9a3758f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:22.279459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-344d298e-2418-4a1d-8bc0-21b8f59f24ea tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:22.282458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-344d298e-2418-4a1d-8bc0-21b8f59f24ea tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:22.283052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-344d298e-2418-4a1d-8bc0-21b8f59f24ea tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:22.283984 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-344d298e-2418-4a1d-8bc0-21b8f59f24ea tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:22.290037 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-344d298e-2418-4a1d-8bc0-21b8f59f24ea tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:22.290660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-344d298e-2418-4a1d-8bc0-21b8f59f24ea tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:23.473764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-344d298e-2418-4a1d-8bc0-21b8f59f24ea tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:23.516167 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-344d298e-2418-4a1d-8bc0-21b8f59f24ea tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f" status: 200 len: 1314 microversion: 2.1 time: 1.280645 Aug 24 10:25:23.517211 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1373/3063] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:22 2022] GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f => generated 1314 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:23.527918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0c058a07-58c9-465b-8cfe-55480914baae tempest-QuotasTestJSON-723034613 tempest-QuotasTestJSON-723034613-project] Calling method '.version_select at 0x7f465a2a3f70>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:23.753950 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0c058a07-58c9-465b-8cfe-55480914baae tempest-QuotasTestJSON-723034613 tempest-QuotasTestJSON-723034613-project] 10.222.0.85 "GET /compute/v2.1/os-quota-sets/14e13579dc804978b59be34323ceb666?user_id=db2ab87e167441599727dbb5f956c68c" status: 200 len: 371 microversion: 2.1 time: 0.234378 Aug 24 10:25:23.756444 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1374/3064] 10.222.0.85 () {58 vars in 1323 bytes} [Wed Aug 24 10:25:23 2022] GET /compute/v2.1/os-quota-sets/14e13579dc804978b59be34323ceb666?user_id=db2ab87e167441599727dbb5f956c68c => generated 371 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:23.771435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3b60a9db-b064-40ec-a449-a39a51668757 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:23.772466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3b60a9db-b064-40ec-a449-a39a51668757 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] [instance: c7361027-6bfd-4d6a-b6fb-5207f4291812] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:23.782190 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b60a9db-b064-40ec-a449-a39a51668757 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:23.783910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b60a9db-b064-40ec-a449-a39a51668757 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:23.784686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b60a9db-b064-40ec-a449-a39a51668757 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:23.785716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b60a9db-b064-40ec-a449-a39a51668757 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:23.786565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b60a9db-b064-40ec-a449-a39a51668757 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:23.787577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b60a9db-b064-40ec-a449-a39a51668757 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:24.705047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3b60a9db-b064-40ec-a449-a39a51668757 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f0e4fb1dae471eadb630004ba3e36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c26ec50b7740b5b0b58878c1c99097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:24.723854 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3b60a9db-b064-40ec-a449-a39a51668757 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] 10.222.0.85 "GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812" status: 200 len: 1317 microversion: 2.1 time: 0.965660 Aug 24 10:25:24.724500 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1375/3065] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:23 2022] GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812 => generated 1317 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:24.756904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-be968d01-ff15-4025-bbf9-75d496bacc58 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:24.758727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-be968d01-ff15-4025-bbf9-75d496bacc58 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:24.769544 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be968d01-ff15-4025-bbf9-75d496bacc58 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:24.770409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be968d01-ff15-4025-bbf9-75d496bacc58 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:24.771088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be968d01-ff15-4025-bbf9-75d496bacc58 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:24.772274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be968d01-ff15-4025-bbf9-75d496bacc58 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:24.774091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be968d01-ff15-4025-bbf9-75d496bacc58 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:24.774875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be968d01-ff15-4025-bbf9-75d496bacc58 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:25.604453 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-be968d01-ff15-4025-bbf9-75d496bacc58 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:25.616305 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-be968d01-ff15-4025-bbf9-75d496bacc58 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 200 len: 1507 microversion: 2.1 time: 0.875621 Aug 24 10:25:25.620581 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1376/3066] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:24 2022] GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 1507 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:25.639760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-907f9b0a-a527-4f1b-8915-fff285a70536 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:25.640976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-907f9b0a-a527-4f1b-8915-fff285a70536 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 84e1c064-02ae-48d5-9b75-ce57b9a3758f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:25.657093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-907f9b0a-a527-4f1b-8915-fff285a70536 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:25.659128 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-907f9b0a-a527-4f1b-8915-fff285a70536 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:25.660121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-907f9b0a-a527-4f1b-8915-fff285a70536 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:25.663328 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-907f9b0a-a527-4f1b-8915-fff285a70536 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:25.664091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-907f9b0a-a527-4f1b-8915-fff285a70536 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:25.670315 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-907f9b0a-a527-4f1b-8915-fff285a70536 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:26.306040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-907f9b0a-a527-4f1b-8915-fff285a70536 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:26.344578 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-907f9b0a-a527-4f1b-8915-fff285a70536 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f" status: 200 len: 1314 microversion: 2.1 time: 0.721537 Aug 24 10:25:26.345963 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1377/3067] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:25 2022] GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f => generated 1314 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:26.378921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-ecdbaf4a-2c92-4f4e-9f6f-7ea6128e4a90 req-5c6f0693-bb33-4b8c-ac89-919559e305bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e1c064-02ae-48d5-9b75-ce57b9a3758f", "name": "network-vif-plugged", "status": "completed", "tag": "e59f3c6f-c02e-47ea-ba5c-3390444e8bec"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:25:26.430921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ecdbaf4a-2c92-4f4e-9f6f-7ea6128e4a90 req-5c6f0693-bb33-4b8c-ac89-919559e305bc service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:26.431808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ecdbaf4a-2c92-4f4e-9f6f-7ea6128e4a90 req-5c6f0693-bb33-4b8c-ac89-919559e305bc service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:26.447196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ecdbaf4a-2c92-4f4e-9f6f-7ea6128e4a90 req-5c6f0693-bb33-4b8c-ac89-919559e305bc service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:26.531852 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-ecdbaf4a-2c92-4f4e-9f6f-7ea6128e4a90 req-5c6f0693-bb33-4b8c-ac89-919559e305bc service nova] Creating event network-vif-plugged:e59f3c6f-c02e-47ea-ba5c-3390444e8bec for instance 84e1c064-02ae-48d5-9b75-ce57b9a3758f on n-h1-849328-3 Aug 24 10:25:26.549588 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-ecdbaf4a-2c92-4f4e-9f6f-7ea6128e4a90 req-5c6f0693-bb33-4b8c-ac89-919559e305bc service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183767 Aug 24 10:25:26.550407 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1378/3068] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:26.571025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-44569835-f9df-407e-8e8c-ccf08fc13f0c tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:26.571774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-44569835-f9df-407e-8e8c-ccf08fc13f0c tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] [instance: c7361027-6bfd-4d6a-b6fb-5207f4291812] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:26.603298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44569835-f9df-407e-8e8c-ccf08fc13f0c tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:26.604037 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44569835-f9df-407e-8e8c-ccf08fc13f0c tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:26.604797 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44569835-f9df-407e-8e8c-ccf08fc13f0c tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:26.606178 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44569835-f9df-407e-8e8c-ccf08fc13f0c tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:26.606908 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44569835-f9df-407e-8e8c-ccf08fc13f0c tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:26.607538 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44569835-f9df-407e-8e8c-ccf08fc13f0c tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:27.351010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-44569835-f9df-407e-8e8c-ccf08fc13f0c tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f0e4fb1dae471eadb630004ba3e36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c26ec50b7740b5b0b58878c1c99097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:27.355570 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:27.381184 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-44569835-f9df-407e-8e8c-ccf08fc13f0c tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] 10.222.0.85 "GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812" status: 200 len: 1317 microversion: 2.1 time: 0.826486 Aug 24 10:25:27.384457 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1379/3069] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:26 2022] GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812 => generated 1317 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:27.400694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bbd77f79-6ae6-4b00-8e8d-d0c34a46d9ef tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:27.401748 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bbd77f79-6ae6-4b00-8e8d-d0c34a46d9ef tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:27.418780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:27.422257 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd77f79-6ae6-4b00-8e8d-d0c34a46d9ef tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:27.422793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd77f79-6ae6-4b00-8e8d-d0c34a46d9ef tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:27.423247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd77f79-6ae6-4b00-8e8d-d0c34a46d9ef tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:27.425225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd77f79-6ae6-4b00-8e8d-d0c34a46d9ef tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:27.426668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd77f79-6ae6-4b00-8e8d-d0c34a46d9ef tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:27.427104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd77f79-6ae6-4b00-8e8d-d0c34a46d9ef tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:27.834891 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e7b6ba6d-1bb6-4f5b-bd12-2e2bd8a679f0 tempest-FloatingIPDetailsTestJSON-1559920032 tempest-FloatingIPDetailsTestJSON-1559920032-project] 10.222.0.85 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.804920 Aug 24 10:25:27.845109 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1691/3070] 10.222.0.85 () {60 vars in 1170 bytes} [Wed Aug 24 10:25:22 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:27.857679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-423004ff-ae67-4f9c-9464-b8c88bede309 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:27.858995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-423004ff-ae67-4f9c-9464-b8c88bede309 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 84e1c064-02ae-48d5-9b75-ce57b9a3758f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:27.872549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=35 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:27.890348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-423004ff-ae67-4f9c-9464-b8c88bede309 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:27.892086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-423004ff-ae67-4f9c-9464-b8c88bede309 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:27.892781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-423004ff-ae67-4f9c-9464-b8c88bede309 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:27.895480 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-423004ff-ae67-4f9c-9464-b8c88bede309 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:27.897615 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-423004ff-ae67-4f9c-9464-b8c88bede309 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:27.899353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-423004ff-ae67-4f9c-9464-b8c88bede309 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:27.944596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bbd77f79-6ae6-4b00-8e8d-d0c34a46d9ef tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:27.955070 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bbd77f79-6ae6-4b00-8e8d-d0c34a46d9ef tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 200 len: 1487 microversion: 2.1 time: 0.568894 Aug 24 10:25:27.960604 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1380/3071] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:27 2022] GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 1487 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:27.973986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f0605544-4a1e-465d-8281-6e730724412e tempest-FloatingIPDetailsTestJSON-1559920032 tempest-FloatingIPDetailsTestJSON-1559920032-project] Calling method '.version_select at 0x7f4655039d30>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:28.364755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-423004ff-ae67-4f9c-9464-b8c88bede309 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:28.416950 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-423004ff-ae67-4f9c-9464-b8c88bede309 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f" status: 200 len: 1314 microversion: 2.1 time: 0.568031 Aug 24 10:25:28.420142 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1692/3072] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:27 2022] GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f => generated 1314 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:28.435708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a2fbc0b0-7b0b-4b7f-b382-a861422320a9 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1265831412", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:25:28.528760 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f0605544-4a1e-465d-8281-6e730724412e tempest-FloatingIPDetailsTestJSON-1559920032 tempest-FloatingIPDetailsTestJSON-1559920032-project] 10.222.0.85 "GET /compute/v2.1/os-floating-ips/2c8c2df5-a853-4085-90c1-067ce112637b" status: 200 len: 141 microversion: 2.1 time: 0.566860 Aug 24 10:25:28.529406 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1381/3073] 10.222.0.85 () {58 vars in 1260 bytes} [Wed Aug 24 10:25:27 2022] GET /compute/v2.1/os-floating-ips/2c8c2df5-a853-4085-90c1-067ce112637b => generated 141 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:28.535549 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ae5ef168-8710-4c1c-892a-46ddc162e644 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:28.536209 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ae5ef168-8710-4c1c-892a-46ddc162e644 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] [instance: c7361027-6bfd-4d6a-b6fb-5207f4291812] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:28.554444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae5ef168-8710-4c1c-892a-46ddc162e644 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:28.555229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae5ef168-8710-4c1c-892a-46ddc162e644 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:28.557884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae5ef168-8710-4c1c-892a-46ddc162e644 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:28.560010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae5ef168-8710-4c1c-892a-46ddc162e644 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:28.562418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae5ef168-8710-4c1c-892a-46ddc162e644 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:28.564125 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae5ef168-8710-4c1c-892a-46ddc162e644 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:28.603794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-a2fbc0b0-7b0b-4b7f-b382-a861422320a9 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] validate_networks() for [('778f7c02-32bb-4be3-a246-e526b0beccd6', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:25:29.038437 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ae5ef168-8710-4c1c-892a-46ddc162e644 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f0e4fb1dae471eadb630004ba3e36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c26ec50b7740b5b0b58878c1c99097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:29.052620 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ae5ef168-8710-4c1c-892a-46ddc162e644 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] 10.222.0.85 "GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812" status: 200 len: 1317 microversion: 2.1 time: 0.521960 Aug 24 10:25:29.055285 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1382/3074] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:28 2022] GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812 => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:29.072455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-73b82b73-313c-4ecc-95be-50351a441b89 tempest-FloatingIPDetailsTestJSON-1559920032 tempest-FloatingIPDetailsTestJSON-1559920032-project] Calling method '.version_select at 0x7f465a434b80>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:29.561892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a2fbc0b0-7b0b-4b7f-b382-a861422320a9 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:25:29.562322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a2fbc0b0-7b0b-4b7f-b382-a861422320a9 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:25:29.562790 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a2fbc0b0-7b0b-4b7f-b382-a861422320a9 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:25:29.563403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a2fbc0b0-7b0b-4b7f-b382-a861422320a9 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:25:29.563988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a2fbc0b0-7b0b-4b7f-b382-a861422320a9 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:25:29.584676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2fbc0b0-7b0b-4b7f-b382-a861422320a9 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:29.585250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2fbc0b0-7b0b-4b7f-b382-a861422320a9 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:29.585981 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2fbc0b0-7b0b-4b7f-b382-a861422320a9 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:29.587171 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2fbc0b0-7b0b-4b7f-b382-a861422320a9 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:29.587884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2fbc0b0-7b0b-4b7f-b382-a861422320a9 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:29.588628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2fbc0b0-7b0b-4b7f-b382-a861422320a9 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:29.611482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-a2fbc0b0-7b0b-4b7f-b382-a861422320a9 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Getting quotas for project de173a86ff8a446289ea3e98de1fd06b. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:25:29.619409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-a2fbc0b0-7b0b-4b7f-b382-a861422320a9 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Getting quotas for user 812c7ee5dd0f4be9b9745e10a89d5cf6 and project de173a86ff8a446289ea3e98de1fd06b. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:25:29.635875 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a2fbc0b0-7b0b-4b7f-b382-a861422320a9 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:25:29.639235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a2fbc0b0-7b0b-4b7f-b382-a861422320a9 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:25:29.698653 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a2fbc0b0-7b0b-4b7f-b382-a861422320a9 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.276539 Aug 24 10:25:29.700116 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1693/3075] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:25:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 1279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:25:30.147240 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b23db0cb-9657-4fb3-9051-8732b18ce6b4 tempest-FloatingIPDetailsNegativeTestJSON-1416332329 tempest-FloatingIPDetailsNegativeTestJSON-1416332329-project] Calling method '.version_select at 0x7f4647caf280>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:30.272723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG neutronclient.v2_0.client [None req-b23db0cb-9657-4fb3-9051-8732b18ce6b4 tempest-FloatingIPDetailsNegativeTestJSON-1416332329 tempest-FloatingIPDetailsNegativeTestJSON-1416332329-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 0f820ab3-eba9-4301-88d1-4c7ec4838661 could not be found", "detail": ""}} {{(pid=122433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 10:25:30.274866 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-b23db0cb-9657-4fb3-9051-8732b18ce6b4 tempest-FloatingIPDetailsNegativeTestJSON-1416332329 tempest-FloatingIPDetailsNegativeTestJSON-1416332329-project] HTTP exception thrown: Floating IP not found for ID 0f820ab3-eba9-4301-88d1-4c7ec4838661 Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b23db0cb-9657-4fb3-9051-8732b18ce6b4 tempest-FloatingIPDetailsNegativeTestJSON-1416332329 tempest-FloatingIPDetailsNegativeTestJSON-1416332329-project] Request method failure captured: Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-floating-ips/0f820ab3-eba9-4301-88d1-4c7ec4838661 HTTP/1.1 Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfyY4oTlFDLHbKKhF8Njj3-QZqdAa_OOdruUXURDsnEa52IqbMYgA88u4e2cJwpiEa29jjCFiXlRhgPNAH7vM-qdSQ7P1kj3yRZ489O2bqLv5SaJGX6V3Hqka0PHi1rSbhm1y5IF9IsESWvIkrmWYUaAhfdzuZlX2vXnuRlV1dhnAeU Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: b2dba0b4661f4925999c4ec6848f949d Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1416332329 Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b2dba0b4661f4925999c4ec6848f949d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b2dba0b4661f4925999c4ec6848f949d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b2dba0b4661f4925999c4ec6848f949d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b2dba0b4661f4925999c4ec6848f949d"}]}] Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1416332329 Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: b2dba0b4661f4925999c4ec6848f949d Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1416332329 Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1416332329-project Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 375b744c425b42f1b589b0fe5bf76e68 Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1416332329-project Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: exception: Floating IP not found for ID 0f820ab3-eba9-4301-88d1-4c7ec4838661 Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '0f820ab3-eba9-4301-88d1-4c7ec4838661'} Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 10:25:30.277153 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 0f820ab3-eba9-4301-88d1-4c7ec4838661 could not be found Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa012515-e2b7-45b6-bac8-b75b2f3e4295'] Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 0f820ab3-eba9-4301-88d1-4c7ec4838661. Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 0f820ab3-eba9-4301-88d1-4c7ec4838661 Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 0f820ab3-eba9-4301-88d1-4c7ec4838661 Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:30.282017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b23db0cb-9657-4fb3-9051-8732b18ce6b4 tempest-FloatingIPDetailsNegativeTestJSON-1416332329 tempest-FloatingIPDetailsNegativeTestJSON-1416332329-project] Returning 404 to user: Floating IP not found for ID 0f820ab3-eba9-4301-88d1-4c7ec4838661 {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:25:30.285584 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b23db0cb-9657-4fb3-9051-8732b18ce6b4 tempest-FloatingIPDetailsNegativeTestJSON-1416332329 tempest-FloatingIPDetailsNegativeTestJSON-1416332329-project] 10.222.0.85 "GET /compute/v2.1/os-floating-ips/0f820ab3-eba9-4301-88d1-4c7ec4838661" status: 404 len: 111 microversion: 2.1 time: 0.581652 Aug 24 10:25:30.286405 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1694/3076] 10.222.0.85 () {58 vars in 1260 bytes} [Wed Aug 24 10:25:29 2022] GET /compute/v2.1/os-floating-ips/0f820ab3-eba9-4301-88d1-4c7ec4838661 => generated 111 bytes in 586 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:25:30.301198 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2fbfb7b9-611d-46a2-8bb7-197ac94362ed tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:30.302900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2fbfb7b9-611d-46a2-8bb7-197ac94362ed tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 84e1c064-02ae-48d5-9b75-ce57b9a3758f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:30.318955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fbfb7b9-611d-46a2-8bb7-197ac94362ed tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:30.321494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fbfb7b9-611d-46a2-8bb7-197ac94362ed tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:30.322902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fbfb7b9-611d-46a2-8bb7-197ac94362ed tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:30.324739 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fbfb7b9-611d-46a2-8bb7-197ac94362ed tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:30.326468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fbfb7b9-611d-46a2-8bb7-197ac94362ed tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:30.329158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fbfb7b9-611d-46a2-8bb7-197ac94362ed tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:30.766768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2fbfb7b9-611d-46a2-8bb7-197ac94362ed tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:30.780030 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2fbfb7b9-611d-46a2-8bb7-197ac94362ed tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f" status: 200 len: 1501 microversion: 2.1 time: 0.490866 Aug 24 10:25:30.795414 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1695/3077] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:30 2022] GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f => generated 1501 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:30.827581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1d425529-33c2-4346-8eda-350eb67f0d6d tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:30.829798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1d425529-33c2-4346-8eda-350eb67f0d6d tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:30.850550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d425529-33c2-4346-8eda-350eb67f0d6d tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:30.853370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d425529-33c2-4346-8eda-350eb67f0d6d tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:30.854045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d425529-33c2-4346-8eda-350eb67f0d6d tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:30.854946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d425529-33c2-4346-8eda-350eb67f0d6d tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:30.855856 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d425529-33c2-4346-8eda-350eb67f0d6d tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:30.856310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d425529-33c2-4346-8eda-350eb67f0d6d tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:30.959854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1d425529-33c2-4346-8eda-350eb67f0d6d tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:30.979079 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1d425529-33c2-4346-8eda-350eb67f0d6d tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1218 microversion: 2.1 time: 0.177961 Aug 24 10:25:30.979751 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1696/3078] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:30 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1218 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:30.998139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-794640fe-1372-42b4-aa24-0de01302636f tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:30.998982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-794640fe-1372-42b4-aa24-0de01302636f tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] [instance: c7361027-6bfd-4d6a-b6fb-5207f4291812] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:31.017569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-794640fe-1372-42b4-aa24-0de01302636f tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:31.017569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-794640fe-1372-42b4-aa24-0de01302636f tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:31.017969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-794640fe-1372-42b4-aa24-0de01302636f tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:31.018923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-794640fe-1372-42b4-aa24-0de01302636f tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:31.021079 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-794640fe-1372-42b4-aa24-0de01302636f tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:31.022185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-794640fe-1372-42b4-aa24-0de01302636f tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:31.762489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-794640fe-1372-42b4-aa24-0de01302636f tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f0e4fb1dae471eadb630004ba3e36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c26ec50b7740b5b0b58878c1c99097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:31.775851 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-794640fe-1372-42b4-aa24-0de01302636f tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] 10.222.0.85 "GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812" status: 200 len: 1317 microversion: 2.1 time: 0.790321 Aug 24 10:25:31.777842 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1697/3079] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:30 2022] GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812 => generated 1317 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:31.786386 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a28be9a6-0a74-4293-b07e-68e6e73f37b4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:25:31.790193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a28be9a6-0a74-4293-b07e-68e6e73f37b4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 84e1c064-02ae-48d5-9b75-ce57b9a3758f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:31.806943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a28be9a6-0a74-4293-b07e-68e6e73f37b4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:31.807667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a28be9a6-0a74-4293-b07e-68e6e73f37b4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:31.807908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a28be9a6-0a74-4293-b07e-68e6e73f37b4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:31.808702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a28be9a6-0a74-4293-b07e-68e6e73f37b4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:31.809198 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a28be9a6-0a74-4293-b07e-68e6e73f37b4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:31.809626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a28be9a6-0a74-4293-b07e-68e6e73f37b4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:31.959072 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a28be9a6-0a74-4293-b07e-68e6e73f37b4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "POST /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f/action" status: 202 len: 0 microversion: 2.1 time: 0.179335 Aug 24 10:25:31.964473 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1698/3080] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:25:31 2022] POST /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:25:31.988898 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3aba75c8-e32d-42f0-91b1-2f6a7353920c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:31.992643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3aba75c8-e32d-42f0-91b1-2f6a7353920c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 84e1c064-02ae-48d5-9b75-ce57b9a3758f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:32.012287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3aba75c8-e32d-42f0-91b1-2f6a7353920c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:32.023072 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3aba75c8-e32d-42f0-91b1-2f6a7353920c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:32.023891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3aba75c8-e32d-42f0-91b1-2f6a7353920c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:32.024839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3aba75c8-e32d-42f0-91b1-2f6a7353920c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:32.025526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3aba75c8-e32d-42f0-91b1-2f6a7353920c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:32.029276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3aba75c8-e32d-42f0-91b1-2f6a7353920c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:32.972168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3aba75c8-e32d-42f0-91b1-2f6a7353920c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:32.995293 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3aba75c8-e32d-42f0-91b1-2f6a7353920c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f" status: 200 len: 1506 microversion: 2.1 time: 1.020943 Aug 24 10:25:32.998405 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1699/3081] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:31 2022] GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f => generated 1506 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:33.016042 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cc73da49-b330-42a1-99ab-a02f5c98187f tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:33.018953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cc73da49-b330-42a1-99ab-a02f5c98187f tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:33.041166 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc73da49-b330-42a1-99ab-a02f5c98187f tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:33.049763 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc73da49-b330-42a1-99ab-a02f5c98187f tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:33.051102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc73da49-b330-42a1-99ab-a02f5c98187f tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:33.052799 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc73da49-b330-42a1-99ab-a02f5c98187f tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:33.059461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc73da49-b330-42a1-99ab-a02f5c98187f tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:33.061108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc73da49-b330-42a1-99ab-a02f5c98187f tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:33.580622 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-73b82b73-313c-4ecc-95be-50351a441b89 tempest-FloatingIPDetailsTestJSON-1559920032 tempest-FloatingIPDetailsTestJSON-1559920032-project] 10.222.0.85 "DELETE /compute/v2.1/os-floating-ips/2c8c2df5-a853-4085-90c1-067ce112637b" status: 202 len: 0 microversion: 2.1 time: 4.523771 Aug 24 10:25:33.587185 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1383/3082] 10.222.0.85 () {58 vars in 1263 bytes} [Wed Aug 24 10:25:29 2022] DELETE /compute/v2.1/os-floating-ips/2c8c2df5-a853-4085-90c1-067ce112637b => generated 0 bytes in 4531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:25:33.595775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-09015002-a25c-4d91-88b1-6c313230b567 req-2a4d5add-4eb0-4d56-b820-f54f5f217b71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7361027-6bfd-4d6a-b6fb-5207f4291812", "name": "network-vif-plugged", "status": "completed", "tag": "3992b73c-3901-4833-8c5d-0ada6e74a1c3"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:25:33.647098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-09015002-a25c-4d91-88b1-6c313230b567 req-2a4d5add-4eb0-4d56-b820-f54f5f217b71 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:33.648464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-09015002-a25c-4d91-88b1-6c313230b567 req-2a4d5add-4eb0-4d56-b820-f54f5f217b71 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:33.648822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cc73da49-b330-42a1-99ab-a02f5c98187f tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:33.651402 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-09015002-a25c-4d91-88b1-6c313230b567 req-2a4d5add-4eb0-4d56-b820-f54f5f217b71 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:33.676575 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cc73da49-b330-42a1-99ab-a02f5c98187f tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1272 microversion: 2.1 time: 0.676054 Aug 24 10:25:33.689155 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1700/3083] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:32 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1272 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:33.689155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b45332eb-f7ba-4f8b-a192-8e2bf2bc4b43 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:33.689155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b45332eb-f7ba-4f8b-a192-8e2bf2bc4b43 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] [instance: c7361027-6bfd-4d6a-b6fb-5207f4291812] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:33.691601 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-09015002-a25c-4d91-88b1-6c313230b567 req-2a4d5add-4eb0-4d56-b820-f54f5f217b71 service nova] Creating event network-vif-plugged:3992b73c-3901-4833-8c5d-0ada6e74a1c3 for instance c7361027-6bfd-4d6a-b6fb-5207f4291812 on n-h1-849328-3 Aug 24 10:25:33.710895 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-09015002-a25c-4d91-88b1-6c313230b567 req-2a4d5add-4eb0-4d56-b820-f54f5f217b71 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121916 Aug 24 10:25:33.711815 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1384/3084] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:33.716041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b45332eb-f7ba-4f8b-a192-8e2bf2bc4b43 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:33.716551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b45332eb-f7ba-4f8b-a192-8e2bf2bc4b43 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:33.717000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b45332eb-f7ba-4f8b-a192-8e2bf2bc4b43 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:33.717706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d831b76b-68a2-4551-9b5f-afba907647ba tempest-FloatingIPDetailsTestJSON-1559920032 tempest-FloatingIPDetailsTestJSON-1559920032-project] Calling method '.version_select at 0x7f4654f97b80>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:33.717917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b45332eb-f7ba-4f8b-a192-8e2bf2bc4b43 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:33.718220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b45332eb-f7ba-4f8b-a192-8e2bf2bc4b43 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:33.718646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b45332eb-f7ba-4f8b-a192-8e2bf2bc4b43 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:33.747036 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:34.346886 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d831b76b-68a2-4551-9b5f-afba907647ba tempest-FloatingIPDetailsTestJSON-1559920032 tempest-FloatingIPDetailsTestJSON-1559920032-project] 10.222.0.85 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.633788 Aug 24 10:25:34.347713 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1385/3085] 10.222.0.85 () {58 vars in 1164 bytes} [Wed Aug 24 10:25:33 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:25:34.353226 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a4ea148c-7fce-4125-a6ab-a003833ffb3e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:34.356870 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a4ea148c-7fce-4125-a6ab-a003833ffb3e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 84e1c064-02ae-48d5-9b75-ce57b9a3758f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:34.383123 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4ea148c-7fce-4125-a6ab-a003833ffb3e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:34.384164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4ea148c-7fce-4125-a6ab-a003833ffb3e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:34.385087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4ea148c-7fce-4125-a6ab-a003833ffb3e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:34.386090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4ea148c-7fce-4125-a6ab-a003833ffb3e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:34.386908 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4ea148c-7fce-4125-a6ab-a003833ffb3e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:34.387574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4ea148c-7fce-4125-a6ab-a003833ffb3e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:34.651480 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b45332eb-f7ba-4f8b-a192-8e2bf2bc4b43 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f0e4fb1dae471eadb630004ba3e36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c26ec50b7740b5b0b58878c1c99097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:34.708007 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b45332eb-f7ba-4f8b-a192-8e2bf2bc4b43 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] 10.222.0.85 "GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812" status: 200 len: 1317 microversion: 2.1 time: 1.020539 Aug 24 10:25:34.727704 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1701/3086] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:33 2022] GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812 => generated 1317 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:34.735457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-27c213af-d48a-41b3-9252-fdae81760d06 tempest-FloatingIPDetailsTestJSON-1559920032 tempest-FloatingIPDetailsTestJSON-1559920032-project] Calling method '.version_select at 0x7f4647cae4c0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:34.803687 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a4ea148c-7fce-4125-a6ab-a003833ffb3e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:34.817565 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a4ea148c-7fce-4125-a6ab-a003833ffb3e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f" status: 200 len: 1486 microversion: 2.1 time: 0.468462 Aug 24 10:25:34.822781 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1386/3087] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:34 2022] GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f => generated 1486 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:34.837845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-592fcefc-bf73-4c1f-b7a3-e9984a629f17 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:34.838533 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-592fcefc-bf73-4c1f-b7a3-e9984a629f17 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:34.850657 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-592fcefc-bf73-4c1f-b7a3-e9984a629f17 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:34.851199 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-592fcefc-bf73-4c1f-b7a3-e9984a629f17 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:34.851652 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-592fcefc-bf73-4c1f-b7a3-e9984a629f17 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:34.852376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-592fcefc-bf73-4c1f-b7a3-e9984a629f17 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:34.852841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-592fcefc-bf73-4c1f-b7a3-e9984a629f17 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:34.853303 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-592fcefc-bf73-4c1f-b7a3-e9984a629f17 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:35.123449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-592fcefc-bf73-4c1f-b7a3-e9984a629f17 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:35.138774 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-592fcefc-bf73-4c1f-b7a3-e9984a629f17 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1272 microversion: 2.1 time: 0.314295 Aug 24 10:25:35.139402 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1387/3088] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:34 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1272 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:35.153749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2d45333f-c890-49dd-99a1-21f97c0f99f8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:35.154812 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2d45333f-c890-49dd-99a1-21f97c0f99f8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 84e1c064-02ae-48d5-9b75-ce57b9a3758f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:35.162505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d45333f-c890-49dd-99a1-21f97c0f99f8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:35.174225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d45333f-c890-49dd-99a1-21f97c0f99f8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:35.175012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d45333f-c890-49dd-99a1-21f97c0f99f8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:35.175981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d45333f-c890-49dd-99a1-21f97c0f99f8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:35.176628 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d45333f-c890-49dd-99a1-21f97c0f99f8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:35.177306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d45333f-c890-49dd-99a1-21f97c0f99f8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:35.224692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2d45333f-c890-49dd-99a1-21f97c0f99f8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 84e1c064-02ae-48d5-9b75-ce57b9a3758f] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:25:35.439000 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2d45333f-c890-49dd-99a1-21f97c0f99f8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "DELETE /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f" status: 204 len: 0 microversion: 2.1 time: 0.298057 Aug 24 10:25:35.439975 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1388/3089] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:25:35 2022] DELETE /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:35.449695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c98355c7-e5d7-41c2-92f5-a2ad3f99f929 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:35.453174 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c98355c7-e5d7-41c2-92f5-a2ad3f99f929 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 84e1c064-02ae-48d5-9b75-ce57b9a3758f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:35.469073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c98355c7-e5d7-41c2-92f5-a2ad3f99f929 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:35.469918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c98355c7-e5d7-41c2-92f5-a2ad3f99f929 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:35.471425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c98355c7-e5d7-41c2-92f5-a2ad3f99f929 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:35.473409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c98355c7-e5d7-41c2-92f5-a2ad3f99f929 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:35.478855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c98355c7-e5d7-41c2-92f5-a2ad3f99f929 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:35.479547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c98355c7-e5d7-41c2-92f5-a2ad3f99f929 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:36.006772 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c98355c7-e5d7-41c2-92f5-a2ad3f99f929 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:36.043419 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c98355c7-e5d7-41c2-92f5-a2ad3f99f929 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f" status: 200 len: 1492 microversion: 2.1 time: 0.589764 Aug 24 10:25:36.044186 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1389/3090] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:35 2022] GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f => generated 1492 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:25:36.066965 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-27c213af-d48a-41b3-9252-fdae81760d06 tempest-FloatingIPDetailsTestJSON-1559920032 tempest-FloatingIPDetailsTestJSON-1559920032-project] 10.222.0.85 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 1.342853 Aug 24 10:25:36.068031 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1702/3091] 10.222.0.85 () {58 vars in 1149 bytes} [Wed Aug 24 10:25:34 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:36.077654 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-67bed6b2-302f-4320-81c5-8065e82ffa9f tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:36.080121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-67bed6b2-302f-4320-81c5-8065e82ffa9f tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] [instance: c7361027-6bfd-4d6a-b6fb-5207f4291812] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:36.090863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2886c8c3-45c6-49e9-a36e-d221f4585220 tempest-FloatingIPDetailsTestJSON-1559920032 tempest-FloatingIPDetailsTestJSON-1559920032-project] Calling method '.version_select at 0x7f4647ce0e50>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:36.101073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67bed6b2-302f-4320-81c5-8065e82ffa9f tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:36.101744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67bed6b2-302f-4320-81c5-8065e82ffa9f tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:36.105445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67bed6b2-302f-4320-81c5-8065e82ffa9f tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:36.107694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67bed6b2-302f-4320-81c5-8065e82ffa9f tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:36.116342 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67bed6b2-302f-4320-81c5-8065e82ffa9f tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:36.118898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67bed6b2-302f-4320-81c5-8065e82ffa9f tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:36.580644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-67bed6b2-302f-4320-81c5-8065e82ffa9f tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f0e4fb1dae471eadb630004ba3e36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c26ec50b7740b5b0b58878c1c99097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:36.589024 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-67bed6b2-302f-4320-81c5-8065e82ffa9f tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] 10.222.0.85 "GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812" status: 200 len: 1507 microversion: 2.1 time: 0.527037 Aug 24 10:25:36.590194 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1390/3092] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:36 2022] GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812 => generated 1507 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:36.595325 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-31010894-e8dc-476b-af76-e8f239e4db24 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:36.596206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-31010894-e8dc-476b-af76-e8f239e4db24 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:36.607788 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31010894-e8dc-476b-af76-e8f239e4db24 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:36.608294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31010894-e8dc-476b-af76-e8f239e4db24 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:36.609555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31010894-e8dc-476b-af76-e8f239e4db24 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:36.612142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31010894-e8dc-476b-af76-e8f239e4db24 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:36.613788 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31010894-e8dc-476b-af76-e8f239e4db24 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:36.614253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31010894-e8dc-476b-af76-e8f239e4db24 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:37.238888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-31010894-e8dc-476b-af76-e8f239e4db24 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:37.249439 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-31010894-e8dc-476b-af76-e8f239e4db24 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1314 microversion: 2.1 time: 0.657890 Aug 24 10:25:37.258705 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1391/3093] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:36 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1314 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:37.264429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-14ae0b37-99c9-43c5-b2fd-dfb204d59e4a tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:37.266939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-14ae0b37-99c9-43c5-b2fd-dfb204d59e4a tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] [instance: c7361027-6bfd-4d6a-b6fb-5207f4291812] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:37.280271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14ae0b37-99c9-43c5-b2fd-dfb204d59e4a tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:37.281275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14ae0b37-99c9-43c5-b2fd-dfb204d59e4a tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:37.281867 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14ae0b37-99c9-43c5-b2fd-dfb204d59e4a tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:37.283005 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14ae0b37-99c9-43c5-b2fd-dfb204d59e4a tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:37.283616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14ae0b37-99c9-43c5-b2fd-dfb204d59e4a tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:37.284392 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14ae0b37-99c9-43c5-b2fd-dfb204d59e4a tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:37.330359 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-14ae0b37-99c9-43c5-b2fd-dfb204d59e4a tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] 10.222.0.85 "GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812/ips" status: 200 len: 110 microversion: 2.1 time: 0.068599 Aug 24 10:25:37.331921 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1392/3094] 10.222.0.85 () {58 vars in 1248 bytes} [Wed Aug 24 10:25:37 2022] GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812/ips => generated 110 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:37.343127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6ea2da21-2c20-4217-86dd-d0fdd6c3d81d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:37.344146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6ea2da21-2c20-4217-86dd-d0fdd6c3d81d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 84e1c064-02ae-48d5-9b75-ce57b9a3758f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:37.353886 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea2da21-2c20-4217-86dd-d0fdd6c3d81d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:37.354994 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea2da21-2c20-4217-86dd-d0fdd6c3d81d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:37.355648 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea2da21-2c20-4217-86dd-d0fdd6c3d81d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:37.358239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea2da21-2c20-4217-86dd-d0fdd6c3d81d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:37.358975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea2da21-2c20-4217-86dd-d0fdd6c3d81d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:37.359594 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea2da21-2c20-4217-86dd-d0fdd6c3d81d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:37.836409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6ea2da21-2c20-4217-86dd-d0fdd6c3d81d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:37.852092 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6ea2da21-2c20-4217-86dd-d0fdd6c3d81d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f" status: 200 len: 1492 microversion: 2.1 time: 0.516793 Aug 24 10:25:37.852360 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1393/3095] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:37 2022] GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f => generated 1492 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:37.864153 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a05a6d06-91ef-4b00-a8f6-39a219f67ae9 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:37.864900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a05a6d06-91ef-4b00-a8f6-39a219f67ae9 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] [instance: c7361027-6bfd-4d6a-b6fb-5207f4291812] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:37.918973 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a05a6d06-91ef-4b00-a8f6-39a219f67ae9 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:37.925259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a05a6d06-91ef-4b00-a8f6-39a219f67ae9 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:37.931089 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a05a6d06-91ef-4b00-a8f6-39a219f67ae9 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:37.933596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a05a6d06-91ef-4b00-a8f6-39a219f67ae9 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:37.935782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a05a6d06-91ef-4b00-a8f6-39a219f67ae9 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:37.936424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a05a6d06-91ef-4b00-a8f6-39a219f67ae9 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:38.040538 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a05a6d06-91ef-4b00-a8f6-39a219f67ae9 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] 10.222.0.85 "GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812/ips" status: 200 len: 110 microversion: 2.1 time: 0.179930 Aug 24 10:25:38.066265 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1394/3096] 10.222.0.85 () {58 vars in 1248 bytes} [Wed Aug 24 10:25:37 2022] GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812/ips => generated 110 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:38.076772 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2db2b07c-3611-498e-a0c3-453f2f65fe1e tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:38.077561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2db2b07c-3611-498e-a0c3-453f2f65fe1e tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] [instance: c7361027-6bfd-4d6a-b6fb-5207f4291812] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:38.110271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2db2b07c-3611-498e-a0c3-453f2f65fe1e tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:38.110869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2db2b07c-3611-498e-a0c3-453f2f65fe1e tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:38.111318 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2db2b07c-3611-498e-a0c3-453f2f65fe1e tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:38.112063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2db2b07c-3611-498e-a0c3-453f2f65fe1e tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:38.112572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2db2b07c-3611-498e-a0c3-453f2f65fe1e tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:38.113198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2db2b07c-3611-498e-a0c3-453f2f65fe1e tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:38.164260 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2db2b07c-3611-498e-a0c3-453f2f65fe1e tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] 10.222.0.85 "GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812/ips/tempest-ServerAddressesTestJSON-1702164014-network" status: 200 len: 95 microversion: 2.1 time: 0.100760 Aug 24 10:25:38.175228 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1395/3097] 10.222.0.85 () {58 vars in 1401 bytes} [Wed Aug 24 10:25:38 2022] GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812/ips/tempest-ServerAddressesTestJSON-1702164014-network => generated 95 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:25:38.186658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2739c694-9c5a-4f7e-bad7-03eeeccf0f7b tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:38.193568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2739c694-9c5a-4f7e-bad7-03eeeccf0f7b tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] [instance: c7361027-6bfd-4d6a-b6fb-5207f4291812] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:38.205285 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2739c694-9c5a-4f7e-bad7-03eeeccf0f7b tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:38.207023 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2739c694-9c5a-4f7e-bad7-03eeeccf0f7b tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:38.208329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2739c694-9c5a-4f7e-bad7-03eeeccf0f7b tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:38.210010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2739c694-9c5a-4f7e-bad7-03eeeccf0f7b tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:38.213087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2739c694-9c5a-4f7e-bad7-03eeeccf0f7b tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:38.213754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2739c694-9c5a-4f7e-bad7-03eeeccf0f7b tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:38.293702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2739c694-9c5a-4f7e-bad7-03eeeccf0f7b tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] [instance: c7361027-6bfd-4d6a-b6fb-5207f4291812] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:25:38.492651 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2739c694-9c5a-4f7e-bad7-03eeeccf0f7b tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] 10.222.0.85 "DELETE /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812" status: 204 len: 0 microversion: 2.1 time: 0.314229 Aug 24 10:25:38.494087 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1396/3098] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:25:38 2022] DELETE /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:38.499910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-82a59edb-4b5a-4c49-90e1-59d5c5a817bd tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:38.500953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-82a59edb-4b5a-4c49-90e1-59d5c5a817bd tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:38.521945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a59edb-4b5a-4c49-90e1-59d5c5a817bd tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:38.522121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a59edb-4b5a-4c49-90e1-59d5c5a817bd tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:38.522572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a59edb-4b5a-4c49-90e1-59d5c5a817bd tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:38.523462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a59edb-4b5a-4c49-90e1-59d5c5a817bd tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:38.524118 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a59edb-4b5a-4c49-90e1-59d5c5a817bd tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:38.524714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a59edb-4b5a-4c49-90e1-59d5c5a817bd tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:39.285680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-82a59edb-4b5a-4c49-90e1-59d5c5a817bd tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:39.288418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:39.300333 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-82a59edb-4b5a-4c49-90e1-59d5c5a817bd tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1314 microversion: 2.1 time: 0.804157 Aug 24 10:25:39.300333 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1397/3099] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:38 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1314 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:39.600875 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:39.630155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:40.025938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c485500b-f25f-4ceb-b3b4-bf3bc315ea85 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1543942890", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "1e4fcfdc-e41c-489d-8c6e-e080a9f1f1f1"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:25:40.128911 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-c485500b-f25f-4ceb-b3b4-bf3bc315ea85 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] validate_networks() for [('1e4fcfdc-e41c-489d-8c6e-e080a9f1f1f1', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:25:40.870397 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2886c8c3-45c6-49e9-a36e-d221f4585220 tempest-FloatingIPDetailsTestJSON-1559920032 tempest-FloatingIPDetailsTestJSON-1559920032-project] 10.222.0.85 "DELETE /compute/v2.1/os-floating-ips/ea9b32d5-9e16-48eb-9380-a93f164dd393" status: 202 len: 0 microversion: 2.1 time: 4.791821 Aug 24 10:25:40.871327 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1703/3100] 10.222.0.85 () {58 vars in 1263 bytes} [Wed Aug 24 10:25:36 2022] DELETE /compute/v2.1/os-floating-ips/ea9b32d5-9e16-48eb-9380-a93f164dd393 => generated 0 bytes in 4794 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:25:40.877511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a21eaf0c-35f5-4224-9b5a-8096420ac8fb tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:40.882193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a21eaf0c-35f5-4224-9b5a-8096420ac8fb tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] [instance: c7361027-6bfd-4d6a-b6fb-5207f4291812] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:40.911795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a21eaf0c-35f5-4224-9b5a-8096420ac8fb tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:40.912788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a21eaf0c-35f5-4224-9b5a-8096420ac8fb tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:40.913568 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a21eaf0c-35f5-4224-9b5a-8096420ac8fb tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:40.915708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a21eaf0c-35f5-4224-9b5a-8096420ac8fb tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:40.917467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a21eaf0c-35f5-4224-9b5a-8096420ac8fb tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:40.918511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a21eaf0c-35f5-4224-9b5a-8096420ac8fb tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:41.702392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a21eaf0c-35f5-4224-9b5a-8096420ac8fb tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f0e4fb1dae471eadb630004ba3e36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c26ec50b7740b5b0b58878c1c99097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:41.717608 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a21eaf0c-35f5-4224-9b5a-8096420ac8fb tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] 10.222.0.85 "GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812" status: 200 len: 1513 microversion: 2.1 time: 0.844625 Aug 24 10:25:41.719942 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1704/3101] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:40 2022] GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812 => generated 1513 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:41.727255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3d97cd1-f9aa-4552-9943-ba38240b64a0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:41.728141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d3d97cd1-f9aa-4552-9943-ba38240b64a0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 84e1c064-02ae-48d5-9b75-ce57b9a3758f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:41.756711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3d97cd1-f9aa-4552-9943-ba38240b64a0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:41.759982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3d97cd1-f9aa-4552-9943-ba38240b64a0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:41.762856 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3d97cd1-f9aa-4552-9943-ba38240b64a0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:41.766487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3d97cd1-f9aa-4552-9943-ba38240b64a0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:41.769010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3d97cd1-f9aa-4552-9943-ba38240b64a0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:41.771330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3d97cd1-f9aa-4552-9943-ba38240b64a0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:41.824042 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-d3d97cd1-f9aa-4552-9943-ba38240b64a0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] HTTP exception thrown: Instance 84e1c064-02ae-48d5-9b75-ce57b9a3758f could not be found. Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3d97cd1-f9aa-4552-9943-ba38240b64a0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Request method failure captured: Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f HTTP/1.1 Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfwVOwKbAI3HcYW4vDUwX5tmvWZcMN8iYYPbyv0cT05fZ_Z-LEPCm4LinUuprRdXqkjYpTNDBQ5PMwhn6CDfWO2m5UgqK-Sr-pjjwg2dd34HghINyEVE3T5Itg-PYKj0YMEqYVC5uIroOumu3tZy7M7156OT9EtIM2-BMTg5dhnnzv0 Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b324a37b01b644dfa301a561e6125672", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b324a37b01b644dfa301a561e6125672"}]}] Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: b49cb438da9f4b309d54bfef9fc19bda Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 84e1c064-02ae-48d5-9b75-ce57b9a3758f could not be found. Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '84e1c064-02ae-48d5-9b75-ce57b9a3758f'} Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84e1c064-02ae-48d5-9b75-ce57b9a3758f could not be found. Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e1c064-02ae-48d5-9b75-ce57b9a3758f could not be found. Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:41.828741 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:41.833759 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:41.833759 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:25:41.833759 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:25:41.833759 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:25:41.833759 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:25:41.833759 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e1c064-02ae-48d5-9b75-ce57b9a3758f could not be found. Aug 24 10:25:41.833759 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:41.836533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3d97cd1-f9aa-4552-9943-ba38240b64a0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Returning 404 to user: Instance 84e1c064-02ae-48d5-9b75-ce57b9a3758f could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:25:41.842918 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d3d97cd1-f9aa-4552-9943-ba38240b64a0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f" status: 404 len: 111 microversion: 2.1 time: 0.121163 Aug 24 10:25:41.858072 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1705/3102] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:41 2022] GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:25:41.865342 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-75fb0f90-8380-408c-b8ea-451a70c4ca2c req-acf8f189-924a-4974-82fc-f88075f59517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e1c064-02ae-48d5-9b75-ce57b9a3758f", "name": "network-vif-deleted", "tag": "e59f3c6f-c02e-47ea-ba5c-3390444e8bec"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:25:41.881559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-75fb0f90-8380-408c-b8ea-451a70c4ca2c req-acf8f189-924a-4974-82fc-f88075f59517 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:41.883407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-75fb0f90-8380-408c-b8ea-451a70c4ca2c req-acf8f189-924a-4974-82fc-f88075f59517 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:41.885319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-75fb0f90-8380-408c-b8ea-451a70c4ca2c req-acf8f189-924a-4974-82fc-f88075f59517 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:41.904108 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-75fb0f90-8380-408c-b8ea-451a70c4ca2c req-acf8f189-924a-4974-82fc-f88075f59517 service nova] Creating event network-vif-deleted:e59f3c6f-c02e-47ea-ba5c-3390444e8bec for instance 84e1c064-02ae-48d5-9b75-ce57b9a3758f on n-h1-849328-3 Aug 24 10:25:41.911918 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-75fb0f90-8380-408c-b8ea-451a70c4ca2c req-acf8f189-924a-4974-82fc-f88075f59517 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051391 Aug 24 10:25:41.915782 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1706/3103] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:41.922793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d485439e-791b-4e62-af13-e40a9a88fda7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:41.924152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d485439e-791b-4e62-af13-e40a9a88fda7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:41.936769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d485439e-791b-4e62-af13-e40a9a88fda7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:41.938058 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d485439e-791b-4e62-af13-e40a9a88fda7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:41.939770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d485439e-791b-4e62-af13-e40a9a88fda7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:41.940940 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d485439e-791b-4e62-af13-e40a9a88fda7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:41.941672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d485439e-791b-4e62-af13-e40a9a88fda7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:41.942594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d485439e-791b-4e62-af13-e40a9a88fda7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:42.037378 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c485500b-f25f-4ceb-b3b4-bf3bc315ea85 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:25:42.037378 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c485500b-f25f-4ceb-b3b4-bf3bc315ea85 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:25:42.038210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c485500b-f25f-4ceb-b3b4-bf3bc315ea85 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:25:42.038210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c485500b-f25f-4ceb-b3b4-bf3bc315ea85 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:25:42.038516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c485500b-f25f-4ceb-b3b4-bf3bc315ea85 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:25:42.057516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c485500b-f25f-4ceb-b3b4-bf3bc315ea85 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:42.058127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c485500b-f25f-4ceb-b3b4-bf3bc315ea85 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:42.058830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c485500b-f25f-4ceb-b3b4-bf3bc315ea85 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:42.059666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c485500b-f25f-4ceb-b3b4-bf3bc315ea85 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:42.066103 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c485500b-f25f-4ceb-b3b4-bf3bc315ea85 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:42.071625 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c485500b-f25f-4ceb-b3b4-bf3bc315ea85 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:42.145946 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-c485500b-f25f-4ceb-b3b4-bf3bc315ea85 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Getting quotas for project c359de3a762f414094f730a2d3ef2492. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:25:42.158359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-c485500b-f25f-4ceb-b3b4-bf3bc315ea85 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Getting quotas for user cf2df6092dd24f33ab5ab4bd353547dd and project c359de3a762f414094f730a2d3ef2492. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:25:42.201261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c485500b-f25f-4ceb-b3b4-bf3bc315ea85 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:25:42.204147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c485500b-f25f-4ceb-b3b4-bf3bc315ea85 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] [instance: 7b4d58bf-f4f2-408f-8609-82b6a528a630] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:25:42.345613 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c485500b-f25f-4ceb-b3b4-bf3bc315ea85 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.044170 Aug 24 10:25:42.347533 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1398/3104] 10.222.0.85 () {62 vars in 1188 bytes} [Wed Aug 24 10:25:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3047 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 10:25:42.361475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7323b5f9-b309-4852-9199-68d09a2fb71e tempest-FloatingIPDetailsTestJSON-1559920032 tempest-FloatingIPDetailsTestJSON-1559920032-project] Calling method '.version_select at 0x7f46550393a0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:42.516255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d485439e-791b-4e62-af13-e40a9a88fda7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:42.560226 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d485439e-791b-4e62-af13-e40a9a88fda7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1314 microversion: 2.1 time: 0.639415 Aug 24 10:25:42.564050 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1707/3105] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:41 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1314 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:42.592488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-adf0eede-5cef-4610-a3b5-cc825fb30b34 req-0af1891b-2854-4e38-a90d-59d51714d7c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea7bc787-3b2c-4174-b05a-178957293e0d", "tag": "a08f33a2-f475-4918-9c3c-7baf872ae2cd"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:25:42.622553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-adf0eede-5cef-4610-a3b5-cc825fb30b34 req-0af1891b-2854-4e38-a90d-59d51714d7c0 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:42.623045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-adf0eede-5cef-4610-a3b5-cc825fb30b34 req-0af1891b-2854-4e38-a90d-59d51714d7c0 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:42.628554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-adf0eede-5cef-4610-a3b5-cc825fb30b34 req-0af1891b-2854-4e38-a90d-59d51714d7c0 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:42.656253 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-adf0eede-5cef-4610-a3b5-cc825fb30b34 req-0af1891b-2854-4e38-a90d-59d51714d7c0 service nova] Creating event network-changed:a08f33a2-f475-4918-9c3c-7baf872ae2cd for instance ea7bc787-3b2c-4174-b05a-178957293e0d on n-h2-849328-3 Aug 24 10:25:42.671985 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-adf0eede-5cef-4610-a3b5-cc825fb30b34 req-0af1891b-2854-4e38-a90d-59d51714d7c0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103744 Aug 24 10:25:42.680915 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1708/3106] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:42.697840 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-db64d519-8905-40be-a7d1-8aacfdd23d07 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-396000301", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "fb7883d4-b081-478d-b08b-6c818132f5bd"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:25:42.926691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-db64d519-8905-40be-a7d1-8aacfdd23d07 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] validate_networks() for [('fb7883d4-b081-478d-b08b-6c818132f5bd', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:25:44.440077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-db64d519-8905-40be-a7d1-8aacfdd23d07 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:25:44.440769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-db64d519-8905-40be-a7d1-8aacfdd23d07 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:25:44.441237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-db64d519-8905-40be-a7d1-8aacfdd23d07 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:25:44.442035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-db64d519-8905-40be-a7d1-8aacfdd23d07 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:25:44.443292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-db64d519-8905-40be-a7d1-8aacfdd23d07 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:25:44.464413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db64d519-8905-40be-a7d1-8aacfdd23d07 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:44.465316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db64d519-8905-40be-a7d1-8aacfdd23d07 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:44.466081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db64d519-8905-40be-a7d1-8aacfdd23d07 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:44.467737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db64d519-8905-40be-a7d1-8aacfdd23d07 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:44.474010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db64d519-8905-40be-a7d1-8aacfdd23d07 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:44.475755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db64d519-8905-40be-a7d1-8aacfdd23d07 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:44.544509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-db64d519-8905-40be-a7d1-8aacfdd23d07 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Getting quotas for project b324a37b01b644dfa301a561e6125672. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:25:44.556736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-db64d519-8905-40be-a7d1-8aacfdd23d07 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Getting quotas for user b49cb438da9f4b309d54bfef9fc19bda and project b324a37b01b644dfa301a561e6125672. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:25:44.622541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-db64d519-8905-40be-a7d1-8aacfdd23d07 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:25:44.628117 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-db64d519-8905-40be-a7d1-8aacfdd23d07 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:25:44.827696 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-db64d519-8905-40be-a7d1-8aacfdd23d07 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.144861 Aug 24 10:25:44.829138 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1709/3107] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:25:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:25:44.855966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-927ee7c3-21a2-4ecc-a1d2-1a3a35069b9a tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:44.867569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-927ee7c3-21a2-4ecc-a1d2-1a3a35069b9a tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] [instance: 7b4d58bf-f4f2-408f-8609-82b6a528a630] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:44.891128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-927ee7c3-21a2-4ecc-a1d2-1a3a35069b9a tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:44.894512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-927ee7c3-21a2-4ecc-a1d2-1a3a35069b9a tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:44.901174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-927ee7c3-21a2-4ecc-a1d2-1a3a35069b9a tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:44.903392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-927ee7c3-21a2-4ecc-a1d2-1a3a35069b9a tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:44.908678 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-927ee7c3-21a2-4ecc-a1d2-1a3a35069b9a tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:44.912317 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-927ee7c3-21a2-4ecc-a1d2-1a3a35069b9a tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:45.161677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-927ee7c3-21a2-4ecc-a1d2-1a3a35069b9a tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:45.181942 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-927ee7c3-21a2-4ecc-a1d2-1a3a35069b9a tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:45.186820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-927ee7c3-21a2-4ecc-a1d2-1a3a35069b9a tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:45.190339 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-927ee7c3-21a2-4ecc-a1d2-1a3a35069b9a tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] 10.222.0.85 "GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630" status: 200 len: 1319 microversion: 2.21 time: 0.351733 Aug 24 10:25:45.195923 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1710/3108] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:25:44 2022] GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630 => generated 1319 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:25:45.209915 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-738e57d0-f44f-4ee5-b497-05caa0ae9718 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:45.214028 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-738e57d0-f44f-4ee5-b497-05caa0ae9718 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] [instance: c7361027-6bfd-4d6a-b6fb-5207f4291812] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:45.242804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-738e57d0-f44f-4ee5-b497-05caa0ae9718 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:45.243535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-738e57d0-f44f-4ee5-b497-05caa0ae9718 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:45.244192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-738e57d0-f44f-4ee5-b497-05caa0ae9718 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:45.245463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-738e57d0-f44f-4ee5-b497-05caa0ae9718 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:45.246716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-738e57d0-f44f-4ee5-b497-05caa0ae9718 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:45.247360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-738e57d0-f44f-4ee5-b497-05caa0ae9718 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:45.295240 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-738e57d0-f44f-4ee5-b497-05caa0ae9718 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] HTTP exception thrown: Instance c7361027-6bfd-4d6a-b6fb-5207f4291812 could not be found. Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-738e57d0-f44f-4ee5-b497-05caa0ae9718 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Request method failure captured: Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812 HTTP/1.1 Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfx9H-4Co2XYVyn9De1eOk7UwkCIey0oKEYMdax86i6F1gmG0X-42B8ak_FaQOFqv9LHSjli69icaPFkNdN5VfIPJM8FNfPOkX9dgh1wPjE4hsu1nd--UPbTyVwHSrXNHLQIGKr9kxhtbC1XzXuCsFFjY-PMEDOn20LDrsUuN-CCCUg Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: a3c26ec50b7740b5b0b58878c1c99097 Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerAddressesTestJSON-446876397 Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a3c26ec50b7740b5b0b58878c1c99097"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_a3c26ec50b7740b5b0b58878c1c99097", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a3c26ec50b7740b5b0b58878c1c99097"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/a3c26ec50b7740b5b0b58878c1c99097"}]}] Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerAddressesTestJSON-446876397 Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: a3c26ec50b7740b5b0b58878c1c99097 Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerAddressesTestJSON-446876397 Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerAddressesTestJSON-446876397-project Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: d0f0e4fb1dae471eadb630004ba3e36b Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerAddressesTestJSON-446876397-project Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance c7361027-6bfd-4d6a-b6fb-5207f4291812 could not be found. Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'c7361027-6bfd-4d6a-b6fb-5207f4291812'} Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7361027-6bfd-4d6a-b6fb-5207f4291812 could not be found. Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7361027-6bfd-4d6a-b6fb-5207f4291812 could not be found. Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:45.300504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:45.306140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:45.306140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:25:45.306140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:25:45.306140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:25:45.306140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:25:45.306140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7361027-6bfd-4d6a-b6fb-5207f4291812 could not be found. Aug 24 10:25:45.306140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:45.311539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-738e57d0-f44f-4ee5-b497-05caa0ae9718 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] Returning 404 to user: Instance c7361027-6bfd-4d6a-b6fb-5207f4291812 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:25:45.319099 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-738e57d0-f44f-4ee5-b497-05caa0ae9718 tempest-ServerAddressesTestJSON-446876397 tempest-ServerAddressesTestJSON-446876397-project] 10.222.0.85 "GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812" status: 404 len: 111 microversion: 2.1 time: 0.119388 Aug 24 10:25:45.321184 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1711/3109] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:45 2022] GET /compute/v2.1/servers/c7361027-6bfd-4d6a-b6fb-5207f4291812 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:25:45.339260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6e71ad57-096f-4832-be24-88d2693eb707 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:45.346413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6e71ad57-096f-4832-be24-88d2693eb707 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:45.385304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e71ad57-096f-4832-be24-88d2693eb707 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:45.387437 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e71ad57-096f-4832-be24-88d2693eb707 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:45.391308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e71ad57-096f-4832-be24-88d2693eb707 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:45.392429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e71ad57-096f-4832-be24-88d2693eb707 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:45.393720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e71ad57-096f-4832-be24-88d2693eb707 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:45.400766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e71ad57-096f-4832-be24-88d2693eb707 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:46.261389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6e71ad57-096f-4832-be24-88d2693eb707 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:46.272175 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6e71ad57-096f-4832-be24-88d2693eb707 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1314 microversion: 2.1 time: 0.948982 Aug 24 10:25:46.286098 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1712/3110] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:45 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1314 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:46.295980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c26ce205-d29b-410e-81d7-5704463042eb req-e6b05d4b-c071-42af-81f8-62339b9a6f73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7361027-6bfd-4d6a-b6fb-5207f4291812", "name": "network-vif-deleted", "tag": "3992b73c-3901-4833-8c5d-0ada6e74a1c3"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:25:46.329039 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c26ce205-d29b-410e-81d7-5704463042eb req-e6b05d4b-c071-42af-81f8-62339b9a6f73 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:46.329562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c26ce205-d29b-410e-81d7-5704463042eb req-e6b05d4b-c071-42af-81f8-62339b9a6f73 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:46.330002 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c26ce205-d29b-410e-81d7-5704463042eb req-e6b05d4b-c071-42af-81f8-62339b9a6f73 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:46.367114 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c26ce205-d29b-410e-81d7-5704463042eb req-e6b05d4b-c071-42af-81f8-62339b9a6f73 service nova] Creating event network-vif-deleted:3992b73c-3901-4833-8c5d-0ada6e74a1c3 for instance c7361027-6bfd-4d6a-b6fb-5207f4291812 on n-h1-849328-3 Aug 24 10:25:46.385567 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c26ce205-d29b-410e-81d7-5704463042eb req-e6b05d4b-c071-42af-81f8-62339b9a6f73 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097273 Aug 24 10:25:46.386478 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1713/3111] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:46.392004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-235fa6b2-a17e-43a5-8fca-797d8151fb78 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:46.393033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-235fa6b2-a17e-43a5-8fca-797d8151fb78 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:46.405514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-235fa6b2-a17e-43a5-8fca-797d8151fb78 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:46.406014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-235fa6b2-a17e-43a5-8fca-797d8151fb78 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:46.406451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-235fa6b2-a17e-43a5-8fca-797d8151fb78 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:46.407154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-235fa6b2-a17e-43a5-8fca-797d8151fb78 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:46.407601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-235fa6b2-a17e-43a5-8fca-797d8151fb78 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:46.408022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-235fa6b2-a17e-43a5-8fca-797d8151fb78 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:46.642042 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-235fa6b2-a17e-43a5-8fca-797d8151fb78 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:46.667165 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-235fa6b2-a17e-43a5-8fca-797d8151fb78 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1210 microversion: 2.1 time: 0.279152 Aug 24 10:25:46.667824 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1714/3112] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:46 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1210 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:46.692023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c4878627-7bf9-47e4-bf5c-f9b01952bb7b tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:46.702722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c4878627-7bf9-47e4-bf5c-f9b01952bb7b tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] [instance: 7b4d58bf-f4f2-408f-8609-82b6a528a630] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:46.709361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4878627-7bf9-47e4-bf5c-f9b01952bb7b tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:46.710016 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4878627-7bf9-47e4-bf5c-f9b01952bb7b tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:46.710298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4878627-7bf9-47e4-bf5c-f9b01952bb7b tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:46.711396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4878627-7bf9-47e4-bf5c-f9b01952bb7b tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:46.721657 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4878627-7bf9-47e4-bf5c-f9b01952bb7b tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:46.722376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4878627-7bf9-47e4-bf5c-f9b01952bb7b tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:46.726146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:46.897753 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7323b5f9-b309-4852-9199-68d09a2fb71e tempest-FloatingIPDetailsTestJSON-1559920032 tempest-FloatingIPDetailsTestJSON-1559920032-project] 10.222.0.85 "DELETE /compute/v2.1/os-floating-ips/9338caf6-d753-4281-8995-ed76878b6fbf" status: 202 len: 0 microversion: 2.1 time: 4.546094 Aug 24 10:25:46.898941 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1399/3113] 10.222.0.85 () {58 vars in 1263 bytes} [Wed Aug 24 10:25:42 2022] DELETE /compute/v2.1/os-floating-ips/9338caf6-d753-4281-8995-ed76878b6fbf => generated 0 bytes in 4551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:25:46.909079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bc2213f7-1d5e-4640-a6ea-7e5f8ffb2dcc tempest-FloatingIPDetailsTestJSON-1559920032 tempest-FloatingIPDetailsTestJSON-1559920032-project] Calling method '.version_select at 0x7f46550011f0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:47.019318 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c4878627-7bf9-47e4-bf5c-f9b01952bb7b tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:47.044764 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c4878627-7bf9-47e4-bf5c-f9b01952bb7b tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:47.053532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c4878627-7bf9-47e4-bf5c-f9b01952bb7b tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:47.055079 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c4878627-7bf9-47e4-bf5c-f9b01952bb7b tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] 10.222.0.85 "GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630" status: 200 len: 1317 microversion: 2.21 time: 0.372450 Aug 24 10:25:47.062690 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1715/3114] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:25:46 2022] GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630 => generated 1317 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:25:47.323089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8c93418c-e4e8-498a-ac62-85f9a4c79300 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:47.323746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8c93418c-e4e8-498a-ac62-85f9a4c79300 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:47.334420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c93418c-e4e8-498a-ac62-85f9a4c79300 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:47.334937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c93418c-e4e8-498a-ac62-85f9a4c79300 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:47.337632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c93418c-e4e8-498a-ac62-85f9a4c79300 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:47.338722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c93418c-e4e8-498a-ac62-85f9a4c79300 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:47.339272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c93418c-e4e8-498a-ac62-85f9a4c79300 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:47.340891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c93418c-e4e8-498a-ac62-85f9a4c79300 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:47.906755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8c93418c-e4e8-498a-ac62-85f9a4c79300 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:47.921691 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8c93418c-e4e8-498a-ac62-85f9a4c79300 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1314 microversion: 2.1 time: 0.609330 Aug 24 10:25:47.922981 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1716/3115] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:47 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:47.931419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ce39aa15-e45b-4084-bdab-e93982cff5cd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:47.932348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ce39aa15-e45b-4084-bdab-e93982cff5cd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:47.940607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce39aa15-e45b-4084-bdab-e93982cff5cd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:47.943361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce39aa15-e45b-4084-bdab-e93982cff5cd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:47.946220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce39aa15-e45b-4084-bdab-e93982cff5cd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:47.949084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce39aa15-e45b-4084-bdab-e93982cff5cd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:47.954427 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce39aa15-e45b-4084-bdab-e93982cff5cd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:47.959572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce39aa15-e45b-4084-bdab-e93982cff5cd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:48.125674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ce39aa15-e45b-4084-bdab-e93982cff5cd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:48.160789 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ce39aa15-e45b-4084-bdab-e93982cff5cd tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1272 microversion: 2.1 time: 0.233423 Aug 24 10:25:48.166643 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1717/3116] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:47 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1272 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:48.173010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bf40142e-5cc5-4f9c-809e-0b5dbbab4a0f tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:48.174057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bf40142e-5cc5-4f9c-809e-0b5dbbab4a0f tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] [instance: 7b4d58bf-f4f2-408f-8609-82b6a528a630] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:48.183372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf40142e-5cc5-4f9c-809e-0b5dbbab4a0f tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:48.184423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf40142e-5cc5-4f9c-809e-0b5dbbab4a0f tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:48.185457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf40142e-5cc5-4f9c-809e-0b5dbbab4a0f tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:48.186682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf40142e-5cc5-4f9c-809e-0b5dbbab4a0f tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:48.187465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf40142e-5cc5-4f9c-809e-0b5dbbab4a0f tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:48.188068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf40142e-5cc5-4f9c-809e-0b5dbbab4a0f tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:48.316537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bf40142e-5cc5-4f9c-809e-0b5dbbab4a0f tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:48.357356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bf40142e-5cc5-4f9c-809e-0b5dbbab4a0f tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:48.366272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bf40142e-5cc5-4f9c-809e-0b5dbbab4a0f tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:48.367520 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bf40142e-5cc5-4f9c-809e-0b5dbbab4a0f tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] 10.222.0.85 "GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630" status: 200 len: 1317 microversion: 2.21 time: 0.199119 Aug 24 10:25:48.370207 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1718/3117] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:25:48 2022] GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630 => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:25:48.945821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d5b0f584-8308-4a08-b44f-7e626f93c640 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:48.946921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d5b0f584-8308-4a08-b44f-7e626f93c640 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:48.965957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5b0f584-8308-4a08-b44f-7e626f93c640 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:48.967046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5b0f584-8308-4a08-b44f-7e626f93c640 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:48.978100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5b0f584-8308-4a08-b44f-7e626f93c640 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:48.981080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5b0f584-8308-4a08-b44f-7e626f93c640 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:48.983395 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5b0f584-8308-4a08-b44f-7e626f93c640 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:48.984365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5b0f584-8308-4a08-b44f-7e626f93c640 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:49.660190 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d5b0f584-8308-4a08-b44f-7e626f93c640 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:49.674319 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d5b0f584-8308-4a08-b44f-7e626f93c640 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1314 microversion: 2.1 time: 0.734719 Aug 24 10:25:49.675025 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1719/3118] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:48 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1314 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:49.702720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8b16ca10-95d2-48e4-b1b6-1e3147046ee1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:49.703627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8b16ca10-95d2-48e4-b1b6-1e3147046ee1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:49.716096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b16ca10-95d2-48e4-b1b6-1e3147046ee1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:49.716775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b16ca10-95d2-48e4-b1b6-1e3147046ee1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:49.717468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b16ca10-95d2-48e4-b1b6-1e3147046ee1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:49.718501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b16ca10-95d2-48e4-b1b6-1e3147046ee1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:49.731217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b16ca10-95d2-48e4-b1b6-1e3147046ee1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:49.731956 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b16ca10-95d2-48e4-b1b6-1e3147046ee1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:50.006091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8b16ca10-95d2-48e4-b1b6-1e3147046ee1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:50.028379 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8b16ca10-95d2-48e4-b1b6-1e3147046ee1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1272 microversion: 2.1 time: 0.343563 Aug 24 10:25:50.045560 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1720/3119] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:49 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1272 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:50.055780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5882e64a-9ff0-4abe-87fd-af6522388e50 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:50.060590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5882e64a-9ff0-4abe-87fd-af6522388e50 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] [instance: 7b4d58bf-f4f2-408f-8609-82b6a528a630] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:50.094207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5882e64a-9ff0-4abe-87fd-af6522388e50 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:50.096994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5882e64a-9ff0-4abe-87fd-af6522388e50 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:50.098476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5882e64a-9ff0-4abe-87fd-af6522388e50 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:50.102728 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5882e64a-9ff0-4abe-87fd-af6522388e50 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:50.105435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5882e64a-9ff0-4abe-87fd-af6522388e50 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:50.107232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5882e64a-9ff0-4abe-87fd-af6522388e50 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:50.321051 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bc2213f7-1d5e-4640-a6ea-7e5f8ffb2dcc tempest-FloatingIPDetailsTestJSON-1559920032 tempest-FloatingIPDetailsTestJSON-1559920032-project] 10.222.0.85 "DELETE /compute/v2.1/os-floating-ips/8a3df070-36d8-45ae-be0e-409f50d67054" status: 202 len: 0 microversion: 2.1 time: 3.415967 Aug 24 10:25:50.322992 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1400/3120] 10.222.0.85 () {58 vars in 1263 bytes} [Wed Aug 24 10:25:46 2022] DELETE /compute/v2.1/os-floating-ips/8a3df070-36d8-45ae-be0e-409f50d67054 => generated 0 bytes in 3419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:25:50.334459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-0ae57749-97d9-46c0-8ea9-d0aac70fb0df req-b8d49f51-162e-460a-84c1-7515044ab844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea7bc787-3b2c-4174-b05a-178957293e0d", "name": "network-vif-plugged", "status": "completed", "tag": "a08f33a2-f475-4918-9c3c-7baf872ae2cd"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:25:50.373597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0ae57749-97d9-46c0-8ea9-d0aac70fb0df req-b8d49f51-162e-460a-84c1-7515044ab844 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:50.374091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0ae57749-97d9-46c0-8ea9-d0aac70fb0df req-b8d49f51-162e-460a-84c1-7515044ab844 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:50.378267 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0ae57749-97d9-46c0-8ea9-d0aac70fb0df req-b8d49f51-162e-460a-84c1-7515044ab844 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:50.409890 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-0ae57749-97d9-46c0-8ea9-d0aac70fb0df req-b8d49f51-162e-460a-84c1-7515044ab844 service nova] Creating event network-vif-plugged:a08f33a2-f475-4918-9c3c-7baf872ae2cd for instance ea7bc787-3b2c-4174-b05a-178957293e0d on n-h2-849328-3 Aug 24 10:25:50.434597 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-0ae57749-97d9-46c0-8ea9-d0aac70fb0df req-b8d49f51-162e-460a-84c1-7515044ab844 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105737 Aug 24 10:25:50.442484 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1401/3121] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:50.710473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d68bd829-c644-41de-84a5-43841ab8eed1 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:50.716415 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d68bd829-c644-41de-84a5-43841ab8eed1 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:50.769003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d68bd829-c644-41de-84a5-43841ab8eed1 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:50.799013 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d68bd829-c644-41de-84a5-43841ab8eed1 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:50.800636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d68bd829-c644-41de-84a5-43841ab8eed1 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:50.810340 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d68bd829-c644-41de-84a5-43841ab8eed1 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:50.813614 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d68bd829-c644-41de-84a5-43841ab8eed1 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:50.814731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d68bd829-c644-41de-84a5-43841ab8eed1 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:51.427851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d68bd829-c644-41de-84a5-43841ab8eed1 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:51.441822 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d68bd829-c644-41de-84a5-43841ab8eed1 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1314 microversion: 2.1 time: 0.742203 Aug 24 10:25:51.464351 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1402/3122] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:50 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1314 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:51.475292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7b05211f-70dc-4cfc-ad77-98da63b4b8c6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:51.476132 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7b05211f-70dc-4cfc-ad77-98da63b4b8c6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:51.485398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b05211f-70dc-4cfc-ad77-98da63b4b8c6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:51.486182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b05211f-70dc-4cfc-ad77-98da63b4b8c6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:51.487302 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b05211f-70dc-4cfc-ad77-98da63b4b8c6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:51.496648 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b05211f-70dc-4cfc-ad77-98da63b4b8c6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:51.503537 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b05211f-70dc-4cfc-ad77-98da63b4b8c6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:51.504365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5882e64a-9ff0-4abe-87fd-af6522388e50 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:51.506098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b05211f-70dc-4cfc-ad77-98da63b4b8c6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:51.520199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5882e64a-9ff0-4abe-87fd-af6522388e50 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:51.531163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5882e64a-9ff0-4abe-87fd-af6522388e50 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:51.537266 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5882e64a-9ff0-4abe-87fd-af6522388e50 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] 10.222.0.85 "GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630" status: 200 len: 1359 microversion: 2.21 time: 1.494795 Aug 24 10:25:51.540157 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1721/3123] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:25:50 2022] GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630 => generated 1359 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:25:51.876853 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e566bc83-60fe-4060-8b54-759f5c9dbb19 tempest-ImagesDeleteNegativeTestJSON-743993974 tempest-ImagesDeleteNegativeTestJSON-743993974-project] 10.222.0.85 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.332526 Aug 24 10:25:51.878100 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1722/3124] 10.222.0.85 () {58 vars in 1128 bytes} [Wed Aug 24 10:25:51 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 10:25:51.895828 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d0ee57f8-6ceb-43cd-98f3-75dc5d659270 tempest-ImagesDeleteNegativeTestJSON-743993974 tempest-ImagesDeleteNegativeTestJSON-743993974-project] Calling method '.version_select at 0x7f4647caf430>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:51.971119 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-d0ee57f8-6ceb-43cd-98f3-75dc5d659270 tempest-ImagesDeleteNegativeTestJSON-743993974 tempest-ImagesDeleteNegativeTestJSON-743993974-project] HTTP exception thrown: Image not found. Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d0ee57f8-6ceb-43cd-98f3-75dc5d659270 tempest-ImagesDeleteNegativeTestJSON-743993974 tempest-ImagesDeleteNegativeTestJSON-743993974-project] Request method failure captured: Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfyvR6TItl2ILqJHODkHQvLc9Xbr8EktNtyV09HdOfESeW0Gu34gIPqHDaF8-VUd-ZqsYe7NYmbbDJ0ly_MIyZTVciLoRoFX8i027tRSdtoZumS3qLrmbJmnYdQjvc2DFK7ac-AMJYOfid020I95YKDI4nnzr4VAB1DVRJWqAHMlz2M Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 36e6fa1538c74599acaafecdaa5a4e6f Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-743993974 Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/36e6fa1538c74599acaafecdaa5a4e6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_36e6fa1538c74599acaafecdaa5a4e6f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/36e6fa1538c74599acaafecdaa5a4e6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/36e6fa1538c74599acaafecdaa5a4e6f"}]}] Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-743993974 Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 36e6fa1538c74599acaafecdaa5a4e6f Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-743993974 Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesDeleteNegativeTestJSON-743993974-project Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: fa2f5e41ac004031acce40bfd842b8f3 Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-743993974-project Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: exception: Image not found. Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '-1'} Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:51.973089 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:51.984421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:25:51.984421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:25:51.984421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:25:51.984421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:25:51.984421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:25:51.984421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:25:51.984421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:25:51.984421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:25:51.984421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 10:25:51.984421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 10:25:51.984421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 10:25:51.984421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:51.984421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:51.984421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:51.984421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:51.984421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:25:51.984421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:25:51.984421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:25:51.984421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:25:51.984421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 10:25:51.984421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:51.984421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d0ee57f8-6ceb-43cd-98f3-75dc5d659270 tempest-ImagesDeleteNegativeTestJSON-743993974 tempest-ImagesDeleteNegativeTestJSON-743993974-project] Returning 404 to user: Image not found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:25:51.984421 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d0ee57f8-6ceb-43cd-98f3-75dc5d659270 tempest-ImagesDeleteNegativeTestJSON-743993974 tempest-ImagesDeleteNegativeTestJSON-743993974-project] 10.222.0.85 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.088883 Aug 24 10:25:51.984421 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1723/3125] 10.222.0.85 () {58 vars in 1134 bytes} [Wed Aug 24 10:25:51 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 10:25:51.996275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f6476063-5081-4b95-b139-569ce76f80e4 tempest-ImagesDeleteNegativeTestJSON-743993974 tempest-ImagesDeleteNegativeTestJSON-743993974-project] Calling method '.version_select at 0x7f4647e024c0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:52.036282 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7b05211f-70dc-4cfc-ad77-98da63b4b8c6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:52.049912 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7b05211f-70dc-4cfc-ad77-98da63b4b8c6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1314 microversion: 2.1 time: 0.580585 Aug 24 10:25:52.050627 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1403/3126] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:51 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:52.064713 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-f6476063-5081-4b95-b139-569ce76f80e4 tempest-ImagesDeleteNegativeTestJSON-743993974 tempest-ImagesDeleteNegativeTestJSON-743993974-project] HTTP exception thrown: Image not found. Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f6476063-5081-4b95-b139-569ce76f80e4 tempest-ImagesDeleteNegativeTestJSON-743993974 tempest-ImagesDeleteNegativeTestJSON-743993974-project] Request method failure captured: Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/images/84744a94-fc99-46d9-b670-fad01f5001fj HTTP/1.1 Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfyvR6TItl2ILqJHODkHQvLc9Xbr8EktNtyV09HdOfESeW0Gu34gIPqHDaF8-VUd-ZqsYe7NYmbbDJ0ly_MIyZTVciLoRoFX8i027tRSdtoZumS3qLrmbJmnYdQjvc2DFK7ac-AMJYOfid020I95YKDI4nnzr4VAB1DVRJWqAHMlz2M Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 36e6fa1538c74599acaafecdaa5a4e6f Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-743993974 Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/36e6fa1538c74599acaafecdaa5a4e6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_36e6fa1538c74599acaafecdaa5a4e6f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/36e6fa1538c74599acaafecdaa5a4e6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/36e6fa1538c74599acaafecdaa5a4e6f"}]}] Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-743993974 Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 36e6fa1538c74599acaafecdaa5a4e6f Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-743993974 Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesDeleteNegativeTestJSON-743993974-project Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: fa2f5e41ac004031acce40bfd842b8f3 Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-743993974-project Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: exception: Image not found. Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '84744a94-fc99-46d9-b670-fad01f5001fj'} Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 84744a94-fc99-46d9-b670-fad01f5001fj to delete Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 84744a94-fc99-46d9-b670-fad01f5001fj could not be found. Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:52.066730 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:52.071812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:52.071812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:25:52.071812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:25:52.071812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:25:52.071812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:25:52.071812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:25:52.071812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:25:52.071812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:25:52.071812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:25:52.071812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 10:25:52.071812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 10:25:52.071812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 10:25:52.071812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:52.071812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:52.071812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:52.071812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:52.071812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:25:52.071812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:25:52.071812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:25:52.071812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:25:52.071812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 10:25:52.071812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:52.074557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f6476063-5081-4b95-b139-569ce76f80e4 tempest-ImagesDeleteNegativeTestJSON-743993974 tempest-ImagesDeleteNegativeTestJSON-743993974-project] Returning 404 to user: Image not found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:25:52.075444 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f6476063-5081-4b95-b139-569ce76f80e4 tempest-ImagesDeleteNegativeTestJSON-743993974 tempest-ImagesDeleteNegativeTestJSON-743993974-project] 10.222.0.85 "DELETE /compute/v2.1/images/84744a94-fc99-46d9-b670-fad01f5001fj" status: 404 len: 62 microversion: 2.1 time: 0.093076 Aug 24 10:25:52.076022 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1724/3127] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:51 2022] DELETE /compute/v2.1/images/84744a94-fc99-46d9-b670-fad01f5001fj => generated 62 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 10:25:52.089185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-449d5dd2-ea36-4078-96ec-b1900c2d5a8d tempest-ImagesDeleteNegativeTestJSON-743993974 tempest-ImagesDeleteNegativeTestJSON-743993974-project] Calling method '.version_select at 0x7f465670a430>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:52.112956 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-449d5dd2-ea36-4078-96ec-b1900c2d5a8d tempest-ImagesDeleteNegativeTestJSON-743993974 tempest-ImagesDeleteNegativeTestJSON-743993974-project] HTTP exception thrown: Image not found. Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-449d5dd2-ea36-4078-96ec-b1900c2d5a8d tempest-ImagesDeleteNegativeTestJSON-743993974 tempest-ImagesDeleteNegativeTestJSON-743993974-project] Request method failure captured: Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/images/ef0d9011-9a60-486c-9579-f69726aaf2dd1 HTTP/1.1 Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfyvR6TItl2ILqJHODkHQvLc9Xbr8EktNtyV09HdOfESeW0Gu34gIPqHDaF8-VUd-ZqsYe7NYmbbDJ0ly_MIyZTVciLoRoFX8i027tRSdtoZumS3qLrmbJmnYdQjvc2DFK7ac-AMJYOfid020I95YKDI4nnzr4VAB1DVRJWqAHMlz2M Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 36e6fa1538c74599acaafecdaa5a4e6f Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-743993974 Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/36e6fa1538c74599acaafecdaa5a4e6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_36e6fa1538c74599acaafecdaa5a4e6f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/36e6fa1538c74599acaafecdaa5a4e6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/36e6fa1538c74599acaafecdaa5a4e6f"}]}] Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-743993974 Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 36e6fa1538c74599acaafecdaa5a4e6f Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-743993974 Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ImagesDeleteNegativeTestJSON-743993974-project Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: fa2f5e41ac004031acce40bfd842b8f3 Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-743993974-project Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: exception: Image not found. Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'ef0d9011-9a60-486c-9579-f69726aaf2dd1'} Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ef0d9011-9a60-486c-9579-f69726aaf2dd1 to delete Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ef0d9011-9a60-486c-9579-f69726aaf2dd1 could not be found. Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:52.115055 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:25:52.119894 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:52.119894 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:25:52.119894 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:25:52.119894 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:25:52.119894 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:25:52.119894 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:25:52.119894 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:25:52.119894 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:25:52.119894 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:25:52.119894 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 10:25:52.119894 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 10:25:52.119894 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 10:25:52.119894 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:25:52.119894 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:52.119894 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:25:52.119894 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:52.119894 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:25:52.119894 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:25:52.119894 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:25:52.119894 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:25:52.119894 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 10:25:52.119894 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:25:52.123468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-449d5dd2-ea36-4078-96ec-b1900c2d5a8d tempest-ImagesDeleteNegativeTestJSON-743993974 tempest-ImagesDeleteNegativeTestJSON-743993974-project] Returning 404 to user: Image not found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:25:52.124614 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-449d5dd2-ea36-4078-96ec-b1900c2d5a8d tempest-ImagesDeleteNegativeTestJSON-743993974 tempest-ImagesDeleteNegativeTestJSON-743993974-project] 10.222.0.85 "DELETE /compute/v2.1/images/ef0d9011-9a60-486c-9579-f69726aaf2dd1" status: 404 len: 62 microversion: 2.1 time: 0.039092 Aug 24 10:25:52.133770 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1404/3128] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:25:52 2022] DELETE /compute/v2.1/images/ef0d9011-9a60-486c-9579-f69726aaf2dd1 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:25:52.136776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-20ad1fe2-cec0-4c63-824f-a325745e636f tempest-ImagesDeleteNegativeTestJSON-743993974 tempest-ImagesDeleteNegativeTestJSON-743993974-project] Calling method '.version_select at 0x7f4647cc83a0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:52.186065 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-20ad1fe2-cec0-4c63-824f-a325745e636f tempest-ImagesDeleteNegativeTestJSON-743993974 tempest-ImagesDeleteNegativeTestJSON-743993974-project] HTTP exception thrown: Image not found. Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-20ad1fe2-cec0-4c63-824f-a325745e636f tempest-ImagesDeleteNegativeTestJSON-743993974 tempest-ImagesDeleteNegativeTestJSON-743993974-project] Request method failure captured: Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/images/tempest-invalid-1029139816 HTTP/1.1 Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfyvR6TItl2ILqJHODkHQvLc9Xbr8EktNtyV09HdOfESeW0Gu34gIPqHDaF8-VUd-ZqsYe7NYmbbDJ0ly_MIyZTVciLoRoFX8i027tRSdtoZumS3qLrmbJmnYdQjvc2DFK7ac-AMJYOfid020I95YKDI4nnzr4VAB1DVRJWqAHMlz2M Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 36e6fa1538c74599acaafecdaa5a4e6f Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-743993974 Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/36e6fa1538c74599acaafecdaa5a4e6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_36e6fa1538c74599acaafecdaa5a4e6f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/36e6fa1538c74599acaafecdaa5a4e6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/36e6fa1538c74599acaafecdaa5a4e6f"}]}] Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-743993974 Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 36e6fa1538c74599acaafecdaa5a4e6f Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-743993974 Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesDeleteNegativeTestJSON-743993974-project Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: fa2f5e41ac004031acce40bfd842b8f3 Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-743993974-project Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: exception: Image not found. Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'tempest-invalid-1029139816'} Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1029139816 to delete Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1029139816 could not be found. Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:52.188773 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:52.194562 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:25:52.194562 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:25:52.194562 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:25:52.194562 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:25:52.194562 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:25:52.194562 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:25:52.194562 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:25:52.194562 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:25:52.194562 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 10:25:52.194562 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 10:25:52.194562 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 10:25:52.194562 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:52.194562 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:52.194562 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:52.194562 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:52.194562 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:25:52.194562 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:25:52.194562 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:25:52.194562 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:25:52.194562 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 10:25:52.194562 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:25:52.194562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-20ad1fe2-cec0-4c63-824f-a325745e636f tempest-ImagesDeleteNegativeTestJSON-743993974 tempest-ImagesDeleteNegativeTestJSON-743993974-project] Returning 404 to user: Image not found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:25:52.194562 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-20ad1fe2-cec0-4c63-824f-a325745e636f tempest-ImagesDeleteNegativeTestJSON-743993974 tempest-ImagesDeleteNegativeTestJSON-743993974-project] 10.222.0.85 "DELETE /compute/v2.1/images/tempest-invalid-1029139816" status: 404 len: 62 microversion: 2.1 time: 0.060313 Aug 24 10:25:52.194562 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1725/3129] 10.222.0.85 () {58 vars in 1206 bytes} [Wed Aug 24 10:25:52 2022] DELETE /compute/v2.1/images/tempest-invalid-1029139816 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 10:25:52.201783 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:52.212036 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:52.222258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b0fc6afa-d75f-4a71-be05-d25824870673 tempest-ImagesDeleteNegativeTestJSON-743993974 tempest-ImagesDeleteNegativeTestJSON-743993974-project] Calling method '.version_select at 0x7f4655012a60>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:52.290052 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-b0fc6afa-d75f-4a71-be05-d25824870673 tempest-ImagesDeleteNegativeTestJSON-743993974 tempest-ImagesDeleteNegativeTestJSON-743993974-project] HTTP exception thrown: Image not found. Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b0fc6afa-d75f-4a71-be05-d25824870673 tempest-ImagesDeleteNegativeTestJSON-743993974 tempest-ImagesDeleteNegativeTestJSON-743993974-project] Request method failure captured: Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/images/823d215c-6c97-43c7-b2b0-60c158ff7f63 HTTP/1.1 Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfyvR6TItl2ILqJHODkHQvLc9Xbr8EktNtyV09HdOfESeW0Gu34gIPqHDaF8-VUd-ZqsYe7NYmbbDJ0ly_MIyZTVciLoRoFX8i027tRSdtoZumS3qLrmbJmnYdQjvc2DFK7ac-AMJYOfid020I95YKDI4nnzr4VAB1DVRJWqAHMlz2M Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 36e6fa1538c74599acaafecdaa5a4e6f Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-743993974 Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/36e6fa1538c74599acaafecdaa5a4e6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_36e6fa1538c74599acaafecdaa5a4e6f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/36e6fa1538c74599acaafecdaa5a4e6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/36e6fa1538c74599acaafecdaa5a4e6f"}]}] Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-743993974 Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 36e6fa1538c74599acaafecdaa5a4e6f Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-743993974 Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ImagesDeleteNegativeTestJSON-743993974-project Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: fa2f5e41ac004031acce40bfd842b8f3 Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-743993974-project Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: exception: Image not found. Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '823d215c-6c97-43c7-b2b0-60c158ff7f63'} Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 823d215c-6c97-43c7-b2b0-60c158ff7f63 to delete Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 823d215c-6c97-43c7-b2b0-60c158ff7f63 could not be found. Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:52.292786 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:25:52.297099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:52.297099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:25:52.297099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:25:52.297099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:25:52.297099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:25:52.297099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:25:52.297099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:25:52.297099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:25:52.297099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:25:52.297099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 10:25:52.297099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 10:25:52.297099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 10:25:52.297099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:25:52.297099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:52.297099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:25:52.297099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:52.297099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:25:52.297099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:25:52.297099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:25:52.297099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:25:52.297099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 10:25:52.297099 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:25:52.300005 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b0fc6afa-d75f-4a71-be05-d25824870673 tempest-ImagesDeleteNegativeTestJSON-743993974 tempest-ImagesDeleteNegativeTestJSON-743993974-project] Returning 404 to user: Image not found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:25:52.301390 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b0fc6afa-d75f-4a71-be05-d25824870673 tempest-ImagesDeleteNegativeTestJSON-743993974 tempest-ImagesDeleteNegativeTestJSON-743993974-project] 10.222.0.85 "DELETE /compute/v2.1/images/823d215c-6c97-43c7-b2b0-60c158ff7f63" status: 404 len: 62 microversion: 2.1 time: 0.100865 Aug 24 10:25:52.307477 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1405/3130] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:52 2022] DELETE /compute/v2.1/images/823d215c-6c97-43c7-b2b0-60c158ff7f63 => generated 62 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:25:52.468105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1fcaef1b-9a73-417e-b3ed-1685c23218b0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:52.469334 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1fcaef1b-9a73-417e-b3ed-1685c23218b0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:52.499089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fcaef1b-9a73-417e-b3ed-1685c23218b0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:52.502771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fcaef1b-9a73-417e-b3ed-1685c23218b0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:52.505143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fcaef1b-9a73-417e-b3ed-1685c23218b0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:52.509321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fcaef1b-9a73-417e-b3ed-1685c23218b0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:52.511832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fcaef1b-9a73-417e-b3ed-1685c23218b0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:52.512610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fcaef1b-9a73-417e-b3ed-1685c23218b0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:52.542646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-5886e504-4e42-42b6-b8b6-5d1ae3ba3727 req-71d67fcf-553b-4e66-aaca-49f56e89492e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b4d58bf-f4f2-408f-8609-82b6a528a630", "tag": "2d5225b0-cc29-4199-a1e8-017af43894fb"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:25:52.587205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5886e504-4e42-42b6-b8b6-5d1ae3ba3727 req-71d67fcf-553b-4e66-aaca-49f56e89492e service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:52.587959 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5886e504-4e42-42b6-b8b6-5d1ae3ba3727 req-71d67fcf-553b-4e66-aaca-49f56e89492e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:52.592876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5886e504-4e42-42b6-b8b6-5d1ae3ba3727 req-71d67fcf-553b-4e66-aaca-49f56e89492e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:52.649501 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-5886e504-4e42-42b6-b8b6-5d1ae3ba3727 req-71d67fcf-553b-4e66-aaca-49f56e89492e service nova] Creating event network-changed:2d5225b0-cc29-4199-a1e8-017af43894fb for instance 7b4d58bf-f4f2-408f-8609-82b6a528a630 on n-h1-849328-3 Aug 24 10:25:52.671122 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-5886e504-4e42-42b6-b8b6-5d1ae3ba3727 req-71d67fcf-553b-4e66-aaca-49f56e89492e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134249 Aug 24 10:25:52.672540 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1406/3131] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:52.680055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fb2f3dfb-c0aa-4ef0-9f75-4a821ec303fd tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:52.681240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fb2f3dfb-c0aa-4ef0-9f75-4a821ec303fd tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] [instance: 7b4d58bf-f4f2-408f-8609-82b6a528a630] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:52.689617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb2f3dfb-c0aa-4ef0-9f75-4a821ec303fd tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:52.692129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb2f3dfb-c0aa-4ef0-9f75-4a821ec303fd tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:52.692993 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb2f3dfb-c0aa-4ef0-9f75-4a821ec303fd tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:52.696613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb2f3dfb-c0aa-4ef0-9f75-4a821ec303fd tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:52.698114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb2f3dfb-c0aa-4ef0-9f75-4a821ec303fd tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:52.698909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb2f3dfb-c0aa-4ef0-9f75-4a821ec303fd tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:53.125955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1fcaef1b-9a73-417e-b3ed-1685c23218b0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:53.139604 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1fcaef1b-9a73-417e-b3ed-1685c23218b0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1314 microversion: 2.1 time: 0.679055 Aug 24 10:25:53.141302 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1726/3132] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:52 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1314 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:53.160278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6579daba-6d50-4024-b269-d119ef354ab4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:53.161839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6579daba-6d50-4024-b269-d119ef354ab4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:53.193985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6579daba-6d50-4024-b269-d119ef354ab4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:53.203417 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6579daba-6d50-4024-b269-d119ef354ab4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:53.205926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6579daba-6d50-4024-b269-d119ef354ab4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:53.210878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6579daba-6d50-4024-b269-d119ef354ab4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:53.211773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6579daba-6d50-4024-b269-d119ef354ab4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:53.212544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6579daba-6d50-4024-b269-d119ef354ab4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:53.429048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fb2f3dfb-c0aa-4ef0-9f75-4a821ec303fd tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:53.445357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fb2f3dfb-c0aa-4ef0-9f75-4a821ec303fd tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:53.454763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fb2f3dfb-c0aa-4ef0-9f75-4a821ec303fd tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:53.457019 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fb2f3dfb-c0aa-4ef0-9f75-4a821ec303fd tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] 10.222.0.85 "GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630" status: 200 len: 1359 microversion: 2.21 time: 0.782781 Aug 24 10:25:53.474910 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1407/3133] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:25:52 2022] GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630 => generated 1359 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:25:54.174121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-16efcfbc-4b44-492f-ba84-fff3afa7e5e2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:54.176204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-16efcfbc-4b44-492f-ba84-fff3afa7e5e2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:54.196669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16efcfbc-4b44-492f-ba84-fff3afa7e5e2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:54.197239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16efcfbc-4b44-492f-ba84-fff3afa7e5e2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:54.198021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16efcfbc-4b44-492f-ba84-fff3afa7e5e2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:54.199131 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16efcfbc-4b44-492f-ba84-fff3afa7e5e2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:54.199752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16efcfbc-4b44-492f-ba84-fff3afa7e5e2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:54.200334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16efcfbc-4b44-492f-ba84-fff3afa7e5e2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:54.207050 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6579daba-6d50-4024-b269-d119ef354ab4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:54.216574 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6579daba-6d50-4024-b269-d119ef354ab4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1314 microversion: 2.1 time: 1.073447 Aug 24 10:25:54.230500 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1727/3134] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:53 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1314 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:54.487384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-64910862-d615-4b65-963a-4d0c8ab52f8d tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:54.488362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-64910862-d615-4b65-963a-4d0c8ab52f8d tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] [instance: 7b4d58bf-f4f2-408f-8609-82b6a528a630] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:54.505549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64910862-d615-4b65-963a-4d0c8ab52f8d tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:54.506434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64910862-d615-4b65-963a-4d0c8ab52f8d tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:54.507155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64910862-d615-4b65-963a-4d0c8ab52f8d tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:54.508100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64910862-d615-4b65-963a-4d0c8ab52f8d tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:54.508780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64910862-d615-4b65-963a-4d0c8ab52f8d tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:54.509447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64910862-d615-4b65-963a-4d0c8ab52f8d tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:54.523347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-16efcfbc-4b44-492f-ba84-fff3afa7e5e2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:54.536203 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-16efcfbc-4b44-492f-ba84-fff3afa7e5e2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1500 microversion: 2.1 time: 0.367092 Aug 24 10:25:54.545639 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1408/3135] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:54 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1500 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:25:54.563280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b808a8a6-1cbd-4b75-94d6-5a8a8d49ff39 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:25:54.571047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b808a8a6-1cbd-4b75-94d6-5a8a8d49ff39 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:54.571625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:54.590775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b808a8a6-1cbd-4b75-94d6-5a8a8d49ff39 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:54.594768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:54.596118 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b808a8a6-1cbd-4b75-94d6-5a8a8d49ff39 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:54.597349 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b808a8a6-1cbd-4b75-94d6-5a8a8d49ff39 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:54.600278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b808a8a6-1cbd-4b75-94d6-5a8a8d49ff39 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:54.601082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b808a8a6-1cbd-4b75-94d6-5a8a8d49ff39 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:54.602443 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b808a8a6-1cbd-4b75-94d6-5a8a8d49ff39 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:54.631105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-b808a8a6-1cbd-4b75-94d6-5a8a8d49ff39 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lazy-loading 'flavor' on Instance uuid ea7bc787-3b2c-4174-b05a-178957293e0d {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:25:54.846224 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b808a8a6-1cbd-4b75-94d6-5a8a8d49ff39 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "POST /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d/action" status: 200 len: 32 microversion: 2.1 time: 0.288141 Aug 24 10:25:54.847965 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1409/3136] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:25:54 2022] POST /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d/action => generated 32 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 10:25:54.857374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-74a3a1e9-58fb-4599-bf15-6b18191e4ad6 req-49ecb771-faad-49b7-85d4-34c435d45cbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fdab911-592d-4d21-9420-fdadfea05875", "tag": "32431dd4-4f50-43ba-b6d9-cd4dc40210f9"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:25:54.899052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-74a3a1e9-58fb-4599-bf15-6b18191e4ad6 req-49ecb771-faad-49b7-85d4-34c435d45cbc service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:54.899796 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-74a3a1e9-58fb-4599-bf15-6b18191e4ad6 req-49ecb771-faad-49b7-85d4-34c435d45cbc service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:54.900384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-74a3a1e9-58fb-4599-bf15-6b18191e4ad6 req-49ecb771-faad-49b7-85d4-34c435d45cbc service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:54.927623 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-74a3a1e9-58fb-4599-bf15-6b18191e4ad6 req-49ecb771-faad-49b7-85d4-34c435d45cbc service nova] Creating event network-changed:32431dd4-4f50-43ba-b6d9-cd4dc40210f9 for instance 0fdab911-592d-4d21-9420-fdadfea05875 on n-h1-849328-3 Aug 24 10:25:54.934411 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-74a3a1e9-58fb-4599-bf15-6b18191e4ad6 req-49ecb771-faad-49b7-85d4-34c435d45cbc service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084393 Aug 24 10:25:54.943218 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1410/3137] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:54.963132 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-735c3acd-95a4-42de-938c-54bcf25681d8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:54.967369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-735c3acd-95a4-42de-938c-54bcf25681d8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:54.978357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-735c3acd-95a4-42de-938c-54bcf25681d8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:54.979126 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-735c3acd-95a4-42de-938c-54bcf25681d8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:54.981074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-735c3acd-95a4-42de-938c-54bcf25681d8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:54.983120 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-735c3acd-95a4-42de-938c-54bcf25681d8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:54.983813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-735c3acd-95a4-42de-938c-54bcf25681d8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:54.984499 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-735c3acd-95a4-42de-938c-54bcf25681d8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:55.176590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-64910862-d615-4b65-963a-4d0c8ab52f8d tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:55.196291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-64910862-d615-4b65-963a-4d0c8ab52f8d tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:55.198066 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-64910862-d615-4b65-963a-4d0c8ab52f8d tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:55.199325 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-64910862-d615-4b65-963a-4d0c8ab52f8d tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] 10.222.0.85 "GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630" status: 200 len: 1359 microversion: 2.21 time: 0.716263 Aug 24 10:25:55.210195 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1728/3138] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:25:54 2022] GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630 => generated 1359 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:25:55.253738 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fd61daf2-a6d0-4ecd-b4ae-a9c6188a6c49 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:55.255934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fd61daf2-a6d0-4ecd-b4ae-a9c6188a6c49 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:55.273885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd61daf2-a6d0-4ecd-b4ae-a9c6188a6c49 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:55.274900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd61daf2-a6d0-4ecd-b4ae-a9c6188a6c49 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:55.276836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd61daf2-a6d0-4ecd-b4ae-a9c6188a6c49 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:55.278482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd61daf2-a6d0-4ecd-b4ae-a9c6188a6c49 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:55.279390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd61daf2-a6d0-4ecd-b4ae-a9c6188a6c49 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:55.280090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd61daf2-a6d0-4ecd-b4ae-a9c6188a6c49 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:55.748996 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-735c3acd-95a4-42de-938c-54bcf25681d8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:55.763449 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-735c3acd-95a4-42de-938c-54bcf25681d8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1506 microversion: 2.1 time: 0.818531 Aug 24 10:25:55.764774 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1411/3139] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:54 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1506 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:55.788198 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fd61daf2-a6d0-4ecd-b4ae-a9c6188a6c49 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:55.799002 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fd61daf2-a6d0-4ecd-b4ae-a9c6188a6c49 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1314 microversion: 2.1 time: 0.549284 Aug 24 10:25:55.801183 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1729/3140] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:55 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:56.259264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-329da838-2d25-423b-b591-9444052676bb tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:56.261020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-329da838-2d25-423b-b591-9444052676bb tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] [instance: 7b4d58bf-f4f2-408f-8609-82b6a528a630] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:56.273296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-329da838-2d25-423b-b591-9444052676bb tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:56.274548 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-329da838-2d25-423b-b591-9444052676bb tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:56.275237 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-329da838-2d25-423b-b591-9444052676bb tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:56.276478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-329da838-2d25-423b-b591-9444052676bb tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:56.277375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-329da838-2d25-423b-b591-9444052676bb tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:56.278405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-329da838-2d25-423b-b591-9444052676bb tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:56.787480 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0a9a8474-6209-4743-9a22-e0e19fdd78b6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:56.789839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0a9a8474-6209-4743-9a22-e0e19fdd78b6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:56.813961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a9a8474-6209-4743-9a22-e0e19fdd78b6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:56.820628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a9a8474-6209-4743-9a22-e0e19fdd78b6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:56.824343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a9a8474-6209-4743-9a22-e0e19fdd78b6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:56.830660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a9a8474-6209-4743-9a22-e0e19fdd78b6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:56.833111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a9a8474-6209-4743-9a22-e0e19fdd78b6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:56.837167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a9a8474-6209-4743-9a22-e0e19fdd78b6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:57.161759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0a9a8474-6209-4743-9a22-e0e19fdd78b6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:57.174788 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0a9a8474-6209-4743-9a22-e0e19fdd78b6 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1506 microversion: 2.1 time: 0.393567 Aug 24 10:25:57.176807 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1730/3141] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:56 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1506 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:25:57.206698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b89de827-b3ef-4206-ba86-0680f3389307 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:57.207841 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b89de827-b3ef-4206-ba86-0680f3389307 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:57.213273 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:25:57.213781 n-d-849328-3 devstack@n-api.service[122433]: Wed Aug 24 10:25:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 (ip 10.222.0.85) !!! Aug 24 10:25:57.227709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b89de827-b3ef-4206-ba86-0680f3389307 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:57.229420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b89de827-b3ef-4206-ba86-0680f3389307 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:57.230105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b89de827-b3ef-4206-ba86-0680f3389307 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:57.231327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b89de827-b3ef-4206-ba86-0680f3389307 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:57.232610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b89de827-b3ef-4206-ba86-0680f3389307 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:57.233646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b89de827-b3ef-4206-ba86-0680f3389307 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:57.662741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-329da838-2d25-423b-b591-9444052676bb tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:57.692561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-329da838-2d25-423b-b591-9444052676bb tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:57.695580 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-329da838-2d25-423b-b591-9444052676bb tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:57.710480 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-329da838-2d25-423b-b591-9444052676bb tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] 10.222.0.85 "GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630" status: 200 len: 1359 microversion: 2.21 time: 1.480750 Aug 24 10:25:57.729153 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1412/3142] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:25:56 2022] GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630 => generated 1359 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:25:57.960105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b89de827-b3ef-4206-ba86-0680f3389307 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:57.969023 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b89de827-b3ef-4206-ba86-0680f3389307 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1314 microversion: 2.1 time: 0.773417 Aug 24 10:25:57.969641 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1731/3143] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:57 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1314 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:58.035922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-16afeb52-e488-445c-a605-ea6f955f20fd tempest-AbsoluteLimitsNegativeTestJSON-1745443114 tempest-AbsoluteLimitsNegativeTestJSON-1745443114-project] Calling method '.version_select at 0x7f4655074d30>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:58.048571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:58.059819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16afeb52-e488-445c-a605-ea6f955f20fd tempest-AbsoluteLimitsNegativeTestJSON-1745443114 tempest-AbsoluteLimitsNegativeTestJSON-1745443114-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:58.065328 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16afeb52-e488-445c-a605-ea6f955f20fd tempest-AbsoluteLimitsNegativeTestJSON-1745443114 tempest-AbsoluteLimitsNegativeTestJSON-1745443114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:58.066348 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16afeb52-e488-445c-a605-ea6f955f20fd tempest-AbsoluteLimitsNegativeTestJSON-1745443114 tempest-AbsoluteLimitsNegativeTestJSON-1745443114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:58.067364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16afeb52-e488-445c-a605-ea6f955f20fd tempest-AbsoluteLimitsNegativeTestJSON-1745443114 tempest-AbsoluteLimitsNegativeTestJSON-1745443114-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:58.073931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16afeb52-e488-445c-a605-ea6f955f20fd tempest-AbsoluteLimitsNegativeTestJSON-1745443114 tempest-AbsoluteLimitsNegativeTestJSON-1745443114-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:58.074809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16afeb52-e488-445c-a605-ea6f955f20fd tempest-AbsoluteLimitsNegativeTestJSON-1745443114 tempest-AbsoluteLimitsNegativeTestJSON-1745443114-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:58.126608 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-16afeb52-e488-445c-a605-ea6f955f20fd tempest-AbsoluteLimitsNegativeTestJSON-1745443114 tempest-AbsoluteLimitsNegativeTestJSON-1745443114-project] 10.222.0.85 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.407272 Aug 24 10:25:58.133070 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1413/3144] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 10:25:57 2022] GET /compute/v2.1/limits => generated 511 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:58.201873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-35ab6123-45c0-4ee7-a6eb-dc9689276dc4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:58.202548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-35ab6123-45c0-4ee7-a6eb-dc9689276dc4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:58.213262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:58.230895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35ab6123-45c0-4ee7-a6eb-dc9689276dc4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:58.231742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35ab6123-45c0-4ee7-a6eb-dc9689276dc4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:58.232206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35ab6123-45c0-4ee7-a6eb-dc9689276dc4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:58.232945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35ab6123-45c0-4ee7-a6eb-dc9689276dc4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:58.236017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35ab6123-45c0-4ee7-a6eb-dc9689276dc4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:58.240109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35ab6123-45c0-4ee7-a6eb-dc9689276dc4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:58.271737 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-77885599-c872-4997-a55f-9536e4706799 tempest-AbsoluteLimitsNegativeTestJSON-1745443114 tempest-AbsoluteLimitsNegativeTestJSON-1745443114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-64980564", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:25:58.455913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-77885599-c872-4997-a55f-9536e4706799 tempest-AbsoluteLimitsNegativeTestJSON-1745443114 tempest-AbsoluteLimitsNegativeTestJSON-1745443114-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:25:59.061597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-35ab6123-45c0-4ee7-a6eb-dc9689276dc4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:59.079524 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-35ab6123-45c0-4ee7-a6eb-dc9689276dc4 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1506 microversion: 2.1 time: 0.883151 Aug 24 10:25:59.080388 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1732/3145] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:58 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1506 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:59.093375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6a1c0270-144c-4b18-bb73-314b1cb05fdb tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:59.094091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6a1c0270-144c-4b18-bb73-314b1cb05fdb tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] [instance: 7b4d58bf-f4f2-408f-8609-82b6a528a630] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:59.114274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a1c0270-144c-4b18-bb73-314b1cb05fdb tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:59.114870 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a1c0270-144c-4b18-bb73-314b1cb05fdb tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:59.115556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a1c0270-144c-4b18-bb73-314b1cb05fdb tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:59.116625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a1c0270-144c-4b18-bb73-314b1cb05fdb tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:59.117283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a1c0270-144c-4b18-bb73-314b1cb05fdb tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:59.118496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a1c0270-144c-4b18-bb73-314b1cb05fdb tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:59.658297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-77885599-c872-4997-a55f-9536e4706799 tempest-AbsoluteLimitsNegativeTestJSON-1745443114 tempest-AbsoluteLimitsNegativeTestJSON-1745443114-project] Getting quotas for project f5a3503fed164c329f8da4544090d093. Resources: dict_keys(['metadata_items']) {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:25:59.671371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-77885599-c872-4997-a55f-9536e4706799 tempest-AbsoluteLimitsNegativeTestJSON-1745443114 tempest-AbsoluteLimitsNegativeTestJSON-1745443114-project] Getting quotas for user 47916942bcac44c4b104fd46f78a826c and project f5a3503fed164c329f8da4544090d093. Resources: dict_keys(['metadata_items']) {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:25:59.717534 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-77885599-c872-4997-a55f-9536e4706799 tempest-AbsoluteLimitsNegativeTestJSON-1745443114 tempest-AbsoluteLimitsNegativeTestJSON-1745443114-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-77885599-c872-4997-a55f-9536e4706799 tempest-AbsoluteLimitsNegativeTestJSON-1745443114 tempest-AbsoluteLimitsNegativeTestJSON-1745443114-project] Request method failure captured: Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 1750 Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfy1sJTDoHHNHI4ht5hyrTLCiFdA7towS7GQMrqCT-lhSwjwFad20yzcJxkvuG_rf1VC0dMRWjrRnfoiOU5fy_SqM1Izy5ELB8GGOgFJ2YCog_fR35jFu4qQ0xMdQPhpyLy39VJoSSzsFNYG1tM4KDRItRIh58Op9XSg7fY5l1bPxTw Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: f5a3503fed164c329f8da4544090d093 Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1745443114 Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f5a3503fed164c329f8da4544090d093"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f5a3503fed164c329f8da4544090d093", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f5a3503fed164c329f8da4544090d093"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f5a3503fed164c329f8da4544090d093"}]}] Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1745443114 Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: f5a3503fed164c329f8da4544090d093 Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1745443114 Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1745443114-project Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 47916942bcac44c4b104fd46f78a826c Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1745443114-project Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-64980564", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:25:59.723558 n-d-849328-3 devstack@n-api.service[122432]: exception: Maximum number of metadata items exceeds 128 Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-64980564', 'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 463, in _check_metadata_properties_quota Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1711, in _create_instance Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1003, in _checks_for_create_and_rebuild Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 470, in _check_metadata_properties_quota Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:25:59.726066 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:25:59.728845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:25:59.728845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 10:25:59.728845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 24 10:25:59.728845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 24 10:25:59.728845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 24 10:25:59.728845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:25:59.728845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:59.728845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:25:59.728845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:59.728845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:25:59.728845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:25:59.728845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:25:59.728845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:25:59.728845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 24 10:25:59.728845 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:25:59.728845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-77885599-c872-4997-a55f-9536e4706799 tempest-AbsoluteLimitsNegativeTestJSON-1745443114 tempest-AbsoluteLimitsNegativeTestJSON-1745443114-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:25:59.728845 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-77885599-c872-4997-a55f-9536e4706799 tempest-AbsoluteLimitsNegativeTestJSON-1745443114 tempest-AbsoluteLimitsNegativeTestJSON-1745443114-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.467581 Aug 24 10:25:59.728845 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1414/3146] 10.222.0.85 () {60 vars in 1148 bytes} [Wed Aug 24 10:25:58 2022] POST /compute/v2.1/servers => generated 87 bytes in 1469 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:25:59.748800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-33a88f12-6b7c-4e31-8a71-7923565e4cc3 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:59.749828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-33a88f12-6b7c-4e31-8a71-7923565e4cc3 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:59.774131 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33a88f12-6b7c-4e31-8a71-7923565e4cc3 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:59.776906 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33a88f12-6b7c-4e31-8a71-7923565e4cc3 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:59.777679 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33a88f12-6b7c-4e31-8a71-7923565e4cc3 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:59.780400 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33a88f12-6b7c-4e31-8a71-7923565e4cc3 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:59.783508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33a88f12-6b7c-4e31-8a71-7923565e4cc3 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:59.786031 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33a88f12-6b7c-4e31-8a71-7923565e4cc3 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:00.030907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6a1c0270-144c-4b18-bb73-314b1cb05fdb tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:00.070866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6a1c0270-144c-4b18-bb73-314b1cb05fdb tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:00.078164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6a1c0270-144c-4b18-bb73-314b1cb05fdb tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:00.083258 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6a1c0270-144c-4b18-bb73-314b1cb05fdb tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] 10.222.0.85 "GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630" status: 200 len: 1359 microversion: 2.21 time: 0.998200 Aug 24 10:26:00.085169 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1733/3147] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:25:59 2022] GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630 => generated 1359 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:26:00.105700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-2d02e23d-71c0-4089-81ce-518f2fafb835 req-33401030-c360-4d51-98cf-a9db77bfcb77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b4d58bf-f4f2-408f-8609-82b6a528a630", "name": "network-vif-plugged", "status": "completed", "tag": "2d5225b0-cc29-4199-a1e8-017af43894fb"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:00.160325 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2d02e23d-71c0-4089-81ce-518f2fafb835 req-33401030-c360-4d51-98cf-a9db77bfcb77 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:00.161083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2d02e23d-71c0-4089-81ce-518f2fafb835 req-33401030-c360-4d51-98cf-a9db77bfcb77 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:00.162354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2d02e23d-71c0-4089-81ce-518f2fafb835 req-33401030-c360-4d51-98cf-a9db77bfcb77 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:00.201720 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-2d02e23d-71c0-4089-81ce-518f2fafb835 req-33401030-c360-4d51-98cf-a9db77bfcb77 service nova] Creating event network-vif-plugged:2d5225b0-cc29-4199-a1e8-017af43894fb for instance 7b4d58bf-f4f2-408f-8609-82b6a528a630 on n-h1-849328-3 Aug 24 10:26:00.210887 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-2d02e23d-71c0-4089-81ce-518f2fafb835 req-33401030-c360-4d51-98cf-a9db77bfcb77 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120837 Aug 24 10:26:00.212029 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1734/3148] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:00.218848 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b7833230-c572-4464-b256-564cd529bd94 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:00.219923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b7833230-c572-4464-b256-564cd529bd94 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:00.227690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7833230-c572-4464-b256-564cd529bd94 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:00.228495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7833230-c572-4464-b256-564cd529bd94 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:00.228692 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7833230-c572-4464-b256-564cd529bd94 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:00.229724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7833230-c572-4464-b256-564cd529bd94 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:00.230355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7833230-c572-4464-b256-564cd529bd94 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:00.230970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7833230-c572-4464-b256-564cd529bd94 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:00.388174 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-33a88f12-6b7c-4e31-8a71-7923565e4cc3 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:00.404543 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-33a88f12-6b7c-4e31-8a71-7923565e4cc3 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1314 microversion: 2.1 time: 0.677715 Aug 24 10:26:00.405403 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1415/3149] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:59 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1314 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:01.046981 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b7833230-c572-4464-b256-564cd529bd94 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:01.076893 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b7833230-c572-4464-b256-564cd529bd94 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1506 microversion: 2.1 time: 0.863215 Aug 24 10:26:01.085618 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1735/3150] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:00 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1506 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:01.119451 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bdca603f-1f35-4238-93ca-e6b641e65c08 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:01.120193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bdca603f-1f35-4238-93ca-e6b641e65c08 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] [instance: 7b4d58bf-f4f2-408f-8609-82b6a528a630] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:01.141109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdca603f-1f35-4238-93ca-e6b641e65c08 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:01.141909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdca603f-1f35-4238-93ca-e6b641e65c08 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:01.142574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdca603f-1f35-4238-93ca-e6b641e65c08 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:01.164329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdca603f-1f35-4238-93ca-e6b641e65c08 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:01.167269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdca603f-1f35-4238-93ca-e6b641e65c08 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:01.168102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdca603f-1f35-4238-93ca-e6b641e65c08 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:01.437453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fce0d509-8f6c-4255-ae4e-aa7af4e1da1b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:01.438874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fce0d509-8f6c-4255-ae4e-aa7af4e1da1b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:01.466754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fce0d509-8f6c-4255-ae4e-aa7af4e1da1b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:01.468623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fce0d509-8f6c-4255-ae4e-aa7af4e1da1b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:01.470409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fce0d509-8f6c-4255-ae4e-aa7af4e1da1b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:01.490909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fce0d509-8f6c-4255-ae4e-aa7af4e1da1b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:01.491884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fce0d509-8f6c-4255-ae4e-aa7af4e1da1b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:01.496479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fce0d509-8f6c-4255-ae4e-aa7af4e1da1b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:01.563647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:01.974977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bdca603f-1f35-4238-93ca-e6b641e65c08 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:02.014359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bdca603f-1f35-4238-93ca-e6b641e65c08 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:02.024338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bdca603f-1f35-4238-93ca-e6b641e65c08 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:02.026299 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bdca603f-1f35-4238-93ca-e6b641e65c08 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] 10.222.0.85 "GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630" status: 200 len: 1359 microversion: 2.21 time: 0.915225 Aug 24 10:26:02.027714 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1416/3151] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:26:01 2022] GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630 => generated 1359 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:26:02.109440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-62bde06a-91d4-423e-98dd-05f61220ba7a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:02.110384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-62bde06a-91d4-423e-98dd-05f61220ba7a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:02.122831 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62bde06a-91d4-423e-98dd-05f61220ba7a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:02.130278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62bde06a-91d4-423e-98dd-05f61220ba7a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:02.132800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62bde06a-91d4-423e-98dd-05f61220ba7a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:02.137930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62bde06a-91d4-423e-98dd-05f61220ba7a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:02.138871 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62bde06a-91d4-423e-98dd-05f61220ba7a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:02.143214 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62bde06a-91d4-423e-98dd-05f61220ba7a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:02.248673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fce0d509-8f6c-4255-ae4e-aa7af4e1da1b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:02.273217 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fce0d509-8f6c-4255-ae4e-aa7af4e1da1b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1314 microversion: 2.1 time: 0.847481 Aug 24 10:26:02.289301 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1736/3152] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:01 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1314 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:02.523284 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-62bde06a-91d4-423e-98dd-05f61220ba7a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:02.532174 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-62bde06a-91d4-423e-98dd-05f61220ba7a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1506 microversion: 2.1 time: 0.428746 Aug 24 10:26:02.536925 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1417/3153] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:02 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1506 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:03.052452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4eceb537-4abc-4d17-9233-4b7101864529 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:03.053168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4eceb537-4abc-4d17-9233-4b7101864529 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] [instance: 7b4d58bf-f4f2-408f-8609-82b6a528a630] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:03.069198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c6ecbdac-f0f6-40a9-a158-c933f1b987a0 req-17b8aacc-8e46-4c6f-a185-b359add2025d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fdab911-592d-4d21-9420-fdadfea05875", "name": "network-vif-plugged", "status": "completed", "tag": "32431dd4-4f50-43ba-b6d9-cd4dc40210f9"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:03.118494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4eceb537-4abc-4d17-9233-4b7101864529 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:03.119687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4eceb537-4abc-4d17-9233-4b7101864529 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:03.121627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4eceb537-4abc-4d17-9233-4b7101864529 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:03.126419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4eceb537-4abc-4d17-9233-4b7101864529 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:03.129920 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c6ecbdac-f0f6-40a9-a158-c933f1b987a0 req-17b8aacc-8e46-4c6f-a185-b359add2025d service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:03.132949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4eceb537-4abc-4d17-9233-4b7101864529 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:03.134542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4eceb537-4abc-4d17-9233-4b7101864529 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:03.146108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c6ecbdac-f0f6-40a9-a158-c933f1b987a0 req-17b8aacc-8e46-4c6f-a185-b359add2025d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:03.148650 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c6ecbdac-f0f6-40a9-a158-c933f1b987a0 req-17b8aacc-8e46-4c6f-a185-b359add2025d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:03.190270 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c6ecbdac-f0f6-40a9-a158-c933f1b987a0 req-17b8aacc-8e46-4c6f-a185-b359add2025d service nova] Creating event network-vif-plugged:32431dd4-4f50-43ba-b6d9-cd4dc40210f9 for instance 0fdab911-592d-4d21-9420-fdadfea05875 on n-h1-849328-3 Aug 24 10:26:03.197937 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c6ecbdac-f0f6-40a9-a158-c933f1b987a0 req-17b8aacc-8e46-4c6f-a185-b359add2025d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137680 Aug 24 10:26:03.197937 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1418/3154] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:03.297669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f2c34d75-b29e-49f7-bcf9-bc6b17008158 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:03.300583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f2c34d75-b29e-49f7-bcf9-bc6b17008158 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:03.322349 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2c34d75-b29e-49f7-bcf9-bc6b17008158 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:03.325354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2c34d75-b29e-49f7-bcf9-bc6b17008158 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:03.326009 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2c34d75-b29e-49f7-bcf9-bc6b17008158 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:03.327422 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2c34d75-b29e-49f7-bcf9-bc6b17008158 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:03.330648 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2c34d75-b29e-49f7-bcf9-bc6b17008158 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:03.331317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2c34d75-b29e-49f7-bcf9-bc6b17008158 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:03.549575 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4eceb537-4abc-4d17-9233-4b7101864529 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:03.559848 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4eceb537-4abc-4d17-9233-4b7101864529 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:03.562444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4eceb537-4abc-4d17-9233-4b7101864529 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:03.564716 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4eceb537-4abc-4d17-9233-4b7101864529 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] 10.222.0.85 "GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630" status: 200 len: 1552 microversion: 2.21 time: 0.515871 Aug 24 10:26:03.565880 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1737/3155] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:26:03 2022] GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630 => generated 1552 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:26:03.570703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-df72287b-55f0-4e29-bb65-81d98773e707 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:03.571792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-df72287b-55f0-4e29-bb65-81d98773e707 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:03.590451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df72287b-55f0-4e29-bb65-81d98773e707 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:03.591133 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df72287b-55f0-4e29-bb65-81d98773e707 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:03.591998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df72287b-55f0-4e29-bb65-81d98773e707 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:03.593056 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df72287b-55f0-4e29-bb65-81d98773e707 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:03.593656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df72287b-55f0-4e29-bb65-81d98773e707 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:03.594375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df72287b-55f0-4e29-bb65-81d98773e707 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:03.815858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-df72287b-55f0-4e29-bb65-81d98773e707 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:03.826582 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-df72287b-55f0-4e29-bb65-81d98773e707 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1506 microversion: 2.1 time: 0.259483 Aug 24 10:26:03.828311 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1738/3156] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:03 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1506 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:03.834630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d7725865-a86e-458e-9d87-4a69568913a9 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:03.837608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d7725865-a86e-458e-9d87-4a69568913a9 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] [instance: 7b4d58bf-f4f2-408f-8609-82b6a528a630] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:03.847509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7725865-a86e-458e-9d87-4a69568913a9 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:03.848092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7725865-a86e-458e-9d87-4a69568913a9 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:03.848765 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7725865-a86e-458e-9d87-4a69568913a9 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:03.849750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7725865-a86e-458e-9d87-4a69568913a9 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:03.850579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7725865-a86e-458e-9d87-4a69568913a9 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:03.851083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7725865-a86e-458e-9d87-4a69568913a9 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:03.890621 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d7725865-a86e-458e-9d87-4a69568913a9 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] [instance: 7b4d58bf-f4f2-408f-8609-82b6a528a630] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:26:04.060939 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d7725865-a86e-458e-9d87-4a69568913a9 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] 10.222.0.85 "DELETE /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630" status: 204 len: 0 microversion: 2.21 time: 0.229490 Aug 24 10:26:04.067410 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1739/3157] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:26:03 2022] DELETE /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:26:04.079580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d482e12d-78d2-419b-b155-69a45b4b51fe tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:04.083106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d482e12d-78d2-419b-b155-69a45b4b51fe tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] [instance: 7b4d58bf-f4f2-408f-8609-82b6a528a630] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:04.104637 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d482e12d-78d2-419b-b155-69a45b4b51fe tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:04.105531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d482e12d-78d2-419b-b155-69a45b4b51fe tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:04.108972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d482e12d-78d2-419b-b155-69a45b4b51fe tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:04.110400 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d482e12d-78d2-419b-b155-69a45b4b51fe tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:04.111379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d482e12d-78d2-419b-b155-69a45b4b51fe tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:04.111948 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d482e12d-78d2-419b-b155-69a45b4b51fe tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:04.294645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f2c34d75-b29e-49f7-bcf9-bc6b17008158 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:04.307594 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f2c34d75-b29e-49f7-bcf9-bc6b17008158 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1314 microversion: 2.1 time: 1.015920 Aug 24 10:26:04.321886 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1419/3158] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:03 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1314 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:04.420737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d482e12d-78d2-419b-b155-69a45b4b51fe tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:04.433597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d482e12d-78d2-419b-b155-69a45b4b51fe tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:04.437080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d482e12d-78d2-419b-b155-69a45b4b51fe tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:04.440276 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d482e12d-78d2-419b-b155-69a45b4b51fe tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] 10.222.0.85 "GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630" status: 200 len: 1558 microversion: 2.21 time: 0.371105 Aug 24 10:26:04.446275 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1740/3159] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:26:04 2022] GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630 => generated 1558 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:26:04.854066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-33b409d1-2b4c-4d3a-8085-157adc20c53b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:04.855731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-33b409d1-2b4c-4d3a-8085-157adc20c53b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:04.881070 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33b409d1-2b4c-4d3a-8085-157adc20c53b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:04.882266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33b409d1-2b4c-4d3a-8085-157adc20c53b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:04.883391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33b409d1-2b4c-4d3a-8085-157adc20c53b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:04.884753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33b409d1-2b4c-4d3a-8085-157adc20c53b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:04.886389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33b409d1-2b4c-4d3a-8085-157adc20c53b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:04.888106 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33b409d1-2b4c-4d3a-8085-157adc20c53b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:05.154327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-33b409d1-2b4c-4d3a-8085-157adc20c53b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:05.178475 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-33b409d1-2b4c-4d3a-8085-157adc20c53b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1506 microversion: 2.1 time: 0.326685 Aug 24 10:26:05.182411 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1420/3160] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:04 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1506 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:05.331173 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8df45503-1e94-44c2-851c-81fe09ecfdf6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:05.331784 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8df45503-1e94-44c2-851c-81fe09ecfdf6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:05.352459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8df45503-1e94-44c2-851c-81fe09ecfdf6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:05.358242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8df45503-1e94-44c2-851c-81fe09ecfdf6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:05.361233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8df45503-1e94-44c2-851c-81fe09ecfdf6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:05.364208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8df45503-1e94-44c2-851c-81fe09ecfdf6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:05.366213 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8df45503-1e94-44c2-851c-81fe09ecfdf6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:05.371587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8df45503-1e94-44c2-851c-81fe09ecfdf6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:05.498534 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4ce7ceff-dc0f-4fd2-b57f-563cac00be50 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:05.499867 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4ce7ceff-dc0f-4fd2-b57f-563cac00be50 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] [instance: 7b4d58bf-f4f2-408f-8609-82b6a528a630] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:05.521241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ce7ceff-dc0f-4fd2-b57f-563cac00be50 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:05.523570 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ce7ceff-dc0f-4fd2-b57f-563cac00be50 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:05.530882 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ce7ceff-dc0f-4fd2-b57f-563cac00be50 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:05.531958 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ce7ceff-dc0f-4fd2-b57f-563cac00be50 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:05.532668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ce7ceff-dc0f-4fd2-b57f-563cac00be50 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:05.533376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ce7ceff-dc0f-4fd2-b57f-563cac00be50 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:05.596994 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:06.179151 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8df45503-1e94-44c2-851c-81fe09ecfdf6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:06.191886 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8df45503-1e94-44c2-851c-81fe09ecfdf6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1314 microversion: 2.1 time: 0.865202 Aug 24 10:26:06.192847 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1741/3161] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:05 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1314 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:06.211234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-622a9d60-4353-490b-82ef-71f40724d551 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:06.212144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-622a9d60-4353-490b-82ef-71f40724d551 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:06.228527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-622a9d60-4353-490b-82ef-71f40724d551 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:06.229441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-622a9d60-4353-490b-82ef-71f40724d551 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:06.230118 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-622a9d60-4353-490b-82ef-71f40724d551 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:06.231108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-622a9d60-4353-490b-82ef-71f40724d551 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:06.234972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-622a9d60-4353-490b-82ef-71f40724d551 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:06.235781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-622a9d60-4353-490b-82ef-71f40724d551 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:06.691278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4ce7ceff-dc0f-4fd2-b57f-563cac00be50 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:06.716696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4ce7ceff-dc0f-4fd2-b57f-563cac00be50 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:06.718585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4ce7ceff-dc0f-4fd2-b57f-563cac00be50 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:06.719907 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4ce7ceff-dc0f-4fd2-b57f-563cac00be50 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] 10.222.0.85 "GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630" status: 200 len: 1558 microversion: 2.21 time: 1.225946 Aug 24 10:26:06.720576 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1421/3162] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:26:05 2022] GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630 => generated 1558 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:26:06.941651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-622a9d60-4353-490b-82ef-71f40724d551 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:07.005751 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-622a9d60-4353-490b-82ef-71f40724d551 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1506 microversion: 2.1 time: 0.796135 Aug 24 10:26:07.007925 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1742/3163] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:06 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1506 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:26:07.224961 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e15b8d1f-ae9c-4af0-b70d-85265107626f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:07.229244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e15b8d1f-ae9c-4af0-b70d-85265107626f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:07.249340 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e15b8d1f-ae9c-4af0-b70d-85265107626f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:07.250490 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e15b8d1f-ae9c-4af0-b70d-85265107626f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:07.253647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e15b8d1f-ae9c-4af0-b70d-85265107626f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:07.256377 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e15b8d1f-ae9c-4af0-b70d-85265107626f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:07.257741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e15b8d1f-ae9c-4af0-b70d-85265107626f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:07.259308 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e15b8d1f-ae9c-4af0-b70d-85265107626f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:07.759506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e39fd615-5641-438a-8b9d-49e635e2db13 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:07.760264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e39fd615-5641-438a-8b9d-49e635e2db13 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] [instance: 7b4d58bf-f4f2-408f-8609-82b6a528a630] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:07.785391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e39fd615-5641-438a-8b9d-49e635e2db13 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:07.785899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e39fd615-5641-438a-8b9d-49e635e2db13 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:07.786341 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e39fd615-5641-438a-8b9d-49e635e2db13 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:07.787061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e39fd615-5641-438a-8b9d-49e635e2db13 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:07.787514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e39fd615-5641-438a-8b9d-49e635e2db13 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:07.791417 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e39fd615-5641-438a-8b9d-49e635e2db13 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:08.108172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e15b8d1f-ae9c-4af0-b70d-85265107626f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:08.146102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:08.162113 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e15b8d1f-ae9c-4af0-b70d-85265107626f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1502 microversion: 2.1 time: 0.945892 Aug 24 10:26:08.163185 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1422/3164] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:07 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1502 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:08.205469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b108dce6-975c-4b48-af69-db99986f0250 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:08.206602 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b108dce6-975c-4b48-af69-db99986f0250 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:08.231803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b108dce6-975c-4b48-af69-db99986f0250 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:08.234208 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b108dce6-975c-4b48-af69-db99986f0250 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:08.234856 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b108dce6-975c-4b48-af69-db99986f0250 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:08.240803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b108dce6-975c-4b48-af69-db99986f0250 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:08.243519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b108dce6-975c-4b48-af69-db99986f0250 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:08.246092 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b108dce6-975c-4b48-af69-db99986f0250 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:08.310553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e39fd615-5641-438a-8b9d-49e635e2db13 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:08.327788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e39fd615-5641-438a-8b9d-49e635e2db13 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:08.329688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e39fd615-5641-438a-8b9d-49e635e2db13 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:08.337364 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e39fd615-5641-438a-8b9d-49e635e2db13 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] 10.222.0.85 "GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630" status: 200 len: 1558 microversion: 2.21 time: 0.582171 Aug 24 10:26:08.342891 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1743/3165] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:26:07 2022] GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630 => generated 1558 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:26:08.348529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c5baa8b3-143f-4776-ae50-f919667bbec4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:08.358105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c5baa8b3-143f-4776-ae50-f919667bbec4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:08.375538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5baa8b3-143f-4776-ae50-f919667bbec4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:08.376064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5baa8b3-143f-4776-ae50-f919667bbec4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:08.376501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5baa8b3-143f-4776-ae50-f919667bbec4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:08.377262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5baa8b3-143f-4776-ae50-f919667bbec4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:08.377746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5baa8b3-143f-4776-ae50-f919667bbec4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:08.378190 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5baa8b3-143f-4776-ae50-f919667bbec4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:08.435228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-c5baa8b3-143f-4776-ae50-f919667bbec4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lazy-loading 'flavor' on Instance uuid 0fdab911-592d-4d21-9420-fdadfea05875 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:26:08.960416 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c5baa8b3-143f-4776-ae50-f919667bbec4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "POST /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875/action" status: 202 len: 0 microversion: 2.1 time: 0.615779 Aug 24 10:26:08.961903 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1744/3166] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:26:08 2022] POST /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875/action => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:26:08.985868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2f63671c-0572-47d1-848d-5e66fa2984a7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:08.989308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2f63671c-0572-47d1-848d-5e66fa2984a7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:09.013090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f63671c-0572-47d1-848d-5e66fa2984a7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:09.015902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f63671c-0572-47d1-848d-5e66fa2984a7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:09.016492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f63671c-0572-47d1-848d-5e66fa2984a7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:09.018111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f63671c-0572-47d1-848d-5e66fa2984a7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:09.022780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f63671c-0572-47d1-848d-5e66fa2984a7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:09.023623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f63671c-0572-47d1-848d-5e66fa2984a7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:09.393982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2f63671c-0572-47d1-848d-5e66fa2984a7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:09.405560 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2f63671c-0572-47d1-848d-5e66fa2984a7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1508 microversion: 2.1 time: 0.437178 Aug 24 10:26:09.412792 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1745/3167] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:08 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1508 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:26:09.422439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-805ba59d-31d4-4e57-ba5a-12f55b7ca83e tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:09.423080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-805ba59d-31d4-4e57-ba5a-12f55b7ca83e tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] [instance: 7b4d58bf-f4f2-408f-8609-82b6a528a630] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:09.437747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-805ba59d-31d4-4e57-ba5a-12f55b7ca83e tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:09.441274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-805ba59d-31d4-4e57-ba5a-12f55b7ca83e tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:09.442008 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-805ba59d-31d4-4e57-ba5a-12f55b7ca83e tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:09.443159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-805ba59d-31d4-4e57-ba5a-12f55b7ca83e tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:09.446576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-805ba59d-31d4-4e57-ba5a-12f55b7ca83e tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:09.447580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-805ba59d-31d4-4e57-ba5a-12f55b7ca83e tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:09.703130 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:10.197051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b108dce6-975c-4b48-af69-db99986f0250 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:10.206754 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b108dce6-975c-4b48-af69-db99986f0250 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1506 microversion: 2.1 time: 2.022915 Aug 24 10:26:10.223488 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1423/3168] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:08 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1506 bytes in 2060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:10.394797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-805ba59d-31d4-4e57-ba5a-12f55b7ca83e tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:10.428160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-805ba59d-31d4-4e57-ba5a-12f55b7ca83e tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:10.432078 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5fb7eea0-55c1-42a2-85cf-ceb3f1ed31fc tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:10.432773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5fb7eea0-55c1-42a2-85cf-ceb3f1ed31fc tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:10.435437 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-805ba59d-31d4-4e57-ba5a-12f55b7ca83e tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:10.439624 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-805ba59d-31d4-4e57-ba5a-12f55b7ca83e tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] 10.222.0.85 "GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630" status: 200 len: 1558 microversion: 2.21 time: 1.023175 Aug 24 10:26:10.442305 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1746/3169] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:26:09 2022] GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630 => generated 1558 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:26:10.470610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fb7eea0-55c1-42a2-85cf-ceb3f1ed31fc tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:10.471756 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fb7eea0-55c1-42a2-85cf-ceb3f1ed31fc tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:10.472552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fb7eea0-55c1-42a2-85cf-ceb3f1ed31fc tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:10.494408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fb7eea0-55c1-42a2-85cf-ceb3f1ed31fc tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:10.495612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fb7eea0-55c1-42a2-85cf-ceb3f1ed31fc tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:10.496691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fb7eea0-55c1-42a2-85cf-ceb3f1ed31fc tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:10.677084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-95d2beaf-0c9a-482b-9a43-6f4b7e755a6d tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Action: 'create', calling method: .version_select at 0x7f4647cc8a60>, body: {"keypair": {"name": "tempest-keypair-263898099", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPH/KeylCwxoQqfMxox8HItuTGfR54c8B23CjcILTps7JgQO++qPsHjKYdb+J8TT+yowvVrDQiYkjVziGjzShrtoETJfIDWDKXuV3/q1yOuV9KB3EQkTLHHi95umwMJU/A=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:10.742994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-95d2beaf-0c9a-482b-9a43-6f4b7e755a6d tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Getting quotas for project 3ace7124510e4aad905cbf22c7c77483. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:26:10.751262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-95d2beaf-0c9a-482b-9a43-6f4b7e755a6d tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Getting quotas for user 24ba82263a7d4ee79bc04be46db8227a and project 3ace7124510e4aad905cbf22c7c77483. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:26:10.835263 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-95d2beaf-0c9a-482b-9a43-6f4b7e755a6d tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.159570 Aug 24 10:26:10.840779 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1747/3170] 10.222.0.85 () {62 vars in 1200 bytes} [Wed Aug 24 10:26:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 169 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 24 10:26:11.266570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-33a7b6e7-d099-4709-8cab-17508c194a61 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:11.267190 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-33a7b6e7-d099-4709-8cab-17508c194a61 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:11.282599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33a7b6e7-d099-4709-8cab-17508c194a61 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:11.283419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33a7b6e7-d099-4709-8cab-17508c194a61 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:11.284174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33a7b6e7-d099-4709-8cab-17508c194a61 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:11.285419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33a7b6e7-d099-4709-8cab-17508c194a61 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:11.286208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33a7b6e7-d099-4709-8cab-17508c194a61 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:11.286918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33a7b6e7-d099-4709-8cab-17508c194a61 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:11.703436 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5fb7eea0-55c1-42a2-85cf-ceb3f1ed31fc tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:11.743748 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5fb7eea0-55c1-42a2-85cf-ceb3f1ed31fc tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1508 microversion: 2.1 time: 1.314981 Aug 24 10:26:11.746572 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1424/3171] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:10 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1508 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:11.764456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-5cf44e72-5265-4c7d-9e8c-321c7b8c34fe req-c37e4a8c-43da-476f-b8b2-abf5f33976ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b4d58bf-f4f2-408f-8609-82b6a528a630", "name": "network-vif-deleted", "tag": "2d5225b0-cc29-4199-a1e8-017af43894fb"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:11.798871 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5cf44e72-5265-4c7d-9e8c-321c7b8c34fe req-c37e4a8c-43da-476f-b8b2-abf5f33976ae service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:11.799526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5cf44e72-5265-4c7d-9e8c-321c7b8c34fe req-c37e4a8c-43da-476f-b8b2-abf5f33976ae service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:11.799966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5cf44e72-5265-4c7d-9e8c-321c7b8c34fe req-c37e4a8c-43da-476f-b8b2-abf5f33976ae service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:11.867528 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-5cf44e72-5265-4c7d-9e8c-321c7b8c34fe req-c37e4a8c-43da-476f-b8b2-abf5f33976ae service nova] Creating event network-vif-deleted:2d5225b0-cc29-4199-a1e8-017af43894fb for instance 7b4d58bf-f4f2-408f-8609-82b6a528a630 on n-h1-849328-3 Aug 24 10:26:11.889802 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-5cf44e72-5265-4c7d-9e8c-321c7b8c34fe req-c37e4a8c-43da-476f-b8b2-abf5f33976ae service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138975 Aug 24 10:26:11.893500 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1425/3172] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:11.905361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-97180614-c689-413a-8455-fcf3a6e5326c tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:11.912527 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-97180614-c689-413a-8455-fcf3a6e5326c tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] [instance: 7b4d58bf-f4f2-408f-8609-82b6a528a630] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:11.927908 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97180614-c689-413a-8455-fcf3a6e5326c tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:11.933589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97180614-c689-413a-8455-fcf3a6e5326c tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:11.935260 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97180614-c689-413a-8455-fcf3a6e5326c tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:11.955883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97180614-c689-413a-8455-fcf3a6e5326c tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:11.962058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97180614-c689-413a-8455-fcf3a6e5326c tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:11.967066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97180614-c689-413a-8455-fcf3a6e5326c tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:12.051919 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97180614-c689-413a-8455-fcf3a6e5326c tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:12.052910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97180614-c689-413a-8455-fcf3a6e5326c tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:12.054020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97180614-c689-413a-8455-fcf3a6e5326c tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:12.054917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-97180614-c689-413a-8455-fcf3a6e5326c tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lazy-loading 'fault' on Instance uuid 7b4d58bf-f4f2-408f-8609-82b6a528a630 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:26:12.066517 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-33a7b6e7-d099-4709-8cab-17508c194a61 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:12.083118 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-33a7b6e7-d099-4709-8cab-17508c194a61 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1506 microversion: 2.1 time: 0.819218 Aug 24 10:26:12.084344 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1748/3173] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:11 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1506 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:12.422822 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-97180614-c689-413a-8455-fcf3a6e5326c tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:12.453949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-97180614-c689-413a-8455-fcf3a6e5326c tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:12.461529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-97180614-c689-413a-8455-fcf3a6e5326c tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf2df6092dd24f33ab5ab4bd353547dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c359de3a762f414094f730a2d3ef2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:12.464885 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-97180614-c689-413a-8455-fcf3a6e5326c tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] 10.222.0.85 "GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630" status: 200 len: 1349 microversion: 2.21 time: 0.567022 Aug 24 10:26:12.470153 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1426/3174] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:26:11 2022] GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630 => generated 1349 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:26:12.778838 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1b7eeff3-d58d-46a1-b6d3-0e95e4bc04a9 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:12.780004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1b7eeff3-d58d-46a1-b6d3-0e95e4bc04a9 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:12.808511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b7eeff3-d58d-46a1-b6d3-0e95e4bc04a9 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:12.827775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b7eeff3-d58d-46a1-b6d3-0e95e4bc04a9 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:12.829633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b7eeff3-d58d-46a1-b6d3-0e95e4bc04a9 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:12.833316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b7eeff3-d58d-46a1-b6d3-0e95e4bc04a9 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:12.836895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b7eeff3-d58d-46a1-b6d3-0e95e4bc04a9 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:12.839851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b7eeff3-d58d-46a1-b6d3-0e95e4bc04a9 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:13.109051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-169c2ce7-feb2-4c94-83c3-aea16bf95750 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:13.111558 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-169c2ce7-feb2-4c94-83c3-aea16bf95750 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:13.124306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-169c2ce7-feb2-4c94-83c3-aea16bf95750 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:13.131957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-169c2ce7-feb2-4c94-83c3-aea16bf95750 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:13.132568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-169c2ce7-feb2-4c94-83c3-aea16bf95750 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:13.137611 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-169c2ce7-feb2-4c94-83c3-aea16bf95750 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:13.138491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-169c2ce7-feb2-4c94-83c3-aea16bf95750 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:13.139311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-169c2ce7-feb2-4c94-83c3-aea16bf95750 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:13.640339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1b7eeff3-d58d-46a1-b6d3-0e95e4bc04a9 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:13.676889 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1b7eeff3-d58d-46a1-b6d3-0e95e4bc04a9 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1508 microversion: 2.1 time: 0.906044 Aug 24 10:26:13.679071 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1749/3175] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:12 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1508 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:13.689813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c57b655b-69ff-4bd7-9b4f-ce3c010d2a7b tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:13.691167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c57b655b-69ff-4bd7-9b4f-ce3c010d2a7b tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] [instance: 7b4d58bf-f4f2-408f-8609-82b6a528a630] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:13.709784 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57b655b-69ff-4bd7-9b4f-ce3c010d2a7b tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:13.710921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57b655b-69ff-4bd7-9b4f-ce3c010d2a7b tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:13.711676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57b655b-69ff-4bd7-9b4f-ce3c010d2a7b tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:13.712597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57b655b-69ff-4bd7-9b4f-ce3c010d2a7b tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:13.713470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57b655b-69ff-4bd7-9b4f-ce3c010d2a7b tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:13.714085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57b655b-69ff-4bd7-9b4f-ce3c010d2a7b tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:13.735225 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-c57b655b-69ff-4bd7-9b4f-ce3c010d2a7b tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] HTTP exception thrown: Instance 7b4d58bf-f4f2-408f-8609-82b6a528a630 could not be found. Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c57b655b-69ff-4bd7-9b4f-ce3c010d2a7b tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Request method failure captured: Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630 HTTP/1.1 Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfyhFg_quD2L4_0sdZQx484_LLJvR1ZZjS9QafyZI9dw6Xye0NrABvyos7KTKcI2moHlnSbE-p_lsaOjPQf6wWeqmyANmDm0H9saaOaAsTjqEK9y7GLuuV1KNIAA4U_fx94RjK48iKtNHFIDg399ci269QN-y3okbnWK4vlUVsF71MA Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.21 Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: c359de3a762f414094f730a2d3ef2492 Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1370364106 Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c359de3a762f414094f730a2d3ef2492"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c359de3a762f414094f730a2d3ef2492", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c359de3a762f414094f730a2d3ef2492"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c359de3a762f414094f730a2d3ef2492"}]}] Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-InstanceActionsV221TestJSON-1370364106 Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: c359de3a762f414094f730a2d3ef2492 Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1370364106 Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-InstanceActionsV221TestJSON-1370364106-project Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: cf2df6092dd24f33ab5ab4bd353547dd Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-InstanceActionsV221TestJSON-1370364106-project Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 7b4d58bf-f4f2-408f-8609-82b6a528a630 could not be found. Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '7b4d58bf-f4f2-408f-8609-82b6a528a630'} Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b4d58bf-f4f2-408f-8609-82b6a528a630 could not be found. Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b4d58bf-f4f2-408f-8609-82b6a528a630 could not be found. Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:13.738655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:26:13.743906 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:13.743906 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:13.743906 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:26:13.743906 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:26:13.743906 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:26:13.743906 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:26:13.743906 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b4d58bf-f4f2-408f-8609-82b6a528a630 could not be found. Aug 24 10:26:13.743906 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:13.747278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c57b655b-69ff-4bd7-9b4f-ce3c010d2a7b tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Returning 404 to user: Instance 7b4d58bf-f4f2-408f-8609-82b6a528a630 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:26:13.748630 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c57b655b-69ff-4bd7-9b4f-ce3c010d2a7b tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] 10.222.0.85 "GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630" status: 404 len: 111 microversion: 2.21 time: 0.068030 Aug 24 10:26:13.749974 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1750/3176] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:26:13 2022] GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:26:13.759425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d45a0751-d141-4e41-b870-5f717b747ac1 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Calling method '.version_select at 0x7f4647c47e50>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:13.760081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d45a0751-d141-4e41-b870-5f717b747ac1 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] [instance: 7b4d58bf-f4f2-408f-8609-82b6a528a630] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:13.766839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d45a0751-d141-4e41-b870-5f717b747ac1 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:13.767628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d45a0751-d141-4e41-b870-5f717b747ac1 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:13.768233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d45a0751-d141-4e41-b870-5f717b747ac1 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:13.769152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d45a0751-d141-4e41-b870-5f717b747ac1 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:13.769786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d45a0751-d141-4e41-b870-5f717b747ac1 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:13.770383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d45a0751-d141-4e41-b870-5f717b747ac1 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:13.834160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:13.852621 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d45a0751-d141-4e41-b870-5f717b747ac1 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] 10.222.0.85 "GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.098463 Aug 24 10:26:13.866530 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1751/3177] 10.222.0.85 () {60 vars in 1337 bytes} [Wed Aug 24 10:26:13 2022] GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630/os-instance-actions => generated 611 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 10:26:13.872815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1e501b4a-1870-46e4-8bdb-09cb0cc1e97e tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:13.873599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1e501b4a-1870-46e4-8bdb-09cb0cc1e97e tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] [instance: 7b4d58bf-f4f2-408f-8609-82b6a528a630] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:13.879926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e501b4a-1870-46e4-8bdb-09cb0cc1e97e tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:13.880683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e501b4a-1870-46e4-8bdb-09cb0cc1e97e tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:13.881349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e501b4a-1870-46e4-8bdb-09cb0cc1e97e tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:13.882820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e501b4a-1870-46e4-8bdb-09cb0cc1e97e tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:13.883462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e501b4a-1870-46e4-8bdb-09cb0cc1e97e tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:13.884043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e501b4a-1870-46e4-8bdb-09cb0cc1e97e tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:13.902404 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-1e501b4a-1870-46e4-8bdb-09cb0cc1e97e tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] HTTP exception thrown: Instance 7b4d58bf-f4f2-408f-8609-82b6a528a630 could not be found. Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1e501b4a-1870-46e4-8bdb-09cb0cc1e97e tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Request method failure captured: Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630 HTTP/1.1 Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfyhFg_quD2L4_0sdZQx484_LLJvR1ZZjS9QafyZI9dw6Xye0NrABvyos7KTKcI2moHlnSbE-p_lsaOjPQf6wWeqmyANmDm0H9saaOaAsTjqEK9y7GLuuV1KNIAA4U_fx94RjK48iKtNHFIDg399ci269QN-y3okbnWK4vlUVsF71MA Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.21 Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: c359de3a762f414094f730a2d3ef2492 Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1370364106 Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c359de3a762f414094f730a2d3ef2492"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c359de3a762f414094f730a2d3ef2492", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c359de3a762f414094f730a2d3ef2492"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c359de3a762f414094f730a2d3ef2492"}]}] Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-InstanceActionsV221TestJSON-1370364106 Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: c359de3a762f414094f730a2d3ef2492 Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1370364106 Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-InstanceActionsV221TestJSON-1370364106-project Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: cf2df6092dd24f33ab5ab4bd353547dd Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-InstanceActionsV221TestJSON-1370364106-project Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 7b4d58bf-f4f2-408f-8609-82b6a528a630 could not be found. Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '7b4d58bf-f4f2-408f-8609-82b6a528a630'} Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b4d58bf-f4f2-408f-8609-82b6a528a630 could not be found. Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:26:13.904167 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:26:13.908651 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b4d58bf-f4f2-408f-8609-82b6a528a630 could not be found. Aug 24 10:26:13.908651 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:13.908651 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:26:13.908651 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:13.908651 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:13.908651 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:26:13.908651 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:26:13.908651 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:26:13.908651 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:26:13.908651 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b4d58bf-f4f2-408f-8609-82b6a528a630 could not be found. Aug 24 10:26:13.908651 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:13.910309 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1e501b4a-1870-46e4-8bdb-09cb0cc1e97e tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Returning 404 to user: Instance 7b4d58bf-f4f2-408f-8609-82b6a528a630 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:26:13.911330 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1e501b4a-1870-46e4-8bdb-09cb0cc1e97e tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] 10.222.0.85 "DELETE /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630" status: 404 len: 111 microversion: 2.21 time: 0.043488 Aug 24 10:26:13.915430 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1752/3178] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:26:13 2022] DELETE /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:26:13.920879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ad860c4-940f-4a5d-a934-ced67373fec4 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:13.921747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3ad860c4-940f-4a5d-a934-ced67373fec4 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] [instance: 7b4d58bf-f4f2-408f-8609-82b6a528a630] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:13.928387 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ad860c4-940f-4a5d-a934-ced67373fec4 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:13.929066 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ad860c4-940f-4a5d-a934-ced67373fec4 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:13.929745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ad860c4-940f-4a5d-a934-ced67373fec4 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:13.930658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ad860c4-940f-4a5d-a934-ced67373fec4 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:13.931561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ad860c4-940f-4a5d-a934-ced67373fec4 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:13.932189 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ad860c4-940f-4a5d-a934-ced67373fec4 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:13.949744 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-3ad860c4-940f-4a5d-a934-ced67373fec4 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] HTTP exception thrown: Instance 7b4d58bf-f4f2-408f-8609-82b6a528a630 could not be found. Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ad860c4-940f-4a5d-a934-ced67373fec4 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Request method failure captured: Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630 HTTP/1.1 Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfyhFg_quD2L4_0sdZQx484_LLJvR1ZZjS9QafyZI9dw6Xye0NrABvyos7KTKcI2moHlnSbE-p_lsaOjPQf6wWeqmyANmDm0H9saaOaAsTjqEK9y7GLuuV1KNIAA4U_fx94RjK48iKtNHFIDg399ci269QN-y3okbnWK4vlUVsF71MA Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.21 Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: c359de3a762f414094f730a2d3ef2492 Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1370364106 Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c359de3a762f414094f730a2d3ef2492"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c359de3a762f414094f730a2d3ef2492", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c359de3a762f414094f730a2d3ef2492"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c359de3a762f414094f730a2d3ef2492"}]}] Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-InstanceActionsV221TestJSON-1370364106 Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: c359de3a762f414094f730a2d3ef2492 Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1370364106 Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-InstanceActionsV221TestJSON-1370364106-project Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: cf2df6092dd24f33ab5ab4bd353547dd Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-InstanceActionsV221TestJSON-1370364106-project Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 7b4d58bf-f4f2-408f-8609-82b6a528a630 could not be found. Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '7b4d58bf-f4f2-408f-8609-82b6a528a630'} Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b4d58bf-f4f2-408f-8609-82b6a528a630 could not be found. Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b4d58bf-f4f2-408f-8609-82b6a528a630 could not be found. Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:13.951615 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:26:13.956290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:13.956290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:13.956290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:26:13.956290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:26:13.956290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:26:13.956290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:26:13.956290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b4d58bf-f4f2-408f-8609-82b6a528a630 could not be found. Aug 24 10:26:13.956290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:13.957681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ad860c4-940f-4a5d-a934-ced67373fec4 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] Returning 404 to user: Instance 7b4d58bf-f4f2-408f-8609-82b6a528a630 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:26:13.958795 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ad860c4-940f-4a5d-a934-ced67373fec4 tempest-InstanceActionsV221TestJSON-1370364106 tempest-InstanceActionsV221TestJSON-1370364106-project] 10.222.0.85 "GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630" status: 404 len: 111 microversion: 2.21 time: 0.042061 Aug 24 10:26:13.963598 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1753/3179] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:26:13 2022] GET /compute/v2.1/servers/7b4d58bf-f4f2-408f-8609-82b6a528a630 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:26:14.136797 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-169c2ce7-feb2-4c94-83c3-aea16bf95750 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:14.157801 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-169c2ce7-feb2-4c94-83c3-aea16bf95750 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1506 microversion: 2.1 time: 1.057511 Aug 24 10:26:14.161712 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1427/3180] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:13 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1506 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:14.700802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-45a1ff73-4c39-48b8-beb7-880bff74c76c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:14.704225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-45a1ff73-4c39-48b8-beb7-880bff74c76c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:14.714514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45a1ff73-4c39-48b8-beb7-880bff74c76c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:14.715489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45a1ff73-4c39-48b8-beb7-880bff74c76c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:14.716416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45a1ff73-4c39-48b8-beb7-880bff74c76c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:14.717198 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45a1ff73-4c39-48b8-beb7-880bff74c76c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:14.717675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45a1ff73-4c39-48b8-beb7-880bff74c76c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:14.718262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45a1ff73-4c39-48b8-beb7-880bff74c76c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:14.998614 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-45a1ff73-4c39-48b8-beb7-880bff74c76c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:15.016233 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-45a1ff73-4c39-48b8-beb7-880bff74c76c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1508 microversion: 2.1 time: 0.318430 Aug 24 10:26:15.031296 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1754/3181] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:14 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1508 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:15.195121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b9122f3b-715a-4d5c-a16e-bf26825cacd8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:15.196351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b9122f3b-715a-4d5c-a16e-bf26825cacd8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:15.204650 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9122f3b-715a-4d5c-a16e-bf26825cacd8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:15.208268 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9122f3b-715a-4d5c-a16e-bf26825cacd8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:15.208999 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9122f3b-715a-4d5c-a16e-bf26825cacd8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:15.210735 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9122f3b-715a-4d5c-a16e-bf26825cacd8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:15.213720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9122f3b-715a-4d5c-a16e-bf26825cacd8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:15.214430 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9122f3b-715a-4d5c-a16e-bf26825cacd8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:15.947915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b9122f3b-715a-4d5c-a16e-bf26825cacd8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:15.947915 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b9122f3b-715a-4d5c-a16e-bf26825cacd8 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1506 microversion: 2.1 time: 0.716752 Aug 24 10:26:15.947915 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1428/3182] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:15 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1506 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:16.039999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c1c72d86-af3c-48b7-9df0-e23d3660ac49 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:16.041387 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c1c72d86-af3c-48b7-9df0-e23d3660ac49 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:16.057029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1c72d86-af3c-48b7-9df0-e23d3660ac49 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:16.063142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1c72d86-af3c-48b7-9df0-e23d3660ac49 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:16.065291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1c72d86-af3c-48b7-9df0-e23d3660ac49 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:16.068038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1c72d86-af3c-48b7-9df0-e23d3660ac49 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:16.068760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1c72d86-af3c-48b7-9df0-e23d3660ac49 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:16.069636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1c72d86-af3c-48b7-9df0-e23d3660ac49 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:16.559000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c1c72d86-af3c-48b7-9df0-e23d3660ac49 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:16.582694 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c1c72d86-af3c-48b7-9df0-e23d3660ac49 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1508 microversion: 2.1 time: 0.548926 Aug 24 10:26:16.593412 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1755/3183] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:16 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1508 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:16.971137 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-44e5d3d0-c264-43e9-93a2-ea8a7bcef0a2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:16.972939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-44e5d3d0-c264-43e9-93a2-ea8a7bcef0a2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:17.012575 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44e5d3d0-c264-43e9-93a2-ea8a7bcef0a2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:17.012995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44e5d3d0-c264-43e9-93a2-ea8a7bcef0a2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:17.013486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44e5d3d0-c264-43e9-93a2-ea8a7bcef0a2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:17.014247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44e5d3d0-c264-43e9-93a2-ea8a7bcef0a2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:17.014857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44e5d3d0-c264-43e9-93a2-ea8a7bcef0a2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:17.015117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44e5d3d0-c264-43e9-93a2-ea8a7bcef0a2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:17.619652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fe7be265-775e-4987-99d3-2198dc0e7894 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:17.632658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fe7be265-775e-4987-99d3-2198dc0e7894 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:17.648260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe7be265-775e-4987-99d3-2198dc0e7894 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:17.649687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe7be265-775e-4987-99d3-2198dc0e7894 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:17.659333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe7be265-775e-4987-99d3-2198dc0e7894 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:17.662058 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe7be265-775e-4987-99d3-2198dc0e7894 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:17.662592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe7be265-775e-4987-99d3-2198dc0e7894 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:17.663041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe7be265-775e-4987-99d3-2198dc0e7894 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:17.966192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fe7be265-775e-4987-99d3-2198dc0e7894 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:17.979379 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fe7be265-775e-4987-99d3-2198dc0e7894 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1508 microversion: 2.1 time: 0.377311 Aug 24 10:26:17.995252 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1756/3184] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:17 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1508 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:18.663479 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-44e5d3d0-c264-43e9-93a2-ea8a7bcef0a2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:18.675651 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-44e5d3d0-c264-43e9-93a2-ea8a7bcef0a2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1506 microversion: 2.1 time: 1.710269 Aug 24 10:26:18.679109 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1429/3185] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:16 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1506 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:18.912637 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b647b0f2-bbb0-4ca4-bfdc-7e35d9bc38af tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Action: 'create', calling method: .version_select at 0x7f4647c47ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1887881271", "description": "tempest-description-1876053106"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:19.003446 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-63cfcebb-f936-4afe-b065-c7add317f17b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:19.004778 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-63cfcebb-f936-4afe-b065-c7add317f17b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:19.015713 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63cfcebb-f936-4afe-b065-c7add317f17b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:19.020578 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63cfcebb-f936-4afe-b065-c7add317f17b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:19.022726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63cfcebb-f936-4afe-b065-c7add317f17b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:19.025489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63cfcebb-f936-4afe-b065-c7add317f17b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:19.031765 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63cfcebb-f936-4afe-b065-c7add317f17b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:19.033526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63cfcebb-f936-4afe-b065-c7add317f17b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:19.312974 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b647b0f2-bbb0-4ca4-bfdc-7e35d9bc38af tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] 10.222.0.85 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.613226 Aug 24 10:26:19.322928 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1757/3186] 10.222.0.85 () {60 vars in 1180 bytes} [Wed Aug 24 10:26:18 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:19.328952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-46a4e445-7346-4e23-b5c4-f6bf838d9292 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Action: 'create', calling method: .version_select at 0x7f4647ca3040>, body: {"security_group_rule": {"parent_group_id": "a0f92d4d-d840-469f-bbbc-43659b54b0ed", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:19.816651 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-63cfcebb-f936-4afe-b065-c7add317f17b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:19.824951 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-63cfcebb-f936-4afe-b065-c7add317f17b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1508 microversion: 2.1 time: 0.825472 Aug 24 10:26:19.836401 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1430/3187] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:18 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1508 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:26:19.856187 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2ad1fb07-21d7-4fc7-a3a1-12b9a771f497 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-849250634", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f4a2e723-b38d-4b8d-83c6-e7daca7b4f6e"}, {"port": "0a936ebf-bd84-48ce-b0c2-fac98f570a10", "tag": "port-1"}, {"port": "fa4b74d3-c905-4fde-af3d-45c9f745c900", "tag": "port-2"}, {"uuid": "726195bc-49b2-46d6-a95e-a7b32557ef2a", "tag": "net-1"}, {"uuid": "726195bc-49b2-46d6-a95e-a7b32557ef2a"}, {"uuid": "19c74655-5107-4f7f-a6f1-2e06462fcd32", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "19c74655-5107-4f7f-a6f1-2e06462fcd32", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "55a1c132-474f-4988-888c-f31db47f5251", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "b9c6daf2-cb72-41d6-88a5-786630d968f8", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "39c9feef-3b23-4cd9-96ee-f9a4054e22b4", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1937402477"}], "key_name": "tempest-keypair-263898099", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:19.866084 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-46a4e445-7346-4e23-b5c4-f6bf838d9292 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] 10.222.0.85 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.541452 Aug 24 10:26:19.866935 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1758/3188] 10.222.0.85 () {60 vars in 1195 bytes} [Wed Aug 24 10:26:19 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:19.880103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b1db804c-475c-4c46-91fc-615d1805ace0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:19.880972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b1db804c-475c-4c46-91fc-615d1805ace0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:19.918745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1db804c-475c-4c46-91fc-615d1805ace0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:19.919456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1db804c-475c-4c46-91fc-615d1805ace0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:19.919686 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1db804c-475c-4c46-91fc-615d1805ace0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:19.920377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1db804c-475c-4c46-91fc-615d1805ace0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:19.920833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1db804c-475c-4c46-91fc-615d1805ace0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:19.921292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1db804c-475c-4c46-91fc-615d1805ace0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:20.240977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b1db804c-475c-4c46-91fc-615d1805ace0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:20.252753 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b1db804c-475c-4c46-91fc-615d1805ace0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1506 microversion: 2.1 time: 0.376812 Aug 24 10:26:20.254202 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1759/3189] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:19 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:20.293636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-128e4b60-0e41-45a1-94ba-01fd7eb6ae51 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Action: 'create', calling method: .version_select at 0x7f4647cafb80>, body: {"security_group_rule": {"parent_group_id": "a0f92d4d-d840-469f-bbbc-43659b54b0ed", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:20.400754 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-128e4b60-0e41-45a1-94ba-01fd7eb6ae51 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] HTTP exception thrown: This rule already exists in group a0f92d4d-d840-469f-bbbc-43659b54b0ed Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-128e4b60-0e41-45a1-94ba-01fd7eb6ae51 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Request method failure captured: Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 138 Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfzKbKP7PhaMW1yZO3sC47aDhI3wYtfEnzZiWGShJ-rNLm-flsZ4CN6jmLDDkgu3oZyfqOMEDYtXxToK_luonLboXoxH1OXWEDD1wmK5Va30Palm1mB1VxPhCWjMCXl0Ym_6dLepw2XGu597ZDBs8BiHL6pWUQNy9i-3CamYb-dSnPc Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 6350b412ae2f420f888b8c9f250d7fb2 Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-164387724 Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6350b412ae2f420f888b8c9f250d7fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6350b412ae2f420f888b8c9f250d7fb2", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6350b412ae2f420f888b8c9f250d7fb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6350b412ae2f420f888b8c9f250d7fb2"}]}] Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-164387724 Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 6350b412ae2f420f888b8c9f250d7fb2 Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-164387724 Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-164387724-project Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 10e7e3c31acd4216a4c099979ee025a1 Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-164387724-project Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: {"security_group_rule": {"parent_group_id": "a0f92d4d-d840-469f-bbbc-43659b54b0ed", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: exception: This rule already exists in group a0f92d4d-d840-469f-bbbc-43659b54b0ed Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a0f92d4d-d840-469f-bbbc-43659b54b0ed', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group a0f92d4d-d840-469f-bbbc-43659b54b0ed Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group a0f92d4d-d840-469f-bbbc-43659b54b0ed Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:26:20.402360 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:26:20.406824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:26:20.406824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:26:20.406824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group a0f92d4d-d840-469f-bbbc-43659b54b0ed Aug 24 10:26:20.406824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:20.406824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-128e4b60-0e41-45a1-94ba-01fd7eb6ae51 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Returning 400 to user: This rule already exists in group a0f92d4d-d840-469f-bbbc-43659b54b0ed {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:26:20.406824 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-128e4b60-0e41-45a1-94ba-01fd7eb6ae51 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] 10.222.0.85 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.148515 Aug 24 10:26:20.407954 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1760/3190] 10.222.0.85 () {60 vars in 1195 bytes} [Wed Aug 24 10:26:20 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:26:20.415253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a8a68695-9ed1-4d3c-9075-998be0fed02b tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Calling method '.version_select at 0x7f4647ca3f70>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:20.529205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-2ad1fb07-21d7-4fc7-a3a1-12b9a771f497 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] validate_networks() for [('f4a2e723-b38d-4b8d-83c6-e7daca7b4f6e', None, None, None, None, None), (None, None, '0a936ebf-bd84-48ce-b0c2-fac98f570a10', None, None, None), (None, None, 'fa4b74d3-c905-4fde-af3d-45c9f745c900', None, None, None), ('726195bc-49b2-46d6-a95e-a7b32557ef2a', None, None, None, None, None), ('726195bc-49b2-46d6-a95e-a7b32557ef2a', None, None, None, None, None), ('19c74655-5107-4f7f-a6f1-2e06462fcd32', '10.2.2.100', None, None, None, None), ('19c74655-5107-4f7f-a6f1-2e06462fcd32', '10.2.2.200', None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:26:20.770730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:20.785437 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a8a68695-9ed1-4d3c-9075-998be0fed02b tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-group-rules/0bc90ee6-a938-437d-9de5-ad0d931746fb" status: 202 len: 0 microversion: 2.1 time: 0.376321 Aug 24 10:26:20.786710 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1761/3191] 10.222.0.85 () {58 vars in 1287 bytes} [Wed Aug 24 10:26:20 2022] DELETE /compute/v2.1/os-security-group-rules/0bc90ee6-a938-437d-9de5-ad0d931746fb => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:26:20.799462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d2383311-3834-41da-8f63-e77a9635e600 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Action: 'create', calling method: .version_select at 0x7f4647c47c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1659915789", "description": "tempest-description-1902921414"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:21.203508 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d2383311-3834-41da-8f63-e77a9635e600 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] 10.222.0.85 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.408993 Aug 24 10:26:21.205487 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1762/3192] 10.222.0.85 () {60 vars in 1180 bytes} [Wed Aug 24 10:26:20 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:21.220894 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-56af664c-d8fc-4528-a260-4750f7d196f0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:21.221930 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-56af664c-d8fc-4528-a260-4750f7d196f0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:21.233825 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56af664c-d8fc-4528-a260-4750f7d196f0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:21.234982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56af664c-d8fc-4528-a260-4750f7d196f0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:21.236714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56af664c-d8fc-4528-a260-4750f7d196f0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:21.250073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56af664c-d8fc-4528-a260-4750f7d196f0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:21.250673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56af664c-d8fc-4528-a260-4750f7d196f0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:21.251216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56af664c-d8fc-4528-a260-4750f7d196f0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:21.599780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-56af664c-d8fc-4528-a260-4750f7d196f0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:21.622268 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-56af664c-d8fc-4528-a260-4750f7d196f0 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1508 microversion: 2.1 time: 0.413583 Aug 24 10:26:21.625298 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1763/3193] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:21 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1508 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:21.677698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7d36d5c9-82a2-42cb-b97b-893efbbf8994 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Action: 'create', calling method: .version_select at 0x7f4647bff1f0>, body: {"security_group_rule": {"parent_group_id": "8cc80101-1550-4a7b-83f5-b8af222f3a63", "ip_protocol": "tcp", "from_port": 1271915984, "to_port": 22}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:21.775244 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-7d36d5c9-82a2-42cb-b97b-893efbbf8994 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] HTTP exception thrown: Invalid port range 1271915984:22. Former value cannot be greater than the later Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7d36d5c9-82a2-42cb-b97b-893efbbf8994 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Request method failure captured: Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 146 Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfzKbKP7PhaMW1yZO3sC47aDhI3wYtfEnzZiWGShJ-rNLm-flsZ4CN6jmLDDkgu3oZyfqOMEDYtXxToK_luonLboXoxH1OXWEDD1wmK5Va30Palm1mB1VxPhCWjMCXl0Ym_6dLepw2XGu597ZDBs8BiHL6pWUQNy9i-3CamYb-dSnPc Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 6350b412ae2f420f888b8c9f250d7fb2 Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-164387724 Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6350b412ae2f420f888b8c9f250d7fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6350b412ae2f420f888b8c9f250d7fb2", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6350b412ae2f420f888b8c9f250d7fb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6350b412ae2f420f888b8c9f250d7fb2"}]}] Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-164387724 Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 6350b412ae2f420f888b8c9f250d7fb2 Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-164387724 Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-164387724-project Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 10e7e3c31acd4216a4c099979ee025a1 Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-164387724-project Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: {"security_group_rule": {"parent_group_id": "8cc80101-1550-4a7b-83f5-b8af222f3a63", "ip_protocol": "tcp", "from_port": 1271915984, "to_port": 22}} Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: exception: Invalid port range 1271915984:22. Former value cannot be greater than the later Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8cc80101-1550-4a7b-83f5-b8af222f3a63', 'ip_protocol': 'tcp', 'from_port': 1271915984, 'to_port': 22}}} Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1271915984:22. Former value cannot be greater than the later Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1271915984:22. Former value cannot be greater than the later Aug 24 10:26:21.777696 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:21.781898 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:26:21.781898 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:21.781898 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:21.781898 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:26:21.781898 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:26:21.781898 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:26:21.781898 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:26:21.781898 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1271915984:22. Former value cannot be greater than the later Aug 24 10:26:21.781898 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:21.795429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7d36d5c9-82a2-42cb-b97b-893efbbf8994 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Returning 400 to user: Invalid port range 1271915984:22. Former value cannot be greater than the later {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:26:21.797490 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7d36d5c9-82a2-42cb-b97b-893efbbf8994 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] 10.222.0.85 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.142757 Aug 24 10:26:21.798418 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1764/3194] 10.222.0.85 () {60 vars in 1195 bytes} [Wed Aug 24 10:26:21 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:26:21.803908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9dd6774b-6e8c-4520-bd72-3ecf310a38e0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:21.804988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9dd6774b-6e8c-4520-bd72-3ecf310a38e0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:21.815935 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9dd6774b-6e8c-4520-bd72-3ecf310a38e0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:21.816612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9dd6774b-6e8c-4520-bd72-3ecf310a38e0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:21.817247 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9dd6774b-6e8c-4520-bd72-3ecf310a38e0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:21.818158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9dd6774b-6e8c-4520-bd72-3ecf310a38e0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:21.818782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9dd6774b-6e8c-4520-bd72-3ecf310a38e0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:21.819771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9dd6774b-6e8c-4520-bd72-3ecf310a38e0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:22.030724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9dd6774b-6e8c-4520-bd72-3ecf310a38e0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:22.041808 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9dd6774b-6e8c-4520-bd72-3ecf310a38e0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1506 microversion: 2.1 time: 0.240576 Aug 24 10:26:22.043247 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1765/3195] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:21 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1506 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:22.063715 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-81adc56c-e756-4f60-ad4e-ee7032d02f78 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Action: 'create', calling method: .version_select at 0x7f4647cafb80>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1617266023", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:22.066652 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-81adc56c-e756-4f60-ad4e-ee7032d02f78 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] HTTP exception thrown: Security group id should be uuid Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-81adc56c-e756-4f60-ad4e-ee7032d02f78 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Request method failure captured: Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 131 Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfzKbKP7PhaMW1yZO3sC47aDhI3wYtfEnzZiWGShJ-rNLm-flsZ4CN6jmLDDkgu3oZyfqOMEDYtXxToK_luonLboXoxH1OXWEDD1wmK5Va30Palm1mB1VxPhCWjMCXl0Ym_6dLepw2XGu597ZDBs8BiHL6pWUQNy9i-3CamYb-dSnPc Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 6350b412ae2f420f888b8c9f250d7fb2 Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-164387724 Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6350b412ae2f420f888b8c9f250d7fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6350b412ae2f420f888b8c9f250d7fb2", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6350b412ae2f420f888b8c9f250d7fb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6350b412ae2f420f888b8c9f250d7fb2"}]}] Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-164387724 Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 6350b412ae2f420f888b8c9f250d7fb2 Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-164387724 Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-164387724-project Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 10e7e3c31acd4216a4c099979ee025a1 Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-164387724-project Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1617266023", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: exception: Security group id should be uuid Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1617266023', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:26:22.068536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:26:22.073602 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 24 10:26:22.073602 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:22.075088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-81adc56c-e756-4f60-ad4e-ee7032d02f78 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Returning 400 to user: Security group id should be uuid {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:26:22.076317 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-81adc56c-e756-4f60-ad4e-ee7032d02f78 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] 10.222.0.85 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.031769 Aug 24 10:26:22.077093 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1766/3196] 10.222.0.85 () {60 vars in 1195 bytes} [Wed Aug 24 10:26:22 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 10:26:22.087109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2e22eff4-8fd1-4e83-b064-eaf7348c13bf tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Action: 'create', calling method: .version_select at 0x7f4647c4adc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-128905302", "description": "tempest-description-1444323555"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:22.320586 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2e22eff4-8fd1-4e83-b064-eaf7348c13bf tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] 10.222.0.85 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.236605 Aug 24 10:26:22.322902 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1767/3197] 10.222.0.85 () {60 vars in 1180 bytes} [Wed Aug 24 10:26:22 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:26:22.342571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7dbbacfd-776c-4775-85d6-b52b056a2949 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Action: 'create', calling method: .version_select at 0x7f4647c26f70>, body: {"security_group_rule": {"parent_group_id": "4a165d82-27b0-459c-ba1b-b8b8c804fe3d", "ip_protocol": "tempest-999-96254536", "from_port": 22, "to_port": 22}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:22.423041 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-7dbbacfd-776c-4775-85d6-b52b056a2949 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] HTTP exception thrown: Invalid IP protocol tempest-999-96254536. Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7dbbacfd-776c-4775-85d6-b52b056a2949 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Request method failure captured: Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 155 Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfzKbKP7PhaMW1yZO3sC47aDhI3wYtfEnzZiWGShJ-rNLm-flsZ4CN6jmLDDkgu3oZyfqOMEDYtXxToK_luonLboXoxH1OXWEDD1wmK5Va30Palm1mB1VxPhCWjMCXl0Ym_6dLepw2XGu597ZDBs8BiHL6pWUQNy9i-3CamYb-dSnPc Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 6350b412ae2f420f888b8c9f250d7fb2 Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-164387724 Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6350b412ae2f420f888b8c9f250d7fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6350b412ae2f420f888b8c9f250d7fb2", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6350b412ae2f420f888b8c9f250d7fb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6350b412ae2f420f888b8c9f250d7fb2"}]}] Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-164387724 Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 6350b412ae2f420f888b8c9f250d7fb2 Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-164387724 Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-164387724-project Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 10e7e3c31acd4216a4c099979ee025a1 Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-164387724-project Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: {"security_group_rule": {"parent_group_id": "4a165d82-27b0-459c-ba1b-b8b8c804fe3d", "ip_protocol": "tempest-999-96254536", "from_port": 22, "to_port": 22}} Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: exception: Invalid IP protocol tempest-999-96254536. Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4a165d82-27b0-459c-ba1b-b8b8c804fe3d', 'ip_protocol': 'tempest-999-96254536', 'from_port': 22, 'to_port': 22}}} Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-96254536. Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-96254536. Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:22.424774 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:26:22.430210 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:22.430210 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:22.430210 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:26:22.430210 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:26:22.430210 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:26:22.430210 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:26:22.430210 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-96254536. Aug 24 10:26:22.430210 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:22.430210 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7dbbacfd-776c-4775-85d6-b52b056a2949 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Returning 400 to user: Invalid IP protocol tempest-999-96254536. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:26:22.430210 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7dbbacfd-776c-4775-85d6-b52b056a2949 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] 10.222.0.85 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 85 microversion: 2.1 time: 0.091577 Aug 24 10:26:22.430210 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1768/3198] 10.222.0.85 () {60 vars in 1195 bytes} [Wed Aug 24 10:26:22 2022] POST /compute/v2.1/os-security-group-rules => generated 85 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 10:26:22.438696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-da967d5f-c7e8-4fff-8e73-d1d0dc859f74 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Action: 'create', calling method: .version_select at 0x7f4647c26430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1021792909", "description": "tempest-description-629867215"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:22.699033 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-da967d5f-c7e8-4fff-8e73-d1d0dc859f74 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] 10.222.0.85 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.264237 Aug 24 10:26:22.699982 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1769/3199] 10.222.0.85 () {60 vars in 1180 bytes} [Wed Aug 24 10:26:22 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:26:22.705648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6d88846c-61b4-46e1-a4bc-fd2f88547865 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:22.706592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6d88846c-61b4-46e1-a4bc-fd2f88547865 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:22.732575 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d88846c-61b4-46e1-a4bc-fd2f88547865 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:22.733075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d88846c-61b4-46e1-a4bc-fd2f88547865 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:22.733546 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d88846c-61b4-46e1-a4bc-fd2f88547865 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:22.734271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d88846c-61b4-46e1-a4bc-fd2f88547865 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:22.735368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d88846c-61b4-46e1-a4bc-fd2f88547865 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:22.736085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d88846c-61b4-46e1-a4bc-fd2f88547865 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:23.027720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6d88846c-61b4-46e1-a4bc-fd2f88547865 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:23.044488 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6d88846c-61b4-46e1-a4bc-fd2f88547865 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1508 microversion: 2.1 time: 0.338946 Aug 24 10:26:23.045483 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1770/3200] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:22 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1508 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:23.059808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f3bb8240-d58f-4009-a937-7864ca7a82cb tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Action: 'create', calling method: .version_select at 0x7f4647c18550>, body: {"security_group_rule": {"parent_group_id": "a77d8cb9-03fd-418f-b958-3174700ee1c2", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:23.142327 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-f3bb8240-d58f-4009-a937-7864ca7a82cb tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f3bb8240-d58f-4009-a937-7864ca7a82cb tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Request method failure captured: Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 138 Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfzKbKP7PhaMW1yZO3sC47aDhI3wYtfEnzZiWGShJ-rNLm-flsZ4CN6jmLDDkgu3oZyfqOMEDYtXxToK_luonLboXoxH1OXWEDD1wmK5Va30Palm1mB1VxPhCWjMCXl0Ym_6dLepw2XGu597ZDBs8BiHL6pWUQNy9i-3CamYb-dSnPc Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 6350b412ae2f420f888b8c9f250d7fb2 Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-164387724 Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6350b412ae2f420f888b8c9f250d7fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6350b412ae2f420f888b8c9f250d7fb2", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6350b412ae2f420f888b8c9f250d7fb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6350b412ae2f420f888b8c9f250d7fb2"}]}] Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-164387724 Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 6350b412ae2f420f888b8c9f250d7fb2 Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-164387724 Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-164387724-project Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 10e7e3c31acd4216a4c099979ee025a1 Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-164387724-project Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: {"security_group_rule": {"parent_group_id": "a77d8cb9-03fd-418f-b958-3174700ee1c2", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a77d8cb9-03fd-418f-b958-3174700ee1c2', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 24 10:26:23.144313 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:23.148628 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:26:23.148628 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:23.148628 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:23.148628 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:26:23.148628 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:26:23.148628 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:26:23.148628 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:26:23.148628 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 24 10:26:23.148628 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:23.150286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f3bb8240-d58f-4009-a937-7864ca7a82cb tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:26:23.151359 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f3bb8240-d58f-4009-a937-7864ca7a82cb tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] 10.222.0.85 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.104623 Aug 24 10:26:23.152167 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1771/3201] 10.222.0.85 () {60 vars in 1195 bytes} [Wed Aug 24 10:26:23 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:26:23.162969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5d935436-82dc-4891-84d2-eae0db6d36eb tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:23.163854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5d935436-82dc-4891-84d2-eae0db6d36eb tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:23.171513 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d935436-82dc-4891-84d2-eae0db6d36eb tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:23.172284 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d935436-82dc-4891-84d2-eae0db6d36eb tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:23.172909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d935436-82dc-4891-84d2-eae0db6d36eb tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:23.174034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d935436-82dc-4891-84d2-eae0db6d36eb tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:23.174757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d935436-82dc-4891-84d2-eae0db6d36eb tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:23.175593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d935436-82dc-4891-84d2-eae0db6d36eb tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:23.354313 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5d935436-82dc-4891-84d2-eae0db6d36eb tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:23.367362 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5d935436-82dc-4891-84d2-eae0db6d36eb tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1506 microversion: 2.1 time: 0.208496 Aug 24 10:26:23.381867 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1772/3202] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:23 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1506 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:23.390405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e1f03b7e-daa4-460a-8973-fe8007305670 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Action: 'create', calling method: .version_select at 0x7f4647c26040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-31240875", "description": "tempest-description-1100091323"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:23.678911 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e1f03b7e-daa4-460a-8973-fe8007305670 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] 10.222.0.85 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.288417 Aug 24 10:26:23.679806 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1773/3203] 10.222.0.85 () {60 vars in 1180 bytes} [Wed Aug 24 10:26:23 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:23.709744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fc483fee-5149-4b46-843b-a066834e0054 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Action: 'create', calling method: .version_select at 0x7f4647cc8a60>, body: {"security_group_rule": {"parent_group_id": "921d0a5f-0cf5-4843-a529-e7fc73f334d8", "ip_protocol": "tcp", "from_port": 22, "to_port": 138226847}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:23.827370 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-fc483fee-5149-4b46-843b-a066834e0054 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] HTTP exception thrown: Invalid port range 22:138226847. Valid TCP ports should be between 1-65535 Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fc483fee-5149-4b46-843b-a066834e0054 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Request method failure captured: Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 145 Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfzKbKP7PhaMW1yZO3sC47aDhI3wYtfEnzZiWGShJ-rNLm-flsZ4CN6jmLDDkgu3oZyfqOMEDYtXxToK_luonLboXoxH1OXWEDD1wmK5Va30Palm1mB1VxPhCWjMCXl0Ym_6dLepw2XGu597ZDBs8BiHL6pWUQNy9i-3CamYb-dSnPc Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 6350b412ae2f420f888b8c9f250d7fb2 Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-164387724 Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6350b412ae2f420f888b8c9f250d7fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6350b412ae2f420f888b8c9f250d7fb2", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6350b412ae2f420f888b8c9f250d7fb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6350b412ae2f420f888b8c9f250d7fb2"}]}] Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-164387724 Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 6350b412ae2f420f888b8c9f250d7fb2 Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-164387724 Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-164387724-project Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 10e7e3c31acd4216a4c099979ee025a1 Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-164387724-project Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: {"security_group_rule": {"parent_group_id": "921d0a5f-0cf5-4843-a529-e7fc73f334d8", "ip_protocol": "tcp", "from_port": 22, "to_port": 138226847}} Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: exception: Invalid port range 22:138226847. Valid TCP ports should be between 1-65535 Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'security_group_rule': {'parent_group_id': '921d0a5f-0cf5-4843-a529-e7fc73f334d8', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 138226847}}} Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:138226847. Valid TCP ports should be between 1-65535 Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:138226847. Valid TCP ports should be between 1-65535 Aug 24 10:26:23.829315 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:23.834227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:26:23.834227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:23.834227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:23.834227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:26:23.834227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:26:23.834227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:26:23.834227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:26:23.834227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:138226847. Valid TCP ports should be between 1-65535 Aug 24 10:26:23.834227 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:23.834227 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fc483fee-5149-4b46-843b-a066834e0054 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Returning 400 to user: Invalid port range 22:138226847. Valid TCP ports should be between 1-65535 {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:26:23.834227 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fc483fee-5149-4b46-843b-a066834e0054 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] 10.222.0.85 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.136759 Aug 24 10:26:23.837267 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1774/3204] 10.222.0.85 () {60 vars in 1195 bytes} [Wed Aug 24 10:26:23 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:26:23.844524 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7fc2e0dc-19e3-4265-9ab6-b85270e83d5e tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Action: 'create', calling method: .version_select at 0x7f4647c475e0>, body: {"security_group_rule": {"parent_group_id": "09d90bc7-89e1-417d-9330-560410ec00d7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:23.899657 n-d-849328-3 devstack@n-api.service[122433]: DEBUG neutronclient.v2_0.client [None req-7fc2e0dc-19e3-4265-9ab6-b85270e83d5e tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 09d90bc7-89e1-417d-9330-560410ec00d7 does not exist", "detail": ""}} {{(pid=122433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 10:26:23.900362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.security_group_api [None req-7fc2e0dc-19e3-4265-9ab6-b85270e83d5e tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Neutron security group 09d90bc7-89e1-417d-9330-560410ec00d7 not found {{(pid=122433) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 10:26:23.900892 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-7fc2e0dc-19e3-4265-9ab6-b85270e83d5e tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] HTTP exception thrown: Security group 09d90bc7-89e1-417d-9330-560410ec00d7 does not exist Aug 24 10:26:23.900892 n-d-849328-3 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-f83017c8-337e-4bf6-afc2-278ebf75f5d2'] Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7fc2e0dc-19e3-4265-9ab6-b85270e83d5e tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Request method failure captured: Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 138 Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfzKbKP7PhaMW1yZO3sC47aDhI3wYtfEnzZiWGShJ-rNLm-flsZ4CN6jmLDDkgu3oZyfqOMEDYtXxToK_luonLboXoxH1OXWEDD1wmK5Va30Palm1mB1VxPhCWjMCXl0Ym_6dLepw2XGu597ZDBs8BiHL6pWUQNy9i-3CamYb-dSnPc Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 6350b412ae2f420f888b8c9f250d7fb2 Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-164387724 Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6350b412ae2f420f888b8c9f250d7fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6350b412ae2f420f888b8c9f250d7fb2", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6350b412ae2f420f888b8c9f250d7fb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6350b412ae2f420f888b8c9f250d7fb2"}]}] Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-164387724 Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 6350b412ae2f420f888b8c9f250d7fb2 Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-164387724 Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-164387724-project Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 10e7e3c31acd4216a4c099979ee025a1 Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-164387724-project Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: {"security_group_rule": {"parent_group_id": "09d90bc7-89e1-417d-9330-560410ec00d7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: exception: Security group 09d90bc7-89e1-417d-9330-560410ec00d7 does not exist Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-f83017c8-337e-4bf6-afc2-278ebf75f5d2'] Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'security_group_rule': {'parent_group_id': '09d90bc7-89e1-417d-9330-560410ec00d7', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 10:26:23.902948 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 09d90bc7-89e1-417d-9330-560410ec00d7 does not exist Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f83017c8-337e-4bf6-afc2-278ebf75f5d2'] Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 09d90bc7-89e1-417d-9330-560410ec00d7 does not exist Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f83017c8-337e-4bf6-afc2-278ebf75f5d2'] Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 09d90bc7-89e1-417d-9330-560410ec00d7 does not exist Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f83017c8-337e-4bf6-afc2-278ebf75f5d2'] Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 09d90bc7-89e1-417d-9330-560410ec00d7 does not exist Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f83017c8-337e-4bf6-afc2-278ebf75f5d2'] Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7fc2e0dc-19e3-4265-9ab6-b85270e83d5e tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Returning 404 to user: Security group 09d90bc7-89e1-417d-9330-560410ec00d7 does not exist Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-f83017c8-337e-4bf6-afc2-278ebf75f5d2'] {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7fc2e0dc-19e3-4265-9ab6-b85270e83d5e tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] 10.222.0.85 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.065475 Aug 24 10:26:23.906895 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1775/3205] 10.222.0.85 () {60 vars in 1195 bytes} [Wed Aug 24 10:26:23 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:26:23.919491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fb2379cd-f216-41b1-ad49-796eac594695 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Calling method '.version_select at 0x7f4647bff280>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:23.997161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG neutronclient.v2_0.client [None req-fb2379cd-f216-41b1-ad49-796eac594695 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule b65af178-e333-402b-95e0-ec7aca999701 does not exist", "detail": ""}} {{(pid=122433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 10:26:23.998114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.security_group_api [None req-fb2379cd-f216-41b1-ad49-796eac594695 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Neutron security group rule b65af178-e333-402b-95e0-ec7aca999701 not found {{(pid=122433) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 24 10:26:23.999629 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-fb2379cd-f216-41b1-ad49-796eac594695 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] HTTP exception thrown: Security group rule b65af178-e333-402b-95e0-ec7aca999701 does not exist Aug 24 10:26:23.999629 n-d-849328-3 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-a4936a80-b223-445c-893a-8b837cc1db1c'] Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fb2379cd-f216-41b1-ad49-796eac594695 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Request method failure captured: Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-security-group-rules/b65af178-e333-402b-95e0-ec7aca999701 HTTP/1.1 Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfzKbKP7PhaMW1yZO3sC47aDhI3wYtfEnzZiWGShJ-rNLm-flsZ4CN6jmLDDkgu3oZyfqOMEDYtXxToK_luonLboXoxH1OXWEDD1wmK5Va30Palm1mB1VxPhCWjMCXl0Ym_6dLepw2XGu597ZDBs8BiHL6pWUQNy9i-3CamYb-dSnPc Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 6350b412ae2f420f888b8c9f250d7fb2 Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-164387724 Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6350b412ae2f420f888b8c9f250d7fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6350b412ae2f420f888b8c9f250d7fb2", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6350b412ae2f420f888b8c9f250d7fb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6350b412ae2f420f888b8c9f250d7fb2"}]}] Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-164387724 Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 6350b412ae2f420f888b8c9f250d7fb2 Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-164387724 Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-164387724-project Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 10e7e3c31acd4216a4c099979ee025a1 Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-164387724-project Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: exception: Security group rule b65af178-e333-402b-95e0-ec7aca999701 does not exist Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-a4936a80-b223-445c-893a-8b837cc1db1c'] Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'b65af178-e333-402b-95e0-ec7aca999701'} Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 10:26:24.002428 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule b65af178-e333-402b-95e0-ec7aca999701 does not exist Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4936a80-b223-445c-893a-8b837cc1db1c'] Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule b65af178-e333-402b-95e0-ec7aca999701 does not exist Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4936a80-b223-445c-893a-8b837cc1db1c'] Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule b65af178-e333-402b-95e0-ec7aca999701 does not exist Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4936a80-b223-445c-893a-8b837cc1db1c'] Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule b65af178-e333-402b-95e0-ec7aca999701 does not exist Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4936a80-b223-445c-893a-8b837cc1db1c'] Aug 24 10:26:24.007963 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:26:24.021484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fb2379cd-f216-41b1-ad49-796eac594695 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Returning 404 to user: Security group rule b65af178-e333-402b-95e0-ec7aca999701 does not exist Aug 24 10:26:24.021484 n-d-849328-3 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-a4936a80-b223-445c-893a-8b837cc1db1c'] {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:26:24.021484 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fb2379cd-f216-41b1-ad49-796eac594695 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-group-rules/b65af178-e333-402b-95e0-ec7aca999701" status: 404 len: 199 microversion: 2.1 time: 0.100483 Aug 24 10:26:24.022922 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1776/3206] 10.222.0.85 () {58 vars in 1287 bytes} [Wed Aug 24 10:26:23 2022] DELETE /compute/v2.1/os-security-group-rules/b65af178-e333-402b-95e0-ec7aca999701 => generated 199 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:26:24.034689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-45f7a9db-6157-4a55-9dcf-3a0f06fae112 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Calling method '.version_select at 0x7f4647c26ca0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:24.565275 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-45f7a9db-6157-4a55-9dcf-3a0f06fae112 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/921d0a5f-0cf5-4843-a529-e7fc73f334d8" status: 202 len: 0 microversion: 2.1 time: 0.540032 Aug 24 10:26:24.569688 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1777/3207] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:26:24 2022] DELETE /compute/v2.1/os-security-groups/921d0a5f-0cf5-4843-a529-e7fc73f334d8 => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:26:24.577533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a8d95431-5bbe-4392-bbe9-4f281923e721 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:24.578479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a8d95431-5bbe-4392-bbe9-4f281923e721 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:24.596468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8d95431-5bbe-4392-bbe9-4f281923e721 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:24.597206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8d95431-5bbe-4392-bbe9-4f281923e721 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:24.602700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8d95431-5bbe-4392-bbe9-4f281923e721 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:24.603916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8d95431-5bbe-4392-bbe9-4f281923e721 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:24.604794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8d95431-5bbe-4392-bbe9-4f281923e721 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:24.605432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8d95431-5bbe-4392-bbe9-4f281923e721 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:24.930577 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a8d95431-5bbe-4392-bbe9-4f281923e721 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:24.940865 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a8d95431-5bbe-4392-bbe9-4f281923e721 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1508 microversion: 2.1 time: 0.369522 Aug 24 10:26:24.945180 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1778/3208] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:24 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1508 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:24.955783 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0997fb29-f2bb-490f-8b9c-be90c6506d49 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:24.959375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0997fb29-f2bb-490f-8b9c-be90c6506d49 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:24.967218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0997fb29-f2bb-490f-8b9c-be90c6506d49 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:24.967978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0997fb29-f2bb-490f-8b9c-be90c6506d49 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:24.968649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0997fb29-f2bb-490f-8b9c-be90c6506d49 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:24.969687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0997fb29-f2bb-490f-8b9c-be90c6506d49 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:24.977419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0997fb29-f2bb-490f-8b9c-be90c6506d49 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:24.978047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0997fb29-f2bb-490f-8b9c-be90c6506d49 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:25.259950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0997fb29-f2bb-490f-8b9c-be90c6506d49 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:25.272208 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0997fb29-f2bb-490f-8b9c-be90c6506d49 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1506 microversion: 2.1 time: 0.324207 Aug 24 10:26:25.273937 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1779/3209] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:24 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1506 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:25.280900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-19510c43-1646-47e8-af0b-587c07983f27 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Calling method '.version_select at 0x7f4647cb2d30>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:25.708672 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-19510c43-1646-47e8-af0b-587c07983f27 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/a77d8cb9-03fd-418f-b958-3174700ee1c2" status: 202 len: 0 microversion: 2.1 time: 0.433270 Aug 24 10:26:25.709312 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1780/3210] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:26:25 2022] DELETE /compute/v2.1/os-security-groups/a77d8cb9-03fd-418f-b958-3174700ee1c2 => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:26:25.717868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dc9a9ae8-e28e-4a34-a2e5-f48a78545a46 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Calling method '.version_select at 0x7f4647c475e0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:26.065917 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dc9a9ae8-e28e-4a34-a2e5-f48a78545a46 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/4a165d82-27b0-459c-ba1b-b8b8c804fe3d" status: 202 len: 0 microversion: 2.1 time: 0.352057 Aug 24 10:26:26.066947 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1781/3211] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:26:25 2022] DELETE /compute/v2.1/os-security-groups/4a165d82-27b0-459c-ba1b-b8b8c804fe3d => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:26:26.074394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8bb8d7f8-a865-4c23-bafc-cf51f3cfe590 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:26.075536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8bb8d7f8-a865-4c23-bafc-cf51f3cfe590 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:26.707294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bb8d7f8-a865-4c23-bafc-cf51f3cfe590 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:26.708098 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bb8d7f8-a865-4c23-bafc-cf51f3cfe590 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:26.718340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bb8d7f8-a865-4c23-bafc-cf51f3cfe590 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:26.723198 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bb8d7f8-a865-4c23-bafc-cf51f3cfe590 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:26.724741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bb8d7f8-a865-4c23-bafc-cf51f3cfe590 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:26.727185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bb8d7f8-a865-4c23-bafc-cf51f3cfe590 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:27.119415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8bb8d7f8-a865-4c23-bafc-cf51f3cfe590 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:27.133483 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8bb8d7f8-a865-4c23-bafc-cf51f3cfe590 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1508 microversion: 2.1 time: 1.061162 Aug 24 10:26:27.134387 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1782/3212] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:26 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1508 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:27.151320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-39c9d775-3471-4eb9-8a96-aff9474a4cc5 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Calling method '.version_select at 0x7f4647caf700>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:27.701468 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-39c9d775-3471-4eb9-8a96-aff9474a4cc5 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/8cc80101-1550-4a7b-83f5-b8af222f3a63" status: 202 len: 0 microversion: 2.1 time: 0.565727 Aug 24 10:26:27.702177 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1783/3213] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:26:27 2022] DELETE /compute/v2.1/os-security-groups/8cc80101-1550-4a7b-83f5-b8af222f3a63 => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:26:27.710936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2952c964-0db8-4dfa-b5ec-e6055c6b51ce tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:27.711788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2952c964-0db8-4dfa-b5ec-e6055c6b51ce tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:27.728583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2952c964-0db8-4dfa-b5ec-e6055c6b51ce tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:27.729959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2952c964-0db8-4dfa-b5ec-e6055c6b51ce tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:27.733648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2952c964-0db8-4dfa-b5ec-e6055c6b51ce tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:27.734787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2952c964-0db8-4dfa-b5ec-e6055c6b51ce tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:27.735619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2952c964-0db8-4dfa-b5ec-e6055c6b51ce tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:27.736239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2952c964-0db8-4dfa-b5ec-e6055c6b51ce tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:27.999577 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2952c964-0db8-4dfa-b5ec-e6055c6b51ce tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:28.010352 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2952c964-0db8-4dfa-b5ec-e6055c6b51ce tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1506 microversion: 2.1 time: 0.303209 Aug 24 10:26:28.011459 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1784/3214] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:27 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1506 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:28.016857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ea408bd9-1734-43b1-8406-72951aa6ede3 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] Calling method '.version_select at 0x7f4647cc8790>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:28.434951 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ea408bd9-1734-43b1-8406-72951aa6ede3 tempest-SecurityGroupRulesNegativeTestJSON-164387724 tempest-SecurityGroupRulesNegativeTestJSON-164387724-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/a0f92d4d-d840-469f-bbbc-43659b54b0ed" status: 202 len: 0 microversion: 2.1 time: 0.422117 Aug 24 10:26:28.435547 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1785/3215] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:26:28 2022] DELETE /compute/v2.1/os-security-groups/a0f92d4d-d840-469f-bbbc-43659b54b0ed => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:26:28.452877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a7a364f3-6edb-4045-b192-cf4fb2dced92 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:28.453535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a7a364f3-6edb-4045-b192-cf4fb2dced92 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:28.473237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:28.474929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7a364f3-6edb-4045-b192-cf4fb2dced92 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:28.475593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7a364f3-6edb-4045-b192-cf4fb2dced92 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:28.476054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7a364f3-6edb-4045-b192-cf4fb2dced92 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:28.477285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7a364f3-6edb-4045-b192-cf4fb2dced92 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:28.477413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7a364f3-6edb-4045-b192-cf4fb2dced92 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:28.477819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7a364f3-6edb-4045-b192-cf4fb2dced92 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:28.925945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a7a364f3-6edb-4045-b192-cf4fb2dced92 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:28.939593 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a7a364f3-6edb-4045-b192-cf4fb2dced92 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1508 microversion: 2.1 time: 0.493130 Aug 24 10:26:28.940111 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1786/3216] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:28 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1508 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:29.521330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2a7939fe-0365-4841-a742-f6112ba24b74 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Action: 'create', calling method: .version_select at 0x7f4647cafdc0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-395937083", "policies": ["affinity"]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:29.591549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-2a7939fe-0365-4841-a742-f6112ba24b74 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Getting quotas for project b38653c7bc12485ba8d0de49f2db2820. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:26:29.610724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-2a7939fe-0365-4841-a742-f6112ba24b74 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Getting quotas for user 54d798bffa944169b1ba0b6042698374 and project b38653c7bc12485ba8d0de49f2db2820. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:26:29.722163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-2a7939fe-0365-4841-a742-f6112ba24b74 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Getting quotas for project b38653c7bc12485ba8d0de49f2db2820. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:26:29.729291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-2a7939fe-0365-4841-a742-f6112ba24b74 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Getting quotas for user 54d798bffa944169b1ba0b6042698374 and project b38653c7bc12485ba8d0de49f2db2820. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:26:29.745014 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2a7939fe-0365-4841-a742-f6112ba24b74 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.803648 Aug 24 10:26:29.746260 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1787/3217] 10.222.0.85 () {60 vars in 1174 bytes} [Wed Aug 24 10:26:28 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:29.759250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b3b64785-a5a7-48ab-9caa-e14c7820a08e tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:29.760597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b3b64785-a5a7-48ab-9caa-e14c7820a08e tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:29.768745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3b64785-a5a7-48ab-9caa-e14c7820a08e tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:29.770212 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3b64785-a5a7-48ab-9caa-e14c7820a08e tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:29.772702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3b64785-a5a7-48ab-9caa-e14c7820a08e tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:29.774540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3b64785-a5a7-48ab-9caa-e14c7820a08e tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:29.775597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3b64785-a5a7-48ab-9caa-e14c7820a08e tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:29.776245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3b64785-a5a7-48ab-9caa-e14c7820a08e tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:29.824371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=55 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:29.997008 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b3b64785-a5a7-48ab-9caa-e14c7820a08e tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:30.007615 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b3b64785-a5a7-48ab-9caa-e14c7820a08e tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1506 microversion: 2.1 time: 0.259717 Aug 24 10:26:30.021048 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1788/3218] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:29 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1506 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:30.021048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2b2883b7-7abf-45d6-829b-8bc9e7243791 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Action: 'create', calling method: .version_select at 0x7f4647cc6af0>, body: {"server_group": {"name": "tempest-server-group-1933212958", "policies": ["affinity"]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:30.040815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-2b2883b7-7abf-45d6-829b-8bc9e7243791 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Getting quotas for project b38653c7bc12485ba8d0de49f2db2820. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:26:30.047587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-2b2883b7-7abf-45d6-829b-8bc9e7243791 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Getting quotas for user 54d798bffa944169b1ba0b6042698374 and project b38653c7bc12485ba8d0de49f2db2820. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:26:30.114156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-2b2883b7-7abf-45d6-829b-8bc9e7243791 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Getting quotas for project b38653c7bc12485ba8d0de49f2db2820. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:26:30.120022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-2b2883b7-7abf-45d6-829b-8bc9e7243791 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Getting quotas for user 54d798bffa944169b1ba0b6042698374 and project b38653c7bc12485ba8d0de49f2db2820. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:26:30.137345 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2b2883b7-7abf-45d6-829b-8bc9e7243791 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.127145 Aug 24 10:26:30.138774 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1789/3219] 10.222.0.85 () {60 vars in 1173 bytes} [Wed Aug 24 10:26:30 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:30.149084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3f664f57-1783-4c04-970d-2014593c6c11 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:30.149739 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3f664f57-1783-4c04-970d-2014593c6c11 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:30.158462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f664f57-1783-4c04-970d-2014593c6c11 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:30.158962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f664f57-1783-4c04-970d-2014593c6c11 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:30.159412 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f664f57-1783-4c04-970d-2014593c6c11 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:30.160136 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f664f57-1783-4c04-970d-2014593c6c11 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:30.160593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f664f57-1783-4c04-970d-2014593c6c11 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:30.161278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f664f57-1783-4c04-970d-2014593c6c11 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:30.385276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3f664f57-1783-4c04-970d-2014593c6c11 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:30.404120 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3f664f57-1783-4c04-970d-2014593c6c11 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1508 microversion: 2.1 time: 0.263315 Aug 24 10:26:30.422449 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1790/3220] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:30 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1508 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:30.433229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-22da7a27-bfe4-461d-bfed-8d317ee7239c tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Action: 'create', calling method: .version_select at 0x7f4647cf65e0>, body: {"server_group": {"name": "tempest-server-group-1933212958", "policies": ["affinity"]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:30.462331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-22da7a27-bfe4-461d-bfed-8d317ee7239c tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Getting quotas for project b38653c7bc12485ba8d0de49f2db2820. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:26:30.476295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-22da7a27-bfe4-461d-bfed-8d317ee7239c tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Getting quotas for user 54d798bffa944169b1ba0b6042698374 and project b38653c7bc12485ba8d0de49f2db2820. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:26:30.547652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-22da7a27-bfe4-461d-bfed-8d317ee7239c tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Getting quotas for project b38653c7bc12485ba8d0de49f2db2820. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:26:30.555500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-22da7a27-bfe4-461d-bfed-8d317ee7239c tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Getting quotas for user 54d798bffa944169b1ba0b6042698374 and project b38653c7bc12485ba8d0de49f2db2820. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:26:30.585754 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-22da7a27-bfe4-461d-bfed-8d317ee7239c tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.161936 Aug 24 10:26:30.587623 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1791/3221] 10.222.0.85 () {60 vars in 1173 bytes} [Wed Aug 24 10:26:30 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:30.607021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bfacf423-9141-4c48-982a-890435c0203d tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:30.648157 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bfacf423-9141-4c48-982a-890435c0203d tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "DELETE /compute/v2.1/os-server-groups/c26f54dd-6b7c-4b65-8319-c6740f51d84f" status: 204 len: 0 microversion: 2.1 time: 0.051598 Aug 24 10:26:30.649233 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1792/3222] 10.222.0.85 () {58 vars in 1266 bytes} [Wed Aug 24 10:26:30 2022] DELETE /compute/v2.1/os-server-groups/c26f54dd-6b7c-4b65-8319-c6740f51d84f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:26:30.660561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5ddd3f9f-4440-4e2e-9986-d8c5abbc24e5 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:30.681657 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5ddd3f9f-4440-4e2e-9986-d8c5abbc24e5 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.026733 Aug 24 10:26:30.684858 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1793/3223] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:26:30 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:30.696623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-10f08c21-0eb5-460a-8338-e3c3f31475fd tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:30.724833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:30.732635 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-10f08c21-0eb5-460a-8338-e3c3f31475fd tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "DELETE /compute/v2.1/os-server-groups/6698bfec-c3f3-4b78-b944-c2e7b0060ae4" status: 204 len: 0 microversion: 2.1 time: 0.040368 Aug 24 10:26:30.739402 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1794/3224] 10.222.0.85 () {58 vars in 1266 bytes} [Wed Aug 24 10:26:30 2022] DELETE /compute/v2.1/os-server-groups/6698bfec-c3f3-4b78-b944-c2e7b0060ae4 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:26:30.747489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-46dbd8a6-540f-466e-8046-47c1a43d730f tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:30.761456 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-46dbd8a6-540f-466e-8046-47c1a43d730f tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.018282 Aug 24 10:26:30.765175 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1795/3225] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:26:30 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:30.775379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cf3b4753-fea4-4dba-90dc-892db04dca78 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Action: 'create', calling method: .version_select at 0x7f4647cb2e50>, body: {"server_group": {"name": "tempest-server-group-216035153", "policies": ["affinity"]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:30.799335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-cf3b4753-fea4-4dba-90dc-892db04dca78 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Getting quotas for project b38653c7bc12485ba8d0de49f2db2820. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:26:30.819934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-cf3b4753-fea4-4dba-90dc-892db04dca78 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Getting quotas for user 54d798bffa944169b1ba0b6042698374 and project b38653c7bc12485ba8d0de49f2db2820. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:26:30.905994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-cf3b4753-fea4-4dba-90dc-892db04dca78 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Getting quotas for project b38653c7bc12485ba8d0de49f2db2820. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:26:30.917371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-cf3b4753-fea4-4dba-90dc-892db04dca78 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Getting quotas for user 54d798bffa944169b1ba0b6042698374 and project b38653c7bc12485ba8d0de49f2db2820. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:26:30.943978 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cf3b4753-fea4-4dba-90dc-892db04dca78 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.172346 Aug 24 10:26:30.949560 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1796/3226] 10.222.0.85 () {60 vars in 1173 bytes} [Wed Aug 24 10:26:30 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:30.966008 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6e3202ea-fd36-4132-811a-428706c9690c tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:31.015189 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6e3202ea-fd36-4132-811a-428706c9690c tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "DELETE /compute/v2.1/os-server-groups/a4317ba5-5cbb-4876-97b3-ffd309061482" status: 204 len: 0 microversion: 2.1 time: 0.057977 Aug 24 10:26:31.021667 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1797/3227] 10.222.0.85 () {58 vars in 1266 bytes} [Wed Aug 24 10:26:30 2022] DELETE /compute/v2.1/os-server-groups/a4317ba5-5cbb-4876-97b3-ffd309061482 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:26:31.029007 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7de33221-be7b-4e8e-a3b5-b2e1844f9fc7 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:31.043431 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7de33221-be7b-4e8e-a3b5-b2e1844f9fc7 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.020285 Aug 24 10:26:31.055196 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1798/3228] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:26:31 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:31.071183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4220e5fe-968d-43f8-8b3a-a96651564239 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:31.073896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4220e5fe-968d-43f8-8b3a-a96651564239 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:31.096113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4220e5fe-968d-43f8-8b3a-a96651564239 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:31.097375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4220e5fe-968d-43f8-8b3a-a96651564239 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:31.099536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4220e5fe-968d-43f8-8b3a-a96651564239 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:31.101606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4220e5fe-968d-43f8-8b3a-a96651564239 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:31.103658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4220e5fe-968d-43f8-8b3a-a96651564239 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:31.105503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4220e5fe-968d-43f8-8b3a-a96651564239 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:31.124343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:31.842109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4220e5fe-968d-43f8-8b3a-a96651564239 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:31.855384 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4220e5fe-968d-43f8-8b3a-a96651564239 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1506 microversion: 2.1 time: 0.798235 Aug 24 10:26:31.856583 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1799/3229] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:31 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1506 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:31.863051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-69bcc212-c7df-4f76-ad48-dd86d22d9e6e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Action: 'create', calling method: .version_select at 0x7f4647cc88b0>, body: {"server_group": {"name": "tempest-server-group-1723273523", "policies": ["anti-affinity"]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:31.885283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-69bcc212-c7df-4f76-ad48-dd86d22d9e6e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Getting quotas for project b38653c7bc12485ba8d0de49f2db2820. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:26:31.892001 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-69bcc212-c7df-4f76-ad48-dd86d22d9e6e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Getting quotas for user 54d798bffa944169b1ba0b6042698374 and project b38653c7bc12485ba8d0de49f2db2820. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:26:31.956019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-69bcc212-c7df-4f76-ad48-dd86d22d9e6e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Getting quotas for project b38653c7bc12485ba8d0de49f2db2820. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:26:31.962404 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-69bcc212-c7df-4f76-ad48-dd86d22d9e6e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Getting quotas for user 54d798bffa944169b1ba0b6042698374 and project b38653c7bc12485ba8d0de49f2db2820. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:26:31.981564 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-69bcc212-c7df-4f76-ad48-dd86d22d9e6e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.123386 Aug 24 10:26:31.982516 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1800/3230] 10.222.0.85 () {60 vars in 1173 bytes} [Wed Aug 24 10:26:31 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:31.987670 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-69fa0bf4-64fa-44ca-b3b3-d44234abc42a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:31.988677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-69fa0bf4-64fa-44ca-b3b3-d44234abc42a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:32.000064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69fa0bf4-64fa-44ca-b3b3-d44234abc42a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:32.000875 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69fa0bf4-64fa-44ca-b3b3-d44234abc42a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:32.001466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69fa0bf4-64fa-44ca-b3b3-d44234abc42a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:32.002276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69fa0bf4-64fa-44ca-b3b3-d44234abc42a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:32.002976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69fa0bf4-64fa-44ca-b3b3-d44234abc42a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:32.003505 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69fa0bf4-64fa-44ca-b3b3-d44234abc42a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:32.267573 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-69fa0bf4-64fa-44ca-b3b3-d44234abc42a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:32.279326 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-69fa0bf4-64fa-44ca-b3b3-d44234abc42a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1508 microversion: 2.1 time: 0.294862 Aug 24 10:26:32.281254 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1801/3231] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:31 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1508 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:32.291661 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-003910c1-0c25-4bd8-8747-4b6efbd24e2d tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:32.337657 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-003910c1-0c25-4bd8-8747-4b6efbd24e2d tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "DELETE /compute/v2.1/os-server-groups/ab75a09c-58a6-4e4f-994b-361217555e5b" status: 204 len: 0 microversion: 2.1 time: 0.054083 Aug 24 10:26:32.338834 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1802/3232] 10.222.0.85 () {58 vars in 1266 bytes} [Wed Aug 24 10:26:32 2022] DELETE /compute/v2.1/os-server-groups/ab75a09c-58a6-4e4f-994b-361217555e5b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:26:32.347823 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9c1f2b19-f149-4069-a5fe-7f23105906da tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:32.360058 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9c1f2b19-f149-4069-a5fe-7f23105906da tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.016002 Aug 24 10:26:32.361324 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1803/3233] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:26:32 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:32.526561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3693fabf-aa14-466c-939a-d5a6e802ff4e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-192861022", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "dc432a50-e16d-4845-a562-ca8cc33226aa"}]}, "os:scheduler_hints": {"group": "5b638a0f-55d5-4eba-8b03-4da7d89c936d"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:32.636376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-3693fabf-aa14-466c-939a-d5a6e802ff4e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] validate_networks() for [('dc432a50-e16d-4845-a562-ca8cc33226aa', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:26:32.949659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=53 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:33.309019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-3693fabf-aa14-466c-939a-d5a6e802ff4e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:26:33.309954 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-3693fabf-aa14-466c-939a-d5a6e802ff4e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:26:33.310595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-3693fabf-aa14-466c-939a-d5a6e802ff4e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:26:33.311160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-3693fabf-aa14-466c-939a-d5a6e802ff4e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:26:33.311713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-3693fabf-aa14-466c-939a-d5a6e802ff4e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:26:33.332609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3693fabf-aa14-466c-939a-d5a6e802ff4e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:33.333562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3693fabf-aa14-466c-939a-d5a6e802ff4e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:33.334217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3693fabf-aa14-466c-939a-d5a6e802ff4e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:33.335896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3693fabf-aa14-466c-939a-d5a6e802ff4e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:33.336978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3693fabf-aa14-466c-939a-d5a6e802ff4e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:33.337693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3693fabf-aa14-466c-939a-d5a6e802ff4e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:33.361932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-3693fabf-aa14-466c-939a-d5a6e802ff4e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Getting quotas for project b38653c7bc12485ba8d0de49f2db2820. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:26:33.368876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-3693fabf-aa14-466c-939a-d5a6e802ff4e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Getting quotas for user 54d798bffa944169b1ba0b6042698374 and project b38653c7bc12485ba8d0de49f2db2820. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:26:33.408891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3693fabf-aa14-466c-939a-d5a6e802ff4e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:26:33.422491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3693fabf-aa14-466c-939a-d5a6e802ff4e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] [instance: 828b46b2-00a2-4e00-b2b7-bc20d0d34f86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:26:33.508661 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=9,nova_api:INSERT=5 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:33.540870 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-3693fabf-aa14-466c-939a-d5a6e802ff4e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Getting quotas for project b38653c7bc12485ba8d0de49f2db2820. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:26:33.552602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-3693fabf-aa14-466c-939a-d5a6e802ff4e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Getting quotas for user 54d798bffa944169b1ba0b6042698374 and project b38653c7bc12485ba8d0de49f2db2820. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:26:33.619233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-3693fabf-aa14-466c-939a-d5a6e802ff4e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Getting quotas for project b38653c7bc12485ba8d0de49f2db2820. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:26:33.635764 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-3693fabf-aa14-466c-939a-d5a6e802ff4e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Getting quotas for user 54d798bffa944169b1ba0b6042698374 and project b38653c7bc12485ba8d0de49f2db2820. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:26:33.744207 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3693fabf-aa14-466c-939a-d5a6e802ff4e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.220569 Aug 24 10:26:33.746448 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1804/3234] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:26:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:26:33.762525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8fad4d47-71bc-4454-b1cb-88baacbad0fd tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:33.763482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8fad4d47-71bc-4454-b1cb-88baacbad0fd tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:33.784239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fad4d47-71bc-4454-b1cb-88baacbad0fd tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:33.785649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fad4d47-71bc-4454-b1cb-88baacbad0fd tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:33.786586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fad4d47-71bc-4454-b1cb-88baacbad0fd tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:33.790222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fad4d47-71bc-4454-b1cb-88baacbad0fd tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:33.791253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fad4d47-71bc-4454-b1cb-88baacbad0fd tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:33.792709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fad4d47-71bc-4454-b1cb-88baacbad0fd tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:34.109324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8fad4d47-71bc-4454-b1cb-88baacbad0fd tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:34.121143 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8fad4d47-71bc-4454-b1cb-88baacbad0fd tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1506 microversion: 2.1 time: 0.371710 Aug 24 10:26:34.125343 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1805/3235] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:33 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1506 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:34.137850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e8b549fc-a216-4df1-8e5d-0c54123c9381 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:34.138488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e8b549fc-a216-4df1-8e5d-0c54123c9381 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:34.148894 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8b549fc-a216-4df1-8e5d-0c54123c9381 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:34.149421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8b549fc-a216-4df1-8e5d-0c54123c9381 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:34.150065 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8b549fc-a216-4df1-8e5d-0c54123c9381 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:34.153335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8b549fc-a216-4df1-8e5d-0c54123c9381 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:34.154065 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8b549fc-a216-4df1-8e5d-0c54123c9381 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:34.154693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8b549fc-a216-4df1-8e5d-0c54123c9381 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:34.340501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e8b549fc-a216-4df1-8e5d-0c54123c9381 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:34.349336 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e8b549fc-a216-4df1-8e5d-0c54123c9381 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1508 microversion: 2.1 time: 0.224533 Aug 24 10:26:34.349958 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1806/3236] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:34 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1508 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:34.355603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-caaf884b-ff12-43fb-aa72-703b09d4053d tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:34.356459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-caaf884b-ff12-43fb-aa72-703b09d4053d tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] [instance: 828b46b2-00a2-4e00-b2b7-bc20d0d34f86] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:34.428513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2ad1fb07-21d7-4fc7-a3a1-12b9a771f497 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:26:34.429050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2ad1fb07-21d7-4fc7-a3a1-12b9a771f497 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:26:34.429447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2ad1fb07-21d7-4fc7-a3a1-12b9a771f497 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:26:34.429852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2ad1fb07-21d7-4fc7-a3a1-12b9a771f497 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:26:34.430425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2ad1fb07-21d7-4fc7-a3a1-12b9a771f497 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:26:34.448149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ad1fb07-21d7-4fc7-a3a1-12b9a771f497 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:34.449902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ad1fb07-21d7-4fc7-a3a1-12b9a771f497 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:34.451344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ad1fb07-21d7-4fc7-a3a1-12b9a771f497 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:34.452505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ad1fb07-21d7-4fc7-a3a1-12b9a771f497 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:34.455644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ad1fb07-21d7-4fc7-a3a1-12b9a771f497 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:34.456333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ad1fb07-21d7-4fc7-a3a1-12b9a771f497 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:34.460504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-caaf884b-ff12-43fb-aa72-703b09d4053d tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d798bffa944169b1ba0b6042698374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38653c7bc12485ba8d0de49f2db2820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:34.472142 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-caaf884b-ff12-43fb-aa72-703b09d4053d tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86" status: 200 len: 1212 microversion: 2.1 time: 0.120588 Aug 24 10:26:34.473407 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1807/3237] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:34 2022] GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86 => generated 1212 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:34.512983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-2ad1fb07-21d7-4fc7-a3a1-12b9a771f497 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Getting quotas for project 3ace7124510e4aad905cbf22c7c77483. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:26:34.526387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-2ad1fb07-21d7-4fc7-a3a1-12b9a771f497 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Getting quotas for user 24ba82263a7d4ee79bc04be46db8227a and project 3ace7124510e4aad905cbf22c7c77483. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:26:34.832916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2ad1fb07-21d7-4fc7-a3a1-12b9a771f497 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:26:34.837000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2ad1fb07-21d7-4fc7-a3a1-12b9a771f497 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='55a1c132-474f-4988-888c-f31db47f5251',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='b9c6daf2-cb72-41d6-88a5-786630d968f8',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='39c9feef-3b23-4cd9-96ee-f9a4054e22b4',volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:26:34.859905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-471af5e7-86a3-4d98-8df7-6abe04790ad0 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-684845966", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "b84af531-c729-4e6b-9e1d-bbfb14647801"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:34.977044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-471af5e7-86a3-4d98-8df7-6abe04790ad0 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] validate_networks() for [('b84af531-c729-4e6b-9e1d-bbfb14647801', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:26:35.523220 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2ad1fb07-21d7-4fc7-a3a1-12b9a771f497 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 15.672763 Aug 24 10:26:35.525653 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1431/3238] 10.222.0.85 () {62 vars in 1189 bytes} [Wed Aug 24 10:26:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 15688 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 10:26:35.531631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8775f612-eed8-4910-8e80-5471d5a0eb7a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:35.534010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8775f612-eed8-4910-8e80-5471d5a0eb7a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:35.548505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8775f612-eed8-4910-8e80-5471d5a0eb7a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:35.549515 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8775f612-eed8-4910-8e80-5471d5a0eb7a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:35.551987 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8775f612-eed8-4910-8e80-5471d5a0eb7a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:35.554146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8775f612-eed8-4910-8e80-5471d5a0eb7a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:35.556661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8775f612-eed8-4910-8e80-5471d5a0eb7a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:35.558821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8775f612-eed8-4910-8e80-5471d5a0eb7a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:36.095973 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8775f612-eed8-4910-8e80-5471d5a0eb7a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:36.105309 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8775f612-eed8-4910-8e80-5471d5a0eb7a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1506 microversion: 2.1 time: 0.577815 Aug 24 10:26:36.113865 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1432/3239] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:35 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1506 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:36.119184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e84064db-bb4b-4ac5-b1ad-24004fb3d564 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:36.130022 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e84064db-bb4b-4ac5-b1ad-24004fb3d564 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:36.138423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e84064db-bb4b-4ac5-b1ad-24004fb3d564 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:36.139324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e84064db-bb4b-4ac5-b1ad-24004fb3d564 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:36.139924 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e84064db-bb4b-4ac5-b1ad-24004fb3d564 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:36.147780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e84064db-bb4b-4ac5-b1ad-24004fb3d564 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:36.148712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e84064db-bb4b-4ac5-b1ad-24004fb3d564 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:36.149423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e84064db-bb4b-4ac5-b1ad-24004fb3d564 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:36.548756 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e84064db-bb4b-4ac5-b1ad-24004fb3d564 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:36.565350 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e84064db-bb4b-4ac5-b1ad-24004fb3d564 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1508 microversion: 2.1 time: 0.449507 Aug 24 10:26:36.568068 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1433/3240] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:36 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1508 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:36.579758 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-438a3099-b739-4bbf-9c16-936b47ec6713 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:36.581263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-438a3099-b739-4bbf-9c16-936b47ec6713 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] [instance: 828b46b2-00a2-4e00-b2b7-bc20d0d34f86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:36.597711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-438a3099-b739-4bbf-9c16-936b47ec6713 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:36.598235 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-438a3099-b739-4bbf-9c16-936b47ec6713 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:36.598688 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-438a3099-b739-4bbf-9c16-936b47ec6713 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:36.599439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-438a3099-b739-4bbf-9c16-936b47ec6713 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:36.599938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-438a3099-b739-4bbf-9c16-936b47ec6713 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:36.600381 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-438a3099-b739-4bbf-9c16-936b47ec6713 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:36.705429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-471af5e7-86a3-4d98-8df7-6abe04790ad0 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:26:36.706844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-471af5e7-86a3-4d98-8df7-6abe04790ad0 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:26:36.708647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-471af5e7-86a3-4d98-8df7-6abe04790ad0 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:26:36.709934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-471af5e7-86a3-4d98-8df7-6abe04790ad0 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:26:36.711138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-471af5e7-86a3-4d98-8df7-6abe04790ad0 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:26:36.732460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-471af5e7-86a3-4d98-8df7-6abe04790ad0 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:36.732967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-471af5e7-86a3-4d98-8df7-6abe04790ad0 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:36.733447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-471af5e7-86a3-4d98-8df7-6abe04790ad0 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:36.742480 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-471af5e7-86a3-4d98-8df7-6abe04790ad0 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:36.743045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-471af5e7-86a3-4d98-8df7-6abe04790ad0 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:36.743556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-471af5e7-86a3-4d98-8df7-6abe04790ad0 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:36.804710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-471af5e7-86a3-4d98-8df7-6abe04790ad0 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Getting quotas for project f9786b6d72ea4462ae31882e65d377b7. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:26:36.820169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-471af5e7-86a3-4d98-8df7-6abe04790ad0 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Getting quotas for user 539d440d00964721bbe156236eaff442 and project f9786b6d72ea4462ae31882e65d377b7. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:26:36.847917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-438a3099-b739-4bbf-9c16-936b47ec6713 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d798bffa944169b1ba0b6042698374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38653c7bc12485ba8d0de49f2db2820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:36.858375 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-438a3099-b739-4bbf-9c16-936b47ec6713 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86" status: 200 len: 1270 microversion: 2.1 time: 0.288823 Aug 24 10:26:36.865654 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1434/3241] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:36 2022] GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86 => generated 1270 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:36.871871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-471af5e7-86a3-4d98-8df7-6abe04790ad0 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:26:36.874171 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-471af5e7-86a3-4d98-8df7-6abe04790ad0 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] [instance: 60157d13-f95a-4362-8ed2-2f9eb878bf81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:26:36.874452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-70505bf8-509d-40d6-8cc4-7cfdf5022bc5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:36.875268 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-70505bf8-509d-40d6-8cc4-7cfdf5022bc5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:37.024783 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-471af5e7-86a3-4d98-8df7-6abe04790ad0 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.548151 Aug 24 10:26:37.025957 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1808/3242] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:26:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:26:37.049914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7d1fe41c-4585-4f4e-a842-1394337960fa tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:37.057401 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7d1fe41c-4585-4f4e-a842-1394337960fa tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] [instance: 60157d13-f95a-4362-8ed2-2f9eb878bf81] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:37.162363 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-70505bf8-509d-40d6-8cc4-7cfdf5022bc5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:37.184502 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-70505bf8-509d-40d6-8cc4-7cfdf5022bc5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:37.195340 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-70505bf8-509d-40d6-8cc4-7cfdf5022bc5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:37.197382 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-70505bf8-509d-40d6-8cc4-7cfdf5022bc5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1284 microversion: 2.42 time: 0.330124 Aug 24 10:26:37.202116 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1435/3243] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:26:36 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1284 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:26:37.214689 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-052dd46d-85eb-4b6c-8256-a4b8858ec23b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:37.216414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-052dd46d-85eb-4b6c-8256-a4b8858ec23b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:37.229269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-052dd46d-85eb-4b6c-8256-a4b8858ec23b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:37.229838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-052dd46d-85eb-4b6c-8256-a4b8858ec23b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:37.230303 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-052dd46d-85eb-4b6c-8256-a4b8858ec23b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:37.231068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-052dd46d-85eb-4b6c-8256-a4b8858ec23b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:37.231546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-052dd46d-85eb-4b6c-8256-a4b8858ec23b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:37.240480 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7d1fe41c-4585-4f4e-a842-1394337960fa tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539d440d00964721bbe156236eaff442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9786b6d72ea4462ae31882e65d377b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:37.240729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-052dd46d-85eb-4b6c-8256-a4b8858ec23b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:37.282460 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7d1fe41c-4585-4f4e-a842-1394337960fa tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] 10.222.0.85 "GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81" status: 200 len: 1215 microversion: 2.1 time: 0.248927 Aug 24 10:26:37.288487 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1809/3244] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:37 2022] GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81 => generated 1215 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:26:37.603539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ad6e063a-967a-413c-b850-78a2054c7fea tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:37.611391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ad6e063a-967a-413c-b850-78a2054c7fea tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:37.642952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad6e063a-967a-413c-b850-78a2054c7fea tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:37.642952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad6e063a-967a-413c-b850-78a2054c7fea tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:37.643410 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad6e063a-967a-413c-b850-78a2054c7fea tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:37.644110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad6e063a-967a-413c-b850-78a2054c7fea tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:37.644550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad6e063a-967a-413c-b850-78a2054c7fea tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:37.647064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad6e063a-967a-413c-b850-78a2054c7fea tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:38.075336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-052dd46d-85eb-4b6c-8256-a4b8858ec23b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:38.088505 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-052dd46d-85eb-4b6c-8256-a4b8858ec23b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1506 microversion: 2.1 time: 0.885010 Aug 24 10:26:38.089235 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1436/3245] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:37 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1506 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:38.106258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ea8a4e0f-d27f-4d30-98cd-af0e2583fb5f tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:38.107315 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ea8a4e0f-d27f-4d30-98cd-af0e2583fb5f tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] [instance: 828b46b2-00a2-4e00-b2b7-bc20d0d34f86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:38.122246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea8a4e0f-d27f-4d30-98cd-af0e2583fb5f tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:38.124544 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea8a4e0f-d27f-4d30-98cd-af0e2583fb5f tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:38.127346 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea8a4e0f-d27f-4d30-98cd-af0e2583fb5f tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:38.128480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea8a4e0f-d27f-4d30-98cd-af0e2583fb5f tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:38.129194 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea8a4e0f-d27f-4d30-98cd-af0e2583fb5f tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:38.134671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea8a4e0f-d27f-4d30-98cd-af0e2583fb5f tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:38.379233 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ea8a4e0f-d27f-4d30-98cd-af0e2583fb5f tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d798bffa944169b1ba0b6042698374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38653c7bc12485ba8d0de49f2db2820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:38.398235 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ea8a4e0f-d27f-4d30-98cd-af0e2583fb5f tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86" status: 200 len: 1270 microversion: 2.1 time: 0.304702 Aug 24 10:26:38.398861 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1437/3246] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:38 2022] GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86 => generated 1270 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:38.411624 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ff9a7f50-627c-4146-a72d-aa926d58145c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:38.411624 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ff9a7f50-627c-4146-a72d-aa926d58145c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:38.411624 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff9a7f50-627c-4146-a72d-aa926d58145c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:38.412705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff9a7f50-627c-4146-a72d-aa926d58145c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:38.412705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff9a7f50-627c-4146-a72d-aa926d58145c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:38.413030 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff9a7f50-627c-4146-a72d-aa926d58145c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:38.413703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff9a7f50-627c-4146-a72d-aa926d58145c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:38.414298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff9a7f50-627c-4146-a72d-aa926d58145c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:38.607464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ad6e063a-967a-413c-b850-78a2054c7fea tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:38.622382 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ad6e063a-967a-413c-b850-78a2054c7fea tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1508 microversion: 2.1 time: 1.032883 Aug 24 10:26:38.626802 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1810/3247] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:37 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1508 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:38.630178 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ff9a7f50-627c-4146-a72d-aa926d58145c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:38.638914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a8f68195-4722-4c9e-a3d7-a467324c16ef tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:38.640944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a8f68195-4722-4c9e-a3d7-a467324c16ef tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] [instance: 60157d13-f95a-4362-8ed2-2f9eb878bf81] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:38.645824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ff9a7f50-627c-4146-a72d-aa926d58145c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:38.651801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ff9a7f50-627c-4146-a72d-aa926d58145c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:38.653377 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ff9a7f50-627c-4146-a72d-aa926d58145c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1592 microversion: 2.42 time: 0.253488 Aug 24 10:26:38.656339 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1438/3248] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:26:38 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1592 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:26:38.661307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8f68195-4722-4c9e-a3d7-a467324c16ef tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:38.669747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8f68195-4722-4c9e-a3d7-a467324c16ef tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:38.670488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8f68195-4722-4c9e-a3d7-a467324c16ef tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:38.671349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8f68195-4722-4c9e-a3d7-a467324c16ef tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:38.672033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8f68195-4722-4c9e-a3d7-a467324c16ef tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:38.672491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8f68195-4722-4c9e-a3d7-a467324c16ef tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:38.976646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a8f68195-4722-4c9e-a3d7-a467324c16ef tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539d440d00964721bbe156236eaff442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9786b6d72ea4462ae31882e65d377b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:38.994820 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a8f68195-4722-4c9e-a3d7-a467324c16ef tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] 10.222.0.85 "GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81" status: 200 len: 1267 microversion: 2.1 time: 0.366543 Aug 24 10:26:39.015900 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1811/3249] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:38 2022] GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81 => generated 1267 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:39.115331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-79594e14-8b87-486c-8321-2946620dfa6e tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:39.116135 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-79594e14-8b87-486c-8321-2946620dfa6e tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:39.139470 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79594e14-8b87-486c-8321-2946620dfa6e tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:39.144860 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79594e14-8b87-486c-8321-2946620dfa6e tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:39.146085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79594e14-8b87-486c-8321-2946620dfa6e tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:39.154613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79594e14-8b87-486c-8321-2946620dfa6e tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:39.155729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79594e14-8b87-486c-8321-2946620dfa6e tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:39.156458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79594e14-8b87-486c-8321-2946620dfa6e tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:39.419284 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5301a84a-7c4d-4ca8-ae22-cef9ebd64f2a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:39.421506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5301a84a-7c4d-4ca8-ae22-cef9ebd64f2a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] [instance: 828b46b2-00a2-4e00-b2b7-bc20d0d34f86] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:39.448338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5301a84a-7c4d-4ca8-ae22-cef9ebd64f2a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:39.451678 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5301a84a-7c4d-4ca8-ae22-cef9ebd64f2a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:39.452690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5301a84a-7c4d-4ca8-ae22-cef9ebd64f2a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:39.453720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5301a84a-7c4d-4ca8-ae22-cef9ebd64f2a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:39.458596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5301a84a-7c4d-4ca8-ae22-cef9ebd64f2a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:39.459576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5301a84a-7c4d-4ca8-ae22-cef9ebd64f2a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:40.265773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-79594e14-8b87-486c-8321-2946620dfa6e tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:40.284706 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-79594e14-8b87-486c-8321-2946620dfa6e tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1506 microversion: 2.1 time: 1.175037 Aug 24 10:26:40.285393 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1439/3250] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:39 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1506 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:40.301355 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6ed81e1f-5328-49bd-b01e-9f73d85ba814 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:40.301931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6ed81e1f-5328-49bd-b01e-9f73d85ba814 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:40.311435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ed81e1f-5328-49bd-b01e-9f73d85ba814 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:40.312087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ed81e1f-5328-49bd-b01e-9f73d85ba814 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:40.312611 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ed81e1f-5328-49bd-b01e-9f73d85ba814 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:40.314100 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ed81e1f-5328-49bd-b01e-9f73d85ba814 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:40.314658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ed81e1f-5328-49bd-b01e-9f73d85ba814 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:40.315360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ed81e1f-5328-49bd-b01e-9f73d85ba814 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:40.569607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5301a84a-7c4d-4ca8-ae22-cef9ebd64f2a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d798bffa944169b1ba0b6042698374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38653c7bc12485ba8d0de49f2db2820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:40.598804 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5301a84a-7c4d-4ca8-ae22-cef9ebd64f2a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86" status: 200 len: 1312 microversion: 2.1 time: 1.183789 Aug 24 10:26:40.599493 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1812/3251] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:39 2022] GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86 => generated 1312 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:26:40.605183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e5040c7b-1ee2-4245-a24c-ba3a399479c8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:40.606013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e5040c7b-1ee2-4245-a24c-ba3a399479c8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:40.612420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5040c7b-1ee2-4245-a24c-ba3a399479c8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:40.613152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5040c7b-1ee2-4245-a24c-ba3a399479c8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:40.616214 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5040c7b-1ee2-4245-a24c-ba3a399479c8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:40.618104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5040c7b-1ee2-4245-a24c-ba3a399479c8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:40.619430 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5040c7b-1ee2-4245-a24c-ba3a399479c8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:40.620030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5040c7b-1ee2-4245-a24c-ba3a399479c8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:40.841444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e5040c7b-1ee2-4245-a24c-ba3a399479c8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:40.868020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e5040c7b-1ee2-4245-a24c-ba3a399479c8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:40.869671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e5040c7b-1ee2-4245-a24c-ba3a399479c8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:40.881854 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e5040c7b-1ee2-4245-a24c-ba3a399479c8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1592 microversion: 2.42 time: 0.280743 Aug 24 10:26:40.887349 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1813/3252] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:26:40 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1592 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:26:40.892312 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8c92d180-239e-44d0-8d5f-b30ddeedaf46 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:40.906380 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8c92d180-239e-44d0-8d5f-b30ddeedaf46 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] [instance: 60157d13-f95a-4362-8ed2-2f9eb878bf81] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:40.934919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c92d180-239e-44d0-8d5f-b30ddeedaf46 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:40.935422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c92d180-239e-44d0-8d5f-b30ddeedaf46 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:40.935861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c92d180-239e-44d0-8d5f-b30ddeedaf46 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:40.936578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c92d180-239e-44d0-8d5f-b30ddeedaf46 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:40.940880 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c92d180-239e-44d0-8d5f-b30ddeedaf46 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:40.941377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c92d180-239e-44d0-8d5f-b30ddeedaf46 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:41.286053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8c92d180-239e-44d0-8d5f-b30ddeedaf46 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539d440d00964721bbe156236eaff442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9786b6d72ea4462ae31882e65d377b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:41.294288 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8c92d180-239e-44d0-8d5f-b30ddeedaf46 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] 10.222.0.85 "GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81" status: 200 len: 1273 microversion: 2.1 time: 0.405567 Aug 24 10:26:41.295085 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1814/3253] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:40 2022] GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81 => generated 1273 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:41.312705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b5e19bb3-43e7-467a-ab20-cc6e3af6f6fc tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:41.314070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b5e19bb3-43e7-467a-ab20-cc6e3af6f6fc tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:41.342988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5e19bb3-43e7-467a-ab20-cc6e3af6f6fc tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:41.345425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5e19bb3-43e7-467a-ab20-cc6e3af6f6fc tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:41.352049 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5e19bb3-43e7-467a-ab20-cc6e3af6f6fc tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:41.354215 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5e19bb3-43e7-467a-ab20-cc6e3af6f6fc tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:41.355826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5e19bb3-43e7-467a-ab20-cc6e3af6f6fc tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:41.357629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5e19bb3-43e7-467a-ab20-cc6e3af6f6fc tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:41.474246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6ed81e1f-5328-49bd-b01e-9f73d85ba814 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:41.484078 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6ed81e1f-5328-49bd-b01e-9f73d85ba814 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1529 microversion: 2.1 time: 1.197256 Aug 24 10:26:41.504013 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1440/3254] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:40 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1529 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:41.619432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a1053b19-2aef-4a89-a6ad-d9570ff4bd8a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:41.620327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a1053b19-2aef-4a89-a6ad-d9570ff4bd8a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] [instance: 828b46b2-00a2-4e00-b2b7-bc20d0d34f86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:41.628785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1053b19-2aef-4a89-a6ad-d9570ff4bd8a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:41.631816 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1053b19-2aef-4a89-a6ad-d9570ff4bd8a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:41.633627 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1053b19-2aef-4a89-a6ad-d9570ff4bd8a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:41.649621 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1053b19-2aef-4a89-a6ad-d9570ff4bd8a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:41.650697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1053b19-2aef-4a89-a6ad-d9570ff4bd8a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:41.651760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1053b19-2aef-4a89-a6ad-d9570ff4bd8a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:41.882125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b5e19bb3-43e7-467a-ab20-cc6e3af6f6fc tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:41.891672 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b5e19bb3-43e7-467a-ab20-cc6e3af6f6fc tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1486 microversion: 2.1 time: 0.582979 Aug 24 10:26:41.901515 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1815/3255] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:41 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1486 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:41.915550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c898286c-2daf-406a-b95f-8a10ac5f6416 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:41.916554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c898286c-2daf-406a-b95f-8a10ac5f6416 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:41.927004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c898286c-2daf-406a-b95f-8a10ac5f6416 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:41.927500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c898286c-2daf-406a-b95f-8a10ac5f6416 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:41.927937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c898286c-2daf-406a-b95f-8a10ac5f6416 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:41.929409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c898286c-2daf-406a-b95f-8a10ac5f6416 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:41.943082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c898286c-2daf-406a-b95f-8a10ac5f6416 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:41.945035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c898286c-2daf-406a-b95f-8a10ac5f6416 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:42.122445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a1053b19-2aef-4a89-a6ad-d9570ff4bd8a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d798bffa944169b1ba0b6042698374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38653c7bc12485ba8d0de49f2db2820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:42.130681 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a1053b19-2aef-4a89-a6ad-d9570ff4bd8a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86" status: 200 len: 1312 microversion: 2.1 time: 0.515403 Aug 24 10:26:42.148101 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1441/3256] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:41 2022] GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86 => generated 1312 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:26:42.153491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d4399e45-aae8-4eb6-a699-0238f384477a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:42.154041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d4399e45-aae8-4eb6-a699-0238f384477a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:42.172712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4399e45-aae8-4eb6-a699-0238f384477a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:42.173264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4399e45-aae8-4eb6-a699-0238f384477a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:42.173713 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4399e45-aae8-4eb6-a699-0238f384477a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:42.174450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4399e45-aae8-4eb6-a699-0238f384477a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:42.174910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4399e45-aae8-4eb6-a699-0238f384477a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:42.181661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4399e45-aae8-4eb6-a699-0238f384477a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:42.232430 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c898286c-2daf-406a-b95f-8a10ac5f6416 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:42.267290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c898286c-2daf-406a-b95f-8a10ac5f6416 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:42.268955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c898286c-2daf-406a-b95f-8a10ac5f6416 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:42.277573 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c898286c-2daf-406a-b95f-8a10ac5f6416 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1592 microversion: 2.42 time: 0.365687 Aug 24 10:26:42.280465 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1816/3257] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:26:41 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1592 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:26:42.333976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-73a2dd0b-0744-4152-b0ec-647f2a97704e tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:42.340425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-73a2dd0b-0744-4152-b0ec-647f2a97704e tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] [instance: 60157d13-f95a-4362-8ed2-2f9eb878bf81] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:42.353152 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d4399e45-aae8-4eb6-a699-0238f384477a tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "POST /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d/action" status: 202 len: 0 microversion: 2.1 time: 0.203556 Aug 24 10:26:42.357334 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1442/3258] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:26:42 2022] POST /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:26:42.363450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-090ecbd0-f721-469d-96fb-bd63ecd24716 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:42.368209 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-090ecbd0-f721-469d-96fb-bd63ecd24716 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:42.368447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73a2dd0b-0744-4152-b0ec-647f2a97704e tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:42.368731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73a2dd0b-0744-4152-b0ec-647f2a97704e tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:42.370462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73a2dd0b-0744-4152-b0ec-647f2a97704e tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:42.373918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73a2dd0b-0744-4152-b0ec-647f2a97704e tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:42.374624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73a2dd0b-0744-4152-b0ec-647f2a97704e tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:42.375382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73a2dd0b-0744-4152-b0ec-647f2a97704e tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:42.393513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-090ecbd0-f721-469d-96fb-bd63ecd24716 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:42.394484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-090ecbd0-f721-469d-96fb-bd63ecd24716 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:42.394941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-090ecbd0-f721-469d-96fb-bd63ecd24716 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:42.395677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-090ecbd0-f721-469d-96fb-bd63ecd24716 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:42.396136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-090ecbd0-f721-469d-96fb-bd63ecd24716 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:42.396571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-090ecbd0-f721-469d-96fb-bd63ecd24716 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:43.030940 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-73a2dd0b-0744-4152-b0ec-647f2a97704e tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539d440d00964721bbe156236eaff442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9786b6d72ea4462ae31882e65d377b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:43.043120 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-73a2dd0b-0744-4152-b0ec-647f2a97704e tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] 10.222.0.85 "GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81" status: 200 len: 1273 microversion: 2.1 time: 0.715898 Aug 24 10:26:43.059650 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1817/3259] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:42 2022] GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81 => generated 1273 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:26:43.069085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-062b966b-80d9-4dfd-95a3-eba45c6c5b2e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:43.071330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-062b966b-80d9-4dfd-95a3-eba45c6c5b2e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:43.082661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-090ecbd0-f721-469d-96fb-bd63ecd24716 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:43.092177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062b966b-80d9-4dfd-95a3-eba45c6c5b2e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:43.097186 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-090ecbd0-f721-469d-96fb-bd63ecd24716 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1494 microversion: 2.1 time: 0.735286 Aug 24 10:26:43.098941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062b966b-80d9-4dfd-95a3-eba45c6c5b2e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:43.099586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062b966b-80d9-4dfd-95a3-eba45c6c5b2e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:43.101626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062b966b-80d9-4dfd-95a3-eba45c6c5b2e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:43.107197 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062b966b-80d9-4dfd-95a3-eba45c6c5b2e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:43.107973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062b966b-80d9-4dfd-95a3-eba45c6c5b2e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:43.110863 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1443/3260] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:42 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1494 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:43.156649 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e4f92b6d-2fc3-4e71-be28-699b5f908d41 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:43.157607 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e4f92b6d-2fc3-4e71-be28-699b5f908d41 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] [instance: 828b46b2-00a2-4e00-b2b7-bc20d0d34f86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:43.173986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4f92b6d-2fc3-4e71-be28-699b5f908d41 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:43.175243 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4f92b6d-2fc3-4e71-be28-699b5f908d41 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:43.175915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4f92b6d-2fc3-4e71-be28-699b5f908d41 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:43.178752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4f92b6d-2fc3-4e71-be28-699b5f908d41 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:43.180529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4f92b6d-2fc3-4e71-be28-699b5f908d41 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:43.183759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4f92b6d-2fc3-4e71-be28-699b5f908d41 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:44.486007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:44.497304 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e4f92b6d-2fc3-4e71-be28-699b5f908d41 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d798bffa944169b1ba0b6042698374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38653c7bc12485ba8d0de49f2db2820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:44.520644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-062b966b-80d9-4dfd-95a3-eba45c6c5b2e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:44.531488 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e4f92b6d-2fc3-4e71-be28-699b5f908d41 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86" status: 200 len: 1312 microversion: 2.1 time: 1.371552 Aug 24 10:26:44.532173 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1444/3261] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:43 2022] GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86 => generated 1312 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:44.534333 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-062b966b-80d9-4dfd-95a3-eba45c6c5b2e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1524 microversion: 2.1 time: 1.473112 Aug 24 10:26:44.544014 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1818/3262] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:43 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1524 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:44.558596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a4c423ac-cf4f-403e-86a0-7f0ea7c74ba6 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:44.561853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a4c423ac-cf4f-403e-86a0-7f0ea7c74ba6 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] [instance: 60157d13-f95a-4362-8ed2-2f9eb878bf81] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:44.580907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4c423ac-cf4f-403e-86a0-7f0ea7c74ba6 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:44.587964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4c423ac-cf4f-403e-86a0-7f0ea7c74ba6 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:44.588745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4c423ac-cf4f-403e-86a0-7f0ea7c74ba6 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:44.589720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4c423ac-cf4f-403e-86a0-7f0ea7c74ba6 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:44.598768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4c423ac-cf4f-403e-86a0-7f0ea7c74ba6 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:44.600501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4c423ac-cf4f-403e-86a0-7f0ea7c74ba6 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:44.601877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-029c9685-bc6f-4431-9e25-d5f3fb242c19 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:44.612873 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-029c9685-bc6f-4431-9e25-d5f3fb242c19 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:44.623953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-029c9685-bc6f-4431-9e25-d5f3fb242c19 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:44.624918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-029c9685-bc6f-4431-9e25-d5f3fb242c19 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:44.629740 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-029c9685-bc6f-4431-9e25-d5f3fb242c19 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:44.632469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-029c9685-bc6f-4431-9e25-d5f3fb242c19 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:44.633394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-029c9685-bc6f-4431-9e25-d5f3fb242c19 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:44.643129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-029c9685-bc6f-4431-9e25-d5f3fb242c19 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:45.176822 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-029c9685-bc6f-4431-9e25-d5f3fb242c19 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:45.212759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-029c9685-bc6f-4431-9e25-d5f3fb242c19 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:45.219830 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a4c423ac-cf4f-403e-86a0-7f0ea7c74ba6 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539d440d00964721bbe156236eaff442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9786b6d72ea4462ae31882e65d377b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:45.229740 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-029c9685-bc6f-4431-9e25-d5f3fb242c19 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:45.233334 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-029c9685-bc6f-4431-9e25-d5f3fb242c19 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1660 microversion: 2.42 time: 0.699934 Aug 24 10:26:45.233781 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a4c423ac-cf4f-403e-86a0-7f0ea7c74ba6 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] 10.222.0.85 "GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81" status: 200 len: 1315 microversion: 2.1 time: 0.686076 Aug 24 10:26:45.234937 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1819/3263] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:44 2022] GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81 => generated 1315 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:45.248167 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1445/3264] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:26:44 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1660 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:26:45.250822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1a4b5b2a-f6d4-4a64-a07a-fa935d6badb0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:45.253446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1a4b5b2a-f6d4-4a64-a07a-fa935d6badb0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:45.257551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-55519adf-7caf-4e76-a12c-7376def6f093 req-3b1d657b-4a77-496c-9760-36d48855b15b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "828b46b2-00a2-4e00-b2b7-bc20d0d34f86", "tag": "81b8f2a2-ab6f-4ad9-8a87-e10bf589770b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:45.266219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a4b5b2a-f6d4-4a64-a07a-fa935d6badb0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:45.267814 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a4b5b2a-f6d4-4a64-a07a-fa935d6badb0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:45.271855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a4b5b2a-f6d4-4a64-a07a-fa935d6badb0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:45.272886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a4b5b2a-f6d4-4a64-a07a-fa935d6badb0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:45.273618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a4b5b2a-f6d4-4a64-a07a-fa935d6badb0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:45.274218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a4b5b2a-f6d4-4a64-a07a-fa935d6badb0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:45.308629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-55519adf-7caf-4e76-a12c-7376def6f093 req-3b1d657b-4a77-496c-9760-36d48855b15b service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:45.317956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-55519adf-7caf-4e76-a12c-7376def6f093 req-3b1d657b-4a77-496c-9760-36d48855b15b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:45.323809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-55519adf-7caf-4e76-a12c-7376def6f093 req-3b1d657b-4a77-496c-9760-36d48855b15b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:45.386106 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-55519adf-7caf-4e76-a12c-7376def6f093 req-3b1d657b-4a77-496c-9760-36d48855b15b service nova] Creating event network-changed:81b8f2a2-ab6f-4ad9-8a87-e10bf589770b for instance 828b46b2-00a2-4e00-b2b7-bc20d0d34f86 on n-h2-849328-3 Aug 24 10:26:45.391758 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-55519adf-7caf-4e76-a12c-7376def6f093 req-3b1d657b-4a77-496c-9760-36d48855b15b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138113 Aug 24 10:26:45.393549 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1446/3265] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:45.559342 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0dcb907d-c1c1-43fd-bf74-09ffa6781c2b tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:45.560214 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0dcb907d-c1c1-43fd-bf74-09ffa6781c2b tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] [instance: 828b46b2-00a2-4e00-b2b7-bc20d0d34f86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:45.571462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dcb907d-c1c1-43fd-bf74-09ffa6781c2b tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:45.573629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dcb907d-c1c1-43fd-bf74-09ffa6781c2b tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:45.574338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dcb907d-c1c1-43fd-bf74-09ffa6781c2b tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:45.575138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dcb907d-c1c1-43fd-bf74-09ffa6781c2b tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:45.588020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dcb907d-c1c1-43fd-bf74-09ffa6781c2b tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:45.588903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dcb907d-c1c1-43fd-bf74-09ffa6781c2b tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:46.277634 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1a4b5b2a-f6d4-4a64-a07a-fa935d6badb0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:46.289592 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1a4b5b2a-f6d4-4a64-a07a-fa935d6badb0 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1494 microversion: 2.1 time: 1.053291 Aug 24 10:26:46.291390 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1820/3266] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:45 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1494 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:46.309579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-43de4bea-7952-44e8-a2c0-cb2492209fc7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:46.310758 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-43de4bea-7952-44e8-a2c0-cb2492209fc7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:46.322512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43de4bea-7952-44e8-a2c0-cb2492209fc7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:46.325669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43de4bea-7952-44e8-a2c0-cb2492209fc7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:46.326475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43de4bea-7952-44e8-a2c0-cb2492209fc7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:46.327538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43de4bea-7952-44e8-a2c0-cb2492209fc7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:46.331280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43de4bea-7952-44e8-a2c0-cb2492209fc7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:46.333781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43de4bea-7952-44e8-a2c0-cb2492209fc7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:46.778642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:46.940489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0dcb907d-c1c1-43fd-bf74-09ffa6781c2b tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d798bffa944169b1ba0b6042698374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38653c7bc12485ba8d0de49f2db2820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:46.957344 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0dcb907d-c1c1-43fd-bf74-09ffa6781c2b tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86" status: 200 len: 1312 microversion: 2.1 time: 1.403071 Aug 24 10:26:46.960332 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1447/3267] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:45 2022] GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86 => generated 1312 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:26:46.976149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-946d54d8-db46-41c6-a886-365e67278fe0 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:46.979825 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-946d54d8-db46-41c6-a886-365e67278fe0 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] [instance: 60157d13-f95a-4362-8ed2-2f9eb878bf81] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:46.998736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-946d54d8-db46-41c6-a886-365e67278fe0 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:46.999403 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-946d54d8-db46-41c6-a886-365e67278fe0 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:46.999952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-946d54d8-db46-41c6-a886-365e67278fe0 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:47.000967 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-946d54d8-db46-41c6-a886-365e67278fe0 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:47.001550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-946d54d8-db46-41c6-a886-365e67278fe0 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:47.002231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-946d54d8-db46-41c6-a886-365e67278fe0 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:47.168641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:47.275500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=64 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:47.834268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-43de4bea-7952-44e8-a2c0-cb2492209fc7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:47.875780 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-43de4bea-7952-44e8-a2c0-cb2492209fc7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1524 microversion: 2.1 time: 1.582418 Aug 24 10:26:47.888970 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1821/3268] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:46 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1524 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:47.930528 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3e572776-6a7c-47c5-a570-96374f4bb2b7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:47.935063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3e572776-6a7c-47c5-a570-96374f4bb2b7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:47.963824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e572776-6a7c-47c5-a570-96374f4bb2b7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:47.978207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e572776-6a7c-47c5-a570-96374f4bb2b7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:47.981697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e572776-6a7c-47c5-a570-96374f4bb2b7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:47.985852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e572776-6a7c-47c5-a570-96374f4bb2b7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:47.989061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e572776-6a7c-47c5-a570-96374f4bb2b7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:47.993252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e572776-6a7c-47c5-a570-96374f4bb2b7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:48.049309 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:48.692754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3e572776-6a7c-47c5-a570-96374f4bb2b7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:48.710082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3e572776-6a7c-47c5-a570-96374f4bb2b7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:48.713308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3e572776-6a7c-47c5-a570-96374f4bb2b7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:48.714565 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3e572776-6a7c-47c5-a570-96374f4bb2b7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1707 microversion: 2.42 time: 0.823941 Aug 24 10:26:48.719027 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1822/3269] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:26:47 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1707 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:26:48.733763 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4a92aa6b-430b-4e79-9ec9-9753fbe563e2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:48.734425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4a92aa6b-430b-4e79-9ec9-9753fbe563e2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:48.753667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a92aa6b-430b-4e79-9ec9-9753fbe563e2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:48.755346 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a92aa6b-430b-4e79-9ec9-9753fbe563e2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:48.755830 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a92aa6b-430b-4e79-9ec9-9753fbe563e2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:48.758139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a92aa6b-430b-4e79-9ec9-9753fbe563e2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:48.759019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a92aa6b-430b-4e79-9ec9-9753fbe563e2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:48.762769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a92aa6b-430b-4e79-9ec9-9753fbe563e2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:49.167223 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-946d54d8-db46-41c6-a886-365e67278fe0 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539d440d00964721bbe156236eaff442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9786b6d72ea4462ae31882e65d377b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:49.171440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:49.217968 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-946d54d8-db46-41c6-a886-365e67278fe0 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] 10.222.0.85 "GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81" status: 200 len: 1315 microversion: 2.1 time: 2.256288 Aug 24 10:26:49.222547 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1448/3270] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:46 2022] GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81 => generated 1315 bytes in 2261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:49.236995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6211d77a-7430-47af-a13a-8b25c651ee18 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:49.237663 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6211d77a-7430-47af-a13a-8b25c651ee18 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] [instance: 828b46b2-00a2-4e00-b2b7-bc20d0d34f86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:49.257317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6211d77a-7430-47af-a13a-8b25c651ee18 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:49.258150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6211d77a-7430-47af-a13a-8b25c651ee18 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:49.258450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6211d77a-7430-47af-a13a-8b25c651ee18 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:49.259198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6211d77a-7430-47af-a13a-8b25c651ee18 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:49.259666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6211d77a-7430-47af-a13a-8b25c651ee18 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:49.260104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6211d77a-7430-47af-a13a-8b25c651ee18 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:49.616185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4a92aa6b-430b-4e79-9ec9-9753fbe563e2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:49.632244 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4a92aa6b-430b-4e79-9ec9-9753fbe563e2 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1494 microversion: 2.1 time: 0.906192 Aug 24 10:26:49.634838 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1823/3271] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:48 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1494 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:49.966142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-856d9a61-f767-40a3-a9c6-e219104951e8 req-7f95d3e1-31df-4694-a860-5ba7b71c98ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fdab911-592d-4d21-9420-fdadfea05875", "name": "network-vif-plugged", "status": "completed", "tag": "32431dd4-4f50-43ba-b6d9-cd4dc40210f9"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:50.002873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-856d9a61-f767-40a3-a9c6-e219104951e8 req-7f95d3e1-31df-4694-a860-5ba7b71c98ab service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:50.003914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-856d9a61-f767-40a3-a9c6-e219104951e8 req-7f95d3e1-31df-4694-a860-5ba7b71c98ab service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:50.008098 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-856d9a61-f767-40a3-a9c6-e219104951e8 req-7f95d3e1-31df-4694-a860-5ba7b71c98ab service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:50.049605 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-856d9a61-f767-40a3-a9c6-e219104951e8 req-7f95d3e1-31df-4694-a860-5ba7b71c98ab service nova] Creating event network-vif-plugged:32431dd4-4f50-43ba-b6d9-cd4dc40210f9 for instance 0fdab911-592d-4d21-9420-fdadfea05875 on n-h1-849328-3 Aug 24 10:26:50.067005 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-856d9a61-f767-40a3-a9c6-e219104951e8 req-7f95d3e1-31df-4694-a860-5ba7b71c98ab service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.429243 Aug 24 10:26:50.069558 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1824/3272] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:50.090217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4e9f6a6a-d3d4-4dc4-862a-95c98d15844c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:50.091625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4e9f6a6a-d3d4-4dc4-862a-95c98d15844c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:50.108893 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e9f6a6a-d3d4-4dc4-862a-95c98d15844c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:50.117590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e9f6a6a-d3d4-4dc4-862a-95c98d15844c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:50.118195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e9f6a6a-d3d4-4dc4-862a-95c98d15844c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:50.118991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e9f6a6a-d3d4-4dc4-862a-95c98d15844c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:50.119482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e9f6a6a-d3d4-4dc4-862a-95c98d15844c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:50.119919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e9f6a6a-d3d4-4dc4-862a-95c98d15844c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:50.223715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6211d77a-7430-47af-a13a-8b25c651ee18 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d798bffa944169b1ba0b6042698374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38653c7bc12485ba8d0de49f2db2820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:50.232933 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6211d77a-7430-47af-a13a-8b25c651ee18 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86" status: 200 len: 1312 microversion: 2.1 time: 1.009069 Aug 24 10:26:50.249416 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1449/3273] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:49 2022] GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86 => generated 1312 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:50.273729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9cd4c740-fb57-41c8-a4c1-3b35766d2154 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:50.274426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9cd4c740-fb57-41c8-a4c1-3b35766d2154 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:50.295065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9cd4c740-fb57-41c8-a4c1-3b35766d2154 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:50.295577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9cd4c740-fb57-41c8-a4c1-3b35766d2154 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:50.296023 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9cd4c740-fb57-41c8-a4c1-3b35766d2154 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:50.296831 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9cd4c740-fb57-41c8-a4c1-3b35766d2154 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:50.305901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9cd4c740-fb57-41c8-a4c1-3b35766d2154 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:50.306826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9cd4c740-fb57-41c8-a4c1-3b35766d2154 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:51.318294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4e9f6a6a-d3d4-4dc4-862a-95c98d15844c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:51.332055 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4e9f6a6a-d3d4-4dc4-862a-95c98d15844c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1524 microversion: 2.1 time: 1.259192 Aug 24 10:26:51.346502 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1825/3274] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:50 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1524 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:51.363868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0c0a8cfe-6cfe-4246-aa96-2dc8a00e56ca req-23a773a6-b517-4e4a-b3aa-d39b72d179ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60157d13-f95a-4362-8ed2-2f9eb878bf81", "tag": "603d0568-5332-4e02-853c-c7a9c7e74d4b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:51.374014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0c0a8cfe-6cfe-4246-aa96-2dc8a00e56ca req-23a773a6-b517-4e4a-b3aa-d39b72d179ac service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:51.374508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0c0a8cfe-6cfe-4246-aa96-2dc8a00e56ca req-23a773a6-b517-4e4a-b3aa-d39b72d179ac service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:51.374950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0c0a8cfe-6cfe-4246-aa96-2dc8a00e56ca req-23a773a6-b517-4e4a-b3aa-d39b72d179ac service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:51.402338 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0c0a8cfe-6cfe-4246-aa96-2dc8a00e56ca req-23a773a6-b517-4e4a-b3aa-d39b72d179ac service nova] Creating event network-changed:603d0568-5332-4e02-853c-c7a9c7e74d4b for instance 60157d13-f95a-4362-8ed2-2f9eb878bf81 on n-h1-849328-3 Aug 24 10:26:51.413984 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0c0a8cfe-6cfe-4246-aa96-2dc8a00e56ca req-23a773a6-b517-4e4a-b3aa-d39b72d179ac service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065858 Aug 24 10:26:51.414806 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1826/3275] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:51.420187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f3c5811a-6924-4650-a967-053e0a22fe0b tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:51.429830 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f3c5811a-6924-4650-a967-053e0a22fe0b tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] [instance: 60157d13-f95a-4362-8ed2-2f9eb878bf81] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:51.442083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3c5811a-6924-4650-a967-053e0a22fe0b tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:51.442615 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3c5811a-6924-4650-a967-053e0a22fe0b tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:51.443058 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3c5811a-6924-4650-a967-053e0a22fe0b tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:51.443788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3c5811a-6924-4650-a967-053e0a22fe0b tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:51.444250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3c5811a-6924-4650-a967-053e0a22fe0b tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:51.444685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3c5811a-6924-4650-a967-053e0a22fe0b tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:51.730115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9cd4c740-fb57-41c8-a4c1-3b35766d2154 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:51.740459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9cd4c740-fb57-41c8-a4c1-3b35766d2154 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:51.749555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9cd4c740-fb57-41c8-a4c1-3b35766d2154 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:51.751048 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9cd4c740-fb57-41c8-a4c1-3b35766d2154 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1707 microversion: 2.42 time: 1.500387 Aug 24 10:26:51.765969 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1450/3276] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:26:50 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1707 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:26:51.776386 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-460df031-d716-4ce8-98ed-e624d081c0ea tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:51.782391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-460df031-d716-4ce8-98ed-e624d081c0ea tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:51.802040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-460df031-d716-4ce8-98ed-e624d081c0ea tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:51.803779 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-460df031-d716-4ce8-98ed-e624d081c0ea tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:51.804512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-460df031-d716-4ce8-98ed-e624d081c0ea tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:51.806522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-460df031-d716-4ce8-98ed-e624d081c0ea tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:51.807306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-460df031-d716-4ce8-98ed-e624d081c0ea tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:51.808029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-460df031-d716-4ce8-98ed-e624d081c0ea tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:52.231889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f3c5811a-6924-4650-a967-053e0a22fe0b tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539d440d00964721bbe156236eaff442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9786b6d72ea4462ae31882e65d377b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:52.242781 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f3c5811a-6924-4650-a967-053e0a22fe0b tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] 10.222.0.85 "GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81" status: 200 len: 1315 microversion: 2.1 time: 0.825121 Aug 24 10:26:52.261562 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1827/3277] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:51 2022] GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81 => generated 1315 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:52.277436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-65dd06eb-70cc-43e6-a60f-99772c5686a0 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:52.278639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-65dd06eb-70cc-43e6-a60f-99772c5686a0 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] [instance: 828b46b2-00a2-4e00-b2b7-bc20d0d34f86] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:52.290030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65dd06eb-70cc-43e6-a60f-99772c5686a0 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:52.290538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65dd06eb-70cc-43e6-a60f-99772c5686a0 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:52.290990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65dd06eb-70cc-43e6-a60f-99772c5686a0 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:52.291715 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65dd06eb-70cc-43e6-a60f-99772c5686a0 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:52.292182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65dd06eb-70cc-43e6-a60f-99772c5686a0 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:52.292618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65dd06eb-70cc-43e6-a60f-99772c5686a0 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:52.343508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-460df031-d716-4ce8-98ed-e624d081c0ea tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:52.353656 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-460df031-d716-4ce8-98ed-e624d081c0ea tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1500 microversion: 2.1 time: 0.586134 Aug 24 10:26:52.364221 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1451/3278] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:51 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1500 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:52.372460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-682e51a5-3057-4ac5-acca-4579c8904f4c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:52.385082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-682e51a5-3057-4ac5-acca-4579c8904f4c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:52.412167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-682e51a5-3057-4ac5-acca-4579c8904f4c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:52.416028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-682e51a5-3057-4ac5-acca-4579c8904f4c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:52.419621 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-682e51a5-3057-4ac5-acca-4579c8904f4c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:52.424559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-682e51a5-3057-4ac5-acca-4579c8904f4c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:52.429438 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-682e51a5-3057-4ac5-acca-4579c8904f4c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:52.437880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-682e51a5-3057-4ac5-acca-4579c8904f4c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:52.954040 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-65dd06eb-70cc-43e6-a60f-99772c5686a0 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d798bffa944169b1ba0b6042698374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38653c7bc12485ba8d0de49f2db2820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:52.962611 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-65dd06eb-70cc-43e6-a60f-99772c5686a0 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86" status: 200 len: 1312 microversion: 2.1 time: 0.697956 Aug 24 10:26:52.976825 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1828/3279] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:52 2022] GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86 => generated 1312 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:52.984912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-132aed8d-c797-4c16-9bd2-60f56b99d412 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:53.003614 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-132aed8d-c797-4c16-9bd2-60f56b99d412 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:53.028923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-132aed8d-c797-4c16-9bd2-60f56b99d412 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:53.032703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-132aed8d-c797-4c16-9bd2-60f56b99d412 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:53.035560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-132aed8d-c797-4c16-9bd2-60f56b99d412 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:53.037995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-132aed8d-c797-4c16-9bd2-60f56b99d412 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:53.041278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-132aed8d-c797-4c16-9bd2-60f56b99d412 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:53.042624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-132aed8d-c797-4c16-9bd2-60f56b99d412 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:53.127509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-132aed8d-c797-4c16-9bd2-60f56b99d412 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:26:53.383999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:53.392456 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-132aed8d-c797-4c16-9bd2-60f56b99d412 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "DELETE /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 204 len: 0 microversion: 2.1 time: 0.414085 Aug 24 10:26:53.395237 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1829/3280] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:26:52 2022] DELETE /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:26:53.407128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-31792e37-0041-4b2f-8b54-780612f24d09 req-5fd918e6-ad49-4d49-8e70-77e76184f211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "828b46b2-00a2-4e00-b2b7-bc20d0d34f86", "name": "network-vif-plugged", "status": "completed", "tag": "81b8f2a2-ab6f-4ad9-8a87-e10bf589770b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:53.434150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-31792e37-0041-4b2f-8b54-780612f24d09 req-5fd918e6-ad49-4d49-8e70-77e76184f211 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:53.434851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-31792e37-0041-4b2f-8b54-780612f24d09 req-5fd918e6-ad49-4d49-8e70-77e76184f211 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:53.437698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-31792e37-0041-4b2f-8b54-780612f24d09 req-5fd918e6-ad49-4d49-8e70-77e76184f211 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:53.468990 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-31792e37-0041-4b2f-8b54-780612f24d09 req-5fd918e6-ad49-4d49-8e70-77e76184f211 service nova] Creating event network-vif-plugged:81b8f2a2-ab6f-4ad9-8a87-e10bf589770b for instance 828b46b2-00a2-4e00-b2b7-bc20d0d34f86 on n-h2-849328-3 Aug 24 10:26:53.479652 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-31792e37-0041-4b2f-8b54-780612f24d09 req-5fd918e6-ad49-4d49-8e70-77e76184f211 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080473 Aug 24 10:26:53.481868 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1830/3281] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:53.511035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-328bfbf1-58f9-45a7-989d-14fb7b56ddbf tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:53.511782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-328bfbf1-58f9-45a7-989d-14fb7b56ddbf tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:53.545039 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-328bfbf1-58f9-45a7-989d-14fb7b56ddbf tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:53.545572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-328bfbf1-58f9-45a7-989d-14fb7b56ddbf tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:53.552194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-328bfbf1-58f9-45a7-989d-14fb7b56ddbf tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:53.558187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-328bfbf1-58f9-45a7-989d-14fb7b56ddbf tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:53.558780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-328bfbf1-58f9-45a7-989d-14fb7b56ddbf tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:53.560568 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-328bfbf1-58f9-45a7-989d-14fb7b56ddbf tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:54.000653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-682e51a5-3057-4ac5-acca-4579c8904f4c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:54.016515 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-682e51a5-3057-4ac5-acca-4579c8904f4c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1524 microversion: 2.1 time: 1.642267 Aug 24 10:26:54.030760 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1452/3282] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:52 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1524 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:54.053670 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b4d33f17-21b6-457c-b319-d1c6bf28f4fe tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:54.057737 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b4d33f17-21b6-457c-b319-d1c6bf28f4fe tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] [instance: 60157d13-f95a-4362-8ed2-2f9eb878bf81] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:54.080873 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4d33f17-21b6-457c-b319-d1c6bf28f4fe tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:54.085605 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4d33f17-21b6-457c-b319-d1c6bf28f4fe tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:54.086443 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4d33f17-21b6-457c-b319-d1c6bf28f4fe tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:54.088519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4d33f17-21b6-457c-b319-d1c6bf28f4fe tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:54.094678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4d33f17-21b6-457c-b319-d1c6bf28f4fe tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:54.100781 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4d33f17-21b6-457c-b319-d1c6bf28f4fe tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:54.121566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-328bfbf1-58f9-45a7-989d-14fb7b56ddbf tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:54.136497 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-328bfbf1-58f9-45a7-989d-14fb7b56ddbf tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:54.140997 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-328bfbf1-58f9-45a7-989d-14fb7b56ddbf tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:54.144210 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-328bfbf1-58f9-45a7-989d-14fb7b56ddbf tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1754 microversion: 2.42 time: 0.660896 Aug 24 10:26:54.148948 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1831/3283] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:26:53 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1754 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:26:54.170806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e2b70644-c9d2-4aa3-bf1b-44aae5fe59b7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:54.172877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e2b70644-c9d2-4aa3-bf1b-44aae5fe59b7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:54.193587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2b70644-c9d2-4aa3-bf1b-44aae5fe59b7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:54.196452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2b70644-c9d2-4aa3-bf1b-44aae5fe59b7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:54.197326 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2b70644-c9d2-4aa3-bf1b-44aae5fe59b7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:54.200144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2b70644-c9d2-4aa3-bf1b-44aae5fe59b7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:54.201491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2b70644-c9d2-4aa3-bf1b-44aae5fe59b7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:54.203670 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2b70644-c9d2-4aa3-bf1b-44aae5fe59b7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:55.203369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e2b70644-c9d2-4aa3-bf1b-44aae5fe59b7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:55.226468 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e2b70644-c9d2-4aa3-bf1b-44aae5fe59b7 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1506 microversion: 2.1 time: 1.075212 Aug 24 10:26:55.242802 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1832/3284] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:54 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1506 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:55.249612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-44a0ab39-b8e4-4a62-91ef-593432934943 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:55.250746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-44a0ab39-b8e4-4a62-91ef-593432934943 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] [instance: 828b46b2-00a2-4e00-b2b7-bc20d0d34f86] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:55.262577 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44a0ab39-b8e4-4a62-91ef-593432934943 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:55.264532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44a0ab39-b8e4-4a62-91ef-593432934943 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:55.265390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44a0ab39-b8e4-4a62-91ef-593432934943 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:55.266587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44a0ab39-b8e4-4a62-91ef-593432934943 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:55.267308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44a0ab39-b8e4-4a62-91ef-593432934943 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:55.267979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44a0ab39-b8e4-4a62-91ef-593432934943 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:55.620820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-44a0ab39-b8e4-4a62-91ef-593432934943 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d798bffa944169b1ba0b6042698374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38653c7bc12485ba8d0de49f2db2820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:55.629739 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-44a0ab39-b8e4-4a62-91ef-593432934943 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86" status: 200 len: 1312 microversion: 2.1 time: 0.385550 Aug 24 10:26:55.634690 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1833/3285] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:55 2022] GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86 => generated 1312 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:55.654515 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-152126c9-00ba-4921-8a63-c6c20e86fbe4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:55.655205 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-152126c9-00ba-4921-8a63-c6c20e86fbe4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:55.675702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-152126c9-00ba-4921-8a63-c6c20e86fbe4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:55.677387 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-152126c9-00ba-4921-8a63-c6c20e86fbe4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:55.680219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-152126c9-00ba-4921-8a63-c6c20e86fbe4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:55.681954 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-152126c9-00ba-4921-8a63-c6c20e86fbe4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:55.685346 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-152126c9-00ba-4921-8a63-c6c20e86fbe4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:55.686055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-152126c9-00ba-4921-8a63-c6c20e86fbe4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:55.737017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b4d33f17-21b6-457c-b319-d1c6bf28f4fe tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539d440d00964721bbe156236eaff442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9786b6d72ea4462ae31882e65d377b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:55.760035 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b4d33f17-21b6-457c-b319-d1c6bf28f4fe tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] 10.222.0.85 "GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81" status: 200 len: 1315 microversion: 2.1 time: 1.719350 Aug 24 10:26:55.764707 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1453/3286] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:54 2022] GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81 => generated 1315 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:55.787388 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-073eb97b-8b49-4055-bf35-0676f7cb0b3a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:55.794210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-073eb97b-8b49-4055-bf35-0676f7cb0b3a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:55.826794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-073eb97b-8b49-4055-bf35-0676f7cb0b3a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:55.827301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-073eb97b-8b49-4055-bf35-0676f7cb0b3a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:55.827746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-073eb97b-8b49-4055-bf35-0676f7cb0b3a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:55.831973 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-073eb97b-8b49-4055-bf35-0676f7cb0b3a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:55.836545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-073eb97b-8b49-4055-bf35-0676f7cb0b3a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:55.837360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-073eb97b-8b49-4055-bf35-0676f7cb0b3a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:57.525714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-073eb97b-8b49-4055-bf35-0676f7cb0b3a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:57.543148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-073eb97b-8b49-4055-bf35-0676f7cb0b3a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:57.553572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-073eb97b-8b49-4055-bf35-0676f7cb0b3a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:57.555189 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-073eb97b-8b49-4055-bf35-0676f7cb0b3a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1754 microversion: 2.42 time: 1.788294 Aug 24 10:26:57.570404 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1454/3287] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:26:55 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1754 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:26:57.578317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0a4407b8-97ea-424a-bbde-a55713d25ccb tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:57.591290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0a4407b8-97ea-424a-bbde-a55713d25ccb tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:57.622810 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a4407b8-97ea-424a-bbde-a55713d25ccb tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:57.623321 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a4407b8-97ea-424a-bbde-a55713d25ccb tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:57.623758 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a4407b8-97ea-424a-bbde-a55713d25ccb tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:57.624474 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a4407b8-97ea-424a-bbde-a55713d25ccb tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:57.624932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a4407b8-97ea-424a-bbde-a55713d25ccb tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:57.625393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a4407b8-97ea-424a-bbde-a55713d25ccb tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:58.794802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-152126c9-00ba-4921-8a63-c6c20e86fbe4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:58.807944 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-152126c9-00ba-4921-8a63-c6c20e86fbe4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1524 microversion: 2.1 time: 3.171810 Aug 24 10:26:58.815462 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1834/3288] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:55 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1524 bytes in 3180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:58.827390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c332d52a-50fb-481a-8ea8-2161046d5f7a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:58.828025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c332d52a-50fb-481a-8ea8-2161046d5f7a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] [instance: 828b46b2-00a2-4e00-b2b7-bc20d0d34f86] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:58.854726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c332d52a-50fb-481a-8ea8-2161046d5f7a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:58.855253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c332d52a-50fb-481a-8ea8-2161046d5f7a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:58.855702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c332d52a-50fb-481a-8ea8-2161046d5f7a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:58.870758 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c332d52a-50fb-481a-8ea8-2161046d5f7a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:58.871277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c332d52a-50fb-481a-8ea8-2161046d5f7a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:58.871733 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c332d52a-50fb-481a-8ea8-2161046d5f7a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:59.784307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c332d52a-50fb-481a-8ea8-2161046d5f7a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d798bffa944169b1ba0b6042698374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38653c7bc12485ba8d0de49f2db2820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:59.795151 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0a4407b8-97ea-424a-bbde-a55713d25ccb tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:59.811738 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c332d52a-50fb-481a-8ea8-2161046d5f7a tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86" status: 200 len: 1312 microversion: 2.1 time: 0.995017 Aug 24 10:26:59.812609 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0a4407b8-97ea-424a-bbde-a55713d25ccb tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 200 len: 1506 microversion: 2.1 time: 2.240585 Aug 24 10:26:59.816637 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1455/3289] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:57 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 1506 bytes in 2245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:59.818514 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1835/3290] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:58 2022] GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86 => generated 1312 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:59.831935 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d2fd7cc4-4667-4d5b-85b8-f9fa48c91973 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:59.833140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d2fd7cc4-4667-4d5b-85b8-f9fa48c91973 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:59.856080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2fd7cc4-4667-4d5b-85b8-f9fa48c91973 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:59.856981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1d19ee4a-3434-4600-bd3a-8f5ded33895f tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:59.857877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1d19ee4a-3434-4600-bd3a-8f5ded33895f tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] [instance: 60157d13-f95a-4362-8ed2-2f9eb878bf81] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:59.862127 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2fd7cc4-4667-4d5b-85b8-f9fa48c91973 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:59.864662 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2fd7cc4-4667-4d5b-85b8-f9fa48c91973 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:59.866254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2fd7cc4-4667-4d5b-85b8-f9fa48c91973 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:59.869976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d19ee4a-3434-4600-bd3a-8f5ded33895f tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:59.870691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d19ee4a-3434-4600-bd3a-8f5ded33895f tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:59.870990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2fd7cc4-4667-4d5b-85b8-f9fa48c91973 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:59.871565 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2fd7cc4-4667-4d5b-85b8-f9fa48c91973 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:59.871962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d19ee4a-3434-4600-bd3a-8f5ded33895f tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:59.872856 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d19ee4a-3434-4600-bd3a-8f5ded33895f tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:59.873502 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d19ee4a-3434-4600-bd3a-8f5ded33895f tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:59.875193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d19ee4a-3434-4600-bd3a-8f5ded33895f tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:00.884587 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1d19ee4a-3434-4600-bd3a-8f5ded33895f tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539d440d00964721bbe156236eaff442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9786b6d72ea4462ae31882e65d377b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:00.893815 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1d19ee4a-3434-4600-bd3a-8f5ded33895f tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] 10.222.0.85 "GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81" status: 200 len: 1315 microversion: 2.1 time: 1.063364 Aug 24 10:27:00.894429 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1456/3291] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:59 2022] GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81 => generated 1315 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:00.914557 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ce7f4171-7dfc-43e4-b6bb-2dbcb140bba1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:00.915204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ce7f4171-7dfc-43e4-b6bb-2dbcb140bba1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:00.936277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce7f4171-7dfc-43e4-b6bb-2dbcb140bba1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:00.944487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce7f4171-7dfc-43e4-b6bb-2dbcb140bba1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:00.945153 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce7f4171-7dfc-43e4-b6bb-2dbcb140bba1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:00.948721 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce7f4171-7dfc-43e4-b6bb-2dbcb140bba1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:00.949500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce7f4171-7dfc-43e4-b6bb-2dbcb140bba1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:00.950135 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce7f4171-7dfc-43e4-b6bb-2dbcb140bba1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:01.185873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d2fd7cc4-4667-4d5b-85b8-f9fa48c91973 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:01.203388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d2fd7cc4-4667-4d5b-85b8-f9fa48c91973 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:01.204986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d2fd7cc4-4667-4d5b-85b8-f9fa48c91973 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:01.214124 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d2fd7cc4-4667-4d5b-85b8-f9fa48c91973 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1801 microversion: 2.42 time: 1.394025 Aug 24 10:27:01.229157 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1836/3292] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:26:59 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1801 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:27:01.229157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a890d5de-6c51-42a5-9d33-7ef012aa6313 req-af451361-0498-455b-98be-8e72dafd22ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60157d13-f95a-4362-8ed2-2f9eb878bf81", "name": "network-vif-plugged", "status": "completed", "tag": "603d0568-5332-4e02-853c-c7a9c7e74d4b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:01.274530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a890d5de-6c51-42a5-9d33-7ef012aa6313 req-af451361-0498-455b-98be-8e72dafd22ae service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:01.275032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a890d5de-6c51-42a5-9d33-7ef012aa6313 req-af451361-0498-455b-98be-8e72dafd22ae service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:01.279689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a890d5de-6c51-42a5-9d33-7ef012aa6313 req-af451361-0498-455b-98be-8e72dafd22ae service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:01.326768 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a890d5de-6c51-42a5-9d33-7ef012aa6313 req-af451361-0498-455b-98be-8e72dafd22ae service nova] Creating event network-vif-plugged:603d0568-5332-4e02-853c-c7a9c7e74d4b for instance 60157d13-f95a-4362-8ed2-2f9eb878bf81 on n-h1-849328-3 Aug 24 10:27:01.348392 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a890d5de-6c51-42a5-9d33-7ef012aa6313 req-af451361-0498-455b-98be-8e72dafd22ae service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124568 Aug 24 10:27:01.362232 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1837/3293] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:27:01.382012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-5e8d97a2-8297-499c-93ca-c20c0abb0a66 req-2e774b2a-9766-4c9a-bed7-e6bcbce0b59e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea7bc787-3b2c-4174-b05a-178957293e0d", "name": "network-vif-deleted", "tag": "a08f33a2-f475-4918-9c3c-7baf872ae2cd"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:01.421111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5e8d97a2-8297-499c-93ca-c20c0abb0a66 req-2e774b2a-9766-4c9a-bed7-e6bcbce0b59e service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:01.421630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5e8d97a2-8297-499c-93ca-c20c0abb0a66 req-2e774b2a-9766-4c9a-bed7-e6bcbce0b59e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:01.430672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5e8d97a2-8297-499c-93ca-c20c0abb0a66 req-2e774b2a-9766-4c9a-bed7-e6bcbce0b59e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:01.469100 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-5e8d97a2-8297-499c-93ca-c20c0abb0a66 req-2e774b2a-9766-4c9a-bed7-e6bcbce0b59e service nova] Creating event network-vif-deleted:a08f33a2-f475-4918-9c3c-7baf872ae2cd for instance ea7bc787-3b2c-4174-b05a-178957293e0d on n-h2-849328-3 Aug 24 10:27:01.486012 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-5e8d97a2-8297-499c-93ca-c20c0abb0a66 req-2e774b2a-9766-4c9a-bed7-e6bcbce0b59e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122167 Aug 24 10:27:01.495941 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1838/3294] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:27:01.518443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-13c3c9c7-ec26-48ae-ae68-38d47ed99c4f tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:01.526381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-13c3c9c7-ec26-48ae-ae68-38d47ed99c4f tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: ea7bc787-3b2c-4174-b05a-178957293e0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:01.560243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13c3c9c7-ec26-48ae-ae68-38d47ed99c4f tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:01.560778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13c3c9c7-ec26-48ae-ae68-38d47ed99c4f tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:01.561262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13c3c9c7-ec26-48ae-ae68-38d47ed99c4f tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:01.570645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13c3c9c7-ec26-48ae-ae68-38d47ed99c4f tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:01.571950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13c3c9c7-ec26-48ae-ae68-38d47ed99c4f tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:01.574305 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13c3c9c7-ec26-48ae-ae68-38d47ed99c4f tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:01.622341 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-13c3c9c7-ec26-48ae-ae68-38d47ed99c4f tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] HTTP exception thrown: Instance ea7bc787-3b2c-4174-b05a-178957293e0d could not be found. Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-13c3c9c7-ec26-48ae-ae68-38d47ed99c4f tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Request method failure captured: Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d HTTP/1.1 Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfxfwPlGNiOu5iS9ebdSI2ORYVitoANB5hqzR7c7IYE9AqoaI06xemb9zASTdjd2jGbUxFkpBpWRR_Nm7o9Ks1699wnyOJFDOZqKKf1fzrbZZAq385C_aQzP7icoHMh-fJd0JiMWXeqhJGtDUpoq0_8udZfRMLJ6qX_D20DWrcbLVtc Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: de173a86ff8a446289ea3e98de1fd06b Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerRescueTestJSON-1903068699 Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/de173a86ff8a446289ea3e98de1fd06b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_de173a86ff8a446289ea3e98de1fd06b", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/de173a86ff8a446289ea3e98de1fd06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/de173a86ff8a446289ea3e98de1fd06b"}]}] Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerRescueTestJSON-1903068699 Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: de173a86ff8a446289ea3e98de1fd06b Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerRescueTestJSON-1903068699 Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerRescueTestJSON-1903068699-project Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 812c7ee5dd0f4be9b9745e10a89d5cf6 Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerRescueTestJSON-1903068699-project Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance ea7bc787-3b2c-4174-b05a-178957293e0d could not be found. Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'ea7bc787-3b2c-4174-b05a-178957293e0d'} Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea7bc787-3b2c-4174-b05a-178957293e0d could not be found. Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea7bc787-3b2c-4174-b05a-178957293e0d could not be found. Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:01.624957 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:27:01.630243 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:01.630243 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:01.630243 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:01.630243 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:27:01.630243 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:27:01.630243 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea7bc787-3b2c-4174-b05a-178957293e0d could not be found. Aug 24 10:27:01.630243 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:27:01.631336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-13c3c9c7-ec26-48ae-ae68-38d47ed99c4f tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Returning 404 to user: Instance ea7bc787-3b2c-4174-b05a-178957293e0d could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:27:01.632245 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-13c3c9c7-ec26-48ae-ae68-38d47ed99c4f tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d" status: 404 len: 111 microversion: 2.1 time: 0.133853 Aug 24 10:27:01.635727 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1839/3295] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:01 2022] GET /compute/v2.1/servers/ea7bc787-3b2c-4174-b05a-178957293e0d => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:27:01.670502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9610dbd4-6e95-4637-99e4-68109da93620 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:01.673517 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9610dbd4-6e95-4637-99e4-68109da93620 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] [instance: 828b46b2-00a2-4e00-b2b7-bc20d0d34f86] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:01.685347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9610dbd4-6e95-4637-99e4-68109da93620 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:01.686240 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9610dbd4-6e95-4637-99e4-68109da93620 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:01.687313 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9610dbd4-6e95-4637-99e4-68109da93620 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:01.688248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9610dbd4-6e95-4637-99e4-68109da93620 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:01.690192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9610dbd4-6e95-4637-99e4-68109da93620 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:01.690844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9610dbd4-6e95-4637-99e4-68109da93620 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:02.278455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ce7f4171-7dfc-43e4-b6bb-2dbcb140bba1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:02.297421 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ce7f4171-7dfc-43e4-b6bb-2dbcb140bba1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1524 microversion: 2.1 time: 1.400780 Aug 24 10:27:02.302334 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1457/3296] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:00 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1524 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:02.318719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-34674f54-355e-4471-92d2-e2212e6c204b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:02.322371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-34674f54-355e-4471-92d2-e2212e6c204b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:02.362279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34674f54-355e-4471-92d2-e2212e6c204b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:02.363104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34674f54-355e-4471-92d2-e2212e6c204b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:02.365473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34674f54-355e-4471-92d2-e2212e6c204b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:02.369698 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34674f54-355e-4471-92d2-e2212e6c204b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:02.370592 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34674f54-355e-4471-92d2-e2212e6c204b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:02.371914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34674f54-355e-4471-92d2-e2212e6c204b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:02.425388 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-34674f54-355e-4471-92d2-e2212e6c204b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:27:02.596444 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-34674f54-355e-4471-92d2-e2212e6c204b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 204 len: 0 microversion: 2.1 time: 0.291074 Aug 24 10:27:02.601222 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1458/3297] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:27:02 2022] DELETE /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:27:02.620313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-85b0befa-f778-4590-963f-0d84b9ef7181 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:02.621252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-85b0befa-f778-4590-963f-0d84b9ef7181 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] [instance: 60157d13-f95a-4362-8ed2-2f9eb878bf81] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:02.636500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85b0befa-f778-4590-963f-0d84b9ef7181 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:02.639692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85b0befa-f778-4590-963f-0d84b9ef7181 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:02.640326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85b0befa-f778-4590-963f-0d84b9ef7181 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:02.641275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85b0befa-f778-4590-963f-0d84b9ef7181 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:02.644508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85b0befa-f778-4590-963f-0d84b9ef7181 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:02.645238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85b0befa-f778-4590-963f-0d84b9ef7181 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:02.854508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9610dbd4-6e95-4637-99e4-68109da93620 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d798bffa944169b1ba0b6042698374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38653c7bc12485ba8d0de49f2db2820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:02.878404 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9610dbd4-6e95-4637-99e4-68109da93620 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86" status: 200 len: 1496 microversion: 2.1 time: 1.238699 Aug 24 10:27:02.881410 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1840/3298] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:01 2022] GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86 => generated 1496 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:02.909433 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-35f7d584-5ea9-4ea0-840a-759f1cdf2034 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:02.913538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-35f7d584-5ea9-4ea0-840a-759f1cdf2034 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:02.950977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35f7d584-5ea9-4ea0-840a-759f1cdf2034 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:02.959399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35f7d584-5ea9-4ea0-840a-759f1cdf2034 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:02.961893 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35f7d584-5ea9-4ea0-840a-759f1cdf2034 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:02.965734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35f7d584-5ea9-4ea0-840a-759f1cdf2034 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:02.971149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35f7d584-5ea9-4ea0-840a-759f1cdf2034 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:02.975496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35f7d584-5ea9-4ea0-840a-759f1cdf2034 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:03.043375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:03.613583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-85b0befa-f778-4590-963f-0d84b9ef7181 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539d440d00964721bbe156236eaff442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9786b6d72ea4462ae31882e65d377b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:03.626034 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-85b0befa-f778-4590-963f-0d84b9ef7181 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] 10.222.0.85 "GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81" status: 200 len: 1315 microversion: 2.1 time: 1.023000 Aug 24 10:27:03.626972 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1459/3299] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:02 2022] GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81 => generated 1315 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:03.652959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-35f7d584-5ea9-4ea0-840a-759f1cdf2034 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:03.669282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-35f7d584-5ea9-4ea0-840a-759f1cdf2034 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:03.672508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32e0f3bb-f4fb-4057-a103-cd2f4508ad2b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:03.673352 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-32e0f3bb-f4fb-4057-a103-cd2f4508ad2b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:03.676138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-35f7d584-5ea9-4ea0-840a-759f1cdf2034 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:03.678582 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:03.693307 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-35f7d584-5ea9-4ea0-840a-759f1cdf2034 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1848 microversion: 2.42 time: 0.805914 Aug 24 10:27:03.700672 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1841/3300] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:27:02 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1848 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:27:03.722475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32e0f3bb-f4fb-4057-a103-cd2f4508ad2b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:03.723377 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32e0f3bb-f4fb-4057-a103-cd2f4508ad2b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:03.725033 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32e0f3bb-f4fb-4057-a103-cd2f4508ad2b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:03.728142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32e0f3bb-f4fb-4057-a103-cd2f4508ad2b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:03.732295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32e0f3bb-f4fb-4057-a103-cd2f4508ad2b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:03.733051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ea9752f-2143-4a0b-a602-3bebbab1c971 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:03.733391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32e0f3bb-f4fb-4057-a103-cd2f4508ad2b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:03.781282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.compute.server_groups [None req-0ea9752f-2143-4a0b-a602-3bebbab1c971 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Querying cell e852a9c4-5bbb-4a78-aec0-794708e7e59e(cell1) for 1 instances {{(pid=122433) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 24 10:27:03.782027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ea9752f-2143-4a0b-a602-3bebbab1c971 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:03.796854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ea9752f-2143-4a0b-a602-3bebbab1c971 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:03.798981 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ea9752f-2143-4a0b-a602-3bebbab1c971 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:03.843991 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0ea9752f-2143-4a0b-a602-3bebbab1c971 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "GET /compute/v2.1/os-server-groups/5b638a0f-55d5-4eba-8b03-4da7d89c936d" status: 200 len: 221 microversion: 2.1 time: 0.140745 Aug 24 10:27:03.854355 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1842/3301] 10.222.0.85 () {58 vars in 1263 bytes} [Wed Aug 24 10:27:03 2022] GET /compute/v2.1/os-server-groups/5b638a0f-55d5-4eba-8b03-4da7d89c936d => generated 221 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:27:03.860561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-add7101f-956e-4c50-9596-a9bb0ed4b4a2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:03.861263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-add7101f-956e-4c50-9596-a9bb0ed4b4a2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:03.870301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-add7101f-956e-4c50-9596-a9bb0ed4b4a2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:03.871051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-add7101f-956e-4c50-9596-a9bb0ed4b4a2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:03.871740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-add7101f-956e-4c50-9596-a9bb0ed4b4a2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:03.872622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-add7101f-956e-4c50-9596-a9bb0ed4b4a2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:03.873286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-add7101f-956e-4c50-9596-a9bb0ed4b4a2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:03.873877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-add7101f-956e-4c50-9596-a9bb0ed4b4a2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:04.462713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-add7101f-956e-4c50-9596-a9bb0ed4b4a2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:04.492277 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-add7101f-956e-4c50-9596-a9bb0ed4b4a2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1524 microversion: 2.1 time: 0.636023 Aug 24 10:27:04.519748 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1843/3302] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:03 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1524 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:04.554290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-32e0f3bb-f4fb-4057-a103-cd2f4508ad2b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:04.557607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5b5a523d-0e8b-447e-a40b-49b5ebc9cfe4 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:04.560437 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5b5a523d-0e8b-447e-a40b-49b5ebc9cfe4 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] [instance: 828b46b2-00a2-4e00-b2b7-bc20d0d34f86] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:04.569054 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-32e0f3bb-f4fb-4057-a103-cd2f4508ad2b tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 200 len: 1493 microversion: 2.1 time: 0.940972 Aug 24 10:27:04.589307 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1460/3303] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:03 2022] GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 1493 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:04.594015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b5a523d-0e8b-447e-a40b-49b5ebc9cfe4 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:04.594442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b5a523d-0e8b-447e-a40b-49b5ebc9cfe4 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:04.597848 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b5a523d-0e8b-447e-a40b-49b5ebc9cfe4 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:04.599479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b5a523d-0e8b-447e-a40b-49b5ebc9cfe4 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:04.605550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b5a523d-0e8b-447e-a40b-49b5ebc9cfe4 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:04.606771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b5a523d-0e8b-447e-a40b-49b5ebc9cfe4 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:04.651176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e30cffb-cabd-4435-b7a7-953fde78356c tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:04.652022 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6e30cffb-cabd-4435-b7a7-953fde78356c tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] [instance: 60157d13-f95a-4362-8ed2-2f9eb878bf81] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:04.661805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e30cffb-cabd-4435-b7a7-953fde78356c tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:04.662464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e30cffb-cabd-4435-b7a7-953fde78356c tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:04.668008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e30cffb-cabd-4435-b7a7-953fde78356c tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:04.668933 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e30cffb-cabd-4435-b7a7-953fde78356c tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:04.669569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e30cffb-cabd-4435-b7a7-953fde78356c tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:04.670335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e30cffb-cabd-4435-b7a7-953fde78356c tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:04.767688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5b5a523d-0e8b-447e-a40b-49b5ebc9cfe4 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] [instance: 828b46b2-00a2-4e00-b2b7-bc20d0d34f86] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:27:05.030734 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5b5a523d-0e8b-447e-a40b-49b5ebc9cfe4 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "DELETE /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86" status: 204 len: 0 microversion: 2.1 time: 0.504724 Aug 24 10:27:05.035704 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1844/3304] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:27:04 2022] DELETE /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:27:05.117334 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9f4e4125-3651-4fca-9cc1-ba6e8b7699ea tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:05.119311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9f4e4125-3651-4fca-9cc1-ba6e8b7699ea tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:05.146884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f4e4125-3651-4fca-9cc1-ba6e8b7699ea tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:05.148132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f4e4125-3651-4fca-9cc1-ba6e8b7699ea tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:05.151606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f4e4125-3651-4fca-9cc1-ba6e8b7699ea tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:05.152397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f4e4125-3651-4fca-9cc1-ba6e8b7699ea tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:05.152883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f4e4125-3651-4fca-9cc1-ba6e8b7699ea tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:05.153439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f4e4125-3651-4fca-9cc1-ba6e8b7699ea tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:05.726972 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6e30cffb-cabd-4435-b7a7-953fde78356c tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539d440d00964721bbe156236eaff442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9786b6d72ea4462ae31882e65d377b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:05.793667 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6e30cffb-cabd-4435-b7a7-953fde78356c tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] 10.222.0.85 "GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81" status: 200 len: 1504 microversion: 2.1 time: 1.146639 Aug 24 10:27:05.813316 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1461/3305] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:04 2022] GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81 => generated 1504 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:05.858295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0fe4eb06-dc4e-48e4-b50e-0d45db9f7a27 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:05.859444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0fe4eb06-dc4e-48e4-b50e-0d45db9f7a27 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] [instance: 828b46b2-00a2-4e00-b2b7-bc20d0d34f86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:05.884756 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fe4eb06-dc4e-48e4-b50e-0d45db9f7a27 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:05.885587 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fe4eb06-dc4e-48e4-b50e-0d45db9f7a27 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:05.901220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fe4eb06-dc4e-48e4-b50e-0d45db9f7a27 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:05.916651 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fe4eb06-dc4e-48e4-b50e-0d45db9f7a27 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:05.917729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fe4eb06-dc4e-48e4-b50e-0d45db9f7a27 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:05.918521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fe4eb06-dc4e-48e4-b50e-0d45db9f7a27 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:06.352574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0fe4eb06-dc4e-48e4-b50e-0d45db9f7a27 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d798bffa944169b1ba0b6042698374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38653c7bc12485ba8d0de49f2db2820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:06.361983 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0fe4eb06-dc4e-48e4-b50e-0d45db9f7a27 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86" status: 200 len: 1502 microversion: 2.1 time: 0.546775 Aug 24 10:27:06.371282 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1462/3306] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:05 2022] GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86 => generated 1502 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:06.393746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6431909c-0933-4d3d-bb61-00d95c3d569e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:06.402009 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6431909c-0933-4d3d-bb61-00d95c3d569e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:06.431373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6431909c-0933-4d3d-bb61-00d95c3d569e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:06.436925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6431909c-0933-4d3d-bb61-00d95c3d569e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:06.440672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9f4e4125-3651-4fca-9cc1-ba6e8b7699ea tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:06.444643 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6431909c-0933-4d3d-bb61-00d95c3d569e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:06.448374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6431909c-0933-4d3d-bb61-00d95c3d569e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:06.448962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6431909c-0933-4d3d-bb61-00d95c3d569e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:06.455179 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6431909c-0933-4d3d-bb61-00d95c3d569e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:06.460098 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9f4e4125-3651-4fca-9cc1-ba6e8b7699ea tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:06.462161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9f4e4125-3651-4fca-9cc1-ba6e8b7699ea tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:06.464408 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9f4e4125-3651-4fca-9cc1-ba6e8b7699ea tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1848 microversion: 2.42 time: 1.426542 Aug 24 10:27:06.468067 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1845/3307] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:27:05 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1848 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:27:06.477776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ef8bbbd3-0664-40cd-bde1-21ed3e7b5dea tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:06.480924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ef8bbbd3-0664-40cd-bde1-21ed3e7b5dea tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:06.502347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef8bbbd3-0664-40cd-bde1-21ed3e7b5dea tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:06.511986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef8bbbd3-0664-40cd-bde1-21ed3e7b5dea tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:06.517463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef8bbbd3-0664-40cd-bde1-21ed3e7b5dea tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:06.521007 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef8bbbd3-0664-40cd-bde1-21ed3e7b5dea tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:06.522216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef8bbbd3-0664-40cd-bde1-21ed3e7b5dea tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:06.526540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef8bbbd3-0664-40cd-bde1-21ed3e7b5dea tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:07.756869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ef8bbbd3-0664-40cd-bde1-21ed3e7b5dea tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:07.777670 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ef8bbbd3-0664-40cd-bde1-21ed3e7b5dea tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 200 len: 1493 microversion: 2.1 time: 1.307587 Aug 24 10:27:07.781665 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1846/3308] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:06 2022] GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 1493 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:07.797519 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a1df2be2-6bfd-4b08-ae3a-42fc9bc40a36 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:07.805022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a1df2be2-6bfd-4b08-ae3a-42fc9bc40a36 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] [instance: 60157d13-f95a-4362-8ed2-2f9eb878bf81] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:07.826068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1df2be2-6bfd-4b08-ae3a-42fc9bc40a36 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:07.826582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1df2be2-6bfd-4b08-ae3a-42fc9bc40a36 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:07.832654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1df2be2-6bfd-4b08-ae3a-42fc9bc40a36 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:07.833459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1df2be2-6bfd-4b08-ae3a-42fc9bc40a36 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:07.833940 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1df2be2-6bfd-4b08-ae3a-42fc9bc40a36 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:07.837000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1df2be2-6bfd-4b08-ae3a-42fc9bc40a36 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:07.974890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a1df2be2-6bfd-4b08-ae3a-42fc9bc40a36 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] [instance: 60157d13-f95a-4362-8ed2-2f9eb878bf81] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:27:08.276375 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a1df2be2-6bfd-4b08-ae3a-42fc9bc40a36 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] 10.222.0.85 "DELETE /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81" status: 204 len: 0 microversion: 2.1 time: 0.489216 Aug 24 10:27:08.277569 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1847/3309] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:27:07 2022] DELETE /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:27:08.522584 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6431909c-0933-4d3d-bb61-00d95c3d569e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:08.528942 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:08.531255 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6431909c-0933-4d3d-bb61-00d95c3d569e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1524 microversion: 2.1 time: 2.158568 Aug 24 10:27:08.542421 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1463/3310] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:06 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1524 bytes in 2170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:08.551495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b1aecf18-506a-49b1-a689-594f56e6eca5 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:08.578136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b1aecf18-506a-49b1-a689-594f56e6eca5 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] [instance: 828b46b2-00a2-4e00-b2b7-bc20d0d34f86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:08.604198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1aecf18-506a-49b1-a689-594f56e6eca5 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:08.604713 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1aecf18-506a-49b1-a689-594f56e6eca5 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:08.605186 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1aecf18-506a-49b1-a689-594f56e6eca5 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:08.605944 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1aecf18-506a-49b1-a689-594f56e6eca5 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:08.606383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1aecf18-506a-49b1-a689-594f56e6eca5 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:08.606805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1aecf18-506a-49b1-a689-594f56e6eca5 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:08.944019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-4cd7d6c8-8be6-4abf-a5b9-74d5e867b4f1 req-b169def6-6e9f-4113-9ed4-96a8f6ae5fbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ade0e12-9ac0-459f-8f85-6743432302fa", "tag": "e3d5d84f-2aa7-4b85-b98f-cb04738cac08"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:08.966000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4cd7d6c8-8be6-4abf-a5b9-74d5e867b4f1 req-b169def6-6e9f-4113-9ed4-96a8f6ae5fbc service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:08.970424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4cd7d6c8-8be6-4abf-a5b9-74d5e867b4f1 req-b169def6-6e9f-4113-9ed4-96a8f6ae5fbc service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:08.971766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4cd7d6c8-8be6-4abf-a5b9-74d5e867b4f1 req-b169def6-6e9f-4113-9ed4-96a8f6ae5fbc service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:09.007447 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-4cd7d6c8-8be6-4abf-a5b9-74d5e867b4f1 req-b169def6-6e9f-4113-9ed4-96a8f6ae5fbc service nova] Creating event network-changed:e3d5d84f-2aa7-4b85-b98f-cb04738cac08 for instance 1ade0e12-9ac0-459f-8f85-6743432302fa on n-h1-849328-3 Aug 24 10:27:09.013938 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-4cd7d6c8-8be6-4abf-a5b9-74d5e867b4f1 req-b169def6-6e9f-4113-9ed4-96a8f6ae5fbc service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.734608 Aug 24 10:27:09.016071 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1848/3311] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:27:09.023527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3acbea97-bbed-4214-9ce6-b042a70f72c0 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:09.024722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3acbea97-bbed-4214-9ce6-b042a70f72c0 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:09.037811 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3acbea97-bbed-4214-9ce6-b042a70f72c0 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:09.043308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3acbea97-bbed-4214-9ce6-b042a70f72c0 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:09.043982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3acbea97-bbed-4214-9ce6-b042a70f72c0 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:09.044859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3acbea97-bbed-4214-9ce6-b042a70f72c0 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:09.045482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3acbea97-bbed-4214-9ce6-b042a70f72c0 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:09.046603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3acbea97-bbed-4214-9ce6-b042a70f72c0 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:09.345982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3acbea97-bbed-4214-9ce6-b042a70f72c0 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:09.359608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3acbea97-bbed-4214-9ce6-b042a70f72c0 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:09.369270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3acbea97-bbed-4214-9ce6-b042a70f72c0 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:09.371035 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3acbea97-bbed-4214-9ce6-b042a70f72c0 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1869 microversion: 2.42 time: 0.352793 Aug 24 10:27:09.373835 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1849/3312] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:27:09 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1869 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:27:09.383627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f9e74bcc-a6b6-430a-93bd-cf822e154cd3 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:09.384255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f9e74bcc-a6b6-430a-93bd-cf822e154cd3 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] [instance: 60157d13-f95a-4362-8ed2-2f9eb878bf81] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:09.399994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9e74bcc-a6b6-430a-93bd-cf822e154cd3 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:09.400501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9e74bcc-a6b6-430a-93bd-cf822e154cd3 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:09.400943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9e74bcc-a6b6-430a-93bd-cf822e154cd3 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:09.401690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9e74bcc-a6b6-430a-93bd-cf822e154cd3 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:09.402152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9e74bcc-a6b6-430a-93bd-cf822e154cd3 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:09.402579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9e74bcc-a6b6-430a-93bd-cf822e154cd3 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:10.459877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f9e74bcc-a6b6-430a-93bd-cf822e154cd3 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539d440d00964721bbe156236eaff442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9786b6d72ea4462ae31882e65d377b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:10.469650 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f9e74bcc-a6b6-430a-93bd-cf822e154cd3 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] 10.222.0.85 "GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81" status: 200 len: 1510 microversion: 2.1 time: 1.094636 Aug 24 10:27:10.476262 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1850/3313] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:09 2022] GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81 => generated 1510 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:10.487806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a05fdf32-45c1-44f1-89a8-8e7933d40643 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:10.496624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a05fdf32-45c1-44f1-89a8-8e7933d40643 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:10.523599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a05fdf32-45c1-44f1-89a8-8e7933d40643 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:10.524198 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a05fdf32-45c1-44f1-89a8-8e7933d40643 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:10.524736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a05fdf32-45c1-44f1-89a8-8e7933d40643 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:10.529973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a05fdf32-45c1-44f1-89a8-8e7933d40643 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:10.530479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a05fdf32-45c1-44f1-89a8-8e7933d40643 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:10.530925 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a05fdf32-45c1-44f1-89a8-8e7933d40643 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:10.647095 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a05fdf32-45c1-44f1-89a8-8e7933d40643 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:10.649822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a05fdf32-45c1-44f1-89a8-8e7933d40643 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:10.652074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a05fdf32-45c1-44f1-89a8-8e7933d40643 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:10.652869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-a05fdf32-45c1-44f1-89a8-8e7933d40643 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lazy-loading 'fault' on Instance uuid d6cdec98-2454-4ba9-8859-25231e4e28ab {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:27:11.024222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a05fdf32-45c1-44f1-89a8-8e7933d40643 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812c7ee5dd0f4be9b9745e10a89d5cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de173a86ff8a446289ea3e98de1fd06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:11.045101 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a05fdf32-45c1-44f1-89a8-8e7933d40643 tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 200 len: 1304 microversion: 2.1 time: 0.566483 Aug 24 10:27:11.065169 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1851/3314] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:10 2022] GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 1304 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:11.072832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-97aa6753-432a-4c7c-b006-179a0f8bb2b7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:11.075019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-97aa6753-432a-4c7c-b006-179a0f8bb2b7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:11.080158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b1aecf18-506a-49b1-a689-594f56e6eca5 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d798bffa944169b1ba0b6042698374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38653c7bc12485ba8d0de49f2db2820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:11.111994 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b1aecf18-506a-49b1-a689-594f56e6eca5 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86" status: 200 len: 1502 microversion: 2.1 time: 2.568165 Aug 24 10:27:11.139831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97aa6753-432a-4c7c-b006-179a0f8bb2b7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:11.139831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97aa6753-432a-4c7c-b006-179a0f8bb2b7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:11.143731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97aa6753-432a-4c7c-b006-179a0f8bb2b7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:11.144345 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1464/3315] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:08 2022] GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86 => generated 1502 bytes in 2601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:11.145687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97aa6753-432a-4c7c-b006-179a0f8bb2b7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:11.146297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97aa6753-432a-4c7c-b006-179a0f8bb2b7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:11.148480 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97aa6753-432a-4c7c-b006-179a0f8bb2b7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:11.157760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-25aaa125-3252-4a93-ab5d-2ab70c35e560 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:11.176684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-25aaa125-3252-4a93-ab5d-2ab70c35e560 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:11.208939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25aaa125-3252-4a93-ab5d-2ab70c35e560 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:11.223985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25aaa125-3252-4a93-ab5d-2ab70c35e560 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:11.227261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25aaa125-3252-4a93-ab5d-2ab70c35e560 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:11.228485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25aaa125-3252-4a93-ab5d-2ab70c35e560 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:11.231483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25aaa125-3252-4a93-ab5d-2ab70c35e560 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:11.234693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25aaa125-3252-4a93-ab5d-2ab70c35e560 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:11.619163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-97aa6753-432a-4c7c-b006-179a0f8bb2b7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:11.629561 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-97aa6753-432a-4c7c-b006-179a0f8bb2b7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1524 microversion: 2.1 time: 0.568038 Aug 24 10:27:11.645535 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1852/3316] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:11 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1524 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:11.664277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-4ca61cc0-87be-49c5-97a7-674daa0e045a req-b7b06146-3087-4da7-b31c-c468bc05726b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "828b46b2-00a2-4e00-b2b7-bc20d0d34f86", "name": "network-vif-deleted", "tag": "81b8f2a2-ab6f-4ad9-8a87-e10bf589770b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:11.682064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4ca61cc0-87be-49c5-97a7-674daa0e045a req-b7b06146-3087-4da7-b31c-c468bc05726b service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:11.691701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4ca61cc0-87be-49c5-97a7-674daa0e045a req-b7b06146-3087-4da7-b31c-c468bc05726b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:11.692439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4ca61cc0-87be-49c5-97a7-674daa0e045a req-b7b06146-3087-4da7-b31c-c468bc05726b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:11.706905 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-4ca61cc0-87be-49c5-97a7-674daa0e045a req-b7b06146-3087-4da7-b31c-c468bc05726b service nova] Creating event network-vif-deleted:81b8f2a2-ab6f-4ad9-8a87-e10bf589770b for instance 828b46b2-00a2-4e00-b2b7-bc20d0d34f86 on n-h2-849328-3 Aug 24 10:27:11.713565 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-4ca61cc0-87be-49c5-97a7-674daa0e045a req-b7b06146-3087-4da7-b31c-c468bc05726b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054821 Aug 24 10:27:11.719956 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1853/3317] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:27:11.728747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-f2e77fb0-5035-491e-bc8c-aa4b20acc2d6 req-31606a45-0fd9-4aaf-833e-273fe0073ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6cdec98-2454-4ba9-8859-25231e4e28ab", "name": "network-vif-deleted", "tag": "d8ac64f8-d1a4-4fb4-aa57-201fbd4205c2"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:11.741023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f2e77fb0-5035-491e-bc8c-aa4b20acc2d6 req-31606a45-0fd9-4aaf-833e-273fe0073ec6 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:11.741798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f2e77fb0-5035-491e-bc8c-aa4b20acc2d6 req-31606a45-0fd9-4aaf-833e-273fe0073ec6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:11.742409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f2e77fb0-5035-491e-bc8c-aa4b20acc2d6 req-31606a45-0fd9-4aaf-833e-273fe0073ec6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:11.764989 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-f2e77fb0-5035-491e-bc8c-aa4b20acc2d6 req-31606a45-0fd9-4aaf-833e-273fe0073ec6 service nova] Creating event network-vif-deleted:d8ac64f8-d1a4-4fb4-aa57-201fbd4205c2 for instance d6cdec98-2454-4ba9-8859-25231e4e28ab on n-h2-849328-3 Aug 24 10:27:11.780297 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-f2e77fb0-5035-491e-bc8c-aa4b20acc2d6 req-31606a45-0fd9-4aaf-833e-273fe0073ec6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057629 Aug 24 10:27:11.782171 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1854/3318] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:27:11.795987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ddad8795-7389-40bb-b2b0-0f1455919cf7 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:11.796990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ddad8795-7389-40bb-b2b0-0f1455919cf7 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] [instance: 60157d13-f95a-4362-8ed2-2f9eb878bf81] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:11.811282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddad8795-7389-40bb-b2b0-0f1455919cf7 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:11.817298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddad8795-7389-40bb-b2b0-0f1455919cf7 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:11.817877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddad8795-7389-40bb-b2b0-0f1455919cf7 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:11.818745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddad8795-7389-40bb-b2b0-0f1455919cf7 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:11.819446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddad8795-7389-40bb-b2b0-0f1455919cf7 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:11.821018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddad8795-7389-40bb-b2b0-0f1455919cf7 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:12.272266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ddad8795-7389-40bb-b2b0-0f1455919cf7 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539d440d00964721bbe156236eaff442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9786b6d72ea4462ae31882e65d377b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:12.282750 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ddad8795-7389-40bb-b2b0-0f1455919cf7 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] 10.222.0.85 "GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81" status: 200 len: 1510 microversion: 2.1 time: 0.499310 Aug 24 10:27:12.287584 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1855/3319] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:11 2022] GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81 => generated 1510 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:12.521654 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-25aaa125-3252-4a93-ab5d-2ab70c35e560 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:12.541376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-25aaa125-3252-4a93-ab5d-2ab70c35e560 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:12.547144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-25aaa125-3252-4a93-ab5d-2ab70c35e560 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:12.550636 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-25aaa125-3252-4a93-ab5d-2ab70c35e560 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1869 microversion: 2.42 time: 1.401855 Aug 24 10:27:12.565848 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1465/3320] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:27:11 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1869 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:27:12.589093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4117b8bb-d0c9-4495-a4ce-05fc20c6e7da tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:12.590934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4117b8bb-d0c9-4495-a4ce-05fc20c6e7da tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] [instance: d6cdec98-2454-4ba9-8859-25231e4e28ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:12.609349 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4117b8bb-d0c9-4495-a4ce-05fc20c6e7da tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:12.611361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4117b8bb-d0c9-4495-a4ce-05fc20c6e7da tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:12.614091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4117b8bb-d0c9-4495-a4ce-05fc20c6e7da tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:12.636353 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4117b8bb-d0c9-4495-a4ce-05fc20c6e7da tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:12.637331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4117b8bb-d0c9-4495-a4ce-05fc20c6e7da tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:12.641215 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4117b8bb-d0c9-4495-a4ce-05fc20c6e7da tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:12.691880 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-4117b8bb-d0c9-4495-a4ce-05fc20c6e7da tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] HTTP exception thrown: Instance d6cdec98-2454-4ba9-8859-25231e4e28ab could not be found. Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4117b8bb-d0c9-4495-a4ce-05fc20c6e7da tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Request method failure captured: Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab HTTP/1.1 Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfxfwPlGNiOu5iS9ebdSI2ORYVitoANB5hqzR7c7IYE9AqoaI06xemb9zASTdjd2jGbUxFkpBpWRR_Nm7o9Ks1699wnyOJFDOZqKKf1fzrbZZAq385C_aQzP7icoHMh-fJd0JiMWXeqhJGtDUpoq0_8udZfRMLJ6qX_D20DWrcbLVtc Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: de173a86ff8a446289ea3e98de1fd06b Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerRescueTestJSON-1903068699 Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/de173a86ff8a446289ea3e98de1fd06b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_de173a86ff8a446289ea3e98de1fd06b", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/de173a86ff8a446289ea3e98de1fd06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/de173a86ff8a446289ea3e98de1fd06b"}]}] Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerRescueTestJSON-1903068699 Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: de173a86ff8a446289ea3e98de1fd06b Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerRescueTestJSON-1903068699 Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerRescueTestJSON-1903068699-project Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 812c7ee5dd0f4be9b9745e10a89d5cf6 Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerRescueTestJSON-1903068699-project Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance d6cdec98-2454-4ba9-8859-25231e4e28ab could not be found. Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'd6cdec98-2454-4ba9-8859-25231e4e28ab'} Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6cdec98-2454-4ba9-8859-25231e4e28ab could not be found. Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6cdec98-2454-4ba9-8859-25231e4e28ab could not be found. Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:12.695425 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:12.699687 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:12.699687 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:12.699687 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:12.699687 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:27:12.699687 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:27:12.699687 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6cdec98-2454-4ba9-8859-25231e4e28ab could not be found. Aug 24 10:27:12.699687 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:12.699687 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4117b8bb-d0c9-4495-a4ce-05fc20c6e7da tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] Returning 404 to user: Instance d6cdec98-2454-4ba9-8859-25231e4e28ab could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:27:12.702319 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4117b8bb-d0c9-4495-a4ce-05fc20c6e7da tempest-ServerRescueTestJSON-1903068699 tempest-ServerRescueTestJSON-1903068699-project] 10.222.0.85 "GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab" status: 404 len: 111 microversion: 2.1 time: 0.124238 Aug 24 10:27:12.703454 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1466/3321] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:12 2022] GET /compute/v2.1/servers/d6cdec98-2454-4ba9-8859-25231e4e28ab => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:27:12.714126 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-adeb901a-4473-4daf-b32a-333982938db6 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:12.718978 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-adeb901a-4473-4daf-b32a-333982938db6 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] [instance: 828b46b2-00a2-4e00-b2b7-bc20d0d34f86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:12.733442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adeb901a-4473-4daf-b32a-333982938db6 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:12.737031 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adeb901a-4473-4daf-b32a-333982938db6 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:12.739598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adeb901a-4473-4daf-b32a-333982938db6 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:12.740764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adeb901a-4473-4daf-b32a-333982938db6 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:12.743670 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adeb901a-4473-4daf-b32a-333982938db6 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:12.744295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adeb901a-4473-4daf-b32a-333982938db6 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:12.789608 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-adeb901a-4473-4daf-b32a-333982938db6 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] HTTP exception thrown: Instance 828b46b2-00a2-4e00-b2b7-bc20d0d34f86 could not be found. Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-adeb901a-4473-4daf-b32a-333982938db6 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Request method failure captured: Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86 HTTP/1.1 Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfzUIWkrsHpu4OdPgSnxERUlbCnukKkldRmSA9VPtXWTKDxFvOunHR5qGG3CmfZz2hvVDuQwaB496S43w7HbHXRWnt3jaxUKH4AgBG4AK9FfjP-cE7-9jOnvkTXY8T_0GzBx9go1KICrw1O-fQ7WyXL7Sn5yIR9fAVNFwG6MkFhPXt4 Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: b38653c7bc12485ba8d0de49f2db2820 Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerGroupTestJSON-1705454618 Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b38653c7bc12485ba8d0de49f2db2820"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b38653c7bc12485ba8d0de49f2db2820", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b38653c7bc12485ba8d0de49f2db2820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b38653c7bc12485ba8d0de49f2db2820"}]}] Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerGroupTestJSON-1705454618 Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: b38653c7bc12485ba8d0de49f2db2820 Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerGroupTestJSON-1705454618 Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerGroupTestJSON-1705454618-project Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 54d798bffa944169b1ba0b6042698374 Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerGroupTestJSON-1705454618-project Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 828b46b2-00a2-4e00-b2b7-bc20d0d34f86 could not be found. Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '828b46b2-00a2-4e00-b2b7-bc20d0d34f86'} Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 828b46b2-00a2-4e00-b2b7-bc20d0d34f86 could not be found. Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 828b46b2-00a2-4e00-b2b7-bc20d0d34f86 could not be found. Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:12.794402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:12.799643 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:12.799643 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:12.799643 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:12.799643 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:27:12.799643 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:27:12.799643 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 828b46b2-00a2-4e00-b2b7-bc20d0d34f86 could not be found. Aug 24 10:27:12.799643 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:12.802085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-adeb901a-4473-4daf-b32a-333982938db6 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Returning 404 to user: Instance 828b46b2-00a2-4e00-b2b7-bc20d0d34f86 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:27:12.803456 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-adeb901a-4473-4daf-b32a-333982938db6 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86" status: 404 len: 111 microversion: 2.1 time: 0.098504 Aug 24 10:27:12.809106 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1467/3322] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:12 2022] GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:27:12.822925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ea073f3d-bf90-4296-a935-902491b182b5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:12.827854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ea073f3d-bf90-4296-a935-902491b182b5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:12.843514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea073f3d-bf90-4296-a935-902491b182b5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:12.844405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea073f3d-bf90-4296-a935-902491b182b5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:12.847007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea073f3d-bf90-4296-a935-902491b182b5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:12.848130 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea073f3d-bf90-4296-a935-902491b182b5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:12.849494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea073f3d-bf90-4296-a935-902491b182b5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:12.850106 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea073f3d-bf90-4296-a935-902491b182b5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:13.181876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-99fe262d-a25c-4a8a-87d2-7a64e155c2d5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-349736208", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "abdb34de-c2c8-4907-9dd2-7c1884b22f8b"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:13.312931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-99fe262d-a25c-4a8a-87d2-7a64e155c2d5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] validate_networks() for [('abdb34de-c2c8-4907-9dd2-7c1884b22f8b', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:27:13.678693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ea073f3d-bf90-4296-a935-902491b182b5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:13.695946 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ea073f3d-bf90-4296-a935-902491b182b5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1524 microversion: 2.1 time: 0.883204 Aug 24 10:27:13.697953 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1468/3323] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:12 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1524 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:13.705111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f2fcbd4a-7be7-45d4-a464-e5b4b8883886 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:13.767677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.compute.server_groups [None req-f2fcbd4a-7be7-45d4-a464-e5b4b8883886 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Querying cell e852a9c4-5bbb-4a78-aec0-794708e7e59e(cell1) for 1 instances {{(pid=122432) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 24 10:27:13.768770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2fcbd4a-7be7-45d4-a464-e5b4b8883886 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:13.770267 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2fcbd4a-7be7-45d4-a464-e5b4b8883886 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:13.778136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2fcbd4a-7be7-45d4-a464-e5b4b8883886 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:13.808365 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f2fcbd4a-7be7-45d4-a464-e5b4b8883886 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.106878 Aug 24 10:27:13.809009 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1469/3324] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:27:13 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:27:13.833569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-798ce1ae-55a2-4d69-9f36-0efd3a60070e tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:13.834213 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-798ce1ae-55a2-4d69-9f36-0efd3a60070e tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] [instance: 60157d13-f95a-4362-8ed2-2f9eb878bf81] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:13.864431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-798ce1ae-55a2-4d69-9f36-0efd3a60070e tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:13.865464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-798ce1ae-55a2-4d69-9f36-0efd3a60070e tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:13.866235 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-798ce1ae-55a2-4d69-9f36-0efd3a60070e tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:13.867561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-798ce1ae-55a2-4d69-9f36-0efd3a60070e tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:13.874133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-798ce1ae-55a2-4d69-9f36-0efd3a60070e tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:13.875068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-798ce1ae-55a2-4d69-9f36-0efd3a60070e tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:13.917682 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-798ce1ae-55a2-4d69-9f36-0efd3a60070e tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] HTTP exception thrown: Instance 60157d13-f95a-4362-8ed2-2f9eb878bf81 could not be found. Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-798ce1ae-55a2-4d69-9f36-0efd3a60070e tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Request method failure captured: Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81 HTTP/1.1 Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfzZv3v1tUM6DTgaGkhOywvGOMVR1vlp44PN2YwtQ7KuZlZ41fENMMJWq9n2ApOAGIhVZMjIgnp65ncq9yRGOFG9k7JAP7Zoo61V7mLoU5VrDYRfDJQQfTkkXhmfpzH3-4VM9j1hhBhD_R9OaNCLfl-IO9FzbxPNs5fDwLOr71zE3aE Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: f9786b6d72ea4462ae31882e65d377b7 Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesNegativeTestJSON-1281684413 Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f9786b6d72ea4462ae31882e65d377b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f9786b6d72ea4462ae31882e65d377b7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f9786b6d72ea4462ae31882e65d377b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f9786b6d72ea4462ae31882e65d377b7"}]}] Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesNegativeTestJSON-1281684413 Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: f9786b6d72ea4462ae31882e65d377b7 Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1281684413 Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ImagesNegativeTestJSON-1281684413-project Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 539d440d00964721bbe156236eaff442 Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesNegativeTestJSON-1281684413-project Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 60157d13-f95a-4362-8ed2-2f9eb878bf81 could not be found. Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '60157d13-f95a-4362-8ed2-2f9eb878bf81'} Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60157d13-f95a-4362-8ed2-2f9eb878bf81 could not be found. Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60157d13-f95a-4362-8ed2-2f9eb878bf81 could not be found. Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:13.925934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:13.931458 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:13.931458 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:13.931458 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:13.931458 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:27:13.931458 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:27:13.931458 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60157d13-f95a-4362-8ed2-2f9eb878bf81 could not be found. Aug 24 10:27:13.931458 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:13.934204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-798ce1ae-55a2-4d69-9f36-0efd3a60070e tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Returning 404 to user: Instance 60157d13-f95a-4362-8ed2-2f9eb878bf81 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:27:13.937490 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-798ce1ae-55a2-4d69-9f36-0efd3a60070e tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] 10.222.0.85 "GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81" status: 404 len: 111 microversion: 2.1 time: 0.127407 Aug 24 10:27:13.943303 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1470/3325] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:13 2022] GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:27:13.950006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-97e83782-67a7-4993-a6cd-02d2bba4a412 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:13.954912 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-97e83782-67a7-4993-a6cd-02d2bba4a412 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:13.970760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97e83782-67a7-4993-a6cd-02d2bba4a412 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:13.971696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97e83782-67a7-4993-a6cd-02d2bba4a412 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:13.972546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97e83782-67a7-4993-a6cd-02d2bba4a412 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:13.974530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97e83782-67a7-4993-a6cd-02d2bba4a412 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:13.977946 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97e83782-67a7-4993-a6cd-02d2bba4a412 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:13.979298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97e83782-67a7-4993-a6cd-02d2bba4a412 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:15.371659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-97e83782-67a7-4993-a6cd-02d2bba4a412 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:15.400288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-97e83782-67a7-4993-a6cd-02d2bba4a412 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:15.407407 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-97e83782-67a7-4993-a6cd-02d2bba4a412 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:15.410209 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-97e83782-67a7-4993-a6cd-02d2bba4a412 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1869 microversion: 2.42 time: 1.464410 Aug 24 10:27:15.414657 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1471/3326] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:27:13 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1869 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:27:15.424149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a1b8e57f-a5c8-421f-8604-10af77efa651 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:15.471630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.compute.server_groups [None req-a1b8e57f-a5c8-421f-8604-10af77efa651 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Querying cell e852a9c4-5bbb-4a78-aec0-794708e7e59e(cell1) for 1 instances {{(pid=122432) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 24 10:27:15.472849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1b8e57f-a5c8-421f-8604-10af77efa651 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:15.473499 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1b8e57f-a5c8-421f-8604-10af77efa651 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:15.474080 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1b8e57f-a5c8-421f-8604-10af77efa651 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:15.513770 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a1b8e57f-a5c8-421f-8604-10af77efa651 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "GET /compute/v2.1/os-server-groups/5b638a0f-55d5-4eba-8b03-4da7d89c936d" status: 200 len: 183 microversion: 2.1 time: 0.096180 Aug 24 10:27:15.515020 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1472/3327] 10.222.0.85 () {58 vars in 1263 bytes} [Wed Aug 24 10:27:15 2022] GET /compute/v2.1/os-server-groups/5b638a0f-55d5-4eba-8b03-4da7d89c936d => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:27:15.546300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a10be609-cda0-4ad3-b35d-87f17af17781 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1515108413", "metadata": {"image_type": "test"}}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:15.559921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a10be609-cda0-4ad3-b35d-87f17af17781 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] [instance: 60157d13-f95a-4362-8ed2-2f9eb878bf81] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:15.586937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a10be609-cda0-4ad3-b35d-87f17af17781 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:15.588824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a10be609-cda0-4ad3-b35d-87f17af17781 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:15.589330 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a10be609-cda0-4ad3-b35d-87f17af17781 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:15.592748 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a10be609-cda0-4ad3-b35d-87f17af17781 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:15.599334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a10be609-cda0-4ad3-b35d-87f17af17781 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:15.600636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a10be609-cda0-4ad3-b35d-87f17af17781 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:15.657091 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-a10be609-cda0-4ad3-b35d-87f17af17781 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] HTTP exception thrown: Instance 60157d13-f95a-4362-8ed2-2f9eb878bf81 could not be found. Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a10be609-cda0-4ad3-b35d-87f17af17781 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Request method failure captured: Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81/action HTTP/1.1 Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 112 Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfzZv3v1tUM6DTgaGkhOywvGOMVR1vlp44PN2YwtQ7KuZlZ41fENMMJWq9n2ApOAGIhVZMjIgnp65ncq9yRGOFG9k7JAP7Zoo61V7mLoU5VrDYRfDJQQfTkkXhmfpzH3-4VM9j1hhBhD_R9OaNCLfl-IO9FzbxPNs5fDwLOr71zE3aE Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: f9786b6d72ea4462ae31882e65d377b7 Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesNegativeTestJSON-1281684413 Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f9786b6d72ea4462ae31882e65d377b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f9786b6d72ea4462ae31882e65d377b7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f9786b6d72ea4462ae31882e65d377b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f9786b6d72ea4462ae31882e65d377b7"}]}] Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesNegativeTestJSON-1281684413 Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: f9786b6d72ea4462ae31882e65d377b7 Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1281684413 Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ImagesNegativeTestJSON-1281684413-project Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 539d440d00964721bbe156236eaff442 Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesNegativeTestJSON-1281684413-project Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1515108413", "metadata": {"image_type": "test"}}} Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 60157d13-f95a-4362-8ed2-2f9eb878bf81 could not be found. Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '60157d13-f95a-4362-8ed2-2f9eb878bf81', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1515108413', 'metadata': {'image_type': 'test'}}}} Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60157d13-f95a-4362-8ed2-2f9eb878bf81 could not be found. Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 24 10:27:15.663986 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 24 10:27:15.668154 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:27:15.668154 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:27:15.668154 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:27:15.668154 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:27:15.668154 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60157d13-f95a-4362-8ed2-2f9eb878bf81 could not be found. Aug 24 10:27:15.668154 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:15.668154 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:15.668154 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:15.668154 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:15.668154 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:15.668154 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:15.668154 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:27:15.668154 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:27:15.668154 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60157d13-f95a-4362-8ed2-2f9eb878bf81 could not be found. Aug 24 10:27:15.668154 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:15.672416 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a10be609-cda0-4ad3-b35d-87f17af17781 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Returning 404 to user: Instance 60157d13-f95a-4362-8ed2-2f9eb878bf81 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:27:15.675724 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a10be609-cda0-4ad3-b35d-87f17af17781 tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] 10.222.0.85 "POST /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81/action" status: 404 len: 111 microversion: 2.1 time: 0.150188 Aug 24 10:27:15.684665 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1473/3328] 10.222.0.85 () {60 vars in 1279 bytes} [Wed Aug 24 10:27:15 2022] POST /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81/action => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:27:15.700390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-a877bd94-7179-4110-bf04-23c4eca30063 req-184034ce-706c-4b05-82e9-40565b919f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60157d13-f95a-4362-8ed2-2f9eb878bf81", "name": "network-vif-deleted", "tag": "603d0568-5332-4e02-853c-c7a9c7e74d4b"}, {"name": "network-changed", "server_uuid": "1ade0e12-9ac0-459f-8f85-6743432302fa", "tag": "0a936ebf-bd84-48ce-b0c2-fac98f570a10"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:15.734173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a877bd94-7179-4110-bf04-23c4eca30063 req-184034ce-706c-4b05-82e9-40565b919f3a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:15.734931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a877bd94-7179-4110-bf04-23c4eca30063 req-184034ce-706c-4b05-82e9-40565b919f3a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:15.739188 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a877bd94-7179-4110-bf04-23c4eca30063 req-184034ce-706c-4b05-82e9-40565b919f3a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:15.781164 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-a877bd94-7179-4110-bf04-23c4eca30063 req-184034ce-706c-4b05-82e9-40565b919f3a service nova] Creating event network-vif-deleted:603d0568-5332-4e02-853c-c7a9c7e74d4b for instance 60157d13-f95a-4362-8ed2-2f9eb878bf81 on n-h1-849328-3 Aug 24 10:27:15.782369 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-a877bd94-7179-4110-bf04-23c4eca30063 req-184034ce-706c-4b05-82e9-40565b919f3a service nova] Creating event network-changed:0a936ebf-bd84-48ce-b0c2-fac98f570a10 for instance 1ade0e12-9ac0-459f-8f85-6743432302fa on n-h1-849328-3 Aug 24 10:27:15.795981 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-a877bd94-7179-4110-bf04-23c4eca30063 req-184034ce-706c-4b05-82e9-40565b919f3a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.107346 Aug 24 10:27:15.796541 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1474/3329] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:27:15.804973 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d0de7a42-7e23-4fb5-b5c0-c47421bd3df2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:15.806062 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d0de7a42-7e23-4fb5-b5c0-c47421bd3df2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:15.816513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0de7a42-7e23-4fb5-b5c0-c47421bd3df2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:15.817937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0de7a42-7e23-4fb5-b5c0-c47421bd3df2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:15.818919 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0de7a42-7e23-4fb5-b5c0-c47421bd3df2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:15.819997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0de7a42-7e23-4fb5-b5c0-c47421bd3df2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:15.821009 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0de7a42-7e23-4fb5-b5c0-c47421bd3df2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:15.822194 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0de7a42-7e23-4fb5-b5c0-c47421bd3df2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:16.127566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-99fe262d-a25c-4a8a-87d2-7a64e155c2d5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:27:16.128581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-99fe262d-a25c-4a8a-87d2-7a64e155c2d5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:27:16.129447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-99fe262d-a25c-4a8a-87d2-7a64e155c2d5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:27:16.130062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-99fe262d-a25c-4a8a-87d2-7a64e155c2d5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:27:16.130668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-99fe262d-a25c-4a8a-87d2-7a64e155c2d5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:27:16.163986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99fe262d-a25c-4a8a-87d2-7a64e155c2d5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:16.164979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99fe262d-a25c-4a8a-87d2-7a64e155c2d5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:16.165623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99fe262d-a25c-4a8a-87d2-7a64e155c2d5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:16.168040 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99fe262d-a25c-4a8a-87d2-7a64e155c2d5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:16.168682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99fe262d-a25c-4a8a-87d2-7a64e155c2d5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:16.169302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99fe262d-a25c-4a8a-87d2-7a64e155c2d5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:16.211950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-99fe262d-a25c-4a8a-87d2-7a64e155c2d5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Getting quotas for project 9dfeb7213b504942a32e3b8ab5c46798. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:27:16.218038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-99fe262d-a25c-4a8a-87d2-7a64e155c2d5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Getting quotas for user ec7478d6249742d0a177be1168a8c481 and project 9dfeb7213b504942a32e3b8ab5c46798. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:27:16.238475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-99fe262d-a25c-4a8a-87d2-7a64e155c2d5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:27:16.241251 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-99fe262d-a25c-4a8a-87d2-7a64e155c2d5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:27:16.337371 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-99fe262d-a25c-4a8a-87d2-7a64e155c2d5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.047428 Aug 24 10:27:16.339463 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1856/3330] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:27:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 4051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:27:16.344538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c4777105-3fff-4ed6-9dbf-b91b23fb08fb tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:16.358097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c4777105-3fff-4ed6-9dbf-b91b23fb08fb tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] [instance: 828b46b2-00a2-4e00-b2b7-bc20d0d34f86] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:16.379784 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4777105-3fff-4ed6-9dbf-b91b23fb08fb tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:16.380314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4777105-3fff-4ed6-9dbf-b91b23fb08fb tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:16.380751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4777105-3fff-4ed6-9dbf-b91b23fb08fb tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:16.381449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4777105-3fff-4ed6-9dbf-b91b23fb08fb tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:16.381909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4777105-3fff-4ed6-9dbf-b91b23fb08fb tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:16.382339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4777105-3fff-4ed6-9dbf-b91b23fb08fb tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:16.441707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:16.454209 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-c4777105-3fff-4ed6-9dbf-b91b23fb08fb tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] HTTP exception thrown: Instance 828b46b2-00a2-4e00-b2b7-bc20d0d34f86 could not be found. Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c4777105-3fff-4ed6-9dbf-b91b23fb08fb tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Request method failure captured: Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86 HTTP/1.1 Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfzUIWkrsHpu4OdPgSnxERUlbCnukKkldRmSA9VPtXWTKDxFvOunHR5qGG3CmfZz2hvVDuQwaB496S43w7HbHXRWnt3jaxUKH4AgBG4AK9FfjP-cE7-9jOnvkTXY8T_0GzBx9go1KICrw1O-fQ7WyXL7Sn5yIR9fAVNFwG6MkFhPXt4 Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: b38653c7bc12485ba8d0de49f2db2820 Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerGroupTestJSON-1705454618 Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b38653c7bc12485ba8d0de49f2db2820"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b38653c7bc12485ba8d0de49f2db2820", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b38653c7bc12485ba8d0de49f2db2820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b38653c7bc12485ba8d0de49f2db2820"}]}] Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerGroupTestJSON-1705454618 Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: b38653c7bc12485ba8d0de49f2db2820 Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerGroupTestJSON-1705454618 Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerGroupTestJSON-1705454618-project Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 54d798bffa944169b1ba0b6042698374 Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerGroupTestJSON-1705454618-project Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 828b46b2-00a2-4e00-b2b7-bc20d0d34f86 could not be found. Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '828b46b2-00a2-4e00-b2b7-bc20d0d34f86'} Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 828b46b2-00a2-4e00-b2b7-bc20d0d34f86 could not be found. Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:27:16.456290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:27:16.460358 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 828b46b2-00a2-4e00-b2b7-bc20d0d34f86 could not be found. Aug 24 10:27:16.460358 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:27:16.460358 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:16.460358 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:27:16.460358 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:16.460358 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:16.460358 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:16.460358 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:27:16.460358 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:27:16.460358 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 828b46b2-00a2-4e00-b2b7-bc20d0d34f86 could not be found. Aug 24 10:27:16.460358 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:27:16.463172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c4777105-3fff-4ed6-9dbf-b91b23fb08fb tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Returning 404 to user: Instance 828b46b2-00a2-4e00-b2b7-bc20d0d34f86 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:27:16.464281 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c4777105-3fff-4ed6-9dbf-b91b23fb08fb tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "DELETE /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86" status: 404 len: 111 microversion: 2.1 time: 0.123649 Aug 24 10:27:16.465484 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1857/3331] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:27:16 2022] DELETE /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:27:16.476015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-99e88761-7b40-41a5-8a1f-d756e2c6caae tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2050486123", "metadata": {"image_type": "test"}}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:16.485251 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-99e88761-7b40-41a5-8a1f-d756e2c6caae tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Failed to fetch instance by id tempest-invalid-366808113 {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 24 10:27:16.485879 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-99e88761-7b40-41a5-8a1f-d756e2c6caae tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] HTTP exception thrown: Instance tempest-invalid-366808113 could not be found. Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-99e88761-7b40-41a5-8a1f-d756e2c6caae tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Request method failure captured: Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/tempest-invalid-366808113/action HTTP/1.1 Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 112 Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfzZv3v1tUM6DTgaGkhOywvGOMVR1vlp44PN2YwtQ7KuZlZ41fENMMJWq9n2ApOAGIhVZMjIgnp65ncq9yRGOFG9k7JAP7Zoo61V7mLoU5VrDYRfDJQQfTkkXhmfpzH3-4VM9j1hhBhD_R9OaNCLfl-IO9FzbxPNs5fDwLOr71zE3aE Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: f9786b6d72ea4462ae31882e65d377b7 Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesNegativeTestJSON-1281684413 Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f9786b6d72ea4462ae31882e65d377b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f9786b6d72ea4462ae31882e65d377b7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f9786b6d72ea4462ae31882e65d377b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f9786b6d72ea4462ae31882e65d377b7"}]}] Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesNegativeTestJSON-1281684413 Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: f9786b6d72ea4462ae31882e65d377b7 Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1281684413 Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesNegativeTestJSON-1281684413-project Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 539d440d00964721bbe156236eaff442 Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesNegativeTestJSON-1281684413-project Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2050486123", "metadata": {"image_type": "test"}}} Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance tempest-invalid-366808113 could not be found. Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'tempest-invalid-366808113', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-2050486123', 'metadata': {'image_type': 'test'}}}} Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-366808113 could not be found. Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:27:16.494505 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-366808113 could not be found. Aug 24 10:27:16.499569 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:27:16.499569 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:16.499569 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:27:16.499569 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:16.499569 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:16.499569 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:16.499569 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:27:16.499569 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:27:16.499569 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-366808113 could not be found. Aug 24 10:27:16.499569 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:27:16.499569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-99e88761-7b40-41a5-8a1f-d756e2c6caae tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Returning 404 to user: Instance tempest-invalid-366808113 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:27:16.501825 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-99e88761-7b40-41a5-8a1f-d756e2c6caae tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] 10.222.0.85 "POST /compute/v2.1/servers/tempest-invalid-366808113/action" status: 404 len: 100 microversion: 2.1 time: 0.035079 Aug 24 10:27:16.521748 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1858/3332] 10.222.0.85 () {60 vars in 1246 bytes} [Wed Aug 24 10:27:16 2022] POST /compute/v2.1/servers/tempest-invalid-366808113/action => generated 100 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:27:16.550088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ec44c97-7e25-44bb-9b7c-a5ae8541c491 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:16.556609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8ec44c97-7e25-44bb-9b7c-a5ae8541c491 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:16.919077 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d0de7a42-7e23-4fb5-b5c0-c47421bd3df2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:16.929016 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8ec44c97-7e25-44bb-9b7c-a5ae8541c491 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:16.937926 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d0de7a42-7e23-4fb5-b5c0-c47421bd3df2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1524 microversion: 2.1 time: 1.138929 Aug 24 10:27:16.943238 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8ec44c97-7e25-44bb-9b7c-a5ae8541c491 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1217 microversion: 2.1 time: 0.420243 Aug 24 10:27:16.953384 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1859/3333] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:16 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1217 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:16.954265 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1475/3334] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:15 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1524 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:16.969641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6aa48aa1-4e62-4fae-a52f-350d3937282c tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:16.973682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c49842d5-2793-46b4-9f53-d90afd419687 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:16.978094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c49842d5-2793-46b4-9f53-d90afd419687 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:16.979110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6aa48aa1-4e62-4fae-a52f-350d3937282c tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] [instance: 828b46b2-00a2-4e00-b2b7-bc20d0d34f86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:17.020328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c49842d5-2793-46b4-9f53-d90afd419687 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:17.020847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c49842d5-2793-46b4-9f53-d90afd419687 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:17.021334 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c49842d5-2793-46b4-9f53-d90afd419687 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:17.022067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c49842d5-2793-46b4-9f53-d90afd419687 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:17.022526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c49842d5-2793-46b4-9f53-d90afd419687 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:17.022957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c49842d5-2793-46b4-9f53-d90afd419687 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:17.027267 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aa48aa1-4e62-4fae-a52f-350d3937282c tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:17.030977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aa48aa1-4e62-4fae-a52f-350d3937282c tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:17.038073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aa48aa1-4e62-4fae-a52f-350d3937282c tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:17.038897 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aa48aa1-4e62-4fae-a52f-350d3937282c tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:17.039439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aa48aa1-4e62-4fae-a52f-350d3937282c tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:17.039864 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aa48aa1-4e62-4fae-a52f-350d3937282c tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:17.101587 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-6aa48aa1-4e62-4fae-a52f-350d3937282c tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] HTTP exception thrown: Instance 828b46b2-00a2-4e00-b2b7-bc20d0d34f86 could not be found. Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6aa48aa1-4e62-4fae-a52f-350d3937282c tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Request method failure captured: Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86 HTTP/1.1 Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfzUIWkrsHpu4OdPgSnxERUlbCnukKkldRmSA9VPtXWTKDxFvOunHR5qGG3CmfZz2hvVDuQwaB496S43w7HbHXRWnt3jaxUKH4AgBG4AK9FfjP-cE7-9jOnvkTXY8T_0GzBx9go1KICrw1O-fQ7WyXL7Sn5yIR9fAVNFwG6MkFhPXt4 Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: b38653c7bc12485ba8d0de49f2db2820 Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerGroupTestJSON-1705454618 Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b38653c7bc12485ba8d0de49f2db2820"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b38653c7bc12485ba8d0de49f2db2820", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b38653c7bc12485ba8d0de49f2db2820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b38653c7bc12485ba8d0de49f2db2820"}]}] Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerGroupTestJSON-1705454618 Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: b38653c7bc12485ba8d0de49f2db2820 Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerGroupTestJSON-1705454618 Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerGroupTestJSON-1705454618-project Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 54d798bffa944169b1ba0b6042698374 Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerGroupTestJSON-1705454618-project Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 828b46b2-00a2-4e00-b2b7-bc20d0d34f86 could not be found. Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '828b46b2-00a2-4e00-b2b7-bc20d0d34f86'} Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 828b46b2-00a2-4e00-b2b7-bc20d0d34f86 could not be found. Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 828b46b2-00a2-4e00-b2b7-bc20d0d34f86 could not be found. Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:17.103308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.108532 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:17.108532 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:17.108532 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:17.108532 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:27:17.108532 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:27:17.108532 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 828b46b2-00a2-4e00-b2b7-bc20d0d34f86 could not be found. Aug 24 10:27:17.108532 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.108532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6aa48aa1-4e62-4fae-a52f-350d3937282c tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Returning 404 to user: Instance 828b46b2-00a2-4e00-b2b7-bc20d0d34f86 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:27:17.108532 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6aa48aa1-4e62-4fae-a52f-350d3937282c tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86" status: 404 len: 111 microversion: 2.1 time: 0.147243 Aug 24 10:27:17.127792 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1476/3335] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:16 2022] GET /compute/v2.1/servers/828b46b2-00a2-4e00-b2b7-bc20d0d34f86 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:27:17.135991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-faa73a29-cae6-4304-b0d7-332304755f0b tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-326425813"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:17.143885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-faa73a29-cae6-4304-b0d7-332304755f0b tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 24 10:27:17.144689 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-faa73a29-cae6-4304-b0d7-332304755f0b tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-faa73a29-cae6-4304-b0d7-332304755f0b tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Request method failure captured: Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 56 Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfzZv3v1tUM6DTgaGkhOywvGOMVR1vlp44PN2YwtQ7KuZlZ41fENMMJWq9n2ApOAGIhVZMjIgnp65ncq9yRGOFG9k7JAP7Zoo61V7mLoU5VrDYRfDJQQfTkkXhmfpzH3-4VM9j1hhBhD_R9OaNCLfl-IO9FzbxPNs5fDwLOr71zE3aE Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: f9786b6d72ea4462ae31882e65d377b7 Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesNegativeTestJSON-1281684413 Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f9786b6d72ea4462ae31882e65d377b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f9786b6d72ea4462ae31882e65d377b7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f9786b6d72ea4462ae31882e65d377b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f9786b6d72ea4462ae31882e65d377b7"}]}] Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesNegativeTestJSON-1281684413 Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: f9786b6d72ea4462ae31882e65d377b7 Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1281684413 Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ImagesNegativeTestJSON-1281684413-project Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 539d440d00964721bbe156236eaff442 Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesNegativeTestJSON-1281684413-project Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: {"createImage": {"name": "tempest-test-snap-326425813"}} Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-326425813'}}} Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 10:27:17.146503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.151127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:17.151127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.151127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:17.151127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:17.151127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:17.151127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:27:17.151127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:27:17.151127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 10:27:17.151127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.152642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-faa73a29-cae6-4304-b0d7-332304755f0b tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:27:17.153756 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-faa73a29-cae6-4304-b0d7-332304755f0b tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] 10.222.0.85 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.024671 Aug 24 10:27:17.154960 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1477/3336] 10.222.0.85 () {60 vars in 1275 bytes} [Wed Aug 24 10:27:17 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:27:17.160902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8e0551fc-26f3-4986-8e2d-eac9f4342e9b tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:17.171925 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-8e0551fc-26f3-4986-8e2d-eac9f4342e9b tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] HTTP exception thrown: Instance group ab75a09c-58a6-4e4f-994b-361217555e5b could not be found. Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8e0551fc-26f3-4986-8e2d-eac9f4342e9b tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Request method failure captured: Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/os-server-groups/ab75a09c-58a6-4e4f-994b-361217555e5b HTTP/1.1 Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfzUIWkrsHpu4OdPgSnxERUlbCnukKkldRmSA9VPtXWTKDxFvOunHR5qGG3CmfZz2hvVDuQwaB496S43w7HbHXRWnt3jaxUKH4AgBG4AK9FfjP-cE7-9jOnvkTXY8T_0GzBx9go1KICrw1O-fQ7WyXL7Sn5yIR9fAVNFwG6MkFhPXt4 Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: b38653c7bc12485ba8d0de49f2db2820 Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerGroupTestJSON-1705454618 Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b38653c7bc12485ba8d0de49f2db2820"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b38653c7bc12485ba8d0de49f2db2820", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b38653c7bc12485ba8d0de49f2db2820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b38653c7bc12485ba8d0de49f2db2820"}]}] Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerGroupTestJSON-1705454618 Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: b38653c7bc12485ba8d0de49f2db2820 Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerGroupTestJSON-1705454618 Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerGroupTestJSON-1705454618-project Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 54d798bffa944169b1ba0b6042698374 Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerGroupTestJSON-1705454618-project Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance group ab75a09c-58a6-4e4f-994b-361217555e5b could not be found. Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'ab75a09c-58a6-4e4f-994b-361217555e5b'} Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ab75a09c-58a6-4e4f-994b-361217555e5b could not be found. Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ab75a09c-58a6-4e4f-994b-361217555e5b could not be found. Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.178551 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:17.183363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:17.183363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:17.183363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:27:17.183363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:27:17.183363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ab75a09c-58a6-4e4f-994b-361217555e5b could not be found. Aug 24 10:27:17.183363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.186917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8e0551fc-26f3-4986-8e2d-eac9f4342e9b tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Returning 404 to user: Instance group ab75a09c-58a6-4e4f-994b-361217555e5b could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:27:17.202482 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8e0551fc-26f3-4986-8e2d-eac9f4342e9b tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "DELETE /compute/v2.1/os-server-groups/ab75a09c-58a6-4e4f-994b-361217555e5b" status: 404 len: 117 microversion: 2.1 time: 0.045931 Aug 24 10:27:17.209469 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1478/3337] 10.222.0.85 () {58 vars in 1266 bytes} [Wed Aug 24 10:27:17 2022] DELETE /compute/v2.1/os-server-groups/ab75a09c-58a6-4e4f-994b-361217555e5b => generated 117 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:27:17.217271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f400102f-22fa-435e-967c-5c5ebbf9e69f tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-757544529"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:17.220020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f400102f-22fa-435e-967c-5c5ebbf9e69f tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 24 10:27:17.224505 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-f400102f-22fa-435e-967c-5c5ebbf9e69f tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f400102f-22fa-435e-967c-5c5ebbf9e69f tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Request method failure captured: Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 56 Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfzZv3v1tUM6DTgaGkhOywvGOMVR1vlp44PN2YwtQ7KuZlZ41fENMMJWq9n2ApOAGIhVZMjIgnp65ncq9yRGOFG9k7JAP7Zoo61V7mLoU5VrDYRfDJQQfTkkXhmfpzH3-4VM9j1hhBhD_R9OaNCLfl-IO9FzbxPNs5fDwLOr71zE3aE Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: f9786b6d72ea4462ae31882e65d377b7 Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesNegativeTestJSON-1281684413 Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f9786b6d72ea4462ae31882e65d377b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f9786b6d72ea4462ae31882e65d377b7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f9786b6d72ea4462ae31882e65d377b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f9786b6d72ea4462ae31882e65d377b7"}]}] Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesNegativeTestJSON-1281684413 Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: f9786b6d72ea4462ae31882e65d377b7 Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1281684413 Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ImagesNegativeTestJSON-1281684413-project Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 539d440d00964721bbe156236eaff442 Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesNegativeTestJSON-1281684413-project Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: {"createImage": {"name": "tempest-test-snap-757544529"}} Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-757544529'}}} Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 10:27:17.226991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.231805 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:17.231805 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.231805 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:17.231805 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:17.231805 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:17.231805 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:27:17.231805 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:27:17.231805 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 10:27:17.231805 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.236074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f400102f-22fa-435e-967c-5c5ebbf9e69f tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:27:17.237239 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f400102f-22fa-435e-967c-5c5ebbf9e69f tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] 10.222.0.85 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.026445 Aug 24 10:27:17.238433 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1479/3338] 10.222.0.85 () {60 vars in 1281 bytes} [Wed Aug 24 10:27:17 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:27:17.244973 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9042f1ca-3f06-4731-8c83-84dc88e8603e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:17.257279 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-9042f1ca-3f06-4731-8c83-84dc88e8603e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] HTTP exception thrown: Instance group a4317ba5-5cbb-4876-97b3-ffd309061482 could not be found. Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9042f1ca-3f06-4731-8c83-84dc88e8603e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Request method failure captured: Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/os-server-groups/a4317ba5-5cbb-4876-97b3-ffd309061482 HTTP/1.1 Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfzUIWkrsHpu4OdPgSnxERUlbCnukKkldRmSA9VPtXWTKDxFvOunHR5qGG3CmfZz2hvVDuQwaB496S43w7HbHXRWnt3jaxUKH4AgBG4AK9FfjP-cE7-9jOnvkTXY8T_0GzBx9go1KICrw1O-fQ7WyXL7Sn5yIR9fAVNFwG6MkFhPXt4 Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: b38653c7bc12485ba8d0de49f2db2820 Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerGroupTestJSON-1705454618 Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b38653c7bc12485ba8d0de49f2db2820"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b38653c7bc12485ba8d0de49f2db2820", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b38653c7bc12485ba8d0de49f2db2820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b38653c7bc12485ba8d0de49f2db2820"}]}] Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerGroupTestJSON-1705454618 Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: b38653c7bc12485ba8d0de49f2db2820 Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerGroupTestJSON-1705454618 Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerGroupTestJSON-1705454618-project Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 54d798bffa944169b1ba0b6042698374 Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerGroupTestJSON-1705454618-project Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance group a4317ba5-5cbb-4876-97b3-ffd309061482 could not be found. Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'a4317ba5-5cbb-4876-97b3-ffd309061482'} Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a4317ba5-5cbb-4876-97b3-ffd309061482 could not be found. Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a4317ba5-5cbb-4876-97b3-ffd309061482 could not be found. Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.260135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:17.265187 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:17.265187 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:17.265187 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:27:17.265187 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:27:17.265187 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a4317ba5-5cbb-4876-97b3-ffd309061482 could not be found. Aug 24 10:27:17.265187 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.267337 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9042f1ca-3f06-4731-8c83-84dc88e8603e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Returning 404 to user: Instance group a4317ba5-5cbb-4876-97b3-ffd309061482 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:27:17.268467 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9042f1ca-3f06-4731-8c83-84dc88e8603e tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "DELETE /compute/v2.1/os-server-groups/a4317ba5-5cbb-4876-97b3-ffd309061482" status: 404 len: 117 microversion: 2.1 time: 0.028820 Aug 24 10:27:17.274247 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1480/3339] 10.222.0.85 () {58 vars in 1266 bytes} [Wed Aug 24 10:27:17 2022] DELETE /compute/v2.1/os-server-groups/a4317ba5-5cbb-4876-97b3-ffd309061482 => generated 117 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:27:17.286211 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8571a3c9-8080-4b05-aef9-88434147977d tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:17.287115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8571a3c9-8080-4b05-aef9-88434147977d tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] [instance: 60157d13-f95a-4362-8ed2-2f9eb878bf81] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:17.308331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8571a3c9-8080-4b05-aef9-88434147977d tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:17.308836 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8571a3c9-8080-4b05-aef9-88434147977d tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:17.309312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8571a3c9-8080-4b05-aef9-88434147977d tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:17.314717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8571a3c9-8080-4b05-aef9-88434147977d tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:17.315206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8571a3c9-8080-4b05-aef9-88434147977d tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:17.315641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8571a3c9-8080-4b05-aef9-88434147977d tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:17.343744 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-8571a3c9-8080-4b05-aef9-88434147977d tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] HTTP exception thrown: Instance 60157d13-f95a-4362-8ed2-2f9eb878bf81 could not be found. Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8571a3c9-8080-4b05-aef9-88434147977d tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Request method failure captured: Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81 HTTP/1.1 Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfzZv3v1tUM6DTgaGkhOywvGOMVR1vlp44PN2YwtQ7KuZlZ41fENMMJWq9n2ApOAGIhVZMjIgnp65ncq9yRGOFG9k7JAP7Zoo61V7mLoU5VrDYRfDJQQfTkkXhmfpzH3-4VM9j1hhBhD_R9OaNCLfl-IO9FzbxPNs5fDwLOr71zE3aE Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: f9786b6d72ea4462ae31882e65d377b7 Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesNegativeTestJSON-1281684413 Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f9786b6d72ea4462ae31882e65d377b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f9786b6d72ea4462ae31882e65d377b7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f9786b6d72ea4462ae31882e65d377b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f9786b6d72ea4462ae31882e65d377b7"}]}] Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesNegativeTestJSON-1281684413 Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: f9786b6d72ea4462ae31882e65d377b7 Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1281684413 Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ImagesNegativeTestJSON-1281684413-project Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 539d440d00964721bbe156236eaff442 Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesNegativeTestJSON-1281684413-project Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 60157d13-f95a-4362-8ed2-2f9eb878bf81 could not be found. Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '60157d13-f95a-4362-8ed2-2f9eb878bf81'} Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60157d13-f95a-4362-8ed2-2f9eb878bf81 could not be found. Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:27:17.345611 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:27:17.350556 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60157d13-f95a-4362-8ed2-2f9eb878bf81 could not be found. Aug 24 10:27:17.350556 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.350556 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:17.350556 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.350556 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:17.350556 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:17.350556 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:17.350556 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:27:17.350556 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:27:17.350556 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60157d13-f95a-4362-8ed2-2f9eb878bf81 could not be found. Aug 24 10:27:17.350556 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.359055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8571a3c9-8080-4b05-aef9-88434147977d tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Returning 404 to user: Instance 60157d13-f95a-4362-8ed2-2f9eb878bf81 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:27:17.360583 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8571a3c9-8080-4b05-aef9-88434147977d tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] 10.222.0.85 "DELETE /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81" status: 404 len: 111 microversion: 2.1 time: 0.083586 Aug 24 10:27:17.361663 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1481/3340] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:27:17 2022] DELETE /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:27:17.382501 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c99183eb-a383-4b71-a02e-0c2646457740 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:17.403247 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-c99183eb-a383-4b71-a02e-0c2646457740 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] HTTP exception thrown: Instance group 6698bfec-c3f3-4b78-b944-c2e7b0060ae4 could not be found. Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c99183eb-a383-4b71-a02e-0c2646457740 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Request method failure captured: Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/os-server-groups/6698bfec-c3f3-4b78-b944-c2e7b0060ae4 HTTP/1.1 Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfzUIWkrsHpu4OdPgSnxERUlbCnukKkldRmSA9VPtXWTKDxFvOunHR5qGG3CmfZz2hvVDuQwaB496S43w7HbHXRWnt3jaxUKH4AgBG4AK9FfjP-cE7-9jOnvkTXY8T_0GzBx9go1KICrw1O-fQ7WyXL7Sn5yIR9fAVNFwG6MkFhPXt4 Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: b38653c7bc12485ba8d0de49f2db2820 Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerGroupTestJSON-1705454618 Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b38653c7bc12485ba8d0de49f2db2820"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b38653c7bc12485ba8d0de49f2db2820", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b38653c7bc12485ba8d0de49f2db2820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b38653c7bc12485ba8d0de49f2db2820"}]}] Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerGroupTestJSON-1705454618 Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: b38653c7bc12485ba8d0de49f2db2820 Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerGroupTestJSON-1705454618 Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerGroupTestJSON-1705454618-project Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 54d798bffa944169b1ba0b6042698374 Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerGroupTestJSON-1705454618-project Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance group 6698bfec-c3f3-4b78-b944-c2e7b0060ae4 could not be found. Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '6698bfec-c3f3-4b78-b944-c2e7b0060ae4'} Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6698bfec-c3f3-4b78-b944-c2e7b0060ae4 could not be found. Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6698bfec-c3f3-4b78-b944-c2e7b0060ae4 could not be found. Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.405874 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:17.411384 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:17.411384 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:17.411384 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:27:17.411384 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:27:17.411384 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6698bfec-c3f3-4b78-b944-c2e7b0060ae4 could not be found. Aug 24 10:27:17.411384 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.417198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c99183eb-a383-4b71-a02e-0c2646457740 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Returning 404 to user: Instance group 6698bfec-c3f3-4b78-b944-c2e7b0060ae4 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:27:17.424356 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c99183eb-a383-4b71-a02e-0c2646457740 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "DELETE /compute/v2.1/os-server-groups/6698bfec-c3f3-4b78-b944-c2e7b0060ae4" status: 404 len: 117 microversion: 2.1 time: 0.058527 Aug 24 10:27:17.428499 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1482/3341] 10.222.0.85 () {58 vars in 1266 bytes} [Wed Aug 24 10:27:17 2022] DELETE /compute/v2.1/os-server-groups/6698bfec-c3f3-4b78-b944-c2e7b0060ae4 => generated 117 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:27:17.440833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f1559dec-592f-4395-ae54-286c801b1dab tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:17.441919 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f1559dec-592f-4395-ae54-286c801b1dab tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] [instance: 60157d13-f95a-4362-8ed2-2f9eb878bf81] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:17.481288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1559dec-592f-4395-ae54-286c801b1dab tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:17.481893 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1559dec-592f-4395-ae54-286c801b1dab tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:17.482359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1559dec-592f-4395-ae54-286c801b1dab tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:17.485589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1559dec-592f-4395-ae54-286c801b1dab tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:17.486084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1559dec-592f-4395-ae54-286c801b1dab tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:17.486533 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1559dec-592f-4395-ae54-286c801b1dab tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:17.542395 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-f1559dec-592f-4395-ae54-286c801b1dab tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] HTTP exception thrown: Instance 60157d13-f95a-4362-8ed2-2f9eb878bf81 could not be found. Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f1559dec-592f-4395-ae54-286c801b1dab tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Request method failure captured: Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81 HTTP/1.1 Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfzZv3v1tUM6DTgaGkhOywvGOMVR1vlp44PN2YwtQ7KuZlZ41fENMMJWq9n2ApOAGIhVZMjIgnp65ncq9yRGOFG9k7JAP7Zoo61V7mLoU5VrDYRfDJQQfTkkXhmfpzH3-4VM9j1hhBhD_R9OaNCLfl-IO9FzbxPNs5fDwLOr71zE3aE Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: f9786b6d72ea4462ae31882e65d377b7 Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesNegativeTestJSON-1281684413 Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f9786b6d72ea4462ae31882e65d377b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f9786b6d72ea4462ae31882e65d377b7", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f9786b6d72ea4462ae31882e65d377b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f9786b6d72ea4462ae31882e65d377b7"}]}] Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesNegativeTestJSON-1281684413 Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: f9786b6d72ea4462ae31882e65d377b7 Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1281684413 Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ImagesNegativeTestJSON-1281684413-project Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 539d440d00964721bbe156236eaff442 Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesNegativeTestJSON-1281684413-project Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 60157d13-f95a-4362-8ed2-2f9eb878bf81 could not be found. Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '60157d13-f95a-4362-8ed2-2f9eb878bf81'} Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60157d13-f95a-4362-8ed2-2f9eb878bf81 could not be found. Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60157d13-f95a-4362-8ed2-2f9eb878bf81 could not be found. Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:17.546106 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.552614 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:17.552614 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:17.552614 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:17.552614 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:27:17.552614 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:27:17.552614 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60157d13-f95a-4362-8ed2-2f9eb878bf81 could not be found. Aug 24 10:27:17.552614 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.552614 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f1559dec-592f-4395-ae54-286c801b1dab tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] Returning 404 to user: Instance 60157d13-f95a-4362-8ed2-2f9eb878bf81 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:27:17.552614 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f1559dec-592f-4395-ae54-286c801b1dab tempest-ImagesNegativeTestJSON-1281684413 tempest-ImagesNegativeTestJSON-1281684413-project] 10.222.0.85 "GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81" status: 404 len: 111 microversion: 2.1 time: 0.118854 Aug 24 10:27:17.552614 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1483/3342] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:17 2022] GET /compute/v2.1/servers/60157d13-f95a-4362-8ed2-2f9eb878bf81 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:27:17.570837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-807d09c8-2bc3-47e3-be01-091333596fff tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:17.603450 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-807d09c8-2bc3-47e3-be01-091333596fff tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] HTTP exception thrown: Instance group c26f54dd-6b7c-4b65-8319-c6740f51d84f could not be found. Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-807d09c8-2bc3-47e3-be01-091333596fff tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Request method failure captured: Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/os-server-groups/c26f54dd-6b7c-4b65-8319-c6740f51d84f HTTP/1.1 Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfzUIWkrsHpu4OdPgSnxERUlbCnukKkldRmSA9VPtXWTKDxFvOunHR5qGG3CmfZz2hvVDuQwaB496S43w7HbHXRWnt3jaxUKH4AgBG4AK9FfjP-cE7-9jOnvkTXY8T_0GzBx9go1KICrw1O-fQ7WyXL7Sn5yIR9fAVNFwG6MkFhPXt4 Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: b38653c7bc12485ba8d0de49f2db2820 Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerGroupTestJSON-1705454618 Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b38653c7bc12485ba8d0de49f2db2820"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b38653c7bc12485ba8d0de49f2db2820", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b38653c7bc12485ba8d0de49f2db2820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b38653c7bc12485ba8d0de49f2db2820"}]}] Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerGroupTestJSON-1705454618 Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: b38653c7bc12485ba8d0de49f2db2820 Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerGroupTestJSON-1705454618 Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerGroupTestJSON-1705454618-project Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 54d798bffa944169b1ba0b6042698374 Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerGroupTestJSON-1705454618-project Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance group c26f54dd-6b7c-4b65-8319-c6740f51d84f could not be found. Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'c26f54dd-6b7c-4b65-8319-c6740f51d84f'} Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c26f54dd-6b7c-4b65-8319-c6740f51d84f could not be found. Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c26f54dd-6b7c-4b65-8319-c6740f51d84f could not be found. Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.609011 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:17.613191 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:17.613191 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:17.613191 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:27:17.613191 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:27:17.613191 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c26f54dd-6b7c-4b65-8319-c6740f51d84f could not be found. Aug 24 10:27:17.613191 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:17.613191 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-807d09c8-2bc3-47e3-be01-091333596fff tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Returning 404 to user: Instance group c26f54dd-6b7c-4b65-8319-c6740f51d84f could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:27:17.613932 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-807d09c8-2bc3-47e3-be01-091333596fff tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "DELETE /compute/v2.1/os-server-groups/c26f54dd-6b7c-4b65-8319-c6740f51d84f" status: 404 len: 117 microversion: 2.1 time: 0.063606 Aug 24 10:27:17.615967 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1484/3343] 10.222.0.85 () {58 vars in 1266 bytes} [Wed Aug 24 10:27:17 2022] DELETE /compute/v2.1/os-server-groups/c26f54dd-6b7c-4b65-8319-c6740f51d84f => generated 117 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:27:17.634774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-beeb137e-4b76-4f64-a025-12016ceefcd5 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:17.637649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c49842d5-2793-46b4-9f53-d90afd419687 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:17.654680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c49842d5-2793-46b4-9f53-d90afd419687 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:17.659314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c49842d5-2793-46b4-9f53-d90afd419687 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:17.671138 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c49842d5-2793-46b4-9f53-d90afd419687 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1890 microversion: 2.42 time: 0.715443 Aug 24 10:27:17.680378 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1860/3344] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:27:16 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1890 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:27:17.705623 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-beeb137e-4b76-4f64-a025-12016ceefcd5 tempest-ServerGroupTestJSON-1705454618 tempest-ServerGroupTestJSON-1705454618-project] 10.222.0.85 "DELETE /compute/v2.1/os-server-groups/5b638a0f-55d5-4eba-8b03-4da7d89c936d" status: 204 len: 0 microversion: 2.1 time: 0.085811 Aug 24 10:27:17.714827 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1485/3345] 10.222.0.85 () {58 vars in 1266 bytes} [Wed Aug 24 10:27:17 2022] DELETE /compute/v2.1/os-server-groups/5b638a0f-55d5-4eba-8b03-4da7d89c936d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:27:17.942424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-19710c3a-2a68-47ce-85b5-88e8071b9d95 req-77dbac16-cad3-4461-a5be-5ca9443c1813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ade0e12-9ac0-459f-8f85-6743432302fa", "tag": "fa4b74d3-c905-4fde-af3d-45c9f745c900"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:17.967371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-19710c3a-2a68-47ce-85b5-88e8071b9d95 req-77dbac16-cad3-4461-a5be-5ca9443c1813 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:17.968166 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-19710c3a-2a68-47ce-85b5-88e8071b9d95 req-77dbac16-cad3-4461-a5be-5ca9443c1813 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:17.968831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-19710c3a-2a68-47ce-85b5-88e8071b9d95 req-77dbac16-cad3-4461-a5be-5ca9443c1813 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:17.989204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1984b405-1322-474e-ac98-8c154e4e4b1b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:17.991911 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1984b405-1322-474e-ac98-8c154e4e4b1b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:18.015991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1984b405-1322-474e-ac98-8c154e4e4b1b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:18.020930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1984b405-1322-474e-ac98-8c154e4e4b1b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:18.021923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1984b405-1322-474e-ac98-8c154e4e4b1b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:18.025929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1984b405-1322-474e-ac98-8c154e4e4b1b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:18.030067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1984b405-1322-474e-ac98-8c154e4e4b1b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:18.031017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1984b405-1322-474e-ac98-8c154e4e4b1b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:18.036226 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-19710c3a-2a68-47ce-85b5-88e8071b9d95 req-77dbac16-cad3-4461-a5be-5ca9443c1813 service nova] Creating event network-changed:fa4b74d3-c905-4fde-af3d-45c9f745c900 for instance 1ade0e12-9ac0-459f-8f85-6743432302fa on n-h1-849328-3 Aug 24 10:27:18.054582 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-19710c3a-2a68-47ce-85b5-88e8071b9d95 req-77dbac16-cad3-4461-a5be-5ca9443c1813 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117804 Aug 24 10:27:18.056555 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1861/3346] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:27:18.068420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5db59667-6c2b-4dc6-aa7a-63fe02353384 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:18.071136 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5db59667-6c2b-4dc6-aa7a-63fe02353384 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:18.112287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5db59667-6c2b-4dc6-aa7a-63fe02353384 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:18.112569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5db59667-6c2b-4dc6-aa7a-63fe02353384 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:18.113026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5db59667-6c2b-4dc6-aa7a-63fe02353384 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:18.120132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5db59667-6c2b-4dc6-aa7a-63fe02353384 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:18.120663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5db59667-6c2b-4dc6-aa7a-63fe02353384 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:18.128639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5db59667-6c2b-4dc6-aa7a-63fe02353384 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:18.921188 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1984b405-1322-474e-ac98-8c154e4e4b1b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:18.932252 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1984b405-1322-474e-ac98-8c154e4e4b1b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1269 microversion: 2.1 time: 0.960438 Aug 24 10:27:18.940263 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1486/3347] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:17 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1269 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:18.958518 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b5dd7a0a-642b-43a8-ac27-7e05525e9ab5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:18.959195 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b5dd7a0a-642b-43a8-ac27-7e05525e9ab5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:18.972941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5dd7a0a-642b-43a8-ac27-7e05525e9ab5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:18.972941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5dd7a0a-642b-43a8-ac27-7e05525e9ab5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:18.977479 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5dd7a0a-642b-43a8-ac27-7e05525e9ab5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:18.978315 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5dd7a0a-642b-43a8-ac27-7e05525e9ab5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:18.978799 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5dd7a0a-642b-43a8-ac27-7e05525e9ab5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:18.979341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5dd7a0a-642b-43a8-ac27-7e05525e9ab5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:19.322586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5db59667-6c2b-4dc6-aa7a-63fe02353384 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:19.332824 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5db59667-6c2b-4dc6-aa7a-63fe02353384 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1506 microversion: 2.1 time: 1.273707 Aug 24 10:27:19.334227 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1862/3348] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:18 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1506 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:19.686449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b5dd7a0a-642b-43a8-ac27-7e05525e9ab5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:19.702892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b5dd7a0a-642b-43a8-ac27-7e05525e9ab5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:19.706870 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b5dd7a0a-642b-43a8-ac27-7e05525e9ab5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:19.708713 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b5dd7a0a-642b-43a8-ac27-7e05525e9ab5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.767292 Aug 24 10:27:19.710397 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1487/3349] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:27:18 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:27:19.963041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8db9a7b6-8429-471a-b4c7-0f3898a9e131 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:19.964543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8db9a7b6-8429-471a-b4c7-0f3898a9e131 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:19.975284 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8db9a7b6-8429-471a-b4c7-0f3898a9e131 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:19.976205 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8db9a7b6-8429-471a-b4c7-0f3898a9e131 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:19.977486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8db9a7b6-8429-471a-b4c7-0f3898a9e131 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:19.979430 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8db9a7b6-8429-471a-b4c7-0f3898a9e131 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:19.980134 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8db9a7b6-8429-471a-b4c7-0f3898a9e131 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:19.980810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8db9a7b6-8429-471a-b4c7-0f3898a9e131 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:20.188075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8db9a7b6-8429-471a-b4c7-0f3898a9e131 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:20.198474 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8db9a7b6-8429-471a-b4c7-0f3898a9e131 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1275 microversion: 2.1 time: 0.248109 Aug 24 10:27:20.214651 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1863/3350] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:19 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1275 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:20.356286 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c91b0bbe-77d6-4f99-ad28-80ff5288c537 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:20.356917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c91b0bbe-77d6-4f99-ad28-80ff5288c537 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:20.364910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c91b0bbe-77d6-4f99-ad28-80ff5288c537 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:20.366496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c91b0bbe-77d6-4f99-ad28-80ff5288c537 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:20.366496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c91b0bbe-77d6-4f99-ad28-80ff5288c537 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:20.366862 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c91b0bbe-77d6-4f99-ad28-80ff5288c537 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:20.371926 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c91b0bbe-77d6-4f99-ad28-80ff5288c537 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:20.372395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c91b0bbe-77d6-4f99-ad28-80ff5288c537 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:20.490465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-d2b0181f-f02e-4bd2-b04c-77e9cee7381e req-7b1ba5ba-4f53-40e2-93cf-f2d37fda23c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ade0e12-9ac0-459f-8f85-6743432302fa", "tag": "f508eefe-bb8e-440a-8dd6-3163d13f5d06"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:20.504885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:20.515882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d2b0181f-f02e-4bd2-b04c-77e9cee7381e req-7b1ba5ba-4f53-40e2-93cf-f2d37fda23c3 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:20.518878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d2b0181f-f02e-4bd2-b04c-77e9cee7381e req-7b1ba5ba-4f53-40e2-93cf-f2d37fda23c3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:20.521305 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d2b0181f-f02e-4bd2-b04c-77e9cee7381e req-7b1ba5ba-4f53-40e2-93cf-f2d37fda23c3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:20.550041 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-d2b0181f-f02e-4bd2-b04c-77e9cee7381e req-7b1ba5ba-4f53-40e2-93cf-f2d37fda23c3 service nova] Creating event network-changed:f508eefe-bb8e-440a-8dd6-3163d13f5d06 for instance 1ade0e12-9ac0-459f-8f85-6743432302fa on n-h1-849328-3 Aug 24 10:27:20.556133 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-d2b0181f-f02e-4bd2-b04c-77e9cee7381e req-7b1ba5ba-4f53-40e2-93cf-f2d37fda23c3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070980 Aug 24 10:27:20.557269 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1864/3351] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:27:20.738209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1c5356c9-5acc-467f-a8a6-1a31ded280fd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:20.740288 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1c5356c9-5acc-467f-a8a6-1a31ded280fd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:20.752515 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c5356c9-5acc-467f-a8a6-1a31ded280fd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:20.757724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c5356c9-5acc-467f-a8a6-1a31ded280fd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:20.761714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c5356c9-5acc-467f-a8a6-1a31ded280fd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:20.762862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c5356c9-5acc-467f-a8a6-1a31ded280fd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:20.767085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c5356c9-5acc-467f-a8a6-1a31ded280fd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:20.767871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c5356c9-5acc-467f-a8a6-1a31ded280fd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:20.772364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c91b0bbe-77d6-4f99-ad28-80ff5288c537 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:20.781465 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c91b0bbe-77d6-4f99-ad28-80ff5288c537 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1506 microversion: 2.1 time: 0.430334 Aug 24 10:27:20.793539 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1488/3352] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:20 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:21.220277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b2940b50-19e7-461d-9a0b-2632b4115324 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:21.220881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b2940b50-19e7-461d-9a0b-2632b4115324 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:21.227403 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2940b50-19e7-461d-9a0b-2632b4115324 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:21.227897 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2940b50-19e7-461d-9a0b-2632b4115324 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:21.228314 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2940b50-19e7-461d-9a0b-2632b4115324 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:21.229273 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2940b50-19e7-461d-9a0b-2632b4115324 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:21.229707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2940b50-19e7-461d-9a0b-2632b4115324 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:21.230294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2940b50-19e7-461d-9a0b-2632b4115324 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:21.468787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1c5356c9-5acc-467f-a8a6-1a31ded280fd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:21.479340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1c5356c9-5acc-467f-a8a6-1a31ded280fd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:21.481015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1c5356c9-5acc-467f-a8a6-1a31ded280fd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:21.482509 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1c5356c9-5acc-467f-a8a6-1a31ded280fd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.749072 Aug 24 10:27:21.483366 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1865/3353] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:27:20 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:27:21.488320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-1f5e9988-18a8-4e74-8437-36a4fe153366 req-d7f5d453-a5cb-443c-9be9-870527737c98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fdab911-592d-4d21-9420-fdadfea05875", "name": "network-vif-unplugged", "status": "completed", "tag": "32431dd4-4f50-43ba-b6d9-cd4dc40210f9"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:21.505343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1f5e9988-18a8-4e74-8437-36a4fe153366 req-d7f5d453-a5cb-443c-9be9-870527737c98 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:21.508001 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1f5e9988-18a8-4e74-8437-36a4fe153366 req-d7f5d453-a5cb-443c-9be9-870527737c98 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:21.508673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1f5e9988-18a8-4e74-8437-36a4fe153366 req-d7f5d453-a5cb-443c-9be9-870527737c98 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:21.516407 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b2940b50-19e7-461d-9a0b-2632b4115324 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:21.534130 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-1f5e9988-18a8-4e74-8437-36a4fe153366 req-d7f5d453-a5cb-443c-9be9-870527737c98 service nova] Creating event network-vif-unplugged:32431dd4-4f50-43ba-b6d9-cd4dc40210f9 for instance 0fdab911-592d-4d21-9420-fdadfea05875 on n-h1-849328-3 Aug 24 10:27:21.534692 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b2940b50-19e7-461d-9a0b-2632b4115324 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1275 microversion: 2.1 time: 0.318103 Aug 24 10:27:21.535962 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1489/3354] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:21 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1275 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:27:21.540827 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-1f5e9988-18a8-4e74-8437-36a4fe153366 req-d7f5d453-a5cb-443c-9be9-870527737c98 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056095 Aug 24 10:27:21.541529 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1866/3355] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:27:21.823038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-db6ecfcd-aa06-44a0-8ae9-52709fd7f6f1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:21.823677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-db6ecfcd-aa06-44a0-8ae9-52709fd7f6f1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:21.856478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db6ecfcd-aa06-44a0-8ae9-52709fd7f6f1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:21.856985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db6ecfcd-aa06-44a0-8ae9-52709fd7f6f1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:21.857532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db6ecfcd-aa06-44a0-8ae9-52709fd7f6f1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:21.858269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db6ecfcd-aa06-44a0-8ae9-52709fd7f6f1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:21.858729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db6ecfcd-aa06-44a0-8ae9-52709fd7f6f1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:21.859161 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db6ecfcd-aa06-44a0-8ae9-52709fd7f6f1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:22.484089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dccc4b36-fa6b-4990-9dac-25af1835e8c4 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1246179071", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "4b759b19-3100-47a6-ad9a-621b5b99c7ab"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:22.596258 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-dccc4b36-fa6b-4990-9dac-25af1835e8c4 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] validate_networks() for [('4b759b19-3100-47a6-ad9a-621b5b99c7ab', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:27:23.068383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-db6ecfcd-aa06-44a0-8ae9-52709fd7f6f1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:23.077281 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-db6ecfcd-aa06-44a0-8ae9-52709fd7f6f1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1506 microversion: 2.1 time: 1.276752 Aug 24 10:27:23.080694 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1490/3356] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:21 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1506 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:23.104423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8082bdf5-a441-4ab8-a183-d08a11e57f8c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:23.118058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8082bdf5-a441-4ab8-a183-d08a11e57f8c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:23.136908 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8082bdf5-a441-4ab8-a183-d08a11e57f8c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:23.137430 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8082bdf5-a441-4ab8-a183-d08a11e57f8c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:23.137885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8082bdf5-a441-4ab8-a183-d08a11e57f8c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:23.138602 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8082bdf5-a441-4ab8-a183-d08a11e57f8c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:23.139063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8082bdf5-a441-4ab8-a183-d08a11e57f8c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:23.139494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8082bdf5-a441-4ab8-a183-d08a11e57f8c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:23.974276 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8082bdf5-a441-4ab8-a183-d08a11e57f8c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:24.000576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8082bdf5-a441-4ab8-a183-d08a11e57f8c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:24.006192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8082bdf5-a441-4ab8-a183-d08a11e57f8c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:24.008734 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8082bdf5-a441-4ab8-a183-d08a11e57f8c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.910295 Aug 24 10:27:24.011556 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1491/3357] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:27:23 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:27:24.033710 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bac38ca7-914d-4ea4-81de-48177f7c3bb3 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:24.036429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bac38ca7-914d-4ea4-81de-48177f7c3bb3 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:24.048903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bac38ca7-914d-4ea4-81de-48177f7c3bb3 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:24.061954 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bac38ca7-914d-4ea4-81de-48177f7c3bb3 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:24.062419 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bac38ca7-914d-4ea4-81de-48177f7c3bb3 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:24.063252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bac38ca7-914d-4ea4-81de-48177f7c3bb3 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:24.063984 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bac38ca7-914d-4ea4-81de-48177f7c3bb3 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:24.064413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bac38ca7-914d-4ea4-81de-48177f7c3bb3 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:24.672995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-dccc4b36-fa6b-4990-9dac-25af1835e8c4 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:27:24.674088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-dccc4b36-fa6b-4990-9dac-25af1835e8c4 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:27:24.674733 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-dccc4b36-fa6b-4990-9dac-25af1835e8c4 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:27:24.675342 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-dccc4b36-fa6b-4990-9dac-25af1835e8c4 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:27:24.675927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-dccc4b36-fa6b-4990-9dac-25af1835e8c4 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:27:24.701390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dccc4b36-fa6b-4990-9dac-25af1835e8c4 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:24.702148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dccc4b36-fa6b-4990-9dac-25af1835e8c4 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:24.702611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dccc4b36-fa6b-4990-9dac-25af1835e8c4 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:24.703445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dccc4b36-fa6b-4990-9dac-25af1835e8c4 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:24.703910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dccc4b36-fa6b-4990-9dac-25af1835e8c4 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:24.704347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dccc4b36-fa6b-4990-9dac-25af1835e8c4 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:24.751852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-dccc4b36-fa6b-4990-9dac-25af1835e8c4 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Getting quotas for project f2db429e0f5a4bba8fab01176631a13e. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:27:24.759310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-dccc4b36-fa6b-4990-9dac-25af1835e8c4 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Getting quotas for user c6cdd36726334d00aff06d8da0d84918 and project f2db429e0f5a4bba8fab01176631a13e. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:27:24.782461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dccc4b36-fa6b-4990-9dac-25af1835e8c4 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:27:24.785223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dccc4b36-fa6b-4990-9dac-25af1835e8c4 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] [instance: 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:27:24.880155 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dccc4b36-fa6b-4990-9dac-25af1835e8c4 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.638071 Aug 24 10:27:24.883662 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1867/3358] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:27:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:27:24.907763 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0877bae5-e81d-46f5-a6f7-ac47aceb1eb2 req-2bdfd8d3-df8e-4c6a-9281-7d5d12b26cb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ade0e12-9ac0-459f-8f85-6743432302fa", "tag": "c070cc96-6844-4a0c-9556-217db4eaf193"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:24.936705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0877bae5-e81d-46f5-a6f7-ac47aceb1eb2 req-2bdfd8d3-df8e-4c6a-9281-7d5d12b26cb4 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:24.937369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0877bae5-e81d-46f5-a6f7-ac47aceb1eb2 req-2bdfd8d3-df8e-4c6a-9281-7d5d12b26cb4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:24.938045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0877bae5-e81d-46f5-a6f7-ac47aceb1eb2 req-2bdfd8d3-df8e-4c6a-9281-7d5d12b26cb4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:24.962839 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0877bae5-e81d-46f5-a6f7-ac47aceb1eb2 req-2bdfd8d3-df8e-4c6a-9281-7d5d12b26cb4 service nova] Creating event network-changed:c070cc96-6844-4a0c-9556-217db4eaf193 for instance 1ade0e12-9ac0-459f-8f85-6743432302fa on n-h1-849328-3 Aug 24 10:27:24.973682 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0877bae5-e81d-46f5-a6f7-ac47aceb1eb2 req-2bdfd8d3-df8e-4c6a-9281-7d5d12b26cb4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088768 Aug 24 10:27:24.979570 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1868/3359] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:27:25.090571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-6d9fd28b-3a73-4de4-886b-632cccf6d4c8 req-9a130a55-50c3-405b-9dcf-2a52ac5aa17c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "521e506a-4d4e-475f-b4e4-e7fc4552a7ac", "tag": "bb00dcc0-85f9-4f70-be7d-bf15304fa924"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:25.109793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6d9fd28b-3a73-4de4-886b-632cccf6d4c8 req-9a130a55-50c3-405b-9dcf-2a52ac5aa17c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:25.110392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6d9fd28b-3a73-4de4-886b-632cccf6d4c8 req-9a130a55-50c3-405b-9dcf-2a52ac5aa17c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:25.111075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6d9fd28b-3a73-4de4-886b-632cccf6d4c8 req-9a130a55-50c3-405b-9dcf-2a52ac5aa17c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:25.131078 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-6d9fd28b-3a73-4de4-886b-632cccf6d4c8 req-9a130a55-50c3-405b-9dcf-2a52ac5aa17c service nova] Creating event network-changed:bb00dcc0-85f9-4f70-be7d-bf15304fa924 for instance 521e506a-4d4e-475f-b4e4-e7fc4552a7ac on n-h2-849328-3 Aug 24 10:27:25.138299 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-6d9fd28b-3a73-4de4-886b-632cccf6d4c8 req-9a130a55-50c3-405b-9dcf-2a52ac5aa17c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155781 Aug 24 10:27:25.139181 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1869/3360] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:27:25.154229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-48eebe54-c79c-47b4-ba7b-063016fc435d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:25.156516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-48eebe54-c79c-47b4-ba7b-063016fc435d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:25.178035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48eebe54-c79c-47b4-ba7b-063016fc435d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:25.179210 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48eebe54-c79c-47b4-ba7b-063016fc435d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:25.179851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48eebe54-c79c-47b4-ba7b-063016fc435d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:25.180824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48eebe54-c79c-47b4-ba7b-063016fc435d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:25.183164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48eebe54-c79c-47b4-ba7b-063016fc435d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:25.183837 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48eebe54-c79c-47b4-ba7b-063016fc435d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:25.192785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bac38ca7-914d-4ea4-81de-48177f7c3bb3 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:25.200908 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bac38ca7-914d-4ea4-81de-48177f7c3bb3 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1317 microversion: 2.1 time: 1.188198 Aug 24 10:27:25.211651 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1492/3361] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:24 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1317 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:25.227587 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92be555f-1bc4-4d29-a1c6-7b52501a997c tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:25.229598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-92be555f-1bc4-4d29-a1c6-7b52501a997c tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] [instance: 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:25.486225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-48eebe54-c79c-47b4-ba7b-063016fc435d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:25.514979 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-48eebe54-c79c-47b4-ba7b-063016fc435d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 200 len: 1449 microversion: 2.1 time: 0.373705 Aug 24 10:27:25.516055 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1870/3362] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:25 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 1449 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:25.522798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bee56e54-56ca-43cb-95ba-1e1dd5ad3ddd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:25.523976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bee56e54-56ca-43cb-95ba-1e1dd5ad3ddd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:25.524907 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-92be555f-1bc4-4d29-a1c6-7b52501a997c tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdd36726334d00aff06d8da0d84918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2db429e0f5a4bba8fab01176631a13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:25.546448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bee56e54-56ca-43cb-95ba-1e1dd5ad3ddd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:25.547170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bee56e54-56ca-43cb-95ba-1e1dd5ad3ddd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:25.548653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bee56e54-56ca-43cb-95ba-1e1dd5ad3ddd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:25.549560 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-92be555f-1bc4-4d29-a1c6-7b52501a997c tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] 10.222.0.85 "GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a" status: 200 len: 1228 microversion: 2.1 time: 0.333437 Aug 24 10:27:25.551384 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1493/3363] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:25 2022] GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a => generated 1228 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:25.552933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bee56e54-56ca-43cb-95ba-1e1dd5ad3ddd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:25.554029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bee56e54-56ca-43cb-95ba-1e1dd5ad3ddd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:25.559185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bee56e54-56ca-43cb-95ba-1e1dd5ad3ddd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:25.567112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8d5eeb40-fe63-4113-b8c1-893ce80f0eac tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:25.570348 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8d5eeb40-fe63-4113-b8c1-893ce80f0eac tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:25.585966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d5eeb40-fe63-4113-b8c1-893ce80f0eac tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:25.588620 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d5eeb40-fe63-4113-b8c1-893ce80f0eac tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:25.589955 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d5eeb40-fe63-4113-b8c1-893ce80f0eac tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:25.593334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d5eeb40-fe63-4113-b8c1-893ce80f0eac tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:25.594079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d5eeb40-fe63-4113-b8c1-893ce80f0eac tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:25.595967 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d5eeb40-fe63-4113-b8c1-893ce80f0eac tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:25.669634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8d5eeb40-fe63-4113-b8c1-893ce80f0eac tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:27:25.680656 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.compute.api [None req-8d5eeb40-fe63-4113-b8c1-893ce80f0eac tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Working on deleting snapshot 38fae00f-7c9d-40fb-992f-1e86ab1bdd9b from shelved instance... Aug 24 10:27:25.988973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bee56e54-56ca-43cb-95ba-1e1dd5ad3ddd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:26.028700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bee56e54-56ca-43cb-95ba-1e1dd5ad3ddd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:26.030348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bee56e54-56ca-43cb-95ba-1e1dd5ad3ddd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:26.031756 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bee56e54-56ca-43cb-95ba-1e1dd5ad3ddd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.514626 Aug 24 10:27:26.032659 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1871/3364] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:27:25 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:27:26.235495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-95ef4ef3-3e03-4ba8-8a02-532a1565d3d6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:26.236300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-95ef4ef3-3e03-4ba8-8a02-532a1565d3d6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:26.251167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95ef4ef3-3e03-4ba8-8a02-532a1565d3d6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:26.261052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95ef4ef3-3e03-4ba8-8a02-532a1565d3d6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:26.261470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95ef4ef3-3e03-4ba8-8a02-532a1565d3d6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:26.265062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95ef4ef3-3e03-4ba8-8a02-532a1565d3d6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:26.265932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95ef4ef3-3e03-4ba8-8a02-532a1565d3d6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:26.272044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95ef4ef3-3e03-4ba8-8a02-532a1565d3d6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:26.741196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:26.811461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8d5eeb40-fe63-4113-b8c1-893ce80f0eac tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Doing local delete in cell e852a9c4-5bbb-4a78-aec0-794708e7e59e(cell1) {{(pid=122432) _delete /opt/stack/nova/nova/compute/api.py:2533}} Aug 24 10:27:26.812192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d5eeb40-fe63-4113-b8c1-893ce80f0eac tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:26.820404 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d5eeb40-fe63-4113-b8c1-893ce80f0eac tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:26.820893 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d5eeb40-fe63-4113-b8c1-893ce80f0eac tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:26.821379 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.compute.api [None req-8d5eeb40-fe63-4113-b8c1-893ce80f0eac tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 24 10:27:26.825168 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-8d5eeb40-fe63-4113-b8c1-893ce80f0eac tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] deallocate_for_instance() {{(pid=122432) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 24 10:27:27.099916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-95ef4ef3-3e03-4ba8-8a02-532a1565d3d6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:27.114780 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-95ef4ef3-3e03-4ba8-8a02-532a1565d3d6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1317 microversion: 2.1 time: 0.884742 Aug 24 10:27:27.116150 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1872/3365] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:26 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1317 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:27.131297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6a002a47-0bd5-4e1e-9a44-9d3563c21794 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:27.145784 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6a002a47-0bd5-4e1e-9a44-9d3563c21794 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] [instance: 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:27.154714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a002a47-0bd5-4e1e-9a44-9d3563c21794 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:27.155671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a002a47-0bd5-4e1e-9a44-9d3563c21794 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:27.156337 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a002a47-0bd5-4e1e-9a44-9d3563c21794 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:27.157313 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a002a47-0bd5-4e1e-9a44-9d3563c21794 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:27.157978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a002a47-0bd5-4e1e-9a44-9d3563c21794 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:27.158632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a002a47-0bd5-4e1e-9a44-9d3563c21794 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:27.369988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6a002a47-0bd5-4e1e-9a44-9d3563c21794 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdd36726334d00aff06d8da0d84918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2db429e0f5a4bba8fab01176631a13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:27.382138 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6a002a47-0bd5-4e1e-9a44-9d3563c21794 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] 10.222.0.85 "GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a" status: 200 len: 1286 microversion: 2.1 time: 0.264266 Aug 24 10:27:27.392393 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1873/3366] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:27 2022] GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a => generated 1286 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:27.416368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-69cc6535-324e-4a1e-a3d9-b247df221852 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:27.418091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-69cc6535-324e-4a1e-a3d9-b247df221852 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:27.430405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69cc6535-324e-4a1e-a3d9-b247df221852 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:27.432477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69cc6535-324e-4a1e-a3d9-b247df221852 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:27.433111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69cc6535-324e-4a1e-a3d9-b247df221852 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:27.434144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69cc6535-324e-4a1e-a3d9-b247df221852 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:27.434767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69cc6535-324e-4a1e-a3d9-b247df221852 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:27.435354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69cc6535-324e-4a1e-a3d9-b247df221852 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:27.901784 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-69cc6535-324e-4a1e-a3d9-b247df221852 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:27.925926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-69cc6535-324e-4a1e-a3d9-b247df221852 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:27.935433 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-69cc6535-324e-4a1e-a3d9-b247df221852 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:27.950486 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-69cc6535-324e-4a1e-a3d9-b247df221852 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.550558 Aug 24 10:27:27.967677 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1874/3367] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:27:27 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:27:28.135815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-81d7e4c6-a1b8-413e-a32a-61d1716655f6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:28.136425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-81d7e4c6-a1b8-413e-a32a-61d1716655f6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:28.149707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81d7e4c6-a1b8-413e-a32a-61d1716655f6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:28.151267 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81d7e4c6-a1b8-413e-a32a-61d1716655f6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:28.152078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81d7e4c6-a1b8-413e-a32a-61d1716655f6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:28.153819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81d7e4c6-a1b8-413e-a32a-61d1716655f6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:28.154524 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81d7e4c6-a1b8-413e-a32a-61d1716655f6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:28.155370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81d7e4c6-a1b8-413e-a32a-61d1716655f6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:28.588792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-81d7e4c6-a1b8-413e-a32a-61d1716655f6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:28.622608 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-81d7e4c6-a1b8-413e-a32a-61d1716655f6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1317 microversion: 2.1 time: 0.490690 Aug 24 10:27:28.638898 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1875/3368] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:28 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1317 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:27:28.654427 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-916aca67-41bb-4b01-8faa-a0f9a1ec90a1 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:28.659177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-916aca67-41bb-4b01-8faa-a0f9a1ec90a1 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] [instance: 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:28.672393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-916aca67-41bb-4b01-8faa-a0f9a1ec90a1 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:28.673353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-916aca67-41bb-4b01-8faa-a0f9a1ec90a1 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:28.673964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-916aca67-41bb-4b01-8faa-a0f9a1ec90a1 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:28.674864 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-916aca67-41bb-4b01-8faa-a0f9a1ec90a1 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:28.675527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-916aca67-41bb-4b01-8faa-a0f9a1ec90a1 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:28.676132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-916aca67-41bb-4b01-8faa-a0f9a1ec90a1 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:28.762747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-916aca67-41bb-4b01-8faa-a0f9a1ec90a1 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdd36726334d00aff06d8da0d84918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2db429e0f5a4bba8fab01176631a13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:28.783808 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-916aca67-41bb-4b01-8faa-a0f9a1ec90a1 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] 10.222.0.85 "GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a" status: 200 len: 1286 microversion: 2.1 time: 0.132739 Aug 24 10:27:28.785785 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1876/3369] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:28 2022] GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a => generated 1286 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:28.978009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d1af32a0-315b-4067-8c2b-63754f339f5b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:28.978617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d1af32a0-315b-4067-8c2b-63754f339f5b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:28.985650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1af32a0-315b-4067-8c2b-63754f339f5b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:28.986432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1af32a0-315b-4067-8c2b-63754f339f5b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:28.987068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1af32a0-315b-4067-8c2b-63754f339f5b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:28.987984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1af32a0-315b-4067-8c2b-63754f339f5b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:28.988630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1af32a0-315b-4067-8c2b-63754f339f5b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:28.989310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1af32a0-315b-4067-8c2b-63754f339f5b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:29.430039 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d1af32a0-315b-4067-8c2b-63754f339f5b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:29.454902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d1af32a0-315b-4067-8c2b-63754f339f5b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:29.456989 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d1af32a0-315b-4067-8c2b-63754f339f5b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:29.457946 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d1af32a0-315b-4067-8c2b-63754f339f5b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.484037 Aug 24 10:27:29.472588 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1877/3370] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:27:28 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:27:29.472588 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-19f7833e-0a5a-41c2-a3e0-5e0dc269e85b req-17f0a4d8-cf2d-47e2-ab90-3674fe7ad031 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ade0e12-9ac0-459f-8f85-6743432302fa", "tag": "baf5ca24-63d8-41c5-a43c-e62b747ae00c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:29.476482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-19f7833e-0a5a-41c2-a3e0-5e0dc269e85b req-17f0a4d8-cf2d-47e2-ab90-3674fe7ad031 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:29.477156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-19f7833e-0a5a-41c2-a3e0-5e0dc269e85b req-17f0a4d8-cf2d-47e2-ab90-3674fe7ad031 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:29.477498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-19f7833e-0a5a-41c2-a3e0-5e0dc269e85b req-17f0a4d8-cf2d-47e2-ab90-3674fe7ad031 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:29.501329 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-19f7833e-0a5a-41c2-a3e0-5e0dc269e85b req-17f0a4d8-cf2d-47e2-ab90-3674fe7ad031 service nova] Creating event network-changed:baf5ca24-63d8-41c5-a43c-e62b747ae00c for instance 1ade0e12-9ac0-459f-8f85-6743432302fa on n-h1-849328-3 Aug 24 10:27:29.510964 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-19f7833e-0a5a-41c2-a3e0-5e0dc269e85b req-17f0a4d8-cf2d-47e2-ab90-3674fe7ad031 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050391 Aug 24 10:27:29.512207 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1878/3371] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:27:29.646105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-867a391a-6e13-46ac-a3a9-c60964c31320 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:29.646836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-867a391a-6e13-46ac-a3a9-c60964c31320 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:29.664102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-867a391a-6e13-46ac-a3a9-c60964c31320 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:29.664715 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-867a391a-6e13-46ac-a3a9-c60964c31320 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:29.665202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-867a391a-6e13-46ac-a3a9-c60964c31320 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:29.671286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-867a391a-6e13-46ac-a3a9-c60964c31320 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:29.671900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-867a391a-6e13-46ac-a3a9-c60964c31320 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:29.672364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-867a391a-6e13-46ac-a3a9-c60964c31320 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:29.740565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-8d5eeb40-fe63-4113-b8c1-893ce80f0eac tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Updating instance_info_cache with network_info: [] {{(pid=122432) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 10:27:30.052872 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8d5eeb40-fe63-4113-b8c1-893ce80f0eac tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "DELETE /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 204 len: 0 microversion: 2.1 time: 4.498120 Aug 24 10:27:30.057054 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1494/3372] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:27:25 2022] DELETE /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 0 bytes in 4501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:27:30.063778 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e4602261-5b0c-40ef-b2d7-17572fb06230 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:30.064528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e4602261-5b0c-40ef-b2d7-17572fb06230 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] [instance: 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:30.071039 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-867a391a-6e13-46ac-a3a9-c60964c31320 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:30.071659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4602261-5b0c-40ef-b2d7-17572fb06230 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:30.072260 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4602261-5b0c-40ef-b2d7-17572fb06230 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:30.072804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4602261-5b0c-40ef-b2d7-17572fb06230 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:30.073699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4602261-5b0c-40ef-b2d7-17572fb06230 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:30.074400 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4602261-5b0c-40ef-b2d7-17572fb06230 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:30.075052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4602261-5b0c-40ef-b2d7-17572fb06230 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:30.083145 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-867a391a-6e13-46ac-a3a9-c60964c31320 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1317 microversion: 2.1 time: 0.442724 Aug 24 10:27:30.084432 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1879/3373] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:29 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1317 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:30.102015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c6098802-e71f-4965-a9c1-9ab4ee6bbb3b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:30.105102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c6098802-e71f-4965-a9c1-9ab4ee6bbb3b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:30.128449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6098802-e71f-4965-a9c1-9ab4ee6bbb3b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:30.129576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6098802-e71f-4965-a9c1-9ab4ee6bbb3b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:30.131478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6098802-e71f-4965-a9c1-9ab4ee6bbb3b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:30.132972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6098802-e71f-4965-a9c1-9ab4ee6bbb3b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:30.134481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6098802-e71f-4965-a9c1-9ab4ee6bbb3b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:30.137613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6098802-e71f-4965-a9c1-9ab4ee6bbb3b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:30.165036 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-c6098802-e71f-4965-a9c1-9ab4ee6bbb3b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] HTTP exception thrown: Instance 0fdab911-592d-4d21-9420-fdadfea05875 could not be found. Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c6098802-e71f-4965-a9c1-9ab4ee6bbb3b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Request method failure captured: Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 HTTP/1.1 Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfwVOwKbAI3HcYW4vDUwX5tmvWZcMN8iYYPbyv0cT05fZ_Z-LEPCm4LinUuprRdXqkjYpTNDBQ5PMwhn6CDfWO2m5UgqK-Sr-pjjwg2dd34HghINyEVE3T5Itg-PYKj0YMEqYVC5uIroOumu3tZy7M7156OT9EtIM2-BMTg5dhnnzv0 Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b324a37b01b644dfa301a561e6125672", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b324a37b01b644dfa301a561e6125672"}]}] Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: b49cb438da9f4b309d54bfef9fc19bda Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 0fdab911-592d-4d21-9420-fdadfea05875 could not be found. Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '0fdab911-592d-4d21-9420-fdadfea05875'} Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fdab911-592d-4d21-9420-fdadfea05875 could not be found. Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fdab911-592d-4d21-9420-fdadfea05875 could not be found. Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:30.166668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:27:30.172036 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:30.172036 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:30.172036 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:30.172036 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:27:30.172036 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:27:30.172036 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fdab911-592d-4d21-9420-fdadfea05875 could not be found. Aug 24 10:27:30.172036 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:27:30.172036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c6098802-e71f-4965-a9c1-9ab4ee6bbb3b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Returning 404 to user: Instance 0fdab911-592d-4d21-9420-fdadfea05875 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:27:30.172036 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c6098802-e71f-4965-a9c1-9ab4ee6bbb3b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 404 len: 111 microversion: 2.1 time: 0.082367 Aug 24 10:27:30.172036 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1880/3374] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:30 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:27:30.218892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e4602261-5b0c-40ef-b2d7-17572fb06230 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdd36726334d00aff06d8da0d84918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2db429e0f5a4bba8fab01176631a13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:30.230125 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e4602261-5b0c-40ef-b2d7-17572fb06230 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] 10.222.0.85 "GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a" status: 200 len: 1286 microversion: 2.1 time: 0.171478 Aug 24 10:27:30.238596 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1495/3375] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:30 2022] GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a => generated 1286 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:30.354041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b046bcb3-b74f-4451-afc6-8e0a5a76d41c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-933841773", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "fb7883d4-b081-478d-b08b-6c818132f5bd"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:30.448887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-b046bcb3-b74f-4451-afc6-8e0a5a76d41c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] validate_networks() for [('fb7883d4-b081-478d-b08b-6c818132f5bd', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:27:30.493194 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-77bdbcde-a75b-42c3-980b-5dda41782e68 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:30.494316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-77bdbcde-a75b-42c3-980b-5dda41782e68 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:30.512339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77bdbcde-a75b-42c3-980b-5dda41782e68 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:30.513718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77bdbcde-a75b-42c3-980b-5dda41782e68 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:30.515087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77bdbcde-a75b-42c3-980b-5dda41782e68 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:30.518110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77bdbcde-a75b-42c3-980b-5dda41782e68 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:30.519096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77bdbcde-a75b-42c3-980b-5dda41782e68 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:30.520579 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77bdbcde-a75b-42c3-980b-5dda41782e68 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:31.102639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b046bcb3-b74f-4451-afc6-8e0a5a76d41c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:27:31.103488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b046bcb3-b74f-4451-afc6-8e0a5a76d41c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:27:31.106436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b046bcb3-b74f-4451-afc6-8e0a5a76d41c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:27:31.106436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b046bcb3-b74f-4451-afc6-8e0a5a76d41c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:27:31.106436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b046bcb3-b74f-4451-afc6-8e0a5a76d41c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:27:31.115989 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b046bcb3-b74f-4451-afc6-8e0a5a76d41c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:31.116770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b046bcb3-b74f-4451-afc6-8e0a5a76d41c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:31.117495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b046bcb3-b74f-4451-afc6-8e0a5a76d41c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:31.118212 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b046bcb3-b74f-4451-afc6-8e0a5a76d41c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:31.118941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b046bcb3-b74f-4451-afc6-8e0a5a76d41c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:31.119372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b046bcb3-b74f-4451-afc6-8e0a5a76d41c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:31.140112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b046bcb3-b74f-4451-afc6-8e0a5a76d41c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Getting quotas for project b324a37b01b644dfa301a561e6125672. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:27:31.146968 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b046bcb3-b74f-4451-afc6-8e0a5a76d41c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Getting quotas for user b49cb438da9f4b309d54bfef9fc19bda and project b324a37b01b644dfa301a561e6125672. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:27:31.160836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b046bcb3-b74f-4451-afc6-8e0a5a76d41c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:27:31.163237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b046bcb3-b74f-4451-afc6-8e0a5a76d41c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:27:31.214020 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b046bcb3-b74f-4451-afc6-8e0a5a76d41c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.865773 Aug 24 10:27:31.215446 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1881/3376] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:27:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:27:31.221052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-337a8293-9bfe-4100-bb42-dcea4e5affaa req-840f67e9-3c1a-4096-804d-a67cb30d49da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "521e506a-4d4e-475f-b4e4-e7fc4552a7ac", "name": "network-vif-plugged", "status": "completed", "tag": "bb00dcc0-85f9-4f70-be7d-bf15304fa924"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:31.234752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-337a8293-9bfe-4100-bb42-dcea4e5affaa req-840f67e9-3c1a-4096-804d-a67cb30d49da service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:31.235711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-337a8293-9bfe-4100-bb42-dcea4e5affaa req-840f67e9-3c1a-4096-804d-a67cb30d49da service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:31.236306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-337a8293-9bfe-4100-bb42-dcea4e5affaa req-840f67e9-3c1a-4096-804d-a67cb30d49da service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:31.253104 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-337a8293-9bfe-4100-bb42-dcea4e5affaa req-840f67e9-3c1a-4096-804d-a67cb30d49da service nova] Creating event network-vif-plugged:bb00dcc0-85f9-4f70-be7d-bf15304fa924 for instance 521e506a-4d4e-475f-b4e4-e7fc4552a7ac on n-h2-849328-3 Aug 24 10:27:31.261293 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-337a8293-9bfe-4100-bb42-dcea4e5affaa req-840f67e9-3c1a-4096-804d-a67cb30d49da service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043883 Aug 24 10:27:31.268710 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1882/3377] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:27:31.277079 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f092c5ac-e5a3-4e2c-9751-4d3121bdf9fc tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:31.278552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f092c5ac-e5a3-4e2c-9751-4d3121bdf9fc tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:31.288025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f092c5ac-e5a3-4e2c-9751-4d3121bdf9fc tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:31.288893 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f092c5ac-e5a3-4e2c-9751-4d3121bdf9fc tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:31.289810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f092c5ac-e5a3-4e2c-9751-4d3121bdf9fc tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:31.291260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f092c5ac-e5a3-4e2c-9751-4d3121bdf9fc tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:31.291946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f092c5ac-e5a3-4e2c-9751-4d3121bdf9fc tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:31.292593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f092c5ac-e5a3-4e2c-9751-4d3121bdf9fc tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:31.298471 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:31.327485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-77bdbcde-a75b-42c3-980b-5dda41782e68 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:31.348945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-77bdbcde-a75b-42c3-980b-5dda41782e68 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:31.359023 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-77bdbcde-a75b-42c3-980b-5dda41782e68 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:31.360573 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-77bdbcde-a75b-42c3-980b-5dda41782e68 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.880300 Aug 24 10:27:31.361177 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1496/3378] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:27:30 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:27:31.374603 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d8173b89-bdeb-49a1-8ebc-dbe7dfd4a75f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:31.379547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d8173b89-bdeb-49a1-8ebc-dbe7dfd4a75f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:31.589150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d8173b89-bdeb-49a1-8ebc-dbe7dfd4a75f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:31.596712 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d8173b89-bdeb-49a1-8ebc-dbe7dfd4a75f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1214 microversion: 2.1 time: 0.227175 Aug 24 10:27:31.614062 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1497/3379] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:31 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1214 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:31.619394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-58b69c87-8a75-4237-8297-cadcd024da8e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:31.619957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-58b69c87-8a75-4237-8297-cadcd024da8e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] [instance: 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:31.627409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58b69c87-8a75-4237-8297-cadcd024da8e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:31.627914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58b69c87-8a75-4237-8297-cadcd024da8e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:31.628355 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58b69c87-8a75-4237-8297-cadcd024da8e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:31.629170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58b69c87-8a75-4237-8297-cadcd024da8e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:31.629545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58b69c87-8a75-4237-8297-cadcd024da8e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:31.629969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58b69c87-8a75-4237-8297-cadcd024da8e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:32.237341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-58b69c87-8a75-4237-8297-cadcd024da8e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdd36726334d00aff06d8da0d84918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2db429e0f5a4bba8fab01176631a13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:32.256571 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-58b69c87-8a75-4237-8297-cadcd024da8e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] 10.222.0.85 "GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a" status: 200 len: 1328 microversion: 2.1 time: 0.640707 Aug 24 10:27:32.257947 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1498/3380] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:31 2022] GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a => generated 1328 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:32.266014 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9fb9cc0f-7911-402d-bb0d-9a6b086ed34b req-ffb98dfb-e36a-4e16-94d7-61c93b4f20b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fdab911-592d-4d21-9420-fdadfea05875", "name": "network-vif-deleted", "tag": "32431dd4-4f50-43ba-b6d9-cd4dc40210f9"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:32.282703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9fb9cc0f-7911-402d-bb0d-9a6b086ed34b req-ffb98dfb-e36a-4e16-94d7-61c93b4f20b7 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:32.283192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9fb9cc0f-7911-402d-bb0d-9a6b086ed34b req-ffb98dfb-e36a-4e16-94d7-61c93b4f20b7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:32.283866 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9fb9cc0f-7911-402d-bb0d-9a6b086ed34b req-ffb98dfb-e36a-4e16-94d7-61c93b4f20b7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:32.304163 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.compute.server_external_events [req-9fb9cc0f-7911-402d-bb0d-9a6b086ed34b req-ffb98dfb-e36a-4e16-94d7-61c93b4f20b7 service nova] Unable to find a host for instance 0fdab911-592d-4d21-9420-fdadfea05875. Dropping event network-vif-deleted {{(pid=122432) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 10:27:32.305818 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9fb9cc0f-7911-402d-bb0d-9a6b086ed34b req-ffb98dfb-e36a-4e16-94d7-61c93b4f20b7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.045115 Aug 24 10:27:32.306762 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1499/3381] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 48 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 10:27:32.388431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b1e5e8f7-7a7c-43a4-9033-640a8189fb4e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:32.389053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f092c5ac-e5a3-4e2c-9751-4d3121bdf9fc tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:32.394754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b1e5e8f7-7a7c-43a4-9033-640a8189fb4e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:32.402730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1e5e8f7-7a7c-43a4-9033-640a8189fb4e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:32.403398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1e5e8f7-7a7c-43a4-9033-640a8189fb4e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:32.403950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1e5e8f7-7a7c-43a4-9033-640a8189fb4e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:32.404917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1e5e8f7-7a7c-43a4-9033-640a8189fb4e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:32.405632 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1e5e8f7-7a7c-43a4-9033-640a8189fb4e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:32.406357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1e5e8f7-7a7c-43a4-9033-640a8189fb4e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:32.435831 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f092c5ac-e5a3-4e2c-9751-4d3121bdf9fc tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1317 microversion: 2.1 time: 1.151378 Aug 24 10:27:32.449348 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1883/3382] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:31 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1317 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:32.622344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d8e99eb9-4705-4ae8-9724-f50f7a11c0db tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:32.623004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d8e99eb9-4705-4ae8-9724-f50f7a11c0db tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:32.630818 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8e99eb9-4705-4ae8-9724-f50f7a11c0db tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:32.631764 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8e99eb9-4705-4ae8-9724-f50f7a11c0db tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:32.632485 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8e99eb9-4705-4ae8-9724-f50f7a11c0db tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:32.633507 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8e99eb9-4705-4ae8-9724-f50f7a11c0db tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:32.634219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8e99eb9-4705-4ae8-9724-f50f7a11c0db tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:32.634951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8e99eb9-4705-4ae8-9724-f50f7a11c0db tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:32.781969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d8e99eb9-4705-4ae8-9724-f50f7a11c0db tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:32.798111 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d8e99eb9-4705-4ae8-9724-f50f7a11c0db tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1266 microversion: 2.1 time: 0.180247 Aug 24 10:27:32.798829 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1884/3383] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:32 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:33.288611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ecf5759-860e-4bc6-8935-e44adf14322f tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:33.289517 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4ecf5759-860e-4bc6-8935-e44adf14322f tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] [instance: 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:33.301399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ecf5759-860e-4bc6-8935-e44adf14322f tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:33.304221 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ecf5759-860e-4bc6-8935-e44adf14322f tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:33.304913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ecf5759-860e-4bc6-8935-e44adf14322f tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:33.307263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ecf5759-860e-4bc6-8935-e44adf14322f tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:33.308748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ecf5759-860e-4bc6-8935-e44adf14322f tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:33.309644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ecf5759-860e-4bc6-8935-e44adf14322f tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:33.463363 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b1e5e8f7-7a7c-43a4-9033-640a8189fb4e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:33.507266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b1e5e8f7-7a7c-43a4-9033-640a8189fb4e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:33.513741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b1e5e8f7-7a7c-43a4-9033-640a8189fb4e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:33.535289 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b1e5e8f7-7a7c-43a4-9033-640a8189fb4e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 1.151245 Aug 24 10:27:33.539618 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1500/3384] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:27:32 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:27:33.548148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f047e5c0-8a45-427c-a0b6-fb4a6eebbf24 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:33.548986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f047e5c0-8a45-427c-a0b6-fb4a6eebbf24 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:33.559950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:33.595780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f047e5c0-8a45-427c-a0b6-fb4a6eebbf24 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:33.599378 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f047e5c0-8a45-427c-a0b6-fb4a6eebbf24 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:33.600949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f047e5c0-8a45-427c-a0b6-fb4a6eebbf24 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:33.602495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4ecf5759-860e-4bc6-8935-e44adf14322f tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdd36726334d00aff06d8da0d84918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2db429e0f5a4bba8fab01176631a13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:33.603439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f047e5c0-8a45-427c-a0b6-fb4a6eebbf24 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:33.605224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f047e5c0-8a45-427c-a0b6-fb4a6eebbf24 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:33.608694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f047e5c0-8a45-427c-a0b6-fb4a6eebbf24 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:33.610756 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4ecf5759-860e-4bc6-8935-e44adf14322f tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] 10.222.0.85 "GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a" status: 200 len: 1328 microversion: 2.1 time: 0.332393 Aug 24 10:27:33.615185 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1885/3385] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:33 2022] GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a => generated 1328 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:33.829475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0184d3e2-a10e-4642-a7d0-a23348678fc2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:33.830197 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0184d3e2-a10e-4642-a7d0-a23348678fc2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:33.844890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0184d3e2-a10e-4642-a7d0-a23348678fc2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:33.845703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0184d3e2-a10e-4642-a7d0-a23348678fc2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:33.846368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0184d3e2-a10e-4642-a7d0-a23348678fc2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:33.847351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0184d3e2-a10e-4642-a7d0-a23348678fc2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:33.864996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0184d3e2-a10e-4642-a7d0-a23348678fc2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:33.865739 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0184d3e2-a10e-4642-a7d0-a23348678fc2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:34.057780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0184d3e2-a10e-4642-a7d0-a23348678fc2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:34.073990 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0184d3e2-a10e-4642-a7d0-a23348678fc2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1272 microversion: 2.1 time: 0.248289 Aug 24 10:27:34.075591 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1886/3386] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:33 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1272 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:27:34.255593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f047e5c0-8a45-427c-a0b6-fb4a6eebbf24 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:34.277379 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f047e5c0-8a45-427c-a0b6-fb4a6eebbf24 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1507 microversion: 2.1 time: 0.735197 Aug 24 10:27:34.278213 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1501/3387] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:33 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1507 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:34.298834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f09abd06-7493-4975-a5be-1b3d71dd30f7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:34.299369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f09abd06-7493-4975-a5be-1b3d71dd30f7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:34.309717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f09abd06-7493-4975-a5be-1b3d71dd30f7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:34.310610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f09abd06-7493-4975-a5be-1b3d71dd30f7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:34.311472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f09abd06-7493-4975-a5be-1b3d71dd30f7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:34.314502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f09abd06-7493-4975-a5be-1b3d71dd30f7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:34.315393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f09abd06-7493-4975-a5be-1b3d71dd30f7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:34.317235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f09abd06-7493-4975-a5be-1b3d71dd30f7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:34.370228 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-6b5ac4c9-d1fb-4e6f-a484-f6a00fc0bb86 req-9bb67499-a5c9-4efe-90cd-aae67fc14d95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ade0e12-9ac0-459f-8f85-6743432302fa", "tag": "5844483e-5b42-463a-95e1-a9835141849c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:34.384194 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6b5ac4c9-d1fb-4e6f-a484-f6a00fc0bb86 req-9bb67499-a5c9-4efe-90cd-aae67fc14d95 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:34.384679 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6b5ac4c9-d1fb-4e6f-a484-f6a00fc0bb86 req-9bb67499-a5c9-4efe-90cd-aae67fc14d95 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:34.386393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6b5ac4c9-d1fb-4e6f-a484-f6a00fc0bb86 req-9bb67499-a5c9-4efe-90cd-aae67fc14d95 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:34.410859 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-6b5ac4c9-d1fb-4e6f-a484-f6a00fc0bb86 req-9bb67499-a5c9-4efe-90cd-aae67fc14d95 service nova] Creating event network-changed:5844483e-5b42-463a-95e1-a9835141849c for instance 1ade0e12-9ac0-459f-8f85-6743432302fa on n-h1-849328-3 Aug 24 10:27:34.434004 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-6b5ac4c9-d1fb-4e6f-a484-f6a00fc0bb86 req-9bb67499-a5c9-4efe-90cd-aae67fc14d95 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061720 Aug 24 10:27:34.436064 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1502/3388] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:27:34.571992 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-95d4a8e7-e695-4331-810e-82e0a77a5319 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:34.573716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-95d4a8e7-e695-4331-810e-82e0a77a5319 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:34.588531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95d4a8e7-e695-4331-810e-82e0a77a5319 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:34.592529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95d4a8e7-e695-4331-810e-82e0a77a5319 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:34.594525 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95d4a8e7-e695-4331-810e-82e0a77a5319 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:34.596563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95d4a8e7-e695-4331-810e-82e0a77a5319 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:34.598385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95d4a8e7-e695-4331-810e-82e0a77a5319 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:34.599410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95d4a8e7-e695-4331-810e-82e0a77a5319 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:34.613150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f09abd06-7493-4975-a5be-1b3d71dd30f7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:34.621555 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f09abd06-7493-4975-a5be-1b3d71dd30f7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1507 microversion: 2.1 time: 0.326846 Aug 24 10:27:34.631126 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1887/3389] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:34 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1507 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:34.642024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-83b1b698-0b09-4da9-817f-685581cafc9f tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:34.653420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-83b1b698-0b09-4da9-817f-685581cafc9f tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] [instance: 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:34.674233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83b1b698-0b09-4da9-817f-685581cafc9f tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:34.677682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83b1b698-0b09-4da9-817f-685581cafc9f tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:34.678176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83b1b698-0b09-4da9-817f-685581cafc9f tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:34.679945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83b1b698-0b09-4da9-817f-685581cafc9f tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:34.680439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83b1b698-0b09-4da9-817f-685581cafc9f tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:34.683871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83b1b698-0b09-4da9-817f-685581cafc9f tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:34.991416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-83b1b698-0b09-4da9-817f-685581cafc9f tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdd36726334d00aff06d8da0d84918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2db429e0f5a4bba8fab01176631a13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:35.008535 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-83b1b698-0b09-4da9-817f-685581cafc9f tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] 10.222.0.85 "GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a" status: 200 len: 1328 microversion: 2.1 time: 0.371602 Aug 24 10:27:35.009169 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1888/3390] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:34 2022] GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a => generated 1328 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:35.022399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a4be77b9-5759-40bf-8238-d169fff08b1e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:35.025731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a4be77b9-5759-40bf-8238-d169fff08b1e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:35.032945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4be77b9-5759-40bf-8238-d169fff08b1e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:35.033799 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4be77b9-5759-40bf-8238-d169fff08b1e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:35.034486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4be77b9-5759-40bf-8238-d169fff08b1e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:35.035415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4be77b9-5759-40bf-8238-d169fff08b1e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:35.036150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4be77b9-5759-40bf-8238-d169fff08b1e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:35.036755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4be77b9-5759-40bf-8238-d169fff08b1e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:35.173576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a4be77b9-5759-40bf-8238-d169fff08b1e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:27:35.174128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a4be77b9-5759-40bf-8238-d169fff08b1e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:27:35.174857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a4be77b9-5759-40bf-8238-d169fff08b1e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:27:35.175717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a4be77b9-5759-40bf-8238-d169fff08b1e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:27:35.176487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a4be77b9-5759-40bf-8238-d169fff08b1e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:27:35.287399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a4be77b9-5759-40bf-8238-d169fff08b1e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:35.297580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4be77b9-5759-40bf-8238-d169fff08b1e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:35.300813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4be77b9-5759-40bf-8238-d169fff08b1e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:35.302096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4be77b9-5759-40bf-8238-d169fff08b1e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:35.304947 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4be77b9-5759-40bf-8238-d169fff08b1e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:35.306831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4be77b9-5759-40bf-8238-d169fff08b1e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:35.308374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4be77b9-5759-40bf-8238-d169fff08b1e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:35.356702 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a4be77b9-5759-40bf-8238-d169fff08b1e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "POST /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac/action" status: 202 len: 1109 microversion: 2.1 time: 0.346170 Aug 24 10:27:35.358410 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1889/3391] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:27:35 2022] POST /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac/action => generated 1109 bytes in 349 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 10:27:35.665065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-95d4a8e7-e695-4331-810e-82e0a77a5319 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:35.684506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-95d4a8e7-e695-4331-810e-82e0a77a5319 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:35.693244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-95d4a8e7-e695-4331-810e-82e0a77a5319 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:35.697023 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-95d4a8e7-e695-4331-810e-82e0a77a5319 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 1.130632 Aug 24 10:27:35.697023 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1503/3392] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:27:34 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:27:35.706240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-03ab7a6d-0ad9-43bc-8b71-df8e48d964d3 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:35.706854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-03ab7a6d-0ad9-43bc-8b71-df8e48d964d3 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:35.738409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03ab7a6d-0ad9-43bc-8b71-df8e48d964d3 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:35.742353 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03ab7a6d-0ad9-43bc-8b71-df8e48d964d3 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:35.743825 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03ab7a6d-0ad9-43bc-8b71-df8e48d964d3 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:35.746081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03ab7a6d-0ad9-43bc-8b71-df8e48d964d3 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:35.746572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03ab7a6d-0ad9-43bc-8b71-df8e48d964d3 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:35.748518 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03ab7a6d-0ad9-43bc-8b71-df8e48d964d3 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:35.869948 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c3c7dfcb-2d2c-497b-9b5c-2f930c37a549 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1107192813", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:35.984868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-c3c7dfcb-2d2c-497b-9b5c-2f930c37a549 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:27:36.258918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-03ab7a6d-0ad9-43bc-8b71-df8e48d964d3 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:36.271740 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-03ab7a6d-0ad9-43bc-8b71-df8e48d964d3 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1314 microversion: 2.1 time: 0.569062 Aug 24 10:27:36.285492 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1504/3393] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:35 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1314 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:36.295332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7b58b89c-3985-451f-8de4-1a7157ea1b06 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:36.302336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7b58b89c-3985-451f-8de4-1a7157ea1b06 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:36.319278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b58b89c-3985-451f-8de4-1a7157ea1b06 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:36.322033 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b58b89c-3985-451f-8de4-1a7157ea1b06 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:36.322540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b58b89c-3985-451f-8de4-1a7157ea1b06 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:36.323268 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b58b89c-3985-451f-8de4-1a7157ea1b06 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:36.323723 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b58b89c-3985-451f-8de4-1a7157ea1b06 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:36.324139 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b58b89c-3985-451f-8de4-1a7157ea1b06 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:37.034917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c3c7dfcb-2d2c-497b-9b5c-2f930c37a549 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:27:37.036130 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c3c7dfcb-2d2c-497b-9b5c-2f930c37a549 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:27:37.037524 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c3c7dfcb-2d2c-497b-9b5c-2f930c37a549 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:27:37.039117 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c3c7dfcb-2d2c-497b-9b5c-2f930c37a549 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:27:37.043009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c3c7dfcb-2d2c-497b-9b5c-2f930c37a549 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:27:37.073792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3c7dfcb-2d2c-497b-9b5c-2f930c37a549 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:37.087603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3c7dfcb-2d2c-497b-9b5c-2f930c37a549 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:37.092533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3c7dfcb-2d2c-497b-9b5c-2f930c37a549 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:37.095824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3c7dfcb-2d2c-497b-9b5c-2f930c37a549 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:37.096295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3c7dfcb-2d2c-497b-9b5c-2f930c37a549 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:37.096768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3c7dfcb-2d2c-497b-9b5c-2f930c37a549 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:37.115072 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=7 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:37.131897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-c3c7dfcb-2d2c-497b-9b5c-2f930c37a549 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Getting quotas for project dba66b174cac4cadb9afc09f7df3e21f. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:27:37.138334 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-c3c7dfcb-2d2c-497b-9b5c-2f930c37a549 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Getting quotas for user fd39bebd0ab646faa5109d1b2f2cae0a and project dba66b174cac4cadb9afc09f7df3e21f. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:27:37.154665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c3c7dfcb-2d2c-497b-9b5c-2f930c37a549 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:27:37.157629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c3c7dfcb-2d2c-497b-9b5c-2f930c37a549 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] [instance: 51be811b-0bd6-4671-831a-ba5733764143] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:27:37.230750 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c3c7dfcb-2d2c-497b-9b5c-2f930c37a549 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.870889 Aug 24 10:27:37.233315 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1890/3394] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:27:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:27:37.251524 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1c76619a-cab2-4c00-b330-d950c17acfd7 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:37.253551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1c76619a-cab2-4c00-b330-d950c17acfd7 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] [instance: 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:37.255754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7b58b89c-3985-451f-8de4-1a7157ea1b06 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:37.265228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:37.271383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c76619a-cab2-4c00-b330-d950c17acfd7 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:37.274041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c76619a-cab2-4c00-b330-d950c17acfd7 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:37.275344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c76619a-cab2-4c00-b330-d950c17acfd7 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:37.276312 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c76619a-cab2-4c00-b330-d950c17acfd7 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:37.277179 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c76619a-cab2-4c00-b330-d950c17acfd7 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:37.278072 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c76619a-cab2-4c00-b330-d950c17acfd7 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:37.285910 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7b58b89c-3985-451f-8de4-1a7157ea1b06 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1514 microversion: 2.1 time: 0.999011 Aug 24 10:27:37.290390 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1505/3395] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:36 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1514 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:37.298458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e8f042c7-4883-43e9-8b84-67fe5ed95e4e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:37.299525 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e8f042c7-4883-43e9-8b84-67fe5ed95e4e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:37.315182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8f042c7-4883-43e9-8b84-67fe5ed95e4e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:37.315908 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8f042c7-4883-43e9-8b84-67fe5ed95e4e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:37.316542 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8f042c7-4883-43e9-8b84-67fe5ed95e4e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:37.322341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8f042c7-4883-43e9-8b84-67fe5ed95e4e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:37.322990 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8f042c7-4883-43e9-8b84-67fe5ed95e4e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:37.323574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8f042c7-4883-43e9-8b84-67fe5ed95e4e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:37.655204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1c76619a-cab2-4c00-b330-d950c17acfd7 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdd36726334d00aff06d8da0d84918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2db429e0f5a4bba8fab01176631a13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:37.664591 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1c76619a-cab2-4c00-b330-d950c17acfd7 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] 10.222.0.85 "GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a" status: 200 len: 1328 microversion: 2.1 time: 0.428102 Aug 24 10:27:37.669946 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1891/3396] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:37 2022] GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a => generated 1328 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:37.687445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-fbb41a8a-3a78-4850-b1b1-cb3d245f2ea2 req-b1ea9e3f-2b81-42e0-be00-3fdca4514b33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a", "tag": "a5659688-be91-4c58-ae4d-ccd5bdbc3a0e"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:37.698143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fbb41a8a-3a78-4850-b1b1-cb3d245f2ea2 req-b1ea9e3f-2b81-42e0-be00-3fdca4514b33 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:37.698957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fbb41a8a-3a78-4850-b1b1-cb3d245f2ea2 req-b1ea9e3f-2b81-42e0-be00-3fdca4514b33 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:37.699584 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fbb41a8a-3a78-4850-b1b1-cb3d245f2ea2 req-b1ea9e3f-2b81-42e0-be00-3fdca4514b33 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:37.712529 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-fbb41a8a-3a78-4850-b1b1-cb3d245f2ea2 req-b1ea9e3f-2b81-42e0-be00-3fdca4514b33 service nova] Creating event network-changed:a5659688-be91-4c58-ae4d-ccd5bdbc3a0e for instance 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a on n-h1-849328-3 Aug 24 10:27:37.721325 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-fbb41a8a-3a78-4850-b1b1-cb3d245f2ea2 req-b1ea9e3f-2b81-42e0-be00-3fdca4514b33 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037565 Aug 24 10:27:37.723784 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1892/3397] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:27:37.731102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6b79f66c-35e0-4239-9592-fc43e01c1e8a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:37.731884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6b79f66c-35e0-4239-9592-fc43e01c1e8a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] [instance: 51be811b-0bd6-4671-831a-ba5733764143] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:37.821027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6b79f66c-35e0-4239-9592-fc43e01c1e8a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39bebd0ab646faa5109d1b2f2cae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba66b174cac4cadb9afc09f7df3e21f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:37.833621 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=27 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:37.837835 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6b79f66c-35e0-4239-9592-fc43e01c1e8a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143" status: 200 len: 1217 microversion: 2.1 time: 0.111833 Aug 24 10:27:37.839268 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1893/3398] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:37 2022] GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143 => generated 1217 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:37.845402 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6b8bbc44-724c-4614-a733-76037191e80c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:37.846808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6b8bbc44-724c-4614-a733-76037191e80c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:37.855261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b8bbc44-724c-4614-a733-76037191e80c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:37.855962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b8bbc44-724c-4614-a733-76037191e80c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:37.857036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b8bbc44-724c-4614-a733-76037191e80c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:37.858208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b8bbc44-724c-4614-a733-76037191e80c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:37.858860 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b8bbc44-724c-4614-a733-76037191e80c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:37.859505 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b8bbc44-724c-4614-a733-76037191e80c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:38.219514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e8f042c7-4883-43e9-8b84-67fe5ed95e4e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:38.255283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e8f042c7-4883-43e9-8b84-67fe5ed95e4e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:38.261499 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e8f042c7-4883-43e9-8b84-67fe5ed95e4e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:38.264588 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e8f042c7-4883-43e9-8b84-67fe5ed95e4e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.972592 Aug 24 10:27:38.266520 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1506/3399] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:27:37 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:27:38.273581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-985aa36f-89f6-43fa-a4f2-16c9aae3ae98 req-62018e79-b418-42bc-8ddf-3490b3243127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2121a94d-a44d-49f0-95d9-e9c77312fb4a", "tag": "5049c965-c608-4389-b52c-0a5056858b91"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:38.298683 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-985aa36f-89f6-43fa-a4f2-16c9aae3ae98 req-62018e79-b418-42bc-8ddf-3490b3243127 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:38.299462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-985aa36f-89f6-43fa-a4f2-16c9aae3ae98 req-62018e79-b418-42bc-8ddf-3490b3243127 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:38.300518 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-985aa36f-89f6-43fa-a4f2-16c9aae3ae98 req-62018e79-b418-42bc-8ddf-3490b3243127 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:38.316330 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-985aa36f-89f6-43fa-a4f2-16c9aae3ae98 req-62018e79-b418-42bc-8ddf-3490b3243127 service nova] Creating event network-changed:5049c965-c608-4389-b52c-0a5056858b91 for instance 2121a94d-a44d-49f0-95d9-e9c77312fb4a on n-h2-849328-3 Aug 24 10:27:38.321543 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-985aa36f-89f6-43fa-a4f2-16c9aae3ae98 req-62018e79-b418-42bc-8ddf-3490b3243127 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053252 Aug 24 10:27:38.322631 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1507/3400] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:27:38.328164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8b9950c4-90f7-47e9-84d2-67b999d0aad5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:38.328869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8b9950c4-90f7-47e9-84d2-67b999d0aad5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:38.336495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b9950c4-90f7-47e9-84d2-67b999d0aad5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:38.337237 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b9950c4-90f7-47e9-84d2-67b999d0aad5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:38.338394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b9950c4-90f7-47e9-84d2-67b999d0aad5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:38.339280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b9950c4-90f7-47e9-84d2-67b999d0aad5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:38.340469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b9950c4-90f7-47e9-84d2-67b999d0aad5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:38.341634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b9950c4-90f7-47e9-84d2-67b999d0aad5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:38.363707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:38.401324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6b8bbc44-724c-4614-a733-76037191e80c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:38.410641 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6b8bbc44-724c-4614-a733-76037191e80c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1314 microversion: 2.1 time: 0.569463 Aug 24 10:27:38.425557 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1894/3401] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:37 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:38.702748 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8b9950c4-90f7-47e9-84d2-67b999d0aad5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:38.707014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-43790808-436e-4545-9b70-f44fe5dce5bc tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:38.709906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-43790808-436e-4545-9b70-f44fe5dce5bc tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] [instance: 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:38.712440 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8b9950c4-90f7-47e9-84d2-67b999d0aad5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1514 microversion: 2.1 time: 0.388378 Aug 24 10:27:38.713331 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1508/3402] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:38 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1514 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:38.727431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43790808-436e-4545-9b70-f44fe5dce5bc tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:38.732196 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43790808-436e-4545-9b70-f44fe5dce5bc tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:38.732814 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43790808-436e-4545-9b70-f44fe5dce5bc tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:38.733900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43790808-436e-4545-9b70-f44fe5dce5bc tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:38.734246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43790808-436e-4545-9b70-f44fe5dce5bc tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:38.734771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43790808-436e-4545-9b70-f44fe5dce5bc tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:38.872703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-121effb6-a50f-4816-9049-7e08e0de2d78 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:38.877398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-121effb6-a50f-4816-9049-7e08e0de2d78 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] [instance: 51be811b-0bd6-4671-831a-ba5733764143] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:38.887317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-121effb6-a50f-4816-9049-7e08e0de2d78 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:38.887903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-121effb6-a50f-4816-9049-7e08e0de2d78 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:38.888572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-121effb6-a50f-4816-9049-7e08e0de2d78 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:38.889357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-121effb6-a50f-4816-9049-7e08e0de2d78 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:38.889981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-121effb6-a50f-4816-9049-7e08e0de2d78 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:38.890413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-121effb6-a50f-4816-9049-7e08e0de2d78 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:39.051408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-121effb6-a50f-4816-9049-7e08e0de2d78 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39bebd0ab646faa5109d1b2f2cae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba66b174cac4cadb9afc09f7df3e21f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:39.064043 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-121effb6-a50f-4816-9049-7e08e0de2d78 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143" status: 200 len: 1213 microversion: 2.1 time: 0.202256 Aug 24 10:27:39.065419 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1509/3403] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:38 2022] GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143 => generated 1213 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:39.125413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-43790808-436e-4545-9b70-f44fe5dce5bc tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdd36726334d00aff06d8da0d84918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2db429e0f5a4bba8fab01176631a13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:39.134776 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-43790808-436e-4545-9b70-f44fe5dce5bc tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] 10.222.0.85 "GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a" status: 200 len: 1328 microversion: 2.1 time: 0.448327 Aug 24 10:27:39.135579 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1895/3404] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:38 2022] GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a => generated 1328 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:39.297462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2cf5224d-cba5-40a2-b281-e65005b380c5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:39.298707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2cf5224d-cba5-40a2-b281-e65005b380c5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:39.305813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cf5224d-cba5-40a2-b281-e65005b380c5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:39.306704 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cf5224d-cba5-40a2-b281-e65005b380c5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:39.307426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cf5224d-cba5-40a2-b281-e65005b380c5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:39.308415 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cf5224d-cba5-40a2-b281-e65005b380c5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:39.309179 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cf5224d-cba5-40a2-b281-e65005b380c5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:39.309854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cf5224d-cba5-40a2-b281-e65005b380c5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:39.438167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9abc7043-fb3a-4a07-b159-4ba9f673ec94 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:39.439109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9abc7043-fb3a-4a07-b159-4ba9f673ec94 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:39.449550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9abc7043-fb3a-4a07-b159-4ba9f673ec94 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:39.453865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9abc7043-fb3a-4a07-b159-4ba9f673ec94 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:39.454543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9abc7043-fb3a-4a07-b159-4ba9f673ec94 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:39.455459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9abc7043-fb3a-4a07-b159-4ba9f673ec94 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:39.458598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9abc7043-fb3a-4a07-b159-4ba9f673ec94 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:39.458973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9abc7043-fb3a-4a07-b159-4ba9f673ec94 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:39.977654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9abc7043-fb3a-4a07-b159-4ba9f673ec94 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:39.996567 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9abc7043-fb3a-4a07-b159-4ba9f673ec94 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1314 microversion: 2.1 time: 0.562444 Aug 24 10:27:39.997720 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1896/3405] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:39 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1314 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:40.004937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-61a6e803-e14a-4c98-9ccd-349c4e593b5c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:40.005878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-61a6e803-e14a-4c98-9ccd-349c4e593b5c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:40.014138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61a6e803-e14a-4c98-9ccd-349c4e593b5c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:40.016322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61a6e803-e14a-4c98-9ccd-349c4e593b5c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:40.017234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61a6e803-e14a-4c98-9ccd-349c4e593b5c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:40.022063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61a6e803-e14a-4c98-9ccd-349c4e593b5c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:40.023140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61a6e803-e14a-4c98-9ccd-349c4e593b5c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:40.023846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61a6e803-e14a-4c98-9ccd-349c4e593b5c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:40.549828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2cf5224d-cba5-40a2-b281-e65005b380c5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:40.568066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2cf5224d-cba5-40a2-b281-e65005b380c5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:40.570103 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2cf5224d-cba5-40a2-b281-e65005b380c5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:40.571800 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2cf5224d-cba5-40a2-b281-e65005b380c5 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 1.278842 Aug 24 10:27:40.574215 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1510/3406] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:27:39 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:27:40.580580 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-17071069-9b9e-40a6-8ead-a9891bebae64 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:40.581700 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-17071069-9b9e-40a6-8ead-a9891bebae64 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] [instance: 51be811b-0bd6-4671-831a-ba5733764143] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:40.591333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17071069-9b9e-40a6-8ead-a9891bebae64 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:40.592675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17071069-9b9e-40a6-8ead-a9891bebae64 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:40.593357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17071069-9b9e-40a6-8ead-a9891bebae64 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:40.594301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17071069-9b9e-40a6-8ead-a9891bebae64 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:40.594963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17071069-9b9e-40a6-8ead-a9891bebae64 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:40.595598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17071069-9b9e-40a6-8ead-a9891bebae64 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:40.716780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-61a6e803-e14a-4c98-9ccd-349c4e593b5c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:40.733198 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-61a6e803-e14a-4c98-9ccd-349c4e593b5c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1514 microversion: 2.1 time: 0.733872 Aug 24 10:27:40.737530 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1897/3407] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:39 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1514 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:40.742982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-329a01d3-4715-4629-a54c-849cafd1d7ec tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:40.744554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-329a01d3-4715-4629-a54c-849cafd1d7ec tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] [instance: 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:40.751895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-329a01d3-4715-4629-a54c-849cafd1d7ec tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:40.752669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-329a01d3-4715-4629-a54c-849cafd1d7ec tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:40.753438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-329a01d3-4715-4629-a54c-849cafd1d7ec tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:40.755036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-329a01d3-4715-4629-a54c-849cafd1d7ec tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:40.755696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-329a01d3-4715-4629-a54c-849cafd1d7ec tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:40.756469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-329a01d3-4715-4629-a54c-849cafd1d7ec tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:40.839932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-17071069-9b9e-40a6-8ead-a9891bebae64 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39bebd0ab646faa5109d1b2f2cae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba66b174cac4cadb9afc09f7df3e21f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:40.858055 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-17071069-9b9e-40a6-8ead-a9891bebae64 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143" status: 200 len: 1275 microversion: 2.1 time: 0.282487 Aug 24 10:27:40.858769 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1511/3408] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:40 2022] GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143 => generated 1275 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:41.019188 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b5d9d27e-1d07-43d9-845b-5cae3ca62326 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:41.021686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b5d9d27e-1d07-43d9-845b-5cae3ca62326 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:41.038462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5d9d27e-1d07-43d9-845b-5cae3ca62326 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:41.041055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5d9d27e-1d07-43d9-845b-5cae3ca62326 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:41.042777 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5d9d27e-1d07-43d9-845b-5cae3ca62326 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:41.044746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5d9d27e-1d07-43d9-845b-5cae3ca62326 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:41.048026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5d9d27e-1d07-43d9-845b-5cae3ca62326 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:41.048768 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5d9d27e-1d07-43d9-845b-5cae3ca62326 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:41.114273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-329a01d3-4715-4629-a54c-849cafd1d7ec tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdd36726334d00aff06d8da0d84918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2db429e0f5a4bba8fab01176631a13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:41.123197 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-329a01d3-4715-4629-a54c-849cafd1d7ec tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] 10.222.0.85 "GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a" status: 200 len: 1328 microversion: 2.1 time: 0.384110 Aug 24 10:27:41.126445 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1898/3409] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:40 2022] GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a => generated 1328 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:41.596677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:41.597149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f5d9d4ff-0bef-4e66-afa2-100d6518b175 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:41.597265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f5d9d4ff-0bef-4e66-afa2-100d6518b175 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:41.618284 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5d9d4ff-0bef-4e66-afa2-100d6518b175 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:41.618793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5d9d4ff-0bef-4e66-afa2-100d6518b175 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:41.619678 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5d9d4ff-0bef-4e66-afa2-100d6518b175 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:41.620427 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5d9d4ff-0bef-4e66-afa2-100d6518b175 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:41.620877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5d9d4ff-0bef-4e66-afa2-100d6518b175 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:41.626250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5d9d4ff-0bef-4e66-afa2-100d6518b175 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:41.711939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b5d9d27e-1d07-43d9-845b-5cae3ca62326 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:41.725909 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b5d9d27e-1d07-43d9-845b-5cae3ca62326 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1314 microversion: 2.1 time: 0.710207 Aug 24 10:27:41.726781 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1512/3410] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:41 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1314 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:41.759690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b454f7c-15b9-47be-9a71-59c88003c138 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:41.761715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2b454f7c-15b9-47be-9a71-59c88003c138 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:41.773469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b454f7c-15b9-47be-9a71-59c88003c138 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:41.774247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b454f7c-15b9-47be-9a71-59c88003c138 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:41.774932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b454f7c-15b9-47be-9a71-59c88003c138 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:41.776257 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b454f7c-15b9-47be-9a71-59c88003c138 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:41.777144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b454f7c-15b9-47be-9a71-59c88003c138 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:41.777800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b454f7c-15b9-47be-9a71-59c88003c138 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:42.226864 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f5d9d4ff-0bef-4e66-afa2-100d6518b175 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:42.243321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f5d9d4ff-0bef-4e66-afa2-100d6518b175 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:42.246957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f5d9d4ff-0bef-4e66-afa2-100d6518b175 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:42.249332 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f5d9d4ff-0bef-4e66-afa2-100d6518b175 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.656706 Aug 24 10:27:42.250903 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1899/3411] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:27:41 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:27:42.266285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ffd601d0-308c-45fc-a8a8-3338cbbd2dd4 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:42.267545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ffd601d0-308c-45fc-a8a8-3338cbbd2dd4 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] [instance: 51be811b-0bd6-4671-831a-ba5733764143] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:42.291279 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffd601d0-308c-45fc-a8a8-3338cbbd2dd4 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:42.292123 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffd601d0-308c-45fc-a8a8-3338cbbd2dd4 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:42.292679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffd601d0-308c-45fc-a8a8-3338cbbd2dd4 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:42.293784 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffd601d0-308c-45fc-a8a8-3338cbbd2dd4 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:42.295324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffd601d0-308c-45fc-a8a8-3338cbbd2dd4 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:42.295880 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffd601d0-308c-45fc-a8a8-3338cbbd2dd4 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:42.307185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:42.412671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2b454f7c-15b9-47be-9a71-59c88003c138 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:42.443749 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2b454f7c-15b9-47be-9a71-59c88003c138 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1514 microversion: 2.1 time: 0.691457 Aug 24 10:27:42.470470 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1513/3412] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:41 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1514 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:42.492887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-06ad7ae7-fc18-40c2-9a70-bdee9186ba6e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:42.495256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-06ad7ae7-fc18-40c2-9a70-bdee9186ba6e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] [instance: 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:42.507946 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06ad7ae7-fc18-40c2-9a70-bdee9186ba6e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:42.512846 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06ad7ae7-fc18-40c2-9a70-bdee9186ba6e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:42.513562 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06ad7ae7-fc18-40c2-9a70-bdee9186ba6e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:42.514502 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06ad7ae7-fc18-40c2-9a70-bdee9186ba6e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:42.515291 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06ad7ae7-fc18-40c2-9a70-bdee9186ba6e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:42.516424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06ad7ae7-fc18-40c2-9a70-bdee9186ba6e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:42.618806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ffd601d0-308c-45fc-a8a8-3338cbbd2dd4 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39bebd0ab646faa5109d1b2f2cae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba66b174cac4cadb9afc09f7df3e21f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:42.631719 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ffd601d0-308c-45fc-a8a8-3338cbbd2dd4 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143" status: 200 len: 1275 microversion: 2.1 time: 0.378769 Aug 24 10:27:42.634323 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1900/3413] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:42 2022] GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143 => generated 1275 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:42.751883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-be8378bd-5732-462d-92e6-29e341a094d4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:42.752552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-be8378bd-5732-462d-92e6-29e341a094d4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:42.771518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be8378bd-5732-462d-92e6-29e341a094d4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:42.772051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be8378bd-5732-462d-92e6-29e341a094d4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:42.772503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be8378bd-5732-462d-92e6-29e341a094d4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:42.773974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be8378bd-5732-462d-92e6-29e341a094d4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:42.774469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be8378bd-5732-462d-92e6-29e341a094d4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:42.774938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be8378bd-5732-462d-92e6-29e341a094d4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:43.294671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-be8378bd-5732-462d-92e6-29e341a094d4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:43.305102 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-be8378bd-5732-462d-92e6-29e341a094d4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1314 microversion: 2.1 time: 0.558988 Aug 24 10:27:43.317527 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1901/3414] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:42 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1314 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:43.317527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9536496a-2352-43cd-b1a8-cf84c23e13f2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:43.317527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9536496a-2352-43cd-b1a8-cf84c23e13f2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:43.330139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9536496a-2352-43cd-b1a8-cf84c23e13f2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:43.331194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9536496a-2352-43cd-b1a8-cf84c23e13f2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:43.331194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9536496a-2352-43cd-b1a8-cf84c23e13f2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:43.331933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9536496a-2352-43cd-b1a8-cf84c23e13f2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:43.332396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9536496a-2352-43cd-b1a8-cf84c23e13f2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:43.332820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9536496a-2352-43cd-b1a8-cf84c23e13f2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:43.662126 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9536496a-2352-43cd-b1a8-cf84c23e13f2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:43.676674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9536496a-2352-43cd-b1a8-cf84c23e13f2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:43.678205 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9536496a-2352-43cd-b1a8-cf84c23e13f2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:43.679429 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9536496a-2352-43cd-b1a8-cf84c23e13f2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.372017 Aug 24 10:27:43.682587 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1902/3415] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:27:43 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:27:43.687385 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f0cb02e5-3a9c-4deb-956b-671c607521bb tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:43.688000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f0cb02e5-3a9c-4deb-956b-671c607521bb tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:43.707046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0cb02e5-3a9c-4deb-956b-671c607521bb tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:43.707632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0cb02e5-3a9c-4deb-956b-671c607521bb tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:43.707984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0cb02e5-3a9c-4deb-956b-671c607521bb tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:43.708700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0cb02e5-3a9c-4deb-956b-671c607521bb tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:43.709168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0cb02e5-3a9c-4deb-956b-671c607521bb tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:43.709595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0cb02e5-3a9c-4deb-956b-671c607521bb tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:43.737859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-06ad7ae7-fc18-40c2-9a70-bdee9186ba6e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdd36726334d00aff06d8da0d84918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2db429e0f5a4bba8fab01176631a13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:43.765668 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-06ad7ae7-fc18-40c2-9a70-bdee9186ba6e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] 10.222.0.85 "GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a" status: 200 len: 1328 microversion: 2.1 time: 1.292630 Aug 24 10:27:43.774418 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1514/3416] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:42 2022] GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a => generated 1328 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:43.785740 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f492b04c-bd11-4765-8952-a0f22f8cbdf5 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:43.786439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f492b04c-bd11-4765-8952-a0f22f8cbdf5 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] [instance: 51be811b-0bd6-4671-831a-ba5733764143] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:43.799835 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f492b04c-bd11-4765-8952-a0f22f8cbdf5 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:43.800734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f492b04c-bd11-4765-8952-a0f22f8cbdf5 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:43.801686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f492b04c-bd11-4765-8952-a0f22f8cbdf5 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:43.802679 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f492b04c-bd11-4765-8952-a0f22f8cbdf5 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:43.803370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f492b04c-bd11-4765-8952-a0f22f8cbdf5 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:43.804154 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f492b04c-bd11-4765-8952-a0f22f8cbdf5 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:43.991857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f492b04c-bd11-4765-8952-a0f22f8cbdf5 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39bebd0ab646faa5109d1b2f2cae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba66b174cac4cadb9afc09f7df3e21f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:44.010974 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f492b04c-bd11-4765-8952-a0f22f8cbdf5 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143" status: 200 len: 1275 microversion: 2.1 time: 0.234773 Aug 24 10:27:44.012217 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1515/3417] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:43 2022] GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143 => generated 1275 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:44.327260 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-65af4338-48a3-4b98-bfb7-bc62fa111024 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:44.328645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-65af4338-48a3-4b98-bfb7-bc62fa111024 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:44.334594 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65af4338-48a3-4b98-bfb7-bc62fa111024 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:44.335557 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65af4338-48a3-4b98-bfb7-bc62fa111024 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:44.335557 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65af4338-48a3-4b98-bfb7-bc62fa111024 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:44.336257 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65af4338-48a3-4b98-bfb7-bc62fa111024 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:44.336706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65af4338-48a3-4b98-bfb7-bc62fa111024 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:44.337138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65af4338-48a3-4b98-bfb7-bc62fa111024 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:44.477796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f0cb02e5-3a9c-4deb-956b-671c607521bb tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:44.499228 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f0cb02e5-3a9c-4deb-956b-671c607521bb tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1514 microversion: 2.1 time: 0.814193 Aug 24 10:27:44.500248 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1903/3418] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:43 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1514 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:44.715240 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f8f44b40-6aad-4b60-9290-aa84e8a7cb92 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:44.716677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f8f44b40-6aad-4b60-9290-aa84e8a7cb92 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:44.728185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8f44b40-6aad-4b60-9290-aa84e8a7cb92 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:44.729076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8f44b40-6aad-4b60-9290-aa84e8a7cb92 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:44.729843 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8f44b40-6aad-4b60-9290-aa84e8a7cb92 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:44.730976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8f44b40-6aad-4b60-9290-aa84e8a7cb92 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:44.732497 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8f44b40-6aad-4b60-9290-aa84e8a7cb92 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:44.734506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8f44b40-6aad-4b60-9290-aa84e8a7cb92 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:45.048966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-65af4338-48a3-4b98-bfb7-bc62fa111024 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:45.064826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f8f44b40-6aad-4b60-9290-aa84e8a7cb92 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:45.074860 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-65af4338-48a3-4b98-bfb7-bc62fa111024 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1314 microversion: 2.1 time: 0.751890 Aug 24 10:27:45.076556 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1516/3419] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:44 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1314 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:45.081170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f8f44b40-6aad-4b60-9290-aa84e8a7cb92 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:45.083009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f8f44b40-6aad-4b60-9290-aa84e8a7cb92 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:45.083291 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d62d4a28-dba4-4f06-a782-ae08b6aa5a6e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:45.084310 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d62d4a28-dba4-4f06-a782-ae08b6aa5a6e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] [instance: 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:45.085829 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f8f44b40-6aad-4b60-9290-aa84e8a7cb92 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.386658 Aug 24 10:27:45.091822 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1904/3420] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:27:44 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:27:45.093311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d62d4a28-dba4-4f06-a782-ae08b6aa5a6e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:45.094028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d62d4a28-dba4-4f06-a782-ae08b6aa5a6e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:45.094800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d62d4a28-dba4-4f06-a782-ae08b6aa5a6e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:45.096121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d62d4a28-dba4-4f06-a782-ae08b6aa5a6e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:45.096940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d62d4a28-dba4-4f06-a782-ae08b6aa5a6e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:45.097678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d62d4a28-dba4-4f06-a782-ae08b6aa5a6e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:45.099717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f417b922-5ac8-418a-a0ce-f5a3653d023e tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:45.101193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f417b922-5ac8-418a-a0ce-f5a3653d023e tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] [instance: 51be811b-0bd6-4671-831a-ba5733764143] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:45.135539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f417b922-5ac8-418a-a0ce-f5a3653d023e tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:45.136033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f417b922-5ac8-418a-a0ce-f5a3653d023e tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:45.136471 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f417b922-5ac8-418a-a0ce-f5a3653d023e tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:45.137200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f417b922-5ac8-418a-a0ce-f5a3653d023e tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:45.137654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f417b922-5ac8-418a-a0ce-f5a3653d023e tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:45.138073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f417b922-5ac8-418a-a0ce-f5a3653d023e tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:45.492322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f417b922-5ac8-418a-a0ce-f5a3653d023e tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39bebd0ab646faa5109d1b2f2cae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba66b174cac4cadb9afc09f7df3e21f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:45.513693 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f417b922-5ac8-418a-a0ce-f5a3653d023e tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143" status: 200 len: 1317 microversion: 2.1 time: 0.410286 Aug 24 10:27:45.528439 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1905/3421] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:45 2022] GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143 => generated 1317 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:45.534990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-017db344-d6f6-4ea0-8fe6-c88db63e886c req-e083a8e4-35c2-4d7b-96d5-e5750ad08aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2121a94d-a44d-49f0-95d9-e9c77312fb4a", "name": "network-vif-plugged", "status": "completed", "tag": "5049c965-c608-4389-b52c-0a5056858b91"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:45.561165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-017db344-d6f6-4ea0-8fe6-c88db63e886c req-e083a8e4-35c2-4d7b-96d5-e5750ad08aa6 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:45.561925 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-017db344-d6f6-4ea0-8fe6-c88db63e886c req-e083a8e4-35c2-4d7b-96d5-e5750ad08aa6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:45.562643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-017db344-d6f6-4ea0-8fe6-c88db63e886c req-e083a8e4-35c2-4d7b-96d5-e5750ad08aa6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:45.582585 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-017db344-d6f6-4ea0-8fe6-c88db63e886c req-e083a8e4-35c2-4d7b-96d5-e5750ad08aa6 service nova] Creating event network-vif-plugged:5049c965-c608-4389-b52c-0a5056858b91 for instance 2121a94d-a44d-49f0-95d9-e9c77312fb4a on n-h2-849328-3 Aug 24 10:27:45.589071 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-017db344-d6f6-4ea0-8fe6-c88db63e886c req-e083a8e4-35c2-4d7b-96d5-e5750ad08aa6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058300 Aug 24 10:27:45.590418 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1906/3422] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:27:45.603478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e28e99cf-05c2-412b-b1c3-d67f5aa6ce79 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:45.605447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e28e99cf-05c2-412b-b1c3-d67f5aa6ce79 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:45.619415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e28e99cf-05c2-412b-b1c3-d67f5aa6ce79 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:45.627639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e28e99cf-05c2-412b-b1c3-d67f5aa6ce79 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:45.635748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e28e99cf-05c2-412b-b1c3-d67f5aa6ce79 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:45.637073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e28e99cf-05c2-412b-b1c3-d67f5aa6ce79 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:45.638354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e28e99cf-05c2-412b-b1c3-d67f5aa6ce79 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:45.639411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e28e99cf-05c2-412b-b1c3-d67f5aa6ce79 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:45.927499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e28e99cf-05c2-412b-b1c3-d67f5aa6ce79 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:45.938794 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e28e99cf-05c2-412b-b1c3-d67f5aa6ce79 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1514 microversion: 2.1 time: 0.346579 Aug 24 10:27:45.958813 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1907/3423] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:45 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1514 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:46.101857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-abdbc2cc-c619-4f44-bcae-229fa99048f2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:46.102919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-abdbc2cc-c619-4f44-bcae-229fa99048f2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:46.118192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abdbc2cc-c619-4f44-bcae-229fa99048f2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:46.120250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abdbc2cc-c619-4f44-bcae-229fa99048f2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:46.121774 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abdbc2cc-c619-4f44-bcae-229fa99048f2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:46.124126 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abdbc2cc-c619-4f44-bcae-229fa99048f2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:46.124777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abdbc2cc-c619-4f44-bcae-229fa99048f2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:46.125847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abdbc2cc-c619-4f44-bcae-229fa99048f2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:46.501218 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d62d4a28-dba4-4f06-a782-ae08b6aa5a6e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdd36726334d00aff06d8da0d84918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2db429e0f5a4bba8fab01176631a13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:46.522233 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d62d4a28-dba4-4f06-a782-ae08b6aa5a6e tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] 10.222.0.85 "GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a" status: 200 len: 1328 microversion: 2.1 time: 1.444356 Aug 24 10:27:46.522898 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1517/3424] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:45 2022] GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a => generated 1328 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:46.541481 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-67c67f98-3d7e-45d6-b331-09d032cb7af4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:46.542355 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-67c67f98-3d7e-45d6-b331-09d032cb7af4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:46.549455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67c67f98-3d7e-45d6-b331-09d032cb7af4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:46.554549 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67c67f98-3d7e-45d6-b331-09d032cb7af4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:46.555292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67c67f98-3d7e-45d6-b331-09d032cb7af4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:46.556469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67c67f98-3d7e-45d6-b331-09d032cb7af4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:46.557109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67c67f98-3d7e-45d6-b331-09d032cb7af4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:46.557899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67c67f98-3d7e-45d6-b331-09d032cb7af4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:46.634032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-abdbc2cc-c619-4f44-bcae-229fa99048f2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:46.652849 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-abdbc2cc-c619-4f44-bcae-229fa99048f2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1314 microversion: 2.1 time: 0.556335 Aug 24 10:27:46.653538 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1908/3425] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:46 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1314 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:46.673360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-83df8ff0-dd24-4312-9c8b-02c9cc00f5a5 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:46.674388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-83df8ff0-dd24-4312-9c8b-02c9cc00f5a5 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] [instance: 51be811b-0bd6-4671-831a-ba5733764143] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:46.682282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83df8ff0-dd24-4312-9c8b-02c9cc00f5a5 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:46.683775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83df8ff0-dd24-4312-9c8b-02c9cc00f5a5 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:46.684653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83df8ff0-dd24-4312-9c8b-02c9cc00f5a5 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:46.686157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83df8ff0-dd24-4312-9c8b-02c9cc00f5a5 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:46.687682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83df8ff0-dd24-4312-9c8b-02c9cc00f5a5 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:46.688807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83df8ff0-dd24-4312-9c8b-02c9cc00f5a5 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:47.127435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:47.246093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-83df8ff0-dd24-4312-9c8b-02c9cc00f5a5 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39bebd0ab646faa5109d1b2f2cae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba66b174cac4cadb9afc09f7df3e21f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:47.263286 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-83df8ff0-dd24-4312-9c8b-02c9cc00f5a5 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143" status: 200 len: 1317 microversion: 2.1 time: 0.593665 Aug 24 10:27:47.278299 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1909/3426] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:46 2022] GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143 => generated 1317 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:47.311731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6ba8950c-f289-4fbb-a6b4-ce72800e59fb tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:47.312990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6ba8950c-f289-4fbb-a6b4-ce72800e59fb tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:47.323985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-67c67f98-3d7e-45d6-b331-09d032cb7af4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:47.335282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ba8950c-f289-4fbb-a6b4-ce72800e59fb tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:47.335970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ba8950c-f289-4fbb-a6b4-ce72800e59fb tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:47.336672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ba8950c-f289-4fbb-a6b4-ce72800e59fb tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:47.337685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ba8950c-f289-4fbb-a6b4-ce72800e59fb tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:47.337913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ba8950c-f289-4fbb-a6b4-ce72800e59fb tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:47.338493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ba8950c-f289-4fbb-a6b4-ce72800e59fb tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:47.364149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-67c67f98-3d7e-45d6-b331-09d032cb7af4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:47.366149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-67c67f98-3d7e-45d6-b331-09d032cb7af4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:47.367754 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-67c67f98-3d7e-45d6-b331-09d032cb7af4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.830342 Aug 24 10:27:47.368946 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1518/3427] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:27:46 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:27:47.545299 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-78f35eda-492a-4f81-be7a-ac47a2157b33 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:47.546122 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-78f35eda-492a-4f81-be7a-ac47a2157b33 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] [instance: 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:47.559485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78f35eda-492a-4f81-be7a-ac47a2157b33 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:47.560289 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78f35eda-492a-4f81-be7a-ac47a2157b33 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:47.560955 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78f35eda-492a-4f81-be7a-ac47a2157b33 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:47.562020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78f35eda-492a-4f81-be7a-ac47a2157b33 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:47.562702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78f35eda-492a-4f81-be7a-ac47a2157b33 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:47.563545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78f35eda-492a-4f81-be7a-ac47a2157b33 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:47.807003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6ba8950c-f289-4fbb-a6b4-ce72800e59fb tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:47.828201 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6ba8950c-f289-4fbb-a6b4-ce72800e59fb tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1514 microversion: 2.1 time: 0.559817 Aug 24 10:27:47.850216 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1910/3428] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:47 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1514 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:47.863261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-22552974-83d9-4f97-9922-79423f82490a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:47.869079 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-22552974-83d9-4f97-9922-79423f82490a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:47.889599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:47.894636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22552974-83d9-4f97-9922-79423f82490a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:47.896632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22552974-83d9-4f97-9922-79423f82490a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:47.897575 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22552974-83d9-4f97-9922-79423f82490a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:47.902591 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22552974-83d9-4f97-9922-79423f82490a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:47.903779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22552974-83d9-4f97-9922-79423f82490a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:47.904842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22552974-83d9-4f97-9922-79423f82490a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:48.325170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-22552974-83d9-4f97-9922-79423f82490a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:48.335457 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-22552974-83d9-4f97-9922-79423f82490a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1501 microversion: 2.1 time: 0.480834 Aug 24 10:27:48.336833 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1911/3429] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:47 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1501 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:48.356309 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-ac43960f-3e7e-4dff-b8ad-e8745ccbce62 req-c38c7248-1c3c-42b3-94d0-6808d14672ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a", "name": "network-vif-plugged", "status": "completed", "tag": "a5659688-be91-4c58-ae4d-ccd5bdbc3a0e"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:48.376414 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ac43960f-3e7e-4dff-b8ad-e8745ccbce62 req-c38c7248-1c3c-42b3-94d0-6808d14672ab service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:48.377521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ac43960f-3e7e-4dff-b8ad-e8745ccbce62 req-c38c7248-1c3c-42b3-94d0-6808d14672ab service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:48.378168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ac43960f-3e7e-4dff-b8ad-e8745ccbce62 req-c38c7248-1c3c-42b3-94d0-6808d14672ab service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:48.412723 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-ac43960f-3e7e-4dff-b8ad-e8745ccbce62 req-c38c7248-1c3c-42b3-94d0-6808d14672ab service nova] Creating event network-vif-plugged:a5659688-be91-4c58-ae4d-ccd5bdbc3a0e for instance 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a on n-h1-849328-3 Aug 24 10:27:48.422857 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-ac43960f-3e7e-4dff-b8ad-e8745ccbce62 req-c38c7248-1c3c-42b3-94d0-6808d14672ab service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084405 Aug 24 10:27:48.427556 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1912/3430] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:27:48.436691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ead20391-b90f-4849-b5cc-3a9e1d06802a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:48.442704 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ead20391-b90f-4849-b5cc-3a9e1d06802a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] [instance: 51be811b-0bd6-4671-831a-ba5733764143] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:48.450858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ead20391-b90f-4849-b5cc-3a9e1d06802a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:48.451997 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ead20391-b90f-4849-b5cc-3a9e1d06802a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:48.452460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ead20391-b90f-4849-b5cc-3a9e1d06802a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:48.453331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ead20391-b90f-4849-b5cc-3a9e1d06802a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:48.453869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ead20391-b90f-4849-b5cc-3a9e1d06802a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:48.454305 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ead20391-b90f-4849-b5cc-3a9e1d06802a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:48.745075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-78f35eda-492a-4f81-be7a-ac47a2157b33 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdd36726334d00aff06d8da0d84918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2db429e0f5a4bba8fab01176631a13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:48.754006 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-78f35eda-492a-4f81-be7a-ac47a2157b33 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] 10.222.0.85 "GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a" status: 200 len: 1328 microversion: 2.1 time: 1.213116 Aug 24 10:27:48.764807 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1519/3431] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:47 2022] GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a => generated 1328 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:27:48.775833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6062950c-aa5b-4919-a563-3bb63853f80a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:48.790840 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6062950c-aa5b-4919-a563-3bb63853f80a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:48.791511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6062950c-aa5b-4919-a563-3bb63853f80a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:48.792090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6062950c-aa5b-4919-a563-3bb63853f80a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:48.851380 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ead20391-b90f-4849-b5cc-3a9e1d06802a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39bebd0ab646faa5109d1b2f2cae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba66b174cac4cadb9afc09f7df3e21f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:48.868432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6062950c-aa5b-4919-a563-3bb63853f80a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Going to try to stop instance {{(pid=122432) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 10:27:48.870148 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ead20391-b90f-4849-b5cc-3a9e1d06802a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143" status: 200 len: 1317 microversion: 2.1 time: 0.440881 Aug 24 10:27:48.872606 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1913/3432] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:48 2022] GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143 => generated 1317 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:48.897606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-071566b0-8823-4277-9073-4a941eb12e99 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:48.900378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-071566b0-8823-4277-9073-4a941eb12e99 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:48.917273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-071566b0-8823-4277-9073-4a941eb12e99 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:48.917778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-071566b0-8823-4277-9073-4a941eb12e99 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:48.918220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-071566b0-8823-4277-9073-4a941eb12e99 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:48.922343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-071566b0-8823-4277-9073-4a941eb12e99 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:48.922814 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-071566b0-8823-4277-9073-4a941eb12e99 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:48.923258 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-071566b0-8823-4277-9073-4a941eb12e99 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:48.992134 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6062950c-aa5b-4919-a563-3bb63853f80a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "POST /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a/action" status: 202 len: 0 microversion: 2.1 time: 0.221303 Aug 24 10:27:48.993106 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1520/3433] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:27:48 2022] POST /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:27:49.284157 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-993de29e-c4a8-4cd2-b75a-271422e4c6b6 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-368401617", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:49.360192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-993de29e-c4a8-4cd2-b75a-271422e4c6b6 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] validate_networks() for [('e672a0e9-6701-4eed-8b4e-431795420ea2', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:27:49.368775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-071566b0-8823-4277-9073-4a941eb12e99 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:49.384688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-071566b0-8823-4277-9073-4a941eb12e99 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:49.386250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-071566b0-8823-4277-9073-4a941eb12e99 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:49.387435 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-071566b0-8823-4277-9073-4a941eb12e99 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.513545 Aug 24 10:27:49.393980 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1914/3434] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:27:48 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:27:49.401939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9bdcdb48-ebad-481a-b722-4a1a95ead8bd tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:49.407219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9bdcdb48-ebad-481a-b722-4a1a95ead8bd tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:49.416764 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bdcdb48-ebad-481a-b722-4a1a95ead8bd tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:49.417537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bdcdb48-ebad-481a-b722-4a1a95ead8bd tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:49.418158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bdcdb48-ebad-481a-b722-4a1a95ead8bd tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:49.419285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bdcdb48-ebad-481a-b722-4a1a95ead8bd tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:49.419904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bdcdb48-ebad-481a-b722-4a1a95ead8bd tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:49.420491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bdcdb48-ebad-481a-b722-4a1a95ead8bd tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:49.690211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9bdcdb48-ebad-481a-b722-4a1a95ead8bd tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:49.699906 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9bdcdb48-ebad-481a-b722-4a1a95ead8bd tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1514 microversion: 2.1 time: 0.304632 Aug 24 10:27:49.701065 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1915/3435] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:49 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1514 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:49.706048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4b765537-a2bb-4b40-a848-d1abd667ac36 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:49.707141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4b765537-a2bb-4b40-a848-d1abd667ac36 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:49.714375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b765537-a2bb-4b40-a848-d1abd667ac36 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:49.715092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b765537-a2bb-4b40-a848-d1abd667ac36 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:49.715713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b765537-a2bb-4b40-a848-d1abd667ac36 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:49.716603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b765537-a2bb-4b40-a848-d1abd667ac36 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:49.717248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b765537-a2bb-4b40-a848-d1abd667ac36 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:49.717860 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b765537-a2bb-4b40-a848-d1abd667ac36 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:49.881193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4b765537-a2bb-4b40-a848-d1abd667ac36 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:49.895370 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4b765537-a2bb-4b40-a848-d1abd667ac36 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1511 microversion: 2.1 time: 0.192944 Aug 24 10:27:49.895985 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1916/3436] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:49 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1511 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:49.901641 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-073b3be0-efbe-41d3-94e9-177483b6a16c req-b5283075-7173-42e5-88b1-cad84ab18887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51be811b-0bd6-4671-831a-ba5733764143", "tag": "c45a2f3f-9db0-4c17-83e8-0cf4d8711aba"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:49.912842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-073b3be0-efbe-41d3-94e9-177483b6a16c req-b5283075-7173-42e5-88b1-cad84ab18887 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:49.913568 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-073b3be0-efbe-41d3-94e9-177483b6a16c req-b5283075-7173-42e5-88b1-cad84ab18887 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:49.914195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-073b3be0-efbe-41d3-94e9-177483b6a16c req-b5283075-7173-42e5-88b1-cad84ab18887 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:49.928706 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-073b3be0-efbe-41d3-94e9-177483b6a16c req-b5283075-7173-42e5-88b1-cad84ab18887 service nova] Creating event network-changed:c45a2f3f-9db0-4c17-83e8-0cf4d8711aba for instance 51be811b-0bd6-4671-831a-ba5733764143 on n-h1-849328-3 Aug 24 10:27:49.937361 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-073b3be0-efbe-41d3-94e9-177483b6a16c req-b5283075-7173-42e5-88b1-cad84ab18887 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040110 Aug 24 10:27:49.939047 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1917/3437] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:27:49.950759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a47e9e8a-6525-4fc0-abc8-81803309fe74 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:49.952488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a47e9e8a-6525-4fc0-abc8-81803309fe74 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] [instance: 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:49.964048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a47e9e8a-6525-4fc0-abc8-81803309fe74 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:49.965617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a47e9e8a-6525-4fc0-abc8-81803309fe74 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:49.966275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a47e9e8a-6525-4fc0-abc8-81803309fe74 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:49.967200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a47e9e8a-6525-4fc0-abc8-81803309fe74 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:49.967842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a47e9e8a-6525-4fc0-abc8-81803309fe74 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:49.968271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a47e9e8a-6525-4fc0-abc8-81803309fe74 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:50.228164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a47e9e8a-6525-4fc0-abc8-81803309fe74 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdd36726334d00aff06d8da0d84918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2db429e0f5a4bba8fab01176631a13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:50.235086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:50.239501 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a47e9e8a-6525-4fc0-abc8-81803309fe74 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] 10.222.0.85 "GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a" status: 200 len: 1328 microversion: 2.1 time: 0.299028 Aug 24 10:27:50.244254 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1918/3438] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:49 2022] GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a => generated 1328 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:50.255857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fd66f0b6-77f4-4084-bb1d-47f2c4edc746 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:50.258370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fd66f0b6-77f4-4084-bb1d-47f2c4edc746 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] [instance: 51be811b-0bd6-4671-831a-ba5733764143] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:50.278657 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd66f0b6-77f4-4084-bb1d-47f2c4edc746 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:50.282284 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd66f0b6-77f4-4084-bb1d-47f2c4edc746 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:50.282879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd66f0b6-77f4-4084-bb1d-47f2c4edc746 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:50.283984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd66f0b6-77f4-4084-bb1d-47f2c4edc746 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:50.285621 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd66f0b6-77f4-4084-bb1d-47f2c4edc746 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:50.288412 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd66f0b6-77f4-4084-bb1d-47f2c4edc746 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:50.924850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fd66f0b6-77f4-4084-bb1d-47f2c4edc746 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39bebd0ab646faa5109d1b2f2cae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba66b174cac4cadb9afc09f7df3e21f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:50.941654 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fd66f0b6-77f4-4084-bb1d-47f2c4edc746 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143" status: 200 len: 1317 microversion: 2.1 time: 0.692761 Aug 24 10:27:50.942381 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1919/3439] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:50 2022] GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143 => generated 1317 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:50.958442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fd66f0b6-77f4-4084-bb1d-47f2c4edc746 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:50.960730 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fd66f0b6-77f4-4084-bb1d-47f2c4edc746 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002316 Aug 24 10:27:50.969385 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1920/3440] 10.222.0.85 () {56 vars in 886 bytes} [Wed Aug 24 10:27:50 2022] GET /compute/ => generated 377 bytes in 26 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 24 10:27:50.979258 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4dfc1c7a-6644-43de-be84-2566544f21d3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:50.980241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4dfc1c7a-6644-43de-be84-2566544f21d3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:50.987242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4dfc1c7a-6644-43de-be84-2566544f21d3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:50.987984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4dfc1c7a-6644-43de-be84-2566544f21d3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:50.988620 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4dfc1c7a-6644-43de-be84-2566544f21d3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:50.989572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4dfc1c7a-6644-43de-be84-2566544f21d3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:50.990307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4dfc1c7a-6644-43de-be84-2566544f21d3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:50.990941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4dfc1c7a-6644-43de-be84-2566544f21d3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:51.066176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-993de29e-c4a8-4cd2-b75a-271422e4c6b6 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:27:51.069039 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-993de29e-c4a8-4cd2-b75a-271422e4c6b6 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:27:51.070571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-993de29e-c4a8-4cd2-b75a-271422e4c6b6 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:27:51.071432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-993de29e-c4a8-4cd2-b75a-271422e4c6b6 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:27:51.072700 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-993de29e-c4a8-4cd2-b75a-271422e4c6b6 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:27:51.094834 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-993de29e-c4a8-4cd2-b75a-271422e4c6b6 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:51.095840 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-993de29e-c4a8-4cd2-b75a-271422e4c6b6 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:51.097108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-993de29e-c4a8-4cd2-b75a-271422e4c6b6 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:51.098758 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-993de29e-c4a8-4cd2-b75a-271422e4c6b6 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:51.099362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-993de29e-c4a8-4cd2-b75a-271422e4c6b6 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:51.099789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-993de29e-c4a8-4cd2-b75a-271422e4c6b6 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:51.130270 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-993de29e-c4a8-4cd2-b75a-271422e4c6b6 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Getting quotas for project 8a932df7eb0b43fe9da0435cb6abeb4e. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:27:51.142971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-993de29e-c4a8-4cd2-b75a-271422e4c6b6 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Getting quotas for user 83da12005b474f1d817200fa86a285b4 and project 8a932df7eb0b43fe9da0435cb6abeb4e. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:27:51.168915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-993de29e-c4a8-4cd2-b75a-271422e4c6b6 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:27:51.171709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-993de29e-c4a8-4cd2-b75a-271422e4c6b6 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:27:51.279009 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-993de29e-c4a8-4cd2-b75a-271422e4c6b6 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.279057 Aug 24 10:27:51.279693 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1521/3441] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:27:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 2283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:27:51.292425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2dd1e4d0-769e-4d44-b027-6ece2b04b476 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:51.293240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2dd1e4d0-769e-4d44-b027-6ece2b04b476 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:51.308147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dd1e4d0-769e-4d44-b027-6ece2b04b476 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:51.308695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dd1e4d0-769e-4d44-b027-6ece2b04b476 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:51.309155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dd1e4d0-769e-4d44-b027-6ece2b04b476 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:51.313612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dd1e4d0-769e-4d44-b027-6ece2b04b476 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:51.314327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dd1e4d0-769e-4d44-b027-6ece2b04b476 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:51.314932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dd1e4d0-769e-4d44-b027-6ece2b04b476 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:51.798354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2dd1e4d0-769e-4d44-b027-6ece2b04b476 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:51.819765 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2dd1e4d0-769e-4d44-b027-6ece2b04b476 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1514 microversion: 2.1 time: 0.534429 Aug 24 10:27:51.821210 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1522/3442] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:51 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1514 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:51.837849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8faeb014-217a-4c3a-ab3b-ce3ab0d513ca tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:51.850960 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8faeb014-217a-4c3a-ab3b-ce3ab0d513ca tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:51.863429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8faeb014-217a-4c3a-ab3b-ce3ab0d513ca tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:51.864228 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8faeb014-217a-4c3a-ab3b-ce3ab0d513ca tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:51.865501 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8faeb014-217a-4c3a-ab3b-ce3ab0d513ca tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:51.867238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8faeb014-217a-4c3a-ab3b-ce3ab0d513ca tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:51.868333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8faeb014-217a-4c3a-ab3b-ce3ab0d513ca tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:51.868803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8faeb014-217a-4c3a-ab3b-ce3ab0d513ca tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:51.913759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4dfc1c7a-6644-43de-be84-2566544f21d3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:51.928721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4dfc1c7a-6644-43de-be84-2566544f21d3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:51.930310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4dfc1c7a-6644-43de-be84-2566544f21d3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:51.937231 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4dfc1c7a-6644-43de-be84-2566544f21d3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.965714 Aug 24 10:27:51.939687 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1921/3443] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:27:50 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:27:51.953682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dc48a8ec-107b-4f7e-b28a-f8ba679e3060 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:51.954330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dc48a8ec-107b-4f7e-b28a-f8ba679e3060 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] [instance: 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:51.978294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc48a8ec-107b-4f7e-b28a-f8ba679e3060 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:51.979257 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc48a8ec-107b-4f7e-b28a-f8ba679e3060 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:51.979943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc48a8ec-107b-4f7e-b28a-f8ba679e3060 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:51.980960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc48a8ec-107b-4f7e-b28a-f8ba679e3060 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:51.981683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc48a8ec-107b-4f7e-b28a-f8ba679e3060 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:51.982532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc48a8ec-107b-4f7e-b28a-f8ba679e3060 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:52.608672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8faeb014-217a-4c3a-ab3b-ce3ab0d513ca tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:52.630481 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8faeb014-217a-4c3a-ab3b-ce3ab0d513ca tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1511 microversion: 2.1 time: 0.805759 Aug 24 10:27:52.635842 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1523/3444] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:51 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1511 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:52.658957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0c970ba4-1d92-4a9d-865f-1b7849678db0 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:52.666252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0c970ba4-1d92-4a9d-865f-1b7849678db0 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:52.675312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c970ba4-1d92-4a9d-865f-1b7849678db0 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:52.676430 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c970ba4-1d92-4a9d-865f-1b7849678db0 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:52.677251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c970ba4-1d92-4a9d-865f-1b7849678db0 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:52.679205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c970ba4-1d92-4a9d-865f-1b7849678db0 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:52.680473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c970ba4-1d92-4a9d-865f-1b7849678db0 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:52.681618 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c970ba4-1d92-4a9d-865f-1b7849678db0 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:52.753438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dc48a8ec-107b-4f7e-b28a-f8ba679e3060 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdd36726334d00aff06d8da0d84918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2db429e0f5a4bba8fab01176631a13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:52.781405 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dc48a8ec-107b-4f7e-b28a-f8ba679e3060 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] 10.222.0.85 "GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a" status: 200 len: 1528 microversion: 2.1 time: 0.830773 Aug 24 10:27:52.782508 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1922/3445] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:51 2022] GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a => generated 1528 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:52.801667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6bac13d0-d4fa-4007-9b5b-80d189345d51 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:52.803201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6bac13d0-d4fa-4007-9b5b-80d189345d51 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] [instance: 51be811b-0bd6-4671-831a-ba5733764143] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:52.810843 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0c970ba4-1d92-4a9d-865f-1b7849678db0 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:52.815165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:52.823445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bac13d0-d4fa-4007-9b5b-80d189345d51 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:52.826445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bac13d0-d4fa-4007-9b5b-80d189345d51 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:52.827247 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bac13d0-d4fa-4007-9b5b-80d189345d51 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:52.828017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bac13d0-d4fa-4007-9b5b-80d189345d51 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:52.831665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bac13d0-d4fa-4007-9b5b-80d189345d51 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:52.832112 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0c970ba4-1d92-4a9d-865f-1b7849678db0 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1274 microversion: 2.1 time: 0.191007 Aug 24 10:27:52.832520 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bac13d0-d4fa-4007-9b5b-80d189345d51 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:52.832800 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1524/3446] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:52 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1274 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:52.844437 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-86101d37-527e-4780-8339-de9121039d17 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:52.846076 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-86101d37-527e-4780-8339-de9121039d17 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] [instance: 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:52.860555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86101d37-527e-4780-8339-de9121039d17 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:52.868185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86101d37-527e-4780-8339-de9121039d17 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:52.869942 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86101d37-527e-4780-8339-de9121039d17 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:52.870990 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86101d37-527e-4780-8339-de9121039d17 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:52.872852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86101d37-527e-4780-8339-de9121039d17 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:52.874851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86101d37-527e-4780-8339-de9121039d17 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:53.096614 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-86101d37-527e-4780-8339-de9121039d17 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdd36726334d00aff06d8da0d84918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2db429e0f5a4bba8fab01176631a13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:53.110315 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-86101d37-527e-4780-8339-de9121039d17 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] 10.222.0.85 "GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a" status: 200 len: 1528 microversion: 2.1 time: 0.276237 Aug 24 10:27:53.111713 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1525/3447] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:52 2022] GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a => generated 1528 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:53.120816 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dfe9a841-e504-4548-8cc2-11147568f584 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:53.124069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dfe9a841-e504-4548-8cc2-11147568f584 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:53.135612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfe9a841-e504-4548-8cc2-11147568f584 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:53.136507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfe9a841-e504-4548-8cc2-11147568f584 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:53.137269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfe9a841-e504-4548-8cc2-11147568f584 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:53.138182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfe9a841-e504-4548-8cc2-11147568f584 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:53.139170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfe9a841-e504-4548-8cc2-11147568f584 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:53.139907 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfe9a841-e504-4548-8cc2-11147568f584 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:53.314694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6bac13d0-d4fa-4007-9b5b-80d189345d51 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39bebd0ab646faa5109d1b2f2cae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba66b174cac4cadb9afc09f7df3e21f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:53.329755 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6bac13d0-d4fa-4007-9b5b-80d189345d51 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143" status: 200 len: 1317 microversion: 2.1 time: 0.546036 Aug 24 10:27:53.334440 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1923/3448] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:52 2022] GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143 => generated 1317 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:53.352874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7bb0a16d-1b04-4e0f-b5fe-8840131bc4c4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:53.353580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7bb0a16d-1b04-4e0f-b5fe-8840131bc4c4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:53.363866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bb0a16d-1b04-4e0f-b5fe-8840131bc4c4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:53.365333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bb0a16d-1b04-4e0f-b5fe-8840131bc4c4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:53.366193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bb0a16d-1b04-4e0f-b5fe-8840131bc4c4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:53.374982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bb0a16d-1b04-4e0f-b5fe-8840131bc4c4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:53.375916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bb0a16d-1b04-4e0f-b5fe-8840131bc4c4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:53.376802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bb0a16d-1b04-4e0f-b5fe-8840131bc4c4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:53.438971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dfe9a841-e504-4548-8cc2-11147568f584 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:53.456179 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dfe9a841-e504-4548-8cc2-11147568f584 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1514 microversion: 2.1 time: 0.341317 Aug 24 10:27:53.460369 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1526/3449] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:53 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1514 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:53.640563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2e3f72c2-1d87-4b19-bd8d-298876a3b9af tempest-ServersNegativeTestMultiTenantJSON-1281369324 tempest-ServersNegativeTestMultiTenantJSON-1281369324-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:53.641229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2e3f72c2-1d87-4b19-bd8d-298876a3b9af tempest-ServersNegativeTestMultiTenantJSON-1281369324 tempest-ServersNegativeTestMultiTenantJSON-1281369324-project] [instance: 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:53.654888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e3f72c2-1d87-4b19-bd8d-298876a3b9af tempest-ServersNegativeTestMultiTenantJSON-1281369324 tempest-ServersNegativeTestMultiTenantJSON-1281369324-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:53.655872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e3f72c2-1d87-4b19-bd8d-298876a3b9af tempest-ServersNegativeTestMultiTenantJSON-1281369324 tempest-ServersNegativeTestMultiTenantJSON-1281369324-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:53.656630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e3f72c2-1d87-4b19-bd8d-298876a3b9af tempest-ServersNegativeTestMultiTenantJSON-1281369324 tempest-ServersNegativeTestMultiTenantJSON-1281369324-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:53.657619 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e3f72c2-1d87-4b19-bd8d-298876a3b9af tempest-ServersNegativeTestMultiTenantJSON-1281369324 tempest-ServersNegativeTestMultiTenantJSON-1281369324-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:53.658449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e3f72c2-1d87-4b19-bd8d-298876a3b9af tempest-ServersNegativeTestMultiTenantJSON-1281369324 tempest-ServersNegativeTestMultiTenantJSON-1281369324-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:53.659085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e3f72c2-1d87-4b19-bd8d-298876a3b9af tempest-ServersNegativeTestMultiTenantJSON-1281369324 tempest-ServersNegativeTestMultiTenantJSON-1281369324-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:53.683833 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-2e3f72c2-1d87-4b19-bd8d-298876a3b9af tempest-ServersNegativeTestMultiTenantJSON-1281369324 tempest-ServersNegativeTestMultiTenantJSON-1281369324-project] HTTP exception thrown: Instance 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a could not be found. Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2e3f72c2-1d87-4b19-bd8d-298876a3b9af tempest-ServersNegativeTestMultiTenantJSON-1281369324 tempest-ServersNegativeTestMultiTenantJSON-1281369324-project] Request method failure captured: Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a HTTP/1.1 Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf0JZl-6juzACcUsLgWBGX8rLzoQfm--2S0H3e3Do5rDK9MBPFU36Ie2ED1Z6d3eh1SCP1Nh69tjE0Vij5uKQfyOqJ4XeNPiVuMscFWd76WA_vCSSpDU9znIgj8IPLhbxdmW6swdbvWXYXwvbvbfufjjOVUw8ZDjhbpuLX3fO8G4ULc Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 448f72a2981543f7a9972a4949336a9c Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1281369324 Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/448f72a2981543f7a9972a4949336a9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_448f72a2981543f7a9972a4949336a9c", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/448f72a2981543f7a9972a4949336a9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/448f72a2981543f7a9972a4949336a9c"}]}] Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1281369324 Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 448f72a2981543f7a9972a4949336a9c Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1281369324 Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1281369324-project Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: eb0559f1c5484a7aa66190d2befa7526 Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1281369324-project Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a could not be found. Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a'} Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a could not be found. Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:27:53.687243 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:27:53.692591 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a could not be found. Aug 24 10:27:53.692591 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:53.692591 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:53.692591 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:53.692591 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:53.692591 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:53.692591 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:53.692591 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:27:53.692591 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:27:53.692591 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a could not be found. Aug 24 10:27:53.692591 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:53.694761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2e3f72c2-1d87-4b19-bd8d-298876a3b9af tempest-ServersNegativeTestMultiTenantJSON-1281369324 tempest-ServersNegativeTestMultiTenantJSON-1281369324-project] Returning 404 to user: Instance 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:27:53.695665 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2e3f72c2-1d87-4b19-bd8d-298876a3b9af tempest-ServersNegativeTestMultiTenantJSON-1281369324 tempest-ServersNegativeTestMultiTenantJSON-1281369324-project] 10.222.0.85 "DELETE /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a" status: 404 len: 111 microversion: 2.1 time: 0.233351 Aug 24 10:27:53.696325 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1527/3450] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:27:53 2022] DELETE /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a => generated 111 bytes in 235 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:27:53.701173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-008d902e-e063-4ea0-a6b3-09358aa9b1c8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:53.701789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-008d902e-e063-4ea0-a6b3-09358aa9b1c8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:53.707974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-008d902e-e063-4ea0-a6b3-09358aa9b1c8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:53.708486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-008d902e-e063-4ea0-a6b3-09358aa9b1c8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:53.708929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-008d902e-e063-4ea0-a6b3-09358aa9b1c8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:53.709634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-008d902e-e063-4ea0-a6b3-09358aa9b1c8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:53.710137 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-008d902e-e063-4ea0-a6b3-09358aa9b1c8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:53.710766 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-008d902e-e063-4ea0-a6b3-09358aa9b1c8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:53.864102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-008d902e-e063-4ea0-a6b3-09358aa9b1c8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:53.873314 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-008d902e-e063-4ea0-a6b3-09358aa9b1c8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1511 microversion: 2.1 time: 0.175544 Aug 24 10:27:53.874675 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1528/3451] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:53 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:53.879794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3fab946f-68e7-4277-9fd3-b0714f9eabd0 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:53.880614 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3fab946f-68e7-4277-9fd3-b0714f9eabd0 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] [instance: 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:53.887017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fab946f-68e7-4277-9fd3-b0714f9eabd0 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:53.887502 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fab946f-68e7-4277-9fd3-b0714f9eabd0 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:53.888131 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fab946f-68e7-4277-9fd3-b0714f9eabd0 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:53.888837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fab946f-68e7-4277-9fd3-b0714f9eabd0 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:53.889323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fab946f-68e7-4277-9fd3-b0714f9eabd0 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:53.889795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fab946f-68e7-4277-9fd3-b0714f9eabd0 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:53.974175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7bb0a16d-1b04-4e0f-b5fe-8840131bc4c4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:53.988382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7bb0a16d-1b04-4e0f-b5fe-8840131bc4c4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:53.989979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7bb0a16d-1b04-4e0f-b5fe-8840131bc4c4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:53.991261 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7bb0a16d-1b04-4e0f-b5fe-8840131bc4c4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.655494 Aug 24 10:27:54.006411 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1924/3452] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:27:53 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:27:54.013834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-af871f45-fd8a-46d1-84b7-e17b9ee2383f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:54.014454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-af871f45-fd8a-46d1-84b7-e17b9ee2383f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:54.024100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af871f45-fd8a-46d1-84b7-e17b9ee2383f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:54.028228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af871f45-fd8a-46d1-84b7-e17b9ee2383f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:54.031892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af871f45-fd8a-46d1-84b7-e17b9ee2383f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:54.031892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af871f45-fd8a-46d1-84b7-e17b9ee2383f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:54.031892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af871f45-fd8a-46d1-84b7-e17b9ee2383f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:54.031892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af871f45-fd8a-46d1-84b7-e17b9ee2383f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:54.186532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3fab946f-68e7-4277-9fd3-b0714f9eabd0 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdd36726334d00aff06d8da0d84918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2db429e0f5a4bba8fab01176631a13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:54.191286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-af871f45-fd8a-46d1-84b7-e17b9ee2383f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:54.204229 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-af871f45-fd8a-46d1-84b7-e17b9ee2383f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1280 microversion: 2.1 time: 0.196502 Aug 24 10:27:54.211701 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3fab946f-68e7-4277-9fd3-b0714f9eabd0 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] 10.222.0.85 "GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a" status: 200 len: 1528 microversion: 2.1 time: 0.330352 Aug 24 10:27:54.211701 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1529/3453] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:53 2022] GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a => generated 1528 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:54.212166 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1925/3454] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:54 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1280 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:54.237899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e3bfa8e5-c71a-49ae-827a-ffa374636746 tempest-ServersNegativeTestMultiTenantJSON-1281369324 tempest-ServersNegativeTestMultiTenantJSON-1281369324-project] Action: 'update', calling method: >, body: {"server": {"name": "8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a_new"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:54.253664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e3bfa8e5-c71a-49ae-827a-ffa374636746 tempest-ServersNegativeTestMultiTenantJSON-1281369324 tempest-ServersNegativeTestMultiTenantJSON-1281369324-project] [instance: 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:54.262800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3bfa8e5-c71a-49ae-827a-ffa374636746 tempest-ServersNegativeTestMultiTenantJSON-1281369324 tempest-ServersNegativeTestMultiTenantJSON-1281369324-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:54.263294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3bfa8e5-c71a-49ae-827a-ffa374636746 tempest-ServersNegativeTestMultiTenantJSON-1281369324 tempest-ServersNegativeTestMultiTenantJSON-1281369324-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:54.263729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3bfa8e5-c71a-49ae-827a-ffa374636746 tempest-ServersNegativeTestMultiTenantJSON-1281369324 tempest-ServersNegativeTestMultiTenantJSON-1281369324-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:54.264437 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3bfa8e5-c71a-49ae-827a-ffa374636746 tempest-ServersNegativeTestMultiTenantJSON-1281369324 tempest-ServersNegativeTestMultiTenantJSON-1281369324-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:54.264884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3bfa8e5-c71a-49ae-827a-ffa374636746 tempest-ServersNegativeTestMultiTenantJSON-1281369324 tempest-ServersNegativeTestMultiTenantJSON-1281369324-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:54.265333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3bfa8e5-c71a-49ae-827a-ffa374636746 tempest-ServersNegativeTestMultiTenantJSON-1281369324 tempest-ServersNegativeTestMultiTenantJSON-1281369324-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:54.295890 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-e3bfa8e5-c71a-49ae-827a-ffa374636746 tempest-ServersNegativeTestMultiTenantJSON-1281369324 tempest-ServersNegativeTestMultiTenantJSON-1281369324-project] HTTP exception thrown: Instance 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a could not be found. Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e3bfa8e5-c71a-49ae-827a-ffa374636746 tempest-ServersNegativeTestMultiTenantJSON-1281369324 tempest-ServersNegativeTestMultiTenantJSON-1281369324-project] Request method failure captured: Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: request: PUT /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a HTTP/1.1 Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 64 Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf0JZl-6juzACcUsLgWBGX8rLzoQfm--2S0H3e3Do5rDK9MBPFU36Ie2ED1Z6d3eh1SCP1Nh69tjE0Vij5uKQfyOqJ4XeNPiVuMscFWd76WA_vCSSpDU9znIgj8IPLhbxdmW6swdbvWXYXwvbvbfufjjOVUw8ZDjhbpuLX3fO8G4ULc Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 448f72a2981543f7a9972a4949336a9c Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1281369324 Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/448f72a2981543f7a9972a4949336a9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_448f72a2981543f7a9972a4949336a9c", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/448f72a2981543f7a9972a4949336a9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/448f72a2981543f7a9972a4949336a9c"}]}] Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1281369324 Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 448f72a2981543f7a9972a4949336a9c Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1281369324 Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1281369324-project Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: eb0559f1c5484a7aa66190d2befa7526 Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1281369324-project Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: {"server": {"name": "8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a_new"}} Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a could not be found. Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a', 'body': {'server': {'name': '8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a_new'}}} Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a could not be found. Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:27:54.298659 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 24 10:27:54.304937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 24 10:27:54.304937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 24 10:27:54.304937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:27:54.304937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:27:54.304937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:27:54.304937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:27:54.304937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a could not be found. Aug 24 10:27:54.304937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:54.304937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:54.304937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:54.304937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:54.304937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:54.304937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:54.304937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:27:54.304937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:27:54.304937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a could not be found. Aug 24 10:27:54.304937 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:27:54.304937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e3bfa8e5-c71a-49ae-827a-ffa374636746 tempest-ServersNegativeTestMultiTenantJSON-1281369324 tempest-ServersNegativeTestMultiTenantJSON-1281369324-project] Returning 404 to user: Instance 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:27:54.308793 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e3bfa8e5-c71a-49ae-827a-ffa374636746 tempest-ServersNegativeTestMultiTenantJSON-1281369324 tempest-ServersNegativeTestMultiTenantJSON-1281369324-project] 10.222.0.85 "PUT /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a" status: 404 len: 111 microversion: 2.1 time: 0.070983 Aug 24 10:27:54.310310 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1530/3455] 10.222.0.85 () {60 vars in 1256 bytes} [Wed Aug 24 10:27:54 2022] PUT /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:27:54.322064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8c7ce337-08f7-4407-85b7-da65c9947260 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:54.322604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8c7ce337-08f7-4407-85b7-da65c9947260 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] [instance: 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:54.338325 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c7ce337-08f7-4407-85b7-da65c9947260 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:54.338814 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c7ce337-08f7-4407-85b7-da65c9947260 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:54.339211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c7ce337-08f7-4407-85b7-da65c9947260 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:54.348302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c7ce337-08f7-4407-85b7-da65c9947260 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:54.348596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c7ce337-08f7-4407-85b7-da65c9947260 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:54.349038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c7ce337-08f7-4407-85b7-da65c9947260 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:54.362018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e471e81-64d6-4afe-b444-f8bb6cd8c322 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:54.362806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6e471e81-64d6-4afe-b444-f8bb6cd8c322 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] [instance: 51be811b-0bd6-4671-831a-ba5733764143] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:54.372567 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e471e81-64d6-4afe-b444-f8bb6cd8c322 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:54.373175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e471e81-64d6-4afe-b444-f8bb6cd8c322 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:54.373404 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e471e81-64d6-4afe-b444-f8bb6cd8c322 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:54.378468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e471e81-64d6-4afe-b444-f8bb6cd8c322 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:54.379216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e471e81-64d6-4afe-b444-f8bb6cd8c322 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:54.382290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e471e81-64d6-4afe-b444-f8bb6cd8c322 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:54.458092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8c7ce337-08f7-4407-85b7-da65c9947260 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] [instance: 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:27:54.678464 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8c7ce337-08f7-4407-85b7-da65c9947260 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] 10.222.0.85 "DELETE /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a" status: 204 len: 0 microversion: 2.1 time: 0.360303 Aug 24 10:27:54.679604 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1926/3456] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:27:54 2022] DELETE /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:27:54.693389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-10f3ad9e-96f6-4704-af4d-cee16e1bded4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:54.694119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-10f3ad9e-96f6-4704-af4d-cee16e1bded4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:54.716342 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10f3ad9e-96f6-4704-af4d-cee16e1bded4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:54.717189 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10f3ad9e-96f6-4704-af4d-cee16e1bded4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:54.717838 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10f3ad9e-96f6-4704-af4d-cee16e1bded4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:54.718856 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10f3ad9e-96f6-4704-af4d-cee16e1bded4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:54.719514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10f3ad9e-96f6-4704-af4d-cee16e1bded4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:54.720091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10f3ad9e-96f6-4704-af4d-cee16e1bded4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:54.912330 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6e471e81-64d6-4afe-b444-f8bb6cd8c322 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39bebd0ab646faa5109d1b2f2cae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba66b174cac4cadb9afc09f7df3e21f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:54.925070 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6e471e81-64d6-4afe-b444-f8bb6cd8c322 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143" status: 200 len: 1317 microversion: 2.1 time: 0.571114 Aug 24 10:27:54.925842 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1531/3457] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:54 2022] GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143 => generated 1317 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:54.936183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b513dff3-073d-4844-90af-fb43c34a6867 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:54.936828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b513dff3-073d-4844-90af-fb43c34a6867 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] [instance: 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:54.952680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b513dff3-073d-4844-90af-fb43c34a6867 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:54.953073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b513dff3-073d-4844-90af-fb43c34a6867 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:54.953559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b513dff3-073d-4844-90af-fb43c34a6867 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:54.954278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b513dff3-073d-4844-90af-fb43c34a6867 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:54.954741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b513dff3-073d-4844-90af-fb43c34a6867 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:54.965482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b513dff3-073d-4844-90af-fb43c34a6867 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:55.402063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b513dff3-073d-4844-90af-fb43c34a6867 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdd36726334d00aff06d8da0d84918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2db429e0f5a4bba8fab01176631a13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:55.426496 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b513dff3-073d-4844-90af-fb43c34a6867 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] 10.222.0.85 "GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a" status: 200 len: 1534 microversion: 2.1 time: 0.497219 Aug 24 10:27:55.427667 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1532/3458] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:54 2022] GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a => generated 1534 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:55.433569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f5424010-63df-4040-b48e-9603fde8370d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:55.442091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f5424010-63df-4040-b48e-9603fde8370d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:55.455469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5424010-63df-4040-b48e-9603fde8370d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:55.456528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5424010-63df-4040-b48e-9603fde8370d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:55.457449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5424010-63df-4040-b48e-9603fde8370d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:55.458692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5424010-63df-4040-b48e-9603fde8370d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:55.459637 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5424010-63df-4040-b48e-9603fde8370d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:55.460627 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5424010-63df-4040-b48e-9603fde8370d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:55.534070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-10f3ad9e-96f6-4704-af4d-cee16e1bded4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:55.578197 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-10f3ad9e-96f6-4704-af4d-cee16e1bded4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1514 microversion: 2.1 time: 0.892392 Aug 24 10:27:55.579324 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1927/3459] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:54 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1514 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:55.587649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a01277c7-90e3-41fd-9ddd-9dbaa0b32cc9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:55.589062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a01277c7-90e3-41fd-9ddd-9dbaa0b32cc9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:55.614528 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a01277c7-90e3-41fd-9ddd-9dbaa0b32cc9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:55.615544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a01277c7-90e3-41fd-9ddd-9dbaa0b32cc9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:55.616238 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a01277c7-90e3-41fd-9ddd-9dbaa0b32cc9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:55.618816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a01277c7-90e3-41fd-9ddd-9dbaa0b32cc9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:55.620416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a01277c7-90e3-41fd-9ddd-9dbaa0b32cc9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:55.632361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a01277c7-90e3-41fd-9ddd-9dbaa0b32cc9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:56.272755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f5424010-63df-4040-b48e-9603fde8370d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:56.284973 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f5424010-63df-4040-b48e-9603fde8370d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1511 microversion: 2.1 time: 0.855959 Aug 24 10:27:56.293985 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1533/3460] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:55 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1511 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:56.299217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-158036f6-6b30-4c26-93d1-8780b3ec123c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:56.302934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-158036f6-6b30-4c26-93d1-8780b3ec123c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:56.310943 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-158036f6-6b30-4c26-93d1-8780b3ec123c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:56.311627 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-158036f6-6b30-4c26-93d1-8780b3ec123c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:56.312254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-158036f6-6b30-4c26-93d1-8780b3ec123c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:56.313611 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-158036f6-6b30-4c26-93d1-8780b3ec123c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:56.314526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-158036f6-6b30-4c26-93d1-8780b3ec123c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:56.315151 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-158036f6-6b30-4c26-93d1-8780b3ec123c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:56.497138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a01277c7-90e3-41fd-9ddd-9dbaa0b32cc9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:56.528159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a01277c7-90e3-41fd-9ddd-9dbaa0b32cc9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:56.531920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a01277c7-90e3-41fd-9ddd-9dbaa0b32cc9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:56.534654 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a01277c7-90e3-41fd-9ddd-9dbaa0b32cc9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.953206 Aug 24 10:27:56.537057 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1928/3461] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:27:55 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:27:56.546466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c7b1a83e-33ae-4918-94a3-1636bcd651ef tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:56.547743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c7b1a83e-33ae-4918-94a3-1636bcd651ef tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] [instance: 51be811b-0bd6-4671-831a-ba5733764143] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:56.556594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7b1a83e-33ae-4918-94a3-1636bcd651ef tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:56.557893 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7b1a83e-33ae-4918-94a3-1636bcd651ef tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:56.558650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7b1a83e-33ae-4918-94a3-1636bcd651ef tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:56.561736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7b1a83e-33ae-4918-94a3-1636bcd651ef tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:56.562958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7b1a83e-33ae-4918-94a3-1636bcd651ef tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:56.563970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7b1a83e-33ae-4918-94a3-1636bcd651ef tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:56.704678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-158036f6-6b30-4c26-93d1-8780b3ec123c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:56.715790 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-158036f6-6b30-4c26-93d1-8780b3ec123c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1322 microversion: 2.1 time: 0.420319 Aug 24 10:27:56.716699 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1534/3462] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:56 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1322 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:56.735811 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-348ba111-ec0c-487f-b862-072e489defd1 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:56.736444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-348ba111-ec0c-487f-b862-072e489defd1 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] [instance: 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:56.743694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-348ba111-ec0c-487f-b862-072e489defd1 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:56.744494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-348ba111-ec0c-487f-b862-072e489defd1 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:56.745102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-348ba111-ec0c-487f-b862-072e489defd1 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:56.746025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-348ba111-ec0c-487f-b862-072e489defd1 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:56.746631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-348ba111-ec0c-487f-b862-072e489defd1 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:56.747216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-348ba111-ec0c-487f-b862-072e489defd1 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:56.985392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c7b1a83e-33ae-4918-94a3-1636bcd651ef tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39bebd0ab646faa5109d1b2f2cae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba66b174cac4cadb9afc09f7df3e21f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:57.004352 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c7b1a83e-33ae-4918-94a3-1636bcd651ef tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143" status: 200 len: 1317 microversion: 2.1 time: 0.465618 Aug 24 10:27:57.019954 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1929/3463] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:56 2022] GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143 => generated 1317 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:57.027622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d6cf141f-abf3-4eaf-b122-5b03c9d91bc6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:57.028654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d6cf141f-abf3-4eaf-b122-5b03c9d91bc6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:57.060538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6cf141f-abf3-4eaf-b122-5b03c9d91bc6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:57.061239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6cf141f-abf3-4eaf-b122-5b03c9d91bc6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:57.062624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6cf141f-abf3-4eaf-b122-5b03c9d91bc6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:57.063796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6cf141f-abf3-4eaf-b122-5b03c9d91bc6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:57.064449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6cf141f-abf3-4eaf-b122-5b03c9d91bc6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:57.065025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6cf141f-abf3-4eaf-b122-5b03c9d91bc6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:57.193431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-348ba111-ec0c-487f-b862-072e489defd1 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdd36726334d00aff06d8da0d84918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2db429e0f5a4bba8fab01176631a13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:57.203105 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-348ba111-ec0c-487f-b862-072e489defd1 tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] 10.222.0.85 "GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a" status: 200 len: 1534 microversion: 2.1 time: 0.471626 Aug 24 10:27:57.204019 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1535/3464] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:56 2022] GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a => generated 1534 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:57.316948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b08c030-923b-4f92-b7b6-6645b462951f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:57.319551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2b08c030-923b-4f92-b7b6-6645b462951f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:57.333730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b08c030-923b-4f92-b7b6-6645b462951f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:57.334681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b08c030-923b-4f92-b7b6-6645b462951f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:57.335388 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b08c030-923b-4f92-b7b6-6645b462951f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:57.336362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b08c030-923b-4f92-b7b6-6645b462951f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:57.337479 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b08c030-923b-4f92-b7b6-6645b462951f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:57.338204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b08c030-923b-4f92-b7b6-6645b462951f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:57.558809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d6cf141f-abf3-4eaf-b122-5b03c9d91bc6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:57.571842 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d6cf141f-abf3-4eaf-b122-5b03c9d91bc6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1514 microversion: 2.1 time: 0.549126 Aug 24 10:27:57.573278 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1930/3465] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:57 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1514 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:57.592370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a6b62f52-cd2b-45ab-a85c-10d555a58424 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:57.593470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a6b62f52-cd2b-45ab-a85c-10d555a58424 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:57.614106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6b62f52-cd2b-45ab-a85c-10d555a58424 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:57.615141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6b62f52-cd2b-45ab-a85c-10d555a58424 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:57.615962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6b62f52-cd2b-45ab-a85c-10d555a58424 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:57.621669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6b62f52-cd2b-45ab-a85c-10d555a58424 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:57.625245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6b62f52-cd2b-45ab-a85c-10d555a58424 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:57.626055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6b62f52-cd2b-45ab-a85c-10d555a58424 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:57.867439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2b08c030-923b-4f92-b7b6-6645b462951f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:57.880292 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2b08c030-923b-4f92-b7b6-6645b462951f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1511 microversion: 2.1 time: 0.568277 Aug 24 10:27:57.890963 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1536/3466] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:57 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1511 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:27:57.899255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-ac801c82-611e-4dab-bebd-c6298f6c708f req-83074e71-1626-444a-a482-7723a715af6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51be811b-0bd6-4671-831a-ba5733764143", "name": "network-vif-plugged", "status": "completed", "tag": "c45a2f3f-9db0-4c17-83e8-0cf4d8711aba"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:57.916774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ac801c82-611e-4dab-bebd-c6298f6c708f req-83074e71-1626-444a-a482-7723a715af6d service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:57.919121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ac801c82-611e-4dab-bebd-c6298f6c708f req-83074e71-1626-444a-a482-7723a715af6d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:57.920957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ac801c82-611e-4dab-bebd-c6298f6c708f req-83074e71-1626-444a-a482-7723a715af6d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:57.968966 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-ac801c82-611e-4dab-bebd-c6298f6c708f req-83074e71-1626-444a-a482-7723a715af6d service nova] Creating event network-vif-plugged:c45a2f3f-9db0-4c17-83e8-0cf4d8711aba for instance 51be811b-0bd6-4671-831a-ba5733764143 on n-h1-849328-3 Aug 24 10:27:57.981272 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-ac801c82-611e-4dab-bebd-c6298f6c708f req-83074e71-1626-444a-a482-7723a715af6d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087573 Aug 24 10:27:57.983234 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1537/3467] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:27:57.993598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0fe55291-1b29-4ff7-86bc-1b945eebbbad tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:57.996088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0fe55291-1b29-4ff7-86bc-1b945eebbbad tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:58.004896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fe55291-1b29-4ff7-86bc-1b945eebbbad tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:58.006007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fe55291-1b29-4ff7-86bc-1b945eebbbad tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:58.006774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fe55291-1b29-4ff7-86bc-1b945eebbbad tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:58.007754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fe55291-1b29-4ff7-86bc-1b945eebbbad tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:58.008511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fe55291-1b29-4ff7-86bc-1b945eebbbad tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:58.009215 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fe55291-1b29-4ff7-86bc-1b945eebbbad tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:58.133857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a6b62f52-cd2b-45ab-a85c-10d555a58424 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:58.168301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a6b62f52-cd2b-45ab-a85c-10d555a58424 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:58.174548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a6b62f52-cd2b-45ab-a85c-10d555a58424 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:58.177281 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a6b62f52-cd2b-45ab-a85c-10d555a58424 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.601618 Aug 24 10:27:58.181094 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1931/3468] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:27:57 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:27:58.200618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3214a057-d358-447c-bf81-09af165c3470 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:58.201730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3214a057-d358-447c-bf81-09af165c3470 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] [instance: 51be811b-0bd6-4671-831a-ba5733764143] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:58.216927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3214a057-d358-447c-bf81-09af165c3470 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:58.219436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3214a057-d358-447c-bf81-09af165c3470 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:58.220060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3214a057-d358-447c-bf81-09af165c3470 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:58.220960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3214a057-d358-447c-bf81-09af165c3470 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:58.222274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3214a057-d358-447c-bf81-09af165c3470 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:58.226342 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3214a057-d358-447c-bf81-09af165c3470 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:58.709707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3214a057-d358-447c-bf81-09af165c3470 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39bebd0ab646faa5109d1b2f2cae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba66b174cac4cadb9afc09f7df3e21f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:58.734155 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3214a057-d358-447c-bf81-09af165c3470 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143" status: 200 len: 1317 microversion: 2.1 time: 0.551090 Aug 24 10:27:58.735740 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1932/3469] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:58 2022] GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143 => generated 1317 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:58.743727 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-282c1e8a-5ec2-459a-9996-95aada38764c req-6edf3778-d8c9-4126-9442-7b1b41ff727a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a", "name": "network-vif-deleted", "tag": "a5659688-be91-4c58-ae4d-ccd5bdbc3a0e"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:58.758136 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-282c1e8a-5ec2-459a-9996-95aada38764c req-6edf3778-d8c9-4126-9442-7b1b41ff727a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:58.760545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-282c1e8a-5ec2-459a-9996-95aada38764c req-6edf3778-d8c9-4126-9442-7b1b41ff727a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:58.761801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-282c1e8a-5ec2-459a-9996-95aada38764c req-6edf3778-d8c9-4126-9442-7b1b41ff727a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:58.784467 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-282c1e8a-5ec2-459a-9996-95aada38764c req-6edf3778-d8c9-4126-9442-7b1b41ff727a service nova] Creating event network-vif-deleted:a5659688-be91-4c58-ae4d-ccd5bdbc3a0e for instance 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a on n-h1-849328-3 Aug 24 10:27:58.811953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0fe55291-1b29-4ff7-86bc-1b945eebbbad tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:58.822386 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-282c1e8a-5ec2-459a-9996-95aada38764c req-6edf3778-d8c9-4126-9442-7b1b41ff727a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067641 Aug 24 10:27:58.825967 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1933/3470] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:27:58.839208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e49a398b-27a9-4bb6-84c9-feddb9d60e5d tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:58.855617 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0fe55291-1b29-4ff7-86bc-1b945eebbbad tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1322 microversion: 2.1 time: 0.855580 Aug 24 10:27:58.875547 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1538/3471] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:57 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1322 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:58.876589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e49a398b-27a9-4bb6-84c9-feddb9d60e5d tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] [instance: 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:58.886518 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-7c77e31d-5dff-46a1-8d86-4cc6bd5e95d7 req-4b7b2beb-9faa-4a8c-8388-c21b0162351e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a501f37-7cb0-4d7d-a95b-03f7aed77f9d", "tag": "d5ccc17d-296b-4e00-ae9b-8f26eb42f6ec"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:58.892921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e49a398b-27a9-4bb6-84c9-feddb9d60e5d tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:58.893863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e49a398b-27a9-4bb6-84c9-feddb9d60e5d tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:58.895203 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e49a398b-27a9-4bb6-84c9-feddb9d60e5d tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:58.900240 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e49a398b-27a9-4bb6-84c9-feddb9d60e5d tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:58.901756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e49a398b-27a9-4bb6-84c9-feddb9d60e5d tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:58.902790 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e49a398b-27a9-4bb6-84c9-feddb9d60e5d tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:58.923207 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-e49a398b-27a9-4bb6-84c9-feddb9d60e5d tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] HTTP exception thrown: Instance 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a could not be found. Aug 24 10:27:58.923809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7c77e31d-5dff-46a1-8d86-4cc6bd5e95d7 req-4b7b2beb-9faa-4a8c-8388-c21b0162351e service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:58.924830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7c77e31d-5dff-46a1-8d86-4cc6bd5e95d7 req-4b7b2beb-9faa-4a8c-8388-c21b0162351e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:58.925907 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7c77e31d-5dff-46a1-8d86-4cc6bd5e95d7 req-4b7b2beb-9faa-4a8c-8388-c21b0162351e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e49a398b-27a9-4bb6-84c9-feddb9d60e5d tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Request method failure captured: Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a HTTP/1.1 Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfztVtXPejnnBFwA6k56RjGVw_1qY3BlPVl29XZ-zLovc9JvJWQ42-dS5rEUuyMsutieUSmVp4Ae2PIwmNDthPh_nq3TqahvI_E3MzerlhJ5QA552U4hw16U2sT2G21nuJbMlJ2TMlCGoISUkY6OzWIKZc-Fpiwge4KzTeFbTIlwr2M Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: f2db429e0f5a4bba8fab01176631a13e Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-371988016 Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f2db429e0f5a4bba8fab01176631a13e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f2db429e0f5a4bba8fab01176631a13e", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f2db429e0f5a4bba8fab01176631a13e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f2db429e0f5a4bba8fab01176631a13e"}]}] Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-371988016 Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: f2db429e0f5a4bba8fab01176631a13e Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-371988016 Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestMultiTenantJSON-371988016-project Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: c6cdd36726334d00aff06d8da0d84918 Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-371988016-project Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a could not be found. Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a'} Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a could not be found. Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a could not be found. Aug 24 10:27:58.926379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:27:58.931421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:58.931421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:27:58.931421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:58.931421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:58.931421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:58.931421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:27:58.931421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:27:58.931421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a could not be found. Aug 24 10:27:58.931421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:27:58.934475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e49a398b-27a9-4bb6-84c9-feddb9d60e5d tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] Returning 404 to user: Instance 8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:27:58.936038 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e49a398b-27a9-4bb6-84c9-feddb9d60e5d tempest-ServersNegativeTestMultiTenantJSON-371988016 tempest-ServersNegativeTestMultiTenantJSON-371988016-project] 10.222.0.85 "GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a" status: 404 len: 111 microversion: 2.1 time: 0.106607 Aug 24 10:27:58.937887 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1934/3472] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:58 2022] GET /compute/v2.1/servers/8d787fce-7b21-4f5c-9b4c-dedf79cf5f8a => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:27:58.951066 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5b9fc5da-7195-49f0-8c1e-9bf3cc444738 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:58.952589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5b9fc5da-7195-49f0-8c1e-9bf3cc444738 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:58.959240 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7c77e31d-5dff-46a1-8d86-4cc6bd5e95d7 req-4b7b2beb-9faa-4a8c-8388-c21b0162351e service nova] Creating event network-changed:d5ccc17d-296b-4e00-ae9b-8f26eb42f6ec for instance 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d on n-h2-849328-3 Aug 24 10:27:58.963168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b9fc5da-7195-49f0-8c1e-9bf3cc444738 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:58.964140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b9fc5da-7195-49f0-8c1e-9bf3cc444738 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:58.966665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b9fc5da-7195-49f0-8c1e-9bf3cc444738 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:58.968800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b9fc5da-7195-49f0-8c1e-9bf3cc444738 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:58.969097 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-7c77e31d-5dff-46a1-8d86-4cc6bd5e95d7 req-4b7b2beb-9faa-4a8c-8388-c21b0162351e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089087 Aug 24 10:27:58.970185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b9fc5da-7195-49f0-8c1e-9bf3cc444738 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:58.970556 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1539/3473] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:27:58.971770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b9fc5da-7195-49f0-8c1e-9bf3cc444738 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:58.979057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9b7cb49a-c79f-4242-9112-9908aa0b914d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:58.989419 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9b7cb49a-c79f-4242-9112-9908aa0b914d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:59.000156 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b7cb49a-c79f-4242-9112-9908aa0b914d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:59.001079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b7cb49a-c79f-4242-9112-9908aa0b914d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:59.002132 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b7cb49a-c79f-4242-9112-9908aa0b914d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:59.003143 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b7cb49a-c79f-4242-9112-9908aa0b914d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:59.004439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b7cb49a-c79f-4242-9112-9908aa0b914d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:59.005639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b7cb49a-c79f-4242-9112-9908aa0b914d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:59.373920 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9b7cb49a-c79f-4242-9112-9908aa0b914d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:59.385640 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9b7cb49a-c79f-4242-9112-9908aa0b914d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1511 microversion: 2.1 time: 0.412783 Aug 24 10:27:59.388595 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1540/3474] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:58 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1511 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:59.401526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4121b222-8669-48da-b116-fb044610ccca tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:59.402490 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4121b222-8669-48da-b116-fb044610ccca tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:59.409925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4121b222-8669-48da-b116-fb044610ccca tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:59.410790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4121b222-8669-48da-b116-fb044610ccca tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:59.411635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4121b222-8669-48da-b116-fb044610ccca tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:59.412607 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4121b222-8669-48da-b116-fb044610ccca tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:59.413356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4121b222-8669-48da-b116-fb044610ccca tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:59.413993 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4121b222-8669-48da-b116-fb044610ccca tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:59.804353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5b9fc5da-7195-49f0-8c1e-9bf3cc444738 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:59.805429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4121b222-8669-48da-b116-fb044610ccca tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:59.821787 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4121b222-8669-48da-b116-fb044610ccca tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:59.826299 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5b9fc5da-7195-49f0-8c1e-9bf3cc444738 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1514 microversion: 2.1 time: 0.886649 Aug 24 10:27:59.830343 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1935/3475] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:58 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1514 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:59.837238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4121b222-8669-48da-b116-fb044610ccca tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:59.839505 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4121b222-8669-48da-b116-fb044610ccca tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.448656 Aug 24 10:27:59.840711 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1541/3476] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:27:59 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:27:59.844974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-09001880-49cd-461f-b81a-caa8af1bc9b0 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:59.845871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-09001880-49cd-461f-b81a-caa8af1bc9b0 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] [instance: 51be811b-0bd6-4671-831a-ba5733764143] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:59.854346 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09001880-49cd-461f-b81a-caa8af1bc9b0 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:59.859117 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09001880-49cd-461f-b81a-caa8af1bc9b0 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:59.865104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09001880-49cd-461f-b81a-caa8af1bc9b0 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:59.865104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09001880-49cd-461f-b81a-caa8af1bc9b0 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:59.865104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09001880-49cd-461f-b81a-caa8af1bc9b0 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:59.865104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09001880-49cd-461f-b81a-caa8af1bc9b0 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:59.888094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ff3c67e5-532f-4748-bff6-e4bb92132133 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:59.889348 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ff3c67e5-532f-4748-bff6-e4bb92132133 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:59.900352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:59.904164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff3c67e5-532f-4748-bff6-e4bb92132133 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:59.905669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff3c67e5-532f-4748-bff6-e4bb92132133 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:59.907573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff3c67e5-532f-4748-bff6-e4bb92132133 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:59.908469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff3c67e5-532f-4748-bff6-e4bb92132133 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:59.909865 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff3c67e5-532f-4748-bff6-e4bb92132133 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:59.911242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff3c67e5-532f-4748-bff6-e4bb92132133 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:00.227303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-09001880-49cd-461f-b81a-caa8af1bc9b0 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39bebd0ab646faa5109d1b2f2cae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba66b174cac4cadb9afc09f7df3e21f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:00.252784 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-09001880-49cd-461f-b81a-caa8af1bc9b0 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143" status: 200 len: 1317 microversion: 2.1 time: 0.416775 Aug 24 10:28:00.254998 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1936/3477] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:59 2022] GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143 => generated 1317 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:00.409276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-49291c2d-863a-4f52-8b2e-1ce49b02f518 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:00.410321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-49291c2d-863a-4f52-8b2e-1ce49b02f518 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:00.423570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49291c2d-863a-4f52-8b2e-1ce49b02f518 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:00.424616 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49291c2d-863a-4f52-8b2e-1ce49b02f518 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:00.426018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49291c2d-863a-4f52-8b2e-1ce49b02f518 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:00.427260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49291c2d-863a-4f52-8b2e-1ce49b02f518 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:00.427908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49291c2d-863a-4f52-8b2e-1ce49b02f518 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:00.428348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49291c2d-863a-4f52-8b2e-1ce49b02f518 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:00.519341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ff3c67e5-532f-4748-bff6-e4bb92132133 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:00.532494 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ff3c67e5-532f-4748-bff6-e4bb92132133 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1322 microversion: 2.1 time: 0.649230 Aug 24 10:28:00.533113 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1542/3478] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:59 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1322 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:00.852132 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a71ba714-c80a-4fed-947e-168282e4cc64 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:00.852809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a71ba714-c80a-4fed-947e-168282e4cc64 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:00.874919 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a71ba714-c80a-4fed-947e-168282e4cc64 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:00.875874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a71ba714-c80a-4fed-947e-168282e4cc64 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:00.876771 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a71ba714-c80a-4fed-947e-168282e4cc64 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:00.878080 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a71ba714-c80a-4fed-947e-168282e4cc64 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:00.879800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a71ba714-c80a-4fed-947e-168282e4cc64 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:00.880597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a71ba714-c80a-4fed-947e-168282e4cc64 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:00.922885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-49291c2d-863a-4f52-8b2e-1ce49b02f518 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:00.939207 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-49291c2d-863a-4f52-8b2e-1ce49b02f518 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1511 microversion: 2.1 time: 0.533840 Aug 24 10:28:00.940164 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1937/3479] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:00 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1511 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:28:00.951887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-87190c1b-b7fb-4eeb-9341-4471a196613f tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:00.957889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-87190c1b-b7fb-4eeb-9341-4471a196613f tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:00.963331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:00.974158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87190c1b-b7fb-4eeb-9341-4471a196613f tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:00.975080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87190c1b-b7fb-4eeb-9341-4471a196613f tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:00.975921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87190c1b-b7fb-4eeb-9341-4471a196613f tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:00.977229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87190c1b-b7fb-4eeb-9341-4471a196613f tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:00.977962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87190c1b-b7fb-4eeb-9341-4471a196613f tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:00.978571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87190c1b-b7fb-4eeb-9341-4471a196613f tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:01.113262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:01.156655 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:01.214832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a71ba714-c80a-4fed-947e-168282e4cc64 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:01.224743 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a71ba714-c80a-4fed-947e-168282e4cc64 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1514 microversion: 2.1 time: 0.377088 Aug 24 10:28:01.226194 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1543/3480] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:00 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1514 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:28:01.288708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ddff6c35-4318-4e3b-9d9d-b3149aca7261 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:01.289351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ddff6c35-4318-4e3b-9d9d-b3149aca7261 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] [instance: 51be811b-0bd6-4671-831a-ba5733764143] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:01.292702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:01.297969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddff6c35-4318-4e3b-9d9d-b3149aca7261 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:01.298452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddff6c35-4318-4e3b-9d9d-b3149aca7261 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:01.298888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddff6c35-4318-4e3b-9d9d-b3149aca7261 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:01.299749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddff6c35-4318-4e3b-9d9d-b3149aca7261 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:01.300169 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddff6c35-4318-4e3b-9d9d-b3149aca7261 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:01.300593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddff6c35-4318-4e3b-9d9d-b3149aca7261 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:01.305793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:01.442741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-87190c1b-b7fb-4eeb-9341-4471a196613f tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:01.457175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-87190c1b-b7fb-4eeb-9341-4471a196613f tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:01.460623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-87190c1b-b7fb-4eeb-9341-4471a196613f tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:01.462301 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-87190c1b-b7fb-4eeb-9341-4471a196613f tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.520300 Aug 24 10:28:01.479359 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1938/3481] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:28:00 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:28:01.553382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ddff6c35-4318-4e3b-9d9d-b3149aca7261 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39bebd0ab646faa5109d1b2f2cae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba66b174cac4cadb9afc09f7df3e21f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:01.569257 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ddff6c35-4318-4e3b-9d9d-b3149aca7261 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143" status: 200 len: 1467 microversion: 2.1 time: 0.284743 Aug 24 10:28:01.571101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-83f5484c-607d-4c84-8918-66d3acb1e5de tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:01.572169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-83f5484c-607d-4c84-8918-66d3acb1e5de tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:01.580099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83f5484c-607d-4c84-8918-66d3acb1e5de tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:01.581393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83f5484c-607d-4c84-8918-66d3acb1e5de tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:01.582189 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83f5484c-607d-4c84-8918-66d3acb1e5de tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:01.583163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83f5484c-607d-4c84-8918-66d3acb1e5de tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:01.583783 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83f5484c-607d-4c84-8918-66d3acb1e5de tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:01.585172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83f5484c-607d-4c84-8918-66d3acb1e5de tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:01.585749 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1544/3482] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:01 2022] GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143 => generated 1467 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:28:01.596626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ccf53119-3043-4339-996d-8dab5ae4c584 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-859226735", "metadata": {"image_type": "test"}}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:01.602928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ccf53119-3043-4339-996d-8dab5ae4c584 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] [instance: 51be811b-0bd6-4671-831a-ba5733764143] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:01.610407 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccf53119-3043-4339-996d-8dab5ae4c584 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:01.611875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccf53119-3043-4339-996d-8dab5ae4c584 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:01.612524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccf53119-3043-4339-996d-8dab5ae4c584 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:01.613462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccf53119-3043-4339-996d-8dab5ae4c584 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:01.614462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccf53119-3043-4339-996d-8dab5ae4c584 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:01.616966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccf53119-3043-4339-996d-8dab5ae4c584 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:01.680722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-ccf53119-3043-4339-996d-8dab5ae4c584 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Getting quotas for project dba66b174cac4cadb9afc09f7df3e21f. Resources: dict_keys(['metadata_items']) {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:28:01.686862 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-ccf53119-3043-4339-996d-8dab5ae4c584 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Getting quotas for user fd39bebd0ab646faa5109d1b2f2cae0a and project dba66b174cac4cadb9afc09f7df3e21f. Resources: dict_keys(['metadata_items']) {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:28:01.906551 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ccf53119-3043-4339-996d-8dab5ae4c584 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "POST /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143/action" status: 202 len: 0 microversion: 2.1 time: 0.318285 Aug 24 10:28:01.909288 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1545/3483] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:28:01 2022] POST /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 24 10:28:01.920169 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0567b745-29c8-4db7-95d0-c6408b9dbfbf tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f46550fd8b0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:01.974909 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0567b745-29c8-4db7-95d0-c6408b9dbfbf tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a" status: 200 len: 1421 microversion: 2.1 time: 0.059999 Aug 24 10:28:01.978384 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1546/3484] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:01 2022] GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a => generated 1421 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:01.991534 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f4406144-91fa-4a4e-b8a5-6e4c164a8f40 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:01.993650 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f4406144-91fa-4a4e-b8a5-6e4c164a8f40 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:02.022152 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4406144-91fa-4a4e-b8a5-6e4c164a8f40 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:02.024683 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4406144-91fa-4a4e-b8a5-6e4c164a8f40 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:02.025907 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4406144-91fa-4a4e-b8a5-6e4c164a8f40 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:02.027540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4406144-91fa-4a4e-b8a5-6e4c164a8f40 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:02.028904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4406144-91fa-4a4e-b8a5-6e4c164a8f40 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:02.030101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4406144-91fa-4a4e-b8a5-6e4c164a8f40 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:02.096682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-83f5484c-607d-4c84-8918-66d3acb1e5de tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:02.121152 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-83f5484c-607d-4c84-8918-66d3acb1e5de tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1322 microversion: 2.1 time: 0.566047 Aug 24 10:28:02.122005 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1939/3485] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:01 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1322 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:02.252037 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fbfb9052-6dd2-488a-8c2a-423ef2a2a16a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:02.252663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fbfb9052-6dd2-488a-8c2a-423ef2a2a16a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:02.270311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbfb9052-6dd2-488a-8c2a-423ef2a2a16a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:02.280286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbfb9052-6dd2-488a-8c2a-423ef2a2a16a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:02.281942 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbfb9052-6dd2-488a-8c2a-423ef2a2a16a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:02.286128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbfb9052-6dd2-488a-8c2a-423ef2a2a16a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:02.287092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbfb9052-6dd2-488a-8c2a-423ef2a2a16a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:02.287668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbfb9052-6dd2-488a-8c2a-423ef2a2a16a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:02.792118 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f4406144-91fa-4a4e-b8a5-6e4c164a8f40 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:02.800308 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f4406144-91fa-4a4e-b8a5-6e4c164a8f40 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1511 microversion: 2.1 time: 0.820590 Aug 24 10:28:02.801416 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1547/3486] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:01 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1511 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:02.830495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bb9113d0-bd82-4774-87fc-ffd6653a64ee tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:02.831105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bb9113d0-bd82-4774-87fc-ffd6653a64ee tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:02.839292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb9113d0-bd82-4774-87fc-ffd6653a64ee tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:02.840109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb9113d0-bd82-4774-87fc-ffd6653a64ee tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:02.840714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb9113d0-bd82-4774-87fc-ffd6653a64ee tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:02.841636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb9113d0-bd82-4774-87fc-ffd6653a64ee tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:02.843023 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb9113d0-bd82-4774-87fc-ffd6653a64ee tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:02.843936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb9113d0-bd82-4774-87fc-ffd6653a64ee tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:03.236973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fbfb9052-6dd2-488a-8c2a-423ef2a2a16a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:03.250597 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fbfb9052-6dd2-488a-8c2a-423ef2a2a16a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1514 microversion: 2.1 time: 1.002127 Aug 24 10:28:03.257930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bb9113d0-bd82-4774-87fc-ffd6653a64ee tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:03.262007 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1940/3487] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:02 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1514 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:28:03.272801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bb9113d0-bd82-4774-87fc-ffd6653a64ee tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:03.277573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bb9113d0-bd82-4774-87fc-ffd6653a64ee tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:03.287372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-13beb711-9ce0-4e03-b86f-c8304a5720fb tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f4647c18430>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:03.290141 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bb9113d0-bd82-4774-87fc-ffd6653a64ee tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.473090 Aug 24 10:28:03.294754 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1548/3488] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:28:02 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:28:03.317227 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4c81a3af-13db-4cbf-bc0e-10151df55ce1 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:03.317858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4c81a3af-13db-4cbf-bc0e-10151df55ce1 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:03.335745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c81a3af-13db-4cbf-bc0e-10151df55ce1 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:03.337286 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c81a3af-13db-4cbf-bc0e-10151df55ce1 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:03.338532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c81a3af-13db-4cbf-bc0e-10151df55ce1 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:03.338532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c81a3af-13db-4cbf-bc0e-10151df55ce1 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:03.339222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c81a3af-13db-4cbf-bc0e-10151df55ce1 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:03.339659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c81a3af-13db-4cbf-bc0e-10151df55ce1 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:03.376086 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-13beb711-9ce0-4e03-b86f-c8304a5720fb tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a" status: 200 len: 1421 microversion: 2.1 time: 0.111876 Aug 24 10:28:03.382196 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1941/3489] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:03 2022] GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a => generated 1421 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:03.701750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4c81a3af-13db-4cbf-bc0e-10151df55ce1 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:03.711989 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4c81a3af-13db-4cbf-bc0e-10151df55ce1 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1322 microversion: 2.1 time: 0.416136 Aug 24 10:28:03.713102 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1549/3490] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:03 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1322 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:03.824349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2852af54-4635-42f7-afa8-923c8b55ac88 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:03.825321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2852af54-4635-42f7-afa8-923c8b55ac88 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:03.839431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2852af54-4635-42f7-afa8-923c8b55ac88 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:03.839946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2852af54-4635-42f7-afa8-923c8b55ac88 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:03.840414 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2852af54-4635-42f7-afa8-923c8b55ac88 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:03.841164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2852af54-4635-42f7-afa8-923c8b55ac88 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:03.844485 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2852af54-4635-42f7-afa8-923c8b55ac88 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:03.846873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2852af54-4635-42f7-afa8-923c8b55ac88 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:04.118357 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2852af54-4635-42f7-afa8-923c8b55ac88 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:04.137441 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2852af54-4635-42f7-afa8-923c8b55ac88 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1511 microversion: 2.1 time: 0.317703 Aug 24 10:28:04.138429 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1942/3491] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:03 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1511 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:04.299930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-979e81b9-5407-428b-9c24-9a2ccabfc0dc tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:04.302830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-979e81b9-5407-428b-9c24-9a2ccabfc0dc tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:04.316699 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-589b4b02-e4f6-4648-9046-08b4afcb763b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:04.317356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-589b4b02-e4f6-4648-9046-08b4afcb763b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:04.340522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-589b4b02-e4f6-4648-9046-08b4afcb763b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:04.341017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-589b4b02-e4f6-4648-9046-08b4afcb763b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:04.341484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-589b4b02-e4f6-4648-9046-08b4afcb763b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:04.342278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-589b4b02-e4f6-4648-9046-08b4afcb763b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:04.342650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-589b4b02-e4f6-4648-9046-08b4afcb763b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:04.343071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-589b4b02-e4f6-4648-9046-08b4afcb763b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:04.350438 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-979e81b9-5407-428b-9c24-9a2ccabfc0dc tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:04.351009 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-979e81b9-5407-428b-9c24-9a2ccabfc0dc tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:04.351453 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-979e81b9-5407-428b-9c24-9a2ccabfc0dc tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:04.352175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-979e81b9-5407-428b-9c24-9a2ccabfc0dc tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:04.352628 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-979e81b9-5407-428b-9c24-9a2ccabfc0dc tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:04.353047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-979e81b9-5407-428b-9c24-9a2ccabfc0dc tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:04.700606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-589b4b02-e4f6-4648-9046-08b4afcb763b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:04.713254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-589b4b02-e4f6-4648-9046-08b4afcb763b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:04.714779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-589b4b02-e4f6-4648-9046-08b4afcb763b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:04.715983 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-589b4b02-e4f6-4648-9046-08b4afcb763b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.403973 Aug 24 10:28:04.716569 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1943/3492] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:28:04 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:28:04.725086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-50d57bbe-4ac1-49a0-ba65-9a48b4e29e9d tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f465a1b8f70>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:04.808057 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-50d57bbe-4ac1-49a0-ba65-9a48b4e29e9d tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a" status: 200 len: 1421 microversion: 2.1 time: 0.090349 Aug 24 10:28:04.811500 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1944/3493] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:04 2022] GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a => generated 1421 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:04.829351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1a1308a5-f1e0-4c4e-8984-1f4cab22f5ac tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:04.830605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1a1308a5-f1e0-4c4e-8984-1f4cab22f5ac tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:04.841370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a1308a5-f1e0-4c4e-8984-1f4cab22f5ac tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:04.841968 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a1308a5-f1e0-4c4e-8984-1f4cab22f5ac tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:04.842746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a1308a5-f1e0-4c4e-8984-1f4cab22f5ac tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:04.843710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a1308a5-f1e0-4c4e-8984-1f4cab22f5ac tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:04.844812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a1308a5-f1e0-4c4e-8984-1f4cab22f5ac tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:04.845475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a1308a5-f1e0-4c4e-8984-1f4cab22f5ac tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:04.924603 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-979e81b9-5407-428b-9c24-9a2ccabfc0dc tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:04.943137 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-979e81b9-5407-428b-9c24-9a2ccabfc0dc tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1514 microversion: 2.1 time: 0.658507 Aug 24 10:28:04.944845 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1550/3494] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:04 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1514 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:04.951938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-2333fb69-ee0a-4863-a668-a9cc10baef7d req-9bc8158d-9b64-47fc-b41d-bf3b92ab7e6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a501f37-7cb0-4d7d-a95b-03f7aed77f9d", "name": "network-vif-plugged", "status": "completed", "tag": "d5ccc17d-296b-4e00-ae9b-8f26eb42f6ec"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:04.968436 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2333fb69-ee0a-4863-a668-a9cc10baef7d req-9bc8158d-9b64-47fc-b41d-bf3b92ab7e6c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:04.970137 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2333fb69-ee0a-4863-a668-a9cc10baef7d req-9bc8158d-9b64-47fc-b41d-bf3b92ab7e6c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:04.972274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2333fb69-ee0a-4863-a668-a9cc10baef7d req-9bc8158d-9b64-47fc-b41d-bf3b92ab7e6c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:04.996221 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-2333fb69-ee0a-4863-a668-a9cc10baef7d req-9bc8158d-9b64-47fc-b41d-bf3b92ab7e6c service nova] Creating event network-vif-plugged:d5ccc17d-296b-4e00-ae9b-8f26eb42f6ec for instance 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d on n-h2-849328-3 Aug 24 10:28:05.004486 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-2333fb69-ee0a-4863-a668-a9cc10baef7d req-9bc8158d-9b64-47fc-b41d-bf3b92ab7e6c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057071 Aug 24 10:28:05.006672 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1551/3495] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:28:05.161066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f1afcb30-690c-415a-b0a7-68c8474c17d1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:05.162787 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f1afcb30-690c-415a-b0a7-68c8474c17d1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:05.177929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1afcb30-690c-415a-b0a7-68c8474c17d1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:05.180906 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1afcb30-690c-415a-b0a7-68c8474c17d1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:05.181785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1afcb30-690c-415a-b0a7-68c8474c17d1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:05.184504 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1afcb30-690c-415a-b0a7-68c8474c17d1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:05.185231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1afcb30-690c-415a-b0a7-68c8474c17d1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:05.185860 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1afcb30-690c-415a-b0a7-68c8474c17d1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:05.226647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1a1308a5-f1e0-4c4e-8984-1f4cab22f5ac tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:05.242063 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1a1308a5-f1e0-4c4e-8984-1f4cab22f5ac tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1322 microversion: 2.1 time: 0.426734 Aug 24 10:28:05.247994 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1945/3496] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:04 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1322 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:05.512046 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f1afcb30-690c-415a-b0a7-68c8474c17d1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:05.532084 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f1afcb30-690c-415a-b0a7-68c8474c17d1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1511 microversion: 2.1 time: 0.377598 Aug 24 10:28:05.533023 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1552/3497] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:05 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1511 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:28:05.748815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3f89a077-e747-4ae7-a567-481de07f133b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:05.750852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3f89a077-e747-4ae7-a567-481de07f133b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:05.761955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f89a077-e747-4ae7-a567-481de07f133b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:05.764970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f89a077-e747-4ae7-a567-481de07f133b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:05.766424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f89a077-e747-4ae7-a567-481de07f133b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:05.767505 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f89a077-e747-4ae7-a567-481de07f133b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:05.768851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f89a077-e747-4ae7-a567-481de07f133b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:05.769668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f89a077-e747-4ae7-a567-481de07f133b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:05.826495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dbebd895-e9cd-410b-bba7-e6e780302808 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f465a2d1e50>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:05.913265 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dbebd895-e9cd-410b-bba7-e6e780302808 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a" status: 200 len: 1421 microversion: 2.1 time: 0.089683 Aug 24 10:28:05.915622 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1553/3498] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:05 2022] GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a => generated 1421 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:05.969018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-17e14322-2a90-4f4c-8789-fd5c1ddb800b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:05.969668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-17e14322-2a90-4f4c-8789-fd5c1ddb800b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:05.996775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17e14322-2a90-4f4c-8789-fd5c1ddb800b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:06.000323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17e14322-2a90-4f4c-8789-fd5c1ddb800b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:06.000993 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17e14322-2a90-4f4c-8789-fd5c1ddb800b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:06.003265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17e14322-2a90-4f4c-8789-fd5c1ddb800b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:06.004190 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17e14322-2a90-4f4c-8789-fd5c1ddb800b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:06.006844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17e14322-2a90-4f4c-8789-fd5c1ddb800b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:06.362896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3f89a077-e747-4ae7-a567-481de07f133b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:06.387280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3f89a077-e747-4ae7-a567-481de07f133b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:06.404006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3f89a077-e747-4ae7-a567-481de07f133b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:06.406479 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3f89a077-e747-4ae7-a567-481de07f133b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.662162 Aug 24 10:28:06.410499 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1946/3499] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:28:05 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:28:06.428909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-822f2317-f643-42ff-af2b-63186072414d tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:06.431331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-822f2317-f643-42ff-af2b-63186072414d tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:06.457958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-822f2317-f643-42ff-af2b-63186072414d tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:06.459338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-822f2317-f643-42ff-af2b-63186072414d tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:06.460529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-822f2317-f643-42ff-af2b-63186072414d tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:06.462522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-822f2317-f643-42ff-af2b-63186072414d tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:06.470647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-822f2317-f643-42ff-af2b-63186072414d tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:06.472530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-822f2317-f643-42ff-af2b-63186072414d tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:06.642333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-17e14322-2a90-4f4c-8789-fd5c1ddb800b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:06.676924 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-17e14322-2a90-4f4c-8789-fd5c1ddb800b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1514 microversion: 2.1 time: 0.711645 Aug 24 10:28:06.690669 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1554/3500] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:05 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1514 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:06.713472 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b30085c9-7f45-4aaa-ad93-29913ec0831a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:06.718758 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b30085c9-7f45-4aaa-ad93-29913ec0831a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:06.761588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b30085c9-7f45-4aaa-ad93-29913ec0831a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:06.766092 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b30085c9-7f45-4aaa-ad93-29913ec0831a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:06.766906 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b30085c9-7f45-4aaa-ad93-29913ec0831a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:06.773542 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b30085c9-7f45-4aaa-ad93-29913ec0831a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:06.774143 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b30085c9-7f45-4aaa-ad93-29913ec0831a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:06.774657 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b30085c9-7f45-4aaa-ad93-29913ec0831a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:07.430326 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-822f2317-f643-42ff-af2b-63186072414d tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:07.445702 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-822f2317-f643-42ff-af2b-63186072414d tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1322 microversion: 2.1 time: 1.029828 Aug 24 10:28:07.446991 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1947/3501] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:06 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1322 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:07.452030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1f594ef4-5a46-407b-ad0d-2d5c6cd963ef tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f4647c47670>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:07.551114 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1f594ef4-5a46-407b-ad0d-2d5c6cd963ef tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a" status: 200 len: 1421 microversion: 2.1 time: 0.102555 Aug 24 10:28:07.552917 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1948/3502] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:07 2022] GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a => generated 1421 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:07.562209 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b30085c9-7f45-4aaa-ad93-29913ec0831a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:07.582323 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8b288d60-5498-403d-8726-8dfc197b006c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:07.598493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8b288d60-5498-403d-8726-8dfc197b006c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:07.602062 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b30085c9-7f45-4aaa-ad93-29913ec0831a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1511 microversion: 2.1 time: 0.909621 Aug 24 10:28:07.608145 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1555/3503] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:06 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1511 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:07.620758 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b288d60-5498-403d-8726-8dfc197b006c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:07.622913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b288d60-5498-403d-8726-8dfc197b006c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:07.625525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b288d60-5498-403d-8726-8dfc197b006c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:07.629646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b288d60-5498-403d-8726-8dfc197b006c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:07.631157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b288d60-5498-403d-8726-8dfc197b006c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:07.637256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b288d60-5498-403d-8726-8dfc197b006c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:07.720643 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-31e42fc4-23a9-4483-b585-4abdb81a6b24 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:07.725718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-31e42fc4-23a9-4483-b585-4abdb81a6b24 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:07.747140 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31e42fc4-23a9-4483-b585-4abdb81a6b24 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:07.747970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31e42fc4-23a9-4483-b585-4abdb81a6b24 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:07.748626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31e42fc4-23a9-4483-b585-4abdb81a6b24 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:07.756860 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31e42fc4-23a9-4483-b585-4abdb81a6b24 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:07.757833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31e42fc4-23a9-4483-b585-4abdb81a6b24 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:07.758520 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31e42fc4-23a9-4483-b585-4abdb81a6b24 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:08.398118 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-31e42fc4-23a9-4483-b585-4abdb81a6b24 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:08.407223 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-31e42fc4-23a9-4483-b585-4abdb81a6b24 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1514 microversion: 2.1 time: 0.695337 Aug 24 10:28:08.431193 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1556/3504] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:07 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1514 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:08.436341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-a7f6c0df-574d-40ca-a310-cb1a2474360c req-649ed529-3601-41e6-9812-1347871dd507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51be811b-0bd6-4671-831a-ba5733764143", "name": "network-vif-plugged", "status": "completed", "tag": "c45a2f3f-9db0-4c17-83e8-0cf4d8711aba"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:08.475990 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a7f6c0df-574d-40ca-a310-cb1a2474360c req-649ed529-3601-41e6-9812-1347871dd507 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:08.476481 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a7f6c0df-574d-40ca-a310-cb1a2474360c req-649ed529-3601-41e6-9812-1347871dd507 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:08.494716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a7f6c0df-574d-40ca-a310-cb1a2474360c req-649ed529-3601-41e6-9812-1347871dd507 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:08.542490 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-a7f6c0df-574d-40ca-a310-cb1a2474360c req-649ed529-3601-41e6-9812-1347871dd507 service nova] Creating event network-vif-plugged:c45a2f3f-9db0-4c17-83e8-0cf4d8711aba for instance 51be811b-0bd6-4671-831a-ba5733764143 on n-h1-849328-3 Aug 24 10:28:08.567930 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-a7f6c0df-574d-40ca-a310-cb1a2474360c req-649ed529-3601-41e6-9812-1347871dd507 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135140 Aug 24 10:28:08.581528 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1557/3505] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:28:08.590461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3ae2fe9a-db7b-4705-8771-c2fa4ca3552b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:08.594059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3ae2fe9a-db7b-4705-8771-c2fa4ca3552b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:08.621149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ae2fe9a-db7b-4705-8771-c2fa4ca3552b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:08.621639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ae2fe9a-db7b-4705-8771-c2fa4ca3552b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:08.622081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ae2fe9a-db7b-4705-8771-c2fa4ca3552b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:08.622799 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ae2fe9a-db7b-4705-8771-c2fa4ca3552b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:08.623263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ae2fe9a-db7b-4705-8771-c2fa4ca3552b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:08.623702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ae2fe9a-db7b-4705-8771-c2fa4ca3552b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:09.020141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8b288d60-5498-403d-8726-8dfc197b006c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:09.033157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8b288d60-5498-403d-8726-8dfc197b006c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:09.034696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8b288d60-5498-403d-8726-8dfc197b006c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:09.035999 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8b288d60-5498-403d-8726-8dfc197b006c tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 1.481220 Aug 24 10:28:09.036733 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1949/3506] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:28:07 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:28:09.079096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b24dc153-7b63-44c4-925d-d74050dffd3c tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f465a242040>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:09.187154 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b24dc153-7b63-44c4-925d-d74050dffd3c tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a" status: 200 len: 1421 microversion: 2.1 time: 0.114588 Aug 24 10:28:09.189260 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1950/3507] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:09 2022] GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a => generated 1421 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:09.198476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-42b0f368-a282-40ad-a585-15c8dd4b3fd8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:09.202816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-42b0f368-a282-40ad-a585-15c8dd4b3fd8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:09.220643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42b0f368-a282-40ad-a585-15c8dd4b3fd8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:09.221612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42b0f368-a282-40ad-a585-15c8dd4b3fd8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:09.222241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42b0f368-a282-40ad-a585-15c8dd4b3fd8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:09.226384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42b0f368-a282-40ad-a585-15c8dd4b3fd8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:09.227080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42b0f368-a282-40ad-a585-15c8dd4b3fd8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:09.227727 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42b0f368-a282-40ad-a585-15c8dd4b3fd8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:09.299694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3ae2fe9a-db7b-4705-8771-c2fa4ca3552b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:09.315485 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3ae2fe9a-db7b-4705-8771-c2fa4ca3552b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1518 microversion: 2.1 time: 0.732380 Aug 24 10:28:09.321453 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1558/3508] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:08 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1518 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:09.343744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ba752d11-21e3-438f-81c8-c9aaca8d0f74 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:09.347069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ba752d11-21e3-438f-81c8-c9aaca8d0f74 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:09.363545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba752d11-21e3-438f-81c8-c9aaca8d0f74 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:09.364288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba752d11-21e3-438f-81c8-c9aaca8d0f74 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:09.366113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba752d11-21e3-438f-81c8-c9aaca8d0f74 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:09.373970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba752d11-21e3-438f-81c8-c9aaca8d0f74 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:09.374725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba752d11-21e3-438f-81c8-c9aaca8d0f74 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:09.375413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba752d11-21e3-438f-81c8-c9aaca8d0f74 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:09.445849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-ba752d11-21e3-438f-81c8-c9aaca8d0f74 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lazy-loading 'flavor' on Instance uuid 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:28:09.606207 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ba752d11-21e3-438f-81c8-c9aaca8d0f74 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "POST /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d/action" status: 200 len: 32 microversion: 2.1 time: 0.268108 Aug 24 10:28:09.607960 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1559/3509] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:28:09 2022] POST /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d/action => generated 32 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 10:28:09.623827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1160c429-39bb-4ab3-8217-31e327ba3909 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:09.625023 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1160c429-39bb-4ab3-8217-31e327ba3909 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:09.639243 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1160c429-39bb-4ab3-8217-31e327ba3909 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:09.639744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1160c429-39bb-4ab3-8217-31e327ba3909 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:09.640191 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1160c429-39bb-4ab3-8217-31e327ba3909 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:09.641781 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1160c429-39bb-4ab3-8217-31e327ba3909 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:09.642275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1160c429-39bb-4ab3-8217-31e327ba3909 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:09.642719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1160c429-39bb-4ab3-8217-31e327ba3909 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:09.680675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:10.085664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-42b0f368-a282-40ad-a585-15c8dd4b3fd8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:10.146243 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-42b0f368-a282-40ad-a585-15c8dd4b3fd8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1511 microversion: 2.1 time: 0.955220 Aug 24 10:28:10.147449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1160c429-39bb-4ab3-8217-31e327ba3909 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:10.158809 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1951/3510] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:09 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1511 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:10.159981 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1160c429-39bb-4ab3-8217-31e327ba3909 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1520 microversion: 2.1 time: 0.550161 Aug 24 10:28:10.160835 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1560/3511] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:09 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1520 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:10.171445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c9063f16-71cc-4c84-a78c-5f20c8448c2d tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:10.176648 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c9063f16-71cc-4c84-a78c-5f20c8448c2d tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:10.192905 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9063f16-71cc-4c84-a78c-5f20c8448c2d tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:10.194743 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9063f16-71cc-4c84-a78c-5f20c8448c2d tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:10.197342 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9063f16-71cc-4c84-a78c-5f20c8448c2d tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:10.198582 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9063f16-71cc-4c84-a78c-5f20c8448c2d tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:10.201747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9063f16-71cc-4c84-a78c-5f20c8448c2d tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:10.202468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9063f16-71cc-4c84-a78c-5f20c8448c2d tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:10.211176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7bd59d9a-679d-4d66-8e18-c768ff0746b3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:10.213655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7bd59d9a-679d-4d66-8e18-c768ff0746b3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:10.252533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bd59d9a-679d-4d66-8e18-c768ff0746b3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:10.263227 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bd59d9a-679d-4d66-8e18-c768ff0746b3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:10.264425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bd59d9a-679d-4d66-8e18-c768ff0746b3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:10.265885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bd59d9a-679d-4d66-8e18-c768ff0746b3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:10.266822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bd59d9a-679d-4d66-8e18-c768ff0746b3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:10.268781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bd59d9a-679d-4d66-8e18-c768ff0746b3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:10.730668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c9063f16-71cc-4c84-a78c-5f20c8448c2d tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:10.742501 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c9063f16-71cc-4c84-a78c-5f20c8448c2d tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:10.746619 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c9063f16-71cc-4c84-a78c-5f20c8448c2d tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:10.753279 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c9063f16-71cc-4c84-a78c-5f20c8448c2d tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.583639 Aug 24 10:28:10.771380 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1561/3512] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:28:10 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:28:10.776824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a486111b-8b7b-41ef-8b10-44a9d882bfe2 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f4654282940>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:10.848362 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a486111b-8b7b-41ef-8b10-44a9d882bfe2 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a" status: 200 len: 1421 microversion: 2.1 time: 0.075301 Aug 24 10:28:10.850774 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1562/3513] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:10 2022] GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a => generated 1421 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:10.906471 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7bd59d9a-679d-4d66-8e18-c768ff0746b3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:10.921296 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7bd59d9a-679d-4d66-8e18-c768ff0746b3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1524 microversion: 2.1 time: 0.760687 Aug 24 10:28:10.924587 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1952/3514] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:10 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1524 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:11.180242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-11679777-517a-4e24-b961-33b326780fcf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:11.180815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-11679777-517a-4e24-b961-33b326780fcf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:11.192760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11679777-517a-4e24-b961-33b326780fcf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:11.194550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11679777-517a-4e24-b961-33b326780fcf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:11.203015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ce9abcb0-820c-4f00-8c68-2d70d8530fc3 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:11.204246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ce9abcb0-820c-4f00-8c68-2d70d8530fc3 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:11.211058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11679777-517a-4e24-b961-33b326780fcf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:11.215594 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11679777-517a-4e24-b961-33b326780fcf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:11.218839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11679777-517a-4e24-b961-33b326780fcf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:11.221449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11679777-517a-4e24-b961-33b326780fcf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:11.224665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce9abcb0-820c-4f00-8c68-2d70d8530fc3 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:11.227604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce9abcb0-820c-4f00-8c68-2d70d8530fc3 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:11.232648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce9abcb0-820c-4f00-8c68-2d70d8530fc3 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:11.235223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce9abcb0-820c-4f00-8c68-2d70d8530fc3 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:11.237026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce9abcb0-820c-4f00-8c68-2d70d8530fc3 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:11.242413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce9abcb0-820c-4f00-8c68-2d70d8530fc3 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:12.192559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ce9abcb0-820c-4f00-8c68-2d70d8530fc3 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:12.222973 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ce9abcb0-820c-4f00-8c68-2d70d8530fc3 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1520 microversion: 2.1 time: 1.024775 Aug 24 10:28:12.226289 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1953/3515] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:11 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1520 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:28:12.251145 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-77a9ac02-33ab-4c75-bad8-ea42bc2a3c78 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:12.253375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-77a9ac02-33ab-4c75-bad8-ea42bc2a3c78 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:12.275692 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77a9ac02-33ab-4c75-bad8-ea42bc2a3c78 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:12.276538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77a9ac02-33ab-4c75-bad8-ea42bc2a3c78 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:12.277180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77a9ac02-33ab-4c75-bad8-ea42bc2a3c78 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:12.278069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77a9ac02-33ab-4c75-bad8-ea42bc2a3c78 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:12.278768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77a9ac02-33ab-4c75-bad8-ea42bc2a3c78 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:12.281211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77a9ac02-33ab-4c75-bad8-ea42bc2a3c78 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:12.557432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-11679777-517a-4e24-b961-33b326780fcf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:12.571458 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-11679777-517a-4e24-b961-33b326780fcf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1511 microversion: 2.1 time: 1.395749 Aug 24 10:28:12.587069 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1563/3516] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:11 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1511 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:12.587069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3ac6ecf4-6ef7-4854-a30c-f14a1549498b tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f465a2ac430>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:12.675958 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3ac6ecf4-6ef7-4854-a30c-f14a1549498b tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a" status: 200 len: 1421 microversion: 2.1 time: 0.099392 Aug 24 10:28:12.676563 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1564/3517] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:12 2022] GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a => generated 1421 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:12.692852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a9d49165-5149-409f-ad8d-aed85b92e937 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:12.694949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a9d49165-5149-409f-ad8d-aed85b92e937 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:12.711251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9d49165-5149-409f-ad8d-aed85b92e937 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:12.715664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9d49165-5149-409f-ad8d-aed85b92e937 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:12.716270 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9d49165-5149-409f-ad8d-aed85b92e937 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:12.717149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9d49165-5149-409f-ad8d-aed85b92e937 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:12.718902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9d49165-5149-409f-ad8d-aed85b92e937 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:12.723014 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9d49165-5149-409f-ad8d-aed85b92e937 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:13.016772 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-77a9ac02-33ab-4c75-bad8-ea42bc2a3c78 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:13.045889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-77a9ac02-33ab-4c75-bad8-ea42bc2a3c78 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:13.051220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-77a9ac02-33ab-4c75-bad8-ea42bc2a3c78 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:13.054002 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-77a9ac02-33ab-4c75-bad8-ea42bc2a3c78 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.824229 Aug 24 10:28:13.055881 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1954/3518] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:28:12 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:28:13.253390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f7e2fad8-490c-43ac-963d-f8921019fba0 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:13.254195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f7e2fad8-490c-43ac-963d-f8921019fba0 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:13.262146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7e2fad8-490c-43ac-963d-f8921019fba0 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:13.262650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7e2fad8-490c-43ac-963d-f8921019fba0 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:13.263088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7e2fad8-490c-43ac-963d-f8921019fba0 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:13.263824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7e2fad8-490c-43ac-963d-f8921019fba0 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:13.264235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7e2fad8-490c-43ac-963d-f8921019fba0 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:13.264659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7e2fad8-490c-43ac-963d-f8921019fba0 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:13.430674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a9d49165-5149-409f-ad8d-aed85b92e937 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:13.444950 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a9d49165-5149-409f-ad8d-aed85b92e937 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1524 microversion: 2.1 time: 0.767253 Aug 24 10:28:13.466761 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1565/3519] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:12 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1524 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:13.593941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-170688ec-a62e-48a7-8e74-6613a31d1d6e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:13.594558 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-170688ec-a62e-48a7-8e74-6613a31d1d6e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:13.615135 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-170688ec-a62e-48a7-8e74-6613a31d1d6e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:13.615655 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-170688ec-a62e-48a7-8e74-6613a31d1d6e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:13.616089 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-170688ec-a62e-48a7-8e74-6613a31d1d6e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:13.616790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-170688ec-a62e-48a7-8e74-6613a31d1d6e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:13.617486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-170688ec-a62e-48a7-8e74-6613a31d1d6e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:13.617905 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-170688ec-a62e-48a7-8e74-6613a31d1d6e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:13.712138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f7e2fad8-490c-43ac-963d-f8921019fba0 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:13.720943 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f7e2fad8-490c-43ac-963d-f8921019fba0 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1520 microversion: 2.1 time: 0.472127 Aug 24 10:28:13.723728 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1955/3520] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:13 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1520 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:13.737466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d47c2b2e-899d-4803-8ac1-531073f50648 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f465528c9d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:13.878275 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d47c2b2e-899d-4803-8ac1-531073f50648 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a" status: 200 len: 1421 microversion: 2.1 time: 0.151503 Aug 24 10:28:13.890602 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1956/3521] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:13 2022] GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a => generated 1421 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:14.082339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-892441cf-8109-416a-a638-8fafc62ce129 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:14.083696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-892441cf-8109-416a-a638-8fafc62ce129 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:14.123251 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-892441cf-8109-416a-a638-8fafc62ce129 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:14.126272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-892441cf-8109-416a-a638-8fafc62ce129 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:14.132931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-892441cf-8109-416a-a638-8fafc62ce129 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:14.138343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-892441cf-8109-416a-a638-8fafc62ce129 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:14.153997 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-892441cf-8109-416a-a638-8fafc62ce129 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:14.155094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-892441cf-8109-416a-a638-8fafc62ce129 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:14.321942 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-170688ec-a62e-48a7-8e74-6613a31d1d6e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:14.361112 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-170688ec-a62e-48a7-8e74-6613a31d1d6e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1511 microversion: 2.1 time: 0.770700 Aug 24 10:28:14.366989 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1566/3522] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:13 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1511 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:28:14.497062 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c3020cdf-2b9d-48ea-be4d-5d0a0c8b0cc3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:14.497713 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c3020cdf-2b9d-48ea-be4d-5d0a0c8b0cc3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:14.512277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3020cdf-2b9d-48ea-be4d-5d0a0c8b0cc3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:14.516713 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3020cdf-2b9d-48ea-be4d-5d0a0c8b0cc3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:14.517319 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3020cdf-2b9d-48ea-be4d-5d0a0c8b0cc3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:14.518081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3020cdf-2b9d-48ea-be4d-5d0a0c8b0cc3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:14.525581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3020cdf-2b9d-48ea-be4d-5d0a0c8b0cc3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:14.526269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3020cdf-2b9d-48ea-be4d-5d0a0c8b0cc3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:14.708664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-892441cf-8109-416a-a638-8fafc62ce129 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:14.711036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:14.729559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-892441cf-8109-416a-a638-8fafc62ce129 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:14.731625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-892441cf-8109-416a-a638-8fafc62ce129 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:14.742710 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-892441cf-8109-416a-a638-8fafc62ce129 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.665826 Aug 24 10:28:14.743933 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1957/3523] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:28:14 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:28:14.756967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3055182f-f412-4e2e-b669-21a2128fe248 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:14.757899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3055182f-f412-4e2e-b669-21a2128fe248 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:14.769356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3055182f-f412-4e2e-b669-21a2128fe248 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:14.770157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3055182f-f412-4e2e-b669-21a2128fe248 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:14.770776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3055182f-f412-4e2e-b669-21a2128fe248 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:14.771653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3055182f-f412-4e2e-b669-21a2128fe248 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:14.772656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3055182f-f412-4e2e-b669-21a2128fe248 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:14.773419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3055182f-f412-4e2e-b669-21a2128fe248 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:15.145184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c3020cdf-2b9d-48ea-be4d-5d0a0c8b0cc3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:15.153206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3055182f-f412-4e2e-b669-21a2128fe248 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:15.155264 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c3020cdf-2b9d-48ea-be4d-5d0a0c8b0cc3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1524 microversion: 2.1 time: 0.662707 Aug 24 10:28:15.156708 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1567/3524] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:14 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1524 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:28:15.167459 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3055182f-f412-4e2e-b669-21a2128fe248 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1520 microversion: 2.1 time: 0.414652 Aug 24 10:28:15.175339 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1958/3525] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:14 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1520 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:15.175754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ce8dbeae-7f38-421c-8ecf-51eaa041c794 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f465644ea60>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:15.242956 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ce8dbeae-7f38-421c-8ecf-51eaa041c794 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a" status: 200 len: 1421 microversion: 2.1 time: 0.084333 Aug 24 10:28:15.244715 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1568/3526] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:15 2022] GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a => generated 1421 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:15.404328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-394caceb-a0db-466f-9a66-1cb14d57e9fe tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:15.404860 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-394caceb-a0db-466f-9a66-1cb14d57e9fe tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:15.415592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-394caceb-a0db-466f-9a66-1cb14d57e9fe tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:15.416018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-394caceb-a0db-466f-9a66-1cb14d57e9fe tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:15.416588 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-394caceb-a0db-466f-9a66-1cb14d57e9fe tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:15.427893 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-394caceb-a0db-466f-9a66-1cb14d57e9fe tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:15.428713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-394caceb-a0db-466f-9a66-1cb14d57e9fe tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:15.429381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-394caceb-a0db-466f-9a66-1cb14d57e9fe tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:15.796839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ca28765f-6881-48ae-840e-e625b79605e2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:15.797720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ca28765f-6881-48ae-840e-e625b79605e2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:15.811699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca28765f-6881-48ae-840e-e625b79605e2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:15.823989 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca28765f-6881-48ae-840e-e625b79605e2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:15.824435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca28765f-6881-48ae-840e-e625b79605e2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:15.825212 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca28765f-6881-48ae-840e-e625b79605e2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:15.825667 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca28765f-6881-48ae-840e-e625b79605e2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:15.826088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca28765f-6881-48ae-840e-e625b79605e2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:16.159666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-394caceb-a0db-466f-9a66-1cb14d57e9fe tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:16.176871 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-394caceb-a0db-466f-9a66-1cb14d57e9fe tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1511 microversion: 2.1 time: 0.768851 Aug 24 10:28:16.203180 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1959/3527] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:15 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1511 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:16.220422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b992ad3e-5e1a-412f-9c64-33b9220faa54 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:16.221064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b992ad3e-5e1a-412f-9c64-33b9220faa54 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:16.249299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b992ad3e-5e1a-412f-9c64-33b9220faa54 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:16.249819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b992ad3e-5e1a-412f-9c64-33b9220faa54 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:16.250273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b992ad3e-5e1a-412f-9c64-33b9220faa54 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:16.251000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b992ad3e-5e1a-412f-9c64-33b9220faa54 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:16.251466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b992ad3e-5e1a-412f-9c64-33b9220faa54 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:16.251895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b992ad3e-5e1a-412f-9c64-33b9220faa54 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:16.547527 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ca28765f-6881-48ae-840e-e625b79605e2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:16.575923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ca28765f-6881-48ae-840e-e625b79605e2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:16.584728 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ca28765f-6881-48ae-840e-e625b79605e2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:16.594986 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ca28765f-6881-48ae-840e-e625b79605e2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.805146 Aug 24 10:28:16.598152 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1569/3528] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:28:15 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:28:16.612621 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ddf92c55-83ce-402b-9c01-8d99840d065f tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f465644ea60>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:16.730227 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ddf92c55-83ce-402b-9c01-8d99840d065f tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a" status: 200 len: 1421 microversion: 2.1 time: 0.128642 Aug 24 10:28:16.732882 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1570/3529] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:16 2022] GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a => generated 1421 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:16.750089 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-89b0736b-54ab-4c1c-bb43-381a5ea75a4c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:16.753934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-89b0736b-54ab-4c1c-bb43-381a5ea75a4c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:16.771419 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89b0736b-54ab-4c1c-bb43-381a5ea75a4c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:16.782217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89b0736b-54ab-4c1c-bb43-381a5ea75a4c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:16.782217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89b0736b-54ab-4c1c-bb43-381a5ea75a4c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:16.782217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89b0736b-54ab-4c1c-bb43-381a5ea75a4c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:16.782217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89b0736b-54ab-4c1c-bb43-381a5ea75a4c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:16.782217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89b0736b-54ab-4c1c-bb43-381a5ea75a4c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:16.872767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b992ad3e-5e1a-412f-9c64-33b9220faa54 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:16.884861 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b992ad3e-5e1a-412f-9c64-33b9220faa54 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1524 microversion: 2.1 time: 0.680358 Aug 24 10:28:16.886954 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1960/3530] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:16 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1524 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:17.199523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dd705f3b-ae9b-4f58-81c7-7ddbccb01bc4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:17.200218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dd705f3b-ae9b-4f58-81c7-7ddbccb01bc4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:17.217743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd705f3b-ae9b-4f58-81c7-7ddbccb01bc4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:17.218161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd705f3b-ae9b-4f58-81c7-7ddbccb01bc4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:17.218988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd705f3b-ae9b-4f58-81c7-7ddbccb01bc4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:17.219444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd705f3b-ae9b-4f58-81c7-7ddbccb01bc4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:17.219797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd705f3b-ae9b-4f58-81c7-7ddbccb01bc4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:17.220221 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd705f3b-ae9b-4f58-81c7-7ddbccb01bc4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:17.481574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-89b0736b-54ab-4c1c-bb43-381a5ea75a4c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:17.490457 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-89b0736b-54ab-4c1c-bb43-381a5ea75a4c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1520 microversion: 2.1 time: 0.753876 Aug 24 10:28:17.508659 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1571/3531] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:16 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1520 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:17.633655 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b219b8a1-a9f7-4557-bfe8-9ac86a3a6928 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:17.635194 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b219b8a1-a9f7-4557-bfe8-9ac86a3a6928 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:17.646300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b219b8a1-a9f7-4557-bfe8-9ac86a3a6928 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:17.648001 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b219b8a1-a9f7-4557-bfe8-9ac86a3a6928 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:17.648846 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b219b8a1-a9f7-4557-bfe8-9ac86a3a6928 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:17.651127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b219b8a1-a9f7-4557-bfe8-9ac86a3a6928 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:17.653096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b219b8a1-a9f7-4557-bfe8-9ac86a3a6928 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:17.653839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b219b8a1-a9f7-4557-bfe8-9ac86a3a6928 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:17.759702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dd705f3b-ae9b-4f58-81c7-7ddbccb01bc4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:17.781262 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dd705f3b-ae9b-4f58-81c7-7ddbccb01bc4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1511 microversion: 2.1 time: 0.585339 Aug 24 10:28:17.785767 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1961/3532] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:17 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1511 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:28:17.803379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-445ea1e8-ceea-4918-88af-6ce5a1657123 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f465a1b8a60>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:17.889392 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-445ea1e8-ceea-4918-88af-6ce5a1657123 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a" status: 200 len: 1421 microversion: 2.1 time: 0.102015 Aug 24 10:28:17.899562 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1962/3533] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:17 2022] GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a => generated 1421 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:17.918957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ffd902c-485d-4578-8957-e140f90bec44 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:17.920242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0ffd902c-485d-4578-8957-e140f90bec44 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:17.944027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ffd902c-485d-4578-8957-e140f90bec44 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:17.945490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ffd902c-485d-4578-8957-e140f90bec44 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:17.946652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ffd902c-485d-4578-8957-e140f90bec44 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:17.948260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ffd902c-485d-4578-8957-e140f90bec44 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:17.949491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ffd902c-485d-4578-8957-e140f90bec44 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:17.950737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ffd902c-485d-4578-8957-e140f90bec44 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:18.656146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b219b8a1-a9f7-4557-bfe8-9ac86a3a6928 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:18.675208 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b219b8a1-a9f7-4557-bfe8-9ac86a3a6928 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:18.680026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b219b8a1-a9f7-4557-bfe8-9ac86a3a6928 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:18.683346 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b219b8a1-a9f7-4557-bfe8-9ac86a3a6928 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 1.053952 Aug 24 10:28:18.686269 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1572/3534] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:28:17 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:28:18.701420 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b8ebded6-50bb-4a92-aa1a-0c69ce8c342a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:18.703322 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b8ebded6-50bb-4a92-aa1a-0c69ce8c342a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:18.721242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8ebded6-50bb-4a92-aa1a-0c69ce8c342a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:18.723816 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8ebded6-50bb-4a92-aa1a-0c69ce8c342a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:18.724694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8ebded6-50bb-4a92-aa1a-0c69ce8c342a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:18.726847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8ebded6-50bb-4a92-aa1a-0c69ce8c342a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:18.730012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8ebded6-50bb-4a92-aa1a-0c69ce8c342a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:18.730812 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8ebded6-50bb-4a92-aa1a-0c69ce8c342a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:19.088820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0ffd902c-485d-4578-8957-e140f90bec44 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:19.104779 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0ffd902c-485d-4578-8957-e140f90bec44 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1524 microversion: 2.1 time: 1.194316 Aug 24 10:28:19.108307 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1963/3535] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:17 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1524 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:19.126156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0c737e0b-bf57-4b5d-a23b-b70a2c3ea53c req-7f2d1e02-58c0-47d9-a216-3ad2062d1af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "521e506a-4d4e-475f-b4e4-e7fc4552a7ac", "name": "network-vif-plugged", "status": "completed", "tag": "bb00dcc0-85f9-4f70-be7d-bf15304fa924"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:19.149784 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0c737e0b-bf57-4b5d-a23b-b70a2c3ea53c req-7f2d1e02-58c0-47d9-a216-3ad2062d1af2 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:19.150318 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0c737e0b-bf57-4b5d-a23b-b70a2c3ea53c req-7f2d1e02-58c0-47d9-a216-3ad2062d1af2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:19.152010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0c737e0b-bf57-4b5d-a23b-b70a2c3ea53c req-7f2d1e02-58c0-47d9-a216-3ad2062d1af2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:19.153368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b8ebded6-50bb-4a92-aa1a-0c69ce8c342a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:19.166558 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b8ebded6-50bb-4a92-aa1a-0c69ce8c342a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1520 microversion: 2.1 time: 0.478703 Aug 24 10:28:19.167667 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1573/3536] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:18 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1520 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:19.186762 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0c737e0b-bf57-4b5d-a23b-b70a2c3ea53c req-7f2d1e02-58c0-47d9-a216-3ad2062d1af2 service nova] Creating event network-vif-plugged:bb00dcc0-85f9-4f70-be7d-bf15304fa924 for instance 521e506a-4d4e-475f-b4e4-e7fc4552a7ac on n-h2-849328-3 Aug 24 10:28:19.199518 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0c737e0b-bf57-4b5d-a23b-b70a2c3ea53c req-7f2d1e02-58c0-47d9-a216-3ad2062d1af2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086929 Aug 24 10:28:19.204169 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1964/3537] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:28:19.214262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3c991392-7f69-4d8c-824f-f4048a446454 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f465a26a430>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:19.383609 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3c991392-7f69-4d8c-824f-f4048a446454 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a" status: 200 len: 1421 microversion: 2.1 time: 0.173589 Aug 24 10:28:19.384233 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1965/3538] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:19 2022] GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a => generated 1421 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:19.701200 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0727514c-d06c-4aa6-9904-75e7424efef4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:19.702577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0727514c-d06c-4aa6-9904-75e7424efef4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:19.713510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-486fff39-4023-48f0-b464-bce9ddda6590 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:19.713747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0727514c-d06c-4aa6-9904-75e7424efef4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:19.714262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-486fff39-4023-48f0-b464-bce9ddda6590 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:19.715464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0727514c-d06c-4aa6-9904-75e7424efef4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:19.716364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0727514c-d06c-4aa6-9904-75e7424efef4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:19.717596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0727514c-d06c-4aa6-9904-75e7424efef4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:19.718295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0727514c-d06c-4aa6-9904-75e7424efef4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:19.719136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0727514c-d06c-4aa6-9904-75e7424efef4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:19.735530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-486fff39-4023-48f0-b464-bce9ddda6590 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:19.736044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-486fff39-4023-48f0-b464-bce9ddda6590 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:19.736492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-486fff39-4023-48f0-b464-bce9ddda6590 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:19.737255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-486fff39-4023-48f0-b464-bce9ddda6590 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:19.737894 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-486fff39-4023-48f0-b464-bce9ddda6590 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:19.738468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-486fff39-4023-48f0-b464-bce9ddda6590 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:20.024188 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0727514c-d06c-4aa6-9904-75e7424efef4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:20.046540 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0727514c-d06c-4aa6-9904-75e7424efef4 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1511 microversion: 2.1 time: 0.874252 Aug 24 10:28:20.050439 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1574/3539] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:19 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1511 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:20.132246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-16714a2e-c078-4e32-a0c9-9f6139ecdd8c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:20.133081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-16714a2e-c078-4e32-a0c9-9f6139ecdd8c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:20.147407 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16714a2e-c078-4e32-a0c9-9f6139ecdd8c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:20.154085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16714a2e-c078-4e32-a0c9-9f6139ecdd8c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:20.155200 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16714a2e-c078-4e32-a0c9-9f6139ecdd8c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:20.156109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16714a2e-c078-4e32-a0c9-9f6139ecdd8c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:20.156741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16714a2e-c078-4e32-a0c9-9f6139ecdd8c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:20.157316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16714a2e-c078-4e32-a0c9-9f6139ecdd8c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:20.278627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-486fff39-4023-48f0-b464-bce9ddda6590 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:20.295002 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-486fff39-4023-48f0-b464-bce9ddda6590 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:20.304130 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-486fff39-4023-48f0-b464-bce9ddda6590 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:20.310921 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-486fff39-4023-48f0-b464-bce9ddda6590 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.602288 Aug 24 10:28:20.323183 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1966/3540] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:28:19 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:28:20.357281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-72c9e7e5-3000-4d1d-95f6-83bccac5e345 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:20.358663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-72c9e7e5-3000-4d1d-95f6-83bccac5e345 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:20.369077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72c9e7e5-3000-4d1d-95f6-83bccac5e345 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:20.370512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72c9e7e5-3000-4d1d-95f6-83bccac5e345 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:20.371629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72c9e7e5-3000-4d1d-95f6-83bccac5e345 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:20.373190 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72c9e7e5-3000-4d1d-95f6-83bccac5e345 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:20.374166 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72c9e7e5-3000-4d1d-95f6-83bccac5e345 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:20.374834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72c9e7e5-3000-4d1d-95f6-83bccac5e345 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:20.711018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-16714a2e-c078-4e32-a0c9-9f6139ecdd8c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:20.730699 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-16714a2e-c078-4e32-a0c9-9f6139ecdd8c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1524 microversion: 2.1 time: 0.603558 Aug 24 10:28:20.731906 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1575/3541] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:20 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1524 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:28:20.745107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9b4b6752-f73f-46f0-989e-99ff37c04b54 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f465a2f0040>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:20.866640 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9b4b6752-f73f-46f0-989e-99ff37c04b54 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a" status: 200 len: 1421 microversion: 2.1 time: 0.130381 Aug 24 10:28:20.873934 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1576/3542] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:20 2022] GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a => generated 1421 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:20.908201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-72c9e7e5-3000-4d1d-95f6-83bccac5e345 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:20.939706 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-72c9e7e5-3000-4d1d-95f6-83bccac5e345 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1520 microversion: 2.1 time: 0.587816 Aug 24 10:28:20.940404 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1967/3543] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:20 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1520 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:21.076079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6f73834c-f5a9-471b-8fb6-1a619dacb92d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:21.077465 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6f73834c-f5a9-471b-8fb6-1a619dacb92d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:21.106323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f73834c-f5a9-471b-8fb6-1a619dacb92d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:21.107521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f73834c-f5a9-471b-8fb6-1a619dacb92d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:21.108426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f73834c-f5a9-471b-8fb6-1a619dacb92d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:21.109826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f73834c-f5a9-471b-8fb6-1a619dacb92d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:21.110759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f73834c-f5a9-471b-8fb6-1a619dacb92d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:21.114751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f73834c-f5a9-471b-8fb6-1a619dacb92d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:21.362901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6dbcdf61-9101-4d87-af30-abb24fae2e03 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:21.366972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6dbcdf61-9101-4d87-af30-abb24fae2e03 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:21.394773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dbcdf61-9101-4d87-af30-abb24fae2e03 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:21.405959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dbcdf61-9101-4d87-af30-abb24fae2e03 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:21.407333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dbcdf61-9101-4d87-af30-abb24fae2e03 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:21.408269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dbcdf61-9101-4d87-af30-abb24fae2e03 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:21.408907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dbcdf61-9101-4d87-af30-abb24fae2e03 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:21.409530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dbcdf61-9101-4d87-af30-abb24fae2e03 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:21.494663 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6f73834c-f5a9-471b-8fb6-1a619dacb92d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:21.523055 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6f73834c-f5a9-471b-8fb6-1a619dacb92d tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1488 microversion: 2.1 time: 0.446294 Aug 24 10:28:21.525355 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1577/3544] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:21 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1488 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:28:21.557736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-438cf4bf-31ee-4a1a-9f86-6fb6c5d11bc6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:21.559244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-438cf4bf-31ee-4a1a-9f86-6fb6c5d11bc6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:21.594324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-438cf4bf-31ee-4a1a-9f86-6fb6c5d11bc6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:21.595526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-438cf4bf-31ee-4a1a-9f86-6fb6c5d11bc6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:21.596199 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-438cf4bf-31ee-4a1a-9f86-6fb6c5d11bc6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:21.596954 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-438cf4bf-31ee-4a1a-9f86-6fb6c5d11bc6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:21.597435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-438cf4bf-31ee-4a1a-9f86-6fb6c5d11bc6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:21.597859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-438cf4bf-31ee-4a1a-9f86-6fb6c5d11bc6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:21.673298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-438cf4bf-31ee-4a1a-9f86-6fb6c5d11bc6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:28:21.891688 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-438cf4bf-31ee-4a1a-9f86-6fb6c5d11bc6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "DELETE /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 204 len: 0 microversion: 2.1 time: 0.343512 Aug 24 10:28:21.893816 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1578/3545] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:28:21 2022] DELETE /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:28:21.912480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-00b7af18-6a4e-4e0e-9731-28a51227c9f6 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:21.921581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-00b7af18-6a4e-4e0e-9731-28a51227c9f6 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:21.938940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b7af18-6a4e-4e0e-9731-28a51227c9f6 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:21.949201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b7af18-6a4e-4e0e-9731-28a51227c9f6 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:21.949201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b7af18-6a4e-4e0e-9731-28a51227c9f6 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:21.949201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b7af18-6a4e-4e0e-9731-28a51227c9f6 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:21.949201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b7af18-6a4e-4e0e-9731-28a51227c9f6 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:21.949201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b7af18-6a4e-4e0e-9731-28a51227c9f6 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:22.192000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6dbcdf61-9101-4d87-af30-abb24fae2e03 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:22.210461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6dbcdf61-9101-4d87-af30-abb24fae2e03 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:22.211998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6dbcdf61-9101-4d87-af30-abb24fae2e03 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:22.230780 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6dbcdf61-9101-4d87-af30-abb24fae2e03 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.856487 Aug 24 10:28:22.232700 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1968/3546] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:28:21 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:28:22.240796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-83e0cac6-b10c-4294-9c18-27f15dc8f3e5 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f465a21ff70>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:22.384894 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-83e0cac6-b10c-4294-9c18-27f15dc8f3e5 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a" status: 200 len: 1421 microversion: 2.1 time: 0.150913 Aug 24 10:28:22.395646 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1969/3547] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:22 2022] GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a => generated 1421 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:22.406734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-665a4882-592a-444c-b56c-765a498e532c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:22.407997 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-665a4882-592a-444c-b56c-765a498e532c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:22.459553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-665a4882-592a-444c-b56c-765a498e532c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:22.461954 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-665a4882-592a-444c-b56c-765a498e532c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:22.467435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-665a4882-592a-444c-b56c-765a498e532c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:22.471126 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-665a4882-592a-444c-b56c-765a498e532c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:22.478180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-665a4882-592a-444c-b56c-765a498e532c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:22.479707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-665a4882-592a-444c-b56c-765a498e532c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:22.784795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-00b7af18-6a4e-4e0e-9731-28a51227c9f6 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:22.811640 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-00b7af18-6a4e-4e0e-9731-28a51227c9f6 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1524 microversion: 2.1 time: 0.908933 Aug 24 10:28:22.813926 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1579/3548] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:21 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1524 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:22.823186 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-36a8bc64-44de-4cc3-a067-b13777492e12 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:22.824291 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-36a8bc64-44de-4cc3-a067-b13777492e12 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:22.838039 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-665a4882-592a-444c-b56c-765a498e532c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:22.857257 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36a8bc64-44de-4cc3-a067-b13777492e12 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:22.858334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36a8bc64-44de-4cc3-a067-b13777492e12 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:22.858968 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36a8bc64-44de-4cc3-a067-b13777492e12 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:22.859892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36a8bc64-44de-4cc3-a067-b13777492e12 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:22.860510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36a8bc64-44de-4cc3-a067-b13777492e12 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:22.861192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36a8bc64-44de-4cc3-a067-b13777492e12 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:22.870039 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:22.874997 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-665a4882-592a-444c-b56c-765a498e532c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1494 microversion: 2.1 time: 0.478133 Aug 24 10:28:22.880356 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1970/3549] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:22 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1494 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:23.183801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-36a8bc64-44de-4cc3-a067-b13777492e12 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:23.202450 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-36a8bc64-44de-4cc3-a067-b13777492e12 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1505 microversion: 2.1 time: 0.386032 Aug 24 10:28:23.204542 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1580/3550] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:22 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1505 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:23.233313 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a42fcfa7-12d1-4f20-8cd7-474b03cb4a55 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:23.234271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a42fcfa7-12d1-4f20-8cd7-474b03cb4a55 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:23.254684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a42fcfa7-12d1-4f20-8cd7-474b03cb4a55 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:23.255909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a42fcfa7-12d1-4f20-8cd7-474b03cb4a55 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:23.257031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a42fcfa7-12d1-4f20-8cd7-474b03cb4a55 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:23.258458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a42fcfa7-12d1-4f20-8cd7-474b03cb4a55 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:23.259186 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a42fcfa7-12d1-4f20-8cd7-474b03cb4a55 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:23.259863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a42fcfa7-12d1-4f20-8cd7-474b03cb4a55 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:23.273546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-84f61aef-a806-4a2a-b851-d343d8a9c449 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:23.274448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-84f61aef-a806-4a2a-b851-d343d8a9c449 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:23.295377 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84f61aef-a806-4a2a-b851-d343d8a9c449 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:23.296278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84f61aef-a806-4a2a-b851-d343d8a9c449 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:23.296877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84f61aef-a806-4a2a-b851-d343d8a9c449 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:23.297790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84f61aef-a806-4a2a-b851-d343d8a9c449 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:23.298407 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84f61aef-a806-4a2a-b851-d343d8a9c449 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:23.298995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84f61aef-a806-4a2a-b851-d343d8a9c449 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:23.760700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a42fcfa7-12d1-4f20-8cd7-474b03cb4a55 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:23.783827 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a42fcfa7-12d1-4f20-8cd7-474b03cb4a55 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 200 len: 1505 microversion: 2.1 time: 0.555260 Aug 24 10:28:23.784783 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1971/3551] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:23 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 1505 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:23.794136 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-300e7607-ca1c-4b64-aad1-e3c94363e42c tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f4647cf6c10>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:23.837500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-84f61aef-a806-4a2a-b851-d343d8a9c449 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:23.853079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-84f61aef-a806-4a2a-b851-d343d8a9c449 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:23.854858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-84f61aef-a806-4a2a-b851-d343d8a9c449 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:23.861449 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-84f61aef-a806-4a2a-b851-d343d8a9c449 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.588423 Aug 24 10:28:23.878818 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1581/3552] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:28:23 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:28:23.894065 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-300e7607-ca1c-4b64-aad1-e3c94363e42c tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a" status: 200 len: 1421 microversion: 2.1 time: 0.107455 Aug 24 10:28:23.894677 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1972/3553] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:23 2022] GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a => generated 1421 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:23.896895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fc3b0a9b-7653-474e-b896-ea5661051659 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:23.897581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fc3b0a9b-7653-474e-b896-ea5661051659 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:23.905905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4328425d-2dde-4843-a2c1-9e1f8ba19ef7 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:23.906783 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4328425d-2dde-4843-a2c1-9e1f8ba19ef7 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:23.913820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc3b0a9b-7653-474e-b896-ea5661051659 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:23.914681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc3b0a9b-7653-474e-b896-ea5661051659 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:23.915447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc3b0a9b-7653-474e-b896-ea5661051659 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:23.916341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc3b0a9b-7653-474e-b896-ea5661051659 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:23.916953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc3b0a9b-7653-474e-b896-ea5661051659 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:23.919488 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc3b0a9b-7653-474e-b896-ea5661051659 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:23.926388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4328425d-2dde-4843-a2c1-9e1f8ba19ef7 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:23.927128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4328425d-2dde-4843-a2c1-9e1f8ba19ef7 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:23.927772 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4328425d-2dde-4843-a2c1-9e1f8ba19ef7 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:23.929041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4328425d-2dde-4843-a2c1-9e1f8ba19ef7 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:23.934739 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4328425d-2dde-4843-a2c1-9e1f8ba19ef7 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:23.935531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4328425d-2dde-4843-a2c1-9e1f8ba19ef7 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:23.983866 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fc3b0a9b-7653-474e-b896-ea5661051659 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:28:24.120454 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fc3b0a9b-7653-474e-b896-ea5661051659 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "DELETE /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 204 len: 0 microversion: 2.1 time: 0.238005 Aug 24 10:28:24.120454 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1582/3554] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:28:23 2022] DELETE /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:28:24.135518 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a1f643ba-9b2a-4def-a500-e9bdd43b933f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:24.135518 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a1f643ba-9b2a-4def-a500-e9bdd43b933f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:24.137272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1f643ba-9b2a-4def-a500-e9bdd43b933f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:24.137764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1f643ba-9b2a-4def-a500-e9bdd43b933f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:24.138902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1f643ba-9b2a-4def-a500-e9bdd43b933f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:24.139626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1f643ba-9b2a-4def-a500-e9bdd43b933f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:24.140079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1f643ba-9b2a-4def-a500-e9bdd43b933f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:24.140501 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1f643ba-9b2a-4def-a500-e9bdd43b933f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:24.865185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a1f643ba-9b2a-4def-a500-e9bdd43b933f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:24.878413 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a1f643ba-9b2a-4def-a500-e9bdd43b933f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1494 microversion: 2.1 time: 0.758004 Aug 24 10:28:24.879687 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1583/3555] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:24 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1494 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:24.898752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4328425d-2dde-4843-a2c1-9e1f8ba19ef7 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:24.911923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a972deb4-89f8-4522-a87c-8bf140294ac2 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-895637842", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "abdb34de-c2c8-4907-9dd2-7c1884b22f8b"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:24.915904 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4328425d-2dde-4843-a2c1-9e1f8ba19ef7 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1524 microversion: 2.1 time: 1.019769 Aug 24 10:28:24.920860 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1973/3556] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:23 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1524 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:24.946912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9846b9e0-63e5-47d0-8c24-2517f23aed6e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:24.947544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9846b9e0-63e5-47d0-8c24-2517f23aed6e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:24.965825 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9846b9e0-63e5-47d0-8c24-2517f23aed6e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:24.979779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9846b9e0-63e5-47d0-8c24-2517f23aed6e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:24.982317 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9846b9e0-63e5-47d0-8c24-2517f23aed6e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:24.984317 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9846b9e0-63e5-47d0-8c24-2517f23aed6e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:24.985428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9846b9e0-63e5-47d0-8c24-2517f23aed6e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:24.986444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9846b9e0-63e5-47d0-8c24-2517f23aed6e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:25.058537 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-a972deb4-89f8-4522-a87c-8bf140294ac2 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] validate_networks() for [('abdb34de-c2c8-4907-9dd2-7c1884b22f8b', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:28:25.676395 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9846b9e0-63e5-47d0-8c24-2517f23aed6e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:25.694450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9846b9e0-63e5-47d0-8c24-2517f23aed6e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:25.695970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9846b9e0-63e5-47d0-8c24-2517f23aed6e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:25.702777 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9846b9e0-63e5-47d0-8c24-2517f23aed6e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.780221 Aug 24 10:28:25.707761 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1974/3557] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:28:24 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:28:25.718152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-613efc75-a3c6-45bf-8537-361e993e9078 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f465a2aa550>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:25.792744 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-613efc75-a3c6-45bf-8537-361e993e9078 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a" status: 200 len: 1421 microversion: 2.1 time: 0.083279 Aug 24 10:28:25.793397 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1975/3558] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:25 2022] GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a => generated 1421 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:25.902891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0d5ad5f7-3cfe-4cb7-a614-8e8d616a8ce7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:25.904009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0d5ad5f7-3cfe-4cb7-a614-8e8d616a8ce7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:25.931578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d5ad5f7-3cfe-4cb7-a614-8e8d616a8ce7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:25.932904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d5ad5f7-3cfe-4cb7-a614-8e8d616a8ce7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:25.933917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d5ad5f7-3cfe-4cb7-a614-8e8d616a8ce7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:25.938413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d5ad5f7-3cfe-4cb7-a614-8e8d616a8ce7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:25.939163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d5ad5f7-3cfe-4cb7-a614-8e8d616a8ce7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:25.939773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d5ad5f7-3cfe-4cb7-a614-8e8d616a8ce7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:26.130795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-a972deb4-89f8-4522-a87c-8bf140294ac2 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:28:26.132023 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-a972deb4-89f8-4522-a87c-8bf140294ac2 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:28:26.132713 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-a972deb4-89f8-4522-a87c-8bf140294ac2 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:28:26.133315 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-a972deb4-89f8-4522-a87c-8bf140294ac2 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:28:26.133950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-a972deb4-89f8-4522-a87c-8bf140294ac2 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:28:26.168986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a972deb4-89f8-4522-a87c-8bf140294ac2 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:26.178630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a972deb4-89f8-4522-a87c-8bf140294ac2 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:26.179717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a972deb4-89f8-4522-a87c-8bf140294ac2 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:26.191782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0d5ad5f7-3cfe-4cb7-a614-8e8d616a8ce7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:26.193277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a972deb4-89f8-4522-a87c-8bf140294ac2 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:26.198154 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a972deb4-89f8-4522-a87c-8bf140294ac2 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:26.199143 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a972deb4-89f8-4522-a87c-8bf140294ac2 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:26.212357 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0d5ad5f7-3cfe-4cb7-a614-8e8d616a8ce7 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 200 len: 1452 microversion: 2.1 time: 0.315335 Aug 24 10:28:26.212985 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1976/3559] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:25 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 1452 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:28:26.229670 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-667e11f5-2cba-4f20-b4e1-3f29f34873a2 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:26.230857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-667e11f5-2cba-4f20-b4e1-3f29f34873a2 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:26.251060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-667e11f5-2cba-4f20-b4e1-3f29f34873a2 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:26.262710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-667e11f5-2cba-4f20-b4e1-3f29f34873a2 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:26.265194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-667e11f5-2cba-4f20-b4e1-3f29f34873a2 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:26.268991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-667e11f5-2cba-4f20-b4e1-3f29f34873a2 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:26.275470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-667e11f5-2cba-4f20-b4e1-3f29f34873a2 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:26.276403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-667e11f5-2cba-4f20-b4e1-3f29f34873a2 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:26.319631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-a972deb4-89f8-4522-a87c-8bf140294ac2 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Getting quotas for project 9dfeb7213b504942a32e3b8ab5c46798. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:28:26.363500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-a972deb4-89f8-4522-a87c-8bf140294ac2 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Getting quotas for user ec7478d6249742d0a177be1168a8c481 and project 9dfeb7213b504942a32e3b8ab5c46798. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:28:26.391883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a972deb4-89f8-4522-a87c-8bf140294ac2 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:28:26.394858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a972deb4-89f8-4522-a87c-8bf140294ac2 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:28:26.448985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:26.527861 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a972deb4-89f8-4522-a87c-8bf140294ac2 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.646120 Aug 24 10:28:26.556993 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1584/3560] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:28:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:28:26.568586 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-332dd17f-e3eb-4ecf-8b3c-c6238602cf1e req-e519ff79-e220-40d1-b7db-4948b3e3a72e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2121a94d-a44d-49f0-95d9-e9c77312fb4a", "name": "network-vif-deleted", "tag": "5049c965-c608-4389-b52c-0a5056858b91"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:26.633043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-332dd17f-e3eb-4ecf-8b3c-c6238602cf1e req-e519ff79-e220-40d1-b7db-4948b3e3a72e service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:26.641879 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-332dd17f-e3eb-4ecf-8b3c-c6238602cf1e req-e519ff79-e220-40d1-b7db-4948b3e3a72e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:26.643636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-332dd17f-e3eb-4ecf-8b3c-c6238602cf1e req-e519ff79-e220-40d1-b7db-4948b3e3a72e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:26.687483 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-332dd17f-e3eb-4ecf-8b3c-c6238602cf1e req-e519ff79-e220-40d1-b7db-4948b3e3a72e service nova] Creating event network-vif-deleted:5049c965-c608-4389-b52c-0a5056858b91 for instance 2121a94d-a44d-49f0-95d9-e9c77312fb4a on n-h2-849328-3 Aug 24 10:28:26.698447 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-332dd17f-e3eb-4ecf-8b3c-c6238602cf1e req-e519ff79-e220-40d1-b7db-4948b3e3a72e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137213 Aug 24 10:28:26.703184 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1585/3561] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:28:26.736060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-f18d617a-bf64-427f-9981-24a744dbcca8 req-0b1a816c-8408-4a1b-a41f-817c9aa53406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ade0e12-9ac0-459f-8f85-6743432302fa", "name": "network-vif-plugged", "status": "completed", "tag": "c070cc96-6844-4a0c-9556-217db4eaf193"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:26.768825 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f18d617a-bf64-427f-9981-24a744dbcca8 req-0b1a816c-8408-4a1b-a41f-817c9aa53406 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:26.774061 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f18d617a-bf64-427f-9981-24a744dbcca8 req-0b1a816c-8408-4a1b-a41f-817c9aa53406 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:26.775326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f18d617a-bf64-427f-9981-24a744dbcca8 req-0b1a816c-8408-4a1b-a41f-817c9aa53406 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:26.818041 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-f18d617a-bf64-427f-9981-24a744dbcca8 req-0b1a816c-8408-4a1b-a41f-817c9aa53406 service nova] Creating event network-vif-plugged:c070cc96-6844-4a0c-9556-217db4eaf193 for instance 1ade0e12-9ac0-459f-8f85-6743432302fa on n-h1-849328-3 Aug 24 10:28:26.851406 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-f18d617a-bf64-427f-9981-24a744dbcca8 req-0b1a816c-8408-4a1b-a41f-817c9aa53406 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145947 Aug 24 10:28:26.855108 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1586/3562] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:28:26.860968 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c12af776-4fa8-40b8-9895-e12a2b0ca821 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:26.868850 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c12af776-4fa8-40b8-9895-e12a2b0ca821 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:27.083322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-667e11f5-2cba-4f20-b4e1-3f29f34873a2 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:27.091717 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-667e11f5-2cba-4f20-b4e1-3f29f34873a2 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1524 microversion: 2.1 time: 0.873903 Aug 24 10:28:27.111445 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1977/3563] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:26 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1524 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:27.123255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7194abf1-6086-490b-83ca-24111f1134a7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:27.127474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7194abf1-6086-490b-83ca-24111f1134a7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:27.141523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7194abf1-6086-490b-83ca-24111f1134a7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:27.142429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7194abf1-6086-490b-83ca-24111f1134a7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:27.146445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7194abf1-6086-490b-83ca-24111f1134a7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:27.147592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7194abf1-6086-490b-83ca-24111f1134a7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:27.148290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7194abf1-6086-490b-83ca-24111f1134a7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:27.149008 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7194abf1-6086-490b-83ca-24111f1134a7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:27.180332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c12af776-4fa8-40b8-9895-e12a2b0ca821 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:27.195942 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c12af776-4fa8-40b8-9895-e12a2b0ca821 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1217 microversion: 2.1 time: 0.335419 Aug 24 10:28:27.213574 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1587/3564] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:26 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1217 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:27.236160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7ddda6cb-ed28-44a2-b17f-b736164f2fd6 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f46542730d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:27.392017 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7ddda6cb-ed28-44a2-b17f-b736164f2fd6 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a" status: 200 len: 1421 microversion: 2.1 time: 0.176653 Aug 24 10:28:27.396624 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1588/3565] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:27 2022] GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a => generated 1421 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:27.414768 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-07dd4c22-7a99-45c3-a8f8-d39f9f992b0f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:27.419764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-07dd4c22-7a99-45c3-a8f8-d39f9f992b0f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:27.452181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07dd4c22-7a99-45c3-a8f8-d39f9f992b0f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:27.452686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07dd4c22-7a99-45c3-a8f8-d39f9f992b0f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:27.453144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07dd4c22-7a99-45c3-a8f8-d39f9f992b0f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:27.453888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07dd4c22-7a99-45c3-a8f8-d39f9f992b0f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:27.462115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07dd4c22-7a99-45c3-a8f8-d39f9f992b0f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:27.464332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07dd4c22-7a99-45c3-a8f8-d39f9f992b0f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:27.506166 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-07dd4c22-7a99-45c3-a8f8-d39f9f992b0f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] HTTP exception thrown: Instance 2121a94d-a44d-49f0-95d9-e9c77312fb4a could not be found. Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-07dd4c22-7a99-45c3-a8f8-d39f9f992b0f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Request method failure captured: Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a HTTP/1.1 Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfwVOwKbAI3HcYW4vDUwX5tmvWZcMN8iYYPbyv0cT05fZ_Z-LEPCm4LinUuprRdXqkjYpTNDBQ5PMwhn6CDfWO2m5UgqK-Sr-pjjwg2dd34HghINyEVE3T5Itg-PYKj0YMEqYVC5uIroOumu3tZy7M7156OT9EtIM2-BMTg5dhnnzv0 Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b324a37b01b644dfa301a561e6125672", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b324a37b01b644dfa301a561e6125672"}]}] Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: b49cb438da9f4b309d54bfef9fc19bda Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 2121a94d-a44d-49f0-95d9-e9c77312fb4a could not be found. Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '2121a94d-a44d-49f0-95d9-e9c77312fb4a'} Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2121a94d-a44d-49f0-95d9-e9c77312fb4a could not be found. Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2121a94d-a44d-49f0-95d9-e9c77312fb4a could not be found. Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:28:27.508176 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:28:27.514145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:28:27.514145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:28:27.514145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:28:27.514145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:28:27.514145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:28:27.514145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2121a94d-a44d-49f0-95d9-e9c77312fb4a could not be found. Aug 24 10:28:27.514145 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:28:27.514145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-07dd4c22-7a99-45c3-a8f8-d39f9f992b0f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Returning 404 to user: Instance 2121a94d-a44d-49f0-95d9-e9c77312fb4a could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:28:27.516855 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-07dd4c22-7a99-45c3-a8f8-d39f9f992b0f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 404 len: 111 microversion: 2.1 time: 0.114471 Aug 24 10:28:27.518170 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1589/3566] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:27 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:28:27.594204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-362a8332-974c-4a34-b081-0053d99ee097 req-5e8f6f10-2d75-480a-8113-1ddeb53ef9e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "521e506a-4d4e-475f-b4e4-e7fc4552a7ac", "name": "network-vif-deleted", "tag": "bb00dcc0-85f9-4f70-be7d-bf15304fa924"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:27.629939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-362a8332-974c-4a34-b081-0053d99ee097 req-5e8f6f10-2d75-480a-8113-1ddeb53ef9e6 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:27.635188 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-362a8332-974c-4a34-b081-0053d99ee097 req-5e8f6f10-2d75-480a-8113-1ddeb53ef9e6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:27.636229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-362a8332-974c-4a34-b081-0053d99ee097 req-5e8f6f10-2d75-480a-8113-1ddeb53ef9e6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:27.691880 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-362a8332-974c-4a34-b081-0053d99ee097 req-5e8f6f10-2d75-480a-8113-1ddeb53ef9e6 service nova] Creating event network-vif-deleted:bb00dcc0-85f9-4f70-be7d-bf15304fa924 for instance 521e506a-4d4e-475f-b4e4-e7fc4552a7ac on n-h2-849328-3 Aug 24 10:28:27.707908 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-362a8332-974c-4a34-b081-0053d99ee097 req-5e8f6f10-2d75-480a-8113-1ddeb53ef9e6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124338 Aug 24 10:28:27.713220 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1590/3567] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:28:27.852409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7194abf1-6086-490b-83ca-24111f1134a7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:27.870443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7194abf1-6086-490b-83ca-24111f1134a7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:27.876848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9697144e-f313-4d52-9564-308f4cfb4205 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1267180699", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "fb7883d4-b081-478d-b08b-6c818132f5bd"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:27.887901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7194abf1-6086-490b-83ca-24111f1134a7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:27.889663 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7194abf1-6086-490b-83ca-24111f1134a7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.774816 Aug 24 10:28:27.893863 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1978/3568] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:28:27 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:28:28.006211 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-9697144e-f313-4d52-9564-308f4cfb4205 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] validate_networks() for [('fb7883d4-b081-478d-b08b-6c818132f5bd', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:28:28.119152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-59e85ec3-3d70-4139-98b8-76d31caaef0b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:28.121360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-59e85ec3-3d70-4139-98b8-76d31caaef0b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:28.135051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59e85ec3-3d70-4139-98b8-76d31caaef0b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:28.137645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59e85ec3-3d70-4139-98b8-76d31caaef0b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:28.141242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59e85ec3-3d70-4139-98b8-76d31caaef0b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:28.144045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59e85ec3-3d70-4139-98b8-76d31caaef0b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:28.145556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59e85ec3-3d70-4139-98b8-76d31caaef0b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:28.146413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59e85ec3-3d70-4139-98b8-76d31caaef0b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:28.478205 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-59e85ec3-3d70-4139-98b8-76d31caaef0b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:28.492683 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-59e85ec3-3d70-4139-98b8-76d31caaef0b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1524 microversion: 2.1 time: 0.378054 Aug 24 10:28:28.494236 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1979/3569] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:28 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1524 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:28:28.499250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-76eeccd7-bd9b-4284-836c-65888350494c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:28.500314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-76eeccd7-bd9b-4284-836c-65888350494c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:28.507214 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76eeccd7-bd9b-4284-836c-65888350494c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:28.508076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76eeccd7-bd9b-4284-836c-65888350494c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:28.508761 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76eeccd7-bd9b-4284-836c-65888350494c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:28.509731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76eeccd7-bd9b-4284-836c-65888350494c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:28.510551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76eeccd7-bd9b-4284-836c-65888350494c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:28.511383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76eeccd7-bd9b-4284-836c-65888350494c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:28.514709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:28.599227 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-76eeccd7-bd9b-4284-836c-65888350494c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:28.608261 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-76eeccd7-bd9b-4284-836c-65888350494c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1269 microversion: 2.1 time: 0.112642 Aug 24 10:28:28.610167 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1980/3570] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:28 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1269 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:28.630652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e53fc4f3-d45d-4a87-b87f-44d2bc918127 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f4647d9cf70>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:28.738003 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e53fc4f3-d45d-4a87-b87f-44d2bc918127 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a" status: 200 len: 1421 microversion: 2.1 time: 0.126464 Aug 24 10:28:28.738645 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1981/3571] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:28 2022] GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a => generated 1421 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:28.921996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1a897b64-c7cc-4c48-b424-db65b3135a49 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:28.922626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1a897b64-c7cc-4c48-b424-db65b3135a49 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:28.936064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9697144e-f313-4d52-9564-308f4cfb4205 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:28:28.937291 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9697144e-f313-4d52-9564-308f4cfb4205 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:28:28.938532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9697144e-f313-4d52-9564-308f4cfb4205 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:28:28.939323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9697144e-f313-4d52-9564-308f4cfb4205 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:28:28.939949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9697144e-f313-4d52-9564-308f4cfb4205 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:28:28.940800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a897b64-c7cc-4c48-b424-db65b3135a49 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:28.948502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a897b64-c7cc-4c48-b424-db65b3135a49 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:28.949574 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a897b64-c7cc-4c48-b424-db65b3135a49 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:28.952611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a897b64-c7cc-4c48-b424-db65b3135a49 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:28.958819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a897b64-c7cc-4c48-b424-db65b3135a49 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:28.960679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a897b64-c7cc-4c48-b424-db65b3135a49 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:28.968017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9697144e-f313-4d52-9564-308f4cfb4205 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:28.968943 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9697144e-f313-4d52-9564-308f4cfb4205 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:28.969589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9697144e-f313-4d52-9564-308f4cfb4205 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:28.972389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9697144e-f313-4d52-9564-308f4cfb4205 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:28.976298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9697144e-f313-4d52-9564-308f4cfb4205 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:28.977413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9697144e-f313-4d52-9564-308f4cfb4205 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:29.039256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-9697144e-f313-4d52-9564-308f4cfb4205 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Getting quotas for project b324a37b01b644dfa301a561e6125672. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:28:29.053942 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-9697144e-f313-4d52-9564-308f4cfb4205 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Getting quotas for user b49cb438da9f4b309d54bfef9fc19bda and project b324a37b01b644dfa301a561e6125672. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:28:29.086562 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9697144e-f313-4d52-9564-308f4cfb4205 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:28:29.090355 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9697144e-f313-4d52-9564-308f4cfb4205 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:28:29.188715 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9697144e-f313-4d52-9564-308f4cfb4205 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.311914 Aug 24 10:28:29.195693 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1591/3572] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:28:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:28:29.209887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fefe8a30-b039-4d92-afe3-9f896fd1b10b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:29.210532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fefe8a30-b039-4d92-afe3-9f896fd1b10b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:29.449543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fefe8a30-b039-4d92-afe3-9f896fd1b10b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:29.467231 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fefe8a30-b039-4d92-afe3-9f896fd1b10b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f" status: 200 len: 1215 microversion: 2.1 time: 0.269149 Aug 24 10:28:29.467708 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1592/3573] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:29 2022] GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f => generated 1215 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:29.514718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-b54cb548-55ba-4f22-a21e-13782bb88e46 req-e5beff9c-cad4-4162-a50d-dc425769c7e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ade0e12-9ac0-459f-8f85-6743432302fa", "name": "network-vif-plugged", "status": "completed", "tag": "5844483e-5b42-463a-95e1-a9835141849c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:29.557075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b54cb548-55ba-4f22-a21e-13782bb88e46 req-e5beff9c-cad4-4162-a50d-dc425769c7e4 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:29.566205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b54cb548-55ba-4f22-a21e-13782bb88e46 req-e5beff9c-cad4-4162-a50d-dc425769c7e4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:29.568051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b54cb548-55ba-4f22-a21e-13782bb88e46 req-e5beff9c-cad4-4162-a50d-dc425769c7e4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:29.600785 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b54cb548-55ba-4f22-a21e-13782bb88e46 req-e5beff9c-cad4-4162-a50d-dc425769c7e4 service nova] Creating event network-vif-plugged:5844483e-5b42-463a-95e1-a9835141849c for instance 1ade0e12-9ac0-459f-8f85-6743432302fa on n-h1-849328-3 Aug 24 10:28:29.613041 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-b54cb548-55ba-4f22-a21e-13782bb88e46 req-e5beff9c-cad4-4162-a50d-dc425769c7e4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126999 Aug 24 10:28:29.618012 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1593/3574] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:28:29.958720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-589435e7-4f19-433d-8862-681bd5ea4f21 tempest-ExtensionsTest-1759922132 tempest-ExtensionsTest-1759922132-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:29.960595 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-589435e7-4f19-433d-8862-681bd5ea4f21 tempest-ExtensionsTest-1759922132 tempest-ExtensionsTest-1759922132-project] 10.222.0.85 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.341364 Aug 24 10:28:29.961182 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1594/3575] 10.222.0.85 () {58 vars in 1170 bytes} [Wed Aug 24 10:28:29 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:28:29.974955 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5d2fdfc0-1390-4500-874f-b70222756c5b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:29.976012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5d2fdfc0-1390-4500-874f-b70222756c5b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:29.986324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d2fdfc0-1390-4500-874f-b70222756c5b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:29.986826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d2fdfc0-1390-4500-874f-b70222756c5b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:29.987279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d2fdfc0-1390-4500-874f-b70222756c5b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:29.987954 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d2fdfc0-1390-4500-874f-b70222756c5b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:29.988790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d2fdfc0-1390-4500-874f-b70222756c5b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:29.989406 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d2fdfc0-1390-4500-874f-b70222756c5b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:30.373022 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5d2fdfc0-1390-4500-874f-b70222756c5b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:30.407452 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5d2fdfc0-1390-4500-874f-b70222756c5b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1524 microversion: 2.1 time: 0.436734 Aug 24 10:28:30.412406 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1595/3576] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:29 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1524 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:30.429053 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a862d4b9-e8fa-4a5f-bfdd-797f14fedf6a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:30.435674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a862d4b9-e8fa-4a5f-bfdd-797f14fedf6a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:30.451516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1a897b64-c7cc-4c48-b424-db65b3135a49 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:30.470297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a862d4b9-e8fa-4a5f-bfdd-797f14fedf6a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:30.471054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a862d4b9-e8fa-4a5f-bfdd-797f14fedf6a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:30.471788 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a862d4b9-e8fa-4a5f-bfdd-797f14fedf6a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:30.472600 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1a897b64-c7cc-4c48-b424-db65b3135a49 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:30.472997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a862d4b9-e8fa-4a5f-bfdd-797f14fedf6a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:30.473866 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a862d4b9-e8fa-4a5f-bfdd-797f14fedf6a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:30.475889 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a862d4b9-e8fa-4a5f-bfdd-797f14fedf6a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:30.480228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1a897b64-c7cc-4c48-b424-db65b3135a49 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:30.484627 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1a897b64-c7cc-4c48-b424-db65b3135a49 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 1.566882 Aug 24 10:28:30.510134 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1982/3577] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:28:28 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:28:30.522776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d8bbee91-a3c0-495b-a06e-9e3bce184d97 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f465a1d08b0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:30.682739 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d8bbee91-a3c0-495b-a06e-9e3bce184d97 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a" status: 200 len: 1421 microversion: 2.1 time: 0.167573 Aug 24 10:28:30.683743 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1983/3578] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:30 2022] GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a => generated 1421 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:30.712171 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9f8e30cf-c73c-4856-a492-a976d27463a8 tempest-ExtensionsTest-1759922132 tempest-ExtensionsTest-1759922132-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:30.726192 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9f8e30cf-c73c-4856-a492-a976d27463a8 tempest-ExtensionsTest-1759922132 tempest-ExtensionsTest-1759922132-project] 10.222.0.85 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.030790 Aug 24 10:28:30.733293 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1984/3579] 10.222.0.85 () {58 vars in 1134 bytes} [Wed Aug 24 10:28:30 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:28:30.759625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-45afca83-082e-49be-80ff-b66a09b9fd8f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:30.767431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-45afca83-082e-49be-80ff-b66a09b9fd8f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:30.815344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45afca83-082e-49be-80ff-b66a09b9fd8f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:30.822065 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45afca83-082e-49be-80ff-b66a09b9fd8f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:30.825106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45afca83-082e-49be-80ff-b66a09b9fd8f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:30.832526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45afca83-082e-49be-80ff-b66a09b9fd8f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:30.836004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45afca83-082e-49be-80ff-b66a09b9fd8f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:30.837433 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45afca83-082e-49be-80ff-b66a09b9fd8f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:30.865136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a862d4b9-e8fa-4a5f-bfdd-797f14fedf6a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:30.899465 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a862d4b9-e8fa-4a5f-bfdd-797f14fedf6a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1275 microversion: 2.1 time: 0.476171 Aug 24 10:28:30.902293 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1596/3580] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:30 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1275 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:31.072964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-45afca83-082e-49be-80ff-b66a09b9fd8f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:31.109028 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-45afca83-082e-49be-80ff-b66a09b9fd8f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f" status: 200 len: 1267 microversion: 2.1 time: 0.370080 Aug 24 10:28:31.126345 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1985/3581] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:30 2022] GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f => generated 1267 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:31.435858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-16b67395-2856-40ed-b0c0-17a797927145 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:31.436577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-16b67395-2856-40ed-b0c0-17a797927145 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:31.452103 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16b67395-2856-40ed-b0c0-17a797927145 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:31.452598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16b67395-2856-40ed-b0c0-17a797927145 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:31.459590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16b67395-2856-40ed-b0c0-17a797927145 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:31.463682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16b67395-2856-40ed-b0c0-17a797927145 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:31.464268 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16b67395-2856-40ed-b0c0-17a797927145 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:31.466931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16b67395-2856-40ed-b0c0-17a797927145 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:31.515876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ffe665e-044c-4478-b9c0-81b8be23027a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:31.516575 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3ffe665e-044c-4478-b9c0-81b8be23027a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:31.555020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=69 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:31.563552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ffe665e-044c-4478-b9c0-81b8be23027a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:31.564322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ffe665e-044c-4478-b9c0-81b8be23027a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:31.565509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ffe665e-044c-4478-b9c0-81b8be23027a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:31.566241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ffe665e-044c-4478-b9c0-81b8be23027a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:31.571953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ffe665e-044c-4478-b9c0-81b8be23027a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:31.574233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ffe665e-044c-4478-b9c0-81b8be23027a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:32.306901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3ffe665e-044c-4478-b9c0-81b8be23027a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:32.323694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3ffe665e-044c-4478-b9c0-81b8be23027a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:32.327983 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3ffe665e-044c-4478-b9c0-81b8be23027a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:32.329295 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ffe665e-044c-4478-b9c0-81b8be23027a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.817893 Aug 24 10:28:32.347530 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1986/3582] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:28:31 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:28:32.359358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-97305b19-5b12-4b5f-9e63-98e02bacb6ed tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f465a1bd700>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:32.454905 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-97305b19-5b12-4b5f-9e63-98e02bacb6ed tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a" status: 200 len: 1421 microversion: 2.1 time: 0.105732 Aug 24 10:28:32.469210 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1987/3583] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:32 2022] GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a => generated 1421 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:32.481817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-fea1e385-5047-421c-8462-e68f57f1d317 req-6a5f46e9-3dd3-421b-9a55-4f2cc58753ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ade0e12-9ac0-459f-8f85-6743432302fa", "name": "network-vif-plugged", "status": "completed", "tag": "e3d5d84f-2aa7-4b85-b98f-cb04738cac08"}, {"server_uuid": "1ade0e12-9ac0-459f-8f85-6743432302fa", "name": "network-vif-plugged", "status": "completed", "tag": "fa4b74d3-c905-4fde-af3d-45c9f745c900"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:32.500496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fea1e385-5047-421c-8462-e68f57f1d317 req-6a5f46e9-3dd3-421b-9a55-4f2cc58753ab service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:32.502093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fea1e385-5047-421c-8462-e68f57f1d317 req-6a5f46e9-3dd3-421b-9a55-4f2cc58753ab service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:32.503103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fea1e385-5047-421c-8462-e68f57f1d317 req-6a5f46e9-3dd3-421b-9a55-4f2cc58753ab service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:32.529661 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-fea1e385-5047-421c-8462-e68f57f1d317 req-6a5f46e9-3dd3-421b-9a55-4f2cc58753ab service nova] Creating event network-vif-plugged:e3d5d84f-2aa7-4b85-b98f-cb04738cac08 for instance 1ade0e12-9ac0-459f-8f85-6743432302fa on n-h1-849328-3 Aug 24 10:28:32.532153 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-fea1e385-5047-421c-8462-e68f57f1d317 req-6a5f46e9-3dd3-421b-9a55-4f2cc58753ab service nova] Creating event network-vif-plugged:fa4b74d3-c905-4fde-af3d-45c9f745c900 for instance 1ade0e12-9ac0-459f-8f85-6743432302fa on n-h1-849328-3 Aug 24 10:28:32.543858 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-fea1e385-5047-421c-8462-e68f57f1d317 req-6a5f46e9-3dd3-421b-9a55-4f2cc58753ab service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.071839 Aug 24 10:28:32.546296 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1988/3584] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:28:32.559002 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f16d62d4-78c3-4490-8003-97a2be5e08f6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:32.560807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f16d62d4-78c3-4490-8003-97a2be5e08f6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:32.574144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f16d62d4-78c3-4490-8003-97a2be5e08f6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:32.576613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f16d62d4-78c3-4490-8003-97a2be5e08f6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:32.578461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f16d62d4-78c3-4490-8003-97a2be5e08f6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:32.580972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f16d62d4-78c3-4490-8003-97a2be5e08f6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:32.583006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f16d62d4-78c3-4490-8003-97a2be5e08f6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:32.586620 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f16d62d4-78c3-4490-8003-97a2be5e08f6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:32.907294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-16b67395-2856-40ed-b0c0-17a797927145 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:32.921972 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-16b67395-2856-40ed-b0c0-17a797927145 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1524 microversion: 2.1 time: 1.492507 Aug 24 10:28:32.929319 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1597/3585] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:31 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1524 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:32.973689 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-190742b8-4885-40e0-b69a-162a4449dea8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:32.977839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-190742b8-4885-40e0-b69a-162a4449dea8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:32.990806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-190742b8-4885-40e0-b69a-162a4449dea8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:32.992129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-190742b8-4885-40e0-b69a-162a4449dea8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:32.993944 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-190742b8-4885-40e0-b69a-162a4449dea8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:32.995556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-190742b8-4885-40e0-b69a-162a4449dea8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:32.996721 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-190742b8-4885-40e0-b69a-162a4449dea8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:32.997803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-190742b8-4885-40e0-b69a-162a4449dea8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:33.482674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-190742b8-4885-40e0-b69a-162a4449dea8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:33.506795 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-190742b8-4885-40e0-b69a-162a4449dea8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f" status: 200 len: 1273 microversion: 2.1 time: 0.552092 Aug 24 10:28:33.527600 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1598/3586] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:32 2022] GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f => generated 1273 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:33.544893 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-551c8323-b6d4-4e93-bd18-6018049f4aa1 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:33.546528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-551c8323-b6d4-4e93-bd18-6018049f4aa1 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:33.588098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-551c8323-b6d4-4e93-bd18-6018049f4aa1 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:33.594789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-551c8323-b6d4-4e93-bd18-6018049f4aa1 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:33.605480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-551c8323-b6d4-4e93-bd18-6018049f4aa1 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:33.611016 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-551c8323-b6d4-4e93-bd18-6018049f4aa1 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:33.612133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-551c8323-b6d4-4e93-bd18-6018049f4aa1 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:33.613037 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-551c8323-b6d4-4e93-bd18-6018049f4aa1 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:33.674999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f16d62d4-78c3-4490-8003-97a2be5e08f6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:33.723773 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f16d62d4-78c3-4490-8003-97a2be5e08f6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1317 microversion: 2.1 time: 1.174902 Aug 24 10:28:33.728142 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1989/3587] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:32 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1317 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:33.759260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3782f8eb-0b53-4584-80c2-c520eea3c308 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f4647d7eca0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:33.884865 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3782f8eb-0b53-4584-80c2-c520eea3c308 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a" status: 200 len: 1421 microversion: 2.1 time: 0.154427 Aug 24 10:28:33.903556 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1990/3588] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:33 2022] GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a => generated 1421 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:33.976163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-260618c7-7c09-40a7-8654-d2696e0e9ffa tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:33.982488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-260618c7-7c09-40a7-8654-d2696e0e9ffa tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:34.004937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-260618c7-7c09-40a7-8654-d2696e0e9ffa tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:34.008492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-260618c7-7c09-40a7-8654-d2696e0e9ffa tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:34.012378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-260618c7-7c09-40a7-8654-d2696e0e9ffa tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:34.016947 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-260618c7-7c09-40a7-8654-d2696e0e9ffa tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:34.018157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-260618c7-7c09-40a7-8654-d2696e0e9ffa tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:34.019199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-260618c7-7c09-40a7-8654-d2696e0e9ffa tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:34.411682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-260618c7-7c09-40a7-8654-d2696e0e9ffa tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:34.423720 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-260618c7-7c09-40a7-8654-d2696e0e9ffa tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1524 microversion: 2.1 time: 0.458769 Aug 24 10:28:34.424643 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1991/3589] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:33 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1524 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:34.545506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-be74b4f4-fc66-476c-9b64-0f41f105117a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:34.546777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-be74b4f4-fc66-476c-9b64-0f41f105117a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:34.555709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be74b4f4-fc66-476c-9b64-0f41f105117a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:34.557484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be74b4f4-fc66-476c-9b64-0f41f105117a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:34.558201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be74b4f4-fc66-476c-9b64-0f41f105117a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:34.562097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be74b4f4-fc66-476c-9b64-0f41f105117a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:34.562825 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be74b4f4-fc66-476c-9b64-0f41f105117a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:34.563780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be74b4f4-fc66-476c-9b64-0f41f105117a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:34.682989 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-be74b4f4-fc66-476c-9b64-0f41f105117a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:34.695628 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-be74b4f4-fc66-476c-9b64-0f41f105117a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f" status: 200 len: 1273 microversion: 2.1 time: 0.154955 Aug 24 10:28:34.698185 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1992/3590] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:34 2022] GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f => generated 1273 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:28:34.707855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a00011bd-6fc9-4fc3-bec0-4b269571fc77 req-b3ff2d0b-05db-4c4e-89b9-6ce7bb0d451d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ade0e12-9ac0-459f-8f85-6743432302fa", "name": "network-vif-plugged", "status": "completed", "tag": "f508eefe-bb8e-440a-8dd6-3163d13f5d06"}, {"server_uuid": "1ade0e12-9ac0-459f-8f85-6743432302fa", "name": "network-vif-plugged", "status": "completed", "tag": "0a936ebf-bd84-48ce-b0c2-fac98f570a10"}, {"server_uuid": "1ade0e12-9ac0-459f-8f85-6743432302fa", "name": "network-vif-plugged", "status": "completed", "tag": "baf5ca24-63d8-41c5-a43c-e62b747ae00c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:34.718031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a00011bd-6fc9-4fc3-bec0-4b269571fc77 req-b3ff2d0b-05db-4c4e-89b9-6ce7bb0d451d service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:34.718780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a00011bd-6fc9-4fc3-bec0-4b269571fc77 req-b3ff2d0b-05db-4c4e-89b9-6ce7bb0d451d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:34.719384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a00011bd-6fc9-4fc3-bec0-4b269571fc77 req-b3ff2d0b-05db-4c4e-89b9-6ce7bb0d451d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:34.732336 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a00011bd-6fc9-4fc3-bec0-4b269571fc77 req-b3ff2d0b-05db-4c4e-89b9-6ce7bb0d451d service nova] Creating event network-vif-plugged:f508eefe-bb8e-440a-8dd6-3163d13f5d06 for instance 1ade0e12-9ac0-459f-8f85-6743432302fa on n-h1-849328-3 Aug 24 10:28:34.733206 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a00011bd-6fc9-4fc3-bec0-4b269571fc77 req-b3ff2d0b-05db-4c4e-89b9-6ce7bb0d451d service nova] Creating event network-vif-plugged:0a936ebf-bd84-48ce-b0c2-fac98f570a10 for instance 1ade0e12-9ac0-459f-8f85-6743432302fa on n-h1-849328-3 Aug 24 10:28:34.733886 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a00011bd-6fc9-4fc3-bec0-4b269571fc77 req-b3ff2d0b-05db-4c4e-89b9-6ce7bb0d451d service nova] Creating event network-vif-plugged:baf5ca24-63d8-41c5-a43c-e62b747ae00c for instance 1ade0e12-9ac0-459f-8f85-6743432302fa on n-h1-849328-3 Aug 24 10:28:34.740895 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a00011bd-6fc9-4fc3-bec0-4b269571fc77 req-b3ff2d0b-05db-4c4e-89b9-6ce7bb0d451d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.041259 Aug 24 10:28:34.742087 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1993/3591] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:28:34.766140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c501255e-bb70-4504-9def-462a2d87782c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:34.767471 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c501255e-bb70-4504-9def-462a2d87782c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:34.777603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c501255e-bb70-4504-9def-462a2d87782c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:34.778475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c501255e-bb70-4504-9def-462a2d87782c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:34.779204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c501255e-bb70-4504-9def-462a2d87782c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:34.780174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c501255e-bb70-4504-9def-462a2d87782c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:34.780890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c501255e-bb70-4504-9def-462a2d87782c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:34.781616 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c501255e-bb70-4504-9def-462a2d87782c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:34.794236 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-551c8323-b6d4-4e93-bd18-6018049f4aa1 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:34.813012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-551c8323-b6d4-4e93-bd18-6018049f4aa1 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:34.819942 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-551c8323-b6d4-4e93-bd18-6018049f4aa1 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:34.821279 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-551c8323-b6d4-4e93-bd18-6018049f4aa1 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 1.291873 Aug 24 10:28:34.821881 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1599/3592] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:28:33 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:28:34.923896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f54b4739-67d5-4d6b-a535-9f2c41af3bd3 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f46541d6dc0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:34.980089 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f54b4739-67d5-4d6b-a535-9f2c41af3bd3 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a" status: 200 len: 1430 microversion: 2.1 time: 0.061239 Aug 24 10:28:34.989815 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1600/3593] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:34 2022] GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a => generated 1430 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:28:34.995286 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5195b88e-b583-41b6-9358-971136202619 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f4654167040>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:35.055247 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5195b88e-b583-41b6-9358-971136202619 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a" status: 200 len: 1430 microversion: 2.1 time: 0.063772 Aug 24 10:28:35.068295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c501255e-bb70-4504-9def-462a2d87782c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:35.077812 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c501255e-bb70-4504-9def-462a2d87782c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1317 microversion: 2.1 time: 0.315925 Aug 24 10:28:35.078534 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1601/3594] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:34 2022] GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a => generated 1430 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:35.084275 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1994/3595] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:34 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1317 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:35.087108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5d7ba77b-85cc-403b-bba6-c6235fae6bcf tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:35.087998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5d7ba77b-85cc-403b-bba6-c6235fae6bcf tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] [instance: 51be811b-0bd6-4671-831a-ba5733764143] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:35.096160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d7ba77b-85cc-403b-bba6-c6235fae6bcf tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:35.097052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d7ba77b-85cc-403b-bba6-c6235fae6bcf tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:35.097836 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d7ba77b-85cc-403b-bba6-c6235fae6bcf tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:35.098816 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d7ba77b-85cc-403b-bba6-c6235fae6bcf tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:35.099806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d7ba77b-85cc-403b-bba6-c6235fae6bcf tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:35.100504 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d7ba77b-85cc-403b-bba6-c6235fae6bcf tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:35.445291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2ef84067-773c-4368-9892-b54fec933e9c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:35.445920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2ef84067-773c-4368-9892-b54fec933e9c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:35.460913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ef84067-773c-4368-9892-b54fec933e9c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:35.461445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ef84067-773c-4368-9892-b54fec933e9c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:35.461889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ef84067-773c-4368-9892-b54fec933e9c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:35.462600 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ef84067-773c-4368-9892-b54fec933e9c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:35.463065 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ef84067-773c-4368-9892-b54fec933e9c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:35.463495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ef84067-773c-4368-9892-b54fec933e9c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:35.696136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5d7ba77b-85cc-403b-bba6-c6235fae6bcf tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39bebd0ab646faa5109d1b2f2cae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba66b174cac4cadb9afc09f7df3e21f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:35.708838 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5d7ba77b-85cc-403b-bba6-c6235fae6bcf tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143" status: 200 len: 1467 microversion: 2.1 time: 0.628723 Aug 24 10:28:35.722074 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1602/3596] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:35 2022] GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143 => generated 1467 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:35.737620 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-04bcefee-8fb6-43eb-9fc0-095e5510ea2e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:35.738484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-04bcefee-8fb6-43eb-9fc0-095e5510ea2e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:35.746641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04bcefee-8fb6-43eb-9fc0-095e5510ea2e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:35.747537 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04bcefee-8fb6-43eb-9fc0-095e5510ea2e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:35.748185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04bcefee-8fb6-43eb-9fc0-095e5510ea2e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:35.749247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04bcefee-8fb6-43eb-9fc0-095e5510ea2e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:35.749929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04bcefee-8fb6-43eb-9fc0-095e5510ea2e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:35.750824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04bcefee-8fb6-43eb-9fc0-095e5510ea2e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:35.887946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2ef84067-773c-4368-9892-b54fec933e9c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:35.906391 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2ef84067-773c-4368-9892-b54fec933e9c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1524 microversion: 2.1 time: 0.464219 Aug 24 10:28:35.907615 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1995/3597] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:35 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1524 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:35.914193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dbfbe702-9282-4196-8fc8-c2c4999620d9 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f46550e1a60>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:35.992940 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dbfbe702-9282-4196-8fc8-c2c4999620d9 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/0a9df326-dcca-498d-8d8a-b320e539a1af" status: 200 len: 784 microversion: 2.1 time: 0.083828 Aug 24 10:28:35.994026 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1996/3598] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:35 2022] GET /compute/v2.1/images/0a9df326-dcca-498d-8d8a-b320e539a1af => generated 784 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:28:36.002368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bda505ca-d260-4271-9812-6b76cdfc2a76 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:36.003385 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bda505ca-d260-4271-9812-6b76cdfc2a76 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:36.026269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bda505ca-d260-4271-9812-6b76cdfc2a76 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:36.026770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bda505ca-d260-4271-9812-6b76cdfc2a76 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:36.030439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bda505ca-d260-4271-9812-6b76cdfc2a76 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:36.034055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bda505ca-d260-4271-9812-6b76cdfc2a76 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:36.034555 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bda505ca-d260-4271-9812-6b76cdfc2a76 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:36.035205 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bda505ca-d260-4271-9812-6b76cdfc2a76 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:36.229854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-04bcefee-8fb6-43eb-9fc0-095e5510ea2e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:36.260809 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-04bcefee-8fb6-43eb-9fc0-095e5510ea2e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f" status: 200 len: 1315 microversion: 2.1 time: 0.537183 Aug 24 10:28:36.267720 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1603/3599] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:35 2022] GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f => generated 1315 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:36.283950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-481ad3c1-5a41-4233-bfdf-7aabf531a745 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:36.297807 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-481ad3c1-5a41-4233-bfdf-7aabf531a745 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024760 Aug 24 10:28:36.299751 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1604/3600] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:28:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:28:36.305705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8e32d270-b1dc-4798-ac0b-5b1a949b834d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:36.306681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8e32d270-b1dc-4798-ac0b-5b1a949b834d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:36.323151 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e32d270-b1dc-4798-ac0b-5b1a949b834d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:36.323892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e32d270-b1dc-4798-ac0b-5b1a949b834d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:36.324335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e32d270-b1dc-4798-ac0b-5b1a949b834d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:36.325790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e32d270-b1dc-4798-ac0b-5b1a949b834d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:36.326250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e32d270-b1dc-4798-ac0b-5b1a949b834d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:36.326680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e32d270-b1dc-4798-ac0b-5b1a949b834d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:36.611316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bda505ca-d260-4271-9812-6b76cdfc2a76 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:36.627057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bda505ca-d260-4271-9812-6b76cdfc2a76 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:36.631213 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bda505ca-d260-4271-9812-6b76cdfc2a76 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:36.632719 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bda505ca-d260-4271-9812-6b76cdfc2a76 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1878 microversion: 2.42 time: 0.636745 Aug 24 10:28:36.642019 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1997/3601] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:28:35 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1878 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:28:36.647137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-9f1f815b-d982-415f-a32f-e79cee843089 req-3f17e300-a1af-481b-83e9-078c798e99d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94c62a85-d3f8-4b01-af30-cc3d15ba08ab", "tag": "00d18df2-80be-44f5-bf00-939583d9cbf9"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:36.675416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9f1f815b-d982-415f-a32f-e79cee843089 req-3f17e300-a1af-481b-83e9-078c798e99d7 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:36.676192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9f1f815b-d982-415f-a32f-e79cee843089 req-3f17e300-a1af-481b-83e9-078c798e99d7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:36.676832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9f1f815b-d982-415f-a32f-e79cee843089 req-3f17e300-a1af-481b-83e9-078c798e99d7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:36.698387 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-9f1f815b-d982-415f-a32f-e79cee843089 req-3f17e300-a1af-481b-83e9-078c798e99d7 service nova] Creating event network-changed:00d18df2-80be-44f5-bf00-939583d9cbf9 for instance 94c62a85-d3f8-4b01-af30-cc3d15ba08ab on n-h1-849328-3 Aug 24 10:28:36.711002 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-9f1f815b-d982-415f-a32f-e79cee843089 req-3f17e300-a1af-481b-83e9-078c798e99d7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067395 Aug 24 10:28:36.711647 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1998/3602] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:28:36.717102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2e15012e-22ca-4403-a6eb-3d9f2386f71d tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f465a207790>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:36.943891 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8e32d270-b1dc-4798-ac0b-5b1a949b834d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:36.956902 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8e32d270-b1dc-4798-ac0b-5b1a949b834d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1317 microversion: 2.1 time: 0.655210 Aug 24 10:28:36.958053 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1605/3603] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:36 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1317 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:36.963635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4533ebde-4cdb-4f7e-8e81-dd0c6ca39086 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:36.964483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4533ebde-4cdb-4f7e-8e81-dd0c6ca39086 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:36.971395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4533ebde-4cdb-4f7e-8e81-dd0c6ca39086 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:36.972144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4533ebde-4cdb-4f7e-8e81-dd0c6ca39086 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:36.972787 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4533ebde-4cdb-4f7e-8e81-dd0c6ca39086 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:36.984972 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4533ebde-4cdb-4f7e-8e81-dd0c6ca39086 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:36.993840 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4533ebde-4cdb-4f7e-8e81-dd0c6ca39086 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:36.994365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4533ebde-4cdb-4f7e-8e81-dd0c6ca39086 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:37.348377 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4533ebde-4cdb-4f7e-8e81-dd0c6ca39086 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:37.354845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:37.363216 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4533ebde-4cdb-4f7e-8e81-dd0c6ca39086 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1524 microversion: 2.1 time: 0.403714 Aug 24 10:28:37.364326 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1606/3604] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:36 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1524 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:37.372708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-56f7a281-04a4-4222-8d85-d3fa48a51da2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:37.373073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-56f7a281-04a4-4222-8d85-d3fa48a51da2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:37.383894 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56f7a281-04a4-4222-8d85-d3fa48a51da2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:37.384603 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56f7a281-04a4-4222-8d85-d3fa48a51da2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:37.385257 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56f7a281-04a4-4222-8d85-d3fa48a51da2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:37.386547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56f7a281-04a4-4222-8d85-d3fa48a51da2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:37.387408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56f7a281-04a4-4222-8d85-d3fa48a51da2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:37.388283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56f7a281-04a4-4222-8d85-d3fa48a51da2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:37.810872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-56f7a281-04a4-4222-8d85-d3fa48a51da2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:37.820697 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-56f7a281-04a4-4222-8d85-d3fa48a51da2 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f" status: 200 len: 1315 microversion: 2.1 time: 0.454645 Aug 24 10:28:37.825312 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1607/3605] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:37 2022] GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:37.834973 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9598d063-549e-4d9e-9b89-449ac5c1612b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:37.835795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9598d063-549e-4d9e-9b89-449ac5c1612b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:37.850673 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9598d063-549e-4d9e-9b89-449ac5c1612b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:37.853895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9598d063-549e-4d9e-9b89-449ac5c1612b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:37.857870 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2e15012e-22ca-4403-a6eb-3d9f2386f71d tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "DELETE /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a" status: 204 len: 0 microversion: 2.1 time: 1.144819 Aug 24 10:28:37.859055 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1999/3606] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:36 2022] DELETE /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a => generated 0 bytes in 1147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:28:37.860073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9598d063-549e-4d9e-9b89-449ac5c1612b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:37.861066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9598d063-549e-4d9e-9b89-449ac5c1612b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:37.861718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9598d063-549e-4d9e-9b89-449ac5c1612b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:37.867659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a2688c90-4f85-4b73-875b-a3b6af52c18f tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f4647c47670>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:37.873727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9598d063-549e-4d9e-9b89-449ac5c1612b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:37.900059 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-a2688c90-4f85-4b73-875b-a3b6af52c18f tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] HTTP exception thrown: Image not found. Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a2688c90-4f85-4b73-875b-a3b6af52c18f tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Request method failure captured: Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a HTTP/1.1 Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf0Wkxl2eVmSyiitaTwzL9coVMWMYjBfKkblO2IlZVS_SHAedzSdk2ChLW22YOlqZ-Hw-16y2BkJfcH9RyuX_FrRgHeUTFLhW33WzIQ-a8dU5a3xTRV0SagfOEBmuhVkrHBgcFONBF7wp7jEmL3NKSy_PPD1DIr8fKkKgVKmMOr3Egg Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: dba66b174cac4cadb9afc09f7df3e21f Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesOneServerTestJSON-563780166 Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/dba66b174cac4cadb9afc09f7df3e21f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_dba66b174cac4cadb9afc09f7df3e21f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/dba66b174cac4cadb9afc09f7df3e21f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/dba66b174cac4cadb9afc09f7df3e21f"}]}] Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesOneServerTestJSON-563780166 Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: dba66b174cac4cadb9afc09f7df3e21f Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-563780166 Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesOneServerTestJSON-563780166-project Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: fd39bebd0ab646faa5109d1b2f2cae0a Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesOneServerTestJSON-563780166-project Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: exception: Image not found. Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'b7340b09-57d9-44bf-abcf-32d7e7fbc22a'} Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b7340b09-57d9-44bf-abcf-32d7e7fbc22a Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 10:28:37.902554 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b7340b09-57d9-44bf-abcf-32d7e7fbc22a could not be found. Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a2688c90-4f85-4b73-875b-a3b6af52c18f tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Returning 404 to user: Image not found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a2688c90-4f85-4b73-875b-a3b6af52c18f tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a" status: 404 len: 62 microversion: 2.1 time: 0.040488 Aug 24 10:28:37.910949 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2000/3607] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:37 2022] GET /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 10:28:37.921932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d8f32d0b-bccc-4be0-bba4-ded4cd96a90f tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-400750507"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:37.932039 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d8f32d0b-bccc-4be0-bba4-ded4cd96a90f tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] [instance: 51be811b-0bd6-4671-831a-ba5733764143] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:37.941199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8f32d0b-bccc-4be0-bba4-ded4cd96a90f tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:37.941946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8f32d0b-bccc-4be0-bba4-ded4cd96a90f tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:37.942620 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8f32d0b-bccc-4be0-bba4-ded4cd96a90f tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:37.943580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8f32d0b-bccc-4be0-bba4-ded4cd96a90f tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:37.944242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8f32d0b-bccc-4be0-bba4-ded4cd96a90f tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:37.946053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8f32d0b-bccc-4be0-bba4-ded4cd96a90f tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:38.234900 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d8f32d0b-bccc-4be0-bba4-ded4cd96a90f tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "POST /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143/action" status: 202 len: 0 microversion: 2.1 time: 0.317202 Aug 24 10:28:38.243041 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2001/3608] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:28:37 2022] POST /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 10:28:38.252265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ebba61c-c639-4ab5-94a0-2781d209bd2b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:38.254679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4ebba61c-c639-4ab5-94a0-2781d209bd2b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:38.264284 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ebba61c-c639-4ab5-94a0-2781d209bd2b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:38.265159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ebba61c-c639-4ab5-94a0-2781d209bd2b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:38.265655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ebba61c-c639-4ab5-94a0-2781d209bd2b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:38.266397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ebba61c-c639-4ab5-94a0-2781d209bd2b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:38.266858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ebba61c-c639-4ab5-94a0-2781d209bd2b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:38.267675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ebba61c-c639-4ab5-94a0-2781d209bd2b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:38.518270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4ebba61c-c639-4ab5-94a0-2781d209bd2b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:38.530763 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4ebba61c-c639-4ab5-94a0-2781d209bd2b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1317 microversion: 2.1 time: 0.285124 Aug 24 10:28:38.534763 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2002/3609] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:38 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:38.542341 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e94c1454-745a-4696-9da8-9d2c6b76cce4 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f465a26aaf0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:38.607508 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e94c1454-745a-4696-9da8-9d2c6b76cce4 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255" status: 200 len: 1426 microversion: 2.1 time: 0.069632 Aug 24 10:28:38.608221 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2003/3610] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:38 2022] GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255 => generated 1426 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:38.617398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c89dbece-a9a4-4cb2-860a-74a283ae03fb tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:38.617856 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c89dbece-a9a4-4cb2-860a-74a283ae03fb tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:38.626886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c89dbece-a9a4-4cb2-860a-74a283ae03fb tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:38.627461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c89dbece-a9a4-4cb2-860a-74a283ae03fb tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:38.628319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c89dbece-a9a4-4cb2-860a-74a283ae03fb tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:38.629345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c89dbece-a9a4-4cb2-860a-74a283ae03fb tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:38.629897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c89dbece-a9a4-4cb2-860a-74a283ae03fb tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:38.630445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c89dbece-a9a4-4cb2-860a-74a283ae03fb tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:38.656240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9598d063-549e-4d9e-9b89-449ac5c1612b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:38.671586 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9598d063-549e-4d9e-9b89-449ac5c1612b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:38.674086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9598d063-549e-4d9e-9b89-449ac5c1612b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:38.676021 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9598d063-549e-4d9e-9b89-449ac5c1612b tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 2834 microversion: 2.42 time: 0.849684 Aug 24 10:28:38.676833 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1608/3611] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:28:37 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 2834 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:28:38.706207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f4e4f011-03c0-4646-93a2-70f5b4aaccaa tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:38.706765 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f4e4f011-03c0-4646-93a2-70f5b4aaccaa tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:38.722403 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4e4f011-03c0-4646-93a2-70f5b4aaccaa tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:38.727322 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4e4f011-03c0-4646-93a2-70f5b4aaccaa tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:38.727943 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4e4f011-03c0-4646-93a2-70f5b4aaccaa tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:38.728714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4e4f011-03c0-4646-93a2-70f5b4aaccaa tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:38.729232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4e4f011-03c0-4646-93a2-70f5b4aaccaa tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:38.729672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4e4f011-03c0-4646-93a2-70f5b4aaccaa tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:39.007024 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:39.033827 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c89dbece-a9a4-4cb2-860a-74a283ae03fb tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:39.048032 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c89dbece-a9a4-4cb2-860a-74a283ae03fb tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1524 microversion: 2.1 time: 0.435870 Aug 24 10:28:39.062748 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2004/3612] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:38 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1524 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:39.073367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a585857d-9bb0-4139-a1d9-1278919509db req-0a64862b-4961-4ead-b4b4-eac0cee46d32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b04bfa6-2a69-479e-bd7e-93e7838e098f", "tag": "1a18a2b7-d4b7-4b98-8182-fb76091d43a4"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:39.082063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a585857d-9bb0-4139-a1d9-1278919509db req-0a64862b-4961-4ead-b4b4-eac0cee46d32 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:39.082789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a585857d-9bb0-4139-a1d9-1278919509db req-0a64862b-4961-4ead-b4b4-eac0cee46d32 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:39.083399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a585857d-9bb0-4139-a1d9-1278919509db req-0a64862b-4961-4ead-b4b4-eac0cee46d32 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:39.098949 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a585857d-9bb0-4139-a1d9-1278919509db req-0a64862b-4961-4ead-b4b4-eac0cee46d32 service nova] Creating event network-changed:1a18a2b7-d4b7-4b98-8182-fb76091d43a4 for instance 6b04bfa6-2a69-479e-bd7e-93e7838e098f on n-h2-849328-3 Aug 24 10:28:39.105613 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a585857d-9bb0-4139-a1d9-1278919509db req-0a64862b-4961-4ead-b4b4-eac0cee46d32 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046489 Aug 24 10:28:39.107074 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2005/3613] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:28:39.115029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b91268e3-e135-4ab9-86db-bf1442b048f5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:39.115805 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b91268e3-e135-4ab9-86db-bf1442b048f5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:39.124074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b91268e3-e135-4ab9-86db-bf1442b048f5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:39.125074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b91268e3-e135-4ab9-86db-bf1442b048f5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:39.125910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b91268e3-e135-4ab9-86db-bf1442b048f5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:39.126969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b91268e3-e135-4ab9-86db-bf1442b048f5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:39.127643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b91268e3-e135-4ab9-86db-bf1442b048f5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:39.128409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b91268e3-e135-4ab9-86db-bf1442b048f5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:39.181861 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f4e4f011-03c0-4646-93a2-70f5b4aaccaa tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.479633 Aug 24 10:28:39.183252 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1609/3614] 10.222.0.85 () {60 vars in 1316 bytes} [Wed Aug 24 10:28:38 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa/os-interface => generated 1830 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:28:39.336578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b91268e3-e135-4ab9-86db-bf1442b048f5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:39.346844 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b91268e3-e135-4ab9-86db-bf1442b048f5 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f" status: 200 len: 1315 microversion: 2.1 time: 0.237656 Aug 24 10:28:39.360058 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2006/3615] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:39 2022] GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:39.571554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ab7a0961-a462-461d-9efe-d46e4a373cec tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:39.573627 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ab7a0961-a462-461d-9efe-d46e4a373cec tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:39.580953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=16 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:39.584815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab7a0961-a462-461d-9efe-d46e4a373cec tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:39.585764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab7a0961-a462-461d-9efe-d46e4a373cec tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:39.586456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab7a0961-a462-461d-9efe-d46e4a373cec tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:39.587408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab7a0961-a462-461d-9efe-d46e4a373cec tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:39.588166 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab7a0961-a462-461d-9efe-d46e4a373cec tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:39.589433 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab7a0961-a462-461d-9efe-d46e4a373cec tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:39.624149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8e9095be-8489-43d8-b0c0-44de50cdd85d tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f465a1d00d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:39.703284 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8e9095be-8489-43d8-b0c0-44de50cdd85d tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255" status: 200 len: 1426 microversion: 2.1 time: 0.083225 Aug 24 10:28:39.704203 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2007/3616] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:39 2022] GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255 => generated 1426 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:40.076767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d87cedd4-7ad4-4512-b0e0-463349df2c03 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:40.080675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d87cedd4-7ad4-4512-b0e0-463349df2c03 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:40.099301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d87cedd4-7ad4-4512-b0e0-463349df2c03 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:40.099855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d87cedd4-7ad4-4512-b0e0-463349df2c03 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:40.100296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d87cedd4-7ad4-4512-b0e0-463349df2c03 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:40.102070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d87cedd4-7ad4-4512-b0e0-463349df2c03 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:40.103458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d87cedd4-7ad4-4512-b0e0-463349df2c03 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:40.104702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d87cedd4-7ad4-4512-b0e0-463349df2c03 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:40.172945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:40.358724 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ab7a0961-a462-461d-9efe-d46e4a373cec tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:40.388885 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ab7a0961-a462-461d-9efe-d46e4a373cec tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1317 microversion: 2.1 time: 0.830448 Aug 24 10:28:40.392699 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1610/3617] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:39 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1317 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:40.407943 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-2209c334-7788-4da6-8225-bd32723a535c req-690f8d94-1d1b-4d3b-aac1-3aea5d6fbd6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51be811b-0bd6-4671-831a-ba5733764143", "name": "network-vif-unplugged", "status": "completed", "tag": "c45a2f3f-9db0-4c17-83e8-0cf4d8711aba"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:40.430508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2209c334-7788-4da6-8225-bd32723a535c req-690f8d94-1d1b-4d3b-aac1-3aea5d6fbd6b service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:40.433023 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2209c334-7788-4da6-8225-bd32723a535c req-690f8d94-1d1b-4d3b-aac1-3aea5d6fbd6b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:40.433499 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2209c334-7788-4da6-8225-bd32723a535c req-690f8d94-1d1b-4d3b-aac1-3aea5d6fbd6b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:40.470627 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-2209c334-7788-4da6-8225-bd32723a535c req-690f8d94-1d1b-4d3b-aac1-3aea5d6fbd6b service nova] Creating event network-vif-unplugged:c45a2f3f-9db0-4c17-83e8-0cf4d8711aba for instance 51be811b-0bd6-4671-831a-ba5733764143 on n-h1-849328-3 Aug 24 10:28:40.483801 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-2209c334-7788-4da6-8225-bd32723a535c req-690f8d94-1d1b-4d3b-aac1-3aea5d6fbd6b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087265 Aug 24 10:28:40.489531 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1611/3618] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:28:40.499962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4dbeede5-e619-4701-8fab-5a78f4533d67 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:40.502369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4dbeede5-e619-4701-8fab-5a78f4533d67 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:40.517410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4dbeede5-e619-4701-8fab-5a78f4533d67 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:40.518137 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4dbeede5-e619-4701-8fab-5a78f4533d67 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:40.518851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4dbeede5-e619-4701-8fab-5a78f4533d67 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:40.519938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4dbeede5-e619-4701-8fab-5a78f4533d67 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:40.522480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4dbeede5-e619-4701-8fab-5a78f4533d67 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:40.523474 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4dbeede5-e619-4701-8fab-5a78f4533d67 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:40.842124 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d87cedd4-7ad4-4512-b0e0-463349df2c03 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:40.854622 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d87cedd4-7ad4-4512-b0e0-463349df2c03 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1524 microversion: 2.1 time: 0.787683 Aug 24 10:28:40.858675 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2008/3619] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:40 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1524 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:28:40.863740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c736552f-4827-4bee-8801-769b10bc8a0b tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f4654688040>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:40.944994 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c736552f-4827-4bee-8801-769b10bc8a0b tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255" status: 200 len: 1426 microversion: 2.1 time: 0.085004 Aug 24 10:28:40.945754 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2009/3620] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:40 2022] GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255 => generated 1426 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:41.416162 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dcd84788-3ea2-4eb3-8782-9dd3512b9f93 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:41.418374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dcd84788-3ea2-4eb3-8782-9dd3512b9f93 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:41.433693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcd84788-3ea2-4eb3-8782-9dd3512b9f93 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:41.443880 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcd84788-3ea2-4eb3-8782-9dd3512b9f93 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:41.445822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcd84788-3ea2-4eb3-8782-9dd3512b9f93 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:41.447051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcd84788-3ea2-4eb3-8782-9dd3512b9f93 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:41.449183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcd84788-3ea2-4eb3-8782-9dd3512b9f93 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:41.450515 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcd84788-3ea2-4eb3-8782-9dd3512b9f93 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:41.716249 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4dbeede5-e619-4701-8fab-5a78f4533d67 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:41.770807 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4dbeede5-e619-4701-8fab-5a78f4533d67 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f" status: 200 len: 1315 microversion: 2.1 time: 1.278760 Aug 24 10:28:41.781612 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1612/3621] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:40 2022] GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f => generated 1315 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:41.864675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dcd84788-3ea2-4eb3-8782-9dd3512b9f93 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:41.877703 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dcd84788-3ea2-4eb3-8782-9dd3512b9f93 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1317 microversion: 2.1 time: 0.462656 Aug 24 10:28:41.878358 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2010/3622] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:41 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1317 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:41.915413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-359377d5-43ab-4a4b-9fe7-8c877af4eb7f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:41.921981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-359377d5-43ab-4a4b-9fe7-8c877af4eb7f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:41.930092 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-359377d5-43ab-4a4b-9fe7-8c877af4eb7f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:41.930778 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-359377d5-43ab-4a4b-9fe7-8c877af4eb7f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:41.931422 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-359377d5-43ab-4a4b-9fe7-8c877af4eb7f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:41.932488 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-359377d5-43ab-4a4b-9fe7-8c877af4eb7f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:41.933720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-359377d5-43ab-4a4b-9fe7-8c877af4eb7f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:41.935309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-359377d5-43ab-4a4b-9fe7-8c877af4eb7f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:41.961825 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1602aeae-a027-4dfa-988b-97e52beb82e6 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f4654c9daf0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:42.042825 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1602aeae-a027-4dfa-988b-97e52beb82e6 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255" status: 200 len: 1426 microversion: 2.1 time: 0.085491 Aug 24 10:28:42.045899 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2011/3623] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:41 2022] GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255 => generated 1426 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:28:42.287663 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-359377d5-43ab-4a4b-9fe7-8c877af4eb7f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:42.307153 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-359377d5-43ab-4a4b-9fe7-8c877af4eb7f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1504 microversion: 2.1 time: 0.430695 Aug 24 10:28:42.341994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-554c3182-1a8e-44e6-8ff0-92c1ad70e706 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Action: 'create', calling method: .version_select at 0x7f46546d2820>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1335447106", "description": "tempest-description-109948074"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:42.351842 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1613/3624] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:41 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1504 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:28:42.519915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-f9cf1a6a-a5e0-4772-b03d-d56f46b2d66c req-55d9b3d0-42eb-4aab-9a29-669d88afc800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ade0e12-9ac0-459f-8f85-6743432302fa", "tag": "e3d5d84f-2aa7-4b85-b98f-cb04738cac08"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:42.534437 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f9cf1a6a-a5e0-4772-b03d-d56f46b2d66c req-55d9b3d0-42eb-4aab-9a29-669d88afc800 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:42.535131 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f9cf1a6a-a5e0-4772-b03d-d56f46b2d66c req-55d9b3d0-42eb-4aab-9a29-669d88afc800 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:42.536238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f9cf1a6a-a5e0-4772-b03d-d56f46b2d66c req-55d9b3d0-42eb-4aab-9a29-669d88afc800 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:42.555137 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-f9cf1a6a-a5e0-4772-b03d-d56f46b2d66c req-55d9b3d0-42eb-4aab-9a29-669d88afc800 service nova] Creating event network-changed:e3d5d84f-2aa7-4b85-b98f-cb04738cac08 for instance 1ade0e12-9ac0-459f-8f85-6743432302fa on n-h1-849328-3 Aug 24 10:28:42.566490 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-f9cf1a6a-a5e0-4772-b03d-d56f46b2d66c req-55d9b3d0-42eb-4aab-9a29-669d88afc800 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051745 Aug 24 10:28:42.568484 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1614/3625] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:28:42.804630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c01a2e77-f0ad-495c-a357-0f7ec6d3867e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:42.806183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c01a2e77-f0ad-495c-a357-0f7ec6d3867e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:42.819235 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c01a2e77-f0ad-495c-a357-0f7ec6d3867e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:42.819747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c01a2e77-f0ad-495c-a357-0f7ec6d3867e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:42.825833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c01a2e77-f0ad-495c-a357-0f7ec6d3867e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:42.826603 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c01a2e77-f0ad-495c-a357-0f7ec6d3867e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:42.827084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c01a2e77-f0ad-495c-a357-0f7ec6d3867e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:42.827521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c01a2e77-f0ad-495c-a357-0f7ec6d3867e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:43.315654 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-554c3182-1a8e-44e6-8ff0-92c1ad70e706 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.987524 Aug 24 10:28:43.316281 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2012/3626] 10.222.0.85 () {60 vars in 1180 bytes} [Wed Aug 24 10:28:42 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:28:43.329465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-70d89ed9-0204-49cf-aaad-b039c8649de5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:43.330455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-70d89ed9-0204-49cf-aaad-b039c8649de5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:43.342442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70d89ed9-0204-49cf-aaad-b039c8649de5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:43.347976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70d89ed9-0204-49cf-aaad-b039c8649de5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:43.348360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70d89ed9-0204-49cf-aaad-b039c8649de5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:43.349301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70d89ed9-0204-49cf-aaad-b039c8649de5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:43.349900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70d89ed9-0204-49cf-aaad-b039c8649de5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:43.350222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70d89ed9-0204-49cf-aaad-b039c8649de5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:43.638447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-70d89ed9-0204-49cf-aaad-b039c8649de5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:43.654773 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-70d89ed9-0204-49cf-aaad-b039c8649de5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1317 microversion: 2.1 time: 0.330574 Aug 24 10:28:43.669030 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2013/3627] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:43 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1317 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:43.674267 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-59d50616-818d-42d9-aed3-f298962e714b tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f465516c670>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:43.767541 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-59d50616-818d-42d9-aed3-f298962e714b tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255" status: 200 len: 1426 microversion: 2.1 time: 0.096720 Aug 24 10:28:43.767839 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2014/3628] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:43 2022] GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255 => generated 1426 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:43.780780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-35a2e716-a91b-4c08-ad9f-246736e3fe9c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1335447106"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:43.781298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-35a2e716-a91b-4c08-ad9f-246736e3fe9c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:43.795525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35a2e716-a91b-4c08-ad9f-246736e3fe9c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:43.796129 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35a2e716-a91b-4c08-ad9f-246736e3fe9c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:43.796571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35a2e716-a91b-4c08-ad9f-246736e3fe9c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:43.797325 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35a2e716-a91b-4c08-ad9f-246736e3fe9c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:43.797772 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35a2e716-a91b-4c08-ad9f-246736e3fe9c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:43.798342 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35a2e716-a91b-4c08-ad9f-246736e3fe9c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:43.818220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c01a2e77-f0ad-495c-a357-0f7ec6d3867e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:43.833766 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c01a2e77-f0ad-495c-a357-0f7ec6d3867e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f" status: 200 len: 1315 microversion: 2.1 time: 1.034190 Aug 24 10:28:43.856576 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1615/3629] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:42 2022] GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f => generated 1315 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:28:44.118673 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.network.security_group_api [None req-35a2e716-a91b-4c08-ad9f-246736e3fe9c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Adding security group 1e6e34a4-2ed9-4318-bd71-6f23e8ed7411 to port d5ccc17d-296b-4e00-ae9b-8f26eb42f6ec Aug 24 10:28:44.674916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1c9d517a-2972-4b77-9d64-841e29a04e5c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:44.675741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1c9d517a-2972-4b77-9d64-841e29a04e5c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:44.684732 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c9d517a-2972-4b77-9d64-841e29a04e5c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:44.693771 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c9d517a-2972-4b77-9d64-841e29a04e5c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:44.694589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c9d517a-2972-4b77-9d64-841e29a04e5c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:44.695639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c9d517a-2972-4b77-9d64-841e29a04e5c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:44.696329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c9d517a-2972-4b77-9d64-841e29a04e5c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:44.703544 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c9d517a-2972-4b77-9d64-841e29a04e5c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:44.940756 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-35a2e716-a91b-4c08-ad9f-246736e3fe9c tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "POST /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d/action" status: 202 len: 0 microversion: 2.1 time: 1.171356 Aug 24 10:28:44.941769 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2015/3630] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:28:43 2022] POST /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d/action => generated 0 bytes in 1173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:28:44.950693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3068d943-ae66-43d2-9c60-1efa4a48b1dc tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f4655073940>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:45.052336 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3068d943-ae66-43d2-9c60-1efa4a48b1dc tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255" status: 200 len: 1426 microversion: 2.1 time: 0.108709 Aug 24 10:28:45.060191 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2016/3631] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:44 2022] GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255 => generated 1426 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:45.070506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d7e589c0-09da-4884-b881-94892f20bdc6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:45.087873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d7e589c0-09da-4884-b881-94892f20bdc6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:45.107592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7e589c0-09da-4884-b881-94892f20bdc6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:45.121032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7e589c0-09da-4884-b881-94892f20bdc6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:45.124567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7e589c0-09da-4884-b881-94892f20bdc6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:45.128107 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7e589c0-09da-4884-b881-94892f20bdc6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:45.129664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7e589c0-09da-4884-b881-94892f20bdc6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:45.132334 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7e589c0-09da-4884-b881-94892f20bdc6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:45.563843 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d7e589c0-09da-4884-b881-94892f20bdc6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:45.585651 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d7e589c0-09da-4884-b881-94892f20bdc6 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f" status: 200 len: 1315 microversion: 2.1 time: 0.523701 Aug 24 10:28:45.588216 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2017/3632] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:45 2022] GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:45.594230 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-76774111-c7fb-4377-bdd2-9f3304b1a7f1 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1335447106"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:45.595151 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-76774111-c7fb-4377-bdd2-9f3304b1a7f1 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:45.613413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76774111-c7fb-4377-bdd2-9f3304b1a7f1 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:45.618121 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76774111-c7fb-4377-bdd2-9f3304b1a7f1 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:45.625363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76774111-c7fb-4377-bdd2-9f3304b1a7f1 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:45.628064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76774111-c7fb-4377-bdd2-9f3304b1a7f1 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:45.628845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76774111-c7fb-4377-bdd2-9f3304b1a7f1 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:45.630715 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76774111-c7fb-4377-bdd2-9f3304b1a7f1 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:46.265339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1c9d517a-2972-4b77-9d64-841e29a04e5c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:46.277910 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1c9d517a-2972-4b77-9d64-841e29a04e5c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1317 microversion: 2.1 time: 1.606947 Aug 24 10:28:46.279127 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1616/3633] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:44 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1317 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:46.285537 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-376b86cf-71fe-4799-8b9e-23ceac0aea74 req-18c2c149-5d7b-4c69-bbc0-3f27da027961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a501f37-7cb0-4d7d-a95b-03f7aed77f9d", "tag": "d5ccc17d-296b-4e00-ae9b-8f26eb42f6ec"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:46.314193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-376b86cf-71fe-4799-8b9e-23ceac0aea74 req-18c2c149-5d7b-4c69-bbc0-3f27da027961 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:46.314604 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.network.security_group_api [None req-76774111-c7fb-4377-bdd2-9f3304b1a7f1 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Removing security group 1e6e34a4-2ed9-4318-bd71-6f23e8ed7411 from port d5ccc17d-296b-4e00-ae9b-8f26eb42f6ec Aug 24 10:28:46.315035 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-376b86cf-71fe-4799-8b9e-23ceac0aea74 req-18c2c149-5d7b-4c69-bbc0-3f27da027961 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:46.315515 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-376b86cf-71fe-4799-8b9e-23ceac0aea74 req-18c2c149-5d7b-4c69-bbc0-3f27da027961 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:46.339394 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-376b86cf-71fe-4799-8b9e-23ceac0aea74 req-18c2c149-5d7b-4c69-bbc0-3f27da027961 service nova] Creating event network-changed:d5ccc17d-296b-4e00-ae9b-8f26eb42f6ec for instance 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d on n-h2-849328-3 Aug 24 10:28:46.356666 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-376b86cf-71fe-4799-8b9e-23ceac0aea74 req-18c2c149-5d7b-4c69-bbc0-3f27da027961 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073995 Aug 24 10:28:46.358084 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1617/3634] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:28:46.372442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-708953d8-574c-4b0b-a039-3268262d1f50 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f46541d6940>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:46.443914 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-708953d8-574c-4b0b-a039-3268262d1f50 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255" status: 200 len: 1426 microversion: 2.1 time: 0.083886 Aug 24 10:28:46.445150 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1618/3635] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:46 2022] GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255 => generated 1426 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:46.607792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-97195246-b600-4ff0-ac98-29c21a2c7e6f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:46.608577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-97195246-b600-4ff0-ac98-29c21a2c7e6f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:46.626758 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97195246-b600-4ff0-ac98-29c21a2c7e6f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:46.626758 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97195246-b600-4ff0-ac98-29c21a2c7e6f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:46.627324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97195246-b600-4ff0-ac98-29c21a2c7e6f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:46.628048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97195246-b600-4ff0-ac98-29c21a2c7e6f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:46.628506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97195246-b600-4ff0-ac98-29c21a2c7e6f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:46.629010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97195246-b600-4ff0-ac98-29c21a2c7e6f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:47.109654 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-97195246-b600-4ff0-ac98-29c21a2c7e6f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:47.117830 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-97195246-b600-4ff0-ac98-29c21a2c7e6f tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f" status: 200 len: 1315 microversion: 2.1 time: 0.513673 Aug 24 10:28:47.118300 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1619/3636] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:46 2022] GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f => generated 1315 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:28:47.299296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-16069f4c-037d-49dd-8e59-f97a984a02c7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:47.299924 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-16069f4c-037d-49dd-8e59-f97a984a02c7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:47.311172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16069f4c-037d-49dd-8e59-f97a984a02c7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:47.311677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16069f4c-037d-49dd-8e59-f97a984a02c7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:47.312115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16069f4c-037d-49dd-8e59-f97a984a02c7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:47.312839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16069f4c-037d-49dd-8e59-f97a984a02c7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:47.313639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16069f4c-037d-49dd-8e59-f97a984a02c7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:47.314064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16069f4c-037d-49dd-8e59-f97a984a02c7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:47.813457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-16069f4c-037d-49dd-8e59-f97a984a02c7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:47.840091 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-16069f4c-037d-49dd-8e59-f97a984a02c7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1317 microversion: 2.1 time: 0.543543 Aug 24 10:28:47.859346 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1620/3637] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:47 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1317 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:28:47.874577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1e00ff22-8a92-41f6-a446-6c9d226c3a53 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f46541cd5e0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:47.961738 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1e00ff22-8a92-41f6-a446-6c9d226c3a53 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255" status: 200 len: 1426 microversion: 2.1 time: 0.099219 Aug 24 10:28:47.964710 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1621/3638] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:47 2022] GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255 => generated 1426 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:48.143806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aee29aeb-39d4-474c-9471-f5c69f129297 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:48.147181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aee29aeb-39d4-474c-9471-f5c69f129297 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:48.185149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aee29aeb-39d4-474c-9471-f5c69f129297 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:48.186104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aee29aeb-39d4-474c-9471-f5c69f129297 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:48.186877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aee29aeb-39d4-474c-9471-f5c69f129297 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:48.197535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aee29aeb-39d4-474c-9471-f5c69f129297 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:48.201023 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aee29aeb-39d4-474c-9471-f5c69f129297 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:48.205100 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aee29aeb-39d4-474c-9471-f5c69f129297 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:48.604620 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aee29aeb-39d4-474c-9471-f5c69f129297 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:48.632588 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aee29aeb-39d4-474c-9471-f5c69f129297 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f" status: 200 len: 1315 microversion: 2.1 time: 0.495812 Aug 24 10:28:48.661915 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1622/3639] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:48 2022] GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f => generated 1315 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:28:48.835236 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-76774111-c7fb-4377-bdd2-9f3304b1a7f1 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "POST /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d/action" status: 202 len: 0 microversion: 2.1 time: 3.244814 Aug 24 10:28:48.836925 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2018/3640] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:28:45 2022] POST /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d/action => generated 0 bytes in 3247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:28:48.855081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f845428a-80ed-4ecd-b192-35064a2fd11b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Action: 'create', calling method: .version_select at 0x7f4655837430>, body: {"pool": null} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:48.869694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-960eeb0d-9027-4038-9e3e-840c14a49235 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:48.870372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-960eeb0d-9027-4038-9e3e-840c14a49235 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:48.893406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-960eeb0d-9027-4038-9e3e-840c14a49235 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:48.894081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-960eeb0d-9027-4038-9e3e-840c14a49235 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:48.896035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-960eeb0d-9027-4038-9e3e-840c14a49235 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:48.901808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-960eeb0d-9027-4038-9e3e-840c14a49235 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:48.903202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-960eeb0d-9027-4038-9e3e-840c14a49235 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:48.904579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-960eeb0d-9027-4038-9e3e-840c14a49235 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:49.341850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-960eeb0d-9027-4038-9e3e-840c14a49235 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:49.381426 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-960eeb0d-9027-4038-9e3e-840c14a49235 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1317 microversion: 2.1 time: 0.515122 Aug 24 10:28:49.386537 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2019/3641] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:48 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:49.418922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-bec43e29-b7b6-4937-bccc-3c5b415c2b68 req-4b0f286a-9f8f-4b5e-afd7-9445890a6aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a501f37-7cb0-4d7d-a95b-03f7aed77f9d", "tag": "d5ccc17d-296b-4e00-ae9b-8f26eb42f6ec"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:49.448508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bec43e29-b7b6-4937-bccc-3c5b415c2b68 req-4b0f286a-9f8f-4b5e-afd7-9445890a6aa4 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:49.449874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bec43e29-b7b6-4937-bccc-3c5b415c2b68 req-4b0f286a-9f8f-4b5e-afd7-9445890a6aa4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:49.456429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bec43e29-b7b6-4937-bccc-3c5b415c2b68 req-4b0f286a-9f8f-4b5e-afd7-9445890a6aa4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:49.489997 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-bec43e29-b7b6-4937-bccc-3c5b415c2b68 req-4b0f286a-9f8f-4b5e-afd7-9445890a6aa4 service nova] Creating event network-changed:d5ccc17d-296b-4e00-ae9b-8f26eb42f6ec for instance 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d on n-h2-849328-3 Aug 24 10:28:49.496193 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-bec43e29-b7b6-4937-bccc-3c5b415c2b68 req-4b0f286a-9f8f-4b5e-afd7-9445890a6aa4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105662 Aug 24 10:28:49.497761 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2020/3642] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:28:49.505987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-68c27fa6-a9fa-47c7-b2c3-57f080b6eac9 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f465a2078b0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:49.566916 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-68c27fa6-a9fa-47c7-b2c3-57f080b6eac9 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255" status: 200 len: 1426 microversion: 2.1 time: 0.067312 Aug 24 10:28:49.568305 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2021/3643] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:49 2022] GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255 => generated 1426 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:49.573715 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-f6f578d5-6d3f-492e-9900-ca36a465b316 req-935a6d81-3a92-456c-810e-7fb8af418c79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c62a85-d3f8-4b01-af30-cc3d15ba08ab", "name": "network-vif-plugged", "status": "completed", "tag": "00d18df2-80be-44f5-bf00-939583d9cbf9"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:49.588798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f6f578d5-6d3f-492e-9900-ca36a465b316 req-935a6d81-3a92-456c-810e-7fb8af418c79 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:49.589319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f6f578d5-6d3f-492e-9900-ca36a465b316 req-935a6d81-3a92-456c-810e-7fb8af418c79 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:49.589763 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f6f578d5-6d3f-492e-9900-ca36a465b316 req-935a6d81-3a92-456c-810e-7fb8af418c79 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:49.628116 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-f6f578d5-6d3f-492e-9900-ca36a465b316 req-935a6d81-3a92-456c-810e-7fb8af418c79 service nova] Creating event network-vif-plugged:00d18df2-80be-44f5-bf00-939583d9cbf9 for instance 94c62a85-d3f8-4b01-af30-cc3d15ba08ab on n-h1-849328-3 Aug 24 10:28:49.641011 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-f6f578d5-6d3f-492e-9900-ca36a465b316 req-935a6d81-3a92-456c-810e-7fb8af418c79 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070958 Aug 24 10:28:49.646060 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2022/3644] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:28:49.674618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0bf72022-4184-4af0-9cac-dacc35c48a05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:49.675201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0bf72022-4184-4af0-9cac-dacc35c48a05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:49.698834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bf72022-4184-4af0-9cac-dacc35c48a05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:49.705236 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bf72022-4184-4af0-9cac-dacc35c48a05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:49.706054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bf72022-4184-4af0-9cac-dacc35c48a05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:49.707625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bf72022-4184-4af0-9cac-dacc35c48a05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:49.709729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bf72022-4184-4af0-9cac-dacc35c48a05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:49.711353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bf72022-4184-4af0-9cac-dacc35c48a05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:49.957979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0bf72022-4184-4af0-9cac-dacc35c48a05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:49.967606 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0bf72022-4184-4af0-9cac-dacc35c48a05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f" status: 200 len: 1315 microversion: 2.1 time: 0.297482 Aug 24 10:28:49.969179 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2023/3645] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:49 2022] GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:28:50.417684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8e49e157-a8c6-4392-8e5c-b487f2efa0ca tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:50.419312 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8e49e157-a8c6-4392-8e5c-b487f2efa0ca tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:50.433095 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e49e157-a8c6-4392-8e5c-b487f2efa0ca tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:50.433619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e49e157-a8c6-4392-8e5c-b487f2efa0ca tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:50.439324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e49e157-a8c6-4392-8e5c-b487f2efa0ca tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:50.443068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e49e157-a8c6-4392-8e5c-b487f2efa0ca tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:50.443560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e49e157-a8c6-4392-8e5c-b487f2efa0ca tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:50.444002 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e49e157-a8c6-4392-8e5c-b487f2efa0ca tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:51.148873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8e49e157-a8c6-4392-8e5c-b487f2efa0ca tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:51.175257 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8e49e157-a8c6-4392-8e5c-b487f2efa0ca tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1317 microversion: 2.1 time: 0.762179 Aug 24 10:28:51.191563 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2024/3646] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:50 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1317 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:51.215596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-80938b57-8e76-4d3a-b836-55b8b37e710c tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f465522ca60>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:51.311712 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-80938b57-8e76-4d3a-b836-55b8b37e710c tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255" status: 200 len: 1426 microversion: 2.1 time: 0.108701 Aug 24 10:28:51.319776 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2025/3647] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:51 2022] GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255 => generated 1426 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:51.326421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c14c816f-f205-458e-8899-b9fff0dcc355 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:51.328119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c14c816f-f205-458e-8899-b9fff0dcc355 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:51.335143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c14c816f-f205-458e-8899-b9fff0dcc355 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:51.338399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c14c816f-f205-458e-8899-b9fff0dcc355 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:51.339204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c14c816f-f205-458e-8899-b9fff0dcc355 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:51.342847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c14c816f-f205-458e-8899-b9fff0dcc355 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:51.343640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c14c816f-f205-458e-8899-b9fff0dcc355 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:51.344255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c14c816f-f205-458e-8899-b9fff0dcc355 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:51.943860 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c14c816f-f205-458e-8899-b9fff0dcc355 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:51.952833 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c14c816f-f205-458e-8899-b9fff0dcc355 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f" status: 200 len: 1315 microversion: 2.1 time: 0.631363 Aug 24 10:28:51.960206 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2026/3648] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:51 2022] GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f => generated 1315 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:51.972917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-190812e8-bbed-41bf-9663-d1112edf9c5e req-d81d5234-2c58-4f73-86b6-55a0ef20ad38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51be811b-0bd6-4671-831a-ba5733764143", "name": "network-vif-plugged", "status": "completed", "tag": "c45a2f3f-9db0-4c17-83e8-0cf4d8711aba"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:52.005295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-190812e8-bbed-41bf-9663-d1112edf9c5e req-d81d5234-2c58-4f73-86b6-55a0ef20ad38 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:52.006124 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-190812e8-bbed-41bf-9663-d1112edf9c5e req-d81d5234-2c58-4f73-86b6-55a0ef20ad38 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:52.006749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-190812e8-bbed-41bf-9663-d1112edf9c5e req-d81d5234-2c58-4f73-86b6-55a0ef20ad38 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:52.046368 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-190812e8-bbed-41bf-9663-d1112edf9c5e req-d81d5234-2c58-4f73-86b6-55a0ef20ad38 service nova] Creating event network-vif-plugged:c45a2f3f-9db0-4c17-83e8-0cf4d8711aba for instance 51be811b-0bd6-4671-831a-ba5733764143 on n-h1-849328-3 Aug 24 10:28:52.064099 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-190812e8-bbed-41bf-9663-d1112edf9c5e req-d81d5234-2c58-4f73-86b6-55a0ef20ad38 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101482 Aug 24 10:28:52.067413 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2027/3649] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:28:52.218254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7645342e-8f9e-44db-b2d1-228c9556899a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:52.219104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7645342e-8f9e-44db-b2d1-228c9556899a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:52.242849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7645342e-8f9e-44db-b2d1-228c9556899a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:52.243350 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7645342e-8f9e-44db-b2d1-228c9556899a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:52.243792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7645342e-8f9e-44db-b2d1-228c9556899a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:52.244509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7645342e-8f9e-44db-b2d1-228c9556899a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:52.244967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7645342e-8f9e-44db-b2d1-228c9556899a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:52.259058 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7645342e-8f9e-44db-b2d1-228c9556899a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:52.778948 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7645342e-8f9e-44db-b2d1-228c9556899a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:52.794040 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7645342e-8f9e-44db-b2d1-228c9556899a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1506 microversion: 2.1 time: 0.589216 Aug 24 10:28:52.795117 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2028/3650] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:52 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1506 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:52.800518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fc8f9b4b-f342-4102-9de3-c77af4ce03c9 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f465a2078b0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:52.888191 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fc8f9b4b-f342-4102-9de3-c77af4ce03c9 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255" status: 200 len: 1426 microversion: 2.1 time: 0.091830 Aug 24 10:28:52.889438 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2029/3651] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:52 2022] GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255 => generated 1426 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:52.897441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ef86d77d-9ed8-4a0b-b7c9-5da9b36b8d7d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:52.898267 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ef86d77d-9ed8-4a0b-b7c9-5da9b36b8d7d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:52.907422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef86d77d-9ed8-4a0b-b7c9-5da9b36b8d7d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:52.908120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef86d77d-9ed8-4a0b-b7c9-5da9b36b8d7d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:52.908738 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef86d77d-9ed8-4a0b-b7c9-5da9b36b8d7d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:52.909885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef86d77d-9ed8-4a0b-b7c9-5da9b36b8d7d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:52.910531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef86d77d-9ed8-4a0b-b7c9-5da9b36b8d7d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:52.911131 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef86d77d-9ed8-4a0b-b7c9-5da9b36b8d7d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:53.489572 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f845428a-80ed-4ecd-b192-35064a2fd11b tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.644540 Aug 24 10:28:53.492512 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1623/3652] 10.222.0.85 () {60 vars in 1170 bytes} [Wed Aug 24 10:28:48 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:28:53.498638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-51eefc5d-8bb6-414f-8e8b-75914c148f55 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:53.499491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-51eefc5d-8bb6-414f-8e8b-75914c148f55 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:53.543262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51eefc5d-8bb6-414f-8e8b-75914c148f55 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:53.544991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51eefc5d-8bb6-414f-8e8b-75914c148f55 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:53.546045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51eefc5d-8bb6-414f-8e8b-75914c148f55 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:53.550266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51eefc5d-8bb6-414f-8e8b-75914c148f55 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:53.551096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51eefc5d-8bb6-414f-8e8b-75914c148f55 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:53.552328 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51eefc5d-8bb6-414f-8e8b-75914c148f55 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:53.763607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ef86d77d-9ed8-4a0b-b7c9-5da9b36b8d7d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:53.776069 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ef86d77d-9ed8-4a0b-b7c9-5da9b36b8d7d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1506 microversion: 2.1 time: 0.885373 Aug 24 10:28:53.777303 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2030/3653] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:52 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1506 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:53.782478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8687bdb9-7ab3-4b61-939d-1c9e34b499b4 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.232"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:53.785144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8687bdb9-7ab3-4b61-939d-1c9e34b499b4 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:53.792142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8687bdb9-7ab3-4b61-939d-1c9e34b499b4 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:53.793214 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8687bdb9-7ab3-4b61-939d-1c9e34b499b4 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:53.793909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8687bdb9-7ab3-4b61-939d-1c9e34b499b4 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:53.794898 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8687bdb9-7ab3-4b61-939d-1c9e34b499b4 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:53.795591 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8687bdb9-7ab3-4b61-939d-1c9e34b499b4 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:53.796248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8687bdb9-7ab3-4b61-939d-1c9e34b499b4 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:53.829159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8687bdb9-7ab3-4b61-939d-1c9e34b499b4 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "refresh_cache-0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 10:28:53.832742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8687bdb9-7ab3-4b61-939d-1c9e34b499b4 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquired lock "refresh_cache-0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 10:28:54.393471 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-51eefc5d-8bb6-414f-8e8b-75914c148f55 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:54.410676 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-51eefc5d-8bb6-414f-8e8b-75914c148f55 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f" status: 200 len: 1315 microversion: 2.1 time: 0.916694 Aug 24 10:28:54.412281 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1624/3654] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:53 2022] GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f => generated 1315 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:54.425311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d3da82ed-48af-45dd-8b50-d9a154d6e09e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:54.433768 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d3da82ed-48af-45dd-8b50-d9a154d6e09e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:54.452875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3da82ed-48af-45dd-8b50-d9a154d6e09e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:54.453667 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3da82ed-48af-45dd-8b50-d9a154d6e09e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:54.454127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3da82ed-48af-45dd-8b50-d9a154d6e09e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:54.455109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3da82ed-48af-45dd-8b50-d9a154d6e09e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:54.455565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3da82ed-48af-45dd-8b50-d9a154d6e09e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:54.457192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3da82ed-48af-45dd-8b50-d9a154d6e09e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:54.618482 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d3da82ed-48af-45dd-8b50-d9a154d6e09e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "PUT /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1078 microversion: 2.1 time: 0.202132 Aug 24 10:28:54.621595 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1625/3655] 10.222.0.85 () {60 vars in 1256 bytes} [Wed Aug 24 10:28:54 2022] PUT /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1078 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:54.631836 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-36f75a97-ba36-439a-84f5-1ab3255bcd07 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f465a2acdc0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:54.758149 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-36f75a97-ba36-439a-84f5-1ab3255bcd07 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255" status: 200 len: 1426 microversion: 2.1 time: 0.135074 Aug 24 10:28:54.761056 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1626/3656] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:54 2022] GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255 => generated 1426 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:54.774028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-4b029482-ab4f-4dd7-989d-886fc1db8963 req-a50827d5-6920-47d6-8416-d444f3da4422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b04bfa6-2a69-479e-bd7e-93e7838e098f", "name": "network-vif-plugged", "status": "completed", "tag": "1a18a2b7-d4b7-4b98-8182-fb76091d43a4"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:54.825684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4b029482-ab4f-4dd7-989d-886fc1db8963 req-a50827d5-6920-47d6-8416-d444f3da4422 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:54.827682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4b029482-ab4f-4dd7-989d-886fc1db8963 req-a50827d5-6920-47d6-8416-d444f3da4422 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:54.828134 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4b029482-ab4f-4dd7-989d-886fc1db8963 req-a50827d5-6920-47d6-8416-d444f3da4422 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:54.853287 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-4b029482-ab4f-4dd7-989d-886fc1db8963 req-a50827d5-6920-47d6-8416-d444f3da4422 service nova] Creating event network-vif-plugged:1a18a2b7-d4b7-4b98-8182-fb76091d43a4 for instance 6b04bfa6-2a69-479e-bd7e-93e7838e098f on n-h2-849328-3 Aug 24 10:28:54.891796 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-4b029482-ab4f-4dd7-989d-886fc1db8963 req-a50827d5-6920-47d6-8416-d444f3da4422 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105524 Aug 24 10:28:54.896419 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1627/3657] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:28:54.929858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-03866d89-ec83-4551-8baf-eac3c735bb2c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:54.930702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-03866d89-ec83-4551-8baf-eac3c735bb2c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:54.959473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03866d89-ec83-4551-8baf-eac3c735bb2c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:54.960299 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03866d89-ec83-4551-8baf-eac3c735bb2c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:54.961703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03866d89-ec83-4551-8baf-eac3c735bb2c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:54.962872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03866d89-ec83-4551-8baf-eac3c735bb2c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:54.965473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03866d89-ec83-4551-8baf-eac3c735bb2c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:54.966210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03866d89-ec83-4551-8baf-eac3c735bb2c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:55.563956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-03866d89-ec83-4551-8baf-eac3c735bb2c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:55.574866 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-03866d89-ec83-4551-8baf-eac3c735bb2c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1504 microversion: 2.1 time: 0.672783 Aug 24 10:28:55.583064 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1628/3658] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:54 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1504 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:55.600224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6053c5d9-758b-4792-9be7-9d0116d8f688 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:55.601011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6053c5d9-758b-4792-9be7-9d0116d8f688 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:55.614408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6053c5d9-758b-4792-9be7-9d0116d8f688 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:55.622580 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6053c5d9-758b-4792-9be7-9d0116d8f688 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:55.623672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6053c5d9-758b-4792-9be7-9d0116d8f688 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:55.624596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6053c5d9-758b-4792-9be7-9d0116d8f688 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:55.625249 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6053c5d9-758b-4792-9be7-9d0116d8f688 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:55.625864 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6053c5d9-758b-4792-9be7-9d0116d8f688 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:56.297712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6053c5d9-758b-4792-9be7-9d0116d8f688 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:56.306258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:56.329210 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6053c5d9-758b-4792-9be7-9d0116d8f688 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f" status: 200 len: 1315 microversion: 2.1 time: 0.742799 Aug 24 10:28:56.332385 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1629/3659] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:55 2022] GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f => generated 1315 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:56.354698 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8e092bae-8490-4521-96d0-ed1b4ecda881 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:56.357914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8e092bae-8490-4521-96d0-ed1b4ecda881 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:56.398474 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e092bae-8490-4521-96d0-ed1b4ecda881 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:56.403217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e092bae-8490-4521-96d0-ed1b4ecda881 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:56.405954 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e092bae-8490-4521-96d0-ed1b4ecda881 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:56.411493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e092bae-8490-4521-96d0-ed1b4ecda881 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:56.412266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e092bae-8490-4521-96d0-ed1b4ecda881 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:56.412470 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e092bae-8490-4521-96d0-ed1b4ecda881 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:56.794379 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8e092bae-8490-4521-96d0-ed1b4ecda881 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:56.825683 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8e092bae-8490-4521-96d0-ed1b4ecda881 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1504 microversion: 2.1 time: 0.482107 Aug 24 10:28:56.830126 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1630/3660] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:56 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1504 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:56.855478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-14dfd8d5-334d-4d13-88e2-a8fa464ff23c tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f4654167670>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:56.962727 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-14dfd8d5-334d-4d13-88e2-a8fa464ff23c tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255" status: 200 len: 1426 microversion: 2.1 time: 0.127434 Aug 24 10:28:56.966383 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1631/3661] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:56 2022] GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255 => generated 1426 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:56.987943 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9ad3cae0-f310-4409-9e13-1f13a214b17a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:57.006104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9ad3cae0-f310-4409-9e13-1f13a214b17a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:57.025832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=92 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:57.032710 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ad3cae0-f310-4409-9e13-1f13a214b17a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:57.035988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ad3cae0-f310-4409-9e13-1f13a214b17a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:57.038596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ad3cae0-f310-4409-9e13-1f13a214b17a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:57.042071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ad3cae0-f310-4409-9e13-1f13a214b17a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:57.043153 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ad3cae0-f310-4409-9e13-1f13a214b17a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:57.045301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ad3cae0-f310-4409-9e13-1f13a214b17a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:57.326076 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9ad3cae0-f310-4409-9e13-1f13a214b17a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:28:57.327328 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9ad3cae0-f310-4409-9e13-1f13a214b17a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:28:57.328327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9ad3cae0-f310-4409-9e13-1f13a214b17a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:28:57.329004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9ad3cae0-f310-4409-9e13-1f13a214b17a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:28:57.330102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9ad3cae0-f310-4409-9e13-1f13a214b17a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:28:57.548317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9ad3cae0-f310-4409-9e13-1f13a214b17a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:57.575123 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ad3cae0-f310-4409-9e13-1f13a214b17a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:57.577984 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ad3cae0-f310-4409-9e13-1f13a214b17a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:57.581084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ad3cae0-f310-4409-9e13-1f13a214b17a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:57.583034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ad3cae0-f310-4409-9e13-1f13a214b17a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:57.583933 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ad3cae0-f310-4409-9e13-1f13a214b17a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:57.585690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ad3cae0-f310-4409-9e13-1f13a214b17a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:57.651253 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9ad3cae0-f310-4409-9e13-1f13a214b17a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "POST /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab/action" status: 202 len: 1110 microversion: 2.1 time: 0.682515 Aug 24 10:28:57.651981 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1632/3662] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:28:56 2022] POST /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab/action => generated 1110 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 10:28:57.677355 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5cfdc5dd-f1ec-4d23-a5f9-4bd1b994d65b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:57.678072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5cfdc5dd-f1ec-4d23-a5f9-4bd1b994d65b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:57.701554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cfdc5dd-f1ec-4d23-a5f9-4bd1b994d65b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:57.702105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cfdc5dd-f1ec-4d23-a5f9-4bd1b994d65b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:57.703197 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-8687bdb9-7ab3-4b61-939d-1c9e34b499b4 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Building network info cache for instance {{(pid=122433) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 10:28:57.704972 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cfdc5dd-f1ec-4d23-a5f9-4bd1b994d65b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:57.707468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cfdc5dd-f1ec-4d23-a5f9-4bd1b994d65b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:57.710249 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cfdc5dd-f1ec-4d23-a5f9-4bd1b994d65b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:57.711316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cfdc5dd-f1ec-4d23-a5f9-4bd1b994d65b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:58.192805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5cfdc5dd-f1ec-4d23-a5f9-4bd1b994d65b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:58.216326 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5cfdc5dd-f1ec-4d23-a5f9-4bd1b994d65b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f" status: 200 len: 1502 microversion: 2.1 time: 0.562836 Aug 24 10:28:58.223606 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1633/3663] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:57 2022] GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f => generated 1502 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:58.251741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-40bdd68c-17ee-4b1e-82bd-ceabe5e36604 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:58.252396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-40bdd68c-17ee-4b1e-82bd-ceabe5e36604 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:58.298657 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40bdd68c-17ee-4b1e-82bd-ceabe5e36604 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:58.299163 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40bdd68c-17ee-4b1e-82bd-ceabe5e36604 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:58.299635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40bdd68c-17ee-4b1e-82bd-ceabe5e36604 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:58.301066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40bdd68c-17ee-4b1e-82bd-ceabe5e36604 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:58.307926 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40bdd68c-17ee-4b1e-82bd-ceabe5e36604 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:58.309265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40bdd68c-17ee-4b1e-82bd-ceabe5e36604 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:59.097957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-40bdd68c-17ee-4b1e-82bd-ceabe5e36604 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:59.116352 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-40bdd68c-17ee-4b1e-82bd-ceabe5e36604 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1515 microversion: 2.1 time: 0.886007 Aug 24 10:28:59.121656 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1634/3664] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:58 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1515 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:59.134833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-4196253b-72ca-4892-957b-c1981941ab00 req-d4874292-de77-4f38-a871-5c5ac02fc83f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a501f37-7cb0-4d7d-a95b-03f7aed77f9d", "tag": "d5ccc17d-296b-4e00-ae9b-8f26eb42f6ec"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:59.173816 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4196253b-72ca-4892-957b-c1981941ab00 req-d4874292-de77-4f38-a871-5c5ac02fc83f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:59.179309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4196253b-72ca-4892-957b-c1981941ab00 req-d4874292-de77-4f38-a871-5c5ac02fc83f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:59.182467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4196253b-72ca-4892-957b-c1981941ab00 req-d4874292-de77-4f38-a871-5c5ac02fc83f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:59.277092 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-4196253b-72ca-4892-957b-c1981941ab00 req-d4874292-de77-4f38-a871-5c5ac02fc83f service nova] Creating event network-changed:d5ccc17d-296b-4e00-ae9b-8f26eb42f6ec for instance 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d on n-h2-849328-3 Aug 24 10:28:59.308535 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-4196253b-72ca-4892-957b-c1981941ab00 req-d4874292-de77-4f38-a871-5c5ac02fc83f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184871 Aug 24 10:28:59.312993 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1635/3665] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:28:59.348848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-776c9af0-f38f-4bf8-bb57-0f977f57c50a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f46541cd3a0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:59.513098 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-776c9af0-f38f-4bf8-bb57-0f977f57c50a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255" status: 200 len: 1426 microversion: 2.1 time: 0.177937 Aug 24 10:28:59.515344 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1636/3666] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:28:59 2022] GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255 => generated 1426 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:59.532146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-98e0841d-e688-486c-a795-5498289db06a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:59.536512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-98e0841d-e688-486c-a795-5498289db06a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:59.559487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98e0841d-e688-486c-a795-5498289db06a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:59.562658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98e0841d-e688-486c-a795-5498289db06a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:59.564053 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98e0841d-e688-486c-a795-5498289db06a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:59.574236 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98e0841d-e688-486c-a795-5498289db06a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:59.576913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98e0841d-e688-486c-a795-5498289db06a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:59.578692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98e0841d-e688-486c-a795-5498289db06a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:59.728636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-98e0841d-e688-486c-a795-5498289db06a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lazy-loading 'flavor' on Instance uuid 6b04bfa6-2a69-479e-bd7e-93e7838e098f {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:28:59.970189 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-98e0841d-e688-486c-a795-5498289db06a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "POST /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f/action" status: 202 len: 0 microversion: 2.1 time: 0.450173 Aug 24 10:28:59.971701 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1637/3667] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:28:59 2022] POST /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:28:59.984785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8d4c397f-a861-4d79-a2c1-3ade14d6122b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:59.985891 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8d4c397f-a861-4d79-a2c1-3ade14d6122b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:00.004579 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d4c397f-a861-4d79-a2c1-3ade14d6122b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:00.006614 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d4c397f-a861-4d79-a2c1-3ade14d6122b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:00.007667 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d4c397f-a861-4d79-a2c1-3ade14d6122b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:00.009112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d4c397f-a861-4d79-a2c1-3ade14d6122b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:00.012898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d4c397f-a861-4d79-a2c1-3ade14d6122b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:00.013649 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d4c397f-a861-4d79-a2c1-3ade14d6122b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:00.627649 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8d4c397f-a861-4d79-a2c1-3ade14d6122b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:00.643630 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8d4c397f-a861-4d79-a2c1-3ade14d6122b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f" status: 200 len: 1510 microversion: 2.1 time: 0.665464 Aug 24 10:29:00.656321 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1638/3668] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:59 2022] GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f => generated 1510 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:00.661662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e8942a91-f393-421d-bd7a-5c011d393dd9 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:00.662783 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e8942a91-f393-421d-bd7a-5c011d393dd9 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:00.681878 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8942a91-f393-421d-bd7a-5c011d393dd9 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:00.682837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8942a91-f393-421d-bd7a-5c011d393dd9 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:00.683498 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8942a91-f393-421d-bd7a-5c011d393dd9 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:00.684428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8942a91-f393-421d-bd7a-5c011d393dd9 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:00.685322 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8942a91-f393-421d-bd7a-5c011d393dd9 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:00.685984 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8942a91-f393-421d-bd7a-5c011d393dd9 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:00.980942 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-8687bdb9-7ab3-4b61-939d-1c9e34b499b4 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Updating instance_info_cache with network_info: [{"id": "d5ccc17d-296b-4e00-ae9b-8f26eb42f6ec", "address": "fa:16:3e:cb:55:a4", "network": {"id": "e672a0e9-6701-4eed-8b4e-431795420ea2", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1882465683-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8a932df7eb0b43fe9da0435cb6abeb4e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd5ccc17d-29", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122433) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 10:29:01.011610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8687bdb9-7ab3-4b61-939d-1c9e34b499b4 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Releasing lock "refresh_cache-0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 10:29:01.014274 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8687bdb9-7ab3-4b61-939d-1c9e34b499b4 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "POST /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d/action" status: 202 len: 0 microversion: 2.1 time: 7.235358 Aug 24 10:29:01.020098 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2031/3669] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:28:53 2022] POST /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d/action => generated 0 bytes in 7238 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 24 10:29:01.037950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8dab51a1-ae08-40de-a624-352807ecb3dd tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f4655092790>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:01.145500 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8dab51a1-ae08-40de-a624-352807ecb3dd tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255" status: 200 len: 1426 microversion: 2.1 time: 0.121022 Aug 24 10:29:01.146920 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2032/3670] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:29:01 2022] GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255 => generated 1426 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:01.158169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8487d8df-8874-4498-8bec-d044121ff30f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.0.232"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:01.203811 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e8942a91-f393-421d-bd7a-5c011d393dd9 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:01.213817 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e8942a91-f393-421d-bd7a-5c011d393dd9 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1515 microversion: 2.1 time: 0.555925 Aug 24 10:29:01.214423 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1639/3671] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:00 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1515 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:01.645070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8487d8df-8874-4498-8bec-d044121ff30f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:01.652348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=62 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:01.653887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8487d8df-8874-4498-8bec-d044121ff30f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:01.654390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8487d8df-8874-4498-8bec-d044121ff30f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:01.655020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8487d8df-8874-4498-8bec-d044121ff30f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:01.658966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8487d8df-8874-4498-8bec-d044121ff30f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:01.659742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8487d8df-8874-4498-8bec-d044121ff30f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:01.662855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8487d8df-8874-4498-8bec-d044121ff30f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:01.676222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d54ba1f-54fd-4f22-aa36-378dc86cb31c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:01.677625 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9d54ba1f-54fd-4f22-aa36-378dc86cb31c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:01.697405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d54ba1f-54fd-4f22-aa36-378dc86cb31c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:01.715976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d54ba1f-54fd-4f22-aa36-378dc86cb31c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:01.717056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d54ba1f-54fd-4f22-aa36-378dc86cb31c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:01.719778 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d54ba1f-54fd-4f22-aa36-378dc86cb31c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:01.720570 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d54ba1f-54fd-4f22-aa36-378dc86cb31c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:01.721412 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d54ba1f-54fd-4f22-aa36-378dc86cb31c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:02.045471 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9d54ba1f-54fd-4f22-aa36-378dc86cb31c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:02.058010 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9d54ba1f-54fd-4f22-aa36-378dc86cb31c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f" status: 200 len: 1493 microversion: 2.1 time: 0.385982 Aug 24 10:29:02.060067 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1640/3672] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:01 2022] GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f => generated 1493 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:29:02.093018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d7cd7320-8ebd-49c0-be04-90114b91c518 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:02.093691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d7cd7320-8ebd-49c0-be04-90114b91c518 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:02.129457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7cd7320-8ebd-49c0-be04-90114b91c518 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:02.131625 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7cd7320-8ebd-49c0-be04-90114b91c518 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:02.133775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7cd7320-8ebd-49c0-be04-90114b91c518 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:02.140808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7cd7320-8ebd-49c0-be04-90114b91c518 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:02.142435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7cd7320-8ebd-49c0-be04-90114b91c518 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:02.143962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7cd7320-8ebd-49c0-be04-90114b91c518 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:02.218692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d7cd7320-8ebd-49c0-be04-90114b91c518 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:29:02.389158 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d7cd7320-8ebd-49c0-be04-90114b91c518 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "DELETE /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f" status: 204 len: 0 microversion: 2.1 time: 0.300531 Aug 24 10:29:02.390196 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1641/3673] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:29:02 2022] DELETE /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:02.402519 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8487d8df-8874-4498-8bec-d044121ff30f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "refresh_cache-0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 10:29:02.406602 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8b9518c5-4764-4bad-83a8-e631dfdb1723 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f46541950d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:02.407225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8487d8df-8874-4498-8bec-d044121ff30f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquired lock "refresh_cache-0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 10:29:02.494711 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8b9518c5-4764-4bad-83a8-e631dfdb1723 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255" status: 200 len: 1426 microversion: 2.1 time: 0.101897 Aug 24 10:29:02.495629 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1642/3674] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:29:02 2022] GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255 => generated 1426 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:02.507104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aea61bf2-c19e-4229-be2c-4e3b2983ea99 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:02.512569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aea61bf2-c19e-4229-be2c-4e3b2983ea99 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:02.534457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aea61bf2-c19e-4229-be2c-4e3b2983ea99 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:02.535608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aea61bf2-c19e-4229-be2c-4e3b2983ea99 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:02.537420 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aea61bf2-c19e-4229-be2c-4e3b2983ea99 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:02.539550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aea61bf2-c19e-4229-be2c-4e3b2983ea99 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:02.542231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aea61bf2-c19e-4229-be2c-4e3b2983ea99 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:02.542851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aea61bf2-c19e-4229-be2c-4e3b2983ea99 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:02.944858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aea61bf2-c19e-4229-be2c-4e3b2983ea99 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:02.973878 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aea61bf2-c19e-4229-be2c-4e3b2983ea99 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1515 microversion: 2.1 time: 0.476020 Aug 24 10:29:02.976118 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1643/3675] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:02 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1515 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:02.982991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-be98fe4a-9cbb-4af7-8bc2-72f5308e3f38 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:02.989889 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-be98fe4a-9cbb-4af7-8bc2-72f5308e3f38 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:03.010350 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be98fe4a-9cbb-4af7-8bc2-72f5308e3f38 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:03.011296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be98fe4a-9cbb-4af7-8bc2-72f5308e3f38 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:03.011987 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be98fe4a-9cbb-4af7-8bc2-72f5308e3f38 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:03.012963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be98fe4a-9cbb-4af7-8bc2-72f5308e3f38 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:03.013702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be98fe4a-9cbb-4af7-8bc2-72f5308e3f38 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:03.014782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be98fe4a-9cbb-4af7-8bc2-72f5308e3f38 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:03.348671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-be98fe4a-9cbb-4af7-8bc2-72f5308e3f38 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:03.354856 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:03.367216 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-be98fe4a-9cbb-4af7-8bc2-72f5308e3f38 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f" status: 200 len: 1499 microversion: 2.1 time: 0.389702 Aug 24 10:29:03.372371 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1644/3676] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:02 2022] GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f => generated 1499 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:03.510842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ba00ce26-4229-4afb-989e-f14bf84e2f1c tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f465459c550>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:03.606139 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ba00ce26-4229-4afb-989e-f14bf84e2f1c tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255" status: 200 len: 1426 microversion: 2.1 time: 0.099636 Aug 24 10:29:03.607014 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1645/3677] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:29:03 2022] GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255 => generated 1426 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:03.998761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e43ab124-964f-41ea-9de1-1fcea91ac90a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:04.000384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e43ab124-964f-41ea-9de1-1fcea91ac90a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:04.022142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e43ab124-964f-41ea-9de1-1fcea91ac90a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:04.022880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e43ab124-964f-41ea-9de1-1fcea91ac90a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:04.023497 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e43ab124-964f-41ea-9de1-1fcea91ac90a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:04.024386 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e43ab124-964f-41ea-9de1-1fcea91ac90a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:04.026216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e43ab124-964f-41ea-9de1-1fcea91ac90a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:04.027948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e43ab124-964f-41ea-9de1-1fcea91ac90a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:04.511350 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e43ab124-964f-41ea-9de1-1fcea91ac90a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:04.528150 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e43ab124-964f-41ea-9de1-1fcea91ac90a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1515 microversion: 2.1 time: 0.532332 Aug 24 10:29:04.543808 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1646/3678] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:03 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1515 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:29:04.549770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ee834348-95b0-4da7-9eaf-213d0b27bfcf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:04.557271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ee834348-95b0-4da7-9eaf-213d0b27bfcf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:04.597545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee834348-95b0-4da7-9eaf-213d0b27bfcf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:04.598055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee834348-95b0-4da7-9eaf-213d0b27bfcf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:04.598500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee834348-95b0-4da7-9eaf-213d0b27bfcf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:04.603400 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee834348-95b0-4da7-9eaf-213d0b27bfcf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:04.603896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee834348-95b0-4da7-9eaf-213d0b27bfcf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:04.604531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee834348-95b0-4da7-9eaf-213d0b27bfcf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:05.117488 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ee834348-95b0-4da7-9eaf-213d0b27bfcf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:05.144017 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ee834348-95b0-4da7-9eaf-213d0b27bfcf tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f" status: 200 len: 1499 microversion: 2.1 time: 0.595985 Aug 24 10:29:05.162708 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1647/3679] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:04 2022] GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f => generated 1499 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:05.175099 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-de49be10-9d42-411b-8d9e-1966c4558d35 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f4655837430>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:05.346948 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-de49be10-9d42-411b-8d9e-1966c4558d35 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255" status: 200 len: 1426 microversion: 2.1 time: 0.182761 Aug 24 10:29:05.356627 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1648/3680] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:29:05 2022] GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255 => generated 1426 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:05.374713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-8487d8df-8874-4498-8bec-d044121ff30f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Building network info cache for instance {{(pid=122433) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 10:29:05.387640 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-845145e9-564c-4b5b-858d-18583bf200fe req-8eccdf6f-7a79-41b1-8961-e7389dd5f3d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a501f37-7cb0-4d7d-a95b-03f7aed77f9d", "tag": "d5ccc17d-296b-4e00-ae9b-8f26eb42f6ec"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:05.417881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-845145e9-564c-4b5b-858d-18583bf200fe req-8eccdf6f-7a79-41b1-8961-e7389dd5f3d1 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:05.420432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-845145e9-564c-4b5b-858d-18583bf200fe req-8eccdf6f-7a79-41b1-8961-e7389dd5f3d1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:05.421599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-845145e9-564c-4b5b-858d-18583bf200fe req-8eccdf6f-7a79-41b1-8961-e7389dd5f3d1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:05.463409 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-845145e9-564c-4b5b-858d-18583bf200fe req-8eccdf6f-7a79-41b1-8961-e7389dd5f3d1 service nova] Creating event network-changed:d5ccc17d-296b-4e00-ae9b-8f26eb42f6ec for instance 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d on n-h2-849328-3 Aug 24 10:29:05.477262 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-845145e9-564c-4b5b-858d-18583bf200fe req-8eccdf6f-7a79-41b1-8961-e7389dd5f3d1 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094185 Aug 24 10:29:05.484190 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1649/3681] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:29:05.559686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e9bb5b60-baba-4b9b-9c7c-16057efe9c6a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:05.560418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e9bb5b60-baba-4b9b-9c7c-16057efe9c6a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:05.576784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9bb5b60-baba-4b9b-9c7c-16057efe9c6a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:05.577309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9bb5b60-baba-4b9b-9c7c-16057efe9c6a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:05.578342 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9bb5b60-baba-4b9b-9c7c-16057efe9c6a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:05.579084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9bb5b60-baba-4b9b-9c7c-16057efe9c6a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:05.579729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9bb5b60-baba-4b9b-9c7c-16057efe9c6a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:05.580932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9bb5b60-baba-4b9b-9c7c-16057efe9c6a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:05.972352 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e9bb5b60-baba-4b9b-9c7c-16057efe9c6a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:05.983791 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e9bb5b60-baba-4b9b-9c7c-16057efe9c6a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1515 microversion: 2.1 time: 0.429517 Aug 24 10:29:06.001191 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1650/3682] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:05 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1515 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:06.168705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-14da3ee4-91d7-4769-9741-029005465bde tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:06.169537 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-14da3ee4-91d7-4769-9741-029005465bde tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:06.201453 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14da3ee4-91d7-4769-9741-029005465bde tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:06.201962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14da3ee4-91d7-4769-9741-029005465bde tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:06.208238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14da3ee4-91d7-4769-9741-029005465bde tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:06.213623 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14da3ee4-91d7-4769-9741-029005465bde tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:06.214320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14da3ee4-91d7-4769-9741-029005465bde tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:06.215769 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14da3ee4-91d7-4769-9741-029005465bde tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:06.499920 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-14da3ee4-91d7-4769-9741-029005465bde tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49cb438da9f4b309d54bfef9fc19bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b324a37b01b644dfa301a561e6125672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:06.512161 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-14da3ee4-91d7-4769-9741-029005465bde tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f" status: 200 len: 1457 microversion: 2.1 time: 0.347390 Aug 24 10:29:06.513513 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1651/3683] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:06 2022] GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f => generated 1457 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:29:06.535939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d3ea8ed1-74a4-448e-b66b-6e466749285a req-944ee470-7bdd-4d93-a37c-df217a7af497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b04bfa6-2a69-479e-bd7e-93e7838e098f", "name": "network-vif-deleted", "tag": "1a18a2b7-d4b7-4b98-8182-fb76091d43a4"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:06.578607 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d3ea8ed1-74a4-448e-b66b-6e466749285a req-944ee470-7bdd-4d93-a37c-df217a7af497 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:06.579348 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d3ea8ed1-74a4-448e-b66b-6e466749285a req-944ee470-7bdd-4d93-a37c-df217a7af497 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:06.579684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d3ea8ed1-74a4-448e-b66b-6e466749285a req-944ee470-7bdd-4d93-a37c-df217a7af497 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:06.608761 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d3ea8ed1-74a4-448e-b66b-6e466749285a req-944ee470-7bdd-4d93-a37c-df217a7af497 service nova] Creating event network-vif-deleted:1a18a2b7-d4b7-4b98-8182-fb76091d43a4 for instance 6b04bfa6-2a69-479e-bd7e-93e7838e098f on n-h2-849328-3 Aug 24 10:29:06.622519 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d3ea8ed1-74a4-448e-b66b-6e466749285a req-944ee470-7bdd-4d93-a37c-df217a7af497 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107214 Aug 24 10:29:06.626189 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1652/3684] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:29:06.640717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0a898677-ff85-4c1a-863f-5461331bd3a1 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f46541cd0d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:06.790283 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0a898677-ff85-4c1a-863f-5461331bd3a1 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255" status: 200 len: 1426 microversion: 2.1 time: 0.157550 Aug 24 10:29:06.794259 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1653/3685] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:29:06 2022] GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255 => generated 1426 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:07.013934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-56f87b76-c487-43ad-8a4c-88252aff109a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:07.017631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-56f87b76-c487-43ad-8a4c-88252aff109a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:07.034870 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56f87b76-c487-43ad-8a4c-88252aff109a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:07.039449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56f87b76-c487-43ad-8a4c-88252aff109a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:07.044416 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56f87b76-c487-43ad-8a4c-88252aff109a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:07.046735 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56f87b76-c487-43ad-8a4c-88252aff109a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:07.047476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56f87b76-c487-43ad-8a4c-88252aff109a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:07.048159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56f87b76-c487-43ad-8a4c-88252aff109a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:07.494043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-56f87b76-c487-43ad-8a4c-88252aff109a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:07.515473 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-56f87b76-c487-43ad-8a4c-88252aff109a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1515 microversion: 2.1 time: 0.505540 Aug 24 10:29:07.517862 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1654/3686] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:07 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1515 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:07.540562 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2e882836-35ce-4bfa-a8b3-31700258d284 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:07.541285 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2e882836-35ce-4bfa-a8b3-31700258d284 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:07.550178 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e882836-35ce-4bfa-a8b3-31700258d284 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:07.550668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e882836-35ce-4bfa-a8b3-31700258d284 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:07.551101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e882836-35ce-4bfa-a8b3-31700258d284 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:07.552071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e882836-35ce-4bfa-a8b3-31700258d284 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:07.552531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e882836-35ce-4bfa-a8b3-31700258d284 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:07.554238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e882836-35ce-4bfa-a8b3-31700258d284 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:07.575840 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-2e882836-35ce-4bfa-a8b3-31700258d284 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] HTTP exception thrown: Instance 6b04bfa6-2a69-479e-bd7e-93e7838e098f could not be found. Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2e882836-35ce-4bfa-a8b3-31700258d284 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Request method failure captured: Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f HTTP/1.1 Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfwVOwKbAI3HcYW4vDUwX5tmvWZcMN8iYYPbyv0cT05fZ_Z-LEPCm4LinUuprRdXqkjYpTNDBQ5PMwhn6CDfWO2m5UgqK-Sr-pjjwg2dd34HghINyEVE3T5Itg-PYKj0YMEqYVC5uIroOumu3tZy7M7156OT9EtIM2-BMTg5dhnnzv0 Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b324a37b01b644dfa301a561e6125672", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b324a37b01b644dfa301a561e6125672"}]}] Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: b49cb438da9f4b309d54bfef9fc19bda Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 6b04bfa6-2a69-479e-bd7e-93e7838e098f could not be found. Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '6b04bfa6-2a69-479e-bd7e-93e7838e098f'} Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b04bfa6-2a69-479e-bd7e-93e7838e098f could not be found. Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b04bfa6-2a69-479e-bd7e-93e7838e098f could not be found. Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:07.578155 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:07.584395 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:07.584395 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:07.584395 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:07.584395 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:29:07.584395 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:29:07.584395 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b04bfa6-2a69-479e-bd7e-93e7838e098f could not be found. Aug 24 10:29:07.584395 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:07.586709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2e882836-35ce-4bfa-a8b3-31700258d284 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Returning 404 to user: Instance 6b04bfa6-2a69-479e-bd7e-93e7838e098f could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:29:07.588015 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2e882836-35ce-4bfa-a8b3-31700258d284 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f" status: 404 len: 111 microversion: 2.1 time: 0.053502 Aug 24 10:29:07.590218 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1655/3687] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:07 2022] GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:29:07.618020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-05007e7e-813f-41e0-afea-c492a4193489 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:07.618674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-05007e7e-813f-41e0-afea-c492a4193489 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:07.639700 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05007e7e-813f-41e0-afea-c492a4193489 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:07.640200 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05007e7e-813f-41e0-afea-c492a4193489 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:07.642395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05007e7e-813f-41e0-afea-c492a4193489 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:07.643157 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05007e7e-813f-41e0-afea-c492a4193489 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:07.643621 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05007e7e-813f-41e0-afea-c492a4193489 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:07.644034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05007e7e-813f-41e0-afea-c492a4193489 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:07.679908 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-05007e7e-813f-41e0-afea-c492a4193489 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] HTTP exception thrown: Instance 6b04bfa6-2a69-479e-bd7e-93e7838e098f could not be found. Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-05007e7e-813f-41e0-afea-c492a4193489 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Request method failure captured: Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f HTTP/1.1 Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfwVOwKbAI3HcYW4vDUwX5tmvWZcMN8iYYPbyv0cT05fZ_Z-LEPCm4LinUuprRdXqkjYpTNDBQ5PMwhn6CDfWO2m5UgqK-Sr-pjjwg2dd34HghINyEVE3T5Itg-PYKj0YMEqYVC5uIroOumu3tZy7M7156OT9EtIM2-BMTg5dhnnzv0 Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b324a37b01b644dfa301a561e6125672", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b324a37b01b644dfa301a561e6125672"}]}] Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: b49cb438da9f4b309d54bfef9fc19bda Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 6b04bfa6-2a69-479e-bd7e-93e7838e098f could not be found. Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '6b04bfa6-2a69-479e-bd7e-93e7838e098f'} Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b04bfa6-2a69-479e-bd7e-93e7838e098f could not be found. Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:29:07.687307 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:29:07.692896 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b04bfa6-2a69-479e-bd7e-93e7838e098f could not be found. Aug 24 10:29:07.692896 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:07.692896 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:07.692896 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:07.692896 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:07.692896 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:07.692896 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:07.692896 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:29:07.692896 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:29:07.692896 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b04bfa6-2a69-479e-bd7e-93e7838e098f could not be found. Aug 24 10:29:07.692896 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:07.696852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-05007e7e-813f-41e0-afea-c492a4193489 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Returning 404 to user: Instance 6b04bfa6-2a69-479e-bd7e-93e7838e098f could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:29:07.706588 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-05007e7e-813f-41e0-afea-c492a4193489 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "DELETE /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f" status: 404 len: 111 microversion: 2.1 time: 0.100787 Aug 24 10:29:07.714248 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1656/3688] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:29:07 2022] DELETE /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:29:07.728965 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-05b0c026-0f7b-4ed9-93f7-bdf2c3ba2b05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:07.729922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-05b0c026-0f7b-4ed9-93f7-bdf2c3ba2b05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 6b04bfa6-2a69-479e-bd7e-93e7838e098f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:07.744998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05b0c026-0f7b-4ed9-93f7-bdf2c3ba2b05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:07.745832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05b0c026-0f7b-4ed9-93f7-bdf2c3ba2b05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:07.746500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05b0c026-0f7b-4ed9-93f7-bdf2c3ba2b05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:07.748057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05b0c026-0f7b-4ed9-93f7-bdf2c3ba2b05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:07.748691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05b0c026-0f7b-4ed9-93f7-bdf2c3ba2b05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:07.751235 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05b0c026-0f7b-4ed9-93f7-bdf2c3ba2b05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:07.774147 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-05b0c026-0f7b-4ed9-93f7-bdf2c3ba2b05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] HTTP exception thrown: Instance 6b04bfa6-2a69-479e-bd7e-93e7838e098f could not be found. Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-05b0c026-0f7b-4ed9-93f7-bdf2c3ba2b05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Request method failure captured: Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f HTTP/1.1 Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfwVOwKbAI3HcYW4vDUwX5tmvWZcMN8iYYPbyv0cT05fZ_Z-LEPCm4LinUuprRdXqkjYpTNDBQ5PMwhn6CDfWO2m5UgqK-Sr-pjjwg2dd34HghINyEVE3T5Itg-PYKj0YMEqYVC5uIroOumu3tZy7M7156OT9EtIM2-BMTg5dhnnzv0 Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b324a37b01b644dfa301a561e6125672", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b324a37b01b644dfa301a561e6125672"}]}] Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: b49cb438da9f4b309d54bfef9fc19bda Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 6b04bfa6-2a69-479e-bd7e-93e7838e098f could not be found. Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '6b04bfa6-2a69-479e-bd7e-93e7838e098f'} Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b04bfa6-2a69-479e-bd7e-93e7838e098f could not be found. Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b04bfa6-2a69-479e-bd7e-93e7838e098f could not be found. Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:07.775917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:07.781944 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:07.781944 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:07.781944 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:07.781944 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:29:07.781944 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:29:07.781944 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b04bfa6-2a69-479e-bd7e-93e7838e098f could not be found. Aug 24 10:29:07.781944 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:07.783549 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-05b0c026-0f7b-4ed9-93f7-bdf2c3ba2b05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Returning 404 to user: Instance 6b04bfa6-2a69-479e-bd7e-93e7838e098f could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:29:07.784611 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-05b0c026-0f7b-4ed9-93f7-bdf2c3ba2b05 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f" status: 404 len: 111 microversion: 2.1 time: 0.069089 Aug 24 10:29:07.789518 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1657/3689] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:07 2022] GET /compute/v2.1/servers/6b04bfa6-2a69-479e-bd7e-93e7838e098f => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:29:07.795823 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d1a556ec-300f-491c-9d06-3caf130b5fe1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:07.796579 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d1a556ec-300f-491c-9d06-3caf130b5fe1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:07.824733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1a556ec-300f-491c-9d06-3caf130b5fe1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:07.826387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1a556ec-300f-491c-9d06-3caf130b5fe1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:07.827290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1a556ec-300f-491c-9d06-3caf130b5fe1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:07.832479 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1a556ec-300f-491c-9d06-3caf130b5fe1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:07.833599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1a556ec-300f-491c-9d06-3caf130b5fe1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:07.837589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1a556ec-300f-491c-9d06-3caf130b5fe1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:07.867716 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-d1a556ec-300f-491c-9d06-3caf130b5fe1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] HTTP exception thrown: Instance 2121a94d-a44d-49f0-95d9-e9c77312fb4a could not be found. Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d1a556ec-300f-491c-9d06-3caf130b5fe1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Request method failure captured: Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a HTTP/1.1 Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfwVOwKbAI3HcYW4vDUwX5tmvWZcMN8iYYPbyv0cT05fZ_Z-LEPCm4LinUuprRdXqkjYpTNDBQ5PMwhn6CDfWO2m5UgqK-Sr-pjjwg2dd34HghINyEVE3T5Itg-PYKj0YMEqYVC5uIroOumu3tZy7M7156OT9EtIM2-BMTg5dhnnzv0 Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b324a37b01b644dfa301a561e6125672", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b324a37b01b644dfa301a561e6125672"}]}] Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: b49cb438da9f4b309d54bfef9fc19bda Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 2121a94d-a44d-49f0-95d9-e9c77312fb4a could not be found. Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '2121a94d-a44d-49f0-95d9-e9c77312fb4a'} Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2121a94d-a44d-49f0-95d9-e9c77312fb4a could not be found. Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:29:07.870572 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:29:07.876121 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2121a94d-a44d-49f0-95d9-e9c77312fb4a could not be found. Aug 24 10:29:07.876121 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:07.876121 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:07.876121 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:07.876121 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:07.876121 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:07.876121 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:07.876121 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:29:07.876121 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:29:07.876121 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2121a94d-a44d-49f0-95d9-e9c77312fb4a could not be found. Aug 24 10:29:07.876121 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:07.878431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d1a556ec-300f-491c-9d06-3caf130b5fe1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Returning 404 to user: Instance 2121a94d-a44d-49f0-95d9-e9c77312fb4a could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:29:07.879389 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d1a556ec-300f-491c-9d06-3caf130b5fe1 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "DELETE /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 404 len: 111 microversion: 2.1 time: 0.088652 Aug 24 10:29:07.881262 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1658/3690] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:29:07 2022] DELETE /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:29:07.892600 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a3f0bf3e-f89a-4a8c-ad41-79007992d833 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f46542823a0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:07.996157 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a3f0bf3e-f89a-4a8c-ad41-79007992d833 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255" status: 200 len: 1426 microversion: 2.1 time: 0.113176 Aug 24 10:29:07.999013 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1659/3691] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:29:07 2022] GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255 => generated 1426 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:08.035147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5ead0a6f-54d4-44f5-a0b7-3ab2c6ff6423 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:08.035873 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5ead0a6f-54d4-44f5-a0b7-3ab2c6ff6423 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 2121a94d-a44d-49f0-95d9-e9c77312fb4a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:08.066912 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ead0a6f-54d4-44f5-a0b7-3ab2c6ff6423 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:08.074001 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ead0a6f-54d4-44f5-a0b7-3ab2c6ff6423 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:08.074541 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ead0a6f-54d4-44f5-a0b7-3ab2c6ff6423 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:08.075559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ead0a6f-54d4-44f5-a0b7-3ab2c6ff6423 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:08.076210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ead0a6f-54d4-44f5-a0b7-3ab2c6ff6423 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:08.077763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ead0a6f-54d4-44f5-a0b7-3ab2c6ff6423 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:08.106519 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-5ead0a6f-54d4-44f5-a0b7-3ab2c6ff6423 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] HTTP exception thrown: Instance 2121a94d-a44d-49f0-95d9-e9c77312fb4a could not be found. Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5ead0a6f-54d4-44f5-a0b7-3ab2c6ff6423 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Request method failure captured: Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a HTTP/1.1 Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfwVOwKbAI3HcYW4vDUwX5tmvWZcMN8iYYPbyv0cT05fZ_Z-LEPCm4LinUuprRdXqkjYpTNDBQ5PMwhn6CDfWO2m5UgqK-Sr-pjjwg2dd34HghINyEVE3T5Itg-PYKj0YMEqYVC5uIroOumu3tZy7M7156OT9EtIM2-BMTg5dhnnzv0 Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b324a37b01b644dfa301a561e6125672", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b324a37b01b644dfa301a561e6125672"}]}] Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: b49cb438da9f4b309d54bfef9fc19bda Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 2121a94d-a44d-49f0-95d9-e9c77312fb4a could not be found. Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '2121a94d-a44d-49f0-95d9-e9c77312fb4a'} Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2121a94d-a44d-49f0-95d9-e9c77312fb4a could not be found. Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2121a94d-a44d-49f0-95d9-e9c77312fb4a could not be found. Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:08.115105 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.120519 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:08.120519 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:08.120519 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:08.120519 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:29:08.120519 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:29:08.120519 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2121a94d-a44d-49f0-95d9-e9c77312fb4a could not be found. Aug 24 10:29:08.120519 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.123602 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5ead0a6f-54d4-44f5-a0b7-3ab2c6ff6423 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Returning 404 to user: Instance 2121a94d-a44d-49f0-95d9-e9c77312fb4a could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:29:08.126271 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5ead0a6f-54d4-44f5-a0b7-3ab2c6ff6423 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a" status: 404 len: 111 microversion: 2.1 time: 0.125996 Aug 24 10:29:08.130588 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1660/3692] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:07 2022] GET /compute/v2.1/servers/2121a94d-a44d-49f0-95d9-e9c77312fb4a => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:29:08.138771 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8b903947-42f2-4cd7-8c5b-5220b3016fca tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:08.141549 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8b903947-42f2-4cd7-8c5b-5220b3016fca tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:08.158386 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b903947-42f2-4cd7-8c5b-5220b3016fca tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:08.159717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b903947-42f2-4cd7-8c5b-5220b3016fca tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:08.165317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b903947-42f2-4cd7-8c5b-5220b3016fca tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:08.166092 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b903947-42f2-4cd7-8c5b-5220b3016fca tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:08.166570 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b903947-42f2-4cd7-8c5b-5220b3016fca tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:08.167008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b903947-42f2-4cd7-8c5b-5220b3016fca tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:08.215364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-8487d8df-8874-4498-8bec-d044121ff30f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Updating instance_info_cache with network_info: [{"id": "d5ccc17d-296b-4e00-ae9b-8f26eb42f6ec", "address": "fa:16:3e:cb:55:a4", "network": {"id": "e672a0e9-6701-4eed-8b4e-431795420ea2", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1882465683-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8a932df7eb0b43fe9da0435cb6abeb4e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd5ccc17d-29", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122433) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 10:29:08.224063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8487d8df-8874-4498-8bec-d044121ff30f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Releasing lock "refresh_cache-0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 10:29:08.229778 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8487d8df-8874-4498-8bec-d044121ff30f tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "POST /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d/action" status: 202 len: 0 microversion: 2.1 time: 7.080865 Aug 24 10:29:08.236074 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-8b903947-42f2-4cd7-8c5b-5220b3016fca tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] HTTP exception thrown: Instance 0fdab911-592d-4d21-9420-fdadfea05875 could not be found. Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8b903947-42f2-4cd7-8c5b-5220b3016fca tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Request method failure captured: Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 HTTP/1.1 Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfwVOwKbAI3HcYW4vDUwX5tmvWZcMN8iYYPbyv0cT05fZ_Z-LEPCm4LinUuprRdXqkjYpTNDBQ5PMwhn6CDfWO2m5UgqK-Sr-pjjwg2dd34HghINyEVE3T5Itg-PYKj0YMEqYVC5uIroOumu3tZy7M7156OT9EtIM2-BMTg5dhnnzv0 Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b324a37b01b644dfa301a561e6125672", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b324a37b01b644dfa301a561e6125672"}]}] Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: b49cb438da9f4b309d54bfef9fc19bda Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 0fdab911-592d-4d21-9420-fdadfea05875 could not be found. Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '0fdab911-592d-4d21-9420-fdadfea05875'} Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fdab911-592d-4d21-9420-fdadfea05875 could not be found. Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:29:08.237729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:29:08.246149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fdab911-592d-4d21-9420-fdadfea05875 could not be found. Aug 24 10:29:08.246149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.246149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:08.246149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.246149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:08.246149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:08.246149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:08.246149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:29:08.246149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:29:08.246149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fdab911-592d-4d21-9420-fdadfea05875 could not be found. Aug 24 10:29:08.246149 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.246149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8b903947-42f2-4cd7-8c5b-5220b3016fca tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Returning 404 to user: Instance 0fdab911-592d-4d21-9420-fdadfea05875 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:29:08.246149 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8b903947-42f2-4cd7-8c5b-5220b3016fca tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "DELETE /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 404 len: 111 microversion: 2.1 time: 0.107429 Aug 24 10:29:08.247526 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2033/3693] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:29:01 2022] POST /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d/action => generated 0 bytes in 7092 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 24 10:29:08.248806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8641e838-0b72-4784-b133-a201cad974ab tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '.version_select at 0x7f46552f6790>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:08.249453 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1661/3694] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:29:08 2022] DELETE /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:29:08.260485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9c14d710-97db-4055-a533-b19b3da2076c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:08.266029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9c14d710-97db-4055-a533-b19b3da2076c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 0fdab911-592d-4d21-9420-fdadfea05875] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:08.280650 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c14d710-97db-4055-a533-b19b3da2076c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:08.281167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c14d710-97db-4055-a533-b19b3da2076c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:08.281616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c14d710-97db-4055-a533-b19b3da2076c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:08.282330 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c14d710-97db-4055-a533-b19b3da2076c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:08.282784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c14d710-97db-4055-a533-b19b3da2076c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:08.283203 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c14d710-97db-4055-a533-b19b3da2076c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:08.324159 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-9c14d710-97db-4055-a533-b19b3da2076c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] HTTP exception thrown: Instance 0fdab911-592d-4d21-9420-fdadfea05875 could not be found. Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9c14d710-97db-4055-a533-b19b3da2076c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Request method failure captured: Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 HTTP/1.1 Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfwVOwKbAI3HcYW4vDUwX5tmvWZcMN8iYYPbyv0cT05fZ_Z-LEPCm4LinUuprRdXqkjYpTNDBQ5PMwhn6CDfWO2m5UgqK-Sr-pjjwg2dd34HghINyEVE3T5Itg-PYKj0YMEqYVC5uIroOumu3tZy7M7156OT9EtIM2-BMTg5dhnnzv0 Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b324a37b01b644dfa301a561e6125672", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b324a37b01b644dfa301a561e6125672"}]}] Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: b49cb438da9f4b309d54bfef9fc19bda Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 0fdab911-592d-4d21-9420-fdadfea05875 could not be found. Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '0fdab911-592d-4d21-9420-fdadfea05875'} Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fdab911-592d-4d21-9420-fdadfea05875 could not be found. Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fdab911-592d-4d21-9420-fdadfea05875 could not be found. Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:08.336525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.342244 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:08.342244 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:08.342244 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:08.342244 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:29:08.342244 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:29:08.342244 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fdab911-592d-4d21-9420-fdadfea05875 could not be found. Aug 24 10:29:08.342244 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.342244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9c14d710-97db-4055-a533-b19b3da2076c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Returning 404 to user: Instance 0fdab911-592d-4d21-9420-fdadfea05875 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:29:08.342872 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9c14d710-97db-4055-a533-b19b3da2076c tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875" status: 404 len: 111 microversion: 2.1 time: 0.091696 Aug 24 10:29:08.342975 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1662/3695] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:08 2022] GET /compute/v2.1/servers/0fdab911-592d-4d21-9420-fdadfea05875 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:29:08.355707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0dbb523d-6583-4fc6-903f-916fa6b08700 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:08.356520 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0dbb523d-6583-4fc6-903f-916fa6b08700 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 84e1c064-02ae-48d5-9b75-ce57b9a3758f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:08.365484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dbb523d-6583-4fc6-903f-916fa6b08700 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:08.366295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dbb523d-6583-4fc6-903f-916fa6b08700 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:08.366982 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dbb523d-6583-4fc6-903f-916fa6b08700 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:08.368410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dbb523d-6583-4fc6-903f-916fa6b08700 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:08.369223 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dbb523d-6583-4fc6-903f-916fa6b08700 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:08.370093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dbb523d-6583-4fc6-903f-916fa6b08700 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:08.391547 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-0dbb523d-6583-4fc6-903f-916fa6b08700 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] HTTP exception thrown: Instance 84e1c064-02ae-48d5-9b75-ce57b9a3758f could not be found. Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0dbb523d-6583-4fc6-903f-916fa6b08700 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Request method failure captured: Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f HTTP/1.1 Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfwVOwKbAI3HcYW4vDUwX5tmvWZcMN8iYYPbyv0cT05fZ_Z-LEPCm4LinUuprRdXqkjYpTNDBQ5PMwhn6CDfWO2m5UgqK-Sr-pjjwg2dd34HghINyEVE3T5Itg-PYKj0YMEqYVC5uIroOumu3tZy7M7156OT9EtIM2-BMTg5dhnnzv0 Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b324a37b01b644dfa301a561e6125672", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b324a37b01b644dfa301a561e6125672"}]}] Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: b49cb438da9f4b309d54bfef9fc19bda Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 84e1c064-02ae-48d5-9b75-ce57b9a3758f could not be found. Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '84e1c064-02ae-48d5-9b75-ce57b9a3758f'} Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84e1c064-02ae-48d5-9b75-ce57b9a3758f could not be found. Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:29:08.394372 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:29:08.399222 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e1c064-02ae-48d5-9b75-ce57b9a3758f could not be found. Aug 24 10:29:08.399222 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.399222 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:08.399222 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.399222 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:08.399222 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:08.399222 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:08.399222 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:29:08.399222 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:29:08.399222 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e1c064-02ae-48d5-9b75-ce57b9a3758f could not be found. Aug 24 10:29:08.399222 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.402690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0dbb523d-6583-4fc6-903f-916fa6b08700 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Returning 404 to user: Instance 84e1c064-02ae-48d5-9b75-ce57b9a3758f could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:29:08.404763 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0dbb523d-6583-4fc6-903f-916fa6b08700 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "DELETE /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f" status: 404 len: 111 microversion: 2.1 time: 0.053676 Aug 24 10:29:08.409309 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1663/3696] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:29:08 2022] DELETE /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:29:08.415120 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1f4851e5-7d5f-4b3a-9fc1-5606f04d337a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:08.415966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1f4851e5-7d5f-4b3a-9fc1-5606f04d337a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 84e1c064-02ae-48d5-9b75-ce57b9a3758f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:08.429555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f4851e5-7d5f-4b3a-9fc1-5606f04d337a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:08.430328 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f4851e5-7d5f-4b3a-9fc1-5606f04d337a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:08.431071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f4851e5-7d5f-4b3a-9fc1-5606f04d337a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:08.433162 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f4851e5-7d5f-4b3a-9fc1-5606f04d337a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:08.433791 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f4851e5-7d5f-4b3a-9fc1-5606f04d337a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:08.434445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f4851e5-7d5f-4b3a-9fc1-5606f04d337a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:08.457357 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-1f4851e5-7d5f-4b3a-9fc1-5606f04d337a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] HTTP exception thrown: Instance 84e1c064-02ae-48d5-9b75-ce57b9a3758f could not be found. Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1f4851e5-7d5f-4b3a-9fc1-5606f04d337a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Request method failure captured: Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f HTTP/1.1 Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfwVOwKbAI3HcYW4vDUwX5tmvWZcMN8iYYPbyv0cT05fZ_Z-LEPCm4LinUuprRdXqkjYpTNDBQ5PMwhn6CDfWO2m5UgqK-Sr-pjjwg2dd34HghINyEVE3T5Itg-PYKj0YMEqYVC5uIroOumu3tZy7M7156OT9EtIM2-BMTg5dhnnzv0 Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b324a37b01b644dfa301a561e6125672", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b324a37b01b644dfa301a561e6125672"}]}] Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: b49cb438da9f4b309d54bfef9fc19bda Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 84e1c064-02ae-48d5-9b75-ce57b9a3758f could not be found. Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '84e1c064-02ae-48d5-9b75-ce57b9a3758f'} Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84e1c064-02ae-48d5-9b75-ce57b9a3758f could not be found. Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e1c064-02ae-48d5-9b75-ce57b9a3758f could not be found. Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:08.459402 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.464947 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:08.464947 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:08.464947 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:08.464947 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:29:08.464947 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:29:08.464947 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e1c064-02ae-48d5-9b75-ce57b9a3758f could not be found. Aug 24 10:29:08.464947 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.466943 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1f4851e5-7d5f-4b3a-9fc1-5606f04d337a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Returning 404 to user: Instance 84e1c064-02ae-48d5-9b75-ce57b9a3758f could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:29:08.468009 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1f4851e5-7d5f-4b3a-9fc1-5606f04d337a tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f" status: 404 len: 111 microversion: 2.1 time: 0.057431 Aug 24 10:29:08.472481 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1664/3697] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:08 2022] GET /compute/v2.1/servers/84e1c064-02ae-48d5-9b75-ce57b9a3758f => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:29:08.479668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92777e3a-62ab-41b9-af51-15f2220c438e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:08.480466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-92777e3a-62ab-41b9-af51-15f2220c438e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 43734320-cfe5-4cc4-afbe-06296b4eeaac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:08.488839 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-92777e3a-62ab-41b9-af51-15f2220c438e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] HTTP exception thrown: Instance 43734320-cfe5-4cc4-afbe-06296b4eeaac could not be found. Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92777e3a-62ab-41b9-af51-15f2220c438e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Request method failure captured: Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/43734320-cfe5-4cc4-afbe-06296b4eeaac HTTP/1.1 Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfwVOwKbAI3HcYW4vDUwX5tmvWZcMN8iYYPbyv0cT05fZ_Z-LEPCm4LinUuprRdXqkjYpTNDBQ5PMwhn6CDfWO2m5UgqK-Sr-pjjwg2dd34HghINyEVE3T5Itg-PYKj0YMEqYVC5uIroOumu3tZy7M7156OT9EtIM2-BMTg5dhnnzv0 Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b324a37b01b644dfa301a561e6125672", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b324a37b01b644dfa301a561e6125672"}]}] Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: b49cb438da9f4b309d54bfef9fc19bda Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 43734320-cfe5-4cc4-afbe-06296b4eeaac could not be found. Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '43734320-cfe5-4cc4-afbe-06296b4eeaac'} Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43734320-cfe5-4cc4-afbe-06296b4eeaac could not be found. Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43734320-cfe5-4cc4-afbe-06296b4eeaac could not be found. Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.491726 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:08.500824 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.500824 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:08.500824 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:08.500824 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:08.500824 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:29:08.500824 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:29:08.500824 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43734320-cfe5-4cc4-afbe-06296b4eeaac could not be found. Aug 24 10:29:08.500824 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.502571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92777e3a-62ab-41b9-af51-15f2220c438e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Returning 404 to user: Instance 43734320-cfe5-4cc4-afbe-06296b4eeaac could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:29:08.503729 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-92777e3a-62ab-41b9-af51-15f2220c438e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "DELETE /compute/v2.1/servers/43734320-cfe5-4cc4-afbe-06296b4eeaac" status: 404 len: 111 microversion: 2.1 time: 0.029875 Aug 24 10:29:08.507895 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1665/3698] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:29:08 2022] DELETE /compute/v2.1/servers/43734320-cfe5-4cc4-afbe-06296b4eeaac => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:29:08.514005 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-be367163-093f-4803-87c7-9bb896445d02 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:08.514797 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-be367163-093f-4803-87c7-9bb896445d02 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 43734320-cfe5-4cc4-afbe-06296b4eeaac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:08.523780 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-be367163-093f-4803-87c7-9bb896445d02 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] HTTP exception thrown: Instance 43734320-cfe5-4cc4-afbe-06296b4eeaac could not be found. Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-be367163-093f-4803-87c7-9bb896445d02 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Request method failure captured: Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/43734320-cfe5-4cc4-afbe-06296b4eeaac HTTP/1.1 Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfwVOwKbAI3HcYW4vDUwX5tmvWZcMN8iYYPbyv0cT05fZ_Z-LEPCm4LinUuprRdXqkjYpTNDBQ5PMwhn6CDfWO2m5UgqK-Sr-pjjwg2dd34HghINyEVE3T5Itg-PYKj0YMEqYVC5uIroOumu3tZy7M7156OT9EtIM2-BMTg5dhnnzv0 Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b324a37b01b644dfa301a561e6125672", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b324a37b01b644dfa301a561e6125672"}]}] Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: b49cb438da9f4b309d54bfef9fc19bda Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 43734320-cfe5-4cc4-afbe-06296b4eeaac could not be found. Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '43734320-cfe5-4cc4-afbe-06296b4eeaac'} Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43734320-cfe5-4cc4-afbe-06296b4eeaac could not be found. Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43734320-cfe5-4cc4-afbe-06296b4eeaac could not be found. Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:08.526032 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:08.531504 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:08.531504 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:29:08.531504 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:29:08.531504 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43734320-cfe5-4cc4-afbe-06296b4eeaac could not be found. Aug 24 10:29:08.531504 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:08.534658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-be367163-093f-4803-87c7-9bb896445d02 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Returning 404 to user: Instance 43734320-cfe5-4cc4-afbe-06296b4eeaac could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:29:08.535998 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-be367163-093f-4803-87c7-9bb896445d02 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/43734320-cfe5-4cc4-afbe-06296b4eeaac" status: 404 len: 111 microversion: 2.1 time: 0.026651 Aug 24 10:29:08.541003 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1666/3699] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:08 2022] GET /compute/v2.1/servers/43734320-cfe5-4cc4-afbe-06296b4eeaac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:29:08.550135 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e4ff60ac-faa9-46fa-90bd-040eef0c1896 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:08.556740 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e4ff60ac-faa9-46fa-90bd-040eef0c1896 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:08.570119 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4ff60ac-faa9-46fa-90bd-040eef0c1896 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:08.571120 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4ff60ac-faa9-46fa-90bd-040eef0c1896 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:08.571556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4ff60ac-faa9-46fa-90bd-040eef0c1896 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:08.572273 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4ff60ac-faa9-46fa-90bd-040eef0c1896 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:08.578424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4ff60ac-faa9-46fa-90bd-040eef0c1896 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:08.578877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4ff60ac-faa9-46fa-90bd-040eef0c1896 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:08.851569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e4ff60ac-faa9-46fa-90bd-040eef0c1896 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:08.864778 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e4ff60ac-faa9-46fa-90bd-040eef0c1896 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1515 microversion: 2.1 time: 0.321117 Aug 24 10:29:08.867929 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1667/3700] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:08 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1515 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:09.011825 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-26c28f45-9f50-4a8a-ad77-340d13d038f1 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f46541950d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:09.083828 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-26c28f45-9f50-4a8a-ad77-340d13d038f1 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255" status: 200 len: 1426 microversion: 2.1 time: 0.075991 Aug 24 10:29:09.087781 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1668/3701] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:29:09 2022] GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255 => generated 1426 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:09.896587 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-88b9eed3-5687-465d-8d5e-b922df73d52f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:09.898631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-88b9eed3-5687-465d-8d5e-b922df73d52f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:09.939568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88b9eed3-5687-465d-8d5e-b922df73d52f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:09.940225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88b9eed3-5687-465d-8d5e-b922df73d52f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:09.940726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88b9eed3-5687-465d-8d5e-b922df73d52f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:09.941554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88b9eed3-5687-465d-8d5e-b922df73d52f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:09.942006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88b9eed3-5687-465d-8d5e-b922df73d52f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:09.951259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88b9eed3-5687-465d-8d5e-b922df73d52f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:10.619049 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-88b9eed3-5687-465d-8d5e-b922df73d52f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:10.650197 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-88b9eed3-5687-465d-8d5e-b922df73d52f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1515 microversion: 2.1 time: 0.753526 Aug 24 10:29:10.653198 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1669/3702] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:09 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1515 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:10.666965 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dee75bec-d925-4247-b661-93dcb7844b11 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f46541833a0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:10.782280 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dee75bec-d925-4247-b661-93dcb7844b11 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255" status: 200 len: 1426 microversion: 2.1 time: 0.123666 Aug 24 10:29:10.784028 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1670/3703] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:29:10 2022] GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255 => generated 1426 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:11.183885 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8641e838-0b72-4784-b133-a201cad974ab tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "DELETE /compute/v2.1/os-floating-ips/7a5943e5-0cc2-4c37-97f2-3e52fb634684" status: 202 len: 0 microversion: 2.1 time: 2.942555 Aug 24 10:29:11.184499 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2034/3704] 10.222.0.85 () {58 vars in 1263 bytes} [Wed Aug 24 10:29:08 2022] DELETE /compute/v2.1/os-floating-ips/7a5943e5-0cc2-4c37-97f2-3e52fb634684 => generated 0 bytes in 2944 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:29:11.195226 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-35f960b0-bfe4-42fa-9676-3cff3c5883a4 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '.version_select at 0x7f4654167d30>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:11.643865 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-35f960b0-bfe4-42fa-9676-3cff3c5883a4 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/1e6e34a4-2ed9-4318-bd71-6f23e8ed7411" status: 202 len: 0 microversion: 2.1 time: 0.453742 Aug 24 10:29:11.645062 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1671/3705] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:29:11 2022] DELETE /compute/v2.1/os-security-groups/1e6e34a4-2ed9-4318-bd71-6f23e8ed7411 => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:29:11.653941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-75a3b855-75a7-432b-89e4-131f642d53c7 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:11.654449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-75a3b855-75a7-432b-89e4-131f642d53c7 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:11.661235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75a3b855-75a7-432b-89e4-131f642d53c7 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:11.661748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75a3b855-75a7-432b-89e4-131f642d53c7 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:11.662192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75a3b855-75a7-432b-89e4-131f642d53c7 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:11.662910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75a3b855-75a7-432b-89e4-131f642d53c7 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:11.663369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75a3b855-75a7-432b-89e4-131f642d53c7 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:11.663793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75a3b855-75a7-432b-89e4-131f642d53c7 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:11.682735 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f8698413-6edc-4f8e-b80e-e29b5a2ef61e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:11.683589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f8698413-6edc-4f8e-b80e-e29b5a2ef61e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:11.692013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=1,nova_cell1:RELEASE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:11.702149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8698413-6edc-4f8e-b80e-e29b5a2ef61e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:11.703930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8698413-6edc-4f8e-b80e-e29b5a2ef61e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:11.705898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8698413-6edc-4f8e-b80e-e29b5a2ef61e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:11.708626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8698413-6edc-4f8e-b80e-e29b5a2ef61e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:11.710107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8698413-6edc-4f8e-b80e-e29b5a2ef61e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:11.712595 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8698413-6edc-4f8e-b80e-e29b5a2ef61e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:11.805049 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-75a3b855-75a7-432b-89e4-131f642d53c7 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:29:12.115230 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-75a3b855-75a7-432b-89e4-131f642d53c7 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "DELETE /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 204 len: 0 microversion: 2.1 time: 0.463926 Aug 24 10:29:12.117410 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2035/3706] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:29:11 2022] DELETE /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:12.135260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-95b5fafa-29c4-4ca3-8321-b43897bf7b54 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f4654f0b430>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:12.240857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f8698413-6edc-4f8e-b80e-e29b5a2ef61e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:12.262348 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f8698413-6edc-4f8e-b80e-e29b5a2ef61e tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1515 microversion: 2.1 time: 0.588172 Aug 24 10:29:12.264074 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-95b5fafa-29c4-4ca3-8321-b43897bf7b54 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255" status: 200 len: 1426 microversion: 2.1 time: 0.144096 Aug 24 10:29:12.277151 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1672/3707] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:11 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1515 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:12.277390 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2036/3708] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:29:12 2022] GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255 => generated 1426 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:12.277504 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c53b9d94-aa1d-4c98-8ba8-8351cd0f3abb tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:12.277504 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c53b9d94-aa1d-4c98-8ba8-8351cd0f3abb tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:12.288052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c53b9d94-aa1d-4c98-8ba8-8351cd0f3abb tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:12.288612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c53b9d94-aa1d-4c98-8ba8-8351cd0f3abb tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:12.289447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c53b9d94-aa1d-4c98-8ba8-8351cd0f3abb tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:12.290188 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c53b9d94-aa1d-4c98-8ba8-8351cd0f3abb tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:12.290714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c53b9d94-aa1d-4c98-8ba8-8351cd0f3abb tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:12.291217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c53b9d94-aa1d-4c98-8ba8-8351cd0f3abb tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:12.566175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c53b9d94-aa1d-4c98-8ba8-8351cd0f3abb tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:12.575841 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c53b9d94-aa1d-4c98-8ba8-8351cd0f3abb tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1510 microversion: 2.1 time: 0.309125 Aug 24 10:29:12.581624 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1673/3709] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:12 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1510 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:13.286911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d37bfe9d-db47-4ce8-91f2-63a73dce9c5c tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f46550923a0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:13.291761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cf036b64-e700-4deb-8307-a6b4c5883a46 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:13.292567 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cf036b64-e700-4deb-8307-a6b4c5883a46 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:13.317221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf036b64-e700-4deb-8307-a6b4c5883a46 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:13.319465 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf036b64-e700-4deb-8307-a6b4c5883a46 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:13.324171 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf036b64-e700-4deb-8307-a6b4c5883a46 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:13.325036 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf036b64-e700-4deb-8307-a6b4c5883a46 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:13.329744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf036b64-e700-4deb-8307-a6b4c5883a46 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:13.332093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf036b64-e700-4deb-8307-a6b4c5883a46 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:13.367535 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d37bfe9d-db47-4ce8-91f2-63a73dce9c5c tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255" status: 200 len: 1435 microversion: 2.1 time: 0.087290 Aug 24 10:29:13.370220 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2037/3710] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:29:13 2022] GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255 => generated 1435 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:13.384549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ad60028f-381d-4d2d-86b1-6b20d7a48b7a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f46551c65e0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:13.481760 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ad60028f-381d-4d2d-86b1-6b20d7a48b7a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255" status: 200 len: 1435 microversion: 2.1 time: 0.100188 Aug 24 10:29:13.490908 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2038/3711] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 10:29:13 2022] GET /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255 => generated 1435 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:13.509504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-60dc5e08-9ee1-424e-83ae-b11cbcb94ff2 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:13.510375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-60dc5e08-9ee1-424e-83ae-b11cbcb94ff2 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] [instance: 51be811b-0bd6-4671-831a-ba5733764143] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:13.524030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60dc5e08-9ee1-424e-83ae-b11cbcb94ff2 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:13.525442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60dc5e08-9ee1-424e-83ae-b11cbcb94ff2 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:13.526193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60dc5e08-9ee1-424e-83ae-b11cbcb94ff2 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:13.527178 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60dc5e08-9ee1-424e-83ae-b11cbcb94ff2 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:13.528034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60dc5e08-9ee1-424e-83ae-b11cbcb94ff2 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:13.528883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60dc5e08-9ee1-424e-83ae-b11cbcb94ff2 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:13.885021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cf036b64-e700-4deb-8307-a6b4c5883a46 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:13.895052 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cf036b64-e700-4deb-8307-a6b4c5883a46 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1515 microversion: 2.1 time: 0.607897 Aug 24 10:29:13.896483 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1674/3712] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:13 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1515 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:29:13.934989 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-27cd3718-ac70-4ec2-891d-6ca05a82d982 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:13.936580 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-27cd3718-ac70-4ec2-891d-6ca05a82d982 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:13.944945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27cd3718-ac70-4ec2-891d-6ca05a82d982 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:13.945863 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27cd3718-ac70-4ec2-891d-6ca05a82d982 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:13.946741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27cd3718-ac70-4ec2-891d-6ca05a82d982 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:13.947659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27cd3718-ac70-4ec2-891d-6ca05a82d982 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:13.948593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27cd3718-ac70-4ec2-891d-6ca05a82d982 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:13.949215 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27cd3718-ac70-4ec2-891d-6ca05a82d982 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:14.142884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-27cd3718-ac70-4ec2-891d-6ca05a82d982 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:14.162335 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-27cd3718-ac70-4ec2-891d-6ca05a82d982 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1510 microversion: 2.1 time: 0.264321 Aug 24 10:29:14.163640 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1675/3713] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:13 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1510 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:14.472614 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-60dc5e08-9ee1-424e-83ae-b11cbcb94ff2 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39bebd0ab646faa5109d1b2f2cae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba66b174cac4cadb9afc09f7df3e21f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:14.481566 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-60dc5e08-9ee1-424e-83ae-b11cbcb94ff2 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143" status: 200 len: 1467 microversion: 2.1 time: 0.984979 Aug 24 10:29:14.482184 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2039/3714] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:13 2022] GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143 => generated 1467 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:29:14.517605 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0095d6bd-2993-4897-85c7-3c9ea9d29461 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f46541b6040>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:14.925235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5de6fe29-e065-47e7-9a53-10198c650719 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:14.925915 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5de6fe29-e065-47e7-9a53-10198c650719 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:14.945081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5de6fe29-e065-47e7-9a53-10198c650719 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:14.945611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5de6fe29-e065-47e7-9a53-10198c650719 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:14.946060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5de6fe29-e065-47e7-9a53-10198c650719 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:14.946783 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5de6fe29-e065-47e7-9a53-10198c650719 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:14.947248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5de6fe29-e065-47e7-9a53-10198c650719 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:14.947681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5de6fe29-e065-47e7-9a53-10198c650719 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:15.565592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5de6fe29-e065-47e7-9a53-10198c650719 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:15.573893 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5de6fe29-e065-47e7-9a53-10198c650719 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1515 microversion: 2.1 time: 0.652676 Aug 24 10:29:15.578057 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2040/3715] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:14 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1515 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:29:15.590165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e7bace97-ad7d-43f0-925d-b04dbad1eb75 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:15.591058 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e7bace97-ad7d-43f0-925d-b04dbad1eb75 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:15.605048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7bace97-ad7d-43f0-925d-b04dbad1eb75 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:15.608557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7bace97-ad7d-43f0-925d-b04dbad1eb75 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:15.609000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7bace97-ad7d-43f0-925d-b04dbad1eb75 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:15.609755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7bace97-ad7d-43f0-925d-b04dbad1eb75 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:15.610215 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7bace97-ad7d-43f0-925d-b04dbad1eb75 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:15.610636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7bace97-ad7d-43f0-925d-b04dbad1eb75 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:15.817142 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0095d6bd-2993-4897-85c7-3c9ea9d29461 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "DELETE /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255" status: 204 len: 0 microversion: 2.1 time: 1.304289 Aug 24 10:29:15.818233 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1676/3716] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:14 2022] DELETE /compute/v2.1/images/bc27f23f-6051-490b-81fb-5779bf3fa255 => generated 0 bytes in 1313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:15.824286 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-760b5560-4c31-459d-bbfe-0e12f32f5d3b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:15.824792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-760b5560-4c31-459d-bbfe-0e12f32f5d3b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:15.839644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-760b5560-4c31-459d-bbfe-0e12f32f5d3b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:15.840247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-760b5560-4c31-459d-bbfe-0e12f32f5d3b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:15.840786 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-760b5560-4c31-459d-bbfe-0e12f32f5d3b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:15.841683 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-760b5560-4c31-459d-bbfe-0e12f32f5d3b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:15.842309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-760b5560-4c31-459d-bbfe-0e12f32f5d3b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:15.843652 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-760b5560-4c31-459d-bbfe-0e12f32f5d3b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:15.867833 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-760b5560-4c31-459d-bbfe-0e12f32f5d3b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] HTTP exception thrown: Instance 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 could not be found. Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-760b5560-4c31-459d-bbfe-0e12f32f5d3b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Request method failure captured: Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 HTTP/1.1 Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfwVOwKbAI3HcYW4vDUwX5tmvWZcMN8iYYPbyv0cT05fZ_Z-LEPCm4LinUuprRdXqkjYpTNDBQ5PMwhn6CDfWO2m5UgqK-Sr-pjjwg2dd34HghINyEVE3T5Itg-PYKj0YMEqYVC5uIroOumu3tZy7M7156OT9EtIM2-BMTg5dhnnzv0 Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b324a37b01b644dfa301a561e6125672", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b324a37b01b644dfa301a561e6125672"}]}] Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: b49cb438da9f4b309d54bfef9fc19bda Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 could not be found. Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6'} Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 could not be found. Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:29:15.871421 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:29:15.877323 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 could not be found. Aug 24 10:29:15.877323 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:15.877323 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:15.877323 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:15.877323 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:15.877323 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:15.877323 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:15.877323 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:29:15.877323 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:29:15.877323 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 could not be found. Aug 24 10:29:15.877323 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:15.877323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-760b5560-4c31-459d-bbfe-0e12f32f5d3b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Returning 404 to user: Instance 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:29:15.878735 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-760b5560-4c31-459d-bbfe-0e12f32f5d3b tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "DELETE /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6" status: 404 len: 111 microversion: 2.1 time: 0.058902 Aug 24 10:29:15.879572 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1677/3717] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:29:15 2022] DELETE /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:29:15.887662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f98e33d4-fee5-4290-bb62-ad0f0bc83b04 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '.version_select at 0x7f46541509d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:15.931199 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-f98e33d4-fee5-4290-bb62-ad0f0bc83b04 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] HTTP exception thrown: Image not found. Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f98e33d4-fee5-4290-bb62-ad0f0bc83b04 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Request method failure captured: Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a HTTP/1.1 Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf0Wkxl2eVmSyiitaTwzL9coVMWMYjBfKkblO2IlZVS_SHAedzSdk2ChLW22YOlqZ-Hw-16y2BkJfcH9RyuX_FrRgHeUTFLhW33WzIQ-a8dU5a3xTRV0SagfOEBmuhVkrHBgcFONBF7wp7jEmL3NKSy_PPD1DIr8fKkKgVKmMOr3Egg Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: dba66b174cac4cadb9afc09f7df3e21f Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesOneServerTestJSON-563780166 Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/dba66b174cac4cadb9afc09f7df3e21f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_dba66b174cac4cadb9afc09f7df3e21f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/dba66b174cac4cadb9afc09f7df3e21f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/dba66b174cac4cadb9afc09f7df3e21f"}]}] Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesOneServerTestJSON-563780166 Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: dba66b174cac4cadb9afc09f7df3e21f Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-563780166 Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ImagesOneServerTestJSON-563780166-project Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: fd39bebd0ab646faa5109d1b2f2cae0a Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesOneServerTestJSON-563780166-project Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: exception: Image not found. Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'b7340b09-57d9-44bf-abcf-32d7e7fbc22a'} Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b7340b09-57d9-44bf-abcf-32d7e7fbc22a to delete Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b7340b09-57d9-44bf-abcf-32d7e7fbc22a could not be found. Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:15.933251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:15.939135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:15.939135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:15.939135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:29:15.939135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:29:15.939135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:29:15.939135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:29:15.939135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:29:15.939135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:29:15.939135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 10:29:15.939135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 10:29:15.939135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 10:29:15.939135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:15.939135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:15.939135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:15.939135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:15.939135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:15.939135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:15.939135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:29:15.939135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:29:15.939135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 10:29:15.939135 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:15.939135 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f98e33d4-fee5-4290-bb62-ad0f0bc83b04 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Returning 404 to user: Image not found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:29:15.939135 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f98e33d4-fee5-4290-bb62-ad0f0bc83b04 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "DELETE /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a" status: 404 len: 62 microversion: 2.1 time: 0.055496 Aug 24 10:29:15.939135 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1678/3718] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:15 2022] DELETE /compute/v2.1/images/b7340b09-57d9-44bf-abcf-32d7e7fbc22a => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:29:15.948032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1b206d3a-76c0-447c-9f23-4f8ca37dbaa8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:15.948846 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1b206d3a-76c0-447c-9f23-4f8ca37dbaa8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:15.956854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b206d3a-76c0-447c-9f23-4f8ca37dbaa8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:15.957545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b206d3a-76c0-447c-9f23-4f8ca37dbaa8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:15.958498 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b206d3a-76c0-447c-9f23-4f8ca37dbaa8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:15.959480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b206d3a-76c0-447c-9f23-4f8ca37dbaa8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:15.960121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b206d3a-76c0-447c-9f23-4f8ca37dbaa8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:15.960696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b206d3a-76c0-447c-9f23-4f8ca37dbaa8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:15.977281 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-1b206d3a-76c0-447c-9f23-4f8ca37dbaa8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] HTTP exception thrown: Instance 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 could not be found. Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1b206d3a-76c0-447c-9f23-4f8ca37dbaa8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Request method failure captured: Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 HTTP/1.1 Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfwVOwKbAI3HcYW4vDUwX5tmvWZcMN8iYYPbyv0cT05fZ_Z-LEPCm4LinUuprRdXqkjYpTNDBQ5PMwhn6CDfWO2m5UgqK-Sr-pjjwg2dd34HghINyEVE3T5Itg-PYKj0YMEqYVC5uIroOumu3tZy7M7156OT9EtIM2-BMTg5dhnnzv0 Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b324a37b01b644dfa301a561e6125672", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b324a37b01b644dfa301a561e6125672"}]}] Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: b49cb438da9f4b309d54bfef9fc19bda Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 could not be found. Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6'} Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 could not be found. Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 could not be found. Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:15.979483 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:15.985731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:15.985731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:15.985731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:15.985731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:29:15.985731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:29:15.985731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 could not be found. Aug 24 10:29:15.985731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:29:15.987992 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e7bace97-ad7d-43f0-925d-b04dbad1eb75 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:15.988349 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1b206d3a-76c0-447c-9f23-4f8ca37dbaa8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Returning 404 to user: Instance 30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:29:15.989721 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1b206d3a-76c0-447c-9f23-4f8ca37dbaa8 tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6" status: 404 len: 111 microversion: 2.1 time: 0.045648 Aug 24 10:29:15.990992 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1679/3719] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:15 2022] GET /compute/v2.1/servers/30bdc4a2-0bdd-4cce-882a-e8b91e8bb1e6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:29:15.997513 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e7bace97-ad7d-43f0-925d-b04dbad1eb75 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1510 microversion: 2.1 time: 0.417754 Aug 24 10:29:16.002734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9e380888-60da-42ff-b685-9cbe9c40d0c3 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:16.003357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9e380888-60da-42ff-b685-9cbe9c40d0c3 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] [instance: 51be811b-0bd6-4671-831a-ba5733764143] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:16.014639 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2041/3720] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:15 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1510 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:16.019384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e380888-60da-42ff-b685-9cbe9c40d0c3 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:16.020626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e380888-60da-42ff-b685-9cbe9c40d0c3 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:16.020947 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e380888-60da-42ff-b685-9cbe9c40d0c3 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:16.022484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e380888-60da-42ff-b685-9cbe9c40d0c3 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:16.023302 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e380888-60da-42ff-b685-9cbe9c40d0c3 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:16.023955 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e380888-60da-42ff-b685-9cbe9c40d0c3 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:16.034026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-35087be9-37a8-48f2-8475-f5686e64b16e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:16.036576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-35087be9-37a8-48f2-8475-f5686e64b16e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 56dc2f7d-cae7-4b36-81e0-594f9b5a0623] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:16.051855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35087be9-37a8-48f2-8475-f5686e64b16e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:16.055156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35087be9-37a8-48f2-8475-f5686e64b16e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:16.055646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35087be9-37a8-48f2-8475-f5686e64b16e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:16.057235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35087be9-37a8-48f2-8475-f5686e64b16e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:16.058013 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9e380888-60da-42ff-b685-9cbe9c40d0c3 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] [instance: 51be811b-0bd6-4671-831a-ba5733764143] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:29:16.059082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35087be9-37a8-48f2-8475-f5686e64b16e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:16.060923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35087be9-37a8-48f2-8475-f5686e64b16e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:16.090571 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-35087be9-37a8-48f2-8475-f5686e64b16e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] HTTP exception thrown: Instance 56dc2f7d-cae7-4b36-81e0-594f9b5a0623 could not be found. Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-35087be9-37a8-48f2-8475-f5686e64b16e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Request method failure captured: Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623 HTTP/1.1 Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfwVOwKbAI3HcYW4vDUwX5tmvWZcMN8iYYPbyv0cT05fZ_Z-LEPCm4LinUuprRdXqkjYpTNDBQ5PMwhn6CDfWO2m5UgqK-Sr-pjjwg2dd34HghINyEVE3T5Itg-PYKj0YMEqYVC5uIroOumu3tZy7M7156OT9EtIM2-BMTg5dhnnzv0 Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b324a37b01b644dfa301a561e6125672", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b324a37b01b644dfa301a561e6125672"}]}] Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: b49cb438da9f4b309d54bfef9fc19bda Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 56dc2f7d-cae7-4b36-81e0-594f9b5a0623 could not be found. Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '56dc2f7d-cae7-4b36-81e0-594f9b5a0623'} Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56dc2f7d-cae7-4b36-81e0-594f9b5a0623 could not be found. Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:29:16.093368 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:29:16.098784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56dc2f7d-cae7-4b36-81e0-594f9b5a0623 could not be found. Aug 24 10:29:16.098784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:29:16.098784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:16.098784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:29:16.098784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:16.098784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:16.098784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:16.098784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:29:16.098784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:29:16.098784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56dc2f7d-cae7-4b36-81e0-594f9b5a0623 could not be found. Aug 24 10:29:16.098784 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:29:16.098784 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-35087be9-37a8-48f2-8475-f5686e64b16e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Returning 404 to user: Instance 56dc2f7d-cae7-4b36-81e0-594f9b5a0623 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:29:16.098784 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-35087be9-37a8-48f2-8475-f5686e64b16e tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "DELETE /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623" status: 404 len: 111 microversion: 2.1 time: 0.079492 Aug 24 10:29:16.102430 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2042/3721] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:29:16 2022] DELETE /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:29:16.104314 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:16.109663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ddcff2f-bcd4-4c4c-a640-02c36caa0bfb tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:16.111164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8ddcff2f-bcd4-4c4c-a640-02c36caa0bfb tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] [instance: 56dc2f7d-cae7-4b36-81e0-594f9b5a0623] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:16.117802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ddcff2f-bcd4-4c4c-a640-02c36caa0bfb tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:16.118686 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ddcff2f-bcd4-4c4c-a640-02c36caa0bfb tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:16.119383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ddcff2f-bcd4-4c4c-a640-02c36caa0bfb tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:16.120331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ddcff2f-bcd4-4c4c-a640-02c36caa0bfb tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:16.121012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ddcff2f-bcd4-4c4c-a640-02c36caa0bfb tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:16.121693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ddcff2f-bcd4-4c4c-a640-02c36caa0bfb tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:16.147679 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-8ddcff2f-bcd4-4c4c-a640-02c36caa0bfb tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] HTTP exception thrown: Instance 56dc2f7d-cae7-4b36-81e0-594f9b5a0623 could not be found. Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ddcff2f-bcd4-4c4c-a640-02c36caa0bfb tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Request method failure captured: Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623 HTTP/1.1 Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfwVOwKbAI3HcYW4vDUwX5tmvWZcMN8iYYPbyv0cT05fZ_Z-LEPCm4LinUuprRdXqkjYpTNDBQ5PMwhn6CDfWO2m5UgqK-Sr-pjjwg2dd34HghINyEVE3T5Itg-PYKj0YMEqYVC5uIroOumu3tZy7M7156OT9EtIM2-BMTg5dhnnzv0 Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b324a37b01b644dfa301a561e6125672", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b324a37b01b644dfa301a561e6125672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b324a37b01b644dfa301a561e6125672"}]}] Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: b324a37b01b644dfa301a561e6125672 Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1615508253 Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: b49cb438da9f4b309d54bfef9fc19bda Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-DeleteServersTestJSON-1615508253-project Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 56dc2f7d-cae7-4b36-81e0-594f9b5a0623 could not be found. Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '56dc2f7d-cae7-4b36-81e0-594f9b5a0623'} Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56dc2f7d-cae7-4b36-81e0-594f9b5a0623 could not be found. Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56dc2f7d-cae7-4b36-81e0-594f9b5a0623 could not be found. Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:16.166002 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:29:16.174552 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:16.174552 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:16.174552 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:16.174552 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:29:16.174552 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:29:16.174552 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56dc2f7d-cae7-4b36-81e0-594f9b5a0623 could not be found. Aug 24 10:29:16.174552 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:29:16.174552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ddcff2f-bcd4-4c4c-a640-02c36caa0bfb tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] Returning 404 to user: Instance 56dc2f7d-cae7-4b36-81e0-594f9b5a0623 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:29:16.174552 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8ddcff2f-bcd4-4c4c-a640-02c36caa0bfb tempest-DeleteServersTestJSON-1615508253 tempest-DeleteServersTestJSON-1615508253-project] 10.222.0.85 "GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623" status: 404 len: 111 microversion: 2.1 time: 0.063598 Aug 24 10:29:16.174552 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2043/3722] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:16 2022] GET /compute/v2.1/servers/56dc2f7d-cae7-4b36-81e0-594f9b5a0623 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:29:16.211459 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9e380888-60da-42ff-b685-9cbe9c40d0c3 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "DELETE /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143" status: 204 len: 0 microversion: 2.1 time: 0.218244 Aug 24 10:29:16.215390 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1680/3723] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:29:15 2022] DELETE /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:16.223664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-24144020-66af-4e0c-918d-0c00516c2e9c tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:16.224500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-24144020-66af-4e0c-918d-0c00516c2e9c tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] [instance: 51be811b-0bd6-4671-831a-ba5733764143] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:16.238148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24144020-66af-4e0c-918d-0c00516c2e9c tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:16.239478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24144020-66af-4e0c-918d-0c00516c2e9c tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:16.240139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24144020-66af-4e0c-918d-0c00516c2e9c tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:16.241370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24144020-66af-4e0c-918d-0c00516c2e9c tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:16.244509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24144020-66af-4e0c-918d-0c00516c2e9c tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:16.246112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24144020-66af-4e0c-918d-0c00516c2e9c tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:16.427650 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-25be7dfb-4133-409b-a2d8-c19bd89361ab req-69d69937-e5df-406d-89b6-b3ce60f40e15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a501f37-7cb0-4d7d-a95b-03f7aed77f9d", "name": "network-vif-deleted", "tag": "d5ccc17d-296b-4e00-ae9b-8f26eb42f6ec"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:16.452518 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-25be7dfb-4133-409b-a2d8-c19bd89361ab req-69d69937-e5df-406d-89b6-b3ce60f40e15 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:16.453090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-25be7dfb-4133-409b-a2d8-c19bd89361ab req-69d69937-e5df-406d-89b6-b3ce60f40e15 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:16.453623 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-25be7dfb-4133-409b-a2d8-c19bd89361ab req-69d69937-e5df-406d-89b6-b3ce60f40e15 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:16.468661 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-25be7dfb-4133-409b-a2d8-c19bd89361ab req-69d69937-e5df-406d-89b6-b3ce60f40e15 service nova] Creating event network-vif-deleted:d5ccc17d-296b-4e00-ae9b-8f26eb42f6ec for instance 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d on n-h2-849328-3 Aug 24 10:29:16.474592 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-25be7dfb-4133-409b-a2d8-c19bd89361ab req-69d69937-e5df-406d-89b6-b3ce60f40e15 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053381 Aug 24 10:29:16.476146 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1681/3724] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:29:16.603014 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f1101f39-cdfc-45fa-8335-304e1f0fcb42 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:16.603858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f1101f39-cdfc-45fa-8335-304e1f0fcb42 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:16.619899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1101f39-cdfc-45fa-8335-304e1f0fcb42 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:16.621247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1101f39-cdfc-45fa-8335-304e1f0fcb42 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:16.623210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1101f39-cdfc-45fa-8335-304e1f0fcb42 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:16.624925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1101f39-cdfc-45fa-8335-304e1f0fcb42 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:16.625636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1101f39-cdfc-45fa-8335-304e1f0fcb42 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:16.627379 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1101f39-cdfc-45fa-8335-304e1f0fcb42 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:16.674816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-24144020-66af-4e0c-918d-0c00516c2e9c tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39bebd0ab646faa5109d1b2f2cae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba66b174cac4cadb9afc09f7df3e21f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:16.684530 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-24144020-66af-4e0c-918d-0c00516c2e9c tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143" status: 200 len: 1473 microversion: 2.1 time: 0.463536 Aug 24 10:29:16.686515 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2044/3725] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:16 2022] GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143 => generated 1473 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:16.974419 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f1101f39-cdfc-45fa-8335-304e1f0fcb42 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:17.012878 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f1101f39-cdfc-45fa-8335-304e1f0fcb42 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1521 microversion: 2.1 time: 0.413722 Aug 24 10:29:17.025146 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1682/3726] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:16 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1521 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:17.026292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-590c414e-866b-4858-b061-974a92860be2 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:17.026292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-590c414e-866b-4858-b061-974a92860be2 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:17.032221 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-590c414e-866b-4858-b061-974a92860be2 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:17.035664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-590c414e-866b-4858-b061-974a92860be2 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:17.036301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-590c414e-866b-4858-b061-974a92860be2 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:17.037278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-590c414e-866b-4858-b061-974a92860be2 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:17.040043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-590c414e-866b-4858-b061-974a92860be2 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:17.041527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-590c414e-866b-4858-b061-974a92860be2 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:17.141997 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-590c414e-866b-4858-b061-974a92860be2 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:17.142863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-590c414e-866b-4858-b061-974a92860be2 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:17.143308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-590c414e-866b-4858-b061-974a92860be2 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:17.143934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-590c414e-866b-4858-b061-974a92860be2 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lazy-loading 'fault' on Instance uuid 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:29:17.226082 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:29:17.226373 n-d-849328-3 devstack@n-api.service[122433]: Wed Aug 24 10:29:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d (ip 10.222.0.85) !!! Aug 24 10:29:17.349979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-590c414e-866b-4858-b061-974a92860be2 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83da12005b474f1d817200fa86a285b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a932df7eb0b43fe9da0435cb6abeb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:17.376532 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-590c414e-866b-4858-b061-974a92860be2 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 200 len: 1312 microversion: 2.1 time: 0.360320 Aug 24 10:29:17.382915 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2045/3727] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:17 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 1312 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:29:17.595237 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9a0a72ec-0663-4591-8049-d656fdea2718 req-140d21a6-8ff2-451a-b3dd-4798d1117639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51be811b-0bd6-4671-831a-ba5733764143", "name": "network-vif-unplugged", "status": "completed", "tag": "c45a2f3f-9db0-4c17-83e8-0cf4d8711aba"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:17.617169 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9a0a72ec-0663-4591-8049-d656fdea2718 req-140d21a6-8ff2-451a-b3dd-4798d1117639 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:17.617773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9a0a72ec-0663-4591-8049-d656fdea2718 req-140d21a6-8ff2-451a-b3dd-4798d1117639 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:17.618534 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9a0a72ec-0663-4591-8049-d656fdea2718 req-140d21a6-8ff2-451a-b3dd-4798d1117639 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:17.659904 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9a0a72ec-0663-4591-8049-d656fdea2718 req-140d21a6-8ff2-451a-b3dd-4798d1117639 service nova] Creating event network-vif-unplugged:c45a2f3f-9db0-4c17-83e8-0cf4d8711aba for instance 51be811b-0bd6-4671-831a-ba5733764143 on n-h1-849328-3 Aug 24 10:29:17.675773 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9a0a72ec-0663-4591-8049-d656fdea2718 req-140d21a6-8ff2-451a-b3dd-4798d1117639 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082699 Aug 24 10:29:17.677539 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1683/3728] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:29:17.712182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-91fd6d35-bd7d-49af-b2bc-ddd9e6361ee1 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:17.712807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-91fd6d35-bd7d-49af-b2bc-ddd9e6361ee1 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] [instance: 51be811b-0bd6-4671-831a-ba5733764143] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:17.725234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91fd6d35-bd7d-49af-b2bc-ddd9e6361ee1 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:17.726238 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91fd6d35-bd7d-49af-b2bc-ddd9e6361ee1 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:17.726892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91fd6d35-bd7d-49af-b2bc-ddd9e6361ee1 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:17.727634 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91fd6d35-bd7d-49af-b2bc-ddd9e6361ee1 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:17.728118 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91fd6d35-bd7d-49af-b2bc-ddd9e6361ee1 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:17.741957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91fd6d35-bd7d-49af-b2bc-ddd9e6361ee1 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:18.041858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0ac6e399-9ca4-47be-beed-7005816f6437 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:18.042557 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0ac6e399-9ca4-47be-beed-7005816f6437 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:18.051278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ac6e399-9ca4-47be-beed-7005816f6437 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:18.052020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ac6e399-9ca4-47be-beed-7005816f6437 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:18.052532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ac6e399-9ca4-47be-beed-7005816f6437 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:18.053491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ac6e399-9ca4-47be-beed-7005816f6437 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:18.055809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ac6e399-9ca4-47be-beed-7005816f6437 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:18.056379 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ac6e399-9ca4-47be-beed-7005816f6437 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:18.170744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-91fd6d35-bd7d-49af-b2bc-ddd9e6361ee1 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39bebd0ab646faa5109d1b2f2cae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba66b174cac4cadb9afc09f7df3e21f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:18.190914 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-91fd6d35-bd7d-49af-b2bc-ddd9e6361ee1 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143" status: 200 len: 1473 microversion: 2.1 time: 0.484413 Aug 24 10:29:18.192704 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2046/3729] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:17 2022] GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143 => generated 1473 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:18.403639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3916209c-25ab-43c4-9c84-b0fd24b386e3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:18.404296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3916209c-25ab-43c4-9c84-b0fd24b386e3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] [instance: 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:18.416469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3916209c-25ab-43c4-9c84-b0fd24b386e3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:18.416960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3916209c-25ab-43c4-9c84-b0fd24b386e3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:18.417435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3916209c-25ab-43c4-9c84-b0fd24b386e3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:18.426084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3916209c-25ab-43c4-9c84-b0fd24b386e3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:18.432469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3916209c-25ab-43c4-9c84-b0fd24b386e3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:18.433503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3916209c-25ab-43c4-9c84-b0fd24b386e3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:18.476650 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-3916209c-25ab-43c4-9c84-b0fd24b386e3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] HTTP exception thrown: Instance 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d could not be found. Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3916209c-25ab-43c4-9c84-b0fd24b386e3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Request method failure captured: Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d HTTP/1.1 Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf0kr6XK2cgZFpjvRQvQi0I922ZRC_JeZBC2uXy9nZvbu_-r9yjP69_pH27MNW4vfmIYJcUPYwlrIl-4qzqOO7KsbS9u9yARCUAyO2SMXfX0WUrahomuI30kqrOMgN91TFersBjswiIWQ0ItCNtyYfxQRikytv4EOfP4dCzzaJ06XaI Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 8a932df7eb0b43fe9da0435cb6abeb4e Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1957725067 Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8a932df7eb0b43fe9da0435cb6abeb4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8a932df7eb0b43fe9da0435cb6abeb4e", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8a932df7eb0b43fe9da0435cb6abeb4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8a932df7eb0b43fe9da0435cb6abeb4e"}]}] Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1957725067 Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 8a932df7eb0b43fe9da0435cb6abeb4e Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1957725067 Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerRescueTestJSONUnderV235-1957725067-project Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 83da12005b474f1d817200fa86a285b4 Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1957725067-project Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d could not be found. Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '0a501f37-7cb0-4d7d-a95b-03f7aed77f9d'} Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d could not be found. Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d could not be found. Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:29:18.481719 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:18.486713 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:29:18.486713 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:18.486713 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:18.486713 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:18.486713 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:29:18.486713 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:29:18.486713 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d could not be found. Aug 24 10:29:18.486713 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:29:18.493148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3916209c-25ab-43c4-9c84-b0fd24b386e3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] Returning 404 to user: Instance 0a501f37-7cb0-4d7d-a95b-03f7aed77f9d could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:29:18.495974 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3916209c-25ab-43c4-9c84-b0fd24b386e3 tempest-ServerRescueTestJSONUnderV235-1957725067 tempest-ServerRescueTestJSONUnderV235-1957725067-project] 10.222.0.85 "GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d" status: 404 len: 111 microversion: 2.1 time: 0.097069 Aug 24 10:29:18.501836 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2047/3730] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:18 2022] GET /compute/v2.1/servers/0a501f37-7cb0-4d7d-a95b-03f7aed77f9d => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:29:19.044116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0ac6e399-9ca4-47be-beed-7005816f6437 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:19.056733 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0ac6e399-9ca4-47be-beed-7005816f6437 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1521 microversion: 2.1 time: 1.019250 Aug 24 10:29:19.078060 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1684/3731] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:18 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1521 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:29:19.219737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cf2b9455-f175-4362-8e47-c66ee1ff2563 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:19.220369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cf2b9455-f175-4362-8e47-c66ee1ff2563 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] [instance: 51be811b-0bd6-4671-831a-ba5733764143] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:19.229091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf2b9455-f175-4362-8e47-c66ee1ff2563 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:19.229888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf2b9455-f175-4362-8e47-c66ee1ff2563 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:19.230525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf2b9455-f175-4362-8e47-c66ee1ff2563 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:19.231430 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf2b9455-f175-4362-8e47-c66ee1ff2563 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:19.232059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf2b9455-f175-4362-8e47-c66ee1ff2563 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:19.232676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf2b9455-f175-4362-8e47-c66ee1ff2563 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:20.079257 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a3e79b6f-9916-4842-b299-8cde37d84f99 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:20.080526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a3e79b6f-9916-4842-b299-8cde37d84f99 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:20.086823 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cf2b9455-f175-4362-8e47-c66ee1ff2563 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39bebd0ab646faa5109d1b2f2cae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba66b174cac4cadb9afc09f7df3e21f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:20.087353 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:20.096814 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3e79b6f-9916-4842-b299-8cde37d84f99 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:20.100014 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cf2b9455-f175-4362-8e47-c66ee1ff2563 tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143" status: 200 len: 1473 microversion: 2.1 time: 0.886186 Aug 24 10:29:20.100866 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2048/3732] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:19 2022] GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143 => generated 1473 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:20.105756 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3e79b6f-9916-4842-b299-8cde37d84f99 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:20.106504 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3e79b6f-9916-4842-b299-8cde37d84f99 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:20.107691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3e79b6f-9916-4842-b299-8cde37d84f99 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:20.108447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3e79b6f-9916-4842-b299-8cde37d84f99 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:20.109242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3e79b6f-9916-4842-b299-8cde37d84f99 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:20.137018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-95cfcb0a-a304-4ff5-bdd7-7a050cdd585b req-de110169-0038-46cd-97ed-2cd736f1311a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c62a85-d3f8-4b01-af30-cc3d15ba08ab", "name": "network-vif-plugged", "status": "completed", "tag": "00d18df2-80be-44f5-bf00-939583d9cbf9"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:20.158402 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-95cfcb0a-a304-4ff5-bdd7-7a050cdd585b req-de110169-0038-46cd-97ed-2cd736f1311a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:20.160672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-95cfcb0a-a304-4ff5-bdd7-7a050cdd585b req-de110169-0038-46cd-97ed-2cd736f1311a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:20.161380 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-95cfcb0a-a304-4ff5-bdd7-7a050cdd585b req-de110169-0038-46cd-97ed-2cd736f1311a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:20.211092 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-95cfcb0a-a304-4ff5-bdd7-7a050cdd585b req-de110169-0038-46cd-97ed-2cd736f1311a service nova] Creating event network-vif-plugged:00d18df2-80be-44f5-bf00-939583d9cbf9 for instance 94c62a85-d3f8-4b01-af30-cc3d15ba08ab on n-h1-849328-3 Aug 24 10:29:20.217726 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-95cfcb0a-a304-4ff5-bdd7-7a050cdd585b req-de110169-0038-46cd-97ed-2cd736f1311a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084562 Aug 24 10:29:20.219266 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2049/3733] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:29:20.228247 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-277366ec-4069-4220-a946-fd0224e35984 req-5ad493e6-530c-4eaa-882e-a23c0efddfdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51be811b-0bd6-4671-831a-ba5733764143", "name": "network-vif-deleted", "tag": "c45a2f3f-9db0-4c17-83e8-0cf4d8711aba"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:20.243006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-277366ec-4069-4220-a946-fd0224e35984 req-5ad493e6-530c-4eaa-882e-a23c0efddfdd service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:20.243799 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-277366ec-4069-4220-a946-fd0224e35984 req-5ad493e6-530c-4eaa-882e-a23c0efddfdd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:20.244399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-277366ec-4069-4220-a946-fd0224e35984 req-5ad493e6-530c-4eaa-882e-a23c0efddfdd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:20.274859 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-277366ec-4069-4220-a946-fd0224e35984 req-5ad493e6-530c-4eaa-882e-a23c0efddfdd service nova] Creating event network-vif-deleted:c45a2f3f-9db0-4c17-83e8-0cf4d8711aba for instance 51be811b-0bd6-4671-831a-ba5733764143 on n-h1-849328-3 Aug 24 10:29:20.284557 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-277366ec-4069-4220-a946-fd0224e35984 req-5ad493e6-530c-4eaa-882e-a23c0efddfdd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062337 Aug 24 10:29:20.287591 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2050/3734] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:29:20.569724 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a3e79b6f-9916-4842-b299-8cde37d84f99 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:20.585844 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a3e79b6f-9916-4842-b299-8cde37d84f99 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1521 microversion: 2.1 time: 0.510326 Aug 24 10:29:20.613619 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1685/3735] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:20 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1521 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:21.123639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec6cac13-fb61-4c68-99a0-604fa578fa9a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:21.124348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ec6cac13-fb61-4c68-99a0-604fa578fa9a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] [instance: 51be811b-0bd6-4671-831a-ba5733764143] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:21.140164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec6cac13-fb61-4c68-99a0-604fa578fa9a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:21.140672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec6cac13-fb61-4c68-99a0-604fa578fa9a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:21.141141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec6cac13-fb61-4c68-99a0-604fa578fa9a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:21.142012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec6cac13-fb61-4c68-99a0-604fa578fa9a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:21.142483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec6cac13-fb61-4c68-99a0-604fa578fa9a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:21.142923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec6cac13-fb61-4c68-99a0-604fa578fa9a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:21.179964 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-ec6cac13-fb61-4c68-99a0-604fa578fa9a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] HTTP exception thrown: Instance 51be811b-0bd6-4671-831a-ba5733764143 could not be found. Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec6cac13-fb61-4c68-99a0-604fa578fa9a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Request method failure captured: Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143 HTTP/1.1 Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf0Wkxl2eVmSyiitaTwzL9coVMWMYjBfKkblO2IlZVS_SHAedzSdk2ChLW22YOlqZ-Hw-16y2BkJfcH9RyuX_FrRgHeUTFLhW33WzIQ-a8dU5a3xTRV0SagfOEBmuhVkrHBgcFONBF7wp7jEmL3NKSy_PPD1DIr8fKkKgVKmMOr3Egg Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: dba66b174cac4cadb9afc09f7df3e21f Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesOneServerTestJSON-563780166 Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/dba66b174cac4cadb9afc09f7df3e21f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_dba66b174cac4cadb9afc09f7df3e21f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/dba66b174cac4cadb9afc09f7df3e21f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/dba66b174cac4cadb9afc09f7df3e21f"}]}] Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesOneServerTestJSON-563780166 Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: dba66b174cac4cadb9afc09f7df3e21f Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-563780166 Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ImagesOneServerTestJSON-563780166-project Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: fd39bebd0ab646faa5109d1b2f2cae0a Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesOneServerTestJSON-563780166-project Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 51be811b-0bd6-4671-831a-ba5733764143 could not be found. Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '51be811b-0bd6-4671-831a-ba5733764143'} Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51be811b-0bd6-4671-831a-ba5733764143 could not be found. Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51be811b-0bd6-4671-831a-ba5733764143 could not be found. Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:29:21.187249 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:29:21.193001 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:29:21.193001 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:29:21.193001 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:29:21.193001 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:29:21.193001 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:29:21.193001 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51be811b-0bd6-4671-831a-ba5733764143 could not be found. Aug 24 10:29:21.193001 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:29:21.197107 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec6cac13-fb61-4c68-99a0-604fa578fa9a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] Returning 404 to user: Instance 51be811b-0bd6-4671-831a-ba5733764143 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:29:21.205458 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ec6cac13-fb61-4c68-99a0-604fa578fa9a tempest-ImagesOneServerTestJSON-563780166 tempest-ImagesOneServerTestJSON-563780166-project] 10.222.0.85 "GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143" status: 404 len: 111 microversion: 2.1 time: 0.087058 Aug 24 10:29:21.209860 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2051/3736] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:21 2022] GET /compute/v2.1/servers/51be811b-0bd6-4671-831a-ba5733764143 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:29:21.607593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c997be41-65f3-4aa9-9733-14c63fd83d49 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:21.608224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c997be41-65f3-4aa9-9733-14c63fd83d49 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:21.617893 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c997be41-65f3-4aa9-9733-14c63fd83d49 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:21.618375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c997be41-65f3-4aa9-9733-14c63fd83d49 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:21.619002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c997be41-65f3-4aa9-9733-14c63fd83d49 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:21.619891 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c997be41-65f3-4aa9-9733-14c63fd83d49 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:21.620616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c997be41-65f3-4aa9-9733-14c63fd83d49 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:21.621256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c997be41-65f3-4aa9-9733-14c63fd83d49 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:22.161396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c997be41-65f3-4aa9-9733-14c63fd83d49 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:22.171687 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c997be41-65f3-4aa9-9733-14c63fd83d49 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1521 microversion: 2.1 time: 0.568022 Aug 24 10:29:22.172286 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1686/3737] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:21 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1521 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:23.201836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-625042fb-ab98-4de1-aa04-f0df2729860b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:23.202532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-625042fb-ab98-4de1-aa04-f0df2729860b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:23.219142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-625042fb-ab98-4de1-aa04-f0df2729860b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:23.221029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-625042fb-ab98-4de1-aa04-f0df2729860b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:23.221758 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-625042fb-ab98-4de1-aa04-f0df2729860b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:23.222777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-625042fb-ab98-4de1-aa04-f0df2729860b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:23.223531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-625042fb-ab98-4de1-aa04-f0df2729860b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:23.224231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-625042fb-ab98-4de1-aa04-f0df2729860b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:23.748568 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-625042fb-ab98-4de1-aa04-f0df2729860b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:23.798878 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-625042fb-ab98-4de1-aa04-f0df2729860b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1506 microversion: 2.1 time: 0.608097 Aug 24 10:29:23.800191 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2052/3738] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:23 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1506 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:23.827787 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f3bf715d-13d8-4457-9245-0d5b99cc0b3f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:23.828406 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f3bf715d-13d8-4457-9245-0d5b99cc0b3f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:23.861452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3bf715d-13d8-4457-9245-0d5b99cc0b3f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:23.861996 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3bf715d-13d8-4457-9245-0d5b99cc0b3f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:23.862450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3bf715d-13d8-4457-9245-0d5b99cc0b3f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:23.863208 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3bf715d-13d8-4457-9245-0d5b99cc0b3f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:23.863658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3bf715d-13d8-4457-9245-0d5b99cc0b3f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:23.866571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3bf715d-13d8-4457-9245-0d5b99cc0b3f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:24.573165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f3bf715d-13d8-4457-9245-0d5b99cc0b3f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:24.590069 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f3bf715d-13d8-4457-9245-0d5b99cc0b3f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 200 len: 1506 microversion: 2.1 time: 0.765655 Aug 24 10:29:24.611574 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1687/3739] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:23 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 1506 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:24.627360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ca3d1259-dfc3-48d8-83e1-d3edf3566fa4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:24.627360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ca3d1259-dfc3-48d8-83e1-d3edf3566fa4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:24.630403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca3d1259-dfc3-48d8-83e1-d3edf3566fa4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:24.630946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca3d1259-dfc3-48d8-83e1-d3edf3566fa4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:24.631381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca3d1259-dfc3-48d8-83e1-d3edf3566fa4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:24.634079 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca3d1259-dfc3-48d8-83e1-d3edf3566fa4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:24.635906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca3d1259-dfc3-48d8-83e1-d3edf3566fa4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:24.636393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca3d1259-dfc3-48d8-83e1-d3edf3566fa4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:24.698963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ca3d1259-dfc3-48d8-83e1-d3edf3566fa4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:29:24.769210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-17e767ec-d47e-48c7-82f9-1cd8de285389 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:24.770387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-17e767ec-d47e-48c7-82f9-1cd8de285389 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:24.787265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17e767ec-d47e-48c7-82f9-1cd8de285389 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:24.793436 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17e767ec-d47e-48c7-82f9-1cd8de285389 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:24.794675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17e767ec-d47e-48c7-82f9-1cd8de285389 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:24.796129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17e767ec-d47e-48c7-82f9-1cd8de285389 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:24.800184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17e767ec-d47e-48c7-82f9-1cd8de285389 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:24.800839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17e767ec-d47e-48c7-82f9-1cd8de285389 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:24.852009 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ca3d1259-dfc3-48d8-83e1-d3edf3566fa4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "DELETE /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 204 len: 0 microversion: 2.1 time: 0.241244 Aug 24 10:29:24.853249 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2053/3740] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:29:24 2022] DELETE /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:25.099428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-09afcd67-318b-438a-81c2-1dfd4875bf96 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1801039798", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "abdb34de-c2c8-4907-9dd2-7c1884b22f8b"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:25.185788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-09afcd67-318b-438a-81c2-1dfd4875bf96 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] validate_networks() for [('abdb34de-c2c8-4907-9dd2-7c1884b22f8b', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:29:25.563732 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-17e767ec-d47e-48c7-82f9-1cd8de285389 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:25.583094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-17e767ec-d47e-48c7-82f9-1cd8de285389 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:25.591605 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-17e767ec-d47e-48c7-82f9-1cd8de285389 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:25.593303 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-17e767ec-d47e-48c7-82f9-1cd8de285389 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 2953 microversion: 2.42 time: 0.835651 Aug 24 10:29:25.609410 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1688/3741] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:29:24 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 2953 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:29:25.620672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6a4dcc0f-3be9-4655-afb2-af1a131b1fd3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:25.621496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6a4dcc0f-3be9-4655-afb2-af1a131b1fd3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:25.628232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a4dcc0f-3be9-4655-afb2-af1a131b1fd3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:25.629111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a4dcc0f-3be9-4655-afb2-af1a131b1fd3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:25.630063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a4dcc0f-3be9-4655-afb2-af1a131b1fd3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:25.630945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a4dcc0f-3be9-4655-afb2-af1a131b1fd3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:25.631574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a4dcc0f-3be9-4655-afb2-af1a131b1fd3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:25.632172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a4dcc0f-3be9-4655-afb2-af1a131b1fd3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:25.831286 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6a4dcc0f-3be9-4655-afb2-af1a131b1fd3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.214926 Aug 24 10:29:25.832475 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1689/3742] 10.222.0.85 () {60 vars in 1316 bytes} [Wed Aug 24 10:29:25 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa/os-interface => generated 1830 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:29:26.834971 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-09afcd67-318b-438a-81c2-1dfd4875bf96 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:29:26.836742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-09afcd67-318b-438a-81c2-1dfd4875bf96 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:29:26.837650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-09afcd67-318b-438a-81c2-1dfd4875bf96 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:29:26.838410 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-09afcd67-318b-438a-81c2-1dfd4875bf96 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:29:26.839208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-09afcd67-318b-438a-81c2-1dfd4875bf96 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:29:26.858505 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09afcd67-318b-438a-81c2-1dfd4875bf96 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:26.859302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09afcd67-318b-438a-81c2-1dfd4875bf96 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:26.860135 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09afcd67-318b-438a-81c2-1dfd4875bf96 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:26.861186 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09afcd67-318b-438a-81c2-1dfd4875bf96 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:26.862296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09afcd67-318b-438a-81c2-1dfd4875bf96 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:26.862923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09afcd67-318b-438a-81c2-1dfd4875bf96 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:26.896470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-09afcd67-318b-438a-81c2-1dfd4875bf96 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Getting quotas for project 9dfeb7213b504942a32e3b8ab5c46798. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:29:26.904876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-09afcd67-318b-438a-81c2-1dfd4875bf96 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Getting quotas for user ec7478d6249742d0a177be1168a8c481 and project 9dfeb7213b504942a32e3b8ab5c46798. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:29:26.925836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-09afcd67-318b-438a-81c2-1dfd4875bf96 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:29:26.929779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-09afcd67-318b-438a-81c2-1dfd4875bf96 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: fef78678-d8b4-4503-a30a-424e3a1005fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:29:27.009471 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-09afcd67-318b-438a-81c2-1dfd4875bf96 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.915580 Aug 24 10:29:27.010863 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2054/3743] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:29:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:29:27.024316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fa7d9cb2-e4dc-435c-b00c-f744ea0cae11 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:27.025772 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fa7d9cb2-e4dc-435c-b00c-f744ea0cae11 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: fef78678-d8b4-4503-a30a-424e3a1005fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:27.209853 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fa7d9cb2-e4dc-435c-b00c-f744ea0cae11 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:27.231493 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fa7d9cb2-e4dc-435c-b00c-f744ea0cae11 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb" status: 200 len: 1218 microversion: 2.1 time: 0.211026 Aug 24 10:29:27.232293 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1690/3744] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:27 2022] GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb => generated 1218 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:28.266781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a0565ddf-3e87-4065-8d62-57fa2e3b0e03 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:28.269277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a0565ddf-3e87-4065-8d62-57fa2e3b0e03 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: fef78678-d8b4-4503-a30a-424e3a1005fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:28.292763 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0565ddf-3e87-4065-8d62-57fa2e3b0e03 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:28.296145 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0565ddf-3e87-4065-8d62-57fa2e3b0e03 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:28.296917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0565ddf-3e87-4065-8d62-57fa2e3b0e03 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:28.298738 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0565ddf-3e87-4065-8d62-57fa2e3b0e03 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:28.302110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0565ddf-3e87-4065-8d62-57fa2e3b0e03 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:28.303210 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0565ddf-3e87-4065-8d62-57fa2e3b0e03 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:28.634451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a0565ddf-3e87-4065-8d62-57fa2e3b0e03 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:28.640844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:28.675706 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a0565ddf-3e87-4065-8d62-57fa2e3b0e03 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb" status: 200 len: 1214 microversion: 2.1 time: 0.406864 Aug 24 10:29:28.680139 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2055/3745] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:28 2022] GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb => generated 1214 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:28.792129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3beecd35-2c74-4c70-9206-43686ad0b069 req-9d404356-8e0c-4f13-be65-c7802a9f87c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c62a85-d3f8-4b01-af30-cc3d15ba08ab", "name": "network-vif-deleted", "tag": "00d18df2-80be-44f5-bf00-939583d9cbf9"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:28.842966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3beecd35-2c74-4c70-9206-43686ad0b069 req-9d404356-8e0c-4f13-be65-c7802a9f87c0 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:28.843572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3beecd35-2c74-4c70-9206-43686ad0b069 req-9d404356-8e0c-4f13-be65-c7802a9f87c0 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:28.843878 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3beecd35-2c74-4c70-9206-43686ad0b069 req-9d404356-8e0c-4f13-be65-c7802a9f87c0 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:28.891856 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3beecd35-2c74-4c70-9206-43686ad0b069 req-9d404356-8e0c-4f13-be65-c7802a9f87c0 service nova] Creating event network-vif-deleted:00d18df2-80be-44f5-bf00-939583d9cbf9 for instance 94c62a85-d3f8-4b01-af30-cc3d15ba08ab on n-h1-849328-3 Aug 24 10:29:28.909899 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3beecd35-2c74-4c70-9206-43686ad0b069 req-9d404356-8e0c-4f13-be65-c7802a9f87c0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121356 Aug 24 10:29:28.915724 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1691/3746] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:29:29.701677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-02774c7b-6719-4385-9f5a-733507263684 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:29.703505 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-02774c7b-6719-4385-9f5a-733507263684 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: fef78678-d8b4-4503-a30a-424e3a1005fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:29.730139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02774c7b-6719-4385-9f5a-733507263684 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:29.731457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02774c7b-6719-4385-9f5a-733507263684 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:29.734727 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02774c7b-6719-4385-9f5a-733507263684 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:29.739869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02774c7b-6719-4385-9f5a-733507263684 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:29.742245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02774c7b-6719-4385-9f5a-733507263684 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:29.744689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02774c7b-6719-4385-9f5a-733507263684 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:30.619929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-02774c7b-6719-4385-9f5a-733507263684 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:30.630616 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-02774c7b-6719-4385-9f5a-733507263684 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb" status: 200 len: 1276 microversion: 2.1 time: 0.932736 Aug 24 10:29:30.632631 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2056/3747] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:29 2022] GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb => generated 1276 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:31.661668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-72c53f5f-8b59-42d7-b19a-8830d72e2d3b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:31.663059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-72c53f5f-8b59-42d7-b19a-8830d72e2d3b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: fef78678-d8b4-4503-a30a-424e3a1005fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:31.678573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72c53f5f-8b59-42d7-b19a-8830d72e2d3b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:31.679124 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72c53f5f-8b59-42d7-b19a-8830d72e2d3b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:31.679583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72c53f5f-8b59-42d7-b19a-8830d72e2d3b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:31.681682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72c53f5f-8b59-42d7-b19a-8830d72e2d3b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:31.684112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72c53f5f-8b59-42d7-b19a-8830d72e2d3b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:31.684753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72c53f5f-8b59-42d7-b19a-8830d72e2d3b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:31.882929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-72c53f5f-8b59-42d7-b19a-8830d72e2d3b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:31.900363 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-72c53f5f-8b59-42d7-b19a-8830d72e2d3b tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb" status: 200 len: 1276 microversion: 2.1 time: 0.244886 Aug 24 10:29:31.904920 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1692/3748] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:31 2022] GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb => generated 1276 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:32.929225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9184186d-a96c-4298-a09a-82e1f49c579f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:32.930030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9184186d-a96c-4298-a09a-82e1f49c579f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: fef78678-d8b4-4503-a30a-424e3a1005fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:32.937852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:32.948228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9184186d-a96c-4298-a09a-82e1f49c579f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:32.949565 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9184186d-a96c-4298-a09a-82e1f49c579f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:32.950704 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9184186d-a96c-4298-a09a-82e1f49c579f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:32.951851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9184186d-a96c-4298-a09a-82e1f49c579f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:32.952864 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9184186d-a96c-4298-a09a-82e1f49c579f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:32.953557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9184186d-a96c-4298-a09a-82e1f49c579f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:34.514761 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9184186d-a96c-4298-a09a-82e1f49c579f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:34.527417 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9184186d-a96c-4298-a09a-82e1f49c579f tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb" status: 200 len: 1318 microversion: 2.1 time: 1.605402 Aug 24 10:29:34.528177 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2057/3749] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:32 2022] GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb => generated 1318 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:35.484434 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-5d7cb148-75d7-4588-8d45-7c3b9f115b50 req-9f758ee0-2f31-45e4-8407-442a0acd7994 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fef78678-d8b4-4503-a30a-424e3a1005fb", "tag": "d5c49cec-43e0-435f-8e92-63f5fd3b7204"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:35.529317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5d7cb148-75d7-4588-8d45-7c3b9f115b50 req-9f758ee0-2f31-45e4-8407-442a0acd7994 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:35.529807 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5d7cb148-75d7-4588-8d45-7c3b9f115b50 req-9f758ee0-2f31-45e4-8407-442a0acd7994 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:35.530237 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5d7cb148-75d7-4588-8d45-7c3b9f115b50 req-9f758ee0-2f31-45e4-8407-442a0acd7994 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:35.549005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b9e59a3c-bb3a-4396-a10d-7e397d2e7b00 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:35.549776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b9e59a3c-bb3a-4396-a10d-7e397d2e7b00 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: fef78678-d8b4-4503-a30a-424e3a1005fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:35.559138 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-5d7cb148-75d7-4588-8d45-7c3b9f115b50 req-9f758ee0-2f31-45e4-8407-442a0acd7994 service nova] Creating event network-changed:d5c49cec-43e0-435f-8e92-63f5fd3b7204 for instance fef78678-d8b4-4503-a30a-424e3a1005fb on n-h2-849328-3 Aug 24 10:29:35.562016 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9e59a3c-bb3a-4396-a10d-7e397d2e7b00 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:35.563835 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9e59a3c-bb3a-4396-a10d-7e397d2e7b00 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:35.565088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9e59a3c-bb3a-4396-a10d-7e397d2e7b00 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:35.567983 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9e59a3c-bb3a-4396-a10d-7e397d2e7b00 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:35.575775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9e59a3c-bb3a-4396-a10d-7e397d2e7b00 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:35.577718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9e59a3c-bb3a-4396-a10d-7e397d2e7b00 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:35.579444 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-5d7cb148-75d7-4588-8d45-7c3b9f115b50 req-9f758ee0-2f31-45e4-8407-442a0acd7994 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096680 Aug 24 10:29:35.583901 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1693/3750] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:29:36.880184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:36.913811 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:37.002270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b9e59a3c-bb3a-4396-a10d-7e397d2e7b00 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:37.017330 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b9e59a3c-bb3a-4396-a10d-7e397d2e7b00 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb" status: 200 len: 1318 microversion: 2.1 time: 1.472159 Aug 24 10:29:37.031934 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2058/3751] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:35 2022] GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb => generated 1318 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:29:38.039635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:38.044958 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-407ea02f-f2a9-44dd-b7ea-8aab0bf97bdf tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:38.046291 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-407ea02f-f2a9-44dd-b7ea-8aab0bf97bdf tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: fef78678-d8b4-4503-a30a-424e3a1005fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:38.064008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-407ea02f-f2a9-44dd-b7ea-8aab0bf97bdf tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:38.064714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-407ea02f-f2a9-44dd-b7ea-8aab0bf97bdf tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:38.065564 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-407ea02f-f2a9-44dd-b7ea-8aab0bf97bdf tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:38.068192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-407ea02f-f2a9-44dd-b7ea-8aab0bf97bdf tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:38.068843 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-407ea02f-f2a9-44dd-b7ea-8aab0bf97bdf tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:38.072168 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-407ea02f-f2a9-44dd-b7ea-8aab0bf97bdf tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:38.662470 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-407ea02f-f2a9-44dd-b7ea-8aab0bf97bdf tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:38.678860 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-407ea02f-f2a9-44dd-b7ea-8aab0bf97bdf tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb" status: 200 len: 1318 microversion: 2.1 time: 0.642032 Aug 24 10:29:38.679470 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1694/3752] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:38 2022] GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb => generated 1318 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:39.699260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c81b61cd-1901-4a71-bcae-d55175bdb228 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:39.699900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c81b61cd-1901-4a71-bcae-d55175bdb228 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: fef78678-d8b4-4503-a30a-424e3a1005fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:39.742075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c81b61cd-1901-4a71-bcae-d55175bdb228 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:39.743839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c81b61cd-1901-4a71-bcae-d55175bdb228 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:39.744927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c81b61cd-1901-4a71-bcae-d55175bdb228 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:39.746474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c81b61cd-1901-4a71-bcae-d55175bdb228 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:39.747242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c81b61cd-1901-4a71-bcae-d55175bdb228 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:39.748136 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c81b61cd-1901-4a71-bcae-d55175bdb228 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:40.512009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c81b61cd-1901-4a71-bcae-d55175bdb228 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:40.531791 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c81b61cd-1901-4a71-bcae-d55175bdb228 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb" status: 200 len: 1318 microversion: 2.1 time: 0.836479 Aug 24 10:29:40.532659 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2059/3753] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:39 2022] GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb => generated 1318 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:40.859546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-de7010ab-f08f-4ae2-a7c6-399622418b11 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] Action: 'create', calling method: .version_select at 0x7f46541d2160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-513548798", "description": "tempest-description-1623876038"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:41.557897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8d28c4d7-f6a8-47ec-94aa-ad802fa6e0e4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:41.558557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8d28c4d7-f6a8-47ec-94aa-ad802fa6e0e4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: fef78678-d8b4-4503-a30a-424e3a1005fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:41.571512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d28c4d7-f6a8-47ec-94aa-ad802fa6e0e4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:41.574190 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d28c4d7-f6a8-47ec-94aa-ad802fa6e0e4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:41.575764 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d28c4d7-f6a8-47ec-94aa-ad802fa6e0e4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:41.576693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d28c4d7-f6a8-47ec-94aa-ad802fa6e0e4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:41.579819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d28c4d7-f6a8-47ec-94aa-ad802fa6e0e4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:41.580487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d28c4d7-f6a8-47ec-94aa-ad802fa6e0e4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:42.000754 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-de7010ab-f08f-4ae2-a7c6-399622418b11 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] 10.222.0.85 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.787877 Aug 24 10:29:42.001451 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1695/3754] 10.222.0.85 () {60 vars in 1180 bytes} [Wed Aug 24 10:29:40 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:29:42.014648 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d069a261-a500-44db-a74b-cc468702f045 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] Action: 'create', calling method: .version_select at 0x7f4654150550>, body: {"security_group_rule": {"parent_group_id": "48ef74e2-d488-454b-a526-4d786a0ed769", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:42.100664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8d28c4d7-f6a8-47ec-94aa-ad802fa6e0e4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:42.118622 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8d28c4d7-f6a8-47ec-94aa-ad802fa6e0e4 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb" status: 200 len: 1318 microversion: 2.1 time: 0.566371 Aug 24 10:29:42.128970 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2060/3755] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:41 2022] GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb => generated 1318 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:29:43.050737 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d069a261-a500-44db-a74b-cc468702f045 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] 10.222.0.85 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.040246 Aug 24 10:29:43.058730 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1696/3756] 10.222.0.85 () {60 vars in 1195 bytes} [Wed Aug 24 10:29:42 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:29:43.065278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e7a927f4-08d7-4531-983a-5da041fea350 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] Action: 'create', calling method: .version_select at 0x7f4654efbca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1324892072", "description": "tempest-description-357468186"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:43.140901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ce2fa899-f757-4b57-bc64-13e5b6144fa6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:43.141881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ce2fa899-f757-4b57-bc64-13e5b6144fa6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: fef78678-d8b4-4503-a30a-424e3a1005fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:43.156076 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce2fa899-f757-4b57-bc64-13e5b6144fa6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:43.161331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce2fa899-f757-4b57-bc64-13e5b6144fa6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:43.162036 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce2fa899-f757-4b57-bc64-13e5b6144fa6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:43.162958 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce2fa899-f757-4b57-bc64-13e5b6144fa6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:43.166069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce2fa899-f757-4b57-bc64-13e5b6144fa6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:43.166733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce2fa899-f757-4b57-bc64-13e5b6144fa6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:43.484896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ce2fa899-f757-4b57-bc64-13e5b6144fa6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:43.498540 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ce2fa899-f757-4b57-bc64-13e5b6144fa6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb" status: 200 len: 1318 microversion: 2.1 time: 0.362428 Aug 24 10:29:43.499148 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1697/3757] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:43 2022] GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:29:43.514621 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-ea2cadc5-1976-44da-9ef3-59197a2fb2ea req-4921e4b6-c512-4e6b-9f04-15109e66ae40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef78678-d8b4-4503-a30a-424e3a1005fb", "name": "network-vif-plugged", "status": "completed", "tag": "d5c49cec-43e0-435f-8e92-63f5fd3b7204"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:43.541531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ea2cadc5-1976-44da-9ef3-59197a2fb2ea req-4921e4b6-c512-4e6b-9f04-15109e66ae40 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:43.543641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ea2cadc5-1976-44da-9ef3-59197a2fb2ea req-4921e4b6-c512-4e6b-9f04-15109e66ae40 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:43.544256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ea2cadc5-1976-44da-9ef3-59197a2fb2ea req-4921e4b6-c512-4e6b-9f04-15109e66ae40 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:43.583493 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-ea2cadc5-1976-44da-9ef3-59197a2fb2ea req-4921e4b6-c512-4e6b-9f04-15109e66ae40 service nova] Creating event network-vif-plugged:d5c49cec-43e0-435f-8e92-63f5fd3b7204 for instance fef78678-d8b4-4503-a30a-424e3a1005fb on n-h2-849328-3 Aug 24 10:29:43.603366 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-ea2cadc5-1976-44da-9ef3-59197a2fb2ea req-4921e4b6-c512-4e6b-9f04-15109e66ae40 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102877 Aug 24 10:29:43.604845 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1698/3758] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:29:44.520804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5715fcc5-e01f-47d4-8950-4cca7e7f8bd7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:44.521665 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5715fcc5-e01f-47d4-8950-4cca7e7f8bd7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: fef78678-d8b4-4503-a30a-424e3a1005fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:44.543470 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5715fcc5-e01f-47d4-8950-4cca7e7f8bd7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:44.543974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5715fcc5-e01f-47d4-8950-4cca7e7f8bd7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:44.546715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5715fcc5-e01f-47d4-8950-4cca7e7f8bd7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:44.550766 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5715fcc5-e01f-47d4-8950-4cca7e7f8bd7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:44.554240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5715fcc5-e01f-47d4-8950-4cca7e7f8bd7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:44.555078 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5715fcc5-e01f-47d4-8950-4cca7e7f8bd7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:45.103959 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e7a927f4-08d7-4531-983a-5da041fea350 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] 10.222.0.85 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 2.043723 Aug 24 10:29:45.104923 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2061/3759] 10.222.0.85 () {60 vars in 1180 bytes} [Wed Aug 24 10:29:43 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 2045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:29:45.122785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1f17cf37-8fcc-4eb6-bd66-2a747f6a9e97 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] Action: 'create', calling method: .version_select at 0x7f465a2aac10>, body: {"security_group_rule": {"parent_group_id": "b93d9170-39bb-4e1d-a86b-00048c834d9d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:45.499236 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5715fcc5-e01f-47d4-8950-4cca7e7f8bd7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:45.509365 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5715fcc5-e01f-47d4-8950-4cca7e7f8bd7 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb" status: 200 len: 1318 microversion: 2.1 time: 0.993329 Aug 24 10:29:45.517402 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1699/3760] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:44 2022] GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb => generated 1318 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:29:47.066262 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1f17cf37-8fcc-4eb6-bd66-2a747f6a9e97 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] 10.222.0.85 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.952804 Aug 24 10:29:47.067449 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2062/3761] 10.222.0.85 () {60 vars in 1195 bytes} [Wed Aug 24 10:29:45 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1954 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:29:47.075072 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7b248522-32fe-4762-bab5-0df07021bf91 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:47.076302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7b248522-32fe-4762-bab5-0df07021bf91 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: fef78678-d8b4-4503-a30a-424e3a1005fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:47.129790 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b248522-32fe-4762-bab5-0df07021bf91 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:47.133812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b248522-32fe-4762-bab5-0df07021bf91 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:47.135122 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b248522-32fe-4762-bab5-0df07021bf91 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:47.139583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b248522-32fe-4762-bab5-0df07021bf91 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:47.142260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b248522-32fe-4762-bab5-0df07021bf91 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:47.145455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b248522-32fe-4762-bab5-0df07021bf91 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:47.235345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-efeb79c7-91f7-4ac0-8358-a64a249ebfaf tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-778865677", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:47.353754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-efeb79c7-91f7-4ac0-8358-a64a249ebfaf tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] validate_networks() for [('796beb17-b5f5-484d-a9eb-b33ca6b1743d', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:29:48.291046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7b248522-32fe-4762-bab5-0df07021bf91 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:48.304279 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7b248522-32fe-4762-bab5-0df07021bf91 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb" status: 200 len: 1508 microversion: 2.1 time: 1.235499 Aug 24 10:29:48.321148 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2063/3762] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:47 2022] GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb => generated 1508 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:48.344085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-efeb79c7-91f7-4ac0-8358-a64a249ebfaf tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:29:48.345301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-efeb79c7-91f7-4ac0-8358-a64a249ebfaf tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:29:48.346092 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-efeb79c7-91f7-4ac0-8358-a64a249ebfaf tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:29:48.346728 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-efeb79c7-91f7-4ac0-8358-a64a249ebfaf tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:29:48.347361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-efeb79c7-91f7-4ac0-8358-a64a249ebfaf tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:29:48.361027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-51bad1ba-0d43-4777-bca3-f795bd54b76c tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] Action: 'create', calling method: .version_select at 0x7f465a2aa3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-406545002", "description": "tempest-description-1694142434"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:48.371693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-efeb79c7-91f7-4ac0-8358-a64a249ebfaf tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:48.373104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-efeb79c7-91f7-4ac0-8358-a64a249ebfaf tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:48.374442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-efeb79c7-91f7-4ac0-8358-a64a249ebfaf tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:48.377801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-efeb79c7-91f7-4ac0-8358-a64a249ebfaf tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:48.378755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-efeb79c7-91f7-4ac0-8358-a64a249ebfaf tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:48.380711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-efeb79c7-91f7-4ac0-8358-a64a249ebfaf tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:48.406596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:48.445495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-efeb79c7-91f7-4ac0-8358-a64a249ebfaf tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Getting quotas for project 125d2dd1d22140abaa36184e3628a339. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:29:48.460142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-efeb79c7-91f7-4ac0-8358-a64a249ebfaf tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Getting quotas for user 133e99904a6b4574933cad73d0f2293f and project 125d2dd1d22140abaa36184e3628a339. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:29:48.491684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-efeb79c7-91f7-4ac0-8358-a64a249ebfaf tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:29:48.497633 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-efeb79c7-91f7-4ac0-8358-a64a249ebfaf tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:29:48.604490 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-efeb79c7-91f7-4ac0-8358-a64a249ebfaf tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.172148 Aug 24 10:29:48.609504 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1700/3763] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:29:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 2178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:29:48.621523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-db13823f-9661-48a3-802c-756b250de754 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:48.622414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-db13823f-9661-48a3-802c-756b250de754 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: fef78678-d8b4-4503-a30a-424e3a1005fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:48.640049 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db13823f-9661-48a3-802c-756b250de754 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:48.643822 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db13823f-9661-48a3-802c-756b250de754 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:48.644815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db13823f-9661-48a3-802c-756b250de754 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:48.647096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db13823f-9661-48a3-802c-756b250de754 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:48.651141 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db13823f-9661-48a3-802c-756b250de754 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:48.652034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db13823f-9661-48a3-802c-756b250de754 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:48.966042 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-51bad1ba-0d43-4777-bca3-f795bd54b76c tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] 10.222.0.85 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.651623 Aug 24 10:29:48.971142 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2064/3764] 10.222.0.85 () {60 vars in 1180 bytes} [Wed Aug 24 10:29:48 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:29:48.983383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c0a81799-36f2-4138-bf8d-7e733dc40586 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:49.002294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c0a81799-36f2-4138-bf8d-7e733dc40586 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:49.045504 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-db13823f-9661-48a3-802c-756b250de754 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:49.080260 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-db13823f-9661-48a3-802c-756b250de754 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb" status: 200 len: 1508 microversion: 2.1 time: 0.469198 Aug 24 10:29:49.109473 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1701/3765] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:48 2022] GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb => generated 1508 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:49.123026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a1fd6126-6791-4c50-b745-aa210cba6b03 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] Action: 'create', calling method: .version_select at 0x7f4654141c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-334655000", "description": "tempest-description-246837561"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:49.672968 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a1fd6126-6791-4c50-b745-aa210cba6b03 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] 10.222.0.85 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.562113 Aug 24 10:29:49.673742 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1702/3766] 10.222.0.85 () {60 vars in 1180 bytes} [Wed Aug 24 10:29:49 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:29:49.690577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-155369d5-728d-4420-8201-65738864929a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:49.700558 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-155369d5-728d-4420-8201-65738864929a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: fef78678-d8b4-4503-a30a-424e3a1005fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:49.714931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-155369d5-728d-4420-8201-65738864929a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:49.715431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-155369d5-728d-4420-8201-65738864929a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:49.717795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-155369d5-728d-4420-8201-65738864929a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:49.718744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-155369d5-728d-4420-8201-65738864929a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:49.719365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-155369d5-728d-4420-8201-65738864929a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:49.722115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-155369d5-728d-4420-8201-65738864929a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:49.830478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c0a81799-36f2-4138-bf8d-7e733dc40586 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:49.845759 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c0a81799-36f2-4138-bf8d-7e733dc40586 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1221 microversion: 2.1 time: 0.871375 Aug 24 10:29:49.846996 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2065/3767] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:48 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1221 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:49.858511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-af680839-305d-4099-98f6-f25287cc7c7c tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] Action: 'create', calling method: .version_select at 0x7f4654ed1790>, body: {"security_group_rule": {"parent_group_id": "9516ba58-5eeb-4c0e-abea-b5db8055bd41", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "7f0e2052-c10a-4b21-b5e8-ca8a006b85f2"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:49.860822 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-155369d5-728d-4420-8201-65738864929a tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "PUT /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb" status: 200 len: 1080 microversion: 2.1 time: 0.174974 Aug 24 10:29:49.861509 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1703/3768] 10.222.0.85 () {60 vars in 1256 bytes} [Wed Aug 24 10:29:49 2022] PUT /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb => generated 1080 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:49.886865 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8dc7d5a7-03f7-4608-b4df-ce00cb8fccaa tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:49.887801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8dc7d5a7-03f7-4608-b4df-ce00cb8fccaa tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: fef78678-d8b4-4503-a30a-424e3a1005fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:49.900705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dc7d5a7-03f7-4608-b4df-ce00cb8fccaa tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:49.903665 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dc7d5a7-03f7-4608-b4df-ce00cb8fccaa tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:49.904317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dc7d5a7-03f7-4608-b4df-ce00cb8fccaa tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:49.905390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dc7d5a7-03f7-4608-b4df-ce00cb8fccaa tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:49.906486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dc7d5a7-03f7-4608-b4df-ce00cb8fccaa tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:49.907938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dc7d5a7-03f7-4608-b4df-ce00cb8fccaa tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:50.275192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8dc7d5a7-03f7-4608-b4df-ce00cb8fccaa tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:50.291329 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8dc7d5a7-03f7-4608-b4df-ce00cb8fccaa tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb" status: 200 len: 1506 microversion: 2.1 time: 0.408204 Aug 24 10:29:50.292014 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1704/3769] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:49 2022] GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb => generated 1506 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:50.312489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d928cda6-e1bd-4374-a99a-d4cce5e407b7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1296239417", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:50.322635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:50.408586 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-d928cda6-e1bd-4374-a99a-d4cce5e407b7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] validate_networks() for [('796beb17-b5f5-484d-a9eb-b33ca6b1743d', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:29:51.068091 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-af680839-305d-4099-98f6-f25287cc7c7c tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] 10.222.0.85 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.219930 Aug 24 10:29:51.069988 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2066/3770] 10.222.0.85 () {60 vars in 1195 bytes} [Wed Aug 24 10:29:49 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:29:51.078448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bdd84646-7f69-4cd4-82de-8b8b86912ab2 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:51.081932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bdd84646-7f69-4cd4-82de-8b8b86912ab2 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: fef78678-d8b4-4503-a30a-424e3a1005fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:51.091339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdd84646-7f69-4cd4-82de-8b8b86912ab2 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:51.092587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdd84646-7f69-4cd4-82de-8b8b86912ab2 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:51.093467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdd84646-7f69-4cd4-82de-8b8b86912ab2 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:51.094480 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdd84646-7f69-4cd4-82de-8b8b86912ab2 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:51.095824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdd84646-7f69-4cd4-82de-8b8b86912ab2 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:51.096589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdd84646-7f69-4cd4-82de-8b8b86912ab2 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:51.508131 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bdd84646-7f69-4cd4-82de-8b8b86912ab2 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:51.525339 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bdd84646-7f69-4cd4-82de-8b8b86912ab2 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb" status: 200 len: 1506 microversion: 2.1 time: 0.453730 Aug 24 10:29:51.527575 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2067/3771] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:51 2022] GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb => generated 1506 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:51.532652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-40c47d3d-13fa-47e5-bb80-3a69d05bfff8 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] Action: 'create', calling method: .version_select at 0x7f4654eb7af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-771744962", "description": "tempest-description-1947360023"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:52.369913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d928cda6-e1bd-4374-a99a-d4cce5e407b7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:29:52.370517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d928cda6-e1bd-4374-a99a-d4cce5e407b7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:29:52.371485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d928cda6-e1bd-4374-a99a-d4cce5e407b7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:29:52.372154 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d928cda6-e1bd-4374-a99a-d4cce5e407b7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:29:52.372737 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d928cda6-e1bd-4374-a99a-d4cce5e407b7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:29:52.390110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d928cda6-e1bd-4374-a99a-d4cce5e407b7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:52.392120 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d928cda6-e1bd-4374-a99a-d4cce5e407b7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:52.394245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d928cda6-e1bd-4374-a99a-d4cce5e407b7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:52.404171 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d928cda6-e1bd-4374-a99a-d4cce5e407b7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:52.404937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d928cda6-e1bd-4374-a99a-d4cce5e407b7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:52.405918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d928cda6-e1bd-4374-a99a-d4cce5e407b7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:52.460302 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-d928cda6-e1bd-4374-a99a-d4cce5e407b7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Getting quotas for project 125d2dd1d22140abaa36184e3628a339. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:29:52.482640 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-d928cda6-e1bd-4374-a99a-d4cce5e407b7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Getting quotas for user 133e99904a6b4574933cad73d0f2293f and project 125d2dd1d22140abaa36184e3628a339. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:29:52.508972 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d928cda6-e1bd-4374-a99a-d4cce5e407b7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:29:52.511545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d928cda6-e1bd-4374-a99a-d4cce5e407b7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:29:52.623413 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d928cda6-e1bd-4374-a99a-d4cce5e407b7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.315956 Aug 24 10:29:52.625610 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1705/3772] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:29:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 2333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:29:52.636652 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3426a3a5-2b63-46be-b04e-ac8b975b3b6d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:52.649664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3426a3a5-2b63-46be-b04e-ac8b975b3b6d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: fef78678-d8b4-4503-a30a-424e3a1005fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:52.677304 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3426a3a5-2b63-46be-b04e-ac8b975b3b6d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:52.678158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3426a3a5-2b63-46be-b04e-ac8b975b3b6d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:52.679011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3426a3a5-2b63-46be-b04e-ac8b975b3b6d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:52.679737 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3426a3a5-2b63-46be-b04e-ac8b975b3b6d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:52.680194 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3426a3a5-2b63-46be-b04e-ac8b975b3b6d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:52.680616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3426a3a5-2b63-46be-b04e-ac8b975b3b6d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:52.801735 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3426a3a5-2b63-46be-b04e-ac8b975b3b6d tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "PUT /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb" status: 200 len: 1082 microversion: 2.1 time: 0.168632 Aug 24 10:29:52.802512 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1706/3773] 10.222.0.85 () {60 vars in 1256 bytes} [Wed Aug 24 10:29:52 2022] PUT /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb => generated 1082 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:52.811138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5b0734d6-340a-4cdf-af24-afbea19fbcdf tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:52.814856 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5b0734d6-340a-4cdf-af24-afbea19fbcdf tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:53.004747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5b0734d6-340a-4cdf-af24-afbea19fbcdf tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:53.013081 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5b0734d6-340a-4cdf-af24-afbea19fbcdf tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1222 microversion: 2.1 time: 0.209316 Aug 24 10:29:53.034225 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1707/3774] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:52 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1222 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:53.039260 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3131b2bb-6105-42b5-8a83-8df0626c9825 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:53.048285 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3131b2bb-6105-42b5-8a83-8df0626c9825 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: fef78678-d8b4-4503-a30a-424e3a1005fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:53.062059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3131b2bb-6105-42b5-8a83-8df0626c9825 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:53.072371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3131b2bb-6105-42b5-8a83-8df0626c9825 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:53.073173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3131b2bb-6105-42b5-8a83-8df0626c9825 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:53.075395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3131b2bb-6105-42b5-8a83-8df0626c9825 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:53.077570 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3131b2bb-6105-42b5-8a83-8df0626c9825 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:53.078217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3131b2bb-6105-42b5-8a83-8df0626c9825 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:53.227586 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-40c47d3d-13fa-47e5-bb80-3a69d05bfff8 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] 10.222.0.85 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.698356 Aug 24 10:29:53.230166 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2068/3775] 10.222.0.85 () {60 vars in 1180 bytes} [Wed Aug 24 10:29:51 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:29:53.248271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-31ef1d27-5c03-41f1-b64a-0a40f08498b2 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] Action: 'create', calling method: .version_select at 0x7f4654f0b430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-498230023", "description": "tempest-description-745254183"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:53.824368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3131b2bb-6105-42b5-8a83-8df0626c9825 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:53.833576 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3131b2bb-6105-42b5-8a83-8df0626c9825 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb" status: 200 len: 1508 microversion: 2.1 time: 0.798105 Aug 24 10:29:53.847874 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1708/3776] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:53 2022] GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb => generated 1508 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:53.873584 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d766e587-0891-4e7c-aac2-159f8a2dbbe6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:53.874202 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d766e587-0891-4e7c-aac2-159f8a2dbbe6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: fef78678-d8b4-4503-a30a-424e3a1005fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:53.889409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d766e587-0891-4e7c-aac2-159f8a2dbbe6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:53.894172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d766e587-0891-4e7c-aac2-159f8a2dbbe6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:53.895329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d766e587-0891-4e7c-aac2-159f8a2dbbe6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:53.897727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d766e587-0891-4e7c-aac2-159f8a2dbbe6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:53.899533 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d766e587-0891-4e7c-aac2-159f8a2dbbe6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:53.902213 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d766e587-0891-4e7c-aac2-159f8a2dbbe6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:54.050841 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-31ef1d27-5c03-41f1-b64a-0a40f08498b2 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] 10.222.0.85 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.811326 Aug 24 10:29:54.052407 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2069/3777] 10.222.0.85 () {60 vars in 1180 bytes} [Wed Aug 24 10:29:53 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:29:54.065477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-67fd91a7-b926-40de-9b74-0ed24f8b764e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:54.066118 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-67fd91a7-b926-40de-9b74-0ed24f8b764e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:54.077791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67fd91a7-b926-40de-9b74-0ed24f8b764e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:54.078287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67fd91a7-b926-40de-9b74-0ed24f8b764e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:54.078733 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67fd91a7-b926-40de-9b74-0ed24f8b764e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:54.079455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67fd91a7-b926-40de-9b74-0ed24f8b764e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:54.079913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67fd91a7-b926-40de-9b74-0ed24f8b764e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:54.080503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67fd91a7-b926-40de-9b74-0ed24f8b764e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:54.304950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-67fd91a7-b926-40de-9b74-0ed24f8b764e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:54.320043 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-67fd91a7-b926-40de-9b74-0ed24f8b764e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1218 microversion: 2.1 time: 0.266512 Aug 24 10:29:54.321647 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2070/3778] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:54 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1218 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:54.328601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d01b5e73-9754-4413-84cc-9c4c1e3d7907 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] Action: 'create', calling method: .version_select at 0x7f46551c61f0>, body: {"security_group_rule": {"parent_group_id": "3ca1d25c-9056-40d5-a272-7016fd12ff65", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "06c6ee86-faa9-4ef6-8a4e-ff13e9fd6790"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:54.879165 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d01b5e73-9754-4413-84cc-9c4c1e3d7907 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] 10.222.0.85 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.555484 Aug 24 10:29:54.894196 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2071/3779] 10.222.0.85 () {60 vars in 1195 bytes} [Wed Aug 24 10:29:54 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:29:54.906072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d766e587-0891-4e7c-aac2-159f8a2dbbe6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:54.944031 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d766e587-0891-4e7c-aac2-159f8a2dbbe6 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb" status: 200 len: 1508 microversion: 2.1 time: 1.070114 Aug 24 10:29:54.945803 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1709/3780] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:53 2022] GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb => generated 1508 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:54.983951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b6a8880-2177-4706-af0d-8a7e8f4a88cb tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] Calling method '.version_select at 0x7f46540db5e0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:55.549873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f1229b8f-88f6-4ddd-b9de-3672baa29626 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-926161499", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "b9e594f9-c603-4cc9-9d9f-63894478bc60"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:55.672501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-f1229b8f-88f6-4ddd-b9de-3672baa29626 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] validate_networks() for [('b9e594f9-c603-4cc9-9d9f-63894478bc60', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:29:55.832982 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2b6a8880-2177-4706-af0d-8a7e8f4a88cb tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/06c6ee86-faa9-4ef6-8a4e-ff13e9fd6790" status: 202 len: 0 microversion: 2.1 time: 0.866267 Aug 24 10:29:55.834432 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1710/3781] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:29:54 2022] DELETE /compute/v2.1/os-security-groups/06c6ee86-faa9-4ef6-8a4e-ff13e9fd6790 => generated 0 bytes in 888 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:29:55.839737 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-15a7bdf5-face-4420-9d26-8a481bdc9796 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:55.840236 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-15a7bdf5-face-4420-9d26-8a481bdc9796 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: fef78678-d8b4-4503-a30a-424e3a1005fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:55.854233 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15a7bdf5-face-4420-9d26-8a481bdc9796 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:55.854709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15a7bdf5-face-4420-9d26-8a481bdc9796 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:55.855164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15a7bdf5-face-4420-9d26-8a481bdc9796 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:55.856930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15a7bdf5-face-4420-9d26-8a481bdc9796 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:55.859901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15a7bdf5-face-4420-9d26-8a481bdc9796 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:55.862419 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15a7bdf5-face-4420-9d26-8a481bdc9796 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:55.941833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-15a7bdf5-face-4420-9d26-8a481bdc9796 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: fef78678-d8b4-4503-a30a-424e3a1005fb] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:29:56.140049 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-15a7bdf5-face-4420-9d26-8a481bdc9796 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "DELETE /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb" status: 204 len: 0 microversion: 2.1 time: 0.300195 Aug 24 10:29:56.143174 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1711/3782] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:29:55 2022] DELETE /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:56.163163 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-619d2c88-458e-45d6-ae85-45a0fb5847c0 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:56.168659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-619d2c88-458e-45d6-ae85-45a0fb5847c0 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:56.186036 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-619d2c88-458e-45d6-ae85-45a0fb5847c0 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:56.190087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-619d2c88-458e-45d6-ae85-45a0fb5847c0 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:56.192342 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-619d2c88-458e-45d6-ae85-45a0fb5847c0 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:56.194735 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-619d2c88-458e-45d6-ae85-45a0fb5847c0 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:56.197404 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-619d2c88-458e-45d6-ae85-45a0fb5847c0 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:56.198887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-619d2c88-458e-45d6-ae85-45a0fb5847c0 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:56.450870 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-619d2c88-458e-45d6-ae85-45a0fb5847c0 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:56.489808 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-619d2c88-458e-45d6-ae85-45a0fb5847c0 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1280 microversion: 2.1 time: 0.336254 Aug 24 10:29:56.490764 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1712/3783] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:56 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1280 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:56.496300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-42c4cf5f-951f-40c9-9e7f-f2f8f77be7af tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] Calling method '.version_select at 0x7f465a2acdc0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:56.701723 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-42c4cf5f-951f-40c9-9e7f-f2f8f77be7af tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] 10.222.0.85 "GET /compute/v2.1/os-security-groups/3ca1d25c-9056-40d5-a272-7016fd12ff65" status: 200 len: 247 microversion: 2.1 time: 0.198548 Aug 24 10:29:56.705247 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1713/3784] 10.222.0.85 () {58 vars in 1269 bytes} [Wed Aug 24 10:29:56 2022] GET /compute/v2.1/os-security-groups/3ca1d25c-9056-40d5-a272-7016fd12ff65 => generated 247 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:29:56.722000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2bf1dd0a-cf14-4b03-9aa6-17a11d802278 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:56.725225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2bf1dd0a-cf14-4b03-9aa6-17a11d802278 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: fef78678-d8b4-4503-a30a-424e3a1005fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:56.740561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bf1dd0a-cf14-4b03-9aa6-17a11d802278 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:56.741768 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bf1dd0a-cf14-4b03-9aa6-17a11d802278 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:56.742712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bf1dd0a-cf14-4b03-9aa6-17a11d802278 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:56.747471 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bf1dd0a-cf14-4b03-9aa6-17a11d802278 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:56.748700 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bf1dd0a-cf14-4b03-9aa6-17a11d802278 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:56.749724 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bf1dd0a-cf14-4b03-9aa6-17a11d802278 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:56.852431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2bf1dd0a-cf14-4b03-9aa6-17a11d802278 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: fef78678-d8b4-4503-a30a-424e3a1005fb] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:29:56.853286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-f1229b8f-88f6-4ddd-b9de-3672baa29626 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:29:56.858918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-f1229b8f-88f6-4ddd-b9de-3672baa29626 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:29:56.868180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-f1229b8f-88f6-4ddd-b9de-3672baa29626 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:29:56.869047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-f1229b8f-88f6-4ddd-b9de-3672baa29626 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:29:56.870090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-f1229b8f-88f6-4ddd-b9de-3672baa29626 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:29:56.896902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1229b8f-88f6-4ddd-b9de-3672baa29626 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:56.897458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1229b8f-88f6-4ddd-b9de-3672baa29626 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:56.899053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1229b8f-88f6-4ddd-b9de-3672baa29626 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:56.900845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1229b8f-88f6-4ddd-b9de-3672baa29626 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:56.903693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1229b8f-88f6-4ddd-b9de-3672baa29626 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:56.905374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1229b8f-88f6-4ddd-b9de-3672baa29626 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:56.949850 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.compute.api [None req-2bf1dd0a-cf14-4b03-9aa6-17a11d802278 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: fef78678-d8b4-4503-a30a-424e3a1005fb] Instance is already in deleting state, ignoring this request Aug 24 10:29:56.950696 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2bf1dd0a-cf14-4b03-9aa6-17a11d802278 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "DELETE /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb" status: 204 len: 0 microversion: 2.1 time: 0.241062 Aug 24 10:29:56.951300 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1714/3785] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:29:56 2022] DELETE /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:56.955890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f1229b8f-88f6-4ddd-b9de-3672baa29626 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Getting quotas for project b8c98b130e0042fd8adda93e89aa3707. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:29:56.961200 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-32f8a080-a580-46dc-b0e5-de7f052334b3 req-b2a67622-ca22-4cb1-911d-49ee8e57786c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1bb2ada-4833-4819-a358-2e832c5a0a41", "tag": "ea3bbe4b-7348-4d1c-bfb1-21965d6cd021"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:56.968521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f1229b8f-88f6-4ddd-b9de-3672baa29626 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Getting quotas for user bc93574a622345a6835e357f797f2e83 and project b8c98b130e0042fd8adda93e89aa3707. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:29:56.977625 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-32f8a080-a580-46dc-b0e5-de7f052334b3 req-b2a67622-ca22-4cb1-911d-49ee8e57786c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:56.978407 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-32f8a080-a580-46dc-b0e5-de7f052334b3 req-b2a67622-ca22-4cb1-911d-49ee8e57786c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:56.980136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-32f8a080-a580-46dc-b0e5-de7f052334b3 req-b2a67622-ca22-4cb1-911d-49ee8e57786c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:57.034308 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-32f8a080-a580-46dc-b0e5-de7f052334b3 req-b2a67622-ca22-4cb1-911d-49ee8e57786c service nova] Creating event network-changed:ea3bbe4b-7348-4d1c-bfb1-21965d6cd021 for instance b1bb2ada-4833-4819-a358-2e832c5a0a41 on n-h1-849328-3 Aug 24 10:29:57.034583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f1229b8f-88f6-4ddd-b9de-3672baa29626 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:29:57.041779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f1229b8f-88f6-4ddd-b9de-3672baa29626 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:29:57.064848 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-32f8a080-a580-46dc-b0e5-de7f052334b3 req-b2a67622-ca22-4cb1-911d-49ee8e57786c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111792 Aug 24 10:29:57.065826 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1715/3786] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:29:57.072939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cee0fbd0-aa61-4459-89e5-0fe023a0975d tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] Action: 'create', calling method: .version_select at 0x7f46541500d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1828488795", "description": "tempest-description-768895652"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:57.140863 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f1229b8f-88f6-4ddd-b9de-3672baa29626 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.243673 Aug 24 10:29:57.147934 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2072/3787] 10.222.0.85 () {62 vars in 1188 bytes} [Wed Aug 24 10:29:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2252 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 10:29:57.153473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-79b5d74f-8264-4e5d-85d1-294dc7f324cd tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:57.154762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-79b5d74f-8264-4e5d-85d1-294dc7f324cd tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: fef78678-d8b4-4503-a30a-424e3a1005fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:57.164528 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79b5d74f-8264-4e5d-85d1-294dc7f324cd tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:57.165423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79b5d74f-8264-4e5d-85d1-294dc7f324cd tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:57.166032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79b5d74f-8264-4e5d-85d1-294dc7f324cd tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:57.166948 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79b5d74f-8264-4e5d-85d1-294dc7f324cd tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:57.167972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79b5d74f-8264-4e5d-85d1-294dc7f324cd tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:57.168746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79b5d74f-8264-4e5d-85d1-294dc7f324cd tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:57.624874 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cee0fbd0-aa61-4459-89e5-0fe023a0975d tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] 10.222.0.85 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.557525 Aug 24 10:29:57.625649 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1716/3788] 10.222.0.85 () {60 vars in 1180 bytes} [Wed Aug 24 10:29:57 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:29:57.630948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9f1fe68f-9b58-4de7-a9d9-d029296db9e6 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:57.631844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9f1fe68f-9b58-4de7-a9d9-d029296db9e6 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:57.740496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9f1fe68f-9b58-4de7-a9d9-d029296db9e6 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:57.756343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9f1fe68f-9b58-4de7-a9d9-d029296db9e6 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:57.758995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9f1fe68f-9b58-4de7-a9d9-d029296db9e6 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:57.760715 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9f1fe68f-9b58-4de7-a9d9-d029296db9e6 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0" status: 200 len: 1261 microversion: 2.26 time: 0.133767 Aug 24 10:29:57.761349 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1717/3789] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:29:57 2022] GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0 => generated 1261 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:29:57.787222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-95e44210-279e-4b24-bd84-d56061b5325c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:57.787853 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-95e44210-279e-4b24-bd84-d56061b5325c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:57.796396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95e44210-279e-4b24-bd84-d56061b5325c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:57.801065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95e44210-279e-4b24-bd84-d56061b5325c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:57.801744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95e44210-279e-4b24-bd84-d56061b5325c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:57.802781 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95e44210-279e-4b24-bd84-d56061b5325c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:57.803272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95e44210-279e-4b24-bd84-d56061b5325c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:57.803708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95e44210-279e-4b24-bd84-d56061b5325c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:57.942358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-79b5d74f-8264-4e5d-85d1-294dc7f324cd tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:57.954520 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-79b5d74f-8264-4e5d-85d1-294dc7f324cd tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb" status: 200 len: 1514 microversion: 2.1 time: 0.805096 Aug 24 10:29:57.958526 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2073/3790] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:57 2022] GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb => generated 1514 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:57.984530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9c32249f-9769-467d-9562-e55dfd2f2ffe tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] Action: 'create', calling method: .version_select at 0x7f4654c9d790>, body: {"security_group_rule": {"parent_group_id": "09bac9ca-3f20-4c1a-943d-041b957686bf", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:58.320711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-95e44210-279e-4b24-bd84-d56061b5325c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:58.333721 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-95e44210-279e-4b24-bd84-d56061b5325c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1322 microversion: 2.1 time: 0.556464 Aug 24 10:29:58.335310 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1718/3791] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:57 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1322 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:58.709609 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9c32249f-9769-467d-9562-e55dfd2f2ffe tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] 10.222.0.85 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.749548 Aug 24 10:29:58.717632 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2074/3792] 10.222.0.85 () {60 vars in 1195 bytes} [Wed Aug 24 10:29:57 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:29:58.731364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-19077181-c961-46ec-b498-df72a239cebd tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] Action: 'create', calling method: .version_select at 0x7f4654150790>, body: {"security_group_rule": {"parent_group_id": "09bac9ca-3f20-4c1a-943d-041b957686bf", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:58.807038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-18dfcc56-415b-4066-b584-0f2d737bb84c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:58.807989 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-18dfcc56-415b-4066-b584-0f2d737bb84c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:58.829734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18dfcc56-415b-4066-b584-0f2d737bb84c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:58.830756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18dfcc56-415b-4066-b584-0f2d737bb84c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:58.831454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18dfcc56-415b-4066-b584-0f2d737bb84c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:58.832487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18dfcc56-415b-4066-b584-0f2d737bb84c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:58.833207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18dfcc56-415b-4066-b584-0f2d737bb84c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:58.833853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18dfcc56-415b-4066-b584-0f2d737bb84c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:59.075085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-18dfcc56-415b-4066-b584-0f2d737bb84c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:59.089396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-18dfcc56-415b-4066-b584-0f2d737bb84c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:59.094215 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-18dfcc56-415b-4066-b584-0f2d737bb84c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:59.095976 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-18dfcc56-415b-4066-b584-0f2d737bb84c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0" status: 200 len: 1331 microversion: 2.26 time: 0.294749 Aug 24 10:29:59.099611 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2075/3793] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:29:58 2022] GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0 => generated 1331 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:29:59.107764 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a9fd3e24-fa4e-4dfd-8cf7-77962eff35aa tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:59.109345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a9fd3e24-fa4e-4dfd-8cf7-77962eff35aa tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: fef78678-d8b4-4503-a30a-424e3a1005fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:59.121465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9fd3e24-fa4e-4dfd-8cf7-77962eff35aa tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:59.122236 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9fd3e24-fa4e-4dfd-8cf7-77962eff35aa tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:59.122863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9fd3e24-fa4e-4dfd-8cf7-77962eff35aa tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:59.124099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9fd3e24-fa4e-4dfd-8cf7-77962eff35aa tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:59.124502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9fd3e24-fa4e-4dfd-8cf7-77962eff35aa tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:59.124899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9fd3e24-fa4e-4dfd-8cf7-77962eff35aa tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:59.713578 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-19077181-c961-46ec-b498-df72a239cebd tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] 10.222.0.85 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.994121 Aug 24 10:29:59.715135 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1719/3794] 10.222.0.85 () {60 vars in 1195 bytes} [Wed Aug 24 10:29:58 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:29:59.720395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8b7d2ce8-8d64-42a8-b1fd-9d7c1a136ed7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:59.721111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8b7d2ce8-8d64-42a8-b1fd-9d7c1a136ed7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:59.738597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b7d2ce8-8d64-42a8-b1fd-9d7c1a136ed7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:59.739099 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b7d2ce8-8d64-42a8-b1fd-9d7c1a136ed7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:59.745928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b7d2ce8-8d64-42a8-b1fd-9d7c1a136ed7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:59.746976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b7d2ce8-8d64-42a8-b1fd-9d7c1a136ed7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:59.747645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b7d2ce8-8d64-42a8-b1fd-9d7c1a136ed7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:59.748237 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b7d2ce8-8d64-42a8-b1fd-9d7c1a136ed7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:00.192984 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8b7d2ce8-8d64-42a8-b1fd-9d7c1a136ed7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:00.205932 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8b7d2ce8-8d64-42a8-b1fd-9d7c1a136ed7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1322 microversion: 2.1 time: 0.489493 Aug 24 10:30:00.206622 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1720/3795] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:59 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1322 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:00.227620 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad2eba13-2438-4ad7-8a4e-854c33caaab2 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] Calling method '.version_select at 0x7f46540e93a0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:00.288598 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:30:00.288883 n-d-849328-3 devstack@n-api.service[122432]: Wed Aug 24 10:30:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-security-groups/09bac9ca-3f20-4c1a-943d-041b957686bf (ip 10.222.0.85) !!! Aug 24 10:30:00.333451 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ad2eba13-2438-4ad7-8a4e-854c33caaab2 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] 10.222.0.85 "GET /compute/v2.1/os-security-groups/09bac9ca-3f20-4c1a-943d-041b957686bf" status: 200 len: 664 microversion: 2.1 time: 0.115218 Aug 24 10:30:00.334649 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1721/3796] 10.222.0.85 () {58 vars in 1269 bytes} [Wed Aug 24 10:30:00 2022] GET /compute/v2.1/os-security-groups/09bac9ca-3f20-4c1a-943d-041b957686bf => generated 664 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:30:00.341396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-01266bfc-3d18-4935-b176-58f42e0ca084 req-28ce247b-8c78-40d7-b15e-854ff1c8bae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef78678-d8b4-4503-a30a-424e3a1005fb", "name": "network-vif-deleted", "tag": "d5c49cec-43e0-435f-8e92-63f5fd3b7204"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:30:00.363476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-01266bfc-3d18-4935-b176-58f42e0ca084 req-28ce247b-8c78-40d7-b15e-854ff1c8bae5 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:00.363983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-01266bfc-3d18-4935-b176-58f42e0ca084 req-28ce247b-8c78-40d7-b15e-854ff1c8bae5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:00.364421 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-01266bfc-3d18-4935-b176-58f42e0ca084 req-28ce247b-8c78-40d7-b15e-854ff1c8bae5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:00.379486 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-01266bfc-3d18-4935-b176-58f42e0ca084 req-28ce247b-8c78-40d7-b15e-854ff1c8bae5 service nova] Creating event network-vif-deleted:d5c49cec-43e0-435f-8e92-63f5fd3b7204 for instance fef78678-d8b4-4503-a30a-424e3a1005fb on n-h2-849328-3 Aug 24 10:30:00.387326 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-01266bfc-3d18-4935-b176-58f42e0ca084 req-28ce247b-8c78-40d7-b15e-854ff1c8bae5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051103 Aug 24 10:30:00.388673 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1722/3797] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:30:00.392355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a9fd3e24-fa4e-4dfd-8cf7-77962eff35aa tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7478d6249742d0a177be1168a8c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfeb7213b504942a32e3b8ab5c46798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:00.399704 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d327a603-5ced-42ff-a9bd-c2bb9c930b78 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:00.400510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=68 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:00.402678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d327a603-5ced-42ff-a9bd-c2bb9c930b78 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:00.409986 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a9fd3e24-fa4e-4dfd-8cf7-77962eff35aa tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb" status: 200 len: 1514 microversion: 2.1 time: 1.308625 Aug 24 10:30:00.410979 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d327a603-5ced-42ff-a9bd-c2bb9c930b78 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:00.411311 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2076/3798] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:59 2022] GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb => generated 1514 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:00.412776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d327a603-5ced-42ff-a9bd-c2bb9c930b78 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:00.413519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d327a603-5ced-42ff-a9bd-c2bb9c930b78 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:00.414561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d327a603-5ced-42ff-a9bd-c2bb9c930b78 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:00.415432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d327a603-5ced-42ff-a9bd-c2bb9c930b78 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:00.416741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d327a603-5ced-42ff-a9bd-c2bb9c930b78 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:00.425663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-183c5354-a809-4a8e-89b7-bb7f8a0efdb8 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] Calling method '.version_select at 0x7f465a2aa820>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:00.452910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:00.533697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d327a603-5ced-42ff-a9bd-c2bb9c930b78 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:00.567703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d327a603-5ced-42ff-a9bd-c2bb9c930b78 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:00.569221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d327a603-5ced-42ff-a9bd-c2bb9c930b78 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:00.570372 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d327a603-5ced-42ff-a9bd-c2bb9c930b78 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0" status: 200 len: 1319 microversion: 2.26 time: 0.180426 Aug 24 10:30:00.572794 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1723/3799] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:30:00 2022] GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:30:01.170034 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-183c5354-a809-4a8e-89b7-bb7f8a0efdb8 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-group-rules/122eb901-1dc5-4beb-a621-838768609ed4" status: 202 len: 0 microversion: 2.1 time: 0.757086 Aug 24 10:30:01.176625 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2077/3800] 10.222.0.85 () {58 vars in 1287 bytes} [Wed Aug 24 10:30:00 2022] DELETE /compute/v2.1/os-security-group-rules/122eb901-1dc5-4beb-a621-838768609ed4 => generated 0 bytes in 765 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:30:01.194009 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0b896908-f871-4038-b3e3-f565f96ece65 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] Calling method '.version_select at 0x7f465409cd30>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:01.228120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-38891927-2e8a-4912-8621-57d45cc254df tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:01.229032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-38891927-2e8a-4912-8621-57d45cc254df tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:01.253368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38891927-2e8a-4912-8621-57d45cc254df tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:01.254801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38891927-2e8a-4912-8621-57d45cc254df tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:01.256938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38891927-2e8a-4912-8621-57d45cc254df tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:01.258990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38891927-2e8a-4912-8621-57d45cc254df tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:01.259655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38891927-2e8a-4912-8621-57d45cc254df tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:01.261415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38891927-2e8a-4912-8621-57d45cc254df tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:01.713173 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0b896908-f871-4038-b3e3-f565f96ece65 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/09bac9ca-3f20-4c1a-943d-041b957686bf" status: 202 len: 0 microversion: 2.1 time: 0.536031 Aug 24 10:30:01.716553 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1724/3801] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:30:01 2022] DELETE /compute/v2.1/os-security-groups/09bac9ca-3f20-4c1a-943d-041b957686bf => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 10:30:01.724541 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-500d6ac4-8765-484b-979c-9eae0e5cbe24 req-dd361759-3467-43ef-a04d-eaa5c2c3cfc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "744fdfa0-24a0-4859-a5c5-7089ce8a444c", "tag": "11bc9ad4-b6cb-4671-8d16-0591609ede47"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:30:01.735057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-38891927-2e8a-4912-8621-57d45cc254df tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:01.749511 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-38891927-2e8a-4912-8621-57d45cc254df tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1322 microversion: 2.1 time: 0.526390 Aug 24 10:30:01.765920 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2078/3802] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:01 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1322 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:30:01.774019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5f33e0c8-49a0-4688-8baa-ad5741658af5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:01.774850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5f33e0c8-49a0-4688-8baa-ad5741658af5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: fef78678-d8b4-4503-a30a-424e3a1005fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:01.775011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-500d6ac4-8765-484b-979c-9eae0e5cbe24 req-dd361759-3467-43ef-a04d-eaa5c2c3cfc1 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:01.775694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-500d6ac4-8765-484b-979c-9eae0e5cbe24 req-dd361759-3467-43ef-a04d-eaa5c2c3cfc1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:01.775991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-500d6ac4-8765-484b-979c-9eae0e5cbe24 req-dd361759-3467-43ef-a04d-eaa5c2c3cfc1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:01.784847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f33e0c8-49a0-4688-8baa-ad5741658af5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:01.785545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f33e0c8-49a0-4688-8baa-ad5741658af5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:01.787307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f33e0c8-49a0-4688-8baa-ad5741658af5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:01.788598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f33e0c8-49a0-4688-8baa-ad5741658af5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:01.789403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f33e0c8-49a0-4688-8baa-ad5741658af5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:01.790030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f33e0c8-49a0-4688-8baa-ad5741658af5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:01.810032 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-5f33e0c8-49a0-4688-8baa-ad5741658af5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] HTTP exception thrown: Instance fef78678-d8b4-4503-a30a-424e3a1005fb could not be found. Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5f33e0c8-49a0-4688-8baa-ad5741658af5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Request method failure captured: Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb HTTP/1.1 Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfz_NDj__pyYhV1L71c4bC1x6NJe9XibuZ_WLDK8u0Ue4ohsquUKkNMyU1PKEpmwWZ7JH_tIgBJHVyHjPfC-z3y8q-lLsgtFkeDZZmeSrKkQyJwX62VhJM9FQG9dEaz3uIhZ81bTH0Nj0q8JZwcT1dAnqPj-S0sIApduwP5q3CI9lEc Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 9dfeb7213b504942a32e3b8ab5c46798 Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1210371686 Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9dfeb7213b504942a32e3b8ab5c46798"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9dfeb7213b504942a32e3b8ab5c46798", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9dfeb7213b504942a32e3b8ab5c46798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9dfeb7213b504942a32e3b8ab5c46798"}]}] Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerDiskConfigTestJSON-1210371686 Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 9dfeb7213b504942a32e3b8ab5c46798 Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1210371686 Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerDiskConfigTestJSON-1210371686-project Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: ec7478d6249742d0a177be1168a8c481 Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerDiskConfigTestJSON-1210371686-project Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance fef78678-d8b4-4503-a30a-424e3a1005fb could not be found. Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'fef78678-d8b4-4503-a30a-424e3a1005fb'} Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fef78678-d8b4-4503-a30a-424e3a1005fb could not be found. Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fef78678-d8b4-4503-a30a-424e3a1005fb could not be found. Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:30:01.811755 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:30:01.818533 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:30:01.818533 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:30:01.818533 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:30:01.818533 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:30:01.818533 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:30:01.818533 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fef78678-d8b4-4503-a30a-424e3a1005fb could not be found. Aug 24 10:30:01.818533 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:30:01.818533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5f33e0c8-49a0-4688-8baa-ad5741658af5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Returning 404 to user: Instance fef78678-d8b4-4503-a30a-424e3a1005fb could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:30:01.818533 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5f33e0c8-49a0-4688-8baa-ad5741658af5 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb" status: 404 len: 111 microversion: 2.1 time: 0.044352 Aug 24 10:30:01.818533 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2079/3803] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:01 2022] GET /compute/v2.1/servers/fef78678-d8b4-4503-a30a-424e3a1005fb => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:30:01.823202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d324dbfe-10ef-4647-be6b-2a26022def2c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:01.823871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d324dbfe-10ef-4647-be6b-2a26022def2c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:01.831211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d324dbfe-10ef-4647-be6b-2a26022def2c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:01.831799 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d324dbfe-10ef-4647-be6b-2a26022def2c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:01.832332 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d324dbfe-10ef-4647-be6b-2a26022def2c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:01.834826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d324dbfe-10ef-4647-be6b-2a26022def2c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:01.835358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d324dbfe-10ef-4647-be6b-2a26022def2c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:01.836758 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d324dbfe-10ef-4647-be6b-2a26022def2c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:01.843231 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-500d6ac4-8765-484b-979c-9eae0e5cbe24 req-dd361759-3467-43ef-a04d-eaa5c2c3cfc1 service nova] Creating event network-changed:11bc9ad4-b6cb-4671-8d16-0591609ede47 for instance 744fdfa0-24a0-4859-a5c5-7089ce8a444c on n-h2-849328-3 Aug 24 10:30:01.860092 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-500d6ac4-8765-484b-979c-9eae0e5cbe24 req-dd361759-3467-43ef-a04d-eaa5c2c3cfc1 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140062 Aug 24 10:30:01.862304 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1725/3804] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:30:01.888564 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ae659429-07d3-4b70-8b3c-1d0f0d80d434 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] Calling method '.version_select at 0x7f46540bc4c0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:01.977025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG neutronclient.v2_0.client [None req-ae659429-07d3-4b70-8b3c-1d0f0d80d434 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 06c6ee86-faa9-4ef6-8a4e-ff13e9fd6790 does not exist", "detail": ""}} {{(pid=122432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 10:30:01.977660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.security_group_api [None req-ae659429-07d3-4b70-8b3c-1d0f0d80d434 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] Neutron security group 06c6ee86-faa9-4ef6-8a4e-ff13e9fd6790 not found {{(pid=122432) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 10:30:01.978192 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-ae659429-07d3-4b70-8b3c-1d0f0d80d434 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] HTTP exception thrown: Security group 06c6ee86-faa9-4ef6-8a4e-ff13e9fd6790 does not exist Aug 24 10:30:01.978192 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-772b440c-c010-43a3-a512-291fa22d9543'] Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ae659429-07d3-4b70-8b3c-1d0f0d80d434 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] Request method failure captured: Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/os-security-groups/06c6ee86-faa9-4ef6-8a4e-ff13e9fd6790 HTTP/1.1 Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf2UZVsZG-Hn5Eo8K29OOgCG8bA9PMnH5aqMIWkXIdvH0U5cXUkeJWygsfgSDh2FvQvLf3DuRDdP-BoUPMKpM2OKM1oBV-2JjTnhwum0DrNa96fsRaP5sbI_xVHg189Ov7_kdnTaclcRIqi_zji4a6Ba5mbyaDAs7pY4tnzoErIedU8 Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: e3847538f6af4cf6b2386f58fd417cf0 Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-848015977 Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e3847538f6af4cf6b2386f58fd417cf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e3847538f6af4cf6b2386f58fd417cf0", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e3847538f6af4cf6b2386f58fd417cf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e3847538f6af4cf6b2386f58fd417cf0"}]}] Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-SecurityGroupRulesTestJSON-848015977 Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: e3847538f6af4cf6b2386f58fd417cf0 Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-848015977 Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-SecurityGroupRulesTestJSON-848015977-project Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: bb9b28a28a09480f82a0e0cd5d07a801 Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-SecurityGroupRulesTestJSON-848015977-project Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: exception: Security group 06c6ee86-faa9-4ef6-8a4e-ff13e9fd6790 does not exist Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-772b440c-c010-43a3-a512-291fa22d9543'] Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '06c6ee86-faa9-4ef6-8a4e-ff13e9fd6790'} Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 10:30:01.981275 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 06c6ee86-faa9-4ef6-8a4e-ff13e9fd6790 does not exist Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-772b440c-c010-43a3-a512-291fa22d9543'] Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 06c6ee86-faa9-4ef6-8a4e-ff13e9fd6790 does not exist Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-772b440c-c010-43a3-a512-291fa22d9543'] Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 06c6ee86-faa9-4ef6-8a4e-ff13e9fd6790 does not exist Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-772b440c-c010-43a3-a512-291fa22d9543'] Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 06c6ee86-faa9-4ef6-8a4e-ff13e9fd6790 does not exist Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-772b440c-c010-43a3-a512-291fa22d9543'] Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ae659429-07d3-4b70-8b3c-1d0f0d80d434 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] Returning 404 to user: Security group 06c6ee86-faa9-4ef6-8a4e-ff13e9fd6790 does not exist Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-772b440c-c010-43a3-a512-291fa22d9543'] {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ae659429-07d3-4b70-8b3c-1d0f0d80d434 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/06c6ee86-faa9-4ef6-8a4e-ff13e9fd6790" status: 404 len: 194 microversion: 2.1 time: 0.117287 Aug 24 10:30:01.985983 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1726/3805] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:30:01 2022] DELETE /compute/v2.1/os-security-groups/06c6ee86-faa9-4ef6-8a4e-ff13e9fd6790 => generated 194 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:30:01.996891 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f698047c-ab7c-4122-b26e-3a7dcd6bc13c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:01.997558 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f698047c-ab7c-4122-b26e-3a7dcd6bc13c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:02.027174 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f698047c-ab7c-4122-b26e-3a7dcd6bc13c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:02.031550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f698047c-ab7c-4122-b26e-3a7dcd6bc13c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:02.035121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f698047c-ab7c-4122-b26e-3a7dcd6bc13c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:02.037097 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f698047c-ab7c-4122-b26e-3a7dcd6bc13c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:02.040125 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f698047c-ab7c-4122-b26e-3a7dcd6bc13c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:02.041611 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f698047c-ab7c-4122-b26e-3a7dcd6bc13c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:02.090952 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-f698047c-ab7c-4122-b26e-3a7dcd6bc13c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] HTTP exception thrown: Instance 94c62a85-d3f8-4b01-af30-cc3d15ba08ab could not be found. Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f698047c-ab7c-4122-b26e-3a7dcd6bc13c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Request method failure captured: Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab HTTP/1.1 Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfz_NDj__pyYhV1L71c4bC1x6NJe9XibuZ_WLDK8u0Ue4ohsquUKkNMyU1PKEpmwWZ7JH_tIgBJHVyHjPfC-z3y8q-lLsgtFkeDZZmeSrKkQyJwX62VhJM9FQG9dEaz3uIhZ81bTH0Nj0q8JZwcT1dAnqPj-S0sIApduwP5q3CI9lEc Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 9dfeb7213b504942a32e3b8ab5c46798 Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1210371686 Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9dfeb7213b504942a32e3b8ab5c46798"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9dfeb7213b504942a32e3b8ab5c46798", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9dfeb7213b504942a32e3b8ab5c46798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9dfeb7213b504942a32e3b8ab5c46798"}]}] Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerDiskConfigTestJSON-1210371686 Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 9dfeb7213b504942a32e3b8ab5c46798 Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1210371686 Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerDiskConfigTestJSON-1210371686-project Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: ec7478d6249742d0a177be1168a8c481 Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerDiskConfigTestJSON-1210371686-project Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 94c62a85-d3f8-4b01-af30-cc3d15ba08ab could not be found. Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '94c62a85-d3f8-4b01-af30-cc3d15ba08ab'} Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94c62a85-d3f8-4b01-af30-cc3d15ba08ab could not be found. Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:30:02.100991 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:30:02.107078 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94c62a85-d3f8-4b01-af30-cc3d15ba08ab could not be found. Aug 24 10:30:02.107078 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:30:02.107078 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:30:02.107078 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:30:02.107078 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:30:02.107078 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:30:02.107078 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:30:02.107078 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:30:02.107078 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:30:02.107078 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94c62a85-d3f8-4b01-af30-cc3d15ba08ab could not be found. Aug 24 10:30:02.107078 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:30:02.108451 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f698047c-ab7c-4122-b26e-3a7dcd6bc13c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Returning 404 to user: Instance 94c62a85-d3f8-4b01-af30-cc3d15ba08ab could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:30:02.111216 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f698047c-ab7c-4122-b26e-3a7dcd6bc13c tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "DELETE /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 404 len: 111 microversion: 2.1 time: 0.126625 Aug 24 10:30:02.118410 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1727/3806] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:30:01 2022] DELETE /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:30:02.132971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e001962d-c881-4bbf-baf6-2cdac0f3ba31 req-bea674bf-ea88-45c1-b167-dbd2cdeabf38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1bb2ada-4833-4819-a358-2e832c5a0a41", "name": "network-vif-plugged", "status": "completed", "tag": "ea3bbe4b-7348-4d1c-bfb1-21965d6cd021"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:30:02.156344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e001962d-c881-4bbf-baf6-2cdac0f3ba31 req-bea674bf-ea88-45c1-b167-dbd2cdeabf38 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:02.157894 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e001962d-c881-4bbf-baf6-2cdac0f3ba31 req-bea674bf-ea88-45c1-b167-dbd2cdeabf38 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:02.159257 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e001962d-c881-4bbf-baf6-2cdac0f3ba31 req-bea674bf-ea88-45c1-b167-dbd2cdeabf38 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:02.179257 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e001962d-c881-4bbf-baf6-2cdac0f3ba31 req-bea674bf-ea88-45c1-b167-dbd2cdeabf38 service nova] Creating event network-vif-plugged:ea3bbe4b-7348-4d1c-bfb1-21965d6cd021 for instance b1bb2ada-4833-4819-a358-2e832c5a0a41 on n-h1-849328-3 Aug 24 10:30:02.194489 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e001962d-c881-4bbf-baf6-2cdac0f3ba31 req-bea674bf-ea88-45c1-b167-dbd2cdeabf38 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073405 Aug 24 10:30:02.196108 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1728/3807] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:30:02.203034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7cd5da9c-1e1b-4447-9bfa-71c196f15261 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] Calling method '.version_select at 0x7f46540bc820>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:02.430772 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:02.444004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d324dbfe-10ef-4647-be6b-2a26022def2c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:02.454732 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d324dbfe-10ef-4647-be6b-2a26022def2c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:02.459177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d324dbfe-10ef-4647-be6b-2a26022def2c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:02.464016 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d324dbfe-10ef-4647-be6b-2a26022def2c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0" status: 200 len: 1361 microversion: 2.26 time: 0.644742 Aug 24 10:30:02.465782 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2080/3808] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:30:01 2022] GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0 => generated 1361 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:30:02.481497 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-63229412-1a64-45a5-ba96-90f9eda5e329 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:02.482184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-63229412-1a64-45a5-ba96-90f9eda5e329 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 94c62a85-d3f8-4b01-af30-cc3d15ba08ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:02.495947 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63229412-1a64-45a5-ba96-90f9eda5e329 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:02.496628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63229412-1a64-45a5-ba96-90f9eda5e329 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:02.501854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63229412-1a64-45a5-ba96-90f9eda5e329 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:02.503424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63229412-1a64-45a5-ba96-90f9eda5e329 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:02.504304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63229412-1a64-45a5-ba96-90f9eda5e329 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:02.504923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63229412-1a64-45a5-ba96-90f9eda5e329 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:02.533987 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-63229412-1a64-45a5-ba96-90f9eda5e329 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] HTTP exception thrown: Instance 94c62a85-d3f8-4b01-af30-cc3d15ba08ab could not be found. Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-63229412-1a64-45a5-ba96-90f9eda5e329 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Request method failure captured: Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab HTTP/1.1 Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfz_NDj__pyYhV1L71c4bC1x6NJe9XibuZ_WLDK8u0Ue4ohsquUKkNMyU1PKEpmwWZ7JH_tIgBJHVyHjPfC-z3y8q-lLsgtFkeDZZmeSrKkQyJwX62VhJM9FQG9dEaz3uIhZ81bTH0Nj0q8JZwcT1dAnqPj-S0sIApduwP5q3CI9lEc Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 9dfeb7213b504942a32e3b8ab5c46798 Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1210371686 Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9dfeb7213b504942a32e3b8ab5c46798"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9dfeb7213b504942a32e3b8ab5c46798", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9dfeb7213b504942a32e3b8ab5c46798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9dfeb7213b504942a32e3b8ab5c46798"}]}] Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerDiskConfigTestJSON-1210371686 Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 9dfeb7213b504942a32e3b8ab5c46798 Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1210371686 Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerDiskConfigTestJSON-1210371686-project Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: ec7478d6249742d0a177be1168a8c481 Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerDiskConfigTestJSON-1210371686-project Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 94c62a85-d3f8-4b01-af30-cc3d15ba08ab could not be found. Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '94c62a85-d3f8-4b01-af30-cc3d15ba08ab'} Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94c62a85-d3f8-4b01-af30-cc3d15ba08ab could not be found. Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94c62a85-d3f8-4b01-af30-cc3d15ba08ab could not be found. Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:30:02.536919 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:30:02.542080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:30:02.542080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:30:02.542080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:30:02.542080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:30:02.542080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:30:02.542080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94c62a85-d3f8-4b01-af30-cc3d15ba08ab could not be found. Aug 24 10:30:02.542080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:30:02.542080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-63229412-1a64-45a5-ba96-90f9eda5e329 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Returning 404 to user: Instance 94c62a85-d3f8-4b01-af30-cc3d15ba08ab could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:30:02.542080 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-63229412-1a64-45a5-ba96-90f9eda5e329 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab" status: 404 len: 111 microversion: 2.1 time: 0.072190 Aug 24 10:30:02.542080 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2081/3809] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:02 2022] GET /compute/v2.1/servers/94c62a85-d3f8-4b01-af30-cc3d15ba08ab => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:30:02.554935 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-34ed0e77-a72c-42b4-951a-8a64f989acce tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:02.555757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-34ed0e77-a72c-42b4-951a-8a64f989acce tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:02.572260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34ed0e77-a72c-42b4-951a-8a64f989acce tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:02.573247 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34ed0e77-a72c-42b4-951a-8a64f989acce tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:02.574014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34ed0e77-a72c-42b4-951a-8a64f989acce tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:02.582457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34ed0e77-a72c-42b4-951a-8a64f989acce tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:02.583788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34ed0e77-a72c-42b4-951a-8a64f989acce tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:02.587636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34ed0e77-a72c-42b4-951a-8a64f989acce tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:02.639532 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-34ed0e77-a72c-42b4-951a-8a64f989acce tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] HTTP exception thrown: Instance 521e506a-4d4e-475f-b4e4-e7fc4552a7ac could not be found. Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-34ed0e77-a72c-42b4-951a-8a64f989acce tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Request method failure captured: Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac HTTP/1.1 Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfz_NDj__pyYhV1L71c4bC1x6NJe9XibuZ_WLDK8u0Ue4ohsquUKkNMyU1PKEpmwWZ7JH_tIgBJHVyHjPfC-z3y8q-lLsgtFkeDZZmeSrKkQyJwX62VhJM9FQG9dEaz3uIhZ81bTH0Nj0q8JZwcT1dAnqPj-S0sIApduwP5q3CI9lEc Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 9dfeb7213b504942a32e3b8ab5c46798 Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1210371686 Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9dfeb7213b504942a32e3b8ab5c46798"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9dfeb7213b504942a32e3b8ab5c46798", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9dfeb7213b504942a32e3b8ab5c46798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9dfeb7213b504942a32e3b8ab5c46798"}]}] Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerDiskConfigTestJSON-1210371686 Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 9dfeb7213b504942a32e3b8ab5c46798 Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1210371686 Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerDiskConfigTestJSON-1210371686-project Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: ec7478d6249742d0a177be1168a8c481 Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerDiskConfigTestJSON-1210371686-project Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 521e506a-4d4e-475f-b4e4-e7fc4552a7ac could not be found. Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '521e506a-4d4e-475f-b4e4-e7fc4552a7ac'} Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 521e506a-4d4e-475f-b4e4-e7fc4552a7ac could not be found. Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:30:02.644991 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:30:02.653816 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 521e506a-4d4e-475f-b4e4-e7fc4552a7ac could not be found. Aug 24 10:30:02.653816 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:30:02.653816 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:30:02.653816 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:30:02.653816 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:30:02.653816 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:30:02.653816 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:30:02.653816 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:30:02.653816 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:30:02.653816 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 521e506a-4d4e-475f-b4e4-e7fc4552a7ac could not be found. Aug 24 10:30:02.653816 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:30:02.653816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-34ed0e77-a72c-42b4-951a-8a64f989acce tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Returning 404 to user: Instance 521e506a-4d4e-475f-b4e4-e7fc4552a7ac could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:30:02.653816 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-34ed0e77-a72c-42b4-951a-8a64f989acce tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "DELETE /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 404 len: 111 microversion: 2.1 time: 0.100730 Aug 24 10:30:02.653816 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2082/3810] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:30:02 2022] DELETE /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:30:02.666651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a85207ae-2a06-4bb5-b9dc-661b187d7646 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:02.667285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a85207ae-2a06-4bb5-b9dc-661b187d7646 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] [instance: 521e506a-4d4e-475f-b4e4-e7fc4552a7ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:02.685247 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a85207ae-2a06-4bb5-b9dc-661b187d7646 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:02.687112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a85207ae-2a06-4bb5-b9dc-661b187d7646 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:02.687888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a85207ae-2a06-4bb5-b9dc-661b187d7646 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:02.688822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a85207ae-2a06-4bb5-b9dc-661b187d7646 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:02.689322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a85207ae-2a06-4bb5-b9dc-661b187d7646 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:02.689759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a85207ae-2a06-4bb5-b9dc-661b187d7646 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:02.710900 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-a85207ae-2a06-4bb5-b9dc-661b187d7646 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] HTTP exception thrown: Instance 521e506a-4d4e-475f-b4e4-e7fc4552a7ac could not be found. Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a85207ae-2a06-4bb5-b9dc-661b187d7646 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Request method failure captured: Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac HTTP/1.1 Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfz_NDj__pyYhV1L71c4bC1x6NJe9XibuZ_WLDK8u0Ue4ohsquUKkNMyU1PKEpmwWZ7JH_tIgBJHVyHjPfC-z3y8q-lLsgtFkeDZZmeSrKkQyJwX62VhJM9FQG9dEaz3uIhZ81bTH0Nj0q8JZwcT1dAnqPj-S0sIApduwP5q3CI9lEc Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 9dfeb7213b504942a32e3b8ab5c46798 Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1210371686 Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9dfeb7213b504942a32e3b8ab5c46798"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9dfeb7213b504942a32e3b8ab5c46798", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9dfeb7213b504942a32e3b8ab5c46798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9dfeb7213b504942a32e3b8ab5c46798"}]}] Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerDiskConfigTestJSON-1210371686 Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 9dfeb7213b504942a32e3b8ab5c46798 Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1210371686 Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerDiskConfigTestJSON-1210371686-project Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: ec7478d6249742d0a177be1168a8c481 Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerDiskConfigTestJSON-1210371686-project Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 521e506a-4d4e-475f-b4e4-e7fc4552a7ac could not be found. Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '521e506a-4d4e-475f-b4e4-e7fc4552a7ac'} Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 521e506a-4d4e-475f-b4e4-e7fc4552a7ac could not be found. Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 521e506a-4d4e-475f-b4e4-e7fc4552a7ac could not be found. Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:30:02.712489 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:30:02.719932 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:30:02.719932 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:30:02.719932 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:30:02.719932 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:30:02.719932 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:30:02.719932 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 521e506a-4d4e-475f-b4e4-e7fc4552a7ac could not be found. Aug 24 10:30:02.719932 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:30:02.719932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a85207ae-2a06-4bb5-b9dc-661b187d7646 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] Returning 404 to user: Instance 521e506a-4d4e-475f-b4e4-e7fc4552a7ac could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:30:02.719932 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a85207ae-2a06-4bb5-b9dc-661b187d7646 tempest-ServerDiskConfigTestJSON-1210371686 tempest-ServerDiskConfigTestJSON-1210371686-project] 10.222.0.85 "GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac" status: 404 len: 111 microversion: 2.1 time: 0.053073 Aug 24 10:30:02.719932 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2083/3811] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:02 2022] GET /compute/v2.1/servers/521e506a-4d4e-475f-b4e4-e7fc4552a7ac => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:30:02.774265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b6ac3d45-210c-46fd-92a1-6bfd621e3b05 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:02.775327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b6ac3d45-210c-46fd-92a1-6bfd621e3b05 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:02.785398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6ac3d45-210c-46fd-92a1-6bfd621e3b05 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:02.785907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6ac3d45-210c-46fd-92a1-6bfd621e3b05 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:02.786349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6ac3d45-210c-46fd-92a1-6bfd621e3b05 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:02.787087 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6ac3d45-210c-46fd-92a1-6bfd621e3b05 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:02.787558 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6ac3d45-210c-46fd-92a1-6bfd621e3b05 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:02.788003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6ac3d45-210c-46fd-92a1-6bfd621e3b05 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:03.131038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b6ac3d45-210c-46fd-92a1-6bfd621e3b05 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:03.140053 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b6ac3d45-210c-46fd-92a1-6bfd621e3b05 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1322 microversion: 2.1 time: 0.370979 Aug 24 10:30:03.140884 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2084/3812] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:02 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1322 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:03.145944 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7cd5da9c-1e1b-4447-9bfa-71c196f15261 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/3ca1d25c-9056-40d5-a272-7016fd12ff65" status: 202 len: 0 microversion: 2.1 time: 0.947353 Aug 24 10:30:03.146770 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1729/3813] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:30:02 2022] DELETE /compute/v2.1/os-security-groups/3ca1d25c-9056-40d5-a272-7016fd12ff65 => generated 0 bytes in 950 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:30:03.162623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-700c1119-e0c1-4152-88ca-255649213a21 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] Calling method '.version_select at 0x7f4654efb1f0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:03.500720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2a25afb0-6e53-4458-a0bd-e0fd96f11f98 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:03.501391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2a25afb0-6e53-4458-a0bd-e0fd96f11f98 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:03.519694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a25afb0-6e53-4458-a0bd-e0fd96f11f98 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:03.520485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a25afb0-6e53-4458-a0bd-e0fd96f11f98 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:03.522388 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a25afb0-6e53-4458-a0bd-e0fd96f11f98 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:03.522388 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a25afb0-6e53-4458-a0bd-e0fd96f11f98 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:03.522830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a25afb0-6e53-4458-a0bd-e0fd96f11f98 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:03.523455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a25afb0-6e53-4458-a0bd-e0fd96f11f98 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:03.820019 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2a25afb0-6e53-4458-a0bd-e0fd96f11f98 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:03.831726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2a25afb0-6e53-4458-a0bd-e0fd96f11f98 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:03.833633 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2a25afb0-6e53-4458-a0bd-e0fd96f11f98 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:03.834858 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2a25afb0-6e53-4458-a0bd-e0fd96f11f98 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0" status: 200 len: 1361 microversion: 2.26 time: 0.347983 Aug 24 10:30:03.850531 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1730/3814] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:30:03 2022] GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0 => generated 1361 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:30:04.140363 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-700c1119-e0c1-4152-88ca-255649213a21 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/7f0e2052-c10a-4b21-b5e8-ca8a006b85f2" status: 202 len: 0 microversion: 2.1 time: 0.971651 Aug 24 10:30:04.143254 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2085/3815] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:30:03 2022] DELETE /compute/v2.1/os-security-groups/7f0e2052-c10a-4b21-b5e8-ca8a006b85f2 => generated 0 bytes in 985 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:30:04.171369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d84f51fe-0305-4ecb-9f8f-a60225cab305 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] Calling method '.version_select at 0x7f46540bc700>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:04.199686 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fcc04910-289f-44b6-9f8d-f152bb016416 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:04.203867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fcc04910-289f-44b6-9f8d-f152bb016416 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:04.224225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:04.236943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcc04910-289f-44b6-9f8d-f152bb016416 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:04.238276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcc04910-289f-44b6-9f8d-f152bb016416 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:04.240268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcc04910-289f-44b6-9f8d-f152bb016416 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:04.241272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcc04910-289f-44b6-9f8d-f152bb016416 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:04.242097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcc04910-289f-44b6-9f8d-f152bb016416 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:04.245202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcc04910-289f-44b6-9f8d-f152bb016416 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:04.898459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fcc04910-289f-44b6-9f8d-f152bb016416 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:04.907917 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fcc04910-289f-44b6-9f8d-f152bb016416 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1322 microversion: 2.1 time: 0.745246 Aug 24 10:30:04.921903 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2086/3816] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:04 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1322 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:04.928047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-2c69c171-60ad-4a45-b8ad-e6836cf74e08 req-2a4a7200-1b48-4cde-b708-e3953527670f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "175bfff6-6f17-40b0-9209-32024473add0", "tag": "1642bb43-7c9c-425e-a354-44209b5f2219"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:30:04.940024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2c69c171-60ad-4a45-b8ad-e6836cf74e08 req-2a4a7200-1b48-4cde-b708-e3953527670f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:04.940749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2c69c171-60ad-4a45-b8ad-e6836cf74e08 req-2a4a7200-1b48-4cde-b708-e3953527670f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:04.943046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2c69c171-60ad-4a45-b8ad-e6836cf74e08 req-2a4a7200-1b48-4cde-b708-e3953527670f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:04.969085 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-2c69c171-60ad-4a45-b8ad-e6836cf74e08 req-2a4a7200-1b48-4cde-b708-e3953527670f service nova] Creating event network-changed:1642bb43-7c9c-425e-a354-44209b5f2219 for instance 175bfff6-6f17-40b0-9209-32024473add0 on n-h2-849328-3 Aug 24 10:30:04.976872 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-2c69c171-60ad-4a45-b8ad-e6836cf74e08 req-2a4a7200-1b48-4cde-b708-e3953527670f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053122 Aug 24 10:30:04.977964 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2087/3817] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:30:04.992108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-648e36db-c3f0-4919-bea4-7d4693f56aad tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:04.993150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-648e36db-c3f0-4919-bea4-7d4693f56aad tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:05.002498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-648e36db-c3f0-4919-bea4-7d4693f56aad tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:05.004617 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d84f51fe-0305-4ecb-9f8f-a60225cab305 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/9516ba58-5eeb-4c0e-abea-b5db8055bd41" status: 202 len: 0 microversion: 2.1 time: 0.857420 Aug 24 10:30:05.005764 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-648e36db-c3f0-4919-bea4-7d4693f56aad tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:05.006438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-648e36db-c3f0-4919-bea4-7d4693f56aad tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:05.007388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-648e36db-c3f0-4919-bea4-7d4693f56aad tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:05.008222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-648e36db-c3f0-4919-bea4-7d4693f56aad tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:05.008891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-648e36db-c3f0-4919-bea4-7d4693f56aad tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:05.011454 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1731/3818] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:30:04 2022] DELETE /compute/v2.1/os-security-groups/9516ba58-5eeb-4c0e-abea-b5db8055bd41 => generated 0 bytes in 865 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:30:05.022463 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9df33c34-fee1-4385-a79a-d2ee5cf63595 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] Calling method '.version_select at 0x7f46540bc4c0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:05.798899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-648e36db-c3f0-4919-bea4-7d4693f56aad tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:05.808703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-648e36db-c3f0-4919-bea4-7d4693f56aad tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:05.810443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-648e36db-c3f0-4919-bea4-7d4693f56aad tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:05.811647 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-648e36db-c3f0-4919-bea4-7d4693f56aad tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0" status: 200 len: 1361 microversion: 2.26 time: 0.831883 Aug 24 10:30:05.812226 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2088/3819] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:30:04 2022] GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0 => generated 1361 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:30:05.929978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0c952622-5d35-4093-b81e-fe62b887b37d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:05.930994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0c952622-5d35-4093-b81e-fe62b887b37d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:05.939312 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c952622-5d35-4093-b81e-fe62b887b37d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:05.939841 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c952622-5d35-4093-b81e-fe62b887b37d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:05.940267 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c952622-5d35-4093-b81e-fe62b887b37d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:05.943375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c952622-5d35-4093-b81e-fe62b887b37d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:05.944079 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c952622-5d35-4093-b81e-fe62b887b37d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:05.944880 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c952622-5d35-4093-b81e-fe62b887b37d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:06.183201 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9df33c34-fee1-4385-a79a-d2ee5cf63595 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/b93d9170-39bb-4e1d-a86b-00048c834d9d" status: 202 len: 0 microversion: 2.1 time: 1.167059 Aug 24 10:30:06.190109 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1732/3820] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:30:05 2022] DELETE /compute/v2.1/os-security-groups/b93d9170-39bb-4e1d-a86b-00048c834d9d => generated 0 bytes in 1175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:30:06.196988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b7e49592-5705-4fce-bb2b-6eb964391d74 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] Calling method '.version_select at 0x7f46540ea670>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:06.363526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0c952622-5d35-4093-b81e-fe62b887b37d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:06.378856 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0c952622-5d35-4093-b81e-fe62b887b37d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1322 microversion: 2.1 time: 0.453023 Aug 24 10:30:06.392616 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2089/3821] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:05 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1322 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:06.722230 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-5082a7bb-dcc1-4926-befa-ecc94525005f req-7d1f28e4-053d-4411-9484-6cdfc14b633a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "744fdfa0-24a0-4859-a5c5-7089ce8a444c", "name": "network-vif-plugged", "status": "completed", "tag": "11bc9ad4-b6cb-4671-8d16-0591609ede47"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:30:06.749682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5082a7bb-dcc1-4926-befa-ecc94525005f req-7d1f28e4-053d-4411-9484-6cdfc14b633a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:06.757752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5082a7bb-dcc1-4926-befa-ecc94525005f req-7d1f28e4-053d-4411-9484-6cdfc14b633a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:06.759335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5082a7bb-dcc1-4926-befa-ecc94525005f req-7d1f28e4-053d-4411-9484-6cdfc14b633a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:06.802307 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-5082a7bb-dcc1-4926-befa-ecc94525005f req-7d1f28e4-053d-4411-9484-6cdfc14b633a service nova] Creating event network-vif-plugged:11bc9ad4-b6cb-4671-8d16-0591609ede47 for instance 744fdfa0-24a0-4859-a5c5-7089ce8a444c on n-h2-849328-3 Aug 24 10:30:06.819394 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-5082a7bb-dcc1-4926-befa-ecc94525005f req-7d1f28e4-053d-4411-9484-6cdfc14b633a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100862 Aug 24 10:30:06.820173 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2090/3822] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:30:06.834723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-376801d5-eb99-4fc8-949c-13f102a772ca tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:06.835510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-376801d5-eb99-4fc8-949c-13f102a772ca tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:06.845953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376801d5-eb99-4fc8-949c-13f102a772ca tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:06.846459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376801d5-eb99-4fc8-949c-13f102a772ca tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:06.846901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376801d5-eb99-4fc8-949c-13f102a772ca tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:06.847665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376801d5-eb99-4fc8-949c-13f102a772ca tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:06.854446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376801d5-eb99-4fc8-949c-13f102a772ca tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:06.855042 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376801d5-eb99-4fc8-949c-13f102a772ca tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:06.935236 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:06.998217 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b7e49592-5705-4fce-bb2b-6eb964391d74 tempest-SecurityGroupRulesTestJSON-848015977 tempest-SecurityGroupRulesTestJSON-848015977-project] 10.222.0.85 "DELETE /compute/v2.1/os-security-groups/48ef74e2-d488-454b-a526-4d786a0ed769" status: 202 len: 0 microversion: 2.1 time: 0.802440 Aug 24 10:30:07.001255 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1733/3823] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 10:30:06 2022] DELETE /compute/v2.1/os-security-groups/48ef74e2-d488-454b-a526-4d786a0ed769 => generated 0 bytes in 810 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:30:07.018737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:07.402167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-376801d5-eb99-4fc8-949c-13f102a772ca tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:07.403088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a92e27c5-044d-4cff-9c80-66b22cfeb6fe tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:07.403914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a92e27c5-044d-4cff-9c80-66b22cfeb6fe tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:07.415751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-376801d5-eb99-4fc8-949c-13f102a772ca tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:07.420287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-376801d5-eb99-4fc8-949c-13f102a772ca tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:07.421275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a92e27c5-044d-4cff-9c80-66b22cfeb6fe tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:07.422821 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-376801d5-eb99-4fc8-949c-13f102a772ca tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0" status: 200 len: 1361 microversion: 2.26 time: 0.592413 Aug 24 10:30:07.423596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a92e27c5-044d-4cff-9c80-66b22cfeb6fe tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:07.427315 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2091/3824] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:30:06 2022] GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0 => generated 1361 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:30:07.428683 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a92e27c5-044d-4cff-9c80-66b22cfeb6fe tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:07.430606 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a92e27c5-044d-4cff-9c80-66b22cfeb6fe tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:07.431344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a92e27c5-044d-4cff-9c80-66b22cfeb6fe tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:07.433057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a92e27c5-044d-4cff-9c80-66b22cfeb6fe tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:07.754295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=16 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:07.883838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a92e27c5-044d-4cff-9c80-66b22cfeb6fe tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:07.893946 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a92e27c5-044d-4cff-9c80-66b22cfeb6fe tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1322 microversion: 2.1 time: 0.496982 Aug 24 10:30:07.910908 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1734/3825] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:07 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1322 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:08.451353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7ece7198-8ca1-4417-8bcf-a1623e174d06 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:08.452657 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7ece7198-8ca1-4417-8bcf-a1623e174d06 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:08.473942 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ece7198-8ca1-4417-8bcf-a1623e174d06 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:08.474551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ece7198-8ca1-4417-8bcf-a1623e174d06 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:08.475218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ece7198-8ca1-4417-8bcf-a1623e174d06 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:08.477227 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ece7198-8ca1-4417-8bcf-a1623e174d06 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:08.477227 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ece7198-8ca1-4417-8bcf-a1623e174d06 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:08.477666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ece7198-8ca1-4417-8bcf-a1623e174d06 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:08.918167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9fec29cf-9b5d-4e66-835d-2c1f789956d8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:08.919778 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9fec29cf-9b5d-4e66-835d-2c1f789956d8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:08.941803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fec29cf-9b5d-4e66-835d-2c1f789956d8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:08.943719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fec29cf-9b5d-4e66-835d-2c1f789956d8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:08.944544 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fec29cf-9b5d-4e66-835d-2c1f789956d8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:08.946152 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fec29cf-9b5d-4e66-835d-2c1f789956d8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:08.947407 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fec29cf-9b5d-4e66-835d-2c1f789956d8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:08.950024 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fec29cf-9b5d-4e66-835d-2c1f789956d8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:09.293332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9fec29cf-9b5d-4e66-835d-2c1f789956d8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:09.306661 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9fec29cf-9b5d-4e66-835d-2c1f789956d8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1515 microversion: 2.1 time: 0.392513 Aug 24 10:30:09.314483 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1735/3826] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:08 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1515 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:09.334094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-64331fb4-b70a-48d2-83e0-850787171498 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:30:09.337250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-64331fb4-b70a-48d2-83e0-850787171498 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:09.344709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64331fb4-b70a-48d2-83e0-850787171498 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:09.345530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64331fb4-b70a-48d2-83e0-850787171498 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:09.346198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64331fb4-b70a-48d2-83e0-850787171498 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:09.347320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64331fb4-b70a-48d2-83e0-850787171498 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:09.348081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64331fb4-b70a-48d2-83e0-850787171498 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:09.348687 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64331fb4-b70a-48d2-83e0-850787171498 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:09.377935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-64331fb4-b70a-48d2-83e0-850787171498 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lazy-loading 'flavor' on Instance uuid 744fdfa0-24a0-4859-a5c5-7089ce8a444c {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:30:09.472716 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-64331fb4-b70a-48d2-83e0-850787171498 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "POST /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c/action" status: 200 len: 32 microversion: 2.1 time: 0.142389 Aug 24 10:30:09.474414 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1736/3827] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:30:09 2022] POST /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c/action => generated 32 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:30:09.491278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3595cab3-b2a5-42c6-818c-4a366701e5b9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:09.492963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3595cab3-b2a5-42c6-818c-4a366701e5b9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:09.508826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3595cab3-b2a5-42c6-818c-4a366701e5b9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:09.509683 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3595cab3-b2a5-42c6-818c-4a366701e5b9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:09.510535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3595cab3-b2a5-42c6-818c-4a366701e5b9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:09.511510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3595cab3-b2a5-42c6-818c-4a366701e5b9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:09.512872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3595cab3-b2a5-42c6-818c-4a366701e5b9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:09.513712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3595cab3-b2a5-42c6-818c-4a366701e5b9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:09.543456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7ece7198-8ca1-4417-8bcf-a1623e174d06 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:09.553583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7ece7198-8ca1-4417-8bcf-a1623e174d06 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:09.559092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7ece7198-8ca1-4417-8bcf-a1623e174d06 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:09.565777 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7ece7198-8ca1-4417-8bcf-a1623e174d06 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0" status: 200 len: 1361 microversion: 2.26 time: 1.118961 Aug 24 10:30:09.568705 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2092/3828] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:30:08 2022] GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0 => generated 1361 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:30:10.057826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3595cab3-b2a5-42c6-818c-4a366701e5b9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:10.079866 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3595cab3-b2a5-42c6-818c-4a366701e5b9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1521 microversion: 2.1 time: 0.594555 Aug 24 10:30:10.080946 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1737/3829] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:09 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1521 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:10.593053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3cf3e151-f223-4ef3-825a-efe92f0772a3 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:10.594530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3cf3e151-f223-4ef3-825a-efe92f0772a3 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:10.609073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cf3e151-f223-4ef3-825a-efe92f0772a3 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:10.611623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cf3e151-f223-4ef3-825a-efe92f0772a3 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:10.616421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cf3e151-f223-4ef3-825a-efe92f0772a3 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:10.617300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cf3e151-f223-4ef3-825a-efe92f0772a3 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:10.617879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cf3e151-f223-4ef3-825a-efe92f0772a3 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:10.618681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cf3e151-f223-4ef3-825a-efe92f0772a3 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:11.103140 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-84fbe871-47f9-4749-b19c-49e6a35eb76f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:11.104498 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-84fbe871-47f9-4749-b19c-49e6a35eb76f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:11.119192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84fbe871-47f9-4749-b19c-49e6a35eb76f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:11.121583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84fbe871-47f9-4749-b19c-49e6a35eb76f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:11.122361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84fbe871-47f9-4749-b19c-49e6a35eb76f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:11.124545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84fbe871-47f9-4749-b19c-49e6a35eb76f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:11.125029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84fbe871-47f9-4749-b19c-49e6a35eb76f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:11.129985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84fbe871-47f9-4749-b19c-49e6a35eb76f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:11.390621 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3cf3e151-f223-4ef3-825a-efe92f0772a3 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:11.409923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3cf3e151-f223-4ef3-825a-efe92f0772a3 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:11.413520 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3cf3e151-f223-4ef3-825a-efe92f0772a3 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:11.415862 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3cf3e151-f223-4ef3-825a-efe92f0772a3 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0" status: 200 len: 1361 microversion: 2.26 time: 0.827274 Aug 24 10:30:11.418061 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2093/3830] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:30:10 2022] GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0 => generated 1361 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:30:11.497883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-84fbe871-47f9-4749-b19c-49e6a35eb76f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:11.520848 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-84fbe871-47f9-4749-b19c-49e6a35eb76f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1521 microversion: 2.1 time: 0.424406 Aug 24 10:30:11.524063 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1738/3831] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:11 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1521 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:30:12.442354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec47e93c-6fb4-4b40-b25d-8abdec034b17 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:12.443834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ec47e93c-6fb4-4b40-b25d-8abdec034b17 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:12.462351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec47e93c-6fb4-4b40-b25d-8abdec034b17 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:12.463176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec47e93c-6fb4-4b40-b25d-8abdec034b17 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:12.463777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec47e93c-6fb4-4b40-b25d-8abdec034b17 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:12.464700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec47e93c-6fb4-4b40-b25d-8abdec034b17 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:12.465431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec47e93c-6fb4-4b40-b25d-8abdec034b17 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:12.466034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec47e93c-6fb4-4b40-b25d-8abdec034b17 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:12.544832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a6f21ec4-deec-496b-bd6d-7f236dd1e9b1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:12.546994 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a6f21ec4-deec-496b-bd6d-7f236dd1e9b1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:12.567395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6f21ec4-deec-496b-bd6d-7f236dd1e9b1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:12.568704 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6f21ec4-deec-496b-bd6d-7f236dd1e9b1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:12.571392 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6f21ec4-deec-496b-bd6d-7f236dd1e9b1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:12.572936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6f21ec4-deec-496b-bd6d-7f236dd1e9b1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:12.573641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6f21ec4-deec-496b-bd6d-7f236dd1e9b1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:12.575276 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6f21ec4-deec-496b-bd6d-7f236dd1e9b1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:12.992209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ec47e93c-6fb4-4b40-b25d-8abdec034b17 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:13.007713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ec47e93c-6fb4-4b40-b25d-8abdec034b17 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:13.017494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ec47e93c-6fb4-4b40-b25d-8abdec034b17 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:13.019568 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ec47e93c-6fb4-4b40-b25d-8abdec034b17 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0" status: 200 len: 1361 microversion: 2.26 time: 0.583378 Aug 24 10:30:13.023700 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2094/3832] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:30:12 2022] GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0 => generated 1361 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:30:13.034458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-472b475d-2c39-4813-836b-acb9bd4bc513 req-5961f4ee-61d1-40a6-82fd-801f022a32fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "175bfff6-6f17-40b0-9209-32024473add0", "name": "network-vif-plugged", "status": "completed", "tag": "1642bb43-7c9c-425e-a354-44209b5f2219"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:30:13.052482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-472b475d-2c39-4813-836b-acb9bd4bc513 req-5961f4ee-61d1-40a6-82fd-801f022a32fa service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:13.052976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-472b475d-2c39-4813-836b-acb9bd4bc513 req-5961f4ee-61d1-40a6-82fd-801f022a32fa service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:13.053449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-472b475d-2c39-4813-836b-acb9bd4bc513 req-5961f4ee-61d1-40a6-82fd-801f022a32fa service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:13.071808 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-472b475d-2c39-4813-836b-acb9bd4bc513 req-5961f4ee-61d1-40a6-82fd-801f022a32fa service nova] Creating event network-vif-plugged:1642bb43-7c9c-425e-a354-44209b5f2219 for instance 175bfff6-6f17-40b0-9209-32024473add0 on n-h2-849328-3 Aug 24 10:30:13.077619 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-472b475d-2c39-4813-836b-acb9bd4bc513 req-5961f4ee-61d1-40a6-82fd-801f022a32fa service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050721 Aug 24 10:30:13.078575 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2095/3833] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:30:13.090222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a6f21ec4-deec-496b-bd6d-7f236dd1e9b1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:13.105787 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a6f21ec4-deec-496b-bd6d-7f236dd1e9b1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1521 microversion: 2.1 time: 0.560591 Aug 24 10:30:13.107382 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1739/3834] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:12 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1521 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:14.052766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-af42833f-f799-40e8-ac9d-30998fa92596 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:14.054235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-af42833f-f799-40e8-ac9d-30998fa92596 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:14.061661 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af42833f-f799-40e8-ac9d-30998fa92596 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:14.062687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af42833f-f799-40e8-ac9d-30998fa92596 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:14.064024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af42833f-f799-40e8-ac9d-30998fa92596 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:14.065566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af42833f-f799-40e8-ac9d-30998fa92596 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:14.066337 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af42833f-f799-40e8-ac9d-30998fa92596 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:14.066858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af42833f-f799-40e8-ac9d-30998fa92596 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:14.128448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0a09b517-b9ad-441e-9113-e4fa2d7ada43 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:14.129080 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0a09b517-b9ad-441e-9113-e4fa2d7ada43 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:14.144593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a09b517-b9ad-441e-9113-e4fa2d7ada43 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:14.144593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a09b517-b9ad-441e-9113-e4fa2d7ada43 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:14.144593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a09b517-b9ad-441e-9113-e4fa2d7ada43 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:14.145314 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a09b517-b9ad-441e-9113-e4fa2d7ada43 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:14.146081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a09b517-b9ad-441e-9113-e4fa2d7ada43 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:14.146746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a09b517-b9ad-441e-9113-e4fa2d7ada43 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:14.669184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0a09b517-b9ad-441e-9113-e4fa2d7ada43 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:14.680948 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0a09b517-b9ad-441e-9113-e4fa2d7ada43 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1521 microversion: 2.1 time: 0.554620 Aug 24 10:30:14.682061 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1740/3835] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:14 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1521 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:30:14.865874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-af42833f-f799-40e8-ac9d-30998fa92596 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:14.876659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-af42833f-f799-40e8-ac9d-30998fa92596 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:14.910705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-af42833f-f799-40e8-ac9d-30998fa92596 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:14.912058 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-af42833f-f799-40e8-ac9d-30998fa92596 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0" status: 200 len: 1361 microversion: 2.26 time: 0.866122 Aug 24 10:30:14.912739 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2096/3836] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:30:14 2022] GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0 => generated 1361 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:30:15.707255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c2a3c535-1dad-4c92-8949-f0cad96b453c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:15.717239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c2a3c535-1dad-4c92-8949-f0cad96b453c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:15.732608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2a3c535-1dad-4c92-8949-f0cad96b453c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:15.736020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2a3c535-1dad-4c92-8949-f0cad96b453c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:15.738681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2a3c535-1dad-4c92-8949-f0cad96b453c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:15.739710 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2a3c535-1dad-4c92-8949-f0cad96b453c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:15.740410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2a3c535-1dad-4c92-8949-f0cad96b453c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:15.742777 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2a3c535-1dad-4c92-8949-f0cad96b453c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:15.937501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-db50ffd5-8acb-4aeb-846f-4f0831edddee tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:15.939149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-db50ffd5-8acb-4aeb-846f-4f0831edddee tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:15.951124 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db50ffd5-8acb-4aeb-846f-4f0831edddee tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:15.951629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db50ffd5-8acb-4aeb-846f-4f0831edddee tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:15.952070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db50ffd5-8acb-4aeb-846f-4f0831edddee tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:15.952798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db50ffd5-8acb-4aeb-846f-4f0831edddee tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:15.953289 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db50ffd5-8acb-4aeb-846f-4f0831edddee tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:15.953722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db50ffd5-8acb-4aeb-846f-4f0831edddee tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:16.140148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c2a3c535-1dad-4c92-8949-f0cad96b453c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:16.154539 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c2a3c535-1dad-4c92-8949-f0cad96b453c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1521 microversion: 2.1 time: 0.454408 Aug 24 10:30:16.155357 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1741/3837] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:15 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:30:16.522437 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-db50ffd5-8acb-4aeb-846f-4f0831edddee tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:16.531991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-db50ffd5-8acb-4aeb-846f-4f0831edddee tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:16.533536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-db50ffd5-8acb-4aeb-846f-4f0831edddee tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:16.543558 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-db50ffd5-8acb-4aeb-846f-4f0831edddee tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0" status: 200 len: 1544 microversion: 2.26 time: 0.601270 Aug 24 10:30:16.547215 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2097/3838] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:30:15 2022] GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0 => generated 1544 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:30:16.580090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-82a5c0e1-e81c-49b9-a15c-ab08d9934bf9 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '.version_select at 0x7f465410c940>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:16.614597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a5c0e1-e81c-49b9-a15c-ab08d9934bf9 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:16.615258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a5c0e1-e81c-49b9-a15c-ab08d9934bf9 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:16.615807 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a5c0e1-e81c-49b9-a15c-ab08d9934bf9 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:16.616789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-82a5c0e1-e81c-49b9-a15c-ab08d9934bf9 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:16.631707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a5c0e1-e81c-49b9-a15c-ab08d9934bf9 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:16.634287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a5c0e1-e81c-49b9-a15c-ab08d9934bf9 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:16.639168 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a5c0e1-e81c-49b9-a15c-ab08d9934bf9 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:16.640338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a5c0e1-e81c-49b9-a15c-ab08d9934bf9 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:16.641044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a5c0e1-e81c-49b9-a15c-ab08d9934bf9 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:16.641791 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a5c0e1-e81c-49b9-a15c-ab08d9934bf9 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:16.718984 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a5c0e1-e81c-49b9-a15c-ab08d9934bf9 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:16.719642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a5c0e1-e81c-49b9-a15c-ab08d9934bf9 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:16.724578 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a5c0e1-e81c-49b9-a15c-ab08d9934bf9 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:16.756492 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a5c0e1-e81c-49b9-a15c-ab08d9934bf9 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:16.760370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a5c0e1-e81c-49b9-a15c-ab08d9934bf9 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:16.761077 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a5c0e1-e81c-49b9-a15c-ab08d9934bf9 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:16.796994 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-82a5c0e1-e81c-49b9-a15c-ab08d9934bf9 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lazy-loading 'flavor' on Instance uuid 175bfff6-6f17-40b0-9209-32024473add0 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:30:16.827417 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-82a5c0e1-e81c-49b9-a15c-ab08d9934bf9 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "PUT /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags/tempest-tag-491590394" status: 201 len: 0 microversion: 2.26 time: 0.253048 Aug 24 10:30:16.828302 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1742/3839] 10.222.0.85 () {62 vars in 1377 bytes} [Wed Aug 24 10:30:16 2022] PUT /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags/tempest-tag-491590394 => generated 0 bytes in 255 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 24 10:30:16.851895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2bb1aff5-406b-4277-b519-43be5d6423e9 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '.version_select at 0x7f46551d6790>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:16.908141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bb1aff5-406b-4277-b519-43be5d6423e9 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:16.913733 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bb1aff5-406b-4277-b519-43be5d6423e9 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:16.916340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bb1aff5-406b-4277-b519-43be5d6423e9 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:16.963013 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2bb1aff5-406b-4277-b519-43be5d6423e9 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags/tempest-tag-491590394" status: 204 len: 0 microversion: 2.26 time: 0.127424 Aug 24 10:30:16.967915 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2098/3840] 10.222.0.85 () {60 vars in 1358 bytes} [Wed Aug 24 10:30:16 2022] GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags/tempest-tag-491590394 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:30:16.975588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-630276ea-ae0e-4c1e-ab50-9684a7254b60 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '.version_select at 0x7f4654141a60>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:17.005483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-630276ea-ae0e-4c1e-ab50-9684a7254b60 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:17.006041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-630276ea-ae0e-4c1e-ab50-9684a7254b60 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:17.006728 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-630276ea-ae0e-4c1e-ab50-9684a7254b60 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:17.007300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-630276ea-ae0e-4c1e-ab50-9684a7254b60 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:17.028864 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-630276ea-ae0e-4c1e-ab50-9684a7254b60 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:17.029388 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-630276ea-ae0e-4c1e-ab50-9684a7254b60 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:17.030024 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-630276ea-ae0e-4c1e-ab50-9684a7254b60 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:17.031266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-630276ea-ae0e-4c1e-ab50-9684a7254b60 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:17.031947 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-630276ea-ae0e-4c1e-ab50-9684a7254b60 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:17.032809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-630276ea-ae0e-4c1e-ab50-9684a7254b60 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:17.086782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-630276ea-ae0e-4c1e-ab50-9684a7254b60 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:17.087270 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-630276ea-ae0e-4c1e-ab50-9684a7254b60 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:17.088014 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-630276ea-ae0e-4c1e-ab50-9684a7254b60 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:17.091525 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:17.139761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-630276ea-ae0e-4c1e-ab50-9684a7254b60 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lazy-loading 'flavor' on Instance uuid 175bfff6-6f17-40b0-9209-32024473add0 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:30:17.184278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ea0d17e1-286b-4940-bfdd-42996c0796ee tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:17.189769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ea0d17e1-286b-4940-bfdd-42996c0796ee tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:17.208832 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-630276ea-ae0e-4c1e-ab50-9684a7254b60 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "DELETE /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags" status: 204 len: 0 microversion: 2.26 time: 0.232335 Aug 24 10:30:17.217099 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1743/3841] 10.222.0.85 () {60 vars in 1295 bytes} [Wed Aug 24 10:30:16 2022] DELETE /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:30:17.230353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea0d17e1-286b-4940-bfdd-42996c0796ee tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:17.231317 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea0d17e1-286b-4940-bfdd-42996c0796ee tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:17.231974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea0d17e1-286b-4940-bfdd-42996c0796ee tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:17.233328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea0d17e1-286b-4940-bfdd-42996c0796ee tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:17.233648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea0d17e1-286b-4940-bfdd-42996c0796ee tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:17.234082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea0d17e1-286b-4940-bfdd-42996c0796ee tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:17.235961 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bedf1b24-b9d1-40aa-a8c3-142b03cc4a83 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '.version_select at 0x7f4654195040>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:17.260423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bedf1b24-b9d1-40aa-a8c3-142b03cc4a83 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:17.261410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bedf1b24-b9d1-40aa-a8c3-142b03cc4a83 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:17.261858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bedf1b24-b9d1-40aa-a8c3-142b03cc4a83 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:17.284442 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bedf1b24-b9d1-40aa-a8c3-142b03cc4a83 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags" status: 200 len: 12 microversion: 2.26 time: 0.065569 Aug 24 10:30:17.286094 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1744/3842] 10.222.0.85 () {60 vars in 1292 bytes} [Wed Aug 24 10:30:17 2022] GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags => generated 12 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:17.302930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-23006df5-a211-41b4-823b-2aa5e7c24d8c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '.version_select at 0x7f46540bc790>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:17.349680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23006df5-a211-41b4-823b-2aa5e7c24d8c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:17.351877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23006df5-a211-41b4-823b-2aa5e7c24d8c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:17.352675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23006df5-a211-41b4-823b-2aa5e7c24d8c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:17.353257 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-23006df5-a211-41b4-823b-2aa5e7c24d8c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:17.369575 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23006df5-a211-41b4-823b-2aa5e7c24d8c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:17.370080 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23006df5-a211-41b4-823b-2aa5e7c24d8c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:17.372813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23006df5-a211-41b4-823b-2aa5e7c24d8c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:17.373639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23006df5-a211-41b4-823b-2aa5e7c24d8c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:17.374344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23006df5-a211-41b4-823b-2aa5e7c24d8c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:17.374853 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23006df5-a211-41b4-823b-2aa5e7c24d8c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:17.429507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23006df5-a211-41b4-823b-2aa5e7c24d8c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:17.431212 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23006df5-a211-41b4-823b-2aa5e7c24d8c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:17.431508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23006df5-a211-41b4-823b-2aa5e7c24d8c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:17.455363 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23006df5-a211-41b4-823b-2aa5e7c24d8c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:17.455859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23006df5-a211-41b4-823b-2aa5e7c24d8c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:17.456719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23006df5-a211-41b4-823b-2aa5e7c24d8c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:17.500395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-23006df5-a211-41b4-823b-2aa5e7c24d8c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lazy-loading 'flavor' on Instance uuid 175bfff6-6f17-40b0-9209-32024473add0 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:30:17.529008 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-23006df5-a211-41b4-823b-2aa5e7c24d8c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "PUT /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags/tempest-tag-1570019873" status: 201 len: 0 microversion: 2.26 time: 0.236080 Aug 24 10:30:17.530447 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1745/3843] 10.222.0.85 () {62 vars in 1380 bytes} [Wed Aug 24 10:30:17 2022] PUT /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags/tempest-tag-1570019873 => generated 0 bytes in 238 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 24 10:30:17.547101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3770b3c1-1638-4937-a9a3-06bb4ce37b34 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '.version_select at 0x7f46540bc550>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:17.559519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3770b3c1-1638-4937-a9a3-06bb4ce37b34 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:17.560203 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3770b3c1-1638-4937-a9a3-06bb4ce37b34 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:17.560798 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3770b3c1-1638-4937-a9a3-06bb4ce37b34 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:17.575080 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3770b3c1-1638-4937-a9a3-06bb4ce37b34 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags" status: 200 len: 36 microversion: 2.26 time: 0.038667 Aug 24 10:30:17.584249 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1746/3844] 10.222.0.85 () {60 vars in 1292 bytes} [Wed Aug 24 10:30:17 2022] GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags => generated 36 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:17.591565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-81ccefb1-3547-470b-9fbd-901d4228362b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '.version_select at 0x7f46540bc4c0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:17.606766 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81ccefb1-3547-470b-9fbd-901d4228362b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:17.606766 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81ccefb1-3547-470b-9fbd-901d4228362b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:17.607093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81ccefb1-3547-470b-9fbd-901d4228362b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:17.607714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-81ccefb1-3547-470b-9fbd-901d4228362b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:17.629626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81ccefb1-3547-470b-9fbd-901d4228362b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:17.630464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81ccefb1-3547-470b-9fbd-901d4228362b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:17.631195 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81ccefb1-3547-470b-9fbd-901d4228362b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:17.632122 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81ccefb1-3547-470b-9fbd-901d4228362b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:17.633435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81ccefb1-3547-470b-9fbd-901d4228362b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:17.634101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81ccefb1-3547-470b-9fbd-901d4228362b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:17.664469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81ccefb1-3547-470b-9fbd-901d4228362b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:17.665167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81ccefb1-3547-470b-9fbd-901d4228362b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:17.666167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81ccefb1-3547-470b-9fbd-901d4228362b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:17.706168 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-81ccefb1-3547-470b-9fbd-901d4228362b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lazy-loading 'flavor' on Instance uuid 175bfff6-6f17-40b0-9209-32024473add0 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:30:17.730599 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-81ccefb1-3547-470b-9fbd-901d4228362b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "DELETE /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags/tempest-tag-1570019873" status: 204 len: 0 microversion: 2.26 time: 0.144294 Aug 24 10:30:17.735629 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1747/3845] 10.222.0.85 () {60 vars in 1364 bytes} [Wed Aug 24 10:30:17 2022] DELETE /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags/tempest-tag-1570019873 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:30:17.744794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32cf5505-9a3b-4e65-9296-654edd2c62f1 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '.version_select at 0x7f4654141700>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:17.763120 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32cf5505-9a3b-4e65-9296-654edd2c62f1 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:17.763918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32cf5505-9a3b-4e65-9296-654edd2c62f1 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:17.764968 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32cf5505-9a3b-4e65-9296-654edd2c62f1 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:17.780779 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-32cf5505-9a3b-4e65-9296-654edd2c62f1 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags" status: 200 len: 12 microversion: 2.26 time: 0.040817 Aug 24 10:30:17.789759 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1748/3846] 10.222.0.85 () {60 vars in 1292 bytes} [Wed Aug 24 10:30:17 2022] GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags => generated 12 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:17.799173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cc6a45a1-d24d-46ce-9ae6-7874a501b489 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '.version_select at 0x7f46540ce160>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:17.812147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc6a45a1-d24d-46ce-9ae6-7874a501b489 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:17.813838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc6a45a1-d24d-46ce-9ae6-7874a501b489 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:17.814532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc6a45a1-d24d-46ce-9ae6-7874a501b489 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:17.815279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cc6a45a1-d24d-46ce-9ae6-7874a501b489 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:17.827971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:17.831714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc6a45a1-d24d-46ce-9ae6-7874a501b489 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:17.832685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc6a45a1-d24d-46ce-9ae6-7874a501b489 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:17.834100 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc6a45a1-d24d-46ce-9ae6-7874a501b489 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:17.835335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc6a45a1-d24d-46ce-9ae6-7874a501b489 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:17.836168 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc6a45a1-d24d-46ce-9ae6-7874a501b489 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:17.836932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc6a45a1-d24d-46ce-9ae6-7874a501b489 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:17.873292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc6a45a1-d24d-46ce-9ae6-7874a501b489 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:17.874026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc6a45a1-d24d-46ce-9ae6-7874a501b489 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:17.874863 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc6a45a1-d24d-46ce-9ae6-7874a501b489 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:17.888142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-cc6a45a1-d24d-46ce-9ae6-7874a501b489 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lazy-loading 'flavor' on Instance uuid 175bfff6-6f17-40b0-9209-32024473add0 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:30:17.908141 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cc6a45a1-d24d-46ce-9ae6-7874a501b489 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "DELETE /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags" status: 204 len: 0 microversion: 2.26 time: 0.116249 Aug 24 10:30:17.914425 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1749/3847] 10.222.0.85 () {60 vars in 1295 bytes} [Wed Aug 24 10:30:17 2022] DELETE /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:30:17.920533 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fbcc4a60-5bc8-4789-ab77-80edefc52b8a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '.version_select at 0x7f46540e9040>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:17.935071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbcc4a60-5bc8-4789-ab77-80edefc52b8a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:17.937469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbcc4a60-5bc8-4789-ab77-80edefc52b8a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:17.937779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ea0d17e1-286b-4940-bfdd-42996c0796ee tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:17.938465 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbcc4a60-5bc8-4789-ab77-80edefc52b8a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:17.939396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fbcc4a60-5bc8-4789-ab77-80edefc52b8a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:17.948023 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbcc4a60-5bc8-4789-ab77-80edefc52b8a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:17.948643 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbcc4a60-5bc8-4789-ab77-80edefc52b8a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:17.949970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbcc4a60-5bc8-4789-ab77-80edefc52b8a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:17.951042 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbcc4a60-5bc8-4789-ab77-80edefc52b8a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:17.951636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbcc4a60-5bc8-4789-ab77-80edefc52b8a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:17.952720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbcc4a60-5bc8-4789-ab77-80edefc52b8a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:17.954166 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ea0d17e1-286b-4940-bfdd-42996c0796ee tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1521 microversion: 2.1 time: 0.778034 Aug 24 10:30:17.954778 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2099/3848] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:17 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1521 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:18.027296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbcc4a60-5bc8-4789-ab77-80edefc52b8a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:18.028135 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbcc4a60-5bc8-4789-ab77-80edefc52b8a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:18.028673 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbcc4a60-5bc8-4789-ab77-80edefc52b8a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:18.040133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbcc4a60-5bc8-4789-ab77-80edefc52b8a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:18.041004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbcc4a60-5bc8-4789-ab77-80edefc52b8a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:18.041992 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbcc4a60-5bc8-4789-ab77-80edefc52b8a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:18.107007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-fbcc4a60-5bc8-4789-ab77-80edefc52b8a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lazy-loading 'flavor' on Instance uuid 175bfff6-6f17-40b0-9209-32024473add0 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:30:18.147946 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fbcc4a60-5bc8-4789-ab77-80edefc52b8a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "PUT /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags/tempest-tag-117131578" status: 201 len: 0 microversion: 2.26 time: 0.228998 Aug 24 10:30:18.149535 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1750/3849] 10.222.0.85 () {62 vars in 1377 bytes} [Wed Aug 24 10:30:17 2022] PUT /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags/tempest-tag-117131578 => generated 0 bytes in 235 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 24 10:30:18.162355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-893a64f4-7a64-48dd-924d-d2e062c414b2 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '.version_select at 0x7f46550364c0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:18.192295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-893a64f4-7a64-48dd-924d-d2e062c414b2 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:18.195226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-893a64f4-7a64-48dd-924d-d2e062c414b2 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:18.196035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-893a64f4-7a64-48dd-924d-d2e062c414b2 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:18.196792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-893a64f4-7a64-48dd-924d-d2e062c414b2 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:18.231883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-893a64f4-7a64-48dd-924d-d2e062c414b2 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:18.233256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-893a64f4-7a64-48dd-924d-d2e062c414b2 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:18.236275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-893a64f4-7a64-48dd-924d-d2e062c414b2 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:18.242150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-893a64f4-7a64-48dd-924d-d2e062c414b2 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:18.243667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-893a64f4-7a64-48dd-924d-d2e062c414b2 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:18.244453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-893a64f4-7a64-48dd-924d-d2e062c414b2 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:18.291578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:18.302771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-893a64f4-7a64-48dd-924d-d2e062c414b2 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:18.303535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-893a64f4-7a64-48dd-924d-d2e062c414b2 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:18.305413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-893a64f4-7a64-48dd-924d-d2e062c414b2 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:18.319934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-893a64f4-7a64-48dd-924d-d2e062c414b2 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:18.321048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-893a64f4-7a64-48dd-924d-d2e062c414b2 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:18.321755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-893a64f4-7a64-48dd-924d-d2e062c414b2 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:18.402797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-893a64f4-7a64-48dd-924d-d2e062c414b2 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lazy-loading 'flavor' on Instance uuid 175bfff6-6f17-40b0-9209-32024473add0 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:30:18.447319 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-893a64f4-7a64-48dd-924d-d2e062c414b2 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "PUT /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags/tempest-tag-5274622" status: 201 len: 0 microversion: 2.26 time: 0.288735 Aug 24 10:30:18.450601 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2100/3850] 10.222.0.85 () {62 vars in 1371 bytes} [Wed Aug 24 10:30:18 2022] PUT /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags/tempest-tag-5274622 => generated 0 bytes in 293 msecs (HTTP/1.1 201) 10 headers in 483 bytes (1 switches on core 0) Aug 24 10:30:18.459824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-04aa03c7-7758-4dc0-aa4e-cced481656b8 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '.version_select at 0x7f4654195160>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:18.471260 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04aa03c7-7758-4dc0-aa4e-cced481656b8 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:18.471921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04aa03c7-7758-4dc0-aa4e-cced481656b8 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:18.472467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04aa03c7-7758-4dc0-aa4e-cced481656b8 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:18.473317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-04aa03c7-7758-4dc0-aa4e-cced481656b8 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:18.481293 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04aa03c7-7758-4dc0-aa4e-cced481656b8 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:18.481879 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04aa03c7-7758-4dc0-aa4e-cced481656b8 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:18.482782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04aa03c7-7758-4dc0-aa4e-cced481656b8 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:18.483326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04aa03c7-7758-4dc0-aa4e-cced481656b8 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:18.483826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04aa03c7-7758-4dc0-aa4e-cced481656b8 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:18.484431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04aa03c7-7758-4dc0-aa4e-cced481656b8 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:18.519113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04aa03c7-7758-4dc0-aa4e-cced481656b8 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:18.519613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04aa03c7-7758-4dc0-aa4e-cced481656b8 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:18.520136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04aa03c7-7758-4dc0-aa4e-cced481656b8 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:18.547858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-04aa03c7-7758-4dc0-aa4e-cced481656b8 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lazy-loading 'flavor' on Instance uuid 175bfff6-6f17-40b0-9209-32024473add0 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:30:18.591941 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-04aa03c7-7758-4dc0-aa4e-cced481656b8 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "DELETE /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags" status: 204 len: 0 microversion: 2.26 time: 0.136122 Aug 24 10:30:18.595602 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1751/3851] 10.222.0.85 () {60 vars in 1295 bytes} [Wed Aug 24 10:30:18 2022] DELETE /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:30:18.604879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-51af753f-a319-4901-828d-6dd584514ad5 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '.version_select at 0x7f4655036310>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:18.622406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51af753f-a319-4901-828d-6dd584514ad5 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:18.623825 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51af753f-a319-4901-828d-6dd584514ad5 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:18.624607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51af753f-a319-4901-828d-6dd584514ad5 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:18.637215 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-51af753f-a319-4901-828d-6dd584514ad5 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags" status: 200 len: 12 microversion: 2.26 time: 0.037356 Aug 24 10:30:18.638474 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2101/3852] 10.222.0.85 () {60 vars in 1292 bytes} [Wed Aug 24 10:30:18 2022] GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags => generated 12 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:18.651730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-018f7a44-7aaa-487c-9182-d94ed0a56d45 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '.version_select at 0x7f465413d280>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:18.664121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-018f7a44-7aaa-487c-9182-d94ed0a56d45 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:18.664920 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-018f7a44-7aaa-487c-9182-d94ed0a56d45 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:18.665607 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-018f7a44-7aaa-487c-9182-d94ed0a56d45 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:18.667184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-018f7a44-7aaa-487c-9182-d94ed0a56d45 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:18.676750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-018f7a44-7aaa-487c-9182-d94ed0a56d45 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:18.677534 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-018f7a44-7aaa-487c-9182-d94ed0a56d45 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:18.678121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-018f7a44-7aaa-487c-9182-d94ed0a56d45 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:18.678987 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-018f7a44-7aaa-487c-9182-d94ed0a56d45 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:18.679599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-018f7a44-7aaa-487c-9182-d94ed0a56d45 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:18.680180 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-018f7a44-7aaa-487c-9182-d94ed0a56d45 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:18.723155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-018f7a44-7aaa-487c-9182-d94ed0a56d45 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:18.723875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-018f7a44-7aaa-487c-9182-d94ed0a56d45 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:18.724438 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-018f7a44-7aaa-487c-9182-d94ed0a56d45 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:18.741696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-018f7a44-7aaa-487c-9182-d94ed0a56d45 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lazy-loading 'flavor' on Instance uuid 175bfff6-6f17-40b0-9209-32024473add0 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:30:18.769946 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-018f7a44-7aaa-487c-9182-d94ed0a56d45 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "DELETE /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags" status: 204 len: 0 microversion: 2.26 time: 0.124652 Aug 24 10:30:18.771804 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1752/3853] 10.222.0.85 () {60 vars in 1295 bytes} [Wed Aug 24 10:30:18 2022] DELETE /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:30:18.782294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7bcd9daa-012a-454f-8312-e68076c6a49c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '.version_select at 0x7f4654f0bd30>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:18.803217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bcd9daa-012a-454f-8312-e68076c6a49c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:18.803718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bcd9daa-012a-454f-8312-e68076c6a49c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:18.804149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bcd9daa-012a-454f-8312-e68076c6a49c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:18.804787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7bcd9daa-012a-454f-8312-e68076c6a49c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:18.819422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bcd9daa-012a-454f-8312-e68076c6a49c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:18.819584 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bcd9daa-012a-454f-8312-e68076c6a49c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:18.819989 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bcd9daa-012a-454f-8312-e68076c6a49c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:18.820941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bcd9daa-012a-454f-8312-e68076c6a49c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:18.823715 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bcd9daa-012a-454f-8312-e68076c6a49c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:18.824373 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bcd9daa-012a-454f-8312-e68076c6a49c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:18.886316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bcd9daa-012a-454f-8312-e68076c6a49c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:18.891049 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bcd9daa-012a-454f-8312-e68076c6a49c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:18.898111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bcd9daa-012a-454f-8312-e68076c6a49c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:18.932055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bcd9daa-012a-454f-8312-e68076c6a49c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:18.932973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bcd9daa-012a-454f-8312-e68076c6a49c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:18.933806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bcd9daa-012a-454f-8312-e68076c6a49c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:18.983804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-44e78990-a847-488a-83e1-357d4dc0f191 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:18.984543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-44e78990-a847-488a-83e1-357d4dc0f191 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:18.996443 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44e78990-a847-488a-83e1-357d4dc0f191 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:18.997318 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-7bcd9daa-012a-454f-8312-e68076c6a49c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lazy-loading 'flavor' on Instance uuid 175bfff6-6f17-40b0-9209-32024473add0 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:30:18.997730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44e78990-a847-488a-83e1-357d4dc0f191 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:19.003095 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44e78990-a847-488a-83e1-357d4dc0f191 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:19.007514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44e78990-a847-488a-83e1-357d4dc0f191 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:19.009541 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44e78990-a847-488a-83e1-357d4dc0f191 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:19.011514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44e78990-a847-488a-83e1-357d4dc0f191 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:19.050730 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7bcd9daa-012a-454f-8312-e68076c6a49c tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "PUT /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags/tempest-tag-1418704000" status: 201 len: 0 microversion: 2.26 time: 0.272907 Aug 24 10:30:19.056431 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2102/3854] 10.222.0.85 () {62 vars in 1380 bytes} [Wed Aug 24 10:30:18 2022] PUT /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags/tempest-tag-1418704000 => generated 0 bytes in 279 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 24 10:30:19.073252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-75431c3f-b3ce-4be2-90b9-393b8ad38e42 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '.version_select at 0x7f46550dc040>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:19.098125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75431c3f-b3ce-4be2-90b9-393b8ad38e42 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:19.098525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75431c3f-b3ce-4be2-90b9-393b8ad38e42 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:19.098969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75431c3f-b3ce-4be2-90b9-393b8ad38e42 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:19.101851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-75431c3f-b3ce-4be2-90b9-393b8ad38e42 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:19.117797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75431c3f-b3ce-4be2-90b9-393b8ad38e42 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:19.120916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75431c3f-b3ce-4be2-90b9-393b8ad38e42 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:19.122211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75431c3f-b3ce-4be2-90b9-393b8ad38e42 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:19.123714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75431c3f-b3ce-4be2-90b9-393b8ad38e42 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:19.124365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75431c3f-b3ce-4be2-90b9-393b8ad38e42 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:19.124812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75431c3f-b3ce-4be2-90b9-393b8ad38e42 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:19.169152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75431c3f-b3ce-4be2-90b9-393b8ad38e42 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:19.175049 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75431c3f-b3ce-4be2-90b9-393b8ad38e42 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:19.175738 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75431c3f-b3ce-4be2-90b9-393b8ad38e42 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:19.188423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75431c3f-b3ce-4be2-90b9-393b8ad38e42 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:19.189303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75431c3f-b3ce-4be2-90b9-393b8ad38e42 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:19.189745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75431c3f-b3ce-4be2-90b9-393b8ad38e42 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:19.303940 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-75431c3f-b3ce-4be2-90b9-393b8ad38e42 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lazy-loading 'flavor' on Instance uuid 175bfff6-6f17-40b0-9209-32024473add0 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:30:19.341339 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-75431c3f-b3ce-4be2-90b9-393b8ad38e42 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "PUT /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags/tempest-tag-2013692083" status: 201 len: 0 microversion: 2.26 time: 0.279551 Aug 24 10:30:19.347917 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2103/3855] 10.222.0.85 () {62 vars in 1380 bytes} [Wed Aug 24 10:30:19 2022] PUT /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags/tempest-tag-2013692083 => generated 0 bytes in 281 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 24 10:30:19.367349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-052f39e0-e387-4d72-9d30-d81b93b45784 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Action: 'update_all', calling method: .version_select at 0x7f4654eb7af0>, body: {"tags": ["tempest-tag-1606919107", "tempest-tag-520314929"]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:30:19.382662 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-052f39e0-e387-4d72-9d30-d81b93b45784 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:19.383339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-052f39e0-e387-4d72-9d30-d81b93b45784 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:19.383849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-052f39e0-e387-4d72-9d30-d81b93b45784 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:19.386958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-052f39e0-e387-4d72-9d30-d81b93b45784 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:19.402209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-052f39e0-e387-4d72-9d30-d81b93b45784 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:19.402810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-052f39e0-e387-4d72-9d30-d81b93b45784 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:19.403830 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-052f39e0-e387-4d72-9d30-d81b93b45784 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:19.405139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-052f39e0-e387-4d72-9d30-d81b93b45784 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:19.405680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-052f39e0-e387-4d72-9d30-d81b93b45784 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:19.406318 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-052f39e0-e387-4d72-9d30-d81b93b45784 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:19.464916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-052f39e0-e387-4d72-9d30-d81b93b45784 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:19.465208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-052f39e0-e387-4d72-9d30-d81b93b45784 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:19.465632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-052f39e0-e387-4d72-9d30-d81b93b45784 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:19.490598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-44e78990-a847-488a-83e1-357d4dc0f191 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:19.501427 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-44e78990-a847-488a-83e1-357d4dc0f191 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1521 microversion: 2.1 time: 0.525282 Aug 24 10:30:19.501989 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1753/3856] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:18 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1521 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:19.540577 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-052f39e0-e387-4d72-9d30-d81b93b45784 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lazy-loading 'flavor' on Instance uuid 175bfff6-6f17-40b0-9209-32024473add0 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:30:19.606156 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-052f39e0-e387-4d72-9d30-d81b93b45784 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "PUT /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags" status: 200 len: 61 microversion: 2.26 time: 0.255374 Aug 24 10:30:19.609971 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2104/3857] 10.222.0.85 () {62 vars in 1312 bytes} [Wed Aug 24 10:30:19 2022] PUT /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags => generated 61 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:19.620913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0e8a42c4-53e2-406c-9190-47ce05f2a89f tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '.version_select at 0x7f46540ce700>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:19.648632 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e8a42c4-53e2-406c-9190-47ce05f2a89f tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:19.661701 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e8a42c4-53e2-406c-9190-47ce05f2a89f tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:19.662170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e8a42c4-53e2-406c-9190-47ce05f2a89f tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:19.689181 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0e8a42c4-53e2-406c-9190-47ce05f2a89f tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags" status: 200 len: 61 microversion: 2.26 time: 0.070845 Aug 24 10:30:19.693315 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1754/3858] 10.222.0.85 () {60 vars in 1292 bytes} [Wed Aug 24 10:30:19 2022] GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags => generated 61 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:19.704509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-823ac547-f54b-4156-b533-7accb1d9783a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '.version_select at 0x7f465a1d6280>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:19.720280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-823ac547-f54b-4156-b533-7accb1d9783a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:19.721742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-823ac547-f54b-4156-b533-7accb1d9783a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:19.721742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-823ac547-f54b-4156-b533-7accb1d9783a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:19.722105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-823ac547-f54b-4156-b533-7accb1d9783a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:19.736264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-823ac547-f54b-4156-b533-7accb1d9783a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:19.736264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-823ac547-f54b-4156-b533-7accb1d9783a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:19.736609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-823ac547-f54b-4156-b533-7accb1d9783a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:19.737362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-823ac547-f54b-4156-b533-7accb1d9783a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:19.737942 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-823ac547-f54b-4156-b533-7accb1d9783a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:19.739055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-823ac547-f54b-4156-b533-7accb1d9783a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:19.777405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-823ac547-f54b-4156-b533-7accb1d9783a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:19.777895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-823ac547-f54b-4156-b533-7accb1d9783a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:19.778344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-823ac547-f54b-4156-b533-7accb1d9783a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:19.817914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-823ac547-f54b-4156-b533-7accb1d9783a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lazy-loading 'flavor' on Instance uuid 175bfff6-6f17-40b0-9209-32024473add0 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:30:19.854629 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-823ac547-f54b-4156-b533-7accb1d9783a tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "DELETE /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags" status: 204 len: 0 microversion: 2.26 time: 0.156065 Aug 24 10:30:19.863411 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2105/3859] 10.222.0.85 () {60 vars in 1295 bytes} [Wed Aug 24 10:30:19 2022] DELETE /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0/tags => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:30:19.869850 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c9592ce4-5947-49fc-943b-0400a8ad2fdf tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:19.870773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c9592ce4-5947-49fc-943b-0400a8ad2fdf tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:19.883557 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9592ce4-5947-49fc-943b-0400a8ad2fdf tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:19.885063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9592ce4-5947-49fc-943b-0400a8ad2fdf tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:19.886674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9592ce4-5947-49fc-943b-0400a8ad2fdf tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:19.887742 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9592ce4-5947-49fc-943b-0400a8ad2fdf tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:19.890699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9592ce4-5947-49fc-943b-0400a8ad2fdf tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:19.891401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9592ce4-5947-49fc-943b-0400a8ad2fdf tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:19.998611 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c9592ce4-5947-49fc-943b-0400a8ad2fdf tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:30:20.004456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:DELETE=5,nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:20.166897 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c9592ce4-5947-49fc-943b-0400a8ad2fdf tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "DELETE /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0" status: 204 len: 0 microversion: 2.26 time: 0.299972 Aug 24 10:30:20.178344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3f2b549-d590-4e9b-affd-9f1aa6362fc4 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:20.179162 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d3f2b549-d590-4e9b-affd-9f1aa6362fc4 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:20.181505 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1755/3860] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:30:19 2022] DELETE /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:30:20.191222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3f2b549-d590-4e9b-affd-9f1aa6362fc4 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:20.191714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3f2b549-d590-4e9b-affd-9f1aa6362fc4 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:20.192157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3f2b549-d590-4e9b-affd-9f1aa6362fc4 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:20.192876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3f2b549-d590-4e9b-affd-9f1aa6362fc4 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:20.200256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3f2b549-d590-4e9b-affd-9f1aa6362fc4 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:20.201190 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3f2b549-d590-4e9b-affd-9f1aa6362fc4 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:20.536201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-659abc2b-8fc2-4a2d-82f5-efb7287049a2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:20.537432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-659abc2b-8fc2-4a2d-82f5-efb7287049a2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:20.560165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-659abc2b-8fc2-4a2d-82f5-efb7287049a2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:20.561013 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-659abc2b-8fc2-4a2d-82f5-efb7287049a2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:20.562146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-659abc2b-8fc2-4a2d-82f5-efb7287049a2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:20.563373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-659abc2b-8fc2-4a2d-82f5-efb7287049a2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:20.564203 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-659abc2b-8fc2-4a2d-82f5-efb7287049a2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:20.564966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-659abc2b-8fc2-4a2d-82f5-efb7287049a2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:21.213735 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d3f2b549-d590-4e9b-affd-9f1aa6362fc4 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:21.226707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d3f2b549-d590-4e9b-affd-9f1aa6362fc4 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:21.228466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d3f2b549-d590-4e9b-affd-9f1aa6362fc4 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:21.230372 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d3f2b549-d590-4e9b-affd-9f1aa6362fc4 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0" status: 200 len: 1550 microversion: 2.26 time: 1.056468 Aug 24 10:30:21.231490 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2106/3861] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:30:20 2022] GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0 => generated 1550 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:30:21.435718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-659abc2b-8fc2-4a2d-82f5-efb7287049a2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:21.454591 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-659abc2b-8fc2-4a2d-82f5-efb7287049a2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1521 microversion: 2.1 time: 0.926869 Aug 24 10:30:21.455256 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1756/3862] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:20 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1521 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:22.258510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ae2a122-fc74-4d75-acc3-bf7b44b2c994 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:22.259204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0ae2a122-fc74-4d75-acc3-bf7b44b2c994 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:22.289921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ae2a122-fc74-4d75-acc3-bf7b44b2c994 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:22.294995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ae2a122-fc74-4d75-acc3-bf7b44b2c994 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:22.297473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ae2a122-fc74-4d75-acc3-bf7b44b2c994 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:22.298747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ae2a122-fc74-4d75-acc3-bf7b44b2c994 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:22.305603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ae2a122-fc74-4d75-acc3-bf7b44b2c994 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:22.308245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ae2a122-fc74-4d75-acc3-bf7b44b2c994 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:22.483996 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0379e480-bfc1-4fae-b32e-1df80d86feca tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:22.485843 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0379e480-bfc1-4fae-b32e-1df80d86feca tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:22.504661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0379e480-bfc1-4fae-b32e-1df80d86feca tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:22.505190 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0379e480-bfc1-4fae-b32e-1df80d86feca tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:22.523901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0379e480-bfc1-4fae-b32e-1df80d86feca tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:22.525518 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0379e480-bfc1-4fae-b32e-1df80d86feca tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:22.527623 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0379e480-bfc1-4fae-b32e-1df80d86feca tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:22.528273 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0379e480-bfc1-4fae-b32e-1df80d86feca tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:22.874677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0379e480-bfc1-4fae-b32e-1df80d86feca tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:22.891880 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0379e480-bfc1-4fae-b32e-1df80d86feca tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1521 microversion: 2.1 time: 0.415663 Aug 24 10:30:22.896549 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1757/3863] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:22 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1521 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:23.639027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0ae2a122-fc74-4d75-acc3-bf7b44b2c994 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:23.664260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0ae2a122-fc74-4d75-acc3-bf7b44b2c994 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:23.665973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0ae2a122-fc74-4d75-acc3-bf7b44b2c994 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:23.667642 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0ae2a122-fc74-4d75-acc3-bf7b44b2c994 tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0" status: 200 len: 1550 microversion: 2.26 time: 1.416239 Aug 24 10:30:23.673939 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2107/3864] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:30:22 2022] GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0 => generated 1550 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:30:23.917501 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fa80b5e5-49d1-4d51-8d7c-f2157670f5ad tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:23.918187 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fa80b5e5-49d1-4d51-8d7c-f2157670f5ad tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:23.958010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa80b5e5-49d1-4d51-8d7c-f2157670f5ad tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:23.962159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa80b5e5-49d1-4d51-8d7c-f2157670f5ad tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:23.967679 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa80b5e5-49d1-4d51-8d7c-f2157670f5ad tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:23.970646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa80b5e5-49d1-4d51-8d7c-f2157670f5ad tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:23.971908 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa80b5e5-49d1-4d51-8d7c-f2157670f5ad tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:23.974001 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa80b5e5-49d1-4d51-8d7c-f2157670f5ad tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:24.438441 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fa80b5e5-49d1-4d51-8d7c-f2157670f5ad tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:24.459157 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fa80b5e5-49d1-4d51-8d7c-f2157670f5ad tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1521 microversion: 2.1 time: 0.543575 Aug 24 10:30:24.459817 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1758/3865] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:23 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1521 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:24.585995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-6ffaba54-07fd-49a6-9021-41f9059fa7b2 req-7ee1a0ac-ff6c-4178-898a-85c6bbc72f56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "175bfff6-6f17-40b0-9209-32024473add0", "name": "network-vif-deleted", "tag": "1642bb43-7c9c-425e-a354-44209b5f2219"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:30:24.621473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6ffaba54-07fd-49a6-9021-41f9059fa7b2 req-7ee1a0ac-ff6c-4178-898a-85c6bbc72f56 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:24.622376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6ffaba54-07fd-49a6-9021-41f9059fa7b2 req-7ee1a0ac-ff6c-4178-898a-85c6bbc72f56 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:24.623059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6ffaba54-07fd-49a6-9021-41f9059fa7b2 req-7ee1a0ac-ff6c-4178-898a-85c6bbc72f56 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:24.645395 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-6ffaba54-07fd-49a6-9021-41f9059fa7b2 req-7ee1a0ac-ff6c-4178-898a-85c6bbc72f56 service nova] Creating event network-vif-deleted:1642bb43-7c9c-425e-a354-44209b5f2219 for instance 175bfff6-6f17-40b0-9209-32024473add0 on n-h2-849328-3 Aug 24 10:30:24.657877 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-6ffaba54-07fd-49a6-9021-41f9059fa7b2 req-7ee1a0ac-ff6c-4178-898a-85c6bbc72f56 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078406 Aug 24 10:30:24.659033 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2108/3866] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:30:24.696868 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f373233d-9d2e-4680-8853-0e5096bda94b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:24.697697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f373233d-9d2e-4680-8853-0e5096bda94b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:24.713750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f373233d-9d2e-4680-8853-0e5096bda94b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:24.714529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f373233d-9d2e-4680-8853-0e5096bda94b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:24.715706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f373233d-9d2e-4680-8853-0e5096bda94b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:24.717702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f373233d-9d2e-4680-8853-0e5096bda94b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:24.719821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f373233d-9d2e-4680-8853-0e5096bda94b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:24.720564 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f373233d-9d2e-4680-8853-0e5096bda94b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:24.818920 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f373233d-9d2e-4680-8853-0e5096bda94b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:24.819776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f373233d-9d2e-4680-8853-0e5096bda94b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:24.820421 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f373233d-9d2e-4680-8853-0e5096bda94b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:24.821112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-f373233d-9d2e-4680-8853-0e5096bda94b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lazy-loading 'fault' on Instance uuid 175bfff6-6f17-40b0-9209-32024473add0 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:30:25.348324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f373233d-9d2e-4680-8853-0e5096bda94b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:25.367098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f373233d-9d2e-4680-8853-0e5096bda94b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:25.371082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f373233d-9d2e-4680-8853-0e5096bda94b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc93574a622345a6835e357f797f2e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c98b130e0042fd8adda93e89aa3707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:25.374978 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f373233d-9d2e-4680-8853-0e5096bda94b tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0" status: 200 len: 1351 microversion: 2.26 time: 0.684433 Aug 24 10:30:25.377547 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1759/3867] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:30:24 2022] GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0 => generated 1351 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:30:25.484916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-32e4bbc7-ca1d-43bc-9470-0b1d012f6f76 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:25.485683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-32e4bbc7-ca1d-43bc-9470-0b1d012f6f76 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:25.497253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32e4bbc7-ca1d-43bc-9470-0b1d012f6f76 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:25.497836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32e4bbc7-ca1d-43bc-9470-0b1d012f6f76 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:25.498359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32e4bbc7-ca1d-43bc-9470-0b1d012f6f76 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:25.499085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32e4bbc7-ca1d-43bc-9470-0b1d012f6f76 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:25.499542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32e4bbc7-ca1d-43bc-9470-0b1d012f6f76 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:25.499967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32e4bbc7-ca1d-43bc-9470-0b1d012f6f76 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:25.874041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-32e4bbc7-ca1d-43bc-9470-0b1d012f6f76 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:25.885035 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-32e4bbc7-ca1d-43bc-9470-0b1d012f6f76 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1521 microversion: 2.1 time: 0.404334 Aug 24 10:30:25.898036 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2109/3868] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:25 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1521 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:26.402613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-61282c4c-e11c-4ed2-ab44-a7d203fb5fad tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:26.404531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-61282c4c-e11c-4ed2-ab44-a7d203fb5fad tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] [instance: 175bfff6-6f17-40b0-9209-32024473add0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:26.412413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61282c4c-e11c-4ed2-ab44-a7d203fb5fad tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:26.413256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61282c4c-e11c-4ed2-ab44-a7d203fb5fad tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:26.413890 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61282c4c-e11c-4ed2-ab44-a7d203fb5fad tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:26.425017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61282c4c-e11c-4ed2-ab44-a7d203fb5fad tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:26.425903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61282c4c-e11c-4ed2-ab44-a7d203fb5fad tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:26.426553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61282c4c-e11c-4ed2-ab44-a7d203fb5fad tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:26.453299 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-61282c4c-e11c-4ed2-ab44-a7d203fb5fad tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] HTTP exception thrown: Instance 175bfff6-6f17-40b0-9209-32024473add0 could not be found. Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-61282c4c-e11c-4ed2-ab44-a7d203fb5fad tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Request method failure captured: Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0 HTTP/1.1 Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf2hHLW6Fi0eeZLfPP02ljW5lze5XPyQKnx4tMyw_mzwRTBnCpaewaa1Xa2tO0cFWBe9KHcJJWayGsVW06qM2DH2NbGuuqsMGzyaGI0Q1kzT697QAPobTMTfo02s_A1aQx1u1ftkPY2twn-2cK4AhHouae2XobXeuVTSMqoIJNfTeTM Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: X-Openstack-Nova-Api-Version: 2.26 Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: b8c98b130e0042fd8adda93e89aa3707 Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerTagsTestJSON-1253389951 Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8c98b130e0042fd8adda93e89aa3707"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b8c98b130e0042fd8adda93e89aa3707", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8c98b130e0042fd8adda93e89aa3707"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b8c98b130e0042fd8adda93e89aa3707"}]}] Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerTagsTestJSON-1253389951 Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: b8c98b130e0042fd8adda93e89aa3707 Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerTagsTestJSON-1253389951 Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerTagsTestJSON-1253389951-project Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: bc93574a622345a6835e357f797f2e83 Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerTagsTestJSON-1253389951-project Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 175bfff6-6f17-40b0-9209-32024473add0 could not be found. Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '175bfff6-6f17-40b0-9209-32024473add0'} Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 175bfff6-6f17-40b0-9209-32024473add0 could not be found. Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 175bfff6-6f17-40b0-9209-32024473add0 could not be found. Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:30:26.455525 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:30:26.458767 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:30:26.458767 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:30:26.458767 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:30:26.458767 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:30:26.458767 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:30:26.458767 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 175bfff6-6f17-40b0-9209-32024473add0 could not be found. Aug 24 10:30:26.458767 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:30:26.460834 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-61282c4c-e11c-4ed2-ab44-a7d203fb5fad tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] Returning 404 to user: Instance 175bfff6-6f17-40b0-9209-32024473add0 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:30:26.462066 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-61282c4c-e11c-4ed2-ab44-a7d203fb5fad tempest-ServerTagsTestJSON-1253389951 tempest-ServerTagsTestJSON-1253389951-project] 10.222.0.85 "GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0" status: 404 len: 111 microversion: 2.26 time: 0.063449 Aug 24 10:30:26.465209 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1760/3869] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:30:26 2022] GET /compute/v2.1/servers/175bfff6-6f17-40b0-9209-32024473add0 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:30:26.908583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-04d83e45-4976-4203-84f5-4ea4a65df068 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:26.910504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-04d83e45-4976-4203-84f5-4ea4a65df068 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:26.928260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04d83e45-4976-4203-84f5-4ea4a65df068 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:26.929170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04d83e45-4976-4203-84f5-4ea4a65df068 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:26.930029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04d83e45-4976-4203-84f5-4ea4a65df068 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:26.930943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04d83e45-4976-4203-84f5-4ea4a65df068 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:26.932371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04d83e45-4976-4203-84f5-4ea4a65df068 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:26.932982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04d83e45-4976-4203-84f5-4ea4a65df068 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:27.649648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-04d83e45-4976-4203-84f5-4ea4a65df068 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:27.687772 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-04d83e45-4976-4203-84f5-4ea4a65df068 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1521 microversion: 2.1 time: 0.777880 Aug 24 10:30:27.692700 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2110/3870] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:26 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1521 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:28.714174 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-83ed8611-c2f8-49c4-ab57-f1bcb4a7caee tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:28.714754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-83ed8611-c2f8-49c4-ab57-f1bcb4a7caee tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:28.726074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83ed8611-c2f8-49c4-ab57-f1bcb4a7caee tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:28.726074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83ed8611-c2f8-49c4-ab57-f1bcb4a7caee tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:28.726074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83ed8611-c2f8-49c4-ab57-f1bcb4a7caee tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:28.726074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83ed8611-c2f8-49c4-ab57-f1bcb4a7caee tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:28.726074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83ed8611-c2f8-49c4-ab57-f1bcb4a7caee tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:28.726074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83ed8611-c2f8-49c4-ab57-f1bcb4a7caee tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:29.227187 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-83ed8611-c2f8-49c4-ab57-f1bcb4a7caee tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:29.236006 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-83ed8611-c2f8-49c4-ab57-f1bcb4a7caee tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1521 microversion: 2.1 time: 0.527499 Aug 24 10:30:29.236607 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1761/3871] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:28 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1521 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:30.259081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-970427e2-ece1-4ce7-978d-ecd24c7c0ac8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:30.259670 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-970427e2-ece1-4ce7-978d-ecd24c7c0ac8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:30.273842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-970427e2-ece1-4ce7-978d-ecd24c7c0ac8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:30.273997 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-970427e2-ece1-4ce7-978d-ecd24c7c0ac8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:30.274451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-970427e2-ece1-4ce7-978d-ecd24c7c0ac8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:30.275284 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-970427e2-ece1-4ce7-978d-ecd24c7c0ac8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:30.275771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-970427e2-ece1-4ce7-978d-ecd24c7c0ac8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:30.276180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-970427e2-ece1-4ce7-978d-ecd24c7c0ac8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:30.341240 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=4,nova_cell1:RELEASE=3,nova_cell1:DELETE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:30.850599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-feabc094-22fa-4caa-be09-4cb7fd4ba596 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-215831488", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "052de5cc-0281-4647-b2bd-0d8a89977d6c"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:30:30.925679 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-feabc094-22fa-4caa-be09-4cb7fd4ba596 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] validate_networks() for [('052de5cc-0281-4647-b2bd-0d8a89977d6c', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:30:31.361897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-970427e2-ece1-4ce7-978d-ecd24c7c0ac8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:31.375798 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-970427e2-ece1-4ce7-978d-ecd24c7c0ac8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1521 microversion: 2.1 time: 1.117659 Aug 24 10:30:31.380728 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2111/3872] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:30 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1521 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:30:32.414887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-324b2bdc-db25-45a5-89ee-bea726e9ff19 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:32.415688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-324b2bdc-db25-45a5-89ee-bea726e9ff19 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:32.453751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-324b2bdc-db25-45a5-89ee-bea726e9ff19 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:32.457634 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-324b2bdc-db25-45a5-89ee-bea726e9ff19 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:32.460252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-324b2bdc-db25-45a5-89ee-bea726e9ff19 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:32.461373 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-324b2bdc-db25-45a5-89ee-bea726e9ff19 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:32.462004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-324b2bdc-db25-45a5-89ee-bea726e9ff19 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:32.466914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-324b2bdc-db25-45a5-89ee-bea726e9ff19 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:32.882166 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-feabc094-22fa-4caa-be09-4cb7fd4ba596 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:30:32.884623 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-feabc094-22fa-4caa-be09-4cb7fd4ba596 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:30:32.887194 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-feabc094-22fa-4caa-be09-4cb7fd4ba596 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:30:32.888652 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-feabc094-22fa-4caa-be09-4cb7fd4ba596 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:30:32.889832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-feabc094-22fa-4caa-be09-4cb7fd4ba596 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:30:32.937795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-feabc094-22fa-4caa-be09-4cb7fd4ba596 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:32.938050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-feabc094-22fa-4caa-be09-4cb7fd4ba596 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:32.938764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-feabc094-22fa-4caa-be09-4cb7fd4ba596 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:32.951556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-feabc094-22fa-4caa-be09-4cb7fd4ba596 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:32.952078 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-feabc094-22fa-4caa-be09-4cb7fd4ba596 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:32.952511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-feabc094-22fa-4caa-be09-4cb7fd4ba596 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:33.018225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-feabc094-22fa-4caa-be09-4cb7fd4ba596 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Getting quotas for project aab9aa7f8d974f0a9e183de5c88cd3f2. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:30:33.083749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-feabc094-22fa-4caa-be09-4cb7fd4ba596 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Getting quotas for user a8fdf985677748289bc39f75ee9b432e and project aab9aa7f8d974f0a9e183de5c88cd3f2. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:30:33.143216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-feabc094-22fa-4caa-be09-4cb7fd4ba596 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:30:33.163241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-feabc094-22fa-4caa-be09-4cb7fd4ba596 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] [instance: 845da280-7c2c-4510-ab4c-ec3cbfaf00de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:30:33.487253 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-feabc094-22fa-4caa-be09-4cb7fd4ba596 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.908110 Aug 24 10:30:33.501198 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1762/3873] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:30:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:30:33.519665 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-02191305-68e7-4306-8ff9-acf4976bc033 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:33.531114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-02191305-68e7-4306-8ff9-acf4976bc033 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] [instance: 845da280-7c2c-4510-ab4c-ec3cbfaf00de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:33.872262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-02191305-68e7-4306-8ff9-acf4976bc033 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fdf985677748289bc39f75ee9b432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab9aa7f8d974f0a9e183de5c88cd3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:33.893084 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-02191305-68e7-4306-8ff9-acf4976bc033 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] 10.222.0.85 "GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de" status: 200 len: 1216 microversion: 2.1 time: 0.390465 Aug 24 10:30:33.899979 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1763/3874] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:33 2022] GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de => generated 1216 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:33.998440 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-324b2bdc-db25-45a5-89ee-bea726e9ff19 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:34.013494 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-324b2bdc-db25-45a5-89ee-bea726e9ff19 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1521 microversion: 2.1 time: 1.609478 Aug 24 10:30:34.026098 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2112/3875] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:32 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1521 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:34.935061 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-19644116-c650-4d8c-80e3-7b45f92f082b tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:34.936644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-19644116-c650-4d8c-80e3-7b45f92f082b tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] [instance: 845da280-7c2c-4510-ab4c-ec3cbfaf00de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:34.948508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19644116-c650-4d8c-80e3-7b45f92f082b tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:34.956694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19644116-c650-4d8c-80e3-7b45f92f082b tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:34.957676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19644116-c650-4d8c-80e3-7b45f92f082b tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:34.959616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19644116-c650-4d8c-80e3-7b45f92f082b tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:34.962847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19644116-c650-4d8c-80e3-7b45f92f082b tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:34.968290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19644116-c650-4d8c-80e3-7b45f92f082b tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:35.047458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b12305cf-655d-41fd-8161-a483879a0ee0 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:35.048474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b12305cf-655d-41fd-8161-a483879a0ee0 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:35.053674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=64 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:35.110194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b12305cf-655d-41fd-8161-a483879a0ee0 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:35.119653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b12305cf-655d-41fd-8161-a483879a0ee0 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:35.121258 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b12305cf-655d-41fd-8161-a483879a0ee0 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:35.122244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b12305cf-655d-41fd-8161-a483879a0ee0 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:35.123716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b12305cf-655d-41fd-8161-a483879a0ee0 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:35.129821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b12305cf-655d-41fd-8161-a483879a0ee0 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:35.924275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-19644116-c650-4d8c-80e3-7b45f92f082b tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fdf985677748289bc39f75ee9b432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab9aa7f8d974f0a9e183de5c88cd3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:35.947351 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-19644116-c650-4d8c-80e3-7b45f92f082b tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] 10.222.0.85 "GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de" status: 200 len: 1220 microversion: 2.1 time: 1.016293 Aug 24 10:30:35.949412 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1764/3876] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:34 2022] GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de => generated 1220 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:35.979575 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b12305cf-655d-41fd-8161-a483879a0ee0 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:35.996363 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b12305cf-655d-41fd-8161-a483879a0ee0 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1521 microversion: 2.1 time: 0.952542 Aug 24 10:30:35.998424 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2113/3877] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:35 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1521 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:36.973757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-56b5e437-7db5-462a-912c-498ce764d10a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:36.974216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-56b5e437-7db5-462a-912c-498ce764d10a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] [instance: 845da280-7c2c-4510-ab4c-ec3cbfaf00de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:36.984298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56b5e437-7db5-462a-912c-498ce764d10a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:36.984798 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56b5e437-7db5-462a-912c-498ce764d10a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:36.992073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56b5e437-7db5-462a-912c-498ce764d10a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:36.993262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56b5e437-7db5-462a-912c-498ce764d10a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:36.993912 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56b5e437-7db5-462a-912c-498ce764d10a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:37.002298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56b5e437-7db5-462a-912c-498ce764d10a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:37.019502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-93ed6063-1396-4c14-83f7-8b54245aa4d3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:37.020061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-93ed6063-1396-4c14-83f7-8b54245aa4d3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:37.039200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93ed6063-1396-4c14-83f7-8b54245aa4d3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:37.040043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93ed6063-1396-4c14-83f7-8b54245aa4d3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:37.042942 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93ed6063-1396-4c14-83f7-8b54245aa4d3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:37.043926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93ed6063-1396-4c14-83f7-8b54245aa4d3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:37.044629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93ed6063-1396-4c14-83f7-8b54245aa4d3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:37.045319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93ed6063-1396-4c14-83f7-8b54245aa4d3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:37.621369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-56b5e437-7db5-462a-912c-498ce764d10a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fdf985677748289bc39f75ee9b432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab9aa7f8d974f0a9e183de5c88cd3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:37.635813 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-56b5e437-7db5-462a-912c-498ce764d10a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] 10.222.0.85 "GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de" status: 200 len: 1274 microversion: 2.1 time: 0.666866 Aug 24 10:30:37.636669 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1765/3878] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:36 2022] GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de => generated 1274 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:37.881961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-93ed6063-1396-4c14-83f7-8b54245aa4d3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:37.900223 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-93ed6063-1396-4c14-83f7-8b54245aa4d3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1521 microversion: 2.1 time: 0.883454 Aug 24 10:30:37.904422 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2114/3879] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:37 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1521 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:30:38.659088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4b058bd0-cd77-417a-bdac-b3ca328f9764 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:38.661575 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4b058bd0-cd77-417a-bdac-b3ca328f9764 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] [instance: 845da280-7c2c-4510-ab4c-ec3cbfaf00de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:38.668636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b058bd0-cd77-417a-bdac-b3ca328f9764 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:38.677956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b058bd0-cd77-417a-bdac-b3ca328f9764 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:38.678410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b058bd0-cd77-417a-bdac-b3ca328f9764 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:38.679170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b058bd0-cd77-417a-bdac-b3ca328f9764 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:38.679632 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b058bd0-cd77-417a-bdac-b3ca328f9764 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:38.680079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b058bd0-cd77-417a-bdac-b3ca328f9764 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:38.931044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b455fa6f-fcec-45dd-90ee-3486aceb9175 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:38.935557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b455fa6f-fcec-45dd-90ee-3486aceb9175 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:38.947446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b455fa6f-fcec-45dd-90ee-3486aceb9175 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:38.948181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b455fa6f-fcec-45dd-90ee-3486aceb9175 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:38.949599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b455fa6f-fcec-45dd-90ee-3486aceb9175 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:38.950501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b455fa6f-fcec-45dd-90ee-3486aceb9175 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:38.951093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b455fa6f-fcec-45dd-90ee-3486aceb9175 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:38.951661 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b455fa6f-fcec-45dd-90ee-3486aceb9175 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:39.265080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b455fa6f-fcec-45dd-90ee-3486aceb9175 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:39.280568 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b455fa6f-fcec-45dd-90ee-3486aceb9175 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1521 microversion: 2.1 time: 0.358918 Aug 24 10:30:39.280568 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2115/3880] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:38 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:39.538298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4b058bd0-cd77-417a-bdac-b3ca328f9764 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fdf985677748289bc39f75ee9b432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab9aa7f8d974f0a9e183de5c88cd3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:39.555619 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4b058bd0-cd77-417a-bdac-b3ca328f9764 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] 10.222.0.85 "GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de" status: 200 len: 1316 microversion: 2.1 time: 0.900123 Aug 24 10:30:39.556813 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1766/3881] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:38 2022] GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de => generated 1316 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:40.305006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-26a47d54-22c3-452d-956d-9a5d35743529 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:40.310142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-26a47d54-22c3-452d-956d-9a5d35743529 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:40.322229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26a47d54-22c3-452d-956d-9a5d35743529 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:40.332796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26a47d54-22c3-452d-956d-9a5d35743529 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:40.333591 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26a47d54-22c3-452d-956d-9a5d35743529 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:40.334550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26a47d54-22c3-452d-956d-9a5d35743529 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:40.335182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26a47d54-22c3-452d-956d-9a5d35743529 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:40.335782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26a47d54-22c3-452d-956d-9a5d35743529 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:40.582352 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b9779e9d-b272-41c1-985b-adaeb3c80a44 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:40.583665 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b9779e9d-b272-41c1-985b-adaeb3c80a44 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] [instance: 845da280-7c2c-4510-ab4c-ec3cbfaf00de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:40.623085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9779e9d-b272-41c1-985b-adaeb3c80a44 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:40.623583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9779e9d-b272-41c1-985b-adaeb3c80a44 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:40.624026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9779e9d-b272-41c1-985b-adaeb3c80a44 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:40.624767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9779e9d-b272-41c1-985b-adaeb3c80a44 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:40.625610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9779e9d-b272-41c1-985b-adaeb3c80a44 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:40.626222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9779e9d-b272-41c1-985b-adaeb3c80a44 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:40.913684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-26a47d54-22c3-452d-956d-9a5d35743529 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:40.925368 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-26a47d54-22c3-452d-956d-9a5d35743529 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1521 microversion: 2.1 time: 0.624821 Aug 24 10:30:40.927111 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2116/3882] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:40 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1521 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:42.066336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b9779e9d-b272-41c1-985b-adaeb3c80a44 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fdf985677748289bc39f75ee9b432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab9aa7f8d974f0a9e183de5c88cd3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:42.078362 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b9779e9d-b272-41c1-985b-adaeb3c80a44 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] 10.222.0.85 "GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de" status: 200 len: 1316 microversion: 2.1 time: 1.504023 Aug 24 10:30:42.078966 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1767/3883] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:40 2022] GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de => generated 1316 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:30:42.091905 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-577863fa-cb59-492d-9cde-8172f62aa26b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:42.092748 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-577863fa-cb59-492d-9cde-8172f62aa26b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:42.112161 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-577863fa-cb59-492d-9cde-8172f62aa26b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:42.113009 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-577863fa-cb59-492d-9cde-8172f62aa26b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:42.113644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-577863fa-cb59-492d-9cde-8172f62aa26b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:42.114394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-577863fa-cb59-492d-9cde-8172f62aa26b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:42.114858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-577863fa-cb59-492d-9cde-8172f62aa26b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:42.115287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-577863fa-cb59-492d-9cde-8172f62aa26b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:42.135801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-27043061-f7e5-4f00-badd-2499b2426217 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Action: 'create', calling method: .version_select at 0x7f46550dc3a0>, body: {"keypair": {"name": "tempest-keypair-1040532086", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4Vlr7qpSB2A1M7d2fKTrbYTz2Fd1g5Rtvsx2THJGIZR1z8a9YLo7DbtXiphxXEtH35KwhFpliBSHs8+LI8pvkeXIHSMaFu6j33961kDDv1xMyVH4Gfs6gnaYHr7r6Q0Q=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:30:42.172686 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-27043061-f7e5-4f00-badd-2499b2426217 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Getting quotas for project 87126fba5c074971a9c3c41de4164571. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:30:42.182174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-27043061-f7e5-4f00-badd-2499b2426217 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Getting quotas for user ce4bbe335166415da37188b475b3194b and project 87126fba5c074971a9c3c41de4164571. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:30:42.226296 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-27043061-f7e5-4f00-badd-2499b2426217 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.458323 Aug 24 10:30:42.250978 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2117/3884] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:30:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:30:42.987316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:43.069874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-577863fa-cb59-492d-9cde-8172f62aa26b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:43.092497 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-577863fa-cb59-492d-9cde-8172f62aa26b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1521 microversion: 2.1 time: 1.000354 Aug 24 10:30:43.093607 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1768/3885] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:42 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1521 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:43.113995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-733442d7-f445-490a-a63a-63830c48083a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:43.114813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-733442d7-f445-490a-a63a-63830c48083a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] [instance: 845da280-7c2c-4510-ab4c-ec3cbfaf00de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:43.122688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-733442d7-f445-490a-a63a-63830c48083a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:43.123419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-733442d7-f445-490a-a63a-63830c48083a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:43.123854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-733442d7-f445-490a-a63a-63830c48083a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:43.124722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-733442d7-f445-490a-a63a-63830c48083a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:43.125361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-733442d7-f445-490a-a63a-63830c48083a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:43.126088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-733442d7-f445-490a-a63a-63830c48083a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:43.403629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-f5427579-8e65-4acf-9703-156a1f2cf403 req-817fe212-daa7-44fc-97e2-be0ceaa21c6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "845da280-7c2c-4510-ab4c-ec3cbfaf00de", "tag": "d382e6ce-1861-496a-98ec-4690a5c31a11"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:30:43.442885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f5427579-8e65-4acf-9703-156a1f2cf403 req-817fe212-daa7-44fc-97e2-be0ceaa21c6c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:43.445988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f5427579-8e65-4acf-9703-156a1f2cf403 req-817fe212-daa7-44fc-97e2-be0ceaa21c6c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:43.448185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f5427579-8e65-4acf-9703-156a1f2cf403 req-817fe212-daa7-44fc-97e2-be0ceaa21c6c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:43.497007 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-f5427579-8e65-4acf-9703-156a1f2cf403 req-817fe212-daa7-44fc-97e2-be0ceaa21c6c service nova] Creating event network-changed:d382e6ce-1861-496a-98ec-4690a5c31a11 for instance 845da280-7c2c-4510-ab4c-ec3cbfaf00de on n-h1-849328-3 Aug 24 10:30:43.516684 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-f5427579-8e65-4acf-9703-156a1f2cf403 req-817fe212-daa7-44fc-97e2-be0ceaa21c6c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123943 Aug 24 10:30:43.517639 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1769/3886] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:30:43.556550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-733442d7-f445-490a-a63a-63830c48083a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fdf985677748289bc39f75ee9b432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab9aa7f8d974f0a9e183de5c88cd3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:43.570567 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-733442d7-f445-490a-a63a-63830c48083a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] 10.222.0.85 "GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de" status: 200 len: 1316 microversion: 2.1 time: 0.464002 Aug 24 10:30:43.574204 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2118/3887] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:43 2022] GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de => generated 1316 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:44.119182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:44.136203 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c4fd9a4f-ab36-4482-94cf-babb1dbce7dd tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:44.137667 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c4fd9a4f-ab36-4482-94cf-babb1dbce7dd tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:44.147934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4fd9a4f-ab36-4482-94cf-babb1dbce7dd tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:44.157679 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4fd9a4f-ab36-4482-94cf-babb1dbce7dd tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:44.158383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4fd9a4f-ab36-4482-94cf-babb1dbce7dd tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:44.159482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4fd9a4f-ab36-4482-94cf-babb1dbce7dd tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:44.160487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4fd9a4f-ab36-4482-94cf-babb1dbce7dd tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:44.161081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4fd9a4f-ab36-4482-94cf-babb1dbce7dd tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:44.596379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-79c1a938-04cc-4ec2-b44b-3311397b06d2 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:44.597796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-79c1a938-04cc-4ec2-b44b-3311397b06d2 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] [instance: 845da280-7c2c-4510-ab4c-ec3cbfaf00de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:44.614773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79c1a938-04cc-4ec2-b44b-3311397b06d2 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:44.615505 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79c1a938-04cc-4ec2-b44b-3311397b06d2 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:44.616292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79c1a938-04cc-4ec2-b44b-3311397b06d2 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:44.617183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79c1a938-04cc-4ec2-b44b-3311397b06d2 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:44.619195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79c1a938-04cc-4ec2-b44b-3311397b06d2 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:44.619769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79c1a938-04cc-4ec2-b44b-3311397b06d2 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:45.096823 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-79c1a938-04cc-4ec2-b44b-3311397b06d2 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fdf985677748289bc39f75ee9b432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab9aa7f8d974f0a9e183de5c88cd3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:45.105302 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-79c1a938-04cc-4ec2-b44b-3311397b06d2 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] 10.222.0.85 "GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de" status: 200 len: 1316 microversion: 2.1 time: 0.513092 Aug 24 10:30:45.118507 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2119/3888] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:44 2022] GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de => generated 1316 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:30:46.088104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c4fd9a4f-ab36-4482-94cf-babb1dbce7dd tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:46.099855 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c4fd9a4f-ab36-4482-94cf-babb1dbce7dd tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1521 microversion: 2.1 time: 1.984630 Aug 24 10:30:46.100476 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1770/3889] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:44 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1521 bytes in 1986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:46.126392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e1ca954f-3b63-4b29-9826-dd40b78a6d48 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:46.127605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e1ca954f-3b63-4b29-9826-dd40b78a6d48 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] [instance: 845da280-7c2c-4510-ab4c-ec3cbfaf00de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:46.143677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1ca954f-3b63-4b29-9826-dd40b78a6d48 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:46.148459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1ca954f-3b63-4b29-9826-dd40b78a6d48 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:46.148889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1ca954f-3b63-4b29-9826-dd40b78a6d48 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:46.158152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1ca954f-3b63-4b29-9826-dd40b78a6d48 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:46.158886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1ca954f-3b63-4b29-9826-dd40b78a6d48 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:46.159570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1ca954f-3b63-4b29-9826-dd40b78a6d48 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:47.124039 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-83204664-8f63-4994-b307-16fb444c30f2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:47.124760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-83204664-8f63-4994-b307-16fb444c30f2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:47.133045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83204664-8f63-4994-b307-16fb444c30f2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:47.138213 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83204664-8f63-4994-b307-16fb444c30f2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:47.138856 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83204664-8f63-4994-b307-16fb444c30f2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:47.140552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83204664-8f63-4994-b307-16fb444c30f2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:47.143939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83204664-8f63-4994-b307-16fb444c30f2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:47.144478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83204664-8f63-4994-b307-16fb444c30f2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:47.678163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e1ca954f-3b63-4b29-9826-dd40b78a6d48 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fdf985677748289bc39f75ee9b432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab9aa7f8d974f0a9e183de5c88cd3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:47.703532 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e1ca954f-3b63-4b29-9826-dd40b78a6d48 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] 10.222.0.85 "GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de" status: 200 len: 1316 microversion: 2.1 time: 1.581242 Aug 24 10:30:47.709550 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2120/3890] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:46 2022] GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de => generated 1316 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:47.785846 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-83204664-8f63-4994-b307-16fb444c30f2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:47.806189 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-83204664-8f63-4994-b307-16fb444c30f2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1501 microversion: 2.1 time: 0.683090 Aug 24 10:30:47.809576 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1771/3891] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:47 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1501 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:30:47.839713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb7ff741-7675-4bd8-bf9f-36622f5f350c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:47.840726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cb7ff741-7675-4bd8-bf9f-36622f5f350c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:47.850146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb7ff741-7675-4bd8-bf9f-36622f5f350c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:47.853477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb7ff741-7675-4bd8-bf9f-36622f5f350c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:47.854125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb7ff741-7675-4bd8-bf9f-36622f5f350c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:47.858122 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb7ff741-7675-4bd8-bf9f-36622f5f350c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:47.858804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb7ff741-7675-4bd8-bf9f-36622f5f350c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:47.859388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb7ff741-7675-4bd8-bf9f-36622f5f350c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:48.429455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cb7ff741-7675-4bd8-bf9f-36622f5f350c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:48.458390 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cb7ff741-7675-4bd8-bf9f-36622f5f350c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1515 microversion: 2.1 time: 0.624407 Aug 24 10:30:48.473580 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2121/3892] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:47 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1515 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:48.482871 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5a2148d9-d96f-4680-b5ad-2143301eb2b0 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:30:48.485442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5a2148d9-d96f-4680-b5ad-2143301eb2b0 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: fee81677-e284-453b-bb87-f5666aca59b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:48.523614 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:48.527612 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-5a2148d9-d96f-4680-b5ad-2143301eb2b0 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] HTTP exception thrown: Instance fee81677-e284-453b-bb87-f5666aca59b3 could not be found. Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5a2148d9-d96f-4680-b5ad-2143301eb2b0 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Request method failure captured: Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/fee81677-e284-453b-bb87-f5666aca59b3/action HTTP/1.1 Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 14 Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf2afGdSM86mh0RIAZFYBYhaQ4EtyTCcCD00ldy_PJZTrDPEqZsqjAaBEiSLwFHEWtlpLSXpU9lI2y_7Dlfdrd1tzCv296dD-Q1jtlqtcx2Z1VdQb3wVY7fHkhrfDX6lZ98oMTsvllOCneZWRxakMNA_j9HFWTm3gYwjAHKCNfApMTc Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 125d2dd1d22140abaa36184e3628a339 Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1145732609 Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/125d2dd1d22140abaa36184e3628a339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_125d2dd1d22140abaa36184e3628a339", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/125d2dd1d22140abaa36184e3628a339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/125d2dd1d22140abaa36184e3628a339"}]}] Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1145732609 Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 125d2dd1d22140abaa36184e3628a339 Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1145732609 Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerRescueNegativeTestJSON-1145732609-project Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 133e99904a6b4574933cad73d0f2293f Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1145732609-project Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: {"rescue": {}} Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance fee81677-e284-453b-bb87-f5666aca59b3 could not be found. Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'fee81677-e284-453b-bb87-f5666aca59b3', 'body': {'rescue': {}}} Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fee81677-e284-453b-bb87-f5666aca59b3 could not be found. Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fee81677-e284-453b-bb87-f5666aca59b3 could not be found. Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:30:48.552675 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:30:48.556653 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:30:48.556653 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:30:48.556653 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:30:48.556653 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:30:48.556653 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fee81677-e284-453b-bb87-f5666aca59b3 could not be found. Aug 24 10:30:48.556653 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:30:48.558553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5a2148d9-d96f-4680-b5ad-2143301eb2b0 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Returning 404 to user: Instance fee81677-e284-453b-bb87-f5666aca59b3 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:30:48.560609 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5a2148d9-d96f-4680-b5ad-2143301eb2b0 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "POST /compute/v2.1/servers/fee81677-e284-453b-bb87-f5666aca59b3/action" status: 404 len: 111 microversion: 2.1 time: 0.083091 Aug 24 10:30:48.573971 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1772/3893] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:30:48 2022] POST /compute/v2.1/servers/fee81677-e284-453b-bb87-f5666aca59b3/action => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:30:48.579495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2b27199b-00dd-454a-8f73-2b9dcaac3f2d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:30:48.580054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2b27199b-00dd-454a-8f73-2b9dcaac3f2d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:48.590350 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b27199b-00dd-454a-8f73-2b9dcaac3f2d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:48.590846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b27199b-00dd-454a-8f73-2b9dcaac3f2d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:48.591279 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b27199b-00dd-454a-8f73-2b9dcaac3f2d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:48.598941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b27199b-00dd-454a-8f73-2b9dcaac3f2d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:48.599820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b27199b-00dd-454a-8f73-2b9dcaac3f2d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:48.600431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b27199b-00dd-454a-8f73-2b9dcaac3f2d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:48.729767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-039ed8e1-eb70-4fcd-a20e-4ced095ac2a3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:48.730663 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-039ed8e1-eb70-4fcd-a20e-4ced095ac2a3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] [instance: 845da280-7c2c-4510-ab4c-ec3cbfaf00de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:48.742865 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-039ed8e1-eb70-4fcd-a20e-4ced095ac2a3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:48.745235 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-039ed8e1-eb70-4fcd-a20e-4ced095ac2a3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:48.762028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-039ed8e1-eb70-4fcd-a20e-4ced095ac2a3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:48.763068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-039ed8e1-eb70-4fcd-a20e-4ced095ac2a3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:48.763694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-039ed8e1-eb70-4fcd-a20e-4ced095ac2a3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:48.764273 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-039ed8e1-eb70-4fcd-a20e-4ced095ac2a3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:48.832812 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2b27199b-00dd-454a-8f73-2b9dcaac3f2d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "POST /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41/action" status: 202 len: 0 microversion: 2.1 time: 0.261889 Aug 24 10:30:48.834639 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2122/3894] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:30:48 2022] POST /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:30:48.849440 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-47047712-659e-49ac-9753-bd8aba659210 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:48.852169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-47047712-659e-49ac-9753-bd8aba659210 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:48.874241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47047712-659e-49ac-9753-bd8aba659210 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:48.875089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47047712-659e-49ac-9753-bd8aba659210 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:48.875758 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47047712-659e-49ac-9753-bd8aba659210 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:48.876710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47047712-659e-49ac-9753-bd8aba659210 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:48.878388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47047712-659e-49ac-9753-bd8aba659210 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:48.879231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47047712-659e-49ac-9753-bd8aba659210 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:49.386058 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-47047712-659e-49ac-9753-bd8aba659210 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:49.395838 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-47047712-659e-49ac-9753-bd8aba659210 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1520 microversion: 2.1 time: 0.556805 Aug 24 10:30:49.401169 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2123/3895] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:48 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1520 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:50.304674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-039ed8e1-eb70-4fcd-a20e-4ced095ac2a3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fdf985677748289bc39f75ee9b432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab9aa7f8d974f0a9e183de5c88cd3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:50.307290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:50.335580 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-039ed8e1-eb70-4fcd-a20e-4ced095ac2a3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] 10.222.0.85 "GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de" status: 200 len: 1316 microversion: 2.1 time: 1.607495 Aug 24 10:30:50.336281 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1773/3896] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:48 2022] GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de => generated 1316 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:30:50.428548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-25967c76-a0d5-4a7d-b150-73d1b803ba4f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:50.429937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-25967c76-a0d5-4a7d-b150-73d1b803ba4f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:50.455106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25967c76-a0d5-4a7d-b150-73d1b803ba4f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:50.456169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25967c76-a0d5-4a7d-b150-73d1b803ba4f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:50.460058 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25967c76-a0d5-4a7d-b150-73d1b803ba4f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:50.466805 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25967c76-a0d5-4a7d-b150-73d1b803ba4f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:50.468932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25967c76-a0d5-4a7d-b150-73d1b803ba4f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:50.469997 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25967c76-a0d5-4a7d-b150-73d1b803ba4f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:50.976829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-25967c76-a0d5-4a7d-b150-73d1b803ba4f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:50.989892 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-25967c76-a0d5-4a7d-b150-73d1b803ba4f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1500 microversion: 2.1 time: 0.566375 Aug 24 10:30:50.990493 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2124/3897] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:50 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1500 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:51.019085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eb1ae4ad-9497-4a0f-bb70-63a972c16a4c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:30:51.022479 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eb1ae4ad-9497-4a0f-bb70-63a972c16a4c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:51.032153 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb1ae4ad-9497-4a0f-bb70-63a972c16a4c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:51.033629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb1ae4ad-9497-4a0f-bb70-63a972c16a4c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:51.034326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb1ae4ad-9497-4a0f-bb70-63a972c16a4c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:51.035269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb1ae4ad-9497-4a0f-bb70-63a972c16a4c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:51.036060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb1ae4ad-9497-4a0f-bb70-63a972c16a4c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:51.036884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb1ae4ad-9497-4a0f-bb70-63a972c16a4c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:51.079137 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-eb1ae4ad-9497-4a0f-bb70-63a972c16a4c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lazy-loading 'flavor' on Instance uuid b1bb2ada-4833-4819-a358-2e832c5a0a41 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:30:51.105086 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-eb1ae4ad-9497-4a0f-bb70-63a972c16a4c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] HTTP exception thrown: Cannot 'rescue' instance b1bb2ada-4833-4819-a358-2e832c5a0a41 while it is in vm_state paused Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eb1ae4ad-9497-4a0f-bb70-63a972c16a4c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Request method failure captured: Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41/action HTTP/1.1 Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 14 Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf2afGdSM86mh0RIAZFYBYhaQ4EtyTCcCD00ldy_PJZTrDPEqZsqjAaBEiSLwFHEWtlpLSXpU9lI2y_7Dlfdrd1tzCv296dD-Q1jtlqtcx2Z1VdQb3wVY7fHkhrfDX6lZ98oMTsvllOCneZWRxakMNA_j9HFWTm3gYwjAHKCNfApMTc Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 125d2dd1d22140abaa36184e3628a339 Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1145732609 Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/125d2dd1d22140abaa36184e3628a339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_125d2dd1d22140abaa36184e3628a339", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/125d2dd1d22140abaa36184e3628a339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/125d2dd1d22140abaa36184e3628a339"}]}] Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1145732609 Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 125d2dd1d22140abaa36184e3628a339 Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1145732609 Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerRescueNegativeTestJSON-1145732609-project Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 133e99904a6b4574933cad73d0f2293f Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1145732609-project Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: {"rescue": {}} Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: exception: Cannot 'rescue' instance b1bb2ada-4833-4819-a358-2e832c5a0a41 while it is in vm_state paused Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'b1bb2ada-4833-4819-a358-2e832c5a0a41', 'body': {'rescue': {}}} Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b1bb2ada-4833-4819-a358-2e832c5a0a41 in vm_state paused. Cannot rescue while the instance is in this state. Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance b1bb2ada-4833-4819-a358-2e832c5a0a41 while it is in vm_state paused Aug 24 10:30:51.107127 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:30:51.111079 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:30:51.111079 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:30:51.111079 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:30:51.111079 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:30:51.111079 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:30:51.111079 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:30:51.111079 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:30:51.111079 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance b1bb2ada-4833-4819-a358-2e832c5a0a41 while it is in vm_state paused Aug 24 10:30:51.111079 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:30:51.113107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eb1ae4ad-9497-4a0f-bb70-63a972c16a4c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Returning 409 to user: Cannot 'rescue' instance b1bb2ada-4833-4819-a358-2e832c5a0a41 while it is in vm_state paused {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:30:51.114248 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eb1ae4ad-9497-4a0f-bb70-63a972c16a4c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "POST /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41/action" status: 409 len: 144 microversion: 2.1 time: 0.100391 Aug 24 10:30:51.115027 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1774/3898] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:30:51 2022] POST /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41/action => generated 144 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 10:30:51.123983 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-372ddf32-4240-416e-8613-d246600f6ba2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:30:51.124966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-372ddf32-4240-416e-8613-d246600f6ba2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:51.142371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-372ddf32-4240-416e-8613-d246600f6ba2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:51.144331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-372ddf32-4240-416e-8613-d246600f6ba2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:51.146023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-372ddf32-4240-416e-8613-d246600f6ba2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:51.148959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-372ddf32-4240-416e-8613-d246600f6ba2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:51.149602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-372ddf32-4240-416e-8613-d246600f6ba2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:51.150986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-372ddf32-4240-416e-8613-d246600f6ba2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:51.349994 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-372ddf32-4240-416e-8613-d246600f6ba2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "POST /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41/action" status: 202 len: 0 microversion: 2.1 time: 0.227661 Aug 24 10:30:51.353754 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2125/3899] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:30:51 2022] POST /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:30:51.359909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a337eb24-628b-4c19-a9bb-d2f418ef328f tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:51.361242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a337eb24-628b-4c19-a9bb-d2f418ef328f tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] [instance: 845da280-7c2c-4510-ab4c-ec3cbfaf00de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:51.378585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-37b65456-18bb-45aa-84f4-01184def8851 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:51.378934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a337eb24-628b-4c19-a9bb-d2f418ef328f tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:51.379664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a337eb24-628b-4c19-a9bb-d2f418ef328f tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:51.380459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a337eb24-628b-4c19-a9bb-d2f418ef328f tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:51.381438 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a337eb24-628b-4c19-a9bb-d2f418ef328f tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:51.385852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a337eb24-628b-4c19-a9bb-d2f418ef328f tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:51.387126 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-37b65456-18bb-45aa-84f4-01184def8851 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:51.387653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a337eb24-628b-4c19-a9bb-d2f418ef328f tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:51.416531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37b65456-18bb-45aa-84f4-01184def8851 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:51.417974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37b65456-18bb-45aa-84f4-01184def8851 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:51.419195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37b65456-18bb-45aa-84f4-01184def8851 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:51.420695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37b65456-18bb-45aa-84f4-01184def8851 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:51.421941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37b65456-18bb-45aa-84f4-01184def8851 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:51.423402 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37b65456-18bb-45aa-84f4-01184def8851 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:51.874254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a337eb24-628b-4c19-a9bb-d2f418ef328f tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fdf985677748289bc39f75ee9b432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab9aa7f8d974f0a9e183de5c88cd3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:51.922878 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a337eb24-628b-4c19-a9bb-d2f418ef328f tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] 10.222.0.85 "GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de" status: 200 len: 1316 microversion: 2.1 time: 0.565596 Aug 24 10:30:51.924035 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1775/3900] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:51 2022] GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de => generated 1316 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:52.193195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:52.351468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-37b65456-18bb-45aa-84f4-01184def8851 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:52.362572 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-37b65456-18bb-45aa-84f4-01184def8851 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1507 microversion: 2.1 time: 0.995157 Aug 24 10:30:52.365449 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2126/3901] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:51 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1507 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:52.950284 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-35d08da9-d8c2-4cae-a632-08959c53c3ab tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:52.951555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-35d08da9-d8c2-4cae-a632-08959c53c3ab tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] [instance: 845da280-7c2c-4510-ab4c-ec3cbfaf00de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:52.966272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35d08da9-d8c2-4cae-a632-08959c53c3ab tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:52.967022 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35d08da9-d8c2-4cae-a632-08959c53c3ab tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:52.969829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35d08da9-d8c2-4cae-a632-08959c53c3ab tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:52.971051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35d08da9-d8c2-4cae-a632-08959c53c3ab tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:52.972951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35d08da9-d8c2-4cae-a632-08959c53c3ab tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:52.974205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35d08da9-d8c2-4cae-a632-08959c53c3ab tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:53.385675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1bcc66f0-c163-43df-aab0-c5b734b2792a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:53.386321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1bcc66f0-c163-43df-aab0-c5b734b2792a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:53.412881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bcc66f0-c163-43df-aab0-c5b734b2792a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:53.413429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bcc66f0-c163-43df-aab0-c5b734b2792a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:53.413884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bcc66f0-c163-43df-aab0-c5b734b2792a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:53.414638 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bcc66f0-c163-43df-aab0-c5b734b2792a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:53.420142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bcc66f0-c163-43df-aab0-c5b734b2792a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:53.428320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bcc66f0-c163-43df-aab0-c5b734b2792a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:53.433034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:53.708557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1bcc66f0-c163-43df-aab0-c5b734b2792a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:53.723057 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1bcc66f0-c163-43df-aab0-c5b734b2792a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1515 microversion: 2.1 time: 0.341497 Aug 24 10:30:53.723686 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2127/3902] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:53 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1515 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:30:53.731195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-07e3e726-6205-478d-8f39-3a678a48c6a1 req-2f544418-9d5c-4d80-84cc-9b85d93c4bbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "845da280-7c2c-4510-ab4c-ec3cbfaf00de", "name": "network-vif-plugged", "status": "completed", "tag": "d382e6ce-1861-496a-98ec-4690a5c31a11"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:30:53.763779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-07e3e726-6205-478d-8f39-3a678a48c6a1 req-2f544418-9d5c-4d80-84cc-9b85d93c4bbd service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:53.764721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-07e3e726-6205-478d-8f39-3a678a48c6a1 req-2f544418-9d5c-4d80-84cc-9b85d93c4bbd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:53.765356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-07e3e726-6205-478d-8f39-3a678a48c6a1 req-2f544418-9d5c-4d80-84cc-9b85d93c4bbd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:53.800935 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-07e3e726-6205-478d-8f39-3a678a48c6a1 req-2f544418-9d5c-4d80-84cc-9b85d93c4bbd service nova] Creating event network-vif-plugged:d382e6ce-1861-496a-98ec-4690a5c31a11 for instance 845da280-7c2c-4510-ab4c-ec3cbfaf00de on n-h1-849328-3 Aug 24 10:30:53.824960 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-07e3e726-6205-478d-8f39-3a678a48c6a1 req-2f544418-9d5c-4d80-84cc-9b85d93c4bbd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089363 Aug 24 10:30:53.827285 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2128/3903] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:30:55.018972 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-35d08da9-d8c2-4cae-a632-08959c53c3ab tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fdf985677748289bc39f75ee9b432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab9aa7f8d974f0a9e183de5c88cd3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:55.032233 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-35d08da9-d8c2-4cae-a632-08959c53c3ab tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] 10.222.0.85 "GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de" status: 200 len: 1316 microversion: 2.1 time: 2.086658 Aug 24 10:30:55.033388 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1776/3904] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:52 2022] GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de => generated 1316 bytes in 2090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:56.055153 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7104a068-3c86-4f0c-ade2-1ef5bc7e1510 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:56.056640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7104a068-3c86-4f0c-ade2-1ef5bc7e1510 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] [instance: 845da280-7c2c-4510-ab4c-ec3cbfaf00de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:56.081405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7104a068-3c86-4f0c-ade2-1ef5bc7e1510 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:56.082230 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7104a068-3c86-4f0c-ade2-1ef5bc7e1510 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:56.083399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7104a068-3c86-4f0c-ade2-1ef5bc7e1510 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:56.084608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7104a068-3c86-4f0c-ade2-1ef5bc7e1510 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:56.085216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7104a068-3c86-4f0c-ade2-1ef5bc7e1510 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:56.085785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7104a068-3c86-4f0c-ade2-1ef5bc7e1510 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:56.740830 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7104a068-3c86-4f0c-ade2-1ef5bc7e1510 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fdf985677748289bc39f75ee9b432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab9aa7f8d974f0a9e183de5c88cd3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:56.784543 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7104a068-3c86-4f0c-ade2-1ef5bc7e1510 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] 10.222.0.85 "GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de" status: 200 len: 1504 microversion: 2.1 time: 0.733127 Aug 24 10:30:56.805523 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2129/3905] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:56 2022] GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de => generated 1504 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:56.820312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-053ddafa-6aaf-47b4-87d0-2d85675c8428 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:56.822780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-053ddafa-6aaf-47b4-87d0-2d85675c8428 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] [instance: 845da280-7c2c-4510-ab4c-ec3cbfaf00de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:56.856131 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-053ddafa-6aaf-47b4-87d0-2d85675c8428 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:56.857011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-053ddafa-6aaf-47b4-87d0-2d85675c8428 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:56.858407 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-053ddafa-6aaf-47b4-87d0-2d85675c8428 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:56.859857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-053ddafa-6aaf-47b4-87d0-2d85675c8428 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:56.864309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-053ddafa-6aaf-47b4-87d0-2d85675c8428 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:56.865155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-053ddafa-6aaf-47b4-87d0-2d85675c8428 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:56.924234 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-053ddafa-6aaf-47b4-87d0-2d85675c8428 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'a8fdf985677748289bc39f75ee9b432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab9aa7f8d974f0a9e183de5c88cd3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:56.925819 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-053ddafa-6aaf-47b4-87d0-2d85675c8428 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] 10.222.0.85 "GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de/os-instance-actions/req-feabc094-22fa-4caa-be09-4cb7fd4ba596" status: 200 len: 313 microversion: 2.1 time: 0.111284 Aug 24 10:30:56.937638 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1777/3906] 10.222.0.85 () {58 vars in 1419 bytes} [Wed Aug 24 10:30:56 2022] GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de/os-instance-actions/req-feabc094-22fa-4caa-be09-4cb7fd4ba596 => generated 313 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:30:56.943188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e6356e1a-e8c0-486a-b1b6-c2fbed5efeb3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:30:56.947095 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e6356e1a-e8c0-486a-b1b6-c2fbed5efeb3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] [instance: 845da280-7c2c-4510-ab4c-ec3cbfaf00de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:56.983282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6356e1a-e8c0-486a-b1b6-c2fbed5efeb3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:56.987957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6356e1a-e8c0-486a-b1b6-c2fbed5efeb3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:56.995452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6356e1a-e8c0-486a-b1b6-c2fbed5efeb3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:57.001748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6356e1a-e8c0-486a-b1b6-c2fbed5efeb3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:57.002530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6356e1a-e8c0-486a-b1b6-c2fbed5efeb3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:57.007191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6356e1a-e8c0-486a-b1b6-c2fbed5efeb3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:57.304774 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e6356e1a-e8c0-486a-b1b6-c2fbed5efeb3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] 10.222.0.85 "POST /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de/action" status: 202 len: 0 microversion: 2.1 time: 0.365441 Aug 24 10:30:57.307132 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2130/3907] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:30:56 2022] POST /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:30:57.317144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2fdc0ef5-5295-4228-8729-107d9ca983f8 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:57.320812 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2fdc0ef5-5295-4228-8729-107d9ca983f8 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] [instance: 845da280-7c2c-4510-ab4c-ec3cbfaf00de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:57.344780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fdc0ef5-5295-4228-8729-107d9ca983f8 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:57.345838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fdc0ef5-5295-4228-8729-107d9ca983f8 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:57.347023 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fdc0ef5-5295-4228-8729-107d9ca983f8 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:57.351389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fdc0ef5-5295-4228-8729-107d9ca983f8 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:57.352048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fdc0ef5-5295-4228-8729-107d9ca983f8 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:57.352684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fdc0ef5-5295-4228-8729-107d9ca983f8 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:58.252786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9a9cccc8-ee1f-4384-9163-e2b876519b1b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:30:58.260148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9a9cccc8-ee1f-4384-9163-e2b876519b1b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:58.304261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a9cccc8-ee1f-4384-9163-e2b876519b1b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:58.316350 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a9cccc8-ee1f-4384-9163-e2b876519b1b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:58.318130 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a9cccc8-ee1f-4384-9163-e2b876519b1b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:58.324174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a9cccc8-ee1f-4384-9163-e2b876519b1b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:58.325191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a9cccc8-ee1f-4384-9163-e2b876519b1b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:58.326155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a9cccc8-ee1f-4384-9163-e2b876519b1b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:58.350682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2fdc0ef5-5295-4228-8729-107d9ca983f8 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fdf985677748289bc39f75ee9b432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab9aa7f8d974f0a9e183de5c88cd3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:30:58.369668 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2fdc0ef5-5295-4228-8729-107d9ca983f8 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] 10.222.0.85 "GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de" status: 200 len: 1506 microversion: 2.1 time: 1.056034 Aug 24 10:30:58.371088 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1778/3908] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:57 2022] GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de => generated 1506 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:58.455451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-9a9cccc8-ee1f-4384-9163-e2b876519b1b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lazy-loading 'flavor' on Instance uuid b1bb2ada-4833-4819-a358-2e832c5a0a41 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:30:58.630383 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9a9cccc8-ee1f-4384-9163-e2b876519b1b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "POST /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41/action" status: 200 len: 32 microversion: 2.1 time: 0.385875 Aug 24 10:30:58.640871 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2131/3909] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:30:58 2022] POST /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41/action => generated 32 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 10:30:58.644693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3e8aaab4-8b0b-475a-9276-e7653997b7cd tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:58.645544 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3e8aaab4-8b0b-475a-9276-e7653997b7cd tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:58.654410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e8aaab4-8b0b-475a-9276-e7653997b7cd tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:58.666114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e8aaab4-8b0b-475a-9276-e7653997b7cd tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:58.671163 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e8aaab4-8b0b-475a-9276-e7653997b7cd tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:58.672892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e8aaab4-8b0b-475a-9276-e7653997b7cd tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:58.673859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e8aaab4-8b0b-475a-9276-e7653997b7cd tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:58.674590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e8aaab4-8b0b-475a-9276-e7653997b7cd tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:59.398188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8956167c-52cd-4224-9c8f-c2267f754d02 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:30:59.399600 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8956167c-52cd-4224-9c8f-c2267f754d02 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] [instance: 845da280-7c2c-4510-ab4c-ec3cbfaf00de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:30:59.419561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8956167c-52cd-4224-9c8f-c2267f754d02 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:59.422592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8956167c-52cd-4224-9c8f-c2267f754d02 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:59.423746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8956167c-52cd-4224-9c8f-c2267f754d02 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:30:59.425977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8956167c-52cd-4224-9c8f-c2267f754d02 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:30:59.429835 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8956167c-52cd-4224-9c8f-c2267f754d02 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:30:59.441166 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8956167c-52cd-4224-9c8f-c2267f754d02 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:00.404105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8956167c-52cd-4224-9c8f-c2267f754d02 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fdf985677748289bc39f75ee9b432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab9aa7f8d974f0a9e183de5c88cd3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:00.413962 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8956167c-52cd-4224-9c8f-c2267f754d02 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] 10.222.0.85 "GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de" status: 200 len: 1506 microversion: 2.1 time: 1.021513 Aug 24 10:31:00.428384 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2132/3910] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:59 2022] GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de => generated 1506 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:31:00.670898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3e8aaab4-8b0b-475a-9276-e7653997b7cd tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:00.706815 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3e8aaab4-8b0b-475a-9276-e7653997b7cd tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1521 microversion: 2.1 time: 2.066160 Aug 24 10:31:00.712139 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1779/3911] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:30:58 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1521 bytes in 2072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:01.435886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ca59f57-dacd-4908-bf2a-a484cca5a27a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:01.437774 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8ca59f57-dacd-4908-bf2a-a484cca5a27a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] [instance: 845da280-7c2c-4510-ab4c-ec3cbfaf00de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:01.482776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ca59f57-dacd-4908-bf2a-a484cca5a27a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:01.483686 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ca59f57-dacd-4908-bf2a-a484cca5a27a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:01.484937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ca59f57-dacd-4908-bf2a-a484cca5a27a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:01.490058 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ca59f57-dacd-4908-bf2a-a484cca5a27a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:01.491960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ca59f57-dacd-4908-bf2a-a484cca5a27a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:01.493202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ca59f57-dacd-4908-bf2a-a484cca5a27a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:01.732127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-57bc42db-d6d4-476f-a0a8-26f15f77a783 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:01.732749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-57bc42db-d6d4-476f-a0a8-26f15f77a783 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:01.748427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57bc42db-d6d4-476f-a0a8-26f15f77a783 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:01.751449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57bc42db-d6d4-476f-a0a8-26f15f77a783 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:01.752133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57bc42db-d6d4-476f-a0a8-26f15f77a783 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:01.758125 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57bc42db-d6d4-476f-a0a8-26f15f77a783 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:01.760727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57bc42db-d6d4-476f-a0a8-26f15f77a783 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:01.763489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57bc42db-d6d4-476f-a0a8-26f15f77a783 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:02.503060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-57bc42db-d6d4-476f-a0a8-26f15f77a783 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:02.527665 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-57bc42db-d6d4-476f-a0a8-26f15f77a783 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1521 microversion: 2.1 time: 0.797317 Aug 24 10:31:02.528846 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1780/3912] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:01 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1521 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:03.025364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-13c63286-8bbb-48fa-b88e-30c5e153da15 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1637088567", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:31:03.143839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-13c63286-8bbb-48fa-b88e-30c5e153da15 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] validate_networks() for [('ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:31:03.243787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8ca59f57-dacd-4908-bf2a-a484cca5a27a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fdf985677748289bc39f75ee9b432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab9aa7f8d974f0a9e183de5c88cd3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:03.269637 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8ca59f57-dacd-4908-bf2a-a484cca5a27a tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] 10.222.0.85 "GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de" status: 200 len: 1511 microversion: 2.1 time: 1.837603 Aug 24 10:31:03.271141 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2133/3913] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:01 2022] GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de => generated 1511 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:03.555128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-71c650e5-2e9f-4d4b-b566-178aa22e9f52 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:03.555829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-71c650e5-2e9f-4d4b-b566-178aa22e9f52 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:03.571101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71c650e5-2e9f-4d4b-b566-178aa22e9f52 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:03.571636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71c650e5-2e9f-4d4b-b566-178aa22e9f52 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:03.572086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71c650e5-2e9f-4d4b-b566-178aa22e9f52 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:03.572815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71c650e5-2e9f-4d4b-b566-178aa22e9f52 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:03.573311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71c650e5-2e9f-4d4b-b566-178aa22e9f52 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:03.573765 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71c650e5-2e9f-4d4b-b566-178aa22e9f52 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:04.231607 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-13c63286-8bbb-48fa-b88e-30c5e153da15 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:31:04.232055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-13c63286-8bbb-48fa-b88e-30c5e153da15 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:31:04.232514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-13c63286-8bbb-48fa-b88e-30c5e153da15 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:31:04.232931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-13c63286-8bbb-48fa-b88e-30c5e153da15 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:31:04.233933 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-13c63286-8bbb-48fa-b88e-30c5e153da15 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:31:04.267715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13c63286-8bbb-48fa-b88e-30c5e153da15 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:04.268259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13c63286-8bbb-48fa-b88e-30c5e153da15 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:04.270996 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13c63286-8bbb-48fa-b88e-30c5e153da15 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:04.276891 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13c63286-8bbb-48fa-b88e-30c5e153da15 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:04.277550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13c63286-8bbb-48fa-b88e-30c5e153da15 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:04.278007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13c63286-8bbb-48fa-b88e-30c5e153da15 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:04.306861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-13c63286-8bbb-48fa-b88e-30c5e153da15 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Getting quotas for project 0ee55b608dbd4e83bddfab28646f3eac. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:31:04.345182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-13c63286-8bbb-48fa-b88e-30c5e153da15 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Getting quotas for user 795cacc54c1c4da8b6e721f1ca19cbbe and project 0ee55b608dbd4e83bddfab28646f3eac. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:31:04.384469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-13c63286-8bbb-48fa-b88e-30c5e153da15 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:31:04.400459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-13c63286-8bbb-48fa-b88e-30c5e153da15 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:31:04.440824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-71c650e5-2e9f-4d4b-b566-178aa22e9f52 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:04.475549 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-71c650e5-2e9f-4d4b-b566-178aa22e9f52 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1521 microversion: 2.1 time: 0.924235 Aug 24 10:31:04.477889 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2134/3914] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:03 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1521 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:31:04.486374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-513e15ee-dbd7-46b4-bc76-0d47776613a3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:04.488055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-513e15ee-dbd7-46b4-bc76-0d47776613a3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] [instance: 845da280-7c2c-4510-ab4c-ec3cbfaf00de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:04.514757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-513e15ee-dbd7-46b4-bc76-0d47776613a3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:04.515544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-513e15ee-dbd7-46b4-bc76-0d47776613a3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:04.516284 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-513e15ee-dbd7-46b4-bc76-0d47776613a3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:04.517359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-513e15ee-dbd7-46b4-bc76-0d47776613a3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:04.518257 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-513e15ee-dbd7-46b4-bc76-0d47776613a3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:04.518899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-513e15ee-dbd7-46b4-bc76-0d47776613a3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:04.596030 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-13c63286-8bbb-48fa-b88e-30c5e153da15 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.680558 Aug 24 10:31:04.599471 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1781/3915] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:31:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:31:04.611543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7d8f87cb-3af7-4204-830b-99837ad45698 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:04.631221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7d8f87cb-3af7-4204-830b-99837ad45698 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:04.992942 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7d8f87cb-3af7-4204-830b-99837ad45698 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:05.016699 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7d8f87cb-3af7-4204-830b-99837ad45698 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1217 microversion: 2.1 time: 0.402238 Aug 24 10:31:05.018980 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1782/3916] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:04 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1217 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:05.317818 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-513e15ee-dbd7-46b4-bc76-0d47776613a3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fdf985677748289bc39f75ee9b432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab9aa7f8d974f0a9e183de5c88cd3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:05.331691 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-513e15ee-dbd7-46b4-bc76-0d47776613a3 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] 10.222.0.85 "GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de" status: 200 len: 1504 microversion: 2.1 time: 0.850754 Aug 24 10:31:05.332623 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2135/3917] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:04 2022] GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de => generated 1504 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:05.358727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a0b4f323-6c1f-4f4f-bcec-67f2074ddca9 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Calling method '.version_select at 0x7f465409cee0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:05.359441 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a0b4f323-6c1f-4f4f-bcec-67f2074ddca9 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] [instance: 845da280-7c2c-4510-ab4c-ec3cbfaf00de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:05.378713 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0b4f323-6c1f-4f4f-bcec-67f2074ddca9 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:05.382328 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0b4f323-6c1f-4f4f-bcec-67f2074ddca9 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:05.382827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0b4f323-6c1f-4f4f-bcec-67f2074ddca9 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:05.384892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0b4f323-6c1f-4f4f-bcec-67f2074ddca9 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:05.385417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0b4f323-6c1f-4f4f-bcec-67f2074ddca9 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:05.385832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0b4f323-6c1f-4f4f-bcec-67f2074ddca9 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:05.458613 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a0b4f323-6c1f-4f4f-bcec-67f2074ddca9 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] 10.222.0.85 "GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.105023 Aug 24 10:31:05.473023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3b91f69-886e-4273-b30c-81b94a839ce0 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:05.473620 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d3b91f69-886e-4273-b30c-81b94a839ce0 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] [instance: 845da280-7c2c-4510-ab4c-ec3cbfaf00de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:05.478616 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1783/3918] 10.222.0.85 () {58 vars in 1296 bytes} [Wed Aug 24 10:31:05 2022] GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de/os-instance-actions => generated 611 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:31:05.479686 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:05.481457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3b91f69-886e-4273-b30c-81b94a839ce0 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:05.482360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3b91f69-886e-4273-b30c-81b94a839ce0 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:05.483054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3b91f69-886e-4273-b30c-81b94a839ce0 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:05.483936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3b91f69-886e-4273-b30c-81b94a839ce0 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:05.484562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3b91f69-886e-4273-b30c-81b94a839ce0 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:05.485200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3b91f69-886e-4273-b30c-81b94a839ce0 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:05.500288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-828477cd-e773-4123-ab1d-a9a370180d0f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:05.501097 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-828477cd-e773-4123-ab1d-a9a370180d0f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:05.518773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-828477cd-e773-4123-ab1d-a9a370180d0f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:05.530855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-828477cd-e773-4123-ab1d-a9a370180d0f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:05.531285 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-828477cd-e773-4123-ab1d-a9a370180d0f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:05.532048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-828477cd-e773-4123-ab1d-a9a370180d0f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:05.532517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-828477cd-e773-4123-ab1d-a9a370180d0f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:05.532938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-828477cd-e773-4123-ab1d-a9a370180d0f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:05.575844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d3b91f69-886e-4273-b30c-81b94a839ce0 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] [instance: 845da280-7c2c-4510-ab4c-ec3cbfaf00de] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:31:05.874284 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d3b91f69-886e-4273-b30c-81b94a839ce0 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] 10.222.0.85 "DELETE /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de" status: 204 len: 0 microversion: 2.1 time: 0.405074 Aug 24 10:31:05.875132 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2136/3919] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:31:05 2022] DELETE /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 10:31:05.885091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1c77fd82-a5cb-4d60-b7d9-b7dd9dec11db tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:05.886399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1c77fd82-a5cb-4d60-b7d9-b7dd9dec11db tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] [instance: 845da280-7c2c-4510-ab4c-ec3cbfaf00de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:05.894106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c77fd82-a5cb-4d60-b7d9-b7dd9dec11db tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:05.894972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c77fd82-a5cb-4d60-b7d9-b7dd9dec11db tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:05.895617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c77fd82-a5cb-4d60-b7d9-b7dd9dec11db tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:05.896477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c77fd82-a5cb-4d60-b7d9-b7dd9dec11db tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:05.897082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c77fd82-a5cb-4d60-b7d9-b7dd9dec11db tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:05.897706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c77fd82-a5cb-4d60-b7d9-b7dd9dec11db tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:06.078723 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-828477cd-e773-4123-ab1d-a9a370180d0f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:06.092208 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-828477cd-e773-4123-ab1d-a9a370180d0f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1521 microversion: 2.1 time: 0.597105 Aug 24 10:31:06.094055 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1784/3920] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:05 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1521 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:06.105373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2522f1be-65c3-4b7a-bc7c-b037ca16d0b4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:06.110658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2522f1be-65c3-4b7a-bc7c-b037ca16d0b4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:06.129865 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2522f1be-65c3-4b7a-bc7c-b037ca16d0b4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:06.133952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2522f1be-65c3-4b7a-bc7c-b037ca16d0b4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:06.134866 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2522f1be-65c3-4b7a-bc7c-b037ca16d0b4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:06.138645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2522f1be-65c3-4b7a-bc7c-b037ca16d0b4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:06.139585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2522f1be-65c3-4b7a-bc7c-b037ca16d0b4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:06.140198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2522f1be-65c3-4b7a-bc7c-b037ca16d0b4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:06.297160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2522f1be-65c3-4b7a-bc7c-b037ca16d0b4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:06.310933 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2522f1be-65c3-4b7a-bc7c-b037ca16d0b4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1269 microversion: 2.1 time: 0.212266 Aug 24 10:31:06.313656 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1785/3921] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:06 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1269 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:06.431216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1c77fd82-a5cb-4d60-b7d9-b7dd9dec11db tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fdf985677748289bc39f75ee9b432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab9aa7f8d974f0a9e183de5c88cd3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:06.449327 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1c77fd82-a5cb-4d60-b7d9-b7dd9dec11db tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] 10.222.0.85 "GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de" status: 200 len: 1510 microversion: 2.1 time: 0.568654 Aug 24 10:31:06.453535 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2137/3922] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:05 2022] GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de => generated 1510 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:07.118460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b396403b-20cb-4179-b71b-55fc0b334a3b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:07.119807 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b396403b-20cb-4179-b71b-55fc0b334a3b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:07.162298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b396403b-20cb-4179-b71b-55fc0b334a3b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:07.162849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b396403b-20cb-4179-b71b-55fc0b334a3b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:07.163315 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b396403b-20cb-4179-b71b-55fc0b334a3b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:07.164085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b396403b-20cb-4179-b71b-55fc0b334a3b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:07.164541 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b396403b-20cb-4179-b71b-55fc0b334a3b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:07.164971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b396403b-20cb-4179-b71b-55fc0b334a3b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:07.342148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fad99de8-5a6f-463e-b813-8c2139b6c38c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:07.342899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fad99de8-5a6f-463e-b813-8c2139b6c38c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:07.374609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad99de8-5a6f-463e-b813-8c2139b6c38c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:07.375133 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad99de8-5a6f-463e-b813-8c2139b6c38c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:07.375589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad99de8-5a6f-463e-b813-8c2139b6c38c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:07.376398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad99de8-5a6f-463e-b813-8c2139b6c38c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:07.376870 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad99de8-5a6f-463e-b813-8c2139b6c38c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:07.377341 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad99de8-5a6f-463e-b813-8c2139b6c38c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:08.065804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fad99de8-5a6f-463e-b813-8c2139b6c38c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:08.095664 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fad99de8-5a6f-463e-b813-8c2139b6c38c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1275 microversion: 2.1 time: 0.760042 Aug 24 10:31:08.100808 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2138/3923] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:07 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1275 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:31:08.114977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dc91ddee-1cb4-4816-9901-552460d6ed4b tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:08.120665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dc91ddee-1cb4-4816-9901-552460d6ed4b tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] [instance: 845da280-7c2c-4510-ab4c-ec3cbfaf00de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:08.144364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc91ddee-1cb4-4816-9901-552460d6ed4b tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:08.145514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc91ddee-1cb4-4816-9901-552460d6ed4b tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:08.146402 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc91ddee-1cb4-4816-9901-552460d6ed4b tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:08.147604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc91ddee-1cb4-4816-9901-552460d6ed4b tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:08.148232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc91ddee-1cb4-4816-9901-552460d6ed4b tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:08.149088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc91ddee-1cb4-4816-9901-552460d6ed4b tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:08.678274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b396403b-20cb-4179-b71b-55fc0b334a3b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:08.696485 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b396403b-20cb-4179-b71b-55fc0b334a3b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1521 microversion: 2.1 time: 1.585447 Aug 24 10:31:08.706101 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1786/3924] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:07 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1521 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:08.997290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dc91ddee-1cb4-4816-9901-552460d6ed4b tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fdf985677748289bc39f75ee9b432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab9aa7f8d974f0a9e183de5c88cd3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:09.005394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:09.022265 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dc91ddee-1cb4-4816-9901-552460d6ed4b tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] 10.222.0.85 "GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de" status: 200 len: 1510 microversion: 2.1 time: 0.920178 Aug 24 10:31:09.022945 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2139/3925] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:08 2022] GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de => generated 1510 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:09.121067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4b6ead7d-0e96-4112-9ae8-fa89b41acdee tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:09.121723 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4b6ead7d-0e96-4112-9ae8-fa89b41acdee tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:09.164152 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b6ead7d-0e96-4112-9ae8-fa89b41acdee tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:09.165198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b6ead7d-0e96-4112-9ae8-fa89b41acdee tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:09.166793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b6ead7d-0e96-4112-9ae8-fa89b41acdee tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:09.210288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b6ead7d-0e96-4112-9ae8-fa89b41acdee tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:09.211723 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b6ead7d-0e96-4112-9ae8-fa89b41acdee tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:09.222997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b6ead7d-0e96-4112-9ae8-fa89b41acdee tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:09.400323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4b6ead7d-0e96-4112-9ae8-fa89b41acdee tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:09.414441 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4b6ead7d-0e96-4112-9ae8-fa89b41acdee tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1275 microversion: 2.1 time: 0.298387 Aug 24 10:31:09.416280 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1787/3926] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:09 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1275 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:09.720823 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a95aecef-f436-492f-9134-4cf1ba710c60 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:09.721668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a95aecef-f436-492f-9134-4cf1ba710c60 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:09.743912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a95aecef-f436-492f-9134-4cf1ba710c60 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:09.744666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a95aecef-f436-492f-9134-4cf1ba710c60 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:09.745330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a95aecef-f436-492f-9134-4cf1ba710c60 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:09.758670 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a95aecef-f436-492f-9134-4cf1ba710c60 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:09.759381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a95aecef-f436-492f-9134-4cf1ba710c60 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:09.759846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a95aecef-f436-492f-9134-4cf1ba710c60 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:09.897315 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-b786194b-2b18-4382-995c-e53b73490c28 req-aea91081-94aa-4bd7-8a74-1e9a95dd430a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "845da280-7c2c-4510-ab4c-ec3cbfaf00de", "name": "network-vif-deleted", "tag": "d382e6ce-1861-496a-98ec-4690a5c31a11"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:31:09.933541 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b786194b-2b18-4382-995c-e53b73490c28 req-aea91081-94aa-4bd7-8a74-1e9a95dd430a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:09.934521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b786194b-2b18-4382-995c-e53b73490c28 req-aea91081-94aa-4bd7-8a74-1e9a95dd430a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:09.935377 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b786194b-2b18-4382-995c-e53b73490c28 req-aea91081-94aa-4bd7-8a74-1e9a95dd430a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:09.952473 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b786194b-2b18-4382-995c-e53b73490c28 req-aea91081-94aa-4bd7-8a74-1e9a95dd430a service nova] Creating event network-vif-deleted:d382e6ce-1861-496a-98ec-4690a5c31a11 for instance 845da280-7c2c-4510-ab4c-ec3cbfaf00de on n-h1-849328-3 Aug 24 10:31:09.966445 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-b786194b-2b18-4382-995c-e53b73490c28 req-aea91081-94aa-4bd7-8a74-1e9a95dd430a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077454 Aug 24 10:31:09.970406 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1788/3927] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:31:10.048975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b6e49437-ed43-479d-a323-d02382f99e53 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:10.050080 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b6e49437-ed43-479d-a323-d02382f99e53 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] [instance: 845da280-7c2c-4510-ab4c-ec3cbfaf00de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:10.073568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6e49437-ed43-479d-a323-d02382f99e53 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:10.074243 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6e49437-ed43-479d-a323-d02382f99e53 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:10.075642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6e49437-ed43-479d-a323-d02382f99e53 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:10.076531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6e49437-ed43-479d-a323-d02382f99e53 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:10.078975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6e49437-ed43-479d-a323-d02382f99e53 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:10.079567 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6e49437-ed43-479d-a323-d02382f99e53 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:10.135294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6e49437-ed43-479d-a323-d02382f99e53 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:10.136358 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6e49437-ed43-479d-a323-d02382f99e53 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:10.136967 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6e49437-ed43-479d-a323-d02382f99e53 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:10.138603 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-b6e49437-ed43-479d-a323-d02382f99e53 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lazy-loading 'fault' on Instance uuid 845da280-7c2c-4510-ab4c-ec3cbfaf00de {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:31:10.215778 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b6e49437-ed43-479d-a323-d02382f99e53 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fdf985677748289bc39f75ee9b432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab9aa7f8d974f0a9e183de5c88cd3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:10.237461 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b6e49437-ed43-479d-a323-d02382f99e53 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] 10.222.0.85 "GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de" status: 200 len: 1306 microversion: 2.1 time: 0.192498 Aug 24 10:31:10.240301 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1789/3928] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:10 2022] GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de => generated 1306 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:31:10.425629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a95aecef-f436-492f-9134-4cf1ba710c60 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:10.440154 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-059f0de3-f04e-4be4-9574-dfd5d8fd8f81 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:10.440886 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-059f0de3-f04e-4be4-9574-dfd5d8fd8f81 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:10.463879 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a95aecef-f436-492f-9134-4cf1ba710c60 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1521 microversion: 2.1 time: 0.738574 Aug 24 10:31:10.467176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-059f0de3-f04e-4be4-9574-dfd5d8fd8f81 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:10.467759 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2140/3929] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:09 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1521 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:10.471436 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-059f0de3-f04e-4be4-9574-dfd5d8fd8f81 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:10.471930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-059f0de3-f04e-4be4-9574-dfd5d8fd8f81 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:10.479602 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-059f0de3-f04e-4be4-9574-dfd5d8fd8f81 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:10.480107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-059f0de3-f04e-4be4-9574-dfd5d8fd8f81 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:10.480563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-059f0de3-f04e-4be4-9574-dfd5d8fd8f81 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:10.832214 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-059f0de3-f04e-4be4-9574-dfd5d8fd8f81 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:10.851613 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-059f0de3-f04e-4be4-9574-dfd5d8fd8f81 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1317 microversion: 2.1 time: 0.415822 Aug 24 10:31:10.859676 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1790/3930] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:10 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1317 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:31:11.264896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e7d7a10b-6f70-4d98-aa76-557369371e12 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:11.266223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e7d7a10b-6f70-4d98-aa76-557369371e12 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] [instance: 845da280-7c2c-4510-ab4c-ec3cbfaf00de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:11.277370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7d7a10b-6f70-4d98-aa76-557369371e12 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:11.278199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7d7a10b-6f70-4d98-aa76-557369371e12 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:11.279919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7d7a10b-6f70-4d98-aa76-557369371e12 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:11.281138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7d7a10b-6f70-4d98-aa76-557369371e12 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:11.282030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7d7a10b-6f70-4d98-aa76-557369371e12 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:11.283189 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7d7a10b-6f70-4d98-aa76-557369371e12 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:11.306911 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-e7d7a10b-6f70-4d98-aa76-557369371e12 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] HTTP exception thrown: Instance 845da280-7c2c-4510-ab4c-ec3cbfaf00de could not be found. Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e7d7a10b-6f70-4d98-aa76-557369371e12 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Request method failure captured: Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de HTTP/1.1 Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf3GraWO0awZyAD2-SOKKFaGiY1O1ZunNuFJcPRYzRskBQ0bWrfFgrTm2K-rDqxOqDnNmDnZRRMbMY6kyA1COSFVfQ78TmCooC9KvVIdJpPQhp2I_wZUX07euaoKsGCZ58RuudWuP4633JOxJ53FGncoLgTTs09Hyt6wHF1t5txZmnE Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: aab9aa7f8d974f0a9e183de5c88cd3f2 Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-InstanceActionsTestJSON-503613521 Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/aab9aa7f8d974f0a9e183de5c88cd3f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_aab9aa7f8d974f0a9e183de5c88cd3f2", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/aab9aa7f8d974f0a9e183de5c88cd3f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/aab9aa7f8d974f0a9e183de5c88cd3f2"}]}] Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-InstanceActionsTestJSON-503613521 Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: aab9aa7f8d974f0a9e183de5c88cd3f2 Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-InstanceActionsTestJSON-503613521 Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-InstanceActionsTestJSON-503613521-project Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: a8fdf985677748289bc39f75ee9b432e Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-InstanceActionsTestJSON-503613521-project Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 845da280-7c2c-4510-ab4c-ec3cbfaf00de could not be found. Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '845da280-7c2c-4510-ab4c-ec3cbfaf00de'} Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 845da280-7c2c-4510-ab4c-ec3cbfaf00de could not be found. Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 845da280-7c2c-4510-ab4c-ec3cbfaf00de could not be found. Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:31:11.309675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:31:11.314184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:31:11.314184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:31:11.314184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:31:11.314184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:31:11.314184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:31:11.314184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 845da280-7c2c-4510-ab4c-ec3cbfaf00de could not be found. Aug 24 10:31:11.314184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:31:11.316528 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e7d7a10b-6f70-4d98-aa76-557369371e12 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] Returning 404 to user: Instance 845da280-7c2c-4510-ab4c-ec3cbfaf00de could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:31:11.320235 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e7d7a10b-6f70-4d98-aa76-557369371e12 tempest-InstanceActionsTestJSON-503613521 tempest-InstanceActionsTestJSON-503613521-project] 10.222.0.85 "GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de" status: 404 len: 111 microversion: 2.1 time: 0.058098 Aug 24 10:31:11.322542 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2141/3931] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:11 2022] GET /compute/v2.1/servers/845da280-7c2c-4510-ab4c-ec3cbfaf00de => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:31:11.496640 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6ae9a35d-673c-46ca-a359-b53083774c3e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:11.499417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6ae9a35d-673c-46ca-a359-b53083774c3e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:11.519829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ae9a35d-673c-46ca-a359-b53083774c3e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:11.520335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ae9a35d-673c-46ca-a359-b53083774c3e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:11.520771 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ae9a35d-673c-46ca-a359-b53083774c3e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:11.530870 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ae9a35d-673c-46ca-a359-b53083774c3e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:11.534023 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ae9a35d-673c-46ca-a359-b53083774c3e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:11.534941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ae9a35d-673c-46ca-a359-b53083774c3e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:11.838439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6ae9a35d-673c-46ca-a359-b53083774c3e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:11.854786 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6ae9a35d-673c-46ca-a359-b53083774c3e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1521 microversion: 2.1 time: 0.365262 Aug 24 10:31:11.857275 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1791/3932] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:11 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:11.892756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0073a543-1008-4737-b0bd-08bf6c09663d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:11.893442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0073a543-1008-4737-b0bd-08bf6c09663d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:11.906263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0073a543-1008-4737-b0bd-08bf6c09663d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:11.907169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0073a543-1008-4737-b0bd-08bf6c09663d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:11.908488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0073a543-1008-4737-b0bd-08bf6c09663d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:11.909740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0073a543-1008-4737-b0bd-08bf6c09663d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:11.910364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0073a543-1008-4737-b0bd-08bf6c09663d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:11.912522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0073a543-1008-4737-b0bd-08bf6c09663d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:12.648411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0073a543-1008-4737-b0bd-08bf6c09663d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:12.657441 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0073a543-1008-4737-b0bd-08bf6c09663d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1317 microversion: 2.1 time: 0.770999 Aug 24 10:31:12.662211 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2142/3933] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:11 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1317 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:12.876581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-828c82ac-7fbe-450f-ae29-e49910f98122 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:12.878074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-828c82ac-7fbe-450f-ae29-e49910f98122 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:12.890262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-828c82ac-7fbe-450f-ae29-e49910f98122 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:12.891562 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-828c82ac-7fbe-450f-ae29-e49910f98122 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:12.892668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-828c82ac-7fbe-450f-ae29-e49910f98122 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:12.893733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-828c82ac-7fbe-450f-ae29-e49910f98122 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:12.894621 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-828c82ac-7fbe-450f-ae29-e49910f98122 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:12.895620 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-828c82ac-7fbe-450f-ae29-e49910f98122 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:12.944330 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:13.025354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-55063a50-f7c0-4534-a1d0-395fb4acd952 req-89729f09-6a40-49bb-b5f4-0ed24eee2336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fb1d6b5-a27c-465a-aa10-652d2cc366ae", "tag": "05c1a894-3c87-4d83-9b42-234ddedc80b0"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:31:13.052714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-55063a50-f7c0-4534-a1d0-395fb4acd952 req-89729f09-6a40-49bb-b5f4-0ed24eee2336 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:13.054605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-55063a50-f7c0-4534-a1d0-395fb4acd952 req-89729f09-6a40-49bb-b5f4-0ed24eee2336 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:13.055221 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-55063a50-f7c0-4534-a1d0-395fb4acd952 req-89729f09-6a40-49bb-b5f4-0ed24eee2336 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:13.075191 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-55063a50-f7c0-4534-a1d0-395fb4acd952 req-89729f09-6a40-49bb-b5f4-0ed24eee2336 service nova] Creating event network-changed:05c1a894-3c87-4d83-9b42-234ddedc80b0 for instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae on n-h2-849328-3 Aug 24 10:31:13.083418 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-55063a50-f7c0-4534-a1d0-395fb4acd952 req-89729f09-6a40-49bb-b5f4-0ed24eee2336 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066946 Aug 24 10:31:13.085163 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2143/3934] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:31:13.348774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-828c82ac-7fbe-450f-ae29-e49910f98122 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:13.358009 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-828c82ac-7fbe-450f-ae29-e49910f98122 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1521 microversion: 2.1 time: 0.485340 Aug 24 10:31:13.371613 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1792/3935] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:12 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:13.688156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e6c76402-dad6-4779-84f8-d66f415260de tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:13.689499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e6c76402-dad6-4779-84f8-d66f415260de tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:13.711297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6c76402-dad6-4779-84f8-d66f415260de tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:13.712265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6c76402-dad6-4779-84f8-d66f415260de tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:13.713245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6c76402-dad6-4779-84f8-d66f415260de tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:13.719642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6c76402-dad6-4779-84f8-d66f415260de tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:13.725284 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6c76402-dad6-4779-84f8-d66f415260de tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:13.728951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6c76402-dad6-4779-84f8-d66f415260de tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:14.367760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e6c76402-dad6-4779-84f8-d66f415260de tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:14.382028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d13841af-b386-484c-826e-c03e0f0bb537 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:14.386706 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e6c76402-dad6-4779-84f8-d66f415260de tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1317 microversion: 2.1 time: 0.708746 Aug 24 10:31:14.387940 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2144/3936] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:13 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1317 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:14.388938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d13841af-b386-484c-826e-c03e0f0bb537 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:14.401951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:14.407924 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d13841af-b386-484c-826e-c03e0f0bb537 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:14.408851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d13841af-b386-484c-826e-c03e0f0bb537 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:14.410410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d13841af-b386-484c-826e-c03e0f0bb537 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:14.412041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d13841af-b386-484c-826e-c03e0f0bb537 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:14.414717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d13841af-b386-484c-826e-c03e0f0bb537 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:14.415524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d13841af-b386-484c-826e-c03e0f0bb537 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:15.009251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:15.095076 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d13841af-b386-484c-826e-c03e0f0bb537 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:15.120393 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d13841af-b386-484c-826e-c03e0f0bb537 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1521 microversion: 2.1 time: 0.744669 Aug 24 10:31:15.122571 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1793/3937] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:14 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1521 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:15.416299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8c86c148-0c7e-429e-94a1-fde7860b52d2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:15.416933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8c86c148-0c7e-429e-94a1-fde7860b52d2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:15.434688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c86c148-0c7e-429e-94a1-fde7860b52d2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:15.435481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c86c148-0c7e-429e-94a1-fde7860b52d2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:15.436087 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c86c148-0c7e-429e-94a1-fde7860b52d2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:15.436971 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c86c148-0c7e-429e-94a1-fde7860b52d2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:15.437608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c86c148-0c7e-429e-94a1-fde7860b52d2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:15.438540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c86c148-0c7e-429e-94a1-fde7860b52d2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:15.793909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8c86c148-0c7e-429e-94a1-fde7860b52d2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:15.809062 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8c86c148-0c7e-429e-94a1-fde7860b52d2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1317 microversion: 2.1 time: 0.396916 Aug 24 10:31:15.813662 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2145/3938] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:15 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1317 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:16.149543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-51ea1e96-61a5-46d1-a447-7c2e113e4e42 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:16.150297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-51ea1e96-61a5-46d1-a447-7c2e113e4e42 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:16.173495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51ea1e96-61a5-46d1-a447-7c2e113e4e42 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:16.174155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51ea1e96-61a5-46d1-a447-7c2e113e4e42 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:16.174743 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51ea1e96-61a5-46d1-a447-7c2e113e4e42 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:16.176477 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51ea1e96-61a5-46d1-a447-7c2e113e4e42 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:16.177144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51ea1e96-61a5-46d1-a447-7c2e113e4e42 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:16.177759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51ea1e96-61a5-46d1-a447-7c2e113e4e42 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:16.840680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-48ccf4d9-232b-40a6-878a-7c89e8577816 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:16.841448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-48ccf4d9-232b-40a6-878a-7c89e8577816 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:16.857944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48ccf4d9-232b-40a6-878a-7c89e8577816 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:16.858756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48ccf4d9-232b-40a6-878a-7c89e8577816 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:16.859611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48ccf4d9-232b-40a6-878a-7c89e8577816 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:16.860998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48ccf4d9-232b-40a6-878a-7c89e8577816 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:16.862696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48ccf4d9-232b-40a6-878a-7c89e8577816 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:16.867000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48ccf4d9-232b-40a6-878a-7c89e8577816 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:17.353833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-51ea1e96-61a5-46d1-a447-7c2e113e4e42 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:17.364049 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-51ea1e96-61a5-46d1-a447-7c2e113e4e42 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1521 microversion: 2.1 time: 1.218268 Aug 24 10:31:17.368074 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1794/3939] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:16 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1521 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:17.683463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-48ccf4d9-232b-40a6-878a-7c89e8577816 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:17.701247 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-48ccf4d9-232b-40a6-878a-7c89e8577816 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1317 microversion: 2.1 time: 0.862000 Aug 24 10:31:17.701934 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2146/3940] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:16 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1317 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:18.390426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-08ad5294-1de9-4302-9bf8-12bab558941d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:18.391045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-08ad5294-1de9-4302-9bf8-12bab558941d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:18.400143 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08ad5294-1de9-4302-9bf8-12bab558941d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:18.402040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08ad5294-1de9-4302-9bf8-12bab558941d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:18.402909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08ad5294-1de9-4302-9bf8-12bab558941d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:18.404880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08ad5294-1de9-4302-9bf8-12bab558941d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:18.405929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08ad5294-1de9-4302-9bf8-12bab558941d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:18.407460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08ad5294-1de9-4302-9bf8-12bab558941d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:18.723595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e0aa6704-4e75-47af-970e-39ea4b15ad88 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:18.724316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e0aa6704-4e75-47af-970e-39ea4b15ad88 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:18.736918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0aa6704-4e75-47af-970e-39ea4b15ad88 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:18.737456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0aa6704-4e75-47af-970e-39ea4b15ad88 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:18.737913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0aa6704-4e75-47af-970e-39ea4b15ad88 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:18.738612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0aa6704-4e75-47af-970e-39ea4b15ad88 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:18.739070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0aa6704-4e75-47af-970e-39ea4b15ad88 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:18.739491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0aa6704-4e75-47af-970e-39ea4b15ad88 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:19.067081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e0aa6704-4e75-47af-970e-39ea4b15ad88 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:19.079779 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e0aa6704-4e75-47af-970e-39ea4b15ad88 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1317 microversion: 2.1 time: 0.360737 Aug 24 10:31:19.080429 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2147/3941] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:18 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:31:19.262310 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-08ad5294-1de9-4302-9bf8-12bab558941d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:19.281486 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-08ad5294-1de9-4302-9bf8-12bab558941d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1521 microversion: 2.1 time: 0.892588 Aug 24 10:31:19.298043 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1795/3942] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:18 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1521 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:20.110885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6a7114c1-381e-45cc-a850-885c9d7d0680 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:20.112182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6a7114c1-381e-45cc-a850-885c9d7d0680 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:20.122767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a7114c1-381e-45cc-a850-885c9d7d0680 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:20.129835 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a7114c1-381e-45cc-a850-885c9d7d0680 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:20.130922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a7114c1-381e-45cc-a850-885c9d7d0680 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:20.131955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a7114c1-381e-45cc-a850-885c9d7d0680 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:20.132654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a7114c1-381e-45cc-a850-885c9d7d0680 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:20.133702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a7114c1-381e-45cc-a850-885c9d7d0680 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:20.311340 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5bce5608-d42d-4db9-9bd2-5bc6e2b19a1a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:20.311975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5bce5608-d42d-4db9-9bd2-5bc6e2b19a1a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:20.322360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:20.325641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bce5608-d42d-4db9-9bd2-5bc6e2b19a1a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:20.330937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bce5608-d42d-4db9-9bd2-5bc6e2b19a1a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:20.331720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bce5608-d42d-4db9-9bd2-5bc6e2b19a1a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:20.332708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bce5608-d42d-4db9-9bd2-5bc6e2b19a1a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:20.335703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bce5608-d42d-4db9-9bd2-5bc6e2b19a1a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:20.336432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bce5608-d42d-4db9-9bd2-5bc6e2b19a1a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:21.098110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5bce5608-d42d-4db9-9bd2-5bc6e2b19a1a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:21.115167 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5bce5608-d42d-4db9-9bd2-5bc6e2b19a1a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1521 microversion: 2.1 time: 0.808174 Aug 24 10:31:21.116137 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1796/3943] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:20 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1521 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:21.131946 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-1b2289d0-8ddb-4519-a6bc-3899f434b714 req-ca4d32d8-c68e-439a-af90-a7954fefa3f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fb1d6b5-a27c-465a-aa10-652d2cc366ae", "name": "network-vif-plugged", "status": "completed", "tag": "05c1a894-3c87-4d83-9b42-234ddedc80b0"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:31:21.152894 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1b2289d0-8ddb-4519-a6bc-3899f434b714 req-ca4d32d8-c68e-439a-af90-a7954fefa3f0 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:21.153435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1b2289d0-8ddb-4519-a6bc-3899f434b714 req-ca4d32d8-c68e-439a-af90-a7954fefa3f0 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:21.153915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1b2289d0-8ddb-4519-a6bc-3899f434b714 req-ca4d32d8-c68e-439a-af90-a7954fefa3f0 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:21.185524 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-1b2289d0-8ddb-4519-a6bc-3899f434b714 req-ca4d32d8-c68e-439a-af90-a7954fefa3f0 service nova] Creating event network-vif-plugged:05c1a894-3c87-4d83-9b42-234ddedc80b0 for instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae on n-h2-849328-3 Aug 24 10:31:21.196316 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-1b2289d0-8ddb-4519-a6bc-3899f434b714 req-ca4d32d8-c68e-439a-af90-a7954fefa3f0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078829 Aug 24 10:31:21.197188 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1797/3944] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:31:21.845466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6a7114c1-381e-45cc-a850-885c9d7d0680 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:21.855325 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6a7114c1-381e-45cc-a850-885c9d7d0680 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1317 microversion: 2.1 time: 1.750250 Aug 24 10:31:21.872232 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2148/3945] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:20 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1317 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:22.173083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2cb926e4-3990-4ff7-bb0a-dca523c3cfa6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:22.174921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2cb926e4-3990-4ff7-bb0a-dca523c3cfa6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:22.185478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cb926e4-3990-4ff7-bb0a-dca523c3cfa6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:22.189340 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cb926e4-3990-4ff7-bb0a-dca523c3cfa6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:22.190253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cb926e4-3990-4ff7-bb0a-dca523c3cfa6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:22.191153 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cb926e4-3990-4ff7-bb0a-dca523c3cfa6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:22.191909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cb926e4-3990-4ff7-bb0a-dca523c3cfa6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:22.192532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cb926e4-3990-4ff7-bb0a-dca523c3cfa6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:22.774486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2cb926e4-3990-4ff7-bb0a-dca523c3cfa6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:22.786156 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2cb926e4-3990-4ff7-bb0a-dca523c3cfa6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1521 microversion: 2.1 time: 0.643961 Aug 24 10:31:22.786761 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1798/3946] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:22 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1521 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:31:22.882531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9291154f-5648-4a02-88da-f39b0a862ba1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:22.883163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9291154f-5648-4a02-88da-f39b0a862ba1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:22.905140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9291154f-5648-4a02-88da-f39b0a862ba1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:22.915064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9291154f-5648-4a02-88da-f39b0a862ba1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:22.915729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9291154f-5648-4a02-88da-f39b0a862ba1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:22.923168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9291154f-5648-4a02-88da-f39b0a862ba1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:22.926450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9291154f-5648-4a02-88da-f39b0a862ba1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:22.927684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9291154f-5648-4a02-88da-f39b0a862ba1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:23.336993 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9291154f-5648-4a02-88da-f39b0a862ba1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:23.345899 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9291154f-5648-4a02-88da-f39b0a862ba1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1317 microversion: 2.1 time: 0.467562 Aug 24 10:31:23.350433 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2149/3947] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:22 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1317 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:23.821840 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-839f614c-b7b9-4497-8530-15446d5af1a7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:23.824214 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-839f614c-b7b9-4497-8530-15446d5af1a7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:23.837096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-839f614c-b7b9-4497-8530-15446d5af1a7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:23.842208 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-839f614c-b7b9-4497-8530-15446d5af1a7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:23.842911 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-839f614c-b7b9-4497-8530-15446d5af1a7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:23.844050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-839f614c-b7b9-4497-8530-15446d5af1a7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:23.846921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-839f614c-b7b9-4497-8530-15446d5af1a7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:23.847744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-839f614c-b7b9-4497-8530-15446d5af1a7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:24.373511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d589967f-dc9c-49f0-8d81-2b69aa01b0e2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:24.374228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d589967f-dc9c-49f0-8d81-2b69aa01b0e2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:24.398848 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d589967f-dc9c-49f0-8d81-2b69aa01b0e2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:24.404311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d589967f-dc9c-49f0-8d81-2b69aa01b0e2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:24.407273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d589967f-dc9c-49f0-8d81-2b69aa01b0e2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:24.416694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d589967f-dc9c-49f0-8d81-2b69aa01b0e2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:24.417967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d589967f-dc9c-49f0-8d81-2b69aa01b0e2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:24.421477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d589967f-dc9c-49f0-8d81-2b69aa01b0e2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:24.913908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d589967f-dc9c-49f0-8d81-2b69aa01b0e2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:24.936076 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d589967f-dc9c-49f0-8d81-2b69aa01b0e2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.566331 Aug 24 10:31:24.939000 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2150/3948] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:24 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:31:24.952492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-062fe08f-1bc8-4f07-8a13-fd54831e6f62 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1306877264", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b6a9333b-691b-4eaf-a892-7e94331b223e"}], "security_groups": [{"name": "tempest-securitygroup--533906100"}], "key_name": "tempest-keypair-1040532086", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "6de1d331-49ff-46e1-aa1e-7d74df52fcb4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:31:25.229696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-839f614c-b7b9-4497-8530-15446d5af1a7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:25.242913 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-839f614c-b7b9-4497-8530-15446d5af1a7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1521 microversion: 2.1 time: 1.426042 Aug 24 10:31:25.243772 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1799/3949] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:23 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1521 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:25.248619 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dc16978a-56c8-4541-a7f6-1335a1838858 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-417656178", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:31:25.370333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-dc16978a-56c8-4541-a7f6-1335a1838858 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] validate_networks() for [('ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:31:25.414022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-062fe08f-1bc8-4f07-8a13-fd54831e6f62 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] validate_networks() for [('b6a9333b-691b-4eaf-a892-7e94331b223e', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:31:26.677913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-dc16978a-56c8-4541-a7f6-1335a1838858 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:31:26.678770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-dc16978a-56c8-4541-a7f6-1335a1838858 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:31:26.678770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-dc16978a-56c8-4541-a7f6-1335a1838858 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:31:26.680119 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-dc16978a-56c8-4541-a7f6-1335a1838858 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:31:26.680119 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-dc16978a-56c8-4541-a7f6-1335a1838858 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:31:26.695851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc16978a-56c8-4541-a7f6-1335a1838858 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:26.696450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc16978a-56c8-4541-a7f6-1335a1838858 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:26.697308 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc16978a-56c8-4541-a7f6-1335a1838858 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:26.698074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc16978a-56c8-4541-a7f6-1335a1838858 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:26.698455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc16978a-56c8-4541-a7f6-1335a1838858 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:26.699241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc16978a-56c8-4541-a7f6-1335a1838858 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:26.725612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-dc16978a-56c8-4541-a7f6-1335a1838858 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Getting quotas for project 0ee55b608dbd4e83bddfab28646f3eac. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:31:26.741547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-dc16978a-56c8-4541-a7f6-1335a1838858 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Getting quotas for user 795cacc54c1c4da8b6e721f1ca19cbbe and project 0ee55b608dbd4e83bddfab28646f3eac. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:31:26.766075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dc16978a-56c8-4541-a7f6-1335a1838858 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:31:26.769076 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dc16978a-56c8-4541-a7f6-1335a1838858 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 33162162-c8fe-4f85-9f88-ff2452cfab95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:31:26.827822 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dc16978a-56c8-4541-a7f6-1335a1838858 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.582778 Aug 24 10:31:26.828955 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1800/3950] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:31:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:31:26.834110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d64e671b-4963-407c-8786-2f58dcc51ba9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:26.835044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d64e671b-4963-407c-8786-2f58dcc51ba9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:26.843312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d64e671b-4963-407c-8786-2f58dcc51ba9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:26.844100 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d64e671b-4963-407c-8786-2f58dcc51ba9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:26.847020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d64e671b-4963-407c-8786-2f58dcc51ba9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:26.851441 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d64e671b-4963-407c-8786-2f58dcc51ba9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:26.852132 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d64e671b-4963-407c-8786-2f58dcc51ba9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:26.852901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d64e671b-4963-407c-8786-2f58dcc51ba9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:27.155885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-062fe08f-1bc8-4f07-8a13-fd54831e6f62 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Getting quotas for project 87126fba5c074971a9c3c41de4164571. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:31:27.172728 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-062fe08f-1bc8-4f07-8a13-fd54831e6f62 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Getting quotas for user ce4bbe335166415da37188b475b3194b and project 87126fba5c074971a9c3c41de4164571. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:31:27.209867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-062fe08f-1bc8-4f07-8a13-fd54831e6f62 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:31:27.210295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-062fe08f-1bc8-4f07-8a13-fd54831e6f62 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:31:27.210776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-062fe08f-1bc8-4f07-8a13-fd54831e6f62 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:31:27.213300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-062fe08f-1bc8-4f07-8a13-fd54831e6f62 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:31:27.214664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-062fe08f-1bc8-4f07-8a13-fd54831e6f62 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:31:27.229685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062fe08f-1bc8-4f07-8a13-fd54831e6f62 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:27.230251 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062fe08f-1bc8-4f07-8a13-fd54831e6f62 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:27.230695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062fe08f-1bc8-4f07-8a13-fd54831e6f62 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:27.232060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062fe08f-1bc8-4f07-8a13-fd54831e6f62 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:27.232595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062fe08f-1bc8-4f07-8a13-fd54831e6f62 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:27.233159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062fe08f-1bc8-4f07-8a13-fd54831e6f62 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:27.268459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-062fe08f-1bc8-4f07-8a13-fd54831e6f62 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Getting quotas for project 87126fba5c074971a9c3c41de4164571. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:31:27.284550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-062fe08f-1bc8-4f07-8a13-fd54831e6f62 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Getting quotas for user ce4bbe335166415da37188b475b3194b and project 87126fba5c074971a9c3c41de4164571. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:31:27.434050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d64e671b-4963-407c-8786-2f58dcc51ba9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:27.448775 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d64e671b-4963-407c-8786-2f58dcc51ba9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1521 microversion: 2.1 time: 0.618606 Aug 24 10:31:27.449796 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1801/3951] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:26 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1521 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:27.464084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-062fe08f-1bc8-4f07-8a13-fd54831e6f62 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:31:27.464084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-062fe08f-1bc8-4f07-8a13-fd54831e6f62 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6de1d331-49ff-46e1-aa1e-7d74df52fcb4',volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:31:27.472134 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5ce647f8-700a-4075-9003-14d66561233e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:27.473963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5ce647f8-700a-4075-9003-14d66561233e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 33162162-c8fe-4f85-9f88-ff2452cfab95] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:27.731446 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5ce647f8-700a-4075-9003-14d66561233e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:27.739523 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-062fe08f-1bc8-4f07-8a13-fd54831e6f62 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.798796 Aug 24 10:31:27.742227 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5ce647f8-700a-4075-9003-14d66561233e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95" status: 200 len: 1216 microversion: 2.1 time: 0.275849 Aug 24 10:31:27.742406 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2151/3952] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:31:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 2803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:31:27.769001 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1802/3953] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:27 2022] GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95 => generated 1216 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:27.770508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4af9d046-ffc9-456f-84d5-44631e1de5e7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:27.771377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4af9d046-ffc9-456f-84d5-44631e1de5e7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:27.867847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4af9d046-ffc9-456f-84d5-44631e1de5e7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:27.879801 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4af9d046-ffc9-456f-84d5-44631e1de5e7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1122 microversion: 2.1 time: 0.124317 Aug 24 10:31:27.883100 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2152/3954] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:27 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1122 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:28.472811 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d894715a-3c71-4d4e-9895-3d28bec8e5a9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:28.473550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d894715a-3c71-4d4e-9895-3d28bec8e5a9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:28.486517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d894715a-3c71-4d4e-9895-3d28bec8e5a9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:28.487290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d894715a-3c71-4d4e-9895-3d28bec8e5a9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:28.487938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d894715a-3c71-4d4e-9895-3d28bec8e5a9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:28.488680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d894715a-3c71-4d4e-9895-3d28bec8e5a9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:28.489166 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d894715a-3c71-4d4e-9895-3d28bec8e5a9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:28.489745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d894715a-3c71-4d4e-9895-3d28bec8e5a9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:28.774044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d34c7e26-205a-499d-b04c-cd6626a05498 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:28.775651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d34c7e26-205a-499d-b04c-cd6626a05498 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 33162162-c8fe-4f85-9f88-ff2452cfab95] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:28.794861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d34c7e26-205a-499d-b04c-cd6626a05498 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:28.795370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d34c7e26-205a-499d-b04c-cd6626a05498 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:28.795816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d34c7e26-205a-499d-b04c-cd6626a05498 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:28.796572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d34c7e26-205a-499d-b04c-cd6626a05498 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:28.797036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d34c7e26-205a-499d-b04c-cd6626a05498 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:28.802260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d34c7e26-205a-499d-b04c-cd6626a05498 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:29.017720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d894715a-3c71-4d4e-9895-3d28bec8e5a9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:29.035654 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d894715a-3c71-4d4e-9895-3d28bec8e5a9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1521 microversion: 2.1 time: 0.567095 Aug 24 10:31:29.037623 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1803/3955] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:28 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1521 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:29.047273 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-26a3a44f-7fdb-477d-a7ef-4ab28e83e9d1 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:29.051927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-26a3a44f-7fdb-477d-a7ef-4ab28e83e9d1 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:29.076788 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26a3a44f-7fdb-477d-a7ef-4ab28e83e9d1 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:29.077361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26a3a44f-7fdb-477d-a7ef-4ab28e83e9d1 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:29.077817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26a3a44f-7fdb-477d-a7ef-4ab28e83e9d1 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:29.078576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26a3a44f-7fdb-477d-a7ef-4ab28e83e9d1 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:29.079038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26a3a44f-7fdb-477d-a7ef-4ab28e83e9d1 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:29.079465 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26a3a44f-7fdb-477d-a7ef-4ab28e83e9d1 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:29.417489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d34c7e26-205a-499d-b04c-cd6626a05498 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:29.430261 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d34c7e26-205a-499d-b04c-cd6626a05498 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95" status: 200 len: 1274 microversion: 2.1 time: 0.661562 Aug 24 10:31:29.445387 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2153/3956] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:28 2022] GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95 => generated 1274 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:31:29.654473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-26a3a44f-7fdb-477d-a7ef-4ab28e83e9d1 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:29.670907 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-26a3a44f-7fdb-477d-a7ef-4ab28e83e9d1 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1220 microversion: 2.1 time: 0.631923 Aug 24 10:31:29.671521 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1804/3957] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:29 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1220 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:30.060791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c15c5cac-2819-4436-a8e6-29d8707e6082 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:30.064866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c15c5cac-2819-4436-a8e6-29d8707e6082 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:30.082211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c15c5cac-2819-4436-a8e6-29d8707e6082 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:30.090922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c15c5cac-2819-4436-a8e6-29d8707e6082 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:30.096932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c15c5cac-2819-4436-a8e6-29d8707e6082 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:30.098173 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c15c5cac-2819-4436-a8e6-29d8707e6082 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:30.098887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c15c5cac-2819-4436-a8e6-29d8707e6082 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:30.099766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c15c5cac-2819-4436-a8e6-29d8707e6082 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:30.458637 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-53ea0070-6380-4a69-b401-af9c44ab943f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:30.459870 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-53ea0070-6380-4a69-b401-af9c44ab943f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 33162162-c8fe-4f85-9f88-ff2452cfab95] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:30.474827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53ea0070-6380-4a69-b401-af9c44ab943f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:30.475240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53ea0070-6380-4a69-b401-af9c44ab943f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:30.478289 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53ea0070-6380-4a69-b401-af9c44ab943f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:30.481730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53ea0070-6380-4a69-b401-af9c44ab943f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:30.482382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53ea0070-6380-4a69-b401-af9c44ab943f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:30.483087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53ea0070-6380-4a69-b401-af9c44ab943f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:30.710508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-53ea0070-6380-4a69-b401-af9c44ab943f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:30.719606 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-53ea0070-6380-4a69-b401-af9c44ab943f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95" status: 200 len: 1274 microversion: 2.1 time: 0.265281 Aug 24 10:31:30.724646 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1805/3958] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:30 2022] GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95 => generated 1274 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:31:30.730050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f49227fc-7f2e-49af-99d8-36cc462f79a8 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:30.735768 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f49227fc-7f2e-49af-99d8-36cc462f79a8 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:30.749202 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f49227fc-7f2e-49af-99d8-36cc462f79a8 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:30.749948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f49227fc-7f2e-49af-99d8-36cc462f79a8 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:30.750699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f49227fc-7f2e-49af-99d8-36cc462f79a8 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:30.751581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f49227fc-7f2e-49af-99d8-36cc462f79a8 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:30.752231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f49227fc-7f2e-49af-99d8-36cc462f79a8 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:30.752979 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f49227fc-7f2e-49af-99d8-36cc462f79a8 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:30.920362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f49227fc-7f2e-49af-99d8-36cc462f79a8 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:30.941702 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f49227fc-7f2e-49af-99d8-36cc462f79a8 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1238 microversion: 2.1 time: 0.211625 Aug 24 10:31:30.942864 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1806/3959] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:30 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1238 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:31.090914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c15c5cac-2819-4436-a8e6-29d8707e6082 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:31.104867 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c15c5cac-2819-4436-a8e6-29d8707e6082 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1521 microversion: 2.1 time: 1.047476 Aug 24 10:31:31.119106 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2154/3960] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:30 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1521 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:31.751736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5db6ad6f-ed6c-42d2-b55a-be45562f653d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:31.754165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5db6ad6f-ed6c-42d2-b55a-be45562f653d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 33162162-c8fe-4f85-9f88-ff2452cfab95] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:31.771396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5db6ad6f-ed6c-42d2-b55a-be45562f653d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:31.772427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5db6ad6f-ed6c-42d2-b55a-be45562f653d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:31.773070 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5db6ad6f-ed6c-42d2-b55a-be45562f653d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:31.778074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5db6ad6f-ed6c-42d2-b55a-be45562f653d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:31.778912 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5db6ad6f-ed6c-42d2-b55a-be45562f653d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:31.779543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5db6ad6f-ed6c-42d2-b55a-be45562f653d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:31.966237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-52bf54f4-5cbe-41ab-8916-6ef774383c01 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:31.969007 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-52bf54f4-5cbe-41ab-8916-6ef774383c01 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:31.990939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52bf54f4-5cbe-41ab-8916-6ef774383c01 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:31.991756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52bf54f4-5cbe-41ab-8916-6ef774383c01 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:31.992404 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52bf54f4-5cbe-41ab-8916-6ef774383c01 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:31.994014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52bf54f4-5cbe-41ab-8916-6ef774383c01 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:31.994685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52bf54f4-5cbe-41ab-8916-6ef774383c01 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:31.995292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52bf54f4-5cbe-41ab-8916-6ef774383c01 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:32.005839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5db6ad6f-ed6c-42d2-b55a-be45562f653d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:32.016678 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5db6ad6f-ed6c-42d2-b55a-be45562f653d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95" status: 200 len: 1274 microversion: 2.1 time: 0.270602 Aug 24 10:31:32.017801 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1807/3961] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:31 2022] GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95 => generated 1274 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:32.132480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-077d261e-b379-410e-9666-d46eab2045a3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:32.133213 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-077d261e-b379-410e-9666-d46eab2045a3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:32.143374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-077d261e-b379-410e-9666-d46eab2045a3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:32.143938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-077d261e-b379-410e-9666-d46eab2045a3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:32.144417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-077d261e-b379-410e-9666-d46eab2045a3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:32.145764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-077d261e-b379-410e-9666-d46eab2045a3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:32.146398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-077d261e-b379-410e-9666-d46eab2045a3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:32.146827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-077d261e-b379-410e-9666-d46eab2045a3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:32.656679 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-077d261e-b379-410e-9666-d46eab2045a3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:32.668300 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-077d261e-b379-410e-9666-d46eab2045a3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1521 microversion: 2.1 time: 0.540657 Aug 24 10:31:32.672900 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1808/3962] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:32 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1521 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:31:33.071975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32e801b1-967c-4960-8e16-56ca0391e1c4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:33.072617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-32e801b1-967c-4960-8e16-56ca0391e1c4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:33.082520 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32e801b1-967c-4960-8e16-56ca0391e1c4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:33.083030 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32e801b1-967c-4960-8e16-56ca0391e1c4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:33.083854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32e801b1-967c-4960-8e16-56ca0391e1c4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:33.102588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32e801b1-967c-4960-8e16-56ca0391e1c4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:33.103403 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32e801b1-967c-4960-8e16-56ca0391e1c4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:33.107687 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32e801b1-967c-4960-8e16-56ca0391e1c4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:33.137031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-52bf54f4-5cbe-41ab-8916-6ef774383c01 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:33.169365 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-52bf54f4-5cbe-41ab-8916-6ef774383c01 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1238 microversion: 2.1 time: 1.210029 Aug 24 10:31:33.173971 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2155/3963] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:31 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1238 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:31:33.196232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-32e801b1-967c-4960-8e16-56ca0391e1c4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:31:33.200185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ebd7d716-3065-47bb-b248-37c25d53763b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:33.203801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ebd7d716-3065-47bb-b248-37c25d53763b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 33162162-c8fe-4f85-9f88-ff2452cfab95] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:33.216953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebd7d716-3065-47bb-b248-37c25d53763b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:33.222960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebd7d716-3065-47bb-b248-37c25d53763b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:33.223684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebd7d716-3065-47bb-b248-37c25d53763b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:33.224932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebd7d716-3065-47bb-b248-37c25d53763b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:33.225585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebd7d716-3065-47bb-b248-37c25d53763b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:33.227368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebd7d716-3065-47bb-b248-37c25d53763b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:33.369995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:33.452905 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-32e801b1-967c-4960-8e16-56ca0391e1c4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "DELETE /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 204 len: 0 microversion: 2.42 time: 0.778302 Aug 24 10:31:33.453549 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1809/3964] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:31:32 2022] DELETE /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 0 bytes in 780 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:31:33.464928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b1456df6-96a1-4f85-b50d-ea72baa718e8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:33.465686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b1456df6-96a1-4f85-b50d-ea72baa718e8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:33.479870 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1456df6-96a1-4f85-b50d-ea72baa718e8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:33.481894 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1456df6-96a1-4f85-b50d-ea72baa718e8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:33.482612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1456df6-96a1-4f85-b50d-ea72baa718e8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:33.483658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1456df6-96a1-4f85-b50d-ea72baa718e8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:33.484959 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1456df6-96a1-4f85-b50d-ea72baa718e8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:33.485612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1456df6-96a1-4f85-b50d-ea72baa718e8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:33.709943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ebd7d716-3065-47bb-b248-37c25d53763b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:33.720204 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ebd7d716-3065-47bb-b248-37c25d53763b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95" status: 200 len: 1274 microversion: 2.1 time: 0.544802 Aug 24 10:31:33.721363 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2156/3965] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:33 2022] GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95 => generated 1274 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:33.727865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-788bb5bd-afc9-4bf0-80ac-8c6e29bc6042 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:33.729104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-788bb5bd-afc9-4bf0-80ac-8c6e29bc6042 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:33.737416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-788bb5bd-afc9-4bf0-80ac-8c6e29bc6042 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:33.737933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-788bb5bd-afc9-4bf0-80ac-8c6e29bc6042 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:33.738556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-788bb5bd-afc9-4bf0-80ac-8c6e29bc6042 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:33.739147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-788bb5bd-afc9-4bf0-80ac-8c6e29bc6042 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:33.739608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-788bb5bd-afc9-4bf0-80ac-8c6e29bc6042 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:33.740283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-788bb5bd-afc9-4bf0-80ac-8c6e29bc6042 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:33.957643 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b1456df6-96a1-4f85-b50d-ea72baa718e8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:33.976987 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b1456df6-96a1-4f85-b50d-ea72baa718e8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:33.978609 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b1456df6-96a1-4f85-b50d-ea72baa718e8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:33.980382 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b1456df6-96a1-4f85-b50d-ea72baa718e8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 2959 microversion: 2.42 time: 0.519573 Aug 24 10:31:33.989385 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1810/3966] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:31:33 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 2959 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:31:34.193900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-da71e10d-bf32-43a9-bb9f-bc87f42c85cc tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:34.195167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-da71e10d-bf32-43a9-bb9f-bc87f42c85cc tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:34.207603 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da71e10d-bf32-43a9-bb9f-bc87f42c85cc tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:34.208394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da71e10d-bf32-43a9-bb9f-bc87f42c85cc tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:34.210642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da71e10d-bf32-43a9-bb9f-bc87f42c85cc tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:34.213058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da71e10d-bf32-43a9-bb9f-bc87f42c85cc tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:34.218452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da71e10d-bf32-43a9-bb9f-bc87f42c85cc tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:34.222442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da71e10d-bf32-43a9-bb9f-bc87f42c85cc tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:34.325981 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-788bb5bd-afc9-4bf0-80ac-8c6e29bc6042 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:34.341997 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-788bb5bd-afc9-4bf0-80ac-8c6e29bc6042 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1521 microversion: 2.1 time: 0.619468 Aug 24 10:31:34.342923 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2157/3967] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:33 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1521 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:34.741233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2a1c44e7-a9de-441c-ad65-d7681264c6fc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:34.742086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2a1c44e7-a9de-441c-ad65-d7681264c6fc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 33162162-c8fe-4f85-9f88-ff2452cfab95] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:34.752974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a1c44e7-a9de-441c-ad65-d7681264c6fc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:34.769990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a1c44e7-a9de-441c-ad65-d7681264c6fc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:34.770571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a1c44e7-a9de-441c-ad65-d7681264c6fc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:34.772376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a1c44e7-a9de-441c-ad65-d7681264c6fc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:34.772881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a1c44e7-a9de-441c-ad65-d7681264c6fc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:34.773368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a1c44e7-a9de-441c-ad65-d7681264c6fc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:34.859848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-da71e10d-bf32-43a9-bb9f-bc87f42c85cc tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:34.868428 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-da71e10d-bf32-43a9-bb9f-bc87f42c85cc tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1305 microversion: 2.1 time: 0.678772 Aug 24 10:31:34.872802 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1811/3968] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:34 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1305 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:35.018329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-61f6786d-8595-4f7a-b1ee-11f19446a2b8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:35.019346 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-61f6786d-8595-4f7a-b1ee-11f19446a2b8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:35.039126 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61f6786d-8595-4f7a-b1ee-11f19446a2b8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:35.040228 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61f6786d-8595-4f7a-b1ee-11f19446a2b8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:35.040934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61f6786d-8595-4f7a-b1ee-11f19446a2b8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:35.048128 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61f6786d-8595-4f7a-b1ee-11f19446a2b8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:35.049060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61f6786d-8595-4f7a-b1ee-11f19446a2b8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:35.049870 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61f6786d-8595-4f7a-b1ee-11f19446a2b8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:35.555070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2a1c44e7-a9de-441c-ad65-d7681264c6fc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:35.578132 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2a1c44e7-a9de-441c-ad65-d7681264c6fc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95" status: 200 len: 1316 microversion: 2.1 time: 0.835233 Aug 24 10:31:35.595361 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2158/3969] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:34 2022] GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95 => generated 1316 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:35.600825 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5ed8334d-a7a7-4906-bb86-81ca2969b741 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:35.606274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5ed8334d-a7a7-4906-bb86-81ca2969b741 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:35.622986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:35.632515 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ed8334d-a7a7-4906-bb86-81ca2969b741 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:35.633370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ed8334d-a7a7-4906-bb86-81ca2969b741 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:35.634003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ed8334d-a7a7-4906-bb86-81ca2969b741 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:35.634916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ed8334d-a7a7-4906-bb86-81ca2969b741 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:35.641470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ed8334d-a7a7-4906-bb86-81ca2969b741 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:35.642189 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ed8334d-a7a7-4906-bb86-81ca2969b741 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:35.713801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:36.051415 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-61f6786d-8595-4f7a-b1ee-11f19446a2b8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:36.085596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-61f6786d-8595-4f7a-b1ee-11f19446a2b8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:36.095347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-61f6786d-8595-4f7a-b1ee-11f19446a2b8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:36.105687 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-61f6786d-8595-4f7a-b1ee-11f19446a2b8 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 2959 microversion: 2.42 time: 1.085302 Aug 24 10:31:36.109330 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1812/3970] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:31:35 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 2959 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:31:36.140220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a479e965-39dc-4565-81e1-ef48069691b0 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:36.142179 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a479e965-39dc-4565-81e1-ef48069691b0 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:36.154753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a479e965-39dc-4565-81e1-ef48069691b0 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:36.157731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a479e965-39dc-4565-81e1-ef48069691b0 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:36.158324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a479e965-39dc-4565-81e1-ef48069691b0 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:36.159205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a479e965-39dc-4565-81e1-ef48069691b0 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:36.159685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a479e965-39dc-4565-81e1-ef48069691b0 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:36.160138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a479e965-39dc-4565-81e1-ef48069691b0 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:36.404347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a479e965-39dc-4565-81e1-ef48069691b0 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:36.426955 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a479e965-39dc-4565-81e1-ef48069691b0 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1305 microversion: 2.1 time: 0.312690 Aug 24 10:31:36.428687 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1813/3971] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:36 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1305 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:36.599817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a35cd21c-688b-4d10-adc5-757b45b4ee02 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:36.600964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a35cd21c-688b-4d10-adc5-757b45b4ee02 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 33162162-c8fe-4f85-9f88-ff2452cfab95] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:36.610113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a35cd21c-688b-4d10-adc5-757b45b4ee02 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:36.612986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a35cd21c-688b-4d10-adc5-757b45b4ee02 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:36.614311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a35cd21c-688b-4d10-adc5-757b45b4ee02 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:36.615484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a35cd21c-688b-4d10-adc5-757b45b4ee02 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:36.618144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a35cd21c-688b-4d10-adc5-757b45b4ee02 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:36.621308 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a35cd21c-688b-4d10-adc5-757b45b4ee02 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:36.724414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:36.983519 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5ed8334d-a7a7-4906-bb86-81ca2969b741 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:36.995652 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5ed8334d-a7a7-4906-bb86-81ca2969b741 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1521 microversion: 2.1 time: 1.398690 Aug 24 10:31:36.999513 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2159/3972] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:35 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1521 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:37.018090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a35cd21c-688b-4d10-adc5-757b45b4ee02 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:37.035281 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a35cd21c-688b-4d10-adc5-757b45b4ee02 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95" status: 200 len: 1316 microversion: 2.1 time: 0.439321 Aug 24 10:31:37.040442 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1814/3973] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:36 2022] GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95 => generated 1316 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:37.139220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4e16fbac-028b-46a2-88af-a9b58946e0d1 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:37.140378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4e16fbac-028b-46a2-88af-a9b58946e0d1 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:37.153012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e16fbac-028b-46a2-88af-a9b58946e0d1 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:37.162827 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e16fbac-028b-46a2-88af-a9b58946e0d1 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:37.165816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e16fbac-028b-46a2-88af-a9b58946e0d1 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:37.166752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e16fbac-028b-46a2-88af-a9b58946e0d1 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:37.168128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e16fbac-028b-46a2-88af-a9b58946e0d1 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:37.172299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e16fbac-028b-46a2-88af-a9b58946e0d1 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:37.251771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:37.455162 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-921cea64-5b2e-4c63-81f1-bb223cbc9b3a tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:37.456459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-921cea64-5b2e-4c63-81f1-bb223cbc9b3a tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:37.466111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-921cea64-5b2e-4c63-81f1-bb223cbc9b3a tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:37.474181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-921cea64-5b2e-4c63-81f1-bb223cbc9b3a tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:37.474612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-921cea64-5b2e-4c63-81f1-bb223cbc9b3a tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:37.475386 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-921cea64-5b2e-4c63-81f1-bb223cbc9b3a tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:37.476044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-921cea64-5b2e-4c63-81f1-bb223cbc9b3a tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:37.476700 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-921cea64-5b2e-4c63-81f1-bb223cbc9b3a tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:37.740596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:37.873004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=12 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:37.964344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4e16fbac-028b-46a2-88af-a9b58946e0d1 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:37.981502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4e16fbac-028b-46a2-88af-a9b58946e0d1 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:37.985237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4e16fbac-028b-46a2-88af-a9b58946e0d1 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:37.989010 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4e16fbac-028b-46a2-88af-a9b58946e0d1 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 2959 microversion: 2.42 time: 0.854010 Aug 24 10:31:37.996846 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2160/3974] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:31:37 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 2959 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:31:38.021096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6f465959-d58e-4690-b738-4003af9bc6e5 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:38.022040 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6f465959-d58e-4690-b738-4003af9bc6e5 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:38.038958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f465959-d58e-4690-b738-4003af9bc6e5 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:38.039826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f465959-d58e-4690-b738-4003af9bc6e5 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:38.040515 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f465959-d58e-4690-b738-4003af9bc6e5 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:38.041746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f465959-d58e-4690-b738-4003af9bc6e5 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:38.042409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f465959-d58e-4690-b738-4003af9bc6e5 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:38.043042 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f465959-d58e-4690-b738-4003af9bc6e5 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:38.043781 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-921cea64-5b2e-4c63-81f1-bb223cbc9b3a tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:38.059795 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-921cea64-5b2e-4c63-81f1-bb223cbc9b3a tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1305 microversion: 2.1 time: 0.609066 Aug 24 10:31:38.060400 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1815/3975] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:37 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1305 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:38.076577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a13af229-585a-412f-9742-765f5c18bc78 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:38.077923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a13af229-585a-412f-9742-765f5c18bc78 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 33162162-c8fe-4f85-9f88-ff2452cfab95] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:38.090906 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a13af229-585a-412f-9742-765f5c18bc78 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:38.092005 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a13af229-585a-412f-9742-765f5c18bc78 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:38.094567 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a13af229-585a-412f-9742-765f5c18bc78 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:38.095522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a13af229-585a-412f-9742-765f5c18bc78 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:38.097797 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a13af229-585a-412f-9742-765f5c18bc78 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:38.098432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a13af229-585a-412f-9742-765f5c18bc78 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:38.734089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6f465959-d58e-4690-b738-4003af9bc6e5 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:38.738707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a13af229-585a-412f-9742-765f5c18bc78 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:38.749832 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6f465959-d58e-4690-b738-4003af9bc6e5 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1501 microversion: 2.1 time: 0.733313 Aug 24 10:31:38.750452 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2161/3976] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:38 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1501 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:38.771432 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a13af229-585a-412f-9742-765f5c18bc78 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95" status: 200 len: 1316 microversion: 2.1 time: 0.709749 Aug 24 10:31:38.772915 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1816/3977] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:38 2022] GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95 => generated 1316 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:38.796088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2da64fd9-dd91-4de3-8779-d82557584ffa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d16a274f-8e45-481e-bf90-700ccfaacbc8"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:31:38.798978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2da64fd9-dd91-4de3-8779-d82557584ffa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:38.816581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2da64fd9-dd91-4de3-8779-d82557584ffa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:38.818355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2da64fd9-dd91-4de3-8779-d82557584ffa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:38.818355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2da64fd9-dd91-4de3-8779-d82557584ffa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:38.818979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2da64fd9-dd91-4de3-8779-d82557584ffa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:38.823591 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2da64fd9-dd91-4de3-8779-d82557584ffa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:38.824053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2da64fd9-dd91-4de3-8779-d82557584ffa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:38.907151 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-2da64fd9-dd91-4de3-8779-d82557584ffa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] HTTP exception thrown: Cannot 'attach_volume' instance b1bb2ada-4833-4819-a358-2e832c5a0a41 while it is in vm_state rescued Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2da64fd9-dd91-4de3-8779-d82557584ffa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Request method failure captured: Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41/os-volume_attachments HTTP/1.1 Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 74 Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf2afGdSM86mh0RIAZFYBYhaQ4EtyTCcCD00ldy_PJZTrDPEqZsqjAaBEiSLwFHEWtlpLSXpU9lI2y_7Dlfdrd1tzCv296dD-Q1jtlqtcx2Z1VdQb3wVY7fHkhrfDX6lZ98oMTsvllOCneZWRxakMNA_j9HFWTm3gYwjAHKCNfApMTc Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 125d2dd1d22140abaa36184e3628a339 Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1145732609 Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/125d2dd1d22140abaa36184e3628a339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_125d2dd1d22140abaa36184e3628a339", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/125d2dd1d22140abaa36184e3628a339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/125d2dd1d22140abaa36184e3628a339"}]}] Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1145732609 Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 125d2dd1d22140abaa36184e3628a339 Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1145732609 Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerRescueNegativeTestJSON-1145732609-project Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 133e99904a6b4574933cad73d0f2293f Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1145732609-project Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: {"volumeAttachment": {"volumeId": "d16a274f-8e45-481e-bf90-700ccfaacbc8"}} Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: exception: Cannot 'attach_volume' instance b1bb2ada-4833-4819-a358-2e832c5a0a41 while it is in vm_state rescued Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'server_id': 'b1bb2ada-4833-4819-a358-2e832c5a0a41', 'body': {'volumeAttachment': {'volumeId': 'd16a274f-8e45-481e-bf90-700ccfaacbc8'}}} Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b1bb2ada-4833-4819-a358-2e832c5a0a41 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 10:31:38.910046 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 10:31:38.914101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 10:31:38.914101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 10:31:38.914101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b1bb2ada-4833-4819-a358-2e832c5a0a41 while it is in vm_state rescued Aug 24 10:31:38.914101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:31:38.914101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:31:38.914101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:31:38.914101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:31:38.914101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:31:38.914101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:31:38.914101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:31:38.914101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:31:38.914101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b1bb2ada-4833-4819-a358-2e832c5a0a41 while it is in vm_state rescued Aug 24 10:31:38.914101 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:31:38.916330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2da64fd9-dd91-4de3-8779-d82557584ffa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Returning 409 to user: Cannot 'attach_volume' instance b1bb2ada-4833-4819-a358-2e832c5a0a41 while it is in vm_state rescued {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:31:38.917451 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2da64fd9-dd91-4de3-8779-d82557584ffa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "POST /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.145784 Aug 24 10:31:38.918213 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2162/3978] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Aug 24 10:31:38 2022] POST /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41/os-volume_attachments => generated 152 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 10:31:38.935124 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4f9b9fb5-4bd1-419e-9076-00afd4e98e51 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:31:38.936677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4f9b9fb5-4bd1-419e-9076-00afd4e98e51 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:38.947461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f9b9fb5-4bd1-419e-9076-00afd4e98e51 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:38.948786 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f9b9fb5-4bd1-419e-9076-00afd4e98e51 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:38.949976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f9b9fb5-4bd1-419e-9076-00afd4e98e51 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:38.951013 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f9b9fb5-4bd1-419e-9076-00afd4e98e51 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:38.951667 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f9b9fb5-4bd1-419e-9076-00afd4e98e51 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:38.952454 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f9b9fb5-4bd1-419e-9076-00afd4e98e51 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:38.968826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-ea202604-422d-4bc3-82db-b2d58231ce8c req-1cb55d89-7689-41ce-b82d-9b03c90a786a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d82e58b9-780c-4deb-80e3-acf4911c7c85", "tag": "1559d343-8448-4e13-92be-96efcc09b44a"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:31:38.996130 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ea202604-422d-4bc3-82db-b2d58231ce8c req-1cb55d89-7689-41ce-b82d-9b03c90a786a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:38.997500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ea202604-422d-4bc3-82db-b2d58231ce8c req-1cb55d89-7689-41ce-b82d-9b03c90a786a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:38.998158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ea202604-422d-4bc3-82db-b2d58231ce8c req-1cb55d89-7689-41ce-b82d-9b03c90a786a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:39.022282 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-ea202604-422d-4bc3-82db-b2d58231ce8c req-1cb55d89-7689-41ce-b82d-9b03c90a786a service nova] Creating event network-changed:1559d343-8448-4e13-92be-96efcc09b44a for instance d82e58b9-780c-4deb-80e3-acf4911c7c85 on n-h2-849328-3 Aug 24 10:31:39.031402 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-ea202604-422d-4bc3-82db-b2d58231ce8c req-1cb55d89-7689-41ce-b82d-9b03c90a786a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068013 Aug 24 10:31:39.032788 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2163/3979] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:31:39.043834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-97227080-3894-418e-919c-720c276e2999 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:39.045160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-97227080-3894-418e-919c-720c276e2999 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:39.055889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97227080-3894-418e-919c-720c276e2999 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:39.056979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97227080-3894-418e-919c-720c276e2999 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:39.057679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97227080-3894-418e-919c-720c276e2999 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:39.059023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97227080-3894-418e-919c-720c276e2999 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:39.059747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97227080-3894-418e-919c-720c276e2999 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:39.060669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97227080-3894-418e-919c-720c276e2999 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:39.140094 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4f9b9fb5-4bd1-419e-9076-00afd4e98e51 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "POST /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41/action" status: 202 len: 0 microversion: 2.1 time: 0.210677 Aug 24 10:31:39.141261 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1817/3980] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:31:38 2022] POST /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:31:39.160423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-503ef0aa-c96e-4351-ba40-1b2e6e919d25 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:39.162429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-503ef0aa-c96e-4351-ba40-1b2e6e919d25 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:39.178971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-503ef0aa-c96e-4351-ba40-1b2e6e919d25 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:39.179469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-503ef0aa-c96e-4351-ba40-1b2e6e919d25 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:39.179904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-503ef0aa-c96e-4351-ba40-1b2e6e919d25 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:39.180624 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-503ef0aa-c96e-4351-ba40-1b2e6e919d25 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:39.181077 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-503ef0aa-c96e-4351-ba40-1b2e6e919d25 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:39.181554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-503ef0aa-c96e-4351-ba40-1b2e6e919d25 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:40.067856 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-503ef0aa-c96e-4351-ba40-1b2e6e919d25 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:40.090359 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-503ef0aa-c96e-4351-ba40-1b2e6e919d25 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1293 microversion: 2.1 time: 0.947419 Aug 24 10:31:40.105531 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1818/3981] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:39 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1293 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:40.111629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c0d8c16c-333b-4d5e-a02e-90355e100901 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:40.112265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c0d8c16c-333b-4d5e-a02e-90355e100901 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:40.145012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0d8c16c-333b-4d5e-a02e-90355e100901 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:40.154009 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0d8c16c-333b-4d5e-a02e-90355e100901 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:40.154493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0d8c16c-333b-4d5e-a02e-90355e100901 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:40.155279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0d8c16c-333b-4d5e-a02e-90355e100901 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:40.155759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0d8c16c-333b-4d5e-a02e-90355e100901 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:40.156193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0d8c16c-333b-4d5e-a02e-90355e100901 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:40.233057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-97227080-3894-418e-919c-720c276e2999 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:40.255298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-97227080-3894-418e-919c-720c276e2999 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:40.257906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-97227080-3894-418e-919c-720c276e2999 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:40.264045 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-97227080-3894-418e-919c-720c276e2999 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 2959 microversion: 2.42 time: 1.228464 Aug 24 10:31:40.266136 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2164/3982] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:31:39 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 2959 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:31:40.277581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c0907dfa-fe07-4e34-b595-3b1ff1155749 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:40.278514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c0907dfa-fe07-4e34-b595-3b1ff1155749 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 33162162-c8fe-4f85-9f88-ff2452cfab95] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:40.291061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0907dfa-fe07-4e34-b595-3b1ff1155749 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:40.297347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0907dfa-fe07-4e34-b595-3b1ff1155749 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:40.298057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0907dfa-fe07-4e34-b595-3b1ff1155749 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:40.299087 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0907dfa-fe07-4e34-b595-3b1ff1155749 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:40.302371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0907dfa-fe07-4e34-b595-3b1ff1155749 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:40.303908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0907dfa-fe07-4e34-b595-3b1ff1155749 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:40.764519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c0d8c16c-333b-4d5e-a02e-90355e100901 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:40.802590 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c0d8c16c-333b-4d5e-a02e-90355e100901 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1509 microversion: 2.1 time: 0.695526 Aug 24 10:31:40.811388 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1819/3983] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:40 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1509 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:40.876184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-86ebe794-9593-47f5-9c82-5cbeb0726e09 req-da451212-e14a-47c6-9482-b950871957b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ade0e12-9ac0-459f-8f85-6743432302fa", "name": "network-vif-unplugged", "status": "completed", "tag": "5844483e-5b42-463a-95e1-a9835141849c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:31:40.910439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-86ebe794-9593-47f5-9c82-5cbeb0726e09 req-da451212-e14a-47c6-9482-b950871957b6 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:40.913813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-86ebe794-9593-47f5-9c82-5cbeb0726e09 req-da451212-e14a-47c6-9482-b950871957b6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:40.915040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-86ebe794-9593-47f5-9c82-5cbeb0726e09 req-da451212-e14a-47c6-9482-b950871957b6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:40.968135 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-86ebe794-9593-47f5-9c82-5cbeb0726e09 req-da451212-e14a-47c6-9482-b950871957b6 service nova] Creating event network-vif-unplugged:5844483e-5b42-463a-95e1-a9835141849c for instance 1ade0e12-9ac0-459f-8f85-6743432302fa on n-h1-849328-3 Aug 24 10:31:40.977083 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-86ebe794-9593-47f5-9c82-5cbeb0726e09 req-da451212-e14a-47c6-9482-b950871957b6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109337 Aug 24 10:31:40.977988 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1820/3984] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:31:41.119471 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-093ed5c8-c835-4d8a-91ce-6813992ffbe3 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:41.121308 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-093ed5c8-c835-4d8a-91ce-6813992ffbe3 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:41.137371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-093ed5c8-c835-4d8a-91ce-6813992ffbe3 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:41.138414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-093ed5c8-c835-4d8a-91ce-6813992ffbe3 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:41.139230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-093ed5c8-c835-4d8a-91ce-6813992ffbe3 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:41.145074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-093ed5c8-c835-4d8a-91ce-6813992ffbe3 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:41.145974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-093ed5c8-c835-4d8a-91ce-6813992ffbe3 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:41.149824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-093ed5c8-c835-4d8a-91ce-6813992ffbe3 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:41.599396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c0907dfa-fe07-4e34-b595-3b1ff1155749 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:41.608105 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c0907dfa-fe07-4e34-b595-3b1ff1155749 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95" status: 200 len: 1316 microversion: 2.1 time: 1.338066 Aug 24 10:31:41.612763 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2165/3985] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:40 2022] GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95 => generated 1316 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:41.622240 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5bf0f9ff-1a0a-48b1-bb8d-ffa28738a17a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:41.623123 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5bf0f9ff-1a0a-48b1-bb8d-ffa28738a17a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:41.641819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5bf0f9ff-1a0a-48b1-bb8d-ffa28738a17a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:41.642326 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5bf0f9ff-1a0a-48b1-bb8d-ffa28738a17a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:41.642826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5bf0f9ff-1a0a-48b1-bb8d-ffa28738a17a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:41.643550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5bf0f9ff-1a0a-48b1-bb8d-ffa28738a17a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:41.644007 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5bf0f9ff-1a0a-48b1-bb8d-ffa28738a17a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:41.644435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5bf0f9ff-1a0a-48b1-bb8d-ffa28738a17a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:41.799085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-093ed5c8-c835-4d8a-91ce-6813992ffbe3 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:41.807411 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-093ed5c8-c835-4d8a-91ce-6813992ffbe3 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1293 microversion: 2.1 time: 0.699286 Aug 24 10:31:41.826678 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1821/3986] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:41 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1293 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:41.833706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-f3ac097d-78de-43e2-92c3-8c3b5d0c3594 req-c3dbe85b-42ff-45d6-a41f-ee3fef016675 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33162162-c8fe-4f85-9f88-ff2452cfab95", "tag": "10ec4bfa-c821-4178-b513-2e59038da6f4"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:31:41.844647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f3ac097d-78de-43e2-92c3-8c3b5d0c3594 req-c3dbe85b-42ff-45d6-a41f-ee3fef016675 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:41.866953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f3ac097d-78de-43e2-92c3-8c3b5d0c3594 req-c3dbe85b-42ff-45d6-a41f-ee3fef016675 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:41.867552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f3ac097d-78de-43e2-92c3-8c3b5d0c3594 req-c3dbe85b-42ff-45d6-a41f-ee3fef016675 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:41.892720 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-f3ac097d-78de-43e2-92c3-8c3b5d0c3594 req-c3dbe85b-42ff-45d6-a41f-ee3fef016675 service nova] Creating event network-changed:10ec4bfa-c821-4178-b513-2e59038da6f4 for instance 33162162-c8fe-4f85-9f88-ff2452cfab95 on n-h2-849328-3 Aug 24 10:31:41.898993 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-f3ac097d-78de-43e2-92c3-8c3b5d0c3594 req-c3dbe85b-42ff-45d6-a41f-ee3fef016675 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070698 Aug 24 10:31:41.899853 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1822/3987] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:31:41.914075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-67b3d3c4-9252-4e6b-9c4c-a51fc7dd1a60 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:41.914917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-67b3d3c4-9252-4e6b-9c4c-a51fc7dd1a60 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:41.931251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67b3d3c4-9252-4e6b-9c4c-a51fc7dd1a60 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:41.931983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67b3d3c4-9252-4e6b-9c4c-a51fc7dd1a60 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:41.932821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67b3d3c4-9252-4e6b-9c4c-a51fc7dd1a60 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:41.935515 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67b3d3c4-9252-4e6b-9c4c-a51fc7dd1a60 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:41.936237 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67b3d3c4-9252-4e6b-9c4c-a51fc7dd1a60 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:41.936844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67b3d3c4-9252-4e6b-9c4c-a51fc7dd1a60 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:42.312540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5bf0f9ff-1a0a-48b1-bb8d-ffa28738a17a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:42.333753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5bf0f9ff-1a0a-48b1-bb8d-ffa28738a17a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:42.339718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5bf0f9ff-1a0a-48b1-bb8d-ffa28738a17a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:42.341295 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5bf0f9ff-1a0a-48b1-bb8d-ffa28738a17a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 2938 microversion: 2.42 time: 0.727457 Aug 24 10:31:42.343091 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2166/3988] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:31:41 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 2938 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:31:42.387694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-67b3d3c4-9252-4e6b-9c4c-a51fc7dd1a60 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:42.406524 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-67b3d3c4-9252-4e6b-9c4c-a51fc7dd1a60 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1509 microversion: 2.1 time: 0.499935 Aug 24 10:31:42.407488 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1823/3989] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:41 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1509 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:42.635123 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ac66e91a-9721-4b8b-b2fd-1aed22a5610f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:42.635851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ac66e91a-9721-4b8b-b2fd-1aed22a5610f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 33162162-c8fe-4f85-9f88-ff2452cfab95] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:42.648788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac66e91a-9721-4b8b-b2fd-1aed22a5610f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:42.650112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac66e91a-9721-4b8b-b2fd-1aed22a5610f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:42.653486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac66e91a-9721-4b8b-b2fd-1aed22a5610f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:42.654365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac66e91a-9721-4b8b-b2fd-1aed22a5610f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:42.655013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac66e91a-9721-4b8b-b2fd-1aed22a5610f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:42.655826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac66e91a-9721-4b8b-b2fd-1aed22a5610f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:42.829620 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-93161b79-2aaf-485a-99d5-c5cc220229e8 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:42.830440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-93161b79-2aaf-485a-99d5-c5cc220229e8 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:42.841565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93161b79-2aaf-485a-99d5-c5cc220229e8 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:42.846095 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93161b79-2aaf-485a-99d5-c5cc220229e8 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:42.850567 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93161b79-2aaf-485a-99d5-c5cc220229e8 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:42.851472 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93161b79-2aaf-485a-99d5-c5cc220229e8 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:42.851970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93161b79-2aaf-485a-99d5-c5cc220229e8 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:42.852419 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93161b79-2aaf-485a-99d5-c5cc220229e8 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:43.360918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-93161b79-2aaf-485a-99d5-c5cc220229e8 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:43.383935 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-93161b79-2aaf-485a-99d5-c5cc220229e8 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1293 microversion: 2.1 time: 0.553811 Aug 24 10:31:43.385835 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1824/3990] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:42 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1293 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:31:43.399718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-69e66e71-d83d-4ac7-aa92-172a33633d5f req-0f3fee91-465d-42ee-8132-696a92b67ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ade0e12-9ac0-459f-8f85-6743432302fa", "name": "network-vif-unplugged", "status": "completed", "tag": "c070cc96-6844-4a0c-9556-217db4eaf193"}, {"server_uuid": "1ade0e12-9ac0-459f-8f85-6743432302fa", "name": "network-vif-unplugged", "status": "completed", "tag": "e3d5d84f-2aa7-4b85-b98f-cb04738cac08"}, {"server_uuid": "1ade0e12-9ac0-459f-8f85-6743432302fa", "name": "network-vif-unplugged", "status": "completed", "tag": "f508eefe-bb8e-440a-8dd6-3163d13f5d06"}, {"server_uuid": "1ade0e12-9ac0-459f-8f85-6743432302fa", "name": "network-vif-unplugged", "status": "completed", "tag": "baf5ca24-63d8-41c5-a43c-e62b747ae00c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:31:43.428544 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-69e66e71-d83d-4ac7-aa92-172a33633d5f req-0f3fee91-465d-42ee-8132-696a92b67ed0 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:43.433618 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-69e66e71-d83d-4ac7-aa92-172a33633d5f req-0f3fee91-465d-42ee-8132-696a92b67ed0 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:43.434151 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-69e66e71-d83d-4ac7-aa92-172a33633d5f req-0f3fee91-465d-42ee-8132-696a92b67ed0 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:43.462661 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-69e66e71-d83d-4ac7-aa92-172a33633d5f req-0f3fee91-465d-42ee-8132-696a92b67ed0 service nova] Creating event network-vif-unplugged:c070cc96-6844-4a0c-9556-217db4eaf193 for instance 1ade0e12-9ac0-459f-8f85-6743432302fa on n-h1-849328-3 Aug 24 10:31:43.463700 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-69e66e71-d83d-4ac7-aa92-172a33633d5f req-0f3fee91-465d-42ee-8132-696a92b67ed0 service nova] Creating event network-vif-unplugged:e3d5d84f-2aa7-4b85-b98f-cb04738cac08 for instance 1ade0e12-9ac0-459f-8f85-6743432302fa on n-h1-849328-3 Aug 24 10:31:43.464358 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-69e66e71-d83d-4ac7-aa92-172a33633d5f req-0f3fee91-465d-42ee-8132-696a92b67ed0 service nova] Creating event network-vif-unplugged:f508eefe-bb8e-440a-8dd6-3163d13f5d06 for instance 1ade0e12-9ac0-459f-8f85-6743432302fa on n-h1-849328-3 Aug 24 10:31:43.464964 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-69e66e71-d83d-4ac7-aa92-172a33633d5f req-0f3fee91-465d-42ee-8132-696a92b67ed0 service nova] Creating event network-vif-unplugged:baf5ca24-63d8-41c5-a43c-e62b747ae00c for instance 1ade0e12-9ac0-459f-8f85-6743432302fa on n-h1-849328-3 Aug 24 10:31:43.478039 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-69e66e71-d83d-4ac7-aa92-172a33633d5f req-0f3fee91-465d-42ee-8132-696a92b67ed0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.090519 Aug 24 10:31:43.480360 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1825/3991] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:31:43.498112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5d037cd0-b10b-4ef4-9382-eb9e9ac0c4f4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:43.499210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5d037cd0-b10b-4ef4-9382-eb9e9ac0c4f4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:43.519857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d037cd0-b10b-4ef4-9382-eb9e9ac0c4f4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:43.525796 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d037cd0-b10b-4ef4-9382-eb9e9ac0c4f4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:43.526311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d037cd0-b10b-4ef4-9382-eb9e9ac0c4f4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:43.527097 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d037cd0-b10b-4ef4-9382-eb9e9ac0c4f4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:43.527577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d037cd0-b10b-4ef4-9382-eb9e9ac0c4f4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:43.528010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d037cd0-b10b-4ef4-9382-eb9e9ac0c4f4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:43.572933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ac66e91a-9721-4b8b-b2fd-1aed22a5610f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:43.583670 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ac66e91a-9721-4b8b-b2fd-1aed22a5610f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95" status: 200 len: 1316 microversion: 2.1 time: 0.953933 Aug 24 10:31:43.584907 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2167/3992] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:42 2022] GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95 => generated 1316 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:43.591321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b08ec179-cd28-4c17-ad94-baa9448c3eae tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:43.599429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b08ec179-cd28-4c17-ad94-baa9448c3eae tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:43.606592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b08ec179-cd28-4c17-ad94-baa9448c3eae tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:43.607444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b08ec179-cd28-4c17-ad94-baa9448c3eae tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:43.608760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b08ec179-cd28-4c17-ad94-baa9448c3eae tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:43.610582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b08ec179-cd28-4c17-ad94-baa9448c3eae tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:43.611602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b08ec179-cd28-4c17-ad94-baa9448c3eae tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:43.612306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b08ec179-cd28-4c17-ad94-baa9448c3eae tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:44.065801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b08ec179-cd28-4c17-ad94-baa9448c3eae tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:44.081967 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b08ec179-cd28-4c17-ad94-baa9448c3eae tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1515 microversion: 2.1 time: 0.494843 Aug 24 10:31:44.083975 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2168/3993] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:43 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1515 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:44.407238 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ecf0c150-69cd-40ed-903a-1522382c5508 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:44.408236 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ecf0c150-69cd-40ed-903a-1522382c5508 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:44.419289 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5d037cd0-b10b-4ef4-9382-eb9e9ac0c4f4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:44.428229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ecf0c150-69cd-40ed-903a-1522382c5508 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:44.429005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ecf0c150-69cd-40ed-903a-1522382c5508 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:44.429890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ecf0c150-69cd-40ed-903a-1522382c5508 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:44.430781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ecf0c150-69cd-40ed-903a-1522382c5508 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:44.431377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ecf0c150-69cd-40ed-903a-1522382c5508 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:44.432331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ecf0c150-69cd-40ed-903a-1522382c5508 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:44.445758 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5d037cd0-b10b-4ef4-9382-eb9e9ac0c4f4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:44.450405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5d037cd0-b10b-4ef4-9382-eb9e9ac0c4f4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:44.454469 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5d037cd0-b10b-4ef4-9382-eb9e9ac0c4f4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 2917 microversion: 2.42 time: 0.972026 Aug 24 10:31:44.458304 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1826/3994] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:31:43 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 2917 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:31:44.617545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4ecebf0c-a0a2-4d7d-b1f8-807768cae135 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:44.618482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4ecebf0c-a0a2-4d7d-b1f8-807768cae135 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 33162162-c8fe-4f85-9f88-ff2452cfab95] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:44.645021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ecebf0c-a0a2-4d7d-b1f8-807768cae135 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:44.653629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ecebf0c-a0a2-4d7d-b1f8-807768cae135 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:44.654107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ecebf0c-a0a2-4d7d-b1f8-807768cae135 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:44.654894 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ecebf0c-a0a2-4d7d-b1f8-807768cae135 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:44.655426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ecebf0c-a0a2-4d7d-b1f8-807768cae135 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:44.655871 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ecebf0c-a0a2-4d7d-b1f8-807768cae135 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:44.711744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:45.442949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4ecebf0c-a0a2-4d7d-b1f8-807768cae135 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:45.466161 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4ecebf0c-a0a2-4d7d-b1f8-807768cae135 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95" status: 200 len: 1316 microversion: 2.1 time: 0.854761 Aug 24 10:31:45.471402 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1827/3995] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:44 2022] GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95 => generated 1316 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:45.491384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1b8b4525-fef2-4338-a577-fbdb9e15d486 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:45.496819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1b8b4525-fef2-4338-a577-fbdb9e15d486 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:45.529225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b8b4525-fef2-4338-a577-fbdb9e15d486 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:45.531764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b8b4525-fef2-4338-a577-fbdb9e15d486 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:45.532333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b8b4525-fef2-4338-a577-fbdb9e15d486 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:45.536740 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b8b4525-fef2-4338-a577-fbdb9e15d486 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:45.539253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b8b4525-fef2-4338-a577-fbdb9e15d486 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:45.539934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b8b4525-fef2-4338-a577-fbdb9e15d486 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:45.878159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ecf0c150-69cd-40ed-903a-1522382c5508 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:45.891421 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ecf0c150-69cd-40ed-903a-1522382c5508 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1293 microversion: 2.1 time: 1.488260 Aug 24 10:31:45.892218 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2169/3996] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:44 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1293 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:46.187314 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1b8b4525-fef2-4338-a577-fbdb9e15d486 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:46.206575 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1b8b4525-fef2-4338-a577-fbdb9e15d486 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:46.210110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1b8b4525-fef2-4338-a577-fbdb9e15d486 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:46.212800 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1b8b4525-fef2-4338-a577-fbdb9e15d486 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 2870 microversion: 2.42 time: 0.728074 Aug 24 10:31:46.236074 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1828/3997] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:31:45 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 2870 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:31:46.492474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-df17ed35-a381-4929-aed3-e8c85d887a49 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:46.493262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-df17ed35-a381-4929-aed3-e8c85d887a49 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 33162162-c8fe-4f85-9f88-ff2452cfab95] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:46.522243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df17ed35-a381-4929-aed3-e8c85d887a49 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:46.522929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df17ed35-a381-4929-aed3-e8c85d887a49 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:46.523511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df17ed35-a381-4929-aed3-e8c85d887a49 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:46.524370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df17ed35-a381-4929-aed3-e8c85d887a49 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:46.524940 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df17ed35-a381-4929-aed3-e8c85d887a49 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:46.525525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df17ed35-a381-4929-aed3-e8c85d887a49 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:46.912416 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-02f8c89c-f6e9-4a2a-be27-0c6720fd6031 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:46.913919 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-02f8c89c-f6e9-4a2a-be27-0c6720fd6031 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:46.927391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02f8c89c-f6e9-4a2a-be27-0c6720fd6031 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:46.928094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02f8c89c-f6e9-4a2a-be27-0c6720fd6031 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:46.928851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02f8c89c-f6e9-4a2a-be27-0c6720fd6031 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:46.929773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02f8c89c-f6e9-4a2a-be27-0c6720fd6031 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:46.930369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02f8c89c-f6e9-4a2a-be27-0c6720fd6031 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:46.930939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02f8c89c-f6e9-4a2a-be27-0c6720fd6031 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:47.707071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-df17ed35-a381-4929-aed3-e8c85d887a49 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:47.740001 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-df17ed35-a381-4929-aed3-e8c85d887a49 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95" status: 200 len: 1316 microversion: 2.1 time: 1.250778 Aug 24 10:31:47.741889 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2170/3998] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:46 2022] GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95 => generated 1316 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:47.759615 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1b8b1e98-687c-4fb9-8346-742b7fc00e2f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Action: 'create', calling method: .version_select at 0x7f4654fa9430>, body: {"keypair": {"name": "tempest-keypair-450899703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyixqlVYtT8YIvwocYYIRmbFtAoyDn65BZSvfq81mvcRMIeC/gAfAtWSShWTJ8KhBiHpOEXOcb7EJSHpn6axjt+7KOKoAFroi5J0MRhlyCDBybYTd0+hO7HYqZK6cDI9Q=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:31:47.797073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-1b8b1e98-687c-4fb9-8346-742b7fc00e2f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Getting quotas for project 125d2dd1d22140abaa36184e3628a339. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:31:47.813260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-1b8b1e98-687c-4fb9-8346-742b7fc00e2f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Getting quotas for user 133e99904a6b4574933cad73d0f2293f and project 125d2dd1d22140abaa36184e3628a339. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:31:47.880860 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1b8b1e98-687c-4fb9-8346-742b7fc00e2f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.136342 Aug 24 10:31:47.882127 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2171/3999] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:31:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:31:47.901277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-65318a60-a95e-4400-9cb7-b10563c87c40 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:47.901919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-65318a60-a95e-4400-9cb7-b10563c87c40 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:47.928832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65318a60-a95e-4400-9cb7-b10563c87c40 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:47.933383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65318a60-a95e-4400-9cb7-b10563c87c40 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:47.933935 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65318a60-a95e-4400-9cb7-b10563c87c40 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:47.934736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65318a60-a95e-4400-9cb7-b10563c87c40 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:47.935209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65318a60-a95e-4400-9cb7-b10563c87c40 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:47.935812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65318a60-a95e-4400-9cb7-b10563c87c40 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:48.458258 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-65318a60-a95e-4400-9cb7-b10563c87c40 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:48.468801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-65318a60-a95e-4400-9cb7-b10563c87c40 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:48.470785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-65318a60-a95e-4400-9cb7-b10563c87c40 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:48.472210 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-65318a60-a95e-4400-9cb7-b10563c87c40 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 2870 microversion: 2.42 time: 0.589036 Aug 24 10:31:48.473036 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2172/4000] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:31:47 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 2870 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:31:48.477885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-6fb66511-7420-4fde-81e2-779d9ae0794f req-5c7e83fa-36f5-4ef2-9041-ca8cc2f06dfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ade0e12-9ac0-459f-8f85-6743432302fa", "name": "network-vif-deleted", "tag": "e3d5d84f-2aa7-4b85-b98f-cb04738cac08"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:31:48.530355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6fb66511-7420-4fde-81e2-779d9ae0794f req-5c7e83fa-36f5-4ef2-9041-ca8cc2f06dfb service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:48.535315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6fb66511-7420-4fde-81e2-779d9ae0794f req-5c7e83fa-36f5-4ef2-9041-ca8cc2f06dfb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:48.537037 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6fb66511-7420-4fde-81e2-779d9ae0794f req-5c7e83fa-36f5-4ef2-9041-ca8cc2f06dfb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:48.554951 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-6fb66511-7420-4fde-81e2-779d9ae0794f req-5c7e83fa-36f5-4ef2-9041-ca8cc2f06dfb service nova] Creating event network-vif-deleted:e3d5d84f-2aa7-4b85-b98f-cb04738cac08 for instance 1ade0e12-9ac0-459f-8f85-6743432302fa on n-h1-849328-3 Aug 24 10:31:48.561937 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-6fb66511-7420-4fde-81e2-779d9ae0794f req-5c7e83fa-36f5-4ef2-9041-ca8cc2f06dfb service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087267 Aug 24 10:31:48.563936 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2173/4001] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:31:48.725222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-62582162-eab0-42d9-a03b-9958791cec67 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'create', calling method: .version_select at 0x7f465795dca0>, body: {"keypair": {"name": "tempest-keypair-1659287080", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMQ4bRDDBn8wDRlCe1KuM3W6NIBLUj6uCbiorXyAoPnaOGkY4LLFVaVOqWi5+fzn/0H5mNpng49sgl6RD9YicDSuhMC9fPwna17M2QquDoFM3Mu742cvaZRKyZTUu1JJQ=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:31:48.767621 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-62582162-eab0-42d9-a03b-9958791cec67 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Getting quotas for project 3d511560c1f543169e7eab8c70c9abcd. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:31:48.779360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-62582162-eab0-42d9-a03b-9958791cec67 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Getting quotas for user 03ef6a33c1f0467993486547b7d00fda and project 3d511560c1f543169e7eab8c70c9abcd. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:31:48.835793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-02f8c89c-f6e9-4a2a-be27-0c6720fd6031 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:48.837478 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-62582162-eab0-42d9-a03b-9958791cec67 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.271886 Aug 24 10:31:48.840257 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2174/4002] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:31:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:31:48.848595 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-02f8c89c-f6e9-4a2a-be27-0c6720fd6031 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1293 microversion: 2.1 time: 1.940306 Aug 24 10:31:48.851930 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a271d980-f886-4101-b68d-d0359de9a635 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:48.852208 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1829/4003] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:46 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1293 bytes in 1944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:48.855490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a271d980-f886-4101-b68d-d0359de9a635 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 33162162-c8fe-4f85-9f88-ff2452cfab95] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:48.869292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a271d980-f886-4101-b68d-d0359de9a635 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:48.869970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a271d980-f886-4101-b68d-d0359de9a635 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:48.870899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a271d980-f886-4101-b68d-d0359de9a635 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:48.871649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a271d980-f886-4101-b68d-d0359de9a635 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:48.873304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a271d980-f886-4101-b68d-d0359de9a635 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:48.873781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a271d980-f886-4101-b68d-d0359de9a635 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:49.175844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a271d980-f886-4101-b68d-d0359de9a635 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:49.186223 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a271d980-f886-4101-b68d-d0359de9a635 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95" status: 200 len: 1316 microversion: 2.1 time: 0.344754 Aug 24 10:31:49.186842 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2175/4004] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:48 2022] GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95 => generated 1316 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:49.519160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5783b0e2-6a30-40fd-9665-09c0fd256538 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:49.520870 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5783b0e2-6a30-40fd-9665-09c0fd256538 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:49.534900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5783b0e2-6a30-40fd-9665-09c0fd256538 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:49.535716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5783b0e2-6a30-40fd-9665-09c0fd256538 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:49.536325 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5783b0e2-6a30-40fd-9665-09c0fd256538 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:49.538494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5783b0e2-6a30-40fd-9665-09c0fd256538 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:49.539242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5783b0e2-6a30-40fd-9665-09c0fd256538 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:49.541112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5783b0e2-6a30-40fd-9665-09c0fd256538 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:49.873607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eba0a9e7-f94f-4f8c-bd03-1a59bcd758f6 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:49.874298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-eba0a9e7-f94f-4f8c-bd03-1a59bcd758f6 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:49.894696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eba0a9e7-f94f-4f8c-bd03-1a59bcd758f6 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:49.896115 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eba0a9e7-f94f-4f8c-bd03-1a59bcd758f6 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:49.896665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eba0a9e7-f94f-4f8c-bd03-1a59bcd758f6 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:49.900225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eba0a9e7-f94f-4f8c-bd03-1a59bcd758f6 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:49.900869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eba0a9e7-f94f-4f8c-bd03-1a59bcd758f6 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:49.901855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eba0a9e7-f94f-4f8c-bd03-1a59bcd758f6 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:50.096637 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5783b0e2-6a30-40fd-9665-09c0fd256538 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:50.136758 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5783b0e2-6a30-40fd-9665-09c0fd256538 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:50.143660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5783b0e2-6a30-40fd-9665-09c0fd256538 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:50.146624 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5783b0e2-6a30-40fd-9665-09c0fd256538 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 2577 microversion: 2.42 time: 0.634188 Aug 24 10:31:50.152726 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1830/4005] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:31:49 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 2577 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:31:50.329561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-84f465cb-dc92-4b67-bac9-f5711a94d74f req-1aabd74f-21c0-40e6-bfc2-e4fa4cd8cea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33162162-c8fe-4f85-9f88-ff2452cfab95", "name": "network-vif-plugged", "status": "completed", "tag": "10ec4bfa-c821-4178-b513-2e59038da6f4"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:31:50.362182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-84f465cb-dc92-4b67-bac9-f5711a94d74f req-1aabd74f-21c0-40e6-bfc2-e4fa4cd8cea7 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:50.362798 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-84f465cb-dc92-4b67-bac9-f5711a94d74f req-1aabd74f-21c0-40e6-bfc2-e4fa4cd8cea7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:50.365876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-84f465cb-dc92-4b67-bac9-f5711a94d74f req-1aabd74f-21c0-40e6-bfc2-e4fa4cd8cea7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:50.410206 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-84f465cb-dc92-4b67-bac9-f5711a94d74f req-1aabd74f-21c0-40e6-bfc2-e4fa4cd8cea7 service nova] Creating event network-vif-plugged:10ec4bfa-c821-4178-b513-2e59038da6f4 for instance 33162162-c8fe-4f85-9f88-ff2452cfab95 on n-h2-849328-3 Aug 24 10:31:50.432484 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-84f465cb-dc92-4b67-bac9-f5711a94d74f req-1aabd74f-21c0-40e6-bfc2-e4fa4cd8cea7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.277495 Aug 24 10:31:50.434540 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1831/4006] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:31:50.449526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a3634d8c-f3e9-47f2-b630-cc9c1bc0811a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:50.456536 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a3634d8c-f3e9-47f2-b630-cc9c1bc0811a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 33162162-c8fe-4f85-9f88-ff2452cfab95] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:50.474720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:50.486971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3634d8c-f3e9-47f2-b630-cc9c1bc0811a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:50.488037 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3634d8c-f3e9-47f2-b630-cc9c1bc0811a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:50.492499 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3634d8c-f3e9-47f2-b630-cc9c1bc0811a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:50.493823 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3634d8c-f3e9-47f2-b630-cc9c1bc0811a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:50.494924 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3634d8c-f3e9-47f2-b630-cc9c1bc0811a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:50.495719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3634d8c-f3e9-47f2-b630-cc9c1bc0811a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:50.744790 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-eba0a9e7-f94f-4f8c-bd03-1a59bcd758f6 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:50.755449 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eba0a9e7-f94f-4f8c-bd03-1a59bcd758f6 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1293 microversion: 2.1 time: 0.887373 Aug 24 10:31:50.774001 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2176/4007] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:49 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1293 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:31:50.781188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-ed2b1642-a212-4882-919b-d44f6b7e2ac4 req-0eb7989f-c1d0-4b37-93ec-624826c7d022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ade0e12-9ac0-459f-8f85-6743432302fa", "name": "network-vif-deleted", "tag": "c070cc96-6844-4a0c-9556-217db4eaf193"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:31:50.806033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ed2b1642-a212-4882-919b-d44f6b7e2ac4 req-0eb7989f-c1d0-4b37-93ec-624826c7d022 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:50.813249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ed2b1642-a212-4882-919b-d44f6b7e2ac4 req-0eb7989f-c1d0-4b37-93ec-624826c7d022 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:50.814304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ed2b1642-a212-4882-919b-d44f6b7e2ac4 req-0eb7989f-c1d0-4b37-93ec-624826c7d022 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:50.845272 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-ed2b1642-a212-4882-919b-d44f6b7e2ac4 req-0eb7989f-c1d0-4b37-93ec-624826c7d022 service nova] Creating event network-vif-deleted:c070cc96-6844-4a0c-9556-217db4eaf193 for instance 1ade0e12-9ac0-459f-8f85-6743432302fa on n-h1-849328-3 Aug 24 10:31:50.851338 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-ed2b1642-a212-4882-919b-d44f6b7e2ac4 req-0eb7989f-c1d0-4b37-93ec-624826c7d022 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075822 Aug 24 10:31:50.862419 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2177/4008] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:31:51.094309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a3634d8c-f3e9-47f2-b630-cc9c1bc0811a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:51.104168 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a3634d8c-f3e9-47f2-b630-cc9c1bc0811a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95" status: 200 len: 1316 microversion: 2.1 time: 0.666605 Aug 24 10:31:51.111461 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1832/4009] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:50 2022] GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95 => generated 1316 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:51.179327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-90c9bb50-30b5-44c4-bfd0-72fc8865c402 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:51.179685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-90c9bb50-30b5-44c4-bfd0-72fc8865c402 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:51.199495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90c9bb50-30b5-44c4-bfd0-72fc8865c402 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:51.200081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90c9bb50-30b5-44c4-bfd0-72fc8865c402 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:51.201602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90c9bb50-30b5-44c4-bfd0-72fc8865c402 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:51.204341 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90c9bb50-30b5-44c4-bfd0-72fc8865c402 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:51.204969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90c9bb50-30b5-44c4-bfd0-72fc8865c402 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:51.206723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90c9bb50-30b5-44c4-bfd0-72fc8865c402 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:51.784810 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-31e0fa3c-5ae9-463a-937f-fc69f5edc81d tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:51.785805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-31e0fa3c-5ae9-463a-937f-fc69f5edc81d tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:51.797197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31e0fa3c-5ae9-463a-937f-fc69f5edc81d tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:51.806040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31e0fa3c-5ae9-463a-937f-fc69f5edc81d tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:51.807889 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31e0fa3c-5ae9-463a-937f-fc69f5edc81d tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:51.813366 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31e0fa3c-5ae9-463a-937f-fc69f5edc81d tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:51.814361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31e0fa3c-5ae9-463a-937f-fc69f5edc81d tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:51.814812 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31e0fa3c-5ae9-463a-937f-fc69f5edc81d tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:52.271060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-90c9bb50-30b5-44c4-bfd0-72fc8865c402 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:52.295487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-90c9bb50-30b5-44c4-bfd0-72fc8865c402 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:52.298759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-90c9bb50-30b5-44c4-bfd0-72fc8865c402 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:52.302908 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-90c9bb50-30b5-44c4-bfd0-72fc8865c402 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 2370 microversion: 2.42 time: 1.129311 Aug 24 10:31:52.334706 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2178/4010] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:31:51 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 2370 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:31:52.341811 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1c48db14-c009-4dc8-b3a1-ceb70c27f010 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:52.342841 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1c48db14-c009-4dc8-b3a1-ceb70c27f010 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 33162162-c8fe-4f85-9f88-ff2452cfab95] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:52.359823 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c48db14-c009-4dc8-b3a1-ceb70c27f010 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:52.360688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c48db14-c009-4dc8-b3a1-ceb70c27f010 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:52.361433 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c48db14-c009-4dc8-b3a1-ceb70c27f010 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:52.363930 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c48db14-c009-4dc8-b3a1-ceb70c27f010 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:52.364807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c48db14-c009-4dc8-b3a1-ceb70c27f010 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:52.365376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c48db14-c009-4dc8-b3a1-ceb70c27f010 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:52.792326 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1c48db14-c009-4dc8-b3a1-ceb70c27f010 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:52.817381 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1c48db14-c009-4dc8-b3a1-ceb70c27f010 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95" status: 200 len: 1316 microversion: 2.1 time: 0.481305 Aug 24 10:31:52.818699 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2179/4011] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:52 2022] GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95 => generated 1316 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:52.921430 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-7c0d515d-040c-4ae9-b4b7-e216e11b4f59 req-3b65c406-c96b-4998-8008-f165a9005f42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ade0e12-9ac0-459f-8f85-6743432302fa", "name": "network-vif-deleted", "tag": "baf5ca24-63d8-41c5-a43c-e62b747ae00c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:31:52.960574 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7c0d515d-040c-4ae9-b4b7-e216e11b4f59 req-3b65c406-c96b-4998-8008-f165a9005f42 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:52.967354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7c0d515d-040c-4ae9-b4b7-e216e11b4f59 req-3b65c406-c96b-4998-8008-f165a9005f42 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:52.972689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7c0d515d-040c-4ae9-b4b7-e216e11b4f59 req-3b65c406-c96b-4998-8008-f165a9005f42 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:53.035447 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-7c0d515d-040c-4ae9-b4b7-e216e11b4f59 req-3b65c406-c96b-4998-8008-f165a9005f42 service nova] Creating event network-vif-deleted:baf5ca24-63d8-41c5-a43c-e62b747ae00c for instance 1ade0e12-9ac0-459f-8f85-6743432302fa on n-h1-849328-3 Aug 24 10:31:53.042021 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-7c0d515d-040c-4ae9-b4b7-e216e11b4f59 req-3b65c406-c96b-4998-8008-f165a9005f42 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125182 Aug 24 10:31:53.043217 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2180/4012] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:31:53.353691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-158fb80f-1564-44a5-9ee6-c0e868fe93b3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:53.355277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-158fb80f-1564-44a5-9ee6-c0e868fe93b3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:53.375143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-158fb80f-1564-44a5-9ee6-c0e868fe93b3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:53.376003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-158fb80f-1564-44a5-9ee6-c0e868fe93b3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:53.376891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-158fb80f-1564-44a5-9ee6-c0e868fe93b3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:53.377876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-158fb80f-1564-44a5-9ee6-c0e868fe93b3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:53.379367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-158fb80f-1564-44a5-9ee6-c0e868fe93b3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:53.381759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-158fb80f-1564-44a5-9ee6-c0e868fe93b3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:53.392934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:53.506874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-31e0fa3c-5ae9-463a-937f-fc69f5edc81d tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:53.532080 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-31e0fa3c-5ae9-463a-937f-fc69f5edc81d tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1293 microversion: 2.1 time: 1.749172 Aug 24 10:31:53.535223 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1833/4013] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:51 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1293 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:31:53.869889 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-49e7f384-9a41-48bf-9803-9eeadd0ab0d3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:53.870665 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-49e7f384-9a41-48bf-9803-9eeadd0ab0d3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 33162162-c8fe-4f85-9f88-ff2452cfab95] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:53.889112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49e7f384-9a41-48bf-9803-9eeadd0ab0d3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:53.889649 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49e7f384-9a41-48bf-9803-9eeadd0ab0d3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:53.894326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49e7f384-9a41-48bf-9803-9eeadd0ab0d3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:53.896565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49e7f384-9a41-48bf-9803-9eeadd0ab0d3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:53.907376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49e7f384-9a41-48bf-9803-9eeadd0ab0d3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:53.914139 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49e7f384-9a41-48bf-9803-9eeadd0ab0d3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:54.422798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-158fb80f-1564-44a5-9ee6-c0e868fe93b3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:54.446753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-158fb80f-1564-44a5-9ee6-c0e868fe93b3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:54.448764 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-158fb80f-1564-44a5-9ee6-c0e868fe93b3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:54.452938 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-158fb80f-1564-44a5-9ee6-c0e868fe93b3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 2256 microversion: 2.42 time: 1.105784 Aug 24 10:31:54.456023 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2181/4014] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:31:53 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 2256 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:31:54.470184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-66f395be-7c3e-4070-bd2c-101e9a9ca0dd req-41d33a93-d40c-4eb9-ba86-8b49e286e8eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d82e58b9-780c-4deb-80e3-acf4911c7c85", "name": "network-vif-plugged", "status": "completed", "tag": "1559d343-8448-4e13-92be-96efcc09b44a"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:31:54.525222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-66f395be-7c3e-4070-bd2c-101e9a9ca0dd req-41d33a93-d40c-4eb9-ba86-8b49e286e8eb service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:54.531803 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-66f395be-7c3e-4070-bd2c-101e9a9ca0dd req-41d33a93-d40c-4eb9-ba86-8b49e286e8eb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:54.532572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-66f395be-7c3e-4070-bd2c-101e9a9ca0dd req-41d33a93-d40c-4eb9-ba86-8b49e286e8eb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:54.560960 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-66f395be-7c3e-4070-bd2c-101e9a9ca0dd req-41d33a93-d40c-4eb9-ba86-8b49e286e8eb service nova] Creating event network-vif-plugged:1559d343-8448-4e13-92be-96efcc09b44a for instance d82e58b9-780c-4deb-80e3-acf4911c7c85 on n-h2-849328-3 Aug 24 10:31:54.582629 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-66f395be-7c3e-4070-bd2c-101e9a9ca0dd req-41d33a93-d40c-4eb9-ba86-8b49e286e8eb service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122499 Aug 24 10:31:54.583837 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2182/4015] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:31:54.596890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-35d8ac42-b327-470b-b9e5-5c00c53c83fb tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:54.600914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-35d8ac42-b327-470b-b9e5-5c00c53c83fb tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:54.619381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35d8ac42-b327-470b-b9e5-5c00c53c83fb tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:54.624144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35d8ac42-b327-470b-b9e5-5c00c53c83fb tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:54.625016 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35d8ac42-b327-470b-b9e5-5c00c53c83fb tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:54.634259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35d8ac42-b327-470b-b9e5-5c00c53c83fb tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:54.642062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35d8ac42-b327-470b-b9e5-5c00c53c83fb tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:54.642890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35d8ac42-b327-470b-b9e5-5c00c53c83fb tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:54.898981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-49e7f384-9a41-48bf-9803-9eeadd0ab0d3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:54.913040 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-49e7f384-9a41-48bf-9803-9eeadd0ab0d3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95" status: 200 len: 1504 microversion: 2.1 time: 1.063311 Aug 24 10:31:54.914613 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1834/4016] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:53 2022] GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95 => generated 1504 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:54.950030 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5bef3f5e-11b6-4556-ba52-9304a7569b96 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:54.950835 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5bef3f5e-11b6-4556-ba52-9304a7569b96 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 33162162-c8fe-4f85-9f88-ff2452cfab95] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:54.959031 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bef3f5e-11b6-4556-ba52-9304a7569b96 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:54.960834 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bef3f5e-11b6-4556-ba52-9304a7569b96 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:54.961621 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bef3f5e-11b6-4556-ba52-9304a7569b96 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:54.962758 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bef3f5e-11b6-4556-ba52-9304a7569b96 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:54.963431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bef3f5e-11b6-4556-ba52-9304a7569b96 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:54.964078 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bef3f5e-11b6-4556-ba52-9304a7569b96 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:55.018786 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5bef3f5e-11b6-4556-ba52-9304a7569b96 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 33162162-c8fe-4f85-9f88-ff2452cfab95] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:31:55.143240 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5bef3f5e-11b6-4556-ba52-9304a7569b96 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "DELETE /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95" status: 204 len: 0 microversion: 2.1 time: 0.201638 Aug 24 10:31:55.145412 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1835/4017] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:31:54 2022] DELETE /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:31:55.161903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-128df859-448e-4031-a0d7-f8f8df532d72 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:55.164649 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-128df859-448e-4031-a0d7-f8f8df532d72 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 33162162-c8fe-4f85-9f88-ff2452cfab95] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:55.184745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-128df859-448e-4031-a0d7-f8f8df532d72 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:55.185869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-128df859-448e-4031-a0d7-f8f8df532d72 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:55.186578 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-128df859-448e-4031-a0d7-f8f8df532d72 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:55.187666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-128df859-448e-4031-a0d7-f8f8df532d72 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:55.188350 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-128df859-448e-4031-a0d7-f8f8df532d72 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:55.189418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-128df859-448e-4031-a0d7-f8f8df532d72 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:55.389083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-35d8ac42-b327-470b-b9e5-5c00c53c83fb tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:55.409940 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-35d8ac42-b327-470b-b9e5-5c00c53c83fb tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1293 microversion: 2.1 time: 0.824564 Aug 24 10:31:55.410914 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2183/4018] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:54 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1293 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:55.419514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-ab90b16e-78f3-4092-8503-0c3230fd0c14 req-6fd99c88-6ec5-40d8-b49e-5deec0ac9ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ade0e12-9ac0-459f-8f85-6743432302fa", "name": "network-vif-deleted", "tag": "5844483e-5b42-463a-95e1-a9835141849c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:31:55.436912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ab90b16e-78f3-4092-8503-0c3230fd0c14 req-6fd99c88-6ec5-40d8-b49e-5deec0ac9ad7 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:55.438767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ab90b16e-78f3-4092-8503-0c3230fd0c14 req-6fd99c88-6ec5-40d8-b49e-5deec0ac9ad7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:55.439412 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ab90b16e-78f3-4092-8503-0c3230fd0c14 req-6fd99c88-6ec5-40d8-b49e-5deec0ac9ad7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:55.453785 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-ab90b16e-78f3-4092-8503-0c3230fd0c14 req-6fd99c88-6ec5-40d8-b49e-5deec0ac9ad7 service nova] Creating event network-vif-deleted:5844483e-5b42-463a-95e1-a9835141849c for instance 1ade0e12-9ac0-459f-8f85-6743432302fa on n-h1-849328-3 Aug 24 10:31:55.462930 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-ab90b16e-78f3-4092-8503-0c3230fd0c14 req-6fd99c88-6ec5-40d8-b49e-5deec0ac9ad7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049160 Aug 24 10:31:55.463871 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2184/4019] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:31:55.518118 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5ce8f4a3-ac82-4437-b80d-2fe951fc35f9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:55.519150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5ce8f4a3-ac82-4437-b80d-2fe951fc35f9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:55.527851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ce8f4a3-ac82-4437-b80d-2fe951fc35f9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:55.528831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ce8f4a3-ac82-4437-b80d-2fe951fc35f9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:55.529860 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ce8f4a3-ac82-4437-b80d-2fe951fc35f9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:55.530703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ce8f4a3-ac82-4437-b80d-2fe951fc35f9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:55.531248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ce8f4a3-ac82-4437-b80d-2fe951fc35f9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:55.532672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ce8f4a3-ac82-4437-b80d-2fe951fc35f9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:55.658408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-128df859-448e-4031-a0d7-f8f8df532d72 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:55.678574 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-128df859-448e-4031-a0d7-f8f8df532d72 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95" status: 200 len: 1510 microversion: 2.1 time: 0.528331 Aug 24 10:31:55.679281 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1836/4020] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:55 2022] GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95 => generated 1510 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:55.709971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1d4022f0-2662-49e2-aa58-31a95ff24e9e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1964059920", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c436d0f2-980c-499c-87fc-ff5c4aa0438d"}], "security_groups": [{"name": "tempest-securitygroup--1668317552"}], "key_name": "tempest-keypair-1659287080", "user_data": "}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:31:55.899083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-1d4022f0-2662-49e2-aa58-31a95ff24e9e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] validate_networks() for [('c436d0f2-980c-499c-87fc-ff5c4aa0438d', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:31:56.159858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5ce8f4a3-ac82-4437-b80d-2fe951fc35f9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:56.180320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5ce8f4a3-ac82-4437-b80d-2fe951fc35f9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:56.185089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5ce8f4a3-ac82-4437-b80d-2fe951fc35f9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:56.193284 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5ce8f4a3-ac82-4437-b80d-2fe951fc35f9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 2052 microversion: 2.42 time: 0.691929 Aug 24 10:31:56.198313 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2185/4021] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:31:55 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 2052 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:31:56.214962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-203cb1c1-db2c-4010-8aff-3465fecedc45 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2092922357", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "796beb17-b5f5-484d-a9eb-b33ca6b1743d"}], "security_groups": [{"name": "tempest-securitygroup--1322154044"}], "key_name": "tempest-keypair-450899703", "user_data": "}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:31:57.105905 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-1d4022f0-2662-49e2-aa58-31a95ff24e9e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:31:57.121987 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-1d4022f0-2662-49e2-aa58-31a95ff24e9e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:31:57.123616 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-203cb1c1-db2c-4010-8aff-3465fecedc45 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] validate_networks() for [('796beb17-b5f5-484d-a9eb-b33ca6b1743d', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:31:57.126998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-1d4022f0-2662-49e2-aa58-31a95ff24e9e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:31:57.127436 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-1d4022f0-2662-49e2-aa58-31a95ff24e9e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:31:57.127929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-1d4022f0-2662-49e2-aa58-31a95ff24e9e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:31:57.149711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d4022f0-2662-49e2-aa58-31a95ff24e9e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:57.150486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d4022f0-2662-49e2-aa58-31a95ff24e9e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:57.151159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d4022f0-2662-49e2-aa58-31a95ff24e9e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:57.152417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d4022f0-2662-49e2-aa58-31a95ff24e9e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:57.153325 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d4022f0-2662-49e2-aa58-31a95ff24e9e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:57.153920 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d4022f0-2662-49e2-aa58-31a95ff24e9e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:57.185795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-1d4022f0-2662-49e2-aa58-31a95ff24e9e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Getting quotas for project 3d511560c1f543169e7eab8c70c9abcd. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:31:57.196705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-1d4022f0-2662-49e2-aa58-31a95ff24e9e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Getting quotas for user 03ef6a33c1f0467993486547b7d00fda and project 3d511560c1f543169e7eab8c70c9abcd. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:31:57.214071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1d4022f0-2662-49e2-aa58-31a95ff24e9e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:31:57.217583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1d4022f0-2662-49e2-aa58-31a95ff24e9e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:31:57.291719 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1d4022f0-2662-49e2-aa58-31a95ff24e9e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.587797 Aug 24 10:31:57.293522 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1837/4022] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:31:55 2022] POST /compute/v2.1/servers => generated 409 bytes in 1591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:31:57.299179 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1278448c-82ce-47f0-b472-9ce1667d5df7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:57.300616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1278448c-82ce-47f0-b472-9ce1667d5df7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:57.310446 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1278448c-82ce-47f0-b472-9ce1667d5df7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:57.312149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1278448c-82ce-47f0-b472-9ce1667d5df7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:57.313008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1278448c-82ce-47f0-b472-9ce1667d5df7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:57.314807 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1278448c-82ce-47f0-b472-9ce1667d5df7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:57.316197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1278448c-82ce-47f0-b472-9ce1667d5df7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:57.316875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1278448c-82ce-47f0-b472-9ce1667d5df7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:57.547440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1278448c-82ce-47f0-b472-9ce1667d5df7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:57.556365 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1278448c-82ce-47f0-b472-9ce1667d5df7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1293 microversion: 2.1 time: 0.261022 Aug 24 10:31:57.556999 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1838/4023] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:57 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1293 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:57.562377 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-14d37cd0-2210-4b99-8620-6ce07fe763e5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:57.563021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-14d37cd0-2210-4b99-8620-6ce07fe763e5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 33162162-c8fe-4f85-9f88-ff2452cfab95] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:57.570355 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14d37cd0-2210-4b99-8620-6ce07fe763e5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:57.570858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14d37cd0-2210-4b99-8620-6ce07fe763e5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:57.571300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14d37cd0-2210-4b99-8620-6ce07fe763e5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:57.572030 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14d37cd0-2210-4b99-8620-6ce07fe763e5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:57.572493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14d37cd0-2210-4b99-8620-6ce07fe763e5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:57.572922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14d37cd0-2210-4b99-8620-6ce07fe763e5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:57.834778 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-14d37cd0-2210-4b99-8620-6ce07fe763e5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:57.851448 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-14d37cd0-2210-4b99-8620-6ce07fe763e5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95" status: 200 len: 1510 microversion: 2.1 time: 0.292138 Aug 24 10:31:57.872811 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1839/4024] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:57 2022] GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95 => generated 1510 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:57.888562 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6ea2b658-d447-47d0-838a-79ad21ba8d7d tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:57.889462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6ea2b658-d447-47d0-838a-79ad21ba8d7d tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:57.934427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea2b658-d447-47d0-838a-79ad21ba8d7d tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:57.935551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea2b658-d447-47d0-838a-79ad21ba8d7d tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:57.936439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea2b658-d447-47d0-838a-79ad21ba8d7d tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:57.939615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea2b658-d447-47d0-838a-79ad21ba8d7d tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:57.941381 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea2b658-d447-47d0-838a-79ad21ba8d7d tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:57.942147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea2b658-d447-47d0-838a-79ad21ba8d7d tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:58.071725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6ea2b658-d447-47d0-838a-79ad21ba8d7d tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:58.088626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6ea2b658-d447-47d0-838a-79ad21ba8d7d tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:58.090390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6ea2b658-d447-47d0-838a-79ad21ba8d7d tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:58.091866 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6ea2b658-d447-47d0-838a-79ad21ba8d7d tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1603 microversion: 2.42 time: 0.215037 Aug 24 10:31:58.108433 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1840/4025] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:31:57 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1603 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:31:58.111390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-083a2b29-06d7-4fa7-b7ea-e3c5527d6560 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:58.112042 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-083a2b29-06d7-4fa7-b7ea-e3c5527d6560 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:58.269302 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-083a2b29-06d7-4fa7-b7ea-e3c5527d6560 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:58.296137 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-083a2b29-06d7-4fa7-b7ea-e3c5527d6560 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1239 microversion: 2.1 time: 0.201868 Aug 24 10:31:58.298742 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1841/4026] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:58 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1239 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:58.310101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-12748788-5a6f-4726-803c-6994a3d25f8d req-9909c778-0f3e-49b3-ae2e-0ecdc59286ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ade0e12-9ac0-459f-8f85-6743432302fa", "name": "network-vif-deleted", "tag": "f508eefe-bb8e-440a-8dd6-3163d13f5d06"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:31:58.331911 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-12748788-5a6f-4726-803c-6994a3d25f8d req-9909c778-0f3e-49b3-ae2e-0ecdc59286ed service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:58.332981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-12748788-5a6f-4726-803c-6994a3d25f8d req-9909c778-0f3e-49b3-ae2e-0ecdc59286ed service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:58.334039 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-12748788-5a6f-4726-803c-6994a3d25f8d req-9909c778-0f3e-49b3-ae2e-0ecdc59286ed service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:58.349223 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-12748788-5a6f-4726-803c-6994a3d25f8d req-9909c778-0f3e-49b3-ae2e-0ecdc59286ed service nova] Creating event network-vif-deleted:f508eefe-bb8e-440a-8dd6-3163d13f5d06 for instance 1ade0e12-9ac0-459f-8f85-6743432302fa on n-h1-849328-3 Aug 24 10:31:58.356527 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-12748788-5a6f-4726-803c-6994a3d25f8d req-9909c778-0f3e-49b3-ae2e-0ecdc59286ed service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054291 Aug 24 10:31:58.358381 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1842/4027] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:31:58.654251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0dcfa213-bfed-4f2d-9d02-57e70e57e0a7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:58.655785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0dcfa213-bfed-4f2d-9d02-57e70e57e0a7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:58.673802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dcfa213-bfed-4f2d-9d02-57e70e57e0a7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:58.674288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dcfa213-bfed-4f2d-9d02-57e70e57e0a7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:58.674734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dcfa213-bfed-4f2d-9d02-57e70e57e0a7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:58.675456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dcfa213-bfed-4f2d-9d02-57e70e57e0a7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:58.676003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dcfa213-bfed-4f2d-9d02-57e70e57e0a7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:58.676348 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dcfa213-bfed-4f2d-9d02-57e70e57e0a7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:58.801394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:59.133914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0dcfa213-bfed-4f2d-9d02-57e70e57e0a7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:59.153030 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0dcfa213-bfed-4f2d-9d02-57e70e57e0a7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1483 microversion: 2.1 time: 0.574373 Aug 24 10:31:59.166308 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1843/4028] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:58 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1483 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:59.172972 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-370db270-b141-4d2f-8262-29b62ecb98d8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:59.173895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-370db270-b141-4d2f-8262-29b62ecb98d8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 33162162-c8fe-4f85-9f88-ff2452cfab95] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:59.186971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-370db270-b141-4d2f-8262-29b62ecb98d8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:59.192536 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-370db270-b141-4d2f-8262-29b62ecb98d8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:59.193147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-370db270-b141-4d2f-8262-29b62ecb98d8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:59.194018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-370db270-b141-4d2f-8262-29b62ecb98d8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:59.194567 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-370db270-b141-4d2f-8262-29b62ecb98d8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:59.195270 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-370db270-b141-4d2f-8262-29b62ecb98d8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:59.297702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-203cb1c1-db2c-4010-8aff-3465fecedc45 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:31:59.299132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-203cb1c1-db2c-4010-8aff-3465fecedc45 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:31:59.300187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-203cb1c1-db2c-4010-8aff-3465fecedc45 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:31:59.300938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-203cb1c1-db2c-4010-8aff-3465fecedc45 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:31:59.301829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-203cb1c1-db2c-4010-8aff-3465fecedc45 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:31:59.331260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-203cb1c1-db2c-4010-8aff-3465fecedc45 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:59.332015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-203cb1c1-db2c-4010-8aff-3465fecedc45 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:59.332680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-203cb1c1-db2c-4010-8aff-3465fecedc45 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:59.333870 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-203cb1c1-db2c-4010-8aff-3465fecedc45 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:59.334629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-203cb1c1-db2c-4010-8aff-3465fecedc45 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:59.335814 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-203cb1c1-db2c-4010-8aff-3465fecedc45 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:59.358625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-203cb1c1-db2c-4010-8aff-3465fecedc45 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Getting quotas for project 125d2dd1d22140abaa36184e3628a339. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:31:59.365746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-203cb1c1-db2c-4010-8aff-3465fecedc45 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Getting quotas for user 133e99904a6b4574933cad73d0f2293f and project 125d2dd1d22140abaa36184e3628a339. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:31:59.380920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-203cb1c1-db2c-4010-8aff-3465fecedc45 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:31:59.394382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-203cb1c1-db2c-4010-8aff-3465fecedc45 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:31:59.524376 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-203cb1c1-db2c-4010-8aff-3465fecedc45 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.324570 Aug 24 10:31:59.525886 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2186/4029] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:31:56 2022] POST /compute/v2.1/servers => generated 409 bytes in 3327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:31:59.533038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0a37383d-f0cc-45e3-983f-1615a28c64ed tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:59.533896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0a37383d-f0cc-45e3-983f-1615a28c64ed tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:59.543208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a37383d-f0cc-45e3-983f-1615a28c64ed tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:59.544344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a37383d-f0cc-45e3-983f-1615a28c64ed tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:59.545017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a37383d-f0cc-45e3-983f-1615a28c64ed tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:59.546296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a37383d-f0cc-45e3-983f-1615a28c64ed tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:59.547474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a37383d-f0cc-45e3-983f-1615a28c64ed tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:59.548161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a37383d-f0cc-45e3-983f-1615a28c64ed tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:59.995819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0a37383d-f0cc-45e3-983f-1615a28c64ed tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:00.024945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0a37383d-f0cc-45e3-983f-1615a28c64ed tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:00.026683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0a37383d-f0cc-45e3-983f-1615a28c64ed tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:00.040505 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0a37383d-f0cc-45e3-983f-1615a28c64ed tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1603 microversion: 2.42 time: 0.509120 Aug 24 10:32:00.045378 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2187/4030] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:31:59 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1603 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:32:00.070989 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6dc8ac7b-2c18-4772-80d9-b53d94ad7afa tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:00.071516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6dc8ac7b-2c18-4772-80d9-b53d94ad7afa tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:00.088126 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dc8ac7b-2c18-4772-80d9-b53d94ad7afa tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:00.089195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dc8ac7b-2c18-4772-80d9-b53d94ad7afa tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:00.089672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dc8ac7b-2c18-4772-80d9-b53d94ad7afa tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:00.095202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dc8ac7b-2c18-4772-80d9-b53d94ad7afa tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:00.097295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dc8ac7b-2c18-4772-80d9-b53d94ad7afa tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:00.100368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dc8ac7b-2c18-4772-80d9-b53d94ad7afa tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:00.266113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-370db270-b141-4d2f-8262-29b62ecb98d8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:00.274970 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-370db270-b141-4d2f-8262-29b62ecb98d8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95" status: 200 len: 1510 microversion: 2.1 time: 1.106876 Aug 24 10:32:00.280970 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1844/4031] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:59 2022] GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95 => generated 1510 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:00.286613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ccb930d4-d357-4f84-8db0-dc865f9eca19 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:00.292292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ccb930d4-d357-4f84-8db0-dc865f9eca19 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:00.315635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccb930d4-d357-4f84-8db0-dc865f9eca19 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:00.324204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccb930d4-d357-4f84-8db0-dc865f9eca19 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:00.326601 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccb930d4-d357-4f84-8db0-dc865f9eca19 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:00.327543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccb930d4-d357-4f84-8db0-dc865f9eca19 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:00.334741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccb930d4-d357-4f84-8db0-dc865f9eca19 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:00.342172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccb930d4-d357-4f84-8db0-dc865f9eca19 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:00.395133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:00.626270 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ccb930d4-d357-4f84-8db0-dc865f9eca19 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:00.643683 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ccb930d4-d357-4f84-8db0-dc865f9eca19 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1297 microversion: 2.1 time: 0.361050 Aug 24 10:32:00.644421 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1845/4032] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:00 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1297 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:00.654562 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8a0a29aa-3832-4d75-9097-d4c3be8dfe5c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:00.655184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8a0a29aa-3832-4d75-9097-d4c3be8dfe5c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:00.667748 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6dc8ac7b-2c18-4772-80d9-b53d94ad7afa tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.607744 Aug 24 10:32:00.669714 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2188/4033] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Aug 24 10:32:00 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85/os-interface => generated 284 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:32:00.676842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-86c55b40-0391-441d-bcdf-68bdb8711dd9 req-20474c40-a2c3-4b07-9fde-a39f72851d26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33162162-c8fe-4f85-9f88-ff2452cfab95", "name": "network-vif-deleted", "tag": "10ec4bfa-c821-4178-b513-2e59038da6f4"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:00.727967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-86c55b40-0391-441d-bcdf-68bdb8711dd9 req-20474c40-a2c3-4b07-9fde-a39f72851d26 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:00.731487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-86c55b40-0391-441d-bcdf-68bdb8711dd9 req-20474c40-a2c3-4b07-9fde-a39f72851d26 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:00.733025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-86c55b40-0391-441d-bcdf-68bdb8711dd9 req-20474c40-a2c3-4b07-9fde-a39f72851d26 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:00.773389 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-86c55b40-0391-441d-bcdf-68bdb8711dd9 req-20474c40-a2c3-4b07-9fde-a39f72851d26 service nova] Creating event network-vif-deleted:10ec4bfa-c821-4178-b513-2e59038da6f4 for instance 33162162-c8fe-4f85-9f88-ff2452cfab95 on n-h2-849328-3 Aug 24 10:32:00.791259 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-86c55b40-0391-441d-bcdf-68bdb8711dd9 req-20474c40-a2c3-4b07-9fde-a39f72851d26 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115636 Aug 24 10:32:00.794091 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2189/4034] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:32:01.010018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8a0a29aa-3832-4d75-9097-d4c3be8dfe5c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:01.031498 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8a0a29aa-3832-4d75-9097-d4c3be8dfe5c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1245 microversion: 2.1 time: 0.380891 Aug 24 10:32:01.045653 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1846/4035] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:00 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1245 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:01.075421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-94be67f9-3660-4d82-a7c6-8aefd4d1a786 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:01.076383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-94be67f9-3660-4d82-a7c6-8aefd4d1a786 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:01.091291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94be67f9-3660-4d82-a7c6-8aefd4d1a786 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:01.095788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94be67f9-3660-4d82-a7c6-8aefd4d1a786 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:01.097677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94be67f9-3660-4d82-a7c6-8aefd4d1a786 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:01.098580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94be67f9-3660-4d82-a7c6-8aefd4d1a786 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:01.101083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94be67f9-3660-4d82-a7c6-8aefd4d1a786 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:01.101888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94be67f9-3660-4d82-a7c6-8aefd4d1a786 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:01.296785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aea40f9c-488a-4686-9856-4c4c86384c47 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:01.300895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aea40f9c-488a-4686-9856-4c4c86384c47 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 33162162-c8fe-4f85-9f88-ff2452cfab95] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:01.320097 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aea40f9c-488a-4686-9856-4c4c86384c47 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:01.321444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aea40f9c-488a-4686-9856-4c4c86384c47 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:01.334041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aea40f9c-488a-4686-9856-4c4c86384c47 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:01.335327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aea40f9c-488a-4686-9856-4c4c86384c47 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:01.335987 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aea40f9c-488a-4686-9856-4c4c86384c47 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:01.336639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aea40f9c-488a-4686-9856-4c4c86384c47 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:01.357831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-94be67f9-3660-4d82-a7c6-8aefd4d1a786 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:01.379888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-94be67f9-3660-4d82-a7c6-8aefd4d1a786 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:01.387628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-94be67f9-3660-4d82-a7c6-8aefd4d1a786 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:01.389375 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-94be67f9-3660-4d82-a7c6-8aefd4d1a786 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1603 microversion: 2.42 time: 0.318690 Aug 24 10:32:01.390112 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2190/4036] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:32:01 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1603 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:32:01.436014 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aea40f9c-488a-4686-9856-4c4c86384c47 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:01.443399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aea40f9c-488a-4686-9856-4c4c86384c47 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:01.447412 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aea40f9c-488a-4686-9856-4c4c86384c47 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:01.448387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-aea40f9c-488a-4686-9856-4c4c86384c47 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lazy-loading 'fault' on Instance uuid 33162162-c8fe-4f85-9f88-ff2452cfab95 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:32:01.666226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-beac011f-fda2-4ddb-9049-6cff57e39b8e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:01.666964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-beac011f-fda2-4ddb-9049-6cff57e39b8e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:01.685253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:01.713778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-beac011f-fda2-4ddb-9049-6cff57e39b8e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:01.714419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-beac011f-fda2-4ddb-9049-6cff57e39b8e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:01.715505 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-beac011f-fda2-4ddb-9049-6cff57e39b8e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:01.717160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-beac011f-fda2-4ddb-9049-6cff57e39b8e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:01.720429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-beac011f-fda2-4ddb-9049-6cff57e39b8e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:01.720992 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-beac011f-fda2-4ddb-9049-6cff57e39b8e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:01.909577 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-beac011f-fda2-4ddb-9049-6cff57e39b8e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:01.940866 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-beac011f-fda2-4ddb-9049-6cff57e39b8e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1297 microversion: 2.1 time: 0.280547 Aug 24 10:32:01.945954 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2191/4037] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:01 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1297 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:01.965268 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aea40f9c-488a-4686-9856-4c4c86384c47 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:01.986591 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aea40f9c-488a-4686-9856-4c4c86384c47 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95" status: 200 len: 1306 microversion: 2.1 time: 0.694206 Aug 24 10:32:01.987209 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1847/4038] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:01 2022] GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95 => generated 1306 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:02.060327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d66da8bb-9257-4df0-906f-d9f66cf93d1b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:02.061283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d66da8bb-9257-4df0-906f-d9f66cf93d1b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:02.072728 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d66da8bb-9257-4df0-906f-d9f66cf93d1b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:02.073625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d66da8bb-9257-4df0-906f-d9f66cf93d1b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:02.074353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d66da8bb-9257-4df0-906f-d9f66cf93d1b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:02.075320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d66da8bb-9257-4df0-906f-d9f66cf93d1b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:02.076003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d66da8bb-9257-4df0-906f-d9f66cf93d1b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:02.077149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d66da8bb-9257-4df0-906f-d9f66cf93d1b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:02.279565 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d66da8bb-9257-4df0-906f-d9f66cf93d1b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:02.299216 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d66da8bb-9257-4df0-906f-d9f66cf93d1b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1297 microversion: 2.1 time: 0.242738 Aug 24 10:32:02.316987 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2192/4039] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:02 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1297 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:02.414741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d3b59c95-c622-485a-befc-61f162bf8e05 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:02.415616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d3b59c95-c622-485a-befc-61f162bf8e05 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:02.432324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3b59c95-c622-485a-befc-61f162bf8e05 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:02.432825 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3b59c95-c622-485a-befc-61f162bf8e05 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:02.436236 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3b59c95-c622-485a-befc-61f162bf8e05 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:02.437267 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3b59c95-c622-485a-befc-61f162bf8e05 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:02.438991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3b59c95-c622-485a-befc-61f162bf8e05 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:02.448809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3b59c95-c622-485a-befc-61f162bf8e05 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:02.832680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d3b59c95-c622-485a-befc-61f162bf8e05 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:02.846251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d3b59c95-c622-485a-befc-61f162bf8e05 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:02.848320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d3b59c95-c622-485a-befc-61f162bf8e05 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:02.863950 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d3b59c95-c622-485a-befc-61f162bf8e05 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1603 microversion: 2.42 time: 0.452997 Aug 24 10:32:02.865014 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1848/4040] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:32:02 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1603 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:32:02.985063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e2614880-6620-4b1d-b8ca-2268897226f0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:02.988822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e2614880-6620-4b1d-b8ca-2268897226f0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:03.008963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ecba9dca-482e-40bd-8bb0-2c263acadbc1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:03.009847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ecba9dca-482e-40bd-8bb0-2c263acadbc1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 33162162-c8fe-4f85-9f88-ff2452cfab95] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:03.053091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecba9dca-482e-40bd-8bb0-2c263acadbc1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:03.053796 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecba9dca-482e-40bd-8bb0-2c263acadbc1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:03.054588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecba9dca-482e-40bd-8bb0-2c263acadbc1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:03.055510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecba9dca-482e-40bd-8bb0-2c263acadbc1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:03.055953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecba9dca-482e-40bd-8bb0-2c263acadbc1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:03.056528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecba9dca-482e-40bd-8bb0-2c263acadbc1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:03.066282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2614880-6620-4b1d-b8ca-2268897226f0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:03.066893 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2614880-6620-4b1d-b8ca-2268897226f0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:03.067492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2614880-6620-4b1d-b8ca-2268897226f0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:03.087345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2614880-6620-4b1d-b8ca-2268897226f0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:03.088100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2614880-6620-4b1d-b8ca-2268897226f0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:03.088686 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2614880-6620-4b1d-b8ca-2268897226f0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:03.141440 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-ecba9dca-482e-40bd-8bb0-2c263acadbc1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ecba9dca-482e-40bd-8bb0-2c263acadbc1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95 HTTP/1.1 Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '33162162-c8fe-4f85-9f88-ff2452cfab95'} Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:03.150000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:03.154432 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:03.154432 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:03.154432 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:03.154432 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:32:03.154432 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:32:03.154432 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. Aug 24 10:32:03.154432 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:03.156277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ecba9dca-482e-40bd-8bb0-2c263acadbc1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 404 to user: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:03.157405 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ecba9dca-482e-40bd-8bb0-2c263acadbc1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95" status: 404 len: 111 microversion: 2.1 time: 0.153693 Aug 24 10:32:03.162870 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1849/4041] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:03 2022] GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:32:03.168535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4fb1081e-7f22-4509-9ec0-ae48626aa4e9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:03.169634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4fb1081e-7f22-4509-9ec0-ae48626aa4e9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:03.186887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fb1081e-7f22-4509-9ec0-ae48626aa4e9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:03.203127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fb1081e-7f22-4509-9ec0-ae48626aa4e9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:03.204013 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fb1081e-7f22-4509-9ec0-ae48626aa4e9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:03.214514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fb1081e-7f22-4509-9ec0-ae48626aa4e9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:03.216414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fb1081e-7f22-4509-9ec0-ae48626aa4e9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:03.217069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fb1081e-7f22-4509-9ec0-ae48626aa4e9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:03.527303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e2614880-6620-4b1d-b8ca-2268897226f0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:03.542102 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e2614880-6620-4b1d-b8ca-2268897226f0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1297 microversion: 2.1 time: 0.558805 Aug 24 10:32:03.543173 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2193/4042] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:02 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1297 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:03.559027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-90df91e7-396c-430b-94f4-5970c3c4dde5 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:03.559981 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-90df91e7-396c-430b-94f4-5970c3c4dde5 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:03.579963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90df91e7-396c-430b-94f4-5970c3c4dde5 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:03.581868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90df91e7-396c-430b-94f4-5970c3c4dde5 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:03.583692 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90df91e7-396c-430b-94f4-5970c3c4dde5 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:03.586137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90df91e7-396c-430b-94f4-5970c3c4dde5 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:03.586801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90df91e7-396c-430b-94f4-5970c3c4dde5 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:03.588024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90df91e7-396c-430b-94f4-5970c3c4dde5 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:03.774919 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4fb1081e-7f22-4509-9ec0-ae48626aa4e9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:03.784661 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4fb1081e-7f22-4509-9ec0-ae48626aa4e9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.620400 Aug 24 10:32:03.810880 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1850/4043] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:03 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:03.893990 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-05495f68-6fc1-4aa7-9ad2-8c44cb95724e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:03.895342 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-05495f68-6fc1-4aa7-9ad2-8c44cb95724e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:03.910699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05495f68-6fc1-4aa7-9ad2-8c44cb95724e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:03.911413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05495f68-6fc1-4aa7-9ad2-8c44cb95724e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:03.914200 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05495f68-6fc1-4aa7-9ad2-8c44cb95724e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:03.915415 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05495f68-6fc1-4aa7-9ad2-8c44cb95724e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:03.916064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05495f68-6fc1-4aa7-9ad2-8c44cb95724e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:03.918966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05495f68-6fc1-4aa7-9ad2-8c44cb95724e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:04.205749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-05495f68-6fc1-4aa7-9ad2-8c44cb95724e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:04.220115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-05495f68-6fc1-4aa7-9ad2-8c44cb95724e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:04.221676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-05495f68-6fc1-4aa7-9ad2-8c44cb95724e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:04.222932 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-05495f68-6fc1-4aa7-9ad2-8c44cb95724e tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1603 microversion: 2.42 time: 0.333812 Aug 24 10:32:04.223900 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1851/4044] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:32:03 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1603 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:32:04.237553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-90df91e7-396c-430b-94f4-5970c3c4dde5 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:04.259259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4b4a358f-a61f-473a-8005-452c8ece7d6b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:04.259987 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-90df91e7-396c-430b-94f4-5970c3c4dde5 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1303 microversion: 2.1 time: 0.715087 Aug 24 10:32:04.260965 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2194/4045] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:03 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1303 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4b4a358f-a61f-473a-8005-452c8ece7d6b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 163 Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: {"server": {"name": 12345, "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d"}]}} Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af', 'flavorRef': '452', 'networks': [{'uuid': 'ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d'}]}}} Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 12345 Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:32:04.264282 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:32:04.270173 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:32:04.270173 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 24 10:32:04.270173 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:04.270173 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:04.270173 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:04.270173 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:04.270173 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:04.270173 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:04.270173 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:32:04.270173 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:32:04.270173 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 24 10:32:04.270173 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:04.286090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4b4a358f-a61f-473a-8005-452c8ece7d6b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:04.289475 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4b4a358f-a61f-473a-8005-452c8ece7d6b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.041905 Aug 24 10:32:04.300486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b9dda1f4-cefe-412f-839d-28486cff3c73 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:04.301234 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1852/4046] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:32:04 2022] POST /compute/v2.1/servers => generated 127 bytes in 77 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:32:04.301728 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b9dda1f4-cefe-412f-839d-28486cff3c73 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:04.328030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9dda1f4-cefe-412f-839d-28486cff3c73 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:04.328794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9dda1f4-cefe-412f-839d-28486cff3c73 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:04.329422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9dda1f4-cefe-412f-839d-28486cff3c73 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:04.332095 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9dda1f4-cefe-412f-839d-28486cff3c73 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:04.332772 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9dda1f4-cefe-412f-839d-28486cff3c73 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:04.333625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9dda1f4-cefe-412f-839d-28486cff3c73 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:04.571113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-66a13446-60f7-4dfd-ac4a-b31a13448114 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:04.572956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-66a13446-60f7-4dfd-ac4a-b31a13448114 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:04.609585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66a13446-60f7-4dfd-ac4a-b31a13448114 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:04.615188 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66a13446-60f7-4dfd-ac4a-b31a13448114 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:04.616438 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66a13446-60f7-4dfd-ac4a-b31a13448114 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:04.618963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66a13446-60f7-4dfd-ac4a-b31a13448114 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:04.619956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66a13446-60f7-4dfd-ac4a-b31a13448114 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:04.621458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66a13446-60f7-4dfd-ac4a-b31a13448114 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:05.561434 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-66a13446-60f7-4dfd-ac4a-b31a13448114 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:05.572700 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-66a13446-60f7-4dfd-ac4a-b31a13448114 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1365 microversion: 2.1 time: 1.012088 Aug 24 10:32:05.592291 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1853/4047] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:04 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1365 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:05.604115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6c770e24-c083-42a1-bee6-3ff2971880b2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:05.605014 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6c770e24-c083-42a1-bee6-3ff2971880b2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:05.623936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c770e24-c083-42a1-bee6-3ff2971880b2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:05.624840 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c770e24-c083-42a1-bee6-3ff2971880b2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:05.625554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c770e24-c083-42a1-bee6-3ff2971880b2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:05.626651 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c770e24-c083-42a1-bee6-3ff2971880b2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:05.627325 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c770e24-c083-42a1-bee6-3ff2971880b2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:05.627988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c770e24-c083-42a1-bee6-3ff2971880b2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:05.785261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6c770e24-c083-42a1-bee6-3ff2971880b2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:05.809331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6c770e24-c083-42a1-bee6-3ff2971880b2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:05.810871 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6c770e24-c083-42a1-bee6-3ff2971880b2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:05.812534 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6c770e24-c083-42a1-bee6-3ff2971880b2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1603 microversion: 2.42 time: 0.218331 Aug 24 10:32:05.815057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b9dda1f4-cefe-412f-839d-28486cff3c73 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:05.821314 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1854/4048] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:32:05 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1603 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:32:05.834546 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b9dda1f4-cefe-412f-839d-28486cff3c73 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 1.539722 Aug 24 10:32:05.836312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-516d57ed-53f8-4dc7-a5ce-832427d34354 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:05.836873 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2195/4049] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:04 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:32:05.838061 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-516d57ed-53f8-4dc7-a5ce-832427d34354 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:05.860233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9d904941-5fc0-4d46-93be-bb7274e3ebef tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:05.861971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-516d57ed-53f8-4dc7-a5ce-832427d34354 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:05.864277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-516d57ed-53f8-4dc7-a5ce-832427d34354 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:05.864808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9d904941-5fc0-4d46-93be-bb7274e3ebef tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:05.867042 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-516d57ed-53f8-4dc7-a5ce-832427d34354 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:05.870566 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-516d57ed-53f8-4dc7-a5ce-832427d34354 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:05.872718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-516d57ed-53f8-4dc7-a5ce-832427d34354 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:05.873323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-516d57ed-53f8-4dc7-a5ce-832427d34354 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:05.884989 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d904941-5fc0-4d46-93be-bb7274e3ebef tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:05.889025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d904941-5fc0-4d46-93be-bb7274e3ebef tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:05.890354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d904941-5fc0-4d46-93be-bb7274e3ebef tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:05.892978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d904941-5fc0-4d46-93be-bb7274e3ebef tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:05.894271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d904941-5fc0-4d46-93be-bb7274e3ebef tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:05.896808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d904941-5fc0-4d46-93be-bb7274e3ebef tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:06.032824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-516d57ed-53f8-4dc7-a5ce-832427d34354 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:06.044056 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-516d57ed-53f8-4dc7-a5ce-832427d34354 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1303 microversion: 2.1 time: 0.219660 Aug 24 10:32:06.059863 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1855/4050] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:05 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1303 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:06.065717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c8748bdf-8936-4f98-b0ce-b252b418863f req-056be581-90b8-419e-8382-5d455ecf3ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d82e58b9-780c-4deb-80e3-acf4911c7c85", "tag": "1559d343-8448-4e13-92be-96efcc09b44a"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:06.077292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c8748bdf-8936-4f98-b0ce-b252b418863f req-056be581-90b8-419e-8382-5d455ecf3ca5 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:06.080594 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c8748bdf-8936-4f98-b0ce-b252b418863f req-056be581-90b8-419e-8382-5d455ecf3ca5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:06.081454 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c8748bdf-8936-4f98-b0ce-b252b418863f req-056be581-90b8-419e-8382-5d455ecf3ca5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:06.121033 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c8748bdf-8936-4f98-b0ce-b252b418863f req-056be581-90b8-419e-8382-5d455ecf3ca5 service nova] Creating event network-changed:1559d343-8448-4e13-92be-96efcc09b44a for instance d82e58b9-780c-4deb-80e3-acf4911c7c85 on n-h2-849328-3 Aug 24 10:32:06.135198 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c8748bdf-8936-4f98-b0ce-b252b418863f req-056be581-90b8-419e-8382-5d455ecf3ca5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073496 Aug 24 10:32:06.137109 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1856/4051] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:32:06.166910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-84c88de7-2f53-4880-af03-ac92f81d1637 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:06.168901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-84c88de7-2f53-4880-af03-ac92f81d1637 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:06.186255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84c88de7-2f53-4880-af03-ac92f81d1637 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:06.192224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84c88de7-2f53-4880-af03-ac92f81d1637 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:06.192940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84c88de7-2f53-4880-af03-ac92f81d1637 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:06.193930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84c88de7-2f53-4880-af03-ac92f81d1637 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:06.194580 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84c88de7-2f53-4880-af03-ac92f81d1637 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:06.195939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84c88de7-2f53-4880-af03-ac92f81d1637 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:07.170687 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:07.302791 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-84c88de7-2f53-4880-af03-ac92f81d1637 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:07.324984 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-84c88de7-2f53-4880-af03-ac92f81d1637 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 1.185712 Aug 24 10:32:07.330588 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1857/4052] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:06 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:07.351502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9d904941-5fc0-4d46-93be-bb7274e3ebef tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:07.354854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-14ee214d-9668-4874-a60a-8e8c7f9b9255 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:07.355822 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-14ee214d-9668-4874-a60a-8e8c7f9b9255 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:07.368348 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9d904941-5fc0-4d46-93be-bb7274e3ebef tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1483 microversion: 2.1 time: 1.527211 Aug 24 10:32:07.369423 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2196/4053] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:05 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1483 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:07.383253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fa056f69-aa25-4dac-b062-5263ca7ae544 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:07.384206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fa056f69-aa25-4dac-b062-5263ca7ae544 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:07.397505 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa056f69-aa25-4dac-b062-5263ca7ae544 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:07.399744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14ee214d-9668-4874-a60a-8e8c7f9b9255 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:07.400255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14ee214d-9668-4874-a60a-8e8c7f9b9255 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:07.400693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14ee214d-9668-4874-a60a-8e8c7f9b9255 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:07.401135 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa056f69-aa25-4dac-b062-5263ca7ae544 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:07.404529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa056f69-aa25-4dac-b062-5263ca7ae544 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:07.405580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa056f69-aa25-4dac-b062-5263ca7ae544 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:07.406205 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa056f69-aa25-4dac-b062-5263ca7ae544 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:07.407633 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14ee214d-9668-4874-a60a-8e8c7f9b9255 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:07.408761 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa056f69-aa25-4dac-b062-5263ca7ae544 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:07.412561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14ee214d-9668-4874-a60a-8e8c7f9b9255 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:07.413091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14ee214d-9668-4874-a60a-8e8c7f9b9255 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:08.038436 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-14ee214d-9668-4874-a60a-8e8c7f9b9255 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:08.048883 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-14ee214d-9668-4874-a60a-8e8c7f9b9255 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1365 microversion: 2.1 time: 0.712519 Aug 24 10:32:08.064094 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1858/4054] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:07 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1365 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:08.070245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bc3df2e8-b5f2-4ec1-849a-d301cf106398 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:08.070883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bc3df2e8-b5f2-4ec1-849a-d301cf106398 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:08.082868 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc3df2e8-b5f2-4ec1-849a-d301cf106398 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:08.098477 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc3df2e8-b5f2-4ec1-849a-d301cf106398 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:08.106125 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc3df2e8-b5f2-4ec1-849a-d301cf106398 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:08.107404 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc3df2e8-b5f2-4ec1-849a-d301cf106398 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:08.108180 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc3df2e8-b5f2-4ec1-849a-d301cf106398 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:08.108981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc3df2e8-b5f2-4ec1-849a-d301cf106398 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:08.167005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fa056f69-aa25-4dac-b062-5263ca7ae544 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:08.223855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fa056f69-aa25-4dac-b062-5263ca7ae544 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:08.232263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fa056f69-aa25-4dac-b062-5263ca7ae544 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:08.245676 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fa056f69-aa25-4dac-b062-5263ca7ae544 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1603 microversion: 2.42 time: 0.870827 Aug 24 10:32:08.256693 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2197/4055] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:32:07 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1603 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:32:09.009220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bc3df2e8-b5f2-4ec1-849a-d301cf106398 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:09.030080 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bc3df2e8-b5f2-4ec1-849a-d301cf106398 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1371 microversion: 2.1 time: 0.964164 Aug 24 10:32:09.032487 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1859/4056] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:08 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1371 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:09.080038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-da934e36-d5fb-4b9d-abd5-74e921746255 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:09.090055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-da934e36-d5fb-4b9d-abd5-74e921746255 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:09.145733 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da934e36-d5fb-4b9d-abd5-74e921746255 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:09.146418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da934e36-d5fb-4b9d-abd5-74e921746255 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:09.146960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da934e36-d5fb-4b9d-abd5-74e921746255 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:09.147781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da934e36-d5fb-4b9d-abd5-74e921746255 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:09.148475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da934e36-d5fb-4b9d-abd5-74e921746255 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:09.149064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da934e36-d5fb-4b9d-abd5-74e921746255 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:09.286331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a83f1608-9d80-4d89-9751-c6bfda2f96d2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:09.287248 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a83f1608-9d80-4d89-9751-c6bfda2f96d2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:09.300486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a83f1608-9d80-4d89-9751-c6bfda2f96d2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:09.301356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a83f1608-9d80-4d89-9751-c6bfda2f96d2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:09.301997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a83f1608-9d80-4d89-9751-c6bfda2f96d2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:09.302926 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a83f1608-9d80-4d89-9751-c6bfda2f96d2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:09.304892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a83f1608-9d80-4d89-9751-c6bfda2f96d2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:09.307091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a83f1608-9d80-4d89-9751-c6bfda2f96d2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:09.347780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:09.375740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:09.502284 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a83f1608-9d80-4d89-9751-c6bfda2f96d2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:09.524967 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a83f1608-9d80-4d89-9751-c6bfda2f96d2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:09.530535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a83f1608-9d80-4d89-9751-c6bfda2f96d2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:09.534344 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a83f1608-9d80-4d89-9751-c6bfda2f96d2 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1603 microversion: 2.42 time: 0.252661 Aug 24 10:32:09.535262 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1860/4057] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:32:09 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1603 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:32:10.062170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da934e36-d5fb-4b9d-abd5-74e921746255 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:10.089650 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-da934e36-d5fb-4b9d-abd5-74e921746255 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1365 microversion: 2.1 time: 1.018206 Aug 24 10:32:10.102647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-aa987a46-2985-46fd-b7ca-2b90ec6dea52 req-0a04d13f-64db-4007-b535-767390c8a73b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99ed6211-b7fc-454f-a8e9-73ba571a71af", "tag": "1c2608cb-c0ff-45d5-b7c5-82ff95cc5b0c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:10.114011 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2198/4058] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:09 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1365 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:10.130610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5f639fbc-61ab-4d43-89cd-aea0b63280f3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:10.131839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5f639fbc-61ab-4d43-89cd-aea0b63280f3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:10.141703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-aa987a46-2985-46fd-b7ca-2b90ec6dea52 req-0a04d13f-64db-4007-b535-767390c8a73b service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:10.143663 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-aa987a46-2985-46fd-b7ca-2b90ec6dea52 req-0a04d13f-64db-4007-b535-767390c8a73b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:10.146917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-aa987a46-2985-46fd-b7ca-2b90ec6dea52 req-0a04d13f-64db-4007-b535-767390c8a73b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:10.152892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f639fbc-61ab-4d43-89cd-aea0b63280f3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:10.163495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f639fbc-61ab-4d43-89cd-aea0b63280f3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:10.164492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f639fbc-61ab-4d43-89cd-aea0b63280f3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:10.171523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f639fbc-61ab-4d43-89cd-aea0b63280f3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:10.172609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f639fbc-61ab-4d43-89cd-aea0b63280f3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:10.173685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f639fbc-61ab-4d43-89cd-aea0b63280f3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:10.215823 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-aa987a46-2985-46fd-b7ca-2b90ec6dea52 req-0a04d13f-64db-4007-b535-767390c8a73b service nova] Creating event network-changed:1c2608cb-c0ff-45d5-b7c5-82ff95cc5b0c for instance 99ed6211-b7fc-454f-a8e9-73ba571a71af on n-h1-849328-3 Aug 24 10:32:10.223484 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-aa987a46-2985-46fd-b7ca-2b90ec6dea52 req-0a04d13f-64db-4007-b535-767390c8a73b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.515415 Aug 24 10:32:10.224754 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1861/4059] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:32:10.554383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5f639fbc-61ab-4d43-89cd-aea0b63280f3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:10.564494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0773616e-ae10-47ad-a938-ae4c5d553bd3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:10.565336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0773616e-ae10-47ad-a938-ae4c5d553bd3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:10.569656 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5f639fbc-61ab-4d43-89cd-aea0b63280f3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1371 microversion: 2.1 time: 0.449205 Aug 24 10:32:10.571096 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2199/4060] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:10 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1371 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:10.587396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0773616e-ae10-47ad-a938-ae4c5d553bd3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:10.587775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0773616e-ae10-47ad-a938-ae4c5d553bd3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:10.591017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0773616e-ae10-47ad-a938-ae4c5d553bd3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:10.591902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0773616e-ae10-47ad-a938-ae4c5d553bd3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:10.595922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0773616e-ae10-47ad-a938-ae4c5d553bd3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:10.596392 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0773616e-ae10-47ad-a938-ae4c5d553bd3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:10.738397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0773616e-ae10-47ad-a938-ae4c5d553bd3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:10.753801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0773616e-ae10-47ad-a938-ae4c5d553bd3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:10.755647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0773616e-ae10-47ad-a938-ae4c5d553bd3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:10.756961 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0773616e-ae10-47ad-a938-ae4c5d553bd3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1603 microversion: 2.42 time: 0.197313 Aug 24 10:32:10.761898 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1862/4061] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:32:10 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1603 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:32:10.908102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-67f52d38-333c-4ae0-8626-38d788986a1a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-936657905", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "6422a7a2-4142-4f61-a795-526298493aca", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:11.060410 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-67f52d38-333c-4ae0-8626-38d788986a1a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Block Device 6422a7a2-4142-4f61-a795-526298493aca is not bootable. Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-67f52d38-333c-4ae0-8626-38d788986a1a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 357 Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-936657905", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "6422a7a2-4142-4f61-a795-526298493aca", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d"}]}} Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: exception: Block Device 6422a7a2-4142-4f61-a795-526298493aca is not bootable. Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-936657905', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '6422a7a2-4142-4f61-a795-526298493aca'}], 'networks': [{'uuid': 'ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d'}]}}} Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1659, in _create_instance Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 6422a7a2-4142-4f61-a795-526298493aca is not bootable. Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:11.068199 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:11.072247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:11.072247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:11.072247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:11.072247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 10:32:11.072247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 24 10:32:11.072247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 24 10:32:11.072247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 6422a7a2-4142-4f61-a795-526298493aca is not bootable. Aug 24 10:32:11.072247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:11.072247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:11.072247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:11.072247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:11.072247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:11.072247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:11.072247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:32:11.072247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:32:11.072247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 6422a7a2-4142-4f61-a795-526298493aca is not bootable. Aug 24 10:32:11.072247 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:11.072247 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-67f52d38-333c-4ae0-8626-38d788986a1a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 400 to user: Block Device 6422a7a2-4142-4f61-a795-526298493aca is not bootable. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:11.072247 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-67f52d38-333c-4ae0-8626-38d788986a1a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.166391 Aug 24 10:32:11.072247 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2200/4062] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:32:10 2022] POST /compute/v2.1/servers => generated 110 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:32:11.079460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0b79ce67-0482-4805-ad94-9db50002a0c5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:11.080095 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0b79ce67-0482-4805-ad94-9db50002a0c5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:11.082254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=10 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:11.101060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b79ce67-0482-4805-ad94-9db50002a0c5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:11.101656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b79ce67-0482-4805-ad94-9db50002a0c5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:11.102060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b79ce67-0482-4805-ad94-9db50002a0c5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:11.119273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7a0c1054-8963-4792-a006-9c9392af8826 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:11.128863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7a0c1054-8963-4792-a006-9c9392af8826 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:11.129856 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b79ce67-0482-4805-ad94-9db50002a0c5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:11.134991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b79ce67-0482-4805-ad94-9db50002a0c5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:11.136094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b79ce67-0482-4805-ad94-9db50002a0c5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:11.147347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a0c1054-8963-4792-a006-9c9392af8826 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:11.161936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a0c1054-8963-4792-a006-9c9392af8826 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:11.162663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a0c1054-8963-4792-a006-9c9392af8826 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:11.163572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a0c1054-8963-4792-a006-9c9392af8826 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:11.165403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a0c1054-8963-4792-a006-9c9392af8826 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:11.173769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a0c1054-8963-4792-a006-9c9392af8826 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:11.714770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0b79ce67-0482-4805-ad94-9db50002a0c5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:11.742499 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0b79ce67-0482-4805-ad94-9db50002a0c5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.652793 Aug 24 10:32:11.745414 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1863/4063] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:11 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:11.766802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c3988c0b-b18f-4ba2-a3ef-4d2f6923f33f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:11.769348 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c3988c0b-b18f-4ba2-a3ef-4d2f6923f33f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:11.782476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7a0c1054-8963-4792-a006-9c9392af8826 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:11.789606 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3988c0b-b18f-4ba2-a3ef-4d2f6923f33f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:11.791490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:11.793823 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3988c0b-b18f-4ba2-a3ef-4d2f6923f33f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:11.794048 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7a0c1054-8963-4792-a006-9c9392af8826 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1365 microversion: 2.1 time: 0.682896 Aug 24 10:32:11.796028 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2201/4064] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:11 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1365 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:32:11.798224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3988c0b-b18f-4ba2-a3ef-4d2f6923f33f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:11.799519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3988c0b-b18f-4ba2-a3ef-4d2f6923f33f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:11.800836 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3988c0b-b18f-4ba2-a3ef-4d2f6923f33f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:11.801528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3988c0b-b18f-4ba2-a3ef-4d2f6923f33f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:11.839211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ece9c2a5-d554-4bda-8e2a-9c36e04db030 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:11.839544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ece9c2a5-d554-4bda-8e2a-9c36e04db030 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:11.859465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ece9c2a5-d554-4bda-8e2a-9c36e04db030 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:11.870269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ece9c2a5-d554-4bda-8e2a-9c36e04db030 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:11.870933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ece9c2a5-d554-4bda-8e2a-9c36e04db030 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:11.871830 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ece9c2a5-d554-4bda-8e2a-9c36e04db030 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:11.872458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ece9c2a5-d554-4bda-8e2a-9c36e04db030 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:11.872904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ece9c2a5-d554-4bda-8e2a-9c36e04db030 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:12.193523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c3988c0b-b18f-4ba2-a3ef-4d2f6923f33f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:12.213407 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c3988c0b-b18f-4ba2-a3ef-4d2f6923f33f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1371 microversion: 2.1 time: 0.461433 Aug 24 10:32:12.215443 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1864/4065] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:11 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1371 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:12.235092 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92c8e803-1265-413c-a3d1-3298cd7903f9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:12.237188 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-92c8e803-1265-413c-a3d1-3298cd7903f9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:12.255919 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92c8e803-1265-413c-a3d1-3298cd7903f9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:12.262660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92c8e803-1265-413c-a3d1-3298cd7903f9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:12.263255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92c8e803-1265-413c-a3d1-3298cd7903f9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:12.264059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92c8e803-1265-413c-a3d1-3298cd7903f9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:12.265576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92c8e803-1265-413c-a3d1-3298cd7903f9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:12.270196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92c8e803-1265-413c-a3d1-3298cd7903f9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:12.401156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ece9c2a5-d554-4bda-8e2a-9c36e04db030 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:12.411166 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ece9c2a5-d554-4bda-8e2a-9c36e04db030 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.602422 Aug 24 10:32:12.412434 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2202/4066] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:11 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:12.420734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-7628133b-8cd4-4cf2-b326-860ea079ec43 req-122f49ef-a9a3-409b-9d81-798e69d52256 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09f120f6-861a-4946-981b-47559a9c97fa", "tag": "29330474-2cf1-47be-ab26-0c24270c9a09"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:12.440440 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7628133b-8cd4-4cf2-b326-860ea079ec43 req-122f49ef-a9a3-409b-9d81-798e69d52256 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:12.441115 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7628133b-8cd4-4cf2-b326-860ea079ec43 req-122f49ef-a9a3-409b-9d81-798e69d52256 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:12.442219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7628133b-8cd4-4cf2-b326-860ea079ec43 req-122f49ef-a9a3-409b-9d81-798e69d52256 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:12.462948 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-7628133b-8cd4-4cf2-b326-860ea079ec43 req-122f49ef-a9a3-409b-9d81-798e69d52256 service nova] Creating event network-changed:29330474-2cf1-47be-ab26-0c24270c9a09 for instance 09f120f6-861a-4946-981b-47559a9c97fa on n-h2-849328-3 Aug 24 10:32:12.478048 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-7628133b-8cd4-4cf2-b326-860ea079ec43 req-122f49ef-a9a3-409b-9d81-798e69d52256 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064161 Aug 24 10:32:12.479327 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2203/4067] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:32:12.582416 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-92c8e803-1265-413c-a3d1-3298cd7903f9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:12.597824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:12.610478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-92c8e803-1265-413c-a3d1-3298cd7903f9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:12.612367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-92c8e803-1265-413c-a3d1-3298cd7903f9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:12.615668 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-92c8e803-1265-413c-a3d1-3298cd7903f9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1603 microversion: 2.42 time: 0.398633 Aug 24 10:32:12.616861 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1865/4068] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:32:12 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1603 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:32:12.872818 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ffa9a845-1fc4-4a49-83cd-8327e3420d03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:12.875309 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ffa9a845-1fc4-4a49-83cd-8327e3420d03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:12.886033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffa9a845-1fc4-4a49-83cd-8327e3420d03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:12.886925 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffa9a845-1fc4-4a49-83cd-8327e3420d03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:12.887587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffa9a845-1fc4-4a49-83cd-8327e3420d03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:12.888543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffa9a845-1fc4-4a49-83cd-8327e3420d03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:12.900454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffa9a845-1fc4-4a49-83cd-8327e3420d03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:12.901260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffa9a845-1fc4-4a49-83cd-8327e3420d03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:13.249104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0878a2b5-abaf-44aa-9d2c-bfcae3919d9d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:13.250307 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0878a2b5-abaf-44aa-9d2c-bfcae3919d9d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:13.264238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0878a2b5-abaf-44aa-9d2c-bfcae3919d9d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:13.264721 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0878a2b5-abaf-44aa-9d2c-bfcae3919d9d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:13.265259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0878a2b5-abaf-44aa-9d2c-bfcae3919d9d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:13.265892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0878a2b5-abaf-44aa-9d2c-bfcae3919d9d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:13.266345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0878a2b5-abaf-44aa-9d2c-bfcae3919d9d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:13.266771 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0878a2b5-abaf-44aa-9d2c-bfcae3919d9d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:13.643154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ffa9a845-1fc4-4a49-83cd-8327e3420d03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:13.657046 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ffa9a845-1fc4-4a49-83cd-8327e3420d03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1365 microversion: 2.1 time: 0.831335 Aug 24 10:32:13.672654 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2204/4069] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:12 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1365 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:13.677279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0878a2b5-abaf-44aa-9d2c-bfcae3919d9d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:13.678965 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9dddc7fc-f685-4d12-a00d-de9f80a4bb69 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:13.687604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9dddc7fc-f685-4d12-a00d-de9f80a4bb69 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:13.691969 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0878a2b5-abaf-44aa-9d2c-bfcae3919d9d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1371 microversion: 2.1 time: 0.450000 Aug 24 10:32:13.694153 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1866/4070] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:13 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1371 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:13.703129 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9dddc7fc-f685-4d12-a00d-de9f80a4bb69 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:13.704502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9dddc7fc-f685-4d12-a00d-de9f80a4bb69 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:13.705208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9dddc7fc-f685-4d12-a00d-de9f80a4bb69 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:13.706860 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9dddc7fc-f685-4d12-a00d-de9f80a4bb69 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:13.709593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9dddc7fc-f685-4d12-a00d-de9f80a4bb69 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:13.710224 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9dddc7fc-f685-4d12-a00d-de9f80a4bb69 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:13.895539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9dddc7fc-f685-4d12-a00d-de9f80a4bb69 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:13.914701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9dddc7fc-f685-4d12-a00d-de9f80a4bb69 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:13.918869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9dddc7fc-f685-4d12-a00d-de9f80a4bb69 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:13.921361 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9dddc7fc-f685-4d12-a00d-de9f80a4bb69 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1603 microversion: 2.42 time: 0.247244 Aug 24 10:32:13.923707 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2205/4071] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:32:13 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1603 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:32:14.681457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-421a0904-d834-4733-a54a-82b8263032d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:14.682929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-421a0904-d834-4733-a54a-82b8263032d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:14.704642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-421a0904-d834-4733-a54a-82b8263032d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:14.705734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-421a0904-d834-4733-a54a-82b8263032d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:14.706455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-421a0904-d834-4733-a54a-82b8263032d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:14.722393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2f5adaed-5f30-4419-b36f-c02822b33057 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:14.724651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2f5adaed-5f30-4419-b36f-c02822b33057 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:14.726829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-421a0904-d834-4733-a54a-82b8263032d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:14.730356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-421a0904-d834-4733-a54a-82b8263032d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:14.730866 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-421a0904-d834-4733-a54a-82b8263032d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:14.742367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f5adaed-5f30-4419-b36f-c02822b33057 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:14.745542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f5adaed-5f30-4419-b36f-c02822b33057 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:14.746695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f5adaed-5f30-4419-b36f-c02822b33057 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:14.749874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f5adaed-5f30-4419-b36f-c02822b33057 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:14.752026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f5adaed-5f30-4419-b36f-c02822b33057 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:14.752834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f5adaed-5f30-4419-b36f-c02822b33057 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:15.497408 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2f5adaed-5f30-4419-b36f-c02822b33057 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:15.520114 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2f5adaed-5f30-4419-b36f-c02822b33057 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1371 microversion: 2.1 time: 0.808275 Aug 24 10:32:15.521034 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2206/4072] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:14 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1371 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:32:15.526719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fd3d3896-f8bc-48f7-9032-68dd60f362d3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:15.527522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fd3d3896-f8bc-48f7-9032-68dd60f362d3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:15.545621 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd3d3896-f8bc-48f7-9032-68dd60f362d3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:15.546512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd3d3896-f8bc-48f7-9032-68dd60f362d3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:15.547174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd3d3896-f8bc-48f7-9032-68dd60f362d3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:15.548163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd3d3896-f8bc-48f7-9032-68dd60f362d3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:15.551596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd3d3896-f8bc-48f7-9032-68dd60f362d3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:15.552259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd3d3896-f8bc-48f7-9032-68dd60f362d3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:15.670360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fd3d3896-f8bc-48f7-9032-68dd60f362d3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:15.683863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fd3d3896-f8bc-48f7-9032-68dd60f362d3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:15.691345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fd3d3896-f8bc-48f7-9032-68dd60f362d3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:15.695857 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fd3d3896-f8bc-48f7-9032-68dd60f362d3 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1603 microversion: 2.42 time: 0.173369 Aug 24 10:32:15.715284 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2207/4073] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:32:15 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1603 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:32:15.732444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e188366d-3ed0-4b99-af43-c82cb16e29cf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-197406129", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "0a9df326-dcca-498d-8d8a-b320e539a1af", "destination_type": "local"}, {"source_type": "volume", "uuid": "a15b6454-27aa-44c2-b95e-9866cbe6737f", "destination_type": "invalid"}], "networks": [{"uuid": "ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e188366d-3ed0-4b99-af43-c82cb16e29cf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 494 Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-197406129", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "0a9df326-dcca-498d-8d8a-b320e539a1af", "destination_type": "local"}, {"source_type": "volume", "uuid": "a15b6454-27aa-44c2-b95e-9866cbe6737f", "destination_type": "invalid"}], "networks": [{"uuid": "ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d"}]}} Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-197406129', 'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '0a9df326-dcca-498d-8d8a-b320e539a1af', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'a15b6454-27aa-44c2-b95e-9866cbe6737f', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d'}]}}} Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'invalid' Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:15.737222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:15.741557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:15.741557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:15.741557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:15.741557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:32:15.741557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:32:15.741557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:32:15.741557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:32:15.741557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:32:15.741557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:32:15.741557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 24 10:32:15.741557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:15.741557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:15.741557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:15.741557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:15.741557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:15.741557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:15.741557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:32:15.741557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:32:15.741557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 24 10:32:15.741557 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:15.741557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e188366d-3ed0-4b99-af43-c82cb16e29cf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:15.741557 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e188366d-3ed0-4b99-af43-c82cb16e29cf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.021944 Aug 24 10:32:15.753565 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2208/4074] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:32:15 2022] POST /compute/v2.1/servers => generated 155 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:32:15.759706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5c92bb01-a7bd-4383-8366-d520662b2650 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:15.760339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5c92bb01-a7bd-4383-8366-d520662b2650 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:15.784734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c92bb01-a7bd-4383-8366-d520662b2650 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:15.789756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c92bb01-a7bd-4383-8366-d520662b2650 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:15.790301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c92bb01-a7bd-4383-8366-d520662b2650 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:15.791345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c92bb01-a7bd-4383-8366-d520662b2650 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:15.792001 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c92bb01-a7bd-4383-8366-d520662b2650 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:15.792627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c92bb01-a7bd-4383-8366-d520662b2650 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:16.242391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-421a0904-d834-4733-a54a-82b8263032d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:16.254856 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-421a0904-d834-4733-a54a-82b8263032d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1365 microversion: 2.1 time: 1.579617 Aug 24 10:32:16.256547 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1867/4075] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:14 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1365 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:32:16.546891 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8f27c628-7757-4503-b01d-6ff86a2182c1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:16.547746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8f27c628-7757-4503-b01d-6ff86a2182c1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:16.562472 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f27c628-7757-4503-b01d-6ff86a2182c1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:16.562976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f27c628-7757-4503-b01d-6ff86a2182c1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:16.563482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f27c628-7757-4503-b01d-6ff86a2182c1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:16.564610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f27c628-7757-4503-b01d-6ff86a2182c1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:16.578461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f27c628-7757-4503-b01d-6ff86a2182c1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:16.578949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f27c628-7757-4503-b01d-6ff86a2182c1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:16.838247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8f27c628-7757-4503-b01d-6ff86a2182c1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:16.852009 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8f27c628-7757-4503-b01d-6ff86a2182c1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1371 microversion: 2.1 time: 0.313795 Aug 24 10:32:16.854871 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1868/4076] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:16 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1371 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:32:16.874676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-86b9eeea-aa63-4107-b491-5dece02fd5a4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:16.876580 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-86b9eeea-aa63-4107-b491-5dece02fd5a4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:16.883595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5c92bb01-a7bd-4383-8366-d520662b2650 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:16.893314 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:16.893546 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5c92bb01-a7bd-4383-8366-d520662b2650 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 1.138559 Aug 24 10:32:16.910122 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86b9eeea-aa63-4107-b491-5dece02fd5a4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:16.910122 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86b9eeea-aa63-4107-b491-5dece02fd5a4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:16.910122 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86b9eeea-aa63-4107-b491-5dece02fd5a4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:16.910641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86b9eeea-aa63-4107-b491-5dece02fd5a4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:16.911561 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2209/4077] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:15 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:16.916073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86b9eeea-aa63-4107-b491-5dece02fd5a4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:16.917712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86b9eeea-aa63-4107-b491-5dece02fd5a4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:16.930387 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a6e60d58-8492-47c9-a146-cc2f3c29ebf2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:16.933812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a6e60d58-8492-47c9-a146-cc2f3c29ebf2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:16.950891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6e60d58-8492-47c9-a146-cc2f3c29ebf2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:16.951963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6e60d58-8492-47c9-a146-cc2f3c29ebf2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:16.952462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6e60d58-8492-47c9-a146-cc2f3c29ebf2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:16.956399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6e60d58-8492-47c9-a146-cc2f3c29ebf2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:16.956887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6e60d58-8492-47c9-a146-cc2f3c29ebf2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:16.957360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6e60d58-8492-47c9-a146-cc2f3c29ebf2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:17.091263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-86b9eeea-aa63-4107-b491-5dece02fd5a4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:17.112122 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-86b9eeea-aa63-4107-b491-5dece02fd5a4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:17.114796 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-86b9eeea-aa63-4107-b491-5dece02fd5a4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:17.120478 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-86b9eeea-aa63-4107-b491-5dece02fd5a4 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1603 microversion: 2.42 time: 0.260476 Aug 24 10:32:17.122111 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1869/4078] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:32:16 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1603 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:32:17.279442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7c5e510b-9768-41f5-a7ab-11960d40d8be tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:17.280525 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7c5e510b-9768-41f5-a7ab-11960d40d8be tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:17.290124 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c5e510b-9768-41f5-a7ab-11960d40d8be tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:17.291375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c5e510b-9768-41f5-a7ab-11960d40d8be tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:17.292831 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c5e510b-9768-41f5-a7ab-11960d40d8be tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:17.294388 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c5e510b-9768-41f5-a7ab-11960d40d8be tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:17.295517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c5e510b-9768-41f5-a7ab-11960d40d8be tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:17.297146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c5e510b-9768-41f5-a7ab-11960d40d8be tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:17.546346 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7c5e510b-9768-41f5-a7ab-11960d40d8be tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:17.556983 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7c5e510b-9768-41f5-a7ab-11960d40d8be tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1365 microversion: 2.1 time: 0.281948 Aug 24 10:32:17.570848 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1870/4079] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:17 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1365 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:17.841042 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a6e60d58-8492-47c9-a146-cc2f3c29ebf2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:17.853947 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a6e60d58-8492-47c9-a146-cc2f3c29ebf2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.941178 Aug 24 10:32:17.854559 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2210/4080] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:16 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:17.880729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d588fe19-531d-4cea-a782-1343f900c947 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:17.883321 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d588fe19-531d-4cea-a782-1343f900c947 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:17.924559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-47ef9d16-38ec-49b2-846a-c16e32ee88e7 req-64d6d011-627a-4e97-afa2-9d2f7b7c9f91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ed6211-b7fc-454f-a8e9-73ba571a71af", "name": "network-vif-plugged", "status": "completed", "tag": "1c2608cb-c0ff-45d5-b7c5-82ff95cc5b0c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:17.932716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d588fe19-531d-4cea-a782-1343f900c947 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:17.933630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d588fe19-531d-4cea-a782-1343f900c947 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:17.934572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d588fe19-531d-4cea-a782-1343f900c947 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:17.937056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d588fe19-531d-4cea-a782-1343f900c947 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:17.941950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d588fe19-531d-4cea-a782-1343f900c947 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:17.942789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d588fe19-531d-4cea-a782-1343f900c947 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:17.947461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-47ef9d16-38ec-49b2-846a-c16e32ee88e7 req-64d6d011-627a-4e97-afa2-9d2f7b7c9f91 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:17.947939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-47ef9d16-38ec-49b2-846a-c16e32ee88e7 req-64d6d011-627a-4e97-afa2-9d2f7b7c9f91 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:17.948373 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-47ef9d16-38ec-49b2-846a-c16e32ee88e7 req-64d6d011-627a-4e97-afa2-9d2f7b7c9f91 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:17.978544 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-47ef9d16-38ec-49b2-846a-c16e32ee88e7 req-64d6d011-627a-4e97-afa2-9d2f7b7c9f91 service nova] Creating event network-vif-plugged:1c2608cb-c0ff-45d5-b7c5-82ff95cc5b0c for instance 99ed6211-b7fc-454f-a8e9-73ba571a71af on n-h1-849328-3 Aug 24 10:32:17.995761 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-47ef9d16-38ec-49b2-846a-c16e32ee88e7 req-64d6d011-627a-4e97-afa2-9d2f7b7c9f91 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075268 Aug 24 10:32:18.002518 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2211/4081] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:32:18.051946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-adc60419-006d-4fa3-a416-eaff13c2f8f1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1062434573", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-adc60419-006d-4fa3-a416-eaff13c2f8f1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 492 Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1062434573", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d"}]}} Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1062434573', 'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d'}]}}} Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:18.056582 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-adc60419-006d-4fa3-a416-eaff13c2f8f1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:18.059317 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-adc60419-006d-4fa3-a416-eaff13c2f8f1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.014214 Aug 24 10:32:18.073804 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2212/4082] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:32:18 2022] POST /compute/v2.1/servers => generated 624 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 10:32:18.093073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0c869169-1cfb-4a4c-8928-9a3119d52534 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:18.095234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0c869169-1cfb-4a4c-8928-9a3119d52534 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:18.105210 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c869169-1cfb-4a4c-8928-9a3119d52534 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:18.106049 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c869169-1cfb-4a4c-8928-9a3119d52534 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:18.106729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c869169-1cfb-4a4c-8928-9a3119d52534 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:18.107879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c869169-1cfb-4a4c-8928-9a3119d52534 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:18.108698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c869169-1cfb-4a4c-8928-9a3119d52534 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:18.111063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c869169-1cfb-4a4c-8928-9a3119d52534 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:18.476336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d588fe19-531d-4cea-a782-1343f900c947 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:18.511977 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d588fe19-531d-4cea-a782-1343f900c947 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1371 microversion: 2.1 time: 0.634552 Aug 24 10:32:18.544346 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1871/4083] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:17 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1371 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:18.562967 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1bc5dec6-104d-479d-8c94-32134296e8d7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:18.565153 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1bc5dec6-104d-479d-8c94-32134296e8d7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:18.582673 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1bc5dec6-104d-479d-8c94-32134296e8d7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:18.586918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1bc5dec6-104d-479d-8c94-32134296e8d7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:18.587547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1bc5dec6-104d-479d-8c94-32134296e8d7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:18.589977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1bc5dec6-104d-479d-8c94-32134296e8d7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:18.591027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1bc5dec6-104d-479d-8c94-32134296e8d7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:18.592254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1bc5dec6-104d-479d-8c94-32134296e8d7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:18.720423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0c869169-1cfb-4a4c-8928-9a3119d52534 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:18.740504 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0c869169-1cfb-4a4c-8928-9a3119d52534 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.664994 Aug 24 10:32:18.764601 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2213/4084] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:18 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:18.772222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-17bc7a6f-c46b-4d7c-8a55-34445997bb27 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:18.773591 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-17bc7a6f-c46b-4d7c-8a55-34445997bb27 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:18.783926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17bc7a6f-c46b-4d7c-8a55-34445997bb27 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:18.784785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17bc7a6f-c46b-4d7c-8a55-34445997bb27 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:18.785594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17bc7a6f-c46b-4d7c-8a55-34445997bb27 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:18.786555 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17bc7a6f-c46b-4d7c-8a55-34445997bb27 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:18.787284 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17bc7a6f-c46b-4d7c-8a55-34445997bb27 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:18.788124 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17bc7a6f-c46b-4d7c-8a55-34445997bb27 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:19.024383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1bc5dec6-104d-479d-8c94-32134296e8d7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:19.062351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1bc5dec6-104d-479d-8c94-32134296e8d7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:19.071207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1bc5dec6-104d-479d-8c94-32134296e8d7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:19.077046 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1bc5dec6-104d-479d-8c94-32134296e8d7 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1603 microversion: 2.42 time: 0.528716 Aug 24 10:32:19.078315 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1872/4085] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:32:18 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1603 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:32:19.083441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-17bc7a6f-c46b-4d7c-8a55-34445997bb27 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:19.099020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ec295479-12b1-44b1-ad55-192852961f22 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:19.100485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ec295479-12b1-44b1-ad55-192852961f22 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:19.102038 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-17bc7a6f-c46b-4d7c-8a55-34445997bb27 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1365 microversion: 2.1 time: 0.335687 Aug 24 10:32:19.102758 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2214/4086] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:18 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1365 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:19.131898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec295479-12b1-44b1-ad55-192852961f22 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:19.132826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec295479-12b1-44b1-ad55-192852961f22 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:19.133477 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec295479-12b1-44b1-ad55-192852961f22 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:19.134991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec295479-12b1-44b1-ad55-192852961f22 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:19.136127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec295479-12b1-44b1-ad55-192852961f22 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:19.137230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec295479-12b1-44b1-ad55-192852961f22 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:19.547089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-31d83ef7-96f9-4a27-85a2-ebc5809f680d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:19.547774 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-31d83ef7-96f9-4a27-85a2-ebc5809f680d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:19.571233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31d83ef7-96f9-4a27-85a2-ebc5809f680d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:19.572003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31d83ef7-96f9-4a27-85a2-ebc5809f680d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:19.572678 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31d83ef7-96f9-4a27-85a2-ebc5809f680d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:19.573635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31d83ef7-96f9-4a27-85a2-ebc5809f680d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:19.574295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31d83ef7-96f9-4a27-85a2-ebc5809f680d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:19.576967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31d83ef7-96f9-4a27-85a2-ebc5809f680d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:19.763649 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ec295479-12b1-44b1-ad55-192852961f22 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:19.775760 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ec295479-12b1-44b1-ad55-192852961f22 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.694580 Aug 24 10:32:19.795831 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1873/4087] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:19 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:19.861135 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-31d83ef7-96f9-4a27-85a2-ebc5809f680d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:19.872217 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-31d83ef7-96f9-4a27-85a2-ebc5809f680d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1371 microversion: 2.1 time: 0.329530 Aug 24 10:32:19.873157 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2215/4088] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:19 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1371 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:32:19.960908 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3170c7b2-69f9-4b5d-978d-a9c56b768ff0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3170c7b2-69f9-4b5d-978d-a9c56b768ff0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 416 Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d"}]}} Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af', 'flavorRef': '452', 'networks': [{'uuid': 'ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d'}]}}} Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:19.967463 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3170c7b2-69f9-4b5d-978d-a9c56b768ff0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:19.971189 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3170c7b2-69f9-4b5d-978d-a9c56b768ff0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.014496 Aug 24 10:32:19.978922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1babe784-cfa1-4450-9a43-a43f09022ca9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:19.979734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1babe784-cfa1-4450-9a43-a43f09022ca9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:19.983168 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1874/4089] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:32:19 2022] POST /compute/v2.1/servers => generated 619 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:32:19.987365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1babe784-cfa1-4450-9a43-a43f09022ca9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:19.988514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1babe784-cfa1-4450-9a43-a43f09022ca9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:19.989713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1babe784-cfa1-4450-9a43-a43f09022ca9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:19.991351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1babe784-cfa1-4450-9a43-a43f09022ca9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:19.992186 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1babe784-cfa1-4450-9a43-a43f09022ca9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:19.992987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1babe784-cfa1-4450-9a43-a43f09022ca9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:20.114189 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0c6528df-73a4-4c1e-9ba7-933bc1fd9513 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:20.115169 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0c6528df-73a4-4c1e-9ba7-933bc1fd9513 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:20.128094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c6528df-73a4-4c1e-9ba7-933bc1fd9513 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:20.129445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c6528df-73a4-4c1e-9ba7-933bc1fd9513 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:20.130292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c6528df-73a4-4c1e-9ba7-933bc1fd9513 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:20.131229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c6528df-73a4-4c1e-9ba7-933bc1fd9513 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:20.132185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c6528df-73a4-4c1e-9ba7-933bc1fd9513 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:20.133730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c6528df-73a4-4c1e-9ba7-933bc1fd9513 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:20.217081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1babe784-cfa1-4450-9a43-a43f09022ca9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:20.229209 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1babe784-cfa1-4450-9a43-a43f09022ca9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.253896 Aug 24 10:32:20.230390 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2216/4090] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:19 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:20.238331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b82b0513-3327-4d36-ba31-3643c6e84931 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:20.239063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b82b0513-3327-4d36-ba31-3643c6e84931 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:20.246806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b82b0513-3327-4d36-ba31-3643c6e84931 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:20.247679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b82b0513-3327-4d36-ba31-3643c6e84931 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:20.248370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b82b0513-3327-4d36-ba31-3643c6e84931 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:20.249418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b82b0513-3327-4d36-ba31-3643c6e84931 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:20.249889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b82b0513-3327-4d36-ba31-3643c6e84931 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:20.250324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b82b0513-3327-4d36-ba31-3643c6e84931 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:20.269759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0c6528df-73a4-4c1e-9ba7-933bc1fd9513 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:20.288638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0c6528df-73a4-4c1e-9ba7-933bc1fd9513 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:20.288638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0c6528df-73a4-4c1e-9ba7-933bc1fd9513 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:20.292111 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0c6528df-73a4-4c1e-9ba7-933bc1fd9513 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1603 microversion: 2.42 time: 0.181982 Aug 24 10:32:20.295178 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1875/4091] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:32:20 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1603 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:32:20.300288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-acd25ce6-cfc6-4a44-b5f8-ff9008101b16 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:20.301109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-acd25ce6-cfc6-4a44-b5f8-ff9008101b16 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:20.320495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acd25ce6-cfc6-4a44-b5f8-ff9008101b16 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:20.321216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acd25ce6-cfc6-4a44-b5f8-ff9008101b16 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:20.321640 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acd25ce6-cfc6-4a44-b5f8-ff9008101b16 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:20.323569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acd25ce6-cfc6-4a44-b5f8-ff9008101b16 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:20.323569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acd25ce6-cfc6-4a44-b5f8-ff9008101b16 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:20.323569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acd25ce6-cfc6-4a44-b5f8-ff9008101b16 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:20.585264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b82b0513-3327-4d36-ba31-3643c6e84931 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:20.606281 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b82b0513-3327-4d36-ba31-3643c6e84931 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1551 microversion: 2.1 time: 0.373949 Aug 24 10:32:20.608275 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2217/4092] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:20 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1551 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:20.638919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d0517974-334d-45c0-8c29-5c7869605011 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:20.639803 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d0517974-334d-45c0-8c29-5c7869605011 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:20.649371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0517974-334d-45c0-8c29-5c7869605011 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:20.650220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0517974-334d-45c0-8c29-5c7869605011 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:20.651088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0517974-334d-45c0-8c29-5c7869605011 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:20.653481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0517974-334d-45c0-8c29-5c7869605011 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:20.655543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0517974-334d-45c0-8c29-5c7869605011 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:20.656435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0517974-334d-45c0-8c29-5c7869605011 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:20.678450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-acd25ce6-cfc6-4a44-b5f8-ff9008101b16 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:20.697408 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-acd25ce6-cfc6-4a44-b5f8-ff9008101b16 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.400418 Aug 24 10:32:20.698700 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1876/4093] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:20 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:20.792369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bf0a309f-264d-4b92-bc7b-914aca698b6e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1994485491", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": -1, "networks": [{"uuid": "ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:20.807743 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-bf0a309f-264d-4b92-bc7b-914aca698b6e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Flavor -1 could not be found. Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bf0a309f-264d-4b92-bc7b-914aca698b6e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 206 Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1994485491", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": -1, "networks": [{"uuid": "ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d"}]}} Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: exception: Flavor -1 could not be found. Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1994485491', 'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af', 'flavorRef': -1, 'networks': [{'uuid': 'ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d'}]}}} Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:20.809800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:20.815340 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:20.815340 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:20.815340 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:20.815340 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:20.815340 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 10:32:20.815340 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 24 10:32:20.815340 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 24 10:32:20.815340 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 24 10:32:20.815340 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:20.815340 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:20.815340 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:20.815340 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:20.815340 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:20.815340 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:20.815340 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:32:20.815340 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:32:20.815340 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 24 10:32:20.815340 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:20.815340 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bf0a309f-264d-4b92-bc7b-914aca698b6e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:20.815340 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bf0a309f-264d-4b92-bc7b-914aca698b6e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.027668 Aug 24 10:32:20.818844 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1877/4094] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:32:20 2022] POST /compute/v2.1/servers => generated 73 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 24 10:32:20.820504 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-00b6e2d4-05c1-45c6-8d0e-17da68fe9bb0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:20.821153 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-00b6e2d4-05c1-45c6-8d0e-17da68fe9bb0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:20.829064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b6e2d4-05c1-45c6-8d0e-17da68fe9bb0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:20.829901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b6e2d4-05c1-45c6-8d0e-17da68fe9bb0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:20.830557 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b6e2d4-05c1-45c6-8d0e-17da68fe9bb0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:20.831529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b6e2d4-05c1-45c6-8d0e-17da68fe9bb0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:20.832311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b6e2d4-05c1-45c6-8d0e-17da68fe9bb0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:20.832908 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b6e2d4-05c1-45c6-8d0e-17da68fe9bb0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:20.894409 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d0517974-334d-45c0-8c29-5c7869605011 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.263804 Aug 24 10:32:20.895166 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2218/4095] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Aug 24 10:32:20 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/os-interface => generated 284 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:32:20.900392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-459c5e02-6e1d-48df-b60a-441484d45fb2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:20.901283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-459c5e02-6e1d-48df-b60a-441484d45fb2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:20.909995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-459c5e02-6e1d-48df-b60a-441484d45fb2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:20.910865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-459c5e02-6e1d-48df-b60a-441484d45fb2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:20.911558 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-459c5e02-6e1d-48df-b60a-441484d45fb2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:20.912883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-459c5e02-6e1d-48df-b60a-441484d45fb2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:20.913592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-459c5e02-6e1d-48df-b60a-441484d45fb2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:20.914245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-459c5e02-6e1d-48df-b60a-441484d45fb2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:21.022693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-00b6e2d4-05c1-45c6-8d0e-17da68fe9bb0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:21.036487 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-00b6e2d4-05c1-45c6-8d0e-17da68fe9bb0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.218508 Aug 24 10:32:21.037693 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1878/4096] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:20 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:21.060918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-940fa18a-d4b3-4f00-83cc-ec7eb407ece5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:21.062681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-940fa18a-d4b3-4f00-83cc-ec7eb407ece5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:21.072330 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-940fa18a-d4b3-4f00-83cc-ec7eb407ece5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:21.073217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-940fa18a-d4b3-4f00-83cc-ec7eb407ece5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:21.073937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-940fa18a-d4b3-4f00-83cc-ec7eb407ece5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:21.075400 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-940fa18a-d4b3-4f00-83cc-ec7eb407ece5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:21.085859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-940fa18a-d4b3-4f00-83cc-ec7eb407ece5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:21.086665 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-940fa18a-d4b3-4f00-83cc-ec7eb407ece5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:21.304751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-940fa18a-d4b3-4f00-83cc-ec7eb407ece5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:21.322920 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-940fa18a-d4b3-4f00-83cc-ec7eb407ece5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.266473 Aug 24 10:32:21.324031 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1879/4097] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:21 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:21.343857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e3f126e9-41fc-47bd-a514-06d3b87eadfc req-88969f42-fd8e-4af5-b545-1bfba9d61f39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f120f6-861a-4946-981b-47559a9c97fa", "name": "network-vif-plugged", "status": "completed", "tag": "29330474-2cf1-47be-ab26-0c24270c9a09"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:21.358114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e3f126e9-41fc-47bd-a514-06d3b87eadfc req-88969f42-fd8e-4af5-b545-1bfba9d61f39 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:21.359273 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e3f126e9-41fc-47bd-a514-06d3b87eadfc req-88969f42-fd8e-4af5-b545-1bfba9d61f39 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:21.359988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e3f126e9-41fc-47bd-a514-06d3b87eadfc req-88969f42-fd8e-4af5-b545-1bfba9d61f39 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:21.381559 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e3f126e9-41fc-47bd-a514-06d3b87eadfc req-88969f42-fd8e-4af5-b545-1bfba9d61f39 service nova] Creating event network-vif-plugged:29330474-2cf1-47be-ab26-0c24270c9a09 for instance 09f120f6-861a-4946-981b-47559a9c97fa on n-h2-849328-3 Aug 24 10:32:21.388093 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e3f126e9-41fc-47bd-a514-06d3b87eadfc req-88969f42-fd8e-4af5-b545-1bfba9d61f39 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062142 Aug 24 10:32:21.389742 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1880/4098] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:32:21.400256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-62d7be74-7ee7-4f17-bdf4-0342ac265009 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:21.401503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-62d7be74-7ee7-4f17-bdf4-0342ac265009 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:21.409356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62d7be74-7ee7-4f17-bdf4-0342ac265009 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:21.410405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62d7be74-7ee7-4f17-bdf4-0342ac265009 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:21.410964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62d7be74-7ee7-4f17-bdf4-0342ac265009 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:21.411939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62d7be74-7ee7-4f17-bdf4-0342ac265009 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:21.412715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62d7be74-7ee7-4f17-bdf4-0342ac265009 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:21.413500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62d7be74-7ee7-4f17-bdf4-0342ac265009 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:21.518077 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-62d7be74-7ee7-4f17-bdf4-0342ac265009 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:21.533152 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-62d7be74-7ee7-4f17-bdf4-0342ac265009 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:21.534949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-62d7be74-7ee7-4f17-bdf4-0342ac265009 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ba82263a7d4ee79bc04be46db8227a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ace7124510e4aad905cbf22c7c77483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:21.536204 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-62d7be74-7ee7-4f17-bdf4-0342ac265009 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 200 len: 1603 microversion: 2.42 time: 0.144737 Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1881/4099] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:32:21 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 1603 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-34b1f097-6795-479c-8063-d36b77de761d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-730681275", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-34b1f097-6795-479c-8063-d36b77de761d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 172 Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-730681275", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d"}]}} Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-730681275', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d'}]}}} Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi -1 Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:21.552600 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:21.556429 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:21.556429 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:21.556429 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:21.556429 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:21.556429 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:21.556429 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:32:21.556429 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:32:21.556429 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:32:21.556429 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:32:21.556429 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:32:21.556429 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:32:21.556429 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 24 10:32:21.556429 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:21.556429 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:21.556429 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:21.556429 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:21.556429 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:21.556429 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:21.556429 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:32:21.556429 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:32:21.556429 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 24 10:32:21.556429 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:21.556429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-34b1f097-6795-479c-8063-d36b77de761d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:21.556429 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-34b1f097-6795-479c-8063-d36b77de761d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.011501 Aug 24 10:32:21.556429 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1882/4100] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:32:21 2022] POST /compute/v2.1/servers => generated 145 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:32:21.563449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d1c97d3a-6631-441a-b6c7-8b363a91129e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:21.564596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d1c97d3a-6631-441a-b6c7-8b363a91129e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:21.572197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1c97d3a-6631-441a-b6c7-8b363a91129e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:21.572857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1c97d3a-6631-441a-b6c7-8b363a91129e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:21.573500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1c97d3a-6631-441a-b6c7-8b363a91129e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:21.574299 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1c97d3a-6631-441a-b6c7-8b363a91129e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:21.574828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1c97d3a-6631-441a-b6c7-8b363a91129e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:21.575692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1c97d3a-6631-441a-b6c7-8b363a91129e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:21.798140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-459c5e02-6e1d-48df-b60a-441484d45fb2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:21.812369 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-459c5e02-6e1d-48df-b60a-441484d45fb2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1371 microversion: 2.1 time: 0.915679 Aug 24 10:32:21.814097 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2219/4101] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:20 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1371 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:21.839366 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d1c97d3a-6631-441a-b6c7-8b363a91129e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:21.849479 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d1c97d3a-6631-441a-b6c7-8b363a91129e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.290408 Aug 24 10:32:21.850809 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1883/4102] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:21 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:21.875363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e195a53a-6f01-4d70-b228-e229bdc598da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:21.877226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e195a53a-6f01-4d70-b228-e229bdc598da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:21.886624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e195a53a-6f01-4d70-b228-e229bdc598da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:21.887367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e195a53a-6f01-4d70-b228-e229bdc598da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:21.887949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e195a53a-6f01-4d70-b228-e229bdc598da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:21.889885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e195a53a-6f01-4d70-b228-e229bdc598da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:21.890744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e195a53a-6f01-4d70-b228-e229bdc598da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:21.891968 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e195a53a-6f01-4d70-b228-e229bdc598da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:22.330596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e195a53a-6f01-4d70-b228-e229bdc598da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:22.356388 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e195a53a-6f01-4d70-b228-e229bdc598da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.486753 Aug 24 10:32:22.366050 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2220/4103] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:21 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:22.502925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-130e74d0-453e-4ddc-a6b2-599e5fca081a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1006798586", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:22.511430 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-130e74d0-453e-4ddc-a6b2-599e5fca081a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-130e74d0-453e-4ddc-a6b2-599e5fca081a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 216 Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1006798586", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1006798586', 'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:22.514093 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:22.517733 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:22.517733 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:22.517733 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:22.517733 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:22.517733 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:32:22.517733 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:32:22.517733 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 24 10:32:22.517733 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:22.520979 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-130e74d0-453e-4ddc-a6b2-599e5fca081a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:22.523012 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-130e74d0-453e-4ddc-a6b2-599e5fca081a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.029328 Aug 24 10:32:22.524626 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1884/4104] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:32:22 2022] POST /compute/v2.1/servers => generated 123 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:32:22.535430 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b74876dc-b41b-4718-a743-022ecf58653e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:22.536173 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b74876dc-b41b-4718-a743-022ecf58653e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:22.545571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b74876dc-b41b-4718-a743-022ecf58653e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:22.546441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b74876dc-b41b-4718-a743-022ecf58653e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:22.547198 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b74876dc-b41b-4718-a743-022ecf58653e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:22.548307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b74876dc-b41b-4718-a743-022ecf58653e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:22.548931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b74876dc-b41b-4718-a743-022ecf58653e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:22.549591 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b74876dc-b41b-4718-a743-022ecf58653e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:22.560428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5e8bed98-72f6-471f-8990-c380913350a9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:22.561628 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5e8bed98-72f6-471f-8990-c380913350a9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:22.579635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e8bed98-72f6-471f-8990-c380913350a9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:22.584510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e8bed98-72f6-471f-8990-c380913350a9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:22.585344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e8bed98-72f6-471f-8990-c380913350a9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:22.586452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e8bed98-72f6-471f-8990-c380913350a9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:22.591383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e8bed98-72f6-471f-8990-c380913350a9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:22.592428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e8bed98-72f6-471f-8990-c380913350a9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:22.626129 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-5e8bed98-72f6-471f-8990-c380913350a9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] HTTP exception thrown: Instance 1ade0e12-9ac0-459f-8f85-6743432302fa could not be found. Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5e8bed98-72f6-471f-8990-c380913350a9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Request method failure captured: Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa HTTP/1.1 Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfx4u-J8d766els6qbuFq7WIlRl6XGRiDxNOiimlrnJtPjsYATm2JNe94EOkJ98NlOrdB8pE_oOaR9SQvpO21I7R6a0aeN7H61vjDHCaYX-To6KdJYvJIeAErBuVTZ72jxEXqzXjh-6Wtup4A0JgY8kh1PFp3s_Vrb1i40tiuubToRs Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: X-Openstack-Nova-Api-Version: 2.42 Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 3ace7124510e4aad905cbf22c7c77483 Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-269540293 Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3ace7124510e4aad905cbf22c7c77483"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3ace7124510e4aad905cbf22c7c77483", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3ace7124510e4aad905cbf22c7c77483"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3ace7124510e4aad905cbf22c7c77483"}]}] Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-TaggedBootDevicesTest_v242-269540293 Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 3ace7124510e4aad905cbf22c7c77483 Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-269540293 Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-TaggedBootDevicesTest_v242-269540293-project Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 24ba82263a7d4ee79bc04be46db8227a Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-TaggedBootDevicesTest_v242-269540293-project Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 1ade0e12-9ac0-459f-8f85-6743432302fa could not be found. Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '1ade0e12-9ac0-459f-8f85-6743432302fa'} Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ade0e12-9ac0-459f-8f85-6743432302fa could not be found. Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ade0e12-9ac0-459f-8f85-6743432302fa could not be found. Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:22.628203 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:22.631806 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:22.631806 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:22.631806 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:22.631806 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:22.631806 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:32:22.631806 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:32:22.631806 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ade0e12-9ac0-459f-8f85-6743432302fa could not be found. Aug 24 10:32:22.631806 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:22.634020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5e8bed98-72f6-471f-8990-c380913350a9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Returning 404 to user: Instance 1ade0e12-9ac0-459f-8f85-6743432302fa could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:22.635275 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5e8bed98-72f6-471f-8990-c380913350a9 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 404 len: 111 microversion: 2.42 time: 0.079212 Aug 24 10:32:22.640267 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1885/4105] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:32:22 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 10:32:22.646266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-456a24c8-9625-4100-88bf-56c0ead9a04a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '.version_select at 0x7f4655837ee0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:22.681888 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-456a24c8-9625-4100-88bf-56c0ead9a04a tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-263898099" status: 204 len: 0 microversion: 2.42 time: 0.039801 Aug 24 10:32:22.683187 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1886/4106] 10.222.0.85 () {60 vars in 1259 bytes} [Wed Aug 24 10:32:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-263898099 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:32:22.845634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fe049cff-c792-40b6-b363-0b8324239a67 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:22.847317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fe049cff-c792-40b6-b363-0b8324239a67 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:22.858812 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe049cff-c792-40b6-b363-0b8324239a67 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:22.859788 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe049cff-c792-40b6-b363-0b8324239a67 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:22.860669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe049cff-c792-40b6-b363-0b8324239a67 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:22.863232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe049cff-c792-40b6-b363-0b8324239a67 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:22.864241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe049cff-c792-40b6-b363-0b8324239a67 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:22.865577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe049cff-c792-40b6-b363-0b8324239a67 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:23.778728 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b74876dc-b41b-4718-a743-022ecf58653e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:23.794430 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b74876dc-b41b-4718-a743-022ecf58653e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 1.263103 Aug 24 10:32:23.795595 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2221/4107] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:22 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:23.838452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3bd9876f-14ef-479e-bd56-724d614b4f6b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:23.839387 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3bd9876f-14ef-479e-bd56-724d614b4f6b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:23.851549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bd9876f-14ef-479e-bd56-724d614b4f6b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:23.852226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bd9876f-14ef-479e-bd56-724d614b4f6b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:23.852890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bd9876f-14ef-479e-bd56-724d614b4f6b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:23.853994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bd9876f-14ef-479e-bd56-724d614b4f6b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:23.854581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bd9876f-14ef-479e-bd56-724d614b4f6b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:23.860047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bd9876f-14ef-479e-bd56-724d614b4f6b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:23.882066 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:23.918312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fe049cff-c792-40b6-b363-0b8324239a67 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:23.945412 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fe049cff-c792-40b6-b363-0b8324239a67 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1371 microversion: 2.1 time: 1.112083 Aug 24 10:32:23.947211 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1887/4108] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:22 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1371 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:24.392602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3bd9876f-14ef-479e-bd56-724d614b4f6b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:24.417727 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3bd9876f-14ef-479e-bd56-724d614b4f6b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.582444 Aug 24 10:32:24.439808 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2222/4109] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:23 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:32:24.580794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bb21ff8b-565e-47fc-956d-e7cd2c169973 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-673829150", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "key_name": "tempest-key-1241841861", "networks": [{"uuid": "ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:24.585271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-01ca27cf-7b4d-4344-bbe3-f146c8c0c45c req-b61bbdb4-51ec-4c06-9acf-572389176735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99ed6211-b7fc-454f-a8e9-73ba571a71af", "tag": "1c2608cb-c0ff-45d5-b7c5-82ff95cc5b0c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:24.662640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-01ca27cf-7b4d-4344-bbe3-f146c8c0c45c req-b61bbdb4-51ec-4c06-9acf-572389176735 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:24.663451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-01ca27cf-7b4d-4344-bbe3-f146c8c0c45c req-b61bbdb4-51ec-4c06-9acf-572389176735 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:24.664752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-01ca27cf-7b4d-4344-bbe3-f146c8c0c45c req-b61bbdb4-51ec-4c06-9acf-572389176735 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:24.730037 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-01ca27cf-7b4d-4344-bbe3-f146c8c0c45c req-b61bbdb4-51ec-4c06-9acf-572389176735 service nova] Creating event network-changed:1c2608cb-c0ff-45d5-b7c5-82ff95cc5b0c for instance 99ed6211-b7fc-454f-a8e9-73ba571a71af on n-h1-849328-3 Aug 24 10:32:24.742242 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-01ca27cf-7b4d-4344-bbe3-f146c8c0c45c req-b61bbdb4-51ec-4c06-9acf-572389176735 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169005 Aug 24 10:32:24.745524 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2223/4110] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:32:24.791743 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-bb21ff8b-565e-47fc-956d-e7cd2c169973 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] validate_networks() for [('ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:32:24.977392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2f7a25d1-af70-45c1-902d-d6ed359fa9f8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:24.979307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2f7a25d1-af70-45c1-902d-d6ed359fa9f8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:24.991585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f7a25d1-af70-45c1-902d-d6ed359fa9f8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:24.992242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f7a25d1-af70-45c1-902d-d6ed359fa9f8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:24.992955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f7a25d1-af70-45c1-902d-d6ed359fa9f8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:24.993918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f7a25d1-af70-45c1-902d-d6ed359fa9f8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:24.994999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f7a25d1-af70-45c1-902d-d6ed359fa9f8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:24.995796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f7a25d1-af70-45c1-902d-d6ed359fa9f8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:25.499243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2f7a25d1-af70-45c1-902d-d6ed359fa9f8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:25.519581 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2f7a25d1-af70-45c1-902d-d6ed359fa9f8 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1565 microversion: 2.1 time: 0.549324 Aug 24 10:32:25.543091 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2224/4111] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:24 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1565 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:25.557623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8e865141-513e-4692-b169-bf88c9fe3e3d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:25.561449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8e865141-513e-4692-b169-bf88c9fe3e3d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:25.582220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e865141-513e-4692-b169-bf88c9fe3e3d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:25.582725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e865141-513e-4692-b169-bf88c9fe3e3d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:25.583170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e865141-513e-4692-b169-bf88c9fe3e3d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:25.585535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e865141-513e-4692-b169-bf88c9fe3e3d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:25.586234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e865141-513e-4692-b169-bf88c9fe3e3d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:25.586671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e865141-513e-4692-b169-bf88c9fe3e3d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:25.755369 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8e865141-513e-4692-b169-bf88c9fe3e3d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.209064 Aug 24 10:32:25.757243 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2225/4112] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Aug 24 10:32:25 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-interface => generated 285 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:32:25.931567 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-bb21ff8b-565e-47fc-956d-e7cd2c169973 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Invalid key_name provided. Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bb21ff8b-565e-47fc-956d-e7cd2c169973 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 246 Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-673829150", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "key_name": "tempest-key-1241841861", "networks": [{"uuid": "ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d"}]}} Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: exception: Invalid key_name provided. Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-673829150', 'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af', 'flavorRef': '452', 'key_name': 'tempest-key-1241841861', 'networks': [{'uuid': 'ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d'}]}}} Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1076, in _validate_and_build_base_options Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1241841861 not found for user 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:25.934536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:25.939736 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:25.939736 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:25.939736 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:25.939736 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:25.939736 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:25.939736 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:25.939736 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:25.939736 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:25.939736 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:25.939736 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:25.939736 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:25.939736 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 10:32:25.939736 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 24 10:32:25.939736 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 24 10:32:25.939736 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 24 10:32:25.939736 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:25.939736 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:25.939736 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:25.939736 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:25.939736 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:25.939736 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:25.939736 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:32:25.939736 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:32:25.939736 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 24 10:32:25.939736 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:25.944335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bb21ff8b-565e-47fc-956d-e7cd2c169973 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 400 to user: Invalid key_name provided. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:25.946478 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bb21ff8b-565e-47fc-956d-e7cd2c169973 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.373821 Aug 24 10:32:25.949014 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1888/4113] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:32:24 2022] POST /compute/v2.1/servers => generated 70 bytes in 1382 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 10:32:25.957267 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5c487fed-ead5-4aa5-8a9f-aa4190843cfa tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:25.957986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5c487fed-ead5-4aa5-8a9f-aa4190843cfa tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:25.972587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c487fed-ead5-4aa5-8a9f-aa4190843cfa tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:25.972587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c487fed-ead5-4aa5-8a9f-aa4190843cfa tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:25.972587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c487fed-ead5-4aa5-8a9f-aa4190843cfa tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:25.972587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c487fed-ead5-4aa5-8a9f-aa4190843cfa tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:25.972587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c487fed-ead5-4aa5-8a9f-aa4190843cfa tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:25.977446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c487fed-ead5-4aa5-8a9f-aa4190843cfa tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:26.902709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5c487fed-ead5-4aa5-8a9f-aa4190843cfa tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:26.926531 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5c487fed-ead5-4aa5-8a9f-aa4190843cfa tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.973705 Aug 24 10:32:26.930301 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2226/4114] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:25 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:26.956491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7341fad2-c634-4692-819e-ff74b7784055 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:26.958664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7341fad2-c634-4692-819e-ff74b7784055 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:26.976056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7341fad2-c634-4692-819e-ff74b7784055 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:26.977072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7341fad2-c634-4692-819e-ff74b7784055 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:26.979347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7341fad2-c634-4692-819e-ff74b7784055 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:26.980320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7341fad2-c634-4692-819e-ff74b7784055 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:26.982311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7341fad2-c634-4692-819e-ff74b7784055 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:26.984614 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7341fad2-c634-4692-819e-ff74b7784055 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:27.433454 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7341fad2-c634-4692-819e-ff74b7784055 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:27.453755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:27.458650 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7341fad2-c634-4692-819e-ff74b7784055 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.506776 Aug 24 10:32:27.466189 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1889/4115] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:26 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:27.582808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3aa3fffd-0c91-4fc6-816b-688d23ce7703 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-265243961", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:28.064964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.security_group_api [None req-3aa3fffd-0c91-4fc6-816b-688d23ce7703 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Neutron security group does_not_exist not found {{(pid=122433) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 24 10:32:28.065765 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-3aa3fffd-0c91-4fc6-816b-688d23ce7703 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3aa3fffd-0c91-4fc6-816b-688d23ce7703 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 257 Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-265243961", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d"}]}} Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-265243961', 'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d'}]}}} Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 24 10:32:28.074066 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1061, in _validate_and_build_base_options Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 508, in _check_requested_secgroups Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:28.085862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3aa3fffd-0c91-4fc6-816b-688d23ce7703 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:28.098041 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3aa3fffd-0c91-4fc6-816b-688d23ce7703 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.497622 Aug 24 10:32:28.098041 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2227/4116] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:32:27 2022] POST /compute/v2.1/servers => generated 106 bytes in 502 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 10:32:28.098215 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-631b01fb-f956-4513-9ca0-bb39b3eeb6dd tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:28.098215 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-631b01fb-f956-4513-9ca0-bb39b3eeb6dd tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:28.110227 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-631b01fb-f956-4513-9ca0-bb39b3eeb6dd tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:28.111264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-631b01fb-f956-4513-9ca0-bb39b3eeb6dd tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:28.111862 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-631b01fb-f956-4513-9ca0-bb39b3eeb6dd tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:28.112774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-631b01fb-f956-4513-9ca0-bb39b3eeb6dd tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:28.113417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-631b01fb-f956-4513-9ca0-bb39b3eeb6dd tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:28.114012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-631b01fb-f956-4513-9ca0-bb39b3eeb6dd tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:28.548317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-631b01fb-f956-4513-9ca0-bb39b3eeb6dd tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:28.566550 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-631b01fb-f956-4513-9ca0-bb39b3eeb6dd tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.480637 Aug 24 10:32:28.567167 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1890/4117] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:28 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:28.589971 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-53ae94c4-734d-4d28-a43b-3f2747bbf653 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:28.591217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-53ae94c4-734d-4d28-a43b-3f2747bbf653 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:28.598223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53ae94c4-734d-4d28-a43b-3f2747bbf653 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:28.599006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53ae94c4-734d-4d28-a43b-3f2747bbf653 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:28.599622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53ae94c4-734d-4d28-a43b-3f2747bbf653 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:28.601355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53ae94c4-734d-4d28-a43b-3f2747bbf653 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:28.601977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53ae94c4-734d-4d28-a43b-3f2747bbf653 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:28.602560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53ae94c4-734d-4d28-a43b-3f2747bbf653 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:29.139549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-53ae94c4-734d-4d28-a43b-3f2747bbf653 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:29.148493 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-53ae94c4-734d-4d28-a43b-3f2747bbf653 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.562295 Aug 24 10:32:29.171487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b585a600-2662-41bd-aea3-fddda7fbd799 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:29.172664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b585a600-2662-41bd-aea3-fddda7fbd799 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: c972ada9-39af-4a14-bb6c-2b00e691e643] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:29.177486 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2228/4118] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:28 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:29.180886 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-b585a600-2662-41bd-aea3-fddda7fbd799 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Instance c972ada9-39af-4a14-bb6c-2b00e691e643 could not be found. Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b585a600-2662-41bd-aea3-fddda7fbd799 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/c972ada9-39af-4a14-bb6c-2b00e691e643 HTTP/1.1 Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance c972ada9-39af-4a14-bb6c-2b00e691e643 could not be found. Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'c972ada9-39af-4a14-bb6c-2b00e691e643'} Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c972ada9-39af-4a14-bb6c-2b00e691e643 could not be found. Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c972ada9-39af-4a14-bb6c-2b00e691e643 could not be found. Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:29.183008 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:29.186512 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:29.186512 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:29.186512 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:29.186512 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:29.186512 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:32:29.186512 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:32:29.186512 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c972ada9-39af-4a14-bb6c-2b00e691e643 could not be found. Aug 24 10:32:29.186512 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:29.188528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b585a600-2662-41bd-aea3-fddda7fbd799 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 404 to user: Instance c972ada9-39af-4a14-bb6c-2b00e691e643 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:29.189976 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b585a600-2662-41bd-aea3-fddda7fbd799 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "DELETE /compute/v2.1/servers/c972ada9-39af-4a14-bb6c-2b00e691e643" status: 404 len: 111 microversion: 2.1 time: 0.023880 Aug 24 10:32:29.199594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cd60376e-6ab4-4671-8812-5809a49b38cf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:29.200611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cd60376e-6ab4-4671-8812-5809a49b38cf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:29.202926 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1891/4119] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:32:29 2022] DELETE /compute/v2.1/servers/c972ada9-39af-4a14-bb6c-2b00e691e643 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:32:29.208953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd60376e-6ab4-4671-8812-5809a49b38cf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:29.209802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd60376e-6ab4-4671-8812-5809a49b38cf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:29.210459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd60376e-6ab4-4671-8812-5809a49b38cf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:29.211397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd60376e-6ab4-4671-8812-5809a49b38cf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:29.212132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd60376e-6ab4-4671-8812-5809a49b38cf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:29.212804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd60376e-6ab4-4671-8812-5809a49b38cf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:29.776169 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9f4535fd-2b22-4ee0-a643-197eb350fe01 req-2446f88b-ed51-431c-9d61-457e092864e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09f120f6-861a-4946-981b-47559a9c97fa", "tag": "29330474-2cf1-47be-ab26-0c24270c9a09"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:29.788541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cd60376e-6ab4-4671-8812-5809a49b38cf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:29.800456 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cd60376e-6ab4-4671-8812-5809a49b38cf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.604419 Aug 24 10:32:29.814427 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2229/4120] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:29 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:29.831913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9f4535fd-2b22-4ee0-a643-197eb350fe01 req-2446f88b-ed51-431c-9d61-457e092864e4 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:29.833716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9f4535fd-2b22-4ee0-a643-197eb350fe01 req-2446f88b-ed51-431c-9d61-457e092864e4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:29.834666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-db1271d4-9031-40d3-a960-a2df8e81b33c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:29.835382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9f4535fd-2b22-4ee0-a643-197eb350fe01 req-2446f88b-ed51-431c-9d61-457e092864e4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:29.836330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-db1271d4-9031-40d3-a960-a2df8e81b33c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:29.858921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db1271d4-9031-40d3-a960-a2df8e81b33c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:29.860469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db1271d4-9031-40d3-a960-a2df8e81b33c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:29.862092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db1271d4-9031-40d3-a960-a2df8e81b33c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:29.864986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db1271d4-9031-40d3-a960-a2df8e81b33c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:29.869380 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db1271d4-9031-40d3-a960-a2df8e81b33c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:29.870425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db1271d4-9031-40d3-a960-a2df8e81b33c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:29.875872 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9f4535fd-2b22-4ee0-a643-197eb350fe01 req-2446f88b-ed51-431c-9d61-457e092864e4 service nova] Creating event network-changed:29330474-2cf1-47be-ab26-0c24270c9a09 for instance 09f120f6-861a-4946-981b-47559a9c97fa on n-h2-849328-3 Aug 24 10:32:29.883555 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9f4535fd-2b22-4ee0-a643-197eb350fe01 req-2446f88b-ed51-431c-9d61-457e092864e4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.436321 Aug 24 10:32:29.891749 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1892/4121] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:32:30.481528 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-db1271d4-9031-40d3-a960-a2df8e81b33c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:30.531034 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-db1271d4-9031-40d3-a960-a2df8e81b33c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.699672 Aug 24 10:32:30.534324 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2230/4122] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:29 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:30.556116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f04d12c6-e638-4cac-b0e8-93d95ff34c1a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:30.557392 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f04d12c6-e638-4cac-b0e8-93d95ff34c1a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Failed to fetch instance by id 9223372036854775808 {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 24 10:32:30.558184 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-f04d12c6-e638-4cac-b0e8-93d95ff34c1a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f04d12c6-e638-4cac-b0e8-93d95ff34c1a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 9223372036854775808 could not be found. Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '9223372036854775808'} Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:30.560283 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:30.565707 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:30.565707 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:32:30.565707 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:32:30.565707 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 24 10:32:30.565707 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:30.565707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f04d12c6-e638-4cac-b0e8-93d95ff34c1a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:30.565707 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f04d12c6-e638-4cac-b0e8-93d95ff34c1a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.011087 Aug 24 10:32:30.565707 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1893/4123] 10.222.0.85 () {58 vars in 1188 bytes} [Wed Aug 24 10:32:30 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:32:30.575772 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0fbb7a9a-1593-4de2-aee9-fdf20f9d72bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:30.576399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0fbb7a9a-1593-4de2-aee9-fdf20f9d72bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:30.596500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fbb7a9a-1593-4de2-aee9-fdf20f9d72bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:30.596950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fbb7a9a-1593-4de2-aee9-fdf20f9d72bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:30.597455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fbb7a9a-1593-4de2-aee9-fdf20f9d72bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:30.603994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fbb7a9a-1593-4de2-aee9-fdf20f9d72bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:30.604536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fbb7a9a-1593-4de2-aee9-fdf20f9d72bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:30.605071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fbb7a9a-1593-4de2-aee9-fdf20f9d72bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:30.972454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0fbb7a9a-1593-4de2-aee9-fdf20f9d72bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:30.988479 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0fbb7a9a-1593-4de2-aee9-fdf20f9d72bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.416858 Aug 24 10:32:31.025543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-64d69650-fdf6-4be2-8c76-3cadd31bead5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:31.026689 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-64d69650-fdf6-4be2-8c76-3cadd31bead5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:31.030365 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2231/4124] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:30 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:31.044134 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64d69650-fdf6-4be2-8c76-3cadd31bead5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:31.044647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64d69650-fdf6-4be2-8c76-3cadd31bead5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:31.045219 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64d69650-fdf6-4be2-8c76-3cadd31bead5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:31.045980 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64d69650-fdf6-4be2-8c76-3cadd31bead5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:31.046451 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64d69650-fdf6-4be2-8c76-3cadd31bead5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:31.046937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64d69650-fdf6-4be2-8c76-3cadd31bead5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:31.598039 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-64d69650-fdf6-4be2-8c76-3cadd31bead5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:31.615118 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-64d69650-fdf6-4be2-8c76-3cadd31bead5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.595094 Aug 24 10:32:31.620310 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1894/4125] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:31 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:32:31.635545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ed25fd12-b9a2-44c7-97e2-b08b6ee512bc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:31.636266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ed25fd12-b9a2-44c7-97e2-b08b6ee512bc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Failed to fetch instance by id -1 {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 24 10:32:31.636971 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-ed25fd12-b9a2-44c7-97e2-b08b6ee512bc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Instance -1 could not be found. Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ed25fd12-b9a2-44c7-97e2-b08b6ee512bc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance -1 could not be found. Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '-1'} Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:31.638782 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:31.643436 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:32:31.643436 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:32:31.643436 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 24 10:32:31.643436 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:31.645111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ed25fd12-b9a2-44c7-97e2-b08b6ee512bc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 404 to user: Instance -1 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:31.647095 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ed25fd12-b9a2-44c7-97e2-b08b6ee512bc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.015639 Aug 24 10:32:31.653284 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2232/4126] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:32:31 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:32:31.662825 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a8eb17c4-8103-4e1d-8b51-42c633283c67 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:31.663590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a8eb17c4-8103-4e1d-8b51-42c633283c67 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:31.678735 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8eb17c4-8103-4e1d-8b51-42c633283c67 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:31.680756 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8eb17c4-8103-4e1d-8b51-42c633283c67 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:31.681434 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8eb17c4-8103-4e1d-8b51-42c633283c67 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:31.683375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8eb17c4-8103-4e1d-8b51-42c633283c67 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:31.684781 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8eb17c4-8103-4e1d-8b51-42c633283c67 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:31.689270 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8eb17c4-8103-4e1d-8b51-42c633283c67 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:32.780011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a8eb17c4-8103-4e1d-8b51-42c633283c67 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:32.796337 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a8eb17c4-8103-4e1d-8b51-42c633283c67 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 1.130869 Aug 24 10:32:32.813165 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1895/4127] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:31 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:32.820358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d2614e5e-a97f-4395-b647-d102088c8cd0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:32.820982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d2614e5e-a97f-4395-b647-d102088c8cd0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:32.842249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=78 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:32.846088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2614e5e-a97f-4395-b647-d102088c8cd0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:32.849601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2614e5e-a97f-4395-b647-d102088c8cd0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:32.850105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2614e5e-a97f-4395-b647-d102088c8cd0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:32.850886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2614e5e-a97f-4395-b647-d102088c8cd0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:32.853512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2614e5e-a97f-4395-b647-d102088c8cd0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:32.854027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2614e5e-a97f-4395-b647-d102088c8cd0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:33.144661 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d2614e5e-a97f-4395-b647-d102088c8cd0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:33.156212 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d2614e5e-a97f-4395-b647-d102088c8cd0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.341448 Aug 24 10:32:33.156892 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2233/4128] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:32 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:33.183585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-be45ba61-06f3-4275-a3d1-6507dc0454c0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:33.184189 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-be45ba61-06f3-4275-a3d1-6507dc0454c0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: ed1f8d2e-5360-44ae-bc14-2cc566f39c5a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:33.191658 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-be45ba61-06f3-4275-a3d1-6507dc0454c0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Instance ed1f8d2e-5360-44ae-bc14-2cc566f39c5a could not be found. Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-be45ba61-06f3-4275-a3d1-6507dc0454c0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/ed1f8d2e-5360-44ae-bc14-2cc566f39c5a/action HTTP/1.1 Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 19 Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: {"forceDelete": {}} Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance ed1f8d2e-5360-44ae-bc14-2cc566f39c5a could not be found. Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'ed1f8d2e-5360-44ae-bc14-2cc566f39c5a', 'body': {'forceDelete': {}}} Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed1f8d2e-5360-44ae-bc14-2cc566f39c5a could not be found. Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed1f8d2e-5360-44ae-bc14-2cc566f39c5a could not be found. Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:33.198172 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:33.204050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:32:33.204050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:32:33.204050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed1f8d2e-5360-44ae-bc14-2cc566f39c5a could not be found. Aug 24 10:32:33.204050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:33.206493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-be45ba61-06f3-4275-a3d1-6507dc0454c0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 404 to user: Instance ed1f8d2e-5360-44ae-bc14-2cc566f39c5a could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:33.208548 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-be45ba61-06f3-4275-a3d1-6507dc0454c0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers/ed1f8d2e-5360-44ae-bc14-2cc566f39c5a/action" status: 404 len: 111 microversion: 2.1 time: 0.028726 Aug 24 10:32:33.213327 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1896/4129] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:32:33 2022] POST /compute/v2.1/servers/ed1f8d2e-5360-44ae-bc14-2cc566f39c5a/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:32:33.227482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3d390431-1eea-4045-b860-f6f29e5c5ef3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:33.228195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3d390431-1eea-4045-b860-f6f29e5c5ef3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:33.237627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d390431-1eea-4045-b860-f6f29e5c5ef3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:33.238210 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d390431-1eea-4045-b860-f6f29e5c5ef3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:33.238716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d390431-1eea-4045-b860-f6f29e5c5ef3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:33.239719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d390431-1eea-4045-b860-f6f29e5c5ef3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:33.240272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d390431-1eea-4045-b860-f6f29e5c5ef3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:33.240971 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d390431-1eea-4045-b860-f6f29e5c5ef3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:33.479498 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f34d03a3-1092-4b8d-90ce-04056f750bbd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:33.479991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f34d03a3-1092-4b8d-90ce-04056f750bbd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:33.497290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f34d03a3-1092-4b8d-90ce-04056f750bbd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:33.497991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f34d03a3-1092-4b8d-90ce-04056f750bbd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:33.498581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f34d03a3-1092-4b8d-90ce-04056f750bbd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:33.499485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f34d03a3-1092-4b8d-90ce-04056f750bbd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:33.500090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f34d03a3-1092-4b8d-90ce-04056f750bbd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:33.500663 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f34d03a3-1092-4b8d-90ce-04056f750bbd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:33.507998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3d390431-1eea-4045-b860-f6f29e5c5ef3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:33.518180 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3d390431-1eea-4045-b860-f6f29e5c5ef3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.294704 Aug 24 10:32:33.521158 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2234/4130] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:33 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:33.526735 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-f34d03a3-1092-4b8d-90ce-04056f750bbd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] HTTP exception thrown: Instance 1ade0e12-9ac0-459f-8f85-6743432302fa could not be found. Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f34d03a3-1092-4b8d-90ce-04056f750bbd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Request method failure captured: Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa HTTP/1.1 Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBfx4u-J8d766els6qbuFq7WIlRl6XGRiDxNOiimlrnJtPjsYATm2JNe94EOkJ98NlOrdB8pE_oOaR9SQvpO21I7R6a0aeN7H61vjDHCaYX-To6KdJYvJIeAErBuVTZ72jxEXqzXjh-6Wtup4A0JgY8kh1PFp3s_Vrb1i40tiuubToRs Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: X-Openstack-Nova-Api-Version: 2.42 Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 3ace7124510e4aad905cbf22c7c77483 Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-269540293 Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3ace7124510e4aad905cbf22c7c77483"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3ace7124510e4aad905cbf22c7c77483", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3ace7124510e4aad905cbf22c7c77483"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3ace7124510e4aad905cbf22c7c77483"}]}] Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-TaggedBootDevicesTest_v242-269540293 Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 3ace7124510e4aad905cbf22c7c77483 Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-269540293 Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-TaggedBootDevicesTest_v242-269540293-project Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 24ba82263a7d4ee79bc04be46db8227a Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-TaggedBootDevicesTest_v242-269540293-project Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 1ade0e12-9ac0-459f-8f85-6743432302fa could not be found. Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '1ade0e12-9ac0-459f-8f85-6743432302fa'} Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ade0e12-9ac0-459f-8f85-6743432302fa could not be found. Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:32:33.528883 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:32:33.533878 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ade0e12-9ac0-459f-8f85-6743432302fa could not be found. Aug 24 10:32:33.533878 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:33.533878 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:33.533878 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:33.533878 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:33.533878 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:33.533878 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:33.533878 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:32:33.533878 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:32:33.533878 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ade0e12-9ac0-459f-8f85-6743432302fa could not be found. Aug 24 10:32:33.533878 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:33.533878 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f34d03a3-1092-4b8d-90ce-04056f750bbd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Returning 404 to user: Instance 1ade0e12-9ac0-459f-8f85-6743432302fa could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:33.535739 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f34d03a3-1092-4b8d-90ce-04056f750bbd tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "DELETE /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 404 len: 111 microversion: 2.42 time: 0.058896 Aug 24 10:32:33.535931 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1897/4131] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:32:33 2022] DELETE /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 10:32:33.545476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1fc80220-d6f1-4faf-90e0-24f8e2eaef78 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:33.546377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1fc80220-d6f1-4faf-90e0-24f8e2eaef78 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] [instance: 1ade0e12-9ac0-459f-8f85-6743432302fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:33.553592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fc80220-d6f1-4faf-90e0-24f8e2eaef78 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:33.554087 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fc80220-d6f1-4faf-90e0-24f8e2eaef78 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:33.554206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e3fc3386-784e-40de-bb47-a36b6f58b689 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:33.554527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fc80220-d6f1-4faf-90e0-24f8e2eaef78 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:33.554757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e3fc3386-784e-40de-bb47-a36b6f58b689 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:33.555598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fc80220-d6f1-4faf-90e0-24f8e2eaef78 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:33.556062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fc80220-d6f1-4faf-90e0-24f8e2eaef78 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:33.556693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fc80220-d6f1-4faf-90e0-24f8e2eaef78 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:33.562900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3fc3386-784e-40de-bb47-a36b6f58b689 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:33.564211 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3fc3386-784e-40de-bb47-a36b6f58b689 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:33.564883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3fc3386-784e-40de-bb47-a36b6f58b689 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:33.565796 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3fc3386-784e-40de-bb47-a36b6f58b689 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:33.566422 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3fc3386-784e-40de-bb47-a36b6f58b689 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:33.567017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3fc3386-784e-40de-bb47-a36b6f58b689 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:33.575816 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-1fc80220-d6f1-4faf-90e0-24f8e2eaef78 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] HTTP exception thrown: Instance 1ade0e12-9ac0-459f-8f85-6743432302fa could not be found. Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1fc80220-d6f1-4faf-90e0-24f8e2eaef78 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Request method failure captured: Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa HTTP/1.1 Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBfx4u-J8d766els6qbuFq7WIlRl6XGRiDxNOiimlrnJtPjsYATm2JNe94EOkJ98NlOrdB8pE_oOaR9SQvpO21I7R6a0aeN7H61vjDHCaYX-To6KdJYvJIeAErBuVTZ72jxEXqzXjh-6Wtup4A0JgY8kh1PFp3s_Vrb1i40tiuubToRs Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.42 Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 3ace7124510e4aad905cbf22c7c77483 Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-269540293 Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3ace7124510e4aad905cbf22c7c77483"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3ace7124510e4aad905cbf22c7c77483", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3ace7124510e4aad905cbf22c7c77483"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3ace7124510e4aad905cbf22c7c77483"}]}] Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TaggedBootDevicesTest_v242-269540293 Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 3ace7124510e4aad905cbf22c7c77483 Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-269540293 Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TaggedBootDevicesTest_v242-269540293-project Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 24ba82263a7d4ee79bc04be46db8227a Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TaggedBootDevicesTest_v242-269540293-project Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 1ade0e12-9ac0-459f-8f85-6743432302fa could not be found. Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '1ade0e12-9ac0-459f-8f85-6743432302fa'} Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ade0e12-9ac0-459f-8f85-6743432302fa could not be found. Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ade0e12-9ac0-459f-8f85-6743432302fa could not be found. Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:33.577876 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:33.583200 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:33.583200 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:33.583200 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:33.583200 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:33.583200 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:32:33.583200 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:32:33.583200 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ade0e12-9ac0-459f-8f85-6743432302fa could not be found. Aug 24 10:32:33.583200 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:33.583200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1fc80220-d6f1-4faf-90e0-24f8e2eaef78 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] Returning 404 to user: Instance 1ade0e12-9ac0-459f-8f85-6743432302fa could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:33.583200 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1fc80220-d6f1-4faf-90e0-24f8e2eaef78 tempest-TaggedBootDevicesTest_v242-269540293 tempest-TaggedBootDevicesTest_v242-269540293-project] 10.222.0.85 "GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa" status: 404 len: 111 microversion: 2.42 time: 0.038410 Aug 24 10:32:33.583200 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2235/4132] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:32:33 2022] GET /compute/v2.1/servers/1ade0e12-9ac0-459f-8f85-6743432302fa => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 10:32:34.119007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e3fc3386-784e-40de-bb47-a36b6f58b689 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:34.147511 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e3fc3386-784e-40de-bb47-a36b6f58b689 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.597049 Aug 24 10:32:34.151438 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1898/4133] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:33 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:34.177396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-69ac0360-513d-4010-9e85-41392b470326 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:34.181070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-69ac0360-513d-4010-9e85-41392b470326 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: d7f3c187-4fc7-495f-a771-22709d1c4085] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:34.190049 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-69ac0360-513d-4010-9e85-41392b470326 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Instance d7f3c187-4fc7-495f-a771-22709d1c4085 could not be found. Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-69ac0360-513d-4010-9e85-41392b470326 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/d7f3c187-4fc7-495f-a771-22709d1c4085/action HTTP/1.1 Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 39 Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: {"os-getConsoleOutput": {"length": 10}} Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance d7f3c187-4fc7-495f-a771-22709d1c4085 could not be found. Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'd7f3c187-4fc7-495f-a771-22709d1c4085', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7f3c187-4fc7-495f-a771-22709d1c4085 could not be found. Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7f3c187-4fc7-495f-a771-22709d1c4085 could not be found. Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:34.199927 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:34.204356 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:34.204356 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:34.204356 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:32:34.204356 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:32:34.204356 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7f3c187-4fc7-495f-a771-22709d1c4085 could not be found. Aug 24 10:32:34.204356 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:34.206286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-69ac0360-513d-4010-9e85-41392b470326 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 404 to user: Instance d7f3c187-4fc7-495f-a771-22709d1c4085 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:34.210828 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-69ac0360-513d-4010-9e85-41392b470326 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers/d7f3c187-4fc7-495f-a771-22709d1c4085/action" status: 404 len: 111 microversion: 2.1 time: 0.038974 Aug 24 10:32:34.211837 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2236/4134] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:32:34 2022] POST /compute/v2.1/servers/d7f3c187-4fc7-495f-a771-22709d1c4085/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:32:34.220750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fe10b1b2-3f26-4e56-941d-1901d3f41f14 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:34.221407 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fe10b1b2-3f26-4e56-941d-1901d3f41f14 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:34.242954 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe10b1b2-3f26-4e56-941d-1901d3f41f14 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:34.244033 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe10b1b2-3f26-4e56-941d-1901d3f41f14 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:34.244684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe10b1b2-3f26-4e56-941d-1901d3f41f14 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:34.245723 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe10b1b2-3f26-4e56-941d-1901d3f41f14 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:34.247671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe10b1b2-3f26-4e56-941d-1901d3f41f14 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:34.249014 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe10b1b2-3f26-4e56-941d-1901d3f41f14 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:34.751887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fe10b1b2-3f26-4e56-941d-1901d3f41f14 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:34.789015 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fe10b1b2-3f26-4e56-941d-1901d3f41f14 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.564401 Aug 24 10:32:34.814208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1d48bb15-177f-4d45-845d-c1ad1b57f660 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:34.815012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1d48bb15-177f-4d45-845d-c1ad1b57f660 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:34.826333 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1899/4135] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:34 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:34.842420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d48bb15-177f-4d45-845d-c1ad1b57f660 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:34.843810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d48bb15-177f-4d45-845d-c1ad1b57f660 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:34.844482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d48bb15-177f-4d45-845d-c1ad1b57f660 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:34.845713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d48bb15-177f-4d45-845d-c1ad1b57f660 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:34.846557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d48bb15-177f-4d45-845d-c1ad1b57f660 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:34.848785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d48bb15-177f-4d45-845d-c1ad1b57f660 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:35.105019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1d48bb15-177f-4d45-845d-c1ad1b57f660 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:35.120502 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1d48bb15-177f-4d45-845d-c1ad1b57f660 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.311561 Aug 24 10:32:35.121439 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2237/4136] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:34 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:35.140884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-855174dd-92f3-4754-9bc4-e913da49cc51 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:35.141768 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-855174dd-92f3-4754-9bc4-e913da49cc51 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: b02cd5e1-3528-4e9f-a50b-116c9209314d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:35.147997 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-855174dd-92f3-4754-9bc4-e913da49cc51 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Instance b02cd5e1-3528-4e9f-a50b-116c9209314d could not be found. Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-855174dd-92f3-4754-9bc4-e913da49cc51 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/b02cd5e1-3528-4e9f-a50b-116c9209314d HTTP/1.1 Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance b02cd5e1-3528-4e9f-a50b-116c9209314d could not be found. Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'b02cd5e1-3528-4e9f-a50b-116c9209314d'} Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b02cd5e1-3528-4e9f-a50b-116c9209314d could not be found. Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b02cd5e1-3528-4e9f-a50b-116c9209314d could not be found. Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:35.149714 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:35.154244 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:35.154244 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:32:35.154244 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:32:35.154244 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b02cd5e1-3528-4e9f-a50b-116c9209314d could not be found. Aug 24 10:32:35.154244 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:35.154244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-855174dd-92f3-4754-9bc4-e913da49cc51 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 404 to user: Instance b02cd5e1-3528-4e9f-a50b-116c9209314d could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:35.154244 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-855174dd-92f3-4754-9bc4-e913da49cc51 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/b02cd5e1-3528-4e9f-a50b-116c9209314d" status: 404 len: 111 microversion: 2.1 time: 0.014466 Aug 24 10:32:35.154244 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1900/4137] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:35 2022] GET /compute/v2.1/servers/b02cd5e1-3528-4e9f-a50b-116c9209314d => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:32:35.163258 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d831d4a7-db47-4d9e-a3f7-e22d6fb4fcec tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:35.164285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d831d4a7-db47-4d9e-a3f7-e22d6fb4fcec tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:35.174756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d831d4a7-db47-4d9e-a3f7-e22d6fb4fcec tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:35.177406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d831d4a7-db47-4d9e-a3f7-e22d6fb4fcec tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:35.178236 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d831d4a7-db47-4d9e-a3f7-e22d6fb4fcec tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:35.180749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d831d4a7-db47-4d9e-a3f7-e22d6fb4fcec tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:35.181670 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d831d4a7-db47-4d9e-a3f7-e22d6fb4fcec tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:35.182437 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d831d4a7-db47-4d9e-a3f7-e22d6fb4fcec tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:35.375320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d831d4a7-db47-4d9e-a3f7-e22d6fb4fcec tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:35.386729 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d831d4a7-db47-4d9e-a3f7-e22d6fb4fcec tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.230031 Aug 24 10:32:35.389186 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2238/4138] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:35 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:35.409693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-baa3105d-ab3a-49b3-8a49-318187138ce7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:35.410740 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-baa3105d-ab3a-49b3-8a49-318187138ce7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:35.419323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-baa3105d-ab3a-49b3-8a49-318187138ce7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:35.420164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-baa3105d-ab3a-49b3-8a49-318187138ce7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:35.420821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-baa3105d-ab3a-49b3-8a49-318187138ce7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:35.421822 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-baa3105d-ab3a-49b3-8a49-318187138ce7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:35.422676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-baa3105d-ab3a-49b3-8a49-318187138ce7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:35.423392 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-baa3105d-ab3a-49b3-8a49-318187138ce7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:35.835683 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-baa3105d-ab3a-49b3-8a49-318187138ce7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:35.845296 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-baa3105d-ab3a-49b3-8a49-318187138ce7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.439779 Aug 24 10:32:35.846299 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1901/4139] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:35 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:35.925661 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb6f3eae-c5f2-480d-9475-56e1fa65ce37 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-798792413", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb6f3eae-c5f2-480d-9475-56e1fa65ce37 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 237 Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-798792413", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d"}]}} Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-798792413', 'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d'}]}}} Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:35.949621 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:35.957090 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:35.957090 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:35.957090 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:35.957090 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:35.957090 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:35.957090 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:35.957090 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:35.957090 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:35.957090 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:32:35.957090 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:32:35.957090 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:32:35.957090 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:32:35.957090 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:32:35.957090 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:32:35.957090 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 24 10:32:35.957090 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:35.957090 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:35.957090 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:35.957090 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:35.957090 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:35.957090 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:35.957090 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:32:35.957090 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:32:35.957090 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 24 10:32:35.957090 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:35.970015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb6f3eae-c5f2-480d-9475-56e1fa65ce37 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:35.971545 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cb6f3eae-c5f2-480d-9475-56e1fa65ce37 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.052318 Aug 24 10:32:35.977912 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2239/4140] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:32:35 2022] POST /compute/v2.1/servers => generated 139 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:32:35.988520 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-96d76012-23fb-4208-bcd0-eedb491345da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:35.989583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-96d76012-23fb-4208-bcd0-eedb491345da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:35.997293 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96d76012-23fb-4208-bcd0-eedb491345da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:35.998747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96d76012-23fb-4208-bcd0-eedb491345da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:35.999361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96d76012-23fb-4208-bcd0-eedb491345da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:36.001699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96d76012-23fb-4208-bcd0-eedb491345da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:36.002665 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96d76012-23fb-4208-bcd0-eedb491345da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:36.004295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96d76012-23fb-4208-bcd0-eedb491345da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:36.292232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-96d76012-23fb-4208-bcd0-eedb491345da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:36.306787 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-96d76012-23fb-4208-bcd0-eedb491345da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.323269 Aug 24 10:32:36.307928 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1902/4141] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:35 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:36.337511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b21f7b3e-f215-4bb5-9281-f2dafce32286 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:36.338931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b21f7b3e-f215-4bb5-9281-f2dafce32286 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:36.359844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b21f7b3e-f215-4bb5-9281-f2dafce32286 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:36.360749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b21f7b3e-f215-4bb5-9281-f2dafce32286 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:36.361423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b21f7b3e-f215-4bb5-9281-f2dafce32286 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:36.362677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b21f7b3e-f215-4bb5-9281-f2dafce32286 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:36.363503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b21f7b3e-f215-4bb5-9281-f2dafce32286 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:36.364283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b21f7b3e-f215-4bb5-9281-f2dafce32286 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:37.245788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b21f7b3e-f215-4bb5-9281-f2dafce32286 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:37.259410 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b21f7b3e-f215-4bb5-9281-f2dafce32286 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.926958 Aug 24 10:32:37.260691 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2240/4142] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:36 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:37.358664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b14b70e7-5ed3-46f3-96d2-c3ea16be6a21 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1107997132", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b14b70e7-5ed3-46f3-96d2-c3ea16be6a21 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 235 Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1107997132", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d"}]}} Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1107997132', 'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d'}]}}} Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:37.377692 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:37.384680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:37.384680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:37.384680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:37.384680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:37.384680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:37.384680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:37.384680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:37.384680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:37.384680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:32:37.384680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:32:37.384680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:32:37.384680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:32:37.384680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:32:37.384680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:32:37.384680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 24 10:32:37.384680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:37.384680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:37.384680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:37.384680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:37.384680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:37.384680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:37.384680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:32:37.384680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:32:37.384680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 24 10:32:37.384680 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:37.390384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b14b70e7-5ed3-46f3-96d2-c3ea16be6a21 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:37.392230 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b14b70e7-5ed3-46f3-96d2-c3ea16be6a21 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.040246 Aug 24 10:32:37.396832 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1903/4143] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:32:37 2022] POST /compute/v2.1/servers => generated 133 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 10:32:37.410006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a1c6bf6e-1550-447d-bcf0-3b6c70a25985 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:37.411070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a1c6bf6e-1550-447d-bcf0-3b6c70a25985 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:37.435357 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1c6bf6e-1550-447d-bcf0-3b6c70a25985 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:37.436200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1c6bf6e-1550-447d-bcf0-3b6c70a25985 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:37.436933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1c6bf6e-1550-447d-bcf0-3b6c70a25985 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:37.438161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1c6bf6e-1550-447d-bcf0-3b6c70a25985 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:37.439272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1c6bf6e-1550-447d-bcf0-3b6c70a25985 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:37.440265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1c6bf6e-1550-447d-bcf0-3b6c70a25985 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:37.890129 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a1c6bf6e-1550-447d-bcf0-3b6c70a25985 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:37.904420 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a1c6bf6e-1550-447d-bcf0-3b6c70a25985 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.500900 Aug 24 10:32:37.905794 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2241/4144] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:37 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:37.928274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-10b1c127-a897-4b01-ad4a-eaf0edd5f61d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:37.929314 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-10b1c127-a897-4b01-ad4a-eaf0edd5f61d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:37.938371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10b1c127-a897-4b01-ad4a-eaf0edd5f61d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:37.939324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10b1c127-a897-4b01-ad4a-eaf0edd5f61d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:37.939765 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10b1c127-a897-4b01-ad4a-eaf0edd5f61d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:37.940478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10b1c127-a897-4b01-ad4a-eaf0edd5f61d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:37.940933 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10b1c127-a897-4b01-ad4a-eaf0edd5f61d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:37.941415 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10b1c127-a897-4b01-ad4a-eaf0edd5f61d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:38.154340 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-10b1c127-a897-4b01-ad4a-eaf0edd5f61d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:38.163840 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-10b1c127-a897-4b01-ad4a-eaf0edd5f61d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.240344 Aug 24 10:32:38.166327 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1904/4145] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:37 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:32:38.186938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-07c63722-7552-483f-aec9-14064c1097a5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:38.187818 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-07c63722-7552-483f-aec9-14064c1097a5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 961a620a-32cc-479c-b898-37702d48e2e8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:38.195345 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-07c63722-7552-483f-aec9-14064c1097a5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Instance 961a620a-32cc-479c-b898-37702d48e2e8 could not be found. Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-07c63722-7552-483f-aec9-14064c1097a5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/961a620a-32cc-479c-b898-37702d48e2e8/action HTTP/1.1 Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 13 Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: {"pause": {}} Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 961a620a-32cc-479c-b898-37702d48e2e8 could not be found. Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '961a620a-32cc-479c-b898-37702d48e2e8', 'body': {'pause': {}}} Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 961a620a-32cc-479c-b898-37702d48e2e8 could not be found. Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 961a620a-32cc-479c-b898-37702d48e2e8 could not be found. Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:38.205137 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:38.216826 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:32:38.216826 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:32:38.216826 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 961a620a-32cc-479c-b898-37702d48e2e8 could not be found. Aug 24 10:32:38.216826 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:38.216826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-07c63722-7552-483f-aec9-14064c1097a5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 404 to user: Instance 961a620a-32cc-479c-b898-37702d48e2e8 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:38.216826 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-07c63722-7552-483f-aec9-14064c1097a5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers/961a620a-32cc-479c-b898-37702d48e2e8/action" status: 404 len: 111 microversion: 2.1 time: 0.024831 Aug 24 10:32:38.219238 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2242/4146] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:32:38 2022] POST /compute/v2.1/servers/961a620a-32cc-479c-b898-37702d48e2e8/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:32:38.219899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a73f2046-0f09-4edb-a8a0-d3df7dc8ab13 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:38.220518 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a73f2046-0f09-4edb-a8a0-d3df7dc8ab13 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:38.230568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a73f2046-0f09-4edb-a8a0-d3df7dc8ab13 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:38.232855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a73f2046-0f09-4edb-a8a0-d3df7dc8ab13 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:38.233220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a73f2046-0f09-4edb-a8a0-d3df7dc8ab13 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:38.234770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a73f2046-0f09-4edb-a8a0-d3df7dc8ab13 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:38.238361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a73f2046-0f09-4edb-a8a0-d3df7dc8ab13 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:38.238841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a73f2046-0f09-4edb-a8a0-d3df7dc8ab13 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:38.567266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a73f2046-0f09-4edb-a8a0-d3df7dc8ab13 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:38.582973 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a73f2046-0f09-4edb-a8a0-d3df7dc8ab13 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.367286 Aug 24 10:32:38.583616 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1905/4147] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:38 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:32:38.605365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e3175fa6-dc8a-4caf-953d-1494bc5046bd tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:38.606650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e3175fa6-dc8a-4caf-953d-1494bc5046bd tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:38.615337 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3175fa6-dc8a-4caf-953d-1494bc5046bd tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:38.616063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3175fa6-dc8a-4caf-953d-1494bc5046bd tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:38.616678 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3175fa6-dc8a-4caf-953d-1494bc5046bd tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:38.617622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3175fa6-dc8a-4caf-953d-1494bc5046bd tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:38.618233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3175fa6-dc8a-4caf-953d-1494bc5046bd tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:38.618816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3175fa6-dc8a-4caf-953d-1494bc5046bd tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:39.021644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e3175fa6-dc8a-4caf-953d-1494bc5046bd tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:39.044822 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e3175fa6-dc8a-4caf-953d-1494bc5046bd tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.443352 Aug 24 10:32:39.065269 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2243/4148] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:38 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:39.071263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0ebec22e-50c3-49a2-864f-48a44a2af39a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:39.071702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0ebec22e-50c3-49a2-864f-48a44a2af39a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:39.081655 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ebec22e-50c3-49a2-864f-48a44a2af39a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:39.082128 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ebec22e-50c3-49a2-864f-48a44a2af39a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:39.082566 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ebec22e-50c3-49a2-864f-48a44a2af39a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:39.083306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ebec22e-50c3-49a2-864f-48a44a2af39a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:39.083745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ebec22e-50c3-49a2-864f-48a44a2af39a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:39.084181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ebec22e-50c3-49a2-864f-48a44a2af39a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:39.251088 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0ebec22e-50c3-49a2-864f-48a44a2af39a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action" status: 202 len: 0 microversion: 2.1 time: 0.180865 Aug 24 10:32:39.252862 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1906/4149] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:32:39 2022] POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 10:32:39.263418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6ae0a907-781d-4d9b-aa21-0fcf494fd646 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:39.264973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6ae0a907-781d-4d9b-aa21-0fcf494fd646 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:39.275730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ae0a907-781d-4d9b-aa21-0fcf494fd646 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:39.277725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ae0a907-781d-4d9b-aa21-0fcf494fd646 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:39.291961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ae0a907-781d-4d9b-aa21-0fcf494fd646 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:39.292909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ae0a907-781d-4d9b-aa21-0fcf494fd646 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:39.296205 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ae0a907-781d-4d9b-aa21-0fcf494fd646 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:39.296749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ae0a907-781d-4d9b-aa21-0fcf494fd646 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:39.693989 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6ae0a907-781d-4d9b-aa21-0fcf494fd646 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:39.717291 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6ae0a907-781d-4d9b-aa21-0fcf494fd646 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1511 microversion: 2.1 time: 0.458122 Aug 24 10:32:39.718164 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2244/4150] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:39 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1511 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:40.743631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-52d5eb40-cc2a-4a71-9ab5-b109a0244adb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:40.744592 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-52d5eb40-cc2a-4a71-9ab5-b109a0244adb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:40.771845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52d5eb40-cc2a-4a71-9ab5-b109a0244adb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:40.780503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52d5eb40-cc2a-4a71-9ab5-b109a0244adb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:40.786771 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52d5eb40-cc2a-4a71-9ab5-b109a0244adb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:40.787672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52d5eb40-cc2a-4a71-9ab5-b109a0244adb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:40.791520 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52d5eb40-cc2a-4a71-9ab5-b109a0244adb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:40.794819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52d5eb40-cc2a-4a71-9ab5-b109a0244adb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:41.232375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-52d5eb40-cc2a-4a71-9ab5-b109a0244adb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:41.241827 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-52d5eb40-cc2a-4a71-9ab5-b109a0244adb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1491 microversion: 2.1 time: 0.503424 Aug 24 10:32:41.243454 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1907/4151] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:40 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1491 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:41.277002 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e3de8f41-bc56-49f7-bc79-cfb9e9c9449d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:41.279567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e3de8f41-bc56-49f7-bc79-cfb9e9c9449d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:41.293867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3de8f41-bc56-49f7-bc79-cfb9e9c9449d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:41.294808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3de8f41-bc56-49f7-bc79-cfb9e9c9449d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:41.295551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3de8f41-bc56-49f7-bc79-cfb9e9c9449d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:41.296508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3de8f41-bc56-49f7-bc79-cfb9e9c9449d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:41.297406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3de8f41-bc56-49f7-bc79-cfb9e9c9449d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:41.298312 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3de8f41-bc56-49f7-bc79-cfb9e9c9449d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:41.341535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:41.348388 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-e3de8f41-bc56-49f7-bc79-cfb9e9c9449d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Cannot 'pause' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state paused Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e3de8f41-bc56-49f7-bc79-cfb9e9c9449d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action HTTP/1.1 Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 13 Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: {"pause": {}} Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: exception: Cannot 'pause' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state paused Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '8fb1d6b5-a27c-465a-aa10-652d2cc366ae', 'body': {'pause': {}}} Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae in vm_state paused. Cannot pause while the instance is in this state. Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state paused Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:41.350461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:41.357950 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:41.357950 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:32:41.357950 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:32:41.357950 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state paused Aug 24 10:32:41.357950 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:41.359703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e3de8f41-bc56-49f7-bc79-cfb9e9c9449d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 409 to user: Cannot 'pause' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state paused {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:41.361205 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e3de8f41-bc56-49f7-bc79-cfb9e9c9449d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action" status: 409 len: 143 microversion: 2.1 time: 0.090051 Aug 24 10:32:41.366742 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2245/4152] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:32:41 2022] POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action => generated 143 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:32:41.372355 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-12215b81-2c08-493e-bf12-22e0fb991d24 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:41.372813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-12215b81-2c08-493e-bf12-22e0fb991d24 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:41.385226 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12215b81-2c08-493e-bf12-22e0fb991d24 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:41.387267 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12215b81-2c08-493e-bf12-22e0fb991d24 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:41.388223 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12215b81-2c08-493e-bf12-22e0fb991d24 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:41.389432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12215b81-2c08-493e-bf12-22e0fb991d24 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:41.390782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12215b81-2c08-493e-bf12-22e0fb991d24 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:41.392494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12215b81-2c08-493e-bf12-22e0fb991d24 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:41.627586 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-12215b81-2c08-493e-bf12-22e0fb991d24 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action" status: 202 len: 0 microversion: 2.1 time: 0.259930 Aug 24 10:32:41.628741 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1908/4153] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:32:41 2022] POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:32:41.640425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-db7fa922-c5ea-40b1-a81a-cce5bed0bff7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:41.641062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-db7fa922-c5ea-40b1-a81a-cce5bed0bff7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:41.650244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db7fa922-c5ea-40b1-a81a-cce5bed0bff7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:41.651169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db7fa922-c5ea-40b1-a81a-cce5bed0bff7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:41.651822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db7fa922-c5ea-40b1-a81a-cce5bed0bff7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:41.653054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db7fa922-c5ea-40b1-a81a-cce5bed0bff7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:41.653837 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db7fa922-c5ea-40b1-a81a-cce5bed0bff7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:41.655123 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db7fa922-c5ea-40b1-a81a-cce5bed0bff7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:42.186303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-db7fa922-c5ea-40b1-a81a-cce5bed0bff7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:42.204579 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-db7fa922-c5ea-40b1-a81a-cce5bed0bff7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1498 microversion: 2.1 time: 0.569151 Aug 24 10:32:42.216281 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2246/4154] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:41 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1498 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:43.245590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3a77c1c4-6d20-4d3c-ac48-04c211cfbc03 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:43.246394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3a77c1c4-6d20-4d3c-ac48-04c211cfbc03 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:43.254444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a77c1c4-6d20-4d3c-ac48-04c211cfbc03 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:43.254943 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a77c1c4-6d20-4d3c-ac48-04c211cfbc03 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:43.255384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a77c1c4-6d20-4d3c-ac48-04c211cfbc03 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:43.256451 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a77c1c4-6d20-4d3c-ac48-04c211cfbc03 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:43.256568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a77c1c4-6d20-4d3c-ac48-04c211cfbc03 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:43.256975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a77c1c4-6d20-4d3c-ac48-04c211cfbc03 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:43.578365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3a77c1c4-6d20-4d3c-ac48-04c211cfbc03 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:43.602925 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3a77c1c4-6d20-4d3c-ac48-04c211cfbc03 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.361800 Aug 24 10:32:43.603559 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1909/4155] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:43 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:43.630196 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-51e0f274-bbf9-4066-b822-4ec30f79c704 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:43.631061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-51e0f274-bbf9-4066-b822-4ec30f79c704 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:43.642333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51e0f274-bbf9-4066-b822-4ec30f79c704 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:43.642711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51e0f274-bbf9-4066-b822-4ec30f79c704 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:43.643157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51e0f274-bbf9-4066-b822-4ec30f79c704 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:43.643910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51e0f274-bbf9-4066-b822-4ec30f79c704 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:43.644343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51e0f274-bbf9-4066-b822-4ec30f79c704 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:43.644774 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51e0f274-bbf9-4066-b822-4ec30f79c704 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:43.909684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-51e0f274-bbf9-4066-b822-4ec30f79c704 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:43.933515 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-51e0f274-bbf9-4066-b822-4ec30f79c704 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.307026 Aug 24 10:32:43.934111 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2247/4156] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:43 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:43.973861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7cb8dd12-4158-41f6-8a64-5f2363e16f3a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:43.976645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7cb8dd12-4158-41f6-8a64-5f2363e16f3a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 33162162-c8fe-4f85-9f88-ff2452cfab95] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:43.992706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cb8dd12-4158-41f6-8a64-5f2363e16f3a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:43.994854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cb8dd12-4158-41f6-8a64-5f2363e16f3a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:43.997394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cb8dd12-4158-41f6-8a64-5f2363e16f3a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:43.998172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cb8dd12-4158-41f6-8a64-5f2363e16f3a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:43.999389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cb8dd12-4158-41f6-8a64-5f2363e16f3a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:44.000173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cb8dd12-4158-41f6-8a64-5f2363e16f3a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:44.034598 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-7cb8dd12-4158-41f6-8a64-5f2363e16f3a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7cb8dd12-4158-41f6-8a64-5f2363e16f3a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95/action HTTP/1.1 Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 28 Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: {"reboot": {"type": "SOFT"}} Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '33162162-c8fe-4f85-9f88-ff2452cfab95', 'body': {'reboot': {'type': 'SOFT'}}} Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:32:44.039136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:32:44.042800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. Aug 24 10:32:44.042800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:44.042800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:44.042800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:44.042800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:44.042800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:44.042800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:44.042800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:32:44.042800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:32:44.042800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. Aug 24 10:32:44.042800 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:44.045371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7cb8dd12-4158-41f6-8a64-5f2363e16f3a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 404 to user: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:44.050577 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7cb8dd12-4158-41f6-8a64-5f2363e16f3a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95/action" status: 404 len: 111 microversion: 2.1 time: 0.094769 Aug 24 10:32:44.052702 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1910/4157] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:32:43 2022] POST /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95/action => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:32:44.061383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-45fd8e9e-6132-403f-a2e2-0dd0333a74c3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:44.062335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-45fd8e9e-6132-403f-a2e2-0dd0333a74c3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:44.071961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45fd8e9e-6132-403f-a2e2-0dd0333a74c3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:44.072458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45fd8e9e-6132-403f-a2e2-0dd0333a74c3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:44.072895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45fd8e9e-6132-403f-a2e2-0dd0333a74c3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:44.073628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45fd8e9e-6132-403f-a2e2-0dd0333a74c3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:44.074083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45fd8e9e-6132-403f-a2e2-0dd0333a74c3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:44.074504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45fd8e9e-6132-403f-a2e2-0dd0333a74c3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:44.907538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-45fd8e9e-6132-403f-a2e2-0dd0333a74c3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:44.926264 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-45fd8e9e-6132-403f-a2e2-0dd0333a74c3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.870278 Aug 24 10:32:44.926888 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2248/4158] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:44 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:44.951638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8b2ab9a3-a7fa-4a52-b3ce-89ea1e504773 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:44.952244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8b2ab9a3-a7fa-4a52-b3ce-89ea1e504773 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:44.970413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b2ab9a3-a7fa-4a52-b3ce-89ea1e504773 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:44.971071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b2ab9a3-a7fa-4a52-b3ce-89ea1e504773 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:44.971824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b2ab9a3-a7fa-4a52-b3ce-89ea1e504773 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:44.974203 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b2ab9a3-a7fa-4a52-b3ce-89ea1e504773 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:44.974695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b2ab9a3-a7fa-4a52-b3ce-89ea1e504773 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:44.975136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b2ab9a3-a7fa-4a52-b3ce-89ea1e504773 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:45.025452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:45.051189 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-47a736cb-39bc-4de6-bd21-f78a7bc47ed4 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:45.066757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-47a736cb-39bc-4de6-bd21-f78a7bc47ed4 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:45.067959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-47a736cb-39bc-4de6-bd21-f78a7bc47ed4 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Searching by: {'deleted': False, 'project_id': '87126fba5c074971a9c3c41de4164571'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:32:45.078575 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47a736cb-39bc-4de6-bd21-f78a7bc47ed4 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:45.079454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47a736cb-39bc-4de6-bd21-f78a7bc47ed4 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:45.080303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47a736cb-39bc-4de6-bd21-f78a7bc47ed4 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:45.081357 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47a736cb-39bc-4de6-bd21-f78a7bc47ed4 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:45.082077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47a736cb-39bc-4de6-bd21-f78a7bc47ed4 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:45.082977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47a736cb-39bc-4de6-bd21-f78a7bc47ed4 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:45.151771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-47a736cb-39bc-4de6-bd21-f78a7bc47ed4 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:32:45.220975 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-47a736cb-39bc-4de6-bd21-f78a7bc47ed4 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.176769 Aug 24 10:32:45.222581 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2249/4159] 10.222.0.85 () {58 vars in 1125 bytes} [Wed Aug 24 10:32:45 2022] GET /compute/v2.1/servers => generated 344 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:32:45.246706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1676d381-a591-40c4-8afc-82a1ffd4022f tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:45.261455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1676d381-a591-40c4-8afc-82a1ffd4022f tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:45.263479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1676d381-a591-40c4-8afc-82a1ffd4022f tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Searching by: {'deleted': False, 'project_id': '87126fba5c074971a9c3c41de4164571'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:32:45.271083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1676d381-a591-40c4-8afc-82a1ffd4022f tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:45.271920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1676d381-a591-40c4-8afc-82a1ffd4022f tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:45.272572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1676d381-a591-40c4-8afc-82a1ffd4022f tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:45.273558 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1676d381-a591-40c4-8afc-82a1ffd4022f tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:45.274478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1676d381-a591-40c4-8afc-82a1ffd4022f tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:45.275094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1676d381-a591-40c4-8afc-82a1ffd4022f tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:45.310963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-1676d381-a591-40c4-8afc-82a1ffd4022f tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:32:45.371921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1676d381-a591-40c4-8afc-82a1ffd4022f tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:45.381541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1676d381-a591-40c4-8afc-82a1ffd4022f tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:45.382310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1676d381-a591-40c4-8afc-82a1ffd4022f tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:45.383021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1676d381-a591-40c4-8afc-82a1ffd4022f tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:45.564159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8b2ab9a3-a7fa-4a52-b3ce-89ea1e504773 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:45.606355 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8b2ab9a3-a7fa-4a52-b3ce-89ea1e504773 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.655770 Aug 24 10:32:45.610621 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1911/4160] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:44 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:45.626370 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1676d381-a591-40c4-8afc-82a1ffd4022f tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.389403 Aug 24 10:32:45.627165 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2250/4161] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:32:45 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:45.651034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-30c4eaab-1af1-41a4-ba65-22b4d28a94e4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:45.654299 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-30c4eaab-1af1-41a4-ba65-22b4d28a94e4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 5bed3002-a34f-46d0-9a5d-c486c327a7ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:45.663213 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-df594b0c-2306-42a4-87f3-19786f1304a5 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:45.684916 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-30c4eaab-1af1-41a4-ba65-22b4d28a94e4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Instance 5bed3002-a34f-46d0-9a5d-c486c327a7ab could not be found. Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-30c4eaab-1af1-41a4-ba65-22b4d28a94e4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/5bed3002-a34f-46d0-9a5d-c486c327a7ab/action HTTP/1.1 Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 28 Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: {"reboot": {"type": "SOFT"}} Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 5bed3002-a34f-46d0-9a5d-c486c327a7ab could not be found. Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '5bed3002-a34f-46d0-9a5d-c486c327a7ab', 'body': {'reboot': {'type': 'SOFT'}}} Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bed3002-a34f-46d0-9a5d-c486c327a7ab could not be found. Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bed3002-a34f-46d0-9a5d-c486c327a7ab could not be found. Aug 24 10:32:45.686921 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:45.697300 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:45.697300 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:45.697300 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:45.697300 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:45.697300 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:45.697300 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:32:45.697300 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:32:45.697300 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bed3002-a34f-46d0-9a5d-c486c327a7ab could not be found. Aug 24 10:32:45.697300 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:45.697300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-30c4eaab-1af1-41a4-ba65-22b4d28a94e4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 404 to user: Instance 5bed3002-a34f-46d0-9a5d-c486c327a7ab could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:45.701824 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-df594b0c-2306-42a4-87f3-19786f1304a5 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.041664 Aug 24 10:32:45.701824 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2251/4162] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:32:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:32:45.703468 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-30c4eaab-1af1-41a4-ba65-22b4d28a94e4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers/5bed3002-a34f-46d0-9a5d-c486c327a7ab/action" status: 404 len: 111 microversion: 2.1 time: 0.055495 Aug 24 10:32:45.707524 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1912/4163] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:32:45 2022] POST /compute/v2.1/servers/5bed3002-a34f-46d0-9a5d-c486c327a7ab/action => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:32:45.715725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aa975058-3bb3-44c0-892a-76b9cdd684d6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:45.716746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aa975058-3bb3-44c0-892a-76b9cdd684d6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:45.738159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa975058-3bb3-44c0-892a-76b9cdd684d6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:45.739120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa975058-3bb3-44c0-892a-76b9cdd684d6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:45.739821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa975058-3bb3-44c0-892a-76b9cdd684d6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:45.741190 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa975058-3bb3-44c0-892a-76b9cdd684d6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:45.743855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa975058-3bb3-44c0-892a-76b9cdd684d6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:45.744628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa975058-3bb3-44c0-892a-76b9cdd684d6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:46.200510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-036c3597-ed66-49d5-87d4-ffd039f45deb tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:46.202893 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-036c3597-ed66-49d5-87d4-ffd039f45deb tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:46.246453 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-036c3597-ed66-49d5-87d4-ffd039f45deb tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:46.246985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-036c3597-ed66-49d5-87d4-ffd039f45deb tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:46.261226 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-036c3597-ed66-49d5-87d4-ffd039f45deb tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:46.262110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-036c3597-ed66-49d5-87d4-ffd039f45deb tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:46.274048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-036c3597-ed66-49d5-87d4-ffd039f45deb tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:46.274510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-036c3597-ed66-49d5-87d4-ffd039f45deb tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:46.316696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aa975058-3bb3-44c0-892a-76b9cdd684d6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:46.327895 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aa975058-3bb3-44c0-892a-76b9cdd684d6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.616365 Aug 24 10:32:46.354220 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2252/4164] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:45 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:46.359914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-036c3597-ed66-49d5-87d4-ffd039f45deb tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:32:46.369909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-111a449e-bfa6-4f9f-96a2-d775e1379d31 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:46.370531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-111a449e-bfa6-4f9f-96a2-d775e1379d31 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:46.394646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-111a449e-bfa6-4f9f-96a2-d775e1379d31 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:46.397186 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-111a449e-bfa6-4f9f-96a2-d775e1379d31 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:46.397972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-111a449e-bfa6-4f9f-96a2-d775e1379d31 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:46.399188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-111a449e-bfa6-4f9f-96a2-d775e1379d31 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:46.399935 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-111a449e-bfa6-4f9f-96a2-d775e1379d31 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:46.400634 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-111a449e-bfa6-4f9f-96a2-d775e1379d31 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:46.518237 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-036c3597-ed66-49d5-87d4-ffd039f45deb tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 204 len: 0 microversion: 2.1 time: 0.322805 Aug 24 10:32:46.521564 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1913/4165] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:32:46 2022] DELETE /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:32:46.534349 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fa656d6b-5b6e-4133-99a8-5aa024d270ba tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:46.539829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fa656d6b-5b6e-4133-99a8-5aa024d270ba tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:46.551983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa656d6b-5b6e-4133-99a8-5aa024d270ba tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:46.555831 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa656d6b-5b6e-4133-99a8-5aa024d270ba tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:46.556512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa656d6b-5b6e-4133-99a8-5aa024d270ba tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:46.558250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa656d6b-5b6e-4133-99a8-5aa024d270ba tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:46.558927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa656d6b-5b6e-4133-99a8-5aa024d270ba tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:46.560087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa656d6b-5b6e-4133-99a8-5aa024d270ba tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:46.882610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fa656d6b-5b6e-4133-99a8-5aa024d270ba tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:46.902606 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fa656d6b-5b6e-4133-99a8-5aa024d270ba tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1608 microversion: 2.1 time: 0.376518 Aug 24 10:32:46.922376 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1914/4166] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:46 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1608 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:47.119660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-111a449e-bfa6-4f9f-96a2-d775e1379d31 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:47.134762 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-111a449e-bfa6-4f9f-96a2-d775e1379d31 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.778596 Aug 24 10:32:47.135564 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2253/4167] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:46 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:47.165682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a55513aa-294f-44c1-882c-49e71f8668ed tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:47.183002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a55513aa-294f-44c1-882c-49e71f8668ed tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 33162162-c8fe-4f85-9f88-ff2452cfab95] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:47.186597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:47.216812 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a55513aa-294f-44c1-882c-49e71f8668ed tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:47.218275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a55513aa-294f-44c1-882c-49e71f8668ed tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:47.218903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a55513aa-294f-44c1-882c-49e71f8668ed tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:47.219849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a55513aa-294f-44c1-882c-49e71f8668ed tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:47.220601 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a55513aa-294f-44c1-882c-49e71f8668ed tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:47.221367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a55513aa-294f-44c1-882c-49e71f8668ed tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:47.252694 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-a55513aa-294f-44c1-882c-49e71f8668ed tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a55513aa-294f-44c1-882c-49e71f8668ed tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95/action HTTP/1.1 Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 65 Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: {"rebuild": {"imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af"}} Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '33162162-c8fe-4f85-9f88-ff2452cfab95', 'body': {'rebuild': {'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af'}}} Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 24 10:32:47.255025 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 24 10:32:47.259021 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 24 10:32:47.259021 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:32:47.259021 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:32:47.259021 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:32:47.259021 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:32:47.259021 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. Aug 24 10:32:47.259021 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:47.259021 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:47.259021 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:47.259021 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:47.259021 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:47.259021 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:47.259021 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:32:47.259021 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:32:47.259021 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. Aug 24 10:32:47.259021 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:47.261285 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a55513aa-294f-44c1-882c-49e71f8668ed tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 404 to user: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:47.262407 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a55513aa-294f-44c1-882c-49e71f8668ed tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95/action" status: 404 len: 111 microversion: 2.1 time: 0.103632 Aug 24 10:32:47.267139 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1915/4168] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:32:47 2022] POST /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95/action => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:32:47.273709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9bdb4162-cb5f-4e4e-8ac9-1489ffc215b6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:47.274434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9bdb4162-cb5f-4e4e-8ac9-1489ffc215b6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:47.290626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bdb4162-cb5f-4e4e-8ac9-1489ffc215b6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:47.300262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bdb4162-cb5f-4e4e-8ac9-1489ffc215b6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:47.301190 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bdb4162-cb5f-4e4e-8ac9-1489ffc215b6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:47.302506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bdb4162-cb5f-4e4e-8ac9-1489ffc215b6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:47.330939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bdb4162-cb5f-4e4e-8ac9-1489ffc215b6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:47.331686 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bdb4162-cb5f-4e4e-8ac9-1489ffc215b6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:47.874709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9bdb4162-cb5f-4e4e-8ac9-1489ffc215b6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:47.890466 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9bdb4162-cb5f-4e4e-8ac9-1489ffc215b6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.622245 Aug 24 10:32:47.891899 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2254/4169] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:47 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:47.925803 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1b29038a-b71d-4726-8fcf-3bd35d8a9b58 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:47.926656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1b29038a-b71d-4726-8fcf-3bd35d8a9b58 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:47.928073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-27bf29eb-a2c2-4e03-93d0-81ead2713f6f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:47.931936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-27bf29eb-a2c2-4e03-93d0-81ead2713f6f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:47.938193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b29038a-b71d-4726-8fcf-3bd35d8a9b58 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:47.939212 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b29038a-b71d-4726-8fcf-3bd35d8a9b58 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:47.944558 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b29038a-b71d-4726-8fcf-3bd35d8a9b58 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:47.946043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b29038a-b71d-4726-8fcf-3bd35d8a9b58 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:47.946543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b29038a-b71d-4726-8fcf-3bd35d8a9b58 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:47.947284 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b29038a-b71d-4726-8fcf-3bd35d8a9b58 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:47.952581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27bf29eb-a2c2-4e03-93d0-81ead2713f6f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:47.958095 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27bf29eb-a2c2-4e03-93d0-81ead2713f6f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:47.964636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27bf29eb-a2c2-4e03-93d0-81ead2713f6f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:47.967431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27bf29eb-a2c2-4e03-93d0-81ead2713f6f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:47.967431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27bf29eb-a2c2-4e03-93d0-81ead2713f6f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:47.967431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27bf29eb-a2c2-4e03-93d0-81ead2713f6f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:48.338075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1b29038a-b71d-4726-8fcf-3bd35d8a9b58 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:48.359861 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1b29038a-b71d-4726-8fcf-3bd35d8a9b58 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1608 microversion: 2.1 time: 0.436014 Aug 24 10:32:48.363203 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2255/4170] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:47 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1608 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:32:48.442069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-27bf29eb-a2c2-4e03-93d0-81ead2713f6f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:48.465439 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-27bf29eb-a2c2-4e03-93d0-81ead2713f6f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.550968 Aug 24 10:32:48.467657 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1916/4171] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:47 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:48.498817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-55c714a1-1726-4ba7-b10a-03e053e6e4d7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:48.502222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-55c714a1-1726-4ba7-b10a-03e053e6e4d7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 6b148ed6-3e93-4bbd-bfa3-db71653166a4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:48.516788 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-55c714a1-1726-4ba7-b10a-03e053e6e4d7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Instance 6b148ed6-3e93-4bbd-bfa3-db71653166a4 could not be found. Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-55c714a1-1726-4ba7-b10a-03e053e6e4d7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/6b148ed6-3e93-4bbd-bfa3-db71653166a4/action HTTP/1.1 Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 65 Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: {"rebuild": {"imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af"}} Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 6b148ed6-3e93-4bbd-bfa3-db71653166a4 could not be found. Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '6b148ed6-3e93-4bbd-bfa3-db71653166a4', 'body': {'rebuild': {'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af'}}} Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b148ed6-3e93-4bbd-bfa3-db71653166a4 could not be found. Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 24 10:32:48.518744 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:32:48.522437 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:32:48.522437 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:32:48.522437 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:32:48.522437 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b148ed6-3e93-4bbd-bfa3-db71653166a4 could not be found. Aug 24 10:32:48.522437 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:48.522437 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:48.522437 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:48.522437 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:48.522437 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:48.522437 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:48.522437 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:32:48.522437 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:32:48.522437 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b148ed6-3e93-4bbd-bfa3-db71653166a4 could not be found. Aug 24 10:32:48.522437 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:48.524793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-55c714a1-1726-4ba7-b10a-03e053e6e4d7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 404 to user: Instance 6b148ed6-3e93-4bbd-bfa3-db71653166a4 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:48.525717 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-55c714a1-1726-4ba7-b10a-03e053e6e4d7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers/6b148ed6-3e93-4bbd-bfa3-db71653166a4/action" status: 404 len: 111 microversion: 2.1 time: 0.031064 Aug 24 10:32:48.530002 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2256/4172] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:32:48 2022] POST /compute/v2.1/servers/6b148ed6-3e93-4bbd-bfa3-db71653166a4/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:32:48.545750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0f753a4b-3e95-4c5d-9454-37419c41b5b5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:48.550558 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0f753a4b-3e95-4c5d-9454-37419c41b5b5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:48.623506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f753a4b-3e95-4c5d-9454-37419c41b5b5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:48.624421 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f753a4b-3e95-4c5d-9454-37419c41b5b5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:48.625290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f753a4b-3e95-4c5d-9454-37419c41b5b5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:48.626676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f753a4b-3e95-4c5d-9454-37419c41b5b5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:48.634438 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f753a4b-3e95-4c5d-9454-37419c41b5b5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:48.635155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f753a4b-3e95-4c5d-9454-37419c41b5b5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:49.332961 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0f753a4b-3e95-4c5d-9454-37419c41b5b5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:49.347350 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0f753a4b-3e95-4c5d-9454-37419c41b5b5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.813881 Aug 24 10:32:49.371778 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1917/4173] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:48 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:49.378297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-acd5c921-47c6-4408-858c-42a5bed57630 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:49.379045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-acd5c921-47c6-4408-858c-42a5bed57630 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:49.384832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-878b04e4-237b-42f7-861b-28cc921bc61c tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:49.385874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-878b04e4-237b-42f7-861b-28cc921bc61c tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:49.397191 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-878b04e4-237b-42f7-861b-28cc921bc61c tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:49.398017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-878b04e4-237b-42f7-861b-28cc921bc61c tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:49.398674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-878b04e4-237b-42f7-861b-28cc921bc61c tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:49.401084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-878b04e4-237b-42f7-861b-28cc921bc61c tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:49.402885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-acd5c921-47c6-4408-858c-42a5bed57630 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:49.403830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-878b04e4-237b-42f7-861b-28cc921bc61c tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:49.407014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-acd5c921-47c6-4408-858c-42a5bed57630 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:49.407584 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-878b04e4-237b-42f7-861b-28cc921bc61c tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:49.408987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-acd5c921-47c6-4408-858c-42a5bed57630 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:49.412908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-acd5c921-47c6-4408-858c-42a5bed57630 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:49.416855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-acd5c921-47c6-4408-858c-42a5bed57630 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:49.418463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-acd5c921-47c6-4408-858c-42a5bed57630 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:49.925507 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-acd5c921-47c6-4408-858c-42a5bed57630 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:49.938406 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-acd5c921-47c6-4408-858c-42a5bed57630 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.565351 Aug 24 10:32:49.946938 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2257/4174] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:49 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:49.973169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cf46d6cd-c67e-4e67-aa8d-f8a8824acc87 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:49.973938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cf46d6cd-c67e-4e67-aa8d-f8a8824acc87 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 5b710a09-c0f6-459c-847d-6032039a7b2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:49.994100 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-cf46d6cd-c67e-4e67-aa8d-f8a8824acc87 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Instance 5b710a09-c0f6-459c-847d-6032039a7b2a could not be found. Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cf46d6cd-c67e-4e67-aa8d-f8a8824acc87 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/5b710a09-c0f6-459c-847d-6032039a7b2a/action HTTP/1.1 Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 15 Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: {"restore": {}} Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 5b710a09-c0f6-459c-847d-6032039a7b2a could not be found. Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '5b710a09-c0f6-459c-847d-6032039a7b2a', 'body': {'restore': {}}} Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b710a09-c0f6-459c-847d-6032039a7b2a could not be found. Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b710a09-c0f6-459c-847d-6032039a7b2a could not be found. Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:49.995994 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:50.000775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:32:50.000775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:32:50.000775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b710a09-c0f6-459c-847d-6032039a7b2a could not be found. Aug 24 10:32:50.000775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:50.000775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cf46d6cd-c67e-4e67-aa8d-f8a8824acc87 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 404 to user: Instance 5b710a09-c0f6-459c-847d-6032039a7b2a could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:50.000775 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cf46d6cd-c67e-4e67-aa8d-f8a8824acc87 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers/5b710a09-c0f6-459c-847d-6032039a7b2a/action" status: 404 len: 111 microversion: 2.1 time: 0.028827 Aug 24 10:32:50.013530 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2258/4175] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:32:49 2022] POST /compute/v2.1/servers/5b710a09-c0f6-459c-847d-6032039a7b2a/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:32:50.018752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ddf340f4-5d4e-49fe-a0d5-1d3a769612da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:50.021074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ddf340f4-5d4e-49fe-a0d5-1d3a769612da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:50.043107 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddf340f4-5d4e-49fe-a0d5-1d3a769612da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:50.043849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddf340f4-5d4e-49fe-a0d5-1d3a769612da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:50.044448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddf340f4-5d4e-49fe-a0d5-1d3a769612da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:50.045378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddf340f4-5d4e-49fe-a0d5-1d3a769612da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:50.045991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddf340f4-5d4e-49fe-a0d5-1d3a769612da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:50.046574 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddf340f4-5d4e-49fe-a0d5-1d3a769612da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:50.194785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-878b04e4-237b-42f7-861b-28cc921bc61c tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:50.227109 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-878b04e4-237b-42f7-861b-28cc921bc61c tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1608 microversion: 2.1 time: 0.846509 Aug 24 10:32:50.232817 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1918/4176] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:49 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1608 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:50.615112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ddf340f4-5d4e-49fe-a0d5-1d3a769612da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:50.631705 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ddf340f4-5d4e-49fe-a0d5-1d3a769612da tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.616716 Aug 24 10:32:50.632334 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2259/4177] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:50 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:50.657537 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-61d04808-4c32-4fec-9d5a-58ac9a20bd83 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:50.658781 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-61d04808-4c32-4fec-9d5a-58ac9a20bd83 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:50.690573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61d04808-4c32-4fec-9d5a-58ac9a20bd83 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:50.693263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61d04808-4c32-4fec-9d5a-58ac9a20bd83 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:50.694414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61d04808-4c32-4fec-9d5a-58ac9a20bd83 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:50.696560 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61d04808-4c32-4fec-9d5a-58ac9a20bd83 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:50.699382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61d04808-4c32-4fec-9d5a-58ac9a20bd83 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:50.699845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61d04808-4c32-4fec-9d5a-58ac9a20bd83 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:51.173715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-61d04808-4c32-4fec-9d5a-58ac9a20bd83 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:51.189974 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-61d04808-4c32-4fec-9d5a-58ac9a20bd83 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.538347 Aug 24 10:32:51.206287 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1919/4178] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:50 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:51.243604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-18ac28a6-8d66-4f09-afe6-1f2b6f558444 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:51.244295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-18ac28a6-8d66-4f09-afe6-1f2b6f558444 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:51.258531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18ac28a6-8d66-4f09-afe6-1f2b6f558444 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:51.259601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18ac28a6-8d66-4f09-afe6-1f2b6f558444 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:51.260962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8cc269e4-e17e-4f52-bd36-5773b0e54c06 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:51.262045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8cc269e4-e17e-4f52-bd36-5773b0e54c06 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:51.262265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18ac28a6-8d66-4f09-afe6-1f2b6f558444 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:51.263731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18ac28a6-8d66-4f09-afe6-1f2b6f558444 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:51.265166 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18ac28a6-8d66-4f09-afe6-1f2b6f558444 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:51.267130 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18ac28a6-8d66-4f09-afe6-1f2b6f558444 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:51.288198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc269e4-e17e-4f52-bd36-5773b0e54c06 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:51.291141 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc269e4-e17e-4f52-bd36-5773b0e54c06 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:51.291867 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc269e4-e17e-4f52-bd36-5773b0e54c06 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:51.294651 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc269e4-e17e-4f52-bd36-5773b0e54c06 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:51.295624 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc269e4-e17e-4f52-bd36-5773b0e54c06 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:51.300195 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc269e4-e17e-4f52-bd36-5773b0e54c06 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:51.371269 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-18ac28a6-8d66-4f09-afe6-1f2b6f558444 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Cannot 'restore' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state active Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-18ac28a6-8d66-4f09-afe6-1f2b6f558444 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action HTTP/1.1 Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 15 Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: {"restore": {}} Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: exception: Cannot 'restore' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state active Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '8fb1d6b5-a27c-465a-aa10-652d2cc366ae', 'body': {'restore': {}}} Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae in vm_state active. Cannot restore while the instance is in this state. Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state active Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:51.373182 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:51.378764 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:51.378764 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:32:51.378764 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:32:51.378764 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state active Aug 24 10:32:51.378764 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:51.380686 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-18ac28a6-8d66-4f09-afe6-1f2b6f558444 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 409 to user: Cannot 'restore' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state active {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:51.381959 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-18ac28a6-8d66-4f09-afe6-1f2b6f558444 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action" status: 409 len: 145 microversion: 2.1 time: 0.144601 Aug 24 10:32:51.384074 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2260/4179] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:32:51 2022] POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action => generated 145 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:32:51.395241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-69aa513a-e6d6-4b02-82b5-f01ed5e107bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:51.401363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-69aa513a-e6d6-4b02-82b5-f01ed5e107bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:51.422396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69aa513a-e6d6-4b02-82b5-f01ed5e107bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:51.422963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69aa513a-e6d6-4b02-82b5-f01ed5e107bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:51.424009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69aa513a-e6d6-4b02-82b5-f01ed5e107bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:51.426794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69aa513a-e6d6-4b02-82b5-f01ed5e107bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:51.427291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69aa513a-e6d6-4b02-82b5-f01ed5e107bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:51.427727 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69aa513a-e6d6-4b02-82b5-f01ed5e107bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:51.516079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8cc269e4-e17e-4f52-bd36-5773b0e54c06 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:51.531054 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8cc269e4-e17e-4f52-bd36-5773b0e54c06 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1541 microversion: 2.1 time: 0.275476 Aug 24 10:32:51.544367 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1920/4180] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:51 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1541 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:32:51.901840 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e4949a5f-7f4a-442f-8785-efd156fab7f0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:51.904344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e4949a5f-7f4a-442f-8785-efd156fab7f0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:51.920957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4949a5f-7f4a-442f-8785-efd156fab7f0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:51.926107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4949a5f-7f4a-442f-8785-efd156fab7f0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:51.926558 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4949a5f-7f4a-442f-8785-efd156fab7f0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:51.927502 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4949a5f-7f4a-442f-8785-efd156fab7f0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:51.928925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4949a5f-7f4a-442f-8785-efd156fab7f0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:51.929584 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4949a5f-7f4a-442f-8785-efd156fab7f0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:52.036644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-69aa513a-e6d6-4b02-82b5-f01ed5e107bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:52.054706 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-69aa513a-e6d6-4b02-82b5-f01ed5e107bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.666177 Aug 24 10:32:52.066151 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2261/4181] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:51 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:52.080297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0774db79-21e8-40b0-946f-2f06e9de18b3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:52.081079 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0774db79-21e8-40b0-946f-2f06e9de18b3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:52.090525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0774db79-21e8-40b0-946f-2f06e9de18b3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:52.091606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0774db79-21e8-40b0-946f-2f06e9de18b3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:52.092347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0774db79-21e8-40b0-946f-2f06e9de18b3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:52.093439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0774db79-21e8-40b0-946f-2f06e9de18b3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:52.094944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0774db79-21e8-40b0-946f-2f06e9de18b3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:52.095717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0774db79-21e8-40b0-946f-2f06e9de18b3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:52.180334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e4949a5f-7f4a-442f-8785-efd156fab7f0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:52.192092 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e4949a5f-7f4a-442f-8785-efd156fab7f0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.296383 Aug 24 10:32:52.193335 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1921/4182] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:51 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:32:52.218070 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-37eeea73-49ba-4472-b3bc-edadf47990bd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:52.219647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-37eeea73-49ba-4472-b3bc-edadf47990bd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:52.228085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37eeea73-49ba-4472-b3bc-edadf47990bd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:52.228681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37eeea73-49ba-4472-b3bc-edadf47990bd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:52.229221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37eeea73-49ba-4472-b3bc-edadf47990bd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:52.230010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37eeea73-49ba-4472-b3bc-edadf47990bd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:52.230520 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37eeea73-49ba-4472-b3bc-edadf47990bd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:52.231463 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37eeea73-49ba-4472-b3bc-edadf47990bd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:52.590577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37eeea73-49ba-4472-b3bc-edadf47990bd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:52.613731 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-37eeea73-49ba-4472-b3bc-edadf47990bd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.399094 Aug 24 10:32:52.622609 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1922/4183] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:52 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:52.647902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d8f4f159-bb68-4808-979b-afa3f09e9abf tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:52.651971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d8f4f159-bb68-4808-979b-afa3f09e9abf tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:52.670785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8f4f159-bb68-4808-979b-afa3f09e9abf tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:52.671579 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8f4f159-bb68-4808-979b-afa3f09e9abf tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:52.672038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8f4f159-bb68-4808-979b-afa3f09e9abf tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:52.672928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8f4f159-bb68-4808-979b-afa3f09e9abf tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:52.677929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8f4f159-bb68-4808-979b-afa3f09e9abf tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:52.678612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8f4f159-bb68-4808-979b-afa3f09e9abf tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:52.831635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d8f4f159-bb68-4808-979b-afa3f09e9abf tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:52.837999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0774db79-21e8-40b0-946f-2f06e9de18b3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:52.845554 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d8f4f159-bb68-4808-979b-afa3f09e9abf tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1253 microversion: 2.1 time: 0.219641 Aug 24 10:32:52.847421 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1923/4184] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:52 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1253 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:52.851099 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0774db79-21e8-40b0-946f-2f06e9de18b3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.776257 Aug 24 10:32:52.858166 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2262/4185] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:52 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:52.881112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-858a6b09-22f0-4c45-a65a-a1ca109c4ef1 req-bf2aa5ae-3534-4d05-b8b8-f14397a04dbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d82e58b9-780c-4deb-80e3-acf4911c7c85", "name": "network-vif-deleted", "tag": "1559d343-8448-4e13-92be-96efcc09b44a"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:52.885619 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6bd4a179-c330-4fa4-9b08-979ebe02f273 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:52.887951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6bd4a179-c330-4fa4-9b08-979ebe02f273 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:52.911476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-858a6b09-22f0-4c45-a65a-a1ca109c4ef1 req-bf2aa5ae-3534-4d05-b8b8-f14397a04dbb service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:52.912654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-858a6b09-22f0-4c45-a65a-a1ca109c4ef1 req-bf2aa5ae-3534-4d05-b8b8-f14397a04dbb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:52.912986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bd4a179-c330-4fa4-9b08-979ebe02f273 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:52.915184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bd4a179-c330-4fa4-9b08-979ebe02f273 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:52.915419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-858a6b09-22f0-4c45-a65a-a1ca109c4ef1 req-bf2aa5ae-3534-4d05-b8b8-f14397a04dbb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:52.920805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bd4a179-c330-4fa4-9b08-979ebe02f273 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:52.924332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bd4a179-c330-4fa4-9b08-979ebe02f273 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:52.925436 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bd4a179-c330-4fa4-9b08-979ebe02f273 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:52.926506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bd4a179-c330-4fa4-9b08-979ebe02f273 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:53.003983 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-858a6b09-22f0-4c45-a65a-a1ca109c4ef1 req-bf2aa5ae-3534-4d05-b8b8-f14397a04dbb service nova] Creating event network-vif-deleted:1559d343-8448-4e13-92be-96efcc09b44a for instance d82e58b9-780c-4deb-80e3-acf4911c7c85 on n-h2-849328-3 Aug 24 10:32:53.028508 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-858a6b09-22f0-4c45-a65a-a1ca109c4ef1 req-bf2aa5ae-3534-4d05-b8b8-f14397a04dbb service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168843 Aug 24 10:32:53.029196 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2263/4186] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:32:53.037102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4a510f48-37e1-4eab-9cc7-e7b65a6a46d1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:53.037766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4a510f48-37e1-4eab-9cc7-e7b65a6a46d1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 4e230796-184a-4762-83fb-285d95ab9698] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:53.066326 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-4a510f48-37e1-4eab-9cc7-e7b65a6a46d1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Instance 4e230796-184a-4762-83fb-285d95ab9698 could not be found. Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4a510f48-37e1-4eab-9cc7-e7b65a6a46d1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/4e230796-184a-4762-83fb-285d95ab9698/action HTTP/1.1 Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 14 Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: {"resume": {}} Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 4e230796-184a-4762-83fb-285d95ab9698 could not be found. Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '4e230796-184a-4762-83fb-285d95ab9698', 'body': {'resume': {}}} Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e230796-184a-4762-83fb-285d95ab9698 could not be found. Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e230796-184a-4762-83fb-285d95ab9698 could not be found. Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:53.076387 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:53.080974 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:32:53.080974 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:32:53.080974 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e230796-184a-4762-83fb-285d95ab9698 could not be found. Aug 24 10:32:53.080974 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:53.082707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4a510f48-37e1-4eab-9cc7-e7b65a6a46d1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 404 to user: Instance 4e230796-184a-4762-83fb-285d95ab9698 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:53.083547 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4a510f48-37e1-4eab-9cc7-e7b65a6a46d1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers/4e230796-184a-4762-83fb-285d95ab9698/action" status: 404 len: 111 microversion: 2.1 time: 0.053233 Aug 24 10:32:53.084740 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2264/4187] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:32:53 2022] POST /compute/v2.1/servers/4e230796-184a-4762-83fb-285d95ab9698/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:32:53.101905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e6d67d88-992b-42e0-9ef3-237736fe9815 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:53.104336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e6d67d88-992b-42e0-9ef3-237736fe9815 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:53.127485 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6d67d88-992b-42e0-9ef3-237736fe9815 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:53.131300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6d67d88-992b-42e0-9ef3-237736fe9815 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:53.131821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6d67d88-992b-42e0-9ef3-237736fe9815 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:53.134564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6d67d88-992b-42e0-9ef3-237736fe9815 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:53.135071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6d67d88-992b-42e0-9ef3-237736fe9815 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:53.163362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6d67d88-992b-42e0-9ef3-237736fe9815 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:53.393031 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6bd4a179-c330-4fa4-9b08-979ebe02f273 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:53.408894 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6bd4a179-c330-4fa4-9b08-979ebe02f273 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.555966 Aug 24 10:32:53.409846 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1924/4188] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:52 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:53.434059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6c99dc36-6b23-4f9e-9417-68e0fefef171 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1725693022"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:53.445208 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6c99dc36-6b23-4f9e-9417-68e0fefef171 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:53.451884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c99dc36-6b23-4f9e-9417-68e0fefef171 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:53.452685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c99dc36-6b23-4f9e-9417-68e0fefef171 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:53.453367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c99dc36-6b23-4f9e-9417-68e0fefef171 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:53.454660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c99dc36-6b23-4f9e-9417-68e0fefef171 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:53.455269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c99dc36-6b23-4f9e-9417-68e0fefef171 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:53.455986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c99dc36-6b23-4f9e-9417-68e0fefef171 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:53.757053 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6c99dc36-6b23-4f9e-9417-68e0fefef171 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action" status: 202 len: 0 microversion: 2.1 time: 0.329083 Aug 24 10:32:53.776382 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1925/4189] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:32:53 2022] POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 24 10:32:53.868905 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0520f893-e683-4b1c-8f32-29ea53984872 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:53.869788 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0520f893-e683-4b1c-8f32-29ea53984872 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:53.888160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0520f893-e683-4b1c-8f32-29ea53984872 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:53.891049 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0520f893-e683-4b1c-8f32-29ea53984872 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:53.891849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0520f893-e683-4b1c-8f32-29ea53984872 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:53.894965 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0520f893-e683-4b1c-8f32-29ea53984872 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:53.895676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0520f893-e683-4b1c-8f32-29ea53984872 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:53.899821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0520f893-e683-4b1c-8f32-29ea53984872 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:54.587708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e6d67d88-992b-42e0-9ef3-237736fe9815 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:54.614503 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e6d67d88-992b-42e0-9ef3-237736fe9815 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 1.524521 Aug 24 10:32:54.615937 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2265/4190] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:53 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:32:54.641225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-342209db-9684-4802-8e8b-633430265ca0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:54.642228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-342209db-9684-4802-8e8b-633430265ca0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:54.673499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-342209db-9684-4802-8e8b-633430265ca0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:54.674200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-342209db-9684-4802-8e8b-633430265ca0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:54.674826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-342209db-9684-4802-8e8b-633430265ca0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:54.675712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-342209db-9684-4802-8e8b-633430265ca0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:54.676322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-342209db-9684-4802-8e8b-633430265ca0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:54.676900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-342209db-9684-4802-8e8b-633430265ca0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:54.719705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:54.802131 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0520f893-e683-4b1c-8f32-29ea53984872 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:54.803259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:54.821473 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0520f893-e683-4b1c-8f32-29ea53984872 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1253 microversion: 2.1 time: 0.955802 Aug 24 10:32:54.822459 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1926/4191] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:53 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1253 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:32:55.188178 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-342209db-9684-4802-8e8b-633430265ca0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:55.196407 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-342209db-9684-4802-8e8b-633430265ca0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.561725 Aug 24 10:32:55.201970 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2266/4192] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:54 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:55.222098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c1e71fcb-b8b6-46d9-8c4d-b5998d849a20 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:55.222720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c1e71fcb-b8b6-46d9-8c4d-b5998d849a20 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:55.237207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1e71fcb-b8b6-46d9-8c4d-b5998d849a20 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:55.248502 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1e71fcb-b8b6-46d9-8c4d-b5998d849a20 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:55.249298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1e71fcb-b8b6-46d9-8c4d-b5998d849a20 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:55.252159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1e71fcb-b8b6-46d9-8c4d-b5998d849a20 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:55.252720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1e71fcb-b8b6-46d9-8c4d-b5998d849a20 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:55.253230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1e71fcb-b8b6-46d9-8c4d-b5998d849a20 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:55.303053 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-c1e71fcb-b8b6-46d9-8c4d-b5998d849a20 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Cannot 'resume' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state active Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c1e71fcb-b8b6-46d9-8c4d-b5998d849a20 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action HTTP/1.1 Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 14 Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: {"resume": {}} Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: exception: Cannot 'resume' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state active Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '8fb1d6b5-a27c-465a-aa10-652d2cc366ae', 'body': {'resume': {}}} Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae in vm_state active. Cannot resume while the instance is in this state. Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state active Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:55.307183 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:55.311375 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:55.311375 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:32:55.311375 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:32:55.311375 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state active Aug 24 10:32:55.311375 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:32:55.315291 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c1e71fcb-b8b6-46d9-8c4d-b5998d849a20 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 409 to user: Cannot 'resume' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state active {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:55.316558 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c1e71fcb-b8b6-46d9-8c4d-b5998d849a20 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action" status: 409 len: 144 microversion: 2.1 time: 0.098540 Aug 24 10:32:55.318064 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1927/4193] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:32:55 2022] POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action => generated 144 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:32:55.329266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c2275f6b-9be8-4414-aeb8-ce85284bee32 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:55.330214 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c2275f6b-9be8-4414-aeb8-ce85284bee32 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:55.337072 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:55.339599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2275f6b-9be8-4414-aeb8-ce85284bee32 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:55.340417 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2275f6b-9be8-4414-aeb8-ce85284bee32 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:55.341142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2275f6b-9be8-4414-aeb8-ce85284bee32 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:55.342647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2275f6b-9be8-4414-aeb8-ce85284bee32 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:55.343454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2275f6b-9be8-4414-aeb8-ce85284bee32 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:55.344095 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2275f6b-9be8-4414-aeb8-ce85284bee32 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:55.368621 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:55.688493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c2275f6b-9be8-4414-aeb8-ce85284bee32 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:55.703793 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c2275f6b-9be8-4414-aeb8-ce85284bee32 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.380891 Aug 24 10:32:55.709932 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2267/4194] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:55 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:55.742613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-41f32c2d-f828-4ad5-825e-9d35fb7a8231 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:55.744597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-41f32c2d-f828-4ad5-825e-9d35fb7a8231 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:55.758545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41f32c2d-f828-4ad5-825e-9d35fb7a8231 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:55.760323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41f32c2d-f828-4ad5-825e-9d35fb7a8231 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:55.760774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41f32c2d-f828-4ad5-825e-9d35fb7a8231 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:55.761537 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41f32c2d-f828-4ad5-825e-9d35fb7a8231 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:55.761993 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41f32c2d-f828-4ad5-825e-9d35fb7a8231 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:55.763872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41f32c2d-f828-4ad5-825e-9d35fb7a8231 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:55.849019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-93872504-dec7-43a2-b58a-f43fe9076bd0 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:55.849879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-93872504-dec7-43a2-b58a-f43fe9076bd0 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:55.859691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93872504-dec7-43a2-b58a-f43fe9076bd0 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:55.865496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93872504-dec7-43a2-b58a-f43fe9076bd0 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:55.866123 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93872504-dec7-43a2-b58a-f43fe9076bd0 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:55.871320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93872504-dec7-43a2-b58a-f43fe9076bd0 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:55.872277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93872504-dec7-43a2-b58a-f43fe9076bd0 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:55.872973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93872504-dec7-43a2-b58a-f43fe9076bd0 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:56.021801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-93872504-dec7-43a2-b58a-f43fe9076bd0 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:56.035856 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-93872504-dec7-43a2-b58a-f43fe9076bd0 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1253 microversion: 2.1 time: 0.190291 Aug 24 10:32:56.038181 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2268/4195] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:55 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1253 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:32:56.176645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-41f32c2d-f828-4ad5-825e-9d35fb7a8231 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:56.192687 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-41f32c2d-f828-4ad5-825e-9d35fb7a8231 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.461740 Aug 24 10:32:56.193990 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1928/4196] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:55 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:56.371642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b855ec17-35eb-429e-9329-b10423bdeaf0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b855ec17-35eb-429e-9329-b10423bdeaf0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 160 Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: {"server": {"name": "", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d"}]}} Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'server': {'name': '', 'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af', 'flavorRef': '452', 'networks': [{'uuid': 'ff5b1b26-0a47-40e4-a55f-46c58b4e3a6d'}]}}} Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi '' Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:32:56.375461 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:32:56.379586 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:32:56.379586 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 24 10:32:56.379586 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:56.379586 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:56.379586 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:56.379586 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:56.379586 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:56.379586 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:56.379586 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:32:56.379586 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:32:56.379586 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 24 10:32:56.379586 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:56.387344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b855ec17-35eb-429e-9329-b10423bdeaf0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:56.388534 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b855ec17-35eb-429e-9329-b10423bdeaf0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.021588 Aug 24 10:32:56.389692 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2269/4197] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:32:56 2022] POST /compute/v2.1/servers => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:32:56.412435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5a9d9810-b9ca-461f-93ac-47b99566e91d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:56.413077 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5a9d9810-b9ca-461f-93ac-47b99566e91d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:56.451021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a9d9810-b9ca-461f-93ac-47b99566e91d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:56.451737 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a9d9810-b9ca-461f-93ac-47b99566e91d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:56.452000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a9d9810-b9ca-461f-93ac-47b99566e91d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:56.452731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a9d9810-b9ca-461f-93ac-47b99566e91d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:56.460993 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a9d9810-b9ca-461f-93ac-47b99566e91d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:56.463573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a9d9810-b9ca-461f-93ac-47b99566e91d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:57.066463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5a097d00-d78b-4271-b1d5-4ce69a56e1a7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:57.067152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5a097d00-d78b-4271-b1d5-4ce69a56e1a7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:57.094994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a097d00-d78b-4271-b1d5-4ce69a56e1a7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:57.095637 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a097d00-d78b-4271-b1d5-4ce69a56e1a7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:57.096219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a097d00-d78b-4271-b1d5-4ce69a56e1a7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:57.097046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a097d00-d78b-4271-b1d5-4ce69a56e1a7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:57.097537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a097d00-d78b-4271-b1d5-4ce69a56e1a7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:57.097963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a097d00-d78b-4271-b1d5-4ce69a56e1a7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:57.211081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5a9d9810-b9ca-461f-93ac-47b99566e91d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:57.224451 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5a9d9810-b9ca-461f-93ac-47b99566e91d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.830523 Aug 24 10:32:57.228010 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1929/4198] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:56 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:57.257350 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8f720c8e-a03f-4ff6-b3e7-a29c28f4c0be tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:57.258181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8f720c8e-a03f-4ff6-b3e7-a29c28f4c0be tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:57.268530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f720c8e-a03f-4ff6-b3e7-a29c28f4c0be tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:57.270975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f720c8e-a03f-4ff6-b3e7-a29c28f4c0be tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:57.271629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f720c8e-a03f-4ff6-b3e7-a29c28f4c0be tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:57.272804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f720c8e-a03f-4ff6-b3e7-a29c28f4c0be tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:57.277496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f720c8e-a03f-4ff6-b3e7-a29c28f4c0be tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:57.278271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f720c8e-a03f-4ff6-b3e7-a29c28f4c0be tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:57.392992 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5a097d00-d78b-4271-b1d5-4ce69a56e1a7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:57.410568 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5a097d00-d78b-4271-b1d5-4ce69a56e1a7 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1253 microversion: 2.1 time: 0.349221 Aug 24 10:32:57.411429 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2270/4199] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:57 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1253 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:32:57.731778 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8f720c8e-a03f-4ff6-b3e7-a29c28f4c0be tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:57.742949 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8f720c8e-a03f-4ff6-b3e7-a29c28f4c0be tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.490670 Aug 24 10:32:57.744104 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1930/4200] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:57 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:32:57.768831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-29abd9e9-5020-485b-84ca-f5735fea7555 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:57.769439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-29abd9e9-5020-485b-84ca-f5735fea7555 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: faccdff1-a98d-4920-b822-fb76e909267c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:57.785312 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-29abd9e9-5020-485b-84ca-f5735fea7555 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Instance faccdff1-a98d-4920-b822-fb76e909267c could not be found. Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-29abd9e9-5020-485b-84ca-f5735fea7555 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/faccdff1-a98d-4920-b822-fb76e909267c/action HTTP/1.1 Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 14 Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: {"shelve": {}} Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance faccdff1-a98d-4920-b822-fb76e909267c could not be found. Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'faccdff1-a98d-4920-b822-fb76e909267c', 'body': {'shelve': {}}} Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faccdff1-a98d-4920-b822-fb76e909267c could not be found. Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faccdff1-a98d-4920-b822-fb76e909267c could not be found. Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:32:57.794027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:32:57.799127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:32:57.799127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:32:57.799127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faccdff1-a98d-4920-b822-fb76e909267c could not be found. Aug 24 10:32:57.799127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:32:57.799598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-29abd9e9-5020-485b-84ca-f5735fea7555 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 404 to user: Instance faccdff1-a98d-4920-b822-fb76e909267c could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:32:57.801826 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-29abd9e9-5020-485b-84ca-f5735fea7555 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers/faccdff1-a98d-4920-b822-fb76e909267c/action" status: 404 len: 111 microversion: 2.1 time: 0.036988 Aug 24 10:32:57.805446 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2271/4201] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:32:57 2022] POST /compute/v2.1/servers/faccdff1-a98d-4920-b822-fb76e909267c/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:32:57.814610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0c7799a0-e556-4795-af90-67cbd06bfe90 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:57.815248 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0c7799a0-e556-4795-af90-67cbd06bfe90 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:57.828886 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c7799a0-e556-4795-af90-67cbd06bfe90 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:57.829420 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c7799a0-e556-4795-af90-67cbd06bfe90 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:57.829871 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c7799a0-e556-4795-af90-67cbd06bfe90 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:57.830593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c7799a0-e556-4795-af90-67cbd06bfe90 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:57.831059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c7799a0-e556-4795-af90-67cbd06bfe90 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:57.831475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c7799a0-e556-4795-af90-67cbd06bfe90 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:58.168272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0c7799a0-e556-4795-af90-67cbd06bfe90 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:58.187611 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0c7799a0-e556-4795-af90-67cbd06bfe90 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.377910 Aug 24 10:32:58.188334 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1931/4202] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:57 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:58.211495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-97bd4533-497d-48b4-b9ba-999ed8da248e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:58.212214 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-97bd4533-497d-48b4-b9ba-999ed8da248e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:58.233330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97bd4533-497d-48b4-b9ba-999ed8da248e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:58.233823 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97bd4533-497d-48b4-b9ba-999ed8da248e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:58.234259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97bd4533-497d-48b4-b9ba-999ed8da248e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:58.245758 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97bd4533-497d-48b4-b9ba-999ed8da248e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:58.246391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97bd4533-497d-48b4-b9ba-999ed8da248e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:58.246838 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97bd4533-497d-48b4-b9ba-999ed8da248e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:58.438133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-37466589-20af-468b-823a-acfcfdf8fb95 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:58.438778 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-37466589-20af-468b-823a-acfcfdf8fb95 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:58.473525 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37466589-20af-468b-823a-acfcfdf8fb95 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:58.474050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37466589-20af-468b-823a-acfcfdf8fb95 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:58.474503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37466589-20af-468b-823a-acfcfdf8fb95 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:58.479184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37466589-20af-468b-823a-acfcfdf8fb95 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:58.480625 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37466589-20af-468b-823a-acfcfdf8fb95 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:58.481271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37466589-20af-468b-823a-acfcfdf8fb95 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:58.860154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-97bd4533-497d-48b4-b9ba-999ed8da248e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:58.896264 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-97bd4533-497d-48b4-b9ba-999ed8da248e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.680584 Aug 24 10:32:58.901986 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2272/4203] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:58 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:58.954356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-14c30887-9f61-4c3b-b737-c059ea349af5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:32:58.955320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-14c30887-9f61-4c3b-b737-c059ea349af5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:59.004968 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14c30887-9f61-4c3b-b737-c059ea349af5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:59.005570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14c30887-9f61-4c3b-b737-c059ea349af5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:59.006022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14c30887-9f61-4c3b-b737-c059ea349af5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:59.013577 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14c30887-9f61-4c3b-b737-c059ea349af5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:59.014463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14c30887-9f61-4c3b-b737-c059ea349af5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:59.024418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14c30887-9f61-4c3b-b737-c059ea349af5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:59.068674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37466589-20af-468b-823a-acfcfdf8fb95 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:59.078362 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-37466589-20af-468b-823a-acfcfdf8fb95 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1253 microversion: 2.1 time: 0.650320 Aug 24 10:32:59.079029 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1932/4204] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:58 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1253 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:32:59.104343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-14c30887-9f61-4c3b-b737-c059ea349af5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lazy-loading 'flavor' on Instance uuid 8fb1d6b5-a27c-465a-aa10-652d2cc366ae {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:32:59.628104 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-14c30887-9f61-4c3b-b737-c059ea349af5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action" status: 202 len: 0 microversion: 2.1 time: 0.710623 Aug 24 10:32:59.629802 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2273/4205] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:32:58 2022] POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action => generated 0 bytes in 713 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:32:59.639567 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f5fe1ce0-a2a8-4c86-ab5b-0bd40d3b44bc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:32:59.640807 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f5fe1ce0-a2a8-4c86-ab5b-0bd40d3b44bc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:32:59.653317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5fe1ce0-a2a8-4c86-ab5b-0bd40d3b44bc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:59.655350 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5fe1ce0-a2a8-4c86-ab5b-0bd40d3b44bc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:59.655970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5fe1ce0-a2a8-4c86-ab5b-0bd40d3b44bc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:59.656945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5fe1ce0-a2a8-4c86-ab5b-0bd40d3b44bc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:32:59.662361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5fe1ce0-a2a8-4c86-ab5b-0bd40d3b44bc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:32:59.664141 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5fe1ce0-a2a8-4c86-ab5b-0bd40d3b44bc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:32:59.979031 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f5fe1ce0-a2a8-4c86-ab5b-0bd40d3b44bc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:32:59.990648 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f5fe1ce0-a2a8-4c86-ab5b-0bd40d3b44bc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1512 microversion: 2.1 time: 0.356611 Aug 24 10:32:59.993777 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1933/4206] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:32:59 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1512 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:00.101632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-59c85571-1422-44c6-adbb-eb7cdd5db1f4 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:00.102616 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-59c85571-1422-44c6-adbb-eb7cdd5db1f4 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:00.121218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59c85571-1422-44c6-adbb-eb7cdd5db1f4 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:00.124689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59c85571-1422-44c6-adbb-eb7cdd5db1f4 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:00.125756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59c85571-1422-44c6-adbb-eb7cdd5db1f4 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:00.128053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59c85571-1422-44c6-adbb-eb7cdd5db1f4 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:00.130227 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59c85571-1422-44c6-adbb-eb7cdd5db1f4 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:00.133806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59c85571-1422-44c6-adbb-eb7cdd5db1f4 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:00.501261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-59c85571-1422-44c6-adbb-eb7cdd5db1f4 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:00.510679 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-59c85571-1422-44c6-adbb-eb7cdd5db1f4 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1253 microversion: 2.1 time: 0.413662 Aug 24 10:33:00.511307 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2274/4207] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:00 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1253 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:01.022246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fcdf1145-8dda-46c2-ac76-63a6450732c7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:01.023483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fcdf1145-8dda-46c2-ac76-63a6450732c7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:01.037085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fcdf1145-8dda-46c2-ac76-63a6450732c7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:01.044953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fcdf1145-8dda-46c2-ac76-63a6450732c7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:01.045770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fcdf1145-8dda-46c2-ac76-63a6450732c7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:01.046826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fcdf1145-8dda-46c2-ac76-63a6450732c7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:01.047552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fcdf1145-8dda-46c2-ac76-63a6450732c7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:01.048229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fcdf1145-8dda-46c2-ac76-63a6450732c7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:01.113649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-afca067f-6274-48db-b482-1a53d0d0c62c req-431401ed-1c09-4b61-9822-2046f4c01a80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ed6211-b7fc-454f-a8e9-73ba571a71af", "name": "network-vif-plugged", "status": "completed", "tag": "1c2608cb-c0ff-45d5-b7c5-82ff95cc5b0c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:33:01.159473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-afca067f-6274-48db-b482-1a53d0d0c62c req-431401ed-1c09-4b61-9822-2046f4c01a80 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:01.165383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-afca067f-6274-48db-b482-1a53d0d0c62c req-431401ed-1c09-4b61-9822-2046f4c01a80 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:01.167969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-afca067f-6274-48db-b482-1a53d0d0c62c req-431401ed-1c09-4b61-9822-2046f4c01a80 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:01.206610 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-afca067f-6274-48db-b482-1a53d0d0c62c req-431401ed-1c09-4b61-9822-2046f4c01a80 service nova] Creating event network-vif-plugged:1c2608cb-c0ff-45d5-b7c5-82ff95cc5b0c for instance 99ed6211-b7fc-454f-a8e9-73ba571a71af on n-h1-849328-3 Aug 24 10:33:01.245271 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-afca067f-6274-48db-b482-1a53d0d0c62c req-431401ed-1c09-4b61-9822-2046f4c01a80 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137586 Aug 24 10:33:01.248897 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2275/4208] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:33:01.534859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-59ca27a0-6ed3-4353-8f51-9da60410f212 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:01.535708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-59ca27a0-6ed3-4353-8f51-9da60410f212 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:01.564500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59ca27a0-6ed3-4353-8f51-9da60410f212 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:01.565926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59ca27a0-6ed3-4353-8f51-9da60410f212 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:01.568228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59ca27a0-6ed3-4353-8f51-9da60410f212 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:01.572659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59ca27a0-6ed3-4353-8f51-9da60410f212 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:01.573499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59ca27a0-6ed3-4353-8f51-9da60410f212 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:01.576465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59ca27a0-6ed3-4353-8f51-9da60410f212 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:01.879493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-59ca27a0-6ed3-4353-8f51-9da60410f212 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bbe335166415da37188b475b3194b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87126fba5c074971a9c3c41de4164571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:01.895720 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-59ca27a0-6ed3-4353-8f51-9da60410f212 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 200 len: 1253 microversion: 2.1 time: 0.367785 Aug 24 10:33:01.898862 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2276/4209] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:01 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 1253 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:02.040926 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fcdf1145-8dda-46c2-ac76-63a6450732c7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:02.072701 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fcdf1145-8dda-46c2-ac76-63a6450732c7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1512 microversion: 2.1 time: 1.049268 Aug 24 10:33:02.074237 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1934/4210] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:01 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1512 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:02.919598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-888196cd-74a1-4c98-b05f-55c23a935bc3 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:02.920974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-888196cd-74a1-4c98-b05f-55c23a935bc3 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] [instance: d82e58b9-780c-4deb-80e3-acf4911c7c85] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:02.930615 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=86 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:02.941517 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-888196cd-74a1-4c98-b05f-55c23a935bc3 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:02.942713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-888196cd-74a1-4c98-b05f-55c23a935bc3 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:02.943336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-888196cd-74a1-4c98-b05f-55c23a935bc3 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:02.944242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-888196cd-74a1-4c98-b05f-55c23a935bc3 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:02.946795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-888196cd-74a1-4c98-b05f-55c23a935bc3 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:02.947574 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-888196cd-74a1-4c98-b05f-55c23a935bc3 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:03.004001 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-888196cd-74a1-4c98-b05f-55c23a935bc3 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] HTTP exception thrown: Instance d82e58b9-780c-4deb-80e3-acf4911c7c85 could not be found. Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-888196cd-74a1-4c98-b05f-55c23a935bc3 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Request method failure captured: Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 HTTP/1.1 Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf3RILttanv6K2yoaNilpgzxkJUvnGzLyQ9EoEa0xUPB5YWta32lbvMhtZk3tojSagpPSJ-GeyONRSHmqLe6nEMAccTRILIdMxm9WX6xyUQjXrzvOJBSPT44Sx8XcomMjqEicv_EzS8R3zUshr5O9LauAsK1w8gZEZlNrMiwVucvXkk Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 87126fba5c074971a9c3c41de4164571 Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersTestBootFromVolume-23663641 Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/87126fba5c074971a9c3c41de4164571"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_87126fba5c074971a9c3c41de4164571", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/87126fba5c074971a9c3c41de4164571"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/87126fba5c074971a9c3c41de4164571"}]}] Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersTestBootFromVolume-23663641 Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 87126fba5c074971a9c3c41de4164571 Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersTestBootFromVolume-23663641 Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersTestBootFromVolume-23663641-project Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: ce4bbe335166415da37188b475b3194b Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersTestBootFromVolume-23663641-project Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance d82e58b9-780c-4deb-80e3-acf4911c7c85 could not be found. Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'd82e58b9-780c-4deb-80e3-acf4911c7c85'} Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d82e58b9-780c-4deb-80e3-acf4911c7c85 could not be found. Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d82e58b9-780c-4deb-80e3-acf4911c7c85 could not be found. Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:33:03.005785 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:33:03.009999 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:33:03.009999 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:33:03.009999 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:33:03.009999 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:33:03.009999 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:33:03.009999 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d82e58b9-780c-4deb-80e3-acf4911c7c85 could not be found. Aug 24 10:33:03.009999 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:33:03.030114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-888196cd-74a1-4c98-b05f-55c23a935bc3 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Returning 404 to user: Instance d82e58b9-780c-4deb-80e3-acf4911c7c85 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:33:03.031015 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-888196cd-74a1-4c98-b05f-55c23a935bc3 tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85" status: 404 len: 111 microversion: 2.1 time: 0.115288 Aug 24 10:33:03.033671 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2277/4211] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:02 2022] GET /compute/v2.1/servers/d82e58b9-780c-4deb-80e3-acf4911c7c85 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:33:03.043006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6295fce6-004e-4ecf-9a9f-b734240eff2b tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] Calling method '.version_select at 0x7f46550fd940>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:03.100990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-48fbdecd-f839-4acf-bdeb-cb83d33ed3f4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:03.101643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-48fbdecd-f839-4acf-bdeb-cb83d33ed3f4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:03.122605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48fbdecd-f839-4acf-bdeb-cb83d33ed3f4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:03.123140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48fbdecd-f839-4acf-bdeb-cb83d33ed3f4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:03.123589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48fbdecd-f839-4acf-bdeb-cb83d33ed3f4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:03.124329 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48fbdecd-f839-4acf-bdeb-cb83d33ed3f4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:03.130002 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6295fce6-004e-4ecf-9a9f-b734240eff2b tempest-ServersTestBootFromVolume-23663641 tempest-ServersTestBootFromVolume-23663641-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1040532086" status: 202 len: 0 microversion: 2.1 time: 0.090571 Aug 24 10:33:03.130688 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1935/4212] 10.222.0.85 () {58 vars in 1221 bytes} [Wed Aug 24 10:33:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1040532086 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:33:03.134627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48fbdecd-f839-4acf-bdeb-cb83d33ed3f4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:03.135083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48fbdecd-f839-4acf-bdeb-cb83d33ed3f4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:04.962422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-48fbdecd-f839-4acf-bdeb-cb83d33ed3f4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:04.971637 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-48fbdecd-f839-4acf-bdeb-cb83d33ed3f4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1512 microversion: 2.1 time: 1.876773 Aug 24 10:33:04.981509 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2278/4213] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:03 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1512 bytes in 1887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:06.000962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e7e44966-6053-476a-9c4f-bf0f0282afe6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:06.003062 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e7e44966-6053-476a-9c4f-bf0f0282afe6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:06.019300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7e44966-6053-476a-9c4f-bf0f0282afe6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:06.022635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7e44966-6053-476a-9c4f-bf0f0282afe6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:06.023412 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7e44966-6053-476a-9c4f-bf0f0282afe6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:06.027549 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7e44966-6053-476a-9c4f-bf0f0282afe6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:06.028334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7e44966-6053-476a-9c4f-bf0f0282afe6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:06.029003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7e44966-6053-476a-9c4f-bf0f0282afe6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:07.807309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e7e44966-6053-476a-9c4f-bf0f0282afe6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:07.827850 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e7e44966-6053-476a-9c4f-bf0f0282afe6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1512 microversion: 2.1 time: 1.833297 Aug 24 10:33:07.839377 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1936/4214] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:05 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1512 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:08.872164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-373be06a-70fa-4f69-8d2d-80f0d57d8c65 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:08.874043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-373be06a-70fa-4f69-8d2d-80f0d57d8c65 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:08.931681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-373be06a-70fa-4f69-8d2d-80f0d57d8c65 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:08.976543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-373be06a-70fa-4f69-8d2d-80f0d57d8c65 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:08.977460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-373be06a-70fa-4f69-8d2d-80f0d57d8c65 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.045s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:08.980227 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-373be06a-70fa-4f69-8d2d-80f0d57d8c65 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:08.983429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-373be06a-70fa-4f69-8d2d-80f0d57d8c65 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:08.986379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-373be06a-70fa-4f69-8d2d-80f0d57d8c65 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:10.161045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-373be06a-70fa-4f69-8d2d-80f0d57d8c65 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:10.178562 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-373be06a-70fa-4f69-8d2d-80f0d57d8c65 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1512 microversion: 2.1 time: 1.314708 Aug 24 10:33:10.179211 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2279/4215] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:08 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1512 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:11.204176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-48197db6-163a-48e0-b694-9921f3854ace tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:11.204929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-48197db6-163a-48e0-b694-9921f3854ace tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:11.222330 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48197db6-163a-48e0-b694-9921f3854ace tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:11.222848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48197db6-163a-48e0-b694-9921f3854ace tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:11.242571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48197db6-163a-48e0-b694-9921f3854ace tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:11.243593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48197db6-163a-48e0-b694-9921f3854ace tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:11.244127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48197db6-163a-48e0-b694-9921f3854ace tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:11.244578 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48197db6-163a-48e0-b694-9921f3854ace tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:12.321989 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-48197db6-163a-48e0-b694-9921f3854ace tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:12.338928 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-48197db6-163a-48e0-b694-9921f3854ace tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1512 microversion: 2.1 time: 1.139910 Aug 24 10:33:12.339547 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1937/4216] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:11 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1512 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:12.870281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-67a6bc26-ba3d-4f9f-8490-4ae4321172d1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f78f5687-cfbe-4e6b-996b-652d2f6c0c64"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:33:12.876152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-67a6bc26-ba3d-4f9f-8490-4ae4321172d1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:12.918276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67a6bc26-ba3d-4f9f-8490-4ae4321172d1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:12.929336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67a6bc26-ba3d-4f9f-8490-4ae4321172d1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:12.931630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67a6bc26-ba3d-4f9f-8490-4ae4321172d1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:12.934105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67a6bc26-ba3d-4f9f-8490-4ae4321172d1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:12.940203 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67a6bc26-ba3d-4f9f-8490-4ae4321172d1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:12.943034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67a6bc26-ba3d-4f9f-8490-4ae4321172d1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:13.361874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0ab5d0f8-c2ca-4dd3-a723-a2e88bce32dc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:13.362935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0ab5d0f8-c2ca-4dd3-a723-a2e88bce32dc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:13.389925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ab5d0f8-c2ca-4dd3-a723-a2e88bce32dc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:13.396450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ab5d0f8-c2ca-4dd3-a723-a2e88bce32dc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:13.399874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ab5d0f8-c2ca-4dd3-a723-a2e88bce32dc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:13.403399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ab5d0f8-c2ca-4dd3-a723-a2e88bce32dc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:13.407335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ab5d0f8-c2ca-4dd3-a723-a2e88bce32dc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:13.411133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ab5d0f8-c2ca-4dd3-a723-a2e88bce32dc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:13.709773 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-67a6bc26-ba3d-4f9f-8490-4ae4321172d1 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "POST /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.852887 Aug 24 10:33:13.729256 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2280/4217] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Aug 24 10:33:12 2022] POST /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-volume_attachments => generated 194 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:33:15.455129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0ab5d0f8-c2ca-4dd3-a723-a2e88bce32dc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:15.469396 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0ab5d0f8-c2ca-4dd3-a723-a2e88bce32dc tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1512 microversion: 2.1 time: 2.112277 Aug 24 10:33:15.489636 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1938/4218] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:13 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1512 bytes in 2120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:16.500770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9a6f8b9e-0a6c-4007-a098-0079d2878cba tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:16.502184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9a6f8b9e-0a6c-4007-a098-0079d2878cba tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:16.530934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a6f8b9e-0a6c-4007-a098-0079d2878cba tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:16.531917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a6f8b9e-0a6c-4007-a098-0079d2878cba tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:16.537256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a6f8b9e-0a6c-4007-a098-0079d2878cba tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:16.538476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a6f8b9e-0a6c-4007-a098-0079d2878cba tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:16.539115 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a6f8b9e-0a6c-4007-a098-0079d2878cba tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:16.539708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a6f8b9e-0a6c-4007-a098-0079d2878cba tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:17.909830 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9a6f8b9e-0a6c-4007-a098-0079d2878cba tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:17.925561 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9a6f8b9e-0a6c-4007-a098-0079d2878cba tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1512 microversion: 2.1 time: 1.431317 Aug 24 10:33:17.933719 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2281/4219] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:16 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1512 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:18.958292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-56d4ec03-f3ff-4a14-a25f-a56b2190ea86 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:18.959976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-56d4ec03-f3ff-4a14-a25f-a56b2190ea86 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:18.963803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:19.005828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56d4ec03-f3ff-4a14-a25f-a56b2190ea86 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:19.011561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56d4ec03-f3ff-4a14-a25f-a56b2190ea86 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:19.017321 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56d4ec03-f3ff-4a14-a25f-a56b2190ea86 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:19.018098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56d4ec03-f3ff-4a14-a25f-a56b2190ea86 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:19.022767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56d4ec03-f3ff-4a14-a25f-a56b2190ea86 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:19.024823 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56d4ec03-f3ff-4a14-a25f-a56b2190ea86 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:19.799193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-56d4ec03-f3ff-4a14-a25f-a56b2190ea86 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:19.824342 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-56d4ec03-f3ff-4a14-a25f-a56b2190ea86 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1512 microversion: 2.1 time: 0.870785 Aug 24 10:33:19.827271 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1939/4220] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:18 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1512 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:33:20.848618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e0474154-b1dc-4e30-b1b1-9a926d2ab61a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:20.850267 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e0474154-b1dc-4e30-b1b1-9a926d2ab61a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:20.869858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0474154-b1dc-4e30-b1b1-9a926d2ab61a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:20.873905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0474154-b1dc-4e30-b1b1-9a926d2ab61a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:20.877163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0474154-b1dc-4e30-b1b1-9a926d2ab61a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:20.881035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0474154-b1dc-4e30-b1b1-9a926d2ab61a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:20.903207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0474154-b1dc-4e30-b1b1-9a926d2ab61a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:20.908175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0474154-b1dc-4e30-b1b1-9a926d2ab61a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:22.612794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e0474154-b1dc-4e30-b1b1-9a926d2ab61a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:22.654513 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e0474154-b1dc-4e30-b1b1-9a926d2ab61a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1533 microversion: 2.1 time: 1.810590 Aug 24 10:33:22.655131 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2282/4221] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:20 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1533 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:23.678912 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0ebf9fbe-fcc3-47bb-8cba-fd0477171235 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:23.679563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0ebf9fbe-fcc3-47bb-8cba-fd0477171235 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:23.697952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ebf9fbe-fcc3-47bb-8cba-fd0477171235 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:23.701604 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ebf9fbe-fcc3-47bb-8cba-fd0477171235 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:23.702333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ebf9fbe-fcc3-47bb-8cba-fd0477171235 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:23.703306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ebf9fbe-fcc3-47bb-8cba-fd0477171235 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:23.704110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ebf9fbe-fcc3-47bb-8cba-fd0477171235 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:23.705510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ebf9fbe-fcc3-47bb-8cba-fd0477171235 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:24.183189 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0ebf9fbe-fcc3-47bb-8cba-fd0477171235 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:24.204556 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0ebf9fbe-fcc3-47bb-8cba-fd0477171235 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1528 microversion: 2.1 time: 0.530125 Aug 24 10:33:24.223599 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1940/4222] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:23 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1528 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:33:25.229245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c9a759a8-8ece-4a8b-af70-350f55d36631 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:25.230494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c9a759a8-8ece-4a8b-af70-350f55d36631 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:25.266140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9a759a8-8ece-4a8b-af70-350f55d36631 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:25.270189 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9a759a8-8ece-4a8b-af70-350f55d36631 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:25.275630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9a759a8-8ece-4a8b-af70-350f55d36631 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:25.280319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9a759a8-8ece-4a8b-af70-350f55d36631 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:25.286247 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9a759a8-8ece-4a8b-af70-350f55d36631 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:25.293180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9a759a8-8ece-4a8b-af70-350f55d36631 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:25.300388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:26.320327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c9a759a8-8ece-4a8b-af70-350f55d36631 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:26.331646 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c9a759a8-8ece-4a8b-af70-350f55d36631 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1528 microversion: 2.1 time: 1.107399 Aug 24 10:33:26.338911 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2283/4223] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:25 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1528 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:27.360587 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-589bb12e-12d1-47b1-8015-8fd57e8376b6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:27.362865 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-589bb12e-12d1-47b1-8015-8fd57e8376b6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:27.397217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-589bb12e-12d1-47b1-8015-8fd57e8376b6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:27.398165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-589bb12e-12d1-47b1-8015-8fd57e8376b6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:27.398871 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-589bb12e-12d1-47b1-8015-8fd57e8376b6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:27.401611 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-589bb12e-12d1-47b1-8015-8fd57e8376b6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:27.412154 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-589bb12e-12d1-47b1-8015-8fd57e8376b6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:27.412929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-589bb12e-12d1-47b1-8015-8fd57e8376b6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:27.505252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=78 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:27.716271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-5f22d964-feda-46a4-ba74-faf7f9fa9c6f req-65987042-9f91-450e-ab3c-050e913ec75a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fb1d6b5-a27c-465a-aa10-652d2cc366ae", "name": "network-vif-plugged", "status": "completed", "tag": "05c1a894-3c87-4d83-9b42-234ddedc80b0"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:33:27.740390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5f22d964-feda-46a4-ba74-faf7f9fa9c6f req-65987042-9f91-450e-ab3c-050e913ec75a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:27.745913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5f22d964-feda-46a4-ba74-faf7f9fa9c6f req-65987042-9f91-450e-ab3c-050e913ec75a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:27.752742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5f22d964-feda-46a4-ba74-faf7f9fa9c6f req-65987042-9f91-450e-ab3c-050e913ec75a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:27.782151 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-5f22d964-feda-46a4-ba74-faf7f9fa9c6f req-65987042-9f91-450e-ab3c-050e913ec75a service nova] Creating event network-vif-plugged:05c1a894-3c87-4d83-9b42-234ddedc80b0 for instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae on n-h2-849328-3 Aug 24 10:33:27.791115 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-5f22d964-feda-46a4-ba74-faf7f9fa9c6f req-65987042-9f91-450e-ab3c-050e913ec75a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078837 Aug 24 10:33:27.801350 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2284/4224] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:33:28.555040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-589bb12e-12d1-47b1-8015-8fd57e8376b6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:28.566802 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-589bb12e-12d1-47b1-8015-8fd57e8376b6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1528 microversion: 2.1 time: 1.209141 Aug 24 10:33:28.570165 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1941/4225] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:27 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1528 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:29.596772 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-97645243-e63e-46af-80ad-b60783125bfb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:29.597569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-97645243-e63e-46af-80ad-b60783125bfb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:29.641005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97645243-e63e-46af-80ad-b60783125bfb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:29.645431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97645243-e63e-46af-80ad-b60783125bfb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:29.647350 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97645243-e63e-46af-80ad-b60783125bfb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:29.654982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97645243-e63e-46af-80ad-b60783125bfb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:29.657490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97645243-e63e-46af-80ad-b60783125bfb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:29.661775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97645243-e63e-46af-80ad-b60783125bfb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:30.250588 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-97645243-e63e-46af-80ad-b60783125bfb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:30.262860 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-97645243-e63e-46af-80ad-b60783125bfb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1528 microversion: 2.1 time: 0.673692 Aug 24 10:33:30.287297 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2285/4226] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:29 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1528 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:31.300277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e07afc21-cbd3-4257-862c-31d82e98edf7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:31.301674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e07afc21-cbd3-4257-862c-31d82e98edf7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:31.334931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e07afc21-cbd3-4257-862c-31d82e98edf7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:31.336785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e07afc21-cbd3-4257-862c-31d82e98edf7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:31.339299 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e07afc21-cbd3-4257-862c-31d82e98edf7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:31.346180 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e07afc21-cbd3-4257-862c-31d82e98edf7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:31.349098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e07afc21-cbd3-4257-862c-31d82e98edf7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:31.351277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e07afc21-cbd3-4257-862c-31d82e98edf7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:32.630359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e07afc21-cbd3-4257-862c-31d82e98edf7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:32.642556 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e07afc21-cbd3-4257-862c-31d82e98edf7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1528 microversion: 2.1 time: 1.352033 Aug 24 10:33:32.666695 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1942/4227] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:31 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1528 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:33.672186 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a107fd50-b1c4-444f-8ec2-0596a81b65bf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:33.673075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a107fd50-b1c4-444f-8ec2-0596a81b65bf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:33.700272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=18 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:33.704725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a107fd50-b1c4-444f-8ec2-0596a81b65bf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:33.713899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a107fd50-b1c4-444f-8ec2-0596a81b65bf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:33.714477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a107fd50-b1c4-444f-8ec2-0596a81b65bf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:33.716489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a107fd50-b1c4-444f-8ec2-0596a81b65bf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:33.729896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a107fd50-b1c4-444f-8ec2-0596a81b65bf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:33.730357 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a107fd50-b1c4-444f-8ec2-0596a81b65bf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:35.203262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a107fd50-b1c4-444f-8ec2-0596a81b65bf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:35.217037 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a107fd50-b1c4-444f-8ec2-0596a81b65bf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1528 microversion: 2.1 time: 1.548786 Aug 24 10:33:35.224623 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2286/4228] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:33 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1528 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:36.013545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b02f7ee3-1ec4-4ddf-b3b4-45c74a3e257f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:36.014287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b02f7ee3-1ec4-4ddf-b3b4-45c74a3e257f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:36.033301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b02f7ee3-1ec4-4ddf-b3b4-45c74a3e257f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:36.034709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b02f7ee3-1ec4-4ddf-b3b4-45c74a3e257f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:36.039601 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b02f7ee3-1ec4-4ddf-b3b4-45c74a3e257f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:36.040866 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b02f7ee3-1ec4-4ddf-b3b4-45c74a3e257f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:36.043434 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b02f7ee3-1ec4-4ddf-b3b4-45c74a3e257f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:36.057261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b02f7ee3-1ec4-4ddf-b3b4-45c74a3e257f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:36.246859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-28673a34-b166-47e9-a695-bc6b3b9810e7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:36.249105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-28673a34-b166-47e9-a695-bc6b3b9810e7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:36.266189 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28673a34-b166-47e9-a695-bc6b3b9810e7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:36.271814 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28673a34-b166-47e9-a695-bc6b3b9810e7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:36.272733 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28673a34-b166-47e9-a695-bc6b3b9810e7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:36.275356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28673a34-b166-47e9-a695-bc6b3b9810e7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:36.276064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28673a34-b166-47e9-a695-bc6b3b9810e7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:36.279920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28673a34-b166-47e9-a695-bc6b3b9810e7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:36.788161 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b02f7ee3-1ec4-4ddf-b3b4-45c74a3e257f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:36.796566 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b02f7ee3-1ec4-4ddf-b3b4-45c74a3e257f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1682 microversion: 2.1 time: 0.789572 Aug 24 10:33:36.810435 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1943/4229] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:36 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1682 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:37.545672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-60311d44-c8ac-4f48-bc92-88d375efc81a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:33:37.551828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-60311d44-c8ac-4f48-bc92-88d375efc81a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:37.572646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60311d44-c8ac-4f48-bc92-88d375efc81a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:37.573207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60311d44-c8ac-4f48-bc92-88d375efc81a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:37.573850 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60311d44-c8ac-4f48-bc92-88d375efc81a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:37.574756 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60311d44-c8ac-4f48-bc92-88d375efc81a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:37.577813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60311d44-c8ac-4f48-bc92-88d375efc81a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:37.578551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60311d44-c8ac-4f48-bc92-88d375efc81a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:37.608601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-28673a34-b166-47e9-a695-bc6b3b9810e7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:37.618033 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-28673a34-b166-47e9-a695-bc6b3b9810e7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1528 microversion: 2.1 time: 1.376281 Aug 24 10:33:37.649856 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2287/4230] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:36 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1528 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:37.744945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-60311d44-c8ac-4f48-bc92-88d375efc81a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lazy-loading 'flavor' on Instance uuid 09f120f6-861a-4946-981b-47559a9c97fa {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:33:37.823124 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e90a1841-6a93-4a02-9ef9-c6c128c65c9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:37.823809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e90a1841-6a93-4a02-9ef9-c6c128c65c9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:37.830328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e90a1841-6a93-4a02-9ef9-c6c128c65c9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:37.847335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e90a1841-6a93-4a02-9ef9-c6c128c65c9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:37.847800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e90a1841-6a93-4a02-9ef9-c6c128c65c9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:37.848602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e90a1841-6a93-4a02-9ef9-c6c128c65c9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:37.849285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e90a1841-6a93-4a02-9ef9-c6c128c65c9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:37.849763 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e90a1841-6a93-4a02-9ef9-c6c128c65c9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:38.312816 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-60311d44-c8ac-4f48-bc92-88d375efc81a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "POST /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/action" status: 200 len: 32 microversion: 2.1 time: 0.764101 Aug 24 10:33:38.319209 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1944/4231] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:33:37 2022] POST /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/action => generated 32 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:33:38.345596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5555801d-0d89-4691-99e6-b2a54395f443 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:38.349092 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5555801d-0d89-4691-99e6-b2a54395f443 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:38.388847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5555801d-0d89-4691-99e6-b2a54395f443 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:38.389401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5555801d-0d89-4691-99e6-b2a54395f443 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:38.403569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5555801d-0d89-4691-99e6-b2a54395f443 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:38.404639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5555801d-0d89-4691-99e6-b2a54395f443 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:38.405193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5555801d-0d89-4691-99e6-b2a54395f443 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:38.414068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5555801d-0d89-4691-99e6-b2a54395f443 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:39.370504 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5555801d-0d89-4691-99e6-b2a54395f443 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:39.387331 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5555801d-0d89-4691-99e6-b2a54395f443 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1736 microversion: 2.1 time: 1.066030 Aug 24 10:33:39.387943 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1945/4232] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:38 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1736 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:39.408137 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9ce0a815-306f-4f8b-bb22-0af277d6e4d3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:39.430861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9ce0a815-306f-4f8b-bb22-0af277d6e4d3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:39.453713 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ce0a815-306f-4f8b-bb22-0af277d6e4d3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:39.454225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ce0a815-306f-4f8b-bb22-0af277d6e4d3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:39.454665 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ce0a815-306f-4f8b-bb22-0af277d6e4d3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:39.489560 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ce0a815-306f-4f8b-bb22-0af277d6e4d3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:39.490330 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ce0a815-306f-4f8b-bb22-0af277d6e4d3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:39.492443 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ce0a815-306f-4f8b-bb22-0af277d6e4d3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:40.128762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9ce0a815-306f-4f8b-bb22-0af277d6e4d3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:40.170045 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9ce0a815-306f-4f8b-bb22-0af277d6e4d3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1528 microversion: 2.1 time: 0.763438 Aug 24 10:33:40.175802 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1946/4233] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:39 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1528 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:40.408826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-573ee479-714d-4edc-a583-b024030e935e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:40.409478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-573ee479-714d-4edc-a583-b024030e935e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:40.417234 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-573ee479-714d-4edc-a583-b024030e935e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:40.417734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-573ee479-714d-4edc-a583-b024030e935e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:40.418175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-573ee479-714d-4edc-a583-b024030e935e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:40.418895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-573ee479-714d-4edc-a583-b024030e935e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:40.419468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-573ee479-714d-4edc-a583-b024030e935e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:40.419793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-573ee479-714d-4edc-a583-b024030e935e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:40.977371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e90a1841-6a93-4a02-9ef9-c6c128c65c9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:40.992488 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e90a1841-6a93-4a02-9ef9-c6c128c65c9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 3.174162 Aug 24 10:33:41.012547 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2288/4234] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:37 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 3195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:41.019942 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-88f38ab3-b7e8-49d8-bcea-1bc9e2caf21c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1975146127"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:33:41.039806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-88f38ab3-b7e8-49d8-bcea-1bc9e2caf21c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:41.064139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88f38ab3-b7e8-49d8-bcea-1bc9e2caf21c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:41.065322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88f38ab3-b7e8-49d8-bcea-1bc9e2caf21c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:41.065921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88f38ab3-b7e8-49d8-bcea-1bc9e2caf21c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:41.066793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88f38ab3-b7e8-49d8-bcea-1bc9e2caf21c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:41.067393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88f38ab3-b7e8-49d8-bcea-1bc9e2caf21c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:41.067966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88f38ab3-b7e8-49d8-bcea-1bc9e2caf21c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:41.474343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-573ee479-714d-4edc-a583-b024030e935e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:41.509988 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-573ee479-714d-4edc-a583-b024030e935e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1736 microversion: 2.1 time: 1.088417 Aug 24 10:33:41.510765 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1947/4235] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:40 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1736 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:41.542926 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4772bef9-fad5-4c79-9fb5-5abc1e129f7e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:41.543646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4772bef9-fad5-4c79-9fb5-5abc1e129f7e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:41.579757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4772bef9-fad5-4c79-9fb5-5abc1e129f7e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:41.594076 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4772bef9-fad5-4c79-9fb5-5abc1e129f7e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:41.594701 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4772bef9-fad5-4c79-9fb5-5abc1e129f7e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:41.595469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4772bef9-fad5-4c79-9fb5-5abc1e129f7e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:41.607655 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4772bef9-fad5-4c79-9fb5-5abc1e129f7e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:41.608323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4772bef9-fad5-4c79-9fb5-5abc1e129f7e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:41.792901 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-88f38ab3-b7e8-49d8-bcea-1bc9e2caf21c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action" status: 202 len: 0 microversion: 2.1 time: 0.777758 Aug 24 10:33:41.793737 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2289/4236] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:33:41 2022] POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action => generated 0 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 24 10:33:42.367582 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4772bef9-fad5-4c79-9fb5-5abc1e129f7e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:42.401871 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4772bef9-fad5-4c79-9fb5-5abc1e129f7e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1528 microversion: 2.1 time: 0.870419 Aug 24 10:33:42.418189 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1948/4237] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:41 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1528 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:42.534878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-92d4015a-1e5f-40f8-971d-b3bbef83b66d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:42.536012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-92d4015a-1e5f-40f8-971d-b3bbef83b66d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:42.572126 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92d4015a-1e5f-40f8-971d-b3bbef83b66d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:42.576410 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92d4015a-1e5f-40f8-971d-b3bbef83b66d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:42.578352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92d4015a-1e5f-40f8-971d-b3bbef83b66d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:42.579375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92d4015a-1e5f-40f8-971d-b3bbef83b66d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:42.588439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92d4015a-1e5f-40f8-971d-b3bbef83b66d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:42.589330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92d4015a-1e5f-40f8-971d-b3bbef83b66d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:43.230284 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f71b8299-8d41-4b4b-b07b-07583ec55b44 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1029783725", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "a99410f7-d26f-4963-9541-f923cc4b2b1e"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:33:43.390672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-f71b8299-8d41-4b4b-b07b-07583ec55b44 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] validate_networks() for [('a99410f7-d26f-4963-9541-f923cc4b2b1e', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:33:44.040114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-92d4015a-1e5f-40f8-971d-b3bbef83b66d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:44.057436 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-92d4015a-1e5f-40f8-971d-b3bbef83b66d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1736 microversion: 2.1 time: 1.530171 Aug 24 10:33:44.084005 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2290/4238] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:42 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1736 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:44.089076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-007092e5-480f-4cc0-ab3c-ef6eae90a5c9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:44.095960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-007092e5-480f-4cc0-ab3c-ef6eae90a5c9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:44.130907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-007092e5-480f-4cc0-ab3c-ef6eae90a5c9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:44.132670 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-007092e5-480f-4cc0-ab3c-ef6eae90a5c9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:44.133347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-007092e5-480f-4cc0-ab3c-ef6eae90a5c9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:44.135655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-007092e5-480f-4cc0-ab3c-ef6eae90a5c9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:44.137498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-007092e5-480f-4cc0-ab3c-ef6eae90a5c9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:44.145854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-007092e5-480f-4cc0-ab3c-ef6eae90a5c9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:44.634567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-007092e5-480f-4cc0-ab3c-ef6eae90a5c9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:44.657859 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-007092e5-480f-4cc0-ab3c-ef6eae90a5c9 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1528 microversion: 2.1 time: 0.560719 Aug 24 10:33:44.669173 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2291/4239] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:44 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1528 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:45.063600 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0732f6bc-26a3-446a-be47-5ba6dd8711f5 req-6329e5c6-a4fa-478c-ac11-28a0a3dcff7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ed6211-b7fc-454f-a8e9-73ba571a71af", "name": "network-vif-unplugged", "status": "completed", "tag": "1c2608cb-c0ff-45d5-b7c5-82ff95cc5b0c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:33:45.097792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0732f6bc-26a3-446a-be47-5ba6dd8711f5 req-6329e5c6-a4fa-478c-ac11-28a0a3dcff7a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:45.097792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0732f6bc-26a3-446a-be47-5ba6dd8711f5 req-6329e5c6-a4fa-478c-ac11-28a0a3dcff7a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:45.097792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0732f6bc-26a3-446a-be47-5ba6dd8711f5 req-6329e5c6-a4fa-478c-ac11-28a0a3dcff7a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:45.143046 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0732f6bc-26a3-446a-be47-5ba6dd8711f5 req-6329e5c6-a4fa-478c-ac11-28a0a3dcff7a service nova] Creating event network-vif-unplugged:1c2608cb-c0ff-45d5-b7c5-82ff95cc5b0c for instance 99ed6211-b7fc-454f-a8e9-73ba571a71af on n-h1-849328-3 Aug 24 10:33:45.159348 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0732f6bc-26a3-446a-be47-5ba6dd8711f5 req-6329e5c6-a4fa-478c-ac11-28a0a3dcff7a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094700 Aug 24 10:33:45.160513 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2292/4240] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:33:45.170039 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-73b74a61-3b92-4d28-8021-cc93ecc329fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:45.173646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-73b74a61-3b92-4d28-8021-cc93ecc329fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:45.188628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73b74a61-3b92-4d28-8021-cc93ecc329fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:45.189145 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73b74a61-3b92-4d28-8021-cc93ecc329fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:45.189938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73b74a61-3b92-4d28-8021-cc93ecc329fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:45.190653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73b74a61-3b92-4d28-8021-cc93ecc329fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:45.191106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73b74a61-3b92-4d28-8021-cc93ecc329fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:45.191530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73b74a61-3b92-4d28-8021-cc93ecc329fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:45.578925 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-73b74a61-3b92-4d28-8021-cc93ecc329fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:45.596472 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-73b74a61-3b92-4d28-8021-cc93ecc329fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1736 microversion: 2.1 time: 0.434380 Aug 24 10:33:45.597148 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2293/4241] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:45 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1736 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:45.683882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0714ce62-658a-4bf2-8ec0-2e45544ac885 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:45.684717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0714ce62-658a-4bf2-8ec0-2e45544ac885 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:45.710541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0714ce62-658a-4bf2-8ec0-2e45544ac885 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:45.711270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0714ce62-658a-4bf2-8ec0-2e45544ac885 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:45.716056 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0714ce62-658a-4bf2-8ec0-2e45544ac885 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:45.728472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0714ce62-658a-4bf2-8ec0-2e45544ac885 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:45.736034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0714ce62-658a-4bf2-8ec0-2e45544ac885 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:45.742191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0714ce62-658a-4bf2-8ec0-2e45544ac885 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:46.192262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0714ce62-658a-4bf2-8ec0-2e45544ac885 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:46.206281 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0714ce62-658a-4bf2-8ec0-2e45544ac885 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1528 microversion: 2.1 time: 0.523551 Aug 24 10:33:46.207876 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2294/4242] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:45 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1528 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:46.618286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f39864a2-0d54-4513-8cad-3daabde533c7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:46.619059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f39864a2-0d54-4513-8cad-3daabde533c7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:46.635683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f39864a2-0d54-4513-8cad-3daabde533c7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:46.636185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f39864a2-0d54-4513-8cad-3daabde533c7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:46.646118 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f39864a2-0d54-4513-8cad-3daabde533c7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:46.647039 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f39864a2-0d54-4513-8cad-3daabde533c7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:46.647702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f39864a2-0d54-4513-8cad-3daabde533c7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:46.648183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f39864a2-0d54-4513-8cad-3daabde533c7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:47.108260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f39864a2-0d54-4513-8cad-3daabde533c7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:47.131841 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f39864a2-0d54-4513-8cad-3daabde533c7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1736 microversion: 2.1 time: 0.503501 Aug 24 10:33:47.132610 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2295/4243] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:46 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1736 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:33:47.232917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f47bc30b-a681-47dd-9b55-cf0ec9037f57 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:47.234467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f47bc30b-a681-47dd-9b55-cf0ec9037f57 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:47.250424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f47bc30b-a681-47dd-9b55-cf0ec9037f57 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:47.257425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f47bc30b-a681-47dd-9b55-cf0ec9037f57 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:47.258899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f47bc30b-a681-47dd-9b55-cf0ec9037f57 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:47.261194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f47bc30b-a681-47dd-9b55-cf0ec9037f57 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:47.263273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f47bc30b-a681-47dd-9b55-cf0ec9037f57 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:47.264150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f47bc30b-a681-47dd-9b55-cf0ec9037f57 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:47.708303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f47bc30b-a681-47dd-9b55-cf0ec9037f57 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:47.721685 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f47bc30b-a681-47dd-9b55-cf0ec9037f57 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1528 microversion: 2.1 time: 0.492982 Aug 24 10:33:47.725220 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2296/4244] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:47 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1528 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:33:48.001699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f71b8299-8d41-4b4b-b07b-07583ec55b44 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:33:48.002204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f71b8299-8d41-4b4b-b07b-07583ec55b44 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:33:48.002683 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f71b8299-8d41-4b4b-b07b-07583ec55b44 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:33:48.003102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f71b8299-8d41-4b4b-b07b-07583ec55b44 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:33:48.003515 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f71b8299-8d41-4b4b-b07b-07583ec55b44 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:33:48.031965 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f71b8299-8d41-4b4b-b07b-07583ec55b44 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:48.032388 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f71b8299-8d41-4b4b-b07b-07583ec55b44 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:48.032833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f71b8299-8d41-4b4b-b07b-07583ec55b44 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:48.052395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f71b8299-8d41-4b4b-b07b-07583ec55b44 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:48.052918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f71b8299-8d41-4b4b-b07b-07583ec55b44 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:48.053403 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f71b8299-8d41-4b4b-b07b-07583ec55b44 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:48.159791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7a432975-3dd2-4caf-a1dc-368be4098a34 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:48.160428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7a432975-3dd2-4caf-a1dc-368be4098a34 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:48.194003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a432975-3dd2-4caf-a1dc-368be4098a34 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:48.198008 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a432975-3dd2-4caf-a1dc-368be4098a34 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:48.205306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a432975-3dd2-4caf-a1dc-368be4098a34 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:48.218329 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a432975-3dd2-4caf-a1dc-368be4098a34 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:48.219821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a432975-3dd2-4caf-a1dc-368be4098a34 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:48.223324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-f71b8299-8d41-4b4b-b07b-07583ec55b44 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Getting quotas for project 070259159f48477787b16ce6ba8f75bd. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:33:48.225917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a432975-3dd2-4caf-a1dc-368be4098a34 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:48.261798 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-f71b8299-8d41-4b4b-b07b-07583ec55b44 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Getting quotas for user 99b9e0c2673344f2a705f7a64c67647f and project 070259159f48477787b16ce6ba8f75bd. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:33:48.457693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f71b8299-8d41-4b4b-b07b-07583ec55b44 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Going to run 3 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:33:48.461003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f71b8299-8d41-4b4b-b07b-07583ec55b44 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:33:48.633143 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f71b8299-8d41-4b4b-b07b-07583ec55b44 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: b46db21c-fd73-4f03-958c-da10e32c008c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:33:48.832055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f71b8299-8d41-4b4b-b07b-07583ec55b44 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: fcb9a7a5-d263-4304-bb5a-d94b5414c2c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=b46db21c-fd73-4f03-958c-da10e32c008c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:33:49.194700 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f71b8299-8d41-4b4b-b07b-07583ec55b44 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.450611 Aug 24 10:33:49.200916 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1949/4245] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:33:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 6458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:33:49.236741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bfb35f7d-2056-41d8-b760-9ed8bcf909a3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:49.240992 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bfb35f7d-2056-41d8-b760-9ed8bcf909a3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:49.248202 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=9 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:49.274738 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfb35f7d-2056-41d8-b760-9ed8bcf909a3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:49.275454 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfb35f7d-2056-41d8-b760-9ed8bcf909a3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:49.276044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfb35f7d-2056-41d8-b760-9ed8bcf909a3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:49.278134 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfb35f7d-2056-41d8-b760-9ed8bcf909a3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:49.280212 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfb35f7d-2056-41d8-b760-9ed8bcf909a3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:49.281832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfb35f7d-2056-41d8-b760-9ed8bcf909a3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:49.320968 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7a432975-3dd2-4caf-a1dc-368be4098a34 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:49.331175 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7a432975-3dd2-4caf-a1dc-368be4098a34 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1736 microversion: 2.1 time: 1.178757 Aug 24 10:33:49.347377 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2297/4246] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:48 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1736 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:33:49.352659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a6cd22b8-47a9-49eb-b0c1-f7a61563f40d tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:49.387691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a6cd22b8-47a9-49eb-b0c1-f7a61563f40d tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:49.389879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a6cd22b8-47a9-49eb-b0c1-f7a61563f40d tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Searching by: {'deleted': False, 'project_id': '070259159f48477787b16ce6ba8f75bd'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:33:49.472989 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6cd22b8-47a9-49eb-b0c1-f7a61563f40d tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:49.475723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6cd22b8-47a9-49eb-b0c1-f7a61563f40d tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:49.476438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6cd22b8-47a9-49eb-b0c1-f7a61563f40d tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:49.477623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6cd22b8-47a9-49eb-b0c1-f7a61563f40d tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:49.479584 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6cd22b8-47a9-49eb-b0c1-f7a61563f40d tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:49.480875 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6cd22b8-47a9-49eb-b0c1-f7a61563f40d tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:49.561715 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a6cd22b8-47a9-49eb-b0c1-f7a61563f40d tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.211616 Aug 24 10:33:49.579655 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2298/4247] 10.222.0.85 () {58 vars in 1125 bytes} [Wed Aug 24 10:33:49 2022] GET /compute/v2.1/servers => generated 1018 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:49.592314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-543f3ca2-b75c-4fb6-8cc4-070974cc587a tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:49.593441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-543f3ca2-b75c-4fb6-8cc4-070974cc587a tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: fcb9a7a5-d263-4304-bb5a-d94b5414c2c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:49.836269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-543f3ca2-b75c-4fb6-8cc4-070974cc587a tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:49.850334 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-543f3ca2-b75c-4fb6-8cc4-070974cc587a tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4" status: 200 len: 1223 microversion: 2.1 time: 0.268755 Aug 24 10:33:49.868823 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2299/4248] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:49 2022] GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 => generated 1223 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:50.169457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bfb35f7d-2056-41d8-b760-9ed8bcf909a3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:50.192046 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bfb35f7d-2056-41d8-b760-9ed8bcf909a3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1528 microversion: 2.1 time: 0.989908 Aug 24 10:33:50.197099 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1950/4249] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:49 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1528 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:50.372074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bbca8622-b616-4fb1-9ebb-ccd7088ef35f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:50.373581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bbca8622-b616-4fb1-9ebb-ccd7088ef35f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:50.399086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbca8622-b616-4fb1-9ebb-ccd7088ef35f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:50.416671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbca8622-b616-4fb1-9ebb-ccd7088ef35f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:50.420609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbca8622-b616-4fb1-9ebb-ccd7088ef35f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:50.436588 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbca8622-b616-4fb1-9ebb-ccd7088ef35f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:50.445485 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbca8622-b616-4fb1-9ebb-ccd7088ef35f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:50.446457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbca8622-b616-4fb1-9ebb-ccd7088ef35f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:50.881594 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ebc916b9-1ec4-4407-9800-3409f113fccc tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:50.882750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ebc916b9-1ec4-4407-9800-3409f113fccc tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: fcb9a7a5-d263-4304-bb5a-d94b5414c2c4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:51.374155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ebc916b9-1ec4-4407-9800-3409f113fccc tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:51.398645 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ebc916b9-1ec4-4407-9800-3409f113fccc tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4" status: 200 len: 1223 microversion: 2.1 time: 0.521000 Aug 24 10:33:51.399960 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1951/4250] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:50 2022] GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 => generated 1223 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:51.441220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9728dba4-070f-4e5a-99d3-73c49a9a6b9e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:51.455742 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9728dba4-070f-4e5a-99d3-73c49a9a6b9e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:51.498056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9728dba4-070f-4e5a-99d3-73c49a9a6b9e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:51.502236 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9728dba4-070f-4e5a-99d3-73c49a9a6b9e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:51.511261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9728dba4-070f-4e5a-99d3-73c49a9a6b9e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:51.512273 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9728dba4-070f-4e5a-99d3-73c49a9a6b9e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:51.512780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9728dba4-070f-4e5a-99d3-73c49a9a6b9e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:51.514270 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9728dba4-070f-4e5a-99d3-73c49a9a6b9e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:51.705184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bbca8622-b616-4fb1-9ebb-ccd7088ef35f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:51.722416 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bbca8622-b616-4fb1-9ebb-ccd7088ef35f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1736 microversion: 2.1 time: 1.360630 Aug 24 10:33:51.724567 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2300/4251] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:50 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1736 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:52.057946 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9728dba4-070f-4e5a-99d3-73c49a9a6b9e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:52.075043 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9728dba4-070f-4e5a-99d3-73c49a9a6b9e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1528 microversion: 2.1 time: 0.658718 Aug 24 10:33:52.095054 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1952/4252] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:51 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1528 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:52.425080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-785d768f-2f2f-4b87-9fbe-515879577267 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:52.462338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-785d768f-2f2f-4b87-9fbe-515879577267 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: fcb9a7a5-d263-4304-bb5a-d94b5414c2c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:52.691135 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-785d768f-2f2f-4b87-9fbe-515879577267 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:52.705370 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-785d768f-2f2f-4b87-9fbe-515879577267 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4" status: 200 len: 1223 microversion: 2.1 time: 0.289221 Aug 24 10:33:52.722380 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2301/4253] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:52 2022] GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 => generated 1223 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:52.745552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-537471cc-dd8d-4bd3-a56e-6a2abda72f00 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:52.747565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-537471cc-dd8d-4bd3-a56e-6a2abda72f00 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:52.761247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-537471cc-dd8d-4bd3-a56e-6a2abda72f00 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:52.767219 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-537471cc-dd8d-4bd3-a56e-6a2abda72f00 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:52.768956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-537471cc-dd8d-4bd3-a56e-6a2abda72f00 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:52.784971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-537471cc-dd8d-4bd3-a56e-6a2abda72f00 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:52.789872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-537471cc-dd8d-4bd3-a56e-6a2abda72f00 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:52.792529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-537471cc-dd8d-4bd3-a56e-6a2abda72f00 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:53.108563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-20a49731-4a81-4cba-8b24-e4270a8448c5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:53.109682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-20a49731-4a81-4cba-8b24-e4270a8448c5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:53.131805 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20a49731-4a81-4cba-8b24-e4270a8448c5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:53.132953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20a49731-4a81-4cba-8b24-e4270a8448c5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:53.137317 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20a49731-4a81-4cba-8b24-e4270a8448c5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:53.146722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20a49731-4a81-4cba-8b24-e4270a8448c5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:53.148720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20a49731-4a81-4cba-8b24-e4270a8448c5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:53.153595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20a49731-4a81-4cba-8b24-e4270a8448c5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:53.262031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:53.780207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-537471cc-dd8d-4bd3-a56e-6a2abda72f00 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:53.820819 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-537471cc-dd8d-4bd3-a56e-6a2abda72f00 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1736 microversion: 2.1 time: 1.072376 Aug 24 10:33:53.822796 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1953/4254] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:52 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1736 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:53.858409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92bed777-aa9a-4a27-8883-06d39cae5280 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:53.861508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-92bed777-aa9a-4a27-8883-06d39cae5280 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: fcb9a7a5-d263-4304-bb5a-d94b5414c2c4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:53.908011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92bed777-aa9a-4a27-8883-06d39cae5280 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:53.912409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92bed777-aa9a-4a27-8883-06d39cae5280 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:53.913279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92bed777-aa9a-4a27-8883-06d39cae5280 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:53.916360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92bed777-aa9a-4a27-8883-06d39cae5280 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:53.917237 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92bed777-aa9a-4a27-8883-06d39cae5280 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:53.917857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92bed777-aa9a-4a27-8883-06d39cae5280 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:53.972807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-20a49731-4a81-4cba-8b24-e4270a8448c5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:53.982651 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-20a49731-4a81-4cba-8b24-e4270a8448c5 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1528 microversion: 2.1 time: 0.879210 Aug 24 10:33:53.997243 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2302/4255] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:53 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1528 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:54.386743 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-92bed777-aa9a-4a27-8883-06d39cae5280 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:54.432650 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-92bed777-aa9a-4a27-8883-06d39cae5280 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4" status: 200 len: 1219 microversion: 2.1 time: 0.587024 Aug 24 10:33:54.441023 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1954/4256] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:53 2022] GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 => generated 1219 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:54.844537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c001564c-f101-4d32-926c-c0cc2ce4a068 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:54.845360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c001564c-f101-4d32-926c-c0cc2ce4a068 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:54.859129 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c001564c-f101-4d32-926c-c0cc2ce4a068 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:54.859637 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c001564c-f101-4d32-926c-c0cc2ce4a068 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:54.860085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c001564c-f101-4d32-926c-c0cc2ce4a068 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:54.860827 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c001564c-f101-4d32-926c-c0cc2ce4a068 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:54.861361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c001564c-f101-4d32-926c-c0cc2ce4a068 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:54.861773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c001564c-f101-4d32-926c-c0cc2ce4a068 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:55.022483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-66626307-dd89-4580-b4fa-931f7a183a6f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:55.023064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-66626307-dd89-4580-b4fa-931f7a183a6f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:55.037321 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66626307-dd89-4580-b4fa-931f7a183a6f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:55.037856 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66626307-dd89-4580-b4fa-931f7a183a6f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:55.038311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66626307-dd89-4580-b4fa-931f7a183a6f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:55.039059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66626307-dd89-4580-b4fa-931f7a183a6f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:55.039526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66626307-dd89-4580-b4fa-931f7a183a6f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:55.039966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66626307-dd89-4580-b4fa-931f7a183a6f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:56.966458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-66626307-dd89-4580-b4fa-931f7a183a6f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:56.974861 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-66626307-dd89-4580-b4fa-931f7a183a6f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1528 microversion: 2.1 time: 1.956774 Aug 24 10:33:57.002760 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1955/4257] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:55 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1528 bytes in 1983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:57.025729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c001564c-f101-4d32-926c-c0cc2ce4a068 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:57.060669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2633f49e-038b-4ea9-93ca-056015f968da tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:57.063937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2633f49e-038b-4ea9-93ca-056015f968da tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: fcb9a7a5-d263-4304-bb5a-d94b5414c2c4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:57.077655 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c001564c-f101-4d32-926c-c0cc2ce4a068 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1736 microversion: 2.1 time: 2.236871 Aug 24 10:33:57.088899 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2303/4258] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:54 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1736 bytes in 2249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:57.114264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2633f49e-038b-4ea9-93ca-056015f968da tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:57.115299 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2633f49e-038b-4ea9-93ca-056015f968da tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:57.122445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2633f49e-038b-4ea9-93ca-056015f968da tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:57.123513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2633f49e-038b-4ea9-93ca-056015f968da tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:57.128725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2633f49e-038b-4ea9-93ca-056015f968da tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:57.133983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2633f49e-038b-4ea9-93ca-056015f968da tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:57.853229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2633f49e-038b-4ea9-93ca-056015f968da tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:57.853229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:57.868640 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2633f49e-038b-4ea9-93ca-056015f968da tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4" status: 200 len: 1281 microversion: 2.1 time: 0.865045 Aug 24 10:33:57.882940 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1956/4259] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:57 2022] GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 => generated 1281 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:57.996176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9341e1ad-4af8-483a-896e-dc2b75e76610 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:57.996700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9341e1ad-4af8-483a-896e-dc2b75e76610 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:58.014244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9341e1ad-4af8-483a-896e-dc2b75e76610 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:58.014911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9341e1ad-4af8-483a-896e-dc2b75e76610 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:58.015495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9341e1ad-4af8-483a-896e-dc2b75e76610 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:58.016256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9341e1ad-4af8-483a-896e-dc2b75e76610 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:58.016718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9341e1ad-4af8-483a-896e-dc2b75e76610 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:58.017158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9341e1ad-4af8-483a-896e-dc2b75e76610 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:58.130623 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d98833b1-8d43-4bda-9035-31b83b5eb82c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:58.132031 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d98833b1-8d43-4bda-9035-31b83b5eb82c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:58.137533 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:58.147259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d98833b1-8d43-4bda-9035-31b83b5eb82c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:58.148065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d98833b1-8d43-4bda-9035-31b83b5eb82c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:58.148699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d98833b1-8d43-4bda-9035-31b83b5eb82c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:58.149803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d98833b1-8d43-4bda-9035-31b83b5eb82c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:58.150683 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d98833b1-8d43-4bda-9035-31b83b5eb82c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:58.151308 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d98833b1-8d43-4bda-9035-31b83b5eb82c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:59.521228 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d98833b1-8d43-4bda-9035-31b83b5eb82c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:59.535931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:59.541955 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d98833b1-8d43-4bda-9035-31b83b5eb82c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1736 microversion: 2.1 time: 1.413165 Aug 24 10:33:59.565179 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1957/4260] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:58 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1736 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:33:59.576247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c1cc1352-87c1-43eb-bd47-5aeea3fa021f tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:59.576881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c1cc1352-87c1-43eb-bd47-5aeea3fa021f tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: fcb9a7a5-d263-4304-bb5a-d94b5414c2c4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:59.616035 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1cc1352-87c1-43eb-bd47-5aeea3fa021f tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:59.617293 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1cc1352-87c1-43eb-bd47-5aeea3fa021f tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:59.627897 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1cc1352-87c1-43eb-bd47-5aeea3fa021f tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:59.634066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1cc1352-87c1-43eb-bd47-5aeea3fa021f tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:59.642954 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1cc1352-87c1-43eb-bd47-5aeea3fa021f tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:59.644015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1cc1352-87c1-43eb-bd47-5aeea3fa021f tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:59.791766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9341e1ad-4af8-483a-896e-dc2b75e76610 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:59.811586 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9341e1ad-4af8-483a-896e-dc2b75e76610 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1528 microversion: 2.1 time: 1.815100 Aug 24 10:33:59.815929 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2304/4261] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:57 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1528 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:00.124801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c1cc1352-87c1-43eb-bd47-5aeea3fa021f tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:00.137357 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c1cc1352-87c1-43eb-bd47-5aeea3fa021f tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4" status: 200 len: 1281 microversion: 2.1 time: 0.566538 Aug 24 10:34:00.153994 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1958/4262] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:59 2022] GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 => generated 1281 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:00.577113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e0b470ed-ff11-4677-9d8f-4e0fef34fbd3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:00.578983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e0b470ed-ff11-4677-9d8f-4e0fef34fbd3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:00.602889 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0b470ed-ff11-4677-9d8f-4e0fef34fbd3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:00.619824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0b470ed-ff11-4677-9d8f-4e0fef34fbd3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:00.621937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0b470ed-ff11-4677-9d8f-4e0fef34fbd3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:00.622949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0b470ed-ff11-4677-9d8f-4e0fef34fbd3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:00.635431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0b470ed-ff11-4677-9d8f-4e0fef34fbd3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:00.638133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0b470ed-ff11-4677-9d8f-4e0fef34fbd3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:00.716056 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aebc3480-d791-4801-81fa-358568adc85f tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Action: 'create', calling method: .version_select at 0x7f4647ab8550>, body: {"keypair": {"name": "tempest-keypair-1828607821", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbn0jPbdN9brDnCLeSYmTAPVLxMkKjtMod1vSFOVpTc+Nwtu3w98Omshiij+KL1TPblfEv0slZK5UhkWVFjWyNwocxIJZ8HdXn1p3FCLQ+zFijFNN8U7yh5MfM9Cfh0Eg=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:00.817321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-aebc3480-d791-4801-81fa-358568adc85f tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Getting quotas for project 6bf76463a8af45aaa6aa2c630bdcbb54. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:34:00.840832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-aebc3480-d791-4801-81fa-358568adc85f tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Getting quotas for user dbe66c7282c84f0fa2011575403c42d7 and project 6bf76463a8af45aaa6aa2c630bdcbb54. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:34:00.926706 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aebc3480-d791-4801-81fa-358568adc85f tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.109276 Aug 24 10:34:00.927781 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2305/4263] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:33:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:34:00.942992 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-ab2a4c5d-2cf3-4fd0-b415-4f3f5af5e478 req-630308ee-b4c8-44b7-aa9a-1238b736da4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ed6211-b7fc-454f-a8e9-73ba571a71af", "name": "network-vif-plugged", "status": "completed", "tag": "1c2608cb-c0ff-45d5-b7c5-82ff95cc5b0c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:00.982834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ab2a4c5d-2cf3-4fd0-b415-4f3f5af5e478 req-630308ee-b4c8-44b7-aa9a-1238b736da4c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:00.987582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ab2a4c5d-2cf3-4fd0-b415-4f3f5af5e478 req-630308ee-b4c8-44b7-aa9a-1238b736da4c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:00.989744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ab2a4c5d-2cf3-4fd0-b415-4f3f5af5e478 req-630308ee-b4c8-44b7-aa9a-1238b736da4c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:01.056857 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-ab2a4c5d-2cf3-4fd0-b415-4f3f5af5e478 req-630308ee-b4c8-44b7-aa9a-1238b736da4c service nova] Creating event network-vif-plugged:1c2608cb-c0ff-45d5-b7c5-82ff95cc5b0c for instance 99ed6211-b7fc-454f-a8e9-73ba571a71af on n-h1-849328-3 Aug 24 10:34:01.079823 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-ab2a4c5d-2cf3-4fd0-b415-4f3f5af5e478 req-630308ee-b4c8-44b7-aa9a-1238b736da4c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147211 Aug 24 10:34:01.082447 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2306/4264] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:34:01.099763 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-40cc4a69-14c2-4b00-a066-0126ddefb71b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:01.106877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-40cc4a69-14c2-4b00-a066-0126ddefb71b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:01.142488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40cc4a69-14c2-4b00-a066-0126ddefb71b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:01.144132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40cc4a69-14c2-4b00-a066-0126ddefb71b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:01.146948 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40cc4a69-14c2-4b00-a066-0126ddefb71b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:01.148043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40cc4a69-14c2-4b00-a066-0126ddefb71b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:01.148685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40cc4a69-14c2-4b00-a066-0126ddefb71b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:01.151865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40cc4a69-14c2-4b00-a066-0126ddefb71b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:01.387468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:01.788666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e0b470ed-ff11-4677-9d8f-4e0fef34fbd3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:01.800599 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e0b470ed-ff11-4677-9d8f-4e0fef34fbd3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1736 microversion: 2.1 time: 1.228418 Aug 24 10:34:01.804875 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1959/4265] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:00 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1736 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:01.825475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cf4d6030-8938-4e98-a46c-ac61a55bda8f tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:01.826393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cf4d6030-8938-4e98-a46c-ac61a55bda8f tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: fcb9a7a5-d263-4304-bb5a-d94b5414c2c4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:01.846231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf4d6030-8938-4e98-a46c-ac61a55bda8f tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:01.848263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf4d6030-8938-4e98-a46c-ac61a55bda8f tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:01.856354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf4d6030-8938-4e98-a46c-ac61a55bda8f tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:01.876985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf4d6030-8938-4e98-a46c-ac61a55bda8f tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:01.878086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf4d6030-8938-4e98-a46c-ac61a55bda8f tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:01.886197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf4d6030-8938-4e98-a46c-ac61a55bda8f tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:02.152096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cf4d6030-8938-4e98-a46c-ac61a55bda8f tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:02.196799 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cf4d6030-8938-4e98-a46c-ac61a55bda8f tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4" status: 200 len: 1281 microversion: 2.1 time: 0.375207 Aug 24 10:34:02.201283 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1960/4266] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:01 2022] GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 => generated 1281 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:02.645378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-40cc4a69-14c2-4b00-a066-0126ddefb71b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:02.664170 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-40cc4a69-14c2-4b00-a066-0126ddefb71b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1528 microversion: 2.1 time: 1.576016 Aug 24 10:34:02.667329 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2307/4267] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:01 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1528 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:02.835646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7410b69c-02fb-4100-bcf8-91fc33d7650b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:02.836266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7410b69c-02fb-4100-bcf8-91fc33d7650b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:02.854469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7410b69c-02fb-4100-bcf8-91fc33d7650b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:02.854974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7410b69c-02fb-4100-bcf8-91fc33d7650b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:02.855691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7410b69c-02fb-4100-bcf8-91fc33d7650b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:02.867376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7410b69c-02fb-4100-bcf8-91fc33d7650b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:02.867770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7410b69c-02fb-4100-bcf8-91fc33d7650b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:02.876872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7410b69c-02fb-4100-bcf8-91fc33d7650b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:03.226275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ad4c4c98-9a46-4448-a25b-e7a54fc6f294 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:03.227143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ad4c4c98-9a46-4448-a25b-e7a54fc6f294 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: fcb9a7a5-d263-4304-bb5a-d94b5414c2c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:03.242877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad4c4c98-9a46-4448-a25b-e7a54fc6f294 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:03.243679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad4c4c98-9a46-4448-a25b-e7a54fc6f294 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:03.244834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad4c4c98-9a46-4448-a25b-e7a54fc6f294 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:03.247261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad4c4c98-9a46-4448-a25b-e7a54fc6f294 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:03.247936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad4c4c98-9a46-4448-a25b-e7a54fc6f294 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:03.252667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad4c4c98-9a46-4448-a25b-e7a54fc6f294 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:03.812597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ad4c4c98-9a46-4448-a25b-e7a54fc6f294 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:03.823900 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ad4c4c98-9a46-4448-a25b-e7a54fc6f294 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4" status: 200 len: 1281 microversion: 2.1 time: 0.600429 Aug 24 10:34:03.824714 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2308/4268] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:03 2022] GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 => generated 1281 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:03.848734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3afaa869-0cac-4f14-b5ec-d0265f8d55a8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:03.849405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3afaa869-0cac-4f14-b5ec-d0265f8d55a8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:03.851526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:03.884002 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3afaa869-0cac-4f14-b5ec-d0265f8d55a8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:03.884522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3afaa869-0cac-4f14-b5ec-d0265f8d55a8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:03.884975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3afaa869-0cac-4f14-b5ec-d0265f8d55a8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:03.885732 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3afaa869-0cac-4f14-b5ec-d0265f8d55a8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:03.886197 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3afaa869-0cac-4f14-b5ec-d0265f8d55a8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:03.886636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3afaa869-0cac-4f14-b5ec-d0265f8d55a8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:04.799418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3afaa869-0cac-4f14-b5ec-d0265f8d55a8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:04.810771 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3afaa869-0cac-4f14-b5ec-d0265f8d55a8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1510 microversion: 2.1 time: 0.979790 Aug 24 10:34:04.830583 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2309/4269] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:03 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1510 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:04.845867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-721eda9d-3263-479d-ba55-5ab0421b72e3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:04.846991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-721eda9d-3263-479d-ba55-5ab0421b72e3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: fcb9a7a5-d263-4304-bb5a-d94b5414c2c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:04.869266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-721eda9d-3263-479d-ba55-5ab0421b72e3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:04.873685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-721eda9d-3263-479d-ba55-5ab0421b72e3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:04.874252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-721eda9d-3263-479d-ba55-5ab0421b72e3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:04.875182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-721eda9d-3263-479d-ba55-5ab0421b72e3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:04.876413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-721eda9d-3263-479d-ba55-5ab0421b72e3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:04.881339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-721eda9d-3263-479d-ba55-5ab0421b72e3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:05.218011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-721eda9d-3263-479d-ba55-5ab0421b72e3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:05.227306 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-721eda9d-3263-479d-ba55-5ab0421b72e3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4" status: 200 len: 1281 microversion: 2.1 time: 0.385377 Aug 24 10:34:05.231593 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2310/4270] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:04 2022] GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 => generated 1281 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:05.684181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7410b69c-02fb-4100-bcf8-91fc33d7650b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:05.696153 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7410b69c-02fb-4100-bcf8-91fc33d7650b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1736 microversion: 2.1 time: 2.869234 Aug 24 10:34:05.709806 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1961/4271] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:02 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1736 bytes in 2884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:34:05.838474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bd3eedba-f37f-45a7-8972-e4618141454d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:05.839293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bd3eedba-f37f-45a7-8972-e4618141454d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:05.852366 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd3eedba-f37f-45a7-8972-e4618141454d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:05.864792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd3eedba-f37f-45a7-8972-e4618141454d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:05.865720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd3eedba-f37f-45a7-8972-e4618141454d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:05.873530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd3eedba-f37f-45a7-8972-e4618141454d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:05.875009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd3eedba-f37f-45a7-8972-e4618141454d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:05.875692 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd3eedba-f37f-45a7-8972-e4618141454d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:06.251980 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7764caa6-2c1c-4030-a2dd-a34f1d82d6c3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:06.253178 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7764caa6-2c1c-4030-a2dd-a34f1d82d6c3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: fcb9a7a5-d263-4304-bb5a-d94b5414c2c4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:06.273684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7764caa6-2c1c-4030-a2dd-a34f1d82d6c3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:06.276238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7764caa6-2c1c-4030-a2dd-a34f1d82d6c3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:06.276832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7764caa6-2c1c-4030-a2dd-a34f1d82d6c3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:06.277781 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7764caa6-2c1c-4030-a2dd-a34f1d82d6c3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:06.278547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7764caa6-2c1c-4030-a2dd-a34f1d82d6c3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:06.281091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7764caa6-2c1c-4030-a2dd-a34f1d82d6c3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:07.109257 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bd3eedba-f37f-45a7-8972-e4618141454d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:07.118402 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bd3eedba-f37f-45a7-8972-e4618141454d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1510 microversion: 2.1 time: 1.283798 Aug 24 10:34:07.125058 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2311/4272] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:05 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1510 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:07.133469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4911f8d2-7a44-4ce7-8c35-e83bb68c6622 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:07.145986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4911f8d2-7a44-4ce7-8c35-e83bb68c6622 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:07.154082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4911f8d2-7a44-4ce7-8c35-e83bb68c6622 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:07.173252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4911f8d2-7a44-4ce7-8c35-e83bb68c6622 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:07.174730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4911f8d2-7a44-4ce7-8c35-e83bb68c6622 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:07.179168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4911f8d2-7a44-4ce7-8c35-e83bb68c6622 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:07.180429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4911f8d2-7a44-4ce7-8c35-e83bb68c6622 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:07.181640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4911f8d2-7a44-4ce7-8c35-e83bb68c6622 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:07.380926 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7764caa6-2c1c-4030-a2dd-a34f1d82d6c3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:07.399375 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7764caa6-2c1c-4030-a2dd-a34f1d82d6c3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4" status: 200 len: 1323 microversion: 2.1 time: 1.151639 Aug 24 10:34:07.403032 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1962/4273] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:06 2022] GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 => generated 1323 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:34:07.413468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-5b8400bd-8e05-4f4a-9092-5ca840ccd71d req-81ac49cd-b2ab-4edb-b80d-28d584b7a3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fb1d6b5-a27c-465a-aa10-652d2cc366ae", "name": "network-vif-unplugged", "status": "completed", "tag": "05c1a894-3c87-4d83-9b42-234ddedc80b0"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:07.464453 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5b8400bd-8e05-4f4a-9092-5ca840ccd71d req-81ac49cd-b2ab-4edb-b80d-28d584b7a3c2 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:07.465399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5b8400bd-8e05-4f4a-9092-5ca840ccd71d req-81ac49cd-b2ab-4edb-b80d-28d584b7a3c2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:07.466089 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5b8400bd-8e05-4f4a-9092-5ca840ccd71d req-81ac49cd-b2ab-4edb-b80d-28d584b7a3c2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:07.492542 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-5b8400bd-8e05-4f4a-9092-5ca840ccd71d req-81ac49cd-b2ab-4edb-b80d-28d584b7a3c2 service nova] Creating event network-vif-unplugged:05c1a894-3c87-4d83-9b42-234ddedc80b0 for instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae on n-h2-849328-3 Aug 24 10:34:07.517842 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-5b8400bd-8e05-4f4a-9092-5ca840ccd71d req-81ac49cd-b2ab-4edb-b80d-28d584b7a3c2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112628 Aug 24 10:34:07.519768 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1963/4274] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:34:07.556334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-25548d74-a0b3-476d-a7f2-08b74ea6742a req-97260031-7840-4c64-8e32-409d8a89cb3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6", "tag": "44c6fb77-e32f-470d-a31c-53dc0213be69"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:07.583979 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-25548d74-a0b3-476d-a7f2-08b74ea6742a req-97260031-7840-4c64-8e32-409d8a89cb3c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:07.584870 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-25548d74-a0b3-476d-a7f2-08b74ea6742a req-97260031-7840-4c64-8e32-409d8a89cb3c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:07.592476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-25548d74-a0b3-476d-a7f2-08b74ea6742a req-97260031-7840-4c64-8e32-409d8a89cb3c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:07.655336 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-25548d74-a0b3-476d-a7f2-08b74ea6742a req-97260031-7840-4c64-8e32-409d8a89cb3c service nova] Creating event network-changed:44c6fb77-e32f-470d-a31c-53dc0213be69 for instance 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 on n-h1-849328-3 Aug 24 10:34:07.690046 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-25548d74-a0b3-476d-a7f2-08b74ea6742a req-97260031-7840-4c64-8e32-409d8a89cb3c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138808 Aug 24 10:34:07.697618 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1964/4275] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:34:08.170938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-34cfc1dc-8c6d-4db1-8811-f06bc571cf39 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:08.174080 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-34cfc1dc-8c6d-4db1-8811-f06bc571cf39 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:08.206214 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34cfc1dc-8c6d-4db1-8811-f06bc571cf39 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:08.214555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34cfc1dc-8c6d-4db1-8811-f06bc571cf39 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:08.215887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34cfc1dc-8c6d-4db1-8811-f06bc571cf39 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:08.223692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34cfc1dc-8c6d-4db1-8811-f06bc571cf39 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:08.226409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34cfc1dc-8c6d-4db1-8811-f06bc571cf39 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:08.227522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34cfc1dc-8c6d-4db1-8811-f06bc571cf39 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:09.126697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-34cfc1dc-8c6d-4db1-8811-f06bc571cf39 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:09.135979 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-34cfc1dc-8c6d-4db1-8811-f06bc571cf39 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1510 microversion: 2.1 time: 0.986789 Aug 24 10:34:09.154069 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1965/4276] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:08 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1510 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:34:09.172970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-db857bec-f30a-4f5f-be47-a5a35198a813 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:09.173874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-db857bec-f30a-4f5f-be47-a5a35198a813 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: fcb9a7a5-d263-4304-bb5a-d94b5414c2c4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:09.196866 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db857bec-f30a-4f5f-be47-a5a35198a813 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:09.197696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db857bec-f30a-4f5f-be47-a5a35198a813 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:09.198339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db857bec-f30a-4f5f-be47-a5a35198a813 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:09.199251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db857bec-f30a-4f5f-be47-a5a35198a813 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:09.203296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db857bec-f30a-4f5f-be47-a5a35198a813 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:09.205186 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db857bec-f30a-4f5f-be47-a5a35198a813 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:09.311478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4911f8d2-7a44-4ce7-8c35-e83bb68c6622 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:09.366225 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4911f8d2-7a44-4ce7-8c35-e83bb68c6622 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1716 microversion: 2.1 time: 2.239584 Aug 24 10:34:09.409314 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2312/4277] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:07 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1716 bytes in 2282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:09.729632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7c5107f5-1071-4b93-af2f-c01f0d5ea161 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:09.732290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7c5107f5-1071-4b93-af2f-c01f0d5ea161 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:09.760578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c5107f5-1071-4b93-af2f-c01f0d5ea161 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:09.770467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c5107f5-1071-4b93-af2f-c01f0d5ea161 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:09.773810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c5107f5-1071-4b93-af2f-c01f0d5ea161 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:09.799144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c5107f5-1071-4b93-af2f-c01f0d5ea161 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:09.806375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c5107f5-1071-4b93-af2f-c01f0d5ea161 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:09.807520 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c5107f5-1071-4b93-af2f-c01f0d5ea161 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:10.081027 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-7c5107f5-1071-4b93-af2f-c01f0d5ea161 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] HTTP exception thrown: Cannot 'detach_volume' instance 09f120f6-861a-4946-981b-47559a9c97fa while it is in vm_state rescued Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7c5107f5-1071-4b93-af2f-c01f0d5ea161 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Request method failure captured: Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-volume_attachments/f78f5687-cfbe-4e6b-996b-652d2f6c0c64 HTTP/1.1 Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf2afGdSM86mh0RIAZFYBYhaQ4EtyTCcCD00ldy_PJZTrDPEqZsqjAaBEiSLwFHEWtlpLSXpU9lI2y_7Dlfdrd1tzCv296dD-Q1jtlqtcx2Z1VdQb3wVY7fHkhrfDX6lZ98oMTsvllOCneZWRxakMNA_j9HFWTm3gYwjAHKCNfApMTc Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 125d2dd1d22140abaa36184e3628a339 Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1145732609 Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/125d2dd1d22140abaa36184e3628a339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_125d2dd1d22140abaa36184e3628a339", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/125d2dd1d22140abaa36184e3628a339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/125d2dd1d22140abaa36184e3628a339"}]}] Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1145732609 Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 125d2dd1d22140abaa36184e3628a339 Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1145732609 Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerRescueNegativeTestJSON-1145732609-project Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 133e99904a6b4574933cad73d0f2293f Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1145732609-project Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: exception: Cannot 'detach_volume' instance 09f120f6-861a-4946-981b-47559a9c97fa while it is in vm_state rescued Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'server_id': '09f120f6-861a-4946-981b-47559a9c97fa', 'id': 'f78f5687-cfbe-4e6b-996b-652d2f6c0c64'} Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 09f120f6-861a-4946-981b-47559a9c97fa in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 09f120f6-861a-4946-981b-47559a9c97fa while it is in vm_state rescued Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:34:10.083547 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:10.088267 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:34:10.088267 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:34:10.088267 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:34:10.088267 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:34:10.088267 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 09f120f6-861a-4946-981b-47559a9c97fa while it is in vm_state rescued Aug 24 10:34:10.088267 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:34:10.091329 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7c5107f5-1071-4b93-af2f-c01f0d5ea161 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Returning 409 to user: Cannot 'detach_volume' instance 09f120f6-861a-4946-981b-47559a9c97fa while it is in vm_state rescued {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:34:10.092776 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7c5107f5-1071-4b93-af2f-c01f0d5ea161 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "DELETE /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-volume_attachments/f78f5687-cfbe-4e6b-996b-652d2f6c0c64" status: 409 len: 152 microversion: 2.1 time: 0.372894 Aug 24 10:34:10.096599 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2313/4278] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Aug 24 10:34:09 2022] DELETE /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-volume_attachments/f78f5687-cfbe-4e6b-996b-652d2f6c0c64 => generated 152 bytes in 376 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:34:10.112091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f020dcbd-48fc-4da5-9485-405b20384da3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:10.113432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f020dcbd-48fc-4da5-9485-405b20384da3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:10.126967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f020dcbd-48fc-4da5-9485-405b20384da3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:10.130889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f020dcbd-48fc-4da5-9485-405b20384da3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:10.131645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f020dcbd-48fc-4da5-9485-405b20384da3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:10.137807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f020dcbd-48fc-4da5-9485-405b20384da3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:10.139129 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f020dcbd-48fc-4da5-9485-405b20384da3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:10.139243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f020dcbd-48fc-4da5-9485-405b20384da3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:10.369015 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f020dcbd-48fc-4da5-9485-405b20384da3 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "POST /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/action" status: 202 len: 0 microversion: 2.1 time: 0.270038 Aug 24 10:34:10.370696 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2314/4279] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:34:10 2022] POST /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:34:10.385170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c5ac95e7-3302-4bf9-afa9-4a5b6a9d55d0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:10.386542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c5ac95e7-3302-4bf9-afa9-4a5b6a9d55d0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:10.394643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5ac95e7-3302-4bf9-afa9-4a5b6a9d55d0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:10.395565 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5ac95e7-3302-4bf9-afa9-4a5b6a9d55d0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:10.396260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5ac95e7-3302-4bf9-afa9-4a5b6a9d55d0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:10.397463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5ac95e7-3302-4bf9-afa9-4a5b6a9d55d0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:10.398546 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5ac95e7-3302-4bf9-afa9-4a5b6a9d55d0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:10.399241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5ac95e7-3302-4bf9-afa9-4a5b6a9d55d0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:10.643483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-db857bec-f30a-4f5f-be47-a5a35198a813 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:10.671357 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-db857bec-f30a-4f5f-be47-a5a35198a813 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4" status: 200 len: 1323 microversion: 2.1 time: 1.515424 Aug 24 10:34:10.684468 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1966/4280] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:09 2022] GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 => generated 1323 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:10.684468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2e635bb7-34d0-4b8a-869e-c4f7ad688a84 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:10.684468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2e635bb7-34d0-4b8a-869e-c4f7ad688a84 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:10.703930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e635bb7-34d0-4b8a-869e-c4f7ad688a84 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:10.704638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e635bb7-34d0-4b8a-869e-c4f7ad688a84 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:10.705279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e635bb7-34d0-4b8a-869e-c4f7ad688a84 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:10.706209 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e635bb7-34d0-4b8a-869e-c4f7ad688a84 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:10.706881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e635bb7-34d0-4b8a-869e-c4f7ad688a84 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:10.707548 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e635bb7-34d0-4b8a-869e-c4f7ad688a84 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:10.890717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:11.186988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2e635bb7-34d0-4b8a-869e-c4f7ad688a84 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:11.197538 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2e635bb7-34d0-4b8a-869e-c4f7ad688a84 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1724 microversion: 2.1 time: 0.523956 Aug 24 10:34:11.202050 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1967/4281] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:10 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1724 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:11.473532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5ecb793b-3eaa-4bb7-8104-921f5ac07b66 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1243008305", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:11.590568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-5ecb793b-3eaa-4bb7-8104-921f5ac07b66 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:34:11.792210 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c5ac95e7-3302-4bf9-afa9-4a5b6a9d55d0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:11.800984 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c5ac95e7-3302-4bf9-afa9-4a5b6a9d55d0 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1510 microversion: 2.1 time: 1.428771 Aug 24 10:34:11.815416 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2315/4282] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:10 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1510 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:11.829037 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-90c23757-6a0d-451a-bb94-091ed2f58297 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:11.829750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-90c23757-6a0d-451a-bb94-091ed2f58297 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: fcb9a7a5-d263-4304-bb5a-d94b5414c2c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:11.856488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90c23757-6a0d-451a-bb94-091ed2f58297 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:11.857042 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90c23757-6a0d-451a-bb94-091ed2f58297 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:11.857595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90c23757-6a0d-451a-bb94-091ed2f58297 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:11.858291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90c23757-6a0d-451a-bb94-091ed2f58297 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:11.867391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90c23757-6a0d-451a-bb94-091ed2f58297 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:11.867952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90c23757-6a0d-451a-bb94-091ed2f58297 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:12.808256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-90c23757-6a0d-451a-bb94-091ed2f58297 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:12.829956 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-90c23757-6a0d-451a-bb94-091ed2f58297 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4" status: 200 len: 1323 microversion: 2.1 time: 1.019946 Aug 24 10:34:12.830523 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2316/4283] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:11 2022] GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 => generated 1323 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:12.849454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8ece42a7-3799-44fd-be2f-a02d79380e99 req-fcf7cf86-0dff-418c-ac9e-81c65e4895d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcb9a7a5-d263-4304-bb5a-d94b5414c2c4", "tag": "099de0eb-77d4-4c7f-97de-c70bed7f573b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:12.882606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8ece42a7-3799-44fd-be2f-a02d79380e99 req-fcf7cf86-0dff-418c-ac9e-81c65e4895d2 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:12.883264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8ece42a7-3799-44fd-be2f-a02d79380e99 req-fcf7cf86-0dff-418c-ac9e-81c65e4895d2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:12.884111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8ece42a7-3799-44fd-be2f-a02d79380e99 req-fcf7cf86-0dff-418c-ac9e-81c65e4895d2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:12.907805 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8ece42a7-3799-44fd-be2f-a02d79380e99 req-fcf7cf86-0dff-418c-ac9e-81c65e4895d2 service nova] Creating event network-changed:099de0eb-77d4-4c7f-97de-c70bed7f573b for instance fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 on n-h1-849328-3 Aug 24 10:34:12.920988 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8ece42a7-3799-44fd-be2f-a02d79380e99 req-fcf7cf86-0dff-418c-ac9e-81c65e4895d2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084920 Aug 24 10:34:12.924019 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2317/4284] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:34:12.936789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-51099d02-e5c3-4804-8515-3eae57797fed tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:12.940233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-51099d02-e5c3-4804-8515-3eae57797fed tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:12.956711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51099d02-e5c3-4804-8515-3eae57797fed tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:12.961905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51099d02-e5c3-4804-8515-3eae57797fed tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:12.962635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51099d02-e5c3-4804-8515-3eae57797fed tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:12.963807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51099d02-e5c3-4804-8515-3eae57797fed tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:12.964422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51099d02-e5c3-4804-8515-3eae57797fed tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:12.965008 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51099d02-e5c3-4804-8515-3eae57797fed tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:13.015228 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-5ecb793b-3eaa-4bb7-8104-921f5ac07b66 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:34:13.016376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-5ecb793b-3eaa-4bb7-8104-921f5ac07b66 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:34:13.017007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-5ecb793b-3eaa-4bb7-8104-921f5ac07b66 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:34:13.017586 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-5ecb793b-3eaa-4bb7-8104-921f5ac07b66 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:34:13.018143 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-5ecb793b-3eaa-4bb7-8104-921f5ac07b66 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:34:13.041412 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ecb793b-3eaa-4bb7-8104-921f5ac07b66 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:13.042966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ecb793b-3eaa-4bb7-8104-921f5ac07b66 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:13.045882 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ecb793b-3eaa-4bb7-8104-921f5ac07b66 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:13.048576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ecb793b-3eaa-4bb7-8104-921f5ac07b66 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:13.051033 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ecb793b-3eaa-4bb7-8104-921f5ac07b66 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:13.051806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ecb793b-3eaa-4bb7-8104-921f5ac07b66 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:13.108258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-5ecb793b-3eaa-4bb7-8104-921f5ac07b66 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Getting quotas for project 5fca3a4feff2429b8b8b04a3d2a4175d. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:34:13.129812 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-5ecb793b-3eaa-4bb7-8104-921f5ac07b66 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Getting quotas for user 4efbd482dde84ddb85ea4be9814dd5e2 and project 5fca3a4feff2429b8b8b04a3d2a4175d. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:34:13.173409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5ecb793b-3eaa-4bb7-8104-921f5ac07b66 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:34:13.176151 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5ecb793b-3eaa-4bb7-8104-921f5ac07b66 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] [instance: 253f9d94-6076-4696-8388-cc5be65d66ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:34:13.332000 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5ecb793b-3eaa-4bb7-8104-921f5ac07b66 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.862635 Aug 24 10:34:13.350407 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1968/4285] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:34:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:34:13.368262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ca862cda-e324-409a-b098-442fd81d875b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:13.369901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ca862cda-e324-409a-b098-442fd81d875b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:13.399957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca862cda-e324-409a-b098-442fd81d875b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:13.400748 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca862cda-e324-409a-b098-442fd81d875b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:13.401663 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca862cda-e324-409a-b098-442fd81d875b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:13.403743 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca862cda-e324-409a-b098-442fd81d875b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:13.407149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca862cda-e324-409a-b098-442fd81d875b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:13.408041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca862cda-e324-409a-b098-442fd81d875b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:13.746350 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-51099d02-e5c3-4804-8515-3eae57797fed tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:13.758696 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-51099d02-e5c3-4804-8515-3eae57797fed tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1724 microversion: 2.1 time: 0.833159 Aug 24 10:34:13.761516 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2318/4286] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:12 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1724 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:13.778457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c535600e-a95f-4539-995c-c276f25eac4e req-74700a92-0050-4454-9091-8de9b2f5eee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b46db21c-fd73-4f03-958c-da10e32c008c", "tag": "229867ff-e48d-41b2-bbd8-410d730f178d"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:13.809757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c535600e-a95f-4539-995c-c276f25eac4e req-74700a92-0050-4454-9091-8de9b2f5eee9 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:13.812688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c535600e-a95f-4539-995c-c276f25eac4e req-74700a92-0050-4454-9091-8de9b2f5eee9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:13.813406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c535600e-a95f-4539-995c-c276f25eac4e req-74700a92-0050-4454-9091-8de9b2f5eee9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:13.849844 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c535600e-a95f-4539-995c-c276f25eac4e req-74700a92-0050-4454-9091-8de9b2f5eee9 service nova] Creating event network-changed:229867ff-e48d-41b2-bbd8-410d730f178d for instance b46db21c-fd73-4f03-958c-da10e32c008c on n-h2-849328-3 Aug 24 10:34:13.863884 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c535600e-a95f-4539-995c-c276f25eac4e req-74700a92-0050-4454-9091-8de9b2f5eee9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097256 Aug 24 10:34:13.865114 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2319/4287] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:34:13.877431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3eeaeb3e-30f4-4bc1-baf2-8887c72118a5 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:13.879920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3eeaeb3e-30f4-4bc1-baf2-8887c72118a5 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] [instance: 253f9d94-6076-4696-8388-cc5be65d66ea] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:14.155463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3eeaeb3e-30f4-4bc1-baf2-8887c72118a5 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbd482dde84ddb85ea4be9814dd5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca3a4feff2429b8b8b04a3d2a4175d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:14.169257 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3eeaeb3e-30f4-4bc1-baf2-8887c72118a5 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] 10.222.0.85 "GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea" status: 200 len: 1214 microversion: 2.1 time: 0.298254 Aug 24 10:34:14.178018 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2320/4288] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:13 2022] GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea => generated 1214 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:14.214904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8899a8e0-01cc-4eb9-9540-34b1f8436ada tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "99b59b6d-6b95-43ac-bf11-eb0320dec731"}], "security_groups": [{"name": "tempest-securitygroup--1444453194"}], "key_name": "tempest-keypair-1828607821", "user_data": "}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:14.384296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ca862cda-e324-409a-b098-442fd81d875b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:14.399931 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ca862cda-e324-409a-b098-442fd81d875b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1453 microversion: 2.1 time: 1.048011 Aug 24 10:34:14.400574 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1969/4289] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:13 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1453 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:14.411678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-053b33d2-11b8-4491-82e0-9f4ed8f35684 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:14.412583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-053b33d2-11b8-4491-82e0-9f4ed8f35684 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: fcb9a7a5-d263-4304-bb5a-d94b5414c2c4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:14.448863 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-053b33d2-11b8-4491-82e0-9f4ed8f35684 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:14.449407 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-053b33d2-11b8-4491-82e0-9f4ed8f35684 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:14.450150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-053b33d2-11b8-4491-82e0-9f4ed8f35684 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:14.456918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-053b33d2-11b8-4491-82e0-9f4ed8f35684 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:14.458030 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-053b33d2-11b8-4491-82e0-9f4ed8f35684 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:14.460263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-053b33d2-11b8-4491-82e0-9f4ed8f35684 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:14.667937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-8899a8e0-01cc-4eb9-9540-34b1f8436ada tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] validate_networks() for [('99b59b6d-6b95-43ac-bf11-eb0320dec731', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:34:14.752831 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-053b33d2-11b8-4491-82e0-9f4ed8f35684 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:14.769627 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-053b33d2-11b8-4491-82e0-9f4ed8f35684 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4" status: 200 len: 1323 microversion: 2.1 time: 0.361366 Aug 24 10:34:14.788167 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1970/4290] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:14 2022] GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 => generated 1323 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:14.802656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ca430c43-8217-43da-af62-42f1a0cee1bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:14.805421 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ca430c43-8217-43da-af62-42f1a0cee1bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:14.823759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca430c43-8217-43da-af62-42f1a0cee1bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:14.824446 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca430c43-8217-43da-af62-42f1a0cee1bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:14.825265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca430c43-8217-43da-af62-42f1a0cee1bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:14.826388 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca430c43-8217-43da-af62-42f1a0cee1bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:14.827010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca430c43-8217-43da-af62-42f1a0cee1bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:14.827635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca430c43-8217-43da-af62-42f1a0cee1bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:15.140255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ca430c43-8217-43da-af62-42f1a0cee1bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:15.152874 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ca430c43-8217-43da-af62-42f1a0cee1bb tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1453 microversion: 2.1 time: 0.362229 Aug 24 10:34:15.154136 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1971/4291] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:14 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1453 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:15.159992 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b37359ab-eebd-436e-a1e4-a6f240a0269a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:15.160982 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b37359ab-eebd-436e-a1e4-a6f240a0269a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:15.195747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b37359ab-eebd-436e-a1e4-a6f240a0269a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:15.197792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b37359ab-eebd-436e-a1e4-a6f240a0269a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:15.200957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b37359ab-eebd-436e-a1e4-a6f240a0269a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:15.203581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b37359ab-eebd-436e-a1e4-a6f240a0269a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:15.205474 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b37359ab-eebd-436e-a1e4-a6f240a0269a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:15.206338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b37359ab-eebd-436e-a1e4-a6f240a0269a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:15.537087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b37359ab-eebd-436e-a1e4-a6f240a0269a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:15.553112 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b37359ab-eebd-436e-a1e4-a6f240a0269a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1724 microversion: 2.1 time: 0.397512 Aug 24 10:34:15.554153 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1972/4292] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:15 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1724 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:15.582570 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e768ba48-ce82-4d3d-bf05-695696d2af4f tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:15.586130 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e768ba48-ce82-4d3d-bf05-695696d2af4f tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] [instance: 253f9d94-6076-4696-8388-cc5be65d66ea] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:15.599175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e768ba48-ce82-4d3d-bf05-695696d2af4f tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:15.600022 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e768ba48-ce82-4d3d-bf05-695696d2af4f tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:15.600818 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e768ba48-ce82-4d3d-bf05-695696d2af4f tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:15.603735 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e768ba48-ce82-4d3d-bf05-695696d2af4f tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:15.603735 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e768ba48-ce82-4d3d-bf05-695696d2af4f tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:15.604165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e768ba48-ce82-4d3d-bf05-695696d2af4f tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:15.840802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e768ba48-ce82-4d3d-bf05-695696d2af4f tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbd482dde84ddb85ea4be9814dd5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca3a4feff2429b8b8b04a3d2a4175d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:15.879755 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e768ba48-ce82-4d3d-bf05-695696d2af4f tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] 10.222.0.85 "GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea" status: 200 len: 1218 microversion: 2.1 time: 0.299256 Aug 24 10:34:15.883314 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1973/4293] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:15 2022] GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea => generated 1218 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:15.907910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fd69372f-9208-49df-a05d-4261701fd3e3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:15.908476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fd69372f-9208-49df-a05d-4261701fd3e3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:15.927489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd69372f-9208-49df-a05d-4261701fd3e3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:15.933700 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd69372f-9208-49df-a05d-4261701fd3e3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:15.934536 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd69372f-9208-49df-a05d-4261701fd3e3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:15.935496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd69372f-9208-49df-a05d-4261701fd3e3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:15.936268 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd69372f-9208-49df-a05d-4261701fd3e3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:15.937059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd69372f-9208-49df-a05d-4261701fd3e3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:16.041068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-fd69372f-9208-49df-a05d-4261701fd3e3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lazy-loading 'flavor' on Instance uuid 8fb1d6b5-a27c-465a-aa10-652d2cc366ae {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:34:16.072105 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-fd69372f-9208-49df-a05d-4261701fd3e3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Cannot 'shelve' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state shelved_offloaded Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fd69372f-9208-49df-a05d-4261701fd3e3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action HTTP/1.1 Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 14 Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: {"shelve": {}} Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: exception: Cannot 'shelve' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state shelved_offloaded Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '8fb1d6b5-a27c-465a-aa10-652d2cc366ae', 'body': {'shelve': {}}} Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 10:34:16.078316 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 10:34:16.082923 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 10:34:16.082923 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state shelved_offloaded Aug 24 10:34:16.082923 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:16.082923 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:34:16.082923 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:16.082923 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:16.082923 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:34:16.082923 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:34:16.082923 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:34:16.082923 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:34:16.082923 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state shelved_offloaded Aug 24 10:34:16.082923 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:16.084778 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fd69372f-9208-49df-a05d-4261701fd3e3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 409 to user: Cannot 'shelve' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state shelved_offloaded {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:34:16.088076 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fd69372f-9208-49df-a05d-4261701fd3e3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action" status: 409 len: 155 microversion: 2.1 time: 0.203544 Aug 24 10:34:16.091390 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1974/4294] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:34:15 2022] POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action => generated 155 bytes in 207 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:34:16.105318 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5872785c-3979-4921-9a50-492648582d72 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:16.107073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5872785c-3979-4921-9a50-492648582d72 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: fcb9a7a5-d263-4304-bb5a-d94b5414c2c4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:16.124566 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5872785c-3979-4921-9a50-492648582d72 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:16.125633 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5872785c-3979-4921-9a50-492648582d72 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:16.128295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5872785c-3979-4921-9a50-492648582d72 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:16.129919 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5872785c-3979-4921-9a50-492648582d72 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:16.131664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5872785c-3979-4921-9a50-492648582d72 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:16.133082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5872785c-3979-4921-9a50-492648582d72 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:16.178535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:16.820854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5872785c-3979-4921-9a50-492648582d72 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:16.830845 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5872785c-3979-4921-9a50-492648582d72 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4" status: 200 len: 1323 microversion: 2.1 time: 0.738077 Aug 24 10:34:16.834884 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1975/4295] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:16 2022] GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 => generated 1323 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:16.846182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-214a478d-f116-4992-8062-356f82a03320 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:16.855719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-214a478d-f116-4992-8062-356f82a03320 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:16.875371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-214a478d-f116-4992-8062-356f82a03320 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:16.886282 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-214a478d-f116-4992-8062-356f82a03320 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:16.887532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-214a478d-f116-4992-8062-356f82a03320 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:16.889048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-214a478d-f116-4992-8062-356f82a03320 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:16.890233 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-214a478d-f116-4992-8062-356f82a03320 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:16.891374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-214a478d-f116-4992-8062-356f82a03320 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:16.999039 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-214a478d-f116-4992-8062-356f82a03320 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122432) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 10:34:17.195155 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-214a478d-f116-4992-8062-356f82a03320 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action" status: 202 len: 0 microversion: 2.1 time: 0.355647 Aug 24 10:34:17.203381 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1976/4296] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:34:16 2022] POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:34:17.227913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5716bce3-f7e3-4cc4-be20-d2fd3da64f30 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:17.235374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5716bce3-f7e3-4cc4-be20-d2fd3da64f30 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:17.264127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5716bce3-f7e3-4cc4-be20-d2fd3da64f30 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:17.278317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5716bce3-f7e3-4cc4-be20-d2fd3da64f30 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:17.280557 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5716bce3-f7e3-4cc4-be20-d2fd3da64f30 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:17.282732 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5716bce3-f7e3-4cc4-be20-d2fd3da64f30 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:17.283464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5716bce3-f7e3-4cc4-be20-d2fd3da64f30 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:17.286170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5716bce3-f7e3-4cc4-be20-d2fd3da64f30 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:18.106837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5716bce3-f7e3-4cc4-be20-d2fd3da64f30 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:18.125811 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5716bce3-f7e3-4cc4-be20-d2fd3da64f30 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1730 microversion: 2.1 time: 0.917926 Aug 24 10:34:18.144088 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1977/4297] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:17 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1730 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:18.156956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8739d34d-d63b-4e87-9f88-9af6351b2abd tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:18.166105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8739d34d-d63b-4e87-9f88-9af6351b2abd tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] [instance: 253f9d94-6076-4696-8388-cc5be65d66ea] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:18.200678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8739d34d-d63b-4e87-9f88-9af6351b2abd tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:18.244796 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8739d34d-d63b-4e87-9f88-9af6351b2abd tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:18.252216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8739d34d-d63b-4e87-9f88-9af6351b2abd tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.044s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:18.260451 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8739d34d-d63b-4e87-9f88-9af6351b2abd tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:18.263417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8739d34d-d63b-4e87-9f88-9af6351b2abd tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:18.278078 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8739d34d-d63b-4e87-9f88-9af6351b2abd tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:18.718870 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8739d34d-d63b-4e87-9f88-9af6351b2abd tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbd482dde84ddb85ea4be9814dd5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca3a4feff2429b8b8b04a3d2a4175d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:18.750424 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8739d34d-d63b-4e87-9f88-9af6351b2abd tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] 10.222.0.85 "GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea" status: 200 len: 1266 microversion: 2.1 time: 0.604560 Aug 24 10:34:18.767935 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1978/4298] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:18 2022] GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea => generated 1266 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:18.789702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e0e5bf05-1ea2-4f68-8e6b-8089b3b25f8a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:18.791160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e0e5bf05-1ea2-4f68-8e6b-8089b3b25f8a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:18.803391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0e5bf05-1ea2-4f68-8e6b-8089b3b25f8a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:18.804740 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0e5bf05-1ea2-4f68-8e6b-8089b3b25f8a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:18.805829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0e5bf05-1ea2-4f68-8e6b-8089b3b25f8a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:18.807578 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0e5bf05-1ea2-4f68-8e6b-8089b3b25f8a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:18.808726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0e5bf05-1ea2-4f68-8e6b-8089b3b25f8a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:18.809966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0e5bf05-1ea2-4f68-8e6b-8089b3b25f8a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:19.003069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8899a8e0-01cc-4eb9-9540-34b1f8436ada tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:34:19.003491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8899a8e0-01cc-4eb9-9540-34b1f8436ada tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:34:19.003984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8899a8e0-01cc-4eb9-9540-34b1f8436ada tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:34:19.004393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8899a8e0-01cc-4eb9-9540-34b1f8436ada tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:34:19.004826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8899a8e0-01cc-4eb9-9540-34b1f8436ada tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:34:19.026719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8899a8e0-01cc-4eb9-9540-34b1f8436ada tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:19.029770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8899a8e0-01cc-4eb9-9540-34b1f8436ada tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:19.032270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8899a8e0-01cc-4eb9-9540-34b1f8436ada tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:19.035314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8899a8e0-01cc-4eb9-9540-34b1f8436ada tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:19.036309 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8899a8e0-01cc-4eb9-9540-34b1f8436ada tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:19.037328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8899a8e0-01cc-4eb9-9540-34b1f8436ada tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:19.071885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-8899a8e0-01cc-4eb9-9540-34b1f8436ada tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Getting quotas for project 6bf76463a8af45aaa6aa2c630bdcbb54. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:34:19.085209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-8899a8e0-01cc-4eb9-9540-34b1f8436ada tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Getting quotas for user dbe66c7282c84f0fa2011575403c42d7 and project 6bf76463a8af45aaa6aa2c630bdcbb54. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:34:19.100423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8899a8e0-01cc-4eb9-9540-34b1f8436ada tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:34:19.109445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8899a8e0-01cc-4eb9-9540-34b1f8436ada tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] [instance: b0df3e3d-8b13-4314-9c1c-c99e81a23032] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:34:19.205194 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8899a8e0-01cc-4eb9-9540-34b1f8436ada tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 5.024544 Aug 24 10:34:19.216335 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2321/4299] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:34:14 2022] POST /compute/v2.1/servers => generated 409 bytes in 5032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:34:19.231355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-d4c29ee6-71af-441f-8d8e-84dd05abe190 req-27ca581a-a058-4f38-b687-77ad055ad436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6", "name": "network-vif-plugged", "status": "completed", "tag": "44c6fb77-e32f-470d-a31c-53dc0213be69"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:19.256388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d4c29ee6-71af-441f-8d8e-84dd05abe190 req-27ca581a-a058-4f38-b687-77ad055ad436 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:19.256905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d4c29ee6-71af-441f-8d8e-84dd05abe190 req-27ca581a-a058-4f38-b687-77ad055ad436 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:19.257375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d4c29ee6-71af-441f-8d8e-84dd05abe190 req-27ca581a-a058-4f38-b687-77ad055ad436 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:19.286493 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-d4c29ee6-71af-441f-8d8e-84dd05abe190 req-27ca581a-a058-4f38-b687-77ad055ad436 service nova] Creating event network-vif-plugged:44c6fb77-e32f-470d-a31c-53dc0213be69 for instance 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 on n-h1-849328-3 Aug 24 10:34:19.300486 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-d4c29ee6-71af-441f-8d8e-84dd05abe190 req-27ca581a-a058-4f38-b687-77ad055ad436 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086033 Aug 24 10:34:19.302746 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2322/4300] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:34:19.317447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-57ce1603-2857-47c0-abec-ad49db2a4fb3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:19.319192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-57ce1603-2857-47c0-abec-ad49db2a4fb3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: fcb9a7a5-d263-4304-bb5a-d94b5414c2c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:19.342616 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57ce1603-2857-47c0-abec-ad49db2a4fb3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:19.345427 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57ce1603-2857-47c0-abec-ad49db2a4fb3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:19.345949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57ce1603-2857-47c0-abec-ad49db2a4fb3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:19.346841 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57ce1603-2857-47c0-abec-ad49db2a4fb3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:19.347311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57ce1603-2857-47c0-abec-ad49db2a4fb3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:19.350116 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57ce1603-2857-47c0-abec-ad49db2a4fb3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:19.391273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:19.559898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e0e5bf05-1ea2-4f68-8e6b-8089b3b25f8a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:19.574302 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e0e5bf05-1ea2-4f68-8e6b-8089b3b25f8a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1461 microversion: 2.1 time: 0.796441 Aug 24 10:34:19.580022 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1979/4301] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:18 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1461 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:19.591629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-71f79471-c8a8-430b-a113-0d17750596fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:19.601568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-71f79471-c8a8-430b-a113-0d17750596fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:19.624455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:19.630403 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71f79471-c8a8-430b-a113-0d17750596fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:19.630810 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71f79471-c8a8-430b-a113-0d17750596fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:19.639212 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71f79471-c8a8-430b-a113-0d17750596fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:19.642076 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71f79471-c8a8-430b-a113-0d17750596fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:19.649530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71f79471-c8a8-430b-a113-0d17750596fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:19.650041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71f79471-c8a8-430b-a113-0d17750596fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:20.018812 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-71f79471-c8a8-430b-a113-0d17750596fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.434607 Aug 24 10:34:20.022077 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1980/4302] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Aug 24 10:34:19 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-interface => generated 285 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:34:20.033501 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d9d2b68e-a456-4bb4-b502-4fcfb23a44b9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:20.034620 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d9d2b68e-a456-4bb4-b502-4fcfb23a44b9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] [instance: b0df3e3d-8b13-4314-9c1c-c99e81a23032] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:20.275714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d9d2b68e-a456-4bb4-b502-4fcfb23a44b9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe66c7282c84f0fa2011575403c42d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf76463a8af45aaa6aa2c630bdcbb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:20.290415 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d9d2b68e-a456-4bb4-b502-4fcfb23a44b9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] 10.222.0.85 "GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032" status: 200 len: 1226 microversion: 2.1 time: 0.263922 Aug 24 10:34:20.291666 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1981/4303] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:20 2022] GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032 => generated 1226 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:20.304855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-86317b71-bc96-448e-955e-588328f048de tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:20.307021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-86317b71-bc96-448e-955e-588328f048de tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] [instance: 253f9d94-6076-4696-8388-cc5be65d66ea] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:20.326137 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86317b71-bc96-448e-955e-588328f048de tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:20.326692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86317b71-bc96-448e-955e-588328f048de tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:20.328432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86317b71-bc96-448e-955e-588328f048de tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:20.330424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86317b71-bc96-448e-955e-588328f048de tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:20.331966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86317b71-bc96-448e-955e-588328f048de tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:20.333418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86317b71-bc96-448e-955e-588328f048de tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:20.560717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-86317b71-bc96-448e-955e-588328f048de tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbd482dde84ddb85ea4be9814dd5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca3a4feff2429b8b8b04a3d2a4175d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:20.603204 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-86317b71-bc96-448e-955e-588328f048de tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] 10.222.0.85 "GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea" status: 200 len: 1272 microversion: 2.1 time: 0.295905 Aug 24 10:34:20.606125 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1982/4304] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:20 2022] GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea => generated 1272 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:20.618867 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cfbb53eb-3332-4846-a269-4a73f8a80284 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:20.619768 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cfbb53eb-3332-4846-a269-4a73f8a80284 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:20.645014 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cfbb53eb-3332-4846-a269-4a73f8a80284 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:20.646748 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cfbb53eb-3332-4846-a269-4a73f8a80284 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:20.651212 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cfbb53eb-3332-4846-a269-4a73f8a80284 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:20.652486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cfbb53eb-3332-4846-a269-4a73f8a80284 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:20.655472 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cfbb53eb-3332-4846-a269-4a73f8a80284 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:20.656209 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cfbb53eb-3332-4846-a269-4a73f8a80284 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:21.194206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cfbb53eb-3332-4846-a269-4a73f8a80284 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:21.217875 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cfbb53eb-3332-4846-a269-4a73f8a80284 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1461 microversion: 2.1 time: 0.608180 Aug 24 10:34:21.221313 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1983/4305] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:20 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1461 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:21.320353 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9e424ed4-25cb-46b4-b83b-fb6a0d4df35a tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:21.321224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9e424ed4-25cb-46b4-b83b-fb6a0d4df35a tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] [instance: b0df3e3d-8b13-4314-9c1c-c99e81a23032] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:21.335784 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-57ce1603-2857-47c0-abec-ad49db2a4fb3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:21.338456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e424ed4-25cb-46b4-b83b-fb6a0d4df35a tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:21.339180 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e424ed4-25cb-46b4-b83b-fb6a0d4df35a tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:21.341677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e424ed4-25cb-46b4-b83b-fb6a0d4df35a tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:21.342634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e424ed4-25cb-46b4-b83b-fb6a0d4df35a tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:21.344895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e424ed4-25cb-46b4-b83b-fb6a0d4df35a tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:21.345659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e424ed4-25cb-46b4-b83b-fb6a0d4df35a tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:21.382826 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-57ce1603-2857-47c0-abec-ad49db2a4fb3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4" status: 200 len: 1323 microversion: 2.1 time: 2.070814 Aug 24 10:34:21.385607 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2323/4306] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:19 2022] GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 => generated 1323 bytes in 2082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:21.411286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-84d92ac0-d28e-42d5-b7b4-e9b8a24ac22a req-a1bd23f1-07bd-4473-a97d-8964cc2467b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcb9a7a5-d263-4304-bb5a-d94b5414c2c4", "name": "network-vif-plugged", "status": "completed", "tag": "099de0eb-77d4-4c7f-97de-c70bed7f573b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:21.427719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-84d92ac0-d28e-42d5-b7b4-e9b8a24ac22a req-a1bd23f1-07bd-4473-a97d-8964cc2467b6 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:21.428771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-84d92ac0-d28e-42d5-b7b4-e9b8a24ac22a req-a1bd23f1-07bd-4473-a97d-8964cc2467b6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:21.430121 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-84d92ac0-d28e-42d5-b7b4-e9b8a24ac22a req-a1bd23f1-07bd-4473-a97d-8964cc2467b6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:21.447373 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-84d92ac0-d28e-42d5-b7b4-e9b8a24ac22a req-a1bd23f1-07bd-4473-a97d-8964cc2467b6 service nova] Creating event network-vif-plugged:099de0eb-77d4-4c7f-97de-c70bed7f573b for instance fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 on n-h1-849328-3 Aug 24 10:34:21.455476 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-84d92ac0-d28e-42d5-b7b4-e9b8a24ac22a req-a1bd23f1-07bd-4473-a97d-8964cc2467b6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052049 Aug 24 10:34:21.456813 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2324/4307] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:34:21.563076 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9e424ed4-25cb-46b4-b83b-fb6a0d4df35a tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe66c7282c84f0fa2011575403c42d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf76463a8af45aaa6aa2c630bdcbb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:21.593956 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9e424ed4-25cb-46b4-b83b-fb6a0d4df35a tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] 10.222.0.85 "GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032" status: 200 len: 1278 microversion: 2.1 time: 0.281627 Aug 24 10:34:21.598453 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1984/4308] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:21 2022] GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032 => generated 1278 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:21.627531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bbac6974-7fe4-46ab-b7a9-5faee37300d3 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:21.628296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bbac6974-7fe4-46ab-b7a9-5faee37300d3 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] [instance: 253f9d94-6076-4696-8388-cc5be65d66ea] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:21.640641 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbac6974-7fe4-46ab-b7a9-5faee37300d3 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:21.641334 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbac6974-7fe4-46ab-b7a9-5faee37300d3 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:21.642891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbac6974-7fe4-46ab-b7a9-5faee37300d3 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:21.645466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbac6974-7fe4-46ab-b7a9-5faee37300d3 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:21.646626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbac6974-7fe4-46ab-b7a9-5faee37300d3 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:21.647640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbac6974-7fe4-46ab-b7a9-5faee37300d3 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:21.829435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5bd6089f-e1c7-4e95-801c-2336c45859de tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:21.830241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5bd6089f-e1c7-4e95-801c-2336c45859de tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:21.839316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bd6089f-e1c7-4e95-801c-2336c45859de tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:21.839805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bd6089f-e1c7-4e95-801c-2336c45859de tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:21.875405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bd6089f-e1c7-4e95-801c-2336c45859de tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:21.883478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bd6089f-e1c7-4e95-801c-2336c45859de tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:21.884223 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bd6089f-e1c7-4e95-801c-2336c45859de tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:21.886165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bd6089f-e1c7-4e95-801c-2336c45859de tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:22.208127 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bbac6974-7fe4-46ab-b7a9-5faee37300d3 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbd482dde84ddb85ea4be9814dd5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca3a4feff2429b8b8b04a3d2a4175d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:22.224342 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bbac6974-7fe4-46ab-b7a9-5faee37300d3 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] 10.222.0.85 "GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea" status: 200 len: 1314 microversion: 2.1 time: 0.601296 Aug 24 10:34:22.228887 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2325/4309] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:21 2022] GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea => generated 1314 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:22.244802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-effa5015-ab75-4dcb-bb06-3e867aa5533f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:22.245862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-effa5015-ab75-4dcb-bb06-3e867aa5533f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:22.259266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-effa5015-ab75-4dcb-bb06-3e867aa5533f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:22.260134 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-effa5015-ab75-4dcb-bb06-3e867aa5533f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:22.260740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-effa5015-ab75-4dcb-bb06-3e867aa5533f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:22.262736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-effa5015-ab75-4dcb-bb06-3e867aa5533f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:22.263392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-effa5015-ab75-4dcb-bb06-3e867aa5533f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:22.263976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-effa5015-ab75-4dcb-bb06-3e867aa5533f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:22.764766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-effa5015-ab75-4dcb-bb06-3e867aa5533f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:22.782379 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-effa5015-ab75-4dcb-bb06-3e867aa5533f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1463 microversion: 2.1 time: 0.544453 Aug 24 10:34:22.785625 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2326/4310] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:22 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1463 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:34:22.792713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e262a3f1-d963-464e-81bc-de8e76672bc3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:22.794575 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e262a3f1-d963-464e-81bc-de8e76672bc3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: fcb9a7a5-d263-4304-bb5a-d94b5414c2c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:22.807579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e262a3f1-d963-464e-81bc-de8e76672bc3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:22.809334 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e262a3f1-d963-464e-81bc-de8e76672bc3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:22.810049 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e262a3f1-d963-464e-81bc-de8e76672bc3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:22.812176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e262a3f1-d963-464e-81bc-de8e76672bc3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:22.813342 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e262a3f1-d963-464e-81bc-de8e76672bc3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:22.814007 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e262a3f1-d963-464e-81bc-de8e76672bc3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:22.929433 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5bd6089f-e1c7-4e95-801c-2336c45859de tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:22.944651 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5bd6089f-e1c7-4e95-801c-2336c45859de tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1682 microversion: 2.1 time: 1.119584 Aug 24 10:34:22.946573 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1985/4311] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:21 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1682 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:22.956673 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-68f90f31-cafc-40c0-a0d9-15e863272af3 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:22.957731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-68f90f31-cafc-40c0-a0d9-15e863272af3 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] [instance: b0df3e3d-8b13-4314-9c1c-c99e81a23032] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:22.972869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68f90f31-cafc-40c0-a0d9-15e863272af3 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:22.979674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68f90f31-cafc-40c0-a0d9-15e863272af3 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:22.980524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68f90f31-cafc-40c0-a0d9-15e863272af3 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:22.982750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68f90f31-cafc-40c0-a0d9-15e863272af3 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:22.983604 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68f90f31-cafc-40c0-a0d9-15e863272af3 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:22.984283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68f90f31-cafc-40c0-a0d9-15e863272af3 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:23.080614 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:23.131776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-68f90f31-cafc-40c0-a0d9-15e863272af3 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe66c7282c84f0fa2011575403c42d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf76463a8af45aaa6aa2c630bdcbb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:23.145770 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-68f90f31-cafc-40c0-a0d9-15e863272af3 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] 10.222.0.85 "GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032" status: 200 len: 1284 microversion: 2.1 time: 0.197674 Aug 24 10:34:23.147639 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1986/4312] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:22 2022] GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032 => generated 1284 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:23.249103 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fdf1754c-ca18-44fb-9953-5e73709142c2 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:23.249782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fdf1754c-ca18-44fb-9953-5e73709142c2 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] [instance: 253f9d94-6076-4696-8388-cc5be65d66ea] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:23.259877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdf1754c-ca18-44fb-9953-5e73709142c2 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:23.260375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdf1754c-ca18-44fb-9953-5e73709142c2 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:23.260823 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdf1754c-ca18-44fb-9953-5e73709142c2 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:23.264810 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdf1754c-ca18-44fb-9953-5e73709142c2 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:23.267317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdf1754c-ca18-44fb-9953-5e73709142c2 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:23.268351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdf1754c-ca18-44fb-9953-5e73709142c2 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:23.694947 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e262a3f1-d963-464e-81bc-de8e76672bc3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:23.709708 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e262a3f1-d963-464e-81bc-de8e76672bc3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4" status: 200 len: 1323 microversion: 2.1 time: 0.919919 Aug 24 10:34:23.711495 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2327/4313] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:22 2022] GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 => generated 1323 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:23.718376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-08195d32-ad8e-4b64-b148-79ec33b53f31 req-bafe8797-8e12-44ee-9dd7-7d604b976053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b46db21c-fd73-4f03-958c-da10e32c008c", "name": "network-vif-plugged", "status": "completed", "tag": "229867ff-e48d-41b2-bbd8-410d730f178d"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:23.739190 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-08195d32-ad8e-4b64-b148-79ec33b53f31 req-bafe8797-8e12-44ee-9dd7-7d604b976053 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:23.741213 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-08195d32-ad8e-4b64-b148-79ec33b53f31 req-bafe8797-8e12-44ee-9dd7-7d604b976053 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:23.741662 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-08195d32-ad8e-4b64-b148-79ec33b53f31 req-bafe8797-8e12-44ee-9dd7-7d604b976053 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:23.759992 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-08195d32-ad8e-4b64-b148-79ec33b53f31 req-bafe8797-8e12-44ee-9dd7-7d604b976053 service nova] Creating event network-vif-plugged:229867ff-e48d-41b2-bbd8-410d730f178d for instance b46db21c-fd73-4f03-958c-da10e32c008c on n-h2-849328-3 Aug 24 10:34:23.766410 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-08195d32-ad8e-4b64-b148-79ec33b53f31 req-bafe8797-8e12-44ee-9dd7-7d604b976053 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052774 Aug 24 10:34:23.768339 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2328/4314] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:34:23.780227 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fdf1754c-ca18-44fb-9953-5e73709142c2 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbd482dde84ddb85ea4be9814dd5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca3a4feff2429b8b8b04a3d2a4175d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:23.798681 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fdf1754c-ca18-44fb-9953-5e73709142c2 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] 10.222.0.85 "GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea" status: 200 len: 1314 microversion: 2.1 time: 0.554780 Aug 24 10:34:23.804747 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1987/4315] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:23 2022] GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea => generated 1314 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:23.815308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7a0ea00a-4c4a-4065-b6a8-69863aca951f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:23.816698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7a0ea00a-4c4a-4065-b6a8-69863aca951f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:23.828266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a0ea00a-4c4a-4065-b6a8-69863aca951f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:23.830108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a0ea00a-4c4a-4065-b6a8-69863aca951f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:23.831610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a0ea00a-4c4a-4065-b6a8-69863aca951f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:23.832510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a0ea00a-4c4a-4065-b6a8-69863aca951f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:23.833193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a0ea00a-4c4a-4065-b6a8-69863aca951f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:23.834255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a0ea00a-4c4a-4065-b6a8-69863aca951f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:23.966836 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0e67c3bd-eb45-4d01-a9c4-721592e399f4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:23.968069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0e67c3bd-eb45-4d01-a9c4-721592e399f4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:23.976097 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e67c3bd-eb45-4d01-a9c4-721592e399f4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:23.977031 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e67c3bd-eb45-4d01-a9c4-721592e399f4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:23.978032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e67c3bd-eb45-4d01-a9c4-721592e399f4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:23.978923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e67c3bd-eb45-4d01-a9c4-721592e399f4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:23.979543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e67c3bd-eb45-4d01-a9c4-721592e399f4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:23.980155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e67c3bd-eb45-4d01-a9c4-721592e399f4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:24.285825 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7a0ea00a-4c4a-4065-b6a8-69863aca951f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:24.302484 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7a0ea00a-4c4a-4065-b6a8-69863aca951f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1519 microversion: 2.1 time: 0.494456 Aug 24 10:34:24.314014 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2329/4316] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:23 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1519 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:24.324931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1ef57998-6368-4e1a-acdc-1a5f44363a9c tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:24.325955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1ef57998-6368-4e1a-acdc-1a5f44363a9c tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] [instance: b0df3e3d-8b13-4314-9c1c-c99e81a23032] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:24.343963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ef57998-6368-4e1a-acdc-1a5f44363a9c tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:24.345924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ef57998-6368-4e1a-acdc-1a5f44363a9c tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:24.347474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ef57998-6368-4e1a-acdc-1a5f44363a9c tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:24.352120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ef57998-6368-4e1a-acdc-1a5f44363a9c tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:24.352846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ef57998-6368-4e1a-acdc-1a5f44363a9c tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:24.353492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ef57998-6368-4e1a-acdc-1a5f44363a9c tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:24.514138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1ef57998-6368-4e1a-acdc-1a5f44363a9c tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe66c7282c84f0fa2011575403c42d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf76463a8af45aaa6aa2c630bdcbb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:24.529574 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1ef57998-6368-4e1a-acdc-1a5f44363a9c tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] 10.222.0.85 "GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032" status: 200 len: 1284 microversion: 2.1 time: 0.213038 Aug 24 10:34:24.530792 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2330/4317] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:24 2022] GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032 => generated 1284 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:24.539532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-17c39491-81a2-4d31-9d32-359b3cfd2f81 req-7c578f5f-f611-40ad-9e8d-54550891bf58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "253f9d94-6076-4696-8388-cc5be65d66ea", "tag": "f52c83d9-2823-4363-b62d-d3f492dc65a1"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:24.581978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-17c39491-81a2-4d31-9d32-359b3cfd2f81 req-7c578f5f-f611-40ad-9e8d-54550891bf58 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:24.582825 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-17c39491-81a2-4d31-9d32-359b3cfd2f81 req-7c578f5f-f611-40ad-9e8d-54550891bf58 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:24.583280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-17c39491-81a2-4d31-9d32-359b3cfd2f81 req-7c578f5f-f611-40ad-9e8d-54550891bf58 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:24.614749 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-17c39491-81a2-4d31-9d32-359b3cfd2f81 req-7c578f5f-f611-40ad-9e8d-54550891bf58 service nova] Creating event network-changed:f52c83d9-2823-4363-b62d-d3f492dc65a1 for instance 253f9d94-6076-4696-8388-cc5be65d66ea on n-h2-849328-3 Aug 24 10:34:24.620075 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-17c39491-81a2-4d31-9d32-359b3cfd2f81 req-7c578f5f-f611-40ad-9e8d-54550891bf58 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087924 Aug 24 10:34:24.620818 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2331/4318] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:34:24.626484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-ecf30295-6992-41d9-b276-5bb92e39dff2 req-ff88d76a-51f9-4f71-ac0f-9d95bf5341d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09f120f6-861a-4946-981b-47559a9c97fa", "tag": "29330474-2cf1-47be-ab26-0c24270c9a09"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:24.649780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ecf30295-6992-41d9-b276-5bb92e39dff2 req-ff88d76a-51f9-4f71-ac0f-9d95bf5341d8 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:24.653015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ecf30295-6992-41d9-b276-5bb92e39dff2 req-ff88d76a-51f9-4f71-ac0f-9d95bf5341d8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:24.653776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ecf30295-6992-41d9-b276-5bb92e39dff2 req-ff88d76a-51f9-4f71-ac0f-9d95bf5341d8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:24.684523 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-ecf30295-6992-41d9-b276-5bb92e39dff2 req-ff88d76a-51f9-4f71-ac0f-9d95bf5341d8 service nova] Creating event network-changed:29330474-2cf1-47be-ab26-0c24270c9a09 for instance 09f120f6-861a-4946-981b-47559a9c97fa on n-h2-849328-3 Aug 24 10:34:24.695138 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-ecf30295-6992-41d9-b276-5bb92e39dff2 req-ff88d76a-51f9-4f71-ac0f-9d95bf5341d8 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072585 Aug 24 10:34:24.696428 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2332/4319] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:34:24.732619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c351e726-db66-45de-963b-f27329e2765c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:24.733940 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c351e726-db66-45de-963b-f27329e2765c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: fcb9a7a5-d263-4304-bb5a-d94b5414c2c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:24.755798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c351e726-db66-45de-963b-f27329e2765c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:24.760211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c351e726-db66-45de-963b-f27329e2765c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:24.761078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c351e726-db66-45de-963b-f27329e2765c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:24.762225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c351e726-db66-45de-963b-f27329e2765c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:24.763324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c351e726-db66-45de-963b-f27329e2765c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:24.766044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c351e726-db66-45de-963b-f27329e2765c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:24.988781 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0e67c3bd-eb45-4d01-a9c4-721592e399f4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:25.017606 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0e67c3bd-eb45-4d01-a9c4-721592e399f4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 1.053708 Aug 24 10:34:25.021519 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1988/4320] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:23 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:34:25.063701 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f7765701-f6d7-4696-a16b-f31c2bd125b4 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:25.066572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f7765701-f6d7-4696-a16b-f31c2bd125b4 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] [instance: 253f9d94-6076-4696-8388-cc5be65d66ea] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:25.089968 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f7765701-f6d7-4696-a16b-f31c2bd125b4 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:25.093162 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f7765701-f6d7-4696-a16b-f31c2bd125b4 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:25.103473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f7765701-f6d7-4696-a16b-f31c2bd125b4 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:25.113040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f7765701-f6d7-4696-a16b-f31c2bd125b4 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:25.114292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f7765701-f6d7-4696-a16b-f31c2bd125b4 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:25.115476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f7765701-f6d7-4696-a16b-f31c2bd125b4 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:25.490846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c351e726-db66-45de-963b-f27329e2765c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:25.518928 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c351e726-db66-45de-963b-f27329e2765c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4" status: 200 len: 1515 microversion: 2.1 time: 0.791153 Aug 24 10:34:25.519873 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2333/4321] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:24 2022] GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 => generated 1515 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:34:25.539210 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e6aafe08-30fd-4edc-b377-000d62196087 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1535789587"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:25.543582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e6aafe08-30fd-4edc-b377-000d62196087 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:25.565736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6aafe08-30fd-4edc-b377-000d62196087 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:25.566852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6aafe08-30fd-4edc-b377-000d62196087 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:25.567972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6aafe08-30fd-4edc-b377-000d62196087 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:25.569064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6aafe08-30fd-4edc-b377-000d62196087 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:25.569795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6aafe08-30fd-4edc-b377-000d62196087 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:25.570469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6aafe08-30fd-4edc-b377-000d62196087 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:25.710484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f7765701-f6d7-4696-a16b-f31c2bd125b4 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbd482dde84ddb85ea4be9814dd5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca3a4feff2429b8b8b04a3d2a4175d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:25.725843 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f7765701-f6d7-4696-a16b-f31c2bd125b4 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] 10.222.0.85 "GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea" status: 200 len: 1314 microversion: 2.1 time: 0.696815 Aug 24 10:34:25.739864 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1989/4322] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:25 2022] GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea => generated 1314 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:25.751476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d18efcba-d394-4fb0-981e-0f84028bdee1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:25.756259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d18efcba-d394-4fb0-981e-0f84028bdee1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:25.779278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d18efcba-d394-4fb0-981e-0f84028bdee1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:25.779910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d18efcba-d394-4fb0-981e-0f84028bdee1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:25.780464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d18efcba-d394-4fb0-981e-0f84028bdee1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:25.785784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d18efcba-d394-4fb0-981e-0f84028bdee1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:25.786990 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d18efcba-d394-4fb0-981e-0f84028bdee1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:25.788307 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d18efcba-d394-4fb0-981e-0f84028bdee1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:26.061412 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e6aafe08-30fd-4edc-b377-000d62196087 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action" status: 202 len: 0 microversion: 2.1 time: 0.531554 Aug 24 10:34:26.065523 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2334/4323] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:34:25 2022] POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action => generated 0 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 24 10:34:26.093774 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a6313cdc-97a0-40e8-b692-613b965ed3b6 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:26.094485 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a6313cdc-97a0-40e8-b692-613b965ed3b6 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: b46db21c-fd73-4f03-958c-da10e32c008c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:26.115757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6313cdc-97a0-40e8-b692-613b965ed3b6 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:26.116259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6313cdc-97a0-40e8-b692-613b965ed3b6 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:26.116702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6313cdc-97a0-40e8-b692-613b965ed3b6 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:26.122445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6313cdc-97a0-40e8-b692-613b965ed3b6 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:26.126506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6313cdc-97a0-40e8-b692-613b965ed3b6 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:26.127606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6313cdc-97a0-40e8-b692-613b965ed3b6 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:26.745876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a6313cdc-97a0-40e8-b692-613b965ed3b6 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:26.758495 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a6313cdc-97a0-40e8-b692-613b965ed3b6 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/b46db21c-fd73-4f03-958c-da10e32c008c" status: 200 len: 1516 microversion: 2.1 time: 0.683973 Aug 24 10:34:26.760772 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2335/4324] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:26 2022] GET /compute/v2.1/servers/b46db21c-fd73-4f03-958c-da10e32c008c => generated 1516 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:26.784663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ca91d9d9-3730-4697-a8fc-ba36ff7ba3a9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:26.785318 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ca91d9d9-3730-4697-a8fc-ba36ff7ba3a9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] [instance: b0df3e3d-8b13-4314-9c1c-c99e81a23032] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:26.797455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca91d9d9-3730-4697-a8fc-ba36ff7ba3a9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:26.797959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca91d9d9-3730-4697-a8fc-ba36ff7ba3a9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:26.798391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca91d9d9-3730-4697-a8fc-ba36ff7ba3a9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:26.800505 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca91d9d9-3730-4697-a8fc-ba36ff7ba3a9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:26.801399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca91d9d9-3730-4697-a8fc-ba36ff7ba3a9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:26.803150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca91d9d9-3730-4697-a8fc-ba36ff7ba3a9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:27.215501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ca91d9d9-3730-4697-a8fc-ba36ff7ba3a9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe66c7282c84f0fa2011575403c42d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf76463a8af45aaa6aa2c630bdcbb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:27.232897 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d18efcba-d394-4fb0-981e-0f84028bdee1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:27.240683 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ca91d9d9-3730-4697-a8fc-ba36ff7ba3a9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] 10.222.0.85 "GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032" status: 200 len: 1352 microversion: 2.1 time: 0.474889 Aug 24 10:34:27.242239 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d18efcba-d394-4fb0-981e-0f84028bdee1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1519 microversion: 2.1 time: 1.500885 Aug 24 10:34:27.253154 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2336/4325] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:26 2022] GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032 => generated 1352 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:27.254675 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1990/4326] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:25 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1519 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:27.256835 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-baeef3be-991d-4f7f-93f1-e902c5cb74cb req-ee210556-b858-4449-b8f7-98a6dfc78691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ed6211-b7fc-454f-a8e9-73ba571a71af", "name": "network-vif-unplugged", "status": "completed", "tag": "1c2608cb-c0ff-45d5-b7c5-82ff95cc5b0c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:27.262764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-90085194-78b7-4cda-9467-cf463bd475f2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:27.263406 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-90085194-78b7-4cda-9467-cf463bd475f2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:27.270104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90085194-78b7-4cda-9467-cf463bd475f2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:27.270830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90085194-78b7-4cda-9467-cf463bd475f2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:27.271428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90085194-78b7-4cda-9467-cf463bd475f2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:27.272164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90085194-78b7-4cda-9467-cf463bd475f2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:27.273087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90085194-78b7-4cda-9467-cf463bd475f2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:27.273899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90085194-78b7-4cda-9467-cf463bd475f2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:27.282185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-baeef3be-991d-4f7f-93f1-e902c5cb74cb req-ee210556-b858-4449-b8f7-98a6dfc78691 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:27.282688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-baeef3be-991d-4f7f-93f1-e902c5cb74cb req-ee210556-b858-4449-b8f7-98a6dfc78691 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:27.283131 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-baeef3be-991d-4f7f-93f1-e902c5cb74cb req-ee210556-b858-4449-b8f7-98a6dfc78691 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:27.334486 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-baeef3be-991d-4f7f-93f1-e902c5cb74cb req-ee210556-b858-4449-b8f7-98a6dfc78691 service nova] Creating event network-vif-unplugged:1c2608cb-c0ff-45d5-b7c5-82ff95cc5b0c for instance 99ed6211-b7fc-454f-a8e9-73ba571a71af on n-h1-849328-3 Aug 24 10:34:27.340740 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-baeef3be-991d-4f7f-93f1-e902c5cb74cb req-ee210556-b858-4449-b8f7-98a6dfc78691 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095245 Aug 24 10:34:27.341017 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2337/4327] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:34:27.347937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a7e263f2-add9-442a-a899-834d5d6c93dc req-2d6e2e73-bd94-43d2-9b37-799d8b88dd4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09f120f6-861a-4946-981b-47559a9c97fa", "tag": "29330474-2cf1-47be-ab26-0c24270c9a09"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:27.358548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a7e263f2-add9-442a-a899-834d5d6c93dc req-2d6e2e73-bd94-43d2-9b37-799d8b88dd4a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:27.359116 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a7e263f2-add9-442a-a899-834d5d6c93dc req-2d6e2e73-bd94-43d2-9b37-799d8b88dd4a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:27.359556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a7e263f2-add9-442a-a899-834d5d6c93dc req-2d6e2e73-bd94-43d2-9b37-799d8b88dd4a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:27.388319 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a7e263f2-add9-442a-a899-834d5d6c93dc req-2d6e2e73-bd94-43d2-9b37-799d8b88dd4a service nova] Creating event network-changed:29330474-2cf1-47be-ab26-0c24270c9a09 for instance 09f120f6-861a-4946-981b-47559a9c97fa on n-h2-849328-3 Aug 24 10:34:27.403687 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a7e263f2-add9-442a-a899-834d5d6c93dc req-2d6e2e73-bd94-43d2-9b37-799d8b88dd4a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060325 Aug 24 10:34:27.404082 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2338/4328] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:34:27.410570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4b804876-5d9f-4b62-aed6-ef00d53e4d98 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:27.411471 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4b804876-5d9f-4b62-aed6-ef00d53e4d98 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] [instance: 253f9d94-6076-4696-8388-cc5be65d66ea] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:27.419359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b804876-5d9f-4b62-aed6-ef00d53e4d98 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:27.420163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b804876-5d9f-4b62-aed6-ef00d53e4d98 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:27.420779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b804876-5d9f-4b62-aed6-ef00d53e4d98 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:27.421745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b804876-5d9f-4b62-aed6-ef00d53e4d98 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:27.422378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b804876-5d9f-4b62-aed6-ef00d53e4d98 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:27.423036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b804876-5d9f-4b62-aed6-ef00d53e4d98 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:27.916916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4b804876-5d9f-4b62-aed6-ef00d53e4d98 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbd482dde84ddb85ea4be9814dd5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca3a4feff2429b8b8b04a3d2a4175d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:27.926865 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4b804876-5d9f-4b62-aed6-ef00d53e4d98 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] 10.222.0.85 "GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea" status: 200 len: 1314 microversion: 2.1 time: 0.521329 Aug 24 10:34:27.927458 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2339/4329] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:27 2022] GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:27.947072 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-14025a8e-7e94-49d9-9219-8a37d11b10d0 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:27.947978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-14025a8e-7e94-49d9-9219-8a37d11b10d0 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:27.956866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14025a8e-7e94-49d9-9219-8a37d11b10d0 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:27.960014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14025a8e-7e94-49d9-9219-8a37d11b10d0 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:27.960642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14025a8e-7e94-49d9-9219-8a37d11b10d0 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:27.961769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14025a8e-7e94-49d9-9219-8a37d11b10d0 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:27.966417 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14025a8e-7e94-49d9-9219-8a37d11b10d0 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:27.967063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14025a8e-7e94-49d9-9219-8a37d11b10d0 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:28.346787 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-90085194-78b7-4cda-9467-cf463bd475f2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:28.357868 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-90085194-78b7-4cda-9467-cf463bd475f2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1679 microversion: 2.1 time: 1.101462 Aug 24 10:34:28.373474 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1991/4330] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:27 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1679 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:28.379660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d1493915-1182-47f5-948f-f559cc9f0802 req-d125c96f-aac0-44db-bf23-9d597ecd8b2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fb1d6b5-a27c-465a-aa10-652d2cc366ae", "tag": "05c1a894-3c87-4d83-9b42-234ddedc80b0"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:28.390604 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d1493915-1182-47f5-948f-f559cc9f0802 req-d125c96f-aac0-44db-bf23-9d597ecd8b2b service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:28.391384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d1493915-1182-47f5-948f-f559cc9f0802 req-d125c96f-aac0-44db-bf23-9d597ecd8b2b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:28.392010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d1493915-1182-47f5-948f-f559cc9f0802 req-d125c96f-aac0-44db-bf23-9d597ecd8b2b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:28.405533 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d1493915-1182-47f5-948f-f559cc9f0802 req-d125c96f-aac0-44db-bf23-9d597ecd8b2b service nova] Creating event network-changed:05c1a894-3c87-4d83-9b42-234ddedc80b0 for instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae on n-h1-849328-3 Aug 24 10:34:28.411507 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d1493915-1182-47f5-948f-f559cc9f0802 req-d125c96f-aac0-44db-bf23-9d597ecd8b2b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036311 Aug 24 10:34:28.412756 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1992/4331] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:34:28.420382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8475f3a4-adcc-45e9-b916-4e2d78fcff16 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:28.421796 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8475f3a4-adcc-45e9-b916-4e2d78fcff16 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] [instance: b0df3e3d-8b13-4314-9c1c-c99e81a23032] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:28.431109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8475f3a4-adcc-45e9-b916-4e2d78fcff16 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:28.432288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8475f3a4-adcc-45e9-b916-4e2d78fcff16 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:28.433009 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8475f3a4-adcc-45e9-b916-4e2d78fcff16 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:28.434109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8475f3a4-adcc-45e9-b916-4e2d78fcff16 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:28.434844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8475f3a4-adcc-45e9-b916-4e2d78fcff16 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:28.435534 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8475f3a4-adcc-45e9-b916-4e2d78fcff16 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:28.439339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:28.492720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-14025a8e-7e94-49d9-9219-8a37d11b10d0 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:28.506085 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-14025a8e-7e94-49d9-9219-8a37d11b10d0 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6" status: 200 len: 1515 microversion: 2.1 time: 0.574423 Aug 24 10:34:28.519999 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2340/4332] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:27 2022] GET /compute/v2.1/servers/2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 => generated 1515 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:28.527771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d9b140a1-7fa0-4747-991e-436f14eefc31 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:28.528690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d9b140a1-7fa0-4747-991e-436f14eefc31 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:28.536361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9b140a1-7fa0-4747-991e-436f14eefc31 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:28.537357 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9b140a1-7fa0-4747-991e-436f14eefc31 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:28.538071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9b140a1-7fa0-4747-991e-436f14eefc31 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:28.539153 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9b140a1-7fa0-4747-991e-436f14eefc31 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:28.539790 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9b140a1-7fa0-4747-991e-436f14eefc31 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:28.540425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9b140a1-7fa0-4747-991e-436f14eefc31 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:28.838969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d9b140a1-7fa0-4747-991e-436f14eefc31 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:28.855490 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d9b140a1-7fa0-4747-991e-436f14eefc31 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1519 microversion: 2.1 time: 0.331488 Aug 24 10:34:28.857618 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2341/4333] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:28 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1519 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:28.868239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-75339e55-ac99-4cd0-9050-c18eee37120e tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:28.869610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-75339e55-ac99-4cd0-9050-c18eee37120e tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:28.880693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75339e55-ac99-4cd0-9050-c18eee37120e tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:28.881978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75339e55-ac99-4cd0-9050-c18eee37120e tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:28.883445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75339e55-ac99-4cd0-9050-c18eee37120e tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:28.884958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75339e55-ac99-4cd0-9050-c18eee37120e tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:28.886239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75339e55-ac99-4cd0-9050-c18eee37120e tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:28.887221 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75339e55-ac99-4cd0-9050-c18eee37120e tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:28.948562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-75339e55-ac99-4cd0-9050-c18eee37120e tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:34:28.959748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:29.005303 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8475f3a4-adcc-45e9-b916-4e2d78fcff16 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe66c7282c84f0fa2011575403c42d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf76463a8af45aaa6aa2c630bdcbb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:29.054383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:29.057327 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8475f3a4-adcc-45e9-b916-4e2d78fcff16 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] 10.222.0.85 "GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032" status: 200 len: 1352 microversion: 2.1 time: 0.642432 Aug 24 10:34:29.073746 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1993/4334] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:28 2022] GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032 => generated 1352 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:29.096447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2fed4f2b-db98-4645-985c-51644351fc1d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:29.098152 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2fed4f2b-db98-4645-985c-51644351fc1d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] [instance: 253f9d94-6076-4696-8388-cc5be65d66ea] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:29.103680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:29.110283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fed4f2b-db98-4645-985c-51644351fc1d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:29.111518 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fed4f2b-db98-4645-985c-51644351fc1d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:29.112655 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fed4f2b-db98-4645-985c-51644351fc1d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:29.115012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fed4f2b-db98-4645-985c-51644351fc1d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:29.116260 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fed4f2b-db98-4645-985c-51644351fc1d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:29.118361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fed4f2b-db98-4645-985c-51644351fc1d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:29.176155 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-75339e55-ac99-4cd0-9050-c18eee37120e tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "DELETE /compute/v2.1/servers/2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6" status: 204 len: 0 microversion: 2.1 time: 0.316130 Aug 24 10:34:29.182808 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2342/4335] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:34:28 2022] DELETE /compute/v2.1/servers/2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:34:29.188408 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-61772505-f8cb-46e6-977c-e15065a5d120 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:29.189152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-61772505-f8cb-46e6-977c-e15065a5d120 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:29.211632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61772505-f8cb-46e6-977c-e15065a5d120 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:29.212136 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61772505-f8cb-46e6-977c-e15065a5d120 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:29.212785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61772505-f8cb-46e6-977c-e15065a5d120 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:29.218142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61772505-f8cb-46e6-977c-e15065a5d120 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:29.218711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61772505-f8cb-46e6-977c-e15065a5d120 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:29.219200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61772505-f8cb-46e6-977c-e15065a5d120 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:29.610298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2fed4f2b-db98-4645-985c-51644351fc1d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbd482dde84ddb85ea4be9814dd5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca3a4feff2429b8b8b04a3d2a4175d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:29.619807 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2fed4f2b-db98-4645-985c-51644351fc1d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] 10.222.0.85 "GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea" status: 200 len: 1314 microversion: 2.1 time: 0.544099 Aug 24 10:34:29.628979 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1994/4336] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:29 2022] GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea => generated 1314 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:29.637694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-80aebf00-ecc1-47cf-81c6-013561e0ebcc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:29.646800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-80aebf00-ecc1-47cf-81c6-013561e0ebcc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:29.657450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80aebf00-ecc1-47cf-81c6-013561e0ebcc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:29.659778 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80aebf00-ecc1-47cf-81c6-013561e0ebcc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:29.661528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80aebf00-ecc1-47cf-81c6-013561e0ebcc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:29.663768 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80aebf00-ecc1-47cf-81c6-013561e0ebcc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:29.665304 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80aebf00-ecc1-47cf-81c6-013561e0ebcc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:29.666651 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80aebf00-ecc1-47cf-81c6-013561e0ebcc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:29.764496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-61772505-f8cb-46e6-977c-e15065a5d120 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:29.773869 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-61772505-f8cb-46e6-977c-e15065a5d120 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6" status: 200 len: 1521 microversion: 2.1 time: 0.589474 Aug 24 10:34:29.786140 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2343/4337] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:29 2022] GET /compute/v2.1/servers/2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 => generated 1521 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:29.881461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-df933552-11fd-464c-9a3a-22a36818af66 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:29.882101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-df933552-11fd-464c-9a3a-22a36818af66 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:29.908187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df933552-11fd-464c-9a3a-22a36818af66 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:29.908694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df933552-11fd-464c-9a3a-22a36818af66 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:29.909164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df933552-11fd-464c-9a3a-22a36818af66 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:29.910547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df933552-11fd-464c-9a3a-22a36818af66 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:29.911020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df933552-11fd-464c-9a3a-22a36818af66 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:29.911453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df933552-11fd-464c-9a3a-22a36818af66 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:30.164446 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-80aebf00-ecc1-47cf-81c6-013561e0ebcc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:30.173773 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-80aebf00-ecc1-47cf-81c6-013561e0ebcc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1687 microversion: 2.1 time: 0.543340 Aug 24 10:34:30.174378 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1995/4338] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:29 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1687 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:30.179590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9b890363-ef3e-4f5f-a691-ab298724f7e9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:30.180423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9b890363-ef3e-4f5f-a691-ab298724f7e9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] [instance: b0df3e3d-8b13-4314-9c1c-c99e81a23032] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:30.188048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b890363-ef3e-4f5f-a691-ab298724f7e9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:30.188767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b890363-ef3e-4f5f-a691-ab298724f7e9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:30.189462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b890363-ef3e-4f5f-a691-ab298724f7e9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:30.190526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b890363-ef3e-4f5f-a691-ab298724f7e9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:30.191107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b890363-ef3e-4f5f-a691-ab298724f7e9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:30.191545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b890363-ef3e-4f5f-a691-ab298724f7e9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:30.285010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:30.366936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-df933552-11fd-464c-9a3a-22a36818af66 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:30.383362 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-df933552-11fd-464c-9a3a-22a36818af66 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1519 microversion: 2.1 time: 0.507833 Aug 24 10:34:30.398985 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2344/4339] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:29 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1519 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:30.531071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-70f8e915-4e54-4934-907a-a06382304715 req-1a2f98a7-54cc-41ba-aa2d-d3cccd34aa43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0df3e3d-8b13-4314-9c1c-c99e81a23032", "tag": "987eb300-121e-4221-8d70-755c9e215d60"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:30.553621 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-70f8e915-4e54-4934-907a-a06382304715 req-1a2f98a7-54cc-41ba-aa2d-d3cccd34aa43 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:30.557770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-70f8e915-4e54-4934-907a-a06382304715 req-1a2f98a7-54cc-41ba-aa2d-d3cccd34aa43 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:30.558896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-70f8e915-4e54-4934-907a-a06382304715 req-1a2f98a7-54cc-41ba-aa2d-d3cccd34aa43 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:30.587194 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-70f8e915-4e54-4934-907a-a06382304715 req-1a2f98a7-54cc-41ba-aa2d-d3cccd34aa43 service nova] Creating event network-changed:987eb300-121e-4221-8d70-755c9e215d60 for instance b0df3e3d-8b13-4314-9c1c-c99e81a23032 on n-h1-849328-3 Aug 24 10:34:30.603400 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9b890363-ef3e-4f5f-a691-ab298724f7e9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe66c7282c84f0fa2011575403c42d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf76463a8af45aaa6aa2c630bdcbb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:30.617459 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9b890363-ef3e-4f5f-a691-ab298724f7e9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] 10.222.0.85 "GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032" status: 200 len: 1352 microversion: 2.1 time: 0.439622 Aug 24 10:34:30.619566 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1996/4340] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:30 2022] GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032 => generated 1352 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:30.630277 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-70f8e915-4e54-4934-907a-a06382304715 req-1a2f98a7-54cc-41ba-aa2d-d3cccd34aa43 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069770 Aug 24 10:34:30.630982 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2345/4341] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:34:30.656045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8b04db75-aaaa-44c1-95d8-e8d48e0f96cc tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:30.656828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8b04db75-aaaa-44c1-95d8-e8d48e0f96cc tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] [instance: 253f9d94-6076-4696-8388-cc5be65d66ea] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:30.667349 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b04db75-aaaa-44c1-95d8-e8d48e0f96cc tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:30.669863 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b04db75-aaaa-44c1-95d8-e8d48e0f96cc tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:30.672295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b04db75-aaaa-44c1-95d8-e8d48e0f96cc tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:30.675070 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b04db75-aaaa-44c1-95d8-e8d48e0f96cc tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:30.675820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b04db75-aaaa-44c1-95d8-e8d48e0f96cc tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:30.676469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b04db75-aaaa-44c1-95d8-e8d48e0f96cc tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:30.799041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ba79c0c-c7e0-4489-9153-3ea1d8defefa tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:30.800026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3ba79c0c-c7e0-4489-9153-3ea1d8defefa tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:30.819077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ba79c0c-c7e0-4489-9153-3ea1d8defefa tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:30.824196 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ba79c0c-c7e0-4489-9153-3ea1d8defefa tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:30.825064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ba79c0c-c7e0-4489-9153-3ea1d8defefa tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:30.832368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ba79c0c-c7e0-4489-9153-3ea1d8defefa tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:30.833105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ba79c0c-c7e0-4489-9153-3ea1d8defefa tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:30.833773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ba79c0c-c7e0-4489-9153-3ea1d8defefa tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:30.980904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8b04db75-aaaa-44c1-95d8-e8d48e0f96cc tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbd482dde84ddb85ea4be9814dd5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca3a4feff2429b8b8b04a3d2a4175d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:30.994813 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8b04db75-aaaa-44c1-95d8-e8d48e0f96cc tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] 10.222.0.85 "GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea" status: 200 len: 1314 microversion: 2.1 time: 0.342203 Aug 24 10:34:30.997239 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1997/4342] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:30 2022] GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:31.200145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ca7d4fcc-f7cd-4a36-83d8-0e2d30b2d615 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:31.200877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ca7d4fcc-f7cd-4a36-83d8-0e2d30b2d615 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:31.214627 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca7d4fcc-f7cd-4a36-83d8-0e2d30b2d615 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:31.215135 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca7d4fcc-f7cd-4a36-83d8-0e2d30b2d615 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:31.218323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca7d4fcc-f7cd-4a36-83d8-0e2d30b2d615 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:31.219505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca7d4fcc-f7cd-4a36-83d8-0e2d30b2d615 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:31.221143 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca7d4fcc-f7cd-4a36-83d8-0e2d30b2d615 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:31.221864 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca7d4fcc-f7cd-4a36-83d8-0e2d30b2d615 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:31.489846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3ba79c0c-c7e0-4489-9153-3ea1d8defefa tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:31.511479 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ba79c0c-c7e0-4489-9153-3ea1d8defefa tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6" status: 200 len: 1521 microversion: 2.1 time: 0.715493 Aug 24 10:34:31.518708 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2346/4343] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:30 2022] GET /compute/v2.1/servers/2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 => generated 1521 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:34:31.537953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ca7d4fcc-f7cd-4a36-83d8-0e2d30b2d615 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:31.577476 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ca7d4fcc-f7cd-4a36-83d8-0e2d30b2d615 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1687 microversion: 2.1 time: 0.384674 Aug 24 10:34:31.585162 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-188e38a7-a2e8-4924-a0b9-fe5c90462c4d req-b90f2764-e632-4399-8e3d-f2f1b5639785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ed6211-b7fc-454f-a8e9-73ba571a71af", "name": "network-vif-plugged", "status": "completed", "tag": "1c2608cb-c0ff-45d5-b7c5-82ff95cc5b0c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:31.586758 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1998/4344] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:31 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1687 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:31.604852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2f23b14f-5ce8-4d2d-8f39-629d77922c0c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:31.607425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2f23b14f-5ce8-4d2d-8f39-629d77922c0c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:31.607837 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:31.636143 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f23b14f-5ce8-4d2d-8f39-629d77922c0c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:31.641904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f23b14f-5ce8-4d2d-8f39-629d77922c0c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:31.642824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f23b14f-5ce8-4d2d-8f39-629d77922c0c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:31.643062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-188e38a7-a2e8-4924-a0b9-fe5c90462c4d req-b90f2764-e632-4399-8e3d-f2f1b5639785 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:31.644866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-188e38a7-a2e8-4924-a0b9-fe5c90462c4d req-b90f2764-e632-4399-8e3d-f2f1b5639785 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:31.647482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f23b14f-5ce8-4d2d-8f39-629d77922c0c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:31.648480 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-188e38a7-a2e8-4924-a0b9-fe5c90462c4d req-b90f2764-e632-4399-8e3d-f2f1b5639785 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:31.649413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f23b14f-5ce8-4d2d-8f39-629d77922c0c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:31.652876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f23b14f-5ce8-4d2d-8f39-629d77922c0c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:31.718761 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-188e38a7-a2e8-4924-a0b9-fe5c90462c4d req-b90f2764-e632-4399-8e3d-f2f1b5639785 service nova] Creating event network-vif-plugged:1c2608cb-c0ff-45d5-b7c5-82ff95cc5b0c for instance 99ed6211-b7fc-454f-a8e9-73ba571a71af on n-h1-849328-3 Aug 24 10:34:31.778274 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-188e38a7-a2e8-4924-a0b9-fe5c90462c4d req-b90f2764-e632-4399-8e3d-f2f1b5639785 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208547 Aug 24 10:34:31.780955 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2347/4345] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:34:31.815291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-53147200-2d34-4753-835a-ba2230c053b8 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:31.834868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-53147200-2d34-4753-835a-ba2230c053b8 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] [instance: b0df3e3d-8b13-4314-9c1c-c99e81a23032] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:31.881234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53147200-2d34-4753-835a-ba2230c053b8 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:31.881732 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53147200-2d34-4753-835a-ba2230c053b8 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:31.884682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53147200-2d34-4753-835a-ba2230c053b8 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:31.886197 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53147200-2d34-4753-835a-ba2230c053b8 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:31.896120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53147200-2d34-4753-835a-ba2230c053b8 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:31.897265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53147200-2d34-4753-835a-ba2230c053b8 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:32.429569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-53147200-2d34-4753-835a-ba2230c053b8 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe66c7282c84f0fa2011575403c42d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf76463a8af45aaa6aa2c630bdcbb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:32.443639 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-53147200-2d34-4753-835a-ba2230c053b8 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] 10.222.0.85 "GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032" status: 200 len: 1352 microversion: 2.1 time: 0.660859 Aug 24 10:34:32.468257 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2348/4346] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:31 2022] GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032 => generated 1352 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:32.478154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-54ff69f4-ca12-4824-bed9-478099506cdf tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:32.479012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-54ff69f4-ca12-4824-bed9-478099506cdf tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] [instance: 253f9d94-6076-4696-8388-cc5be65d66ea] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:32.493990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54ff69f4-ca12-4824-bed9-478099506cdf tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:32.494676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54ff69f4-ca12-4824-bed9-478099506cdf tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:32.494909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54ff69f4-ca12-4824-bed9-478099506cdf tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:32.495710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54ff69f4-ca12-4824-bed9-478099506cdf tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:32.496221 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54ff69f4-ca12-4824-bed9-478099506cdf tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:32.496911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54ff69f4-ca12-4824-bed9-478099506cdf tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:32.928733 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-54ff69f4-ca12-4824-bed9-478099506cdf tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbd482dde84ddb85ea4be9814dd5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca3a4feff2429b8b8b04a3d2a4175d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:32.944672 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-54ff69f4-ca12-4824-bed9-478099506cdf tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] 10.222.0.85 "GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea" status: 200 len: 1314 microversion: 2.1 time: 0.475031 Aug 24 10:34:32.945648 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2349/4347] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:32 2022] GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:32.953795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-65f42a81-d85a-4e41-832f-3ef2ba1f8332 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:32.954717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-65f42a81-d85a-4e41-832f-3ef2ba1f8332 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:32.955148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2f23b14f-5ce8-4d2d-8f39-629d77922c0c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:32.974362 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2f23b14f-5ce8-4d2d-8f39-629d77922c0c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1519 microversion: 2.1 time: 1.378882 Aug 24 10:34:32.980642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65f42a81-d85a-4e41-832f-3ef2ba1f8332 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:32.981630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65f42a81-d85a-4e41-832f-3ef2ba1f8332 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:32.982153 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65f42a81-d85a-4e41-832f-3ef2ba1f8332 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:32.983052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65f42a81-d85a-4e41-832f-3ef2ba1f8332 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:32.989782 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1999/4348] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:31 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1519 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:32.997678 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65f42a81-d85a-4e41-832f-3ef2ba1f8332 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:32.998320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65f42a81-d85a-4e41-832f-3ef2ba1f8332 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:33.037322 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b43e9658-0553-4042-a8c1-057d06117075 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:33.038426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b43e9658-0553-4042-a8c1-057d06117075 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:33.081405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b43e9658-0553-4042-a8c1-057d06117075 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:33.082137 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b43e9658-0553-4042-a8c1-057d06117075 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:33.083961 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b43e9658-0553-4042-a8c1-057d06117075 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:33.084789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b43e9658-0553-4042-a8c1-057d06117075 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:33.089998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b43e9658-0553-4042-a8c1-057d06117075 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:33.090481 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b43e9658-0553-4042-a8c1-057d06117075 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:33.899626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-65f42a81-d85a-4e41-832f-3ef2ba1f8332 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:33.912637 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-65f42a81-d85a-4e41-832f-3ef2ba1f8332 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6" status: 200 len: 1521 microversion: 2.1 time: 0.965837 Aug 24 10:34:33.913855 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2350/4349] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:32 2022] GET /compute/v2.1/servers/2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 => generated 1521 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:33.928006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d9d42f91-9fd2-4154-92b0-f095c83c1885 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:33.934051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d9d42f91-9fd2-4154-92b0-f095c83c1885 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] [instance: b0df3e3d-8b13-4314-9c1c-c99e81a23032] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:33.960654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9d42f91-9fd2-4154-92b0-f095c83c1885 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:33.961206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9d42f91-9fd2-4154-92b0-f095c83c1885 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:33.961660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9d42f91-9fd2-4154-92b0-f095c83c1885 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:33.962543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9d42f91-9fd2-4154-92b0-f095c83c1885 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:33.963009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9d42f91-9fd2-4154-92b0-f095c83c1885 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:33.964863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9d42f91-9fd2-4154-92b0-f095c83c1885 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:34.175415 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b43e9658-0553-4042-a8c1-057d06117075 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:34.193292 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b43e9658-0553-4042-a8c1-057d06117075 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1682 microversion: 2.1 time: 1.194301 Aug 24 10:34:34.206281 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2000/4350] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:32 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1682 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:34.214746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cbaf261a-c3cb-4836-bd34-72227a8257e0 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:34.217981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cbaf261a-c3cb-4836-bd34-72227a8257e0 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] [instance: 253f9d94-6076-4696-8388-cc5be65d66ea] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:34.234217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbaf261a-c3cb-4836-bd34-72227a8257e0 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:34.238086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbaf261a-c3cb-4836-bd34-72227a8257e0 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:34.239142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbaf261a-c3cb-4836-bd34-72227a8257e0 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:34.242354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbaf261a-c3cb-4836-bd34-72227a8257e0 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:34.243359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbaf261a-c3cb-4836-bd34-72227a8257e0 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:34.245919 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbaf261a-c3cb-4836-bd34-72227a8257e0 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:34.306430 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d9d42f91-9fd2-4154-92b0-f095c83c1885 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe66c7282c84f0fa2011575403c42d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf76463a8af45aaa6aa2c630bdcbb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:34.336635 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d9d42f91-9fd2-4154-92b0-f095c83c1885 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] 10.222.0.85 "GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032" status: 200 len: 1352 microversion: 2.1 time: 0.420800 Aug 24 10:34:34.341016 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2351/4351] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:33 2022] GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032 => generated 1352 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:34.359148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4fdab6dc-605c-48ed-992e-d0cc9c505069 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:34.364221 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4fdab6dc-605c-48ed-992e-d0cc9c505069 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:34.417571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fdab6dc-605c-48ed-992e-d0cc9c505069 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:34.418988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fdab6dc-605c-48ed-992e-d0cc9c505069 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:34.419680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fdab6dc-605c-48ed-992e-d0cc9c505069 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:34.420805 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fdab6dc-605c-48ed-992e-d0cc9c505069 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:34.426203 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fdab6dc-605c-48ed-992e-d0cc9c505069 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:34.426203 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fdab6dc-605c-48ed-992e-d0cc9c505069 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:34.876501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4fdab6dc-605c-48ed-992e-d0cc9c505069 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:34.890895 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4fdab6dc-605c-48ed-992e-d0cc9c505069 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1519 microversion: 2.1 time: 0.547954 Aug 24 10:34:34.916909 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2352/4352] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:34 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1519 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:34.939076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8e79728b-5b90-412c-99e5-1dcafcbc0686 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:34.940265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8e79728b-5b90-412c-99e5-1dcafcbc0686 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:34.954489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e79728b-5b90-412c-99e5-1dcafcbc0686 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:34.955294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e79728b-5b90-412c-99e5-1dcafcbc0686 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:34.955921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e79728b-5b90-412c-99e5-1dcafcbc0686 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:34.956835 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e79728b-5b90-412c-99e5-1dcafcbc0686 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:34.957636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e79728b-5b90-412c-99e5-1dcafcbc0686 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:34.958228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e79728b-5b90-412c-99e5-1dcafcbc0686 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:35.212340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8e79728b-5b90-412c-99e5-1dcafcbc0686 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:35.230234 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8e79728b-5b90-412c-99e5-1dcafcbc0686 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6" status: 200 len: 1521 microversion: 2.1 time: 0.295128 Aug 24 10:34:35.247275 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2353/4353] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:34 2022] GET /compute/v2.1/servers/2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:35.255147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-630d2f03-7dd2-4095-bd87-e6ccaf04f0c8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:35.259008 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-630d2f03-7dd2-4095-bd87-e6ccaf04f0c8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:35.279907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-630d2f03-7dd2-4095-bd87-e6ccaf04f0c8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:35.280723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-630d2f03-7dd2-4095-bd87-e6ccaf04f0c8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:35.281206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-630d2f03-7dd2-4095-bd87-e6ccaf04f0c8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:35.287938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-630d2f03-7dd2-4095-bd87-e6ccaf04f0c8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:35.288758 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-630d2f03-7dd2-4095-bd87-e6ccaf04f0c8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:35.289556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-630d2f03-7dd2-4095-bd87-e6ccaf04f0c8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:35.371407 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cbaf261a-c3cb-4836-bd34-72227a8257e0 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbd482dde84ddb85ea4be9814dd5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca3a4feff2429b8b8b04a3d2a4175d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:35.382955 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cbaf261a-c3cb-4836-bd34-72227a8257e0 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] 10.222.0.85 "GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea" status: 200 len: 1314 microversion: 2.1 time: 1.175152 Aug 24 10:34:35.499558 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2001/4354] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:34 2022] GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea => generated 1314 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:35.514715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3d6cffc1-080c-4f0f-a8ce-f63824b7fec6 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:35.515548 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3d6cffc1-080c-4f0f-a8ce-f63824b7fec6 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] [instance: b0df3e3d-8b13-4314-9c1c-c99e81a23032] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:35.552483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d6cffc1-080c-4f0f-a8ce-f63824b7fec6 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:35.552992 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d6cffc1-080c-4f0f-a8ce-f63824b7fec6 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:35.553457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d6cffc1-080c-4f0f-a8ce-f63824b7fec6 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:35.554190 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d6cffc1-080c-4f0f-a8ce-f63824b7fec6 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:35.554649 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d6cffc1-080c-4f0f-a8ce-f63824b7fec6 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:35.555065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d6cffc1-080c-4f0f-a8ce-f63824b7fec6 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:35.910883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-630d2f03-7dd2-4095-bd87-e6ccaf04f0c8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:35.936679 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-630d2f03-7dd2-4095-bd87-e6ccaf04f0c8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1682 microversion: 2.1 time: 0.687861 Aug 24 10:34:35.937727 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2354/4355] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:35 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1682 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:35.990239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-965676f0-0f6d-4e4c-a5a7-dd54c4554a11 req-5b1a17c2-1a06-4737-a6c4-9b191f8e09e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6", "name": "network-vif-deleted", "tag": "44c6fb77-e32f-470d-a31c-53dc0213be69"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:36.018501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-965676f0-0f6d-4e4c-a5a7-dd54c4554a11 req-5b1a17c2-1a06-4737-a6c4-9b191f8e09e5 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:36.032288 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-965676f0-0f6d-4e4c-a5a7-dd54c4554a11 req-5b1a17c2-1a06-4737-a6c4-9b191f8e09e5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:36.035630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-965676f0-0f6d-4e4c-a5a7-dd54c4554a11 req-5b1a17c2-1a06-4737-a6c4-9b191f8e09e5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:36.085009 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-965676f0-0f6d-4e4c-a5a7-dd54c4554a11 req-5b1a17c2-1a06-4737-a6c4-9b191f8e09e5 service nova] Creating event network-vif-deleted:44c6fb77-e32f-470d-a31c-53dc0213be69 for instance 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 on n-h1-849328-3 Aug 24 10:34:36.105546 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-965676f0-0f6d-4e4c-a5a7-dd54c4554a11 req-5b1a17c2-1a06-4737-a6c4-9b191f8e09e5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118927 Aug 24 10:34:36.106461 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2355/4356] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:34:36.137407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-92938a65-4609-4051-b47e-a64c72db20f1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:36.154570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-92938a65-4609-4051-b47e-a64c72db20f1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:36.198738 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3d6cffc1-080c-4f0f-a8ce-f63824b7fec6 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe66c7282c84f0fa2011575403c42d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf76463a8af45aaa6aa2c630bdcbb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:36.199564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92938a65-4609-4051-b47e-a64c72db20f1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:36.200381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92938a65-4609-4051-b47e-a64c72db20f1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:36.201053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92938a65-4609-4051-b47e-a64c72db20f1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:36.201811 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92938a65-4609-4051-b47e-a64c72db20f1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:36.202331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92938a65-4609-4051-b47e-a64c72db20f1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:36.202868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92938a65-4609-4051-b47e-a64c72db20f1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:36.209966 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3d6cffc1-080c-4f0f-a8ce-f63824b7fec6 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] 10.222.0.85 "GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032" status: 200 len: 1352 microversion: 2.1 time: 0.709246 Aug 24 10:34:36.217903 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2002/4357] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:35 2022] GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032 => generated 1352 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:36.265446 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b9a2877a-b839-4dac-b71f-3e410ea290b2 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:36.267513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b9a2877a-b839-4dac-b71f-3e410ea290b2 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:36.287598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9a2877a-b839-4dac-b71f-3e410ea290b2 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:36.288217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9a2877a-b839-4dac-b71f-3e410ea290b2 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:36.290219 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9a2877a-b839-4dac-b71f-3e410ea290b2 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:36.291407 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9a2877a-b839-4dac-b71f-3e410ea290b2 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:36.293184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9a2877a-b839-4dac-b71f-3e410ea290b2 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:36.293695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9a2877a-b839-4dac-b71f-3e410ea290b2 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:36.425610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9a2877a-b839-4dac-b71f-3e410ea290b2 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:36.427179 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9a2877a-b839-4dac-b71f-3e410ea290b2 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:36.427855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9a2877a-b839-4dac-b71f-3e410ea290b2 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:36.429489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-b9a2877a-b839-4dac-b71f-3e410ea290b2 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lazy-loading 'fault' on Instance uuid 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:34:36.813616 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-92938a65-4609-4051-b47e-a64c72db20f1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:36.848550 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-92938a65-4609-4051-b47e-a64c72db20f1 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1519 microversion: 2.1 time: 0.740291 Aug 24 10:34:36.849707 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2356/4358] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:36 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1519 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:36.873335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8b992c25-46fb-482a-9a43-e23c0c814dd7 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:36.874543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8b992c25-46fb-482a-9a43-e23c0c814dd7 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] [instance: 253f9d94-6076-4696-8388-cc5be65d66ea] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:36.904590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b992c25-46fb-482a-9a43-e23c0c814dd7 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:36.905223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b992c25-46fb-482a-9a43-e23c0c814dd7 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:36.905872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b992c25-46fb-482a-9a43-e23c0c814dd7 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:36.906824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b992c25-46fb-482a-9a43-e23c0c814dd7 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:36.912299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b992c25-46fb-482a-9a43-e23c0c814dd7 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:36.912984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b992c25-46fb-482a-9a43-e23c0c814dd7 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:37.269276 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b9a2877a-b839-4dac-b71f-3e410ea290b2 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:37.287755 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b9a2877a-b839-4dac-b71f-3e410ea290b2 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6" status: 200 len: 1313 microversion: 2.1 time: 1.030338 Aug 24 10:34:37.288413 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2003/4359] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:36 2022] GET /compute/v2.1/servers/2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 => generated 1313 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:34:37.306578 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8b3a8ba5-73e5-446a-b82d-4647df55c6b1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:37.324792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8b3a8ba5-73e5-446a-b82d-4647df55c6b1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:37.346956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b3a8ba5-73e5-446a-b82d-4647df55c6b1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:37.352122 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b3a8ba5-73e5-446a-b82d-4647df55c6b1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:37.353423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b3a8ba5-73e5-446a-b82d-4647df55c6b1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:37.358114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b3a8ba5-73e5-446a-b82d-4647df55c6b1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:37.359359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b3a8ba5-73e5-446a-b82d-4647df55c6b1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:37.360485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b3a8ba5-73e5-446a-b82d-4647df55c6b1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:37.405912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8b992c25-46fb-482a-9a43-e23c0c814dd7 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbd482dde84ddb85ea4be9814dd5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca3a4feff2429b8b8b04a3d2a4175d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:37.414812 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8b992c25-46fb-482a-9a43-e23c0c814dd7 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] 10.222.0.85 "GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea" status: 200 len: 1314 microversion: 2.1 time: 0.563487 Aug 24 10:34:37.423816 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2357/4360] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:36 2022] GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:37.428872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0fc8f62a-95ab-4314-8612-e17897bf900b tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:37.450020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0fc8f62a-95ab-4314-8612-e17897bf900b tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] [instance: b0df3e3d-8b13-4314-9c1c-c99e81a23032] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:37.476766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fc8f62a-95ab-4314-8612-e17897bf900b tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:37.476766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fc8f62a-95ab-4314-8612-e17897bf900b tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:37.476766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fc8f62a-95ab-4314-8612-e17897bf900b tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:37.476766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fc8f62a-95ab-4314-8612-e17897bf900b tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:37.476766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fc8f62a-95ab-4314-8612-e17897bf900b tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:37.499293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fc8f62a-95ab-4314-8612-e17897bf900b tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:37.814647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8b3a8ba5-73e5-446a-b82d-4647df55c6b1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:37.840720 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8b3a8ba5-73e5-446a-b82d-4647df55c6b1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1682 microversion: 2.1 time: 0.549248 Aug 24 10:34:37.842148 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2004/4361] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:37 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1682 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:37.880052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ac9c431c-f1a6-4ed7-8a41-e35cd0509a59 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:37.887603 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ac9c431c-f1a6-4ed7-8a41-e35cd0509a59 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:37.902918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0fc8f62a-95ab-4314-8612-e17897bf900b tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe66c7282c84f0fa2011575403c42d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf76463a8af45aaa6aa2c630bdcbb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:37.920016 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0fc8f62a-95ab-4314-8612-e17897bf900b tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] 10.222.0.85 "GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032" status: 200 len: 1352 microversion: 2.1 time: 0.494856 Aug 24 10:34:37.920633 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2358/4362] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:37 2022] GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032 => generated 1352 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:37.930910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac9c431c-f1a6-4ed7-8a41-e35cd0509a59 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:37.930910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac9c431c-f1a6-4ed7-8a41-e35cd0509a59 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:37.930910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac9c431c-f1a6-4ed7-8a41-e35cd0509a59 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:37.938638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac9c431c-f1a6-4ed7-8a41-e35cd0509a59 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:37.944442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac9c431c-f1a6-4ed7-8a41-e35cd0509a59 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:37.948535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac9c431c-f1a6-4ed7-8a41-e35cd0509a59 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:38.015951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-2af30a7b-9aa8-4e68-a48a-f3426aa4aeb1 req-0511cf50-4232-40e7-8b00-0e2cecdca01c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "253f9d94-6076-4696-8388-cc5be65d66ea", "name": "network-vif-plugged", "status": "completed", "tag": "f52c83d9-2823-4363-b62d-d3f492dc65a1"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:38.050059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2af30a7b-9aa8-4e68-a48a-f3426aa4aeb1 req-0511cf50-4232-40e7-8b00-0e2cecdca01c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:38.058183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2af30a7b-9aa8-4e68-a48a-f3426aa4aeb1 req-0511cf50-4232-40e7-8b00-0e2cecdca01c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:38.059150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2af30a7b-9aa8-4e68-a48a-f3426aa4aeb1 req-0511cf50-4232-40e7-8b00-0e2cecdca01c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:38.116649 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-2af30a7b-9aa8-4e68-a48a-f3426aa4aeb1 req-0511cf50-4232-40e7-8b00-0e2cecdca01c service nova] Creating event network-vif-plugged:f52c83d9-2823-4363-b62d-d3f492dc65a1 for instance 253f9d94-6076-4696-8388-cc5be65d66ea on n-h2-849328-3 Aug 24 10:34:38.164660 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-2af30a7b-9aa8-4e68-a48a-f3426aa4aeb1 req-0511cf50-4232-40e7-8b00-0e2cecdca01c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153329 Aug 24 10:34:38.170311 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2359/4363] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:34:38.312143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f149a7a5-a770-4182-8575-6ce1e5818e0c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:38.312851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f149a7a5-a770-4182-8575-6ce1e5818e0c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:38.338495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f149a7a5-a770-4182-8575-6ce1e5818e0c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:38.340063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f149a7a5-a770-4182-8575-6ce1e5818e0c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:38.340545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f149a7a5-a770-4182-8575-6ce1e5818e0c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:38.341346 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f149a7a5-a770-4182-8575-6ce1e5818e0c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:38.341816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f149a7a5-a770-4182-8575-6ce1e5818e0c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:38.342250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f149a7a5-a770-4182-8575-6ce1e5818e0c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:38.400584 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-f149a7a5-a770-4182-8575-6ce1e5818e0c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] HTTP exception thrown: Instance 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 could not be found. Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f149a7a5-a770-4182-8575-6ce1e5818e0c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Request method failure captured: Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 HTTP/1.1 Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf6G_Fl6Po5an1sxvvBt-NOd-lkU5xtt3khMYQcTevCswytc4yiSiFEsMwcGccArMe_H16sXVBuFm-9HylsHCgsOHeGuvBcoZjDAvqeCrxKeOihRVqGGIerXIzoGn7Z6miOEVC1oTm6PoJG9366G4jD2pjLn8j_4TJgO35KWbkeDbhY Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 070259159f48477787b16ce6ba8f75bd Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ListServersNegativeTestJSON-1321955027 Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/070259159f48477787b16ce6ba8f75bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_070259159f48477787b16ce6ba8f75bd", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/070259159f48477787b16ce6ba8f75bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/070259159f48477787b16ce6ba8f75bd"}]}] Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ListServersNegativeTestJSON-1321955027 Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 070259159f48477787b16ce6ba8f75bd Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1321955027 Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ListServersNegativeTestJSON-1321955027-project Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 99b9e0c2673344f2a705f7a64c67647f Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ListServersNegativeTestJSON-1321955027-project Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 could not be found. Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6'} Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 could not be found. Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 could not be found. Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:34:38.402443 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:34:38.407720 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:34:38.407720 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:38.407720 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:34:38.407720 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:34:38.407720 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:34:38.407720 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:34:38.407720 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 could not be found. Aug 24 10:34:38.407720 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:34:38.407720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f149a7a5-a770-4182-8575-6ce1e5818e0c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Returning 404 to user: Instance 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:34:38.407720 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f149a7a5-a770-4182-8575-6ce1e5818e0c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6" status: 404 len: 111 microversion: 2.1 time: 0.096270 Aug 24 10:34:38.408663 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2360/4364] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:38 2022] GET /compute/v2.1/servers/2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:34:38.417025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-efef0a55-73d4-444a-9b7f-f9e93b3df031 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:38.430858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-efef0a55-73d4-444a-9b7f-f9e93b3df031 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:38.443603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-efef0a55-73d4-444a-9b7f-f9e93b3df031 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '070259159f48477787b16ce6ba8f75bd'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:34:38.460589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efef0a55-73d4-444a-9b7f-f9e93b3df031 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:38.461071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efef0a55-73d4-444a-9b7f-f9e93b3df031 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:38.461878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efef0a55-73d4-444a-9b7f-f9e93b3df031 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:38.462266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efef0a55-73d4-444a-9b7f-f9e93b3df031 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:38.462726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efef0a55-73d4-444a-9b7f-f9e93b3df031 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:38.463154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efef0a55-73d4-444a-9b7f-f9e93b3df031 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:38.602506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:38.728992 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-efef0a55-73d4-444a-9b7f-f9e93b3df031 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.319156 Aug 24 10:34:38.733684 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2361/4365] 10.222.0.85 () {58 vars in 1230 bytes} [Wed Aug 24 10:34:38 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:34:38.773958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ed61426f-be3e-4474-ad2f-7c00cd8f653d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:38.775341 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ed61426f-be3e-4474-ad2f-7c00cd8f653d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] [instance: 253f9d94-6076-4696-8388-cc5be65d66ea] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:38.786021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed61426f-be3e-4474-ad2f-7c00cd8f653d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:38.787080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed61426f-be3e-4474-ad2f-7c00cd8f653d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:38.787732 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed61426f-be3e-4474-ad2f-7c00cd8f653d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:38.788832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed61426f-be3e-4474-ad2f-7c00cd8f653d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:38.789844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed61426f-be3e-4474-ad2f-7c00cd8f653d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:38.790504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed61426f-be3e-4474-ad2f-7c00cd8f653d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:39.172318 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ed61426f-be3e-4474-ad2f-7c00cd8f653d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbd482dde84ddb85ea4be9814dd5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca3a4feff2429b8b8b04a3d2a4175d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:39.202087 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ed61426f-be3e-4474-ad2f-7c00cd8f653d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] 10.222.0.85 "GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea" status: 200 len: 1314 microversion: 2.1 time: 0.456081 Aug 24 10:34:39.217782 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2362/4366] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:38 2022] GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:39.226527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c3bd08c2-0930-4b27-9e76-4f25bf671a65 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c3bd08c2-0930-4b27-9e76-4f25bf671a65 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Request method failure captured: Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf6G_Fl6Po5an1sxvvBt-NOd-lkU5xtt3khMYQcTevCswytc4yiSiFEsMwcGccArMe_H16sXVBuFm-9HylsHCgsOHeGuvBcoZjDAvqeCrxKeOihRVqGGIerXIzoGn7Z6miOEVC1oTm6PoJG9366G4jD2pjLn8j_4TJgO35KWbkeDbhY Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 070259159f48477787b16ce6ba8f75bd Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ListServersNegativeTestJSON-1321955027 Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/070259159f48477787b16ce6ba8f75bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_070259159f48477787b16ce6ba8f75bd", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/070259159f48477787b16ce6ba8f75bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/070259159f48477787b16ce6ba8f75bd"}]}] Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ListServersNegativeTestJSON-1321955027 Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 070259159f48477787b16ce6ba8f75bd Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1321955027 Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ListServersNegativeTestJSON-1321955027-project Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 99b9e0c2673344f2a705f7a64c67647f Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ListServersNegativeTestJSON-1321955027-project Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: action_args: {} Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 24 10:34:39.231370 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:34:39.235674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:34:39.235674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:34:39.235674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:34:39.235674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 24 10:34:39.235674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:34:39.235674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:34:39.235674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:34:39.235674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:39.235674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:34:39.235674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:34:39.235674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:34:39.235674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:34:39.235674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 24 10:34:39.235674 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:34:39.238630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c3bd08c2-0930-4b27-9e76-4f25bf671a65 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:34:39.240745 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c3bd08c2-0930-4b27-9e76-4f25bf671a65 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.020838 Aug 24 10:34:39.249289 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2363/4367] 10.222.0.85 () {58 vars in 1182 bytes} [Wed Aug 24 10:34:39 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:34:39.272923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d5ff6d18-37d0-469c-bd55-9b8877f99a24 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:39.273938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d5ff6d18-37d0-469c-bd55-9b8877f99a24 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:39.292503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5ff6d18-37d0-469c-bd55-9b8877f99a24 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:39.293795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5ff6d18-37d0-469c-bd55-9b8877f99a24 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:39.294579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5ff6d18-37d0-469c-bd55-9b8877f99a24 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:39.297350 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5ff6d18-37d0-469c-bd55-9b8877f99a24 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:39.298855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5ff6d18-37d0-469c-bd55-9b8877f99a24 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:39.307338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5ff6d18-37d0-469c-bd55-9b8877f99a24 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:39.616387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ac9c431c-f1a6-4ed7-8a41-e35cd0509a59 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:39.670480 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ac9c431c-f1a6-4ed7-8a41-e35cd0509a59 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1519 microversion: 2.1 time: 1.802573 Aug 24 10:34:39.671464 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2005/4368] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:37 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1519 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:34:39.690947 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4646a633-906b-47f1-b5b8-cfbb28e6a59b tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:39.691605 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4646a633-906b-47f1-b5b8-cfbb28e6a59b tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] [instance: b0df3e3d-8b13-4314-9c1c-c99e81a23032] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:39.734580 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4646a633-906b-47f1-b5b8-cfbb28e6a59b tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:39.741095 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4646a633-906b-47f1-b5b8-cfbb28e6a59b tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:39.741678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4646a633-906b-47f1-b5b8-cfbb28e6a59b tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:39.742460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4646a633-906b-47f1-b5b8-cfbb28e6a59b tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:39.742913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4646a633-906b-47f1-b5b8-cfbb28e6a59b tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:39.743341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4646a633-906b-47f1-b5b8-cfbb28e6a59b tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:39.745813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d5ff6d18-37d0-469c-bd55-9b8877f99a24 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:39.764422 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d5ff6d18-37d0-469c-bd55-9b8877f99a24 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1682 microversion: 2.1 time: 0.512885 Aug 24 10:34:39.775761 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2364/4369] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:39 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1682 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:39.791720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ee65839-d9de-4fa5-8c48-981e22f18314 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:39.813702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4ee65839-d9de-4fa5-8c48-981e22f18314 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:39.815267 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4ee65839-d9de-4fa5-8c48-981e22f18314 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Searching by: {'deleted': False, 'project_id': '070259159f48477787b16ce6ba8f75bd'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:34:39.833800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ee65839-d9de-4fa5-8c48-981e22f18314 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:39.835082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ee65839-d9de-4fa5-8c48-981e22f18314 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:39.840000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ee65839-d9de-4fa5-8c48-981e22f18314 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:39.841094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ee65839-d9de-4fa5-8c48-981e22f18314 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:39.842134 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ee65839-d9de-4fa5-8c48-981e22f18314 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:39.842745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ee65839-d9de-4fa5-8c48-981e22f18314 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:39.922176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-4ee65839-d9de-4fa5-8c48-981e22f18314 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:34:40.026311 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4ee65839-d9de-4fa5-8c48-981e22f18314 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.248151 Aug 24 10:34:40.035007 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2365/4370] 10.222.0.85 () {58 vars in 1125 bytes} [Wed Aug 24 10:34:39 2022] GET /compute/v2.1/servers => generated 683 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:34:40.051393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-71775ab8-3a03-443d-b252-0e6f535ece88 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:40.064454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-71775ab8-3a03-443d-b252-0e6f535ece88 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:40.065704 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.compute.servers [None req-71775ab8-3a03-443d-b252-0e6f535ece88 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Removing options 'limit' from query {{(pid=122433) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 24 10:34:40.066848 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-71775ab8-3a03-443d-b252-0e6f535ece88 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Searching by: {'deleted': False, 'project_id': '070259159f48477787b16ce6ba8f75bd'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:34:40.074791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71775ab8-3a03-443d-b252-0e6f535ece88 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:40.078318 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71775ab8-3a03-443d-b252-0e6f535ece88 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:40.079065 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71775ab8-3a03-443d-b252-0e6f535ece88 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:40.080428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71775ab8-3a03-443d-b252-0e6f535ece88 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:40.083184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71775ab8-3a03-443d-b252-0e6f535ece88 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:40.087961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71775ab8-3a03-443d-b252-0e6f535ece88 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:40.147638 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-71775ab8-3a03-443d-b252-0e6f535ece88 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:34:40.227733 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-71775ab8-3a03-443d-b252-0e6f535ece88 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.181465 Aug 24 10:34:40.232647 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2366/4371] 10.222.0.85 () {58 vars in 1144 bytes} [Wed Aug 24 10:34:40 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:34:40.249320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c4722184-ded1-4572-9611-81f04a21d70d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:40.250243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c4722184-ded1-4572-9611-81f04a21d70d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] [instance: 253f9d94-6076-4696-8388-cc5be65d66ea] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:40.260644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4722184-ded1-4572-9611-81f04a21d70d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:40.263582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4722184-ded1-4572-9611-81f04a21d70d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:40.265860 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4722184-ded1-4572-9611-81f04a21d70d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:40.270254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4722184-ded1-4572-9611-81f04a21d70d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:40.271011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4722184-ded1-4572-9611-81f04a21d70d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:40.271799 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4722184-ded1-4572-9611-81f04a21d70d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:40.300566 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4646a633-906b-47f1-b5b8-cfbb28e6a59b tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe66c7282c84f0fa2011575403c42d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf76463a8af45aaa6aa2c630bdcbb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:40.346090 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4646a633-906b-47f1-b5b8-cfbb28e6a59b tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] 10.222.0.85 "GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032" status: 200 len: 1352 microversion: 2.1 time: 0.656765 Aug 24 10:34:40.347776 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2006/4372] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:39 2022] GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032 => generated 1352 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:40.354366 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-de266235-a21f-44db-8ee3-f993811d00f1 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-de266235-a21f-44db-8ee3-f993811d00f1 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Request method failure captured: Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf6G_Fl6Po5an1sxvvBt-NOd-lkU5xtt3khMYQcTevCswytc4yiSiFEsMwcGccArMe_H16sXVBuFm-9HylsHCgsOHeGuvBcoZjDAvqeCrxKeOihRVqGGIerXIzoGn7Z6miOEVC1oTm6PoJG9366G4jD2pjLn8j_4TJgO35KWbkeDbhY Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 070259159f48477787b16ce6ba8f75bd Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ListServersNegativeTestJSON-1321955027 Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/070259159f48477787b16ce6ba8f75bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_070259159f48477787b16ce6ba8f75bd", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/070259159f48477787b16ce6ba8f75bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/070259159f48477787b16ce6ba8f75bd"}]}] Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ListServersNegativeTestJSON-1321955027 Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 070259159f48477787b16ce6ba8f75bd Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1321955027 Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ListServersNegativeTestJSON-1321955027-project Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 99b9e0c2673344f2a705f7a64c67647f Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ListServersNegativeTestJSON-1321955027-project Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: action_args: {} Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi '-1' Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 24 10:34:40.379360 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 24 10:34:40.387251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:34:40.387251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:34:40.387251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:34:40.387251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:34:40.387251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 24 10:34:40.387251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:40.387251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:34:40.387251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:40.387251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:40.387251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:34:40.387251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:34:40.387251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:34:40.387251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:34:40.387251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 24 10:34:40.387251 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:40.406667 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-de266235-a21f-44db-8ee3-f993811d00f1 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:34:40.409258 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-de266235-a21f-44db-8ee3-f993811d00f1 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.059385 Aug 24 10:34:40.411155 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2007/4373] 10.222.0.85 () {58 vars in 1142 bytes} [Wed Aug 24 10:34:40 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:34:40.423730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-7464f4e0-153b-4b95-8f8a-b1bd67dddf0e req-563e4817-2c0a-4f53-ba0a-692f66a9a2c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0df3e3d-8b13-4314-9c1c-c99e81a23032", "name": "network-vif-plugged", "status": "completed", "tag": "987eb300-121e-4221-8d70-755c9e215d60"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:40.478903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7464f4e0-153b-4b95-8f8a-b1bd67dddf0e req-563e4817-2c0a-4f53-ba0a-692f66a9a2c8 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:40.480000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7464f4e0-153b-4b95-8f8a-b1bd67dddf0e req-563e4817-2c0a-4f53-ba0a-692f66a9a2c8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:40.480966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7464f4e0-153b-4b95-8f8a-b1bd67dddf0e req-563e4817-2c0a-4f53-ba0a-692f66a9a2c8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:40.537749 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7464f4e0-153b-4b95-8f8a-b1bd67dddf0e req-563e4817-2c0a-4f53-ba0a-692f66a9a2c8 service nova] Creating event network-vif-plugged:987eb300-121e-4221-8d70-755c9e215d60 for instance b0df3e3d-8b13-4314-9c1c-c99e81a23032 on n-h1-849328-3 Aug 24 10:34:40.552522 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-7464f4e0-153b-4b95-8f8a-b1bd67dddf0e req-563e4817-2c0a-4f53-ba0a-692f66a9a2c8 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139193 Aug 24 10:34:40.554147 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2008/4374] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:34:40.571626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-57588532-02ca-43fc-9856-dc410a949b70 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-57588532-02ca-43fc-9856-dc410a949b70 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Request method failure captured: Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf6G_Fl6Po5an1sxvvBt-NOd-lkU5xtt3khMYQcTevCswytc4yiSiFEsMwcGccArMe_H16sXVBuFm-9HylsHCgsOHeGuvBcoZjDAvqeCrxKeOihRVqGGIerXIzoGn7Z6miOEVC1oTm6PoJG9366G4jD2pjLn8j_4TJgO35KWbkeDbhY Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 070259159f48477787b16ce6ba8f75bd Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ListServersNegativeTestJSON-1321955027 Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/070259159f48477787b16ce6ba8f75bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_070259159f48477787b16ce6ba8f75bd", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/070259159f48477787b16ce6ba8f75bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/070259159f48477787b16ce6ba8f75bd"}]}] Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ListServersNegativeTestJSON-1321955027 Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 070259159f48477787b16ce6ba8f75bd Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1321955027 Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ListServersNegativeTestJSON-1321955027-project Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 99b9e0c2673344f2a705f7a64c67647f Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ListServersNegativeTestJSON-1321955027-project Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: action_args: {} Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'testing' Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 24 10:34:40.579069 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 24 10:34:40.588945 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:34:40.588945 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:34:40.588945 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:34:40.588945 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:34:40.588945 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 24 10:34:40.588945 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:40.588945 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:34:40.588945 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:40.588945 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:40.588945 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:34:40.588945 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:34:40.588945 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:34:40.588945 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:34:40.588945 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 24 10:34:40.588945 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:40.593088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-57588532-02ca-43fc-9856-dc410a949b70 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:34:40.594388 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-57588532-02ca-43fc-9856-dc410a949b70 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.038417 Aug 24 10:34:40.597189 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2009/4375] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:34:40 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:34:40.633612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-45aaa921-4d1e-43f7-a4b9-295a35028a5c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:40.640429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-45aaa921-4d1e-43f7-a4b9-295a35028a5c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:40.641762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-45aaa921-4d1e-43f7-a4b9-295a35028a5c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '070259159f48477787b16ce6ba8f75bd'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:34:40.662394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.compute.servers [None req-45aaa921-4d1e-43f7-a4b9-295a35028a5c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Flavor 'non_existing_flavor' could not be found {{(pid=122432) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 24 10:34:40.664046 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-45aaa921-4d1e-43f7-a4b9-295a35028a5c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.059294 Aug 24 10:34:40.665287 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2010/4376] 10.222.0.85 () {58 vars in 1178 bytes} [Wed Aug 24 10:34:40 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:34:40.684371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dec9dac0-9282-40b4-80eb-dfb1f8732db9 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:40.690256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dec9dac0-9282-40b4-80eb-dfb1f8732db9 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:40.700036 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dec9dac0-9282-40b4-80eb-dfb1f8732db9 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '070259159f48477787b16ce6ba8f75bd'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:34:40.711454 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dec9dac0-9282-40b4-80eb-dfb1f8732db9 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:40.722556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dec9dac0-9282-40b4-80eb-dfb1f8732db9 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:40.723983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dec9dac0-9282-40b4-80eb-dfb1f8732db9 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:40.725753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dec9dac0-9282-40b4-80eb-dfb1f8732db9 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:40.726962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dec9dac0-9282-40b4-80eb-dfb1f8732db9 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:40.731484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dec9dac0-9282-40b4-80eb-dfb1f8732db9 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:40.991506 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dec9dac0-9282-40b4-80eb-dfb1f8732db9 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.311965 Aug 24 10:34:40.996250 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2011/4377] 10.222.0.85 () {58 vars in 1174 bytes} [Wed Aug 24 10:34:40 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 10:34:41.032201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9bfa25c6-2342-4242-8171-e1f14e5ddf63 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:41.050421 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9bfa25c6-2342-4242-8171-e1f14e5ddf63 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:41.078455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9bfa25c6-2342-4242-8171-e1f14e5ddf63 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:41.084673 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9bfa25c6-2342-4242-8171-e1f14e5ddf63 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:41.086029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9bfa25c6-2342-4242-8171-e1f14e5ddf63 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:41.087341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9bfa25c6-2342-4242-8171-e1f14e5ddf63 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:41.088387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9bfa25c6-2342-4242-8171-e1f14e5ddf63 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:41.102227 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9bfa25c6-2342-4242-8171-e1f14e5ddf63 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:41.844836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c4722184-ded1-4572-9611-81f04a21d70d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbd482dde84ddb85ea4be9814dd5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca3a4feff2429b8b8b04a3d2a4175d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:41.856936 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c4722184-ded1-4572-9611-81f04a21d70d tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] 10.222.0.85 "GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea" status: 200 len: 1314 microversion: 2.1 time: 1.622741 Aug 24 10:34:41.881220 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2367/4378] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:40 2022] GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea => generated 1314 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:41.888874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1dae435e-f27c-4a98-881c-8bdea9382f17 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:41.888874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1dae435e-f27c-4a98-881c-8bdea9382f17 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:41.935902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dae435e-f27c-4a98-881c-8bdea9382f17 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:41.936465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dae435e-f27c-4a98-881c-8bdea9382f17 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:41.937010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dae435e-f27c-4a98-881c-8bdea9382f17 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:41.937818 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dae435e-f27c-4a98-881c-8bdea9382f17 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:41.938285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dae435e-f27c-4a98-881c-8bdea9382f17 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:41.938927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dae435e-f27c-4a98-881c-8bdea9382f17 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:42.111799 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9bfa25c6-2342-4242-8171-e1f14e5ddf63 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:42.128172 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9bfa25c6-2342-4242-8171-e1f14e5ddf63 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1519 microversion: 2.1 time: 1.129712 Aug 24 10:34:42.137634 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2012/4379] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:40 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1519 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:42.147205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d726fd4d-da66-4d98-9c45-cca12cd59fd9 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:42.190493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d726fd4d-da66-4d98-9c45-cca12cd59fd9 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:42.210710 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d726fd4d-da66-4d98-9c45-cca12cd59fd9 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '070259159f48477787b16ce6ba8f75bd'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:34:42.235017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d726fd4d-da66-4d98-9c45-cca12cd59fd9 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:42.240024 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d726fd4d-da66-4d98-9c45-cca12cd59fd9 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:42.241763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d726fd4d-da66-4d98-9c45-cca12cd59fd9 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:42.243662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d726fd4d-da66-4d98-9c45-cca12cd59fd9 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:42.254140 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d726fd4d-da66-4d98-9c45-cca12cd59fd9 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:42.255421 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d726fd4d-da66-4d98-9c45-cca12cd59fd9 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:42.409855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1dae435e-f27c-4a98-881c-8bdea9382f17 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:42.422082 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1dae435e-f27c-4a98-881c-8bdea9382f17 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1682 microversion: 2.1 time: 0.553978 Aug 24 10:34:42.441682 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2368/4380] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:41 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1682 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:42.454021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1aaaf2b4-791e-4e98-90ae-2761823beab9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:42.455219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1aaaf2b4-791e-4e98-90ae-2761823beab9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] [instance: b0df3e3d-8b13-4314-9c1c-c99e81a23032] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:42.470474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aaaf2b4-791e-4e98-90ae-2761823beab9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:42.471333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aaaf2b4-791e-4e98-90ae-2761823beab9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:42.472516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aaaf2b4-791e-4e98-90ae-2761823beab9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:42.484916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aaaf2b4-791e-4e98-90ae-2761823beab9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:42.508665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aaaf2b4-791e-4e98-90ae-2761823beab9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:42.510122 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aaaf2b4-791e-4e98-90ae-2761823beab9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:42.581855 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d726fd4d-da66-4d98-9c45-cca12cd59fd9 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.438794 Aug 24 10:34:42.597465 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2013/4381] 10.222.0.85 () {58 vars in 1184 bytes} [Wed Aug 24 10:34:42 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:34:42.612946 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-15a7d837-e5a2-4339-b37a-ea3c46afb4ec tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:42.633359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-15a7d837-e5a2-4339-b37a-ea3c46afb4ec tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:42.637092 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-15a7d837-e5a2-4339-b37a-ea3c46afb4ec tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Searching by: {'deleted': False, 'project_id': '070259159f48477787b16ce6ba8f75bd'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:34:42.653016 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15a7d837-e5a2-4339-b37a-ea3c46afb4ec tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:42.653983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15a7d837-e5a2-4339-b37a-ea3c46afb4ec tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:42.653983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15a7d837-e5a2-4339-b37a-ea3c46afb4ec tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:42.654940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15a7d837-e5a2-4339-b37a-ea3c46afb4ec tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:42.655470 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15a7d837-e5a2-4339-b37a-ea3c46afb4ec tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:42.656605 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15a7d837-e5a2-4339-b37a-ea3c46afb4ec tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:42.690714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:42.698287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-15a7d837-e5a2-4339-b37a-ea3c46afb4ec tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:34:42.793083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-15a7d837-e5a2-4339-b37a-ea3c46afb4ec tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:42.816567 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15a7d837-e5a2-4339-b37a-ea3c46afb4ec tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:42.817473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15a7d837-e5a2-4339-b37a-ea3c46afb4ec tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:42.818508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15a7d837-e5a2-4339-b37a-ea3c46afb4ec tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:42.898373 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1aaaf2b4-791e-4e98-90ae-2761823beab9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe66c7282c84f0fa2011575403c42d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf76463a8af45aaa6aa2c630bdcbb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:42.910925 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1aaaf2b4-791e-4e98-90ae-2761823beab9 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] 10.222.0.85 "GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032" status: 200 len: 1352 microversion: 2.1 time: 0.467458 Aug 24 10:34:42.911945 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2369/4382] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:42 2022] GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032 => generated 1352 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:42.917236 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9d37b4e6-d004-4658-9ed9-d5a3be97ee05 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:42.918075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9d37b4e6-d004-4658-9ed9-d5a3be97ee05 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] [instance: 253f9d94-6076-4696-8388-cc5be65d66ea] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:42.925736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d37b4e6-d004-4658-9ed9-d5a3be97ee05 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:42.926435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d37b4e6-d004-4658-9ed9-d5a3be97ee05 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:42.927145 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d37b4e6-d004-4658-9ed9-d5a3be97ee05 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:42.927810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d37b4e6-d004-4658-9ed9-d5a3be97ee05 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:42.928483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d37b4e6-d004-4658-9ed9-d5a3be97ee05 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:42.928952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d37b4e6-d004-4658-9ed9-d5a3be97ee05 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:43.258304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9d37b4e6-d004-4658-9ed9-d5a3be97ee05 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbd482dde84ddb85ea4be9814dd5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca3a4feff2429b8b8b04a3d2a4175d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:43.270044 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9d37b4e6-d004-4658-9ed9-d5a3be97ee05 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] 10.222.0.85 "GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea" status: 200 len: 1464 microversion: 2.1 time: 0.356905 Aug 24 10:34:43.323121 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2370/4383] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:42 2022] GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea => generated 1464 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:43.368004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-23d962f1-e7dc-4a79-944b-c53ab7b6f87d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:43.374302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-23d962f1-e7dc-4a79-944b-c53ab7b6f87d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:43.422623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23d962f1-e7dc-4a79-944b-c53ab7b6f87d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:43.423876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23d962f1-e7dc-4a79-944b-c53ab7b6f87d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:43.424578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23d962f1-e7dc-4a79-944b-c53ab7b6f87d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:43.425816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23d962f1-e7dc-4a79-944b-c53ab7b6f87d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:43.426501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23d962f1-e7dc-4a79-944b-c53ab7b6f87d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:43.427391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23d962f1-e7dc-4a79-944b-c53ab7b6f87d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:43.823804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-23d962f1-e7dc-4a79-944b-c53ab7b6f87d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:43.825506 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-15a7d837-e5a2-4339-b37a-ea3c46afb4ec tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 1.226479 Aug 24 10:34:43.826812 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2014/4384] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:34:42 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:43.833798 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-99d77853-9512-4ff3-bfca-65f49b60e59e tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26f9fcc8-163c-45ff-b245-20b271fef649", "device": "/dev/sdb"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:43.840627 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-99d77853-9512-4ff3-bfca-65f49b60e59e tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] [instance: 253f9d94-6076-4696-8388-cc5be65d66ea] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:43.858243 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-23d962f1-e7dc-4a79-944b-c53ab7b6f87d tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1519 microversion: 2.1 time: 0.533337 Aug 24 10:34:43.879923 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2371/4385] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:43 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1519 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:43.889717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c1807a20-6e48-4ff1-aa14-f695a96f8897 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:43.891470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c1807a20-6e48-4ff1-aa14-f695a96f8897 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:43.900155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99d77853-9512-4ff3-bfca-65f49b60e59e tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:43.903771 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99d77853-9512-4ff3-bfca-65f49b60e59e tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.043s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:43.906577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99d77853-9512-4ff3-bfca-65f49b60e59e tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:43.907632 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99d77853-9512-4ff3-bfca-65f49b60e59e tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:43.912605 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99d77853-9512-4ff3-bfca-65f49b60e59e tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:43.913082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99d77853-9512-4ff3-bfca-65f49b60e59e tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:43.922626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1807a20-6e48-4ff1-aa14-f695a96f8897 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:43.923603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1807a20-6e48-4ff1-aa14-f695a96f8897 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:43.923876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1807a20-6e48-4ff1-aa14-f695a96f8897 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:43.924856 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1807a20-6e48-4ff1-aa14-f695a96f8897 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:43.925532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1807a20-6e48-4ff1-aa14-f695a96f8897 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:43.926176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1807a20-6e48-4ff1-aa14-f695a96f8897 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:44.381065 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c1807a20-6e48-4ff1-aa14-f695a96f8897 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:44.409315 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c1807a20-6e48-4ff1-aa14-f695a96f8897 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1682 microversion: 2.1 time: 0.529907 Aug 24 10:34:44.410512 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2372/4386] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:43 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1682 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:44.457071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2668faef-f385-443f-9ab6-b29872635fea tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:44.499158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2668faef-f385-443f-9ab6-b29872635fea tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:44.515974 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2668faef-f385-443f-9ab6-b29872635fea tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.061839 Aug 24 10:34:44.517924 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2373/4387] 10.222.0.85 () {58 vars in 1178 bytes} [Wed Aug 24 10:34:44 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:34:44.533603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c728fbcd-6a9d-46e8-b09a-31b467ce4817 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:44.534624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c728fbcd-6a9d-46e8-b09a-31b467ce4817 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] [instance: b0df3e3d-8b13-4314-9c1c-c99e81a23032] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:44.549030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c728fbcd-6a9d-46e8-b09a-31b467ce4817 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:44.549952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c728fbcd-6a9d-46e8-b09a-31b467ce4817 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:44.550605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c728fbcd-6a9d-46e8-b09a-31b467ce4817 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:44.564430 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c728fbcd-6a9d-46e8-b09a-31b467ce4817 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:44.564654 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-99d77853-9512-4ff3-bfca-65f49b60e59e tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] 10.222.0.85 "POST /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.735659 Aug 24 10:34:44.565857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c728fbcd-6a9d-46e8-b09a-31b467ce4817 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:44.566529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c728fbcd-6a9d-46e8-b09a-31b467ce4817 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:44.574630 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2015/4388] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Aug 24 10:34:43 2022] POST /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea/os-volume_attachments => generated 194 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:34:44.602158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6777947e-a4a3-4886-bd53-7fa6d5a1f570 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:44.629361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6777947e-a4a3-4886-bd53-7fa6d5a1f570 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:44.631254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6777947e-a4a3-4886-bd53-7fa6d5a1f570 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Searching by: {'deleted': False, 'project_id': '070259159f48477787b16ce6ba8f75bd'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:34:44.652215 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6777947e-a4a3-4886-bd53-7fa6d5a1f570 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:44.653780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6777947e-a4a3-4886-bd53-7fa6d5a1f570 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:44.654937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6777947e-a4a3-4886-bd53-7fa6d5a1f570 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:44.656893 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6777947e-a4a3-4886-bd53-7fa6d5a1f570 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:44.659378 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6777947e-a4a3-4886-bd53-7fa6d5a1f570 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:44.660000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6777947e-a4a3-4886-bd53-7fa6d5a1f570 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:44.753183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-6777947e-a4a3-4886-bd53-7fa6d5a1f570 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:34:44.862745 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6777947e-a4a3-4886-bd53-7fa6d5a1f570 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.285953 Aug 24 10:34:44.876975 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2016/4389] 10.222.0.85 () {58 vars in 1125 bytes} [Wed Aug 24 10:34:44 2022] GET /compute/v2.1/servers => generated 683 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:34:44.883609 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-568c8559-0394-4b35-bd63-dc59b50d8fe3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:44.884550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-568c8559-0394-4b35-bd63-dc59b50d8fe3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:44.897511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-568c8559-0394-4b35-bd63-dc59b50d8fe3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:44.899071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-568c8559-0394-4b35-bd63-dc59b50d8fe3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:44.900321 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-568c8559-0394-4b35-bd63-dc59b50d8fe3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:44.901872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-568c8559-0394-4b35-bd63-dc59b50d8fe3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:44.902941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-568c8559-0394-4b35-bd63-dc59b50d8fe3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:44.903764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-568c8559-0394-4b35-bd63-dc59b50d8fe3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:44.929762 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-568c8559-0394-4b35-bd63-dc59b50d8fe3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] HTTP exception thrown: Instance 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 could not be found. Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-568c8559-0394-4b35-bd63-dc59b50d8fe3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Request method failure captured: Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 HTTP/1.1 Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf6G_Fl6Po5an1sxvvBt-NOd-lkU5xtt3khMYQcTevCswytc4yiSiFEsMwcGccArMe_H16sXVBuFm-9HylsHCgsOHeGuvBcoZjDAvqeCrxKeOihRVqGGIerXIzoGn7Z6miOEVC1oTm6PoJG9366G4jD2pjLn8j_4TJgO35KWbkeDbhY Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 070259159f48477787b16ce6ba8f75bd Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ListServersNegativeTestJSON-1321955027 Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/070259159f48477787b16ce6ba8f75bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_070259159f48477787b16ce6ba8f75bd", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/070259159f48477787b16ce6ba8f75bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/070259159f48477787b16ce6ba8f75bd"}]}] Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ListServersNegativeTestJSON-1321955027 Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 070259159f48477787b16ce6ba8f75bd Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1321955027 Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ListServersNegativeTestJSON-1321955027-project Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 99b9e0c2673344f2a705f7a64c67647f Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ListServersNegativeTestJSON-1321955027-project Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 could not be found. Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6'} Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 could not be found. Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:34:44.936286 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:34:44.943528 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 could not be found. Aug 24 10:34:44.943528 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:44.943528 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:34:44.943528 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:44.943528 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:44.943528 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:34:44.943528 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:34:44.943528 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:34:44.943528 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:34:44.943528 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 could not be found. Aug 24 10:34:44.943528 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:44.952587 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-568c8559-0394-4b35-bd63-dc59b50d8fe3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Returning 404 to user: Instance 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:34:44.954534 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-568c8559-0394-4b35-bd63-dc59b50d8fe3 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "DELETE /compute/v2.1/servers/2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6" status: 404 len: 111 microversion: 2.1 time: 0.075732 Aug 24 10:34:44.963791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c728fbcd-6a9d-46e8-b09a-31b467ce4817 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe66c7282c84f0fa2011575403c42d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf76463a8af45aaa6aa2c630bdcbb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:44.964755 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2017/4390] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:34:44 2022] DELETE /compute/v2.1/servers/2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:34:44.973676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-24e8b128-99de-421e-a60d-820439cfa6ce tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:44.974972 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-24e8b128-99de-421e-a60d-820439cfa6ce tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:44.980978 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c728fbcd-6a9d-46e8-b09a-31b467ce4817 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] 10.222.0.85 "GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032" status: 200 len: 1540 microversion: 2.1 time: 0.460212 Aug 24 10:34:44.981484 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2374/4391] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:44 2022] GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032 => generated 1540 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:44.988369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24e8b128-99de-421e-a60d-820439cfa6ce tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:44.990332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24e8b128-99de-421e-a60d-820439cfa6ce tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:44.991495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24e8b128-99de-421e-a60d-820439cfa6ce tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:44.993225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24e8b128-99de-421e-a60d-820439cfa6ce tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:44.996419 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24e8b128-99de-421e-a60d-820439cfa6ce tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:44.998071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24e8b128-99de-421e-a60d-820439cfa6ce tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:45.013570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c7262e85-11cc-4f74-9483-86a841d60718 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:45.015928 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c7262e85-11cc-4f74-9483-86a841d60718 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: b46db21c-fd73-4f03-958c-da10e32c008c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:45.044984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7262e85-11cc-4f74-9483-86a841d60718 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:45.045573 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7262e85-11cc-4f74-9483-86a841d60718 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:45.047461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7262e85-11cc-4f74-9483-86a841d60718 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:45.048275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7262e85-11cc-4f74-9483-86a841d60718 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:45.048827 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7262e85-11cc-4f74-9483-86a841d60718 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:45.049299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7262e85-11cc-4f74-9483-86a841d60718 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:45.114990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c7262e85-11cc-4f74-9483-86a841d60718 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: b46db21c-fd73-4f03-958c-da10e32c008c] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:34:45.363912 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c7262e85-11cc-4f74-9483-86a841d60718 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b46db21c-fd73-4f03-958c-da10e32c008c" status: 204 len: 0 microversion: 2.1 time: 0.373156 Aug 24 10:34:45.383803 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2375/4392] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:34:44 2022] DELETE /compute/v2.1/servers/b46db21c-fd73-4f03-958c-da10e32c008c => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:34:45.425705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c9e3a6d9-1f2a-4412-884d-ba295557ba5d tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:45.432346 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c9e3a6d9-1f2a-4412-884d-ba295557ba5d tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] [instance: b0df3e3d-8b13-4314-9c1c-c99e81a23032] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:45.476621 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9e3a6d9-1f2a-4412-884d-ba295557ba5d tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:45.484319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9e3a6d9-1f2a-4412-884d-ba295557ba5d tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:45.495713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9e3a6d9-1f2a-4412-884d-ba295557ba5d tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:45.504480 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9e3a6d9-1f2a-4412-884d-ba295557ba5d tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:45.505681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9e3a6d9-1f2a-4412-884d-ba295557ba5d tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:45.510021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9e3a6d9-1f2a-4412-884d-ba295557ba5d tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:45.772688 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c9e3a6d9-1f2a-4412-884d-ba295557ba5d tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] 10.222.0.85 "GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.386772 Aug 24 10:34:45.792931 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2376/4393] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Aug 24 10:34:45 2022] GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032/os-interface => generated 284 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:34:45.834838 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-883d6f86-b52a-401c-b385-dc315dcc48a1 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:45.835360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-883d6f86-b52a-401c-b385-dc315dcc48a1 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: fcb9a7a5-d263-4304-bb5a-d94b5414c2c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:45.888979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-883d6f86-b52a-401c-b385-dc315dcc48a1 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:45.898887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-883d6f86-b52a-401c-b385-dc315dcc48a1 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:45.904203 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-883d6f86-b52a-401c-b385-dc315dcc48a1 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:45.911191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-883d6f86-b52a-401c-b385-dc315dcc48a1 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:45.914400 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-883d6f86-b52a-401c-b385-dc315dcc48a1 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:45.914400 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-883d6f86-b52a-401c-b385-dc315dcc48a1 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:46.016535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-24e8b128-99de-421e-a60d-820439cfa6ce tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:46.038816 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-24e8b128-99de-421e-a60d-820439cfa6ce tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1519 microversion: 2.1 time: 1.075538 Aug 24 10:34:46.045238 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2018/4394] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:44 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1519 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:46.049011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-883d6f86-b52a-401c-b385-dc315dcc48a1 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: fcb9a7a5-d263-4304-bb5a-d94b5414c2c4] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:34:46.060013 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-031dd74c-67f5-4885-b2a9-629a9ef5a410 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:46.066778 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-031dd74c-67f5-4885-b2a9-629a9ef5a410 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:46.088338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-031dd74c-67f5-4885-b2a9-629a9ef5a410 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:46.089105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-031dd74c-67f5-4885-b2a9-629a9ef5a410 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:46.091908 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-031dd74c-67f5-4885-b2a9-629a9ef5a410 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:46.093566 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-031dd74c-67f5-4885-b2a9-629a9ef5a410 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:46.094075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-031dd74c-67f5-4885-b2a9-629a9ef5a410 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:46.094514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-031dd74c-67f5-4885-b2a9-629a9ef5a410 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:46.185676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:46.348260 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-883d6f86-b52a-401c-b385-dc315dcc48a1 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "DELETE /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4" status: 204 len: 0 microversion: 2.1 time: 0.552773 Aug 24 10:34:46.352023 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2377/4395] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:34:45 2022] DELETE /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:34:46.376304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f8ad36d7-4a7f-4f58-a7b1-67520073822c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:46.379732 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f8ad36d7-4a7f-4f58-a7b1-67520073822c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:46.413787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8ad36d7-4a7f-4f58-a7b1-67520073822c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:46.420939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8ad36d7-4a7f-4f58-a7b1-67520073822c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:46.423631 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8ad36d7-4a7f-4f58-a7b1-67520073822c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:46.425685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8ad36d7-4a7f-4f58-a7b1-67520073822c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:46.427447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8ad36d7-4a7f-4f58-a7b1-67520073822c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:46.431740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8ad36d7-4a7f-4f58-a7b1-67520073822c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:46.482523 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-f8ad36d7-4a7f-4f58-a7b1-67520073822c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] HTTP exception thrown: Instance 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 could not be found. Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f8ad36d7-4a7f-4f58-a7b1-67520073822c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Request method failure captured: Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 HTTP/1.1 Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf6G_Fl6Po5an1sxvvBt-NOd-lkU5xtt3khMYQcTevCswytc4yiSiFEsMwcGccArMe_H16sXVBuFm-9HylsHCgsOHeGuvBcoZjDAvqeCrxKeOihRVqGGIerXIzoGn7Z6miOEVC1oTm6PoJG9366G4jD2pjLn8j_4TJgO35KWbkeDbhY Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 070259159f48477787b16ce6ba8f75bd Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ListServersNegativeTestJSON-1321955027 Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/070259159f48477787b16ce6ba8f75bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_070259159f48477787b16ce6ba8f75bd", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/070259159f48477787b16ce6ba8f75bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/070259159f48477787b16ce6ba8f75bd"}]}] Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ListServersNegativeTestJSON-1321955027 Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 070259159f48477787b16ce6ba8f75bd Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1321955027 Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ListServersNegativeTestJSON-1321955027-project Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 99b9e0c2673344f2a705f7a64c67647f Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ListServersNegativeTestJSON-1321955027-project Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 could not be found. Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6'} Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 could not be found. Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 could not be found. Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:34:46.490111 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:34:46.494053 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:34:46.494053 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:46.494053 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:34:46.494053 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:34:46.494053 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:34:46.494053 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:34:46.494053 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 could not be found. Aug 24 10:34:46.494053 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:34:46.495595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f8ad36d7-4a7f-4f58-a7b1-67520073822c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Returning 404 to user: Instance 2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:34:46.500338 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f8ad36d7-4a7f-4f58-a7b1-67520073822c tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6" status: 404 len: 111 microversion: 2.1 time: 0.143135 Aug 24 10:34:46.505476 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2378/4396] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:46 2022] GET /compute/v2.1/servers/2ce54a6d-8aa4-4eb0-8e3d-a1fe8f7773a6 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:34:46.523467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2dace3b5-557f-42d9-83ca-d0b264becb56 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:46.530755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2dace3b5-557f-42d9-83ca-d0b264becb56 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: b46db21c-fd73-4f03-958c-da10e32c008c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:46.547133 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dace3b5-557f-42d9-83ca-d0b264becb56 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:46.550527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dace3b5-557f-42d9-83ca-d0b264becb56 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:46.551496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dace3b5-557f-42d9-83ca-d0b264becb56 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:46.557557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dace3b5-557f-42d9-83ca-d0b264becb56 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:46.558264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dace3b5-557f-42d9-83ca-d0b264becb56 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:46.558900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dace3b5-557f-42d9-83ca-d0b264becb56 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:47.015205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-031dd74c-67f5-4885-b2a9-629a9ef5a410 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:47.042350 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-031dd74c-67f5-4885-b2a9-629a9ef5a410 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1682 microversion: 2.1 time: 0.990925 Aug 24 10:34:47.048671 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2019/4397] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:46 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1682 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:47.077258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-637f9668-b6b7-4d6f-bd08-65304fe8a54c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:47.079898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-637f9668-b6b7-4d6f-bd08-65304fe8a54c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:47.121616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-637f9668-b6b7-4d6f-bd08-65304fe8a54c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:47.122399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-637f9668-b6b7-4d6f-bd08-65304fe8a54c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:47.123114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-637f9668-b6b7-4d6f-bd08-65304fe8a54c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:47.125736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-637f9668-b6b7-4d6f-bd08-65304fe8a54c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:47.136215 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-637f9668-b6b7-4d6f-bd08-65304fe8a54c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:47.138165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-637f9668-b6b7-4d6f-bd08-65304fe8a54c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:47.312829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2dace3b5-557f-42d9-83ca-d0b264becb56 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:47.376479 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2dace3b5-557f-42d9-83ca-d0b264becb56 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/b46db21c-fd73-4f03-958c-da10e32c008c" status: 200 len: 1522 microversion: 2.1 time: 0.864022 Aug 24 10:34:47.389161 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2379/4398] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:46 2022] GET /compute/v2.1/servers/b46db21c-fd73-4f03-958c-da10e32c008c => generated 1522 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:48.019599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-637f9668-b6b7-4d6f-bd08-65304fe8a54c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:48.039801 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-637f9668-b6b7-4d6f-bd08-65304fe8a54c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1519 microversion: 2.1 time: 0.969904 Aug 24 10:34:48.055802 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2020/4399] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:47 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1519 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:48.079090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8d6902e3-1d7f-478a-9823-51f6a107859b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:48.081635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8d6902e3-1d7f-478a-9823-51f6a107859b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:48.107239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d6902e3-1d7f-478a-9823-51f6a107859b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:48.107751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d6902e3-1d7f-478a-9823-51f6a107859b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:48.119449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d6902e3-1d7f-478a-9823-51f6a107859b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:48.120413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d6902e3-1d7f-478a-9823-51f6a107859b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:48.130535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d6902e3-1d7f-478a-9823-51f6a107859b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:48.131073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d6902e3-1d7f-478a-9823-51f6a107859b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:48.404136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b44b0db-2b35-448c-987f-8836cf1899a0 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:48.405446 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2b44b0db-2b35-448c-987f-8836cf1899a0 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: b46db21c-fd73-4f03-958c-da10e32c008c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:48.422121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b44b0db-2b35-448c-987f-8836cf1899a0 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:48.429010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b44b0db-2b35-448c-987f-8836cf1899a0 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:48.429773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b44b0db-2b35-448c-987f-8836cf1899a0 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:48.430817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b44b0db-2b35-448c-987f-8836cf1899a0 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:48.431442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b44b0db-2b35-448c-987f-8836cf1899a0 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:48.436384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b44b0db-2b35-448c-987f-8836cf1899a0 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:49.710919 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2b44b0db-2b35-448c-987f-8836cf1899a0 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:49.727097 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2b44b0db-2b35-448c-987f-8836cf1899a0 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/b46db21c-fd73-4f03-958c-da10e32c008c" status: 200 len: 1522 microversion: 2.1 time: 1.327430 Aug 24 10:34:49.741827 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2021/4400] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:48 2022] GET /compute/v2.1/servers/b46db21c-fd73-4f03-958c-da10e32c008c => generated 1522 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:34:49.745414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e57301ba-08b1-42da-b410-da840e77d387 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:49.746424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e57301ba-08b1-42da-b410-da840e77d387 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:49.778354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=86 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:49.780398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e57301ba-08b1-42da-b410-da840e77d387 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:49.780958 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e57301ba-08b1-42da-b410-da840e77d387 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:49.781724 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e57301ba-08b1-42da-b410-da840e77d387 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:49.782506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e57301ba-08b1-42da-b410-da840e77d387 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:49.782961 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e57301ba-08b1-42da-b410-da840e77d387 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:49.783396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e57301ba-08b1-42da-b410-da840e77d387 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:49.824468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8d6902e3-1d7f-478a-9823-51f6a107859b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:49.862689 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8d6902e3-1d7f-478a-9823-51f6a107859b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1682 microversion: 2.1 time: 1.790472 Aug 24 10:34:49.878175 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2380/4401] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:48 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1682 bytes in 1807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:50.380050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e57301ba-08b1-42da-b410-da840e77d387 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:50.390417 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e57301ba-08b1-42da-b410-da840e77d387 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1519 microversion: 2.1 time: 0.655527 Aug 24 10:34:50.391526 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2022/4402] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:49 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1519 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:50.722798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8fd23865-8e7c-4e01-b3d1-6b0481243b61 req-bfd5becf-d6d4-46e9-9d6f-8e4d95ecfefd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcb9a7a5-d263-4304-bb5a-d94b5414c2c4", "name": "network-vif-deleted", "tag": "099de0eb-77d4-4c7f-97de-c70bed7f573b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:50.728018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:50.756828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-69df8c78-df0c-48f7-a786-9e5db38589da tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:50.757602 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-69df8c78-df0c-48f7-a786-9e5db38589da tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: b46db21c-fd73-4f03-958c-da10e32c008c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:50.759487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8fd23865-8e7c-4e01-b3d1-6b0481243b61 req-bfd5becf-d6d4-46e9-9d6f-8e4d95ecfefd service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:50.765017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8fd23865-8e7c-4e01-b3d1-6b0481243b61 req-bfd5becf-d6d4-46e9-9d6f-8e4d95ecfefd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:50.768424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8fd23865-8e7c-4e01-b3d1-6b0481243b61 req-bfd5becf-d6d4-46e9-9d6f-8e4d95ecfefd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:50.782457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69df8c78-df0c-48f7-a786-9e5db38589da tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:50.785679 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69df8c78-df0c-48f7-a786-9e5db38589da tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:50.787746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69df8c78-df0c-48f7-a786-9e5db38589da tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:50.790739 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69df8c78-df0c-48f7-a786-9e5db38589da tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:50.794093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69df8c78-df0c-48f7-a786-9e5db38589da tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:50.796940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69df8c78-df0c-48f7-a786-9e5db38589da tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:50.806613 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8fd23865-8e7c-4e01-b3d1-6b0481243b61 req-bfd5becf-d6d4-46e9-9d6f-8e4d95ecfefd service nova] Creating event network-vif-deleted:099de0eb-77d4-4c7f-97de-c70bed7f573b for instance fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 on n-h1-849328-3 Aug 24 10:34:50.822670 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8fd23865-8e7c-4e01-b3d1-6b0481243b61 req-bfd5becf-d6d4-46e9-9d6f-8e4d95ecfefd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102201 Aug 24 10:34:50.826047 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2381/4403] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:34:50.905805 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6c3433e3-da22-4480-ae4c-b91bc1a55235 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:50.906767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6c3433e3-da22-4480-ae4c-b91bc1a55235 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:50.930154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c3433e3-da22-4480-ae4c-b91bc1a55235 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:50.931069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c3433e3-da22-4480-ae4c-b91bc1a55235 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:50.932164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c3433e3-da22-4480-ae4c-b91bc1a55235 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:50.935234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c3433e3-da22-4480-ae4c-b91bc1a55235 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:50.948950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c3433e3-da22-4480-ae4c-b91bc1a55235 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:50.954058 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c3433e3-da22-4480-ae4c-b91bc1a55235 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:51.258287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-69df8c78-df0c-48f7-a786-9e5db38589da tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:51.290182 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-69df8c78-df0c-48f7-a786-9e5db38589da tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/b46db21c-fd73-4f03-958c-da10e32c008c" status: 200 len: 1480 microversion: 2.1 time: 0.537241 Aug 24 10:34:51.295627 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2023/4404] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:50 2022] GET /compute/v2.1/servers/b46db21c-fd73-4f03-958c-da10e32c008c => generated 1480 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:51.418414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c6a33dea-aa18-4f86-a354-a8b5020d55af tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:51.419303 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c6a33dea-aa18-4f86-a354-a8b5020d55af tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:51.438961 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6a33dea-aa18-4f86-a354-a8b5020d55af tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:51.441368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6a33dea-aa18-4f86-a354-a8b5020d55af tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:51.442806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6a33dea-aa18-4f86-a354-a8b5020d55af tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:51.445796 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6a33dea-aa18-4f86-a354-a8b5020d55af tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:51.448185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6a33dea-aa18-4f86-a354-a8b5020d55af tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:51.450197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6a33dea-aa18-4f86-a354-a8b5020d55af tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:51.977429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c6a33dea-aa18-4f86-a354-a8b5020d55af tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:51.987803 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c6a33dea-aa18-4f86-a354-a8b5020d55af tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1519 microversion: 2.1 time: 0.572954 Aug 24 10:34:51.988790 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2024/4405] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:51 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1519 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:34:52.317353 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4168f99e-abc2-4b59-9d1a-005b31efe603 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:52.318370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4168f99e-abc2-4b59-9d1a-005b31efe603 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: b46db21c-fd73-4f03-958c-da10e32c008c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:52.348541 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4168f99e-abc2-4b59-9d1a-005b31efe603 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:52.355937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4168f99e-abc2-4b59-9d1a-005b31efe603 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:52.356821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4168f99e-abc2-4b59-9d1a-005b31efe603 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:52.357853 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4168f99e-abc2-4b59-9d1a-005b31efe603 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:52.363972 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4168f99e-abc2-4b59-9d1a-005b31efe603 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:52.365754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4168f99e-abc2-4b59-9d1a-005b31efe603 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:52.463676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4168f99e-abc2-4b59-9d1a-005b31efe603 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:52.464583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4168f99e-abc2-4b59-9d1a-005b31efe603 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:52.466805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4168f99e-abc2-4b59-9d1a-005b31efe603 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:52.467554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-4168f99e-abc2-4b59-9d1a-005b31efe603 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lazy-loading 'fault' on Instance uuid b46db21c-fd73-4f03-958c-da10e32c008c {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:34:52.628538 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4168f99e-abc2-4b59-9d1a-005b31efe603 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b9e0c2673344f2a705f7a64c67647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070259159f48477787b16ce6ba8f75bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:52.644839 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4168f99e-abc2-4b59-9d1a-005b31efe603 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/b46db21c-fd73-4f03-958c-da10e32c008c" status: 200 len: 1313 microversion: 2.1 time: 0.335313 Aug 24 10:34:52.652892 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2025/4406] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:52 2022] GET /compute/v2.1/servers/b46db21c-fd73-4f03-958c-da10e32c008c => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:34:52.835093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6c3433e3-da22-4480-ae4c-b91bc1a55235 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:52.848555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9d23eb0c-d4fc-42a3-9cd1-a57e5df0772a req-f9c8690c-01de-4537-9e1f-aed364129411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b46db21c-fd73-4f03-958c-da10e32c008c", "name": "network-vif-deleted", "tag": "229867ff-e48d-41b2-bbd8-410d730f178d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:52.875125 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6c3433e3-da22-4480-ae4c-b91bc1a55235 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1682 microversion: 2.1 time: 1.969510 Aug 24 10:34:52.881504 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2382/4407] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:50 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1682 bytes in 1983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:52.884721 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:52.890411 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9d23eb0c-d4fc-42a3-9cd1-a57e5df0772a req-f9c8690c-01de-4537-9e1f-aed364129411 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:52.896403 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9d23eb0c-d4fc-42a3-9cd1-a57e5df0772a req-f9c8690c-01de-4537-9e1f-aed364129411 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:52.899811 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9d23eb0c-d4fc-42a3-9cd1-a57e5df0772a req-f9c8690c-01de-4537-9e1f-aed364129411 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:52.955642 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9d23eb0c-d4fc-42a3-9cd1-a57e5df0772a req-f9c8690c-01de-4537-9e1f-aed364129411 service nova] Creating event network-vif-deleted:229867ff-e48d-41b2-bbd8-410d730f178d for instance b46db21c-fd73-4f03-958c-da10e32c008c on n-h2-849328-3 Aug 24 10:34:52.979703 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9d23eb0c-d4fc-42a3-9cd1-a57e5df0772a req-f9c8690c-01de-4537-9e1f-aed364129411 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131243 Aug 24 10:34:52.985494 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2026/4408] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:34:53.013317 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-17f1a4de-aba1-4afc-9cb1-cc3cf53dfc18 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:53.014476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-17f1a4de-aba1-4afc-9cb1-cc3cf53dfc18 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:53.027955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17f1a4de-aba1-4afc-9cb1-cc3cf53dfc18 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:53.030671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17f1a4de-aba1-4afc-9cb1-cc3cf53dfc18 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:53.033143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17f1a4de-aba1-4afc-9cb1-cc3cf53dfc18 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:53.034915 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17f1a4de-aba1-4afc-9cb1-cc3cf53dfc18 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:53.039599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17f1a4de-aba1-4afc-9cb1-cc3cf53dfc18 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:53.040712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17f1a4de-aba1-4afc-9cb1-cc3cf53dfc18 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:53.433163 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-249f4441-fadf-4b7c-9085-5405be682de7 req-b4047fec-d070-41dc-a851-a82bd2cbaf31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0df3e3d-8b13-4314-9c1c-c99e81a23032", "tag": "987eb300-121e-4221-8d70-755c9e215d60"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:34:53.459574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-249f4441-fadf-4b7c-9085-5405be682de7 req-b4047fec-d070-41dc-a851-a82bd2cbaf31 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:53.466394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-249f4441-fadf-4b7c-9085-5405be682de7 req-b4047fec-d070-41dc-a851-a82bd2cbaf31 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:53.467888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-249f4441-fadf-4b7c-9085-5405be682de7 req-b4047fec-d070-41dc-a851-a82bd2cbaf31 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:53.500248 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-249f4441-fadf-4b7c-9085-5405be682de7 req-b4047fec-d070-41dc-a851-a82bd2cbaf31 service nova] Creating event network-changed:987eb300-121e-4221-8d70-755c9e215d60 for instance b0df3e3d-8b13-4314-9c1c-c99e81a23032 on n-h1-849328-3 Aug 24 10:34:53.568411 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-249f4441-fadf-4b7c-9085-5405be682de7 req-b4047fec-d070-41dc-a851-a82bd2cbaf31 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132161 Aug 24 10:34:53.573041 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2027/4409] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:34:53.687465 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d7f04283-965d-4c99-b41f-c2ca2d5fe84b tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:53.688555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d7f04283-965d-4c99-b41f-c2ca2d5fe84b tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: b46db21c-fd73-4f03-958c-da10e32c008c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:53.722878 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7f04283-965d-4c99-b41f-c2ca2d5fe84b tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:53.723568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7f04283-965d-4c99-b41f-c2ca2d5fe84b tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:53.724039 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7f04283-965d-4c99-b41f-c2ca2d5fe84b tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:53.724795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7f04283-965d-4c99-b41f-c2ca2d5fe84b tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:53.725283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7f04283-965d-4c99-b41f-c2ca2d5fe84b tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:53.725713 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7f04283-965d-4c99-b41f-c2ca2d5fe84b tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:53.814629 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-d7f04283-965d-4c99-b41f-c2ca2d5fe84b tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] HTTP exception thrown: Instance b46db21c-fd73-4f03-958c-da10e32c008c could not be found. Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d7f04283-965d-4c99-b41f-c2ca2d5fe84b tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Request method failure captured: Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/b46db21c-fd73-4f03-958c-da10e32c008c HTTP/1.1 Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf6G_Fl6Po5an1sxvvBt-NOd-lkU5xtt3khMYQcTevCswytc4yiSiFEsMwcGccArMe_H16sXVBuFm-9HylsHCgsOHeGuvBcoZjDAvqeCrxKeOihRVqGGIerXIzoGn7Z6miOEVC1oTm6PoJG9366G4jD2pjLn8j_4TJgO35KWbkeDbhY Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 070259159f48477787b16ce6ba8f75bd Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ListServersNegativeTestJSON-1321955027 Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/070259159f48477787b16ce6ba8f75bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_070259159f48477787b16ce6ba8f75bd", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/070259159f48477787b16ce6ba8f75bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/070259159f48477787b16ce6ba8f75bd"}]}] Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ListServersNegativeTestJSON-1321955027 Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 070259159f48477787b16ce6ba8f75bd Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1321955027 Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ListServersNegativeTestJSON-1321955027-project Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 99b9e0c2673344f2a705f7a64c67647f Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ListServersNegativeTestJSON-1321955027-project Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance b46db21c-fd73-4f03-958c-da10e32c008c could not be found. Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'b46db21c-fd73-4f03-958c-da10e32c008c'} Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b46db21c-fd73-4f03-958c-da10e32c008c could not be found. Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b46db21c-fd73-4f03-958c-da10e32c008c could not be found. Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:53.820354 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:34:53.829051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:53.829051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:53.829051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:34:53.829051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:34:53.829051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:34:53.829051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:34:53.829051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b46db21c-fd73-4f03-958c-da10e32c008c could not be found. Aug 24 10:34:53.829051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:53.834256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d7f04283-965d-4c99-b41f-c2ca2d5fe84b tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Returning 404 to user: Instance b46db21c-fd73-4f03-958c-da10e32c008c could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:34:53.837478 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d7f04283-965d-4c99-b41f-c2ca2d5fe84b tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/b46db21c-fd73-4f03-958c-da10e32c008c" status: 404 len: 111 microversion: 2.1 time: 0.156378 Aug 24 10:34:53.845110 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2028/4410] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:53 2022] GET /compute/v2.1/servers/b46db21c-fd73-4f03-958c-da10e32c008c => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:34:53.855988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-75ac10bd-febf-4780-97e9-2858957f19f7 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:53.857635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-75ac10bd-febf-4780-97e9-2858957f19f7 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] [instance: fcb9a7a5-d263-4304-bb5a-d94b5414c2c4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:53.903340 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75ac10bd-febf-4780-97e9-2858957f19f7 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:53.904002 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-17f1a4de-aba1-4afc-9cb1-cc3cf53dfc18 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:53.905774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75ac10bd-febf-4780-97e9-2858957f19f7 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:53.908239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75ac10bd-febf-4780-97e9-2858957f19f7 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:53.910184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75ac10bd-febf-4780-97e9-2858957f19f7 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:53.911242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75ac10bd-febf-4780-97e9-2858957f19f7 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:53.912272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75ac10bd-febf-4780-97e9-2858957f19f7 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:53.914431 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-17f1a4de-aba1-4afc-9cb1-cc3cf53dfc18 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1519 microversion: 2.1 time: 0.905092 Aug 24 10:34:53.915070 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2383/4411] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:53 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1519 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:53.955821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7de6e9ff-08ec-452b-8ace-91c3ddea44b4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:53.956753 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-75ac10bd-febf-4780-97e9-2858957f19f7 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] HTTP exception thrown: Instance fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 could not be found. Aug 24 10:34:53.959242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7de6e9ff-08ec-452b-8ace-91c3ddea44b4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-75ac10bd-febf-4780-97e9-2858957f19f7 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Request method failure captured: Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 HTTP/1.1 Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf6G_Fl6Po5an1sxvvBt-NOd-lkU5xtt3khMYQcTevCswytc4yiSiFEsMwcGccArMe_H16sXVBuFm-9HylsHCgsOHeGuvBcoZjDAvqeCrxKeOihRVqGGIerXIzoGn7Z6miOEVC1oTm6PoJG9366G4jD2pjLn8j_4TJgO35KWbkeDbhY Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 070259159f48477787b16ce6ba8f75bd Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ListServersNegativeTestJSON-1321955027 Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/070259159f48477787b16ce6ba8f75bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_070259159f48477787b16ce6ba8f75bd", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/070259159f48477787b16ce6ba8f75bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/070259159f48477787b16ce6ba8f75bd"}]}] Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ListServersNegativeTestJSON-1321955027 Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 070259159f48477787b16ce6ba8f75bd Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1321955027 Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ListServersNegativeTestJSON-1321955027-project Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 99b9e0c2673344f2a705f7a64c67647f Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ListServersNegativeTestJSON-1321955027-project Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 could not be found. Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'fcb9a7a5-d263-4304-bb5a-d94b5414c2c4'} Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 could not be found. Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 could not be found. Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:53.961081 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:34:53.966195 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:53.966195 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:34:53.966195 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:34:53.966195 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:34:53.966195 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:34:53.966195 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:34:53.966195 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 could not be found. Aug 24 10:34:53.966195 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:34:53.968472 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-75ac10bd-febf-4780-97e9-2858957f19f7 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] Returning 404 to user: Instance fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:34:53.971689 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-75ac10bd-febf-4780-97e9-2858957f19f7 tempest-ListServersNegativeTestJSON-1321955027 tempest-ListServersNegativeTestJSON-1321955027-project] 10.222.0.85 "GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4" status: 404 len: 111 microversion: 2.1 time: 0.124589 Aug 24 10:34:53.974154 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2029/4412] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:53 2022] GET /compute/v2.1/servers/fcb9a7a5-d263-4304-bb5a-d94b5414c2c4 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:34:54.000363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7de6e9ff-08ec-452b-8ace-91c3ddea44b4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:54.001044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7de6e9ff-08ec-452b-8ace-91c3ddea44b4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:54.001635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7de6e9ff-08ec-452b-8ace-91c3ddea44b4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:54.002335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7de6e9ff-08ec-452b-8ace-91c3ddea44b4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:54.002922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7de6e9ff-08ec-452b-8ace-91c3ddea44b4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:54.003542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7de6e9ff-08ec-452b-8ace-91c3ddea44b4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:54.940492 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-34d27cdf-3e21-4930-abf0-01c96e4e6200 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:54.941137 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-34d27cdf-3e21-4930-abf0-01c96e4e6200 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:54.945706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:54.976376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34d27cdf-3e21-4930-abf0-01c96e4e6200 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:54.977238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34d27cdf-3e21-4930-abf0-01c96e4e6200 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:54.980414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34d27cdf-3e21-4930-abf0-01c96e4e6200 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:54.982271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34d27cdf-3e21-4930-abf0-01c96e4e6200 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:54.982937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34d27cdf-3e21-4930-abf0-01c96e4e6200 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:54.984195 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34d27cdf-3e21-4930-abf0-01c96e4e6200 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:55.069842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7de6e9ff-08ec-452b-8ace-91c3ddea44b4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:55.079592 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7de6e9ff-08ec-452b-8ace-91c3ddea44b4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1682 microversion: 2.1 time: 1.163376 Aug 24 10:34:55.091473 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2384/4413] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:53 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1682 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:55.402054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-34d27cdf-3e21-4930-abf0-01c96e4e6200 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:55.417594 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-34d27cdf-3e21-4930-abf0-01c96e4e6200 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1519 microversion: 2.1 time: 0.482344 Aug 24 10:34:55.430003 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2030/4414] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:54 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1519 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:56.103986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8f975019-461f-4045-8e43-70a0c9bb63d0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:56.106274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8f975019-461f-4045-8e43-70a0c9bb63d0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:56.119664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f975019-461f-4045-8e43-70a0c9bb63d0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:56.120161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f975019-461f-4045-8e43-70a0c9bb63d0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:56.120597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f975019-461f-4045-8e43-70a0c9bb63d0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:56.121346 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f975019-461f-4045-8e43-70a0c9bb63d0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:56.126911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f975019-461f-4045-8e43-70a0c9bb63d0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:56.127688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f975019-461f-4045-8e43-70a0c9bb63d0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:56.455280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-46f17721-6499-4e23-a20c-46349e8e0f32 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:56.456505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-46f17721-6499-4e23-a20c-46349e8e0f32 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:56.472738 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46f17721-6499-4e23-a20c-46349e8e0f32 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:56.477278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46f17721-6499-4e23-a20c-46349e8e0f32 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:56.480883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46f17721-6499-4e23-a20c-46349e8e0f32 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:56.482270 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46f17721-6499-4e23-a20c-46349e8e0f32 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:56.483187 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46f17721-6499-4e23-a20c-46349e8e0f32 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:56.484074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46f17721-6499-4e23-a20c-46349e8e0f32 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:56.750710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8f975019-461f-4045-8e43-70a0c9bb63d0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:56.775658 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8f975019-461f-4045-8e43-70a0c9bb63d0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1682 microversion: 2.1 time: 0.675394 Aug 24 10:34:56.785244 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2385/4415] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:56 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1682 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:56.952007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-46f17721-6499-4e23-a20c-46349e8e0f32 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:56.954617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:56.971158 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-46f17721-6499-4e23-a20c-46349e8e0f32 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1519 microversion: 2.1 time: 0.519650 Aug 24 10:34:56.979631 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2031/4416] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:56 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1519 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:57.816740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0b97ec2f-dd76-46d3-be49-2bdb87608b83 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:57.818103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0b97ec2f-dd76-46d3-be49-2bdb87608b83 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:57.830837 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b97ec2f-dd76-46d3-be49-2bdb87608b83 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:57.831508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b97ec2f-dd76-46d3-be49-2bdb87608b83 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:57.837922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b97ec2f-dd76-46d3-be49-2bdb87608b83 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:57.839206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b97ec2f-dd76-46d3-be49-2bdb87608b83 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:57.840026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b97ec2f-dd76-46d3-be49-2bdb87608b83 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:57.840794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b97ec2f-dd76-46d3-be49-2bdb87608b83 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:58.008909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32c19666-4cc7-4578-bcf0-ce97afe277de tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:58.009571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-32c19666-4cc7-4578-bcf0-ce97afe277de tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:58.023840 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32c19666-4cc7-4578-bcf0-ce97afe277de tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:58.024362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32c19666-4cc7-4578-bcf0-ce97afe277de tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:58.024805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32c19666-4cc7-4578-bcf0-ce97afe277de tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:58.032159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32c19666-4cc7-4578-bcf0-ce97afe277de tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:58.032925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32c19666-4cc7-4578-bcf0-ce97afe277de tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:58.033416 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32c19666-4cc7-4578-bcf0-ce97afe277de tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:58.352333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0b97ec2f-dd76-46d3-be49-2bdb87608b83 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:58.381321 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0b97ec2f-dd76-46d3-be49-2bdb87608b83 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.568957 Aug 24 10:34:58.382101 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2386/4417] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:57 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:34:58.535659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-33015b85-0e2b-49b2-a5bc-c643780c2572 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:58.536487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-33015b85-0e2b-49b2-a5bc-c643780c2572 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:58.546077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33015b85-0e2b-49b2-a5bc-c643780c2572 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:58.547628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33015b85-0e2b-49b2-a5bc-c643780c2572 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:58.548884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33015b85-0e2b-49b2-a5bc-c643780c2572 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:58.550012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33015b85-0e2b-49b2-a5bc-c643780c2572 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:58.551179 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33015b85-0e2b-49b2-a5bc-c643780c2572 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:58.552435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33015b85-0e2b-49b2-a5bc-c643780c2572 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:58.613712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-32c19666-4cc7-4578-bcf0-ce97afe277de tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:58.632099 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-32c19666-4cc7-4578-bcf0-ce97afe277de tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1519 microversion: 2.1 time: 0.627837 Aug 24 10:34:58.637105 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2032/4418] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:58 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1519 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:34:58.840563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-33015b85-0e2b-49b2-a5bc-c643780c2572 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:34:58.852988 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-33015b85-0e2b-49b2-a5bc-c643780c2572 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.325893 Aug 24 10:34:58.866059 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2387/4419] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:58 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:34:59.662482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-efa3af2d-5fc5-406b-9d3b-aec56c665e23 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:34:59.663117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-efa3af2d-5fc5-406b-9d3b-aec56c665e23 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:34:59.672583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-efa3af2d-5fc5-406b-9d3b-aec56c665e23 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:59.679999 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-efa3af2d-5fc5-406b-9d3b-aec56c665e23 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:59.680921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-efa3af2d-5fc5-406b-9d3b-aec56c665e23 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:34:59.682554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-efa3af2d-5fc5-406b-9d3b-aec56c665e23 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:34:59.684148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-efa3af2d-5fc5-406b-9d3b-aec56c665e23 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:34:59.684999 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-efa3af2d-5fc5-406b-9d3b-aec56c665e23 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:00.158851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-efa3af2d-5fc5-406b-9d3b-aec56c665e23 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:00.169354 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-efa3af2d-5fc5-406b-9d3b-aec56c665e23 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1519 microversion: 2.1 time: 0.512056 Aug 24 10:35:00.173754 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2033/4420] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:34:59 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1519 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:35:00.269067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-132af23b-e940-41a1-b2c0-e013d47186a4 req-347e65f7-9491-487e-86a4-9474a4ec421f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ed6211-b7fc-454f-a8e9-73ba571a71af", "name": "network-vif-unplugged", "status": "completed", "tag": "1c2608cb-c0ff-45d5-b7c5-82ff95cc5b0c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:00.301469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-132af23b-e940-41a1-b2c0-e013d47186a4 req-347e65f7-9491-487e-86a4-9474a4ec421f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:00.303139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-132af23b-e940-41a1-b2c0-e013d47186a4 req-347e65f7-9491-487e-86a4-9474a4ec421f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:00.303609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-132af23b-e940-41a1-b2c0-e013d47186a4 req-347e65f7-9491-487e-86a4-9474a4ec421f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:00.347356 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-132af23b-e940-41a1-b2c0-e013d47186a4 req-347e65f7-9491-487e-86a4-9474a4ec421f service nova] Creating event network-vif-unplugged:1c2608cb-c0ff-45d5-b7c5-82ff95cc5b0c for instance 99ed6211-b7fc-454f-a8e9-73ba571a71af on n-h1-849328-3 Aug 24 10:35:00.367637 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-132af23b-e940-41a1-b2c0-e013d47186a4 req-347e65f7-9491-487e-86a4-9474a4ec421f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103682 Aug 24 10:35:00.371157 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2388/4421] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:35:01.214760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-53165d8f-5fdf-4351-b4e0-ecddeb2fa787 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:01.215753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-53165d8f-5fdf-4351-b4e0-ecddeb2fa787 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:01.219023 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4b05a195-3f0c-4bbc-8777-c8b7c9f1af68 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:01.220420 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4b05a195-3f0c-4bbc-8777-c8b7c9f1af68 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:01.247814 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b05a195-3f0c-4bbc-8777-c8b7c9f1af68 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:01.248699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b05a195-3f0c-4bbc-8777-c8b7c9f1af68 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:01.249863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53165d8f-5fdf-4351-b4e0-ecddeb2fa787 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:01.257165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b05a195-3f0c-4bbc-8777-c8b7c9f1af68 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:01.258419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53165d8f-5fdf-4351-b4e0-ecddeb2fa787 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:01.258883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53165d8f-5fdf-4351-b4e0-ecddeb2fa787 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:01.259884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53165d8f-5fdf-4351-b4e0-ecddeb2fa787 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:01.260366 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53165d8f-5fdf-4351-b4e0-ecddeb2fa787 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:01.260813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53165d8f-5fdf-4351-b4e0-ecddeb2fa787 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:01.266165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b05a195-3f0c-4bbc-8777-c8b7c9f1af68 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:01.266749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b05a195-3f0c-4bbc-8777-c8b7c9f1af68 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:01.267078 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b05a195-3f0c-4bbc-8777-c8b7c9f1af68 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:01.680765 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-53165d8f-5fdf-4351-b4e0-ecddeb2fa787 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:01.701820 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-53165d8f-5fdf-4351-b4e0-ecddeb2fa787 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.504524 Aug 24 10:35:01.722683 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2389/4422] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:01 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:01.743116 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1dad6922-c4c1-4e1b-af12-d9fa8f5a58f7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:01.746056 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1dad6922-c4c1-4e1b-af12-d9fa8f5a58f7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:01.752137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:01.759730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dad6922-c4c1-4e1b-af12-d9fa8f5a58f7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:01.760433 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dad6922-c4c1-4e1b-af12-d9fa8f5a58f7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:01.764562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dad6922-c4c1-4e1b-af12-d9fa8f5a58f7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:01.767946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dad6922-c4c1-4e1b-af12-d9fa8f5a58f7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:01.777655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dad6922-c4c1-4e1b-af12-d9fa8f5a58f7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:01.778638 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dad6922-c4c1-4e1b-af12-d9fa8f5a58f7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:02.105474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1dad6922-c4c1-4e1b-af12-d9fa8f5a58f7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:02.116598 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1dad6922-c4c1-4e1b-af12-d9fa8f5a58f7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.382328 Aug 24 10:35:02.130947 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2390/4423] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:01 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:35:02.147031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f993f2a-5e6d-4d08-807f-95ee99b20f03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:02.148016 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0f993f2a-5e6d-4d08-807f-95ee99b20f03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:02.156165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f993f2a-5e6d-4d08-807f-95ee99b20f03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:02.157462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f993f2a-5e6d-4d08-807f-95ee99b20f03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:02.158156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f993f2a-5e6d-4d08-807f-95ee99b20f03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:02.160185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f993f2a-5e6d-4d08-807f-95ee99b20f03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:02.161422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f993f2a-5e6d-4d08-807f-95ee99b20f03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:02.162828 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f993f2a-5e6d-4d08-807f-95ee99b20f03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:02.492402 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0f993f2a-5e6d-4d08-807f-95ee99b20f03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:02.496312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4b05a195-3f0c-4bbc-8777-c8b7c9f1af68 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:02.522608 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4b05a195-3f0c-4bbc-8777-c8b7c9f1af68 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1519 microversion: 2.1 time: 1.326182 Aug 24 10:35:02.523585 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2034/4424] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:01 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1519 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:02.531032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-6503086e-c4eb-448a-ba42-4364a4dd402d req-98332800-cb51-4d43-acfe-d509b5d70cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fb1d6b5-a27c-465a-aa10-652d2cc366ae", "name": "network-vif-plugged", "status": "completed", "tag": "05c1a894-3c87-4d83-9b42-234ddedc80b0"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:02.542353 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0f993f2a-5e6d-4d08-807f-95ee99b20f03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.399111 Aug 24 10:35:02.550959 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2391/4425] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:02 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:02.551711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6503086e-c4eb-448a-ba42-4364a4dd402d req-98332800-cb51-4d43-acfe-d509b5d70cc2 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:02.552395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6503086e-c4eb-448a-ba42-4364a4dd402d req-98332800-cb51-4d43-acfe-d509b5d70cc2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:02.553006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6503086e-c4eb-448a-ba42-4364a4dd402d req-98332800-cb51-4d43-acfe-d509b5d70cc2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:02.576158 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-6503086e-c4eb-448a-ba42-4364a4dd402d req-98332800-cb51-4d43-acfe-d509b5d70cc2 service nova] Creating event network-vif-plugged:05c1a894-3c87-4d83-9b42-234ddedc80b0 for instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae on n-h1-849328-3 Aug 24 10:35:02.584679 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-6503086e-c4eb-448a-ba42-4364a4dd402d req-98332800-cb51-4d43-acfe-d509b5d70cc2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057709 Aug 24 10:35:02.584945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-387e4a36-82eb-406e-812b-f8cd392a9ebf tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:02.585107 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2035/4426] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:35:02.594912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-387e4a36-82eb-406e-812b-f8cd392a9ebf tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:02.614018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-387e4a36-82eb-406e-812b-f8cd392a9ebf tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:02.616216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-387e4a36-82eb-406e-812b-f8cd392a9ebf tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:02.618272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-387e4a36-82eb-406e-812b-f8cd392a9ebf tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:02.619374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-387e4a36-82eb-406e-812b-f8cd392a9ebf tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:02.620083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-387e4a36-82eb-406e-812b-f8cd392a9ebf tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:02.620757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-387e4a36-82eb-406e-812b-f8cd392a9ebf tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:02.791934 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-387e4a36-82eb-406e-812b-f8cd392a9ebf tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action" status: 202 len: 0 microversion: 2.1 time: 0.215365 Aug 24 10:35:02.801285 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2392/4427] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:35:02 2022] POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:35:02.806142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-77664457-9c58-4741-a4ea-3153e1e03b0c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:02.807280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-77664457-9c58-4741-a4ea-3153e1e03b0c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:02.841651 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77664457-9c58-4741-a4ea-3153e1e03b0c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:02.854755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77664457-9c58-4741-a4ea-3153e1e03b0c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:02.857398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77664457-9c58-4741-a4ea-3153e1e03b0c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:02.861076 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77664457-9c58-4741-a4ea-3153e1e03b0c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:02.864970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77664457-9c58-4741-a4ea-3153e1e03b0c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:02.867101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77664457-9c58-4741-a4ea-3153e1e03b0c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:03.241438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2a72ab23-251d-4185-8a7e-f816b148d632 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:03.242154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2a72ab23-251d-4185-8a7e-f816b148d632 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:03.265164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a72ab23-251d-4185-8a7e-f816b148d632 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:03.265628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a72ab23-251d-4185-8a7e-f816b148d632 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:03.273604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a72ab23-251d-4185-8a7e-f816b148d632 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:03.275063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a72ab23-251d-4185-8a7e-f816b148d632 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:03.276451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a72ab23-251d-4185-8a7e-f816b148d632 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:03.277569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a72ab23-251d-4185-8a7e-f816b148d632 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:03.450007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-77664457-9c58-4741-a4ea-3153e1e03b0c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:03.458919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-2a72ab23-251d-4185-8a7e-f816b148d632 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lazy-loading 'services' on Instance uuid 09f120f6-861a-4946-981b-47559a9c97fa {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:35:03.463478 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-77664457-9c58-4741-a4ea-3153e1e03b0c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1671 microversion: 2.1 time: 0.664093 Aug 24 10:35:03.478189 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2036/4428] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:02 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1671 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:35:03.568337 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:03.569082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-81c288ff-11ad-4226-9ee7-bfc520f4f190 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:03.570191 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-81c288ff-11ad-4226-9ee7-bfc520f4f190 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:03.579239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81c288ff-11ad-4226-9ee7-bfc520f4f190 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:03.579680 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2a72ab23-251d-4185-8a7e-f816b148d632 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "DELETE /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-volume_attachments/f78f5687-cfbe-4e6b-996b-652d2f6c0c64" status: 202 len: 0 microversion: 2.1 time: 0.345446 Aug 24 10:35:03.580022 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81c288ff-11ad-4226-9ee7-bfc520f4f190 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:03.580529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81c288ff-11ad-4226-9ee7-bfc520f4f190 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:03.581242 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2393/4429] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Aug 24 10:35:03 2022] DELETE /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-volume_attachments/f78f5687-cfbe-4e6b-996b-652d2f6c0c64 => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:35:03.581744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81c288ff-11ad-4226-9ee7-bfc520f4f190 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:03.582313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81c288ff-11ad-4226-9ee7-bfc520f4f190 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:03.582803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81c288ff-11ad-4226-9ee7-bfc520f4f190 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:03.597861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c656b940-b78e-4df7-a08d-66765afff150 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:03.605043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c656b940-b78e-4df7-a08d-66765afff150 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:03.629320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c656b940-b78e-4df7-a08d-66765afff150 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:03.630086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c656b940-b78e-4df7-a08d-66765afff150 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:03.630548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c656b940-b78e-4df7-a08d-66765afff150 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:03.633648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c656b940-b78e-4df7-a08d-66765afff150 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:03.635020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c656b940-b78e-4df7-a08d-66765afff150 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:03.636409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c656b940-b78e-4df7-a08d-66765afff150 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:03.702496 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c656b940-b78e-4df7-a08d-66765afff150 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114622 Aug 24 10:35:03.705303 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2394/4430] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:35:03 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:35:03.946376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-81c288ff-11ad-4226-9ee7-bfc520f4f190 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:03.956218 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-81c288ff-11ad-4226-9ee7-bfc520f4f190 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1519 microversion: 2.1 time: 0.395564 Aug 24 10:35:03.958196 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2037/4431] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:03 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1519 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:04.484501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-37d8dea0-24d7-453f-9b13-12b4d2ad9d41 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:04.485156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-37d8dea0-24d7-453f-9b13-12b4d2ad9d41 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:04.555299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37d8dea0-24d7-453f-9b13-12b4d2ad9d41 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:04.555821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37d8dea0-24d7-453f-9b13-12b4d2ad9d41 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:04.556263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37d8dea0-24d7-453f-9b13-12b4d2ad9d41 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:04.556988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37d8dea0-24d7-453f-9b13-12b4d2ad9d41 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:04.573871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37d8dea0-24d7-453f-9b13-12b4d2ad9d41 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:04.574457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37d8dea0-24d7-453f-9b13-12b4d2ad9d41 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:04.715399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-484ea625-5766-4b7d-9899-639a070e2e1d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:04.717930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-484ea625-5766-4b7d-9899-639a070e2e1d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:04.737851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-484ea625-5766-4b7d-9899-639a070e2e1d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:04.738412 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-484ea625-5766-4b7d-9899-639a070e2e1d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:04.738861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-484ea625-5766-4b7d-9899-639a070e2e1d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:04.740142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-484ea625-5766-4b7d-9899-639a070e2e1d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:04.742142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-484ea625-5766-4b7d-9899-639a070e2e1d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:04.743062 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-484ea625-5766-4b7d-9899-639a070e2e1d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:04.835481 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-484ea625-5766-4b7d-9899-639a070e2e1d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124296 Aug 24 10:35:04.845440 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2038/4432] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:35:04 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:35:04.982968 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-20aba883-61d7-45bc-90d7-5ff7f95980fa tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:04.983832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-20aba883-61d7-45bc-90d7-5ff7f95980fa tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:04.995971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20aba883-61d7-45bc-90d7-5ff7f95980fa tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:04.996633 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20aba883-61d7-45bc-90d7-5ff7f95980fa tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:04.997258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20aba883-61d7-45bc-90d7-5ff7f95980fa tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:04.997989 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20aba883-61d7-45bc-90d7-5ff7f95980fa tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:05.000685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20aba883-61d7-45bc-90d7-5ff7f95980fa tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:05.001193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20aba883-61d7-45bc-90d7-5ff7f95980fa tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:05.387088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-20aba883-61d7-45bc-90d7-5ff7f95980fa tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:05.397783 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-20aba883-61d7-45bc-90d7-5ff7f95980fa tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1519 microversion: 2.1 time: 0.419962 Aug 24 10:35:05.405199 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2039/4433] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:04 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1519 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:05.850739 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7a5e6263-f2c4-4cd6-b4b4-816bce52cc04 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:05.858636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7a5e6263-f2c4-4cd6-b4b4-816bce52cc04 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:05.879748 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a5e6263-f2c4-4cd6-b4b4-816bce52cc04 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:05.880516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a5e6263-f2c4-4cd6-b4b4-816bce52cc04 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:05.884061 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a5e6263-f2c4-4cd6-b4b4-816bce52cc04 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:05.885272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a5e6263-f2c4-4cd6-b4b4-816bce52cc04 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:05.888069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a5e6263-f2c4-4cd6-b4b4-816bce52cc04 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:05.888744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a5e6263-f2c4-4cd6-b4b4-816bce52cc04 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:05.996028 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7a5e6263-f2c4-4cd6-b4b4-816bce52cc04 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149728 Aug 24 10:35:05.997984 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2040/4434] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:35:05 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:35:06.090920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-37d8dea0-24d7-453f-9b13-12b4d2ad9d41 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:06.117202 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-37d8dea0-24d7-453f-9b13-12b4d2ad9d41 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1671 microversion: 2.1 time: 1.637135 Aug 24 10:35:06.131346 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2395/4435] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:04 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1671 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:06.443365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4846f219-1304-48a1-b82e-7546c82b279c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:06.446449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4846f219-1304-48a1-b82e-7546c82b279c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:06.464008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4846f219-1304-48a1-b82e-7546c82b279c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:06.465072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4846f219-1304-48a1-b82e-7546c82b279c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:06.467677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4846f219-1304-48a1-b82e-7546c82b279c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:06.472200 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4846f219-1304-48a1-b82e-7546c82b279c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:06.474281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4846f219-1304-48a1-b82e-7546c82b279c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:06.476590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4846f219-1304-48a1-b82e-7546c82b279c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:06.970996 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4846f219-1304-48a1-b82e-7546c82b279c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:06.989298 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4846f219-1304-48a1-b82e-7546c82b279c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.560365 Aug 24 10:35:06.990520 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2041/4436] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:06 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:07.010158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f397a314-1bb2-4e3f-8500-4f046b90dc0c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:07.014437 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f397a314-1bb2-4e3f-8500-4f046b90dc0c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:07.027856 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d1d46b27-8d02-405e-9fc2-c1297e507695 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:07.031708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d1d46b27-8d02-405e-9fc2-c1297e507695 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:07.034664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f397a314-1bb2-4e3f-8500-4f046b90dc0c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:07.035177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f397a314-1bb2-4e3f-8500-4f046b90dc0c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:07.039302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f397a314-1bb2-4e3f-8500-4f046b90dc0c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:07.040261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f397a314-1bb2-4e3f-8500-4f046b90dc0c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:07.040753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f397a314-1bb2-4e3f-8500-4f046b90dc0c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:07.044467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f397a314-1bb2-4e3f-8500-4f046b90dc0c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:07.048589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1d46b27-8d02-405e-9fc2-c1297e507695 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:07.052074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1d46b27-8d02-405e-9fc2-c1297e507695 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:07.053911 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1d46b27-8d02-405e-9fc2-c1297e507695 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:07.055278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1d46b27-8d02-405e-9fc2-c1297e507695 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:07.058923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1d46b27-8d02-405e-9fc2-c1297e507695 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:07.061612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1d46b27-8d02-405e-9fc2-c1297e507695 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:07.119262 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f397a314-1bb2-4e3f-8500-4f046b90dc0c tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113399 Aug 24 10:35:07.135246 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2396/4437] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:35:07 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:35:07.156633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fef43c4a-4e26-4c61-ae04-874fa20015c8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:07.157294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fef43c4a-4e26-4c61-ae04-874fa20015c8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:07.173142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fef43c4a-4e26-4c61-ae04-874fa20015c8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:07.173884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fef43c4a-4e26-4c61-ae04-874fa20015c8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:07.174347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fef43c4a-4e26-4c61-ae04-874fa20015c8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:07.183804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fef43c4a-4e26-4c61-ae04-874fa20015c8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:07.184311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fef43c4a-4e26-4c61-ae04-874fa20015c8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:07.184760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fef43c4a-4e26-4c61-ae04-874fa20015c8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:07.349658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d1d46b27-8d02-405e-9fc2-c1297e507695 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:07.403803 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d1d46b27-8d02-405e-9fc2-c1297e507695 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.379432 Aug 24 10:35:07.403803 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2042/4438] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:07 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:07.446371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b78aa871-c590-4fc0-bd1f-0e3f7311880c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:07.447026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b78aa871-c590-4fc0-bd1f-0e3f7311880c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:07.456152 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b78aa871-c590-4fc0-bd1f-0e3f7311880c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:07.456888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b78aa871-c590-4fc0-bd1f-0e3f7311880c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:07.468078 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b78aa871-c590-4fc0-bd1f-0e3f7311880c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:07.469525 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b78aa871-c590-4fc0-bd1f-0e3f7311880c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:07.470234 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b78aa871-c590-4fc0-bd1f-0e3f7311880c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:07.485575 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b78aa871-c590-4fc0-bd1f-0e3f7311880c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:07.582441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fef43c4a-4e26-4c61-ae04-874fa20015c8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:07.597737 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fef43c4a-4e26-4c61-ae04-874fa20015c8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.444145 Aug 24 10:35:07.598367 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2397/4439] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:07 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:35:07.628292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b8ac3f74-3c20-49f4-a16c-b972cb450e97 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:07.630674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b8ac3f74-3c20-49f4-a16c-b972cb450e97 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:07.665925 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8ac3f74-3c20-49f4-a16c-b972cb450e97 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:07.668217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8ac3f74-3c20-49f4-a16c-b972cb450e97 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:07.669836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8ac3f74-3c20-49f4-a16c-b972cb450e97 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:07.672095 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8ac3f74-3c20-49f4-a16c-b972cb450e97 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:07.677837 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8ac3f74-3c20-49f4-a16c-b972cb450e97 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:07.678798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8ac3f74-3c20-49f4-a16c-b972cb450e97 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:07.810664 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b8ac3f74-3c20-49f4-a16c-b972cb450e97 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action" status: 200 len: 322 microversion: 2.1 time: 0.188673 Aug 24 10:35:07.817258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b78aa871-c590-4fc0-bd1f-0e3f7311880c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:07.818179 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2398/4440] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:35:07 2022] POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action => generated 322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:35:07.828586 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b78aa871-c590-4fc0-bd1f-0e3f7311880c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.386298 Aug 24 10:35:07.832896 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2043/4441] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:07 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:07.843021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fa4c1c4d-4091-4c84-87ab-86ace89309d1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:07.845106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fa4c1c4d-4091-4c84-87ab-86ace89309d1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:07.863135 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-881583c9-e9f5-4d44-8eac-26b0f146ab00 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:07.866102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa4c1c4d-4091-4c84-87ab-86ace89309d1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:07.868091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa4c1c4d-4091-4c84-87ab-86ace89309d1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:07.869625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa4c1c4d-4091-4c84-87ab-86ace89309d1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:07.871478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa4c1c4d-4091-4c84-87ab-86ace89309d1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:07.873748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa4c1c4d-4091-4c84-87ab-86ace89309d1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:07.874219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa4c1c4d-4091-4c84-87ab-86ace89309d1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:07.883419 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-881583c9-e9f5-4d44-8eac-26b0f146ab00 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Instance 8b7d5e7e-33c9-4c22-80d8-280f75542315 has no mapping to a cell. Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-881583c9-e9f5-4d44-8eac-26b0f146ab00 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/8b7d5e7e-33c9-4c22-80d8-280f75542315/action HTTP/1.1 Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 15 Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: {"os-stop": {}} Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 8b7d5e7e-33c9-4c22-80d8-280f75542315 has no mapping to a cell. Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '8b7d5e7e-33c9-4c22-80d8-280f75542315', 'body': {'os-stop': {}}} Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 8b7d5e7e-33c9-4c22-80d8-280f75542315 has no mapping to a cell. Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:35:07.894379 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b7d5e7e-33c9-4c22-80d8-280f75542315 has no mapping to a cell. Aug 24 10:35:07.899370 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:07.899370 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:07.899370 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:07.899370 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:07.899370 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:07.899370 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:07.899370 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:35:07.899370 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:35:07.899370 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b7d5e7e-33c9-4c22-80d8-280f75542315 has no mapping to a cell. Aug 24 10:35:07.899370 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:07.899370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-881583c9-e9f5-4d44-8eac-26b0f146ab00 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 404 to user: Instance 8b7d5e7e-33c9-4c22-80d8-280f75542315 has no mapping to a cell. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:35:07.912977 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-881583c9-e9f5-4d44-8eac-26b0f146ab00 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers/8b7d5e7e-33c9-4c22-80d8-280f75542315/action" status: 404 len: 117 microversion: 2.1 time: 0.062268 Aug 24 10:35:07.914380 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2044/4442] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:35:07 2022] POST /compute/v2.1/servers/8b7d5e7e-33c9-4c22-80d8-280f75542315/action => generated 117 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:35:07.936122 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-abfdd166-6460-41f4-a08b-9d9f34cba883 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:07.937276 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-abfdd166-6460-41f4-a08b-9d9f34cba883 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:07.958373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abfdd166-6460-41f4-a08b-9d9f34cba883 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:07.958877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abfdd166-6460-41f4-a08b-9d9f34cba883 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:07.959312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abfdd166-6460-41f4-a08b-9d9f34cba883 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:07.960029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abfdd166-6460-41f4-a08b-9d9f34cba883 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:07.960486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abfdd166-6460-41f4-a08b-9d9f34cba883 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:07.960926 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abfdd166-6460-41f4-a08b-9d9f34cba883 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:08.296978 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-abfdd166-6460-41f4-a08b-9d9f34cba883 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:08.308224 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-abfdd166-6460-41f4-a08b-9d9f34cba883 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.389508 Aug 24 10:35:08.308828 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2045/4443] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:07 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:08.319826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fa4c1c4d-4091-4c84-87ab-86ace89309d1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:08.338337 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cf77bb26-275f-48dc-b587-1fc638479ccc tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:08.341062 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cf77bb26-275f-48dc-b587-1fc638479ccc tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:08.343150 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fa4c1c4d-4091-4c84-87ab-86ace89309d1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.513945 Aug 24 10:35:08.343917 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2399/4444] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:07 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:08.349894 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9a6f5d80-b1ab-4597-8dfd-40183f52280f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:08.361415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9a6f5d80-b1ab-4597-8dfd-40183f52280f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:08.367171 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf77bb26-275f-48dc-b587-1fc638479ccc tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:08.368013 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf77bb26-275f-48dc-b587-1fc638479ccc tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:08.370718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf77bb26-275f-48dc-b587-1fc638479ccc tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:08.373224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf77bb26-275f-48dc-b587-1fc638479ccc tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:08.381218 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf77bb26-275f-48dc-b587-1fc638479ccc tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:08.383736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf77bb26-275f-48dc-b587-1fc638479ccc tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:08.392084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a6f5d80-b1ab-4597-8dfd-40183f52280f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:08.393768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a6f5d80-b1ab-4597-8dfd-40183f52280f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:08.403593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a6f5d80-b1ab-4597-8dfd-40183f52280f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:08.404814 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a6f5d80-b1ab-4597-8dfd-40183f52280f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:08.405691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a6f5d80-b1ab-4597-8dfd-40183f52280f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:08.407054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a6f5d80-b1ab-4597-8dfd-40183f52280f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:08.482982 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cf77bb26-275f-48dc-b587-1fc638479ccc tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172768 Aug 24 10:35:08.486345 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2046/4445] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:35:08 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:35:08.515859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7fde8aae-d2fe-47bc-be6e-0654ad535a5d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:08.523019 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7fde8aae-d2fe-47bc-be6e-0654ad535a5d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:08.540086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fde8aae-d2fe-47bc-be6e-0654ad535a5d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:08.541094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fde8aae-d2fe-47bc-be6e-0654ad535a5d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:08.541561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fde8aae-d2fe-47bc-be6e-0654ad535a5d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:08.542270 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fde8aae-d2fe-47bc-be6e-0654ad535a5d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:08.542927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fde8aae-d2fe-47bc-be6e-0654ad535a5d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:08.543878 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fde8aae-d2fe-47bc-be6e-0654ad535a5d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:08.754940 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9a6f5d80-b1ab-4597-8dfd-40183f52280f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:08.773779 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9a6f5d80-b1ab-4597-8dfd-40183f52280f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.428111 Aug 24 10:35:08.774655 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2400/4446] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:08 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:08.815479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-53530225-e62c-41ac-aa4f-aee3e961c70f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:08.817505 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-53530225-e62c-41ac-aa4f-aee3e961c70f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 955c485d-91c6-44eb-b8e8-3d9c4efc9082] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:08.825277 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-53530225-e62c-41ac-aa4f-aee3e961c70f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Instance 955c485d-91c6-44eb-b8e8-3d9c4efc9082 could not be found. Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-53530225-e62c-41ac-aa4f-aee3e961c70f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/955c485d-91c6-44eb-b8e8-3d9c4efc9082/action HTTP/1.1 Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 15 Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: {"suspend": {}} Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 955c485d-91c6-44eb-b8e8-3d9c4efc9082 could not be found. Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '955c485d-91c6-44eb-b8e8-3d9c4efc9082', 'body': {'suspend': {}}} Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 955c485d-91c6-44eb-b8e8-3d9c4efc9082 could not be found. Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 955c485d-91c6-44eb-b8e8-3d9c4efc9082 could not be found. Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:08.827415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:08.832663 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:35:08.832663 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:35:08.832663 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 955c485d-91c6-44eb-b8e8-3d9c4efc9082 could not be found. Aug 24 10:35:08.832663 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:08.834838 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-53530225-e62c-41ac-aa4f-aee3e961c70f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 404 to user: Instance 955c485d-91c6-44eb-b8e8-3d9c4efc9082 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:35:08.836163 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-53530225-e62c-41ac-aa4f-aee3e961c70f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers/955c485d-91c6-44eb-b8e8-3d9c4efc9082/action" status: 404 len: 111 microversion: 2.1 time: 0.031630 Aug 24 10:35:08.846099 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2401/4447] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:35:08 2022] POST /compute/v2.1/servers/955c485d-91c6-44eb-b8e8-3d9c4efc9082/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:35:08.867896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e5cf67ef-bbeb-433d-9acc-095405bf6986 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:08.869538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e5cf67ef-bbeb-433d-9acc-095405bf6986 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:08.941879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5cf67ef-bbeb-433d-9acc-095405bf6986 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:08.943101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5cf67ef-bbeb-433d-9acc-095405bf6986 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:08.943904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5cf67ef-bbeb-433d-9acc-095405bf6986 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:08.944950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5cf67ef-bbeb-433d-9acc-095405bf6986 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:08.946669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5cf67ef-bbeb-433d-9acc-095405bf6986 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:08.947549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5cf67ef-bbeb-433d-9acc-095405bf6986 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:09.292212 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e5cf67ef-bbeb-433d-9acc-095405bf6986 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:09.304489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7fde8aae-d2fe-47bc-be6e-0654ad535a5d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:09.313151 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e5cf67ef-bbeb-433d-9acc-095405bf6986 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.458114 Aug 24 10:35:09.313936 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7fde8aae-d2fe-47bc-be6e-0654ad535a5d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.804029 Aug 24 10:35:09.314794 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2047/4448] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:08 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:09.329494 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2402/4449] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:08 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:09.346215 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9bc17c26-94a0-4db5-b05b-ddb9b7d208e8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:09.347390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9bc17c26-94a0-4db5-b05b-ddb9b7d208e8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:09.370906 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aa22a668-8c6e-4522-b14b-0b70f9c1545b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:09.371500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bc17c26-94a0-4db5-b05b-ddb9b7d208e8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:09.373305 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bc17c26-94a0-4db5-b05b-ddb9b7d208e8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:09.376353 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aa22a668-8c6e-4522-b14b-0b70f9c1545b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:09.377294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bc17c26-94a0-4db5-b05b-ddb9b7d208e8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:09.382927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bc17c26-94a0-4db5-b05b-ddb9b7d208e8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:09.384130 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bc17c26-94a0-4db5-b05b-ddb9b7d208e8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:09.385768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bc17c26-94a0-4db5-b05b-ddb9b7d208e8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:09.399331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa22a668-8c6e-4522-b14b-0b70f9c1545b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:09.399950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa22a668-8c6e-4522-b14b-0b70f9c1545b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:09.402483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa22a668-8c6e-4522-b14b-0b70f9c1545b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:09.405827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa22a668-8c6e-4522-b14b-0b70f9c1545b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:09.406722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa22a668-8c6e-4522-b14b-0b70f9c1545b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:09.409040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa22a668-8c6e-4522-b14b-0b70f9c1545b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:09.720472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9bc17c26-94a0-4db5-b05b-ddb9b7d208e8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:09.729106 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9bc17c26-94a0-4db5-b05b-ddb9b7d208e8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.389798 Aug 24 10:35:09.729679 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2403/4450] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:09 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:09.752969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f4c1872f-096d-494e-b5ae-e2f99ee480a9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:09.763659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f4c1872f-096d-494e-b5ae-e2f99ee480a9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:09.799548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4c1872f-096d-494e-b5ae-e2f99ee480a9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:09.799963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4c1872f-096d-494e-b5ae-e2f99ee480a9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:09.800418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4c1872f-096d-494e-b5ae-e2f99ee480a9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:09.801175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4c1872f-096d-494e-b5ae-e2f99ee480a9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:09.801648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4c1872f-096d-494e-b5ae-e2f99ee480a9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:09.802089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4c1872f-096d-494e-b5ae-e2f99ee480a9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:09.847967 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f4c1872f-096d-494e-b5ae-e2f99ee480a9 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108728 Aug 24 10:35:09.848863 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2404/4451] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:35:09 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:35:09.856998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7209555b-1248-48d0-a772-5a294214cc47 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:09.858219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7209555b-1248-48d0-a772-5a294214cc47 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:09.865650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7209555b-1248-48d0-a772-5a294214cc47 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:09.866802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7209555b-1248-48d0-a772-5a294214cc47 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:09.867591 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7209555b-1248-48d0-a772-5a294214cc47 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:09.868642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7209555b-1248-48d0-a772-5a294214cc47 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:09.869424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7209555b-1248-48d0-a772-5a294214cc47 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:09.870105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7209555b-1248-48d0-a772-5a294214cc47 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:10.074913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aa22a668-8c6e-4522-b14b-0b70f9c1545b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:10.087674 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aa22a668-8c6e-4522-b14b-0b70f9c1545b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.729368 Aug 24 10:35:10.089599 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2048/4452] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:09 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:10.115624 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6df59f38-b249-4a68-aa8a-0a7aeda87ea2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:10.116467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6df59f38-b249-4a68-aa8a-0a7aeda87ea2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:10.152848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6df59f38-b249-4a68-aa8a-0a7aeda87ea2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:10.154833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6df59f38-b249-4a68-aa8a-0a7aeda87ea2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:10.155721 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6df59f38-b249-4a68-aa8a-0a7aeda87ea2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:10.158786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7209555b-1248-48d0-a772-5a294214cc47 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:10.159423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6df59f38-b249-4a68-aa8a-0a7aeda87ea2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:10.161063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6df59f38-b249-4a68-aa8a-0a7aeda87ea2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:10.163778 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6df59f38-b249-4a68-aa8a-0a7aeda87ea2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:10.186059 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7209555b-1248-48d0-a772-5a294214cc47 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.334693 Aug 24 10:35:10.218924 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2405/4453] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:09 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:10.250144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-6df59f38-b249-4a68-aa8a-0a7aeda87ea2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lazy-loading 'flavor' on Instance uuid 8fb1d6b5-a27c-465a-aa10-652d2cc366ae {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:35:10.302740 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:10.405763 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6d7c9f34-b6cd-4bf9-aace-b6192d533777 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1136781185", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "c436d0f2-980c-499c-87fc-ff5c4aa0438d"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:10.429475 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6df59f38-b249-4a68-aa8a-0a7aeda87ea2 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action" status: 202 len: 0 microversion: 2.1 time: 0.320311 Aug 24 10:35:10.441578 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2049/4454] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:35:10 2022] POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:35:10.455744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ba66c3a4-c10f-45ac-b24e-13ea14426dad tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:10.457951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ba66c3a4-c10f-45ac-b24e-13ea14426dad tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:10.484820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba66c3a4-c10f-45ac-b24e-13ea14426dad tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:10.493983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba66c3a4-c10f-45ac-b24e-13ea14426dad tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:10.495771 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba66c3a4-c10f-45ac-b24e-13ea14426dad tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:10.496770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba66c3a4-c10f-45ac-b24e-13ea14426dad tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:10.498035 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba66c3a4-c10f-45ac-b24e-13ea14426dad tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:10.498562 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba66c3a4-c10f-45ac-b24e-13ea14426dad tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:10.533695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-6d7c9f34-b6cd-4bf9-aace-b6192d533777 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] validate_networks() for [('c436d0f2-980c-499c-87fc-ff5c4aa0438d', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:35:10.829679 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ba66c3a4-c10f-45ac-b24e-13ea14426dad tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:10.841570 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ba66c3a4-c10f-45ac-b24e-13ea14426dad tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1514 microversion: 2.1 time: 0.391026 Aug 24 10:35:10.842616 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2050/4455] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:10 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1514 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:10.874200 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7135109c-a7e5-4696-8bbf-d903a07859bb tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:10.878406 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7135109c-a7e5-4696-8bbf-d903a07859bb tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:10.888181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7135109c-a7e5-4696-8bbf-d903a07859bb tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:10.889045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7135109c-a7e5-4696-8bbf-d903a07859bb tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:10.896286 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7135109c-a7e5-4696-8bbf-d903a07859bb tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:10.897072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7135109c-a7e5-4696-8bbf-d903a07859bb tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:10.897581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7135109c-a7e5-4696-8bbf-d903a07859bb tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:10.898021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7135109c-a7e5-4696-8bbf-d903a07859bb tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:10.949482 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7135109c-a7e5-4696-8bbf-d903a07859bb tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091748 Aug 24 10:35:10.958802 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2051/4456] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:35:10 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:35:11.327387 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-6d7c9f34-b6cd-4bf9-aace-b6192d533777 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:35:11.328295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-6d7c9f34-b6cd-4bf9-aace-b6192d533777 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:35:11.329007 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-6d7c9f34-b6cd-4bf9-aace-b6192d533777 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:35:11.330308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-6d7c9f34-b6cd-4bf9-aace-b6192d533777 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:35:11.331094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-6d7c9f34-b6cd-4bf9-aace-b6192d533777 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:35:11.347334 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d7c9f34-b6cd-4bf9-aace-b6192d533777 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:11.348199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d7c9f34-b6cd-4bf9-aace-b6192d533777 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:11.349009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d7c9f34-b6cd-4bf9-aace-b6192d533777 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:11.350619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d7c9f34-b6cd-4bf9-aace-b6192d533777 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:11.351655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d7c9f34-b6cd-4bf9-aace-b6192d533777 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:11.353027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d7c9f34-b6cd-4bf9-aace-b6192d533777 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:11.377826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-6d7c9f34-b6cd-4bf9-aace-b6192d533777 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Getting quotas for project 3d511560c1f543169e7eab8c70c9abcd. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:35:11.387100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-6d7c9f34-b6cd-4bf9-aace-b6192d533777 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Getting quotas for user 03ef6a33c1f0467993486547b7d00fda and project 3d511560c1f543169e7eab8c70c9abcd. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:35:11.404227 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6d7c9f34-b6cd-4bf9-aace-b6192d533777 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:35:11.407787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6d7c9f34-b6cd-4bf9-aace-b6192d533777 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:35:11.493918 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6d7c9f34-b6cd-4bf9-aace-b6192d533777 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.092505 Aug 24 10:35:11.497616 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2406/4457] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:35:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:35:11.521756 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-931a9632-8388-4a8d-b971-8488040cb550 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:11.523167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-931a9632-8388-4a8d-b971-8488040cb550 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:11.728598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-931a9632-8388-4a8d-b971-8488040cb550 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:11.740049 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-931a9632-8388-4a8d-b971-8488040cb550 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1215 microversion: 2.1 time: 0.223013 Aug 24 10:35:11.741714 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2052/4458] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:11 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1215 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:11.865539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-28dd25a2-f265-4537-80e2-7b3b46b35162 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:11.866427 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-28dd25a2-f265-4537-80e2-7b3b46b35162 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:11.890277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28dd25a2-f265-4537-80e2-7b3b46b35162 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:11.891122 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28dd25a2-f265-4537-80e2-7b3b46b35162 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:11.891777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28dd25a2-f265-4537-80e2-7b3b46b35162 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:11.892726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28dd25a2-f265-4537-80e2-7b3b46b35162 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:11.896102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28dd25a2-f265-4537-80e2-7b3b46b35162 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:11.899035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28dd25a2-f265-4537-80e2-7b3b46b35162 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:11.968485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-40217195-2a65-436b-a0f3-588b49664a65 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:11.996776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-40217195-2a65-436b-a0f3-588b49664a65 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:12.044304 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40217195-2a65-436b-a0f3-588b49664a65 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:12.048318 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40217195-2a65-436b-a0f3-588b49664a65 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:12.050809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40217195-2a65-436b-a0f3-588b49664a65 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:12.055727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40217195-2a65-436b-a0f3-588b49664a65 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:12.059233 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40217195-2a65-436b-a0f3-588b49664a65 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:12.063904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40217195-2a65-436b-a0f3-588b49664a65 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:12.221380 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-40217195-2a65-436b-a0f3-588b49664a65 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.256653 Aug 24 10:35:12.224386 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2053/4459] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:35:11 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-volume_attachments => generated 197 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:35:12.325107 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-28dd25a2-f265-4537-80e2-7b3b46b35162 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:12.354677 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-28dd25a2-f265-4537-80e2-7b3b46b35162 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1497 microversion: 2.1 time: 0.493256 Aug 24 10:35:12.384662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-116cca96-c4ff-4478-9cf1-b6f38492414b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:12.385249 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-116cca96-c4ff-4478-9cf1-b6f38492414b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:12.386238 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2407/4460] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:11 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1497 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:12.429707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-116cca96-c4ff-4478-9cf1-b6f38492414b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:12.431134 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-116cca96-c4ff-4478-9cf1-b6f38492414b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:12.431612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-116cca96-c4ff-4478-9cf1-b6f38492414b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:12.433041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-116cca96-c4ff-4478-9cf1-b6f38492414b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:12.433041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-116cca96-c4ff-4478-9cf1-b6f38492414b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:12.433352 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-116cca96-c4ff-4478-9cf1-b6f38492414b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:12.530365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-116cca96-c4ff-4478-9cf1-b6f38492414b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lazy-loading 'flavor' on Instance uuid 8fb1d6b5-a27c-465a-aa10-652d2cc366ae {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:35:12.569013 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-116cca96-c4ff-4478-9cf1-b6f38492414b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Cannot 'suspend' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state suspended Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-116cca96-c4ff-4478-9cf1-b6f38492414b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action HTTP/1.1 Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 15 Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: {"suspend": {}} Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: exception: Cannot 'suspend' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state suspended Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '8fb1d6b5-a27c-465a-aa10-652d2cc366ae', 'body': {'suspend': {}}} Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae in vm_state suspended. Cannot suspend while the instance is in this state. Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 24 10:35:12.573457 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 10:35:12.577900 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 10:35:12.577900 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 10:35:12.577900 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state suspended Aug 24 10:35:12.577900 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:12.577900 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:12.577900 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:12.577900 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:12.577900 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:12.577900 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:12.577900 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:35:12.577900 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:35:12.577900 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state suspended Aug 24 10:35:12.577900 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:12.577900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-116cca96-c4ff-4478-9cf1-b6f38492414b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 409 to user: Cannot 'suspend' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state suspended {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:35:12.578836 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-116cca96-c4ff-4478-9cf1-b6f38492414b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action" status: 409 len: 148 microversion: 2.1 time: 0.201810 Aug 24 10:35:12.584155 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2054/4461] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:35:12 2022] POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action => generated 148 bytes in 205 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 10:35:12.593540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a75d4ec8-c8cd-4b8d-b81d-39a808c97c1e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:12.594078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a75d4ec8-c8cd-4b8d-b81d-39a808c97c1e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:12.609907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a75d4ec8-c8cd-4b8d-b81d-39a808c97c1e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:12.610431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a75d4ec8-c8cd-4b8d-b81d-39a808c97c1e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:12.610884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a75d4ec8-c8cd-4b8d-b81d-39a808c97c1e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:12.614454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a75d4ec8-c8cd-4b8d-b81d-39a808c97c1e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:12.614960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a75d4ec8-c8cd-4b8d-b81d-39a808c97c1e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:12.633348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a75d4ec8-c8cd-4b8d-b81d-39a808c97c1e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:12.760189 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3a37dd31-3e47-4641-9c91-e66ac9cb536d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:12.761704 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3a37dd31-3e47-4641-9c91-e66ac9cb536d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:12.787742 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a37dd31-3e47-4641-9c91-e66ac9cb536d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:12.788337 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a37dd31-3e47-4641-9c91-e66ac9cb536d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:12.788802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a37dd31-3e47-4641-9c91-e66ac9cb536d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:12.789585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a37dd31-3e47-4641-9c91-e66ac9cb536d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:12.796154 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a37dd31-3e47-4641-9c91-e66ac9cb536d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:12.796671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a37dd31-3e47-4641-9c91-e66ac9cb536d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:12.952368 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a75d4ec8-c8cd-4b8d-b81d-39a808c97c1e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action" status: 202 len: 0 microversion: 2.1 time: 0.365619 Aug 24 10:35:12.954394 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2408/4462] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:35:12 2022] POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:35:12.965961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3d9a5d31-41bd-45d7-94e6-573c47237262 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:12.967081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3d9a5d31-41bd-45d7-94e6-573c47237262 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:12.979411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d9a5d31-41bd-45d7-94e6-573c47237262 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:12.980623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d9a5d31-41bd-45d7-94e6-573c47237262 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:12.981421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d9a5d31-41bd-45d7-94e6-573c47237262 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:12.984500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d9a5d31-41bd-45d7-94e6-573c47237262 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:12.986482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d9a5d31-41bd-45d7-94e6-573c47237262 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:12.987414 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d9a5d31-41bd-45d7-94e6-573c47237262 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:13.127018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3a37dd31-3e47-4641-9c91-e66ac9cb536d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:13.142639 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3a37dd31-3e47-4641-9c91-e66ac9cb536d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1267 microversion: 2.1 time: 0.384893 Aug 24 10:35:13.154870 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2055/4463] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:12 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1267 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:13.238114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-06d78383-b708-4a09-84d9-eefcb018581e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:13.241456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-06d78383-b708-4a09-84d9-eefcb018581e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:13.256199 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06d78383-b708-4a09-84d9-eefcb018581e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:13.257289 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06d78383-b708-4a09-84d9-eefcb018581e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:13.260510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06d78383-b708-4a09-84d9-eefcb018581e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:13.263638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06d78383-b708-4a09-84d9-eefcb018581e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:13.264514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06d78383-b708-4a09-84d9-eefcb018581e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:13.266787 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06d78383-b708-4a09-84d9-eefcb018581e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:13.360757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3d9a5d31-41bd-45d7-94e6-573c47237262 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:13.391889 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3d9a5d31-41bd-45d7-94e6-573c47237262 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1503 microversion: 2.1 time: 0.431410 Aug 24 10:35:13.400223 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2409/4464] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:12 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1503 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:13.423191 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-06d78383-b708-4a09-84d9-eefcb018581e tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.187030 Aug 24 10:35:13.424569 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2056/4465] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:35:13 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:35:14.171543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-53f27177-1208-4f5c-8350-923cd6bb5ad2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:14.180530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-53f27177-1208-4f5c-8350-923cd6bb5ad2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:14.204859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53f27177-1208-4f5c-8350-923cd6bb5ad2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:14.217163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53f27177-1208-4f5c-8350-923cd6bb5ad2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:14.217666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53f27177-1208-4f5c-8350-923cd6bb5ad2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:14.218553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53f27177-1208-4f5c-8350-923cd6bb5ad2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:14.219037 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53f27177-1208-4f5c-8350-923cd6bb5ad2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:14.219475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53f27177-1208-4f5c-8350-923cd6bb5ad2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:14.352174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-53f27177-1208-4f5c-8350-923cd6bb5ad2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:14.365051 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-53f27177-1208-4f5c-8350-923cd6bb5ad2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1273 microversion: 2.1 time: 0.198870 Aug 24 10:35:14.372561 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2410/4466] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:14 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1273 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:14.420196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-61b3d36c-6ce0-4feb-a80e-0cb942c93162 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:14.421074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-61b3d36c-6ce0-4feb-a80e-0cb942c93162 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:14.429290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61b3d36c-6ce0-4feb-a80e-0cb942c93162 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:14.430165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61b3d36c-6ce0-4feb-a80e-0cb942c93162 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:14.430949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61b3d36c-6ce0-4feb-a80e-0cb942c93162 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:14.431924 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61b3d36c-6ce0-4feb-a80e-0cb942c93162 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:14.432774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61b3d36c-6ce0-4feb-a80e-0cb942c93162 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:14.433521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61b3d36c-6ce0-4feb-a80e-0cb942c93162 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:14.436521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d5655635-7d8b-446c-928e-4c106e7bbc4d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:14.439650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d5655635-7d8b-446c-928e-4c106e7bbc4d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:14.454072 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5655635-7d8b-446c-928e-4c106e7bbc4d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:14.454625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5655635-7d8b-446c-928e-4c106e7bbc4d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:14.455094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5655635-7d8b-446c-928e-4c106e7bbc4d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:14.455875 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5655635-7d8b-446c-928e-4c106e7bbc4d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:14.456364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5655635-7d8b-446c-928e-4c106e7bbc4d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:14.456822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5655635-7d8b-446c-928e-4c106e7bbc4d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:14.494053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:14.533213 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d5655635-7d8b-446c-928e-4c106e7bbc4d tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100631 Aug 24 10:35:14.534731 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2411/4467] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:35:14 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:35:14.633894 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e8bb65dc-a7d0-44b8-8d62-f15403b9e2b2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:14.637187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e8bb65dc-a7d0-44b8-8d62-f15403b9e2b2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:14.651502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8bb65dc-a7d0-44b8-8d62-f15403b9e2b2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:14.652386 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8bb65dc-a7d0-44b8-8d62-f15403b9e2b2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:14.653000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8bb65dc-a7d0-44b8-8d62-f15403b9e2b2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:14.654109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8bb65dc-a7d0-44b8-8d62-f15403b9e2b2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:14.654743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8bb65dc-a7d0-44b8-8d62-f15403b9e2b2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:14.655411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8bb65dc-a7d0-44b8-8d62-f15403b9e2b2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:14.685156 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-e8bb65dc-a7d0-44b8-8d62-f15403b9e2b2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] HTTP exception thrown: Cannot 'reboot' instance 744fdfa0-24a0-4859-a5c5-7089ce8a444c while it is in vm_state rescued Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e8bb65dc-a7d0-44b8-8d62-f15403b9e2b2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Request method failure captured: Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c/action HTTP/1.1 Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 28 Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf2afGdSM86mh0RIAZFYBYhaQ4EtyTCcCD00ldy_PJZTrDPEqZsqjAaBEiSLwFHEWtlpLSXpU9lI2y_7Dlfdrd1tzCv296dD-Q1jtlqtcx2Z1VdQb3wVY7fHkhrfDX6lZ98oMTsvllOCneZWRxakMNA_j9HFWTm3gYwjAHKCNfApMTc Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 125d2dd1d22140abaa36184e3628a339 Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1145732609 Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/125d2dd1d22140abaa36184e3628a339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_125d2dd1d22140abaa36184e3628a339", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/125d2dd1d22140abaa36184e3628a339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/125d2dd1d22140abaa36184e3628a339"}]}] Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1145732609 Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 125d2dd1d22140abaa36184e3628a339 Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1145732609 Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerRescueNegativeTestJSON-1145732609-project Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 133e99904a6b4574933cad73d0f2293f Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1145732609-project Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: {"reboot": {"type": "HARD"}} Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: exception: Cannot 'reboot' instance 744fdfa0-24a0-4859-a5c5-7089ce8a444c while it is in vm_state rescued Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '744fdfa0-24a0-4859-a5c5-7089ce8a444c', 'body': {'reboot': {'type': 'HARD'}}} Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3539, in reboot Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 744fdfa0-24a0-4859-a5c5-7089ce8a444c in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 10:35:14.687348 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 10:35:14.692027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 744fdfa0-24a0-4859-a5c5-7089ce8a444c while it is in vm_state rescued Aug 24 10:35:14.692027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:14.692027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:14.692027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:14.692027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:14.692027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:14.692027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:14.692027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:35:14.692027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:35:14.692027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 744fdfa0-24a0-4859-a5c5-7089ce8a444c while it is in vm_state rescued Aug 24 10:35:14.692027 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:14.694418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e8bb65dc-a7d0-44b8-8d62-f15403b9e2b2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Returning 409 to user: Cannot 'reboot' instance 744fdfa0-24a0-4859-a5c5-7089ce8a444c while it is in vm_state rescued {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:35:14.695578 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e8bb65dc-a7d0-44b8-8d62-f15403b9e2b2 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "POST /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c/action" status: 409 len: 145 microversion: 2.1 time: 0.066940 Aug 24 10:35:14.696792 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2412/4468] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:35:14 2022] POST /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c/action => generated 145 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:35:14.706908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-67374c1c-8e8a-4862-a2a5-ba99bda8349b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:14.709816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-67374c1c-8e8a-4862-a2a5-ba99bda8349b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:14.717215 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67374c1c-8e8a-4862-a2a5-ba99bda8349b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:14.719636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67374c1c-8e8a-4862-a2a5-ba99bda8349b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:14.720123 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67374c1c-8e8a-4862-a2a5-ba99bda8349b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:14.720896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67374c1c-8e8a-4862-a2a5-ba99bda8349b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:14.721602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67374c1c-8e8a-4862-a2a5-ba99bda8349b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:14.722046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67374c1c-8e8a-4862-a2a5-ba99bda8349b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:14.756044 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-67374c1c-8e8a-4862-a2a5-ba99bda8349b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] HTTP exception thrown: Cannot 'rebuild' instance 744fdfa0-24a0-4859-a5c5-7089ce8a444c while it is in vm_state rescued Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-67374c1c-8e8a-4862-a2a5-ba99bda8349b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Request method failure captured: Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c/action HTTP/1.1 Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 65 Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf2afGdSM86mh0RIAZFYBYhaQ4EtyTCcCD00ldy_PJZTrDPEqZsqjAaBEiSLwFHEWtlpLSXpU9lI2y_7Dlfdrd1tzCv296dD-Q1jtlqtcx2Z1VdQb3wVY7fHkhrfDX6lZ98oMTsvllOCneZWRxakMNA_j9HFWTm3gYwjAHKCNfApMTc Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 125d2dd1d22140abaa36184e3628a339 Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1145732609 Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/125d2dd1d22140abaa36184e3628a339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_125d2dd1d22140abaa36184e3628a339", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/125d2dd1d22140abaa36184e3628a339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/125d2dd1d22140abaa36184e3628a339"}]}] Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1145732609 Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 125d2dd1d22140abaa36184e3628a339 Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1145732609 Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerRescueNegativeTestJSON-1145732609-project Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 133e99904a6b4574933cad73d0f2293f Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1145732609-project Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: {"rebuild": {"imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af"}} Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: exception: Cannot 'rebuild' instance 744fdfa0-24a0-4859-a5c5-7089ce8a444c while it is in vm_state rescued Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '744fdfa0-24a0-4859-a5c5-7089ce8a444c', 'body': {'rebuild': {'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af'}}} Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 744fdfa0-24a0-4859-a5c5-7089ce8a444c in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:35:14.758108 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:35:14.761951 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:35:14.761951 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 24 10:35:14.761951 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 24 10:35:14.761951 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 10:35:14.761951 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 10:35:14.761951 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 10:35:14.761951 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 744fdfa0-24a0-4859-a5c5-7089ce8a444c while it is in vm_state rescued Aug 24 10:35:14.761951 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:14.761951 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:14.761951 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:14.761951 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:14.761951 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:14.761951 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:14.761951 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:35:14.761951 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:35:14.761951 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 744fdfa0-24a0-4859-a5c5-7089ce8a444c while it is in vm_state rescued Aug 24 10:35:14.761951 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:14.761951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-67374c1c-8e8a-4862-a2a5-ba99bda8349b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Returning 409 to user: Cannot 'rebuild' instance 744fdfa0-24a0-4859-a5c5-7089ce8a444c while it is in vm_state rescued {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:35:14.761951 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-67374c1c-8e8a-4862-a2a5-ba99bda8349b tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "POST /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c/action" status: 409 len: 146 microversion: 2.1 time: 0.057444 Aug 24 10:35:14.766096 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2413/4469] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:35:14 2022] POST /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c/action => generated 146 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:35:14.771694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-029a5766-207f-405b-815f-a6786a85f75a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:14.772206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-029a5766-207f-405b-815f-a6786a85f75a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:14.779719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-029a5766-207f-405b-815f-a6786a85f75a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:14.780298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-029a5766-207f-405b-815f-a6786a85f75a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:14.780746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-029a5766-207f-405b-815f-a6786a85f75a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:14.781494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-029a5766-207f-405b-815f-a6786a85f75a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:14.781960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-029a5766-207f-405b-815f-a6786a85f75a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:14.782388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-029a5766-207f-405b-815f-a6786a85f75a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:14.828625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-029a5766-207f-405b-815f-a6786a85f75a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:35:14.971704 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-029a5766-207f-405b-815f-a6786a85f75a tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "DELETE /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 204 len: 0 microversion: 2.1 time: 0.198336 Aug 24 10:35:14.980437 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2414/4470] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:35:14 2022] DELETE /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:35:15.026820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8f15a9fd-da3c-4fc7-a9d5-a0604e9cebd6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:15.036885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8f15a9fd-da3c-4fc7-a9d5-a0604e9cebd6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:15.066094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f15a9fd-da3c-4fc7-a9d5-a0604e9cebd6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:15.066974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f15a9fd-da3c-4fc7-a9d5-a0604e9cebd6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:15.070581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f15a9fd-da3c-4fc7-a9d5-a0604e9cebd6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:15.073027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f15a9fd-da3c-4fc7-a9d5-a0604e9cebd6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:15.074327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f15a9fd-da3c-4fc7-a9d5-a0604e9cebd6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:15.074816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f15a9fd-da3c-4fc7-a9d5-a0604e9cebd6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:15.462268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8f15a9fd-da3c-4fc7-a9d5-a0604e9cebd6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:15.503492 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8f15a9fd-da3c-4fc7-a9d5-a0604e9cebd6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1690 microversion: 2.1 time: 0.496238 Aug 24 10:35:15.525351 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2415/4471] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:14 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1690 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:15.535721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-92e19d94-23ad-45f6-8f17-c16ceec94077 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:15.536757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-92e19d94-23ad-45f6-8f17-c16ceec94077 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:15.561863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92e19d94-23ad-45f6-8f17-c16ceec94077 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:15.569402 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92e19d94-23ad-45f6-8f17-c16ceec94077 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:15.569953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92e19d94-23ad-45f6-8f17-c16ceec94077 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:15.572607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92e19d94-23ad-45f6-8f17-c16ceec94077 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:15.573158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92e19d94-23ad-45f6-8f17-c16ceec94077 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:15.574994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92e19d94-23ad-45f6-8f17-c16ceec94077 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:15.670599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-61b3d36c-6ce0-4feb-a80e-0cb942c93162 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:15.683826 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-61b3d36c-6ce0-4feb-a80e-0cb942c93162 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1503 microversion: 2.1 time: 1.267540 Aug 24 10:35:15.684580 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2057/4472] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:14 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1503 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:15.707184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-92e19d94-23ad-45f6-8f17-c16ceec94077 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:15.761207 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-92e19d94-23ad-45f6-8f17-c16ceec94077 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1273 microversion: 2.1 time: 0.232179 Aug 24 10:35:15.762793 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2416/4473] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:15 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1273 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:16.531805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fc38ce29-3917-4ec6-8ef8-0f434dc456fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:16.532453 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fc38ce29-3917-4ec6-8ef8-0f434dc456fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:16.548431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc38ce29-3917-4ec6-8ef8-0f434dc456fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:16.552285 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc38ce29-3917-4ec6-8ef8-0f434dc456fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:16.557912 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc38ce29-3917-4ec6-8ef8-0f434dc456fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:16.559079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc38ce29-3917-4ec6-8ef8-0f434dc456fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:16.563134 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc38ce29-3917-4ec6-8ef8-0f434dc456fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:16.567347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc38ce29-3917-4ec6-8ef8-0f434dc456fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:16.719815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-29f6301a-7307-431b-a7dd-6bbdb538e34f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:16.719815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-29f6301a-7307-431b-a7dd-6bbdb538e34f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:16.755608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29f6301a-7307-431b-a7dd-6bbdb538e34f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:16.770279 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29f6301a-7307-431b-a7dd-6bbdb538e34f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:16.772885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29f6301a-7307-431b-a7dd-6bbdb538e34f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:16.782175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29f6301a-7307-431b-a7dd-6bbdb538e34f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:16.789893 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29f6301a-7307-431b-a7dd-6bbdb538e34f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:16.791364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29f6301a-7307-431b-a7dd-6bbdb538e34f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:17.374969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-29f6301a-7307-431b-a7dd-6bbdb538e34f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:17.393986 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-29f6301a-7307-431b-a7dd-6bbdb538e34f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1503 microversion: 2.1 time: 0.683723 Aug 24 10:35:17.419673 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2417/4474] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:16 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1503 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:17.452434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-50eb2762-fbfa-419e-8728-d8993423bbaa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:17.453704 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-50eb2762-fbfa-419e-8728-d8993423bbaa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:17.485249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50eb2762-fbfa-419e-8728-d8993423bbaa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:17.486773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50eb2762-fbfa-419e-8728-d8993423bbaa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:17.499520 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50eb2762-fbfa-419e-8728-d8993423bbaa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:17.500660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50eb2762-fbfa-419e-8728-d8993423bbaa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:17.501483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50eb2762-fbfa-419e-8728-d8993423bbaa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:17.502335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50eb2762-fbfa-419e-8728-d8993423bbaa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:17.719809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-50eb2762-fbfa-419e-8728-d8993423bbaa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:17.747152 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-50eb2762-fbfa-419e-8728-d8993423bbaa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1273 microversion: 2.1 time: 0.320789 Aug 24 10:35:17.754494 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2418/4475] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:17 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1273 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:17.915127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fc38ce29-3917-4ec6-8ef8-0f434dc456fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:17.958076 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fc38ce29-3917-4ec6-8ef8-0f434dc456fa tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1690 microversion: 2.1 time: 1.430073 Aug 24 10:35:17.964945 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2058/4476] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:16 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1690 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:18.445387 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e9e95222-c294-433f-961c-91d09f9b71f7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:18.446554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e9e95222-c294-433f-961c-91d09f9b71f7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:18.468789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9e95222-c294-433f-961c-91d09f9b71f7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:18.473844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9e95222-c294-433f-961c-91d09f9b71f7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:18.474570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9e95222-c294-433f-961c-91d09f9b71f7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:18.475787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9e95222-c294-433f-961c-91d09f9b71f7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:18.476485 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9e95222-c294-433f-961c-91d09f9b71f7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:18.477287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9e95222-c294-433f-961c-91d09f9b71f7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:18.769035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e9e95222-c294-433f-961c-91d09f9b71f7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:18.783591 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e9e95222-c294-433f-961c-91d09f9b71f7 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.341689 Aug 24 10:35:18.784479 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b2399af9-08c8-4047-87e6-567c389a1d51 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:18.785097 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b2399af9-08c8-4047-87e6-567c389a1d51 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:18.802052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2399af9-08c8-4047-87e6-567c389a1d51 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:18.803258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2399af9-08c8-4047-87e6-567c389a1d51 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:18.804127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2399af9-08c8-4047-87e6-567c389a1d51 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:18.805438 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2399af9-08c8-4047-87e6-567c389a1d51 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:18.806688 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2399af9-08c8-4047-87e6-567c389a1d51 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:18.807722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2399af9-08c8-4047-87e6-567c389a1d51 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:18.813698 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2419/4477] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:18 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:35:18.820872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ee1bc3e4-f23d-47e3-97af-5f141315ebc8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:18.822963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ee1bc3e4-f23d-47e3-97af-5f141315ebc8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:18.831323 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee1bc3e4-f23d-47e3-97af-5f141315ebc8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:18.833493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee1bc3e4-f23d-47e3-97af-5f141315ebc8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:18.834251 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee1bc3e4-f23d-47e3-97af-5f141315ebc8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:18.835909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee1bc3e4-f23d-47e3-97af-5f141315ebc8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:18.837468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee1bc3e4-f23d-47e3-97af-5f141315ebc8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:18.838137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee1bc3e4-f23d-47e3-97af-5f141315ebc8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:19.240217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ee1bc3e4-f23d-47e3-97af-5f141315ebc8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:19.259533 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ee1bc3e4-f23d-47e3-97af-5f141315ebc8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.443751 Aug 24 10:35:19.268098 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2420/4478] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:18 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:19.281875 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1c1b14d9-2c84-4c68-8de1-d2e46df26437 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:19.282855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1c1b14d9-2c84-4c68-8de1-d2e46df26437 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:19.309241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c1b14d9-2c84-4c68-8de1-d2e46df26437 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:19.309939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c1b14d9-2c84-4c68-8de1-d2e46df26437 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:19.310510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c1b14d9-2c84-4c68-8de1-d2e46df26437 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:19.311511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c1b14d9-2c84-4c68-8de1-d2e46df26437 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:19.312088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c1b14d9-2c84-4c68-8de1-d2e46df26437 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:19.312598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b2399af9-08c8-4047-87e6-567c389a1d51 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:19.313551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c1b14d9-2c84-4c68-8de1-d2e46df26437 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:19.327574 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b2399af9-08c8-4047-87e6-567c389a1d51 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1315 microversion: 2.1 time: 0.547307 Aug 24 10:35:19.328728 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2059/4479] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:18 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1315 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:19.333766 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a12cc40b-155a-4422-8ede-6456a3600b65 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:19.339250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a12cc40b-155a-4422-8ede-6456a3600b65 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 5ba97dc2-0a84-476b-9f9c-c7feabebef08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:19.358552 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-a12cc40b-155a-4422-8ede-6456a3600b65 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Instance 5ba97dc2-0a84-476b-9f9c-c7feabebef08 could not be found. Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a12cc40b-155a-4422-8ede-6456a3600b65 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/5ba97dc2-0a84-476b-9f9c-c7feabebef08/action HTTP/1.1 Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 15 Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: {"unpause": {}} Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 5ba97dc2-0a84-476b-9f9c-c7feabebef08 could not be found. Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '5ba97dc2-0a84-476b-9f9c-c7feabebef08', 'body': {'unpause': {}}} Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ba97dc2-0a84-476b-9f9c-c7feabebef08 could not be found. Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ba97dc2-0a84-476b-9f9c-c7feabebef08 could not be found. Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:19.360469 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:19.367922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:35:19.367922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:35:19.367922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ba97dc2-0a84-476b-9f9c-c7feabebef08 could not be found. Aug 24 10:35:19.367922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:19.367922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a12cc40b-155a-4422-8ede-6456a3600b65 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 404 to user: Instance 5ba97dc2-0a84-476b-9f9c-c7feabebef08 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:35:19.367922 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a12cc40b-155a-4422-8ede-6456a3600b65 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers/5ba97dc2-0a84-476b-9f9c-c7feabebef08/action" status: 404 len: 111 microversion: 2.1 time: 0.032385 Aug 24 10:35:19.367922 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2060/4480] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:35:19 2022] POST /compute/v2.1/servers/5ba97dc2-0a84-476b-9f9c-c7feabebef08/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:35:19.372146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0bd3e7ef-7435-4f39-86c7-c250fbd4771b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:19.372767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0bd3e7ef-7435-4f39-86c7-c250fbd4771b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:19.391262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0bd3e7ef-7435-4f39-86c7-c250fbd4771b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:19.392083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0bd3e7ef-7435-4f39-86c7-c250fbd4771b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:19.392952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0bd3e7ef-7435-4f39-86c7-c250fbd4771b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:19.393761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0bd3e7ef-7435-4f39-86c7-c250fbd4771b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:19.394337 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0bd3e7ef-7435-4f39-86c7-c250fbd4771b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:19.395664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0bd3e7ef-7435-4f39-86c7-c250fbd4771b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:19.666233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1c1b14d9-2c84-4c68-8de1-d2e46df26437 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:19.676807 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1c1b14d9-2c84-4c68-8de1-d2e46df26437 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1690 microversion: 2.1 time: 0.407012 Aug 24 10:35:19.691639 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2421/4481] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:19 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1690 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:19.828249 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0bd3e7ef-7435-4f39-86c7-c250fbd4771b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:19.842699 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0bd3e7ef-7435-4f39-86c7-c250fbd4771b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.472614 Aug 24 10:35:19.845479 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2061/4482] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:19 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:19.865922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d4c60c12-55c9-4cb0-8793-baf0c2def4bf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:19.866812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d4c60c12-55c9-4cb0-8793-baf0c2def4bf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:19.881067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4c60c12-55c9-4cb0-8793-baf0c2def4bf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:19.881755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4c60c12-55c9-4cb0-8793-baf0c2def4bf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:19.882199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4c60c12-55c9-4cb0-8793-baf0c2def4bf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:19.885512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4c60c12-55c9-4cb0-8793-baf0c2def4bf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:19.886168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4c60c12-55c9-4cb0-8793-baf0c2def4bf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:19.887053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4c60c12-55c9-4cb0-8793-baf0c2def4bf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:20.324065 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d4c60c12-55c9-4cb0-8793-baf0c2def4bf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:20.344122 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d4c60c12-55c9-4cb0-8793-baf0c2def4bf tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.482173 Aug 24 10:35:20.353726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-98becf63-b9b7-4972-a98e-0f352e1b65a8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:20.354982 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-98becf63-b9b7-4972-a98e-0f352e1b65a8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:20.360769 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2422/4483] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:19 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:20.362842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=84 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:20.367461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98becf63-b9b7-4972-a98e-0f352e1b65a8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:20.372514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98becf63-b9b7-4972-a98e-0f352e1b65a8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:20.373227 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98becf63-b9b7-4972-a98e-0f352e1b65a8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:20.374196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98becf63-b9b7-4972-a98e-0f352e1b65a8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:20.375443 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98becf63-b9b7-4972-a98e-0f352e1b65a8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:20.381166 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c6bcbd3d-5dd6-476c-b8c9-a5c84eb934f3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:20.381991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c6bcbd3d-5dd6-476c-b8c9-a5c84eb934f3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:20.382769 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98becf63-b9b7-4972-a98e-0f352e1b65a8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:20.405264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6bcbd3d-5dd6-476c-b8c9-a5c84eb934f3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:20.411634 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6bcbd3d-5dd6-476c-b8c9-a5c84eb934f3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:20.412102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6bcbd3d-5dd6-476c-b8c9-a5c84eb934f3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:20.412863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6bcbd3d-5dd6-476c-b8c9-a5c84eb934f3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:20.413767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6bcbd3d-5dd6-476c-b8c9-a5c84eb934f3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:20.414220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6bcbd3d-5dd6-476c-b8c9-a5c84eb934f3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:20.525565 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-c6bcbd3d-5dd6-476c-b8c9-a5c84eb934f3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Cannot 'unpause' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state active Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c6bcbd3d-5dd6-476c-b8c9-a5c84eb934f3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action HTTP/1.1 Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 15 Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: {"unpause": {}} Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: exception: Cannot 'unpause' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state active Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '8fb1d6b5-a27c-465a-aa10-652d2cc366ae', 'body': {'unpause': {}}} Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae in vm_state active. Cannot unpause while the instance is in this state. Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state active Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:20.527559 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:20.533113 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:20.533113 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:35:20.533113 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:35:20.533113 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state active Aug 24 10:35:20.533113 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:20.538118 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c6bcbd3d-5dd6-476c-b8c9-a5c84eb934f3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 409 to user: Cannot 'unpause' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state active {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:35:20.539637 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c6bcbd3d-5dd6-476c-b8c9-a5c84eb934f3 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action" status: 409 len: 145 microversion: 2.1 time: 0.162012 Aug 24 10:35:20.539916 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2423/4484] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:35:20 2022] POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action => generated 145 bytes in 163 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 10:35:20.549237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a10f1e96-8a7d-4751-9792-a7d05d5caf0e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:20.555308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a10f1e96-8a7d-4751-9792-a7d05d5caf0e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:20.573112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a10f1e96-8a7d-4751-9792-a7d05d5caf0e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:20.573878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a10f1e96-8a7d-4751-9792-a7d05d5caf0e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:20.574524 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a10f1e96-8a7d-4751-9792-a7d05d5caf0e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:20.575779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a10f1e96-8a7d-4751-9792-a7d05d5caf0e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:20.576407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a10f1e96-8a7d-4751-9792-a7d05d5caf0e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:20.577027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a10f1e96-8a7d-4751-9792-a7d05d5caf0e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:21.010273 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-98becf63-b9b7-4972-a98e-0f352e1b65a8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:21.027164 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-98becf63-b9b7-4972-a98e-0f352e1b65a8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1315 microversion: 2.1 time: 0.677687 Aug 24 10:35:21.035970 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2062/4485] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:20 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1315 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:35:21.057674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-358a2786-18ae-43c5-8c27-394162add223 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:21.059927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-358a2786-18ae-43c5-8c27-394162add223 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:21.093845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-358a2786-18ae-43c5-8c27-394162add223 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:21.096818 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-358a2786-18ae-43c5-8c27-394162add223 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:21.098826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-358a2786-18ae-43c5-8c27-394162add223 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:21.103191 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-358a2786-18ae-43c5-8c27-394162add223 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:21.106690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-358a2786-18ae-43c5-8c27-394162add223 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:21.107520 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-358a2786-18ae-43c5-8c27-394162add223 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:21.193623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a10f1e96-8a7d-4751-9792-a7d05d5caf0e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:21.202306 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a10f1e96-8a7d-4751-9792-a7d05d5caf0e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.656951 Aug 24 10:35:21.218180 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2424/4486] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:20 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:21.227873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3544c8cd-200d-48df-9d9b-9dd779903f3c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:21.229216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3544c8cd-200d-48df-9d9b-9dd779903f3c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:21.256445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3544c8cd-200d-48df-9d9b-9dd779903f3c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:21.257516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3544c8cd-200d-48df-9d9b-9dd779903f3c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:21.258274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3544c8cd-200d-48df-9d9b-9dd779903f3c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:21.261453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3544c8cd-200d-48df-9d9b-9dd779903f3c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:21.266303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3544c8cd-200d-48df-9d9b-9dd779903f3c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:21.267575 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3544c8cd-200d-48df-9d9b-9dd779903f3c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:21.373444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:21.400959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:21.700471 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-358a2786-18ae-43c5-8c27-394162add223 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:21.725883 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-358a2786-18ae-43c5-8c27-394162add223 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1622 microversion: 2.1 time: 0.685982 Aug 24 10:35:21.740430 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2063/4487] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:21 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1622 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:21.903705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3544c8cd-200d-48df-9d9b-9dd779903f3c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:21.917683 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3544c8cd-200d-48df-9d9b-9dd779903f3c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.694969 Aug 24 10:35:21.918899 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2425/4488] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:21 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:21.952704 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2981df23-7628-4bfc-8d58-04d6fb1c2019 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:21.953790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2981df23-7628-4bfc-8d58-04d6fb1c2019 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 45c65e75-9a76-4b49-a052-98d1f13c001b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:21.963147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:22.008470 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-2981df23-7628-4bfc-8d58-04d6fb1c2019 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Instance 45c65e75-9a76-4b49-a052-98d1f13c001b could not be found. Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2981df23-7628-4bfc-8d58-04d6fb1c2019 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/45c65e75-9a76-4b49-a052-98d1f13c001b/action HTTP/1.1 Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 18 Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: {"unshelve": null} Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 45c65e75-9a76-4b49-a052-98d1f13c001b could not be found. Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '45c65e75-9a76-4b49-a052-98d1f13c001b', 'body': {'unshelve': None}} Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45c65e75-9a76-4b49-a052-98d1f13c001b could not be found. Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45c65e75-9a76-4b49-a052-98d1f13c001b could not be found. Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:22.013536 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:22.019266 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:22.019266 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:22.019266 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:22.019266 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:22.019266 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:35:22.019266 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:35:22.019266 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45c65e75-9a76-4b49-a052-98d1f13c001b could not be found. Aug 24 10:35:22.019266 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:22.020676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2981df23-7628-4bfc-8d58-04d6fb1c2019 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 404 to user: Instance 45c65e75-9a76-4b49-a052-98d1f13c001b could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:35:22.022729 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2981df23-7628-4bfc-8d58-04d6fb1c2019 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers/45c65e75-9a76-4b49-a052-98d1f13c001b/action" status: 404 len: 111 microversion: 2.1 time: 0.080040 Aug 24 10:35:22.035400 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2064/4489] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:35:21 2022] POST /compute/v2.1/servers/45c65e75-9a76-4b49-a052-98d1f13c001b/action => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:35:22.043628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-343b37d4-05ac-4da8-85a7-8d846f9b1f44 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:22.044282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-343b37d4-05ac-4da8-85a7-8d846f9b1f44 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:22.055375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-343b37d4-05ac-4da8-85a7-8d846f9b1f44 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:22.055891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-343b37d4-05ac-4da8-85a7-8d846f9b1f44 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:22.056317 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-343b37d4-05ac-4da8-85a7-8d846f9b1f44 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:22.060204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-343b37d4-05ac-4da8-85a7-8d846f9b1f44 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:22.066641 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-343b37d4-05ac-4da8-85a7-8d846f9b1f44 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:22.071076 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1d2e5fdf-42a6-4e94-8af6-9bbc20e8d22a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:22.071834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-343b37d4-05ac-4da8-85a7-8d846f9b1f44 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:22.074610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1d2e5fdf-42a6-4e94-8af6-9bbc20e8d22a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:22.131176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d2e5fdf-42a6-4e94-8af6-9bbc20e8d22a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:22.131973 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d2e5fdf-42a6-4e94-8af6-9bbc20e8d22a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:22.133940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d2e5fdf-42a6-4e94-8af6-9bbc20e8d22a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:22.134870 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d2e5fdf-42a6-4e94-8af6-9bbc20e8d22a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:22.136056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d2e5fdf-42a6-4e94-8af6-9bbc20e8d22a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:22.139585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d2e5fdf-42a6-4e94-8af6-9bbc20e8d22a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:22.566650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-343b37d4-05ac-4da8-85a7-8d846f9b1f44 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:22.579187 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-343b37d4-05ac-4da8-85a7-8d846f9b1f44 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.539400 Aug 24 10:35:22.593309 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2426/4490] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:22 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:22.609940 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a54413ce-96cb-44cf-8a72-fb1049a21476 req-8606c05b-9886-4bd3-8097-f4d769126d38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ab2cfea-9c70-4e39-974f-beb80474d2da", "tag": "f9ad995f-7308-4040-a0b7-3ddf83743260"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:22.627980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a54413ce-96cb-44cf-8a72-fb1049a21476 req-8606c05b-9886-4bd3-8097-f4d769126d38 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:22.633672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a54413ce-96cb-44cf-8a72-fb1049a21476 req-8606c05b-9886-4bd3-8097-f4d769126d38 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:22.637893 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a54413ce-96cb-44cf-8a72-fb1049a21476 req-8606c05b-9886-4bd3-8097-f4d769126d38 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:22.677780 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a54413ce-96cb-44cf-8a72-fb1049a21476 req-8606c05b-9886-4bd3-8097-f4d769126d38 service nova] Creating event network-changed:f9ad995f-7308-4040-a0b7-3ddf83743260 for instance 6ab2cfea-9c70-4e39-974f-beb80474d2da on n-h2-849328-3 Aug 24 10:35:22.701703 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a54413ce-96cb-44cf-8a72-fb1049a21476 req-8606c05b-9886-4bd3-8097-f4d769126d38 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106387 Aug 24 10:35:22.709635 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2427/4491] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:35:22.715204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f20eb80f-c066-4462-bf36-506cbd1ca310 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:22.715985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f20eb80f-c066-4462-bf36-506cbd1ca310 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:22.728774 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f20eb80f-c066-4462-bf36-506cbd1ca310 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:22.729307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f20eb80f-c066-4462-bf36-506cbd1ca310 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:22.729757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f20eb80f-c066-4462-bf36-506cbd1ca310 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:22.730463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f20eb80f-c066-4462-bf36-506cbd1ca310 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:22.736751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f20eb80f-c066-4462-bf36-506cbd1ca310 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:22.737460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f20eb80f-c066-4462-bf36-506cbd1ca310 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:22.744279 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:23.132849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f20eb80f-c066-4462-bf36-506cbd1ca310 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:23.143388 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f20eb80f-c066-4462-bf36-506cbd1ca310 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.432306 Aug 24 10:35:23.161501 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2428/4492] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:22 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:23.167761 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-4142e84a-1a16-48ab-a718-7f19ed7f2639 req-38bee837-9e03-4edf-8342-313b40ba7ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f120f6-861a-4946-981b-47559a9c97fa", "name": "network-vif-deleted", "tag": "29330474-2cf1-47be-ab26-0c24270c9a09"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:23.188615 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4142e84a-1a16-48ab-a718-7f19ed7f2639 req-38bee837-9e03-4edf-8342-313b40ba7ddc service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:23.188944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4142e84a-1a16-48ab-a718-7f19ed7f2639 req-38bee837-9e03-4edf-8342-313b40ba7ddc service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:23.189690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4142e84a-1a16-48ab-a718-7f19ed7f2639 req-38bee837-9e03-4edf-8342-313b40ba7ddc service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:23.205949 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-4142e84a-1a16-48ab-a718-7f19ed7f2639 req-38bee837-9e03-4edf-8342-313b40ba7ddc service nova] Creating event network-vif-deleted:29330474-2cf1-47be-ab26-0c24270c9a09 for instance 09f120f6-861a-4946-981b-47559a9c97fa on n-h2-849328-3 Aug 24 10:35:23.221428 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-4142e84a-1a16-48ab-a718-7f19ed7f2639 req-38bee837-9e03-4edf-8342-313b40ba7ddc service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057824 Aug 24 10:35:23.230682 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2429/4493] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:35:23.241350 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-21bcbeb4-a441-4287-8a08-a97912951fa7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:23.242353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-21bcbeb4-a441-4287-8a08-a97912951fa7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:23.253652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:23.291910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21bcbeb4-a441-4287-8a08-a97912951fa7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:23.295586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21bcbeb4-a441-4287-8a08-a97912951fa7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:23.296300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21bcbeb4-a441-4287-8a08-a97912951fa7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:23.304832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21bcbeb4-a441-4287-8a08-a97912951fa7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:23.305955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21bcbeb4-a441-4287-8a08-a97912951fa7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:23.307866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21bcbeb4-a441-4287-8a08-a97912951fa7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:23.411296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21bcbeb4-a441-4287-8a08-a97912951fa7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:23.412744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21bcbeb4-a441-4287-8a08-a97912951fa7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:23.413415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21bcbeb4-a441-4287-8a08-a97912951fa7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:23.414130 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-21bcbeb4-a441-4287-8a08-a97912951fa7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lazy-loading 'fault' on Instance uuid 09f120f6-861a-4946-981b-47559a9c97fa {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:35:23.522782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-21bcbeb4-a441-4287-8a08-a97912951fa7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:23.538295 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-21bcbeb4-a441-4287-8a08-a97912951fa7 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 200 len: 1335 microversion: 2.1 time: 0.298705 Aug 24 10:35:23.539518 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2430/4494] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:23 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 1335 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:23.544999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-25a58095-25e6-4653-9cf6-ede0baa03492 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:23.546831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-25a58095-25e6-4653-9cf6-ede0baa03492 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:23.560422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25a58095-25e6-4653-9cf6-ede0baa03492 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:23.564723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25a58095-25e6-4653-9cf6-ede0baa03492 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:23.566939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25a58095-25e6-4653-9cf6-ede0baa03492 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:23.568431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25a58095-25e6-4653-9cf6-ede0baa03492 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:23.569324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25a58095-25e6-4653-9cf6-ede0baa03492 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:23.571210 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25a58095-25e6-4653-9cf6-ede0baa03492 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:23.602449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1d2e5fdf-42a6-4e94-8af6-9bbc20e8d22a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:23.619832 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1d2e5fdf-42a6-4e94-8af6-9bbc20e8d22a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1315 microversion: 2.1 time: 1.557346 Aug 24 10:35:23.620542 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2065/4495] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:22 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1315 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:23.663222 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-25a58095-25e6-4653-9cf6-ede0baa03492 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Cannot 'unshelve' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state active Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-25a58095-25e6-4653-9cf6-ede0baa03492 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action HTTP/1.1 Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 18 Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: {"unshelve": null} Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: exception: Cannot 'unshelve' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state active Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '8fb1d6b5-a27c-465a-aa10-652d2cc366ae', 'body': {'unshelve': None}} Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae in vm_state active. Cannot unshelve while the instance is in this state. Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 10:35:23.665290 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 10:35:23.670326 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state active Aug 24 10:35:23.670326 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:23.670326 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:23.670326 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:23.670326 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:23.670326 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:23.670326 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:23.670326 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:35:23.670326 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:35:23.670326 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state active Aug 24 10:35:23.670326 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:23.670326 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-25a58095-25e6-4653-9cf6-ede0baa03492 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 409 to user: Cannot 'unshelve' instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae while it is in vm_state active {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:35:23.670326 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-25a58095-25e6-4653-9cf6-ede0baa03492 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action" status: 409 len: 146 microversion: 2.1 time: 0.126006 Aug 24 10:35:23.670326 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2431/4496] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:35:23 2022] POST /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae/action => generated 146 bytes in 127 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:35:23.686388 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7cad7e86-0390-44f0-9f40-86bb21d3d743 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:23.687020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7cad7e86-0390-44f0-9f40-86bb21d3d743 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:23.714447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cad7e86-0390-44f0-9f40-86bb21d3d743 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:23.715468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cad7e86-0390-44f0-9f40-86bb21d3d743 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:23.716093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cad7e86-0390-44f0-9f40-86bb21d3d743 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:23.716974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cad7e86-0390-44f0-9f40-86bb21d3d743 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:23.725075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cad7e86-0390-44f0-9f40-86bb21d3d743 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:23.725958 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cad7e86-0390-44f0-9f40-86bb21d3d743 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:23.922232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-faa8f1e2-0e3d-4ee8-983d-aece30467f73 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:23.922734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-faa8f1e2-0e3d-4ee8-983d-aece30467f73 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] [instance: b0df3e3d-8b13-4314-9c1c-c99e81a23032] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:23.934871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-faa8f1e2-0e3d-4ee8-983d-aece30467f73 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:23.935361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-faa8f1e2-0e3d-4ee8-983d-aece30467f73 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:23.935798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-faa8f1e2-0e3d-4ee8-983d-aece30467f73 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:23.936545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-faa8f1e2-0e3d-4ee8-983d-aece30467f73 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:23.936998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-faa8f1e2-0e3d-4ee8-983d-aece30467f73 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:23.937447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-faa8f1e2-0e3d-4ee8-983d-aece30467f73 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:24.012781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-faa8f1e2-0e3d-4ee8-983d-aece30467f73 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] [instance: b0df3e3d-8b13-4314-9c1c-c99e81a23032] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:35:24.218459 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-faa8f1e2-0e3d-4ee8-983d-aece30467f73 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032" status: 204 len: 0 microversion: 2.1 time: 0.300336 Aug 24 10:35:24.220043 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2432/4497] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:35:23 2022] DELETE /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:35:24.234022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-da53ad81-55ab-4a53-aff0-2182ce750c96 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:24.235632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-da53ad81-55ab-4a53-aff0-2182ce750c96 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] [instance: b0df3e3d-8b13-4314-9c1c-c99e81a23032] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:24.253748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da53ad81-55ab-4a53-aff0-2182ce750c96 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:24.259265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da53ad81-55ab-4a53-aff0-2182ce750c96 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:24.260020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da53ad81-55ab-4a53-aff0-2182ce750c96 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:24.261182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da53ad81-55ab-4a53-aff0-2182ce750c96 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:24.261826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da53ad81-55ab-4a53-aff0-2182ce750c96 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:24.264121 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da53ad81-55ab-4a53-aff0-2182ce750c96 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:24.429208 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7cad7e86-0390-44f0-9f40-86bb21d3d743 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:24.446263 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7cad7e86-0390-44f0-9f40-86bb21d3d743 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.769195 Aug 24 10:35:24.452219 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2066/4498] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:23 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:24.481889 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f72bea0b-724a-4ade-bc2c-56fd4f073399 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:24.482923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f72bea0b-724a-4ade-bc2c-56fd4f073399 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:24.530686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f72bea0b-724a-4ade-bc2c-56fd4f073399 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:24.531391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f72bea0b-724a-4ade-bc2c-56fd4f073399 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:24.537585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f72bea0b-724a-4ade-bc2c-56fd4f073399 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:24.539460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f72bea0b-724a-4ade-bc2c-56fd4f073399 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:24.543899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f72bea0b-724a-4ade-bc2c-56fd4f073399 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:24.544503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f72bea0b-724a-4ade-bc2c-56fd4f073399 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:24.655160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da53ad81-55ab-4a53-aff0-2182ce750c96 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe66c7282c84f0fa2011575403c42d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf76463a8af45aaa6aa2c630bdcbb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:24.664442 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-da53ad81-55ab-4a53-aff0-2182ce750c96 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] 10.222.0.85 "GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032" status: 200 len: 1664 microversion: 2.1 time: 0.439601 Aug 24 10:35:24.665056 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2433/4499] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:24 2022] GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032 => generated 1664 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:24.691124 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-767bd16a-86d0-4f23-9223-0b05a620af84 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:24.692085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-767bd16a-86d0-4f23-9223-0b05a620af84 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 09f120f6-861a-4946-981b-47559a9c97fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:24.721297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-767bd16a-86d0-4f23-9223-0b05a620af84 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:24.721937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-767bd16a-86d0-4f23-9223-0b05a620af84 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:24.722399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-767bd16a-86d0-4f23-9223-0b05a620af84 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:24.723289 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-767bd16a-86d0-4f23-9223-0b05a620af84 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:24.723614 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-767bd16a-86d0-4f23-9223-0b05a620af84 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:24.724325 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-767bd16a-86d0-4f23-9223-0b05a620af84 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:24.765034 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-767bd16a-86d0-4f23-9223-0b05a620af84 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] HTTP exception thrown: Instance 09f120f6-861a-4946-981b-47559a9c97fa could not be found. Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-767bd16a-86d0-4f23-9223-0b05a620af84 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Request method failure captured: Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa HTTP/1.1 Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf2afGdSM86mh0RIAZFYBYhaQ4EtyTCcCD00ldy_PJZTrDPEqZsqjAaBEiSLwFHEWtlpLSXpU9lI2y_7Dlfdrd1tzCv296dD-Q1jtlqtcx2Z1VdQb3wVY7fHkhrfDX6lZ98oMTsvllOCneZWRxakMNA_j9HFWTm3gYwjAHKCNfApMTc Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 125d2dd1d22140abaa36184e3628a339 Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1145732609 Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/125d2dd1d22140abaa36184e3628a339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_125d2dd1d22140abaa36184e3628a339", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/125d2dd1d22140abaa36184e3628a339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/125d2dd1d22140abaa36184e3628a339"}]}] Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1145732609 Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 125d2dd1d22140abaa36184e3628a339 Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1145732609 Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerRescueNegativeTestJSON-1145732609-project Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 133e99904a6b4574933cad73d0f2293f Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1145732609-project Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 09f120f6-861a-4946-981b-47559a9c97fa could not be found. Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '09f120f6-861a-4946-981b-47559a9c97fa'} Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09f120f6-861a-4946-981b-47559a9c97fa could not be found. Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09f120f6-861a-4946-981b-47559a9c97fa could not be found. Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:24.770539 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:24.775116 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:24.775116 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:24.775116 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:24.775116 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:24.775116 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:35:24.775116 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:35:24.775116 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09f120f6-861a-4946-981b-47559a9c97fa could not be found. Aug 24 10:35:24.775116 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:24.776632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-767bd16a-86d0-4f23-9223-0b05a620af84 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Returning 404 to user: Instance 09f120f6-861a-4946-981b-47559a9c97fa could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:35:24.784552 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-767bd16a-86d0-4f23-9223-0b05a620af84 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa" status: 404 len: 111 microversion: 2.1 time: 0.092950 Aug 24 10:35:24.785580 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2434/4500] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:24 2022] GET /compute/v2.1/servers/09f120f6-861a-4946-981b-47559a9c97fa => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:35:24.797547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3c7d50fe-9c25-44c2-babd-59a192a87ea7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:24.802152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3c7d50fe-9c25-44c2-babd-59a192a87ea7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:24.815815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c7d50fe-9c25-44c2-babd-59a192a87ea7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:24.816576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c7d50fe-9c25-44c2-babd-59a192a87ea7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:24.817224 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c7d50fe-9c25-44c2-babd-59a192a87ea7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:24.820673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c7d50fe-9c25-44c2-babd-59a192a87ea7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:24.821370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c7d50fe-9c25-44c2-babd-59a192a87ea7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:24.824312 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c7d50fe-9c25-44c2-babd-59a192a87ea7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:25.055195 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f72bea0b-724a-4ade-bc2c-56fd4f073399 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:25.086518 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f72bea0b-724a-4ade-bc2c-56fd4f073399 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.612930 Aug 24 10:35:25.091255 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2067/4501] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:24 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:25.103772 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8b3d88ba-861a-4db9-a399-ca8680384574 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '.version_select at 0x7f4655054700>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:25.169414 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3c7d50fe-9c25-44c2-babd-59a192a87ea7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:25.183766 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8b3d88ba-861a-4db9-a399-ca8680384574 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-450899703" status: 202 len: 0 microversion: 2.1 time: 0.090493 Aug 24 10:35:25.187408 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2068/4502] 10.222.0.85 () {58 vars in 1218 bytes} [Wed Aug 24 10:35:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-450899703 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:35:25.188663 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3c7d50fe-9c25-44c2-babd-59a192a87ea7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1315 microversion: 2.1 time: 0.397108 Aug 24 10:35:25.191511 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2435/4503] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:24 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:25.211757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3922c4ab-004f-42bf-8ab9-9f096caf2348 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1957136418_updated"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:25.223915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3922c4ab-004f-42bf-8ab9-9f096caf2348 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 712f66e1-835a-430a-b1a0-386ae7b8f084] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:25.243730 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-3922c4ab-004f-42bf-8ab9-9f096caf2348 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Instance 712f66e1-835a-430a-b1a0-386ae7b8f084 could not be found. Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3922c4ab-004f-42bf-8ab9-9f096caf2348 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: request: PUT /compute/v2.1/servers/712f66e1-835a-430a-b1a0-386ae7b8f084 HTTP/1.1 Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 81 Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1957136418_updated"}} Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 712f66e1-835a-430a-b1a0-386ae7b8f084 could not be found. Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '712f66e1-835a-430a-b1a0-386ae7b8f084', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1957136418_updated'}}} Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 712f66e1-835a-430a-b1a0-386ae7b8f084 could not be found. Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 24 10:35:25.245480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:35:25.249762 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:35:25.249762 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:35:25.249762 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:35:25.249762 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 712f66e1-835a-430a-b1a0-386ae7b8f084 could not be found. Aug 24 10:35:25.249762 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:25.249762 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:25.249762 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:25.249762 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:25.249762 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:25.249762 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:25.249762 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:35:25.249762 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:35:25.249762 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 712f66e1-835a-430a-b1a0-386ae7b8f084 could not be found. Aug 24 10:35:25.249762 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:25.256622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3922c4ab-004f-42bf-8ab9-9f096caf2348 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 404 to user: Instance 712f66e1-835a-430a-b1a0-386ae7b8f084 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:35:25.257644 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3922c4ab-004f-42bf-8ab9-9f096caf2348 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "PUT /compute/v2.1/servers/712f66e1-835a-430a-b1a0-386ae7b8f084" status: 404 len: 111 microversion: 2.1 time: 0.069149 Aug 24 10:35:25.258271 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2069/4504] 10.222.0.85 () {60 vars in 1256 bytes} [Wed Aug 24 10:35:25 2022] PUT /compute/v2.1/servers/712f66e1-835a-430a-b1a0-386ae7b8f084 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:35:25.268330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-027f8332-374c-4c49-b0dd-3bf2daa78c8b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:25.269360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-027f8332-374c-4c49-b0dd-3bf2daa78c8b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:25.288351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-027f8332-374c-4c49-b0dd-3bf2daa78c8b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:25.291785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-027f8332-374c-4c49-b0dd-3bf2daa78c8b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:25.293559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-027f8332-374c-4c49-b0dd-3bf2daa78c8b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:25.297512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-027f8332-374c-4c49-b0dd-3bf2daa78c8b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:25.298260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-027f8332-374c-4c49-b0dd-3bf2daa78c8b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:25.299283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-027f8332-374c-4c49-b0dd-3bf2daa78c8b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:25.692794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-46ec7157-bbb2-45cf-93ba-63898a2b5dc5 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:25.694935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-46ec7157-bbb2-45cf-93ba-63898a2b5dc5 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] [instance: b0df3e3d-8b13-4314-9c1c-c99e81a23032] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:25.707437 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46ec7157-bbb2-45cf-93ba-63898a2b5dc5 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:25.711127 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-027f8332-374c-4c49-b0dd-3bf2daa78c8b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:25.714193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46ec7157-bbb2-45cf-93ba-63898a2b5dc5 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:25.719301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46ec7157-bbb2-45cf-93ba-63898a2b5dc5 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:25.720633 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46ec7157-bbb2-45cf-93ba-63898a2b5dc5 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:25.721945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46ec7157-bbb2-45cf-93ba-63898a2b5dc5 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:25.722575 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46ec7157-bbb2-45cf-93ba-63898a2b5dc5 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:25.723521 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-027f8332-374c-4c49-b0dd-3bf2daa78c8b tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.459618 Aug 24 10:35:25.737156 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2436/4505] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:25 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:25.753378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6d456086-1652-4fe7-aa72-25008c7ceca8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:25.754006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6d456086-1652-4fe7-aa72-25008c7ceca8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:25.773904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d456086-1652-4fe7-aa72-25008c7ceca8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:25.774473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d456086-1652-4fe7-aa72-25008c7ceca8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:25.775417 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d456086-1652-4fe7-aa72-25008c7ceca8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:25.775886 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:25.776524 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d456086-1652-4fe7-aa72-25008c7ceca8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:25.777036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d456086-1652-4fe7-aa72-25008c7ceca8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:25.777745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d456086-1652-4fe7-aa72-25008c7ceca8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:26.087062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6d456086-1652-4fe7-aa72-25008c7ceca8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:26.100166 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6d456086-1652-4fe7-aa72-25008c7ceca8 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.351132 Aug 24 10:35:26.102535 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2437/4506] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:25 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:35:26.128083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-059bced9-e5ec-46b5-86ac-a04e83b56909 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-059bced9-e5ec-46b5-86ac-a04e83b56909 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: request: PUT /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae HTTP/1.1 Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 280 Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '8fb1d6b5-a27c-465a-aa10-652d2cc366ae', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:26.136675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:26.140747 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:26.140747 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:26.140747 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:35:26.140747 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:35:26.140747 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:35:26.140747 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:35:26.140747 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:35:26.140747 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:35:26.140747 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:35:26.140747 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:35:26.140747 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:35:26.140747 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:35:26.140747 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:35:26.140747 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:35:26.140747 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 10:35:26.140747 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:26.140747 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:26.140747 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:26.140747 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:26.140747 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:26.140747 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:26.140747 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:35:26.140747 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:35:26.140747 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 10:35:26.140747 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:26.145764 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-059bced9-e5ec-46b5-86ac-a04e83b56909 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:35:26.146880 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-059bced9-e5ec-46b5-86ac-a04e83b56909 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "PUT /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 400 len: 619 microversion: 2.1 time: 0.030026 Aug 24 10:35:26.152559 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2438/4507] 10.222.0.85 () {60 vars in 1257 bytes} [Wed Aug 24 10:35:26 2022] PUT /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 619 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:35:26.170781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-032da4a7-4643-472e-bd18-45033b68800f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:26.175787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-032da4a7-4643-472e-bd18-45033b68800f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:26.198059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-032da4a7-4643-472e-bd18-45033b68800f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:26.200064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-032da4a7-4643-472e-bd18-45033b68800f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:26.202017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-032da4a7-4643-472e-bd18-45033b68800f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:26.203322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-032da4a7-4643-472e-bd18-45033b68800f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:26.207978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-032da4a7-4643-472e-bd18-45033b68800f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:26.209330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-032da4a7-4643-472e-bd18-45033b68800f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:26.642915 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-032da4a7-4643-472e-bd18-45033b68800f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:26.657718 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-032da4a7-4643-472e-bd18-45033b68800f tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.499166 Aug 24 10:35:26.658341 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2439/4508] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:26 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:35:26.664608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9f3f6158-fdc8-4ac6-aad5-db2eed1e3d9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:26.666641 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9f3f6158-fdc8-4ac6-aad5-db2eed1e3d9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:26.688524 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f3f6158-fdc8-4ac6-aad5-db2eed1e3d9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:26.689507 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f3f6158-fdc8-4ac6-aad5-db2eed1e3d9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:26.690948 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f3f6158-fdc8-4ac6-aad5-db2eed1e3d9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:26.692752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f3f6158-fdc8-4ac6-aad5-db2eed1e3d9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:26.693490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f3f6158-fdc8-4ac6-aad5-db2eed1e3d9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:26.694147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f3f6158-fdc8-4ac6-aad5-db2eed1e3d9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:26.728315 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-46ec7157-bbb2-45cf-93ba-63898a2b5dc5 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe66c7282c84f0fa2011575403c42d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf76463a8af45aaa6aa2c630bdcbb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:26.743353 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-46ec7157-bbb2-45cf-93ba-63898a2b5dc5 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] 10.222.0.85 "GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032" status: 200 len: 1664 microversion: 2.1 time: 1.059675 Aug 24 10:35:26.747168 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2070/4509] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:25 2022] GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032 => generated 1664 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:26.758519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-06005e16-7de8-4958-93ae-c647e9e75dff tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:26.763361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-06005e16-7de8-4958-93ae-c647e9e75dff tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:26.775818 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06005e16-7de8-4958-93ae-c647e9e75dff tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:26.776588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06005e16-7de8-4958-93ae-c647e9e75dff tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:26.777242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06005e16-7de8-4958-93ae-c647e9e75dff tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:26.778142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06005e16-7de8-4958-93ae-c647e9e75dff tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:26.778760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06005e16-7de8-4958-93ae-c647e9e75dff tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:26.779462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06005e16-7de8-4958-93ae-c647e9e75dff tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:27.012781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9f3f6158-fdc8-4ac6-aad5-db2eed1e3d9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:27.030274 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9f3f6158-fdc8-4ac6-aad5-db2eed1e3d9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1315 microversion: 2.1 time: 0.370627 Aug 24 10:35:27.032557 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2440/4510] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:26 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:27.772484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0531952f-bfbd-4391-8a3c-6c2778d9edd6 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:27.773113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0531952f-bfbd-4391-8a3c-6c2778d9edd6 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] [instance: b0df3e3d-8b13-4314-9c1c-c99e81a23032] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:27.780502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0531952f-bfbd-4391-8a3c-6c2778d9edd6 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:27.781007 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0531952f-bfbd-4391-8a3c-6c2778d9edd6 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:27.782171 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0531952f-bfbd-4391-8a3c-6c2778d9edd6 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:27.782272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0531952f-bfbd-4391-8a3c-6c2778d9edd6 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:27.789664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0531952f-bfbd-4391-8a3c-6c2778d9edd6 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:27.790711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0531952f-bfbd-4391-8a3c-6c2778d9edd6 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:27.818732 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-06005e16-7de8-4958-93ae-c647e9e75dff tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:27.831550 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-06005e16-7de8-4958-93ae-c647e9e75dff tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 1.077619 Aug 24 10:35:27.832262 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2071/4511] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:26 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:27.853230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a3fb63c9-26c1-4800-a59a-717abd5b328a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a3fb63c9-26c1-4800-a59a-717abd5b328a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: request: PUT /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae HTTP/1.1 Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 24 Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: {"server": {"name": ""}} Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '8fb1d6b5-a27c-465a-aa10-652d2cc366ae', 'body': {'server': {'name': ''}}} Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi '' Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:35:27.857804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:35:27.869597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 24 10:35:27.869597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:27.869597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:27.869597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:27.869597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:27.869597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:27.869597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:27.869597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:35:27.869597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:35:27.869597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 24 10:35:27.869597 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:35:27.869597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a3fb63c9-26c1-4800-a59a-717abd5b328a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:35:27.869597 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a3fb63c9-26c1-4800-a59a-717abd5b328a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "PUT /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 400 len: 108 microversion: 2.1 time: 0.013129 Aug 24 10:35:27.869597 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2072/4512] 10.222.0.85 () {60 vars in 1256 bytes} [Wed Aug 24 10:35:27 2022] PUT /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 10:35:27.879630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-60406f62-df65-4f72-ac85-c313a4768e5e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:27.883346 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-60406f62-df65-4f72-ac85-c313a4768e5e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:27.898342 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60406f62-df65-4f72-ac85-c313a4768e5e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:27.898851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60406f62-df65-4f72-ac85-c313a4768e5e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:27.905298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60406f62-df65-4f72-ac85-c313a4768e5e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:27.906657 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60406f62-df65-4f72-ac85-c313a4768e5e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:27.906958 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60406f62-df65-4f72-ac85-c313a4768e5e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:27.907498 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60406f62-df65-4f72-ac85-c313a4768e5e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:28.210315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0531952f-bfbd-4391-8a3c-6c2778d9edd6 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe66c7282c84f0fa2011575403c42d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf76463a8af45aaa6aa2c630bdcbb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:28.228468 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0531952f-bfbd-4391-8a3c-6c2778d9edd6 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] 10.222.0.85 "GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032" status: 200 len: 1664 microversion: 2.1 time: 0.459078 Aug 24 10:35:28.248967 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2441/4513] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:27 2022] GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032 => generated 1664 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:28.258849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1ce19b57-1c12-4f4f-a9bd-2b893543b95e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:28.263110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1ce19b57-1c12-4f4f-a9bd-2b893543b95e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:28.286192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ce19b57-1c12-4f4f-a9bd-2b893543b95e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:28.297985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ce19b57-1c12-4f4f-a9bd-2b893543b95e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:28.298720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ce19b57-1c12-4f4f-a9bd-2b893543b95e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:28.299603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ce19b57-1c12-4f4f-a9bd-2b893543b95e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:28.303233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ce19b57-1c12-4f4f-a9bd-2b893543b95e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:28.307984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ce19b57-1c12-4f4f-a9bd-2b893543b95e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:28.699670 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-60406f62-df65-4f72-ac85-c313a4768e5e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:28.709443 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-60406f62-df65-4f72-ac85-c313a4768e5e tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1506 microversion: 2.1 time: 0.841546 Aug 24 10:35:28.733533 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2073/4514] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:27 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1506 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:28.800567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1ce19b57-1c12-4f4f-a9bd-2b893543b95e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:28.816662 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1ce19b57-1c12-4f4f-a9bd-2b893543b95e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1315 microversion: 2.1 time: 0.562270 Aug 24 10:35:28.832970 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2442/4515] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:28 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1315 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:29.256318 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-45b82e56-a3fe-4c98-9418-af59d3ab61f1 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:29.257540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-45b82e56-a3fe-4c98-9418-af59d3ab61f1 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] [instance: b0df3e3d-8b13-4314-9c1c-c99e81a23032] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:29.269985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-45b82e56-a3fe-4c98-9418-af59d3ab61f1 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:29.270516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-45b82e56-a3fe-4c98-9418-af59d3ab61f1 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:29.270914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-45b82e56-a3fe-4c98-9418-af59d3ab61f1 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:29.271661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-45b82e56-a3fe-4c98-9418-af59d3ab61f1 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:29.272119 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-45b82e56-a3fe-4c98-9418-af59d3ab61f1 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:29.272550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-45b82e56-a3fe-4c98-9418-af59d3ab61f1 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:29.503395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-45b82e56-a3fe-4c98-9418-af59d3ab61f1 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe66c7282c84f0fa2011575403c42d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf76463a8af45aaa6aa2c630bdcbb54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:29.584728 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-45b82e56-a3fe-4c98-9418-af59d3ab61f1 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] 10.222.0.85 "GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032" status: 200 len: 1596 microversion: 2.1 time: 0.332159 Aug 24 10:35:29.585763 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2074/4516] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:29 2022] GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032 => generated 1596 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:29.842623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c1991b72-3d25-4e19-8ea6-5dd7dcb1d6d9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:29.846364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c1991b72-3d25-4e19-8ea6-5dd7dcb1d6d9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:29.874636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1991b72-3d25-4e19-8ea6-5dd7dcb1d6d9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:29.887230 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1991b72-3d25-4e19-8ea6-5dd7dcb1d6d9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:29.887979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1991b72-3d25-4e19-8ea6-5dd7dcb1d6d9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:29.889434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1991b72-3d25-4e19-8ea6-5dd7dcb1d6d9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:29.903009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1991b72-3d25-4e19-8ea6-5dd7dcb1d6d9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:29.903685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1991b72-3d25-4e19-8ea6-5dd7dcb1d6d9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:30.176957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fb2439ff-4bcf-48a2-bfea-5ed7afd8fb98 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-533646397", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "c36cbae7-d73d-45df-8057-3341e4f7db44"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:30.261312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-fb2439ff-4bcf-48a2-bfea-5ed7afd8fb98 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] validate_networks() for [('c36cbae7-d73d-45df-8057-3341e4f7db44', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:35:31.163606 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fb2439ff-4bcf-48a2-bfea-5ed7afd8fb98 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:35:31.164031 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fb2439ff-4bcf-48a2-bfea-5ed7afd8fb98 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:35:31.164553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fb2439ff-4bcf-48a2-bfea-5ed7afd8fb98 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:35:31.164963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fb2439ff-4bcf-48a2-bfea-5ed7afd8fb98 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:35:31.165527 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fb2439ff-4bcf-48a2-bfea-5ed7afd8fb98 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:35:31.178139 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb2439ff-4bcf-48a2-bfea-5ed7afd8fb98 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:31.178664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb2439ff-4bcf-48a2-bfea-5ed7afd8fb98 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:31.181649 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb2439ff-4bcf-48a2-bfea-5ed7afd8fb98 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:31.182415 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb2439ff-4bcf-48a2-bfea-5ed7afd8fb98 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:31.182896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb2439ff-4bcf-48a2-bfea-5ed7afd8fb98 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:31.183332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb2439ff-4bcf-48a2-bfea-5ed7afd8fb98 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:31.225554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-fb2439ff-4bcf-48a2-bfea-5ed7afd8fb98 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Getting quotas for project b4137804f32f459394ac7aa54f6bacb3. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:35:31.238761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-fb2439ff-4bcf-48a2-bfea-5ed7afd8fb98 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Getting quotas for user f2aacca6ee8646349b6f385adb8b9ef3 and project b4137804f32f459394ac7aa54f6bacb3. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:35:31.273187 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fb2439ff-4bcf-48a2-bfea-5ed7afd8fb98 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Going to run 2 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:35:31.279528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fb2439ff-4bcf-48a2-bfea-5ed7afd8fb98 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: 6548607f-1ff0-4a77-882d-7ccdfeffc55f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:35:31.338830 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c1991b72-3d25-4e19-8ea6-5dd7dcb1d6d9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:31.367319 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c1991b72-3d25-4e19-8ea6-5dd7dcb1d6d9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1315 microversion: 2.1 time: 1.528829 Aug 24 10:35:31.367958 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2443/4517] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:29 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1315 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:31.402722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-88bed796-20b6-449b-8ecb-c04b61ac6b7b req-ca3ba0de-6a3b-45e9-b3cd-86dcc82f2fae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ab2cfea-9c70-4e39-974f-beb80474d2da", "name": "network-vif-plugged", "status": "completed", "tag": "f9ad995f-7308-4040-a0b7-3ddf83743260"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:31.425666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fb2439ff-4bcf-48a2-bfea-5ed7afd8fb98 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: c3620de3-2e71-4135-bd71-246c54910ef6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=6548607f-1ff0-4a77-882d-7ccdfeffc55f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:35:31.437442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-88bed796-20b6-449b-8ecb-c04b61ac6b7b req-ca3ba0de-6a3b-45e9-b3cd-86dcc82f2fae service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:31.437932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-88bed796-20b6-449b-8ecb-c04b61ac6b7b req-ca3ba0de-6a3b-45e9-b3cd-86dcc82f2fae service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:31.438361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-88bed796-20b6-449b-8ecb-c04b61ac6b7b req-ca3ba0de-6a3b-45e9-b3cd-86dcc82f2fae service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:31.464930 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-88bed796-20b6-449b-8ecb-c04b61ac6b7b req-ca3ba0de-6a3b-45e9-b3cd-86dcc82f2fae service nova] Creating event network-vif-plugged:f9ad995f-7308-4040-a0b7-3ddf83743260 for instance 6ab2cfea-9c70-4e39-974f-beb80474d2da on n-h2-849328-3 Aug 24 10:35:31.477680 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-88bed796-20b6-449b-8ecb-c04b61ac6b7b req-ca3ba0de-6a3b-45e9-b3cd-86dcc82f2fae service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108405 Aug 24 10:35:31.478311 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2444/4518] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:35:31.495793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-7f68c4ef-647e-4a3c-96d0-03849d0b29ce req-dc37e8de-2707-46be-a677-a098e992f954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0df3e3d-8b13-4314-9c1c-c99e81a23032", "name": "network-vif-deleted", "tag": "987eb300-121e-4221-8d70-755c9e215d60"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:31.516778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7f68c4ef-647e-4a3c-96d0-03849d0b29ce req-dc37e8de-2707-46be-a677-a098e992f954 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:31.521917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7f68c4ef-647e-4a3c-96d0-03849d0b29ce req-dc37e8de-2707-46be-a677-a098e992f954 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:31.522617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7f68c4ef-647e-4a3c-96d0-03849d0b29ce req-dc37e8de-2707-46be-a677-a098e992f954 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:31.546857 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-7f68c4ef-647e-4a3c-96d0-03849d0b29ce req-dc37e8de-2707-46be-a677-a098e992f954 service nova] Creating event network-vif-deleted:987eb300-121e-4221-8d70-755c9e215d60 for instance b0df3e3d-8b13-4314-9c1c-c99e81a23032 on n-h1-849328-3 Aug 24 10:35:31.564915 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-7f68c4ef-647e-4a3c-96d0-03849d0b29ce req-dc37e8de-2707-46be-a677-a098e992f954 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084900 Aug 24 10:35:31.567789 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2445/4519] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:35:31.594666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-94c90748-c6a4-41a8-a9a6-23e6722856ec tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:31.598845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-94c90748-c6a4-41a8-a9a6-23e6722856ec tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] [instance: b0df3e3d-8b13-4314-9c1c-c99e81a23032] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:31.620129 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94c90748-c6a4-41a8-a9a6-23e6722856ec tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:31.621768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94c90748-c6a4-41a8-a9a6-23e6722856ec tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:31.624813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94c90748-c6a4-41a8-a9a6-23e6722856ec tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:31.629481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94c90748-c6a4-41a8-a9a6-23e6722856ec tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:31.633748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94c90748-c6a4-41a8-a9a6-23e6722856ec tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:31.634194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94c90748-c6a4-41a8-a9a6-23e6722856ec tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:31.656171 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-94c90748-c6a4-41a8-a9a6-23e6722856ec tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] HTTP exception thrown: Instance b0df3e3d-8b13-4314-9c1c-c99e81a23032 could not be found. Aug 24 10:35:31.658507 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fb2439ff-4bcf-48a2-bfea-5ed7afd8fb98 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.764721 Aug 24 10:35:31.660360 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2075/4520] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:35:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-94c90748-c6a4-41a8-a9a6-23e6722856ec tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Request method failure captured: Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032 HTTP/1.1 Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf6Xwv-xLN39O6V4vc-15odahF7vWPltiawWRuOFGjQ9k21nEnWc0gLJ2czgY3qgEAMD002MZBG5IwOrY-GfVvuFA5RBMQejqbNwPR7fz-RlZoa_5rYG6WuF4LwVY6xHUPx7MZA9FsEM6Q6yll9BfDUAjVBjUHNnIeOtG8IQOqizHz4 Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 6bf76463a8af45aaa6aa2c630bdcbb54 Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersTestFqdnHostnames-1140609662 Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6bf76463a8af45aaa6aa2c630bdcbb54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6bf76463a8af45aaa6aa2c630bdcbb54", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6bf76463a8af45aaa6aa2c630bdcbb54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6bf76463a8af45aaa6aa2c630bdcbb54"}]}] Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersTestFqdnHostnames-1140609662 Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 6bf76463a8af45aaa6aa2c630bdcbb54 Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1140609662 Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersTestFqdnHostnames-1140609662-project Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: dbe66c7282c84f0fa2011575403c42d7 Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersTestFqdnHostnames-1140609662-project Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance b0df3e3d-8b13-4314-9c1c-c99e81a23032 could not be found. Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'b0df3e3d-8b13-4314-9c1c-c99e81a23032'} Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0df3e3d-8b13-4314-9c1c-c99e81a23032 could not be found. Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0df3e3d-8b13-4314-9c1c-c99e81a23032 could not be found. Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:31.662421 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:31.667080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:31.667080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:31.667080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:31.667080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:35:31.667080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:35:31.667080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0df3e3d-8b13-4314-9c1c-c99e81a23032 could not be found. Aug 24 10:35:31.667080 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:31.674047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-94c90748-c6a4-41a8-a9a6-23e6722856ec tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Returning 404 to user: Instance b0df3e3d-8b13-4314-9c1c-c99e81a23032 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:35:31.675888 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-94c90748-c6a4-41a8-a9a6-23e6722856ec tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] 10.222.0.85 "GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032" status: 404 len: 111 microversion: 2.1 time: 0.103982 Aug 24 10:35:31.678174 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6ea05ad4-e69a-4144-86ca-43902a3a7548 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:31.689735 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2446/4521] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:31 2022] GET /compute/v2.1/servers/b0df3e3d-8b13-4314-9c1c-c99e81a23032 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:35:31.699944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f76a8ab-01be-487c-97b9-af41d1770f09 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] Calling method '.version_select at 0x7f46545e3280>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:31.709143 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6ea05ad4-e69a-4144-86ca-43902a3a7548 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:31.710413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6ea05ad4-e69a-4144-86ca-43902a3a7548 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Searching by: {'deleted': False, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:35:31.764898 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0f76a8ab-01be-487c-97b9-af41d1770f09 tempest-ServersTestFqdnHostnames-1140609662 tempest-ServersTestFqdnHostnames-1140609662-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1828607821" status: 202 len: 0 microversion: 2.1 time: 0.069413 Aug 24 10:35:31.767530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea05ad4-e69a-4144-86ca-43902a3a7548 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:31.767938 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2447/4522] 10.222.0.85 () {58 vars in 1221 bytes} [Wed Aug 24 10:35:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1828607821 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:35:31.768597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea05ad4-e69a-4144-86ca-43902a3a7548 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:31.769194 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea05ad4-e69a-4144-86ca-43902a3a7548 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:31.770283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea05ad4-e69a-4144-86ca-43902a3a7548 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:31.770887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea05ad4-e69a-4144-86ca-43902a3a7548 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:31.771455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea05ad4-e69a-4144-86ca-43902a3a7548 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:31.805760 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6ea05ad4-e69a-4144-86ca-43902a3a7548 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.136853 Aug 24 10:35:31.810649 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2076/4523] 10.222.0.85 () {58 vars in 1125 bytes} [Wed Aug 24 10:35:31 2022] GET /compute/v2.1/servers => generated 675 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:35:31.819106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-32e44bfc-c06a-4ab3-afd4-b07ed8f4e254 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:31.819651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-32e44bfc-c06a-4ab3-afd4-b07ed8f4e254 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: c3620de3-2e71-4135-bd71-246c54910ef6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:31.955666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-32e44bfc-c06a-4ab3-afd4-b07ed8f4e254 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:31.963704 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-32e44bfc-c06a-4ab3-afd4-b07ed8f4e254 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6" status: 200 len: 1219 microversion: 2.1 time: 0.149060 Aug 24 10:35:31.970239 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2448/4524] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:31 2022] GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6 => generated 1219 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:32.394736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bfae50e0-7c93-49a1-ac6f-33340be67bae tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:32.395362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bfae50e0-7c93-49a1-ac6f-33340be67bae tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:32.420397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfae50e0-7c93-49a1-ac6f-33340be67bae tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:32.420946 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfae50e0-7c93-49a1-ac6f-33340be67bae tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:32.421420 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfae50e0-7c93-49a1-ac6f-33340be67bae tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:32.422150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfae50e0-7c93-49a1-ac6f-33340be67bae tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:32.422727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfae50e0-7c93-49a1-ac6f-33340be67bae tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:32.423039 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfae50e0-7c93-49a1-ac6f-33340be67bae tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:32.854353 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bfae50e0-7c93-49a1-ac6f-33340be67bae tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:32.887300 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bfae50e0-7c93-49a1-ac6f-33340be67bae tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1315 microversion: 2.1 time: 0.496382 Aug 24 10:35:32.888400 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2077/4525] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:32 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:32.992011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f1abd058-70ed-4516-8d94-ceb9de255035 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:32.992639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f1abd058-70ed-4516-8d94-ceb9de255035 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: c3620de3-2e71-4135-bd71-246c54910ef6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:33.184701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f1abd058-70ed-4516-8d94-ceb9de255035 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:33.218817 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f1abd058-70ed-4516-8d94-ceb9de255035 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6" status: 200 len: 1219 microversion: 2.1 time: 0.232331 Aug 24 10:35:33.233380 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2449/4526] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:32 2022] GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6 => generated 1219 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:33.919382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-899060cb-a1df-4575-9ba5-a93025686d20 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:33.926177 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-899060cb-a1df-4575-9ba5-a93025686d20 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:33.983538 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-899060cb-a1df-4575-9ba5-a93025686d20 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:33.994422 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-899060cb-a1df-4575-9ba5-a93025686d20 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:33.999970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-899060cb-a1df-4575-9ba5-a93025686d20 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:34.008643 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-899060cb-a1df-4575-9ba5-a93025686d20 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:34.012577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-899060cb-a1df-4575-9ba5-a93025686d20 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:34.013371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-899060cb-a1df-4575-9ba5-a93025686d20 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:34.243838 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-72cdaee0-09ae-4a3f-b491-3c072bc41397 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:34.244978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-72cdaee0-09ae-4a3f-b491-3c072bc41397 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: c3620de3-2e71-4135-bd71-246c54910ef6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:34.279045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72cdaee0-09ae-4a3f-b491-3c072bc41397 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:34.279045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72cdaee0-09ae-4a3f-b491-3c072bc41397 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:34.279505 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72cdaee0-09ae-4a3f-b491-3c072bc41397 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:34.280317 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72cdaee0-09ae-4a3f-b491-3c072bc41397 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:34.280785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72cdaee0-09ae-4a3f-b491-3c072bc41397 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:34.281238 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72cdaee0-09ae-4a3f-b491-3c072bc41397 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:34.348649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:34.679376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-899060cb-a1df-4575-9ba5-a93025686d20 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:34.689431 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-899060cb-a1df-4575-9ba5-a93025686d20 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1502 microversion: 2.1 time: 0.778496 Aug 24 10:35:34.698469 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2078/4527] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:33 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1502 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:34.726473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3fd6a685-bbe5-4fc7-a7b2-62d6944bde02 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:34.736366 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-72cdaee0-09ae-4a3f-b491-3c072bc41397 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:34.751802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fd6a685-bbe5-4fc7-a7b2-62d6944bde02 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:34.752574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fd6a685-bbe5-4fc7-a7b2-62d6944bde02 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:34.753178 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fd6a685-bbe5-4fc7-a7b2-62d6944bde02 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:34.753865 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-72cdaee0-09ae-4a3f-b491-3c072bc41397 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6" status: 200 len: 1223 microversion: 2.1 time: 0.517399 Aug 24 10:35:34.754478 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2450/4528] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:34 2022] GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6 => generated 1223 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:35:34.780923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3fd6a685-bbe5-4fc7-a7b2-62d6944bde02 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Going to try to stop instance {{(pid=122432) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 10:35:34.856953 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3fd6a685-bbe5-4fc7-a7b2-62d6944bde02 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da/action" status: 202 len: 0 microversion: 2.1 time: 0.135800 Aug 24 10:35:34.860599 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2079/4529] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:35:34 2022] POST /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 10:35:34.869556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-22617307-b93c-4453-8bda-1fbc1391428c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:34.869556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-22617307-b93c-4453-8bda-1fbc1391428c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:34.888898 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22617307-b93c-4453-8bda-1fbc1391428c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:34.903601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22617307-b93c-4453-8bda-1fbc1391428c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:34.904303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22617307-b93c-4453-8bda-1fbc1391428c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:34.905475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22617307-b93c-4453-8bda-1fbc1391428c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:34.905956 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22617307-b93c-4453-8bda-1fbc1391428c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:34.906694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22617307-b93c-4453-8bda-1fbc1391428c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:35.602625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-22617307-b93c-4453-8bda-1fbc1391428c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:35.624539 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-22617307-b93c-4453-8bda-1fbc1391428c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1512 microversion: 2.1 time: 0.760247 Aug 24 10:35:35.625733 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2451/4530] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:34 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1512 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:35.782908 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-99a1419e-5898-4713-94e8-65243425822b tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:35.783662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-99a1419e-5898-4713-94e8-65243425822b tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: c3620de3-2e71-4135-bd71-246c54910ef6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:35.812385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99a1419e-5898-4713-94e8-65243425822b tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:35.814819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99a1419e-5898-4713-94e8-65243425822b tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:35.818086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99a1419e-5898-4713-94e8-65243425822b tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:35.820418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99a1419e-5898-4713-94e8-65243425822b tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:35.827964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99a1419e-5898-4713-94e8-65243425822b tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:35.828645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99a1419e-5898-4713-94e8-65243425822b tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:36.436791 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-99a1419e-5898-4713-94e8-65243425822b tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:36.458029 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-99a1419e-5898-4713-94e8-65243425822b tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6" status: 200 len: 1279 microversion: 2.1 time: 0.681249 Aug 24 10:35:36.473865 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2080/4531] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:35 2022] GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6 => generated 1279 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:36.646936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-82f9a9ff-c788-4961-bca6-3be135a1670a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:36.647690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-82f9a9ff-c788-4961-bca6-3be135a1670a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:36.680211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82f9a9ff-c788-4961-bca6-3be135a1670a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:36.680710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82f9a9ff-c788-4961-bca6-3be135a1670a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:36.681168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82f9a9ff-c788-4961-bca6-3be135a1670a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:36.681890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82f9a9ff-c788-4961-bca6-3be135a1670a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:36.682346 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82f9a9ff-c788-4961-bca6-3be135a1670a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:36.682769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82f9a9ff-c788-4961-bca6-3be135a1670a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:37.484287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-46873fd4-5002-483b-a9fe-25681b0a5eb7 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:37.484798 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-46873fd4-5002-483b-a9fe-25681b0a5eb7 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: c3620de3-2e71-4135-bd71-246c54910ef6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:37.497995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46873fd4-5002-483b-a9fe-25681b0a5eb7 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:37.498522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46873fd4-5002-483b-a9fe-25681b0a5eb7 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:37.498958 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46873fd4-5002-483b-a9fe-25681b0a5eb7 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:37.499698 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46873fd4-5002-483b-a9fe-25681b0a5eb7 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:37.500144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46873fd4-5002-483b-a9fe-25681b0a5eb7 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:37.526879 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46873fd4-5002-483b-a9fe-25681b0a5eb7 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:37.694928 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-82f9a9ff-c788-4961-bca6-3be135a1670a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:37.709543 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-82f9a9ff-c788-4961-bca6-3be135a1670a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1512 microversion: 2.1 time: 1.065918 Aug 24 10:35:37.710238 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2452/4532] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:36 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1512 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:38.124761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-46873fd4-5002-483b-a9fe-25681b0a5eb7 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:38.143697 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-46873fd4-5002-483b-a9fe-25681b0a5eb7 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6" status: 200 len: 1277 microversion: 2.1 time: 0.663483 Aug 24 10:35:38.163303 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2081/4533] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:37 2022] GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6 => generated 1277 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:35:38.732478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8081b4a9-539c-4423-bb99-43105a5a64a5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:38.733207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8081b4a9-539c-4423-bb99-43105a5a64a5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:38.752339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8081b4a9-539c-4423-bb99-43105a5a64a5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:38.755363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8081b4a9-539c-4423-bb99-43105a5a64a5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:38.755836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8081b4a9-539c-4423-bb99-43105a5a64a5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:38.756579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8081b4a9-539c-4423-bb99-43105a5a64a5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:38.758486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8081b4a9-539c-4423-bb99-43105a5a64a5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:38.759941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8081b4a9-539c-4423-bb99-43105a5a64a5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:39.172264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-360c7503-2029-4799-91e9-34a17a30516b tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:39.173890 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-360c7503-2029-4799-91e9-34a17a30516b tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: c3620de3-2e71-4135-bd71-246c54910ef6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:39.190839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8081b4a9-539c-4423-bb99-43105a5a64a5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:39.203600 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8081b4a9-539c-4423-bb99-43105a5a64a5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1512 microversion: 2.1 time: 0.475843 Aug 24 10:35:39.211832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-360c7503-2029-4799-91e9-34a17a30516b tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:39.212811 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2453/4534] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:38 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1512 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:35:39.213599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-360c7503-2029-4799-91e9-34a17a30516b tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:39.214296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-360c7503-2029-4799-91e9-34a17a30516b tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:39.219373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-360c7503-2029-4799-91e9-34a17a30516b tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:39.220084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-360c7503-2029-4799-91e9-34a17a30516b tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:39.222264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-360c7503-2029-4799-91e9-34a17a30516b tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:39.515501 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-360c7503-2029-4799-91e9-34a17a30516b tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:39.536225 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-360c7503-2029-4799-91e9-34a17a30516b tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6" status: 200 len: 1277 microversion: 2.1 time: 0.370831 Aug 24 10:35:39.537647 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2082/4535] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:39 2022] GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6 => generated 1277 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:35:40.248511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-76063d1c-d6f6-43a0-86de-08de3b4c7c4a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:40.250944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-76063d1c-d6f6-43a0-86de-08de3b4c7c4a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:40.299266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76063d1c-d6f6-43a0-86de-08de3b4c7c4a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:40.300217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76063d1c-d6f6-43a0-86de-08de3b4c7c4a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:40.309657 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76063d1c-d6f6-43a0-86de-08de3b4c7c4a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:40.313296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76063d1c-d6f6-43a0-86de-08de3b4c7c4a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:40.314497 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76063d1c-d6f6-43a0-86de-08de3b4c7c4a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:40.318003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76063d1c-d6f6-43a0-86de-08de3b4c7c4a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:40.560085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6d0385d8-8f32-4a7a-946b-b9ce58f15155 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:40.561499 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6d0385d8-8f32-4a7a-946b-b9ce58f15155 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: c3620de3-2e71-4135-bd71-246c54910ef6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:40.573581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d0385d8-8f32-4a7a-946b-b9ce58f15155 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:40.579342 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d0385d8-8f32-4a7a-946b-b9ce58f15155 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:40.580458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d0385d8-8f32-4a7a-946b-b9ce58f15155 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:40.594384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d0385d8-8f32-4a7a-946b-b9ce58f15155 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:40.598645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d0385d8-8f32-4a7a-946b-b9ce58f15155 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:40.599703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d0385d8-8f32-4a7a-946b-b9ce58f15155 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:40.866548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-76063d1c-d6f6-43a0-86de-08de3b4c7c4a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:40.874980 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-76063d1c-d6f6-43a0-86de-08de3b4c7c4a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1512 microversion: 2.1 time: 0.634913 Aug 24 10:35:40.905426 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2454/4536] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:40 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1512 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:40.912210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6d0385d8-8f32-4a7a-946b-b9ce58f15155 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:40.922196 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6d0385d8-8f32-4a7a-946b-b9ce58f15155 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6" status: 200 len: 1277 microversion: 2.1 time: 0.366199 Aug 24 10:35:40.941336 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2083/4537] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:40 2022] GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6 => generated 1277 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:35:41.834908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1f236bc4-4c72-4b2c-8bd6-eff3de8e3d6a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:41.837594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1f236bc4-4c72-4b2c-8bd6-eff3de8e3d6a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 33162162-c8fe-4f85-9f88-ff2452cfab95] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:41.859575 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f236bc4-4c72-4b2c-8bd6-eff3de8e3d6a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:41.863408 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f236bc4-4c72-4b2c-8bd6-eff3de8e3d6a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:41.864759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f236bc4-4c72-4b2c-8bd6-eff3de8e3d6a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:41.865797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f236bc4-4c72-4b2c-8bd6-eff3de8e3d6a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:41.866503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f236bc4-4c72-4b2c-8bd6-eff3de8e3d6a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:41.867809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f236bc4-4c72-4b2c-8bd6-eff3de8e3d6a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:41.902947 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-1f236bc4-4c72-4b2c-8bd6-eff3de8e3d6a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. Aug 24 10:35:41.926636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7aaa8dad-9814-4ace-bd1a-9d741ea5c3f4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:41.928092 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7aaa8dad-9814-4ace-bd1a-9d741ea5c3f4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1f236bc4-4c72-4b2c-8bd6-eff3de8e3d6a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95 HTTP/1.1 Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '33162162-c8fe-4f85-9f88-ff2452cfab95'} Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:35:41.940068 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:35:41.944582 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. Aug 24 10:35:41.944582 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:41.944582 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:41.944582 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:41.944582 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:41.944582 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:41.944582 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:41.944582 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:35:41.944582 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:35:41.944582 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. Aug 24 10:35:41.944582 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:41.947285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1f236bc4-4c72-4b2c-8bd6-eff3de8e3d6a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 404 to user: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:35:41.961021 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1f236bc4-4c72-4b2c-8bd6-eff3de8e3d6a tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "DELETE /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95" status: 404 len: 111 microversion: 2.1 time: 0.123797 Aug 24 10:35:41.961409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:41.962156 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2455/4538] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:35:41 2022] DELETE /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:35:41.991684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ad37087-199b-4913-855f-1a9353aec822 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:41.994074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3ad37087-199b-4913-855f-1a9353aec822 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: c3620de3-2e71-4135-bd71-246c54910ef6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:41.994890 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:42.001952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ad37087-199b-4913-855f-1a9353aec822 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:42.002795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ad37087-199b-4913-855f-1a9353aec822 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:42.005710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ad37087-199b-4913-855f-1a9353aec822 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:42.006804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ad37087-199b-4913-855f-1a9353aec822 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:42.007517 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ad37087-199b-4913-855f-1a9353aec822 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:42.008228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ad37087-199b-4913-855f-1a9353aec822 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:42.010917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7aaa8dad-9814-4ace-bd1a-9d741ea5c3f4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:42.013850 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7aaa8dad-9814-4ace-bd1a-9d741ea5c3f4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:42.014438 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7aaa8dad-9814-4ace-bd1a-9d741ea5c3f4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:42.021414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7aaa8dad-9814-4ace-bd1a-9d741ea5c3f4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:42.022007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7aaa8dad-9814-4ace-bd1a-9d741ea5c3f4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:42.022992 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7aaa8dad-9814-4ace-bd1a-9d741ea5c3f4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:42.688117 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3ad37087-199b-4913-855f-1a9353aec822 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:42.723217 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ad37087-199b-4913-855f-1a9353aec822 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6" status: 200 len: 1319 microversion: 2.1 time: 0.736801 Aug 24 10:35:42.723904 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2456/4539] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:41 2022] GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6 => generated 1319 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:42.769076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b50192b6-80c2-4901-a9d7-efa9fd55e6a4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:42.772547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b50192b6-80c2-4901-a9d7-efa9fd55e6a4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 33162162-c8fe-4f85-9f88-ff2452cfab95] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:42.810243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b50192b6-80c2-4901-a9d7-efa9fd55e6a4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:42.814141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b50192b6-80c2-4901-a9d7-efa9fd55e6a4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:42.816393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b50192b6-80c2-4901-a9d7-efa9fd55e6a4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:42.833468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b50192b6-80c2-4901-a9d7-efa9fd55e6a4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:42.833973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b50192b6-80c2-4901-a9d7-efa9fd55e6a4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:42.840491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b50192b6-80c2-4901-a9d7-efa9fd55e6a4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:42.901662 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-b50192b6-80c2-4901-a9d7-efa9fd55e6a4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b50192b6-80c2-4901-a9d7-efa9fd55e6a4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95 HTTP/1.1 Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '33162162-c8fe-4f85-9f88-ff2452cfab95'} Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:42.909792 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:42.914447 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:42.914447 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:42.914447 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:42.914447 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:35:42.914447 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:35:42.914447 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. Aug 24 10:35:42.914447 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:42.915833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b50192b6-80c2-4901-a9d7-efa9fd55e6a4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 404 to user: Instance 33162162-c8fe-4f85-9f88-ff2452cfab95 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:35:42.921163 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b50192b6-80c2-4901-a9d7-efa9fd55e6a4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95" status: 404 len: 111 microversion: 2.1 time: 0.173739 Aug 24 10:35:42.922847 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2457/4540] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:42 2022] GET /compute/v2.1/servers/33162162-c8fe-4f85-9f88-ff2452cfab95 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:35:42.947984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-63bf51d4-f2a1-4df2-b363-14232434165c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:42.956806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-63bf51d4-f2a1-4df2-b363-14232434165c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:43.006866 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7aaa8dad-9814-4ace-bd1a-9d741ea5c3f4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:43.017995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63bf51d4-f2a1-4df2-b363-14232434165c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:43.025332 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7aaa8dad-9814-4ace-bd1a-9d741ea5c3f4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1512 microversion: 2.1 time: 1.098864 Aug 24 10:35:43.026243 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2084/4541] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:41 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1512 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:43.027941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63bf51d4-f2a1-4df2-b363-14232434165c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:43.029607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63bf51d4-f2a1-4df2-b363-14232434165c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:43.034702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63bf51d4-f2a1-4df2-b363-14232434165c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:43.035641 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63bf51d4-f2a1-4df2-b363-14232434165c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:43.036097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63bf51d4-f2a1-4df2-b363-14232434165c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:43.150621 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-63bf51d4-f2a1-4df2-b363-14232434165c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:35:43.243620 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:43.486767 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-63bf51d4-f2a1-4df2-b363-14232434165c tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "DELETE /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 204 len: 0 microversion: 2.1 time: 0.555123 Aug 24 10:35:43.488145 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2458/4542] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:35:42 2022] DELETE /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:35:43.496653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-95c873af-6934-4810-b942-fa165d7ddf22 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:43.497536 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-95c873af-6934-4810-b942-fa165d7ddf22 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:43.523791 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95c873af-6934-4810-b942-fa165d7ddf22 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:43.524501 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95c873af-6934-4810-b942-fa165d7ddf22 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:43.526509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95c873af-6934-4810-b942-fa165d7ddf22 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:43.527682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95c873af-6934-4810-b942-fa165d7ddf22 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:43.536753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95c873af-6934-4810-b942-fa165d7ddf22 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:43.541070 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95c873af-6934-4810-b942-fa165d7ddf22 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:43.750640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1ff2fac4-82b3-4a35-a0cb-5cdff28e199e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:43.752093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1ff2fac4-82b3-4a35-a0cb-5cdff28e199e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: c3620de3-2e71-4135-bd71-246c54910ef6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:43.789432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ff2fac4-82b3-4a35-a0cb-5cdff28e199e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:43.792037 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ff2fac4-82b3-4a35-a0cb-5cdff28e199e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:43.793507 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ff2fac4-82b3-4a35-a0cb-5cdff28e199e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:43.795986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ff2fac4-82b3-4a35-a0cb-5cdff28e199e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:43.797448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ff2fac4-82b3-4a35-a0cb-5cdff28e199e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:43.799247 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ff2fac4-82b3-4a35-a0cb-5cdff28e199e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:44.276849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1ff2fac4-82b3-4a35-a0cb-5cdff28e199e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:44.290128 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1ff2fac4-82b3-4a35-a0cb-5cdff28e199e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6" status: 200 len: 1319 microversion: 2.1 time: 0.546759 Aug 24 10:35:44.291209 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2459/4543] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:43 2022] GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6 => generated 1319 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:44.304306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-841763d7-90f6-4aab-8b65-0d4af09fb78b req-2d54d081-05dd-4249-9a24-220691e5e359 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6548607f-1ff0-4a77-882d-7ccdfeffc55f", "tag": "00068dba-a9ad-4827-a908-ad8fae978fdf"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:44.334378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-841763d7-90f6-4aab-8b65-0d4af09fb78b req-2d54d081-05dd-4249-9a24-220691e5e359 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:44.338330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-841763d7-90f6-4aab-8b65-0d4af09fb78b req-2d54d081-05dd-4249-9a24-220691e5e359 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:44.338809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-841763d7-90f6-4aab-8b65-0d4af09fb78b req-2d54d081-05dd-4249-9a24-220691e5e359 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:44.381415 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-841763d7-90f6-4aab-8b65-0d4af09fb78b req-2d54d081-05dd-4249-9a24-220691e5e359 service nova] Creating event network-changed:00068dba-a9ad-4827-a908-ad8fae978fdf for instance 6548607f-1ff0-4a77-882d-7ccdfeffc55f on n-h1-849328-3 Aug 24 10:35:44.387080 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-841763d7-90f6-4aab-8b65-0d4af09fb78b req-2d54d081-05dd-4249-9a24-220691e5e359 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093806 Aug 24 10:35:44.387956 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2460/4544] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:35:44.406455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-90f8f90b-8e44-43f4-9391-367e6c96272a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:44.411420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-90f8f90b-8e44-43f4-9391-367e6c96272a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:44.429819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90f8f90b-8e44-43f4-9391-367e6c96272a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:44.430427 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90f8f90b-8e44-43f4-9391-367e6c96272a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:44.431195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90f8f90b-8e44-43f4-9391-367e6c96272a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:44.432204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90f8f90b-8e44-43f4-9391-367e6c96272a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:44.432974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90f8f90b-8e44-43f4-9391-367e6c96272a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:44.437493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90f8f90b-8e44-43f4-9391-367e6c96272a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:44.514098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-95c873af-6934-4810-b942-fa165d7ddf22 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:44.541405 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-95c873af-6934-4810-b942-fa165d7ddf22 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1512 microversion: 2.1 time: 1.048799 Aug 24 10:35:44.546244 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2085/4545] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:43 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1512 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:44.565101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-278ca8cb-9745-415e-8d56-d975200757ce tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:44.568659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-278ca8cb-9745-415e-8d56-d975200757ce tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:44.593790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-278ca8cb-9745-415e-8d56-d975200757ce tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:44.594305 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-278ca8cb-9745-415e-8d56-d975200757ce tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:44.596437 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-278ca8cb-9745-415e-8d56-d975200757ce tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:44.597109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-278ca8cb-9745-415e-8d56-d975200757ce tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:44.597604 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-278ca8cb-9745-415e-8d56-d975200757ce tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:44.598043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-278ca8cb-9745-415e-8d56-d975200757ce tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:44.695468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-278ca8cb-9745-415e-8d56-d975200757ce tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:35:44.819506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:44.923410 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-278ca8cb-9745-415e-8d56-d975200757ce tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "DELETE /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 204 len: 0 microversion: 2.1 time: 0.373876 Aug 24 10:35:44.949041 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2086/4546] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:35:44 2022] DELETE /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:35:44.974972 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8739e412-6256-4cab-9e9c-49598c2a288f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:44.978260 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8739e412-6256-4cab-9e9c-49598c2a288f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:44.994493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8739e412-6256-4cab-9e9c-49598c2a288f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:44.994993 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8739e412-6256-4cab-9e9c-49598c2a288f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:45.002167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8739e412-6256-4cab-9e9c-49598c2a288f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:45.003135 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8739e412-6256-4cab-9e9c-49598c2a288f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:45.003623 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8739e412-6256-4cab-9e9c-49598c2a288f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:45.004053 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8739e412-6256-4cab-9e9c-49598c2a288f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:45.167679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-90f8f90b-8e44-43f4-9391-367e6c96272a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:45.186062 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-90f8f90b-8e44-43f4-9391-367e6c96272a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1512 microversion: 2.1 time: 0.783270 Aug 24 10:35:45.187650 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2461/4547] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:44 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1512 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:45.317949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-777ada88-73c9-49ec-b42b-ce0183b833bf tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:45.319695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-777ada88-73c9-49ec-b42b-ce0183b833bf tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: c3620de3-2e71-4135-bd71-246c54910ef6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:45.338327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-777ada88-73c9-49ec-b42b-ce0183b833bf tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:45.339389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-777ada88-73c9-49ec-b42b-ce0183b833bf tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:45.340575 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-777ada88-73c9-49ec-b42b-ce0183b833bf tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:45.343847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-777ada88-73c9-49ec-b42b-ce0183b833bf tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:45.344697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-777ada88-73c9-49ec-b42b-ce0183b833bf tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:45.345404 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-777ada88-73c9-49ec-b42b-ce0183b833bf tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:45.711368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8739e412-6256-4cab-9e9c-49598c2a288f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:45.721702 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8739e412-6256-4cab-9e9c-49598c2a288f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1507 microversion: 2.1 time: 0.766741 Aug 24 10:35:45.726829 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2087/4548] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:44 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1507 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:45.744920 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e8773f5e-5ed8-439d-8feb-df040844fec6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:45.746313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e8773f5e-5ed8-439d-8feb-df040844fec6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:45.753453 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8773f5e-5ed8-439d-8feb-df040844fec6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:45.756844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8773f5e-5ed8-439d-8feb-df040844fec6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:45.757503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8773f5e-5ed8-439d-8feb-df040844fec6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:45.762240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8773f5e-5ed8-439d-8feb-df040844fec6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:45.762967 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8773f5e-5ed8-439d-8feb-df040844fec6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:45.763597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8773f5e-5ed8-439d-8feb-df040844fec6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:46.682676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-777ada88-73c9-49ec-b42b-ce0183b833bf tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:46.698043 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-777ada88-73c9-49ec-b42b-ce0183b833bf tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6" status: 200 len: 1319 microversion: 2.1 time: 1.385787 Aug 24 10:35:46.710021 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2462/4549] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:45 2022] GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6 => generated 1319 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:35:46.715658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a27f43ca-ea2c-4c5c-b367-0d527b807663 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:46.723773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a27f43ca-ea2c-4c5c-b367-0d527b807663 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:46.759822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a27f43ca-ea2c-4c5c-b367-0d527b807663 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:46.761589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a27f43ca-ea2c-4c5c-b367-0d527b807663 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:46.769591 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a27f43ca-ea2c-4c5c-b367-0d527b807663 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:46.770628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a27f43ca-ea2c-4c5c-b367-0d527b807663 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:46.771446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a27f43ca-ea2c-4c5c-b367-0d527b807663 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:46.773827 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a27f43ca-ea2c-4c5c-b367-0d527b807663 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:46.876952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e8773f5e-5ed8-439d-8feb-df040844fec6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:46.901002 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e8773f5e-5ed8-439d-8feb-df040844fec6 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1512 microversion: 2.1 time: 1.162839 Aug 24 10:35:46.906349 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2088/4550] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:45 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1512 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:46.928606 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e4e4cb0-ee48-478c-9510-94c7dc3537c6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:46.929252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6e4e4cb0-ee48-478c-9510-94c7dc3537c6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:46.957297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e4e4cb0-ee48-478c-9510-94c7dc3537c6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:46.957798 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e4e4cb0-ee48-478c-9510-94c7dc3537c6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:46.958234 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e4e4cb0-ee48-478c-9510-94c7dc3537c6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:46.958956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e4e4cb0-ee48-478c-9510-94c7dc3537c6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:46.959384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e4e4cb0-ee48-478c-9510-94c7dc3537c6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:46.967407 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e4e4cb0-ee48-478c-9510-94c7dc3537c6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:47.760736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6e4e4cb0-ee48-478c-9510-94c7dc3537c6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:47.805359 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6e4e4cb0-ee48-478c-9510-94c7dc3537c6 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 200 len: 1465 microversion: 2.1 time: 0.897787 Aug 24 10:35:47.806012 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2089/4551] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:46 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 1465 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:47.854028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e81c9ecf-0b26-4c48-8b0d-7ee1634b4e13 req-a8737c99-c42b-43d0-b724-a6d955008e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fb1d6b5-a27c-465a-aa10-652d2cc366ae", "name": "network-vif-deleted", "tag": "05c1a894-3c87-4d83-9b42-234ddedc80b0"}, {"name": "network-changed", "server_uuid": "c3620de3-2e71-4135-bd71-246c54910ef6", "tag": "6de16871-4e26-4ab0-ac4c-217f84459dd1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:47.903719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e81c9ecf-0b26-4c48-8b0d-7ee1634b4e13 req-a8737c99-c42b-43d0-b724-a6d955008e07 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:47.904435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e81c9ecf-0b26-4c48-8b0d-7ee1634b4e13 req-a8737c99-c42b-43d0-b724-a6d955008e07 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:47.904701 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e81c9ecf-0b26-4c48-8b0d-7ee1634b4e13 req-a8737c99-c42b-43d0-b724-a6d955008e07 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:47.943777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a27f43ca-ea2c-4c5c-b367-0d527b807663 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:47.961019 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a27f43ca-ea2c-4c5c-b367-0d527b807663 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1512 microversion: 2.1 time: 1.249479 Aug 24 10:35:47.961758 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2463/4552] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:46 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1512 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:47.972901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-5191a770-a14a-41f9-bff9-2bbb1894f557 req-56f6bc88-49dd-469a-b848-cb5ddae64a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "744fdfa0-24a0-4859-a5c5-7089ce8a444c", "name": "network-vif-deleted", "tag": "11bc9ad4-b6cb-4671-8d16-0591609ede47"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:48.012341 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5191a770-a14a-41f9-bff9-2bbb1894f557 req-56f6bc88-49dd-469a-b848-cb5ddae64a2b service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:48.016463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5191a770-a14a-41f9-bff9-2bbb1894f557 req-56f6bc88-49dd-469a-b848-cb5ddae64a2b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:48.018407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5191a770-a14a-41f9-bff9-2bbb1894f557 req-56f6bc88-49dd-469a-b848-cb5ddae64a2b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:48.019952 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e81c9ecf-0b26-4c48-8b0d-7ee1634b4e13 req-a8737c99-c42b-43d0-b724-a6d955008e07 service nova] Creating event network-vif-deleted:05c1a894-3c87-4d83-9b42-234ddedc80b0 for instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae on n-h1-849328-3 Aug 24 10:35:48.021882 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e81c9ecf-0b26-4c48-8b0d-7ee1634b4e13 req-a8737c99-c42b-43d0-b724-a6d955008e07 service nova] Creating event network-changed:6de16871-4e26-4ab0-ac4c-217f84459dd1 for instance c3620de3-2e71-4135-bd71-246c54910ef6 on n-h2-849328-3 Aug 24 10:35:48.041045 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e81c9ecf-0b26-4c48-8b0d-7ee1634b4e13 req-a8737c99-c42b-43d0-b724-a6d955008e07 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.233638 Aug 24 10:35:48.042216 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2090/4553] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:35:48.055051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e46e2023-c891-4b41-9013-e479aa7973d6 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:48.057312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e46e2023-c891-4b41-9013-e479aa7973d6 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: c3620de3-2e71-4135-bd71-246c54910ef6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:48.074151 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-5191a770-a14a-41f9-bff9-2bbb1894f557 req-56f6bc88-49dd-469a-b848-cb5ddae64a2b service nova] Creating event network-vif-deleted:11bc9ad4-b6cb-4671-8d16-0591609ede47 for instance 744fdfa0-24a0-4859-a5c5-7089ce8a444c on n-h2-849328-3 Aug 24 10:35:48.081229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e46e2023-c891-4b41-9013-e479aa7973d6 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:48.081594 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-5191a770-a14a-41f9-bff9-2bbb1894f557 req-56f6bc88-49dd-469a-b848-cb5ddae64a2b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114965 Aug 24 10:35:48.082467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e46e2023-c891-4b41-9013-e479aa7973d6 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:48.083386 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2464/4554] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:35:48.083972 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e46e2023-c891-4b41-9013-e479aa7973d6 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:48.086687 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e46e2023-c891-4b41-9013-e479aa7973d6 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:48.091388 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e46e2023-c891-4b41-9013-e479aa7973d6 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:48.092156 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e46e2023-c891-4b41-9013-e479aa7973d6 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:48.124923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4eb18b57-9662-453c-a165-0d74521b73e4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:48.127564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4eb18b57-9662-453c-a165-0d74521b73e4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:48.155974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4eb18b57-9662-453c-a165-0d74521b73e4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:48.156696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4eb18b57-9662-453c-a165-0d74521b73e4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:48.165865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4eb18b57-9662-453c-a165-0d74521b73e4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:48.167605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4eb18b57-9662-453c-a165-0d74521b73e4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:48.168258 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4eb18b57-9662-453c-a165-0d74521b73e4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:48.168850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4eb18b57-9662-453c-a165-0d74521b73e4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:48.226105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4eb18b57-9662-453c-a165-0d74521b73e4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:48.226796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4eb18b57-9662-453c-a165-0d74521b73e4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:48.227562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4eb18b57-9662-453c-a165-0d74521b73e4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:48.228412 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-4eb18b57-9662-453c-a165-0d74521b73e4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lazy-loading 'fault' on Instance uuid 8fb1d6b5-a27c-465a-aa10-652d2cc366ae {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:35:48.299400 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4eb18b57-9662-453c-a165-0d74521b73e4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795cacc54c1c4da8b6e721f1ca19cbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee55b608dbd4e83bddfab28646f3eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:48.318282 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4eb18b57-9662-453c-a165-0d74521b73e4 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 200 len: 1307 microversion: 2.1 time: 0.229819 Aug 24 10:35:48.319008 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2465/4555] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:48 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 1307 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:48.829346 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f6b84a84-ea04-4ee5-a67b-984bfe7927d4 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:48.830167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f6b84a84-ea04-4ee5-a67b-984bfe7927d4 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: 744fdfa0-24a0-4859-a5c5-7089ce8a444c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:48.842968 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6b84a84-ea04-4ee5-a67b-984bfe7927d4 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:48.843771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6b84a84-ea04-4ee5-a67b-984bfe7927d4 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:48.845473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6b84a84-ea04-4ee5-a67b-984bfe7927d4 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:48.846473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6b84a84-ea04-4ee5-a67b-984bfe7927d4 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:48.847104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6b84a84-ea04-4ee5-a67b-984bfe7927d4 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:48.847653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6b84a84-ea04-4ee5-a67b-984bfe7927d4 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:48.884546 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-f6b84a84-ea04-4ee5-a67b-984bfe7927d4 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] HTTP exception thrown: Instance 744fdfa0-24a0-4859-a5c5-7089ce8a444c could not be found. Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f6b84a84-ea04-4ee5-a67b-984bfe7927d4 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Request method failure captured: Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c HTTP/1.1 Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf2afGdSM86mh0RIAZFYBYhaQ4EtyTCcCD00ldy_PJZTrDPEqZsqjAaBEiSLwFHEWtlpLSXpU9lI2y_7Dlfdrd1tzCv296dD-Q1jtlqtcx2Z1VdQb3wVY7fHkhrfDX6lZ98oMTsvllOCneZWRxakMNA_j9HFWTm3gYwjAHKCNfApMTc Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 125d2dd1d22140abaa36184e3628a339 Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1145732609 Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/125d2dd1d22140abaa36184e3628a339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_125d2dd1d22140abaa36184e3628a339", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/125d2dd1d22140abaa36184e3628a339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/125d2dd1d22140abaa36184e3628a339"}]}] Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1145732609 Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 125d2dd1d22140abaa36184e3628a339 Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1145732609 Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerRescueNegativeTestJSON-1145732609-project Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 133e99904a6b4574933cad73d0f2293f Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1145732609-project Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 744fdfa0-24a0-4859-a5c5-7089ce8a444c could not be found. Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '744fdfa0-24a0-4859-a5c5-7089ce8a444c'} Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 744fdfa0-24a0-4859-a5c5-7089ce8a444c could not be found. Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 744fdfa0-24a0-4859-a5c5-7089ce8a444c could not be found. Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:48.886298 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:48.893001 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:48.893001 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:48.893001 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:48.893001 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:48.893001 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:35:48.893001 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:35:48.893001 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 744fdfa0-24a0-4859-a5c5-7089ce8a444c could not be found. Aug 24 10:35:48.893001 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:48.893001 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f6b84a84-ea04-4ee5-a67b-984bfe7927d4 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Returning 404 to user: Instance 744fdfa0-24a0-4859-a5c5-7089ce8a444c could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:35:48.893001 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f6b84a84-ea04-4ee5-a67b-984bfe7927d4 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c" status: 404 len: 111 microversion: 2.1 time: 0.064542 Aug 24 10:35:48.898061 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2466/4556] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:48 2022] GET /compute/v2.1/servers/744fdfa0-24a0-4859-a5c5-7089ce8a444c => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:35:48.910178 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1ef63dcf-70ed-4c9a-a82b-e446728f0dde tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:48.910964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1ef63dcf-70ed-4c9a-a82b-e446728f0dde tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:48.929776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ef63dcf-70ed-4c9a-a82b-e446728f0dde tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:48.930266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ef63dcf-70ed-4c9a-a82b-e446728f0dde tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:48.931181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ef63dcf-70ed-4c9a-a82b-e446728f0dde tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:48.932056 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ef63dcf-70ed-4c9a-a82b-e446728f0dde tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:48.932671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ef63dcf-70ed-4c9a-a82b-e446728f0dde tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:48.933285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ef63dcf-70ed-4c9a-a82b-e446728f0dde tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:49.005778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1ef63dcf-70ed-4c9a-a82b-e446728f0dde tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:35:49.065107 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:49.219972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:49.246221 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1ef63dcf-70ed-4c9a-a82b-e446728f0dde tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 204 len: 0 microversion: 2.1 time: 0.346816 Aug 24 10:35:49.246838 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2467/4557] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:35:48 2022] DELETE /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:35:49.281341 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-102c7270-84f2-4d20-9483-a9ec0720aaf0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:49.282157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-102c7270-84f2-4d20-9483-a9ec0720aaf0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:49.310628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-102c7270-84f2-4d20-9483-a9ec0720aaf0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:49.311668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-102c7270-84f2-4d20-9483-a9ec0720aaf0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:49.312296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-102c7270-84f2-4d20-9483-a9ec0720aaf0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:49.313207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-102c7270-84f2-4d20-9483-a9ec0720aaf0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:49.313824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-102c7270-84f2-4d20-9483-a9ec0720aaf0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:49.314400 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-102c7270-84f2-4d20-9483-a9ec0720aaf0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:49.404991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e46e2023-c891-4b41-9013-e479aa7973d6 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:49.421186 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e46e2023-c891-4b41-9013-e479aa7973d6 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6" status: 200 len: 1319 microversion: 2.1 time: 1.375062 Aug 24 10:35:49.424725 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2091/4558] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:48 2022] GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6 => generated 1319 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:49.459107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9757c08a-ebe3-49e4-8af9-f45129812ffb tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:49.462518 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9757c08a-ebe3-49e4-8af9-f45129812ffb tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:49.497800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9757c08a-ebe3-49e4-8af9-f45129812ffb tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:49.503155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9757c08a-ebe3-49e4-8af9-f45129812ffb tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:49.503788 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9757c08a-ebe3-49e4-8af9-f45129812ffb tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:49.504709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9757c08a-ebe3-49e4-8af9-f45129812ffb tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:49.507157 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9757c08a-ebe3-49e4-8af9-f45129812ffb tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:49.508081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9757c08a-ebe3-49e4-8af9-f45129812ffb tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:50.003667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-102c7270-84f2-4d20-9483-a9ec0720aaf0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:50.021413 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-102c7270-84f2-4d20-9483-a9ec0720aaf0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1512 microversion: 2.1 time: 0.759633 Aug 24 10:35:50.029990 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2468/4559] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:49 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1512 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:50.042223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c9a287d8-843d-41fb-9666-bb4783afdc61 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:50.043711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c9a287d8-843d-41fb-9666-bb4783afdc61 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] [instance: 8fb1d6b5-a27c-465a-aa10-652d2cc366ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:50.088195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9a287d8-843d-41fb-9666-bb4783afdc61 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:50.089386 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9a287d8-843d-41fb-9666-bb4783afdc61 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:50.090053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9a287d8-843d-41fb-9666-bb4783afdc61 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:50.093893 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9a287d8-843d-41fb-9666-bb4783afdc61 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:50.094704 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9a287d8-843d-41fb-9666-bb4783afdc61 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:50.095361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9a287d8-843d-41fb-9666-bb4783afdc61 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:50.142039 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-c9a287d8-843d-41fb-9666-bb4783afdc61 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] HTTP exception thrown: Instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae could not be found. Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c9a287d8-843d-41fb-9666-bb4783afdc61 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Request method failure captured: Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae HTTP/1.1 Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf3m1X8Va49z1jsaLF82jyrUrqIkBPT3RFCDnBboagcg3UxDPLTUE6QtKmcL4kik9NZqYE9qC8x3JiH6BZ1pQqYk20gfEccvguQunFdDgbZzlycpWBdDQi_CqS8M9-I0n7wHRyBSRVP_NmTxAGFYUpeX4WNVbJ5DmxHF8rv47fIISb0 Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0ee55b608dbd4e83bddfab28646f3eac", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0ee55b608dbd4e83bddfab28646f3eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0ee55b608dbd4e83bddfab28646f3eac"}]}] Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 0ee55b608dbd4e83bddfab28646f3eac Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2066650852 Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 795cacc54c1c4da8b6e721f1ca19cbbe Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-2066650852-project Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae could not be found. Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '8fb1d6b5-a27c-465a-aa10-652d2cc366ae'} Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae could not be found. Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae could not be found. Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:50.148269 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:50.164503 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:50.164503 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:50.164503 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:50.164503 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:35:50.164503 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:35:50.164503 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae could not be found. Aug 24 10:35:50.164503 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:50.168711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c9a287d8-843d-41fb-9666-bb4783afdc61 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] Returning 404 to user: Instance 8fb1d6b5-a27c-465a-aa10-652d2cc366ae could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:35:50.172606 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9757c08a-ebe3-49e4-8af9-f45129812ffb tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:50.174354 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c9a287d8-843d-41fb-9666-bb4783afdc61 tempest-ServersNegativeTestJSON-2066650852 tempest-ServersNegativeTestJSON-2066650852-project] 10.222.0.85 "GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae" status: 404 len: 111 microversion: 2.1 time: 0.139169 Aug 24 10:35:50.182299 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2469/4560] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:50 2022] GET /compute/v2.1/servers/8fb1d6b5-a27c-465a-aa10-652d2cc366ae => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:35:50.185507 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9757c08a-ebe3-49e4-8af9-f45129812ffb tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1521 microversion: 2.1 time: 0.759368 Aug 24 10:35:50.186154 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2092/4561] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:49 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1521 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:50.449566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-397ac537-2fd6-4cef-b1e7-70b8c4505d7a tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:50.450879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-397ac537-2fd6-4cef-b1e7-70b8c4505d7a tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: c3620de3-2e71-4135-bd71-246c54910ef6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:50.469781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-397ac537-2fd6-4cef-b1e7-70b8c4505d7a tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:50.470499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-397ac537-2fd6-4cef-b1e7-70b8c4505d7a tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:50.471111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-397ac537-2fd6-4cef-b1e7-70b8c4505d7a tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:50.474009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-397ac537-2fd6-4cef-b1e7-70b8c4505d7a tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:50.474642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-397ac537-2fd6-4cef-b1e7-70b8c4505d7a tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:50.477175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-397ac537-2fd6-4cef-b1e7-70b8c4505d7a tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:51.072580 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-57cbd6c4-8905-4251-ab03-548890484622 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:51.074743 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-57cbd6c4-8905-4251-ab03-548890484622 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:51.088333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:51.100085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57cbd6c4-8905-4251-ab03-548890484622 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:51.100622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57cbd6c4-8905-4251-ab03-548890484622 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:51.101069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57cbd6c4-8905-4251-ab03-548890484622 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:51.104831 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57cbd6c4-8905-4251-ab03-548890484622 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:51.105368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57cbd6c4-8905-4251-ab03-548890484622 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:51.105811 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57cbd6c4-8905-4251-ab03-548890484622 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:51.260746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-397ac537-2fd6-4cef-b1e7-70b8c4505d7a tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:51.272887 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-397ac537-2fd6-4cef-b1e7-70b8c4505d7a tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6" status: 200 len: 1319 microversion: 2.1 time: 0.830812 Aug 24 10:35:51.273896 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2470/4562] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:50 2022] GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6 => generated 1319 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:51.290108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e4bd1863-a13f-40e9-9106-10a9dadd2e00 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:51.291052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e4bd1863-a13f-40e9-9106-10a9dadd2e00 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:51.300961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4bd1863-a13f-40e9-9106-10a9dadd2e00 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:51.301779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4bd1863-a13f-40e9-9106-10a9dadd2e00 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:51.302411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4bd1863-a13f-40e9-9106-10a9dadd2e00 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:51.304332 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4bd1863-a13f-40e9-9106-10a9dadd2e00 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:51.304967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4bd1863-a13f-40e9-9106-10a9dadd2e00 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:51.305602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4bd1863-a13f-40e9-9106-10a9dadd2e00 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:51.640994 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-57cbd6c4-8905-4251-ab03-548890484622 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:51.651041 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-57cbd6c4-8905-4251-ab03-548890484622 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1512 microversion: 2.1 time: 0.596202 Aug 24 10:35:51.669952 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2093/4563] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:51 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1512 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:35:51.722330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e4bd1863-a13f-40e9-9106-10a9dadd2e00 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:51.732679 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e4bd1863-a13f-40e9-9106-10a9dadd2e00 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1521 microversion: 2.1 time: 0.457309 Aug 24 10:35:51.733893 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2471/4564] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:51 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1521 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:52.300850 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7a709ec5-e7e5-4c7f-8f74-87e9d49395aa tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:52.302362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7a709ec5-e7e5-4c7f-8f74-87e9d49395aa tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: c3620de3-2e71-4135-bd71-246c54910ef6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:52.317374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a709ec5-e7e5-4c7f-8f74-87e9d49395aa tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:52.317883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a709ec5-e7e5-4c7f-8f74-87e9d49395aa tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:52.321587 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a709ec5-e7e5-4c7f-8f74-87e9d49395aa tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:52.323594 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a709ec5-e7e5-4c7f-8f74-87e9d49395aa tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:52.324088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a709ec5-e7e5-4c7f-8f74-87e9d49395aa tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:52.324535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a709ec5-e7e5-4c7f-8f74-87e9d49395aa tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:52.682323 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-360c85c5-ccf1-4469-93f8-91e981cd74b6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:52.687409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-360c85c5-ccf1-4469-93f8-91e981cd74b6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:52.709935 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-360c85c5-ccf1-4469-93f8-91e981cd74b6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:52.710441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-360c85c5-ccf1-4469-93f8-91e981cd74b6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:52.710999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-360c85c5-ccf1-4469-93f8-91e981cd74b6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:52.712220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-360c85c5-ccf1-4469-93f8-91e981cd74b6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:52.712719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-360c85c5-ccf1-4469-93f8-91e981cd74b6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:52.726943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-360c85c5-ccf1-4469-93f8-91e981cd74b6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:53.344193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-360c85c5-ccf1-4469-93f8-91e981cd74b6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:53.355552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7a709ec5-e7e5-4c7f-8f74-87e9d49395aa tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:53.371791 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-360c85c5-ccf1-4469-93f8-91e981cd74b6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1512 microversion: 2.1 time: 0.699905 Aug 24 10:35:53.374845 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7a709ec5-e7e5-4c7f-8f74-87e9d49395aa tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6" status: 200 len: 1319 microversion: 2.1 time: 1.079402 Aug 24 10:35:53.377566 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2094/4565] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:52 2022] GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6 => generated 1319 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:53.392532 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2472/4566] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:52 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1512 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:53.406743 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-67e75bca-6ef6-4b2d-b4f3-c4af3f199a6f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:53.410306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-67e75bca-6ef6-4b2d-b4f3-c4af3f199a6f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:53.438898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67e75bca-6ef6-4b2d-b4f3-c4af3f199a6f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:53.439472 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67e75bca-6ef6-4b2d-b4f3-c4af3f199a6f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:53.439927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67e75bca-6ef6-4b2d-b4f3-c4af3f199a6f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:53.441009 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67e75bca-6ef6-4b2d-b4f3-c4af3f199a6f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:53.441502 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67e75bca-6ef6-4b2d-b4f3-c4af3f199a6f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:53.441927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67e75bca-6ef6-4b2d-b4f3-c4af3f199a6f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:54.400655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-46165d88-632b-4e03-bd46-a758f347f4c8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:54.402592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-46165d88-632b-4e03-bd46-a758f347f4c8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: c3620de3-2e71-4135-bd71-246c54910ef6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:54.430692 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46165d88-632b-4e03-bd46-a758f347f4c8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:54.431210 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46165d88-632b-4e03-bd46-a758f347f4c8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:54.431673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46165d88-632b-4e03-bd46-a758f347f4c8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:54.434055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46165d88-632b-4e03-bd46-a758f347f4c8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:54.437649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46165d88-632b-4e03-bd46-a758f347f4c8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:54.438223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46165d88-632b-4e03-bd46-a758f347f4c8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:54.891693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-46165d88-632b-4e03-bd46-a758f347f4c8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:54.906336 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-46165d88-632b-4e03-bd46-a758f347f4c8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6" status: 200 len: 1319 microversion: 2.1 time: 0.511929 Aug 24 10:35:54.928150 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2473/4567] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:54 2022] GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6 => generated 1319 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:35:54.945664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2398052b-894d-4a14-85db-88e2a34b7765 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:54.947484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2398052b-894d-4a14-85db-88e2a34b7765 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:54.954381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2398052b-894d-4a14-85db-88e2a34b7765 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:54.955166 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2398052b-894d-4a14-85db-88e2a34b7765 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:54.955818 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2398052b-894d-4a14-85db-88e2a34b7765 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:54.957932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2398052b-894d-4a14-85db-88e2a34b7765 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:54.958599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2398052b-894d-4a14-85db-88e2a34b7765 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:54.961298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2398052b-894d-4a14-85db-88e2a34b7765 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:55.389757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-67e75bca-6ef6-4b2d-b4f3-c4af3f199a6f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:55.399580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2398052b-894d-4a14-85db-88e2a34b7765 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:55.406620 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-67e75bca-6ef6-4b2d-b4f3-c4af3f199a6f tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1521 microversion: 2.1 time: 2.027715 Aug 24 10:35:55.407845 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2095/4568] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:53 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1521 bytes in 2029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:55.434722 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2398052b-894d-4a14-85db-88e2a34b7765 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1512 microversion: 2.1 time: 0.491446 Aug 24 10:35:55.435863 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2474/4569] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:54 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1512 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:55.871533 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c1663dcd-cdcf-489e-ae63-320bbcf116a0 req-7fc64c24-e833-4fe6-9c79-59182ff17eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3620de3-2e71-4135-bd71-246c54910ef6", "name": "network-vif-plugged", "status": "completed", "tag": "6de16871-4e26-4ab0-ac4c-217f84459dd1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:55.917536 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c1663dcd-cdcf-489e-ae63-320bbcf116a0 req-7fc64c24-e833-4fe6-9c79-59182ff17eb4 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:55.918075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c1663dcd-cdcf-489e-ae63-320bbcf116a0 req-7fc64c24-e833-4fe6-9c79-59182ff17eb4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:55.918530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c1663dcd-cdcf-489e-ae63-320bbcf116a0 req-7fc64c24-e833-4fe6-9c79-59182ff17eb4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:55.935498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f01d77b3-9312-4430-997c-1f35f8663c23 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:55.936571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f01d77b3-9312-4430-997c-1f35f8663c23 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: c3620de3-2e71-4135-bd71-246c54910ef6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:55.951091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f01d77b3-9312-4430-997c-1f35f8663c23 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:55.951993 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f01d77b3-9312-4430-997c-1f35f8663c23 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:55.952677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f01d77b3-9312-4430-997c-1f35f8663c23 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:55.953647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f01d77b3-9312-4430-997c-1f35f8663c23 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:55.954639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f01d77b3-9312-4430-997c-1f35f8663c23 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:55.955307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f01d77b3-9312-4430-997c-1f35f8663c23 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:55.981459 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c1663dcd-cdcf-489e-ae63-320bbcf116a0 req-7fc64c24-e833-4fe6-9c79-59182ff17eb4 service nova] Creating event network-vif-plugged:6de16871-4e26-4ab0-ac4c-217f84459dd1 for instance c3620de3-2e71-4135-bd71-246c54910ef6 on n-h2-849328-3 Aug 24 10:35:55.998319 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c1663dcd-cdcf-489e-ae63-320bbcf116a0 req-7fc64c24-e833-4fe6-9c79-59182ff17eb4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131096 Aug 24 10:35:56.005907 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2096/4570] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:35:56.425797 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-00ee6480-a727-48e7-9947-745faf24ac3e req-35e72467-9e14-4f23-aca6-fb5f1cd294f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1bb2ada-4833-4819-a358-2e832c5a0a41", "name": "network-vif-deleted", "tag": "ea3bbe4b-7348-4d1c-bfb1-21965d6cd021"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:56.459571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-00ee6480-a727-48e7-9947-745faf24ac3e req-35e72467-9e14-4f23-aca6-fb5f1cd294f8 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:56.462433 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-00ee6480-a727-48e7-9947-745faf24ac3e req-35e72467-9e14-4f23-aca6-fb5f1cd294f8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:56.463357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-00ee6480-a727-48e7-9947-745faf24ac3e req-35e72467-9e14-4f23-aca6-fb5f1cd294f8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:56.517939 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-00ee6480-a727-48e7-9947-745faf24ac3e req-35e72467-9e14-4f23-aca6-fb5f1cd294f8 service nova] Creating event network-vif-deleted:ea3bbe4b-7348-4d1c-bfb1-21965d6cd021 for instance b1bb2ada-4833-4819-a358-2e832c5a0a41 on n-h1-849328-3 Aug 24 10:35:56.532824 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-00ee6480-a727-48e7-9947-745faf24ac3e req-35e72467-9e14-4f23-aca6-fb5f1cd294f8 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113096 Aug 24 10:35:56.535087 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2097/4571] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:35:56.549666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-64c143cb-1e63-4a96-b978-3873982d2853 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:56.551436 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-64c143cb-1e63-4a96-b978-3873982d2853 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:56.587379 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64c143cb-1e63-4a96-b978-3873982d2853 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:56.596255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64c143cb-1e63-4a96-b978-3873982d2853 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:56.598828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64c143cb-1e63-4a96-b978-3873982d2853 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:56.600528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64c143cb-1e63-4a96-b978-3873982d2853 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:56.603056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64c143cb-1e63-4a96-b978-3873982d2853 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:56.603952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64c143cb-1e63-4a96-b978-3873982d2853 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:56.722770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64c143cb-1e63-4a96-b978-3873982d2853 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:56.723158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64c143cb-1e63-4a96-b978-3873982d2853 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:56.724067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64c143cb-1e63-4a96-b978-3873982d2853 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:56.724560 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-64c143cb-1e63-4a96-b978-3873982d2853 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lazy-loading 'fault' on Instance uuid b1bb2ada-4833-4819-a358-2e832c5a0a41 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:35:56.797467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-64c143cb-1e63-4a96-b978-3873982d2853 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133e99904a6b4574933cad73d0f2293f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125d2dd1d22140abaa36184e3628a339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:56.813673 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-64c143cb-1e63-4a96-b978-3873982d2853 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 200 len: 1311 microversion: 2.1 time: 0.276813 Aug 24 10:35:56.814350 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2098/4572] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:56 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 1311 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:56.829564 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4eaa86eb-a77a-4cba-b8ea-e025815ecbc0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:56.830224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4eaa86eb-a77a-4cba-b8ea-e025815ecbc0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:56.842449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4eaa86eb-a77a-4cba-b8ea-e025815ecbc0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:56.842449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4eaa86eb-a77a-4cba-b8ea-e025815ecbc0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:56.842449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4eaa86eb-a77a-4cba-b8ea-e025815ecbc0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:56.842449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4eaa86eb-a77a-4cba-b8ea-e025815ecbc0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:56.842449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4eaa86eb-a77a-4cba-b8ea-e025815ecbc0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:56.843018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4eaa86eb-a77a-4cba-b8ea-e025815ecbc0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:56.881821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f01d77b3-9312-4430-997c-1f35f8663c23 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:56.904747 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f01d77b3-9312-4430-997c-1f35f8663c23 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6" status: 200 len: 1319 microversion: 2.1 time: 0.972423 Aug 24 10:35:56.908366 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2475/4573] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:55 2022] GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6 => generated 1319 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:57.348568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4eaa86eb-a77a-4cba-b8ea-e025815ecbc0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:57.367436 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4eaa86eb-a77a-4cba-b8ea-e025815ecbc0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1512 microversion: 2.1 time: 0.551242 Aug 24 10:35:57.369950 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2099/4574] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:56 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1512 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:57.835400 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-21aba326-3bf6-4f8b-9767-151d5168f612 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:57.836334 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-21aba326-3bf6-4f8b-9767-151d5168f612 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] [instance: b1bb2ada-4833-4819-a358-2e832c5a0a41] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:57.858777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21aba326-3bf6-4f8b-9767-151d5168f612 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:57.860375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21aba326-3bf6-4f8b-9767-151d5168f612 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:57.865228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21aba326-3bf6-4f8b-9767-151d5168f612 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:57.868020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21aba326-3bf6-4f8b-9767-151d5168f612 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:57.868446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21aba326-3bf6-4f8b-9767-151d5168f612 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:57.869374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21aba326-3bf6-4f8b-9767-151d5168f612 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:57.932108 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-21aba326-3bf6-4f8b-9767-151d5168f612 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] HTTP exception thrown: Instance b1bb2ada-4833-4819-a358-2e832c5a0a41 could not be found. Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-21aba326-3bf6-4f8b-9767-151d5168f612 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Request method failure captured: Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 HTTP/1.1 Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf2afGdSM86mh0RIAZFYBYhaQ4EtyTCcCD00ldy_PJZTrDPEqZsqjAaBEiSLwFHEWtlpLSXpU9lI2y_7Dlfdrd1tzCv296dD-Q1jtlqtcx2Z1VdQb3wVY7fHkhrfDX6lZ98oMTsvllOCneZWRxakMNA_j9HFWTm3gYwjAHKCNfApMTc Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 125d2dd1d22140abaa36184e3628a339 Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1145732609 Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/125d2dd1d22140abaa36184e3628a339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_125d2dd1d22140abaa36184e3628a339", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/125d2dd1d22140abaa36184e3628a339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/125d2dd1d22140abaa36184e3628a339"}]}] Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1145732609 Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 125d2dd1d22140abaa36184e3628a339 Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1145732609 Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerRescueNegativeTestJSON-1145732609-project Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 133e99904a6b4574933cad73d0f2293f Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1145732609-project Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance b1bb2ada-4833-4819-a358-2e832c5a0a41 could not be found. Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'b1bb2ada-4833-4819-a358-2e832c5a0a41'} Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1bb2ada-4833-4819-a358-2e832c5a0a41 could not be found. Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1bb2ada-4833-4819-a358-2e832c5a0a41 could not be found. Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:57.933812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:57.940946 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:57.940946 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:57.940946 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:57.940946 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:57.940946 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:35:57.940946 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:35:57.940946 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1bb2ada-4833-4819-a358-2e832c5a0a41 could not be found. Aug 24 10:35:57.940946 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:35:57.940946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-21aba326-3bf6-4f8b-9767-151d5168f612 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] Returning 404 to user: Instance b1bb2ada-4833-4819-a358-2e832c5a0a41 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:35:57.940946 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-21aba326-3bf6-4f8b-9767-151d5168f612 tempest-ServerRescueNegativeTestJSON-1145732609 tempest-ServerRescueNegativeTestJSON-1145732609-project] 10.222.0.85 "GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41" status: 404 len: 111 microversion: 2.1 time: 0.104105 Aug 24 10:35:57.956351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cdb327b6-8dc3-4c2a-8817-0d10f21ad538 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:57.957334 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2476/4575] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:57 2022] GET /compute/v2.1/servers/b1bb2ada-4833-4819-a358-2e832c5a0a41 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:35:57.958303 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cdb327b6-8dc3-4c2a-8817-0d10f21ad538 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: c3620de3-2e71-4135-bd71-246c54910ef6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:57.972578 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdb327b6-8dc3-4c2a-8817-0d10f21ad538 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:57.973475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdb327b6-8dc3-4c2a-8817-0d10f21ad538 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:57.974004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdb327b6-8dc3-4c2a-8817-0d10f21ad538 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:57.975163 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdb327b6-8dc3-4c2a-8817-0d10f21ad538 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:57.975774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdb327b6-8dc3-4c2a-8817-0d10f21ad538 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:57.976362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdb327b6-8dc3-4c2a-8817-0d10f21ad538 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:58.395082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1cc212be-2091-4366-a891-386c4536b2df tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:58.398104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1cc212be-2091-4366-a891-386c4536b2df tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:58.419649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cc212be-2091-4366-a891-386c4536b2df tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:58.422474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cc212be-2091-4366-a891-386c4536b2df tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:58.423046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cc212be-2091-4366-a891-386c4536b2df tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:58.424799 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cc212be-2091-4366-a891-386c4536b2df tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:58.427536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cc212be-2091-4366-a891-386c4536b2df tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:58.433966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cc212be-2091-4366-a891-386c4536b2df tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:58.657990 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cdb327b6-8dc3-4c2a-8817-0d10f21ad538 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:58.667994 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cdb327b6-8dc3-4c2a-8817-0d10f21ad538 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6" status: 200 len: 1319 microversion: 2.1 time: 0.724654 Aug 24 10:35:58.681567 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2100/4576] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:57 2022] GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6 => generated 1319 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:58.829281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-f97f950b-1541-4856-8ae1-80ff2716e32d req-d1de017c-7508-4ef5-8451-46d6c9a8c4cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6548607f-1ff0-4a77-882d-7ccdfeffc55f", "name": "network-vif-plugged", "status": "completed", "tag": "00068dba-a9ad-4827-a908-ad8fae978fdf"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:58.851981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f97f950b-1541-4856-8ae1-80ff2716e32d req-d1de017c-7508-4ef5-8451-46d6c9a8c4cb service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:58.852545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f97f950b-1541-4856-8ae1-80ff2716e32d req-d1de017c-7508-4ef5-8451-46d6c9a8c4cb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:58.853374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f97f950b-1541-4856-8ae1-80ff2716e32d req-d1de017c-7508-4ef5-8451-46d6c9a8c4cb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:58.870338 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-f97f950b-1541-4856-8ae1-80ff2716e32d req-d1de017c-7508-4ef5-8451-46d6c9a8c4cb service nova] Creating event network-vif-plugged:00068dba-a9ad-4827-a908-ad8fae978fdf for instance 6548607f-1ff0-4a77-882d-7ccdfeffc55f on n-h1-849328-3 Aug 24 10:35:58.883526 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-f97f950b-1541-4856-8ae1-80ff2716e32d req-d1de017c-7508-4ef5-8451-46d6c9a8c4cb service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058777 Aug 24 10:35:58.885465 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2101/4577] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:35:59.028359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1cc212be-2091-4366-a891-386c4536b2df tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:59.040224 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1cc212be-2091-4366-a891-386c4536b2df tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1512 microversion: 2.1 time: 0.652431 Aug 24 10:35:59.040849 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2477/4578] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:58 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1512 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:59.698042 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dec8f122-4c54-4368-a682-b41f2ca9e18f tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:59.698881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dec8f122-4c54-4368-a682-b41f2ca9e18f tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: c3620de3-2e71-4135-bd71-246c54910ef6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:59.710053 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dec8f122-4c54-4368-a682-b41f2ca9e18f tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:59.711633 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dec8f122-4c54-4368-a682-b41f2ca9e18f tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:59.712571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dec8f122-4c54-4368-a682-b41f2ca9e18f tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:59.713858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dec8f122-4c54-4368-a682-b41f2ca9e18f tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:59.718523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dec8f122-4c54-4368-a682-b41f2ca9e18f tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:59.719483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dec8f122-4c54-4368-a682-b41f2ca9e18f tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:00.069684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ffe388d3-becb-4426-a133-ab2f9fb3a868 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:00.070283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ffe388d3-becb-4426-a133-ab2f9fb3a868 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:00.092661 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffe388d3-becb-4426-a133-ab2f9fb3a868 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:00.096431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffe388d3-becb-4426-a133-ab2f9fb3a868 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:00.098261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffe388d3-becb-4426-a133-ab2f9fb3a868 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:00.100227 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffe388d3-becb-4426-a133-ab2f9fb3a868 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:00.103057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffe388d3-becb-4426-a133-ab2f9fb3a868 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:00.104940 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffe388d3-becb-4426-a133-ab2f9fb3a868 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:00.670673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ffe388d3-becb-4426-a133-ab2f9fb3a868 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:00.683646 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ffe388d3-becb-4426-a133-ab2f9fb3a868 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1512 microversion: 2.1 time: 0.620493 Aug 24 10:36:00.691886 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2478/4579] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:00 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1512 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:00.871509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dec8f122-4c54-4368-a682-b41f2ca9e18f tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:00.880537 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dec8f122-4c54-4368-a682-b41f2ca9e18f tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6" status: 200 len: 1508 microversion: 2.1 time: 1.192178 Aug 24 10:36:00.885921 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2102/4580] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:59 2022] GET /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6 => generated 1508 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:00.935283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0d088de5-cbea-4254-809d-2af9e45652b8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:00.937462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0d088de5-cbea-4254-809d-2af9e45652b8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: 6548607f-1ff0-4a77-882d-7ccdfeffc55f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:00.949995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d088de5-cbea-4254-809d-2af9e45652b8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:00.950902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d088de5-cbea-4254-809d-2af9e45652b8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:00.951667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d088de5-cbea-4254-809d-2af9e45652b8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:00.952691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d088de5-cbea-4254-809d-2af9e45652b8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:00.953716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d088de5-cbea-4254-809d-2af9e45652b8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:00.954532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d088de5-cbea-4254-809d-2af9e45652b8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:01.611305 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0d088de5-cbea-4254-809d-2af9e45652b8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:01.628856 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0d088de5-cbea-4254-809d-2af9e45652b8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/6548607f-1ff0-4a77-882d-7ccdfeffc55f" status: 200 len: 1319 microversion: 2.1 time: 0.707899 Aug 24 10:36:01.633678 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2479/4581] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:00 2022] GET /compute/v2.1/servers/6548607f-1ff0-4a77-882d-7ccdfeffc55f => generated 1319 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:01.716119 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b13ded3b-e6d0-46fa-964c-d3f3798b1dfe tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:01.716753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b13ded3b-e6d0-46fa-964c-d3f3798b1dfe tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:01.728988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b13ded3b-e6d0-46fa-964c-d3f3798b1dfe tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:01.729860 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b13ded3b-e6d0-46fa-964c-d3f3798b1dfe tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:01.730474 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b13ded3b-e6d0-46fa-964c-d3f3798b1dfe tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:01.733251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b13ded3b-e6d0-46fa-964c-d3f3798b1dfe tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:01.735909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b13ded3b-e6d0-46fa-964c-d3f3798b1dfe tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:01.737037 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b13ded3b-e6d0-46fa-964c-d3f3798b1dfe tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:02.652535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7de4e2a8-b5dc-4b80-b224-7bfe757e2f12 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:02.653673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7de4e2a8-b5dc-4b80-b224-7bfe757e2f12 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: 6548607f-1ff0-4a77-882d-7ccdfeffc55f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:02.678808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7de4e2a8-b5dc-4b80-b224-7bfe757e2f12 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:02.681150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7de4e2a8-b5dc-4b80-b224-7bfe757e2f12 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:02.681950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7de4e2a8-b5dc-4b80-b224-7bfe757e2f12 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:02.684134 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7de4e2a8-b5dc-4b80-b224-7bfe757e2f12 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:02.686225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7de4e2a8-b5dc-4b80-b224-7bfe757e2f12 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:02.687610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7de4e2a8-b5dc-4b80-b224-7bfe757e2f12 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:02.818309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b13ded3b-e6d0-46fa-964c-d3f3798b1dfe tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:02.851664 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b13ded3b-e6d0-46fa-964c-d3f3798b1dfe tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1512 microversion: 2.1 time: 1.137596 Aug 24 10:36:02.852292 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2103/4582] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:01 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1512 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:03.592630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7de4e2a8-b5dc-4b80-b224-7bfe757e2f12 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:03.610945 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7de4e2a8-b5dc-4b80-b224-7bfe757e2f12 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/6548607f-1ff0-4a77-882d-7ccdfeffc55f" status: 200 len: 1507 microversion: 2.1 time: 0.963225 Aug 24 10:36:03.621167 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2480/4583] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:02 2022] GET /compute/v2.1/servers/6548607f-1ff0-4a77-882d-7ccdfeffc55f => generated 1507 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:03.635763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b71b3290-5443-4e44-8e0a-52ce48fe4c56 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:03.636685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b71b3290-5443-4e44-8e0a-52ce48fe4c56 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: 6548607f-1ff0-4a77-882d-7ccdfeffc55f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:03.645373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b71b3290-5443-4e44-8e0a-52ce48fe4c56 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:03.656472 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b71b3290-5443-4e44-8e0a-52ce48fe4c56 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:03.657143 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b71b3290-5443-4e44-8e0a-52ce48fe4c56 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:03.658761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b71b3290-5443-4e44-8e0a-52ce48fe4c56 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:03.659439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b71b3290-5443-4e44-8e0a-52ce48fe4c56 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:03.664914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b71b3290-5443-4e44-8e0a-52ce48fe4c56 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:03.708085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b71b3290-5443-4e44-8e0a-52ce48fe4c56 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: 6548607f-1ff0-4a77-882d-7ccdfeffc55f] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:36:03.812657 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:03.872285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-57098f4d-2d7c-42ba-b514-73f4fc6931fe tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:03.872905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-57098f4d-2d7c-42ba-b514-73f4fc6931fe tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:03.897078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57098f4d-2d7c-42ba-b514-73f4fc6931fe tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:03.907041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57098f4d-2d7c-42ba-b514-73f4fc6931fe tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:03.907680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57098f4d-2d7c-42ba-b514-73f4fc6931fe tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:03.909460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57098f4d-2d7c-42ba-b514-73f4fc6931fe tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:03.910108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57098f4d-2d7c-42ba-b514-73f4fc6931fe tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:03.910829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57098f4d-2d7c-42ba-b514-73f4fc6931fe tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:03.943660 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b71b3290-5443-4e44-8e0a-52ce48fe4c56 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "DELETE /compute/v2.1/servers/6548607f-1ff0-4a77-882d-7ccdfeffc55f" status: 204 len: 0 microversion: 2.1 time: 0.311498 Aug 24 10:36:03.948919 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2104/4584] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:36:03 2022] DELETE /compute/v2.1/servers/6548607f-1ff0-4a77-882d-7ccdfeffc55f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:36:03.984618 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c64fe8b5-ba15-4757-90df-d930bf798d0d tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:04.001372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c64fe8b5-ba15-4757-90df-d930bf798d0d tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: c3620de3-2e71-4135-bd71-246c54910ef6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:04.024998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c64fe8b5-ba15-4757-90df-d930bf798d0d tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:04.025993 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c64fe8b5-ba15-4757-90df-d930bf798d0d tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:04.026588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c64fe8b5-ba15-4757-90df-d930bf798d0d tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:04.042331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c64fe8b5-ba15-4757-90df-d930bf798d0d tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:04.045965 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c64fe8b5-ba15-4757-90df-d930bf798d0d tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:04.047408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c64fe8b5-ba15-4757-90df-d930bf798d0d tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:04.177289 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c64fe8b5-ba15-4757-90df-d930bf798d0d tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: c3620de3-2e71-4135-bd71-246c54910ef6] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:36:04.344120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-57098f4d-2d7c-42ba-b514-73f4fc6931fe tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:04.356579 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-57098f4d-2d7c-42ba-b514-73f4fc6931fe tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1512 microversion: 2.1 time: 0.488464 Aug 24 10:36:04.369543 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2481/4585] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:03 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1512 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:04.434270 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c64fe8b5-ba15-4757-90df-d930bf798d0d tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "DELETE /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6" status: 204 len: 0 microversion: 2.1 time: 0.470659 Aug 24 10:36:04.437810 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2105/4586] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:36:03 2022] DELETE /compute/v2.1/servers/c3620de3-2e71-4135-bd71-246c54910ef6 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:36:04.574777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4a1d81a2-4427-4b0e-aee7-0ba48bcaae76 tempest-ServerGroup264TestJSON-2136595741 tempest-ServerGroup264TestJSON-2136595741-project] Action: 'create', calling method: .version_select at 0x7f4654167b80>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:36:04.629050 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-4a1d81a2-4427-4b0e-aee7-0ba48bcaae76 tempest-ServerGroup264TestJSON-2136595741 tempest-ServerGroup264TestJSON-2136595741-project] Getting quotas for project 679de720d78a4a889a0320036ef30e20. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:36:04.644148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-4a1d81a2-4427-4b0e-aee7-0ba48bcaae76 tempest-ServerGroup264TestJSON-2136595741 tempest-ServerGroup264TestJSON-2136595741-project] Getting quotas for user b746773d85ac4972b92a469fdc94243a and project 679de720d78a4a889a0320036ef30e20. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:36:04.780358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-4a1d81a2-4427-4b0e-aee7-0ba48bcaae76 tempest-ServerGroup264TestJSON-2136595741 tempest-ServerGroup264TestJSON-2136595741-project] Getting quotas for project 679de720d78a4a889a0320036ef30e20. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:36:04.796287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-4a1d81a2-4427-4b0e-aee7-0ba48bcaae76 tempest-ServerGroup264TestJSON-2136595741 tempest-ServerGroup264TestJSON-2136595741-project] Getting quotas for user b746773d85ac4972b92a469fdc94243a and project 679de720d78a4a889a0320036ef30e20. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:36:04.845702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cb91fff8-69b6-4ae6-8d67-e660406677bc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1503630358", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "c36cbae7-d73d-45df-8057-3341e4f7db44"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:36:04.865937 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4a1d81a2-4427-4b0e-aee7-0ba48bcaae76 tempest-ServerGroup264TestJSON-2136595741 tempest-ServerGroup264TestJSON-2136595741-project] 10.222.0.85 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.504720 Aug 24 10:36:04.872500 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2482/4587] 10.222.0.85 () {62 vars in 1214 bytes} [Wed Aug 24 10:36:04 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:36:04.903937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d70ea8c6-7504-40fd-ac6c-cbfcddb4a044 tempest-ServerGroup264TestJSON-2136595741 tempest-ServerGroup264TestJSON-2136595741-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:04.945320 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d70ea8c6-7504-40fd-ac6c-cbfcddb4a044 tempest-ServerGroup264TestJSON-2136595741 tempest-ServerGroup264TestJSON-2136595741-project] 10.222.0.85 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.064050 Aug 24 10:36:04.946884 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2483/4588] 10.222.0.85 () {60 vars in 1193 bytes} [Wed Aug 24 10:36:04 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:36:04.962737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-03a3d64a-44ee-4f75-b979-0c981c989758 tempest-ServerGroup264TestJSON-2136595741 tempest-ServerGroup264TestJSON-2136595741-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:04.975736 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-03a3d64a-44ee-4f75-b979-0c981c989758 tempest-ServerGroup264TestJSON-2136595741 tempest-ServerGroup264TestJSON-2136595741-project] 10.222.0.85 "GET /compute/v2.1/os-server-groups/273aaa59-245c-401c-9347-7acbcf610858" status: 200 len: 235 microversion: 2.64 time: 0.019759 Aug 24 10:36:04.976950 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2484/4589] 10.222.0.85 () {60 vars in 1304 bytes} [Wed Aug 24 10:36:04 2022] GET /compute/v2.1/os-server-groups/273aaa59-245c-401c-9347-7acbcf610858 => generated 235 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:36:04.990251 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1f80f8fa-0055-4d18-a0d4-88743780d30d tempest-ServerGroup264TestJSON-2136595741 tempest-ServerGroup264TestJSON-2136595741-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:05.007740 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-cb91fff8-69b6-4ae6-8d67-e660406677bc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] validate_networks() for [('c36cbae7-d73d-45df-8057-3341e4f7db44', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:36:05.046838 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1f80f8fa-0055-4d18-a0d4-88743780d30d tempest-ServerGroup264TestJSON-2136595741 tempest-ServerGroup264TestJSON-2136595741-project] 10.222.0.85 "DELETE /compute/v2.1/os-server-groups/273aaa59-245c-401c-9347-7acbcf610858" status: 204 len: 0 microversion: 2.64 time: 0.060648 Aug 24 10:36:05.061143 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2485/4590] 10.222.0.85 () {60 vars in 1307 bytes} [Wed Aug 24 10:36:04 2022] DELETE /compute/v2.1/os-server-groups/273aaa59-245c-401c-9347-7acbcf610858 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 10:36:05.081161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-afbdd3b2-dc05-42d3-898a-f1147a5db4f8 tempest-ServerGroup264TestJSON-2136595741 tempest-ServerGroup264TestJSON-2136595741-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:05.091624 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-afbdd3b2-dc05-42d3-898a-f1147a5db4f8 tempest-ServerGroup264TestJSON-2136595741 tempest-ServerGroup264TestJSON-2136595741-project] HTTP exception thrown: Instance group 273aaa59-245c-401c-9347-7acbcf610858 could not be found. Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-afbdd3b2-dc05-42d3-898a-f1147a5db4f8 tempest-ServerGroup264TestJSON-2136595741 tempest-ServerGroup264TestJSON-2136595741-project] Request method failure captured: Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-server-groups/273aaa59-245c-401c-9347-7acbcf610858 HTTP/1.1 Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf8TZBeS-HtI5D-RdIlK8jftQsZS4ON8RLd3lXmmVxKPXKsfw5TOJ2n9JrxYit7r4BObWt7rF807_bQ2iDCbVoJpL3M-3jLRV2uEN-gFnDSwJTn6JMCj_WoZbyd6kNdmfxFKUzFKBYc-LzI9hfUGqElEpSgBZVW-GxkYR_CGCfIoN80 Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.64 Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 679de720d78a4a889a0320036ef30e20 Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerGroup264TestJSON-2136595741 Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/679de720d78a4a889a0320036ef30e20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_679de720d78a4a889a0320036ef30e20", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/679de720d78a4a889a0320036ef30e20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/679de720d78a4a889a0320036ef30e20"}]}] Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerGroup264TestJSON-2136595741 Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 679de720d78a4a889a0320036ef30e20 Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerGroup264TestJSON-2136595741 Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerGroup264TestJSON-2136595741-project Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: b746773d85ac4972b92a469fdc94243a Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerGroup264TestJSON-2136595741-project Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance group 273aaa59-245c-401c-9347-7acbcf610858 could not be found. Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '273aaa59-245c-401c-9347-7acbcf610858'} Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 273aaa59-245c-401c-9347-7acbcf610858 could not be found. Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 273aaa59-245c-401c-9347-7acbcf610858 could not be found. Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:05.094897 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:05.099914 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:36:05.099914 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:36:05.099914 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:36:05.099914 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:36:05.099914 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 273aaa59-245c-401c-9347-7acbcf610858 could not be found. Aug 24 10:36:05.099914 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:05.101375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-afbdd3b2-dc05-42d3-898a-f1147a5db4f8 tempest-ServerGroup264TestJSON-2136595741 tempest-ServerGroup264TestJSON-2136595741-project] Returning 404 to user: Instance group 273aaa59-245c-401c-9347-7acbcf610858 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:36:05.102980 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-afbdd3b2-dc05-42d3-898a-f1147a5db4f8 tempest-ServerGroup264TestJSON-2136595741 tempest-ServerGroup264TestJSON-2136595741-project] 10.222.0.85 "DELETE /compute/v2.1/os-server-groups/273aaa59-245c-401c-9347-7acbcf610858" status: 404 len: 117 microversion: 2.64 time: 0.026344 Aug 24 10:36:05.104793 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2486/4591] 10.222.0.85 () {60 vars in 1307 bytes} [Wed Aug 24 10:36:05 2022] DELETE /compute/v2.1/os-server-groups/273aaa59-245c-401c-9347-7acbcf610858 => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:36:05.392963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e5835213-0c09-4e25-9d43-b736749e4d62 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:05.396537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e5835213-0c09-4e25-9d43-b736749e4d62 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:05.419721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5835213-0c09-4e25-9d43-b736749e4d62 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:05.420295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5835213-0c09-4e25-9d43-b736749e4d62 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:05.420747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5835213-0c09-4e25-9d43-b736749e4d62 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:05.421526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5835213-0c09-4e25-9d43-b736749e4d62 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:05.422001 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5835213-0c09-4e25-9d43-b736749e4d62 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:05.439111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5835213-0c09-4e25-9d43-b736749e4d62 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:06.040165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e5835213-0c09-4e25-9d43-b736749e4d62 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:06.064443 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e5835213-0c09-4e25-9d43-b736749e4d62 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1512 microversion: 2.1 time: 0.684290 Aug 24 10:36:06.065995 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2487/4592] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:05 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1512 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:07.096604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-26c466af-2114-401d-bcb9-a7ea4dea2c6f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:07.097209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-26c466af-2114-401d-bcb9-a7ea4dea2c6f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:07.119344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26c466af-2114-401d-bcb9-a7ea4dea2c6f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:07.120026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26c466af-2114-401d-bcb9-a7ea4dea2c6f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:07.120466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26c466af-2114-401d-bcb9-a7ea4dea2c6f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:07.126304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26c466af-2114-401d-bcb9-a7ea4dea2c6f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:07.126858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26c466af-2114-401d-bcb9-a7ea4dea2c6f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:07.127301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26c466af-2114-401d-bcb9-a7ea4dea2c6f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:07.856202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-26c466af-2114-401d-bcb9-a7ea4dea2c6f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:07.867285 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-26c466af-2114-401d-bcb9-a7ea4dea2c6f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1489 microversion: 2.1 time: 0.778522 Aug 24 10:36:07.870747 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2488/4593] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:07 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1489 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:07.892094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a0c98ffc-1e7f-42fe-86b5-5130048ef0d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:36:07.894883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a0c98ffc-1e7f-42fe-86b5-5130048ef0d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:07.911951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0c98ffc-1e7f-42fe-86b5-5130048ef0d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:07.912466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0c98ffc-1e7f-42fe-86b5-5130048ef0d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:07.922355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0c98ffc-1e7f-42fe-86b5-5130048ef0d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:07.925569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0c98ffc-1e7f-42fe-86b5-5130048ef0d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:07.926645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0c98ffc-1e7f-42fe-86b5-5130048ef0d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:07.928729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0c98ffc-1e7f-42fe-86b5-5130048ef0d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:08.076195 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a0c98ffc-1e7f-42fe-86b5-5130048ef0d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action" status: 200 len: 142 microversion: 2.1 time: 0.188935 Aug 24 10:36:08.081621 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2489/4594] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:36:07 2022] POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action => generated 142 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:36:08.087338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a0c98ffc-1e7f-42fe-86b5-5130048ef0d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:08.088711 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a0c98ffc-1e7f-42fe-86b5-5130048ef0d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002650 Aug 24 10:36:08.091332 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2490/4595] 10.222.0.85 () {56 vars in 886 bytes} [Wed Aug 24 10:36:08 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 24 10:36:08.107709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-20f1e803-a74d-431f-a6d0-1a7d195f836d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:08.111468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-20f1e803-a74d-431f-a6d0-1a7d195f836d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:08.167332 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20f1e803-a74d-431f-a6d0-1a7d195f836d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:08.167332 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20f1e803-a74d-431f-a6d0-1a7d195f836d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:08.167680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20f1e803-a74d-431f-a6d0-1a7d195f836d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:08.168244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20f1e803-a74d-431f-a6d0-1a7d195f836d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:08.168700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20f1e803-a74d-431f-a6d0-1a7d195f836d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:08.169150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20f1e803-a74d-431f-a6d0-1a7d195f836d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:08.189791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:08.750873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-20f1e803-a74d-431f-a6d0-1a7d195f836d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:08.765139 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-20f1e803-a74d-431f-a6d0-1a7d195f836d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.668520 Aug 24 10:36:08.767190 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2491/4596] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:08 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:08.771962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-20f1e803-a74d-431f-a6d0-1a7d195f836d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:08.773166 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-20f1e803-a74d-431f-a6d0-1a7d195f836d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.004867 Aug 24 10:36:08.773580 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2492/4597] 10.222.0.85 () {54 vars in 1035 bytes} [Wed Aug 24 10:36:08 2022] GET /compute/v2/ => generated 379 bytes in 6 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 24 10:36:08.786831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-13b242b5-192a-4144-85a9-c8a850a5518b req-88210962-e811-4add-85aa-fabfeb4b52cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6548607f-1ff0-4a77-882d-7ccdfeffc55f", "name": "network-vif-deleted", "tag": "00068dba-a9ad-4827-a908-ad8fae978fdf"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:36:08.824733 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-13b242b5-192a-4144-85a9-c8a850a5518b req-88210962-e811-4add-85aa-fabfeb4b52cb service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:08.825295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-13b242b5-192a-4144-85a9-c8a850a5518b req-88210962-e811-4add-85aa-fabfeb4b52cb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:08.825936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-13b242b5-192a-4144-85a9-c8a850a5518b req-88210962-e811-4add-85aa-fabfeb4b52cb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:08.847336 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-13b242b5-192a-4144-85a9-c8a850a5518b req-88210962-e811-4add-85aa-fabfeb4b52cb service nova] Creating event network-vif-deleted:00068dba-a9ad-4827-a908-ad8fae978fdf for instance 6548607f-1ff0-4a77-882d-7ccdfeffc55f on n-h1-849328-3 Aug 24 10:36:08.859699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cb91fff8-69b6-4ae6-8d67-e660406677bc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:36:08.860213 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cb91fff8-69b6-4ae6-8d67-e660406677bc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:36:08.860589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cb91fff8-69b6-4ae6-8d67-e660406677bc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:36:08.861001 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cb91fff8-69b6-4ae6-8d67-e660406677bc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:36:08.862076 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cb91fff8-69b6-4ae6-8d67-e660406677bc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:36:08.875585 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-13b242b5-192a-4144-85a9-c8a850a5518b req-88210962-e811-4add-85aa-fabfeb4b52cb service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098920 Aug 24 10:36:08.876230 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2493/4598] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:08.878903 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-13b242b5-192a-4144-85a9-c8a850a5518b req-88210962-e811-4add-85aa-fabfeb4b52cb service nova] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:08.881615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb91fff8-69b6-4ae6-8d67-e660406677bc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:08.882108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb91fff8-69b6-4ae6-8d67-e660406677bc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:08.882549 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb91fff8-69b6-4ae6-8d67-e660406677bc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:08.883279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb91fff8-69b6-4ae6-8d67-e660406677bc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:08.883739 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb91fff8-69b6-4ae6-8d67-e660406677bc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:08.884167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb91fff8-69b6-4ae6-8d67-e660406677bc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:08.890008 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-13b242b5-192a-4144-85a9-c8a850a5518b req-88210962-e811-4add-85aa-fabfeb4b52cb service nova] 10.222.0.85 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001518 Aug 24 10:36:08.890579 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2494/4599] 10.222.0.85 () {54 vars in 1041 bytes} [Wed Aug 24 10:36:08 2022] GET /compute/v2.1/ => generated 388 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:08.909741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3678fd19-4a7f-4d2b-a9ad-f1df29727b48 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:08.910495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3678fd19-4a7f-4d2b-a9ad-f1df29727b48 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:08.923754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3678fd19-4a7f-4d2b-a9ad-f1df29727b48 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:08.924596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3678fd19-4a7f-4d2b-a9ad-f1df29727b48 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:08.925258 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3678fd19-4a7f-4d2b-a9ad-f1df29727b48 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:08.926391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3678fd19-4a7f-4d2b-a9ad-f1df29727b48 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:08.927138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3678fd19-4a7f-4d2b-a9ad-f1df29727b48 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:08.927725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3678fd19-4a7f-4d2b-a9ad-f1df29727b48 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:08.939141 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-cb91fff8-69b6-4ae6-8d67-e660406677bc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Getting quotas for project b4137804f32f459394ac7aa54f6bacb3. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:36:08.960778 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-cb91fff8-69b6-4ae6-8d67-e660406677bc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Getting quotas for user f2aacca6ee8646349b6f385adb8b9ef3 and project b4137804f32f459394ac7aa54f6bacb3. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:36:08.999460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cb91fff8-69b6-4ae6-8d67-e660406677bc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Going to run 2 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:36:09.004885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cb91fff8-69b6-4ae6-8d67-e660406677bc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: ee1d0652-a85c-44aa-aadb-cc43e28c30fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:36:09.063899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cb91fff8-69b6-4ae6-8d67-e660406677bc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: 60017c53-5854-4b27-a8e7-164c39da5856] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=ee1d0652-a85c-44aa-aadb-cc43e28c30fc,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:36:09.202464 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cb91fff8-69b6-4ae6-8d67-e660406677bc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 4.361515 Aug 24 10:36:09.205951 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2106/4600] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:36:04 2022] POST /compute/v2.1/servers => generated 32 bytes in 4367 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 24 10:36:09.208642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cb91fff8-69b6-4ae6-8d67-e660406677bc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:09.212040 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cb91fff8-69b6-4ae6-8d67-e660406677bc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002916 Aug 24 10:36:09.212612 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2107/4601] 10.222.0.85 () {56 vars in 886 bytes} [Wed Aug 24 10:36:09 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 24 10:36:09.219609 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-451d708e-b0ba-4bfe-a169-3eab782cb043 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:09.236703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-451d708e-b0ba-4bfe-a169-3eab782cb043 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:09.238629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-451d708e-b0ba-4bfe-a169-3eab782cb043 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Searching by: {'deleted': False, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:36:09.297454 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-451d708e-b0ba-4bfe-a169-3eab782cb043 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:09.298004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-451d708e-b0ba-4bfe-a169-3eab782cb043 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:09.300935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-451d708e-b0ba-4bfe-a169-3eab782cb043 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:09.303901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-451d708e-b0ba-4bfe-a169-3eab782cb043 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:09.304648 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-451d708e-b0ba-4bfe-a169-3eab782cb043 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:09.305721 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-451d708e-b0ba-4bfe-a169-3eab782cb043 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:09.382994 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-451d708e-b0ba-4bfe-a169-3eab782cb043 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:36:09.431222 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-451d708e-b0ba-4bfe-a169-3eab782cb043 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.217350 Aug 24 10:36:09.433815 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2108/4602] 10.222.0.85 () {58 vars in 1125 bytes} [Wed Aug 24 10:36:09 2022] GET /compute/v2.1/servers => generated 1004 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:09.445489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ae85c6a7-1b3f-4d01-a3fd-9d9062b736ea tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:09.447728 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ae85c6a7-1b3f-4d01-a3fd-9d9062b736ea tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: 60017c53-5854-4b27-a8e7-164c39da5856] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:09.828127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ae85c6a7-1b3f-4d01-a3fd-9d9062b736ea tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:09.836543 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ae85c6a7-1b3f-4d01-a3fd-9d9062b736ea tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856" status: 200 len: 1218 microversion: 2.1 time: 0.396636 Aug 24 10:36:09.843456 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2109/4603] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:09 2022] GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856 => generated 1218 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:09.924759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3678fd19-4a7f-4d2b-a9ad-f1df29727b48 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:09.958268 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3678fd19-4a7f-4d2b-a9ad-f1df29727b48 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 1.062671 Aug 24 10:36:09.960364 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2495/4604] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:08 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:09.986416 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd32cd42-ab6a-45a5-8b9c-5022c9b9c905 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:09.987724 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dd32cd42-ab6a-45a5-8b9c-5022c9b9c905 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:10.009191 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd32cd42-ab6a-45a5-8b9c-5022c9b9c905 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:10.009675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd32cd42-ab6a-45a5-8b9c-5022c9b9c905 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:10.010214 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd32cd42-ab6a-45a5-8b9c-5022c9b9c905 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:10.017092 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd32cd42-ab6a-45a5-8b9c-5022c9b9c905 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:10.017092 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd32cd42-ab6a-45a5-8b9c-5022c9b9c905 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:10.033374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd32cd42-ab6a-45a5-8b9c-5022c9b9c905 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:10.703019 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dd32cd42-ab6a-45a5-8b9c-5022c9b9c905 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:10.727038 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dd32cd42-ab6a-45a5-8b9c-5022c9b9c905 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.745112 Aug 24 10:36:10.728727 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2110/4605] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:09 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:10.750619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ebcea47c-a547-42d3-b2a6-cb7dac428128 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:10.752698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ebcea47c-a547-42d3-b2a6-cb7dac428128 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:10.763812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebcea47c-a547-42d3-b2a6-cb7dac428128 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:10.764665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebcea47c-a547-42d3-b2a6-cb7dac428128 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:10.765270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebcea47c-a547-42d3-b2a6-cb7dac428128 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:10.766395 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebcea47c-a547-42d3-b2a6-cb7dac428128 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:10.767116 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebcea47c-a547-42d3-b2a6-cb7dac428128 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:10.767759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebcea47c-a547-42d3-b2a6-cb7dac428128 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:10.864167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-059020e7-bf85-45c6-b551-2a06c98b6b69 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:10.864795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-059020e7-bf85-45c6-b551-2a06c98b6b69 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: 60017c53-5854-4b27-a8e7-164c39da5856] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:11.048440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-059020e7-bf85-45c6-b551-2a06c98b6b69 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:11.060843 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-059020e7-bf85-45c6-b551-2a06c98b6b69 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856" status: 200 len: 1218 microversion: 2.1 time: 0.199313 Aug 24 10:36:11.062437 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2111/4606] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:10 2022] GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856 => generated 1218 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:36:11.081521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-abd4e03e-e1ef-4eb3-a372-0e785fa18874 req-7e674094-18a3-40cd-9fbb-5a94b9451a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3620de3-2e71-4135-bd71-246c54910ef6", "name": "network-vif-deleted", "tag": "6de16871-4e26-4ab0-ac4c-217f84459dd1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:36:11.113324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-abd4e03e-e1ef-4eb3-a372-0e785fa18874 req-7e674094-18a3-40cd-9fbb-5a94b9451a95 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:11.114052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-abd4e03e-e1ef-4eb3-a372-0e785fa18874 req-7e674094-18a3-40cd-9fbb-5a94b9451a95 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:11.114917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-abd4e03e-e1ef-4eb3-a372-0e785fa18874 req-7e674094-18a3-40cd-9fbb-5a94b9451a95 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:11.144026 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-abd4e03e-e1ef-4eb3-a372-0e785fa18874 req-7e674094-18a3-40cd-9fbb-5a94b9451a95 service nova] Creating event network-vif-deleted:6de16871-4e26-4ab0-ac4c-217f84459dd1 for instance c3620de3-2e71-4135-bd71-246c54910ef6 on n-h2-849328-3 Aug 24 10:36:11.169046 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-abd4e03e-e1ef-4eb3-a372-0e785fa18874 req-7e674094-18a3-40cd-9fbb-5a94b9451a95 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105106 Aug 24 10:36:11.169791 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2112/4607] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:11.713976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ebcea47c-a547-42d3-b2a6-cb7dac428128 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:11.733392 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ebcea47c-a547-42d3-b2a6-cb7dac428128 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.985320 Aug 24 10:36:11.737519 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2496/4608] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:10 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:12.052688 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ae1b58cc-63f0-4712-86e4-244092943df7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-273454796", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "c436d0f2-980c-499c-87fc-ff5c4aa0438d"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:36:12.089495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-74203ff8-ea17-4f81-b85b-d1fed59374e0 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:12.090140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-74203ff8-ea17-4f81-b85b-d1fed59374e0 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: 60017c53-5854-4b27-a8e7-164c39da5856] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:12.106630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74203ff8-ea17-4f81-b85b-d1fed59374e0 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:12.107140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74203ff8-ea17-4f81-b85b-d1fed59374e0 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:12.107671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74203ff8-ea17-4f81-b85b-d1fed59374e0 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:12.108454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74203ff8-ea17-4f81-b85b-d1fed59374e0 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:12.108914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74203ff8-ea17-4f81-b85b-d1fed59374e0 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:12.109369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74203ff8-ea17-4f81-b85b-d1fed59374e0 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:12.196084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-ae1b58cc-63f0-4712-86e4-244092943df7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] validate_networks() for [('c436d0f2-980c-499c-87fc-ff5c4aa0438d', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:36:12.841381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-74203ff8-ea17-4f81-b85b-d1fed59374e0 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:12.856315 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-74203ff8-ea17-4f81-b85b-d1fed59374e0 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856" status: 200 len: 1278 microversion: 2.1 time: 0.776995 Aug 24 10:36:12.856951 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2497/4609] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:12 2022] GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856 => generated 1278 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:13.884176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b25ec818-2dc6-4ac2-bae7-e57b732241ea tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:13.886185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b25ec818-2dc6-4ac2-bae7-e57b732241ea tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: 60017c53-5854-4b27-a8e7-164c39da5856] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:13.942314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b25ec818-2dc6-4ac2-bae7-e57b732241ea tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:13.944729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b25ec818-2dc6-4ac2-bae7-e57b732241ea tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:13.945463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b25ec818-2dc6-4ac2-bae7-e57b732241ea tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:13.946983 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b25ec818-2dc6-4ac2-bae7-e57b732241ea tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:13.948717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b25ec818-2dc6-4ac2-bae7-e57b732241ea tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:13.949712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b25ec818-2dc6-4ac2-bae7-e57b732241ea tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:14.192939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b25ec818-2dc6-4ac2-bae7-e57b732241ea tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:14.211869 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b25ec818-2dc6-4ac2-bae7-e57b732241ea tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856" status: 200 len: 1276 microversion: 2.1 time: 0.330941 Aug 24 10:36:14.215909 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2498/4610] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:13 2022] GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856 => generated 1276 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:14.764278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e1bf83ff-649e-4b06-b4db-2f0aa3230b7f tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Action: 'create', calling method: .version_select at 0x7f4647b310d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-548928985"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:36:14.823457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:15.408968 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e1bf83ff-649e-4b06-b4db-2f0aa3230b7f tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.191165 Aug 24 10:36:15.417170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-ae1b58cc-63f0-4712-86e4-244092943df7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:36:15.417170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-ae1b58cc-63f0-4712-86e4-244092943df7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:36:15.417170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-ae1b58cc-63f0-4712-86e4-244092943df7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:36:15.418155 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2499/4611] 10.222.0.85 () {60 vars in 1155 bytes} [Wed Aug 24 10:36:14 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1198 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 10:36:15.418256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-ae1b58cc-63f0-4712-86e4-244092943df7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:36:15.418256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-ae1b58cc-63f0-4712-86e4-244092943df7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:36:15.424905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6a0b49a2-ab66-443d-9f02-b78ab4b9ee09 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:15.426567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6a0b49a2-ab66-443d-9f02-b78ab4b9ee09 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: 60017c53-5854-4b27-a8e7-164c39da5856] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:15.451366 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a0b49a2-ab66-443d-9f02-b78ab4b9ee09 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:15.451873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a0b49a2-ab66-443d-9f02-b78ab4b9ee09 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:15.452318 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a0b49a2-ab66-443d-9f02-b78ab4b9ee09 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:15.453048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a0b49a2-ab66-443d-9f02-b78ab4b9ee09 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:15.455862 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae1b58cc-63f0-4712-86e4-244092943df7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:15.456354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae1b58cc-63f0-4712-86e4-244092943df7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:15.465070 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae1b58cc-63f0-4712-86e4-244092943df7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:15.466027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae1b58cc-63f0-4712-86e4-244092943df7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:15.466524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae1b58cc-63f0-4712-86e4-244092943df7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:15.467020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae1b58cc-63f0-4712-86e4-244092943df7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:15.470233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a0b49a2-ab66-443d-9f02-b78ab4b9ee09 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:15.470887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a0b49a2-ab66-443d-9f02-b78ab4b9ee09 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:15.564981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-ae1b58cc-63f0-4712-86e4-244092943df7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Getting quotas for project 3d511560c1f543169e7eab8c70c9abcd. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:36:15.581541 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-ae1b58cc-63f0-4712-86e4-244092943df7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Getting quotas for user 03ef6a33c1f0467993486547b7d00fda and project 3d511560c1f543169e7eab8c70c9abcd. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:36:15.602953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ae1b58cc-63f0-4712-86e4-244092943df7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:36:15.616496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ae1b58cc-63f0-4712-86e4-244092943df7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:36:15.709214 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6a0b49a2-ab66-443d-9f02-b78ab4b9ee09 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:15.720750 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6a0b49a2-ab66-443d-9f02-b78ab4b9ee09 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856" status: 200 len: 1276 microversion: 2.1 time: 0.304392 Aug 24 10:36:15.721704 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2500/4612] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:15 2022] GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856 => generated 1276 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:15.750039 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1a1bacf9-efb3-4003-9563-cca671136f0e tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Calling method '.version_select at 0x7f4647a9f310>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:15.771102 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ae1b58cc-63f0-4712-86e4-244092943df7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.726730 Aug 24 10:36:15.777856 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2113/4613] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:36:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 3734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:36:15.784522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ede3c5c1-8260-4c10-b30b-ba8959a31ca1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:15.785264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ede3c5c1-8260-4c10-b30b-ba8959a31ca1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:15.927669 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1a1bacf9-efb3-4003-9563-cca671136f0e tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/be1bd176-8884-46ee-9111-ff890ab51857" status: 200 len: 344 microversion: 2.1 time: 0.203807 Aug 24 10:36:15.931463 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2501/4614] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Aug 24 10:36:15 2022] GET /compute/v2.1/os-volumes/be1bd176-8884-46ee-9111-ff890ab51857 => generated 344 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:16.071844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ede3c5c1-8260-4c10-b30b-ba8959a31ca1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:16.082848 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ede3c5c1-8260-4c10-b30b-ba8959a31ca1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d" status: 200 len: 1214 microversion: 2.1 time: 0.303550 Aug 24 10:36:16.085402 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2114/4615] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:15 2022] GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d => generated 1214 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:16.750812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-15d36505-6c09-45db-a802-0dae4ef198b4 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:16.751441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-15d36505-6c09-45db-a802-0dae4ef198b4 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: 60017c53-5854-4b27-a8e7-164c39da5856] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:16.780408 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15d36505-6c09-45db-a802-0dae4ef198b4 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:16.780913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15d36505-6c09-45db-a802-0dae4ef198b4 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:16.791639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15d36505-6c09-45db-a802-0dae4ef198b4 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:16.799668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15d36505-6c09-45db-a802-0dae4ef198b4 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:16.800971 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15d36505-6c09-45db-a802-0dae4ef198b4 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:16.804788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15d36505-6c09-45db-a802-0dae4ef198b4 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:16.948038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df37f741-7e17-4bdb-900a-d6c1fde27672 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Calling method '.version_select at 0x7f4654f87280>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:17.077919 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-df37f741-7e17-4bdb-900a-d6c1fde27672 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/be1bd176-8884-46ee-9111-ff890ab51857" status: 200 len: 344 microversion: 2.1 time: 0.140094 Aug 24 10:36:17.078499 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2115/4616] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Aug 24 10:36:16 2022] GET /compute/v2.1/os-volumes/be1bd176-8884-46ee-9111-ff890ab51857 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:17.113421 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-69e2f470-1c67-492b-a3f9-ab27d8cf1f57 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:17.114725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-69e2f470-1c67-492b-a3f9-ab27d8cf1f57 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:17.130624 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69e2f470-1c67-492b-a3f9-ab27d8cf1f57 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:17.133444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69e2f470-1c67-492b-a3f9-ab27d8cf1f57 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:17.134703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69e2f470-1c67-492b-a3f9-ab27d8cf1f57 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:17.138020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69e2f470-1c67-492b-a3f9-ab27d8cf1f57 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:17.138020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69e2f470-1c67-492b-a3f9-ab27d8cf1f57 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:17.138020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69e2f470-1c67-492b-a3f9-ab27d8cf1f57 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:17.492747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-69e2f470-1c67-492b-a3f9-ab27d8cf1f57 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:17.505965 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-69e2f470-1c67-492b-a3f9-ab27d8cf1f57 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d" status: 200 len: 1210 microversion: 2.1 time: 0.398067 Aug 24 10:36:17.525256 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2116/4617] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:17 2022] GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d => generated 1210 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:17.558329 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-15d36505-6c09-45db-a802-0dae4ef198b4 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:17.568583 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-15d36505-6c09-45db-a802-0dae4ef198b4 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856" status: 200 len: 1318 microversion: 2.1 time: 0.822511 Aug 24 10:36:17.572048 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2502/4618] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:16 2022] GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856 => generated 1318 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:18.092779 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c69ea3c7-2069-431f-9c61-550989325e44 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Calling method '.version_select at 0x7f4654282430>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:18.194290 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c69ea3c7-2069-431f-9c61-550989325e44 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/be1bd176-8884-46ee-9111-ff890ab51857" status: 200 len: 345 microversion: 2.1 time: 0.106192 Aug 24 10:36:18.195732 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2117/4619] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Aug 24 10:36:18 2022] GET /compute/v2.1/os-volumes/be1bd176-8884-46ee-9111-ff890ab51857 => generated 345 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:18.210312 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c4a9a550-7e63-4b21-81be-eae1fd2abb52 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Action: 'create', calling method: .version_select at 0x7f4654716820>, body: {"snapshot": {"volume_id": "be1bd176-8884-46ee-9111-ff890ab51857", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2019772301"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:36:18.529213 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-13e5280c-2d8b-465b-a391-80778c0d4577 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:18.530248 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-13e5280c-2d8b-465b-a391-80778c0d4577 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:18.547614 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13e5280c-2d8b-465b-a391-80778c0d4577 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:18.556172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13e5280c-2d8b-465b-a391-80778c0d4577 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:18.556918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13e5280c-2d8b-465b-a391-80778c0d4577 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:18.558430 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13e5280c-2d8b-465b-a391-80778c0d4577 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:18.559089 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13e5280c-2d8b-465b-a391-80778c0d4577 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:18.559641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13e5280c-2d8b-465b-a391-80778c0d4577 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:18.594844 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c4a9a550-7e63-4b21-81be-eae1fd2abb52 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] 10.222.0.85 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.389678 Aug 24 10:36:18.595581 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2503/4620] 10.222.0.85 () {60 vars in 1162 bytes} [Wed Aug 24 10:36:18 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:18.600716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c5982a0a-9a7a-4a8d-abbb-2303f23adcfc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:18.601780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c5982a0a-9a7a-4a8d-abbb-2303f23adcfc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: 60017c53-5854-4b27-a8e7-164c39da5856] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:18.618570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5982a0a-9a7a-4a8d-abbb-2303f23adcfc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:18.620995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5982a0a-9a7a-4a8d-abbb-2303f23adcfc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:18.621708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5982a0a-9a7a-4a8d-abbb-2303f23adcfc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:18.624078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5982a0a-9a7a-4a8d-abbb-2303f23adcfc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:18.624844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5982a0a-9a7a-4a8d-abbb-2303f23adcfc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:18.627604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5982a0a-9a7a-4a8d-abbb-2303f23adcfc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:19.033840 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-13e5280c-2d8b-465b-a391-80778c0d4577 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:19.042420 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-13e5280c-2d8b-465b-a391-80778c0d4577 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d" status: 200 len: 1272 microversion: 2.1 time: 0.517918 Aug 24 10:36:19.047666 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2118/4621] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:18 2022] GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d => generated 1272 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:19.083997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-81edabfc-5f1d-4417-a59f-b15bf8574ef5 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Calling method '.version_select at 0x7f465428e280>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:19.162077 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-81edabfc-5f1d-4417-a59f-b15bf8574ef5 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/a27c93c8-a02d-4052-a5c1-f7a024a56ee7" status: 200 len: 287 microversion: 2.1 time: 0.102389 Aug 24 10:36:19.162924 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2119/4622] 10.222.0.85 () {58 vars in 1251 bytes} [Wed Aug 24 10:36:19 2022] GET /compute/v2.1/os-snapshots/a27c93c8-a02d-4052-a5c1-f7a024a56ee7 => generated 287 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:19.174716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d18819d-ac79-45c9-b20f-124811d0e846 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Calling method '.version_select at 0x7f4654282280>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:19.277999 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9d18819d-ac79-45c9-b20f-124811d0e846 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.108213 Aug 24 10:36:19.278861 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2120/4623] 10.222.0.85 () {58 vars in 1140 bytes} [Wed Aug 24 10:36:19 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:36:19.289724 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f53dc156-161d-4612-89c9-1fdd0161b33b tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Calling method '.version_select at 0x7f46540bc4c0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:19.355758 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f53dc156-161d-4612-89c9-1fdd0161b33b tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/a27c93c8-a02d-4052-a5c1-f7a024a56ee7" status: 200 len: 287 microversion: 2.1 time: 0.069702 Aug 24 10:36:19.360809 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2121/4624] 10.222.0.85 () {58 vars in 1251 bytes} [Wed Aug 24 10:36:19 2022] GET /compute/v2.1/os-snapshots/a27c93c8-a02d-4052-a5c1-f7a024a56ee7 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:19.445535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c5982a0a-9a7a-4a8d-abbb-2303f23adcfc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:19.460583 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c5982a0a-9a7a-4a8d-abbb-2303f23adcfc tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856" status: 200 len: 1318 microversion: 2.1 time: 0.863635 Aug 24 10:36:19.479443 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2504/4625] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:18 2022] GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856 => generated 1318 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:20.082920 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fabba5e5-e45f-4d99-a9f1-f2b8777ceab4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:20.083851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fabba5e5-e45f-4d99-a9f1-f2b8777ceab4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:20.103064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fabba5e5-e45f-4d99-a9f1-f2b8777ceab4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:20.108716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fabba5e5-e45f-4d99-a9f1-f2b8777ceab4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:20.111321 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fabba5e5-e45f-4d99-a9f1-f2b8777ceab4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:20.114697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fabba5e5-e45f-4d99-a9f1-f2b8777ceab4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:20.118889 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fabba5e5-e45f-4d99-a9f1-f2b8777ceab4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:20.119423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fabba5e5-e45f-4d99-a9f1-f2b8777ceab4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:20.368531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-94a2d2ba-dd64-4414-9243-bac7ed203a46 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Calling method '.version_select at 0x7f46557c2f70>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:20.422160 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-94a2d2ba-dd64-4414-9243-bac7ed203a46 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/a27c93c8-a02d-4052-a5c1-f7a024a56ee7" status: 200 len: 287 microversion: 2.1 time: 0.058140 Aug 24 10:36:20.427015 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2505/4626] 10.222.0.85 () {58 vars in 1251 bytes} [Wed Aug 24 10:36:20 2022] GET /compute/v2.1/os-snapshots/a27c93c8-a02d-4052-a5c1-f7a024a56ee7 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:36:20.471351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fabba5e5-e45f-4d99-a9f1-f2b8777ceab4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:20.482403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-38efa3f1-c3a7-4e16-ad43-8307a950267d tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:20.483362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-38efa3f1-c3a7-4e16-ad43-8307a950267d tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: 60017c53-5854-4b27-a8e7-164c39da5856] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:20.484936 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fabba5e5-e45f-4d99-a9f1-f2b8777ceab4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d" status: 200 len: 1272 microversion: 2.1 time: 0.405372 Aug 24 10:36:20.485836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:20.487887 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2122/4627] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:20 2022] GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d => generated 1272 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:20.527196 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38efa3f1-c3a7-4e16-ad43-8307a950267d tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:20.534531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38efa3f1-c3a7-4e16-ad43-8307a950267d tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:20.536088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38efa3f1-c3a7-4e16-ad43-8307a950267d tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:20.538978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38efa3f1-c3a7-4e16-ad43-8307a950267d tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:20.540977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38efa3f1-c3a7-4e16-ad43-8307a950267d tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:20.542474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38efa3f1-c3a7-4e16-ad43-8307a950267d tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:21.057278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-38efa3f1-c3a7-4e16-ad43-8307a950267d tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:21.076118 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-38efa3f1-c3a7-4e16-ad43-8307a950267d tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856" status: 200 len: 1318 microversion: 2.1 time: 0.595008 Aug 24 10:36:21.078188 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2506/4628] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:20 2022] GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856 => generated 1318 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:36:21.447964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-79f17bfe-1223-44a9-83f9-143b690c701d tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Calling method '.version_select at 0x7f46540bcaf0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:21.507801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-15b5f49a-adb5-4aa3-854b-9bf16d0fd66b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:21.508430 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-15b5f49a-adb5-4aa3-854b-9bf16d0fd66b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:21.524698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15b5f49a-adb5-4aa3-854b-9bf16d0fd66b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:21.525235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15b5f49a-adb5-4aa3-854b-9bf16d0fd66b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:21.525687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15b5f49a-adb5-4aa3-854b-9bf16d0fd66b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:21.536380 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-79f17bfe-1223-44a9-83f9-143b690c701d tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/a27c93c8-a02d-4052-a5c1-f7a024a56ee7" status: 200 len: 287 microversion: 2.1 time: 0.105172 Aug 24 10:36:21.541922 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2123/4629] 10.222.0.85 () {58 vars in 1251 bytes} [Wed Aug 24 10:36:21 2022] GET /compute/v2.1/os-snapshots/a27c93c8-a02d-4052-a5c1-f7a024a56ee7 => generated 287 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:21.548540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15b5f49a-adb5-4aa3-854b-9bf16d0fd66b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:21.552081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15b5f49a-adb5-4aa3-854b-9bf16d0fd66b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:21.554300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15b5f49a-adb5-4aa3-854b-9bf16d0fd66b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:21.846098 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-15b5f49a-adb5-4aa3-854b-9bf16d0fd66b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:21.856770 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-15b5f49a-adb5-4aa3-854b-9bf16d0fd66b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d" status: 200 len: 1272 microversion: 2.1 time: 0.353561 Aug 24 10:36:21.857999 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2507/4630] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:21 2022] GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d => generated 1272 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:22.109032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dc63b5c2-e82a-46bb-87e1-8ecad9425ff1 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:22.109887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dc63b5c2-e82a-46bb-87e1-8ecad9425ff1 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: 60017c53-5854-4b27-a8e7-164c39da5856] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:22.118441 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=9 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:22.143191 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc63b5c2-e82a-46bb-87e1-8ecad9425ff1 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:22.148175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc63b5c2-e82a-46bb-87e1-8ecad9425ff1 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:22.148669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc63b5c2-e82a-46bb-87e1-8ecad9425ff1 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:22.150729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc63b5c2-e82a-46bb-87e1-8ecad9425ff1 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:22.154155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc63b5c2-e82a-46bb-87e1-8ecad9425ff1 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:22.154644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc63b5c2-e82a-46bb-87e1-8ecad9425ff1 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:22.555325 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c8971452-b932-46a0-9184-52a1f1460849 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Calling method '.version_select at 0x7f4654ebc5e0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:22.612732 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c8971452-b932-46a0-9184-52a1f1460849 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/a27c93c8-a02d-4052-a5c1-f7a024a56ee7" status: 200 len: 288 microversion: 2.1 time: 0.066845 Aug 24 10:36:22.619735 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2508/4631] 10.222.0.85 () {58 vars in 1251 bytes} [Wed Aug 24 10:36:22 2022] GET /compute/v2.1/os-snapshots/a27c93c8-a02d-4052-a5c1-f7a024a56ee7 => generated 288 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:22.625509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-07e62fc2-4e30-46bb-95e3-28449a3d5632 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Calling method '.version_select at 0x7f46551c6af0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:22.762293 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-07e62fc2-4e30-46bb-95e3-28449a3d5632 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] 10.222.0.85 "DELETE /compute/v2.1/os-snapshots/a27c93c8-a02d-4052-a5c1-f7a024a56ee7" status: 202 len: 0 microversion: 2.1 time: 0.141139 Aug 24 10:36:22.763005 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2509/4632] 10.222.0.85 () {58 vars in 1254 bytes} [Wed Aug 24 10:36:22 2022] DELETE /compute/v2.1/os-snapshots/a27c93c8-a02d-4052-a5c1-f7a024a56ee7 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:36:22.771349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-12c2593d-9380-4d68-ac15-d03a836e562b tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Calling method '.version_select at 0x7f46551d68b0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:22.897772 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-12c2593d-9380-4d68-ac15-d03a836e562b tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/a27c93c8-a02d-4052-a5c1-f7a024a56ee7" status: 200 len: 287 microversion: 2.1 time: 0.130216 Aug 24 10:36:22.898373 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2510/4633] 10.222.0.85 () {58 vars in 1251 bytes} [Wed Aug 24 10:36:22 2022] GET /compute/v2.1/os-snapshots/a27c93c8-a02d-4052-a5c1-f7a024a56ee7 => generated 287 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:36:22.903543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5edaa596-6997-4f88-a149-2d3e9a0f3453 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:22.904248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5edaa596-6997-4f88-a149-2d3e9a0f3453 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:22.920819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5edaa596-6997-4f88-a149-2d3e9a0f3453 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:22.923339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5edaa596-6997-4f88-a149-2d3e9a0f3453 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:22.923978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5edaa596-6997-4f88-a149-2d3e9a0f3453 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:22.925359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5edaa596-6997-4f88-a149-2d3e9a0f3453 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:22.925992 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5edaa596-6997-4f88-a149-2d3e9a0f3453 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:22.926755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5edaa596-6997-4f88-a149-2d3e9a0f3453 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:23.103547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5edaa596-6997-4f88-a149-2d3e9a0f3453 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:23.116847 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5edaa596-6997-4f88-a149-2d3e9a0f3453 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d" status: 200 len: 1272 microversion: 2.1 time: 0.217356 Aug 24 10:36:23.118647 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2511/4634] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:22 2022] GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d => generated 1272 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:23.706696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-e34662b3-fa9c-4d0b-b83d-5d9148783c25 req-5c986158-d3d0-45f8-bd4a-2429c00dbae1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60017c53-5854-4b27-a8e7-164c39da5856", "tag": "61c66f40-ff34-4f0c-8a09-93af8a607f50"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:36:23.734282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e34662b3-fa9c-4d0b-b83d-5d9148783c25 req-5c986158-d3d0-45f8-bd4a-2429c00dbae1 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:23.734919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e34662b3-fa9c-4d0b-b83d-5d9148783c25 req-5c986158-d3d0-45f8-bd4a-2429c00dbae1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:23.735425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e34662b3-fa9c-4d0b-b83d-5d9148783c25 req-5c986158-d3d0-45f8-bd4a-2429c00dbae1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:23.765841 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-e34662b3-fa9c-4d0b-b83d-5d9148783c25 req-5c986158-d3d0-45f8-bd4a-2429c00dbae1 service nova] Creating event network-changed:61c66f40-ff34-4f0c-8a09-93af8a607f50 for instance 60017c53-5854-4b27-a8e7-164c39da5856 on n-h2-849328-3 Aug 24 10:36:23.783878 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-e34662b3-fa9c-4d0b-b83d-5d9148783c25 req-5c986158-d3d0-45f8-bd4a-2429c00dbae1 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080239 Aug 24 10:36:23.788120 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2512/4635] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:36:23.912609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-12ae153e-44e0-4c9c-adca-347afbd36d58 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Calling method '.version_select at 0x7f4654de3430>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:23.992836 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-12ae153e-44e0-4c9c-adca-347afbd36d58 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/a27c93c8-a02d-4052-a5c1-f7a024a56ee7" status: 200 len: 287 microversion: 2.1 time: 0.085747 Aug 24 10:36:23.993695 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2513/4636] 10.222.0.85 () {58 vars in 1251 bytes} [Wed Aug 24 10:36:23 2022] GET /compute/v2.1/os-snapshots/a27c93c8-a02d-4052-a5c1-f7a024a56ee7 => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:24.143440 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-48e0d8b6-8918-4914-8ab7-d344966d56c3 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:24.144488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-48e0d8b6-8918-4914-8ab7-d344966d56c3 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:24.167792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48e0d8b6-8918-4914-8ab7-d344966d56c3 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:24.169369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48e0d8b6-8918-4914-8ab7-d344966d56c3 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:24.228045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48e0d8b6-8918-4914-8ab7-d344966d56c3 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:24.229766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48e0d8b6-8918-4914-8ab7-d344966d56c3 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:24.232962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48e0d8b6-8918-4914-8ab7-d344966d56c3 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:24.237422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48e0d8b6-8918-4914-8ab7-d344966d56c3 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:24.638831 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dc63b5c2-e82a-46bb-87e1-8ecad9425ff1 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:24.660452 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dc63b5c2-e82a-46bb-87e1-8ecad9425ff1 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856" status: 200 len: 1318 microversion: 2.1 time: 2.559119 Aug 24 10:36:24.661155 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2124/4637] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:22 2022] GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856 => generated 1318 bytes in 2566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:36:24.740060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-48e0d8b6-8918-4914-8ab7-d344966d56c3 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:24.763052 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-48e0d8b6-8918-4914-8ab7-d344966d56c3 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d" status: 200 len: 1314 microversion: 2.1 time: 0.624534 Aug 24 10:36:24.777484 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2514/4638] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:24 2022] GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d => generated 1314 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:25.006278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8c45d207-d9ab-4c24-99ab-947925e62910 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Calling method '.version_select at 0x7f4654282160>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:25.086432 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8c45d207-d9ab-4c24-99ab-947925e62910 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/a27c93c8-a02d-4052-a5c1-f7a024a56ee7" status: 200 len: 287 microversion: 2.1 time: 0.084068 Aug 24 10:36:25.087345 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2125/4639] 10.222.0.85 () {58 vars in 1251 bytes} [Wed Aug 24 10:36:24 2022] GET /compute/v2.1/os-snapshots/a27c93c8-a02d-4052-a5c1-f7a024a56ee7 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:25.687462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cf0359bd-ceb6-4174-a0d1-da432c52c027 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:25.688382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cf0359bd-ceb6-4174-a0d1-da432c52c027 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: 60017c53-5854-4b27-a8e7-164c39da5856] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:25.697282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0359bd-ceb6-4174-a0d1-da432c52c027 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:25.698068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0359bd-ceb6-4174-a0d1-da432c52c027 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:25.698666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0359bd-ceb6-4174-a0d1-da432c52c027 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:25.699907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0359bd-ceb6-4174-a0d1-da432c52c027 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:25.701325 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0359bd-ceb6-4174-a0d1-da432c52c027 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:25.701924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0359bd-ceb6-4174-a0d1-da432c52c027 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:25.785684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:25.791764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2338af56-4a99-4d0d-80e3-a548f27120a5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:25.792795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2338af56-4a99-4d0d-80e3-a548f27120a5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:25.809977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2338af56-4a99-4d0d-80e3-a548f27120a5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:25.811916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2338af56-4a99-4d0d-80e3-a548f27120a5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:25.818787 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2338af56-4a99-4d0d-80e3-a548f27120a5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:25.819836 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2338af56-4a99-4d0d-80e3-a548f27120a5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:25.822072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2338af56-4a99-4d0d-80e3-a548f27120a5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:25.822687 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2338af56-4a99-4d0d-80e3-a548f27120a5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:26.055789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cf0359bd-ceb6-4174-a0d1-da432c52c027 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:26.069522 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cf0359bd-ceb6-4174-a0d1-da432c52c027 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856" status: 200 len: 1318 microversion: 2.1 time: 0.387399 Aug 24 10:36:26.071691 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2515/4640] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:25 2022] GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856 => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:26.077399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=18 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:26.100852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb822d75-dc13-4582-a59a-952e5fa991f4 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Calling method '.version_select at 0x7f4647affaf0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:26.131904 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-cb822d75-dc13-4582-a59a-952e5fa991f4 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] HTTP exception thrown: Snapshot a27c93c8-a02d-4052-a5c1-f7a024a56ee7 could not be found. Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb822d75-dc13-4582-a59a-952e5fa991f4 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Request method failure captured: Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-snapshots/a27c93c8-a02d-4052-a5c1-f7a024a56ee7 HTTP/1.1 Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf8eUOosAEwUQcpABbEYePButctuk-clK4bfjwkL3avXfaEthDZ6lbyIsVs8N_x-IAP4b_FduC2y5oZLqHoNxYswiN15fz75ed_KnHbrYUz6Zyjx9cNJLq7w6fsLbwhao8d7mJ1YMO1WolNf4rPSSaoPGj_EGtBVpIippKyQfGAZIAc Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: ae817b67ff74484d831793f8817e13ae Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-573941354 Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ae817b67ff74484d831793f8817e13ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_ae817b67ff74484d831793f8817e13ae", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ae817b67ff74484d831793f8817e13ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/ae817b67ff74484d831793f8817e13ae"}]}] Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-VolumesSnapshotsTestJSON-573941354 Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: ae817b67ff74484d831793f8817e13ae Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-573941354 Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-VolumesSnapshotsTestJSON-573941354-project Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 8b79110c6be243fcb1a2a40b6797ab65 Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-VolumesSnapshotsTestJSON-573941354-project Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: exception: Snapshot a27c93c8-a02d-4052-a5c1-f7a024a56ee7 could not be found. Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'a27c93c8-a02d-4052-a5c1-f7a024a56ee7'} Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a27c93c8-a02d-4052-a5c1-f7a024a56ee7 could not be found. (HTTP 404) (Request-ID: req-f0fd3a37-c3c2-49d1-a8c2-a2ef0e2af86a) Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 10:36:26.139657 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a27c93c8-a02d-4052-a5c1-f7a024a56ee7 could not be found. Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a27c93c8-a02d-4052-a5c1-f7a024a56ee7 could not be found. Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a27c93c8-a02d-4052-a5c1-f7a024a56ee7 could not be found. Aug 24 10:36:26.144244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:26.153330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb822d75-dc13-4582-a59a-952e5fa991f4 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Returning 404 to user: Snapshot a27c93c8-a02d-4052-a5c1-f7a024a56ee7 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:36:26.154518 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cb822d75-dc13-4582-a59a-952e5fa991f4 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/a27c93c8-a02d-4052-a5c1-f7a024a56ee7" status: 404 len: 111 microversion: 2.1 time: 0.058846 Aug 24 10:36:26.161254 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2516/4641] 10.222.0.85 () {58 vars in 1251 bytes} [Wed Aug 24 10:36:26 2022] GET /compute/v2.1/os-snapshots/a27c93c8-a02d-4052-a5c1-f7a024a56ee7 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:36:26.174601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-56e11195-f171-45e3-8166-81a13a636c50 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Calling method '.version_select at 0x7f4654eb7700>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:26.333182 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-56e11195-f171-45e3-8166-81a13a636c50 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/be1bd176-8884-46ee-9111-ff890ab51857" status: 202 len: 0 microversion: 2.1 time: 0.163057 Aug 24 10:36:26.334060 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2517/4642] 10.222.0.85 () {58 vars in 1248 bytes} [Wed Aug 24 10:36:26 2022] DELETE /compute/v2.1/os-volumes/be1bd176-8884-46ee-9111-ff890ab51857 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:36:26.343898 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a891def5-e625-4df4-804e-06e6f0bfa8a3 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Calling method '.version_select at 0x7f4654f2b040>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:26.444909 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a891def5-e625-4df4-804e-06e6f0bfa8a3 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/be1bd176-8884-46ee-9111-ff890ab51857" status: 200 len: 344 microversion: 2.1 time: 0.106087 Aug 24 10:36:26.445705 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2518/4643] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Aug 24 10:36:26 2022] GET /compute/v2.1/os-volumes/be1bd176-8884-46ee-9111-ff890ab51857 => generated 344 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:26.747546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2338af56-4a99-4d0d-80e3-a548f27120a5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:26.765194 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2338af56-4a99-4d0d-80e3-a548f27120a5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d" status: 200 len: 1314 microversion: 2.1 time: 0.980960 Aug 24 10:36:26.766421 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2126/4644] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:25 2022] GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d => generated 1314 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:27.095623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6ad2b351-bd1f-4445-a6e7-994d961322cd tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:27.096503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6ad2b351-bd1f-4445-a6e7-994d961322cd tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: 60017c53-5854-4b27-a8e7-164c39da5856] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:27.126510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ad2b351-bd1f-4445-a6e7-994d961322cd tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:27.132424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-cf226b48-16bf-4a27-ab4e-3e29f64e7d63 req-10790164-43f9-47a6-b818-c6c1ecd8c22a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee1d0652-a85c-44aa-aadb-cc43e28c30fc", "tag": "93cd5da0-38ae-4e9d-a5b5-e26c21950488"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:36:27.139173 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ad2b351-bd1f-4445-a6e7-994d961322cd tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:27.139884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ad2b351-bd1f-4445-a6e7-994d961322cd tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:27.140710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ad2b351-bd1f-4445-a6e7-994d961322cd tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:27.144077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ad2b351-bd1f-4445-a6e7-994d961322cd tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:27.145457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ad2b351-bd1f-4445-a6e7-994d961322cd tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:27.162201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cf226b48-16bf-4a27-ab4e-3e29f64e7d63 req-10790164-43f9-47a6-b818-c6c1ecd8c22a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:27.163173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cf226b48-16bf-4a27-ab4e-3e29f64e7d63 req-10790164-43f9-47a6-b818-c6c1ecd8c22a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:27.163884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cf226b48-16bf-4a27-ab4e-3e29f64e7d63 req-10790164-43f9-47a6-b818-c6c1ecd8c22a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:27.179606 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-cf226b48-16bf-4a27-ab4e-3e29f64e7d63 req-10790164-43f9-47a6-b818-c6c1ecd8c22a service nova] Creating event network-changed:93cd5da0-38ae-4e9d-a5b5-e26c21950488 for instance ee1d0652-a85c-44aa-aadb-cc43e28c30fc on n-h1-849328-3 Aug 24 10:36:27.187996 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-cf226b48-16bf-4a27-ab4e-3e29f64e7d63 req-10790164-43f9-47a6-b818-c6c1ecd8c22a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059577 Aug 24 10:36:27.190473 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2127/4645] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:27.464047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fe77127b-5486-48be-a1fe-578bc706bda2 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Calling method '.version_select at 0x7f4654f87820>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:27.546474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6ad2b351-bd1f-4445-a6e7-994d961322cd tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:27.555622 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6ad2b351-bd1f-4445-a6e7-994d961322cd tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856" status: 200 len: 1318 microversion: 2.1 time: 0.467296 Aug 24 10:36:27.608180 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2519/4646] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:27 2022] GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856 => generated 1318 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:27.644197 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fe77127b-5486-48be-a1fe-578bc706bda2 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/be1bd176-8884-46ee-9111-ff890ab51857" status: 200 len: 344 microversion: 2.1 time: 0.186945 Aug 24 10:36:27.645751 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2128/4647] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Aug 24 10:36:27 2022] GET /compute/v2.1/os-volumes/be1bd176-8884-46ee-9111-ff890ab51857 => generated 344 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:27.789522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b49e23e5-ec4a-4e99-b1f5-48f99db21ffa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:27.791230 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b49e23e5-ec4a-4e99-b1f5-48f99db21ffa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:27.803022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b49e23e5-ec4a-4e99-b1f5-48f99db21ffa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:27.805829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b49e23e5-ec4a-4e99-b1f5-48f99db21ffa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:27.806265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b49e23e5-ec4a-4e99-b1f5-48f99db21ffa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:27.809856 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b49e23e5-ec4a-4e99-b1f5-48f99db21ffa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:27.810503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b49e23e5-ec4a-4e99-b1f5-48f99db21ffa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:27.813572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b49e23e5-ec4a-4e99-b1f5-48f99db21ffa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:28.633543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ec440388-d041-4936-951f-046224a68b4e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:28.634360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ec440388-d041-4936-951f-046224a68b4e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: 60017c53-5854-4b27-a8e7-164c39da5856] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:28.640479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b49e23e5-ec4a-4e99-b1f5-48f99db21ffa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:28.655391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec440388-d041-4936-951f-046224a68b4e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:28.655884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec440388-d041-4936-951f-046224a68b4e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:28.656318 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec440388-d041-4936-951f-046224a68b4e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:28.656958 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b49e23e5-ec4a-4e99-b1f5-48f99db21ffa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d" status: 200 len: 1314 microversion: 2.1 time: 0.871986 Aug 24 10:36:28.657167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec440388-d041-4936-951f-046224a68b4e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:28.657495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec440388-d041-4936-951f-046224a68b4e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:28.657914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec440388-d041-4936-951f-046224a68b4e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:28.674632 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2520/4648] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:27 2022] GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d => generated 1314 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:28.700052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1b3a9fd1-c000-4d4d-b845-d9705ca0dac2 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Calling method '.version_select at 0x7f465a1ed790>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:28.805767 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1b3a9fd1-c000-4d4d-b845-d9705ca0dac2 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/be1bd176-8884-46ee-9111-ff890ab51857" status: 200 len: 344 microversion: 2.1 time: 0.129525 Aug 24 10:36:28.813100 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2521/4649] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Aug 24 10:36:28 2022] GET /compute/v2.1/os-volumes/be1bd176-8884-46ee-9111-ff890ab51857 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:29.682621 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-950348a3-66b4-477e-9826-831fd04d39ad tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:29.684559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-950348a3-66b4-477e-9826-831fd04d39ad tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:29.707301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-950348a3-66b4-477e-9826-831fd04d39ad tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:29.708198 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-950348a3-66b4-477e-9826-831fd04d39ad tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:29.708871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-950348a3-66b4-477e-9826-831fd04d39ad tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:29.710155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-950348a3-66b4-477e-9826-831fd04d39ad tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:29.710860 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-950348a3-66b4-477e-9826-831fd04d39ad tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:29.711566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-950348a3-66b4-477e-9826-831fd04d39ad tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:30.522048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ec440388-d041-4936-951f-046224a68b4e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:30.532125 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ec440388-d041-4936-951f-046224a68b4e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856" status: 200 len: 1318 microversion: 2.1 time: 1.903295 Aug 24 10:36:30.552109 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2129/4650] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:28 2022] GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856 => generated 1318 bytes in 1924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:36:30.563159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5df0ec71-f230-452b-9a26-e1892d4bf124 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Calling method '.version_select at 0x7f46541d6ca0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:30.613142 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-5df0ec71-f230-452b-9a26-e1892d4bf124 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] HTTP exception thrown: Volume be1bd176-8884-46ee-9111-ff890ab51857 could not be found. Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5df0ec71-f230-452b-9a26-e1892d4bf124 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Request method failure captured: Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-volumes/be1bd176-8884-46ee-9111-ff890ab51857 HTTP/1.1 Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf8eUOosAEwUQcpABbEYePButctuk-clK4bfjwkL3avXfaEthDZ6lbyIsVs8N_x-IAP4b_FduC2y5oZLqHoNxYswiN15fz75ed_KnHbrYUz6Zyjx9cNJLq7w6fsLbwhao8d7mJ1YMO1WolNf4rPSSaoPGj_EGtBVpIippKyQfGAZIAc Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: ae817b67ff74484d831793f8817e13ae Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-573941354 Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ae817b67ff74484d831793f8817e13ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_ae817b67ff74484d831793f8817e13ae", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ae817b67ff74484d831793f8817e13ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/ae817b67ff74484d831793f8817e13ae"}]}] Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-VolumesSnapshotsTestJSON-573941354 Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: ae817b67ff74484d831793f8817e13ae Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-573941354 Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-VolumesSnapshotsTestJSON-573941354-project Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 8b79110c6be243fcb1a2a40b6797ab65 Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-VolumesSnapshotsTestJSON-573941354-project Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: exception: Volume be1bd176-8884-46ee-9111-ff890ab51857 could not be found. Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'be1bd176-8884-46ee-9111-ff890ab51857'} Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume be1bd176-8884-46ee-9111-ff890ab51857 could not be found. (HTTP 404) (Request-ID: req-2dcc03ee-d9ed-42d7-81f1-210b5e8eb032) Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 10:36:30.631849 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume be1bd176-8884-46ee-9111-ff890ab51857 could not be found. Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume be1bd176-8884-46ee-9111-ff890ab51857 could not be found. Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume be1bd176-8884-46ee-9111-ff890ab51857 could not be found. Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5df0ec71-f230-452b-9a26-e1892d4bf124 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Returning 404 to user: Volume be1bd176-8884-46ee-9111-ff890ab51857 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5df0ec71-f230-452b-9a26-e1892d4bf124 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/be1bd176-8884-46ee-9111-ff890ab51857" status: 404 len: 109 microversion: 2.1 time: 0.077235 Aug 24 10:36:30.637063 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2130/4651] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Aug 24 10:36:30 2022] GET /compute/v2.1/os-volumes/be1bd176-8884-46ee-9111-ff890ab51857 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:36:30.643682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-7a3e6afb-4943-4319-bf25-5ed4cfc9f845 req-ab6a6560-8ac7-4042-a994-f84aa0144094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60017c53-5854-4b27-a8e7-164c39da5856", "name": "network-vif-plugged", "status": "completed", "tag": "61c66f40-ff34-4f0c-8a09-93af8a607f50"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:36:30.681004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7a3e6afb-4943-4319-bf25-5ed4cfc9f845 req-ab6a6560-8ac7-4042-a994-f84aa0144094 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:30.681530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7a3e6afb-4943-4319-bf25-5ed4cfc9f845 req-ab6a6560-8ac7-4042-a994-f84aa0144094 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:30.681971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7a3e6afb-4943-4319-bf25-5ed4cfc9f845 req-ab6a6560-8ac7-4042-a994-f84aa0144094 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:30.718733 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-950348a3-66b4-477e-9826-831fd04d39ad tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:30.729593 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7a3e6afb-4943-4319-bf25-5ed4cfc9f845 req-ab6a6560-8ac7-4042-a994-f84aa0144094 service nova] Creating event network-vif-plugged:61c66f40-ff34-4f0c-8a09-93af8a607f50 for instance 60017c53-5854-4b27-a8e7-164c39da5856 on n-h2-849328-3 Aug 24 10:36:30.740570 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-950348a3-66b4-477e-9826-831fd04d39ad tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d" status: 200 len: 1314 microversion: 2.1 time: 1.064411 Aug 24 10:36:30.742345 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-7a3e6afb-4943-4319-bf25-5ed4cfc9f845 req-ab6a6560-8ac7-4042-a994-f84aa0144094 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104979 Aug 24 10:36:30.745849 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2131/4653] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:30.746142 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2522/4653] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:29 2022] GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d => generated 1314 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:36:30.764953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f4c4ee4a-87b7-492b-9ad6-c4a85ccc0ca0 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Calling method '.version_select at 0x7f4647b47b80>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:30.844769 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-f4c4ee4a-87b7-492b-9ad6-c4a85ccc0ca0 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] HTTP exception thrown: Volume be1bd176-8884-46ee-9111-ff890ab51857 could not be found. Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f4c4ee4a-87b7-492b-9ad6-c4a85ccc0ca0 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Request method failure captured: Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-volumes/be1bd176-8884-46ee-9111-ff890ab51857 HTTP/1.1 Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf8eUOosAEwUQcpABbEYePButctuk-clK4bfjwkL3avXfaEthDZ6lbyIsVs8N_x-IAP4b_FduC2y5oZLqHoNxYswiN15fz75ed_KnHbrYUz6Zyjx9cNJLq7w6fsLbwhao8d7mJ1YMO1WolNf4rPSSaoPGj_EGtBVpIippKyQfGAZIAc Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: ae817b67ff74484d831793f8817e13ae Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-573941354 Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ae817b67ff74484d831793f8817e13ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_ae817b67ff74484d831793f8817e13ae", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ae817b67ff74484d831793f8817e13ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/ae817b67ff74484d831793f8817e13ae"}]}] Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-VolumesSnapshotsTestJSON-573941354 Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: ae817b67ff74484d831793f8817e13ae Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-573941354 Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-VolumesSnapshotsTestJSON-573941354-project Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 8b79110c6be243fcb1a2a40b6797ab65 Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-VolumesSnapshotsTestJSON-573941354-project Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: exception: Volume be1bd176-8884-46ee-9111-ff890ab51857 could not be found. Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'be1bd176-8884-46ee-9111-ff890ab51857'} Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume be1bd176-8884-46ee-9111-ff890ab51857 could not be found. (HTTP 404) (Request-ID: req-45146a3b-6cb6-40ce-afc0-2e00726c101c) Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 10:36:30.847460 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume be1bd176-8884-46ee-9111-ff890ab51857 could not be found. Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume be1bd176-8884-46ee-9111-ff890ab51857 could not be found. Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume be1bd176-8884-46ee-9111-ff890ab51857 could not be found. Aug 24 10:36:30.852596 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:30.857090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f4c4ee4a-87b7-492b-9ad6-c4a85ccc0ca0 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Returning 404 to user: Volume be1bd176-8884-46ee-9111-ff890ab51857 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:36:30.861108 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f4c4ee4a-87b7-492b-9ad6-c4a85ccc0ca0 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/be1bd176-8884-46ee-9111-ff890ab51857" status: 404 len: 109 microversion: 2.1 time: 0.112536 Aug 24 10:36:30.861959 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2523/4654] 10.222.0.85 () {58 vars in 1248 bytes} [Wed Aug 24 10:36:30 2022] DELETE /compute/v2.1/os-volumes/be1bd176-8884-46ee-9111-ff890ab51857 => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:36:30.875142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c9d59323-4018-47ed-93d0-354506c9a5d6 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Calling method '.version_select at 0x7f46540ea040>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:30.980275 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-c9d59323-4018-47ed-93d0-354506c9a5d6 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] HTTP exception thrown: Volume be1bd176-8884-46ee-9111-ff890ab51857 could not be found. Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c9d59323-4018-47ed-93d0-354506c9a5d6 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Request method failure captured: Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-volumes/be1bd176-8884-46ee-9111-ff890ab51857 HTTP/1.1 Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf8eUOosAEwUQcpABbEYePButctuk-clK4bfjwkL3avXfaEthDZ6lbyIsVs8N_x-IAP4b_FduC2y5oZLqHoNxYswiN15fz75ed_KnHbrYUz6Zyjx9cNJLq7w6fsLbwhao8d7mJ1YMO1WolNf4rPSSaoPGj_EGtBVpIippKyQfGAZIAc Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: ae817b67ff74484d831793f8817e13ae Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-573941354 Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ae817b67ff74484d831793f8817e13ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_ae817b67ff74484d831793f8817e13ae", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ae817b67ff74484d831793f8817e13ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/ae817b67ff74484d831793f8817e13ae"}]}] Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-VolumesSnapshotsTestJSON-573941354 Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: ae817b67ff74484d831793f8817e13ae Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-573941354 Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-VolumesSnapshotsTestJSON-573941354-project Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 8b79110c6be243fcb1a2a40b6797ab65 Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-VolumesSnapshotsTestJSON-573941354-project Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: exception: Volume be1bd176-8884-46ee-9111-ff890ab51857 could not be found. Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'be1bd176-8884-46ee-9111-ff890ab51857'} Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume be1bd176-8884-46ee-9111-ff890ab51857 could not be found. (HTTP 404) (Request-ID: req-d5984a1d-3dc1-4da9-916a-c2dd41cf0f1c) Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 10:36:30.982624 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume be1bd176-8884-46ee-9111-ff890ab51857 could not be found. Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume be1bd176-8884-46ee-9111-ff890ab51857 could not be found. Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume be1bd176-8884-46ee-9111-ff890ab51857 could not be found. Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c9d59323-4018-47ed-93d0-354506c9a5d6 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] Returning 404 to user: Volume be1bd176-8884-46ee-9111-ff890ab51857 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c9d59323-4018-47ed-93d0-354506c9a5d6 tempest-VolumesSnapshotsTestJSON-573941354 tempest-VolumesSnapshotsTestJSON-573941354-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/be1bd176-8884-46ee-9111-ff890ab51857" status: 404 len: 109 microversion: 2.1 time: 0.117737 Aug 24 10:36:30.986731 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2132/4655] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Aug 24 10:36:30 2022] GET /compute/v2.1/os-volumes/be1bd176-8884-46ee-9111-ff890ab51857 => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:36:31.563189 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a3bd19ec-2073-4d2b-a16d-621a2eb2b535 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:31.563792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a3bd19ec-2073-4d2b-a16d-621a2eb2b535 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: 60017c53-5854-4b27-a8e7-164c39da5856] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:31.575888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3bd19ec-2073-4d2b-a16d-621a2eb2b535 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:31.576500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3bd19ec-2073-4d2b-a16d-621a2eb2b535 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:31.576922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3bd19ec-2073-4d2b-a16d-621a2eb2b535 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:31.577713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3bd19ec-2073-4d2b-a16d-621a2eb2b535 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:31.578183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3bd19ec-2073-4d2b-a16d-621a2eb2b535 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:31.578614 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3bd19ec-2073-4d2b-a16d-621a2eb2b535 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:31.588201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:31.762968 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-280a8991-44f9-4cd4-992b-082307330955 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:31.765271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-280a8991-44f9-4cd4-992b-082307330955 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:31.800589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-280a8991-44f9-4cd4-992b-082307330955 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:31.803830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-280a8991-44f9-4cd4-992b-082307330955 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:31.809154 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-280a8991-44f9-4cd4-992b-082307330955 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:31.810545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-280a8991-44f9-4cd4-992b-082307330955 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:31.815484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-280a8991-44f9-4cd4-992b-082307330955 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:31.816815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-280a8991-44f9-4cd4-992b-082307330955 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:33.676279 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a3bd19ec-2073-4d2b-a16d-621a2eb2b535 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:33.688853 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a3bd19ec-2073-4d2b-a16d-621a2eb2b535 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856" status: 200 len: 1318 microversion: 2.1 time: 2.128836 Aug 24 10:36:33.697258 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2524/4656] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:31 2022] GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856 => generated 1318 bytes in 2138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:33.703845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-b1bc4c26-0cff-441f-a6ea-1b4e782f8508 req-7ba88631-ced8-4454-b1bb-25f1599908de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45f848cf-4fd8-44c9-8d28-d3491a3fbd2d", "tag": "923183a9-35de-48cb-8cf8-83600d182ee2"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:36:33.737912 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-280a8991-44f9-4cd4-992b-082307330955 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:33.746174 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-280a8991-44f9-4cd4-992b-082307330955 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d" status: 200 len: 1314 microversion: 2.1 time: 1.988217 Aug 24 10:36:33.750988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b1bc4c26-0cff-441f-a6ea-1b4e782f8508 req-7ba88631-ced8-4454-b1bb-25f1599908de service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:33.754654 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2133/4657] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:31 2022] GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d => generated 1314 bytes in 1997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:33.757689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b1bc4c26-0cff-441f-a6ea-1b4e782f8508 req-7ba88631-ced8-4454-b1bb-25f1599908de service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:33.758516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b1bc4c26-0cff-441f-a6ea-1b4e782f8508 req-7ba88631-ced8-4454-b1bb-25f1599908de service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:33.791276 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-b1bc4c26-0cff-441f-a6ea-1b4e782f8508 req-7ba88631-ced8-4454-b1bb-25f1599908de service nova] Creating event network-changed:923183a9-35de-48cb-8cf8-83600d182ee2 for instance 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d on n-h1-849328-3 Aug 24 10:36:33.802411 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-b1bc4c26-0cff-441f-a6ea-1b4e782f8508 req-7ba88631-ced8-4454-b1bb-25f1599908de service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103818 Aug 24 10:36:33.806583 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2525/4658] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:34.736205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3e0556f5-2a95-402a-b1cf-caff57ced2d3 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:34.737294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3e0556f5-2a95-402a-b1cf-caff57ced2d3 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: 60017c53-5854-4b27-a8e7-164c39da5856] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:34.752124 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e0556f5-2a95-402a-b1cf-caff57ced2d3 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:34.753423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e0556f5-2a95-402a-b1cf-caff57ced2d3 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:34.754092 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e0556f5-2a95-402a-b1cf-caff57ced2d3 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:34.756758 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e0556f5-2a95-402a-b1cf-caff57ced2d3 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:34.758881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e0556f5-2a95-402a-b1cf-caff57ced2d3 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:34.760616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e0556f5-2a95-402a-b1cf-caff57ced2d3 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:34.795321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-670a9a2b-f4bb-4c02-b666-e06f3321efa9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:34.797219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-670a9a2b-f4bb-4c02-b666-e06f3321efa9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:34.812590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-670a9a2b-f4bb-4c02-b666-e06f3321efa9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:34.813855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-670a9a2b-f4bb-4c02-b666-e06f3321efa9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:34.815729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-670a9a2b-f4bb-4c02-b666-e06f3321efa9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:34.817333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-670a9a2b-f4bb-4c02-b666-e06f3321efa9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:34.817926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-670a9a2b-f4bb-4c02-b666-e06f3321efa9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:34.821227 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-670a9a2b-f4bb-4c02-b666-e06f3321efa9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:34.830563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:35.601640 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3e0556f5-2a95-402a-b1cf-caff57ced2d3 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:35.640780 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3e0556f5-2a95-402a-b1cf-caff57ced2d3 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856" status: 200 len: 1506 microversion: 2.1 time: 0.888039 Aug 24 10:36:35.644227 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2134/4659] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:34 2022] GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856 => generated 1506 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:35.684406 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-525a38d9-5baf-44f2-82d6-da41fe5c6b02 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:35.685416 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-525a38d9-5baf-44f2-82d6-da41fe5c6b02 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: ee1d0652-a85c-44aa-aadb-cc43e28c30fc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:35.698016 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-525a38d9-5baf-44f2-82d6-da41fe5c6b02 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:35.699406 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-525a38d9-5baf-44f2-82d6-da41fe5c6b02 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:35.700044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-525a38d9-5baf-44f2-82d6-da41fe5c6b02 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:35.700970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-525a38d9-5baf-44f2-82d6-da41fe5c6b02 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:35.705381 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-525a38d9-5baf-44f2-82d6-da41fe5c6b02 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:35.707196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-525a38d9-5baf-44f2-82d6-da41fe5c6b02 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:36.088146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-525a38d9-5baf-44f2-82d6-da41fe5c6b02 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:36.098231 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-525a38d9-5baf-44f2-82d6-da41fe5c6b02 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/ee1d0652-a85c-44aa-aadb-cc43e28c30fc" status: 200 len: 1318 microversion: 2.1 time: 0.423818 Aug 24 10:36:36.104998 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2135/4660] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:35 2022] GET /compute/v2.1/servers/ee1d0652-a85c-44aa-aadb-cc43e28c30fc => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:36:36.524761 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-670a9a2b-f4bb-4c02-b666-e06f3321efa9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:36.573684 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-670a9a2b-f4bb-4c02-b666-e06f3321efa9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d" status: 200 len: 1314 microversion: 2.1 time: 1.782809 Aug 24 10:36:36.574739 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2526/4661] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:34 2022] GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d => generated 1314 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:37.146110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a9ec684f-d64b-4de1-bc37-5a302e10a7d9 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:37.146714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a9ec684f-d64b-4de1-bc37-5a302e10a7d9 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: ee1d0652-a85c-44aa-aadb-cc43e28c30fc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:37.166189 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9ec684f-d64b-4de1-bc37-5a302e10a7d9 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:37.167570 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9ec684f-d64b-4de1-bc37-5a302e10a7d9 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:37.171885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9ec684f-d64b-4de1-bc37-5a302e10a7d9 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:37.173072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9ec684f-d64b-4de1-bc37-5a302e10a7d9 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:37.175583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9ec684f-d64b-4de1-bc37-5a302e10a7d9 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:37.176409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9ec684f-d64b-4de1-bc37-5a302e10a7d9 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:37.695804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-62879203-ff0f-4818-a374-36639e249a1f tempest-VolumesGetTestJSON-411716268 tempest-VolumesGetTestJSON-411716268-project] Action: 'create', calling method: .version_select at 0x7f4654680280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1819342467", "metadata": {"Type": "work"}}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:36:37.775071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a9ec684f-d64b-4de1-bc37-5a302e10a7d9 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:37.784251 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a9ec684f-d64b-4de1-bc37-5a302e10a7d9 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/ee1d0652-a85c-44aa-aadb-cc43e28c30fc" status: 200 len: 1318 microversion: 2.1 time: 0.644511 Aug 24 10:36:37.784853 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2136/4662] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:37 2022] GET /compute/v2.1/servers/ee1d0652-a85c-44aa-aadb-cc43e28c30fc => generated 1318 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:37.813617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8ce50901-a9ee-47ac-b276-22f4902fd595 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:37.814736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8ce50901-a9ee-47ac-b276-22f4902fd595 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:37.864830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ce50901-a9ee-47ac-b276-22f4902fd595 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:37.865718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ce50901-a9ee-47ac-b276-22f4902fd595 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:37.866478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ce50901-a9ee-47ac-b276-22f4902fd595 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:37.867705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ce50901-a9ee-47ac-b276-22f4902fd595 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:37.894514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ce50901-a9ee-47ac-b276-22f4902fd595 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:37.895717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ce50901-a9ee-47ac-b276-22f4902fd595 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:38.869951 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-62879203-ff0f-4818-a374-36639e249a1f tempest-VolumesGetTestJSON-411716268 tempest-VolumesGetTestJSON-411716268-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.621581 Aug 24 10:36:38.878767 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2527/4663] 10.222.0.85 () {60 vars in 1156 bytes} [Wed Aug 24 10:36:37 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1631 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 10:36:38.884009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7e765691-aec9-4fc1-997a-7caca24b7820 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:38.889304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7e765691-aec9-4fc1-997a-7caca24b7820 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: ee1d0652-a85c-44aa-aadb-cc43e28c30fc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:38.924510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e765691-aec9-4fc1-997a-7caca24b7820 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:38.925019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e765691-aec9-4fc1-997a-7caca24b7820 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:38.925503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e765691-aec9-4fc1-997a-7caca24b7820 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:38.926227 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e765691-aec9-4fc1-997a-7caca24b7820 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:38.942611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e765691-aec9-4fc1-997a-7caca24b7820 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:38.942904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e765691-aec9-4fc1-997a-7caca24b7820 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:39.689868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7e765691-aec9-4fc1-997a-7caca24b7820 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:39.700556 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7e765691-aec9-4fc1-997a-7caca24b7820 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/ee1d0652-a85c-44aa-aadb-cc43e28c30fc" status: 200 len: 1318 microversion: 2.1 time: 0.820521 Aug 24 10:36:39.706312 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2528/4664] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:38 2022] GET /compute/v2.1/servers/ee1d0652-a85c-44aa-aadb-cc43e28c30fc => generated 1318 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:39.718431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7ae2d4d5-1ef1-4f99-afc6-53cece7a5075 tempest-VolumesGetTestJSON-411716268 tempest-VolumesGetTestJSON-411716268-project] Calling method '.version_select at 0x7f4647affaf0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:39.896338 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7ae2d4d5-1ef1-4f99-afc6-53cece7a5075 tempest-VolumesGetTestJSON-411716268 tempest-VolumesGetTestJSON-411716268-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/168dcec9-711c-491b-a883-dbff9a3d374f" status: 200 len: 353 microversion: 2.1 time: 0.188450 Aug 24 10:36:39.897333 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2529/4665] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Aug 24 10:36:39 2022] GET /compute/v2.1/os-volumes/168dcec9-711c-491b-a883-dbff9a3d374f => generated 353 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:39.903504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-30df36d3-b750-4236-b6ba-c75396d3d54c req-6169d796-3fcb-4d22-be7f-fe5682670f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee1d0652-a85c-44aa-aadb-cc43e28c30fc", "name": "network-vif-plugged", "status": "completed", "tag": "93cd5da0-38ae-4e9d-a5b5-e26c21950488"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:36:39.938641 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-30df36d3-b750-4236-b6ba-c75396d3d54c req-6169d796-3fcb-4d22-be7f-fe5682670f5e service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:39.939159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-30df36d3-b750-4236-b6ba-c75396d3d54c req-6169d796-3fcb-4d22-be7f-fe5682670f5e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:39.939592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-30df36d3-b750-4236-b6ba-c75396d3d54c req-6169d796-3fcb-4d22-be7f-fe5682670f5e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:39.993642 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-30df36d3-b750-4236-b6ba-c75396d3d54c req-6169d796-3fcb-4d22-be7f-fe5682670f5e service nova] Creating event network-vif-plugged:93cd5da0-38ae-4e9d-a5b5-e26c21950488 for instance ee1d0652-a85c-44aa-aadb-cc43e28c30fc on n-h1-849328-3 Aug 24 10:36:40.013898 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-30df36d3-b750-4236-b6ba-c75396d3d54c req-6169d796-3fcb-4d22-be7f-fe5682670f5e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109295 Aug 24 10:36:40.016400 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2530/4666] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:40.383979 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8ce50901-a9ee-47ac-b276-22f4902fd595 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:40.399594 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8ce50901-a9ee-47ac-b276-22f4902fd595 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d" status: 200 len: 1314 microversion: 2.1 time: 2.613622 Aug 24 10:36:40.406748 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2137/4667] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:37 2022] GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d => generated 1314 bytes in 2621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:40.731701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c498a8b9-9a2c-4201-ac2e-f21ac95d8e12 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:40.732468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c498a8b9-9a2c-4201-ac2e-f21ac95d8e12 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: ee1d0652-a85c-44aa-aadb-cc43e28c30fc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:40.752613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c498a8b9-9a2c-4201-ac2e-f21ac95d8e12 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:40.768356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c498a8b9-9a2c-4201-ac2e-f21ac95d8e12 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:40.777736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c498a8b9-9a2c-4201-ac2e-f21ac95d8e12 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:40.779106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c498a8b9-9a2c-4201-ac2e-f21ac95d8e12 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:40.779862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c498a8b9-9a2c-4201-ac2e-f21ac95d8e12 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:40.784012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c498a8b9-9a2c-4201-ac2e-f21ac95d8e12 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:40.943401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-127ab7ab-7e09-46e6-8022-fb9c91d5e79b tempest-VolumesGetTestJSON-411716268 tempest-VolumesGetTestJSON-411716268-project] Calling method '.version_select at 0x7f46540ce5e0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:41.080916 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-127ab7ab-7e09-46e6-8022-fb9c91d5e79b tempest-VolumesGetTestJSON-411716268 tempest-VolumesGetTestJSON-411716268-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/168dcec9-711c-491b-a883-dbff9a3d374f" status: 200 len: 353 microversion: 2.1 time: 0.167878 Aug 24 10:36:41.081532 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2138/4668] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Aug 24 10:36:40 2022] GET /compute/v2.1/os-volumes/168dcec9-711c-491b-a883-dbff9a3d374f => generated 353 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:36:41.432762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-910dbcfa-b93b-429e-9091-92de98241a1d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:41.434874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-910dbcfa-b93b-429e-9091-92de98241a1d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:41.456898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910dbcfa-b93b-429e-9091-92de98241a1d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:41.464291 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910dbcfa-b93b-429e-9091-92de98241a1d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:41.465619 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910dbcfa-b93b-429e-9091-92de98241a1d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:41.493207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910dbcfa-b93b-429e-9091-92de98241a1d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:41.493653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910dbcfa-b93b-429e-9091-92de98241a1d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:41.494085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910dbcfa-b93b-429e-9091-92de98241a1d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:41.851413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c498a8b9-9a2c-4201-ac2e-f21ac95d8e12 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:41.884611 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c498a8b9-9a2c-4201-ac2e-f21ac95d8e12 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/ee1d0652-a85c-44aa-aadb-cc43e28c30fc" status: 200 len: 1318 microversion: 2.1 time: 1.157661 Aug 24 10:36:41.898352 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2531/4669] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:40 2022] GET /compute/v2.1/servers/ee1d0652-a85c-44aa-aadb-cc43e28c30fc => generated 1318 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:41.991921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-910dbcfa-b93b-429e-9091-92de98241a1d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:42.006680 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-910dbcfa-b93b-429e-9091-92de98241a1d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d" status: 200 len: 1314 microversion: 2.1 time: 0.573745 Aug 24 10:36:42.010294 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2139/4670] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:41 2022] GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:36:42.102254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ef24671e-3180-4d82-8491-91bcfc275688 tempest-VolumesGetTestJSON-411716268 tempest-VolumesGetTestJSON-411716268-project] Calling method '.version_select at 0x7f4654fa9670>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:42.395292 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ef24671e-3180-4d82-8491-91bcfc275688 tempest-VolumesGetTestJSON-411716268 tempest-VolumesGetTestJSON-411716268-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/168dcec9-711c-491b-a883-dbff9a3d374f" status: 200 len: 354 microversion: 2.1 time: 0.303591 Aug 24 10:36:42.396550 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2532/4671] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Aug 24 10:36:42 2022] GET /compute/v2.1/os-volumes/168dcec9-711c-491b-a883-dbff9a3d374f => generated 354 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:42.413106 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c6a2e6b6-baad-45aa-a52b-492b4c9719c0 tempest-VolumesGetTestJSON-411716268 tempest-VolumesGetTestJSON-411716268-project] Calling method '.version_select at 0x7f46540ce3a0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:42.672261 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c6a2e6b6-baad-45aa-a52b-492b4c9719c0 tempest-VolumesGetTestJSON-411716268 tempest-VolumesGetTestJSON-411716268-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/168dcec9-711c-491b-a883-dbff9a3d374f" status: 200 len: 354 microversion: 2.1 time: 0.266088 Aug 24 10:36:42.673810 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2140/4672] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Aug 24 10:36:42 2022] GET /compute/v2.1/os-volumes/168dcec9-711c-491b-a883-dbff9a3d374f => generated 354 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:42.691040 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5cfc7757-69b3-4bc8-a7a6-7962dd1742bb tempest-VolumesGetTestJSON-411716268 tempest-VolumesGetTestJSON-411716268-project] Calling method '.version_select at 0x7f4655073820>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:42.855981 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5cfc7757-69b3-4bc8-a7a6-7962dd1742bb tempest-VolumesGetTestJSON-411716268 tempest-VolumesGetTestJSON-411716268-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/168dcec9-711c-491b-a883-dbff9a3d374f" status: 202 len: 0 microversion: 2.1 time: 0.173286 Aug 24 10:36:42.856894 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2533/4673] 10.222.0.85 () {58 vars in 1248 bytes} [Wed Aug 24 10:36:42 2022] DELETE /compute/v2.1/os-volumes/168dcec9-711c-491b-a883-dbff9a3d374f => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:36:42.870518 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dbc45ae3-769b-4fbf-9e79-ac873c4c6b43 tempest-VolumesGetTestJSON-411716268 tempest-VolumesGetTestJSON-411716268-project] Calling method '.version_select at 0x7f46540cb040>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:42.932922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-abe2d281-8e01-4f48-a4b8-e4559ae29a7c tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:42.933596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-abe2d281-8e01-4f48-a4b8-e4559ae29a7c tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: ee1d0652-a85c-44aa-aadb-cc43e28c30fc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:42.956449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abe2d281-8e01-4f48-a4b8-e4559ae29a7c tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:42.957194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abe2d281-8e01-4f48-a4b8-e4559ae29a7c tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:42.957836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abe2d281-8e01-4f48-a4b8-e4559ae29a7c tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:42.958741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abe2d281-8e01-4f48-a4b8-e4559ae29a7c tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:42.959553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abe2d281-8e01-4f48-a4b8-e4559ae29a7c tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:42.960150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abe2d281-8e01-4f48-a4b8-e4559ae29a7c tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:43.026159 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dbc45ae3-769b-4fbf-9e79-ac873c4c6b43 tempest-VolumesGetTestJSON-411716268 tempest-VolumesGetTestJSON-411716268-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/168dcec9-711c-491b-a883-dbff9a3d374f" status: 200 len: 353 microversion: 2.1 time: 0.164842 Aug 24 10:36:43.026758 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2141/4674] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Aug 24 10:36:42 2022] GET /compute/v2.1/os-volumes/168dcec9-711c-491b-a883-dbff9a3d374f => generated 353 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:43.038800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7c180748-a55f-458a-a48b-80f1edf4c511 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:43.039691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7c180748-a55f-458a-a48b-80f1edf4c511 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:43.071000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c180748-a55f-458a-a48b-80f1edf4c511 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:43.071734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c180748-a55f-458a-a48b-80f1edf4c511 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:43.072199 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c180748-a55f-458a-a48b-80f1edf4c511 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:43.072973 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c180748-a55f-458a-a48b-80f1edf4c511 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:43.073467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c180748-a55f-458a-a48b-80f1edf4c511 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:43.073903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c180748-a55f-458a-a48b-80f1edf4c511 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:43.399385 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-abe2d281-8e01-4f48-a4b8-e4559ae29a7c tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:43.410471 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-abe2d281-8e01-4f48-a4b8-e4559ae29a7c tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/ee1d0652-a85c-44aa-aadb-cc43e28c30fc" status: 200 len: 1506 microversion: 2.1 time: 0.485505 Aug 24 10:36:43.434035 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2534/4675] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:42 2022] GET /compute/v2.1/servers/ee1d0652-a85c-44aa-aadb-cc43e28c30fc => generated 1506 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:43.450889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-65c1e7c9-34c9-485d-a135-cd5672663d65 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:43.452346 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-65c1e7c9-34c9-485d-a135-cd5672663d65 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: ee1d0652-a85c-44aa-aadb-cc43e28c30fc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:43.463931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65c1e7c9-34c9-485d-a135-cd5672663d65 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:43.467033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65c1e7c9-34c9-485d-a135-cd5672663d65 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:43.474063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65c1e7c9-34c9-485d-a135-cd5672663d65 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:43.475103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65c1e7c9-34c9-485d-a135-cd5672663d65 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:43.475888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65c1e7c9-34c9-485d-a135-cd5672663d65 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:43.477037 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65c1e7c9-34c9-485d-a135-cd5672663d65 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:43.538676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-65c1e7c9-34c9-485d-a135-cd5672663d65 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: ee1d0652-a85c-44aa-aadb-cc43e28c30fc] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:36:43.554760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7c180748-a55f-458a-a48b-80f1edf4c511 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:43.566831 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7c180748-a55f-458a-a48b-80f1edf4c511 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d" status: 200 len: 1314 microversion: 2.1 time: 0.532306 Aug 24 10:36:43.580769 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2142/4676] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:43 2022] GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:36:43.858311 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-65c1e7c9-34c9-485d-a135-cd5672663d65 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "DELETE /compute/v2.1/servers/ee1d0652-a85c-44aa-aadb-cc43e28c30fc" status: 204 len: 0 microversion: 2.1 time: 0.419473 Aug 24 10:36:43.859955 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2535/4677] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:36:43 2022] DELETE /compute/v2.1/servers/ee1d0652-a85c-44aa-aadb-cc43e28c30fc => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:36:43.876098 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f5a6169f-4da1-43c6-8123-fc2805ceb7e8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:43.877633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f5a6169f-4da1-43c6-8123-fc2805ceb7e8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: 60017c53-5854-4b27-a8e7-164c39da5856] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:43.893435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5a6169f-4da1-43c6-8123-fc2805ceb7e8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:43.894467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5a6169f-4da1-43c6-8123-fc2805ceb7e8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:43.896194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5a6169f-4da1-43c6-8123-fc2805ceb7e8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:43.897959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5a6169f-4da1-43c6-8123-fc2805ceb7e8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:43.901882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5a6169f-4da1-43c6-8123-fc2805ceb7e8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:43.902526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5a6169f-4da1-43c6-8123-fc2805ceb7e8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:43.969448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f5a6169f-4da1-43c6-8123-fc2805ceb7e8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: 60017c53-5854-4b27-a8e7-164c39da5856] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:36:44.081053 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2af8fda7-b932-465b-bd99-922f705db169 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1562930559", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "66890c02-aa63-4a1b-a0f0-947d4c116c2a"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:36:44.242374 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f5a6169f-4da1-43c6-8123-fc2805ceb7e8 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "DELETE /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856" status: 204 len: 0 microversion: 2.1 time: 0.377450 Aug 24 10:36:44.243450 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2536/4678] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:36:43 2022] DELETE /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:36:44.246101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-2af8fda7-b932-465b-bd99-922f705db169 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] validate_networks() for [('66890c02-aa63-4a1b-a0f0-947d4c116c2a', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:36:44.251392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-72179d42-7390-4065-86a7-8a7be50e7f15 tempest-VolumesGetTestJSON-411716268 tempest-VolumesGetTestJSON-411716268-project] Calling method '.version_select at 0x7f4654ebce50>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:44.345025 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-72179d42-7390-4065-86a7-8a7be50e7f15 tempest-VolumesGetTestJSON-411716268 tempest-VolumesGetTestJSON-411716268-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/168dcec9-711c-491b-a883-dbff9a3d374f" status: 200 len: 353 microversion: 2.1 time: 0.099095 Aug 24 10:36:44.352949 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2537/4679] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Aug 24 10:36:44 2022] GET /compute/v2.1/os-volumes/168dcec9-711c-491b-a883-dbff9a3d374f => generated 353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:44.360923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9174c195-9def-44da-8c0f-7e798526b02f tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:44.363516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9174c195-9def-44da-8c0f-7e798526b02f tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: ee1d0652-a85c-44aa-aadb-cc43e28c30fc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:44.373538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9174c195-9def-44da-8c0f-7e798526b02f tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:44.374502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9174c195-9def-44da-8c0f-7e798526b02f tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:44.375169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9174c195-9def-44da-8c0f-7e798526b02f tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:44.379648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9174c195-9def-44da-8c0f-7e798526b02f tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:44.380765 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9174c195-9def-44da-8c0f-7e798526b02f tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:44.381449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9174c195-9def-44da-8c0f-7e798526b02f tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:45.559431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9174c195-9def-44da-8c0f-7e798526b02f tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:45.578292 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9174c195-9def-44da-8c0f-7e798526b02f tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/ee1d0652-a85c-44aa-aadb-cc43e28c30fc" status: 200 len: 1512 microversion: 2.1 time: 1.223783 Aug 24 10:36:45.578922 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2538/4680] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:44 2022] GET /compute/v2.1/servers/ee1d0652-a85c-44aa-aadb-cc43e28c30fc => generated 1512 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:45.611340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d9fba569-dc78-4e30-90fe-71dbd42af7e2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:45.612653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d9fba569-dc78-4e30-90fe-71dbd42af7e2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:45.632312 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9fba569-dc78-4e30-90fe-71dbd42af7e2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:45.632813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9fba569-dc78-4e30-90fe-71dbd42af7e2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:45.633295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9fba569-dc78-4e30-90fe-71dbd42af7e2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:45.652953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9fba569-dc78-4e30-90fe-71dbd42af7e2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:45.656987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9fba569-dc78-4e30-90fe-71dbd42af7e2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:45.657826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9fba569-dc78-4e30-90fe-71dbd42af7e2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:45.770808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2af8fda7-b932-465b-bd99-922f705db169 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:36:45.772658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2af8fda7-b932-465b-bd99-922f705db169 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:36:45.772658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2af8fda7-b932-465b-bd99-922f705db169 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:36:45.772658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2af8fda7-b932-465b-bd99-922f705db169 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:36:45.772658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2af8fda7-b932-465b-bd99-922f705db169 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:36:45.799944 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2af8fda7-b932-465b-bd99-922f705db169 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:45.800308 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2af8fda7-b932-465b-bd99-922f705db169 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:45.810054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2af8fda7-b932-465b-bd99-922f705db169 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:45.811102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2af8fda7-b932-465b-bd99-922f705db169 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:45.811423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2af8fda7-b932-465b-bd99-922f705db169 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:45.820642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2af8fda7-b932-465b-bd99-922f705db169 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:45.860552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-2af8fda7-b932-465b-bd99-922f705db169 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Getting quotas for project ce61197b6e1c4a27b36a4774ea2e89c3. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:36:45.879546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-2af8fda7-b932-465b-bd99-922f705db169 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Getting quotas for user 0b4be32dd307497dae1e5fa2dbb76e71 and project ce61197b6e1c4a27b36a4774ea2e89c3. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:36:45.919948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2af8fda7-b932-465b-bd99-922f705db169 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:36:45.924261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2af8fda7-b932-465b-bd99-922f705db169 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] [instance: af079278-7264-43d0-975e-1fcd1f5c731a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:36:46.028832 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2af8fda7-b932-465b-bd99-922f705db169 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.249166 Aug 24 10:36:46.038243 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2143/4681] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:36:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:36:46.049403 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-b3f04a84-ada2-4c4c-adac-4a1d5f7eeed0 req-96f7e10b-88fa-4302-b7f7-6cc844214627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45f848cf-4fd8-44c9-8d28-d3491a3fbd2d", "name": "network-vif-plugged", "status": "completed", "tag": "923183a9-35de-48cb-8cf8-83600d182ee2"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:36:46.074114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b3f04a84-ada2-4c4c-adac-4a1d5f7eeed0 req-96f7e10b-88fa-4302-b7f7-6cc844214627 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:46.077781 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b3f04a84-ada2-4c4c-adac-4a1d5f7eeed0 req-96f7e10b-88fa-4302-b7f7-6cc844214627 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:46.080447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b3f04a84-ada2-4c4c-adac-4a1d5f7eeed0 req-96f7e10b-88fa-4302-b7f7-6cc844214627 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:46.137413 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b3f04a84-ada2-4c4c-adac-4a1d5f7eeed0 req-96f7e10b-88fa-4302-b7f7-6cc844214627 service nova] Creating event network-vif-plugged:923183a9-35de-48cb-8cf8-83600d182ee2 for instance 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d on n-h1-849328-3 Aug 24 10:36:46.148463 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-b3f04a84-ada2-4c4c-adac-4a1d5f7eeed0 req-96f7e10b-88fa-4302-b7f7-6cc844214627 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108643 Aug 24 10:36:46.157987 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2144/4682] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:46.171710 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4db05ae8-3ce8-4702-be92-2f13309e5616 tempest-VolumesGetTestJSON-411716268 tempest-VolumesGetTestJSON-411716268-project] Calling method '.version_select at 0x7f46542731f0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:46.424078 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4db05ae8-3ce8-4702-be92-2f13309e5616 tempest-VolumesGetTestJSON-411716268 tempest-VolumesGetTestJSON-411716268-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/168dcec9-711c-491b-a883-dbff9a3d374f" status: 200 len: 353 microversion: 2.1 time: 0.264558 Aug 24 10:36:46.434630 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2145/4683] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Aug 24 10:36:46 2022] GET /compute/v2.1/os-volumes/168dcec9-711c-491b-a883-dbff9a3d374f => generated 353 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:46.434630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-33cc0d46-01c1-4f2c-89bb-05477f3b7502 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:46.434630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-33cc0d46-01c1-4f2c-89bb-05477f3b7502 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] [instance: af079278-7264-43d0-975e-1fcd1f5c731a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:46.530769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d9fba569-dc78-4e30-90fe-71dbd42af7e2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:46.589782 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d9fba569-dc78-4e30-90fe-71dbd42af7e2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d" status: 200 len: 1314 microversion: 2.1 time: 0.995690 Aug 24 10:36:46.593602 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2539/4684] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:45 2022] GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d => generated 1314 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:46.633486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1018019f-a388-44a2-b489-51372449bc87 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:46.634886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1018019f-a388-44a2-b489-51372449bc87 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: ee1d0652-a85c-44aa-aadb-cc43e28c30fc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:46.666316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1018019f-a388-44a2-b489-51372449bc87 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:46.682197 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1018019f-a388-44a2-b489-51372449bc87 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:46.683128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1018019f-a388-44a2-b489-51372449bc87 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:46.684451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1018019f-a388-44a2-b489-51372449bc87 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:46.685478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1018019f-a388-44a2-b489-51372449bc87 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:46.689522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1018019f-a388-44a2-b489-51372449bc87 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:47.329317 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1018019f-a388-44a2-b489-51372449bc87 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:47.343190 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1018019f-a388-44a2-b489-51372449bc87 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/ee1d0652-a85c-44aa-aadb-cc43e28c30fc" status: 200 len: 1512 microversion: 2.1 time: 0.740609 Aug 24 10:36:47.358149 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2540/4685] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:46 2022] GET /compute/v2.1/servers/ee1d0652-a85c-44aa-aadb-cc43e28c30fc => generated 1512 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:47.445583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a22c0791-b5b4-4222-af86-8344a27390f6 tempest-VolumesGetTestJSON-411716268 tempest-VolumesGetTestJSON-411716268-project] Calling method '.version_select at 0x7f4647a9f550>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:47.605316 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a22c0791-b5b4-4222-af86-8344a27390f6 tempest-VolumesGetTestJSON-411716268 tempest-VolumesGetTestJSON-411716268-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/168dcec9-711c-491b-a883-dbff9a3d374f" status: 200 len: 353 microversion: 2.1 time: 0.165062 Aug 24 10:36:47.606965 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2541/4686] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Aug 24 10:36:47 2022] GET /compute/v2.1/os-volumes/168dcec9-711c-491b-a883-dbff9a3d374f => generated 353 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:36:47.612680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-51f16e7e-f670-4c7c-bcd3-0d616f51d127 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:47.613570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-51f16e7e-f670-4c7c-bcd3-0d616f51d127 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:47.620853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51f16e7e-f670-4c7c-bcd3-0d616f51d127 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:47.621580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51f16e7e-f670-4c7c-bcd3-0d616f51d127 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:47.622199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51f16e7e-f670-4c7c-bcd3-0d616f51d127 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:47.623316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51f16e7e-f670-4c7c-bcd3-0d616f51d127 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:47.624051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51f16e7e-f670-4c7c-bcd3-0d616f51d127 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:47.624635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51f16e7e-f670-4c7c-bcd3-0d616f51d127 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:47.884376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-33cc0d46-01c1-4f2c-89bb-05477f3b7502 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4be32dd307497dae1e5fa2dbb76e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce61197b6e1c4a27b36a4774ea2e89c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:47.901471 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-33cc0d46-01c1-4f2c-89bb-05477f3b7502 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] 10.222.0.85 "GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a" status: 200 len: 1224 microversion: 2.1 time: 1.472190 Aug 24 10:36:47.916098 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2146/4687] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:46 2022] GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a => generated 1224 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:48.010569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-51f16e7e-f670-4c7c-bcd3-0d616f51d127 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:48.025903 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-51f16e7e-f670-4c7c-bcd3-0d616f51d127 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d" status: 200 len: 1314 microversion: 2.1 time: 0.413045 Aug 24 10:36:48.026606 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2542/4688] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:47 2022] GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:48.220690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-607a9b8d-d4de-41d9-af6a-0a1e492fdb93 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-898544831", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "444806fc-9684-467f-82d3-8ae5206eec37"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:36:48.375532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-679d9fe5-c865-40b2-82ed-5db1aaaba66e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:48.376844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-679d9fe5-c865-40b2-82ed-5db1aaaba66e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: ee1d0652-a85c-44aa-aadb-cc43e28c30fc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:48.411025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-679d9fe5-c865-40b2-82ed-5db1aaaba66e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:48.418555 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-679d9fe5-c865-40b2-82ed-5db1aaaba66e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:48.421109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-679d9fe5-c865-40b2-82ed-5db1aaaba66e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:48.422462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-607a9b8d-d4de-41d9-af6a-0a1e492fdb93 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] validate_networks() for [('444806fc-9684-467f-82d3-8ae5206eec37', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:36:48.423131 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-679d9fe5-c865-40b2-82ed-5db1aaaba66e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:48.429402 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-679d9fe5-c865-40b2-82ed-5db1aaaba66e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:48.430216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-679d9fe5-c865-40b2-82ed-5db1aaaba66e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:48.993263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-679d9fe5-c865-40b2-82ed-5db1aaaba66e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aacca6ee8646349b6f385adb8b9ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4137804f32f459394ac7aa54f6bacb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:49.036036 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-679d9fe5-c865-40b2-82ed-5db1aaaba66e tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/ee1d0652-a85c-44aa-aadb-cc43e28c30fc" status: 200 len: 1470 microversion: 2.1 time: 0.673779 Aug 24 10:36:49.048293 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2543/4689] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:48 2022] GET /compute/v2.1/servers/ee1d0652-a85c-44aa-aadb-cc43e28c30fc => generated 1470 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:36:49.097924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-53880fda-1044-4e20-a59b-5375d1ce20bd tempest-VolumesGetTestJSON-411716268 tempest-VolumesGetTestJSON-411716268-project] Calling method '.version_select at 0x7f46541c0e50>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:49.256855 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-53880fda-1044-4e20-a59b-5375d1ce20bd tempest-VolumesGetTestJSON-411716268 tempest-VolumesGetTestJSON-411716268-project] HTTP exception thrown: Volume 168dcec9-711c-491b-a883-dbff9a3d374f could not be found. Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-53880fda-1044-4e20-a59b-5375d1ce20bd tempest-VolumesGetTestJSON-411716268 tempest-VolumesGetTestJSON-411716268-project] Request method failure captured: Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-volumes/168dcec9-711c-491b-a883-dbff9a3d374f HTTP/1.1 Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf81GzJ-0tmhet3S50MhuacgzO3yBmdamC63fqccudfHl8-YuBpQ9XO_UnkR9LSgWldR5N3ybfVU4DQF4kARctspAhafpiesKxkhFmtFBOM4xKHTFBqZoNhkoFjPsIJ3lcLY_oMnvUMZWKO4ERWqqEAichcpOvzJDySiEHPFTluhuhM Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: ea2707c4022f4e13a1bf4e01f14cef80 Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-VolumesGetTestJSON-411716268 Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ea2707c4022f4e13a1bf4e01f14cef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_ea2707c4022f4e13a1bf4e01f14cef80", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ea2707c4022f4e13a1bf4e01f14cef80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/ea2707c4022f4e13a1bf4e01f14cef80"}]}] Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-VolumesGetTestJSON-411716268 Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: ea2707c4022f4e13a1bf4e01f14cef80 Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-VolumesGetTestJSON-411716268 Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-VolumesGetTestJSON-411716268-project Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: d2dec13084544001a457b599f57c244c Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-VolumesGetTestJSON-411716268-project Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: exception: Volume 168dcec9-711c-491b-a883-dbff9a3d374f could not be found. Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '168dcec9-711c-491b-a883-dbff9a3d374f'} Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 168dcec9-711c-491b-a883-dbff9a3d374f could not be found. (HTTP 404) (Request-ID: req-e102bc20-b22d-4781-acf8-3d202db61dfe) Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 10:36:49.261866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 168dcec9-711c-491b-a883-dbff9a3d374f could not be found. Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 168dcec9-711c-491b-a883-dbff9a3d374f could not be found. Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 168dcec9-711c-491b-a883-dbff9a3d374f could not be found. Aug 24 10:36:49.265928 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:49.270931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-53880fda-1044-4e20-a59b-5375d1ce20bd tempest-VolumesGetTestJSON-411716268 tempest-VolumesGetTestJSON-411716268-project] Returning 404 to user: Volume 168dcec9-711c-491b-a883-dbff9a3d374f could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:36:49.277883 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-53880fda-1044-4e20-a59b-5375d1ce20bd tempest-VolumesGetTestJSON-411716268 tempest-VolumesGetTestJSON-411716268-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/168dcec9-711c-491b-a883-dbff9a3d374f" status: 404 len: 109 microversion: 2.1 time: 0.222678 Aug 24 10:36:49.280725 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2544/4690] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Aug 24 10:36:49 2022] GET /compute/v2.1/os-volumes/168dcec9-711c-491b-a883-dbff9a3d374f => generated 109 bytes in 232 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:36:49.321925 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-400889d5-7379-40a9-ac9e-ff35acc18a0b tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:49.339953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-400889d5-7379-40a9-ac9e-ff35acc18a0b tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] [instance: af079278-7264-43d0-975e-1fcd1f5c731a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:49.374679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-400889d5-7379-40a9-ac9e-ff35acc18a0b tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:49.393872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-400889d5-7379-40a9-ac9e-ff35acc18a0b tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:49.402836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-400889d5-7379-40a9-ac9e-ff35acc18a0b tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:49.404566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-400889d5-7379-40a9-ac9e-ff35acc18a0b tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:49.414044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-400889d5-7379-40a9-ac9e-ff35acc18a0b tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:49.421082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-400889d5-7379-40a9-ac9e-ff35acc18a0b tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:49.921510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-400889d5-7379-40a9-ac9e-ff35acc18a0b tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4be32dd307497dae1e5fa2dbb76e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce61197b6e1c4a27b36a4774ea2e89c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:49.932232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:49.992236 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-400889d5-7379-40a9-ac9e-ff35acc18a0b tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] 10.222.0.85 "GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a" status: 200 len: 1294 microversion: 2.1 time: 0.697327 Aug 24 10:36:49.993870 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2545/4691] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:49 2022] GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a => generated 1294 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:50.306570 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-607a9b8d-d4de-41d9-af6a-0a1e492fdb93 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:36:50.307886 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-607a9b8d-d4de-41d9-af6a-0a1e492fdb93 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:36:50.309364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-607a9b8d-d4de-41d9-af6a-0a1e492fdb93 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:36:50.309532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-607a9b8d-d4de-41d9-af6a-0a1e492fdb93 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:36:50.310152 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-607a9b8d-d4de-41d9-af6a-0a1e492fdb93 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:36:50.346197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-607a9b8d-d4de-41d9-af6a-0a1e492fdb93 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:50.353288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-607a9b8d-d4de-41d9-af6a-0a1e492fdb93 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:50.355755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-607a9b8d-d4de-41d9-af6a-0a1e492fdb93 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:50.359211 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-607a9b8d-d4de-41d9-af6a-0a1e492fdb93 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:50.362611 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-607a9b8d-d4de-41d9-af6a-0a1e492fdb93 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:50.364487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-607a9b8d-d4de-41d9-af6a-0a1e492fdb93 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:50.447135 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-607a9b8d-d4de-41d9-af6a-0a1e492fdb93 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Getting quotas for project 8b489eabb0014ddc9a2fcdf6e78ee740. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:36:50.467040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-607a9b8d-d4de-41d9-af6a-0a1e492fdb93 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Getting quotas for user 83a25a0677c04f8ba975528ece80d676 and project 8b489eabb0014ddc9a2fcdf6e78ee740. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:36:50.561074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-607a9b8d-d4de-41d9-af6a-0a1e492fdb93 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:36:50.574657 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-607a9b8d-d4de-41d9-af6a-0a1e492fdb93 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:36:50.858142 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-607a9b8d-d4de-41d9-af6a-0a1e492fdb93 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.940557 Aug 24 10:36:50.867113 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2147/4692] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:36:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:36:50.880181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-b879b8c5-a5df-43fe-8bf3-34cad1278d36 req-3aa3dc06-a9ea-4239-9f55-7e344eab8461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60017c53-5854-4b27-a8e7-164c39da5856", "name": "network-vif-deleted", "tag": "61c66f40-ff34-4f0c-8a09-93af8a607f50"}, {"server_uuid": "ee1d0652-a85c-44aa-aadb-cc43e28c30fc", "name": "network-vif-deleted", "tag": "93cd5da0-38ae-4e9d-a5b5-e26c21950488"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:36:51.022289 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1806bd4b-61ca-43ea-86d3-5a36bb6f3610 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:51.024568 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1806bd4b-61ca-43ea-86d3-5a36bb6f3610 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:51.033552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b879b8c5-a5df-43fe-8bf3-34cad1278d36 req-3aa3dc06-a9ea-4239-9f55-7e344eab8461 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:51.039762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b879b8c5-a5df-43fe-8bf3-34cad1278d36 req-3aa3dc06-a9ea-4239-9f55-7e344eab8461 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:51.058605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:51.061862 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b879b8c5-a5df-43fe-8bf3-34cad1278d36 req-3aa3dc06-a9ea-4239-9f55-7e344eab8461 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:51.124944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1806bd4b-61ca-43ea-86d3-5a36bb6f3610 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:51.130485 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1806bd4b-61ca-43ea-86d3-5a36bb6f3610 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:51.134110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1806bd4b-61ca-43ea-86d3-5a36bb6f3610 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:51.143441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1806bd4b-61ca-43ea-86d3-5a36bb6f3610 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:51.149692 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1806bd4b-61ca-43ea-86d3-5a36bb6f3610 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:51.152152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1806bd4b-61ca-43ea-86d3-5a36bb6f3610 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:51.181837 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b879b8c5-a5df-43fe-8bf3-34cad1278d36 req-3aa3dc06-a9ea-4239-9f55-7e344eab8461 service nova] Creating event network-vif-deleted:61c66f40-ff34-4f0c-8a09-93af8a607f50 for instance 60017c53-5854-4b27-a8e7-164c39da5856 on n-h2-849328-3 Aug 24 10:36:51.185111 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b879b8c5-a5df-43fe-8bf3-34cad1278d36 req-3aa3dc06-a9ea-4239-9f55-7e344eab8461 service nova] Creating event network-vif-deleted:93cd5da0-38ae-4e9d-a5b5-e26c21950488 for instance ee1d0652-a85c-44aa-aadb-cc43e28c30fc on n-h1-849328-3 Aug 24 10:36:51.220358 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-b879b8c5-a5df-43fe-8bf3-34cad1278d36 req-3aa3dc06-a9ea-4239-9f55-7e344eab8461 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.347713 Aug 24 10:36:51.226153 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2148/4693] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:51.245448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-de20abf2-a87a-4f03-8771-57328772cc62 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:51.252254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-de20abf2-a87a-4f03-8771-57328772cc62 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: ee1d0652-a85c-44aa-aadb-cc43e28c30fc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:51.274749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de20abf2-a87a-4f03-8771-57328772cc62 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:51.277821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de20abf2-a87a-4f03-8771-57328772cc62 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:51.280599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de20abf2-a87a-4f03-8771-57328772cc62 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:51.281663 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de20abf2-a87a-4f03-8771-57328772cc62 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:51.286095 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de20abf2-a87a-4f03-8771-57328772cc62 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:51.288863 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de20abf2-a87a-4f03-8771-57328772cc62 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:51.336882 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-de20abf2-a87a-4f03-8771-57328772cc62 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] HTTP exception thrown: Instance ee1d0652-a85c-44aa-aadb-cc43e28c30fc could not be found. Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-de20abf2-a87a-4f03-8771-57328772cc62 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Request method failure captured: Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/ee1d0652-a85c-44aa-aadb-cc43e28c30fc HTTP/1.1 Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf7xNn_JV7qA8riGZJFQf__ncoNTNCwez_lppBf28SeZ3wpP3XYvqZIIRPzdooen_64aZSdujQRPkcTLIXIwlLlZWp47xvzAiFLGGRMHfXe9CtJ03Me5oJhHdSXNUf_dK396dz6tRHUzeboLol6ePxSFEnFt0DMNjkd_2j3Xukbvdxc Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: b4137804f32f459394ac7aa54f6bacb3 Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-MultipleCreateTestJSON-1567926735 Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b4137804f32f459394ac7aa54f6bacb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b4137804f32f459394ac7aa54f6bacb3", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b4137804f32f459394ac7aa54f6bacb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b4137804f32f459394ac7aa54f6bacb3"}]}] Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-MultipleCreateTestJSON-1567926735 Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: b4137804f32f459394ac7aa54f6bacb3 Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1567926735 Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-MultipleCreateTestJSON-1567926735-project Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: f2aacca6ee8646349b6f385adb8b9ef3 Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-MultipleCreateTestJSON-1567926735-project Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance ee1d0652-a85c-44aa-aadb-cc43e28c30fc could not be found. Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'ee1d0652-a85c-44aa-aadb-cc43e28c30fc'} Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee1d0652-a85c-44aa-aadb-cc43e28c30fc could not be found. Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee1d0652-a85c-44aa-aadb-cc43e28c30fc could not be found. Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:36:51.341697 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:36:51.346901 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:51.346901 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:36:51.346901 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:36:51.346901 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:36:51.346901 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:36:51.346901 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee1d0652-a85c-44aa-aadb-cc43e28c30fc could not be found. Aug 24 10:36:51.346901 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:36:51.351535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-de20abf2-a87a-4f03-8771-57328772cc62 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Returning 404 to user: Instance ee1d0652-a85c-44aa-aadb-cc43e28c30fc could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:36:51.354877 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-de20abf2-a87a-4f03-8771-57328772cc62 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/ee1d0652-a85c-44aa-aadb-cc43e28c30fc" status: 404 len: 111 microversion: 2.1 time: 0.127030 Aug 24 10:36:51.357354 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2149/4694] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:51 2022] GET /compute/v2.1/servers/ee1d0652-a85c-44aa-aadb-cc43e28c30fc => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:36:51.379408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5ef7de91-cbaf-4395-a9c3-79fc73f27cdd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:51.380698 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5ef7de91-cbaf-4395-a9c3-79fc73f27cdd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:51.586687 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5ef7de91-cbaf-4395-a9c3-79fc73f27cdd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:51.650911 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5ef7de91-cbaf-4395-a9c3-79fc73f27cdd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9" status: 200 len: 1192 microversion: 2.1 time: 0.284071 Aug 24 10:36:51.651595 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2150/4695] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:51 2022] GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 => generated 1192 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:51.668175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-faf69ec1-696b-410f-a0da-4120181f3dbe tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:51.677568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-faf69ec1-696b-410f-a0da-4120181f3dbe tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] [instance: af079278-7264-43d0-975e-1fcd1f5c731a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:51.719671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-faf69ec1-696b-410f-a0da-4120181f3dbe tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:51.720188 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-faf69ec1-696b-410f-a0da-4120181f3dbe tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:51.724412 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-faf69ec1-696b-410f-a0da-4120181f3dbe tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:51.725886 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-faf69ec1-696b-410f-a0da-4120181f3dbe tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:51.727185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-faf69ec1-696b-410f-a0da-4120181f3dbe tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:51.728105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-faf69ec1-696b-410f-a0da-4120181f3dbe tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:52.015034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1806bd4b-61ca-43ea-86d3-5a36bb6f3610 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:52.036626 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1806bd4b-61ca-43ea-86d3-5a36bb6f3610 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d" status: 200 len: 1500 microversion: 2.1 time: 2.035269 Aug 24 10:36:52.040833 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2546/4696] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:49 2022] GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d => generated 1500 bytes in 2044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:52.055554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c26cad84-73a0-413b-b522-ed9b918d1842 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:52.057019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c26cad84-73a0-413b-b522-ed9b918d1842 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] [instance: 60017c53-5854-4b27-a8e7-164c39da5856] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:52.084675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c26cad84-73a0-413b-b522-ed9b918d1842 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:52.086296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c26cad84-73a0-413b-b522-ed9b918d1842 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:52.093679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c26cad84-73a0-413b-b522-ed9b918d1842 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:52.094549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c26cad84-73a0-413b-b522-ed9b918d1842 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:52.095046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c26cad84-73a0-413b-b522-ed9b918d1842 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:52.095493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c26cad84-73a0-413b-b522-ed9b918d1842 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:52.120666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-faf69ec1-696b-410f-a0da-4120181f3dbe tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4be32dd307497dae1e5fa2dbb76e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce61197b6e1c4a27b36a4774ea2e89c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:52.132557 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-faf69ec1-696b-410f-a0da-4120181f3dbe tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] 10.222.0.85 "GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a" status: 200 len: 1282 microversion: 2.1 time: 0.471842 Aug 24 10:36:52.139836 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2151/4697] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:51 2022] GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a => generated 1282 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:52.143026 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-c26cad84-73a0-413b-b522-ed9b918d1842 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] HTTP exception thrown: Instance 60017c53-5854-4b27-a8e7-164c39da5856 could not be found. Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c26cad84-73a0-413b-b522-ed9b918d1842 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Request method failure captured: Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856 HTTP/1.1 Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf7xNn_JV7qA8riGZJFQf__ncoNTNCwez_lppBf28SeZ3wpP3XYvqZIIRPzdooen_64aZSdujQRPkcTLIXIwlLlZWp47xvzAiFLGGRMHfXe9CtJ03Me5oJhHdSXNUf_dK396dz6tRHUzeboLol6ePxSFEnFt0DMNjkd_2j3Xukbvdxc Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: b4137804f32f459394ac7aa54f6bacb3 Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-MultipleCreateTestJSON-1567926735 Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b4137804f32f459394ac7aa54f6bacb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b4137804f32f459394ac7aa54f6bacb3", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b4137804f32f459394ac7aa54f6bacb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b4137804f32f459394ac7aa54f6bacb3"}]}] Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-MultipleCreateTestJSON-1567926735 Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: b4137804f32f459394ac7aa54f6bacb3 Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1567926735 Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-MultipleCreateTestJSON-1567926735-project Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: f2aacca6ee8646349b6f385adb8b9ef3 Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-MultipleCreateTestJSON-1567926735-project Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 60017c53-5854-4b27-a8e7-164c39da5856 could not be found. Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '60017c53-5854-4b27-a8e7-164c39da5856'} Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60017c53-5854-4b27-a8e7-164c39da5856 could not be found. Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60017c53-5854-4b27-a8e7-164c39da5856 could not be found. Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:36:52.148389 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:52.156959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:36:52.156959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:36:52.156959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:36:52.156959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:36:52.156959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:36:52.156959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60017c53-5854-4b27-a8e7-164c39da5856 could not be found. Aug 24 10:36:52.156959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:36:52.156959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c26cad84-73a0-413b-b522-ed9b918d1842 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] Returning 404 to user: Instance 60017c53-5854-4b27-a8e7-164c39da5856 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:36:52.156959 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c26cad84-73a0-413b-b522-ed9b918d1842 tempest-MultipleCreateTestJSON-1567926735 tempest-MultipleCreateTestJSON-1567926735-project] 10.222.0.85 "GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856" status: 404 len: 111 microversion: 2.1 time: 0.106686 Aug 24 10:36:52.156959 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2547/4698] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:52 2022] GET /compute/v2.1/servers/60017c53-5854-4b27-a8e7-164c39da5856 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:36:52.161322 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e229f925-77a5-4f28-80c7-852505616e2c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:36:52.170302 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e229f925-77a5-4f28-80c7-852505616e2c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:52.204410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:52.220765 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e229f925-77a5-4f28-80c7-852505616e2c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:52.222262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e229f925-77a5-4f28-80c7-852505616e2c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:52.238919 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e229f925-77a5-4f28-80c7-852505616e2c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:52.250699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e229f925-77a5-4f28-80c7-852505616e2c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:52.252600 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e229f925-77a5-4f28-80c7-852505616e2c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:52.257472 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e229f925-77a5-4f28-80c7-852505616e2c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:52.383272 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e229f925-77a5-4f28-80c7-852505616e2c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d/action" status: 200 len: 14 microversion: 2.1 time: 0.241515 Aug 24 10:36:52.388197 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2152/4699] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:36:52 2022] POST /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d/action => generated 14 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:36:52.672357 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9e376ed0-6569-4a39-ae0c-8756b3010b30 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:52.673022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9e376ed0-6569-4a39-ae0c-8756b3010b30 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:52.701277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e376ed0-6569-4a39-ae0c-8756b3010b30 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:52.702187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e376ed0-6569-4a39-ae0c-8756b3010b30 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:52.704328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e376ed0-6569-4a39-ae0c-8756b3010b30 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:52.707424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e376ed0-6569-4a39-ae0c-8756b3010b30 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:52.708100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e376ed0-6569-4a39-ae0c-8756b3010b30 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:52.721552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e376ed0-6569-4a39-ae0c-8756b3010b30 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:53.054649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9e376ed0-6569-4a39-ae0c-8756b3010b30 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:53.069238 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9e376ed0-6569-4a39-ae0c-8756b3010b30 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9" status: 200 len: 1196 microversion: 2.1 time: 0.401723 Aug 24 10:36:53.077012 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2548/4700] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:52 2022] GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 => generated 1196 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:53.159563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8ed4e41c-3eb6-4ed3-a3b9-ad6520a15f49 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:53.160391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8ed4e41c-3eb6-4ed3-a3b9-ad6520a15f49 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] [instance: af079278-7264-43d0-975e-1fcd1f5c731a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:53.215244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ed4e41c-3eb6-4ed3-a3b9-ad6520a15f49 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:53.218649 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ed4e41c-3eb6-4ed3-a3b9-ad6520a15f49 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:53.221282 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ed4e41c-3eb6-4ed3-a3b9-ad6520a15f49 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:53.228324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ed4e41c-3eb6-4ed3-a3b9-ad6520a15f49 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:53.228989 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ed4e41c-3eb6-4ed3-a3b9-ad6520a15f49 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:53.229402 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ed4e41c-3eb6-4ed3-a3b9-ad6520a15f49 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:53.395286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-90804560-81d4-4607-8f59-ff680427bd21 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:36:53.398642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-90804560-81d4-4607-8f59-ff680427bd21 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:53.417656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90804560-81d4-4607-8f59-ff680427bd21 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:53.420310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90804560-81d4-4607-8f59-ff680427bd21 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:53.421898 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90804560-81d4-4607-8f59-ff680427bd21 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:53.423718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90804560-81d4-4607-8f59-ff680427bd21 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:53.424898 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90804560-81d4-4607-8f59-ff680427bd21 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:53.429603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90804560-81d4-4607-8f59-ff680427bd21 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:53.552703 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-90804560-81d4-4607-8f59-ff680427bd21 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d/action" status: 200 len: 14 microversion: 2.1 time: 0.161371 Aug 24 10:36:53.553743 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2549/4701] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:36:53 2022] POST /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 10:36:54.101101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-11d3ce17-b74e-4ab7-a295-2bcad389eea1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:54.101998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-11d3ce17-b74e-4ab7-a295-2bcad389eea1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:54.129581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11d3ce17-b74e-4ab7-a295-2bcad389eea1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:54.134533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11d3ce17-b74e-4ab7-a295-2bcad389eea1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:54.137676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11d3ce17-b74e-4ab7-a295-2bcad389eea1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:54.145472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11d3ce17-b74e-4ab7-a295-2bcad389eea1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:54.146465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11d3ce17-b74e-4ab7-a295-2bcad389eea1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:54.147666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11d3ce17-b74e-4ab7-a295-2bcad389eea1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:54.157245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8ed4e41c-3eb6-4ed3-a3b9-ad6520a15f49 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4be32dd307497dae1e5fa2dbb76e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce61197b6e1c4a27b36a4774ea2e89c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:54.166372 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8ed4e41c-3eb6-4ed3-a3b9-ad6520a15f49 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] 10.222.0.85 "GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a" status: 200 len: 1324 microversion: 2.1 time: 1.012626 Aug 24 10:36:54.170027 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2153/4702] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:53 2022] GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a => generated 1324 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:54.378043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-11d3ce17-b74e-4ab7-a295-2bcad389eea1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:54.387763 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-11d3ce17-b74e-4ab7-a295-2bcad389eea1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9" status: 200 len: 1250 microversion: 2.1 time: 0.291481 Aug 24 10:36:54.391088 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2550/4703] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:54 2022] GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 => generated 1250 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:36:54.567891 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df402664-f189-401c-8a61-b8f348601b12 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:36:54.569327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-df402664-f189-401c-8a61-b8f348601b12 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:54.587047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a8344277-9f12-492b-bb9f-ceb85262e4b4 req-efce198e-48c3-4786-8575-bd85b8ef771b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af079278-7264-43d0-975e-1fcd1f5c731a", "tag": "c2d5f602-b2e5-4a1e-a873-4707953f89af"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:36:54.599837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df402664-f189-401c-8a61-b8f348601b12 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:54.600342 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df402664-f189-401c-8a61-b8f348601b12 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:54.600786 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df402664-f189-401c-8a61-b8f348601b12 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:54.617924 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df402664-f189-401c-8a61-b8f348601b12 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:54.618712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df402664-f189-401c-8a61-b8f348601b12 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:54.619243 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df402664-f189-401c-8a61-b8f348601b12 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:54.624692 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a8344277-9f12-492b-bb9f-ceb85262e4b4 req-efce198e-48c3-4786-8575-bd85b8ef771b service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:54.625206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a8344277-9f12-492b-bb9f-ceb85262e4b4 req-efce198e-48c3-4786-8575-bd85b8ef771b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:54.631515 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a8344277-9f12-492b-bb9f-ceb85262e4b4 req-efce198e-48c3-4786-8575-bd85b8ef771b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:54.662740 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a8344277-9f12-492b-bb9f-ceb85262e4b4 req-efce198e-48c3-4786-8575-bd85b8ef771b service nova] Creating event network-changed:c2d5f602-b2e5-4a1e-a873-4707953f89af for instance af079278-7264-43d0-975e-1fcd1f5c731a on n-h2-849328-3 Aug 24 10:36:54.678917 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a8344277-9f12-492b-bb9f-ceb85262e4b4 req-efce198e-48c3-4786-8575-bd85b8ef771b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095787 Aug 24 10:36:54.683955 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2551/4704] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:54.742509 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-df402664-f189-401c-8a61-b8f348601b12 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d/action" status: 200 len: 14 microversion: 2.1 time: 0.181863 Aug 24 10:36:54.743637 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2154/4705] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:36:54 2022] POST /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d/action => generated 14 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:36:55.191734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f331ca8d-36df-4839-8bfb-9ede02a30ebc tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:55.192469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f331ca8d-36df-4839-8bfb-9ede02a30ebc tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] [instance: af079278-7264-43d0-975e-1fcd1f5c731a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:55.233313 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f331ca8d-36df-4839-8bfb-9ede02a30ebc tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:55.234282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f331ca8d-36df-4839-8bfb-9ede02a30ebc tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:55.234945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f331ca8d-36df-4839-8bfb-9ede02a30ebc tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:55.235887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f331ca8d-36df-4839-8bfb-9ede02a30ebc tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:55.238269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f331ca8d-36df-4839-8bfb-9ede02a30ebc tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:55.238906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f331ca8d-36df-4839-8bfb-9ede02a30ebc tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:55.416729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-66b265a2-af5a-4069-a062-1688188431e8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:55.418176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-66b265a2-af5a-4069-a062-1688188431e8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:55.437285 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66b265a2-af5a-4069-a062-1688188431e8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:55.438419 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66b265a2-af5a-4069-a062-1688188431e8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:55.438878 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66b265a2-af5a-4069-a062-1688188431e8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:55.443103 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66b265a2-af5a-4069-a062-1688188431e8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:55.443583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66b265a2-af5a-4069-a062-1688188431e8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:55.445639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66b265a2-af5a-4069-a062-1688188431e8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:55.731493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-66b265a2-af5a-4069-a062-1688188431e8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:55.741998 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-66b265a2-af5a-4069-a062-1688188431e8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9" status: 200 len: 1250 microversion: 2.1 time: 0.329684 Aug 24 10:36:55.743184 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2155/4706] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:55 2022] GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 => generated 1250 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:36:55.755171 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3c7527ea-7521-4dbf-93e9-080ef72facb5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:36:55.759315 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3c7527ea-7521-4dbf-93e9-080ef72facb5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:55.794647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c7527ea-7521-4dbf-93e9-080ef72facb5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:55.795564 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c7527ea-7521-4dbf-93e9-080ef72facb5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:55.796234 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c7527ea-7521-4dbf-93e9-080ef72facb5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:55.797901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c7527ea-7521-4dbf-93e9-080ef72facb5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:55.798623 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c7527ea-7521-4dbf-93e9-080ef72facb5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:55.799385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c7527ea-7521-4dbf-93e9-080ef72facb5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:55.899480 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f331ca8d-36df-4839-8bfb-9ede02a30ebc tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4be32dd307497dae1e5fa2dbb76e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce61197b6e1c4a27b36a4774ea2e89c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:55.920992 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f331ca8d-36df-4839-8bfb-9ede02a30ebc tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] 10.222.0.85 "GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a" status: 200 len: 1324 microversion: 2.1 time: 0.735173 Aug 24 10:36:55.922224 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2552/4707] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:55 2022] GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a => generated 1324 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:55.929114 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3c7527ea-7521-4dbf-93e9-080ef72facb5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d/action" status: 200 len: 14 microversion: 2.1 time: 0.177914 Aug 24 10:36:55.930130 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2156/4708] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:36:55 2022] POST /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d/action => generated 14 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 10:36:56.768265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a60e2794-c41b-4aec-96a1-d0a1d310f566 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:56.768888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a60e2794-c41b-4aec-96a1-d0a1d310f566 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:56.789786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a60e2794-c41b-4aec-96a1-d0a1d310f566 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:56.790398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a60e2794-c41b-4aec-96a1-d0a1d310f566 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:56.790764 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a60e2794-c41b-4aec-96a1-d0a1d310f566 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:56.791523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a60e2794-c41b-4aec-96a1-d0a1d310f566 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:56.791983 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a60e2794-c41b-4aec-96a1-d0a1d310f566 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:56.792405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a60e2794-c41b-4aec-96a1-d0a1d310f566 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:56.944141 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2c5f2517-05d8-4ff0-87d1-808eef4d15ed tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:36:56.946495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2c5f2517-05d8-4ff0-87d1-808eef4d15ed tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:56.975656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c5f2517-05d8-4ff0-87d1-808eef4d15ed tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:56.976929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c5f2517-05d8-4ff0-87d1-808eef4d15ed tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:56.977252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c5f2517-05d8-4ff0-87d1-808eef4d15ed tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:56.978271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c5f2517-05d8-4ff0-87d1-808eef4d15ed tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:56.979018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c5f2517-05d8-4ff0-87d1-808eef4d15ed tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:56.979713 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c5f2517-05d8-4ff0-87d1-808eef4d15ed tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:57.108604 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2c5f2517-05d8-4ff0-87d1-808eef4d15ed tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d/action" status: 200 len: 14 microversion: 2.1 time: 0.168449 Aug 24 10:36:57.109548 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2157/4709] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:36:56 2022] POST /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 10:36:57.120317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-41822972-09f4-4871-9813-6c4bf36daf5b tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:57.125846 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-41822972-09f4-4871-9813-6c4bf36daf5b tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] [instance: af079278-7264-43d0-975e-1fcd1f5c731a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:57.146074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41822972-09f4-4871-9813-6c4bf36daf5b tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:57.148239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41822972-09f4-4871-9813-6c4bf36daf5b tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:57.149036 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41822972-09f4-4871-9813-6c4bf36daf5b tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:57.151345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41822972-09f4-4871-9813-6c4bf36daf5b tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:57.153232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41822972-09f4-4871-9813-6c4bf36daf5b tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:57.156765 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41822972-09f4-4871-9813-6c4bf36daf5b tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:57.257612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a60e2794-c41b-4aec-96a1-d0a1d310f566 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:57.268770 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a60e2794-c41b-4aec-96a1-d0a1d310f566 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9" status: 200 len: 1292 microversion: 2.1 time: 0.504410 Aug 24 10:36:57.281750 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2553/4710] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:56 2022] GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 => generated 1292 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:58.046782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-41822972-09f4-4871-9813-6c4bf36daf5b tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4be32dd307497dae1e5fa2dbb76e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce61197b6e1c4a27b36a4774ea2e89c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:58.058095 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-41822972-09f4-4871-9813-6c4bf36daf5b tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] 10.222.0.85 "GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a" status: 200 len: 1324 microversion: 2.1 time: 0.947067 Aug 24 10:36:58.073936 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2158/4711] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:57 2022] GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a => generated 1324 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:58.121157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c64ae49-5ea7-4b01-84a7-61734d8827b5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:36:58.124905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2c64ae49-5ea7-4b01-84a7-61734d8827b5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:58.137050 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c64ae49-5ea7-4b01-84a7-61734d8827b5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:58.137870 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c64ae49-5ea7-4b01-84a7-61734d8827b5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:58.139727 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c64ae49-5ea7-4b01-84a7-61734d8827b5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:58.140682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c64ae49-5ea7-4b01-84a7-61734d8827b5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:58.142058 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c64ae49-5ea7-4b01-84a7-61734d8827b5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:58.142820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c64ae49-5ea7-4b01-84a7-61734d8827b5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:58.225198 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2c64ae49-5ea7-4b01-84a7-61734d8827b5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d/action" status: 200 len: 14 microversion: 2.1 time: 0.108315 Aug 24 10:36:58.226171 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2554/4712] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:36:58 2022] POST /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:36:58.303808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-045183ce-24ae-4bb2-a6e2-03f6fc2f68d5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:58.304429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-045183ce-24ae-4bb2-a6e2-03f6fc2f68d5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:58.314331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-045183ce-24ae-4bb2-a6e2-03f6fc2f68d5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:58.315917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-045183ce-24ae-4bb2-a6e2-03f6fc2f68d5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:58.316072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-045183ce-24ae-4bb2-a6e2-03f6fc2f68d5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:58.318276 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-045183ce-24ae-4bb2-a6e2-03f6fc2f68d5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:58.319179 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-045183ce-24ae-4bb2-a6e2-03f6fc2f68d5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:58.319999 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-045183ce-24ae-4bb2-a6e2-03f6fc2f68d5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:58.775474 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-045183ce-24ae-4bb2-a6e2-03f6fc2f68d5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:58.788019 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-045183ce-24ae-4bb2-a6e2-03f6fc2f68d5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9" status: 200 len: 1292 microversion: 2.1 time: 0.488049 Aug 24 10:36:58.789280 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2159/4713] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:58 2022] GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 => generated 1292 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:59.095619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cbd3b64f-0d03-44b4-b99a-ad3290995a59 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:59.096289 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cbd3b64f-0d03-44b4-b99a-ad3290995a59 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] [instance: af079278-7264-43d0-975e-1fcd1f5c731a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:59.115496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbd3b64f-0d03-44b4-b99a-ad3290995a59 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:59.115996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbd3b64f-0d03-44b4-b99a-ad3290995a59 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:59.116436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbd3b64f-0d03-44b4-b99a-ad3290995a59 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:59.117167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbd3b64f-0d03-44b4-b99a-ad3290995a59 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:59.117630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbd3b64f-0d03-44b4-b99a-ad3290995a59 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:59.118053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbd3b64f-0d03-44b4-b99a-ad3290995a59 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:59.242219 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5151a84f-806e-43f2-92b5-34dcf4b03920 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:36:59.244595 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5151a84f-806e-43f2-92b5-34dcf4b03920 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:59.253447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5151a84f-806e-43f2-92b5-34dcf4b03920 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:59.253946 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5151a84f-806e-43f2-92b5-34dcf4b03920 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:59.254377 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5151a84f-806e-43f2-92b5-34dcf4b03920 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:59.255117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5151a84f-806e-43f2-92b5-34dcf4b03920 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:59.255526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5151a84f-806e-43f2-92b5-34dcf4b03920 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:59.255976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5151a84f-806e-43f2-92b5-34dcf4b03920 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:59.372424 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5151a84f-806e-43f2-92b5-34dcf4b03920 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d/action" status: 200 len: 14 microversion: 2.1 time: 0.139856 Aug 24 10:36:59.373717 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2160/4714] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:36:59 2022] POST /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 10:36:59.383125 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-03f8dc3d-7f1f-42ea-92bb-3407aa7ba054 req-f6b19f53-f99a-4546-b6fe-3144401b2254 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9", "tag": "49282a09-9feb-4209-89fa-dde9cf343ed1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:36:59.395889 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-03f8dc3d-7f1f-42ea-92bb-3407aa7ba054 req-f6b19f53-f99a-4546-b6fe-3144401b2254 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:59.396673 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-03f8dc3d-7f1f-42ea-92bb-3407aa7ba054 req-f6b19f53-f99a-4546-b6fe-3144401b2254 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:59.397363 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-03f8dc3d-7f1f-42ea-92bb-3407aa7ba054 req-f6b19f53-f99a-4546-b6fe-3144401b2254 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:59.412244 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-03f8dc3d-7f1f-42ea-92bb-3407aa7ba054 req-f6b19f53-f99a-4546-b6fe-3144401b2254 service nova] Creating event network-changed:49282a09-9feb-4209-89fa-dde9cf343ed1 for instance 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 on n-h1-849328-3 Aug 24 10:36:59.418316 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-03f8dc3d-7f1f-42ea-92bb-3407aa7ba054 req-f6b19f53-f99a-4546-b6fe-3144401b2254 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042868 Aug 24 10:36:59.420876 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2161/4715] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:36:59.623677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cbd3b64f-0d03-44b4-b99a-ad3290995a59 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4be32dd307497dae1e5fa2dbb76e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce61197b6e1c4a27b36a4774ea2e89c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:36:59.636184 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cbd3b64f-0d03-44b4-b99a-ad3290995a59 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] 10.222.0.85 "GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a" status: 200 len: 1324 microversion: 2.1 time: 0.545054 Aug 24 10:36:59.636800 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2555/4716] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:59 2022] GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a => generated 1324 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:36:59.813246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d69313e7-dec3-4c58-b636-c91b7257acb8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:36:59.814519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d69313e7-dec3-4c58-b636-c91b7257acb8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:36:59.829186 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d69313e7-dec3-4c58-b636-c91b7257acb8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:59.830683 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d69313e7-dec3-4c58-b636-c91b7257acb8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:59.831589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d69313e7-dec3-4c58-b636-c91b7257acb8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:59.833417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d69313e7-dec3-4c58-b636-c91b7257acb8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:36:59.834962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d69313e7-dec3-4c58-b636-c91b7257acb8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:36:59.835679 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d69313e7-dec3-4c58-b636-c91b7257acb8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:36:59.875242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:00.154646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d69313e7-dec3-4c58-b636-c91b7257acb8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:00.165841 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d69313e7-dec3-4c58-b636-c91b7257acb8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9" status: 200 len: 1292 microversion: 2.1 time: 0.357699 Aug 24 10:37:00.169494 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2162/4717] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:36:59 2022] GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 => generated 1292 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:00.384732 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3dc5afdf-1cfb-48ef-8e3a-5118c9aa1445 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:00.387365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3dc5afdf-1cfb-48ef-8e3a-5118c9aa1445 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:00.423226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3dc5afdf-1cfb-48ef-8e3a-5118c9aa1445 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:00.424739 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3dc5afdf-1cfb-48ef-8e3a-5118c9aa1445 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:00.425224 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3dc5afdf-1cfb-48ef-8e3a-5118c9aa1445 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:00.430907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3dc5afdf-1cfb-48ef-8e3a-5118c9aa1445 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:00.434530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3dc5afdf-1cfb-48ef-8e3a-5118c9aa1445 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:00.435038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3dc5afdf-1cfb-48ef-8e3a-5118c9aa1445 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:00.659543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-156cf26f-261f-42da-95fe-d5da3322b8af tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:00.660078 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-156cf26f-261f-42da-95fe-d5da3322b8af tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] [instance: af079278-7264-43d0-975e-1fcd1f5c731a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:00.680514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:00.691061 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-156cf26f-261f-42da-95fe-d5da3322b8af tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:00.695139 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-156cf26f-261f-42da-95fe-d5da3322b8af tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:00.695802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-156cf26f-261f-42da-95fe-d5da3322b8af tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:00.698461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-156cf26f-261f-42da-95fe-d5da3322b8af tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:00.699339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-156cf26f-261f-42da-95fe-d5da3322b8af tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:00.699805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-156cf26f-261f-42da-95fe-d5da3322b8af tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:01.014499 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-156cf26f-261f-42da-95fe-d5da3322b8af tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4be32dd307497dae1e5fa2dbb76e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce61197b6e1c4a27b36a4774ea2e89c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:01.022638 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-156cf26f-261f-42da-95fe-d5da3322b8af tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] 10.222.0.85 "GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a" status: 200 len: 1324 microversion: 2.1 time: 0.370229 Aug 24 10:37:01.023240 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2163/4718] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:00 2022] GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a => generated 1324 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:01.153441 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3dc5afdf-1cfb-48ef-8e3a-5118c9aa1445 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d/action" status: 200 len: 14 microversion: 2.1 time: 0.772988 Aug 24 10:37:01.163844 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2556/4719] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:37:00 2022] POST /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d/action => generated 14 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:37:01.193330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fb0cd61f-6f99-4f20-a463-b5f2aef5e4dd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:01.194603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fb0cd61f-6f99-4f20-a463-b5f2aef5e4dd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:01.207540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb0cd61f-6f99-4f20-a463-b5f2aef5e4dd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:01.208039 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb0cd61f-6f99-4f20-a463-b5f2aef5e4dd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:01.211241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb0cd61f-6f99-4f20-a463-b5f2aef5e4dd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:01.218231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb0cd61f-6f99-4f20-a463-b5f2aef5e4dd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:01.219866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb0cd61f-6f99-4f20-a463-b5f2aef5e4dd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:01.220490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb0cd61f-6f99-4f20-a463-b5f2aef5e4dd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:01.478713 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-b32ffa62-c6a9-4dd7-8258-e54e2081bc57 req-19ca77f6-b18a-43f4-bc83-93dfb2bf47e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af079278-7264-43d0-975e-1fcd1f5c731a", "name": "network-vif-plugged", "status": "completed", "tag": "c2d5f602-b2e5-4a1e-a873-4707953f89af"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:01.521468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b32ffa62-c6a9-4dd7-8258-e54e2081bc57 req-19ca77f6-b18a-43f4-bc83-93dfb2bf47e8 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:01.522560 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b32ffa62-c6a9-4dd7-8258-e54e2081bc57 req-19ca77f6-b18a-43f4-bc83-93dfb2bf47e8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:01.523058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b32ffa62-c6a9-4dd7-8258-e54e2081bc57 req-19ca77f6-b18a-43f4-bc83-93dfb2bf47e8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:01.552580 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b32ffa62-c6a9-4dd7-8258-e54e2081bc57 req-19ca77f6-b18a-43f4-bc83-93dfb2bf47e8 service nova] Creating event network-vif-plugged:c2d5f602-b2e5-4a1e-a873-4707953f89af for instance af079278-7264-43d0-975e-1fcd1f5c731a on n-h2-849328-3 Aug 24 10:37:01.560920 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-b32ffa62-c6a9-4dd7-8258-e54e2081bc57 req-19ca77f6-b18a-43f4-bc83-93dfb2bf47e8 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.536462 Aug 24 10:37:01.562216 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2164/4720] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:37:01.672578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fb0cd61f-6f99-4f20-a463-b5f2aef5e4dd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:01.685646 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fb0cd61f-6f99-4f20-a463-b5f2aef5e4dd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9" status: 200 len: 1292 microversion: 2.1 time: 0.493108 Aug 24 10:37:01.686242 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2557/4721] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:01 2022] GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 => generated 1292 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:02.042281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=16 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:02.047527 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a6e8845f-173a-42f7-b74a-8ad2050efd12 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:02.048243 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a6e8845f-173a-42f7-b74a-8ad2050efd12 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] [instance: af079278-7264-43d0-975e-1fcd1f5c731a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:02.066797 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6e8845f-173a-42f7-b74a-8ad2050efd12 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:02.067287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6e8845f-173a-42f7-b74a-8ad2050efd12 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:02.067722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6e8845f-173a-42f7-b74a-8ad2050efd12 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:02.068434 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6e8845f-173a-42f7-b74a-8ad2050efd12 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:02.068885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6e8845f-173a-42f7-b74a-8ad2050efd12 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:02.069337 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6e8845f-173a-42f7-b74a-8ad2050efd12 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:02.176052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7a06dc9d-9db0-44f3-88d0-4c4131191135 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:02.179786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7a06dc9d-9db0-44f3-88d0-4c4131191135 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:02.196886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a06dc9d-9db0-44f3-88d0-4c4131191135 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:02.199411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a06dc9d-9db0-44f3-88d0-4c4131191135 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:02.201829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a06dc9d-9db0-44f3-88d0-4c4131191135 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:02.205384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a06dc9d-9db0-44f3-88d0-4c4131191135 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:02.210078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a06dc9d-9db0-44f3-88d0-4c4131191135 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:02.211040 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a06dc9d-9db0-44f3-88d0-4c4131191135 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:02.312944 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7a06dc9d-9db0-44f3-88d0-4c4131191135 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d/action" status: 200 len: 14 microversion: 2.1 time: 0.142026 Aug 24 10:37:02.313808 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2558/4722] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:37:02 2022] POST /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 10:37:02.711020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3780780c-1dc3-47f8-a6fe-196826f3aecd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:02.712117 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3780780c-1dc3-47f8-a6fe-196826f3aecd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:02.728244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a6e8845f-173a-42f7-b74a-8ad2050efd12 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4be32dd307497dae1e5fa2dbb76e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce61197b6e1c4a27b36a4774ea2e89c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:02.736516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3780780c-1dc3-47f8-a6fe-196826f3aecd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:02.736991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3780780c-1dc3-47f8-a6fe-196826f3aecd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:02.753879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3780780c-1dc3-47f8-a6fe-196826f3aecd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:02.755085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3780780c-1dc3-47f8-a6fe-196826f3aecd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:02.755737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3780780c-1dc3-47f8-a6fe-196826f3aecd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:02.763934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3780780c-1dc3-47f8-a6fe-196826f3aecd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:02.827432 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a6e8845f-173a-42f7-b74a-8ad2050efd12 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] 10.222.0.85 "GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a" status: 200 len: 1324 microversion: 2.1 time: 0.780216 Aug 24 10:37:02.828546 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2165/4723] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:02 2022] GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a => generated 1324 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:03.155905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3780780c-1dc3-47f8-a6fe-196826f3aecd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:03.165656 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3780780c-1dc3-47f8-a6fe-196826f3aecd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9" status: 200 len: 1292 microversion: 2.1 time: 0.459242 Aug 24 10:37:03.167054 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2559/4724] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:02 2022] GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 => generated 1292 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:37:03.325507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-73370538-63b6-49ad-b60c-2ee1692b901f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:03.328491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-73370538-63b6-49ad-b60c-2ee1692b901f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:03.341629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73370538-63b6-49ad-b60c-2ee1692b901f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:03.345817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73370538-63b6-49ad-b60c-2ee1692b901f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:03.347551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73370538-63b6-49ad-b60c-2ee1692b901f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:03.354745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73370538-63b6-49ad-b60c-2ee1692b901f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:03.368251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73370538-63b6-49ad-b60c-2ee1692b901f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:03.372705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73370538-63b6-49ad-b60c-2ee1692b901f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:03.500983 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-73370538-63b6-49ad-b60c-2ee1692b901f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d/action" status: 200 len: 8208 microversion: 2.1 time: 0.179779 Aug 24 10:37:03.501684 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2166/4725] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:37:03 2022] POST /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d/action => generated 8208 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:03.513724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cd010dd7-24c5-490c-880f-1e8751771d0c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:03.517725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cd010dd7-24c5-490c-880f-1e8751771d0c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:03.533337 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd010dd7-24c5-490c-880f-1e8751771d0c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:03.534143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd010dd7-24c5-490c-880f-1e8751771d0c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:03.534767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd010dd7-24c5-490c-880f-1e8751771d0c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:03.535854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd010dd7-24c5-490c-880f-1e8751771d0c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:03.536610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd010dd7-24c5-490c-880f-1e8751771d0c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:03.537241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd010dd7-24c5-490c-880f-1e8751771d0c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:03.851338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1f2de57a-7ee8-4361-afc0-7dbf857288de tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:03.852055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1f2de57a-7ee8-4361-afc0-7dbf857288de tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] [instance: af079278-7264-43d0-975e-1fcd1f5c731a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:03.872136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f2de57a-7ee8-4361-afc0-7dbf857288de tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:03.872674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f2de57a-7ee8-4361-afc0-7dbf857288de tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:03.873136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f2de57a-7ee8-4361-afc0-7dbf857288de tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:03.873859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f2de57a-7ee8-4361-afc0-7dbf857288de tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:03.874319 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f2de57a-7ee8-4361-afc0-7dbf857288de tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:03.874749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f2de57a-7ee8-4361-afc0-7dbf857288de tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:03.881714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cd010dd7-24c5-490c-880f-1e8751771d0c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:03.896175 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cd010dd7-24c5-490c-880f-1e8751771d0c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.388362 Aug 24 10:37:03.899263 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2560/4726] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:03 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:03.937839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6d163bc3-f99b-4905-b631-9f534e9570eb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:03.938550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6d163bc3-f99b-4905-b631-9f534e9570eb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:03.955998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d163bc3-f99b-4905-b631-9f534e9570eb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:03.957176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d163bc3-f99b-4905-b631-9f534e9570eb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:03.959304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d163bc3-f99b-4905-b631-9f534e9570eb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:03.960198 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d163bc3-f99b-4905-b631-9f534e9570eb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:03.961653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d163bc3-f99b-4905-b631-9f534e9570eb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:03.964639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d163bc3-f99b-4905-b631-9f534e9570eb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:04.205240 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6d163bc3-f99b-4905-b631-9f534e9570eb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:04.217683 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6d163bc3-f99b-4905-b631-9f534e9570eb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.290007 Aug 24 10:37:04.219651 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2561/4727] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:03 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:04.230926 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1f2de57a-7ee8-4361-afc0-7dbf857288de tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4be32dd307497dae1e5fa2dbb76e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce61197b6e1c4a27b36a4774ea2e89c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:04.236454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-119bf260-1e14-44bd-8bd1-4529a7ea4bd9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:04.237607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-119bf260-1e14-44bd-8bd1-4529a7ea4bd9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:04.240750 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1f2de57a-7ee8-4361-afc0-7dbf857288de tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] 10.222.0.85 "GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a" status: 200 len: 1521 microversion: 2.1 time: 0.393586 Aug 24 10:37:04.244775 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2167/4728] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:03 2022] GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:04.252362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2a718ece-d3d5-4f0b-bd3b-75c1ac92ce57 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:04.258028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2a718ece-d3d5-4f0b-bd3b-75c1ac92ce57 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:04.268521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a718ece-d3d5-4f0b-bd3b-75c1ac92ce57 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:04.268870 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a718ece-d3d5-4f0b-bd3b-75c1ac92ce57 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:04.277752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a718ece-d3d5-4f0b-bd3b-75c1ac92ce57 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:04.279495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a718ece-d3d5-4f0b-bd3b-75c1ac92ce57 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:04.280844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a718ece-d3d5-4f0b-bd3b-75c1ac92ce57 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:04.282527 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a718ece-d3d5-4f0b-bd3b-75c1ac92ce57 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:04.283073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-119bf260-1e14-44bd-8bd1-4529a7ea4bd9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:04.283663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-119bf260-1e14-44bd-8bd1-4529a7ea4bd9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:04.284114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-119bf260-1e14-44bd-8bd1-4529a7ea4bd9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:04.284856 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-119bf260-1e14-44bd-8bd1-4529a7ea4bd9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:04.287938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-119bf260-1e14-44bd-8bd1-4529a7ea4bd9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:04.288389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-119bf260-1e14-44bd-8bd1-4529a7ea4bd9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:04.583538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-119bf260-1e14-44bd-8bd1-4529a7ea4bd9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:04.598858 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-119bf260-1e14-44bd-8bd1-4529a7ea4bd9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9" status: 200 len: 1292 microversion: 2.1 time: 0.377627 Aug 24 10:37:04.602114 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2562/4729] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:04 2022] GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 => generated 1292 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:04.646607 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2a718ece-d3d5-4f0b-bd3b-75c1ac92ce57 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:04.672901 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2a718ece-d3d5-4f0b-bd3b-75c1ac92ce57 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.425718 Aug 24 10:37:04.675485 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2168/4730] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:04 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:04.713266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0601d557-70b5-499d-96f8-0a7022fc970d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:04.713266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0601d557-70b5-499d-96f8-0a7022fc970d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:04.731592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0601d557-70b5-499d-96f8-0a7022fc970d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:04.735081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0601d557-70b5-499d-96f8-0a7022fc970d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:04.735957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0601d557-70b5-499d-96f8-0a7022fc970d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:04.739619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0601d557-70b5-499d-96f8-0a7022fc970d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:04.743536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0601d557-70b5-499d-96f8-0a7022fc970d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:04.747673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0601d557-70b5-499d-96f8-0a7022fc970d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:04.770897 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9edc02ab-34d5-465e-b6bd-9007eacb36f2 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1771172081", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "66890c02-aa63-4a1b-a0f0-947d4c116c2a"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9edc02ab-34d5-465e-b6bd-9007eacb36f2 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Request method failure captured: Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 243 Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf87MXHm4NC9peqCWxzLBaaIjHSseP-OeVmk1z0frgYlVy9TxgVitCZSJABPyV71SFWQ2ytxMRXy6zS_PtKpBO7Hy3KXK20wkGbfthpU8B8HrHWnMb-oamRiM23iande1j5OMMj21ZMTzWYfYwXitPa9QpEAaeVRjLXZhq_evXASEC4 Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: ce61197b6e1c4a27b36a4774ea2e89c3 Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2130520497 Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ce61197b6e1c4a27b36a4774ea2e89c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_ce61197b6e1c4a27b36a4774ea2e89c3", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ce61197b6e1c4a27b36a4774ea2e89c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/ce61197b6e1c4a27b36a4774ea2e89c3"}]}] Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2130520497 Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: ce61197b6e1c4a27b36a4774ea2e89c3 Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2130520497 Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerMetadataNegativeTestJSON-2130520497-project Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 0b4be32dd307497dae1e5fa2dbb76e71 Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2130520497-project Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1771172081", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "66890c02-aa63-4a1b-a0f0-947d4c116c2a"}]}} Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1771172081', 'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '66890c02-aa63-4a1b-a0f0-947d4c116c2a'}]}}} Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:37:04.775875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:37:04.781507 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:37:04.781507 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:37:04.781507 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:37:04.781507 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:37:04.781507 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:37:04.781507 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:37:04.781507 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:37:04.781507 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 10:37:04.781507 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:04.781507 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:37:04.781507 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:04.781507 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:04.781507 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:37:04.781507 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:37:04.781507 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:37:04.781507 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:37:04.781507 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 10:37:04.781507 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:04.781507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9edc02ab-34d5-465e-b6bd-9007eacb36f2 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:37:04.785439 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9edc02ab-34d5-465e-b6bd-9007eacb36f2 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.011161 Aug 24 10:37:04.792441 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2169/4731] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:37:04 2022] POST /compute/v2.1/servers => generated 175 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:37:04.797021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5eba4fd0-ca3f-4ab0-a1e2-b3e50f2c6e79 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:04.809410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5eba4fd0-ca3f-4ab0-a1e2-b3e50f2c6e79 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] [instance: d80d1086-41d4-449d-ae24-d6172c2602b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:04.830859 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-5eba4fd0-ca3f-4ab0-a1e2-b3e50f2c6e79 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] HTTP exception thrown: Instance d80d1086-41d4-449d-ae24-d6172c2602b4 could not be found. Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5eba4fd0-ca3f-4ab0-a1e2-b3e50f2c6e79 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Request method failure captured: Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/d80d1086-41d4-449d-ae24-d6172c2602b4/metadata HTTP/1.1 Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf87MXHm4NC9peqCWxzLBaaIjHSseP-OeVmk1z0frgYlVy9TxgVitCZSJABPyV71SFWQ2ytxMRXy6zS_PtKpBO7Hy3KXK20wkGbfthpU8B8HrHWnMb-oamRiM23iande1j5OMMj21ZMTzWYfYwXitPa9QpEAaeVRjLXZhq_evXASEC4 Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: ce61197b6e1c4a27b36a4774ea2e89c3 Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2130520497 Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ce61197b6e1c4a27b36a4774ea2e89c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_ce61197b6e1c4a27b36a4774ea2e89c3", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ce61197b6e1c4a27b36a4774ea2e89c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/ce61197b6e1c4a27b36a4774ea2e89c3"}]}] Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2130520497 Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: ce61197b6e1c4a27b36a4774ea2e89c3 Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2130520497 Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerMetadataNegativeTestJSON-2130520497-project Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 0b4be32dd307497dae1e5fa2dbb76e71 Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2130520497-project Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance d80d1086-41d4-449d-ae24-d6172c2602b4 could not be found. Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'server_id': 'd80d1086-41d4-449d-ae24-d6172c2602b4'} Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d80d1086-41d4-449d-ae24-d6172c2602b4 could not be found. Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d80d1086-41d4-449d-ae24-d6172c2602b4 could not be found. Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:37:04.852306 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:37:04.857359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:37:04.857359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:37:04.857359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d80d1086-41d4-449d-ae24-d6172c2602b4 could not be found. Aug 24 10:37:04.857359 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:04.857359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5eba4fd0-ca3f-4ab0-a1e2-b3e50f2c6e79 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Returning 404 to user: Instance d80d1086-41d4-449d-ae24-d6172c2602b4 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:37:04.857359 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5eba4fd0-ca3f-4ab0-a1e2-b3e50f2c6e79 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] 10.222.0.85 "GET /compute/v2.1/servers/d80d1086-41d4-449d-ae24-d6172c2602b4/metadata" status: 404 len: 111 microversion: 2.1 time: 0.060870 Aug 24 10:37:04.866263 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2170/4732] 10.222.0.85 () {58 vars in 1263 bytes} [Wed Aug 24 10:37:04 2022] GET /compute/v2.1/servers/d80d1086-41d4-449d-ae24-d6172c2602b4/metadata => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:37:05.021151 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-33c952d7-6755-4ef3-9592-52e65874043d tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-722004910", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "66890c02-aa63-4a1b-a0f0-947d4c116c2a"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-33c952d7-6755-4ef3-9592-52e65874043d tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Request method failure captured: Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 498 Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf87MXHm4NC9peqCWxzLBaaIjHSseP-OeVmk1z0frgYlVy9TxgVitCZSJABPyV71SFWQ2ytxMRXy6zS_PtKpBO7Hy3KXK20wkGbfthpU8B8HrHWnMb-oamRiM23iande1j5OMMj21ZMTzWYfYwXitPa9QpEAaeVRjLXZhq_evXASEC4 Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: ce61197b6e1c4a27b36a4774ea2e89c3 Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2130520497 Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ce61197b6e1c4a27b36a4774ea2e89c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_ce61197b6e1c4a27b36a4774ea2e89c3", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ce61197b6e1c4a27b36a4774ea2e89c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/ce61197b6e1c4a27b36a4774ea2e89c3"}]}] Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2130520497 Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: ce61197b6e1c4a27b36a4774ea2e89c3 Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2130520497 Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerMetadataNegativeTestJSON-2130520497-project Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 0b4be32dd307497dae1e5fa2dbb76e71 Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2130520497-project Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-722004910", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "66890c02-aa63-4a1b-a0f0-947d4c116c2a"}]}} Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-722004910', 'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '66890c02-aa63-4a1b-a0f0-947d4c116c2a'}]}}} Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 24 10:37:05.025788 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 10:37:05.029655 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:05.038614 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-33c952d7-6755-4ef3-9592-52e65874043d tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:37:05.039686 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-33c952d7-6755-4ef3-9592-52e65874043d tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.022848 Aug 24 10:37:05.050359 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2171/4733] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:37:05 2022] POST /compute/v2.1/servers => generated 687 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:37:05.121989 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e81171ef-425e-42b5-948c-c7f0ba8e5d2e req-178f4a85-6653-4677-9415-9a0f8cefa1fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9", "name": "network-vif-plugged", "status": "completed", "tag": "49282a09-9feb-4209-89fa-dde9cf343ed1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:05.149629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e81171ef-425e-42b5-948c-c7f0ba8e5d2e req-178f4a85-6653-4677-9415-9a0f8cefa1fe service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:05.150128 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e81171ef-425e-42b5-948c-c7f0ba8e5d2e req-178f4a85-6653-4677-9415-9a0f8cefa1fe service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:05.150569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e81171ef-425e-42b5-948c-c7f0ba8e5d2e req-178f4a85-6653-4677-9415-9a0f8cefa1fe service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:05.173169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0601d557-70b5-499d-96f8-0a7022fc970d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:05.176381 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e81171ef-425e-42b5-948c-c7f0ba8e5d2e req-178f4a85-6653-4677-9415-9a0f8cefa1fe service nova] Creating event network-vif-plugged:49282a09-9feb-4209-89fa-dde9cf343ed1 for instance 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 on n-h1-849328-3 Aug 24 10:37:05.185093 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0601d557-70b5-499d-96f8-0a7022fc970d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.488430 Aug 24 10:37:05.190167 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2563/4734] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:04 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:05.192478 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e81171ef-425e-42b5-948c-c7f0ba8e5d2e req-178f4a85-6653-4677-9415-9a0f8cefa1fe service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075550 Aug 24 10:37:05.193095 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2172/4735] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:37:05.217017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4014c507-dd31-4f93-8c4d-47d1ddf7cf5e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:05.217824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4014c507-dd31-4f93-8c4d-47d1ddf7cf5e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:05.242619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4014c507-dd31-4f93-8c4d-47d1ddf7cf5e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:05.244196 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4014c507-dd31-4f93-8c4d-47d1ddf7cf5e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:05.245318 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4014c507-dd31-4f93-8c4d-47d1ddf7cf5e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:05.246290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4014c507-dd31-4f93-8c4d-47d1ddf7cf5e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:05.246925 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4014c507-dd31-4f93-8c4d-47d1ddf7cf5e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:05.247607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4014c507-dd31-4f93-8c4d-47d1ddf7cf5e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:05.313517 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:05.335500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4014c507-dd31-4f93-8c4d-47d1ddf7cf5e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Locking {{(pid=122433) lock /opt/stack/nova/nova/compute/api.py:4828}} Aug 24 10:37:05.476767 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4014c507-dd31-4f93-8c4d-47d1ddf7cf5e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action" status: 202 len: 0 microversion: 2.1 time: 0.265332 Aug 24 10:37:05.480902 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2564/4736] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:37:05 2022] POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:37:05.488228 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d1af5f21-9b64-405c-8a9a-b1c12977a75a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:05.488999 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d1af5f21-9b64-405c-8a9a-b1c12977a75a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:05.506450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1af5f21-9b64-405c-8a9a-b1c12977a75a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:05.509708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1af5f21-9b64-405c-8a9a-b1c12977a75a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:05.517449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1af5f21-9b64-405c-8a9a-b1c12977a75a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:05.519256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1af5f21-9b64-405c-8a9a-b1c12977a75a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:05.521503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1af5f21-9b64-405c-8a9a-b1c12977a75a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:05.522566 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1af5f21-9b64-405c-8a9a-b1c12977a75a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:05.581981 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-abd56655-a860-4121-9ea1-78b6226cbabb tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1172990387", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "66890c02-aa63-4a1b-a0f0-947d4c116c2a"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-abd56655-a860-4121-9ea1-78b6226cbabb tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Request method failure captured: Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 500 Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf87MXHm4NC9peqCWxzLBaaIjHSseP-OeVmk1z0frgYlVy9TxgVitCZSJABPyV71SFWQ2ytxMRXy6zS_PtKpBO7Hy3KXK20wkGbfthpU8B8HrHWnMb-oamRiM23iande1j5OMMj21ZMTzWYfYwXitPa9QpEAaeVRjLXZhq_evXASEC4 Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: ce61197b6e1c4a27b36a4774ea2e89c3 Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2130520497 Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ce61197b6e1c4a27b36a4774ea2e89c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_ce61197b6e1c4a27b36a4774ea2e89c3", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ce61197b6e1c4a27b36a4774ea2e89c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/ce61197b6e1c4a27b36a4774ea2e89c3"}]}] Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2130520497 Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: ce61197b6e1c4a27b36a4774ea2e89c3 Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2130520497 Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerMetadataNegativeTestJSON-2130520497-project Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 0b4be32dd307497dae1e5fa2dbb76e71 Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2130520497-project Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1172990387", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "66890c02-aa63-4a1b-a0f0-947d4c116c2a"}]}} Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1172990387', 'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '66890c02-aa63-4a1b-a0f0-947d4c116c2a'}]}}} Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 24 10:37:05.587018 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 10:37:05.591524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:05.595016 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-abd56655-a860-4121-9ea1-78b6226cbabb tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:37:05.596047 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-abd56655-a860-4121-9ea1-78b6226cbabb tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.025469 Aug 24 10:37:05.597189 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2565/4737] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:37:05 2022] POST /compute/v2.1/servers => generated 689 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 10:37:05.621814 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-776e95b7-f8dc-48ab-a422-f1d400ff0b10 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:05.622839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-776e95b7-f8dc-48ab-a422-f1d400ff0b10 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:05.635487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-776e95b7-f8dc-48ab-a422-f1d400ff0b10 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:05.644923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-776e95b7-f8dc-48ab-a422-f1d400ff0b10 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:05.645751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-776e95b7-f8dc-48ab-a422-f1d400ff0b10 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:05.646725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-776e95b7-f8dc-48ab-a422-f1d400ff0b10 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:05.647522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-776e95b7-f8dc-48ab-a422-f1d400ff0b10 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:05.648152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-776e95b7-f8dc-48ab-a422-f1d400ff0b10 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:05.911450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-776e95b7-f8dc-48ab-a422-f1d400ff0b10 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:05.932744 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-776e95b7-f8dc-48ab-a422-f1d400ff0b10 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9" status: 200 len: 1292 microversion: 2.1 time: 0.315380 Aug 24 10:37:05.935920 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2566/4738] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:05 2022] GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 => generated 1292 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:37:05.950475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-46aa5f8b-cd3a-4b2a-b6da-38c924a382ce tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-809392428", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "66890c02-aa63-4a1b-a0f0-947d4c116c2a"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-46aa5f8b-cd3a-4b2a-b6da-38c924a382ce tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Request method failure captured: Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 753 Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf87MXHm4NC9peqCWxzLBaaIjHSseP-OeVmk1z0frgYlVy9TxgVitCZSJABPyV71SFWQ2ytxMRXy6zS_PtKpBO7Hy3KXK20wkGbfthpU8B8HrHWnMb-oamRiM23iande1j5OMMj21ZMTzWYfYwXitPa9QpEAaeVRjLXZhq_evXASEC4 Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: ce61197b6e1c4a27b36a4774ea2e89c3 Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2130520497 Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ce61197b6e1c4a27b36a4774ea2e89c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_ce61197b6e1c4a27b36a4774ea2e89c3", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ce61197b6e1c4a27b36a4774ea2e89c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/ce61197b6e1c4a27b36a4774ea2e89c3"}]}] Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2130520497 Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: ce61197b6e1c4a27b36a4774ea2e89c3 Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2130520497 Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerMetadataNegativeTestJSON-2130520497-project Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 0b4be32dd307497dae1e5fa2dbb76e71 Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2130520497-project Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-809392428", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "66890c02-aa63-4a1b-a0f0-947d4c116c2a"}]}} Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-809392428', 'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '66890c02-aa63-4a1b-a0f0-947d4c116c2a'}]}}} Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:37:05.960716 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:37:05.964041 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:37:05.976385 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 10:37:05.976385 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:05.976385 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-46aa5f8b-cd3a-4b2a-b6da-38c924a382ce tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:37:05.976385 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-46aa5f8b-cd3a-4b2a-b6da-38c924a382ce tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.029070 Aug 24 10:37:05.976385 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2567/4739] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:37:05 2022] POST /compute/v2.1/servers => generated 1197 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 24 10:37:06.083886 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d1af5f21-9b64-405c-8a9a-b1c12977a75a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:06.095695 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d1af5f21-9b64-405c-8a9a-b1c12977a75a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.613510 Aug 24 10:37:06.096898 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2173/4740] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:05 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:37:06.118934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d92b681f-066b-42a1-98b6-a06fc0dff496 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:06.133364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d92b681f-066b-42a1-98b6-a06fc0dff496 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:06.133884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d92b681f-066b-42a1-98b6-a06fc0dff496 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:06.135455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d92b681f-066b-42a1-98b6-a06fc0dff496 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:06.207560 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-abd95b3e-f926-4044-99cd-75f680d2ee3e tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-525182357", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "66890c02-aa63-4a1b-a0f0-947d4c116c2a"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-abd95b3e-f926-4044-99cd-75f680d2ee3e tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Request method failure captured: Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 1265 Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf87MXHm4NC9peqCWxzLBaaIjHSseP-OeVmk1z0frgYlVy9TxgVitCZSJABPyV71SFWQ2ytxMRXy6zS_PtKpBO7Hy3KXK20wkGbfthpU8B8HrHWnMb-oamRiM23iande1j5OMMj21ZMTzWYfYwXitPa9QpEAaeVRjLXZhq_evXASEC4 Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: ce61197b6e1c4a27b36a4774ea2e89c3 Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2130520497 Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ce61197b6e1c4a27b36a4774ea2e89c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_ce61197b6e1c4a27b36a4774ea2e89c3", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ce61197b6e1c4a27b36a4774ea2e89c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/ce61197b6e1c4a27b36a4774ea2e89c3"}]}] Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2130520497 Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: ce61197b6e1c4a27b36a4774ea2e89c3 Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2130520497 Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerMetadataNegativeTestJSON-2130520497-project Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 0b4be32dd307497dae1e5fa2dbb76e71 Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2130520497-project Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-525182357", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "66890c02-aa63-4a1b-a0f0-947d4c116c2a"}]}} Aug 24 10:37:06.217662 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:37:06.220291 n-d-849328-3 devstack@n-api.service[122432]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 10:37:06.220291 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-525182357', 'imageRef': '0a9df326-dcca-498d-8d8a-b320e539a1af', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '66890c02-aa63-4a1b-a0f0-947d4c116c2a'}]}}} Aug 24 10:37:06.220291 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:37:06.220291 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:06.220291 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:37:06.220291 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:37:06.220291 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:37:06.220291 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:37:06.220291 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 10:37:06.220291 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:06.220291 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 24 10:37:06.220291 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 24 10:37:06.220291 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 24 10:37:06.220291 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 24 10:37:06.220291 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 24 10:37:06.220291 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:06.220291 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 10:37:06.221628 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 24 10:37:06.221628 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:06.221628 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:37:06.221628 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:06.221628 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:06.221628 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:37:06.221628 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:37:06.221628 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:37:06.221628 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:37:06.221628 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:37:06.221628 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:37:06.221628 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:37:06.221628 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:37:06.221628 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:37:06.221628 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:37:06.221628 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:37:06.221628 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:37:06.221628 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:37:06.221628 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:37:06.221628 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 10:37:06.221628 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:06.221628 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:37:06.221628 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:06.221628 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:06.221628 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:37:06.221628 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:37:06.221628 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:37:06.221628 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:37:06.223658 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 10:37:06.223658 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:06.226266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-abd95b3e-f926-4044-99cd-75f680d2ee3e tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:37:06.227489 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-abd95b3e-f926-4044-99cd-75f680d2ee3e tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.026665 Aug 24 10:37:06.228889 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-d92b681f-066b-42a1-98b6-a06fc0dff496 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] HTTP exception thrown: Instance 99ed6211-b7fc-454f-a8e9-73ba571a71af is locked Aug 24 10:37:06.234079 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2174/4741] 10.222.0.85 () {60 vars in 1148 bytes} [Wed Aug 24 10:37:06 2022] POST /compute/v2.1/servers => generated 2221 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d92b681f-066b-42a1-98b6-a06fc0dff496 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Request method failure captured: Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action HTTP/1.1 Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 15 Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf4TQ-ANQmryHMcmh9mjA8auVh1UVU40Ptyqc8C7SVEqbwoTaJhYRV2L-5dPBBr1S5HtWMawW3k8YGb_tKrCiEye7fzruwlhEHHLdof87q4HL1nmhzukhg_36RvG00tLOGcZO9HQ1UY-3nEC3lK5bXyxvHMgEJdlWvWiw7WTxDs1y50 Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 3d511560c1f543169e7eab8c70c9abcd Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerActionsTestJSON-1329836544 Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3d511560c1f543169e7eab8c70c9abcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3d511560c1f543169e7eab8c70c9abcd", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3d511560c1f543169e7eab8c70c9abcd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3d511560c1f543169e7eab8c70c9abcd"}]}] Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerActionsTestJSON-1329836544 Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 3d511560c1f543169e7eab8c70c9abcd Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerActionsTestJSON-1329836544 Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerActionsTestJSON-1329836544-project Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 03ef6a33c1f0467993486547b7d00fda Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerActionsTestJSON-1329836544-project Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: {"os-stop": {}} Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 99ed6211-b7fc-454f-a8e9-73ba571a71af is locked Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '99ed6211-b7fc-454f-a8e9-73ba571a71af', 'body': {'os-stop': {}}} Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 99ed6211-b7fc-454f-a8e9-73ba571a71af is locked Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 99ed6211-b7fc-454f-a8e9-73ba571a71af is locked Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99ed6211-b7fc-454f-a8e9-73ba571a71af is locked Aug 24 10:37:06.238524 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:06.247520 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d92b681f-066b-42a1-98b6-a06fc0dff496 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Returning 409 to user: Instance 99ed6211-b7fc-454f-a8e9-73ba571a71af is locked {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:37:06.247520 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d92b681f-066b-42a1-98b6-a06fc0dff496 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action" status: 409 len: 107 microversion: 2.1 time: 0.124921 Aug 24 10:37:06.247520 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2568/4742] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:37:06 2022] POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action => generated 107 bytes in 128 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:37:06.249227 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-de5d84de-2746-430f-b179-a37d19b4051f tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:06.249790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-de5d84de-2746-430f-b179-a37d19b4051f tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] [instance: 0287df6e-cd3e-4ec3-86eb-14a7f8181fdb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:06.253024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-772f57d7-7d19-4bee-baa4-d638decab9ba tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:06.254344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-772f57d7-7d19-4bee-baa4-d638decab9ba tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:06.263181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-772f57d7-7d19-4bee-baa4-d638decab9ba tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:06.263926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-772f57d7-7d19-4bee-baa4-d638decab9ba tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:06.264566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-772f57d7-7d19-4bee-baa4-d638decab9ba tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:06.266787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-772f57d7-7d19-4bee-baa4-d638decab9ba tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:06.268100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-772f57d7-7d19-4bee-baa4-d638decab9ba tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:06.268771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-772f57d7-7d19-4bee-baa4-d638decab9ba tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:06.273414 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-de5d84de-2746-430f-b179-a37d19b4051f tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] HTTP exception thrown: Instance 0287df6e-cd3e-4ec3-86eb-14a7f8181fdb could not be found. Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-de5d84de-2746-430f-b179-a37d19b4051f tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Request method failure captured: Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/0287df6e-cd3e-4ec3-86eb-14a7f8181fdb/metadata/test2 HTTP/1.1 Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf87MXHm4NC9peqCWxzLBaaIjHSseP-OeVmk1z0frgYlVy9TxgVitCZSJABPyV71SFWQ2ytxMRXy6zS_PtKpBO7Hy3KXK20wkGbfthpU8B8HrHWnMb-oamRiM23iande1j5OMMj21ZMTzWYfYwXitPa9QpEAaeVRjLXZhq_evXASEC4 Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: ce61197b6e1c4a27b36a4774ea2e89c3 Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2130520497 Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ce61197b6e1c4a27b36a4774ea2e89c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_ce61197b6e1c4a27b36a4774ea2e89c3", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ce61197b6e1c4a27b36a4774ea2e89c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/ce61197b6e1c4a27b36a4774ea2e89c3"}]}] Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2130520497 Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: ce61197b6e1c4a27b36a4774ea2e89c3 Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2130520497 Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerMetadataNegativeTestJSON-2130520497-project Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 0b4be32dd307497dae1e5fa2dbb76e71 Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2130520497-project Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 0287df6e-cd3e-4ec3-86eb-14a7f8181fdb could not be found. Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'server_id': '0287df6e-cd3e-4ec3-86eb-14a7f8181fdb', 'id': 'test2'} Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0287df6e-cd3e-4ec3-86eb-14a7f8181fdb could not be found. Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0287df6e-cd3e-4ec3-86eb-14a7f8181fdb could not be found. Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:37:06.275480 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:37:06.280812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:37:06.280812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:37:06.280812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0287df6e-cd3e-4ec3-86eb-14a7f8181fdb could not be found. Aug 24 10:37:06.280812 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:06.287358 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-de5d84de-2746-430f-b179-a37d19b4051f tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Returning 404 to user: Instance 0287df6e-cd3e-4ec3-86eb-14a7f8181fdb could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:37:06.288706 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-de5d84de-2746-430f-b179-a37d19b4051f tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] 10.222.0.85 "GET /compute/v2.1/servers/0287df6e-cd3e-4ec3-86eb-14a7f8181fdb/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.053164 Aug 24 10:37:06.298259 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2175/4743] 10.222.0.85 () {58 vars in 1281 bytes} [Wed Aug 24 10:37:06 2022] GET /compute/v2.1/servers/0287df6e-cd3e-4ec3-86eb-14a7f8181fdb/metadata/test2 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:37:06.315272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-15e6c9b6-7b1d-4d97-b006-152b6ad754c0 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:06.318514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-15e6c9b6-7b1d-4d97-b006-152b6ad754c0 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] [instance: af079278-7264-43d0-975e-1fcd1f5c731a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:06.326736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15e6c9b6-7b1d-4d97-b006-152b6ad754c0 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:06.327236 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15e6c9b6-7b1d-4d97-b006-152b6ad754c0 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:06.327667 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15e6c9b6-7b1d-4d97-b006-152b6ad754c0 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:06.328810 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15e6c9b6-7b1d-4d97-b006-152b6ad754c0 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:06.329533 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15e6c9b6-7b1d-4d97-b006-152b6ad754c0 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:06.330195 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15e6c9b6-7b1d-4d97-b006-152b6ad754c0 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:06.371763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-15e6c9b6-7b1d-4d97-b006-152b6ad754c0 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] [instance: af079278-7264-43d0-975e-1fcd1f5c731a] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:37:06.402803 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-772f57d7-7d19-4bee-baa4-d638decab9ba tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Unlocking {{(pid=122433) unlock /opt/stack/nova/nova/compute/api.py:4857}} Aug 24 10:37:06.528949 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-772f57d7-7d19-4bee-baa4-d638decab9ba tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action" status: 202 len: 0 microversion: 2.1 time: 0.281995 Aug 24 10:37:06.530412 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2569/4744] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:37:06 2022] POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:37:06.540151 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-528f0f21-3543-4434-b256-030760128952 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:06.543824 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-15e6c9b6-7b1d-4d97-b006-152b6ad754c0 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] 10.222.0.85 "DELETE /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a" status: 204 len: 0 microversion: 2.1 time: 0.235273 Aug 24 10:37:06.546228 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2176/4745] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:37:06 2022] DELETE /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:37:06.562822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-528f0f21-3543-4434-b256-030760128952 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:06.563912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-528f0f21-3543-4434-b256-030760128952 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:06.565431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-528f0f21-3543-4434-b256-030760128952 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:06.577228 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-da69b575-82e9-43ac-81da-216d3485b10a tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:06.578417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-da69b575-82e9-43ac-81da-216d3485b10a tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] [instance: af079278-7264-43d0-975e-1fcd1f5c731a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:06.589202 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da69b575-82e9-43ac-81da-216d3485b10a tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:06.590566 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da69b575-82e9-43ac-81da-216d3485b10a tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:06.591995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da69b575-82e9-43ac-81da-216d3485b10a tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:06.593157 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da69b575-82e9-43ac-81da-216d3485b10a tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:06.593872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da69b575-82e9-43ac-81da-216d3485b10a tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:06.594837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da69b575-82e9-43ac-81da-216d3485b10a tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:06.632037 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-528f0f21-3543-4434-b256-030760128952 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Going to try to stop instance {{(pid=122433) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 10:37:06.757785 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-528f0f21-3543-4434-b256-030760128952 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action" status: 202 len: 0 microversion: 2.1 time: 0.221538 Aug 24 10:37:06.765082 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2570/4746] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:37:06 2022] POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:37:06.812610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f37e6e13-1208-41c5-8e2e-2a530c7d5bc6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:06.814606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f37e6e13-1208-41c5-8e2e-2a530c7d5bc6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:06.835364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f37e6e13-1208-41c5-8e2e-2a530c7d5bc6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:06.835625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f37e6e13-1208-41c5-8e2e-2a530c7d5bc6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:06.836261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f37e6e13-1208-41c5-8e2e-2a530c7d5bc6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:06.841319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f37e6e13-1208-41c5-8e2e-2a530c7d5bc6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:06.845378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f37e6e13-1208-41c5-8e2e-2a530c7d5bc6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:06.846068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f37e6e13-1208-41c5-8e2e-2a530c7d5bc6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:06.993388 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-da69b575-82e9-43ac-81da-216d3485b10a tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4be32dd307497dae1e5fa2dbb76e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce61197b6e1c4a27b36a4774ea2e89c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:07.011329 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-da69b575-82e9-43ac-81da-216d3485b10a tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] 10.222.0.85 "GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a" status: 200 len: 1527 microversion: 2.1 time: 0.455057 Aug 24 10:37:07.027888 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2177/4747] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:06 2022] GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a => generated 1527 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:07.041172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-da69b575-82e9-43ac-81da-216d3485b10a tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:07.046301 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-da69b575-82e9-43ac-81da-216d3485b10a tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] 10.222.0.85 "GET /compute//" status: 200 len: 377 microversion: - time: 0.015722 Aug 24 10:37:07.073071 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2178/4748] 10.222.0.85 () {56 vars in 886 bytes} [Wed Aug 24 10:37:07 2022] GET /compute/ => generated 377 bytes in 38 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 24 10:37:07.091782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6fc39537-6927-437e-9b20-86f60b581c81 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:07.094165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6fc39537-6927-437e-9b20-86f60b581c81 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:07.107434 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6fc39537-6927-437e-9b20-86f60b581c81 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:07.108689 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6fc39537-6927-437e-9b20-86f60b581c81 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:07.109816 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6fc39537-6927-437e-9b20-86f60b581c81 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:07.112060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6fc39537-6927-437e-9b20-86f60b581c81 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:07.113247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6fc39537-6927-437e-9b20-86f60b581c81 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:07.114810 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6fc39537-6927-437e-9b20-86f60b581c81 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:07.229192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f37e6e13-1208-41c5-8e2e-2a530c7d5bc6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:07.245448 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f37e6e13-1208-41c5-8e2e-2a530c7d5bc6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1679 microversion: 2.1 time: 0.464179 Aug 24 10:37:07.246426 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2571/4749] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:06 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1679 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:07.515164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6fc39537-6927-437e-9b20-86f60b581c81 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:07.527844 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6fc39537-6927-437e-9b20-86f60b581c81 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9" status: 200 len: 1472 microversion: 2.1 time: 0.452700 Aug 24 10:37:07.534719 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2179/4750] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:07 2022] GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 => generated 1472 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:07.929340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1e8bcea0-7c1f-4457-b055-4a1af2fdea9e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1328307330", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:08.058776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d3e02e7c-43dc-4443-9349-a7274fc072dc tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:08.063563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d3e02e7c-43dc-4443-9349-a7274fc072dc tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] [instance: af079278-7264-43d0-975e-1fcd1f5c731a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:08.070352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-1e8bcea0-7c1f-4457-b055-4a1af2fdea9e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] validate_networks() for [('444806fc-9684-467f-82d3-8ae5206eec37', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:37:08.097914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3e02e7c-43dc-4443-9349-a7274fc072dc tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:08.098807 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3e02e7c-43dc-4443-9349-a7274fc072dc tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:08.105980 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3e02e7c-43dc-4443-9349-a7274fc072dc tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:08.109647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3e02e7c-43dc-4443-9349-a7274fc072dc tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:08.110509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3e02e7c-43dc-4443-9349-a7274fc072dc tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:08.112794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3e02e7c-43dc-4443-9349-a7274fc072dc tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:08.728112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d3e02e7c-43dc-4443-9349-a7274fc072dc tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4be32dd307497dae1e5fa2dbb76e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce61197b6e1c4a27b36a4774ea2e89c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:08.753447 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d3e02e7c-43dc-4443-9349-a7274fc072dc tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] 10.222.0.85 "GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a" status: 200 len: 1527 microversion: 2.1 time: 0.698245 Aug 24 10:37:08.753947 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2180/4751] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:08 2022] GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a => generated 1527 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:08.776776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c0e413a8-b42f-4ce4-b405-6c90043f03f5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:08.777619 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c0e413a8-b42f-4ce4-b405-6c90043f03f5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:08.813071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0e413a8-b42f-4ce4-b405-6c90043f03f5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:08.813619 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0e413a8-b42f-4ce4-b405-6c90043f03f5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:08.814060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0e413a8-b42f-4ce4-b405-6c90043f03f5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:08.814779 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0e413a8-b42f-4ce4-b405-6c90043f03f5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:08.815234 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0e413a8-b42f-4ce4-b405-6c90043f03f5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:08.815657 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0e413a8-b42f-4ce4-b405-6c90043f03f5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:09.127300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c0e413a8-b42f-4ce4-b405-6c90043f03f5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:09.150662 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c0e413a8-b42f-4ce4-b405-6c90043f03f5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1679 microversion: 2.1 time: 0.372090 Aug 24 10:37:09.152663 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2181/4752] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:08 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1679 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:09.775165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9fe6e89e-3f68-48b5-ab17-fdd8ae2f57d1 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:09.775784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9fe6e89e-3f68-48b5-ab17-fdd8ae2f57d1 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] [instance: af079278-7264-43d0-975e-1fcd1f5c731a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:09.784277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fe6e89e-3f68-48b5-ab17-fdd8ae2f57d1 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:09.798057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fe6e89e-3f68-48b5-ab17-fdd8ae2f57d1 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:09.804656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fe6e89e-3f68-48b5-ab17-fdd8ae2f57d1 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:09.805909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fe6e89e-3f68-48b5-ab17-fdd8ae2f57d1 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:09.807409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fe6e89e-3f68-48b5-ab17-fdd8ae2f57d1 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:09.809785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fe6e89e-3f68-48b5-ab17-fdd8ae2f57d1 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:10.247063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-1e8bcea0-7c1f-4457-b055-4a1af2fdea9e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:37:10.247627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-1e8bcea0-7c1f-4457-b055-4a1af2fdea9e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:37:10.248088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-1e8bcea0-7c1f-4457-b055-4a1af2fdea9e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:37:10.248502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-1e8bcea0-7c1f-4457-b055-4a1af2fdea9e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:37:10.248933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-1e8bcea0-7c1f-4457-b055-4a1af2fdea9e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:37:10.262542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e8bcea0-7c1f-4457-b055-4a1af2fdea9e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:10.263553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e8bcea0-7c1f-4457-b055-4a1af2fdea9e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:10.264268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e8bcea0-7c1f-4457-b055-4a1af2fdea9e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:10.265994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e8bcea0-7c1f-4457-b055-4a1af2fdea9e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:10.266634 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e8bcea0-7c1f-4457-b055-4a1af2fdea9e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:10.267250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e8bcea0-7c1f-4457-b055-4a1af2fdea9e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:10.318810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-1e8bcea0-7c1f-4457-b055-4a1af2fdea9e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Getting quotas for project 8b489eabb0014ddc9a2fcdf6e78ee740. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:37:10.332262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-1e8bcea0-7c1f-4457-b055-4a1af2fdea9e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Getting quotas for user 83a25a0677c04f8ba975528ece80d676 and project 8b489eabb0014ddc9a2fcdf6e78ee740. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:37:10.376098 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1e8bcea0-7c1f-4457-b055-4a1af2fdea9e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:37:10.383562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1e8bcea0-7c1f-4457-b055-4a1af2fdea9e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: c30d0317-0b22-4856-8188-5e5dbdfcd936] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:37:10.595792 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1e8bcea0-7c1f-4457-b055-4a1af2fdea9e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.676265 Aug 24 10:37:10.597230 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2572/4753] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:37:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:37:10.605527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2e55f5a9-59af-4816-b1ad-5da9c3cc1a85 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:10.606449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2e55f5a9-59af-4816-b1ad-5da9c3cc1a85 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:10.615080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e55f5a9-59af-4816-b1ad-5da9c3cc1a85 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:10.615804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e55f5a9-59af-4816-b1ad-5da9c3cc1a85 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:10.616812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e55f5a9-59af-4816-b1ad-5da9c3cc1a85 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:10.617780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e55f5a9-59af-4816-b1ad-5da9c3cc1a85 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:10.635286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e55f5a9-59af-4816-b1ad-5da9c3cc1a85 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:10.636314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e55f5a9-59af-4816-b1ad-5da9c3cc1a85 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:11.088098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9fe6e89e-3f68-48b5-ab17-fdd8ae2f57d1 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4be32dd307497dae1e5fa2dbb76e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce61197b6e1c4a27b36a4774ea2e89c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:11.099321 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9fe6e89e-3f68-48b5-ab17-fdd8ae2f57d1 tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] 10.222.0.85 "GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a" status: 200 len: 1527 microversion: 2.1 time: 1.327931 Aug 24 10:37:11.100714 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2182/4754] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:09 2022] GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a => generated 1527 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:11.107175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-87696e7b-0aed-4abd-8368-3492fee024c1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:11.107943 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-87696e7b-0aed-4abd-8368-3492fee024c1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: c30d0317-0b22-4856-8188-5e5dbdfcd936] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:11.205018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-87696e7b-0aed-4abd-8368-3492fee024c1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: c30d0317-0b22-4856-8188-5e5dbdfcd936] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:37:11.661686 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2e55f5a9-59af-4816-b1ad-5da9c3cc1a85 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:11.675656 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2e55f5a9-59af-4816-b1ad-5da9c3cc1a85 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1679 microversion: 2.1 time: 1.075468 Aug 24 10:37:11.676221 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2573/4755] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:10 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1679 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:11.696353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-5f6c8db3-d90e-411a-8bff-2bd6d74983ce req-660fed1f-e45d-4700-93b6-0c036e11c997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af079278-7264-43d0-975e-1fcd1f5c731a", "name": "network-vif-deleted", "tag": "c2d5f602-b2e5-4a1e-a873-4707953f89af"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:11.732078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5f6c8db3-d90e-411a-8bff-2bd6d74983ce req-660fed1f-e45d-4700-93b6-0c036e11c997 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:11.732363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5f6c8db3-d90e-411a-8bff-2bd6d74983ce req-660fed1f-e45d-4700-93b6-0c036e11c997 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:11.732810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5f6c8db3-d90e-411a-8bff-2bd6d74983ce req-660fed1f-e45d-4700-93b6-0c036e11c997 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:11.787159 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-5f6c8db3-d90e-411a-8bff-2bd6d74983ce req-660fed1f-e45d-4700-93b6-0c036e11c997 service nova] Creating event network-vif-deleted:c2d5f602-b2e5-4a1e-a873-4707953f89af for instance af079278-7264-43d0-975e-1fcd1f5c731a on n-h2-849328-3 Aug 24 10:37:11.805236 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-5f6c8db3-d90e-411a-8bff-2bd6d74983ce req-660fed1f-e45d-4700-93b6-0c036e11c997 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122749 Aug 24 10:37:11.805893 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2574/4756] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:37:11.996717 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-87696e7b-0aed-4abd-8368-3492fee024c1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "DELETE /compute/v2.1/servers/c30d0317-0b22-4856-8188-5e5dbdfcd936" status: 204 len: 0 microversion: 2.1 time: 0.893459 Aug 24 10:37:11.997765 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2183/4757] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:37:11 2022] DELETE /compute/v2.1/servers/c30d0317-0b22-4856-8188-5e5dbdfcd936 => generated 0 bytes in 896 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:37:12.021603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-be0ef5cc-1a8b-4279-b6a7-41fdc7751083 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:12.023193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-be0ef5cc-1a8b-4279-b6a7-41fdc7751083 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: c30d0317-0b22-4856-8188-5e5dbdfcd936] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:12.113289 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-be0ef5cc-1a8b-4279-b6a7-41fdc7751083 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] HTTP exception thrown: Instance c30d0317-0b22-4856-8188-5e5dbdfcd936 could not be found. Aug 24 10:37:12.122361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8445fd44-d976-4607-bafc-30309834cc0c tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:12.123624 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8445fd44-d976-4607-bafc-30309834cc0c tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] [instance: af079278-7264-43d0-975e-1fcd1f5c731a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:12.143858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8445fd44-d976-4607-bafc-30309834cc0c tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:12.146032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8445fd44-d976-4607-bafc-30309834cc0c tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:12.147908 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8445fd44-d976-4607-bafc-30309834cc0c tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:12.149086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8445fd44-d976-4607-bafc-30309834cc0c tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-be0ef5cc-1a8b-4279-b6a7-41fdc7751083 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Request method failure captured: Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/c30d0317-0b22-4856-8188-5e5dbdfcd936 HTTP/1.1 Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf8_-svoJ82Zcz3LMtRJH-LxEmi7YhL3SyNjhBkMMhmGqnW0J0hM18TP4MYYa3JryjRkfD6MJWxRrI1tc6yKAxu9hD6H4E3SSBMepuWzyz5efbHaNXS1nRaEb6aE-x3oa0iXQadiBh1CoF_uoY7wN-kywJAG1lWDamBR5UsabCRziuM Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersTestJSON-523633018 Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8b489eabb0014ddc9a2fcdf6e78ee740", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8b489eabb0014ddc9a2fcdf6e78ee740"}]}] Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersTestJSON-523633018 Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersTestJSON-523633018 Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersTestJSON-523633018-project Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 83a25a0677c04f8ba975528ece80d676 Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersTestJSON-523633018-project Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance c30d0317-0b22-4856-8188-5e5dbdfcd936 could not be found. Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'c30d0317-0b22-4856-8188-5e5dbdfcd936'} Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2919, in _get_instance Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance c30d0317-0b22-4856-8188-5e5dbdfcd936 Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2931, in _get_instance Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c30d0317-0b22-4856-8188-5e5dbdfcd936 could not be found. Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:37:12.150798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:37:12.157838 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:37:12.157838 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:37:12.157838 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:37:12.157838 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:37:12.157838 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:37:12.157838 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:37:12.157838 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:37:12.157838 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:37:12.157838 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:37:12.157838 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:37:12.157838 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c30d0317-0b22-4856-8188-5e5dbdfcd936 could not be found. Aug 24 10:37:12.157838 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:12.157838 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:37:12.157838 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:12.157838 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:12.157838 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:37:12.157838 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:37:12.157838 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:37:12.157838 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:37:12.157838 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c30d0317-0b22-4856-8188-5e5dbdfcd936 could not be found. Aug 24 10:37:12.157838 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:12.157838 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-be0ef5cc-1a8b-4279-b6a7-41fdc7751083 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Returning 404 to user: Instance c30d0317-0b22-4856-8188-5e5dbdfcd936 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:37:12.157838 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-be0ef5cc-1a8b-4279-b6a7-41fdc7751083 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/c30d0317-0b22-4856-8188-5e5dbdfcd936" status: 404 len: 111 microversion: 2.1 time: 0.151667 Aug 24 10:37:12.174161 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2575/4758] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:12 2022] GET /compute/v2.1/servers/c30d0317-0b22-4856-8188-5e5dbdfcd936 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:37:12.180477 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8445fd44-d976-4607-bafc-30309834cc0c tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:12.181795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8445fd44-d976-4607-bafc-30309834cc0c tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:12.303516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8445fd44-d976-4607-bafc-30309834cc0c tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:12.304460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8445fd44-d976-4607-bafc-30309834cc0c tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:12.305426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8445fd44-d976-4607-bafc-30309834cc0c tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:12.306148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-8445fd44-d976-4607-bafc-30309834cc0c tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lazy-loading 'fault' on Instance uuid af079278-7264-43d0-975e-1fcd1f5c731a {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:37:12.482112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8445fd44-d976-4607-bafc-30309834cc0c tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4be32dd307497dae1e5fa2dbb76e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce61197b6e1c4a27b36a4774ea2e89c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:12.490424 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8445fd44-d976-4607-bafc-30309834cc0c tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] 10.222.0.85 "GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a" status: 200 len: 1314 microversion: 2.1 time: 0.371963 Aug 24 10:37:12.503299 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2184/4759] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:12 2022] GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:12.634464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-873a854c-ce46-4b15-abd2-a290aaf06f62 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-240351805", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "444806fc-9684-467f-82d3-8ae5206eec37"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:12.703007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-10e1d6bd-6208-4f4c-95e0-005ff318684b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:12.703917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-10e1d6bd-6208-4f4c-95e0-005ff318684b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:12.726086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10e1d6bd-6208-4f4c-95e0-005ff318684b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:12.730284 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10e1d6bd-6208-4f4c-95e0-005ff318684b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:12.731147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10e1d6bd-6208-4f4c-95e0-005ff318684b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:12.734471 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10e1d6bd-6208-4f4c-95e0-005ff318684b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:12.736486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10e1d6bd-6208-4f4c-95e0-005ff318684b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:12.738870 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10e1d6bd-6208-4f4c-95e0-005ff318684b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:12.844603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-873a854c-ce46-4b15-abd2-a290aaf06f62 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] validate_networks() for [('444806fc-9684-467f-82d3-8ae5206eec37', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:37:13.190695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-10e1d6bd-6208-4f4c-95e0-005ff318684b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:13.199999 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:13.221921 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-10e1d6bd-6208-4f4c-95e0-005ff318684b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1679 microversion: 2.1 time: 0.512945 Aug 24 10:37:13.237154 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2185/4760] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:12 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1679 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:13.522223 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-69389eab-4694-422b-9840-915537b09e0e tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:13.523292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-69389eab-4694-422b-9840-915537b09e0e tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] [instance: af079278-7264-43d0-975e-1fcd1f5c731a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:13.540883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69389eab-4694-422b-9840-915537b09e0e tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:13.541685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69389eab-4694-422b-9840-915537b09e0e tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:13.544106 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69389eab-4694-422b-9840-915537b09e0e tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:13.547527 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69389eab-4694-422b-9840-915537b09e0e tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:13.548444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69389eab-4694-422b-9840-915537b09e0e tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:13.549051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69389eab-4694-422b-9840-915537b09e0e tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:13.628413 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-69389eab-4694-422b-9840-915537b09e0e tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] HTTP exception thrown: Instance af079278-7264-43d0-975e-1fcd1f5c731a could not be found. Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-69389eab-4694-422b-9840-915537b09e0e tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Request method failure captured: Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a HTTP/1.1 Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf87MXHm4NC9peqCWxzLBaaIjHSseP-OeVmk1z0frgYlVy9TxgVitCZSJABPyV71SFWQ2ytxMRXy6zS_PtKpBO7Hy3KXK20wkGbfthpU8B8HrHWnMb-oamRiM23iande1j5OMMj21ZMTzWYfYwXitPa9QpEAaeVRjLXZhq_evXASEC4 Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: ce61197b6e1c4a27b36a4774ea2e89c3 Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2130520497 Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ce61197b6e1c4a27b36a4774ea2e89c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_ce61197b6e1c4a27b36a4774ea2e89c3", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/ce61197b6e1c4a27b36a4774ea2e89c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/ce61197b6e1c4a27b36a4774ea2e89c3"}]}] Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2130520497 Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: ce61197b6e1c4a27b36a4774ea2e89c3 Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2130520497 Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerMetadataNegativeTestJSON-2130520497-project Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 0b4be32dd307497dae1e5fa2dbb76e71 Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2130520497-project Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance af079278-7264-43d0-975e-1fcd1f5c731a could not be found. Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'af079278-7264-43d0-975e-1fcd1f5c731a'} Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af079278-7264-43d0-975e-1fcd1f5c731a could not be found. Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af079278-7264-43d0-975e-1fcd1f5c731a could not be found. Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:13.631905 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:37:13.636938 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:13.636938 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:13.636938 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:37:13.636938 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:37:13.636938 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:37:13.636938 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:37:13.636938 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af079278-7264-43d0-975e-1fcd1f5c731a could not be found. Aug 24 10:37:13.636938 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:37:13.642191 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-69389eab-4694-422b-9840-915537b09e0e tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] Returning 404 to user: Instance af079278-7264-43d0-975e-1fcd1f5c731a could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:37:13.644876 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-69389eab-4694-422b-9840-915537b09e0e tempest-ServerMetadataNegativeTestJSON-2130520497 tempest-ServerMetadataNegativeTestJSON-2130520497-project] 10.222.0.85 "GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a" status: 404 len: 111 microversion: 2.1 time: 0.126828 Aug 24 10:37:13.646925 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2186/4761] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:13 2022] GET /compute/v2.1/servers/af079278-7264-43d0-975e-1fcd1f5c731a => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:37:13.856853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-873a854c-ce46-4b15-abd2-a290aaf06f62 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:37:13.857899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-873a854c-ce46-4b15-abd2-a290aaf06f62 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:37:13.858964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-873a854c-ce46-4b15-abd2-a290aaf06f62 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:37:13.859605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-873a854c-ce46-4b15-abd2-a290aaf06f62 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:37:13.860250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-873a854c-ce46-4b15-abd2-a290aaf06f62 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:37:13.901891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-873a854c-ce46-4b15-abd2-a290aaf06f62 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:13.903913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-873a854c-ce46-4b15-abd2-a290aaf06f62 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:13.911440 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-873a854c-ce46-4b15-abd2-a290aaf06f62 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:13.912500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-873a854c-ce46-4b15-abd2-a290aaf06f62 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:13.921451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-873a854c-ce46-4b15-abd2-a290aaf06f62 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:13.925469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-873a854c-ce46-4b15-abd2-a290aaf06f62 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:14.026621 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-873a854c-ce46-4b15-abd2-a290aaf06f62 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Getting quotas for project 8b489eabb0014ddc9a2fcdf6e78ee740. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:37:14.037992 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-873a854c-ce46-4b15-abd2-a290aaf06f62 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Getting quotas for user 83a25a0677c04f8ba975528ece80d676 and project 8b489eabb0014ddc9a2fcdf6e78ee740. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:37:14.098677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-873a854c-ce46-4b15-abd2-a290aaf06f62 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:37:14.101456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-873a854c-ce46-4b15-abd2-a290aaf06f62 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: b03ac06d-c767-4fd3-a252-1b84310d81a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:37:14.216961 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-873a854c-ce46-4b15-abd2-a290aaf06f62 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.584283 Aug 24 10:37:14.219885 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2576/4762] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:37:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:37:14.232378 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c1ef8f0c-4b52-449e-a7e4-8b294506f439 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:14.233027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c1ef8f0c-4b52-449e-a7e4-8b294506f439 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: b03ac06d-c767-4fd3-a252-1b84310d81a8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:14.251004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a9a44e3c-bf4f-4295-8eab-901c90d760c6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:14.251636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a9a44e3c-bf4f-4295-8eab-901c90d760c6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:14.278669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9a44e3c-bf4f-4295-8eab-901c90d760c6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:14.284998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9a44e3c-bf4f-4295-8eab-901c90d760c6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:14.286808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9a44e3c-bf4f-4295-8eab-901c90d760c6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:14.289640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9a44e3c-bf4f-4295-8eab-901c90d760c6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:14.290208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9a44e3c-bf4f-4295-8eab-901c90d760c6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:14.290655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9a44e3c-bf4f-4295-8eab-901c90d760c6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:14.972422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a9a44e3c-bf4f-4295-8eab-901c90d760c6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:14.981152 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a9a44e3c-bf4f-4295-8eab-901c90d760c6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1679 microversion: 2.1 time: 0.734299 Aug 24 10:37:14.985776 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2577/4763] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:14 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1679 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:15.004605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6d7857a5-5b99-4e67-9ae6-7d3d2b50026e tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:15.012100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6d7857a5-5b99-4e67-9ae6-7d3d2b50026e tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] [instance: 253f9d94-6076-4696-8388-cc5be65d66ea] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:15.029379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d7857a5-5b99-4e67-9ae6-7d3d2b50026e tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:15.030564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d7857a5-5b99-4e67-9ae6-7d3d2b50026e tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:15.031211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d7857a5-5b99-4e67-9ae6-7d3d2b50026e tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:15.032172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d7857a5-5b99-4e67-9ae6-7d3d2b50026e tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:15.032844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d7857a5-5b99-4e67-9ae6-7d3d2b50026e tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:15.036143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d7857a5-5b99-4e67-9ae6-7d3d2b50026e tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:15.150031 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c1ef8f0c-4b52-449e-a7e4-8b294506f439 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:15.159380 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c1ef8f0c-4b52-449e-a7e4-8b294506f439 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8" status: 200 len: 1220 microversion: 2.1 time: 0.932828 Aug 24 10:37:15.162232 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2187/4764] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:14 2022] GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8 => generated 1220 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:15.199872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-6d7857a5-5b99-4e67-9ae6-7d3d2b50026e tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lazy-loading 'services' on Instance uuid 253f9d94-6076-4696-8388-cc5be65d66ea {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:37:15.374720 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6d7857a5-5b99-4e67-9ae6-7d3d2b50026e tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] 10.222.0.85 "DELETE /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea/os-volume_attachments/26f9fcc8-163c-45ff-b245-20b271fef649" status: 202 len: 0 microversion: 2.1 time: 0.370673 Aug 24 10:37:15.377409 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2578/4765] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Aug 24 10:37:14 2022] DELETE /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea/os-volume_attachments/26f9fcc8-163c-45ff-b245-20b271fef649 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:37:16.008146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-938bd51e-8917-4f76-ada8-57c66e4f9978 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:16.009954 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-938bd51e-8917-4f76-ada8-57c66e4f9978 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:16.027387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-938bd51e-8917-4f76-ada8-57c66e4f9978 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:16.028340 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-938bd51e-8917-4f76-ada8-57c66e4f9978 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:16.028918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-938bd51e-8917-4f76-ada8-57c66e4f9978 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:16.029699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-938bd51e-8917-4f76-ada8-57c66e4f9978 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:16.030769 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-938bd51e-8917-4f76-ada8-57c66e4f9978 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:16.031235 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-938bd51e-8917-4f76-ada8-57c66e4f9978 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:16.187947 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bbeda120-e7b0-47e0-9511-737228f720d9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:16.188852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bbeda120-e7b0-47e0-9511-737228f720d9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: b03ac06d-c767-4fd3-a252-1b84310d81a8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:16.210484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbeda120-e7b0-47e0-9511-737228f720d9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:16.211073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbeda120-e7b0-47e0-9511-737228f720d9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:16.211445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbeda120-e7b0-47e0-9511-737228f720d9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:16.212173 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbeda120-e7b0-47e0-9511-737228f720d9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:16.222985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbeda120-e7b0-47e0-9511-737228f720d9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:16.223548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbeda120-e7b0-47e0-9511-737228f720d9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:16.604525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bbeda120-e7b0-47e0-9511-737228f720d9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:16.645502 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bbeda120-e7b0-47e0-9511-737228f720d9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8" status: 200 len: 1272 microversion: 2.1 time: 0.433372 Aug 24 10:37:16.655322 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2579/4766] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:16 2022] GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8 => generated 1272 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:17.396742 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-938bd51e-8917-4f76-ada8-57c66e4f9978 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:17.409200 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-938bd51e-8917-4f76-ada8-57c66e4f9978 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1679 microversion: 2.1 time: 1.406389 Aug 24 10:37:17.413465 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2188/4767] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:16 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1679 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:17.676061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cab5b4c8-83e1-48fa-b8aa-70db38c08224 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:17.676775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cab5b4c8-83e1-48fa-b8aa-70db38c08224 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: b03ac06d-c767-4fd3-a252-1b84310d81a8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:17.694121 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cab5b4c8-83e1-48fa-b8aa-70db38c08224 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:17.695089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cab5b4c8-83e1-48fa-b8aa-70db38c08224 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:17.695700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cab5b4c8-83e1-48fa-b8aa-70db38c08224 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:17.696712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cab5b4c8-83e1-48fa-b8aa-70db38c08224 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:17.698194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cab5b4c8-83e1-48fa-b8aa-70db38c08224 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:17.698980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cab5b4c8-83e1-48fa-b8aa-70db38c08224 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:17.732633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=9,nova_cell1:INSERT=5 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:17.989748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cab5b4c8-83e1-48fa-b8aa-70db38c08224 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:18.008807 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cab5b4c8-83e1-48fa-b8aa-70db38c08224 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8" status: 200 len: 1278 microversion: 2.1 time: 0.337479 Aug 24 10:37:18.009987 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2580/4768] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:17 2022] GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8 => generated 1278 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:18.430478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ffc83634-f37e-4236-8712-05cca20567e4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:18.431098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ffc83634-f37e-4236-8712-05cca20567e4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:18.452888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffc83634-f37e-4236-8712-05cca20567e4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:18.453429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffc83634-f37e-4236-8712-05cca20567e4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:18.453866 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffc83634-f37e-4236-8712-05cca20567e4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:18.454585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffc83634-f37e-4236-8712-05cca20567e4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:18.455040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffc83634-f37e-4236-8712-05cca20567e4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:18.455462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffc83634-f37e-4236-8712-05cca20567e4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:19.034889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f88e8202-5e97-4a3b-86e5-a3c7b57bfd15 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:19.035519 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f88e8202-5e97-4a3b-86e5-a3c7b57bfd15 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: b03ac06d-c767-4fd3-a252-1b84310d81a8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:19.050039 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f88e8202-5e97-4a3b-86e5-a3c7b57bfd15 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:19.050473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f88e8202-5e97-4a3b-86e5-a3c7b57bfd15 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:19.050916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f88e8202-5e97-4a3b-86e5-a3c7b57bfd15 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:19.051624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f88e8202-5e97-4a3b-86e5-a3c7b57bfd15 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:19.052080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f88e8202-5e97-4a3b-86e5-a3c7b57bfd15 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:19.052506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f88e8202-5e97-4a3b-86e5-a3c7b57bfd15 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:19.617819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ffc83634-f37e-4236-8712-05cca20567e4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:19.658589 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ffc83634-f37e-4236-8712-05cca20567e4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1656 microversion: 2.1 time: 1.231932 Aug 24 10:37:19.659206 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2189/4769] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:18 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1656 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:37:19.694575 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ed46c519-d5bb-453b-831c-c9b6a7057532 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:19.722426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed46c519-d5bb-453b-831c-c9b6a7057532 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:19.725210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed46c519-d5bb-453b-831c-c9b6a7057532 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:19.733405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed46c519-d5bb-453b-831c-c9b6a7057532 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:19.848513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ed46c519-d5bb-453b-831c-c9b6a7057532 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Going to try to start instance {{(pid=122432) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 10:37:19.964196 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ed46c519-d5bb-453b-831c-c9b6a7057532 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action" status: 202 len: 0 microversion: 2.1 time: 0.284326 Aug 24 10:37:19.965173 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2190/4770] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:37:19 2022] POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:37:19.973792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32d5d19e-6128-4e6c-bbfb-24112cc0d729 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:19.979612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-32d5d19e-6128-4e6c-bbfb-24112cc0d729 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:19.995301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d5d19e-6128-4e6c-bbfb-24112cc0d729 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:19.995827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d5d19e-6128-4e6c-bbfb-24112cc0d729 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:19.996267 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d5d19e-6128-4e6c-bbfb-24112cc0d729 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:19.996991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d5d19e-6128-4e6c-bbfb-24112cc0d729 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:19.997559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d5d19e-6128-4e6c-bbfb-24112cc0d729 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:19.998342 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d5d19e-6128-4e6c-bbfb-24112cc0d729 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:20.238402 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f88e8202-5e97-4a3b-86e5-a3c7b57bfd15 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:20.254407 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f88e8202-5e97-4a3b-86e5-a3c7b57bfd15 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8" status: 200 len: 1320 microversion: 2.1 time: 1.223376 Aug 24 10:37:20.255577 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2581/4771] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:19 2022] GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8 => generated 1320 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:37:21.159383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-32d5d19e-6128-4e6c-bbfb-24112cc0d729 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:21.171457 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-32d5d19e-6128-4e6c-bbfb-24112cc0d729 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1665 microversion: 2.1 time: 1.202060 Aug 24 10:37:21.172908 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2191/4772] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:19 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1665 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:37:21.276872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e8a0946b-9842-4658-947c-affecb90f1d2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:21.277628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e8a0946b-9842-4658-947c-affecb90f1d2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: b03ac06d-c767-4fd3-a252-1b84310d81a8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:21.284657 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:21.300732 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8a0946b-9842-4658-947c-affecb90f1d2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:21.302990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8a0946b-9842-4658-947c-affecb90f1d2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:21.305485 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8a0946b-9842-4658-947c-affecb90f1d2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:21.306430 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8a0946b-9842-4658-947c-affecb90f1d2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:21.307028 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8a0946b-9842-4658-947c-affecb90f1d2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:21.309898 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8a0946b-9842-4658-947c-affecb90f1d2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:21.853333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e8a0946b-9842-4658-947c-affecb90f1d2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:21.879258 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e8a0946b-9842-4658-947c-affecb90f1d2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8" status: 200 len: 1320 microversion: 2.1 time: 0.606851 Aug 24 10:37:21.887354 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2582/4773] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:21 2022] GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8 => generated 1320 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:22.194367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5ba3430a-7ba8-4800-82cd-26ab51c84557 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:22.195304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5ba3430a-7ba8-4800-82cd-26ab51c84557 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:22.210115 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ba3430a-7ba8-4800-82cd-26ab51c84557 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:22.219826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ba3430a-7ba8-4800-82cd-26ab51c84557 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:22.220563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ba3430a-7ba8-4800-82cd-26ab51c84557 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:22.221659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ba3430a-7ba8-4800-82cd-26ab51c84557 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:22.222385 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ba3430a-7ba8-4800-82cd-26ab51c84557 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:22.224066 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ba3430a-7ba8-4800-82cd-26ab51c84557 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:22.759710 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-63345b26-ddc5-4abb-8505-201ecea43b48 req-6cffc565-27ef-4867-9555-d38dc9529ddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b03ac06d-c767-4fd3-a252-1b84310d81a8", "tag": "9d952754-2d88-4879-8505-2eec015092f0"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:22.768768 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:22.778975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-63345b26-ddc5-4abb-8505-201ecea43b48 req-6cffc565-27ef-4867-9555-d38dc9529ddd service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:22.779573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-63345b26-ddc5-4abb-8505-201ecea43b48 req-6cffc565-27ef-4867-9555-d38dc9529ddd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:22.780281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-63345b26-ddc5-4abb-8505-201ecea43b48 req-6cffc565-27ef-4867-9555-d38dc9529ddd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:22.802170 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-63345b26-ddc5-4abb-8505-201ecea43b48 req-6cffc565-27ef-4867-9555-d38dc9529ddd service nova] Creating event network-changed:9d952754-2d88-4879-8505-2eec015092f0 for instance b03ac06d-c767-4fd3-a252-1b84310d81a8 on n-h2-849328-3 Aug 24 10:37:22.814860 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-63345b26-ddc5-4abb-8505-201ecea43b48 req-6cffc565-27ef-4867-9555-d38dc9529ddd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.665919 Aug 24 10:37:22.819478 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2192/4774] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:37:22.911902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-700dc207-2eee-4d04-ac41-72a673aad7ba tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:22.912719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-700dc207-2eee-4d04-ac41-72a673aad7ba tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: b03ac06d-c767-4fd3-a252-1b84310d81a8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:22.922796 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-700dc207-2eee-4d04-ac41-72a673aad7ba tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:22.923281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-700dc207-2eee-4d04-ac41-72a673aad7ba tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:22.925873 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-700dc207-2eee-4d04-ac41-72a673aad7ba tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:22.926619 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-700dc207-2eee-4d04-ac41-72a673aad7ba tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:22.928255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-700dc207-2eee-4d04-ac41-72a673aad7ba tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:22.929620 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-700dc207-2eee-4d04-ac41-72a673aad7ba tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:23.833722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5ba3430a-7ba8-4800-82cd-26ab51c84557 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:23.854297 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5ba3430a-7ba8-4800-82cd-26ab51c84557 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1665 microversion: 2.1 time: 1.664550 Aug 24 10:37:23.855376 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2583/4775] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:22 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1665 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:37:24.875396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0d5dabd6-b7a0-4608-997f-a0e2c9ec205d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:24.876104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0d5dabd6-b7a0-4608-997f-a0e2c9ec205d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:24.896290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:24.897089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=12 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:24.899498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d5dabd6-b7a0-4608-997f-a0e2c9ec205d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:24.915488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d5dabd6-b7a0-4608-997f-a0e2c9ec205d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:24.915488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d5dabd6-b7a0-4608-997f-a0e2c9ec205d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:24.916171 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d5dabd6-b7a0-4608-997f-a0e2c9ec205d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:24.920151 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d5dabd6-b7a0-4608-997f-a0e2c9ec205d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:24.929923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d5dabd6-b7a0-4608-997f-a0e2c9ec205d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:25.159555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:25.163879 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-700dc207-2eee-4d04-ac41-72a673aad7ba tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:25.188601 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-700dc207-2eee-4d04-ac41-72a673aad7ba tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8" status: 200 len: 1320 microversion: 2.1 time: 2.277051 Aug 24 10:37:25.189298 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2193/4776] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:22 2022] GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8 => generated 1320 bytes in 2284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:37:25.631719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0d5dabd6-b7a0-4608-997f-a0e2c9ec205d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:25.645214 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0d5dabd6-b7a0-4608-997f-a0e2c9ec205d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1665 microversion: 2.1 time: 0.773737 Aug 24 10:37:25.653953 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2584/4777] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:24 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1665 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:37:26.213481 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6d59b1f9-eb5d-4f26-b4d9-309fd0933e22 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:26.215524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6d59b1f9-eb5d-4f26-b4d9-309fd0933e22 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: b03ac06d-c767-4fd3-a252-1b84310d81a8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:26.257327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d59b1f9-eb5d-4f26-b4d9-309fd0933e22 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:26.259041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d59b1f9-eb5d-4f26-b4d9-309fd0933e22 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:26.262767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d59b1f9-eb5d-4f26-b4d9-309fd0933e22 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:26.264503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d59b1f9-eb5d-4f26-b4d9-309fd0933e22 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:26.266690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d59b1f9-eb5d-4f26-b4d9-309fd0933e22 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:26.270000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d59b1f9-eb5d-4f26-b4d9-309fd0933e22 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:26.674368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8c00328b-f745-4471-971e-3993df22d59d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:26.675054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8c00328b-f745-4471-971e-3993df22d59d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:26.698301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c00328b-f745-4471-971e-3993df22d59d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:26.698998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c00328b-f745-4471-971e-3993df22d59d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:26.699451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c00328b-f745-4471-971e-3993df22d59d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:26.700207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c00328b-f745-4471-971e-3993df22d59d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:26.700702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c00328b-f745-4471-971e-3993df22d59d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:26.701148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c00328b-f745-4471-971e-3993df22d59d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:27.180130 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6d59b1f9-eb5d-4f26-b4d9-309fd0933e22 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:27.189697 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6d59b1f9-eb5d-4f26-b4d9-309fd0933e22 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8" status: 200 len: 1320 microversion: 2.1 time: 0.981546 Aug 24 10:37:27.209840 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2194/4778] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:26 2022] GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8 => generated 1320 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:27.237502 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-afcf2f57-06b9-40f6-98cb-f0267ea0549a tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:27.238935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-afcf2f57-06b9-40f6-98cb-f0267ea0549a tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] [instance: 253f9d94-6076-4696-8388-cc5be65d66ea] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:27.267511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afcf2f57-06b9-40f6-98cb-f0267ea0549a tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:27.268141 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afcf2f57-06b9-40f6-98cb-f0267ea0549a tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:27.269565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afcf2f57-06b9-40f6-98cb-f0267ea0549a tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:27.271360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afcf2f57-06b9-40f6-98cb-f0267ea0549a tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:27.273060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afcf2f57-06b9-40f6-98cb-f0267ea0549a tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:27.273665 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afcf2f57-06b9-40f6-98cb-f0267ea0549a tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:27.326809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8c00328b-f745-4471-971e-3993df22d59d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:27.335219 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8c00328b-f745-4471-971e-3993df22d59d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.664721 Aug 24 10:37:27.342913 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2585/4779] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:26 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:27.362455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0d48b4b8-3548-4716-9a87-c1b46d970e65 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:27.363322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0d48b4b8-3548-4716-9a87-c1b46d970e65 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:27.372836 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-afcf2f57-06b9-40f6-98cb-f0267ea0549a tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] [instance: 253f9d94-6076-4696-8388-cc5be65d66ea] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:37:27.378307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d48b4b8-3548-4716-9a87-c1b46d970e65 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:27.385896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d48b4b8-3548-4716-9a87-c1b46d970e65 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:27.386594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d48b4b8-3548-4716-9a87-c1b46d970e65 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:27.389619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d48b4b8-3548-4716-9a87-c1b46d970e65 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:27.390248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d48b4b8-3548-4716-9a87-c1b46d970e65 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:27.390886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d48b4b8-3548-4716-9a87-c1b46d970e65 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:27.595544 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-afcf2f57-06b9-40f6-98cb-f0267ea0549a tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] 10.222.0.85 "DELETE /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea" status: 204 len: 0 microversion: 2.1 time: 0.378316 Aug 24 10:37:27.597689 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2195/4780] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:37:27 2022] DELETE /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:37:27.822525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0d48b4b8-3548-4716-9a87-c1b46d970e65 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:27.844660 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0d48b4b8-3548-4716-9a87-c1b46d970e65 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.487167 Aug 24 10:37:27.853090 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2586/4781] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:27 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:27.865996 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-143b4b11-9717-412f-972b-6833f9e079c3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Action: 'create', calling method: .version_select at 0x7f465428e040>, body: {"keypair": {"name": "tempest-keypair-641645315", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTb3GelZJuem8gC+ARSN5aGDziNLd4lOLOaXzU/a6t0IcY0ZjKSkSk49JtXq9B5WHAHo1r+cZHVLACiK30zoX1/q5Z0TMka1ouDygnjSN413YRg+kiInEkvZbYyBKu6Zw=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:27.874459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0cd62327-6e05-4f3b-a9c7-3b3ed698bc90 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:27.890438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0cd62327-6e05-4f3b-a9c7-3b3ed698bc90 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] [instance: 253f9d94-6076-4696-8388-cc5be65d66ea] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:27.919383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-143b4b11-9717-412f-972b-6833f9e079c3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Getting quotas for project 2c9ad6902a1f4f2c807315e5ee3dc897. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:37:27.921004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cd62327-6e05-4f3b-a9c7-3b3ed698bc90 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:27.921655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cd62327-6e05-4f3b-a9c7-3b3ed698bc90 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:27.925141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cd62327-6e05-4f3b-a9c7-3b3ed698bc90 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:27.927020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cd62327-6e05-4f3b-a9c7-3b3ed698bc90 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:27.930974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cd62327-6e05-4f3b-a9c7-3b3ed698bc90 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:27.932872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cd62327-6e05-4f3b-a9c7-3b3ed698bc90 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:27.945922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-143b4b11-9717-412f-972b-6833f9e079c3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Getting quotas for user 3f1d12ba24f245b59b9af777352984d0 and project 2c9ad6902a1f4f2c807315e5ee3dc897. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:37:28.034476 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-143b4b11-9717-412f-972b-6833f9e079c3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.435147 Aug 24 10:37:28.036852 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2196/4782] 10.222.0.85 () {62 vars in 1200 bytes} [Wed Aug 24 10:37:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 438 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 10:37:28.057005 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cd6dc596-bc9c-44f0-bc40-0223af738262 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:28.058073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cd6dc596-bc9c-44f0-bc40-0223af738262 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:28.081015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd6dc596-bc9c-44f0-bc40-0223af738262 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:28.081549 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd6dc596-bc9c-44f0-bc40-0223af738262 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:28.081995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd6dc596-bc9c-44f0-bc40-0223af738262 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:28.082719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd6dc596-bc9c-44f0-bc40-0223af738262 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:28.083176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd6dc596-bc9c-44f0-bc40-0223af738262 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:28.083616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd6dc596-bc9c-44f0-bc40-0223af738262 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:28.211312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cd6dc596-bc9c-44f0-bc40-0223af738262 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Unlocking {{(pid=122432) unlock /opt/stack/nova/nova/compute/api.py:4857}} Aug 24 10:37:28.324944 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cd6dc596-bc9c-44f0-bc40-0223af738262 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action" status: 202 len: 0 microversion: 2.1 time: 0.286875 Aug 24 10:37:28.326884 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2197/4783] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:37:28 2022] POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:37:28.339252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f09f8905-f9ad-460e-beac-93599fb316d7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:28.340174 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f09f8905-f9ad-460e-beac-93599fb316d7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: b03ac06d-c767-4fd3-a252-1b84310d81a8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:28.374927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f09f8905-f9ad-460e-beac-93599fb316d7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:28.375882 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f09f8905-f9ad-460e-beac-93599fb316d7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:28.376685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f09f8905-f9ad-460e-beac-93599fb316d7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:28.377713 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f09f8905-f9ad-460e-beac-93599fb316d7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:28.380443 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f09f8905-f9ad-460e-beac-93599fb316d7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:28.381644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f09f8905-f9ad-460e-beac-93599fb316d7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:28.425899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0cd62327-6e05-4f3b-a9c7-3b3ed698bc90 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbd482dde84ddb85ea4be9814dd5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca3a4feff2429b8b8b04a3d2a4175d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:28.437452 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0cd62327-6e05-4f3b-a9c7-3b3ed698bc90 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] 10.222.0.85 "GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea" status: 200 len: 1470 microversion: 2.1 time: 0.580634 Aug 24 10:37:28.438198 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2587/4784] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:27 2022] GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea => generated 1470 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:28.484888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-627141b5-a1e7-4b94-bfe2-2fd30a535a09 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:28.516877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-627141b5-a1e7-4b94-bfe2-2fd30a535a09 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:28.530180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-627141b5-a1e7-4b94-bfe2-2fd30a535a09 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:28.530994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-627141b5-a1e7-4b94-bfe2-2fd30a535a09 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:28.531710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-627141b5-a1e7-4b94-bfe2-2fd30a535a09 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:28.532652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-627141b5-a1e7-4b94-bfe2-2fd30a535a09 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:28.535055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-627141b5-a1e7-4b94-bfe2-2fd30a535a09 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:28.535887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-627141b5-a1e7-4b94-bfe2-2fd30a535a09 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:28.726073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f09f8905-f9ad-460e-beac-93599fb316d7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:28.736169 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f09f8905-f9ad-460e-beac-93599fb316d7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8" status: 200 len: 1320 microversion: 2.1 time: 0.407899 Aug 24 10:37:28.738414 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2198/4785] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:28 2022] GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8 => generated 1320 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:29.386399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-627141b5-a1e7-4b94-bfe2-2fd30a535a09 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:29.431514 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-627141b5-a1e7-4b94-bfe2-2fd30a535a09 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.959731 Aug 24 10:37:29.434034 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2588/4786] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:28 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:29.466279 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7002708c-3b36-40e0-9fa9-8a96bfe888a0 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:29.467042 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7002708c-3b36-40e0-9fa9-8a96bfe888a0 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] [instance: 253f9d94-6076-4696-8388-cc5be65d66ea] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:29.468108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b3d8dbca-1e85-4657-a2f4-464c1797cfd2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:29.470607 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b3d8dbca-1e85-4657-a2f4-464c1797cfd2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:29.476234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7002708c-3b36-40e0-9fa9-8a96bfe888a0 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:29.477650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7002708c-3b36-40e0-9fa9-8a96bfe888a0 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:29.478747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7002708c-3b36-40e0-9fa9-8a96bfe888a0 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:29.480292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7002708c-3b36-40e0-9fa9-8a96bfe888a0 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:29.482197 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7002708c-3b36-40e0-9fa9-8a96bfe888a0 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:29.483096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7002708c-3b36-40e0-9fa9-8a96bfe888a0 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:29.514512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3d8dbca-1e85-4657-a2f4-464c1797cfd2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:29.517254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3d8dbca-1e85-4657-a2f4-464c1797cfd2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:29.519818 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3d8dbca-1e85-4657-a2f4-464c1797cfd2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:29.521038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3d8dbca-1e85-4657-a2f4-464c1797cfd2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:29.521678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3d8dbca-1e85-4657-a2f4-464c1797cfd2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:29.523583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3d8dbca-1e85-4657-a2f4-464c1797cfd2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:29.995061 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b3d8dbca-1e85-4657-a2f4-464c1797cfd2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:30.010376 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b3d8dbca-1e85-4657-a2f4-464c1797cfd2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.556150 Aug 24 10:37:30.017891 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2199/4787] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:29 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:30.037887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-87ba80b2-e315-443c-bc5c-0f20436d17e1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:30.038775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-87ba80b2-e315-443c-bc5c-0f20436d17e1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: b03ac06d-c767-4fd3-a252-1b84310d81a8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:30.054121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87ba80b2-e315-443c-bc5c-0f20436d17e1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:30.068356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87ba80b2-e315-443c-bc5c-0f20436d17e1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:30.069405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87ba80b2-e315-443c-bc5c-0f20436d17e1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:30.071802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87ba80b2-e315-443c-bc5c-0f20436d17e1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:30.073903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87ba80b2-e315-443c-bc5c-0f20436d17e1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:30.074548 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87ba80b2-e315-443c-bc5c-0f20436d17e1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:30.176396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:30.355854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7002708c-3b36-40e0-9fa9-8a96bfe888a0 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbd482dde84ddb85ea4be9814dd5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca3a4feff2429b8b8b04a3d2a4175d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:30.381275 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7002708c-3b36-40e0-9fa9-8a96bfe888a0 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] 10.222.0.85 "GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea" status: 200 len: 1470 microversion: 2.1 time: 0.919173 Aug 24 10:37:30.384060 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2589/4788] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:29 2022] GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea => generated 1470 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:30.399193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0e9d9e8f-2243-425f-9b40-08920a86be9f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:30.403132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0e9d9e8f-2243-425f-9b40-08920a86be9f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:30.422236 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e9d9e8f-2243-425f-9b40-08920a86be9f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:30.423994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e9d9e8f-2243-425f-9b40-08920a86be9f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:30.424673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e9d9e8f-2243-425f-9b40-08920a86be9f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:30.428048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e9d9e8f-2243-425f-9b40-08920a86be9f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:30.429856 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e9d9e8f-2243-425f-9b40-08920a86be9f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:30.432097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e9d9e8f-2243-425f-9b40-08920a86be9f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:30.904158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0e9d9e8f-2243-425f-9b40-08920a86be9f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:30.924778 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0e9d9e8f-2243-425f-9b40-08920a86be9f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.538152 Aug 24 10:37:30.926044 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2590/4789] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:30 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:30.933002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-87ba80b2-e315-443c-bc5c-0f20436d17e1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:30.951775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-58832552-ef45-4c60-ae8c-1fe3714f0f68 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:30.952617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-58832552-ef45-4c60-ae8c-1fe3714f0f68 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:30.962262 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-87ba80b2-e315-443c-bc5c-0f20436d17e1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8" status: 200 len: 1320 microversion: 2.1 time: 0.942541 Aug 24 10:37:30.963203 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58832552-ef45-4c60-ae8c-1fe3714f0f68 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:30.963871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58832552-ef45-4c60-ae8c-1fe3714f0f68 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:30.964314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58832552-ef45-4c60-ae8c-1fe3714f0f68 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:30.967941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58832552-ef45-4c60-ae8c-1fe3714f0f68 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:30.968633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58832552-ef45-4c60-ae8c-1fe3714f0f68 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:30.969268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58832552-ef45-4c60-ae8c-1fe3714f0f68 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:30.982000 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2200/4790] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:30 2022] GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8 => generated 1320 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:31.114151 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-58832552-ef45-4c60-ae8c-1fe3714f0f68 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action" status: 202 len: 0 microversion: 2.1 time: 0.166739 Aug 24 10:37:31.118971 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2591/4791] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:37:30 2022] POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:37:31.127251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f18fc709-29a2-40da-9db8-14b2d3b5fafb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:31.128722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f18fc709-29a2-40da-9db8-14b2d3b5fafb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:31.161631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f18fc709-29a2-40da-9db8-14b2d3b5fafb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:31.163201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f18fc709-29a2-40da-9db8-14b2d3b5fafb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:31.164342 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f18fc709-29a2-40da-9db8-14b2d3b5fafb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:31.165834 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f18fc709-29a2-40da-9db8-14b2d3b5fafb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:31.169158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f18fc709-29a2-40da-9db8-14b2d3b5fafb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:31.170054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f18fc709-29a2-40da-9db8-14b2d3b5fafb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:31.408656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0bc11348-5168-4951-88a6-48f7c034663f tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:31.409530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0bc11348-5168-4951-88a6-48f7c034663f tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] [instance: 253f9d94-6076-4696-8388-cc5be65d66ea] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:31.451128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bc11348-5168-4951-88a6-48f7c034663f tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:31.457490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bc11348-5168-4951-88a6-48f7c034663f tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:31.458155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bc11348-5168-4951-88a6-48f7c034663f tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:31.458954 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bc11348-5168-4951-88a6-48f7c034663f tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:31.459412 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bc11348-5168-4951-88a6-48f7c034663f tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:31.459850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bc11348-5168-4951-88a6-48f7c034663f tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:31.846858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0bc11348-5168-4951-88a6-48f7c034663f tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efbd482dde84ddb85ea4be9814dd5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca3a4feff2429b8b8b04a3d2a4175d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:31.871380 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0bc11348-5168-4951-88a6-48f7c034663f tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] 10.222.0.85 "GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea" status: 200 len: 1428 microversion: 2.1 time: 0.468608 Aug 24 10:37:31.887646 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2592/4792] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:31 2022] GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea => generated 1428 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:31.902499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-685ea131-8c04-466a-9d9d-b6285b9fe5d6 req-8a3932bf-2ee0-44c6-88d6-e5bc9c34f090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b03ac06d-c767-4fd3-a252-1b84310d81a8", "name": "network-vif-plugged", "status": "completed", "tag": "9d952754-2d88-4879-8505-2eec015092f0"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:31.948441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-685ea131-8c04-466a-9d9d-b6285b9fe5d6 req-8a3932bf-2ee0-44c6-88d6-e5bc9c34f090 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:31.952538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-685ea131-8c04-466a-9d9d-b6285b9fe5d6 req-8a3932bf-2ee0-44c6-88d6-e5bc9c34f090 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:31.977455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-685ea131-8c04-466a-9d9d-b6285b9fe5d6 req-8a3932bf-2ee0-44c6-88d6-e5bc9c34f090 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:32.045726 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-685ea131-8c04-466a-9d9d-b6285b9fe5d6 req-8a3932bf-2ee0-44c6-88d6-e5bc9c34f090 service nova] Creating event network-vif-plugged:9d952754-2d88-4879-8505-2eec015092f0 for instance b03ac06d-c767-4fd3-a252-1b84310d81a8 on n-h2-849328-3 Aug 24 10:37:32.059949 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-685ea131-8c04-466a-9d9d-b6285b9fe5d6 req-8a3932bf-2ee0-44c6-88d6-e5bc9c34f090 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168654 Aug 24 10:37:32.066536 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2593/4793] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:37:32.587593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f18fc709-29a2-40da-9db8-14b2d3b5fafb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:32.602837 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f18fc709-29a2-40da-9db8-14b2d3b5fafb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1674 microversion: 2.1 time: 1.480420 Aug 24 10:37:32.609670 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2201/4794] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:31 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1674 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:32.631243 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-130ed737-52b4-452a-a05f-214fcd085251 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:32.650435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-130ed737-52b4-452a-a05f-214fcd085251 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: b03ac06d-c767-4fd3-a252-1b84310d81a8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:32.671714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-130ed737-52b4-452a-a05f-214fcd085251 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:32.683268 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-130ed737-52b4-452a-a05f-214fcd085251 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:32.683726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-130ed737-52b4-452a-a05f-214fcd085251 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:32.684484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-130ed737-52b4-452a-a05f-214fcd085251 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:32.699126 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-130ed737-52b4-452a-a05f-214fcd085251 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:32.705658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-130ed737-52b4-452a-a05f-214fcd085251 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:32.723146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-549f45fb-a17b-4666-8e41-ad63643bd3c2 req-2ed5359f-12c4-4d9e-a5a3-f57614838729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "253f9d94-6076-4696-8388-cc5be65d66ea", "name": "network-vif-deleted", "tag": "f52c83d9-2823-4363-b62d-d3f492dc65a1"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:32.758205 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-549f45fb-a17b-4666-8e41-ad63643bd3c2 req-2ed5359f-12c4-4d9e-a5a3-f57614838729 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:32.758729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-549f45fb-a17b-4666-8e41-ad63643bd3c2 req-2ed5359f-12c4-4d9e-a5a3-f57614838729 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:32.768677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-549f45fb-a17b-4666-8e41-ad63643bd3c2 req-2ed5359f-12c4-4d9e-a5a3-f57614838729 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:32.812446 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-549f45fb-a17b-4666-8e41-ad63643bd3c2 req-2ed5359f-12c4-4d9e-a5a3-f57614838729 service nova] Creating event network-vif-deleted:f52c83d9-2823-4363-b62d-d3f492dc65a1 for instance 253f9d94-6076-4696-8388-cc5be65d66ea on n-h2-849328-3 Aug 24 10:37:32.848868 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-549f45fb-a17b-4666-8e41-ad63643bd3c2 req-2ed5359f-12c4-4d9e-a5a3-f57614838729 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.779828 Aug 24 10:37:32.853589 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2594/4795] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:37:32.898533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fa020897-57a7-43a1-aa84-c29466f24f47 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:32.899278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fa020897-57a7-43a1-aa84-c29466f24f47 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] [instance: 253f9d94-6076-4696-8388-cc5be65d66ea] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:32.927088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa020897-57a7-43a1-aa84-c29466f24f47 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:32.927655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa020897-57a7-43a1-aa84-c29466f24f47 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:32.928116 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa020897-57a7-43a1-aa84-c29466f24f47 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:32.935341 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa020897-57a7-43a1-aa84-c29466f24f47 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:32.936077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa020897-57a7-43a1-aa84-c29466f24f47 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:32.936534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa020897-57a7-43a1-aa84-c29466f24f47 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:33.012280 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-fa020897-57a7-43a1-aa84-c29466f24f47 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] HTTP exception thrown: Instance 253f9d94-6076-4696-8388-cc5be65d66ea could not be found. Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fa020897-57a7-43a1-aa84-c29466f24f47 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Request method failure captured: Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea HTTP/1.1 Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf6e4SyN_PHsqxZGXqfgxn7GJzr9DMr7V8PNMmGLsH9nN2BLHxlRMIuVt2YodtlY0n5Ba0DVjOQgv-D1wPrC_qCSXviyTVg08s_ndU7TXkxn4STlZ79ppoY1dIACJa3_oDoPe3G1PDb6V0vEyLq-G28NtO2FK9td2QwM6lAwZw5J2Jw Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 5fca3a4feff2429b8b8b04a3d2a4175d Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-VolumesBackupsTest-804988616 Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5fca3a4feff2429b8b8b04a3d2a4175d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_5fca3a4feff2429b8b8b04a3d2a4175d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5fca3a4feff2429b8b8b04a3d2a4175d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/5fca3a4feff2429b8b8b04a3d2a4175d"}]}] Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-VolumesBackupsTest-804988616 Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 5fca3a4feff2429b8b8b04a3d2a4175d Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-VolumesBackupsTest-804988616 Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-VolumesBackupsTest-804988616-project Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 4efbd482dde84ddb85ea4be9814dd5e2 Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-VolumesBackupsTest-804988616-project Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 253f9d94-6076-4696-8388-cc5be65d66ea could not be found. Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '253f9d94-6076-4696-8388-cc5be65d66ea'} Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 253f9d94-6076-4696-8388-cc5be65d66ea could not be found. Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 253f9d94-6076-4696-8388-cc5be65d66ea could not be found. Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:37:33.019626 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:33.024197 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:33.024197 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:37:33.024197 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:37:33.024197 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:37:33.024197 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:37:33.024197 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 253f9d94-6076-4696-8388-cc5be65d66ea could not be found. Aug 24 10:37:33.024197 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:33.024197 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fa020897-57a7-43a1-aa84-c29466f24f47 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] Returning 404 to user: Instance 253f9d94-6076-4696-8388-cc5be65d66ea could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:37:33.036485 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fa020897-57a7-43a1-aa84-c29466f24f47 tempest-VolumesBackupsTest-804988616 tempest-VolumesBackupsTest-804988616-project] 10.222.0.85 "GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea" status: 404 len: 111 microversion: 2.1 time: 0.143895 Aug 24 10:37:33.051683 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2595/4796] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:32 2022] GET /compute/v2.1/servers/253f9d94-6076-4696-8388-cc5be65d66ea => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:37:33.538300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-130ed737-52b4-452a-a05f-214fcd085251 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:33.551322 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-130ed737-52b4-452a-a05f-214fcd085251 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8" status: 200 len: 1320 microversion: 2.1 time: 0.940040 Aug 24 10:37:33.551754 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2202/4797] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:32 2022] GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8 => generated 1320 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:33.640962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de90ef82-e03a-478e-935a-583a5df438c0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:33.646132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-de90ef82-e03a-478e-935a-583a5df438c0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:33.689873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de90ef82-e03a-478e-935a-583a5df438c0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:33.741893 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de90ef82-e03a-478e-935a-583a5df438c0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:33.754548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de90ef82-e03a-478e-935a-583a5df438c0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.047s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:33.759511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de90ef82-e03a-478e-935a-583a5df438c0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:33.771894 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de90ef82-e03a-478e-935a-583a5df438c0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:33.776035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de90ef82-e03a-478e-935a-583a5df438c0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:34.595982 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2cb63548-28ae-423c-82cf-48732fa2ab7a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:34.597878 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2cb63548-28ae-423c-82cf-48732fa2ab7a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: b03ac06d-c767-4fd3-a252-1b84310d81a8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:34.649432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cb63548-28ae-423c-82cf-48732fa2ab7a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:34.671049 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cb63548-28ae-423c-82cf-48732fa2ab7a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:34.672699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cb63548-28ae-423c-82cf-48732fa2ab7a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:34.686477 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cb63548-28ae-423c-82cf-48732fa2ab7a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:34.687932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cb63548-28ae-423c-82cf-48732fa2ab7a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:34.690037 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cb63548-28ae-423c-82cf-48732fa2ab7a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:35.093189 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-de90ef82-e03a-478e-935a-583a5df438c0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:35.121168 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-de90ef82-e03a-478e-935a-583a5df438c0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1654 microversion: 2.1 time: 1.485066 Aug 24 10:37:35.137573 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2596/4798] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:33 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1654 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:35.171665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a1703d31-73b8-4e52-8ad6-14634badb948 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-982807332", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "48f3ed12-001f-4385-b56f-399300362d3a"}], "security_groups": [{"name": "tempest-securitygroup--1981442277"}], "key_name": "tempest-keypair-641645315", "user_data": "}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:35.406958 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2cb63548-28ae-423c-82cf-48732fa2ab7a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:35.418542 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2cb63548-28ae-423c-82cf-48732fa2ab7a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8" status: 200 len: 1501 microversion: 2.1 time: 0.843057 Aug 24 10:37:35.418919 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2203/4799] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:34 2022] GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8 => generated 1501 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:35.453426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b43d3202-eea2-4271-9dc3-8e358f6c4c8c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:35.454819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b43d3202-eea2-4271-9dc3-8e358f6c4c8c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:35.472544 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b43d3202-eea2-4271-9dc3-8e358f6c4c8c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:35.482947 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b43d3202-eea2-4271-9dc3-8e358f6c4c8c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:35.483670 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b43d3202-eea2-4271-9dc3-8e358f6c4c8c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:35.484817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b43d3202-eea2-4271-9dc3-8e358f6c4c8c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:35.488826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b43d3202-eea2-4271-9dc3-8e358f6c4c8c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:35.489505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b43d3202-eea2-4271-9dc3-8e358f6c4c8c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:35.547246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-a1703d31-73b8-4e52-8ad6-14634badb948 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] validate_networks() for [('48f3ed12-001f-4385-b56f-399300362d3a', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:37:35.629916 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b43d3202-eea2-4271-9dc3-8e358f6c4c8c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action" status: 202 len: 0 microversion: 2.1 time: 0.207794 Aug 24 10:37:35.630921 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2204/4800] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:37:35 2022] POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:37:35.643706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-862d74c2-e893-49b1-95bc-15211382a850 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:35.644791 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-862d74c2-e893-49b1-95bc-15211382a850 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: b03ac06d-c767-4fd3-a252-1b84310d81a8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:35.657386 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-862d74c2-e893-49b1-95bc-15211382a850 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:35.659854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-862d74c2-e893-49b1-95bc-15211382a850 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:35.661871 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-862d74c2-e893-49b1-95bc-15211382a850 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:35.667161 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-862d74c2-e893-49b1-95bc-15211382a850 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:35.667922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-862d74c2-e893-49b1-95bc-15211382a850 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:35.668527 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-862d74c2-e893-49b1-95bc-15211382a850 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:36.161288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-862d74c2-e893-49b1-95bc-15211382a850 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:36.174544 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-862d74c2-e893-49b1-95bc-15211382a850 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8" status: 200 len: 1501 microversion: 2.1 time: 0.542123 Aug 24 10:37:36.175494 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2205/4801] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:35 2022] GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8 => generated 1501 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:36.199207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cbfe0b33-da1b-4eb5-8643-76b059933f03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:36.199822 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cbfe0b33-da1b-4eb5-8643-76b059933f03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:36.222602 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbfe0b33-da1b-4eb5-8643-76b059933f03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:36.226854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbfe0b33-da1b-4eb5-8643-76b059933f03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:36.231388 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbfe0b33-da1b-4eb5-8643-76b059933f03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:36.232249 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbfe0b33-da1b-4eb5-8643-76b059933f03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:36.237764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbfe0b33-da1b-4eb5-8643-76b059933f03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:36.238215 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbfe0b33-da1b-4eb5-8643-76b059933f03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:36.782473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cbfe0b33-da1b-4eb5-8643-76b059933f03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:36.811959 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cbfe0b33-da1b-4eb5-8643-76b059933f03 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.627908 Aug 24 10:37:36.832165 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2206/4802] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:36 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:36.832165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-16db3567-c2b4-4c0b-8386-0a245c02b0e5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:36.832165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-16db3567-c2b4-4c0b-8386-0a245c02b0e5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: b03ac06d-c767-4fd3-a252-1b84310d81a8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:36.852904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16db3567-c2b4-4c0b-8386-0a245c02b0e5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:36.856684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16db3567-c2b4-4c0b-8386-0a245c02b0e5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:36.858289 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16db3567-c2b4-4c0b-8386-0a245c02b0e5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:36.860369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16db3567-c2b4-4c0b-8386-0a245c02b0e5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:36.861012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16db3567-c2b4-4c0b-8386-0a245c02b0e5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:36.861681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16db3567-c2b4-4c0b-8386-0a245c02b0e5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:36.996196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-16db3567-c2b4-4c0b-8386-0a245c02b0e5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: b03ac06d-c767-4fd3-a252-1b84310d81a8] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:37:37.093590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a1703d31-73b8-4e52-8ad6-14634badb948 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:37:37.094845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a1703d31-73b8-4e52-8ad6-14634badb948 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:37:37.096719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a1703d31-73b8-4e52-8ad6-14634badb948 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:37:37.097413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a1703d31-73b8-4e52-8ad6-14634badb948 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:37:37.098040 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a1703d31-73b8-4e52-8ad6-14634badb948 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:37:37.121318 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1703d31-73b8-4e52-8ad6-14634badb948 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:37.122277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1703d31-73b8-4e52-8ad6-14634badb948 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:37.124388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1703d31-73b8-4e52-8ad6-14634badb948 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:37.128585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1703d31-73b8-4e52-8ad6-14634badb948 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:37.130300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1703d31-73b8-4e52-8ad6-14634badb948 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:37.131984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1703d31-73b8-4e52-8ad6-14634badb948 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:37.198749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-a1703d31-73b8-4e52-8ad6-14634badb948 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Getting quotas for project 2c9ad6902a1f4f2c807315e5ee3dc897. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:37:37.214949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-a1703d31-73b8-4e52-8ad6-14634badb948 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Getting quotas for user 3f1d12ba24f245b59b9af777352984d0 and project 2c9ad6902a1f4f2c807315e5ee3dc897. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:37:37.221067 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-16db3567-c2b4-4c0b-8386-0a245c02b0e5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8" status: 204 len: 0 microversion: 2.1 time: 0.395265 Aug 24 10:37:37.222955 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2207/4803] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:37:36 2022] DELETE /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:37:37.239675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5e0a6013-4559-4680-a737-4f8c63a80fa5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:37.241753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5e0a6013-4559-4680-a737-4f8c63a80fa5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:37.257475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a1703d31-73b8-4e52-8ad6-14634badb948 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:37:37.286204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e0a6013-4559-4680-a737-4f8c63a80fa5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:37.286653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e0a6013-4559-4680-a737-4f8c63a80fa5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:37.291617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e0a6013-4559-4680-a737-4f8c63a80fa5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:37.295053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a1703d31-73b8-4e52-8ad6-14634badb948 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:37:37.296308 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e0a6013-4559-4680-a737-4f8c63a80fa5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:37.296809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e0a6013-4559-4680-a737-4f8c63a80fa5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:37.303716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e0a6013-4559-4680-a737-4f8c63a80fa5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:37.469332 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a1703d31-73b8-4e52-8ad6-14634badb948 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.318215 Aug 24 10:37:37.470418 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2597/4804] 10.222.0.85 () {62 vars in 1188 bytes} [Wed Aug 24 10:37:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 2332 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 10:37:37.490600 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a64b05d5-3ad3-46ba-813a-8f020378688e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:37.491861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a64b05d5-3ad3-46ba-813a-8f020378688e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: b03ac06d-c767-4fd3-a252-1b84310d81a8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:37.509694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a64b05d5-3ad3-46ba-813a-8f020378688e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:37.510603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a64b05d5-3ad3-46ba-813a-8f020378688e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:37.511450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a64b05d5-3ad3-46ba-813a-8f020378688e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:37.512405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a64b05d5-3ad3-46ba-813a-8f020378688e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:37.514189 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a64b05d5-3ad3-46ba-813a-8f020378688e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:37.514885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a64b05d5-3ad3-46ba-813a-8f020378688e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:37.978043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:38.012614 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5e0a6013-4559-4680-a737-4f8c63a80fa5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:38.025011 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5e0a6013-4559-4680-a737-4f8c63a80fa5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.799002 Aug 24 10:37:38.032815 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2208/4805] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:37 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:38.045617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7bf34358-4229-45ee-8332-d225de762811 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:38.047144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7bf34358-4229-45ee-8332-d225de762811 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:38.184234 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7bf34358-4229-45ee-8332-d225de762811 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:38.207895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7bf34358-4229-45ee-8332-d225de762811 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:38.226259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7bf34358-4229-45ee-8332-d225de762811 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:38.230468 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7bf34358-4229-45ee-8332-d225de762811 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1280 microversion: 2.20 time: 0.196130 Aug 24 10:37:38.233443 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2209/4806] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:37:38 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1280 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:37:38.244793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ede452a4-35ff-4c69-8049-4e7eecf21f34 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:38.245719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ede452a4-35ff-4c69-8049-4e7eecf21f34 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:38.284307 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ede452a4-35ff-4c69-8049-4e7eecf21f34 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:38.285006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ede452a4-35ff-4c69-8049-4e7eecf21f34 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:38.288484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ede452a4-35ff-4c69-8049-4e7eecf21f34 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:38.289481 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ede452a4-35ff-4c69-8049-4e7eecf21f34 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:38.290363 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ede452a4-35ff-4c69-8049-4e7eecf21f34 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:38.293086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ede452a4-35ff-4c69-8049-4e7eecf21f34 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:38.726051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ede452a4-35ff-4c69-8049-4e7eecf21f34 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:38.744535 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ede452a4-35ff-4c69-8049-4e7eecf21f34 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.509797 Aug 24 10:37:38.747114 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2210/4807] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:38 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:38.785780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5905a8f7-ddc3-4e2d-85bb-86696a5f562a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:38.786507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5905a8f7-ddc3-4e2d-85bb-86696a5f562a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:38.799934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5905a8f7-ddc3-4e2d-85bb-86696a5f562a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:38.800845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5905a8f7-ddc3-4e2d-85bb-86696a5f562a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:38.801660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5905a8f7-ddc3-4e2d-85bb-86696a5f562a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:38.806301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5905a8f7-ddc3-4e2d-85bb-86696a5f562a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:38.810558 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5905a8f7-ddc3-4e2d-85bb-86696a5f562a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:38.812940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5905a8f7-ddc3-4e2d-85bb-86696a5f562a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:39.089836 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5905a8f7-ddc3-4e2d-85bb-86696a5f562a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:39.099272 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5905a8f7-ddc3-4e2d-85bb-86696a5f562a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.334877 Aug 24 10:37:39.113148 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2211/4808] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:38 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:39.120411 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a9654cda-559c-45d1-8975-43f0b537cbcc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:39.121475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a9654cda-559c-45d1-8975-43f0b537cbcc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:39.128657 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9654cda-559c-45d1-8975-43f0b537cbcc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:39.130353 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9654cda-559c-45d1-8975-43f0b537cbcc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:39.130970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9654cda-559c-45d1-8975-43f0b537cbcc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:39.132109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9654cda-559c-45d1-8975-43f0b537cbcc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:39.132983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9654cda-559c-45d1-8975-43f0b537cbcc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:39.133588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9654cda-559c-45d1-8975-43f0b537cbcc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:39.346856 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a9654cda-559c-45d1-8975-43f0b537cbcc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:39.354781 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a9654cda-559c-45d1-8975-43f0b537cbcc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.238418 Aug 24 10:37:39.355375 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2212/4809] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:39 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:37:39.375852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-28ab6dc0-17cb-4141-9d97-0ebb3bb0c37e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:39.377729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-28ab6dc0-17cb-4141-9d97-0ebb3bb0c37e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:39.385820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28ab6dc0-17cb-4141-9d97-0ebb3bb0c37e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:39.386615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28ab6dc0-17cb-4141-9d97-0ebb3bb0c37e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:39.387239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28ab6dc0-17cb-4141-9d97-0ebb3bb0c37e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:39.388479 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28ab6dc0-17cb-4141-9d97-0ebb3bb0c37e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:39.389297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28ab6dc0-17cb-4141-9d97-0ebb3bb0c37e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:39.390207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28ab6dc0-17cb-4141-9d97-0ebb3bb0c37e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:39.482565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-28ab6dc0-17cb-4141-9d97-0ebb3bb0c37e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:39.495871 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-28ab6dc0-17cb-4141-9d97-0ebb3bb0c37e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:39.497647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-28ab6dc0-17cb-4141-9d97-0ebb3bb0c37e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:39.498819 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-28ab6dc0-17cb-4141-9d97-0ebb3bb0c37e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1332 microversion: 2.20 time: 0.128056 Aug 24 10:37:39.499402 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2213/4810] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:37:39 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1332 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:37:39.512066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-363d6e17-9e0a-44b7-9b1d-0fdf81e2d562 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:39.512708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a64b05d5-3ad3-46ba-813a-8f020378688e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:39.516569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:39.526859 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a64b05d5-3ad3-46ba-813a-8f020378688e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8" status: 200 len: 1507 microversion: 2.1 time: 2.054908 Aug 24 10:37:39.530130 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2598/4811] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:37 2022] GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8 => generated 1507 bytes in 2059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:39.544085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-363d6e17-9e0a-44b7-9b1d-0fdf81e2d562 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:39.550865 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-363d6e17-9e0a-44b7-9b1d-0fdf81e2d562 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:39.551575 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-363d6e17-9e0a-44b7-9b1d-0fdf81e2d562 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:39.552198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-363d6e17-9e0a-44b7-9b1d-0fdf81e2d562 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:39.553072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-363d6e17-9e0a-44b7-9b1d-0fdf81e2d562 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:39.554002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-363d6e17-9e0a-44b7-9b1d-0fdf81e2d562 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:39.554615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-363d6e17-9e0a-44b7-9b1d-0fdf81e2d562 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:39.912483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-363d6e17-9e0a-44b7-9b1d-0fdf81e2d562 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:39.922033 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-363d6e17-9e0a-44b7-9b1d-0fdf81e2d562 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.421535 Aug 24 10:37:39.928543 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2214/4812] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:39 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:40.527170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0940926b-9c67-4917-ab81-95f92cee5462 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:40.528441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0940926b-9c67-4917-ab81-95f92cee5462 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:40.551416 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-01cc496b-a1ac-4475-b438-fd0557e7615d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:40.552267 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-01cc496b-a1ac-4475-b438-fd0557e7615d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: b03ac06d-c767-4fd3-a252-1b84310d81a8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:40.567340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0940926b-9c67-4917-ab81-95f92cee5462 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:40.567945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0940926b-9c67-4917-ab81-95f92cee5462 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:40.570058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01cc496b-a1ac-4475-b438-fd0557e7615d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:40.570613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01cc496b-a1ac-4475-b438-fd0557e7615d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:40.571056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01cc496b-a1ac-4475-b438-fd0557e7615d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:40.571780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01cc496b-a1ac-4475-b438-fd0557e7615d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:40.574512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0940926b-9c67-4917-ab81-95f92cee5462 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:40.578786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0940926b-9c67-4917-ab81-95f92cee5462 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:40.581827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01cc496b-a1ac-4475-b438-fd0557e7615d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:40.582339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01cc496b-a1ac-4475-b438-fd0557e7615d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:40.584374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0940926b-9c67-4917-ab81-95f92cee5462 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:40.584883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0940926b-9c67-4917-ab81-95f92cee5462 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:40.686656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:40.837173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-01cc496b-a1ac-4475-b438-fd0557e7615d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:40.846027 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-01cc496b-a1ac-4475-b438-fd0557e7615d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8" status: 200 len: 1465 microversion: 2.1 time: 0.299338 Aug 24 10:37:40.846630 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2215/4813] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:40 2022] GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8 => generated 1465 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:41.051248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0940926b-9c67-4917-ab81-95f92cee5462 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:41.064183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0940926b-9c67-4917-ab81-95f92cee5462 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:41.083309 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0940926b-9c67-4917-ab81-95f92cee5462 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:41.085183 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0940926b-9c67-4917-ab81-95f92cee5462 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1338 microversion: 2.20 time: 0.562973 Aug 24 10:37:41.087193 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2599/4814] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:37:40 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1338 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:37:41.174644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-cf0e3774-07ed-41eb-8259-3236193ca318 req-2b1c9bd3-6403-4eae-ba22-5d72edfb81d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b03ac06d-c767-4fd3-a252-1b84310d81a8", "name": "network-vif-deleted", "tag": "9d952754-2d88-4879-8505-2eec015092f0"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:41.200708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cf0e3774-07ed-41eb-8259-3236193ca318 req-2b1c9bd3-6403-4eae-ba22-5d72edfb81d7 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:41.204020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cf0e3774-07ed-41eb-8259-3236193ca318 req-2b1c9bd3-6403-4eae-ba22-5d72edfb81d7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:41.206398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cf0e3774-07ed-41eb-8259-3236193ca318 req-2b1c9bd3-6403-4eae-ba22-5d72edfb81d7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:41.263731 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-cf0e3774-07ed-41eb-8259-3236193ca318 req-2b1c9bd3-6403-4eae-ba22-5d72edfb81d7 service nova] Creating event network-vif-deleted:9d952754-2d88-4879-8505-2eec015092f0 for instance b03ac06d-c767-4fd3-a252-1b84310d81a8 on n-h2-849328-3 Aug 24 10:37:41.275490 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-cf0e3774-07ed-41eb-8259-3236193ca318 req-2b1c9bd3-6403-4eae-ba22-5d72edfb81d7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105108 Aug 24 10:37:41.281271 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2216/4815] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:37:41.870978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0690186a-eda9-4d87-abdf-8e7cc5ba3cf3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:41.871684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0690186a-eda9-4d87-abdf-8e7cc5ba3cf3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: b03ac06d-c767-4fd3-a252-1b84310d81a8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:41.894282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0690186a-eda9-4d87-abdf-8e7cc5ba3cf3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:41.895022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0690186a-eda9-4d87-abdf-8e7cc5ba3cf3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:41.902586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0690186a-eda9-4d87-abdf-8e7cc5ba3cf3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:41.903666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0690186a-eda9-4d87-abdf-8e7cc5ba3cf3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:41.904165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0690186a-eda9-4d87-abdf-8e7cc5ba3cf3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:41.904617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0690186a-eda9-4d87-abdf-8e7cc5ba3cf3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:42.023928 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0690186a-eda9-4d87-abdf-8e7cc5ba3cf3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:42.025355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0690186a-eda9-4d87-abdf-8e7cc5ba3cf3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:42.028421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0690186a-eda9-4d87-abdf-8e7cc5ba3cf3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:42.030446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-0690186a-eda9-4d87-abdf-8e7cc5ba3cf3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lazy-loading 'fault' on Instance uuid b03ac06d-c767-4fd3-a252-1b84310d81a8 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:37:42.115594 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-79122001-1df5-40df-aa1c-e44f4755aa4a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:42.128000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-79122001-1df5-40df-aa1c-e44f4755aa4a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:42.155848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79122001-1df5-40df-aa1c-e44f4755aa4a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:42.157707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79122001-1df5-40df-aa1c-e44f4755aa4a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:42.161926 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79122001-1df5-40df-aa1c-e44f4755aa4a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:42.162979 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79122001-1df5-40df-aa1c-e44f4755aa4a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:42.165691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79122001-1df5-40df-aa1c-e44f4755aa4a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:42.166394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79122001-1df5-40df-aa1c-e44f4755aa4a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:42.236136 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0690186a-eda9-4d87-abdf-8e7cc5ba3cf3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:42.244440 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0690186a-eda9-4d87-abdf-8e7cc5ba3cf3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8" status: 200 len: 1310 microversion: 2.1 time: 0.380791 Aug 24 10:37:42.249559 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2600/4816] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:41 2022] GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8 => generated 1310 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:42.801615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-79122001-1df5-40df-aa1c-e44f4755aa4a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:42.810955 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-79122001-1df5-40df-aa1c-e44f4755aa4a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:42.851892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-79122001-1df5-40df-aa1c-e44f4755aa4a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:42.859428 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-79122001-1df5-40df-aa1c-e44f4755aa4a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1406 microversion: 2.20 time: 0.749142 Aug 24 10:37:42.864178 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2217/4817] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:37:42 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1406 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:37:43.268721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b1e8f4f4-45bd-4e9b-9687-ce363f6ce02d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:43.270656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b1e8f4f4-45bd-4e9b-9687-ce363f6ce02d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: b03ac06d-c767-4fd3-a252-1b84310d81a8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:43.289498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1e8f4f4-45bd-4e9b-9687-ce363f6ce02d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:43.290284 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1e8f4f4-45bd-4e9b-9687-ce363f6ce02d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:43.291322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1e8f4f4-45bd-4e9b-9687-ce363f6ce02d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:43.292468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1e8f4f4-45bd-4e9b-9687-ce363f6ce02d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:43.293212 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1e8f4f4-45bd-4e9b-9687-ce363f6ce02d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:43.294460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1e8f4f4-45bd-4e9b-9687-ce363f6ce02d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:43.315447 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-b1e8f4f4-45bd-4e9b-9687-ce363f6ce02d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] HTTP exception thrown: Instance b03ac06d-c767-4fd3-a252-1b84310d81a8 could not be found. Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b1e8f4f4-45bd-4e9b-9687-ce363f6ce02d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Request method failure captured: Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8 HTTP/1.1 Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf8_-svoJ82Zcz3LMtRJH-LxEmi7YhL3SyNjhBkMMhmGqnW0J0hM18TP4MYYa3JryjRkfD6MJWxRrI1tc6yKAxu9hD6H4E3SSBMepuWzyz5efbHaNXS1nRaEb6aE-x3oa0iXQadiBh1CoF_uoY7wN-kywJAG1lWDamBR5UsabCRziuM Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersTestJSON-523633018 Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8b489eabb0014ddc9a2fcdf6e78ee740", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8b489eabb0014ddc9a2fcdf6e78ee740"}]}] Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersTestJSON-523633018 Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersTestJSON-523633018 Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersTestJSON-523633018-project Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 83a25a0677c04f8ba975528ece80d676 Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersTestJSON-523633018-project Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance b03ac06d-c767-4fd3-a252-1b84310d81a8 could not be found. Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'b03ac06d-c767-4fd3-a252-1b84310d81a8'} Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b03ac06d-c767-4fd3-a252-1b84310d81a8 could not be found. Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b03ac06d-c767-4fd3-a252-1b84310d81a8 could not be found. Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:43.331648 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:37:43.337171 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:37:43.337171 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:37:43.337171 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:37:43.337171 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:37:43.337171 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b03ac06d-c767-4fd3-a252-1b84310d81a8 could not be found. Aug 24 10:37:43.337171 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:37:43.339237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b1e8f4f4-45bd-4e9b-9687-ce363f6ce02d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Returning 404 to user: Instance b03ac06d-c767-4fd3-a252-1b84310d81a8 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:37:43.343230 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b1e8f4f4-45bd-4e9b-9687-ce363f6ce02d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8" status: 404 len: 111 microversion: 2.1 time: 0.076401 Aug 24 10:37:43.344273 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2601/4818] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:43 2022] GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:37:43.359653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-41b28185-94c6-4b9b-af52-fe9d83d58178 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Action: 'create', calling method: .version_select at 0x7f4654195f70>, body: {"keypair": {"name": "tempest-key-620670873", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwXrwia3JowzMHgfw0Mi1WYqFGytpnyisVi12GONCdIXbkuPZccleXPEbjvqza8ncWr6QDQtBCDYoV6FElinvMQXNml8rJyQd7Zi/DFdsAASUzoO3p21gxMfniWmpiUFw=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:43.416919 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-41b28185-94c6-4b9b-af52-fe9d83d58178 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Getting quotas for project 8b489eabb0014ddc9a2fcdf6e78ee740. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:37:43.446910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-41b28185-94c6-4b9b-af52-fe9d83d58178 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Getting quotas for user 83a25a0677c04f8ba975528ece80d676 and project 8b489eabb0014ddc9a2fcdf6e78ee740. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:37:43.571067 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-41b28185-94c6-4b9b-af52-fe9d83d58178 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.214534 Aug 24 10:37:43.573203 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2218/4819] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:37:43 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:37:43.601979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1d7ad51a-6242-4e91-a777-b9da5a4e4368 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '.version_select at 0x7f465a1d0430>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:43.630954 n-d-849328-3 devstack@n-api.service[122433]: WARNING oslo_db.sqlalchemy.utils [None req-1d7ad51a-6242-4e91-a777-b9da5a4e4368 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 24 10:37:43.657839 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1d7ad51a-6242-4e91-a777-b9da5a4e4368 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.061679 Aug 24 10:37:43.660137 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2602/4820] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:37:43 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:37:43.890057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7cb4e002-746b-4741-82db-799f05ae8bdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:43.891029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7cb4e002-746b-4741-82db-799f05ae8bdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:43.900674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cb4e002-746b-4741-82db-799f05ae8bdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:43.905186 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cb4e002-746b-4741-82db-799f05ae8bdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:43.905917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cb4e002-746b-4741-82db-799f05ae8bdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:43.906875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cb4e002-746b-4741-82db-799f05ae8bdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:43.909534 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cb4e002-746b-4741-82db-799f05ae8bdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:43.914091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cb4e002-746b-4741-82db-799f05ae8bdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:44.050052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c42e4299-ef92-4dc7-b1bb-858334d30c1f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-951008767", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "key_name": "tempest-key-620670873", "networks": [{"uuid": "444806fc-9684-467f-82d3-8ae5206eec37"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:44.251388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-c42e4299-ef92-4dc7-b1bb-858334d30c1f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] validate_networks() for [('444806fc-9684-467f-82d3-8ae5206eec37', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:37:44.529483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7cb4e002-746b-4741-82db-799f05ae8bdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:44.545894 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7cb4e002-746b-4741-82db-799f05ae8bdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:44.551342 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7cb4e002-746b-4741-82db-799f05ae8bdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:44.553537 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7cb4e002-746b-4741-82db-799f05ae8bdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1406 microversion: 2.20 time: 0.669693 Aug 24 10:37:44.572924 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2219/4821] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:37:43 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1406 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:37:45.075711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3a3bff19-6c22-4325-b008-e5b1518a8fa4 req-ccacac0a-218c-499c-9963-66cb1f49871a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e", "tag": "04bfe8b2-85f8-48c0-83cc-8a238d22af80"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:45.104459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3a3bff19-6c22-4325-b008-e5b1518a8fa4 req-ccacac0a-218c-499c-9963-66cb1f49871a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:45.109555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3a3bff19-6c22-4325-b008-e5b1518a8fa4 req-ccacac0a-218c-499c-9963-66cb1f49871a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:45.109999 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3a3bff19-6c22-4325-b008-e5b1518a8fa4 req-ccacac0a-218c-499c-9963-66cb1f49871a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:45.161607 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3a3bff19-6c22-4325-b008-e5b1518a8fa4 req-ccacac0a-218c-499c-9963-66cb1f49871a service nova] Creating event network-changed:04bfe8b2-85f8-48c0-83cc-8a238d22af80 for instance 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e on n-h1-849328-3 Aug 24 10:37:45.173488 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3a3bff19-6c22-4325-b008-e5b1518a8fa4 req-ccacac0a-218c-499c-9963-66cb1f49871a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100420 Aug 24 10:37:45.176774 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2220/4822] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:37:45.586126 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c5eca901-e621-4784-ad68-45e1818bfbff tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:45.586826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c5eca901-e621-4784-ad68-45e1818bfbff tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:45.606236 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5eca901-e621-4784-ad68-45e1818bfbff tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:45.607073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5eca901-e621-4784-ad68-45e1818bfbff tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:45.607679 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5eca901-e621-4784-ad68-45e1818bfbff tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:45.608589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5eca901-e621-4784-ad68-45e1818bfbff tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:45.609230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5eca901-e621-4784-ad68-45e1818bfbff tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:45.609819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5eca901-e621-4784-ad68-45e1818bfbff tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:46.104539 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c5eca901-e621-4784-ad68-45e1818bfbff tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:46.114112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c5eca901-e621-4784-ad68-45e1818bfbff tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:46.119349 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c5eca901-e621-4784-ad68-45e1818bfbff tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:46.123246 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c5eca901-e621-4784-ad68-45e1818bfbff tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1406 microversion: 2.20 time: 0.542980 Aug 24 10:37:46.131735 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2221/4823] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:37:45 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1406 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:37:46.575184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c42e4299-ef92-4dc7-b1bb-858334d30c1f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:37:46.575791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c42e4299-ef92-4dc7-b1bb-858334d30c1f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:37:46.576272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c42e4299-ef92-4dc7-b1bb-858334d30c1f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:37:46.576685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c42e4299-ef92-4dc7-b1bb-858334d30c1f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:37:46.577100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c42e4299-ef92-4dc7-b1bb-858334d30c1f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:37:46.621846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c42e4299-ef92-4dc7-b1bb-858334d30c1f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:46.623464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c42e4299-ef92-4dc7-b1bb-858334d30c1f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:46.631525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c42e4299-ef92-4dc7-b1bb-858334d30c1f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:46.633594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c42e4299-ef92-4dc7-b1bb-858334d30c1f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:46.634473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c42e4299-ef92-4dc7-b1bb-858334d30c1f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:46.636133 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c42e4299-ef92-4dc7-b1bb-858334d30c1f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:46.686559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-c42e4299-ef92-4dc7-b1bb-858334d30c1f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Getting quotas for project 8b489eabb0014ddc9a2fcdf6e78ee740. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:37:46.693859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-c42e4299-ef92-4dc7-b1bb-858334d30c1f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Getting quotas for user 83a25a0677c04f8ba975528ece80d676 and project 8b489eabb0014ddc9a2fcdf6e78ee740. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:37:46.726731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c42e4299-ef92-4dc7-b1bb-858334d30c1f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:37:46.733700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c42e4299-ef92-4dc7-b1bb-858334d30c1f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0796aa2e-d174-4e03-b8e9-7b836ba9f485] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:37:46.851754 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c42e4299-ef92-4dc7-b1bb-858334d30c1f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.806622 Aug 24 10:37:46.863600 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4ed8003d-2629-41a7-bb35-b26b20f31ad7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:46.864192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4ed8003d-2629-41a7-bb35-b26b20f31ad7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0796aa2e-d174-4e03-b8e9-7b836ba9f485] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:46.874311 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2603/4824] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:37:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:37:47.074518 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4ed8003d-2629-41a7-bb35-b26b20f31ad7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:47.084036 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4ed8003d-2629-41a7-bb35-b26b20f31ad7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485" status: 200 len: 1227 microversion: 2.1 time: 0.224504 Aug 24 10:37:47.088922 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2222/4825] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:46 2022] GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485 => generated 1227 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:47.156610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b630542b-2808-4246-ba24-1b5180e7d950 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:47.157266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b630542b-2808-4246-ba24-1b5180e7d950 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:47.168963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b630542b-2808-4246-ba24-1b5180e7d950 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:47.181145 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b630542b-2808-4246-ba24-1b5180e7d950 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:47.182919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b630542b-2808-4246-ba24-1b5180e7d950 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:47.184569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b630542b-2808-4246-ba24-1b5180e7d950 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:47.186151 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b630542b-2808-4246-ba24-1b5180e7d950 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:47.187495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b630542b-2808-4246-ba24-1b5180e7d950 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:48.120010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0e76a779-1f10-4f99-b1cf-e68bb706e3c5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:48.120645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0e76a779-1f10-4f99-b1cf-e68bb706e3c5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0796aa2e-d174-4e03-b8e9-7b836ba9f485] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:48.164148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:48.312136 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b630542b-2808-4246-ba24-1b5180e7d950 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:48.339120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b630542b-2808-4246-ba24-1b5180e7d950 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:48.348291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b630542b-2808-4246-ba24-1b5180e7d950 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:48.351932 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b630542b-2808-4246-ba24-1b5180e7d950 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1406 microversion: 2.20 time: 1.199294 Aug 24 10:37:48.357001 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2604/4826] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:37:47 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1406 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:37:48.358688 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0e76a779-1f10-4f99-b1cf-e68bb706e3c5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:48.369252 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0e76a779-1f10-4f99-b1cf-e68bb706e3c5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485" status: 200 len: 1227 microversion: 2.1 time: 0.253109 Aug 24 10:37:48.374850 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2223/4827] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:48 2022] GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485 => generated 1227 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:37:49.401584 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-54d747a9-f10f-4301-aa4b-722777e6370d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:49.403614 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-54d747a9-f10f-4301-aa4b-722777e6370d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0796aa2e-d174-4e03-b8e9-7b836ba9f485] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:49.417328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-557413fc-b3dd-490a-9d16-95bf3345b4d3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:49.418832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-557413fc-b3dd-490a-9d16-95bf3345b4d3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:49.435564 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54d747a9-f10f-4301-aa4b-722777e6370d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:49.436055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54d747a9-f10f-4301-aa4b-722777e6370d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:49.436486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54d747a9-f10f-4301-aa4b-722777e6370d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:49.437220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54d747a9-f10f-4301-aa4b-722777e6370d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:49.438893 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54d747a9-f10f-4301-aa4b-722777e6370d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:49.438893 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54d747a9-f10f-4301-aa4b-722777e6370d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:49.475091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-557413fc-b3dd-490a-9d16-95bf3345b4d3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:49.475633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-557413fc-b3dd-490a-9d16-95bf3345b4d3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:49.476053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-557413fc-b3dd-490a-9d16-95bf3345b4d3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:49.476805 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-557413fc-b3dd-490a-9d16-95bf3345b4d3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:49.477300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-557413fc-b3dd-490a-9d16-95bf3345b4d3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:49.477747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-557413fc-b3dd-490a-9d16-95bf3345b4d3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:49.742336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-54d747a9-f10f-4301-aa4b-722777e6370d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:49.760249 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-54d747a9-f10f-4301-aa4b-722777e6370d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485" status: 200 len: 1287 microversion: 2.1 time: 0.361927 Aug 24 10:37:49.760401 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2224/4828] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:49 2022] GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485 => generated 1287 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:50.352632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-557413fc-b3dd-490a-9d16-95bf3345b4d3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:50.361456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-557413fc-b3dd-490a-9d16-95bf3345b4d3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:50.373396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-557413fc-b3dd-490a-9d16-95bf3345b4d3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:50.374981 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-557413fc-b3dd-490a-9d16-95bf3345b4d3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1406 microversion: 2.20 time: 0.992338 Aug 24 10:37:50.376131 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2605/4829] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:37:49 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1406 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:37:50.793171 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-de18c62e-4653-489a-88c9-a23256a2e1d6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:50.794029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-de18c62e-4653-489a-88c9-a23256a2e1d6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0796aa2e-d174-4e03-b8e9-7b836ba9f485] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:50.806880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de18c62e-4653-489a-88c9-a23256a2e1d6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:50.807040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de18c62e-4653-489a-88c9-a23256a2e1d6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:50.812217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de18c62e-4653-489a-88c9-a23256a2e1d6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:50.813181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de18c62e-4653-489a-88c9-a23256a2e1d6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:50.813656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de18c62e-4653-489a-88c9-a23256a2e1d6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:50.814089 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de18c62e-4653-489a-88c9-a23256a2e1d6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:50.968557 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-de18c62e-4653-489a-88c9-a23256a2e1d6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:50.986605 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-de18c62e-4653-489a-88c9-a23256a2e1d6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485" status: 200 len: 1285 microversion: 2.1 time: 0.193963 Aug 24 10:37:51.008396 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2225/4830] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:50 2022] GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485 => generated 1285 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:51.401904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2119106b-5f5d-41c0-956f-784fdc6910a8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:51.402751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2119106b-5f5d-41c0-956f-784fdc6910a8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:51.412171 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:51.444847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2119106b-5f5d-41c0-956f-784fdc6910a8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:51.445713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2119106b-5f5d-41c0-956f-784fdc6910a8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:51.447635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2119106b-5f5d-41c0-956f-784fdc6910a8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:51.449033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2119106b-5f5d-41c0-956f-784fdc6910a8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:51.453306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2119106b-5f5d-41c0-956f-784fdc6910a8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:51.454830 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2119106b-5f5d-41c0-956f-784fdc6910a8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:52.007884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4e524453-4e79-4efd-8d8e-34a6d164fe01 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:52.009406 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4e524453-4e79-4efd-8d8e-34a6d164fe01 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0796aa2e-d174-4e03-b8e9-7b836ba9f485] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:52.026773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e524453-4e79-4efd-8d8e-34a6d164fe01 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:52.030391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e524453-4e79-4efd-8d8e-34a6d164fe01 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:52.031590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e524453-4e79-4efd-8d8e-34a6d164fe01 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:52.033949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e524453-4e79-4efd-8d8e-34a6d164fe01 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:52.036400 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e524453-4e79-4efd-8d8e-34a6d164fe01 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:52.037793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e524453-4e79-4efd-8d8e-34a6d164fe01 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:52.181768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2119106b-5f5d-41c0-956f-784fdc6910a8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:52.196857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2119106b-5f5d-41c0-956f-784fdc6910a8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:52.203127 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2119106b-5f5d-41c0-956f-784fdc6910a8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:52.204771 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2119106b-5f5d-41c0-956f-784fdc6910a8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1406 microversion: 2.20 time: 0.810570 Aug 24 10:37:52.220127 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2606/4831] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:37:51 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1406 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:37:52.298535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4e524453-4e79-4efd-8d8e-34a6d164fe01 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:52.313369 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4e524453-4e79-4efd-8d8e-34a6d164fe01 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485" status: 200 len: 1285 microversion: 2.1 time: 0.308799 Aug 24 10:37:52.328206 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2226/4832] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:52 2022] GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485 => generated 1285 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:37:53.256374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-3e54dc8d-f9e7-40cc-b825-beb5832f088d req-c9676625-60fe-42af-a4bd-761e1a3560de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e", "name": "network-vif-plugged", "status": "completed", "tag": "04bfe8b2-85f8-48c0-83cc-8a238d22af80"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:53.257094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2692097a-d70c-450a-8fbe-d8b58876adbf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:53.259532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2692097a-d70c-450a-8fbe-d8b58876adbf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:53.277507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2692097a-d70c-450a-8fbe-d8b58876adbf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:53.286609 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2692097a-d70c-450a-8fbe-d8b58876adbf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:53.291593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2692097a-d70c-450a-8fbe-d8b58876adbf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:53.292528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2692097a-d70c-450a-8fbe-d8b58876adbf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:53.294243 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2692097a-d70c-450a-8fbe-d8b58876adbf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:53.296207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3e54dc8d-f9e7-40cc-b825-beb5832f088d req-c9676625-60fe-42af-a4bd-761e1a3560de service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:53.296782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2692097a-d70c-450a-8fbe-d8b58876adbf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:53.304441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3e54dc8d-f9e7-40cc-b825-beb5832f088d req-c9676625-60fe-42af-a4bd-761e1a3560de service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:53.304980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3e54dc8d-f9e7-40cc-b825-beb5832f088d req-c9676625-60fe-42af-a4bd-761e1a3560de service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:53.346441 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-3e54dc8d-f9e7-40cc-b825-beb5832f088d req-c9676625-60fe-42af-a4bd-761e1a3560de service nova] Creating event network-vif-plugged:04bfe8b2-85f8-48c0-83cc-8a238d22af80 for instance 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e on n-h1-849328-3 Aug 24 10:37:53.368135 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-3e54dc8d-f9e7-40cc-b825-beb5832f088d req-c9676625-60fe-42af-a4bd-761e1a3560de service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127894 Aug 24 10:37:53.385750 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2607/4833] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:37:53.398577 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5664c1e2-798e-41b7-a468-9164a0e69582 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:53.400587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5664c1e2-798e-41b7-a468-9164a0e69582 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0796aa2e-d174-4e03-b8e9-7b836ba9f485] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:53.416629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5664c1e2-798e-41b7-a468-9164a0e69582 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:53.418592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5664c1e2-798e-41b7-a468-9164a0e69582 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:53.419608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5664c1e2-798e-41b7-a468-9164a0e69582 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:53.430607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5664c1e2-798e-41b7-a468-9164a0e69582 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:53.431995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5664c1e2-798e-41b7-a468-9164a0e69582 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:53.433473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5664c1e2-798e-41b7-a468-9164a0e69582 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:53.773885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2692097a-d70c-450a-8fbe-d8b58876adbf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:53.790345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2692097a-d70c-450a-8fbe-d8b58876adbf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:53.792463 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2692097a-d70c-450a-8fbe-d8b58876adbf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:53.793676 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2692097a-d70c-450a-8fbe-d8b58876adbf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1406 microversion: 2.20 time: 0.551294 Aug 24 10:37:53.794295 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2227/4834] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:37:53 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1406 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:37:54.051271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5664c1e2-798e-41b7-a468-9164a0e69582 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:54.072542 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5664c1e2-798e-41b7-a468-9164a0e69582 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485" status: 200 len: 1327 microversion: 2.1 time: 0.685083 Aug 24 10:37:54.078361 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2608/4835] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:53 2022] GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485 => generated 1327 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:54.310559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3d0486e4-75f5-49d7-8ebf-c088aba324bc tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1465867444", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "8b7b8776-46d3-46cb-b646-b9f4c31ddb5b"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:54.461325 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-3d0486e4-75f5-49d7-8ebf-c088aba324bc tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] validate_networks() for [('8b7b8776-46d3-46cb-b646-b9f4c31ddb5b', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:37:54.825945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0fec12e7-d68b-41ef-bc71-0de1578051f5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:54.829686 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0fec12e7-d68b-41ef-bc71-0de1578051f5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:54.860646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fec12e7-d68b-41ef-bc71-0de1578051f5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:54.861194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fec12e7-d68b-41ef-bc71-0de1578051f5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:54.876307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fec12e7-d68b-41ef-bc71-0de1578051f5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:54.880116 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fec12e7-d68b-41ef-bc71-0de1578051f5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:54.882325 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fec12e7-d68b-41ef-bc71-0de1578051f5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:54.886781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fec12e7-d68b-41ef-bc71-0de1578051f5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:55.302392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0fec12e7-d68b-41ef-bc71-0de1578051f5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:55.319521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0fec12e7-d68b-41ef-bc71-0de1578051f5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:55.334002 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0fec12e7-d68b-41ef-bc71-0de1578051f5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:55.340334 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0fec12e7-d68b-41ef-bc71-0de1578051f5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1406 microversion: 2.20 time: 0.523956 Aug 24 10:37:55.355732 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2609/4836] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:37:54 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1406 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:37:55.355732 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ebfefa6b-a928-47ff-82b9-9589bf0f3d52 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:55.356332 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ebfefa6b-a928-47ff-82b9-9589bf0f3d52 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0796aa2e-d174-4e03-b8e9-7b836ba9f485] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:55.374899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebfefa6b-a928-47ff-82b9-9589bf0f3d52 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:55.376935 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebfefa6b-a928-47ff-82b9-9589bf0f3d52 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:55.379871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebfefa6b-a928-47ff-82b9-9589bf0f3d52 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:55.380778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebfefa6b-a928-47ff-82b9-9589bf0f3d52 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:55.385821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebfefa6b-a928-47ff-82b9-9589bf0f3d52 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:55.386654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebfefa6b-a928-47ff-82b9-9589bf0f3d52 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:55.945098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3d0486e4-75f5-49d7-8ebf-c088aba324bc tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:37:55.947606 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3d0486e4-75f5-49d7-8ebf-c088aba324bc tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:37:55.948612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3d0486e4-75f5-49d7-8ebf-c088aba324bc tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:37:55.949356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3d0486e4-75f5-49d7-8ebf-c088aba324bc tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:37:55.949945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3d0486e4-75f5-49d7-8ebf-c088aba324bc tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:37:55.967972 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d0486e4-75f5-49d7-8ebf-c088aba324bc tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:55.968716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d0486e4-75f5-49d7-8ebf-c088aba324bc tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:55.969462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d0486e4-75f5-49d7-8ebf-c088aba324bc tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:56.002215 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d0486e4-75f5-49d7-8ebf-c088aba324bc tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:56.003047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d0486e4-75f5-49d7-8ebf-c088aba324bc tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:56.003817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d0486e4-75f5-49d7-8ebf-c088aba324bc tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:56.071129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-3d0486e4-75f5-49d7-8ebf-c088aba324bc tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Getting quotas for project 833ef551b89b4ec19797a0b39223841b. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:37:56.096398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ebfefa6b-a928-47ff-82b9-9589bf0f3d52 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:56.113994 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-3d0486e4-75f5-49d7-8ebf-c088aba324bc tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Getting quotas for user ba4b57697a02461285581183eddcaf55 and project 833ef551b89b4ec19797a0b39223841b. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:37:56.127529 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ebfefa6b-a928-47ff-82b9-9589bf0f3d52 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485" status: 200 len: 1327 microversion: 2.1 time: 0.784927 Aug 24 10:37:56.129874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3d0486e4-75f5-49d7-8ebf-c088aba324bc tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:37:56.132646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3d0486e4-75f5-49d7-8ebf-c088aba324bc tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] [instance: 5987159c-d9d2-4205-902c-c4356925dc8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:37:56.136169 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2610/4837] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:55 2022] GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485 => generated 1327 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:56.147190 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-05ab8e74-a068-48cf-84ce-0827f64197cb req-2c7347a3-b05b-42f0-8e9b-c6e432586cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0796aa2e-d174-4e03-b8e9-7b836ba9f485", "tag": "3d5c7e91-2b1a-4808-887e-67ee426ca53d"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:37:56.193320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-05ab8e74-a068-48cf-84ce-0827f64197cb req-2c7347a3-b05b-42f0-8e9b-c6e432586cb7 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:56.195266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-05ab8e74-a068-48cf-84ce-0827f64197cb req-2c7347a3-b05b-42f0-8e9b-c6e432586cb7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:56.195949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-05ab8e74-a068-48cf-84ce-0827f64197cb req-2c7347a3-b05b-42f0-8e9b-c6e432586cb7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:56.212129 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3d0486e4-75f5-49d7-8ebf-c088aba324bc tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.157327 Aug 24 10:37:56.215488 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2228/4838] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:37:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:37:56.239170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2e0a6734-09e8-4845-8530-d11e1d842126 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:56.277035 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2e0a6734-09e8-4845-8530-d11e1d842126 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] [instance: 5987159c-d9d2-4205-902c-c4356925dc8e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:56.288874 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-05ab8e74-a068-48cf-84ce-0827f64197cb req-2c7347a3-b05b-42f0-8e9b-c6e432586cb7 service nova] Creating event network-changed:3d5c7e91-2b1a-4808-887e-67ee426ca53d for instance 0796aa2e-d174-4e03-b8e9-7b836ba9f485 on n-h2-849328-3 Aug 24 10:37:56.310653 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-05ab8e74-a068-48cf-84ce-0827f64197cb req-2c7347a3-b05b-42f0-8e9b-c6e432586cb7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170741 Aug 24 10:37:56.325513 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2611/4839] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:37:56.373074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2df2f5f8-7a5f-4d17-81a1-2e100f9a2040 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:56.374352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2df2f5f8-7a5f-4d17-81a1-2e100f9a2040 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:56.388030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2df2f5f8-7a5f-4d17-81a1-2e100f9a2040 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:56.389234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2df2f5f8-7a5f-4d17-81a1-2e100f9a2040 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:56.393688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2df2f5f8-7a5f-4d17-81a1-2e100f9a2040 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:56.395030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2df2f5f8-7a5f-4d17-81a1-2e100f9a2040 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:56.397268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2df2f5f8-7a5f-4d17-81a1-2e100f9a2040 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:56.400809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2df2f5f8-7a5f-4d17-81a1-2e100f9a2040 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:56.481880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2e0a6734-09e8-4845-8530-d11e1d842126 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4b57697a02461285581183eddcaf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833ef551b89b4ec19797a0b39223841b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:56.495127 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2e0a6734-09e8-4845-8530-d11e1d842126 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] 10.222.0.85 "GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e" status: 200 len: 1216 microversion: 2.1 time: 0.272540 Aug 24 10:37:56.501848 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2229/4840] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:56 2022] GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e => generated 1216 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:56.653207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:56.713099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=12 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:57.157087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3641070a-55f3-486e-aaf6-657691046848 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:57.157816 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3641070a-55f3-486e-aaf6-657691046848 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0796aa2e-d174-4e03-b8e9-7b836ba9f485] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:57.172252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3641070a-55f3-486e-aaf6-657691046848 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:57.172755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3641070a-55f3-486e-aaf6-657691046848 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:57.184401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3641070a-55f3-486e-aaf6-657691046848 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:57.187705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3641070a-55f3-486e-aaf6-657691046848 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:57.188248 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3641070a-55f3-486e-aaf6-657691046848 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:57.188703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3641070a-55f3-486e-aaf6-657691046848 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:57.912085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3641070a-55f3-486e-aaf6-657691046848 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:57.918228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2df2f5f8-7a5f-4d17-81a1-2e100f9a2040 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:57.951189 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3641070a-55f3-486e-aaf6-657691046848 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485" status: 200 len: 1327 microversion: 2.1 time: 0.795988 Aug 24 10:37:57.952911 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2230/4841] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:57 2022] GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485 => generated 1327 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:37:57.960363 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bfc5e3e2-2339-4b0a-89e9-a7a5e028d1ae tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:57.961337 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bfc5e3e2-2339-4b0a-89e9-a7a5e028d1ae tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] [instance: 5987159c-d9d2-4205-902c-c4356925dc8e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:57.973649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2df2f5f8-7a5f-4d17-81a1-2e100f9a2040 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:57.975511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfc5e3e2-2339-4b0a-89e9-a7a5e028d1ae tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:57.977405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfc5e3e2-2339-4b0a-89e9-a7a5e028d1ae tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:57.978130 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfc5e3e2-2339-4b0a-89e9-a7a5e028d1ae tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:57.980253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2df2f5f8-7a5f-4d17-81a1-2e100f9a2040 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:57.980755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfc5e3e2-2339-4b0a-89e9-a7a5e028d1ae tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:57.981781 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfc5e3e2-2339-4b0a-89e9-a7a5e028d1ae tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:57.982685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfc5e3e2-2339-4b0a-89e9-a7a5e028d1ae tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:57.990477 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2df2f5f8-7a5f-4d17-81a1-2e100f9a2040 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1598 microversion: 2.20 time: 1.621856 Aug 24 10:37:57.993777 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2612/4842] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:37:56 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1598 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:37:58.019765 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-998a7072-ede3-4037-aa07-b2cfc1b55cd0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:58.026701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-998a7072-ede3-4037-aa07-b2cfc1b55cd0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:58.043027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-998a7072-ede3-4037-aa07-b2cfc1b55cd0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:58.044150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-998a7072-ede3-4037-aa07-b2cfc1b55cd0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:58.044766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-998a7072-ede3-4037-aa07-b2cfc1b55cd0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:58.045743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-998a7072-ede3-4037-aa07-b2cfc1b55cd0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:58.046607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-998a7072-ede3-4037-aa07-b2cfc1b55cd0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:58.047308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-998a7072-ede3-4037-aa07-b2cfc1b55cd0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:58.155377 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bfc5e3e2-2339-4b0a-89e9-a7a5e028d1ae tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4b57697a02461285581183eddcaf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833ef551b89b4ec19797a0b39223841b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:58.179049 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bfc5e3e2-2339-4b0a-89e9-a7a5e028d1ae tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] 10.222.0.85 "GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e" status: 200 len: 1212 microversion: 2.1 time: 0.224296 Aug 24 10:37:58.186654 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2231/4843] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:57 2022] GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e => generated 1212 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:58.310608 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-998a7072-ede3-4037-aa07-b2cfc1b55cd0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.298728 Aug 24 10:37:58.311546 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2613/4844] 10.222.0.85 () {60 vars in 1316 bytes} [Wed Aug 24 10:37:58 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-interface => generated 284 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 10:37:58.976132 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0b95f906-0af3-475e-920c-b4f3873dac73 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:58.976915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0b95f906-0af3-475e-920c-b4f3873dac73 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0796aa2e-d174-4e03-b8e9-7b836ba9f485] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:58.999110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b95f906-0af3-475e-920c-b4f3873dac73 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:59.001099 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b95f906-0af3-475e-920c-b4f3873dac73 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:59.003235 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b95f906-0af3-475e-920c-b4f3873dac73 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:59.004382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b95f906-0af3-475e-920c-b4f3873dac73 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:59.007019 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b95f906-0af3-475e-920c-b4f3873dac73 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:59.007758 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b95f906-0af3-475e-920c-b4f3873dac73 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:59.211164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0465ec3c-af40-4743-b2a2-6d84059e16c2 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:37:59.212647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0465ec3c-af40-4743-b2a2-6d84059e16c2 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] [instance: 5987159c-d9d2-4205-902c-c4356925dc8e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:37:59.239257 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0465ec3c-af40-4743-b2a2-6d84059e16c2 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:59.240599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0465ec3c-af40-4743-b2a2-6d84059e16c2 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:59.251612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0465ec3c-af40-4743-b2a2-6d84059e16c2 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:59.252544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0465ec3c-af40-4743-b2a2-6d84059e16c2 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:37:59.253154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0465ec3c-af40-4743-b2a2-6d84059e16c2 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:37:59.253753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0465ec3c-af40-4743-b2a2-6d84059e16c2 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:37:59.316950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0b95f906-0af3-475e-920c-b4f3873dac73 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:59.328993 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0b95f906-0af3-475e-920c-b4f3873dac73 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485" status: 200 len: 1327 microversion: 2.1 time: 0.359847 Aug 24 10:37:59.330168 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2232/4845] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:58 2022] GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485 => generated 1327 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:37:59.459501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0465ec3c-af40-4743-b2a2-6d84059e16c2 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4b57697a02461285581183eddcaf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833ef551b89b4ec19797a0b39223841b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:37:59.472879 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0465ec3c-af40-4743-b2a2-6d84059e16c2 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] 10.222.0.85 "GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e" status: 200 len: 1268 microversion: 2.1 time: 0.267446 Aug 24 10:37:59.474974 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2614/4846] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:37:59 2022] GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e => generated 1268 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:38:00.350022 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-61739988-01d5-4c3c-9a19-f9541f70aeaf tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:00.350664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-61739988-01d5-4c3c-9a19-f9541f70aeaf tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0796aa2e-d174-4e03-b8e9-7b836ba9f485] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:00.364448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61739988-01d5-4c3c-9a19-f9541f70aeaf tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:00.366935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61739988-01d5-4c3c-9a19-f9541f70aeaf tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:00.367705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61739988-01d5-4c3c-9a19-f9541f70aeaf tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:00.371075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61739988-01d5-4c3c-9a19-f9541f70aeaf tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:00.371704 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61739988-01d5-4c3c-9a19-f9541f70aeaf tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:00.372303 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61739988-01d5-4c3c-9a19-f9541f70aeaf tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:00.500964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fe7a7ecc-e011-4f2b-a5db-616419316b73 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:00.501671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fe7a7ecc-e011-4f2b-a5db-616419316b73 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] [instance: 5987159c-d9d2-4205-902c-c4356925dc8e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:00.512172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe7a7ecc-e011-4f2b-a5db-616419316b73 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:00.512686 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe7a7ecc-e011-4f2b-a5db-616419316b73 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:00.513165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe7a7ecc-e011-4f2b-a5db-616419316b73 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:00.519383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe7a7ecc-e011-4f2b-a5db-616419316b73 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:00.519864 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe7a7ecc-e011-4f2b-a5db-616419316b73 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:00.522290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe7a7ecc-e011-4f2b-a5db-616419316b73 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:00.677021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fe7a7ecc-e011-4f2b-a5db-616419316b73 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4b57697a02461285581183eddcaf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833ef551b89b4ec19797a0b39223841b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:00.691024 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fe7a7ecc-e011-4f2b-a5db-616419316b73 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] 10.222.0.85 "GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e" status: 200 len: 1274 microversion: 2.1 time: 0.197495 Aug 24 10:38:00.713661 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2615/4847] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:00 2022] GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e => generated 1274 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:01.059739 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a48b8cab-ae44-4ecc-808e-a331c0025f92 req-8454a9fc-2005-4994-b31d-9a53db8a1301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e", "tag": "04bfe8b2-85f8-48c0-83cc-8a238d22af80"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:38:01.080310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a48b8cab-ae44-4ecc-808e-a331c0025f92 req-8454a9fc-2005-4994-b31d-9a53db8a1301 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:01.081673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a48b8cab-ae44-4ecc-808e-a331c0025f92 req-8454a9fc-2005-4994-b31d-9a53db8a1301 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:01.083113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a48b8cab-ae44-4ecc-808e-a331c0025f92 req-8454a9fc-2005-4994-b31d-9a53db8a1301 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:01.104772 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a48b8cab-ae44-4ecc-808e-a331c0025f92 req-8454a9fc-2005-4994-b31d-9a53db8a1301 service nova] Creating event network-changed:04bfe8b2-85f8-48c0-83cc-8a238d22af80 for instance 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e on n-h1-849328-3 Aug 24 10:38:01.112657 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a48b8cab-ae44-4ecc-808e-a331c0025f92 req-8454a9fc-2005-4994-b31d-9a53db8a1301 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059314 Aug 24 10:38:01.113659 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2616/4848] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:38:01.135842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-61739988-01d5-4c3c-9a19-f9541f70aeaf tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:01.146257 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-61739988-01d5-4c3c-9a19-f9541f70aeaf tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485" status: 200 len: 1327 microversion: 2.1 time: 0.800339 Aug 24 10:38:01.148426 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2233/4849] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:00 2022] GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485 => generated 1327 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:01.713302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1e130e00-27bf-46a6-a283-018d2638f250 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:01.714018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1e130e00-27bf-46a6-a283-018d2638f250 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] [instance: 5987159c-d9d2-4205-902c-c4356925dc8e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:01.727262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e130e00-27bf-46a6-a283-018d2638f250 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:01.729897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e130e00-27bf-46a6-a283-018d2638f250 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:01.730691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e130e00-27bf-46a6-a283-018d2638f250 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:01.731683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e130e00-27bf-46a6-a283-018d2638f250 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:01.733367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e130e00-27bf-46a6-a283-018d2638f250 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:01.734973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e130e00-27bf-46a6-a283-018d2638f250 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:01.916966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1e130e00-27bf-46a6-a283-018d2638f250 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4b57697a02461285581183eddcaf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833ef551b89b4ec19797a0b39223841b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:01.931399 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1e130e00-27bf-46a6-a283-018d2638f250 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] 10.222.0.85 "GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e" status: 200 len: 1274 microversion: 2.1 time: 0.223284 Aug 24 10:38:01.948388 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2617/4850] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:01 2022] GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e => generated 1274 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:02.168173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-982f0c15-49dd-4265-819c-f9c41e4af99b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:02.169104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-982f0c15-49dd-4265-819c-f9c41e4af99b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0796aa2e-d174-4e03-b8e9-7b836ba9f485] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:02.188334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-982f0c15-49dd-4265-819c-f9c41e4af99b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:02.189243 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-982f0c15-49dd-4265-819c-f9c41e4af99b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:02.193375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-982f0c15-49dd-4265-819c-f9c41e4af99b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:02.194528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-982f0c15-49dd-4265-819c-f9c41e4af99b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:02.196164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-982f0c15-49dd-4265-819c-f9c41e4af99b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:02.197140 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-982f0c15-49dd-4265-819c-f9c41e4af99b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:02.512540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-982f0c15-49dd-4265-819c-f9c41e4af99b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:02.521718 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-982f0c15-49dd-4265-819c-f9c41e4af99b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485" status: 200 len: 1327 microversion: 2.1 time: 0.357150 Aug 24 10:38:02.522396 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2234/4851] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:02 2022] GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485 => generated 1327 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:02.962524 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6d106f84-5cd1-45ac-8515-f2242dcc0df1 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:02.966455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6d106f84-5cd1-45ac-8515-f2242dcc0df1 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] [instance: 5987159c-d9d2-4205-902c-c4356925dc8e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:02.981232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d106f84-5cd1-45ac-8515-f2242dcc0df1 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:02.982469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d106f84-5cd1-45ac-8515-f2242dcc0df1 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:02.983174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d106f84-5cd1-45ac-8515-f2242dcc0df1 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:02.986354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d106f84-5cd1-45ac-8515-f2242dcc0df1 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:02.990454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d106f84-5cd1-45ac-8515-f2242dcc0df1 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:02.991006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d106f84-5cd1-45ac-8515-f2242dcc0df1 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:03.202464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a05e984b-6252-4c9c-994d-c8d000534165 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:38:03.205008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a05e984b-6252-4c9c-994d-c8d000534165 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:03.234973 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a05e984b-6252-4c9c-994d-c8d000534165 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:03.238093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a05e984b-6252-4c9c-994d-c8d000534165 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:03.238777 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a05e984b-6252-4c9c-994d-c8d000534165 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:03.252093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a05e984b-6252-4c9c-994d-c8d000534165 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:03.252795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a05e984b-6252-4c9c-994d-c8d000534165 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:03.253507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a05e984b-6252-4c9c-994d-c8d000534165 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:03.380899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6d106f84-5cd1-45ac-8515-f2242dcc0df1 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4b57697a02461285581183eddcaf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833ef551b89b4ec19797a0b39223841b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:03.398904 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6d106f84-5cd1-45ac-8515-f2242dcc0df1 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] 10.222.0.85 "GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e" status: 200 len: 1316 microversion: 2.1 time: 0.450668 Aug 24 10:38:03.399554 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2618/4852] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:02 2022] GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e => generated 1316 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:38:03.522453 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a05e984b-6252-4c9c-994d-c8d000534165 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action" status: 202 len: 0 microversion: 2.1 time: 0.319504 Aug 24 10:38:03.532196 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2235/4853] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:38:03 2022] POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 10:38:03.534749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c46c976f-caac-463e-b889-bec876d1c585 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:03.535714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c46c976f-caac-463e-b889-bec876d1c585 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:03.550162 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a88e4174-484e-48b8-a7ce-f6e800fdf008 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:03.552984 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a88e4174-484e-48b8-a7ce-f6e800fdf008 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0796aa2e-d174-4e03-b8e9-7b836ba9f485] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:03.554539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c46c976f-caac-463e-b889-bec876d1c585 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:03.556329 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c46c976f-caac-463e-b889-bec876d1c585 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:03.556718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c46c976f-caac-463e-b889-bec876d1c585 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:03.559064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c46c976f-caac-463e-b889-bec876d1c585 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:03.559685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c46c976f-caac-463e-b889-bec876d1c585 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:03.565938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c46c976f-caac-463e-b889-bec876d1c585 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:03.573157 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a88e4174-484e-48b8-a7ce-f6e800fdf008 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:03.575509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a88e4174-484e-48b8-a7ce-f6e800fdf008 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:03.576211 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a88e4174-484e-48b8-a7ce-f6e800fdf008 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:03.578301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a88e4174-484e-48b8-a7ce-f6e800fdf008 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:03.582795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a88e4174-484e-48b8-a7ce-f6e800fdf008 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:03.583435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a88e4174-484e-48b8-a7ce-f6e800fdf008 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:03.912513 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c46c976f-caac-463e-b889-bec876d1c585 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:03.919154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:03.931415 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c46c976f-caac-463e-b889-bec876d1c585 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1671 microversion: 2.1 time: 0.400487 Aug 24 10:38:03.933044 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2619/4854] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:03 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1671 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:04.221016 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a88e4174-484e-48b8-a7ce-f6e800fdf008 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:04.237348 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a88e4174-484e-48b8-a7ce-f6e800fdf008 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485" status: 200 len: 1327 microversion: 2.1 time: 0.696815 Aug 24 10:38:04.249153 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2236/4855] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:03 2022] GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485 => generated 1327 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:04.421925 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6e6cfdd0-3445-4e61-83cb-2968f66b3cf8 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:04.422888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6e6cfdd0-3445-4e61-83cb-2968f66b3cf8 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] [instance: 5987159c-d9d2-4205-902c-c4356925dc8e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:04.436815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e6cfdd0-3445-4e61-83cb-2968f66b3cf8 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:04.436815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e6cfdd0-3445-4e61-83cb-2968f66b3cf8 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:04.441468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e6cfdd0-3445-4e61-83cb-2968f66b3cf8 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:04.442668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e6cfdd0-3445-4e61-83cb-2968f66b3cf8 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:04.443172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e6cfdd0-3445-4e61-83cb-2968f66b3cf8 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:04.443619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e6cfdd0-3445-4e61-83cb-2968f66b3cf8 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:04.683214 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-322f7656-63fe-4736-b864-5e01d67c85e4 req-2b6ecc2b-d56c-446e-9225-281d41182dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5987159c-d9d2-4205-902c-c4356925dc8e", "tag": "7d136f24-2726-43d9-a98e-8d1f6fb3472c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:38:04.717913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-322f7656-63fe-4736-b864-5e01d67c85e4 req-2b6ecc2b-d56c-446e-9225-281d41182dd4 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:04.718731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-322f7656-63fe-4736-b864-5e01d67c85e4 req-2b6ecc2b-d56c-446e-9225-281d41182dd4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:04.719375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-322f7656-63fe-4736-b864-5e01d67c85e4 req-2b6ecc2b-d56c-446e-9225-281d41182dd4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:04.744981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:04.753720 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-322f7656-63fe-4736-b864-5e01d67c85e4 req-2b6ecc2b-d56c-446e-9225-281d41182dd4 service nova] Creating event network-changed:7d136f24-2726-43d9-a98e-8d1f6fb3472c for instance 5987159c-d9d2-4205-902c-c4356925dc8e on n-h2-849328-3 Aug 24 10:38:04.765849 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-322f7656-63fe-4736-b864-5e01d67c85e4 req-2b6ecc2b-d56c-446e-9225-281d41182dd4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087047 Aug 24 10:38:04.767053 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2237/4856] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:38:04.807634 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6e6cfdd0-3445-4e61-83cb-2968f66b3cf8 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4b57697a02461285581183eddcaf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833ef551b89b4ec19797a0b39223841b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:04.820923 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6e6cfdd0-3445-4e61-83cb-2968f66b3cf8 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] 10.222.0.85 "GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e" status: 200 len: 1316 microversion: 2.1 time: 0.403976 Aug 24 10:38:04.822426 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2620/4857] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:04 2022] GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e => generated 1316 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:04.884478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9970da27-59a1-44cb-8a17-98e6c0ce6c05 req-f627a5c5-6813-45c7-8546-c0e2b9ab278a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0796aa2e-d174-4e03-b8e9-7b836ba9f485", "name": "network-vif-plugged", "status": "completed", "tag": "3d5c7e91-2b1a-4808-887e-67ee426ca53d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:38:04.911361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9970da27-59a1-44cb-8a17-98e6c0ce6c05 req-f627a5c5-6813-45c7-8546-c0e2b9ab278a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:04.913078 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9970da27-59a1-44cb-8a17-98e6c0ce6c05 req-f627a5c5-6813-45c7-8546-c0e2b9ab278a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:04.914954 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9970da27-59a1-44cb-8a17-98e6c0ce6c05 req-f627a5c5-6813-45c7-8546-c0e2b9ab278a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:04.940104 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9970da27-59a1-44cb-8a17-98e6c0ce6c05 req-f627a5c5-6813-45c7-8546-c0e2b9ab278a service nova] Creating event network-vif-plugged:3d5c7e91-2b1a-4808-887e-67ee426ca53d for instance 0796aa2e-d174-4e03-b8e9-7b836ba9f485 on n-h2-849328-3 Aug 24 10:38:04.948683 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9970da27-59a1-44cb-8a17-98e6c0ce6c05 req-f627a5c5-6813-45c7-8546-c0e2b9ab278a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067657 Aug 24 10:38:04.958386 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b8507ad3-1c45-4b12-beb7-c6cf1de77338 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:04.959479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b8507ad3-1c45-4b12-beb7-c6cf1de77338 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:04.965014 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2238/4858] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:38:04.970350 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8507ad3-1c45-4b12-beb7-c6cf1de77338 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:04.971406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8507ad3-1c45-4b12-beb7-c6cf1de77338 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:04.972436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8507ad3-1c45-4b12-beb7-c6cf1de77338 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:04.973367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8507ad3-1c45-4b12-beb7-c6cf1de77338 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:04.973991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8507ad3-1c45-4b12-beb7-c6cf1de77338 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:04.974608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8507ad3-1c45-4b12-beb7-c6cf1de77338 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:05.262247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-383a8529-f48f-4e86-ac43-2227292fb86c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:05.263187 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-383a8529-f48f-4e86-ac43-2227292fb86c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0796aa2e-d174-4e03-b8e9-7b836ba9f485] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:05.285328 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-383a8529-f48f-4e86-ac43-2227292fb86c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:05.287583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-383a8529-f48f-4e86-ac43-2227292fb86c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:05.289514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-383a8529-f48f-4e86-ac43-2227292fb86c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:05.290330 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-383a8529-f48f-4e86-ac43-2227292fb86c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:05.290965 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-383a8529-f48f-4e86-ac43-2227292fb86c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:05.291454 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-383a8529-f48f-4e86-ac43-2227292fb86c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:05.351548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b8507ad3-1c45-4b12-beb7-c6cf1de77338 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:05.360422 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b8507ad3-1c45-4b12-beb7-c6cf1de77338 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1671 microversion: 2.1 time: 0.408024 Aug 24 10:38:05.361936 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2621/4859] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:04 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1671 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:05.750533 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-383a8529-f48f-4e86-ac43-2227292fb86c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:05.758822 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-383a8529-f48f-4e86-ac43-2227292fb86c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485" status: 200 len: 1327 microversion: 2.1 time: 0.502570 Aug 24 10:38:05.772661 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2239/4860] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:05 2022] GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485 => generated 1327 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:38:05.846751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-83f92429-2bf7-4273-95dc-6b6b358d65ad tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:05.847372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-83f92429-2bf7-4273-95dc-6b6b358d65ad tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] [instance: 5987159c-d9d2-4205-902c-c4356925dc8e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:05.863581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83f92429-2bf7-4273-95dc-6b6b358d65ad tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:05.864191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83f92429-2bf7-4273-95dc-6b6b358d65ad tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:05.864650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83f92429-2bf7-4273-95dc-6b6b358d65ad tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:05.865477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83f92429-2bf7-4273-95dc-6b6b358d65ad tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:05.869531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83f92429-2bf7-4273-95dc-6b6b358d65ad tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:05.870239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83f92429-2bf7-4273-95dc-6b6b358d65ad tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:06.141952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:06.224614 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-83f92429-2bf7-4273-95dc-6b6b358d65ad tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4b57697a02461285581183eddcaf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833ef551b89b4ec19797a0b39223841b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:06.239045 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-83f92429-2bf7-4273-95dc-6b6b358d65ad tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] 10.222.0.85 "GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e" status: 200 len: 1316 microversion: 2.1 time: 0.396399 Aug 24 10:38:06.245065 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2622/4861] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:05 2022] GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e => generated 1316 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:06.386431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c10ba3e-4928-4ac5-8792-3838e09f9aed tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:06.390939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2c10ba3e-4928-4ac5-8792-3838e09f9aed tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:06.404645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ddd5b9ed-5ca6-4e2a-8ec4-952741271926 tempest-PortsAdminExtendedAttrsTestJSON-566106352 tempest-PortsAdminExtendedAttrsTestJSON-566106352-project-admin] Calling method '.version_select at 0x7f4647ee9700>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:06.407540 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:38:06.407540 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:38:06.410197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddd5b9ed-5ca6-4e2a-8ec4-952741271926 tempest-PortsAdminExtendedAttrsTestJSON-566106352 tempest-PortsAdminExtendedAttrsTestJSON-566106352-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:06.411326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddd5b9ed-5ca6-4e2a-8ec4-952741271926 tempest-PortsAdminExtendedAttrsTestJSON-566106352 tempest-PortsAdminExtendedAttrsTestJSON-566106352-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:06.412424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddd5b9ed-5ca6-4e2a-8ec4-952741271926 tempest-PortsAdminExtendedAttrsTestJSON-566106352 tempest-PortsAdminExtendedAttrsTestJSON-566106352-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:06.412817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c10ba3e-4928-4ac5-8792-3838e09f9aed tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:06.413501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c10ba3e-4928-4ac5-8792-3838e09f9aed tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:06.414276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c10ba3e-4928-4ac5-8792-3838e09f9aed tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:06.423812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c10ba3e-4928-4ac5-8792-3838e09f9aed tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:06.424537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c10ba3e-4928-4ac5-8792-3838e09f9aed tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:06.426326 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c10ba3e-4928-4ac5-8792-3838e09f9aed tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:06.465355 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddd5b9ed-5ca6-4e2a-8ec4-952741271926 tempest-PortsAdminExtendedAttrsTestJSON-566106352 tempest-PortsAdminExtendedAttrsTestJSON-566106352-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:06.470727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddd5b9ed-5ca6-4e2a-8ec4-952741271926 tempest-PortsAdminExtendedAttrsTestJSON-566106352 tempest-PortsAdminExtendedAttrsTestJSON-566106352-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:06.470727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddd5b9ed-5ca6-4e2a-8ec4-952741271926 tempest-PortsAdminExtendedAttrsTestJSON-566106352 tempest-PortsAdminExtendedAttrsTestJSON-566106352-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:06.486623 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddd5b9ed-5ca6-4e2a-8ec4-952741271926 tempest-PortsAdminExtendedAttrsTestJSON-566106352 tempest-PortsAdminExtendedAttrsTestJSON-566106352-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:06.487122 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddd5b9ed-5ca6-4e2a-8ec4-952741271926 tempest-PortsAdminExtendedAttrsTestJSON-566106352 tempest-PortsAdminExtendedAttrsTestJSON-566106352-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:06.487763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddd5b9ed-5ca6-4e2a-8ec4-952741271926 tempest-PortsAdminExtendedAttrsTestJSON-566106352 tempest-PortsAdminExtendedAttrsTestJSON-566106352-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:06.490028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=18 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:06.496057 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ddd5b9ed-5ca6-4e2a-8ec4-952741271926 tempest-PortsAdminExtendedAttrsTestJSON-566106352 tempest-PortsAdminExtendedAttrsTestJSON-566106352-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.360496 Aug 24 10:38:06.497049 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2240/4862] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:38:06 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:38:06.656407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2c10ba3e-4928-4ac5-8792-3838e09f9aed tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:06.673784 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2c10ba3e-4928-4ac5-8792-3838e09f9aed tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1676 microversion: 2.1 time: 0.294035 Aug 24 10:38:06.675375 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2623/4863] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:06 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1676 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:06.786056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-280ec8bc-0d4d-4f0d-814b-906db0695a62 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:06.786711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-280ec8bc-0d4d-4f0d-814b-906db0695a62 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0796aa2e-d174-4e03-b8e9-7b836ba9f485] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:06.796263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-280ec8bc-0d4d-4f0d-814b-906db0695a62 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:06.796760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-280ec8bc-0d4d-4f0d-814b-906db0695a62 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:06.797217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-280ec8bc-0d4d-4f0d-814b-906db0695a62 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:06.797930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-280ec8bc-0d4d-4f0d-814b-906db0695a62 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:06.798401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-280ec8bc-0d4d-4f0d-814b-906db0695a62 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:06.805696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-280ec8bc-0d4d-4f0d-814b-906db0695a62 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:07.066552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-280ec8bc-0d4d-4f0d-814b-906db0695a62 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:07.081554 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-280ec8bc-0d4d-4f0d-814b-906db0695a62 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485" status: 200 len: 1327 microversion: 2.1 time: 0.299995 Aug 24 10:38:07.093155 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2241/4864] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:06 2022] GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485 => generated 1327 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:07.282582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-db4ce494-5225-4aef-8e23-39c13e91b8f6 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:07.286120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-db4ce494-5225-4aef-8e23-39c13e91b8f6 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] [instance: 5987159c-d9d2-4205-902c-c4356925dc8e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:07.300014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db4ce494-5225-4aef-8e23-39c13e91b8f6 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:07.300653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db4ce494-5225-4aef-8e23-39c13e91b8f6 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:07.301565 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db4ce494-5225-4aef-8e23-39c13e91b8f6 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:07.302536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db4ce494-5225-4aef-8e23-39c13e91b8f6 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:07.304032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db4ce494-5225-4aef-8e23-39c13e91b8f6 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:07.310546 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db4ce494-5225-4aef-8e23-39c13e91b8f6 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:07.664491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-db4ce494-5225-4aef-8e23-39c13e91b8f6 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4b57697a02461285581183eddcaf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833ef551b89b4ec19797a0b39223841b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:07.674051 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-db4ce494-5225-4aef-8e23-39c13e91b8f6 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] 10.222.0.85 "GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e" status: 200 len: 1316 microversion: 2.1 time: 0.403820 Aug 24 10:38:07.674880 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2624/4865] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:07 2022] GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e => generated 1316 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:38:07.696900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fec3faf3-60a1-43f1-ba25-512acd8732cb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:07.697607 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fec3faf3-60a1-43f1-ba25-512acd8732cb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:07.707289 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fec3faf3-60a1-43f1-ba25-512acd8732cb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:07.708480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fec3faf3-60a1-43f1-ba25-512acd8732cb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:07.709326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fec3faf3-60a1-43f1-ba25-512acd8732cb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:07.710352 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fec3faf3-60a1-43f1-ba25-512acd8732cb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:07.711296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fec3faf3-60a1-43f1-ba25-512acd8732cb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:07.712234 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fec3faf3-60a1-43f1-ba25-512acd8732cb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:08.024019 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fec3faf3-60a1-43f1-ba25-512acd8732cb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:08.041283 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fec3faf3-60a1-43f1-ba25-512acd8732cb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1676 microversion: 2.1 time: 0.349327 Aug 24 10:38:08.061747 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2242/4866] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:07 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1676 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:08.104785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d4cfdca8-b067-4903-9702-93fddf0a34a9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:08.105629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d4cfdca8-b067-4903-9702-93fddf0a34a9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0796aa2e-d174-4e03-b8e9-7b836ba9f485] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:08.116484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4cfdca8-b067-4903-9702-93fddf0a34a9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:08.116994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4cfdca8-b067-4903-9702-93fddf0a34a9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:08.117640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4cfdca8-b067-4903-9702-93fddf0a34a9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:08.118535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4cfdca8-b067-4903-9702-93fddf0a34a9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:08.119087 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4cfdca8-b067-4903-9702-93fddf0a34a9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:08.119998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4cfdca8-b067-4903-9702-93fddf0a34a9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:08.325716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d4cfdca8-b067-4903-9702-93fddf0a34a9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:08.334189 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d4cfdca8-b067-4903-9702-93fddf0a34a9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485" status: 200 len: 1508 microversion: 2.1 time: 0.235112 Aug 24 10:38:08.336313 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2625/4867] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:08 2022] GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485 => generated 1508 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:08.356784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-27b768ae-a6b4-4135-a30f-bfb6291f1a51 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:08.357732 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-27b768ae-a6b4-4135-a30f-bfb6291f1a51 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0796aa2e-d174-4e03-b8e9-7b836ba9f485] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:08.364386 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27b768ae-a6b4-4135-a30f-bfb6291f1a51 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:08.365084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27b768ae-a6b4-4135-a30f-bfb6291f1a51 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:08.365783 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27b768ae-a6b4-4135-a30f-bfb6291f1a51 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:08.366651 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27b768ae-a6b4-4135-a30f-bfb6291f1a51 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:08.367264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27b768ae-a6b4-4135-a30f-bfb6291f1a51 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:08.367849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27b768ae-a6b4-4135-a30f-bfb6291f1a51 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:08.646517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-27b768ae-a6b4-4135-a30f-bfb6291f1a51 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:08.656071 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-27b768ae-a6b4-4135-a30f-bfb6291f1a51 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485" status: 200 len: 1508 microversion: 2.1 time: 0.303985 Aug 24 10:38:08.670047 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2243/4868] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:08 2022] GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485 => generated 1508 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:08.676348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c8c5c23f-e484-4a28-8877-fc7daef4383c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:08.676869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c8c5c23f-e484-4a28-8877-fc7daef4383c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0796aa2e-d174-4e03-b8e9-7b836ba9f485] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:08.683424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8c5c23f-e484-4a28-8877-fc7daef4383c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:08.683924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8c5c23f-e484-4a28-8877-fc7daef4383c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:08.684351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8c5c23f-e484-4a28-8877-fc7daef4383c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:08.685336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8c5c23f-e484-4a28-8877-fc7daef4383c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:08.685951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8c5c23f-e484-4a28-8877-fc7daef4383c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:08.686531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8c5c23f-e484-4a28-8877-fc7daef4383c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:08.695315 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-657a1a89-64d4-4c59-9ce6-fb103d5ecf5f tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:08.695925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-657a1a89-64d4-4c59-9ce6-fb103d5ecf5f tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] [instance: 5987159c-d9d2-4205-902c-c4356925dc8e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:08.703873 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-657a1a89-64d4-4c59-9ce6-fb103d5ecf5f tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:08.704565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-657a1a89-64d4-4c59-9ce6-fb103d5ecf5f tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:08.704776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-657a1a89-64d4-4c59-9ce6-fb103d5ecf5f tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:08.710071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-657a1a89-64d4-4c59-9ce6-fb103d5ecf5f tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:08.710800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-657a1a89-64d4-4c59-9ce6-fb103d5ecf5f tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:08.713240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-657a1a89-64d4-4c59-9ce6-fb103d5ecf5f tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:08.756226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c8c5c23f-e484-4a28-8877-fc7daef4383c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0796aa2e-d174-4e03-b8e9-7b836ba9f485] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:38:08.938688 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c8c5c23f-e484-4a28-8877-fc7daef4383c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "DELETE /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485" status: 204 len: 0 microversion: 2.1 time: 0.265547 Aug 24 10:38:08.943327 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2626/4869] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:38:08 2022] DELETE /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:38:08.957561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b557ffcb-5b69-4ffc-97ed-7a629321ac6e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:08.958537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b557ffcb-5b69-4ffc-97ed-7a629321ac6e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0796aa2e-d174-4e03-b8e9-7b836ba9f485] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:08.988404 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b557ffcb-5b69-4ffc-97ed-7a629321ac6e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:08.989509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b557ffcb-5b69-4ffc-97ed-7a629321ac6e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:08.990236 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b557ffcb-5b69-4ffc-97ed-7a629321ac6e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:08.992447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b557ffcb-5b69-4ffc-97ed-7a629321ac6e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:08.993370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b557ffcb-5b69-4ffc-97ed-7a629321ac6e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:08.995609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b557ffcb-5b69-4ffc-97ed-7a629321ac6e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:09.259954 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b557ffcb-5b69-4ffc-97ed-7a629321ac6e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:09.275145 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b557ffcb-5b69-4ffc-97ed-7a629321ac6e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485" status: 200 len: 1514 microversion: 2.1 time: 0.329996 Aug 24 10:38:09.276266 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2627/4870] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:08 2022] GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485 => generated 1514 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:09.294083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4e0831b4-fdbf-416e-86c5-6870061c8ee2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:09.294961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4e0831b4-fdbf-416e-86c5-6870061c8ee2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:09.318613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e0831b4-fdbf-416e-86c5-6870061c8ee2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:09.320092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e0831b4-fdbf-416e-86c5-6870061c8ee2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:09.321523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e0831b4-fdbf-416e-86c5-6870061c8ee2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:09.323694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e0831b4-fdbf-416e-86c5-6870061c8ee2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:09.325171 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e0831b4-fdbf-416e-86c5-6870061c8ee2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:09.326460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e0831b4-fdbf-416e-86c5-6870061c8ee2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:09.604942 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4e0831b4-fdbf-416e-86c5-6870061c8ee2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:09.617246 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4e0831b4-fdbf-416e-86c5-6870061c8ee2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1676 microversion: 2.1 time: 0.339258 Aug 24 10:38:09.637381 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2628/4871] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:09 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1676 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:09.691162 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-657a1a89-64d4-4c59-9ce6-fb103d5ecf5f tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4b57697a02461285581183eddcaf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833ef551b89b4ec19797a0b39223841b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:09.708547 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-657a1a89-64d4-4c59-9ce6-fb103d5ecf5f tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] 10.222.0.85 "GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e" status: 200 len: 1316 microversion: 2.1 time: 1.017065 Aug 24 10:38:09.710495 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2244/4872] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:08 2022] GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e => generated 1316 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:38:10.298829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6aa64e9c-01a0-40ed-9c80-f0118a16111d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:10.301414 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6aa64e9c-01a0-40ed-9c80-f0118a16111d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0796aa2e-d174-4e03-b8e9-7b836ba9f485] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:10.346420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa64e9c-01a0-40ed-9c80-f0118a16111d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:10.348380 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa64e9c-01a0-40ed-9c80-f0118a16111d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:10.349479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa64e9c-01a0-40ed-9c80-f0118a16111d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:10.350549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa64e9c-01a0-40ed-9c80-f0118a16111d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:10.351424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa64e9c-01a0-40ed-9c80-f0118a16111d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:10.352239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa64e9c-01a0-40ed-9c80-f0118a16111d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:10.642378 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-24d54bb1-1991-4a4d-912d-9ed7b427ee88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:10.642999 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-24d54bb1-1991-4a4d-912d-9ed7b427ee88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:10.654948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24d54bb1-1991-4a4d-912d-9ed7b427ee88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:10.669111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24d54bb1-1991-4a4d-912d-9ed7b427ee88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:10.671575 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24d54bb1-1991-4a4d-912d-9ed7b427ee88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:10.675485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24d54bb1-1991-4a4d-912d-9ed7b427ee88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:10.678952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24d54bb1-1991-4a4d-912d-9ed7b427ee88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:10.680524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24d54bb1-1991-4a4d-912d-9ed7b427ee88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:10.838895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6aa64e9c-01a0-40ed-9c80-f0118a16111d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:10.850246 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6aa64e9c-01a0-40ed-9c80-f0118a16111d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485" status: 200 len: 1514 microversion: 2.1 time: 0.557834 Aug 24 10:38:10.852457 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2629/4873] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:10 2022] GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485 => generated 1514 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:10.881062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c57b5ade-8b12-4cd3-ae6c-3fc229b4ed8e tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:10.882017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c57b5ade-8b12-4cd3-ae6c-3fc229b4ed8e tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] [instance: 5987159c-d9d2-4205-902c-c4356925dc8e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:10.892079 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57b5ade-8b12-4cd3-ae6c-3fc229b4ed8e tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:10.893881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57b5ade-8b12-4cd3-ae6c-3fc229b4ed8e tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:10.894523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57b5ade-8b12-4cd3-ae6c-3fc229b4ed8e tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:10.896133 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57b5ade-8b12-4cd3-ae6c-3fc229b4ed8e tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:10.897267 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57b5ade-8b12-4cd3-ae6c-3fc229b4ed8e tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:10.898655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57b5ade-8b12-4cd3-ae6c-3fc229b4ed8e tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:11.251163 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-24d54bb1-1991-4a4d-912d-9ed7b427ee88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:11.263314 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-24d54bb1-1991-4a4d-912d-9ed7b427ee88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1676 microversion: 2.1 time: 0.625022 Aug 24 10:38:11.278291 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2245/4874] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:10 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1676 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:38:11.513798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c57b5ade-8b12-4cd3-ae6c-3fc229b4ed8e tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4b57697a02461285581183eddcaf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833ef551b89b4ec19797a0b39223841b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:11.532065 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c57b5ade-8b12-4cd3-ae6c-3fc229b4ed8e tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] 10.222.0.85 "GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e" status: 200 len: 1316 microversion: 2.1 time: 0.664861 Aug 24 10:38:11.532677 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2630/4875] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:10 2022] GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e => generated 1316 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:11.877500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ccddc123-4e68-44e5-b6b2-0425a2289c76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:11.882432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ccddc123-4e68-44e5-b6b2-0425a2289c76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0796aa2e-d174-4e03-b8e9-7b836ba9f485] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:11.897469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccddc123-4e68-44e5-b6b2-0425a2289c76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:11.897469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccddc123-4e68-44e5-b6b2-0425a2289c76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:11.897469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccddc123-4e68-44e5-b6b2-0425a2289c76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:11.897469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccddc123-4e68-44e5-b6b2-0425a2289c76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:11.897863 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccddc123-4e68-44e5-b6b2-0425a2289c76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:11.899225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccddc123-4e68-44e5-b6b2-0425a2289c76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:12.095490 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ccddc123-4e68-44e5-b6b2-0425a2289c76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:12.113948 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ccddc123-4e68-44e5-b6b2-0425a2289c76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485" status: 200 len: 1472 microversion: 2.1 time: 0.240345 Aug 24 10:38:12.116932 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2246/4876] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:11 2022] GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485 => generated 1472 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:12.222121 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8bc6657a-88fe-4e6e-ab07-c4bcb3b5cf15 req-2e8251b6-60c4-4b7c-9ef1-92cd829f2e0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0796aa2e-d174-4e03-b8e9-7b836ba9f485", "name": "network-vif-deleted", "tag": "3d5c7e91-2b1a-4808-887e-67ee426ca53d"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:38:12.260622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8bc6657a-88fe-4e6e-ab07-c4bcb3b5cf15 req-2e8251b6-60c4-4b7c-9ef1-92cd829f2e0c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:12.261345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8bc6657a-88fe-4e6e-ab07-c4bcb3b5cf15 req-2e8251b6-60c4-4b7c-9ef1-92cd829f2e0c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:12.263008 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8bc6657a-88fe-4e6e-ab07-c4bcb3b5cf15 req-2e8251b6-60c4-4b7c-9ef1-92cd829f2e0c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:12.286269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1dccea1b-8584-4c87-b609-50e08b4826d8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:12.288044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1dccea1b-8584-4c87-b609-50e08b4826d8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:12.304490 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1dccea1b-8584-4c87-b609-50e08b4826d8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:12.306180 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1dccea1b-8584-4c87-b609-50e08b4826d8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:12.307846 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1dccea1b-8584-4c87-b609-50e08b4826d8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:12.310840 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1dccea1b-8584-4c87-b609-50e08b4826d8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:12.312322 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1dccea1b-8584-4c87-b609-50e08b4826d8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:12.313091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1dccea1b-8584-4c87-b609-50e08b4826d8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:12.315869 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8bc6657a-88fe-4e6e-ab07-c4bcb3b5cf15 req-2e8251b6-60c4-4b7c-9ef1-92cd829f2e0c service nova] Creating event network-vif-deleted:3d5c7e91-2b1a-4808-887e-67ee426ca53d for instance 0796aa2e-d174-4e03-b8e9-7b836ba9f485 on n-h2-849328-3 Aug 24 10:38:12.330251 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8bc6657a-88fe-4e6e-ab07-c4bcb3b5cf15 req-2e8251b6-60c4-4b7c-9ef1-92cd829f2e0c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112611 Aug 24 10:38:12.337359 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2631/4877] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:38:12.557881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3729b13c-2c08-4866-838c-29e1a5dbca22 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:12.558581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3729b13c-2c08-4866-838c-29e1a5dbca22 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] [instance: 5987159c-d9d2-4205-902c-c4356925dc8e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:12.573549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3729b13c-2c08-4866-838c-29e1a5dbca22 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:12.574055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3729b13c-2c08-4866-838c-29e1a5dbca22 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:12.574494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3729b13c-2c08-4866-838c-29e1a5dbca22 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:12.575253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3729b13c-2c08-4866-838c-29e1a5dbca22 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:12.579443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3729b13c-2c08-4866-838c-29e1a5dbca22 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:12.580715 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3729b13c-2c08-4866-838c-29e1a5dbca22 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:13.078255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3729b13c-2c08-4866-838c-29e1a5dbca22 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4b57697a02461285581183eddcaf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833ef551b89b4ec19797a0b39223841b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:13.089712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1dccea1b-8584-4c87-b609-50e08b4826d8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:13.092744 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3729b13c-2c08-4866-838c-29e1a5dbca22 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] 10.222.0.85 "GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e" status: 200 len: 1316 microversion: 2.1 time: 0.539005 Aug 24 10:38:13.111509 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1dccea1b-8584-4c87-b609-50e08b4826d8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.821820 Aug 24 10:38:13.112186 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2247/4878] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:12 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:13.116261 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2632/4879] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:12 2022] GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e => generated 1316 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:13.131375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-2a0c6ad5-e6e0-4f6f-909d-756d16e75d8d req-5b839214-2a47-435a-98ef-c7d4aeab6b04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5987159c-d9d2-4205-902c-c4356925dc8e", "name": "network-vif-plugged", "status": "completed", "tag": "7d136f24-2726-43d9-a98e-8d1f6fb3472c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:38:13.135541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c831f907-95ba-4a0b-b808-dde9a99cda76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:13.138555 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c831f907-95ba-4a0b-b808-dde9a99cda76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0796aa2e-d174-4e03-b8e9-7b836ba9f485] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:13.154160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c831f907-95ba-4a0b-b808-dde9a99cda76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:13.154807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c831f907-95ba-4a0b-b808-dde9a99cda76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:13.155261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c831f907-95ba-4a0b-b808-dde9a99cda76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:13.155988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c831f907-95ba-4a0b-b808-dde9a99cda76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:13.157903 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c831f907-95ba-4a0b-b808-dde9a99cda76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:13.158600 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c831f907-95ba-4a0b-b808-dde9a99cda76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:13.159909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2a0c6ad5-e6e0-4f6f-909d-756d16e75d8d req-5b839214-2a47-435a-98ef-c7d4aeab6b04 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:13.160390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2a0c6ad5-e6e0-4f6f-909d-756d16e75d8d req-5b839214-2a47-435a-98ef-c7d4aeab6b04 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:13.160816 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2a0c6ad5-e6e0-4f6f-909d-756d16e75d8d req-5b839214-2a47-435a-98ef-c7d4aeab6b04 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:13.191090 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-2a0c6ad5-e6e0-4f6f-909d-756d16e75d8d req-5b839214-2a47-435a-98ef-c7d4aeab6b04 service nova] Creating event network-vif-plugged:7d136f24-2726-43d9-a98e-8d1f6fb3472c for instance 5987159c-d9d2-4205-902c-c4356925dc8e on n-h2-849328-3 Aug 24 10:38:13.193166 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-c831f907-95ba-4a0b-b808-dde9a99cda76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] HTTP exception thrown: Instance 0796aa2e-d174-4e03-b8e9-7b836ba9f485 could not be found. Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c831f907-95ba-4a0b-b808-dde9a99cda76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Request method failure captured: Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485 HTTP/1.1 Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf8_-svoJ82Zcz3LMtRJH-LxEmi7YhL3SyNjhBkMMhmGqnW0J0hM18TP4MYYa3JryjRkfD6MJWxRrI1tc6yKAxu9hD6H4E3SSBMepuWzyz5efbHaNXS1nRaEb6aE-x3oa0iXQadiBh1CoF_uoY7wN-kywJAG1lWDamBR5UsabCRziuM Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersTestJSON-523633018 Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8b489eabb0014ddc9a2fcdf6e78ee740", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8b489eabb0014ddc9a2fcdf6e78ee740"}]}] Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersTestJSON-523633018 Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersTestJSON-523633018 Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersTestJSON-523633018-project Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 83a25a0677c04f8ba975528ece80d676 Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersTestJSON-523633018-project Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 0796aa2e-d174-4e03-b8e9-7b836ba9f485 could not be found. Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '0796aa2e-d174-4e03-b8e9-7b836ba9f485'} Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0796aa2e-d174-4e03-b8e9-7b836ba9f485 could not be found. Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0796aa2e-d174-4e03-b8e9-7b836ba9f485 could not be found. Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:38:13.197629 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:38:13.203475 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:38:13.203475 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:38:13.203475 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:38:13.203475 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:38:13.203475 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0796aa2e-d174-4e03-b8e9-7b836ba9f485 could not be found. Aug 24 10:38:13.203475 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:38:13.203475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c831f907-95ba-4a0b-b808-dde9a99cda76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Returning 404 to user: Instance 0796aa2e-d174-4e03-b8e9-7b836ba9f485 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:38:13.204772 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c831f907-95ba-4a0b-b808-dde9a99cda76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485" status: 404 len: 111 microversion: 2.1 time: 0.073199 Aug 24 10:38:13.207141 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-2a0c6ad5-e6e0-4f6f-909d-756d16e75d8d req-5b839214-2a47-435a-98ef-c7d4aeab6b04 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090666 Aug 24 10:38:13.207846 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2633/4880] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:13 2022] GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:38:13.207984 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2248/4881] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:38:13.228450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-98a9e80c-c044-4a33-8b79-894a9f3247cb tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '.version_select at 0x7f465413ddc0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:13.260846 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-98a9e80c-c044-4a33-8b79-894a9f3247cb tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-key-620670873" status: 202 len: 0 microversion: 2.1 time: 0.041898 Aug 24 10:38:13.262542 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2249/4882] 10.222.0.85 () {58 vars in 1206 bytes} [Wed Aug 24 10:38:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-620670873 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:38:13.513375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4db2a081-463d-419f-9e0b-91471320c8da tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1460045027", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "444806fc-9684-467f-82d3-8ae5206eec37"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:38:13.620389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-4db2a081-463d-419f-9e0b-91471320c8da tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] validate_networks() for [('444806fc-9684-467f-82d3-8ae5206eec37', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:38:14.113934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8fee6bdb-c8c4-4fc6-ba81-361f046ee5cb tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:14.114757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8fee6bdb-c8c4-4fc6-ba81-361f046ee5cb tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] [instance: 5987159c-d9d2-4205-902c-c4356925dc8e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:14.149045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fee6bdb-c8c4-4fc6-ba81-361f046ee5cb tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:14.156411 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fee6bdb-c8c4-4fc6-ba81-361f046ee5cb tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:14.157066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fee6bdb-c8c4-4fc6-ba81-361f046ee5cb tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:14.160774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fee6bdb-c8c4-4fc6-ba81-361f046ee5cb tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:14.161516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fee6bdb-c8c4-4fc6-ba81-361f046ee5cb tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:14.162126 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fee6bdb-c8c4-4fc6-ba81-361f046ee5cb tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:14.556299 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8fee6bdb-c8c4-4fc6-ba81-361f046ee5cb tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4b57697a02461285581183eddcaf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833ef551b89b4ec19797a0b39223841b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:14.580237 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8fee6bdb-c8c4-4fc6-ba81-361f046ee5cb tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] 10.222.0.85 "GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e" status: 200 len: 1316 microversion: 2.1 time: 0.468029 Aug 24 10:38:14.595029 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2250/4883] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:14 2022] GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e => generated 1316 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:38:14.679569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-4db2a081-463d-419f-9e0b-91471320c8da tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:38:14.680731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-4db2a081-463d-419f-9e0b-91471320c8da tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:38:14.681451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-4db2a081-463d-419f-9e0b-91471320c8da tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:38:14.682614 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-4db2a081-463d-419f-9e0b-91471320c8da tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:38:14.683816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-4db2a081-463d-419f-9e0b-91471320c8da tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:38:14.698880 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4db2a081-463d-419f-9e0b-91471320c8da tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:14.699842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4db2a081-463d-419f-9e0b-91471320c8da tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:14.700515 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4db2a081-463d-419f-9e0b-91471320c8da tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:14.710577 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4db2a081-463d-419f-9e0b-91471320c8da tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:14.715195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4db2a081-463d-419f-9e0b-91471320c8da tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:14.717715 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4db2a081-463d-419f-9e0b-91471320c8da tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:14.756919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-4db2a081-463d-419f-9e0b-91471320c8da tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Getting quotas for project 8b489eabb0014ddc9a2fcdf6e78ee740. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:38:14.767224 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-4db2a081-463d-419f-9e0b-91471320c8da tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Getting quotas for user 83a25a0677c04f8ba975528ece80d676 and project 8b489eabb0014ddc9a2fcdf6e78ee740. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:38:14.787932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4db2a081-463d-419f-9e0b-91471320c8da tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:38:14.792080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4db2a081-463d-419f-9e0b-91471320c8da tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: a8d638df-397c-4b18-9b86-1ef6ce736fcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:38:14.934040 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4db2a081-463d-419f-9e0b-91471320c8da tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.422840 Aug 24 10:38:14.934830 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2634/4884] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:38:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:38:14.952506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e3eb2d1f-d2c6-4e71-b3ae-238eae5cae76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:14.953193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e3eb2d1f-d2c6-4e71-b3ae-238eae5cae76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: a8d638df-397c-4b18-9b86-1ef6ce736fcb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:15.102272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e3eb2d1f-d2c6-4e71-b3ae-238eae5cae76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:15.114263 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e3eb2d1f-d2c6-4e71-b3ae-238eae5cae76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb" status: 200 len: 1209 microversion: 2.1 time: 0.170314 Aug 24 10:38:15.133404 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2251/4885] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:14 2022] GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb => generated 1209 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:15.607432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0beb05ec-91ba-4d92-a758-a9504646e30f tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:15.608099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0beb05ec-91ba-4d92-a758-a9504646e30f tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] [instance: 5987159c-d9d2-4205-902c-c4356925dc8e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:15.629670 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0beb05ec-91ba-4d92-a758-a9504646e30f tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:15.631333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0beb05ec-91ba-4d92-a758-a9504646e30f tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:15.632801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0beb05ec-91ba-4d92-a758-a9504646e30f tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:15.633741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0beb05ec-91ba-4d92-a758-a9504646e30f tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:15.635965 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0beb05ec-91ba-4d92-a758-a9504646e30f tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:15.637323 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0beb05ec-91ba-4d92-a758-a9504646e30f tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:16.083192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0beb05ec-91ba-4d92-a758-a9504646e30f tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4b57697a02461285581183eddcaf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833ef551b89b4ec19797a0b39223841b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:16.096208 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0beb05ec-91ba-4d92-a758-a9504646e30f tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] 10.222.0.85 "GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e" status: 200 len: 1505 microversion: 2.1 time: 0.493497 Aug 24 10:38:16.109818 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2635/4886] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:15 2022] GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e => generated 1505 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:16.119448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad51e2bd-62ab-4e7a-9c02-a7e564e23ddb tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:16.120245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ad51e2bd-62ab-4e7a-9c02-a7e564e23ddb tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] [instance: 5987159c-d9d2-4205-902c-c4356925dc8e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:16.128853 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad51e2bd-62ab-4e7a-9c02-a7e564e23ddb tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:16.129378 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad51e2bd-62ab-4e7a-9c02-a7e564e23ddb tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:16.130306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad51e2bd-62ab-4e7a-9c02-a7e564e23ddb tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:16.131106 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad51e2bd-62ab-4e7a-9c02-a7e564e23ddb tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:16.131576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad51e2bd-62ab-4e7a-9c02-a7e564e23ddb tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:16.132004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad51e2bd-62ab-4e7a-9c02-a7e564e23ddb tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:16.141194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-110b8b08-b43d-42b3-b88a-bf3229eea872 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:16.141888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-110b8b08-b43d-42b3-b88a-bf3229eea872 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: a8d638df-397c-4b18-9b86-1ef6ce736fcb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:16.152905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-110b8b08-b43d-42b3-b88a-bf3229eea872 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:16.156081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-110b8b08-b43d-42b3-b88a-bf3229eea872 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:16.156578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-110b8b08-b43d-42b3-b88a-bf3229eea872 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:16.161315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-110b8b08-b43d-42b3-b88a-bf3229eea872 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:16.161866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-110b8b08-b43d-42b3-b88a-bf3229eea872 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:16.162319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-110b8b08-b43d-42b3-b88a-bf3229eea872 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:16.264408 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ad51e2bd-62ab-4e7a-9c02-a7e564e23ddb tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] 10.222.0.85 "DELETE /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.148287 Aug 24 10:38:16.272711 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2252/4887] 10.222.0.85 () {58 vars in 1296 bytes} [Wed Aug 24 10:38:16 2022] DELETE /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e/os-server-password => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:38:16.281494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd8c971a-bb7e-410e-b467-6a163bf6f5ff tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:16.282139 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dd8c971a-bb7e-410e-b467-6a163bf6f5ff tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] [instance: 5987159c-d9d2-4205-902c-c4356925dc8e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:16.305950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd8c971a-bb7e-410e-b467-6a163bf6f5ff tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:16.306701 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd8c971a-bb7e-410e-b467-6a163bf6f5ff tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:16.323881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd8c971a-bb7e-410e-b467-6a163bf6f5ff tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:16.324812 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd8c971a-bb7e-410e-b467-6a163bf6f5ff tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:16.331412 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd8c971a-bb7e-410e-b467-6a163bf6f5ff tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:16.334848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd8c971a-bb7e-410e-b467-6a163bf6f5ff tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:16.407924 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dd8c971a-bb7e-410e-b467-6a163bf6f5ff tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] 10.222.0.85 "GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.134058 Aug 24 10:38:16.416442 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2253/4888] 10.222.0.85 () {58 vars in 1293 bytes} [Wed Aug 24 10:38:16 2022] GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e/os-server-password => generated 16 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:38:16.426567 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fee245ff-69e0-49d7-9096-77f01da236ac tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:16.427351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fee245ff-69e0-49d7-9096-77f01da236ac tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] [instance: 5987159c-d9d2-4205-902c-c4356925dc8e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:16.440720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fee245ff-69e0-49d7-9096-77f01da236ac tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:16.443059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fee245ff-69e0-49d7-9096-77f01da236ac tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:16.443787 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fee245ff-69e0-49d7-9096-77f01da236ac tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:16.445288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fee245ff-69e0-49d7-9096-77f01da236ac tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:16.446642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fee245ff-69e0-49d7-9096-77f01da236ac tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:16.447590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fee245ff-69e0-49d7-9096-77f01da236ac tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:16.470710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-110b8b08-b43d-42b3-b88a-bf3229eea872 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:16.479396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:16.482333 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-110b8b08-b43d-42b3-b88a-bf3229eea872 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb" status: 200 len: 1205 microversion: 2.1 time: 0.345839 Aug 24 10:38:16.497310 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2636/4889] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:16 2022] GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb => generated 1205 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:38:16.560533 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fee245ff-69e0-49d7-9096-77f01da236ac tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] [instance: 5987159c-d9d2-4205-902c-c4356925dc8e] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:38:16.724573 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fee245ff-69e0-49d7-9096-77f01da236ac tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] 10.222.0.85 "DELETE /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e" status: 204 len: 0 microversion: 2.1 time: 0.305991 Aug 24 10:38:16.742664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-658a952f-fdff-4424-b529-04492d40ea3c tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:16.743302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-658a952f-fdff-4424-b529-04492d40ea3c tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] [instance: 5987159c-d9d2-4205-902c-c4356925dc8e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:16.748089 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2254/4890] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:38:16 2022] DELETE /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:38:16.764756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-658a952f-fdff-4424-b529-04492d40ea3c tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:16.766421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-658a952f-fdff-4424-b529-04492d40ea3c tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:16.767047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-658a952f-fdff-4424-b529-04492d40ea3c tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:16.769902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-658a952f-fdff-4424-b529-04492d40ea3c tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:16.770583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-658a952f-fdff-4424-b529-04492d40ea3c tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:16.772285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-658a952f-fdff-4424-b529-04492d40ea3c tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:17.506127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b6fce67-a9af-4d2d-9220-6900af52bc03 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:17.506990 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2b6fce67-a9af-4d2d-9220-6900af52bc03 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: a8d638df-397c-4b18-9b86-1ef6ce736fcb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:17.521508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b6fce67-a9af-4d2d-9220-6900af52bc03 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:17.526106 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b6fce67-a9af-4d2d-9220-6900af52bc03 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:17.526892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b6fce67-a9af-4d2d-9220-6900af52bc03 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:17.534348 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b6fce67-a9af-4d2d-9220-6900af52bc03 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:17.534990 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b6fce67-a9af-4d2d-9220-6900af52bc03 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:17.535888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b6fce67-a9af-4d2d-9220-6900af52bc03 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:17.617101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:17.786328 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2b6fce67-a9af-4d2d-9220-6900af52bc03 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:17.807738 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2b6fce67-a9af-4d2d-9220-6900af52bc03 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb" status: 200 len: 1269 microversion: 2.1 time: 0.306228 Aug 24 10:38:17.816861 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2255/4891] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:17 2022] GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb => generated 1269 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:38:18.080955 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0c03e8da-2086-4d15-a6a7-41d2f9a1c552 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-587345642", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "a9c928eb-1d0b-4705-946c-1d6ecdaa2a1e"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:38:18.101796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-658a952f-fdff-4424-b529-04492d40ea3c tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4b57697a02461285581183eddcaf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833ef551b89b4ec19797a0b39223841b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:18.116933 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-658a952f-fdff-4424-b529-04492d40ea3c tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] 10.222.0.85 "GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e" status: 200 len: 1511 microversion: 2.1 time: 1.381294 Aug 24 10:38:18.117570 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2637/4892] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:16 2022] GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e => generated 1511 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:18.176740 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-0c03e8da-2086-4d15-a6a7-41d2f9a1c552 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] validate_networks() for [('a9c928eb-1d0b-4705-946c-1d6ecdaa2a1e', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:38:18.844578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9e45ddb3-0009-4d15-9bfb-f46ff3da6cd2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:18.845607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9e45ddb3-0009-4d15-9bfb-f46ff3da6cd2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: a8d638df-397c-4b18-9b86-1ef6ce736fcb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:18.859701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e45ddb3-0009-4d15-9bfb-f46ff3da6cd2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:18.860551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e45ddb3-0009-4d15-9bfb-f46ff3da6cd2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:18.861396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e45ddb3-0009-4d15-9bfb-f46ff3da6cd2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:18.862334 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e45ddb3-0009-4d15-9bfb-f46ff3da6cd2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:18.863201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e45ddb3-0009-4d15-9bfb-f46ff3da6cd2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:18.863852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e45ddb3-0009-4d15-9bfb-f46ff3da6cd2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:18.994237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9e45ddb3-0009-4d15-9bfb-f46ff3da6cd2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:19.013020 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9e45ddb3-0009-4d15-9bfb-f46ff3da6cd2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb" status: 200 len: 1267 microversion: 2.1 time: 0.173100 Aug 24 10:38:19.014387 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2638/4893] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:18 2022] GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:19.145942 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-da2ad889-92e0-48c1-abfd-389fddf00ead tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:19.147656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-da2ad889-92e0-48c1-abfd-389fddf00ead tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] [instance: 5987159c-d9d2-4205-902c-c4356925dc8e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:19.154909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da2ad889-92e0-48c1-abfd-389fddf00ead tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:19.156227 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da2ad889-92e0-48c1-abfd-389fddf00ead tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:19.157416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da2ad889-92e0-48c1-abfd-389fddf00ead tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:19.158637 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da2ad889-92e0-48c1-abfd-389fddf00ead tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:19.159312 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da2ad889-92e0-48c1-abfd-389fddf00ead tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:19.159953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da2ad889-92e0-48c1-abfd-389fddf00ead tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:19.411424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0c03e8da-2086-4d15-a6a7-41d2f9a1c552 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:38:19.413135 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0c03e8da-2086-4d15-a6a7-41d2f9a1c552 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:38:19.414408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0c03e8da-2086-4d15-a6a7-41d2f9a1c552 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:38:19.415366 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0c03e8da-2086-4d15-a6a7-41d2f9a1c552 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:38:19.416180 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0c03e8da-2086-4d15-a6a7-41d2f9a1c552 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:38:19.420866 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:19.440614 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c03e8da-2086-4d15-a6a7-41d2f9a1c552 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:19.441370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c03e8da-2086-4d15-a6a7-41d2f9a1c552 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:19.442284 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c03e8da-2086-4d15-a6a7-41d2f9a1c552 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:19.443794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c03e8da-2086-4d15-a6a7-41d2f9a1c552 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:19.445182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c03e8da-2086-4d15-a6a7-41d2f9a1c552 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:19.445782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c03e8da-2086-4d15-a6a7-41d2f9a1c552 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:19.472892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-0c03e8da-2086-4d15-a6a7-41d2f9a1c552 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Getting quotas for project 2dc5853f2c1c434f832d5ffc2f550bf6. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:38:19.481756 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-0c03e8da-2086-4d15-a6a7-41d2f9a1c552 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Getting quotas for user 988cbd2509314aeaa9ad618e705894d3 and project 2dc5853f2c1c434f832d5ffc2f550bf6. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:38:19.496116 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da2ad889-92e0-48c1-abfd-389fddf00ead tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4b57697a02461285581183eddcaf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833ef551b89b4ec19797a0b39223841b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:19.510613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0c03e8da-2086-4d15-a6a7-41d2f9a1c552 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:38:19.516801 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-da2ad889-92e0-48c1-abfd-389fddf00ead tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] 10.222.0.85 "GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e" status: 200 len: 1511 microversion: 2.1 time: 0.376117 Aug 24 10:38:19.521610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0c03e8da-2086-4d15-a6a7-41d2f9a1c552 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: de1ab918-0344-414e-8ec8-139343022fa1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:38:19.523938 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2639/4894] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:19 2022] GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e => generated 1511 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:38:19.678841 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0c03e8da-2086-4d15-a6a7-41d2f9a1c552 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.601688 Aug 24 10:38:19.680147 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2256/4895] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:38:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:38:19.696598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4615b7d6-f0ec-4280-b5f0-6b2e0ec73618 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:19.698840 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4615b7d6-f0ec-4280-b5f0-6b2e0ec73618 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: de1ab918-0344-414e-8ec8-139343022fa1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:19.864397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4615b7d6-f0ec-4280-b5f0-6b2e0ec73618 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988cbd2509314aeaa9ad618e705894d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc5853f2c1c434f832d5ffc2f550bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:19.865080 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-5aa47ec1-400e-4249-8ecc-27a36127a948 req-f89c673d-250a-4709-b8a3-dc74470f2109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5987159c-d9d2-4205-902c-c4356925dc8e", "name": "network-vif-deleted", "tag": "7d136f24-2726-43d9-a98e-8d1f6fb3472c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:38:19.873014 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4615b7d6-f0ec-4280-b5f0-6b2e0ec73618 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1" status: 200 len: 1218 microversion: 2.1 time: 0.185444 Aug 24 10:38:19.874231 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2640/4896] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:19 2022] GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1 => generated 1218 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:19.922220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5aa47ec1-400e-4249-8ecc-27a36127a948 req-f89c673d-250a-4709-b8a3-dc74470f2109 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:19.922912 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5aa47ec1-400e-4249-8ecc-27a36127a948 req-f89c673d-250a-4709-b8a3-dc74470f2109 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:19.930227 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5aa47ec1-400e-4249-8ecc-27a36127a948 req-f89c673d-250a-4709-b8a3-dc74470f2109 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:20.005331 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-5aa47ec1-400e-4249-8ecc-27a36127a948 req-f89c673d-250a-4709-b8a3-dc74470f2109 service nova] Creating event network-vif-deleted:7d136f24-2726-43d9-a98e-8d1f6fb3472c for instance 5987159c-d9d2-4205-902c-c4356925dc8e on n-h2-849328-3 Aug 24 10:38:20.026440 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-5aa47ec1-400e-4249-8ecc-27a36127a948 req-f89c673d-250a-4709-b8a3-dc74470f2109 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175601 Aug 24 10:38:20.032514 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2257/4897] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:38:20.037653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-31dc2306-969b-402a-9694-4c59fdf1619f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:20.039565 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-31dc2306-969b-402a-9694-4c59fdf1619f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: a8d638df-397c-4b18-9b86-1ef6ce736fcb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:20.071138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31dc2306-969b-402a-9694-4c59fdf1619f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:20.074484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31dc2306-969b-402a-9694-4c59fdf1619f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:20.075326 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31dc2306-969b-402a-9694-4c59fdf1619f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:20.078007 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31dc2306-969b-402a-9694-4c59fdf1619f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:20.079895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31dc2306-969b-402a-9694-4c59fdf1619f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:20.080010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31dc2306-969b-402a-9694-4c59fdf1619f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:20.424075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-31dc2306-969b-402a-9694-4c59fdf1619f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:20.446338 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-31dc2306-969b-402a-9694-4c59fdf1619f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb" status: 200 len: 1309 microversion: 2.1 time: 0.411255 Aug 24 10:38:20.464472 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2641/4898] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:20 2022] GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb => generated 1309 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:38:20.548502 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-29c6e0fa-8599-4a3e-9756-42dd7f3af556 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:20.549255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-29c6e0fa-8599-4a3e-9756-42dd7f3af556 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] [instance: 5987159c-d9d2-4205-902c-c4356925dc8e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:20.563576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29c6e0fa-8599-4a3e-9756-42dd7f3af556 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:20.564287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29c6e0fa-8599-4a3e-9756-42dd7f3af556 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:20.566146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29c6e0fa-8599-4a3e-9756-42dd7f3af556 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:20.569184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29c6e0fa-8599-4a3e-9756-42dd7f3af556 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:20.571108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29c6e0fa-8599-4a3e-9756-42dd7f3af556 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:20.574226 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29c6e0fa-8599-4a3e-9756-42dd7f3af556 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:20.658486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29c6e0fa-8599-4a3e-9756-42dd7f3af556 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:20.659026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29c6e0fa-8599-4a3e-9756-42dd7f3af556 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:20.659444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29c6e0fa-8599-4a3e-9756-42dd7f3af556 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:20.660082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-29c6e0fa-8599-4a3e-9756-42dd7f3af556 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lazy-loading 'fault' on Instance uuid 5987159c-d9d2-4205-902c-c4356925dc8e {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:38:20.744244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-29c6e0fa-8599-4a3e-9756-42dd7f3af556 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4b57697a02461285581183eddcaf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833ef551b89b4ec19797a0b39223841b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:20.757760 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-29c6e0fa-8599-4a3e-9756-42dd7f3af556 tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] 10.222.0.85 "GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e" status: 200 len: 1306 microversion: 2.1 time: 0.213720 Aug 24 10:38:20.760582 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2258/4899] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:20 2022] GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e => generated 1306 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:20.898565 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c97bf7d0-9456-4c52-9ebd-854d08e34bff tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:20.899203 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c97bf7d0-9456-4c52-9ebd-854d08e34bff tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: de1ab918-0344-414e-8ec8-139343022fa1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:20.909005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c97bf7d0-9456-4c52-9ebd-854d08e34bff tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:20.909810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c97bf7d0-9456-4c52-9ebd-854d08e34bff tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:20.911061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c97bf7d0-9456-4c52-9ebd-854d08e34bff tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:20.912157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c97bf7d0-9456-4c52-9ebd-854d08e34bff tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:20.912841 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c97bf7d0-9456-4c52-9ebd-854d08e34bff tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:20.913491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c97bf7d0-9456-4c52-9ebd-854d08e34bff tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:21.069700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c97bf7d0-9456-4c52-9ebd-854d08e34bff tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988cbd2509314aeaa9ad618e705894d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc5853f2c1c434f832d5ffc2f550bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:21.091726 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c97bf7d0-9456-4c52-9ebd-854d08e34bff tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1" status: 200 len: 1214 microversion: 2.1 time: 0.197673 Aug 24 10:38:21.092415 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2642/4900] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:20 2022] GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1 => generated 1214 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:21.184881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-96c813ab-aa49-4dd7-8644-3099d865ff1e req-f9cfc782-4b33-450b-830e-9d1bb4a0d1ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8d638df-397c-4b18-9b86-1ef6ce736fcb", "tag": "03feb44d-af0d-4031-bc39-b2b3f861be46"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:38:21.207472 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-96c813ab-aa49-4dd7-8644-3099d865ff1e req-f9cfc782-4b33-450b-830e-9d1bb4a0d1ff service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:21.208275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-96c813ab-aa49-4dd7-8644-3099d865ff1e req-f9cfc782-4b33-450b-830e-9d1bb4a0d1ff service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:21.208903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-96c813ab-aa49-4dd7-8644-3099d865ff1e req-f9cfc782-4b33-450b-830e-9d1bb4a0d1ff service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:21.250741 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-96c813ab-aa49-4dd7-8644-3099d865ff1e req-f9cfc782-4b33-450b-830e-9d1bb4a0d1ff service nova] Creating event network-changed:03feb44d-af0d-4031-bc39-b2b3f861be46 for instance a8d638df-397c-4b18-9b86-1ef6ce736fcb on n-h2-849328-3 Aug 24 10:38:21.267000 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-96c813ab-aa49-4dd7-8644-3099d865ff1e req-f9cfc782-4b33-450b-830e-9d1bb4a0d1ff service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085996 Aug 24 10:38:21.273933 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2259/4901] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:38:21.468125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-07f93aed-7405-4ee3-8389-ad224862197a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:21.469380 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-07f93aed-7405-4ee3-8389-ad224862197a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: a8d638df-397c-4b18-9b86-1ef6ce736fcb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:21.479732 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07f93aed-7405-4ee3-8389-ad224862197a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:21.480615 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07f93aed-7405-4ee3-8389-ad224862197a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:21.481830 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07f93aed-7405-4ee3-8389-ad224862197a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:21.483740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07f93aed-7405-4ee3-8389-ad224862197a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:21.486698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07f93aed-7405-4ee3-8389-ad224862197a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:21.497770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07f93aed-7405-4ee3-8389-ad224862197a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:21.779975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-370554f8-d2d5-4d46-9a48-8eb1f6d64bbd tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:21.780675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-370554f8-d2d5-4d46-9a48-8eb1f6d64bbd tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] [instance: 5987159c-d9d2-4205-902c-c4356925dc8e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:21.790513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-370554f8-d2d5-4d46-9a48-8eb1f6d64bbd tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:21.793258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-370554f8-d2d5-4d46-9a48-8eb1f6d64bbd tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:21.793631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-370554f8-d2d5-4d46-9a48-8eb1f6d64bbd tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:21.795201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-370554f8-d2d5-4d46-9a48-8eb1f6d64bbd tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:21.795668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-370554f8-d2d5-4d46-9a48-8eb1f6d64bbd tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:21.796090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-370554f8-d2d5-4d46-9a48-8eb1f6d64bbd tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:21.813669 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-370554f8-d2d5-4d46-9a48-8eb1f6d64bbd tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] HTTP exception thrown: Instance 5987159c-d9d2-4205-902c-c4356925dc8e could not be found. Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-370554f8-d2d5-4d46-9a48-8eb1f6d64bbd tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Request method failure captured: Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e HTTP/1.1 Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf-BRWKgqPyPTFsZ3vAusx7fAnQwR-meaCbc9jsX3aippYoAqIL-UBBeoWfX6UlsCXcfs_fJUH3QqHmSrirBGva6jtdxW5qbHGkdzQbtOw53NorM2V_0WLyJhfPWEbzli4ps76qBym3tXqp1Ysx2i2INe9ux6udyMYpmVY8y97kmBbY Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 833ef551b89b4ec19797a0b39223841b Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerPasswordTestJSON-1742645798 Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/833ef551b89b4ec19797a0b39223841b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_833ef551b89b4ec19797a0b39223841b", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/833ef551b89b4ec19797a0b39223841b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/833ef551b89b4ec19797a0b39223841b"}]}] Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerPasswordTestJSON-1742645798 Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 833ef551b89b4ec19797a0b39223841b Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1742645798 Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerPasswordTestJSON-1742645798-project Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: ba4b57697a02461285581183eddcaf55 Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerPasswordTestJSON-1742645798-project Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 5987159c-d9d2-4205-902c-c4356925dc8e could not be found. Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '5987159c-d9d2-4205-902c-c4356925dc8e'} Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5987159c-d9d2-4205-902c-c4356925dc8e could not be found. Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5987159c-d9d2-4205-902c-c4356925dc8e could not be found. Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:38:21.816084 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:38:21.822339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:38:21.822339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:38:21.822339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:38:21.822339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:38:21.822339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:38:21.822339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5987159c-d9d2-4205-902c-c4356925dc8e could not be found. Aug 24 10:38:21.822339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:38:21.830677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-370554f8-d2d5-4d46-9a48-8eb1f6d64bbd tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] Returning 404 to user: Instance 5987159c-d9d2-4205-902c-c4356925dc8e could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:38:21.832093 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-370554f8-d2d5-4d46-9a48-8eb1f6d64bbd tempest-ServerPasswordTestJSON-1742645798 tempest-ServerPasswordTestJSON-1742645798-project] 10.222.0.85 "GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e" status: 404 len: 111 microversion: 2.1 time: 0.056582 Aug 24 10:38:21.833964 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2260/4902] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:21 2022] GET /compute/v2.1/servers/5987159c-d9d2-4205-902c-c4356925dc8e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:38:21.988015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-07f93aed-7405-4ee3-8389-ad224862197a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:22.001195 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-07f93aed-7405-4ee3-8389-ad224862197a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb" status: 200 len: 1309 microversion: 2.1 time: 0.537002 Aug 24 10:38:22.003374 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2643/4903] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:21 2022] GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb => generated 1309 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:22.116977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4d42b9fc-8786-49e1-a599-cf9a1d837c0e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:22.117634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4d42b9fc-8786-49e1-a599-cf9a1d837c0e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: de1ab918-0344-414e-8ec8-139343022fa1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:22.128204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4d42b9fc-8786-49e1-a599-cf9a1d837c0e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:22.128922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4d42b9fc-8786-49e1-a599-cf9a1d837c0e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:22.132158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4d42b9fc-8786-49e1-a599-cf9a1d837c0e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:22.133069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4d42b9fc-8786-49e1-a599-cf9a1d837c0e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:22.133746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4d42b9fc-8786-49e1-a599-cf9a1d837c0e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:22.134768 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4d42b9fc-8786-49e1-a599-cf9a1d837c0e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:22.392399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4d42b9fc-8786-49e1-a599-cf9a1d837c0e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988cbd2509314aeaa9ad618e705894d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc5853f2c1c434f832d5ffc2f550bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:22.402440 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4d42b9fc-8786-49e1-a599-cf9a1d837c0e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1" status: 200 len: 1276 microversion: 2.1 time: 0.292110 Aug 24 10:38:22.403530 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2261/4904] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:22 2022] GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1 => generated 1276 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:23.038627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a09dcc9a-f0c2-4ac7-8058-b3db0e6e7c04 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:23.039093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a09dcc9a-f0c2-4ac7-8058-b3db0e6e7c04 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: a8d638df-397c-4b18-9b86-1ef6ce736fcb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:23.042532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:23.053734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a09dcc9a-f0c2-4ac7-8058-b3db0e6e7c04 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:23.054963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a09dcc9a-f0c2-4ac7-8058-b3db0e6e7c04 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:23.056072 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a09dcc9a-f0c2-4ac7-8058-b3db0e6e7c04 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:23.057641 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a09dcc9a-f0c2-4ac7-8058-b3db0e6e7c04 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:23.058699 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a09dcc9a-f0c2-4ac7-8058-b3db0e6e7c04 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:23.060107 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a09dcc9a-f0c2-4ac7-8058-b3db0e6e7c04 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:23.423770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6202c57c-caf0-4fcf-8728-d09cc5ee1aae tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:23.425015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6202c57c-caf0-4fcf-8728-d09cc5ee1aae tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: de1ab918-0344-414e-8ec8-139343022fa1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:23.435804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6202c57c-caf0-4fcf-8728-d09cc5ee1aae tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:23.445415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a09dcc9a-f0c2-4ac7-8058-b3db0e6e7c04 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:23.451971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6202c57c-caf0-4fcf-8728-d09cc5ee1aae tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:23.455641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6202c57c-caf0-4fcf-8728-d09cc5ee1aae tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:23.458891 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a09dcc9a-f0c2-4ac7-8058-b3db0e6e7c04 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb" status: 200 len: 1309 microversion: 2.1 time: 0.439032 Aug 24 10:38:23.459274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6202c57c-caf0-4fcf-8728-d09cc5ee1aae tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:23.460146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6202c57c-caf0-4fcf-8728-d09cc5ee1aae tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:23.469784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6202c57c-caf0-4fcf-8728-d09cc5ee1aae tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:23.470262 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2644/4905] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:23 2022] GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb => generated 1309 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:24.485505 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a3a3c379-2e9f-4e1b-b9be-a40565d1ce60 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:24.486275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a3a3c379-2e9f-4e1b-b9be-a40565d1ce60 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: a8d638df-397c-4b18-9b86-1ef6ce736fcb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:24.497065 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3a3c379-2e9f-4e1b-b9be-a40565d1ce60 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:24.509988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3a3c379-2e9f-4e1b-b9be-a40565d1ce60 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:24.510835 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3a3c379-2e9f-4e1b-b9be-a40565d1ce60 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:24.511819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3a3c379-2e9f-4e1b-b9be-a40565d1ce60 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:24.512538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3a3c379-2e9f-4e1b-b9be-a40565d1ce60 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:24.513229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3a3c379-2e9f-4e1b-b9be-a40565d1ce60 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:24.589344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6202c57c-caf0-4fcf-8728-d09cc5ee1aae tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988cbd2509314aeaa9ad618e705894d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc5853f2c1c434f832d5ffc2f550bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:24.600394 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6202c57c-caf0-4fcf-8728-d09cc5ee1aae tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1" status: 200 len: 1318 microversion: 2.1 time: 1.180169 Aug 24 10:38:24.615225 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2262/4906] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:23 2022] GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1 => generated 1318 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:38:24.745039 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:24.986314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a3a3c379-2e9f-4e1b-b9be-a40565d1ce60 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:24.997867 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a3a3c379-2e9f-4e1b-b9be-a40565d1ce60 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb" status: 200 len: 1309 microversion: 2.1 time: 0.514069 Aug 24 10:38:25.010565 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2645/4907] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:24 2022] GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb => generated 1309 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:25.450631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-23cb3799-c13c-4d83-88c3-8ffe89013d7b req-636a84c3-081a-42a5-9430-2408caba2b43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de1ab918-0344-414e-8ec8-139343022fa1", "tag": "94eb86ab-0bc1-4465-8b9b-9bfe7e51867f"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:38:25.482118 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-23cb3799-c13c-4d83-88c3-8ffe89013d7b req-636a84c3-081a-42a5-9430-2408caba2b43 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:25.484777 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-23cb3799-c13c-4d83-88c3-8ffe89013d7b req-636a84c3-081a-42a5-9430-2408caba2b43 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:25.485486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-23cb3799-c13c-4d83-88c3-8ffe89013d7b req-636a84c3-081a-42a5-9430-2408caba2b43 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:25.545100 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-23cb3799-c13c-4d83-88c3-8ffe89013d7b req-636a84c3-081a-42a5-9430-2408caba2b43 service nova] Creating event network-changed:94eb86ab-0bc1-4465-8b9b-9bfe7e51867f for instance de1ab918-0344-414e-8ec8-139343022fa1 on n-h1-849328-3 Aug 24 10:38:25.560897 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-23cb3799-c13c-4d83-88c3-8ffe89013d7b req-636a84c3-081a-42a5-9430-2408caba2b43 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129430 Aug 24 10:38:25.562018 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2263/4908] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:38:25.624653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d0ea38cb-a6d5-4500-be10-e860e818bb42 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:25.625373 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d0ea38cb-a6d5-4500-be10-e860e818bb42 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: de1ab918-0344-414e-8ec8-139343022fa1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:25.634614 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0ea38cb-a6d5-4500-be10-e860e818bb42 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:25.640132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0ea38cb-a6d5-4500-be10-e860e818bb42 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:25.642760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0ea38cb-a6d5-4500-be10-e860e818bb42 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:25.644335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0ea38cb-a6d5-4500-be10-e860e818bb42 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:25.651907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0ea38cb-a6d5-4500-be10-e860e818bb42 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:25.653045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0ea38cb-a6d5-4500-be10-e860e818bb42 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:26.025282 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-11ca15c6-8b36-4b5c-821f-edc74d0eed14 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:26.026982 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-11ca15c6-8b36-4b5c-821f-edc74d0eed14 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: a8d638df-397c-4b18-9b86-1ef6ce736fcb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:26.042046 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11ca15c6-8b36-4b5c-821f-edc74d0eed14 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:26.042971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11ca15c6-8b36-4b5c-821f-edc74d0eed14 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:26.045017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11ca15c6-8b36-4b5c-821f-edc74d0eed14 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:26.048424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11ca15c6-8b36-4b5c-821f-edc74d0eed14 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:26.049459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11ca15c6-8b36-4b5c-821f-edc74d0eed14 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:26.050189 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11ca15c6-8b36-4b5c-821f-edc74d0eed14 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:26.102335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d0ea38cb-a6d5-4500-be10-e860e818bb42 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988cbd2509314aeaa9ad618e705894d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc5853f2c1c434f832d5ffc2f550bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:26.116806 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d0ea38cb-a6d5-4500-be10-e860e818bb42 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1" status: 200 len: 1318 microversion: 2.1 time: 0.495097 Aug 24 10:38:26.120639 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2646/4909] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:25 2022] GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1 => generated 1318 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:26.484138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-11ca15c6-8b36-4b5c-821f-edc74d0eed14 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:26.500239 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-11ca15c6-8b36-4b5c-821f-edc74d0eed14 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb" status: 200 len: 1309 microversion: 2.1 time: 0.480656 Aug 24 10:38:26.501335 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2264/4910] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:26 2022] GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb => generated 1309 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:38:27.142039 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b994d916-2d68-49c9-ab77-d7b026424df4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:27.143307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b994d916-2d68-49c9-ab77-d7b026424df4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: de1ab918-0344-414e-8ec8-139343022fa1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:27.154004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b994d916-2d68-49c9-ab77-d7b026424df4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:27.154723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b994d916-2d68-49c9-ab77-d7b026424df4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:27.155817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b994d916-2d68-49c9-ab77-d7b026424df4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:27.157554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b994d916-2d68-49c9-ab77-d7b026424df4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:27.160164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b994d916-2d68-49c9-ab77-d7b026424df4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:27.160910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b994d916-2d68-49c9-ab77-d7b026424df4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:27.445819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b994d916-2d68-49c9-ab77-d7b026424df4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988cbd2509314aeaa9ad618e705894d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc5853f2c1c434f832d5ffc2f550bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:27.455225 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b994d916-2d68-49c9-ab77-d7b026424df4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1" status: 200 len: 1318 microversion: 2.1 time: 0.317650 Aug 24 10:38:27.455837 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2647/4911] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:27 2022] GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1 => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:27.531837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f1ba8c60-5c8a-46af-a784-174c5452acc7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:27.533367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f1ba8c60-5c8a-46af-a784-174c5452acc7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: a8d638df-397c-4b18-9b86-1ef6ce736fcb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:27.550011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1ba8c60-5c8a-46af-a784-174c5452acc7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:27.550932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1ba8c60-5c8a-46af-a784-174c5452acc7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:27.553066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1ba8c60-5c8a-46af-a784-174c5452acc7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:27.554148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1ba8c60-5c8a-46af-a784-174c5452acc7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:27.555094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1ba8c60-5c8a-46af-a784-174c5452acc7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:27.556323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1ba8c60-5c8a-46af-a784-174c5452acc7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:28.120754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f1ba8c60-5c8a-46af-a784-174c5452acc7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:28.129531 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f1ba8c60-5c8a-46af-a784-174c5452acc7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb" status: 200 len: 1309 microversion: 2.1 time: 0.608212 Aug 24 10:38:28.154070 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2265/4912] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:27 2022] GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb => generated 1309 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:28.476919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3a571e50-2c5c-4019-aa6f-d9a88d6f7d7e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:28.477989 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3a571e50-2c5c-4019-aa6f-d9a88d6f7d7e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: de1ab918-0344-414e-8ec8-139343022fa1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:28.491226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a571e50-2c5c-4019-aa6f-d9a88d6f7d7e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:28.494549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a571e50-2c5c-4019-aa6f-d9a88d6f7d7e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:28.495549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a571e50-2c5c-4019-aa6f-d9a88d6f7d7e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:28.500949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a571e50-2c5c-4019-aa6f-d9a88d6f7d7e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:28.501941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a571e50-2c5c-4019-aa6f-d9a88d6f7d7e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:28.502639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a571e50-2c5c-4019-aa6f-d9a88d6f7d7e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:29.096411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3a571e50-2c5c-4019-aa6f-d9a88d6f7d7e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988cbd2509314aeaa9ad618e705894d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc5853f2c1c434f832d5ffc2f550bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:29.114626 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3a571e50-2c5c-4019-aa6f-d9a88d6f7d7e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1" status: 200 len: 1318 microversion: 2.1 time: 0.640050 Aug 24 10:38:29.116255 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2648/4913] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:28 2022] GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1 => generated 1318 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:29.132297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-8076b84c-fcd3-46a0-87c9-0515f6b43198 req-a0f0abd9-aeb9-4130-be24-f41f294e7069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d638df-397c-4b18-9b86-1ef6ce736fcb", "name": "network-vif-plugged", "status": "completed", "tag": "03feb44d-af0d-4031-bc39-b2b3f861be46"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:38:29.152119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5b35d8fd-38d4-4dbb-b7ef-f67614cc74c7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:29.152837 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5b35d8fd-38d4-4dbb-b7ef-f67614cc74c7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: a8d638df-397c-4b18-9b86-1ef6ce736fcb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:29.165716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b35d8fd-38d4-4dbb-b7ef-f67614cc74c7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:29.166206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b35d8fd-38d4-4dbb-b7ef-f67614cc74c7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:29.166653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b35d8fd-38d4-4dbb-b7ef-f67614cc74c7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:29.167339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b35d8fd-38d4-4dbb-b7ef-f67614cc74c7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:29.167784 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b35d8fd-38d4-4dbb-b7ef-f67614cc74c7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:29.169406 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8076b84c-fcd3-46a0-87c9-0515f6b43198 req-a0f0abd9-aeb9-4130-be24-f41f294e7069 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:29.170071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8076b84c-fcd3-46a0-87c9-0515f6b43198 req-a0f0abd9-aeb9-4130-be24-f41f294e7069 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:29.170659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8076b84c-fcd3-46a0-87c9-0515f6b43198 req-a0f0abd9-aeb9-4130-be24-f41f294e7069 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:29.174196 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b35d8fd-38d4-4dbb-b7ef-f67614cc74c7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:29.192253 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-8076b84c-fcd3-46a0-87c9-0515f6b43198 req-a0f0abd9-aeb9-4130-be24-f41f294e7069 service nova] Creating event network-vif-plugged:03feb44d-af0d-4031-bc39-b2b3f861be46 for instance a8d638df-397c-4b18-9b86-1ef6ce736fcb on n-h2-849328-3 Aug 24 10:38:29.226946 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-8076b84c-fcd3-46a0-87c9-0515f6b43198 req-a0f0abd9-aeb9-4130-be24-f41f294e7069 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099267 Aug 24 10:38:29.227571 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2266/4914] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:38:29.528468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5b35d8fd-38d4-4dbb-b7ef-f67614cc74c7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:29.540752 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5b35d8fd-38d4-4dbb-b7ef-f67614cc74c7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb" status: 200 len: 1309 microversion: 2.1 time: 0.394228 Aug 24 10:38:29.544056 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2649/4915] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:29 2022] GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb => generated 1309 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:38:30.139553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f9f054ad-6a93-4076-818f-c43837973a8c tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:30.141513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f9f054ad-6a93-4076-818f-c43837973a8c tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: de1ab918-0344-414e-8ec8-139343022fa1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:30.143224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:30.143876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:30.160879 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9f054ad-6a93-4076-818f-c43837973a8c tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:30.164512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9f054ad-6a93-4076-818f-c43837973a8c tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:30.165223 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9f054ad-6a93-4076-818f-c43837973a8c tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:30.166150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9f054ad-6a93-4076-818f-c43837973a8c tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:30.167244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9f054ad-6a93-4076-818f-c43837973a8c tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:30.169398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9f054ad-6a93-4076-818f-c43837973a8c tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:30.485298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f9f054ad-6a93-4076-818f-c43837973a8c tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988cbd2509314aeaa9ad618e705894d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc5853f2c1c434f832d5ffc2f550bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:30.498685 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f9f054ad-6a93-4076-818f-c43837973a8c tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1" status: 200 len: 1318 microversion: 2.1 time: 0.364258 Aug 24 10:38:30.499946 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2267/4916] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:30 2022] GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1 => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:30.561450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:30.574836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aa4f8329-5e46-4383-8e74-57add66582ff tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:30.575888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aa4f8329-5e46-4383-8e74-57add66582ff tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: a8d638df-397c-4b18-9b86-1ef6ce736fcb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:30.583475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa4f8329-5e46-4383-8e74-57add66582ff tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:30.583986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa4f8329-5e46-4383-8e74-57add66582ff tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:30.584464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa4f8329-5e46-4383-8e74-57add66582ff tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:30.586049 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa4f8329-5e46-4383-8e74-57add66582ff tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:30.586658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa4f8329-5e46-4383-8e74-57add66582ff tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:30.587280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa4f8329-5e46-4383-8e74-57add66582ff tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:30.919938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aa4f8329-5e46-4383-8e74-57add66582ff tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:30.935413 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aa4f8329-5e46-4383-8e74-57add66582ff tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb" status: 200 len: 1309 microversion: 2.1 time: 0.375127 Aug 24 10:38:30.936596 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2650/4917] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:30 2022] GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb => generated 1309 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:31.329629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-05444f47-82e8-42de-8806-ff606215534c req-66e6cc27-c179-4572-a436-dc7aa03292a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de1ab918-0344-414e-8ec8-139343022fa1", "name": "network-vif-plugged", "status": "completed", "tag": "94eb86ab-0bc1-4465-8b9b-9bfe7e51867f"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:38:31.359933 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-05444f47-82e8-42de-8806-ff606215534c req-66e6cc27-c179-4572-a436-dc7aa03292a1 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:31.360444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-05444f47-82e8-42de-8806-ff606215534c req-66e6cc27-c179-4572-a436-dc7aa03292a1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:31.360876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-05444f47-82e8-42de-8806-ff606215534c req-66e6cc27-c179-4572-a436-dc7aa03292a1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:31.406429 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-05444f47-82e8-42de-8806-ff606215534c req-66e6cc27-c179-4572-a436-dc7aa03292a1 service nova] Creating event network-vif-plugged:94eb86ab-0bc1-4465-8b9b-9bfe7e51867f for instance de1ab918-0344-414e-8ec8-139343022fa1 on n-h1-849328-3 Aug 24 10:38:31.415909 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-05444f47-82e8-42de-8806-ff606215534c req-66e6cc27-c179-4572-a436-dc7aa03292a1 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089121 Aug 24 10:38:31.416916 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2268/4918] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:38:31.521283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fc8ca648-fbaf-45b9-a641-22f5a74329d2 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:31.522205 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fc8ca648-fbaf-45b9-a641-22f5a74329d2 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: de1ab918-0344-414e-8ec8-139343022fa1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:31.534613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc8ca648-fbaf-45b9-a641-22f5a74329d2 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:31.537222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc8ca648-fbaf-45b9-a641-22f5a74329d2 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:31.538950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc8ca648-fbaf-45b9-a641-22f5a74329d2 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:31.539972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc8ca648-fbaf-45b9-a641-22f5a74329d2 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:31.542387 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc8ca648-fbaf-45b9-a641-22f5a74329d2 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:31.545980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc8ca648-fbaf-45b9-a641-22f5a74329d2 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:31.960913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5c83d2cd-36d5-4f10-a17b-1f42693c6f68 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:31.961667 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5c83d2cd-36d5-4f10-a17b-1f42693c6f68 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: a8d638df-397c-4b18-9b86-1ef6ce736fcb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:31.975747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fc8ca648-fbaf-45b9-a641-22f5a74329d2 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988cbd2509314aeaa9ad618e705894d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc5853f2c1c434f832d5ffc2f550bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:31.976540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c83d2cd-36d5-4f10-a17b-1f42693c6f68 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:31.977113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c83d2cd-36d5-4f10-a17b-1f42693c6f68 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:31.977573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c83d2cd-36d5-4f10-a17b-1f42693c6f68 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:31.978283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c83d2cd-36d5-4f10-a17b-1f42693c6f68 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:31.979624 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c83d2cd-36d5-4f10-a17b-1f42693c6f68 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:31.980063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c83d2cd-36d5-4f10-a17b-1f42693c6f68 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:31.988242 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fc8ca648-fbaf-45b9-a641-22f5a74329d2 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1" status: 200 len: 1318 microversion: 2.1 time: 0.472010 Aug 24 10:38:31.991825 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2651/4919] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:31 2022] GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1 => generated 1318 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:32.395322 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5c83d2cd-36d5-4f10-a17b-1f42693c6f68 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:32.413605 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5c83d2cd-36d5-4f10-a17b-1f42693c6f68 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb" status: 200 len: 1490 microversion: 2.1 time: 0.457982 Aug 24 10:38:32.421370 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2269/4920] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:31 2022] GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb => generated 1490 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:38:32.591650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bc531631-27f7-4459-8953-c7790bdee699 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1460045027", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "444806fc-9684-467f-82d3-8ae5206eec37"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:38:32.691697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-bc531631-27f7-4459-8953-c7790bdee699 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] validate_networks() for [('444806fc-9684-467f-82d3-8ae5206eec37', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:38:32.943258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e3391064-17bc-4f2e-9bc9-5b6087247447 tempest-ComputeTenantNetworksTest-411625349 tempest-ComputeTenantNetworksTest-411625349-project] Calling method '.version_select at 0x7f46540bc310>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:33.215691 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e3391064-17bc-4f2e-9bc9-5b6087247447 tempest-ComputeTenantNetworksTest-411625349 tempest-ComputeTenantNetworksTest-411625349-project] 10.222.0.85 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 423 microversion: 2.1 time: 0.472583 Aug 24 10:38:33.216313 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2270/4921] 10.222.0.85 () {58 vars in 1158 bytes} [Wed Aug 24 10:38:32 2022] GET /compute/v2.1/os-tenant-networks => generated 423 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:38:33.221878 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-023ef895-c689-4912-86d9-286f1b942363 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:33.222483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-023ef895-c689-4912-86d9-286f1b942363 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: de1ab918-0344-414e-8ec8-139343022fa1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:33.235191 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-023ef895-c689-4912-86d9-286f1b942363 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:33.235726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-023ef895-c689-4912-86d9-286f1b942363 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:33.236158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-023ef895-c689-4912-86d9-286f1b942363 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:33.236867 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-023ef895-c689-4912-86d9-286f1b942363 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:33.237339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-023ef895-c689-4912-86d9-286f1b942363 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:33.237977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-023ef895-c689-4912-86d9-286f1b942363 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:33.445496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-023ef895-c689-4912-86d9-286f1b942363 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988cbd2509314aeaa9ad618e705894d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc5853f2c1c434f832d5ffc2f550bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:33.455619 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-023ef895-c689-4912-86d9-286f1b942363 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1" status: 200 len: 1318 microversion: 2.1 time: 0.237831 Aug 24 10:38:33.458175 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2271/4922] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:33 2022] GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:33.463850 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fae12053-fa80-4cb7-9aec-cd4ffa543fdc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:33.464924 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fae12053-fa80-4cb7-9aec-cd4ffa543fdc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:33.472644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fae12053-fa80-4cb7-9aec-cd4ffa543fdc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:33.473494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fae12053-fa80-4cb7-9aec-cd4ffa543fdc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:33.474250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fae12053-fa80-4cb7-9aec-cd4ffa543fdc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:33.475187 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fae12053-fa80-4cb7-9aec-cd4ffa543fdc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:33.475953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fae12053-fa80-4cb7-9aec-cd4ffa543fdc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:33.476606 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fae12053-fa80-4cb7-9aec-cd4ffa543fdc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:33.504639 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fae12053-fa80-4cb7-9aec-cd4ffa543fdc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/ips" status: 200 len: 152 microversion: 2.20 time: 0.044904 Aug 24 10:38:33.525082 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2272/4923] 10.222.0.85 () {60 vars in 1289 bytes} [Wed Aug 24 10:38:33 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/ips => generated 152 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:38:33.539763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3bbcdf7b-f661-41f5-ab01-826edfb422f0 tempest-ComputeTenantNetworksTest-411625349 tempest-ComputeTenantNetworksTest-411625349-project] Calling method '.version_select at 0x7f46540578b0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:33.685945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-bc531631-27f7-4459-8953-c7790bdee699 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:38:33.686946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-bc531631-27f7-4459-8953-c7790bdee699 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:38:33.688844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-bc531631-27f7-4459-8953-c7790bdee699 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:38:33.690343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-bc531631-27f7-4459-8953-c7790bdee699 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:38:33.691159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-bc531631-27f7-4459-8953-c7790bdee699 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:38:33.717716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc531631-27f7-4459-8953-c7790bdee699 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:33.720696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc531631-27f7-4459-8953-c7790bdee699 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:33.721461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc531631-27f7-4459-8953-c7790bdee699 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:33.722721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc531631-27f7-4459-8953-c7790bdee699 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:33.725276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc531631-27f7-4459-8953-c7790bdee699 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:33.726018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc531631-27f7-4459-8953-c7790bdee699 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:33.734490 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3bbcdf7b-f661-41f5-ab01-826edfb422f0 tempest-ComputeTenantNetworksTest-411625349 tempest-ComputeTenantNetworksTest-411625349-project] 10.222.0.85 "GET /compute/v2.1/os-tenant-networks/1a68f521-9338-4ca7-83fe-d2c04bfbafe4" status: 200 len: 139 microversion: 2.1 time: 0.208067 Aug 24 10:38:33.736025 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2273/4924] 10.222.0.85 () {58 vars in 1269 bytes} [Wed Aug 24 10:38:33 2022] GET /compute/v2.1/os-tenant-networks/1a68f521-9338-4ca7-83fe-d2c04bfbafe4 => generated 139 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:38:33.799006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-bc531631-27f7-4459-8953-c7790bdee699 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Getting quotas for project 8b489eabb0014ddc9a2fcdf6e78ee740. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:38:33.813408 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-bc531631-27f7-4459-8953-c7790bdee699 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Getting quotas for user 83a25a0677c04f8ba975528ece80d676 and project 8b489eabb0014ddc9a2fcdf6e78ee740. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:38:33.846637 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bc531631-27f7-4459-8953-c7790bdee699 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:38:33.851022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bc531631-27f7-4459-8953-c7790bdee699 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:38:33.956186 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bc531631-27f7-4459-8953-c7790bdee699 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.368565 Aug 24 10:38:33.957661 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2652/4925] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:38:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:38:33.974401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5d2fc12f-0ac9-4ddd-b23b-2206e661bb87 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:33.976523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5d2fc12f-0ac9-4ddd-b23b-2206e661bb87 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:34.335164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5d2fc12f-0ac9-4ddd-b23b-2206e661bb87 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:34.348470 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5d2fc12f-0ac9-4ddd-b23b-2206e661bb87 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2" status: 200 len: 1209 microversion: 2.1 time: 0.382979 Aug 24 10:38:34.353702 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2274/4926] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:33 2022] GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 => generated 1209 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:34.482455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ca9b19f-dc3e-4c6f-972f-7210f3bf9002 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:34.483567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4ca9b19f-dc3e-4c6f-972f-7210f3bf9002 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: de1ab918-0344-414e-8ec8-139343022fa1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:34.509655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ca9b19f-dc3e-4c6f-972f-7210f3bf9002 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:34.510613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ca9b19f-dc3e-4c6f-972f-7210f3bf9002 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:34.512340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ca9b19f-dc3e-4c6f-972f-7210f3bf9002 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:34.514048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ca9b19f-dc3e-4c6f-972f-7210f3bf9002 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:34.517815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ca9b19f-dc3e-4c6f-972f-7210f3bf9002 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:34.521113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ca9b19f-dc3e-4c6f-972f-7210f3bf9002 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:35.380296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d7fac36-6f39-4a65-8dbc-ab0821f42e16 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:35.381565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9d7fac36-6f39-4a65-8dbc-ab0821f42e16 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:35.390085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d7fac36-6f39-4a65-8dbc-ab0821f42e16 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:35.393723 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d7fac36-6f39-4a65-8dbc-ab0821f42e16 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:35.394362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d7fac36-6f39-4a65-8dbc-ab0821f42e16 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:35.395256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d7fac36-6f39-4a65-8dbc-ab0821f42e16 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:35.395880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d7fac36-6f39-4a65-8dbc-ab0821f42e16 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:35.396494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d7fac36-6f39-4a65-8dbc-ab0821f42e16 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:35.536011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4ca9b19f-dc3e-4c6f-972f-7210f3bf9002 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988cbd2509314aeaa9ad618e705894d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc5853f2c1c434f832d5ffc2f550bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:35.579635 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4ca9b19f-dc3e-4c6f-972f-7210f3bf9002 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1" status: 200 len: 1507 microversion: 2.1 time: 1.103160 Aug 24 10:38:35.587854 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2653/4927] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:34 2022] GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1 => generated 1507 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:35.613876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9d7fac36-6f39-4a65-8dbc-ab0821f42e16 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:35.632252 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9d7fac36-6f39-4a65-8dbc-ab0821f42e16 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2" status: 200 len: 1261 microversion: 2.1 time: 0.261627 Aug 24 10:38:35.632947 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2275/4928] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:35 2022] GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 => generated 1261 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:38:36.676611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fe3e290c-343a-4f66-8f67-a689ab909815 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:36.677464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fe3e290c-343a-4f66-8f67-a689ab909815 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:36.710628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe3e290c-343a-4f66-8f67-a689ab909815 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:36.711555 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe3e290c-343a-4f66-8f67-a689ab909815 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:36.712290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe3e290c-343a-4f66-8f67-a689ab909815 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:36.716278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe3e290c-343a-4f66-8f67-a689ab909815 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:36.717969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe3e290c-343a-4f66-8f67-a689ab909815 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:36.720931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe3e290c-343a-4f66-8f67-a689ab909815 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:36.960901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fe3e290c-343a-4f66-8f67-a689ab909815 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:36.975854 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fe3e290c-343a-4f66-8f67-a689ab909815 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2" status: 200 len: 1267 microversion: 2.1 time: 0.300324 Aug 24 10:38:36.977342 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2654/4929] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:36 2022] GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 => generated 1267 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:38.004838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f5cb6a6a-eb08-4b80-bc23-7476e177362e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:38.006312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f5cb6a6a-eb08-4b80-bc23-7476e177362e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:38.032229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5cb6a6a-eb08-4b80-bc23-7476e177362e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:38.034802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5cb6a6a-eb08-4b80-bc23-7476e177362e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:38.037159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5cb6a6a-eb08-4b80-bc23-7476e177362e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:38.040694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5cb6a6a-eb08-4b80-bc23-7476e177362e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:38.041619 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5cb6a6a-eb08-4b80-bc23-7476e177362e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:38.048385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5cb6a6a-eb08-4b80-bc23-7476e177362e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:38.073167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7976fa2e-ca43-4ef1-8d34-22c40cd155a3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:38:38.074408 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7976fa2e-ca43-4ef1-8d34-22c40cd155a3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:38.113546 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7976fa2e-ca43-4ef1-8d34-22c40cd155a3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:38.114588 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7976fa2e-ca43-4ef1-8d34-22c40cd155a3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:38.118649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7976fa2e-ca43-4ef1-8d34-22c40cd155a3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:38.124594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7976fa2e-ca43-4ef1-8d34-22c40cd155a3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:38.132966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7976fa2e-ca43-4ef1-8d34-22c40cd155a3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:38.135202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7976fa2e-ca43-4ef1-8d34-22c40cd155a3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:38.163641 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:38.257479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-7976fa2e-ca43-4ef1-8d34-22c40cd155a3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lazy-loading 'flavor' on Instance uuid 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:38:38.831951 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7976fa2e-ca43-4ef1-8d34-22c40cd155a3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "POST /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/action" status: 202 len: 0 microversion: 2.20 time: 0.768628 Aug 24 10:38:38.832837 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2655/4930] 10.222.0.85 () {62 vars in 1319 bytes} [Wed Aug 24 10:38:38 2022] POST /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/action => generated 0 bytes in 771 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:38:38.847189 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a9073d61-8907-4eb1-abfd-26d22aee1b91 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:38.847886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a9073d61-8907-4eb1-abfd-26d22aee1b91 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:38.866211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9073d61-8907-4eb1-abfd-26d22aee1b91 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:38.873369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9073d61-8907-4eb1-abfd-26d22aee1b91 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:38.875463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9073d61-8907-4eb1-abfd-26d22aee1b91 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:38.882285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9073d61-8907-4eb1-abfd-26d22aee1b91 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:38.884712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9073d61-8907-4eb1-abfd-26d22aee1b91 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:38.885432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9073d61-8907-4eb1-abfd-26d22aee1b91 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:38.944561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f5cb6a6a-eb08-4b80-bc23-7476e177362e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:38.958894 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f5cb6a6a-eb08-4b80-bc23-7476e177362e tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2" status: 200 len: 1309 microversion: 2.1 time: 0.962747 Aug 24 10:38:38.960247 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2276/4931] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:37 2022] GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 => generated 1309 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:39.340219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a9073d61-8907-4eb1-abfd-26d22aee1b91 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:39.355310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a9073d61-8907-4eb1-abfd-26d22aee1b91 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:39.357469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a9073d61-8907-4eb1-abfd-26d22aee1b91 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:39.365111 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a9073d61-8907-4eb1-abfd-26d22aee1b91 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1723 microversion: 2.20 time: 0.527003 Aug 24 10:38:39.370074 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2656/4932] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:38:38 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1723 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:38:39.715218 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-6a31e5df-d9e1-4b83-b449-103f57a18167 req-79f99e32-687b-4361-85a9-085eb1c12514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c00e900-78b8-4a70-97b3-d2fa3c9e05d2", "tag": "aca9920f-883b-4aa8-84c3-1a2bfdb4eb7f"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:38:39.748093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6a31e5df-d9e1-4b83-b449-103f57a18167 req-79f99e32-687b-4361-85a9-085eb1c12514 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:39.748289 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6a31e5df-d9e1-4b83-b449-103f57a18167 req-79f99e32-687b-4361-85a9-085eb1c12514 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:39.748892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6a31e5df-d9e1-4b83-b449-103f57a18167 req-79f99e32-687b-4361-85a9-085eb1c12514 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:39.790467 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-6a31e5df-d9e1-4b83-b449-103f57a18167 req-79f99e32-687b-4361-85a9-085eb1c12514 service nova] Creating event network-changed:aca9920f-883b-4aa8-84c3-1a2bfdb4eb7f for instance 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 on n-h2-849328-3 Aug 24 10:38:39.802835 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-6a31e5df-d9e1-4b83-b449-103f57a18167 req-79f99e32-687b-4361-85a9-085eb1c12514 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094559 Aug 24 10:38:39.804253 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2277/4933] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:38:39.981613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c62b61aa-2426-4270-be03-d26f9841b005 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:39.982674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c62b61aa-2426-4270-be03-d26f9841b005 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:39.996196 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c62b61aa-2426-4270-be03-d26f9841b005 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:39.997419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c62b61aa-2426-4270-be03-d26f9841b005 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:39.998241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c62b61aa-2426-4270-be03-d26f9841b005 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:40.000085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c62b61aa-2426-4270-be03-d26f9841b005 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:40.004181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c62b61aa-2426-4270-be03-d26f9841b005 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:40.004638 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c62b61aa-2426-4270-be03-d26f9841b005 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:40.390517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-377cfce7-665f-405c-86ae-98b71342b7b9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:40.392413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-377cfce7-665f-405c-86ae-98b71342b7b9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:40.417604 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-377cfce7-665f-405c-86ae-98b71342b7b9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:40.418121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-377cfce7-665f-405c-86ae-98b71342b7b9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:40.418633 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-377cfce7-665f-405c-86ae-98b71342b7b9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:40.419370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-377cfce7-665f-405c-86ae-98b71342b7b9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:40.429084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-377cfce7-665f-405c-86ae-98b71342b7b9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:40.431704 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c62b61aa-2426-4270-be03-d26f9841b005 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:40.433058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-377cfce7-665f-405c-86ae-98b71342b7b9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:40.453500 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c62b61aa-2426-4270-be03-d26f9841b005 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2" status: 200 len: 1309 microversion: 2.1 time: 0.473155 Aug 24 10:38:40.474590 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2657/4934] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:39 2022] GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 => generated 1309 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:40.874242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-377cfce7-665f-405c-86ae-98b71342b7b9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:40.884634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-377cfce7-665f-405c-86ae-98b71342b7b9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:40.886254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-377cfce7-665f-405c-86ae-98b71342b7b9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:40.887492 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-377cfce7-665f-405c-86ae-98b71342b7b9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1723 microversion: 2.20 time: 0.503254 Aug 24 10:38:40.888071 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2278/4935] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:38:40 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1723 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:38:41.480088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eb047113-08d5-49d6-a9b1-bb766f470f56 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:41.481395 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-eb047113-08d5-49d6-a9b1-bb766f470f56 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:41.514895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb047113-08d5-49d6-a9b1-bb766f470f56 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:41.520021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb047113-08d5-49d6-a9b1-bb766f470f56 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:41.520589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb047113-08d5-49d6-a9b1-bb766f470f56 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:41.523459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb047113-08d5-49d6-a9b1-bb766f470f56 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:41.524991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb047113-08d5-49d6-a9b1-bb766f470f56 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:41.525548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb047113-08d5-49d6-a9b1-bb766f470f56 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:41.913111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-eb047113-08d5-49d6-a9b1-bb766f470f56 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:41.917018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4c988878-e76d-4363-ac8c-8adc0edf9678 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:41.935489 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eb047113-08d5-49d6-a9b1-bb766f470f56 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2" status: 200 len: 1309 microversion: 2.1 time: 0.457884 Aug 24 10:38:41.935738 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4c988878-e76d-4363-ac8c-8adc0edf9678 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:41.941921 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2658/4936] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:41 2022] GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 => generated 1309 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:41.980700 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c988878-e76d-4363-ac8c-8adc0edf9678 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:41.981414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c988878-e76d-4363-ac8c-8adc0edf9678 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:41.984102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c988878-e76d-4363-ac8c-8adc0edf9678 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:41.988911 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c988878-e76d-4363-ac8c-8adc0edf9678 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:41.996876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c988878-e76d-4363-ac8c-8adc0edf9678 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:41.997836 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c988878-e76d-4363-ac8c-8adc0edf9678 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:42.348916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4c988878-e76d-4363-ac8c-8adc0edf9678 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:42.367641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4c988878-e76d-4363-ac8c-8adc0edf9678 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:42.369359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4c988878-e76d-4363-ac8c-8adc0edf9678 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:42.378101 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4c988878-e76d-4363-ac8c-8adc0edf9678 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1723 microversion: 2.20 time: 0.465333 Aug 24 10:38:42.381902 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2279/4937] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:38:41 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1723 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:38:42.965185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c6a853ec-d19b-4e33-b977-550cc5fc2fa9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:42.966490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c6a853ec-d19b-4e33-b977-550cc5fc2fa9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:42.974946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6a853ec-d19b-4e33-b977-550cc5fc2fa9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:42.975749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6a853ec-d19b-4e33-b977-550cc5fc2fa9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:42.976415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6a853ec-d19b-4e33-b977-550cc5fc2fa9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:42.977396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6a853ec-d19b-4e33-b977-550cc5fc2fa9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:42.978026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6a853ec-d19b-4e33-b977-550cc5fc2fa9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:42.978626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6a853ec-d19b-4e33-b977-550cc5fc2fa9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:43.237296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c6a853ec-d19b-4e33-b977-550cc5fc2fa9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:43.250945 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c6a853ec-d19b-4e33-b977-550cc5fc2fa9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2" status: 200 len: 1309 microversion: 2.1 time: 0.286778 Aug 24 10:38:43.250945 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2659/4938] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:42 2022] GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 => generated 1309 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:43.409176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-36b9b13f-0415-4196-8db3-fd506b1a4791 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:43.411086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-36b9b13f-0415-4196-8db3-fd506b1a4791 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:43.450372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36b9b13f-0415-4196-8db3-fd506b1a4791 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:43.451097 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36b9b13f-0415-4196-8db3-fd506b1a4791 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:43.451702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36b9b13f-0415-4196-8db3-fd506b1a4791 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:43.453083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36b9b13f-0415-4196-8db3-fd506b1a4791 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:43.453849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36b9b13f-0415-4196-8db3-fd506b1a4791 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:43.454439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36b9b13f-0415-4196-8db3-fd506b1a4791 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:43.485185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:43.927231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-36b9b13f-0415-4196-8db3-fd506b1a4791 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:43.940370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-36b9b13f-0415-4196-8db3-fd506b1a4791 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:43.947176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-36b9b13f-0415-4196-8db3-fd506b1a4791 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:43.949080 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-36b9b13f-0415-4196-8db3-fd506b1a4791 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1723 microversion: 2.20 time: 0.549704 Aug 24 10:38:43.954481 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2280/4939] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:38:43 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1723 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:38:44.267943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3a771979-b2bb-473c-b821-dc2707306964 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:44.268531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3a771979-b2bb-473c-b821-dc2707306964 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:44.270711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:44.271395 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:44.287481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a771979-b2bb-473c-b821-dc2707306964 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:44.287977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a771979-b2bb-473c-b821-dc2707306964 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:44.288412 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a771979-b2bb-473c-b821-dc2707306964 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:44.297538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a771979-b2bb-473c-b821-dc2707306964 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:44.298126 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a771979-b2bb-473c-b821-dc2707306964 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:44.298578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a771979-b2bb-473c-b821-dc2707306964 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:44.754857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3a771979-b2bb-473c-b821-dc2707306964 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:44.797323 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3a771979-b2bb-473c-b821-dc2707306964 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2" status: 200 len: 1309 microversion: 2.1 time: 0.533036 Aug 24 10:38:44.797974 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2660/4940] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:44 2022] GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 => generated 1309 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:38:44.979367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1680ca78-9e2d-46f4-8b27-5b81789af687 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:44.979965 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1680ca78-9e2d-46f4-8b27-5b81789af687 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:44.994050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:44.997141 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1680ca78-9e2d-46f4-8b27-5b81789af687 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:44.997627 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1680ca78-9e2d-46f4-8b27-5b81789af687 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:44.998266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1680ca78-9e2d-46f4-8b27-5b81789af687 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:45.000887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1680ca78-9e2d-46f4-8b27-5b81789af687 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:45.001366 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1680ca78-9e2d-46f4-8b27-5b81789af687 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:45.002651 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1680ca78-9e2d-46f4-8b27-5b81789af687 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:45.245334 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-91d7860a-5622-4135-b343-6e0b3acaab9a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:45.246336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-91d7860a-5622-4135-b343-6e0b3acaab9a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:45.269414 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91d7860a-5622-4135-b343-6e0b3acaab9a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:45.273559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91d7860a-5622-4135-b343-6e0b3acaab9a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:45.278207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91d7860a-5622-4135-b343-6e0b3acaab9a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:45.286230 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91d7860a-5622-4135-b343-6e0b3acaab9a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:45.288124 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91d7860a-5622-4135-b343-6e0b3acaab9a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:45.290341 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91d7860a-5622-4135-b343-6e0b3acaab9a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:45.592133 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-91d7860a-5622-4135-b343-6e0b3acaab9a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:45.603935 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-91d7860a-5622-4135-b343-6e0b3acaab9a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.369686 Aug 24 10:38:45.605343 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2661/4941] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:45 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:45.629779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f138169b-fe25-4671-a16e-d3d4c443d706 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:45.630778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f138169b-fe25-4671-a16e-d3d4c443d706 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:45.634939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1680ca78-9e2d-46f4-8b27-5b81789af687 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:45.639044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f138169b-fe25-4671-a16e-d3d4c443d706 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:45.639927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f138169b-fe25-4671-a16e-d3d4c443d706 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:45.640623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f138169b-fe25-4671-a16e-d3d4c443d706 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:45.641649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f138169b-fe25-4671-a16e-d3d4c443d706 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:45.642324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f138169b-fe25-4671-a16e-d3d4c443d706 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:45.642981 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f138169b-fe25-4671-a16e-d3d4c443d706 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:45.676101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1680ca78-9e2d-46f4-8b27-5b81789af687 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:45.679957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1680ca78-9e2d-46f4-8b27-5b81789af687 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:45.686072 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1680ca78-9e2d-46f4-8b27-5b81789af687 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1723 microversion: 2.20 time: 0.713409 Aug 24 10:38:45.688601 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2281/4942] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:38:44 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1723 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:38:45.824418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a285764c-2652-4a40-ba7a-a88f11f73229 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:45.826500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a285764c-2652-4a40-ba7a-a88f11f73229 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:45.840169 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a285764c-2652-4a40-ba7a-a88f11f73229 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:45.842451 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a285764c-2652-4a40-ba7a-a88f11f73229 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:45.845244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a285764c-2652-4a40-ba7a-a88f11f73229 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:45.846195 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a285764c-2652-4a40-ba7a-a88f11f73229 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:45.847527 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a285764c-2652-4a40-ba7a-a88f11f73229 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:45.850050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a285764c-2652-4a40-ba7a-a88f11f73229 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:45.968254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f138169b-fe25-4671-a16e-d3d4c443d706 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:45.995422 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f138169b-fe25-4671-a16e-d3d4c443d706 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.370894 Aug 24 10:38:46.009788 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2662/4943] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:45 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:46.016681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f7578563-95f5-4663-a76b-1e846edbd783 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:46.017496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f7578563-95f5-4663-a76b-1e846edbd783 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:46.023876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7578563-95f5-4663-a76b-1e846edbd783 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:46.024597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7578563-95f5-4663-a76b-1e846edbd783 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:46.025235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7578563-95f5-4663-a76b-1e846edbd783 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:46.026794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7578563-95f5-4663-a76b-1e846edbd783 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:46.027475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7578563-95f5-4663-a76b-1e846edbd783 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:46.028184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7578563-95f5-4663-a76b-1e846edbd783 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:46.312491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f7578563-95f5-4663-a76b-1e846edbd783 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:46.331672 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f7578563-95f5-4663-a76b-1e846edbd783 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.318964 Aug 24 10:38:46.348521 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2663/4944] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:46 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:38:46.377472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-24e7f470-15be-411a-8186-ee43267057aa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:46.378099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-24e7f470-15be-411a-8186-ee43267057aa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:46.396607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24e7f470-15be-411a-8186-ee43267057aa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:46.397099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24e7f470-15be-411a-8186-ee43267057aa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:46.401407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24e7f470-15be-411a-8186-ee43267057aa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:46.402588 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24e7f470-15be-411a-8186-ee43267057aa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:46.403329 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24e7f470-15be-411a-8186-ee43267057aa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:46.405286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24e7f470-15be-411a-8186-ee43267057aa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:46.673528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a285764c-2652-4a40-ba7a-a88f11f73229 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:46.698425 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a285764c-2652-4a40-ba7a-a88f11f73229 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2" status: 200 len: 1309 microversion: 2.1 time: 0.876778 Aug 24 10:38:46.722813 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2282/4945] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:45 2022] GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 => generated 1309 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:46.745111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8b49c4ca-9e55-46d6-9555-fa48d986d750 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:46.745781 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8b49c4ca-9e55-46d6-9555-fa48d986d750 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:46.764666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-24e7f470-15be-411a-8186-ee43267057aa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:46.775834 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b49c4ca-9e55-46d6-9555-fa48d986d750 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:46.779881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b49c4ca-9e55-46d6-9555-fa48d986d750 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:46.780657 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b49c4ca-9e55-46d6-9555-fa48d986d750 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:46.781594 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b49c4ca-9e55-46d6-9555-fa48d986d750 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:46.782222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b49c4ca-9e55-46d6-9555-fa48d986d750 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:46.782829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b49c4ca-9e55-46d6-9555-fa48d986d750 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:46.788428 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-24e7f470-15be-411a-8186-ee43267057aa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.433039 Aug 24 10:38:46.790439 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2664/4946] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:46 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:47.129626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f072f8e1-4c89-49a2-a089-62ba117771eb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1790039854", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "c436d0f2-980c-499c-87fc-ff5c4aa0438d"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:38:47.257550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-f072f8e1-4c89-49a2-a089-62ba117771eb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] validate_networks() for [('c436d0f2-980c-499c-87fc-ff5c4aa0438d', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:38:47.428229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8b49c4ca-9e55-46d6-9555-fa48d986d750 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:47.449211 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8b49c4ca-9e55-46d6-9555-fa48d986d750 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:47.456873 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8b49c4ca-9e55-46d6-9555-fa48d986d750 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:47.461376 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8b49c4ca-9e55-46d6-9555-fa48d986d750 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1723 microversion: 2.20 time: 0.735099 Aug 24 10:38:47.474486 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2283/4947] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:38:46 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1723 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:38:47.506722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-4dfda833-8104-48ee-a307-bdbe10401a6e req-b8988e20-5f7e-434e-ad3a-3d9f7c4b9a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c00e900-78b8-4a70-97b3-d2fa3c9e05d2", "name": "network-vif-plugged", "status": "completed", "tag": "aca9920f-883b-4aa8-84c3-1a2bfdb4eb7f"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:38:47.563019 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4dfda833-8104-48ee-a307-bdbe10401a6e req-b8988e20-5f7e-434e-ad3a-3d9f7c4b9a6b service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:47.563575 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4dfda833-8104-48ee-a307-bdbe10401a6e req-b8988e20-5f7e-434e-ad3a-3d9f7c4b9a6b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:47.564030 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4dfda833-8104-48ee-a307-bdbe10401a6e req-b8988e20-5f7e-434e-ad3a-3d9f7c4b9a6b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:48.218406 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-4dfda833-8104-48ee-a307-bdbe10401a6e req-b8988e20-5f7e-434e-ad3a-3d9f7c4b9a6b service nova] Creating event network-vif-plugged:aca9920f-883b-4aa8-84c3-1a2bfdb4eb7f for instance 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 on n-h2-849328-3 Aug 24 10:38:48.231661 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-4dfda833-8104-48ee-a307-bdbe10401a6e req-b8988e20-5f7e-434e-ad3a-3d9f7c4b9a6b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.746310 Aug 24 10:38:48.233808 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2284/4948] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:38:48.246413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ab7997fa-232f-4aad-9695-42fbeacdda65 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:48.247931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ab7997fa-232f-4aad-9695-42fbeacdda65 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:48.267074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab7997fa-232f-4aad-9695-42fbeacdda65 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:48.268512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab7997fa-232f-4aad-9695-42fbeacdda65 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:48.269708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab7997fa-232f-4aad-9695-42fbeacdda65 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:48.272923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab7997fa-232f-4aad-9695-42fbeacdda65 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:48.273834 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab7997fa-232f-4aad-9695-42fbeacdda65 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:48.274682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab7997fa-232f-4aad-9695-42fbeacdda65 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:49.054994 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ab7997fa-232f-4aad-9695-42fbeacdda65 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:49.068553 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ab7997fa-232f-4aad-9695-42fbeacdda65 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2" status: 200 len: 1309 microversion: 2.1 time: 0.832785 Aug 24 10:38:49.072728 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2285/4949] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:48 2022] GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 => generated 1309 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:49.101923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ccb43ff6-5dfa-476e-9628-8d13a1e69e88 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:49.102594 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ccb43ff6-5dfa-476e-9628-8d13a1e69e88 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:49.134745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccb43ff6-5dfa-476e-9628-8d13a1e69e88 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:49.135921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccb43ff6-5dfa-476e-9628-8d13a1e69e88 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:49.136383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccb43ff6-5dfa-476e-9628-8d13a1e69e88 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:49.141490 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccb43ff6-5dfa-476e-9628-8d13a1e69e88 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:49.143578 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccb43ff6-5dfa-476e-9628-8d13a1e69e88 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:49.144675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccb43ff6-5dfa-476e-9628-8d13a1e69e88 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:49.248969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-f072f8e1-4c89-49a2-a089-62ba117771eb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:38:49.251374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-f072f8e1-4c89-49a2-a089-62ba117771eb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:38:49.252616 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-f072f8e1-4c89-49a2-a089-62ba117771eb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:38:49.253307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-f072f8e1-4c89-49a2-a089-62ba117771eb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:38:49.253963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-f072f8e1-4c89-49a2-a089-62ba117771eb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:38:49.273843 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f072f8e1-4c89-49a2-a089-62ba117771eb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:49.275545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f072f8e1-4c89-49a2-a089-62ba117771eb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:49.276510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f072f8e1-4c89-49a2-a089-62ba117771eb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:49.278466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f072f8e1-4c89-49a2-a089-62ba117771eb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:49.279460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f072f8e1-4c89-49a2-a089-62ba117771eb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:49.280409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f072f8e1-4c89-49a2-a089-62ba117771eb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:49.310118 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f072f8e1-4c89-49a2-a089-62ba117771eb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Getting quotas for project 3d511560c1f543169e7eab8c70c9abcd. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:38:49.316815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f072f8e1-4c89-49a2-a089-62ba117771eb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Getting quotas for user 03ef6a33c1f0467993486547b7d00fda and project 3d511560c1f543169e7eab8c70c9abcd. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:38:49.334914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f072f8e1-4c89-49a2-a089-62ba117771eb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:38:49.338365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f072f8e1-4c89-49a2-a089-62ba117771eb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 29b3cde5-4716-49f6-b3d3-11d12a290375] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:38:49.438323 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f072f8e1-4c89-49a2-a089-62ba117771eb tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.313386 Aug 24 10:38:49.440901 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2665/4950] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:38:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:38:49.466780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c74f317a-cd90-4a65-a9e3-f64644867925 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:49.470260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c74f317a-cd90-4a65-a9e3-f64644867925 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 29b3cde5-4716-49f6-b3d3-11d12a290375] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:49.657425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c74f317a-cd90-4a65-a9e3-f64644867925 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:49.675307 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ccb43ff6-5dfa-476e-9628-8d13a1e69e88 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:49.682794 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c74f317a-cd90-4a65-a9e3-f64644867925 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375" status: 200 len: 1215 microversion: 2.1 time: 0.232261 Aug 24 10:38:49.685848 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2666/4951] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:49 2022] GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375 => generated 1215 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:49.688645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ccb43ff6-5dfa-476e-9628-8d13a1e69e88 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:49.692529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ccb43ff6-5dfa-476e-9628-8d13a1e69e88 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:49.696051 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ccb43ff6-5dfa-476e-9628-8d13a1e69e88 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1723 microversion: 2.20 time: 0.620237 Aug 24 10:38:49.697213 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2286/4952] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:38:49 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1723 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:38:50.092978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-942864ae-80dc-4a5e-a0d1-f9d94c380ac4 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:50.093844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-942864ae-80dc-4a5e-a0d1-f9d94c380ac4 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:50.106843 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-942864ae-80dc-4a5e-a0d1-f9d94c380ac4 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:50.107340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-942864ae-80dc-4a5e-a0d1-f9d94c380ac4 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:50.107789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-942864ae-80dc-4a5e-a0d1-f9d94c380ac4 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:50.108869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-942864ae-80dc-4a5e-a0d1-f9d94c380ac4 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:50.122713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-942864ae-80dc-4a5e-a0d1-f9d94c380ac4 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:50.123798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-942864ae-80dc-4a5e-a0d1-f9d94c380ac4 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:50.448427 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-942864ae-80dc-4a5e-a0d1-f9d94c380ac4 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:50.458899 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-942864ae-80dc-4a5e-a0d1-f9d94c380ac4 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2" status: 200 len: 1309 microversion: 2.1 time: 0.370908 Aug 24 10:38:50.473326 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2667/4953] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:50 2022] GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 => generated 1309 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:50.713288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-22e3ed89-7512-4b84-a430-d9db782facee tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:50.715734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-22e3ed89-7512-4b84-a430-d9db782facee tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 29b3cde5-4716-49f6-b3d3-11d12a290375] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:50.720796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-877bf19b-180c-4e6f-81cb-85ad3be5fcfe tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:50.722549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-877bf19b-180c-4e6f-81cb-85ad3be5fcfe tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:50.743887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:50.745475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22e3ed89-7512-4b84-a430-d9db782facee tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:50.745913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22e3ed89-7512-4b84-a430-d9db782facee tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:50.746491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-877bf19b-180c-4e6f-81cb-85ad3be5fcfe tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:50.747273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-877bf19b-180c-4e6f-81cb-85ad3be5fcfe tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:50.747716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-877bf19b-180c-4e6f-81cb-85ad3be5fcfe tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:50.748489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-877bf19b-180c-4e6f-81cb-85ad3be5fcfe tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:50.749000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-877bf19b-180c-4e6f-81cb-85ad3be5fcfe tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:50.749452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-877bf19b-180c-4e6f-81cb-85ad3be5fcfe tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:50.751116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22e3ed89-7512-4b84-a430-d9db782facee tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:50.753078 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22e3ed89-7512-4b84-a430-d9db782facee tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:50.760617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22e3ed89-7512-4b84-a430-d9db782facee tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:50.761382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22e3ed89-7512-4b84-a430-d9db782facee tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:51.088978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-877bf19b-180c-4e6f-81cb-85ad3be5fcfe tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:51.110943 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-22e3ed89-7512-4b84-a430-d9db782facee tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:51.123742 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-22e3ed89-7512-4b84-a430-d9db782facee tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375" status: 200 len: 1219 microversion: 2.1 time: 0.416425 Aug 24 10:38:51.124945 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2287/4954] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:50 2022] GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375 => generated 1219 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:51.126002 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-877bf19b-180c-4e6f-81cb-85ad3be5fcfe tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:51.128816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-877bf19b-180c-4e6f-81cb-85ad3be5fcfe tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:51.131087 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-877bf19b-180c-4e6f-81cb-85ad3be5fcfe tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1723 microversion: 2.20 time: 0.414276 Aug 24 10:38:51.132621 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2668/4955] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:38:50 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1723 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:38:51.480972 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e880853d-ecc8-4bb6-9160-0be8c96f9f0c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:51.481731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e880853d-ecc8-4bb6-9160-0be8c96f9f0c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:51.499535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e880853d-ecc8-4bb6-9160-0be8c96f9f0c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:51.515119 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e880853d-ecc8-4bb6-9160-0be8c96f9f0c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:51.515119 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e880853d-ecc8-4bb6-9160-0be8c96f9f0c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:51.519336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e880853d-ecc8-4bb6-9160-0be8c96f9f0c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:51.519913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e880853d-ecc8-4bb6-9160-0be8c96f9f0c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:51.520440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e880853d-ecc8-4bb6-9160-0be8c96f9f0c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:51.945067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e880853d-ecc8-4bb6-9160-0be8c96f9f0c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:51.958107 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e880853d-ecc8-4bb6-9160-0be8c96f9f0c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2" status: 200 len: 1490 microversion: 2.1 time: 0.481840 Aug 24 10:38:51.958733 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2288/4956] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:51 2022] GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 => generated 1490 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:51.981450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aabf8a15-2977-4c7a-8792-844ebed4f2c2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:51.982254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aabf8a15-2977-4c7a-8792-844ebed4f2c2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: a8d638df-397c-4b18-9b86-1ef6ce736fcb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:51.995651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aabf8a15-2977-4c7a-8792-844ebed4f2c2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:51.999162 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aabf8a15-2977-4c7a-8792-844ebed4f2c2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:52.000947 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aabf8a15-2977-4c7a-8792-844ebed4f2c2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:52.002788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aabf8a15-2977-4c7a-8792-844ebed4f2c2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:52.004225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aabf8a15-2977-4c7a-8792-844ebed4f2c2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:52.005469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aabf8a15-2977-4c7a-8792-844ebed4f2c2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:52.146498 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3b474aef-bff4-4340-b6d8-149bd3583c6b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:52.147431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3b474aef-bff4-4340-b6d8-149bd3583c6b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 29b3cde5-4716-49f6-b3d3-11d12a290375] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:52.170067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b474aef-bff4-4340-b6d8-149bd3583c6b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:52.173147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b474aef-bff4-4340-b6d8-149bd3583c6b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:52.177396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b474aef-bff4-4340-b6d8-149bd3583c6b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:52.179941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b474aef-bff4-4340-b6d8-149bd3583c6b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:52.180927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b474aef-bff4-4340-b6d8-149bd3583c6b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:52.182120 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b474aef-bff4-4340-b6d8-149bd3583c6b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:52.462350 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aabf8a15-2977-4c7a-8792-844ebed4f2c2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:52.484520 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aabf8a15-2977-4c7a-8792-844ebed4f2c2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb" status: 200 len: 1490 microversion: 2.1 time: 0.506175 Aug 24 10:38:52.486687 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2669/4957] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:51 2022] GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb => generated 1490 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:52.528955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0c42ea6b-89ca-4b68-a10b-716714e35be6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:52.530139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0c42ea6b-89ca-4b68-a10b-716714e35be6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:52.552212 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c42ea6b-89ca-4b68-a10b-716714e35be6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:52.554453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c42ea6b-89ca-4b68-a10b-716714e35be6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:52.555558 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c42ea6b-89ca-4b68-a10b-716714e35be6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:52.557401 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c42ea6b-89ca-4b68-a10b-716714e35be6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:52.559688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c42ea6b-89ca-4b68-a10b-716714e35be6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:52.561391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c42ea6b-89ca-4b68-a10b-716714e35be6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:52.715355 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3b474aef-bff4-4340-b6d8-149bd3583c6b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:52.725980 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3b474aef-bff4-4340-b6d8-149bd3583c6b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375" status: 200 len: 1273 microversion: 2.1 time: 0.583664 Aug 24 10:38:52.750035 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2289/4958] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:52 2022] GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375 => generated 1273 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:52.755089 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-31e04060-0ed7-4dff-b2b0-0e60907728a8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:52.757680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-31e04060-0ed7-4dff-b2b0-0e60907728a8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:52.774034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31e04060-0ed7-4dff-b2b0-0e60907728a8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:52.774917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31e04060-0ed7-4dff-b2b0-0e60907728a8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:52.778999 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31e04060-0ed7-4dff-b2b0-0e60907728a8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:52.781938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31e04060-0ed7-4dff-b2b0-0e60907728a8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:52.783459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31e04060-0ed7-4dff-b2b0-0e60907728a8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:52.785610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31e04060-0ed7-4dff-b2b0-0e60907728a8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:52.854815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0c42ea6b-89ca-4b68-a10b-716714e35be6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:52.870620 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0c42ea6b-89ca-4b68-a10b-716714e35be6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:52.873908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0c42ea6b-89ca-4b68-a10b-716714e35be6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:52.880374 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0c42ea6b-89ca-4b68-a10b-716714e35be6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1723 microversion: 2.20 time: 0.377110 Aug 24 10:38:52.881456 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2670/4959] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:38:52 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1723 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:38:53.133244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-31e04060-0ed7-4dff-b2b0-0e60907728a8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:53.154253 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-31e04060-0ed7-4dff-b2b0-0e60907728a8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2" status: 200 len: 1490 microversion: 2.1 time: 0.401775 Aug 24 10:38:53.159234 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2290/4960] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:52 2022] GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 => generated 1490 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:53.180245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1262ded2-24c5-4ac2-abe9-647c160b4c76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:53.181304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1262ded2-24c5-4ac2-abe9-647c160b4c76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:53.192346 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:53.198892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1262ded2-24c5-4ac2-abe9-647c160b4c76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:53.202158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1262ded2-24c5-4ac2-abe9-647c160b4c76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:53.202867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1262ded2-24c5-4ac2-abe9-647c160b4c76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:53.205009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1262ded2-24c5-4ac2-abe9-647c160b4c76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:53.212817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1262ded2-24c5-4ac2-abe9-647c160b4c76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:53.213650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1262ded2-24c5-4ac2-abe9-647c160b4c76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:53.262189 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:53.312633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1262ded2-24c5-4ac2-abe9-647c160b4c76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:38:53.769895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-38bc0a0f-2aad-4b7b-99f4-de1f3961e893 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:53.770862 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-38bc0a0f-2aad-4b7b-99f4-de1f3961e893 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 29b3cde5-4716-49f6-b3d3-11d12a290375] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:53.824486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38bc0a0f-2aad-4b7b-99f4-de1f3961e893 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:53.825864 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38bc0a0f-2aad-4b7b-99f4-de1f3961e893 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:53.826968 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38bc0a0f-2aad-4b7b-99f4-de1f3961e893 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:53.829046 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38bc0a0f-2aad-4b7b-99f4-de1f3961e893 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:53.837440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38bc0a0f-2aad-4b7b-99f4-de1f3961e893 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:53.838644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38bc0a0f-2aad-4b7b-99f4-de1f3961e893 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:53.940604 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1262ded2-24c5-4ac2-abe9-647c160b4c76 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "DELETE /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2" status: 204 len: 0 microversion: 2.1 time: 0.765341 Aug 24 10:38:53.945213 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2671/4961] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:38:53 2022] DELETE /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:38:53.960777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2f33669c-81e0-4c35-9a1a-ff0680593f1a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:53.962580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2f33669c-81e0-4c35-9a1a-ff0680593f1a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:53.982563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f33669c-81e0-4c35-9a1a-ff0680593f1a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:53.984654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f33669c-81e0-4c35-9a1a-ff0680593f1a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:53.985397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f33669c-81e0-4c35-9a1a-ff0680593f1a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:53.989310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f33669c-81e0-4c35-9a1a-ff0680593f1a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:53.989951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f33669c-81e0-4c35-9a1a-ff0680593f1a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:53.990407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f33669c-81e0-4c35-9a1a-ff0680593f1a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:54.649428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2f33669c-81e0-4c35-9a1a-ff0680593f1a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:54.669494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2f33669c-81e0-4c35-9a1a-ff0680593f1a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:54.687952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2f33669c-81e0-4c35-9a1a-ff0680593f1a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:54.690042 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2f33669c-81e0-4c35-9a1a-ff0680593f1a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1723 microversion: 2.20 time: 0.746267 Aug 24 10:38:54.698572 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2672/4962] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:38:53 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1723 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:38:54.735199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-098ff9a7-8491-4e30-9cb5-8e4700be8d0d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:54.735199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-098ff9a7-8491-4e30-9cb5-8e4700be8d0d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:54.770101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-098ff9a7-8491-4e30-9cb5-8e4700be8d0d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:54.770101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-098ff9a7-8491-4e30-9cb5-8e4700be8d0d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:54.770101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-098ff9a7-8491-4e30-9cb5-8e4700be8d0d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:54.782195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-098ff9a7-8491-4e30-9cb5-8e4700be8d0d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:54.786674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-098ff9a7-8491-4e30-9cb5-8e4700be8d0d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:54.794064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-098ff9a7-8491-4e30-9cb5-8e4700be8d0d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:56.080607 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-38bc0a0f-2aad-4b7b-99f4-de1f3961e893 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:56.101302 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-38bc0a0f-2aad-4b7b-99f4-de1f3961e893 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375" status: 200 len: 1315 microversion: 2.1 time: 2.347986 Aug 24 10:38:56.105519 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2291/4963] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:53 2022] GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375 => generated 1315 bytes in 2353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:56.118680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6a3273b0-5b31-4c47-963f-ee0281d94cb8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:56.121497 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6a3273b0-5b31-4c47-963f-ee0281d94cb8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:56.144005 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a3273b0-5b31-4c47-963f-ee0281d94cb8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:56.146930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a3273b0-5b31-4c47-963f-ee0281d94cb8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:56.147577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a3273b0-5b31-4c47-963f-ee0281d94cb8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:56.148967 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a3273b0-5b31-4c47-963f-ee0281d94cb8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:56.150741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a3273b0-5b31-4c47-963f-ee0281d94cb8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:56.153966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a3273b0-5b31-4c47-963f-ee0281d94cb8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:56.633721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-098ff9a7-8491-4e30-9cb5-8e4700be8d0d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:56.648968 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-098ff9a7-8491-4e30-9cb5-8e4700be8d0d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2" status: 200 len: 1496 microversion: 2.1 time: 1.948170 Aug 24 10:38:56.652586 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2673/4964] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:54 2022] GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 => generated 1496 bytes in 1953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:56.831189 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-58bdbdd4-36d4-4490-a151-d3197df011ba req-42d77a37-b72e-44a7-8b08-33a2987a5481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29b3cde5-4716-49f6-b3d3-11d12a290375", "tag": "cac1d72e-1940-403b-b4ae-cd571cbc2063"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:38:56.881326 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-58bdbdd4-36d4-4490-a151-d3197df011ba req-42d77a37-b72e-44a7-8b08-33a2987a5481 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:56.883021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-58bdbdd4-36d4-4490-a151-d3197df011ba req-42d77a37-b72e-44a7-8b08-33a2987a5481 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:56.885426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-58bdbdd4-36d4-4490-a151-d3197df011ba req-42d77a37-b72e-44a7-8b08-33a2987a5481 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:56.960614 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-58bdbdd4-36d4-4490-a151-d3197df011ba req-42d77a37-b72e-44a7-8b08-33a2987a5481 service nova] Creating event network-changed:cac1d72e-1940-403b-b4ae-cd571cbc2063 for instance 29b3cde5-4716-49f6-b3d3-11d12a290375 on n-h1-849328-3 Aug 24 10:38:56.983958 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-58bdbdd4-36d4-4490-a151-d3197df011ba req-42d77a37-b72e-44a7-8b08-33a2987a5481 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155014 Aug 24 10:38:56.983958 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2674/4965] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:38:57.099077 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6a3273b0-5b31-4c47-963f-ee0281d94cb8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:57.139075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4fcc802f-f3b8-4c6b-8b93-4f2e372ee168 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:57.140725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4fcc802f-f3b8-4c6b-8b93-4f2e372ee168 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 29b3cde5-4716-49f6-b3d3-11d12a290375] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:57.168265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6a3273b0-5b31-4c47-963f-ee0281d94cb8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:57.179613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6a3273b0-5b31-4c47-963f-ee0281d94cb8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:57.202555 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6a3273b0-5b31-4c47-963f-ee0281d94cb8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1744 microversion: 2.20 time: 1.089614 Aug 24 10:38:57.204058 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fcc802f-f3b8-4c6b-8b93-4f2e372ee168 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:57.208191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fcc802f-f3b8-4c6b-8b93-4f2e372ee168 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:57.208690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fcc802f-f3b8-4c6b-8b93-4f2e372ee168 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:57.209480 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fcc802f-f3b8-4c6b-8b93-4f2e372ee168 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:57.209948 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fcc802f-f3b8-4c6b-8b93-4f2e372ee168 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:57.210381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fcc802f-f3b8-4c6b-8b93-4f2e372ee168 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:57.212602 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2292/4966] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:38:56 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1744 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:38:57.673397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-80ee933a-864e-4e47-811a-d5b0b5a362d2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:57.674413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-80ee933a-864e-4e47-811a-d5b0b5a362d2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:57.689898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80ee933a-864e-4e47-811a-d5b0b5a362d2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:57.692376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80ee933a-864e-4e47-811a-d5b0b5a362d2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:57.693934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80ee933a-864e-4e47-811a-d5b0b5a362d2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:57.694891 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80ee933a-864e-4e47-811a-d5b0b5a362d2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:57.695681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80ee933a-864e-4e47-811a-d5b0b5a362d2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:57.696279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80ee933a-864e-4e47-811a-d5b0b5a362d2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:57.957406 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-80ee933a-864e-4e47-811a-d5b0b5a362d2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:57.976866 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-80ee933a-864e-4e47-811a-d5b0b5a362d2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2" status: 200 len: 1454 microversion: 2.1 time: 0.306345 Aug 24 10:38:57.981915 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2293/4967] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:57 2022] GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 => generated 1454 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:38:58.138842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-7df8292f-6e6d-4dc8-8196-034b617a7d85 req-2bf924e2-f729-4631-a1ce-9742759eb031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e", "name": "network-vif-plugged", "status": "completed", "tag": "04bfe8b2-85f8-48c0-83cc-8a238d22af80"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:38:58.180267 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7df8292f-6e6d-4dc8-8196-034b617a7d85 req-2bf924e2-f729-4631-a1ce-9742759eb031 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:58.180685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7df8292f-6e6d-4dc8-8196-034b617a7d85 req-2bf924e2-f729-4631-a1ce-9742759eb031 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:58.181148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7df8292f-6e6d-4dc8-8196-034b617a7d85 req-2bf924e2-f729-4631-a1ce-9742759eb031 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:58.284958 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7df8292f-6e6d-4dc8-8196-034b617a7d85 req-2bf924e2-f729-4631-a1ce-9742759eb031 service nova] Creating event network-vif-plugged:04bfe8b2-85f8-48c0-83cc-8a238d22af80 for instance 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e on n-h1-849328-3 Aug 24 10:38:58.306348 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-7df8292f-6e6d-4dc8-8196-034b617a7d85 req-2bf924e2-f729-4631-a1ce-9742759eb031 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187855 Aug 24 10:38:58.314965 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2294/4968] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:38:58.323818 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cbcec609-7e7a-4720-a795-2f62a0fd79fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:58.324301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cbcec609-7e7a-4720-a795-2f62a0fd79fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:58.381312 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4fcc802f-f3b8-4c6b-8b93-4f2e372ee168 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:58.391519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbcec609-7e7a-4720-a795-2f62a0fd79fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:58.392079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbcec609-7e7a-4720-a795-2f62a0fd79fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:58.392524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbcec609-7e7a-4720-a795-2f62a0fd79fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:58.393442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbcec609-7e7a-4720-a795-2f62a0fd79fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:58.393992 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbcec609-7e7a-4720-a795-2f62a0fd79fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:58.394393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbcec609-7e7a-4720-a795-2f62a0fd79fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:58.409614 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4fcc802f-f3b8-4c6b-8b93-4f2e372ee168 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375" status: 200 len: 1315 microversion: 2.1 time: 1.287230 Aug 24 10:38:58.413361 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2675/4969] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:57 2022] GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375 => generated 1315 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:38:58.720839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-d3a75b31-15c8-489f-9eb5-d23949c51010 req-1ac63cc3-24c9-4860-837c-798c2ad25c52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c00e900-78b8-4a70-97b3-d2fa3c9e05d2", "name": "network-vif-deleted", "tag": "aca9920f-883b-4aa8-84c3-1a2bfdb4eb7f"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:38:58.768126 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d3a75b31-15c8-489f-9eb5-d23949c51010 req-1ac63cc3-24c9-4860-837c-798c2ad25c52 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:58.771425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d3a75b31-15c8-489f-9eb5-d23949c51010 req-1ac63cc3-24c9-4860-837c-798c2ad25c52 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:58.772527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d3a75b31-15c8-489f-9eb5-d23949c51010 req-1ac63cc3-24c9-4860-837c-798c2ad25c52 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:58.816411 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-d3a75b31-15c8-489f-9eb5-d23949c51010 req-1ac63cc3-24c9-4860-837c-798c2ad25c52 service nova] Creating event network-vif-deleted:aca9920f-883b-4aa8-84c3-1a2bfdb4eb7f for instance 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 on n-h2-849328-3 Aug 24 10:38:58.850068 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-d3a75b31-15c8-489f-9eb5-d23949c51010 req-1ac63cc3-24c9-4860-837c-798c2ad25c52 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127558 Aug 24 10:38:58.856291 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2676/4970] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:38:59.000029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8056dc7c-07c3-43b8-b83e-077ba39ad9d5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:59.000852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8056dc7c-07c3-43b8-b83e-077ba39ad9d5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:59.019490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8056dc7c-07c3-43b8-b83e-077ba39ad9d5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:59.034054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8056dc7c-07c3-43b8-b83e-077ba39ad9d5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:59.046186 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8056dc7c-07c3-43b8-b83e-077ba39ad9d5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:59.052347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8056dc7c-07c3-43b8-b83e-077ba39ad9d5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:59.060416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8056dc7c-07c3-43b8-b83e-077ba39ad9d5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:59.064688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8056dc7c-07c3-43b8-b83e-077ba39ad9d5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:59.299525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:59.432087 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8056dc7c-07c3-43b8-b83e-077ba39ad9d5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:59.446802 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8056dc7c-07c3-43b8-b83e-077ba39ad9d5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2" status: 200 len: 1294 microversion: 2.1 time: 0.451460 Aug 24 10:38:59.460558 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cbcec609-7e7a-4720-a795-2f62a0fd79fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:59.461802 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2677/4971] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:58 2022] GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 => generated 1294 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:38:59.483994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0114a827-197c-4b84-a24b-bfdc5cce9476 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:38:59.493069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0114a827-197c-4b84-a24b-bfdc5cce9476 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 29b3cde5-4716-49f6-b3d3-11d12a290375] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:38:59.533280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0114a827-197c-4b84-a24b-bfdc5cce9476 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:59.534059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0114a827-197c-4b84-a24b-bfdc5cce9476 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:59.535855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cbcec609-7e7a-4720-a795-2f62a0fd79fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:59.536717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0114a827-197c-4b84-a24b-bfdc5cce9476 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:59.537699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cbcec609-7e7a-4720-a795-2f62a0fd79fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:38:59.538176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0114a827-197c-4b84-a24b-bfdc5cce9476 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:38:59.538947 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cbcec609-7e7a-4720-a795-2f62a0fd79fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1739 microversion: 2.20 time: 1.221026 Aug 24 10:38:59.552767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0114a827-197c-4b84-a24b-bfdc5cce9476 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:38:59.558015 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2295/4972] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:38:58 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1739 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:38:59.558243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0114a827-197c-4b84-a24b-bfdc5cce9476 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:38:59.678638 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:00.336559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0114a827-197c-4b84-a24b-bfdc5cce9476 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:00.351643 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0114a827-197c-4b84-a24b-bfdc5cce9476 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375" status: 200 len: 1315 microversion: 2.1 time: 0.888549 Aug 24 10:39:00.358813 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2678/4973] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:38:59 2022] GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375 => generated 1315 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:00.486453 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4e5bf817-d353-4b29-84dc-535a2ede0b45 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:00.487409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4e5bf817-d353-4b29-84dc-535a2ede0b45 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:00.531371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e5bf817-d353-4b29-84dc-535a2ede0b45 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:00.533751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e5bf817-d353-4b29-84dc-535a2ede0b45 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:00.542154 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e5bf817-d353-4b29-84dc-535a2ede0b45 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:00.547064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e5bf817-d353-4b29-84dc-535a2ede0b45 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:00.548946 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e5bf817-d353-4b29-84dc-535a2ede0b45 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:00.550098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e5bf817-d353-4b29-84dc-535a2ede0b45 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:00.567136 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb900864-1e7d-4a93-8dc8-cfea2a4ef94d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:00.567822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cb900864-1e7d-4a93-8dc8-cfea2a4ef94d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:00.584533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb900864-1e7d-4a93-8dc8-cfea2a4ef94d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:00.586961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb900864-1e7d-4a93-8dc8-cfea2a4ef94d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:00.589000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb900864-1e7d-4a93-8dc8-cfea2a4ef94d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:00.592097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb900864-1e7d-4a93-8dc8-cfea2a4ef94d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:00.594796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb900864-1e7d-4a93-8dc8-cfea2a4ef94d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:00.596801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb900864-1e7d-4a93-8dc8-cfea2a4ef94d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:00.623715 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-4e5bf817-d353-4b29-84dc-535a2ede0b45 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] HTTP exception thrown: Instance 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 could not be found. Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4e5bf817-d353-4b29-84dc-535a2ede0b45 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Request method failure captured: Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 HTTP/1.1 Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf8_-svoJ82Zcz3LMtRJH-LxEmi7YhL3SyNjhBkMMhmGqnW0J0hM18TP4MYYa3JryjRkfD6MJWxRrI1tc6yKAxu9hD6H4E3SSBMepuWzyz5efbHaNXS1nRaEb6aE-x3oa0iXQadiBh1CoF_uoY7wN-kywJAG1lWDamBR5UsabCRziuM Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestJSON-523633018 Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8b489eabb0014ddc9a2fcdf6e78ee740", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8b489eabb0014ddc9a2fcdf6e78ee740"}]}] Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestJSON-523633018 Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestJSON-523633018 Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersTestJSON-523633018-project Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 83a25a0677c04f8ba975528ece80d676 Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestJSON-523633018-project Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 could not be found. Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '0c00e900-78b8-4a70-97b3-d2fa3c9e05d2'} Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 could not be found. Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 could not be found. Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:39:00.628983 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:39:00.634223 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:39:00.634223 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:39:00.634223 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:39:00.634223 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:39:00.634223 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 could not be found. Aug 24 10:39:00.634223 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:39:00.645193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4e5bf817-d353-4b29-84dc-535a2ede0b45 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Returning 404 to user: Instance 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:39:00.655018 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4e5bf817-d353-4b29-84dc-535a2ede0b45 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2" status: 404 len: 111 microversion: 2.1 time: 0.174830 Aug 24 10:39:00.669460 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2296/4974] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:00 2022] GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:39:00.674887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fd384c87-dece-469e-be8b-de976c7699cf tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:00.677878 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fd384c87-dece-469e-be8b-de976c7699cf tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: a8d638df-397c-4b18-9b86-1ef6ce736fcb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:00.706782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd384c87-dece-469e-be8b-de976c7699cf tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:00.709898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd384c87-dece-469e-be8b-de976c7699cf tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:00.710654 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd384c87-dece-469e-be8b-de976c7699cf tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:00.712494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd384c87-dece-469e-be8b-de976c7699cf tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:00.715298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd384c87-dece-469e-be8b-de976c7699cf tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:00.716129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd384c87-dece-469e-be8b-de976c7699cf tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:00.812249 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fd384c87-dece-469e-be8b-de976c7699cf tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: a8d638df-397c-4b18-9b86-1ef6ce736fcb] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:39:00.947172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:01.118836 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fd384c87-dece-469e-be8b-de976c7699cf tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb" status: 204 len: 0 microversion: 2.1 time: 0.447580 Aug 24 10:39:01.150638 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2297/4975] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:39:00 2022] DELETE /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:39:01.172625 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-160a8471-f855-403f-aebb-4da87f429b15 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:01.173671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-160a8471-f855-403f-aebb-4da87f429b15 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: a8d638df-397c-4b18-9b86-1ef6ce736fcb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:01.193583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-160a8471-f855-403f-aebb-4da87f429b15 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:01.201113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-160a8471-f855-403f-aebb-4da87f429b15 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:01.201854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-160a8471-f855-403f-aebb-4da87f429b15 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:01.202852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-160a8471-f855-403f-aebb-4da87f429b15 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:01.212193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-160a8471-f855-403f-aebb-4da87f429b15 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:01.213077 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-160a8471-f855-403f-aebb-4da87f429b15 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:01.478459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cb900864-1e7d-4a93-8dc8-cfea2a4ef94d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:01.514389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cb900864-1e7d-4a93-8dc8-cfea2a4ef94d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:01.530804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cb900864-1e7d-4a93-8dc8-cfea2a4ef94d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:01.534281 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cb900864-1e7d-4a93-8dc8-cfea2a4ef94d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1739 microversion: 2.20 time: 0.972342 Aug 24 10:39:01.543135 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2679/4976] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:00 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1739 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:39:01.568004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-12d95aed-9602-44d2-8039-35bdcd6288bc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:01.568966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-12d95aed-9602-44d2-8039-35bdcd6288bc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 29b3cde5-4716-49f6-b3d3-11d12a290375] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:01.624111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12d95aed-9602-44d2-8039-35bdcd6288bc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:01.626351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12d95aed-9602-44d2-8039-35bdcd6288bc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:01.627888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12d95aed-9602-44d2-8039-35bdcd6288bc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:01.633874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12d95aed-9602-44d2-8039-35bdcd6288bc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:01.635062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12d95aed-9602-44d2-8039-35bdcd6288bc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:01.638028 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12d95aed-9602-44d2-8039-35bdcd6288bc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:02.094710 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-160a8471-f855-403f-aebb-4da87f429b15 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:02.114245 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-160a8471-f855-403f-aebb-4da87f429b15 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb" status: 200 len: 1496 microversion: 2.1 time: 0.961374 Aug 24 10:39:02.138365 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2298/4977] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:01 2022] GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb => generated 1496 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:02.568735 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1c7a8891-327f-44e8-96df-4a59e8ab0318 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:02.569396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1c7a8891-327f-44e8-96df-4a59e8ab0318 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:02.595717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c7a8891-327f-44e8-96df-4a59e8ab0318 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:02.596129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c7a8891-327f-44e8-96df-4a59e8ab0318 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:02.596585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c7a8891-327f-44e8-96df-4a59e8ab0318 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:02.614963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c7a8891-327f-44e8-96df-4a59e8ab0318 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:02.647412 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c7a8891-327f-44e8-96df-4a59e8ab0318 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:02.648458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c7a8891-327f-44e8-96df-4a59e8ab0318 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:02.692104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-12d95aed-9602-44d2-8039-35bdcd6288bc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:02.705466 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-12d95aed-9602-44d2-8039-35bdcd6288bc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375" status: 200 len: 1315 microversion: 2.1 time: 1.153434 Aug 24 10:39:02.709901 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2680/4978] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:01 2022] GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375 => generated 1315 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:03.069521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1c7a8891-327f-44e8-96df-4a59e8ab0318 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:03.082719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1c7a8891-327f-44e8-96df-4a59e8ab0318 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:03.086402 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1c7a8891-327f-44e8-96df-4a59e8ab0318 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:03.090016 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1c7a8891-327f-44e8-96df-4a59e8ab0318 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1739 microversion: 2.20 time: 0.526136 Aug 24 10:39:03.093583 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2299/4979] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:02 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1739 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:39:03.146048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5d1a58dc-a23e-4bf6-a73a-62787ddff03b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:03.146725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5d1a58dc-a23e-4bf6-a73a-62787ddff03b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: a8d638df-397c-4b18-9b86-1ef6ce736fcb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:03.153891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d1a58dc-a23e-4bf6-a73a-62787ddff03b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:03.159865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d1a58dc-a23e-4bf6-a73a-62787ddff03b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:03.162891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d1a58dc-a23e-4bf6-a73a-62787ddff03b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:03.164482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d1a58dc-a23e-4bf6-a73a-62787ddff03b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:03.167834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d1a58dc-a23e-4bf6-a73a-62787ddff03b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:03.170973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d1a58dc-a23e-4bf6-a73a-62787ddff03b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:03.732826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-123b06fa-2696-46c1-abf8-e03b34d8a706 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:03.734148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-123b06fa-2696-46c1-abf8-e03b34d8a706 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 29b3cde5-4716-49f6-b3d3-11d12a290375] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:03.744027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-123b06fa-2696-46c1-abf8-e03b34d8a706 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:03.752613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-123b06fa-2696-46c1-abf8-e03b34d8a706 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:03.754105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-123b06fa-2696-46c1-abf8-e03b34d8a706 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:03.755135 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-123b06fa-2696-46c1-abf8-e03b34d8a706 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:03.756619 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-123b06fa-2696-46c1-abf8-e03b34d8a706 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:03.758316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-123b06fa-2696-46c1-abf8-e03b34d8a706 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:04.158188 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-123b06fa-2696-46c1-abf8-e03b34d8a706 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:04.185910 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-123b06fa-2696-46c1-abf8-e03b34d8a706 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375" status: 200 len: 1315 microversion: 2.1 time: 0.457194 Aug 24 10:39:04.186497 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2300/4980] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:03 2022] GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375 => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:04.211267 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7e1dd838-b2d6-44a2-b487-0fb1213656b9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:04.213572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7e1dd838-b2d6-44a2-b487-0fb1213656b9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:04.222952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5d1a58dc-a23e-4bf6-a73a-62787ddff03b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:04.232256 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5d1a58dc-a23e-4bf6-a73a-62787ddff03b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb" status: 200 len: 1496 microversion: 2.1 time: 1.090374 Aug 24 10:39:04.239377 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2681/4981] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:03 2022] GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb => generated 1496 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:04.240086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e1dd838-b2d6-44a2-b487-0fb1213656b9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:04.240621 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e1dd838-b2d6-44a2-b487-0fb1213656b9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:04.241732 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e1dd838-b2d6-44a2-b487-0fb1213656b9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:04.242468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e1dd838-b2d6-44a2-b487-0fb1213656b9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:04.242927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e1dd838-b2d6-44a2-b487-0fb1213656b9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:04.246734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e1dd838-b2d6-44a2-b487-0fb1213656b9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:04.581597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7e1dd838-b2d6-44a2-b487-0fb1213656b9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:04.591480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7e1dd838-b2d6-44a2-b487-0fb1213656b9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:04.603938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7e1dd838-b2d6-44a2-b487-0fb1213656b9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:04.617646 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7e1dd838-b2d6-44a2-b487-0fb1213656b9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1739 microversion: 2.20 time: 0.420778 Aug 24 10:39:04.618602 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2301/4982] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:04 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1739 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:39:05.207538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-64a837e2-913f-4e4e-a8ac-ae7022994266 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:05.208574 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-64a837e2-913f-4e4e-a8ac-ae7022994266 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 29b3cde5-4716-49f6-b3d3-11d12a290375] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:05.223431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64a837e2-913f-4e4e-a8ac-ae7022994266 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:05.241493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64a837e2-913f-4e4e-a8ac-ae7022994266 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:05.245515 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64a837e2-913f-4e4e-a8ac-ae7022994266 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:05.250896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64a837e2-913f-4e4e-a8ac-ae7022994266 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:05.254984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64a837e2-913f-4e4e-a8ac-ae7022994266 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:05.266568 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64a837e2-913f-4e4e-a8ac-ae7022994266 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:05.272052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-42f1d074-04ee-455b-9dce-135c87d74374 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:05.272798 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-42f1d074-04ee-455b-9dce-135c87d74374 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: a8d638df-397c-4b18-9b86-1ef6ce736fcb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:05.293259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42f1d074-04ee-455b-9dce-135c87d74374 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:05.297397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42f1d074-04ee-455b-9dce-135c87d74374 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:05.298173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42f1d074-04ee-455b-9dce-135c87d74374 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:05.299184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42f1d074-04ee-455b-9dce-135c87d74374 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:05.300278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42f1d074-04ee-455b-9dce-135c87d74374 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:05.301075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42f1d074-04ee-455b-9dce-135c87d74374 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:05.529372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-42f1d074-04ee-455b-9dce-135c87d74374 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:05.537511 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-42f1d074-04ee-455b-9dce-135c87d74374 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb" status: 200 len: 1496 microversion: 2.1 time: 0.281234 Aug 24 10:39:05.552166 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2302/4983] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:05 2022] GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb => generated 1496 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:05.648978 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6bace51a-58cf-49c8-a0e4-5ec5f73f6087 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:05.649800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6bace51a-58cf-49c8-a0e4-5ec5f73f6087 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:05.669230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bace51a-58cf-49c8-a0e4-5ec5f73f6087 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:05.669743 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bace51a-58cf-49c8-a0e4-5ec5f73f6087 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:05.670714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bace51a-58cf-49c8-a0e4-5ec5f73f6087 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:05.670902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bace51a-58cf-49c8-a0e4-5ec5f73f6087 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:05.689805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bace51a-58cf-49c8-a0e4-5ec5f73f6087 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:05.692009 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bace51a-58cf-49c8-a0e4-5ec5f73f6087 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:06.079411 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6bace51a-58cf-49c8-a0e4-5ec5f73f6087 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:06.089282 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6bace51a-58cf-49c8-a0e4-5ec5f73f6087 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:06.098409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6bace51a-58cf-49c8-a0e4-5ec5f73f6087 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:06.101959 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6bace51a-58cf-49c8-a0e4-5ec5f73f6087 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1739 microversion: 2.20 time: 0.460857 Aug 24 10:39:06.106269 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2303/4984] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:05 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1739 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:39:06.304459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-64a837e2-913f-4e4e-a8ac-ae7022994266 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:06.313259 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-64a837e2-913f-4e4e-a8ac-ae7022994266 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375" status: 200 len: 1315 microversion: 2.1 time: 1.110337 Aug 24 10:39:06.318557 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2682/4985] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:05 2022] GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375 => generated 1315 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:06.514486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d1a0841c-6e62-4a9b-aebc-6bb38c62fc69 req-38080472-2e93-4d09-9ec4-aab9de211edd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29b3cde5-4716-49f6-b3d3-11d12a290375", "name": "network-vif-plugged", "status": "completed", "tag": "cac1d72e-1940-403b-b4ae-cd571cbc2063"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:39:06.540521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d1a0841c-6e62-4a9b-aebc-6bb38c62fc69 req-38080472-2e93-4d09-9ec4-aab9de211edd service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:06.541309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d1a0841c-6e62-4a9b-aebc-6bb38c62fc69 req-38080472-2e93-4d09-9ec4-aab9de211edd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:06.541935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d1a0841c-6e62-4a9b-aebc-6bb38c62fc69 req-38080472-2e93-4d09-9ec4-aab9de211edd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:06.558540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a037c908-4938-4a51-ae2a-6a807f592508 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:06.559517 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a037c908-4938-4a51-ae2a-6a807f592508 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: a8d638df-397c-4b18-9b86-1ef6ce736fcb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:06.573361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a037c908-4938-4a51-ae2a-6a807f592508 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:06.585916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a037c908-4938-4a51-ae2a-6a807f592508 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:06.586694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a037c908-4938-4a51-ae2a-6a807f592508 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:06.587741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a037c908-4938-4a51-ae2a-6a807f592508 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:06.588406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a037c908-4938-4a51-ae2a-6a807f592508 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:06.589034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a037c908-4938-4a51-ae2a-6a807f592508 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:06.594215 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d1a0841c-6e62-4a9b-aebc-6bb38c62fc69 req-38080472-2e93-4d09-9ec4-aab9de211edd service nova] Creating event network-vif-plugged:cac1d72e-1940-403b-b4ae-cd571cbc2063 for instance 29b3cde5-4716-49f6-b3d3-11d12a290375 on n-h1-849328-3 Aug 24 10:39:06.615472 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d1a0841c-6e62-4a9b-aebc-6bb38c62fc69 req-38080472-2e93-4d09-9ec4-aab9de211edd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104810 Aug 24 10:39:06.616590 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2304/4986] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:39:06.664162 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-189b1881-7fca-419e-b63d-346f0790dbc2 req-5b4e61f6-ae10-4906-896c-c62ed38908f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d638df-397c-4b18-9b86-1ef6ce736fcb", "name": "network-vif-deleted", "tag": "03feb44d-af0d-4031-bc39-b2b3f861be46"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:39:06.690358 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-189b1881-7fca-419e-b63d-346f0790dbc2 req-5b4e61f6-ae10-4906-896c-c62ed38908f1 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:06.691427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-189b1881-7fca-419e-b63d-346f0790dbc2 req-5b4e61f6-ae10-4906-896c-c62ed38908f1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:06.693884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-189b1881-7fca-419e-b63d-346f0790dbc2 req-5b4e61f6-ae10-4906-896c-c62ed38908f1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:06.731810 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-189b1881-7fca-419e-b63d-346f0790dbc2 req-5b4e61f6-ae10-4906-896c-c62ed38908f1 service nova] Creating event network-vif-deleted:03feb44d-af0d-4031-bc39-b2b3f861be46 for instance a8d638df-397c-4b18-9b86-1ef6ce736fcb on n-h2-849328-3 Aug 24 10:39:06.745179 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-189b1881-7fca-419e-b63d-346f0790dbc2 req-5b4e61f6-ae10-4906-896c-c62ed38908f1 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084772 Aug 24 10:39:06.752379 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2305/4987] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:39:07.128688 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b1439c78-4e8d-4805-8816-f362f26d349d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:07.129859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b1439c78-4e8d-4805-8816-f362f26d349d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:07.147056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1439c78-4e8d-4805-8816-f362f26d349d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:07.147561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1439c78-4e8d-4805-8816-f362f26d349d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:07.148004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1439c78-4e8d-4805-8816-f362f26d349d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:07.148722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1439c78-4e8d-4805-8816-f362f26d349d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:07.149204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1439c78-4e8d-4805-8816-f362f26d349d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:07.160243 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1439c78-4e8d-4805-8816-f362f26d349d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:07.335566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a037c908-4938-4a51-ae2a-6a807f592508 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:07.344790 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a037c908-4938-4a51-ae2a-6a807f592508 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb" status: 200 len: 1454 microversion: 2.1 time: 0.790653 Aug 24 10:39:07.358328 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2683/4988] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:06 2022] GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb => generated 1454 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:39:07.363415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9be1d348-8394-478e-bede-4d8cb5dc3cf4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:07.386083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9be1d348-8394-478e-bede-4d8cb5dc3cf4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 29b3cde5-4716-49f6-b3d3-11d12a290375] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:07.440935 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9be1d348-8394-478e-bede-4d8cb5dc3cf4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:07.447410 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9be1d348-8394-478e-bede-4d8cb5dc3cf4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:07.451232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9be1d348-8394-478e-bede-4d8cb5dc3cf4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:07.455162 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9be1d348-8394-478e-bede-4d8cb5dc3cf4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:07.459449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9be1d348-8394-478e-bede-4d8cb5dc3cf4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:07.483303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9be1d348-8394-478e-bede-4d8cb5dc3cf4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:07.787406 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b1439c78-4e8d-4805-8816-f362f26d349d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:07.807842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b1439c78-4e8d-4805-8816-f362f26d349d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:07.818464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b1439c78-4e8d-4805-8816-f362f26d349d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:07.819753 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b1439c78-4e8d-4805-8816-f362f26d349d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1739 microversion: 2.20 time: 0.695487 Aug 24 10:39:07.842379 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2306/4989] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:07 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1739 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:39:08.104417 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9be1d348-8394-478e-bede-4d8cb5dc3cf4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:08.112852 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9be1d348-8394-478e-bede-4d8cb5dc3cf4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375" status: 200 len: 1315 microversion: 2.1 time: 0.753217 Aug 24 10:39:08.132639 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2684/4990] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:07 2022] GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375 => generated 1315 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:08.388710 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6f99092b-a449-4c77-86af-c7ec3dbd542a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:08.390008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6f99092b-a449-4c77-86af-c7ec3dbd542a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: a8d638df-397c-4b18-9b86-1ef6ce736fcb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:08.419436 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f99092b-a449-4c77-86af-c7ec3dbd542a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:08.422393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f99092b-a449-4c77-86af-c7ec3dbd542a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:08.428794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f99092b-a449-4c77-86af-c7ec3dbd542a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:08.432525 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f99092b-a449-4c77-86af-c7ec3dbd542a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:08.436395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f99092b-a449-4c77-86af-c7ec3dbd542a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:08.441307 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f99092b-a449-4c77-86af-c7ec3dbd542a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:08.710129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f99092b-a449-4c77-86af-c7ec3dbd542a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:08.713526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f99092b-a449-4c77-86af-c7ec3dbd542a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:08.722191 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f99092b-a449-4c77-86af-c7ec3dbd542a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:08.730371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-6f99092b-a449-4c77-86af-c7ec3dbd542a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lazy-loading 'fault' on Instance uuid a8d638df-397c-4b18-9b86-1ef6ce736fcb {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:39:08.868689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fb85fa3a-50a9-4b54-9d5a-1222d4a2dd16 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:08.870599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fb85fa3a-50a9-4b54-9d5a-1222d4a2dd16 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:08.889525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb85fa3a-50a9-4b54-9d5a-1222d4a2dd16 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:08.893391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb85fa3a-50a9-4b54-9d5a-1222d4a2dd16 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:08.897432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb85fa3a-50a9-4b54-9d5a-1222d4a2dd16 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:08.898540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb85fa3a-50a9-4b54-9d5a-1222d4a2dd16 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:08.901890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb85fa3a-50a9-4b54-9d5a-1222d4a2dd16 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:08.905323 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb85fa3a-50a9-4b54-9d5a-1222d4a2dd16 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:08.943750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6f99092b-a449-4c77-86af-c7ec3dbd542a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:08.972210 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6f99092b-a449-4c77-86af-c7ec3dbd542a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb" status: 200 len: 1299 microversion: 2.1 time: 0.592770 Aug 24 10:39:08.986934 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2307/4991] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:08 2022] GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb => generated 1299 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:09.158320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1d0fde5a-9a5b-4305-9462-e2fd7a29f37f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:09.159655 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1d0fde5a-9a5b-4305-9462-e2fd7a29f37f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 29b3cde5-4716-49f6-b3d3-11d12a290375] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:09.188556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d0fde5a-9a5b-4305-9462-e2fd7a29f37f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:09.189760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d0fde5a-9a5b-4305-9462-e2fd7a29f37f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:09.196511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d0fde5a-9a5b-4305-9462-e2fd7a29f37f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:09.198175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d0fde5a-9a5b-4305-9462-e2fd7a29f37f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:09.205010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d0fde5a-9a5b-4305-9462-e2fd7a29f37f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:09.210802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d0fde5a-9a5b-4305-9462-e2fd7a29f37f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:09.755433 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1d0fde5a-9a5b-4305-9462-e2fd7a29f37f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:09.769585 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1d0fde5a-9a5b-4305-9462-e2fd7a29f37f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375" status: 200 len: 1501 microversion: 2.1 time: 0.629207 Aug 24 10:39:09.777587 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2308/4992] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:09 2022] GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375 => generated 1501 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:09.812913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3953c439-d4c1-4eef-aadc-fd338326bace tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:39:09.813941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3953c439-d4c1-4eef-aadc-fd338326bace tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 29b3cde5-4716-49f6-b3d3-11d12a290375] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:09.827498 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3953c439-d4c1-4eef-aadc-fd338326bace tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:09.828342 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3953c439-d4c1-4eef-aadc-fd338326bace tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:09.829975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3953c439-d4c1-4eef-aadc-fd338326bace tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:09.832846 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3953c439-d4c1-4eef-aadc-fd338326bace tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:09.833604 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3953c439-d4c1-4eef-aadc-fd338326bace tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:09.834284 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3953c439-d4c1-4eef-aadc-fd338326bace tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:10.048352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fb85fa3a-50a9-4b54-9d5a-1222d4a2dd16 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:10.069617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fb85fa3a-50a9-4b54-9d5a-1222d4a2dd16 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:10.071079 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fb85fa3a-50a9-4b54-9d5a-1222d4a2dd16 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:10.072374 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fb85fa3a-50a9-4b54-9d5a-1222d4a2dd16 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1739 microversion: 2.20 time: 1.208738 Aug 24 10:39:10.072964 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2685/4993] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:08 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1739 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:39:10.109952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-88467857-8479-4570-9d28-55ae413a0da3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:10.110586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-88467857-8479-4570-9d28-55ae413a0da3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: a8d638df-397c-4b18-9b86-1ef6ce736fcb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:10.118482 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.network.security_group_api [None req-3953c439-d4c1-4eef-aadc-fd338326bace tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Removing security group 13b5a3a1-374e-4d16-b5f1-0a95188db83b from port cac1d72e-1940-403b-b4ae-cd571cbc2063 Aug 24 10:39:10.141727 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88467857-8479-4570-9d28-55ae413a0da3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:10.142487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88467857-8479-4570-9d28-55ae413a0da3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:10.143133 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88467857-8479-4570-9d28-55ae413a0da3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:10.144055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88467857-8479-4570-9d28-55ae413a0da3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:10.144680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88467857-8479-4570-9d28-55ae413a0da3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:10.145538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88467857-8479-4570-9d28-55ae413a0da3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:10.182715 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-88467857-8479-4570-9d28-55ae413a0da3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] HTTP exception thrown: Instance a8d638df-397c-4b18-9b86-1ef6ce736fcb could not be found. Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-88467857-8479-4570-9d28-55ae413a0da3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Request method failure captured: Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb HTTP/1.1 Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf8_-svoJ82Zcz3LMtRJH-LxEmi7YhL3SyNjhBkMMhmGqnW0J0hM18TP4MYYa3JryjRkfD6MJWxRrI1tc6yKAxu9hD6H4E3SSBMepuWzyz5efbHaNXS1nRaEb6aE-x3oa0iXQadiBh1CoF_uoY7wN-kywJAG1lWDamBR5UsabCRziuM Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersTestJSON-523633018 Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8b489eabb0014ddc9a2fcdf6e78ee740", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8b489eabb0014ddc9a2fcdf6e78ee740"}]}] Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersTestJSON-523633018 Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersTestJSON-523633018 Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersTestJSON-523633018-project Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 83a25a0677c04f8ba975528ece80d676 Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersTestJSON-523633018-project Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance a8d638df-397c-4b18-9b86-1ef6ce736fcb could not be found. Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'a8d638df-397c-4b18-9b86-1ef6ce736fcb'} Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8d638df-397c-4b18-9b86-1ef6ce736fcb could not be found. Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8d638df-397c-4b18-9b86-1ef6ce736fcb could not be found. Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:39:10.187063 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:39:10.193939 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:39:10.193939 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:39:10.193939 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:39:10.193939 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:39:10.193939 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8d638df-397c-4b18-9b86-1ef6ce736fcb could not be found. Aug 24 10:39:10.193939 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:39:10.204347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-88467857-8479-4570-9d28-55ae413a0da3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Returning 404 to user: Instance a8d638df-397c-4b18-9b86-1ef6ce736fcb could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:39:10.206569 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-88467857-8479-4570-9d28-55ae413a0da3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb" status: 404 len: 111 microversion: 2.1 time: 0.109368 Aug 24 10:39:10.207876 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2686/4994] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:10 2022] GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:39:10.529944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f570aa1-9343-4f4b-af61-812c8ebefba0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1342006928", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "444806fc-9684-467f-82d3-8ae5206eec37"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:39:10.726696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-0f570aa1-9343-4f4b-af61-812c8ebefba0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] validate_networks() for [('444806fc-9684-467f-82d3-8ae5206eec37', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:39:11.132901 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3953c439-d4c1-4eef-aadc-fd338326bace tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375/action" status: 202 len: 0 microversion: 2.1 time: 1.341084 Aug 24 10:39:11.134642 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2309/4995] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:39:09 2022] POST /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375/action => generated 0 bytes in 1346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:39:11.140292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cc88cfbc-e85b-4813-ac08-7646c792e78f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:11.141239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cc88cfbc-e85b-4813-ac08-7646c792e78f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:11.158895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc88cfbc-e85b-4813-ac08-7646c792e78f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:11.161814 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc88cfbc-e85b-4813-ac08-7646c792e78f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:11.162535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc88cfbc-e85b-4813-ac08-7646c792e78f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:11.165259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc88cfbc-e85b-4813-ac08-7646c792e78f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:11.167889 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc88cfbc-e85b-4813-ac08-7646c792e78f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:11.168608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc88cfbc-e85b-4813-ac08-7646c792e78f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:11.719603 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cc88cfbc-e85b-4813-ac08-7646c792e78f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:11.732869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cc88cfbc-e85b-4813-ac08-7646c792e78f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:11.738784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cc88cfbc-e85b-4813-ac08-7646c792e78f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:11.746520 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cc88cfbc-e85b-4813-ac08-7646c792e78f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1739 microversion: 2.20 time: 0.610363 Aug 24 10:39:11.763963 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2310/4996] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:11 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1739 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:39:11.763963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0755e792-94f3-4e1c-b1f4-2b7bf29213c4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:11.763963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0755e792-94f3-4e1c-b1f4-2b7bf29213c4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 29b3cde5-4716-49f6-b3d3-11d12a290375] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:11.763963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0755e792-94f3-4e1c-b1f4-2b7bf29213c4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:11.763963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0755e792-94f3-4e1c-b1f4-2b7bf29213c4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:11.763963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0755e792-94f3-4e1c-b1f4-2b7bf29213c4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:11.764734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0755e792-94f3-4e1c-b1f4-2b7bf29213c4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:11.767683 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0755e792-94f3-4e1c-b1f4-2b7bf29213c4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:11.769692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0755e792-94f3-4e1c-b1f4-2b7bf29213c4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:12.065422 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0755e792-94f3-4e1c-b1f4-2b7bf29213c4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:12.076531 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0755e792-94f3-4e1c-b1f4-2b7bf29213c4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375" status: 200 len: 1459 microversion: 2.1 time: 0.327153 Aug 24 10:39:12.096573 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2311/4997] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:11 2022] GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375 => generated 1459 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:12.105588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d0ca23f2-e220-4ed6-9c86-752469a0bee0 req-0842e2cd-39de-4d1e-85da-a49f82b56817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29b3cde5-4716-49f6-b3d3-11d12a290375", "tag": "cac1d72e-1940-403b-b4ae-cd571cbc2063"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:39:12.137506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d0ca23f2-e220-4ed6-9c86-752469a0bee0 req-0842e2cd-39de-4d1e-85da-a49f82b56817 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:12.138188 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d0ca23f2-e220-4ed6-9c86-752469a0bee0 req-0842e2cd-39de-4d1e-85da-a49f82b56817 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:12.143443 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d0ca23f2-e220-4ed6-9c86-752469a0bee0 req-0842e2cd-39de-4d1e-85da-a49f82b56817 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:12.228230 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d0ca23f2-e220-4ed6-9c86-752469a0bee0 req-0842e2cd-39de-4d1e-85da-a49f82b56817 service nova] Creating event network-changed:cac1d72e-1940-403b-b4ae-cd571cbc2063 for instance 29b3cde5-4716-49f6-b3d3-11d12a290375 on n-h1-849328-3 Aug 24 10:39:12.253709 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d0ca23f2-e220-4ed6-9c86-752469a0bee0 req-0842e2cd-39de-4d1e-85da-a49f82b56817 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155206 Aug 24 10:39:12.263722 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2312/4998] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:39:12.280229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f4490d75-f32a-48c3-a22a-e7d29d71784f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:12.296789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f4490d75-f32a-48c3-a22a-e7d29d71784f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:12.324758 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4490d75-f32a-48c3-a22a-e7d29d71784f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:12.327559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4490d75-f32a-48c3-a22a-e7d29d71784f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:12.329684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4490d75-f32a-48c3-a22a-e7d29d71784f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:12.334466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4490d75-f32a-48c3-a22a-e7d29d71784f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:12.342170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4490d75-f32a-48c3-a22a-e7d29d71784f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:12.343096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4490d75-f32a-48c3-a22a-e7d29d71784f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:12.982706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f4490d75-f32a-48c3-a22a-e7d29d71784f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:12.998987 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f4490d75-f32a-48c3-a22a-e7d29d71784f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.728597 Aug 24 10:39:13.000051 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2313/4999] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:12 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:13.008284 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f40d7c9e-4388-4914-829c-6f840bbe3666 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:13.014192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f40d7c9e-4388-4914-829c-6f840bbe3666 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:13.037525 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f40d7c9e-4388-4914-829c-6f840bbe3666 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:13.038513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f40d7c9e-4388-4914-829c-6f840bbe3666 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:13.039898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f40d7c9e-4388-4914-829c-6f840bbe3666 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:13.041397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f40d7c9e-4388-4914-829c-6f840bbe3666 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:13.043083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f40d7c9e-4388-4914-829c-6f840bbe3666 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:13.045725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f40d7c9e-4388-4914-829c-6f840bbe3666 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:13.319298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0f570aa1-9343-4f4b-af61-812c8ebefba0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:39:13.320310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0f570aa1-9343-4f4b-af61-812c8ebefba0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:39:13.320958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0f570aa1-9343-4f4b-af61-812c8ebefba0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:39:13.321583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0f570aa1-9343-4f4b-af61-812c8ebefba0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:39:13.322184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0f570aa1-9343-4f4b-af61-812c8ebefba0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:39:13.360486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f570aa1-9343-4f4b-af61-812c8ebefba0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:13.364036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f570aa1-9343-4f4b-af61-812c8ebefba0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:13.364581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f570aa1-9343-4f4b-af61-812c8ebefba0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:13.365449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f570aa1-9343-4f4b-af61-812c8ebefba0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:13.369228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f570aa1-9343-4f4b-af61-812c8ebefba0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:13.369812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f570aa1-9343-4f4b-af61-812c8ebefba0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:13.418180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-0f570aa1-9343-4f4b-af61-812c8ebefba0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Getting quotas for project 8b489eabb0014ddc9a2fcdf6e78ee740. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:39:13.445035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-0f570aa1-9343-4f4b-af61-812c8ebefba0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Getting quotas for user 83a25a0677c04f8ba975528ece80d676 and project 8b489eabb0014ddc9a2fcdf6e78ee740. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:39:13.488036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0f570aa1-9343-4f4b-af61-812c8ebefba0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:39:13.491562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0f570aa1-9343-4f4b-af61-812c8ebefba0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:39:13.564874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f40d7c9e-4388-4914-829c-6f840bbe3666 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:13.576316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f40d7c9e-4388-4914-829c-6f840bbe3666 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:13.577869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f40d7c9e-4388-4914-829c-6f840bbe3666 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:13.596398 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f40d7c9e-4388-4914-829c-6f840bbe3666 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1739 microversion: 2.20 time: 0.594935 Aug 24 10:39:13.598784 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2314/5000] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:13 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1739 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:39:13.610470 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0f570aa1-9343-4f4b-af61-812c8ebefba0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.074242 Aug 24 10:39:13.614730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ef623481-71af-4133-b805-4bc5d8af2c83 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:13.619762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ef623481-71af-4133-b805-4bc5d8af2c83 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:13.620223 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2687/5001] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:39:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:39:13.627413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b0b90c98-3b15-412f-982e-76f39b734986 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:13.631502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b0b90c98-3b15-412f-982e-76f39b734986 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:13.659950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef623481-71af-4133-b805-4bc5d8af2c83 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:13.660478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef623481-71af-4133-b805-4bc5d8af2c83 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:13.660910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef623481-71af-4133-b805-4bc5d8af2c83 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:13.661654 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef623481-71af-4133-b805-4bc5d8af2c83 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:13.662108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef623481-71af-4133-b805-4bc5d8af2c83 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:13.662666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef623481-71af-4133-b805-4bc5d8af2c83 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:13.837279 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b0b90c98-3b15-412f-982e-76f39b734986 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:13.847287 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b0b90c98-3b15-412f-982e-76f39b734986 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581" status: 200 len: 1209 microversion: 2.1 time: 0.223688 Aug 24 10:39:13.854051 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2688/5002] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:13 2022] GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 => generated 1209 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:39:14.110219 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ef623481-71af-4133-b805-4bc5d8af2c83 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:14.114573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:14.124038 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ef623481-71af-4133-b805-4bc5d8af2c83 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.520279 Aug 24 10:39:14.126458 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2315/5003] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:13 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:14.153833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-076a46bc-2437-4ca2-bc85-9e29d88951b5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:14.155608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-076a46bc-2437-4ca2-bc85-9e29d88951b5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:14.177052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-076a46bc-2437-4ca2-bc85-9e29d88951b5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:14.196445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-076a46bc-2437-4ca2-bc85-9e29d88951b5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:14.196913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-076a46bc-2437-4ca2-bc85-9e29d88951b5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:14.203276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-076a46bc-2437-4ca2-bc85-9e29d88951b5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:14.205955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-076a46bc-2437-4ca2-bc85-9e29d88951b5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:14.209045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-076a46bc-2437-4ca2-bc85-9e29d88951b5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:14.623913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6a959ac9-dbb3-47b4-bd4f-d96c4efffc9a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:14.624528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6a959ac9-dbb3-47b4-bd4f-d96c4efffc9a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:14.637826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a959ac9-dbb3-47b4-bd4f-d96c4efffc9a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:14.644101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a959ac9-dbb3-47b4-bd4f-d96c4efffc9a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:14.645258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a959ac9-dbb3-47b4-bd4f-d96c4efffc9a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:14.646023 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a959ac9-dbb3-47b4-bd4f-d96c4efffc9a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:14.657982 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a959ac9-dbb3-47b4-bd4f-d96c4efffc9a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:14.658450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a959ac9-dbb3-47b4-bd4f-d96c4efffc9a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:14.960922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-076a46bc-2437-4ca2-bc85-9e29d88951b5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:14.975949 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-076a46bc-2437-4ca2-bc85-9e29d88951b5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.828434 Aug 24 10:39:14.989155 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2689/5004] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:14 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:14.995687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1373afe7-facb-4e4e-b988-77a358acf6ed tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:15.015433 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1373afe7-facb-4e4e-b988-77a358acf6ed tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:15.049760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1373afe7-facb-4e4e-b988-77a358acf6ed tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:15.050023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1373afe7-facb-4e4e-b988-77a358acf6ed tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:15.050472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1373afe7-facb-4e4e-b988-77a358acf6ed tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:15.051192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1373afe7-facb-4e4e-b988-77a358acf6ed tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:15.051650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1373afe7-facb-4e4e-b988-77a358acf6ed tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:15.052079 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1373afe7-facb-4e4e-b988-77a358acf6ed tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:15.163725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:15.308028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6a959ac9-dbb3-47b4-bd4f-d96c4efffc9a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:15.334565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6a959ac9-dbb3-47b4-bd4f-d96c4efffc9a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:15.345204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6a959ac9-dbb3-47b4-bd4f-d96c4efffc9a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:15.347016 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6a959ac9-dbb3-47b4-bd4f-d96c4efffc9a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1739 microversion: 2.20 time: 0.727036 Aug 24 10:39:15.350108 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2316/5005] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:14 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1739 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:39:15.369209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1373afe7-facb-4e4e-b988-77a358acf6ed tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:15.392909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1729cbb4-14a5-415e-8387-a51943b16862 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:15.395123 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1729cbb4-14a5-415e-8387-a51943b16862 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:15.400559 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1373afe7-facb-4e4e-b988-77a358acf6ed tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581" status: 200 len: 1205 microversion: 2.1 time: 0.422481 Aug 24 10:39:15.406002 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2690/5006] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:14 2022] GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 => generated 1205 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:15.436639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1729cbb4-14a5-415e-8387-a51943b16862 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:15.438506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1729cbb4-14a5-415e-8387-a51943b16862 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:15.444736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1729cbb4-14a5-415e-8387-a51943b16862 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:15.446751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1729cbb4-14a5-415e-8387-a51943b16862 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:15.447520 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1729cbb4-14a5-415e-8387-a51943b16862 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:15.448431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1729cbb4-14a5-415e-8387-a51943b16862 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:16.049194 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1729cbb4-14a5-415e-8387-a51943b16862 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:16.064124 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1729cbb4-14a5-415e-8387-a51943b16862 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.711972 Aug 24 10:39:16.065374 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2317/5007] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:15 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:16.370849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fcbec80d-cbba-4925-9027-c89ec2e71f56 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:16.372366 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fcbec80d-cbba-4925-9027-c89ec2e71f56 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:16.390802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcbec80d-cbba-4925-9027-c89ec2e71f56 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:16.395375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcbec80d-cbba-4925-9027-c89ec2e71f56 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:16.396136 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcbec80d-cbba-4925-9027-c89ec2e71f56 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:16.397152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcbec80d-cbba-4925-9027-c89ec2e71f56 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:16.400569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcbec80d-cbba-4925-9027-c89ec2e71f56 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:16.401336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcbec80d-cbba-4925-9027-c89ec2e71f56 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:16.430300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-523e876a-9d71-437b-aaf4-acaf5fe3f0c8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:16.431043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-523e876a-9d71-437b-aaf4-acaf5fe3f0c8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:16.442840 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-523e876a-9d71-437b-aaf4-acaf5fe3f0c8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:16.443700 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-523e876a-9d71-437b-aaf4-acaf5fe3f0c8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:16.444153 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-523e876a-9d71-437b-aaf4-acaf5fe3f0c8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:16.446697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-523e876a-9d71-437b-aaf4-acaf5fe3f0c8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:16.458903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-523e876a-9d71-437b-aaf4-acaf5fe3f0c8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:16.465606 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-523e876a-9d71-437b-aaf4-acaf5fe3f0c8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:16.722252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-523e876a-9d71-437b-aaf4-acaf5fe3f0c8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:16.731265 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-523e876a-9d71-437b-aaf4-acaf5fe3f0c8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581" status: 200 len: 1267 microversion: 2.1 time: 0.304886 Aug 24 10:39:16.740249 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2318/5008] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:16 2022] GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 => generated 1267 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:39:16.747356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd80bcf8-d4b1-4bf4-9cf0-8b7c77320947 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-866019679", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "c436d0f2-980c-499c-87fc-ff5c4aa0438d"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:39:16.886858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-dd80bcf8-d4b1-4bf4-9cf0-8b7c77320947 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] validate_networks() for [('c436d0f2-980c-499c-87fc-ff5c4aa0438d', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:39:17.258228 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:39:17.258496 n-d-849328-3 devstack@n-api.service[122433]: Wed Aug 24 10:39:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e (ip 10.222.0.85) !!! Aug 24 10:39:17.759119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fcbec80d-cbba-4925-9027-c89ec2e71f56 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:17.771845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fcbec80d-cbba-4925-9027-c89ec2e71f56 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:17.777589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fcbec80d-cbba-4925-9027-c89ec2e71f56 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:17.779354 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fcbec80d-cbba-4925-9027-c89ec2e71f56 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1739 microversion: 2.20 time: 1.412631 Aug 24 10:39:17.815746 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2691/5009] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:16 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1739 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:39:17.823363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d40a93a9-0901-41e9-aa63-fcbcd1040a87 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:17.823851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d40a93a9-0901-41e9-aa63-fcbcd1040a87 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:17.854867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d40a93a9-0901-41e9-aa63-fcbcd1040a87 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:17.855361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d40a93a9-0901-41e9-aa63-fcbcd1040a87 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:17.855827 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d40a93a9-0901-41e9-aa63-fcbcd1040a87 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:17.856544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d40a93a9-0901-41e9-aa63-fcbcd1040a87 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:17.856996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d40a93a9-0901-41e9-aa63-fcbcd1040a87 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:17.857448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d40a93a9-0901-41e9-aa63-fcbcd1040a87 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:18.114223 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-dd80bcf8-d4b1-4bf4-9cf0-8b7c77320947 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:39:18.114868 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-dd80bcf8-d4b1-4bf4-9cf0-8b7c77320947 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:39:18.115177 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-dd80bcf8-d4b1-4bf4-9cf0-8b7c77320947 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:39:18.115595 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-dd80bcf8-d4b1-4bf4-9cf0-8b7c77320947 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:39:18.116016 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-dd80bcf8-d4b1-4bf4-9cf0-8b7c77320947 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:39:18.145925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd80bcf8-d4b1-4bf4-9cf0-8b7c77320947 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:18.147353 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd80bcf8-d4b1-4bf4-9cf0-8b7c77320947 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:18.148532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd80bcf8-d4b1-4bf4-9cf0-8b7c77320947 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:18.154029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd80bcf8-d4b1-4bf4-9cf0-8b7c77320947 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:18.155138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd80bcf8-d4b1-4bf4-9cf0-8b7c77320947 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:18.157361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd80bcf8-d4b1-4bf4-9cf0-8b7c77320947 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:18.221844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-dd80bcf8-d4b1-4bf4-9cf0-8b7c77320947 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Getting quotas for project 3d511560c1f543169e7eab8c70c9abcd. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:39:18.241390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-dd80bcf8-d4b1-4bf4-9cf0-8b7c77320947 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Getting quotas for user 03ef6a33c1f0467993486547b7d00fda and project 3d511560c1f543169e7eab8c70c9abcd. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:39:18.290105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dd80bcf8-d4b1-4bf4-9cf0-8b7c77320947 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:39:18.302081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dd80bcf8-d4b1-4bf4-9cf0-8b7c77320947 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:39:18.500524 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dd80bcf8-d4b1-4bf4-9cf0-8b7c77320947 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.758051 Aug 24 10:39:18.509740 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2319/5010] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:39:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:39:18.517530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2cbc1447-460f-4311-931b-e15f1d0dcaa3 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:18.519499 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2cbc1447-460f-4311-931b-e15f1d0dcaa3 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:18.649868 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2cbc1447-460f-4311-931b-e15f1d0dcaa3 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:18.658812 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2cbc1447-460f-4311-931b-e15f1d0dcaa3 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1214 microversion: 2.1 time: 0.147589 Aug 24 10:39:18.666066 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2320/5011] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:18 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1214 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:18.817940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7c8eb212-31fa-4c9e-b9b1-32eb3e8b05ab tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:18.819203 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7c8eb212-31fa-4c9e-b9b1-32eb3e8b05ab tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:18.828394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c8eb212-31fa-4c9e-b9b1-32eb3e8b05ab tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:18.834990 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c8eb212-31fa-4c9e-b9b1-32eb3e8b05ab tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:18.836638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c8eb212-31fa-4c9e-b9b1-32eb3e8b05ab tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:18.838951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c8eb212-31fa-4c9e-b9b1-32eb3e8b05ab tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:18.850353 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c8eb212-31fa-4c9e-b9b1-32eb3e8b05ab tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:18.851778 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c8eb212-31fa-4c9e-b9b1-32eb3e8b05ab tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:18.924249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d40a93a9-0901-41e9-aa63-fcbcd1040a87 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:18.943099 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d40a93a9-0901-41e9-aa63-fcbcd1040a87 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581" status: 200 len: 1267 microversion: 2.1 time: 1.121935 Aug 24 10:39:18.957062 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2692/5012] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:17 2022] GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 => generated 1267 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:19.288694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7c8eb212-31fa-4c9e-b9b1-32eb3e8b05ab tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:19.307559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7c8eb212-31fa-4c9e-b9b1-32eb3e8b05ab tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:19.309425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7c8eb212-31fa-4c9e-b9b1-32eb3e8b05ab tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:19.310534 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7c8eb212-31fa-4c9e-b9b1-32eb3e8b05ab tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1739 microversion: 2.20 time: 0.498361 Aug 24 10:39:19.311106 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2321/5013] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:18 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1739 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:39:19.689050 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b657d892-e123-42fc-8056-79e398d9f7d2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:19.690242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b657d892-e123-42fc-8056-79e398d9f7d2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:19.705146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b657d892-e123-42fc-8056-79e398d9f7d2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:19.708289 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b657d892-e123-42fc-8056-79e398d9f7d2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:19.708988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b657d892-e123-42fc-8056-79e398d9f7d2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:19.711121 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b657d892-e123-42fc-8056-79e398d9f7d2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:19.712717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b657d892-e123-42fc-8056-79e398d9f7d2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:19.715378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b657d892-e123-42fc-8056-79e398d9f7d2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:19.882543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-20a573a5-6a3e-424f-886e-1e54ec917bbc tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5a8c468-1f7d-4f2c-88a5-ba7ab544225f", "device": "/dev/sdb"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:39:19.890547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-20a573a5-6a3e-424f-886e-1e54ec917bbc tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: de1ab918-0344-414e-8ec8-139343022fa1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:19.900150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20a573a5-6a3e-424f-886e-1e54ec917bbc tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:19.900951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20a573a5-6a3e-424f-886e-1e54ec917bbc tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:19.901631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20a573a5-6a3e-424f-886e-1e54ec917bbc tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:19.902553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20a573a5-6a3e-424f-886e-1e54ec917bbc tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:19.903250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20a573a5-6a3e-424f-886e-1e54ec917bbc tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:19.904068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20a573a5-6a3e-424f-886e-1e54ec917bbc tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:20.421572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b657d892-e123-42fc-8056-79e398d9f7d2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:20.449100 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b657d892-e123-42fc-8056-79e398d9f7d2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1218 microversion: 2.1 time: 0.763968 Aug 24 10:39:20.470589 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2693/5014] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:19 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1218 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:20.482483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6575dd89-cb9b-4efc-9694-b3929ed04ea3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:20.488721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6575dd89-cb9b-4efc-9694-b3929ed04ea3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:20.506928 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6575dd89-cb9b-4efc-9694-b3929ed04ea3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:20.512243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6575dd89-cb9b-4efc-9694-b3929ed04ea3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:20.513241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6575dd89-cb9b-4efc-9694-b3929ed04ea3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:20.514767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6575dd89-cb9b-4efc-9694-b3929ed04ea3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:20.516207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6575dd89-cb9b-4efc-9694-b3929ed04ea3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:20.516903 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6575dd89-cb9b-4efc-9694-b3929ed04ea3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:20.933483 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-20a573a5-6a3e-424f-886e-1e54ec917bbc tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "POST /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.054477 Aug 24 10:39:20.935421 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2322/5015] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Aug 24 10:39:19 2022] POST /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1/os-volume_attachments => generated 194 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:39:20.968718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ba8c333d-7202-4b2f-98f6-84a369198d67 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:20.974132 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ba8c333d-7202-4b2f-98f6-84a369198d67 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:20.988344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:20.994784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba8c333d-7202-4b2f-98f6-84a369198d67 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:20.995602 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba8c333d-7202-4b2f-98f6-84a369198d67 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:20.996289 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba8c333d-7202-4b2f-98f6-84a369198d67 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:20.997500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba8c333d-7202-4b2f-98f6-84a369198d67 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:20.998585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba8c333d-7202-4b2f-98f6-84a369198d67 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:20.999210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba8c333d-7202-4b2f-98f6-84a369198d67 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:21.632304 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ba8c333d-7202-4b2f-98f6-84a369198d67 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:21.646018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ba8c333d-7202-4b2f-98f6-84a369198d67 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:21.651490 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ba8c333d-7202-4b2f-98f6-84a369198d67 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:21.656744 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ba8c333d-7202-4b2f-98f6-84a369198d67 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1739 microversion: 2.20 time: 0.716731 Aug 24 10:39:21.658667 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2323/5016] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:20 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1739 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:39:21.671929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9f49fbbc-7f6f-4567-ba50-cd0eb5bdf44b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:21.674200 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9f49fbbc-7f6f-4567-ba50-cd0eb5bdf44b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:21.709626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f49fbbc-7f6f-4567-ba50-cd0eb5bdf44b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:21.710499 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f49fbbc-7f6f-4567-ba50-cd0eb5bdf44b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:21.713034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f49fbbc-7f6f-4567-ba50-cd0eb5bdf44b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:21.717509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f49fbbc-7f6f-4567-ba50-cd0eb5bdf44b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:21.718032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f49fbbc-7f6f-4567-ba50-cd0eb5bdf44b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:21.724442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6575dd89-cb9b-4efc-9694-b3929ed04ea3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:21.725809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f49fbbc-7f6f-4567-ba50-cd0eb5bdf44b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:21.740939 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6575dd89-cb9b-4efc-9694-b3929ed04ea3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581" status: 200 len: 1309 microversion: 2.1 time: 1.266552 Aug 24 10:39:21.744456 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2694/5017] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:20 2022] GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 => generated 1309 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:21.893770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9f49fbbc-7f6f-4567-ba50-cd0eb5bdf44b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:21.907244 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9f49fbbc-7f6f-4567-ba50-cd0eb5bdf44b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1272 microversion: 2.1 time: 0.246253 Aug 24 10:39:21.912814 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2324/5018] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:21 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1272 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:22.686318 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0505afc0-3b7e-4499-9fcd-3981f2298a2a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:22.687017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0505afc0-3b7e-4499-9fcd-3981f2298a2a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:22.708472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0505afc0-3b7e-4499-9fcd-3981f2298a2a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:22.712487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0505afc0-3b7e-4499-9fcd-3981f2298a2a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:22.714129 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0505afc0-3b7e-4499-9fcd-3981f2298a2a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:22.716263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0505afc0-3b7e-4499-9fcd-3981f2298a2a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:22.720229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0505afc0-3b7e-4499-9fcd-3981f2298a2a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:22.724668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0505afc0-3b7e-4499-9fcd-3981f2298a2a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:22.763911 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eed57b2b-4ee5-4701-8749-b2e199e7cd56 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:22.766074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eed57b2b-4ee5-4701-8749-b2e199e7cd56 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:22.794216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eed57b2b-4ee5-4701-8749-b2e199e7cd56 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:22.796797 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eed57b2b-4ee5-4701-8749-b2e199e7cd56 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:22.800719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eed57b2b-4ee5-4701-8749-b2e199e7cd56 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:22.805293 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eed57b2b-4ee5-4701-8749-b2e199e7cd56 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:22.806088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eed57b2b-4ee5-4701-8749-b2e199e7cd56 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:22.809667 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eed57b2b-4ee5-4701-8749-b2e199e7cd56 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:23.395831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:23.442485 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0505afc0-3b7e-4499-9fcd-3981f2298a2a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:23.465461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0505afc0-3b7e-4499-9fcd-3981f2298a2a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:23.466972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0505afc0-3b7e-4499-9fcd-3981f2298a2a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:23.482234 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0505afc0-3b7e-4499-9fcd-3981f2298a2a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1739 microversion: 2.20 time: 0.800879 Aug 24 10:39:23.486136 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2695/5019] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:22 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1739 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:39:23.502254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1df5ad90-39bb-4adf-b617-4789347a6491 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:23.505522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1df5ad90-39bb-4adf-b617-4789347a6491 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:23.527401 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:23.529172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1df5ad90-39bb-4adf-b617-4789347a6491 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:23.529694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1df5ad90-39bb-4adf-b617-4789347a6491 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:23.532358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1df5ad90-39bb-4adf-b617-4789347a6491 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:23.534156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1df5ad90-39bb-4adf-b617-4789347a6491 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:23.540242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1df5ad90-39bb-4adf-b617-4789347a6491 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:23.544669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1df5ad90-39bb-4adf-b617-4789347a6491 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:23.846775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:24.338629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eed57b2b-4ee5-4701-8749-b2e199e7cd56 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:24.351535 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eed57b2b-4ee5-4701-8749-b2e199e7cd56 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581" status: 200 len: 1309 microversion: 2.1 time: 1.592163 Aug 24 10:39:24.379193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1df5ad90-39bb-4adf-b617-4789347a6491 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:24.383794 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2325/5020] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:22 2022] GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 => generated 1309 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:24.389097 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1df5ad90-39bb-4adf-b617-4789347a6491 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1314 microversion: 2.1 time: 0.901252 Aug 24 10:39:24.389338 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2696/5021] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:23 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1314 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:24.513998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1be99380-051e-443b-9268-913d23af2a4b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:24.514680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1be99380-051e-443b-9268-913d23af2a4b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:24.533019 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1be99380-051e-443b-9268-913d23af2a4b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:24.533556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1be99380-051e-443b-9268-913d23af2a4b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:24.550879 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1be99380-051e-443b-9268-913d23af2a4b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:24.552641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1be99380-051e-443b-9268-913d23af2a4b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:24.553388 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1be99380-051e-443b-9268-913d23af2a4b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:24.555757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1be99380-051e-443b-9268-913d23af2a4b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:25.095968 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1be99380-051e-443b-9268-913d23af2a4b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:25.110541 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1be99380-051e-443b-9268-913d23af2a4b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:25.116993 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1be99380-051e-443b-9268-913d23af2a4b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:25.119792 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1be99380-051e-443b-9268-913d23af2a4b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1739 microversion: 2.20 time: 0.612557 Aug 24 10:39:25.145606 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2326/5022] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:24 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1739 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:39:25.377629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2e793865-704d-4b32-830c-cf18fd1a96f0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:25.378492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2e793865-704d-4b32-830c-cf18fd1a96f0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:25.393250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e793865-704d-4b32-830c-cf18fd1a96f0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:25.393998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e793865-704d-4b32-830c-cf18fd1a96f0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:25.394589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e793865-704d-4b32-830c-cf18fd1a96f0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:25.395428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e793865-704d-4b32-830c-cf18fd1a96f0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:25.408947 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e793865-704d-4b32-830c-cf18fd1a96f0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:25.409450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e793865-704d-4b32-830c-cf18fd1a96f0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:25.411828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-55ca9422-8573-44e9-b5e9-25dfc8c35639 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:25.412578 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-55ca9422-8573-44e9-b5e9-25dfc8c35639 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:25.443789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55ca9422-8573-44e9-b5e9-25dfc8c35639 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:25.452206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55ca9422-8573-44e9-b5e9-25dfc8c35639 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:25.454501 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55ca9422-8573-44e9-b5e9-25dfc8c35639 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:25.456207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55ca9422-8573-44e9-b5e9-25dfc8c35639 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:25.466339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55ca9422-8573-44e9-b5e9-25dfc8c35639 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:25.466979 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55ca9422-8573-44e9-b5e9-25dfc8c35639 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:26.202604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2e793865-704d-4b32-830c-cf18fd1a96f0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:26.253636 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2e793865-704d-4b32-830c-cf18fd1a96f0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581" status: 200 len: 1309 microversion: 2.1 time: 0.879713 Aug 24 10:39:26.254264 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2697/5023] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:25 2022] GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 => generated 1309 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:26.288231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-55ca9422-8573-44e9-b5e9-25dfc8c35639 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:26.292884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a38e4653-8615-4d7e-91b6-6c078639c727 req-d41064c6-7a44-48aa-8d65-09efc4462e74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5484349-8f24-4e16-9ab3-5ac504825bfd", "tag": "9c4133d6-1151-4533-993d-a245cb9d286b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:39:26.313766 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-55ca9422-8573-44e9-b5e9-25dfc8c35639 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1314 microversion: 2.1 time: 0.906991 Aug 24 10:39:26.328146 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2327/5024] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:25 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1314 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:39:26.362512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a38e4653-8615-4d7e-91b6-6c078639c727 req-d41064c6-7a44-48aa-8d65-09efc4462e74 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:26.362757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8bcc80ac-7c8b-420f-b467-8a637902a5cb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:26.363008 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a38e4653-8615-4d7e-91b6-6c078639c727 req-d41064c6-7a44-48aa-8d65-09efc4462e74 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:26.363867 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8bcc80ac-7c8b-420f-b467-8a637902a5cb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:26.371931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a38e4653-8615-4d7e-91b6-6c078639c727 req-d41064c6-7a44-48aa-8d65-09efc4462e74 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:26.389570 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bcc80ac-7c8b-420f-b467-8a637902a5cb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:26.390286 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bcc80ac-7c8b-420f-b467-8a637902a5cb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:26.391655 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bcc80ac-7c8b-420f-b467-8a637902a5cb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:26.392681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bcc80ac-7c8b-420f-b467-8a637902a5cb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:26.408487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bcc80ac-7c8b-420f-b467-8a637902a5cb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:26.412103 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a38e4653-8615-4d7e-91b6-6c078639c727 req-d41064c6-7a44-48aa-8d65-09efc4462e74 service nova] Creating event network-changed:9c4133d6-1151-4533-993d-a245cb9d286b for instance e5484349-8f24-4e16-9ab3-5ac504825bfd on n-h1-849328-3 Aug 24 10:39:26.412657 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bcc80ac-7c8b-420f-b467-8a637902a5cb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:26.423711 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a38e4653-8615-4d7e-91b6-6c078639c727 req-d41064c6-7a44-48aa-8d65-09efc4462e74 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162898 Aug 24 10:39:26.427546 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2698/5025] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:39:27.282238 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-78e0abb7-1aa1-4b53-9ecb-2b392eefc2fe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:27.284019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-78e0abb7-1aa1-4b53-9ecb-2b392eefc2fe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:27.306189 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78e0abb7-1aa1-4b53-9ecb-2b392eefc2fe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:27.306719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78e0abb7-1aa1-4b53-9ecb-2b392eefc2fe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:27.311403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78e0abb7-1aa1-4b53-9ecb-2b392eefc2fe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:27.312697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78e0abb7-1aa1-4b53-9ecb-2b392eefc2fe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:27.313223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78e0abb7-1aa1-4b53-9ecb-2b392eefc2fe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:27.329812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78e0abb7-1aa1-4b53-9ecb-2b392eefc2fe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:27.375278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8bcc80ac-7c8b-420f-b467-8a637902a5cb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:27.404847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8bcc80ac-7c8b-420f-b467-8a637902a5cb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:27.406920 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8bcc80ac-7c8b-420f-b467-8a637902a5cb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:27.416875 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8bcc80ac-7c8b-420f-b467-8a637902a5cb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1739 microversion: 2.20 time: 1.082997 Aug 24 10:39:27.441074 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2328/5026] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:26 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1739 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:39:27.467003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92c62c3b-139a-4e86-8fa9-c05c1ffe5d75 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:27.467605 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-92c62c3b-139a-4e86-8fa9-c05c1ffe5d75 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:27.488782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92c62c3b-139a-4e86-8fa9-c05c1ffe5d75 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:27.491282 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92c62c3b-139a-4e86-8fa9-c05c1ffe5d75 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:27.491768 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92c62c3b-139a-4e86-8fa9-c05c1ffe5d75 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:27.494288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92c62c3b-139a-4e86-8fa9-c05c1ffe5d75 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:27.494854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92c62c3b-139a-4e86-8fa9-c05c1ffe5d75 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:27.495304 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92c62c3b-139a-4e86-8fa9-c05c1ffe5d75 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:27.752194 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-92c62c3b-139a-4e86-8fa9-c05c1ffe5d75 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:27.768892 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-92c62c3b-139a-4e86-8fa9-c05c1ffe5d75 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1314 microversion: 2.1 time: 0.322230 Aug 24 10:39:27.770731 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2329/5027] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:27 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:27.776609 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-38b63a3a-a319-4750-b800-cd1640bb60b2 req-ad1f6c14-0e1f-478c-a627-ab8349cdf4ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d38f3a10-55ae-4b9b-9568-60733d40a581", "tag": "0a5a4832-206d-475a-b69c-f1c2ca96f10b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:39:27.807848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-38b63a3a-a319-4750-b800-cd1640bb60b2 req-ad1f6c14-0e1f-478c-a627-ab8349cdf4ae service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:27.808851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-38b63a3a-a319-4750-b800-cd1640bb60b2 req-ad1f6c14-0e1f-478c-a627-ab8349cdf4ae service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:27.811975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-38b63a3a-a319-4750-b800-cd1640bb60b2 req-ad1f6c14-0e1f-478c-a627-ab8349cdf4ae service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:27.855037 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-38b63a3a-a319-4750-b800-cd1640bb60b2 req-ad1f6c14-0e1f-478c-a627-ab8349cdf4ae service nova] Creating event network-changed:0a5a4832-206d-475a-b69c-f1c2ca96f10b for instance d38f3a10-55ae-4b9b-9568-60733d40a581 on n-h2-849328-3 Aug 24 10:39:27.870893 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-38b63a3a-a319-4750-b800-cd1640bb60b2 req-ad1f6c14-0e1f-478c-a627-ab8349cdf4ae service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098250 Aug 24 10:39:27.871594 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2330/5028] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:39:28.322055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-78e0abb7-1aa1-4b53-9ecb-2b392eefc2fe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:28.336537 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-78e0abb7-1aa1-4b53-9ecb-2b392eefc2fe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581" status: 200 len: 1309 microversion: 2.1 time: 1.064066 Aug 24 10:39:28.349236 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2699/5029] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:27 2022] GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 => generated 1309 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:28.447504 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-99bdeb7f-9639-4d20-a90b-2c27f8e616fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:28.448588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-99bdeb7f-9639-4d20-a90b-2c27f8e616fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:28.465206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:28.466991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99bdeb7f-9639-4d20-a90b-2c27f8e616fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:28.467625 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99bdeb7f-9639-4d20-a90b-2c27f8e616fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:28.468156 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99bdeb7f-9639-4d20-a90b-2c27f8e616fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:28.468874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99bdeb7f-9639-4d20-a90b-2c27f8e616fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:28.469365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99bdeb7f-9639-4d20-a90b-2c27f8e616fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:28.469804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99bdeb7f-9639-4d20-a90b-2c27f8e616fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:28.653983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:28.795297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bb6ded01-79a8-40b9-a88a-9bdecb3955f5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:28.795909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bb6ded01-79a8-40b9-a88a-9bdecb3955f5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:28.813900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb6ded01-79a8-40b9-a88a-9bdecb3955f5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:28.814397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb6ded01-79a8-40b9-a88a-9bdecb3955f5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:28.814831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb6ded01-79a8-40b9-a88a-9bdecb3955f5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:28.815544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb6ded01-79a8-40b9-a88a-9bdecb3955f5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:28.815994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb6ded01-79a8-40b9-a88a-9bdecb3955f5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:28.816427 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb6ded01-79a8-40b9-a88a-9bdecb3955f5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:29.672390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-99bdeb7f-9639-4d20-a90b-2c27f8e616fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:29.688281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-99bdeb7f-9639-4d20-a90b-2c27f8e616fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:29.692246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-99bdeb7f-9639-4d20-a90b-2c27f8e616fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:29.695356 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-99bdeb7f-9639-4d20-a90b-2c27f8e616fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1739 microversion: 2.20 time: 1.252662 Aug 24 10:39:29.703812 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2331/5030] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:28 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1739 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:39:29.735828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-58197238-02ff-4efb-b6bb-c14e256f20a8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:29.742787 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-58197238-02ff-4efb-b6bb-c14e256f20a8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:29.771073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58197238-02ff-4efb-b6bb-c14e256f20a8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:29.771392 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58197238-02ff-4efb-b6bb-c14e256f20a8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:29.777421 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58197238-02ff-4efb-b6bb-c14e256f20a8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:29.782311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58197238-02ff-4efb-b6bb-c14e256f20a8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:29.783898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58197238-02ff-4efb-b6bb-c14e256f20a8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:29.784361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58197238-02ff-4efb-b6bb-c14e256f20a8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:30.254195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bb6ded01-79a8-40b9-a88a-9bdecb3955f5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:30.268392 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bb6ded01-79a8-40b9-a88a-9bdecb3955f5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1314 microversion: 2.1 time: 1.476879 Aug 24 10:39:30.269011 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2700/5031] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:28 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1314 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:39:30.737716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0c31406e-b8dc-465e-b653-d275b14e6395 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:30.738899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0c31406e-b8dc-465e-b653-d275b14e6395 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:30.755225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c31406e-b8dc-465e-b653-d275b14e6395 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:30.759474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c31406e-b8dc-465e-b653-d275b14e6395 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:30.759927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c31406e-b8dc-465e-b653-d275b14e6395 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:30.778958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c31406e-b8dc-465e-b653-d275b14e6395 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:30.778958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c31406e-b8dc-465e-b653-d275b14e6395 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:30.779202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c31406e-b8dc-465e-b653-d275b14e6395 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:31.133856 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-58197238-02ff-4efb-b6bb-c14e256f20a8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:31.152347 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-58197238-02ff-4efb-b6bb-c14e256f20a8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581" status: 200 len: 1309 microversion: 2.1 time: 1.443547 Aug 24 10:39:31.154697 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2332/5032] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:29 2022] GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 => generated 1309 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:31.290539 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a1e7eb13-9d20-43d2-811e-7cc5447583a8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:31.291598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a1e7eb13-9d20-43d2-811e-7cc5447583a8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:31.305420 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1e7eb13-9d20-43d2-811e-7cc5447583a8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:31.306562 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1e7eb13-9d20-43d2-811e-7cc5447583a8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:31.310690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1e7eb13-9d20-43d2-811e-7cc5447583a8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:31.312668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1e7eb13-9d20-43d2-811e-7cc5447583a8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:31.313862 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1e7eb13-9d20-43d2-811e-7cc5447583a8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:31.314592 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1e7eb13-9d20-43d2-811e-7cc5447583a8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:31.394305 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:31.495376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0c31406e-b8dc-465e-b653-d275b14e6395 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:31.513927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0c31406e-b8dc-465e-b653-d275b14e6395 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:31.520743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0c31406e-b8dc-465e-b653-d275b14e6395 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:31.543614 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0c31406e-b8dc-465e-b653-d275b14e6395 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1739 microversion: 2.20 time: 0.816459 Aug 24 10:39:31.562382 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2701/5033] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:30 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1739 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:39:32.175899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b927dcce-f4d5-446e-9236-bb937a30f637 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:32.176162 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b927dcce-f4d5-446e-9236-bb937a30f637 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:32.196557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b927dcce-f4d5-446e-9236-bb937a30f637 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:32.197207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b927dcce-f4d5-446e-9236-bb937a30f637 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:32.197669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b927dcce-f4d5-446e-9236-bb937a30f637 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:32.198413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b927dcce-f4d5-446e-9236-bb937a30f637 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:32.198873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b927dcce-f4d5-446e-9236-bb937a30f637 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:32.205639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b927dcce-f4d5-446e-9236-bb937a30f637 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:32.211843 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a1e7eb13-9d20-43d2-811e-7cc5447583a8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:32.222069 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a1e7eb13-9d20-43d2-811e-7cc5447583a8 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1314 microversion: 2.1 time: 0.935810 Aug 24 10:39:32.226127 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2333/5034] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:31 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1314 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:32.575039 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7cc4b5eb-458b-4b63-a4f7-03e532784644 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:32.575672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7cc4b5eb-458b-4b63-a4f7-03e532784644 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:32.588893 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cc4b5eb-458b-4b63-a4f7-03e532784644 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:32.589555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cc4b5eb-458b-4b63-a4f7-03e532784644 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:32.591420 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cc4b5eb-458b-4b63-a4f7-03e532784644 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:32.592784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cc4b5eb-458b-4b63-a4f7-03e532784644 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:32.597564 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cc4b5eb-458b-4b63-a4f7-03e532784644 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:32.598421 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cc4b5eb-458b-4b63-a4f7-03e532784644 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:33.421540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7cc4b5eb-458b-4b63-a4f7-03e532784644 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:33.438916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7cc4b5eb-458b-4b63-a4f7-03e532784644 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:33.441848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7cc4b5eb-458b-4b63-a4f7-03e532784644 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:33.457181 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7cc4b5eb-458b-4b63-a4f7-03e532784644 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1721 microversion: 2.20 time: 0.885970 Aug 24 10:39:33.460637 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2334/5035] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:32 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1721 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:39:33.469313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d21fcc37-9372-4bae-a5f3-a3900c269206 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:33.470552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d21fcc37-9372-4bae-a5f3-a3900c269206 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:33.499477 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d21fcc37-9372-4bae-a5f3-a3900c269206 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:33.502199 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d21fcc37-9372-4bae-a5f3-a3900c269206 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:33.502896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d21fcc37-9372-4bae-a5f3-a3900c269206 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:33.519228 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d21fcc37-9372-4bae-a5f3-a3900c269206 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:33.520867 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d21fcc37-9372-4bae-a5f3-a3900c269206 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:33.521760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d21fcc37-9372-4bae-a5f3-a3900c269206 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:33.892219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b927dcce-f4d5-446e-9236-bb937a30f637 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:33.903761 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b927dcce-f4d5-446e-9236-bb937a30f637 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581" status: 200 len: 1309 microversion: 2.1 time: 1.732558 Aug 24 10:39:33.908661 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2702/5036] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:32 2022] GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 => generated 1309 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:39:33.951369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a32a1415-d67b-41bd-949d-9582e11192bb req-e28eafd0-b650-4341-a0fa-717d4a3f93f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5484349-8f24-4e16-9ab3-5ac504825bfd", "name": "network-vif-plugged", "status": "completed", "tag": "9c4133d6-1151-4533-993d-a245cb9d286b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:39:33.972610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a32a1415-d67b-41bd-949d-9582e11192bb req-e28eafd0-b650-4341-a0fa-717d4a3f93f3 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:33.975278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a32a1415-d67b-41bd-949d-9582e11192bb req-e28eafd0-b650-4341-a0fa-717d4a3f93f3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:33.976037 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a32a1415-d67b-41bd-949d-9582e11192bb req-e28eafd0-b650-4341-a0fa-717d4a3f93f3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:33.991503 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a32a1415-d67b-41bd-949d-9582e11192bb req-e28eafd0-b650-4341-a0fa-717d4a3f93f3 service nova] Creating event network-vif-plugged:9c4133d6-1151-4533-993d-a245cb9d286b for instance e5484349-8f24-4e16-9ab3-5ac504825bfd on n-h1-849328-3 Aug 24 10:39:33.997686 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a32a1415-d67b-41bd-949d-9582e11192bb req-e28eafd0-b650-4341-a0fa-717d4a3f93f3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051532 Aug 24 10:39:33.999136 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2703/5037] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:39:34.020886 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d21fcc37-9372-4bae-a5f3-a3900c269206 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:34.035127 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d21fcc37-9372-4bae-a5f3-a3900c269206 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1314 microversion: 2.1 time: 0.571254 Aug 24 10:39:34.036198 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2335/5038] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:33 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1314 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:34.488709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7773adc2-b607-49b3-b61f-9ddd0d91dd70 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:34.489786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7773adc2-b607-49b3-b61f-9ddd0d91dd70 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:34.496558 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7773adc2-b607-49b3-b61f-9ddd0d91dd70 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:34.497961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7773adc2-b607-49b3-b61f-9ddd0d91dd70 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:34.498570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7773adc2-b607-49b3-b61f-9ddd0d91dd70 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:34.499460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7773adc2-b607-49b3-b61f-9ddd0d91dd70 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:34.500125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7773adc2-b607-49b3-b61f-9ddd0d91dd70 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:34.500956 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7773adc2-b607-49b3-b61f-9ddd0d91dd70 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:34.822295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7773adc2-b607-49b3-b61f-9ddd0d91dd70 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:34.831302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7773adc2-b607-49b3-b61f-9ddd0d91dd70 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:34.834290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7773adc2-b607-49b3-b61f-9ddd0d91dd70 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:34.835483 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7773adc2-b607-49b3-b61f-9ddd0d91dd70 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1721 microversion: 2.20 time: 0.352532 Aug 24 10:39:34.836057 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2704/5039] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:34 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1721 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:39:34.939505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b4d8302a-9c49-4c94-99c8-7f8cd98a9216 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:34.940718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b4d8302a-9c49-4c94-99c8-7f8cd98a9216 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:34.954633 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4d8302a-9c49-4c94-99c8-7f8cd98a9216 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:34.958976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4d8302a-9c49-4c94-99c8-7f8cd98a9216 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:34.962386 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4d8302a-9c49-4c94-99c8-7f8cd98a9216 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:34.965314 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4d8302a-9c49-4c94-99c8-7f8cd98a9216 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:34.966921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4d8302a-9c49-4c94-99c8-7f8cd98a9216 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:34.967529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4d8302a-9c49-4c94-99c8-7f8cd98a9216 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:35.056521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-988f4bab-ddd4-449e-8cdf-b406d8cbda88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:35.057181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-988f4bab-ddd4-449e-8cdf-b406d8cbda88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:35.067238 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-988f4bab-ddd4-449e-8cdf-b406d8cbda88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:35.067400 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-988f4bab-ddd4-449e-8cdf-b406d8cbda88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:35.069642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-988f4bab-ddd4-449e-8cdf-b406d8cbda88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:35.071738 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-988f4bab-ddd4-449e-8cdf-b406d8cbda88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:35.072218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-988f4bab-ddd4-449e-8cdf-b406d8cbda88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:35.072649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-988f4bab-ddd4-449e-8cdf-b406d8cbda88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:35.363644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b4d8302a-9c49-4c94-99c8-7f8cd98a9216 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:35.380198 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b4d8302a-9c49-4c94-99c8-7f8cd98a9216 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581" status: 200 len: 1309 microversion: 2.1 time: 0.443228 Aug 24 10:39:35.395285 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2336/5040] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:34 2022] GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 => generated 1309 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:35.439039 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-988f4bab-ddd4-449e-8cdf-b406d8cbda88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:35.454062 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-988f4bab-ddd4-449e-8cdf-b406d8cbda88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1314 microversion: 2.1 time: 0.401563 Aug 24 10:39:35.455000 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2705/5041] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:35 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:39:35.862790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b9fb0a18-2239-4cd5-bf1a-785483a8678c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:35.863408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b9fb0a18-2239-4cd5-bf1a-785483a8678c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:35.877049 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9fb0a18-2239-4cd5-bf1a-785483a8678c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:35.877898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9fb0a18-2239-4cd5-bf1a-785483a8678c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:35.878503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9fb0a18-2239-4cd5-bf1a-785483a8678c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:35.879425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9fb0a18-2239-4cd5-bf1a-785483a8678c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:35.881093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9fb0a18-2239-4cd5-bf1a-785483a8678c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:35.888600 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9fb0a18-2239-4cd5-bf1a-785483a8678c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:36.064153 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-da11168e-9362-44e8-83b5-0023aea406b7 req-912d372d-54d1-44a7-943a-9cc3fcbc840a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e", "name": "network-vif-unplugged", "status": "completed", "tag": "04bfe8b2-85f8-48c0-83cc-8a238d22af80"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:39:36.102102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-da11168e-9362-44e8-83b5-0023aea406b7 req-912d372d-54d1-44a7-943a-9cc3fcbc840a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:36.102586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-da11168e-9362-44e8-83b5-0023aea406b7 req-912d372d-54d1-44a7-943a-9cc3fcbc840a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:36.103019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-da11168e-9362-44e8-83b5-0023aea406b7 req-912d372d-54d1-44a7-943a-9cc3fcbc840a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:36.145692 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-da11168e-9362-44e8-83b5-0023aea406b7 req-912d372d-54d1-44a7-943a-9cc3fcbc840a service nova] Creating event network-vif-unplugged:04bfe8b2-85f8-48c0-83cc-8a238d22af80 for instance 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e on n-h1-849328-3 Aug 24 10:39:36.158932 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-da11168e-9362-44e8-83b5-0023aea406b7 req-912d372d-54d1-44a7-943a-9cc3fcbc840a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103599 Aug 24 10:39:36.161879 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2706/5042] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:39:36.404527 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b9fb0a18-2239-4cd5-bf1a-785483a8678c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:36.408238 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2f772de8-453f-47e7-a85a-67870d8e077a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:36.411458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2f772de8-453f-47e7-a85a-67870d8e077a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:36.422586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f772de8-453f-47e7-a85a-67870d8e077a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:36.423369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f772de8-453f-47e7-a85a-67870d8e077a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:36.424097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f772de8-453f-47e7-a85a-67870d8e077a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:36.424994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f772de8-453f-47e7-a85a-67870d8e077a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:36.425636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f772de8-453f-47e7-a85a-67870d8e077a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:36.426077 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b9fb0a18-2239-4cd5-bf1a-785483a8678c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:36.426432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f772de8-453f-47e7-a85a-67870d8e077a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:36.435097 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b9fb0a18-2239-4cd5-bf1a-785483a8678c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:36.437388 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b9fb0a18-2239-4cd5-bf1a-785483a8678c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1721 microversion: 2.20 time: 0.578632 Aug 24 10:39:36.453215 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2337/5043] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:35 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1721 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:39:36.475536 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-019dc2ab-4575-46aa-bb91-df26f9a25d00 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:36.476306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-019dc2ab-4575-46aa-bb91-df26f9a25d00 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:36.498692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-019dc2ab-4575-46aa-bb91-df26f9a25d00 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:36.499558 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-019dc2ab-4575-46aa-bb91-df26f9a25d00 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:36.500232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-019dc2ab-4575-46aa-bb91-df26f9a25d00 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:36.501156 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-019dc2ab-4575-46aa-bb91-df26f9a25d00 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:36.501691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-019dc2ab-4575-46aa-bb91-df26f9a25d00 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:36.502237 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-019dc2ab-4575-46aa-bb91-df26f9a25d00 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:36.687666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2f772de8-453f-47e7-a85a-67870d8e077a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:36.699860 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2f772de8-453f-47e7-a85a-67870d8e077a tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581" status: 200 len: 1309 microversion: 2.1 time: 0.296456 Aug 24 10:39:36.701290 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2707/5044] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:36 2022] GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 => generated 1309 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:37.469564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-202d52ed-9bb3-4536-b412-610badea0ef3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:37.470355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-202d52ed-9bb3-4536-b412-610badea0ef3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:37.486283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-202d52ed-9bb3-4536-b412-610badea0ef3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:37.487055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-202d52ed-9bb3-4536-b412-610badea0ef3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:37.487603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-202d52ed-9bb3-4536-b412-610badea0ef3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:37.488514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-202d52ed-9bb3-4536-b412-610badea0ef3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:37.489257 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-202d52ed-9bb3-4536-b412-610badea0ef3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:37.491445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-202d52ed-9bb3-4536-b412-610badea0ef3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:37.593058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-019dc2ab-4575-46aa-bb91-df26f9a25d00 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:37.602342 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-019dc2ab-4575-46aa-bb91-df26f9a25d00 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1314 microversion: 2.1 time: 1.130789 Aug 24 10:39:37.602953 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2338/5045] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:36 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1314 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:37.713285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-202d52ed-9bb3-4536-b412-610badea0ef3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:37.716317 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:37.722489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3c796e4d-a6c4-4830-b59e-7587c9eeea81 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:37.723731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3c796e4d-a6c4-4830-b59e-7587c9eeea81 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:37.732700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-202d52ed-9bb3-4536-b412-610badea0ef3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:37.735410 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-202d52ed-9bb3-4536-b412-610badea0ef3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:37.737191 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-202d52ed-9bb3-4536-b412-610badea0ef3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1664 microversion: 2.20 time: 0.272954 Aug 24 10:39:37.739384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c796e4d-a6c4-4830-b59e-7587c9eeea81 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:37.740168 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2708/5046] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:37 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1664 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:39:37.748661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c796e4d-a6c4-4830-b59e-7587c9eeea81 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:37.749424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c796e4d-a6c4-4830-b59e-7587c9eeea81 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:37.750341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c796e4d-a6c4-4830-b59e-7587c9eeea81 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:37.750892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c796e4d-a6c4-4830-b59e-7587c9eeea81 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:37.759079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c796e4d-a6c4-4830-b59e-7587c9eeea81 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:37.772594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-03df8be8-874d-48aa-bed1-b8b708d337f0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a59f4dcc-918f-4b08-ab37-42bc7b283c70"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:39:37.781217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-03df8be8-874d-48aa-bed1-b8b708d337f0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:37.789390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03df8be8-874d-48aa-bed1-b8b708d337f0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:37.798277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03df8be8-874d-48aa-bed1-b8b708d337f0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:37.799515 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03df8be8-874d-48aa-bed1-b8b708d337f0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:37.800963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03df8be8-874d-48aa-bed1-b8b708d337f0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:37.801641 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03df8be8-874d-48aa-bed1-b8b708d337f0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:37.802252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03df8be8-874d-48aa-bed1-b8b708d337f0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:38.221528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3c796e4d-a6c4-4830-b59e-7587c9eeea81 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:38.233563 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3c796e4d-a6c4-4830-b59e-7587c9eeea81 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581" status: 200 len: 1309 microversion: 2.1 time: 0.515885 Aug 24 10:39:38.235215 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2339/5047] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:37 2022] GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 => generated 1309 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:38.241693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-aca08e17-c08d-4bf3-a6f7-911e7b4a8b0f req-ad654cc0-1d94-4062-859a-de885d41b205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d38f3a10-55ae-4b9b-9568-60733d40a581", "name": "network-vif-plugged", "status": "completed", "tag": "0a5a4832-206d-475a-b69c-f1c2ca96f10b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:39:38.260920 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-aca08e17-c08d-4bf3-a6f7-911e7b4a8b0f req-ad654cc0-1d94-4062-859a-de885d41b205 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:38.261666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-aca08e17-c08d-4bf3-a6f7-911e7b4a8b0f req-ad654cc0-1d94-4062-859a-de885d41b205 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:38.262409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-aca08e17-c08d-4bf3-a6f7-911e7b4a8b0f req-ad654cc0-1d94-4062-859a-de885d41b205 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:38.310204 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-aca08e17-c08d-4bf3-a6f7-911e7b4a8b0f req-ad654cc0-1d94-4062-859a-de885d41b205 service nova] Creating event network-vif-plugged:0a5a4832-206d-475a-b69c-f1c2ca96f10b for instance d38f3a10-55ae-4b9b-9568-60733d40a581 on n-h2-849328-3 Aug 24 10:39:38.322513 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-aca08e17-c08d-4bf3-a6f7-911e7b4a8b0f req-ad654cc0-1d94-4062-859a-de885d41b205 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085382 Aug 24 10:39:38.325095 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2340/5048] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:39:38.421885 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-03df8be8-874d-48aa-bed1-b8b708d337f0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "POST /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.656047 Aug 24 10:39:38.425480 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2709/5049] 10.222.0.85 () {62 vars in 1364 bytes} [Wed Aug 24 10:39:37 2022] POST /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-volume_attachments => generated 188 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:39:38.632998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d938331d-cb00-41dc-9ed6-22ae9b8724ff tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:38.633791 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d938331d-cb00-41dc-9ed6-22ae9b8724ff tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:38.643938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d938331d-cb00-41dc-9ed6-22ae9b8724ff tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:38.647613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d938331d-cb00-41dc-9ed6-22ae9b8724ff tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:38.649803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d938331d-cb00-41dc-9ed6-22ae9b8724ff tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:38.652622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d938331d-cb00-41dc-9ed6-22ae9b8724ff tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:38.653473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d938331d-cb00-41dc-9ed6-22ae9b8724ff tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:38.655061 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d938331d-cb00-41dc-9ed6-22ae9b8724ff tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:38.702210 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-408a4294-55b0-40e6-9524-da9099e68149 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:39:38.703494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-408a4294-55b0-40e6-9524-da9099e68149 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:38.719311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-408a4294-55b0-40e6-9524-da9099e68149 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:38.721759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-408a4294-55b0-40e6-9524-da9099e68149 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:38.724768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-408a4294-55b0-40e6-9524-da9099e68149 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:38.725731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-408a4294-55b0-40e6-9524-da9099e68149 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:38.726392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-408a4294-55b0-40e6-9524-da9099e68149 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:38.726988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-408a4294-55b0-40e6-9524-da9099e68149 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:38.775167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-408a4294-55b0-40e6-9524-da9099e68149 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122433) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 10:39:38.933861 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-408a4294-55b0-40e6-9524-da9099e68149 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "POST /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/action" status: 202 len: 0 microversion: 2.20 time: 0.236018 Aug 24 10:39:38.935198 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2710/5050] 10.222.0.85 () {62 vars in 1319 bytes} [Wed Aug 24 10:39:38 2022] POST /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:39:38.945100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a826e0d1-0721-42d2-a5bb-06e0e5457533 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:38.946971 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a826e0d1-0721-42d2-a5bb-06e0e5457533 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:38.962561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a826e0d1-0721-42d2-a5bb-06e0e5457533 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:38.965947 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a826e0d1-0721-42d2-a5bb-06e0e5457533 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:38.966535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a826e0d1-0721-42d2-a5bb-06e0e5457533 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:38.967393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a826e0d1-0721-42d2-a5bb-06e0e5457533 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:38.967961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a826e0d1-0721-42d2-a5bb-06e0e5457533 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:38.971816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a826e0d1-0721-42d2-a5bb-06e0e5457533 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:39.383791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a826e0d1-0721-42d2-a5bb-06e0e5457533 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:39.435120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a826e0d1-0721-42d2-a5bb-06e0e5457533 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:39.446997 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a826e0d1-0721-42d2-a5bb-06e0e5457533 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:39.452895 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a826e0d1-0721-42d2-a5bb-06e0e5457533 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1750 microversion: 2.20 time: 0.513589 Aug 24 10:39:39.455678 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2711/5051] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:38 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1750 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:39:39.470908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b8be2be1-eb64-4622-9728-f328c509b951 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:39.474726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b8be2be1-eb64-4622-9728-f328c509b951 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:39.498987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8be2be1-eb64-4622-9728-f328c509b951 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:39.499667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8be2be1-eb64-4622-9728-f328c509b951 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:39.500121 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8be2be1-eb64-4622-9728-f328c509b951 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:39.510982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8be2be1-eb64-4622-9728-f328c509b951 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:39.515214 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8be2be1-eb64-4622-9728-f328c509b951 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:39.515678 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8be2be1-eb64-4622-9728-f328c509b951 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:39.970185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b8be2be1-eb64-4622-9728-f328c509b951 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:39.978326 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b8be2be1-eb64-4622-9728-f328c509b951 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581" status: 200 len: 1309 microversion: 2.1 time: 0.520266 Aug 24 10:39:39.983942 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2712/5052] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:39 2022] GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 => generated 1309 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:40.437734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d938331d-cb00-41dc-9ed6-22ae9b8724ff tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:40.454358 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d938331d-cb00-41dc-9ed6-22ae9b8724ff tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1500 microversion: 2.1 time: 1.834547 Aug 24 10:39:40.466841 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2341/5053] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:38 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1500 bytes in 1843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:40.480582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2ed26b29-3523-4cbd-8ef2-d638745b2f91 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:39:40.481442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2ed26b29-3523-4cbd-8ef2-d638745b2f91 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:40.483616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-70a35129-85df-4d1b-8621-46e08c7180c2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:40.484553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-70a35129-85df-4d1b-8621-46e08c7180c2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:40.493050 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ed26b29-3523-4cbd-8ef2-d638745b2f91 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:40.498476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70a35129-85df-4d1b-8621-46e08c7180c2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:40.499176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70a35129-85df-4d1b-8621-46e08c7180c2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:40.499794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70a35129-85df-4d1b-8621-46e08c7180c2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:40.500758 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70a35129-85df-4d1b-8621-46e08c7180c2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:40.501393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70a35129-85df-4d1b-8621-46e08c7180c2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:40.501525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ed26b29-3523-4cbd-8ef2-d638745b2f91 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:40.501965 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ed26b29-3523-4cbd-8ef2-d638745b2f91 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:40.502267 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70a35129-85df-4d1b-8621-46e08c7180c2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:40.502708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ed26b29-3523-4cbd-8ef2-d638745b2f91 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:40.503180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ed26b29-3523-4cbd-8ef2-d638745b2f91 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:40.503608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ed26b29-3523-4cbd-8ef2-d638745b2f91 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:40.652082 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2ed26b29-3523-4cbd-8ef2-d638745b2f91 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd/action" status: 202 len: 0 microversion: 2.1 time: 0.175939 Aug 24 10:39:40.653780 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2713/5054] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:39:40 2022] POST /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:39:40.668511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-662bca55-5bea-458c-9948-fbb62bf54b35 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:40.674664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-662bca55-5bea-458c-9948-fbb62bf54b35 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:40.694005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-662bca55-5bea-458c-9948-fbb62bf54b35 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:40.694639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-662bca55-5bea-458c-9948-fbb62bf54b35 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:40.694927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-662bca55-5bea-458c-9948-fbb62bf54b35 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:40.698071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-662bca55-5bea-458c-9948-fbb62bf54b35 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:40.698550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-662bca55-5bea-458c-9948-fbb62bf54b35 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:40.698976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-662bca55-5bea-458c-9948-fbb62bf54b35 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:41.063246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-70a35129-85df-4d1b-8621-46e08c7180c2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:41.070351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-662bca55-5bea-458c-9948-fbb62bf54b35 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:41.084952 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-662bca55-5bea-458c-9948-fbb62bf54b35 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1505 microversion: 2.1 time: 0.423726 Aug 24 10:39:41.093853 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2714/5055] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:40 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1505 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:41.098047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-70a35129-85df-4d1b-8621-46e08c7180c2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:41.109348 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-70a35129-85df-4d1b-8621-46e08c7180c2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:41.110713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ef94d062-93e4-4b2e-955d-abe2e72c1ad6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:41.111764 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-70a35129-85df-4d1b-8621-46e08c7180c2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1750 microversion: 2.20 time: 0.633300 Aug 24 10:39:41.114484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ef94d062-93e4-4b2e-955d-abe2e72c1ad6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:41.118257 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2342/5056] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:40 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1750 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:39:41.131235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef94d062-93e4-4b2e-955d-abe2e72c1ad6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:41.133957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef94d062-93e4-4b2e-955d-abe2e72c1ad6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:41.136096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef94d062-93e4-4b2e-955d-abe2e72c1ad6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:41.140673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef94d062-93e4-4b2e-955d-abe2e72c1ad6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:41.141743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef94d062-93e4-4b2e-955d-abe2e72c1ad6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:41.143187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef94d062-93e4-4b2e-955d-abe2e72c1ad6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:41.651207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ef94d062-93e4-4b2e-955d-abe2e72c1ad6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:41.687798 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ef94d062-93e4-4b2e-955d-abe2e72c1ad6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581" status: 200 len: 1489 microversion: 2.1 time: 0.584926 Aug 24 10:39:41.691748 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2715/5057] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:41 2022] GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 => generated 1489 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:41.713537 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9b65fb38-fdd1-4905-978b-dab2be1d56fd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:39:41.717841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9b65fb38-fdd1-4905-978b-dab2be1d56fd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:41.746143 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b65fb38-fdd1-4905-978b-dab2be1d56fd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:41.751365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b65fb38-fdd1-4905-978b-dab2be1d56fd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:41.752016 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b65fb38-fdd1-4905-978b-dab2be1d56fd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:41.752903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b65fb38-fdd1-4905-978b-dab2be1d56fd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:41.762423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b65fb38-fdd1-4905-978b-dab2be1d56fd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:41.769821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b65fb38-fdd1-4905-978b-dab2be1d56fd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:41.907854 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9b65fb38-fdd1-4905-978b-dab2be1d56fd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "PUT /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581" status: 200 len: 1084 microversion: 2.1 time: 0.199783 Aug 24 10:39:41.916309 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2343/5058] 10.222.0.85 () {60 vars in 1256 bytes} [Wed Aug 24 10:39:41 2022] PUT /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 => generated 1084 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:41.936114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7703f31b-e5b9-4fac-88dd-cbaba22bf186 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:41.937084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7703f31b-e5b9-4fac-88dd-cbaba22bf186 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:41.966697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7703f31b-e5b9-4fac-88dd-cbaba22bf186 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:41.968939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7703f31b-e5b9-4fac-88dd-cbaba22bf186 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:41.969638 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7703f31b-e5b9-4fac-88dd-cbaba22bf186 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:41.973842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7703f31b-e5b9-4fac-88dd-cbaba22bf186 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:41.974358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7703f31b-e5b9-4fac-88dd-cbaba22bf186 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:41.978600 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7703f31b-e5b9-4fac-88dd-cbaba22bf186 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:42.115067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b295918c-aa93-45d9-9586-82c9338fc9d2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:42.115690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b295918c-aa93-45d9-9586-82c9338fc9d2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:42.135238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b295918c-aa93-45d9-9586-82c9338fc9d2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:42.137920 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b295918c-aa93-45d9-9586-82c9338fc9d2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:42.138616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b295918c-aa93-45d9-9586-82c9338fc9d2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:42.153877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b295918c-aa93-45d9-9586-82c9338fc9d2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:42.157331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b295918c-aa93-45d9-9586-82c9338fc9d2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:42.158062 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b295918c-aa93-45d9-9586-82c9338fc9d2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:42.542656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7703f31b-e5b9-4fac-88dd-cbaba22bf186 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:42.559442 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7703f31b-e5b9-4fac-88dd-cbaba22bf186 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581" status: 200 len: 1510 microversion: 2.1 time: 0.628139 Aug 24 10:39:42.562207 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2716/5059] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:41 2022] GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 => generated 1510 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:42.586294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7786993f-68b9-473b-a496-99d02dfcb3c4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:42.587061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7786993f-68b9-473b-a496-99d02dfcb3c4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:42.610688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7786993f-68b9-473b-a496-99d02dfcb3c4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:42.611294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7786993f-68b9-473b-a496-99d02dfcb3c4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:42.613760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7786993f-68b9-473b-a496-99d02dfcb3c4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:42.614595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7786993f-68b9-473b-a496-99d02dfcb3c4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:42.617890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7786993f-68b9-473b-a496-99d02dfcb3c4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:42.618435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7786993f-68b9-473b-a496-99d02dfcb3c4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:43.084673 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b295918c-aa93-45d9-9586-82c9338fc9d2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:43.100185 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b295918c-aa93-45d9-9586-82c9338fc9d2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1485 microversion: 2.1 time: 0.984373 Aug 24 10:39:43.102354 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2344/5060] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:42 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1485 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:43.120903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-48c1979b-7448-4d3d-9b00-5bc17382aa02 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:43.123030 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-48c1979b-7448-4d3d-9b00-5bc17382aa02 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:43.152374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48c1979b-7448-4d3d-9b00-5bc17382aa02 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:43.154742 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48c1979b-7448-4d3d-9b00-5bc17382aa02 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:43.158379 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48c1979b-7448-4d3d-9b00-5bc17382aa02 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:43.189581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48c1979b-7448-4d3d-9b00-5bc17382aa02 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:43.193286 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48c1979b-7448-4d3d-9b00-5bc17382aa02 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:43.202246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48c1979b-7448-4d3d-9b00-5bc17382aa02 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:43.430629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7786993f-68b9-473b-a496-99d02dfcb3c4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:43.451873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7786993f-68b9-473b-a496-99d02dfcb3c4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:43.453878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7786993f-68b9-473b-a496-99d02dfcb3c4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:43.455228 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7786993f-68b9-473b-a496-99d02dfcb3c4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1752 microversion: 2.20 time: 0.889773 Aug 24 10:39:43.456374 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2717/5061] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:42 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1752 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:39:43.473645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-485f6199-03fa-4550-8c7c-dc78ab93b6ea tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:39:43.474760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-485f6199-03fa-4550-8c7c-dc78ab93b6ea tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:43.482824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-485f6199-03fa-4550-8c7c-dc78ab93b6ea tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:43.483886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-485f6199-03fa-4550-8c7c-dc78ab93b6ea tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:43.484847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-485f6199-03fa-4550-8c7c-dc78ab93b6ea tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:43.485847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-485f6199-03fa-4550-8c7c-dc78ab93b6ea tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:43.498974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-485f6199-03fa-4550-8c7c-dc78ab93b6ea tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:43.499688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-485f6199-03fa-4550-8c7c-dc78ab93b6ea tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:43.554602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-485f6199-03fa-4550-8c7c-dc78ab93b6ea tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lazy-loading 'flavor' on Instance uuid e5484349-8f24-4e16-9ab3-5ac504825bfd {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:39:43.582632 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-48c1979b-7448-4d3d-9b00-5bc17382aa02 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:43.594848 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-48c1979b-7448-4d3d-9b00-5bc17382aa02 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581" status: 200 len: 1510 microversion: 2.1 time: 0.491163 Aug 24 10:39:43.609158 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2345/5062] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:43 2022] GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 => generated 1510 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:43.620154 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-31212434-c741-4ae3-bf4d-17a9fa33cbc6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:43.621608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-31212434-c741-4ae3-bf4d-17a9fa33cbc6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:43.645970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31212434-c741-4ae3-bf4d-17a9fa33cbc6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:43.646696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31212434-c741-4ae3-bf4d-17a9fa33cbc6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:43.647303 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31212434-c741-4ae3-bf4d-17a9fa33cbc6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:43.648278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31212434-c741-4ae3-bf4d-17a9fa33cbc6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:43.648984 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31212434-c741-4ae3-bf4d-17a9fa33cbc6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:43.649781 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31212434-c741-4ae3-bf4d-17a9fa33cbc6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:43.713556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-31212434-c741-4ae3-bf4d-17a9fa33cbc6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:39:43.740702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=6,nova_cell1:UPDATE=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:43.953659 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-31212434-c741-4ae3-bf4d-17a9fa33cbc6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581" status: 204 len: 0 microversion: 2.1 time: 0.335562 Aug 24 10:39:43.955734 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2346/5063] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:39:43 2022] DELETE /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:39:43.971475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f606d3f2-fb90-48e3-a64c-f6654bca245b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:43.976130 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f606d3f2-fb90-48e3-a64c-f6654bca245b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:43.987898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f606d3f2-fb90-48e3-a64c-f6654bca245b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:43.988741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f606d3f2-fb90-48e3-a64c-f6654bca245b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:43.989395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f606d3f2-fb90-48e3-a64c-f6654bca245b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:43.990929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f606d3f2-fb90-48e3-a64c-f6654bca245b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:43.991582 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f606d3f2-fb90-48e3-a64c-f6654bca245b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:43.993905 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f606d3f2-fb90-48e3-a64c-f6654bca245b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:43.996228 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-485f6199-03fa-4550-8c7c-dc78ab93b6ea tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd/action" status: 202 len: 0 microversion: 2.1 time: 0.537684 Aug 24 10:39:44.001246 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2718/5064] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:39:43 2022] POST /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:39:44.007922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-44c7455e-5f11-4bb7-bfc8-04a4dd1dcf85 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:44.008927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-44c7455e-5f11-4bb7-bfc8-04a4dd1dcf85 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:44.021384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44c7455e-5f11-4bb7-bfc8-04a4dd1dcf85 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:44.021995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44c7455e-5f11-4bb7-bfc8-04a4dd1dcf85 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:44.022544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44c7455e-5f11-4bb7-bfc8-04a4dd1dcf85 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:44.023467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44c7455e-5f11-4bb7-bfc8-04a4dd1dcf85 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:44.024304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44c7455e-5f11-4bb7-bfc8-04a4dd1dcf85 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:44.025252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44c7455e-5f11-4bb7-bfc8-04a4dd1dcf85 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:44.292553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f606d3f2-fb90-48e3-a64c-f6654bca245b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:44.309330 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f606d3f2-fb90-48e3-a64c-f6654bca245b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581" status: 200 len: 1516 microversion: 2.1 time: 0.346652 Aug 24 10:39:44.310874 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2347/5065] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:43 2022] GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 => generated 1516 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:39:44.484815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b85f330a-5206-4b05-bcca-9ba703d1b0e5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:44.485993 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b85f330a-5206-4b05-bcca-9ba703d1b0e5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:44.504615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b85f330a-5206-4b05-bcca-9ba703d1b0e5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:44.507821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b85f330a-5206-4b05-bcca-9ba703d1b0e5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:44.509793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b85f330a-5206-4b05-bcca-9ba703d1b0e5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:44.515739 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b85f330a-5206-4b05-bcca-9ba703d1b0e5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:44.516748 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b85f330a-5206-4b05-bcca-9ba703d1b0e5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:44.518196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b85f330a-5206-4b05-bcca-9ba703d1b0e5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:44.572455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:44.817375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b85f330a-5206-4b05-bcca-9ba703d1b0e5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:44.833061 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b85f330a-5206-4b05-bcca-9ba703d1b0e5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:44.835967 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b85f330a-5206-4b05-bcca-9ba703d1b0e5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:44.838841 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b85f330a-5206-4b05-bcca-9ba703d1b0e5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1752 microversion: 2.20 time: 0.363414 Aug 24 10:39:44.844518 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2348/5066] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:44 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1752 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:39:45.146726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-44c7455e-5f11-4bb7-bfc8-04a4dd1dcf85 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:45.162861 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-44c7455e-5f11-4bb7-bfc8-04a4dd1dcf85 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1491 microversion: 2.1 time: 1.160442 Aug 24 10:39:45.189289 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2719/5067] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:44 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1491 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:39:45.355567 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-46e309f4-42d9-44ec-a380-7726fd47f507 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:45.356272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-46e309f4-42d9-44ec-a380-7726fd47f507 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:45.416713 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46e309f4-42d9-44ec-a380-7726fd47f507 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:45.424745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46e309f4-42d9-44ec-a380-7726fd47f507 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:45.431034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46e309f4-42d9-44ec-a380-7726fd47f507 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:45.432624 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46e309f4-42d9-44ec-a380-7726fd47f507 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:45.442435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46e309f4-42d9-44ec-a380-7726fd47f507 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:45.449506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46e309f4-42d9-44ec-a380-7726fd47f507 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:45.871950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d314e81f-89ae-491a-8ea0-6888c9d53b1b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:45.872867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d314e81f-89ae-491a-8ea0-6888c9d53b1b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:45.884833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d314e81f-89ae-491a-8ea0-6888c9d53b1b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:45.891810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d314e81f-89ae-491a-8ea0-6888c9d53b1b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:45.898339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d314e81f-89ae-491a-8ea0-6888c9d53b1b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:45.910860 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d314e81f-89ae-491a-8ea0-6888c9d53b1b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:45.911769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d314e81f-89ae-491a-8ea0-6888c9d53b1b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:45.912610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d314e81f-89ae-491a-8ea0-6888c9d53b1b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:46.074010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-46e309f4-42d9-44ec-a380-7726fd47f507 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:46.091328 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-46e309f4-42d9-44ec-a380-7726fd47f507 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581" status: 200 len: 1516 microversion: 2.1 time: 0.757440 Aug 24 10:39:46.095928 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2349/5068] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:45 2022] GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 => generated 1516 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:46.203565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e4329808-a53e-47a6-b9b5-30d55142ed1d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:46.204848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e4329808-a53e-47a6-b9b5-30d55142ed1d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:46.222954 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4329808-a53e-47a6-b9b5-30d55142ed1d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:46.225897 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4329808-a53e-47a6-b9b5-30d55142ed1d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:46.226501 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4329808-a53e-47a6-b9b5-30d55142ed1d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:46.229968 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4329808-a53e-47a6-b9b5-30d55142ed1d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:46.230701 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4329808-a53e-47a6-b9b5-30d55142ed1d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:46.240365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4329808-a53e-47a6-b9b5-30d55142ed1d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:46.958351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e4329808-a53e-47a6-b9b5-30d55142ed1d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:46.972948 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e4329808-a53e-47a6-b9b5-30d55142ed1d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1512 microversion: 2.1 time: 0.778056 Aug 24 10:39:46.978785 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2350/5069] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:46 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1512 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:47.121716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-96a1754e-fe05-474d-9b3d-6a694e1dd3c0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:47.123149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-96a1754e-fe05-474d-9b3d-6a694e1dd3c0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:47.142206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96a1754e-fe05-474d-9b3d-6a694e1dd3c0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:47.144413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96a1754e-fe05-474d-9b3d-6a694e1dd3c0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:47.144877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96a1754e-fe05-474d-9b3d-6a694e1dd3c0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:47.150615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96a1754e-fe05-474d-9b3d-6a694e1dd3c0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:47.159861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96a1754e-fe05-474d-9b3d-6a694e1dd3c0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:47.160793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96a1754e-fe05-474d-9b3d-6a694e1dd3c0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:47.528313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-96a1754e-fe05-474d-9b3d-6a694e1dd3c0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:47.545276 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-96a1754e-fe05-474d-9b3d-6a694e1dd3c0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581" status: 200 len: 1516 microversion: 2.1 time: 0.432963 Aug 24 10:39:47.547664 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2351/5070] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:47 2022] GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 => generated 1516 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:47.944833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d314e81f-89ae-491a-8ea0-6888c9d53b1b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:47.956010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d314e81f-89ae-491a-8ea0-6888c9d53b1b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:47.987335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d314e81f-89ae-491a-8ea0-6888c9d53b1b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:48.000075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-61b656ba-6e51-4746-aacf-5d883da3d5a9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:48.000830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-61b656ba-6e51-4746-aacf-5d883da3d5a9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:48.008113 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d314e81f-89ae-491a-8ea0-6888c9d53b1b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1752 microversion: 2.20 time: 2.127791 Aug 24 10:39:48.015326 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2720/5071] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:45 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1752 bytes in 2150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:39:48.025262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61b656ba-6e51-4746-aacf-5d883da3d5a9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:48.028090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61b656ba-6e51-4746-aacf-5d883da3d5a9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:48.034357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61b656ba-6e51-4746-aacf-5d883da3d5a9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:48.036239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61b656ba-6e51-4746-aacf-5d883da3d5a9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:48.050415 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61b656ba-6e51-4746-aacf-5d883da3d5a9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:48.054530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61b656ba-6e51-4746-aacf-5d883da3d5a9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:48.579176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f29ad12-ae15-4461-ba45-bb9cb60dbff6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:48.579988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0f29ad12-ae15-4461-ba45-bb9cb60dbff6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:48.608174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f29ad12-ae15-4461-ba45-bb9cb60dbff6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:48.608702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f29ad12-ae15-4461-ba45-bb9cb60dbff6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:48.615958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f29ad12-ae15-4461-ba45-bb9cb60dbff6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:48.618988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f29ad12-ae15-4461-ba45-bb9cb60dbff6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:48.625331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f29ad12-ae15-4461-ba45-bb9cb60dbff6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:48.629500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f29ad12-ae15-4461-ba45-bb9cb60dbff6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:49.215087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-61b656ba-6e51-4746-aacf-5d883da3d5a9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:49.229935 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-61b656ba-6e51-4746-aacf-5d883da3d5a9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1507 microversion: 2.1 time: 1.235296 Aug 24 10:39:49.231737 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2352/5072] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:47 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1507 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:49.244010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-112a1f7d-3960-4eba-a21f-afcac59b6632 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:49.245408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-112a1f7d-3960-4eba-a21f-afcac59b6632 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:49.260125 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-112a1f7d-3960-4eba-a21f-afcac59b6632 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:49.261075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-112a1f7d-3960-4eba-a21f-afcac59b6632 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:49.262908 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-112a1f7d-3960-4eba-a21f-afcac59b6632 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:49.263997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-112a1f7d-3960-4eba-a21f-afcac59b6632 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:49.265598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-112a1f7d-3960-4eba-a21f-afcac59b6632 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:49.266216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-112a1f7d-3960-4eba-a21f-afcac59b6632 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:49.696870 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-112a1f7d-3960-4eba-a21f-afcac59b6632 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:49.716677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-112a1f7d-3960-4eba-a21f-afcac59b6632 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:49.721557 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-112a1f7d-3960-4eba-a21f-afcac59b6632 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:49.724922 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-112a1f7d-3960-4eba-a21f-afcac59b6632 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1752 microversion: 2.20 time: 0.489164 Aug 24 10:39:49.727862 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2353/5073] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:49 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1752 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:39:49.741287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0f29ad12-ae15-4461-ba45-bb9cb60dbff6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:49.746520 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0f29ad12-ae15-4461-ba45-bb9cb60dbff6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581" status: 200 len: 1516 microversion: 2.1 time: 1.181129 Aug 24 10:39:49.763857 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2721/5074] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:48 2022] GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 => generated 1516 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:49.765445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-b10686ef-8c2b-4f69-8111-0947beefafca req-d56ea81e-abf1-4ecc-9bc9-890dab055994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5484349-8f24-4e16-9ab3-5ac504825bfd", "name": "network-vif-plugged", "status": "completed", "tag": "9c4133d6-1151-4533-993d-a245cb9d286b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:39:49.780000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b10686ef-8c2b-4f69-8111-0947beefafca req-d56ea81e-abf1-4ecc-9bc9-890dab055994 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:49.781426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b10686ef-8c2b-4f69-8111-0947beefafca req-d56ea81e-abf1-4ecc-9bc9-890dab055994 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:49.782077 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b10686ef-8c2b-4f69-8111-0947beefafca req-d56ea81e-abf1-4ecc-9bc9-890dab055994 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:49.795909 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b10686ef-8c2b-4f69-8111-0947beefafca req-d56ea81e-abf1-4ecc-9bc9-890dab055994 service nova] Creating event network-vif-plugged:9c4133d6-1151-4533-993d-a245cb9d286b for instance e5484349-8f24-4e16-9ab3-5ac504825bfd on n-h1-849328-3 Aug 24 10:39:49.802684 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-b10686ef-8c2b-4f69-8111-0947beefafca req-d56ea81e-abf1-4ecc-9bc9-890dab055994 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058932 Aug 24 10:39:49.804795 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2354/5075] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:39:50.252246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-112384ed-50e5-4ce9-a033-6859b25cd573 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:50.253075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-112384ed-50e5-4ce9-a033-6859b25cd573 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:50.266958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-112384ed-50e5-4ce9-a033-6859b25cd573 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:50.267866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-112384ed-50e5-4ce9-a033-6859b25cd573 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:50.268568 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-112384ed-50e5-4ce9-a033-6859b25cd573 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:50.272323 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-112384ed-50e5-4ce9-a033-6859b25cd573 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:50.273206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-112384ed-50e5-4ce9-a033-6859b25cd573 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:50.275675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-112384ed-50e5-4ce9-a033-6859b25cd573 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:50.454629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-cd7ea020-9440-44cc-917d-8d451d5cd861 req-c9cf8d9a-36b1-46b1-8040-660704fed0f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d38f3a10-55ae-4b9b-9568-60733d40a581", "name": "network-vif-deleted", "tag": "0a5a4832-206d-475a-b69c-f1c2ca96f10b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:39:50.491977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cd7ea020-9440-44cc-917d-8d451d5cd861 req-c9cf8d9a-36b1-46b1-8040-660704fed0f6 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:50.497922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cd7ea020-9440-44cc-917d-8d451d5cd861 req-c9cf8d9a-36b1-46b1-8040-660704fed0f6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:50.500537 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cd7ea020-9440-44cc-917d-8d451d5cd861 req-c9cf8d9a-36b1-46b1-8040-660704fed0f6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:50.565063 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-cd7ea020-9440-44cc-917d-8d451d5cd861 req-c9cf8d9a-36b1-46b1-8040-660704fed0f6 service nova] Creating event network-vif-deleted:0a5a4832-206d-475a-b69c-f1c2ca96f10b for instance d38f3a10-55ae-4b9b-9568-60733d40a581 on n-h2-849328-3 Aug 24 10:39:50.588547 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-cd7ea020-9440-44cc-917d-8d451d5cd861 req-c9cf8d9a-36b1-46b1-8040-660704fed0f6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138877 Aug 24 10:39:50.602698 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2355/5076] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:39:50.755119 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d01a7e7f-d26d-4a1f-90be-3d8793e04bdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:50.756030 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d01a7e7f-d26d-4a1f-90be-3d8793e04bdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:50.774660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d01a7e7f-d26d-4a1f-90be-3d8793e04bdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:50.778610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d01a7e7f-d26d-4a1f-90be-3d8793e04bdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:50.779519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d01a7e7f-d26d-4a1f-90be-3d8793e04bdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:50.786357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d01a7e7f-d26d-4a1f-90be-3d8793e04bdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:50.788748 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d01a7e7f-d26d-4a1f-90be-3d8793e04bdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:50.797256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d01a7e7f-d26d-4a1f-90be-3d8793e04bdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:51.020395 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-112384ed-50e5-4ce9-a033-6859b25cd573 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:51.032719 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-112384ed-50e5-4ce9-a033-6859b25cd573 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1507 microversion: 2.1 time: 0.780411 Aug 24 10:39:51.041967 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2722/5077] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:50 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1507 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:51.063203 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-56a5483e-80e3-4a6c-8baa-0f0db83f5f40 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:51.064225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-56a5483e-80e3-4a6c-8baa-0f0db83f5f40 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:51.109013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56a5483e-80e3-4a6c-8baa-0f0db83f5f40 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:51.109537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56a5483e-80e3-4a6c-8baa-0f0db83f5f40 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:51.109967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56a5483e-80e3-4a6c-8baa-0f0db83f5f40 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:51.110683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56a5483e-80e3-4a6c-8baa-0f0db83f5f40 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:51.111132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56a5483e-80e3-4a6c-8baa-0f0db83f5f40 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:51.111552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56a5483e-80e3-4a6c-8baa-0f0db83f5f40 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:51.260964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56a5483e-80e3-4a6c-8baa-0f0db83f5f40 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:51.261680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56a5483e-80e3-4a6c-8baa-0f0db83f5f40 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:51.262579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56a5483e-80e3-4a6c-8baa-0f0db83f5f40 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:51.263755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-56a5483e-80e3-4a6c-8baa-0f0db83f5f40 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lazy-loading 'fault' on Instance uuid d38f3a10-55ae-4b9b-9568-60733d40a581 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:39:51.417513 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-56a5483e-80e3-4a6c-8baa-0f0db83f5f40 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:51.427740 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d01a7e7f-d26d-4a1f-90be-3d8793e04bdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:51.443425 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-56a5483e-80e3-4a6c-8baa-0f0db83f5f40 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581" status: 200 len: 1320 microversion: 2.1 time: 0.395312 Aug 24 10:39:51.448636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d01a7e7f-d26d-4a1f-90be-3d8793e04bdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:51.452122 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2723/5078] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:51 2022] GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 => generated 1320 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:51.457525 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d01a7e7f-d26d-4a1f-90be-3d8793e04bdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:51.463024 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d01a7e7f-d26d-4a1f-90be-3d8793e04bdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1752 microversion: 2.20 time: 0.712703 Aug 24 10:39:51.468574 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2356/5079] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:50 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1752 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:39:52.066989 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-87fd60de-785c-4738-ad1a-34adba15fe29 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:52.067616 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-87fd60de-785c-4738-ad1a-34adba15fe29 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:52.081683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87fd60de-785c-4738-ad1a-34adba15fe29 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:52.088695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87fd60de-785c-4738-ad1a-34adba15fe29 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:52.089355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87fd60de-785c-4738-ad1a-34adba15fe29 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:52.090345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87fd60de-785c-4738-ad1a-34adba15fe29 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:52.090836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87fd60de-785c-4738-ad1a-34adba15fe29 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:52.091273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87fd60de-785c-4738-ad1a-34adba15fe29 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:52.483296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fb75e4fb-d83b-4086-8b02-9b8238ca98a3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:52.483913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fb75e4fb-d83b-4086-8b02-9b8238ca98a3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:52.488120 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:52.500793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb75e4fb-d83b-4086-8b02-9b8238ca98a3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:52.509719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb75e4fb-d83b-4086-8b02-9b8238ca98a3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:52.511943 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb75e4fb-d83b-4086-8b02-9b8238ca98a3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:52.516423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb75e4fb-d83b-4086-8b02-9b8238ca98a3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:52.519696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb75e4fb-d83b-4086-8b02-9b8238ca98a3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:52.521179 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb75e4fb-d83b-4086-8b02-9b8238ca98a3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:52.544124 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-87fd60de-785c-4738-ad1a-34adba15fe29 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:52.557238 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-87fd60de-785c-4738-ad1a-34adba15fe29 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1507 microversion: 2.1 time: 0.494051 Aug 24 10:39:52.559767 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2724/5080] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:52 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1507 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:52.573993 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f7857254-bf66-4be9-846a-dfbd16ae9f2b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:52.579671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f7857254-bf66-4be9-846a-dfbd16ae9f2b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:52.602747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7857254-bf66-4be9-846a-dfbd16ae9f2b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:52.604411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7857254-bf66-4be9-846a-dfbd16ae9f2b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:52.609812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7857254-bf66-4be9-846a-dfbd16ae9f2b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:52.614210 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7857254-bf66-4be9-846a-dfbd16ae9f2b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:52.619434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7857254-bf66-4be9-846a-dfbd16ae9f2b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:52.620137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7857254-bf66-4be9-846a-dfbd16ae9f2b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:52.640574 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-fb75e4fb-d83b-4086-8b02-9b8238ca98a3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] HTTP exception thrown: Instance d38f3a10-55ae-4b9b-9568-60733d40a581 could not be found. Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fb75e4fb-d83b-4086-8b02-9b8238ca98a3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Request method failure captured: Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 HTTP/1.1 Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf8_-svoJ82Zcz3LMtRJH-LxEmi7YhL3SyNjhBkMMhmGqnW0J0hM18TP4MYYa3JryjRkfD6MJWxRrI1tc6yKAxu9hD6H4E3SSBMepuWzyz5efbHaNXS1nRaEb6aE-x3oa0iXQadiBh1CoF_uoY7wN-kywJAG1lWDamBR5UsabCRziuM Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestJSON-523633018 Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8b489eabb0014ddc9a2fcdf6e78ee740", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8b489eabb0014ddc9a2fcdf6e78ee740"}]}] Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestJSON-523633018 Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestJSON-523633018 Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersTestJSON-523633018-project Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 83a25a0677c04f8ba975528ece80d676 Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestJSON-523633018-project Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance d38f3a10-55ae-4b9b-9568-60733d40a581 could not be found. Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'd38f3a10-55ae-4b9b-9568-60733d40a581'} Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d38f3a10-55ae-4b9b-9568-60733d40a581 could not be found. Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d38f3a10-55ae-4b9b-9568-60733d40a581 could not be found. Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:39:52.650357 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:39:52.655954 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:39:52.655954 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:39:52.655954 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:39:52.655954 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:39:52.655954 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d38f3a10-55ae-4b9b-9568-60733d40a581 could not be found. Aug 24 10:39:52.655954 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:39:52.655954 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fb75e4fb-d83b-4086-8b02-9b8238ca98a3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Returning 404 to user: Instance d38f3a10-55ae-4b9b-9568-60733d40a581 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:39:52.658599 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fb75e4fb-d83b-4086-8b02-9b8238ca98a3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581" status: 404 len: 111 microversion: 2.1 time: 0.179749 Aug 24 10:39:52.663274 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2357/5081] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:52 2022] GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:39:53.013728 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-20d16fd6-8051-4767-8828-9aa47c1d9df8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-800608257", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "444806fc-9684-467f-82d3-8ae5206eec37"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:39:53.153561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f7857254-bf66-4be9-846a-dfbd16ae9f2b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:53.164491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f7857254-bf66-4be9-846a-dfbd16ae9f2b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:53.170998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f7857254-bf66-4be9-846a-dfbd16ae9f2b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:53.177245 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f7857254-bf66-4be9-846a-dfbd16ae9f2b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1752 microversion: 2.20 time: 0.614297 Aug 24 10:39:53.179659 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2725/5082] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:52 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1752 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:39:53.580174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a22b1fd1-9bb0-476f-b6c1-3d407eb0868f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:53.581062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a22b1fd1-9bb0-476f-b6c1-3d407eb0868f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:53.603161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a22b1fd1-9bb0-476f-b6c1-3d407eb0868f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:53.607354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a22b1fd1-9bb0-476f-b6c1-3d407eb0868f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:53.607905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a22b1fd1-9bb0-476f-b6c1-3d407eb0868f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:53.608667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a22b1fd1-9bb0-476f-b6c1-3d407eb0868f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:53.609154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a22b1fd1-9bb0-476f-b6c1-3d407eb0868f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:53.613376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a22b1fd1-9bb0-476f-b6c1-3d407eb0868f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:54.664527 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-20d16fd6-8051-4767-8828-9aa47c1d9df8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] validate_networks() for [('444806fc-9684-467f-82d3-8ae5206eec37', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:39:54.736618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a22b1fd1-9bb0-476f-b6c1-3d407eb0868f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:54.748728 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a22b1fd1-9bb0-476f-b6c1-3d407eb0868f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1507 microversion: 2.1 time: 1.171323 Aug 24 10:39:54.761178 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2726/5083] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:53 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1507 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:54.761873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ebb3369c-09d9-4ba1-bbfc-54f968db45d6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:54.763499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ebb3369c-09d9-4ba1-bbfc-54f968db45d6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:54.780395 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:54.783017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebb3369c-09d9-4ba1-bbfc-54f968db45d6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:54.784498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebb3369c-09d9-4ba1-bbfc-54f968db45d6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:54.785905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebb3369c-09d9-4ba1-bbfc-54f968db45d6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:54.788550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebb3369c-09d9-4ba1-bbfc-54f968db45d6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:54.790011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebb3369c-09d9-4ba1-bbfc-54f968db45d6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:54.791718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebb3369c-09d9-4ba1-bbfc-54f968db45d6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:55.527721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ebb3369c-09d9-4ba1-bbfc-54f968db45d6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:55.541668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ebb3369c-09d9-4ba1-bbfc-54f968db45d6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:55.543244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ebb3369c-09d9-4ba1-bbfc-54f968db45d6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:55.565255 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ebb3369c-09d9-4ba1-bbfc-54f968db45d6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1752 microversion: 2.20 time: 0.813334 Aug 24 10:39:55.567589 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2727/5084] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:54 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1752 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:39:55.773671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f2411598-a06c-4f4a-bae5-47d5beb1aa3e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:55.774389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f2411598-a06c-4f4a-bae5-47d5beb1aa3e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:55.787690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2411598-a06c-4f4a-bae5-47d5beb1aa3e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:55.788191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2411598-a06c-4f4a-bae5-47d5beb1aa3e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:55.788928 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2411598-a06c-4f4a-bae5-47d5beb1aa3e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:55.789708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2411598-a06c-4f4a-bae5-47d5beb1aa3e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:55.793110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2411598-a06c-4f4a-bae5-47d5beb1aa3e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:55.793659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2411598-a06c-4f4a-bae5-47d5beb1aa3e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:56.086903 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f2411598-a06c-4f4a-bae5-47d5beb1aa3e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:56.099091 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f2411598-a06c-4f4a-bae5-47d5beb1aa3e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1507 microversion: 2.1 time: 0.329703 Aug 24 10:39:56.111676 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2728/5085] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:55 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1507 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:56.596008 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b593c024-5537-4d6d-8f03-add37ccc9ded tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:56.598127 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b593c024-5537-4d6d-8f03-add37ccc9ded tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:56.619025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b593c024-5537-4d6d-8f03-add37ccc9ded tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:56.635804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b593c024-5537-4d6d-8f03-add37ccc9ded tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:56.636384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b593c024-5537-4d6d-8f03-add37ccc9ded tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:56.640119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b593c024-5537-4d6d-8f03-add37ccc9ded tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:56.643002 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b593c024-5537-4d6d-8f03-add37ccc9ded tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:56.643778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b593c024-5537-4d6d-8f03-add37ccc9ded tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:57.329847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b593c024-5537-4d6d-8f03-add37ccc9ded tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:57.349641 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b593c024-5537-4d6d-8f03-add37ccc9ded tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:57.351176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b593c024-5537-4d6d-8f03-add37ccc9ded tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:57.356544 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b593c024-5537-4d6d-8f03-add37ccc9ded tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1752 microversion: 2.20 time: 0.761396 Aug 24 10:39:57.357914 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2729/5086] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:56 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1752 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:39:57.370283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f2c4fd5d-e362-45af-b2a5-b9685a4344b6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:57.372651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f2c4fd5d-e362-45af-b2a5-b9685a4344b6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:57.407143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2c4fd5d-e362-45af-b2a5-b9685a4344b6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:57.407886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2c4fd5d-e362-45af-b2a5-b9685a4344b6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:57.408862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2c4fd5d-e362-45af-b2a5-b9685a4344b6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:57.411845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2c4fd5d-e362-45af-b2a5-b9685a4344b6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:57.413048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2c4fd5d-e362-45af-b2a5-b9685a4344b6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:57.414385 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2c4fd5d-e362-45af-b2a5-b9685a4344b6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:57.539993 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-20d16fd6-8051-4767-8828-9aa47c1d9df8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:39:57.540576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-20d16fd6-8051-4767-8828-9aa47c1d9df8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:39:57.541157 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-20d16fd6-8051-4767-8828-9aa47c1d9df8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:39:57.541793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-20d16fd6-8051-4767-8828-9aa47c1d9df8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:39:57.542317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-20d16fd6-8051-4767-8828-9aa47c1d9df8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:39:57.585241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20d16fd6-8051-4767-8828-9aa47c1d9df8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:57.592852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20d16fd6-8051-4767-8828-9aa47c1d9df8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:57.596442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20d16fd6-8051-4767-8828-9aa47c1d9df8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:57.602094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20d16fd6-8051-4767-8828-9aa47c1d9df8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:57.602689 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20d16fd6-8051-4767-8828-9aa47c1d9df8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:57.603145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20d16fd6-8051-4767-8828-9aa47c1d9df8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:57.676930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-20d16fd6-8051-4767-8828-9aa47c1d9df8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Getting quotas for project 8b489eabb0014ddc9a2fcdf6e78ee740. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:39:57.691220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-20d16fd6-8051-4767-8828-9aa47c1d9df8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Getting quotas for user 83a25a0677c04f8ba975528ece80d676 and project 8b489eabb0014ddc9a2fcdf6e78ee740. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:39:57.725399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-20d16fd6-8051-4767-8828-9aa47c1d9df8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:39:57.740228 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-20d16fd6-8051-4767-8828-9aa47c1d9df8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:39:57.922272 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-20d16fd6-8051-4767-8828-9aa47c1d9df8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.912884 Aug 24 10:39:57.929324 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2358/5087] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:39:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 4920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:39:57.949535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-09f49ca0-6a6e-4f9a-8695-46abdc293492 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:57.960346 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-09f49ca0-6a6e-4f9a-8695-46abdc293492 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:59.003092 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-09f49ca0-6a6e-4f9a-8695-46abdc293492 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:59.035365 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-09f49ca0-6a6e-4f9a-8695-46abdc293492 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1208 microversion: 2.1 time: 1.098430 Aug 24 10:39:59.044865 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2359/5088] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:57 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1208 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:39:59.059440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d7b1e020-7d3e-419b-8f43-e7915eae896b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:39:59.065354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d7b1e020-7d3e-419b-8f43-e7915eae896b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:39:59.083281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7b1e020-7d3e-419b-8f43-e7915eae896b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:59.083789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7b1e020-7d3e-419b-8f43-e7915eae896b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:59.084227 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7b1e020-7d3e-419b-8f43-e7915eae896b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:59.089193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7b1e020-7d3e-419b-8f43-e7915eae896b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:39:59.089800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7b1e020-7d3e-419b-8f43-e7915eae896b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:39:59.090290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7b1e020-7d3e-419b-8f43-e7915eae896b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:39:59.849705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f2c4fd5d-e362-45af-b2a5-b9685a4344b6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:39:59.863509 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f2c4fd5d-e362-45af-b2a5-b9685a4344b6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1507 microversion: 2.1 time: 2.503397 Aug 24 10:39:59.884618 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2730/5089] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:39:57 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1507 bytes in 2526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:00.066172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c13ab335-0fde-4bfe-81eb-fdf406207228 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:00.069613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c13ab335-0fde-4bfe-81eb-fdf406207228 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:00.100870 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c13ab335-0fde-4bfe-81eb-fdf406207228 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:00.101426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c13ab335-0fde-4bfe-81eb-fdf406207228 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:00.101984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c13ab335-0fde-4bfe-81eb-fdf406207228 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:00.106249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c13ab335-0fde-4bfe-81eb-fdf406207228 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:00.106815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c13ab335-0fde-4bfe-81eb-fdf406207228 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:00.107265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c13ab335-0fde-4bfe-81eb-fdf406207228 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:00.226869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d7b1e020-7d3e-419b-8f43-e7915eae896b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:00.243944 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d7b1e020-7d3e-419b-8f43-e7915eae896b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:00.245983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d7b1e020-7d3e-419b-8f43-e7915eae896b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:00.247562 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d7b1e020-7d3e-419b-8f43-e7915eae896b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1808 microversion: 2.20 time: 1.201386 Aug 24 10:40:00.250757 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2360/5090] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:39:59 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1808 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:40:00.728274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c13ab335-0fde-4bfe-81eb-fdf406207228 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:00.737003 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c13ab335-0fde-4bfe-81eb-fdf406207228 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1260 microversion: 2.1 time: 0.675982 Aug 24 10:40:00.763345 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2731/5091] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:00 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1260 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:40:00.913767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c25c21a6-7b1f-4141-b12f-11ccc37840bd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:00.914410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c25c21a6-7b1f-4141-b12f-11ccc37840bd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:00.940369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c25c21a6-7b1f-4141-b12f-11ccc37840bd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:00.941266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c25c21a6-7b1f-4141-b12f-11ccc37840bd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:00.941952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c25c21a6-7b1f-4141-b12f-11ccc37840bd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:00.943084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c25c21a6-7b1f-4141-b12f-11ccc37840bd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:00.944341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c25c21a6-7b1f-4141-b12f-11ccc37840bd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:00.945378 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c25c21a6-7b1f-4141-b12f-11ccc37840bd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:01.273822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-76a14dce-cccd-4051-8086-edd1e04816ff tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:01.274553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-76a14dce-cccd-4051-8086-edd1e04816ff tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:01.285886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76a14dce-cccd-4051-8086-edd1e04816ff tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:01.286392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76a14dce-cccd-4051-8086-edd1e04816ff tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:01.286838 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76a14dce-cccd-4051-8086-edd1e04816ff tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:01.287561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76a14dce-cccd-4051-8086-edd1e04816ff tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:01.288841 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76a14dce-cccd-4051-8086-edd1e04816ff tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:01.289617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76a14dce-cccd-4051-8086-edd1e04816ff tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:01.829937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-76a14dce-cccd-4051-8086-edd1e04816ff tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:01.846633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-76a14dce-cccd-4051-8086-edd1e04816ff tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:01.850820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-76a14dce-cccd-4051-8086-edd1e04816ff tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:01.854741 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-76a14dce-cccd-4051-8086-edd1e04816ff tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1808 microversion: 2.20 time: 0.585295 Aug 24 10:40:01.869889 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2732/5092] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:40:01 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1808 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:40:01.883322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b0c3e414-6888-4c3e-b9e6-e99111f0f6b7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:01.891044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b0c3e414-6888-4c3e-b9e6-e99111f0f6b7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:01.909940 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0c3e414-6888-4c3e-b9e6-e99111f0f6b7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:01.911513 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0c3e414-6888-4c3e-b9e6-e99111f0f6b7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:01.911943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0c3e414-6888-4c3e-b9e6-e99111f0f6b7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:01.912678 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0c3e414-6888-4c3e-b9e6-e99111f0f6b7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:01.913160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0c3e414-6888-4c3e-b9e6-e99111f0f6b7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:01.925421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0c3e414-6888-4c3e-b9e6-e99111f0f6b7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:02.189631 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b0c3e414-6888-4c3e-b9e6-e99111f0f6b7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:02.207658 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b0c3e414-6888-4c3e-b9e6-e99111f0f6b7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1266 microversion: 2.1 time: 0.335700 Aug 24 10:40:02.208386 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2733/5093] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:01 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1266 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:02.363253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c25c21a6-7b1f-4141-b12f-11ccc37840bd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:02.379942 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c25c21a6-7b1f-4141-b12f-11ccc37840bd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1507 microversion: 2.1 time: 1.474485 Aug 24 10:40:02.386025 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2361/5094] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:00 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1507 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:02.887119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-af43b731-6d42-4e1e-b8fb-a556e6090921 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:02.888388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-af43b731-6d42-4e1e-b8fb-a556e6090921 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:02.904607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af43b731-6d42-4e1e-b8fb-a556e6090921 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:02.935385 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af43b731-6d42-4e1e-b8fb-a556e6090921 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:02.939704 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af43b731-6d42-4e1e-b8fb-a556e6090921 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:02.940525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af43b731-6d42-4e1e-b8fb-a556e6090921 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:02.946907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af43b731-6d42-4e1e-b8fb-a556e6090921 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:02.948575 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af43b731-6d42-4e1e-b8fb-a556e6090921 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:03.230909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4da9e182-0617-4b73-87c2-6419c7c49e69 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:03.231739 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4da9e182-0617-4b73-87c2-6419c7c49e69 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:03.259993 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4da9e182-0617-4b73-87c2-6419c7c49e69 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:03.261684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4da9e182-0617-4b73-87c2-6419c7c49e69 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:03.262372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4da9e182-0617-4b73-87c2-6419c7c49e69 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:03.265637 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4da9e182-0617-4b73-87c2-6419c7c49e69 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:03.268456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4da9e182-0617-4b73-87c2-6419c7c49e69 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:03.271189 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4da9e182-0617-4b73-87c2-6419c7c49e69 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:03.676063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-af43b731-6d42-4e1e-b8fb-a556e6090921 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:03.711023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-af43b731-6d42-4e1e-b8fb-a556e6090921 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:03.723057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-af43b731-6d42-4e1e-b8fb-a556e6090921 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:03.724332 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-af43b731-6d42-4e1e-b8fb-a556e6090921 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1808 microversion: 2.20 time: 0.841627 Aug 24 10:40:03.724923 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2734/5095] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:40:02 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1808 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:40:03.735628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7ff5d81b-3105-4529-a2c6-c213c63b9a51 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:03.752709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7ff5d81b-3105-4529-a2c6-c213c63b9a51 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:03.831051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ff5d81b-3105-4529-a2c6-c213c63b9a51 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:03.833088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ff5d81b-3105-4529-a2c6-c213c63b9a51 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:03.834254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ff5d81b-3105-4529-a2c6-c213c63b9a51 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:03.836775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ff5d81b-3105-4529-a2c6-c213c63b9a51 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:03.837471 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ff5d81b-3105-4529-a2c6-c213c63b9a51 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:03.838288 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ff5d81b-3105-4529-a2c6-c213c63b9a51 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:03.846287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:04.211688 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4da9e182-0617-4b73-87c2-6419c7c49e69 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:04.225007 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4da9e182-0617-4b73-87c2-6419c7c49e69 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1308 microversion: 2.1 time: 1.000542 Aug 24 10:40:04.225561 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2362/5096] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:03 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1308 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:40:04.291425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7ff5d81b-3105-4529-a2c6-c213c63b9a51 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:04.291425 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7ff5d81b-3105-4529-a2c6-c213c63b9a51 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1507 microversion: 2.1 time: 0.535315 Aug 24 10:40:04.291425 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2735/5097] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:03 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1507 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:04.407097 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-013b77cc-5726-4120-940f-af4009dfb052 req-47259937-403a-41ed-a660-84bcdadd233f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e", "tag": "04bfe8b2-85f8-48c0-83cc-8a238d22af80"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:40:04.440585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-013b77cc-5726-4120-940f-af4009dfb052 req-47259937-403a-41ed-a660-84bcdadd233f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:04.450390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-013b77cc-5726-4120-940f-af4009dfb052 req-47259937-403a-41ed-a660-84bcdadd233f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:04.451196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-013b77cc-5726-4120-940f-af4009dfb052 req-47259937-403a-41ed-a660-84bcdadd233f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:04.484339 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-013b77cc-5726-4120-940f-af4009dfb052 req-47259937-403a-41ed-a660-84bcdadd233f service nova] Creating event network-changed:04bfe8b2-85f8-48c0-83cc-8a238d22af80 for instance 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e on n-h2-849328-3 Aug 24 10:40:04.501276 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-013b77cc-5726-4120-940f-af4009dfb052 req-47259937-403a-41ed-a660-84bcdadd233f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098118 Aug 24 10:40:04.510456 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2363/5098] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:40:04.750380 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-edf170be-fca9-46bf-8767-56b152699719 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:04.751169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-edf170be-fca9-46bf-8767-56b152699719 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:04.778981 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edf170be-fca9-46bf-8767-56b152699719 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:04.782212 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edf170be-fca9-46bf-8767-56b152699719 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:04.782801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edf170be-fca9-46bf-8767-56b152699719 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:04.783720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edf170be-fca9-46bf-8767-56b152699719 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:04.784143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edf170be-fca9-46bf-8767-56b152699719 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:04.784572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edf170be-fca9-46bf-8767-56b152699719 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:05.618566 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-63d1eac8-6093-4af3-a7ab-33624c339dac tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:05.620907 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:40:05.620907 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:40:05.622430 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63d1eac8-6093-4af3-a7ab-33624c339dac tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:05.625568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63d1eac8-6093-4af3-a7ab-33624c339dac tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:05.628974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63d1eac8-6093-4af3-a7ab-33624c339dac tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:05.630008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63d1eac8-6093-4af3-a7ab-33624c339dac tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:05.634349 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63d1eac8-6093-4af3-a7ab-33624c339dac tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:05.635589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63d1eac8-6093-4af3-a7ab-33624c339dac tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:05.741492 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-63d1eac8-6093-4af3-a7ab-33624c339dac tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.535990 Aug 24 10:40:05.745446 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2364/5099] 10.222.0.85 () {58 vars in 1185 bytes} [Wed Aug 24 10:40:05 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:40:05.749944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-edf170be-fca9-46bf-8767-56b152699719 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:05.773373 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-edf170be-fca9-46bf-8767-56b152699719 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:05.784243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-edf170be-fca9-46bf-8767-56b152699719 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:05.784480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-187519c7-a66b-4b2a-836f-6b52accad25d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:05.790457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-187519c7-a66b-4b2a-836f-6b52accad25d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:05.799474 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-edf170be-fca9-46bf-8767-56b152699719 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1808 microversion: 2.20 time: 1.054669 Aug 24 10:40:05.800397 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2736/5100] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:40:04 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1808 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:40:05.824516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-50a5ca1c-7748-459d-8014-0e0834ecb7d3 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:05.826252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-50a5ca1c-7748-459d-8014-0e0834ecb7d3 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:05.857064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50a5ca1c-7748-459d-8014-0e0834ecb7d3 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:05.863004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50a5ca1c-7748-459d-8014-0e0834ecb7d3 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:05.866096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-187519c7-a66b-4b2a-836f-6b52accad25d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:05.866608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-187519c7-a66b-4b2a-836f-6b52accad25d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:05.867550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50a5ca1c-7748-459d-8014-0e0834ecb7d3 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:05.869757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50a5ca1c-7748-459d-8014-0e0834ecb7d3 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:05.870122 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-187519c7-a66b-4b2a-836f-6b52accad25d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:05.871018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-187519c7-a66b-4b2a-836f-6b52accad25d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:05.871408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-187519c7-a66b-4b2a-836f-6b52accad25d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:05.871842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-187519c7-a66b-4b2a-836f-6b52accad25d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:05.873030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50a5ca1c-7748-459d-8014-0e0834ecb7d3 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:05.877763 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50a5ca1c-7748-459d-8014-0e0834ecb7d3 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:06.459050 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-50a5ca1c-7748-459d-8014-0e0834ecb7d3 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:06.468880 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-50a5ca1c-7748-459d-8014-0e0834ecb7d3 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1507 microversion: 2.1 time: 0.664656 Aug 24 10:40:06.497247 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2737/5101] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:05 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1507 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:06.508913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-45cb1e4b-edc5-4fdf-aade-491cb1d00983 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-452490196", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "availability_zone": "nova:n-h1-849328-3", "networks": [{"uuid": "2fce3984-41e2-4277-8476-c01603dae073"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:40:07.095620 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-187519c7-a66b-4b2a-836f-6b52accad25d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:07.115047 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-187519c7-a66b-4b2a-836f-6b52accad25d tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1308 microversion: 2.1 time: 1.365399 Aug 24 10:40:07.116940 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2365/5102] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:05 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1308 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:07.131169 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-47fda044-45fa-4fd0-a6a6-2e9a359903fc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:07.132550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-47fda044-45fa-4fd0-a6a6-2e9a359903fc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:07.143707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47fda044-45fa-4fd0-a6a6-2e9a359903fc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:07.149899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47fda044-45fa-4fd0-a6a6-2e9a359903fc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:07.150582 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47fda044-45fa-4fd0-a6a6-2e9a359903fc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:07.151633 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47fda044-45fa-4fd0-a6a6-2e9a359903fc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:07.152260 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47fda044-45fa-4fd0-a6a6-2e9a359903fc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:07.152844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47fda044-45fa-4fd0-a6a6-2e9a359903fc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:07.688452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-47fda044-45fa-4fd0-a6a6-2e9a359903fc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:07.704313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-47fda044-45fa-4fd0-a6a6-2e9a359903fc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:07.714882 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-47fda044-45fa-4fd0-a6a6-2e9a359903fc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:07.716167 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-47fda044-45fa-4fd0-a6a6-2e9a359903fc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1808 microversion: 2.20 time: 0.588983 Aug 24 10:40:07.716756 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2366/5103] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:40:07 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1808 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:40:07.787449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d5a619bf-4253-45a4-8c47-ecb7e1c90080 req-96fc2195-131f-425e-8644-c75ec311521e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63df0acf-c830-4801-8533-ad833b1f0180", "tag": "05916c60-0283-4f9d-b42e-ce2a1dfff874"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:40:07.839638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d5a619bf-4253-45a4-8c47-ecb7e1c90080 req-96fc2195-131f-425e-8644-c75ec311521e service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:07.840158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d5a619bf-4253-45a4-8c47-ecb7e1c90080 req-96fc2195-131f-425e-8644-c75ec311521e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:07.840651 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d5a619bf-4253-45a4-8c47-ecb7e1c90080 req-96fc2195-131f-425e-8644-c75ec311521e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:07.885427 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d5a619bf-4253-45a4-8c47-ecb7e1c90080 req-96fc2195-131f-425e-8644-c75ec311521e service nova] Creating event network-changed:05916c60-0283-4f9d-b42e-ce2a1dfff874 for instance 63df0acf-c830-4801-8533-ad833b1f0180 on n-h2-849328-3 Aug 24 10:40:07.901628 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d5a619bf-4253-45a4-8c47-ecb7e1c90080 req-96fc2195-131f-425e-8644-c75ec311521e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164628 Aug 24 10:40:07.902292 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2367/5104] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:40:07.934985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e180da3f-4323-470b-afae-1c81bc01f196 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:07.935797 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e180da3f-4323-470b-afae-1c81bc01f196 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:07.958958 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e180da3f-4323-470b-afae-1c81bc01f196 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:07.959818 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e180da3f-4323-470b-afae-1c81bc01f196 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:07.960271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e180da3f-4323-470b-afae-1c81bc01f196 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:07.961011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e180da3f-4323-470b-afae-1c81bc01f196 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:07.961497 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e180da3f-4323-470b-afae-1c81bc01f196 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:07.961921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e180da3f-4323-470b-afae-1c81bc01f196 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:08.632959 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e180da3f-4323-470b-afae-1c81bc01f196 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:08.644088 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e180da3f-4323-470b-afae-1c81bc01f196 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1507 microversion: 2.1 time: 0.740457 Aug 24 10:40:08.667732 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2368/5105] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:07 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1507 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:08.682551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0aa83209-8c27-4ce6-bb3a-ff4013c2465f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:08.688594 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0aa83209-8c27-4ce6-bb3a-ff4013c2465f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:08.713347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0aa83209-8c27-4ce6-bb3a-ff4013c2465f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:08.714248 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0aa83209-8c27-4ce6-bb3a-ff4013c2465f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:08.716740 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0aa83209-8c27-4ce6-bb3a-ff4013c2465f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:08.717903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0aa83209-8c27-4ce6-bb3a-ff4013c2465f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:08.724122 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0aa83209-8c27-4ce6-bb3a-ff4013c2465f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:08.731636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0aa83209-8c27-4ce6-bb3a-ff4013c2465f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:09.010108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:09.351907 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0aa83209-8c27-4ce6-bb3a-ff4013c2465f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:09.370242 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0aa83209-8c27-4ce6-bb3a-ff4013c2465f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1308 microversion: 2.1 time: 0.700519 Aug 24 10:40:09.386482 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2369/5106] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:08 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1308 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:09.405220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f8771430-0a98-41f1-a505-974e96cf12fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:09.407134 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f8771430-0a98-41f1-a505-974e96cf12fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:09.427282 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8771430-0a98-41f1-a505-974e96cf12fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:09.430880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8771430-0a98-41f1-a505-974e96cf12fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:09.432057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8771430-0a98-41f1-a505-974e96cf12fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:09.436320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8771430-0a98-41f1-a505-974e96cf12fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:09.437244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8771430-0a98-41f1-a505-974e96cf12fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:09.437937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8771430-0a98-41f1-a505-974e96cf12fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:09.781842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f8771430-0a98-41f1-a505-974e96cf12fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:09.789932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:09.808332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f8771430-0a98-41f1-a505-974e96cf12fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:09.810426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f8771430-0a98-41f1-a505-974e96cf12fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:09.811936 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f8771430-0a98-41f1-a505-974e96cf12fd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1808 microversion: 2.20 time: 0.423872 Aug 24 10:40:09.812755 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2370/5107] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:40:09 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1808 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:40:09.834272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-17cc5f8e-c798-42e1-929b-b7200169065a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:09.835319 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-17cc5f8e-c798-42e1-929b-b7200169065a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:09.846328 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17cc5f8e-c798-42e1-929b-b7200169065a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:09.847330 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17cc5f8e-c798-42e1-929b-b7200169065a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:09.848024 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17cc5f8e-c798-42e1-929b-b7200169065a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:09.849078 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17cc5f8e-c798-42e1-929b-b7200169065a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:09.849780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17cc5f8e-c798-42e1-929b-b7200169065a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:09.850428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17cc5f8e-c798-42e1-929b-b7200169065a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:10.262509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-17cc5f8e-c798-42e1-929b-b7200169065a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:10.271342 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-17cc5f8e-c798-42e1-929b-b7200169065a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1507 microversion: 2.1 time: 0.457274 Aug 24 10:40:10.278202 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2371/5108] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:09 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1507 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:10.301241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ed5725d4-5d78-4638-ac6d-2a9e316f19c6 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:10.303111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ed5725d4-5d78-4638-ac6d-2a9e316f19c6 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: de1ab918-0344-414e-8ec8-139343022fa1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:10.316195 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed5725d4-5d78-4638-ac6d-2a9e316f19c6 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:10.318684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed5725d4-5d78-4638-ac6d-2a9e316f19c6 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:10.319769 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed5725d4-5d78-4638-ac6d-2a9e316f19c6 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:10.322035 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed5725d4-5d78-4638-ac6d-2a9e316f19c6 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:10.322681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed5725d4-5d78-4638-ac6d-2a9e316f19c6 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:10.327564 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed5725d4-5d78-4638-ac6d-2a9e316f19c6 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:10.488885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-ed5725d4-5d78-4638-ac6d-2a9e316f19c6 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lazy-loading 'services' on Instance uuid de1ab918-0344-414e-8ec8-139343022fa1 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:40:10.709688 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ed5725d4-5d78-4638-ac6d-2a9e316f19c6 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "DELETE /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1/os-volume_attachments/a5a8c468-1f7d-4f2c-88a5-ba7ab544225f" status: 202 len: 0 microversion: 2.1 time: 0.426743 Aug 24 10:40:10.711012 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2372/5109] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Aug 24 10:40:10 2022] DELETE /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1/os-volume_attachments/a5a8c468-1f7d-4f2c-88a5-ba7ab544225f => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:40:10.741266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d4853d2f-8c2b-49a4-9573-8c058e608dcd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:10.742656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d4853d2f-8c2b-49a4-9573-8c058e608dcd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:10.762668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4853d2f-8c2b-49a4-9573-8c058e608dcd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:10.763582 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4853d2f-8c2b-49a4-9573-8c058e608dcd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:10.765656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4853d2f-8c2b-49a4-9573-8c058e608dcd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:10.769017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4853d2f-8c2b-49a4-9573-8c058e608dcd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:10.773446 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4853d2f-8c2b-49a4-9573-8c058e608dcd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:10.774540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4853d2f-8c2b-49a4-9573-8c058e608dcd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:12.159229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d4853d2f-8c2b-49a4-9573-8c058e608dcd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:12.169248 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d4853d2f-8c2b-49a4-9573-8c058e608dcd tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1308 microversion: 2.1 time: 1.456627 Aug 24 10:40:12.187558 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2373/5110] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:10 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1308 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:12.192822 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f86694cb-966f-4147-92bd-0d57249212dc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:12.209040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f86694cb-966f-4147-92bd-0d57249212dc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:12.234327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f86694cb-966f-4147-92bd-0d57249212dc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:12.235124 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f86694cb-966f-4147-92bd-0d57249212dc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:12.235868 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f86694cb-966f-4147-92bd-0d57249212dc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:12.237282 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f86694cb-966f-4147-92bd-0d57249212dc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:12.237881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f86694cb-966f-4147-92bd-0d57249212dc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:12.238473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f86694cb-966f-4147-92bd-0d57249212dc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:12.809867 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f86694cb-966f-4147-92bd-0d57249212dc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:12.827686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f86694cb-966f-4147-92bd-0d57249212dc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:12.834258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f86694cb-966f-4147-92bd-0d57249212dc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:12.839655 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f86694cb-966f-4147-92bd-0d57249212dc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1808 microversion: 2.20 time: 0.650710 Aug 24 10:40:12.840708 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2374/5111] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:40:12 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1808 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:40:12.858509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e3b21ca3-742b-4580-a8b8-a3a53893912b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:12.862534 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e3b21ca3-742b-4580-a8b8-a3a53893912b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:12.879551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3b21ca3-742b-4580-a8b8-a3a53893912b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:12.880362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3b21ca3-742b-4580-a8b8-a3a53893912b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:12.880970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3b21ca3-742b-4580-a8b8-a3a53893912b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:12.884399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3b21ca3-742b-4580-a8b8-a3a53893912b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:12.885328 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3b21ca3-742b-4580-a8b8-a3a53893912b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:12.885924 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3b21ca3-742b-4580-a8b8-a3a53893912b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:13.299255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e3b21ca3-742b-4580-a8b8-a3a53893912b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:13.313085 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e3b21ca3-742b-4580-a8b8-a3a53893912b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1507 microversion: 2.1 time: 0.470769 Aug 24 10:40:13.325166 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2375/5112] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:12 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1507 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:13.325166 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6272f5f4-bf30-453f-903b-1f844ebf2123 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:13.325166 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6272f5f4-bf30-453f-903b-1f844ebf2123 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:13.344616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6272f5f4-bf30-453f-903b-1f844ebf2123 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:13.345146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6272f5f4-bf30-453f-903b-1f844ebf2123 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:13.345691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6272f5f4-bf30-453f-903b-1f844ebf2123 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:13.346416 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6272f5f4-bf30-453f-903b-1f844ebf2123 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:13.346867 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6272f5f4-bf30-453f-903b-1f844ebf2123 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:13.347350 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6272f5f4-bf30-453f-903b-1f844ebf2123 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:13.708939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6272f5f4-bf30-453f-903b-1f844ebf2123 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:13.720707 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6272f5f4-bf30-453f-903b-1f844ebf2123 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1308 microversion: 2.1 time: 0.405180 Aug 24 10:40:13.721721 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2376/5113] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:13 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1308 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:13.873675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3c72f713-dd6e-496e-ba10-089398f90f6a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:13.874562 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3c72f713-dd6e-496e-ba10-089398f90f6a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:13.889662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c72f713-dd6e-496e-ba10-089398f90f6a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:13.891836 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c72f713-dd6e-496e-ba10-089398f90f6a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:13.892605 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c72f713-dd6e-496e-ba10-089398f90f6a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:13.893505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c72f713-dd6e-496e-ba10-089398f90f6a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:13.904849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c72f713-dd6e-496e-ba10-089398f90f6a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:13.906738 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c72f713-dd6e-496e-ba10-089398f90f6a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:14.487952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3c72f713-dd6e-496e-ba10-089398f90f6a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:14.515578 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3c72f713-dd6e-496e-ba10-089398f90f6a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:14.517109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3c72f713-dd6e-496e-ba10-089398f90f6a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:14.518400 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3c72f713-dd6e-496e-ba10-089398f90f6a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1808 microversion: 2.20 time: 0.650155 Aug 24 10:40:14.519227 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2377/5114] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:40:13 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1808 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:40:14.538067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8908983a-5eb6-4d8f-9784-3de7d0f114e7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:14.538761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8908983a-5eb6-4d8f-9784-3de7d0f114e7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:14.566120 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8908983a-5eb6-4d8f-9784-3de7d0f114e7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:14.566662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8908983a-5eb6-4d8f-9784-3de7d0f114e7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:14.567139 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8908983a-5eb6-4d8f-9784-3de7d0f114e7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:14.567913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8908983a-5eb6-4d8f-9784-3de7d0f114e7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:14.568373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8908983a-5eb6-4d8f-9784-3de7d0f114e7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:14.568898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8908983a-5eb6-4d8f-9784-3de7d0f114e7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:14.912597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8908983a-5eb6-4d8f-9784-3de7d0f114e7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:14.941475 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8908983a-5eb6-4d8f-9784-3de7d0f114e7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1507 microversion: 2.1 time: 0.420985 Aug 24 10:40:14.945514 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2378/5115] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:14 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1507 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:14.957695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3e92d294-1155-42f5-8fff-76f1550c9a45 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:14.958770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3e92d294-1155-42f5-8fff-76f1550c9a45 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:14.970230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e92d294-1155-42f5-8fff-76f1550c9a45 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:14.974058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e92d294-1155-42f5-8fff-76f1550c9a45 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:14.974704 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e92d294-1155-42f5-8fff-76f1550c9a45 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:14.979933 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e92d294-1155-42f5-8fff-76f1550c9a45 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:14.980729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e92d294-1155-42f5-8fff-76f1550c9a45 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:14.981428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e92d294-1155-42f5-8fff-76f1550c9a45 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:15.660711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:15.703997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3e92d294-1155-42f5-8fff-76f1550c9a45 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:15.724274 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3e92d294-1155-42f5-8fff-76f1550c9a45 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1308 microversion: 2.1 time: 0.777335 Aug 24 10:40:15.729447 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2379/5116] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:14 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1308 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:15.749351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-08108163-4e1f-40d1-b1b5-75bb4e9a2cb4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:15.750236 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-08108163-4e1f-40d1-b1b5-75bb4e9a2cb4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:15.776895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08108163-4e1f-40d1-b1b5-75bb4e9a2cb4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:15.779012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08108163-4e1f-40d1-b1b5-75bb4e9a2cb4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:15.779504 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08108163-4e1f-40d1-b1b5-75bb4e9a2cb4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:15.782449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08108163-4e1f-40d1-b1b5-75bb4e9a2cb4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:15.785275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08108163-4e1f-40d1-b1b5-75bb4e9a2cb4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:15.785903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08108163-4e1f-40d1-b1b5-75bb4e9a2cb4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:16.375885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-45cb1e4b-edc5-4fdf-aade-491cb1d00983 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] validate_networks() for [('2fce3984-41e2-4277-8476-c01603dae073', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:40:16.464020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=17 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:16.579628 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-08108163-4e1f-40d1-b1b5-75bb4e9a2cb4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:16.598804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=25 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:16.601720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-08108163-4e1f-40d1-b1b5-75bb4e9a2cb4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:16.608039 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-08108163-4e1f-40d1-b1b5-75bb4e9a2cb4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:16.612493 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-08108163-4e1f-40d1-b1b5-75bb4e9a2cb4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1808 microversion: 2.20 time: 0.881433 Aug 24 10:40:16.613042 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2380/5117] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:40:15 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1808 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:40:16.625505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9c96b70a-33d9-41a7-b9c7-692329526d0d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:16.629187 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9c96b70a-33d9-41a7-b9c7-692329526d0d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:16.648522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c96b70a-33d9-41a7-b9c7-692329526d0d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:16.648522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c96b70a-33d9-41a7-b9c7-692329526d0d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:16.648522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c96b70a-33d9-41a7-b9c7-692329526d0d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:16.648522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c96b70a-33d9-41a7-b9c7-692329526d0d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:16.648522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c96b70a-33d9-41a7-b9c7-692329526d0d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:16.648522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c96b70a-33d9-41a7-b9c7-692329526d0d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:17.348537 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9c96b70a-33d9-41a7-b9c7-692329526d0d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:17.364262 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9c96b70a-33d9-41a7-b9c7-692329526d0d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1507 microversion: 2.1 time: 0.750039 Aug 24 10:40:17.367457 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2381/5118] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:16 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1507 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:17.378962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-396904c6-4625-4131-909d-1ed42640ea47 req-a959334e-326d-42d8-bc42-ed4371bd49b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63df0acf-c830-4801-8533-ad833b1f0180", "name": "network-vif-plugged", "status": "completed", "tag": "05916c60-0283-4f9d-b42e-ce2a1dfff874"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:40:17.405760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-396904c6-4625-4131-909d-1ed42640ea47 req-a959334e-326d-42d8-bc42-ed4371bd49b8 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:17.407419 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-396904c6-4625-4131-909d-1ed42640ea47 req-a959334e-326d-42d8-bc42-ed4371bd49b8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:17.409330 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-396904c6-4625-4131-909d-1ed42640ea47 req-a959334e-326d-42d8-bc42-ed4371bd49b8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:17.451088 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-396904c6-4625-4131-909d-1ed42640ea47 req-a959334e-326d-42d8-bc42-ed4371bd49b8 service nova] Creating event network-vif-plugged:05916c60-0283-4f9d-b42e-ce2a1dfff874 for instance 63df0acf-c830-4801-8533-ad833b1f0180 on n-h2-849328-3 Aug 24 10:40:17.486926 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-396904c6-4625-4131-909d-1ed42640ea47 req-a959334e-326d-42d8-bc42-ed4371bd49b8 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116255 Aug 24 10:40:17.510159 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2382/5119] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:40:17.531064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cc26f979-36a4-4c30-90ea-c24ed569f929 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:17.536610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cc26f979-36a4-4c30-90ea-c24ed569f929 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:17.574061 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc26f979-36a4-4c30-90ea-c24ed569f929 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:17.574599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc26f979-36a4-4c30-90ea-c24ed569f929 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:17.575046 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc26f979-36a4-4c30-90ea-c24ed569f929 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:17.575765 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc26f979-36a4-4c30-90ea-c24ed569f929 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:17.576225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc26f979-36a4-4c30-90ea-c24ed569f929 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:17.576682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc26f979-36a4-4c30-90ea-c24ed569f929 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:17.689782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-45cb1e4b-edc5-4fdf-aade-491cb1d00983 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:40:17.690958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-45cb1e4b-edc5-4fdf-aade-491cb1d00983 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:40:17.691786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-45cb1e4b-edc5-4fdf-aade-491cb1d00983 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:40:17.692427 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-45cb1e4b-edc5-4fdf-aade-491cb1d00983 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:40:17.693053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-45cb1e4b-edc5-4fdf-aade-491cb1d00983 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:40:17.733043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45cb1e4b-edc5-4fdf-aade-491cb1d00983 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:17.734057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45cb1e4b-edc5-4fdf-aade-491cb1d00983 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:17.734813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45cb1e4b-edc5-4fdf-aade-491cb1d00983 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:17.737790 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45cb1e4b-edc5-4fdf-aade-491cb1d00983 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:17.739225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45cb1e4b-edc5-4fdf-aade-491cb1d00983 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:17.741396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45cb1e4b-edc5-4fdf-aade-491cb1d00983 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:17.812931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-45cb1e4b-edc5-4fdf-aade-491cb1d00983 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Getting quotas for project 2b0f6576c12947c386db2c488fcace2d. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:40:17.822030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-45cb1e4b-edc5-4fdf-aade-491cb1d00983 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Getting quotas for user a3e99593a56941369eceaec628b8aaad and project 2b0f6576c12947c386db2c488fcace2d. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:40:17.843399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-45cb1e4b-edc5-4fdf-aade-491cb1d00983 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:40:17.855580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-45cb1e4b-edc5-4fdf-aade-491cb1d00983 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: e61a5d87-9af0-427b-8730-8c84899eda28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:40:17.983275 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-45cb1e4b-edc5-4fdf-aade-491cb1d00983 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 11.477017 Aug 24 10:40:17.997102 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2738/5120] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:40:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 11499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:40:18.012490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0275d9dc-5949-4be8-aa07-1b2ebbac224e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:18.016429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0275d9dc-5949-4be8-aa07-1b2ebbac224e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:18.052144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0275d9dc-5949-4be8-aa07-1b2ebbac224e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:18.064211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0275d9dc-5949-4be8-aa07-1b2ebbac224e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:18.065063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0275d9dc-5949-4be8-aa07-1b2ebbac224e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:18.070035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0275d9dc-5949-4be8-aa07-1b2ebbac224e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:18.077980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0275d9dc-5949-4be8-aa07-1b2ebbac224e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:18.078828 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0275d9dc-5949-4be8-aa07-1b2ebbac224e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:18.521025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0275d9dc-5949-4be8-aa07-1b2ebbac224e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:18.546117 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0275d9dc-5949-4be8-aa07-1b2ebbac224e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:18.550950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0275d9dc-5949-4be8-aa07-1b2ebbac224e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:18.553853 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0275d9dc-5949-4be8-aa07-1b2ebbac224e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1808 microversion: 2.20 time: 0.553469 Aug 24 10:40:18.554903 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2739/5121] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:40:17 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1808 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:40:18.602957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7b213615-5587-4679-910b-583afeea67ef tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:18.605034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7b213615-5587-4679-910b-583afeea67ef tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: e61a5d87-9af0-427b-8730-8c84899eda28] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:18.794795 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7b213615-5587-4679-910b-583afeea67ef tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28" status: 200 len: 1328 microversion: 2.1 time: 0.236531 Aug 24 10:40:18.800221 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2740/5122] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:18 2022] GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28 => generated 1328 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:18.808635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8c116fac-35f8-465d-90b2-bed5aee7329d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:18.833825 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8c116fac-35f8-465d-90b2-bed5aee7329d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:18.855119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c116fac-35f8-465d-90b2-bed5aee7329d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:18.856830 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c116fac-35f8-465d-90b2-bed5aee7329d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:18.863991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c116fac-35f8-465d-90b2-bed5aee7329d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:18.865022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c116fac-35f8-465d-90b2-bed5aee7329d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:18.874204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c116fac-35f8-465d-90b2-bed5aee7329d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:18.875170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c116fac-35f8-465d-90b2-bed5aee7329d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:19.337640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8c116fac-35f8-465d-90b2-bed5aee7329d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:19.372220 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8c116fac-35f8-465d-90b2-bed5aee7329d tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1504 microversion: 2.1 time: 0.568216 Aug 24 10:40:19.374656 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2741/5123] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:18 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1504 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:19.522496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cc26f979-36a4-4c30-90ea-c24ed569f929 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:19.538337 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cc26f979-36a4-4c30-90ea-c24ed569f929 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1308 microversion: 2.1 time: 2.026701 Aug 24 10:40:19.542098 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2383/5124] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:17 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1308 bytes in 2031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:19.592623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7e5d94f8-4e40-475c-9b1b-e3cd57e91cc1 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:19.596513 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7e5d94f8-4e40-475c-9b1b-e3cd57e91cc1 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:19.625208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e5d94f8-4e40-475c-9b1b-e3cd57e91cc1 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:19.635580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e5d94f8-4e40-475c-9b1b-e3cd57e91cc1 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:19.637608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e5d94f8-4e40-475c-9b1b-e3cd57e91cc1 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:19.639768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e5d94f8-4e40-475c-9b1b-e3cd57e91cc1 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:19.642778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e5d94f8-4e40-475c-9b1b-e3cd57e91cc1 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:19.643568 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e5d94f8-4e40-475c-9b1b-e3cd57e91cc1 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:19.818787 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f9e70c04-12d0-41d5-86fd-3410691353b3 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:19.819727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f9e70c04-12d0-41d5-86fd-3410691353b3 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: e61a5d87-9af0-427b-8730-8c84899eda28] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:19.844976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9e70c04-12d0-41d5-86fd-3410691353b3 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:19.845536 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9e70c04-12d0-41d5-86fd-3410691353b3 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:19.846218 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9e70c04-12d0-41d5-86fd-3410691353b3 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:19.847042 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9e70c04-12d0-41d5-86fd-3410691353b3 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:19.847704 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9e70c04-12d0-41d5-86fd-3410691353b3 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:19.848105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9e70c04-12d0-41d5-86fd-3410691353b3 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:20.015882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7e5d94f8-4e40-475c-9b1b-e3cd57e91cc1 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:20.068293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7e5d94f8-4e40-475c-9b1b-e3cd57e91cc1 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:20.090443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7e5d94f8-4e40-475c-9b1b-e3cd57e91cc1 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:20.094161 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7e5d94f8-4e40-475c-9b1b-e3cd57e91cc1 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1808 microversion: 2.20 time: 0.516320 Aug 24 10:40:20.099842 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2742/5125] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:40:19 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1808 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:40:20.130137 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f9e70c04-12d0-41d5-86fd-3410691353b3 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28" status: 200 len: 1345 microversion: 2.1 time: 0.317476 Aug 24 10:40:20.144705 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2384/5126] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:19 2022] GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28 => generated 1345 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:40:20.409294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-714861d8-0239-42a3-8d0a-379a37fe293a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:20.410057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-714861d8-0239-42a3-8d0a-379a37fe293a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:20.422782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-714861d8-0239-42a3-8d0a-379a37fe293a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:20.428128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-714861d8-0239-42a3-8d0a-379a37fe293a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:20.428754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-714861d8-0239-42a3-8d0a-379a37fe293a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:20.429668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-714861d8-0239-42a3-8d0a-379a37fe293a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:20.430480 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-714861d8-0239-42a3-8d0a-379a37fe293a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:20.430730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-714861d8-0239-42a3-8d0a-379a37fe293a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:20.567339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9fc27b25-feaa-4e97-873e-cd46ae940d4c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:20.568239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9fc27b25-feaa-4e97-873e-cd46ae940d4c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:20.591839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fc27b25-feaa-4e97-873e-cd46ae940d4c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:20.592220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fc27b25-feaa-4e97-873e-cd46ae940d4c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:20.592651 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fc27b25-feaa-4e97-873e-cd46ae940d4c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:20.615950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fc27b25-feaa-4e97-873e-cd46ae940d4c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:20.621042 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fc27b25-feaa-4e97-873e-cd46ae940d4c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:20.624622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fc27b25-feaa-4e97-873e-cd46ae940d4c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:20.903801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-714861d8-0239-42a3-8d0a-379a37fe293a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:20.916249 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-714861d8-0239-42a3-8d0a-379a37fe293a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1504 microversion: 2.1 time: 0.512666 Aug 24 10:40:20.917767 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2743/5127] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:20 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1504 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:21.120587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-df54d474-b0d7-4480-9ea4-f5b125389a95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:21.122655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-df54d474-b0d7-4480-9ea4-f5b125389a95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:21.159089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df54d474-b0d7-4480-9ea4-f5b125389a95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:21.159764 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df54d474-b0d7-4480-9ea4-f5b125389a95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:21.161064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df54d474-b0d7-4480-9ea4-f5b125389a95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:21.184161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df54d474-b0d7-4480-9ea4-f5b125389a95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:21.186108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df54d474-b0d7-4480-9ea4-f5b125389a95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:21.187299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df54d474-b0d7-4480-9ea4-f5b125389a95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:21.583783 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9fc27b25-feaa-4e97-873e-cd46ae940d4c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:21.595791 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9fc27b25-feaa-4e97-873e-cd46ae940d4c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1488 microversion: 2.1 time: 1.035194 Aug 24 10:40:21.615934 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2385/5128] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:20 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1488 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:40:21.632036 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e3339501-6f53-4e4f-b448-30b199345362 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:21.639563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e3339501-6f53-4e4f-b448-30b199345362 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: e61a5d87-9af0-427b-8730-8c84899eda28] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:21.651613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3339501-6f53-4e4f-b448-30b199345362 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:21.654311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-df54d474-b0d7-4480-9ea4-f5b125389a95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:21.655632 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3339501-6f53-4e4f-b448-30b199345362 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:21.661165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3339501-6f53-4e4f-b448-30b199345362 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:21.662875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3339501-6f53-4e4f-b448-30b199345362 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:21.664003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3339501-6f53-4e4f-b448-30b199345362 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:21.667364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3339501-6f53-4e4f-b448-30b199345362 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:21.669952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-df54d474-b0d7-4480-9ea4-f5b125389a95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:21.671563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-df54d474-b0d7-4480-9ea4-f5b125389a95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:21.672904 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-df54d474-b0d7-4480-9ea4-f5b125389a95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1808 microversion: 2.20 time: 0.557269 Aug 24 10:40:21.705957 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2744/5129] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:40:21 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1808 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:40:21.721628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4204293e-5612-42b8-a418-ce5ef28960b9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1084539632"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:40:21.724538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4204293e-5612-42b8-a418-ce5ef28960b9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:21.761409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4204293e-5612-42b8-a418-ce5ef28960b9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:21.761960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4204293e-5612-42b8-a418-ce5ef28960b9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:21.762400 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4204293e-5612-42b8-a418-ce5ef28960b9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:21.763131 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4204293e-5612-42b8-a418-ce5ef28960b9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:21.763594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4204293e-5612-42b8-a418-ce5ef28960b9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:21.764000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4204293e-5612-42b8-a418-ce5ef28960b9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:21.982915 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e3339501-6f53-4e4f-b448-30b199345362 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28" status: 200 len: 1421 microversion: 2.1 time: 0.365014 Aug 24 10:40:21.988630 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2386/5130] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:21 2022] GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28 => generated 1421 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:22.026489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0cb3c188-f8e0-4b63-84b2-50d1b88a8426 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:22.027774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0cb3c188-f8e0-4b63-84b2-50d1b88a8426 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:22.033084 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4204293e-5612-42b8-a418-ce5ef28960b9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "PUT /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1074 microversion: 2.1 time: 0.324183 Aug 24 10:40:22.051926 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cb3c188-f8e0-4b63-84b2-50d1b88a8426 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:22.053849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cb3c188-f8e0-4b63-84b2-50d1b88a8426 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:22.055050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cb3c188-f8e0-4b63-84b2-50d1b88a8426 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:22.058278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cb3c188-f8e0-4b63-84b2-50d1b88a8426 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:22.060717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cb3c188-f8e0-4b63-84b2-50d1b88a8426 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:22.061493 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2745/5131] 10.222.0.85 () {60 vars in 1256 bytes} [Wed Aug 24 10:40:21 2022] PUT /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1074 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:22.061749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cb3c188-f8e0-4b63-84b2-50d1b88a8426 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:22.082900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9056ee2e-735e-4363-be2c-b57afaa05655 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:22.083539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9056ee2e-735e-4363-be2c-b57afaa05655 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:22.104456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9056ee2e-735e-4363-be2c-b57afaa05655 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:22.105612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9056ee2e-735e-4363-be2c-b57afaa05655 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:22.109510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9056ee2e-735e-4363-be2c-b57afaa05655 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:22.110901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9056ee2e-735e-4363-be2c-b57afaa05655 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:22.113215 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9056ee2e-735e-4363-be2c-b57afaa05655 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:22.121978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9056ee2e-735e-4363-be2c-b57afaa05655 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:22.206296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:22.565024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9056ee2e-735e-4363-be2c-b57afaa05655 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:22.590613 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9056ee2e-735e-4363-be2c-b57afaa05655 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1500 microversion: 2.1 time: 0.521549 Aug 24 10:40:22.623111 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2746/5132] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:22 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1500 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:40:22.640513 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-bb8b1e60-54f3-41bb-9c13-5184ca0ea7c9 req-6c98a296-72d2-4963-9bd7-aa223204e31a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5484349-8f24-4e16-9ab3-5ac504825bfd", "name": "network-vif-unplugged", "status": "completed", "tag": "9c4133d6-1151-4533-993d-a245cb9d286b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:40:22.693473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bb8b1e60-54f3-41bb-9c13-5184ca0ea7c9 req-6c98a296-72d2-4963-9bd7-aa223204e31a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:22.704564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bb8b1e60-54f3-41bb-9c13-5184ca0ea7c9 req-6c98a296-72d2-4963-9bd7-aa223204e31a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:22.707374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bb8b1e60-54f3-41bb-9c13-5184ca0ea7c9 req-6c98a296-72d2-4963-9bd7-aa223204e31a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:22.772040 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-bb8b1e60-54f3-41bb-9c13-5184ca0ea7c9 req-6c98a296-72d2-4963-9bd7-aa223204e31a service nova] Creating event network-vif-unplugged:9c4133d6-1151-4533-993d-a245cb9d286b for instance e5484349-8f24-4e16-9ab3-5ac504825bfd on n-h1-849328-3 Aug 24 10:40:22.799406 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-bb8b1e60-54f3-41bb-9c13-5184ca0ea7c9 req-6c98a296-72d2-4963-9bd7-aa223204e31a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.170330 Aug 24 10:40:22.803897 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2747/5133] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:40:22.825289 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5352c69f-812a-4c81-910c-ffcaceb63dfe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:22.833567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5352c69f-812a-4c81-910c-ffcaceb63dfe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:22.870478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5352c69f-812a-4c81-910c-ffcaceb63dfe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:22.871489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5352c69f-812a-4c81-910c-ffcaceb63dfe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:22.879469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5352c69f-812a-4c81-910c-ffcaceb63dfe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:22.880934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5352c69f-812a-4c81-910c-ffcaceb63dfe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:22.881583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5352c69f-812a-4c81-910c-ffcaceb63dfe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:22.882062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5352c69f-812a-4c81-910c-ffcaceb63dfe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:22.946500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0cb3c188-f8e0-4b63-84b2-50d1b88a8426 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:22.970492 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0cb3c188-f8e0-4b63-84b2-50d1b88a8426 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1504 microversion: 2.1 time: 0.962200 Aug 24 10:40:22.971112 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2387/5134] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:22 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1504 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:22.976382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6ca9fa67-8176-4349-8435-bc656b3a81cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:22.986542 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6ca9fa67-8176-4349-8435-bc656b3a81cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:23.002932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:23.007133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ca9fa67-8176-4349-8435-bc656b3a81cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:23.012631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ca9fa67-8176-4349-8435-bc656b3a81cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:23.014293 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ca9fa67-8176-4349-8435-bc656b3a81cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:23.018834 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ca9fa67-8176-4349-8435-bc656b3a81cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:23.023147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ca9fa67-8176-4349-8435-bc656b3a81cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:23.024043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ca9fa67-8176-4349-8435-bc656b3a81cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:23.257684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5352c69f-812a-4c81-910c-ffcaceb63dfe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:23.271552 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5352c69f-812a-4c81-910c-ffcaceb63dfe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1500 microversion: 2.1 time: 0.465765 Aug 24 10:40:23.272968 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2748/5135] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:22 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1500 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:23.278291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5736f9b8-8d97-4906-ba79-041fd814ee0d tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:23.279308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5736f9b8-8d97-4906-ba79-041fd814ee0d tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: e61a5d87-9af0-427b-8730-8c84899eda28] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:23.288150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5736f9b8-8d97-4906-ba79-041fd814ee0d tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:23.288919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5736f9b8-8d97-4906-ba79-041fd814ee0d tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:23.289544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5736f9b8-8d97-4906-ba79-041fd814ee0d tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:23.290498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5736f9b8-8d97-4906-ba79-041fd814ee0d tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:23.291779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5736f9b8-8d97-4906-ba79-041fd814ee0d tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:23.292649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5736f9b8-8d97-4906-ba79-041fd814ee0d tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:23.410022 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5736f9b8-8d97-4906-ba79-041fd814ee0d tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28" status: 200 len: 1421 microversion: 2.1 time: 0.135637 Aug 24 10:40:23.411509 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2749/5136] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:23 2022] GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28 => generated 1421 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:23.423067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-03681f57-531d-459d-9cbb-4de5eb403960 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:40:23.448868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03681f57-531d-459d-9cbb-4de5eb403960 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:23.449520 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03681f57-531d-459d-9cbb-4de5eb403960 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:23.450226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03681f57-531d-459d-9cbb-4de5eb403960 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:23.504029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-03681f57-531d-459d-9cbb-4de5eb403960 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Going to try to stop instance {{(pid=122433) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 10:40:23.599000 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-03681f57-531d-459d-9cbb-4de5eb403960 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "POST /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180/action" status: 202 len: 0 microversion: 2.1 time: 0.182661 Aug 24 10:40:23.599653 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2750/5137] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:40:23 2022] POST /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:40:23.614357 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-658f7f6c-62ea-497a-91ef-8040003effe1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:23.616281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-658f7f6c-62ea-497a-91ef-8040003effe1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:23.647411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-658f7f6c-62ea-497a-91ef-8040003effe1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:23.648581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-658f7f6c-62ea-497a-91ef-8040003effe1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:23.649622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-658f7f6c-62ea-497a-91ef-8040003effe1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:23.651052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-658f7f6c-62ea-497a-91ef-8040003effe1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:23.651814 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-658f7f6c-62ea-497a-91ef-8040003effe1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:23.652728 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-658f7f6c-62ea-497a-91ef-8040003effe1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:23.868360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-658f7f6c-62ea-497a-91ef-8040003effe1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:23.910262 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-658f7f6c-62ea-497a-91ef-8040003effe1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1510 microversion: 2.1 time: 0.293311 Aug 24 10:40:23.912574 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2751/5138] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:23 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1510 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:23.928191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4b956937-0f79-41fb-8c89-1062a77b638a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:23.929632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4b956937-0f79-41fb-8c89-1062a77b638a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: de1ab918-0344-414e-8ec8-139343022fa1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:23.949946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b956937-0f79-41fb-8c89-1062a77b638a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:23.960599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b956937-0f79-41fb-8c89-1062a77b638a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:23.967477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b956937-0f79-41fb-8c89-1062a77b638a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:23.970106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b956937-0f79-41fb-8c89-1062a77b638a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:23.973938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b956937-0f79-41fb-8c89-1062a77b638a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:23.975091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b956937-0f79-41fb-8c89-1062a77b638a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:24.058234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4b956937-0f79-41fb-8c89-1062a77b638a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: de1ab918-0344-414e-8ec8-139343022fa1] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:40:24.224836 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4b956937-0f79-41fb-8c89-1062a77b638a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "DELETE /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1" status: 204 len: 0 microversion: 2.1 time: 0.306178 Aug 24 10:40:24.227031 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2752/5139] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:40:23 2022] DELETE /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:40:24.237930 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b95f5617-d6a7-45d7-baf5-531bccba8ff9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:24.242452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b95f5617-d6a7-45d7-baf5-531bccba8ff9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:24.255470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b95f5617-d6a7-45d7-baf5-531bccba8ff9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:24.255977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b95f5617-d6a7-45d7-baf5-531bccba8ff9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:24.256419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b95f5617-d6a7-45d7-baf5-531bccba8ff9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:24.259163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b95f5617-d6a7-45d7-baf5-531bccba8ff9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:24.259747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b95f5617-d6a7-45d7-baf5-531bccba8ff9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:24.261777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b95f5617-d6a7-45d7-baf5-531bccba8ff9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:24.304179 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:24.630818 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b95f5617-d6a7-45d7-baf5-531bccba8ff9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:24.645889 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6ca9fa67-8176-4349-8435-bc656b3a81cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:24.659050 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b95f5617-d6a7-45d7-baf5-531bccba8ff9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1504 microversion: 2.1 time: 0.425628 Aug 24 10:40:24.677186 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2753/5140] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:24 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1504 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:24.695773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d628af3e-3c48-43d8-8030-8d00ceb7996f tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:24.696367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d628af3e-3c48-43d8-8030-8d00ceb7996f tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: de1ab918-0344-414e-8ec8-139343022fa1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:24.707359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d628af3e-3c48-43d8-8030-8d00ceb7996f tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:24.707681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d628af3e-3c48-43d8-8030-8d00ceb7996f tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:24.708783 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d628af3e-3c48-43d8-8030-8d00ceb7996f tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:24.709542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d628af3e-3c48-43d8-8030-8d00ceb7996f tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:24.710002 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d628af3e-3c48-43d8-8030-8d00ceb7996f tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:24.710481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d628af3e-3c48-43d8-8030-8d00ceb7996f tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:24.713496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6ca9fa67-8176-4349-8435-bc656b3a81cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:24.730129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6ca9fa67-8176-4349-8435-bc656b3a81cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:24.731837 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6ca9fa67-8176-4349-8435-bc656b3a81cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1808 microversion: 2.20 time: 1.759585 Aug 24 10:40:24.734108 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2388/5141] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:40:22 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1808 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:40:24.749517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-79d37b3a-3bce-4d6c-a622-60ee3705f3f1 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:24.751127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-79d37b3a-3bce-4d6c-a622-60ee3705f3f1 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: e61a5d87-9af0-427b-8730-8c84899eda28] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:24.770725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79d37b3a-3bce-4d6c-a622-60ee3705f3f1 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:24.771245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79d37b3a-3bce-4d6c-a622-60ee3705f3f1 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:24.772795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79d37b3a-3bce-4d6c-a622-60ee3705f3f1 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:24.774448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79d37b3a-3bce-4d6c-a622-60ee3705f3f1 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:24.776478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79d37b3a-3bce-4d6c-a622-60ee3705f3f1 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:24.777890 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79d37b3a-3bce-4d6c-a622-60ee3705f3f1 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:25.120074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d628af3e-3c48-43d8-8030-8d00ceb7996f tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988cbd2509314aeaa9ad618e705894d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc5853f2c1c434f832d5ffc2f550bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:25.132389 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d628af3e-3c48-43d8-8030-8d00ceb7996f tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1" status: 200 len: 1513 microversion: 2.1 time: 0.449540 Aug 24 10:40:25.135857 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2754/5142] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:24 2022] GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1 => generated 1513 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:25.149674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec5c5c41-9ba0-42dc-8025-dd635e310986 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:25.152811 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ec5c5c41-9ba0-42dc-8025-dd635e310986 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:25.163700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec5c5c41-9ba0-42dc-8025-dd635e310986 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:25.164470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec5c5c41-9ba0-42dc-8025-dd635e310986 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:25.165045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec5c5c41-9ba0-42dc-8025-dd635e310986 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:25.165886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec5c5c41-9ba0-42dc-8025-dd635e310986 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:25.166330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec5c5c41-9ba0-42dc-8025-dd635e310986 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:25.166749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec5c5c41-9ba0-42dc-8025-dd635e310986 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:25.215721 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-79d37b3a-3bce-4d6c-a622-60ee3705f3f1 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28" status: 200 len: 1463 microversion: 2.1 time: 0.477295 Aug 24 10:40:25.216349 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2389/5143] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:24 2022] GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28 => generated 1463 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:25.543532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ec5c5c41-9ba0-42dc-8025-dd635e310986 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:25.565274 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ec5c5c41-9ba0-42dc-8025-dd635e310986 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1510 microversion: 2.1 time: 0.427373 Aug 24 10:40:25.582608 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2755/5144] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:25 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1510 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:25.695180 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-00b6a0e3-faac-43cb-af3a-f70c88a10c9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:25.695889 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-00b6a0e3-faac-43cb-af3a-f70c88a10c9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:25.718464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b6a0e3-faac-43cb-af3a-f70c88a10c9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:25.718464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b6a0e3-faac-43cb-af3a-f70c88a10c9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:25.718880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b6a0e3-faac-43cb-af3a-f70c88a10c9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:25.719509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b6a0e3-faac-43cb-af3a-f70c88a10c9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:25.720202 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b6a0e3-faac-43cb-af3a-f70c88a10c9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:25.720877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b6a0e3-faac-43cb-af3a-f70c88a10c9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:25.756933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-81faf6fd-381c-44e8-b9e1-2ae513ea093c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:25.757853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-81faf6fd-381c-44e8-b9e1-2ae513ea093c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:25.765202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81faf6fd-381c-44e8-b9e1-2ae513ea093c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:25.765911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81faf6fd-381c-44e8-b9e1-2ae513ea093c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:25.766512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81faf6fd-381c-44e8-b9e1-2ae513ea093c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:25.767380 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81faf6fd-381c-44e8-b9e1-2ae513ea093c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:25.767810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81faf6fd-381c-44e8-b9e1-2ae513ea093c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:25.768219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81faf6fd-381c-44e8-b9e1-2ae513ea093c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:25.946611 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-00b6a0e3-faac-43cb-af3a-f70c88a10c9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:25.955701 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-00b6a0e3-faac-43cb-af3a-f70c88a10c9b tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1504 microversion: 2.1 time: 0.276406 Aug 24 10:40:25.956912 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2390/5145] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:25 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1504 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:26.127162 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-81faf6fd-381c-44e8-b9e1-2ae513ea093c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:26.138370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-81faf6fd-381c-44e8-b9e1-2ae513ea093c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:26.140483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-81faf6fd-381c-44e8-b9e1-2ae513ea093c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:26.142584 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-81faf6fd-381c-44e8-b9e1-2ae513ea093c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1808 microversion: 2.20 time: 0.390235 Aug 24 10:40:26.154286 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2756/5146] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:40:25 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1808 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:40:26.180590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-025c7366-64e1-40d6-a1f8-3b1c6c495727 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:26.182640 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-025c7366-64e1-40d6-a1f8-3b1c6c495727 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: de1ab918-0344-414e-8ec8-139343022fa1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:26.192208 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025c7366-64e1-40d6-a1f8-3b1c6c495727 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:26.194291 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025c7366-64e1-40d6-a1f8-3b1c6c495727 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:26.195488 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025c7366-64e1-40d6-a1f8-3b1c6c495727 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:26.197368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025c7366-64e1-40d6-a1f8-3b1c6c495727 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:26.198733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025c7366-64e1-40d6-a1f8-3b1c6c495727 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:26.199782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025c7366-64e1-40d6-a1f8-3b1c6c495727 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:26.246246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a4b4f5d6-5ab2-4008-92e4-063473e2d1e9 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:26.247161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a4b4f5d6-5ab2-4008-92e4-063473e2d1e9 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: e61a5d87-9af0-427b-8730-8c84899eda28] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:26.254910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4b4f5d6-5ab2-4008-92e4-063473e2d1e9 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:26.257951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4b4f5d6-5ab2-4008-92e4-063473e2d1e9 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:26.258464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4b4f5d6-5ab2-4008-92e4-063473e2d1e9 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:26.259255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4b4f5d6-5ab2-4008-92e4-063473e2d1e9 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:26.259787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4b4f5d6-5ab2-4008-92e4-063473e2d1e9 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:26.260270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4b4f5d6-5ab2-4008-92e4-063473e2d1e9 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:26.701046 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a4b4f5d6-5ab2-4008-92e4-063473e2d1e9 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28" status: 200 len: 1463 microversion: 2.1 time: 0.458396 Aug 24 10:40:26.713712 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2757/5147] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:26 2022] GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28 => generated 1463 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:26.722838 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec4b401a-e8a9-4e30-84fc-3c9fe5c77713 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:26.725420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ec4b401a-e8a9-4e30-84fc-3c9fe5c77713 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:26.743025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec4b401a-e8a9-4e30-84fc-3c9fe5c77713 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:26.743589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-025c7366-64e1-40d6-a1f8-3b1c6c495727 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988cbd2509314aeaa9ad618e705894d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc5853f2c1c434f832d5ffc2f550bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:26.745479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec4b401a-e8a9-4e30-84fc-3c9fe5c77713 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:26.747713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec4b401a-e8a9-4e30-84fc-3c9fe5c77713 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:26.748615 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec4b401a-e8a9-4e30-84fc-3c9fe5c77713 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:26.750953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec4b401a-e8a9-4e30-84fc-3c9fe5c77713 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:26.752079 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec4b401a-e8a9-4e30-84fc-3c9fe5c77713 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:26.763251 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-025c7366-64e1-40d6-a1f8-3b1c6c495727 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1" status: 200 len: 1513 microversion: 2.1 time: 0.587348 Aug 24 10:40:26.764862 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2391/5148] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:26 2022] GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1 => generated 1513 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:26.981713 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e03fdbd7-9ffa-4b47-8954-f32770d6f868 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:26.982764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e03fdbd7-9ffa-4b47-8954-f32770d6f868 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:26.991214 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e03fdbd7-9ffa-4b47-8954-f32770d6f868 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:26.992246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e03fdbd7-9ffa-4b47-8954-f32770d6f868 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:26.992891 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e03fdbd7-9ffa-4b47-8954-f32770d6f868 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:26.993864 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e03fdbd7-9ffa-4b47-8954-f32770d6f868 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:26.994867 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e03fdbd7-9ffa-4b47-8954-f32770d6f868 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:26.995496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e03fdbd7-9ffa-4b47-8954-f32770d6f868 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:27.243775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ec4b401a-e8a9-4e30-84fc-3c9fe5c77713 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:27.252082 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ec4b401a-e8a9-4e30-84fc-3c9fe5c77713 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1510 microversion: 2.1 time: 0.537190 Aug 24 10:40:27.265617 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2758/5149] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:26 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1510 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:27.271754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-29a5d7d7-e06e-487b-a706-d219fb1f4d4f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:27.272718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-29a5d7d7-e06e-487b-a706-d219fb1f4d4f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:27.282138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29a5d7d7-e06e-487b-a706-d219fb1f4d4f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:27.282896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29a5d7d7-e06e-487b-a706-d219fb1f4d4f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:27.283536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29a5d7d7-e06e-487b-a706-d219fb1f4d4f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:27.284443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29a5d7d7-e06e-487b-a706-d219fb1f4d4f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:27.285146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29a5d7d7-e06e-487b-a706-d219fb1f4d4f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:27.285802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29a5d7d7-e06e-487b-a706-d219fb1f4d4f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:27.619123 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e03fdbd7-9ffa-4b47-8954-f32770d6f868 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:27.641203 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e03fdbd7-9ffa-4b47-8954-f32770d6f868 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 200 len: 1447 microversion: 2.1 time: 0.665294 Aug 24 10:40:27.643299 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2392/5150] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:26 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 1447 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:40:27.680852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-46d28fd1-5e4d-4bbd-8c9e-4ce456112267 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:27.686590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-46d28fd1-5e4d-4bbd-8c9e-4ce456112267 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:27.695330 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46d28fd1-5e4d-4bbd-8c9e-4ce456112267 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:27.696132 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46d28fd1-5e4d-4bbd-8c9e-4ce456112267 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:27.696815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46d28fd1-5e4d-4bbd-8c9e-4ce456112267 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:27.697847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46d28fd1-5e4d-4bbd-8c9e-4ce456112267 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:27.698569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46d28fd1-5e4d-4bbd-8c9e-4ce456112267 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:27.699309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46d28fd1-5e4d-4bbd-8c9e-4ce456112267 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:27.772773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:27.947747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-29a5d7d7-e06e-487b-a706-d219fb1f4d4f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:27.960921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-29a5d7d7-e06e-487b-a706-d219fb1f4d4f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:27.962768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-29a5d7d7-e06e-487b-a706-d219fb1f4d4f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:27.965169 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-29a5d7d7-e06e-487b-a706-d219fb1f4d4f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1808 microversion: 2.20 time: 0.697151 Aug 24 10:40:27.966420 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2759/5151] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:40:27 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1808 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:40:27.986001 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2ee25f70-322e-4880-88ea-1ab2575c4763 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:27.987243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2ee25f70-322e-4880-88ea-1ab2575c4763 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: e61a5d87-9af0-427b-8730-8c84899eda28] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:27.995800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ee25f70-322e-4880-88ea-1ab2575c4763 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:27.996582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ee25f70-322e-4880-88ea-1ab2575c4763 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:28.000570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ee25f70-322e-4880-88ea-1ab2575c4763 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:28.002914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ee25f70-322e-4880-88ea-1ab2575c4763 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:28.003550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ee25f70-322e-4880-88ea-1ab2575c4763 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:28.004139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ee25f70-322e-4880-88ea-1ab2575c4763 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:28.154944 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-46d28fd1-5e4d-4bbd-8c9e-4ce456112267 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:28.174502 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-46d28fd1-5e4d-4bbd-8c9e-4ce456112267 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.508162 Aug 24 10:40:28.189607 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2393/5152] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:27 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:28.199345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dbb685e1-283a-4fd1-879c-d24a056ecaa4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:28.199970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dbb685e1-283a-4fd1-879c-d24a056ecaa4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: de1ab918-0344-414e-8ec8-139343022fa1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:28.206902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbb685e1-283a-4fd1-879c-d24a056ecaa4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:28.207694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbb685e1-283a-4fd1-879c-d24a056ecaa4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:28.208300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbb685e1-283a-4fd1-879c-d24a056ecaa4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:28.209192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbb685e1-283a-4fd1-879c-d24a056ecaa4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:28.209791 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbb685e1-283a-4fd1-879c-d24a056ecaa4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:28.210365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbb685e1-283a-4fd1-879c-d24a056ecaa4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:28.359752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dbb685e1-283a-4fd1-879c-d24a056ecaa4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988cbd2509314aeaa9ad618e705894d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc5853f2c1c434f832d5ffc2f550bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:28.368676 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dbb685e1-283a-4fd1-879c-d24a056ecaa4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1" status: 200 len: 1471 microversion: 2.1 time: 0.177459 Aug 24 10:40:28.370073 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2394/5153] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:28 2022] GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1 => generated 1471 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:28.376445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-143211d9-8f8e-41e0-95ab-e9b9e9f33322 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:28.377398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-143211d9-8f8e-41e0-95ab-e9b9e9f33322 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:28.384496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-143211d9-8f8e-41e0-95ab-e9b9e9f33322 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:28.385698 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-143211d9-8f8e-41e0-95ab-e9b9e9f33322 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:28.386279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-143211d9-8f8e-41e0-95ab-e9b9e9f33322 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:28.387362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-143211d9-8f8e-41e0-95ab-e9b9e9f33322 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:28.388119 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-143211d9-8f8e-41e0-95ab-e9b9e9f33322 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:28.389511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-143211d9-8f8e-41e0-95ab-e9b9e9f33322 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:28.555605 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2ee25f70-322e-4880-88ea-1ab2575c4763 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28" status: 200 len: 1463 microversion: 2.1 time: 0.587677 Aug 24 10:40:28.565828 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2760/5154] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:27 2022] GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28 => generated 1463 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:28.570916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-4259894b-c8b8-495d-a9bb-37c74181ad2a req-f1099d7d-8be2-4ca7-9296-8949c0dda593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de1ab918-0344-414e-8ec8-139343022fa1", "name": "network-vif-deleted", "tag": "94eb86ab-0bc1-4465-8b9b-9bfe7e51867f"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:40:28.588706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4259894b-c8b8-495d-a9bb-37c74181ad2a req-f1099d7d-8be2-4ca7-9296-8949c0dda593 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:28.589637 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4259894b-c8b8-495d-a9bb-37c74181ad2a req-f1099d7d-8be2-4ca7-9296-8949c0dda593 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:28.590292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4259894b-c8b8-495d-a9bb-37c74181ad2a req-f1099d7d-8be2-4ca7-9296-8949c0dda593 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:28.606478 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-4259894b-c8b8-495d-a9bb-37c74181ad2a req-f1099d7d-8be2-4ca7-9296-8949c0dda593 service nova] Creating event network-vif-deleted:94eb86ab-0bc1-4465-8b9b-9bfe7e51867f for instance de1ab918-0344-414e-8ec8-139343022fa1 on n-h1-849328-3 Aug 24 10:40:28.613211 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-4259894b-c8b8-495d-a9bb-37c74181ad2a req-f1099d7d-8be2-4ca7-9296-8949c0dda593 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045552 Aug 24 10:40:28.614015 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2761/5155] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:40:28.622284 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cc270c42-7f3e-4259-af20-b0d798594958 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:28.622994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cc270c42-7f3e-4259-af20-b0d798594958 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:28.630288 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc270c42-7f3e-4259-af20-b0d798594958 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:28.630935 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc270c42-7f3e-4259-af20-b0d798594958 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:28.631381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc270c42-7f3e-4259-af20-b0d798594958 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:28.632090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc270c42-7f3e-4259-af20-b0d798594958 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:28.632546 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc270c42-7f3e-4259-af20-b0d798594958 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:28.632973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc270c42-7f3e-4259-af20-b0d798594958 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:28.733148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-143211d9-8f8e-41e0-95ab-e9b9e9f33322 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:28.751861 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-143211d9-8f8e-41e0-95ab-e9b9e9f33322 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.377360 Aug 24 10:40:28.753497 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2395/5156] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:28 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:28.771653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0a61b623-b5ae-402a-94a4-fe2298272585 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:28.772439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0a61b623-b5ae-402a-94a4-fe2298272585 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:28.789757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a61b623-b5ae-402a-94a4-fe2298272585 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:28.790264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a61b623-b5ae-402a-94a4-fe2298272585 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:28.790713 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a61b623-b5ae-402a-94a4-fe2298272585 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:28.791445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a61b623-b5ae-402a-94a4-fe2298272585 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:28.791881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a61b623-b5ae-402a-94a4-fe2298272585 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:28.792584 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a61b623-b5ae-402a-94a4-fe2298272585 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:28.792743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:28.922011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cc270c42-7f3e-4259-af20-b0d798594958 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:28.934422 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cc270c42-7f3e-4259-af20-b0d798594958 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1510 microversion: 2.1 time: 0.319012 Aug 24 10:40:28.936108 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2762/5157] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:28 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1510 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:28.996482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8c4f837a-2fb6-4e97-be66-57cab8452cf5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:28.996482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8c4f837a-2fb6-4e97-be66-57cab8452cf5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:29.021362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c4f837a-2fb6-4e97-be66-57cab8452cf5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:29.022500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c4f837a-2fb6-4e97-be66-57cab8452cf5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:29.023230 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c4f837a-2fb6-4e97-be66-57cab8452cf5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:29.024503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c4f837a-2fb6-4e97-be66-57cab8452cf5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:29.025583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c4f837a-2fb6-4e97-be66-57cab8452cf5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:29.027325 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c4f837a-2fb6-4e97-be66-57cab8452cf5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:29.555173 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8c4f837a-2fb6-4e97-be66-57cab8452cf5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:29.570894 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8c4f837a-2fb6-4e97-be66-57cab8452cf5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:29.572614 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8c4f837a-2fb6-4e97-be66-57cab8452cf5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:29.574226 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8c4f837a-2fb6-4e97-be66-57cab8452cf5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1808 microversion: 2.20 time: 0.584222 Aug 24 10:40:29.575278 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2763/5158] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:40:28 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1808 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:40:29.581316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b0a0cea4-1357-400c-a663-01c27a9c4612 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:29.583162 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b0a0cea4-1357-400c-a663-01c27a9c4612 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: de1ab918-0344-414e-8ec8-139343022fa1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:29.590956 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0a0cea4-1357-400c-a663-01c27a9c4612 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:29.591673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0a0cea4-1357-400c-a663-01c27a9c4612 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:29.592930 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0a0cea4-1357-400c-a663-01c27a9c4612 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:29.593827 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0a0cea4-1357-400c-a663-01c27a9c4612 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:29.594569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0a0cea4-1357-400c-a663-01c27a9c4612 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:29.595424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0a0cea4-1357-400c-a663-01c27a9c4612 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:29.622827 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-b0a0cea4-1357-400c-a663-01c27a9c4612 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] HTTP exception thrown: Instance de1ab918-0344-414e-8ec8-139343022fa1 could not be found. Aug 24 10:40:29.623741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0a61b623-b5ae-402a-94a4-fe2298272585 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b0a0cea4-1357-400c-a663-01c27a9c4612 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Request method failure captured: Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1 HTTP/1.1 Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf8jsOlnM7uC0sIeo9FLRTeum-IRnNRtp8kINLlJyrlJK4SpRX2fxGYgo5GriEVI0D2OAyMbW2YX71INdqrYyIQvwhEDWl0L-brWsKIvmEQMJ7Lbsytl4u0E-vUbPdd0oxoCtzAF9173p03YaQ890UAErKOJddd3G-zPivwkTgn_3fw Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 2dc5853f2c1c434f832d5ffc2f550bf6 Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-VolumesSnapshotTestJSON-353491327 Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2dc5853f2c1c434f832d5ffc2f550bf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_2dc5853f2c1c434f832d5ffc2f550bf6", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2dc5853f2c1c434f832d5ffc2f550bf6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/2dc5853f2c1c434f832d5ffc2f550bf6"}]}] Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-VolumesSnapshotTestJSON-353491327 Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 2dc5853f2c1c434f832d5ffc2f550bf6 Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-353491327 Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-VolumesSnapshotTestJSON-353491327-project Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 988cbd2509314aeaa9ad618e705894d3 Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-VolumesSnapshotTestJSON-353491327-project Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance de1ab918-0344-414e-8ec8-139343022fa1 could not be found. Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'de1ab918-0344-414e-8ec8-139343022fa1'} Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de1ab918-0344-414e-8ec8-139343022fa1 could not be found. Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de1ab918-0344-414e-8ec8-139343022fa1 could not be found. Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:40:29.625563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:40:29.629894 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:40:29.629894 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:40:29.629894 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:40:29.629894 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:40:29.629894 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:40:29.629894 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de1ab918-0344-414e-8ec8-139343022fa1 could not be found. Aug 24 10:40:29.629894 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:40:29.631432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b0a0cea4-1357-400c-a663-01c27a9c4612 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Returning 404 to user: Instance de1ab918-0344-414e-8ec8-139343022fa1 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:40:29.631966 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0a61b623-b5ae-402a-94a4-fe2298272585 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.864197 Aug 24 10:40:29.633190 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b0a0cea4-1357-400c-a663-01c27a9c4612 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1" status: 404 len: 111 microversion: 2.1 time: 0.056332 Aug 24 10:40:29.634058 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2764/5159] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:29 2022] GET /compute/v2.1/servers/de1ab918-0344-414e-8ec8-139343022fa1 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:40:29.637816 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2396/5160] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:28 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:40:29.641374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9deb65e8-58c4-4299-93f4-c57ec484a942 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:29.642243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9deb65e8-58c4-4299-93f4-c57ec484a942 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: e61a5d87-9af0-427b-8730-8c84899eda28] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:29.652669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9deb65e8-58c4-4299-93f4-c57ec484a942 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:29.653372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9deb65e8-58c4-4299-93f4-c57ec484a942 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:29.654160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9deb65e8-58c4-4299-93f4-c57ec484a942 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:29.655454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9deb65e8-58c4-4299-93f4-c57ec484a942 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:29.656125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9deb65e8-58c4-4299-93f4-c57ec484a942 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:29.656686 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9deb65e8-58c4-4299-93f4-c57ec484a942 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:29.679397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-18d07d5d-9e93-4454-9861-c2309b4bbb5c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:29.680716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-18d07d5d-9e93-4454-9861-c2309b4bbb5c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:29.689417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18d07d5d-9e93-4454-9861-c2309b4bbb5c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:29.690310 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18d07d5d-9e93-4454-9861-c2309b4bbb5c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:29.690901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18d07d5d-9e93-4454-9861-c2309b4bbb5c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:29.691769 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18d07d5d-9e93-4454-9861-c2309b4bbb5c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:29.692373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18d07d5d-9e93-4454-9861-c2309b4bbb5c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:29.693067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18d07d5d-9e93-4454-9861-c2309b4bbb5c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:29.918057 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9deb65e8-58c4-4299-93f4-c57ec484a942 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28" status: 200 len: 1463 microversion: 2.1 time: 0.260213 Aug 24 10:40:29.918763 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2765/5161] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:29 2022] GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28 => generated 1463 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:29.961277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cbf0cd9f-c795-4615-bac6-27a2d64ee9b6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:29.961939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cbf0cd9f-c795-4615-bac6-27a2d64ee9b6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:29.982232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbf0cd9f-c795-4615-bac6-27a2d64ee9b6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:29.982688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbf0cd9f-c795-4615-bac6-27a2d64ee9b6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:29.983133 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbf0cd9f-c795-4615-bac6-27a2d64ee9b6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:29.995445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbf0cd9f-c795-4615-bac6-27a2d64ee9b6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:29.996596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbf0cd9f-c795-4615-bac6-27a2d64ee9b6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:29.997421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbf0cd9f-c795-4615-bac6-27a2d64ee9b6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:30.027962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-18d07d5d-9e93-4454-9861-c2309b4bbb5c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:30.045520 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-18d07d5d-9e93-4454-9861-c2309b4bbb5c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.388800 Aug 24 10:40:30.046889 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2397/5162] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:29 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:30.070666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c6dbe617-537a-4393-b3d3-ed83c329843e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:40:30.088007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6dbe617-537a-4393-b3d3-ed83c329843e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:30.090251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6dbe617-537a-4393-b3d3-ed83c329843e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:30.090704 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6dbe617-537a-4393-b3d3-ed83c329843e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:30.164492 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c6dbe617-537a-4393-b3d3-ed83c329843e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Going to try to stop instance {{(pid=122432) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 10:40:30.272310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cbf0cd9f-c795-4615-bac6-27a2d64ee9b6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:30.275751 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c6dbe617-537a-4393-b3d3-ed83c329843e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action" status: 202 len: 0 microversion: 2.1 time: 0.209234 Aug 24 10:40:30.276731 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2398/5163] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:40:30 2022] POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 10:40:30.280798 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cbf0cd9f-c795-4615-bac6-27a2d64ee9b6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1510 microversion: 2.1 time: 0.323909 Aug 24 10:40:30.286290 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2766/5164] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:29 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1510 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:40:30.290601 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e4ee0393-14c8-4794-be17-95a0043bce30 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:30.291602 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e4ee0393-14c8-4794-be17-95a0043bce30 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:30.298939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4ee0393-14c8-4794-be17-95a0043bce30 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:30.300186 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4ee0393-14c8-4794-be17-95a0043bce30 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:30.301341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4ee0393-14c8-4794-be17-95a0043bce30 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:30.302216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4ee0393-14c8-4794-be17-95a0043bce30 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:30.303077 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4ee0393-14c8-4794-be17-95a0043bce30 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:30.303628 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4ee0393-14c8-4794-be17-95a0043bce30 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:30.515147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e4ee0393-14c8-4794-be17-95a0043bce30 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:30.523901 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e4ee0393-14c8-4794-be17-95a0043bce30 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1679 microversion: 2.1 time: 0.241581 Aug 24 10:40:30.525375 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2399/5165] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:30 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1679 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:30.598464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-76d090ff-cf0d-4c28-8898-e5ac98e0361c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:30.599093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-76d090ff-cf0d-4c28-8898-e5ac98e0361c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:30.614704 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76d090ff-cf0d-4c28-8898-e5ac98e0361c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:30.615293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76d090ff-cf0d-4c28-8898-e5ac98e0361c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:30.615743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76d090ff-cf0d-4c28-8898-e5ac98e0361c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:30.617321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76d090ff-cf0d-4c28-8898-e5ac98e0361c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:30.617321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76d090ff-cf0d-4c28-8898-e5ac98e0361c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:30.619804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76d090ff-cf0d-4c28-8898-e5ac98e0361c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:30.677210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-b066ef96-a9fe-45e3-8006-f709ead0c2bb req-46374415-509f-46e4-a21f-47f7b37f765d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e61a5d87-9af0-427b-8730-8c84899eda28", "tag": "2b10b994-e2ff-4cf9-96b6-1d4a0de260ad"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:40:30.700533 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b066ef96-a9fe-45e3-8006-f709ead0c2bb req-46374415-509f-46e4-a21f-47f7b37f765d service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:30.703101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b066ef96-a9fe-45e3-8006-f709ead0c2bb req-46374415-509f-46e4-a21f-47f7b37f765d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:30.706917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b066ef96-a9fe-45e3-8006-f709ead0c2bb req-46374415-509f-46e4-a21f-47f7b37f765d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:30.734385 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b066ef96-a9fe-45e3-8006-f709ead0c2bb req-46374415-509f-46e4-a21f-47f7b37f765d service nova] Creating event network-changed:2b10b994-e2ff-4cf9-96b6-1d4a0de260ad for instance e61a5d87-9af0-427b-8730-8c84899eda28 on n-h1-849328-3 Aug 24 10:40:30.744624 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-b066ef96-a9fe-45e3-8006-f709ead0c2bb req-46374415-509f-46e4-a21f-47f7b37f765d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071335 Aug 24 10:40:30.745556 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2400/5166] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:40:30.843833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-76d090ff-cf0d-4c28-8898-e5ac98e0361c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:30.869846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-76d090ff-cf0d-4c28-8898-e5ac98e0361c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:30.871405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-76d090ff-cf0d-4c28-8898-e5ac98e0361c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:30.872880 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-76d090ff-cf0d-4c28-8898-e5ac98e0361c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1808 microversion: 2.20 time: 0.278913 Aug 24 10:40:30.890105 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2767/5167] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:40:30 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1808 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:40:30.939965 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e44dfae8-04a1-484f-8645-f11bf9464949 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:30.963070 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e44dfae8-04a1-484f-8645-f11bf9464949 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: e61a5d87-9af0-427b-8730-8c84899eda28] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:30.980320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e44dfae8-04a1-484f-8645-f11bf9464949 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:30.981059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e44dfae8-04a1-484f-8645-f11bf9464949 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:30.987391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e44dfae8-04a1-484f-8645-f11bf9464949 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:30.988273 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e44dfae8-04a1-484f-8645-f11bf9464949 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:30.988864 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e44dfae8-04a1-484f-8645-f11bf9464949 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:30.989426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e44dfae8-04a1-484f-8645-f11bf9464949 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:31.314988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7ae61a6d-84cf-46c0-aaaa-922c2f16ec9f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:31.318287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7ae61a6d-84cf-46c0-aaaa-922c2f16ec9f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:31.333091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ae61a6d-84cf-46c0-aaaa-922c2f16ec9f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:31.334070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ae61a6d-84cf-46c0-aaaa-922c2f16ec9f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:31.334522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ae61a6d-84cf-46c0-aaaa-922c2f16ec9f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:31.335445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ae61a6d-84cf-46c0-aaaa-922c2f16ec9f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:31.346925 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ae61a6d-84cf-46c0-aaaa-922c2f16ec9f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:31.347709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ae61a6d-84cf-46c0-aaaa-922c2f16ec9f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:31.357715 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e44dfae8-04a1-484f-8645-f11bf9464949 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28" status: 200 len: 1463 microversion: 2.1 time: 0.414699 Aug 24 10:40:31.359380 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2401/5168] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:30 2022] GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28 => generated 1463 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:31.548647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e1422ea1-2225-4b9e-af45-38277329a436 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:31.550537 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e1422ea1-2225-4b9e-af45-38277329a436 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:31.568348 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1422ea1-2225-4b9e-af45-38277329a436 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:31.573204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1422ea1-2225-4b9e-af45-38277329a436 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:31.577533 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1422ea1-2225-4b9e-af45-38277329a436 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:31.579193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1422ea1-2225-4b9e-af45-38277329a436 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:31.580782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1422ea1-2225-4b9e-af45-38277329a436 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:31.585412 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1422ea1-2225-4b9e-af45-38277329a436 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:31.658491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7ae61a6d-84cf-46c0-aaaa-922c2f16ec9f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:31.674401 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7ae61a6d-84cf-46c0-aaaa-922c2f16ec9f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1510 microversion: 2.1 time: 0.364918 Aug 24 10:40:31.689148 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2768/5169] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:31 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1510 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:31.898671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-99233e96-3076-4803-8586-3894b6eef55d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:31.899622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-99233e96-3076-4803-8586-3894b6eef55d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:31.913792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99233e96-3076-4803-8586-3894b6eef55d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:31.917885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99233e96-3076-4803-8586-3894b6eef55d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:31.919278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99233e96-3076-4803-8586-3894b6eef55d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:31.921082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99233e96-3076-4803-8586-3894b6eef55d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:31.923405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99233e96-3076-4803-8586-3894b6eef55d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:31.939633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99233e96-3076-4803-8586-3894b6eef55d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:32.263517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e1422ea1-2225-4b9e-af45-38277329a436 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:32.308277 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e1422ea1-2225-4b9e-af45-38277329a436 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1679 microversion: 2.1 time: 0.765830 Aug 24 10:40:32.309758 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2402/5170] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:31 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1679 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:40:32.456505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-747bf938-db6f-44e4-9364-a78d9ee63695 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:32.456505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-747bf938-db6f-44e4-9364-a78d9ee63695 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: e61a5d87-9af0-427b-8730-8c84899eda28] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:32.464206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-99233e96-3076-4803-8586-3894b6eef55d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:32.507514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-99233e96-3076-4803-8586-3894b6eef55d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:32.509623 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-747bf938-db6f-44e4-9364-a78d9ee63695 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:32.519148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-747bf938-db6f-44e4-9364-a78d9ee63695 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:32.522367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-99233e96-3076-4803-8586-3894b6eef55d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:32.526466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-747bf938-db6f-44e4-9364-a78d9ee63695 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:32.532673 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-747bf938-db6f-44e4-9364-a78d9ee63695 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:32.533804 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-99233e96-3076-4803-8586-3894b6eef55d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1808 microversion: 2.20 time: 0.639285 Aug 24 10:40:32.537536 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2769/5171] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:40:31 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1808 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:40:32.537907 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-747bf938-db6f-44e4-9364-a78d9ee63695 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:32.538595 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-747bf938-db6f-44e4-9364-a78d9ee63695 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:32.709967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d4081fd9-ddc4-486f-9d3e-2bf61ba3262c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:32.710597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d4081fd9-ddc4-486f-9d3e-2bf61ba3262c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:32.721025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4081fd9-ddc4-486f-9d3e-2bf61ba3262c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:32.722630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4081fd9-ddc4-486f-9d3e-2bf61ba3262c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:32.723086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4081fd9-ddc4-486f-9d3e-2bf61ba3262c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:32.723816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4081fd9-ddc4-486f-9d3e-2bf61ba3262c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:32.724280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4081fd9-ddc4-486f-9d3e-2bf61ba3262c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:32.724709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4081fd9-ddc4-486f-9d3e-2bf61ba3262c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:32.737973 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:32.757075 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-747bf938-db6f-44e4-9364-a78d9ee63695 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28" status: 200 len: 1463 microversion: 2.1 time: 0.360041 Aug 24 10:40:32.781891 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2403/5172] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:32 2022] GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28 => generated 1463 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:33.017606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d4081fd9-ddc4-486f-9d3e-2bf61ba3262c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:33.026308 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d4081fd9-ddc4-486f-9d3e-2bf61ba3262c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1510 microversion: 2.1 time: 0.321354 Aug 24 10:40:33.028707 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2770/5173] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:32 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1510 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:40:33.332254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5085041a-5d90-455f-8269-0d603c302d1f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:33.333499 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5085041a-5d90-455f-8269-0d603c302d1f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:33.340797 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5085041a-5d90-455f-8269-0d603c302d1f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:33.341612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5085041a-5d90-455f-8269-0d603c302d1f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:33.341927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5085041a-5d90-455f-8269-0d603c302d1f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:33.342778 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5085041a-5d90-455f-8269-0d603c302d1f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:33.343241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5085041a-5d90-455f-8269-0d603c302d1f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:33.343808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5085041a-5d90-455f-8269-0d603c302d1f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:33.564313 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7a3a6b9f-9e84-4697-ab7a-f6d92c7c21d7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:33.565605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7a3a6b9f-9e84-4697-ab7a-f6d92c7c21d7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:33.580548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a3a6b9f-9e84-4697-ab7a-f6d92c7c21d7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:33.582132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a3a6b9f-9e84-4697-ab7a-f6d92c7c21d7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:33.583217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a3a6b9f-9e84-4697-ab7a-f6d92c7c21d7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:33.584041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5085041a-5d90-455f-8269-0d603c302d1f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:33.585931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a3a6b9f-9e84-4697-ab7a-f6d92c7c21d7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:33.587645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a3a6b9f-9e84-4697-ab7a-f6d92c7c21d7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:33.588269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a3a6b9f-9e84-4697-ab7a-f6d92c7c21d7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:33.595118 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5085041a-5d90-455f-8269-0d603c302d1f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1679 microversion: 2.1 time: 0.267073 Aug 24 10:40:33.606131 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2404/5174] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:33 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1679 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:40:33.645960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:33.780516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a77f0dcc-1446-4133-9f82-7ce4b9a24d1e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:33.782496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a77f0dcc-1446-4133-9f82-7ce4b9a24d1e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: e61a5d87-9af0-427b-8730-8c84899eda28] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:33.796035 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a77f0dcc-1446-4133-9f82-7ce4b9a24d1e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:33.797475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a77f0dcc-1446-4133-9f82-7ce4b9a24d1e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:33.802806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a77f0dcc-1446-4133-9f82-7ce4b9a24d1e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:33.804221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a77f0dcc-1446-4133-9f82-7ce4b9a24d1e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:33.804857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a77f0dcc-1446-4133-9f82-7ce4b9a24d1e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:33.805537 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a77f0dcc-1446-4133-9f82-7ce4b9a24d1e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:33.823877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7a3a6b9f-9e84-4697-ab7a-f6d92c7c21d7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:33.850520 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7a3a6b9f-9e84-4697-ab7a-f6d92c7c21d7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:33.860985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7a3a6b9f-9e84-4697-ab7a-f6d92c7c21d7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:33.863070 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7a3a6b9f-9e84-4697-ab7a-f6d92c7c21d7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1808 microversion: 2.20 time: 0.303684 Aug 24 10:40:33.864055 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2771/5175] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:40:33 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1808 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:40:34.049459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-01eef5f7-2af7-4c8c-901c-e5a148ee8484 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:34.050222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-01eef5f7-2af7-4c8c-901c-e5a148ee8484 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:34.062747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01eef5f7-2af7-4c8c-901c-e5a148ee8484 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:34.063364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01eef5f7-2af7-4c8c-901c-e5a148ee8484 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:34.063878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01eef5f7-2af7-4c8c-901c-e5a148ee8484 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:34.073871 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a77f0dcc-1446-4133-9f82-7ce4b9a24d1e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28" status: 200 len: 1463 microversion: 2.1 time: 0.297592 Aug 24 10:40:34.074765 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2405/5176] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:33 2022] GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28 => generated 1463 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:40:34.082606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01eef5f7-2af7-4c8c-901c-e5a148ee8484 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:34.083357 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01eef5f7-2af7-4c8c-901c-e5a148ee8484 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:34.083985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01eef5f7-2af7-4c8c-901c-e5a148ee8484 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:34.291319 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-42bfff56-f935-4388-babf-68df7332d8c8 req-6b612687-f8d7-4d9e-8717-68f5dd44f971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e61a5d87-9af0-427b-8730-8c84899eda28", "name": "network-vif-plugged", "status": "completed", "tag": "2b10b994-e2ff-4cf9-96b6-1d4a0de260ad"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:40:34.303029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-01eef5f7-2af7-4c8c-901c-e5a148ee8484 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:34.316075 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-01eef5f7-2af7-4c8c-901c-e5a148ee8484 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1510 microversion: 2.1 time: 0.271665 Aug 24 10:40:34.317989 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2772/5177] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:34 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1510 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:40:34.319821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-42bfff56-f935-4388-babf-68df7332d8c8 req-6b612687-f8d7-4d9e-8717-68f5dd44f971 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:34.320497 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-42bfff56-f935-4388-babf-68df7332d8c8 req-6b612687-f8d7-4d9e-8717-68f5dd44f971 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:34.321334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-42bfff56-f935-4388-babf-68df7332d8c8 req-6b612687-f8d7-4d9e-8717-68f5dd44f971 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:34.336820 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-42bfff56-f935-4388-babf-68df7332d8c8 req-6b612687-f8d7-4d9e-8717-68f5dd44f971 service nova] Creating event network-vif-plugged:2b10b994-e2ff-4cf9-96b6-1d4a0de260ad for instance e61a5d87-9af0-427b-8730-8c84899eda28 on n-h1-849328-3 Aug 24 10:40:34.344301 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-42bfff56-f935-4388-babf-68df7332d8c8 req-6b612687-f8d7-4d9e-8717-68f5dd44f971 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057117 Aug 24 10:40:34.345066 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2406/5178] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:40:34.622199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-728ef2ea-fea7-4c2d-a7dd-3211240c8e14 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:34.622822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-728ef2ea-fea7-4c2d-a7dd-3211240c8e14 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:34.634014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-728ef2ea-fea7-4c2d-a7dd-3211240c8e14 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:34.634985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-728ef2ea-fea7-4c2d-a7dd-3211240c8e14 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:34.636904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-728ef2ea-fea7-4c2d-a7dd-3211240c8e14 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:34.637876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-728ef2ea-fea7-4c2d-a7dd-3211240c8e14 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:34.638418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-728ef2ea-fea7-4c2d-a7dd-3211240c8e14 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:34.638867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-728ef2ea-fea7-4c2d-a7dd-3211240c8e14 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:34.855914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-728ef2ea-fea7-4c2d-a7dd-3211240c8e14 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:34.868683 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-728ef2ea-fea7-4c2d-a7dd-3211240c8e14 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1679 microversion: 2.1 time: 0.250168 Aug 24 10:40:34.896968 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2773/5179] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:34 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1679 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:34.897580 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-000abd5d-142f-468e-adeb-bd25f678d552 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:34.898371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-000abd5d-142f-468e-adeb-bd25f678d552 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:34.907969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-000abd5d-142f-468e-adeb-bd25f678d552 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:34.909088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-000abd5d-142f-468e-adeb-bd25f678d552 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:34.910088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-000abd5d-142f-468e-adeb-bd25f678d552 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:34.911179 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-000abd5d-142f-468e-adeb-bd25f678d552 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:34.912428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-000abd5d-142f-468e-adeb-bd25f678d552 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:34.913634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-000abd5d-142f-468e-adeb-bd25f678d552 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:35.094962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4a9caef2-1edf-48de-8c94-445ff81584a3 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:35.095593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4a9caef2-1edf-48de-8c94-445ff81584a3 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: e61a5d87-9af0-427b-8730-8c84899eda28] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:35.115810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a9caef2-1edf-48de-8c94-445ff81584a3 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:35.116587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a9caef2-1edf-48de-8c94-445ff81584a3 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:35.117269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a9caef2-1edf-48de-8c94-445ff81584a3 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:35.118730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a9caef2-1edf-48de-8c94-445ff81584a3 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:35.118856 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a9caef2-1edf-48de-8c94-445ff81584a3 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:35.119258 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a9caef2-1edf-48de-8c94-445ff81584a3 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:35.198339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-000abd5d-142f-468e-adeb-bd25f678d552 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:35.198339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-000abd5d-142f-468e-adeb-bd25f678d552 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:35.198339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-000abd5d-142f-468e-adeb-bd25f678d552 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:35.198339 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-000abd5d-142f-468e-adeb-bd25f678d552 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1808 microversion: 2.20 time: 0.263491 Aug 24 10:40:35.198339 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2407/5180] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:40:34 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1808 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:40:35.271684 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4a9caef2-1edf-48de-8c94-445ff81584a3 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28" status: 200 len: 1463 microversion: 2.1 time: 0.180281 Aug 24 10:40:35.272401 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2774/5181] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:35 2022] GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28 => generated 1463 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:40:35.345703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df679760-6de9-43ad-9808-e11a750c70e3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:35.346529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-df679760-6de9-43ad-9808-e11a750c70e3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:35.357902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df679760-6de9-43ad-9808-e11a750c70e3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:35.359937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df679760-6de9-43ad-9808-e11a750c70e3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:35.360543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df679760-6de9-43ad-9808-e11a750c70e3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:35.362445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df679760-6de9-43ad-9808-e11a750c70e3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:35.362952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df679760-6de9-43ad-9808-e11a750c70e3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:35.363391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df679760-6de9-43ad-9808-e11a750c70e3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:35.715900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-df679760-6de9-43ad-9808-e11a750c70e3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:35.724829 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-df679760-6de9-43ad-9808-e11a750c70e3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1510 microversion: 2.1 time: 0.383372 Aug 24 10:40:35.725480 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2408/5182] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:35 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1510 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:35.895873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e46a3918-40c1-4e66-b578-c2e93b28ee2c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:35.897589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e46a3918-40c1-4e66-b578-c2e93b28ee2c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:35.918161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e46a3918-40c1-4e66-b578-c2e93b28ee2c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:35.922339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e46a3918-40c1-4e66-b578-c2e93b28ee2c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:35.923673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e46a3918-40c1-4e66-b578-c2e93b28ee2c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:35.928389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e46a3918-40c1-4e66-b578-c2e93b28ee2c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:35.929363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e46a3918-40c1-4e66-b578-c2e93b28ee2c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:35.930068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e46a3918-40c1-4e66-b578-c2e93b28ee2c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:36.219036 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3dd6761a-420b-43c6-93a6-703ae838a8a3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:36.219666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3dd6761a-420b-43c6-93a6-703ae838a8a3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:36.228812 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dd6761a-420b-43c6-93a6-703ae838a8a3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:36.229351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dd6761a-420b-43c6-93a6-703ae838a8a3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:36.229802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dd6761a-420b-43c6-93a6-703ae838a8a3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:36.230565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dd6761a-420b-43c6-93a6-703ae838a8a3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:36.231027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dd6761a-420b-43c6-93a6-703ae838a8a3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:36.231461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dd6761a-420b-43c6-93a6-703ae838a8a3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:36.259810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e46a3918-40c1-4e66-b578-c2e93b28ee2c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:36.278129 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e46a3918-40c1-4e66-b578-c2e93b28ee2c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1679 microversion: 2.1 time: 0.387289 Aug 24 10:40:36.293383 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2775/5183] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:35 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1679 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:36.302593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0a8c12e3-7d18-41e5-b45f-43afd08c9b68 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:36.303579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0a8c12e3-7d18-41e5-b45f-43afd08c9b68 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: e61a5d87-9af0-427b-8730-8c84899eda28] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:36.314089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a8c12e3-7d18-41e5-b45f-43afd08c9b68 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:36.314948 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a8c12e3-7d18-41e5-b45f-43afd08c9b68 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:36.316164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a8c12e3-7d18-41e5-b45f-43afd08c9b68 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:36.317239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a8c12e3-7d18-41e5-b45f-43afd08c9b68 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:36.317979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a8c12e3-7d18-41e5-b45f-43afd08c9b68 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:36.318560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a8c12e3-7d18-41e5-b45f-43afd08c9b68 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:36.514667 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3dd6761a-420b-43c6-93a6-703ae838a8a3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:36.535902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3dd6761a-420b-43c6-93a6-703ae838a8a3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:36.538921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3dd6761a-420b-43c6-93a6-703ae838a8a3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:36.540450 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3dd6761a-420b-43c6-93a6-703ae838a8a3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1808 microversion: 2.20 time: 0.325604 Aug 24 10:40:36.541046 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2409/5184] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:40:36 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1808 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:40:36.586261 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0a8c12e3-7d18-41e5-b45f-43afd08c9b68 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28" status: 200 len: 1647 microversion: 2.1 time: 0.291177 Aug 24 10:40:36.586914 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2776/5185] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:36 2022] GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28 => generated 1647 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:36.616525 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8e3ef6f1-28f9-49b2-9703-24f428285e2e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:36.617504 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8e3ef6f1-28f9-49b2-9703-24f428285e2e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: e61a5d87-9af0-427b-8730-8c84899eda28] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:36.629336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e3ef6f1-28f9-49b2-9703-24f428285e2e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:36.630015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e3ef6f1-28f9-49b2-9703-24f428285e2e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:36.630385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e3ef6f1-28f9-49b2-9703-24f428285e2e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:36.637313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e3ef6f1-28f9-49b2-9703-24f428285e2e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:36.638029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e3ef6f1-28f9-49b2-9703-24f428285e2e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:36.638501 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e3ef6f1-28f9-49b2-9703-24f428285e2e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:36.746320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2cb12529-164a-4ff1-86d8-69145b889706 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:36.747885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2cb12529-164a-4ff1-86d8-69145b889706 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:36.762310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:36.765816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cb12529-164a-4ff1-86d8-69145b889706 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:36.770093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cb12529-164a-4ff1-86d8-69145b889706 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:36.770913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cb12529-164a-4ff1-86d8-69145b889706 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:36.771941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cb12529-164a-4ff1-86d8-69145b889706 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:36.772751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cb12529-164a-4ff1-86d8-69145b889706 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:36.773418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cb12529-164a-4ff1-86d8-69145b889706 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:37.060188 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8e3ef6f1-28f9-49b2-9703-24f428285e2e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28" status: 200 len: 1647 microversion: 2.1 time: 0.444990 Aug 24 10:40:37.073787 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2410/5186] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:36 2022] GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28 => generated 1647 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:37.087581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3b02c324-87ff-406b-9c64-c1d715c282d7 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:37.094577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3b02c324-87ff-406b-9c64-c1d715c282d7 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: e61a5d87-9af0-427b-8730-8c84899eda28] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:37.106158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b02c324-87ff-406b-9c64-c1d715c282d7 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:37.107260 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b02c324-87ff-406b-9c64-c1d715c282d7 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:37.112396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b02c324-87ff-406b-9c64-c1d715c282d7 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:37.113427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b02c324-87ff-406b-9c64-c1d715c282d7 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:37.114354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b02c324-87ff-406b-9c64-c1d715c282d7 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:37.114926 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b02c324-87ff-406b-9c64-c1d715c282d7 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:37.129455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2cb12529-164a-4ff1-86d8-69145b889706 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:37.142511 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2cb12529-164a-4ff1-86d8-69145b889706 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1510 microversion: 2.1 time: 0.400309 Aug 24 10:40:37.143138 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2777/5187] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:36 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1510 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:37.305342 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-01c1b90b-03d8-4144-a190-ccf15c59e0c7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:37.306038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-01c1b90b-03d8-4144-a190-ccf15c59e0c7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:37.321551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01c1b90b-03d8-4144-a190-ccf15c59e0c7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:37.322335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01c1b90b-03d8-4144-a190-ccf15c59e0c7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:37.323431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01c1b90b-03d8-4144-a190-ccf15c59e0c7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:37.325384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01c1b90b-03d8-4144-a190-ccf15c59e0c7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:37.327702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01c1b90b-03d8-4144-a190-ccf15c59e0c7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:37.328400 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01c1b90b-03d8-4144-a190-ccf15c59e0c7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:37.472314 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3b02c324-87ff-406b-9c64-c1d715c282d7 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28" status: 200 len: 1647 microversion: 2.1 time: 0.389237 Aug 24 10:40:37.497663 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2411/5188] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:37 2022] GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28 => generated 1647 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:37.566389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-52f477c1-6048-4c62-b729-df4cdd61380a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:37.569068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-52f477c1-6048-4c62-b729-df4cdd61380a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:37.580526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52f477c1-6048-4c62-b729-df4cdd61380a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:37.583452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52f477c1-6048-4c62-b729-df4cdd61380a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:37.585444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52f477c1-6048-4c62-b729-df4cdd61380a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:37.589092 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52f477c1-6048-4c62-b729-df4cdd61380a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:37.589911 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52f477c1-6048-4c62-b729-df4cdd61380a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:37.590673 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52f477c1-6048-4c62-b729-df4cdd61380a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:37.700838 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-01c1b90b-03d8-4144-a190-ccf15c59e0c7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:37.710058 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-01c1b90b-03d8-4144-a190-ccf15c59e0c7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1679 microversion: 2.1 time: 0.410289 Aug 24 10:40:37.729264 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2778/5189] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:37 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1679 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:40:37.784338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-35e62fc1-577f-49a3-bdab-48a69c345f7b tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-731504285", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "availability_zone": "nova:n-h2-849328-3", "networks": [{"uuid": "2fce3984-41e2-4277-8476-c01603dae073"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:40:37.900625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-35e62fc1-577f-49a3-bdab-48a69c345f7b tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] validate_networks() for [('2fce3984-41e2-4277-8476-c01603dae073', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:40:38.056577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-52f477c1-6048-4c62-b729-df4cdd61380a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:38.070847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-52f477c1-6048-4c62-b729-df4cdd61380a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:38.087448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-52f477c1-6048-4c62-b729-df4cdd61380a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:38.089266 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-52f477c1-6048-4c62-b729-df4cdd61380a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1808 microversion: 2.20 time: 0.527840 Aug 24 10:40:38.091199 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2412/5190] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:40:37 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1808 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:40:38.097983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-21bc4a56-2c42-4c47-a889-36122bb1304c req-9e052a58-0085-484e-906d-5abc7fcde0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e", "name": "network-vif-plugged", "status": "completed", "tag": "04bfe8b2-85f8-48c0-83cc-8a238d22af80"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:40:38.118181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-21bc4a56-2c42-4c47-a889-36122bb1304c req-9e052a58-0085-484e-906d-5abc7fcde0e6 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:38.119336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-21bc4a56-2c42-4c47-a889-36122bb1304c req-9e052a58-0085-484e-906d-5abc7fcde0e6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:38.120378 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-21bc4a56-2c42-4c47-a889-36122bb1304c req-9e052a58-0085-484e-906d-5abc7fcde0e6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:38.147288 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-21bc4a56-2c42-4c47-a889-36122bb1304c req-9e052a58-0085-484e-906d-5abc7fcde0e6 service nova] Creating event network-vif-plugged:04bfe8b2-85f8-48c0-83cc-8a238d22af80 for instance 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e on n-h2-849328-3 Aug 24 10:40:38.154496 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-21bc4a56-2c42-4c47-a889-36122bb1304c req-9e052a58-0085-484e-906d-5abc7fcde0e6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061512 Aug 24 10:40:38.155865 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2413/5191] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:40:38.166736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b0983e57-84b6-4bda-9896-11256322ab37 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:38.168193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b0983e57-84b6-4bda-9896-11256322ab37 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:38.176684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0983e57-84b6-4bda-9896-11256322ab37 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:38.177755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0983e57-84b6-4bda-9896-11256322ab37 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:38.178654 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0983e57-84b6-4bda-9896-11256322ab37 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:38.179805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0983e57-84b6-4bda-9896-11256322ab37 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:38.192895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0983e57-84b6-4bda-9896-11256322ab37 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:38.195514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0983e57-84b6-4bda-9896-11256322ab37 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:38.564429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b0983e57-84b6-4bda-9896-11256322ab37 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:38.598862 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b0983e57-84b6-4bda-9896-11256322ab37 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1510 microversion: 2.1 time: 0.438068 Aug 24 10:40:38.601666 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2414/5192] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:38 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1510 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:40:38.754814 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-74b62159-5c29-46fa-a625-dd00e4ef1a94 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:38.756029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-74b62159-5c29-46fa-a625-dd00e4ef1a94 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:38.806116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74b62159-5c29-46fa-a625-dd00e4ef1a94 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:38.807261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74b62159-5c29-46fa-a625-dd00e4ef1a94 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:38.808540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74b62159-5c29-46fa-a625-dd00e4ef1a94 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:38.810117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74b62159-5c29-46fa-a625-dd00e4ef1a94 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:38.814985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74b62159-5c29-46fa-a625-dd00e4ef1a94 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:38.831059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74b62159-5c29-46fa-a625-dd00e4ef1a94 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:39.151467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-74b62159-5c29-46fa-a625-dd00e4ef1a94 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:39.176213 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-74b62159-5c29-46fa-a625-dd00e4ef1a94 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1679 microversion: 2.1 time: 0.426928 Aug 24 10:40:39.177287 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2415/5193] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:38 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1679 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:39.187378 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6d80b04b-225f-45fa-8468-1e518ac0f5a2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:39.188071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6d80b04b-225f-45fa-8468-1e518ac0f5a2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:39.205232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d80b04b-225f-45fa-8468-1e518ac0f5a2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:39.205766 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d80b04b-225f-45fa-8468-1e518ac0f5a2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:39.206223 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d80b04b-225f-45fa-8468-1e518ac0f5a2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:39.207032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d80b04b-225f-45fa-8468-1e518ac0f5a2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:39.207426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d80b04b-225f-45fa-8468-1e518ac0f5a2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:39.207858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d80b04b-225f-45fa-8468-1e518ac0f5a2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:39.483923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-35e62fc1-577f-49a3-bdab-48a69c345f7b tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:40:39.499590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-35e62fc1-577f-49a3-bdab-48a69c345f7b tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:40:39.500194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-35e62fc1-577f-49a3-bdab-48a69c345f7b tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:40:39.507474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-35e62fc1-577f-49a3-bdab-48a69c345f7b tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:40:39.508125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-35e62fc1-577f-49a3-bdab-48a69c345f7b tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:40:39.542506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35e62fc1-577f-49a3-bdab-48a69c345f7b tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:39.543120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35e62fc1-577f-49a3-bdab-48a69c345f7b tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:39.543578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35e62fc1-577f-49a3-bdab-48a69c345f7b tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:39.544379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35e62fc1-577f-49a3-bdab-48a69c345f7b tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:39.544852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35e62fc1-577f-49a3-bdab-48a69c345f7b tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:39.545324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35e62fc1-577f-49a3-bdab-48a69c345f7b tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:39.584954 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-35e62fc1-577f-49a3-bdab-48a69c345f7b tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Getting quotas for project 2b0f6576c12947c386db2c488fcace2d. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:40:39.593986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-35e62fc1-577f-49a3-bdab-48a69c345f7b tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Getting quotas for user a3e99593a56941369eceaec628b8aaad and project 2b0f6576c12947c386db2c488fcace2d. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:40:39.595945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6d80b04b-225f-45fa-8468-1e518ac0f5a2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:39.609917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-35e62fc1-577f-49a3-bdab-48a69c345f7b tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:40:39.612853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-35e62fc1-577f-49a3-bdab-48a69c345f7b tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: af89e9af-4d73-40d4-aa95-816a03bd5b13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:40:39.628985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6d80b04b-225f-45fa-8468-1e518ac0f5a2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:39.632967 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6d80b04b-225f-45fa-8468-1e518ac0f5a2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:39.635312 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6d80b04b-225f-45fa-8468-1e518ac0f5a2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1808 microversion: 2.20 time: 0.456921 Aug 24 10:40:39.636586 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2416/5194] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:40:39 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1808 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:40:39.713093 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-35e62fc1-577f-49a3-bdab-48a69c345f7b tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.932057 Aug 24 10:40:39.713845 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2779/5195] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:40:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:40:39.728473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8287cfcb-b624-4e27-bda6-8dd746952f31 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:39.729798 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8287cfcb-b624-4e27-bda6-8dd746952f31 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:39.744329 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-45314c01-96b0-46ef-abf9-5a5e246527f8 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:39.747937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-45314c01-96b0-46ef-abf9-5a5e246527f8 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: af89e9af-4d73-40d4-aa95-816a03bd5b13] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:39.773866 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8287cfcb-b624-4e27-bda6-8dd746952f31 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:39.774764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8287cfcb-b624-4e27-bda6-8dd746952f31 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:39.775526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8287cfcb-b624-4e27-bda6-8dd746952f31 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:39.776914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8287cfcb-b624-4e27-bda6-8dd746952f31 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:39.777742 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8287cfcb-b624-4e27-bda6-8dd746952f31 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:39.778475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8287cfcb-b624-4e27-bda6-8dd746952f31 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:39.948085 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-45314c01-96b0-46ef-abf9-5a5e246527f8 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13" status: 200 len: 1328 microversion: 2.1 time: 0.219378 Aug 24 10:40:39.954354 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2780/5196] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:39 2022] GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13 => generated 1328 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:40.202536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2dcc4b43-e8c2-4b0c-b6a7-4a7955f28a5f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:40.204521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2dcc4b43-e8c2-4b0c-b6a7-4a7955f28a5f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:40.235101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dcc4b43-e8c2-4b0c-b6a7-4a7955f28a5f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:40.241914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dcc4b43-e8c2-4b0c-b6a7-4a7955f28a5f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:40.243546 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dcc4b43-e8c2-4b0c-b6a7-4a7955f28a5f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:40.245606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dcc4b43-e8c2-4b0c-b6a7-4a7955f28a5f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:40.249330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dcc4b43-e8c2-4b0c-b6a7-4a7955f28a5f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:40.249974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dcc4b43-e8c2-4b0c-b6a7-4a7955f28a5f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:40.372445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8287cfcb-b624-4e27-bda6-8dd746952f31 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:40.383971 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8287cfcb-b624-4e27-bda6-8dd746952f31 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1510 microversion: 2.1 time: 0.723238 Aug 24 10:40:40.397508 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2417/5197] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:39 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1510 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:40.398895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-956e7f6d-5d31-45ed-ae52-daf9d542768f tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-861110780", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "a9c928eb-1d0b-4705-946c-1d6ecdaa2a1e"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:40:40.533430 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-956e7f6d-5d31-45ed-ae52-daf9d542768f tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] validate_networks() for [('a9c928eb-1d0b-4705-946c-1d6ecdaa2a1e', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:40:40.795006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2dcc4b43-e8c2-4b0c-b6a7-4a7955f28a5f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:40.809501 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2dcc4b43-e8c2-4b0c-b6a7-4a7955f28a5f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1679 microversion: 2.1 time: 0.611723 Aug 24 10:40:40.810492 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2781/5198] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:40 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1679 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:40.819514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7e3bc392-cea3-4d31-b9d6-6c031f047947 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:40.824650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7e3bc392-cea3-4d31-b9d6-6c031f047947 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:40.841527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e3bc392-cea3-4d31-b9d6-6c031f047947 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:40.842834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e3bc392-cea3-4d31-b9d6-6c031f047947 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:40.844160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e3bc392-cea3-4d31-b9d6-6c031f047947 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:40.846883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e3bc392-cea3-4d31-b9d6-6c031f047947 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:40.848867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e3bc392-cea3-4d31-b9d6-6c031f047947 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:40.849373 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e3bc392-cea3-4d31-b9d6-6c031f047947 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:41.318959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7e3bc392-cea3-4d31-b9d6-6c031f047947 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:41.346394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7e3bc392-cea3-4d31-b9d6-6c031f047947 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:41.350061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7e3bc392-cea3-4d31-b9d6-6c031f047947 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:41.359028 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7e3bc392-cea3-4d31-b9d6-6c031f047947 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1808 microversion: 2.20 time: 0.545907 Aug 24 10:40:41.380076 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2782/5199] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:40:40 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1808 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:40:41.400372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-330bed4f-b9cc-44da-b721-2c32e1678b2e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:41.402398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-330bed4f-b9cc-44da-b721-2c32e1678b2e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: af89e9af-4d73-40d4-aa95-816a03bd5b13] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:41.422543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-330bed4f-b9cc-44da-b721-2c32e1678b2e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:41.423060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-330bed4f-b9cc-44da-b721-2c32e1678b2e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:41.423507 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-330bed4f-b9cc-44da-b721-2c32e1678b2e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:41.424230 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-330bed4f-b9cc-44da-b721-2c32e1678b2e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:41.425352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-330bed4f-b9cc-44da-b721-2c32e1678b2e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:41.426604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-330bed4f-b9cc-44da-b721-2c32e1678b2e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:41.586662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-956e7f6d-5d31-45ed-ae52-daf9d542768f tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:40:41.587446 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-956e7f6d-5d31-45ed-ae52-daf9d542768f tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:40:41.588320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-956e7f6d-5d31-45ed-ae52-daf9d542768f tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:40:41.589069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-956e7f6d-5d31-45ed-ae52-daf9d542768f tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:40:41.589920 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-956e7f6d-5d31-45ed-ae52-daf9d542768f tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:40:41.616412 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-956e7f6d-5d31-45ed-ae52-daf9d542768f tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:41.616412 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-956e7f6d-5d31-45ed-ae52-daf9d542768f tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:41.617004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-956e7f6d-5d31-45ed-ae52-daf9d542768f tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:41.617611 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-956e7f6d-5d31-45ed-ae52-daf9d542768f tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:41.618073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-956e7f6d-5d31-45ed-ae52-daf9d542768f tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:41.618500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-956e7f6d-5d31-45ed-ae52-daf9d542768f tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:41.650664 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-330bed4f-b9cc-44da-b721-2c32e1678b2e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13" status: 200 len: 1415 microversion: 2.1 time: 0.268436 Aug 24 10:40:41.652828 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2783/5200] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:41 2022] GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13 => generated 1415 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:41.657824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3fa502fb-031b-4ba3-b34f-fb211cec4ea7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:41.658713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3fa502fb-031b-4ba3-b34f-fb211cec4ea7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:41.668836 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-956e7f6d-5d31-45ed-ae52-daf9d542768f tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Getting quotas for project 2dc5853f2c1c434f832d5ffc2f550bf6. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:40:41.677351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-956e7f6d-5d31-45ed-ae52-daf9d542768f tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Getting quotas for user 988cbd2509314aeaa9ad618e705894d3 and project 2dc5853f2c1c434f832d5ffc2f550bf6. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:40:41.678653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fa502fb-031b-4ba3-b34f-fb211cec4ea7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:41.679340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fa502fb-031b-4ba3-b34f-fb211cec4ea7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:41.680202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fa502fb-031b-4ba3-b34f-fb211cec4ea7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:41.682586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fa502fb-031b-4ba3-b34f-fb211cec4ea7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:41.683770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fa502fb-031b-4ba3-b34f-fb211cec4ea7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:41.684590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fa502fb-031b-4ba3-b34f-fb211cec4ea7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:41.720371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-956e7f6d-5d31-45ed-ae52-daf9d542768f tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:40:41.729590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-956e7f6d-5d31-45ed-ae52-daf9d542768f tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: 94eebedc-5d3f-404b-bdf6-d039b5baf150] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:40:41.847510 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-956e7f6d-5d31-45ed-ae52-daf9d542768f tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.460462 Aug 24 10:40:41.848101 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2418/5201] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:40:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:40:41.862633 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b64b0918-b52e-4d58-9441-0006413528e9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:41.864329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b64b0918-b52e-4d58-9441-0006413528e9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:41.884976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b64b0918-b52e-4d58-9441-0006413528e9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:41.902509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b64b0918-b52e-4d58-9441-0006413528e9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:41.903801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b64b0918-b52e-4d58-9441-0006413528e9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:41.905313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b64b0918-b52e-4d58-9441-0006413528e9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:41.906462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b64b0918-b52e-4d58-9441-0006413528e9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:41.907960 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b64b0918-b52e-4d58-9441-0006413528e9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:42.090142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b64b0918-b52e-4d58-9441-0006413528e9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:42.115534 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b64b0918-b52e-4d58-9441-0006413528e9 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1656 microversion: 2.1 time: 0.260497 Aug 24 10:40:42.137058 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2419/5202] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:41 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1656 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:42.142167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7b74c806-c0cd-4c6e-b1f9-ada891a13b4e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:42.142788 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7b74c806-c0cd-4c6e-b1f9-ada891a13b4e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: 94eebedc-5d3f-404b-bdf6-d039b5baf150] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:42.302037 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7b74c806-c0cd-4c6e-b1f9-ada891a13b4e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988cbd2509314aeaa9ad618e705894d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc5853f2c1c434f832d5ffc2f550bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:42.310035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3fa502fb-031b-4ba3-b34f-fb211cec4ea7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:42.310659 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7b74c806-c0cd-4c6e-b1f9-ada891a13b4e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150" status: 200 len: 1218 microversion: 2.1 time: 0.172172 Aug 24 10:40:42.311421 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2420/5203] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:42 2022] GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150 => generated 1218 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:42.345671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-90dd5428-1587-4518-b12d-3779f17ac6a1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:40:42.348481 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3fa502fb-031b-4ba3-b34f-fb211cec4ea7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1510 microversion: 2.1 time: 0.691693 Aug 24 10:40:42.350152 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2784/5204] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:41 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1510 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:42.377597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90dd5428-1587-4518-b12d-3779f17ac6a1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:42.380472 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90dd5428-1587-4518-b12d-3779f17ac6a1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:42.383808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90dd5428-1587-4518-b12d-3779f17ac6a1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:42.395793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3fd6d9ad-3c5d-429f-b90b-ade673d00d3c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:42.396629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3fd6d9ad-3c5d-429f-b90b-ade673d00d3c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:42.408718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd6d9ad-3c5d-429f-b90b-ade673d00d3c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:42.418635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd6d9ad-3c5d-429f-b90b-ade673d00d3c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:42.419530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd6d9ad-3c5d-429f-b90b-ade673d00d3c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:42.420207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd6d9ad-3c5d-429f-b90b-ade673d00d3c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:42.420745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd6d9ad-3c5d-429f-b90b-ade673d00d3c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:42.421270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd6d9ad-3c5d-429f-b90b-ade673d00d3c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:42.466330 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-90dd5428-1587-4518-b12d-3779f17ac6a1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Going to try to start instance {{(pid=122432) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 10:40:42.662587 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-90dd5428-1587-4518-b12d-3779f17ac6a1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action" status: 202 len: 0 microversion: 2.1 time: 0.329449 Aug 24 10:40:42.668532 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2421/5205] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:40:42 2022] POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:40:42.707938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-207712d9-f0b4-4809-9763-450e87342e4f tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:42.718286 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-207712d9-f0b4-4809-9763-450e87342e4f tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: af89e9af-4d73-40d4-aa95-816a03bd5b13] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:42.739532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-207712d9-f0b4-4809-9763-450e87342e4f tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:42.740668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-207712d9-f0b4-4809-9763-450e87342e4f tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:42.743795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-207712d9-f0b4-4809-9763-450e87342e4f tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:42.746736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-207712d9-f0b4-4809-9763-450e87342e4f tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:42.751613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-207712d9-f0b4-4809-9763-450e87342e4f tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:42.753688 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-207712d9-f0b4-4809-9763-450e87342e4f tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:42.791400 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:42.925450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3fd6d9ad-3c5d-429f-b90b-ade673d00d3c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:42.948025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3fd6d9ad-3c5d-429f-b90b-ade673d00d3c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:42.949437 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3fd6d9ad-3c5d-429f-b90b-ade673d00d3c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:42.950689 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3fd6d9ad-3c5d-429f-b90b-ade673d00d3c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1795 microversion: 2.20 time: 0.565444 Aug 24 10:40:42.952020 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2785/5206] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:40:42 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1795 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:40:42.960302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6b2aa31a-5c7f-4e41-9228-77b3faa4b282 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:42.961300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6b2aa31a-5c7f-4e41-9228-77b3faa4b282 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:42.978513 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b2aa31a-5c7f-4e41-9228-77b3faa4b282 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:42.979020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b2aa31a-5c7f-4e41-9228-77b3faa4b282 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:42.979471 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b2aa31a-5c7f-4e41-9228-77b3faa4b282 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:42.980285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b2aa31a-5c7f-4e41-9228-77b3faa4b282 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:42.980776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b2aa31a-5c7f-4e41-9228-77b3faa4b282 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:42.981270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b2aa31a-5c7f-4e41-9228-77b3faa4b282 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:43.092318 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-207712d9-f0b4-4809-9763-450e87342e4f tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13" status: 200 len: 1421 microversion: 2.1 time: 0.403817 Aug 24 10:40:43.093154 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2422/5207] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:42 2022] GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13 => generated 1421 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:43.339678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-714a9fa7-ddb2-47de-b669-ecb848bd9081 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:43.340897 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-714a9fa7-ddb2-47de-b669-ecb848bd9081 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: 94eebedc-5d3f-404b-bdf6-d039b5baf150] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:43.355889 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-714a9fa7-ddb2-47de-b669-ecb848bd9081 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:43.356382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-714a9fa7-ddb2-47de-b669-ecb848bd9081 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:43.356817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-714a9fa7-ddb2-47de-b669-ecb848bd9081 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:43.360608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-714a9fa7-ddb2-47de-b669-ecb848bd9081 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:43.361170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-714a9fa7-ddb2-47de-b669-ecb848bd9081 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:43.361595 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-714a9fa7-ddb2-47de-b669-ecb848bd9081 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:43.440792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6b2aa31a-5c7f-4e41-9228-77b3faa4b282 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:43.461881 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6b2aa31a-5c7f-4e41-9228-77b3faa4b282 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1665 microversion: 2.1 time: 0.508909 Aug 24 10:40:43.476050 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2786/5208] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:42 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1665 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:43.481537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a26d522a-cea5-4c68-9d2a-33141fc63ed6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:43.488154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a26d522a-cea5-4c68-9d2a-33141fc63ed6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:43.501056 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a26d522a-cea5-4c68-9d2a-33141fc63ed6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:43.501920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a26d522a-cea5-4c68-9d2a-33141fc63ed6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:43.502538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a26d522a-cea5-4c68-9d2a-33141fc63ed6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:43.503411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a26d522a-cea5-4c68-9d2a-33141fc63ed6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:43.507791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a26d522a-cea5-4c68-9d2a-33141fc63ed6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:43.508435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a26d522a-cea5-4c68-9d2a-33141fc63ed6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:43.689921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-714a9fa7-ddb2-47de-b669-ecb848bd9081 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988cbd2509314aeaa9ad618e705894d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc5853f2c1c434f832d5ffc2f550bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:43.714767 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-714a9fa7-ddb2-47de-b669-ecb848bd9081 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150" status: 200 len: 1270 microversion: 2.1 time: 0.377847 Aug 24 10:40:43.716147 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2423/5209] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:43 2022] GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150 => generated 1270 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:43.885707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a26d522a-cea5-4c68-9d2a-33141fc63ed6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:43.901818 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a26d522a-cea5-4c68-9d2a-33141fc63ed6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1510 microversion: 2.1 time: 0.424481 Aug 24 10:40:43.915678 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2787/5210] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:43 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1510 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:44.127322 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-49eb8977-3cd0-4d93-a29b-4bd542cbd73c tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:44.128435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-49eb8977-3cd0-4d93-a29b-4bd542cbd73c tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: af89e9af-4d73-40d4-aa95-816a03bd5b13] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:44.143458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49eb8977-3cd0-4d93-a29b-4bd542cbd73c tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:44.145367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49eb8977-3cd0-4d93-a29b-4bd542cbd73c tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:44.148944 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49eb8977-3cd0-4d93-a29b-4bd542cbd73c tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:44.149998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49eb8977-3cd0-4d93-a29b-4bd542cbd73c tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:44.153637 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49eb8977-3cd0-4d93-a29b-4bd542cbd73c tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:44.154324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49eb8977-3cd0-4d93-a29b-4bd542cbd73c tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:44.487826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7ced93ea-fa70-427e-a0e2-8621a7ae8dc6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:44.489181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7ced93ea-fa70-427e-a0e2-8621a7ae8dc6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:44.501308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ced93ea-fa70-427e-a0e2-8621a7ae8dc6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:44.502444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ced93ea-fa70-427e-a0e2-8621a7ae8dc6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:44.503478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ced93ea-fa70-427e-a0e2-8621a7ae8dc6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:44.505267 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ced93ea-fa70-427e-a0e2-8621a7ae8dc6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:44.506832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ced93ea-fa70-427e-a0e2-8621a7ae8dc6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:44.508005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ced93ea-fa70-427e-a0e2-8621a7ae8dc6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:44.739692 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-49eb8977-3cd0-4d93-a29b-4bd542cbd73c tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13" status: 200 len: 1463 microversion: 2.1 time: 0.616311 Aug 24 10:40:44.740297 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2424/5211] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:44 2022] GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13 => generated 1463 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:44.758760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5aae2a6d-0ea0-494d-88a2-dc5a78c0c9f3 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:44.759691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5aae2a6d-0ea0-494d-88a2-dc5a78c0c9f3 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: 94eebedc-5d3f-404b-bdf6-d039b5baf150] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:44.766658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5aae2a6d-0ea0-494d-88a2-dc5a78c0c9f3 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:44.767802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5aae2a6d-0ea0-494d-88a2-dc5a78c0c9f3 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:44.768527 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5aae2a6d-0ea0-494d-88a2-dc5a78c0c9f3 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:44.769596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5aae2a6d-0ea0-494d-88a2-dc5a78c0c9f3 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:44.770277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5aae2a6d-0ea0-494d-88a2-dc5a78c0c9f3 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:44.771032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5aae2a6d-0ea0-494d-88a2-dc5a78c0c9f3 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:44.883770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5aae2a6d-0ea0-494d-88a2-dc5a78c0c9f3 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988cbd2509314aeaa9ad618e705894d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc5853f2c1c434f832d5ffc2f550bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:44.898418 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5aae2a6d-0ea0-494d-88a2-dc5a78c0c9f3 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150" status: 200 len: 1276 microversion: 2.1 time: 0.152563 Aug 24 10:40:44.899740 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2425/5212] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:44 2022] GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150 => generated 1276 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:44.931122 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3c936efa-f3d5-405f-9c2e-67697180b5fe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:44.931754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3c936efa-f3d5-405f-9c2e-67697180b5fe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:44.949183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c936efa-f3d5-405f-9c2e-67697180b5fe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:44.951187 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c936efa-f3d5-405f-9c2e-67697180b5fe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:44.951960 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c936efa-f3d5-405f-9c2e-67697180b5fe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:44.953964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c936efa-f3d5-405f-9c2e-67697180b5fe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:44.955748 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c936efa-f3d5-405f-9c2e-67697180b5fe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:44.956540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c936efa-f3d5-405f-9c2e-67697180b5fe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:44.968819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7ced93ea-fa70-427e-a0e2-8621a7ae8dc6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:44.986607 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7ced93ea-fa70-427e-a0e2-8621a7ae8dc6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1665 microversion: 2.1 time: 0.503641 Aug 24 10:40:44.988980 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2788/5213] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:44 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1665 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:40:45.099804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-2e06b20a-88c8-46c3-8f2a-f35c3449da2d req-b0e0c4a6-ff07-45fb-9924-ade9e461ce15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af89e9af-4d73-40d4-aa95-816a03bd5b13", "tag": "8e49be9b-a5d0-4573-8115-172b8ad0e973"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:40:45.121928 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2e06b20a-88c8-46c3-8f2a-f35c3449da2d req-b0e0c4a6-ff07-45fb-9924-ade9e461ce15 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:45.130887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2e06b20a-88c8-46c3-8f2a-f35c3449da2d req-b0e0c4a6-ff07-45fb-9924-ade9e461ce15 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:45.133376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2e06b20a-88c8-46c3-8f2a-f35c3449da2d req-b0e0c4a6-ff07-45fb-9924-ade9e461ce15 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:45.163995 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-2e06b20a-88c8-46c3-8f2a-f35c3449da2d req-b0e0c4a6-ff07-45fb-9924-ade9e461ce15 service nova] Creating event network-changed:8e49be9b-a5d0-4573-8115-172b8ad0e973 for instance af89e9af-4d73-40d4-aa95-816a03bd5b13 on n-h2-849328-3 Aug 24 10:40:45.180064 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-2e06b20a-88c8-46c3-8f2a-f35c3449da2d req-b0e0c4a6-ff07-45fb-9924-ade9e461ce15 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084105 Aug 24 10:40:45.180989 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2789/5214] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:40:45.456837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3c936efa-f3d5-405f-9c2e-67697180b5fe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:45.473248 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3c936efa-f3d5-405f-9c2e-67697180b5fe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1510 microversion: 2.1 time: 0.553679 Aug 24 10:40:45.475320 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2426/5215] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:44 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1510 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:45.778406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b9e304d9-aecb-4b92-9181-69e90fa384da tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:45.782218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b9e304d9-aecb-4b92-9181-69e90fa384da tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: af89e9af-4d73-40d4-aa95-816a03bd5b13] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:45.813829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9e304d9-aecb-4b92-9181-69e90fa384da tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:45.815582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9e304d9-aecb-4b92-9181-69e90fa384da tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:45.816609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9e304d9-aecb-4b92-9181-69e90fa384da tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:45.818921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9e304d9-aecb-4b92-9181-69e90fa384da tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:45.823614 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9e304d9-aecb-4b92-9181-69e90fa384da tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:45.826430 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9e304d9-aecb-4b92-9181-69e90fa384da tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:45.917439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:45.922570 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f4fa96d0-2508-4e37-8a9e-91c2271897fd tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:45.924034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f4fa96d0-2508-4e37-8a9e-91c2271897fd tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: 94eebedc-5d3f-404b-bdf6-d039b5baf150] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:45.942439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4fa96d0-2508-4e37-8a9e-91c2271897fd tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:45.949718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4fa96d0-2508-4e37-8a9e-91c2271897fd tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:45.951063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4fa96d0-2508-4e37-8a9e-91c2271897fd tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:45.957285 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4fa96d0-2508-4e37-8a9e-91c2271897fd tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:45.963027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4fa96d0-2508-4e37-8a9e-91c2271897fd tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:45.966438 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4fa96d0-2508-4e37-8a9e-91c2271897fd tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:46.278309 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b9e304d9-aecb-4b92-9181-69e90fa384da tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13" status: 200 len: 1463 microversion: 2.1 time: 0.511855 Aug 24 10:40:46.293054 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2790/5216] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:45 2022] GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13 => generated 1463 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:46.302330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1a9f6866-a8f2-4553-9915-b3013bf82023 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:46.303619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1a9f6866-a8f2-4553-9915-b3013bf82023 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:46.318468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a9f6866-a8f2-4553-9915-b3013bf82023 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:46.320067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a9f6866-a8f2-4553-9915-b3013bf82023 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:46.321062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a9f6866-a8f2-4553-9915-b3013bf82023 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:46.323357 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a9f6866-a8f2-4553-9915-b3013bf82023 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:46.324476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a9f6866-a8f2-4553-9915-b3013bf82023 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:46.325429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a9f6866-a8f2-4553-9915-b3013bf82023 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:46.551819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1a9f6866-a8f2-4553-9915-b3013bf82023 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:46.569456 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1a9f6866-a8f2-4553-9915-b3013bf82023 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.274681 Aug 24 10:40:46.571624 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2791/5217] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:46 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:46.587085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c6a93522-dfab-483c-bfd9-14cd0b4b3442 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:46.588023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c6a93522-dfab-483c-bfd9-14cd0b4b3442 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:46.596830 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6a93522-dfab-483c-bfd9-14cd0b4b3442 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:46.599041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6a93522-dfab-483c-bfd9-14cd0b4b3442 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:46.599911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6a93522-dfab-483c-bfd9-14cd0b4b3442 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:46.604420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6a93522-dfab-483c-bfd9-14cd0b4b3442 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:46.606486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6a93522-dfab-483c-bfd9-14cd0b4b3442 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:46.607272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6a93522-dfab-483c-bfd9-14cd0b4b3442 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:46.782723 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f4fa96d0-2508-4e37-8a9e-91c2271897fd tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988cbd2509314aeaa9ad618e705894d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc5853f2c1c434f832d5ffc2f550bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:46.795192 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f4fa96d0-2508-4e37-8a9e-91c2271897fd tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150" status: 200 len: 1318 microversion: 2.1 time: 0.878360 Aug 24 10:40:46.797777 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2427/5218] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:45 2022] GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150 => generated 1318 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:40:46.810272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-01afc555-705d-457a-bdec-b4a830108c01 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:46.810887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-01afc555-705d-457a-bdec-b4a830108c01 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:46.826133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01afc555-705d-457a-bdec-b4a830108c01 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:46.826653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01afc555-705d-457a-bdec-b4a830108c01 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:46.827303 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01afc555-705d-457a-bdec-b4a830108c01 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:46.828262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01afc555-705d-457a-bdec-b4a830108c01 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:46.828876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01afc555-705d-457a-bdec-b4a830108c01 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:46.829642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01afc555-705d-457a-bdec-b4a830108c01 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:46.841878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c6a93522-dfab-483c-bfd9-14cd0b4b3442 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:46.854963 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c6a93522-dfab-483c-bfd9-14cd0b4b3442 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1510 microversion: 2.1 time: 0.281105 Aug 24 10:40:46.855929 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2792/5219] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:46 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1510 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:47.315770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bfbd1cd2-7c08-4e18-bb84-c1ba7d550996 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:47.317381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bfbd1cd2-7c08-4e18-bb84-c1ba7d550996 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: af89e9af-4d73-40d4-aa95-816a03bd5b13] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:47.332810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bfbd1cd2-7c08-4e18-bb84-c1ba7d550996 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:47.333595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bfbd1cd2-7c08-4e18-bb84-c1ba7d550996 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:47.334398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bfbd1cd2-7c08-4e18-bb84-c1ba7d550996 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:47.336142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bfbd1cd2-7c08-4e18-bb84-c1ba7d550996 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:47.337326 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bfbd1cd2-7c08-4e18-bb84-c1ba7d550996 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:47.338406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bfbd1cd2-7c08-4e18-bb84-c1ba7d550996 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:47.369111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-01afc555-705d-457a-bdec-b4a830108c01 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:47.393931 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-01afc555-705d-457a-bdec-b4a830108c01 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.594682 Aug 24 10:40:47.394984 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2428/5220] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:46 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:47.422020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-61b4673b-aaf7-46f4-8715-50ade97efb3f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:47.422884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-61b4673b-aaf7-46f4-8715-50ade97efb3f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:47.429667 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61b4673b-aaf7-46f4-8715-50ade97efb3f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:47.430163 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61b4673b-aaf7-46f4-8715-50ade97efb3f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:47.430589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61b4673b-aaf7-46f4-8715-50ade97efb3f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:47.431484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61b4673b-aaf7-46f4-8715-50ade97efb3f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:47.432084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61b4673b-aaf7-46f4-8715-50ade97efb3f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:47.432765 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61b4673b-aaf7-46f4-8715-50ade97efb3f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:47.617430 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bfbd1cd2-7c08-4e18-bb84-c1ba7d550996 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13" status: 200 len: 1463 microversion: 2.1 time: 0.308660 Aug 24 10:40:47.618327 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2793/5221] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:47 2022] GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13 => generated 1463 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:47.832956 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-05033fd0-49c4-4bf4-8262-42353a7c360a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:47.834362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-05033fd0-49c4-4bf4-8262-42353a7c360a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: 94eebedc-5d3f-404b-bdf6-d039b5baf150] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:47.866085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05033fd0-49c4-4bf4-8262-42353a7c360a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:47.869236 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05033fd0-49c4-4bf4-8262-42353a7c360a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:47.871022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05033fd0-49c4-4bf4-8262-42353a7c360a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:47.874121 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05033fd0-49c4-4bf4-8262-42353a7c360a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:47.880902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05033fd0-49c4-4bf4-8262-42353a7c360a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:47.883255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05033fd0-49c4-4bf4-8262-42353a7c360a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:48.151113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-61b4673b-aaf7-46f4-8715-50ade97efb3f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:48.160001 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-61b4673b-aaf7-46f4-8715-50ade97efb3f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.743188 Aug 24 10:40:48.161375 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2429/5222] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:47 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:48.166976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b97e75c1-52d2-4911-8a18-8eeff376ad43 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:48.168474 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b97e75c1-52d2-4911-8a18-8eeff376ad43 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:48.175970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:48.178678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b97e75c1-52d2-4911-8a18-8eeff376ad43 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:48.179488 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b97e75c1-52d2-4911-8a18-8eeff376ad43 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:48.180134 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b97e75c1-52d2-4911-8a18-8eeff376ad43 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:48.181079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b97e75c1-52d2-4911-8a18-8eeff376ad43 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:48.181801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b97e75c1-52d2-4911-8a18-8eeff376ad43 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:48.182462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b97e75c1-52d2-4911-8a18-8eeff376ad43 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:48.511715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b97e75c1-52d2-4911-8a18-8eeff376ad43 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:48.525610 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b97e75c1-52d2-4911-8a18-8eeff376ad43 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1510 microversion: 2.1 time: 0.362748 Aug 24 10:40:48.535597 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2430/5223] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:48 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1510 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:48.535597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-27905ea9-89af-4811-8993-f81027a37956 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:48.535597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-27905ea9-89af-4811-8993-f81027a37956 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:48.544153 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27905ea9-89af-4811-8993-f81027a37956 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:48.545291 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27905ea9-89af-4811-8993-f81027a37956 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:48.545993 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27905ea9-89af-4811-8993-f81027a37956 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:48.547615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27905ea9-89af-4811-8993-f81027a37956 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:48.552157 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27905ea9-89af-4811-8993-f81027a37956 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:48.553083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27905ea9-89af-4811-8993-f81027a37956 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:48.627040 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-05033fd0-49c4-4bf4-8262-42353a7c360a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988cbd2509314aeaa9ad618e705894d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc5853f2c1c434f832d5ffc2f550bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:48.649152 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-05033fd0-49c4-4bf4-8262-42353a7c360a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150" status: 200 len: 1318 microversion: 2.1 time: 0.822687 Aug 24 10:40:48.649790 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2794/5224] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:47 2022] GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150 => generated 1318 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:40:48.658847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3a58bcc9-b1e4-4813-99d3-4339a48a30d8 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:48.660425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3a58bcc9-b1e4-4813-99d3-4339a48a30d8 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: af89e9af-4d73-40d4-aa95-816a03bd5b13] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:48.670841 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a58bcc9-b1e4-4813-99d3-4339a48a30d8 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:48.672269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a58bcc9-b1e4-4813-99d3-4339a48a30d8 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:48.673165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a58bcc9-b1e4-4813-99d3-4339a48a30d8 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:48.678214 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a58bcc9-b1e4-4813-99d3-4339a48a30d8 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:48.679028 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a58bcc9-b1e4-4813-99d3-4339a48a30d8 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:48.679785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a58bcc9-b1e4-4813-99d3-4339a48a30d8 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:48.899569 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3a58bcc9-b1e4-4813-99d3-4339a48a30d8 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13" status: 200 len: 1463 microversion: 2.1 time: 0.247477 Aug 24 10:40:48.901521 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2795/5225] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:48 2022] GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13 => generated 1463 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:48.919090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-6a21c417-2353-42be-86eb-ace4191a921d req-edfd65c3-1dd9-4d19-8d6f-9a6a78dca4fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94eebedc-5d3f-404b-bdf6-d039b5baf150", "tag": "2c0fae0f-ed26-46d3-8761-073190a62a7c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:40:48.932945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6a21c417-2353-42be-86eb-ace4191a921d req-edfd65c3-1dd9-4d19-8d6f-9a6a78dca4fc service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:48.934224 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6a21c417-2353-42be-86eb-ace4191a921d req-edfd65c3-1dd9-4d19-8d6f-9a6a78dca4fc service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:48.934779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6a21c417-2353-42be-86eb-ace4191a921d req-edfd65c3-1dd9-4d19-8d6f-9a6a78dca4fc service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:48.953668 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-6a21c417-2353-42be-86eb-ace4191a921d req-edfd65c3-1dd9-4d19-8d6f-9a6a78dca4fc service nova] Creating event network-changed:2c0fae0f-ed26-46d3-8761-073190a62a7c for instance 94eebedc-5d3f-404b-bdf6-d039b5baf150 on n-h1-849328-3 Aug 24 10:40:48.961219 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-6a21c417-2353-42be-86eb-ace4191a921d req-edfd65c3-1dd9-4d19-8d6f-9a6a78dca4fc service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057915 Aug 24 10:40:48.963414 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2796/5226] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:40:49.100957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-27905ea9-89af-4811-8993-f81027a37956 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:49.112914 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-27905ea9-89af-4811-8993-f81027a37956 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.584058 Aug 24 10:40:49.114120 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2431/5227] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:48 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:49.140446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de754746-4cc5-43df-8fe6-967fe31d559c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:49.141408 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-de754746-4cc5-43df-8fe6-967fe31d559c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:49.148210 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de754746-4cc5-43df-8fe6-967fe31d559c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:49.148953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de754746-4cc5-43df-8fe6-967fe31d559c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:49.149564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de754746-4cc5-43df-8fe6-967fe31d559c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:49.150425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de754746-4cc5-43df-8fe6-967fe31d559c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:49.151027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de754746-4cc5-43df-8fe6-967fe31d559c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:49.151598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de754746-4cc5-43df-8fe6-967fe31d559c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:49.329712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-de754746-4cc5-43df-8fe6-967fe31d559c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:49.342395 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-de754746-4cc5-43df-8fe6-967fe31d559c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.206640 Aug 24 10:40:49.343168 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2797/5228] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:49 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:49.362802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-67594601-90b7-464d-bff6-0f7642da0991 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:40:49.363335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-67594601-90b7-464d-bff6-0f7642da0991 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:49.370936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67594601-90b7-464d-bff6-0f7642da0991 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:49.371685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67594601-90b7-464d-bff6-0f7642da0991 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:49.372276 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67594601-90b7-464d-bff6-0f7642da0991 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:49.373363 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67594601-90b7-464d-bff6-0f7642da0991 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:49.373960 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67594601-90b7-464d-bff6-0f7642da0991 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:49.374522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67594601-90b7-464d-bff6-0f7642da0991 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:49.408226 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-67594601-90b7-464d-bff6-0f7642da0991 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lazy-loading 'flavor' on Instance uuid 99ed6211-b7fc-454f-a8e9-73ba571a71af {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:40:49.539208 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-67594601-90b7-464d-bff6-0f7642da0991 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action" status: 202 len: 0 microversion: 2.1 time: 0.179373 Aug 24 10:40:49.540125 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2432/5229] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:40:49 2022] POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:40:49.548073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-80fc7e3a-d193-445d-a5cb-970e998bfb99 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:49.551781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-80fc7e3a-d193-445d-a5cb-970e998bfb99 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:49.554343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:49.564246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4744a3e5-e32d-4993-ad21-8c99e4842ec5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:49.566564 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4744a3e5-e32d-4993-ad21-8c99e4842ec5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:49.576316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80fc7e3a-d193-445d-a5cb-970e998bfb99 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:49.576316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80fc7e3a-d193-445d-a5cb-970e998bfb99 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:49.576316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80fc7e3a-d193-445d-a5cb-970e998bfb99 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:49.576316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80fc7e3a-d193-445d-a5cb-970e998bfb99 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:49.582471 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80fc7e3a-d193-445d-a5cb-970e998bfb99 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:49.582471 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80fc7e3a-d193-445d-a5cb-970e998bfb99 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:49.588030 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4744a3e5-e32d-4993-ad21-8c99e4842ec5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:49.588030 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4744a3e5-e32d-4993-ad21-8c99e4842ec5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:49.588030 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4744a3e5-e32d-4993-ad21-8c99e4842ec5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:49.591696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4744a3e5-e32d-4993-ad21-8c99e4842ec5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:49.592698 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4744a3e5-e32d-4993-ad21-8c99e4842ec5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:49.593405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4744a3e5-e32d-4993-ad21-8c99e4842ec5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:49.946911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:50.201412 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-80fc7e3a-d193-445d-a5cb-970e998bfb99 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:50.216981 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-80fc7e3a-d193-445d-a5cb-970e998bfb99 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1510 microversion: 2.1 time: 0.671508 Aug 24 10:40:50.220944 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2798/5230] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:49 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1510 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:50.252327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4744a3e5-e32d-4993-ad21-8c99e4842ec5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:50.272962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6564a6bc-a537-4462-abc8-58c1b05c5756 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:50.275069 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4744a3e5-e32d-4993-ad21-8c99e4842ec5 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1677 microversion: 2.1 time: 0.724751 Aug 24 10:40:50.278283 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2433/5231] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:49 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1677 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:50.279242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6564a6bc-a537-4462-abc8-58c1b05c5756 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: 94eebedc-5d3f-404b-bdf6-d039b5baf150] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:50.287534 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-66c64b8c-77fc-4a78-a16d-422ed4a58953 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:50.291139 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-66c64b8c-77fc-4a78-a16d-422ed4a58953 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: af89e9af-4d73-40d4-aa95-816a03bd5b13] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:50.308418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6564a6bc-a537-4462-abc8-58c1b05c5756 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:50.313685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6564a6bc-a537-4462-abc8-58c1b05c5756 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:50.314270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6564a6bc-a537-4462-abc8-58c1b05c5756 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:50.315246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6564a6bc-a537-4462-abc8-58c1b05c5756 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:50.317730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6564a6bc-a537-4462-abc8-58c1b05c5756 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:50.323691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6564a6bc-a537-4462-abc8-58c1b05c5756 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:50.334591 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66c64b8c-77fc-4a78-a16d-422ed4a58953 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:50.336026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66c64b8c-77fc-4a78-a16d-422ed4a58953 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:50.336712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66c64b8c-77fc-4a78-a16d-422ed4a58953 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:50.338109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66c64b8c-77fc-4a78-a16d-422ed4a58953 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:50.339986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66c64b8c-77fc-4a78-a16d-422ed4a58953 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:50.349379 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66c64b8c-77fc-4a78-a16d-422ed4a58953 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:50.885721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6564a6bc-a537-4462-abc8-58c1b05c5756 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988cbd2509314aeaa9ad618e705894d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc5853f2c1c434f832d5ffc2f550bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:50.921783 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6564a6bc-a537-4462-abc8-58c1b05c5756 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150" status: 200 len: 1318 microversion: 2.1 time: 0.696974 Aug 24 10:40:50.922650 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2799/5232] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:50 2022] GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150 => generated 1318 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:51.244246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7ed9d2cc-7cb6-4630-8b90-c0ec6909ede2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:51.245604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7ed9d2cc-7cb6-4630-8b90-c0ec6909ede2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:51.257708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ed9d2cc-7cb6-4630-8b90-c0ec6909ede2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:51.261274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ed9d2cc-7cb6-4630-8b90-c0ec6909ede2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:51.261890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ed9d2cc-7cb6-4630-8b90-c0ec6909ede2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:51.262735 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ed9d2cc-7cb6-4630-8b90-c0ec6909ede2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:51.263225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ed9d2cc-7cb6-4630-8b90-c0ec6909ede2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:51.263808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ed9d2cc-7cb6-4630-8b90-c0ec6909ede2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:51.576891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7ed9d2cc-7cb6-4630-8b90-c0ec6909ede2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:51.603383 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7ed9d2cc-7cb6-4630-8b90-c0ec6909ede2 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1510 microversion: 2.1 time: 0.364643 Aug 24 10:40:51.604190 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2800/5233] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:51 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1510 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:40:51.611113 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-66c64b8c-77fc-4a78-a16d-422ed4a58953 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13" status: 200 len: 1463 microversion: 2.1 time: 1.331320 Aug 24 10:40:51.628158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6d4f5fc2-31f2-45b9-8713-918ab8e53278 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:51.628678 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2434/5234] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:50 2022] GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13 => generated 1463 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:51.629032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6d4f5fc2-31f2-45b9-8713-918ab8e53278 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:51.660568 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d4f5fc2-31f2-45b9-8713-918ab8e53278 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:51.661549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d4f5fc2-31f2-45b9-8713-918ab8e53278 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:51.662311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d4f5fc2-31f2-45b9-8713-918ab8e53278 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:51.663539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d4f5fc2-31f2-45b9-8713-918ab8e53278 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:51.664343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d4f5fc2-31f2-45b9-8713-918ab8e53278 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:51.669250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d4f5fc2-31f2-45b9-8713-918ab8e53278 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:51.886192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6d4f5fc2-31f2-45b9-8713-918ab8e53278 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:51.897920 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6d4f5fc2-31f2-45b9-8713-918ab8e53278 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1660 microversion: 2.1 time: 0.288133 Aug 24 10:40:51.899108 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2801/5235] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:51 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1660 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:51.919660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-43a75b0b-5c3b-4703-88e2-d4a3f070dbb1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:40:51.920585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-43a75b0b-5c3b-4703-88e2-d4a3f070dbb1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:51.922971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:51.930563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43a75b0b-5c3b-4703-88e2-d4a3f070dbb1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:51.931429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43a75b0b-5c3b-4703-88e2-d4a3f070dbb1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:51.932098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43a75b0b-5c3b-4703-88e2-d4a3f070dbb1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:51.933023 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43a75b0b-5c3b-4703-88e2-d4a3f070dbb1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:51.933784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43a75b0b-5c3b-4703-88e2-d4a3f070dbb1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:51.934481 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43a75b0b-5c3b-4703-88e2-d4a3f070dbb1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:51.944063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-05eb5374-6446-4022-bde4-91fd3c85ce73 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:51.945381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-05eb5374-6446-4022-bde4-91fd3c85ce73 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: 94eebedc-5d3f-404b-bdf6-d039b5baf150] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:51.953897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05eb5374-6446-4022-bde4-91fd3c85ce73 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:51.955021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05eb5374-6446-4022-bde4-91fd3c85ce73 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:51.955673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05eb5374-6446-4022-bde4-91fd3c85ce73 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:51.956559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05eb5374-6446-4022-bde4-91fd3c85ce73 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:51.957211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05eb5374-6446-4022-bde4-91fd3c85ce73 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:51.957801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05eb5374-6446-4022-bde4-91fd3c85ce73 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:52.127274 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-43a75b0b-5c3b-4703-88e2-d4a3f070dbb1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action" status: 202 len: 0 microversion: 2.1 time: 0.209901 Aug 24 10:40:52.130897 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2435/5236] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:40:51 2022] POST /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:40:52.150041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a8cfa0d6-b82f-4941-858a-b7077adfb53a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:52.152049 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a8cfa0d6-b82f-4941-858a-b7077adfb53a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:52.169112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-05eb5374-6446-4022-bde4-91fd3c85ce73 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988cbd2509314aeaa9ad618e705894d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc5853f2c1c434f832d5ffc2f550bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:52.178112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8cfa0d6-b82f-4941-858a-b7077adfb53a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:52.179932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8cfa0d6-b82f-4941-858a-b7077adfb53a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:52.181113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8cfa0d6-b82f-4941-858a-b7077adfb53a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:52.183634 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-05eb5374-6446-4022-bde4-91fd3c85ce73 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150" status: 200 len: 1318 microversion: 2.1 time: 0.243688 Aug 24 10:40:52.184118 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8cfa0d6-b82f-4941-858a-b7077adfb53a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:52.185689 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8cfa0d6-b82f-4941-858a-b7077adfb53a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:52.186350 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8cfa0d6-b82f-4941-858a-b7077adfb53a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:52.215204 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2802/5237] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:51 2022] GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150 => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:40:52.231380 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:52.307935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:52.366913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-204bca0a-685e-4dee-853d-33dc7333e151 req-10e2b1ce-b2ac-4b0e-98e7-2aac7c47c5a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af89e9af-4d73-40d4-aa95-816a03bd5b13", "name": "network-vif-plugged", "status": "completed", "tag": "8e49be9b-a5d0-4573-8115-172b8ad0e973"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:40:52.405446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-204bca0a-685e-4dee-853d-33dc7333e151 req-10e2b1ce-b2ac-4b0e-98e7-2aac7c47c5a8 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:52.407790 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-204bca0a-685e-4dee-853d-33dc7333e151 req-10e2b1ce-b2ac-4b0e-98e7-2aac7c47c5a8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:52.408458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-204bca0a-685e-4dee-853d-33dc7333e151 req-10e2b1ce-b2ac-4b0e-98e7-2aac7c47c5a8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:52.430670 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-204bca0a-685e-4dee-853d-33dc7333e151 req-10e2b1ce-b2ac-4b0e-98e7-2aac7c47c5a8 service nova] Creating event network-vif-plugged:8e49be9b-a5d0-4573-8115-172b8ad0e973 for instance af89e9af-4d73-40d4-aa95-816a03bd5b13 on n-h2-849328-3 Aug 24 10:40:52.446005 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-204bca0a-685e-4dee-853d-33dc7333e151 req-10e2b1ce-b2ac-4b0e-98e7-2aac7c47c5a8 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083950 Aug 24 10:40:52.447362 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2803/5238] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:40:52.635921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-607e9f4e-c8c0-4569-82aa-a45699cbd893 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:52.636756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-607e9f4e-c8c0-4569-82aa-a45699cbd893 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: af89e9af-4d73-40d4-aa95-816a03bd5b13] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:52.649565 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-607e9f4e-c8c0-4569-82aa-a45699cbd893 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:52.650530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-607e9f4e-c8c0-4569-82aa-a45699cbd893 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:52.651276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-607e9f4e-c8c0-4569-82aa-a45699cbd893 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:52.653695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-607e9f4e-c8c0-4569-82aa-a45699cbd893 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:52.655912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-607e9f4e-c8c0-4569-82aa-a45699cbd893 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:52.656543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-607e9f4e-c8c0-4569-82aa-a45699cbd893 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:53.094621 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-607e9f4e-c8c0-4569-82aa-a45699cbd893 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13" status: 200 len: 1463 microversion: 2.1 time: 0.462290 Aug 24 10:40:53.096493 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2804/5239] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:52 2022] GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13 => generated 1463 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:40:53.104574 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-62cb3e1b-cfc5-4404-80be-4e0c0cfd47b9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:53.105839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-62cb3e1b-cfc5-4404-80be-4e0c0cfd47b9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:53.116945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62cb3e1b-cfc5-4404-80be-4e0c0cfd47b9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:53.119090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62cb3e1b-cfc5-4404-80be-4e0c0cfd47b9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:53.121095 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62cb3e1b-cfc5-4404-80be-4e0c0cfd47b9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:53.122908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62cb3e1b-cfc5-4404-80be-4e0c0cfd47b9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:53.123620 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62cb3e1b-cfc5-4404-80be-4e0c0cfd47b9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:53.124900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62cb3e1b-cfc5-4404-80be-4e0c0cfd47b9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:53.321019 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a8cfa0d6-b82f-4941-858a-b7077adfb53a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:53.352016 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a8cfa0d6-b82f-4941-858a-b7077adfb53a tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1666 microversion: 2.1 time: 1.215176 Aug 24 10:40:53.356995 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2436/5240] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:52 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1666 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:53.380331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a73f7f1d-1fb8-4e92-8f55-dad0963f69ca tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:53.384283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a73f7f1d-1fb8-4e92-8f55-dad0963f69ca tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: 94eebedc-5d3f-404b-bdf6-d039b5baf150] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:53.407998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a73f7f1d-1fb8-4e92-8f55-dad0963f69ca tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:53.409534 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a73f7f1d-1fb8-4e92-8f55-dad0963f69ca tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:53.411139 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a73f7f1d-1fb8-4e92-8f55-dad0963f69ca tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:53.412136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a73f7f1d-1fb8-4e92-8f55-dad0963f69ca tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:53.413360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a73f7f1d-1fb8-4e92-8f55-dad0963f69ca tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:53.414105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a73f7f1d-1fb8-4e92-8f55-dad0963f69ca tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:53.611994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-62cb3e1b-cfc5-4404-80be-4e0c0cfd47b9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:53.629777 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-62cb3e1b-cfc5-4404-80be-4e0c0cfd47b9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1510 microversion: 2.1 time: 0.530325 Aug 24 10:40:53.632119 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2805/5241] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:53 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1510 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:53.907169 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a73f7f1d-1fb8-4e92-8f55-dad0963f69ca tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988cbd2509314aeaa9ad618e705894d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc5853f2c1c434f832d5ffc2f550bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:53.921431 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a73f7f1d-1fb8-4e92-8f55-dad0963f69ca tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150" status: 200 len: 1318 microversion: 2.1 time: 0.558426 Aug 24 10:40:53.923306 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2437/5242] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:53 2022] GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150 => generated 1318 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:54.121806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f899a230-9414-4718-b23d-34ba5d39f913 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:54.122438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f899a230-9414-4718-b23d-34ba5d39f913 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: af89e9af-4d73-40d4-aa95-816a03bd5b13] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:54.137649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f899a230-9414-4718-b23d-34ba5d39f913 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:54.138168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f899a230-9414-4718-b23d-34ba5d39f913 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:54.138615 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f899a230-9414-4718-b23d-34ba5d39f913 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:54.139351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f899a230-9414-4718-b23d-34ba5d39f913 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:54.140089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f899a230-9414-4718-b23d-34ba5d39f913 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:54.143999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f899a230-9414-4718-b23d-34ba5d39f913 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:54.376425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7e88e33d-d789-42fc-8e6e-ca7fd33dacc0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:54.378796 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7e88e33d-d789-42fc-8e6e-ca7fd33dacc0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:54.390149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e88e33d-d789-42fc-8e6e-ca7fd33dacc0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:54.390950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e88e33d-d789-42fc-8e6e-ca7fd33dacc0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:54.391536 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e88e33d-d789-42fc-8e6e-ca7fd33dacc0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:54.392434 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e88e33d-d789-42fc-8e6e-ca7fd33dacc0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:54.393050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e88e33d-d789-42fc-8e6e-ca7fd33dacc0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:54.394468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e88e33d-d789-42fc-8e6e-ca7fd33dacc0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:54.640072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7e88e33d-d789-42fc-8e6e-ca7fd33dacc0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:54.649648 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7e88e33d-d789-42fc-8e6e-ca7fd33dacc0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1666 microversion: 2.1 time: 0.278624 Aug 24 10:40:54.650622 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2438/5243] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:54 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1666 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:54.672969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-af4c5fbc-7097-482b-b96c-78e7715531c3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:54.674599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-af4c5fbc-7097-482b-b96c-78e7715531c3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:54.679008 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f899a230-9414-4718-b23d-34ba5d39f913 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13" status: 200 len: 1463 microversion: 2.1 time: 0.561775 Aug 24 10:40:54.683461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af4c5fbc-7097-482b-b96c-78e7715531c3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:54.685592 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af4c5fbc-7097-482b-b96c-78e7715531c3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:54.686323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af4c5fbc-7097-482b-b96c-78e7715531c3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:54.690673 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af4c5fbc-7097-482b-b96c-78e7715531c3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:54.692105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af4c5fbc-7097-482b-b96c-78e7715531c3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:54.692790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af4c5fbc-7097-482b-b96c-78e7715531c3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:54.697916 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2806/5244] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:54 2022] GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13 => generated 1463 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:54.887057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-af4c5fbc-7097-482b-b96c-78e7715531c3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:54.897265 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-af4c5fbc-7097-482b-b96c-78e7715531c3 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1487 microversion: 2.1 time: 0.229574 Aug 24 10:40:54.897878 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2439/5245] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:54 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1487 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:40:54.918987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-707c62e9-fdd5-4035-a190-9085b8948d1b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-816005405"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:40:54.921767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-707c62e9-fdd5-4035-a190-9085b8948d1b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:54.928173 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-707c62e9-fdd5-4035-a190-9085b8948d1b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:54.929405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-707c62e9-fdd5-4035-a190-9085b8948d1b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:54.929405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-707c62e9-fdd5-4035-a190-9085b8948d1b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:54.930297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-707c62e9-fdd5-4035-a190-9085b8948d1b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:54.930297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-707c62e9-fdd5-4035-a190-9085b8948d1b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:54.932254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-707c62e9-fdd5-4035-a190-9085b8948d1b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:54.947423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1c966d86-0ac4-40ad-b2be-51f783f0988e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:54.948110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1c966d86-0ac4-40ad-b2be-51f783f0988e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: 94eebedc-5d3f-404b-bdf6-d039b5baf150] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:54.954857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c966d86-0ac4-40ad-b2be-51f783f0988e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:54.955360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c966d86-0ac4-40ad-b2be-51f783f0988e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:54.956079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c966d86-0ac4-40ad-b2be-51f783f0988e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:54.956508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c966d86-0ac4-40ad-b2be-51f783f0988e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:54.957157 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c966d86-0ac4-40ad-b2be-51f783f0988e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:54.957573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c966d86-0ac4-40ad-b2be-51f783f0988e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:55.036402 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:55.056388 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-707c62e9-fdd5-4035-a190-9085b8948d1b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "PUT /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1059 microversion: 2.1 time: 0.141718 Aug 24 10:40:55.070181 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2807/5246] 10.222.0.85 () {60 vars in 1256 bytes} [Wed Aug 24 10:40:54 2022] PUT /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1059 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:55.095812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3f308be0-5f24-4445-b615-b1746f55eebc tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:55.097077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3f308be0-5f24-4445-b615-b1746f55eebc tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:55.108763 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f308be0-5f24-4445-b615-b1746f55eebc tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:55.109907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f308be0-5f24-4445-b615-b1746f55eebc tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:55.113934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f308be0-5f24-4445-b615-b1746f55eebc tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:55.115603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f308be0-5f24-4445-b615-b1746f55eebc tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:55.116738 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f308be0-5f24-4445-b615-b1746f55eebc tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:55.119321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f308be0-5f24-4445-b615-b1746f55eebc tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:55.218372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1c966d86-0ac4-40ad-b2be-51f783f0988e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988cbd2509314aeaa9ad618e705894d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc5853f2c1c434f832d5ffc2f550bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:55.235672 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1c966d86-0ac4-40ad-b2be-51f783f0988e tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150" status: 200 len: 1318 microversion: 2.1 time: 0.292609 Aug 24 10:40:55.236865 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2440/5247] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:54 2022] GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150 => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:40:55.680353 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-302fd6a5-f290-4286-a732-c8bdb5b03e55 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:55.681485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-302fd6a5-f290-4286-a732-c8bdb5b03e55 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:55.690086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-302fd6a5-f290-4286-a732-c8bdb5b03e55 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:55.690705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-302fd6a5-f290-4286-a732-c8bdb5b03e55 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:55.691319 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-302fd6a5-f290-4286-a732-c8bdb5b03e55 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:55.692017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-302fd6a5-f290-4286-a732-c8bdb5b03e55 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:55.692504 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-302fd6a5-f290-4286-a732-c8bdb5b03e55 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:55.692916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-302fd6a5-f290-4286-a732-c8bdb5b03e55 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:55.794585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3f308be0-5f24-4445-b615-b1746f55eebc tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:55.831417 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3f308be0-5f24-4445-b615-b1746f55eebc tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1486 microversion: 2.1 time: 0.744257 Aug 24 10:40:55.832967 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2808/5248] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:55 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1486 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:55.843197 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1bb454ea-a5c7-4fb2-99a3-34cf90ac4f76 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:55.844375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1bb454ea-a5c7-4fb2-99a3-34cf90ac4f76 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: af89e9af-4d73-40d4-aa95-816a03bd5b13] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:55.863553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bb454ea-a5c7-4fb2-99a3-34cf90ac4f76 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:55.866724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bb454ea-a5c7-4fb2-99a3-34cf90ac4f76 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:55.867376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bb454ea-a5c7-4fb2-99a3-34cf90ac4f76 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:55.868144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bb454ea-a5c7-4fb2-99a3-34cf90ac4f76 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:55.868625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bb454ea-a5c7-4fb2-99a3-34cf90ac4f76 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:55.869063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bb454ea-a5c7-4fb2-99a3-34cf90ac4f76 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:56.013443 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-302fd6a5-f290-4286-a732-c8bdb5b03e55 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:56.028931 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-302fd6a5-f290-4286-a732-c8bdb5b03e55 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.352164 Aug 24 10:40:56.030168 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2441/5249] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:55 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:40:56.042199 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-16310347-7ebf-43d4-938f-fadcb7cb5f3b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:56.043261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-16310347-7ebf-43d4-938f-fadcb7cb5f3b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:56.058089 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16310347-7ebf-43d4-938f-fadcb7cb5f3b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:56.058942 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16310347-7ebf-43d4-938f-fadcb7cb5f3b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:56.061775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16310347-7ebf-43d4-938f-fadcb7cb5f3b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:56.062799 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16310347-7ebf-43d4-938f-fadcb7cb5f3b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:56.063478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16310347-7ebf-43d4-938f-fadcb7cb5f3b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:56.065858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16310347-7ebf-43d4-938f-fadcb7cb5f3b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:56.209825 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1bb454ea-a5c7-4fb2-99a3-34cf90ac4f76 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13" status: 200 len: 1647 microversion: 2.1 time: 0.374998 Aug 24 10:40:56.210548 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2809/5250] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:55 2022] GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13 => generated 1647 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:56.216426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-54298272-f8ce-422f-bdc4-ddf978a006b2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:56.217149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-54298272-f8ce-422f-bdc4-ddf978a006b2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:56.224392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54298272-f8ce-422f-bdc4-ddf978a006b2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:56.225980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54298272-f8ce-422f-bdc4-ddf978a006b2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:56.226621 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54298272-f8ce-422f-bdc4-ddf978a006b2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:56.227680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54298272-f8ce-422f-bdc4-ddf978a006b2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:56.228340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54298272-f8ce-422f-bdc4-ddf978a006b2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:56.229048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54298272-f8ce-422f-bdc4-ddf978a006b2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:56.497494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-54298272-f8ce-422f-bdc4-ddf978a006b2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:56.512799 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-54298272-f8ce-422f-bdc4-ddf978a006b2 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1669 microversion: 2.1 time: 0.301017 Aug 24 10:40:56.513818 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2810/5251] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:56 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1669 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:56.526864 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-30c85dc9-9c2f-428d-9a19-5db8c3051497 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:56.534442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-30c85dc9-9c2f-428d-9a19-5db8c3051497 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: af89e9af-4d73-40d4-aa95-816a03bd5b13] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:56.539185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-16310347-7ebf-43d4-938f-fadcb7cb5f3b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:56.553001 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-16310347-7ebf-43d4-938f-fadcb7cb5f3b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1486 microversion: 2.1 time: 0.519874 Aug 24 10:40:56.557441 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2442/5252] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:56 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1486 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:56.564798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30c85dc9-9c2f-428d-9a19-5db8c3051497 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:56.565560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30c85dc9-9c2f-428d-9a19-5db8c3051497 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:56.567722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30c85dc9-9c2f-428d-9a19-5db8c3051497 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:56.568957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30c85dc9-9c2f-428d-9a19-5db8c3051497 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:56.570207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e8b60a6c-4694-4aa1-914b-20accf350fe4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:56.570792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30c85dc9-9c2f-428d-9a19-5db8c3051497 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:56.571326 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30c85dc9-9c2f-428d-9a19-5db8c3051497 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:56.571631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e8b60a6c-4694-4aa1-914b-20accf350fe4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: 94eebedc-5d3f-404b-bdf6-d039b5baf150] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:56.579849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8b60a6c-4694-4aa1-914b-20accf350fe4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:56.580958 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8b60a6c-4694-4aa1-914b-20accf350fe4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:56.581623 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8b60a6c-4694-4aa1-914b-20accf350fe4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:56.582498 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8b60a6c-4694-4aa1-914b-20accf350fe4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:56.583309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8b60a6c-4694-4aa1-914b-20accf350fe4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:56.584479 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8b60a6c-4694-4aa1-914b-20accf350fe4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:56.908433 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-30c85dc9-9c2f-428d-9a19-5db8c3051497 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13" status: 200 len: 1647 microversion: 2.1 time: 0.393237 Aug 24 10:40:56.927438 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2811/5253] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:56 2022] GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13 => generated 1647 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:56.937700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-97ba7c79-7d3d-48b9-b6e3-86619ed70051 req-fae71a63-3148-4c5f-b1d4-f15b27eaafab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94eebedc-5d3f-404b-bdf6-d039b5baf150", "name": "network-vif-plugged", "status": "completed", "tag": "2c0fae0f-ed26-46d3-8761-073190a62a7c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:40:56.958716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-97ba7c79-7d3d-48b9-b6e3-86619ed70051 req-fae71a63-3148-4c5f-b1d4-f15b27eaafab service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:56.959208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-97ba7c79-7d3d-48b9-b6e3-86619ed70051 req-fae71a63-3148-4c5f-b1d4-f15b27eaafab service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:56.959643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-97ba7c79-7d3d-48b9-b6e3-86619ed70051 req-fae71a63-3148-4c5f-b1d4-f15b27eaafab service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:56.982260 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-97ba7c79-7d3d-48b9-b6e3-86619ed70051 req-fae71a63-3148-4c5f-b1d4-f15b27eaafab service nova] Creating event network-vif-plugged:2c0fae0f-ed26-46d3-8761-073190a62a7c for instance 94eebedc-5d3f-404b-bdf6-d039b5baf150 on n-h1-849328-3 Aug 24 10:40:56.993599 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-97ba7c79-7d3d-48b9-b6e3-86619ed70051 req-fae71a63-3148-4c5f-b1d4-f15b27eaafab service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063964 Aug 24 10:40:56.997392 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2812/5254] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:40:57.012681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fd4a2604-fafa-44d1-8017-f3835b7342ca tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:57.013334 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fd4a2604-fafa-44d1-8017-f3835b7342ca tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:57.029335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd4a2604-fafa-44d1-8017-f3835b7342ca tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:57.029847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd4a2604-fafa-44d1-8017-f3835b7342ca tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:57.030292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd4a2604-fafa-44d1-8017-f3835b7342ca tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:57.031012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd4a2604-fafa-44d1-8017-f3835b7342ca tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:57.032009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd4a2604-fafa-44d1-8017-f3835b7342ca tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:57.032152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd4a2604-fafa-44d1-8017-f3835b7342ca tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:57.090292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fd4a2604-fafa-44d1-8017-f3835b7342ca tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:40:57.105167 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.compute.api [None req-fd4a2604-fafa-44d1-8017-f3835b7342ca tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Working on deleting snapshot ff69985a-a55c-4565-aa5e-67ffcd21923a from shelved instance... Aug 24 10:40:57.156876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e8b60a6c-4694-4aa1-914b-20accf350fe4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988cbd2509314aeaa9ad618e705894d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc5853f2c1c434f832d5ffc2f550bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:57.168378 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e8b60a6c-4694-4aa1-914b-20accf350fe4 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150" status: 200 len: 1318 microversion: 2.1 time: 0.608766 Aug 24 10:40:57.184631 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2443/5255] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:56 2022] GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150 => generated 1318 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:57.191075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0f5f0fbf-c186-4223-b5c0-ffdd8730bb84 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:57.191591 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0f5f0fbf-c186-4223-b5c0-ffdd8730bb84 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:57.202806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f5f0fbf-c186-4223-b5c0-ffdd8730bb84 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:57.203320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f5f0fbf-c186-4223-b5c0-ffdd8730bb84 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:57.203766 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f5f0fbf-c186-4223-b5c0-ffdd8730bb84 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:57.204491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f5f0fbf-c186-4223-b5c0-ffdd8730bb84 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:57.204951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f5f0fbf-c186-4223-b5c0-ffdd8730bb84 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:57.205410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f5f0fbf-c186-4223-b5c0-ffdd8730bb84 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:57.268596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0f5f0fbf-c186-4223-b5c0-ffdd8730bb84 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:40:57.402363 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0f5f0fbf-c186-4223-b5c0-ffdd8730bb84 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "DELETE /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 204 len: 0 microversion: 2.1 time: 0.215919 Aug 24 10:40:57.404131 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2444/5256] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:40:57 2022] DELETE /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:40:57.417170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c15d9a9e-4965-45e3-b745-1d5215051b7d tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:57.418790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c15d9a9e-4965-45e3-b745-1d5215051b7d tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: af89e9af-4d73-40d4-aa95-816a03bd5b13] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:57.445673 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c15d9a9e-4965-45e3-b745-1d5215051b7d tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:57.449301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c15d9a9e-4965-45e3-b745-1d5215051b7d tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:57.449995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c15d9a9e-4965-45e3-b745-1d5215051b7d tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:57.450902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c15d9a9e-4965-45e3-b745-1d5215051b7d tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:57.453044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c15d9a9e-4965-45e3-b745-1d5215051b7d tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:57.453653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c15d9a9e-4965-45e3-b745-1d5215051b7d tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:57.924902 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c15d9a9e-4965-45e3-b745-1d5215051b7d tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13" status: 200 len: 1647 microversion: 2.1 time: 0.514915 Aug 24 10:40:57.925112 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2445/5257] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:57 2022] GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13 => generated 1647 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:57.949695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-25bc5ed3-ed4a-4693-bc73-8ddd99f8f250 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:57.957638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-25bc5ed3-ed4a-4693-bc73-8ddd99f8f250 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:57.981939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25bc5ed3-ed4a-4693-bc73-8ddd99f8f250 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:57.982641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25bc5ed3-ed4a-4693-bc73-8ddd99f8f250 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:57.983276 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25bc5ed3-ed4a-4693-bc73-8ddd99f8f250 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:57.984315 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25bc5ed3-ed4a-4693-bc73-8ddd99f8f250 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:57.985445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25bc5ed3-ed4a-4693-bc73-8ddd99f8f250 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:57.988074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25bc5ed3-ed4a-4693-bc73-8ddd99f8f250 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:58.313745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-25bc5ed3-ed4a-4693-bc73-8ddd99f8f250 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:58.335139 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-25bc5ed3-ed4a-4693-bc73-8ddd99f8f250 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1492 microversion: 2.1 time: 0.404266 Aug 24 10:40:58.338593 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2446/5258] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:57 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1492 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:58.356002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9225ca7b-d881-4211-9355-dc4c03790356 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:58.361021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9225ca7b-d881-4211-9355-dc4c03790356 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: af89e9af-4d73-40d4-aa95-816a03bd5b13] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:58.381976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9225ca7b-d881-4211-9355-dc4c03790356 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:58.383405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9225ca7b-d881-4211-9355-dc4c03790356 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:58.385104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9225ca7b-d881-4211-9355-dc4c03790356 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:58.386646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9225ca7b-d881-4211-9355-dc4c03790356 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:58.391587 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9225ca7b-d881-4211-9355-dc4c03790356 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:58.394845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9225ca7b-d881-4211-9355-dc4c03790356 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:58.453443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fd4a2604-fafa-44d1-8017-f3835b7342ca tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Doing local delete in cell e852a9c4-5bbb-4a78-aec0-794708e7e59e(cell1) {{(pid=122433) _delete /opt/stack/nova/nova/compute/api.py:2533}} Aug 24 10:40:58.455254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd4a2604-fafa-44d1-8017-f3835b7342ca tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:58.481625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd4a2604-fafa-44d1-8017-f3835b7342ca tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:58.482218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd4a2604-fafa-44d1-8017-f3835b7342ca tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:58.486475 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.compute.api [None req-fd4a2604-fafa-44d1-8017-f3835b7342ca tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 24 10:40:58.522002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9225ca7b-d881-4211-9355-dc4c03790356 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: af89e9af-4d73-40d4-aa95-816a03bd5b13] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:40:58.536945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-fd4a2604-fafa-44d1-8017-f3835b7342ca tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] deallocate_for_instance() {{(pid=122433) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 24 10:40:58.840917 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9225ca7b-d881-4211-9355-dc4c03790356 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "DELETE /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13" status: 204 len: 0 microversion: 2.1 time: 0.498549 Aug 24 10:40:58.846181 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2447/5259] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:40:58 2022] DELETE /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:40:58.862287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ab0765e0-d53e-4b25-afb7-5d41a2606fd9 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:58.863341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ab0765e0-d53e-4b25-afb7-5d41a2606fd9 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: 94eebedc-5d3f-404b-bdf6-d039b5baf150] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:58.882388 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab0765e0-d53e-4b25-afb7-5d41a2606fd9 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:58.883252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab0765e0-d53e-4b25-afb7-5d41a2606fd9 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:58.883986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab0765e0-d53e-4b25-afb7-5d41a2606fd9 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:58.885018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab0765e0-d53e-4b25-afb7-5d41a2606fd9 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:58.886019 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab0765e0-d53e-4b25-afb7-5d41a2606fd9 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:58.888576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab0765e0-d53e-4b25-afb7-5d41a2606fd9 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:59.461418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ab0765e0-d53e-4b25-afb7-5d41a2606fd9 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988cbd2509314aeaa9ad618e705894d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc5853f2c1c434f832d5ffc2f550bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:40:59.478081 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ab0765e0-d53e-4b25-afb7-5d41a2606fd9 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150" status: 200 len: 1507 microversion: 2.1 time: 0.630299 Aug 24 10:40:59.479373 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2448/5260] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:58 2022] GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150 => generated 1507 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:40:59.484974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8085219c-2e94-405a-a7b4-14f76dc30cd9 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:40:59.502145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8085219c-2e94-405a-a7b4-14f76dc30cd9 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: af89e9af-4d73-40d4-aa95-816a03bd5b13] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:40:59.522209 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8085219c-2e94-405a-a7b4-14f76dc30cd9 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:59.523102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8085219c-2e94-405a-a7b4-14f76dc30cd9 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:59.530245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8085219c-2e94-405a-a7b4-14f76dc30cd9 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:59.532109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8085219c-2e94-405a-a7b4-14f76dc30cd9 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:40:59.533302 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8085219c-2e94-405a-a7b4-14f76dc30cd9 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:40:59.534915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8085219c-2e94-405a-a7b4-14f76dc30cd9 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:40:59.988348 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:00.008173 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-fd4a2604-fafa-44d1-8017-f3835b7342ca tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Updating instance_info_cache with network_info: [] {{(pid=122433) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 10:41:00.012837 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8085219c-2e94-405a-a7b4-14f76dc30cd9 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13" status: 200 len: 1653 microversion: 2.1 time: 0.531146 Aug 24 10:41:00.018427 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2449/5261] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:40:59 2022] GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13 => generated 1653 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:00.033477 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-919cde0d-7814-469c-960b-5b006d9295c0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:00.034370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-919cde0d-7814-469c-960b-5b006d9295c0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:00.045423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-919cde0d-7814-469c-960b-5b006d9295c0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:00.046162 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-919cde0d-7814-469c-960b-5b006d9295c0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:00.047255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-919cde0d-7814-469c-960b-5b006d9295c0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:00.048567 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-919cde0d-7814-469c-960b-5b006d9295c0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:00.049408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-919cde0d-7814-469c-960b-5b006d9295c0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:00.050025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-919cde0d-7814-469c-960b-5b006d9295c0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:00.664457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-919cde0d-7814-469c-960b-5b006d9295c0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:00.666213 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fd4a2604-fafa-44d1-8017-f3835b7342ca tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "DELETE /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 204 len: 0 microversion: 2.1 time: 3.667283 Aug 24 10:41:00.667734 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2813/5262] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:40:56 2022] DELETE /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 0 bytes in 3669 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:41:00.676197 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ce700d5a-5648-4768-a4be-91f0a4d73c9a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de6069dd-b255-4ec1-b067-642608dcc9dc", "device": "/dev/sdb"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:41:00.677997 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-919cde0d-7814-469c-960b-5b006d9295c0 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1492 microversion: 2.1 time: 0.658249 Aug 24 10:41:00.679630 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2450/5263] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:00 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1492 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:00.691095 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-66a04610-984f-4713-b499-6255de333bae req-4fcbf0cc-22bb-478b-b91b-2d647ba20ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5484349-8f24-4e16-9ab3-5ac504825bfd", "name": "network-vif-deleted", "tag": "9c4133d6-1151-4533-993d-a245cb9d286b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:41:00.693090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ce700d5a-5648-4768-a4be-91f0a4d73c9a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: 94eebedc-5d3f-404b-bdf6-d039b5baf150] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:00.712535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:00.713942 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-66a04610-984f-4713-b499-6255de333bae req-4fcbf0cc-22bb-478b-b91b-2d647ba20ff7 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:00.715503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-66a04610-984f-4713-b499-6255de333bae req-4fcbf0cc-22bb-478b-b91b-2d647ba20ff7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:00.717765 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-66a04610-984f-4713-b499-6255de333bae req-4fcbf0cc-22bb-478b-b91b-2d647ba20ff7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:00.723344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce700d5a-5648-4768-a4be-91f0a4d73c9a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:00.724254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce700d5a-5648-4768-a4be-91f0a4d73c9a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:00.724888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce700d5a-5648-4768-a4be-91f0a4d73c9a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:00.734237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce700d5a-5648-4768-a4be-91f0a4d73c9a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:00.735256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce700d5a-5648-4768-a4be-91f0a4d73c9a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:00.736994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce700d5a-5648-4768-a4be-91f0a4d73c9a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:00.743895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.compute.server_external_events [req-66a04610-984f-4713-b499-6255de333bae req-4fcbf0cc-22bb-478b-b91b-2d647ba20ff7 service nova] Unable to find a host for instance e5484349-8f24-4e16-9ab3-5ac504825bfd. Dropping event network-vif-deleted {{(pid=122432) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 10:41:00.745534 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-66a04610-984f-4713-b499-6255de333bae req-4fcbf0cc-22bb-478b-b91b-2d647ba20ff7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.063052 Aug 24 10:41:00.746728 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2451/5264] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 66 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 10:41:00.753794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e3de6c86-8f2d-45cc-b818-326a3b66e5b1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:00.754872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e3de6c86-8f2d-45cc-b818-326a3b66e5b1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: e5484349-8f24-4e16-9ab3-5ac504825bfd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:00.824707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3de6c86-8f2d-45cc-b818-326a3b66e5b1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:00.826296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3de6c86-8f2d-45cc-b818-326a3b66e5b1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:00.827571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3de6c86-8f2d-45cc-b818-326a3b66e5b1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:00.829271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3de6c86-8f2d-45cc-b818-326a3b66e5b1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:00.830546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3de6c86-8f2d-45cc-b818-326a3b66e5b1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:00.832018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3de6c86-8f2d-45cc-b818-326a3b66e5b1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:00.857090 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-e3de6c86-8f2d-45cc-b818-326a3b66e5b1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] HTTP exception thrown: Instance e5484349-8f24-4e16-9ab3-5ac504825bfd could not be found. Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e3de6c86-8f2d-45cc-b818-326a3b66e5b1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Request method failure captured: Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd HTTP/1.1 Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf4TQ-ANQmryHMcmh9mjA8auVh1UVU40Ptyqc8C7SVEqbwoTaJhYRV2L-5dPBBr1S5HtWMawW3k8YGb_tKrCiEye7fzruwlhEHHLdof87q4HL1nmhzukhg_36RvG00tLOGcZO9HQ1UY-3nEC3lK5bXyxvHMgEJdlWvWiw7WTxDs1y50 Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 3d511560c1f543169e7eab8c70c9abcd Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerActionsTestJSON-1329836544 Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3d511560c1f543169e7eab8c70c9abcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3d511560c1f543169e7eab8c70c9abcd", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3d511560c1f543169e7eab8c70c9abcd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3d511560c1f543169e7eab8c70c9abcd"}]}] Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerActionsTestJSON-1329836544 Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 3d511560c1f543169e7eab8c70c9abcd Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerActionsTestJSON-1329836544 Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerActionsTestJSON-1329836544-project Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 03ef6a33c1f0467993486547b7d00fda Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerActionsTestJSON-1329836544-project Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance e5484349-8f24-4e16-9ab3-5ac504825bfd could not be found. Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'e5484349-8f24-4e16-9ab3-5ac504825bfd'} Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5484349-8f24-4e16-9ab3-5ac504825bfd could not be found. Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5484349-8f24-4e16-9ab3-5ac504825bfd could not be found. Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:00.862153 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:00.866000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:00.866000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:00.866000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:00.866000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:41:00.866000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:41:00.866000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5484349-8f24-4e16-9ab3-5ac504825bfd could not be found. Aug 24 10:41:00.866000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:00.866000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e3de6c86-8f2d-45cc-b818-326a3b66e5b1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Returning 404 to user: Instance e5484349-8f24-4e16-9ab3-5ac504825bfd could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:41:00.866000 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e3de6c86-8f2d-45cc-b818-326a3b66e5b1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd" status: 404 len: 111 microversion: 2.1 time: 0.115740 Aug 24 10:41:00.866000 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2452/5265] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:00 2022] GET /compute/v2.1/servers/e5484349-8f24-4e16-9ab3-5ac504825bfd => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:41:00.873038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7ea07976-3600-4846-a123-9dbb99ef8cef tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:00.873723 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7ea07976-3600-4846-a123-9dbb99ef8cef tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 29b3cde5-4716-49f6-b3d3-11d12a290375] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:00.883245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ea07976-3600-4846-a123-9dbb99ef8cef tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:00.883245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ea07976-3600-4846-a123-9dbb99ef8cef tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:00.883858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ea07976-3600-4846-a123-9dbb99ef8cef tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:00.884752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ea07976-3600-4846-a123-9dbb99ef8cef tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:00.885250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ea07976-3600-4846-a123-9dbb99ef8cef tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:00.885677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ea07976-3600-4846-a123-9dbb99ef8cef tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:00.920310 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7ea07976-3600-4846-a123-9dbb99ef8cef tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 29b3cde5-4716-49f6-b3d3-11d12a290375] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:41:01.027277 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7ea07976-3600-4846-a123-9dbb99ef8cef tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "DELETE /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375" status: 204 len: 0 microversion: 2.1 time: 0.157042 Aug 24 10:41:01.034435 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2453/5266] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:41:00 2022] DELETE /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:41:01.051586 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-abf4f188-c536-437a-ba23-d0a1d518ce7d tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:01.054072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-abf4f188-c536-437a-ba23-d0a1d518ce7d tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: af89e9af-4d73-40d4-aa95-816a03bd5b13] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:01.071544 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abf4f188-c536-437a-ba23-d0a1d518ce7d tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:01.072789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abf4f188-c536-437a-ba23-d0a1d518ce7d tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:01.073294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abf4f188-c536-437a-ba23-d0a1d518ce7d tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:01.074133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abf4f188-c536-437a-ba23-d0a1d518ce7d tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:01.074604 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abf4f188-c536-437a-ba23-d0a1d518ce7d tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:01.076621 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abf4f188-c536-437a-ba23-d0a1d518ce7d tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:01.546867 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-abf4f188-c536-437a-ba23-d0a1d518ce7d tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13" status: 200 len: 1653 microversion: 2.1 time: 0.507376 Aug 24 10:41:01.547918 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2454/5267] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:01 2022] GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13 => generated 1653 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:01.556506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-734c7217-a523-4390-947a-e8b99efe5e6f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:01.558137 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-734c7217-a523-4390-947a-e8b99efe5e6f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 29b3cde5-4716-49f6-b3d3-11d12a290375] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:01.566488 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-734c7217-a523-4390-947a-e8b99efe5e6f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:01.567335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-734c7217-a523-4390-947a-e8b99efe5e6f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:01.568064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-734c7217-a523-4390-947a-e8b99efe5e6f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:01.569050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-734c7217-a523-4390-947a-e8b99efe5e6f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:01.569792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-734c7217-a523-4390-947a-e8b99efe5e6f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:01.570953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-734c7217-a523-4390-947a-e8b99efe5e6f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:01.750974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-734c7217-a523-4390-947a-e8b99efe5e6f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:01.767418 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-734c7217-a523-4390-947a-e8b99efe5e6f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375" status: 200 len: 1465 microversion: 2.1 time: 0.214672 Aug 24 10:41:01.768047 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2455/5268] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:01 2022] GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375 => generated 1465 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:01.785900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b92d26a1-d9bc-4a3b-85cc-3c9bdf69448c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:01.786641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b92d26a1-d9bc-4a3b-85cc-3c9bdf69448c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:01.794544 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b92d26a1-d9bc-4a3b-85cc-3c9bdf69448c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:01.795301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b92d26a1-d9bc-4a3b-85cc-3c9bdf69448c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:01.795880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b92d26a1-d9bc-4a3b-85cc-3c9bdf69448c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:01.796925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b92d26a1-d9bc-4a3b-85cc-3c9bdf69448c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:01.797660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b92d26a1-d9bc-4a3b-85cc-3c9bdf69448c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:01.798726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b92d26a1-d9bc-4a3b-85cc-3c9bdf69448c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:01.961884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b92d26a1-d9bc-4a3b-85cc-3c9bdf69448c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:01.973940 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b92d26a1-d9bc-4a3b-85cc-3c9bdf69448c tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 200 len: 1450 microversion: 2.1 time: 0.204315 Aug 24 10:41:01.974564 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2456/5269] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:01 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 1450 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:02.478710 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-a1698d21-4db1-4fe5-8a2f-42d3068c9051 req-cb2ecb60-6d0b-48b5-a8b8-971e62bcb067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af89e9af-4d73-40d4-aa95-816a03bd5b13", "name": "network-vif-deleted", "tag": "8e49be9b-a5d0-4573-8115-172b8ad0e973"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:41:02.496552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a1698d21-4db1-4fe5-8a2f-42d3068c9051 req-cb2ecb60-6d0b-48b5-a8b8-971e62bcb067 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:02.500576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a1698d21-4db1-4fe5-8a2f-42d3068c9051 req-cb2ecb60-6d0b-48b5-a8b8-971e62bcb067 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:02.514702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a1698d21-4db1-4fe5-8a2f-42d3068c9051 req-cb2ecb60-6d0b-48b5-a8b8-971e62bcb067 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:02.542088 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-a1698d21-4db1-4fe5-8a2f-42d3068c9051 req-cb2ecb60-6d0b-48b5-a8b8-971e62bcb067 service nova] Creating event network-vif-deleted:8e49be9b-a5d0-4573-8115-172b8ad0e973 for instance af89e9af-4d73-40d4-aa95-816a03bd5b13 on n-h2-849328-3 Aug 24 10:41:02.547581 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-a1698d21-4db1-4fe5-8a2f-42d3068c9051 req-cb2ecb60-6d0b-48b5-a8b8-971e62bcb067 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073146 Aug 24 10:41:02.548543 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2457/5270] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:41:02.572671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ed5e94a6-aa06-49a3-a37e-4cac2addd285 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:02.573784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ed5e94a6-aa06-49a3-a37e-4cac2addd285 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: af89e9af-4d73-40d4-aa95-816a03bd5b13] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:02.583206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed5e94a6-aa06-49a3-a37e-4cac2addd285 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:02.583902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed5e94a6-aa06-49a3-a37e-4cac2addd285 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:02.584567 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed5e94a6-aa06-49a3-a37e-4cac2addd285 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:02.585478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed5e94a6-aa06-49a3-a37e-4cac2addd285 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:02.586100 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed5e94a6-aa06-49a3-a37e-4cac2addd285 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:02.586686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed5e94a6-aa06-49a3-a37e-4cac2addd285 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:02.699479 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ed5e94a6-aa06-49a3-a37e-4cac2addd285 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13" status: 200 len: 1611 microversion: 2.1 time: 0.131693 Aug 24 10:41:02.706315 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2458/5271] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:02 2022] GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13 => generated 1611 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:41:02.788708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-02774e8e-7d6f-4a44-9de7-66c71803770f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:02.790682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-02774e8e-7d6f-4a44-9de7-66c71803770f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 29b3cde5-4716-49f6-b3d3-11d12a290375] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:02.808940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02774e8e-7d6f-4a44-9de7-66c71803770f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:02.809721 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02774e8e-7d6f-4a44-9de7-66c71803770f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:02.810311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02774e8e-7d6f-4a44-9de7-66c71803770f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:02.812630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02774e8e-7d6f-4a44-9de7-66c71803770f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:02.817028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02774e8e-7d6f-4a44-9de7-66c71803770f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:02.817720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02774e8e-7d6f-4a44-9de7-66c71803770f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:02.957149 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ce700d5a-5648-4768-a4be-91f0a4d73c9a tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "POST /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.268097 Aug 24 10:41:02.962509 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2814/5272] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Aug 24 10:41:00 2022] POST /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150/os-volume_attachments => generated 194 bytes in 2293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:41:02.999101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7a299dd0-ecbb-4dd1-8651-db463454fcf1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:02.999820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7a299dd0-ecbb-4dd1-8651-db463454fcf1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:03.020863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a299dd0-ecbb-4dd1-8651-db463454fcf1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:03.023469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a299dd0-ecbb-4dd1-8651-db463454fcf1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:03.024881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a299dd0-ecbb-4dd1-8651-db463454fcf1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:03.032485 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a299dd0-ecbb-4dd1-8651-db463454fcf1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:03.055985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a299dd0-ecbb-4dd1-8651-db463454fcf1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:03.059573 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a299dd0-ecbb-4dd1-8651-db463454fcf1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:03.120593 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-7a299dd0-ecbb-4dd1-8651-db463454fcf1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] HTTP exception thrown: Instance 63df0acf-c830-4801-8533-ad833b1f0180 could not be found. Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7a299dd0-ecbb-4dd1-8651-db463454fcf1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Request method failure captured: Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 HTTP/1.1 Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf8_-svoJ82Zcz3LMtRJH-LxEmi7YhL3SyNjhBkMMhmGqnW0J0hM18TP4MYYa3JryjRkfD6MJWxRrI1tc6yKAxu9hD6H4E3SSBMepuWzyz5efbHaNXS1nRaEb6aE-x3oa0iXQadiBh1CoF_uoY7wN-kywJAG1lWDamBR5UsabCRziuM Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8b489eabb0014ddc9a2fcdf6e78ee740", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8b489eabb0014ddc9a2fcdf6e78ee740"}]}] Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersTestJSON-523633018 Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersTestJSON-523633018-project Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 83a25a0677c04f8ba975528ece80d676 Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersTestJSON-523633018-project Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 63df0acf-c830-4801-8533-ad833b1f0180 could not be found. Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '63df0acf-c830-4801-8533-ad833b1f0180'} Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63df0acf-c830-4801-8533-ad833b1f0180 could not be found. Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63df0acf-c830-4801-8533-ad833b1f0180 could not be found. Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.122966 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:03.129078 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:03.129078 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:03.129078 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:41:03.129078 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:41:03.129078 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63df0acf-c830-4801-8533-ad833b1f0180 could not be found. Aug 24 10:41:03.129078 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.129078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7a299dd0-ecbb-4dd1-8651-db463454fcf1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Returning 404 to user: Instance 63df0acf-c830-4801-8533-ad833b1f0180 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:41:03.129078 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7a299dd0-ecbb-4dd1-8651-db463454fcf1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 404 len: 111 microversion: 2.1 time: 0.133343 Aug 24 10:41:03.130537 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2815/5273] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:02 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:41:03.141862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-4ef4d9ac-6af7-440c-a944-41236a091007 req-4a7c03b6-a476-4024-81fd-f30ad3cda4a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63df0acf-c830-4801-8533-ad833b1f0180", "name": "network-vif-deleted", "tag": "05916c60-0283-4f9d-b42e-ce2a1dfff874"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:41:03.158716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4ef4d9ac-6af7-440c-a944-41236a091007 req-4a7c03b6-a476-4024-81fd-f30ad3cda4a3 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:03.159209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4ef4d9ac-6af7-440c-a944-41236a091007 req-4a7c03b6-a476-4024-81fd-f30ad3cda4a3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:03.159706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-02774e8e-7d6f-4a44-9de7-66c71803770f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:03.160264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4ef4d9ac-6af7-440c-a944-41236a091007 req-4a7c03b6-a476-4024-81fd-f30ad3cda4a3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:03.176541 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-02774e8e-7d6f-4a44-9de7-66c71803770f tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375" status: 200 len: 1465 microversion: 2.1 time: 0.392168 Aug 24 10:41:03.180795 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2459/5274] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:02 2022] GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375 => generated 1465 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:41:03.196975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-af62cafa-5092-4de4-b99f-42d109b22f2f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:03.200088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-af62cafa-5092-4de4-b99f-42d109b22f2f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:03.218657 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-4ef4d9ac-6af7-440c-a944-41236a091007 req-4a7c03b6-a476-4024-81fd-f30ad3cda4a3 service nova] Creating event network-vif-deleted:05916c60-0283-4f9d-b42e-ce2a1dfff874 for instance 63df0acf-c830-4801-8533-ad833b1f0180 on n-h2-849328-3 Aug 24 10:41:03.226557 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-4ef4d9ac-6af7-440c-a944-41236a091007 req-4a7c03b6-a476-4024-81fd-f30ad3cda4a3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093750 Aug 24 10:41:03.227313 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2816/5275] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:41:03.228967 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af62cafa-5092-4de4-b99f-42d109b22f2f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:03.229501 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af62cafa-5092-4de4-b99f-42d109b22f2f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:03.229938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af62cafa-5092-4de4-b99f-42d109b22f2f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:03.242597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af62cafa-5092-4de4-b99f-42d109b22f2f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:03.244702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af62cafa-5092-4de4-b99f-42d109b22f2f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:03.246008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af62cafa-5092-4de4-b99f-42d109b22f2f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:03.300967 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-af62cafa-5092-4de4-b99f-42d109b22f2f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] HTTP exception thrown: Instance 63df0acf-c830-4801-8533-ad833b1f0180 could not be found. Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-af62cafa-5092-4de4-b99f-42d109b22f2f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Request method failure captured: Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 HTTP/1.1 Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf8_-svoJ82Zcz3LMtRJH-LxEmi7YhL3SyNjhBkMMhmGqnW0J0hM18TP4MYYa3JryjRkfD6MJWxRrI1tc6yKAxu9hD6H4E3SSBMepuWzyz5efbHaNXS1nRaEb6aE-x3oa0iXQadiBh1CoF_uoY7wN-kywJAG1lWDamBR5UsabCRziuM Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8b489eabb0014ddc9a2fcdf6e78ee740", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8b489eabb0014ddc9a2fcdf6e78ee740"}]}] Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestJSON-523633018 Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersTestJSON-523633018-project Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 83a25a0677c04f8ba975528ece80d676 Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestJSON-523633018-project Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 63df0acf-c830-4801-8533-ad833b1f0180 could not be found. Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '63df0acf-c830-4801-8533-ad833b1f0180'} Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63df0acf-c830-4801-8533-ad833b1f0180 could not be found. Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:41:03.304804 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63df0acf-c830-4801-8533-ad833b1f0180 could not be found. Aug 24 10:41:03.309228 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.309228 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:03.309228 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.309228 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:03.309228 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:03.309228 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:03.309228 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:41:03.309228 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:41:03.309228 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63df0acf-c830-4801-8533-ad833b1f0180 could not be found. Aug 24 10:41:03.309228 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.309228 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-af62cafa-5092-4de4-b99f-42d109b22f2f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Returning 404 to user: Instance 63df0acf-c830-4801-8533-ad833b1f0180 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:41:03.309228 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-af62cafa-5092-4de4-b99f-42d109b22f2f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "DELETE /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 404 len: 111 microversion: 2.1 time: 0.125659 Aug 24 10:41:03.315650 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2460/5276] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:41:03 2022] DELETE /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:41:03.321869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ca00f80a-3afe-40ea-8483-15e8d511b22b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:03.322573 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ca00f80a-3afe-40ea-8483-15e8d511b22b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 63df0acf-c830-4801-8533-ad833b1f0180] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:03.341235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca00f80a-3afe-40ea-8483-15e8d511b22b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:03.341786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca00f80a-3afe-40ea-8483-15e8d511b22b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:03.343396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca00f80a-3afe-40ea-8483-15e8d511b22b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:03.363776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca00f80a-3afe-40ea-8483-15e8d511b22b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:03.364398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca00f80a-3afe-40ea-8483-15e8d511b22b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:03.367670 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca00f80a-3afe-40ea-8483-15e8d511b22b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:03.416277 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-ca00f80a-3afe-40ea-8483-15e8d511b22b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] HTTP exception thrown: Instance 63df0acf-c830-4801-8533-ad833b1f0180 could not be found. Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ca00f80a-3afe-40ea-8483-15e8d511b22b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Request method failure captured: Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 HTTP/1.1 Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf8_-svoJ82Zcz3LMtRJH-LxEmi7YhL3SyNjhBkMMhmGqnW0J0hM18TP4MYYa3JryjRkfD6MJWxRrI1tc6yKAxu9hD6H4E3SSBMepuWzyz5efbHaNXS1nRaEb6aE-x3oa0iXQadiBh1CoF_uoY7wN-kywJAG1lWDamBR5UsabCRziuM Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8b489eabb0014ddc9a2fcdf6e78ee740", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8b489eabb0014ddc9a2fcdf6e78ee740"}]}] Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersTestJSON-523633018 Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersTestJSON-523633018-project Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 83a25a0677c04f8ba975528ece80d676 Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersTestJSON-523633018-project Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 63df0acf-c830-4801-8533-ad833b1f0180 could not be found. Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '63df0acf-c830-4801-8533-ad833b1f0180'} Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63df0acf-c830-4801-8533-ad833b1f0180 could not be found. Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63df0acf-c830-4801-8533-ad833b1f0180 could not be found. Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.420725 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:03.425192 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:03.425192 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:03.425192 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:41:03.425192 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:41:03.425192 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63df0acf-c830-4801-8533-ad833b1f0180 could not be found. Aug 24 10:41:03.425192 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.428752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ca00f80a-3afe-40ea-8483-15e8d511b22b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Returning 404 to user: Instance 63df0acf-c830-4801-8533-ad833b1f0180 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:41:03.433333 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ca00f80a-3afe-40ea-8483-15e8d511b22b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180" status: 404 len: 111 microversion: 2.1 time: 0.119061 Aug 24 10:41:03.443254 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2817/5277] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:03 2022] GET /compute/v2.1/servers/63df0acf-c830-4801-8533-ad833b1f0180 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:41:03.447376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-28f189f0-5a5f-43c5-bcdc-8dc46db7afa8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:03.448034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-28f189f0-5a5f-43c5-bcdc-8dc46db7afa8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:03.475499 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28f189f0-5a5f-43c5-bcdc-8dc46db7afa8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:03.476447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28f189f0-5a5f-43c5-bcdc-8dc46db7afa8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:03.477047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28f189f0-5a5f-43c5-bcdc-8dc46db7afa8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:03.478505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28f189f0-5a5f-43c5-bcdc-8dc46db7afa8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:03.479256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28f189f0-5a5f-43c5-bcdc-8dc46db7afa8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:03.480190 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28f189f0-5a5f-43c5-bcdc-8dc46db7afa8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:03.521138 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-28f189f0-5a5f-43c5-bcdc-8dc46db7afa8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] HTTP exception thrown: Instance d38f3a10-55ae-4b9b-9568-60733d40a581 could not be found. Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-28f189f0-5a5f-43c5-bcdc-8dc46db7afa8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Request method failure captured: Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 HTTP/1.1 Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf8_-svoJ82Zcz3LMtRJH-LxEmi7YhL3SyNjhBkMMhmGqnW0J0hM18TP4MYYa3JryjRkfD6MJWxRrI1tc6yKAxu9hD6H4E3SSBMepuWzyz5efbHaNXS1nRaEb6aE-x3oa0iXQadiBh1CoF_uoY7wN-kywJAG1lWDamBR5UsabCRziuM Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8b489eabb0014ddc9a2fcdf6e78ee740", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8b489eabb0014ddc9a2fcdf6e78ee740"}]}] Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestJSON-523633018 Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersTestJSON-523633018-project Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 83a25a0677c04f8ba975528ece80d676 Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestJSON-523633018-project Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance d38f3a10-55ae-4b9b-9568-60733d40a581 could not be found. Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'd38f3a10-55ae-4b9b-9568-60733d40a581'} Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d38f3a10-55ae-4b9b-9568-60733d40a581 could not be found. Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:41:03.527158 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d38f3a10-55ae-4b9b-9568-60733d40a581 could not be found. Aug 24 10:41:03.531290 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.531290 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:03.531290 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.531290 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:03.531290 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:03.531290 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:03.531290 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:41:03.531290 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:41:03.531290 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d38f3a10-55ae-4b9b-9568-60733d40a581 could not be found. Aug 24 10:41:03.531290 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.532864 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-28f189f0-5a5f-43c5-bcdc-8dc46db7afa8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Returning 404 to user: Instance d38f3a10-55ae-4b9b-9568-60733d40a581 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:41:03.536355 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-28f189f0-5a5f-43c5-bcdc-8dc46db7afa8 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581" status: 404 len: 111 microversion: 2.1 time: 0.096211 Aug 24 10:41:03.539995 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2461/5278] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:41:03 2022] DELETE /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:41:03.548692 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9c7db211-291f-4ac4-9220-e3dfa8f5b759 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:03.549803 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9c7db211-291f-4ac4-9220-e3dfa8f5b759 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: d38f3a10-55ae-4b9b-9568-60733d40a581] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:03.570396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c7db211-291f-4ac4-9220-e3dfa8f5b759 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:03.577655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c7db211-291f-4ac4-9220-e3dfa8f5b759 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:03.587522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c7db211-291f-4ac4-9220-e3dfa8f5b759 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:03.590845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c7db211-291f-4ac4-9220-e3dfa8f5b759 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:03.592448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c7db211-291f-4ac4-9220-e3dfa8f5b759 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:03.595255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c7db211-291f-4ac4-9220-e3dfa8f5b759 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:03.640160 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-9c7db211-291f-4ac4-9220-e3dfa8f5b759 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] HTTP exception thrown: Instance d38f3a10-55ae-4b9b-9568-60733d40a581 could not be found. Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9c7db211-291f-4ac4-9220-e3dfa8f5b759 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Request method failure captured: Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 HTTP/1.1 Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf8_-svoJ82Zcz3LMtRJH-LxEmi7YhL3SyNjhBkMMhmGqnW0J0hM18TP4MYYa3JryjRkfD6MJWxRrI1tc6yKAxu9hD6H4E3SSBMepuWzyz5efbHaNXS1nRaEb6aE-x3oa0iXQadiBh1CoF_uoY7wN-kywJAG1lWDamBR5UsabCRziuM Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8b489eabb0014ddc9a2fcdf6e78ee740", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8b489eabb0014ddc9a2fcdf6e78ee740"}]}] Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersTestJSON-523633018 Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersTestJSON-523633018-project Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 83a25a0677c04f8ba975528ece80d676 Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersTestJSON-523633018-project Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance d38f3a10-55ae-4b9b-9568-60733d40a581 could not be found. Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'd38f3a10-55ae-4b9b-9568-60733d40a581'} Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d38f3a10-55ae-4b9b-9568-60733d40a581 could not be found. Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d38f3a10-55ae-4b9b-9568-60733d40a581 could not be found. Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.642130 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:03.645589 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:03.645589 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:03.645589 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:41:03.645589 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:41:03.645589 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d38f3a10-55ae-4b9b-9568-60733d40a581 could not be found. Aug 24 10:41:03.645589 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.655371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9c7db211-291f-4ac4-9220-e3dfa8f5b759 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Returning 404 to user: Instance d38f3a10-55ae-4b9b-9568-60733d40a581 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:41:03.656372 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9c7db211-291f-4ac4-9220-e3dfa8f5b759 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581" status: 404 len: 111 microversion: 2.1 time: 0.111917 Aug 24 10:41:03.657494 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2818/5279] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:03 2022] GET /compute/v2.1/servers/d38f3a10-55ae-4b9b-9568-60733d40a581 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:41:03.665936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ead19f1c-02bf-4fde-ac8a-dde7c716113b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:03.666438 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ead19f1c-02bf-4fde-ac8a-dde7c716113b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:03.675028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ead19f1c-02bf-4fde-ac8a-dde7c716113b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:03.675669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ead19f1c-02bf-4fde-ac8a-dde7c716113b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:03.676445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ead19f1c-02bf-4fde-ac8a-dde7c716113b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:03.680999 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ead19f1c-02bf-4fde-ac8a-dde7c716113b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:03.681849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ead19f1c-02bf-4fde-ac8a-dde7c716113b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:03.682430 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ead19f1c-02bf-4fde-ac8a-dde7c716113b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:03.720257 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-ead19f1c-02bf-4fde-ac8a-dde7c716113b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] HTTP exception thrown: Instance 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 could not be found. Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ead19f1c-02bf-4fde-ac8a-dde7c716113b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Request method failure captured: Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 HTTP/1.1 Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf8_-svoJ82Zcz3LMtRJH-LxEmi7YhL3SyNjhBkMMhmGqnW0J0hM18TP4MYYa3JryjRkfD6MJWxRrI1tc6yKAxu9hD6H4E3SSBMepuWzyz5efbHaNXS1nRaEb6aE-x3oa0iXQadiBh1CoF_uoY7wN-kywJAG1lWDamBR5UsabCRziuM Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8b489eabb0014ddc9a2fcdf6e78ee740", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8b489eabb0014ddc9a2fcdf6e78ee740"}]}] Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestJSON-523633018 Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersTestJSON-523633018-project Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 83a25a0677c04f8ba975528ece80d676 Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestJSON-523633018-project Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 could not be found. Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '0c00e900-78b8-4a70-97b3-d2fa3c9e05d2'} Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 could not be found. Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:41:03.722712 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 could not be found. Aug 24 10:41:03.726566 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.726566 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:03.726566 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.726566 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:03.726566 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:03.726566 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:03.726566 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:41:03.726566 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:41:03.726566 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 could not be found. Aug 24 10:41:03.726566 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.737800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ead19f1c-02bf-4fde-ac8a-dde7c716113b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Returning 404 to user: Instance 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:41:03.737903 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1d7d479c-0973-4a1e-8cd7-48c40ff565e7 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:03.737995 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ead19f1c-02bf-4fde-ac8a-dde7c716113b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "DELETE /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2" status: 404 len: 111 microversion: 2.1 time: 0.073217 Aug 24 10:41:03.738074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1d7d479c-0973-4a1e-8cd7-48c40ff565e7 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: af89e9af-4d73-40d4-aa95-816a03bd5b13] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:03.755262 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2462/5280] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:41:03 2022] DELETE /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:41:03.774600 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d7d479c-0973-4a1e-8cd7-48c40ff565e7 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:03.778208 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-04ab3ba6-17bb-4462-893f-226c41811975 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:03.779271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d7d479c-0973-4a1e-8cd7-48c40ff565e7 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:03.782650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d7d479c-0973-4a1e-8cd7-48c40ff565e7 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:03.783564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d7d479c-0973-4a1e-8cd7-48c40ff565e7 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:03.783677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-04ab3ba6-17bb-4462-893f-226c41811975 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:03.784519 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d7d479c-0973-4a1e-8cd7-48c40ff565e7 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:03.788344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d7d479c-0973-4a1e-8cd7-48c40ff565e7 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:03.797565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04ab3ba6-17bb-4462-893f-226c41811975 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:03.798114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04ab3ba6-17bb-4462-893f-226c41811975 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:03.798496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04ab3ba6-17bb-4462-893f-226c41811975 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:03.799221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04ab3ba6-17bb-4462-893f-226c41811975 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:03.804956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04ab3ba6-17bb-4462-893f-226c41811975 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:03.805441 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04ab3ba6-17bb-4462-893f-226c41811975 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:03.840858 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-1d7d479c-0973-4a1e-8cd7-48c40ff565e7 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] HTTP exception thrown: Instance af89e9af-4d73-40d4-aa95-816a03bd5b13 could not be found. Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1d7d479c-0973-4a1e-8cd7-48c40ff565e7 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Request method failure captured: Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13 HTTP/1.1 Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgAEkdryvkFdI0Ah4Vm7KRPrd5skaGL4y3bmrJ2UVByS2nbTztiTFmtm2tBXLGSt6wq8-XGtl1AjFRPYTdVtdWi15JXYYS0RKRjQH6SAUvuZ0kOElUra0xDl8gpSac7MP8rtThpmq7IVxBhvewv91nbsWqyrqUC3Q8aB9mvRmAQLVcM Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 2b0f6576c12947c386db2c488fcace2d Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestServerMultinode-605727859 Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2b0f6576c12947c386db2c488fcace2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_2b0f6576c12947c386db2c488fcace2d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2b0f6576c12947c386db2c488fcace2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/2b0f6576c12947c386db2c488fcace2d"}]}] Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestServerMultinode-605727859 Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 2b0f6576c12947c386db2c488fcace2d Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestServerMultinode-605727859 Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestServerMultinode-605727859-project-admin Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: a3e99593a56941369eceaec628b8aaad Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestServerMultinode-605727859-project-admin Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance af89e9af-4d73-40d4-aa95-816a03bd5b13 could not be found. Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'af89e9af-4d73-40d4-aa95-816a03bd5b13'} Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af89e9af-4d73-40d4-aa95-816a03bd5b13 could not be found. Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af89e9af-4d73-40d4-aa95-816a03bd5b13 could not be found. Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:03.842831 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.846910 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:03.846910 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:03.846910 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:03.846910 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:41:03.846910 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:41:03.846910 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af89e9af-4d73-40d4-aa95-816a03bd5b13 could not be found. Aug 24 10:41:03.846910 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.848141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1d7d479c-0973-4a1e-8cd7-48c40ff565e7 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Returning 404 to user: Instance af89e9af-4d73-40d4-aa95-816a03bd5b13 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:41:03.849350 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1d7d479c-0973-4a1e-8cd7-48c40ff565e7 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13" status: 404 len: 111 microversion: 2.1 time: 0.130560 Aug 24 10:41:03.851485 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2819/5281] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:03 2022] GET /compute/v2.1/servers/af89e9af-4d73-40d4-aa95-816a03bd5b13 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:41:03.866490 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-04ab3ba6-17bb-4462-893f-226c41811975 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] HTTP exception thrown: Instance 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 could not be found. Aug 24 10:41:03.870334 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7c33053f-4c67-44dc-8495-b186948a43a4 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:03.870905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7c33053f-4c67-44dc-8495-b186948a43a4 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: e61a5d87-9af0-427b-8730-8c84899eda28] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-04ab3ba6-17bb-4462-893f-226c41811975 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Request method failure captured: Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 HTTP/1.1 Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf8_-svoJ82Zcz3LMtRJH-LxEmi7YhL3SyNjhBkMMhmGqnW0J0hM18TP4MYYa3JryjRkfD6MJWxRrI1tc6yKAxu9hD6H4E3SSBMepuWzyz5efbHaNXS1nRaEb6aE-x3oa0iXQadiBh1CoF_uoY7wN-kywJAG1lWDamBR5UsabCRziuM Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8b489eabb0014ddc9a2fcdf6e78ee740", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8b489eabb0014ddc9a2fcdf6e78ee740"}]}] Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestJSON-523633018 Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersTestJSON-523633018-project Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 83a25a0677c04f8ba975528ece80d676 Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestJSON-523633018-project Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 could not be found. Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '0c00e900-78b8-4a70-97b3-d2fa3c9e05d2'} Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 could not be found. Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 could not be found. Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.877688 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:03.881778 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:03.881778 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:03.881778 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:41:03.881778 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:41:03.881778 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 could not be found. Aug 24 10:41:03.881778 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:03.881778 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-04ab3ba6-17bb-4462-893f-226c41811975 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Returning 404 to user: Instance 0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:41:03.882244 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-04ab3ba6-17bb-4462-893f-226c41811975 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2" status: 404 len: 111 microversion: 2.1 time: 0.123673 Aug 24 10:41:03.882456 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2463/5282] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:03 2022] GET /compute/v2.1/servers/0c00e900-78b8-4a70-97b3-d2fa3c9e05d2 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:41:03.897606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c33053f-4c67-44dc-8495-b186948a43a4 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:03.898108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c33053f-4c67-44dc-8495-b186948a43a4 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:03.898547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c33053f-4c67-44dc-8495-b186948a43a4 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:03.899264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c33053f-4c67-44dc-8495-b186948a43a4 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:03.899721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c33053f-4c67-44dc-8495-b186948a43a4 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:03.911366 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0b8683e4-752c-4289-a585-8b52e18f5229 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:03.919137 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0b8683e4-752c-4289-a585-8b52e18f5229 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: a8d638df-397c-4b18-9b86-1ef6ce736fcb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:03.920004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c33053f-4c67-44dc-8495-b186948a43a4 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:03.947729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b8683e4-752c-4289-a585-8b52e18f5229 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:03.948246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b8683e4-752c-4289-a585-8b52e18f5229 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:03.948693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b8683e4-752c-4289-a585-8b52e18f5229 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:03.949504 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b8683e4-752c-4289-a585-8b52e18f5229 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:03.949971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b8683e4-752c-4289-a585-8b52e18f5229 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:03.950399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b8683e4-752c-4289-a585-8b52e18f5229 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:04.002835 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-0b8683e4-752c-4289-a585-8b52e18f5229 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] HTTP exception thrown: Instance a8d638df-397c-4b18-9b86-1ef6ce736fcb could not be found. Aug 24 10:41:04.005472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7c33053f-4c67-44dc-8495-b186948a43a4 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: e61a5d87-9af0-427b-8730-8c84899eda28] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0b8683e4-752c-4289-a585-8b52e18f5229 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Request method failure captured: Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb HTTP/1.1 Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf8_-svoJ82Zcz3LMtRJH-LxEmi7YhL3SyNjhBkMMhmGqnW0J0hM18TP4MYYa3JryjRkfD6MJWxRrI1tc6yKAxu9hD6H4E3SSBMepuWzyz5efbHaNXS1nRaEb6aE-x3oa0iXQadiBh1CoF_uoY7wN-kywJAG1lWDamBR5UsabCRziuM Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8b489eabb0014ddc9a2fcdf6e78ee740", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8b489eabb0014ddc9a2fcdf6e78ee740"}]}] Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestJSON-523633018 Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersTestJSON-523633018-project Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 83a25a0677c04f8ba975528ece80d676 Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestJSON-523633018-project Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance a8d638df-397c-4b18-9b86-1ef6ce736fcb could not be found. Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'a8d638df-397c-4b18-9b86-1ef6ce736fcb'} Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8d638df-397c-4b18-9b86-1ef6ce736fcb could not be found. Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:41:04.009941 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8d638df-397c-4b18-9b86-1ef6ce736fcb could not be found. Aug 24 10:41:04.014118 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.014118 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:04.014118 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.014118 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:04.014118 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:04.014118 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:04.014118 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:41:04.014118 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:41:04.014118 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8d638df-397c-4b18-9b86-1ef6ce736fcb could not be found. Aug 24 10:41:04.014118 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.014118 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0b8683e4-752c-4289-a585-8b52e18f5229 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Returning 404 to user: Instance a8d638df-397c-4b18-9b86-1ef6ce736fcb could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:41:04.014118 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0b8683e4-752c-4289-a585-8b52e18f5229 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb" status: 404 len: 111 microversion: 2.1 time: 0.120680 Aug 24 10:41:04.015112 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2464/5283] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:41:03 2022] DELETE /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:41:04.017080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=18,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:04.028062 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-462ddf27-3be8-49eb-94d0-f5c94cca2635 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:04.034089 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-462ddf27-3be8-49eb-94d0-f5c94cca2635 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: a8d638df-397c-4b18-9b86-1ef6ce736fcb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:04.051780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-462ddf27-3be8-49eb-94d0-f5c94cca2635 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:04.052286 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-462ddf27-3be8-49eb-94d0-f5c94cca2635 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:04.052735 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-462ddf27-3be8-49eb-94d0-f5c94cca2635 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:04.053482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-462ddf27-3be8-49eb-94d0-f5c94cca2635 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:04.053950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-462ddf27-3be8-49eb-94d0-f5c94cca2635 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:04.054383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-462ddf27-3be8-49eb-94d0-f5c94cca2635 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:04.120015 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-462ddf27-3be8-49eb-94d0-f5c94cca2635 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] HTTP exception thrown: Instance a8d638df-397c-4b18-9b86-1ef6ce736fcb could not be found. Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-462ddf27-3be8-49eb-94d0-f5c94cca2635 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Request method failure captured: Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb HTTP/1.1 Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf8_-svoJ82Zcz3LMtRJH-LxEmi7YhL3SyNjhBkMMhmGqnW0J0hM18TP4MYYa3JryjRkfD6MJWxRrI1tc6yKAxu9hD6H4E3SSBMepuWzyz5efbHaNXS1nRaEb6aE-x3oa0iXQadiBh1CoF_uoY7wN-kywJAG1lWDamBR5UsabCRziuM Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8b489eabb0014ddc9a2fcdf6e78ee740", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8b489eabb0014ddc9a2fcdf6e78ee740"}]}] Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestJSON-523633018 Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersTestJSON-523633018-project Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 83a25a0677c04f8ba975528ece80d676 Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestJSON-523633018-project Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance a8d638df-397c-4b18-9b86-1ef6ce736fcb could not be found. Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'a8d638df-397c-4b18-9b86-1ef6ce736fcb'} Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8d638df-397c-4b18-9b86-1ef6ce736fcb could not be found. Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8d638df-397c-4b18-9b86-1ef6ce736fcb could not be found. Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.123111 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:04.127399 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:04.127399 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:04.127399 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:41:04.127399 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:41:04.127399 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8d638df-397c-4b18-9b86-1ef6ce736fcb could not be found. Aug 24 10:41:04.127399 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.129816 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-462ddf27-3be8-49eb-94d0-f5c94cca2635 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Returning 404 to user: Instance a8d638df-397c-4b18-9b86-1ef6ce736fcb could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:41:04.134237 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-462ddf27-3be8-49eb-94d0-f5c94cca2635 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb" status: 404 len: 111 microversion: 2.1 time: 0.117552 Aug 24 10:41:04.141503 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2465/5284] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:04 2022] GET /compute/v2.1/servers/a8d638df-397c-4b18-9b86-1ef6ce736fcb => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:41:04.148664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1b469e4a-4c59-42e5-ac84-5e156e10487b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:04.158696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1b469e4a-4c59-42e5-ac84-5e156e10487b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0796aa2e-d174-4e03-b8e9-7b836ba9f485] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:04.181159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b469e4a-4c59-42e5-ac84-5e156e10487b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:04.184707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b469e4a-4c59-42e5-ac84-5e156e10487b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:04.189718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b469e4a-4c59-42e5-ac84-5e156e10487b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:04.190598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b469e4a-4c59-42e5-ac84-5e156e10487b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:04.193252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b469e4a-4c59-42e5-ac84-5e156e10487b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:04.198364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b469e4a-4c59-42e5-ac84-5e156e10487b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:04.256185 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-1b469e4a-4c59-42e5-ac84-5e156e10487b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] HTTP exception thrown: Instance 0796aa2e-d174-4e03-b8e9-7b836ba9f485 could not be found. Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1b469e4a-4c59-42e5-ac84-5e156e10487b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Request method failure captured: Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485 HTTP/1.1 Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf8_-svoJ82Zcz3LMtRJH-LxEmi7YhL3SyNjhBkMMhmGqnW0J0hM18TP4MYYa3JryjRkfD6MJWxRrI1tc6yKAxu9hD6H4E3SSBMepuWzyz5efbHaNXS1nRaEb6aE-x3oa0iXQadiBh1CoF_uoY7wN-kywJAG1lWDamBR5UsabCRziuM Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8b489eabb0014ddc9a2fcdf6e78ee740", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8b489eabb0014ddc9a2fcdf6e78ee740"}]}] Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestJSON-523633018 Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersTestJSON-523633018-project Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 83a25a0677c04f8ba975528ece80d676 Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestJSON-523633018-project Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 0796aa2e-d174-4e03-b8e9-7b836ba9f485 could not be found. Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '0796aa2e-d174-4e03-b8e9-7b836ba9f485'} Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0796aa2e-d174-4e03-b8e9-7b836ba9f485 could not be found. Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:41:04.270660 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0796aa2e-d174-4e03-b8e9-7b836ba9f485 could not be found. Aug 24 10:41:04.275212 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.275212 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:04.275212 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.275212 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:04.275212 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:04.275212 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:04.275212 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:41:04.275212 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:41:04.275212 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0796aa2e-d174-4e03-b8e9-7b836ba9f485 could not be found. Aug 24 10:41:04.275212 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.275212 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1b469e4a-4c59-42e5-ac84-5e156e10487b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Returning 404 to user: Instance 0796aa2e-d174-4e03-b8e9-7b836ba9f485 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:41:04.275212 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1b469e4a-4c59-42e5-ac84-5e156e10487b tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "DELETE /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485" status: 404 len: 111 microversion: 2.1 time: 0.121705 Aug 24 10:41:04.277349 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2466/5285] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:41:04 2022] DELETE /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:41:04.286012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5069979e-3d04-4dd4-b3b5-115a8c798edc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:04.296709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5069979e-3d04-4dd4-b3b5-115a8c798edc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 29b3cde5-4716-49f6-b3d3-11d12a290375] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:04.323316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5069979e-3d04-4dd4-b3b5-115a8c798edc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:04.323647 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7c33053f-4c67-44dc-8495-b186948a43a4 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "DELETE /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28" status: 204 len: 0 microversion: 2.1 time: 0.467803 Aug 24 10:41:04.324228 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5069979e-3d04-4dd4-b3b5-115a8c798edc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:04.324776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5069979e-3d04-4dd4-b3b5-115a8c798edc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:04.324924 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2820/5286] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:41:03 2022] DELETE /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:41:04.326008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5069979e-3d04-4dd4-b3b5-115a8c798edc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:04.327414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5069979e-3d04-4dd4-b3b5-115a8c798edc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:04.330494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5069979e-3d04-4dd4-b3b5-115a8c798edc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:04.332114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bdae6ce7-3fba-49c6-bb2c-1c2f3f0e7722 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:04.337571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bdae6ce7-3fba-49c6-bb2c-1c2f3f0e7722 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 0796aa2e-d174-4e03-b8e9-7b836ba9f485] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:04.361161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdae6ce7-3fba-49c6-bb2c-1c2f3f0e7722 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:04.361908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdae6ce7-3fba-49c6-bb2c-1c2f3f0e7722 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:04.362494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdae6ce7-3fba-49c6-bb2c-1c2f3f0e7722 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:04.363372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdae6ce7-3fba-49c6-bb2c-1c2f3f0e7722 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:04.363983 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdae6ce7-3fba-49c6-bb2c-1c2f3f0e7722 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:04.364543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdae6ce7-3fba-49c6-bb2c-1c2f3f0e7722 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:04.391234 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-bdae6ce7-3fba-49c6-bb2c-1c2f3f0e7722 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] HTTP exception thrown: Instance 0796aa2e-d174-4e03-b8e9-7b836ba9f485 could not be found. Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bdae6ce7-3fba-49c6-bb2c-1c2f3f0e7722 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Request method failure captured: Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485 HTTP/1.1 Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf8_-svoJ82Zcz3LMtRJH-LxEmi7YhL3SyNjhBkMMhmGqnW0J0hM18TP4MYYa3JryjRkfD6MJWxRrI1tc6yKAxu9hD6H4E3SSBMepuWzyz5efbHaNXS1nRaEb6aE-x3oa0iXQadiBh1CoF_uoY7wN-kywJAG1lWDamBR5UsabCRziuM Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8b489eabb0014ddc9a2fcdf6e78ee740", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8b489eabb0014ddc9a2fcdf6e78ee740"}]}] Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersTestJSON-523633018 Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersTestJSON-523633018-project Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 83a25a0677c04f8ba975528ece80d676 Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersTestJSON-523633018-project Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 0796aa2e-d174-4e03-b8e9-7b836ba9f485 could not be found. Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '0796aa2e-d174-4e03-b8e9-7b836ba9f485'} Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0796aa2e-d174-4e03-b8e9-7b836ba9f485 could not be found. Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0796aa2e-d174-4e03-b8e9-7b836ba9f485 could not be found. Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.393154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:04.397322 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:04.397322 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:04.397322 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:41:04.397322 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:41:04.397322 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0796aa2e-d174-4e03-b8e9-7b836ba9f485 could not be found. Aug 24 10:41:04.397322 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.398542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bdae6ce7-3fba-49c6-bb2c-1c2f3f0e7722 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Returning 404 to user: Instance 0796aa2e-d174-4e03-b8e9-7b836ba9f485 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:41:04.400111 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bdae6ce7-3fba-49c6-bb2c-1c2f3f0e7722 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485" status: 404 len: 111 microversion: 2.1 time: 0.073870 Aug 24 10:41:04.401432 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2821/5287] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:04 2022] GET /compute/v2.1/servers/0796aa2e-d174-4e03-b8e9-7b836ba9f485 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:41:04.406883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-681822f1-cf14-4e07-a3ef-3c5c47c95bbb tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:04.407739 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-681822f1-cf14-4e07-a3ef-3c5c47c95bbb tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: e61a5d87-9af0-427b-8730-8c84899eda28] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:04.417335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-681822f1-cf14-4e07-a3ef-3c5c47c95bbb tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:04.418083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-681822f1-cf14-4e07-a3ef-3c5c47c95bbb tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:04.418669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-681822f1-cf14-4e07-a3ef-3c5c47c95bbb tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:04.420487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-681822f1-cf14-4e07-a3ef-3c5c47c95bbb tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:04.421490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-681822f1-cf14-4e07-a3ef-3c5c47c95bbb tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:04.422103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-681822f1-cf14-4e07-a3ef-3c5c47c95bbb tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:04.561399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5069979e-3d04-4dd4-b3b5-115a8c798edc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:04.575258 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5069979e-3d04-4dd4-b3b5-115a8c798edc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375" status: 200 len: 1465 microversion: 2.1 time: 0.296305 Aug 24 10:41:04.578013 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2467/5288] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:04 2022] GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375 => generated 1465 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:04.608732 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-83bf14d6-7f20-4443-a0d7-4c0445f737db tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:04.611647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-83bf14d6-7f20-4443-a0d7-4c0445f737db tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: b03ac06d-c767-4fd3-a252-1b84310d81a8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:04.630286 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83bf14d6-7f20-4443-a0d7-4c0445f737db tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:04.632223 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83bf14d6-7f20-4443-a0d7-4c0445f737db tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:04.632672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83bf14d6-7f20-4443-a0d7-4c0445f737db tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:04.633443 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83bf14d6-7f20-4443-a0d7-4c0445f737db tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:04.633902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83bf14d6-7f20-4443-a0d7-4c0445f737db tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:04.636172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83bf14d6-7f20-4443-a0d7-4c0445f737db tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:04.698432 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-83bf14d6-7f20-4443-a0d7-4c0445f737db tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] HTTP exception thrown: Instance b03ac06d-c767-4fd3-a252-1b84310d81a8 could not be found. Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-83bf14d6-7f20-4443-a0d7-4c0445f737db tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Request method failure captured: Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8 HTTP/1.1 Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf8_-svoJ82Zcz3LMtRJH-LxEmi7YhL3SyNjhBkMMhmGqnW0J0hM18TP4MYYa3JryjRkfD6MJWxRrI1tc6yKAxu9hD6H4E3SSBMepuWzyz5efbHaNXS1nRaEb6aE-x3oa0iXQadiBh1CoF_uoY7wN-kywJAG1lWDamBR5UsabCRziuM Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8b489eabb0014ddc9a2fcdf6e78ee740", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8b489eabb0014ddc9a2fcdf6e78ee740"}]}] Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestJSON-523633018 Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersTestJSON-523633018-project Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 83a25a0677c04f8ba975528ece80d676 Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestJSON-523633018-project Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance b03ac06d-c767-4fd3-a252-1b84310d81a8 could not be found. Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'b03ac06d-c767-4fd3-a252-1b84310d81a8'} Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b03ac06d-c767-4fd3-a252-1b84310d81a8 could not be found. Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:41:04.701000 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b03ac06d-c767-4fd3-a252-1b84310d81a8 could not be found. Aug 24 10:41:04.704922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.704922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:04.704922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.704922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:04.704922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:04.704922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:04.704922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:41:04.704922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:41:04.704922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b03ac06d-c767-4fd3-a252-1b84310d81a8 could not be found. Aug 24 10:41:04.704922 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.704922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-83bf14d6-7f20-4443-a0d7-4c0445f737db tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Returning 404 to user: Instance b03ac06d-c767-4fd3-a252-1b84310d81a8 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:41:04.704922 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-83bf14d6-7f20-4443-a0d7-4c0445f737db tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8" status: 404 len: 111 microversion: 2.1 time: 0.115688 Aug 24 10:41:04.709797 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2468/5289] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:41:04 2022] DELETE /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:41:04.716563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-74ff6da8-839b-4527-84da-5f71ed879c08 req-905b8f9a-2fdb-41f9-ae83-d15a0a08b756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29b3cde5-4716-49f6-b3d3-11d12a290375", "name": "network-vif-deleted", "tag": "cac1d72e-1940-403b-b4ae-cd571cbc2063"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:41:04.729060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-74ff6da8-839b-4527-84da-5f71ed879c08 req-905b8f9a-2fdb-41f9-ae83-d15a0a08b756 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:04.729577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-74ff6da8-839b-4527-84da-5f71ed879c08 req-905b8f9a-2fdb-41f9-ae83-d15a0a08b756 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:04.730042 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-74ff6da8-839b-4527-84da-5f71ed879c08 req-905b8f9a-2fdb-41f9-ae83-d15a0a08b756 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:04.767145 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-74ff6da8-839b-4527-84da-5f71ed879c08 req-905b8f9a-2fdb-41f9-ae83-d15a0a08b756 service nova] Creating event network-vif-deleted:cac1d72e-1940-403b-b4ae-cd571cbc2063 for instance 29b3cde5-4716-49f6-b3d3-11d12a290375 on n-h1-849328-3 Aug 24 10:41:04.774281 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-74ff6da8-839b-4527-84da-5f71ed879c08 req-905b8f9a-2fdb-41f9-ae83-d15a0a08b756 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066562 Aug 24 10:41:04.774912 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2469/5290] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:41:04.783828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bcb146f2-45e1-4a09-8fce-96f28c6602a9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:04.784553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bcb146f2-45e1-4a09-8fce-96f28c6602a9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: b03ac06d-c767-4fd3-a252-1b84310d81a8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:04.791707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcb146f2-45e1-4a09-8fce-96f28c6602a9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:04.794343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcb146f2-45e1-4a09-8fce-96f28c6602a9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:04.794886 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcb146f2-45e1-4a09-8fce-96f28c6602a9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:04.795634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcb146f2-45e1-4a09-8fce-96f28c6602a9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:04.796275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcb146f2-45e1-4a09-8fce-96f28c6602a9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:04.796855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcb146f2-45e1-4a09-8fce-96f28c6602a9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:04.821476 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-bcb146f2-45e1-4a09-8fce-96f28c6602a9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] HTTP exception thrown: Instance b03ac06d-c767-4fd3-a252-1b84310d81a8 could not be found. Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bcb146f2-45e1-4a09-8fce-96f28c6602a9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Request method failure captured: Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8 HTTP/1.1 Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf8_-svoJ82Zcz3LMtRJH-LxEmi7YhL3SyNjhBkMMhmGqnW0J0hM18TP4MYYa3JryjRkfD6MJWxRrI1tc6yKAxu9hD6H4E3SSBMepuWzyz5efbHaNXS1nRaEb6aE-x3oa0iXQadiBh1CoF_uoY7wN-kywJAG1lWDamBR5UsabCRziuM Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8b489eabb0014ddc9a2fcdf6e78ee740", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8b489eabb0014ddc9a2fcdf6e78ee740"}]}] Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestJSON-523633018 Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersTestJSON-523633018-project Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 83a25a0677c04f8ba975528ece80d676 Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestJSON-523633018-project Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance b03ac06d-c767-4fd3-a252-1b84310d81a8 could not be found. Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'b03ac06d-c767-4fd3-a252-1b84310d81a8'} Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b03ac06d-c767-4fd3-a252-1b84310d81a8 could not be found. Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b03ac06d-c767-4fd3-a252-1b84310d81a8 could not be found. Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.822965 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:04.828089 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:04.828089 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:04.828089 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:41:04.828089 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:41:04.828089 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b03ac06d-c767-4fd3-a252-1b84310d81a8 could not be found. Aug 24 10:41:04.828089 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.828089 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bcb146f2-45e1-4a09-8fce-96f28c6602a9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Returning 404 to user: Instance b03ac06d-c767-4fd3-a252-1b84310d81a8 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:41:04.828089 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bcb146f2-45e1-4a09-8fce-96f28c6602a9 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8" status: 404 len: 111 microversion: 2.1 time: 0.048708 Aug 24 10:41:04.828089 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2470/5291] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:04 2022] GET /compute/v2.1/servers/b03ac06d-c767-4fd3-a252-1b84310d81a8 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:41:04.835952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-41be1881-bc83-4376-a872-98d2843cf6fe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:04.838402 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-41be1881-bc83-4376-a872-98d2843cf6fe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: c30d0317-0b22-4856-8188-5e5dbdfcd936] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:04.849276 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:04.879136 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-41be1881-bc83-4376-a872-98d2843cf6fe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] HTTP exception thrown: Instance c30d0317-0b22-4856-8188-5e5dbdfcd936 could not be found. Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-41be1881-bc83-4376-a872-98d2843cf6fe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Request method failure captured: Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/c30d0317-0b22-4856-8188-5e5dbdfcd936 HTTP/1.1 Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf8_-svoJ82Zcz3LMtRJH-LxEmi7YhL3SyNjhBkMMhmGqnW0J0hM18TP4MYYa3JryjRkfD6MJWxRrI1tc6yKAxu9hD6H4E3SSBMepuWzyz5efbHaNXS1nRaEb6aE-x3oa0iXQadiBh1CoF_uoY7wN-kywJAG1lWDamBR5UsabCRziuM Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8b489eabb0014ddc9a2fcdf6e78ee740", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8b489eabb0014ddc9a2fcdf6e78ee740"}]}] Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestJSON-523633018 Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersTestJSON-523633018-project Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 83a25a0677c04f8ba975528ece80d676 Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestJSON-523633018-project Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance c30d0317-0b22-4856-8188-5e5dbdfcd936 could not be found. Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'c30d0317-0b22-4856-8188-5e5dbdfcd936'} Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c30d0317-0b22-4856-8188-5e5dbdfcd936 could not be found. Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c30d0317-0b22-4856-8188-5e5dbdfcd936 could not be found. Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:04.880821 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.884982 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:04.884982 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:04.884982 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:04.884982 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:41:04.884982 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:41:04.884982 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c30d0317-0b22-4856-8188-5e5dbdfcd936 could not be found. Aug 24 10:41:04.884982 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.884982 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-41be1881-bc83-4376-a872-98d2843cf6fe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Returning 404 to user: Instance c30d0317-0b22-4856-8188-5e5dbdfcd936 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:41:04.884982 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-41be1881-bc83-4376-a872-98d2843cf6fe tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "DELETE /compute/v2.1/servers/c30d0317-0b22-4856-8188-5e5dbdfcd936" status: 404 len: 111 microversion: 2.1 time: 0.053241 Aug 24 10:41:04.890506 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2471/5292] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:41:04 2022] DELETE /compute/v2.1/servers/c30d0317-0b22-4856-8188-5e5dbdfcd936 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:41:04.914297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2963229a-d6db-4854-8a26-dfe22ab8e1f6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:04.918385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2963229a-d6db-4854-8a26-dfe22ab8e1f6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: c30d0317-0b22-4856-8188-5e5dbdfcd936] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:04.936072 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-2963229a-d6db-4854-8a26-dfe22ab8e1f6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] HTTP exception thrown: Instance c30d0317-0b22-4856-8188-5e5dbdfcd936 could not be found. Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2963229a-d6db-4854-8a26-dfe22ab8e1f6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Request method failure captured: Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/c30d0317-0b22-4856-8188-5e5dbdfcd936 HTTP/1.1 Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf8_-svoJ82Zcz3LMtRJH-LxEmi7YhL3SyNjhBkMMhmGqnW0J0hM18TP4MYYa3JryjRkfD6MJWxRrI1tc6yKAxu9hD6H4E3SSBMepuWzyz5efbHaNXS1nRaEb6aE-x3oa0iXQadiBh1CoF_uoY7wN-kywJAG1lWDamBR5UsabCRziuM Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8b489eabb0014ddc9a2fcdf6e78ee740", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8b489eabb0014ddc9a2fcdf6e78ee740"}]}] Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestJSON-523633018 Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersTestJSON-523633018-project Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 83a25a0677c04f8ba975528ece80d676 Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestJSON-523633018-project Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance c30d0317-0b22-4856-8188-5e5dbdfcd936 could not be found. Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'c30d0317-0b22-4856-8188-5e5dbdfcd936'} Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c30d0317-0b22-4856-8188-5e5dbdfcd936 could not be found. Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c30d0317-0b22-4856-8188-5e5dbdfcd936 could not be found. Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:04.942180 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:04.947082 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:41:04.947082 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:41:04.947082 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c30d0317-0b22-4856-8188-5e5dbdfcd936 could not be found. Aug 24 10:41:04.947082 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:04.947615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2963229a-d6db-4854-8a26-dfe22ab8e1f6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Returning 404 to user: Instance c30d0317-0b22-4856-8188-5e5dbdfcd936 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:41:04.962789 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2963229a-d6db-4854-8a26-dfe22ab8e1f6 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/c30d0317-0b22-4856-8188-5e5dbdfcd936" status: 404 len: 111 microversion: 2.1 time: 0.066649 Aug 24 10:41:04.963616 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2472/5293] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:04 2022] GET /compute/v2.1/servers/c30d0317-0b22-4856-8188-5e5dbdfcd936 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:41:04.972976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4c358860-16ef-4f0a-8f1a-33c375564530 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:04.977487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4c358860-16ef-4f0a-8f1a-33c375564530 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:04.989058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c358860-16ef-4f0a-8f1a-33c375564530 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:04.990065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c358860-16ef-4f0a-8f1a-33c375564530 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:04.993918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c358860-16ef-4f0a-8f1a-33c375564530 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:04.995028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c358860-16ef-4f0a-8f1a-33c375564530 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:04.998116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c358860-16ef-4f0a-8f1a-33c375564530 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:04.998850 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c358860-16ef-4f0a-8f1a-33c375564530 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:05.059284 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4c358860-16ef-4f0a-8f1a-33c375564530 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:41:05.172618 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:05.221246 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4c358860-16ef-4f0a-8f1a-33c375564530 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "DELETE /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9" status: 204 len: 0 microversion: 2.1 time: 0.253541 Aug 24 10:41:05.222424 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2473/5294] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:41:04 2022] DELETE /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:41:05.247236 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-072fb078-b994-4590-9ec8-46c22721c8c5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:05.251364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-072fb078-b994-4590-9ec8-46c22721c8c5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:05.305408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-072fb078-b994-4590-9ec8-46c22721c8c5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:05.307951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-072fb078-b994-4590-9ec8-46c22721c8c5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:05.310588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-072fb078-b994-4590-9ec8-46c22721c8c5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:05.316432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-072fb078-b994-4590-9ec8-46c22721c8c5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:05.321006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-072fb078-b994-4590-9ec8-46c22721c8c5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:05.322115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-072fb078-b994-4590-9ec8-46c22721c8c5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:05.502718 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-681822f1-cf14-4e07-a3ef-3c5c47c95bbb tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28" status: 200 len: 1653 microversion: 2.1 time: 1.099974 Aug 24 10:41:05.517530 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2822/5295] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:04 2022] GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28 => generated 1653 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:05.605276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8d9101c3-c156-4c5f-ad7f-01be63b3e7f6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:05.606256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8d9101c3-c156-4c5f-ad7f-01be63b3e7f6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 29b3cde5-4716-49f6-b3d3-11d12a290375] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:05.621770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d9101c3-c156-4c5f-ad7f-01be63b3e7f6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:05.622281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d9101c3-c156-4c5f-ad7f-01be63b3e7f6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:05.624943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d9101c3-c156-4c5f-ad7f-01be63b3e7f6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:05.627590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d9101c3-c156-4c5f-ad7f-01be63b3e7f6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:05.628115 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d9101c3-c156-4c5f-ad7f-01be63b3e7f6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:05.630723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d9101c3-c156-4c5f-ad7f-01be63b3e7f6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:05.811432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8d9101c3-c156-4c5f-ad7f-01be63b3e7f6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:05.832088 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8d9101c3-c156-4c5f-ad7f-01be63b3e7f6 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375" status: 200 len: 1300 microversion: 2.1 time: 0.232827 Aug 24 10:41:05.834597 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2823/5296] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:05 2022] GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375 => generated 1300 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:41:06.302531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-072fb078-b994-4590-9ec8-46c22721c8c5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:06.314069 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-072fb078-b994-4590-9ec8-46c22721c8c5 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9" status: 200 len: 1478 microversion: 2.1 time: 1.086642 Aug 24 10:41:06.314679 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2474/5297] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:05 2022] GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 => generated 1478 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:06.524762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-70e81dbe-2e59-4445-b34f-ad862fa36fd4 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:06.526023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-70e81dbe-2e59-4445-b34f-ad862fa36fd4 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: e61a5d87-9af0-427b-8730-8c84899eda28] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:06.537136 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70e81dbe-2e59-4445-b34f-ad862fa36fd4 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:06.537900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70e81dbe-2e59-4445-b34f-ad862fa36fd4 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:06.538529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70e81dbe-2e59-4445-b34f-ad862fa36fd4 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:06.539244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70e81dbe-2e59-4445-b34f-ad862fa36fd4 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:06.539705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70e81dbe-2e59-4445-b34f-ad862fa36fd4 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:06.540129 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70e81dbe-2e59-4445-b34f-ad862fa36fd4 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:06.837334 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-70e81dbe-2e59-4445-b34f-ad862fa36fd4 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28" status: 200 len: 1653 microversion: 2.1 time: 0.316216 Aug 24 10:41:06.858287 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2824/5298] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:06 2022] GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28 => generated 1653 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:41:06.860376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ffda31ca-ad14-4e8c-bd87-e67f48f03794 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:06.860995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ffda31ca-ad14-4e8c-bd87-e67f48f03794 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 29b3cde5-4716-49f6-b3d3-11d12a290375] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:06.877459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffda31ca-ad14-4e8c-bd87-e67f48f03794 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:06.878270 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffda31ca-ad14-4e8c-bd87-e67f48f03794 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:06.878882 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffda31ca-ad14-4e8c-bd87-e67f48f03794 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:06.880181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffda31ca-ad14-4e8c-bd87-e67f48f03794 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:06.880872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffda31ca-ad14-4e8c-bd87-e67f48f03794 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:06.881505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffda31ca-ad14-4e8c-bd87-e67f48f03794 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:07.108176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ffda31ca-ad14-4e8c-bd87-e67f48f03794 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:07.117314 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ffda31ca-ad14-4e8c-bd87-e67f48f03794 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375" status: 200 len: 1300 microversion: 2.1 time: 0.261099 Aug 24 10:41:07.136171 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2475/5299] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:06 2022] GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375 => generated 1300 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:07.340267 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a5cbfa1a-27d5-432e-9339-f56724736c70 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:07.340901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a5cbfa1a-27d5-432e-9339-f56724736c70 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:07.349642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5cbfa1a-27d5-432e-9339-f56724736c70 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:07.350146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5cbfa1a-27d5-432e-9339-f56724736c70 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:07.350588 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5cbfa1a-27d5-432e-9339-f56724736c70 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:07.355216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5cbfa1a-27d5-432e-9339-f56724736c70 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:07.358045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5cbfa1a-27d5-432e-9339-f56724736c70 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:07.358498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5cbfa1a-27d5-432e-9339-f56724736c70 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:07.862983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-94682899-e26b-43c0-ab9a-02cb855e4253 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:07.863609 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-94682899-e26b-43c0-ab9a-02cb855e4253 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: e61a5d87-9af0-427b-8730-8c84899eda28] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:07.878737 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94682899-e26b-43c0-ab9a-02cb855e4253 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:07.883323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94682899-e26b-43c0-ab9a-02cb855e4253 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:07.884013 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94682899-e26b-43c0-ab9a-02cb855e4253 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:07.885610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94682899-e26b-43c0-ab9a-02cb855e4253 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:07.886417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94682899-e26b-43c0-ab9a-02cb855e4253 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:07.886760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94682899-e26b-43c0-ab9a-02cb855e4253 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:08.010655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a5cbfa1a-27d5-432e-9339-f56724736c70 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:08.021859 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a5cbfa1a-27d5-432e-9339-f56724736c70 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9" status: 200 len: 1478 microversion: 2.1 time: 0.686673 Aug 24 10:41:08.024560 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2825/5300] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:07 2022] GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 => generated 1478 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:08.144370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-711c8075-569c-427a-94ae-a835ab597fdd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:08.145362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-711c8075-569c-427a-94ae-a835ab597fdd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 29b3cde5-4716-49f6-b3d3-11d12a290375] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:08.159170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-711c8075-569c-427a-94ae-a835ab597fdd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:08.160008 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-711c8075-569c-427a-94ae-a835ab597fdd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:08.160665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-711c8075-569c-427a-94ae-a835ab597fdd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:08.161640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-711c8075-569c-427a-94ae-a835ab597fdd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:08.162293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-711c8075-569c-427a-94ae-a835ab597fdd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:08.162951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-711c8075-569c-427a-94ae-a835ab597fdd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:08.201862 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-711c8075-569c-427a-94ae-a835ab597fdd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] HTTP exception thrown: Instance 29b3cde5-4716-49f6-b3d3-11d12a290375 could not be found. Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-711c8075-569c-427a-94ae-a835ab597fdd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Request method failure captured: Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375 HTTP/1.1 Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf4TQ-ANQmryHMcmh9mjA8auVh1UVU40Ptyqc8C7SVEqbwoTaJhYRV2L-5dPBBr1S5HtWMawW3k8YGb_tKrCiEye7fzruwlhEHHLdof87q4HL1nmhzukhg_36RvG00tLOGcZO9HQ1UY-3nEC3lK5bXyxvHMgEJdlWvWiw7WTxDs1y50 Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 3d511560c1f543169e7eab8c70c9abcd Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerActionsTestJSON-1329836544 Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3d511560c1f543169e7eab8c70c9abcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3d511560c1f543169e7eab8c70c9abcd", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3d511560c1f543169e7eab8c70c9abcd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3d511560c1f543169e7eab8c70c9abcd"}]}] Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerActionsTestJSON-1329836544 Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 3d511560c1f543169e7eab8c70c9abcd Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerActionsTestJSON-1329836544 Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerActionsTestJSON-1329836544-project Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 03ef6a33c1f0467993486547b7d00fda Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerActionsTestJSON-1329836544-project Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 29b3cde5-4716-49f6-b3d3-11d12a290375 could not be found. Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '29b3cde5-4716-49f6-b3d3-11d12a290375'} Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29b3cde5-4716-49f6-b3d3-11d12a290375 could not be found. Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29b3cde5-4716-49f6-b3d3-11d12a290375 could not be found. Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:08.204294 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:08.207763 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:08.207763 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:08.207763 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:08.207763 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:41:08.207763 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:41:08.207763 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29b3cde5-4716-49f6-b3d3-11d12a290375 could not be found. Aug 24 10:41:08.207763 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:08.212072 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-711c8075-569c-427a-94ae-a835ab597fdd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Returning 404 to user: Instance 29b3cde5-4716-49f6-b3d3-11d12a290375 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:41:08.213668 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-711c8075-569c-427a-94ae-a835ab597fdd tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375" status: 404 len: 111 microversion: 2.1 time: 0.073379 Aug 24 10:41:08.219268 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2826/5301] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:08 2022] GET /compute/v2.1/servers/29b3cde5-4716-49f6-b3d3-11d12a290375 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:41:08.238303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d9354b3c-0307-4ce3-a1d4-6880c6c6744e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:08.239539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d9354b3c-0307-4ce3-a1d4-6880c6c6744e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:08.248665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9354b3c-0307-4ce3-a1d4-6880c6c6744e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:08.249367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9354b3c-0307-4ce3-a1d4-6880c6c6744e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:08.249906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9354b3c-0307-4ce3-a1d4-6880c6c6744e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:08.250730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9354b3c-0307-4ce3-a1d4-6880c6c6744e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:08.251308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9354b3c-0307-4ce3-a1d4-6880c6c6744e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:08.252677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9354b3c-0307-4ce3-a1d4-6880c6c6744e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:08.290443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d9354b3c-0307-4ce3-a1d4-6880c6c6744e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:41:08.438175 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d9354b3c-0307-4ce3-a1d4-6880c6c6744e tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "DELETE /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d" status: 204 len: 0 microversion: 2.1 time: 0.207425 Aug 24 10:41:08.447153 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2827/5302] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:41:08 2022] DELETE /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:41:08.469464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-410feb0a-d638-4356-beee-af4dcb3370d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:08.472287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-410feb0a-d638-4356-beee-af4dcb3370d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:08.481520 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-410feb0a-d638-4356-beee-af4dcb3370d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:08.482691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-410feb0a-d638-4356-beee-af4dcb3370d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:08.483319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-410feb0a-d638-4356-beee-af4dcb3370d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:08.484465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-410feb0a-d638-4356-beee-af4dcb3370d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:08.485083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-410feb0a-d638-4356-beee-af4dcb3370d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:08.485680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-410feb0a-d638-4356-beee-af4dcb3370d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:08.928902 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-94682899-e26b-43c0-ab9a-02cb855e4253 tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28" status: 200 len: 1653 microversion: 2.1 time: 1.070946 Aug 24 10:41:08.942643 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2476/5303] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:07 2022] GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28 => generated 1653 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:41:08.943065 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-410feb0a-d638-4356-beee-af4dcb3370d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:08.953877 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-410feb0a-d638-4356-beee-af4dcb3370d7 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d" status: 200 len: 1506 microversion: 2.1 time: 0.502143 Aug 24 10:41:08.977787 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2828/5304] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:08 2022] GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d => generated 1506 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:41:09.045507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7d2f7132-1391-4398-ae32-da8d49ba79d7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:09.046239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7d2f7132-1391-4398-ae32-da8d49ba79d7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:09.059929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d2f7132-1391-4398-ae32-da8d49ba79d7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:09.060813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d2f7132-1391-4398-ae32-da8d49ba79d7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:09.061404 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d2f7132-1391-4398-ae32-da8d49ba79d7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:09.062265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d2f7132-1391-4398-ae32-da8d49ba79d7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:09.066955 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d2f7132-1391-4398-ae32-da8d49ba79d7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:09.067521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d2f7132-1391-4398-ae32-da8d49ba79d7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:09.278586 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7d2f7132-1391-4398-ae32-da8d49ba79d7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:09.291364 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7d2f7132-1391-4398-ae32-da8d49ba79d7 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9" status: 200 len: 1436 microversion: 2.1 time: 0.251517 Aug 24 10:41:09.295277 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2477/5305] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:09 2022] GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 => generated 1436 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:09.428037 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-6de9b4f4-7eee-48ee-902d-0f1df51865f8 req-c1383169-9bd1-4394-bb26-24a00bb1c76a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9", "name": "network-vif-deleted", "tag": "49282a09-9feb-4209-89fa-dde9cf343ed1"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:41:09.455205 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6de9b4f4-7eee-48ee-902d-0f1df51865f8 req-c1383169-9bd1-4394-bb26-24a00bb1c76a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:09.456355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6de9b4f4-7eee-48ee-902d-0f1df51865f8 req-c1383169-9bd1-4394-bb26-24a00bb1c76a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:09.457493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6de9b4f4-7eee-48ee-902d-0f1df51865f8 req-c1383169-9bd1-4394-bb26-24a00bb1c76a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:09.540903 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-6de9b4f4-7eee-48ee-902d-0f1df51865f8 req-c1383169-9bd1-4394-bb26-24a00bb1c76a service nova] Creating event network-vif-deleted:49282a09-9feb-4209-89fa-dde9cf343ed1 for instance 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 on n-h1-849328-3 Aug 24 10:41:09.553064 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-6de9b4f4-7eee-48ee-902d-0f1df51865f8 req-c1383169-9bd1-4394-bb26-24a00bb1c76a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134618 Aug 24 10:41:09.554194 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2829/5306] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:41:09.954283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9441e608-1f6d-417f-a391-08a338aba95e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:09.955685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9441e608-1f6d-417f-a391-08a338aba95e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: e61a5d87-9af0-427b-8730-8c84899eda28] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:09.977805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9441e608-1f6d-417f-a391-08a338aba95e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:09.978774 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6fc55c38-84cb-4013-ab3b-fb8ffd2a9aaa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:09.979617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9441e608-1f6d-417f-a391-08a338aba95e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:09.980023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6fc55c38-84cb-4013-ab3b-fb8ffd2a9aaa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:09.980131 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9441e608-1f6d-417f-a391-08a338aba95e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:09.986511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9441e608-1f6d-417f-a391-08a338aba95e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:09.986932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9441e608-1f6d-417f-a391-08a338aba95e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:09.987380 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9441e608-1f6d-417f-a391-08a338aba95e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:09.996044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fc55c38-84cb-4013-ab3b-fb8ffd2a9aaa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:09.996931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fc55c38-84cb-4013-ab3b-fb8ffd2a9aaa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:09.997645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fc55c38-84cb-4013-ab3b-fb8ffd2a9aaa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:10.000734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fc55c38-84cb-4013-ab3b-fb8ffd2a9aaa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:10.003468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fc55c38-84cb-4013-ab3b-fb8ffd2a9aaa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:10.007362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fc55c38-84cb-4013-ab3b-fb8ffd2a9aaa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:10.089842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9441e608-1f6d-417f-a391-08a338aba95e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:10.093649 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9441e608-1f6d-417f-a391-08a338aba95e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:10.094590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9441e608-1f6d-417f-a391-08a338aba95e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:10.095217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-9441e608-1f6d-417f-a391-08a338aba95e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lazy-loading 'fault' on Instance uuid e61a5d87-9af0-427b-8730-8c84899eda28 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:41:10.348943 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9441e608-1f6d-417f-a391-08a338aba95e tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28" status: 200 len: 1453 microversion: 2.1 time: 0.401894 Aug 24 10:41:10.354479 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2478/5307] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:09 2022] GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28 => generated 1453 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:10.364106 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b2a2721f-a03a-4c80-8275-533c8550d8d1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:10.365455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b2a2721f-a03a-4c80-8275-533c8550d8d1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:10.384067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2a2721f-a03a-4c80-8275-533c8550d8d1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:10.384957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2a2721f-a03a-4c80-8275-533c8550d8d1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:10.385622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2a2721f-a03a-4c80-8275-533c8550d8d1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:10.388634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2a2721f-a03a-4c80-8275-533c8550d8d1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:10.389404 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2a2721f-a03a-4c80-8275-533c8550d8d1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:10.390210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2a2721f-a03a-4c80-8275-533c8550d8d1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:10.442044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2a2721f-a03a-4c80-8275-533c8550d8d1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:10.442778 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2a2721f-a03a-4c80-8275-533c8550d8d1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:10.443845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2a2721f-a03a-4c80-8275-533c8550d8d1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:10.444570 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-b2a2721f-a03a-4c80-8275-533c8550d8d1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lazy-loading 'fault' on Instance uuid 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:41:10.490588 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6fc55c38-84cb-4013-ab3b-fb8ffd2a9aaa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:10.517689 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6fc55c38-84cb-4013-ab3b-fb8ffd2a9aaa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d" status: 200 len: 1506 microversion: 2.1 time: 0.537975 Aug 24 10:41:10.521835 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2830/5308] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:09 2022] GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d => generated 1506 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:10.626236 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b2a2721f-a03a-4c80-8275-533c8550d8d1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a25a0677c04f8ba975528ece80d676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b489eabb0014ddc9a2fcdf6e78ee740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:10.642111 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b2a2721f-a03a-4c80-8275-533c8550d8d1 tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9" status: 200 len: 1282 microversion: 2.1 time: 0.284546 Aug 24 10:41:10.662334 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2479/5309] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:10 2022] GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 => generated 1282 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:11.376269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7c08b027-7368-48e8-b0d8-5b875948fe6c tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:11.376896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7c08b027-7368-48e8-b0d8-5b875948fe6c tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] [instance: e61a5d87-9af0-427b-8730-8c84899eda28] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:11.396631 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c08b027-7368-48e8-b0d8-5b875948fe6c tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:11.397034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c08b027-7368-48e8-b0d8-5b875948fe6c tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:11.397508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c08b027-7368-48e8-b0d8-5b875948fe6c tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:11.398224 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c08b027-7368-48e8-b0d8-5b875948fe6c tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:11.398671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c08b027-7368-48e8-b0d8-5b875948fe6c tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:11.399093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c08b027-7368-48e8-b0d8-5b875948fe6c tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:11.458915 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-7c08b027-7368-48e8-b0d8-5b875948fe6c tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] HTTP exception thrown: Instance e61a5d87-9af0-427b-8730-8c84899eda28 could not be found. Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7c08b027-7368-48e8-b0d8-5b875948fe6c tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Request method failure captured: Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28 HTTP/1.1 Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgAEkdryvkFdI0Ah4Vm7KRPrd5skaGL4y3bmrJ2UVByS2nbTztiTFmtm2tBXLGSt6wq8-XGtl1AjFRPYTdVtdWi15JXYYS0RKRjQH6SAUvuZ0kOElUra0xDl8gpSac7MP8rtThpmq7IVxBhvewv91nbsWqyrqUC3Q8aB9mvRmAQLVcM Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 2b0f6576c12947c386db2c488fcace2d Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestServerMultinode-605727859 Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2b0f6576c12947c386db2c488fcace2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_2b0f6576c12947c386db2c488fcace2d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2b0f6576c12947c386db2c488fcace2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/2b0f6576c12947c386db2c488fcace2d"}]}] Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestServerMultinode-605727859 Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 2b0f6576c12947c386db2c488fcace2d Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestServerMultinode-605727859 Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestServerMultinode-605727859-project-admin Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: a3e99593a56941369eceaec628b8aaad Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestServerMultinode-605727859-project-admin Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance e61a5d87-9af0-427b-8730-8c84899eda28 could not be found. Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'e61a5d87-9af0-427b-8730-8c84899eda28'} Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e61a5d87-9af0-427b-8730-8c84899eda28 could not be found. Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e61a5d87-9af0-427b-8730-8c84899eda28 could not be found. Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:11.467427 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:11.472472 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:11.472472 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:11.472472 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:11.472472 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:41:11.472472 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:41:11.472472 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e61a5d87-9af0-427b-8730-8c84899eda28 could not be found. Aug 24 10:41:11.472472 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:11.472472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7c08b027-7368-48e8-b0d8-5b875948fe6c tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] Returning 404 to user: Instance e61a5d87-9af0-427b-8730-8c84899eda28 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:41:11.473645 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7c08b027-7368-48e8-b0d8-5b875948fe6c tempest-TestServerMultinode-605727859 tempest-TestServerMultinode-605727859-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28" status: 404 len: 111 microversion: 2.1 time: 0.099597 Aug 24 10:41:11.476011 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2831/5310] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:11 2022] GET /compute/v2.1/servers/e61a5d87-9af0-427b-8730-8c84899eda28 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:41:11.555983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ca9bede5-a91c-4c21-91d1-7ebdfe4876c1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:11.556655 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ca9bede5-a91c-4c21-91d1-7ebdfe4876c1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:11.569680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca9bede5-a91c-4c21-91d1-7ebdfe4876c1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:11.570818 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca9bede5-a91c-4c21-91d1-7ebdfe4876c1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:11.572019 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca9bede5-a91c-4c21-91d1-7ebdfe4876c1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:11.573294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca9bede5-a91c-4c21-91d1-7ebdfe4876c1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:11.574070 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca9bede5-a91c-4c21-91d1-7ebdfe4876c1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:11.574653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca9bede5-a91c-4c21-91d1-7ebdfe4876c1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:11.589350 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-010ae5dc-0c46-48da-8273-4524df8f699b req-8648dd15-0225-455e-af15-e7318ab3e6be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e61a5d87-9af0-427b-8730-8c84899eda28", "name": "network-vif-deleted", "tag": "2b10b994-e2ff-4cf9-96b6-1d4a0de260ad"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:41:11.615111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-010ae5dc-0c46-48da-8273-4524df8f699b req-8648dd15-0225-455e-af15-e7318ab3e6be service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:11.618132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-010ae5dc-0c46-48da-8273-4524df8f699b req-8648dd15-0225-455e-af15-e7318ab3e6be service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:11.618749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-010ae5dc-0c46-48da-8273-4524df8f699b req-8648dd15-0225-455e-af15-e7318ab3e6be service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:11.646809 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-010ae5dc-0c46-48da-8273-4524df8f699b req-8648dd15-0225-455e-af15-e7318ab3e6be service nova] Creating event network-vif-deleted:2b10b994-e2ff-4cf9-96b6-1d4a0de260ad for instance e61a5d87-9af0-427b-8730-8c84899eda28 on n-h1-849328-3 Aug 24 10:41:11.656680 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-010ae5dc-0c46-48da-8273-4524df8f699b req-8648dd15-0225-455e-af15-e7318ab3e6be service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071138 Aug 24 10:41:11.661046 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2832/5311] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:41:11.684143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9ced0363-44bf-4fa9-865a-4193833df68f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:11.685194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9ced0363-44bf-4fa9-865a-4193833df68f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] [instance: 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:11.699392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ced0363-44bf-4fa9-865a-4193833df68f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:11.700294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ced0363-44bf-4fa9-865a-4193833df68f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:11.700901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ced0363-44bf-4fa9-865a-4193833df68f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:11.701924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ced0363-44bf-4fa9-865a-4193833df68f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:11.702558 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ced0363-44bf-4fa9-865a-4193833df68f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:11.705790 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ced0363-44bf-4fa9-865a-4193833df68f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:11.733056 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-9ced0363-44bf-4fa9-865a-4193833df68f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] HTTP exception thrown: Instance 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 could not be found. Aug 24 10:41:11.738813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ca9bede5-a91c-4c21-91d1-7ebdfe4876c1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9ced0363-44bf-4fa9-865a-4193833df68f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Request method failure captured: Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 HTTP/1.1 Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf8_-svoJ82Zcz3LMtRJH-LxEmi7YhL3SyNjhBkMMhmGqnW0J0hM18TP4MYYa3JryjRkfD6MJWxRrI1tc6yKAxu9hD6H4E3SSBMepuWzyz5efbHaNXS1nRaEb6aE-x3oa0iXQadiBh1CoF_uoY7wN-kywJAG1lWDamBR5UsabCRziuM Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8b489eabb0014ddc9a2fcdf6e78ee740", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b489eabb0014ddc9a2fcdf6e78ee740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8b489eabb0014ddc9a2fcdf6e78ee740"}]}] Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersTestJSON-523633018 Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 8b489eabb0014ddc9a2fcdf6e78ee740 Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersTestJSON-523633018 Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersTestJSON-523633018-project Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 83a25a0677c04f8ba975528ece80d676 Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersTestJSON-523633018-project Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 could not be found. Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9'} Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 could not be found. Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 could not be found. Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:11.751159 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:11.768567 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:11.768567 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:11.768567 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:41:11.768567 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:41:11.768567 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 could not be found. Aug 24 10:41:11.768567 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:11.768567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9ced0363-44bf-4fa9-865a-4193833df68f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] Returning 404 to user: Instance 2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:41:11.769477 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ca9bede5-a91c-4c21-91d1-7ebdfe4876c1 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d" status: 200 len: 1464 microversion: 2.1 time: 0.204247 Aug 24 10:41:11.769477 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2480/5312] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:11 2022] GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d => generated 1464 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:11.770071 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9ced0363-44bf-4fa9-865a-4193833df68f tempest-ServersTestJSON-523633018 tempest-ServersTestJSON-523633018-project] 10.222.0.85 "GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9" status: 404 len: 111 microversion: 2.1 time: 0.073164 Aug 24 10:41:11.775074 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2833/5313] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:11 2022] GET /compute/v2.1/servers/2e7b7b62-27d9-4c85-8c86-e2e2f51ecab9 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:41:12.785195 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-056d903d-a64c-4998-8278-3cf6efdac6db tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:12.786526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-056d903d-a64c-4998-8278-3cf6efdac6db tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:12.804999 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-056d903d-a64c-4998-8278-3cf6efdac6db tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:12.805844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-056d903d-a64c-4998-8278-3cf6efdac6db tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:12.806462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-056d903d-a64c-4998-8278-3cf6efdac6db tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:12.807383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-056d903d-a64c-4998-8278-3cf6efdac6db tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:12.809695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-056d903d-a64c-4998-8278-3cf6efdac6db tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:12.810343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-056d903d-a64c-4998-8278-3cf6efdac6db tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:12.846201 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-056d903d-a64c-4998-8278-3cf6efdac6db tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] HTTP exception thrown: Instance 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d could not be found. Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-056d903d-a64c-4998-8278-3cf6efdac6db tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Request method failure captured: Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d HTTP/1.1 Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf4TQ-ANQmryHMcmh9mjA8auVh1UVU40Ptyqc8C7SVEqbwoTaJhYRV2L-5dPBBr1S5HtWMawW3k8YGb_tKrCiEye7fzruwlhEHHLdof87q4HL1nmhzukhg_36RvG00tLOGcZO9HQ1UY-3nEC3lK5bXyxvHMgEJdlWvWiw7WTxDs1y50 Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 3d511560c1f543169e7eab8c70c9abcd Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerActionsTestJSON-1329836544 Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3d511560c1f543169e7eab8c70c9abcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3d511560c1f543169e7eab8c70c9abcd", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3d511560c1f543169e7eab8c70c9abcd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3d511560c1f543169e7eab8c70c9abcd"}]}] Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerActionsTestJSON-1329836544 Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 3d511560c1f543169e7eab8c70c9abcd Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerActionsTestJSON-1329836544 Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerActionsTestJSON-1329836544-project Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 03ef6a33c1f0467993486547b7d00fda Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerActionsTestJSON-1329836544-project Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d could not be found. Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '45f848cf-4fd8-44c9-8d28-d3491a3fbd2d'} Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d could not be found. Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d could not be found. Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:12.848493 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:12.853199 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:12.853199 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:12.853199 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:12.853199 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:41:12.853199 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:41:12.853199 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d could not be found. Aug 24 10:41:12.853199 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:41:12.854730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-056d903d-a64c-4998-8278-3cf6efdac6db tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Returning 404 to user: Instance 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:41:12.855818 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-056d903d-a64c-4998-8278-3cf6efdac6db tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d" status: 404 len: 111 microversion: 2.1 time: 0.080736 Aug 24 10:41:12.861169 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2481/5314] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:12 2022] GET /compute/v2.1/servers/45f848cf-4fd8-44c9-8d28-d3491a3fbd2d => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:41:12.866927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-71b973f3-da75-40ba-8b72-8ef8f1dad8cc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:12.867618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-71b973f3-da75-40ba-8b72-8ef8f1dad8cc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:12.899662 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71b973f3-da75-40ba-8b72-8ef8f1dad8cc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:12.900529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71b973f3-da75-40ba-8b72-8ef8f1dad8cc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:12.902382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71b973f3-da75-40ba-8b72-8ef8f1dad8cc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:12.907016 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71b973f3-da75-40ba-8b72-8ef8f1dad8cc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:12.916560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71b973f3-da75-40ba-8b72-8ef8f1dad8cc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:12.917410 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71b973f3-da75-40ba-8b72-8ef8f1dad8cc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:12.990635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-71b973f3-da75-40ba-8b72-8ef8f1dad8cc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:41:13.230721 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-71b973f3-da75-40ba-8b72-8ef8f1dad8cc tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "DELETE /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 204 len: 0 microversion: 2.1 time: 0.366933 Aug 24 10:41:13.242445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-30b9623a-c485-4850-b810-52f4c49fb3fa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:13.243462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-30b9623a-c485-4850-b810-52f4c49fb3fa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:13.247697 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2834/5315] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:41:12 2022] DELETE /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:41:13.286021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30b9623a-c485-4850-b810-52f4c49fb3fa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:13.290983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30b9623a-c485-4850-b810-52f4c49fb3fa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:13.296464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30b9623a-c485-4850-b810-52f4c49fb3fa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:13.297571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30b9623a-c485-4850-b810-52f4c49fb3fa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:13.298662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30b9623a-c485-4850-b810-52f4c49fb3fa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:13.300410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30b9623a-c485-4850-b810-52f4c49fb3fa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:13.757871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-e22eb87d-1c61-4d88-a511-fd0341bb8802 req-80d2d499-d7b4-44f9-8940-ad2964e10b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45f848cf-4fd8-44c9-8d28-d3491a3fbd2d", "name": "network-vif-deleted", "tag": "923183a9-35de-48cb-8cf8-83600d182ee2"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:41:13.776675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e22eb87d-1c61-4d88-a511-fd0341bb8802 req-80d2d499-d7b4-44f9-8940-ad2964e10b93 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:13.777320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e22eb87d-1c61-4d88-a511-fd0341bb8802 req-80d2d499-d7b4-44f9-8940-ad2964e10b93 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:13.788618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e22eb87d-1c61-4d88-a511-fd0341bb8802 req-80d2d499-d7b4-44f9-8940-ad2964e10b93 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:13.817165 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-e22eb87d-1c61-4d88-a511-fd0341bb8802 req-80d2d499-d7b4-44f9-8940-ad2964e10b93 service nova] Creating event network-vif-deleted:923183a9-35de-48cb-8cf8-83600d182ee2 for instance 45f848cf-4fd8-44c9-8d28-d3491a3fbd2d on n-h1-849328-3 Aug 24 10:41:13.836090 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-e22eb87d-1c61-4d88-a511-fd0341bb8802 req-80d2d499-d7b4-44f9-8940-ad2964e10b93 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081886 Aug 24 10:41:13.864780 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2835/5316] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:41:14.545422 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-30b9623a-c485-4850-b810-52f4c49fb3fa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:14.556838 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-30b9623a-c485-4850-b810-52f4c49fb3fa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1495 microversion: 2.1 time: 1.319944 Aug 24 10:41:14.569611 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2482/5317] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:13 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1495 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:15.126047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8cbdb055-a8d8-4dc2-9c20-c81319c5bb12 req-f444fe98-6155-47d7-9290-4df30889a3c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ab2cfea-9c70-4e39-974f-beb80474d2da", "name": "network-vif-deleted", "tag": "f9ad995f-7308-4040-a0b7-3ddf83743260"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:41:15.170115 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8cbdb055-a8d8-4dc2-9c20-c81319c5bb12 req-f444fe98-6155-47d7-9290-4df30889a3c6 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:15.173907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8cbdb055-a8d8-4dc2-9c20-c81319c5bb12 req-f444fe98-6155-47d7-9290-4df30889a3c6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:15.174273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8cbdb055-a8d8-4dc2-9c20-c81319c5bb12 req-f444fe98-6155-47d7-9290-4df30889a3c6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:15.205173 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8cbdb055-a8d8-4dc2-9c20-c81319c5bb12 req-f444fe98-6155-47d7-9290-4df30889a3c6 service nova] Creating event network-vif-deleted:f9ad995f-7308-4040-a0b7-3ddf83743260 for instance 6ab2cfea-9c70-4e39-974f-beb80474d2da on n-h2-849328-3 Aug 24 10:41:15.216541 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8cbdb055-a8d8-4dc2-9c20-c81319c5bb12 req-f444fe98-6155-47d7-9290-4df30889a3c6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097048 Aug 24 10:41:15.219891 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2836/5318] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:41:15.583632 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2a9f6826-7aa9-4a92-b3e1-90bb584fce8c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:15.586816 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2a9f6826-7aa9-4a92-b3e1-90bb584fce8c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:15.604808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a9f6826-7aa9-4a92-b3e1-90bb584fce8c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:15.605909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a9f6826-7aa9-4a92-b3e1-90bb584fce8c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:15.607784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a9f6826-7aa9-4a92-b3e1-90bb584fce8c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:15.609313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a9f6826-7aa9-4a92-b3e1-90bb584fce8c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:15.610356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a9f6826-7aa9-4a92-b3e1-90bb584fce8c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:15.611352 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a9f6826-7aa9-4a92-b3e1-90bb584fce8c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:15.682546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a9f6826-7aa9-4a92-b3e1-90bb584fce8c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:15.683393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a9f6826-7aa9-4a92-b3e1-90bb584fce8c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:15.684120 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a9f6826-7aa9-4a92-b3e1-90bb584fce8c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:15.684759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-2a9f6826-7aa9-4a92-b3e1-90bb584fce8c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lazy-loading 'fault' on Instance uuid 6ab2cfea-9c70-4e39-974f-beb80474d2da {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:41:15.881779 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2a9f6826-7aa9-4a92-b3e1-90bb584fce8c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:15.892855 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2a9f6826-7aa9-4a92-b3e1-90bb584fce8c tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 200 len: 1305 microversion: 2.1 time: 0.316134 Aug 24 10:41:15.906100 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2483/5319] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:15 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 1305 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:16.916115 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3f83c80d-1797-4556-a40b-af2fb3d862ba tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:16.919493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3f83c80d-1797-4556-a40b-af2fb3d862ba tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 6ab2cfea-9c70-4e39-974f-beb80474d2da] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:16.965604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f83c80d-1797-4556-a40b-af2fb3d862ba tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:16.965604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f83c80d-1797-4556-a40b-af2fb3d862ba tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:16.965604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f83c80d-1797-4556-a40b-af2fb3d862ba tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:16.965903 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f83c80d-1797-4556-a40b-af2fb3d862ba tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:16.968194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f83c80d-1797-4556-a40b-af2fb3d862ba tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:16.969285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f83c80d-1797-4556-a40b-af2fb3d862ba tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:17.019278 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-3f83c80d-1797-4556-a40b-af2fb3d862ba tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] HTTP exception thrown: Instance 6ab2cfea-9c70-4e39-974f-beb80474d2da could not be found. Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3f83c80d-1797-4556-a40b-af2fb3d862ba tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Request method failure captured: Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da HTTP/1.1 Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf4TQ-ANQmryHMcmh9mjA8auVh1UVU40Ptyqc8C7SVEqbwoTaJhYRV2L-5dPBBr1S5HtWMawW3k8YGb_tKrCiEye7fzruwlhEHHLdof87q4HL1nmhzukhg_36RvG00tLOGcZO9HQ1UY-3nEC3lK5bXyxvHMgEJdlWvWiw7WTxDs1y50 Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 3d511560c1f543169e7eab8c70c9abcd Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerActionsTestJSON-1329836544 Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3d511560c1f543169e7eab8c70c9abcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3d511560c1f543169e7eab8c70c9abcd", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3d511560c1f543169e7eab8c70c9abcd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3d511560c1f543169e7eab8c70c9abcd"}]}] Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerActionsTestJSON-1329836544 Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 3d511560c1f543169e7eab8c70c9abcd Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerActionsTestJSON-1329836544 Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerActionsTestJSON-1329836544-project Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 03ef6a33c1f0467993486547b7d00fda Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerActionsTestJSON-1329836544-project Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 6ab2cfea-9c70-4e39-974f-beb80474d2da could not be found. Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '6ab2cfea-9c70-4e39-974f-beb80474d2da'} Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ab2cfea-9c70-4e39-974f-beb80474d2da could not be found. Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ab2cfea-9c70-4e39-974f-beb80474d2da could not be found. Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:17.022881 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:17.029009 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:17.029009 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:17.029009 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:17.029009 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:41:17.029009 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:41:17.029009 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ab2cfea-9c70-4e39-974f-beb80474d2da could not be found. Aug 24 10:41:17.029009 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:17.029009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3f83c80d-1797-4556-a40b-af2fb3d862ba tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Returning 404 to user: Instance 6ab2cfea-9c70-4e39-974f-beb80474d2da could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:41:17.032401 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3f83c80d-1797-4556-a40b-af2fb3d862ba tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da" status: 404 len: 111 microversion: 2.1 time: 0.121036 Aug 24 10:41:17.034398 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2837/5320] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:16 2022] GET /compute/v2.1/servers/6ab2cfea-9c70-4e39-974f-beb80474d2da => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:41:17.042617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e91ff5ac-359a-4d49-8528-872351b86311 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:17.043837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e91ff5ac-359a-4d49-8528-872351b86311 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:17.058653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e91ff5ac-359a-4d49-8528-872351b86311 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:17.062049 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e91ff5ac-359a-4d49-8528-872351b86311 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:17.063909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e91ff5ac-359a-4d49-8528-872351b86311 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:17.066215 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e91ff5ac-359a-4d49-8528-872351b86311 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:17.067500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e91ff5ac-359a-4d49-8528-872351b86311 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:17.068793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e91ff5ac-359a-4d49-8528-872351b86311 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:17.160176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e91ff5ac-359a-4d49-8528-872351b86311 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:41:17.381731 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e91ff5ac-359a-4d49-8528-872351b86311 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "DELETE /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 204 len: 0 microversion: 2.1 time: 0.343070 Aug 24 10:41:17.383727 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2484/5321] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:41:17 2022] DELETE /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:41:17.393861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5096f9ee-7951-46cc-b5ce-f54c3b4d67ff tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:17.394920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5096f9ee-7951-46cc-b5ce-f54c3b4d67ff tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:17.411804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5096f9ee-7951-46cc-b5ce-f54c3b4d67ff tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:17.412808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5096f9ee-7951-46cc-b5ce-f54c3b4d67ff tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:17.414161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5096f9ee-7951-46cc-b5ce-f54c3b4d67ff tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:17.415538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5096f9ee-7951-46cc-b5ce-f54c3b4d67ff tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:17.416315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5096f9ee-7951-46cc-b5ce-f54c3b4d67ff tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:17.416971 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5096f9ee-7951-46cc-b5ce-f54c3b4d67ff tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:17.460845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:17.760029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5096f9ee-7951-46cc-b5ce-f54c3b4d67ff tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:17.785351 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5096f9ee-7951-46cc-b5ce-f54c3b4d67ff tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1675 microversion: 2.1 time: 0.396788 Aug 24 10:41:17.786161 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2838/5322] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:17 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1675 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:18.810107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0d1fa6d0-e600-426b-a51e-e31945688939 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:18.810902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0d1fa6d0-e600-426b-a51e-e31945688939 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:18.832092 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d1fa6d0-e600-426b-a51e-e31945688939 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:18.832524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d1fa6d0-e600-426b-a51e-e31945688939 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:18.839294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d1fa6d0-e600-426b-a51e-e31945688939 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:18.844277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d1fa6d0-e600-426b-a51e-e31945688939 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:18.845760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d1fa6d0-e600-426b-a51e-e31945688939 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:18.846241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d1fa6d0-e600-426b-a51e-e31945688939 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:20.646676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0d1fa6d0-e600-426b-a51e-e31945688939 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:20.666862 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0d1fa6d0-e600-426b-a51e-e31945688939 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1675 microversion: 2.1 time: 1.858579 Aug 24 10:41:20.670256 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2485/5323] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:18 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1675 bytes in 1867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:41:21.697974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3141a880-8fe8-4cbd-8f04-ee50fd80a4a4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:21.701786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3141a880-8fe8-4cbd-8f04-ee50fd80a4a4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:21.725717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3141a880-8fe8-4cbd-8f04-ee50fd80a4a4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:21.730679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3141a880-8fe8-4cbd-8f04-ee50fd80a4a4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:21.734769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3141a880-8fe8-4cbd-8f04-ee50fd80a4a4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:21.736286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3141a880-8fe8-4cbd-8f04-ee50fd80a4a4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:21.739285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3141a880-8fe8-4cbd-8f04-ee50fd80a4a4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:21.743242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3141a880-8fe8-4cbd-8f04-ee50fd80a4a4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:22.490146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3141a880-8fe8-4cbd-8f04-ee50fd80a4a4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:22.504788 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3141a880-8fe8-4cbd-8f04-ee50fd80a4a4 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1675 microversion: 2.1 time: 0.816061 Aug 24 10:41:22.508432 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2839/5324] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:21 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1675 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:23.533618 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cce947c2-9c4e-43ba-ab04-3b70a1cd4ba0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:23.534949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cce947c2-9c4e-43ba-ab04-3b70a1cd4ba0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:23.569021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cce947c2-9c4e-43ba-ab04-3b70a1cd4ba0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:23.570092 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cce947c2-9c4e-43ba-ab04-3b70a1cd4ba0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:23.571259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cce947c2-9c4e-43ba-ab04-3b70a1cd4ba0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:23.574265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cce947c2-9c4e-43ba-ab04-3b70a1cd4ba0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:23.575554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cce947c2-9c4e-43ba-ab04-3b70a1cd4ba0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:23.576556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cce947c2-9c4e-43ba-ab04-3b70a1cd4ba0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:24.288560 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cce947c2-9c4e-43ba-ab04-3b70a1cd4ba0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:24.303925 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cce947c2-9c4e-43ba-ab04-3b70a1cd4ba0 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1607 microversion: 2.1 time: 0.775514 Aug 24 10:41:24.304925 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2486/5325] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:23 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1607 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:24.796072 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2e774bcb-39a8-4a7e-89d6-dbac9b60c33b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:24.797237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2e774bcb-39a8-4a7e-89d6-dbac9b60c33b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:24.807078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e774bcb-39a8-4a7e-89d6-dbac9b60c33b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:24.807567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e774bcb-39a8-4a7e-89d6-dbac9b60c33b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:24.808030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e774bcb-39a8-4a7e-89d6-dbac9b60c33b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:24.808762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e774bcb-39a8-4a7e-89d6-dbac9b60c33b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:24.811463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e774bcb-39a8-4a7e-89d6-dbac9b60c33b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:24.812419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e774bcb-39a8-4a7e-89d6-dbac9b60c33b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:24.871241 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2e774bcb-39a8-4a7e-89d6-dbac9b60c33b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-volume_attachments/a59f4dcc-918f-4b08-ab37-42bc7b283c70" status: 200 len: 194 microversion: 2.20 time: 0.079248 Aug 24 10:41:24.877335 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2840/5326] 10.222.0.85 () {60 vars in 1454 bytes} [Wed Aug 24 10:41:24 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-volume_attachments/a59f4dcc-918f-4b08-ab37-42bc7b283c70 => generated 194 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:41:24.981230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eef10874-621b-44cc-84e1-4fa466aa1e89 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:24.982022 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eef10874-621b-44cc-84e1-4fa466aa1e89 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:24.998000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eef10874-621b-44cc-84e1-4fa466aa1e89 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:24.998904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eef10874-621b-44cc-84e1-4fa466aa1e89 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:24.999695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eef10874-621b-44cc-84e1-4fa466aa1e89 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:25.000588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eef10874-621b-44cc-84e1-4fa466aa1e89 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:25.001412 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eef10874-621b-44cc-84e1-4fa466aa1e89 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:25.001998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eef10874-621b-44cc-84e1-4fa466aa1e89 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:25.135782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-eef10874-621b-44cc-84e1-4fa466aa1e89 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lazy-loading 'services' on Instance uuid 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:41:25.241998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:25.260266 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eef10874-621b-44cc-84e1-4fa466aa1e89 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "DELETE /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-volume_attachments/a59f4dcc-918f-4b08-ab37-42bc7b283c70" status: 202 len: 0 microversion: 2.20 time: 0.285756 Aug 24 10:41:25.264001 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2487/5327] 10.222.0.85 () {60 vars in 1457 bytes} [Wed Aug 24 10:41:24 2022] DELETE /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-volume_attachments/a59f4dcc-918f-4b08-ab37-42bc7b283c70 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:41:25.274170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e03321cd-f7c0-44e4-b462-e9cf9f49992e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:25.281768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e03321cd-f7c0-44e4-b462-e9cf9f49992e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:25.303244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e03321cd-f7c0-44e4-b462-e9cf9f49992e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:25.304258 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e03321cd-f7c0-44e4-b462-e9cf9f49992e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:25.307024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e03321cd-f7c0-44e4-b462-e9cf9f49992e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:25.308416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e03321cd-f7c0-44e4-b462-e9cf9f49992e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:25.312551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e03321cd-f7c0-44e4-b462-e9cf9f49992e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:25.316124 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e03321cd-f7c0-44e4-b462-e9cf9f49992e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:25.328593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e1557ab7-29b1-4fa3-bc32-2bbd013a11aa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:25.329907 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e1557ab7-29b1-4fa3-bc32-2bbd013a11aa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:25.353844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1557ab7-29b1-4fa3-bc32-2bbd013a11aa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:25.355247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1557ab7-29b1-4fa3-bc32-2bbd013a11aa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:25.356936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1557ab7-29b1-4fa3-bc32-2bbd013a11aa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:25.359897 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1557ab7-29b1-4fa3-bc32-2bbd013a11aa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:25.360426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1557ab7-29b1-4fa3-bc32-2bbd013a11aa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:25.360884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1557ab7-29b1-4fa3-bc32-2bbd013a11aa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:25.462181 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e03321cd-f7c0-44e4-b462-e9cf9f49992e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.193538 Aug 24 10:41:25.462823 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2841/5328] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Aug 24 10:41:25 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 10:41:26.284610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-bca5c7ea-316a-45c8-8815-fca38c4cb0d5 req-25c1c4d5-ec42-4937-9b26-9283344bb723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ed6211-b7fc-454f-a8e9-73ba571a71af", "name": "network-vif-deleted", "tag": "1c2608cb-c0ff-45d5-b7c5-82ff95cc5b0c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:41:26.319888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bca5c7ea-316a-45c8-8815-fca38c4cb0d5 req-25c1c4d5-ec42-4937-9b26-9283344bb723 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:26.320903 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bca5c7ea-316a-45c8-8815-fca38c4cb0d5 req-25c1c4d5-ec42-4937-9b26-9283344bb723 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:26.322404 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e1557ab7-29b1-4fa3-bc32-2bbd013a11aa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ef6a33c1f0467993486547b7d00fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d511560c1f543169e7eab8c70c9abcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:26.328541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bca5c7ea-316a-45c8-8815-fca38c4cb0d5 req-25c1c4d5-ec42-4937-9b26-9283344bb723 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:26.332954 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e1557ab7-29b1-4fa3-bc32-2bbd013a11aa tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 200 len: 1607 microversion: 2.1 time: 1.012352 Aug 24 10:41:26.338549 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2488/5329] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:25 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 1607 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:26.382382 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-bca5c7ea-316a-45c8-8815-fca38c4cb0d5 req-25c1c4d5-ec42-4937-9b26-9283344bb723 service nova] Creating event network-vif-deleted:1c2608cb-c0ff-45d5-b7c5-82ff95cc5b0c for instance 99ed6211-b7fc-454f-a8e9-73ba571a71af on n-h1-849328-3 Aug 24 10:41:26.405207 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-bca5c7ea-316a-45c8-8815-fca38c4cb0d5 req-25c1c4d5-ec42-4937-9b26-9283344bb723 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123962 Aug 24 10:41:26.408427 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2842/5330] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:41:26.475890 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8de6d579-6405-4df2-80a3-dcdbfd72873a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:26.478630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8de6d579-6405-4df2-80a3-dcdbfd72873a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:26.514912 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8de6d579-6405-4df2-80a3-dcdbfd72873a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:26.515661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8de6d579-6405-4df2-80a3-dcdbfd72873a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:26.516278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8de6d579-6405-4df2-80a3-dcdbfd72873a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:26.518584 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8de6d579-6405-4df2-80a3-dcdbfd72873a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:26.519243 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8de6d579-6405-4df2-80a3-dcdbfd72873a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:26.543352 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8de6d579-6405-4df2-80a3-dcdbfd72873a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:26.660401 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8de6d579-6405-4df2-80a3-dcdbfd72873a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.188986 Aug 24 10:41:26.661616 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2489/5331] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Aug 24 10:41:26 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:41:27.359982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c70ebcf3-5c4b-4c71-93e2-30a14fbfbc88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:27.360679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c70ebcf3-5c4b-4c71-93e2-30a14fbfbc88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] [instance: 99ed6211-b7fc-454f-a8e9-73ba571a71af] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:27.378237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c70ebcf3-5c4b-4c71-93e2-30a14fbfbc88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:27.378731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c70ebcf3-5c4b-4c71-93e2-30a14fbfbc88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:27.379167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c70ebcf3-5c4b-4c71-93e2-30a14fbfbc88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:27.379873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c70ebcf3-5c4b-4c71-93e2-30a14fbfbc88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:27.380325 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c70ebcf3-5c4b-4c71-93e2-30a14fbfbc88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:27.380749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c70ebcf3-5c4b-4c71-93e2-30a14fbfbc88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:27.423809 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-c70ebcf3-5c4b-4c71-93e2-30a14fbfbc88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] HTTP exception thrown: Instance 99ed6211-b7fc-454f-a8e9-73ba571a71af could not be found. Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c70ebcf3-5c4b-4c71-93e2-30a14fbfbc88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Request method failure captured: Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af HTTP/1.1 Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf4TQ-ANQmryHMcmh9mjA8auVh1UVU40Ptyqc8C7SVEqbwoTaJhYRV2L-5dPBBr1S5HtWMawW3k8YGb_tKrCiEye7fzruwlhEHHLdof87q4HL1nmhzukhg_36RvG00tLOGcZO9HQ1UY-3nEC3lK5bXyxvHMgEJdlWvWiw7WTxDs1y50 Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 3d511560c1f543169e7eab8c70c9abcd Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerActionsTestJSON-1329836544 Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3d511560c1f543169e7eab8c70c9abcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3d511560c1f543169e7eab8c70c9abcd", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3d511560c1f543169e7eab8c70c9abcd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3d511560c1f543169e7eab8c70c9abcd"}]}] Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerActionsTestJSON-1329836544 Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 3d511560c1f543169e7eab8c70c9abcd Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerActionsTestJSON-1329836544 Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerActionsTestJSON-1329836544-project Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 03ef6a33c1f0467993486547b7d00fda Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerActionsTestJSON-1329836544-project Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 99ed6211-b7fc-454f-a8e9-73ba571a71af could not be found. Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '99ed6211-b7fc-454f-a8e9-73ba571a71af'} Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99ed6211-b7fc-454f-a8e9-73ba571a71af could not be found. Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99ed6211-b7fc-454f-a8e9-73ba571a71af could not be found. Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:27.425507 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:27.429836 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:27.429836 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:27.429836 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:27.429836 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:41:27.429836 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:41:27.429836 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99ed6211-b7fc-454f-a8e9-73ba571a71af could not be found. Aug 24 10:41:27.429836 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:27.433909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c70ebcf3-5c4b-4c71-93e2-30a14fbfbc88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Returning 404 to user: Instance 99ed6211-b7fc-454f-a8e9-73ba571a71af could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:41:27.435071 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c70ebcf3-5c4b-4c71-93e2-30a14fbfbc88 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af" status: 404 len: 111 microversion: 2.1 time: 0.080331 Aug 24 10:41:27.444706 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2843/5332] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:27 2022] GET /compute/v2.1/servers/99ed6211-b7fc-454f-a8e9-73ba571a71af => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:41:27.451625 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f8d1ce45-33eb-46ee-a5bd-9c914425e130 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] Calling method '.version_select at 0x7f465a42b430>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:27.518949 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f8d1ce45-33eb-46ee-a5bd-9c914425e130 tempest-ServerActionsTestJSON-1329836544 tempest-ServerActionsTestJSON-1329836544-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1659287080" status: 202 len: 0 microversion: 2.1 time: 0.076392 Aug 24 10:41:27.522663 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2490/5333] 10.222.0.85 () {58 vars in 1221 bytes} [Wed Aug 24 10:41:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1659287080 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:41:27.674352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-38951b73-0e5b-4ca4-b419-da15ca4ec29a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:27.677319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-38951b73-0e5b-4ca4-b419-da15ca4ec29a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:27.690147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38951b73-0e5b-4ca4-b419-da15ca4ec29a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:27.690912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38951b73-0e5b-4ca4-b419-da15ca4ec29a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:27.693668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38951b73-0e5b-4ca4-b419-da15ca4ec29a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:27.694604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38951b73-0e5b-4ca4-b419-da15ca4ec29a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:27.696340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38951b73-0e5b-4ca4-b419-da15ca4ec29a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:27.699518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38951b73-0e5b-4ca4-b419-da15ca4ec29a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:27.780614 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-38951b73-0e5b-4ca4-b419-da15ca4ec29a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.110761 Aug 24 10:41:27.781558 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2844/5334] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Aug 24 10:41:27 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:41:28.798471 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-567d07b1-71c2-4573-a14d-5361592fe86e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:28.800874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-567d07b1-71c2-4573-a14d-5361592fe86e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:28.811943 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-567d07b1-71c2-4573-a14d-5361592fe86e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:28.812533 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-567d07b1-71c2-4573-a14d-5361592fe86e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:28.813606 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-567d07b1-71c2-4573-a14d-5361592fe86e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:28.814389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-567d07b1-71c2-4573-a14d-5361592fe86e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:28.815263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-567d07b1-71c2-4573-a14d-5361592fe86e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:28.815817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-567d07b1-71c2-4573-a14d-5361592fe86e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:28.886274 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-567d07b1-71c2-4573-a14d-5361592fe86e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.097006 Aug 24 10:41:28.890761 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2491/5335] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Aug 24 10:41:28 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:41:29.904911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bfd8891c-defa-4ddc-8340-3de2cd033550 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:29.917737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bfd8891c-defa-4ddc-8340-3de2cd033550 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:29.938188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bfd8891c-defa-4ddc-8340-3de2cd033550 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:29.938678 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bfd8891c-defa-4ddc-8340-3de2cd033550 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:29.940293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bfd8891c-defa-4ddc-8340-3de2cd033550 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:29.941019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bfd8891c-defa-4ddc-8340-3de2cd033550 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:29.944884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bfd8891c-defa-4ddc-8340-3de2cd033550 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:29.947025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bfd8891c-defa-4ddc-8340-3de2cd033550 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:30.038660 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bfd8891c-defa-4ddc-8340-3de2cd033550 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.137749 Aug 24 10:41:30.041587 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2845/5336] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Aug 24 10:41:29 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:41:31.056424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-62700352-e8b1-48b6-93a0-ad18da17bd10 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:31.064682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-62700352-e8b1-48b6-93a0-ad18da17bd10 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:31.092255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62700352-e8b1-48b6-93a0-ad18da17bd10 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:31.094931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62700352-e8b1-48b6-93a0-ad18da17bd10 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:31.096427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62700352-e8b1-48b6-93a0-ad18da17bd10 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:31.099656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62700352-e8b1-48b6-93a0-ad18da17bd10 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:31.103073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62700352-e8b1-48b6-93a0-ad18da17bd10 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:31.105927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62700352-e8b1-48b6-93a0-ad18da17bd10 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:31.186486 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-62700352-e8b1-48b6-93a0-ad18da17bd10 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.138463 Aug 24 10:41:31.195958 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2492/5337] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Aug 24 10:41:31 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:41:32.202552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0487de30-374a-4f26-89d3-1f2e6ad7cb85 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:32.205246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0487de30-374a-4f26-89d3-1f2e6ad7cb85 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:32.219193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:32.287849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0487de30-374a-4f26-89d3-1f2e6ad7cb85 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:32.297928 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0487de30-374a-4f26-89d3-1f2e6ad7cb85 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:32.299874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0487de30-374a-4f26-89d3-1f2e6ad7cb85 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:32.302293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0487de30-374a-4f26-89d3-1f2e6ad7cb85 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:32.305731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0487de30-374a-4f26-89d3-1f2e6ad7cb85 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:32.306476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0487de30-374a-4f26-89d3-1f2e6ad7cb85 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:32.374523 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0487de30-374a-4f26-89d3-1f2e6ad7cb85 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.175855 Aug 24 10:41:32.379433 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2846/5338] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Aug 24 10:41:32 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:41:33.394963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-43e0a4c4-05e5-4a49-933b-3a73b2dcf662 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:33.400249 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-43e0a4c4-05e5-4a49-933b-3a73b2dcf662 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:33.442405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e0a4c4-05e5-4a49-933b-3a73b2dcf662 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:33.442965 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e0a4c4-05e5-4a49-933b-3a73b2dcf662 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:33.443410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e0a4c4-05e5-4a49-933b-3a73b2dcf662 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:33.446790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e0a4c4-05e5-4a49-933b-3a73b2dcf662 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:33.449000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e0a4c4-05e5-4a49-933b-3a73b2dcf662 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:33.450294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e0a4c4-05e5-4a49-933b-3a73b2dcf662 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:33.577082 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-43e0a4c4-05e5-4a49-933b-3a73b2dcf662 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.188919 Aug 24 10:41:33.579853 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2493/5339] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Aug 24 10:41:33 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:41:34.591788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4767b763-ccd5-4d5a-af97-6b4b029ff165 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:34.604448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4767b763-ccd5-4d5a-af97-6b4b029ff165 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:34.642518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4767b763-ccd5-4d5a-af97-6b4b029ff165 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:34.643262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4767b763-ccd5-4d5a-af97-6b4b029ff165 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:34.657311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4767b763-ccd5-4d5a-af97-6b4b029ff165 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:34.658286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4767b763-ccd5-4d5a-af97-6b4b029ff165 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:34.658773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4767b763-ccd5-4d5a-af97-6b4b029ff165 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:34.660121 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4767b763-ccd5-4d5a-af97-6b4b029ff165 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:34.773436 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4767b763-ccd5-4d5a-af97-6b4b029ff165 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.184823 Aug 24 10:41:34.776257 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2847/5340] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Aug 24 10:41:34 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:41:35.789207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-af6e9426-7333-4be4-8437-2516ef1ecb77 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:35.791428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-af6e9426-7333-4be4-8437-2516ef1ecb77 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:35.802105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:35.821868 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af6e9426-7333-4be4-8437-2516ef1ecb77 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:35.834265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af6e9426-7333-4be4-8437-2516ef1ecb77 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:35.835264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af6e9426-7333-4be4-8437-2516ef1ecb77 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:35.836317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af6e9426-7333-4be4-8437-2516ef1ecb77 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:35.836920 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af6e9426-7333-4be4-8437-2516ef1ecb77 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:35.837537 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af6e9426-7333-4be4-8437-2516ef1ecb77 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:35.918478 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-af6e9426-7333-4be4-8437-2516ef1ecb77 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.136063 Aug 24 10:41:35.918972 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2494/5341] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Aug 24 10:41:35 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:41:36.935337 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5fa433e6-7317-4a4b-8436-226681b63c18 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:36.942315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5fa433e6-7317-4a4b-8436-226681b63c18 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:36.982945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fa433e6-7317-4a4b-8436-226681b63c18 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:36.989803 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fa433e6-7317-4a4b-8436-226681b63c18 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:36.991403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fa433e6-7317-4a4b-8436-226681b63c18 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:36.993100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fa433e6-7317-4a4b-8436-226681b63c18 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:36.995051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fa433e6-7317-4a4b-8436-226681b63c18 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:36.995746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fa433e6-7317-4a4b-8436-226681b63c18 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:37.075851 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5fa433e6-7317-4a4b-8436-226681b63c18 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.149185 Aug 24 10:41:37.077239 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2848/5342] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Aug 24 10:41:36 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e/os-volume_attachments => generated 25 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:37.191276 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-782ab0fd-f484-4eba-99ec-ec5edecdd05e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:37.192393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-782ab0fd-f484-4eba-99ec-ec5edecdd05e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:37.204597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-782ab0fd-f484-4eba-99ec-ec5edecdd05e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:37.205102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-782ab0fd-f484-4eba-99ec-ec5edecdd05e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:37.213321 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-782ab0fd-f484-4eba-99ec-ec5edecdd05e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:37.215874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-782ab0fd-f484-4eba-99ec-ec5edecdd05e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:37.216377 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-782ab0fd-f484-4eba-99ec-ec5edecdd05e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:37.216825 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-782ab0fd-f484-4eba-99ec-ec5edecdd05e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:37.296167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-782ab0fd-f484-4eba-99ec-ec5edecdd05e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:41:37.428215 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-782ab0fd-f484-4eba-99ec-ec5edecdd05e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "DELETE /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 204 len: 0 microversion: 2.20 time: 0.240539 Aug 24 10:41:37.438440 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2495/5343] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:41:37 2022] DELETE /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:41:37.447012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8bcf9484-2289-413e-8e48-d8fd7fa57422 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:37.447781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8bcf9484-2289-413e-8e48-d8fd7fa57422 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:37.456866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bcf9484-2289-413e-8e48-d8fd7fa57422 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:37.457690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bcf9484-2289-413e-8e48-d8fd7fa57422 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:37.458334 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bcf9484-2289-413e-8e48-d8fd7fa57422 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:37.459527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bcf9484-2289-413e-8e48-d8fd7fa57422 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:37.460486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bcf9484-2289-413e-8e48-d8fd7fa57422 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:37.461158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bcf9484-2289-413e-8e48-d8fd7fa57422 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:38.035012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8bcf9484-2289-413e-8e48-d8fd7fa57422 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:38.048366 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8bcf9484-2289-413e-8e48-d8fd7fa57422 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:38.059217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8bcf9484-2289-413e-8e48-d8fd7fa57422 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:38.060595 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8bcf9484-2289-413e-8e48-d8fd7fa57422 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1723 microversion: 2.20 time: 0.617942 Aug 24 10:41:38.065361 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2849/5344] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:41:37 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1723 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:41:39.097861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3edd71fc-182f-44b1-b46a-9194472e9c7e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:39.098815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3edd71fc-182f-44b1-b46a-9194472e9c7e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:39.112955 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3edd71fc-182f-44b1-b46a-9194472e9c7e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:39.118434 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3edd71fc-182f-44b1-b46a-9194472e9c7e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:39.119211 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3edd71fc-182f-44b1-b46a-9194472e9c7e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:39.120353 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3edd71fc-182f-44b1-b46a-9194472e9c7e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:39.121341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3edd71fc-182f-44b1-b46a-9194472e9c7e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:39.122011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3edd71fc-182f-44b1-b46a-9194472e9c7e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:40.166687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cddc5b55-039c-41e2-a5a3-3dff61243abc tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:40.167563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cddc5b55-039c-41e2-a5a3-3dff61243abc tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: 94eebedc-5d3f-404b-bdf6-d039b5baf150] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:40.184164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cddc5b55-039c-41e2-a5a3-3dff61243abc tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:40.187055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cddc5b55-039c-41e2-a5a3-3dff61243abc tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:40.188705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cddc5b55-039c-41e2-a5a3-3dff61243abc tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:40.191207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cddc5b55-039c-41e2-a5a3-3dff61243abc tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:40.193643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cddc5b55-039c-41e2-a5a3-3dff61243abc tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:40.194602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cddc5b55-039c-41e2-a5a3-3dff61243abc tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:40.435056 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-cddc5b55-039c-41e2-a5a3-3dff61243abc tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lazy-loading 'services' on Instance uuid 94eebedc-5d3f-404b-bdf6-d039b5baf150 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:41:40.600475 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cddc5b55-039c-41e2-a5a3-3dff61243abc tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "DELETE /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150/os-volume_attachments/de6069dd-b255-4ec1-b067-642608dcc9dc" status: 202 len: 0 microversion: 2.1 time: 0.440824 Aug 24 10:41:40.601134 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2850/5345] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Aug 24 10:41:40 2022] DELETE /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150/os-volume_attachments/de6069dd-b255-4ec1-b067-642608dcc9dc => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:41:40.932395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3edd71fc-182f-44b1-b46a-9194472e9c7e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:40.946526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3edd71fc-182f-44b1-b46a-9194472e9c7e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:40.948318 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3edd71fc-182f-44b1-b46a-9194472e9c7e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:40.953582 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3edd71fc-182f-44b1-b46a-9194472e9c7e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1723 microversion: 2.20 time: 1.860364 Aug 24 10:41:40.954383 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2496/5346] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:41:39 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1723 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:41:41.838203 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-718c3a32-6346-473e-84f4-a045a40f7bbb req-9cca0347-82ac-4335-b138-7801282c9dab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e", "name": "network-vif-deleted", "tag": "04bfe8b2-85f8-48c0-83cc-8a238d22af80"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:41:41.860546 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-718c3a32-6346-473e-84f4-a045a40f7bbb req-9cca0347-82ac-4335-b138-7801282c9dab service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:41.861064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-718c3a32-6346-473e-84f4-a045a40f7bbb req-9cca0347-82ac-4335-b138-7801282c9dab service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:41.861552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-718c3a32-6346-473e-84f4-a045a40f7bbb req-9cca0347-82ac-4335-b138-7801282c9dab service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:41.888977 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-718c3a32-6346-473e-84f4-a045a40f7bbb req-9cca0347-82ac-4335-b138-7801282c9dab service nova] Creating event network-vif-deleted:04bfe8b2-85f8-48c0-83cc-8a238d22af80 for instance 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e on n-h2-849328-3 Aug 24 10:41:41.894714 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-718c3a32-6346-473e-84f4-a045a40f7bbb req-9cca0347-82ac-4335-b138-7801282c9dab service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063657 Aug 24 10:41:41.899414 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2851/5347] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:41:41.982836 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-691cbd78-9b2c-41fa-91ae-b28dc2c9fac7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:41.984176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-691cbd78-9b2c-41fa-91ae-b28dc2c9fac7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:41.995092 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-691cbd78-9b2c-41fa-91ae-b28dc2c9fac7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:41.997664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-691cbd78-9b2c-41fa-91ae-b28dc2c9fac7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:41.998369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-691cbd78-9b2c-41fa-91ae-b28dc2c9fac7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:41.999326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-691cbd78-9b2c-41fa-91ae-b28dc2c9fac7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:41.999988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-691cbd78-9b2c-41fa-91ae-b28dc2c9fac7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:42.000662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-691cbd78-9b2c-41fa-91ae-b28dc2c9fac7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:42.075815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-691cbd78-9b2c-41fa-91ae-b28dc2c9fac7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:42.076675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-691cbd78-9b2c-41fa-91ae-b28dc2c9fac7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:42.077544 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-691cbd78-9b2c-41fa-91ae-b28dc2c9fac7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:42.078260 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-691cbd78-9b2c-41fa-91ae-b28dc2c9fac7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lazy-loading 'fault' on Instance uuid 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:41:42.590420 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-691cbd78-9b2c-41fa-91ae-b28dc2c9fac7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:42.611009 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-691cbd78-9b2c-41fa-91ae-b28dc2c9fac7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:42.615223 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-691cbd78-9b2c-41fa-91ae-b28dc2c9fac7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:42.616911 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-691cbd78-9b2c-41fa-91ae-b28dc2c9fac7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 200 len: 1370 microversion: 2.20 time: 0.638463 Aug 24 10:41:42.632008 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2497/5348] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:41:41 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 1370 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:41:43.658787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d28869ca-dfdf-49a3-bf90-c7e4382e010c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:43.660181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d28869ca-dfdf-49a3-bf90-c7e4382e010c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:43.680356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d28869ca-dfdf-49a3-bf90-c7e4382e010c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:43.681176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d28869ca-dfdf-49a3-bf90-c7e4382e010c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:43.681779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d28869ca-dfdf-49a3-bf90-c7e4382e010c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:43.682781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d28869ca-dfdf-49a3-bf90-c7e4382e010c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:43.683910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d28869ca-dfdf-49a3-bf90-c7e4382e010c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:43.686211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d28869ca-dfdf-49a3-bf90-c7e4382e010c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:43.725101 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-d28869ca-dfdf-49a3-bf90-c7e4382e010c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] HTTP exception thrown: Instance 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e could not be found. Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d28869ca-dfdf-49a3-bf90-c7e4382e010c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Request method failure captured: Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e HTTP/1.1 Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf9nCauhJDOCT4Xy9CKMVMd3wfzK8bvssGDc3rFNOgK-YJxNzU-KAXJQZNh3gZzq6oFSRtXQivWIeWvAbzyOuyl5w5ndy3iHqEIua9W_ikjnzVSeI8nkFEIFmYltjUi5spRJIFZh-3IQ1ii1oBc_-axVhOaob-8aEUg7Ow6cR2rzIb0 Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 2c9ad6902a1f4f2c807315e5ee3dc897 Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1498146334 Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2c9ad6902a1f4f2c807315e5ee3dc897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_2c9ad6902a1f4f2c807315e5ee3dc897", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2c9ad6902a1f4f2c807315e5ee3dc897"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/2c9ad6902a1f4f2c807315e5ee3dc897"}]}] Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1498146334 Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 2c9ad6902a1f4f2c807315e5ee3dc897 Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1498146334 Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AttachVolumeShelveTestJSON-1498146334-project Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 3f1d12ba24f245b59b9af777352984d0 Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1498146334-project Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e could not be found. Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e'} Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e could not be found. Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e could not be found. Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:43.740379 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:43.747022 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:43.747022 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:43.747022 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:43.747022 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:43.747022 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:41:43.747022 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:41:43.747022 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e could not be found. Aug 24 10:41:43.747022 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:43.747022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d28869ca-dfdf-49a3-bf90-c7e4382e010c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Returning 404 to user: Instance 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:41:43.747022 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d28869ca-dfdf-49a3-bf90-c7e4382e010c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 404 len: 111 microversion: 2.20 time: 0.090386 Aug 24 10:41:43.747597 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2852/5349] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:41:43 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:41:43.753408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1ff4e1f5-9aa9-453c-96f7-83a8300e6343 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '.version_select at 0x7f4654f2c8b0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:43.787866 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1ff4e1f5-9aa9-453c-96f7-83a8300e6343 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-641645315" status: 204 len: 0 microversion: 2.20 time: 0.038937 Aug 24 10:41:43.793890 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2498/5350] 10.222.0.85 () {60 vars in 1259 bytes} [Wed Aug 24 10:41:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-641645315 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:41:47.710833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-22a783b4-3eb8-43df-bf1e-ef76b1b992d1 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Action: 'create', calling method: .version_select at 0x7f4647912b80>, body: {"keypair": {"name": "tempest-keypair-1838153285", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDF8ZlnUauMpMHNj5yPSXw/IGjk/9dq+Ld+j3jrjWYgq4k8Qy+C+pvtxPr7aISw6PG98eXnTXa7ZC9AOaWht4YaG8E+viHbJHnNdwjXd3TXF2SEnUTQw0/qv8TDMsTJgg=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:41:47.777265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-22a783b4-3eb8-43df-bf1e-ef76b1b992d1 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Getting quotas for project 2c9ad6902a1f4f2c807315e5ee3dc897. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:41:47.790452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-22a783b4-3eb8-43df-bf1e-ef76b1b992d1 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Getting quotas for user 3f1d12ba24f245b59b9af777352984d0 and project 2c9ad6902a1f4f2c807315e5ee3dc897. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:41:47.895438 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-22a783b4-3eb8-43df-bf1e-ef76b1b992d1 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.187329 Aug 24 10:41:47.897518 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2853/5351] 10.222.0.85 () {62 vars in 1200 bytes} [Wed Aug 24 10:41:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 193 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 10:41:49.247338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-02a9915c-8844-459a-ba28-ee9189691901 tempest-VolumesTestJSON-588096633 tempest-VolumesTestJSON-588096633-project] Calling method '.version_select at 0x7f46552ddf70>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:49.349331 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-02a9915c-8844-459a-ba28-ee9189691901 tempest-VolumesTestJSON-588096633 tempest-VolumesTestJSON-588096633-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/e51f93f7-772e-4760-842a-9d40d161e2e0" status: 200 len: 350 microversion: 2.1 time: 0.107955 Aug 24 10:41:49.350749 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2499/5352] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Aug 24 10:41:49 2022] GET /compute/v2.1/os-volumes/e51f93f7-772e-4760-842a-9d40d161e2e0 => generated 350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:41:50.285188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-70dd1b7b-46c7-4e47-b93e-a7e83d2f1351 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:50.285736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-70dd1b7b-46c7-4e47-b93e-a7e83d2f1351 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: 94eebedc-5d3f-404b-bdf6-d039b5baf150] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:50.297869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70dd1b7b-46c7-4e47-b93e-a7e83d2f1351 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:50.298371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70dd1b7b-46c7-4e47-b93e-a7e83d2f1351 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:50.298807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70dd1b7b-46c7-4e47-b93e-a7e83d2f1351 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:50.299514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70dd1b7b-46c7-4e47-b93e-a7e83d2f1351 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:50.299965 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70dd1b7b-46c7-4e47-b93e-a7e83d2f1351 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:50.300384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70dd1b7b-46c7-4e47-b93e-a7e83d2f1351 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:50.351607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:50.359116 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-70dd1b7b-46c7-4e47-b93e-a7e83d2f1351 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: 94eebedc-5d3f-404b-bdf6-d039b5baf150] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:41:50.569730 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-70dd1b7b-46c7-4e47-b93e-a7e83d2f1351 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "DELETE /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150" status: 204 len: 0 microversion: 2.1 time: 0.289432 Aug 24 10:41:50.579375 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2854/5353] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:41:50 2022] DELETE /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:41:50.580838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bbe0eefd-dffe-445b-9020-aa0f3f5149a7 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:50.582034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bbe0eefd-dffe-445b-9020-aa0f3f5149a7 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: 94eebedc-5d3f-404b-bdf6-d039b5baf150] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:50.595435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbe0eefd-dffe-445b-9020-aa0f3f5149a7 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:50.596363 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbe0eefd-dffe-445b-9020-aa0f3f5149a7 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:50.597055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbe0eefd-dffe-445b-9020-aa0f3f5149a7 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:50.598136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbe0eefd-dffe-445b-9020-aa0f3f5149a7 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:50.598772 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbe0eefd-dffe-445b-9020-aa0f3f5149a7 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:50.599343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbe0eefd-dffe-445b-9020-aa0f3f5149a7 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:51.866189 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bbe0eefd-dffe-445b-9020-aa0f3f5149a7 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988cbd2509314aeaa9ad618e705894d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc5853f2c1c434f832d5ffc2f550bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:51.879252 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bbe0eefd-dffe-445b-9020-aa0f3f5149a7 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150" status: 200 len: 1513 microversion: 2.1 time: 1.301614 Aug 24 10:41:51.882224 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2500/5354] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:50 2022] GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150 => generated 1513 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:52.207774 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4b34d31b-8416-434c-b718-af1ca6a78696 tempest-VolumesTestJSON-588096633 tempest-VolumesTestJSON-588096633-project] Calling method '.version_select at 0x7f4647938160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:52.276038 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4b34d31b-8416-434c-b718-af1ca6a78696 tempest-VolumesTestJSON-588096633 tempest-VolumesTestJSON-588096633-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/1ae20e9c-c0b6-430b-a793-b360f0047685" status: 200 len: 350 microversion: 2.1 time: 0.077553 Aug 24 10:41:52.282999 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2855/5355] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Aug 24 10:41:52 2022] GET /compute/v2.1/os-volumes/1ae20e9c-c0b6-430b-a793-b360f0047685 => generated 350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:41:52.907155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-74ca16eb-3c47-4551-9505-8702af2dc654 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:52.908144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-74ca16eb-3c47-4551-9505-8702af2dc654 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: 94eebedc-5d3f-404b-bdf6-d039b5baf150] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:52.943543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74ca16eb-3c47-4551-9505-8702af2dc654 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:52.944065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74ca16eb-3c47-4551-9505-8702af2dc654 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:52.944488 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74ca16eb-3c47-4551-9505-8702af2dc654 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:52.945278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74ca16eb-3c47-4551-9505-8702af2dc654 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:52.945744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74ca16eb-3c47-4551-9505-8702af2dc654 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:52.946631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74ca16eb-3c47-4551-9505-8702af2dc654 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:54.146579 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-74ca16eb-3c47-4551-9505-8702af2dc654 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988cbd2509314aeaa9ad618e705894d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc5853f2c1c434f832d5ffc2f550bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:54.157313 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-74ca16eb-3c47-4551-9505-8702af2dc654 tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150" status: 200 len: 1513 microversion: 2.1 time: 1.257344 Aug 24 10:41:54.168053 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2501/5356] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:52 2022] GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150 => generated 1513 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:55.189959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ce33efe-27e8-4d5e-abda-2bca255abc2b tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:55.191594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3ce33efe-27e8-4d5e-abda-2bca255abc2b tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: 94eebedc-5d3f-404b-bdf6-d039b5baf150] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:55.228240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-7766b324-e72f-41f9-a3f2-3b042d2648a4 req-a5796ab7-5a31-425f-a8ed-28332b91a2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94eebedc-5d3f-404b-bdf6-d039b5baf150", "name": "network-vif-deleted", "tag": "2c0fae0f-ed26-46d3-8761-073190a62a7c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:41:55.233563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ce33efe-27e8-4d5e-abda-2bca255abc2b tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:55.239934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ce33efe-27e8-4d5e-abda-2bca255abc2b tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:55.246292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ce33efe-27e8-4d5e-abda-2bca255abc2b tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:55.247585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ce33efe-27e8-4d5e-abda-2bca255abc2b tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:55.248286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ce33efe-27e8-4d5e-abda-2bca255abc2b tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:55.251388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ce33efe-27e8-4d5e-abda-2bca255abc2b tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:55.254251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7766b324-e72f-41f9-a3f2-3b042d2648a4 req-a5796ab7-5a31-425f-a8ed-28332b91a2f3 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:55.264263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7766b324-e72f-41f9-a3f2-3b042d2648a4 req-a5796ab7-5a31-425f-a8ed-28332b91a2f3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:55.264829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7766b324-e72f-41f9-a3f2-3b042d2648a4 req-a5796ab7-5a31-425f-a8ed-28332b91a2f3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:55.290157 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7766b324-e72f-41f9-a3f2-3b042d2648a4 req-a5796ab7-5a31-425f-a8ed-28332b91a2f3 service nova] Creating event network-vif-deleted:2c0fae0f-ed26-46d3-8761-073190a62a7c for instance 94eebedc-5d3f-404b-bdf6-d039b5baf150 on n-h1-849328-3 Aug 24 10:41:55.323173 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-7766b324-e72f-41f9-a3f2-3b042d2648a4 req-a5796ab7-5a31-425f-a8ed-28332b91a2f3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098834 Aug 24 10:41:55.337521 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2502/5357] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:41:55.502376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5903cf3f-37a6-402a-b93a-1991253efe7a tempest-VolumesTestJSON-588096633 tempest-VolumesTestJSON-588096633-project] Calling method '.version_select at 0x7f4655017d30>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:55.561114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3ce33efe-27e8-4d5e-abda-2bca255abc2b tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988cbd2509314aeaa9ad618e705894d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc5853f2c1c434f832d5ffc2f550bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:41:55.576204 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ce33efe-27e8-4d5e-abda-2bca255abc2b tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150" status: 200 len: 1471 microversion: 2.1 time: 0.391198 Aug 24 10:41:55.581477 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2856/5358] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:55 2022] GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150 => generated 1471 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:55.634244 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5903cf3f-37a6-402a-b93a-1991253efe7a tempest-VolumesTestJSON-588096633 tempest-VolumesTestJSON-588096633-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/826b98f5-9620-45c8-89dd-c8b8965aff39" status: 200 len: 351 microversion: 2.1 time: 0.137254 Aug 24 10:41:55.637110 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2503/5359] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Aug 24 10:41:55 2022] GET /compute/v2.1/os-volumes/826b98f5-9620-45c8-89dd-c8b8965aff39 => generated 351 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:41:55.653958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-03b281bf-249d-4b59-bff4-5c2c05dc17a1 tempest-VolumesTestJSON-588096633 tempest-VolumesTestJSON-588096633-project] Calling method '.version_select at 0x7f46478c8dc0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:55.840835 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-03b281bf-249d-4b59-bff4-5c2c05dc17a1 tempest-VolumesTestJSON-588096633 tempest-VolumesTestJSON-588096633-project] 10.222.0.85 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.194143 Aug 24 10:41:55.842502 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2857/5360] 10.222.0.85 () {58 vars in 1134 bytes} [Wed Aug 24 10:41:55 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:55.857908 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a30b48ee-f5eb-4e24-8d81-c4d1b5012f8b tempest-VolumesTestJSON-588096633 tempest-VolumesTestJSON-588096633-project] Calling method '.version_select at 0x7f4654f34ee0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:56.087237 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a30b48ee-f5eb-4e24-8d81-c4d1b5012f8b tempest-VolumesTestJSON-588096633 tempest-VolumesTestJSON-588096633-project] 10.222.0.85 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.234811 Aug 24 10:41:56.088150 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2504/5361] 10.222.0.85 () {58 vars in 1149 bytes} [Wed Aug 24 10:41:55 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:41:56.104079 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1f5efc19-42c2-4744-bc2d-e7b747758001 tempest-VolumesTestJSON-588096633 tempest-VolumesTestJSON-588096633-project] Calling method '.version_select at 0x7f4647924b80>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:56.360183 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1f5efc19-42c2-4744-bc2d-e7b747758001 tempest-VolumesTestJSON-588096633 tempest-VolumesTestJSON-588096633-project] 10.222.0.85 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.261700 Aug 24 10:41:56.361045 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2858/5362] 10.222.0.85 () {58 vars in 1134 bytes} [Wed Aug 24 10:41:56 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:56.374689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5aa2d265-4e3d-4e08-a092-823a6407562a tempest-VolumesTestJSON-588096633 tempest-VolumesTestJSON-588096633-project] Calling method '.version_select at 0x7f4647938e50>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:56.530906 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-74bd248e-5168-400c-8616-95305f96f6a8 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Action: 'create', calling method: .version_select at 0x7f4654fd6280>, body: {"keypair": {"name": "tempest-keypair-1851647544", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkiYaKzr5XYDS+urekEF3IUcTtWDDspUKjga2DFS63b/fRUzix+kdJ7WWL7uatgoMEMFCwVM3svd4CepeVEeRKJ1Y5jaWRL2zMhkapAPs8yiJYGTbirmJbynq7cIJilUg=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:41:56.569510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-74bd248e-5168-400c-8616-95305f96f6a8 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Getting quotas for project 3cfd67239d3f4b7a89be1453a08c92ba. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:41:56.577301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-74bd248e-5168-400c-8616-95305f96f6a8 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Getting quotas for user ff5172c17fae44e5839bd9b789e4c3a8 and project 3cfd67239d3f4b7a89be1453a08c92ba. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:41:56.600319 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5aa2d265-4e3d-4e08-a092-823a6407562a tempest-VolumesTestJSON-588096633 tempest-VolumesTestJSON-588096633-project] 10.222.0.85 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.230512 Aug 24 10:41:56.600923 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2859/5363] 10.222.0.85 () {58 vars in 1167 bytes} [Wed Aug 24 10:41:56 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:41:56.613087 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6e261352-789d-465e-b26b-6b33fa1c0afb tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:56.613960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6e261352-789d-465e-b26b-6b33fa1c0afb tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] [instance: 94eebedc-5d3f-404b-bdf6-d039b5baf150] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:41:56.627384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e261352-789d-465e-b26b-6b33fa1c0afb tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:56.628136 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e261352-789d-465e-b26b-6b33fa1c0afb tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:56.628886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e261352-789d-465e-b26b-6b33fa1c0afb tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:56.629819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e261352-789d-465e-b26b-6b33fa1c0afb tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:41:56.630503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e261352-789d-465e-b26b-6b33fa1c0afb tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:41:56.631086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e261352-789d-465e-b26b-6b33fa1c0afb tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:41:56.635036 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-74bd248e-5168-400c-8616-95305f96f6a8 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.396741 Aug 24 10:41:56.636139 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2505/5364] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:41:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:41:56.650554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-448ec936-c0bd-4b07-88fd-b07684518a41 tempest-VolumesTestJSON-588096633 tempest-VolumesTestJSON-588096633-project] Calling method '.version_select at 0x7f465564d550>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:56.664823 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-6e261352-789d-465e-b26b-6b33fa1c0afb tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] HTTP exception thrown: Instance 94eebedc-5d3f-404b-bdf6-d039b5baf150 could not be found. Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6e261352-789d-465e-b26b-6b33fa1c0afb tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Request method failure captured: Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150 HTTP/1.1 Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf8jsOlnM7uC0sIeo9FLRTeum-IRnNRtp8kINLlJyrlJK4SpRX2fxGYgo5GriEVI0D2OAyMbW2YX71INdqrYyIQvwhEDWl0L-brWsKIvmEQMJ7Lbsytl4u0E-vUbPdd0oxoCtzAF9173p03YaQ890UAErKOJddd3G-zPivwkTgn_3fw Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 2dc5853f2c1c434f832d5ffc2f550bf6 Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-VolumesSnapshotTestJSON-353491327 Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2dc5853f2c1c434f832d5ffc2f550bf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_2dc5853f2c1c434f832d5ffc2f550bf6", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2dc5853f2c1c434f832d5ffc2f550bf6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/2dc5853f2c1c434f832d5ffc2f550bf6"}]}] Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-VolumesSnapshotTestJSON-353491327 Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 2dc5853f2c1c434f832d5ffc2f550bf6 Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-353491327 Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-VolumesSnapshotTestJSON-353491327-project Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 988cbd2509314aeaa9ad618e705894d3 Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-VolumesSnapshotTestJSON-353491327-project Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 94eebedc-5d3f-404b-bdf6-d039b5baf150 could not be found. Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '94eebedc-5d3f-404b-bdf6-d039b5baf150'} Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94eebedc-5d3f-404b-bdf6-d039b5baf150 could not be found. Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94eebedc-5d3f-404b-bdf6-d039b5baf150 could not be found. Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:41:56.666578 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:56.673844 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:41:56.673844 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:41:56.673844 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:41:56.673844 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:41:56.673844 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:41:56.673844 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94eebedc-5d3f-404b-bdf6-d039b5baf150 could not be found. Aug 24 10:41:56.673844 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:41:56.673844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6e261352-789d-465e-b26b-6b33fa1c0afb tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] Returning 404 to user: Instance 94eebedc-5d3f-404b-bdf6-d039b5baf150 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:41:56.673844 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6e261352-789d-465e-b26b-6b33fa1c0afb tempest-VolumesSnapshotTestJSON-353491327 tempest-VolumesSnapshotTestJSON-353491327-project] 10.222.0.85 "GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150" status: 404 len: 111 microversion: 2.1 time: 0.065939 Aug 24 10:41:56.673844 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2860/5365] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:41:56 2022] GET /compute/v2.1/servers/94eebedc-5d3f-404b-bdf6-d039b5baf150 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:41:56.824621 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-448ec936-c0bd-4b07-88fd-b07684518a41 tempest-VolumesTestJSON-588096633 tempest-VolumesTestJSON-588096633-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.186874 Aug 24 10:41:56.825233 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2506/5366] 10.222.0.85 () {58 vars in 1170 bytes} [Wed Aug 24 10:41:56 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:41:56.841285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-94c4932b-916b-4b21-ba1e-206d01694b79 tempest-VolumesTestJSON-588096633 tempest-VolumesTestJSON-588096633-project] Calling method '.version_select at 0x7f4647924280>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:57.073241 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-94c4932b-916b-4b21-ba1e-206d01694b79 tempest-VolumesTestJSON-588096633 tempest-VolumesTestJSON-588096633-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.238416 Aug 24 10:41:57.075506 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2861/5367] 10.222.0.85 () {58 vars in 1155 bytes} [Wed Aug 24 10:41:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:57.088617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ec74d376-5c45-4379-b2a7-4542094cb51f tempest-VolumesTestJSON-588096633 tempest-VolumesTestJSON-588096633-project] Calling method '.version_select at 0x7f46545a25e0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:57.482135 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ec74d376-5c45-4379-b2a7-4542094cb51f tempest-VolumesTestJSON-588096633 tempest-VolumesTestJSON-588096633-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.398092 Aug 24 10:41:57.482876 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2507/5368] 10.222.0.85 () {58 vars in 1188 bytes} [Wed Aug 24 10:41:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:41:57.513797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4eb5f20a-3a5e-4f99-a752-151c69e1dd1a tempest-VolumesTestJSON-588096633 tempest-VolumesTestJSON-588096633-project] Calling method '.version_select at 0x7f46479755e0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:41:57.690393 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4eb5f20a-3a5e-4f99-a752-151c69e1dd1a tempest-VolumesTestJSON-588096633 tempest-VolumesTestJSON-588096633-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.194018 Aug 24 10:41:57.699616 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2862/5369] 10.222.0.85 () {58 vars in 1155 bytes} [Wed Aug 24 10:41:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:41:59.327272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1ac884fe-d024-4994-941f-4c67d12d7bf6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-30942298", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "48f3ed12-001f-4385-b56f-399300362d3a"}], "security_groups": [{"name": "tempest-securitygroup--1993910143"}], "key_name": "tempest-keypair-1838153285", "user_data": "}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:42:00.656002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-1ac884fe-d024-4994-941f-4c67d12d7bf6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] validate_networks() for [('48f3ed12-001f-4385-b56f-399300362d3a', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:42:02.978545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-1ac884fe-d024-4994-941f-4c67d12d7bf6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:42:02.978545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-1ac884fe-d024-4994-941f-4c67d12d7bf6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:42:02.980382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-1ac884fe-d024-4994-941f-4c67d12d7bf6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:42:02.981379 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-1ac884fe-d024-4994-941f-4c67d12d7bf6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:42:02.982041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-1ac884fe-d024-4994-941f-4c67d12d7bf6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:42:03.009489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ac884fe-d024-4994-941f-4c67d12d7bf6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:03.010196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ac884fe-d024-4994-941f-4c67d12d7bf6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:03.010745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ac884fe-d024-4994-941f-4c67d12d7bf6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:03.014047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ac884fe-d024-4994-941f-4c67d12d7bf6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:03.014673 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ac884fe-d024-4994-941f-4c67d12d7bf6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:03.015250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ac884fe-d024-4994-941f-4c67d12d7bf6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:03.046106 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:03.083420 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-1ac884fe-d024-4994-941f-4c67d12d7bf6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Getting quotas for project 2c9ad6902a1f4f2c807315e5ee3dc897. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:42:03.100424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-1ac884fe-d024-4994-941f-4c67d12d7bf6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Getting quotas for user 3f1d12ba24f245b59b9af777352984d0 and project 2c9ad6902a1f4f2c807315e5ee3dc897. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:42:03.134283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1ac884fe-d024-4994-941f-4c67d12d7bf6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:42:03.145455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1ac884fe-d024-4994-941f-4c67d12d7bf6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:42:03.265098 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1ac884fe-d024-4994-941f-4c67d12d7bf6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.943514 Aug 24 10:42:03.266444 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2508/5370] 10.222.0.85 () {62 vars in 1188 bytes} [Wed Aug 24 10:41:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 3946 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 10:42:03.274347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:03.305209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bea38606-ed8e-423c-ae74-4480e56b9027 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:03.306373 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bea38606-ed8e-423c-ae74-4480e56b9027 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:03.312325 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:03.622143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bea38606-ed8e-423c-ae74-4480e56b9027 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:03.638793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bea38606-ed8e-423c-ae74-4480e56b9027 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:03.643556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bea38606-ed8e-423c-ae74-4480e56b9027 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:03.646461 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bea38606-ed8e-423c-ae74-4480e56b9027 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1280 microversion: 2.20 time: 0.373096 Aug 24 10:42:03.648771 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2863/5371] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:42:03 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1280 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:42:04.676763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b29e746a-e157-47ee-a020-3b48ff318e09 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:04.683351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b29e746a-e157-47ee-a020-3b48ff318e09 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:04.719483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b29e746a-e157-47ee-a020-3b48ff318e09 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:04.720243 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b29e746a-e157-47ee-a020-3b48ff318e09 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:04.721968 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b29e746a-e157-47ee-a020-3b48ff318e09 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:04.725749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b29e746a-e157-47ee-a020-3b48ff318e09 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:04.726427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b29e746a-e157-47ee-a020-3b48ff318e09 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:04.727413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b29e746a-e157-47ee-a020-3b48ff318e09 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:05.338720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b29e746a-e157-47ee-a020-3b48ff318e09 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:05.354989 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b29e746a-e157-47ee-a020-3b48ff318e09 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:05.359276 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b29e746a-e157-47ee-a020-3b48ff318e09 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:05.371624 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b29e746a-e157-47ee-a020-3b48ff318e09 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1276 microversion: 2.20 time: 0.700182 Aug 24 10:42:05.387125 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2509/5372] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:42:04 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1276 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:42:06.402907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-60cdd63a-04e0-40ce-a86e-5303373fa356 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:06.404204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-60cdd63a-04e0-40ce-a86e-5303373fa356 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:06.414871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60cdd63a-04e0-40ce-a86e-5303373fa356 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:06.416287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60cdd63a-04e0-40ce-a86e-5303373fa356 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:06.418146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60cdd63a-04e0-40ce-a86e-5303373fa356 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:06.419105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60cdd63a-04e0-40ce-a86e-5303373fa356 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:06.419729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60cdd63a-04e0-40ce-a86e-5303373fa356 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:06.420330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60cdd63a-04e0-40ce-a86e-5303373fa356 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:06.646525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-60cdd63a-04e0-40ce-a86e-5303373fa356 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:06.658492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-60cdd63a-04e0-40ce-a86e-5303373fa356 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:06.663625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-60cdd63a-04e0-40ce-a86e-5303373fa356 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:06.669329 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-60cdd63a-04e0-40ce-a86e-5303373fa356 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1338 microversion: 2.20 time: 0.273460 Aug 24 10:42:06.671022 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2864/5373] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:42:06 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1338 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:42:07.693661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-03002b57-3ad0-430a-ad61-e83da5039a75 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:07.694941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-03002b57-3ad0-430a-ad61-e83da5039a75 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:07.703983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:07.710880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03002b57-3ad0-430a-ad61-e83da5039a75 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:07.711671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03002b57-3ad0-430a-ad61-e83da5039a75 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:07.712337 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03002b57-3ad0-430a-ad61-e83da5039a75 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:07.715757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03002b57-3ad0-430a-ad61-e83da5039a75 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:07.716450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03002b57-3ad0-430a-ad61-e83da5039a75 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:07.719771 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03002b57-3ad0-430a-ad61-e83da5039a75 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:07.930346 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-03002b57-3ad0-430a-ad61-e83da5039a75 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:07.943625 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-03002b57-3ad0-430a-ad61-e83da5039a75 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:07.945165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-03002b57-3ad0-430a-ad61-e83da5039a75 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:07.946677 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-03002b57-3ad0-430a-ad61-e83da5039a75 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1338 microversion: 2.20 time: 0.256665 Aug 24 10:42:07.947268 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2510/5374] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:42:07 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1338 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:42:08.300060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1bbaea0d-79e8-4783-b9fe-67e96c4fd284 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1141984143", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a83d8002-e283-4390-9f7e-f2670f338d6f"}], "security_groups": [{"name": "tempest-securitygroup--1992364724"}], "key_name": "tempest-keypair-1851647544", "user_data": "}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:42:08.784466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-1bbaea0d-79e8-4783-b9fe-67e96c4fd284 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] validate_networks() for [('a83d8002-e283-4390-9f7e-f2670f338d6f', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:42:08.970180 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d0421f96-47c1-4514-b65e-614e50bc6c86 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:08.971727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d0421f96-47c1-4514-b65e-614e50bc6c86 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:09.002712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0421f96-47c1-4514-b65e-614e50bc6c86 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:09.003447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0421f96-47c1-4514-b65e-614e50bc6c86 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:09.004096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0421f96-47c1-4514-b65e-614e50bc6c86 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:09.004988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0421f96-47c1-4514-b65e-614e50bc6c86 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:09.005605 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0421f96-47c1-4514-b65e-614e50bc6c86 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:09.010149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0421f96-47c1-4514-b65e-614e50bc6c86 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:09.465556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d0421f96-47c1-4514-b65e-614e50bc6c86 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:09.507765 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d0421f96-47c1-4514-b65e-614e50bc6c86 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:09.518315 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d0421f96-47c1-4514-b65e-614e50bc6c86 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:09.519604 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d0421f96-47c1-4514-b65e-614e50bc6c86 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1338 microversion: 2.20 time: 0.554298 Aug 24 10:42:09.525646 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2511/5375] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:42:08 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1338 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:42:10.107634 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-1bbaea0d-79e8-4783-b9fe-67e96c4fd284 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:42:10.108678 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-1bbaea0d-79e8-4783-b9fe-67e96c4fd284 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:42:10.109394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-1bbaea0d-79e8-4783-b9fe-67e96c4fd284 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:42:10.110791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-1bbaea0d-79e8-4783-b9fe-67e96c4fd284 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:42:10.111586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-1bbaea0d-79e8-4783-b9fe-67e96c4fd284 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:42:10.132085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bbaea0d-79e8-4783-b9fe-67e96c4fd284 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:10.133469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bbaea0d-79e8-4783-b9fe-67e96c4fd284 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:10.135707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bbaea0d-79e8-4783-b9fe-67e96c4fd284 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:10.136747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bbaea0d-79e8-4783-b9fe-67e96c4fd284 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:10.137703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bbaea0d-79e8-4783-b9fe-67e96c4fd284 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:10.139112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bbaea0d-79e8-4783-b9fe-67e96c4fd284 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:10.219244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-1bbaea0d-79e8-4783-b9fe-67e96c4fd284 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Getting quotas for project 3cfd67239d3f4b7a89be1453a08c92ba. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:42:10.228084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-1bbaea0d-79e8-4783-b9fe-67e96c4fd284 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Getting quotas for user ff5172c17fae44e5839bd9b789e4c3a8 and project 3cfd67239d3f4b7a89be1453a08c92ba. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:42:10.256318 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1bbaea0d-79e8-4783-b9fe-67e96c4fd284 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:42:10.262106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1bbaea0d-79e8-4783-b9fe-67e96c4fd284 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:42:10.347586 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1bbaea0d-79e8-4783-b9fe-67e96c4fd284 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.051965 Aug 24 10:42:10.351554 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2865/5376] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:42:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 2057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:42:10.362115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d3117e83-8ba5-4ad4-916e-40fd4b2e40c3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:10.363437 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d3117e83-8ba5-4ad4-916e-40fd4b2e40c3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:10.548298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-87fde94c-b075-456a-87b4-f1443e627d13 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:10.549202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-87fde94c-b075-456a-87b4-f1443e627d13 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:10.570199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87fde94c-b075-456a-87b4-f1443e627d13 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:10.570666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87fde94c-b075-456a-87b4-f1443e627d13 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:10.571435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87fde94c-b075-456a-87b4-f1443e627d13 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:10.572199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87fde94c-b075-456a-87b4-f1443e627d13 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:10.572656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87fde94c-b075-456a-87b4-f1443e627d13 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:10.573082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87fde94c-b075-456a-87b4-f1443e627d13 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:10.714098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d3117e83-8ba5-4ad4-916e-40fd4b2e40c3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:10.761068 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d3117e83-8ba5-4ad4-916e-40fd4b2e40c3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9" status: 200 len: 1242 microversion: 2.1 time: 0.398568 Aug 24 10:42:10.762762 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2512/5377] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:42:10 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9 => generated 1242 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:42:10.940712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-87fde94c-b075-456a-87b4-f1443e627d13 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:10.976330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-87fde94c-b075-456a-87b4-f1443e627d13 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:10.978465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-87fde94c-b075-456a-87b4-f1443e627d13 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:10.987172 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-87fde94c-b075-456a-87b4-f1443e627d13 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1406 microversion: 2.20 time: 0.443106 Aug 24 10:42:11.002406 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2866/5378] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:42:10 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1406 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:42:11.785245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4c48e251-66c6-45d6-8f1d-93253aa32eda tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:11.785863 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4c48e251-66c6-45d6-8f1d-93253aa32eda tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:11.815206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c48e251-66c6-45d6-8f1d-93253aa32eda tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:11.815714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c48e251-66c6-45d6-8f1d-93253aa32eda tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:11.816155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c48e251-66c6-45d6-8f1d-93253aa32eda tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:11.816882 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c48e251-66c6-45d6-8f1d-93253aa32eda tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:11.831703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c48e251-66c6-45d6-8f1d-93253aa32eda tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:11.832286 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c48e251-66c6-45d6-8f1d-93253aa32eda tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:12.021790 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-79e8875a-d643-46a5-9c99-07bab7d06d9a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:12.023425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-79e8875a-d643-46a5-9c99-07bab7d06d9a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:12.042913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79e8875a-d643-46a5-9c99-07bab7d06d9a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:12.044276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79e8875a-d643-46a5-9c99-07bab7d06d9a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:12.044926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79e8875a-d643-46a5-9c99-07bab7d06d9a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:12.046596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79e8875a-d643-46a5-9c99-07bab7d06d9a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:12.054445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79e8875a-d643-46a5-9c99-07bab7d06d9a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:12.054645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79e8875a-d643-46a5-9c99-07bab7d06d9a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:12.285399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4c48e251-66c6-45d6-8f1d-93253aa32eda tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:12.296908 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4c48e251-66c6-45d6-8f1d-93253aa32eda tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9" status: 200 len: 1238 microversion: 2.1 time: 0.516286 Aug 24 10:42:12.303049 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2513/5379] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:42:11 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9 => generated 1238 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:42:13.060076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-79e8875a-d643-46a5-9c99-07bab7d06d9a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:13.085066 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-79e8875a-d643-46a5-9c99-07bab7d06d9a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:13.093086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-79e8875a-d643-46a5-9c99-07bab7d06d9a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:13.095019 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-79e8875a-d643-46a5-9c99-07bab7d06d9a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1406 microversion: 2.20 time: 1.081059 Aug 24 10:42:13.100882 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2867/5380] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:42:12 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1406 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:42:13.318513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-087897c4-7572-449f-96d8-7fbc339998be tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:13.319725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-087897c4-7572-449f-96d8-7fbc339998be tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:13.333288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:13.338198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-087897c4-7572-449f-96d8-7fbc339998be tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:13.340487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-087897c4-7572-449f-96d8-7fbc339998be tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:13.342003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-087897c4-7572-449f-96d8-7fbc339998be tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:13.345166 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-087897c4-7572-449f-96d8-7fbc339998be tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:13.346024 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-087897c4-7572-449f-96d8-7fbc339998be tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:13.347339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-087897c4-7572-449f-96d8-7fbc339998be tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:13.630104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-087897c4-7572-449f-96d8-7fbc339998be tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:13.641925 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-087897c4-7572-449f-96d8-7fbc339998be tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9" status: 200 len: 1300 microversion: 2.1 time: 0.327467 Aug 24 10:42:13.660653 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2514/5381] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:42:13 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9 => generated 1300 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:42:14.122569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2934aee4-e526-449d-a869-ba22b953bf39 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:14.123802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2934aee4-e526-449d-a869-ba22b953bf39 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:14.141008 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2934aee4-e526-449d-a869-ba22b953bf39 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:14.142820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2934aee4-e526-449d-a869-ba22b953bf39 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:14.143445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2934aee4-e526-449d-a869-ba22b953bf39 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:14.144320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2934aee4-e526-449d-a869-ba22b953bf39 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:14.145710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2934aee4-e526-449d-a869-ba22b953bf39 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:14.146315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2934aee4-e526-449d-a869-ba22b953bf39 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:14.420087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-6aee38ac-c2bb-47af-9026-90a157b66a7a req-f65eec7b-993c-4dc6-b12a-ef04f09afec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc496b71-8fb7-4344-8642-53483cea796b", "tag": "30ffbeff-bf67-4d4a-8328-d554619bcd68"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:42:14.438677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6aee38ac-c2bb-47af-9026-90a157b66a7a req-f65eec7b-993c-4dc6-b12a-ef04f09afec1 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:14.439776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6aee38ac-c2bb-47af-9026-90a157b66a7a req-f65eec7b-993c-4dc6-b12a-ef04f09afec1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:14.440396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6aee38ac-c2bb-47af-9026-90a157b66a7a req-f65eec7b-993c-4dc6-b12a-ef04f09afec1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:14.458086 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-6aee38ac-c2bb-47af-9026-90a157b66a7a req-f65eec7b-993c-4dc6-b12a-ef04f09afec1 service nova] Creating event network-changed:30ffbeff-bf67-4d4a-8328-d554619bcd68 for instance cc496b71-8fb7-4344-8642-53483cea796b on n-h1-849328-3 Aug 24 10:42:14.469687 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-6aee38ac-c2bb-47af-9026-90a157b66a7a req-f65eec7b-993c-4dc6-b12a-ef04f09afec1 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051661 Aug 24 10:42:14.472520 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2515/5382] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:42:14.669671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a657e5e0-dfae-440e-83db-9470a77e13e7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:14.670711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a657e5e0-dfae-440e-83db-9470a77e13e7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:14.684917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a657e5e0-dfae-440e-83db-9470a77e13e7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:14.686598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a657e5e0-dfae-440e-83db-9470a77e13e7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:14.687223 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a657e5e0-dfae-440e-83db-9470a77e13e7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:14.689350 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a657e5e0-dfae-440e-83db-9470a77e13e7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:14.693811 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a657e5e0-dfae-440e-83db-9470a77e13e7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:14.694507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a657e5e0-dfae-440e-83db-9470a77e13e7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:14.825962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a657e5e0-dfae-440e-83db-9470a77e13e7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:14.835626 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a657e5e0-dfae-440e-83db-9470a77e13e7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9" status: 200 len: 1300 microversion: 2.1 time: 0.170979 Aug 24 10:42:14.841811 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2516/5383] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:42:14 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9 => generated 1300 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:42:15.371276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2934aee4-e526-449d-a869-ba22b953bf39 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:15.394992 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2934aee4-e526-449d-a869-ba22b953bf39 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:15.423218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2934aee4-e526-449d-a869-ba22b953bf39 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:15.430407 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2934aee4-e526-449d-a869-ba22b953bf39 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1406 microversion: 2.20 time: 1.312781 Aug 24 10:42:15.431464 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2868/5384] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:42:14 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1406 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:42:15.865921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3dc97ae8-58c5-4e2b-90e9-a2e2db6d7890 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:15.866532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3dc97ae8-58c5-4e2b-90e9-a2e2db6d7890 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:15.880547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dc97ae8-58c5-4e2b-90e9-a2e2db6d7890 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:15.887938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dc97ae8-58c5-4e2b-90e9-a2e2db6d7890 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:15.888626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dc97ae8-58c5-4e2b-90e9-a2e2db6d7890 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:15.892599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dc97ae8-58c5-4e2b-90e9-a2e2db6d7890 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:15.893630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dc97ae8-58c5-4e2b-90e9-a2e2db6d7890 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:15.894219 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dc97ae8-58c5-4e2b-90e9-a2e2db6d7890 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:16.472739 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8c48a94d-90f1-4f2b-bfb6-ff8c6a9b8925 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:16.474127 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8c48a94d-90f1-4f2b-bfb6-ff8c6a9b8925 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:16.484305 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c48a94d-90f1-4f2b-bfb6-ff8c6a9b8925 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:16.491073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c48a94d-90f1-4f2b-bfb6-ff8c6a9b8925 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:16.491692 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c48a94d-90f1-4f2b-bfb6-ff8c6a9b8925 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:16.492511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c48a94d-90f1-4f2b-bfb6-ff8c6a9b8925 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:16.497644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c48a94d-90f1-4f2b-bfb6-ff8c6a9b8925 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:16.498172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c48a94d-90f1-4f2b-bfb6-ff8c6a9b8925 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:16.649084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3dc97ae8-58c5-4e2b-90e9-a2e2db6d7890 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:16.657782 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3dc97ae8-58c5-4e2b-90e9-a2e2db6d7890 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9" status: 200 len: 1300 microversion: 2.1 time: 0.795657 Aug 24 10:42:16.676215 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2517/5385] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:42:15 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9 => generated 1300 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:42:17.343688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8c48a94d-90f1-4f2b-bfb6-ff8c6a9b8925 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:17.382200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8c48a94d-90f1-4f2b-bfb6-ff8c6a9b8925 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:17.412605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8c48a94d-90f1-4f2b-bfb6-ff8c6a9b8925 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:17.419894 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8c48a94d-90f1-4f2b-bfb6-ff8c6a9b8925 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1406 microversion: 2.20 time: 0.950877 Aug 24 10:42:17.427886 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2869/5386] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:42:16 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1406 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:42:17.683879 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1e131924-9b86-4a8e-8c0a-4b9aeb64ab7d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:17.685105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1e131924-9b86-4a8e-8c0a-4b9aeb64ab7d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:17.703148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e131924-9b86-4a8e-8c0a-4b9aeb64ab7d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:17.704081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e131924-9b86-4a8e-8c0a-4b9aeb64ab7d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:17.704751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e131924-9b86-4a8e-8c0a-4b9aeb64ab7d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:17.705738 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e131924-9b86-4a8e-8c0a-4b9aeb64ab7d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:17.706194 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e131924-9b86-4a8e-8c0a-4b9aeb64ab7d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:17.706809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e131924-9b86-4a8e-8c0a-4b9aeb64ab7d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:18.040973 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1e131924-9b86-4a8e-8c0a-4b9aeb64ab7d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:18.052383 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1e131924-9b86-4a8e-8c0a-4b9aeb64ab7d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9" status: 200 len: 1368 microversion: 2.1 time: 0.372427 Aug 24 10:42:18.065463 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2518/5387] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:42:17 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9 => generated 1368 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:42:18.455336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4687428c-2c4e-4a38-8fea-a85f3983c94b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:18.457069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4687428c-2c4e-4a38-8fea-a85f3983c94b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:18.477040 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4687428c-2c4e-4a38-8fea-a85f3983c94b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:18.482678 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4687428c-2c4e-4a38-8fea-a85f3983c94b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:18.484642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4687428c-2c4e-4a38-8fea-a85f3983c94b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:18.500160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4687428c-2c4e-4a38-8fea-a85f3983c94b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:18.502161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4687428c-2c4e-4a38-8fea-a85f3983c94b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:18.516297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4687428c-2c4e-4a38-8fea-a85f3983c94b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:19.089306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a7564085-7222-4ff6-89d4-a58e94a8a386 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:19.097622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a7564085-7222-4ff6-89d4-a58e94a8a386 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:19.123196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7564085-7222-4ff6-89d4-a58e94a8a386 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:19.124787 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7564085-7222-4ff6-89d4-a58e94a8a386 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:19.125440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7564085-7222-4ff6-89d4-a58e94a8a386 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:19.127206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7564085-7222-4ff6-89d4-a58e94a8a386 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:19.129462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7564085-7222-4ff6-89d4-a58e94a8a386 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:19.130115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7564085-7222-4ff6-89d4-a58e94a8a386 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:19.587910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4687428c-2c4e-4a38-8fea-a85f3983c94b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:19.598421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4687428c-2c4e-4a38-8fea-a85f3983c94b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:19.602558 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4687428c-2c4e-4a38-8fea-a85f3983c94b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:19.603290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a7564085-7222-4ff6-89d4-a58e94a8a386 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:19.613931 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4687428c-2c4e-4a38-8fea-a85f3983c94b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1406 microversion: 2.20 time: 1.164597 Aug 24 10:42:19.614839 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2870/5388] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:42:18 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1406 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:42:19.631545 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a7564085-7222-4ff6-89d4-a58e94a8a386 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9" status: 200 len: 1368 microversion: 2.1 time: 0.540385 Aug 24 10:42:19.636455 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2519/5389] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:42:19 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9 => generated 1368 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:42:20.643301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-56de9f15-b1b4-40ae-93b5-5f5ee4b609f4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:20.644537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-56de9f15-b1b4-40ae-93b5-5f5ee4b609f4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:20.663509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e3706ff5-9fe2-440b-95ed-f4633d514c1d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:20.664733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e3706ff5-9fe2-440b-95ed-f4633d514c1d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:20.674144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:20.683097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:20.689880 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56de9f15-b1b4-40ae-93b5-5f5ee4b609f4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:20.692771 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3706ff5-9fe2-440b-95ed-f4633d514c1d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:20.694295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3706ff5-9fe2-440b-95ed-f4633d514c1d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:20.698450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56de9f15-b1b4-40ae-93b5-5f5ee4b609f4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:20.699027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56de9f15-b1b4-40ae-93b5-5f5ee4b609f4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:20.699953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56de9f15-b1b4-40ae-93b5-5f5ee4b609f4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:20.700419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56de9f15-b1b4-40ae-93b5-5f5ee4b609f4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:20.704559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3706ff5-9fe2-440b-95ed-f4633d514c1d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:20.704953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3706ff5-9fe2-440b-95ed-f4633d514c1d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:20.710230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3706ff5-9fe2-440b-95ed-f4633d514c1d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:20.710727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3706ff5-9fe2-440b-95ed-f4633d514c1d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:20.718258 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56de9f15-b1b4-40ae-93b5-5f5ee4b609f4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:20.814419 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=12 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:20.856683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:21.387120 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e3706ff5-9fe2-440b-95ed-f4633d514c1d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:21.398470 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e3706ff5-9fe2-440b-95ed-f4633d514c1d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9" status: 200 len: 1368 microversion: 2.1 time: 0.739641 Aug 24 10:42:21.402029 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2520/5390] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:42:20 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9 => generated 1368 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:42:21.962936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-15c5a14c-207b-4f41-af05-2f90bfbe6fa7 req-fe3a51ee-e6bb-4489-ab60-9d468c1f7009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc496b71-8fb7-4344-8642-53483cea796b", "name": "network-vif-plugged", "status": "completed", "tag": "30ffbeff-bf67-4d4a-8328-d554619bcd68"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:42:21.998699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-15c5a14c-207b-4f41-af05-2f90bfbe6fa7 req-fe3a51ee-e6bb-4489-ab60-9d468c1f7009 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:21.999197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-15c5a14c-207b-4f41-af05-2f90bfbe6fa7 req-fe3a51ee-e6bb-4489-ab60-9d468c1f7009 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:21.999654 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-15c5a14c-207b-4f41-af05-2f90bfbe6fa7 req-fe3a51ee-e6bb-4489-ab60-9d468c1f7009 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:22.051707 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-15c5a14c-207b-4f41-af05-2f90bfbe6fa7 req-fe3a51ee-e6bb-4489-ab60-9d468c1f7009 service nova] Creating event network-vif-plugged:30ffbeff-bf67-4d4a-8328-d554619bcd68 for instance cc496b71-8fb7-4344-8642-53483cea796b on n-h1-849328-3 Aug 24 10:42:22.063681 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-15c5a14c-207b-4f41-af05-2f90bfbe6fa7 req-fe3a51ee-e6bb-4489-ab60-9d468c1f7009 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.658058 Aug 24 10:42:22.064348 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2521/5391] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:42:22.134139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-56de9f15-b1b4-40ae-93b5-5f5ee4b609f4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:22.146467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-56de9f15-b1b4-40ae-93b5-5f5ee4b609f4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:22.153673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-56de9f15-b1b4-40ae-93b5-5f5ee4b609f4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:22.158561 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-56de9f15-b1b4-40ae-93b5-5f5ee4b609f4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1406 microversion: 2.20 time: 1.519497 Aug 24 10:42:22.162898 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2871/5392] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:42:20 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1406 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:42:22.426693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-98745f75-7692-4bb1-8da8-7ea4fd6f38be tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:22.427421 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-98745f75-7692-4bb1-8da8-7ea4fd6f38be tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:22.447030 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98745f75-7692-4bb1-8da8-7ea4fd6f38be tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:22.447537 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98745f75-7692-4bb1-8da8-7ea4fd6f38be tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:22.447975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98745f75-7692-4bb1-8da8-7ea4fd6f38be tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:22.448706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98745f75-7692-4bb1-8da8-7ea4fd6f38be tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:22.449174 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98745f75-7692-4bb1-8da8-7ea4fd6f38be tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:22.449598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98745f75-7692-4bb1-8da8-7ea4fd6f38be tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:23.037206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0f0c8a53-e67f-4505-955a-9f43c0297780 req-d7827a77-5d4f-415e-8bfc-e3609c6f7d72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8cf649c-8f17-41ad-9ee6-f29dab1632d9", "tag": "468840d9-6087-422e-b470-dfedc8e5e328"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:42:23.060794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0f0c8a53-e67f-4505-955a-9f43c0297780 req-d7827a77-5d4f-415e-8bfc-e3609c6f7d72 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:23.062911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0f0c8a53-e67f-4505-955a-9f43c0297780 req-d7827a77-5d4f-415e-8bfc-e3609c6f7d72 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:23.063537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0f0c8a53-e67f-4505-955a-9f43c0297780 req-d7827a77-5d4f-415e-8bfc-e3609c6f7d72 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:23.087318 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0f0c8a53-e67f-4505-955a-9f43c0297780 req-d7827a77-5d4f-415e-8bfc-e3609c6f7d72 service nova] Creating event network-changed:468840d9-6087-422e-b470-dfedc8e5e328 for instance b8cf649c-8f17-41ad-9ee6-f29dab1632d9 on n-h2-849328-3 Aug 24 10:42:23.097290 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0f0c8a53-e67f-4505-955a-9f43c0297780 req-d7827a77-5d4f-415e-8bfc-e3609c6f7d72 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060874 Aug 24 10:42:23.098533 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2872/5393] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:42:23.106657 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-98745f75-7692-4bb1-8da8-7ea4fd6f38be tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:23.117306 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-98745f75-7692-4bb1-8da8-7ea4fd6f38be tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9" status: 200 len: 1368 microversion: 2.1 time: 0.698707 Aug 24 10:42:23.122094 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2522/5394] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:42:22 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9 => generated 1368 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:42:23.222893 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2d2f1ccf-cf66-498a-a043-30aff9b935cf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:23.223589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2d2f1ccf-cf66-498a-a043-30aff9b935cf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:23.238974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d2f1ccf-cf66-498a-a043-30aff9b935cf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:23.239470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d2f1ccf-cf66-498a-a043-30aff9b935cf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:23.239900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d2f1ccf-cf66-498a-a043-30aff9b935cf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:23.240597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d2f1ccf-cf66-498a-a043-30aff9b935cf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:23.241045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d2f1ccf-cf66-498a-a043-30aff9b935cf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:23.241537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d2f1ccf-cf66-498a-a043-30aff9b935cf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:23.944751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2d2f1ccf-cf66-498a-a043-30aff9b935cf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:23.962539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2d2f1ccf-cf66-498a-a043-30aff9b935cf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:23.978291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2d2f1ccf-cf66-498a-a043-30aff9b935cf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:23.984155 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2d2f1ccf-cf66-498a-a043-30aff9b935cf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1406 microversion: 2.20 time: 0.764429 Aug 24 10:42:23.987233 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2873/5395] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:42:23 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1406 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:42:24.143935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3cd5635f-cee8-4152-9a71-3aa687b4f66a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:24.145284 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3cd5635f-cee8-4152-9a71-3aa687b4f66a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:24.157627 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cd5635f-cee8-4152-9a71-3aa687b4f66a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:24.158447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cd5635f-cee8-4152-9a71-3aa687b4f66a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:24.159088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cd5635f-cee8-4152-9a71-3aa687b4f66a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:24.162160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cd5635f-cee8-4152-9a71-3aa687b4f66a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:24.162887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cd5635f-cee8-4152-9a71-3aa687b4f66a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:24.163541 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cd5635f-cee8-4152-9a71-3aa687b4f66a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:24.774300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3cd5635f-cee8-4152-9a71-3aa687b4f66a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:24.784078 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3cd5635f-cee8-4152-9a71-3aa687b4f66a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9" status: 200 len: 1368 microversion: 2.1 time: 0.644948 Aug 24 10:42:24.784612 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2523/5396] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:42:24 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9 => generated 1368 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:42:25.027271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-25276ead-1d36-4e56-ad77-4de05978fd3f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:25.027961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-25276ead-1d36-4e56-ad77-4de05978fd3f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:25.041817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25276ead-1d36-4e56-ad77-4de05978fd3f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:25.042260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25276ead-1d36-4e56-ad77-4de05978fd3f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:25.044957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25276ead-1d36-4e56-ad77-4de05978fd3f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:25.045911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25276ead-1d36-4e56-ad77-4de05978fd3f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:25.047438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25276ead-1d36-4e56-ad77-4de05978fd3f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:25.047863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25276ead-1d36-4e56-ad77-4de05978fd3f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:25.810362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3a682905-9d18-4a5d-a413-11e70a7500a0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:25.811084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3a682905-9d18-4a5d-a413-11e70a7500a0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:25.822014 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a682905-9d18-4a5d-a413-11e70a7500a0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:25.825938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a682905-9d18-4a5d-a413-11e70a7500a0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:25.826652 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a682905-9d18-4a5d-a413-11e70a7500a0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:25.828209 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a682905-9d18-4a5d-a413-11e70a7500a0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:25.830099 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a682905-9d18-4a5d-a413-11e70a7500a0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:25.830783 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a682905-9d18-4a5d-a413-11e70a7500a0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:26.160992 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-25276ead-1d36-4e56-ad77-4de05978fd3f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:26.200957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-25276ead-1d36-4e56-ad77-4de05978fd3f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:26.204282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-25276ead-1d36-4e56-ad77-4de05978fd3f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:26.211132 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-25276ead-1d36-4e56-ad77-4de05978fd3f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1598 microversion: 2.20 time: 1.200655 Aug 24 10:42:26.214674 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2874/5397] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:42:25 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1598 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:42:26.221301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3a682905-9d18-4a5d-a413-11e70a7500a0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:26.231538 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3a682905-9d18-4a5d-a413-11e70a7500a0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9" status: 200 len: 1368 microversion: 2.1 time: 0.425339 Aug 24 10:42:26.235958 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2524/5398] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:42:25 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9 => generated 1368 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:42:26.249769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-94f8de26-3669-4971-93f5-0c37fd8b64ed tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:26.250583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-94f8de26-3669-4971-93f5-0c37fd8b64ed tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:26.262343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94f8de26-3669-4971-93f5-0c37fd8b64ed tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:26.263070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94f8de26-3669-4971-93f5-0c37fd8b64ed tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:26.265002 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94f8de26-3669-4971-93f5-0c37fd8b64ed tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:26.266426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94f8de26-3669-4971-93f5-0c37fd8b64ed tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:26.267096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94f8de26-3669-4971-93f5-0c37fd8b64ed tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:26.267792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94f8de26-3669-4971-93f5-0c37fd8b64ed tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:26.553906 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-94f8de26-3669-4971-93f5-0c37fd8b64ed tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.318387 Aug 24 10:42:26.555183 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2875/5399] 10.222.0.85 () {60 vars in 1316 bytes} [Wed Aug 24 10:42:26 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b/os-interface => generated 284 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 10:42:27.256894 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-15bd7a8e-e081-4208-9f55-013d508751b6 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:27.257780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-15bd7a8e-e081-4208-9f55-013d508751b6 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:27.267952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15bd7a8e-e081-4208-9f55-013d508751b6 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:27.268447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15bd7a8e-e081-4208-9f55-013d508751b6 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:27.272863 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15bd7a8e-e081-4208-9f55-013d508751b6 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:27.273956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15bd7a8e-e081-4208-9f55-013d508751b6 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:27.274633 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15bd7a8e-e081-4208-9f55-013d508751b6 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:27.279636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15bd7a8e-e081-4208-9f55-013d508751b6 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:27.672947 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-15bd7a8e-e081-4208-9f55-013d508751b6 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:27.690279 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-15bd7a8e-e081-4208-9f55-013d508751b6 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9" status: 200 len: 1368 microversion: 2.1 time: 0.437162 Aug 24 10:42:27.691409 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2525/5400] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:42:27 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9 => generated 1368 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:42:28.715266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-30e314f8-d07e-43e9-a4d3-482bc7be3746 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:28.715890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-30e314f8-d07e-43e9-a4d3-482bc7be3746 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:28.733319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30e314f8-d07e-43e9-a4d3-482bc7be3746 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:28.733887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30e314f8-d07e-43e9-a4d3-482bc7be3746 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:28.734387 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30e314f8-d07e-43e9-a4d3-482bc7be3746 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:28.735170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30e314f8-d07e-43e9-a4d3-482bc7be3746 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:28.739200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30e314f8-d07e-43e9-a4d3-482bc7be3746 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:28.739737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30e314f8-d07e-43e9-a4d3-482bc7be3746 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:29.395117 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-30e314f8-d07e-43e9-a4d3-482bc7be3746 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:29.421730 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-30e314f8-d07e-43e9-a4d3-482bc7be3746 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9" status: 200 len: 1368 microversion: 2.1 time: 0.711649 Aug 24 10:42:29.426100 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2876/5401] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:42:28 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9 => generated 1368 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:42:30.355694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-868efcac-ef7a-4a17-92b2-3d389a4e1b13 req-a112bbaf-ac2c-4792-a050-eba8d9e17a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8cf649c-8f17-41ad-9ee6-f29dab1632d9", "name": "network-vif-plugged", "status": "completed", "tag": "468840d9-6087-422e-b470-dfedc8e5e328"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:42:30.369527 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-868efcac-ef7a-4a17-92b2-3d389a4e1b13 req-a112bbaf-ac2c-4792-a050-eba8d9e17a0f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:30.376253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-868efcac-ef7a-4a17-92b2-3d389a4e1b13 req-a112bbaf-ac2c-4792-a050-eba8d9e17a0f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:30.376948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-868efcac-ef7a-4a17-92b2-3d389a4e1b13 req-a112bbaf-ac2c-4792-a050-eba8d9e17a0f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:30.390873 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-868efcac-ef7a-4a17-92b2-3d389a4e1b13 req-a112bbaf-ac2c-4792-a050-eba8d9e17a0f service nova] Creating event network-vif-plugged:468840d9-6087-422e-b470-dfedc8e5e328 for instance b8cf649c-8f17-41ad-9ee6-f29dab1632d9 on n-h2-849328-3 Aug 24 10:42:30.399827 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-868efcac-ef7a-4a17-92b2-3d389a4e1b13 req-a112bbaf-ac2c-4792-a050-eba8d9e17a0f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047864 Aug 24 10:42:30.412090 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2526/5402] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:42:30.447496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a5be7030-93d7-4735-93d4-9d93b573f97d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:30.448822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a5be7030-93d7-4735-93d4-9d93b573f97d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:30.461209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5be7030-93d7-4735-93d4-9d93b573f97d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:30.465084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5be7030-93d7-4735-93d4-9d93b573f97d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:30.466495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5be7030-93d7-4735-93d4-9d93b573f97d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:30.468593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5be7030-93d7-4735-93d4-9d93b573f97d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:30.469458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5be7030-93d7-4735-93d4-9d93b573f97d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:30.470801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5be7030-93d7-4735-93d4-9d93b573f97d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:31.214669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a5be7030-93d7-4735-93d4-9d93b573f97d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:31.228814 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-60d9399d-9662-496c-a465-1c7602de8f6c req-4cfc3d38-1713-473b-9bfa-5126f893b5fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc496b71-8fb7-4344-8642-53483cea796b", "tag": "30ffbeff-bf67-4d4a-8328-d554619bcd68"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:42:31.242393 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a5be7030-93d7-4735-93d4-9d93b573f97d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9" status: 200 len: 1368 microversion: 2.1 time: 0.799324 Aug 24 10:42:31.244491 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2877/5403] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:42:30 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9 => generated 1368 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:42:31.287841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-60d9399d-9662-496c-a465-1c7602de8f6c req-4cfc3d38-1713-473b-9bfa-5126f893b5fc service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:31.288230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-60d9399d-9662-496c-a465-1c7602de8f6c req-4cfc3d38-1713-473b-9bfa-5126f893b5fc service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:31.289215 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-60d9399d-9662-496c-a465-1c7602de8f6c req-4cfc3d38-1713-473b-9bfa-5126f893b5fc service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:31.321927 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-60d9399d-9662-496c-a465-1c7602de8f6c req-4cfc3d38-1713-473b-9bfa-5126f893b5fc service nova] Creating event network-changed:30ffbeff-bf67-4d4a-8328-d554619bcd68 for instance cc496b71-8fb7-4344-8642-53483cea796b on n-h1-849328-3 Aug 24 10:42:31.336527 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-60d9399d-9662-496c-a465-1c7602de8f6c req-4cfc3d38-1713-473b-9bfa-5126f893b5fc service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112628 Aug 24 10:42:31.337499 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2527/5404] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:42:32.280646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aa683f43-627a-48e0-8ffa-73965404d6e8 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:32.281960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aa683f43-627a-48e0-8ffa-73965404d6e8 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:32.308804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa683f43-627a-48e0-8ffa-73965404d6e8 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:32.314869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa683f43-627a-48e0-8ffa-73965404d6e8 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:32.321313 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa683f43-627a-48e0-8ffa-73965404d6e8 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:32.323538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa683f43-627a-48e0-8ffa-73965404d6e8 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:32.333383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa683f43-627a-48e0-8ffa-73965404d6e8 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:32.334140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa683f43-627a-48e0-8ffa-73965404d6e8 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:32.871051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aa683f43-627a-48e0-8ffa-73965404d6e8 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:32.891423 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aa683f43-627a-48e0-8ffa-73965404d6e8 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9" status: 200 len: 1368 microversion: 2.1 time: 0.614857 Aug 24 10:42:32.892963 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2878/5405] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:42:32 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9 => generated 1368 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:42:33.916694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-781d9aaa-8f9e-409f-8b68-2d5b2d70889e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:33.920561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-781d9aaa-8f9e-409f-8b68-2d5b2d70889e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:33.940128 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-781d9aaa-8f9e-409f-8b68-2d5b2d70889e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:33.944976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-781d9aaa-8f9e-409f-8b68-2d5b2d70889e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:33.946367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-781d9aaa-8f9e-409f-8b68-2d5b2d70889e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:33.948712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-781d9aaa-8f9e-409f-8b68-2d5b2d70889e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:33.949747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-781d9aaa-8f9e-409f-8b68-2d5b2d70889e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:33.951021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-781d9aaa-8f9e-409f-8b68-2d5b2d70889e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:33.965929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=94 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:34.233466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-781d9aaa-8f9e-409f-8b68-2d5b2d70889e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:42:34.248705 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-781d9aaa-8f9e-409f-8b68-2d5b2d70889e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9" status: 200 len: 1558 microversion: 2.1 time: 0.337776 Aug 24 10:42:34.249365 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2528/5406] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:42:33 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9 => generated 1558 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:42:34.280375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ef08811-21ba-4624-9001-a06b0c28191f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:34.282189 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3ef08811-21ba-4624-9001-a06b0c28191f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:34.305920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:34.308183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ef08811-21ba-4624-9001-a06b0c28191f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:34.316948 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ef08811-21ba-4624-9001-a06b0c28191f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:34.317463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ef08811-21ba-4624-9001-a06b0c28191f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:34.318226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ef08811-21ba-4624-9001-a06b0c28191f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:34.318759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ef08811-21ba-4624-9001-a06b0c28191f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:34.319113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ef08811-21ba-4624-9001-a06b0c28191f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:34.699980 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ef08811-21ba-4624-9001-a06b0c28191f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.430384 Aug 24 10:42:34.701272 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2879/5407] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Aug 24 10:42:34 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9/os-interface => generated 285 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:42:37.216739 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-b117d3c3-9140-40d8-97a4-12f67eec5f00 req-62b77d56-5e8d-4d4a-9040-196cd6a256e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8cf649c-8f17-41ad-9ee6-f29dab1632d9", "tag": "468840d9-6087-422e-b470-dfedc8e5e328"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:42:37.251817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b117d3c3-9140-40d8-97a4-12f67eec5f00 req-62b77d56-5e8d-4d4a-9040-196cd6a256e4 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:37.251817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b117d3c3-9140-40d8-97a4-12f67eec5f00 req-62b77d56-5e8d-4d4a-9040-196cd6a256e4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:37.251817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b117d3c3-9140-40d8-97a4-12f67eec5f00 req-62b77d56-5e8d-4d4a-9040-196cd6a256e4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:37.303509 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b117d3c3-9140-40d8-97a4-12f67eec5f00 req-62b77d56-5e8d-4d4a-9040-196cd6a256e4 service nova] Creating event network-changed:468840d9-6087-422e-b470-dfedc8e5e328 for instance b8cf649c-8f17-41ad-9ee6-f29dab1632d9 on n-h2-849328-3 Aug 24 10:42:37.327038 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-b117d3c3-9140-40d8-97a4-12f67eec5f00 req-62b77d56-5e8d-4d4a-9040-196cd6a256e4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.532818 Aug 24 10:42:37.328050 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2529/5408] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:42:57.091823 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=45 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:57.092623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:57.919261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9f4d9175-9cba-421f-adf0-42a929e090fc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:42:57.920073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9f4d9175-9cba-421f-adf0-42a929e090fc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:42:57.927114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f4d9175-9cba-421f-adf0-42a929e090fc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:57.927927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f4d9175-9cba-421f-adf0-42a929e090fc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:57.928802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f4d9175-9cba-421f-adf0-42a929e090fc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:57.933254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f4d9175-9cba-421f-adf0-42a929e090fc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:42:57.937150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f4d9175-9cba-421f-adf0-42a929e090fc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:42:57.937801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f4d9175-9cba-421f-adf0-42a929e090fc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:42:57.994269 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9f4d9175-9cba-421f-adf0-42a929e090fc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b/ips" status: 200 len: 151 microversion: 2.20 time: 0.904736 Aug 24 10:42:58.002378 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2880/5409] 10.222.0.85 () {60 vars in 1289 bytes} [Wed Aug 24 10:42:57 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b/ips => generated 151 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:43:01.539662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1b575031-b0ca-40b0-b134-e276fd09e046 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:43:01.543328 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1b575031-b0ca-40b0-b134-e276fd09e046 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:01.567453 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=41 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:01.568317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=7 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:01.573852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b575031-b0ca-40b0-b134-e276fd09e046 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:01.574707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b575031-b0ca-40b0-b134-e276fd09e046 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:01.575264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b575031-b0ca-40b0-b134-e276fd09e046 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:01.578370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b575031-b0ca-40b0-b134-e276fd09e046 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:01.580061 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b575031-b0ca-40b0-b134-e276fd09e046 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:01.585392 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b575031-b0ca-40b0-b134-e276fd09e046 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:01.655013 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-1b575031-b0ca-40b0-b134-e276fd09e046 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lazy-loading 'flavor' on Instance uuid cc496b71-8fb7-4344-8642-53483cea796b {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:43:02.087533 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1b575031-b0ca-40b0-b134-e276fd09e046 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "POST /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b/action" status: 202 len: 0 microversion: 2.20 time: 0.554871 Aug 24 10:43:02.090042 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2530/5410] 10.222.0.85 () {62 vars in 1319 bytes} [Wed Aug 24 10:43:01 2022] POST /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:43:02.103941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-07439c07-9d5f-4aa6-a75c-ce5687882e8c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:02.104715 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-07439c07-9d5f-4aa6-a75c-ce5687882e8c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:02.148688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07439c07-9d5f-4aa6-a75c-ce5687882e8c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:02.149215 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07439c07-9d5f-4aa6-a75c-ce5687882e8c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:02.149658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07439c07-9d5f-4aa6-a75c-ce5687882e8c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:02.150381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07439c07-9d5f-4aa6-a75c-ce5687882e8c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:02.150837 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07439c07-9d5f-4aa6-a75c-ce5687882e8c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:02.151337 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07439c07-9d5f-4aa6-a75c-ce5687882e8c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:02.457230 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-07439c07-9d5f-4aa6-a75c-ce5687882e8c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:02.471718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-07439c07-9d5f-4aa6-a75c-ce5687882e8c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:02.477795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-07439c07-9d5f-4aa6-a75c-ce5687882e8c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:02.481604 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-07439c07-9d5f-4aa6-a75c-ce5687882e8c tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1722 microversion: 2.20 time: 0.387095 Aug 24 10:43:02.484018 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2881/5411] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:02 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1722 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:03.511881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-250ff614-2498-4335-95a0-96284a3da603 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:03.514065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-250ff614-2498-4335-95a0-96284a3da603 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:03.542491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-250ff614-2498-4335-95a0-96284a3da603 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:03.542491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-250ff614-2498-4335-95a0-96284a3da603 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:03.543661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-250ff614-2498-4335-95a0-96284a3da603 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:03.544538 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-250ff614-2498-4335-95a0-96284a3da603 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:03.545006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-250ff614-2498-4335-95a0-96284a3da603 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:03.551763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-250ff614-2498-4335-95a0-96284a3da603 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:04.013848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-250ff614-2498-4335-95a0-96284a3da603 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:04.039354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-250ff614-2498-4335-95a0-96284a3da603 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:04.046971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-250ff614-2498-4335-95a0-96284a3da603 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:04.048245 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-250ff614-2498-4335-95a0-96284a3da603 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1722 microversion: 2.20 time: 0.541242 Aug 24 10:43:04.048838 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2531/5412] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:03 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1722 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:05.078328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-06ff708e-2045-469c-b02d-38d29b275171 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:05.079047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-06ff708e-2045-469c-b02d-38d29b275171 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:05.101578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06ff708e-2045-469c-b02d-38d29b275171 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:05.102124 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06ff708e-2045-469c-b02d-38d29b275171 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:05.107649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06ff708e-2045-469c-b02d-38d29b275171 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:05.109910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06ff708e-2045-469c-b02d-38d29b275171 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:05.110560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06ff708e-2045-469c-b02d-38d29b275171 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:05.113919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06ff708e-2045-469c-b02d-38d29b275171 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:05.510273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-06ff708e-2045-469c-b02d-38d29b275171 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:05.533544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-06ff708e-2045-469c-b02d-38d29b275171 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:05.534225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-06ff708e-2045-469c-b02d-38d29b275171 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:05.535821 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-06ff708e-2045-469c-b02d-38d29b275171 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1722 microversion: 2.20 time: 0.466466 Aug 24 10:43:05.536563 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2882/5413] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:05 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1722 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:06.564729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1c64d2b9-10dc-43b8-832d-96b843a55c85 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:06.566173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1c64d2b9-10dc-43b8-832d-96b843a55c85 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:06.589407 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c64d2b9-10dc-43b8-832d-96b843a55c85 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:06.601016 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c64d2b9-10dc-43b8-832d-96b843a55c85 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:06.602697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c64d2b9-10dc-43b8-832d-96b843a55c85 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:06.606398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c64d2b9-10dc-43b8-832d-96b843a55c85 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:06.607546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c64d2b9-10dc-43b8-832d-96b843a55c85 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:06.612480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c64d2b9-10dc-43b8-832d-96b843a55c85 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:07.385586 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1c64d2b9-10dc-43b8-832d-96b843a55c85 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:07.400414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1c64d2b9-10dc-43b8-832d-96b843a55c85 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:07.404290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1c64d2b9-10dc-43b8-832d-96b843a55c85 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:07.408814 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1c64d2b9-10dc-43b8-832d-96b843a55c85 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1722 microversion: 2.20 time: 0.847659 Aug 24 10:43:07.414124 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2532/5414] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:06 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1722 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:08.439082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6428793e-fce5-4382-9435-6b9bd33f3376 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:08.441294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6428793e-fce5-4382-9435-6b9bd33f3376 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:08.474738 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6428793e-fce5-4382-9435-6b9bd33f3376 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:08.475432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6428793e-fce5-4382-9435-6b9bd33f3376 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:08.476066 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6428793e-fce5-4382-9435-6b9bd33f3376 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:08.476923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6428793e-fce5-4382-9435-6b9bd33f3376 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:08.478347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6428793e-fce5-4382-9435-6b9bd33f3376 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:08.479523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6428793e-fce5-4382-9435-6b9bd33f3376 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:09.057176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6428793e-fce5-4382-9435-6b9bd33f3376 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:09.066829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6428793e-fce5-4382-9435-6b9bd33f3376 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:09.074037 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6428793e-fce5-4382-9435-6b9bd33f3376 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:09.079066 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6428793e-fce5-4382-9435-6b9bd33f3376 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1722 microversion: 2.20 time: 0.649241 Aug 24 10:43:09.081834 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2883/5415] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:08 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1722 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:10.109034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f3cae880-eb9e-43c5-95a1-e565b60edab3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:10.109681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f3cae880-eb9e-43c5-95a1-e565b60edab3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:10.136712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3cae880-eb9e-43c5-95a1-e565b60edab3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:10.142385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3cae880-eb9e-43c5-95a1-e565b60edab3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:10.144496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3cae880-eb9e-43c5-95a1-e565b60edab3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:10.145497 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3cae880-eb9e-43c5-95a1-e565b60edab3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:10.146685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3cae880-eb9e-43c5-95a1-e565b60edab3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:10.148239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3cae880-eb9e-43c5-95a1-e565b60edab3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:10.183893 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de58e19f-88e0-4c83-a0cd-8ab2cd2accd4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:10.184616 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-de58e19f-88e0-4c83-a0cd-8ab2cd2accd4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:10.209953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de58e19f-88e0-4c83-a0cd-8ab2cd2accd4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:10.210607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de58e19f-88e0-4c83-a0cd-8ab2cd2accd4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:10.213379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de58e19f-88e0-4c83-a0cd-8ab2cd2accd4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:10.216422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de58e19f-88e0-4c83-a0cd-8ab2cd2accd4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:10.218303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de58e19f-88e0-4c83-a0cd-8ab2cd2accd4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:10.218946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de58e19f-88e0-4c83-a0cd-8ab2cd2accd4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:10.301367 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-de58e19f-88e0-4c83-a0cd-8ab2cd2accd4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9/ips" status: 200 len: 149 microversion: 2.1 time: 0.124665 Aug 24 10:43:10.302891 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2884/5416] 10.222.0.85 () {58 vars in 1248 bytes} [Wed Aug 24 10:43:10 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9/ips => generated 149 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:43:11.516396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f3cae880-eb9e-43c5-95a1-e565b60edab3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:11.535901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f3cae880-eb9e-43c5-95a1-e565b60edab3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:11.546857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f3cae880-eb9e-43c5-95a1-e565b60edab3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:11.554927 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f3cae880-eb9e-43c5-95a1-e565b60edab3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1722 microversion: 2.20 time: 1.448721 Aug 24 10:43:11.557994 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2533/5417] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:10 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1722 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:12.584868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-278596b4-14a0-49a8-8f59-241845ece75f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:12.585582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-278596b4-14a0-49a8-8f59-241845ece75f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:12.600352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-278596b4-14a0-49a8-8f59-241845ece75f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:12.604070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-278596b4-14a0-49a8-8f59-241845ece75f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:12.605952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-278596b4-14a0-49a8-8f59-241845ece75f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:12.608040 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-278596b4-14a0-49a8-8f59-241845ece75f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:12.613509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-278596b4-14a0-49a8-8f59-241845ece75f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:12.614227 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-278596b4-14a0-49a8-8f59-241845ece75f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:13.603018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-278596b4-14a0-49a8-8f59-241845ece75f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:13.613437 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-278596b4-14a0-49a8-8f59-241845ece75f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:13.615000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-278596b4-14a0-49a8-8f59-241845ece75f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:13.616218 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-278596b4-14a0-49a8-8f59-241845ece75f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1722 microversion: 2.20 time: 1.035885 Aug 24 10:43:13.616806 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2885/5418] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:12 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1722 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:14.444460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e628c1e1-16eb-4b04-9ac1-9153dbcb3c00 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7bc2ef2a-aec7-4ead-9ad2-fc3351093f72"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:43:14.448730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e628c1e1-16eb-4b04-9ac1-9153dbcb3c00 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:14.459638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e628c1e1-16eb-4b04-9ac1-9153dbcb3c00 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:14.461010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e628c1e1-16eb-4b04-9ac1-9153dbcb3c00 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:14.473816 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e628c1e1-16eb-4b04-9ac1-9153dbcb3c00 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:14.474929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e628c1e1-16eb-4b04-9ac1-9153dbcb3c00 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:14.478164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e628c1e1-16eb-4b04-9ac1-9153dbcb3c00 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:14.479007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e628c1e1-16eb-4b04-9ac1-9153dbcb3c00 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:14.664741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f1cb67ab-eb30-4610-876f-fe3dee1f6484 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:14.665567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f1cb67ab-eb30-4610-876f-fe3dee1f6484 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:14.683590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1cb67ab-eb30-4610-876f-fe3dee1f6484 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:14.684256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1cb67ab-eb30-4610-876f-fe3dee1f6484 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:14.685367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1cb67ab-eb30-4610-876f-fe3dee1f6484 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:14.687455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1cb67ab-eb30-4610-876f-fe3dee1f6484 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:14.689716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1cb67ab-eb30-4610-876f-fe3dee1f6484 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:14.690807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1cb67ab-eb30-4610-876f-fe3dee1f6484 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:15.079612 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e628c1e1-16eb-4b04-9ac1-9153dbcb3c00 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "POST /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.639245 Aug 24 10:43:15.088398 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2534/5419] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Aug 24 10:43:14 2022] POST /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9/os-volume_attachments => generated 194 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:43:15.396952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f1cb67ab-eb30-4610-876f-fe3dee1f6484 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:15.428155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f1cb67ab-eb30-4610-876f-fe3dee1f6484 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:15.429920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f1cb67ab-eb30-4610-876f-fe3dee1f6484 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:15.442109 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f1cb67ab-eb30-4610-876f-fe3dee1f6484 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1722 microversion: 2.20 time: 0.782478 Aug 24 10:43:15.447664 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2886/5420] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:14 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1722 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:16.475428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2235ecd9-21ba-4a77-b821-d3cb903f2ce1 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:16.476194 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2235ecd9-21ba-4a77-b821-d3cb903f2ce1 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:16.487466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2235ecd9-21ba-4a77-b821-d3cb903f2ce1 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:16.492054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2235ecd9-21ba-4a77-b821-d3cb903f2ce1 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:16.494075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2235ecd9-21ba-4a77-b821-d3cb903f2ce1 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:16.500442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2235ecd9-21ba-4a77-b821-d3cb903f2ce1 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:16.501264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2235ecd9-21ba-4a77-b821-d3cb903f2ce1 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:16.501895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2235ecd9-21ba-4a77-b821-d3cb903f2ce1 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:16.951971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2235ecd9-21ba-4a77-b821-d3cb903f2ce1 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:16.984658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2235ecd9-21ba-4a77-b821-d3cb903f2ce1 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:16.988248 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2235ecd9-21ba-4a77-b821-d3cb903f2ce1 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:16.990170 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2235ecd9-21ba-4a77-b821-d3cb903f2ce1 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1722 microversion: 2.20 time: 0.519381 Aug 24 10:43:16.992984 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2535/5421] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:16 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1722 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:18.014554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-434f0c74-8d9b-490d-80c3-9b4ea6309311 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:18.015167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-434f0c74-8d9b-490d-80c3-9b4ea6309311 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:18.034884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-434f0c74-8d9b-490d-80c3-9b4ea6309311 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:18.035377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-434f0c74-8d9b-490d-80c3-9b4ea6309311 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:18.036001 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-434f0c74-8d9b-490d-80c3-9b4ea6309311 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:18.036722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-434f0c74-8d9b-490d-80c3-9b4ea6309311 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:18.038426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-434f0c74-8d9b-490d-80c3-9b4ea6309311 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:18.038888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-434f0c74-8d9b-490d-80c3-9b4ea6309311 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:18.330367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-434f0c74-8d9b-490d-80c3-9b4ea6309311 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:18.358767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-434f0c74-8d9b-490d-80c3-9b4ea6309311 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:18.363794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-434f0c74-8d9b-490d-80c3-9b4ea6309311 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:18.367677 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-434f0c74-8d9b-490d-80c3-9b4ea6309311 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1743 microversion: 2.20 time: 0.355815 Aug 24 10:43:18.387131 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2887/5422] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:18 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1743 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:19.396352 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b436d3f2-db2f-4e91-acf5-7385e28c36c7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:19.397029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b436d3f2-db2f-4e91-acf5-7385e28c36c7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:19.415152 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b436d3f2-db2f-4e91-acf5-7385e28c36c7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:19.415658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b436d3f2-db2f-4e91-acf5-7385e28c36c7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:19.424748 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b436d3f2-db2f-4e91-acf5-7385e28c36c7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:19.426844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b436d3f2-db2f-4e91-acf5-7385e28c36c7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:19.427341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b436d3f2-db2f-4e91-acf5-7385e28c36c7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:19.427778 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b436d3f2-db2f-4e91-acf5-7385e28c36c7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:20.076462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b436d3f2-db2f-4e91-acf5-7385e28c36c7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:20.086202 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b436d3f2-db2f-4e91-acf5-7385e28c36c7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:20.087716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b436d3f2-db2f-4e91-acf5-7385e28c36c7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:20.094695 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b436d3f2-db2f-4e91-acf5-7385e28c36c7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1743 microversion: 2.20 time: 0.706400 Aug 24 10:43:20.098007 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2536/5423] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:19 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1743 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:21.124429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-123534c0-04f7-47dc-b4fd-9ff4ee66feb0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:21.125206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-123534c0-04f7-47dc-b4fd-9ff4ee66feb0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:21.143123 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-123534c0-04f7-47dc-b4fd-9ff4ee66feb0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:21.143528 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-123534c0-04f7-47dc-b4fd-9ff4ee66feb0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:21.144564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-123534c0-04f7-47dc-b4fd-9ff4ee66feb0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:21.145439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-123534c0-04f7-47dc-b4fd-9ff4ee66feb0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:21.146061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-123534c0-04f7-47dc-b4fd-9ff4ee66feb0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:21.146506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-123534c0-04f7-47dc-b4fd-9ff4ee66feb0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:21.615124 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-123534c0-04f7-47dc-b4fd-9ff4ee66feb0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:21.631383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-123534c0-04f7-47dc-b4fd-9ff4ee66feb0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:21.632943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-123534c0-04f7-47dc-b4fd-9ff4ee66feb0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:21.643776 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-123534c0-04f7-47dc-b4fd-9ff4ee66feb0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1738 microversion: 2.20 time: 0.526927 Aug 24 10:43:21.661513 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2888/5424] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:21 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1738 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:22.671699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e88b2913-d885-4a88-a67e-786c77ff5c6d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:22.672320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e88b2913-d885-4a88-a67e-786c77ff5c6d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:22.687683 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e88b2913-d885-4a88-a67e-786c77ff5c6d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:22.700764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e88b2913-d885-4a88-a67e-786c77ff5c6d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:22.701258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e88b2913-d885-4a88-a67e-786c77ff5c6d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:22.702020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e88b2913-d885-4a88-a67e-786c77ff5c6d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:22.702485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e88b2913-d885-4a88-a67e-786c77ff5c6d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:22.702924 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e88b2913-d885-4a88-a67e-786c77ff5c6d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:22.868077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-88a8bae9-44ab-46f0-ac88-5672d79accbd req-c9e2fe38-9497-45e2-b220-fbb850b53912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc496b71-8fb7-4344-8642-53483cea796b", "name": "network-vif-plugged", "status": "completed", "tag": "30ffbeff-bf67-4d4a-8328-d554619bcd68"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:43:22.892296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-88a8bae9-44ab-46f0-ac88-5672d79accbd req-c9e2fe38-9497-45e2-b220-fbb850b53912 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:22.892780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-88a8bae9-44ab-46f0-ac88-5672d79accbd req-c9e2fe38-9497-45e2-b220-fbb850b53912 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:22.896573 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-88a8bae9-44ab-46f0-ac88-5672d79accbd req-c9e2fe38-9497-45e2-b220-fbb850b53912 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:22.924250 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-88a8bae9-44ab-46f0-ac88-5672d79accbd req-c9e2fe38-9497-45e2-b220-fbb850b53912 service nova] Creating event network-vif-plugged:30ffbeff-bf67-4d4a-8328-d554619bcd68 for instance cc496b71-8fb7-4344-8642-53483cea796b on n-h1-849328-3 Aug 24 10:43:22.942496 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-88a8bae9-44ab-46f0-ac88-5672d79accbd req-c9e2fe38-9497-45e2-b220-fbb850b53912 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080015 Aug 24 10:43:22.943125 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2889/5425] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:43:23.763751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e88b2913-d885-4a88-a67e-786c77ff5c6d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:23.773689 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e88b2913-d885-4a88-a67e-786c77ff5c6d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:23.791529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e88b2913-d885-4a88-a67e-786c77ff5c6d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:23.796622 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e88b2913-d885-4a88-a67e-786c77ff5c6d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1738 microversion: 2.20 time: 1.127552 Aug 24 10:43:23.818385 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2537/5426] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:22 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1738 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:24.830496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-89aafc10-e3bd-4401-9467-f18de1d8740b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:24.831197 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-89aafc10-e3bd-4401-9467-f18de1d8740b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:24.847919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89aafc10-e3bd-4401-9467-f18de1d8740b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:24.848373 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89aafc10-e3bd-4401-9467-f18de1d8740b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:24.856217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89aafc10-e3bd-4401-9467-f18de1d8740b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:24.857995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89aafc10-e3bd-4401-9467-f18de1d8740b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:24.862739 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89aafc10-e3bd-4401-9467-f18de1d8740b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:24.867361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89aafc10-e3bd-4401-9467-f18de1d8740b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:25.664798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-89aafc10-e3bd-4401-9467-f18de1d8740b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:25.682891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-89aafc10-e3bd-4401-9467-f18de1d8740b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:25.688619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-89aafc10-e3bd-4401-9467-f18de1d8740b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:25.690969 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-89aafc10-e3bd-4401-9467-f18de1d8740b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1738 microversion: 2.20 time: 0.866414 Aug 24 10:43:25.706363 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2890/5427] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:24 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1738 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:26.720659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-acf9cc55-0e67-4438-8fab-672f6e517871 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:26.721304 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-acf9cc55-0e67-4438-8fab-672f6e517871 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:26.735372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acf9cc55-0e67-4438-8fab-672f6e517871 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:26.736148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acf9cc55-0e67-4438-8fab-672f6e517871 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:26.736751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acf9cc55-0e67-4438-8fab-672f6e517871 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:26.740027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acf9cc55-0e67-4438-8fab-672f6e517871 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:26.748491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acf9cc55-0e67-4438-8fab-672f6e517871 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:26.749487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acf9cc55-0e67-4438-8fab-672f6e517871 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:27.199519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-acf9cc55-0e67-4438-8fab-672f6e517871 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:27.224150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-acf9cc55-0e67-4438-8fab-672f6e517871 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:27.244570 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-acf9cc55-0e67-4438-8fab-672f6e517871 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:27.247857 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-acf9cc55-0e67-4438-8fab-672f6e517871 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1738 microversion: 2.20 time: 0.531171 Aug 24 10:43:27.260890 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2538/5428] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:26 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1738 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:28.286542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-13775fe8-0dc7-4a5a-b82e-d17f8195cf95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:28.288580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-13775fe8-0dc7-4a5a-b82e-d17f8195cf95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:28.293866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=23 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:28.309758 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13775fe8-0dc7-4a5a-b82e-d17f8195cf95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:28.312440 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13775fe8-0dc7-4a5a-b82e-d17f8195cf95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:28.313156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13775fe8-0dc7-4a5a-b82e-d17f8195cf95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:28.314089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13775fe8-0dc7-4a5a-b82e-d17f8195cf95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:28.316961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13775fe8-0dc7-4a5a-b82e-d17f8195cf95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:28.317636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13775fe8-0dc7-4a5a-b82e-d17f8195cf95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:28.331269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=59 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:28.637588 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-13775fe8-0dc7-4a5a-b82e-d17f8195cf95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:28.654267 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-13775fe8-0dc7-4a5a-b82e-d17f8195cf95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:28.657293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-13775fe8-0dc7-4a5a-b82e-d17f8195cf95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:28.658743 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-13775fe8-0dc7-4a5a-b82e-d17f8195cf95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1738 microversion: 2.20 time: 0.376705 Aug 24 10:43:28.659698 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2891/5429] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:28 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1738 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:29.687323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-974fff39-8b14-4b1a-bfa4-c8683adca8d2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:29.687861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-974fff39-8b14-4b1a-bfa4-c8683adca8d2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:29.706526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-974fff39-8b14-4b1a-bfa4-c8683adca8d2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:29.707391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-974fff39-8b14-4b1a-bfa4-c8683adca8d2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:29.708005 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-974fff39-8b14-4b1a-bfa4-c8683adca8d2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:29.708925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-974fff39-8b14-4b1a-bfa4-c8683adca8d2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:29.709606 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-974fff39-8b14-4b1a-bfa4-c8683adca8d2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:29.710335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-974fff39-8b14-4b1a-bfa4-c8683adca8d2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:30.279027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-974fff39-8b14-4b1a-bfa4-c8683adca8d2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:30.304825 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-974fff39-8b14-4b1a-bfa4-c8683adca8d2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:30.306684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-974fff39-8b14-4b1a-bfa4-c8683adca8d2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:30.315761 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-974fff39-8b14-4b1a-bfa4-c8683adca8d2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1738 microversion: 2.20 time: 0.634383 Aug 24 10:43:30.316648 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2539/5430] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:29 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1738 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:31.340568 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6081bddc-6b79-4c95-bb71-491cf27e010f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:31.341316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6081bddc-6b79-4c95-bb71-491cf27e010f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:31.355004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6081bddc-6b79-4c95-bb71-491cf27e010f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:31.358777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6081bddc-6b79-4c95-bb71-491cf27e010f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:31.359538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6081bddc-6b79-4c95-bb71-491cf27e010f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:31.360465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6081bddc-6b79-4c95-bb71-491cf27e010f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:31.360952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6081bddc-6b79-4c95-bb71-491cf27e010f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:31.362422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6081bddc-6b79-4c95-bb71-491cf27e010f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:32.118825 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6081bddc-6b79-4c95-bb71-491cf27e010f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:32.137219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6081bddc-6b79-4c95-bb71-491cf27e010f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:32.139271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6081bddc-6b79-4c95-bb71-491cf27e010f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:32.143270 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6081bddc-6b79-4c95-bb71-491cf27e010f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1738 microversion: 2.20 time: 0.806776 Aug 24 10:43:32.144189 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2892/5431] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:31 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1738 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:33.170669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cae2c677-1b16-41ec-83bb-b6caf6acebdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:33.170669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cae2c677-1b16-41ec-83bb-b6caf6acebdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:33.179982 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=21 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:33.186177 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cae2c677-1b16-41ec-83bb-b6caf6acebdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:33.186971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cae2c677-1b16-41ec-83bb-b6caf6acebdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:33.188327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cae2c677-1b16-41ec-83bb-b6caf6acebdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:33.189305 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cae2c677-1b16-41ec-83bb-b6caf6acebdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:33.192128 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cae2c677-1b16-41ec-83bb-b6caf6acebdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:33.192776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cae2c677-1b16-41ec-83bb-b6caf6acebdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:33.208161 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:33.870748 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cae2c677-1b16-41ec-83bb-b6caf6acebdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:33.882213 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cae2c677-1b16-41ec-83bb-b6caf6acebdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:33.883907 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cae2c677-1b16-41ec-83bb-b6caf6acebdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:33.885183 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cae2c677-1b16-41ec-83bb-b6caf6acebdf tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1738 microversion: 2.20 time: 0.721663 Aug 24 10:43:33.888236 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2540/5432] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:33 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1738 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:34.911250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-07421835-10d2-42c7-b6b6-0983f8b50abe tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:34.911919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-07421835-10d2-42c7-b6b6-0983f8b50abe tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:34.942602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07421835-10d2-42c7-b6b6-0983f8b50abe tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:34.943140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07421835-10d2-42c7-b6b6-0983f8b50abe tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:34.943590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07421835-10d2-42c7-b6b6-0983f8b50abe tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:34.944327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07421835-10d2-42c7-b6b6-0983f8b50abe tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:34.944787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07421835-10d2-42c7-b6b6-0983f8b50abe tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:34.945248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07421835-10d2-42c7-b6b6-0983f8b50abe tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:35.665210 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-07421835-10d2-42c7-b6b6-0983f8b50abe tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:35.675557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-07421835-10d2-42c7-b6b6-0983f8b50abe tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:35.689561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-07421835-10d2-42c7-b6b6-0983f8b50abe tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:35.692643 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-07421835-10d2-42c7-b6b6-0983f8b50abe tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1738 microversion: 2.20 time: 0.788693 Aug 24 10:43:35.716994 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2893/5433] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:34 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1738 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:36.721024 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8c98bdc2-6d0f-4885-83d2-42d9237bd4bd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:36.721685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8c98bdc2-6d0f-4885-83d2-42d9237bd4bd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:36.750885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c98bdc2-6d0f-4885-83d2-42d9237bd4bd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:36.751398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c98bdc2-6d0f-4885-83d2-42d9237bd4bd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:36.751845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c98bdc2-6d0f-4885-83d2-42d9237bd4bd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:36.752575 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c98bdc2-6d0f-4885-83d2-42d9237bd4bd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:36.753036 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c98bdc2-6d0f-4885-83d2-42d9237bd4bd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:36.756700 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c98bdc2-6d0f-4885-83d2-42d9237bd4bd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:37.375385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8c98bdc2-6d0f-4885-83d2-42d9237bd4bd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:37.385285 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8c98bdc2-6d0f-4885-83d2-42d9237bd4bd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:37.391174 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8c98bdc2-6d0f-4885-83d2-42d9237bd4bd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:37.396937 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8c98bdc2-6d0f-4885-83d2-42d9237bd4bd tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1738 microversion: 2.20 time: 0.677842 Aug 24 10:43:37.398324 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2541/5434] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:36 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1738 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:38.429423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-71892fbc-8a7f-45ca-ad95-bdb9d52e8b95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:38.430018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-71892fbc-8a7f-45ca-ad95-bdb9d52e8b95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:38.453495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71892fbc-8a7f-45ca-ad95-bdb9d52e8b95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:38.454006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71892fbc-8a7f-45ca-ad95-bdb9d52e8b95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:38.454451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71892fbc-8a7f-45ca-ad95-bdb9d52e8b95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:38.455181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71892fbc-8a7f-45ca-ad95-bdb9d52e8b95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:38.455645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71892fbc-8a7f-45ca-ad95-bdb9d52e8b95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:38.456073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71892fbc-8a7f-45ca-ad95-bdb9d52e8b95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:39.042064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-71892fbc-8a7f-45ca-ad95-bdb9d52e8b95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:39.066146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-71892fbc-8a7f-45ca-ad95-bdb9d52e8b95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:39.079218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-71892fbc-8a7f-45ca-ad95-bdb9d52e8b95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:39.082499 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-71892fbc-8a7f-45ca-ad95-bdb9d52e8b95 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1738 microversion: 2.20 time: 0.657337 Aug 24 10:43:39.103510 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2894/5435] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:38 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1738 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:40.119019 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5c8403c8-fede-4696-b03b-693977dba979 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:40.119803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5c8403c8-fede-4696-b03b-693977dba979 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:40.131179 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c8403c8-fede-4696-b03b-693977dba979 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:40.136426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c8403c8-fede-4696-b03b-693977dba979 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:40.138857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c8403c8-fede-4696-b03b-693977dba979 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:40.139725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c8403c8-fede-4696-b03b-693977dba979 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:40.149253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c8403c8-fede-4696-b03b-693977dba979 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:40.152530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c8403c8-fede-4696-b03b-693977dba979 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:40.887043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5c8403c8-fede-4696-b03b-693977dba979 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:40.901905 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5c8403c8-fede-4696-b03b-693977dba979 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:40.905610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5c8403c8-fede-4696-b03b-693977dba979 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:40.911461 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5c8403c8-fede-4696-b03b-693977dba979 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1738 microversion: 2.20 time: 0.797204 Aug 24 10:43:40.934214 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2542/5436] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:40 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1738 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:41.940187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e01e33a7-0a63-4398-8bb6-3475da3ff0fb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:41.941472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e01e33a7-0a63-4398-8bb6-3475da3ff0fb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:41.965763 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e01e33a7-0a63-4398-8bb6-3475da3ff0fb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:41.967083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e01e33a7-0a63-4398-8bb6-3475da3ff0fb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:41.968177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e01e33a7-0a63-4398-8bb6-3475da3ff0fb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:41.971722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e01e33a7-0a63-4398-8bb6-3475da3ff0fb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:41.978716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e01e33a7-0a63-4398-8bb6-3475da3ff0fb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:41.980494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e01e33a7-0a63-4398-8bb6-3475da3ff0fb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:42.658685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e01e33a7-0a63-4398-8bb6-3475da3ff0fb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:42.668703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e01e33a7-0a63-4398-8bb6-3475da3ff0fb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:42.670281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e01e33a7-0a63-4398-8bb6-3475da3ff0fb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:42.671498 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e01e33a7-0a63-4398-8bb6-3475da3ff0fb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1738 microversion: 2.20 time: 0.735535 Aug 24 10:43:42.672096 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2895/5437] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:41 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1738 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:43.699116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-84ca7992-5b1d-477c-8da1-af1dd06b3a24 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:43.699725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-84ca7992-5b1d-477c-8da1-af1dd06b3a24 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:43.721431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84ca7992-5b1d-477c-8da1-af1dd06b3a24 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:43.721935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84ca7992-5b1d-477c-8da1-af1dd06b3a24 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:43.722379 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84ca7992-5b1d-477c-8da1-af1dd06b3a24 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:43.723103 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84ca7992-5b1d-477c-8da1-af1dd06b3a24 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:43.723559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84ca7992-5b1d-477c-8da1-af1dd06b3a24 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:43.724010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84ca7992-5b1d-477c-8da1-af1dd06b3a24 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:44.198812 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-84ca7992-5b1d-477c-8da1-af1dd06b3a24 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:44.219201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-84ca7992-5b1d-477c-8da1-af1dd06b3a24 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:44.223351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-84ca7992-5b1d-477c-8da1-af1dd06b3a24 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:44.224942 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-84ca7992-5b1d-477c-8da1-af1dd06b3a24 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1738 microversion: 2.20 time: 0.530294 Aug 24 10:43:44.227933 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2543/5438] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:43 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1738 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:45.251841 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-703f50ce-f26c-4433-ad07-c50832965865 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:45.252473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-703f50ce-f26c-4433-ad07-c50832965865 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:45.261240 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-703f50ce-f26c-4433-ad07-c50832965865 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:45.283289 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-703f50ce-f26c-4433-ad07-c50832965865 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:45.290058 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-703f50ce-f26c-4433-ad07-c50832965865 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:45.290873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-703f50ce-f26c-4433-ad07-c50832965865 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:45.291363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-703f50ce-f26c-4433-ad07-c50832965865 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:45.291845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-703f50ce-f26c-4433-ad07-c50832965865 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:46.074102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-703f50ce-f26c-4433-ad07-c50832965865 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:46.110141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-703f50ce-f26c-4433-ad07-c50832965865 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:46.123004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-703f50ce-f26c-4433-ad07-c50832965865 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:46.125771 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-703f50ce-f26c-4433-ad07-c50832965865 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1738 microversion: 2.20 time: 0.878644 Aug 24 10:43:46.153014 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2896/5439] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:45 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1738 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:46.432875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-070796ff-013a-40b0-8e73-2b97c2959b31 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Action: 'create', calling method: .version_select at 0x7f46550b71f0>, body: {"keypair": {"name": "tempest-keypair-1006638020", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZMaKwkwY1CylDq79z86zUKinkE9Ifrh35lxvzPCpm9/HPKurJby7uAe+9ot3XjP1Uk+8FtRHlTg5YxmikIaTiGdfA4POa/JiaaLgmW5x3C5piNS/tBNaIxHrYXl605Ng=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:43:46.492821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-070796ff-013a-40b0-8e73-2b97c2959b31 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Getting quotas for project 3cfd67239d3f4b7a89be1453a08c92ba. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:43:46.535121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-070796ff-013a-40b0-8e73-2b97c2959b31 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Getting quotas for user ff5172c17fae44e5839bd9b789e4c3a8 and project 3cfd67239d3f4b7a89be1453a08c92ba. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:43:46.618073 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-070796ff-013a-40b0-8e73-2b97c2959b31 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.189533 Aug 24 10:43:46.620681 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2544/5440] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:43:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:43:47.167330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-433d71fd-2ff8-4e5a-8788-c0b33fff3e6f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:47.168593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-433d71fd-2ff8-4e5a-8788-c0b33fff3e6f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:47.178990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-433d71fd-2ff8-4e5a-8788-c0b33fff3e6f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:47.187899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-433d71fd-2ff8-4e5a-8788-c0b33fff3e6f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:47.188550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-433d71fd-2ff8-4e5a-8788-c0b33fff3e6f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:47.193048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-433d71fd-2ff8-4e5a-8788-c0b33fff3e6f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:47.193767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-433d71fd-2ff8-4e5a-8788-c0b33fff3e6f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:47.194375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-433d71fd-2ff8-4e5a-8788-c0b33fff3e6f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:47.667175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-433d71fd-2ff8-4e5a-8788-c0b33fff3e6f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:47.693077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-433d71fd-2ff8-4e5a-8788-c0b33fff3e6f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:47.695797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-433d71fd-2ff8-4e5a-8788-c0b33fff3e6f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:47.697255 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-433d71fd-2ff8-4e5a-8788-c0b33fff3e6f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1738 microversion: 2.20 time: 0.536258 Aug 24 10:43:47.702190 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2897/5441] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:47 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1738 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:48.727765 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9228ccd5-27a0-4379-8107-4e1f170f73a2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:48.729795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9228ccd5-27a0-4379-8107-4e1f170f73a2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:48.767889 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9228ccd5-27a0-4379-8107-4e1f170f73a2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:48.768946 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9228ccd5-27a0-4379-8107-4e1f170f73a2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:48.771874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9228ccd5-27a0-4379-8107-4e1f170f73a2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:48.773956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9228ccd5-27a0-4379-8107-4e1f170f73a2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:48.777175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9228ccd5-27a0-4379-8107-4e1f170f73a2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:48.783023 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9228ccd5-27a0-4379-8107-4e1f170f73a2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:49.194279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9228ccd5-27a0-4379-8107-4e1f170f73a2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:49.214545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9228ccd5-27a0-4379-8107-4e1f170f73a2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:49.219145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9228ccd5-27a0-4379-8107-4e1f170f73a2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:49.232615 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9228ccd5-27a0-4379-8107-4e1f170f73a2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1738 microversion: 2.20 time: 0.510081 Aug 24 10:43:49.258967 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2545/5442] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:48 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1738 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:50.269403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-13b8a90f-9068-4292-acdc-00f6f7f0d30b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:50.270241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-13b8a90f-9068-4292-acdc-00f6f7f0d30b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:50.283088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13b8a90f-9068-4292-acdc-00f6f7f0d30b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:50.289306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13b8a90f-9068-4292-acdc-00f6f7f0d30b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:50.289923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13b8a90f-9068-4292-acdc-00f6f7f0d30b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:50.290794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13b8a90f-9068-4292-acdc-00f6f7f0d30b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:50.293687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13b8a90f-9068-4292-acdc-00f6f7f0d30b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:50.297702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13b8a90f-9068-4292-acdc-00f6f7f0d30b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:51.013300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-13b8a90f-9068-4292-acdc-00f6f7f0d30b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:51.024906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-13b8a90f-9068-4292-acdc-00f6f7f0d30b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:51.026876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-13b8a90f-9068-4292-acdc-00f6f7f0d30b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:51.029157 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-13b8a90f-9068-4292-acdc-00f6f7f0d30b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1738 microversion: 2.20 time: 0.768687 Aug 24 10:43:51.057573 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2898/5443] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:50 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1738 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:52.086838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e8f077b4-f8e3-4b2c-bcd3-479a20fae19a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:52.086838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e8f077b4-f8e3-4b2c-bcd3-479a20fae19a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:52.086838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8f077b4-f8e3-4b2c-bcd3-479a20fae19a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:52.086838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8f077b4-f8e3-4b2c-bcd3-479a20fae19a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:52.086838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8f077b4-f8e3-4b2c-bcd3-479a20fae19a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:52.090097 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8f077b4-f8e3-4b2c-bcd3-479a20fae19a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:52.091097 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8f077b4-f8e3-4b2c-bcd3-479a20fae19a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:52.091898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8f077b4-f8e3-4b2c-bcd3-479a20fae19a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:52.132950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4b73dea5-6b37-4800-8896-9c62901cd2a1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1164906055", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a83d8002-e283-4390-9f7e-f2670f338d6f"}], "security_groups": [{"name": "tempest-securitygroup--1813285372"}], "key_name": "tempest-keypair-1006638020", "user_data": "}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:43:52.458465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-4b73dea5-6b37-4800-8896-9c62901cd2a1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] validate_networks() for [('a83d8002-e283-4390-9f7e-f2670f338d6f', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:43:52.676752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e8f077b4-f8e3-4b2c-bcd3-479a20fae19a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:52.690597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e8f077b4-f8e3-4b2c-bcd3-479a20fae19a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:52.695197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e8f077b4-f8e3-4b2c-bcd3-479a20fae19a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:52.701164 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e8f077b4-f8e3-4b2c-bcd3-479a20fae19a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1720 microversion: 2.20 time: 0.644600 Aug 24 10:43:52.713964 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2546/5444] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:52 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1720 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:53.635183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-4b73dea5-6b37-4800-8896-9c62901cd2a1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:43:53.636288 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-4b73dea5-6b37-4800-8896-9c62901cd2a1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:43:53.640146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-4b73dea5-6b37-4800-8896-9c62901cd2a1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:43:53.641355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-4b73dea5-6b37-4800-8896-9c62901cd2a1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:43:53.646245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-4b73dea5-6b37-4800-8896-9c62901cd2a1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:43:53.696228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b73dea5-6b37-4800-8896-9c62901cd2a1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:53.696715 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b73dea5-6b37-4800-8896-9c62901cd2a1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:53.697165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b73dea5-6b37-4800-8896-9c62901cd2a1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:53.698486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b73dea5-6b37-4800-8896-9c62901cd2a1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:53.699108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b73dea5-6b37-4800-8896-9c62901cd2a1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:53.699813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b73dea5-6b37-4800-8896-9c62901cd2a1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:53.730558 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-04714257-0507-4010-97f0-6a78634f258d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:53.731163 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-04714257-0507-4010-97f0-6a78634f258d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:53.746252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04714257-0507-4010-97f0-6a78634f258d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:53.747653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-4b73dea5-6b37-4800-8896-9c62901cd2a1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Getting quotas for project 3cfd67239d3f4b7a89be1453a08c92ba. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:43:53.751532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04714257-0507-4010-97f0-6a78634f258d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:53.752600 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04714257-0507-4010-97f0-6a78634f258d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:53.753541 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04714257-0507-4010-97f0-6a78634f258d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:53.753668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-4b73dea5-6b37-4800-8896-9c62901cd2a1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Getting quotas for user ff5172c17fae44e5839bd9b789e4c3a8 and project 3cfd67239d3f4b7a89be1453a08c92ba. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:43:53.756328 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04714257-0507-4010-97f0-6a78634f258d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:53.757076 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04714257-0507-4010-97f0-6a78634f258d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:53.786949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4b73dea5-6b37-4800-8896-9c62901cd2a1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:43:53.789416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4b73dea5-6b37-4800-8896-9c62901cd2a1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: dbb7948c-1b98-4b05-9c70-d1a3e873fc54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:43:53.906780 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4b73dea5-6b37-4800-8896-9c62901cd2a1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.779065 Aug 24 10:43:53.919761 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2899/5445] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:43:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 1793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:43:53.925740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bbf78a4a-daeb-4cf8-8500-5e9e7da4dac9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:53.926714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bbf78a4a-daeb-4cf8-8500-5e9e7da4dac9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: dbb7948c-1b98-4b05-9c70-d1a3e873fc54] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:54.263238 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bbf78a4a-daeb-4cf8-8500-5e9e7da4dac9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:54.276143 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bbf78a4a-daeb-4cf8-8500-5e9e7da4dac9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54" status: 200 len: 1242 microversion: 2.1 time: 0.354667 Aug 24 10:43:54.276760 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2900/5446] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:43:53 2022] GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54 => generated 1242 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:43:54.842824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-04714257-0507-4010-97f0-6a78634f258d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:54.864948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-04714257-0507-4010-97f0-6a78634f258d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:54.866940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-04714257-0507-4010-97f0-6a78634f258d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:54.868585 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-04714257-0507-4010-97f0-6a78634f258d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1720 microversion: 2.20 time: 1.144046 Aug 24 10:43:54.870473 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2547/5447] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:53 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1720 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:43:55.313735 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-66a545f6-9ce4-4462-b005-bfd955c07ddf tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:55.315111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-66a545f6-9ce4-4462-b005-bfd955c07ddf tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: dbb7948c-1b98-4b05-9c70-d1a3e873fc54] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:55.339036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66a545f6-9ce4-4462-b005-bfd955c07ddf tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:55.342710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66a545f6-9ce4-4462-b005-bfd955c07ddf tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:55.344967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66a545f6-9ce4-4462-b005-bfd955c07ddf tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:55.346948 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66a545f6-9ce4-4462-b005-bfd955c07ddf tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:55.347500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66a545f6-9ce4-4462-b005-bfd955c07ddf tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:55.350177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66a545f6-9ce4-4462-b005-bfd955c07ddf tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:55.663574 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-66a545f6-9ce4-4462-b005-bfd955c07ddf tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:55.681970 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-66a545f6-9ce4-4462-b005-bfd955c07ddf tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54" status: 200 len: 1246 microversion: 2.1 time: 0.373062 Aug 24 10:43:55.683702 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2901/5448] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:43:55 2022] GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54 => generated 1246 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:43:55.892593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-64b83423-4b69-453f-afd9-fb5ff176b2e5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:55.893793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-64b83423-4b69-453f-afd9-fb5ff176b2e5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:55.904168 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64b83423-4b69-453f-afd9-fb5ff176b2e5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:55.910795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64b83423-4b69-453f-afd9-fb5ff176b2e5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:55.913250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64b83423-4b69-453f-afd9-fb5ff176b2e5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:55.917448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64b83423-4b69-453f-afd9-fb5ff176b2e5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:55.920613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64b83423-4b69-453f-afd9-fb5ff176b2e5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:55.921336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64b83423-4b69-453f-afd9-fb5ff176b2e5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:56.326206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-64b83423-4b69-453f-afd9-fb5ff176b2e5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:56.341839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-64b83423-4b69-453f-afd9-fb5ff176b2e5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:56.344177 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-64b83423-4b69-453f-afd9-fb5ff176b2e5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:56.348196 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-64b83423-4b69-453f-afd9-fb5ff176b2e5 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1720 microversion: 2.20 time: 0.459897 Aug 24 10:43:56.366938 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2548/5449] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:55 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1720 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:56.706423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1ad7b74f-443d-45ce-b70d-deb6400e520b tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:56.707053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1ad7b74f-443d-45ce-b70d-deb6400e520b tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: dbb7948c-1b98-4b05-9c70-d1a3e873fc54] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:56.720944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ad7b74f-443d-45ce-b70d-deb6400e520b tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:56.721522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ad7b74f-443d-45ce-b70d-deb6400e520b tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:56.725788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ad7b74f-443d-45ce-b70d-deb6400e520b tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:56.729861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ad7b74f-443d-45ce-b70d-deb6400e520b tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:56.730497 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ad7b74f-443d-45ce-b70d-deb6400e520b tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:56.733707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ad7b74f-443d-45ce-b70d-deb6400e520b tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:56.801851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-05b67966-7175-402e-85cb-dce982832efb req-6aa0d066-58e7-4891-b9ef-ed4270393143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc496b71-8fb7-4344-8642-53483cea796b", "name": "network-vif-unplugged", "status": "completed", "tag": "30ffbeff-bf67-4d4a-8328-d554619bcd68"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:43:56.808365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:56.821582 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-05b67966-7175-402e-85cb-dce982832efb req-6aa0d066-58e7-4891-b9ef-ed4270393143 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:56.822495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-05b67966-7175-402e-85cb-dce982832efb req-6aa0d066-58e7-4891-b9ef-ed4270393143 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:56.825090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-05b67966-7175-402e-85cb-dce982832efb req-6aa0d066-58e7-4891-b9ef-ed4270393143 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:56.843184 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-05b67966-7175-402e-85cb-dce982832efb req-6aa0d066-58e7-4891-b9ef-ed4270393143 service nova] Creating event network-vif-unplugged:30ffbeff-bf67-4d4a-8328-d554619bcd68 for instance cc496b71-8fb7-4344-8642-53483cea796b on n-h1-849328-3 Aug 24 10:43:56.850512 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-05b67966-7175-402e-85cb-dce982832efb req-6aa0d066-58e7-4891-b9ef-ed4270393143 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051464 Aug 24 10:43:56.852959 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2549/5450] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:43:56.915610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1ad7b74f-443d-45ce-b70d-deb6400e520b tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:56.929160 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1ad7b74f-443d-45ce-b70d-deb6400e520b tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54" status: 200 len: 1294 microversion: 2.1 time: 0.226856 Aug 24 10:43:56.935031 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2902/5451] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:43:56 2022] GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54 => generated 1294 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:43:57.380811 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-55a00292-bfd9-4fe0-8eaf-3dbf202a5596 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:57.383683 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-55a00292-bfd9-4fe0-8eaf-3dbf202a5596 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:57.422258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55a00292-bfd9-4fe0-8eaf-3dbf202a5596 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:57.426379 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55a00292-bfd9-4fe0-8eaf-3dbf202a5596 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:57.431084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55a00292-bfd9-4fe0-8eaf-3dbf202a5596 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:57.431657 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55a00292-bfd9-4fe0-8eaf-3dbf202a5596 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:57.431917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55a00292-bfd9-4fe0-8eaf-3dbf202a5596 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:57.435918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55a00292-bfd9-4fe0-8eaf-3dbf202a5596 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:57.971772 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d292dc8e-3d35-43d3-9638-c188915cf8c4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:57.973681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d292dc8e-3d35-43d3-9638-c188915cf8c4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: dbb7948c-1b98-4b05-9c70-d1a3e873fc54] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:57.996253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d292dc8e-3d35-43d3-9638-c188915cf8c4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:58.001940 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d292dc8e-3d35-43d3-9638-c188915cf8c4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:58.003753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d292dc8e-3d35-43d3-9638-c188915cf8c4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:58.014702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d292dc8e-3d35-43d3-9638-c188915cf8c4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:58.015158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d292dc8e-3d35-43d3-9638-c188915cf8c4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:58.025535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d292dc8e-3d35-43d3-9638-c188915cf8c4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:58.224229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-55a00292-bfd9-4fe0-8eaf-3dbf202a5596 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:58.263333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-55a00292-bfd9-4fe0-8eaf-3dbf202a5596 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:58.265763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-55a00292-bfd9-4fe0-8eaf-3dbf202a5596 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:58.267968 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-55a00292-bfd9-4fe0-8eaf-3dbf202a5596 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1723 microversion: 2.20 time: 0.895803 Aug 24 10:43:58.285603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d292dc8e-3d35-43d3-9638-c188915cf8c4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:43:58.290968 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2550/5452] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:43:57 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1723 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:43:58.303252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-68ff4f5f-0981-4eeb-90aa-15b500c24ebb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c4640a4-7373-44f1-8973-7bd842c3a19f"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:43:58.306627 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-68ff4f5f-0981-4eeb-90aa-15b500c24ebb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:58.314102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68ff4f5f-0981-4eeb-90aa-15b500c24ebb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:58.314356 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d292dc8e-3d35-43d3-9638-c188915cf8c4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54" status: 200 len: 1312 microversion: 2.1 time: 0.335847 Aug 24 10:43:58.315033 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68ff4f5f-0981-4eeb-90aa-15b500c24ebb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:58.315651 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2903/5453] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:43:57 2022] GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54 => generated 1312 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:43:58.315888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68ff4f5f-0981-4eeb-90aa-15b500c24ebb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:58.316971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68ff4f5f-0981-4eeb-90aa-15b500c24ebb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:58.318995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68ff4f5f-0981-4eeb-90aa-15b500c24ebb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:58.319628 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68ff4f5f-0981-4eeb-90aa-15b500c24ebb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:58.929680 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-68ff4f5f-0981-4eeb-90aa-15b500c24ebb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "POST /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.632447 Aug 24 10:43:58.932819 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2551/5454] 10.222.0.85 () {62 vars in 1364 bytes} [Wed Aug 24 10:43:58 2022] POST /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b/os-volume_attachments => generated 188 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:43:59.224967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ab2981f0-cc4f-4e3c-9477-5da0908d2af6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:59.225578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ab2981f0-cc4f-4e3c-9477-5da0908d2af6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:59.229377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:59.250769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab2981f0-cc4f-4e3c-9477-5da0908d2af6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:59.253592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab2981f0-cc4f-4e3c-9477-5da0908d2af6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:59.254138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab2981f0-cc4f-4e3c-9477-5da0908d2af6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:59.254983 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab2981f0-cc4f-4e3c-9477-5da0908d2af6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:59.256664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab2981f0-cc4f-4e3c-9477-5da0908d2af6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:59.257154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab2981f0-cc4f-4e3c-9477-5da0908d2af6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:59.343979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=68 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:59.360726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b31acd79-0a28-48fb-8610-68633c1ea825 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:43:59.362647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b31acd79-0a28-48fb-8610-68633c1ea825 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: dbb7948c-1b98-4b05-9c70-d1a3e873fc54] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:59.377102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b31acd79-0a28-48fb-8610-68633c1ea825 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:59.388093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b31acd79-0a28-48fb-8610-68633c1ea825 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:59.388753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b31acd79-0a28-48fb-8610-68633c1ea825 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:59.394272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b31acd79-0a28-48fb-8610-68633c1ea825 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:59.394761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b31acd79-0a28-48fb-8610-68633c1ea825 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:59.396416 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b31acd79-0a28-48fb-8610-68633c1ea825 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:59.872977 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ab2981f0-cc4f-4e3c-9477-5da0908d2af6 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "DELETE /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b/os-volume_attachments/0c4640a4-7373-44f1-8973-7bd842c3a19f" status: 202 len: 0 microversion: 2.20 time: 0.652774 Aug 24 10:43:59.875093 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2904/5455] 10.222.0.85 () {60 vars in 1457 bytes} [Wed Aug 24 10:43:59 2022] DELETE /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b/os-volume_attachments/0c4640a4-7373-44f1-8973-7bd842c3a19f => generated 0 bytes in 656 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 10:43:59.976055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5199f366-d930-4c24-925c-4f191aba99be tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:43:59.976922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5199f366-d930-4c24-925c-4f191aba99be tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:43:59.990353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5199f366-d930-4c24-925c-4f191aba99be tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:59.991160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5199f366-d930-4c24-925c-4f191aba99be tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:59.991820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5199f366-d930-4c24-925c-4f191aba99be tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:43:59.992724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5199f366-d930-4c24-925c-4f191aba99be tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:43:59.993413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5199f366-d930-4c24-925c-4f191aba99be tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:43:59.994007 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5199f366-d930-4c24-925c-4f191aba99be tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:00.065594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5199f366-d930-4c24-925c-4f191aba99be tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122433) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 10:44:00.188335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b31acd79-0a28-48fb-8610-68633c1ea825 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:00.232472 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b31acd79-0a28-48fb-8610-68633c1ea825 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54" status: 200 len: 1300 microversion: 2.1 time: 0.891026 Aug 24 10:44:00.247856 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2552/5456] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:43:59 2022] GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54 => generated 1300 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:44:00.266951 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5199f366-d930-4c24-925c-4f191aba99be tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "POST /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b/action" status: 202 len: 0 microversion: 2.20 time: 0.295398 Aug 24 10:44:00.269762 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2905/5457] 10.222.0.85 () {62 vars in 1319 bytes} [Wed Aug 24 10:43:59 2022] POST /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 10:44:00.283981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6516dc5a-8af6-47d0-a977-f670c14d8d77 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:00.284519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6516dc5a-8af6-47d0-a977-f670c14d8d77 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:00.306518 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6516dc5a-8af6-47d0-a977-f670c14d8d77 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:00.306518 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6516dc5a-8af6-47d0-a977-f670c14d8d77 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:00.310154 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6516dc5a-8af6-47d0-a977-f670c14d8d77 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:00.311410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6516dc5a-8af6-47d0-a977-f670c14d8d77 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:00.321579 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6516dc5a-8af6-47d0-a977-f670c14d8d77 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:00.324134 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6516dc5a-8af6-47d0-a977-f670c14d8d77 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:01.260855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8d512f00-e8f7-4c5b-a8bb-711a1c2e7bd0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:01.261279 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8d512f00-e8f7-4c5b-a8bb-711a1c2e7bd0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: dbb7948c-1b98-4b05-9c70-d1a3e873fc54] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:01.316863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d512f00-e8f7-4c5b-a8bb-711a1c2e7bd0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:01.318244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d512f00-e8f7-4c5b-a8bb-711a1c2e7bd0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:01.319354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d512f00-e8f7-4c5b-a8bb-711a1c2e7bd0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:01.320293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d512f00-e8f7-4c5b-a8bb-711a1c2e7bd0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:01.322168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d512f00-e8f7-4c5b-a8bb-711a1c2e7bd0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:01.324391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d512f00-e8f7-4c5b-a8bb-711a1c2e7bd0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:01.582370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6516dc5a-8af6-47d0-a977-f670c14d8d77 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:01.618405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6516dc5a-8af6-47d0-a977-f670c14d8d77 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:01.664369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6516dc5a-8af6-47d0-a977-f670c14d8d77 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:01.670139 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6516dc5a-8af6-47d0-a977-f670c14d8d77 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1671 microversion: 2.20 time: 1.395473 Aug 24 10:44:01.673168 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2553/5458] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:44:00 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1671 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:44:02.200716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8d512f00-e8f7-4c5b-a8bb-711a1c2e7bd0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:02.215355 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8d512f00-e8f7-4c5b-a8bb-711a1c2e7bd0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54" status: 200 len: 1368 microversion: 2.1 time: 0.959730 Aug 24 10:44:02.219042 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2906/5459] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:44:01 2022] GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54 => generated 1368 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:44:02.695914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1b3f11fe-6b87-4968-859d-8fbdca1b88a7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:02.696641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1b3f11fe-6b87-4968-859d-8fbdca1b88a7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:02.715059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b3f11fe-6b87-4968-859d-8fbdca1b88a7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:02.719465 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b3f11fe-6b87-4968-859d-8fbdca1b88a7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:02.720039 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b3f11fe-6b87-4968-859d-8fbdca1b88a7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:02.721173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b3f11fe-6b87-4968-859d-8fbdca1b88a7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:02.721944 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b3f11fe-6b87-4968-859d-8fbdca1b88a7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:02.723100 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b3f11fe-6b87-4968-859d-8fbdca1b88a7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:03.178574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1b3f11fe-6b87-4968-859d-8fbdca1b88a7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:03.192850 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1b3f11fe-6b87-4968-859d-8fbdca1b88a7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:03.197914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1b3f11fe-6b87-4968-859d-8fbdca1b88a7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:03.203976 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1b3f11fe-6b87-4968-859d-8fbdca1b88a7 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1729 microversion: 2.20 time: 0.509707 Aug 24 10:44:03.204932 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2554/5460] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:44:02 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1729 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:44:03.241516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-84b377ff-22cc-47d6-873a-97179acdf02c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:03.242156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-84b377ff-22cc-47d6-873a-97179acdf02c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: dbb7948c-1b98-4b05-9c70-d1a3e873fc54] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:03.258138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84b377ff-22cc-47d6-873a-97179acdf02c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:03.258645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84b377ff-22cc-47d6-873a-97179acdf02c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:03.259086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84b377ff-22cc-47d6-873a-97179acdf02c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:03.259804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84b377ff-22cc-47d6-873a-97179acdf02c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:03.260291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84b377ff-22cc-47d6-873a-97179acdf02c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:03.260725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84b377ff-22cc-47d6-873a-97179acdf02c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:03.637902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c6ab542e-947d-4df1-a5a5-cb9daeac7511 req-f37dc15d-0e6e-48f6-9c63-249e9afdd65c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbb7948c-1b98-4b05-9c70-d1a3e873fc54", "tag": "a42b7e09-0862-4825-9be7-52d0f56fc209"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:44:03.673762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:03.678168 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c6ab542e-947d-4df1-a5a5-cb9daeac7511 req-f37dc15d-0e6e-48f6-9c63-249e9afdd65c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:03.680336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c6ab542e-947d-4df1-a5a5-cb9daeac7511 req-f37dc15d-0e6e-48f6-9c63-249e9afdd65c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:03.680998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c6ab542e-947d-4df1-a5a5-cb9daeac7511 req-f37dc15d-0e6e-48f6-9c63-249e9afdd65c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:03.720416 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:03.726811 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:03.727119 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c6ab542e-947d-4df1-a5a5-cb9daeac7511 req-f37dc15d-0e6e-48f6-9c63-249e9afdd65c service nova] Creating event network-changed:a42b7e09-0862-4825-9be7-52d0f56fc209 for instance dbb7948c-1b98-4b05-9c70-d1a3e873fc54 on n-h1-849328-3 Aug 24 10:44:03.754892 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c6ab542e-947d-4df1-a5a5-cb9daeac7511 req-f37dc15d-0e6e-48f6-9c63-249e9afdd65c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118654 Aug 24 10:44:03.762110 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2555/5461] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:44:04.231753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9787c9c0-8fc2-488d-9f51-e43da879d180 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:04.232893 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9787c9c0-8fc2-488d-9f51-e43da879d180 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:04.246547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9787c9c0-8fc2-488d-9f51-e43da879d180 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:04.247323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9787c9c0-8fc2-488d-9f51-e43da879d180 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:04.247948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9787c9c0-8fc2-488d-9f51-e43da879d180 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:04.248863 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9787c9c0-8fc2-488d-9f51-e43da879d180 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:04.249625 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9787c9c0-8fc2-488d-9f51-e43da879d180 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:04.250208 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9787c9c0-8fc2-488d-9f51-e43da879d180 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:04.268490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:04.549013 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9787c9c0-8fc2-488d-9f51-e43da879d180 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:04.560499 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9787c9c0-8fc2-488d-9f51-e43da879d180 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:04.566413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9787c9c0-8fc2-488d-9f51-e43da879d180 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:04.569218 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9787c9c0-8fc2-488d-9f51-e43da879d180 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1729 microversion: 2.20 time: 0.342067 Aug 24 10:44:04.572133 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2556/5462] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:44:04 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1729 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:44:05.194318 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-84b377ff-22cc-47d6-873a-97179acdf02c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:05.212295 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-84b377ff-22cc-47d6-873a-97179acdf02c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54" status: 200 len: 1368 microversion: 2.1 time: 1.974792 Aug 24 10:44:05.213560 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2907/5463] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:44:03 2022] GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54 => generated 1368 bytes in 1977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:44:05.597999 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8abe9aff-b55f-46f5-bd3e-0393d11d2af0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:05.598799 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8abe9aff-b55f-46f5-bd3e-0393d11d2af0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:05.610250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8abe9aff-b55f-46f5-bd3e-0393d11d2af0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:05.613509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8abe9aff-b55f-46f5-bd3e-0393d11d2af0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:05.615543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8abe9aff-b55f-46f5-bd3e-0393d11d2af0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:05.618851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8abe9aff-b55f-46f5-bd3e-0393d11d2af0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:05.632863 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8abe9aff-b55f-46f5-bd3e-0393d11d2af0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:05.636970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8abe9aff-b55f-46f5-bd3e-0393d11d2af0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:06.236545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-09457055-098a-45aa-9d92-d07e5cd383bb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:06.241561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-09457055-098a-45aa-9d92-d07e5cd383bb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: dbb7948c-1b98-4b05-9c70-d1a3e873fc54] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:06.269699 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09457055-098a-45aa-9d92-d07e5cd383bb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:06.270533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09457055-098a-45aa-9d92-d07e5cd383bb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:06.271186 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09457055-098a-45aa-9d92-d07e5cd383bb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:06.274407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09457055-098a-45aa-9d92-d07e5cd383bb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:06.275254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09457055-098a-45aa-9d92-d07e5cd383bb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:06.275976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09457055-098a-45aa-9d92-d07e5cd383bb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:06.382670 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8abe9aff-b55f-46f5-bd3e-0393d11d2af0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:06.392385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8abe9aff-b55f-46f5-bd3e-0393d11d2af0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:06.397085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8abe9aff-b55f-46f5-bd3e-0393d11d2af0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:06.399169 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8abe9aff-b55f-46f5-bd3e-0393d11d2af0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1729 microversion: 2.20 time: 0.805754 Aug 24 10:44:06.400289 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2557/5464] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:44:05 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1729 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:44:07.426510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7903f06d-1974-4f3f-8ac8-bc5d35d43a20 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:07.427181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7903f06d-1974-4f3f-8ac8-bc5d35d43a20 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:07.442922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7903f06d-1974-4f3f-8ac8-bc5d35d43a20 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:07.443750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7903f06d-1974-4f3f-8ac8-bc5d35d43a20 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:07.444462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7903f06d-1974-4f3f-8ac8-bc5d35d43a20 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:07.447381 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7903f06d-1974-4f3f-8ac8-bc5d35d43a20 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:07.448124 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7903f06d-1974-4f3f-8ac8-bc5d35d43a20 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:07.450306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7903f06d-1974-4f3f-8ac8-bc5d35d43a20 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:07.566204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-09457055-098a-45aa-9d92-d07e5cd383bb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:07.583650 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-09457055-098a-45aa-9d92-d07e5cd383bb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54" status: 200 len: 1368 microversion: 2.1 time: 1.351214 Aug 24 10:44:07.596812 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2908/5465] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:44:06 2022] GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54 => generated 1368 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:44:08.249296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7903f06d-1974-4f3f-8ac8-bc5d35d43a20 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:08.262217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7903f06d-1974-4f3f-8ac8-bc5d35d43a20 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:08.268555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7903f06d-1974-4f3f-8ac8-bc5d35d43a20 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:08.270244 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7903f06d-1974-4f3f-8ac8-bc5d35d43a20 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1729 microversion: 2.20 time: 0.848154 Aug 24 10:44:08.292864 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2558/5466] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:44:07 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1729 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:44:08.486282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-df78bde6-b34f-4a51-b148-97b6f8860b12 req-212b4ddd-cd7b-4353-a69a-aa8f609edeef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc496b71-8fb7-4344-8642-53483cea796b", "tag": "30ffbeff-bf67-4d4a-8328-d554619bcd68"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:44:08.540603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-df78bde6-b34f-4a51-b148-97b6f8860b12 req-212b4ddd-cd7b-4353-a69a-aa8f609edeef service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:08.541089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-df78bde6-b34f-4a51-b148-97b6f8860b12 req-212b4ddd-cd7b-4353-a69a-aa8f609edeef service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:08.544942 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-df78bde6-b34f-4a51-b148-97b6f8860b12 req-212b4ddd-cd7b-4353-a69a-aa8f609edeef service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:08.605815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-acc0acda-c43e-4565-9555-185875ac9db9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:08.608258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-acc0acda-c43e-4565-9555-185875ac9db9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: dbb7948c-1b98-4b05-9c70-d1a3e873fc54] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:08.634391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acc0acda-c43e-4565-9555-185875ac9db9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:08.635054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acc0acda-c43e-4565-9555-185875ac9db9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:08.635598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acc0acda-c43e-4565-9555-185875ac9db9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:08.640419 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acc0acda-c43e-4565-9555-185875ac9db9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:08.640665 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acc0acda-c43e-4565-9555-185875ac9db9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:08.642899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acc0acda-c43e-4565-9555-185875ac9db9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:09.276178 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-acc0acda-c43e-4565-9555-185875ac9db9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:09.290316 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-acc0acda-c43e-4565-9555-185875ac9db9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54" status: 200 len: 1368 microversion: 2.1 time: 0.689742 Aug 24 10:44:09.293788 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2559/5467] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:44:08 2022] GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54 => generated 1368 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:44:09.320476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cef1525d-12ed-456c-b6a9-3bf13373387a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:09.326452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cef1525d-12ed-456c-b6a9-3bf13373387a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:09.348952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cef1525d-12ed-456c-b6a9-3bf13373387a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:09.349489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cef1525d-12ed-456c-b6a9-3bf13373387a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:09.350043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cef1525d-12ed-456c-b6a9-3bf13373387a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:09.350638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cef1525d-12ed-456c-b6a9-3bf13373387a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:09.351081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cef1525d-12ed-456c-b6a9-3bf13373387a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:09.352146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cef1525d-12ed-456c-b6a9-3bf13373387a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:09.447535 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-df78bde6-b34f-4a51-b148-97b6f8860b12 req-212b4ddd-cd7b-4353-a69a-aa8f609edeef service nova] Creating event network-changed:30ffbeff-bf67-4d4a-8328-d554619bcd68 for instance cc496b71-8fb7-4344-8642-53483cea796b on n-h2-849328-3 Aug 24 10:44:09.459836 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-df78bde6-b34f-4a51-b148-97b6f8860b12 req-212b4ddd-cd7b-4353-a69a-aa8f609edeef service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.487919 Aug 24 10:44:09.461340 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2909/5468] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:44:10.162139 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cef1525d-12ed-456c-b6a9-3bf13373387a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:10.176915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cef1525d-12ed-456c-b6a9-3bf13373387a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:10.183317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cef1525d-12ed-456c-b6a9-3bf13373387a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:10.184966 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cef1525d-12ed-456c-b6a9-3bf13373387a tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1729 microversion: 2.20 time: 0.870079 Aug 24 10:44:10.190013 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2560/5469] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:44:09 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1729 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:44:10.320826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d103107f-febe-4b16-a99e-18ffe38f185f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:10.322044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d103107f-febe-4b16-a99e-18ffe38f185f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: dbb7948c-1b98-4b05-9c70-d1a3e873fc54] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:10.341301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d103107f-febe-4b16-a99e-18ffe38f185f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:10.343290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d103107f-febe-4b16-a99e-18ffe38f185f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:10.343989 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d103107f-febe-4b16-a99e-18ffe38f185f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:10.345085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d103107f-febe-4b16-a99e-18ffe38f185f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:10.348071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d103107f-febe-4b16-a99e-18ffe38f185f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:10.348831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d103107f-febe-4b16-a99e-18ffe38f185f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:10.586875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-840d0369-0305-4e1c-8497-3720157b460f req-c16a9384-7769-4900-86ad-b9a53b92b193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbb7948c-1b98-4b05-9c70-d1a3e873fc54", "name": "network-vif-plugged", "status": "completed", "tag": "a42b7e09-0862-4825-9be7-52d0f56fc209"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:44:10.597634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-840d0369-0305-4e1c-8497-3720157b460f req-c16a9384-7769-4900-86ad-b9a53b92b193 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:10.599186 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-840d0369-0305-4e1c-8497-3720157b460f req-c16a9384-7769-4900-86ad-b9a53b92b193 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:10.600004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-840d0369-0305-4e1c-8497-3720157b460f req-c16a9384-7769-4900-86ad-b9a53b92b193 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:10.645620 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-840d0369-0305-4e1c-8497-3720157b460f req-c16a9384-7769-4900-86ad-b9a53b92b193 service nova] Creating event network-vif-plugged:a42b7e09-0862-4825-9be7-52d0f56fc209 for instance dbb7948c-1b98-4b05-9c70-d1a3e873fc54 on n-h1-849328-3 Aug 24 10:44:10.653650 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-840d0369-0305-4e1c-8497-3720157b460f req-c16a9384-7769-4900-86ad-b9a53b92b193 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071234 Aug 24 10:44:10.658274 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2561/5470] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:44:11.217344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bc6a9c8e-41d6-47b7-9c49-8487a8717447 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:11.218044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bc6a9c8e-41d6-47b7-9c49-8487a8717447 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:11.247564 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc6a9c8e-41d6-47b7-9c49-8487a8717447 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:11.248314 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc6a9c8e-41d6-47b7-9c49-8487a8717447 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:11.248928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc6a9c8e-41d6-47b7-9c49-8487a8717447 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:11.249931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc6a9c8e-41d6-47b7-9c49-8487a8717447 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:11.250985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc6a9c8e-41d6-47b7-9c49-8487a8717447 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:11.261427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc6a9c8e-41d6-47b7-9c49-8487a8717447 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:11.914378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d103107f-febe-4b16-a99e-18ffe38f185f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:11.924076 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d103107f-febe-4b16-a99e-18ffe38f185f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54" status: 200 len: 1368 microversion: 2.1 time: 1.610135 Aug 24 10:44:11.934931 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2910/5471] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:44:10 2022] GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54 => generated 1368 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:44:12.379009 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bc6a9c8e-41d6-47b7-9c49-8487a8717447 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:12.404059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bc6a9c8e-41d6-47b7-9c49-8487a8717447 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:12.407782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bc6a9c8e-41d6-47b7-9c49-8487a8717447 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:12.410994 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bc6a9c8e-41d6-47b7-9c49-8487a8717447 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1729 microversion: 2.20 time: 1.198595 Aug 24 10:44:12.416178 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2562/5472] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:44:11 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1729 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:44:12.955674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7131c262-efc6-40c4-aedf-3bc0f014f7bb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:12.960920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7131c262-efc6-40c4-aedf-3bc0f014f7bb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: dbb7948c-1b98-4b05-9c70-d1a3e873fc54] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:12.982665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7131c262-efc6-40c4-aedf-3bc0f014f7bb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:12.983440 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7131c262-efc6-40c4-aedf-3bc0f014f7bb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:12.988097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7131c262-efc6-40c4-aedf-3bc0f014f7bb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:12.992196 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7131c262-efc6-40c4-aedf-3bc0f014f7bb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:12.993006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7131c262-efc6-40c4-aedf-3bc0f014f7bb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:12.993707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7131c262-efc6-40c4-aedf-3bc0f014f7bb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:13.444110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-af1b93cf-440f-4ec5-9eb0-6f92420be1dc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:13.444718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-af1b93cf-440f-4ec5-9eb0-6f92420be1dc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:13.457372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af1b93cf-440f-4ec5-9eb0-6f92420be1dc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:13.469746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af1b93cf-440f-4ec5-9eb0-6f92420be1dc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:13.470306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af1b93cf-440f-4ec5-9eb0-6f92420be1dc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:13.471337 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af1b93cf-440f-4ec5-9eb0-6f92420be1dc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:13.477837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af1b93cf-440f-4ec5-9eb0-6f92420be1dc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:13.481455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af1b93cf-440f-4ec5-9eb0-6f92420be1dc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:13.706038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7131c262-efc6-40c4-aedf-3bc0f014f7bb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:13.718336 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7131c262-efc6-40c4-aedf-3bc0f014f7bb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54" status: 200 len: 1368 microversion: 2.1 time: 0.766272 Aug 24 10:44:13.733566 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2911/5473] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:44:12 2022] GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54 => generated 1368 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:44:14.740843 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ce682774-7874-406e-a441-56a04d9fdf6d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:14.742889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ce682774-7874-406e-a441-56a04d9fdf6d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: dbb7948c-1b98-4b05-9c70-d1a3e873fc54] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:14.752881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce682774-7874-406e-a441-56a04d9fdf6d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:14.754032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce682774-7874-406e-a441-56a04d9fdf6d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:14.754832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce682774-7874-406e-a441-56a04d9fdf6d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:14.760599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce682774-7874-406e-a441-56a04d9fdf6d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:14.761486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce682774-7874-406e-a441-56a04d9fdf6d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:14.762158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce682774-7874-406e-a441-56a04d9fdf6d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:15.385626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ce682774-7874-406e-a441-56a04d9fdf6d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:15.403331 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ce682774-7874-406e-a441-56a04d9fdf6d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54" status: 200 len: 1557 microversion: 2.1 time: 0.666611 Aug 24 10:44:15.409712 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2912/5474] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:44:14 2022] GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54 => generated 1557 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:44:15.430892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-af1b93cf-440f-4ec5-9eb0-6f92420be1dc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:15.442384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3b194fc4-878e-4295-83ed-cc277b7761a4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:15.443744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3b194fc4-878e-4295-83ed-cc277b7761a4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: dbb7948c-1b98-4b05-9c70-d1a3e873fc54] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:15.464455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b194fc4-878e-4295-83ed-cc277b7761a4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:15.466139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b194fc4-878e-4295-83ed-cc277b7761a4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:15.469892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b194fc4-878e-4295-83ed-cc277b7761a4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:15.471654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b194fc4-878e-4295-83ed-cc277b7761a4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:15.473666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b194fc4-878e-4295-83ed-cc277b7761a4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:15.474121 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b194fc4-878e-4295-83ed-cc277b7761a4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:15.546165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-af1b93cf-440f-4ec5-9eb0-6f92420be1dc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:15.548957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-af1b93cf-440f-4ec5-9eb0-6f92420be1dc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:15.559811 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-af1b93cf-440f-4ec5-9eb0-6f92420be1dc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1729 microversion: 2.20 time: 2.118999 Aug 24 10:44:15.560643 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2563/5475] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:44:13 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1729 bytes in 2121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:44:15.767883 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3b194fc4-878e-4295-83ed-cc277b7761a4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.332200 Aug 24 10:44:15.768754 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2913/5476] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Aug 24 10:44:15 2022] GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54/os-interface => generated 284 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:44:16.599113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d7f89985-ea96-47ad-b2f2-3ef15720bf9d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:16.609547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d7f89985-ea96-47ad-b2f2-3ef15720bf9d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:16.651309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7f89985-ea96-47ad-b2f2-3ef15720bf9d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:16.652574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7f89985-ea96-47ad-b2f2-3ef15720bf9d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:16.654519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7f89985-ea96-47ad-b2f2-3ef15720bf9d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:16.661499 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7f89985-ea96-47ad-b2f2-3ef15720bf9d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:16.664132 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7f89985-ea96-47ad-b2f2-3ef15720bf9d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:16.669003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7f89985-ea96-47ad-b2f2-3ef15720bf9d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:17.277063 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:44:17.277725 n-d-849328-3 devstack@n-api.service[122433]: Wed Aug 24 10:44:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:44:18.032930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d7f89985-ea96-47ad-b2f2-3ef15720bf9d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:18.059532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d7f89985-ea96-47ad-b2f2-3ef15720bf9d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:18.066941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d7f89985-ea96-47ad-b2f2-3ef15720bf9d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:18.071516 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d7f89985-ea96-47ad-b2f2-3ef15720bf9d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1729 microversion: 2.20 time: 1.489419 Aug 24 10:44:18.074250 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2564/5477] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:44:16 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1729 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:44:19.108603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bed0b24f-dd40-4c5e-b66b-3243b2a332b4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:19.117829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bed0b24f-dd40-4c5e-b66b-3243b2a332b4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:19.140162 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bed0b24f-dd40-4c5e-b66b-3243b2a332b4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:19.140583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bed0b24f-dd40-4c5e-b66b-3243b2a332b4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:19.141041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bed0b24f-dd40-4c5e-b66b-3243b2a332b4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:19.150491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bed0b24f-dd40-4c5e-b66b-3243b2a332b4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:19.151370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bed0b24f-dd40-4c5e-b66b-3243b2a332b4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:19.152033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bed0b24f-dd40-4c5e-b66b-3243b2a332b4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:19.731258 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bed0b24f-dd40-4c5e-b66b-3243b2a332b4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:19.748528 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bed0b24f-dd40-4c5e-b66b-3243b2a332b4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:19.750399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bed0b24f-dd40-4c5e-b66b-3243b2a332b4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:19.751813 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bed0b24f-dd40-4c5e-b66b-3243b2a332b4 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1729 microversion: 2.20 time: 0.651405 Aug 24 10:44:19.775461 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2914/5478] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:44:19 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1729 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:44:20.790644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9065358e-7004-4f31-b4a2-310b64728a88 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:20.794447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9065358e-7004-4f31-b4a2-310b64728a88 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:20.828179 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9065358e-7004-4f31-b4a2-310b64728a88 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:20.829417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9065358e-7004-4f31-b4a2-310b64728a88 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:20.830362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9065358e-7004-4f31-b4a2-310b64728a88 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:20.831762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9065358e-7004-4f31-b4a2-310b64728a88 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:20.832751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9065358e-7004-4f31-b4a2-310b64728a88 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:20.833735 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9065358e-7004-4f31-b4a2-310b64728a88 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:21.474865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-e2754e23-d5f1-4304-bc7b-ec586898ee17 req-201b1e69-a9d7-455e-bc43-0311306096b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbb7948c-1b98-4b05-9c70-d1a3e873fc54", "tag": "a42b7e09-0862-4825-9be7-52d0f56fc209"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:44:21.527436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e2754e23-d5f1-4304-bc7b-ec586898ee17 req-201b1e69-a9d7-455e-bc43-0311306096b1 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:21.541984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e2754e23-d5f1-4304-bc7b-ec586898ee17 req-201b1e69-a9d7-455e-bc43-0311306096b1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:21.544550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e2754e23-d5f1-4304-bc7b-ec586898ee17 req-201b1e69-a9d7-455e-bc43-0311306096b1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:21.653569 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-e2754e23-d5f1-4304-bc7b-ec586898ee17 req-201b1e69-a9d7-455e-bc43-0311306096b1 service nova] Creating event network-changed:a42b7e09-0862-4825-9be7-52d0f56fc209 for instance dbb7948c-1b98-4b05-9c70-d1a3e873fc54 on n-h1-849328-3 Aug 24 10:44:21.692457 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-e2754e23-d5f1-4304-bc7b-ec586898ee17 req-201b1e69-a9d7-455e-bc43-0311306096b1 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.224264 Aug 24 10:44:21.695276 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2915/5479] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:44:21.800267 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9065358e-7004-4f31-b4a2-310b64728a88 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:21.858690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9065358e-7004-4f31-b4a2-310b64728a88 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:21.869196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9065358e-7004-4f31-b4a2-310b64728a88 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:21.882117 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9065358e-7004-4f31-b4a2-310b64728a88 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1729 microversion: 2.20 time: 1.097010 Aug 24 10:44:21.890046 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2565/5480] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:44:20 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1729 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:44:22.916925 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fbcb1b4f-ec93-456b-aa04-03305e510f30 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:22.918304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fbcb1b4f-ec93-456b-aa04-03305e510f30 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:22.932385 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbcb1b4f-ec93-456b-aa04-03305e510f30 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:22.935037 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbcb1b4f-ec93-456b-aa04-03305e510f30 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:22.935680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbcb1b4f-ec93-456b-aa04-03305e510f30 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:22.941078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbcb1b4f-ec93-456b-aa04-03305e510f30 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:22.941824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbcb1b4f-ec93-456b-aa04-03305e510f30 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:22.942479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbcb1b4f-ec93-456b-aa04-03305e510f30 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:23.652832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fbcb1b4f-ec93-456b-aa04-03305e510f30 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:23.670124 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fbcb1b4f-ec93-456b-aa04-03305e510f30 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:23.674705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fbcb1b4f-ec93-456b-aa04-03305e510f30 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:23.676355 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fbcb1b4f-ec93-456b-aa04-03305e510f30 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1729 microversion: 2.20 time: 0.764690 Aug 24 10:44:23.677497 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2916/5481] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:44:22 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1729 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:44:24.701299 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fbfa3215-46d5-4ad0-8112-a75e4694687d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:24.702075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fbfa3215-46d5-4ad0-8112-a75e4694687d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:24.715555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbfa3215-46d5-4ad0-8112-a75e4694687d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:24.719636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbfa3215-46d5-4ad0-8112-a75e4694687d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:24.720320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbfa3215-46d5-4ad0-8112-a75e4694687d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:24.721330 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbfa3215-46d5-4ad0-8112-a75e4694687d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:24.726296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbfa3215-46d5-4ad0-8112-a75e4694687d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:24.727165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbfa3215-46d5-4ad0-8112-a75e4694687d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:25.594059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fbfa3215-46d5-4ad0-8112-a75e4694687d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:25.603442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fbfa3215-46d5-4ad0-8112-a75e4694687d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:25.627498 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fbfa3215-46d5-4ad0-8112-a75e4694687d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:25.629537 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fbfa3215-46d5-4ad0-8112-a75e4694687d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1729 microversion: 2.20 time: 0.932894 Aug 24 10:44:25.638138 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2566/5482] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:44:24 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1729 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:44:26.662824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-36619514-a98d-4a52-81a7-334f77bfda6d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:26.663944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-36619514-a98d-4a52-81a7-334f77bfda6d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:26.685353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36619514-a98d-4a52-81a7-334f77bfda6d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:26.685874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36619514-a98d-4a52-81a7-334f77bfda6d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:26.686327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36619514-a98d-4a52-81a7-334f77bfda6d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:26.687062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36619514-a98d-4a52-81a7-334f77bfda6d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:26.697941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36619514-a98d-4a52-81a7-334f77bfda6d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:26.698955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36619514-a98d-4a52-81a7-334f77bfda6d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:27.501245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-36619514-a98d-4a52-81a7-334f77bfda6d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:27.522983 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-36619514-a98d-4a52-81a7-334f77bfda6d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:27.524545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-36619514-a98d-4a52-81a7-334f77bfda6d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:27.525858 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-36619514-a98d-4a52-81a7-334f77bfda6d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1729 microversion: 2.20 time: 0.867172 Aug 24 10:44:27.546315 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2917/5483] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:44:26 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1729 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:44:28.563304 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ba24065d-4092-42a4-b17d-abdc43a3f1ec tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:28.563999 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ba24065d-4092-42a4-b17d-abdc43a3f1ec tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:28.584222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba24065d-4092-42a4-b17d-abdc43a3f1ec tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:28.584947 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba24065d-4092-42a4-b17d-abdc43a3f1ec tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:28.585459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba24065d-4092-42a4-b17d-abdc43a3f1ec tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:28.586222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba24065d-4092-42a4-b17d-abdc43a3f1ec tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:28.586691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba24065d-4092-42a4-b17d-abdc43a3f1ec tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:28.587125 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba24065d-4092-42a4-b17d-abdc43a3f1ec tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:29.140741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ba24065d-4092-42a4-b17d-abdc43a3f1ec tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:29.153864 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ba24065d-4092-42a4-b17d-abdc43a3f1ec tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:29.161335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ba24065d-4092-42a4-b17d-abdc43a3f1ec tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:29.162632 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ba24065d-4092-42a4-b17d-abdc43a3f1ec tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1729 microversion: 2.20 time: 0.608372 Aug 24 10:44:29.177173 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2567/5484] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:44:28 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1729 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:44:30.196263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c267d135-14f8-4417-a111-2a220df89eb2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:30.198342 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c267d135-14f8-4417-a111-2a220df89eb2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:30.210726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:30.223140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c267d135-14f8-4417-a111-2a220df89eb2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:30.225544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c267d135-14f8-4417-a111-2a220df89eb2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:30.226004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c267d135-14f8-4417-a111-2a220df89eb2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:30.232149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c267d135-14f8-4417-a111-2a220df89eb2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:30.232844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c267d135-14f8-4417-a111-2a220df89eb2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:30.233511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c267d135-14f8-4417-a111-2a220df89eb2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:30.260725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:30.732370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c267d135-14f8-4417-a111-2a220df89eb2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:30.744666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c267d135-14f8-4417-a111-2a220df89eb2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:30.749926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c267d135-14f8-4417-a111-2a220df89eb2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:30.754120 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c267d135-14f8-4417-a111-2a220df89eb2 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1729 microversion: 2.20 time: 0.561846 Aug 24 10:44:30.762029 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2918/5485] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:44:30 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1729 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:44:31.788123 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-35ac47f7-4652-4261-bb9b-99d84c1e01cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:31.797817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-35ac47f7-4652-4261-bb9b-99d84c1e01cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:31.808793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35ac47f7-4652-4261-bb9b-99d84c1e01cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:31.815188 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35ac47f7-4652-4261-bb9b-99d84c1e01cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:31.817093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35ac47f7-4652-4261-bb9b-99d84c1e01cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:31.818011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35ac47f7-4652-4261-bb9b-99d84c1e01cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:31.820715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35ac47f7-4652-4261-bb9b-99d84c1e01cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:31.821310 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35ac47f7-4652-4261-bb9b-99d84c1e01cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:32.540158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-35ac47f7-4652-4261-bb9b-99d84c1e01cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:32.562019 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-35ac47f7-4652-4261-bb9b-99d84c1e01cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:32.570719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-35ac47f7-4652-4261-bb9b-99d84c1e01cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:32.572193 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-35ac47f7-4652-4261-bb9b-99d84c1e01cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1729 microversion: 2.20 time: 0.791762 Aug 24 10:44:32.578416 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2568/5486] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:44:31 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1729 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:44:33.379100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-aa85891a-dac1-4aab-8c0e-2917dff5c717 req-12b54991-5d4f-4d57-9da3-9483817e2d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc496b71-8fb7-4344-8642-53483cea796b", "name": "network-vif-plugged", "status": "completed", "tag": "30ffbeff-bf67-4d4a-8328-d554619bcd68"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:44:33.410818 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-aa85891a-dac1-4aab-8c0e-2917dff5c717 req-12b54991-5d4f-4d57-9da3-9483817e2d9c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:33.411029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-aa85891a-dac1-4aab-8c0e-2917dff5c717 req-12b54991-5d4f-4d57-9da3-9483817e2d9c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:33.411356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-aa85891a-dac1-4aab-8c0e-2917dff5c717 req-12b54991-5d4f-4d57-9da3-9483817e2d9c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:33.470781 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-aa85891a-dac1-4aab-8c0e-2917dff5c717 req-12b54991-5d4f-4d57-9da3-9483817e2d9c service nova] Creating event network-vif-plugged:30ffbeff-bf67-4d4a-8328-d554619bcd68 for instance cc496b71-8fb7-4344-8642-53483cea796b on n-h2-849328-3 Aug 24 10:44:33.512204 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-aa85891a-dac1-4aab-8c0e-2917dff5c717 req-12b54991-5d4f-4d57-9da3-9483817e2d9c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113033 Aug 24 10:44:33.520469 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2919/5487] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:44:33.602435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-80b6093c-b2bf-4231-9b4f-ac751ab10aa9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:33.602435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-80b6093c-b2bf-4231-9b4f-ac751ab10aa9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:33.615103 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80b6093c-b2bf-4231-9b4f-ac751ab10aa9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:33.623546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80b6093c-b2bf-4231-9b4f-ac751ab10aa9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:33.624451 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80b6093c-b2bf-4231-9b4f-ac751ab10aa9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:33.626043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80b6093c-b2bf-4231-9b4f-ac751ab10aa9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:33.630658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80b6093c-b2bf-4231-9b4f-ac751ab10aa9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:33.632226 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80b6093c-b2bf-4231-9b4f-ac751ab10aa9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:34.418332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-80b6093c-b2bf-4231-9b4f-ac751ab10aa9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:34.421503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=80 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:34.462666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-80b6093c-b2bf-4231-9b4f-ac751ab10aa9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:34.474385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-80b6093c-b2bf-4231-9b4f-ac751ab10aa9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:34.497844 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-80b6093c-b2bf-4231-9b4f-ac751ab10aa9 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1729 microversion: 2.20 time: 0.890674 Aug 24 10:44:34.508978 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2569/5488] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:44:33 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1729 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:44:35.047715 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9e43a402-a202-4560-a78b-1686ffb6201a tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-666754572", "availability_zone": "foo_zone"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:44:35.056357 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:44:35.056357 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:44:35.058259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.aggregate [None req-9e43a402-a202-4560-a78b-1686ffb6201a tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] Generated uuid 0e791057-599a-479d-91ad-080d08a31477 for aggregate {{(pid=122433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 10:44:35.131618 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9e43a402-a202-4560-a78b-1686ffb6201a tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.426374 Aug 24 10:44:35.132242 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2920/5489] 10.222.0.85 () {60 vars in 1164 bytes} [Wed Aug 24 10:44:34 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:44:35.144164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-54f89b03-3ea3-4ce6-aad1-c34722c862de tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:44:35.148369 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:44:35.148369 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:44:35.162998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=30 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:35.218671 n-d-849328-3 devstack@n-api.service[122432]: ERROR oslo.messaging._drivers.impl_rabbit [None req-54f89b03-3ea3-4ce6-aad1-c34722c862de tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] [71362138-cca8-4714-a2e3-8ecfd2f426c3] AMQP server on 10.222.0.85:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 10:44:35.533009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-22bf868f-0bf0-4198-be77-8456ee320a5d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:35.533858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-22bf868f-0bf0-4198-be77-8456ee320a5d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:35.543738 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22bf868f-0bf0-4198-be77-8456ee320a5d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:35.544491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22bf868f-0bf0-4198-be77-8456ee320a5d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:35.545169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22bf868f-0bf0-4198-be77-8456ee320a5d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:35.546102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22bf868f-0bf0-4198-be77-8456ee320a5d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:35.547194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22bf868f-0bf0-4198-be77-8456ee320a5d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:35.547721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22bf868f-0bf0-4198-be77-8456ee320a5d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:36.230518 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [None req-54f89b03-3ea3-4ce6-aad1-c34722c862de tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] [71362138-cca8-4714-a2e3-8ecfd2f426c3] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 33628. Aug 24 10:44:36.238509 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-54f89b03-3ea3-4ce6-aad1-c34722c862de tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 1.098265 Aug 24 10:44:36.240231 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2570/5490] 10.222.0.85 () {60 vars in 1194 bytes} [Wed Aug 24 10:44:35 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:44:36.265328 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b983098c-2366-4bff-be34-88d2e5ac8c4c tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:36.273714 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:44:36.273714 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:44:36.280061 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b983098c-2366-4bff-be34-88d2e5ac8c4c tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:36.281409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b983098c-2366-4bff-be34-88d2e5ac8c4c tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:36.284910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b983098c-2366-4bff-be34-88d2e5ac8c4c tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:36.291548 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b983098c-2366-4bff-be34-88d2e5ac8c4c tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:36.292333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b983098c-2366-4bff-be34-88d2e5ac8c4c tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:36.295070 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b983098c-2366-4bff-be34-88d2e5ac8c4c tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:36.414762 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b983098c-2366-4bff-be34-88d2e5ac8c4c tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] 10.222.0.85 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.165462 Aug 24 10:44:36.416137 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2571/5491] 10.222.0.85 () {58 vars in 1176 bytes} [Wed Aug 24 10:44:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:44:36.433792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4a67f3af-e00e-45d3-9af2-b79a02760391 tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:36.434940 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:44:36.434940 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:44:36.466758 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4a67f3af-e00e-45d3-9af2-b79a02760391 tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] 10.222.0.85 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.043055 Aug 24 10:44:36.472039 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2572/5492] 10.222.0.85 () {58 vars in 1143 bytes} [Wed Aug 24 10:44:36 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:44:36.503403 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0076fb40-a3d7-4f36-b6b5-09269009239f tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-849328-3"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:44:36.514704 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:44:36.514704 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:44:36.539200 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0076fb40-a3d7-4f36-b6b5-09269009239f tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:36.541868 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0076fb40-a3d7-4f36-b6b5-09269009239f tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:36.543719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0076fb40-a3d7-4f36-b6b5-09269009239f tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:37.203778 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0076fb40-a3d7-4f36-b6b5-09269009239f tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.712372 Aug 24 10:44:37.210830 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2573/5493] 10.222.0.85 () {60 vars in 1194 bytes} [Wed Aug 24 10:44:36 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:44:37.216115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-016e62d9-ef29-4597-ab0e-f969ea150e1d tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:37.216887 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:44:37.216887 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:44:37.232190 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-016e62d9-ef29-4597-ab0e-f969ea150e1d tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] 10.222.0.85 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.019799 Aug 24 10:44:37.239092 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2574/5494] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:44:37 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:44:37.247838 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-22bf868f-0bf0-4198-be77-8456ee320a5d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:37.249507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-db3b1fd3-2461-4a5a-a51b-434bbb819adc tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1260514264", "availability_zone": "foo_zone"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:44:37.257782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-22bf868f-0bf0-4198-be77-8456ee320a5d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:37.263485 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-22bf868f-0bf0-4198-be77-8456ee320a5d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:37.278791 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-22bf868f-0bf0-4198-be77-8456ee320a5d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1729 microversion: 2.20 time: 1.751133 Aug 24 10:44:37.280017 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2921/5495] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:44:35 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1729 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:44:37.526677 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:44:37.526677 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:44:37.636162 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-db3b1fd3-2461-4a5a-a51b-434bbb819adc tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] 10.222.0.85 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.395595 Aug 24 10:44:37.640206 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2575/5496] 10.222.0.85 () {60 vars in 1173 bytes} [Wed Aug 24 10:44:37 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:44:37.651115 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-64200077-9908-4c86-95d2-e0e1641400bb tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:44:37.653901 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:44:37.653901 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:44:37.709678 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-64200077-9908-4c86-95d2-e0e1641400bb tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.062418 Aug 24 10:44:37.710665 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2922/5497] 10.222.0.85 () {60 vars in 1194 bytes} [Wed Aug 24 10:44:37 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:44:37.722282 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-57bcb334-e2f8-4659-8892-abc51a1cb820 tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:37.723308 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:44:37.723308 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:44:37.739464 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-57bcb334-e2f8-4659-8892-abc51a1cb820 tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] 10.222.0.85 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.014963 Aug 24 10:44:37.746356 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2576/5498] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Aug 24 10:44:37 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:44:37.752459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8fe6c249-7ffb-4eb6-8f89-e196d8e3c059 tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-849328-3"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:44:37.755059 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:44:37.755059 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:44:37.772274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fe6c249-7ffb-4eb6-8f89-e196d8e3c059 tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:37.776675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fe6c249-7ffb-4eb6-8f89-e196d8e3c059 tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:37.777390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fe6c249-7ffb-4eb6-8f89-e196d8e3c059 tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:38.037489 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8fe6c249-7ffb-4eb6-8f89-e196d8e3c059 tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] 10.222.0.85 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.288693 Aug 24 10:44:38.038333 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2923/5499] 10.222.0.85 () {60 vars in 1194 bytes} [Wed Aug 24 10:44:37 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:44:38.049922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-80da9393-8eba-42a0-8ba0-0e7ec6253618 tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:38.050957 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:44:38.050957 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 10:44:38.112784 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-80da9393-8eba-42a0-8ba0-0e7ec6253618 tempest-TestAggregatesBasicOps-487679304 tempest-TestAggregatesBasicOps-487679304-project-admin] 10.222.0.85 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.065611 Aug 24 10:44:38.118606 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2577/5500] 10.222.0.85 () {58 vars in 1155 bytes} [Wed Aug 24 10:44:38 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 10:44:38.317321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9ea8c0e8-332c-4729-8087-e71414ada39d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:38.319401 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9ea8c0e8-332c-4729-8087-e71414ada39d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:38.349878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ea8c0e8-332c-4729-8087-e71414ada39d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:38.350868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ea8c0e8-332c-4729-8087-e71414ada39d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:38.351796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ea8c0e8-332c-4729-8087-e71414ada39d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:38.356198 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ea8c0e8-332c-4729-8087-e71414ada39d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:38.356959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ea8c0e8-332c-4729-8087-e71414ada39d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:38.372355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ea8c0e8-332c-4729-8087-e71414ada39d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:39.089785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9ea8c0e8-332c-4729-8087-e71414ada39d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:39.109522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9ea8c0e8-332c-4729-8087-e71414ada39d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:39.116212 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9ea8c0e8-332c-4729-8087-e71414ada39d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:39.120888 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9ea8c0e8-332c-4729-8087-e71414ada39d tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1716 microversion: 2.20 time: 0.811040 Aug 24 10:44:39.126653 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2924/5501] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:44:38 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1716 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:44:46.182157 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-69e68394-6687-4c42-b70e-4a30bd7ed05e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:46.183547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-69e68394-6687-4c42-b70e-4a30bd7ed05e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: dbb7948c-1b98-4b05-9c70-d1a3e873fc54] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:46.192522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69e68394-6687-4c42-b70e-4a30bd7ed05e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:46.195519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69e68394-6687-4c42-b70e-4a30bd7ed05e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:46.197755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69e68394-6687-4c42-b70e-4a30bd7ed05e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:46.199476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69e68394-6687-4c42-b70e-4a30bd7ed05e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:46.201631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69e68394-6687-4c42-b70e-4a30bd7ed05e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:46.203385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69e68394-6687-4c42-b70e-4a30bd7ed05e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:46.260308 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-69e68394-6687-4c42-b70e-4a30bd7ed05e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54/ips" status: 200 len: 149 microversion: 2.1 time: 0.081933 Aug 24 10:44:46.263511 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2578/5502] 10.222.0.85 () {58 vars in 1248 bytes} [Wed Aug 24 10:44:46 2022] GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54/ips => generated 149 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:44:46.277322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-00deeb49-193b-4b4c-984a-a4bcdd0a1db3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7bc2ef2a-aec7-4ead-9ad2-fc3351093f72"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:44:46.280139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-00deeb49-193b-4b4c-984a-a4bcdd0a1db3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: dbb7948c-1b98-4b05-9c70-d1a3e873fc54] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:46.299662 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00deeb49-193b-4b4c-984a-a4bcdd0a1db3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:46.300071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00deeb49-193b-4b4c-984a-a4bcdd0a1db3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:46.300522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00deeb49-193b-4b4c-984a-a4bcdd0a1db3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:46.301299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00deeb49-193b-4b4c-984a-a4bcdd0a1db3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:46.301775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00deeb49-193b-4b4c-984a-a4bcdd0a1db3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:46.302206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00deeb49-193b-4b4c-984a-a4bcdd0a1db3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:46.529346 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-00deeb49-193b-4b4c-984a-a4bcdd0a1db3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] HTTP exception thrown: Invalid volume: volume 7bc2ef2a-aec7-4ead-9ad2-fc3351093f72 is already attached to instances: b8cf649c-8f17-41ad-9ee6-f29dab1632d9 Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-00deeb49-193b-4b4c-984a-a4bcdd0a1db3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Request method failure captured: Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54/os-volume_attachments HTTP/1.1 Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 74 Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgBznQHNaOQSFLxoSWoCQ9hM_j0rDTvTqgGEXtOY5AvsNS3wnSnsKPq1brvowzVLm_09c1waLsJrFpihbXQ2I-pXEEbKWLH4qZhxSJfMM_hStgT1NZ8xcwJWs2OWbQyk15VS3tMTjbBVTyv_jiH5rZPFN41C1BDVpAXdNxiZaDgd17U Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 3cfd67239d3f4b7a89be1453a08c92ba Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3cfd67239d3f4b7a89be1453a08c92ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3cfd67239d3f4b7a89be1453a08c92ba", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3cfd67239d3f4b7a89be1453a08c92ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3cfd67239d3f4b7a89be1453a08c92ba"}]}] Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 3cfd67239d3f4b7a89be1453a08c92ba Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AttachVolumeNegativeTest-632701884-project Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: ff5172c17fae44e5839bd9b789e4c3a8 Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AttachVolumeNegativeTest-632701884-project Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: {"volumeAttachment": {"volumeId": "7bc2ef2a-aec7-4ead-9ad2-fc3351093f72"}} Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: exception: Invalid volume: volume 7bc2ef2a-aec7-4ead-9ad2-fc3351093f72 is already attached to instances: b8cf649c-8f17-41ad-9ee6-f29dab1632d9 Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'server_id': 'dbb7948c-1b98-4b05-9c70-d1a3e873fc54', 'body': {'volumeAttachment': {'volumeId': '7bc2ef2a-aec7-4ead-9ad2-fc3351093f72'}}} Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7bc2ef2a-aec7-4ead-9ad2-fc3351093f72 is already attached to instances: b8cf649c-8f17-41ad-9ee6-f29dab1632d9 Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:44:46.539140 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:44:46.544139 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:44:46.544139 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:44:46.544139 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 10:44:46.544139 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 10:44:46.544139 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7bc2ef2a-aec7-4ead-9ad2-fc3351093f72 is already attached to instances: b8cf649c-8f17-41ad-9ee6-f29dab1632d9 Aug 24 10:44:46.544139 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:44:46.544139 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:44:46.544139 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:44:46.544139 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:44:46.544139 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:44:46.544139 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:44:46.544139 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:44:46.544139 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:44:46.544139 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7bc2ef2a-aec7-4ead-9ad2-fc3351093f72 is already attached to instances: b8cf649c-8f17-41ad-9ee6-f29dab1632d9 Aug 24 10:44:46.544139 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:44:46.544139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-00deeb49-193b-4b4c-984a-a4bcdd0a1db3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Returning 400 to user: Invalid volume: volume 7bc2ef2a-aec7-4ead-9ad2-fc3351093f72 is already attached to instances: b8cf649c-8f17-41ad-9ee6-f29dab1632d9 {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:44:46.544139 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-00deeb49-193b-4b4c-984a-a4bcdd0a1db3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "POST /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.269464 Aug 24 10:44:46.544139 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2925/5503] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Aug 24 10:44:46 2022] POST /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54/os-volume_attachments => generated 174 bytes in 271 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:44:46.550892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8be6c301-7a3d-4f61-85c6-2edac6f56b7c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:46.553916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8be6c301-7a3d-4f61-85c6-2edac6f56b7c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: dbb7948c-1b98-4b05-9c70-d1a3e873fc54] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:46.556802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:46.565852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8be6c301-7a3d-4f61-85c6-2edac6f56b7c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:46.566577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8be6c301-7a3d-4f61-85c6-2edac6f56b7c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:46.567186 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8be6c301-7a3d-4f61-85c6-2edac6f56b7c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:46.568106 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8be6c301-7a3d-4f61-85c6-2edac6f56b7c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:46.568727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8be6c301-7a3d-4f61-85c6-2edac6f56b7c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:46.569351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8be6c301-7a3d-4f61-85c6-2edac6f56b7c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:46.616847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8be6c301-7a3d-4f61-85c6-2edac6f56b7c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: dbb7948c-1b98-4b05-9c70-d1a3e873fc54] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:44:46.752150 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8be6c301-7a3d-4f61-85c6-2edac6f56b7c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "DELETE /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54" status: 204 len: 0 microversion: 2.1 time: 0.205446 Aug 24 10:44:46.753108 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2579/5504] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:44:46 2022] DELETE /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:44:46.761932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-270173da-1efb-472b-a38a-dd81bb22266e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:46.762753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-270173da-1efb-472b-a38a-dd81bb22266e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: dbb7948c-1b98-4b05-9c70-d1a3e873fc54] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:46.773471 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-270173da-1efb-472b-a38a-dd81bb22266e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:46.773977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-270173da-1efb-472b-a38a-dd81bb22266e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:46.774422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-270173da-1efb-472b-a38a-dd81bb22266e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:46.775162 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-270173da-1efb-472b-a38a-dd81bb22266e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:46.775624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-270173da-1efb-472b-a38a-dd81bb22266e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:46.776112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-270173da-1efb-472b-a38a-dd81bb22266e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:47.296456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-270173da-1efb-472b-a38a-dd81bb22266e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:47.334026 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-270173da-1efb-472b-a38a-dd81bb22266e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54" status: 200 len: 1682 microversion: 2.1 time: 0.550978 Aug 24 10:44:47.334026 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2926/5505] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:44:46 2022] GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54 => generated 1682 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:44:48.355820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-addd9542-8d1f-4194-a01d-a8fbc7ac5097 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:48.361045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-addd9542-8d1f-4194-a01d-a8fbc7ac5097 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: dbb7948c-1b98-4b05-9c70-d1a3e873fc54] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:48.380715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-addd9542-8d1f-4194-a01d-a8fbc7ac5097 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:48.382372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-addd9542-8d1f-4194-a01d-a8fbc7ac5097 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:48.383646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-addd9542-8d1f-4194-a01d-a8fbc7ac5097 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:48.384632 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-addd9542-8d1f-4194-a01d-a8fbc7ac5097 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:48.389343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-addd9542-8d1f-4194-a01d-a8fbc7ac5097 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:48.395144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-addd9542-8d1f-4194-a01d-a8fbc7ac5097 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:48.892124 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-addd9542-8d1f-4194-a01d-a8fbc7ac5097 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:48.906046 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-addd9542-8d1f-4194-a01d-a8fbc7ac5097 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54" status: 200 len: 1682 microversion: 2.1 time: 0.561503 Aug 24 10:44:48.931248 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2580/5506] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:44:48 2022] GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54 => generated 1682 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:44:49.927915 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0cd5ef70-1c49-4f46-bfc9-a8f32ed1042d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:49.928532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0cd5ef70-1c49-4f46-bfc9-a8f32ed1042d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: dbb7948c-1b98-4b05-9c70-d1a3e873fc54] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:49.939347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cd5ef70-1c49-4f46-bfc9-a8f32ed1042d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:49.939844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cd5ef70-1c49-4f46-bfc9-a8f32ed1042d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:49.940282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cd5ef70-1c49-4f46-bfc9-a8f32ed1042d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:49.940993 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cd5ef70-1c49-4f46-bfc9-a8f32ed1042d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:49.947275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cd5ef70-1c49-4f46-bfc9-a8f32ed1042d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:49.947486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cd5ef70-1c49-4f46-bfc9-a8f32ed1042d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:50.434908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0cd5ef70-1c49-4f46-bfc9-a8f32ed1042d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:50.445272 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0cd5ef70-1c49-4f46-bfc9-a8f32ed1042d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54" status: 200 len: 1682 microversion: 2.1 time: 0.520382 Aug 24 10:44:50.446469 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2927/5507] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:44:49 2022] GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54 => generated 1682 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:44:51.469763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-de0dfc08-3d3d-457e-b5ff-ab74c673cc32 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:51.470389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-de0dfc08-3d3d-457e-b5ff-ab74c673cc32 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: dbb7948c-1b98-4b05-9c70-d1a3e873fc54] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:51.486329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de0dfc08-3d3d-457e-b5ff-ab74c673cc32 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:51.498836 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de0dfc08-3d3d-457e-b5ff-ab74c673cc32 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:51.499270 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de0dfc08-3d3d-457e-b5ff-ab74c673cc32 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:51.500068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de0dfc08-3d3d-457e-b5ff-ab74c673cc32 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:51.500546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de0dfc08-3d3d-457e-b5ff-ab74c673cc32 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:51.500980 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de0dfc08-3d3d-457e-b5ff-ab74c673cc32 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:51.712642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-de0dfc08-3d3d-457e-b5ff-ab74c673cc32 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:44:51.718001 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0d2e0c7a-62ad-4dd6-8dad-a56394cdfa81 req-c9c3a0c8-38db-4c67-9136-9a1d32903071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbb7948c-1b98-4b05-9c70-d1a3e873fc54", "name": "network-vif-deleted", "tag": "a42b7e09-0862-4825-9be7-52d0f56fc209"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:44:51.721998 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-de0dfc08-3d3d-457e-b5ff-ab74c673cc32 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54" status: 200 len: 1614 microversion: 2.1 time: 0.257216 Aug 24 10:44:51.737334 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2581/5508] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:44:51 2022] GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54 => generated 1614 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:44:51.777022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0d2e0c7a-62ad-4dd6-8dad-a56394cdfa81 req-c9c3a0c8-38db-4c67-9136-9a1d32903071 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:51.777999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0d2e0c7a-62ad-4dd6-8dad-a56394cdfa81 req-c9c3a0c8-38db-4c67-9136-9a1d32903071 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:51.778789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0d2e0c7a-62ad-4dd6-8dad-a56394cdfa81 req-c9c3a0c8-38db-4c67-9136-9a1d32903071 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:51.795308 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0d2e0c7a-62ad-4dd6-8dad-a56394cdfa81 req-c9c3a0c8-38db-4c67-9136-9a1d32903071 service nova] Creating event network-vif-deleted:a42b7e09-0862-4825-9be7-52d0f56fc209 for instance dbb7948c-1b98-4b05-9c70-d1a3e873fc54 on n-h1-849328-3 Aug 24 10:44:51.802966 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0d2e0c7a-62ad-4dd6-8dad-a56394cdfa81 req-c9c3a0c8-38db-4c67-9136-9a1d32903071 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093887 Aug 24 10:44:51.804238 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2928/5509] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:44:52.748481 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-30a2ad92-95ff-49ea-9d2b-0bd79444a618 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:52.749146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-30a2ad92-95ff-49ea-9d2b-0bd79444a618 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: dbb7948c-1b98-4b05-9c70-d1a3e873fc54] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:52.765880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30a2ad92-95ff-49ea-9d2b-0bd79444a618 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:52.767736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30a2ad92-95ff-49ea-9d2b-0bd79444a618 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:52.771349 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30a2ad92-95ff-49ea-9d2b-0bd79444a618 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:52.773074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30a2ad92-95ff-49ea-9d2b-0bd79444a618 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:52.777326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30a2ad92-95ff-49ea-9d2b-0bd79444a618 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:52.778751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30a2ad92-95ff-49ea-9d2b-0bd79444a618 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:52.820203 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-30a2ad92-95ff-49ea-9d2b-0bd79444a618 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] HTTP exception thrown: Instance dbb7948c-1b98-4b05-9c70-d1a3e873fc54 could not be found. Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-30a2ad92-95ff-49ea-9d2b-0bd79444a618 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Request method failure captured: Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54 HTTP/1.1 Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgBznQHNaOQSFLxoSWoCQ9hM_j0rDTvTqgGEXtOY5AvsNS3wnSnsKPq1brvowzVLm_09c1waLsJrFpihbXQ2I-pXEEbKWLH4qZhxSJfMM_hStgT1NZ8xcwJWs2OWbQyk15VS3tMTjbBVTyv_jiH5rZPFN41C1BDVpAXdNxiZaDgd17U Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 3cfd67239d3f4b7a89be1453a08c92ba Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3cfd67239d3f4b7a89be1453a08c92ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3cfd67239d3f4b7a89be1453a08c92ba", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3cfd67239d3f4b7a89be1453a08c92ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3cfd67239d3f4b7a89be1453a08c92ba"}]}] Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 3cfd67239d3f4b7a89be1453a08c92ba Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-AttachVolumeNegativeTest-632701884-project Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: ff5172c17fae44e5839bd9b789e4c3a8 Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-AttachVolumeNegativeTest-632701884-project Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance dbb7948c-1b98-4b05-9c70-d1a3e873fc54 could not be found. Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'dbb7948c-1b98-4b05-9c70-d1a3e873fc54'} Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbb7948c-1b98-4b05-9c70-d1a3e873fc54 could not be found. Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbb7948c-1b98-4b05-9c70-d1a3e873fc54 could not be found. Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:44:52.833622 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:44:52.837606 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:44:52.837606 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:44:52.837606 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:44:52.837606 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:44:52.837606 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:44:52.837606 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbb7948c-1b98-4b05-9c70-d1a3e873fc54 could not be found. Aug 24 10:44:52.837606 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:44:52.840795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-30a2ad92-95ff-49ea-9d2b-0bd79444a618 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Returning 404 to user: Instance dbb7948c-1b98-4b05-9c70-d1a3e873fc54 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:44:52.843345 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-30a2ad92-95ff-49ea-9d2b-0bd79444a618 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54" status: 404 len: 111 microversion: 2.1 time: 0.104164 Aug 24 10:44:52.845203 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2582/5510] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:44:52 2022] GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:44:52.857024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0e38f665-ca96-4a56-864e-6b92ff8a0ecd tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '.version_select at 0x7f46479725e0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:52.904810 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0e38f665-ca96-4a56-864e-6b92ff8a0ecd tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006638020" status: 202 len: 0 microversion: 2.1 time: 0.053652 Aug 24 10:44:52.907956 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2929/5511] 10.222.0.85 () {58 vars in 1221 bytes} [Wed Aug 24 10:44:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006638020 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:44:55.376617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5a2d1757-4a25-430e-abdd-eed473b528a9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:55.377857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5a2d1757-4a25-430e-abdd-eed473b528a9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:55.386093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a2d1757-4a25-430e-abdd-eed473b528a9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:55.387187 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a2d1757-4a25-430e-abdd-eed473b528a9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:55.387630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a2d1757-4a25-430e-abdd-eed473b528a9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:55.388457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a2d1757-4a25-430e-abdd-eed473b528a9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:55.388890 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a2d1757-4a25-430e-abdd-eed473b528a9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:55.389622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a2d1757-4a25-430e-abdd-eed473b528a9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:55.522839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-5a2d1757-4a25-430e-abdd-eed473b528a9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lazy-loading 'services' on Instance uuid b8cf649c-8f17-41ad-9ee6-f29dab1632d9 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:44:55.625708 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5a2d1757-4a25-430e-abdd-eed473b528a9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9/os-volume_attachments/7bc2ef2a-aec7-4ead-9ad2-fc3351093f72" status: 202 len: 0 microversion: 2.1 time: 0.253356 Aug 24 10:44:55.630994 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2583/5512] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Aug 24 10:44:55 2022] DELETE /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9/os-volume_attachments/7bc2ef2a-aec7-4ead-9ad2-fc3351093f72 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:44:55.646183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-778f7679-d399-4444-ad79-320b3ca49503 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:55.655876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-778f7679-d399-4444-ad79-320b3ca49503 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:55.675969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-778f7679-d399-4444-ad79-320b3ca49503 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:55.677421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-778f7679-d399-4444-ad79-320b3ca49503 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:55.678922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-778f7679-d399-4444-ad79-320b3ca49503 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:55.680511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-778f7679-d399-4444-ad79-320b3ca49503 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:55.685316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-778f7679-d399-4444-ad79-320b3ca49503 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:55.686284 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-778f7679-d399-4444-ad79-320b3ca49503 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:55.778667 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-778f7679-d399-4444-ad79-320b3ca49503 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138385 Aug 24 10:44:55.785591 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2930/5513] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:44:55 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:44:56.815939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-59ed1aad-798a-409c-a24b-b4a085839c5a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:56.835260 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-59ed1aad-798a-409c-a24b-b4a085839c5a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:56.856513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59ed1aad-798a-409c-a24b-b4a085839c5a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:56.858292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59ed1aad-798a-409c-a24b-b4a085839c5a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:56.861045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59ed1aad-798a-409c-a24b-b4a085839c5a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:56.864006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59ed1aad-798a-409c-a24b-b4a085839c5a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:56.866178 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59ed1aad-798a-409c-a24b-b4a085839c5a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:56.868189 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59ed1aad-798a-409c-a24b-b4a085839c5a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:56.976256 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-59ed1aad-798a-409c-a24b-b4a085839c5a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172268 Aug 24 10:44:56.977491 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2584/5514] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:44:56 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:44:57.990109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1746d4db-92d8-4b0b-ad23-44fbf5c1f028 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:57.992424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1746d4db-92d8-4b0b-ad23-44fbf5c1f028 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:58.009202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1746d4db-92d8-4b0b-ad23-44fbf5c1f028 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:58.009709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1746d4db-92d8-4b0b-ad23-44fbf5c1f028 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:58.018993 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1746d4db-92d8-4b0b-ad23-44fbf5c1f028 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:58.021501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1746d4db-92d8-4b0b-ad23-44fbf5c1f028 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:58.025750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1746d4db-92d8-4b0b-ad23-44fbf5c1f028 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:58.026290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1746d4db-92d8-4b0b-ad23-44fbf5c1f028 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:58.122854 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1746d4db-92d8-4b0b-ad23-44fbf5c1f028 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137676 Aug 24 10:44:58.127378 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2931/5515] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:44:57 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:44:59.140340 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df9c4b49-b320-4937-87ec-2e519c4f3ca2 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:44:59.143016 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-df9c4b49-b320-4937-87ec-2e519c4f3ca2 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:44:59.158335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df9c4b49-b320-4937-87ec-2e519c4f3ca2 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:59.158745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df9c4b49-b320-4937-87ec-2e519c4f3ca2 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:59.159386 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df9c4b49-b320-4937-87ec-2e519c4f3ca2 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:59.162850 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df9c4b49-b320-4937-87ec-2e519c4f3ca2 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:44:59.163681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df9c4b49-b320-4937-87ec-2e519c4f3ca2 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:44:59.164333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df9c4b49-b320-4937-87ec-2e519c4f3ca2 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:44:59.229057 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-df9c4b49-b320-4937-87ec-2e519c4f3ca2 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094076 Aug 24 10:44:59.234674 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2585/5516] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:44:59 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:45:00.253699 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-54d37b26-5d1d-4853-8e86-7d166f5f8b34 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:00.257469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-54d37b26-5d1d-4853-8e86-7d166f5f8b34 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:00.281335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:00.287612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54d37b26-5d1d-4853-8e86-7d166f5f8b34 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:00.288810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54d37b26-5d1d-4853-8e86-7d166f5f8b34 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:00.290573 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54d37b26-5d1d-4853-8e86-7d166f5f8b34 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:00.294381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54d37b26-5d1d-4853-8e86-7d166f5f8b34 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:00.295233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54d37b26-5d1d-4853-8e86-7d166f5f8b34 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:00.298150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54d37b26-5d1d-4853-8e86-7d166f5f8b34 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:00.308720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=56 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:00.371694 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-54d37b26-5d1d-4853-8e86-7d166f5f8b34 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127516 Aug 24 10:45:00.373103 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2932/5517] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:45:00 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:45:01.384704 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-53862bdb-af4d-4c15-bf8d-9f2f35ba3656 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:01.387511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-53862bdb-af4d-4c15-bf8d-9f2f35ba3656 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:01.401150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53862bdb-af4d-4c15-bf8d-9f2f35ba3656 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:01.406685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53862bdb-af4d-4c15-bf8d-9f2f35ba3656 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:01.407712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53862bdb-af4d-4c15-bf8d-9f2f35ba3656 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:01.409060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53862bdb-af4d-4c15-bf8d-9f2f35ba3656 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:01.409565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53862bdb-af4d-4c15-bf8d-9f2f35ba3656 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:01.409993 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53862bdb-af4d-4c15-bf8d-9f2f35ba3656 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:01.487172 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-53862bdb-af4d-4c15-bf8d-9f2f35ba3656 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106879 Aug 24 10:45:01.490403 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2586/5518] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:45:01 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:45:02.504301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a6426d84-a9b9-4e21-a877-602eb23ef4c8 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:02.506874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a6426d84-a9b9-4e21-a877-602eb23ef4c8 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:02.514740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6426d84-a9b9-4e21-a877-602eb23ef4c8 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:02.514740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6426d84-a9b9-4e21-a877-602eb23ef4c8 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:02.514740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6426d84-a9b9-4e21-a877-602eb23ef4c8 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:02.515171 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6426d84-a9b9-4e21-a877-602eb23ef4c8 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:02.515487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6426d84-a9b9-4e21-a877-602eb23ef4c8 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:02.516172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6426d84-a9b9-4e21-a877-602eb23ef4c8 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:02.579644 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a6426d84-a9b9-4e21-a877-602eb23ef4c8 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081087 Aug 24 10:45:02.580322 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2933/5519] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:45:02 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:45:03.603880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-794e50b1-2c3e-4bbb-9345-f89eac41f29f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:03.606154 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-794e50b1-2c3e-4bbb-9345-f89eac41f29f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:03.619233 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-794e50b1-2c3e-4bbb-9345-f89eac41f29f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:03.620484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-794e50b1-2c3e-4bbb-9345-f89eac41f29f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:03.621379 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-794e50b1-2c3e-4bbb-9345-f89eac41f29f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:03.622722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-794e50b1-2c3e-4bbb-9345-f89eac41f29f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:03.623393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-794e50b1-2c3e-4bbb-9345-f89eac41f29f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:03.624018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-794e50b1-2c3e-4bbb-9345-f89eac41f29f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:03.661225 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-794e50b1-2c3e-4bbb-9345-f89eac41f29f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070489 Aug 24 10:45:03.663667 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2587/5520] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:45:03 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:45:04.678364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-57af1c36-b6b8-48e5-a99b-436639ff5fd4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:04.682043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-57af1c36-b6b8-48e5-a99b-436639ff5fd4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:04.690952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57af1c36-b6b8-48e5-a99b-436639ff5fd4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:04.691858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57af1c36-b6b8-48e5-a99b-436639ff5fd4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:04.693023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57af1c36-b6b8-48e5-a99b-436639ff5fd4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:04.694034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57af1c36-b6b8-48e5-a99b-436639ff5fd4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:04.694756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57af1c36-b6b8-48e5-a99b-436639ff5fd4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:04.695399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57af1c36-b6b8-48e5-a99b-436639ff5fd4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:04.729059 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-57af1c36-b6b8-48e5-a99b-436639ff5fd4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055575 Aug 24 10:45:04.730390 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2934/5521] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:45:04 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:45:04.847295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-542cb41c-8522-4c32-b094-fb2647ac25f0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:04.848462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-542cb41c-8522-4c32-b094-fb2647ac25f0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:04.876452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-542cb41c-8522-4c32-b094-fb2647ac25f0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:04.878577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-542cb41c-8522-4c32-b094-fb2647ac25f0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:04.879228 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-542cb41c-8522-4c32-b094-fb2647ac25f0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:04.880973 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-542cb41c-8522-4c32-b094-fb2647ac25f0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:04.886108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-542cb41c-8522-4c32-b094-fb2647ac25f0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:04.887193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-542cb41c-8522-4c32-b094-fb2647ac25f0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:04.893339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:05.071399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-542cb41c-8522-4c32-b094-fb2647ac25f0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:45:05.247801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=2,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:05.316498 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-542cb41c-8522-4c32-b094-fb2647ac25f0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9" status: 204 len: 0 microversion: 2.1 time: 0.473521 Aug 24 10:45:05.323324 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2588/5522] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:45:04 2022] DELETE /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:45:05.332821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e1e54a46-a8e1-41f5-8150-0f5a87adfcd4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:05.334747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e1e54a46-a8e1-41f5-8150-0f5a87adfcd4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:05.348035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1e54a46-a8e1-41f5-8150-0f5a87adfcd4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:05.348864 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1e54a46-a8e1-41f5-8150-0f5a87adfcd4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:05.349799 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1e54a46-a8e1-41f5-8150-0f5a87adfcd4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:05.351219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1e54a46-a8e1-41f5-8150-0f5a87adfcd4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:05.352014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1e54a46-a8e1-41f5-8150-0f5a87adfcd4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:05.352727 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1e54a46-a8e1-41f5-8150-0f5a87adfcd4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:05.767793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e1e54a46-a8e1-41f5-8150-0f5a87adfcd4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:05.780945 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e1e54a46-a8e1-41f5-8150-0f5a87adfcd4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9" status: 200 len: 1682 microversion: 2.1 time: 0.455304 Aug 24 10:45:05.780945 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2935/5523] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:45:05 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9 => generated 1682 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:45:06.825961 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a4a914bb-b8d7-47ae-89e1-dbfab0691197 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:06.830807 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a4a914bb-b8d7-47ae-89e1-dbfab0691197 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:06.848990 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4a914bb-b8d7-47ae-89e1-dbfab0691197 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:06.855253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4a914bb-b8d7-47ae-89e1-dbfab0691197 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:06.858247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4a914bb-b8d7-47ae-89e1-dbfab0691197 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:06.859291 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4a914bb-b8d7-47ae-89e1-dbfab0691197 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:06.863477 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4a914bb-b8d7-47ae-89e1-dbfab0691197 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:06.866100 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4a914bb-b8d7-47ae-89e1-dbfab0691197 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:07.311685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a4a914bb-b8d7-47ae-89e1-dbfab0691197 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:07.332296 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a4a914bb-b8d7-47ae-89e1-dbfab0691197 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9" status: 200 len: 1682 microversion: 2.1 time: 0.515302 Aug 24 10:45:07.333774 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2589/5524] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:45:06 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9 => generated 1682 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:45:08.364280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-08c25691-a710-4207-8f3f-e63508eeafa0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:08.372031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-08c25691-a710-4207-8f3f-e63508eeafa0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:08.394054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08c25691-a710-4207-8f3f-e63508eeafa0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:08.397812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08c25691-a710-4207-8f3f-e63508eeafa0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:08.398457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08c25691-a710-4207-8f3f-e63508eeafa0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:08.401894 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08c25691-a710-4207-8f3f-e63508eeafa0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:08.402390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08c25691-a710-4207-8f3f-e63508eeafa0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:08.406357 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08c25691-a710-4207-8f3f-e63508eeafa0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:08.559987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-08c25691-a710-4207-8f3f-e63508eeafa0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:08.585315 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-08c25691-a710-4207-8f3f-e63508eeafa0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9" status: 200 len: 1614 microversion: 2.1 time: 0.227772 Aug 24 10:45:08.587157 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2936/5525] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:45:08 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9 => generated 1614 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:45:08.773815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-424e4571-7d9b-4b97-9d20-ca5cd36f6a89 req-0b52376f-b063-4a81-b0d6-4fa52156b100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8cf649c-8f17-41ad-9ee6-f29dab1632d9", "name": "network-vif-deleted", "tag": "468840d9-6087-422e-b470-dfedc8e5e328"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:45:08.813691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-424e4571-7d9b-4b97-9d20-ca5cd36f6a89 req-0b52376f-b063-4a81-b0d6-4fa52156b100 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:08.814402 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-424e4571-7d9b-4b97-9d20-ca5cd36f6a89 req-0b52376f-b063-4a81-b0d6-4fa52156b100 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:08.814856 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-424e4571-7d9b-4b97-9d20-ca5cd36f6a89 req-0b52376f-b063-4a81-b0d6-4fa52156b100 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:08.847509 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-424e4571-7d9b-4b97-9d20-ca5cd36f6a89 req-0b52376f-b063-4a81-b0d6-4fa52156b100 service nova] Creating event network-vif-deleted:468840d9-6087-422e-b470-dfedc8e5e328 for instance b8cf649c-8f17-41ad-9ee6-f29dab1632d9 on n-h2-849328-3 Aug 24 10:45:08.854947 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-424e4571-7d9b-4b97-9d20-ca5cd36f6a89 req-0b52376f-b063-4a81-b0d6-4fa52156b100 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092415 Aug 24 10:45:08.860011 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2590/5526] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:45:09.617165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-817c286c-b537-4715-9c60-b37c43fe530e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:09.618630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-817c286c-b537-4715-9c60-b37c43fe530e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:09.677668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-817c286c-b537-4715-9c60-b37c43fe530e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:09.679910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-817c286c-b537-4715-9c60-b37c43fe530e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:09.681747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-817c286c-b537-4715-9c60-b37c43fe530e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:09.685406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-817c286c-b537-4715-9c60-b37c43fe530e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:09.686195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-817c286c-b537-4715-9c60-b37c43fe530e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:09.686835 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-817c286c-b537-4715-9c60-b37c43fe530e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:09.722402 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-817c286c-b537-4715-9c60-b37c43fe530e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] HTTP exception thrown: Instance b8cf649c-8f17-41ad-9ee6-f29dab1632d9 could not be found. Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-817c286c-b537-4715-9c60-b37c43fe530e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Request method failure captured: Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9 HTTP/1.1 Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgBznQHNaOQSFLxoSWoCQ9hM_j0rDTvTqgGEXtOY5AvsNS3wnSnsKPq1brvowzVLm_09c1waLsJrFpihbXQ2I-pXEEbKWLH4qZhxSJfMM_hStgT1NZ8xcwJWs2OWbQyk15VS3tMTjbBVTyv_jiH5rZPFN41C1BDVpAXdNxiZaDgd17U Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 3cfd67239d3f4b7a89be1453a08c92ba Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3cfd67239d3f4b7a89be1453a08c92ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3cfd67239d3f4b7a89be1453a08c92ba", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3cfd67239d3f4b7a89be1453a08c92ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3cfd67239d3f4b7a89be1453a08c92ba"}]}] Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 3cfd67239d3f4b7a89be1453a08c92ba Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AttachVolumeNegativeTest-632701884-project Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: ff5172c17fae44e5839bd9b789e4c3a8 Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AttachVolumeNegativeTest-632701884-project Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance b8cf649c-8f17-41ad-9ee6-f29dab1632d9 could not be found. Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'b8cf649c-8f17-41ad-9ee6-f29dab1632d9'} Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8cf649c-8f17-41ad-9ee6-f29dab1632d9 could not be found. Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8cf649c-8f17-41ad-9ee6-f29dab1632d9 could not be found. Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:45:09.724184 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:45:09.730484 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:45:09.730484 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:45:09.730484 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:45:09.730484 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:45:09.730484 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:45:09.730484 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8cf649c-8f17-41ad-9ee6-f29dab1632d9 could not be found. Aug 24 10:45:09.730484 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:45:09.730484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-817c286c-b537-4715-9c60-b37c43fe530e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Returning 404 to user: Instance b8cf649c-8f17-41ad-9ee6-f29dab1632d9 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:45:09.730484 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-817c286c-b537-4715-9c60-b37c43fe530e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9" status: 404 len: 111 microversion: 2.1 time: 0.120478 Aug 24 10:45:09.735754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7aba7e96-5b47-4428-ad0e-a2f2da6aa679 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '.version_select at 0x7f465410c550>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:09.738802 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2937/5527] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:45:09 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:45:09.829006 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7aba7e96-5b47-4428-ad0e-a2f2da6aa679 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1851647544" status: 202 len: 0 microversion: 2.1 time: 0.097750 Aug 24 10:45:09.835789 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2591/5528] 10.222.0.85 () {58 vars in 1221 bytes} [Wed Aug 24 10:45:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1851647544 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:45:11.446470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f861f085-5436-4a7d-b753-a351d54660e3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Action: 'create', calling method: .version_select at 0x7f4647a204c0>, body: {"keypair": {"name": "tempest-keypair-1162018293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCE/BE9Z1ses30d2A7jObUQbUeOVvGotOCFE6L8IrzTAHihoUBSZXmk6Lcd/Rlk8+HEF3DhMgJf53KiU4eqkSz+JyoqbyEdJaBEqxpfwdRrPsylnS1L6Vqz2R72LFNkPg=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:45:11.551473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f861f085-5436-4a7d-b753-a351d54660e3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Getting quotas for project 3cfd67239d3f4b7a89be1453a08c92ba. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:45:11.569824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f861f085-5436-4a7d-b753-a351d54660e3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Getting quotas for user ff5172c17fae44e5839bd9b789e4c3a8 and project 3cfd67239d3f4b7a89be1453a08c92ba. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:45:11.623176 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f861f085-5436-4a7d-b753-a351d54660e3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.184250 Aug 24 10:45:11.629243 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2938/5529] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:45:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:45:11.970335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-60cc91b4-0e35-4da7-86be-9306922173cb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:11.974151 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-60cc91b4-0e35-4da7-86be-9306922173cb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:11.992926 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60cc91b4-0e35-4da7-86be-9306922173cb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:11.993680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60cc91b4-0e35-4da7-86be-9306922173cb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:11.995297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60cc91b4-0e35-4da7-86be-9306922173cb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:11.996076 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60cc91b4-0e35-4da7-86be-9306922173cb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:11.996553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60cc91b4-0e35-4da7-86be-9306922173cb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:11.996986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60cc91b4-0e35-4da7-86be-9306922173cb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:12.081549 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-60cc91b4-0e35-4da7-86be-9306922173cb tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.115021 Aug 24 10:45:12.083490 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2592/5530] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Aug 24 10:45:11 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b/os-volume_attachments => generated 25 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:45:12.220642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5a970fe7-6a19-4f60-9f22-4c29083f560b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:12.221903 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5a970fe7-6a19-4f60-9f22-4c29083f560b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:12.233404 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a970fe7-6a19-4f60-9f22-4c29083f560b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:12.234182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a970fe7-6a19-4f60-9f22-4c29083f560b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:12.234859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a970fe7-6a19-4f60-9f22-4c29083f560b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:12.235994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a970fe7-6a19-4f60-9f22-4c29083f560b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:12.249069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a970fe7-6a19-4f60-9f22-4c29083f560b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:12.250380 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a970fe7-6a19-4f60-9f22-4c29083f560b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:12.306687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5a970fe7-6a19-4f60-9f22-4c29083f560b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:45:12.462727 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5a970fe7-6a19-4f60-9f22-4c29083f560b tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "DELETE /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 204 len: 0 microversion: 2.20 time: 0.246599 Aug 24 10:45:12.464640 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2939/5531] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:45:12 2022] DELETE /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:45:12.476665 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-95cf5d96-2edc-4816-80c3-71e18d10ac4f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:12.476665 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-95cf5d96-2edc-4816-80c3-71e18d10ac4f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:12.496974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95cf5d96-2edc-4816-80c3-71e18d10ac4f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:12.496974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95cf5d96-2edc-4816-80c3-71e18d10ac4f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:12.496974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95cf5d96-2edc-4816-80c3-71e18d10ac4f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:12.498812 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95cf5d96-2edc-4816-80c3-71e18d10ac4f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:12.499300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95cf5d96-2edc-4816-80c3-71e18d10ac4f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:12.502144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95cf5d96-2edc-4816-80c3-71e18d10ac4f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:12.929803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-95cf5d96-2edc-4816-80c3-71e18d10ac4f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:12.962044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-95cf5d96-2edc-4816-80c3-71e18d10ac4f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:12.974817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-95cf5d96-2edc-4816-80c3-71e18d10ac4f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:12.978588 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-95cf5d96-2edc-4816-80c3-71e18d10ac4f tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1722 microversion: 2.20 time: 0.508766 Aug 24 10:45:12.979166 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2593/5532] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:45:12 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1722 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:45:14.030314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f043b579-db79-464d-a098-45d3e40b2fc3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:14.034401 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f043b579-db79-464d-a098-45d3e40b2fc3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:14.056925 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f043b579-db79-464d-a098-45d3e40b2fc3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:14.058216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f043b579-db79-464d-a098-45d3e40b2fc3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:14.059260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f043b579-db79-464d-a098-45d3e40b2fc3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:14.060048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f043b579-db79-464d-a098-45d3e40b2fc3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:14.060518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f043b579-db79-464d-a098-45d3e40b2fc3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:14.060953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f043b579-db79-464d-a098-45d3e40b2fc3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:14.648217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f043b579-db79-464d-a098-45d3e40b2fc3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:14.673394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f043b579-db79-464d-a098-45d3e40b2fc3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:14.679582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f043b579-db79-464d-a098-45d3e40b2fc3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:14.685001 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f043b579-db79-464d-a098-45d3e40b2fc3 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1722 microversion: 2.20 time: 0.665576 Aug 24 10:45:14.687455 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2940/5533] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:45:14 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1722 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:45:15.713950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-db23575a-e695-48e5-b465-9cc2933683e0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:15.714583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-db23575a-e695-48e5-b465-9cc2933683e0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:15.730110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db23575a-e695-48e5-b465-9cc2933683e0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:15.733842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db23575a-e695-48e5-b465-9cc2933683e0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:15.734566 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db23575a-e695-48e5-b465-9cc2933683e0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:15.735329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db23575a-e695-48e5-b465-9cc2933683e0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:15.736850 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db23575a-e695-48e5-b465-9cc2933683e0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:15.737594 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db23575a-e695-48e5-b465-9cc2933683e0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:16.009502 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-db23575a-e695-48e5-b465-9cc2933683e0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:16.023232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-e4eefacf-24f2-416d-aee2-65edf111a502 req-dd6510c0-741d-4278-8c5b-1d0a3722bbe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc496b71-8fb7-4344-8642-53483cea796b", "name": "network-vif-deleted", "tag": "30ffbeff-bf67-4d4a-8328-d554619bcd68"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:45:16.029059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-db23575a-e695-48e5-b465-9cc2933683e0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:16.032156 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-db23575a-e695-48e5-b465-9cc2933683e0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d12ba24f245b59b9af777352984d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9ad6902a1f4f2c807315e5ee3dc897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:16.033763 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-db23575a-e695-48e5-b465-9cc2933683e0 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 200 len: 1654 microversion: 2.20 time: 0.327149 Aug 24 10:45:16.035019 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2594/5534] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:45:15 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 1654 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:45:16.039768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e4eefacf-24f2-416d-aee2-65edf111a502 req-dd6510c0-741d-4278-8c5b-1d0a3722bbe7 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:16.049898 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e4eefacf-24f2-416d-aee2-65edf111a502 req-dd6510c0-741d-4278-8c5b-1d0a3722bbe7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:16.050598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e4eefacf-24f2-416d-aee2-65edf111a502 req-dd6510c0-741d-4278-8c5b-1d0a3722bbe7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:16.067615 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-e4eefacf-24f2-416d-aee2-65edf111a502 req-dd6510c0-741d-4278-8c5b-1d0a3722bbe7 service nova] Creating event network-vif-deleted:30ffbeff-bf67-4d4a-8328-d554619bcd68 for instance cc496b71-8fb7-4344-8642-53483cea796b on n-h2-849328-3 Aug 24 10:45:16.081438 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-e4eefacf-24f2-416d-aee2-65edf111a502 req-dd6510c0-741d-4278-8c5b-1d0a3722bbe7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062376 Aug 24 10:45:16.089585 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2941/5535] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:45:16.479085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6d2871aa-dde7-4abe-b25b-200c7f5f0f75 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-973712813", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a83d8002-e283-4390-9f7e-f2670f338d6f"}], "security_groups": [{"name": "tempest-securitygroup--856767546"}], "key_name": "tempest-keypair-1162018293", "user_data": "}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:45:16.912503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-6d2871aa-dde7-4abe-b25b-200c7f5f0f75 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] validate_networks() for [('a83d8002-e283-4390-9f7e-f2670f338d6f', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:45:17.061483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2525181c-81c4-45d4-934c-99f2ca9c1ed8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:17.063130 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2525181c-81c4-45d4-934c-99f2ca9c1ed8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:17.069793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2525181c-81c4-45d4-934c-99f2ca9c1ed8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:17.070616 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2525181c-81c4-45d4-934c-99f2ca9c1ed8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:17.071240 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2525181c-81c4-45d4-934c-99f2ca9c1ed8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:17.072816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2525181c-81c4-45d4-934c-99f2ca9c1ed8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:17.073558 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2525181c-81c4-45d4-934c-99f2ca9c1ed8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:17.074218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2525181c-81c4-45d4-934c-99f2ca9c1ed8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:17.091109 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-2525181c-81c4-45d4-934c-99f2ca9c1ed8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] HTTP exception thrown: Instance cc496b71-8fb7-4344-8642-53483cea796b could not be found. Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2525181c-81c4-45d4-934c-99f2ca9c1ed8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Request method failure captured: Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b HTTP/1.1 Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf9nCauhJDOCT4Xy9CKMVMd3wfzK8bvssGDc3rFNOgK-YJxNzU-KAXJQZNh3gZzq6oFSRtXQivWIeWvAbzyOuyl5w5ndy3iHqEIua9W_ikjnzVSeI8nkFEIFmYltjUi5spRJIFZh-3IQ1ii1oBc_-axVhOaob-8aEUg7Ow6cR2rzIb0 Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 2c9ad6902a1f4f2c807315e5ee3dc897 Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1498146334 Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2c9ad6902a1f4f2c807315e5ee3dc897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_2c9ad6902a1f4f2c807315e5ee3dc897", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2c9ad6902a1f4f2c807315e5ee3dc897"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/2c9ad6902a1f4f2c807315e5ee3dc897"}]}] Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1498146334 Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 2c9ad6902a1f4f2c807315e5ee3dc897 Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1498146334 Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AttachVolumeShelveTestJSON-1498146334-project Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 3f1d12ba24f245b59b9af777352984d0 Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1498146334-project Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance cc496b71-8fb7-4344-8642-53483cea796b could not be found. Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'cc496b71-8fb7-4344-8642-53483cea796b'} Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc496b71-8fb7-4344-8642-53483cea796b could not be found. Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc496b71-8fb7-4344-8642-53483cea796b could not be found. Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:45:17.093265 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:45:17.097751 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:45:17.097751 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:45:17.097751 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:45:17.097751 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:45:17.097751 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:45:17.097751 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:45:17.097751 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc496b71-8fb7-4344-8642-53483cea796b could not be found. Aug 24 10:45:17.097751 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:45:17.099759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2525181c-81c4-45d4-934c-99f2ca9c1ed8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Returning 404 to user: Instance cc496b71-8fb7-4344-8642-53483cea796b could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:45:17.100961 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2525181c-81c4-45d4-934c-99f2ca9c1ed8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 404 len: 111 microversion: 2.20 time: 0.044952 Aug 24 10:45:17.106890 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2942/5536] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:45:17 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:45:17.112226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-126fe42a-6843-40da-a81b-75ab5f49f464 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '.version_select at 0x7f46478c2ee0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:17.153695 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-126fe42a-6843-40da-a81b-75ab5f49f464 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1838153285" status: 204 len: 0 microversion: 2.20 time: 0.045677 Aug 24 10:45:17.156040 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2943/5537] 10.222.0.85 () {60 vars in 1262 bytes} [Wed Aug 24 10:45:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1838153285 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:45:18.280737 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-6d2871aa-dde7-4abe-b25b-200c7f5f0f75 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:45:18.281297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-6d2871aa-dde7-4abe-b25b-200c7f5f0f75 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:45:18.282072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-6d2871aa-dde7-4abe-b25b-200c7f5f0f75 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:45:18.282072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-6d2871aa-dde7-4abe-b25b-200c7f5f0f75 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:45:18.282732 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-6d2871aa-dde7-4abe-b25b-200c7f5f0f75 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:45:18.309746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d2871aa-dde7-4abe-b25b-200c7f5f0f75 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:18.310336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d2871aa-dde7-4abe-b25b-200c7f5f0f75 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:18.310972 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d2871aa-dde7-4abe-b25b-200c7f5f0f75 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:18.311980 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d2871aa-dde7-4abe-b25b-200c7f5f0f75 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:18.312631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d2871aa-dde7-4abe-b25b-200c7f5f0f75 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:18.313433 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d2871aa-dde7-4abe-b25b-200c7f5f0f75 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:18.337465 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-6d2871aa-dde7-4abe-b25b-200c7f5f0f75 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Getting quotas for project 3cfd67239d3f4b7a89be1453a08c92ba. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:45:18.345186 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-6d2871aa-dde7-4abe-b25b-200c7f5f0f75 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Getting quotas for user ff5172c17fae44e5839bd9b789e4c3a8 and project 3cfd67239d3f4b7a89be1453a08c92ba. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:45:18.362397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6d2871aa-dde7-4abe-b25b-200c7f5f0f75 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:45:18.369240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6d2871aa-dde7-4abe-b25b-200c7f5f0f75 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:45:18.470897 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6d2871aa-dde7-4abe-b25b-200c7f5f0f75 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.996282 Aug 24 10:45:18.473566 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2595/5538] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:45:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 2000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:45:18.490951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-86907b48-9583-48ef-96a7-d6d77495f70c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:18.490951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-86907b48-9583-48ef-96a7-d6d77495f70c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:18.801983 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-86907b48-9583-48ef-96a7-d6d77495f70c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:18.810892 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-86907b48-9583-48ef-96a7-d6d77495f70c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84" status: 200 len: 1241 microversion: 2.1 time: 0.330700 Aug 24 10:45:18.811566 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2944/5539] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:45:18 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84 => generated 1241 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:45:19.844861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ac0e0004-abc9-4a85-ac1b-fcf177854c56 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:19.847311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ac0e0004-abc9-4a85-ac1b-fcf177854c56 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:19.886407 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac0e0004-abc9-4a85-ac1b-fcf177854c56 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:19.886909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac0e0004-abc9-4a85-ac1b-fcf177854c56 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:19.887474 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac0e0004-abc9-4a85-ac1b-fcf177854c56 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:19.889230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac0e0004-abc9-4a85-ac1b-fcf177854c56 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:19.889878 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac0e0004-abc9-4a85-ac1b-fcf177854c56 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:19.890463 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac0e0004-abc9-4a85-ac1b-fcf177854c56 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:20.241506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ac0e0004-abc9-4a85-ac1b-fcf177854c56 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:20.250669 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ac0e0004-abc9-4a85-ac1b-fcf177854c56 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84" status: 200 len: 1293 microversion: 2.1 time: 0.419065 Aug 24 10:45:20.279135 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2596/5540] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:45:19 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84 => generated 1293 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:45:21.286336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2ef4a6c8-f3b7-448b-a2bc-9cd9fe08588f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:21.287023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2ef4a6c8-f3b7-448b-a2bc-9cd9fe08588f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:21.307779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ef4a6c8-f3b7-448b-a2bc-9cd9fe08588f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:21.313562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ef4a6c8-f3b7-448b-a2bc-9cd9fe08588f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:21.314434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ef4a6c8-f3b7-448b-a2bc-9cd9fe08588f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:21.319314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ef4a6c8-f3b7-448b-a2bc-9cd9fe08588f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:21.321236 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ef4a6c8-f3b7-448b-a2bc-9cd9fe08588f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:21.322811 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ef4a6c8-f3b7-448b-a2bc-9cd9fe08588f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:21.586814 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2ef4a6c8-f3b7-448b-a2bc-9cd9fe08588f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:21.596584 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2ef4a6c8-f3b7-448b-a2bc-9cd9fe08588f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84" status: 200 len: 1299 microversion: 2.1 time: 0.316204 Aug 24 10:45:21.601211 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2945/5541] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:45:21 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84 => generated 1299 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:45:22.621583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d37a978e-4d6b-40e1-9965-e22e80fbcf1f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:22.623045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d37a978e-4d6b-40e1-9965-e22e80fbcf1f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:22.646911 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d37a978e-4d6b-40e1-9965-e22e80fbcf1f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:22.647783 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d37a978e-4d6b-40e1-9965-e22e80fbcf1f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:22.648463 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d37a978e-4d6b-40e1-9965-e22e80fbcf1f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:22.649396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d37a978e-4d6b-40e1-9965-e22e80fbcf1f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:22.650241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d37a978e-4d6b-40e1-9965-e22e80fbcf1f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:22.650900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d37a978e-4d6b-40e1-9965-e22e80fbcf1f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:22.826432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-33de358a-4ab9-4aba-8855-5ff6096ec0a8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:22.827581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-33de358a-4ab9-4aba-8855-5ff6096ec0a8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:22.840423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33de358a-4ab9-4aba-8855-5ff6096ec0a8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:22.841188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33de358a-4ab9-4aba-8855-5ff6096ec0a8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:22.845925 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33de358a-4ab9-4aba-8855-5ff6096ec0a8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:22.846910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33de358a-4ab9-4aba-8855-5ff6096ec0a8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:22.851619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33de358a-4ab9-4aba-8855-5ff6096ec0a8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:22.853159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33de358a-4ab9-4aba-8855-5ff6096ec0a8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:22.869350 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d37a978e-4d6b-40e1-9965-e22e80fbcf1f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:22.883048 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d37a978e-4d6b-40e1-9965-e22e80fbcf1f tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84" status: 200 len: 1299 microversion: 2.1 time: 0.266704 Aug 24 10:45:22.901948 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2597/5542] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:45:22 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84 => generated 1299 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:45:22.916827 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-33de358a-4ab9-4aba-8855-5ff6096ec0a8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] HTTP exception thrown: Instance cc496b71-8fb7-4344-8642-53483cea796b could not be found. Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-33de358a-4ab9-4aba-8855-5ff6096ec0a8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Request method failure captured: Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b HTTP/1.1 Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf9nCauhJDOCT4Xy9CKMVMd3wfzK8bvssGDc3rFNOgK-YJxNzU-KAXJQZNh3gZzq6oFSRtXQivWIeWvAbzyOuyl5w5ndy3iHqEIua9W_ikjnzVSeI8nkFEIFmYltjUi5spRJIFZh-3IQ1ii1oBc_-axVhOaob-8aEUg7Ow6cR2rzIb0 Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 2c9ad6902a1f4f2c807315e5ee3dc897 Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1498146334 Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2c9ad6902a1f4f2c807315e5ee3dc897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_2c9ad6902a1f4f2c807315e5ee3dc897", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2c9ad6902a1f4f2c807315e5ee3dc897"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/2c9ad6902a1f4f2c807315e5ee3dc897"}]}] Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1498146334 Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 2c9ad6902a1f4f2c807315e5ee3dc897 Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1498146334 Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AttachVolumeShelveTestJSON-1498146334-project Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 3f1d12ba24f245b59b9af777352984d0 Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1498146334-project Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance cc496b71-8fb7-4344-8642-53483cea796b could not be found. Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'cc496b71-8fb7-4344-8642-53483cea796b'} Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc496b71-8fb7-4344-8642-53483cea796b could not be found. Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:45:22.919922 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:45:22.924605 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc496b71-8fb7-4344-8642-53483cea796b could not be found. Aug 24 10:45:22.924605 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:45:22.924605 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:45:22.924605 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:45:22.924605 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:45:22.924605 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:45:22.924605 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:45:22.924605 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:45:22.924605 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:45:22.924605 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc496b71-8fb7-4344-8642-53483cea796b could not be found. Aug 24 10:45:22.924605 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:45:22.929541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-33de358a-4ab9-4aba-8855-5ff6096ec0a8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Returning 404 to user: Instance cc496b71-8fb7-4344-8642-53483cea796b could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:45:22.933004 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-33de358a-4ab9-4aba-8855-5ff6096ec0a8 tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "DELETE /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 404 len: 111 microversion: 2.20 time: 0.109504 Aug 24 10:45:22.934282 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2946/5543] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:45:22 2022] DELETE /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:45:22.947655 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cbafbac2-3cb8-4dd4-bf8d-9aa158925ada tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:22.948566 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cbafbac2-3cb8-4dd4-bf8d-9aa158925ada tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: cc496b71-8fb7-4344-8642-53483cea796b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:22.958550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbafbac2-3cb8-4dd4-bf8d-9aa158925ada tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:22.960955 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbafbac2-3cb8-4dd4-bf8d-9aa158925ada tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:22.962381 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbafbac2-3cb8-4dd4-bf8d-9aa158925ada tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:22.963608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbafbac2-3cb8-4dd4-bf8d-9aa158925ada tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:22.966503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbafbac2-3cb8-4dd4-bf8d-9aa158925ada tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:22.968375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbafbac2-3cb8-4dd4-bf8d-9aa158925ada tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:23.005432 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-cbafbac2-3cb8-4dd4-bf8d-9aa158925ada tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] HTTP exception thrown: Instance cc496b71-8fb7-4344-8642-53483cea796b could not be found. Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cbafbac2-3cb8-4dd4-bf8d-9aa158925ada tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Request method failure captured: Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b HTTP/1.1 Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf9nCauhJDOCT4Xy9CKMVMd3wfzK8bvssGDc3rFNOgK-YJxNzU-KAXJQZNh3gZzq6oFSRtXQivWIeWvAbzyOuyl5w5ndy3iHqEIua9W_ikjnzVSeI8nkFEIFmYltjUi5spRJIFZh-3IQ1ii1oBc_-axVhOaob-8aEUg7Ow6cR2rzIb0 Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 2c9ad6902a1f4f2c807315e5ee3dc897 Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1498146334 Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2c9ad6902a1f4f2c807315e5ee3dc897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_2c9ad6902a1f4f2c807315e5ee3dc897", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2c9ad6902a1f4f2c807315e5ee3dc897"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/2c9ad6902a1f4f2c807315e5ee3dc897"}]}] Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1498146334 Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 2c9ad6902a1f4f2c807315e5ee3dc897 Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1498146334 Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-AttachVolumeShelveTestJSON-1498146334-project Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 3f1d12ba24f245b59b9af777352984d0 Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1498146334-project Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance cc496b71-8fb7-4344-8642-53483cea796b could not be found. Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'cc496b71-8fb7-4344-8642-53483cea796b'} Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc496b71-8fb7-4344-8642-53483cea796b could not be found. Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc496b71-8fb7-4344-8642-53483cea796b could not be found. Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:45:23.012547 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:45:23.017565 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:45:23.017565 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:45:23.017565 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:45:23.017565 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:45:23.017565 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:45:23.017565 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:45:23.017565 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc496b71-8fb7-4344-8642-53483cea796b could not be found. Aug 24 10:45:23.017565 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:45:23.019561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cbafbac2-3cb8-4dd4-bf8d-9aa158925ada tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Returning 404 to user: Instance cc496b71-8fb7-4344-8642-53483cea796b could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:45:23.021308 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cbafbac2-3cb8-4dd4-bf8d-9aa158925ada tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b" status: 404 len: 111 microversion: 2.20 time: 0.079133 Aug 24 10:45:23.022678 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2598/5544] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:45:22 2022] GET /compute/v2.1/servers/cc496b71-8fb7-4344-8642-53483cea796b => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:45:23.907940 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-021881b7-2642-41ce-b96d-ee392f657cca tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:23.908548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-021881b7-2642-41ce-b96d-ee392f657cca tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:23.921113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-021881b7-2642-41ce-b96d-ee392f657cca tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:23.932786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-021881b7-2642-41ce-b96d-ee392f657cca tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:23.937557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-021881b7-2642-41ce-b96d-ee392f657cca tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:23.938689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-021881b7-2642-41ce-b96d-ee392f657cca tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:23.939379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-021881b7-2642-41ce-b96d-ee392f657cca tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:23.940088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-021881b7-2642-41ce-b96d-ee392f657cca tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:24.598133 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-021881b7-2642-41ce-b96d-ee392f657cca tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:24.612891 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-021881b7-2642-41ce-b96d-ee392f657cca tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84" status: 200 len: 1366 microversion: 2.1 time: 0.708731 Aug 24 10:45:24.626615 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2947/5545] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:45:23 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84 => generated 1366 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:45:25.638988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2ebcc1ab-ef0f-4aa6-b1f6-51407c01eba4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:25.640150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2ebcc1ab-ef0f-4aa6-b1f6-51407c01eba4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:25.666911 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ebcc1ab-ef0f-4aa6-b1f6-51407c01eba4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:25.668366 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ebcc1ab-ef0f-4aa6-b1f6-51407c01eba4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:25.669384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ebcc1ab-ef0f-4aa6-b1f6-51407c01eba4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:25.671844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ebcc1ab-ef0f-4aa6-b1f6-51407c01eba4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:25.673013 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ebcc1ab-ef0f-4aa6-b1f6-51407c01eba4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:25.674082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ebcc1ab-ef0f-4aa6-b1f6-51407c01eba4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:26.415431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2ebcc1ab-ef0f-4aa6-b1f6-51407c01eba4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:26.427329 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2ebcc1ab-ef0f-4aa6-b1f6-51407c01eba4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84" status: 200 len: 1366 microversion: 2.1 time: 0.792707 Aug 24 10:45:26.431979 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2599/5546] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:45:25 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84 => generated 1366 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:45:26.697889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-ba2f2efd-f5f4-49a4-bb31-8c6a41ba6fa8 req-63add7f8-46a4-46f9-b62f-d02766935a8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb455d4d-f629-4593-ab93-67ac87630d84", "tag": "5c921a92-8857-466c-b0b7-b9f15938d925"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:45:26.722427 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ba2f2efd-f5f4-49a4-bb31-8c6a41ba6fa8 req-63add7f8-46a4-46f9-b62f-d02766935a8a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:26.723214 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ba2f2efd-f5f4-49a4-bb31-8c6a41ba6fa8 req-63add7f8-46a4-46f9-b62f-d02766935a8a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:26.723932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ba2f2efd-f5f4-49a4-bb31-8c6a41ba6fa8 req-63add7f8-46a4-46f9-b62f-d02766935a8a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:26.748755 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-ba2f2efd-f5f4-49a4-bb31-8c6a41ba6fa8 req-63add7f8-46a4-46f9-b62f-d02766935a8a service nova] Creating event network-changed:5c921a92-8857-466c-b0b7-b9f15938d925 for instance bb455d4d-f629-4593-ab93-67ac87630d84 on n-h2-849328-3 Aug 24 10:45:26.759759 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-ba2f2efd-f5f4-49a4-bb31-8c6a41ba6fa8 req-63add7f8-46a4-46f9-b62f-d02766935a8a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077015 Aug 24 10:45:26.766772 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2948/5547] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:45:27.448801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-12e186ce-23cd-4666-b3dd-21744c050753 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:27.449263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-12e186ce-23cd-4666-b3dd-21744c050753 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:27.459515 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12e186ce-23cd-4666-b3dd-21744c050753 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:27.460000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12e186ce-23cd-4666-b3dd-21744c050753 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:27.460442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12e186ce-23cd-4666-b3dd-21744c050753 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:27.461197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12e186ce-23cd-4666-b3dd-21744c050753 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:27.461657 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12e186ce-23cd-4666-b3dd-21744c050753 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:27.462084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12e186ce-23cd-4666-b3dd-21744c050753 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:27.871584 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-12e186ce-23cd-4666-b3dd-21744c050753 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:27.896418 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-12e186ce-23cd-4666-b3dd-21744c050753 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84" status: 200 len: 1366 microversion: 2.1 time: 0.451759 Aug 24 10:45:27.901348 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2600/5548] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:45:27 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84 => generated 1366 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:45:28.923455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c1968902-4e10-4797-ad66-fbd33396e893 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:28.925888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c1968902-4e10-4797-ad66-fbd33396e893 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:28.935130 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:28.977865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1968902-4e10-4797-ad66-fbd33396e893 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:28.980413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1968902-4e10-4797-ad66-fbd33396e893 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:28.980875 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1968902-4e10-4797-ad66-fbd33396e893 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:28.983751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1968902-4e10-4797-ad66-fbd33396e893 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:28.987205 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1968902-4e10-4797-ad66-fbd33396e893 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:29.001669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1968902-4e10-4797-ad66-fbd33396e893 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:29.394730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c1968902-4e10-4797-ad66-fbd33396e893 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:29.408692 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c1968902-4e10-4797-ad66-fbd33396e893 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84" status: 200 len: 1366 microversion: 2.1 time: 0.491080 Aug 24 10:45:29.413381 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2949/5549] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:45:28 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84 => generated 1366 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:45:29.851847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c6383c60-1883-4f87-8161-9dced3ee3f1e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:29.852923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c6383c60-1883-4f87-8161-9dced3ee3f1e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:29.859282 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:29.861171 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:29.866166 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6383c60-1883-4f87-8161-9dced3ee3f1e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:29.866848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6383c60-1883-4f87-8161-9dced3ee3f1e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:29.867307 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6383c60-1883-4f87-8161-9dced3ee3f1e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:29.868031 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6383c60-1883-4f87-8161-9dced3ee3f1e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:29.868491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6383c60-1883-4f87-8161-9dced3ee3f1e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:29.868916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6383c60-1883-4f87-8161-9dced3ee3f1e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:29.888241 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-c6383c60-1883-4f87-8161-9dced3ee3f1e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] HTTP exception thrown: Instance 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e could not be found. Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c6383c60-1883-4f87-8161-9dced3ee3f1e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Request method failure captured: Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e HTTP/1.1 Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBf9nCauhJDOCT4Xy9CKMVMd3wfzK8bvssGDc3rFNOgK-YJxNzU-KAXJQZNh3gZzq6oFSRtXQivWIeWvAbzyOuyl5w5ndy3iHqEIua9W_ikjnzVSeI8nkFEIFmYltjUi5spRJIFZh-3IQ1ii1oBc_-axVhOaob-8aEUg7Ow6cR2rzIb0 Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 2c9ad6902a1f4f2c807315e5ee3dc897 Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1498146334 Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2c9ad6902a1f4f2c807315e5ee3dc897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_2c9ad6902a1f4f2c807315e5ee3dc897", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2c9ad6902a1f4f2c807315e5ee3dc897"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/2c9ad6902a1f4f2c807315e5ee3dc897"}]}] Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1498146334 Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 2c9ad6902a1f4f2c807315e5ee3dc897 Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1498146334 Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-AttachVolumeShelveTestJSON-1498146334-project Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 3f1d12ba24f245b59b9af777352984d0 Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1498146334-project Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e could not be found. Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e'} Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e could not be found. Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:45:29.906051 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:45:29.911131 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e could not be found. Aug 24 10:45:29.911131 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:45:29.911131 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:45:29.911131 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:45:29.911131 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:45:29.911131 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:45:29.911131 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:45:29.911131 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:45:29.911131 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:45:29.911131 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e could not be found. Aug 24 10:45:29.911131 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:45:29.911131 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c6383c60-1883-4f87-8161-9dced3ee3f1e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Returning 404 to user: Instance 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:45:29.911131 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c6383c60-1883-4f87-8161-9dced3ee3f1e tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "DELETE /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 404 len: 111 microversion: 2.20 time: 0.060941 Aug 24 10:45:29.911131 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2601/5550] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Aug 24 10:45:29 2022] DELETE /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:45:29.916675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b236350b-789e-4d00-a76e-f22aa087b5cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:29.917383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b236350b-789e-4d00-a76e-f22aa087b5cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] [instance: 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:29.932933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b236350b-789e-4d00-a76e-f22aa087b5cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:29.933611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b236350b-789e-4d00-a76e-f22aa087b5cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:29.933991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b236350b-789e-4d00-a76e-f22aa087b5cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:29.934732 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b236350b-789e-4d00-a76e-f22aa087b5cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:29.935198 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b236350b-789e-4d00-a76e-f22aa087b5cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:29.935631 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b236350b-789e-4d00-a76e-f22aa087b5cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:29.970456 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-b236350b-789e-4d00-a76e-f22aa087b5cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] HTTP exception thrown: Instance 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e could not be found. Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b236350b-789e-4d00-a76e-f22aa087b5cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Request method failure captured: Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e HTTP/1.1 Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBf9nCauhJDOCT4Xy9CKMVMd3wfzK8bvssGDc3rFNOgK-YJxNzU-KAXJQZNh3gZzq6oFSRtXQivWIeWvAbzyOuyl5w5ndy3iHqEIua9W_ikjnzVSeI8nkFEIFmYltjUi5spRJIFZh-3IQ1ii1oBc_-axVhOaob-8aEUg7Ow6cR2rzIb0 Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 2c9ad6902a1f4f2c807315e5ee3dc897 Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1498146334 Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2c9ad6902a1f4f2c807315e5ee3dc897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_2c9ad6902a1f4f2c807315e5ee3dc897", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2c9ad6902a1f4f2c807315e5ee3dc897"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/2c9ad6902a1f4f2c807315e5ee3dc897"}]}] Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1498146334 Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 2c9ad6902a1f4f2c807315e5ee3dc897 Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1498146334 Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AttachVolumeShelveTestJSON-1498146334-project Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 3f1d12ba24f245b59b9af777352984d0 Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1498146334-project Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e could not be found. Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e'} Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e could not be found. Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e could not be found. Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:45:29.972209 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:45:29.977798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:45:29.977798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:45:29.977798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:45:29.977798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:45:29.977798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:45:29.977798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:45:29.977798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e could not be found. Aug 24 10:45:29.977798 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:45:29.977798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b236350b-789e-4d00-a76e-f22aa087b5cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] Returning 404 to user: Instance 3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:45:29.977798 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b236350b-789e-4d00-a76e-f22aa087b5cc tempest-AttachVolumeShelveTestJSON-1498146334 tempest-AttachVolumeShelveTestJSON-1498146334-project] 10.222.0.85 "GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e" status: 404 len: 111 microversion: 2.20 time: 0.061237 Aug 24 10:45:29.983178 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2950/5551] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Aug 24 10:45:29 2022] GET /compute/v2.1/servers/3eecb3ec-ea3f-4b92-8ab1-6c07f9f7f98e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:45:30.433161 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0e58be59-628d-4710-ae13-7ae5de41b02a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:30.433856 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0e58be59-628d-4710-ae13-7ae5de41b02a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:30.447048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e58be59-628d-4710-ae13-7ae5de41b02a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:30.447744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e58be59-628d-4710-ae13-7ae5de41b02a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:30.448196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e58be59-628d-4710-ae13-7ae5de41b02a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:30.448934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e58be59-628d-4710-ae13-7ae5de41b02a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:30.449431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e58be59-628d-4710-ae13-7ae5de41b02a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:30.450185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e58be59-628d-4710-ae13-7ae5de41b02a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:30.893241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0e58be59-628d-4710-ae13-7ae5de41b02a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:30.902423 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0e58be59-628d-4710-ae13-7ae5de41b02a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84" status: 200 len: 1366 microversion: 2.1 time: 0.473331 Aug 24 10:45:30.912439 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2602/5552] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:45:30 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84 => generated 1366 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:45:31.934271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-37e056ff-1be0-4b24-9e7c-2b91f4abfbb7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:31.934880 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-37e056ff-1be0-4b24-9e7c-2b91f4abfbb7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:31.938519 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:31.960786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37e056ff-1be0-4b24-9e7c-2b91f4abfbb7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:31.961782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37e056ff-1be0-4b24-9e7c-2b91f4abfbb7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:31.966278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37e056ff-1be0-4b24-9e7c-2b91f4abfbb7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:31.969906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37e056ff-1be0-4b24-9e7c-2b91f4abfbb7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:31.970752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37e056ff-1be0-4b24-9e7c-2b91f4abfbb7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:31.971435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37e056ff-1be0-4b24-9e7c-2b91f4abfbb7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:31.978035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:32.554333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-37e056ff-1be0-4b24-9e7c-2b91f4abfbb7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:32.569900 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-37e056ff-1be0-4b24-9e7c-2b91f4abfbb7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84" status: 200 len: 1366 microversion: 2.1 time: 0.635986 Aug 24 10:45:32.570627 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2951/5553] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:45:31 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84 => generated 1366 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:45:33.595129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d6a9cf6f-96d0-41c1-8f33-3f50930f9d78 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:33.595902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d6a9cf6f-96d0-41c1-8f33-3f50930f9d78 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:33.608877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6a9cf6f-96d0-41c1-8f33-3f50930f9d78 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:33.609417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6a9cf6f-96d0-41c1-8f33-3f50930f9d78 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:33.609861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6a9cf6f-96d0-41c1-8f33-3f50930f9d78 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:33.610586 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6a9cf6f-96d0-41c1-8f33-3f50930f9d78 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:33.611043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6a9cf6f-96d0-41c1-8f33-3f50930f9d78 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:33.611450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6a9cf6f-96d0-41c1-8f33-3f50930f9d78 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:33.995073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d6a9cf6f-96d0-41c1-8f33-3f50930f9d78 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:34.004488 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d6a9cf6f-96d0-41c1-8f33-3f50930f9d78 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84" status: 200 len: 1366 microversion: 2.1 time: 0.413194 Aug 24 10:45:34.017707 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2603/5554] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:45:33 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84 => generated 1366 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:45:35.028930 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5d1effe1-7389-41f9-82fd-b192daeddc68 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:35.029698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5d1effe1-7389-41f9-82fd-b192daeddc68 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:35.044189 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d1effe1-7389-41f9-82fd-b192daeddc68 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:35.044960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d1effe1-7389-41f9-82fd-b192daeddc68 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:35.047784 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d1effe1-7389-41f9-82fd-b192daeddc68 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:35.048767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d1effe1-7389-41f9-82fd-b192daeddc68 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:35.049549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d1effe1-7389-41f9-82fd-b192daeddc68 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:35.050167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d1effe1-7389-41f9-82fd-b192daeddc68 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:35.593782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5d1effe1-7389-41f9-82fd-b192daeddc68 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:35.604584 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5d1effe1-7389-41f9-82fd-b192daeddc68 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84" status: 200 len: 1366 microversion: 2.1 time: 0.580838 Aug 24 10:45:35.609031 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2952/5555] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:45:35 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84 => generated 1366 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:45:36.470840 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-813b568a-5937-475d-a379-7a12141bfae2 req-0b0a6134-ed3d-4956-943e-51ae4bfb4152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb455d4d-f629-4593-ab93-67ac87630d84", "name": "network-vif-plugged", "status": "completed", "tag": "5c921a92-8857-466c-b0b7-b9f15938d925"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:45:36.538881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-813b568a-5937-475d-a379-7a12141bfae2 req-0b0a6134-ed3d-4956-943e-51ae4bfb4152 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:36.539449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-813b568a-5937-475d-a379-7a12141bfae2 req-0b0a6134-ed3d-4956-943e-51ae4bfb4152 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:36.547693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-813b568a-5937-475d-a379-7a12141bfae2 req-0b0a6134-ed3d-4956-943e-51ae4bfb4152 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:36.552338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:36.576964 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-813b568a-5937-475d-a379-7a12141bfae2 req-0b0a6134-ed3d-4956-943e-51ae4bfb4152 service nova] Creating event network-vif-plugged:5c921a92-8857-466c-b0b7-b9f15938d925 for instance bb455d4d-f629-4593-ab93-67ac87630d84 on n-h2-849328-3 Aug 24 10:45:36.582757 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-813b568a-5937-475d-a379-7a12141bfae2 req-0b0a6134-ed3d-4956-943e-51ae4bfb4152 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118677 Aug 24 10:45:36.587780 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2604/5556] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:45:36.631314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-11557b57-de54-421a-ac1d-0d3ac7b8db22 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:36.632577 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-11557b57-de54-421a-ac1d-0d3ac7b8db22 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:36.684817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11557b57-de54-421a-ac1d-0d3ac7b8db22 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:36.685566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11557b57-de54-421a-ac1d-0d3ac7b8db22 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:36.686453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11557b57-de54-421a-ac1d-0d3ac7b8db22 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:36.689330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11557b57-de54-421a-ac1d-0d3ac7b8db22 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:36.691678 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11557b57-de54-421a-ac1d-0d3ac7b8db22 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:36.693794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11557b57-de54-421a-ac1d-0d3ac7b8db22 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:37.032233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-11557b57-de54-421a-ac1d-0d3ac7b8db22 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:37.043208 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-11557b57-de54-421a-ac1d-0d3ac7b8db22 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84" status: 200 len: 1366 microversion: 2.1 time: 0.418795 Aug 24 10:45:37.048482 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2953/5557] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:45:36 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84 => generated 1366 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:45:38.088011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e5b8522f-e0bb-46d4-be08-f1e5f920d000 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:38.088011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e5b8522f-e0bb-46d4-be08-f1e5f920d000 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:38.089833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:38.134421 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5b8522f-e0bb-46d4-be08-f1e5f920d000 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:38.137409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5b8522f-e0bb-46d4-be08-f1e5f920d000 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:38.138080 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5b8522f-e0bb-46d4-be08-f1e5f920d000 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:38.141553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5b8522f-e0bb-46d4-be08-f1e5f920d000 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:38.143113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5b8522f-e0bb-46d4-be08-f1e5f920d000 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:38.144222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5b8522f-e0bb-46d4-be08-f1e5f920d000 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:38.908576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e5b8522f-e0bb-46d4-be08-f1e5f920d000 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:38.917291 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e5b8522f-e0bb-46d4-be08-f1e5f920d000 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84" status: 200 len: 1366 microversion: 2.1 time: 0.846621 Aug 24 10:45:38.917925 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2605/5558] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:45:38 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84 => generated 1366 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:45:39.939561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bf8deeca-e186-4c9a-8eb8-1a89287887a4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:39.941482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bf8deeca-e186-4c9a-8eb8-1a89287887a4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:39.954966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf8deeca-e186-4c9a-8eb8-1a89287887a4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:39.955927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf8deeca-e186-4c9a-8eb8-1a89287887a4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:39.956537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf8deeca-e186-4c9a-8eb8-1a89287887a4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:39.958270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf8deeca-e186-4c9a-8eb8-1a89287887a4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:39.958910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf8deeca-e186-4c9a-8eb8-1a89287887a4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:39.961689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf8deeca-e186-4c9a-8eb8-1a89287887a4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:40.272775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bf8deeca-e186-4c9a-8eb8-1a89287887a4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:40.301927 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bf8deeca-e186-4c9a-8eb8-1a89287887a4 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84" status: 200 len: 1555 microversion: 2.1 time: 0.366428 Aug 24 10:45:40.304669 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2954/5559] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:45:39 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84 => generated 1555 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:45:40.332405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-21e8dd7b-67a3-4b3d-b91a-1d50f81aa0b0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:40.333707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-21e8dd7b-67a3-4b3d-b91a-1d50f81aa0b0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:40.353617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21e8dd7b-67a3-4b3d-b91a-1d50f81aa0b0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:40.354530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21e8dd7b-67a3-4b3d-b91a-1d50f81aa0b0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:40.355405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21e8dd7b-67a3-4b3d-b91a-1d50f81aa0b0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:40.356344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21e8dd7b-67a3-4b3d-b91a-1d50f81aa0b0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:40.357567 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21e8dd7b-67a3-4b3d-b91a-1d50f81aa0b0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:40.358274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21e8dd7b-67a3-4b3d-b91a-1d50f81aa0b0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:40.611089 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-21e8dd7b-67a3-4b3d-b91a-1d50f81aa0b0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.283662 Aug 24 10:45:40.612788 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2606/5560] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Aug 24 10:45:40 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84/os-interface => generated 284 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:45:43.225519 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-51892945-6929-4c9a-b93e-af836b59d5f4 req-532fc139-0508-4f8b-ac56-0c50e2813292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb455d4d-f629-4593-ab93-67ac87630d84", "tag": "5c921a92-8857-466c-b0b7-b9f15938d925"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:45:43.243654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-51892945-6929-4c9a-b93e-af836b59d5f4 req-532fc139-0508-4f8b-ac56-0c50e2813292 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:43.244217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-51892945-6929-4c9a-b93e-af836b59d5f4 req-532fc139-0508-4f8b-ac56-0c50e2813292 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:43.244701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-51892945-6929-4c9a-b93e-af836b59d5f4 req-532fc139-0508-4f8b-ac56-0c50e2813292 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:43.264286 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-51892945-6929-4c9a-b93e-af836b59d5f4 req-532fc139-0508-4f8b-ac56-0c50e2813292 service nova] Creating event network-changed:5c921a92-8857-466c-b0b7-b9f15938d925 for instance bb455d4d-f629-4593-ab93-67ac87630d84 on n-h2-849328-3 Aug 24 10:45:43.286748 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-51892945-6929-4c9a-b93e-af836b59d5f4 req-532fc139-0508-4f8b-ac56-0c50e2813292 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065027 Aug 24 10:45:43.287296 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2955/5561] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:45:54.236448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:54.237916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=11 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:54.242307 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fed84bb1-c606-498c-a1d7-16316ed48077 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-413089238", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "9e90145c-755e-4d49-bbff-17f29a9eefa3"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:45:54.349246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-fed84bb1-c606-498c-a1d7-16316ed48077 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] validate_networks() for [('9e90145c-755e-4d49-bbff-17f29a9eefa3', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:45:56.081361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fed84bb1-c606-498c-a1d7-16316ed48077 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:45:56.081986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fed84bb1-c606-498c-a1d7-16316ed48077 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:45:56.082262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fed84bb1-c606-498c-a1d7-16316ed48077 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:45:56.083227 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fed84bb1-c606-498c-a1d7-16316ed48077 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:45:56.083639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fed84bb1-c606-498c-a1d7-16316ed48077 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:45:56.095203 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fed84bb1-c606-498c-a1d7-16316ed48077 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:56.096066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fed84bb1-c606-498c-a1d7-16316ed48077 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:56.096797 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fed84bb1-c606-498c-a1d7-16316ed48077 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:56.098969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fed84bb1-c606-498c-a1d7-16316ed48077 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:56.099615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fed84bb1-c606-498c-a1d7-16316ed48077 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:56.100362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fed84bb1-c606-498c-a1d7-16316ed48077 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:56.169395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-fed84bb1-c606-498c-a1d7-16316ed48077 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Getting quotas for project 043846dcb8e74d27b84497e19c8da3dd. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:45:56.182989 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-fed84bb1-c606-498c-a1d7-16316ed48077 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Getting quotas for user 01a60c0bed3b481aa3b50661946be422 and project 043846dcb8e74d27b84497e19c8da3dd. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:45:56.204421 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fed84bb1-c606-498c-a1d7-16316ed48077 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:45:56.209049 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fed84bb1-c606-498c-a1d7-16316ed48077 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: a0ca2e86-b871-4be0-9e3e-bd5d25f65710] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:45:56.387416 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fed84bb1-c606-498c-a1d7-16316ed48077 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.152643 Aug 24 10:45:56.390009 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2607/5562] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:45:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:45:56.405616 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-08ac5521-f348-4159-8db9-d30767d031d6 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:56.406368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-08ac5521-f348-4159-8db9-d30767d031d6 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: a0ca2e86-b871-4be0-9e3e-bd5d25f65710] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:56.429090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=9 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:56.433494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=25 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:56.708087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-83b1815b-a975-4719-a976-ec3432d9a892 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Action: 'create', calling method: .version_select at 0x7f465a259160>, body: {"keypair": {"name": "tempest-keypair-1399095480", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiifXdBs/pppP+jBJvx5hkJeRV99etF6NvokfSycWT76dWPXj45f63xpbNhi339hrLD1V4RIqD/0rvTTV4EA+lr8b65b7383up+UdxLGdBb4VgAAtomtrNBke9BLAQnYg=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:45:56.734588 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-08ac5521-f348-4159-8db9-d30767d031d6 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a60c0bed3b481aa3b50661946be422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043846dcb8e74d27b84497e19c8da3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:56.747600 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-08ac5521-f348-4159-8db9-d30767d031d6 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710" status: 200 len: 1213 microversion: 2.1 time: 0.349966 Aug 24 10:45:56.749468 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2956/5563] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:45:56 2022] GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710 => generated 1213 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:45:56.775740 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-83b1815b-a975-4719-a976-ec3432d9a892 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Getting quotas for project e6b6540f9c574be7b4d1e3aa058938f9. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:45:56.807020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-83b1815b-a975-4719-a976-ec3432d9a892 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Getting quotas for user 13a31e5adc8a4a8b89a9031714ae0496 and project e6b6540f9c574be7b4d1e3aa058938f9. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:45:56.883486 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-83b1815b-a975-4719-a976-ec3432d9a892 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.393766 Aug 24 10:45:56.885718 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2608/5564] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:45:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:45:57.778362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aa6a293c-88da-497c-8775-d5e802276239 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:57.781136 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aa6a293c-88da-497c-8775-d5e802276239 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: a0ca2e86-b871-4be0-9e3e-bd5d25f65710] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:57.792149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa6a293c-88da-497c-8775-d5e802276239 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:57.792931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa6a293c-88da-497c-8775-d5e802276239 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:57.793860 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa6a293c-88da-497c-8775-d5e802276239 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:57.794799 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa6a293c-88da-497c-8775-d5e802276239 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:57.795524 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa6a293c-88da-497c-8775-d5e802276239 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:57.796315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa6a293c-88da-497c-8775-d5e802276239 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:57.969604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aa6a293c-88da-497c-8775-d5e802276239 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a60c0bed3b481aa3b50661946be422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043846dcb8e74d27b84497e19c8da3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:57.983300 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aa6a293c-88da-497c-8775-d5e802276239 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710" status: 200 len: 1265 microversion: 2.1 time: 0.210631 Aug 24 10:45:57.985130 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2957/5565] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:45:57 2022] GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:45:59.005004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6b455b18-e4bd-4ce0-ad51-d03bc110ff40 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:45:59.005708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6b455b18-e4bd-4ce0-ad51-d03bc110ff40 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: a0ca2e86-b871-4be0-9e3e-bd5d25f65710] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:45:59.025230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b455b18-e4bd-4ce0-ad51-d03bc110ff40 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:59.025926 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b455b18-e4bd-4ce0-ad51-d03bc110ff40 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:59.026369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b455b18-e4bd-4ce0-ad51-d03bc110ff40 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:59.027093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b455b18-e4bd-4ce0-ad51-d03bc110ff40 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:45:59.027554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b455b18-e4bd-4ce0-ad51-d03bc110ff40 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:45:59.028036 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b455b18-e4bd-4ce0-ad51-d03bc110ff40 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:45:59.459848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6b455b18-e4bd-4ce0-ad51-d03bc110ff40 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a60c0bed3b481aa3b50661946be422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043846dcb8e74d27b84497e19c8da3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:45:59.475571 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6b455b18-e4bd-4ce0-ad51-d03bc110ff40 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710" status: 200 len: 1271 microversion: 2.1 time: 0.474337 Aug 24 10:45:59.478582 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2609/5566] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:45:58 2022] GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710 => generated 1271 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:00.514816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4c908169-5830-40aa-954a-cd892668d1a9 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:00.515542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4c908169-5830-40aa-954a-cd892668d1a9 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: a0ca2e86-b871-4be0-9e3e-bd5d25f65710] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:00.525920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c908169-5830-40aa-954a-cd892668d1a9 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:00.533644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c908169-5830-40aa-954a-cd892668d1a9 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:00.534569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c908169-5830-40aa-954a-cd892668d1a9 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:00.540365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c908169-5830-40aa-954a-cd892668d1a9 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:00.541499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c908169-5830-40aa-954a-cd892668d1a9 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:00.542276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c908169-5830-40aa-954a-cd892668d1a9 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:02.086933 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-35e53de7-47e9-4818-ab67-bb133f2cb04f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Action: 'create', calling method: .version_select at 0x7f465410c1f0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1815105512", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsNQfZGJQRZ8Mhw7pIzlyoyOiuxkM2DR5EZyoPxwTmPH+woN5GPyvTrWxIS+bOm8rCNcgruv4VYE37itP6FfBzJoegSBTg2zHvRHtQWIdk894cWtlsqy87e/9E9xzeebw=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:46:02.123774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-35e53de7-47e9-4818-ab67-bb133f2cb04f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Getting quotas for project 65e4aa20cf3d44a2b11f47c0c18cfb4d. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:46:02.136616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-35e53de7-47e9-4818-ab67-bb133f2cb04f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Getting quotas for user afd244b0014c4240bca18becdd30a5a0 and project 65e4aa20cf3d44a2b11f47c0c18cfb4d. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:46:02.180142 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-35e53de7-47e9-4818-ab67-bb133f2cb04f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.097550 Aug 24 10:46:02.188689 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2610/5567] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:46:02 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:46:02.505740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4c908169-5830-40aa-954a-cd892668d1a9 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a60c0bed3b481aa3b50661946be422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043846dcb8e74d27b84497e19c8da3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:02.530576 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4c908169-5830-40aa-954a-cd892668d1a9 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710" status: 200 len: 1313 microversion: 2.1 time: 2.028294 Aug 24 10:46:02.549506 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2958/5568] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:00 2022] GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710 => generated 1313 bytes in 2046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:03.457296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-312261eb-07f9-4975-8d96-0c94d943b2d4 req-73de53d7-3de4-418d-bc06-90ec8b70c68e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0ca2e86-b871-4be0-9e3e-bd5d25f65710", "tag": "7a5635ef-2089-4856-8731-724bbc3df1a4"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:46:03.484345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-312261eb-07f9-4975-8d96-0c94d943b2d4 req-73de53d7-3de4-418d-bc06-90ec8b70c68e service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:03.484829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-312261eb-07f9-4975-8d96-0c94d943b2d4 req-73de53d7-3de4-418d-bc06-90ec8b70c68e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:03.485291 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-312261eb-07f9-4975-8d96-0c94d943b2d4 req-73de53d7-3de4-418d-bc06-90ec8b70c68e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:03.518789 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-312261eb-07f9-4975-8d96-0c94d943b2d4 req-73de53d7-3de4-418d-bc06-90ec8b70c68e service nova] Creating event network-changed:7a5635ef-2089-4856-8731-724bbc3df1a4 for instance a0ca2e86-b871-4be0-9e3e-bd5d25f65710 on n-h1-849328-3 Aug 24 10:46:03.531176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a1c2cd13-31c3-4c9f-8c58-363095f44b6c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1051905963", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d2342762-930c-4062-9d55-9242a18d3dd8"}], "security_groups": [{"name": "tempest-securitygroup--1818799094"}], "key_name": "tempest-keypair-1399095480", "user_data": "}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:46:03.548817 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-312261eb-07f9-4975-8d96-0c94d943b2d4 req-73de53d7-3de4-418d-bc06-90ec8b70c68e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093243 Aug 24 10:46:03.549569 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2611/5569] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:46:03.561039 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3dca9fd7-d65e-437a-b05b-509e5798f2fa tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:03.567257 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3dca9fd7-d65e-437a-b05b-509e5798f2fa tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: a0ca2e86-b871-4be0-9e3e-bd5d25f65710] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:03.590770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dca9fd7-d65e-437a-b05b-509e5798f2fa tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:03.591270 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dca9fd7-d65e-437a-b05b-509e5798f2fa tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:03.591700 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dca9fd7-d65e-437a-b05b-509e5798f2fa tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:03.592613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dca9fd7-d65e-437a-b05b-509e5798f2fa tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:03.593446 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dca9fd7-d65e-437a-b05b-509e5798f2fa tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:03.594058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dca9fd7-d65e-437a-b05b-509e5798f2fa tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:03.906826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-a1c2cd13-31c3-4c9f-8c58-363095f44b6c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] validate_networks() for [('d2342762-930c-4062-9d55-9242a18d3dd8', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:46:04.017909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3dca9fd7-d65e-437a-b05b-509e5798f2fa tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a60c0bed3b481aa3b50661946be422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043846dcb8e74d27b84497e19c8da3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:04.032082 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3dca9fd7-d65e-437a-b05b-509e5798f2fa tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710" status: 200 len: 1313 microversion: 2.1 time: 0.473868 Aug 24 10:46:04.033989 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2612/5570] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:03 2022] GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710 => generated 1313 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:46:05.062195 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-532c0e6a-b216-4863-a5e7-1d36998163fe tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:05.062811 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-532c0e6a-b216-4863-a5e7-1d36998163fe tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: a0ca2e86-b871-4be0-9e3e-bd5d25f65710] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:05.073155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-532c0e6a-b216-4863-a5e7-1d36998163fe tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:05.073968 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-532c0e6a-b216-4863-a5e7-1d36998163fe tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:05.074599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-532c0e6a-b216-4863-a5e7-1d36998163fe tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:05.076381 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-532c0e6a-b216-4863-a5e7-1d36998163fe tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:05.080114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-532c0e6a-b216-4863-a5e7-1d36998163fe tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:05.081307 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-532c0e6a-b216-4863-a5e7-1d36998163fe tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:05.543270 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-532c0e6a-b216-4863-a5e7-1d36998163fe tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a60c0bed3b481aa3b50661946be422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043846dcb8e74d27b84497e19c8da3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:05.558425 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-532c0e6a-b216-4863-a5e7-1d36998163fe tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710" status: 200 len: 1313 microversion: 2.1 time: 0.501085 Aug 24 10:46:05.573773 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2613/5571] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:05 2022] GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710 => generated 1313 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:05.597209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a1c2cd13-31c3-4c9f-8c58-363095f44b6c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:46:05.598079 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a1c2cd13-31c3-4c9f-8c58-363095f44b6c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:46:05.598811 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a1c2cd13-31c3-4c9f-8c58-363095f44b6c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:46:05.599421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a1c2cd13-31c3-4c9f-8c58-363095f44b6c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:46:05.600171 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a1c2cd13-31c3-4c9f-8c58-363095f44b6c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:46:05.611640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1c2cd13-31c3-4c9f-8c58-363095f44b6c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:05.612134 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1c2cd13-31c3-4c9f-8c58-363095f44b6c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:05.612769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1c2cd13-31c3-4c9f-8c58-363095f44b6c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:05.613789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1c2cd13-31c3-4c9f-8c58-363095f44b6c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:05.614263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1c2cd13-31c3-4c9f-8c58-363095f44b6c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:05.614697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1c2cd13-31c3-4c9f-8c58-363095f44b6c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:05.638863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-a1c2cd13-31c3-4c9f-8c58-363095f44b6c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Getting quotas for project e6b6540f9c574be7b4d1e3aa058938f9. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:46:05.650521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-a1c2cd13-31c3-4c9f-8c58-363095f44b6c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Getting quotas for user 13a31e5adc8a4a8b89a9031714ae0496 and project e6b6540f9c574be7b4d1e3aa058938f9. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:46:05.667266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a1c2cd13-31c3-4c9f-8c58-363095f44b6c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:46:05.671181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a1c2cd13-31c3-4c9f-8c58-363095f44b6c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:46:05.740224 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a1c2cd13-31c3-4c9f-8c58-363095f44b6c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.215351 Aug 24 10:46:05.743483 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2959/5572] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:46:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 2220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:46:05.765345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-477ec35b-92a3-4852-8899-b1dca01b991d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:05.766966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-477ec35b-92a3-4852-8899-b1dca01b991d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:06.139300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:06.215481 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-477ec35b-92a3-4852-8899-b1dca01b991d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:06.226254 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-477ec35b-92a3-4852-8899-b1dca01b991d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1238 microversion: 2.1 time: 0.475205 Aug 24 10:46:06.227580 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2614/5573] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:05 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1238 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:06.489352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c36e6c40-af42-411a-a9de-0df442c1f81d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1613214780", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "3f482667-39ee-440f-8684-f9398ea44c79"}], "key_name": "tempest-TestNetworkBasicOps-1815105512", "security_groups": [{"name": "tempest-secgroup-smoke-1164036449"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:46:06.580742 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-21d5e675-b722-45af-b4e5-4e54bfbb3a6e tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:06.581432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-21d5e675-b722-45af-b4e5-4e54bfbb3a6e tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: a0ca2e86-b871-4be0-9e3e-bd5d25f65710] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:06.591872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21d5e675-b722-45af-b4e5-4e54bfbb3a6e tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:06.593028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21d5e675-b722-45af-b4e5-4e54bfbb3a6e tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:06.593894 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21d5e675-b722-45af-b4e5-4e54bfbb3a6e tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:06.595766 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21d5e675-b722-45af-b4e5-4e54bfbb3a6e tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:06.596958 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21d5e675-b722-45af-b4e5-4e54bfbb3a6e tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:06.597932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21d5e675-b722-45af-b4e5-4e54bfbb3a6e tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:06.684546 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-c36e6c40-af42-411a-a9de-0df442c1f81d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] validate_networks() for [('3f482667-39ee-440f-8684-f9398ea44c79', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:46:07.006409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-21d5e675-b722-45af-b4e5-4e54bfbb3a6e tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a60c0bed3b481aa3b50661946be422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043846dcb8e74d27b84497e19c8da3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:07.022986 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-21d5e675-b722-45af-b4e5-4e54bfbb3a6e tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710" status: 200 len: 1313 microversion: 2.1 time: 0.446393 Aug 24 10:46:07.026233 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2615/5574] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:06 2022] GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710 => generated 1313 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:07.249440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-95dc2342-0929-46ed-976a-11fc4006f8ba tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:07.249977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-95dc2342-0929-46ed-976a-11fc4006f8ba tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:07.257243 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95dc2342-0929-46ed-976a-11fc4006f8ba tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:07.264462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95dc2342-0929-46ed-976a-11fc4006f8ba tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:07.265815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95dc2342-0929-46ed-976a-11fc4006f8ba tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:07.266603 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95dc2342-0929-46ed-976a-11fc4006f8ba tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:07.270030 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95dc2342-0929-46ed-976a-11fc4006f8ba tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:07.270542 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95dc2342-0929-46ed-976a-11fc4006f8ba tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:07.636242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-95dc2342-0929-46ed-976a-11fc4006f8ba tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:07.649474 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-95dc2342-0929-46ed-976a-11fc4006f8ba tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1298 microversion: 2.1 time: 0.404851 Aug 24 10:46:07.663373 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2616/5575] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:07 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1298 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:07.970125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c36e6c40-af42-411a-a9de-0df442c1f81d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:46:07.971513 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c36e6c40-af42-411a-a9de-0df442c1f81d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:46:07.971891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c36e6c40-af42-411a-a9de-0df442c1f81d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:46:07.972556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c36e6c40-af42-411a-a9de-0df442c1f81d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:46:07.972906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c36e6c40-af42-411a-a9de-0df442c1f81d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:46:07.984081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c36e6c40-af42-411a-a9de-0df442c1f81d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:07.984604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c36e6c40-af42-411a-a9de-0df442c1f81d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:07.985032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c36e6c40-af42-411a-a9de-0df442c1f81d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:07.986091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c36e6c40-af42-411a-a9de-0df442c1f81d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:07.986610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c36e6c40-af42-411a-a9de-0df442c1f81d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:07.987268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c36e6c40-af42-411a-a9de-0df442c1f81d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:08.007434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-c36e6c40-af42-411a-a9de-0df442c1f81d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Getting quotas for project 65e4aa20cf3d44a2b11f47c0c18cfb4d. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:46:08.013919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-c36e6c40-af42-411a-a9de-0df442c1f81d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Getting quotas for user afd244b0014c4240bca18becdd30a5a0 and project 65e4aa20cf3d44a2b11f47c0c18cfb4d. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:46:08.029087 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c36e6c40-af42-411a-a9de-0df442c1f81d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:46:08.032006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c36e6c40-af42-411a-a9de-0df442c1f81d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:46:08.051355 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4ed769a7-2d12-4259-8171-f1490d22ac93 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:08.053345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4ed769a7-2d12-4259-8171-f1490d22ac93 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: a0ca2e86-b871-4be0-9e3e-bd5d25f65710] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:08.069232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ed769a7-2d12-4259-8171-f1490d22ac93 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:08.070325 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ed769a7-2d12-4259-8171-f1490d22ac93 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:08.071157 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ed769a7-2d12-4259-8171-f1490d22ac93 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:08.073373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ed769a7-2d12-4259-8171-f1490d22ac93 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:08.074415 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ed769a7-2d12-4259-8171-f1490d22ac93 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:08.076128 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ed769a7-2d12-4259-8171-f1490d22ac93 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:08.086045 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c36e6c40-af42-411a-a9de-0df442c1f81d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.603305 Aug 24 10:46:08.087307 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2960/5576] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:46:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:46:08.113778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-812ec891-5f63-4a63-826e-e13d68386cbc tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:08.115582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-812ec891-5f63-4a63-826e-e13d68386cbc tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:08.257566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-812ec891-5f63-4a63-826e-e13d68386cbc tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:08.274015 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-812ec891-5f63-4a63-826e-e13d68386cbc tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a" status: 200 len: 1249 microversion: 2.1 time: 0.178961 Aug 24 10:46:08.285142 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2961/5577] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:08 2022] GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a => generated 1249 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:08.429454 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4ed769a7-2d12-4259-8171-f1490d22ac93 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a60c0bed3b481aa3b50661946be422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043846dcb8e74d27b84497e19c8da3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:08.442297 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4ed769a7-2d12-4259-8171-f1490d22ac93 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710" status: 200 len: 1313 microversion: 2.1 time: 0.396282 Aug 24 10:46:08.443488 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2617/5578] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:08 2022] GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710 => generated 1313 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:46:08.676613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f7213f11-38db-4671-9167-8fba896b4d9e tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:08.678372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f7213f11-38db-4671-9167-8fba896b4d9e tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:08.697434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7213f11-38db-4671-9167-8fba896b4d9e tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:08.698231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7213f11-38db-4671-9167-8fba896b4d9e tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:08.698800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7213f11-38db-4671-9167-8fba896b4d9e tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:08.699676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7213f11-38db-4671-9167-8fba896b4d9e tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:08.700143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7213f11-38db-4671-9167-8fba896b4d9e tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:08.700917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7213f11-38db-4671-9167-8fba896b4d9e tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:08.830573 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f7213f11-38db-4671-9167-8fba896b4d9e tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:08.853638 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f7213f11-38db-4671-9167-8fba896b4d9e tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1296 microversion: 2.1 time: 0.169096 Aug 24 10:46:08.854752 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2962/5579] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:08 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1296 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:09.300142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3a25bad9-3050-4c61-9a5d-992bfac819d6 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:09.301343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3a25bad9-3050-4c61-9a5d-992bfac819d6 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:09.312943 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a25bad9-3050-4c61-9a5d-992bfac819d6 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:09.313552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a25bad9-3050-4c61-9a5d-992bfac819d6 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:09.314073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a25bad9-3050-4c61-9a5d-992bfac819d6 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:09.314964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a25bad9-3050-4c61-9a5d-992bfac819d6 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:09.315632 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a25bad9-3050-4c61-9a5d-992bfac819d6 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:09.316101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a25bad9-3050-4c61-9a5d-992bfac819d6 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:09.471216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6c076c27-aefe-4bc0-9472-1994fbe77e78 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:09.477850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6c076c27-aefe-4bc0-9472-1994fbe77e78 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: a0ca2e86-b871-4be0-9e3e-bd5d25f65710] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:09.497398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c076c27-aefe-4bc0-9472-1994fbe77e78 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:09.499519 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c076c27-aefe-4bc0-9472-1994fbe77e78 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:09.500059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c076c27-aefe-4bc0-9472-1994fbe77e78 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:09.501892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c076c27-aefe-4bc0-9472-1994fbe77e78 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:09.505418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c076c27-aefe-4bc0-9472-1994fbe77e78 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:09.507375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c076c27-aefe-4bc0-9472-1994fbe77e78 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:09.654656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3a25bad9-3050-4c61-9a5d-992bfac819d6 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:09.666394 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3a25bad9-3050-4c61-9a5d-992bfac819d6 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a" status: 200 len: 1301 microversion: 2.1 time: 0.371212 Aug 24 10:46:09.668272 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2618/5580] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:09 2022] GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a => generated 1301 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:09.767197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-931da3d8-4660-4a1d-8f85-7b5330ab0362 req-2d15926d-a405-47ac-a540-1427ddca394a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0ca2e86-b871-4be0-9e3e-bd5d25f65710", "name": "network-vif-plugged", "status": "completed", "tag": "7a5635ef-2089-4856-8731-724bbc3df1a4"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:46:09.781561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-931da3d8-4660-4a1d-8f85-7b5330ab0362 req-2d15926d-a405-47ac-a540-1427ddca394a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:09.782510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-931da3d8-4660-4a1d-8f85-7b5330ab0362 req-2d15926d-a405-47ac-a540-1427ddca394a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:09.783540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-931da3d8-4660-4a1d-8f85-7b5330ab0362 req-2d15926d-a405-47ac-a540-1427ddca394a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:09.800944 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-931da3d8-4660-4a1d-8f85-7b5330ab0362 req-2d15926d-a405-47ac-a540-1427ddca394a service nova] Creating event network-vif-plugged:7a5635ef-2089-4856-8731-724bbc3df1a4 for instance a0ca2e86-b871-4be0-9e3e-bd5d25f65710 on n-h1-849328-3 Aug 24 10:46:09.808059 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-931da3d8-4660-4a1d-8f85-7b5330ab0362 req-2d15926d-a405-47ac-a540-1427ddca394a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048613 Aug 24 10:46:09.809462 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2619/5581] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:46:09.883271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-167c07c9-6907-4790-8279-8e26b8865be4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:09.884003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-167c07c9-6907-4790-8279-8e26b8865be4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:09.900256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-167c07c9-6907-4790-8279-8e26b8865be4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:09.901872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-167c07c9-6907-4790-8279-8e26b8865be4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:09.902372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-167c07c9-6907-4790-8279-8e26b8865be4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:09.903939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-167c07c9-6907-4790-8279-8e26b8865be4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:09.905318 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-167c07c9-6907-4790-8279-8e26b8865be4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:09.906101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-167c07c9-6907-4790-8279-8e26b8865be4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:10.038962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6c076c27-aefe-4bc0-9472-1994fbe77e78 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a60c0bed3b481aa3b50661946be422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043846dcb8e74d27b84497e19c8da3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:10.048231 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6c076c27-aefe-4bc0-9472-1994fbe77e78 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710" status: 200 len: 1313 microversion: 2.1 time: 0.587041 Aug 24 10:46:10.048948 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2963/5582] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:09 2022] GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710 => generated 1313 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:10.349702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-167c07c9-6907-4790-8279-8e26b8865be4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:10.359427 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-167c07c9-6907-4790-8279-8e26b8865be4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1364 microversion: 2.1 time: 0.486409 Aug 24 10:46:10.360796 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2620/5583] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:09 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1364 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:10.691692 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6fb299a4-6445-46c9-b9a1-16021f7c837b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:10.694924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6fb299a4-6445-46c9-b9a1-16021f7c837b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:10.707700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fb299a4-6445-46c9-b9a1-16021f7c837b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:10.709328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fb299a4-6445-46c9-b9a1-16021f7c837b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:10.710791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fb299a4-6445-46c9-b9a1-16021f7c837b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:10.712504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fb299a4-6445-46c9-b9a1-16021f7c837b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:10.713683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fb299a4-6445-46c9-b9a1-16021f7c837b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:10.714350 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fb299a4-6445-46c9-b9a1-16021f7c837b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:10.906854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-7ab5e376-158d-4c95-9b32-4357c90b3139 req-4d6d1485-4dee-424e-8496-6b31668f80cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46ecd5ee-6e65-441c-b75e-941757d51a02", "tag": "ebd92acf-1a09-43c5-9f1b-7347cd1cbc5e"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:46:10.917776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7ab5e376-158d-4c95-9b32-4357c90b3139 req-4d6d1485-4dee-424e-8496-6b31668f80cd service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:10.918659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7ab5e376-158d-4c95-9b32-4357c90b3139 req-4d6d1485-4dee-424e-8496-6b31668f80cd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:10.919183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7ab5e376-158d-4c95-9b32-4357c90b3139 req-4d6d1485-4dee-424e-8496-6b31668f80cd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:10.954717 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7ab5e376-158d-4c95-9b32-4357c90b3139 req-4d6d1485-4dee-424e-8496-6b31668f80cd service nova] Creating event network-changed:ebd92acf-1a09-43c5-9f1b-7347cd1cbc5e for instance 46ecd5ee-6e65-441c-b75e-941757d51a02 on n-h1-849328-3 Aug 24 10:46:10.963409 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-7ab5e376-158d-4c95-9b32-4357c90b3139 req-4d6d1485-4dee-424e-8496-6b31668f80cd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060326 Aug 24 10:46:10.966771 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2621/5584] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:46:11.070214 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-95404fb0-e49e-46c2-a8a9-1ac8d1957a83 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:11.070921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-95404fb0-e49e-46c2-a8a9-1ac8d1957a83 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: a0ca2e86-b871-4be0-9e3e-bd5d25f65710] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:11.078153 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95404fb0-e49e-46c2-a8a9-1ac8d1957a83 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:11.078912 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95404fb0-e49e-46c2-a8a9-1ac8d1957a83 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:11.079353 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95404fb0-e49e-46c2-a8a9-1ac8d1957a83 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:11.080068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95404fb0-e49e-46c2-a8a9-1ac8d1957a83 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:11.080515 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95404fb0-e49e-46c2-a8a9-1ac8d1957a83 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:11.081152 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95404fb0-e49e-46c2-a8a9-1ac8d1957a83 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:11.097066 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6fb299a4-6445-46c9-b9a1-16021f7c837b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:11.106268 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6fb299a4-6445-46c9-b9a1-16021f7c837b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a" status: 200 len: 1307 microversion: 2.1 time: 0.421563 Aug 24 10:46:11.107621 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2964/5585] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:10 2022] GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a => generated 1307 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:11.381794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-03ba3778-47b6-437e-b854-fd18862bea47 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:11.382690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-03ba3778-47b6-437e-b854-fd18862bea47 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:11.391842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03ba3778-47b6-437e-b854-fd18862bea47 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:11.392933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03ba3778-47b6-437e-b854-fd18862bea47 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:11.392933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03ba3778-47b6-437e-b854-fd18862bea47 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:11.401044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03ba3778-47b6-437e-b854-fd18862bea47 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:11.401819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03ba3778-47b6-437e-b854-fd18862bea47 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:11.402755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03ba3778-47b6-437e-b854-fd18862bea47 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:11.442705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-95404fb0-e49e-46c2-a8a9-1ac8d1957a83 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a60c0bed3b481aa3b50661946be422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043846dcb8e74d27b84497e19c8da3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:11.458865 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-95404fb0-e49e-46c2-a8a9-1ac8d1957a83 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710" status: 200 len: 1313 microversion: 2.1 time: 0.392821 Aug 24 10:46:11.473302 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2622/5586] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:11 2022] GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710 => generated 1313 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:11.961024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-03ba3778-47b6-437e-b854-fd18862bea47 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:11.980870 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-03ba3778-47b6-437e-b854-fd18862bea47 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1364 microversion: 2.1 time: 0.602914 Aug 24 10:46:11.982037 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2965/5587] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:11 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1364 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:12.128922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2e93bd9b-c1d8-400c-8813-c005957cdaca tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:12.129572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2e93bd9b-c1d8-400c-8813-c005957cdaca tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:12.141361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e93bd9b-c1d8-400c-8813-c005957cdaca tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:12.142074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e93bd9b-c1d8-400c-8813-c005957cdaca tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:12.142686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e93bd9b-c1d8-400c-8813-c005957cdaca tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:12.143573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e93bd9b-c1d8-400c-8813-c005957cdaca tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:12.144269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e93bd9b-c1d8-400c-8813-c005957cdaca tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:12.144879 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e93bd9b-c1d8-400c-8813-c005957cdaca tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:12.496562 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2e93bd9b-c1d8-400c-8813-c005957cdaca tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:12.497226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bde81d0a-443a-4df5-bb7e-a196a2fec00e tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:12.497918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bde81d0a-443a-4df5-bb7e-a196a2fec00e tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: a0ca2e86-b871-4be0-9e3e-bd5d25f65710] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:12.507250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bde81d0a-443a-4df5-bb7e-a196a2fec00e tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:12.513247 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bde81d0a-443a-4df5-bb7e-a196a2fec00e tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:12.514418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bde81d0a-443a-4df5-bb7e-a196a2fec00e tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:12.514547 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2e93bd9b-c1d8-400c-8813-c005957cdaca tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a" status: 200 len: 1375 microversion: 2.1 time: 0.388403 Aug 24 10:46:12.515772 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2623/5588] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:12 2022] GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a => generated 1375 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:46:12.518509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bde81d0a-443a-4df5-bb7e-a196a2fec00e tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:12.519055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bde81d0a-443a-4df5-bb7e-a196a2fec00e tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:12.519669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bde81d0a-443a-4df5-bb7e-a196a2fec00e tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:13.003055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-58bb79a8-e48b-44f4-8d56-8d7bfb3b4f73 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:13.003055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-58bb79a8-e48b-44f4-8d56-8d7bfb3b4f73 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:13.010724 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58bb79a8-e48b-44f4-8d56-8d7bfb3b4f73 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:13.011218 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58bb79a8-e48b-44f4-8d56-8d7bfb3b4f73 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:13.011653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58bb79a8-e48b-44f4-8d56-8d7bfb3b4f73 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:13.012373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58bb79a8-e48b-44f4-8d56-8d7bfb3b4f73 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:13.012820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58bb79a8-e48b-44f4-8d56-8d7bfb3b4f73 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:13.013335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58bb79a8-e48b-44f4-8d56-8d7bfb3b4f73 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:13.018594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bde81d0a-443a-4df5-bb7e-a196a2fec00e tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a60c0bed3b481aa3b50661946be422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043846dcb8e74d27b84497e19c8da3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:13.028912 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bde81d0a-443a-4df5-bb7e-a196a2fec00e tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710" status: 200 len: 1497 microversion: 2.1 time: 0.536613 Aug 24 10:46:13.041146 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2966/5589] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:12 2022] GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710 => generated 1497 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:46:13.357856 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-58bb79a8-e48b-44f4-8d56-8d7bfb3b4f73 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:13.379616 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-58bb79a8-e48b-44f4-8d56-8d7bfb3b4f73 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1364 microversion: 2.1 time: 0.381273 Aug 24 10:46:13.381522 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2624/5590] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:12 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1364 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:46:13.416572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-9aadeb84-fc13-4456-bb87-e1d4375f8920 req-1e682a89-e6ee-449c-8411-d4c6b80efefe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a", "tag": "4dc64609-6aa6-499b-b626-48b0729bc4ed"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:46:13.435025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9aadeb84-fc13-4456-bb87-e1d4375f8920 req-1e682a89-e6ee-449c-8411-d4c6b80efefe service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:13.436171 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9aadeb84-fc13-4456-bb87-e1d4375f8920 req-1e682a89-e6ee-449c-8411-d4c6b80efefe service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:13.436858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9aadeb84-fc13-4456-bb87-e1d4375f8920 req-1e682a89-e6ee-449c-8411-d4c6b80efefe service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:13.454213 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-9aadeb84-fc13-4456-bb87-e1d4375f8920 req-1e682a89-e6ee-449c-8411-d4c6b80efefe service nova] Creating event network-changed:4dc64609-6aa6-499b-b626-48b0729bc4ed for instance a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a on n-h2-849328-3 Aug 24 10:46:13.474475 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-9aadeb84-fc13-4456-bb87-e1d4375f8920 req-1e682a89-e6ee-449c-8411-d4c6b80efefe service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067081 Aug 24 10:46:13.477186 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2967/5591] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:46:13.538109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e2cd6ec6-1215-4479-9192-54c164294f19 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:13.541159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e2cd6ec6-1215-4479-9192-54c164294f19 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:13.557633 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2cd6ec6-1215-4479-9192-54c164294f19 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:13.558619 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2cd6ec6-1215-4479-9192-54c164294f19 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:13.562469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2cd6ec6-1215-4479-9192-54c164294f19 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:13.563880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2cd6ec6-1215-4479-9192-54c164294f19 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:13.589994 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2cd6ec6-1215-4479-9192-54c164294f19 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:13.598005 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2cd6ec6-1215-4479-9192-54c164294f19 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:13.631187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-196236fc-d1fe-40aa-8db6-625a4ca01533 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:13.632339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-196236fc-d1fe-40aa-8db6-625a4ca01533 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: a0ca2e86-b871-4be0-9e3e-bd5d25f65710] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:13.661744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-196236fc-d1fe-40aa-8db6-625a4ca01533 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:13.662723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-196236fc-d1fe-40aa-8db6-625a4ca01533 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:13.663587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-196236fc-d1fe-40aa-8db6-625a4ca01533 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:13.665071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-196236fc-d1fe-40aa-8db6-625a4ca01533 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:13.665757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-196236fc-d1fe-40aa-8db6-625a4ca01533 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:13.666463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-196236fc-d1fe-40aa-8db6-625a4ca01533 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:13.721428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-196236fc-d1fe-40aa-8db6-625a4ca01533 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: a0ca2e86-b871-4be0-9e3e-bd5d25f65710] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:46:13.905231 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-196236fc-d1fe-40aa-8db6-625a4ca01533 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710" status: 204 len: 0 microversion: 2.1 time: 0.277461 Aug 24 10:46:13.906445 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2968/5592] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:46:13 2022] DELETE /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 10:46:13.919439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bb10a17a-9f03-4c6a-bb5f-19bed358e1c4 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:13.920899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bb10a17a-9f03-4c6a-bb5f-19bed358e1c4 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: a0ca2e86-b871-4be0-9e3e-bd5d25f65710] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:13.930837 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb10a17a-9f03-4c6a-bb5f-19bed358e1c4 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:13.931796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb10a17a-9f03-4c6a-bb5f-19bed358e1c4 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:13.932525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb10a17a-9f03-4c6a-bb5f-19bed358e1c4 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:13.933751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb10a17a-9f03-4c6a-bb5f-19bed358e1c4 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:13.935815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb10a17a-9f03-4c6a-bb5f-19bed358e1c4 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:13.936768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb10a17a-9f03-4c6a-bb5f-19bed358e1c4 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:14.108749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e2cd6ec6-1215-4479-9192-54c164294f19 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:14.129804 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e2cd6ec6-1215-4479-9192-54c164294f19 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a" status: 200 len: 1375 microversion: 2.1 time: 0.596953 Aug 24 10:46:14.145798 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2625/5593] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:13 2022] GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a => generated 1375 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:14.402445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1eae2d4d-fe65-417c-b5c0-76cb47a10add tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:14.403319 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1eae2d4d-fe65-417c-b5c0-76cb47a10add tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:14.426110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eae2d4d-fe65-417c-b5c0-76cb47a10add tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:14.426974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eae2d4d-fe65-417c-b5c0-76cb47a10add tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:14.428616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eae2d4d-fe65-417c-b5c0-76cb47a10add tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:14.429626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eae2d4d-fe65-417c-b5c0-76cb47a10add tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:14.430299 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eae2d4d-fe65-417c-b5c0-76cb47a10add tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:14.430951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eae2d4d-fe65-417c-b5c0-76cb47a10add tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:14.543330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bb10a17a-9f03-4c6a-bb5f-19bed358e1c4 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a60c0bed3b481aa3b50661946be422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043846dcb8e74d27b84497e19c8da3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:14.553371 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bb10a17a-9f03-4c6a-bb5f-19bed358e1c4 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710" status: 200 len: 1503 microversion: 2.1 time: 0.642097 Aug 24 10:46:14.554996 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2969/5594] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:13 2022] GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710 => generated 1503 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:14.759096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1eae2d4d-fe65-417c-b5c0-76cb47a10add tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:14.772010 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1eae2d4d-fe65-417c-b5c0-76cb47a10add tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1364 microversion: 2.1 time: 0.373902 Aug 24 10:46:14.773087 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2626/5595] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:14 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1364 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:15.166160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dc398ec5-9e30-4da3-8efa-de7e77f7f06b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:15.170907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dc398ec5-9e30-4da3-8efa-de7e77f7f06b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:15.186977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc398ec5-9e30-4da3-8efa-de7e77f7f06b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:15.188871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc398ec5-9e30-4da3-8efa-de7e77f7f06b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:15.189031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc398ec5-9e30-4da3-8efa-de7e77f7f06b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:15.193903 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc398ec5-9e30-4da3-8efa-de7e77f7f06b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:15.194752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc398ec5-9e30-4da3-8efa-de7e77f7f06b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:15.195529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc398ec5-9e30-4da3-8efa-de7e77f7f06b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:15.518658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dc398ec5-9e30-4da3-8efa-de7e77f7f06b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:15.531427 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dc398ec5-9e30-4da3-8efa-de7e77f7f06b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a" status: 200 len: 1375 microversion: 2.1 time: 0.376190 Aug 24 10:46:15.533563 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2970/5596] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:15 2022] GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a => generated 1375 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:46:15.578440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2a8827ab-c4c3-4d0b-b1d0-ab379ccb3e43 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:15.579272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2a8827ab-c4c3-4d0b-b1d0-ab379ccb3e43 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: a0ca2e86-b871-4be0-9e3e-bd5d25f65710] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:15.590992 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a8827ab-c4c3-4d0b-b1d0-ab379ccb3e43 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:15.591507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a8827ab-c4c3-4d0b-b1d0-ab379ccb3e43 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:15.592109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a8827ab-c4c3-4d0b-b1d0-ab379ccb3e43 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:15.593316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a8827ab-c4c3-4d0b-b1d0-ab379ccb3e43 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:15.594382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a8827ab-c4c3-4d0b-b1d0-ab379ccb3e43 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:15.595049 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a8827ab-c4c3-4d0b-b1d0-ab379ccb3e43 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:15.796842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6d40a2ab-3ed4-4f46-a785-be5007311a51 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:15.797645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6d40a2ab-3ed4-4f46-a785-be5007311a51 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:15.812780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d40a2ab-3ed4-4f46-a785-be5007311a51 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:15.816552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d40a2ab-3ed4-4f46-a785-be5007311a51 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:15.817407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d40a2ab-3ed4-4f46-a785-be5007311a51 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:15.818762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d40a2ab-3ed4-4f46-a785-be5007311a51 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:15.819606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d40a2ab-3ed4-4f46-a785-be5007311a51 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:15.820405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d40a2ab-3ed4-4f46-a785-be5007311a51 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:16.008542 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2a8827ab-c4c3-4d0b-b1d0-ab379ccb3e43 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a60c0bed3b481aa3b50661946be422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043846dcb8e74d27b84497e19c8da3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:16.021777 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2a8827ab-c4c3-4d0b-b1d0-ab379ccb3e43 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710" status: 200 len: 1503 microversion: 2.1 time: 0.449035 Aug 24 10:46:16.022655 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2627/5597] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:15 2022] GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710 => generated 1503 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:16.236005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6d40a2ab-3ed4-4f46-a785-be5007311a51 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:16.247035 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6d40a2ab-3ed4-4f46-a785-be5007311a51 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1364 microversion: 2.1 time: 0.453917 Aug 24 10:46:16.248618 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2971/5598] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:15 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1364 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:16.560356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7ff8b51d-6cdb-4036-942a-a4a299986d1f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:16.561673 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7ff8b51d-6cdb-4036-942a-a4a299986d1f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:16.566248 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=16 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:16.578928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ff8b51d-6cdb-4036-942a-a4a299986d1f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:16.581059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ff8b51d-6cdb-4036-942a-a4a299986d1f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:16.581984 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ff8b51d-6cdb-4036-942a-a4a299986d1f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:16.582973 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ff8b51d-6cdb-4036-942a-a4a299986d1f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:16.584659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ff8b51d-6cdb-4036-942a-a4a299986d1f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:16.585470 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ff8b51d-6cdb-4036-942a-a4a299986d1f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:16.732840 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-43043870-be46-4c42-872d-0c69918507c5 req-45c24121-e0f2-4b0a-aa5f-eaed098b9db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0ca2e86-b871-4be0-9e3e-bd5d25f65710", "name": "network-vif-deleted", "tag": "7a5635ef-2089-4856-8731-724bbc3df1a4"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:46:16.763188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-43043870-be46-4c42-872d-0c69918507c5 req-45c24121-e0f2-4b0a-aa5f-eaed098b9db9 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:16.765620 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-43043870-be46-4c42-872d-0c69918507c5 req-45c24121-e0f2-4b0a-aa5f-eaed098b9db9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:16.766761 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-43043870-be46-4c42-872d-0c69918507c5 req-45c24121-e0f2-4b0a-aa5f-eaed098b9db9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:16.788457 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-43043870-be46-4c42-872d-0c69918507c5 req-45c24121-e0f2-4b0a-aa5f-eaed098b9db9 service nova] Creating event network-vif-deleted:7a5635ef-2089-4856-8731-724bbc3df1a4 for instance a0ca2e86-b871-4be0-9e3e-bd5d25f65710 on n-h1-849328-3 Aug 24 10:46:16.796048 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-43043870-be46-4c42-872d-0c69918507c5 req-45c24121-e0f2-4b0a-aa5f-eaed098b9db9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068019 Aug 24 10:46:16.797690 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2972/5599] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:46:16.918444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7ff8b51d-6cdb-4036-942a-a4a299986d1f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:16.928401 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7ff8b51d-6cdb-4036-942a-a4a299986d1f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a" status: 200 len: 1375 microversion: 2.1 time: 0.377423 Aug 24 10:46:16.928954 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2628/5600] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:16 2022] GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a => generated 1375 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:17.045556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-38d218b3-6c16-4a17-9fe7-152263d0d9c6 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:17.046425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-38d218b3-6c16-4a17-9fe7-152263d0d9c6 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: a0ca2e86-b871-4be0-9e3e-bd5d25f65710] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:17.053310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38d218b3-6c16-4a17-9fe7-152263d0d9c6 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:17.053950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38d218b3-6c16-4a17-9fe7-152263d0d9c6 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:17.054530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38d218b3-6c16-4a17-9fe7-152263d0d9c6 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:17.055380 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38d218b3-6c16-4a17-9fe7-152263d0d9c6 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:17.055940 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38d218b3-6c16-4a17-9fe7-152263d0d9c6 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:17.056470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38d218b3-6c16-4a17-9fe7-152263d0d9c6 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:17.105567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38d218b3-6c16-4a17-9fe7-152263d0d9c6 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:17.106198 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38d218b3-6c16-4a17-9fe7-152263d0d9c6 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:17.106991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38d218b3-6c16-4a17-9fe7-152263d0d9c6 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:17.107806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-38d218b3-6c16-4a17-9fe7-152263d0d9c6 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lazy-loading 'fault' on Instance uuid a0ca2e86-b871-4be0-9e3e-bd5d25f65710 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:46:17.248545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-38d218b3-6c16-4a17-9fe7-152263d0d9c6 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a60c0bed3b481aa3b50661946be422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043846dcb8e74d27b84497e19c8da3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:17.260241 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-38d218b3-6c16-4a17-9fe7-152263d0d9c6 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710" status: 200 len: 1303 microversion: 2.1 time: 0.218552 Aug 24 10:46:17.267357 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2973/5601] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:17 2022] GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710 => generated 1303 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:46:17.282841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-51679ad2-5b28-45a1-8e8e-3e69524b9554 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:17.283823 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-51679ad2-5b28-45a1-8e8e-3e69524b9554 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:17.292955 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51679ad2-5b28-45a1-8e8e-3e69524b9554 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:17.293698 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51679ad2-5b28-45a1-8e8e-3e69524b9554 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:17.294351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51679ad2-5b28-45a1-8e8e-3e69524b9554 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:17.295730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51679ad2-5b28-45a1-8e8e-3e69524b9554 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:17.296571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51679ad2-5b28-45a1-8e8e-3e69524b9554 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:17.297341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51679ad2-5b28-45a1-8e8e-3e69524b9554 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:17.302287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:17.483669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-51679ad2-5b28-45a1-8e8e-3e69524b9554 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:17.500292 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-51679ad2-5b28-45a1-8e8e-3e69524b9554 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1364 microversion: 2.1 time: 0.219367 Aug 24 10:46:17.502656 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2629/5602] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:17 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:17.913496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-825dfc98-8263-4101-b62b-81fa3f780880 req-edcf04ec-a7fe-4182-bacc-830fa7ce7ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46ecd5ee-6e65-441c-b75e-941757d51a02", "name": "network-vif-plugged", "status": "completed", "tag": "ebd92acf-1a09-43c5-9f1b-7347cd1cbc5e"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:46:17.925990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-825dfc98-8263-4101-b62b-81fa3f780880 req-edcf04ec-a7fe-4182-bacc-830fa7ce7ec3 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:17.926751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-825dfc98-8263-4101-b62b-81fa3f780880 req-edcf04ec-a7fe-4182-bacc-830fa7ce7ec3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:17.927563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-825dfc98-8263-4101-b62b-81fa3f780880 req-edcf04ec-a7fe-4182-bacc-830fa7ce7ec3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:17.954138 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-825dfc98-8263-4101-b62b-81fa3f780880 req-edcf04ec-a7fe-4182-bacc-830fa7ce7ec3 service nova] Creating event network-vif-plugged:ebd92acf-1a09-43c5-9f1b-7347cd1cbc5e for instance 46ecd5ee-6e65-441c-b75e-941757d51a02 on n-h1-849328-3 Aug 24 10:46:17.959567 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1ef6cd9c-f69d-4ccd-9628-0b0fa3dd030d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:17.961154 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1ef6cd9c-f69d-4ccd-9628-0b0fa3dd030d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:17.962086 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-825dfc98-8263-4101-b62b-81fa3f780880 req-edcf04ec-a7fe-4182-bacc-830fa7ce7ec3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054105 Aug 24 10:46:17.963358 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2974/5603] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:46:17.972716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ef6cd9c-f69d-4ccd-9628-0b0fa3dd030d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:17.974151 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ef6cd9c-f69d-4ccd-9628-0b0fa3dd030d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:17.974584 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ef6cd9c-f69d-4ccd-9628-0b0fa3dd030d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:17.975346 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ef6cd9c-f69d-4ccd-9628-0b0fa3dd030d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:17.975793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ef6cd9c-f69d-4ccd-9628-0b0fa3dd030d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:17.976432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ef6cd9c-f69d-4ccd-9628-0b0fa3dd030d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:18.032411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:18.049626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e85c99e5-fc33-4a79-b82a-a34615e7dd8e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:18.050448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e85c99e5-fc33-4a79-b82a-a34615e7dd8e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:18.074358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85c99e5-fc33-4a79-b82a-a34615e7dd8e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:18.075283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85c99e5-fc33-4a79-b82a-a34615e7dd8e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:18.076241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85c99e5-fc33-4a79-b82a-a34615e7dd8e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:18.079771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85c99e5-fc33-4a79-b82a-a34615e7dd8e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:18.080499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85c99e5-fc33-4a79-b82a-a34615e7dd8e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:18.081147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85c99e5-fc33-4a79-b82a-a34615e7dd8e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:18.135180 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e85c99e5-fc33-4a79-b82a-a34615e7dd8e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84/ips" status: 200 len: 148 microversion: 2.1 time: 0.103002 Aug 24 10:46:18.136458 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2975/5604] 10.222.0.85 () {58 vars in 1248 bytes} [Wed Aug 24 10:46:18 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84/ips => generated 148 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:46:18.290632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-03296781-8e11-473f-ac42-0fed905e73fb tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:18.292066 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-03296781-8e11-473f-ac42-0fed905e73fb tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: a0ca2e86-b871-4be0-9e3e-bd5d25f65710] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:18.292483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1ef6cd9c-f69d-4ccd-9628-0b0fa3dd030d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:18.303471 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1ef6cd9c-f69d-4ccd-9628-0b0fa3dd030d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a" status: 200 len: 1375 microversion: 2.1 time: 0.355071 Aug 24 10:46:18.312547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=16 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:18.317599 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2630/5605] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:17 2022] GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a => generated 1375 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:18.318397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03296781-8e11-473f-ac42-0fed905e73fb tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:18.320334 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03296781-8e11-473f-ac42-0fed905e73fb tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:18.323064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03296781-8e11-473f-ac42-0fed905e73fb tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:18.323944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03296781-8e11-473f-ac42-0fed905e73fb tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:18.326619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03296781-8e11-473f-ac42-0fed905e73fb tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:18.327057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03296781-8e11-473f-ac42-0fed905e73fb tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:18.335314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:18.348274 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-03296781-8e11-473f-ac42-0fed905e73fb tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] HTTP exception thrown: Instance a0ca2e86-b871-4be0-9e3e-bd5d25f65710 could not be found. Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-03296781-8e11-473f-ac42-0fed905e73fb tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Request method failure captured: Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710 HTTP/1.1 Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgFeGKmiEciHbS_hNUoT9Wj90j4VxPOxg2oFuKYJLiW9aaYI0jlTZMpGtJDY8T6tK3N6yTVe9EFm_44SBNYsHHGX5BfWrjwsfaallKgkqXP0koK9m4OqBlG8pmKChXmbAlQO_9Jipfe1wTIaSXpQu1DUDjGyjRDYYFQ1Sj-ld4BrpKQ Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 043846dcb8e74d27b84497e19c8da3dd Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-VolumesActionsTest-729605592 Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/043846dcb8e74d27b84497e19c8da3dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_043846dcb8e74d27b84497e19c8da3dd", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/043846dcb8e74d27b84497e19c8da3dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/043846dcb8e74d27b84497e19c8da3dd"}]}] Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-VolumesActionsTest-729605592 Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 043846dcb8e74d27b84497e19c8da3dd Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-VolumesActionsTest-729605592 Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-VolumesActionsTest-729605592-project Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 01a60c0bed3b481aa3b50661946be422 Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-VolumesActionsTest-729605592-project Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance a0ca2e86-b871-4be0-9e3e-bd5d25f65710 could not be found. Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'a0ca2e86-b871-4be0-9e3e-bd5d25f65710'} Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0ca2e86-b871-4be0-9e3e-bd5d25f65710 could not be found. Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0ca2e86-b871-4be0-9e3e-bd5d25f65710 could not be found. Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:46:18.350553 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:46:18.355690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:46:18.355690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:46:18.355690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:46:18.355690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:46:18.355690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:46:18.355690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0ca2e86-b871-4be0-9e3e-bd5d25f65710 could not be found. Aug 24 10:46:18.355690 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:46:18.357834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-03296781-8e11-473f-ac42-0fed905e73fb tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Returning 404 to user: Instance a0ca2e86-b871-4be0-9e3e-bd5d25f65710 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:46:18.359205 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-03296781-8e11-473f-ac42-0fed905e73fb tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710" status: 404 len: 111 microversion: 2.1 time: 0.075215 Aug 24 10:46:18.360038 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2976/5606] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:18 2022] GET /compute/v2.1/servers/a0ca2e86-b871-4be0-9e3e-bd5d25f65710 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:46:18.481167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cd11accf-4763-41dd-8d4c-4ce6f3ed1820 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-973523204", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "9e90145c-755e-4d49-bbff-17f29a9eefa3"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:46:18.527884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dd3b6fbd-bf8d-438b-8ca6-22096646c723 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:18.528971 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dd3b6fbd-bf8d-438b-8ca6-22096646c723 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:18.539262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd3b6fbd-bf8d-438b-8ca6-22096646c723 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:18.540045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd3b6fbd-bf8d-438b-8ca6-22096646c723 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:18.541235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd3b6fbd-bf8d-438b-8ca6-22096646c723 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:18.542856 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd3b6fbd-bf8d-438b-8ca6-22096646c723 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:18.544104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd3b6fbd-bf8d-438b-8ca6-22096646c723 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:18.544732 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd3b6fbd-bf8d-438b-8ca6-22096646c723 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:18.582581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-cd11accf-4763-41dd-8d4c-4ce6f3ed1820 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] validate_networks() for [('9e90145c-755e-4d49-bbff-17f29a9eefa3', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:46:18.775544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dd3b6fbd-bf8d-438b-8ca6-22096646c723 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:18.786430 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dd3b6fbd-bf8d-438b-8ca6-22096646c723 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1364 microversion: 2.1 time: 0.263449 Aug 24 10:46:18.788522 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2977/5607] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:18 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1364 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:46:19.324894 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8e3655cf-045c-48d9-87d5-4f4647c7267b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:19.326110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8e3655cf-045c-48d9-87d5-4f4647c7267b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:19.368923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e3655cf-045c-48d9-87d5-4f4647c7267b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:19.368923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e3655cf-045c-48d9-87d5-4f4647c7267b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:19.368923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e3655cf-045c-48d9-87d5-4f4647c7267b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:19.375736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e3655cf-045c-48d9-87d5-4f4647c7267b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:19.376248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e3655cf-045c-48d9-87d5-4f4647c7267b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:19.376700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e3655cf-045c-48d9-87d5-4f4647c7267b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:19.723930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cd11accf-4763-41dd-8d4c-4ce6f3ed1820 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:46:19.724432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cd11accf-4763-41dd-8d4c-4ce6f3ed1820 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:46:19.724818 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cd11accf-4763-41dd-8d4c-4ce6f3ed1820 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:46:19.725261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cd11accf-4763-41dd-8d4c-4ce6f3ed1820 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:46:19.725675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cd11accf-4763-41dd-8d4c-4ce6f3ed1820 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:46:19.767281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd11accf-4763-41dd-8d4c-4ce6f3ed1820 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:19.767785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd11accf-4763-41dd-8d4c-4ce6f3ed1820 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:19.768228 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd11accf-4763-41dd-8d4c-4ce6f3ed1820 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:19.768966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd11accf-4763-41dd-8d4c-4ce6f3ed1820 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:19.769474 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd11accf-4763-41dd-8d4c-4ce6f3ed1820 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:19.769969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd11accf-4763-41dd-8d4c-4ce6f3ed1820 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:19.834653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-cd11accf-4763-41dd-8d4c-4ce6f3ed1820 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Getting quotas for project 043846dcb8e74d27b84497e19c8da3dd. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:46:19.849576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-cd11accf-4763-41dd-8d4c-4ce6f3ed1820 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Getting quotas for user 01a60c0bed3b481aa3b50661946be422 and project 043846dcb8e74d27b84497e19c8da3dd. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:46:19.882654 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cd11accf-4763-41dd-8d4c-4ce6f3ed1820 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:46:19.886013 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cd11accf-4763-41dd-8d4c-4ce6f3ed1820 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: 0fa12935-a5ba-46ec-8706-99c9ad785d0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:46:19.953154 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:20.001676 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cd11accf-4763-41dd-8d4c-4ce6f3ed1820 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.520642 Aug 24 10:46:20.007744 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2631/5608] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:46:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:46:20.018370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-78a5370d-303e-41fe-b2ef-7626345a72f4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:20.019453 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-78a5370d-303e-41fe-b2ef-7626345a72f4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:20.029887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78a5370d-303e-41fe-b2ef-7626345a72f4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:20.030781 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78a5370d-303e-41fe-b2ef-7626345a72f4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:20.032439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78a5370d-303e-41fe-b2ef-7626345a72f4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:20.052323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78a5370d-303e-41fe-b2ef-7626345a72f4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:20.053299 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78a5370d-303e-41fe-b2ef-7626345a72f4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:20.054021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78a5370d-303e-41fe-b2ef-7626345a72f4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:20.391179 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-78a5370d-303e-41fe-b2ef-7626345a72f4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:20.397110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8e3655cf-045c-48d9-87d5-4f4647c7267b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:20.400121 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-78a5370d-303e-41fe-b2ef-7626345a72f4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1550 microversion: 2.1 time: 0.390797 Aug 24 10:46:20.400789 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2632/5609] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:20 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1550 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:20.405520 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2a21e591-3ccc-4208-be53-de4857837d4a tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:20.406273 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2a21e591-3ccc-4208-be53-de4857837d4a tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: 0fa12935-a5ba-46ec-8706-99c9ad785d0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:20.424843 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8e3655cf-045c-48d9-87d5-4f4647c7267b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a" status: 200 len: 1375 microversion: 2.1 time: 1.104433 Aug 24 10:46:20.425621 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2978/5610] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:19 2022] GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a => generated 1375 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:46:20.445192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-3d16709f-b78b-4a6c-ae26-f6d8dd4a61f3 req-fcbe3207-b568-468a-9d1e-aad6534995bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a", "name": "network-vif-plugged", "status": "completed", "tag": "4dc64609-6aa6-499b-b626-48b0729bc4ed"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:46:20.456761 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3d16709f-b78b-4a6c-ae26-f6d8dd4a61f3 req-fcbe3207-b568-468a-9d1e-aad6534995bd service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:20.458185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3d16709f-b78b-4a6c-ae26-f6d8dd4a61f3 req-fcbe3207-b568-468a-9d1e-aad6534995bd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:20.459064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3d16709f-b78b-4a6c-ae26-f6d8dd4a61f3 req-fcbe3207-b568-468a-9d1e-aad6534995bd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:20.482849 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-3d16709f-b78b-4a6c-ae26-f6d8dd4a61f3 req-fcbe3207-b568-468a-9d1e-aad6534995bd service nova] Creating event network-vif-plugged:4dc64609-6aa6-499b-b626-48b0729bc4ed for instance a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a on n-h2-849328-3 Aug 24 10:46:20.496729 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-3d16709f-b78b-4a6c-ae26-f6d8dd4a61f3 req-fcbe3207-b568-468a-9d1e-aad6534995bd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069350 Aug 24 10:46:20.498600 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2979/5611] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:46:20.526689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f6d7b6e4-a128-4222-9280-920a5e5aad76 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:20.527688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f6d7b6e4-a128-4222-9280-920a5e5aad76 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:20.535886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6d7b6e4-a128-4222-9280-920a5e5aad76 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:20.536775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6d7b6e4-a128-4222-9280-920a5e5aad76 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:20.537948 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6d7b6e4-a128-4222-9280-920a5e5aad76 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:20.539084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6d7b6e4-a128-4222-9280-920a5e5aad76 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:20.540106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6d7b6e4-a128-4222-9280-920a5e5aad76 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:20.540773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6d7b6e4-a128-4222-9280-920a5e5aad76 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:20.555824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2a21e591-3ccc-4208-be53-de4857837d4a tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a60c0bed3b481aa3b50661946be422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043846dcb8e74d27b84497e19c8da3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:20.580862 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2a21e591-3ccc-4208-be53-de4857837d4a tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d" status: 200 len: 1213 microversion: 2.1 time: 0.177315 Aug 24 10:46:20.583704 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2633/5612] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:20 2022] GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d => generated 1213 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:20.729525 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f6d7b6e4-a128-4222-9280-920a5e5aad76 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.229190 Aug 24 10:46:20.731109 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2980/5613] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Aug 24 10:46:20 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02/os-interface => generated 285 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:46:20.822558 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1a3b8ab4-f435-44b8-8867-7a101b6007db tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21c20151-a26b-4c4b-b7f5-c3f4c92f1321"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:46:20.825104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1a3b8ab4-f435-44b8-8867-7a101b6007db tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:20.841931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a3b8ab4-f435-44b8-8867-7a101b6007db tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:20.842432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a3b8ab4-f435-44b8-8867-7a101b6007db tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:20.842905 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a3b8ab4-f435-44b8-8867-7a101b6007db tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:20.843657 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a3b8ab4-f435-44b8-8867-7a101b6007db tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:20.844117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a3b8ab4-f435-44b8-8867-7a101b6007db tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:20.844543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a3b8ab4-f435-44b8-8867-7a101b6007db tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:21.449257 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d5a4b8cf-0629-4bcb-bf08-fe1de4c90406 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:21.449869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d5a4b8cf-0629-4bcb-bf08-fe1de4c90406 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:21.460732 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5a4b8cf-0629-4bcb-bf08-fe1de4c90406 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:21.465846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5a4b8cf-0629-4bcb-bf08-fe1de4c90406 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:21.466459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5a4b8cf-0629-4bcb-bf08-fe1de4c90406 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:21.470161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5a4b8cf-0629-4bcb-bf08-fe1de4c90406 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:21.470951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5a4b8cf-0629-4bcb-bf08-fe1de4c90406 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:21.471571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5a4b8cf-0629-4bcb-bf08-fe1de4c90406 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:21.554725 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1a3b8ab4-f435-44b8-8867-7a101b6007db tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "POST /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.735968 Aug 24 10:46:21.556153 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2634/5614] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Aug 24 10:46:20 2022] POST /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84/os-volume_attachments => generated 194 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:46:21.605982 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dbf620a4-1acf-46de-9a68-a8f4363779c5 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:21.607003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dbf620a4-1acf-46de-9a68-a8f4363779c5 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: 0fa12935-a5ba-46ec-8706-99c9ad785d0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:21.622522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbf620a4-1acf-46de-9a68-a8f4363779c5 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:21.625227 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbf620a4-1acf-46de-9a68-a8f4363779c5 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:21.626813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbf620a4-1acf-46de-9a68-a8f4363779c5 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:21.630948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbf620a4-1acf-46de-9a68-a8f4363779c5 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:21.631853 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbf620a4-1acf-46de-9a68-a8f4363779c5 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:21.632532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbf620a4-1acf-46de-9a68-a8f4363779c5 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:21.826941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dbf620a4-1acf-46de-9a68-a8f4363779c5 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a60c0bed3b481aa3b50661946be422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043846dcb8e74d27b84497e19c8da3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:21.848788 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dbf620a4-1acf-46de-9a68-a8f4363779c5 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d" status: 200 len: 1273 microversion: 2.1 time: 0.249053 Aug 24 10:46:21.851508 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2635/5615] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:21 2022] GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d => generated 1273 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:46:22.433682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d5a4b8cf-0629-4bcb-bf08-fe1de4c90406 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:22.445013 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d5a4b8cf-0629-4bcb-bf08-fe1de4c90406 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a" status: 200 len: 1375 microversion: 2.1 time: 1.000603 Aug 24 10:46:22.446183 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2981/5616] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:21 2022] GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a => generated 1375 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:46:22.874985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-47c848a1-43ea-45bd-8f2f-773b38630f7c tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:22.875907 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-47c848a1-43ea-45bd-8f2f-773b38630f7c tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: 0fa12935-a5ba-46ec-8706-99c9ad785d0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:22.891559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47c848a1-43ea-45bd-8f2f-773b38630f7c tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:22.893750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47c848a1-43ea-45bd-8f2f-773b38630f7c tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:22.894586 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47c848a1-43ea-45bd-8f2f-773b38630f7c tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:22.898142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47c848a1-43ea-45bd-8f2f-773b38630f7c tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:22.899113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47c848a1-43ea-45bd-8f2f-773b38630f7c tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:22.899813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47c848a1-43ea-45bd-8f2f-773b38630f7c tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:23.007543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-47c848a1-43ea-45bd-8f2f-773b38630f7c tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a60c0bed3b481aa3b50661946be422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043846dcb8e74d27b84497e19c8da3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:23.020480 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-47c848a1-43ea-45bd-8f2f-773b38630f7c tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d" status: 200 len: 1271 microversion: 2.1 time: 0.149386 Aug 24 10:46:23.023088 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2636/5617] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:22 2022] GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d => generated 1271 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:23.466822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-030716b6-86e4-44de-af0b-6e5b045b36f1 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:23.467435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-030716b6-86e4-44de-af0b-6e5b045b36f1 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:23.474551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-030716b6-86e4-44de-af0b-6e5b045b36f1 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:23.475288 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-030716b6-86e4-44de-af0b-6e5b045b36f1 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:23.476099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-030716b6-86e4-44de-af0b-6e5b045b36f1 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:23.476981 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-030716b6-86e4-44de-af0b-6e5b045b36f1 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:23.477638 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-030716b6-86e4-44de-af0b-6e5b045b36f1 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:23.478220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-030716b6-86e4-44de-af0b-6e5b045b36f1 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:23.971029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-030716b6-86e4-44de-af0b-6e5b045b36f1 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:23.996772 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-030716b6-86e4-44de-af0b-6e5b045b36f1 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a" status: 200 len: 1546 microversion: 2.1 time: 0.531941 Aug 24 10:46:23.998532 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2982/5618] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:23 2022] GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a => generated 1546 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:24.034423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-158b844d-8572-41dd-b268-779ce946f94e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:24.035723 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-158b844d-8572-41dd-b268-779ce946f94e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:24.043292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ecd52577-6f39-4be8-b02a-e634169c2f4c tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:24.044110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ecd52577-6f39-4be8-b02a-e634169c2f4c tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: 0fa12935-a5ba-46ec-8706-99c9ad785d0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:24.055954 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:24.058213 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-158b844d-8572-41dd-b268-779ce946f94e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:24.060062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ecd52577-6f39-4be8-b02a-e634169c2f4c tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:24.060832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-158b844d-8572-41dd-b268-779ce946f94e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:24.061548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ecd52577-6f39-4be8-b02a-e634169c2f4c tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:24.062217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-158b844d-8572-41dd-b268-779ce946f94e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:24.062841 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ecd52577-6f39-4be8-b02a-e634169c2f4c tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:24.063768 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-158b844d-8572-41dd-b268-779ce946f94e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:24.064709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ecd52577-6f39-4be8-b02a-e634169c2f4c tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:24.065653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ecd52577-6f39-4be8-b02a-e634169c2f4c tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:24.066134 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-158b844d-8572-41dd-b268-779ce946f94e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:24.066727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-158b844d-8572-41dd-b268-779ce946f94e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:24.067325 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ecd52577-6f39-4be8-b02a-e634169c2f4c tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:24.374287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-158b844d-8572-41dd-b268-779ce946f94e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:24.385782 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-158b844d-8572-41dd-b268-779ce946f94e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a" status: 200 len: 1546 microversion: 2.1 time: 0.353517 Aug 24 10:46:24.391154 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2637/5619] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:24 2022] GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a => generated 1546 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:24.493613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-f100b5ed-936a-4810-a80e-155d6a2cef32 req-752038aa-d07a-4c74-b2ba-24029a7ae108 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46ecd5ee-6e65-441c-b75e-941757d51a02", "tag": "ebd92acf-1a09-43c5-9f1b-7347cd1cbc5e"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:46:24.514359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f100b5ed-936a-4810-a80e-155d6a2cef32 req-752038aa-d07a-4c74-b2ba-24029a7ae108 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:24.515136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f100b5ed-936a-4810-a80e-155d6a2cef32 req-752038aa-d07a-4c74-b2ba-24029a7ae108 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:24.515805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f100b5ed-936a-4810-a80e-155d6a2cef32 req-752038aa-d07a-4c74-b2ba-24029a7ae108 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:24.541515 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-f100b5ed-936a-4810-a80e-155d6a2cef32 req-752038aa-d07a-4c74-b2ba-24029a7ae108 service nova] Creating event network-changed:ebd92acf-1a09-43c5-9f1b-7347cd1cbc5e for instance 46ecd5ee-6e65-441c-b75e-941757d51a02 on n-h1-849328-3 Aug 24 10:46:24.548276 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-f100b5ed-936a-4810-a80e-155d6a2cef32 req-752038aa-d07a-4c74-b2ba-24029a7ae108 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058017 Aug 24 10:46:24.550588 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2638/5620] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:46:24.627256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c8f12916-9a0b-4382-a627-5c7d44133f48 req-5881be7a-6341-4992-bd3a-ff2014ce3d63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fa12935-a5ba-46ec-8706-99c9ad785d0d", "tag": "31c4322a-cf34-4962-bb50-8e7db26d9ef4"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:46:24.648686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c8f12916-9a0b-4382-a627-5c7d44133f48 req-5881be7a-6341-4992-bd3a-ff2014ce3d63 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:24.650425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c8f12916-9a0b-4382-a627-5c7d44133f48 req-5881be7a-6341-4992-bd3a-ff2014ce3d63 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:24.652203 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c8f12916-9a0b-4382-a627-5c7d44133f48 req-5881be7a-6341-4992-bd3a-ff2014ce3d63 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:24.674479 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c8f12916-9a0b-4382-a627-5c7d44133f48 req-5881be7a-6341-4992-bd3a-ff2014ce3d63 service nova] Creating event network-changed:31c4322a-cf34-4962-bb50-8e7db26d9ef4 for instance 0fa12935-a5ba-46ec-8706-99c9ad785d0d on n-h1-849328-3 Aug 24 10:46:24.694319 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c8f12916-9a0b-4382-a627-5c7d44133f48 req-5881be7a-6341-4992-bd3a-ff2014ce3d63 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070975 Aug 24 10:46:24.694690 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2639/5621] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:46:24.765888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ecd52577-6f39-4be8-b02a-e634169c2f4c tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a60c0bed3b481aa3b50661946be422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043846dcb8e74d27b84497e19c8da3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:24.780191 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ecd52577-6f39-4be8-b02a-e634169c2f4c tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d" status: 200 len: 1313 microversion: 2.1 time: 0.741096 Aug 24 10:46:24.784299 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2983/5622] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:24 2022] GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d => generated 1313 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:25.803588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-017f9157-904d-46a8-aa13-62b8eddbc828 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:25.804298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-017f9157-904d-46a8-aa13-62b8eddbc828 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: 0fa12935-a5ba-46ec-8706-99c9ad785d0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:25.810819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-017f9157-904d-46a8-aa13-62b8eddbc828 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:25.811553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-017f9157-904d-46a8-aa13-62b8eddbc828 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:25.812170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-017f9157-904d-46a8-aa13-62b8eddbc828 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:25.813040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-017f9157-904d-46a8-aa13-62b8eddbc828 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:25.813674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-017f9157-904d-46a8-aa13-62b8eddbc828 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:25.814251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-017f9157-904d-46a8-aa13-62b8eddbc828 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:26.008483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-017f9157-904d-46a8-aa13-62b8eddbc828 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a60c0bed3b481aa3b50661946be422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043846dcb8e74d27b84497e19c8da3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:26.021910 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-017f9157-904d-46a8-aa13-62b8eddbc828 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d" status: 200 len: 1313 microversion: 2.1 time: 0.222081 Aug 24 10:46:26.038033 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2640/5623] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:25 2022] GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:27.045866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5a2bd577-1763-4fb7-9717-abf2f4ddd871 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:27.047105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5a2bd577-1763-4fb7-9717-abf2f4ddd871 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: 0fa12935-a5ba-46ec-8706-99c9ad785d0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:27.058551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a2bd577-1763-4fb7-9717-abf2f4ddd871 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:27.059304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a2bd577-1763-4fb7-9717-abf2f4ddd871 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:27.062259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a2bd577-1763-4fb7-9717-abf2f4ddd871 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:27.063244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a2bd577-1763-4fb7-9717-abf2f4ddd871 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:27.065714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a2bd577-1763-4fb7-9717-abf2f4ddd871 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:27.068644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a2bd577-1763-4fb7-9717-abf2f4ddd871 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:27.805761 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5a2bd577-1763-4fb7-9717-abf2f4ddd871 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a60c0bed3b481aa3b50661946be422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043846dcb8e74d27b84497e19c8da3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:27.828661 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5a2bd577-1763-4fb7-9717-abf2f4ddd871 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d" status: 200 len: 1313 microversion: 2.1 time: 0.786372 Aug 24 10:46:27.831667 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2984/5624] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:27 2022] GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d => generated 1313 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:28.855267 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-86cbced4-805a-49ab-b3ae-7bb6d31c9ebc tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:28.856984 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-86cbced4-805a-49ab-b3ae-7bb6d31c9ebc tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: 0fa12935-a5ba-46ec-8706-99c9ad785d0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:28.890051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86cbced4-805a-49ab-b3ae-7bb6d31c9ebc tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:28.893531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86cbced4-805a-49ab-b3ae-7bb6d31c9ebc tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:28.895827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86cbced4-805a-49ab-b3ae-7bb6d31c9ebc tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:28.901080 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86cbced4-805a-49ab-b3ae-7bb6d31c9ebc tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:28.901796 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86cbced4-805a-49ab-b3ae-7bb6d31c9ebc tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:28.902422 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86cbced4-805a-49ab-b3ae-7bb6d31c9ebc tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:29.530926 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-86cbced4-805a-49ab-b3ae-7bb6d31c9ebc tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a60c0bed3b481aa3b50661946be422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043846dcb8e74d27b84497e19c8da3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:29.577692 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-86cbced4-805a-49ab-b3ae-7bb6d31c9ebc tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d" status: 200 len: 1313 microversion: 2.1 time: 0.730551 Aug 24 10:46:29.580396 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2641/5625] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:28 2022] GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d => generated 1313 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:29.851218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-5fd9a4e3-5918-45ad-b04a-0c719abcc7a1 req-51831c6b-718d-45c1-b88a-c84daeb7a489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a", "tag": "4dc64609-6aa6-499b-b626-48b0729bc4ed"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:46:29.869408 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5fd9a4e3-5918-45ad-b04a-0c719abcc7a1 req-51831c6b-718d-45c1-b88a-c84daeb7a489 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:29.870535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5fd9a4e3-5918-45ad-b04a-0c719abcc7a1 req-51831c6b-718d-45c1-b88a-c84daeb7a489 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:29.871228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5fd9a4e3-5918-45ad-b04a-0c719abcc7a1 req-51831c6b-718d-45c1-b88a-c84daeb7a489 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:29.895011 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-5fd9a4e3-5918-45ad-b04a-0c719abcc7a1 req-51831c6b-718d-45c1-b88a-c84daeb7a489 service nova] Creating event network-changed:4dc64609-6aa6-499b-b626-48b0729bc4ed for instance a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a on n-h2-849328-3 Aug 24 10:46:29.901886 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-5fd9a4e3-5918-45ad-b04a-0c719abcc7a1 req-51831c6b-718d-45c1-b88a-c84daeb7a489 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059927 Aug 24 10:46:29.903574 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2985/5626] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:46:30.600805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c81c808c-12ca-4fd4-a4fa-60f6977568bf tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:30.602198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c81c808c-12ca-4fd4-a4fa-60f6977568bf tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: 0fa12935-a5ba-46ec-8706-99c9ad785d0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:30.608162 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:30.609991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:30.611770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c81c808c-12ca-4fd4-a4fa-60f6977568bf tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:30.612539 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c81c808c-12ca-4fd4-a4fa-60f6977568bf tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:30.613277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c81c808c-12ca-4fd4-a4fa-60f6977568bf tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:30.614291 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c81c808c-12ca-4fd4-a4fa-60f6977568bf tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:30.614894 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c81c808c-12ca-4fd4-a4fa-60f6977568bf tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:30.615474 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c81c808c-12ca-4fd4-a4fa-60f6977568bf tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:30.797191 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c81c808c-12ca-4fd4-a4fa-60f6977568bf tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a60c0bed3b481aa3b50661946be422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043846dcb8e74d27b84497e19c8da3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:30.807195 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c81c808c-12ca-4fd4-a4fa-60f6977568bf tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d" status: 200 len: 1313 microversion: 2.1 time: 0.210657 Aug 24 10:46:30.808202 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2642/5627] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:30 2022] GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:31.833904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4c8d18d4-a644-472a-9819-00c5d028f095 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:31.834622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4c8d18d4-a644-472a-9819-00c5d028f095 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: 0fa12935-a5ba-46ec-8706-99c9ad785d0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:31.849092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c8d18d4-a644-472a-9819-00c5d028f095 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:31.849980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c8d18d4-a644-472a-9819-00c5d028f095 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:31.851100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c8d18d4-a644-472a-9819-00c5d028f095 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:31.851982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c8d18d4-a644-472a-9819-00c5d028f095 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:31.852574 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c8d18d4-a644-472a-9819-00c5d028f095 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:31.853270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c8d18d4-a644-472a-9819-00c5d028f095 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:32.026205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-015ddeff-356c-4840-b307-f526b34e7244 req-916f17a9-b76d-4bb3-a382-63a8003c2314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa12935-a5ba-46ec-8706-99c9ad785d0d", "name": "network-vif-plugged", "status": "completed", "tag": "31c4322a-cf34-4962-bb50-8e7db26d9ef4"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:46:32.041076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4c8d18d4-a644-472a-9819-00c5d028f095 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a60c0bed3b481aa3b50661946be422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043846dcb8e74d27b84497e19c8da3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:32.050027 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4c8d18d4-a644-472a-9819-00c5d028f095 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d" status: 200 len: 1313 microversion: 2.1 time: 0.223956 Aug 24 10:46:32.054396 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2986/5628] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:31 2022] GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:32.057530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-015ddeff-356c-4840-b307-f526b34e7244 req-916f17a9-b76d-4bb3-a382-63a8003c2314 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:32.058726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-015ddeff-356c-4840-b307-f526b34e7244 req-916f17a9-b76d-4bb3-a382-63a8003c2314 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:32.059709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-015ddeff-356c-4840-b307-f526b34e7244 req-916f17a9-b76d-4bb3-a382-63a8003c2314 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:32.082385 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-015ddeff-356c-4840-b307-f526b34e7244 req-916f17a9-b76d-4bb3-a382-63a8003c2314 service nova] Creating event network-vif-plugged:31c4322a-cf34-4962-bb50-8e7db26d9ef4 for instance 0fa12935-a5ba-46ec-8706-99c9ad785d0d on n-h1-849328-3 Aug 24 10:46:32.087642 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-015ddeff-356c-4840-b307-f526b34e7244 req-916f17a9-b76d-4bb3-a382-63a8003c2314 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068432 Aug 24 10:46:32.088609 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2643/5629] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:46:33.078086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7584b824-6a7e-42b7-9771-c96cb0273f7b tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:33.080123 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7584b824-6a7e-42b7-9771-c96cb0273f7b tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: 0fa12935-a5ba-46ec-8706-99c9ad785d0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:33.090795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7584b824-6a7e-42b7-9771-c96cb0273f7b tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:33.091751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7584b824-6a7e-42b7-9771-c96cb0273f7b tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:33.092434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7584b824-6a7e-42b7-9771-c96cb0273f7b tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:33.093716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7584b824-6a7e-42b7-9771-c96cb0273f7b tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:33.094490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7584b824-6a7e-42b7-9771-c96cb0273f7b tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:33.095118 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7584b824-6a7e-42b7-9771-c96cb0273f7b tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:33.354874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7584b824-6a7e-42b7-9771-c96cb0273f7b tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a60c0bed3b481aa3b50661946be422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043846dcb8e74d27b84497e19c8da3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:33.373475 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7584b824-6a7e-42b7-9771-c96cb0273f7b tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d" status: 200 len: 1313 microversion: 2.1 time: 0.302911 Aug 24 10:46:33.377474 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2987/5630] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:33 2022] GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:34.400394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d246975d-7bde-44d9-bd86-ceafbca00968 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:34.401148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d246975d-7bde-44d9-bd86-ceafbca00968 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: 0fa12935-a5ba-46ec-8706-99c9ad785d0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:34.414147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d246975d-7bde-44d9-bd86-ceafbca00968 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:34.414672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d246975d-7bde-44d9-bd86-ceafbca00968 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:34.415381 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d246975d-7bde-44d9-bd86-ceafbca00968 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:34.417219 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d246975d-7bde-44d9-bd86-ceafbca00968 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:34.418312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d246975d-7bde-44d9-bd86-ceafbca00968 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:34.419070 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d246975d-7bde-44d9-bd86-ceafbca00968 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:34.720318 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d246975d-7bde-44d9-bd86-ceafbca00968 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a60c0bed3b481aa3b50661946be422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043846dcb8e74d27b84497e19c8da3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:34.737094 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d246975d-7bde-44d9-bd86-ceafbca00968 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d" status: 200 len: 1497 microversion: 2.1 time: 0.341700 Aug 24 10:46:34.738016 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2644/5631] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:34 2022] GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d => generated 1497 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:46:34.959303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8bb40701-db8a-4b94-a301-9733e8778163 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21c20151-a26b-4c4b-b7f5-c3f4c92f1321"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:46:34.962012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8bb40701-db8a-4b94-a301-9733e8778163 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:34.969995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bb40701-db8a-4b94-a301-9733e8778163 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:34.970494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bb40701-db8a-4b94-a301-9733e8778163 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:34.970926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bb40701-db8a-4b94-a301-9733e8778163 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:34.973680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bb40701-db8a-4b94-a301-9733e8778163 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:34.974188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bb40701-db8a-4b94-a301-9733e8778163 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:34.974623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bb40701-db8a-4b94-a301-9733e8778163 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:35.157565 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-8bb40701-db8a-4b94-a301-9733e8778163 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] HTTP exception thrown: Invalid volume: volume 21c20151-a26b-4c4b-b7f5-c3f4c92f1321 is already attached to instances: bb455d4d-f629-4593-ab93-67ac87630d84 Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8bb40701-db8a-4b94-a301-9733e8778163 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Request method failure captured: Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84/os-volume_attachments HTTP/1.1 Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 74 Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgBznQHNaOQSFLxoSWoCQ9hM_j0rDTvTqgGEXtOY5AvsNS3wnSnsKPq1brvowzVLm_09c1waLsJrFpihbXQ2I-pXEEbKWLH4qZhxSJfMM_hStgT1NZ8xcwJWs2OWbQyk15VS3tMTjbBVTyv_jiH5rZPFN41C1BDVpAXdNxiZaDgd17U Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 3cfd67239d3f4b7a89be1453a08c92ba Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3cfd67239d3f4b7a89be1453a08c92ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3cfd67239d3f4b7a89be1453a08c92ba", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3cfd67239d3f4b7a89be1453a08c92ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3cfd67239d3f4b7a89be1453a08c92ba"}]}] Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 3cfd67239d3f4b7a89be1453a08c92ba Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AttachVolumeNegativeTest-632701884-project Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: ff5172c17fae44e5839bd9b789e4c3a8 Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AttachVolumeNegativeTest-632701884-project Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: {"volumeAttachment": {"volumeId": "21c20151-a26b-4c4b-b7f5-c3f4c92f1321"}} Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: exception: Invalid volume: volume 21c20151-a26b-4c4b-b7f5-c3f4c92f1321 is already attached to instances: bb455d4d-f629-4593-ab93-67ac87630d84 Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'server_id': 'bb455d4d-f629-4593-ab93-67ac87630d84', 'body': {'volumeAttachment': {'volumeId': '21c20151-a26b-4c4b-b7f5-c3f4c92f1321'}}} Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 21c20151-a26b-4c4b-b7f5-c3f4c92f1321 is already attached to instances: bb455d4d-f629-4593-ab93-67ac87630d84 Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:46:35.159330 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:46:35.163982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:46:35.163982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:46:35.163982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 10:46:35.163982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 10:46:35.163982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 21c20151-a26b-4c4b-b7f5-c3f4c92f1321 is already attached to instances: bb455d4d-f629-4593-ab93-67ac87630d84 Aug 24 10:46:35.163982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:46:35.163982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:46:35.163982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:46:35.163982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:46:35.163982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:46:35.163982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:46:35.163982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:46:35.163982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:46:35.163982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 21c20151-a26b-4c4b-b7f5-c3f4c92f1321 is already attached to instances: bb455d4d-f629-4593-ab93-67ac87630d84 Aug 24 10:46:35.163982 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:46:35.163982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8bb40701-db8a-4b94-a301-9733e8778163 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Returning 400 to user: Invalid volume: volume 21c20151-a26b-4c4b-b7f5-c3f4c92f1321 is already attached to instances: bb455d4d-f629-4593-ab93-67ac87630d84 {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:46:35.163982 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8bb40701-db8a-4b94-a301-9733e8778163 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "POST /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.206076 Aug 24 10:46:35.165958 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2988/5632] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Aug 24 10:46:34 2022] POST /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84/os-volume_attachments => generated 174 bytes in 212 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:46:35.292351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-297b70b8-0e58-46e2-ad73-4e1d88440424 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:35.292862 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-297b70b8-0e58-46e2-ad73-4e1d88440424 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:35.309410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-297b70b8-0e58-46e2-ad73-4e1d88440424 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:35.311909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-297b70b8-0e58-46e2-ad73-4e1d88440424 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:35.314494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-297b70b8-0e58-46e2-ad73-4e1d88440424 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:35.317025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-297b70b8-0e58-46e2-ad73-4e1d88440424 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:35.317786 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-297b70b8-0e58-46e2-ad73-4e1d88440424 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:35.318233 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-297b70b8-0e58-46e2-ad73-4e1d88440424 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:35.517913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-629a2b1e-e7b4-48e9-801c-f8ad3c512551 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:35.519009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-629a2b1e-e7b4-48e9-801c-f8ad3c512551 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: 0fa12935-a5ba-46ec-8706-99c9ad785d0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:35.520176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-297b70b8-0e58-46e2-ad73-4e1d88440424 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lazy-loading 'services' on Instance uuid bb455d4d-f629-4593-ab93-67ac87630d84 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:46:35.531283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-629a2b1e-e7b4-48e9-801c-f8ad3c512551 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:35.538613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-629a2b1e-e7b4-48e9-801c-f8ad3c512551 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:35.539612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-629a2b1e-e7b4-48e9-801c-f8ad3c512551 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:35.540498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-629a2b1e-e7b4-48e9-801c-f8ad3c512551 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:35.541095 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-629a2b1e-e7b4-48e9-801c-f8ad3c512551 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:35.541893 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-629a2b1e-e7b4-48e9-801c-f8ad3c512551 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:35.588244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-629a2b1e-e7b4-48e9-801c-f8ad3c512551 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: 0fa12935-a5ba-46ec-8706-99c9ad785d0d] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:46:35.684106 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-297b70b8-0e58-46e2-ad73-4e1d88440424 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "DELETE /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84/os-volume_attachments/21c20151-a26b-4c4b-b7f5-c3f4c92f1321" status: 202 len: 0 microversion: 2.1 time: 0.384243 Aug 24 10:46:35.686486 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2645/5633] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Aug 24 10:46:35 2022] DELETE /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84/os-volume_attachments/21c20151-a26b-4c4b-b7f5-c3f4c92f1321 => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:46:35.708718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0833007a-d9f0-4e10-ab25-8302b91276b5 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:35.712982 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0833007a-d9f0-4e10-ab25-8302b91276b5 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:35.732656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0833007a-d9f0-4e10-ab25-8302b91276b5 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:35.733478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0833007a-d9f0-4e10-ab25-8302b91276b5 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:35.734196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0833007a-d9f0-4e10-ab25-8302b91276b5 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:35.735124 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0833007a-d9f0-4e10-ab25-8302b91276b5 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:35.736380 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0833007a-d9f0-4e10-ab25-8302b91276b5 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:35.736746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0833007a-d9f0-4e10-ab25-8302b91276b5 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:35.769316 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-629a2b1e-e7b4-48e9-801c-f8ad3c512551 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "DELETE /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d" status: 204 len: 0 microversion: 2.1 time: 0.257557 Aug 24 10:46:35.781607 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2989/5634] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:46:35 2022] DELETE /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:46:35.805292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a2df1cb6-ac97-462f-8e3b-734c21f895e4 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:35.806339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a2df1cb6-ac97-462f-8e3b-734c21f895e4 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: 0fa12935-a5ba-46ec-8706-99c9ad785d0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:35.813501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2df1cb6-ac97-462f-8e3b-734c21f895e4 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:35.814278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2df1cb6-ac97-462f-8e3b-734c21f895e4 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:35.814839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2df1cb6-ac97-462f-8e3b-734c21f895e4 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:35.815812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2df1cb6-ac97-462f-8e3b-734c21f895e4 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:35.816437 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2df1cb6-ac97-462f-8e3b-734c21f895e4 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:35.816990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2df1cb6-ac97-462f-8e3b-734c21f895e4 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:35.828090 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0833007a-d9f0-4e10-ab25-8302b91276b5 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137994 Aug 24 10:46:35.829007 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2646/5635] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:46:35 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:46:36.153763 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a2df1cb6-ac97-462f-8e3b-734c21f895e4 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a60c0bed3b481aa3b50661946be422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043846dcb8e74d27b84497e19c8da3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:36.168761 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a2df1cb6-ac97-462f-8e3b-734c21f895e4 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d" status: 200 len: 1503 microversion: 2.1 time: 0.374634 Aug 24 10:46:36.169475 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2990/5636] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:35 2022] GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d => generated 1503 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:36.841991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9af50809-5871-4977-a642-aa8a416203e2 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:36.846836 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9af50809-5871-4977-a642-aa8a416203e2 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:36.855877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9af50809-5871-4977-a642-aa8a416203e2 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:36.856886 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9af50809-5871-4977-a642-aa8a416203e2 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:36.858034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9af50809-5871-4977-a642-aa8a416203e2 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:36.859391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9af50809-5871-4977-a642-aa8a416203e2 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:36.860524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9af50809-5871-4977-a642-aa8a416203e2 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:36.861474 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9af50809-5871-4977-a642-aa8a416203e2 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:36.882847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:36.902730 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9af50809-5871-4977-a642-aa8a416203e2 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066231 Aug 24 10:46:36.907795 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2647/5637] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:46:36 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:46:37.198572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2551aac9-aeb7-4c8c-920e-77cf980d5abc tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:37.199872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2551aac9-aeb7-4c8c-920e-77cf980d5abc tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: 0fa12935-a5ba-46ec-8706-99c9ad785d0d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:37.209412 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2551aac9-aeb7-4c8c-920e-77cf980d5abc tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:37.210493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2551aac9-aeb7-4c8c-920e-77cf980d5abc tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:37.211819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2551aac9-aeb7-4c8c-920e-77cf980d5abc tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:37.212798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2551aac9-aeb7-4c8c-920e-77cf980d5abc tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:37.213503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2551aac9-aeb7-4c8c-920e-77cf980d5abc tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:37.214116 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2551aac9-aeb7-4c8c-920e-77cf980d5abc tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:37.530245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2551aac9-aeb7-4c8c-920e-77cf980d5abc tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a60c0bed3b481aa3b50661946be422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043846dcb8e74d27b84497e19c8da3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:37.546963 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2551aac9-aeb7-4c8c-920e-77cf980d5abc tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d" status: 200 len: 1503 microversion: 2.1 time: 0.349020 Aug 24 10:46:37.552575 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2991/5638] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:37 2022] GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d => generated 1503 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:37.916054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-14e27831-b4c9-4291-b636-bc71ca3bd7b5 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:37.918570 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-14e27831-b4c9-4291-b636-bc71ca3bd7b5 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:37.938387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14e27831-b4c9-4291-b636-bc71ca3bd7b5 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:37.938387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14e27831-b4c9-4291-b636-bc71ca3bd7b5 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:37.938981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14e27831-b4c9-4291-b636-bc71ca3bd7b5 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:37.942090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14e27831-b4c9-4291-b636-bc71ca3bd7b5 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:37.943249 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14e27831-b4c9-4291-b636-bc71ca3bd7b5 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:37.944210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14e27831-b4c9-4291-b636-bc71ca3bd7b5 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:38.047194 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-14e27831-b4c9-4291-b636-bc71ca3bd7b5 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135592 Aug 24 10:46:38.051956 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2648/5639] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:46:37 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:46:38.179860 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-6309a546-fbc9-46dc-a67f-478eef0713b4 req-fa915bd6-69d8-4c88-bbd7-fbba38a7ab52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa12935-a5ba-46ec-8706-99c9ad785d0d", "name": "network-vif-deleted", "tag": "31c4322a-cf34-4962-bb50-8e7db26d9ef4"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:46:38.194662 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6309a546-fbc9-46dc-a67f-478eef0713b4 req-fa915bd6-69d8-4c88-bbd7-fbba38a7ab52 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:38.197072 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6309a546-fbc9-46dc-a67f-478eef0713b4 req-fa915bd6-69d8-4c88-bbd7-fbba38a7ab52 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:38.198233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6309a546-fbc9-46dc-a67f-478eef0713b4 req-fa915bd6-69d8-4c88-bbd7-fbba38a7ab52 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:38.218897 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-6309a546-fbc9-46dc-a67f-478eef0713b4 req-fa915bd6-69d8-4c88-bbd7-fbba38a7ab52 service nova] Creating event network-vif-deleted:31c4322a-cf34-4962-bb50-8e7db26d9ef4 for instance 0fa12935-a5ba-46ec-8706-99c9ad785d0d on n-h1-849328-3 Aug 24 10:46:38.224298 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-6309a546-fbc9-46dc-a67f-478eef0713b4 req-fa915bd6-69d8-4c88-bbd7-fbba38a7ab52 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049834 Aug 24 10:46:38.225558 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2992/5640] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:46:38.577461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aca5c9d3-2e12-4ac4-942c-591f4038478f tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:38.578174 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aca5c9d3-2e12-4ac4-942c-591f4038478f tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: 0fa12935-a5ba-46ec-8706-99c9ad785d0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:38.588802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aca5c9d3-2e12-4ac4-942c-591f4038478f tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:38.589339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aca5c9d3-2e12-4ac4-942c-591f4038478f tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:38.589788 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aca5c9d3-2e12-4ac4-942c-591f4038478f tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:38.590502 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aca5c9d3-2e12-4ac4-942c-591f4038478f tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:38.590963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aca5c9d3-2e12-4ac4-942c-591f4038478f tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:38.591394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aca5c9d3-2e12-4ac4-942c-591f4038478f tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:38.639539 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aca5c9d3-2e12-4ac4-942c-591f4038478f tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:38.640291 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aca5c9d3-2e12-4ac4-942c-591f4038478f tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:38.640736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aca5c9d3-2e12-4ac4-942c-591f4038478f tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:38.641386 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-aca5c9d3-2e12-4ac4-942c-591f4038478f tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lazy-loading 'fault' on Instance uuid 0fa12935-a5ba-46ec-8706-99c9ad785d0d {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:46:38.734556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aca5c9d3-2e12-4ac4-942c-591f4038478f tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a60c0bed3b481aa3b50661946be422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043846dcb8e74d27b84497e19c8da3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:38.754142 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aca5c9d3-2e12-4ac4-942c-591f4038478f tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d" status: 200 len: 1303 microversion: 2.1 time: 0.180953 Aug 24 10:46:38.755327 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2649/5641] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:38 2022] GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d => generated 1303 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:39.065347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-93d4f3fb-42a7-432f-a09d-4412da298a4e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:39.068858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-93d4f3fb-42a7-432f-a09d-4412da298a4e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:39.098289 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93d4f3fb-42a7-432f-a09d-4412da298a4e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:39.099054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93d4f3fb-42a7-432f-a09d-4412da298a4e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:39.099707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93d4f3fb-42a7-432f-a09d-4412da298a4e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:39.100664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93d4f3fb-42a7-432f-a09d-4412da298a4e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:39.101398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93d4f3fb-42a7-432f-a09d-4412da298a4e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:39.102019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93d4f3fb-42a7-432f-a09d-4412da298a4e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:39.157211 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-93d4f3fb-42a7-432f-a09d-4412da298a4e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098502 Aug 24 10:46:39.158489 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2993/5642] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:46:39 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:46:39.782003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-328636e1-6de9-4498-93da-818be51cc117 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:39.782611 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-328636e1-6de9-4498-93da-818be51cc117 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] [instance: 0fa12935-a5ba-46ec-8706-99c9ad785d0d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:39.789910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-328636e1-6de9-4498-93da-818be51cc117 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:39.790637 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-328636e1-6de9-4498-93da-818be51cc117 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:39.791260 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-328636e1-6de9-4498-93da-818be51cc117 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:39.792183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-328636e1-6de9-4498-93da-818be51cc117 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:39.792806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-328636e1-6de9-4498-93da-818be51cc117 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:39.793423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-328636e1-6de9-4498-93da-818be51cc117 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:39.814764 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-328636e1-6de9-4498-93da-818be51cc117 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] HTTP exception thrown: Instance 0fa12935-a5ba-46ec-8706-99c9ad785d0d could not be found. Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-328636e1-6de9-4498-93da-818be51cc117 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Request method failure captured: Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d HTTP/1.1 Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgFeGKmiEciHbS_hNUoT9Wj90j4VxPOxg2oFuKYJLiW9aaYI0jlTZMpGtJDY8T6tK3N6yTVe9EFm_44SBNYsHHGX5BfWrjwsfaallKgkqXP0koK9m4OqBlG8pmKChXmbAlQO_9Jipfe1wTIaSXpQu1DUDjGyjRDYYFQ1Sj-ld4BrpKQ Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 043846dcb8e74d27b84497e19c8da3dd Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-VolumesActionsTest-729605592 Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/043846dcb8e74d27b84497e19c8da3dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_043846dcb8e74d27b84497e19c8da3dd", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/043846dcb8e74d27b84497e19c8da3dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/043846dcb8e74d27b84497e19c8da3dd"}]}] Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-VolumesActionsTest-729605592 Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 043846dcb8e74d27b84497e19c8da3dd Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-VolumesActionsTest-729605592 Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-VolumesActionsTest-729605592-project Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 01a60c0bed3b481aa3b50661946be422 Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-VolumesActionsTest-729605592-project Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 0fa12935-a5ba-46ec-8706-99c9ad785d0d could not be found. Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '0fa12935-a5ba-46ec-8706-99c9ad785d0d'} Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fa12935-a5ba-46ec-8706-99c9ad785d0d could not be found. Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fa12935-a5ba-46ec-8706-99c9ad785d0d could not be found. Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:46:39.817178 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:46:39.822228 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:46:39.822228 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:46:39.822228 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:46:39.822228 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:46:39.822228 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:46:39.822228 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fa12935-a5ba-46ec-8706-99c9ad785d0d could not be found. Aug 24 10:46:39.822228 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:46:39.823606 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-328636e1-6de9-4498-93da-818be51cc117 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] Returning 404 to user: Instance 0fa12935-a5ba-46ec-8706-99c9ad785d0d could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:46:39.824750 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-328636e1-6de9-4498-93da-818be51cc117 tempest-VolumesActionsTest-729605592 tempest-VolumesActionsTest-729605592-project] 10.222.0.85 "GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d" status: 404 len: 111 microversion: 2.1 time: 0.046888 Aug 24 10:46:39.826378 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2650/5643] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:39 2022] GET /compute/v2.1/servers/0fa12935-a5ba-46ec-8706-99c9ad785d0d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:46:40.171114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8606dc85-3764-4f18-b2e0-366971dcc619 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:40.175349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8606dc85-3764-4f18-b2e0-366971dcc619 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:40.187151 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8606dc85-3764-4f18-b2e0-366971dcc619 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:40.188943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8606dc85-3764-4f18-b2e0-366971dcc619 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:40.189969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8606dc85-3764-4f18-b2e0-366971dcc619 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:40.191331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8606dc85-3764-4f18-b2e0-366971dcc619 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:40.191807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8606dc85-3764-4f18-b2e0-366971dcc619 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:40.192582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8606dc85-3764-4f18-b2e0-366971dcc619 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:40.197910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:40.231135 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8606dc85-3764-4f18-b2e0-366971dcc619 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065225 Aug 24 10:46:40.232247 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2994/5644] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:46:40 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:46:41.245493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6d5497bc-b5a9-4d76-b828-82c23748f830 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:41.249199 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6d5497bc-b5a9-4d76-b828-82c23748f830 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:41.268732 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d5497bc-b5a9-4d76-b828-82c23748f830 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:41.279669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d5497bc-b5a9-4d76-b828-82c23748f830 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:41.280287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d5497bc-b5a9-4d76-b828-82c23748f830 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:41.281381 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d5497bc-b5a9-4d76-b828-82c23748f830 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:41.282021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d5497bc-b5a9-4d76-b828-82c23748f830 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:41.282608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d5497bc-b5a9-4d76-b828-82c23748f830 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:41.325688 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6d5497bc-b5a9-4d76-b828-82c23748f830 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085665 Aug 24 10:46:41.329098 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2651/5645] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:46:41 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:46:42.338455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-870d9b4d-6fc9-4492-97ea-7413061b5cc9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:42.340700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-870d9b4d-6fc9-4492-97ea-7413061b5cc9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:42.348153 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-870d9b4d-6fc9-4492-97ea-7413061b5cc9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:42.348711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-870d9b4d-6fc9-4492-97ea-7413061b5cc9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:42.349168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-870d9b4d-6fc9-4492-97ea-7413061b5cc9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:42.350012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-870d9b4d-6fc9-4492-97ea-7413061b5cc9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:42.350437 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-870d9b4d-6fc9-4492-97ea-7413061b5cc9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:42.351038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-870d9b4d-6fc9-4492-97ea-7413061b5cc9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:42.386686 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-870d9b4d-6fc9-4492-97ea-7413061b5cc9 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052305 Aug 24 10:46:42.388003 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2995/5646] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:46:42 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 10:46:42.486427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2415c6bd-4bba-40e2-8d35-948e48993232 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:42.487711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2415c6bd-4bba-40e2-8d35-948e48993232 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:42.510464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2415c6bd-4bba-40e2-8d35-948e48993232 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:42.511148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2415c6bd-4bba-40e2-8d35-948e48993232 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:42.512565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2415c6bd-4bba-40e2-8d35-948e48993232 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:42.514484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2415c6bd-4bba-40e2-8d35-948e48993232 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:42.515213 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2415c6bd-4bba-40e2-8d35-948e48993232 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:42.515883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2415c6bd-4bba-40e2-8d35-948e48993232 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:42.553617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2415c6bd-4bba-40e2-8d35-948e48993232 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:46:42.733864 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2415c6bd-4bba-40e2-8d35-948e48993232 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "DELETE /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84" status: 204 len: 0 microversion: 2.1 time: 0.250958 Aug 24 10:46:42.737284 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2652/5647] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:46:42 2022] DELETE /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:46:42.746819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-38c60d89-d65d-4925-9e90-4acd5bcad443 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:42.747836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-38c60d89-d65d-4925-9e90-4acd5bcad443 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:42.762013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38c60d89-d65d-4925-9e90-4acd5bcad443 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:42.763264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38c60d89-d65d-4925-9e90-4acd5bcad443 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:42.764011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38c60d89-d65d-4925-9e90-4acd5bcad443 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:42.766815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38c60d89-d65d-4925-9e90-4acd5bcad443 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:42.769571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38c60d89-d65d-4925-9e90-4acd5bcad443 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:42.770384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38c60d89-d65d-4925-9e90-4acd5bcad443 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:43.280753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-38c60d89-d65d-4925-9e90-4acd5bcad443 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:43.329435 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-38c60d89-d65d-4925-9e90-4acd5bcad443 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84" status: 200 len: 1679 microversion: 2.1 time: 0.587429 Aug 24 10:46:43.337311 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2996/5648] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:42 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84 => generated 1679 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:44.359808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32bb4ac8-226c-4211-892d-b760dce15ef1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:44.361693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-32bb4ac8-226c-4211-892d-b760dce15ef1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:44.375655 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32bb4ac8-226c-4211-892d-b760dce15ef1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:44.377267 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32bb4ac8-226c-4211-892d-b760dce15ef1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:44.378327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32bb4ac8-226c-4211-892d-b760dce15ef1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:44.379371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32bb4ac8-226c-4211-892d-b760dce15ef1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:44.380119 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32bb4ac8-226c-4211-892d-b760dce15ef1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:44.381006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32bb4ac8-226c-4211-892d-b760dce15ef1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:44.702088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-32bb4ac8-226c-4211-892d-b760dce15ef1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:44.711194 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-32bb4ac8-226c-4211-892d-b760dce15ef1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84" status: 200 len: 1679 microversion: 2.1 time: 0.356838 Aug 24 10:46:44.711801 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2653/5649] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:44 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84 => generated 1679 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:45.734051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-182f1794-de9a-4df3-9067-dec44c126b76 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:45.735251 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-182f1794-de9a-4df3-9067-dec44c126b76 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:45.761376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-182f1794-de9a-4df3-9067-dec44c126b76 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:45.762197 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-182f1794-de9a-4df3-9067-dec44c126b76 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:45.764207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-182f1794-de9a-4df3-9067-dec44c126b76 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:45.767244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-182f1794-de9a-4df3-9067-dec44c126b76 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:45.767930 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-182f1794-de9a-4df3-9067-dec44c126b76 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:45.770541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-182f1794-de9a-4df3-9067-dec44c126b76 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:46.261499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-182f1794-de9a-4df3-9067-dec44c126b76 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:46.279246 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-182f1794-de9a-4df3-9067-dec44c126b76 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84" status: 200 len: 1612 microversion: 2.1 time: 0.550564 Aug 24 10:46:46.281200 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2997/5650] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:45 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84 => generated 1612 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:46.699644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-89af0525-c007-4176-ad98-098ce171e460 req-885b76ba-c979-4122-9d5f-b3124a817290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb455d4d-f629-4593-ab93-67ac87630d84", "name": "network-vif-deleted", "tag": "5c921a92-8857-466c-b0b7-b9f15938d925"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:46:46.714358 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-89af0525-c007-4176-ad98-098ce171e460 req-885b76ba-c979-4122-9d5f-b3124a817290 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:46.715346 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-89af0525-c007-4176-ad98-098ce171e460 req-885b76ba-c979-4122-9d5f-b3124a817290 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:46.716175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-89af0525-c007-4176-ad98-098ce171e460 req-885b76ba-c979-4122-9d5f-b3124a817290 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:46.738059 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-89af0525-c007-4176-ad98-098ce171e460 req-885b76ba-c979-4122-9d5f-b3124a817290 service nova] Creating event network-vif-deleted:5c921a92-8857-466c-b0b7-b9f15938d925 for instance bb455d4d-f629-4593-ab93-67ac87630d84 on n-h2-849328-3 Aug 24 10:46:46.748343 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-89af0525-c007-4176-ad98-098ce171e460 req-885b76ba-c979-4122-9d5f-b3124a817290 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053199 Aug 24 10:46:46.770585 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2654/5651] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:46:47.322195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-620f3386-9113-40ee-8d8d-c9cab4c47367 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:47.323241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-620f3386-9113-40ee-8d8d-c9cab4c47367 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:47.344892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-620f3386-9113-40ee-8d8d-c9cab4c47367 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:47.345504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-620f3386-9113-40ee-8d8d-c9cab4c47367 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:47.347896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-620f3386-9113-40ee-8d8d-c9cab4c47367 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:47.355478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-620f3386-9113-40ee-8d8d-c9cab4c47367 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:47.356045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-620f3386-9113-40ee-8d8d-c9cab4c47367 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:47.356816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-620f3386-9113-40ee-8d8d-c9cab4c47367 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:47.559021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-620f3386-9113-40ee-8d8d-c9cab4c47367 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:47.559556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-620f3386-9113-40ee-8d8d-c9cab4c47367 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:47.564133 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-620f3386-9113-40ee-8d8d-c9cab4c47367 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:47.565015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-620f3386-9113-40ee-8d8d-c9cab4c47367 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lazy-loading 'fault' on Instance uuid bb455d4d-f629-4593-ab93-67ac87630d84 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:46:48.671873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-620f3386-9113-40ee-8d8d-c9cab4c47367 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:48.680976 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-620f3386-9113-40ee-8d8d-c9cab4c47367 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84" status: 200 len: 1331 microversion: 2.1 time: 1.372628 Aug 24 10:46:48.693832 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2998/5652] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:47 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84 => generated 1331 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:49.705690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5ef056fe-284b-4c6d-83ae-4aa645843cbb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:49.707493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5ef056fe-284b-4c6d-83ae-4aa645843cbb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:49.723910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ef056fe-284b-4c6d-83ae-4aa645843cbb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:49.729031 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ef056fe-284b-4c6d-83ae-4aa645843cbb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:49.731497 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ef056fe-284b-4c6d-83ae-4aa645843cbb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:49.733792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ef056fe-284b-4c6d-83ae-4aa645843cbb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:49.733792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ef056fe-284b-4c6d-83ae-4aa645843cbb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:49.733792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ef056fe-284b-4c6d-83ae-4aa645843cbb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:49.770286 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-5ef056fe-284b-4c6d-83ae-4aa645843cbb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] HTTP exception thrown: Instance bb455d4d-f629-4593-ab93-67ac87630d84 could not be found. Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5ef056fe-284b-4c6d-83ae-4aa645843cbb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Request method failure captured: Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84 HTTP/1.1 Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgBznQHNaOQSFLxoSWoCQ9hM_j0rDTvTqgGEXtOY5AvsNS3wnSnsKPq1brvowzVLm_09c1waLsJrFpihbXQ2I-pXEEbKWLH4qZhxSJfMM_hStgT1NZ8xcwJWs2OWbQyk15VS3tMTjbBVTyv_jiH5rZPFN41C1BDVpAXdNxiZaDgd17U Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 3cfd67239d3f4b7a89be1453a08c92ba Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3cfd67239d3f4b7a89be1453a08c92ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3cfd67239d3f4b7a89be1453a08c92ba", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3cfd67239d3f4b7a89be1453a08c92ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3cfd67239d3f4b7a89be1453a08c92ba"}]}] Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 3cfd67239d3f4b7a89be1453a08c92ba Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-AttachVolumeNegativeTest-632701884-project Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: ff5172c17fae44e5839bd9b789e4c3a8 Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-AttachVolumeNegativeTest-632701884-project Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance bb455d4d-f629-4593-ab93-67ac87630d84 could not be found. Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'bb455d4d-f629-4593-ab93-67ac87630d84'} Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb455d4d-f629-4593-ab93-67ac87630d84 could not be found. Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb455d4d-f629-4593-ab93-67ac87630d84 could not be found. Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:46:49.774308 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:46:49.780005 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:46:49.780005 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:46:49.780005 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:46:49.780005 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:46:49.780005 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:46:49.780005 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb455d4d-f629-4593-ab93-67ac87630d84 could not be found. Aug 24 10:46:49.780005 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:46:49.780005 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5ef056fe-284b-4c6d-83ae-4aa645843cbb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Returning 404 to user: Instance bb455d4d-f629-4593-ab93-67ac87630d84 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:46:49.780005 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5ef056fe-284b-4c6d-83ae-4aa645843cbb tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84" status: 404 len: 111 microversion: 2.1 time: 0.077429 Aug 24 10:46:49.791564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d1a03b8f-31d3-4cf3-8e33-21d68cf86232 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '.version_select at 0x7f4647d513a0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:49.797762 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2655/5653] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:49 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:46:49.846987 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d1a03b8f-31d3-4cf3-8e33-21d68cf86232 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1162018293" status: 202 len: 0 microversion: 2.1 time: 0.061483 Aug 24 10:46:49.847652 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2999/5654] 10.222.0.85 () {58 vars in 1221 bytes} [Wed Aug 24 10:46:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1162018293 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:46:50.650022 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8c2cf76e-c3c2-4bbf-9ea6-28c50ec7184b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:46:50.656326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8c2cf76e-c3c2-4bbf-9ea6-28c50ec7184b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:50.669440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:50.691500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c2cf76e-c3c2-4bbf-9ea6-28c50ec7184b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:50.692389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c2cf76e-c3c2-4bbf-9ea6-28c50ec7184b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:50.693046 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c2cf76e-c3c2-4bbf-9ea6-28c50ec7184b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:50.694051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c2cf76e-c3c2-4bbf-9ea6-28c50ec7184b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:50.695504 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c2cf76e-c3c2-4bbf-9ea6-28c50ec7184b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:50.696202 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c2cf76e-c3c2-4bbf-9ea6-28c50ec7184b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:50.846379 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8c2cf76e-c3c2-4bbf-9ea6-28c50ec7184b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "POST /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a/action" status: 200 len: 24563 microversion: 2.1 time: 0.205355 Aug 24 10:46:50.848419 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2656/5655] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:46:50 2022] POST /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a/action => generated 24563 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:46:51.281590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3fbd188b-c397-43b5-91f4-f83bcfda3a91 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Action: 'create', calling method: .version_select at 0x7f4647d65040>, body: {"keypair": {"name": "tempest-keypair-365372290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErhK/b+2fXXoR9tfN46Krpn6N3Q4ZONN8kjSnZpQiF8Gw/1q/vbqnE3CwUG9JOX6JCvFVkbsP6xSE3EqdPdmCKCxpDZAhJDTydD94AOW0LP49dGfWwKQqnP0paXevudww=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:46:51.341375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-3fbd188b-c397-43b5-91f4-f83bcfda3a91 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Getting quotas for project 3cfd67239d3f4b7a89be1453a08c92ba. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:46:51.347788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-3fbd188b-c397-43b5-91f4-f83bcfda3a91 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Getting quotas for user ff5172c17fae44e5839bd9b789e4c3a8 and project 3cfd67239d3f4b7a89be1453a08c92ba. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:46:51.384047 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3fbd188b-c397-43b5-91f4-f83bcfda3a91 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.111651 Aug 24 10:46:51.391898 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3000/5656] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:46:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:46:55.021951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-77ade2b0-b5d4-4a30-925a-328b5ea6d81d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-286041845", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a83d8002-e283-4390-9f7e-f2670f338d6f"}], "security_groups": [{"name": "tempest-securitygroup--376979276"}], "key_name": "tempest-keypair-365372290", "user_data": "}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:46:55.310616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-77ade2b0-b5d4-4a30-925a-328b5ea6d81d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] validate_networks() for [('a83d8002-e283-4390-9f7e-f2670f338d6f', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:46:56.206154 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-77ade2b0-b5d4-4a30-925a-328b5ea6d81d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:46:56.207061 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-77ade2b0-b5d4-4a30-925a-328b5ea6d81d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:46:56.207061 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-77ade2b0-b5d4-4a30-925a-328b5ea6d81d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:46:56.207445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-77ade2b0-b5d4-4a30-925a-328b5ea6d81d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:46:56.207857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-77ade2b0-b5d4-4a30-925a-328b5ea6d81d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:46:56.229476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77ade2b0-b5d4-4a30-925a-328b5ea6d81d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:56.233295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77ade2b0-b5d4-4a30-925a-328b5ea6d81d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:56.234029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77ade2b0-b5d4-4a30-925a-328b5ea6d81d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:56.235063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77ade2b0-b5d4-4a30-925a-328b5ea6d81d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:56.235732 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77ade2b0-b5d4-4a30-925a-328b5ea6d81d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:56.241562 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77ade2b0-b5d4-4a30-925a-328b5ea6d81d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:56.285326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-77ade2b0-b5d4-4a30-925a-328b5ea6d81d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Getting quotas for project 3cfd67239d3f4b7a89be1453a08c92ba. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:46:56.293826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-77ade2b0-b5d4-4a30-925a-328b5ea6d81d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Getting quotas for user ff5172c17fae44e5839bd9b789e4c3a8 and project 3cfd67239d3f4b7a89be1453a08c92ba. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:46:56.330656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-77ade2b0-b5d4-4a30-925a-328b5ea6d81d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:46:56.343281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-77ade2b0-b5d4-4a30-925a-328b5ea6d81d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:46:56.451837 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-77ade2b0-b5d4-4a30-925a-328b5ea6d81d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.443075 Aug 24 10:46:56.453493 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2657/5657] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:46:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 1446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:46:56.465859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e3287bd2-07d2-408e-95ed-f45152df6d1b tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:56.468459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e3287bd2-07d2-408e-95ed-f45152df6d1b tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:56.480633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:57.437462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e3287bd2-07d2-408e-95ed-f45152df6d1b tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:57.447186 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e3287bd2-07d2-408e-95ed-f45152df6d1b tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd" status: 200 len: 1240 microversion: 2.1 time: 0.985724 Aug 24 10:46:57.450732 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3001/5658] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:56 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd => generated 1240 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:57.887167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-947748a6-e09f-4f7b-852a-f575b63932c1 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:57.889503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-947748a6-e09f-4f7b-852a-f575b63932c1 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:57.902515 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-947748a6-e09f-4f7b-852a-f575b63932c1 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:57.903601 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-947748a6-e09f-4f7b-852a-f575b63932c1 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:57.904370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-947748a6-e09f-4f7b-852a-f575b63932c1 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:57.905507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-947748a6-e09f-4f7b-852a-f575b63932c1 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:57.906633 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-947748a6-e09f-4f7b-852a-f575b63932c1 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:57.907559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-947748a6-e09f-4f7b-852a-f575b63932c1 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:57.959327 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-947748a6-e09f-4f7b-852a-f575b63932c1 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02/ips" status: 200 len: 146 microversion: 2.1 time: 0.080014 Aug 24 10:46:57.963396 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2658/5659] 10.222.0.85 () {58 vars in 1248 bytes} [Wed Aug 24 10:46:57 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02/ips => generated 146 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:46:58.472986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4c0fec7f-9679-4ea9-8231-4b90c2391f9b tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:58.474121 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4c0fec7f-9679-4ea9-8231-4b90c2391f9b tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:58.537860 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c0fec7f-9679-4ea9-8231-4b90c2391f9b tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:58.540233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c0fec7f-9679-4ea9-8231-4b90c2391f9b tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:58.541865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c0fec7f-9679-4ea9-8231-4b90c2391f9b tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:58.553797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c0fec7f-9679-4ea9-8231-4b90c2391f9b tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:58.556908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c0fec7f-9679-4ea9-8231-4b90c2391f9b tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:58.560815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c0fec7f-9679-4ea9-8231-4b90c2391f9b tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:58.800568 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4c0fec7f-9679-4ea9-8231-4b90c2391f9b tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:46:58.827980 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4c0fec7f-9679-4ea9-8231-4b90c2391f9b tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd" status: 200 len: 1298 microversion: 2.1 time: 0.356005 Aug 24 10:46:58.831646 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3002/5660] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:58 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd => generated 1298 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:46:59.853670 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-627baed9-c2f8-4da9-ab88-92fed1937051 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:46:59.854902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-627baed9-c2f8-4da9-ab88-92fed1937051 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:46:59.873478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-627baed9-c2f8-4da9-ab88-92fed1937051 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:59.881095 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-627baed9-c2f8-4da9-ab88-92fed1937051 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:59.881900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-627baed9-c2f8-4da9-ab88-92fed1937051 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:46:59.893377 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-627baed9-c2f8-4da9-ab88-92fed1937051 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:46:59.893928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-627baed9-c2f8-4da9-ab88-92fed1937051 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:46:59.894906 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-627baed9-c2f8-4da9-ab88-92fed1937051 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:00.032748 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-627baed9-c2f8-4da9-ab88-92fed1937051 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:00.047709 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-627baed9-c2f8-4da9-ab88-92fed1937051 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd" status: 200 len: 1298 microversion: 2.1 time: 0.194017 Aug 24 10:47:00.048534 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2659/5661] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:46:59 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd => generated 1298 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:01.086369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f964dc71-50b5-4e0b-8b09-77eea2432abc tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:01.088640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f964dc71-50b5-4e0b-8b09-77eea2432abc tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:01.099602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f964dc71-50b5-4e0b-8b09-77eea2432abc tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:01.100614 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f964dc71-50b5-4e0b-8b09-77eea2432abc tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:01.102282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f964dc71-50b5-4e0b-8b09-77eea2432abc tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:01.103517 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f964dc71-50b5-4e0b-8b09-77eea2432abc tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:01.104441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f964dc71-50b5-4e0b-8b09-77eea2432abc tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:01.109465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f964dc71-50b5-4e0b-8b09-77eea2432abc tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:01.482990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f964dc71-50b5-4e0b-8b09-77eea2432abc tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:01.491477 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f964dc71-50b5-4e0b-8b09-77eea2432abc tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd" status: 200 len: 1365 microversion: 2.1 time: 0.424164 Aug 24 10:47:01.499854 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3003/5662] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:01 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd => generated 1365 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:01.863484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5f3b30b6-b342-4718-b581-6fb7cea39d0a tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3fd6e25-e932-4c9b-95f7-a4ce0433783e"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:47:01.869622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5f3b30b6-b342-4718-b581-6fb7cea39d0a tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:01.906020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f3b30b6-b342-4718-b581-6fb7cea39d0a tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:01.907682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f3b30b6-b342-4718-b581-6fb7cea39d0a tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:01.910072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f3b30b6-b342-4718-b581-6fb7cea39d0a tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:01.912181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f3b30b6-b342-4718-b581-6fb7cea39d0a tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:01.918994 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f3b30b6-b342-4718-b581-6fb7cea39d0a tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:01.919540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f3b30b6-b342-4718-b581-6fb7cea39d0a tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:02.104564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-5eb9e8f8-cea5-4d00-b6e4-1a315d659d1a req-c91d61ee-ea7f-4467-9ed0-11e5d4e83b6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd547127-9c38-4b82-b256-057f141843cd", "tag": "fc2c19f7-5877-46d0-8a47-e82e600c9a5b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:47:02.129110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5eb9e8f8-cea5-4d00-b6e4-1a315d659d1a req-c91d61ee-ea7f-4467-9ed0-11e5d4e83b6f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:02.131246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5eb9e8f8-cea5-4d00-b6e4-1a315d659d1a req-c91d61ee-ea7f-4467-9ed0-11e5d4e83b6f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:02.132249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5eb9e8f8-cea5-4d00-b6e4-1a315d659d1a req-c91d61ee-ea7f-4467-9ed0-11e5d4e83b6f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:02.149098 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-5eb9e8f8-cea5-4d00-b6e4-1a315d659d1a req-c91d61ee-ea7f-4467-9ed0-11e5d4e83b6f service nova] Creating event network-changed:fc2c19f7-5877-46d0-8a47-e82e600c9a5b for instance fd547127-9c38-4b82-b256-057f141843cd on n-h1-849328-3 Aug 24 10:47:02.157681 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-5eb9e8f8-cea5-4d00-b6e4-1a315d659d1a req-c91d61ee-ea7f-4467-9ed0-11e5d4e83b6f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058671 Aug 24 10:47:02.161563 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3004/5663] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:47:02.526135 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d2c084fc-bdf5-419b-8dbf-26620b9d3b58 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:02.527138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d2c084fc-bdf5-419b-8dbf-26620b9d3b58 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:02.541623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2c084fc-bdf5-419b-8dbf-26620b9d3b58 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:02.541974 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5f3b30b6-b342-4718-b581-6fb7cea39d0a tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "POST /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.683734 Aug 24 10:47:02.549771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2c084fc-bdf5-419b-8dbf-26620b9d3b58 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:02.549771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2c084fc-bdf5-419b-8dbf-26620b9d3b58 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:02.551271 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2660/5664] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Aug 24 10:47:01 2022] POST /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02/os-volume_attachments => generated 194 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:47:02.554585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2c084fc-bdf5-419b-8dbf-26620b9d3b58 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:02.555664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2c084fc-bdf5-419b-8dbf-26620b9d3b58 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:02.555882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2c084fc-bdf5-419b-8dbf-26620b9d3b58 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:02.811821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d2c084fc-bdf5-419b-8dbf-26620b9d3b58 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:02.822955 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d2c084fc-bdf5-419b-8dbf-26620b9d3b58 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd" status: 200 len: 1365 microversion: 2.1 time: 0.301341 Aug 24 10:47:02.823662 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3005/5665] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:02 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd => generated 1365 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:03.849904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-224a8769-9eeb-449e-81df-0772c6cd8bc3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:03.850738 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-224a8769-9eeb-449e-81df-0772c6cd8bc3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:03.869186 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-224a8769-9eeb-449e-81df-0772c6cd8bc3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:03.869688 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-224a8769-9eeb-449e-81df-0772c6cd8bc3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:03.873849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-224a8769-9eeb-449e-81df-0772c6cd8bc3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:03.878138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-224a8769-9eeb-449e-81df-0772c6cd8bc3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:03.878883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-224a8769-9eeb-449e-81df-0772c6cd8bc3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:03.879545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-224a8769-9eeb-449e-81df-0772c6cd8bc3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:04.687434 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-224a8769-9eeb-449e-81df-0772c6cd8bc3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:04.718488 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-224a8769-9eeb-449e-81df-0772c6cd8bc3 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd" status: 200 len: 1365 microversion: 2.1 time: 0.873420 Aug 24 10:47:04.736404 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2661/5666] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:03 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd => generated 1365 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:05.771809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8d5e30a8-f8f5-46e8-9248-8a0435cc19ca tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:05.777592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8d5e30a8-f8f5-46e8-9248-8a0435cc19ca tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:05.803031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d5e30a8-f8f5-46e8-9248-8a0435cc19ca tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:05.803943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d5e30a8-f8f5-46e8-9248-8a0435cc19ca tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:05.804953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d5e30a8-f8f5-46e8-9248-8a0435cc19ca tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:05.806512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d5e30a8-f8f5-46e8-9248-8a0435cc19ca tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:05.807424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d5e30a8-f8f5-46e8-9248-8a0435cc19ca tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:05.808205 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d5e30a8-f8f5-46e8-9248-8a0435cc19ca tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:06.172691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8d5e30a8-f8f5-46e8-9248-8a0435cc19ca tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:06.186450 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8d5e30a8-f8f5-46e8-9248-8a0435cc19ca tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd" status: 200 len: 1365 microversion: 2.1 time: 0.430862 Aug 24 10:47:06.193490 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3006/5667] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:05 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd => generated 1365 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:07.233930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:07.233930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:07.240332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2ffcf36d-0eb5-4f93-afd9-5d300c66fdaa tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:07.249502 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2ffcf36d-0eb5-4f93-afd9-5d300c66fdaa tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:07.276521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ffcf36d-0eb5-4f93-afd9-5d300c66fdaa tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:07.278638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ffcf36d-0eb5-4f93-afd9-5d300c66fdaa tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:07.280081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ffcf36d-0eb5-4f93-afd9-5d300c66fdaa tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:07.282155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ffcf36d-0eb5-4f93-afd9-5d300c66fdaa tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:07.284815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ffcf36d-0eb5-4f93-afd9-5d300c66fdaa tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:07.285975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ffcf36d-0eb5-4f93-afd9-5d300c66fdaa tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:07.384582 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:08.465183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2ffcf36d-0eb5-4f93-afd9-5d300c66fdaa tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:08.479467 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2ffcf36d-0eb5-4f93-afd9-5d300c66fdaa tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd" status: 200 len: 1365 microversion: 2.1 time: 1.251576 Aug 24 10:47:08.490788 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2662/5668] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:07 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd => generated 1365 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:09.510125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-37f80f7f-5899-4da0-8a46-cb43215df53e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:09.510125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-37f80f7f-5899-4da0-8a46-cb43215df53e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:09.519070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:09.527294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37f80f7f-5899-4da0-8a46-cb43215df53e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:09.528268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37f80f7f-5899-4da0-8a46-cb43215df53e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:09.528962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37f80f7f-5899-4da0-8a46-cb43215df53e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:09.530056 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37f80f7f-5899-4da0-8a46-cb43215df53e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:09.534164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37f80f7f-5899-4da0-8a46-cb43215df53e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:09.534982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37f80f7f-5899-4da0-8a46-cb43215df53e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:09.774340 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-65aed1af-818b-4909-8f7a-4eb856d0bda3 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Action: 'create', calling method: .version_select at 0x7f465a259160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-258179170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAbwn1ISSzH42vC8xQ9lrD0kruLEy5RuJmnmb0kAIO8tleLjcPitWPc6stjNuJPBOVgRTRY6VyfR7UvLcaOzmQZfg9KjMb1Sf/800pdqRW+5/+sjwAxm9//sFlDtymR3Q=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:47:09.811674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-65aed1af-818b-4909-8f7a-4eb856d0bda3 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Getting quotas for project 65e4aa20cf3d44a2b11f47c0c18cfb4d. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:47:09.828796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-37f80f7f-5899-4da0-8a46-cb43215df53e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:09.833504 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-65aed1af-818b-4909-8f7a-4eb856d0bda3 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Getting quotas for user afd244b0014c4240bca18becdd30a5a0 and project 65e4aa20cf3d44a2b11f47c0c18cfb4d. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:47:09.837488 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-37f80f7f-5899-4da0-8a46-cb43215df53e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd" status: 200 len: 1365 microversion: 2.1 time: 0.339155 Aug 24 10:47:09.838786 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3007/5669] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:09 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd => generated 1365 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:09.919933 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-65aed1af-818b-4909-8f7a-4eb856d0bda3 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.150705 Aug 24 10:47:09.920587 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2663/5670] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:47:09 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:47:10.864230 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-00eeb259-326f-46a6-820c-58e6b35e527a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:10.864833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-00eeb259-326f-46a6-820c-58e6b35e527a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:10.890609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00eeb259-326f-46a6-820c-58e6b35e527a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:10.891738 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00eeb259-326f-46a6-820c-58e6b35e527a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:10.894963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00eeb259-326f-46a6-820c-58e6b35e527a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:10.898822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00eeb259-326f-46a6-820c-58e6b35e527a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:10.902491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00eeb259-326f-46a6-820c-58e6b35e527a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:10.904285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00eeb259-326f-46a6-820c-58e6b35e527a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:10.926273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=63 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:11.420662 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-00eeb259-326f-46a6-820c-58e6b35e527a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:11.431336 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-00eeb259-326f-46a6-820c-58e6b35e527a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd" status: 200 len: 1365 microversion: 2.1 time: 0.571096 Aug 24 10:47:11.444581 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3008/5671] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:10 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd => generated 1365 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:47:12.468412 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-98a156f0-08d6-4b11-927a-5f1c80e332f7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:12.469024 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-98a156f0-08d6-4b11-927a-5f1c80e332f7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:12.484265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98a156f0-08d6-4b11-927a-5f1c80e332f7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:12.485185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98a156f0-08d6-4b11-927a-5f1c80e332f7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:12.489753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98a156f0-08d6-4b11-927a-5f1c80e332f7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:12.490762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98a156f0-08d6-4b11-927a-5f1c80e332f7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:12.497894 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98a156f0-08d6-4b11-927a-5f1c80e332f7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:12.498844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98a156f0-08d6-4b11-927a-5f1c80e332f7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:12.555393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e7840fee-5604-4890-9827-554593d8276b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-660331749", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "0754e9b4-434b-452d-af81-4f8337ef1177"}], "key_name": "tempest-TestNetworkBasicOps-258179170", "security_groups": [{"name": "tempest-secgroup-smoke-781380694"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:47:12.833137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-e7840fee-5604-4890-9827-554593d8276b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] validate_networks() for [('0754e9b4-434b-452d-af81-4f8337ef1177', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:47:12.852133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-98a156f0-08d6-4b11-927a-5f1c80e332f7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:12.866957 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-98a156f0-08d6-4b11-927a-5f1c80e332f7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd" status: 200 len: 1365 microversion: 2.1 time: 0.400791 Aug 24 10:47:12.868239 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2664/5672] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:12 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd => generated 1365 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:13.889735 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b3a5bfc-c916-4118-9cde-effa4803f9b7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:13.892312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2b3a5bfc-c916-4118-9cde-effa4803f9b7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:13.912576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b3a5bfc-c916-4118-9cde-effa4803f9b7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:13.914324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b3a5bfc-c916-4118-9cde-effa4803f9b7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:13.916829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b3a5bfc-c916-4118-9cde-effa4803f9b7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:13.917925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b3a5bfc-c916-4118-9cde-effa4803f9b7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:13.923272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b3a5bfc-c916-4118-9cde-effa4803f9b7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:13.924094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b3a5bfc-c916-4118-9cde-effa4803f9b7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:13.950211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e7840fee-5604-4890-9827-554593d8276b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:47:13.951344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e7840fee-5604-4890-9827-554593d8276b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:47:13.952669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e7840fee-5604-4890-9827-554593d8276b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:47:13.953385 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e7840fee-5604-4890-9827-554593d8276b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:47:13.953987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e7840fee-5604-4890-9827-554593d8276b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:47:13.972096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7840fee-5604-4890-9827-554593d8276b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:13.974796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7840fee-5604-4890-9827-554593d8276b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:13.976748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7840fee-5604-4890-9827-554593d8276b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:13.979815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7840fee-5604-4890-9827-554593d8276b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:13.980859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7840fee-5604-4890-9827-554593d8276b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:13.983761 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7840fee-5604-4890-9827-554593d8276b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:14.036526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-e7840fee-5604-4890-9827-554593d8276b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Getting quotas for project 65e4aa20cf3d44a2b11f47c0c18cfb4d. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:47:14.045289 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-e7840fee-5604-4890-9827-554593d8276b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Getting quotas for user afd244b0014c4240bca18becdd30a5a0 and project 65e4aa20cf3d44a2b11f47c0c18cfb4d. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:47:14.078974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e7840fee-5604-4890-9827-554593d8276b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:47:14.082068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e7840fee-5604-4890-9827-554593d8276b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 7ffe4fcd-67d0-493e-b966-0e49e13f97d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:47:14.231378 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e7840fee-5604-4890-9827-554593d8276b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.677898 Aug 24 10:47:14.232432 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3009/5673] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:47:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 1683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:47:14.278458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-174b4650-b0e8-4dc6-81fa-6b8230ae2f64 req-c2c31bcf-e0d4-4b37-8781-e134c7e698ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd547127-9c38-4b82-b256-057f141843cd", "name": "network-vif-plugged", "status": "completed", "tag": "fc2c19f7-5877-46d0-8a47-e82e600c9a5b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:47:14.319966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-174b4650-b0e8-4dc6-81fa-6b8230ae2f64 req-c2c31bcf-e0d4-4b37-8781-e134c7e698ca service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:14.325833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-174b4650-b0e8-4dc6-81fa-6b8230ae2f64 req-c2c31bcf-e0d4-4b37-8781-e134c7e698ca service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:14.326585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-174b4650-b0e8-4dc6-81fa-6b8230ae2f64 req-c2c31bcf-e0d4-4b37-8781-e134c7e698ca service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:14.343988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2b3a5bfc-c916-4118-9cde-effa4803f9b7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:14.353677 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2b3a5bfc-c916-4118-9cde-effa4803f9b7 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd" status: 200 len: 1365 microversion: 2.1 time: 0.469365 Aug 24 10:47:14.361805 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2665/5674] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:13 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd => generated 1365 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:14.375653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b752fca4-a569-4f2f-b405-703e34a1262b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:14.377952 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-174b4650-b0e8-4dc6-81fa-6b8230ae2f64 req-c2c31bcf-e0d4-4b37-8781-e134c7e698ca service nova] Creating event network-vif-plugged:fc2c19f7-5877-46d0-8a47-e82e600c9a5b for instance fd547127-9c38-4b82-b256-057f141843cd on n-h1-849328-3 Aug 24 10:47:14.384775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b752fca4-a569-4f2f-b405-703e34a1262b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 7ffe4fcd-67d0-493e-b966-0e49e13f97d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:14.401083 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-174b4650-b0e8-4dc6-81fa-6b8230ae2f64 req-c2c31bcf-e0d4-4b37-8781-e134c7e698ca service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159829 Aug 24 10:47:14.401770 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3010/5675] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:47:14.837677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b752fca4-a569-4f2f-b405-703e34a1262b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:14.849922 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b752fca4-a569-4f2f-b405-703e34a1262b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4" status: 200 len: 1247 microversion: 2.1 time: 0.486680 Aug 24 10:47:14.850532 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2666/5676] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:14 2022] GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4 => generated 1247 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:15.379872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cf91d52e-caee-4d74-9791-8f4c027c275e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:15.380422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cf91d52e-caee-4d74-9791-8f4c027c275e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:15.398103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf91d52e-caee-4d74-9791-8f4c027c275e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:15.398606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf91d52e-caee-4d74-9791-8f4c027c275e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:15.399043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf91d52e-caee-4d74-9791-8f4c027c275e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:15.399772 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf91d52e-caee-4d74-9791-8f4c027c275e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:15.400319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf91d52e-caee-4d74-9791-8f4c027c275e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:15.400751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf91d52e-caee-4d74-9791-8f4c027c275e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:15.875763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7ca20eba-c6ad-41d7-8241-3f1119db870f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:15.877078 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7ca20eba-c6ad-41d7-8241-3f1119db870f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 7ffe4fcd-67d0-493e-b966-0e49e13f97d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:15.902783 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ca20eba-c6ad-41d7-8241-3f1119db870f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:15.903483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ca20eba-c6ad-41d7-8241-3f1119db870f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:15.904277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ca20eba-c6ad-41d7-8241-3f1119db870f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:15.906115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ca20eba-c6ad-41d7-8241-3f1119db870f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:15.906761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ca20eba-c6ad-41d7-8241-3f1119db870f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:15.907346 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ca20eba-c6ad-41d7-8241-3f1119db870f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:16.059036 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7ca20eba-c6ad-41d7-8241-3f1119db870f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:16.074956 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7ca20eba-c6ad-41d7-8241-3f1119db870f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4" status: 200 len: 1251 microversion: 2.1 time: 0.202358 Aug 24 10:47:16.080084 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2667/5677] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:15 2022] GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4 => generated 1251 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:16.309643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cf91d52e-caee-4d74-9791-8f4c027c275e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:16.325946 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cf91d52e-caee-4d74-9791-8f4c027c275e tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd" status: 200 len: 1365 microversion: 2.1 time: 0.949813 Aug 24 10:47:16.329098 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3011/5678] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:15 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd => generated 1365 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:17.118980 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad34a746-9d69-4262-b030-d5ab7ab49539 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:17.120976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ad34a746-9d69-4262-b030-d5ab7ab49539 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 7ffe4fcd-67d0-493e-b966-0e49e13f97d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:17.164531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad34a746-9d69-4262-b030-d5ab7ab49539 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:17.168196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad34a746-9d69-4262-b030-d5ab7ab49539 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:17.170318 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad34a746-9d69-4262-b030-d5ab7ab49539 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:17.174581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad34a746-9d69-4262-b030-d5ab7ab49539 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:17.181192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad34a746-9d69-4262-b030-d5ab7ab49539 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:17.182511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad34a746-9d69-4262-b030-d5ab7ab49539 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:17.349031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dd44a62f-8ff2-43ea-aa19-87580e5f4dce tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:17.349801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dd44a62f-8ff2-43ea-aa19-87580e5f4dce tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:17.385477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd44a62f-8ff2-43ea-aa19-87580e5f4dce tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:17.400347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd44a62f-8ff2-43ea-aa19-87580e5f4dce tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:17.401302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd44a62f-8ff2-43ea-aa19-87580e5f4dce tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:17.405560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd44a62f-8ff2-43ea-aa19-87580e5f4dce tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:17.409511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd44a62f-8ff2-43ea-aa19-87580e5f4dce tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:17.415122 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd44a62f-8ff2-43ea-aa19-87580e5f4dce tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:17.472362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ad34a746-9d69-4262-b030-d5ab7ab49539 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:17.487088 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ad34a746-9d69-4262-b030-d5ab7ab49539 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4" status: 200 len: 1305 microversion: 2.1 time: 0.383304 Aug 24 10:47:17.487356 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2668/5679] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:17 2022] GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4 => generated 1305 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:17.860094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dd44a62f-8ff2-43ea-aa19-87580e5f4dce tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:17.883533 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dd44a62f-8ff2-43ea-aa19-87580e5f4dce tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd" status: 200 len: 1554 microversion: 2.1 time: 0.537540 Aug 24 10:47:17.904548 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3012/5680] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:17 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd => generated 1554 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:17.906195 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e255a775-658b-4c07-b71f-f3abc51d746d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:17.906977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e255a775-658b-4c07-b71f-f3abc51d746d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:17.920684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e255a775-658b-4c07-b71f-f3abc51d746d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:17.923534 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e255a775-658b-4c07-b71f-f3abc51d746d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:17.924237 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e255a775-658b-4c07-b71f-f3abc51d746d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:17.926401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e255a775-658b-4c07-b71f-f3abc51d746d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:17.928598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e255a775-658b-4c07-b71f-f3abc51d746d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:17.929369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e255a775-658b-4c07-b71f-f3abc51d746d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:18.300763 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e255a775-658b-4c07-b71f-f3abc51d746d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.399055 Aug 24 10:47:18.314339 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2669/5681] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Aug 24 10:47:17 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd/os-interface => generated 284 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:47:18.511611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b5eaa011-8a6c-44ae-8ba6-a7ee49b6be72 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:18.515709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b5eaa011-8a6c-44ae-8ba6-a7ee49b6be72 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 7ffe4fcd-67d0-493e-b966-0e49e13f97d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:18.542450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5eaa011-8a6c-44ae-8ba6-a7ee49b6be72 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:18.544662 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5eaa011-8a6c-44ae-8ba6-a7ee49b6be72 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:18.546725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5eaa011-8a6c-44ae-8ba6-a7ee49b6be72 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:18.547533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5eaa011-8a6c-44ae-8ba6-a7ee49b6be72 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:18.548018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5eaa011-8a6c-44ae-8ba6-a7ee49b6be72 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:18.551471 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5eaa011-8a6c-44ae-8ba6-a7ee49b6be72 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:20.788645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d71e196f-ba89-4c81-b00d-959da5ef07ad tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:47:20.812871 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:20.847674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d71e196f-ba89-4c81-b00d-959da5ef07ad tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:20.849757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d71e196f-ba89-4c81-b00d-959da5ef07ad tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:20.852359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d71e196f-ba89-4c81-b00d-959da5ef07ad tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:20.961892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d71e196f-ba89-4c81-b00d-959da5ef07ad tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Going to try to stop instance {{(pid=122432) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 10:47:21.083863 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d71e196f-ba89-4c81-b00d-959da5ef07ad tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "POST /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02/action" status: 202 len: 0 microversion: 2.1 time: 0.302621 Aug 24 10:47:21.085349 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2670/5682] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:47:20 2022] POST /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 10:47:21.093966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-46ce5372-2c58-4f05-a4da-941bb2825b70 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:21.095185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-46ce5372-2c58-4f05-a4da-941bb2825b70 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:21.114197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46ce5372-2c58-4f05-a4da-941bb2825b70 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:21.115323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46ce5372-2c58-4f05-a4da-941bb2825b70 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:21.116041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46ce5372-2c58-4f05-a4da-941bb2825b70 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:21.117029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46ce5372-2c58-4f05-a4da-941bb2825b70 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:21.117782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46ce5372-2c58-4f05-a4da-941bb2825b70 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:21.118467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46ce5372-2c58-4f05-a4da-941bb2825b70 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:21.267634 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b5eaa011-8a6c-44ae-8ba6-a7ee49b6be72 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:21.276663 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b5eaa011-8a6c-44ae-8ba6-a7ee49b6be72 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4" status: 200 len: 1372 microversion: 2.1 time: 2.772290 Aug 24 10:47:21.280956 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3013/5683] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:18 2022] GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4 => generated 1372 bytes in 2778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:21.640541 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-46ce5372-2c58-4f05-a4da-941bb2825b70 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:21.656424 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-46ce5372-2c58-4f05-a4da-941bb2825b70 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1725 microversion: 2.1 time: 0.566791 Aug 24 10:47:21.672176 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2671/5684] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:21 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1725 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:47:22.019222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-b4df72c1-1594-47c1-8520-26b1c3955267 req-bbe958e2-66c4-43ed-bd7b-28bcc416e62f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ffe4fcd-67d0-493e-b966-0e49e13f97d4", "tag": "9c795d87-515e-4dea-af0f-dab6c1d2e978"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:47:22.035706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b4df72c1-1594-47c1-8520-26b1c3955267 req-bbe958e2-66c4-43ed-bd7b-28bcc416e62f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:22.036477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b4df72c1-1594-47c1-8520-26b1c3955267 req-bbe958e2-66c4-43ed-bd7b-28bcc416e62f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:22.037147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b4df72c1-1594-47c1-8520-26b1c3955267 req-bbe958e2-66c4-43ed-bd7b-28bcc416e62f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:22.050076 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-b4df72c1-1594-47c1-8520-26b1c3955267 req-bbe958e2-66c4-43ed-bd7b-28bcc416e62f service nova] Creating event network-changed:9c795d87-515e-4dea-af0f-dab6c1d2e978 for instance 7ffe4fcd-67d0-493e-b966-0e49e13f97d4 on n-h2-849328-3 Aug 24 10:47:22.056300 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-b4df72c1-1594-47c1-8520-26b1c3955267 req-bbe958e2-66c4-43ed-bd7b-28bcc416e62f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041615 Aug 24 10:47:22.057770 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3014/5685] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:47:22.323759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6cecd139-d055-4d32-b264-2c7745315f78 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:22.324721 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6cecd139-d055-4d32-b264-2c7745315f78 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 7ffe4fcd-67d0-493e-b966-0e49e13f97d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:22.348560 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cecd139-d055-4d32-b264-2c7745315f78 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:22.349958 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cecd139-d055-4d32-b264-2c7745315f78 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:22.350599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cecd139-d055-4d32-b264-2c7745315f78 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:22.351824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cecd139-d055-4d32-b264-2c7745315f78 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:22.352830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cecd139-d055-4d32-b264-2c7745315f78 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:22.353760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cecd139-d055-4d32-b264-2c7745315f78 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:22.682390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3883f644-b733-4ebf-af38-edcbdffdba05 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:22.683489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3883f644-b733-4ebf-af38-edcbdffdba05 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:22.707788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3883f644-b733-4ebf-af38-edcbdffdba05 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:22.708447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3883f644-b733-4ebf-af38-edcbdffdba05 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:22.717395 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3883f644-b733-4ebf-af38-edcbdffdba05 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:22.718473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3883f644-b733-4ebf-af38-edcbdffdba05 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:22.719283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3883f644-b733-4ebf-af38-edcbdffdba05 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:22.719934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3883f644-b733-4ebf-af38-edcbdffdba05 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:22.965777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3883f644-b733-4ebf-af38-edcbdffdba05 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:22.979141 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3883f644-b733-4ebf-af38-edcbdffdba05 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1725 microversion: 2.1 time: 0.304446 Aug 24 10:47:22.980700 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3015/5686] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:22 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1725 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:23.008829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c01c77c9-c721-4857-bd7e-22b409c7f47e req-5c1c7531-144a-4241-9004-22c35747f4f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd547127-9c38-4b82-b256-057f141843cd", "tag": "fc2c19f7-5877-46d0-8a47-e82e600c9a5b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:47:23.055391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c01c77c9-c721-4857-bd7e-22b409c7f47e req-5c1c7531-144a-4241-9004-22c35747f4f9 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:23.055880 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c01c77c9-c721-4857-bd7e-22b409c7f47e req-5c1c7531-144a-4241-9004-22c35747f4f9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:23.057579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c01c77c9-c721-4857-bd7e-22b409c7f47e req-5c1c7531-144a-4241-9004-22c35747f4f9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:23.099731 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c01c77c9-c721-4857-bd7e-22b409c7f47e req-5c1c7531-144a-4241-9004-22c35747f4f9 service nova] Creating event network-changed:fc2c19f7-5877-46d0-8a47-e82e600c9a5b for instance fd547127-9c38-4b82-b256-057f141843cd on n-h1-849328-3 Aug 24 10:47:23.127788 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c01c77c9-c721-4857-bd7e-22b409c7f47e req-5c1c7531-144a-4241-9004-22c35747f4f9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144359 Aug 24 10:47:23.128778 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3016/5687] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:47:23.170308 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6cecd139-d055-4d32-b264-2c7745315f78 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:23.180838 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6cecd139-d055-4d32-b264-2c7745315f78 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4" status: 200 len: 1372 microversion: 2.1 time: 0.879307 Aug 24 10:47:23.184397 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2672/5688] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:22 2022] GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4 => generated 1372 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:24.008750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a22976b0-00ea-40c1-abbc-3b3f9249919f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:24.010230 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a22976b0-00ea-40c1-abbc-3b3f9249919f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:24.029679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a22976b0-00ea-40c1-abbc-3b3f9249919f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:24.030203 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a22976b0-00ea-40c1-abbc-3b3f9249919f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:24.032116 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a22976b0-00ea-40c1-abbc-3b3f9249919f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:24.033088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a22976b0-00ea-40c1-abbc-3b3f9249919f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:24.034050 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a22976b0-00ea-40c1-abbc-3b3f9249919f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:24.034892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a22976b0-00ea-40c1-abbc-3b3f9249919f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:24.036635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:24.064512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:24.203725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-07135461-959c-4c59-998f-b3d6bde70e80 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:24.205031 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-07135461-959c-4c59-998f-b3d6bde70e80 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 7ffe4fcd-67d0-493e-b966-0e49e13f97d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:24.216876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07135461-959c-4c59-998f-b3d6bde70e80 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:24.217828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07135461-959c-4c59-998f-b3d6bde70e80 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:24.218470 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07135461-959c-4c59-998f-b3d6bde70e80 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:24.220015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07135461-959c-4c59-998f-b3d6bde70e80 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:24.220840 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07135461-959c-4c59-998f-b3d6bde70e80 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:24.221777 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07135461-959c-4c59-998f-b3d6bde70e80 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:24.238505 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a22976b0-00ea-40c1-abbc-3b3f9249919f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:24.251909 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a22976b0-00ea-40c1-abbc-3b3f9249919f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1725 microversion: 2.1 time: 0.254024 Aug 24 10:47:24.254251 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3017/5689] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:23 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1725 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:24.824490 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-07135461-959c-4c59-998f-b3d6bde70e80 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:24.838518 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-07135461-959c-4c59-998f-b3d6bde70e80 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4" status: 200 len: 1372 microversion: 2.1 time: 0.640424 Aug 24 10:47:24.839429 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2673/5690] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:24 2022] GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4 => generated 1372 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:47:25.293467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-29175715-5257-4c3e-968a-03187cc7c702 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:25.293467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-29175715-5257-4c3e-968a-03187cc7c702 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:25.338921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29175715-5257-4c3e-968a-03187cc7c702 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:25.341209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29175715-5257-4c3e-968a-03187cc7c702 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:25.344522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29175715-5257-4c3e-968a-03187cc7c702 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:25.347674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29175715-5257-4c3e-968a-03187cc7c702 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:25.348167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29175715-5257-4c3e-968a-03187cc7c702 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:25.348607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29175715-5257-4c3e-968a-03187cc7c702 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:25.625570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-29175715-5257-4c3e-968a-03187cc7c702 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:25.635056 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-29175715-5257-4c3e-968a-03187cc7c702 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1725 microversion: 2.1 time: 0.356375 Aug 24 10:47:25.636737 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3018/5691] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:25 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1725 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:25.860323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-28ccd242-91b5-4fa8-9270-110652338ac4 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:25.861584 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-28ccd242-91b5-4fa8-9270-110652338ac4 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 7ffe4fcd-67d0-493e-b966-0e49e13f97d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:25.873618 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:25.876395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28ccd242-91b5-4fa8-9270-110652338ac4 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:25.878495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28ccd242-91b5-4fa8-9270-110652338ac4 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:25.879762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28ccd242-91b5-4fa8-9270-110652338ac4 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:25.882382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28ccd242-91b5-4fa8-9270-110652338ac4 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:25.883020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28ccd242-91b5-4fa8-9270-110652338ac4 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:25.883629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28ccd242-91b5-4fa8-9270-110652338ac4 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:26.242792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-28ccd242-91b5-4fa8-9270-110652338ac4 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:26.253722 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-28ccd242-91b5-4fa8-9270-110652338ac4 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4" status: 200 len: 1372 microversion: 2.1 time: 0.397389 Aug 24 10:47:26.263578 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2674/5692] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:25 2022] GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4 => generated 1372 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:26.660348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-58a3abbd-797a-470a-bb0a-02c75f636113 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:26.660966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-58a3abbd-797a-470a-bb0a-02c75f636113 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:26.668998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:26.685900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58a3abbd-797a-470a-bb0a-02c75f636113 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:26.686554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58a3abbd-797a-470a-bb0a-02c75f636113 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:26.687063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58a3abbd-797a-470a-bb0a-02c75f636113 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:26.689808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58a3abbd-797a-470a-bb0a-02c75f636113 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:26.690616 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58a3abbd-797a-470a-bb0a-02c75f636113 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:26.691122 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58a3abbd-797a-470a-bb0a-02c75f636113 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:26.920905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-58a3abbd-797a-470a-bb0a-02c75f636113 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:26.938928 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-58a3abbd-797a-470a-bb0a-02c75f636113 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1725 microversion: 2.1 time: 0.282559 Aug 24 10:47:26.955234 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3019/5693] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:26 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1725 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:27.289246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-637c839c-401c-41fe-ae59-2d4befd9f6fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:27.290688 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-637c839c-401c-41fe-ae59-2d4befd9f6fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 7ffe4fcd-67d0-493e-b966-0e49e13f97d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:27.298367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-637c839c-401c-41fe-ae59-2d4befd9f6fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:27.299122 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-637c839c-401c-41fe-ae59-2d4befd9f6fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:27.299736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-637c839c-401c-41fe-ae59-2d4befd9f6fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:27.301196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-637c839c-401c-41fe-ae59-2d4befd9f6fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:27.301810 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-637c839c-401c-41fe-ae59-2d4befd9f6fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:27.302395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-637c839c-401c-41fe-ae59-2d4befd9f6fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:27.575689 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-637c839c-401c-41fe-ae59-2d4befd9f6fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:27.590708 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-637c839c-401c-41fe-ae59-2d4befd9f6fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4" status: 200 len: 1372 microversion: 2.1 time: 0.305536 Aug 24 10:47:27.591724 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2675/5694] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:27 2022] GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4 => generated 1372 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:47:27.967788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7a1a3902-72c5-4fb4-b109-791ba115a54f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:27.969495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7a1a3902-72c5-4fb4-b109-791ba115a54f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:27.988661 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a1a3902-72c5-4fb4-b109-791ba115a54f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:27.989459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a1a3902-72c5-4fb4-b109-791ba115a54f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:27.990058 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a1a3902-72c5-4fb4-b109-791ba115a54f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:27.991241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a1a3902-72c5-4fb4-b109-791ba115a54f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:27.991872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a1a3902-72c5-4fb4-b109-791ba115a54f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:27.992709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a1a3902-72c5-4fb4-b109-791ba115a54f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:28.291818 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7a1a3902-72c5-4fb4-b109-791ba115a54f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:28.302593 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7a1a3902-72c5-4fb4-b109-791ba115a54f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1725 microversion: 2.1 time: 0.341107 Aug 24 10:47:28.323241 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3020/5695] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:27 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1725 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:28.613031 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cae8bbc8-fd65-4d8f-b490-cbabe1252049 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:28.614327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cae8bbc8-fd65-4d8f-b490-cbabe1252049 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 7ffe4fcd-67d0-493e-b966-0e49e13f97d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:28.629915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cae8bbc8-fd65-4d8f-b490-cbabe1252049 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:28.630692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cae8bbc8-fd65-4d8f-b490-cbabe1252049 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:28.631367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cae8bbc8-fd65-4d8f-b490-cbabe1252049 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:28.632239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cae8bbc8-fd65-4d8f-b490-cbabe1252049 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:28.632848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cae8bbc8-fd65-4d8f-b490-cbabe1252049 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:28.633521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cae8bbc8-fd65-4d8f-b490-cbabe1252049 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:29.196534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-9062f959-ccf1-4b99-888f-fd172d9df250 req-36be1bcb-42ca-408a-8a26-f031da4dcbbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ffe4fcd-67d0-493e-b966-0e49e13f97d4", "name": "network-vif-plugged", "status": "completed", "tag": "9c795d87-515e-4dea-af0f-dab6c1d2e978"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:47:29.218935 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9062f959-ccf1-4b99-888f-fd172d9df250 req-36be1bcb-42ca-408a-8a26-f031da4dcbbb service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:29.219725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9062f959-ccf1-4b99-888f-fd172d9df250 req-36be1bcb-42ca-408a-8a26-f031da4dcbbb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:29.222676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9062f959-ccf1-4b99-888f-fd172d9df250 req-36be1bcb-42ca-408a-8a26-f031da4dcbbb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:29.249561 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-9062f959-ccf1-4b99-888f-fd172d9df250 req-36be1bcb-42ca-408a-8a26-f031da4dcbbb service nova] Creating event network-vif-plugged:9c795d87-515e-4dea-af0f-dab6c1d2e978 for instance 7ffe4fcd-67d0-493e-b966-0e49e13f97d4 on n-h2-849328-3 Aug 24 10:47:29.264641 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-9062f959-ccf1-4b99-888f-fd172d9df250 req-36be1bcb-42ca-408a-8a26-f031da4dcbbb service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.451768 Aug 24 10:47:29.265642 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3021/5696] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:47:29.326650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-af574960-263b-4dbd-98c1-b8e5a58e41d9 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:29.328027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-af574960-263b-4dbd-98c1-b8e5a58e41d9 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:29.343358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af574960-263b-4dbd-98c1-b8e5a58e41d9 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:29.344231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af574960-263b-4dbd-98c1-b8e5a58e41d9 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:29.345472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af574960-263b-4dbd-98c1-b8e5a58e41d9 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:29.346374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af574960-263b-4dbd-98c1-b8e5a58e41d9 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:29.347481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af574960-263b-4dbd-98c1-b8e5a58e41d9 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:29.348142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af574960-263b-4dbd-98c1-b8e5a58e41d9 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:29.542559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-af574960-263b-4dbd-98c1-b8e5a58e41d9 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:29.551984 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-af574960-263b-4dbd-98c1-b8e5a58e41d9 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1725 microversion: 2.1 time: 0.230360 Aug 24 10:47:29.552588 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3022/5697] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:29 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1725 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:29.687010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cae8bbc8-fd65-4d8f-b490-cbabe1252049 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:29.700157 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cae8bbc8-fd65-4d8f-b490-cbabe1252049 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4" status: 200 len: 1372 microversion: 2.1 time: 1.091846 Aug 24 10:47:29.714319 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2676/5698] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:28 2022] GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4 => generated 1372 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:30.585902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-195859f3-bdd7-46f2-a2a3-8f40cb658ef0 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:30.591333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-195859f3-bdd7-46f2-a2a3-8f40cb658ef0 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:30.604752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-195859f3-bdd7-46f2-a2a3-8f40cb658ef0 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:30.605313 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-195859f3-bdd7-46f2-a2a3-8f40cb658ef0 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:30.605779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-195859f3-bdd7-46f2-a2a3-8f40cb658ef0 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:30.606645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-195859f3-bdd7-46f2-a2a3-8f40cb658ef0 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:30.615025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-195859f3-bdd7-46f2-a2a3-8f40cb658ef0 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:30.616156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-195859f3-bdd7-46f2-a2a3-8f40cb658ef0 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:30.730869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-767c6265-6186-49a2-ac45-e30e03a648ee tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:30.732321 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-767c6265-6186-49a2-ac45-e30e03a648ee tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 7ffe4fcd-67d0-493e-b966-0e49e13f97d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:30.743089 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-767c6265-6186-49a2-ac45-e30e03a648ee tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:30.744044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-767c6265-6186-49a2-ac45-e30e03a648ee tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:30.745433 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-767c6265-6186-49a2-ac45-e30e03a648ee tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:30.746644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-767c6265-6186-49a2-ac45-e30e03a648ee tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:30.747381 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-767c6265-6186-49a2-ac45-e30e03a648ee tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:30.748036 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-767c6265-6186-49a2-ac45-e30e03a648ee tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:30.935293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-195859f3-bdd7-46f2-a2a3-8f40cb658ef0 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:30.944895 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-195859f3-bdd7-46f2-a2a3-8f40cb658ef0 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1725 microversion: 2.1 time: 0.368023 Aug 24 10:47:30.945555 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3023/5699] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:30 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1725 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:31.294870 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-767c6265-6186-49a2-ac45-e30e03a648ee tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:31.336267 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-767c6265-6186-49a2-ac45-e30e03a648ee tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4" status: 200 len: 1372 microversion: 2.1 time: 0.617313 Aug 24 10:47:31.366170 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2677/5700] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:30 2022] GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4 => generated 1372 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:31.977779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-334930f5-1f2a-4ae8-83c9-c8fcd1ab9bd6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:31.978550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-334930f5-1f2a-4ae8-83c9-c8fcd1ab9bd6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:31.987840 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-334930f5-1f2a-4ae8-83c9-c8fcd1ab9bd6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:31.988346 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-334930f5-1f2a-4ae8-83c9-c8fcd1ab9bd6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:31.989247 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-334930f5-1f2a-4ae8-83c9-c8fcd1ab9bd6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:31.990316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-334930f5-1f2a-4ae8-83c9-c8fcd1ab9bd6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:31.991543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-334930f5-1f2a-4ae8-83c9-c8fcd1ab9bd6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:31.992395 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-334930f5-1f2a-4ae8-83c9-c8fcd1ab9bd6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:32.198918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-334930f5-1f2a-4ae8-83c9-c8fcd1ab9bd6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:32.208393 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-334930f5-1f2a-4ae8-83c9-c8fcd1ab9bd6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1725 microversion: 2.1 time: 0.239999 Aug 24 10:47:32.209310 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3024/5701] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:31 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1725 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:32.374020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-edf683a6-236f-4b28-ac53-cdd77d703763 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:32.374663 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-edf683a6-236f-4b28-ac53-cdd77d703763 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 7ffe4fcd-67d0-493e-b966-0e49e13f97d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:32.388452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edf683a6-236f-4b28-ac53-cdd77d703763 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:32.389060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edf683a6-236f-4b28-ac53-cdd77d703763 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:32.389536 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edf683a6-236f-4b28-ac53-cdd77d703763 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:32.390267 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edf683a6-236f-4b28-ac53-cdd77d703763 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:32.390729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edf683a6-236f-4b28-ac53-cdd77d703763 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:32.391179 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edf683a6-236f-4b28-ac53-cdd77d703763 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:32.692558 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-edf683a6-236f-4b28-ac53-cdd77d703763 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:32.719392 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-edf683a6-236f-4b28-ac53-cdd77d703763 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4" status: 200 len: 1545 microversion: 2.1 time: 0.344242 Aug 24 10:47:32.720094 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2678/5702] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:32 2022] GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4 => generated 1545 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:32.745589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-526c7b92-0f22-42e9-81e0-b493b38f18d3 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:32.746365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-526c7b92-0f22-42e9-81e0-b493b38f18d3 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 7ffe4fcd-67d0-493e-b966-0e49e13f97d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:32.764546 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-526c7b92-0f22-42e9-81e0-b493b38f18d3 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:32.767096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-526c7b92-0f22-42e9-81e0-b493b38f18d3 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:32.767614 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-526c7b92-0f22-42e9-81e0-b493b38f18d3 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:32.769808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-526c7b92-0f22-42e9-81e0-b493b38f18d3 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:32.773444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-526c7b92-0f22-42e9-81e0-b493b38f18d3 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:32.774032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-526c7b92-0f22-42e9-81e0-b493b38f18d3 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:33.015867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-526c7b92-0f22-42e9-81e0-b493b38f18d3 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:33.026232 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-526c7b92-0f22-42e9-81e0-b493b38f18d3 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4" status: 200 len: 1545 microversion: 2.1 time: 0.287494 Aug 24 10:47:33.034545 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3025/5703] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:32 2022] GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4 => generated 1545 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:33.239165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2491357f-4a41-453b-99e5-3c0949b311ed tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:33.242113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2491357f-4a41-453b-99e5-3c0949b311ed tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:33.282008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2491357f-4a41-453b-99e5-3c0949b311ed tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:33.283916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2491357f-4a41-453b-99e5-3c0949b311ed tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:33.286055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2491357f-4a41-453b-99e5-3c0949b311ed tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:33.288713 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2491357f-4a41-453b-99e5-3c0949b311ed tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:33.293767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2491357f-4a41-453b-99e5-3c0949b311ed tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:33.297994 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2491357f-4a41-453b-99e5-3c0949b311ed tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:33.647741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2491357f-4a41-453b-99e5-3c0949b311ed tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:33.657473 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2491357f-4a41-453b-99e5-3c0949b311ed tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1725 microversion: 2.1 time: 0.424322 Aug 24 10:47:33.667492 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2679/5704] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:33 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1725 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:34.690156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4c57448d-3c89-4f86-bce0-556226ce3db4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:34.691465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4c57448d-3c89-4f86-bce0-556226ce3db4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:34.707264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c57448d-3c89-4f86-bce0-556226ce3db4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:34.712987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c57448d-3c89-4f86-bce0-556226ce3db4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:34.713654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c57448d-3c89-4f86-bce0-556226ce3db4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:34.714632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c57448d-3c89-4f86-bce0-556226ce3db4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:34.720514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c57448d-3c89-4f86-bce0-556226ce3db4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:34.720990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c57448d-3c89-4f86-bce0-556226ce3db4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:35.531850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4c57448d-3c89-4f86-bce0-556226ce3db4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:35.541183 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4c57448d-3c89-4f86-bce0-556226ce3db4 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1725 microversion: 2.1 time: 0.856887 Aug 24 10:47:35.546528 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3026/5705] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:34 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1725 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:36.572815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7e318c5b-9064-4a13-9af3-3b472c741d84 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:36.574131 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7e318c5b-9064-4a13-9af3-3b472c741d84 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:36.592867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e318c5b-9064-4a13-9af3-3b472c741d84 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:36.595124 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e318c5b-9064-4a13-9af3-3b472c741d84 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:36.595827 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e318c5b-9064-4a13-9af3-3b472c741d84 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:36.598290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e318c5b-9064-4a13-9af3-3b472c741d84 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:36.600403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e318c5b-9064-4a13-9af3-3b472c741d84 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:36.601141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e318c5b-9064-4a13-9af3-3b472c741d84 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:36.663283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2ffb0b86-292a-4643-974f-f980bf338ba8 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1535587622", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "ff8b4e8e-f889-4d64-bb0c-7962b9713f82"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:47:36.766605 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-2ffb0b86-292a-4643-974f-f980bf338ba8 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] validate_networks() for [('ff8b4e8e-f889-4d64-bb0c-7962b9713f82', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:47:36.911688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7e318c5b-9064-4a13-9af3-3b472c741d84 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:36.920766 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7e318c5b-9064-4a13-9af3-3b472c741d84 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1725 microversion: 2.1 time: 0.354350 Aug 24 10:47:36.922074 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3027/5706] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:36 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1725 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:37.942566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a1a835d6-bba7-4fad-99ba-88f6c55aad8a tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:37.943243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a1a835d6-bba7-4fad-99ba-88f6c55aad8a tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:37.956113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1a835d6-bba7-4fad-99ba-88f6c55aad8a tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:37.956631 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1a835d6-bba7-4fad-99ba-88f6c55aad8a tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:37.957089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1a835d6-bba7-4fad-99ba-88f6c55aad8a tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:37.957840 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1a835d6-bba7-4fad-99ba-88f6c55aad8a tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:37.962528 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1a835d6-bba7-4fad-99ba-88f6c55aad8a tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:37.963748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1a835d6-bba7-4fad-99ba-88f6c55aad8a tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:37.976454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:38.005378 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2ffb0b86-292a-4643-974f-f980bf338ba8 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:47:38.005792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2ffb0b86-292a-4643-974f-f980bf338ba8 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:47:38.006543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2ffb0b86-292a-4643-974f-f980bf338ba8 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:47:38.007341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2ffb0b86-292a-4643-974f-f980bf338ba8 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:47:38.008040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2ffb0b86-292a-4643-974f-f980bf338ba8 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:47:38.022245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ffb0b86-292a-4643-974f-f980bf338ba8 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:38.024964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ffb0b86-292a-4643-974f-f980bf338ba8 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:38.025472 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ffb0b86-292a-4643-974f-f980bf338ba8 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:38.026248 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ffb0b86-292a-4643-974f-f980bf338ba8 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:38.026710 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ffb0b86-292a-4643-974f-f980bf338ba8 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:38.027126 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ffb0b86-292a-4643-974f-f980bf338ba8 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:38.052138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:38.089186 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-2ffb0b86-292a-4643-974f-f980bf338ba8 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Getting quotas for project f1b0a78004cc45ed9f9cbd78c6360cd9. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:47:38.096025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-2ffb0b86-292a-4643-974f-f980bf338ba8 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Getting quotas for user 66fc1054d14a46e990f9325cc7224b1d and project f1b0a78004cc45ed9f9cbd78c6360cd9. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:47:38.117217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2ffb0b86-292a-4643-974f-f980bf338ba8 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:47:38.119925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2ffb0b86-292a-4643-974f-f980bf338ba8 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] [instance: 929f68b5-a014-4216-9e1f-6301433f4119] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:47:38.183630 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2ffb0b86-292a-4643-974f-f980bf338ba8 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.781953 Aug 24 10:47:38.191479 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2680/5707] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:47:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:47:38.196811 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-347253b2-5bac-46a8-a028-7c5d63762dc2 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:38.197810 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-347253b2-5bac-46a8-a028-7c5d63762dc2 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] [instance: 929f68b5-a014-4216-9e1f-6301433f4119] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:38.334981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-347253b2-5bac-46a8-a028-7c5d63762dc2 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fc1054d14a46e990f9325cc7224b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b0a78004cc45ed9f9cbd78c6360cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:38.349829 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-347253b2-5bac-46a8-a028-7c5d63762dc2 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] 10.222.0.85 "GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119" status: 200 len: 1214 microversion: 2.1 time: 0.157084 Aug 24 10:47:38.352874 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2681/5708] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:38 2022] GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119 => generated 1214 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:38.363273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a1a835d6-bba7-4fad-99ba-88f6c55aad8a tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:38.373581 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a1a835d6-bba7-4fad-99ba-88f6c55aad8a tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1725 microversion: 2.1 time: 0.434952 Aug 24 10:47:38.376562 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3028/5709] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:37 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1725 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:39.375058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-99edd292-44c2-45e5-9063-532f2d260c62 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:39.375939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-99edd292-44c2-45e5-9063-532f2d260c62 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] [instance: 929f68b5-a014-4216-9e1f-6301433f4119] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:39.386554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99edd292-44c2-45e5-9063-532f2d260c62 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:39.389412 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99edd292-44c2-45e5-9063-532f2d260c62 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:39.391941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99edd292-44c2-45e5-9063-532f2d260c62 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:39.393629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99edd292-44c2-45e5-9063-532f2d260c62 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:39.393629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99edd292-44c2-45e5-9063-532f2d260c62 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:39.399244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-021b77fe-4f88-4141-82ec-f95cbad4c9ed tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:39.399754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99edd292-44c2-45e5-9063-532f2d260c62 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:39.400690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-021b77fe-4f88-4141-82ec-f95cbad4c9ed tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:39.413231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-021b77fe-4f88-4141-82ec-f95cbad4c9ed tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:39.414684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-021b77fe-4f88-4141-82ec-f95cbad4c9ed tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:39.415423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-021b77fe-4f88-4141-82ec-f95cbad4c9ed tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:39.416592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-021b77fe-4f88-4141-82ec-f95cbad4c9ed tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:39.417376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-021b77fe-4f88-4141-82ec-f95cbad4c9ed tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:39.418057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-021b77fe-4f88-4141-82ec-f95cbad4c9ed tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:39.565892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-99edd292-44c2-45e5-9063-532f2d260c62 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fc1054d14a46e990f9325cc7224b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b0a78004cc45ed9f9cbd78c6360cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:39.575644 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-99edd292-44c2-45e5-9063-532f2d260c62 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] 10.222.0.85 "GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119" status: 200 len: 1266 microversion: 2.1 time: 0.204931 Aug 24 10:47:39.576451 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2682/5710] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:39 2022] GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:39.609944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-021b77fe-4f88-4141-82ec-f95cbad4c9ed tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:39.633853 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-021b77fe-4f88-4141-82ec-f95cbad4c9ed tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1725 microversion: 2.1 time: 0.238225 Aug 24 10:47:39.635690 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3029/5711] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:39 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1725 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:47:40.596956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-881b36e1-a186-4fbb-a930-a3425e96a1a1 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:40.598571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-881b36e1-a186-4fbb-a930-a3425e96a1a1 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] [instance: 929f68b5-a014-4216-9e1f-6301433f4119] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:40.614913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-881b36e1-a186-4fbb-a930-a3425e96a1a1 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:40.616681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-881b36e1-a186-4fbb-a930-a3425e96a1a1 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:40.619067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-881b36e1-a186-4fbb-a930-a3425e96a1a1 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:40.624308 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-881b36e1-a186-4fbb-a930-a3425e96a1a1 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:40.625867 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-881b36e1-a186-4fbb-a930-a3425e96a1a1 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:40.627921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-881b36e1-a186-4fbb-a930-a3425e96a1a1 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:40.657563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0b7c2c96-5277-4cf5-9421-8e35645f6ca6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:40.658895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0b7c2c96-5277-4cf5-9421-8e35645f6ca6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:40.676290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b7c2c96-5277-4cf5-9421-8e35645f6ca6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:40.676782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b7c2c96-5277-4cf5-9421-8e35645f6ca6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:40.678521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b7c2c96-5277-4cf5-9421-8e35645f6ca6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:40.680989 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b7c2c96-5277-4cf5-9421-8e35645f6ca6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:40.682913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b7c2c96-5277-4cf5-9421-8e35645f6ca6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:40.683773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b7c2c96-5277-4cf5-9421-8e35645f6ca6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:40.777662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-881b36e1-a186-4fbb-a930-a3425e96a1a1 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fc1054d14a46e990f9325cc7224b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b0a78004cc45ed9f9cbd78c6360cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:40.789596 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-881b36e1-a186-4fbb-a930-a3425e96a1a1 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] 10.222.0.85 "GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119" status: 200 len: 1272 microversion: 2.1 time: 0.196435 Aug 24 10:47:40.790227 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2683/5712] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:40 2022] GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119 => generated 1272 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:40.915779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0b7c2c96-5277-4cf5-9421-8e35645f6ca6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:40.930635 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0b7c2c96-5277-4cf5-9421-8e35645f6ca6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1725 microversion: 2.1 time: 0.274906 Aug 24 10:47:40.946835 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3030/5713] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:40 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1725 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:41.812503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad12fd11-5290-42b0-9257-0dbcdec97360 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:41.813048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ad12fd11-5290-42b0-9257-0dbcdec97360 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] [instance: 929f68b5-a014-4216-9e1f-6301433f4119] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:41.830096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad12fd11-5290-42b0-9257-0dbcdec97360 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:41.830764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad12fd11-5290-42b0-9257-0dbcdec97360 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:41.831514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad12fd11-5290-42b0-9257-0dbcdec97360 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:41.832391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad12fd11-5290-42b0-9257-0dbcdec97360 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:41.832965 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad12fd11-5290-42b0-9257-0dbcdec97360 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:41.836101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad12fd11-5290-42b0-9257-0dbcdec97360 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:41.958331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c2279a22-0964-4139-a6de-f972c42cfe7e tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:41.959229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c2279a22-0964-4139-a6de-f972c42cfe7e tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:41.986860 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2279a22-0964-4139-a6de-f972c42cfe7e tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:41.989024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2279a22-0964-4139-a6de-f972c42cfe7e tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:41.990781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2279a22-0964-4139-a6de-f972c42cfe7e tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:41.994417 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2279a22-0964-4139-a6de-f972c42cfe7e tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:41.996220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2279a22-0964-4139-a6de-f972c42cfe7e tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:41.998950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2279a22-0964-4139-a6de-f972c42cfe7e tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:42.137447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ad12fd11-5290-42b0-9257-0dbcdec97360 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fc1054d14a46e990f9325cc7224b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b0a78004cc45ed9f9cbd78c6360cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:42.150876 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ad12fd11-5290-42b0-9257-0dbcdec97360 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] 10.222.0.85 "GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119" status: 200 len: 1314 microversion: 2.1 time: 0.343822 Aug 24 10:47:42.152027 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2684/5714] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:41 2022] GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:42.304268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c2279a22-0964-4139-a6de-f972c42cfe7e tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:42.318183 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c2279a22-0964-4139-a6de-f972c42cfe7e tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1725 microversion: 2.1 time: 0.366014 Aug 24 10:47:42.338037 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3031/5715] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:41 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1725 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:42.610409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-5e5d9d3d-8402-4fd1-bca7-69e027e2eed0 req-2e7b071b-d41a-4289-8815-a9f50b0576ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "929f68b5-a014-4216-9e1f-6301433f4119", "tag": "a5bd1352-df2d-4433-a886-5fc41882674b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:47:42.623878 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5e5d9d3d-8402-4fd1-bca7-69e027e2eed0 req-2e7b071b-d41a-4289-8815-a9f50b0576ec service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:42.624427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5e5d9d3d-8402-4fd1-bca7-69e027e2eed0 req-2e7b071b-d41a-4289-8815-a9f50b0576ec service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:42.624869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5e5d9d3d-8402-4fd1-bca7-69e027e2eed0 req-2e7b071b-d41a-4289-8815-a9f50b0576ec service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:42.641717 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-5e5d9d3d-8402-4fd1-bca7-69e027e2eed0 req-2e7b071b-d41a-4289-8815-a9f50b0576ec service nova] Creating event network-changed:a5bd1352-df2d-4433-a886-5fc41882674b for instance 929f68b5-a014-4216-9e1f-6301433f4119 on n-h1-849328-3 Aug 24 10:47:42.647048 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-5e5d9d3d-8402-4fd1-bca7-69e027e2eed0 req-2e7b071b-d41a-4289-8815-a9f50b0576ec service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120488 Aug 24 10:47:42.647916 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2685/5716] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:47:43.173912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5b3cf047-1d1d-470b-9c9a-fc97dfb707f5 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:43.175299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5b3cf047-1d1d-470b-9c9a-fc97dfb707f5 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] [instance: 929f68b5-a014-4216-9e1f-6301433f4119] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:43.185773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b3cf047-1d1d-470b-9c9a-fc97dfb707f5 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:43.186786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b3cf047-1d1d-470b-9c9a-fc97dfb707f5 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:43.187421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b3cf047-1d1d-470b-9c9a-fc97dfb707f5 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:43.188494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b3cf047-1d1d-470b-9c9a-fc97dfb707f5 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:43.188984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b3cf047-1d1d-470b-9c9a-fc97dfb707f5 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:43.189452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b3cf047-1d1d-470b-9c9a-fc97dfb707f5 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:43.352458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-31a2df40-7d8d-4454-8eb1-4082df0fd2b0 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:43.353998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-31a2df40-7d8d-4454-8eb1-4082df0fd2b0 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:43.362060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31a2df40-7d8d-4454-8eb1-4082df0fd2b0 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:43.362767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31a2df40-7d8d-4454-8eb1-4082df0fd2b0 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:43.363557 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31a2df40-7d8d-4454-8eb1-4082df0fd2b0 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:43.364259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31a2df40-7d8d-4454-8eb1-4082df0fd2b0 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:43.364900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31a2df40-7d8d-4454-8eb1-4082df0fd2b0 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:43.365540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31a2df40-7d8d-4454-8eb1-4082df0fd2b0 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:43.600610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-31a2df40-7d8d-4454-8eb1-4082df0fd2b0 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:43.611760 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-31a2df40-7d8d-4454-8eb1-4082df0fd2b0 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1725 microversion: 2.1 time: 0.264723 Aug 24 10:47:43.612859 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2686/5717] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:43 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1725 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:47:43.711976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5b3cf047-1d1d-470b-9c9a-fc97dfb707f5 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fc1054d14a46e990f9325cc7224b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b0a78004cc45ed9f9cbd78c6360cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:43.721849 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5b3cf047-1d1d-470b-9c9a-fc97dfb707f5 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] 10.222.0.85 "GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119" status: 200 len: 1314 microversion: 2.1 time: 0.553660 Aug 24 10:47:43.725251 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3032/5718] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:43 2022] GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119 => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:44.634038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-71cfc59d-ae4c-4c3c-bd71-5611d1373ecf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:44.634806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-71cfc59d-ae4c-4c3c-bd71-5611d1373ecf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:44.648338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71cfc59d-ae4c-4c3c-bd71-5611d1373ecf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:44.649793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71cfc59d-ae4c-4c3c-bd71-5611d1373ecf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:44.651095 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71cfc59d-ae4c-4c3c-bd71-5611d1373ecf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:44.652660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71cfc59d-ae4c-4c3c-bd71-5611d1373ecf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:44.654830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71cfc59d-ae4c-4c3c-bd71-5611d1373ecf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:44.657761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71cfc59d-ae4c-4c3c-bd71-5611d1373ecf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:44.746476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ed9597c-8c89-4499-b241-b44267f8600c tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:44.747910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0ed9597c-8c89-4499-b241-b44267f8600c tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] [instance: 929f68b5-a014-4216-9e1f-6301433f4119] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:44.770061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ed9597c-8c89-4499-b241-b44267f8600c tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:44.772875 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ed9597c-8c89-4499-b241-b44267f8600c tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:44.775080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ed9597c-8c89-4499-b241-b44267f8600c tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:44.777395 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ed9597c-8c89-4499-b241-b44267f8600c tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:44.778766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ed9597c-8c89-4499-b241-b44267f8600c tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:44.779937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ed9597c-8c89-4499-b241-b44267f8600c tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:44.979137 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-71cfc59d-ae4c-4c3c-bd71-5611d1373ecf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:45.022497 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-71cfc59d-ae4c-4c3c-bd71-5611d1373ecf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1725 microversion: 2.1 time: 0.392685 Aug 24 10:47:45.024176 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2687/5719] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:44 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1725 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:45.132559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0ed9597c-8c89-4499-b241-b44267f8600c tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fc1054d14a46e990f9325cc7224b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b0a78004cc45ed9f9cbd78c6360cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:45.145786 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0ed9597c-8c89-4499-b241-b44267f8600c tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] 10.222.0.85 "GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119" status: 200 len: 1314 microversion: 2.1 time: 0.403986 Aug 24 10:47:45.145786 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3033/5720] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:44 2022] GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:46.046797 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d7e99700-d3cd-4a53-84ac-e0cdf3a5f57f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:46.047407 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d7e99700-d3cd-4a53-84ac-e0cdf3a5f57f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:46.057318 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7e99700-d3cd-4a53-84ac-e0cdf3a5f57f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:46.058726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7e99700-d3cd-4a53-84ac-e0cdf3a5f57f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:46.059205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7e99700-d3cd-4a53-84ac-e0cdf3a5f57f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:46.062375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7e99700-d3cd-4a53-84ac-e0cdf3a5f57f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:46.062852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7e99700-d3cd-4a53-84ac-e0cdf3a5f57f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:46.064571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7e99700-d3cd-4a53-84ac-e0cdf3a5f57f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:46.167430 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1da39f16-fb4a-4a41-a171-6e61b90091c2 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:46.167985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1da39f16-fb4a-4a41-a171-6e61b90091c2 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] [instance: 929f68b5-a014-4216-9e1f-6301433f4119] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:46.182917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1da39f16-fb4a-4a41-a171-6e61b90091c2 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:46.184522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1da39f16-fb4a-4a41-a171-6e61b90091c2 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:46.184996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1da39f16-fb4a-4a41-a171-6e61b90091c2 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:46.188538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1da39f16-fb4a-4a41-a171-6e61b90091c2 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:46.189066 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1da39f16-fb4a-4a41-a171-6e61b90091c2 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:46.189551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1da39f16-fb4a-4a41-a171-6e61b90091c2 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:46.326540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d7e99700-d3cd-4a53-84ac-e0cdf3a5f57f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:46.341459 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d7e99700-d3cd-4a53-84ac-e0cdf3a5f57f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1725 microversion: 2.1 time: 0.298820 Aug 24 10:47:46.342082 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2688/5721] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:46 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1725 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:46.454877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1da39f16-fb4a-4a41-a171-6e61b90091c2 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fc1054d14a46e990f9325cc7224b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b0a78004cc45ed9f9cbd78c6360cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:46.465624 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1da39f16-fb4a-4a41-a171-6e61b90091c2 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] 10.222.0.85 "GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119" status: 200 len: 1314 microversion: 2.1 time: 0.304970 Aug 24 10:47:46.472137 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3034/5722] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:46 2022] GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:47.376681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-54afbf14-1b8e-4e0d-884a-5207a895b610 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:47.377356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-54afbf14-1b8e-4e0d-884a-5207a895b610 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:47.385388 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54afbf14-1b8e-4e0d-884a-5207a895b610 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:47.386243 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54afbf14-1b8e-4e0d-884a-5207a895b610 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:47.386915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54afbf14-1b8e-4e0d-884a-5207a895b610 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:47.388026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54afbf14-1b8e-4e0d-884a-5207a895b610 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:47.388725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54afbf14-1b8e-4e0d-884a-5207a895b610 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:47.389674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54afbf14-1b8e-4e0d-884a-5207a895b610 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:47.503253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-607d2d94-cb01-418a-aac3-f70d035c365c tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:47.504798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-607d2d94-cb01-418a-aac3-f70d035c365c tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] [instance: 929f68b5-a014-4216-9e1f-6301433f4119] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:47.512491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-607d2d94-cb01-418a-aac3-f70d035c365c tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:47.513316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-607d2d94-cb01-418a-aac3-f70d035c365c tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:47.513938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-607d2d94-cb01-418a-aac3-f70d035c365c tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:47.515510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-607d2d94-cb01-418a-aac3-f70d035c365c tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:47.516403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-607d2d94-cb01-418a-aac3-f70d035c365c tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:47.517202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-607d2d94-cb01-418a-aac3-f70d035c365c tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:47.599923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-54afbf14-1b8e-4e0d-884a-5207a895b610 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:47.620771 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-54afbf14-1b8e-4e0d-884a-5207a895b610 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1702 microversion: 2.1 time: 0.249049 Aug 24 10:47:47.622945 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2689/5723] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:47 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1702 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:47.645427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-38add09e-8239-4a49-afcb-b62932c105e3 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:47:47.663316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38add09e-8239-4a49-afcb-b62932c105e3 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:47.663991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38add09e-8239-4a49-afcb-b62932c105e3 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:47.664507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38add09e-8239-4a49-afcb-b62932c105e3 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:47.701225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-38add09e-8239-4a49-afcb-b62932c105e3 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Going to try to start instance {{(pid=122432) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 10:47:47.760010 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-38add09e-8239-4a49-afcb-b62932c105e3 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "POST /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02/action" status: 202 len: 0 microversion: 2.1 time: 0.120773 Aug 24 10:47:47.760457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-607d2d94-cb01-418a-aac3-f70d035c365c tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fc1054d14a46e990f9325cc7224b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b0a78004cc45ed9f9cbd78c6360cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:47.761742 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2690/5724] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:47:47 2022] POST /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:47:47.774777 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-25166351-efdc-4b08-a074-69655525fa09 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:47.775733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-25166351-efdc-4b08-a074-69655525fa09 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:47.787379 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25166351-efdc-4b08-a074-69655525fa09 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:47.789169 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25166351-efdc-4b08-a074-69655525fa09 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:47.789833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25166351-efdc-4b08-a074-69655525fa09 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:47.791285 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25166351-efdc-4b08-a074-69655525fa09 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:47.791937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25166351-efdc-4b08-a074-69655525fa09 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:47.792522 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-607d2d94-cb01-418a-aac3-f70d035c365c tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] 10.222.0.85 "GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119" status: 200 len: 1314 microversion: 2.1 time: 0.291834 Aug 24 10:47:47.793863 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25166351-efdc-4b08-a074-69655525fa09 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:47.794541 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3035/5725] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:47 2022] GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:48.039371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-25166351-efdc-4b08-a074-69655525fa09 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:48.049590 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-25166351-efdc-4b08-a074-69655525fa09 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1711 microversion: 2.1 time: 0.281645 Aug 24 10:47:48.050057 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2691/5726] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:47 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1711 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:48.814726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fceedf28-092c-4c68-938c-53391f5120fb tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:48.816023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fceedf28-092c-4c68-938c-53391f5120fb tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] [instance: 929f68b5-a014-4216-9e1f-6301433f4119] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:48.823791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fceedf28-092c-4c68-938c-53391f5120fb tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:48.824588 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fceedf28-092c-4c68-938c-53391f5120fb tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:48.825228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fceedf28-092c-4c68-938c-53391f5120fb tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:48.826112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fceedf28-092c-4c68-938c-53391f5120fb tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:48.826725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fceedf28-092c-4c68-938c-53391f5120fb tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:48.827309 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fceedf28-092c-4c68-938c-53391f5120fb tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:48.883559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-63ccf325-623e-4885-8ad7-a432dbbcc09c req-88ff98b5-3e45-4a82-8ae0-55bd26114006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "929f68b5-a014-4216-9e1f-6301433f4119", "name": "network-vif-plugged", "status": "completed", "tag": "a5bd1352-df2d-4433-a886-5fc41882674b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:47:48.892175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:48.895114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:48.906375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-63ccf325-623e-4885-8ad7-a432dbbcc09c req-88ff98b5-3e45-4a82-8ae0-55bd26114006 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:48.907180 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-63ccf325-623e-4885-8ad7-a432dbbcc09c req-88ff98b5-3e45-4a82-8ae0-55bd26114006 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:48.907788 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-63ccf325-623e-4885-8ad7-a432dbbcc09c req-88ff98b5-3e45-4a82-8ae0-55bd26114006 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:48.929112 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-63ccf325-623e-4885-8ad7-a432dbbcc09c req-88ff98b5-3e45-4a82-8ae0-55bd26114006 service nova] Creating event network-vif-plugged:a5bd1352-df2d-4433-a886-5fc41882674b for instance 929f68b5-a014-4216-9e1f-6301433f4119 on n-h1-849328-3 Aug 24 10:47:48.936345 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-63ccf325-623e-4885-8ad7-a432dbbcc09c req-88ff98b5-3e45-4a82-8ae0-55bd26114006 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056558 Aug 24 10:47:48.937503 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2692/5727] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:47:49.033030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fceedf28-092c-4c68-938c-53391f5120fb tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fc1054d14a46e990f9325cc7224b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b0a78004cc45ed9f9cbd78c6360cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:49.047733 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fceedf28-092c-4c68-938c-53391f5120fb tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] 10.222.0.85 "GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119" status: 200 len: 1314 microversion: 2.1 time: 0.237002 Aug 24 10:47:49.049161 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3036/5728] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:48 2022] GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:49.114496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5ee60f97-b06f-44b9-8137-d1394b658473 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:49.116954 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5ee60f97-b06f-44b9-8137-d1394b658473 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:49.133567 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ee60f97-b06f-44b9-8137-d1394b658473 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:49.134642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ee60f97-b06f-44b9-8137-d1394b658473 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:49.136032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ee60f97-b06f-44b9-8137-d1394b658473 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:49.139676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ee60f97-b06f-44b9-8137-d1394b658473 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:49.140285 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ee60f97-b06f-44b9-8137-d1394b658473 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:49.140733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ee60f97-b06f-44b9-8137-d1394b658473 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:49.491657 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5ee60f97-b06f-44b9-8137-d1394b658473 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:49.502227 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5ee60f97-b06f-44b9-8137-d1394b658473 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1711 microversion: 2.1 time: 0.434234 Aug 24 10:47:49.508054 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2693/5729] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:49 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1711 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:50.070865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7390bda5-2a81-43db-9d16-872e6f9a2ffd tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:50.071469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7390bda5-2a81-43db-9d16-872e6f9a2ffd tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] [instance: 929f68b5-a014-4216-9e1f-6301433f4119] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:50.079322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7390bda5-2a81-43db-9d16-872e6f9a2ffd tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:50.079819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7390bda5-2a81-43db-9d16-872e6f9a2ffd tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:50.080260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7390bda5-2a81-43db-9d16-872e6f9a2ffd tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:50.080978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7390bda5-2a81-43db-9d16-872e6f9a2ffd tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:50.081463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7390bda5-2a81-43db-9d16-872e6f9a2ffd tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:50.081895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7390bda5-2a81-43db-9d16-872e6f9a2ffd tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:50.255411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7390bda5-2a81-43db-9d16-872e6f9a2ffd tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fc1054d14a46e990f9325cc7224b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b0a78004cc45ed9f9cbd78c6360cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:50.271387 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7390bda5-2a81-43db-9d16-872e6f9a2ffd tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] 10.222.0.85 "GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119" status: 200 len: 1314 microversion: 2.1 time: 0.204417 Aug 24 10:47:50.281162 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3037/5730] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:50 2022] GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:50.526248 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-54958a4b-6e35-4f4c-86e7-ef4a43446c13 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:50.530088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-54958a4b-6e35-4f4c-86e7-ef4a43446c13 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:50.548226 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54958a4b-6e35-4f4c-86e7-ef4a43446c13 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:50.549066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54958a4b-6e35-4f4c-86e7-ef4a43446c13 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:50.550684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54958a4b-6e35-4f4c-86e7-ef4a43446c13 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:50.551870 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54958a4b-6e35-4f4c-86e7-ef4a43446c13 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:50.552526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54958a4b-6e35-4f4c-86e7-ef4a43446c13 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:50.553604 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54958a4b-6e35-4f4c-86e7-ef4a43446c13 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:50.792174 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-54958a4b-6e35-4f4c-86e7-ef4a43446c13 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:50.801433 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-54958a4b-6e35-4f4c-86e7-ef4a43446c13 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1715 microversion: 2.1 time: 0.281008 Aug 24 10:47:50.805660 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2694/5731] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:50 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1715 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:51.295156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6880142e-b534-4789-8622-37bb94fc4d26 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:51.295795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6880142e-b534-4789-8622-37bb94fc4d26 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] [instance: 929f68b5-a014-4216-9e1f-6301433f4119] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:51.305789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6880142e-b534-4789-8622-37bb94fc4d26 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:51.306723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6880142e-b534-4789-8622-37bb94fc4d26 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:51.307985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6880142e-b534-4789-8622-37bb94fc4d26 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:51.322367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6880142e-b534-4789-8622-37bb94fc4d26 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:51.323113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6880142e-b534-4789-8622-37bb94fc4d26 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:51.323923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6880142e-b534-4789-8622-37bb94fc4d26 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:51.595966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6880142e-b534-4789-8622-37bb94fc4d26 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fc1054d14a46e990f9325cc7224b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b0a78004cc45ed9f9cbd78c6360cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:51.605209 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6880142e-b534-4789-8622-37bb94fc4d26 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] 10.222.0.85 "GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119" status: 200 len: 1499 microversion: 2.1 time: 0.315226 Aug 24 10:47:51.618287 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3038/5732] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:51 2022] GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119 => generated 1499 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:54.435073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d278be9-4c31-43a8-b311-0728dd438729 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:54.436922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9d278be9-4c31-43a8-b311-0728dd438729 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] [instance: 929f68b5-a014-4216-9e1f-6301433f4119] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:54.444893 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:54.453040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d278be9-4c31-43a8-b311-0728dd438729 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:54.453988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d278be9-4c31-43a8-b311-0728dd438729 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:54.454718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d278be9-4c31-43a8-b311-0728dd438729 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:54.456085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d278be9-4c31-43a8-b311-0728dd438729 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:54.456652 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d278be9-4c31-43a8-b311-0728dd438729 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:54.457469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d278be9-4c31-43a8-b311-0728dd438729 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:54.507356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9d278be9-4c31-43a8-b311-0728dd438729 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] [instance: 929f68b5-a014-4216-9e1f-6301433f4119] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:47:54.669214 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9d278be9-4c31-43a8-b311-0728dd438729 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] 10.222.0.85 "DELETE /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119" status: 204 len: 0 microversion: 2.1 time: 0.242115 Aug 24 10:47:54.670373 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2695/5733] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:47:54 2022] DELETE /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:47:54.680071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4a252046-84ed-4fa1-a954-34610a0c29d9 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:54.681453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4a252046-84ed-4fa1-a954-34610a0c29d9 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] [instance: 929f68b5-a014-4216-9e1f-6301433f4119] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:54.689219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a252046-84ed-4fa1-a954-34610a0c29d9 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:54.689837 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a252046-84ed-4fa1-a954-34610a0c29d9 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:54.690368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a252046-84ed-4fa1-a954-34610a0c29d9 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:54.691228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a252046-84ed-4fa1-a954-34610a0c29d9 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:54.691813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a252046-84ed-4fa1-a954-34610a0c29d9 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:54.692333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a252046-84ed-4fa1-a954-34610a0c29d9 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:54.883871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4a252046-84ed-4fa1-a954-34610a0c29d9 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fc1054d14a46e990f9325cc7224b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b0a78004cc45ed9f9cbd78c6360cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:54.892481 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4a252046-84ed-4fa1-a954-34610a0c29d9 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] 10.222.0.85 "GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119" status: 200 len: 1505 microversion: 2.1 time: 0.217506 Aug 24 10:47:54.893651 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3039/5734] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:54 2022] GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119 => generated 1505 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:55.036935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9702a766-cf38-4ae7-a78c-9baedd5255de tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:55.037903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9702a766-cf38-4ae7-a78c-9baedd5255de tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:55.047485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9702a766-cf38-4ae7-a78c-9baedd5255de tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:55.047969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9702a766-cf38-4ae7-a78c-9baedd5255de tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:55.048392 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9702a766-cf38-4ae7-a78c-9baedd5255de tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:55.052105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9702a766-cf38-4ae7-a78c-9baedd5255de tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:55.052881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9702a766-cf38-4ae7-a78c-9baedd5255de tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:55.053373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9702a766-cf38-4ae7-a78c-9baedd5255de tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:55.097666 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9702a766-cf38-4ae7-a78c-9baedd5255de tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd/ips" status: 200 len: 149 microversion: 2.1 time: 0.068072 Aug 24 10:47:55.099371 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2696/5735] 10.222.0.85 () {58 vars in 1248 bytes} [Wed Aug 24 10:47:55 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd/ips => generated 149 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:47:55.916239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-64865b5d-8604-4de4-9004-dfcb71690d9e tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:55.917640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-64865b5d-8604-4de4-9004-dfcb71690d9e tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] [instance: 929f68b5-a014-4216-9e1f-6301433f4119] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:55.937488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64865b5d-8604-4de4-9004-dfcb71690d9e tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:55.938340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64865b5d-8604-4de4-9004-dfcb71690d9e tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:55.939040 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64865b5d-8604-4de4-9004-dfcb71690d9e tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:55.939971 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64865b5d-8604-4de4-9004-dfcb71690d9e tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:55.940645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64865b5d-8604-4de4-9004-dfcb71690d9e tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:55.941329 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64865b5d-8604-4de4-9004-dfcb71690d9e tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:56.095448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-64865b5d-8604-4de4-9004-dfcb71690d9e tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fc1054d14a46e990f9325cc7224b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b0a78004cc45ed9f9cbd78c6360cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:56.104479 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-64865b5d-8604-4de4-9004-dfcb71690d9e tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] 10.222.0.85 "GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119" status: 200 len: 1505 microversion: 2.1 time: 0.193446 Aug 24 10:47:56.105956 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3040/5736] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:55 2022] GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119 => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:56.958222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-7b595310-41d4-4e55-9451-2f1a73bb1f45 req-f7ea8b5e-2dd8-47e6-916c-6a780d1eaf3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "929f68b5-a014-4216-9e1f-6301433f4119", "name": "network-vif-deleted", "tag": "a5bd1352-df2d-4433-a886-5fc41882674b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:47:56.977057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7b595310-41d4-4e55-9451-2f1a73bb1f45 req-f7ea8b5e-2dd8-47e6-916c-6a780d1eaf3a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:56.978302 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7b595310-41d4-4e55-9451-2f1a73bb1f45 req-f7ea8b5e-2dd8-47e6-916c-6a780d1eaf3a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:56.979026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7b595310-41d4-4e55-9451-2f1a73bb1f45 req-f7ea8b5e-2dd8-47e6-916c-6a780d1eaf3a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:56.995723 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7b595310-41d4-4e55-9451-2f1a73bb1f45 req-f7ea8b5e-2dd8-47e6-916c-6a780d1eaf3a service nova] Creating event network-vif-deleted:a5bd1352-df2d-4433-a886-5fc41882674b for instance 929f68b5-a014-4216-9e1f-6301433f4119 on n-h1-849328-3 Aug 24 10:47:57.002372 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-7b595310-41d4-4e55-9451-2f1a73bb1f45 req-f7ea8b5e-2dd8-47e6-916c-6a780d1eaf3a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048177 Aug 24 10:47:57.003264 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2697/5737] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:47:57.126141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9d29ee44-0fff-4b57-bb53-3096ab6deb8e tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:57.126760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9d29ee44-0fff-4b57-bb53-3096ab6deb8e tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] [instance: 929f68b5-a014-4216-9e1f-6301433f4119] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:57.129829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=44 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:57.136893 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d29ee44-0fff-4b57-bb53-3096ab6deb8e tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:57.137822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d29ee44-0fff-4b57-bb53-3096ab6deb8e tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:57.138272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d29ee44-0fff-4b57-bb53-3096ab6deb8e tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:57.138996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d29ee44-0fff-4b57-bb53-3096ab6deb8e tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:57.139456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d29ee44-0fff-4b57-bb53-3096ab6deb8e tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:57.139886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d29ee44-0fff-4b57-bb53-3096ab6deb8e tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:57.177756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d29ee44-0fff-4b57-bb53-3096ab6deb8e tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:57.178509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d29ee44-0fff-4b57-bb53-3096ab6deb8e tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:57.179076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d29ee44-0fff-4b57-bb53-3096ab6deb8e tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:57.179544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-9d29ee44-0fff-4b57-bb53-3096ab6deb8e tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lazy-loading 'fault' on Instance uuid 929f68b5-a014-4216-9e1f-6301433f4119 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:47:57.224760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9d29ee44-0fff-4b57-bb53-3096ab6deb8e tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fc1054d14a46e990f9325cc7224b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b0a78004cc45ed9f9cbd78c6360cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:47:57.233417 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9d29ee44-0fff-4b57-bb53-3096ab6deb8e tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] 10.222.0.85 "GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119" status: 200 len: 1304 microversion: 2.1 time: 0.111442 Aug 24 10:47:57.234250 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3041/5738] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:57 2022] GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119 => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:47:57.706669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0d6c84bf-fcd6-4226-8648-db32f0c6cbc1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5b24bd4-5911-4581-9fbd-1864c96977fe"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:47:57.709235 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0d6c84bf-fcd6-4226-8648-db32f0c6cbc1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:57.715995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d6c84bf-fcd6-4226-8648-db32f0c6cbc1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:57.716477 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d6c84bf-fcd6-4226-8648-db32f0c6cbc1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:57.716907 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d6c84bf-fcd6-4226-8648-db32f0c6cbc1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:57.717733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d6c84bf-fcd6-4226-8648-db32f0c6cbc1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:57.718184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d6c84bf-fcd6-4226-8648-db32f0c6cbc1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:57.718599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d6c84bf-fcd6-4226-8648-db32f0c6cbc1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:57.722702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:58.051315 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0d6c84bf-fcd6-4226-8648-db32f0c6cbc1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "POST /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.348879 Aug 24 10:47:58.051880 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2698/5739] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Aug 24 10:47:57 2022] POST /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd/os-volume_attachments => generated 194 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:47:58.256965 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6d41269c-290e-4eaa-bfee-dfc5cae94177 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:47:58.258466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6d41269c-290e-4eaa-bfee-dfc5cae94177 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] [instance: 929f68b5-a014-4216-9e1f-6301433f4119] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:47:58.272672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d41269c-290e-4eaa-bfee-dfc5cae94177 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:58.275277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d41269c-290e-4eaa-bfee-dfc5cae94177 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:58.275277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d41269c-290e-4eaa-bfee-dfc5cae94177 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:58.277152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d41269c-290e-4eaa-bfee-dfc5cae94177 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:47:58.278145 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d41269c-290e-4eaa-bfee-dfc5cae94177 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:47:58.278145 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d41269c-290e-4eaa-bfee-dfc5cae94177 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:47:58.310795 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-6d41269c-290e-4eaa-bfee-dfc5cae94177 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] HTTP exception thrown: Instance 929f68b5-a014-4216-9e1f-6301433f4119 could not be found. Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6d41269c-290e-4eaa-bfee-dfc5cae94177 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Request method failure captured: Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119 HTTP/1.1 Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgHEmU0MdwAVQ85ac24qWvuTGQeVMpukSxcJ_pJ048sZMdlFAVk3ZOB00j8G7g1dzvj48xli9_ICO1iuTOci7-DaVoRD4gpKkbwLZCg8y0iOajDx7lo2POIOTfN80xCOsMLuc84XKgFxmcDuJZd3LiXt5ve7gNfKCJJwJ-gXgy0HTrE Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: f1b0a78004cc45ed9f9cbd78c6360cd9 Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-VolumesActionsTest-1292105655 Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f1b0a78004cc45ed9f9cbd78c6360cd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f1b0a78004cc45ed9f9cbd78c6360cd9", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f1b0a78004cc45ed9f9cbd78c6360cd9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f1b0a78004cc45ed9f9cbd78c6360cd9"}]}] Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-VolumesActionsTest-1292105655 Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: f1b0a78004cc45ed9f9cbd78c6360cd9 Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-VolumesActionsTest-1292105655 Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-VolumesActionsTest-1292105655-project Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 66fc1054d14a46e990f9325cc7224b1d Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-VolumesActionsTest-1292105655-project Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 929f68b5-a014-4216-9e1f-6301433f4119 could not be found. Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '929f68b5-a014-4216-9e1f-6301433f4119'} Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 929f68b5-a014-4216-9e1f-6301433f4119 could not be found. Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 929f68b5-a014-4216-9e1f-6301433f4119 could not be found. Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:47:58.315944 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:47:58.320655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:47:58.320655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:47:58.320655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:47:58.320655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:47:58.320655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:47:58.320655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 929f68b5-a014-4216-9e1f-6301433f4119 could not be found. Aug 24 10:47:58.320655 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:47:58.320655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6d41269c-290e-4eaa-bfee-dfc5cae94177 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] Returning 404 to user: Instance 929f68b5-a014-4216-9e1f-6301433f4119 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:47:58.324829 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6d41269c-290e-4eaa-bfee-dfc5cae94177 tempest-VolumesActionsTest-1292105655 tempest-VolumesActionsTest-1292105655-project] 10.222.0.85 "GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119" status: 404 len: 111 microversion: 2.1 time: 0.071031 Aug 24 10:47:58.326731 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3042/5740] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:47:58 2022] GET /compute/v2.1/servers/929f68b5-a014-4216-9e1f-6301433f4119 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:48:02.965491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f9861706-f001-4d21-94ba-6123fe94d9b7 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:02.966446 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f9861706-f001-4d21-94ba-6123fe94d9b7 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 7ffe4fcd-67d0-493e-b966-0e49e13f97d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:02.979664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9861706-f001-4d21-94ba-6123fe94d9b7 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:02.985049 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9861706-f001-4d21-94ba-6123fe94d9b7 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:02.985658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9861706-f001-4d21-94ba-6123fe94d9b7 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:02.987503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9861706-f001-4d21-94ba-6123fe94d9b7 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:02.991870 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9861706-f001-4d21-94ba-6123fe94d9b7 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:02.992454 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9861706-f001-4d21-94ba-6123fe94d9b7 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:03.049531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f9861706-f001-4d21-94ba-6123fe94d9b7 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 7ffe4fcd-67d0-493e-b966-0e49e13f97d4] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:48:03.225958 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f9861706-f001-4d21-94ba-6123fe94d9b7 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "DELETE /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4" status: 204 len: 0 microversion: 2.1 time: 0.265459 Aug 24 10:48:03.226636 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2699/5741] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:48:02 2022] DELETE /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:48:03.235778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bb9bdd1c-ae22-4629-bdde-b3089f0f506d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:03.237101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bb9bdd1c-ae22-4629-bdde-b3089f0f506d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 7ffe4fcd-67d0-493e-b966-0e49e13f97d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:03.256438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb9bdd1c-ae22-4629-bdde-b3089f0f506d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:03.256869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb9bdd1c-ae22-4629-bdde-b3089f0f506d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:03.257526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb9bdd1c-ae22-4629-bdde-b3089f0f506d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:03.258721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb9bdd1c-ae22-4629-bdde-b3089f0f506d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:03.259380 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb9bdd1c-ae22-4629-bdde-b3089f0f506d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:03.260963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb9bdd1c-ae22-4629-bdde-b3089f0f506d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:03.988984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bb9bdd1c-ae22-4629-bdde-b3089f0f506d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:04.004608 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bb9bdd1c-ae22-4629-bdde-b3089f0f506d tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4" status: 200 len: 1551 microversion: 2.1 time: 0.773128 Aug 24 10:48:04.005209 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3043/5742] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:03 2022] GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4 => generated 1551 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:48:05.040308 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7c795ba4-07e0-4da7-b150-0463c42da074 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:05.041216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7c795ba4-07e0-4da7-b150-0463c42da074 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 7ffe4fcd-67d0-493e-b966-0e49e13f97d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:05.093516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c795ba4-07e0-4da7-b150-0463c42da074 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:05.097646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c795ba4-07e0-4da7-b150-0463c42da074 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:05.100571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c795ba4-07e0-4da7-b150-0463c42da074 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:05.104922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c795ba4-07e0-4da7-b150-0463c42da074 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:05.107723 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c795ba4-07e0-4da7-b150-0463c42da074 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:05.108198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c795ba4-07e0-4da7-b150-0463c42da074 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:06.947394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7c795ba4-07e0-4da7-b150-0463c42da074 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:06.980069 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7c795ba4-07e0-4da7-b150-0463c42da074 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4" status: 200 len: 1551 microversion: 2.1 time: 1.931034 Aug 24 10:48:06.985210 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2700/5743] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:05 2022] GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4 => generated 1551 bytes in 1955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:48:08.013723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-82e73efc-f941-4582-bb8c-e01513f3d3e7 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:08.017314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-82e73efc-f941-4582-bb8c-e01513f3d3e7 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 7ffe4fcd-67d0-493e-b966-0e49e13f97d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:08.045840 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82e73efc-f941-4582-bb8c-e01513f3d3e7 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:08.046339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82e73efc-f941-4582-bb8c-e01513f3d3e7 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:08.049457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82e73efc-f941-4582-bb8c-e01513f3d3e7 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:08.050248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82e73efc-f941-4582-bb8c-e01513f3d3e7 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:08.050741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82e73efc-f941-4582-bb8c-e01513f3d3e7 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:08.058408 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82e73efc-f941-4582-bb8c-e01513f3d3e7 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:08.156434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=94 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:08.668751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-82e73efc-f941-4582-bb8c-e01513f3d3e7 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:08.685657 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-82e73efc-f941-4582-bb8c-e01513f3d3e7 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4" status: 200 len: 1551 microversion: 2.1 time: 0.677296 Aug 24 10:48:08.697169 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3044/5744] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:08 2022] GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4 => generated 1551 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:48:09.379099 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9807c2ba-a784-42cc-8e4f-153aff601f87 req-11ed1b07-a9cc-4215-9c44-8b8547c4e91e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ffe4fcd-67d0-493e-b966-0e49e13f97d4", "name": "network-vif-deleted", "tag": "9c795d87-515e-4dea-af0f-dab6c1d2e978"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:48:09.404946 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9807c2ba-a784-42cc-8e4f-153aff601f87 req-11ed1b07-a9cc-4215-9c44-8b8547c4e91e service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:09.423906 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9807c2ba-a784-42cc-8e4f-153aff601f87 req-11ed1b07-a9cc-4215-9c44-8b8547c4e91e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:09.429772 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9807c2ba-a784-42cc-8e4f-153aff601f87 req-11ed1b07-a9cc-4215-9c44-8b8547c4e91e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:09.482855 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9807c2ba-a784-42cc-8e4f-153aff601f87 req-11ed1b07-a9cc-4215-9c44-8b8547c4e91e service nova] Creating event network-vif-deleted:9c795d87-515e-4dea-af0f-dab6c1d2e978 for instance 7ffe4fcd-67d0-493e-b966-0e49e13f97d4 on n-h2-849328-3 Aug 24 10:48:09.529285 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9807c2ba-a784-42cc-8e4f-153aff601f87 req-11ed1b07-a9cc-4215-9c44-8b8547c4e91e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153950 Aug 24 10:48:09.531143 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2701/5745] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:48:09.721468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c0da8940-efa7-43d1-b491-176e328f8c8e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:09.723902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c0da8940-efa7-43d1-b491-176e328f8c8e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 7ffe4fcd-67d0-493e-b966-0e49e13f97d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:09.788025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0da8940-efa7-43d1-b491-176e328f8c8e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:09.794163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0da8940-efa7-43d1-b491-176e328f8c8e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:09.799762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0da8940-efa7-43d1-b491-176e328f8c8e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:09.800598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0da8940-efa7-43d1-b491-176e328f8c8e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:09.802460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0da8940-efa7-43d1-b491-176e328f8c8e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:09.803197 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0da8940-efa7-43d1-b491-176e328f8c8e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:10.058850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0da8940-efa7-43d1-b491-176e328f8c8e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:10.059891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0da8940-efa7-43d1-b491-176e328f8c8e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:10.061259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0da8940-efa7-43d1-b491-176e328f8c8e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:10.063944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-c0da8940-efa7-43d1-b491-176e328f8c8e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lazy-loading 'fault' on Instance uuid 7ffe4fcd-67d0-493e-b966-0e49e13f97d4 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:48:10.145562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c0da8940-efa7-43d1-b491-176e328f8c8e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:10.183815 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c0da8940-efa7-43d1-b491-176e328f8c8e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4" status: 200 len: 1337 microversion: 2.1 time: 0.467315 Aug 24 10:48:10.186375 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3045/5746] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:09 2022] GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4 => generated 1337 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:48:11.246226 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4bb3740f-af94-47cc-9f94-08674dcb7feb tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:11.247037 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4bb3740f-af94-47cc-9f94-08674dcb7feb tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 7ffe4fcd-67d0-493e-b966-0e49e13f97d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:11.271142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4bb3740f-af94-47cc-9f94-08674dcb7feb tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:11.271981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4bb3740f-af94-47cc-9f94-08674dcb7feb tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:11.274557 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4bb3740f-af94-47cc-9f94-08674dcb7feb tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:11.276236 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4bb3740f-af94-47cc-9f94-08674dcb7feb tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:11.278434 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4bb3740f-af94-47cc-9f94-08674dcb7feb tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:11.279153 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4bb3740f-af94-47cc-9f94-08674dcb7feb tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:11.326693 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-4bb3740f-af94-47cc-9f94-08674dcb7feb tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] HTTP exception thrown: Instance 7ffe4fcd-67d0-493e-b966-0e49e13f97d4 could not be found. Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4bb3740f-af94-47cc-9f94-08674dcb7feb tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Request method failure captured: Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4 HTTP/1.1 Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgFXe7oWLnPEt6gBXDapFcnUDKp283XImKzkE8PX7IGLpZqa-k5v8fIbIo1U_2uCyNlNH-sGwR4GCaE6RoeSAcmlMTOIqQiXPhRi4UE5Os4kjbYzOKfwo9kuEIatN5H7fr_S_KVkepeevW8Drsq4OZtLNiebEAVd_K2cAbI2fBzaLQ0 Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 65e4aa20cf3d44a2b11f47c0c18cfb4d Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-TestNetworkBasicOps-889484220 Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/65e4aa20cf3d44a2b11f47c0c18cfb4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_65e4aa20cf3d44a2b11f47c0c18cfb4d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/65e4aa20cf3d44a2b11f47c0c18cfb4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/65e4aa20cf3d44a2b11f47c0c18cfb4d"}]}] Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-TestNetworkBasicOps-889484220 Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 65e4aa20cf3d44a2b11f47c0c18cfb4d Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestNetworkBasicOps-889484220 Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-TestNetworkBasicOps-889484220-project Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: afd244b0014c4240bca18becdd30a5a0 Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-TestNetworkBasicOps-889484220-project Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 7ffe4fcd-67d0-493e-b966-0e49e13f97d4 could not be found. Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '7ffe4fcd-67d0-493e-b966-0e49e13f97d4'} Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ffe4fcd-67d0-493e-b966-0e49e13f97d4 could not be found. Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ffe4fcd-67d0-493e-b966-0e49e13f97d4 could not be found. Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:48:11.335074 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:11.341578 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:11.341578 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:48:11.341578 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:48:11.341578 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:48:11.341578 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:48:11.341578 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ffe4fcd-67d0-493e-b966-0e49e13f97d4 could not be found. Aug 24 10:48:11.341578 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:11.341578 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4bb3740f-af94-47cc-9f94-08674dcb7feb tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Returning 404 to user: Instance 7ffe4fcd-67d0-493e-b966-0e49e13f97d4 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:48:11.341578 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4bb3740f-af94-47cc-9f94-08674dcb7feb tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4" status: 404 len: 111 microversion: 2.1 time: 0.100016 Aug 24 10:48:11.341578 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2702/5747] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:11 2022] GET /compute/v2.1/servers/7ffe4fcd-67d0-493e-b966-0e49e13f97d4 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:48:11.753271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-53b63359-cfb3-4fab-b0e5-f806c8cb9bc4 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '.version_select at 0x7f4655036310>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:11.823650 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-53b63359-cfb3-4fab-b0e5-f806c8cb9bc4 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-258179170" status: 202 len: 0 microversion: 2.1 time: 0.072687 Aug 24 10:48:11.830127 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3046/5748] 10.222.0.85 () {58 vars in 1254 bytes} [Wed Aug 24 10:48:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-258179170 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:48:15.041157 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d8e7ada2-5a6c-4c07-8625-74b2dd31882a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:15.041747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d8e7ada2-5a6c-4c07-8625-74b2dd31882a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:15.067794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8e7ada2-5a6c-4c07-8625-74b2dd31882a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:15.068287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8e7ada2-5a6c-4c07-8625-74b2dd31882a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:15.068720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8e7ada2-5a6c-4c07-8625-74b2dd31882a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:15.069453 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8e7ada2-5a6c-4c07-8625-74b2dd31882a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:15.069904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8e7ada2-5a6c-4c07-8625-74b2dd31882a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:15.070322 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8e7ada2-5a6c-4c07-8625-74b2dd31882a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:15.220396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-d8e7ada2-5a6c-4c07-8625-74b2dd31882a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lazy-loading 'services' on Instance uuid fd547127-9c38-4b82-b256-057f141843cd {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:48:15.381531 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d8e7ada2-5a6c-4c07-8625-74b2dd31882a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "DELETE /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd/os-volume_attachments/e5b24bd4-5911-4581-9fbd-1864c96977fe" status: 202 len: 0 microversion: 2.1 time: 0.341071 Aug 24 10:48:15.382243 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2703/5749] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Aug 24 10:48:15 2022] DELETE /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd/os-volume_attachments/e5b24bd4-5911-4581-9fbd-1864c96977fe => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 10:48:15.409194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-796dd62e-112b-4f29-b714-c7f5fc1473c1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:15.424387 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-796dd62e-112b-4f29-b714-c7f5fc1473c1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:15.484314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-796dd62e-112b-4f29-b714-c7f5fc1473c1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:15.485536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-796dd62e-112b-4f29-b714-c7f5fc1473c1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:15.488795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-796dd62e-112b-4f29-b714-c7f5fc1473c1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:15.491567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-796dd62e-112b-4f29-b714-c7f5fc1473c1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:15.492184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-796dd62e-112b-4f29-b714-c7f5fc1473c1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:15.495294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-796dd62e-112b-4f29-b714-c7f5fc1473c1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:15.601958 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-796dd62e-112b-4f29-b714-c7f5fc1473c1 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.212626 Aug 24 10:48:15.602995 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3047/5750] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:48:15 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd/os-volume_attachments => generated 197 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:48:16.109255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5a5b8133-c075-4da2-abda-8dc4930f3656 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:16.109917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5a5b8133-c075-4da2-abda-8dc4930f3656 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:16.118440 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-2ba40dc8-c43e-465a-9344-c9507790f5a0 req-16219148-0b97-4a74-9df8-3e8c9674101b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a", "tag": "4dc64609-6aa6-499b-b626-48b0729bc4ed"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:48:16.128368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a5b8133-c075-4da2-abda-8dc4930f3656 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:16.131324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2ba40dc8-c43e-465a-9344-c9507790f5a0 req-16219148-0b97-4a74-9df8-3e8c9674101b service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:16.132535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2ba40dc8-c43e-465a-9344-c9507790f5a0 req-16219148-0b97-4a74-9df8-3e8c9674101b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:16.133261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a5b8133-c075-4da2-abda-8dc4930f3656 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:16.133651 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a5b8133-c075-4da2-abda-8dc4930f3656 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:16.134029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2ba40dc8-c43e-465a-9344-c9507790f5a0 req-16219148-0b97-4a74-9df8-3e8c9674101b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:16.134494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a5b8133-c075-4da2-abda-8dc4930f3656 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:16.139547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a5b8133-c075-4da2-abda-8dc4930f3656 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:16.140312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a5b8133-c075-4da2-abda-8dc4930f3656 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:16.153551 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-2ba40dc8-c43e-465a-9344-c9507790f5a0 req-16219148-0b97-4a74-9df8-3e8c9674101b service nova] Creating event network-changed:4dc64609-6aa6-499b-b626-48b0729bc4ed for instance a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a on n-h2-849328-3 Aug 24 10:48:16.160016 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-2ba40dc8-c43e-465a-9344-c9507790f5a0 req-16219148-0b97-4a74-9df8-3e8c9674101b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046091 Aug 24 10:48:16.161166 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3048/5751] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:48:16.205662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5a5b8133-c075-4da2-abda-8dc4930f3656 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:48:16.414919 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5a5b8133-c075-4da2-abda-8dc4930f3656 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a" status: 204 len: 0 microversion: 2.1 time: 0.309673 Aug 24 10:48:16.420945 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2704/5752] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:48:16 2022] DELETE /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:48:16.427677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-89da5033-13ed-4634-b0d3-048f98c5d5be tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:16.429151 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-89da5033-13ed-4634-b0d3-048f98c5d5be tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:16.443848 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89da5033-13ed-4634-b0d3-048f98c5d5be tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:16.446393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89da5033-13ed-4634-b0d3-048f98c5d5be tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:16.446916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89da5033-13ed-4634-b0d3-048f98c5d5be tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:16.447692 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89da5033-13ed-4634-b0d3-048f98c5d5be tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:16.448171 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89da5033-13ed-4634-b0d3-048f98c5d5be tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:16.448593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89da5033-13ed-4634-b0d3-048f98c5d5be tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:16.615814 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-948ce191-90f8-4719-9df6-de37d12ead7c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:16.618329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-948ce191-90f8-4719-9df6-de37d12ead7c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:16.630711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-948ce191-90f8-4719-9df6-de37d12ead7c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:16.631236 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-948ce191-90f8-4719-9df6-de37d12ead7c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:16.631671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-948ce191-90f8-4719-9df6-de37d12ead7c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:16.632394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-948ce191-90f8-4719-9df6-de37d12ead7c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:16.632845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-948ce191-90f8-4719-9df6-de37d12ead7c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:16.633297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-948ce191-90f8-4719-9df6-de37d12ead7c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:16.712863 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-948ce191-90f8-4719-9df6-de37d12ead7c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101424 Aug 24 10:48:16.722759 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2705/5753] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:48:16 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:48:16.749676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-89da5033-13ed-4634-b0d3-048f98c5d5be tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:16.763105 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-89da5033-13ed-4634-b0d3-048f98c5d5be tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a" status: 200 len: 1671 microversion: 2.1 time: 0.338178 Aug 24 10:48:16.764186 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3049/5754] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:16 2022] GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a => generated 1671 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:48:17.741971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a4359ab2-20b7-476b-b931-2c24d67e69bd tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:17.745409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a4359ab2-20b7-476b-b931-2c24d67e69bd tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:17.755205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4359ab2-20b7-476b-b931-2c24d67e69bd tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:17.761896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4359ab2-20b7-476b-b931-2c24d67e69bd tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:17.762663 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4359ab2-20b7-476b-b931-2c24d67e69bd tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:17.763610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4359ab2-20b7-476b-b931-2c24d67e69bd tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:17.765690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4359ab2-20b7-476b-b931-2c24d67e69bd tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:17.767508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4359ab2-20b7-476b-b931-2c24d67e69bd tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:17.798628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a0892518-9571-4419-9937-fb31da479018 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:17.799298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a0892518-9571-4419-9937-fb31da479018 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:17.837071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0892518-9571-4419-9937-fb31da479018 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:17.846332 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0892518-9571-4419-9937-fb31da479018 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:17.851936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0892518-9571-4419-9937-fb31da479018 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:17.856010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0892518-9571-4419-9937-fb31da479018 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:17.856800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0892518-9571-4419-9937-fb31da479018 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:17.857527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0892518-9571-4419-9937-fb31da479018 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:17.871015 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a4359ab2-20b7-476b-b931-2c24d67e69bd tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138512 Aug 24 10:48:17.876654 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2706/5755] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:48:17 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:48:18.222126 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a0892518-9571-4419-9937-fb31da479018 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:18.238136 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a0892518-9571-4419-9937-fb31da479018 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a" status: 200 len: 1671 microversion: 2.1 time: 0.453294 Aug 24 10:48:18.239060 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3050/5756] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:17 2022] GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a => generated 1671 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:48:18.883870 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-66ec879b-b128-4d36-8ff2-f2d6724dbb4a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:18.892734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8fe5aea3-5171-49d0-b866-e03f32900276 req-a7baa018-5f72-4f23-a591-1edc28ee0dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a", "name": "network-vif-deleted", "tag": "4dc64609-6aa6-499b-b626-48b0729bc4ed"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:48:18.894718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-66ec879b-b128-4d36-8ff2-f2d6724dbb4a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:18.917422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8fe5aea3-5171-49d0-b866-e03f32900276 req-a7baa018-5f72-4f23-a591-1edc28ee0dd3 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:18.918423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8fe5aea3-5171-49d0-b866-e03f32900276 req-a7baa018-5f72-4f23-a591-1edc28ee0dd3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:18.919101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8fe5aea3-5171-49d0-b866-e03f32900276 req-a7baa018-5f72-4f23-a591-1edc28ee0dd3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:18.923367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66ec879b-b128-4d36-8ff2-f2d6724dbb4a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:18.924373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66ec879b-b128-4d36-8ff2-f2d6724dbb4a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:18.925007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66ec879b-b128-4d36-8ff2-f2d6724dbb4a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:18.926224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66ec879b-b128-4d36-8ff2-f2d6724dbb4a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:18.927529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66ec879b-b128-4d36-8ff2-f2d6724dbb4a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:18.928853 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66ec879b-b128-4d36-8ff2-f2d6724dbb4a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:18.947507 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8fe5aea3-5171-49d0-b866-e03f32900276 req-a7baa018-5f72-4f23-a591-1edc28ee0dd3 service nova] Creating event network-vif-deleted:4dc64609-6aa6-499b-b626-48b0729bc4ed for instance a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a on n-h2-849328-3 Aug 24 10:48:18.960338 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8fe5aea3-5171-49d0-b866-e03f32900276 req-a7baa018-5f72-4f23-a591-1edc28ee0dd3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073654 Aug 24 10:48:18.963224 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3051/5757] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:48:19.031543 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-66ec879b-b128-4d36-8ff2-f2d6724dbb4a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151853 Aug 24 10:48:19.038956 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2707/5758] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:48:18 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:48:19.261970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-785a0377-d82f-497e-bb83-4b6f4b4a4136 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:19.263013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-785a0377-d82f-497e-bb83-4b6f4b4a4136 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:19.276578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-785a0377-d82f-497e-bb83-4b6f4b4a4136 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:19.280832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-785a0377-d82f-497e-bb83-4b6f4b4a4136 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:19.281614 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-785a0377-d82f-497e-bb83-4b6f4b4a4136 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:19.282725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-785a0377-d82f-497e-bb83-4b6f4b4a4136 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:19.283388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-785a0377-d82f-497e-bb83-4b6f4b4a4136 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:19.284114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-785a0377-d82f-497e-bb83-4b6f4b4a4136 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:19.338808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-785a0377-d82f-497e-bb83-4b6f4b4a4136 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:19.339571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-785a0377-d82f-497e-bb83-4b6f4b4a4136 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:19.340187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-785a0377-d82f-497e-bb83-4b6f4b4a4136 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:19.340916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-785a0377-d82f-497e-bb83-4b6f4b4a4136 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lazy-loading 'fault' on Instance uuid a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:48:19.431360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-785a0377-d82f-497e-bb83-4b6f4b4a4136 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:19.444157 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-785a0377-d82f-497e-bb83-4b6f4b4a4136 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a" status: 200 len: 1339 microversion: 2.1 time: 0.187147 Aug 24 10:48:19.445398 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3052/5759] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:19 2022] GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a => generated 1339 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:48:20.045843 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3b5b02b6-25d3-413d-9431-9a2a72142018 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:20.049230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3b5b02b6-25d3-413d-9431-9a2a72142018 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:20.057535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b5b02b6-25d3-413d-9431-9a2a72142018 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:20.063225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b5b02b6-25d3-413d-9431-9a2a72142018 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:20.063675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b5b02b6-25d3-413d-9431-9a2a72142018 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:20.064401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b5b02b6-25d3-413d-9431-9a2a72142018 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:20.064906 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b5b02b6-25d3-413d-9431-9a2a72142018 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:20.065362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b5b02b6-25d3-413d-9431-9a2a72142018 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:20.135578 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3b5b02b6-25d3-413d-9431-9a2a72142018 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095365 Aug 24 10:48:20.140041 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2708/5760] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:48:20 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:48:20.471987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e48adf7d-7651-4e47-bd90-67fba8ae641b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:20.472610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e48adf7d-7651-4e47-bd90-67fba8ae641b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:20.479636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e48adf7d-7651-4e47-bd90-67fba8ae641b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:20.480429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e48adf7d-7651-4e47-bd90-67fba8ae641b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:20.481044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e48adf7d-7651-4e47-bd90-67fba8ae641b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:20.481967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e48adf7d-7651-4e47-bd90-67fba8ae641b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:20.482584 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e48adf7d-7651-4e47-bd90-67fba8ae641b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:20.483183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e48adf7d-7651-4e47-bd90-67fba8ae641b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:20.511124 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-e48adf7d-7651-4e47-bd90-67fba8ae641b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] HTTP exception thrown: Instance a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a could not be found. Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e48adf7d-7651-4e47-bd90-67fba8ae641b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Request method failure captured: Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a HTTP/1.1 Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgFXe7oWLnPEt6gBXDapFcnUDKp283XImKzkE8PX7IGLpZqa-k5v8fIbIo1U_2uCyNlNH-sGwR4GCaE6RoeSAcmlMTOIqQiXPhRi4UE5Os4kjbYzOKfwo9kuEIatN5H7fr_S_KVkepeevW8Drsq4OZtLNiebEAVd_K2cAbI2fBzaLQ0 Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 65e4aa20cf3d44a2b11f47c0c18cfb4d Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestNetworkBasicOps-889484220 Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/65e4aa20cf3d44a2b11f47c0c18cfb4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_65e4aa20cf3d44a2b11f47c0c18cfb4d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/65e4aa20cf3d44a2b11f47c0c18cfb4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/65e4aa20cf3d44a2b11f47c0c18cfb4d"}]}] Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestNetworkBasicOps-889484220 Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 65e4aa20cf3d44a2b11f47c0c18cfb4d Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestNetworkBasicOps-889484220 Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestNetworkBasicOps-889484220-project Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: afd244b0014c4240bca18becdd30a5a0 Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestNetworkBasicOps-889484220-project Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a could not be found. Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a'} Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a could not be found. Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a could not be found. Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:48:20.527295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:48:20.532924 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:20.532924 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:48:20.532924 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:48:20.532924 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:48:20.532924 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:48:20.532924 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a could not be found. Aug 24 10:48:20.532924 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:48:20.534830 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e48adf7d-7651-4e47-bd90-67fba8ae641b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Returning 404 to user: Instance a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:48:20.535889 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e48adf7d-7651-4e47-bd90-67fba8ae641b tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a" status: 404 len: 111 microversion: 2.1 time: 0.067847 Aug 24 10:48:20.536954 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3053/5761] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:20 2022] GET /compute/v2.1/servers/a5dceb8a-1d33-4c43-8d60-0d7c0ff03a2a => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:48:20.761205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-40c9cacd-2717-44c8-80d6-515ac6293f40 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '.version_select at 0x7f465428e8b0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:20.842049 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-40c9cacd-2717-44c8-80d6-515ac6293f40 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1815105512" status: 202 len: 0 microversion: 2.1 time: 0.085227 Aug 24 10:48:20.843980 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2709/5762] 10.222.0.85 () {58 vars in 1257 bytes} [Wed Aug 24 10:48:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1815105512 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:48:21.151884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-185c8264-9ac4-42fa-ae38-2ee935884d5d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:21.156780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-185c8264-9ac4-42fa-ae38-2ee935884d5d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:21.179296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-185c8264-9ac4-42fa-ae38-2ee935884d5d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:21.184235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-185c8264-9ac4-42fa-ae38-2ee935884d5d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:21.184925 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-185c8264-9ac4-42fa-ae38-2ee935884d5d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:21.186081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-185c8264-9ac4-42fa-ae38-2ee935884d5d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:21.189748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-185c8264-9ac4-42fa-ae38-2ee935884d5d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:21.190385 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-185c8264-9ac4-42fa-ae38-2ee935884d5d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:21.270862 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-185c8264-9ac4-42fa-ae38-2ee935884d5d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124778 Aug 24 10:48:21.274443 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3054/5763] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:48:21 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:48:22.298034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7bb1fb2b-a233-40d9-a1b3-1a4e1188901d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:22.304100 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7bb1fb2b-a233-40d9-a1b3-1a4e1188901d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:22.331679 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7bb1fb2b-a233-40d9-a1b3-1a4e1188901d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:22.331679 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7bb1fb2b-a233-40d9-a1b3-1a4e1188901d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:22.331679 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7bb1fb2b-a233-40d9-a1b3-1a4e1188901d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:22.337901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7bb1fb2b-a233-40d9-a1b3-1a4e1188901d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:22.340925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7bb1fb2b-a233-40d9-a1b3-1a4e1188901d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:22.345766 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7bb1fb2b-a233-40d9-a1b3-1a4e1188901d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:22.413818 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7bb1fb2b-a233-40d9-a1b3-1a4e1188901d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134538 Aug 24 10:48:22.418037 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2710/5764] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:48:22 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:48:23.430652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-82c44333-2f49-4726-898f-39b83924e721 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:23.433761 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-82c44333-2f49-4726-898f-39b83924e721 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:23.448739 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82c44333-2f49-4726-898f-39b83924e721 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:23.449566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82c44333-2f49-4726-898f-39b83924e721 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:23.452622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82c44333-2f49-4726-898f-39b83924e721 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:23.454058 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82c44333-2f49-4726-898f-39b83924e721 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:23.457889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82c44333-2f49-4726-898f-39b83924e721 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:23.460861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82c44333-2f49-4726-898f-39b83924e721 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:23.534937 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-82c44333-2f49-4726-898f-39b83924e721 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.107308 Aug 24 10:48:23.540922 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3055/5765] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:48:23 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:48:23.754794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eec6f8fb-d8b6-4e48-9585-beb2c0048045 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:23.755304 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eec6f8fb-d8b6-4e48-9585-beb2c0048045 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:23.768467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eec6f8fb-d8b6-4e48-9585-beb2c0048045 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:23.768974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eec6f8fb-d8b6-4e48-9585-beb2c0048045 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:23.769439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eec6f8fb-d8b6-4e48-9585-beb2c0048045 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:23.775110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eec6f8fb-d8b6-4e48-9585-beb2c0048045 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:23.775683 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eec6f8fb-d8b6-4e48-9585-beb2c0048045 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:23.776058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eec6f8fb-d8b6-4e48-9585-beb2c0048045 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:23.839796 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eec6f8fb-d8b6-4e48-9585-beb2c0048045 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:48:23.865738 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:23.957724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a9f9fa20-cb83-4c92-9e75-7a1b70a401dd tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:23.958518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a9f9fa20-cb83-4c92-9e75-7a1b70a401dd tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:23.966919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9f9fa20-cb83-4c92-9e75-7a1b70a401dd tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:23.971749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9f9fa20-cb83-4c92-9e75-7a1b70a401dd tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:23.972594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9f9fa20-cb83-4c92-9e75-7a1b70a401dd tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:23.976384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9f9fa20-cb83-4c92-9e75-7a1b70a401dd tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:23.977298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9f9fa20-cb83-4c92-9e75-7a1b70a401dd tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:23.977935 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9f9fa20-cb83-4c92-9e75-7a1b70a401dd tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:24.038804 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eec6f8fb-d8b6-4e48-9585-beb2c0048045 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "DELETE /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd" status: 204 len: 0 microversion: 2.1 time: 0.291600 Aug 24 10:48:24.039801 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2711/5766] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:48:23 2022] DELETE /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:48:24.050410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7c648056-02f5-44f7-b1e8-618d48194e28 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:24.051432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7c648056-02f5-44f7-b1e8-618d48194e28 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:24.059105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c648056-02f5-44f7-b1e8-618d48194e28 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:24.059881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c648056-02f5-44f7-b1e8-618d48194e28 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:24.061224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c648056-02f5-44f7-b1e8-618d48194e28 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:24.062157 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c648056-02f5-44f7-b1e8-618d48194e28 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:24.062781 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c648056-02f5-44f7-b1e8-618d48194e28 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:24.063445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c648056-02f5-44f7-b1e8-618d48194e28 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:24.251308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-a9f9fa20-cb83-4c92-9e75-7a1b70a401dd tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lazy-loading 'services' on Instance uuid 46ecd5ee-6e65-441c-b75e-941757d51a02 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:48:24.404057 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a9f9fa20-cb83-4c92-9e75-7a1b70a401dd tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "DELETE /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02/os-volume_attachments/b3fd6e25-e932-4c9b-95f7-a4ce0433783e" status: 202 len: 0 microversion: 2.1 time: 0.450742 Aug 24 10:48:24.404992 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3056/5767] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Aug 24 10:48:23 2022] DELETE /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02/os-volume_attachments/b3fd6e25-e932-4c9b-95f7-a4ce0433783e => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:48:24.745337 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7c648056-02f5-44f7-b1e8-618d48194e28 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:24.770390 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7c648056-02f5-44f7-b1e8-618d48194e28 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd" status: 200 len: 1679 microversion: 2.1 time: 0.725831 Aug 24 10:48:24.780546 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2712/5768] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:24 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd => generated 1679 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:48:25.796687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-edbadc36-402f-4c56-80e8-a05a0673a812 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:25.798335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-edbadc36-402f-4c56-80e8-a05a0673a812 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:25.818859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edbadc36-402f-4c56-80e8-a05a0673a812 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:25.819405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edbadc36-402f-4c56-80e8-a05a0673a812 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:25.822736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edbadc36-402f-4c56-80e8-a05a0673a812 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:25.824995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edbadc36-402f-4c56-80e8-a05a0673a812 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:25.827853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edbadc36-402f-4c56-80e8-a05a0673a812 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:25.831464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edbadc36-402f-4c56-80e8-a05a0673a812 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:26.532439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-edbadc36-402f-4c56-80e8-a05a0673a812 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:26.548781 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-edbadc36-402f-4c56-80e8-a05a0673a812 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd" status: 200 len: 1679 microversion: 2.1 time: 0.757969 Aug 24 10:48:26.550177 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3057/5769] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:25 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd => generated 1679 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:48:27.571679 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8a122e61-ad21-4eb5-8327-38494326835c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:27.572873 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8a122e61-ad21-4eb5-8327-38494326835c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:27.579002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:27.588838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a122e61-ad21-4eb5-8327-38494326835c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:27.592858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a122e61-ad21-4eb5-8327-38494326835c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:27.593400 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a122e61-ad21-4eb5-8327-38494326835c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:27.594143 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a122e61-ad21-4eb5-8327-38494326835c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:27.594601 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a122e61-ad21-4eb5-8327-38494326835c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:27.595029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a122e61-ad21-4eb5-8327-38494326835c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:28.048427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8a122e61-ad21-4eb5-8327-38494326835c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:28.067949 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8a122e61-ad21-4eb5-8327-38494326835c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd" status: 200 len: 1679 microversion: 2.1 time: 0.492860 Aug 24 10:48:28.081202 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2713/5770] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:27 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd => generated 1679 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:48:29.116073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-16b6a3dc-1e4f-4607-8807-c14cba7d83ef tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:29.117155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-16b6a3dc-1e4f-4607-8807-c14cba7d83ef tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:29.117818 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-10493f0a-14fc-4347-8920-94ac181313e6 req-20e4ba17-fc04-46e4-b943-1f9bda3f6b0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd547127-9c38-4b82-b256-057f141843cd", "name": "network-vif-deleted", "tag": "fc2c19f7-5877-46d0-8a47-e82e600c9a5b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:48:29.124191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:29.144097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16b6a3dc-1e4f-4607-8807-c14cba7d83ef tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:29.147372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16b6a3dc-1e4f-4607-8807-c14cba7d83ef tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:29.148158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16b6a3dc-1e4f-4607-8807-c14cba7d83ef tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:29.151490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16b6a3dc-1e4f-4607-8807-c14cba7d83ef tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:29.153524 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16b6a3dc-1e4f-4607-8807-c14cba7d83ef tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:29.154067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-10493f0a-14fc-4347-8920-94ac181313e6 req-20e4ba17-fc04-46e4-b943-1f9bda3f6b0f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:29.154275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16b6a3dc-1e4f-4607-8807-c14cba7d83ef tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:29.154539 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-10493f0a-14fc-4347-8920-94ac181313e6 req-20e4ba17-fc04-46e4-b943-1f9bda3f6b0f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:29.154976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-10493f0a-14fc-4347-8920-94ac181313e6 req-20e4ba17-fc04-46e4-b943-1f9bda3f6b0f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:29.187846 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-10493f0a-14fc-4347-8920-94ac181313e6 req-20e4ba17-fc04-46e4-b943-1f9bda3f6b0f service nova] Creating event network-vif-deleted:fc2c19f7-5877-46d0-8a47-e82e600c9a5b for instance fd547127-9c38-4b82-b256-057f141843cd on n-h1-849328-3 Aug 24 10:48:29.209606 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-10493f0a-14fc-4347-8920-94ac181313e6 req-20e4ba17-fc04-46e4-b943-1f9bda3f6b0f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102395 Aug 24 10:48:29.214028 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2714/5771] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:48:29.436203 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-16b6a3dc-1e4f-4607-8807-c14cba7d83ef tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5172c17fae44e5839bd9b789e4c3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfd67239d3f4b7a89be1453a08c92ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:29.455248 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-16b6a3dc-1e4f-4607-8807-c14cba7d83ef tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd" status: 200 len: 1325 microversion: 2.1 time: 0.353902 Aug 24 10:48:29.472882 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3058/5772] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:29 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd => generated 1325 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:48:30.513626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c60cada2-7a74-4d58-bcdc-9ed36f65d9b0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:30.514887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c60cada2-7a74-4d58-bcdc-9ed36f65d9b0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:30.528717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c60cada2-7a74-4d58-bcdc-9ed36f65d9b0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:30.540175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c60cada2-7a74-4d58-bcdc-9ed36f65d9b0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:30.542695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c60cada2-7a74-4d58-bcdc-9ed36f65d9b0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:30.543643 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c60cada2-7a74-4d58-bcdc-9ed36f65d9b0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:30.550187 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c60cada2-7a74-4d58-bcdc-9ed36f65d9b0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:30.550930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c60cada2-7a74-4d58-bcdc-9ed36f65d9b0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:30.597159 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-c60cada2-7a74-4d58-bcdc-9ed36f65d9b0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] HTTP exception thrown: Instance fd547127-9c38-4b82-b256-057f141843cd could not be found. Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c60cada2-7a74-4d58-bcdc-9ed36f65d9b0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Request method failure captured: Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd HTTP/1.1 Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgBznQHNaOQSFLxoSWoCQ9hM_j0rDTvTqgGEXtOY5AvsNS3wnSnsKPq1brvowzVLm_09c1waLsJrFpihbXQ2I-pXEEbKWLH4qZhxSJfMM_hStgT1NZ8xcwJWs2OWbQyk15VS3tMTjbBVTyv_jiH5rZPFN41C1BDVpAXdNxiZaDgd17U Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 3cfd67239d3f4b7a89be1453a08c92ba Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3cfd67239d3f4b7a89be1453a08c92ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3cfd67239d3f4b7a89be1453a08c92ba", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3cfd67239d3f4b7a89be1453a08c92ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3cfd67239d3f4b7a89be1453a08c92ba"}]}] Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 3cfd67239d3f4b7a89be1453a08c92ba Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-AttachVolumeNegativeTest-632701884-project Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: ff5172c17fae44e5839bd9b789e4c3a8 Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-AttachVolumeNegativeTest-632701884-project Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance fd547127-9c38-4b82-b256-057f141843cd could not be found. Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'fd547127-9c38-4b82-b256-057f141843cd'} Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd547127-9c38-4b82-b256-057f141843cd could not be found. Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd547127-9c38-4b82-b256-057f141843cd could not be found. Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:48:30.601962 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:30.607761 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:30.607761 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:48:30.607761 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:48:30.607761 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:48:30.607761 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:48:30.607761 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd547127-9c38-4b82-b256-057f141843cd could not be found. Aug 24 10:48:30.607761 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:30.607761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c60cada2-7a74-4d58-bcdc-9ed36f65d9b0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Returning 404 to user: Instance fd547127-9c38-4b82-b256-057f141843cd could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:48:30.614145 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c60cada2-7a74-4d58-bcdc-9ed36f65d9b0 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd" status: 404 len: 111 microversion: 2.1 time: 0.118488 Aug 24 10:48:30.614792 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2715/5773] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:30 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:48:30.633625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-33f4a8f9-167c-4e2c-ac8c-377cd3e9e170 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '.version_select at 0x7f46551858b0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:30.703719 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-33f4a8f9-167c-4e2c-ac8c-377cd3e9e170 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-365372290" status: 202 len: 0 microversion: 2.1 time: 0.079367 Aug 24 10:48:30.713919 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3059/5774] 10.222.0.85 () {58 vars in 1218 bytes} [Wed Aug 24 10:48:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-365372290 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:48:35.232552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8c9b5e9f-2cf6-4d8f-b1fd-60611ae2050a tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:48:35.242240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c9b5e9f-2cf6-4d8f-b1fd-60611ae2050a tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:35.242739 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c9b5e9f-2cf6-4d8f-b1fd-60611ae2050a tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:35.243196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c9b5e9f-2cf6-4d8f-b1fd-60611ae2050a tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:35.313955 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8c9b5e9f-2cf6-4d8f-b1fd-60611ae2050a tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Going to try to stop instance {{(pid=122432) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 10:48:35.449608 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8c9b5e9f-2cf6-4d8f-b1fd-60611ae2050a tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "POST /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02/action" status: 202 len: 0 microversion: 2.1 time: 0.220285 Aug 24 10:48:35.453678 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2716/5775] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:48:35 2022] POST /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:48:35.462683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-11492dda-8b0e-4731-be9d-d1e78bedf7e8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:35.463346 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-11492dda-8b0e-4731-be9d-d1e78bedf7e8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:35.487194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11492dda-8b0e-4731-be9d-d1e78bedf7e8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:35.487697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11492dda-8b0e-4731-be9d-d1e78bedf7e8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:35.488136 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11492dda-8b0e-4731-be9d-d1e78bedf7e8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:35.488862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11492dda-8b0e-4731-be9d-d1e78bedf7e8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:35.496630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11492dda-8b0e-4731-be9d-d1e78bedf7e8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:35.497272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11492dda-8b0e-4731-be9d-d1e78bedf7e8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:35.928137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-11492dda-8b0e-4731-be9d-d1e78bedf7e8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:35.939647 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-11492dda-8b0e-4731-be9d-d1e78bedf7e8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1679 microversion: 2.1 time: 0.482792 Aug 24 10:48:35.943302 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3060/5776] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:35 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1679 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:48:36.964590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f85fcf00-7fd9-4f18-ac18-fdc526fedf4b tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:36.965477 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f85fcf00-7fd9-4f18-ac18-fdc526fedf4b tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:37.008130 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f85fcf00-7fd9-4f18-ac18-fdc526fedf4b tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:37.013764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f85fcf00-7fd9-4f18-ac18-fdc526fedf4b tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:37.017073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f85fcf00-7fd9-4f18-ac18-fdc526fedf4b tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:37.017981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f85fcf00-7fd9-4f18-ac18-fdc526fedf4b tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:37.018559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f85fcf00-7fd9-4f18-ac18-fdc526fedf4b tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:37.020998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f85fcf00-7fd9-4f18-ac18-fdc526fedf4b tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:38.276275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f85fcf00-7fd9-4f18-ac18-fdc526fedf4b tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:38.321417 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f85fcf00-7fd9-4f18-ac18-fdc526fedf4b tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1679 microversion: 2.1 time: 1.361812 Aug 24 10:48:38.324145 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2717/5777] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:36 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1679 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:48:39.355323 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-65b92706-edc5-4c71-a292-5e4f5822db3d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:39.355869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-65b92706-edc5-4c71-a292-5e4f5822db3d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:39.378420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65b92706-edc5-4c71-a292-5e4f5822db3d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:39.379543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65b92706-edc5-4c71-a292-5e4f5822db3d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:39.380014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65b92706-edc5-4c71-a292-5e4f5822db3d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:39.384852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65b92706-edc5-4c71-a292-5e4f5822db3d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:39.385417 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65b92706-edc5-4c71-a292-5e4f5822db3d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:39.388385 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65b92706-edc5-4c71-a292-5e4f5822db3d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:39.471349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:39.992214 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-65b92706-edc5-4c71-a292-5e4f5822db3d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:40.007649 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-65b92706-edc5-4c71-a292-5e4f5822db3d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1679 microversion: 2.1 time: 0.655432 Aug 24 10:48:40.018564 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3061/5778] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:39 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1679 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:48:41.032001 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2ca046d3-e110-45a3-a218-d8e0e091227d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:41.032624 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2ca046d3-e110-45a3-a218-d8e0e091227d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:41.045771 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ca046d3-e110-45a3-a218-d8e0e091227d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:41.046317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ca046d3-e110-45a3-a218-d8e0e091227d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:41.046758 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ca046d3-e110-45a3-a218-d8e0e091227d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:41.047487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ca046d3-e110-45a3-a218-d8e0e091227d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:41.047941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ca046d3-e110-45a3-a218-d8e0e091227d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:41.058005 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ca046d3-e110-45a3-a218-d8e0e091227d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:41.074855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb16f268-1efc-4970-9762-567657a97c09 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:41.075360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cb16f268-1efc-4970-9762-567657a97c09 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:41.093480 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb16f268-1efc-4970-9762-567657a97c09 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:41.094001 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb16f268-1efc-4970-9762-567657a97c09 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:41.094456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb16f268-1efc-4970-9762-567657a97c09 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:41.105729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb16f268-1efc-4970-9762-567657a97c09 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:41.106731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb16f268-1efc-4970-9762-567657a97c09 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:41.107427 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb16f268-1efc-4970-9762-567657a97c09 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:41.160567 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-cb16f268-1efc-4970-9762-567657a97c09 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] HTTP exception thrown: Instance fd547127-9c38-4b82-b256-057f141843cd could not be found. Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb16f268-1efc-4970-9762-567657a97c09 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Request method failure captured: Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd HTTP/1.1 Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgBznQHNaOQSFLxoSWoCQ9hM_j0rDTvTqgGEXtOY5AvsNS3wnSnsKPq1brvowzVLm_09c1waLsJrFpihbXQ2I-pXEEbKWLH4qZhxSJfMM_hStgT1NZ8xcwJWs2OWbQyk15VS3tMTjbBVTyv_jiH5rZPFN41C1BDVpAXdNxiZaDgd17U Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 3cfd67239d3f4b7a89be1453a08c92ba Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3cfd67239d3f4b7a89be1453a08c92ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3cfd67239d3f4b7a89be1453a08c92ba", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3cfd67239d3f4b7a89be1453a08c92ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3cfd67239d3f4b7a89be1453a08c92ba"}]}] Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 3cfd67239d3f4b7a89be1453a08c92ba Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AttachVolumeNegativeTest-632701884-project Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: ff5172c17fae44e5839bd9b789e4c3a8 Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AttachVolumeNegativeTest-632701884-project Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance fd547127-9c38-4b82-b256-057f141843cd could not be found. Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'fd547127-9c38-4b82-b256-057f141843cd'} Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd547127-9c38-4b82-b256-057f141843cd could not be found. Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:48:41.176890 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:48:41.185376 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd547127-9c38-4b82-b256-057f141843cd could not be found. Aug 24 10:48:41.185376 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:48:41.185376 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:48:41.185376 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:48:41.185376 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:41.185376 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:48:41.185376 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:48:41.185376 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:48:41.185376 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:48:41.185376 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd547127-9c38-4b82-b256-057f141843cd could not be found. Aug 24 10:48:41.185376 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:48:41.185376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb16f268-1efc-4970-9762-567657a97c09 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Returning 404 to user: Instance fd547127-9c38-4b82-b256-057f141843cd could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:48:41.185376 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cb16f268-1efc-4970-9762-567657a97c09 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "DELETE /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd" status: 404 len: 111 microversion: 2.1 time: 0.108203 Aug 24 10:48:41.185376 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3062/5779] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:48:41 2022] DELETE /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:48:41.192228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b4b2c84b-71f5-45b4-82eb-9ebad2bc7b60 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:41.192524 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b4b2c84b-71f5-45b4-82eb-9ebad2bc7b60 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: fd547127-9c38-4b82-b256-057f141843cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:41.239546 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4b2c84b-71f5-45b4-82eb-9ebad2bc7b60 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:41.246563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4b2c84b-71f5-45b4-82eb-9ebad2bc7b60 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:41.249975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4b2c84b-71f5-45b4-82eb-9ebad2bc7b60 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:41.251183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4b2c84b-71f5-45b4-82eb-9ebad2bc7b60 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:41.254419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4b2c84b-71f5-45b4-82eb-9ebad2bc7b60 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:41.257243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4b2c84b-71f5-45b4-82eb-9ebad2bc7b60 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:41.309566 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-b4b2c84b-71f5-45b4-82eb-9ebad2bc7b60 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] HTTP exception thrown: Instance fd547127-9c38-4b82-b256-057f141843cd could not be found. Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b4b2c84b-71f5-45b4-82eb-9ebad2bc7b60 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Request method failure captured: Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd HTTP/1.1 Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgBznQHNaOQSFLxoSWoCQ9hM_j0rDTvTqgGEXtOY5AvsNS3wnSnsKPq1brvowzVLm_09c1waLsJrFpihbXQ2I-pXEEbKWLH4qZhxSJfMM_hStgT1NZ8xcwJWs2OWbQyk15VS3tMTjbBVTyv_jiH5rZPFN41C1BDVpAXdNxiZaDgd17U Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 3cfd67239d3f4b7a89be1453a08c92ba Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3cfd67239d3f4b7a89be1453a08c92ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3cfd67239d3f4b7a89be1453a08c92ba", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3cfd67239d3f4b7a89be1453a08c92ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3cfd67239d3f4b7a89be1453a08c92ba"}]}] Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 3cfd67239d3f4b7a89be1453a08c92ba Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AttachVolumeNegativeTest-632701884-project Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: ff5172c17fae44e5839bd9b789e4c3a8 Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AttachVolumeNegativeTest-632701884-project Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance fd547127-9c38-4b82-b256-057f141843cd could not be found. Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'fd547127-9c38-4b82-b256-057f141843cd'} Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd547127-9c38-4b82-b256-057f141843cd could not be found. Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd547127-9c38-4b82-b256-057f141843cd could not be found. Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:48:41.312652 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:48:41.319968 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:41.319968 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:48:41.319968 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:48:41.319968 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:48:41.319968 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:48:41.319968 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd547127-9c38-4b82-b256-057f141843cd could not be found. Aug 24 10:48:41.319968 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:48:41.324830 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b4b2c84b-71f5-45b4-82eb-9ebad2bc7b60 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Returning 404 to user: Instance fd547127-9c38-4b82-b256-057f141843cd could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:48:41.330425 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b4b2c84b-71f5-45b4-82eb-9ebad2bc7b60 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd" status: 404 len: 111 microversion: 2.1 time: 0.144578 Aug 24 10:48:41.333895 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3063/5780] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:41 2022] GET /compute/v2.1/servers/fd547127-9c38-4b82-b256-057f141843cd => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:48:41.656904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2ca046d3-e110-45a3-a218-d8e0e091227d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:41.666012 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2ca046d3-e110-45a3-a218-d8e0e091227d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1679 microversion: 2.1 time: 0.637833 Aug 24 10:48:41.666617 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2718/5781] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:41 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1679 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:48:42.707165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-16fd6cda-3582-4730-983a-9c5ea97459a3 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:42.708341 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-16fd6cda-3582-4730-983a-9c5ea97459a3 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:42.727122 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16fd6cda-3582-4730-983a-9c5ea97459a3 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:42.729794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16fd6cda-3582-4730-983a-9c5ea97459a3 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:42.736688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16fd6cda-3582-4730-983a-9c5ea97459a3 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:42.737883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16fd6cda-3582-4730-983a-9c5ea97459a3 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:42.738797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16fd6cda-3582-4730-983a-9c5ea97459a3 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:42.741502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16fd6cda-3582-4730-983a-9c5ea97459a3 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:43.037310 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d75d167d-9db6-40b6-a584-05659930abcf tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Action: 'create', calling method: .version_select at 0x7f4655074e50>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1297925966", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAo7gbfVcd6KqUc70nnfGXLaeTJj1cZZ89ztZ5UdkNUhjn+kqvQZO7Vib7YZZM63hhLjh13NPfNr7ccGMcSLZLRDsk4s7ujtehiKAwj3o1v6/pWp+xpeJ0WklkOKjFicrA=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:48:43.075274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-d75d167d-9db6-40b6-a584-05659930abcf tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Getting quotas for project 65e4aa20cf3d44a2b11f47c0c18cfb4d. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:48:43.096959 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-d75d167d-9db6-40b6-a584-05659930abcf tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Getting quotas for user afd244b0014c4240bca18becdd30a5a0 and project 65e4aa20cf3d44a2b11f47c0c18cfb4d. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:48:43.157062 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d75d167d-9db6-40b6-a584-05659930abcf tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.123753 Aug 24 10:48:43.157748 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2719/5782] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:48:43 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:48:43.312623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-16fd6cda-3582-4730-983a-9c5ea97459a3 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:43.327605 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-16fd6cda-3582-4730-983a-9c5ea97459a3 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1679 microversion: 2.1 time: 0.623331 Aug 24 10:48:43.330555 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3064/5783] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:42 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1679 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:48:44.353249 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f02592d1-e472-4f90-af85-cd1f3ec8e695 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:44.355339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f02592d1-e472-4f90-af85-cd1f3ec8e695 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:44.372056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f02592d1-e472-4f90-af85-cd1f3ec8e695 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:44.372785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f02592d1-e472-4f90-af85-cd1f3ec8e695 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:44.375676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f02592d1-e472-4f90-af85-cd1f3ec8e695 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:44.376737 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f02592d1-e472-4f90-af85-cd1f3ec8e695 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:44.377603 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f02592d1-e472-4f90-af85-cd1f3ec8e695 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:44.380287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f02592d1-e472-4f90-af85-cd1f3ec8e695 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:44.740725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f02592d1-e472-4f90-af85-cd1f3ec8e695 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:44.755323 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f02592d1-e472-4f90-af85-cd1f3ec8e695 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1679 microversion: 2.1 time: 0.408845 Aug 24 10:48:44.756435 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2720/5784] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:44 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1679 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:48:45.781175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dfc61725-71c7-4434-8ebf-d8043c96f9c6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:45.783343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dfc61725-71c7-4434-8ebf-d8043c96f9c6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:45.799940 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfc61725-71c7-4434-8ebf-d8043c96f9c6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:45.801212 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfc61725-71c7-4434-8ebf-d8043c96f9c6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:45.801851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfc61725-71c7-4434-8ebf-d8043c96f9c6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:45.802759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfc61725-71c7-4434-8ebf-d8043c96f9c6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:45.803426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfc61725-71c7-4434-8ebf-d8043c96f9c6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:45.806361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfc61725-71c7-4434-8ebf-d8043c96f9c6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:46.110942 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fb65c456-c4b4-44af-a2ea-5a3a5f8be50f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-250958649", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "81437a66-0122-4577-b928-d85506f507e6"}], "key_name": "tempest-TestNetworkBasicOps-1297925966", "security_groups": [{"name": "tempest-secgroup-smoke-1390905179"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:48:46.354569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dfc61725-71c7-4434-8ebf-d8043c96f9c6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:46.369968 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dfc61725-71c7-4434-8ebf-d8043c96f9c6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1679 microversion: 2.1 time: 0.592601 Aug 24 10:48:46.373534 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3065/5785] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:45 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1679 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:48:46.562888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-fb65c456-c4b4-44af-a2ea-5a3a5f8be50f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] validate_networks() for [('81437a66-0122-4577-b928-d85506f507e6', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:48:47.398603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b096d17b-37a2-4780-ba5d-36794f425d6d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:47.400022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b096d17b-37a2-4780-ba5d-36794f425d6d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:47.440967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b096d17b-37a2-4780-ba5d-36794f425d6d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:47.442320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b096d17b-37a2-4780-ba5d-36794f425d6d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:47.443457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b096d17b-37a2-4780-ba5d-36794f425d6d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:47.449711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b096d17b-37a2-4780-ba5d-36794f425d6d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:47.450414 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b096d17b-37a2-4780-ba5d-36794f425d6d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:47.451139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b096d17b-37a2-4780-ba5d-36794f425d6d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:47.697906 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fb65c456-c4b4-44af-a2ea-5a3a5f8be50f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:48:47.699074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fb65c456-c4b4-44af-a2ea-5a3a5f8be50f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:48:47.699807 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fb65c456-c4b4-44af-a2ea-5a3a5f8be50f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:48:47.700451 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fb65c456-c4b4-44af-a2ea-5a3a5f8be50f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:48:47.701093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fb65c456-c4b4-44af-a2ea-5a3a5f8be50f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:48:47.713741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb65c456-c4b4-44af-a2ea-5a3a5f8be50f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:47.714938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb65c456-c4b4-44af-a2ea-5a3a5f8be50f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:47.715616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb65c456-c4b4-44af-a2ea-5a3a5f8be50f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:47.716613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb65c456-c4b4-44af-a2ea-5a3a5f8be50f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:47.717365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb65c456-c4b4-44af-a2ea-5a3a5f8be50f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:47.718039 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb65c456-c4b4-44af-a2ea-5a3a5f8be50f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:47.738138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-fb65c456-c4b4-44af-a2ea-5a3a5f8be50f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Getting quotas for project 65e4aa20cf3d44a2b11f47c0c18cfb4d. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:48:47.745345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-fb65c456-c4b4-44af-a2ea-5a3a5f8be50f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Getting quotas for user afd244b0014c4240bca18becdd30a5a0 and project 65e4aa20cf3d44a2b11f47c0c18cfb4d. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:48:47.762524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fb65c456-c4b4-44af-a2ea-5a3a5f8be50f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:48:47.765428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fb65c456-c4b4-44af-a2ea-5a3a5f8be50f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 5c094722-159c-4fb8-ae06-e73ae16da2aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:48:47.847631 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fb65c456-c4b4-44af-a2ea-5a3a5f8be50f tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.740490 Aug 24 10:48:47.854468 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2721/5786] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:48:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 1742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:48:47.861419 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8f54c89d-3210-47bd-b184-004ed07fc6f7 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:47.862203 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8f54c89d-3210-47bd-b184-004ed07fc6f7 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 5c094722-159c-4fb8-ae06-e73ae16da2aa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:47.964444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8f54c89d-3210-47bd-b184-004ed07fc6f7 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:47.972035 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8f54c89d-3210-47bd-b184-004ed07fc6f7 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa" status: 200 len: 1248 microversion: 2.1 time: 0.114774 Aug 24 10:48:47.977744 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2722/5787] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:47 2022] GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa => generated 1248 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:48:48.019386 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b096d17b-37a2-4780-ba5d-36794f425d6d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:48.028742 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b096d17b-37a2-4780-ba5d-36794f425d6d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1656 microversion: 2.1 time: 0.641057 Aug 24 10:48:48.045602 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3066/5788] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:47 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1656 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:48:48.062587 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5c6e3e0b-353c-4e3e-912d-4ef05280cacf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:48:48.098684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c6e3e0b-353c-4e3e-912d-4ef05280cacf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:48.105705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c6e3e0b-353c-4e3e-912d-4ef05280cacf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:48.106307 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c6e3e0b-353c-4e3e-912d-4ef05280cacf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:48.144602 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5c6e3e0b-353c-4e3e-912d-4ef05280cacf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Going to try to start instance {{(pid=122432) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 10:48:48.279307 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5c6e3e0b-353c-4e3e-912d-4ef05280cacf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "POST /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02/action" status: 202 len: 0 microversion: 2.1 time: 0.222152 Aug 24 10:48:48.280598 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2723/5789] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:48:48 2022] POST /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:48:48.299138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d11a8dca-e296-4238-a96a-14c6c8bfa362 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:48.299945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d11a8dca-e296-4238-a96a-14c6c8bfa362 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:48.346029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d11a8dca-e296-4238-a96a-14c6c8bfa362 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:48.350643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d11a8dca-e296-4238-a96a-14c6c8bfa362 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:48.351702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d11a8dca-e296-4238-a96a-14c6c8bfa362 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:48.353747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d11a8dca-e296-4238-a96a-14c6c8bfa362 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:48.354219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d11a8dca-e296-4238-a96a-14c6c8bfa362 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:48.357927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d11a8dca-e296-4238-a96a-14c6c8bfa362 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:48.382205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f3b9a892-ae39-46ea-9710-90adcaaffcff tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:48.383067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f3b9a892-ae39-46ea-9710-90adcaaffcff tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:48.402706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3b9a892-ae39-46ea-9710-90adcaaffcff tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:48.403770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3b9a892-ae39-46ea-9710-90adcaaffcff tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:48.404588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3b9a892-ae39-46ea-9710-90adcaaffcff tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:48.408060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3b9a892-ae39-46ea-9710-90adcaaffcff tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:48.409836 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3b9a892-ae39-46ea-9710-90adcaaffcff tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:48.411279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3b9a892-ae39-46ea-9710-90adcaaffcff tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:48.450709 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-f3b9a892-ae39-46ea-9710-90adcaaffcff tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] HTTP exception thrown: Instance bb455d4d-f629-4593-ab93-67ac87630d84 could not be found. Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f3b9a892-ae39-46ea-9710-90adcaaffcff tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Request method failure captured: Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84 HTTP/1.1 Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgBznQHNaOQSFLxoSWoCQ9hM_j0rDTvTqgGEXtOY5AvsNS3wnSnsKPq1brvowzVLm_09c1waLsJrFpihbXQ2I-pXEEbKWLH4qZhxSJfMM_hStgT1NZ8xcwJWs2OWbQyk15VS3tMTjbBVTyv_jiH5rZPFN41C1BDVpAXdNxiZaDgd17U Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 3cfd67239d3f4b7a89be1453a08c92ba Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3cfd67239d3f4b7a89be1453a08c92ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3cfd67239d3f4b7a89be1453a08c92ba", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3cfd67239d3f4b7a89be1453a08c92ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3cfd67239d3f4b7a89be1453a08c92ba"}]}] Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 3cfd67239d3f4b7a89be1453a08c92ba Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-AttachVolumeNegativeTest-632701884-project Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: ff5172c17fae44e5839bd9b789e4c3a8 Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-AttachVolumeNegativeTest-632701884-project Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance bb455d4d-f629-4593-ab93-67ac87630d84 could not be found. Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'bb455d4d-f629-4593-ab93-67ac87630d84'} Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb455d4d-f629-4593-ab93-67ac87630d84 could not be found. Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:48:48.453036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:48:48.459177 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb455d4d-f629-4593-ab93-67ac87630d84 could not be found. Aug 24 10:48:48.459177 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:48.459177 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:48:48.459177 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:48.459177 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:48.459177 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:48:48.459177 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:48:48.459177 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:48:48.459177 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:48:48.459177 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb455d4d-f629-4593-ab93-67ac87630d84 could not be found. Aug 24 10:48:48.459177 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:48.464764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f3b9a892-ae39-46ea-9710-90adcaaffcff tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Returning 404 to user: Instance bb455d4d-f629-4593-ab93-67ac87630d84 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:48:48.466496 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f3b9a892-ae39-46ea-9710-90adcaaffcff tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "DELETE /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84" status: 404 len: 111 microversion: 2.1 time: 0.091528 Aug 24 10:48:48.467634 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2724/5790] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:48:48 2022] DELETE /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:48:48.478583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4ebfc86e-553c-4033-b59b-c2dd633d8856 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:48.479692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4ebfc86e-553c-4033-b59b-c2dd633d8856 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: bb455d4d-f629-4593-ab93-67ac87630d84] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:48.490454 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ebfc86e-553c-4033-b59b-c2dd633d8856 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:48.491159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ebfc86e-553c-4033-b59b-c2dd633d8856 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:48.492058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ebfc86e-553c-4033-b59b-c2dd633d8856 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:48.493204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ebfc86e-553c-4033-b59b-c2dd633d8856 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:48.494126 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ebfc86e-553c-4033-b59b-c2dd633d8856 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:48.495653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ebfc86e-553c-4033-b59b-c2dd633d8856 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:48.520469 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-4ebfc86e-553c-4033-b59b-c2dd633d8856 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] HTTP exception thrown: Instance bb455d4d-f629-4593-ab93-67ac87630d84 could not be found. Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4ebfc86e-553c-4033-b59b-c2dd633d8856 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Request method failure captured: Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84 HTTP/1.1 Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgBznQHNaOQSFLxoSWoCQ9hM_j0rDTvTqgGEXtOY5AvsNS3wnSnsKPq1brvowzVLm_09c1waLsJrFpihbXQ2I-pXEEbKWLH4qZhxSJfMM_hStgT1NZ8xcwJWs2OWbQyk15VS3tMTjbBVTyv_jiH5rZPFN41C1BDVpAXdNxiZaDgd17U Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 3cfd67239d3f4b7a89be1453a08c92ba Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3cfd67239d3f4b7a89be1453a08c92ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3cfd67239d3f4b7a89be1453a08c92ba", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3cfd67239d3f4b7a89be1453a08c92ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3cfd67239d3f4b7a89be1453a08c92ba"}]}] Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 3cfd67239d3f4b7a89be1453a08c92ba Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-AttachVolumeNegativeTest-632701884-project Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: ff5172c17fae44e5839bd9b789e4c3a8 Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-AttachVolumeNegativeTest-632701884-project Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance bb455d4d-f629-4593-ab93-67ac87630d84 could not be found. Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'bb455d4d-f629-4593-ab93-67ac87630d84'} Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb455d4d-f629-4593-ab93-67ac87630d84 could not be found. Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb455d4d-f629-4593-ab93-67ac87630d84 could not be found. Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:48:48.526065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:48.532396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:48.532396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:48:48.532396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:48:48.532396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:48:48.532396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:48:48.532396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb455d4d-f629-4593-ab93-67ac87630d84 could not be found. Aug 24 10:48:48.532396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:48.541656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4ebfc86e-553c-4033-b59b-c2dd633d8856 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Returning 404 to user: Instance bb455d4d-f629-4593-ab93-67ac87630d84 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:48:48.542913 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4ebfc86e-553c-4033-b59b-c2dd633d8856 tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84" status: 404 len: 111 microversion: 2.1 time: 0.070069 Aug 24 10:48:48.545617 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2725/5791] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:48 2022] GET /compute/v2.1/servers/bb455d4d-f629-4593-ab93-67ac87630d84 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:48:48.557763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-75b2e22d-962f-449a-9e1e-eeb3ef3de95a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:48.558656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-75b2e22d-962f-449a-9e1e-eeb3ef3de95a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: dbb7948c-1b98-4b05-9c70-d1a3e873fc54] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:48.570032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75b2e22d-962f-449a-9e1e-eeb3ef3de95a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:48.573561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75b2e22d-962f-449a-9e1e-eeb3ef3de95a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:48.574423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75b2e22d-962f-449a-9e1e-eeb3ef3de95a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:48.575520 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75b2e22d-962f-449a-9e1e-eeb3ef3de95a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:48.576217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75b2e22d-962f-449a-9e1e-eeb3ef3de95a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:48.576877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75b2e22d-962f-449a-9e1e-eeb3ef3de95a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:48.605933 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-75b2e22d-962f-449a-9e1e-eeb3ef3de95a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] HTTP exception thrown: Instance dbb7948c-1b98-4b05-9c70-d1a3e873fc54 could not be found. Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-75b2e22d-962f-449a-9e1e-eeb3ef3de95a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Request method failure captured: Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54 HTTP/1.1 Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgBznQHNaOQSFLxoSWoCQ9hM_j0rDTvTqgGEXtOY5AvsNS3wnSnsKPq1brvowzVLm_09c1waLsJrFpihbXQ2I-pXEEbKWLH4qZhxSJfMM_hStgT1NZ8xcwJWs2OWbQyk15VS3tMTjbBVTyv_jiH5rZPFN41C1BDVpAXdNxiZaDgd17U Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 3cfd67239d3f4b7a89be1453a08c92ba Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3cfd67239d3f4b7a89be1453a08c92ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3cfd67239d3f4b7a89be1453a08c92ba", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3cfd67239d3f4b7a89be1453a08c92ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3cfd67239d3f4b7a89be1453a08c92ba"}]}] Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 3cfd67239d3f4b7a89be1453a08c92ba Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-AttachVolumeNegativeTest-632701884-project Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: ff5172c17fae44e5839bd9b789e4c3a8 Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-AttachVolumeNegativeTest-632701884-project Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance dbb7948c-1b98-4b05-9c70-d1a3e873fc54 could not be found. Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'dbb7948c-1b98-4b05-9c70-d1a3e873fc54'} Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbb7948c-1b98-4b05-9c70-d1a3e873fc54 could not be found. Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:48:48.607563 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:48:48.612978 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbb7948c-1b98-4b05-9c70-d1a3e873fc54 could not be found. Aug 24 10:48:48.612978 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:48.612978 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:48:48.612978 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:48.612978 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:48.612978 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:48:48.612978 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:48:48.612978 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:48:48.612978 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:48:48.612978 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbb7948c-1b98-4b05-9c70-d1a3e873fc54 could not be found. Aug 24 10:48:48.612978 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:48.612978 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-75b2e22d-962f-449a-9e1e-eeb3ef3de95a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Returning 404 to user: Instance dbb7948c-1b98-4b05-9c70-d1a3e873fc54 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:48:48.612978 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-75b2e22d-962f-449a-9e1e-eeb3ef3de95a tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "DELETE /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54" status: 404 len: 111 microversion: 2.1 time: 0.061927 Aug 24 10:48:48.614333 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2726/5792] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:48:48 2022] DELETE /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:48:48.624072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5bad65e5-65c6-4ece-b16a-a03ec864a11c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:48.624978 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5bad65e5-65c6-4ece-b16a-a03ec864a11c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: dbb7948c-1b98-4b05-9c70-d1a3e873fc54] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:48.632382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bad65e5-65c6-4ece-b16a-a03ec864a11c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:48.633053 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bad65e5-65c6-4ece-b16a-a03ec864a11c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:48.633690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bad65e5-65c6-4ece-b16a-a03ec864a11c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:48.634558 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bad65e5-65c6-4ece-b16a-a03ec864a11c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:48.635238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bad65e5-65c6-4ece-b16a-a03ec864a11c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:48.636356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bad65e5-65c6-4ece-b16a-a03ec864a11c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:48.667030 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-5bad65e5-65c6-4ece-b16a-a03ec864a11c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] HTTP exception thrown: Instance dbb7948c-1b98-4b05-9c70-d1a3e873fc54 could not be found. Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5bad65e5-65c6-4ece-b16a-a03ec864a11c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Request method failure captured: Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54 HTTP/1.1 Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgBznQHNaOQSFLxoSWoCQ9hM_j0rDTvTqgGEXtOY5AvsNS3wnSnsKPq1brvowzVLm_09c1waLsJrFpihbXQ2I-pXEEbKWLH4qZhxSJfMM_hStgT1NZ8xcwJWs2OWbQyk15VS3tMTjbBVTyv_jiH5rZPFN41C1BDVpAXdNxiZaDgd17U Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 3cfd67239d3f4b7a89be1453a08c92ba Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3cfd67239d3f4b7a89be1453a08c92ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3cfd67239d3f4b7a89be1453a08c92ba", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3cfd67239d3f4b7a89be1453a08c92ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3cfd67239d3f4b7a89be1453a08c92ba"}]}] Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 3cfd67239d3f4b7a89be1453a08c92ba Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-AttachVolumeNegativeTest-632701884-project Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: ff5172c17fae44e5839bd9b789e4c3a8 Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-AttachVolumeNegativeTest-632701884-project Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance dbb7948c-1b98-4b05-9c70-d1a3e873fc54 could not be found. Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'dbb7948c-1b98-4b05-9c70-d1a3e873fc54'} Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbb7948c-1b98-4b05-9c70-d1a3e873fc54 could not be found. Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbb7948c-1b98-4b05-9c70-d1a3e873fc54 could not be found. Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:48:48.669297 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:48.674824 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:48.674824 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:48:48.674824 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:48:48.674824 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:48:48.674824 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:48:48.674824 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbb7948c-1b98-4b05-9c70-d1a3e873fc54 could not be found. Aug 24 10:48:48.674824 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:48:48.674824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5bad65e5-65c6-4ece-b16a-a03ec864a11c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Returning 404 to user: Instance dbb7948c-1b98-4b05-9c70-d1a3e873fc54 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:48:48.676417 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5bad65e5-65c6-4ece-b16a-a03ec864a11c tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54" status: 404 len: 111 microversion: 2.1 time: 0.058194 Aug 24 10:48:48.680634 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2727/5793] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:48 2022] GET /compute/v2.1/servers/dbb7948c-1b98-4b05-9c70-d1a3e873fc54 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:48:48.966045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d11a8dca-e296-4238-a96a-14c6c8bfa362 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:48.984744 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d11a8dca-e296-4238-a96a-14c6c8bfa362 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1665 microversion: 2.1 time: 0.697594 Aug 24 10:48:48.985457 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3067/5794] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:48 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1665 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:48:49.006712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-50216822-5d15-47b7-ba67-e55e3e2c7a0c tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:49.007589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-50216822-5d15-47b7-ba67-e55e3e2c7a0c tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 5c094722-159c-4fb8-ae06-e73ae16da2aa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:49.021543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50216822-5d15-47b7-ba67-e55e3e2c7a0c tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:49.022069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50216822-5d15-47b7-ba67-e55e3e2c7a0c tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:49.024756 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50216822-5d15-47b7-ba67-e55e3e2c7a0c tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:49.025935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50216822-5d15-47b7-ba67-e55e3e2c7a0c tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:49.027537 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50216822-5d15-47b7-ba67-e55e3e2c7a0c tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:49.029236 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50216822-5d15-47b7-ba67-e55e3e2c7a0c tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:49.185168 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-50216822-5d15-47b7-ba67-e55e3e2c7a0c tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:49.195683 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-50216822-5d15-47b7-ba67-e55e3e2c7a0c tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa" status: 200 len: 1252 microversion: 2.1 time: 0.201474 Aug 24 10:48:49.205484 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2728/5795] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:48 2022] GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa => generated 1252 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:48:50.011089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-daa3e4e6-9971-479a-a536-b02b9e328083 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:50.012474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-daa3e4e6-9971-479a-a536-b02b9e328083 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:50.023235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-daa3e4e6-9971-479a-a536-b02b9e328083 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:50.026058 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-daa3e4e6-9971-479a-a536-b02b9e328083 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:50.029937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-daa3e4e6-9971-479a-a536-b02b9e328083 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:50.031099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-daa3e4e6-9971-479a-a536-b02b9e328083 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:50.031816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-daa3e4e6-9971-479a-a536-b02b9e328083 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:50.032679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-daa3e4e6-9971-479a-a536-b02b9e328083 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:50.238841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2f0dcdc4-98e1-43b4-b3f6-2deb9150c292 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:50.239474 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2f0dcdc4-98e1-43b4-b3f6-2deb9150c292 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 5c094722-159c-4fb8-ae06-e73ae16da2aa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:50.274164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f0dcdc4-98e1-43b4-b3f6-2deb9150c292 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:50.303884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f0dcdc4-98e1-43b4-b3f6-2deb9150c292 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:50.304551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f0dcdc4-98e1-43b4-b3f6-2deb9150c292 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:50.305347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f0dcdc4-98e1-43b4-b3f6-2deb9150c292 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:50.309532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f0dcdc4-98e1-43b4-b3f6-2deb9150c292 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:50.310180 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f0dcdc4-98e1-43b4-b3f6-2deb9150c292 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:50.603404 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2f0dcdc4-98e1-43b4-b3f6-2deb9150c292 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:50.620635 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2f0dcdc4-98e1-43b4-b3f6-2deb9150c292 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa" status: 200 len: 1306 microversion: 2.1 time: 0.392206 Aug 24 10:48:50.623097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-daa3e4e6-9971-479a-a536-b02b9e328083 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:50.624354 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2729/5796] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:50 2022] GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa => generated 1306 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:48:50.658754 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-daa3e4e6-9971-479a-a536-b02b9e328083 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1665 microversion: 2.1 time: 0.652543 Aug 24 10:48:50.662819 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3068/5797] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:50 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1665 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:48:51.654692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-08086f93-6f3b-4a77-a034-3a2611d44592 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:51.656478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-08086f93-6f3b-4a77-a034-3a2611d44592 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 5c094722-159c-4fb8-ae06-e73ae16da2aa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:51.680544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cd2f4ae9-48d4-41ed-9367-c751e8f0b0e7 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:51.681441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cd2f4ae9-48d4-41ed-9367-c751e8f0b0e7 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:51.684551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08086f93-6f3b-4a77-a034-3a2611d44592 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:51.685490 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08086f93-6f3b-4a77-a034-3a2611d44592 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:51.687207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08086f93-6f3b-4a77-a034-3a2611d44592 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:51.688235 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08086f93-6f3b-4a77-a034-3a2611d44592 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:51.692560 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08086f93-6f3b-4a77-a034-3a2611d44592 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:51.693332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08086f93-6f3b-4a77-a034-3a2611d44592 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:51.695310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd2f4ae9-48d4-41ed-9367-c751e8f0b0e7 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:51.701182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd2f4ae9-48d4-41ed-9367-c751e8f0b0e7 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:51.701926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd2f4ae9-48d4-41ed-9367-c751e8f0b0e7 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:51.702940 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd2f4ae9-48d4-41ed-9367-c751e8f0b0e7 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:51.704163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd2f4ae9-48d4-41ed-9367-c751e8f0b0e7 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:51.704883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd2f4ae9-48d4-41ed-9367-c751e8f0b0e7 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:51.854837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-08086f93-6f3b-4a77-a034-3a2611d44592 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:51.868404 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-08086f93-6f3b-4a77-a034-3a2611d44592 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa" status: 200 len: 1306 microversion: 2.1 time: 0.219638 Aug 24 10:48:51.883261 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2730/5798] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:51 2022] GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa => generated 1306 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:48:52.018217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cd2f4ae9-48d4-41ed-9367-c751e8f0b0e7 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:52.033764 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cd2f4ae9-48d4-41ed-9367-c751e8f0b0e7 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1669 microversion: 2.1 time: 0.356816 Aug 24 10:48:52.045204 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3069/5799] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:51 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1669 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:48:52.892726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0c43b8d8-d269-4be9-be48-ed392fba9245 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:52.894490 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0c43b8d8-d269-4be9-be48-ed392fba9245 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 5c094722-159c-4fb8-ae06-e73ae16da2aa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:52.931280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c43b8d8-d269-4be9-be48-ed392fba9245 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:52.936923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c43b8d8-d269-4be9-be48-ed392fba9245 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:52.938718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c43b8d8-d269-4be9-be48-ed392fba9245 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:52.941681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c43b8d8-d269-4be9-be48-ed392fba9245 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:52.942485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c43b8d8-d269-4be9-be48-ed392fba9245 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:52.944944 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c43b8d8-d269-4be9-be48-ed392fba9245 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:52.997402 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:53.256220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0c43b8d8-d269-4be9-be48-ed392fba9245 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:53.266133 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0c43b8d8-d269-4be9-be48-ed392fba9245 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa" status: 200 len: 1374 microversion: 2.1 time: 0.377712 Aug 24 10:48:53.266868 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2731/5800] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:52 2022] GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa => generated 1374 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:48:53.880357 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-66046f77-88fb-4eba-a875-f79d6f15a4cf req-b906bb3e-ece4-4473-aee3-fd456ed26696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c094722-159c-4fb8-ae06-e73ae16da2aa", "tag": "dd14f6d8-77eb-4af1-a3cf-7f59206343cc"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:48:53.898168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-66046f77-88fb-4eba-a875-f79d6f15a4cf req-b906bb3e-ece4-4473-aee3-fd456ed26696 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:53.898666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-66046f77-88fb-4eba-a875-f79d6f15a4cf req-b906bb3e-ece4-4473-aee3-fd456ed26696 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:53.899513 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-66046f77-88fb-4eba-a875-f79d6f15a4cf req-b906bb3e-ece4-4473-aee3-fd456ed26696 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:53.949896 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-66046f77-88fb-4eba-a875-f79d6f15a4cf req-b906bb3e-ece4-4473-aee3-fd456ed26696 service nova] Creating event network-changed:dd14f6d8-77eb-4af1-a3cf-7f59206343cc for instance 5c094722-159c-4fb8-ae06-e73ae16da2aa on n-h2-849328-3 Aug 24 10:48:53.972462 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-66046f77-88fb-4eba-a875-f79d6f15a4cf req-b906bb3e-ece4-4473-aee3-fd456ed26696 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097498 Aug 24 10:48:53.977544 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3070/5801] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:48:54.288051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c2630ae0-8be5-411d-9eed-5037de81a30a tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:54.289440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c2630ae0-8be5-411d-9eed-5037de81a30a tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 5c094722-159c-4fb8-ae06-e73ae16da2aa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:54.297029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2630ae0-8be5-411d-9eed-5037de81a30a tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:54.298035 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2630ae0-8be5-411d-9eed-5037de81a30a tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:54.298642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2630ae0-8be5-411d-9eed-5037de81a30a tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:54.300378 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2630ae0-8be5-411d-9eed-5037de81a30a tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:54.301076 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2630ae0-8be5-411d-9eed-5037de81a30a tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:54.301711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2630ae0-8be5-411d-9eed-5037de81a30a tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:54.479924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8372c3b8-143b-49db-ae43-33e90ec6fdde tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:54.481406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8372c3b8-143b-49db-ae43-33e90ec6fdde tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:54.496004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8372c3b8-143b-49db-ae43-33e90ec6fdde tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:54.496835 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8372c3b8-143b-49db-ae43-33e90ec6fdde tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:54.498882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8372c3b8-143b-49db-ae43-33e90ec6fdde tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:54.499969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8372c3b8-143b-49db-ae43-33e90ec6fdde tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:54.501772 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8372c3b8-143b-49db-ae43-33e90ec6fdde tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:54.502225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8372c3b8-143b-49db-ae43-33e90ec6fdde tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:54.537939 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-8372c3b8-143b-49db-ae43-33e90ec6fdde tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] HTTP exception thrown: Instance b8cf649c-8f17-41ad-9ee6-f29dab1632d9 could not be found. Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8372c3b8-143b-49db-ae43-33e90ec6fdde tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Request method failure captured: Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9 HTTP/1.1 Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgBznQHNaOQSFLxoSWoCQ9hM_j0rDTvTqgGEXtOY5AvsNS3wnSnsKPq1brvowzVLm_09c1waLsJrFpihbXQ2I-pXEEbKWLH4qZhxSJfMM_hStgT1NZ8xcwJWs2OWbQyk15VS3tMTjbBVTyv_jiH5rZPFN41C1BDVpAXdNxiZaDgd17U Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 3cfd67239d3f4b7a89be1453a08c92ba Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3cfd67239d3f4b7a89be1453a08c92ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3cfd67239d3f4b7a89be1453a08c92ba", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3cfd67239d3f4b7a89be1453a08c92ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3cfd67239d3f4b7a89be1453a08c92ba"}]}] Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 3cfd67239d3f4b7a89be1453a08c92ba Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AttachVolumeNegativeTest-632701884-project Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: ff5172c17fae44e5839bd9b789e4c3a8 Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AttachVolumeNegativeTest-632701884-project Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance b8cf649c-8f17-41ad-9ee6-f29dab1632d9 could not be found. Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'b8cf649c-8f17-41ad-9ee6-f29dab1632d9'} Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8cf649c-8f17-41ad-9ee6-f29dab1632d9 could not be found. Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:48:54.545399 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:48:54.550775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8cf649c-8f17-41ad-9ee6-f29dab1632d9 could not be found. Aug 24 10:48:54.550775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:48:54.550775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:48:54.550775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:48:54.550775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:54.550775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:48:54.550775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:48:54.550775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:48:54.550775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:48:54.550775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8cf649c-8f17-41ad-9ee6-f29dab1632d9 could not be found. Aug 24 10:48:54.550775 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:48:54.550775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8372c3b8-143b-49db-ae43-33e90ec6fdde tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Returning 404 to user: Instance b8cf649c-8f17-41ad-9ee6-f29dab1632d9 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:48:54.550775 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8372c3b8-143b-49db-ae43-33e90ec6fdde tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9" status: 404 len: 111 microversion: 2.1 time: 0.073559 Aug 24 10:48:54.550775 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3071/5802] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:48:54 2022] DELETE /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:48:54.558997 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-358813a9-0f34-474f-bb20-c6ffd507821d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:54.563627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-358813a9-0f34-474f-bb20-c6ffd507821d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] [instance: b8cf649c-8f17-41ad-9ee6-f29dab1632d9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:54.594572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-358813a9-0f34-474f-bb20-c6ffd507821d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:54.595167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-358813a9-0f34-474f-bb20-c6ffd507821d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:54.596024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-358813a9-0f34-474f-bb20-c6ffd507821d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:54.597313 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-358813a9-0f34-474f-bb20-c6ffd507821d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:54.598113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-358813a9-0f34-474f-bb20-c6ffd507821d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:54.600343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-358813a9-0f34-474f-bb20-c6ffd507821d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:54.640587 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-358813a9-0f34-474f-bb20-c6ffd507821d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] HTTP exception thrown: Instance b8cf649c-8f17-41ad-9ee6-f29dab1632d9 could not be found. Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-358813a9-0f34-474f-bb20-c6ffd507821d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Request method failure captured: Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9 HTTP/1.1 Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgBznQHNaOQSFLxoSWoCQ9hM_j0rDTvTqgGEXtOY5AvsNS3wnSnsKPq1brvowzVLm_09c1waLsJrFpihbXQ2I-pXEEbKWLH4qZhxSJfMM_hStgT1NZ8xcwJWs2OWbQyk15VS3tMTjbBVTyv_jiH5rZPFN41C1BDVpAXdNxiZaDgd17U Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 3cfd67239d3f4b7a89be1453a08c92ba Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3cfd67239d3f4b7a89be1453a08c92ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3cfd67239d3f4b7a89be1453a08c92ba", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3cfd67239d3f4b7a89be1453a08c92ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3cfd67239d3f4b7a89be1453a08c92ba"}]}] Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 3cfd67239d3f4b7a89be1453a08c92ba Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-632701884 Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AttachVolumeNegativeTest-632701884-project Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: ff5172c17fae44e5839bd9b789e4c3a8 Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AttachVolumeNegativeTest-632701884-project Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance b8cf649c-8f17-41ad-9ee6-f29dab1632d9 could not be found. Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'b8cf649c-8f17-41ad-9ee6-f29dab1632d9'} Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8cf649c-8f17-41ad-9ee6-f29dab1632d9 could not be found. Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8cf649c-8f17-41ad-9ee6-f29dab1632d9 could not be found. Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:48:54.643236 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:48:54.648279 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:48:54.648279 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:48:54.648279 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:48:54.648279 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:48:54.648279 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:48:54.648279 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8cf649c-8f17-41ad-9ee6-f29dab1632d9 could not be found. Aug 24 10:48:54.648279 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:48:54.650819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-358813a9-0f34-474f-bb20-c6ffd507821d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] Returning 404 to user: Instance b8cf649c-8f17-41ad-9ee6-f29dab1632d9 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:48:54.651742 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-358813a9-0f34-474f-bb20-c6ffd507821d tempest-AttachVolumeNegativeTest-632701884 tempest-AttachVolumeNegativeTest-632701884-project] 10.222.0.85 "GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9" status: 404 len: 111 microversion: 2.1 time: 0.097297 Aug 24 10:48:54.652336 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3072/5803] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:54 2022] GET /compute/v2.1/servers/b8cf649c-8f17-41ad-9ee6-f29dab1632d9 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:48:54.993051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c2630ae0-8be5-411d-9eed-5037de81a30a tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:55.008329 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c2630ae0-8be5-411d-9eed-5037de81a30a tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa" status: 200 len: 1374 microversion: 2.1 time: 0.724793 Aug 24 10:48:55.008942 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2732/5804] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:54 2022] GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa => generated 1374 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:48:56.033954 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-23cc802c-17ea-461a-9c67-b63126fe27ab tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:56.034776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-23cc802c-17ea-461a-9c67-b63126fe27ab tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 5c094722-159c-4fb8-ae06-e73ae16da2aa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:56.047991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23cc802c-17ea-461a-9c67-b63126fe27ab tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:56.048682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23cc802c-17ea-461a-9c67-b63126fe27ab tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:56.049269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23cc802c-17ea-461a-9c67-b63126fe27ab tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:56.050097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23cc802c-17ea-461a-9c67-b63126fe27ab tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:56.062500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23cc802c-17ea-461a-9c67-b63126fe27ab tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:56.064784 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23cc802c-17ea-461a-9c67-b63126fe27ab tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:56.513307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-23cc802c-17ea-461a-9c67-b63126fe27ab tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:56.524880 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-23cc802c-17ea-461a-9c67-b63126fe27ab tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa" status: 200 len: 1374 microversion: 2.1 time: 0.492166 Aug 24 10:48:56.526301 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3073/5805] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:56 2022] GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa => generated 1374 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:48:57.408323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6a066511-36e5-483e-87f1-89fecc9bd5ea tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Action: 'create', calling method: .version_select at 0x7f4647e349d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2110511473", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3w/2boBj6xU7k1NSEtABEH3PKSXPsIqUN0PuQjr2JUQUKkcbTf/WdeosmDq6klTkf2cg+ZQuRTgVvsiZry1/bZMpiYLA8jmQwdY4wzrK0PitJV4PkOVbTMfOg9IMaQyQ=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:48:57.425250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-6a066511-36e5-483e-87f1-89fecc9bd5ea tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Getting quotas for project de650d3c897a409dbf54c32bfd45d672. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:48:57.433371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-6a066511-36e5-483e-87f1-89fecc9bd5ea tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Getting quotas for user 127a30846ae64f268baf7f3231b84273 and project de650d3c897a409dbf54c32bfd45d672. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:48:57.478489 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6a066511-36e5-483e-87f1-89fecc9bd5ea tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.357044 Aug 24 10:48:57.479863 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2733/5806] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:48:57 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:48:57.548995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-46fb3ccc-2c94-4044-be37-42d00a98e313 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:57.550638 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-46fb3ccc-2c94-4044-be37-42d00a98e313 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 5c094722-159c-4fb8-ae06-e73ae16da2aa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:57.566088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46fb3ccc-2c94-4044-be37-42d00a98e313 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:57.567878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46fb3ccc-2c94-4044-be37-42d00a98e313 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:57.568687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46fb3ccc-2c94-4044-be37-42d00a98e313 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:57.569918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46fb3ccc-2c94-4044-be37-42d00a98e313 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:57.571416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46fb3ccc-2c94-4044-be37-42d00a98e313 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:57.572175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46fb3ccc-2c94-4044-be37-42d00a98e313 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:57.833775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-46fb3ccc-2c94-4044-be37-42d00a98e313 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:57.843089 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-46fb3ccc-2c94-4044-be37-42d00a98e313 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa" status: 200 len: 1374 microversion: 2.1 time: 0.299962 Aug 24 10:48:57.847811 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3074/5807] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:57 2022] GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa => generated 1374 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:48:58.867191 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:58.880506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ac66d60a-8173-4215-aed1-e23ebdacb7fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:48:58.881160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ac66d60a-8173-4215-aed1-e23ebdacb7fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 5c094722-159c-4fb8-ae06-e73ae16da2aa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:48:58.883206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=5 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:58.908566 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac66d60a-8173-4215-aed1-e23ebdacb7fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:58.909453 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac66d60a-8173-4215-aed1-e23ebdacb7fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:58.909909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac66d60a-8173-4215-aed1-e23ebdacb7fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:58.910858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac66d60a-8173-4215-aed1-e23ebdacb7fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:48:58.911493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac66d60a-8173-4215-aed1-e23ebdacb7fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:48:58.912086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac66d60a-8173-4215-aed1-e23ebdacb7fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:48:59.341764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ac66d60a-8173-4215-aed1-e23ebdacb7fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:48:59.355108 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ac66d60a-8173-4215-aed1-e23ebdacb7fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa" status: 200 len: 1374 microversion: 2.1 time: 0.488964 Aug 24 10:48:59.369173 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2734/5808] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:48:58 2022] GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa => generated 1374 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:00.384558 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-922eb695-c648-4c04-8610-395c73479a4e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:00.385484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-922eb695-c648-4c04-8610-395c73479a4e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 5c094722-159c-4fb8-ae06-e73ae16da2aa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:00.399748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:00.401872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-922eb695-c648-4c04-8610-395c73479a4e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:00.405203 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-922eb695-c648-4c04-8610-395c73479a4e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:00.405931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-922eb695-c648-4c04-8610-395c73479a4e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:00.406915 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-922eb695-c648-4c04-8610-395c73479a4e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:00.407732 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-922eb695-c648-4c04-8610-395c73479a4e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:00.409666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-922eb695-c648-4c04-8610-395c73479a4e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:00.721112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-f1118a1f-5322-4665-add9-a01fe05f031c req-662c3cbe-b366-4c99-98d2-5f7464dc6a8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c094722-159c-4fb8-ae06-e73ae16da2aa", "name": "network-vif-plugged", "status": "completed", "tag": "dd14f6d8-77eb-4af1-a3cf-7f59206343cc"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:49:00.743668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f1118a1f-5322-4665-add9-a01fe05f031c req-662c3cbe-b366-4c99-98d2-5f7464dc6a8b service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:00.744465 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f1118a1f-5322-4665-add9-a01fe05f031c req-662c3cbe-b366-4c99-98d2-5f7464dc6a8b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:00.745229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f1118a1f-5322-4665-add9-a01fe05f031c req-662c3cbe-b366-4c99-98d2-5f7464dc6a8b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:00.757219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-922eb695-c648-4c04-8610-395c73479a4e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:00.778966 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-922eb695-c648-4c04-8610-395c73479a4e tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa" status: 200 len: 1374 microversion: 2.1 time: 0.398798 Aug 24 10:49:00.795146 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-f1118a1f-5322-4665-add9-a01fe05f031c req-662c3cbe-b366-4c99-98d2-5f7464dc6a8b service nova] Creating event network-vif-plugged:dd14f6d8-77eb-4af1-a3cf-7f59206343cc for instance 5c094722-159c-4fb8-ae06-e73ae16da2aa on n-h2-849328-3 Aug 24 10:49:00.796541 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3075/5809] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:00 2022] GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa => generated 1374 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:00.809318 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-f1118a1f-5322-4665-add9-a01fe05f031c req-662c3cbe-b366-4c99-98d2-5f7464dc6a8b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092409 Aug 24 10:49:00.811767 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2735/5810] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:49:01.815279 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5a570c61-3862-4be0-b677-7771224fa2ff tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:01.816692 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5a570c61-3862-4be0-b677-7771224fa2ff tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 5c094722-159c-4fb8-ae06-e73ae16da2aa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:01.831468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a570c61-3862-4be0-b677-7771224fa2ff tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:01.831893 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a570c61-3862-4be0-b677-7771224fa2ff tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:01.832338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a570c61-3862-4be0-b677-7771224fa2ff tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:01.833113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a570c61-3862-4be0-b677-7771224fa2ff tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:01.833600 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a570c61-3862-4be0-b677-7771224fa2ff tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:01.839385 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a570c61-3862-4be0-b677-7771224fa2ff tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:02.184756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5a570c61-3862-4be0-b677-7771224fa2ff tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:02.195029 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5a570c61-3862-4be0-b677-7771224fa2ff tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa" status: 200 len: 1374 microversion: 2.1 time: 0.394026 Aug 24 10:49:02.209593 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3076/5811] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:01 2022] GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa => generated 1374 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:03.218426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2ef486f1-f308-4970-81e2-c70d7882a7fd tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:03.219140 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2ef486f1-f308-4970-81e2-c70d7882a7fd tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 5c094722-159c-4fb8-ae06-e73ae16da2aa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:03.237044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ef486f1-f308-4970-81e2-c70d7882a7fd tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:03.237563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ef486f1-f308-4970-81e2-c70d7882a7fd tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:03.238165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ef486f1-f308-4970-81e2-c70d7882a7fd tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:03.239003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ef486f1-f308-4970-81e2-c70d7882a7fd tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:03.239466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ef486f1-f308-4970-81e2-c70d7882a7fd tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:03.241990 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ef486f1-f308-4970-81e2-c70d7882a7fd tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:03.427803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2ef486f1-f308-4970-81e2-c70d7882a7fd tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:03.440772 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2ef486f1-f308-4970-81e2-c70d7882a7fd tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa" status: 200 len: 1546 microversion: 2.1 time: 0.227683 Aug 24 10:49:03.441560 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2736/5812] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:03 2022] GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa => generated 1546 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:03.466581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ef44da8-efda-40c4-9481-f352b5544080 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:03.467238 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8ef44da8-efda-40c4-9481-f352b5544080 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 5c094722-159c-4fb8-ae06-e73ae16da2aa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:03.508692 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ef44da8-efda-40c4-9481-f352b5544080 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:03.509269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ef44da8-efda-40c4-9481-f352b5544080 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:03.509724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ef44da8-efda-40c4-9481-f352b5544080 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:03.512807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ef44da8-efda-40c4-9481-f352b5544080 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:03.513031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ef44da8-efda-40c4-9481-f352b5544080 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:03.513453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ef44da8-efda-40c4-9481-f352b5544080 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:03.848518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8ef44da8-efda-40c4-9481-f352b5544080 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:03.858932 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8ef44da8-efda-40c4-9481-f352b5544080 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa" status: 200 len: 1546 microversion: 2.1 time: 0.398450 Aug 24 10:49:03.859912 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3077/5813] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:03 2022] GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa => generated 1546 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:06.981923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-4faeda33-57c9-447b-99f9-566a1ad4c6fb req-374983fa-6d3c-4607-998a-f722d40f3c1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c094722-159c-4fb8-ae06-e73ae16da2aa", "tag": "dd14f6d8-77eb-4af1-a3cf-7f59206343cc"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:49:07.008383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4faeda33-57c9-447b-99f9-566a1ad4c6fb req-374983fa-6d3c-4607-998a-f722d40f3c1b service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:07.008927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4faeda33-57c9-447b-99f9-566a1ad4c6fb req-374983fa-6d3c-4607-998a-f722d40f3c1b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:07.009771 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4faeda33-57c9-447b-99f9-566a1ad4c6fb req-374983fa-6d3c-4607-998a-f722d40f3c1b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:07.065280 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-4faeda33-57c9-447b-99f9-566a1ad4c6fb req-374983fa-6d3c-4607-998a-f722d40f3c1b service nova] Creating event network-changed:dd14f6d8-77eb-4af1-a3cf-7f59206343cc for instance 5c094722-159c-4fb8-ae06-e73ae16da2aa on n-h2-849328-3 Aug 24 10:49:07.073056 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-4faeda33-57c9-447b-99f9-566a1ad4c6fb req-374983fa-6d3c-4607-998a-f722d40f3c1b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096342 Aug 24 10:49:07.074410 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2737/5814] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:49:07.955933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-176ffad0-9942-4e7f-9579-b33d6117f1cd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1313934927", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "137aaca6-8852-4c93-8cf7-8e5569c21f09"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2110511473", "security_groups": [{"name": "tempest-secgroup-smoke-347298371"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:49:08.290301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-176ffad0-9942-4e7f-9579-b33d6117f1cd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] validate_networks() for [('137aaca6-8852-4c93-8cf7-8e5569c21f09', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:49:09.014177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-176ffad0-9942-4e7f-9579-b33d6117f1cd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:49:09.014821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-176ffad0-9942-4e7f-9579-b33d6117f1cd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:49:09.015121 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-176ffad0-9942-4e7f-9579-b33d6117f1cd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:49:09.015695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-176ffad0-9942-4e7f-9579-b33d6117f1cd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:49:09.016287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-176ffad0-9942-4e7f-9579-b33d6117f1cd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:49:09.029220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-176ffad0-9942-4e7f-9579-b33d6117f1cd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:09.032206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-176ffad0-9942-4e7f-9579-b33d6117f1cd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:09.037874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-176ffad0-9942-4e7f-9579-b33d6117f1cd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:09.038949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-176ffad0-9942-4e7f-9579-b33d6117f1cd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:09.039748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-176ffad0-9942-4e7f-9579-b33d6117f1cd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:09.040393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-176ffad0-9942-4e7f-9579-b33d6117f1cd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:09.079489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-176ffad0-9942-4e7f-9579-b33d6117f1cd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Getting quotas for project de650d3c897a409dbf54c32bfd45d672. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:49:09.094474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-176ffad0-9942-4e7f-9579-b33d6117f1cd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Getting quotas for user 127a30846ae64f268baf7f3231b84273 and project de650d3c897a409dbf54c32bfd45d672. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:49:09.124971 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-176ffad0-9942-4e7f-9579-b33d6117f1cd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:49:09.127374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-176ffad0-9942-4e7f-9579-b33d6117f1cd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:49:09.219675 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-176ffad0-9942-4e7f-9579-b33d6117f1cd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.268610 Aug 24 10:49:09.220817 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3078/5815] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:49:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 1270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:49:09.228672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=16 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:09.233915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9ea498b5-db2b-45e7-829d-68b38f3dfa6d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:09.234633 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9ea498b5-db2b-45e7-829d-68b38f3dfa6d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:09.365965 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9ea498b5-db2b-45e7-829d-68b38f3dfa6d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:09.375657 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9ea498b5-db2b-45e7-829d-68b38f3dfa6d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1267 microversion: 2.1 time: 0.147796 Aug 24 10:49:09.378134 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2738/5816] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:09 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:10.402839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9c592f12-a2c4-4952-b3f8-612f04a75de3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:10.403570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9c592f12-a2c4-4952-b3f8-612f04a75de3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:10.484473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9c592f12-a2c4-4952-b3f8-612f04a75de3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:10.508936 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9c592f12-a2c4-4952-b3f8-612f04a75de3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1267 microversion: 2.1 time: 0.110833 Aug 24 10:49:10.510868 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3079/5817] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:10 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1267 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:11.533487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-780dd8e5-a523-43fd-9075-85905b698cb5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:11.539080 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-780dd8e5-a523-43fd-9075-85905b698cb5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:11.553017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-780dd8e5-a523-43fd-9075-85905b698cb5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:11.553550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-780dd8e5-a523-43fd-9075-85905b698cb5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:11.553989 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-780dd8e5-a523-43fd-9075-85905b698cb5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:11.555616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-780dd8e5-a523-43fd-9075-85905b698cb5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:11.556435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-780dd8e5-a523-43fd-9075-85905b698cb5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:11.556895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-780dd8e5-a523-43fd-9075-85905b698cb5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:11.658003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-780dd8e5-a523-43fd-9075-85905b698cb5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:11.671176 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-780dd8e5-a523-43fd-9075-85905b698cb5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1325 microversion: 2.1 time: 0.142178 Aug 24 10:49:11.671917 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2739/5818] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:11 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1325 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:12.694375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ab298ae-71f6-4287-a216-05509af21dc7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:12.697114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3ab298ae-71f6-4287-a216-05509af21dc7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:12.706711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ab298ae-71f6-4287-a216-05509af21dc7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:12.707705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ab298ae-71f6-4287-a216-05509af21dc7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:12.708158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ab298ae-71f6-4287-a216-05509af21dc7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:12.709947 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ab298ae-71f6-4287-a216-05509af21dc7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:12.709947 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ab298ae-71f6-4287-a216-05509af21dc7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:12.710694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ab298ae-71f6-4287-a216-05509af21dc7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:12.716477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=84 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:12.917746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3ab298ae-71f6-4287-a216-05509af21dc7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:12.929351 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ab298ae-71f6-4287-a216-05509af21dc7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1392 microversion: 2.1 time: 0.240724 Aug 24 10:49:12.930458 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3080/5819] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:12 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1392 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:13.311872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-627539d1-003d-4a5f-ae84-ae35d97308f3 req-5b4b38b1-2f97-4911-a128-7bb9f02c7e70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef0933a3-a042-41c2-a901-172e9c89dd03", "tag": "7d58f5cd-e9e0-4d8a-a4f6-61ac70ae8a3c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:49:13.332712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-627539d1-003d-4a5f-ae84-ae35d97308f3 req-5b4b38b1-2f97-4911-a128-7bb9f02c7e70 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:13.334117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-627539d1-003d-4a5f-ae84-ae35d97308f3 req-5b4b38b1-2f97-4911-a128-7bb9f02c7e70 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:13.334693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-627539d1-003d-4a5f-ae84-ae35d97308f3 req-5b4b38b1-2f97-4911-a128-7bb9f02c7e70 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:13.351503 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-627539d1-003d-4a5f-ae84-ae35d97308f3 req-5b4b38b1-2f97-4911-a128-7bb9f02c7e70 service nova] Creating event network-changed:7d58f5cd-e9e0-4d8a-a4f6-61ac70ae8a3c for instance ef0933a3-a042-41c2-a901-172e9c89dd03 on n-h1-849328-3 Aug 24 10:49:13.359520 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-627539d1-003d-4a5f-ae84-ae35d97308f3 req-5b4b38b1-2f97-4911-a128-7bb9f02c7e70 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054110 Aug 24 10:49:13.361622 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2740/5820] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:49:13.955149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5e0e7e5e-1f0c-49ca-855a-36ec1e8fe5a1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:13.956570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5e0e7e5e-1f0c-49ca-855a-36ec1e8fe5a1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:13.966371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e0e7e5e-1f0c-49ca-855a-36ec1e8fe5a1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:13.967249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e0e7e5e-1f0c-49ca-855a-36ec1e8fe5a1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:13.968022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e0e7e5e-1f0c-49ca-855a-36ec1e8fe5a1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:13.969212 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e0e7e5e-1f0c-49ca-855a-36ec1e8fe5a1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:13.969888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e0e7e5e-1f0c-49ca-855a-36ec1e8fe5a1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:13.970547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e0e7e5e-1f0c-49ca-855a-36ec1e8fe5a1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:14.169759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5e0e7e5e-1f0c-49ca-855a-36ec1e8fe5a1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:14.179321 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5e0e7e5e-1f0c-49ca-855a-36ec1e8fe5a1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1392 microversion: 2.1 time: 0.229021 Aug 24 10:49:14.179959 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3081/5821] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:13 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1392 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:15.207516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fe025225-0809-46e6-8b07-1aae5f8f61a5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:15.208589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fe025225-0809-46e6-8b07-1aae5f8f61a5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:15.222297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe025225-0809-46e6-8b07-1aae5f8f61a5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:15.222794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe025225-0809-46e6-8b07-1aae5f8f61a5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:15.223229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe025225-0809-46e6-8b07-1aae5f8f61a5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:15.223935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe025225-0809-46e6-8b07-1aae5f8f61a5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:15.224391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe025225-0809-46e6-8b07-1aae5f8f61a5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:15.224811 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe025225-0809-46e6-8b07-1aae5f8f61a5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:15.491290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fe025225-0809-46e6-8b07-1aae5f8f61a5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:15.502517 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fe025225-0809-46e6-8b07-1aae5f8f61a5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1392 microversion: 2.1 time: 0.305197 Aug 24 10:49:15.517112 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2741/5822] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:15 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1392 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:16.525921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6f8177ec-1871-4538-81a7-19379f796dba tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:16.526780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6f8177ec-1871-4538-81a7-19379f796dba tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:16.550044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f8177ec-1871-4538-81a7-19379f796dba tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:16.550572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f8177ec-1871-4538-81a7-19379f796dba tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:16.551112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f8177ec-1871-4538-81a7-19379f796dba tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:16.552219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f8177ec-1871-4538-81a7-19379f796dba tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:16.552983 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f8177ec-1871-4538-81a7-19379f796dba tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:16.553647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f8177ec-1871-4538-81a7-19379f796dba tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:16.736781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6f8177ec-1871-4538-81a7-19379f796dba tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:16.748005 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6f8177ec-1871-4538-81a7-19379f796dba tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1392 microversion: 2.1 time: 0.227312 Aug 24 10:49:16.749998 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3082/5823] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:16 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1392 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:17.772457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5a23023b-a1c2-40b7-a125-b57b2d5c7bd9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:17.776163 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5a23023b-a1c2-40b7-a125-b57b2d5c7bd9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:17.783313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a23023b-a1c2-40b7-a125-b57b2d5c7bd9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:17.784028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a23023b-a1c2-40b7-a125-b57b2d5c7bd9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:17.784464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a23023b-a1c2-40b7-a125-b57b2d5c7bd9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:17.785192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a23023b-a1c2-40b7-a125-b57b2d5c7bd9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:17.785644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a23023b-a1c2-40b7-a125-b57b2d5c7bd9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:17.786065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a23023b-a1c2-40b7-a125-b57b2d5c7bd9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:17.953528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5a23023b-a1c2-40b7-a125-b57b2d5c7bd9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:17.964871 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5a23023b-a1c2-40b7-a125-b57b2d5c7bd9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1392 microversion: 2.1 time: 0.196142 Aug 24 10:49:17.965880 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2742/5824] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:17 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1392 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:18.850935 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-141e8582-0ed4-4009-85c8-91bb25bfc5b9 req-278cfe10-50e7-41d6-b4bc-d0878740e337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0933a3-a042-41c2-a901-172e9c89dd03", "name": "network-vif-plugged", "status": "completed", "tag": "7d58f5cd-e9e0-4d8a-a4f6-61ac70ae8a3c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:49:18.869856 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-141e8582-0ed4-4009-85c8-91bb25bfc5b9 req-278cfe10-50e7-41d6-b4bc-d0878740e337 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:18.872541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-141e8582-0ed4-4009-85c8-91bb25bfc5b9 req-278cfe10-50e7-41d6-b4bc-d0878740e337 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:18.873608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-141e8582-0ed4-4009-85c8-91bb25bfc5b9 req-278cfe10-50e7-41d6-b4bc-d0878740e337 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:18.897692 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-141e8582-0ed4-4009-85c8-91bb25bfc5b9 req-278cfe10-50e7-41d6-b4bc-d0878740e337 service nova] Creating event network-vif-plugged:7d58f5cd-e9e0-4d8a-a4f6-61ac70ae8a3c for instance ef0933a3-a042-41c2-a901-172e9c89dd03 on n-h1-849328-3 Aug 24 10:49:18.909041 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-141e8582-0ed4-4009-85c8-91bb25bfc5b9 req-278cfe10-50e7-41d6-b4bc-d0878740e337 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062709 Aug 24 10:49:18.910134 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3083/5825] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:49:18.987024 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8dd420c0-6c58-4fff-ba15-c11aca33ad3f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:18.987683 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8dd420c0-6c58-4fff-ba15-c11aca33ad3f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:19.001170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dd420c0-6c58-4fff-ba15-c11aca33ad3f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:19.001905 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dd420c0-6c58-4fff-ba15-c11aca33ad3f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:19.002546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dd420c0-6c58-4fff-ba15-c11aca33ad3f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:19.003507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dd420c0-6c58-4fff-ba15-c11aca33ad3f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:19.004537 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dd420c0-6c58-4fff-ba15-c11aca33ad3f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:19.005414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dd420c0-6c58-4fff-ba15-c11aca33ad3f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:19.219272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8dd420c0-6c58-4fff-ba15-c11aca33ad3f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:19.228559 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8dd420c0-6c58-4fff-ba15-c11aca33ad3f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1392 microversion: 2.1 time: 0.246549 Aug 24 10:49:19.229247 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2743/5826] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:18 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1392 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:20.255230 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:20.261306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6cccb5cc-235f-492e-a79f-bb07f37ac4b5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:20.262137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6cccb5cc-235f-492e-a79f-bb07f37ac4b5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:20.270055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cccb5cc-235f-492e-a79f-bb07f37ac4b5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:20.270756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cccb5cc-235f-492e-a79f-bb07f37ac4b5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:20.271750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cccb5cc-235f-492e-a79f-bb07f37ac4b5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:20.272747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cccb5cc-235f-492e-a79f-bb07f37ac4b5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:20.273365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cccb5cc-235f-492e-a79f-bb07f37ac4b5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:20.273929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cccb5cc-235f-492e-a79f-bb07f37ac4b5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:20.469287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6cccb5cc-235f-492e-a79f-bb07f37ac4b5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:20.477828 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6cccb5cc-235f-492e-a79f-bb07f37ac4b5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1392 microversion: 2.1 time: 0.223549 Aug 24 10:49:20.478937 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3084/5827] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:20 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1392 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:21.500093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-89ababca-5673-4b90-bf7d-3b66bdf77340 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:21.501053 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-89ababca-5673-4b90-bf7d-3b66bdf77340 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:21.505312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:21.510510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89ababca-5673-4b90-bf7d-3b66bdf77340 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:21.511592 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89ababca-5673-4b90-bf7d-3b66bdf77340 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:21.512427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89ababca-5673-4b90-bf7d-3b66bdf77340 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:21.513672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89ababca-5673-4b90-bf7d-3b66bdf77340 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:21.514305 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89ababca-5673-4b90-bf7d-3b66bdf77340 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:21.516013 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89ababca-5673-4b90-bf7d-3b66bdf77340 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:21.743884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-89ababca-5673-4b90-bf7d-3b66bdf77340 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:21.760252 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-89ababca-5673-4b90-bf7d-3b66bdf77340 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1563 microversion: 2.1 time: 0.263544 Aug 24 10:49:21.762064 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2744/5828] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:21 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1563 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:21.799336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-28b6caec-ccdf-46bd-8d16-74e99d897805 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:21.800493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-28b6caec-ccdf-46bd-8d16-74e99d897805 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:21.805563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:21.815423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28b6caec-ccdf-46bd-8d16-74e99d897805 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:21.816623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28b6caec-ccdf-46bd-8d16-74e99d897805 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:21.817525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28b6caec-ccdf-46bd-8d16-74e99d897805 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:21.818900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28b6caec-ccdf-46bd-8d16-74e99d897805 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:21.819894 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28b6caec-ccdf-46bd-8d16-74e99d897805 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:21.820758 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28b6caec-ccdf-46bd-8d16-74e99d897805 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:22.042138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-28b6caec-ccdf-46bd-8d16-74e99d897805 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:22.050366 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-28b6caec-ccdf-46bd-8d16-74e99d897805 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1563 microversion: 2.1 time: 0.258223 Aug 24 10:49:22.050969 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3085/5829] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:21 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1563 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:24.067759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-22d408c7-6269-432b-850a-f58f4b8c270d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:24.068454 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-22d408c7-6269-432b-850a-f58f4b8c270d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:24.083054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22d408c7-6269-432b-850a-f58f4b8c270d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:24.083555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22d408c7-6269-432b-850a-f58f4b8c270d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:24.084057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22d408c7-6269-432b-850a-f58f4b8c270d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:24.086097 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22d408c7-6269-432b-850a-f58f4b8c270d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:24.086880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22d408c7-6269-432b-850a-f58f4b8c270d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:24.089213 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22d408c7-6269-432b-850a-f58f4b8c270d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:24.093977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=58 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:24.290332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-22d408c7-6269-432b-850a-f58f4b8c270d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:24.299054 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-22d408c7-6269-432b-850a-f58f4b8c270d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1563 microversion: 2.1 time: 0.235187 Aug 24 10:49:24.300070 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2745/5830] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:24 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1563 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:24.305404 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-59a92609-fc5d-45fb-8ca9-0533bd7240f8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:24.308554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-59a92609-fc5d-45fb-8ca9-0533bd7240f8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:24.331715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59a92609-fc5d-45fb-8ca9-0533bd7240f8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:24.332550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59a92609-fc5d-45fb-8ca9-0533bd7240f8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:24.333373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59a92609-fc5d-45fb-8ca9-0533bd7240f8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:24.335287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59a92609-fc5d-45fb-8ca9-0533bd7240f8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:24.336033 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59a92609-fc5d-45fb-8ca9-0533bd7240f8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:24.336672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59a92609-fc5d-45fb-8ca9-0533bd7240f8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:24.380662 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a32e0556-abf6-497a-b4df-1a688ef456ce req-2a6b0b13-9e8d-4898-a7ba-951b3ae2ecc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef0933a3-a042-41c2-a901-172e9c89dd03", "tag": "7d58f5cd-e9e0-4d8a-a4f6-61ac70ae8a3c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:49:24.396691 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-59a92609-fc5d-45fb-8ca9-0533bd7240f8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.095301 Aug 24 10:49:24.400940 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2746/5831] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:49:24 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:49:24.403753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a32e0556-abf6-497a-b4df-1a688ef456ce req-2a6b0b13-9e8d-4898-a7ba-951b3ae2ecc2 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:24.404253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a32e0556-abf6-497a-b4df-1a688ef456ce req-2a6b0b13-9e8d-4898-a7ba-951b3ae2ecc2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:24.404695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a32e0556-abf6-497a-b4df-1a688ef456ce req-2a6b0b13-9e8d-4898-a7ba-951b3ae2ecc2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:24.430623 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a32e0556-abf6-497a-b4df-1a688ef456ce req-2a6b0b13-9e8d-4898-a7ba-951b3ae2ecc2 service nova] Creating event network-changed:7d58f5cd-e9e0-4d8a-a4f6-61ac70ae8a3c for instance ef0933a3-a042-41c2-a901-172e9c89dd03 on n-h1-849328-3 Aug 24 10:49:24.443805 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a32e0556-abf6-497a-b4df-1a688ef456ce req-2a6b0b13-9e8d-4898-a7ba-951b3ae2ecc2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.366938 Aug 24 10:49:24.445169 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3086/5832] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:49:24.475532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d9cdd9f5-a256-4115-941b-f1b3784fbeaa tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:24.476046 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d9cdd9f5-a256-4115-941b-f1b3784fbeaa tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:24.482820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9cdd9f5-a256-4115-941b-f1b3784fbeaa tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:24.483567 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9cdd9f5-a256-4115-941b-f1b3784fbeaa tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:24.484230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9cdd9f5-a256-4115-941b-f1b3784fbeaa tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:24.484960 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9cdd9f5-a256-4115-941b-f1b3784fbeaa tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:24.485456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9cdd9f5-a256-4115-941b-f1b3784fbeaa tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:24.485886 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9cdd9f5-a256-4115-941b-f1b3784fbeaa tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:24.530222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d9cdd9f5-a256-4115-941b-f1b3784fbeaa tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:49:24.637618 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d9cdd9f5-a256-4115-941b-f1b3784fbeaa tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "DELETE /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 204 len: 0 microversion: 2.1 time: 0.165756 Aug 24 10:49:24.638956 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2747/5833] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:49:24 2022] DELETE /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:49:24.648262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-78fa6093-333b-49b3-8d55-d1718a017ab5 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:24.649524 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-78fa6093-333b-49b3-8d55-d1718a017ab5 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:24.663638 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78fa6093-333b-49b3-8d55-d1718a017ab5 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:24.666557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78fa6093-333b-49b3-8d55-d1718a017ab5 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:24.667203 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78fa6093-333b-49b3-8d55-d1718a017ab5 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:24.668175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78fa6093-333b-49b3-8d55-d1718a017ab5 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:24.669375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78fa6093-333b-49b3-8d55-d1718a017ab5 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:24.670032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78fa6093-333b-49b3-8d55-d1718a017ab5 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:24.922420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-78fa6093-333b-49b3-8d55-d1718a017ab5 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:24.932572 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-78fa6093-333b-49b3-8d55-d1718a017ab5 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1675 microversion: 2.1 time: 0.288933 Aug 24 10:49:24.933954 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3087/5834] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:24 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1675 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:49:25.955904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e23592c4-bdb1-4c1b-a217-d0634dffba46 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:25.956611 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e23592c4-bdb1-4c1b-a217-d0634dffba46 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:25.963989 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e23592c4-bdb1-4c1b-a217-d0634dffba46 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:25.964709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e23592c4-bdb1-4c1b-a217-d0634dffba46 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:25.965358 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e23592c4-bdb1-4c1b-a217-d0634dffba46 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:25.968762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e23592c4-bdb1-4c1b-a217-d0634dffba46 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:25.968762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e23592c4-bdb1-4c1b-a217-d0634dffba46 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:25.968762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e23592c4-bdb1-4c1b-a217-d0634dffba46 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:26.113996 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e23592c4-bdb1-4c1b-a217-d0634dffba46 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:26.122357 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e23592c4-bdb1-4c1b-a217-d0634dffba46 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1675 microversion: 2.1 time: 0.171175 Aug 24 10:49:26.123183 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2748/5835] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:25 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1675 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:27.148128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3c7e0655-5885-41ab-862f-9a7c9c25bc10 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:27.148797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3c7e0655-5885-41ab-862f-9a7c9c25bc10 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:27.156902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c7e0655-5885-41ab-862f-9a7c9c25bc10 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:27.157511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c7e0655-5885-41ab-862f-9a7c9c25bc10 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:27.162464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c7e0655-5885-41ab-862f-9a7c9c25bc10 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:27.163478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c7e0655-5885-41ab-862f-9a7c9c25bc10 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:27.164388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c7e0655-5885-41ab-862f-9a7c9c25bc10 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:27.164991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c7e0655-5885-41ab-862f-9a7c9c25bc10 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:27.342856 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3c7e0655-5885-41ab-862f-9a7c9c25bc10 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:27.351257 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3c7e0655-5885-41ab-862f-9a7c9c25bc10 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1675 microversion: 2.1 time: 0.209316 Aug 24 10:49:27.353599 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3088/5836] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:27 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1675 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:49:28.358340 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-df0b2dfc-e4c9-4a6e-9c2d-997731b1ba53 req-beea4ead-5314-4f31-b116-c831861de6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46ecd5ee-6e65-441c-b75e-941757d51a02", "name": "network-vif-deleted", "tag": "ebd92acf-1a09-43c5-9f1b-7347cd1cbc5e"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:49:28.372273 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-df0b2dfc-e4c9-4a6e-9c2d-997731b1ba53 req-beea4ead-5314-4f31-b116-c831861de6d8 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:28.373110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-df0b2dfc-e4c9-4a6e-9c2d-997731b1ba53 req-beea4ead-5314-4f31-b116-c831861de6d8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:28.373781 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-df0b2dfc-e4c9-4a6e-9c2d-997731b1ba53 req-beea4ead-5314-4f31-b116-c831861de6d8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:28.377180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-09be5cbf-1e05-480b-92e0-9cc864f7bbb8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:28.377867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-09be5cbf-1e05-480b-92e0-9cc864f7bbb8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:28.391618 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-df0b2dfc-e4c9-4a6e-9c2d-997731b1ba53 req-beea4ead-5314-4f31-b116-c831861de6d8 service nova] Creating event network-vif-deleted:ebd92acf-1a09-43c5-9f1b-7347cd1cbc5e for instance 46ecd5ee-6e65-441c-b75e-941757d51a02 on n-h1-849328-3 Aug 24 10:49:28.396573 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09be5cbf-1e05-480b-92e0-9cc864f7bbb8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:28.397166 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09be5cbf-1e05-480b-92e0-9cc864f7bbb8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:28.397695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09be5cbf-1e05-480b-92e0-9cc864f7bbb8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:28.398450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09be5cbf-1e05-480b-92e0-9cc864f7bbb8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:28.398928 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09be5cbf-1e05-480b-92e0-9cc864f7bbb8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:28.399690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09be5cbf-1e05-480b-92e0-9cc864f7bbb8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:28.404604 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-df0b2dfc-e4c9-4a6e-9c2d-997731b1ba53 req-beea4ead-5314-4f31-b116-c831861de6d8 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049784 Aug 24 10:49:28.406951 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2749/5837] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:49:28.544383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-09be5cbf-1e05-480b-92e0-9cc864f7bbb8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:28.560982 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-09be5cbf-1e05-480b-92e0-9cc864f7bbb8 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 200 len: 1607 microversion: 2.1 time: 0.188763 Aug 24 10:49:28.561690 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3089/5838] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:28 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 1607 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:29.587019 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5a8514a2-82fb-495c-939a-787fe448f487 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:29.588471 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5a8514a2-82fb-495c-939a-787fe448f487 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:29.591621 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:29.597397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a8514a2-82fb-495c-939a-787fe448f487 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:29.597928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a8514a2-82fb-495c-939a-787fe448f487 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:29.598374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a8514a2-82fb-495c-939a-787fe448f487 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:29.599116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a8514a2-82fb-495c-939a-787fe448f487 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:29.599578 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a8514a2-82fb-495c-939a-787fe448f487 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:29.600006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a8514a2-82fb-495c-939a-787fe448f487 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:29.617344 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-5a8514a2-82fb-495c-939a-787fe448f487 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] HTTP exception thrown: Instance 46ecd5ee-6e65-441c-b75e-941757d51a02 could not be found. Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5a8514a2-82fb-495c-939a-787fe448f487 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Request method failure captured: Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 HTTP/1.1 Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgFkzbIq2WrP4XPrOqfbES6EewMHqJBat38dnsnx4ujeYbEVK2L2EsonSXp3WIMjmBkNTfVKqRIjP4hMhhaT8f4g_4xWjRHQ6URyNlLOZQPImplwGYuAZcyT8-6h_iZD6jH9DZg_laBnlv2OMRGP7SPNIlCiKBrlvkvRi7rcFst-VqM Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: e6b6540f9c574be7b4d1e3aa058938f9 Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachVolumeTestJSON-288981867 Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6b6540f9c574be7b4d1e3aa058938f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e6b6540f9c574be7b4d1e3aa058938f9", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6b6540f9c574be7b4d1e3aa058938f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e6b6540f9c574be7b4d1e3aa058938f9"}]}] Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-AttachVolumeTestJSON-288981867 Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: e6b6540f9c574be7b4d1e3aa058938f9 Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachVolumeTestJSON-288981867 Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-AttachVolumeTestJSON-288981867-project Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 13a31e5adc8a4a8b89a9031714ae0496 Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-AttachVolumeTestJSON-288981867-project Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 46ecd5ee-6e65-441c-b75e-941757d51a02 could not be found. Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '46ecd5ee-6e65-441c-b75e-941757d51a02'} Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46ecd5ee-6e65-441c-b75e-941757d51a02 could not be found. Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46ecd5ee-6e65-441c-b75e-941757d51a02 could not be found. Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:49:29.619339 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:49:29.623126 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:49:29.623126 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:49:29.623126 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:49:29.623126 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:49:29.623126 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:49:29.623126 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46ecd5ee-6e65-441c-b75e-941757d51a02 could not be found. Aug 24 10:49:29.623126 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:49:29.623126 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5a8514a2-82fb-495c-939a-787fe448f487 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Returning 404 to user: Instance 46ecd5ee-6e65-441c-b75e-941757d51a02 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:49:29.623733 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5a8514a2-82fb-495c-939a-787fe448f487 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 404 len: 111 microversion: 2.1 time: 0.041235 Aug 24 10:49:29.629110 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2750/5839] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:29 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:49:29.633534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-36f2686b-9555-477f-8755-24254b9f261d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '.version_select at 0x7f465a1bd430>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:29.654807 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-36f2686b-9555-477f-8755-24254b9f261d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1399095480" status: 202 len: 0 microversion: 2.1 time: 0.025571 Aug 24 10:49:29.658884 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3090/5840] 10.222.0.85 () {58 vars in 1221 bytes} [Wed Aug 24 10:49:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1399095480 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:49:30.717938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b089d3cd-ced8-4394-a427-01bd1e1671c6 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:49:30.717938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b089d3cd-ced8-4394-a427-01bd1e1671c6 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 5c094722-159c-4fb8-ae06-e73ae16da2aa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:30.727332 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bf757add-cd55-47ca-b84e-5804432a7586 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Action: 'create', calling method: .version_select at 0x7f465a2074c0>, body: {"keypair": {"name": "tempest-keypair-2006058402", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdL/REX19PNWrGx3Tycnj66Ck9dtjX1nN3j8V4i7KCl4cFiMrQHwSHRd2BXkPMoxBzVJQFO9Or0TJnCFFYMLhGNHQDSjK5XRk76qTgMzJLYPrUNBZ7i3H3SDm0ze1WtnQ=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:49:30.731602 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b089d3cd-ced8-4394-a427-01bd1e1671c6 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:30.732102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b089d3cd-ced8-4394-a427-01bd1e1671c6 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:30.732767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b089d3cd-ced8-4394-a427-01bd1e1671c6 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:30.740213 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:30.749192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b089d3cd-ced8-4394-a427-01bd1e1671c6 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:30.749692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b089d3cd-ced8-4394-a427-01bd1e1671c6 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:30.750128 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b089d3cd-ced8-4394-a427-01bd1e1671c6 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:30.756691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-bf757add-cd55-47ca-b84e-5804432a7586 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Getting quotas for project e6b6540f9c574be7b4d1e3aa058938f9. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:49:30.763051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-bf757add-cd55-47ca-b84e-5804432a7586 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Getting quotas for user 13a31e5adc8a4a8b89a9031714ae0496 and project e6b6540f9c574be7b4d1e3aa058938f9. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:49:30.793342 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bf757add-cd55-47ca-b84e-5804432a7586 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.072142 Aug 24 10:49:30.793970 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3091/5841] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:49:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:49:30.823930 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b089d3cd-ced8-4394-a427-01bd1e1671c6 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "POST /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa/action" status: 200 len: 24575 microversion: 2.1 time: 0.114494 Aug 24 10:49:30.831542 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2751/5842] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:49:30 2022] POST /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa/action => generated 24575 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:49:32.389866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ec24d8d-6ee2-43f2-ad0b-dc0eec41a6fc tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-177036703", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d2342762-930c-4062-9d55-9242a18d3dd8"}], "security_groups": [{"name": "tempest-securitygroup--1467334021"}], "key_name": "tempest-keypair-2006058402", "user_data": "}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:49:32.557517 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-4ec24d8d-6ee2-43f2-ad0b-dc0eec41a6fc tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] validate_networks() for [('d2342762-930c-4062-9d55-9242a18d3dd8', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:49:33.058772 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-4ec24d8d-6ee2-43f2-ad0b-dc0eec41a6fc tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:49:33.059203 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-4ec24d8d-6ee2-43f2-ad0b-dc0eec41a6fc tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:49:33.059682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-4ec24d8d-6ee2-43f2-ad0b-dc0eec41a6fc tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:49:33.060099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-4ec24d8d-6ee2-43f2-ad0b-dc0eec41a6fc tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:49:33.060531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-4ec24d8d-6ee2-43f2-ad0b-dc0eec41a6fc tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:49:33.070331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ec24d8d-6ee2-43f2-ad0b-dc0eec41a6fc tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:33.070845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ec24d8d-6ee2-43f2-ad0b-dc0eec41a6fc tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:33.071272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ec24d8d-6ee2-43f2-ad0b-dc0eec41a6fc tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:33.072052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ec24d8d-6ee2-43f2-ad0b-dc0eec41a6fc tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:33.072511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ec24d8d-6ee2-43f2-ad0b-dc0eec41a6fc tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:33.073330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ec24d8d-6ee2-43f2-ad0b-dc0eec41a6fc tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:33.093052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-4ec24d8d-6ee2-43f2-ad0b-dc0eec41a6fc tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Getting quotas for project e6b6540f9c574be7b4d1e3aa058938f9. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:49:33.099532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-4ec24d8d-6ee2-43f2-ad0b-dc0eec41a6fc tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Getting quotas for user 13a31e5adc8a4a8b89a9031714ae0496 and project e6b6540f9c574be7b4d1e3aa058938f9. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:49:33.113955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4ec24d8d-6ee2-43f2-ad0b-dc0eec41a6fc tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:49:33.116525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4ec24d8d-6ee2-43f2-ad0b-dc0eec41a6fc tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:49:33.183496 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4ec24d8d-6ee2-43f2-ad0b-dc0eec41a6fc tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.801902 Aug 24 10:49:33.184203 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3092/5843] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:49:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:49:33.203940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6ed224c7-9035-4df8-b80e-505e00f1763e tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:33.205018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6ed224c7-9035-4df8-b80e-505e00f1763e tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:33.303470 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6ed224c7-9035-4df8-b80e-505e00f1763e tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:33.312771 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6ed224c7-9035-4df8-b80e-505e00f1763e tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece" status: 200 len: 1237 microversion: 2.1 time: 0.119259 Aug 24 10:49:33.313728 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2752/5844] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:33 2022] GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece => generated 1237 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:34.340715 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3a7ab7ac-a036-467a-9623-336a7493f869 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:34.344854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3a7ab7ac-a036-467a-9623-336a7493f869 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:34.357824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a7ab7ac-a036-467a-9623-336a7493f869 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:34.358587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a7ab7ac-a036-467a-9623-336a7493f869 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:34.359566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a7ab7ac-a036-467a-9623-336a7493f869 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:34.361107 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a7ab7ac-a036-467a-9623-336a7493f869 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:34.363425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a7ab7ac-a036-467a-9623-336a7493f869 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:34.364346 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a7ab7ac-a036-467a-9623-336a7493f869 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:34.474240 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3a7ab7ac-a036-467a-9623-336a7493f869 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:34.485417 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3a7ab7ac-a036-467a-9623-336a7493f869 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece" status: 200 len: 1289 microversion: 2.1 time: 0.152515 Aug 24 10:49:34.497881 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3093/5845] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:34 2022] GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece => generated 1289 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:35.510536 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-873668f6-ee9d-4ac1-8454-bf97a09fa862 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:35.511384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-873668f6-ee9d-4ac1-8454-bf97a09fa862 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:35.519209 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-873668f6-ee9d-4ac1-8454-bf97a09fa862 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:35.520048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-873668f6-ee9d-4ac1-8454-bf97a09fa862 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:35.520577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-873668f6-ee9d-4ac1-8454-bf97a09fa862 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:35.521591 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-873668f6-ee9d-4ac1-8454-bf97a09fa862 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:35.522211 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-873668f6-ee9d-4ac1-8454-bf97a09fa862 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:35.522789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-873668f6-ee9d-4ac1-8454-bf97a09fa862 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:35.775178 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-873668f6-ee9d-4ac1-8454-bf97a09fa862 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:35.786830 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-873668f6-ee9d-4ac1-8454-bf97a09fa862 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece" status: 200 len: 1363 microversion: 2.1 time: 0.280931 Aug 24 10:49:35.788636 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2753/5846] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:35 2022] GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:36.802953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-ec0763da-6551-42a5-b478-8db9dbfdf65a req-277d5fcc-12a7-40c2-a0e4-afbc7b43b7cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7adbdc60-ef19-4434-bfc2-2c3fc0c32ece", "tag": "982f1558-d46b-435c-b1fb-fbdb26ababea"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:49:36.814026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-24845a4e-8026-42a7-83ad-549063789698 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:36.816632 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-24845a4e-8026-42a7-83ad-549063789698 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:36.835799 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24845a4e-8026-42a7-83ad-549063789698 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:36.839091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24845a4e-8026-42a7-83ad-549063789698 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:36.839766 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24845a4e-8026-42a7-83ad-549063789698 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:36.840795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24845a4e-8026-42a7-83ad-549063789698 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:36.841815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24845a4e-8026-42a7-83ad-549063789698 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:36.843784 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ec0763da-6551-42a5-b478-8db9dbfdf65a req-277d5fcc-12a7-40c2-a0e4-afbc7b43b7cd service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:36.844487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24845a4e-8026-42a7-83ad-549063789698 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:36.850240 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ec0763da-6551-42a5-b478-8db9dbfdf65a req-277d5fcc-12a7-40c2-a0e4-afbc7b43b7cd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:36.850764 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ec0763da-6551-42a5-b478-8db9dbfdf65a req-277d5fcc-12a7-40c2-a0e4-afbc7b43b7cd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:36.872190 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-ec0763da-6551-42a5-b478-8db9dbfdf65a req-277d5fcc-12a7-40c2-a0e4-afbc7b43b7cd service nova] Creating event network-changed:982f1558-d46b-435c-b1fb-fbdb26ababea for instance 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece on n-h2-849328-3 Aug 24 10:49:36.883239 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-ec0763da-6551-42a5-b478-8db9dbfdf65a req-277d5fcc-12a7-40c2-a0e4-afbc7b43b7cd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087965 Aug 24 10:49:36.885941 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3094/5847] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:49:37.034697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-24845a4e-8026-42a7-83ad-549063789698 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:37.044354 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-24845a4e-8026-42a7-83ad-549063789698 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece" status: 200 len: 1363 microversion: 2.1 time: 0.235005 Aug 24 10:49:37.045482 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2754/5848] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:36 2022] GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:38.072736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1d122f8f-0088-426f-bbbc-4d69056b845f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:38.073523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1d122f8f-0088-426f-bbbc-4d69056b845f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:38.081091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d122f8f-0088-426f-bbbc-4d69056b845f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:38.081794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d122f8f-0088-426f-bbbc-4d69056b845f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:38.082205 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d122f8f-0088-426f-bbbc-4d69056b845f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:38.082951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d122f8f-0088-426f-bbbc-4d69056b845f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:38.083396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d122f8f-0088-426f-bbbc-4d69056b845f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:38.083787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d122f8f-0088-426f-bbbc-4d69056b845f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:38.261729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1d122f8f-0088-426f-bbbc-4d69056b845f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:38.270594 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1d122f8f-0088-426f-bbbc-4d69056b845f tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece" status: 200 len: 1363 microversion: 2.1 time: 0.203105 Aug 24 10:49:38.271212 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3095/5849] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:38 2022] GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:39.296105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-35811629-f6f7-4beb-bf60-1a8891a578eb tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:39.297266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-35811629-f6f7-4beb-bf60-1a8891a578eb tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:39.305281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35811629-f6f7-4beb-bf60-1a8891a578eb tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:39.305803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35811629-f6f7-4beb-bf60-1a8891a578eb tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:39.306609 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35811629-f6f7-4beb-bf60-1a8891a578eb tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:39.307359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35811629-f6f7-4beb-bf60-1a8891a578eb tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:39.307982 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35811629-f6f7-4beb-bf60-1a8891a578eb tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:39.308393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35811629-f6f7-4beb-bf60-1a8891a578eb tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:39.462672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-35811629-f6f7-4beb-bf60-1a8891a578eb tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:39.472099 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-35811629-f6f7-4beb-bf60-1a8891a578eb tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece" status: 200 len: 1363 microversion: 2.1 time: 0.180150 Aug 24 10:49:39.492087 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2755/5850] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:39 2022] GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:40.496388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8e4abbcd-c53a-4020-bf0b-63fade1e3f25 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:40.497782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8e4abbcd-c53a-4020-bf0b-63fade1e3f25 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:40.505763 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e4abbcd-c53a-4020-bf0b-63fade1e3f25 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:40.506253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e4abbcd-c53a-4020-bf0b-63fade1e3f25 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:40.506691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e4abbcd-c53a-4020-bf0b-63fade1e3f25 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:40.507377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e4abbcd-c53a-4020-bf0b-63fade1e3f25 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:40.507840 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e4abbcd-c53a-4020-bf0b-63fade1e3f25 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:40.508265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e4abbcd-c53a-4020-bf0b-63fade1e3f25 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:40.729193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8e4abbcd-c53a-4020-bf0b-63fade1e3f25 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:40.741506 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8e4abbcd-c53a-4020-bf0b-63fade1e3f25 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece" status: 200 len: 1363 microversion: 2.1 time: 0.249100 Aug 24 10:49:40.742650 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3096/5851] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:40 2022] GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:41.764009 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cf8e2ba3-a84e-494d-96dc-a55cc3f79135 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:41.764805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cf8e2ba3-a84e-494d-96dc-a55cc3f79135 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:41.773662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf8e2ba3-a84e-494d-96dc-a55cc3f79135 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:41.774515 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf8e2ba3-a84e-494d-96dc-a55cc3f79135 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:41.775395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf8e2ba3-a84e-494d-96dc-a55cc3f79135 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:41.776826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf8e2ba3-a84e-494d-96dc-a55cc3f79135 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:41.777604 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf8e2ba3-a84e-494d-96dc-a55cc3f79135 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:41.778345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf8e2ba3-a84e-494d-96dc-a55cc3f79135 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:41.971841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cf8e2ba3-a84e-494d-96dc-a55cc3f79135 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:41.973415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c60952a8-2d95-4674-b9de-a80a8f1a8cf5 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:49:41.975762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c60952a8-2d95-4674-b9de-a80a8f1a8cf5 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 5c094722-159c-4fb8-ae06-e73ae16da2aa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:41.981154 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cf8e2ba3-a84e-494d-96dc-a55cc3f79135 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece" status: 200 len: 1363 microversion: 2.1 time: 0.221342 Aug 24 10:49:41.981778 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2756/5852] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:41 2022] GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:41.985424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c60952a8-2d95-4674-b9de-a80a8f1a8cf5 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:41.985921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c60952a8-2d95-4674-b9de-a80a8f1a8cf5 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:41.986363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c60952a8-2d95-4674-b9de-a80a8f1a8cf5 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:41.987076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c60952a8-2d95-4674-b9de-a80a8f1a8cf5 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:41.987533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c60952a8-2d95-4674-b9de-a80a8f1a8cf5 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:41.987959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c60952a8-2d95-4674-b9de-a80a8f1a8cf5 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:42.046680 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c60952a8-2d95-4674-b9de-a80a8f1a8cf5 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "POST /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa/action" status: 200 len: 32646 microversion: 2.1 time: 0.077482 Aug 24 10:49:42.047359 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3097/5853] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:49:41 2022] POST /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa/action => generated 32646 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:49:42.889566 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e2d588d6-5bf6-4e98-b9d1-c341436f433a req-5486c1cf-e486-4a2c-bf55-2fba9bc2b1e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7adbdc60-ef19-4434-bfc2-2c3fc0c32ece", "name": "network-vif-plugged", "status": "completed", "tag": "982f1558-d46b-435c-b1fb-fbdb26ababea"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:49:42.903871 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e2d588d6-5bf6-4e98-b9d1-c341436f433a req-5486c1cf-e486-4a2c-bf55-2fba9bc2b1e0 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:42.907561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e2d588d6-5bf6-4e98-b9d1-c341436f433a req-5486c1cf-e486-4a2c-bf55-2fba9bc2b1e0 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:42.913984 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e2d588d6-5bf6-4e98-b9d1-c341436f433a req-5486c1cf-e486-4a2c-bf55-2fba9bc2b1e0 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:42.938955 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e2d588d6-5bf6-4e98-b9d1-c341436f433a req-5486c1cf-e486-4a2c-bf55-2fba9bc2b1e0 service nova] Creating event network-vif-plugged:982f1558-d46b-435c-b1fb-fbdb26ababea for instance 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece on n-h2-849328-3 Aug 24 10:49:42.947608 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e2d588d6-5bf6-4e98-b9d1-c341436f433a req-5486c1cf-e486-4a2c-bf55-2fba9bc2b1e0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061392 Aug 24 10:49:42.950538 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2757/5854] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:49:43.005852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2da63e6e-3b2f-45a0-aa07-d80083eea7d7 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:43.006886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2da63e6e-3b2f-45a0-aa07-d80083eea7d7 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:43.022808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2da63e6e-3b2f-45a0-aa07-d80083eea7d7 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:43.023462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2da63e6e-3b2f-45a0-aa07-d80083eea7d7 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:43.024209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2da63e6e-3b2f-45a0-aa07-d80083eea7d7 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:43.025201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2da63e6e-3b2f-45a0-aa07-d80083eea7d7 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:43.025489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2da63e6e-3b2f-45a0-aa07-d80083eea7d7 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:43.025920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2da63e6e-3b2f-45a0-aa07-d80083eea7d7 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:43.030276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=78 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:43.082189 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:43.112416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=10 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:43.261466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2da63e6e-3b2f-45a0-aa07-d80083eea7d7 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:43.278733 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2da63e6e-3b2f-45a0-aa07-d80083eea7d7 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece" status: 200 len: 1363 microversion: 2.1 time: 0.278947 Aug 24 10:49:43.279546 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3098/5855] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:42 2022] GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:49:43.443157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-f338e816-8921-4e44-b336-b7b106af61f8 req-11a57584-84f7-4215-ba09-3cd4da3912eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c094722-159c-4fb8-ae06-e73ae16da2aa", "tag": "dd14f6d8-77eb-4af1-a3cf-7f59206343cc"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:49:43.453136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5bc12d1b-ba84-48e6-99af-fc5a3f639c82 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:43.455459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5bc12d1b-ba84-48e6-99af-fc5a3f639c82 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 5c094722-159c-4fb8-ae06-e73ae16da2aa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:43.486564 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:43.494201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bc12d1b-ba84-48e6-99af-fc5a3f639c82 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:43.494201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bc12d1b-ba84-48e6-99af-fc5a3f639c82 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:43.494201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bc12d1b-ba84-48e6-99af-fc5a3f639c82 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:43.505284 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f338e816-8921-4e44-b336-b7b106af61f8 req-11a57584-84f7-4215-ba09-3cd4da3912eb service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:43.512534 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bc12d1b-ba84-48e6-99af-fc5a3f639c82 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:43.514265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bc12d1b-ba84-48e6-99af-fc5a3f639c82 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:43.514984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f338e816-8921-4e44-b336-b7b106af61f8 req-11a57584-84f7-4215-ba09-3cd4da3912eb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:43.516789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bc12d1b-ba84-48e6-99af-fc5a3f639c82 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:43.517859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f338e816-8921-4e44-b336-b7b106af61f8 req-11a57584-84f7-4215-ba09-3cd4da3912eb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:43.569401 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-f338e816-8921-4e44-b336-b7b106af61f8 req-11a57584-84f7-4215-ba09-3cd4da3912eb service nova] Creating event network-changed:dd14f6d8-77eb-4af1-a3cf-7f59206343cc for instance 5c094722-159c-4fb8-ae06-e73ae16da2aa on n-h2-849328-3 Aug 24 10:49:43.588634 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-f338e816-8921-4e44-b336-b7b106af61f8 req-11a57584-84f7-4215-ba09-3cd4da3912eb service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160748 Aug 24 10:49:43.591869 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3099/5856] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:49:43.640243 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5bc12d1b-ba84-48e6-99af-fc5a3f639c82 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 5c094722-159c-4fb8-ae06-e73ae16da2aa] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:49:43.882947 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5bc12d1b-ba84-48e6-99af-fc5a3f639c82 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "DELETE /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa" status: 204 len: 0 microversion: 2.1 time: 0.459840 Aug 24 10:49:43.896271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-15652f24-4104-4886-a457-32c8b98cadd4 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:43.897097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-15652f24-4104-4886-a457-32c8b98cadd4 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 5c094722-159c-4fb8-ae06-e73ae16da2aa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:43.900274 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2758/5857] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:49:43 2022] DELETE /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:49:43.909192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15652f24-4104-4886-a457-32c8b98cadd4 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:43.911949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15652f24-4104-4886-a457-32c8b98cadd4 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:43.915658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15652f24-4104-4886-a457-32c8b98cadd4 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:43.920282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15652f24-4104-4886-a457-32c8b98cadd4 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:43.921658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15652f24-4104-4886-a457-32c8b98cadd4 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:43.924405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15652f24-4104-4886-a457-32c8b98cadd4 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:44.144378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-15652f24-4104-4886-a457-32c8b98cadd4 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:44.160441 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-15652f24-4104-4886-a457-32c8b98cadd4 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa" status: 200 len: 1671 microversion: 2.1 time: 0.269094 Aug 24 10:49:44.163301 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3100/5858] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:43 2022] GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa => generated 1671 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:44.317391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b020643-6eb4-4f04-b428-52ffc5f1f18d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:44.318437 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2b020643-6eb4-4f04-b428-52ffc5f1f18d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:44.339426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b020643-6eb4-4f04-b428-52ffc5f1f18d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:44.340154 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b020643-6eb4-4f04-b428-52ffc5f1f18d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:44.340610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b020643-6eb4-4f04-b428-52ffc5f1f18d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:44.342092 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b020643-6eb4-4f04-b428-52ffc5f1f18d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:44.343083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b020643-6eb4-4f04-b428-52ffc5f1f18d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:44.345104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b020643-6eb4-4f04-b428-52ffc5f1f18d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:45.105401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2b020643-6eb4-4f04-b428-52ffc5f1f18d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:45.123618 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2b020643-6eb4-4f04-b428-52ffc5f1f18d tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece" status: 200 len: 1363 microversion: 2.1 time: 0.814008 Aug 24 10:49:45.123618 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2759/5859] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:44 2022] GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece => generated 1363 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:45.185484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fae8c59d-1a1a-483e-bc5f-a90e3ef6f7fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:45.186350 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fae8c59d-1a1a-483e-bc5f-a90e3ef6f7fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 5c094722-159c-4fb8-ae06-e73ae16da2aa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:45.211009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fae8c59d-1a1a-483e-bc5f-a90e3ef6f7fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:45.211909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fae8c59d-1a1a-483e-bc5f-a90e3ef6f7fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:45.212605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fae8c59d-1a1a-483e-bc5f-a90e3ef6f7fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:45.216551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fae8c59d-1a1a-483e-bc5f-a90e3ef6f7fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:45.217451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fae8c59d-1a1a-483e-bc5f-a90e3ef6f7fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:45.218359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fae8c59d-1a1a-483e-bc5f-a90e3ef6f7fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:45.472035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fae8c59d-1a1a-483e-bc5f-a90e3ef6f7fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:45.482294 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fae8c59d-1a1a-483e-bc5f-a90e3ef6f7fa tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa" status: 200 len: 1671 microversion: 2.1 time: 0.300942 Aug 24 10:49:45.483448 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3101/5860] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:45 2022] GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa => generated 1671 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:46.011883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6dc54d5c-f197-4c91-a5da-eb3b7bb7fcea tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1594743919", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:49:46.132668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-6dc54d5c-f197-4c91-a5da-eb3b7bb7fcea tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:49:46.142092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2a780c01-36f1-4e6b-a0ef-7c54f1d394b6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:46.142924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2a780c01-36f1-4e6b-a0ef-7c54f1d394b6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:46.155217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a780c01-36f1-4e6b-a0ef-7c54f1d394b6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:46.155873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a780c01-36f1-4e6b-a0ef-7c54f1d394b6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:46.156626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a780c01-36f1-4e6b-a0ef-7c54f1d394b6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:46.157516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a780c01-36f1-4e6b-a0ef-7c54f1d394b6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:46.160628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a780c01-36f1-4e6b-a0ef-7c54f1d394b6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:46.161408 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a780c01-36f1-4e6b-a0ef-7c54f1d394b6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:46.365481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2a780c01-36f1-4e6b-a0ef-7c54f1d394b6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:46.375685 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2a780c01-36f1-4e6b-a0ef-7c54f1d394b6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece" status: 200 len: 1548 microversion: 2.1 time: 0.237588 Aug 24 10:49:46.379897 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3102/5861] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:46 2022] GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece => generated 1548 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:46.400776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eb94c5d4-c36b-4f00-ac60-fd995a361315 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:46.405688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-eb94c5d4-c36b-4f00-ac60-fd995a361315 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:46.421039 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb94c5d4-c36b-4f00-ac60-fd995a361315 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:46.423309 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb94c5d4-c36b-4f00-ac60-fd995a361315 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:46.423837 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb94c5d4-c36b-4f00-ac60-fd995a361315 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:46.426156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb94c5d4-c36b-4f00-ac60-fd995a361315 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:46.426713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb94c5d4-c36b-4f00-ac60-fd995a361315 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:46.430372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb94c5d4-c36b-4f00-ac60-fd995a361315 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:46.605953 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eb94c5d4-c36b-4f00-ac60-fd995a361315 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.209957 Aug 24 10:49:46.606928 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3103/5862] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Aug 24 10:49:46 2022] GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece/os-interface => generated 284 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:49:46.619074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3027e5b7-0a09-4ac5-bef9-450bf3b8ea99 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:46.619870 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3027e5b7-0a09-4ac5-bef9-450bf3b8ea99 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 5c094722-159c-4fb8-ae06-e73ae16da2aa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:46.628604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3027e5b7-0a09-4ac5-bef9-450bf3b8ea99 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:46.629388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3027e5b7-0a09-4ac5-bef9-450bf3b8ea99 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:46.629975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3027e5b7-0a09-4ac5-bef9-450bf3b8ea99 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:46.630865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3027e5b7-0a09-4ac5-bef9-450bf3b8ea99 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:46.631523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3027e5b7-0a09-4ac5-bef9-450bf3b8ea99 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:46.632099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3027e5b7-0a09-4ac5-bef9-450bf3b8ea99 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:46.732709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-6dc54d5c-f197-4c91-a5da-eb3b7bb7fcea tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:49:46.733152 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-6dc54d5c-f197-4c91-a5da-eb3b7bb7fcea tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:49:46.733637 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-6dc54d5c-f197-4c91-a5da-eb3b7bb7fcea tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:49:46.734046 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-6dc54d5c-f197-4c91-a5da-eb3b7bb7fcea tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:49:46.734457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-6dc54d5c-f197-4c91-a5da-eb3b7bb7fcea tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:49:46.747801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6dc54d5c-f197-4c91-a5da-eb3b7bb7fcea tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:46.748305 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6dc54d5c-f197-4c91-a5da-eb3b7bb7fcea tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:46.748934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6dc54d5c-f197-4c91-a5da-eb3b7bb7fcea tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:46.749694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6dc54d5c-f197-4c91-a5da-eb3b7bb7fcea tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:46.750311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6dc54d5c-f197-4c91-a5da-eb3b7bb7fcea tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:46.750880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6dc54d5c-f197-4c91-a5da-eb3b7bb7fcea tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:46.770831 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-6dc54d5c-f197-4c91-a5da-eb3b7bb7fcea tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Getting quotas for project c1cc8d0d2ea04e2180f07dc5f29f58de. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:49:46.777690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-6dc54d5c-f197-4c91-a5da-eb3b7bb7fcea tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Getting quotas for user f251299ac44344678910279f23969b7d and project c1cc8d0d2ea04e2180f07dc5f29f58de. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:49:46.792206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6dc54d5c-f197-4c91-a5da-eb3b7bb7fcea tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:49:46.795340 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6dc54d5c-f197-4c91-a5da-eb3b7bb7fcea tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] [instance: e791498e-c777-4a92-b5f2-7df63f56d8f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:49:46.853960 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6dc54d5c-f197-4c91-a5da-eb3b7bb7fcea tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.847274 Aug 24 10:49:46.854641 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2760/5863] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:49:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:49:46.865775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dde16d19-ea83-40b0-8187-fd75c2012047 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:49:46.873993 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dde16d19-ea83-40b0-8187-fd75c2012047 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:46.883939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dde16d19-ea83-40b0-8187-fd75c2012047 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:46.885281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dde16d19-ea83-40b0-8187-fd75c2012047 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:46.886875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dde16d19-ea83-40b0-8187-fd75c2012047 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:46.888133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dde16d19-ea83-40b0-8187-fd75c2012047 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:46.889114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dde16d19-ea83-40b0-8187-fd75c2012047 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:46.889875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dde16d19-ea83-40b0-8187-fd75c2012047 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:46.965744 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dde16d19-ea83-40b0-8187-fd75c2012047 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "POST /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03/action" status: 200 len: 24572 microversion: 2.1 time: 0.107248 Aug 24 10:49:46.967304 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2761/5864] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:49:46 2022] POST /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03/action => generated 24572 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:49:46.973111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a079b6cb-6380-4d5a-98ce-47fcdcd6a7d2 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:46.976660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a079b6cb-6380-4d5a-98ce-47fcdcd6a7d2 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] [instance: e791498e-c777-4a92-b5f2-7df63f56d8f0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:47.021026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3027e5b7-0a09-4ac5-bef9-450bf3b8ea99 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd244b0014c4240bca18becdd30a5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4aa20cf3d44a2b11f47c0c18cfb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:47.034671 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3027e5b7-0a09-4ac5-bef9-450bf3b8ea99 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa" status: 200 len: 1552 microversion: 2.1 time: 0.426412 Aug 24 10:49:47.035880 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3104/5865] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:46 2022] GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa => generated 1552 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:47.092176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a079b6cb-6380-4d5a-98ce-47fcdcd6a7d2 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f251299ac44344678910279f23969b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc8d0d2ea04e2180f07dc5f29f58de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:47.104741 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a079b6cb-6380-4d5a-98ce-47fcdcd6a7d2 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] 10.222.0.85 "GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0" status: 200 len: 1215 microversion: 2.1 time: 0.133899 Aug 24 10:49:47.106511 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2762/5866] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:46 2022] GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0 => generated 1215 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:47.131921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-40c53200-e66b-4520-b0b9-1f3453247e4a req-46353021-2703-43e7-9b4e-4514e763d8a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c094722-159c-4fb8-ae06-e73ae16da2aa", "name": "network-vif-deleted", "tag": "dd14f6d8-77eb-4af1-a3cf-7f59206343cc"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:49:47.160850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-40c53200-e66b-4520-b0b9-1f3453247e4a req-46353021-2703-43e7-9b4e-4514e763d8a4 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:47.164892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-40c53200-e66b-4520-b0b9-1f3453247e4a req-46353021-2703-43e7-9b4e-4514e763d8a4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:47.165856 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-40c53200-e66b-4520-b0b9-1f3453247e4a req-46353021-2703-43e7-9b4e-4514e763d8a4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:47.192047 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-40c53200-e66b-4520-b0b9-1f3453247e4a req-46353021-2703-43e7-9b4e-4514e763d8a4 service nova] Creating event network-vif-deleted:dd14f6d8-77eb-4af1-a3cf-7f59206343cc for instance 5c094722-159c-4fb8-ae06-e73ae16da2aa on n-h2-849328-3 Aug 24 10:49:47.198931 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-40c53200-e66b-4520-b0b9-1f3453247e4a req-46353021-2703-43e7-9b4e-4514e763d8a4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075338 Aug 24 10:49:47.199578 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3105/5867] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:49:47.971510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c32cf31a-7ed7-4233-8ab3-c77969907e75 req-303466bf-a03e-45a0-a274-024ef9c7205c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7adbdc60-ef19-4434-bfc2-2c3fc0c32ece", "tag": "982f1558-d46b-435c-b1fb-fbdb26ababea"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:49:47.981875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c32cf31a-7ed7-4233-8ab3-c77969907e75 req-303466bf-a03e-45a0-a274-024ef9c7205c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:47.982391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c32cf31a-7ed7-4233-8ab3-c77969907e75 req-303466bf-a03e-45a0-a274-024ef9c7205c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:47.982809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c32cf31a-7ed7-4233-8ab3-c77969907e75 req-303466bf-a03e-45a0-a274-024ef9c7205c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:47.994697 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c32cf31a-7ed7-4233-8ab3-c77969907e75 req-303466bf-a03e-45a0-a274-024ef9c7205c service nova] Creating event network-changed:982f1558-d46b-435c-b1fb-fbdb26ababea for instance 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece on n-h2-849328-3 Aug 24 10:49:48.001395 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c32cf31a-7ed7-4233-8ab3-c77969907e75 req-303466bf-a03e-45a0-a274-024ef9c7205c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033518 Aug 24 10:49:48.002285 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2763/5868] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:49:48.057263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-417db009-e437-454e-a58c-4d78aa5e32f1 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:48.058008 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-417db009-e437-454e-a58c-4d78aa5e32f1 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] [instance: 5c094722-159c-4fb8-ae06-e73ae16da2aa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:48.065545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-417db009-e437-454e-a58c-4d78aa5e32f1 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:48.066316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-417db009-e437-454e-a58c-4d78aa5e32f1 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:48.066951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-417db009-e437-454e-a58c-4d78aa5e32f1 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:48.068488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-417db009-e437-454e-a58c-4d78aa5e32f1 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:48.069180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-417db009-e437-454e-a58c-4d78aa5e32f1 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:48.069671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-417db009-e437-454e-a58c-4d78aa5e32f1 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:48.085886 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-417db009-e437-454e-a58c-4d78aa5e32f1 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] HTTP exception thrown: Instance 5c094722-159c-4fb8-ae06-e73ae16da2aa could not be found. Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-417db009-e437-454e-a58c-4d78aa5e32f1 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Request method failure captured: Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa HTTP/1.1 Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgFXe7oWLnPEt6gBXDapFcnUDKp283XImKzkE8PX7IGLpZqa-k5v8fIbIo1U_2uCyNlNH-sGwR4GCaE6RoeSAcmlMTOIqQiXPhRi4UE5Os4kjbYzOKfwo9kuEIatN5H7fr_S_KVkepeevW8Drsq4OZtLNiebEAVd_K2cAbI2fBzaLQ0 Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 65e4aa20cf3d44a2b11f47c0c18cfb4d Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestNetworkBasicOps-889484220 Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/65e4aa20cf3d44a2b11f47c0c18cfb4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_65e4aa20cf3d44a2b11f47c0c18cfb4d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/65e4aa20cf3d44a2b11f47c0c18cfb4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/65e4aa20cf3d44a2b11f47c0c18cfb4d"}]}] Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestNetworkBasicOps-889484220 Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 65e4aa20cf3d44a2b11f47c0c18cfb4d Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestNetworkBasicOps-889484220 Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestNetworkBasicOps-889484220-project Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: afd244b0014c4240bca18becdd30a5a0 Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestNetworkBasicOps-889484220-project Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 5c094722-159c-4fb8-ae06-e73ae16da2aa could not be found. Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '5c094722-159c-4fb8-ae06-e73ae16da2aa'} Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c094722-159c-4fb8-ae06-e73ae16da2aa could not be found. Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c094722-159c-4fb8-ae06-e73ae16da2aa could not be found. Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:49:48.087947 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:49:48.091312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:49:48.091312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:49:48.091312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:49:48.091312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:49:48.091312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:49:48.091312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c094722-159c-4fb8-ae06-e73ae16da2aa could not be found. Aug 24 10:49:48.091312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:49:48.093214 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-417db009-e437-454e-a58c-4d78aa5e32f1 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Returning 404 to user: Instance 5c094722-159c-4fb8-ae06-e73ae16da2aa could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:49:48.094707 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-417db009-e437-454e-a58c-4d78aa5e32f1 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa" status: 404 len: 111 microversion: 2.1 time: 0.041852 Aug 24 10:49:48.095434 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3106/5869] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:48 2022] GET /compute/v2.1/servers/5c094722-159c-4fb8-ae06-e73ae16da2aa => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:49:48.129032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dff29d22-5ed3-48bc-b93f-0c0215c5deb4 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:48.130358 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dff29d22-5ed3-48bc-b93f-0c0215c5deb4 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] [instance: e791498e-c777-4a92-b5f2-7df63f56d8f0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:48.138702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dff29d22-5ed3-48bc-b93f-0c0215c5deb4 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:48.139550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dff29d22-5ed3-48bc-b93f-0c0215c5deb4 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:48.140338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dff29d22-5ed3-48bc-b93f-0c0215c5deb4 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:48.141749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dff29d22-5ed3-48bc-b93f-0c0215c5deb4 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:48.142418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dff29d22-5ed3-48bc-b93f-0c0215c5deb4 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:48.143046 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dff29d22-5ed3-48bc-b93f-0c0215c5deb4 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:48.178088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:48.566729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3d43b60-5954-4bf9-b07e-97613ad727e3 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] Calling method '.version_select at 0x7f465a1d0790>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:48.617907 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d3d43b60-5954-4bf9-b07e-97613ad727e3 tempest-TestNetworkBasicOps-889484220 tempest-TestNetworkBasicOps-889484220-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1297925966" status: 202 len: 0 microversion: 2.1 time: 0.055013 Aug 24 10:49:48.622523 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3107/5870] 10.222.0.85 () {58 vars in 1257 bytes} [Wed Aug 24 10:49:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1297925966 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:49:48.764481 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dff29d22-5ed3-48bc-b93f-0c0215c5deb4 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f251299ac44344678910279f23969b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc8d0d2ea04e2180f07dc5f29f58de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:48.775043 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dff29d22-5ed3-48bc-b93f-0c0215c5deb4 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] 10.222.0.85 "GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0" status: 200 len: 1267 microversion: 2.1 time: 0.652272 Aug 24 10:49:48.775675 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2764/5871] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:48 2022] GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0 => generated 1267 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:49:49.799509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3d308c01-7d82-453e-bb25-8195b8b5622f tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:49.800142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3d308c01-7d82-453e-bb25-8195b8b5622f tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] [instance: e791498e-c777-4a92-b5f2-7df63f56d8f0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:49.814410 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d308c01-7d82-453e-bb25-8195b8b5622f tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:49.814917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d308c01-7d82-453e-bb25-8195b8b5622f tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:49.815571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d308c01-7d82-453e-bb25-8195b8b5622f tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:49.816165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d308c01-7d82-453e-bb25-8195b8b5622f tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:49.816588 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d308c01-7d82-453e-bb25-8195b8b5622f tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:49.816916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d308c01-7d82-453e-bb25-8195b8b5622f tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:50.071525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3d308c01-7d82-453e-bb25-8195b8b5622f tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f251299ac44344678910279f23969b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc8d0d2ea04e2180f07dc5f29f58de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:50.081276 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3d308c01-7d82-453e-bb25-8195b8b5622f tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] 10.222.0.85 "GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0" status: 200 len: 1315 microversion: 2.1 time: 0.286678 Aug 24 10:49:50.082576 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3108/5872] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:49 2022] GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:50.767836 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-895a1b15-91d4-484c-a7e6-ed5d63d45c84 req-fa9e56bc-0938-4f9a-8e9d-015a45ebd625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e791498e-c777-4a92-b5f2-7df63f56d8f0", "tag": "0a0ee588-fb2f-44ac-9da7-b90bbee65238"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:49:50.782723 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-895a1b15-91d4-484c-a7e6-ed5d63d45c84 req-fa9e56bc-0938-4f9a-8e9d-015a45ebd625 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:50.783395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-895a1b15-91d4-484c-a7e6-ed5d63d45c84 req-fa9e56bc-0938-4f9a-8e9d-015a45ebd625 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:50.784251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-895a1b15-91d4-484c-a7e6-ed5d63d45c84 req-fa9e56bc-0938-4f9a-8e9d-015a45ebd625 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:50.823298 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-895a1b15-91d4-484c-a7e6-ed5d63d45c84 req-fa9e56bc-0938-4f9a-8e9d-015a45ebd625 service nova] Creating event network-changed:0a0ee588-fb2f-44ac-9da7-b90bbee65238 for instance e791498e-c777-4a92-b5f2-7df63f56d8f0 on n-h1-849328-3 Aug 24 10:49:50.830988 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-895a1b15-91d4-484c-a7e6-ed5d63d45c84 req-fa9e56bc-0938-4f9a-8e9d-015a45ebd625 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066115 Aug 24 10:49:50.832344 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2765/5873] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:49:51.103581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-42054bfd-4794-466a-bcf1-7f6201b31f08 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:51.104964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-42054bfd-4794-466a-bcf1-7f6201b31f08 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] [instance: e791498e-c777-4a92-b5f2-7df63f56d8f0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:51.112726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42054bfd-4794-466a-bcf1-7f6201b31f08 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:51.113249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42054bfd-4794-466a-bcf1-7f6201b31f08 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:51.113836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42054bfd-4794-466a-bcf1-7f6201b31f08 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:51.115448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42054bfd-4794-466a-bcf1-7f6201b31f08 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:51.115892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42054bfd-4794-466a-bcf1-7f6201b31f08 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:51.116458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42054bfd-4794-466a-bcf1-7f6201b31f08 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:51.405774 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-42054bfd-4794-466a-bcf1-7f6201b31f08 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f251299ac44344678910279f23969b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc8d0d2ea04e2180f07dc5f29f58de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:51.418547 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-42054bfd-4794-466a-bcf1-7f6201b31f08 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] 10.222.0.85 "GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0" status: 200 len: 1315 microversion: 2.1 time: 0.319289 Aug 24 10:49:51.419162 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3109/5874] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:51 2022] GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:52.442688 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f679b186-7977-4673-a571-89ece18dbe0c tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:52.448525 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f679b186-7977-4673-a571-89ece18dbe0c tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] [instance: e791498e-c777-4a92-b5f2-7df63f56d8f0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:52.461985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f679b186-7977-4673-a571-89ece18dbe0c tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:52.462583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f679b186-7977-4673-a571-89ece18dbe0c tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:52.463029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f679b186-7977-4673-a571-89ece18dbe0c tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:52.465282 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f679b186-7977-4673-a571-89ece18dbe0c tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:52.465772 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f679b186-7977-4673-a571-89ece18dbe0c tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:52.466220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f679b186-7977-4673-a571-89ece18dbe0c tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:52.762780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f679b186-7977-4673-a571-89ece18dbe0c tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f251299ac44344678910279f23969b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc8d0d2ea04e2180f07dc5f29f58de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:52.772086 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f679b186-7977-4673-a571-89ece18dbe0c tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] 10.222.0.85 "GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0" status: 200 len: 1315 microversion: 2.1 time: 0.336659 Aug 24 10:49:52.773264 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2766/5875] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:52 2022] GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0 => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:49:53.310339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-41d664f1-e7ab-4f57-b20a-1edfdae6efd9 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:53.313342 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-41d664f1-e7ab-4f57-b20a-1edfdae6efd9 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:53.325422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41d664f1-e7ab-4f57-b20a-1edfdae6efd9 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:53.326177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41d664f1-e7ab-4f57-b20a-1edfdae6efd9 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:53.326824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41d664f1-e7ab-4f57-b20a-1edfdae6efd9 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:53.327685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41d664f1-e7ab-4f57-b20a-1edfdae6efd9 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:53.328283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41d664f1-e7ab-4f57-b20a-1edfdae6efd9 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:53.330954 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41d664f1-e7ab-4f57-b20a-1edfdae6efd9 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:53.708678 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-41d664f1-e7ab-4f57-b20a-1edfdae6efd9 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1833 microversion: 2.1 time: 0.404023 Aug 24 10:49:53.710010 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3110/5876] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:53 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1833 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:53.730170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8835d080-cd11-4b4a-a697-5514c26125c2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:53.731306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8835d080-cd11-4b4a-a697-5514c26125c2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:53.738353 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8835d080-cd11-4b4a-a697-5514c26125c2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:53.738849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8835d080-cd11-4b4a-a697-5514c26125c2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:53.739289 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8835d080-cd11-4b4a-a697-5514c26125c2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:53.740002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8835d080-cd11-4b4a-a697-5514c26125c2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:53.740471 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8835d080-cd11-4b4a-a697-5514c26125c2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:53.740918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8835d080-cd11-4b4a-a697-5514c26125c2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:53.794365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fb5ae6e5-8421-4184-b3fa-845344a3c313 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:53.794988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fb5ae6e5-8421-4184-b3fa-845344a3c313 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] [instance: e791498e-c777-4a92-b5f2-7df63f56d8f0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:53.802160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb5ae6e5-8421-4184-b3fa-845344a3c313 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:53.802694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb5ae6e5-8421-4184-b3fa-845344a3c313 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:53.803135 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb5ae6e5-8421-4184-b3fa-845344a3c313 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:53.803847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb5ae6e5-8421-4184-b3fa-845344a3c313 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:53.804316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb5ae6e5-8421-4184-b3fa-845344a3c313 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:53.804745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb5ae6e5-8421-4184-b3fa-845344a3c313 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:53.992518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fb5ae6e5-8421-4184-b3fa-845344a3c313 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f251299ac44344678910279f23969b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc8d0d2ea04e2180f07dc5f29f58de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:54.006308 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fb5ae6e5-8421-4184-b3fa-845344a3c313 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] 10.222.0.85 "GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0" status: 200 len: 1315 microversion: 2.1 time: 0.214577 Aug 24 10:49:54.006308 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3111/5877] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:53 2022] GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:49:54.411667 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8835d080-cd11-4b4a-a697-5514c26125c2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:54.424683 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8835d080-cd11-4b4a-a697-5514c26125c2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1682 microversion: 2.1 time: 0.698318 Aug 24 10:49:54.425621 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2767/5878] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:53 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1682 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:54.541658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e059c9c4-14a0-4beb-bac7-e2c9ac3ff575 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:49:54.544134 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e059c9c4-14a0-4beb-bac7-e2c9ac3ff575 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:54.551800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e059c9c4-14a0-4beb-bac7-e2c9ac3ff575 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:54.552619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e059c9c4-14a0-4beb-bac7-e2c9ac3ff575 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:54.553170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e059c9c4-14a0-4beb-bac7-e2c9ac3ff575 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:54.554018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e059c9c4-14a0-4beb-bac7-e2c9ac3ff575 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:54.554498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e059c9c4-14a0-4beb-bac7-e2c9ac3ff575 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:54.554929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e059c9c4-14a0-4beb-bac7-e2c9ac3ff575 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:54.633342 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e059c9c4-14a0-4beb-bac7-e2c9ac3ff575 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "POST /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03/action" status: 200 len: 32639 microversion: 2.1 time: 0.095907 Aug 24 10:49:54.634307 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3112/5879] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:49:54 2022] POST /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03/action => generated 32639 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:49:54.861746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e48a6283-a670-4638-a327-a38e4215a014 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:49:54.862392 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e48a6283-a670-4638-a327-a38e4215a014 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:54.869615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e48a6283-a670-4638-a327-a38e4215a014 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:54.870347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e48a6283-a670-4638-a327-a38e4215a014 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:54.870965 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e48a6283-a670-4638-a327-a38e4215a014 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:54.871659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e48a6283-a670-4638-a327-a38e4215a014 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:54.872133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e48a6283-a670-4638-a327-a38e4215a014 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:54.872555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e48a6283-a670-4638-a327-a38e4215a014 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:54.936286 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e48a6283-a670-4638-a327-a38e4215a014 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6f15314107944f66855d13dca1b2e97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e720f1f52028408c84b0e478336c938d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:54.936929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e48a6283-a670-4638-a327-a38e4215a014 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] flavor_id is None. Assuming migration. {{(pid=122432) resize /opt/stack/nova/nova/compute/api.py:4181}} Aug 24 10:49:54.937416 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e48a6283-a670-4638-a327-a38e4215a014 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122432) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 10:49:55.026707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c0fd28fe-685c-4084-b192-8dc1799b5521 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:55.027646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c0fd28fe-685c-4084-b192-8dc1799b5521 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] [instance: e791498e-c777-4a92-b5f2-7df63f56d8f0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:55.041457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0fd28fe-685c-4084-b192-8dc1799b5521 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:55.041984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0fd28fe-685c-4084-b192-8dc1799b5521 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:55.042436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0fd28fe-685c-4084-b192-8dc1799b5521 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:55.047789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0fd28fe-685c-4084-b192-8dc1799b5521 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:55.048795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0fd28fe-685c-4084-b192-8dc1799b5521 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:55.049280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0fd28fe-685c-4084-b192-8dc1799b5521 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:55.316508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c0fd28fe-685c-4084-b192-8dc1799b5521 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f251299ac44344678910279f23969b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc8d0d2ea04e2180f07dc5f29f58de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:55.327403 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c0fd28fe-685c-4084-b192-8dc1799b5521 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] 10.222.0.85 "GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0" status: 200 len: 1315 microversion: 2.1 time: 0.305401 Aug 24 10:49:55.328338 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3113/5880] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:55 2022] GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:55.383893 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e48a6283-a670-4638-a327-a38e4215a014 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03/action" status: 202 len: 0 microversion: 2.1 time: 0.526291 Aug 24 10:49:55.384926 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2768/5881] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:49:54 2022] POST /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 10:49:55.394160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-308d0bc7-d566-493d-9a97-3cf2e9255668 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:55.394918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-308d0bc7-d566-493d-9a97-3cf2e9255668 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:55.402417 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-308d0bc7-d566-493d-9a97-3cf2e9255668 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:55.403149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-308d0bc7-d566-493d-9a97-3cf2e9255668 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:55.403908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-308d0bc7-d566-493d-9a97-3cf2e9255668 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:55.404740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-308d0bc7-d566-493d-9a97-3cf2e9255668 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:55.405349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-308d0bc7-d566-493d-9a97-3cf2e9255668 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:55.405878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-308d0bc7-d566-493d-9a97-3cf2e9255668 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:55.648926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-308d0bc7-d566-493d-9a97-3cf2e9255668 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:55.659394 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-308d0bc7-d566-493d-9a97-3cf2e9255668 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1691 microversion: 2.1 time: 0.269856 Aug 24 10:49:55.660410 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3114/5882] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:55 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1691 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:56.351385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-96cc82ef-d8bf-4c32-b1b7-9776aa9fdeba tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:56.353033 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-96cc82ef-d8bf-4c32-b1b7-9776aa9fdeba tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] [instance: e791498e-c777-4a92-b5f2-7df63f56d8f0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:56.362122 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96cc82ef-d8bf-4c32-b1b7-9776aa9fdeba tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:56.363014 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96cc82ef-d8bf-4c32-b1b7-9776aa9fdeba tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:56.363685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96cc82ef-d8bf-4c32-b1b7-9776aa9fdeba tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:56.364610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96cc82ef-d8bf-4c32-b1b7-9776aa9fdeba tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:56.365503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96cc82ef-d8bf-4c32-b1b7-9776aa9fdeba tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:56.366200 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96cc82ef-d8bf-4c32-b1b7-9776aa9fdeba tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:56.589729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-96cc82ef-d8bf-4c32-b1b7-9776aa9fdeba tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f251299ac44344678910279f23969b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc8d0d2ea04e2180f07dc5f29f58de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:56.604202 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-96cc82ef-d8bf-4c32-b1b7-9776aa9fdeba tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] 10.222.0.85 "GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0" status: 200 len: 1315 microversion: 2.1 time: 0.257665 Aug 24 10:49:56.621071 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2769/5883] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:56 2022] GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:56.693514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-55390a3a-cf39-4a4c-94af-ffe6c3c064cc tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:56.694161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-55390a3a-cf39-4a4c-94af-ffe6c3c064cc tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:56.702694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55390a3a-cf39-4a4c-94af-ffe6c3c064cc tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:56.703205 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55390a3a-cf39-4a4c-94af-ffe6c3c064cc tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:56.703690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55390a3a-cf39-4a4c-94af-ffe6c3c064cc tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:56.704418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55390a3a-cf39-4a4c-94af-ffe6c3c064cc tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:56.705239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55390a3a-cf39-4a4c-94af-ffe6c3c064cc tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:56.705832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55390a3a-cf39-4a4c-94af-ffe6c3c064cc tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:57.054900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-55390a3a-cf39-4a4c-94af-ffe6c3c064cc tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:57.065844 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-55390a3a-cf39-4a4c-94af-ffe6c3c064cc tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1691 microversion: 2.1 time: 0.378497 Aug 24 10:49:57.068777 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3115/5884] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:56 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1691 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:57.450630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-b65af5ed-c01d-4bf5-add3-c9c772543f2f req-39d2751b-b1c0-4810-a1b4-621879ed5630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e791498e-c777-4a92-b5f2-7df63f56d8f0", "name": "network-vif-plugged", "status": "completed", "tag": "0a0ee588-fb2f-44ac-9da7-b90bbee65238"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:49:57.461455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:57.462472 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:57.471239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b65af5ed-c01d-4bf5-add3-c9c772543f2f req-39d2751b-b1c0-4810-a1b4-621879ed5630 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:57.473541 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b65af5ed-c01d-4bf5-add3-c9c772543f2f req-39d2751b-b1c0-4810-a1b4-621879ed5630 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:57.474483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b65af5ed-c01d-4bf5-add3-c9c772543f2f req-39d2751b-b1c0-4810-a1b4-621879ed5630 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:57.513990 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b65af5ed-c01d-4bf5-add3-c9c772543f2f req-39d2751b-b1c0-4810-a1b4-621879ed5630 service nova] Creating event network-vif-plugged:0a0ee588-fb2f-44ac-9da7-b90bbee65238 for instance e791498e-c777-4a92-b5f2-7df63f56d8f0 on n-h1-849328-3 Aug 24 10:49:57.520122 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-b65af5ed-c01d-4bf5-add3-c9c772543f2f req-39d2751b-b1c0-4810-a1b4-621879ed5630 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072915 Aug 24 10:49:57.521200 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2770/5885] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:49:57.630876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ae33ef79-cc7a-4d79-989b-966a3b9ebd3e tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:57.631624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ae33ef79-cc7a-4d79-989b-966a3b9ebd3e tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] [instance: e791498e-c777-4a92-b5f2-7df63f56d8f0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:57.642008 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae33ef79-cc7a-4d79-989b-966a3b9ebd3e tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:57.642681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae33ef79-cc7a-4d79-989b-966a3b9ebd3e tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:57.644717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae33ef79-cc7a-4d79-989b-966a3b9ebd3e tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:57.646410 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae33ef79-cc7a-4d79-989b-966a3b9ebd3e tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:57.647265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae33ef79-cc7a-4d79-989b-966a3b9ebd3e tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:57.648033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae33ef79-cc7a-4d79-989b-966a3b9ebd3e tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:58.046433 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ae33ef79-cc7a-4d79-989b-966a3b9ebd3e tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f251299ac44344678910279f23969b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc8d0d2ea04e2180f07dc5f29f58de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:58.055656 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ae33ef79-cc7a-4d79-989b-966a3b9ebd3e tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] 10.222.0.85 "GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0" status: 200 len: 1315 microversion: 2.1 time: 0.432144 Aug 24 10:49:58.056293 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3116/5886] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:57 2022] GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0 => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:58.091426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dfa13c75-b6a8-4aeb-9882-ef4159e2804f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:58.092144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dfa13c75-b6a8-4aeb-9882-ef4159e2804f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:58.098727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfa13c75-b6a8-4aeb-9882-ef4159e2804f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:58.099277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfa13c75-b6a8-4aeb-9882-ef4159e2804f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:58.099850 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfa13c75-b6a8-4aeb-9882-ef4159e2804f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:58.100559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfa13c75-b6a8-4aeb-9882-ef4159e2804f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:58.101017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfa13c75-b6a8-4aeb-9882-ef4159e2804f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:58.101701 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfa13c75-b6a8-4aeb-9882-ef4159e2804f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:58.254210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dfa13c75-b6a8-4aeb-9882-ef4159e2804f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:58.269981 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dfa13c75-b6a8-4aeb-9882-ef4159e2804f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1691 microversion: 2.1 time: 0.181807 Aug 24 10:49:58.269981 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2771/5887] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:58 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:49:59.078708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a4f1a6c0-942a-4a89-b341-ffe0d9616c09 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:59.080973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a4f1a6c0-942a-4a89-b341-ffe0d9616c09 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] [instance: e791498e-c777-4a92-b5f2-7df63f56d8f0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:59.089515 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4f1a6c0-942a-4a89-b341-ffe0d9616c09 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:59.090260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4f1a6c0-942a-4a89-b341-ffe0d9616c09 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:59.090702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4f1a6c0-942a-4a89-b341-ffe0d9616c09 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:59.091425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4f1a6c0-942a-4a89-b341-ffe0d9616c09 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:59.091889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4f1a6c0-942a-4a89-b341-ffe0d9616c09 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:59.092320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4f1a6c0-942a-4a89-b341-ffe0d9616c09 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:59.293035 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-37ccbc89-e84c-430f-a80d-76897fcaf3d0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:59.294521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-37ccbc89-e84c-430f-a80d-76897fcaf3d0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:59.303827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37ccbc89-e84c-430f-a80d-76897fcaf3d0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:59.303827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37ccbc89-e84c-430f-a80d-76897fcaf3d0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:59.304152 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37ccbc89-e84c-430f-a80d-76897fcaf3d0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:59.304934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37ccbc89-e84c-430f-a80d-76897fcaf3d0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:59.305419 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37ccbc89-e84c-430f-a80d-76897fcaf3d0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:59.306132 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37ccbc89-e84c-430f-a80d-76897fcaf3d0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:59.353992 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a4f1a6c0-942a-4a89-b341-ffe0d9616c09 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f251299ac44344678910279f23969b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc8d0d2ea04e2180f07dc5f29f58de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:59.363203 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a4f1a6c0-942a-4a89-b341-ffe0d9616c09 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] 10.222.0.85 "GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0" status: 200 len: 1463 microversion: 2.1 time: 0.291151 Aug 24 10:49:59.364458 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3117/5888] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:59 2022] GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0 => generated 1463 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:49:59.423140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e526824a-3a21-4d4f-9ce3-10b555367beb tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:59.423909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e526824a-3a21-4d4f-9ce3-10b555367beb tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] [instance: e791498e-c777-4a92-b5f2-7df63f56d8f0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:59.442244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e526824a-3a21-4d4f-9ce3-10b555367beb tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:59.442754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e526824a-3a21-4d4f-9ce3-10b555367beb tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:59.443194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e526824a-3a21-4d4f-9ce3-10b555367beb tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:59.444597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e526824a-3a21-4d4f-9ce3-10b555367beb tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:59.445082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e526824a-3a21-4d4f-9ce3-10b555367beb tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:59.446674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e526824a-3a21-4d4f-9ce3-10b555367beb tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:59.467273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:59.490300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e526824a-3a21-4d4f-9ce3-10b555367beb tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] [instance: e791498e-c777-4a92-b5f2-7df63f56d8f0] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:49:59.627060 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e526824a-3a21-4d4f-9ce3-10b555367beb tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] 10.222.0.85 "DELETE /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0" status: 204 len: 0 microversion: 2.1 time: 0.214889 Aug 24 10:49:59.627935 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3118/5889] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:49:59 2022] DELETE /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:49:59.639306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9eca65be-c48f-436a-bfa2-4ff2c2bab45d tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:49:59.640890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9eca65be-c48f-436a-bfa2-4ff2c2bab45d tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] [instance: e791498e-c777-4a92-b5f2-7df63f56d8f0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:49:59.653562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9eca65be-c48f-436a-bfa2-4ff2c2bab45d tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:59.653562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9eca65be-c48f-436a-bfa2-4ff2c2bab45d tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:59.653562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9eca65be-c48f-436a-bfa2-4ff2c2bab45d tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:59.654024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9eca65be-c48f-436a-bfa2-4ff2c2bab45d tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:49:59.661592 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37ccbc89-e84c-430f-a80d-76897fcaf3d0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:49:59.662115 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9eca65be-c48f-436a-bfa2-4ff2c2bab45d tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:49:59.668898 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9eca65be-c48f-436a-bfa2-4ff2c2bab45d tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:49:59.670711 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-37ccbc89-e84c-430f-a80d-76897fcaf3d0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1696 microversion: 2.1 time: 0.378534 Aug 24 10:49:59.671397 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2772/5890] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:59 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1696 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:50:00.005289 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9eca65be-c48f-436a-bfa2-4ff2c2bab45d tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f251299ac44344678910279f23969b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc8d0d2ea04e2180f07dc5f29f58de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:00.019416 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9eca65be-c48f-436a-bfa2-4ff2c2bab45d tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] 10.222.0.85 "GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0" status: 200 len: 1469 microversion: 2.1 time: 0.386181 Aug 24 10:50:00.021193 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3119/5891] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:49:59 2022] GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0 => generated 1469 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:00.698957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-14790efa-be4a-4e29-bddc-705673a21291 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:00.699750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-14790efa-be4a-4e29-bddc-705673a21291 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:00.721899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:00.725051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14790efa-be4a-4e29-bddc-705673a21291 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:00.726280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14790efa-be4a-4e29-bddc-705673a21291 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:00.726941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14790efa-be4a-4e29-bddc-705673a21291 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:00.728113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14790efa-be4a-4e29-bddc-705673a21291 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:00.730802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14790efa-be4a-4e29-bddc-705673a21291 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:00.731534 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14790efa-be4a-4e29-bddc-705673a21291 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:01.011157 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-14790efa-be4a-4e29-bddc-705673a21291 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:01.023002 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-14790efa-be4a-4e29-bddc-705673a21291 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1696 microversion: 2.1 time: 0.327900 Aug 24 10:50:01.024986 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2773/5892] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:00 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1696 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:50:01.040027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-57a2b7a4-da9c-4e7b-8348-bdf0d0bed6ac tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:01.040762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-57a2b7a4-da9c-4e7b-8348-bdf0d0bed6ac tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] [instance: e791498e-c777-4a92-b5f2-7df63f56d8f0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:01.044375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:01.057986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57a2b7a4-da9c-4e7b-8348-bdf0d0bed6ac tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:01.058948 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57a2b7a4-da9c-4e7b-8348-bdf0d0bed6ac tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:01.059599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57a2b7a4-da9c-4e7b-8348-bdf0d0bed6ac tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:01.060516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57a2b7a4-da9c-4e7b-8348-bdf0d0bed6ac tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:01.061177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57a2b7a4-da9c-4e7b-8348-bdf0d0bed6ac tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:01.061796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57a2b7a4-da9c-4e7b-8348-bdf0d0bed6ac tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:01.355752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-57a2b7a4-da9c-4e7b-8348-bdf0d0bed6ac tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f251299ac44344678910279f23969b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc8d0d2ea04e2180f07dc5f29f58de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:01.363511 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-57a2b7a4-da9c-4e7b-8348-bdf0d0bed6ac tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] 10.222.0.85 "GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0" status: 200 len: 1469 microversion: 2.1 time: 0.327379 Aug 24 10:50:01.366566 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3120/5893] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:01 2022] GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0 => generated 1469 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:01.916581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e5b4a925-afe2-4136-87b4-56d58c89c076 req-8612451f-0da7-400f-9e9c-d17ce9d41724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e791498e-c777-4a92-b5f2-7df63f56d8f0", "name": "network-vif-deleted", "tag": "0a0ee588-fb2f-44ac-9da7-b90bbee65238"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:50:01.954029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e5b4a925-afe2-4136-87b4-56d58c89c076 req-8612451f-0da7-400f-9e9c-d17ce9d41724 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:01.959767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e5b4a925-afe2-4136-87b4-56d58c89c076 req-8612451f-0da7-400f-9e9c-d17ce9d41724 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:01.961435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e5b4a925-afe2-4136-87b4-56d58c89c076 req-8612451f-0da7-400f-9e9c-d17ce9d41724 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:02.007195 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e5b4a925-afe2-4136-87b4-56d58c89c076 req-8612451f-0da7-400f-9e9c-d17ce9d41724 service nova] Creating event network-vif-deleted:0a0ee588-fb2f-44ac-9da7-b90bbee65238 for instance e791498e-c777-4a92-b5f2-7df63f56d8f0 on n-h1-849328-3 Aug 24 10:50:02.037448 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e5b4a925-afe2-4136-87b4-56d58c89c076 req-8612451f-0da7-400f-9e9c-d17ce9d41724 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134048 Aug 24 10:50:02.038075 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2774/5894] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:50:02.051970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7ad8d4d7-f5db-4279-9cd9-10719134eb1d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:02.053920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7ad8d4d7-f5db-4279-9cd9-10719134eb1d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:02.070564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ad8d4d7-f5db-4279-9cd9-10719134eb1d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:02.072188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ad8d4d7-f5db-4279-9cd9-10719134eb1d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:02.072835 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ad8d4d7-f5db-4279-9cd9-10719134eb1d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:02.076031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ad8d4d7-f5db-4279-9cd9-10719134eb1d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:02.081703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ad8d4d7-f5db-4279-9cd9-10719134eb1d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:02.084433 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ad8d4d7-f5db-4279-9cd9-10719134eb1d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:02.343261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7ad8d4d7-f5db-4279-9cd9-10719134eb1d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:02.357294 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7ad8d4d7-f5db-4279-9cd9-10719134eb1d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1696 microversion: 2.1 time: 0.309169 Aug 24 10:50:02.364790 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3121/5895] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:02 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1696 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:02.409094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-84babc76-9879-4e25-8816-9bf344ecad11 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:02.410140 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-84babc76-9879-4e25-8816-9bf344ecad11 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] [instance: e791498e-c777-4a92-b5f2-7df63f56d8f0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:02.418719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84babc76-9879-4e25-8816-9bf344ecad11 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:02.419509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84babc76-9879-4e25-8816-9bf344ecad11 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:02.421466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84babc76-9879-4e25-8816-9bf344ecad11 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:02.422266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84babc76-9879-4e25-8816-9bf344ecad11 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:02.422744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84babc76-9879-4e25-8816-9bf344ecad11 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:02.423296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84babc76-9879-4e25-8816-9bf344ecad11 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:02.462789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84babc76-9879-4e25-8816-9bf344ecad11 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:02.463318 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84babc76-9879-4e25-8816-9bf344ecad11 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:02.464394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84babc76-9879-4e25-8816-9bf344ecad11 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:02.465138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-84babc76-9879-4e25-8816-9bf344ecad11 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lazy-loading 'fault' on Instance uuid e791498e-c777-4a92-b5f2-7df63f56d8f0 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:50:02.525182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-84babc76-9879-4e25-8816-9bf344ecad11 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f251299ac44344678910279f23969b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cc8d0d2ea04e2180f07dc5f29f58de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:02.546011 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-84babc76-9879-4e25-8816-9bf344ecad11 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] 10.222.0.85 "GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0" status: 200 len: 1305 microversion: 2.1 time: 0.150666 Aug 24 10:50:02.547819 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2775/5896] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:02 2022] GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0 => generated 1305 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:03.383091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9d993010-48ac-45cd-9a9e-3ac54413b4f8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:03.383875 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9d993010-48ac-45cd-9a9e-3ac54413b4f8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:03.391635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d993010-48ac-45cd-9a9e-3ac54413b4f8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:03.392226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d993010-48ac-45cd-9a9e-3ac54413b4f8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:03.392742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d993010-48ac-45cd-9a9e-3ac54413b4f8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:03.393659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d993010-48ac-45cd-9a9e-3ac54413b4f8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:03.394193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d993010-48ac-45cd-9a9e-3ac54413b4f8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:03.394828 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d993010-48ac-45cd-9a9e-3ac54413b4f8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:03.576417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f988f35e-580e-46fc-9aa8-0e61ddc0ea84 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:03.577359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f988f35e-580e-46fc-9aa8-0e61ddc0ea84 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] [instance: e791498e-c777-4a92-b5f2-7df63f56d8f0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:03.601865 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f988f35e-580e-46fc-9aa8-0e61ddc0ea84 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:03.602375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f988f35e-580e-46fc-9aa8-0e61ddc0ea84 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:03.605262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f988f35e-580e-46fc-9aa8-0e61ddc0ea84 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:03.609028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f988f35e-580e-46fc-9aa8-0e61ddc0ea84 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:03.611258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f988f35e-580e-46fc-9aa8-0e61ddc0ea84 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:03.612660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f988f35e-580e-46fc-9aa8-0e61ddc0ea84 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:03.673927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9d993010-48ac-45cd-9a9e-3ac54413b4f8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:03.683173 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9d993010-48ac-45cd-9a9e-3ac54413b4f8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1696 microversion: 2.1 time: 0.304107 Aug 24 10:50:03.686551 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3122/5897] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:03 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1696 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:03.697591 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-f988f35e-580e-46fc-9aa8-0e61ddc0ea84 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] HTTP exception thrown: Instance e791498e-c777-4a92-b5f2-7df63f56d8f0 could not be found. Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f988f35e-580e-46fc-9aa8-0e61ddc0ea84 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Request method failure captured: Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0 HTTP/1.1 Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgJGGjpvtV3vW2TksgwAO7lM_qsRboJ4-Mm-Nea_y1MhqB2Ogjj7QzexR80GzXDiblA3aB6mGIZiUwOZZgnBrbvMrX8tOP-aoWG_dxgJSjcikvqzteH187gBLJQa2o6KWWkuNn0KF4mivjsyvScNGhuH3EkZ-Lu4BIKJb9fm3EKf2X4 Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: c1cc8d0d2ea04e2180f07dc5f29f58de Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-VolumesNegativeTest-420497558 Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c1cc8d0d2ea04e2180f07dc5f29f58de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c1cc8d0d2ea04e2180f07dc5f29f58de", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c1cc8d0d2ea04e2180f07dc5f29f58de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c1cc8d0d2ea04e2180f07dc5f29f58de"}]}] Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-VolumesNegativeTest-420497558 Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: c1cc8d0d2ea04e2180f07dc5f29f58de Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-VolumesNegativeTest-420497558 Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-VolumesNegativeTest-420497558-project Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: f251299ac44344678910279f23969b7d Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-VolumesNegativeTest-420497558-project Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance e791498e-c777-4a92-b5f2-7df63f56d8f0 could not be found. Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'e791498e-c777-4a92-b5f2-7df63f56d8f0'} Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e791498e-c777-4a92-b5f2-7df63f56d8f0 could not be found. Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e791498e-c777-4a92-b5f2-7df63f56d8f0 could not be found. Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:50:03.703363 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:50:03.707852 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:50:03.707852 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:50:03.707852 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:50:03.707852 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:50:03.707852 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:50:03.707852 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e791498e-c777-4a92-b5f2-7df63f56d8f0 could not be found. Aug 24 10:50:03.707852 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:50:03.709184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f988f35e-580e-46fc-9aa8-0e61ddc0ea84 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] Returning 404 to user: Instance e791498e-c777-4a92-b5f2-7df63f56d8f0 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:50:03.710236 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f988f35e-580e-46fc-9aa8-0e61ddc0ea84 tempest-VolumesNegativeTest-420497558 tempest-VolumesNegativeTest-420497558-project] 10.222.0.85 "GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0" status: 404 len: 111 microversion: 2.1 time: 0.138679 Aug 24 10:50:03.718418 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2776/5898] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:03 2022] GET /compute/v2.1/servers/e791498e-c777-4a92-b5f2-7df63f56d8f0 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:50:04.733097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6e2d103c-b97f-43ad-9d3c-bf81dc38fed2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:04.733097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6e2d103c-b97f-43ad-9d3c-bf81dc38fed2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:04.753822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e2d103c-b97f-43ad-9d3c-bf81dc38fed2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:04.754327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e2d103c-b97f-43ad-9d3c-bf81dc38fed2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:04.760761 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e2d103c-b97f-43ad-9d3c-bf81dc38fed2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:04.770357 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e2d103c-b97f-43ad-9d3c-bf81dc38fed2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:04.773089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e2d103c-b97f-43ad-9d3c-bf81dc38fed2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:04.773658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e2d103c-b97f-43ad-9d3c-bf81dc38fed2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:05.691555 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6e2d103c-b97f-43ad-9d3c-bf81dc38fed2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:05.710396 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6e2d103c-b97f-43ad-9d3c-bf81dc38fed2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1696 microversion: 2.1 time: 0.994933 Aug 24 10:50:05.711624 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3123/5899] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:04 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1696 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:06.733439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5397b7ce-a83d-449d-b3fe-1237d228191a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:06.734071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5397b7ce-a83d-449d-b3fe-1237d228191a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:06.751772 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5397b7ce-a83d-449d-b3fe-1237d228191a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:06.752711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5397b7ce-a83d-449d-b3fe-1237d228191a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:06.753370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5397b7ce-a83d-449d-b3fe-1237d228191a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:06.754283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5397b7ce-a83d-449d-b3fe-1237d228191a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:06.755075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5397b7ce-a83d-449d-b3fe-1237d228191a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:06.755664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5397b7ce-a83d-449d-b3fe-1237d228191a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:06.957373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5397b7ce-a83d-449d-b3fe-1237d228191a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:06.979928 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5397b7ce-a83d-449d-b3fe-1237d228191a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1696 microversion: 2.1 time: 0.251179 Aug 24 10:50:06.981932 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2777/5900] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:06 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1696 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:08.010078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d899d317-f9e2-4666-afac-8d8caf0ac9e8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:08.010841 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d899d317-f9e2-4666-afac-8d8caf0ac9e8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:08.022907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d899d317-f9e2-4666-afac-8d8caf0ac9e8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:08.023463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d899d317-f9e2-4666-afac-8d8caf0ac9e8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:08.028591 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d899d317-f9e2-4666-afac-8d8caf0ac9e8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:08.029461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d899d317-f9e2-4666-afac-8d8caf0ac9e8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:08.031136 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d899d317-f9e2-4666-afac-8d8caf0ac9e8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:08.031489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d899d317-f9e2-4666-afac-8d8caf0ac9e8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:08.329415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d899d317-f9e2-4666-afac-8d8caf0ac9e8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:08.343323 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d899d317-f9e2-4666-afac-8d8caf0ac9e8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1696 microversion: 2.1 time: 0.338307 Aug 24 10:50:08.345575 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3124/5901] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:08 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1696 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:09.369064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-826d6bb0-24ac-4910-82d4-917086b288de tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:09.370209 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-826d6bb0-24ac-4910-82d4-917086b288de tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:09.383645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-826d6bb0-24ac-4910-82d4-917086b288de tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:09.384523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-826d6bb0-24ac-4910-82d4-917086b288de tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:09.385327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-826d6bb0-24ac-4910-82d4-917086b288de tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:09.386824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-826d6bb0-24ac-4910-82d4-917086b288de tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:09.387487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-826d6bb0-24ac-4910-82d4-917086b288de tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:09.388073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-826d6bb0-24ac-4910-82d4-917086b288de tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:09.833304 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-826d6bb0-24ac-4910-82d4-917086b288de tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:09.850215 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-826d6bb0-24ac-4910-82d4-917086b288de tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1696 microversion: 2.1 time: 0.487450 Aug 24 10:50:09.853922 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2778/5902] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:09 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1696 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:10.875680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-08982f8e-3fc9-4c4a-beec-5de8cc1fbae7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:10.878352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-08982f8e-3fc9-4c4a-beec-5de8cc1fbae7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:10.895348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08982f8e-3fc9-4c4a-beec-5de8cc1fbae7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:10.899313 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08982f8e-3fc9-4c4a-beec-5de8cc1fbae7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:10.901395 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08982f8e-3fc9-4c4a-beec-5de8cc1fbae7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:10.902393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08982f8e-3fc9-4c4a-beec-5de8cc1fbae7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:10.904208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08982f8e-3fc9-4c4a-beec-5de8cc1fbae7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:10.911138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08982f8e-3fc9-4c4a-beec-5de8cc1fbae7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:11.247421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-08982f8e-3fc9-4c4a-beec-5de8cc1fbae7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:11.257217 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-08982f8e-3fc9-4c4a-beec-5de8cc1fbae7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1696 microversion: 2.1 time: 0.385569 Aug 24 10:50:11.258482 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3125/5903] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:10 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1696 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:12.289907 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3652ee23-1d5f-42e5-951b-64d090baee92 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:12.290937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3652ee23-1d5f-42e5-951b-64d090baee92 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:12.318227 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3652ee23-1d5f-42e5-951b-64d090baee92 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:12.328315 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3652ee23-1d5f-42e5-951b-64d090baee92 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:12.328762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3652ee23-1d5f-42e5-951b-64d090baee92 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:12.329707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3652ee23-1d5f-42e5-951b-64d090baee92 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:12.330525 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3652ee23-1d5f-42e5-951b-64d090baee92 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:12.330975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3652ee23-1d5f-42e5-951b-64d090baee92 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:12.559029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3652ee23-1d5f-42e5-951b-64d090baee92 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:12.573827 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3652ee23-1d5f-42e5-951b-64d090baee92 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1696 microversion: 2.1 time: 0.291794 Aug 24 10:50:12.586691 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2779/5904] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:12 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1696 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:13.615186 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-52ba8333-8979-4389-8dca-8d8f56ea7dd9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:13.616383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-52ba8333-8979-4389-8dca-8d8f56ea7dd9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:13.627422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52ba8333-8979-4389-8dca-8d8f56ea7dd9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:13.631696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52ba8333-8979-4389-8dca-8d8f56ea7dd9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:13.633747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52ba8333-8979-4389-8dca-8d8f56ea7dd9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:13.636925 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52ba8333-8979-4389-8dca-8d8f56ea7dd9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:13.637685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52ba8333-8979-4389-8dca-8d8f56ea7dd9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:13.639249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52ba8333-8979-4389-8dca-8d8f56ea7dd9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:13.998918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-52ba8333-8979-4389-8dca-8d8f56ea7dd9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:14.019414 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-52ba8333-8979-4389-8dca-8d8f56ea7dd9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1696 microversion: 2.1 time: 0.408970 Aug 24 10:50:14.030984 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3126/5905] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:13 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1696 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:14.779467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4fc6e7bc-2713-4068-8ad3-6384a5bff4ab tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1027705215", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "a3e80f9f-e114-4a19-9151-b3c4f0d53535", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9996d4a7-fe50-441a-b919-9c80031d0109"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:50:14.876882 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-4fc6e7bc-2713-4068-8ad3-6384a5bff4ab tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] validate_networks() for [('9996d4a7-fe50-441a-b919-9c80031d0109', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:50:15.045792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-859855b2-d295-445e-829c-de62d1d755e2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:15.047480 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-859855b2-d295-445e-829c-de62d1d755e2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:15.056118 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-859855b2-d295-445e-829c-de62d1d755e2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:15.057612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-859855b2-d295-445e-829c-de62d1d755e2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:15.058393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-859855b2-d295-445e-829c-de62d1d755e2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:15.059084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-859855b2-d295-445e-829c-de62d1d755e2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:15.059547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-859855b2-d295-445e-829c-de62d1d755e2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:15.060232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-859855b2-d295-445e-829c-de62d1d755e2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:15.256268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-859855b2-d295-445e-829c-de62d1d755e2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:15.269335 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-859855b2-d295-445e-829c-de62d1d755e2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1696 microversion: 2.1 time: 0.228375 Aug 24 10:50:15.273335 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3127/5906] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:15 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1696 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:15.793911 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-4fc6e7bc-2713-4068-8ad3-6384a5bff4ab tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:50:15.795694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-4fc6e7bc-2713-4068-8ad3-6384a5bff4ab tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:50:15.796407 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-4fc6e7bc-2713-4068-8ad3-6384a5bff4ab tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:50:15.797031 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-4fc6e7bc-2713-4068-8ad3-6384a5bff4ab tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:50:15.797677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-4fc6e7bc-2713-4068-8ad3-6384a5bff4ab tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:50:15.825353 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fc6e7bc-2713-4068-8ad3-6384a5bff4ab tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:15.833666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fc6e7bc-2713-4068-8ad3-6384a5bff4ab tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:15.834366 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fc6e7bc-2713-4068-8ad3-6384a5bff4ab tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:15.835341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fc6e7bc-2713-4068-8ad3-6384a5bff4ab tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:15.836083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fc6e7bc-2713-4068-8ad3-6384a5bff4ab tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:15.836700 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fc6e7bc-2713-4068-8ad3-6384a5bff4ab tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:15.866254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-4fc6e7bc-2713-4068-8ad3-6384a5bff4ab tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Getting quotas for project d1785d661bbd41619a7046600ad435b1. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:50:15.889061 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-4fc6e7bc-2713-4068-8ad3-6384a5bff4ab tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Getting quotas for user 26b7ff61eab4477890d20977574e8dac and project d1785d661bbd41619a7046600ad435b1. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:50:16.046700 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4fc6e7bc-2713-4068-8ad3-6384a5bff4ab tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:50:16.049256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4fc6e7bc-2713-4068-8ad3-6384a5bff4ab tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 284f904c-d55f-4ffe-a53f-87db05f0cd30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a3e80f9f-e114-4a19-9151-b3c4f0d53535',volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:50:16.294027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ce93cf93-eb46-4260-b280-7abb9b2be0fa tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:16.296912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ce93cf93-eb46-4260-b280-7abb9b2be0fa tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:16.318956 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce93cf93-eb46-4260-b280-7abb9b2be0fa tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:16.319877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce93cf93-eb46-4260-b280-7abb9b2be0fa tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:16.323064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce93cf93-eb46-4260-b280-7abb9b2be0fa tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:16.323854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce93cf93-eb46-4260-b280-7abb9b2be0fa tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:16.324325 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce93cf93-eb46-4260-b280-7abb9b2be0fa tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:16.327583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce93cf93-eb46-4260-b280-7abb9b2be0fa tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:16.426804 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4fc6e7bc-2713-4068-8ad3-6384a5bff4ab tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.655336 Aug 24 10:50:16.427796 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2780/5907] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:50:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:50:16.901379 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-48f97bad-13d7-4394-8305-bb4b6161c43e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Action: 'create', calling method: .version_select at 0x7f4647e68310>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-427861830", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvkrcyzanLQopQe+JWF+VJGVT9OYPLV1tAspyA6Uzk94NHM6MX946zTOx32wFHIjqy+pIUzYTap9vhO3t8gcZ09R1V2gqlLx0H2zkU5ZYrDFBwo13VcsSWE+BjNck8GDA=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:50:16.937464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-48f97bad-13d7-4394-8305-bb4b6161c43e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Getting quotas for project 5566add1862d44f5be270fcefeb1a4bf. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:50:16.953598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-48f97bad-13d7-4394-8305-bb4b6161c43e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Getting quotas for user 7465bc2e09b4455b8cee5e8aeb11dbb9 and project 5566add1862d44f5be270fcefeb1a4bf. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:50:17.010280 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-48f97bad-13d7-4394-8305-bb4b6161c43e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.579898 Aug 24 10:50:17.013009 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2781/5908] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:50:16 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:50:17.026642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-da98173f-ba46-4c3c-922e-ac72dd81ef90 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:17.036107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-da98173f-ba46-4c3c-922e-ac72dd81ef90 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 284f904c-d55f-4ffe-a53f-87db05f0cd30] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:17.276841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-da98173f-ba46-4c3c-922e-ac72dd81ef90 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:17.285371 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-da98173f-ba46-4c3c-922e-ac72dd81ef90 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30" status: 200 len: 1057 microversion: 2.1 time: 0.268485 Aug 24 10:50:17.288289 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2782/5909] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:17 2022] GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30 => generated 1057 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:17.722491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ce93cf93-eb46-4260-b280-7abb9b2be0fa tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:17.738369 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ce93cf93-eb46-4260-b280-7abb9b2be0fa tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1696 microversion: 2.1 time: 1.449445 Aug 24 10:50:17.739002 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3128/5910] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:16 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1696 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:50:17.932242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-4c7be5f7-436a-4f44-892f-63b292deb0e6 req-abaaeafc-8181-47a9-aebb-ef29e9fb6d90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0933a3-a042-41c2-a901-172e9c89dd03", "name": "network-vif-unplugged", "status": "completed", "tag": "7d58f5cd-e9e0-4d8a-a4f6-61ac70ae8a3c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:50:17.972229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4c7be5f7-436a-4f44-892f-63b292deb0e6 req-abaaeafc-8181-47a9-aebb-ef29e9fb6d90 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:17.972765 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4c7be5f7-436a-4f44-892f-63b292deb0e6 req-abaaeafc-8181-47a9-aebb-ef29e9fb6d90 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:17.973241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4c7be5f7-436a-4f44-892f-63b292deb0e6 req-abaaeafc-8181-47a9-aebb-ef29e9fb6d90 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:17.996815 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-4c7be5f7-436a-4f44-892f-63b292deb0e6 req-abaaeafc-8181-47a9-aebb-ef29e9fb6d90 service nova] Creating event network-vif-unplugged:7d58f5cd-e9e0-4d8a-a4f6-61ac70ae8a3c for instance ef0933a3-a042-41c2-a901-172e9c89dd03 on n-h2-849328-3 Aug 24 10:50:18.016138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-4c7be5f7-436a-4f44-892f-63b292deb0e6 req-abaaeafc-8181-47a9-aebb-ef29e9fb6d90 service nova] Instance ef0933a3-a042-41c2-a901-172e9c89dd03 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 10:50:18.064570 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-4c7be5f7-436a-4f44-892f-63b292deb0e6 req-abaaeafc-8181-47a9-aebb-ef29e9fb6d90 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145844 Aug 24 10:50:18.065549 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2783/5911] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:50:18.318401 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3127f491-3937-4bb6-9c8f-79e45b70f009 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:18.319038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3127f491-3937-4bb6-9c8f-79e45b70f009 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 284f904c-d55f-4ffe-a53f-87db05f0cd30] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:18.329981 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3127f491-3937-4bb6-9c8f-79e45b70f009 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:18.330774 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3127f491-3937-4bb6-9c8f-79e45b70f009 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:18.330966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3127f491-3937-4bb6-9c8f-79e45b70f009 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:18.338709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3127f491-3937-4bb6-9c8f-79e45b70f009 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:18.339457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3127f491-3937-4bb6-9c8f-79e45b70f009 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:18.340057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3127f491-3937-4bb6-9c8f-79e45b70f009 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:18.491503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3127f491-3937-4bb6-9c8f-79e45b70f009 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:18.506826 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3127f491-3937-4bb6-9c8f-79e45b70f009 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30" status: 200 len: 1163 microversion: 2.1 time: 0.192378 Aug 24 10:50:18.507646 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3129/5912] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:18 2022] GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30 => generated 1163 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:50:18.760766 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-18f87918-19b8-4aa4-8bde-2a6816b437cf tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:18.761672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-18f87918-19b8-4aa4-8bde-2a6816b437cf tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:18.773173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18f87918-19b8-4aa4-8bde-2a6816b437cf tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:18.775450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18f87918-19b8-4aa4-8bde-2a6816b437cf tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:18.778252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18f87918-19b8-4aa4-8bde-2a6816b437cf tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:18.783278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18f87918-19b8-4aa4-8bde-2a6816b437cf tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:18.783787 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18f87918-19b8-4aa4-8bde-2a6816b437cf tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:18.785557 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18f87918-19b8-4aa4-8bde-2a6816b437cf tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:18.798726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:19.530460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-30e3b05b-f476-4314-98c1-18c6aebf5d78 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:19.531405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-30e3b05b-f476-4314-98c1-18c6aebf5d78 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 284f904c-d55f-4ffe-a53f-87db05f0cd30] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:19.544146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30e3b05b-f476-4314-98c1-18c6aebf5d78 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:19.544674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30e3b05b-f476-4314-98c1-18c6aebf5d78 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:19.545105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30e3b05b-f476-4314-98c1-18c6aebf5d78 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:19.545883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30e3b05b-f476-4314-98c1-18c6aebf5d78 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:19.546344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30e3b05b-f476-4314-98c1-18c6aebf5d78 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:19.549478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30e3b05b-f476-4314-98c1-18c6aebf5d78 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:19.620173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-18f87918-19b8-4aa4-8bde-2a6816b437cf tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:19.637779 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-18f87918-19b8-4aa4-8bde-2a6816b437cf tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1695 microversion: 2.1 time: 0.881258 Aug 24 10:50:19.638695 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2784/5913] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:18 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1695 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:19.819073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-30e3b05b-f476-4314-98c1-18c6aebf5d78 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:19.838521 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-30e3b05b-f476-4314-98c1-18c6aebf5d78 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30" status: 200 len: 1173 microversion: 2.1 time: 0.312095 Aug 24 10:50:19.839154 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3130/5914] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:19 2022] GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30 => generated 1173 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:20.282306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-cb93749d-62e9-4e87-8405-781028a65034 req-a65931f7-7022-4af9-84c6-aa7d5d62c859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef0933a3-a042-41c2-a901-172e9c89dd03", "tag": "7d58f5cd-e9e0-4d8a-a4f6-61ac70ae8a3c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:50:20.296272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cb93749d-62e9-4e87-8405-781028a65034 req-a65931f7-7022-4af9-84c6-aa7d5d62c859 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:20.297114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cb93749d-62e9-4e87-8405-781028a65034 req-a65931f7-7022-4af9-84c6-aa7d5d62c859 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:20.297589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cb93749d-62e9-4e87-8405-781028a65034 req-a65931f7-7022-4af9-84c6-aa7d5d62c859 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:20.318660 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-cb93749d-62e9-4e87-8405-781028a65034 req-a65931f7-7022-4af9-84c6-aa7d5d62c859 service nova] Creating event network-changed:7d58f5cd-e9e0-4d8a-a4f6-61ac70ae8a3c for instance ef0933a3-a042-41c2-a901-172e9c89dd03 on n-h2-849328-3 Aug 24 10:50:20.325368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-cb93749d-62e9-4e87-8405-781028a65034 req-a65931f7-7022-4af9-84c6-aa7d5d62c859 service nova] Instance ef0933a3-a042-41c2-a901-172e9c89dd03 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 10:50:20.339798 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-cb93749d-62e9-4e87-8405-781028a65034 req-a65931f7-7022-4af9-84c6-aa7d5d62c859 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062023 Aug 24 10:50:20.341147 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2785/5915] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:50:20.677655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6d6c37b1-b01d-4eaf-9439-3fc65e061ad7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:20.677655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6d6c37b1-b01d-4eaf-9439-3fc65e061ad7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:20.697531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d6c37b1-b01d-4eaf-9439-3fc65e061ad7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:20.699559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d6c37b1-b01d-4eaf-9439-3fc65e061ad7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:20.701522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d6c37b1-b01d-4eaf-9439-3fc65e061ad7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:20.703306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d6c37b1-b01d-4eaf-9439-3fc65e061ad7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:20.704748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d6c37b1-b01d-4eaf-9439-3fc65e061ad7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:20.705930 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d6c37b1-b01d-4eaf-9439-3fc65e061ad7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:20.860480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-286a3914-0dfb-49d1-b781-08ee9f092ab1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:20.861219 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-286a3914-0dfb-49d1-b781-08ee9f092ab1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 284f904c-d55f-4ffe-a53f-87db05f0cd30] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:20.868931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-286a3914-0dfb-49d1-b781-08ee9f092ab1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:20.869457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-286a3914-0dfb-49d1-b781-08ee9f092ab1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:20.870087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-286a3914-0dfb-49d1-b781-08ee9f092ab1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:20.871050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-286a3914-0dfb-49d1-b781-08ee9f092ab1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:20.871517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-286a3914-0dfb-49d1-b781-08ee9f092ab1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:20.871948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-286a3914-0dfb-49d1-b781-08ee9f092ab1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:20.962570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6d6c37b1-b01d-4eaf-9439-3fc65e061ad7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:20.972634 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6d6c37b1-b01d-4eaf-9439-3fc65e061ad7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1695 microversion: 2.1 time: 0.300620 Aug 24 10:50:20.985674 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3131/5916] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:20 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1695 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:21.086942 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-286a3914-0dfb-49d1-b781-08ee9f092ab1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:21.096842 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-286a3914-0dfb-49d1-b781-08ee9f092ab1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30" status: 200 len: 1173 microversion: 2.1 time: 0.240489 Aug 24 10:50:21.098331 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2786/5917] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:20 2022] GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30 => generated 1173 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:21.995595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8c1fc7d2-4a55-4e7c-a445-797838415739 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:21.996914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8c1fc7d2-4a55-4e7c-a445-797838415739 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:22.010326 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c1fc7d2-4a55-4e7c-a445-797838415739 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:22.010840 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c1fc7d2-4a55-4e7c-a445-797838415739 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:22.011317 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c1fc7d2-4a55-4e7c-a445-797838415739 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:22.012082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c1fc7d2-4a55-4e7c-a445-797838415739 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:22.012626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c1fc7d2-4a55-4e7c-a445-797838415739 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:22.018204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c1fc7d2-4a55-4e7c-a445-797838415739 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:22.119165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b0d1e966-b8bb-4024-8f0b-3a05e8ef62d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:22.119797 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b0d1e966-b8bb-4024-8f0b-3a05e8ef62d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 284f904c-d55f-4ffe-a53f-87db05f0cd30] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:22.136184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0d1e966-b8bb-4024-8f0b-3a05e8ef62d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:22.138766 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0d1e966-b8bb-4024-8f0b-3a05e8ef62d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:22.139544 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0d1e966-b8bb-4024-8f0b-3a05e8ef62d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:22.140491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0d1e966-b8bb-4024-8f0b-3a05e8ef62d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:22.148033 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0d1e966-b8bb-4024-8f0b-3a05e8ef62d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:22.149184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0d1e966-b8bb-4024-8f0b-3a05e8ef62d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:22.352439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8c1fc7d2-4a55-4e7c-a445-797838415739 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:22.360957 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8c1fc7d2-4a55-4e7c-a445-797838415739 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1693 microversion: 2.1 time: 0.369720 Aug 24 10:50:22.375828 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3132/5918] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:21 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1693 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:50:22.813865 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b0d1e966-b8bb-4024-8f0b-3a05e8ef62d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:22.838566 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b0d1e966-b8bb-4024-8f0b-3a05e8ef62d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30" status: 200 len: 1215 microversion: 2.1 time: 0.723355 Aug 24 10:50:22.839924 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2787/5919] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:22 2022] GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30 => generated 1215 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:50:23.387620 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3652485d-09b0-4e7b-98b5-f3f8c3684ed4 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:23.391064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3652485d-09b0-4e7b-98b5-f3f8c3684ed4 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:23.422816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3652485d-09b0-4e7b-98b5-f3f8c3684ed4 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:23.425207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3652485d-09b0-4e7b-98b5-f3f8c3684ed4 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:23.428858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3652485d-09b0-4e7b-98b5-f3f8c3684ed4 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:23.432279 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3652485d-09b0-4e7b-98b5-f3f8c3684ed4 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:23.437219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3652485d-09b0-4e7b-98b5-f3f8c3684ed4 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:23.441429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3652485d-09b0-4e7b-98b5-f3f8c3684ed4 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:23.572152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:23.864583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-afcbd033-668c-4989-b7e7-fe875bdc5b48 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:23.866589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-afcbd033-668c-4989-b7e7-fe875bdc5b48 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 284f904c-d55f-4ffe-a53f-87db05f0cd30] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:23.893725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afcbd033-668c-4989-b7e7-fe875bdc5b48 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:23.894693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afcbd033-668c-4989-b7e7-fe875bdc5b48 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:23.911798 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afcbd033-668c-4989-b7e7-fe875bdc5b48 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:23.913346 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afcbd033-668c-4989-b7e7-fe875bdc5b48 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:23.915106 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afcbd033-668c-4989-b7e7-fe875bdc5b48 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:23.917927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afcbd033-668c-4989-b7e7-fe875bdc5b48 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:24.787851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3652485d-09b0-4e7b-98b5-f3f8c3684ed4 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:24.809603 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3652485d-09b0-4e7b-98b5-f3f8c3684ed4 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1693 microversion: 2.1 time: 1.429061 Aug 24 10:50:24.826481 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3133/5920] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:23 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1693 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:24.832147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cf0e8efe-e3e5-408d-b909-1c4956dfafca tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:24.832985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cf0e8efe-e3e5-408d-b909-1c4956dfafca tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:24.845014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0e8efe-e3e5-408d-b909-1c4956dfafca tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:24.848635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0e8efe-e3e5-408d-b909-1c4956dfafca tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:24.849772 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0e8efe-e3e5-408d-b909-1c4956dfafca tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:24.860316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0e8efe-e3e5-408d-b909-1c4956dfafca tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:24.861277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0e8efe-e3e5-408d-b909-1c4956dfafca tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:24.861966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0e8efe-e3e5-408d-b909-1c4956dfafca tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:24.921629 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cf0e8efe-e3e5-408d-b909-1c4956dfafca tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece/ips" status: 200 len: 145 microversion: 2.1 time: 0.093244 Aug 24 10:50:24.926770 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3134/5921] 10.222.0.85 () {58 vars in 1248 bytes} [Wed Aug 24 10:50:24 2022] GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece/ips => generated 145 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:50:25.136901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-afcbd033-668c-4989-b7e7-fe875bdc5b48 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:25.171037 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-afcbd033-668c-4989-b7e7-fe875bdc5b48 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30" status: 200 len: 1215 microversion: 2.1 time: 1.311051 Aug 24 10:50:25.193513 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2788/5922] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:23 2022] GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30 => generated 1215 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:25.214288 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0c9b3a55-6953-47fc-bb50-2a36bba412ab req-a5e58d1f-57a8-4adf-afac-197ce21e49c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "284f904c-d55f-4ffe-a53f-87db05f0cd30", "tag": "f296267d-51ea-4b9e-8044-f6ab861d4689"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:50:25.253617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0c9b3a55-6953-47fc-bb50-2a36bba412ab req-a5e58d1f-57a8-4adf-afac-197ce21e49c5 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:25.254916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0c9b3a55-6953-47fc-bb50-2a36bba412ab req-a5e58d1f-57a8-4adf-afac-197ce21e49c5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:25.262961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0c9b3a55-6953-47fc-bb50-2a36bba412ab req-a5e58d1f-57a8-4adf-afac-197ce21e49c5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:25.296488 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0c9b3a55-6953-47fc-bb50-2a36bba412ab req-a5e58d1f-57a8-4adf-afac-197ce21e49c5 service nova] Creating event network-changed:f296267d-51ea-4b9e-8044-f6ab861d4689 for instance 284f904c-d55f-4ffe-a53f-87db05f0cd30 on n-h1-849328-3 Aug 24 10:50:25.309262 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0c9b3a55-6953-47fc-bb50-2a36bba412ab req-a5e58d1f-57a8-4adf-afac-197ce21e49c5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100300 Aug 24 10:50:25.310574 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3135/5923] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:50:25.854493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-42d139a3-d7d4-41f9-a5a7-4220709d6dd8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:25.855245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-42d139a3-d7d4-41f9-a5a7-4220709d6dd8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:25.859240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:25.891735 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42d139a3-d7d4-41f9-a5a7-4220709d6dd8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:25.892472 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42d139a3-d7d4-41f9-a5a7-4220709d6dd8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:25.896243 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42d139a3-d7d4-41f9-a5a7-4220709d6dd8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:25.899792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42d139a3-d7d4-41f9-a5a7-4220709d6dd8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:25.907767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42d139a3-d7d4-41f9-a5a7-4220709d6dd8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:25.908264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42d139a3-d7d4-41f9-a5a7-4220709d6dd8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:26.199174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a4a14418-1ad2-4fe4-897c-f7b7183df605 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:26.199918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a4a14418-1ad2-4fe4-897c-f7b7183df605 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 284f904c-d55f-4ffe-a53f-87db05f0cd30] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:26.250348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4a14418-1ad2-4fe4-897c-f7b7183df605 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:26.250908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4a14418-1ad2-4fe4-897c-f7b7183df605 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:26.251371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4a14418-1ad2-4fe4-897c-f7b7183df605 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:26.252120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4a14418-1ad2-4fe4-897c-f7b7183df605 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:26.252605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4a14418-1ad2-4fe4-897c-f7b7183df605 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:26.253052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4a14418-1ad2-4fe4-897c-f7b7183df605 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:26.530801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-42d139a3-d7d4-41f9-a5a7-4220709d6dd8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:26.545019 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-42d139a3-d7d4-41f9-a5a7-4220709d6dd8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1690 microversion: 2.1 time: 0.699003 Aug 24 10:50:26.546405 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2789/5924] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:25 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1690 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:26.599194 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5c31f3b2-1f44-497b-b04a-6b1b1c77054f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:50:26.600252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5c31f3b2-1f44-497b-b04a-6b1b1c77054f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:26.614881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c31f3b2-1f44-497b-b04a-6b1b1c77054f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:26.617997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c31f3b2-1f44-497b-b04a-6b1b1c77054f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:26.618977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c31f3b2-1f44-497b-b04a-6b1b1c77054f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:26.620422 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c31f3b2-1f44-497b-b04a-6b1b1c77054f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:26.622450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c31f3b2-1f44-497b-b04a-6b1b1c77054f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:26.624461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c31f3b2-1f44-497b-b04a-6b1b1c77054f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:26.815003 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5c31f3b2-1f44-497b-b04a-6b1b1c77054f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "POST /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03/action" status: 204 len: 0 microversion: 2.1 time: 0.234936 Aug 24 10:50:26.824771 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2790/5925] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:50:26 2022] POST /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03/action => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:50:26.842008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ee044dd6-7a83-49a6-a44e-fcd0bda26fed tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:26.845764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ee044dd6-7a83-49a6-a44e-fcd0bda26fed tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:26.866007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee044dd6-7a83-49a6-a44e-fcd0bda26fed tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:26.877876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee044dd6-7a83-49a6-a44e-fcd0bda26fed tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:26.879652 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee044dd6-7a83-49a6-a44e-fcd0bda26fed tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:26.880794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee044dd6-7a83-49a6-a44e-fcd0bda26fed tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:26.881627 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee044dd6-7a83-49a6-a44e-fcd0bda26fed tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:26.882241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee044dd6-7a83-49a6-a44e-fcd0bda26fed tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:27.287345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ee044dd6-7a83-49a6-a44e-fcd0bda26fed tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:27.302033 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=12 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:27.310210 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ee044dd6-7a83-49a6-a44e-fcd0bda26fed tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1690 microversion: 2.1 time: 0.482145 Aug 24 10:50:27.310843 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2791/5926] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:26 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1690 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:27.687255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a4a14418-1ad2-4fe4-897c-f7b7183df605 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:27.703774 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a4a14418-1ad2-4fe4-897c-f7b7183df605 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30" status: 200 len: 1215 microversion: 2.1 time: 1.506709 Aug 24 10:50:27.706500 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3136/5927] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:26 2022] GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30 => generated 1215 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:27.806803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-97d7386a-f419-449b-81f2-f17261797efc tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "656ac6b5-16b5-4f78-831a-0efe8539e7b9"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:50:27.809288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-97d7386a-f419-449b-81f2-f17261797efc tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:27.829319 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97d7386a-f419-449b-81f2-f17261797efc tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:27.829831 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97d7386a-f419-449b-81f2-f17261797efc tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:27.830285 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97d7386a-f419-449b-81f2-f17261797efc tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:27.831312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97d7386a-f419-449b-81f2-f17261797efc tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:27.831774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97d7386a-f419-449b-81f2-f17261797efc tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:27.832208 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97d7386a-f419-449b-81f2-f17261797efc tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:28.336120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8fbada5a-377c-4afa-9de1-0ad18af19c36 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:28.336749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8fbada5a-377c-4afa-9de1-0ad18af19c36 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:28.340757 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-97d7386a-f419-449b-81f2-f17261797efc tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "POST /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.537999 Aug 24 10:50:28.343133 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2792/5928] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Aug 24 10:50:27 2022] POST /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece/os-volume_attachments => generated 194 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:50:28.385172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fbada5a-377c-4afa-9de1-0ad18af19c36 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:28.389214 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fbada5a-377c-4afa-9de1-0ad18af19c36 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:28.390581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fbada5a-377c-4afa-9de1-0ad18af19c36 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:28.391526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fbada5a-377c-4afa-9de1-0ad18af19c36 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:28.394195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fbada5a-377c-4afa-9de1-0ad18af19c36 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:28.395492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fbada5a-377c-4afa-9de1-0ad18af19c36 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:28.730261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0e6afdd9-7c0a-41ab-afd2-6e88b63400d1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:28.730991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0e6afdd9-7c0a-41ab-afd2-6e88b63400d1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 284f904c-d55f-4ffe-a53f-87db05f0cd30] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:28.751674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e6afdd9-7c0a-41ab-afd2-6e88b63400d1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:28.751986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e6afdd9-7c0a-41ab-afd2-6e88b63400d1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:28.752433 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e6afdd9-7c0a-41ab-afd2-6e88b63400d1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:28.753183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e6afdd9-7c0a-41ab-afd2-6e88b63400d1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:28.753651 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e6afdd9-7c0a-41ab-afd2-6e88b63400d1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:28.754085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e6afdd9-7c0a-41ab-afd2-6e88b63400d1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:28.826022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8fbada5a-377c-4afa-9de1-0ad18af19c36 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:28.836006 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8fbada5a-377c-4afa-9de1-0ad18af19c36 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1690 microversion: 2.1 time: 0.506856 Aug 24 10:50:28.836886 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3137/5929] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:28 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1690 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:50:29.417654 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0e6afdd9-7c0a-41ab-afd2-6e88b63400d1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:29.432406 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0e6afdd9-7c0a-41ab-afd2-6e88b63400d1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30" status: 200 len: 1203 microversion: 2.1 time: 0.707960 Aug 24 10:50:29.433032 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2793/5930] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:28 2022] GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30 => generated 1203 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:29.858715 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-22442796-2bbf-43c9-a145-bc5c4026a2ef tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:29.860278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-22442796-2bbf-43c9-a145-bc5c4026a2ef tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:29.869265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22442796-2bbf-43c9-a145-bc5c4026a2ef tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:29.870223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22442796-2bbf-43c9-a145-bc5c4026a2ef tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:29.870929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22442796-2bbf-43c9-a145-bc5c4026a2ef tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:29.871828 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22442796-2bbf-43c9-a145-bc5c4026a2ef tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:29.872439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22442796-2bbf-43c9-a145-bc5c4026a2ef tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:29.873751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22442796-2bbf-43c9-a145-bc5c4026a2ef tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:30.458676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aaefed85-126a-46ba-9694-203ff136124b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:30.460043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aaefed85-126a-46ba-9694-203ff136124b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 284f904c-d55f-4ffe-a53f-87db05f0cd30] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:30.523459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaefed85-126a-46ba-9694-203ff136124b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:30.527288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaefed85-126a-46ba-9694-203ff136124b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:30.530552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaefed85-126a-46ba-9694-203ff136124b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:30.534224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaefed85-126a-46ba-9694-203ff136124b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:30.538462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaefed85-126a-46ba-9694-203ff136124b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:30.541691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaefed85-126a-46ba-9694-203ff136124b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:30.842826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-22442796-2bbf-43c9-a145-bc5c4026a2ef tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:30.857740 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-22442796-2bbf-43c9-a145-bc5c4026a2ef tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1690 microversion: 2.1 time: 1.002814 Aug 24 10:50:30.861911 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3138/5931] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:29 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1690 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:31.098835 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aaefed85-126a-46ba-9694-203ff136124b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:31.124509 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aaefed85-126a-46ba-9694-203ff136124b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30" status: 200 len: 1203 microversion: 2.1 time: 0.674235 Aug 24 10:50:31.139275 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2794/5932] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:30 2022] GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30 => generated 1203 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:31.883993 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f1d5f7af-70a5-494f-9a3b-48c079c36972 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:31.886107 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f1d5f7af-70a5-494f-9a3b-48c079c36972 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:31.905971 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=38 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:31.907824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1d5f7af-70a5-494f-9a3b-48c079c36972 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:31.908227 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1d5f7af-70a5-494f-9a3b-48c079c36972 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:31.908534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1d5f7af-70a5-494f-9a3b-48c079c36972 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:31.922402 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1d5f7af-70a5-494f-9a3b-48c079c36972 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:31.923100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1d5f7af-70a5-494f-9a3b-48c079c36972 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:31.923384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1d5f7af-70a5-494f-9a3b-48c079c36972 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:32.105095 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fe78b155-298f-4087-9a82-dea83a0dd7a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1742835842-access_point-77803226", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "141fd062-d141-41de-9d38-67e6e51df6d2"}], "key_name": "tempest-TestSecurityGroupsBasicOps-427861830", "security_groups": [{"name": "tempest-secgroup_access--1171077320"}, {"name": "tempest-secgroup_general--258214455"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:50:32.172875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:32.384287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f1d5f7af-70a5-494f-9a3b-48c079c36972 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:32.395845 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f1d5f7af-70a5-494f-9a3b-48c079c36972 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1682 microversion: 2.1 time: 0.516691 Aug 24 10:50:32.399641 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3139/5933] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:31 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1682 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:32.405074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-5942963b-582a-4bc4-bc1e-8e55fc99616d req-b5a305c1-09ff-49db-81d0-e121fdff3036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0933a3-a042-41c2-a901-172e9c89dd03", "name": "network-vif-plugged", "status": "completed", "tag": "7d58f5cd-e9e0-4d8a-a4f6-61ac70ae8a3c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:50:32.428153 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5942963b-582a-4bc4-bc1e-8e55fc99616d req-b5a305c1-09ff-49db-81d0-e121fdff3036 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:32.433965 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5942963b-582a-4bc4-bc1e-8e55fc99616d req-b5a305c1-09ff-49db-81d0-e121fdff3036 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:32.434599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5942963b-582a-4bc4-bc1e-8e55fc99616d req-b5a305c1-09ff-49db-81d0-e121fdff3036 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:32.468886 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-5942963b-582a-4bc4-bc1e-8e55fc99616d req-b5a305c1-09ff-49db-81d0-e121fdff3036 service nova] Creating event network-vif-plugged:7d58f5cd-e9e0-4d8a-a4f6-61ac70ae8a3c for instance ef0933a3-a042-41c2-a901-172e9c89dd03 on n-h2-849328-3 Aug 24 10:50:32.480807 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-5942963b-582a-4bc4-bc1e-8e55fc99616d req-b5a305c1-09ff-49db-81d0-e121fdff3036 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079633 Aug 24 10:50:32.483121 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3140/5934] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:50:32.498665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a83fa66a-28f8-4389-a09b-d85a35589598 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:32.507938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a83fa66a-28f8-4389-a09b-d85a35589598 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 284f904c-d55f-4ffe-a53f-87db05f0cd30] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:32.535988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a83fa66a-28f8-4389-a09b-d85a35589598 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:32.543994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a83fa66a-28f8-4389-a09b-d85a35589598 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:32.544472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a83fa66a-28f8-4389-a09b-d85a35589598 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:32.545298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a83fa66a-28f8-4389-a09b-d85a35589598 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:32.545765 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a83fa66a-28f8-4389-a09b-d85a35589598 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:32.563477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a83fa66a-28f8-4389-a09b-d85a35589598 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:32.652341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-fe78b155-298f-4087-9a82-dea83a0dd7a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] validate_networks() for [('141fd062-d141-41de-9d38-67e6e51df6d2', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:50:32.818292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a83fa66a-28f8-4389-a09b-d85a35589598 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:32.829877 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a83fa66a-28f8-4389-a09b-d85a35589598 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30" status: 200 len: 1203 microversion: 2.1 time: 0.345154 Aug 24 10:50:32.834937 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3141/5935] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:32 2022] GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30 => generated 1203 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:33.864420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4d3435fd-45d4-4c92-b672-3e37b133d8ed tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:33.865479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4d3435fd-45d4-4c92-b672-3e37b133d8ed tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 284f904c-d55f-4ffe-a53f-87db05f0cd30] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:33.884849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d3435fd-45d4-4c92-b672-3e37b133d8ed tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:33.885812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d3435fd-45d4-4c92-b672-3e37b133d8ed tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:33.886300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d3435fd-45d4-4c92-b672-3e37b133d8ed tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:33.894243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d3435fd-45d4-4c92-b672-3e37b133d8ed tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:33.894764 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d3435fd-45d4-4c92-b672-3e37b133d8ed tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:33.895222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d3435fd-45d4-4c92-b672-3e37b133d8ed tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:34.394162 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4d3435fd-45d4-4c92-b672-3e37b133d8ed tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:34.407283 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4d3435fd-45d4-4c92-b672-3e37b133d8ed tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30" status: 200 len: 1203 microversion: 2.1 time: 0.546817 Aug 24 10:50:34.421997 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3142/5936] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:33 2022] GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30 => generated 1203 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:50:34.688015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fe78b155-298f-4087-9a82-dea83a0dd7a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:50:34.688837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fe78b155-298f-4087-9a82-dea83a0dd7a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:50:34.689590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fe78b155-298f-4087-9a82-dea83a0dd7a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:50:34.690217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fe78b155-298f-4087-9a82-dea83a0dd7a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:50:34.691060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fe78b155-298f-4087-9a82-dea83a0dd7a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:50:34.709447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe78b155-298f-4087-9a82-dea83a0dd7a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:34.711013 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe78b155-298f-4087-9a82-dea83a0dd7a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:34.711726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe78b155-298f-4087-9a82-dea83a0dd7a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:34.713718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe78b155-298f-4087-9a82-dea83a0dd7a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:34.714656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe78b155-298f-4087-9a82-dea83a0dd7a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:34.717285 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe78b155-298f-4087-9a82-dea83a0dd7a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:34.754629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-fe78b155-298f-4087-9a82-dea83a0dd7a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Getting quotas for project 5566add1862d44f5be270fcefeb1a4bf. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:50:34.771906 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-fe78b155-298f-4087-9a82-dea83a0dd7a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Getting quotas for user 7465bc2e09b4455b8cee5e8aeb11dbb9 and project 5566add1862d44f5be270fcefeb1a4bf. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:50:34.788339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fe78b155-298f-4087-9a82-dea83a0dd7a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:50:34.793050 n-d-849328-3 devstack@n-api.service[122432]: WARNING nova.utils [None req-fe78b155-298f-4087-9a82-dea83a0dd7a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1742835842-access_point-77803226 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1742835842-ac Aug 24 10:50:34.793050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fe78b155-298f-4087-9a82-dea83a0dd7a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 5bf06a96-37db-4b6f-ad24-f5a10125701d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:50:34.907235 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fe78b155-298f-4087-9a82-dea83a0dd7a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 2.811072 Aug 24 10:50:34.908723 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2795/5937] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:50:32 2022] POST /compute/v2.1/servers => generated 457 bytes in 2814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:50:34.920991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b20941da-aad1-4815-9bd2-5b3bdf1d76cf tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:34.922132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b20941da-aad1-4815-9bd2-5b3bdf1d76cf tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 5bf06a96-37db-4b6f-ad24-f5a10125701d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:35.070780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b20941da-aad1-4815-9bd2-5b3bdf1d76cf tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:35.088650 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b20941da-aad1-4815-9bd2-5b3bdf1d76cf tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d" status: 200 len: 1292 microversion: 2.1 time: 0.171468 Aug 24 10:50:35.090316 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3143/5938] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:34 2022] GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d => generated 1292 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:35.430593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7a6fba4e-49ff-4451-b302-6e5367251043 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:35.431264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7a6fba4e-49ff-4451-b302-6e5367251043 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 284f904c-d55f-4ffe-a53f-87db05f0cd30] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:35.446336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a6fba4e-49ff-4451-b302-6e5367251043 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:35.446925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a6fba4e-49ff-4451-b302-6e5367251043 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:35.447361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a6fba4e-49ff-4451-b302-6e5367251043 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:35.448290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a6fba4e-49ff-4451-b302-6e5367251043 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:35.448932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a6fba4e-49ff-4451-b302-6e5367251043 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:35.449553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a6fba4e-49ff-4451-b302-6e5367251043 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:35.719953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7a6fba4e-49ff-4451-b302-6e5367251043 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:35.729299 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7a6fba4e-49ff-4451-b302-6e5367251043 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30" status: 200 len: 1203 microversion: 2.1 time: 0.302501 Aug 24 10:50:35.730643 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2796/5939] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:35 2022] GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30 => generated 1203 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:50:36.113651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-32486ada-cab0-477e-928d-a335f58548f9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:36.114852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-32486ada-cab0-477e-928d-a335f58548f9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 5bf06a96-37db-4b6f-ad24-f5a10125701d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:36.124272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32486ada-cab0-477e-928d-a335f58548f9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:36.125149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32486ada-cab0-477e-928d-a335f58548f9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:36.125900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32486ada-cab0-477e-928d-a335f58548f9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:36.126891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32486ada-cab0-477e-928d-a335f58548f9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:36.127619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32486ada-cab0-477e-928d-a335f58548f9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:36.128392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32486ada-cab0-477e-928d-a335f58548f9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:36.213216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-32486ada-cab0-477e-928d-a335f58548f9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:36.234380 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-32486ada-cab0-477e-928d-a335f58548f9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d" status: 200 len: 1344 microversion: 2.1 time: 0.124356 Aug 24 10:50:36.249766 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3144/5940] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:36 2022] GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d => generated 1344 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:50:36.751588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9e8a61fd-a8ff-406f-800b-9ab4b72b8d2d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:36.755596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9e8a61fd-a8ff-406f-800b-9ab4b72b8d2d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 284f904c-d55f-4ffe-a53f-87db05f0cd30] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:36.765938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e8a61fd-a8ff-406f-800b-9ab4b72b8d2d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:36.766773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e8a61fd-a8ff-406f-800b-9ab4b72b8d2d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:36.767432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e8a61fd-a8ff-406f-800b-9ab4b72b8d2d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:36.768420 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e8a61fd-a8ff-406f-800b-9ab4b72b8d2d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:36.769322 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e8a61fd-a8ff-406f-800b-9ab4b72b8d2d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:36.770129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e8a61fd-a8ff-406f-800b-9ab4b72b8d2d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:37.215871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-f98d297b-9a38-4e9c-a127-655aaf23ca02 req-5e7dfa56-efa7-4d61-b096-d6d4652e0449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "284f904c-d55f-4ffe-a53f-87db05f0cd30", "name": "network-vif-plugged", "status": "completed", "tag": "f296267d-51ea-4b9e-8044-f6ab861d4689"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:50:37.230920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f98d297b-9a38-4e9c-a127-655aaf23ca02 req-5e7dfa56-efa7-4d61-b096-d6d4652e0449 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:37.231787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f98d297b-9a38-4e9c-a127-655aaf23ca02 req-5e7dfa56-efa7-4d61-b096-d6d4652e0449 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:37.232829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f98d297b-9a38-4e9c-a127-655aaf23ca02 req-5e7dfa56-efa7-4d61-b096-d6d4652e0449 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:37.250121 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-f98d297b-9a38-4e9c-a127-655aaf23ca02 req-5e7dfa56-efa7-4d61-b096-d6d4652e0449 service nova] Creating event network-vif-plugged:f296267d-51ea-4b9e-8044-f6ab861d4689 for instance 284f904c-d55f-4ffe-a53f-87db05f0cd30 on n-h1-849328-3 Aug 24 10:50:37.259036 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-f98d297b-9a38-4e9c-a127-655aaf23ca02 req-5e7dfa56-efa7-4d61-b096-d6d4652e0449 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047689 Aug 24 10:50:37.260610 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3145/5941] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:50:37.269666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2ab3c438-e6b2-4155-a9d5-674dfb627988 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:37.270720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2ab3c438-e6b2-4155-a9d5-674dfb627988 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 5bf06a96-37db-4b6f-ad24-f5a10125701d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:37.276204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9e8a61fd-a8ff-406f-800b-9ab4b72b8d2d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:37.280298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ab3c438-e6b2-4155-a9d5-674dfb627988 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:37.281070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ab3c438-e6b2-4155-a9d5-674dfb627988 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:37.281683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ab3c438-e6b2-4155-a9d5-674dfb627988 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:37.282762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ab3c438-e6b2-4155-a9d5-674dfb627988 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:37.284207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ab3c438-e6b2-4155-a9d5-674dfb627988 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:37.284667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ab3c438-e6b2-4155-a9d5-674dfb627988 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:37.298095 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9e8a61fd-a8ff-406f-800b-9ab4b72b8d2d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30" status: 200 len: 1203 microversion: 2.1 time: 0.548501 Aug 24 10:50:37.304282 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2797/5942] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:36 2022] GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30 => generated 1203 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:37.416036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2ab3c438-e6b2-4155-a9d5-674dfb627988 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:37.426308 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2ab3c438-e6b2-4155-a9d5-674dfb627988 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d" status: 200 len: 1350 microversion: 2.1 time: 0.162272 Aug 24 10:50:37.427273 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3146/5943] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:37 2022] GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d => generated 1350 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:38.324201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-329ae1d7-ecd0-457e-95dc-f6d92d020d1f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:38.325484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-329ae1d7-ecd0-457e-95dc-f6d92d020d1f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 284f904c-d55f-4ffe-a53f-87db05f0cd30] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:38.333449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-329ae1d7-ecd0-457e-95dc-f6d92d020d1f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:38.334207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-329ae1d7-ecd0-457e-95dc-f6d92d020d1f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:38.334789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-329ae1d7-ecd0-457e-95dc-f6d92d020d1f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:38.335695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-329ae1d7-ecd0-457e-95dc-f6d92d020d1f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:38.336292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-329ae1d7-ecd0-457e-95dc-f6d92d020d1f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:38.336859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-329ae1d7-ecd0-457e-95dc-f6d92d020d1f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:38.461936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b08a6cec-53a3-4411-a7db-3f7f14b79cd8 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:38.462621 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b08a6cec-53a3-4411-a7db-3f7f14b79cd8 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 5bf06a96-37db-4b6f-ad24-f5a10125701d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:38.482870 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b08a6cec-53a3-4411-a7db-3f7f14b79cd8 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:38.483377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b08a6cec-53a3-4411-a7db-3f7f14b79cd8 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:38.483817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b08a6cec-53a3-4411-a7db-3f7f14b79cd8 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:38.484543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b08a6cec-53a3-4411-a7db-3f7f14b79cd8 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:38.484999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b08a6cec-53a3-4411-a7db-3f7f14b79cd8 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:38.485452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b08a6cec-53a3-4411-a7db-3f7f14b79cd8 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:38.649318 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-329ae1d7-ecd0-457e-95dc-f6d92d020d1f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:38.661679 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-329ae1d7-ecd0-457e-95dc-f6d92d020d1f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30" status: 200 len: 1203 microversion: 2.1 time: 0.341430 Aug 24 10:50:38.662449 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2798/5944] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:38 2022] GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30 => generated 1203 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:38.833008 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b08a6cec-53a3-4411-a7db-3f7f14b79cd8 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:38.843914 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b08a6cec-53a3-4411-a7db-3f7f14b79cd8 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d" status: 200 len: 1469 microversion: 2.1 time: 0.386254 Aug 24 10:50:38.844650 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3147/5945] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:38 2022] GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d => generated 1469 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:50:39.067302 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-7bda19c9-3cc1-4622-b562-4c955b4b0c1b req-bd61a0c9-b210-49e6-824d-ba91a7d24c9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bf06a96-37db-4b6f-ad24-f5a10125701d", "tag": "73a62d46-7d7c-4125-87a7-decdce4f8e2f"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:50:39.089624 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7bda19c9-3cc1-4622-b562-4c955b4b0c1b req-bd61a0c9-b210-49e6-824d-ba91a7d24c9c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:39.090095 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7bda19c9-3cc1-4622-b562-4c955b4b0c1b req-bd61a0c9-b210-49e6-824d-ba91a7d24c9c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:39.098068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7bda19c9-3cc1-4622-b562-4c955b4b0c1b req-bd61a0c9-b210-49e6-824d-ba91a7d24c9c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:39.130805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:39.140091 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7bda19c9-3cc1-4622-b562-4c955b4b0c1b req-bd61a0c9-b210-49e6-824d-ba91a7d24c9c service nova] Creating event network-changed:73a62d46-7d7c-4125-87a7-decdce4f8e2f for instance 5bf06a96-37db-4b6f-ad24-f5a10125701d on n-h2-849328-3 Aug 24 10:50:39.146773 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-7bda19c9-3cc1-4622-b562-4c955b4b0c1b req-bd61a0c9-b210-49e6-824d-ba91a7d24c9c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086964 Aug 24 10:50:39.148051 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2799/5946] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:50:39.698370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a69b0731-7dae-4dac-9a0d-245a1fed6bdb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:39.699013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a69b0731-7dae-4dac-9a0d-245a1fed6bdb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 284f904c-d55f-4ffe-a53f-87db05f0cd30] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:39.706767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a69b0731-7dae-4dac-9a0d-245a1fed6bdb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:39.707212 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a69b0731-7dae-4dac-9a0d-245a1fed6bdb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:39.707648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a69b0731-7dae-4dac-9a0d-245a1fed6bdb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:39.708868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a69b0731-7dae-4dac-9a0d-245a1fed6bdb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:39.709357 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a69b0731-7dae-4dac-9a0d-245a1fed6bdb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:39.709943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a69b0731-7dae-4dac-9a0d-245a1fed6bdb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:39.868797 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c0ae1781-6c6f-4566-a99a-8639c87ef6f6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:39.869542 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c0ae1781-6c6f-4566-a99a-8639c87ef6f6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 5bf06a96-37db-4b6f-ad24-f5a10125701d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:39.878195 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0ae1781-6c6f-4566-a99a-8639c87ef6f6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:39.879086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0ae1781-6c6f-4566-a99a-8639c87ef6f6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:39.880612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0ae1781-6c6f-4566-a99a-8639c87ef6f6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:39.881609 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0ae1781-6c6f-4566-a99a-8639c87ef6f6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:39.882221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0ae1781-6c6f-4566-a99a-8639c87ef6f6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:39.882848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0ae1781-6c6f-4566-a99a-8639c87ef6f6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:39.884584 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a69b0731-7dae-4dac-9a0d-245a1fed6bdb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:39.894485 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a69b0731-7dae-4dac-9a0d-245a1fed6bdb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30" status: 200 len: 1390 microversion: 2.1 time: 0.203385 Aug 24 10:50:39.895657 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3148/5947] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:39 2022] GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30 => generated 1390 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:39.916589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6ecc23a3-2e60-4707-9352-9e7365244539 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:39.917097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6ecc23a3-2e60-4707-9352-9e7365244539 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 284f904c-d55f-4ffe-a53f-87db05f0cd30] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:39.926246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ecc23a3-2e60-4707-9352-9e7365244539 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:39.927052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ecc23a3-2e60-4707-9352-9e7365244539 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:39.927509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ecc23a3-2e60-4707-9352-9e7365244539 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:39.928311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ecc23a3-2e60-4707-9352-9e7365244539 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:39.928883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ecc23a3-2e60-4707-9352-9e7365244539 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:39.929224 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ecc23a3-2e60-4707-9352-9e7365244539 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:40.129458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c0ae1781-6c6f-4566-a99a-8639c87ef6f6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:40.138077 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c0ae1781-6c6f-4566-a99a-8639c87ef6f6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d" status: 200 len: 1469 microversion: 2.1 time: 0.277335 Aug 24 10:50:40.141175 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2800/5948] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:39 2022] GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d => generated 1469 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:40.231277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6ecc23a3-2e60-4707-9352-9e7365244539 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:40.246865 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6ecc23a3-2e60-4707-9352-9e7365244539 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30" status: 200 len: 1390 microversion: 2.1 time: 0.334301 Aug 24 10:50:40.247817 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3149/5949] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:39 2022] GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30 => generated 1390 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:50:40.268182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d822e253-1105-4478-b828-8233fa999d2f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:40.268919 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d822e253-1105-4478-b828-8233fa999d2f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 284f904c-d55f-4ffe-a53f-87db05f0cd30] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:40.275376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d822e253-1105-4478-b828-8233fa999d2f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:40.276172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d822e253-1105-4478-b828-8233fa999d2f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:40.276674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d822e253-1105-4478-b828-8233fa999d2f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:40.277591 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d822e253-1105-4478-b828-8233fa999d2f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:40.278250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d822e253-1105-4478-b828-8233fa999d2f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:40.278839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d822e253-1105-4478-b828-8233fa999d2f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:40.462191 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d822e253-1105-4478-b828-8233fa999d2f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:40.470748 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d822e253-1105-4478-b828-8233fa999d2f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30" status: 200 len: 1390 microversion: 2.1 time: 0.206787 Aug 24 10:50:40.471343 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2801/5950] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:40 2022] GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30 => generated 1390 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:50:40.495973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e191b2af-6624-4a04-914a-81f47ae84d6c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:40.496568 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e191b2af-6624-4a04-914a-81f47ae84d6c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 284f904c-d55f-4ffe-a53f-87db05f0cd30] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:40.514225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e191b2af-6624-4a04-914a-81f47ae84d6c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:40.514704 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e191b2af-6624-4a04-914a-81f47ae84d6c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:40.514916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e191b2af-6624-4a04-914a-81f47ae84d6c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:40.515820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e191b2af-6624-4a04-914a-81f47ae84d6c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:40.516468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e191b2af-6624-4a04-914a-81f47ae84d6c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:40.516904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e191b2af-6624-4a04-914a-81f47ae84d6c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:40.544252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e191b2af-6624-4a04-914a-81f47ae84d6c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 284f904c-d55f-4ffe-a53f-87db05f0cd30] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:50:40.722037 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e191b2af-6624-4a04-914a-81f47ae84d6c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "DELETE /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30" status: 204 len: 0 microversion: 2.1 time: 0.231483 Aug 24 10:50:40.724262 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3150/5951] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:50:40 2022] DELETE /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:50:40.733025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-36f9ece8-63fa-4c3f-85e5-fee72a4b869f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:40.745622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-36f9ece8-63fa-4c3f-85e5-fee72a4b869f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 284f904c-d55f-4ffe-a53f-87db05f0cd30] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:40.752932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36f9ece8-63fa-4c3f-85e5-fee72a4b869f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:40.753721 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36f9ece8-63fa-4c3f-85e5-fee72a4b869f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:40.754269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36f9ece8-63fa-4c3f-85e5-fee72a4b869f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:40.754875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36f9ece8-63fa-4c3f-85e5-fee72a4b869f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:40.755333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36f9ece8-63fa-4c3f-85e5-fee72a4b869f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:40.755756 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36f9ece8-63fa-4c3f-85e5-fee72a4b869f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:41.000533 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-36f9ece8-63fa-4c3f-85e5-fee72a4b869f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:41.016811 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-36f9ece8-63fa-4c3f-85e5-fee72a4b869f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30" status: 200 len: 1396 microversion: 2.1 time: 0.287786 Aug 24 10:50:41.018845 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2802/5952] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:40 2022] GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30 => generated 1396 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:41.160132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-93b88149-c9fb-484b-aec0-755e693b88fb tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:41.161058 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-93b88149-c9fb-484b-aec0-755e693b88fb tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 5bf06a96-37db-4b6f-ad24-f5a10125701d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:41.168119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93b88149-c9fb-484b-aec0-755e693b88fb tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:41.169103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93b88149-c9fb-484b-aec0-755e693b88fb tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:41.169827 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93b88149-c9fb-484b-aec0-755e693b88fb tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:41.170543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93b88149-c9fb-484b-aec0-755e693b88fb tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:41.171051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93b88149-c9fb-484b-aec0-755e693b88fb tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:41.171470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93b88149-c9fb-484b-aec0-755e693b88fb tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:41.332981 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-93b88149-c9fb-484b-aec0-755e693b88fb tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:41.335418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:41.342683 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-93b88149-c9fb-484b-aec0-755e693b88fb tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d" status: 200 len: 1469 microversion: 2.1 time: 0.187049 Aug 24 10:50:41.356092 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3151/5953] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:41 2022] GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d => generated 1469 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:42.039345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5c43ff5f-b790-47ec-8b0e-33ea9d63a8a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:42.039923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5c43ff5f-b790-47ec-8b0e-33ea9d63a8a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 284f904c-d55f-4ffe-a53f-87db05f0cd30] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:42.047222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c43ff5f-b790-47ec-8b0e-33ea9d63a8a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:42.047693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c43ff5f-b790-47ec-8b0e-33ea9d63a8a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:42.048126 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c43ff5f-b790-47ec-8b0e-33ea9d63a8a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:42.048830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c43ff5f-b790-47ec-8b0e-33ea9d63a8a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:42.049315 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c43ff5f-b790-47ec-8b0e-33ea9d63a8a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:42.049742 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c43ff5f-b790-47ec-8b0e-33ea9d63a8a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:42.253775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5c43ff5f-b790-47ec-8b0e-33ea9d63a8a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:42.263725 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5c43ff5f-b790-47ec-8b0e-33ea9d63a8a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30" status: 200 len: 1396 microversion: 2.1 time: 0.228036 Aug 24 10:50:42.264553 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2803/5954] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:42 2022] GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30 => generated 1396 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:42.365492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-789d4297-fbb2-46c1-bf69-6c2fb6bab266 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:42.366740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-789d4297-fbb2-46c1-bf69-6c2fb6bab266 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 5bf06a96-37db-4b6f-ad24-f5a10125701d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:42.376869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-789d4297-fbb2-46c1-bf69-6c2fb6bab266 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:42.377532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-789d4297-fbb2-46c1-bf69-6c2fb6bab266 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:42.378043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-789d4297-fbb2-46c1-bf69-6c2fb6bab266 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:42.378832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-789d4297-fbb2-46c1-bf69-6c2fb6bab266 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:42.379355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-789d4297-fbb2-46c1-bf69-6c2fb6bab266 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:42.379849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-789d4297-fbb2-46c1-bf69-6c2fb6bab266 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:42.672828 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-789d4297-fbb2-46c1-bf69-6c2fb6bab266 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:42.684142 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-789d4297-fbb2-46c1-bf69-6c2fb6bab266 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d" status: 200 len: 1469 microversion: 2.1 time: 0.323082 Aug 24 10:50:42.685291 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3152/5955] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:42 2022] GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d => generated 1469 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:42.978012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bad8f88a-aa72-41ef-82c9-e0bc91b6cee6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:42.980304 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bad8f88a-aa72-41ef-82c9-e0bc91b6cee6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:43.000278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bad8f88a-aa72-41ef-82c9-e0bc91b6cee6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:43.004206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bad8f88a-aa72-41ef-82c9-e0bc91b6cee6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:43.005112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bad8f88a-aa72-41ef-82c9-e0bc91b6cee6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:43.005893 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bad8f88a-aa72-41ef-82c9-e0bc91b6cee6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:43.006363 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bad8f88a-aa72-41ef-82c9-e0bc91b6cee6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:43.006817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bad8f88a-aa72-41ef-82c9-e0bc91b6cee6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:43.043632 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bad8f88a-aa72-41ef-82c9-e0bc91b6cee6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070607 Aug 24 10:50:43.044587 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2804/5956] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:50:42 2022] GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:50:43.055962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-34d31e79-e65c-420d-896e-921154655111 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:43.056804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-34d31e79-e65c-420d-896e-921154655111 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:43.063746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34d31e79-e65c-420d-896e-921154655111 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:43.064448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34d31e79-e65c-420d-896e-921154655111 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:43.064921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34d31e79-e65c-420d-896e-921154655111 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:43.065664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34d31e79-e65c-420d-896e-921154655111 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:43.066277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34d31e79-e65c-420d-896e-921154655111 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:43.066894 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34d31e79-e65c-420d-896e-921154655111 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:43.104795 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-34d31e79-e65c-420d-896e-921154655111 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece/os-volume_attachments/656ac6b5-16b5-4f78-831a-0efe8539e7b9" status: 200 len: 194 microversion: 2.1 time: 0.053755 Aug 24 10:50:43.107352 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3153/5957] 10.222.0.85 () {58 vars in 1413 bytes} [Wed Aug 24 10:50:43 2022] GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece/os-volume_attachments/656ac6b5-16b5-4f78-831a-0efe8539e7b9 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:50:43.272915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-0734e3b0-2c4d-4c8d-ba88-626ce97e11a5 req-e835e189-826e-4211-99f3-72b77c366cac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "284f904c-d55f-4ffe-a53f-87db05f0cd30", "name": "network-vif-deleted", "tag": "f296267d-51ea-4b9e-8044-f6ab861d4689"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:50:43.287407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ac39fd9-741c-4c31-81aa-3bd4b794ec8b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:43.288145 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0ac39fd9-741c-4c31-81aa-3bd4b794ec8b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 284f904c-d55f-4ffe-a53f-87db05f0cd30] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:43.300005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ac39fd9-741c-4c31-81aa-3bd4b794ec8b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:43.303513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0734e3b0-2c4d-4c8d-ba88-626ce97e11a5 req-e835e189-826e-4211-99f3-72b77c366cac service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:43.308459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ac39fd9-741c-4c31-81aa-3bd4b794ec8b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:43.309032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ac39fd9-741c-4c31-81aa-3bd4b794ec8b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:43.309913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ac39fd9-741c-4c31-81aa-3bd4b794ec8b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:43.310553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0734e3b0-2c4d-4c8d-ba88-626ce97e11a5 req-e835e189-826e-4211-99f3-72b77c366cac service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:43.311092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ac39fd9-741c-4c31-81aa-3bd4b794ec8b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:43.311770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0734e3b0-2c4d-4c8d-ba88-626ce97e11a5 req-e835e189-826e-4211-99f3-72b77c366cac service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:43.312201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ac39fd9-741c-4c31-81aa-3bd4b794ec8b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:43.346753 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-0734e3b0-2c4d-4c8d-ba88-626ce97e11a5 req-e835e189-826e-4211-99f3-72b77c366cac service nova] Creating event network-vif-deleted:f296267d-51ea-4b9e-8044-f6ab861d4689 for instance 284f904c-d55f-4ffe-a53f-87db05f0cd30 on n-h1-849328-3 Aug 24 10:50:43.354672 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-0734e3b0-2c4d-4c8d-ba88-626ce97e11a5 req-e835e189-826e-4211-99f3-72b77c366cac service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085484 Aug 24 10:50:43.360119 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2805/5958] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:50:43.708512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a749140b-c927-4c51-b055-3dbf25ecad3a tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:43.709559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a749140b-c927-4c51-b055-3dbf25ecad3a tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 5bf06a96-37db-4b6f-ad24-f5a10125701d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:43.727057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a749140b-c927-4c51-b055-3dbf25ecad3a tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:43.727964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a749140b-c927-4c51-b055-3dbf25ecad3a tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:43.728836 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a749140b-c927-4c51-b055-3dbf25ecad3a tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:43.731762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a749140b-c927-4c51-b055-3dbf25ecad3a tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:43.732385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a749140b-c927-4c51-b055-3dbf25ecad3a tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:43.732934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a749140b-c927-4c51-b055-3dbf25ecad3a tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:43.857865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0ac39fd9-741c-4c31-81aa-3bd4b794ec8b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:43.876206 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0ac39fd9-741c-4c31-81aa-3bd4b794ec8b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30" status: 200 len: 1188 microversion: 2.1 time: 0.593774 Aug 24 10:50:43.892221 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3154/5959] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:43 2022] GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30 => generated 1188 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:43.981899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a749140b-c927-4c51-b055-3dbf25ecad3a tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:43.995271 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a749140b-c927-4c51-b055-3dbf25ecad3a tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d" status: 200 len: 1469 microversion: 2.1 time: 0.287615 Aug 24 10:50:43.996620 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2806/5960] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:43 2022] GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d => generated 1469 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:44.901701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-13d7a40a-3025-4d9b-9321-ca70c65cff78 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:44.903116 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-13d7a40a-3025-4d9b-9321-ca70c65cff78 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 284f904c-d55f-4ffe-a53f-87db05f0cd30] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:44.909884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13d7a40a-3025-4d9b-9321-ca70c65cff78 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:44.910960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13d7a40a-3025-4d9b-9321-ca70c65cff78 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:44.911662 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13d7a40a-3025-4d9b-9321-ca70c65cff78 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:44.912650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13d7a40a-3025-4d9b-9321-ca70c65cff78 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:44.913514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13d7a40a-3025-4d9b-9321-ca70c65cff78 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:44.914368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13d7a40a-3025-4d9b-9321-ca70c65cff78 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:45.021788 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8a9e70f2-dcbd-4cd5-88b4-c8f3d6a9a20d tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:45.024401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8a9e70f2-dcbd-4cd5-88b4-c8f3d6a9a20d tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 5bf06a96-37db-4b6f-ad24-f5a10125701d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:45.035279 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-13d7a40a-3025-4d9b-9321-ca70c65cff78 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:45.047300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:45.049614 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:45.055456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a9e70f2-dcbd-4cd5-88b4-c8f3d6a9a20d tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:45.059620 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a9e70f2-dcbd-4cd5-88b4-c8f3d6a9a20d tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:45.060145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a9e70f2-dcbd-4cd5-88b4-c8f3d6a9a20d tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:45.060959 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a9e70f2-dcbd-4cd5-88b4-c8f3d6a9a20d tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:45.063506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a9e70f2-dcbd-4cd5-88b4-c8f3d6a9a20d tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:45.064026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a9e70f2-dcbd-4cd5-88b4-c8f3d6a9a20d tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:45.065871 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-13d7a40a-3025-4d9b-9321-ca70c65cff78 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30" status: 200 len: 1188 microversion: 2.1 time: 0.170773 Aug 24 10:50:45.084028 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3155/5961] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:44 2022] GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30 => generated 1188 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:45.263615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8a9e70f2-dcbd-4cd5-88b4-c8f3d6a9a20d tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:45.281752 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8a9e70f2-dcbd-4cd5-88b4-c8f3d6a9a20d tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d" status: 200 len: 1469 microversion: 2.1 time: 0.261115 Aug 24 10:50:45.282486 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2807/5962] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:45 2022] GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d => generated 1469 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:45.543784 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-34ff0dcf-6b1f-4549-95d9-5273c72c078a req-0e61e9af-6e3b-40d0-b019-d5dfb1b41a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf06a96-37db-4b6f-ad24-f5a10125701d", "name": "network-vif-plugged", "status": "completed", "tag": "73a62d46-7d7c-4125-87a7-decdce4f8e2f"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:50:45.551672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:45.558170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-34ff0dcf-6b1f-4549-95d9-5273c72c078a req-0e61e9af-6e3b-40d0-b019-d5dfb1b41a45 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:45.559100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-34ff0dcf-6b1f-4549-95d9-5273c72c078a req-0e61e9af-6e3b-40d0-b019-d5dfb1b41a45 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:45.559905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-34ff0dcf-6b1f-4549-95d9-5273c72c078a req-0e61e9af-6e3b-40d0-b019-d5dfb1b41a45 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:45.579106 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-34ff0dcf-6b1f-4549-95d9-5273c72c078a req-0e61e9af-6e3b-40d0-b019-d5dfb1b41a45 service nova] Creating event network-vif-plugged:73a62d46-7d7c-4125-87a7-decdce4f8e2f for instance 5bf06a96-37db-4b6f-ad24-f5a10125701d on n-h2-849328-3 Aug 24 10:50:45.586220 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-34ff0dcf-6b1f-4549-95d9-5273c72c078a req-0e61e9af-6e3b-40d0-b019-d5dfb1b41a45 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046805 Aug 24 10:50:45.588486 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3156/5963] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:50:45.850690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8aef3b3b-07d7-45d4-a2e5-645dad0f89bf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a6352b5-606c-4cb5-9669-9af9b141fd03"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:50:45.854149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8aef3b3b-07d7-45d4-a2e5-645dad0f89bf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:45.862486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8aef3b3b-07d7-45d4-a2e5-645dad0f89bf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:45.863437 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8aef3b3b-07d7-45d4-a2e5-645dad0f89bf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:45.864299 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8aef3b3b-07d7-45d4-a2e5-645dad0f89bf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:45.865696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8aef3b3b-07d7-45d4-a2e5-645dad0f89bf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:45.866423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8aef3b3b-07d7-45d4-a2e5-645dad0f89bf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:45.867169 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8aef3b3b-07d7-45d4-a2e5-645dad0f89bf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:46.097143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-83e118ae-8609-479e-bd8d-76eb45c7bc56 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:46.098735 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-83e118ae-8609-479e-bd8d-76eb45c7bc56 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 284f904c-d55f-4ffe-a53f-87db05f0cd30] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:46.123379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83e118ae-8609-479e-bd8d-76eb45c7bc56 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:46.124647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83e118ae-8609-479e-bd8d-76eb45c7bc56 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:46.127704 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83e118ae-8609-479e-bd8d-76eb45c7bc56 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:46.128797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83e118ae-8609-479e-bd8d-76eb45c7bc56 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:46.129886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83e118ae-8609-479e-bd8d-76eb45c7bc56 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:46.130882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83e118ae-8609-479e-bd8d-76eb45c7bc56 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:46.271965 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-83e118ae-8609-479e-bd8d-76eb45c7bc56 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:46.283840 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-83e118ae-8609-479e-bd8d-76eb45c7bc56 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30" status: 200 len: 1188 microversion: 2.1 time: 0.192424 Aug 24 10:50:46.284715 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3157/5964] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:46 2022] GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30 => generated 1188 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:46.307073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9d9bb8fb-c738-4b44-b780-f3987bc4d48a tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:46.307809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9d9bb8fb-c738-4b44-b780-f3987bc4d48a tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 5bf06a96-37db-4b6f-ad24-f5a10125701d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:46.361352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d9bb8fb-c738-4b44-b780-f3987bc4d48a tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:46.364878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d9bb8fb-c738-4b44-b780-f3987bc4d48a tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:46.367167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d9bb8fb-c738-4b44-b780-f3987bc4d48a tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:46.372372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d9bb8fb-c738-4b44-b780-f3987bc4d48a tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:46.377529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d9bb8fb-c738-4b44-b780-f3987bc4d48a tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:46.379674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d9bb8fb-c738-4b44-b780-f3987bc4d48a tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:46.470323 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8aef3b3b-07d7-45d4-a2e5-645dad0f89bf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "POST /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.624203 Aug 24 10:50:46.472288 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2808/5965] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Aug 24 10:50:45 2022] POST /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece/os-volume_attachments => generated 194 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:50:46.838508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9d9bb8fb-c738-4b44-b780-f3987bc4d48a tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:46.871969 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9d9bb8fb-c738-4b44-b780-f3987bc4d48a tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d" status: 200 len: 1469 microversion: 2.1 time: 0.572055 Aug 24 10:50:46.872979 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3158/5966] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:46 2022] GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d => generated 1469 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:47.308099 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bb545757-895a-4efa-a138-3ca52ef785a7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:47.308870 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bb545757-895a-4efa-a138-3ca52ef785a7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 284f904c-d55f-4ffe-a53f-87db05f0cd30] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:47.321827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb545757-895a-4efa-a138-3ca52ef785a7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:47.322336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb545757-895a-4efa-a138-3ca52ef785a7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:47.322786 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb545757-895a-4efa-a138-3ca52ef785a7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:47.323509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb545757-895a-4efa-a138-3ca52ef785a7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:47.323979 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb545757-895a-4efa-a138-3ca52ef785a7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:47.324389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb545757-895a-4efa-a138-3ca52ef785a7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:47.452740 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bb545757-895a-4efa-a138-3ca52ef785a7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:47.461841 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bb545757-895a-4efa-a138-3ca52ef785a7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30" status: 200 len: 1188 microversion: 2.1 time: 0.159408 Aug 24 10:50:47.463128 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2809/5967] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:47 2022] GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30 => generated 1188 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:47.904073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-66723545-a40c-4eb2-9f9d-a7c82f94d1ea tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:47.905548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-66723545-a40c-4eb2-9f9d-a7c82f94d1ea tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 5bf06a96-37db-4b6f-ad24-f5a10125701d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:47.915031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66723545-a40c-4eb2-9f9d-a7c82f94d1ea tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:47.915817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66723545-a40c-4eb2-9f9d-a7c82f94d1ea tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:47.916606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66723545-a40c-4eb2-9f9d-a7c82f94d1ea tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:47.917476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66723545-a40c-4eb2-9f9d-a7c82f94d1ea tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:47.918217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66723545-a40c-4eb2-9f9d-a7c82f94d1ea tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:47.918869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66723545-a40c-4eb2-9f9d-a7c82f94d1ea tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:48.192802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-66723545-a40c-4eb2-9f9d-a7c82f94d1ea tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:48.205271 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-66723545-a40c-4eb2-9f9d-a7c82f94d1ea tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d" status: 200 len: 1640 microversion: 2.1 time: 0.305573 Aug 24 10:50:48.206680 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3159/5968] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:47 2022] GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d => generated 1640 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:48.229415 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f1cf6e97-2af7-4f2a-9d51-42e9c1967de6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:48.231914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f1cf6e97-2af7-4f2a-9d51-42e9c1967de6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 5bf06a96-37db-4b6f-ad24-f5a10125701d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:48.241173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1cf6e97-2af7-4f2a-9d51-42e9c1967de6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:48.241819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1cf6e97-2af7-4f2a-9d51-42e9c1967de6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:48.242263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1cf6e97-2af7-4f2a-9d51-42e9c1967de6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:48.244670 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1cf6e97-2af7-4f2a-9d51-42e9c1967de6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:48.245176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1cf6e97-2af7-4f2a-9d51-42e9c1967de6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:48.245617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1cf6e97-2af7-4f2a-9d51-42e9c1967de6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:48.447389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f1cf6e97-2af7-4f2a-9d51-42e9c1967de6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:48.457918 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f1cf6e97-2af7-4f2a-9d51-42e9c1967de6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d" status: 200 len: 1640 microversion: 2.1 time: 0.234093 Aug 24 10:50:48.475142 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2810/5969] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:48 2022] GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d => generated 1640 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:48.481140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3058e7f1-8141-418b-b98c-f2e22768a473 tempest-TestSecurityGroupsBasicOps-890088947 tempest-TestSecurityGroupsBasicOps-890088947-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:48.481792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3058e7f1-8141-418b-b98c-f2e22768a473 tempest-TestSecurityGroupsBasicOps-890088947 tempest-TestSecurityGroupsBasicOps-890088947-project-admin] [instance: 5bf06a96-37db-4b6f-ad24-f5a10125701d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:48.488875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1c83fa72-2a96-42ca-99c0-66e65f2b5881 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:48.489535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1c83fa72-2a96-42ca-99c0-66e65f2b5881 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 284f904c-d55f-4ffe-a53f-87db05f0cd30] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:48.496291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3058e7f1-8141-418b-b98c-f2e22768a473 tempest-TestSecurityGroupsBasicOps-890088947 tempest-TestSecurityGroupsBasicOps-890088947-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:48.496793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3058e7f1-8141-418b-b98c-f2e22768a473 tempest-TestSecurityGroupsBasicOps-890088947 tempest-TestSecurityGroupsBasicOps-890088947-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:48.497415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3058e7f1-8141-418b-b98c-f2e22768a473 tempest-TestSecurityGroupsBasicOps-890088947 tempest-TestSecurityGroupsBasicOps-890088947-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:48.498140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3058e7f1-8141-418b-b98c-f2e22768a473 tempest-TestSecurityGroupsBasicOps-890088947 tempest-TestSecurityGroupsBasicOps-890088947-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:48.498604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3058e7f1-8141-418b-b98c-f2e22768a473 tempest-TestSecurityGroupsBasicOps-890088947 tempest-TestSecurityGroupsBasicOps-890088947-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:48.499035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3058e7f1-8141-418b-b98c-f2e22768a473 tempest-TestSecurityGroupsBasicOps-890088947 tempest-TestSecurityGroupsBasicOps-890088947-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:48.510917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c83fa72-2a96-42ca-99c0-66e65f2b5881 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:48.511608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c83fa72-2a96-42ca-99c0-66e65f2b5881 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:48.512211 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c83fa72-2a96-42ca-99c0-66e65f2b5881 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:48.513111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c83fa72-2a96-42ca-99c0-66e65f2b5881 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:48.513752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c83fa72-2a96-42ca-99c0-66e65f2b5881 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:48.514504 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c83fa72-2a96-42ca-99c0-66e65f2b5881 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:48.617519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1c83fa72-2a96-42ca-99c0-66e65f2b5881 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:50:48.627180 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1c83fa72-2a96-42ca-99c0-66e65f2b5881 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30" status: 200 len: 1188 microversion: 2.1 time: 0.142117 Aug 24 10:50:48.628095 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2811/5970] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:48 2022] GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30 => generated 1188 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:49.162696 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3058e7f1-8141-418b-b98c-f2e22768a473 tempest-TestSecurityGroupsBasicOps-890088947 tempest-TestSecurityGroupsBasicOps-890088947-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d" status: 200 len: 1791 microversion: 2.1 time: 0.685620 Aug 24 10:50:49.163615 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3160/5971] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:48 2022] GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d => generated 1791 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:50:49.651826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3c2d8b95-9cf8-45a9-be4a-f47e1a8e0d60 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:49.652701 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3c2d8b95-9cf8-45a9-be4a-f47e1a8e0d60 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 284f904c-d55f-4ffe-a53f-87db05f0cd30] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:49.661658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c2d8b95-9cf8-45a9-be4a-f47e1a8e0d60 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:49.662741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c2d8b95-9cf8-45a9-be4a-f47e1a8e0d60 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:49.663323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c2d8b95-9cf8-45a9-be4a-f47e1a8e0d60 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:49.667212 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c2d8b95-9cf8-45a9-be4a-f47e1a8e0d60 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:49.673471 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c2d8b95-9cf8-45a9-be4a-f47e1a8e0d60 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:49.675808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c2d8b95-9cf8-45a9-be4a-f47e1a8e0d60 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:49.704839 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-3c2d8b95-9cf8-45a9-be4a-f47e1a8e0d60 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] HTTP exception thrown: Instance 284f904c-d55f-4ffe-a53f-87db05f0cd30 could not be found. Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3c2d8b95-9cf8-45a9-be4a-f47e1a8e0d60 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Request method failure captured: Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30 HTTP/1.1 Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgJaL-kWwlcIRB5LGdxUOg9NstdlrO4InCZtaIlL6zMAKoO2x9AaKw5QTM5Yc447Qz9dKY7jxkolr7Q3liCCaPxpGdqV4sv_A4_Emu-qJmA0z5hB1ngNyBGm9n-W2LyGX7LaKy8OE29M25iXwnWnUlWVb7vPgN3qX9b_bYxZIyExFQ4 Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d1785d661bbd41619a7046600ad435b1", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d1785d661bbd41619a7046600ad435b1"}]}] Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-TestVolumeBootPattern-1780678770-project Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 26b7ff61eab4477890d20977574e8dac Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-TestVolumeBootPattern-1780678770-project Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 284f904c-d55f-4ffe-a53f-87db05f0cd30 could not be found. Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '284f904c-d55f-4ffe-a53f-87db05f0cd30'} Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 284f904c-d55f-4ffe-a53f-87db05f0cd30 could not be found. Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 284f904c-d55f-4ffe-a53f-87db05f0cd30 could not be found. Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:50:49.709271 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:50:49.714036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:50:49.714036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:50:49.714036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:50:49.714036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:50:49.714036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:50:49.714036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 284f904c-d55f-4ffe-a53f-87db05f0cd30 could not be found. Aug 24 10:50:49.714036 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:50:49.716662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3c2d8b95-9cf8-45a9-be4a-f47e1a8e0d60 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Returning 404 to user: Instance 284f904c-d55f-4ffe-a53f-87db05f0cd30 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:50:49.717982 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3c2d8b95-9cf8-45a9-be4a-f47e1a8e0d60 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30" status: 404 len: 111 microversion: 2.1 time: 0.070714 Aug 24 10:50:49.719098 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2812/5972] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:49 2022] GET /compute/v2.1/servers/284f904c-d55f-4ffe-a53f-87db05f0cd30 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:50:52.148033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-319a07a8-ca78-453f-9043-0fed77c36274 req-1494df2e-1a7d-4be8-9d37-3dd64c21b226 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bf06a96-37db-4b6f-ad24-f5a10125701d", "tag": "73a62d46-7d7c-4125-87a7-decdce4f8e2f"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:50:52.174605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-319a07a8-ca78-453f-9043-0fed77c36274 req-1494df2e-1a7d-4be8-9d37-3dd64c21b226 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:52.175376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-319a07a8-ca78-453f-9043-0fed77c36274 req-1494df2e-1a7d-4be8-9d37-3dd64c21b226 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:52.175977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-319a07a8-ca78-453f-9043-0fed77c36274 req-1494df2e-1a7d-4be8-9d37-3dd64c21b226 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:52.209433 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-319a07a8-ca78-453f-9043-0fed77c36274 req-1494df2e-1a7d-4be8-9d37-3dd64c21b226 service nova] Creating event network-changed:73a62d46-7d7c-4125-87a7-decdce4f8e2f for instance 5bf06a96-37db-4b6f-ad24-f5a10125701d on n-h2-849328-3 Aug 24 10:50:52.219289 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-319a07a8-ca78-453f-9043-0fed77c36274 req-1494df2e-1a7d-4be8-9d37-3dd64c21b226 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074662 Aug 24 10:50:52.224296 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3161/5973] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:50:54.773991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b9faac1a-fcaf-4f6b-aaf1-96bffbf2f4e9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:50:54.778544 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b9faac1a-fcaf-4f6b-aaf1-96bffbf2f4e9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:50:54.789325 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9faac1a-fcaf-4f6b-aaf1-96bffbf2f4e9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:54.790475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9faac1a-fcaf-4f6b-aaf1-96bffbf2f4e9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:54.791183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9faac1a-fcaf-4f6b-aaf1-96bffbf2f4e9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:54.793175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9faac1a-fcaf-4f6b-aaf1-96bffbf2f4e9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:54.793952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9faac1a-fcaf-4f6b-aaf1-96bffbf2f4e9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:54.794609 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9faac1a-fcaf-4f6b-aaf1-96bffbf2f4e9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:54.864211 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b9faac1a-fcaf-4f6b-aaf1-96bffbf2f4e9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "POST /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03/action" status: 200 len: 24564 microversion: 2.1 time: 0.094610 Aug 24 10:50:54.865358 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2813/5974] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:50:54 2022] POST /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03/action => generated 24564 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:50:58.721612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-456fe768-3bb5-4f9e-ab4e-985e74bd7f1e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-185299519", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9d9f2c30-63e4-49ab-bc65-0e78e3f11ea0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9996d4a7-fe50-441a-b919-9c80031d0109"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:50:58.851921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-456fe768-3bb5-4f9e-ab4e-985e74bd7f1e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] validate_networks() for [('9996d4a7-fe50-441a-b919-9c80031d0109', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:50:59.403026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-456fe768-3bb5-4f9e-ab4e-985e74bd7f1e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:50:59.403629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-456fe768-3bb5-4f9e-ab4e-985e74bd7f1e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:50:59.404199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-456fe768-3bb5-4f9e-ab4e-985e74bd7f1e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:50:59.404781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-456fe768-3bb5-4f9e-ab4e-985e74bd7f1e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:50:59.405403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-456fe768-3bb5-4f9e-ab4e-985e74bd7f1e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:50:59.418676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-456fe768-3bb5-4f9e-ab4e-985e74bd7f1e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:59.419752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-456fe768-3bb5-4f9e-ab4e-985e74bd7f1e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:59.420431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-456fe768-3bb5-4f9e-ab4e-985e74bd7f1e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:59.421770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-456fe768-3bb5-4f9e-ab4e-985e74bd7f1e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:50:59.422511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-456fe768-3bb5-4f9e-ab4e-985e74bd7f1e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:50:59.422945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-456fe768-3bb5-4f9e-ab4e-985e74bd7f1e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:50:59.459857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-456fe768-3bb5-4f9e-ab4e-985e74bd7f1e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Getting quotas for project d1785d661bbd41619a7046600ad435b1. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:50:59.485739 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-456fe768-3bb5-4f9e-ab4e-985e74bd7f1e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Getting quotas for user 26b7ff61eab4477890d20977574e8dac and project d1785d661bbd41619a7046600ad435b1. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:50:59.639675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-456fe768-3bb5-4f9e-ab4e-985e74bd7f1e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:50:59.642155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-456fe768-3bb5-4f9e-ab4e-985e74bd7f1e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9d9f2c30-63e4-49ab-bc65-0e78e3f11ea0',volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:50:59.868948 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-456fe768-3bb5-4f9e-ab4e-985e74bd7f1e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.155834 Aug 24 10:50:59.870589 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3162/5975] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:50:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1159 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:50:59.886910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5225e555-233a-4c0b-a0d1-078e87c480a2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:50:59.887799 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5225e555-233a-4c0b-a0d1-078e87c480a2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:00.026098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5225e555-233a-4c0b-a0d1-078e87c480a2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:00.033779 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5225e555-233a-4c0b-a0d1-078e87c480a2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1056 microversion: 2.1 time: 0.155652 Aug 24 10:51:00.049678 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2814/5976] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:50:59 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1056 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:51:01.069073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-38fabbb1-96eb-415d-ad85-7e7f9bf52567 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:01.070990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-38fabbb1-96eb-415d-ad85-7e7f9bf52567 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:01.089100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38fabbb1-96eb-415d-ad85-7e7f9bf52567 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:01.089100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38fabbb1-96eb-415d-ad85-7e7f9bf52567 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:01.095747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38fabbb1-96eb-415d-ad85-7e7f9bf52567 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:01.095747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38fabbb1-96eb-415d-ad85-7e7f9bf52567 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:01.095747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38fabbb1-96eb-415d-ad85-7e7f9bf52567 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:01.095747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38fabbb1-96eb-415d-ad85-7e7f9bf52567 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:01.194613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-38fabbb1-96eb-415d-ad85-7e7f9bf52567 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:01.203435 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-38fabbb1-96eb-415d-ad85-7e7f9bf52567 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1154 microversion: 2.1 time: 0.149237 Aug 24 10:51:01.204617 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3163/5977] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:01 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1154 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:01.469617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ee7d93f1-377d-46cd-a4c5-22ca44de77be tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:01.473230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ee7d93f1-377d-46cd-a4c5-22ca44de77be tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:01.483222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee7d93f1-377d-46cd-a4c5-22ca44de77be tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:01.484124 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee7d93f1-377d-46cd-a4c5-22ca44de77be tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:01.484969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee7d93f1-377d-46cd-a4c5-22ca44de77be tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:01.485634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee7d93f1-377d-46cd-a4c5-22ca44de77be tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:01.486188 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee7d93f1-377d-46cd-a4c5-22ca44de77be tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:01.486779 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee7d93f1-377d-46cd-a4c5-22ca44de77be tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:01.556526 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ee7d93f1-377d-46cd-a4c5-22ca44de77be tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.090797 Aug 24 10:51:01.566538 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2815/5978] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:51:01 2022] GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece/os-volume_attachments => generated 371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:51:01.706681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-138c2b23-09f5-40c1-8850-8d9278c2019c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:01.707612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-138c2b23-09f5-40c1-8850-8d9278c2019c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:01.719970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-138c2b23-09f5-40c1-8850-8d9278c2019c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:01.722563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-138c2b23-09f5-40c1-8850-8d9278c2019c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:01.723431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-138c2b23-09f5-40c1-8850-8d9278c2019c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:01.724357 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-138c2b23-09f5-40c1-8850-8d9278c2019c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:01.731092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-138c2b23-09f5-40c1-8850-8d9278c2019c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:01.733900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-138c2b23-09f5-40c1-8850-8d9278c2019c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:01.813109 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-138c2b23-09f5-40c1-8850-8d9278c2019c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece/os-volume_attachments/656ac6b5-16b5-4f78-831a-0efe8539e7b9" status: 200 len: 194 microversion: 2.1 time: 0.113384 Aug 24 10:51:01.814008 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3164/5979] 10.222.0.85 () {58 vars in 1413 bytes} [Wed Aug 24 10:51:01 2022] GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece/os-volume_attachments/656ac6b5-16b5-4f78-831a-0efe8539e7b9 => generated 194 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:51:01.827176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3ff17905-ec00-4614-9bbe-368944ae6a0b tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:01.827520 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3ff17905-ec00-4614-9bbe-368944ae6a0b tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:01.835887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ff17905-ec00-4614-9bbe-368944ae6a0b tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:01.836379 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ff17905-ec00-4614-9bbe-368944ae6a0b tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:01.836816 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ff17905-ec00-4614-9bbe-368944ae6a0b tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:01.837605 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ff17905-ec00-4614-9bbe-368944ae6a0b tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:01.838049 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ff17905-ec00-4614-9bbe-368944ae6a0b tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:01.838466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ff17905-ec00-4614-9bbe-368944ae6a0b tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:02.020123 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-3ff17905-ec00-4614-9bbe-368944ae6a0b tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lazy-loading 'services' on Instance uuid 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:51:02.162048 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3ff17905-ec00-4614-9bbe-368944ae6a0b tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "DELETE /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece/os-volume_attachments/656ac6b5-16b5-4f78-831a-0efe8539e7b9" status: 202 len: 0 microversion: 2.1 time: 0.339098 Aug 24 10:51:02.172907 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2816/5980] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Aug 24 10:51:01 2022] DELETE /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece/os-volume_attachments/656ac6b5-16b5-4f78-831a-0efe8539e7b9 => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:51:02.225632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-07a45223-8908-4631-9ab7-779cd20b4e63 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:02.226405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-07a45223-8908-4631-9ab7-779cd20b4e63 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:02.229285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:02.243995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07a45223-8908-4631-9ab7-779cd20b4e63 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:02.244511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07a45223-8908-4631-9ab7-779cd20b4e63 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:02.244961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07a45223-8908-4631-9ab7-779cd20b4e63 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:02.245867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07a45223-8908-4631-9ab7-779cd20b4e63 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:02.246328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07a45223-8908-4631-9ab7-779cd20b4e63 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:02.246758 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07a45223-8908-4631-9ab7-779cd20b4e63 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:02.364845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-07a45223-8908-4631-9ab7-779cd20b4e63 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:02.377457 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-07a45223-8908-4631-9ab7-779cd20b4e63 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1172 microversion: 2.1 time: 0.155736 Aug 24 10:51:02.378742 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3165/5981] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:02 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1172 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:03.404931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b7d3f414-d2be-458b-a591-635a56e2c2fb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:03.406231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b7d3f414-d2be-458b-a591-635a56e2c2fb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:03.410458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:03.420963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7d3f414-d2be-458b-a591-635a56e2c2fb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:03.421513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7d3f414-d2be-458b-a591-635a56e2c2fb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:03.421951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7d3f414-d2be-458b-a591-635a56e2c2fb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:03.422677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7d3f414-d2be-458b-a591-635a56e2c2fb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:03.424206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7d3f414-d2be-458b-a591-635a56e2c2fb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:03.424655 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7d3f414-d2be-458b-a591-635a56e2c2fb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:03.432031 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:03.546314 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b7d3f414-d2be-458b-a591-635a56e2c2fb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:03.560029 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b7d3f414-d2be-458b-a591-635a56e2c2fb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1172 microversion: 2.1 time: 0.163515 Aug 24 10:51:03.574306 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2817/5982] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:03 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1172 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:04.583176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-678fd2de-dbbf-4405-93d7-0902d9cf5856 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:04.584101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-678fd2de-dbbf-4405-93d7-0902d9cf5856 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:04.600209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-678fd2de-dbbf-4405-93d7-0902d9cf5856 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:04.601345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-678fd2de-dbbf-4405-93d7-0902d9cf5856 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:04.602245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-678fd2de-dbbf-4405-93d7-0902d9cf5856 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:04.604216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-678fd2de-dbbf-4405-93d7-0902d9cf5856 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:04.605028 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-678fd2de-dbbf-4405-93d7-0902d9cf5856 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:04.606319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-678fd2de-dbbf-4405-93d7-0902d9cf5856 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:04.959398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-678fd2de-dbbf-4405-93d7-0902d9cf5856 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:04.969871 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-678fd2de-dbbf-4405-93d7-0902d9cf5856 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1214 microversion: 2.1 time: 0.391082 Aug 24 10:51:04.971144 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3166/5983] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:04 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1214 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:05.013178 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c73990a4-7814-4e9c-afc3-7410c56a1da1 req-b8f05191-3226-489b-8aff-c53969430c32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1abbc720-b508-4aee-90f0-4f5c673b2941", "tag": "392e3af5-66bc-4a92-9708-7c9d206860f2"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:51:05.027988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c73990a4-7814-4e9c-afc3-7410c56a1da1 req-b8f05191-3226-489b-8aff-c53969430c32 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:05.028580 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c73990a4-7814-4e9c-afc3-7410c56a1da1 req-b8f05191-3226-489b-8aff-c53969430c32 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:05.029091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c73990a4-7814-4e9c-afc3-7410c56a1da1 req-b8f05191-3226-489b-8aff-c53969430c32 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:05.050770 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c73990a4-7814-4e9c-afc3-7410c56a1da1 req-b8f05191-3226-489b-8aff-c53969430c32 service nova] Creating event network-changed:392e3af5-66bc-4a92-9708-7c9d206860f2 for instance 1abbc720-b508-4aee-90f0-4f5c673b2941 on n-h1-849328-3 Aug 24 10:51:05.053060 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c73990a4-7814-4e9c-afc3-7410c56a1da1 req-b8f05191-3226-489b-8aff-c53969430c32 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044238 Aug 24 10:51:05.054328 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2818/5984] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:51:05.883906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2907cd41-b33b-4d17-9a29-e9d66907c3c1 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:05.886109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2907cd41-b33b-4d17-9a29-e9d66907c3c1 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:05.897653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2907cd41-b33b-4d17-9a29-e9d66907c3c1 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:05.898919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2907cd41-b33b-4d17-9a29-e9d66907c3c1 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:05.900059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2907cd41-b33b-4d17-9a29-e9d66907c3c1 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:05.901707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2907cd41-b33b-4d17-9a29-e9d66907c3c1 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:05.902761 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2907cd41-b33b-4d17-9a29-e9d66907c3c1 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:05.903821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2907cd41-b33b-4d17-9a29-e9d66907c3c1 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:06.016544 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4aa63a09-ea3a-4348-8ee2-52d494d6e3ef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:06.019449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4aa63a09-ea3a-4348-8ee2-52d494d6e3ef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:06.040852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4aa63a09-ea3a-4348-8ee2-52d494d6e3ef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:06.044939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4aa63a09-ea3a-4348-8ee2-52d494d6e3ef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:06.045726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4aa63a09-ea3a-4348-8ee2-52d494d6e3ef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:06.046741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4aa63a09-ea3a-4348-8ee2-52d494d6e3ef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:06.047371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4aa63a09-ea3a-4348-8ee2-52d494d6e3ef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:06.047978 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4aa63a09-ea3a-4348-8ee2-52d494d6e3ef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:06.384952 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2907cd41-b33b-4d17-9a29-e9d66907c3c1 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1833 microversion: 2.1 time: 0.508224 Aug 24 10:51:06.389558 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3167/5985] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:05 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1833 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:06.473208 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4aa63a09-ea3a-4348-8ee2-52d494d6e3ef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:06.486004 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4aa63a09-ea3a-4348-8ee2-52d494d6e3ef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1214 microversion: 2.1 time: 0.483484 Aug 24 10:51:06.506241 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2819/5986] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:05 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1214 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:07.514198 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c5c0a2ee-698a-400b-8158-bce3feb06bfe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:07.514914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c5c0a2ee-698a-400b-8158-bce3feb06bfe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:07.524977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5c0a2ee-698a-400b-8158-bce3feb06bfe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:07.526236 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5c0a2ee-698a-400b-8158-bce3feb06bfe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:07.526926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5c0a2ee-698a-400b-8158-bce3feb06bfe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:07.528262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5c0a2ee-698a-400b-8158-bce3feb06bfe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:07.528927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5c0a2ee-698a-400b-8158-bce3feb06bfe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:07.530153 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5c0a2ee-698a-400b-8158-bce3feb06bfe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:07.914571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c5c0a2ee-698a-400b-8158-bce3feb06bfe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:07.926610 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c5c0a2ee-698a-400b-8158-bce3feb06bfe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1214 microversion: 2.1 time: 0.416629 Aug 24 10:51:07.933532 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3168/5987] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:07 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1214 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:08.399281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-88b75381-ba2e-4db4-9ae2-1b1d42c42710 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:08.400017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-88b75381-ba2e-4db4-9ae2-1b1d42c42710 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:08.400144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-36125fe3-4cd7-4b60-a0e2-4175fff599c3 req-b37f4e5b-99e4-48af-b067-caa39876b95a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef0933a3-a042-41c2-a901-172e9c89dd03", "tag": "7d58f5cd-e9e0-4d8a-a4f6-61ac70ae8a3c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:51:08.412085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-36125fe3-4cd7-4b60-a0e2-4175fff599c3 req-b37f4e5b-99e4-48af-b067-caa39876b95a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:08.412496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-36125fe3-4cd7-4b60-a0e2-4175fff599c3 req-b37f4e5b-99e4-48af-b067-caa39876b95a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:08.412936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-36125fe3-4cd7-4b60-a0e2-4175fff599c3 req-b37f4e5b-99e4-48af-b067-caa39876b95a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:08.416481 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88b75381-ba2e-4db4-9ae2-1b1d42c42710 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:08.416981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88b75381-ba2e-4db4-9ae2-1b1d42c42710 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:08.417481 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88b75381-ba2e-4db4-9ae2-1b1d42c42710 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:08.418203 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88b75381-ba2e-4db4-9ae2-1b1d42c42710 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:08.429977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88b75381-ba2e-4db4-9ae2-1b1d42c42710 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:08.430446 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88b75381-ba2e-4db4-9ae2-1b1d42c42710 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:08.443807 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-36125fe3-4cd7-4b60-a0e2-4175fff599c3 req-b37f4e5b-99e4-48af-b067-caa39876b95a service nova] Creating event network-changed:7d58f5cd-e9e0-4d8a-a4f6-61ac70ae8a3c for instance ef0933a3-a042-41c2-a901-172e9c89dd03 on n-h2-849328-3 Aug 24 10:51:08.460504 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-36125fe3-4cd7-4b60-a0e2-4175fff599c3 req-b37f4e5b-99e4-48af-b067-caa39876b95a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063776 Aug 24 10:51:08.461886 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3169/5988] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:51:08.468751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-88b75381-ba2e-4db4-9ae2-1b1d42c42710 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:51:08.672293 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-88b75381-ba2e-4db4-9ae2-1b1d42c42710 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "DELETE /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 204 len: 0 microversion: 2.1 time: 0.275655 Aug 24 10:51:08.673812 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2820/5989] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:51:08 2022] DELETE /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:51:08.685771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0c022ab2-b67a-4ecc-8fcd-0b6d2f828a8d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:08.686764 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0c022ab2-b67a-4ecc-8fcd-0b6d2f828a8d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:08.704746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c022ab2-b67a-4ecc-8fcd-0b6d2f828a8d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:08.705294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c022ab2-b67a-4ecc-8fcd-0b6d2f828a8d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:08.705809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c022ab2-b67a-4ecc-8fcd-0b6d2f828a8d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:08.707186 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c022ab2-b67a-4ecc-8fcd-0b6d2f828a8d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:08.707668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c022ab2-b67a-4ecc-8fcd-0b6d2f828a8d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:08.708113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c022ab2-b67a-4ecc-8fcd-0b6d2f828a8d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:08.954515 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6aeeefae-7307-42d2-8124-3799c89b1b9b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:08.954515 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6aeeefae-7307-42d2-8124-3799c89b1b9b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:08.961290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aeeefae-7307-42d2-8124-3799c89b1b9b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:08.961808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aeeefae-7307-42d2-8124-3799c89b1b9b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:08.962595 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aeeefae-7307-42d2-8124-3799c89b1b9b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:08.966074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aeeefae-7307-42d2-8124-3799c89b1b9b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:08.966344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aeeefae-7307-42d2-8124-3799c89b1b9b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:08.967133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aeeefae-7307-42d2-8124-3799c89b1b9b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:09.208798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0c022ab2-b67a-4ecc-8fcd-0b6d2f828a8d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:09.224802 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0c022ab2-b67a-4ecc-8fcd-0b6d2f828a8d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1688 microversion: 2.1 time: 0.539372 Aug 24 10:51:09.225558 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3170/5990] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:08 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1688 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:09.268940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6aeeefae-7307-42d2-8124-3799c89b1b9b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:09.285088 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6aeeefae-7307-42d2-8124-3799c89b1b9b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1214 microversion: 2.1 time: 0.339462 Aug 24 10:51:09.310564 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2821/5991] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:08 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1214 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:51:10.248977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:10.250752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:10.256140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f98737a7-a905-4b4d-b90d-266b36b3996d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:10.256776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f98737a7-a905-4b4d-b90d-266b36b3996d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:10.266159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f98737a7-a905-4b4d-b90d-266b36b3996d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:10.266659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f98737a7-a905-4b4d-b90d-266b36b3996d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:10.267289 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f98737a7-a905-4b4d-b90d-266b36b3996d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:10.268179 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f98737a7-a905-4b4d-b90d-266b36b3996d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:10.268814 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f98737a7-a905-4b4d-b90d-266b36b3996d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:10.269367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f98737a7-a905-4b4d-b90d-266b36b3996d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:10.273349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:10.316675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-115e1fce-bcd1-4c42-ae55-350ed3dd0e28 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:10.317346 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-115e1fce-bcd1-4c42-ae55-350ed3dd0e28 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:10.320524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:10.329554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-115e1fce-bcd1-4c42-ae55-350ed3dd0e28 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:10.330073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-115e1fce-bcd1-4c42-ae55-350ed3dd0e28 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:10.330692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-115e1fce-bcd1-4c42-ae55-350ed3dd0e28 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:10.331993 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-115e1fce-bcd1-4c42-ae55-350ed3dd0e28 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:10.332611 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-115e1fce-bcd1-4c42-ae55-350ed3dd0e28 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:10.333221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-115e1fce-bcd1-4c42-ae55-350ed3dd0e28 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:10.569278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f98737a7-a905-4b4d-b90d-266b36b3996d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:10.580452 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f98737a7-a905-4b4d-b90d-266b36b3996d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 200 len: 1688 microversion: 2.1 time: 0.332317 Aug 24 10:51:10.585225 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3171/5992] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:10 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 1688 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:10.666855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-115e1fce-bcd1-4c42-ae55-350ed3dd0e28 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:10.681385 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-115e1fce-bcd1-4c42-ae55-350ed3dd0e28 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1214 microversion: 2.1 time: 0.368802 Aug 24 10:51:10.683647 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2822/5993] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:10 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1214 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:51:11.025255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-95ba7c66-7a13-431a-8f7e-d4a75581b9ff req-d686f34b-63fe-48e9-b84b-cdef95469cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0933a3-a042-41c2-a901-172e9c89dd03", "name": "network-vif-deleted", "tag": "7d58f5cd-e9e0-4d8a-a4f6-61ac70ae8a3c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:51:11.052666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-95ba7c66-7a13-431a-8f7e-d4a75581b9ff req-d686f34b-63fe-48e9-b84b-cdef95469cc3 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:11.055640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-95ba7c66-7a13-431a-8f7e-d4a75581b9ff req-d686f34b-63fe-48e9-b84b-cdef95469cc3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:11.058878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-95ba7c66-7a13-431a-8f7e-d4a75581b9ff req-d686f34b-63fe-48e9-b84b-cdef95469cc3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:11.076246 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-95ba7c66-7a13-431a-8f7e-d4a75581b9ff req-d686f34b-63fe-48e9-b84b-cdef95469cc3 service nova] Creating event network-vif-deleted:7d58f5cd-e9e0-4d8a-a4f6-61ac70ae8a3c for instance ef0933a3-a042-41c2-a901-172e9c89dd03 on n-h2-849328-3 Aug 24 10:51:11.083996 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-95ba7c66-7a13-431a-8f7e-d4a75581b9ff req-d686f34b-63fe-48e9-b84b-cdef95469cc3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078163 Aug 24 10:51:11.085343 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3172/5994] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:51:11.402976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4dcbdb84-b906-4f94-9ff0-3cd5fa7e1932 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:11.403553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4dcbdb84-b906-4f94-9ff0-3cd5fa7e1932 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:11.424047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4dcbdb84-b906-4f94-9ff0-3cd5fa7e1932 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:11.424704 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4dcbdb84-b906-4f94-9ff0-3cd5fa7e1932 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:11.425190 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4dcbdb84-b906-4f94-9ff0-3cd5fa7e1932 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:11.426759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4dcbdb84-b906-4f94-9ff0-3cd5fa7e1932 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:11.428029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4dcbdb84-b906-4f94-9ff0-3cd5fa7e1932 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:11.428665 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4dcbdb84-b906-4f94-9ff0-3cd5fa7e1932 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:11.482380 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4dcbdb84-b906-4f94-9ff0-3cd5fa7e1932 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece/os-volume_attachments/2a6352b5-606c-4cb5-9669-9af9b141fd03" status: 200 len: 194 microversion: 2.1 time: 0.086137 Aug 24 10:51:11.490242 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2823/5995] 10.222.0.85 () {58 vars in 1413 bytes} [Wed Aug 24 10:51:11 2022] GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece/os-volume_attachments/2a6352b5-606c-4cb5-9669-9af9b141fd03 => generated 194 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:51:11.502692 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e678c9f2-17a3-43dc-88d1-22a45d433e45 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:11.503208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e678c9f2-17a3-43dc-88d1-22a45d433e45 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:11.511779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e678c9f2-17a3-43dc-88d1-22a45d433e45 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:11.512401 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e678c9f2-17a3-43dc-88d1-22a45d433e45 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:11.512908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e678c9f2-17a3-43dc-88d1-22a45d433e45 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:11.513783 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e678c9f2-17a3-43dc-88d1-22a45d433e45 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:11.514382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e678c9f2-17a3-43dc-88d1-22a45d433e45 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:11.514886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e678c9f2-17a3-43dc-88d1-22a45d433e45 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:11.606155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-33107ce8-4644-4022-9924-59c0b8393f63 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:11.607218 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-33107ce8-4644-4022-9924-59c0b8393f63 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: ef0933a3-a042-41c2-a901-172e9c89dd03] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:11.620435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33107ce8-4644-4022-9924-59c0b8393f63 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:11.624650 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33107ce8-4644-4022-9924-59c0b8393f63 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:11.625109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33107ce8-4644-4022-9924-59c0b8393f63 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:11.625914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33107ce8-4644-4022-9924-59c0b8393f63 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:11.626372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33107ce8-4644-4022-9924-59c0b8393f63 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:11.626809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33107ce8-4644-4022-9924-59c0b8393f63 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:11.665655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-e678c9f2-17a3-43dc-88d1-22a45d433e45 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lazy-loading 'services' on Instance uuid 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:51:11.672967 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-33107ce8-4644-4022-9924-59c0b8393f63 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] HTTP exception thrown: Instance ef0933a3-a042-41c2-a901-172e9c89dd03 could not be found. Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-33107ce8-4644-4022-9924-59c0b8393f63 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Request method failure captured: Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 HTTP/1.1 Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgIYr3m0kczioH5SSbuV0siG9VfGIEhErhXgPNYWqTrwdwzLctBv4d_yF7_2o3Bo2OCW0F3YBxLt_VBZKvzJVotT6Q8BjQkCHvOThFjqvFIwYZTCav5UQXePGBVbTY6y1fdzkpkRSvMUUvzdkP7LJWZQ1ilcF3WX7Nwy-FzIhdwxmrY Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: de650d3c897a409dbf54c32bfd45d672 Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-639544488 Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/de650d3c897a409dbf54c32bfd45d672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_de650d3c897a409dbf54c32bfd45d672", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/de650d3c897a409dbf54c32bfd45d672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/de650d3c897a409dbf54c32bfd45d672"}]}] Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-TestNetworkAdvancedServerOps-639544488 Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: de650d3c897a409dbf54c32bfd45d672 Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-639544488 Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-TestNetworkAdvancedServerOps-639544488-project Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 127a30846ae64f268baf7f3231b84273 Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-TestNetworkAdvancedServerOps-639544488-project Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance ef0933a3-a042-41c2-a901-172e9c89dd03 could not be found. Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'ef0933a3-a042-41c2-a901-172e9c89dd03'} Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef0933a3-a042-41c2-a901-172e9c89dd03 could not be found. Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef0933a3-a042-41c2-a901-172e9c89dd03 could not be found. Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:11.679751 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:11.684142 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:11.684142 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:11.684142 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:51:11.684142 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:51:11.684142 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:51:11.684142 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:51:11.684142 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef0933a3-a042-41c2-a901-172e9c89dd03 could not be found. Aug 24 10:51:11.684142 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:11.684142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-33107ce8-4644-4022-9924-59c0b8393f63 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Returning 404 to user: Instance ef0933a3-a042-41c2-a901-172e9c89dd03 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:51:11.684142 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-33107ce8-4644-4022-9924-59c0b8393f63 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03" status: 404 len: 111 microversion: 2.1 time: 0.079775 Aug 24 10:51:11.688409 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2824/5996] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:11 2022] GET /compute/v2.1/servers/ef0933a3-a042-41c2-a901-172e9c89dd03 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:51:11.709931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ea7c587a-d99f-4e70-a04a-4b846392d523 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:11.709931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ea7c587a-d99f-4e70-a04a-4b846392d523 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:11.713763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea7c587a-d99f-4e70-a04a-4b846392d523 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:11.714369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea7c587a-d99f-4e70-a04a-4b846392d523 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:11.715002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea7c587a-d99f-4e70-a04a-4b846392d523 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:11.715718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea7c587a-d99f-4e70-a04a-4b846392d523 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:11.716172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea7c587a-d99f-4e70-a04a-4b846392d523 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:11.716601 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea7c587a-d99f-4e70-a04a-4b846392d523 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:11.794045 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e678c9f2-17a3-43dc-88d1-22a45d433e45 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "DELETE /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece/os-volume_attachments/2a6352b5-606c-4cb5-9669-9af9b141fd03" status: 202 len: 0 microversion: 2.1 time: 0.302521 Aug 24 10:51:11.795695 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3173/5997] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Aug 24 10:51:11 2022] DELETE /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece/os-volume_attachments/2a6352b5-606c-4cb5-9669-9af9b141fd03 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:51:12.412595 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ea7c587a-d99f-4e70-a04a-4b846392d523 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:12.430265 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ea7c587a-d99f-4e70-a04a-4b846392d523 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1214 microversion: 2.1 time: 0.730634 Aug 24 10:51:12.430947 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2825/5998] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:11 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1214 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:13.454939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a190c747-d244-4e77-b908-e275747ddb71 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:13.456367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a190c747-d244-4e77-b908-e275747ddb71 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:13.478096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a190c747-d244-4e77-b908-e275747ddb71 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:13.479514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a190c747-d244-4e77-b908-e275747ddb71 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:13.481871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a190c747-d244-4e77-b908-e275747ddb71 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:13.483527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a190c747-d244-4e77-b908-e275747ddb71 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:13.484205 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a190c747-d244-4e77-b908-e275747ddb71 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:13.484808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a190c747-d244-4e77-b908-e275747ddb71 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:13.782817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a190c747-d244-4e77-b908-e275747ddb71 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:13.798754 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a190c747-d244-4e77-b908-e275747ddb71 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1214 microversion: 2.1 time: 0.345757 Aug 24 10:51:13.806217 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3174/5999] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:13 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1214 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:14.822657 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9e8eb900-e313-4583-937b-12c95781197b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:14.823352 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9e8eb900-e313-4583-937b-12c95781197b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:14.837608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e8eb900-e313-4583-937b-12c95781197b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:14.838172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e8eb900-e313-4583-937b-12c95781197b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:14.840956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e8eb900-e313-4583-937b-12c95781197b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:14.842117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e8eb900-e313-4583-937b-12c95781197b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:14.845941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e8eb900-e313-4583-937b-12c95781197b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:14.846617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e8eb900-e313-4583-937b-12c95781197b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:15.258714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9e8eb900-e313-4583-937b-12c95781197b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:15.267599 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9e8eb900-e313-4583-937b-12c95781197b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1202 microversion: 2.1 time: 0.450758 Aug 24 10:51:15.268201 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2826/6000] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:14 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1202 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:16.296717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b72d0454-24c5-4288-ba04-afbe3c9a2846 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:16.297542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b72d0454-24c5-4288-ba04-afbe3c9a2846 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:16.312913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b72d0454-24c5-4288-ba04-afbe3c9a2846 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:16.314927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b72d0454-24c5-4288-ba04-afbe3c9a2846 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:16.316671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b72d0454-24c5-4288-ba04-afbe3c9a2846 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:16.318239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b72d0454-24c5-4288-ba04-afbe3c9a2846 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:16.320426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b72d0454-24c5-4288-ba04-afbe3c9a2846 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:16.321641 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b72d0454-24c5-4288-ba04-afbe3c9a2846 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:16.776888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b72d0454-24c5-4288-ba04-afbe3c9a2846 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:16.798805 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b72d0454-24c5-4288-ba04-afbe3c9a2846 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1202 microversion: 2.1 time: 0.505319 Aug 24 10:51:16.810767 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3175/6001] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:16 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1202 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:17.464907 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ab26e17e-5c57-43c2-8863-055b79f59dd7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '.version_select at 0x7f465409c550>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:17.501294 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ab26e17e-5c57-43c2-8863-055b79f59dd7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2110511473" status: 202 len: 0 microversion: 2.1 time: 0.039821 Aug 24 10:51:17.502729 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2827/6002] 10.222.0.85 () {58 vars in 1284 bytes} [Wed Aug 24 10:51:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2110511473 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 10:51:17.538682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6d35e26f-df1b-4943-9646-40265cae6b70 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Action: 'create', calling method: .version_select at 0x7f4654efb5e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1520876587", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChszyNbW2YbUuIPxdxOAj5B/6gd3o3JdLQR1u4SC9PAP0CCd7N9uLNYKXPPwXJpKY3hGiBt1G6op4HMwxQPrzBN/v68R9xRotH7r+wfBcfLE2Exzgg9ibH5RpoPhWRv+Q=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:51:17.557527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-6d35e26f-df1b-4943-9646-40265cae6b70 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Getting quotas for project de650d3c897a409dbf54c32bfd45d672. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:51:17.566234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-6d35e26f-df1b-4943-9646-40265cae6b70 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Getting quotas for user 127a30846ae64f268baf7f3231b84273 and project de650d3c897a409dbf54c32bfd45d672. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:51:17.600040 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6d35e26f-df1b-4943-9646-40265cae6b70 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.068362 Aug 24 10:51:17.602485 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3176/6003] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:51:17 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:51:17.828313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b198d129-8e58-4610-87fa-602e5c98420e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:17.829393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b198d129-8e58-4610-87fa-602e5c98420e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:17.840821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b198d129-8e58-4610-87fa-602e5c98420e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:17.841852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b198d129-8e58-4610-87fa-602e5c98420e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:17.842327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b198d129-8e58-4610-87fa-602e5c98420e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:17.843060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b198d129-8e58-4610-87fa-602e5c98420e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:17.843512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b198d129-8e58-4610-87fa-602e5c98420e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:17.844069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b198d129-8e58-4610-87fa-602e5c98420e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:18.416463 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b198d129-8e58-4610-87fa-602e5c98420e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:18.428161 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b198d129-8e58-4610-87fa-602e5c98420e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1202 microversion: 2.1 time: 0.603740 Aug 24 10:51:18.445705 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2828/6004] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:17 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1202 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:19.187021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-933f5e15-afe2-4fcb-9d06-ad83bc5f215c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:19.190128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-933f5e15-afe2-4fcb-9d06-ad83bc5f215c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:19.198003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-933f5e15-afe2-4fcb-9d06-ad83bc5f215c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:19.198817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-933f5e15-afe2-4fcb-9d06-ad83bc5f215c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:19.199636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-933f5e15-afe2-4fcb-9d06-ad83bc5f215c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:19.200411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-933f5e15-afe2-4fcb-9d06-ad83bc5f215c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:19.200910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-933f5e15-afe2-4fcb-9d06-ad83bc5f215c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:19.201528 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-933f5e15-afe2-4fcb-9d06-ad83bc5f215c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:19.235445 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-933f5e15-afe2-4fcb-9d06-ad83bc5f215c tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054134 Aug 24 10:51:19.236077 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3177/6005] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:51:19 2022] GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:51:19.376111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dfb42666-0871-4081-8e43-8ac07f9a71cf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:19.378745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dfb42666-0871-4081-8e43-8ac07f9a71cf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:19.391996 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfb42666-0871-4081-8e43-8ac07f9a71cf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:19.392825 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfb42666-0871-4081-8e43-8ac07f9a71cf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:19.393529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfb42666-0871-4081-8e43-8ac07f9a71cf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:19.395059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfb42666-0871-4081-8e43-8ac07f9a71cf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:19.396521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfb42666-0871-4081-8e43-8ac07f9a71cf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:19.397185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfb42666-0871-4081-8e43-8ac07f9a71cf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:19.435203 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dfb42666-0871-4081-8e43-8ac07f9a71cf tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065244 Aug 24 10:51:19.436110 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2829/6006] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 10:51:19 2022] GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:51:19.455018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-efa14adb-4e06-4fc9-9602-daeab9acc049 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:19.455790 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-efa14adb-4e06-4fc9-9602-daeab9acc049 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:19.463610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efa14adb-4e06-4fc9-9602-daeab9acc049 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:19.464106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efa14adb-4e06-4fc9-9602-daeab9acc049 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:19.464709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efa14adb-4e06-4fc9-9602-daeab9acc049 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:19.466533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efa14adb-4e06-4fc9-9602-daeab9acc049 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:19.467237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efa14adb-4e06-4fc9-9602-daeab9acc049 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:19.467964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efa14adb-4e06-4fc9-9602-daeab9acc049 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:19.507582 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5fa545f0-048a-4f5f-b69b-b0235fc4cb71 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:19.508449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5fa545f0-048a-4f5f-b69b-b0235fc4cb71 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:19.517639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fa545f0-048a-4f5f-b69b-b0235fc4cb71 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:19.518342 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fa545f0-048a-4f5f-b69b-b0235fc4cb71 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:19.518985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fa545f0-048a-4f5f-b69b-b0235fc4cb71 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:19.520270 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fa545f0-048a-4f5f-b69b-b0235fc4cb71 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:19.521360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fa545f0-048a-4f5f-b69b-b0235fc4cb71 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:19.522130 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fa545f0-048a-4f5f-b69b-b0235fc4cb71 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:19.552642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5fa545f0-048a-4f5f-b69b-b0235fc4cb71 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:51:19.668911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-efa14adb-4e06-4fc9-9602-daeab9acc049 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:19.696958 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-efa14adb-4e06-4fc9-9602-daeab9acc049 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1202 microversion: 2.1 time: 0.229390 Aug 24 10:51:19.698395 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5fa545f0-048a-4f5f-b69b-b0235fc4cb71 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "DELETE /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece" status: 204 len: 0 microversion: 2.1 time: 0.195904 Aug 24 10:51:19.699558 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2830/6007] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:51:19 2022] DELETE /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 10:51:19.711176 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3178/6008] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:19 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1202 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:19.714987 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f672c29e-7b9d-447c-b5c3-4a8110a69ffb tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:19.715703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f672c29e-7b9d-447c-b5c3-4a8110a69ffb tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:19.722727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f672c29e-7b9d-447c-b5c3-4a8110a69ffb tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:19.723505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f672c29e-7b9d-447c-b5c3-4a8110a69ffb tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:19.724109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f672c29e-7b9d-447c-b5c3-4a8110a69ffb tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:19.724996 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f672c29e-7b9d-447c-b5c3-4a8110a69ffb tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:19.725630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f672c29e-7b9d-447c-b5c3-4a8110a69ffb tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:19.726218 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f672c29e-7b9d-447c-b5c3-4a8110a69ffb tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:20.030672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f672c29e-7b9d-447c-b5c3-4a8110a69ffb tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:20.044119 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f672c29e-7b9d-447c-b5c3-4a8110a69ffb tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece" status: 200 len: 1673 microversion: 2.1 time: 0.339588 Aug 24 10:51:20.045591 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2831/6009] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:19 2022] GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece => generated 1673 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:51:20.716847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-88723f80-f3e1-4a34-8bd3-bc996a2a39ec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:20.718246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-88723f80-f3e1-4a34-8bd3-bc996a2a39ec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:20.727184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88723f80-f3e1-4a34-8bd3-bc996a2a39ec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:20.727819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88723f80-f3e1-4a34-8bd3-bc996a2a39ec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:20.728378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88723f80-f3e1-4a34-8bd3-bc996a2a39ec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:20.729332 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88723f80-f3e1-4a34-8bd3-bc996a2a39ec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:20.729874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88723f80-f3e1-4a34-8bd3-bc996a2a39ec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:20.730366 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88723f80-f3e1-4a34-8bd3-bc996a2a39ec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:20.895736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-88723f80-f3e1-4a34-8bd3-bc996a2a39ec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:20.906832 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-88723f80-f3e1-4a34-8bd3-bc996a2a39ec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1202 microversion: 2.1 time: 0.194499 Aug 24 10:51:20.907463 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3179/6010] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:20 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1202 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:21.069462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3bbf8500-2198-4583-a421-a01d924420da tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:21.070776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3bbf8500-2198-4583-a421-a01d924420da tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:21.080196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3bbf8500-2198-4583-a421-a01d924420da tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:21.080693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3bbf8500-2198-4583-a421-a01d924420da tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:21.081166 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3bbf8500-2198-4583-a421-a01d924420da tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:21.082397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3bbf8500-2198-4583-a421-a01d924420da tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:21.082827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3bbf8500-2198-4583-a421-a01d924420da tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:21.083332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3bbf8500-2198-4583-a421-a01d924420da tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:21.343530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3bbf8500-2198-4583-a421-a01d924420da tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:21.348136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:21.354453 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3bbf8500-2198-4583-a421-a01d924420da tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece" status: 200 len: 1673 microversion: 2.1 time: 0.289628 Aug 24 10:51:21.369216 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2832/6011] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:21 2022] GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece => generated 1673 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:21.927733 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-312e7ada-7ddc-4c01-843d-7238890e047a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:21.928364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-312e7ada-7ddc-4c01-843d-7238890e047a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:21.935687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-312e7ada-7ddc-4c01-843d-7238890e047a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:21.936190 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-312e7ada-7ddc-4c01-843d-7238890e047a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:21.949331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-312e7ada-7ddc-4c01-843d-7238890e047a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:21.951723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-312e7ada-7ddc-4c01-843d-7238890e047a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:21.952413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-312e7ada-7ddc-4c01-843d-7238890e047a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:21.952864 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-312e7ada-7ddc-4c01-843d-7238890e047a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:22.360482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-312e7ada-7ddc-4c01-843d-7238890e047a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:22.371210 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-312e7ada-7ddc-4c01-843d-7238890e047a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1202 microversion: 2.1 time: 0.447846 Aug 24 10:51:22.386248 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3180/6012] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:21 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1202 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:22.400749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-11b749bf-bdfd-4bf7-81e0-96e6f41e4922 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:22.401469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-11b749bf-bdfd-4bf7-81e0-96e6f41e4922 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:22.412793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11b749bf-bdfd-4bf7-81e0-96e6f41e4922 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:22.413318 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11b749bf-bdfd-4bf7-81e0-96e6f41e4922 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:22.413765 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11b749bf-bdfd-4bf7-81e0-96e6f41e4922 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:22.414481 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11b749bf-bdfd-4bf7-81e0-96e6f41e4922 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:22.414940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11b749bf-bdfd-4bf7-81e0-96e6f41e4922 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:22.415405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11b749bf-bdfd-4bf7-81e0-96e6f41e4922 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:22.631716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-11b749bf-bdfd-4bf7-81e0-96e6f41e4922 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:22.643450 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-11b749bf-bdfd-4bf7-81e0-96e6f41e4922 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece" status: 200 len: 1673 microversion: 2.1 time: 0.252651 Aug 24 10:51:22.646341 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2833/6013] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:22 2022] GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece => generated 1673 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:23.406276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6a4b5646-d0ae-432f-bda7-fe4502e68242 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:23.406916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6a4b5646-d0ae-432f-bda7-fe4502e68242 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:23.419205 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a4b5646-d0ae-432f-bda7-fe4502e68242 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:23.420563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a4b5646-d0ae-432f-bda7-fe4502e68242 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:23.421672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a4b5646-d0ae-432f-bda7-fe4502e68242 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:23.432172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a4b5646-d0ae-432f-bda7-fe4502e68242 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:23.433159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a4b5646-d0ae-432f-bda7-fe4502e68242 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:23.433858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a4b5646-d0ae-432f-bda7-fe4502e68242 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:23.668220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c467fbde-1ff4-4312-bf2c-2bb6b4f66525 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:23.668987 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c467fbde-1ff4-4312-bf2c-2bb6b4f66525 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:23.685853 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c467fbde-1ff4-4312-bf2c-2bb6b4f66525 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:23.688925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c467fbde-1ff4-4312-bf2c-2bb6b4f66525 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:23.691253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c467fbde-1ff4-4312-bf2c-2bb6b4f66525 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:23.692066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c467fbde-1ff4-4312-bf2c-2bb6b4f66525 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:23.692552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c467fbde-1ff4-4312-bf2c-2bb6b4f66525 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:23.695185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c467fbde-1ff4-4312-bf2c-2bb6b4f66525 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:23.923709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6a4b5646-d0ae-432f-bda7-fe4502e68242 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:23.938280 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6a4b5646-d0ae-432f-bda7-fe4502e68242 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1202 microversion: 2.1 time: 0.547078 Aug 24 10:51:23.953456 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3181/6014] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:23 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1202 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:23.959715 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c93ff711-8355-4dff-a1dd-83f789c5cf9e req-d8cd6537-be92-47fc-b1c3-56c6f8cd03a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7adbdc60-ef19-4434-bfc2-2c3fc0c32ece", "name": "network-vif-deleted", "tag": "982f1558-d46b-435c-b1fb-fbdb26ababea"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:51:23.972225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c93ff711-8355-4dff-a1dd-83f789c5cf9e req-d8cd6537-be92-47fc-b1c3-56c6f8cd03a7 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:23.972726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c93ff711-8355-4dff-a1dd-83f789c5cf9e req-d8cd6537-be92-47fc-b1c3-56c6f8cd03a7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:23.973629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c93ff711-8355-4dff-a1dd-83f789c5cf9e req-d8cd6537-be92-47fc-b1c3-56c6f8cd03a7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:23.994821 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c93ff711-8355-4dff-a1dd-83f789c5cf9e req-d8cd6537-be92-47fc-b1c3-56c6f8cd03a7 service nova] Creating event network-vif-deleted:982f1558-d46b-435c-b1fb-fbdb26ababea for instance 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece on n-h2-849328-3 Aug 24 10:51:24.006988 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c93ff711-8355-4dff-a1dd-83f789c5cf9e req-d8cd6537-be92-47fc-b1c3-56c6f8cd03a7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051554 Aug 24 10:51:24.008911 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3182/6015] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:51:24.125776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c467fbde-1ff4-4312-bf2c-2bb6b4f66525 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a31e5adc8a4a8b89a9031714ae0496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b6540f9c574be7b4d1e3aa058938f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:24.143868 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c467fbde-1ff4-4312-bf2c-2bb6b4f66525 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece" status: 200 len: 1605 microversion: 2.1 time: 0.481761 Aug 24 10:51:24.153271 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2834/6016] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:23 2022] GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece => generated 1605 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:51:24.960272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-db585a9f-020a-4fe6-a503-284da51b1c37 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:24.960980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-db585a9f-020a-4fe6-a503-284da51b1c37 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:24.974187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db585a9f-020a-4fe6-a503-284da51b1c37 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:24.980522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db585a9f-020a-4fe6-a503-284da51b1c37 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:24.981338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db585a9f-020a-4fe6-a503-284da51b1c37 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:24.985254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db585a9f-020a-4fe6-a503-284da51b1c37 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:24.986212 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db585a9f-020a-4fe6-a503-284da51b1c37 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:24.987202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db585a9f-020a-4fe6-a503-284da51b1c37 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:25.176814 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3ce7b2e2-7a79-4a86-aaab-e5c64adc2a42 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:25.179267 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3ce7b2e2-7a79-4a86-aaab-e5c64adc2a42 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:25.190769 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ce7b2e2-7a79-4a86-aaab-e5c64adc2a42 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:25.191448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ce7b2e2-7a79-4a86-aaab-e5c64adc2a42 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:25.192062 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ce7b2e2-7a79-4a86-aaab-e5c64adc2a42 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:25.192930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ce7b2e2-7a79-4a86-aaab-e5c64adc2a42 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:25.194992 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ce7b2e2-7a79-4a86-aaab-e5c64adc2a42 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:25.195648 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ce7b2e2-7a79-4a86-aaab-e5c64adc2a42 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:25.255540 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-3ce7b2e2-7a79-4a86-aaab-e5c64adc2a42 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] HTTP exception thrown: Instance 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece could not be found. Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3ce7b2e2-7a79-4a86-aaab-e5c64adc2a42 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Request method failure captured: Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece HTTP/1.1 Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgFkzbIq2WrP4XPrOqfbES6EewMHqJBat38dnsnx4ujeYbEVK2L2EsonSXp3WIMjmBkNTfVKqRIjP4hMhhaT8f4g_4xWjRHQ6URyNlLOZQPImplwGYuAZcyT8-6h_iZD6jH9DZg_laBnlv2OMRGP7SPNIlCiKBrlvkvRi7rcFst-VqM Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: e6b6540f9c574be7b4d1e3aa058938f9 Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachVolumeTestJSON-288981867 Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6b6540f9c574be7b4d1e3aa058938f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e6b6540f9c574be7b4d1e3aa058938f9", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6b6540f9c574be7b4d1e3aa058938f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e6b6540f9c574be7b4d1e3aa058938f9"}]}] Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-AttachVolumeTestJSON-288981867 Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: e6b6540f9c574be7b4d1e3aa058938f9 Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachVolumeTestJSON-288981867 Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-AttachVolumeTestJSON-288981867-project Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 13a31e5adc8a4a8b89a9031714ae0496 Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-AttachVolumeTestJSON-288981867-project Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece could not be found. Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '7adbdc60-ef19-4434-bfc2-2c3fc0c32ece'} Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece could not be found. Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece could not be found. Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:25.261873 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:25.267193 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:25.267193 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:51:25.267193 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:51:25.267193 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:51:25.267193 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:51:25.267193 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece could not be found. Aug 24 10:51:25.267193 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:25.267193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3ce7b2e2-7a79-4a86-aaab-e5c64adc2a42 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Returning 404 to user: Instance 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:51:25.269300 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3ce7b2e2-7a79-4a86-aaab-e5c64adc2a42 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece" status: 404 len: 111 microversion: 2.1 time: 0.101785 Aug 24 10:51:25.288199 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2835/6017] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:25 2022] GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:51:25.295962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6239a6ce-58c2-46e7-affe-c0652bf3775b tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '.version_select at 0x7f4647ee9550>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:25.317280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-db585a9f-020a-4fe6-a503-284da51b1c37 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:25.328433 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6239a6ce-58c2-46e7-affe-c0652bf3775b tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2006058402" status: 202 len: 0 microversion: 2.1 time: 0.037601 Aug 24 10:51:25.329968 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2836/6018] 10.222.0.85 () {58 vars in 1221 bytes} [Wed Aug 24 10:51:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2006058402 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:51:25.337920 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-db585a9f-020a-4fe6-a503-284da51b1c37 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1202 microversion: 2.1 time: 0.382467 Aug 24 10:51:25.340382 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3183/6019] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:24 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1202 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:26.363715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aa002181-4c3a-4cb6-be9e-10a533781381 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:26.365054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aa002181-4c3a-4cb6-be9e-10a533781381 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:26.382227 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa002181-4c3a-4cb6-be9e-10a533781381 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:26.383181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa002181-4c3a-4cb6-be9e-10a533781381 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:26.383743 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa002181-4c3a-4cb6-be9e-10a533781381 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:26.384635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa002181-4c3a-4cb6-be9e-10a533781381 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:26.385413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa002181-4c3a-4cb6-be9e-10a533781381 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:26.386079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa002181-4c3a-4cb6-be9e-10a533781381 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:26.896331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aa002181-4c3a-4cb6-be9e-10a533781381 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:26.909508 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aa002181-4c3a-4cb6-be9e-10a533781381 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1202 microversion: 2.1 time: 0.551365 Aug 24 10:51:26.910078 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2837/6020] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:26 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1202 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:27.369026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-492d9d94-b9fd-433c-a98d-0b09567243ab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1327461928", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "17de6933-60d4-4593-8387-2ff31ef5327d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1520876587", "security_groups": [{"name": "tempest-secgroup-smoke-1870882361"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:51:27.576217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:27.601321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-492d9d94-b9fd-433c-a98d-0b09567243ab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] validate_networks() for [('17de6933-60d4-4593-8387-2ff31ef5327d', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:51:27.934389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd306d9a-da89-4be0-80f8-3b7845aceba4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:27.934994 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dd306d9a-da89-4be0-80f8-3b7845aceba4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:27.951090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd306d9a-da89-4be0-80f8-3b7845aceba4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:27.951997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd306d9a-da89-4be0-80f8-3b7845aceba4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:27.952617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd306d9a-da89-4be0-80f8-3b7845aceba4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:27.953962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd306d9a-da89-4be0-80f8-3b7845aceba4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:27.955258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd306d9a-da89-4be0-80f8-3b7845aceba4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:27.956126 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd306d9a-da89-4be0-80f8-3b7845aceba4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:28.162917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dd306d9a-da89-4be0-80f8-3b7845aceba4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:28.172581 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dd306d9a-da89-4be0-80f8-3b7845aceba4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1202 microversion: 2.1 time: 0.246432 Aug 24 10:51:28.173383 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2838/6021] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:27 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1202 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:28.223500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d60d9094-7d1f-4265-b0c1-b08dc72215ee req-a8b2c600-04b8-4219-bee1-d79b4b5cfd85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1abbc720-b508-4aee-90f0-4f5c673b2941", "name": "network-vif-plugged", "status": "completed", "tag": "392e3af5-66bc-4a92-9708-7c9d206860f2"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:51:28.250208 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d60d9094-7d1f-4265-b0c1-b08dc72215ee req-a8b2c600-04b8-4219-bee1-d79b4b5cfd85 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:28.250734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d60d9094-7d1f-4265-b0c1-b08dc72215ee req-a8b2c600-04b8-4219-bee1-d79b4b5cfd85 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:28.252703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d60d9094-7d1f-4265-b0c1-b08dc72215ee req-a8b2c600-04b8-4219-bee1-d79b4b5cfd85 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:28.290888 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d60d9094-7d1f-4265-b0c1-b08dc72215ee req-a8b2c600-04b8-4219-bee1-d79b4b5cfd85 service nova] Creating event network-vif-plugged:392e3af5-66bc-4a92-9708-7c9d206860f2 for instance 1abbc720-b508-4aee-90f0-4f5c673b2941 on n-h1-849328-3 Aug 24 10:51:28.301764 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d60d9094-7d1f-4265-b0c1-b08dc72215ee req-a8b2c600-04b8-4219-bee1-d79b4b5cfd85 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085347 Aug 24 10:51:28.303013 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2839/6022] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:51:28.475030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-492d9d94-b9fd-433c-a98d-0b09567243ab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:51:28.475477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-492d9d94-b9fd-433c-a98d-0b09567243ab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:51:28.475949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-492d9d94-b9fd-433c-a98d-0b09567243ab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:51:28.476358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-492d9d94-b9fd-433c-a98d-0b09567243ab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:51:28.476772 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-492d9d94-b9fd-433c-a98d-0b09567243ab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:51:28.512424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-492d9d94-b9fd-433c-a98d-0b09567243ab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:28.515207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-492d9d94-b9fd-433c-a98d-0b09567243ab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:28.515861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-492d9d94-b9fd-433c-a98d-0b09567243ab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:28.516836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-492d9d94-b9fd-433c-a98d-0b09567243ab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:28.517699 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-492d9d94-b9fd-433c-a98d-0b09567243ab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:28.518286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-492d9d94-b9fd-433c-a98d-0b09567243ab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:28.562743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-492d9d94-b9fd-433c-a98d-0b09567243ab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Getting quotas for project de650d3c897a409dbf54c32bfd45d672. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:51:28.581164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-492d9d94-b9fd-433c-a98d-0b09567243ab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Getting quotas for user 127a30846ae64f268baf7f3231b84273 and project de650d3c897a409dbf54c32bfd45d672. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:51:28.607586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-492d9d94-b9fd-433c-a98d-0b09567243ab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:51:28.610024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-492d9d94-b9fd-433c-a98d-0b09567243ab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:51:28.665416 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-492d9d94-b9fd-433c-a98d-0b09567243ab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.300305 Aug 24 10:51:28.666079 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3184/6023] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:51:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 1302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:51:28.679380 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-83c02921-cc12-46ba-8296-a8fd6b809c11 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:28.680334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-83c02921-cc12-46ba-8296-a8fd6b809c11 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:28.770751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-83c02921-cc12-46ba-8296-a8fd6b809c11 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:28.783828 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-83c02921-cc12-46ba-8296-a8fd6b809c11 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1267 microversion: 2.1 time: 0.109817 Aug 24 10:51:28.798644 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2840/6024] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:28 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1267 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:29.199100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-76bcb3e5-c202-4d07-91b2-bbea9e138359 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:29.200128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-76bcb3e5-c202-4d07-91b2-bbea9e138359 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:29.219245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76bcb3e5-c202-4d07-91b2-bbea9e138359 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:29.219245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76bcb3e5-c202-4d07-91b2-bbea9e138359 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:29.219245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76bcb3e5-c202-4d07-91b2-bbea9e138359 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:29.219245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76bcb3e5-c202-4d07-91b2-bbea9e138359 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:29.219245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76bcb3e5-c202-4d07-91b2-bbea9e138359 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:29.219245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76bcb3e5-c202-4d07-91b2-bbea9e138359 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:29.389785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-76bcb3e5-c202-4d07-91b2-bbea9e138359 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:29.405021 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-76bcb3e5-c202-4d07-91b2-bbea9e138359 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1202 microversion: 2.1 time: 0.210937 Aug 24 10:51:29.406953 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3185/6025] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:29 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1202 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:29.823934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-58b38e2a-1ab6-4612-9403-edf986892945 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:29.824574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-58b38e2a-1ab6-4612-9403-edf986892945 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:29.838186 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58b38e2a-1ab6-4612-9403-edf986892945 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:29.838881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58b38e2a-1ab6-4612-9403-edf986892945 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:29.839473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58b38e2a-1ab6-4612-9403-edf986892945 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:29.840540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58b38e2a-1ab6-4612-9403-edf986892945 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:29.841185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58b38e2a-1ab6-4612-9403-edf986892945 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:29.841759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58b38e2a-1ab6-4612-9403-edf986892945 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:29.971397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-58b38e2a-1ab6-4612-9403-edf986892945 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:29.990711 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-58b38e2a-1ab6-4612-9403-edf986892945 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1319 microversion: 2.1 time: 0.167736 Aug 24 10:51:30.004272 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2841/6026] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:29 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:30.434527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5c3d394f-9310-49d9-ae2b-e1aa5711d7b9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:30.437394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5c3d394f-9310-49d9-ae2b-e1aa5711d7b9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:30.448914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c3d394f-9310-49d9-ae2b-e1aa5711d7b9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:30.450908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c3d394f-9310-49d9-ae2b-e1aa5711d7b9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:30.451765 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c3d394f-9310-49d9-ae2b-e1aa5711d7b9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:30.452741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c3d394f-9310-49d9-ae2b-e1aa5711d7b9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:30.453520 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c3d394f-9310-49d9-ae2b-e1aa5711d7b9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:30.454160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c3d394f-9310-49d9-ae2b-e1aa5711d7b9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:30.824167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5c3d394f-9310-49d9-ae2b-e1aa5711d7b9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:30.833621 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5c3d394f-9310-49d9-ae2b-e1aa5711d7b9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1390 microversion: 2.1 time: 0.408130 Aug 24 10:51:30.853778 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3186/6027] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:30 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1390 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:30.865671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-58d03da6-59fe-4ea7-b00b-7e2eddae1362 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:30.867275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-58d03da6-59fe-4ea7-b00b-7e2eddae1362 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:30.888538 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58d03da6-59fe-4ea7-b00b-7e2eddae1362 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:30.891616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58d03da6-59fe-4ea7-b00b-7e2eddae1362 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:30.893410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58d03da6-59fe-4ea7-b00b-7e2eddae1362 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:30.895448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58d03da6-59fe-4ea7-b00b-7e2eddae1362 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:30.899153 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58d03da6-59fe-4ea7-b00b-7e2eddae1362 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:30.904450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58d03da6-59fe-4ea7-b00b-7e2eddae1362 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:31.012579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cd4221c2-9249-49d1-b047-db89d19c1a97 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:31.013257 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cd4221c2-9249-49d1-b047-db89d19c1a97 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:31.031562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd4221c2-9249-49d1-b047-db89d19c1a97 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:31.034403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd4221c2-9249-49d1-b047-db89d19c1a97 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:31.034868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd4221c2-9249-49d1-b047-db89d19c1a97 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:31.035803 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd4221c2-9249-49d1-b047-db89d19c1a97 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:31.042689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd4221c2-9249-49d1-b047-db89d19c1a97 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:31.043416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd4221c2-9249-49d1-b047-db89d19c1a97 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:31.232473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cd4221c2-9249-49d1-b047-db89d19c1a97 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:31.244991 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cd4221c2-9249-49d1-b047-db89d19c1a97 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1325 microversion: 2.1 time: 0.236505 Aug 24 10:51:31.246650 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3187/6028] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:31 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1325 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:31.359664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-58d03da6-59fe-4ea7-b00b-7e2eddae1362 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:31.382090 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-58d03da6-59fe-4ea7-b00b-7e2eddae1362 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1390 microversion: 2.1 time: 0.520834 Aug 24 10:51:31.382733 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2842/6029] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:30 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1390 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:31.413585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-027da00f-cc4a-4db6-96b6-fb5a5bf223fd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:31.415033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-027da00f-cc4a-4db6-96b6-fb5a5bf223fd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:31.435760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-027da00f-cc4a-4db6-96b6-fb5a5bf223fd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:31.436463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-027da00f-cc4a-4db6-96b6-fb5a5bf223fd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:31.436697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-027da00f-cc4a-4db6-96b6-fb5a5bf223fd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:31.437477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-027da00f-cc4a-4db6-96b6-fb5a5bf223fd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:31.437946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-027da00f-cc4a-4db6-96b6-fb5a5bf223fd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:31.438371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-027da00f-cc4a-4db6-96b6-fb5a5bf223fd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:31.981452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-027da00f-cc4a-4db6-96b6-fb5a5bf223fd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:32.000685 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-027da00f-cc4a-4db6-96b6-fb5a5bf223fd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1390 microversion: 2.1 time: 0.591577 Aug 24 10:51:32.006231 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3188/6030] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:31 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1390 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:32.027386 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d95d4187-b06a-495e-9ecc-88c50fd35cef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:32.028725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d95d4187-b06a-495e-9ecc-88c50fd35cef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:32.038389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d95d4187-b06a-495e-9ecc-88c50fd35cef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:32.039210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d95d4187-b06a-495e-9ecc-88c50fd35cef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:32.039813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d95d4187-b06a-495e-9ecc-88c50fd35cef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:32.040814 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d95d4187-b06a-495e-9ecc-88c50fd35cef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:32.042695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d95d4187-b06a-495e-9ecc-88c50fd35cef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:32.043313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d95d4187-b06a-495e-9ecc-88c50fd35cef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:32.103946 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d95d4187-b06a-495e-9ecc-88c50fd35cef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:51:32.272148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5542cb85-9f06-439d-85ea-ae3e780e7951 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:32.273298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5542cb85-9f06-439d-85ea-ae3e780e7951 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:32.293148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5542cb85-9f06-439d-85ea-ae3e780e7951 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:32.295080 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d95d4187-b06a-495e-9ecc-88c50fd35cef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "DELETE /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 204 len: 0 microversion: 2.1 time: 0.272213 Aug 24 10:51:32.298964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5542cb85-9f06-439d-85ea-ae3e780e7951 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:32.299131 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2843/6031] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:51:32 2022] DELETE /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:51:32.299227 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5542cb85-9f06-439d-85ea-ae3e780e7951 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:32.299824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5542cb85-9f06-439d-85ea-ae3e780e7951 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:32.300488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5542cb85-9f06-439d-85ea-ae3e780e7951 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:32.301711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5542cb85-9f06-439d-85ea-ae3e780e7951 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:32.309662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-83cdded9-6ca4-434b-9a69-12ae4b6c7635 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:32.311955 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-83cdded9-6ca4-434b-9a69-12ae4b6c7635 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:32.327772 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83cdded9-6ca4-434b-9a69-12ae4b6c7635 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:32.328599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83cdded9-6ca4-434b-9a69-12ae4b6c7635 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:32.329671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83cdded9-6ca4-434b-9a69-12ae4b6c7635 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:32.330578 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83cdded9-6ca4-434b-9a69-12ae4b6c7635 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:32.332961 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83cdded9-6ca4-434b-9a69-12ae4b6c7635 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:32.335007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83cdded9-6ca4-434b-9a69-12ae4b6c7635 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:32.951557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5542cb85-9f06-439d-85ea-ae3e780e7951 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:32.965358 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5542cb85-9f06-439d-85ea-ae3e780e7951 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1393 microversion: 2.1 time: 0.697883 Aug 24 10:51:32.966549 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3189/6032] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:32 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1393 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:51:33.170504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-43e7f589-b706-498d-a362-72ce7f3f9927 req-860f30d8-d7f8-4f48-bebe-ddfc3ca2698a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c50590b2-3366-4439-8a10-6e8f1014882f", "tag": "694c2288-dc06-4d72-81de-d7b13c0b0cb3"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:51:33.178701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:33.205023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-43e7f589-b706-498d-a362-72ce7f3f9927 req-860f30d8-d7f8-4f48-bebe-ddfc3ca2698a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:33.206140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-43e7f589-b706-498d-a362-72ce7f3f9927 req-860f30d8-d7f8-4f48-bebe-ddfc3ca2698a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:33.207211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-43e7f589-b706-498d-a362-72ce7f3f9927 req-860f30d8-d7f8-4f48-bebe-ddfc3ca2698a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:33.215101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:33.248559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-83cdded9-6ca4-434b-9a69-12ae4b6c7635 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:33.259842 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-83cdded9-6ca4-434b-9a69-12ae4b6c7635 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1396 microversion: 2.1 time: 0.958427 Aug 24 10:51:33.260433 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2844/6033] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:32 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1396 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:33.273522 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-43e7f589-b706-498d-a362-72ce7f3f9927 req-860f30d8-d7f8-4f48-bebe-ddfc3ca2698a service nova] Creating event network-changed:694c2288-dc06-4d72-81de-d7b13c0b0cb3 for instance c50590b2-3366-4439-8a10-6e8f1014882f on n-h2-849328-3 Aug 24 10:51:33.283598 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-43e7f589-b706-498d-a362-72ce7f3f9927 req-860f30d8-d7f8-4f48-bebe-ddfc3ca2698a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116651 Aug 24 10:51:33.284556 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3190/6034] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:51:33.986305 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aaf5c4b5-3695-4500-b26f-74234d7b0b69 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:33.986939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aaf5c4b5-3695-4500-b26f-74234d7b0b69 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:33.989083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:33.997666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaf5c4b5-3695-4500-b26f-74234d7b0b69 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:33.998619 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaf5c4b5-3695-4500-b26f-74234d7b0b69 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:33.999285 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaf5c4b5-3695-4500-b26f-74234d7b0b69 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:34.000259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaf5c4b5-3695-4500-b26f-74234d7b0b69 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:34.000924 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaf5c4b5-3695-4500-b26f-74234d7b0b69 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:34.001573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaf5c4b5-3695-4500-b26f-74234d7b0b69 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:34.295735 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-778a6c45-994f-4294-90f6-ad372bcd84f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:34.297335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-778a6c45-994f-4294-90f6-ad372bcd84f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:34.308708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-778a6c45-994f-4294-90f6-ad372bcd84f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:34.309629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-778a6c45-994f-4294-90f6-ad372bcd84f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:34.310216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-778a6c45-994f-4294-90f6-ad372bcd84f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:34.311072 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-778a6c45-994f-4294-90f6-ad372bcd84f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:34.311694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-778a6c45-994f-4294-90f6-ad372bcd84f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:34.312275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-778a6c45-994f-4294-90f6-ad372bcd84f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:34.506896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-778a6c45-994f-4294-90f6-ad372bcd84f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:34.524145 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-778a6c45-994f-4294-90f6-ad372bcd84f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1396 microversion: 2.1 time: 0.246176 Aug 24 10:51:34.526485 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3191/6035] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:34 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1396 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:34.591338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aaf5c4b5-3695-4500-b26f-74234d7b0b69 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:34.602122 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aaf5c4b5-3695-4500-b26f-74234d7b0b69 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1393 microversion: 2.1 time: 0.619409 Aug 24 10:51:34.603116 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2845/6036] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:33 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1393 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:35.523274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-96b77465-070a-4e2d-ab24-bdac8a1af20a req-215234f6-9cf1-4674-9551-a2fdcdf60742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1abbc720-b508-4aee-90f0-4f5c673b2941", "name": "network-vif-deleted", "tag": "392e3af5-66bc-4a92-9708-7c9d206860f2"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:51:35.548066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8200ceac-68f7-4ecb-96a5-a9a664361554 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:35.548955 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8200ceac-68f7-4ecb-96a5-a9a664361554 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:35.559683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-96b77465-070a-4e2d-ab24-bdac8a1af20a req-215234f6-9cf1-4674-9551-a2fdcdf60742 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:35.561780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-96b77465-070a-4e2d-ab24-bdac8a1af20a req-215234f6-9cf1-4674-9551-a2fdcdf60742 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:35.563518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-96b77465-070a-4e2d-ab24-bdac8a1af20a req-215234f6-9cf1-4674-9551-a2fdcdf60742 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:35.565449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8200ceac-68f7-4ecb-96a5-a9a664361554 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:35.565947 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8200ceac-68f7-4ecb-96a5-a9a664361554 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:35.567753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8200ceac-68f7-4ecb-96a5-a9a664361554 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:35.569094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8200ceac-68f7-4ecb-96a5-a9a664361554 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:35.569611 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8200ceac-68f7-4ecb-96a5-a9a664361554 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:35.570040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8200ceac-68f7-4ecb-96a5-a9a664361554 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:35.592522 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-96b77465-070a-4e2d-ab24-bdac8a1af20a req-215234f6-9cf1-4674-9551-a2fdcdf60742 service nova] Creating event network-vif-deleted:392e3af5-66bc-4a92-9708-7c9d206860f2 for instance 1abbc720-b508-4aee-90f0-4f5c673b2941 on n-h1-849328-3 Aug 24 10:51:35.608373 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-96b77465-070a-4e2d-ab24-bdac8a1af20a req-215234f6-9cf1-4674-9551-a2fdcdf60742 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088271 Aug 24 10:51:35.609979 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3192/6037] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:51:35.630496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b20b486c-cdf4-4b61-bb56-bc1012f592ab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:35.640864 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b20b486c-cdf4-4b61-bb56-bc1012f592ab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:35.671161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b20b486c-cdf4-4b61-bb56-bc1012f592ab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:35.674550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b20b486c-cdf4-4b61-bb56-bc1012f592ab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:35.675047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b20b486c-cdf4-4b61-bb56-bc1012f592ab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:35.675816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b20b486c-cdf4-4b61-bb56-bc1012f592ab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:35.676291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b20b486c-cdf4-4b61-bb56-bc1012f592ab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:35.684378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b20b486c-cdf4-4b61-bb56-bc1012f592ab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:35.806486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8200ceac-68f7-4ecb-96a5-a9a664361554 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:35.819108 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8200ceac-68f7-4ecb-96a5-a9a664361554 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1187 microversion: 2.1 time: 0.274927 Aug 24 10:51:35.823456 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2846/6038] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:35 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1187 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:51:36.126397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e4aef487-90cf-454e-91a4-828f6015e6f6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:36.126892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e4aef487-90cf-454e-91a4-828f6015e6f6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:36.144131 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4aef487-90cf-454e-91a4-828f6015e6f6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:36.144974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4aef487-90cf-454e-91a4-828f6015e6f6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:36.145678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4aef487-90cf-454e-91a4-828f6015e6f6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:36.146582 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4aef487-90cf-454e-91a4-828f6015e6f6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:36.147220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4aef487-90cf-454e-91a4-828f6015e6f6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:36.147806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4aef487-90cf-454e-91a4-828f6015e6f6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:36.181062 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-e4aef487-90cf-454e-91a4-828f6015e6f6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] HTTP exception thrown: Instance 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece could not be found. Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e4aef487-90cf-454e-91a4-828f6015e6f6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Request method failure captured: Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece HTTP/1.1 Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgFkzbIq2WrP4XPrOqfbES6EewMHqJBat38dnsnx4ujeYbEVK2L2EsonSXp3WIMjmBkNTfVKqRIjP4hMhhaT8f4g_4xWjRHQ6URyNlLOZQPImplwGYuAZcyT8-6h_iZD6jH9DZg_laBnlv2OMRGP7SPNIlCiKBrlvkvRi7rcFst-VqM Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: e6b6540f9c574be7b4d1e3aa058938f9 Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachVolumeTestJSON-288981867 Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6b6540f9c574be7b4d1e3aa058938f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e6b6540f9c574be7b4d1e3aa058938f9", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6b6540f9c574be7b4d1e3aa058938f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e6b6540f9c574be7b4d1e3aa058938f9"}]}] Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-AttachVolumeTestJSON-288981867 Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: e6b6540f9c574be7b4d1e3aa058938f9 Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachVolumeTestJSON-288981867 Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-AttachVolumeTestJSON-288981867-project Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 13a31e5adc8a4a8b89a9031714ae0496 Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-AttachVolumeTestJSON-288981867-project Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece could not be found. Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '7adbdc60-ef19-4434-bfc2-2c3fc0c32ece'} Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece could not be found. Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:51:36.189801 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:51:36.194419 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece could not be found. Aug 24 10:51:36.194419 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:36.194419 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:36.194419 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:36.194419 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:36.194419 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:51:36.194419 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:51:36.194419 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:51:36.194419 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:51:36.194419 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece could not be found. Aug 24 10:51:36.194419 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:36.196116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e4aef487-90cf-454e-91a4-828f6015e6f6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Returning 404 to user: Instance 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:51:36.197294 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e4aef487-90cf-454e-91a4-828f6015e6f6 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "DELETE /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece" status: 404 len: 111 microversion: 2.1 time: 0.075274 Aug 24 10:51:36.198398 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2847/6039] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:51:36 2022] DELETE /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:51:36.210376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-71bff921-4e02-47a0-9661-de73a7fb43dd tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:36.213922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-71bff921-4e02-47a0-9661-de73a7fb43dd tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:36.234482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71bff921-4e02-47a0-9661-de73a7fb43dd tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:36.234729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71bff921-4e02-47a0-9661-de73a7fb43dd tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:36.235125 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71bff921-4e02-47a0-9661-de73a7fb43dd tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:36.235868 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71bff921-4e02-47a0-9661-de73a7fb43dd tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:36.236329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71bff921-4e02-47a0-9661-de73a7fb43dd tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:36.236763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71bff921-4e02-47a0-9661-de73a7fb43dd tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:36.286911 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-71bff921-4e02-47a0-9661-de73a7fb43dd tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] HTTP exception thrown: Instance 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece could not be found. Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-71bff921-4e02-47a0-9661-de73a7fb43dd tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Request method failure captured: Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece HTTP/1.1 Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgFkzbIq2WrP4XPrOqfbES6EewMHqJBat38dnsnx4ujeYbEVK2L2EsonSXp3WIMjmBkNTfVKqRIjP4hMhhaT8f4g_4xWjRHQ6URyNlLOZQPImplwGYuAZcyT8-6h_iZD6jH9DZg_laBnlv2OMRGP7SPNIlCiKBrlvkvRi7rcFst-VqM Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: e6b6540f9c574be7b4d1e3aa058938f9 Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachVolumeTestJSON-288981867 Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6b6540f9c574be7b4d1e3aa058938f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e6b6540f9c574be7b4d1e3aa058938f9", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6b6540f9c574be7b4d1e3aa058938f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e6b6540f9c574be7b4d1e3aa058938f9"}]}] Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-AttachVolumeTestJSON-288981867 Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: e6b6540f9c574be7b4d1e3aa058938f9 Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachVolumeTestJSON-288981867 Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-AttachVolumeTestJSON-288981867-project Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 13a31e5adc8a4a8b89a9031714ae0496 Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-AttachVolumeTestJSON-288981867-project Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece could not be found. Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '7adbdc60-ef19-4434-bfc2-2c3fc0c32ece'} Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece could not be found. Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece could not be found. Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:36.288515 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:36.294452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:36.294452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:51:36.294452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:51:36.294452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:51:36.294452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:51:36.294452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece could not be found. Aug 24 10:51:36.294452 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:36.294452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-71bff921-4e02-47a0-9661-de73a7fb43dd tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Returning 404 to user: Instance 7adbdc60-ef19-4434-bfc2-2c3fc0c32ece could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:51:36.302833 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-71bff921-4e02-47a0-9661-de73a7fb43dd tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece" status: 404 len: 111 microversion: 2.1 time: 0.098863 Aug 24 10:51:36.303455 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2848/6040] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:36 2022] GET /compute/v2.1/servers/7adbdc60-ef19-4434-bfc2-2c3fc0c32ece => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:51:36.844471 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b2f9f6cf-cfca-40e1-9845-6502c2b68d4f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:36.845150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b2f9f6cf-cfca-40e1-9845-6502c2b68d4f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:36.868967 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2f9f6cf-cfca-40e1-9845-6502c2b68d4f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:36.869603 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2f9f6cf-cfca-40e1-9845-6502c2b68d4f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:36.870111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2f9f6cf-cfca-40e1-9845-6502c2b68d4f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:36.870948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2f9f6cf-cfca-40e1-9845-6502c2b68d4f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:36.871473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2f9f6cf-cfca-40e1-9845-6502c2b68d4f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:36.881694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2f9f6cf-cfca-40e1-9845-6502c2b68d4f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:36.948140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b20b486c-cdf4-4b61-bb56-bc1012f592ab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:36.972687 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b20b486c-cdf4-4b61-bb56-bc1012f592ab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1393 microversion: 2.1 time: 1.350255 Aug 24 10:51:36.973432 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3193/6041] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:35 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1393 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:51:36.992704 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b2f9f6cf-cfca-40e1-9845-6502c2b68d4f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:37.002046 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b2f9f6cf-cfca-40e1-9845-6502c2b68d4f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1187 microversion: 2.1 time: 0.161505 Aug 24 10:51:37.003185 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2849/6042] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:36 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1187 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:37.789640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-5de8a1b0-7e4c-4cb1-b11d-ab31d5eb9e3e req-7c289ce7-16e6-4b32-bcb9-a5bd285b0e61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c50590b2-3366-4439-8a10-6e8f1014882f", "name": "network-vif-plugged", "status": "completed", "tag": "694c2288-dc06-4d72-81de-d7b13c0b0cb3"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:51:37.825963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5de8a1b0-7e4c-4cb1-b11d-ab31d5eb9e3e req-7c289ce7-16e6-4b32-bcb9-a5bd285b0e61 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:37.828086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5de8a1b0-7e4c-4cb1-b11d-ab31d5eb9e3e req-7c289ce7-16e6-4b32-bcb9-a5bd285b0e61 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:37.830120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5de8a1b0-7e4c-4cb1-b11d-ab31d5eb9e3e req-7c289ce7-16e6-4b32-bcb9-a5bd285b0e61 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:37.860197 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-5de8a1b0-7e4c-4cb1-b11d-ab31d5eb9e3e req-7c289ce7-16e6-4b32-bcb9-a5bd285b0e61 service nova] Creating event network-vif-plugged:694c2288-dc06-4d72-81de-d7b13c0b0cb3 for instance c50590b2-3366-4439-8a10-6e8f1014882f on n-h2-849328-3 Aug 24 10:51:37.870664 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-5de8a1b0-7e4c-4cb1-b11d-ab31d5eb9e3e req-7c289ce7-16e6-4b32-bcb9-a5bd285b0e61 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086284 Aug 24 10:51:37.874531 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3194/6043] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:51:37.997094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-db9368b7-2178-42fb-b788-e063fd370195 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:37.997775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-db9368b7-2178-42fb-b788-e063fd370195 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:38.017199 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db9368b7-2178-42fb-b788-e063fd370195 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:38.017993 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db9368b7-2178-42fb-b788-e063fd370195 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:38.018606 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db9368b7-2178-42fb-b788-e063fd370195 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:38.019509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db9368b7-2178-42fb-b788-e063fd370195 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:38.024828 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c83c2778-f1f7-45f3-b695-f378e879ca3d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:38.025720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c83c2778-f1f7-45f3-b695-f378e879ca3d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:38.026587 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db9368b7-2178-42fb-b788-e063fd370195 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:38.027362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db9368b7-2178-42fb-b788-e063fd370195 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:38.039365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c83c2778-f1f7-45f3-b695-f378e879ca3d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:38.039874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c83c2778-f1f7-45f3-b695-f378e879ca3d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:38.040346 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c83c2778-f1f7-45f3-b695-f378e879ca3d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:38.052357 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c83c2778-f1f7-45f3-b695-f378e879ca3d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:38.059426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c83c2778-f1f7-45f3-b695-f378e879ca3d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:38.059884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c83c2778-f1f7-45f3-b695-f378e879ca3d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:38.434803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-db9368b7-2178-42fb-b788-e063fd370195 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:38.444793 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-db9368b7-2178-42fb-b788-e063fd370195 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1393 microversion: 2.1 time: 0.451535 Aug 24 10:51:38.462556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c83c2778-f1f7-45f3-b695-f378e879ca3d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:38.464929 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2850/6044] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:37 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1393 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:38.473291 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c83c2778-f1f7-45f3-b695-f378e879ca3d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1187 microversion: 2.1 time: 0.453136 Aug 24 10:51:38.488613 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3195/6045] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:38 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1187 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:39.469903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0f1a516d-f1b9-4b39-99cb-3c55440ec87b tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:39.470528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0f1a516d-f1b9-4b39-99cb-3c55440ec87b tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:39.472725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:39.490169 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f1a516d-f1b9-4b39-99cb-3c55440ec87b tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:39.490281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f1a516d-f1b9-4b39-99cb-3c55440ec87b tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:39.490713 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f1a516d-f1b9-4b39-99cb-3c55440ec87b tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:39.491437 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f1a516d-f1b9-4b39-99cb-3c55440ec87b tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:39.491906 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f1a516d-f1b9-4b39-99cb-3c55440ec87b tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:39.492332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f1a516d-f1b9-4b39-99cb-3c55440ec87b tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:39.497514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d65bd036-5836-4234-9ff9-8d5fb86b3ea0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:39.499245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d65bd036-5836-4234-9ff9-8d5fb86b3ea0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:39.506259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:39.507501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:39.519879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d65bd036-5836-4234-9ff9-8d5fb86b3ea0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:39.520601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d65bd036-5836-4234-9ff9-8d5fb86b3ea0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:39.521262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d65bd036-5836-4234-9ff9-8d5fb86b3ea0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:39.522257 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d65bd036-5836-4234-9ff9-8d5fb86b3ea0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:39.523029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d65bd036-5836-4234-9ff9-8d5fb86b3ea0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:39.523613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d65bd036-5836-4234-9ff9-8d5fb86b3ea0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:39.746381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d65bd036-5836-4234-9ff9-8d5fb86b3ea0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:39.759121 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d65bd036-5836-4234-9ff9-8d5fb86b3ea0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1187 microversion: 2.1 time: 0.266870 Aug 24 10:51:39.765259 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3196/6046] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:39 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1187 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:39.874228 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0f1a516d-f1b9-4b39-99cb-3c55440ec87b tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:39.919633 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0f1a516d-f1b9-4b39-99cb-3c55440ec87b tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1393 microversion: 2.1 time: 0.453682 Aug 24 10:51:39.920515 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2851/6047] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:39 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1393 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:40.788041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-57f0f6e3-b88a-4d23-93ec-c82ff1f5bc59 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:40.788835 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-57f0f6e3-b88a-4d23-93ec-c82ff1f5bc59 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:40.800370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57f0f6e3-b88a-4d23-93ec-c82ff1f5bc59 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:40.801758 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57f0f6e3-b88a-4d23-93ec-c82ff1f5bc59 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:40.802417 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57f0f6e3-b88a-4d23-93ec-c82ff1f5bc59 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:40.803412 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57f0f6e3-b88a-4d23-93ec-c82ff1f5bc59 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:40.804899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57f0f6e3-b88a-4d23-93ec-c82ff1f5bc59 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:40.805634 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57f0f6e3-b88a-4d23-93ec-c82ff1f5bc59 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:40.950874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-14b73bcd-1dc2-4828-b1ee-c832265faf3c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:40.951278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-14b73bcd-1dc2-4828-b1ee-c832265faf3c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:40.967448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14b73bcd-1dc2-4828-b1ee-c832265faf3c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:40.968198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14b73bcd-1dc2-4828-b1ee-c832265faf3c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:40.968944 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14b73bcd-1dc2-4828-b1ee-c832265faf3c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:40.969892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14b73bcd-1dc2-4828-b1ee-c832265faf3c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:40.970496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14b73bcd-1dc2-4828-b1ee-c832265faf3c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:40.971075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14b73bcd-1dc2-4828-b1ee-c832265faf3c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:40.989407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-57f0f6e3-b88a-4d23-93ec-c82ff1f5bc59 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:41.002905 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-57f0f6e3-b88a-4d23-93ec-c82ff1f5bc59 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1187 microversion: 2.1 time: 0.220751 Aug 24 10:51:41.003542 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3197/6048] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:40 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1187 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:41.019796 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:41.276828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-14b73bcd-1dc2-4828-b1ee-c832265faf3c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:41.292819 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-14b73bcd-1dc2-4828-b1ee-c832265faf3c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1565 microversion: 2.1 time: 0.346838 Aug 24 10:51:41.293464 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2852/6049] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:40 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1565 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:41.318754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e2509157-5fda-4f03-9273-bab2eda8027e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:41.319895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e2509157-5fda-4f03-9273-bab2eda8027e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:41.335294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2509157-5fda-4f03-9273-bab2eda8027e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:41.336322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2509157-5fda-4f03-9273-bab2eda8027e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:41.338024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2509157-5fda-4f03-9273-bab2eda8027e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:41.344428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2509157-5fda-4f03-9273-bab2eda8027e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:41.345163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2509157-5fda-4f03-9273-bab2eda8027e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:41.345758 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2509157-5fda-4f03-9273-bab2eda8027e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:41.668790 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e2509157-5fda-4f03-9273-bab2eda8027e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:41.678678 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e2509157-5fda-4f03-9273-bab2eda8027e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1565 microversion: 2.1 time: 0.366106 Aug 24 10:51:41.682126 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3198/6050] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:41 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1565 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:41.865302 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-21882e33-cd7f-440f-9b46-e58d6f64a73b tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-800820338", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "0cf666b3-1f4c-49bc-b38d-db6ae6669ddd"}], "key_name": "tempest-TestSecurityGroupsBasicOps-427861830", "security_groups": []}, "os:scheduler_hints": {"different_host": ["5bf06a96-37db-4b6f-ad24-f5a10125701d"]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:51:41.973159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-21882e33-cd7f-440f-9b46-e58d6f64a73b tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] validate_networks() for [('0cf666b3-1f4c-49bc-b38d-db6ae6669ddd', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:51:42.024345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e085a62b-14ed-452a-a6ca-9014b1dfae27 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:42.025055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e085a62b-14ed-452a-a6ca-9014b1dfae27 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:42.035187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e085a62b-14ed-452a-a6ca-9014b1dfae27 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:42.050716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e085a62b-14ed-452a-a6ca-9014b1dfae27 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:42.050716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e085a62b-14ed-452a-a6ca-9014b1dfae27 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:42.061145 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e085a62b-14ed-452a-a6ca-9014b1dfae27 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:42.063542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e085a62b-14ed-452a-a6ca-9014b1dfae27 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:42.064007 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e085a62b-14ed-452a-a6ca-9014b1dfae27 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:42.246119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e085a62b-14ed-452a-a6ca-9014b1dfae27 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:42.257804 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e085a62b-14ed-452a-a6ca-9014b1dfae27 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1187 microversion: 2.1 time: 0.237689 Aug 24 10:51:42.259239 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3199/6051] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:42 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1187 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:43.188609 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-21882e33-cd7f-440f-9b46-e58d6f64a73b tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:51:43.189052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-21882e33-cd7f-440f-9b46-e58d6f64a73b tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:51:43.189540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-21882e33-cd7f-440f-9b46-e58d6f64a73b tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:51:43.189947 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-21882e33-cd7f-440f-9b46-e58d6f64a73b tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:51:43.190357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-21882e33-cd7f-440f-9b46-e58d6f64a73b tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:51:43.201285 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21882e33-cd7f-440f-9b46-e58d6f64a73b tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:43.202117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21882e33-cd7f-440f-9b46-e58d6f64a73b tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:43.203117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21882e33-cd7f-440f-9b46-e58d6f64a73b tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:43.204002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21882e33-cd7f-440f-9b46-e58d6f64a73b tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:43.204628 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21882e33-cd7f-440f-9b46-e58d6f64a73b tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:43.205229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21882e33-cd7f-440f-9b46-e58d6f64a73b tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:43.234118 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-21882e33-cd7f-440f-9b46-e58d6f64a73b tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Getting quotas for project 5566add1862d44f5be270fcefeb1a4bf. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:51:43.241386 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-21882e33-cd7f-440f-9b46-e58d6f64a73b tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Getting quotas for user 7465bc2e09b4455b8cee5e8aeb11dbb9 and project 5566add1862d44f5be270fcefeb1a4bf. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:51:43.255865 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-21882e33-cd7f-440f-9b46-e58d6f64a73b tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:51:43.258659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-21882e33-cd7f-440f-9b46-e58d6f64a73b tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 19aa1dcc-c3d9-4def-b772-e393eaf11a22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:51:43.283305 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-83b0b698-ef6b-4996-8994-0bc789258165 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:43.284607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-83b0b698-ef6b-4996-8994-0bc789258165 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:43.297609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83b0b698-ef6b-4996-8994-0bc789258165 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:43.298861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83b0b698-ef6b-4996-8994-0bc789258165 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:43.299509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83b0b698-ef6b-4996-8994-0bc789258165 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:43.300431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83b0b698-ef6b-4996-8994-0bc789258165 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:43.301087 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83b0b698-ef6b-4996-8994-0bc789258165 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:43.301769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83b0b698-ef6b-4996-8994-0bc789258165 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:43.340799 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83b0b698-ef6b-4996-8994-0bc789258165 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:43.341954 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83b0b698-ef6b-4996-8994-0bc789258165 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:43.342695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83b0b698-ef6b-4996-8994-0bc789258165 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:43.343352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-83b0b698-ef6b-4996-8994-0bc789258165 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lazy-loading 'fault' on Instance uuid 1abbc720-b508-4aee-90f0-4f5c673b2941 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:51:43.366675 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-21882e33-cd7f-440f-9b46-e58d6f64a73b tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.504127 Aug 24 10:51:43.375170 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2853/6052] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:51:41 2022] POST /compute/v2.1/servers => generated 361 bytes in 1515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:51:43.385387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-af953944-5679-41d8-ba41-4bc447d22276 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:43.390202 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-af953944-5679-41d8-ba41-4bc447d22276 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 19aa1dcc-c3d9-4def-b772-e393eaf11a22] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:43.416404 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-83b0b698-ef6b-4996-8994-0bc789258165 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:43.429030 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-83b0b698-ef6b-4996-8994-0bc789258165 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 200 len: 1192 microversion: 2.1 time: 0.148835 Aug 24 10:51:43.430047 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3200/6053] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:43 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 1192 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:51:43.567535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-af953944-5679-41d8-ba41-4bc447d22276 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:43.588032 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-af953944-5679-41d8-ba41-4bc447d22276 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22" status: 200 len: 1240 microversion: 2.1 time: 0.209685 Aug 24 10:51:43.596299 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2854/6054] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:43 2022] GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22 => generated 1240 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:44.452821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8f8a6030-5c9c-4e63-8860-fcf38830d4a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:44.454658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8f8a6030-5c9c-4e63-8860-fcf38830d4a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 1abbc720-b508-4aee-90f0-4f5c673b2941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:44.473662 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f8a6030-5c9c-4e63-8860-fcf38830d4a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:44.476223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f8a6030-5c9c-4e63-8860-fcf38830d4a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:44.477087 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f8a6030-5c9c-4e63-8860-fcf38830d4a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:44.479545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f8a6030-5c9c-4e63-8860-fcf38830d4a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:44.482358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f8a6030-5c9c-4e63-8860-fcf38830d4a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:44.483250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f8a6030-5c9c-4e63-8860-fcf38830d4a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:44.531952 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-8f8a6030-5c9c-4e63-8860-fcf38830d4a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] HTTP exception thrown: Instance 1abbc720-b508-4aee-90f0-4f5c673b2941 could not be found. Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8f8a6030-5c9c-4e63-8860-fcf38830d4a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Request method failure captured: Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 HTTP/1.1 Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgJaL-kWwlcIRB5LGdxUOg9NstdlrO4InCZtaIlL6zMAKoO2x9AaKw5QTM5Yc447Qz9dKY7jxkolr7Q3liCCaPxpGdqV4sv_A4_Emu-qJmA0z5hB1ngNyBGm9n-W2LyGX7LaKy8OE29M25iXwnWnUlWVb7vPgN3qX9b_bYxZIyExFQ4 Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d1785d661bbd41619a7046600ad435b1", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d1785d661bbd41619a7046600ad435b1"}]}] Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestVolumeBootPattern-1780678770-project Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 26b7ff61eab4477890d20977574e8dac Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestVolumeBootPattern-1780678770-project Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 1abbc720-b508-4aee-90f0-4f5c673b2941 could not be found. Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '1abbc720-b508-4aee-90f0-4f5c673b2941'} Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1abbc720-b508-4aee-90f0-4f5c673b2941 could not be found. Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1abbc720-b508-4aee-90f0-4f5c673b2941 could not be found. Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:44.537504 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:44.541481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:44.541481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:51:44.541481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:51:44.541481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:51:44.541481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:51:44.541481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1abbc720-b508-4aee-90f0-4f5c673b2941 could not be found. Aug 24 10:51:44.541481 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:44.549221 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8f8a6030-5c9c-4e63-8860-fcf38830d4a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Returning 404 to user: Instance 1abbc720-b508-4aee-90f0-4f5c673b2941 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:51:44.550261 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8f8a6030-5c9c-4e63-8860-fcf38830d4a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941" status: 404 len: 111 microversion: 2.1 time: 0.103798 Aug 24 10:51:44.551774 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3201/6055] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:44 2022] GET /compute/v2.1/servers/1abbc720-b508-4aee-90f0-4f5c673b2941 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:51:44.615322 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-095a140a-d18f-42b5-81ab-4dd969730c22 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:44.616545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-095a140a-d18f-42b5-81ab-4dd969730c22 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 19aa1dcc-c3d9-4def-b772-e393eaf11a22] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:44.641646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-095a140a-d18f-42b5-81ab-4dd969730c22 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:44.642308 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-095a140a-d18f-42b5-81ab-4dd969730c22 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:44.647851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-095a140a-d18f-42b5-81ab-4dd969730c22 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:44.650526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-095a140a-d18f-42b5-81ab-4dd969730c22 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:44.651609 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-095a140a-d18f-42b5-81ab-4dd969730c22 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:44.653039 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-095a140a-d18f-42b5-81ab-4dd969730c22 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:44.902799 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-095a140a-d18f-42b5-81ab-4dd969730c22 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:44.921974 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-095a140a-d18f-42b5-81ab-4dd969730c22 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22" status: 200 len: 1292 microversion: 2.1 time: 0.311052 Aug 24 10:51:44.937936 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2855/6056] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:44 2022] GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22 => generated 1292 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:45.943879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ee45edb-5df0-40f9-ac81-3d81c37afa28 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:45.944759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3ee45edb-5df0-40f9-ac81-3d81c37afa28 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 19aa1dcc-c3d9-4def-b772-e393eaf11a22] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:45.964300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ee45edb-5df0-40f9-ac81-3d81c37afa28 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:45.970147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ee45edb-5df0-40f9-ac81-3d81c37afa28 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:45.970792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ee45edb-5df0-40f9-ac81-3d81c37afa28 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:45.971754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ee45edb-5df0-40f9-ac81-3d81c37afa28 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:45.972362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ee45edb-5df0-40f9-ac81-3d81c37afa28 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:45.975809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ee45edb-5df0-40f9-ac81-3d81c37afa28 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:46.164818 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-98349a38-bcdb-46e5-8131-c83f165fca74 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:46.166097 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-98349a38-bcdb-46e5-8131-c83f165fca74 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:46.173020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3ee45edb-5df0-40f9-ac81-3d81c37afa28 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:46.188443 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ee45edb-5df0-40f9-ac81-3d81c37afa28 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22" status: 200 len: 1298 microversion: 2.1 time: 0.248569 Aug 24 10:51:46.189052 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3202/6057] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:45 2022] GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22 => generated 1298 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:46.192048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98349a38-bcdb-46e5-8131-c83f165fca74 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:46.204995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98349a38-bcdb-46e5-8131-c83f165fca74 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:46.213905 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98349a38-bcdb-46e5-8131-c83f165fca74 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:46.217332 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-1e4939aa-972e-4511-bf78-432c0c74719d req-df8a36af-af7d-4be9-a83b-715912ef8f22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c50590b2-3366-4439-8a10-6e8f1014882f", "tag": "694c2288-dc06-4d72-81de-d7b13c0b0cb3"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:51:46.217855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98349a38-bcdb-46e5-8131-c83f165fca74 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:46.218575 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98349a38-bcdb-46e5-8131-c83f165fca74 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:46.219206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98349a38-bcdb-46e5-8131-c83f165fca74 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:46.260035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1e4939aa-972e-4511-bf78-432c0c74719d req-df8a36af-af7d-4be9-a83b-715912ef8f22 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:46.267140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1e4939aa-972e-4511-bf78-432c0c74719d req-df8a36af-af7d-4be9-a83b-715912ef8f22 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:46.268946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1e4939aa-972e-4511-bf78-432c0c74719d req-df8a36af-af7d-4be9-a83b-715912ef8f22 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:46.314121 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-1e4939aa-972e-4511-bf78-432c0c74719d req-df8a36af-af7d-4be9-a83b-715912ef8f22 service nova] Creating event network-changed:694c2288-dc06-4d72-81de-d7b13c0b0cb3 for instance c50590b2-3366-4439-8a10-6e8f1014882f on n-h2-849328-3 Aug 24 10:51:46.354762 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-1e4939aa-972e-4511-bf78-432c0c74719d req-df8a36af-af7d-4be9-a83b-715912ef8f22 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139884 Aug 24 10:51:46.359078 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3203/6058] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:51:46.861633 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-98349a38-bcdb-46e5-8131-c83f165fca74 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:46.878186 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-98349a38-bcdb-46e5-8131-c83f165fca74 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1565 microversion: 2.1 time: 0.718165 Aug 24 10:51:46.881945 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2856/6059] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:46 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1565 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:51:47.214104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8fee3dd2-c99d-4b13-bb1e-e69b303f63f4 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:47.214815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8fee3dd2-c99d-4b13-bb1e-e69b303f63f4 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 19aa1dcc-c3d9-4def-b772-e393eaf11a22] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:47.223769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fee3dd2-c99d-4b13-bb1e-e69b303f63f4 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:47.224273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fee3dd2-c99d-4b13-bb1e-e69b303f63f4 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:47.224710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fee3dd2-c99d-4b13-bb1e-e69b303f63f4 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:47.225453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fee3dd2-c99d-4b13-bb1e-e69b303f63f4 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:47.225906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fee3dd2-c99d-4b13-bb1e-e69b303f63f4 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:47.226328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fee3dd2-c99d-4b13-bb1e-e69b303f63f4 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:47.793445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8fee3dd2-c99d-4b13-bb1e-e69b303f63f4 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:47.811735 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8fee3dd2-c99d-4b13-bb1e-e69b303f63f4 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22" status: 200 len: 1298 microversion: 2.1 time: 0.601829 Aug 24 10:51:47.812353 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3204/6060] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:47 2022] GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22 => generated 1298 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:48.837204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad276de3-f57c-4ecc-adc1-90fe0943d3da tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:48.837841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ad276de3-f57c-4ecc-adc1-90fe0943d3da tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 19aa1dcc-c3d9-4def-b772-e393eaf11a22] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:48.850084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad276de3-f57c-4ecc-adc1-90fe0943d3da tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:48.850578 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad276de3-f57c-4ecc-adc1-90fe0943d3da tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:48.854651 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad276de3-f57c-4ecc-adc1-90fe0943d3da tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:48.856669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad276de3-f57c-4ecc-adc1-90fe0943d3da tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:48.857190 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad276de3-f57c-4ecc-adc1-90fe0943d3da tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:48.857645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad276de3-f57c-4ecc-adc1-90fe0943d3da tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:48.897907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-abaff906-6de9-4fcb-8c5c-64086a83ec61 req-ce148c16-06e8-4507-b296-b30cfb9033d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19aa1dcc-c3d9-4def-b772-e393eaf11a22", "tag": "9bd7b794-dad4-4e62-a7dc-6a05be1ab963"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:51:48.917093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-abaff906-6de9-4fcb-8c5c-64086a83ec61 req-ce148c16-06e8-4507-b296-b30cfb9033d0 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:48.923597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-abaff906-6de9-4fcb-8c5c-64086a83ec61 req-ce148c16-06e8-4507-b296-b30cfb9033d0 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:48.924387 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-abaff906-6de9-4fcb-8c5c-64086a83ec61 req-ce148c16-06e8-4507-b296-b30cfb9033d0 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:48.950859 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-abaff906-6de9-4fcb-8c5c-64086a83ec61 req-ce148c16-06e8-4507-b296-b30cfb9033d0 service nova] Creating event network-changed:9bd7b794-dad4-4e62-a7dc-6a05be1ab963 for instance 19aa1dcc-c3d9-4def-b772-e393eaf11a22 on n-h1-849328-3 Aug 24 10:51:48.961702 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-abaff906-6de9-4fcb-8c5c-64086a83ec61 req-ce148c16-06e8-4507-b296-b30cfb9033d0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067591 Aug 24 10:51:48.963317 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3205/6061] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:51:49.023020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ad276de3-f57c-4ecc-adc1-90fe0943d3da tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:49.034272 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ad276de3-f57c-4ecc-adc1-90fe0943d3da tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22" status: 200 len: 1298 microversion: 2.1 time: 0.202573 Aug 24 10:51:49.034886 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2857/6062] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:48 2022] GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22 => generated 1298 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:49.928926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6d905e10-d4e6-4a22-8313-782467bf1c76 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:49.929614 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6d905e10-d4e6-4a22-8313-782467bf1c76 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:49.940334 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d905e10-d4e6-4a22-8313-782467bf1c76 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:49.940841 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d905e10-d4e6-4a22-8313-782467bf1c76 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:49.941320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d905e10-d4e6-4a22-8313-782467bf1c76 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:49.942037 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d905e10-d4e6-4a22-8313-782467bf1c76 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:49.942501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d905e10-d4e6-4a22-8313-782467bf1c76 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:49.944969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d905e10-d4e6-4a22-8313-782467bf1c76 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:49.970187 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-6d905e10-d4e6-4a22-8313-782467bf1c76 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] HTTP exception thrown: Instance 46ecd5ee-6e65-441c-b75e-941757d51a02 could not be found. Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6d905e10-d4e6-4a22-8313-782467bf1c76 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Request method failure captured: Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 HTTP/1.1 Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgFkzbIq2WrP4XPrOqfbES6EewMHqJBat38dnsnx4ujeYbEVK2L2EsonSXp3WIMjmBkNTfVKqRIjP4hMhhaT8f4g_4xWjRHQ6URyNlLOZQPImplwGYuAZcyT8-6h_iZD6jH9DZg_laBnlv2OMRGP7SPNIlCiKBrlvkvRi7rcFst-VqM Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: e6b6540f9c574be7b4d1e3aa058938f9 Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-AttachVolumeTestJSON-288981867 Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6b6540f9c574be7b4d1e3aa058938f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e6b6540f9c574be7b4d1e3aa058938f9", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6b6540f9c574be7b4d1e3aa058938f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e6b6540f9c574be7b4d1e3aa058938f9"}]}] Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-AttachVolumeTestJSON-288981867 Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: e6b6540f9c574be7b4d1e3aa058938f9 Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AttachVolumeTestJSON-288981867 Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-AttachVolumeTestJSON-288981867-project Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 13a31e5adc8a4a8b89a9031714ae0496 Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-AttachVolumeTestJSON-288981867-project Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 46ecd5ee-6e65-441c-b75e-941757d51a02 could not be found. Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '46ecd5ee-6e65-441c-b75e-941757d51a02'} Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46ecd5ee-6e65-441c-b75e-941757d51a02 could not be found. Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:51:49.971824 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:51:49.977021 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46ecd5ee-6e65-441c-b75e-941757d51a02 could not be found. Aug 24 10:51:49.977021 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:49.977021 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:49.977021 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:49.977021 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:49.977021 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:51:49.977021 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:51:49.977021 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:51:49.977021 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:51:49.977021 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46ecd5ee-6e65-441c-b75e-941757d51a02 could not be found. Aug 24 10:51:49.977021 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:49.977021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6d905e10-d4e6-4a22-8313-782467bf1c76 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Returning 404 to user: Instance 46ecd5ee-6e65-441c-b75e-941757d51a02 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:51:49.977021 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6d905e10-d4e6-4a22-8313-782467bf1c76 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "DELETE /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 404 len: 111 microversion: 2.1 time: 0.050305 Aug 24 10:51:49.978939 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3206/6063] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:51:49 2022] DELETE /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:51:49.987632 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e6b9119b-fad3-4c24-8f75-414941afbd24 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:49.988362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e6b9119b-fad3-4c24-8f75-414941afbd24 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] [instance: 46ecd5ee-6e65-441c-b75e-941757d51a02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:49.998032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6b9119b-fad3-4c24-8f75-414941afbd24 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:49.998716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6b9119b-fad3-4c24-8f75-414941afbd24 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:49.999425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6b9119b-fad3-4c24-8f75-414941afbd24 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:50.004197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6b9119b-fad3-4c24-8f75-414941afbd24 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:50.004886 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6b9119b-fad3-4c24-8f75-414941afbd24 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:50.005476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6b9119b-fad3-4c24-8f75-414941afbd24 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:50.027999 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-e6b9119b-fad3-4c24-8f75-414941afbd24 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] HTTP exception thrown: Instance 46ecd5ee-6e65-441c-b75e-941757d51a02 could not be found. Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e6b9119b-fad3-4c24-8f75-414941afbd24 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Request method failure captured: Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 HTTP/1.1 Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgFkzbIq2WrP4XPrOqfbES6EewMHqJBat38dnsnx4ujeYbEVK2L2EsonSXp3WIMjmBkNTfVKqRIjP4hMhhaT8f4g_4xWjRHQ6URyNlLOZQPImplwGYuAZcyT8-6h_iZD6jH9DZg_laBnlv2OMRGP7SPNIlCiKBrlvkvRi7rcFst-VqM Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: e6b6540f9c574be7b4d1e3aa058938f9 Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachVolumeTestJSON-288981867 Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6b6540f9c574be7b4d1e3aa058938f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e6b6540f9c574be7b4d1e3aa058938f9", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e6b6540f9c574be7b4d1e3aa058938f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e6b6540f9c574be7b4d1e3aa058938f9"}]}] Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-AttachVolumeTestJSON-288981867 Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: e6b6540f9c574be7b4d1e3aa058938f9 Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachVolumeTestJSON-288981867 Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-AttachVolumeTestJSON-288981867-project Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 13a31e5adc8a4a8b89a9031714ae0496 Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-AttachVolumeTestJSON-288981867-project Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 46ecd5ee-6e65-441c-b75e-941757d51a02 could not be found. Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '46ecd5ee-6e65-441c-b75e-941757d51a02'} Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46ecd5ee-6e65-441c-b75e-941757d51a02 could not be found. Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46ecd5ee-6e65-441c-b75e-941757d51a02 could not be found. Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:50.029830 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:50.034136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:50.034136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:51:50.034136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:51:50.034136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:51:50.034136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:51:50.034136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46ecd5ee-6e65-441c-b75e-941757d51a02 could not be found. Aug 24 10:51:50.034136 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:50.035833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e6b9119b-fad3-4c24-8f75-414941afbd24 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] Returning 404 to user: Instance 46ecd5ee-6e65-441c-b75e-941757d51a02 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:51:50.036980 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e6b9119b-fad3-4c24-8f75-414941afbd24 tempest-AttachVolumeTestJSON-288981867 tempest-AttachVolumeTestJSON-288981867-project] 10.222.0.85 "GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02" status: 404 len: 111 microversion: 2.1 time: 0.053497 Aug 24 10:51:50.037878 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2858/6064] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:49 2022] GET /compute/v2.1/servers/46ecd5ee-6e65-441c-b75e-941757d51a02 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:51:50.056147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-70525052-0813-49a6-9d85-f328130d503e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:50.056806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-70525052-0813-49a6-9d85-f328130d503e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 19aa1dcc-c3d9-4def-b772-e393eaf11a22] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:50.074345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70525052-0813-49a6-9d85-f328130d503e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:50.075126 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70525052-0813-49a6-9d85-f328130d503e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:50.075904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70525052-0813-49a6-9d85-f328130d503e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:50.076971 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70525052-0813-49a6-9d85-f328130d503e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:50.078036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70525052-0813-49a6-9d85-f328130d503e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:50.078628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70525052-0813-49a6-9d85-f328130d503e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:50.226898 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-70525052-0813-49a6-9d85-f328130d503e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:50.236797 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-70525052-0813-49a6-9d85-f328130d503e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22" status: 200 len: 1298 microversion: 2.1 time: 0.184455 Aug 24 10:51:50.250002 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3207/6065] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:50 2022] GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22 => generated 1298 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:51.259695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4a7bb673-e1ae-46e4-9d1b-e3c29f1ce76f tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:51.261063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4a7bb673-e1ae-46e4-9d1b-e3c29f1ce76f tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 19aa1dcc-c3d9-4def-b772-e393eaf11a22] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:51.279047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a7bb673-e1ae-46e4-9d1b-e3c29f1ce76f tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:51.280526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a7bb673-e1ae-46e4-9d1b-e3c29f1ce76f tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:51.281186 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a7bb673-e1ae-46e4-9d1b-e3c29f1ce76f tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:51.287728 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a7bb673-e1ae-46e4-9d1b-e3c29f1ce76f tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:51.289912 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a7bb673-e1ae-46e4-9d1b-e3c29f1ce76f tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:51.290848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a7bb673-e1ae-46e4-9d1b-e3c29f1ce76f tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:51.485575 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4a7bb673-e1ae-46e4-9d1b-e3c29f1ce76f tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:51.501949 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4a7bb673-e1ae-46e4-9d1b-e3c29f1ce76f tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22" status: 200 len: 1298 microversion: 2.1 time: 0.246730 Aug 24 10:51:51.514891 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2859/6066] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:51 2022] GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22 => generated 1298 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:52.528227 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cbcf761f-4f55-4554-b0e4-d6a13618a9d0 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:52.528969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cbcf761f-4f55-4554-b0e4-d6a13618a9d0 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 19aa1dcc-c3d9-4def-b772-e393eaf11a22] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:52.535728 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbcf761f-4f55-4554-b0e4-d6a13618a9d0 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:52.536249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbcf761f-4f55-4554-b0e4-d6a13618a9d0 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:52.536685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbcf761f-4f55-4554-b0e4-d6a13618a9d0 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:52.537416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbcf761f-4f55-4554-b0e4-d6a13618a9d0 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:52.537873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbcf761f-4f55-4554-b0e4-d6a13618a9d0 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:52.538295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbcf761f-4f55-4554-b0e4-d6a13618a9d0 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:52.667585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cbcf761f-4f55-4554-b0e4-d6a13618a9d0 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:52.675828 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cbcf761f-4f55-4554-b0e4-d6a13618a9d0 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22" status: 200 len: 1298 microversion: 2.1 time: 0.151813 Aug 24 10:51:52.677320 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3208/6067] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:52 2022] GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22 => generated 1298 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:53.698293 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d5ba2c7e-131e-4b1d-bc57-27318364b45e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:53.699509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d5ba2c7e-131e-4b1d-bc57-27318364b45e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 19aa1dcc-c3d9-4def-b772-e393eaf11a22] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:53.702681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:53.704185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:53.712457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5ba2c7e-131e-4b1d-bc57-27318364b45e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:53.713344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5ba2c7e-131e-4b1d-bc57-27318364b45e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:53.713791 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5ba2c7e-131e-4b1d-bc57-27318364b45e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:53.714508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5ba2c7e-131e-4b1d-bc57-27318364b45e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:53.714960 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5ba2c7e-131e-4b1d-bc57-27318364b45e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:53.715380 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5ba2c7e-131e-4b1d-bc57-27318364b45e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:53.853331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d5ba2c7e-131e-4b1d-bc57-27318364b45e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:53.862348 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d5ba2c7e-131e-4b1d-bc57-27318364b45e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22" status: 200 len: 1298 microversion: 2.1 time: 0.168497 Aug 24 10:51:53.867094 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2860/6068] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:53 2022] GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22 => generated 1298 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:54.897073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ea1ce72c-fb67-4959-9c12-8a5ee6c1e2a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:54.897778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ea1ce72c-fb67-4959-9c12-8a5ee6c1e2a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 19aa1dcc-c3d9-4def-b772-e393eaf11a22] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:54.908770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea1ce72c-fb67-4959-9c12-8a5ee6c1e2a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:54.909311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea1ce72c-fb67-4959-9c12-8a5ee6c1e2a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:54.909762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea1ce72c-fb67-4959-9c12-8a5ee6c1e2a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:54.910509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea1ce72c-fb67-4959-9c12-8a5ee6c1e2a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:54.913493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea1ce72c-fb67-4959-9c12-8a5ee6c1e2a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:54.913966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea1ce72c-fb67-4959-9c12-8a5ee6c1e2a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:55.045421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ea1ce72c-fb67-4959-9c12-8a5ee6c1e2a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:55.063073 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ea1ce72c-fb67-4959-9c12-8a5ee6c1e2a9 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22" status: 200 len: 1298 microversion: 2.1 time: 0.178091 Aug 24 10:51:55.073790 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3209/6069] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:54 2022] GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22 => generated 1298 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:55.646309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-1b24476d-00a8-49fb-8d8d-13be4738ae2f req-c139cc10-15ae-4ac9-9d66-476baab36a75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19aa1dcc-c3d9-4def-b772-e393eaf11a22", "name": "network-vif-plugged", "status": "completed", "tag": "9bd7b794-dad4-4e62-a7dc-6a05be1ab963"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:51:55.661272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1b24476d-00a8-49fb-8d8d-13be4738ae2f req-c139cc10-15ae-4ac9-9d66-476baab36a75 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:55.662041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1b24476d-00a8-49fb-8d8d-13be4738ae2f req-c139cc10-15ae-4ac9-9d66-476baab36a75 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:55.662800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1b24476d-00a8-49fb-8d8d-13be4738ae2f req-c139cc10-15ae-4ac9-9d66-476baab36a75 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:55.676813 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-1b24476d-00a8-49fb-8d8d-13be4738ae2f req-c139cc10-15ae-4ac9-9d66-476baab36a75 service nova] Creating event network-vif-plugged:9bd7b794-dad4-4e62-a7dc-6a05be1ab963 for instance 19aa1dcc-c3d9-4def-b772-e393eaf11a22 on n-h1-849328-3 Aug 24 10:51:55.691508 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-1b24476d-00a8-49fb-8d8d-13be4738ae2f req-c139cc10-15ae-4ac9-9d66-476baab36a75 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048787 Aug 24 10:51:55.692716 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2861/6070] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:51:56.086162 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8cdef023-ba05-42ae-811a-6a70c87820f1 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:56.086702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8cdef023-ba05-42ae-811a-6a70c87820f1 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 19aa1dcc-c3d9-4def-b772-e393eaf11a22] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:56.094749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8cdef023-ba05-42ae-811a-6a70c87820f1 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:56.095253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8cdef023-ba05-42ae-811a-6a70c87820f1 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:56.095686 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8cdef023-ba05-42ae-811a-6a70c87820f1 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:56.096584 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8cdef023-ba05-42ae-811a-6a70c87820f1 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:56.097043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8cdef023-ba05-42ae-811a-6a70c87820f1 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:56.097658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8cdef023-ba05-42ae-811a-6a70c87820f1 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:56.218740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8cdef023-ba05-42ae-811a-6a70c87820f1 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:56.227552 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8cdef023-ba05-42ae-811a-6a70c87820f1 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22" status: 200 len: 1298 microversion: 2.1 time: 0.146758 Aug 24 10:51:56.228468 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3210/6071] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:56 2022] GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22 => generated 1298 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:51:57.187254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-34773a09-2307-43db-bea6-cbe9d87f2474 tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] Action: 'create', calling method: .version_select at 0x7f4654b718b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-559195939", "metadata": {"Type": "work"}}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-34773a09-2307-43db-bea6-cbe9d87f2474 tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] Request method failure captured: Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 121 Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgLM4-3fT5_otLOuRhc9WPFJgefDy33tPrKFrORpj_dgDPTVD33dS8vaS8HIDoltRfrU8ISC9TPeyHF2VQ0IbwCdTH5bwycoFvzjxcBEqafqlri9tFrTDYy7hE3NY7TNwSvVPGhpPfN65yDBzgwlcz8MRxZlKxEHdkIUFuM4VJuUkwA Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 5e7ac42179504ad0880c13b33a4e0c76 Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-VolumesNegativeTest-1517476696 Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5e7ac42179504ad0880c13b33a4e0c76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_5e7ac42179504ad0880c13b33a4e0c76", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5e7ac42179504ad0880c13b33a4e0c76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/5e7ac42179504ad0880c13b33a4e0c76"}]}] Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-VolumesNegativeTest-1517476696 Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 5e7ac42179504ad0880c13b33a4e0c76 Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-VolumesNegativeTest-1517476696 Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-VolumesNegativeTest-1517476696-project Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: d8dce1942ea94de9aec17f73ae06fa0f Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-VolumesNegativeTest-1517476696-project Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-559195939", "metadata": {"Type": "work"}}} Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-559195939', 'metadata': {'Type': 'work'}}}} Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:51:57.191584 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:51:57.197395 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 10:51:57.197395 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.197395 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:57.197395 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.197395 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:57.197395 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:51:57.197395 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:51:57.197395 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:51:57.197395 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:51:57.197395 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 10:51:57.197395 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.197395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-34773a09-2307-43db-bea6-cbe9d87f2474 tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:51:57.197395 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-34773a09-2307-43db-bea6-cbe9d87f2474 tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.163460 Aug 24 10:51:57.197395 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2862/6072] 10.222.0.85 () {60 vars in 1156 bytes} [Wed Aug 24 10:51:57 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:51:57.206809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c341c55-c651-4a71-9ac4-3c5912bdb14b tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] Action: 'create', calling method: .version_select at 0x7f4647c26790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-356482199", "metadata": {"Type": "work"}}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c341c55-c651-4a71-9ac4-3c5912bdb14b tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] Request method failure captured: Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 119 Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgLM4-3fT5_otLOuRhc9WPFJgefDy33tPrKFrORpj_dgDPTVD33dS8vaS8HIDoltRfrU8ISC9TPeyHF2VQ0IbwCdTH5bwycoFvzjxcBEqafqlri9tFrTDYy7hE3NY7TNwSvVPGhpPfN65yDBzgwlcz8MRxZlKxEHdkIUFuM4VJuUkwA Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 5e7ac42179504ad0880c13b33a4e0c76 Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-VolumesNegativeTest-1517476696 Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5e7ac42179504ad0880c13b33a4e0c76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_5e7ac42179504ad0880c13b33a4e0c76", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5e7ac42179504ad0880c13b33a4e0c76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/5e7ac42179504ad0880c13b33a4e0c76"}]}] Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-VolumesNegativeTest-1517476696 Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 5e7ac42179504ad0880c13b33a4e0c76 Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-VolumesNegativeTest-1517476696 Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-VolumesNegativeTest-1517476696-project Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: d8dce1942ea94de9aec17f73ae06fa0f Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-VolumesNegativeTest-1517476696-project Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-356482199", "metadata": {"Type": "work"}}} Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-356482199', 'metadata': {'Type': 'work'}}}} Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi '0' Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:51:57.211501 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:51:57.216749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 10:51:57.216749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.216749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:57.216749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.216749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:57.216749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:51:57.216749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:51:57.216749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:51:57.216749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:51:57.216749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 10:51:57.216749 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.216749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c341c55-c651-4a71-9ac4-3c5912bdb14b tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:51:57.216749 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2c341c55-c651-4a71-9ac4-3c5912bdb14b tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011149 Aug 24 10:51:57.216749 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3211/6073] 10.222.0.85 () {60 vars in 1156 bytes} [Wed Aug 24 10:51:57 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:51:57.224217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32264d11-7c91-450d-b331-b5b59a0f4d33 tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] Action: 'create', calling method: .version_select at 0x7f4654cdf5e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-204816139", "metadata": {"Type": "work"}}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32264d11-7c91-450d-b331-b5b59a0f4d33 tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] Request method failure captured: Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 118 Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgLM4-3fT5_otLOuRhc9WPFJgefDy33tPrKFrORpj_dgDPTVD33dS8vaS8HIDoltRfrU8ISC9TPeyHF2VQ0IbwCdTH5bwycoFvzjxcBEqafqlri9tFrTDYy7hE3NY7TNwSvVPGhpPfN65yDBzgwlcz8MRxZlKxEHdkIUFuM4VJuUkwA Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 5e7ac42179504ad0880c13b33a4e0c76 Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-VolumesNegativeTest-1517476696 Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5e7ac42179504ad0880c13b33a4e0c76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_5e7ac42179504ad0880c13b33a4e0c76", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5e7ac42179504ad0880c13b33a4e0c76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/5e7ac42179504ad0880c13b33a4e0c76"}]}] Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-VolumesNegativeTest-1517476696 Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 5e7ac42179504ad0880c13b33a4e0c76 Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-VolumesNegativeTest-1517476696 Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-VolumesNegativeTest-1517476696-project Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: d8dce1942ea94de9aec17f73ae06fa0f Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-VolumesNegativeTest-1517476696-project Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-204816139", "metadata": {"Type": "work"}}} Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: method: Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-204816139', 'metadata': {'Type': 'work'}}}} Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi '' Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:51:57.228934 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:51:57.233313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 10:51:57.233313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.233313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:57.233313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.233313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:57.233313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:51:57.233313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:51:57.233313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:51:57.233313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:51:57.233313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 10:51:57.233313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.233313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32264d11-7c91-450d-b331-b5b59a0f4d33 tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:51:57.233313 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-32264d11-7c91-450d-b331-b5b59a0f4d33 tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010259 Aug 24 10:51:57.233313 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2863/6074] 10.222.0.85 () {60 vars in 1156 bytes} [Wed Aug 24 10:51:57 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:51:57.241872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5a7894e7-80fb-415c-86b0-46d588150d3f tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] Calling method '.version_select at 0x7f46547164c0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:57.249263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7dbef8a7-9c08-47c1-af96-4a5fa64f4510 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:57.250107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7dbef8a7-9c08-47c1-af96-4a5fa64f4510 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 19aa1dcc-c3d9-4def-b772-e393eaf11a22] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:57.260435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7dbef8a7-9c08-47c1-af96-4a5fa64f4510 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:57.261033 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7dbef8a7-9c08-47c1-af96-4a5fa64f4510 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:57.261527 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7dbef8a7-9c08-47c1-af96-4a5fa64f4510 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:57.262414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7dbef8a7-9c08-47c1-af96-4a5fa64f4510 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:57.262878 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7dbef8a7-9c08-47c1-af96-4a5fa64f4510 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:57.263311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7dbef8a7-9c08-47c1-af96-4a5fa64f4510 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:57.276635 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-5a7894e7-80fb-415c-86b0-46d588150d3f tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] HTTP exception thrown: Volume tempest-invalid-493426110 could not be found. Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5a7894e7-80fb-415c-86b0-46d588150d3f tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] Request method failure captured: Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-493426110 HTTP/1.1 Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgLM4-3fT5_otLOuRhc9WPFJgefDy33tPrKFrORpj_dgDPTVD33dS8vaS8HIDoltRfrU8ISC9TPeyHF2VQ0IbwCdTH5bwycoFvzjxcBEqafqlri9tFrTDYy7hE3NY7TNwSvVPGhpPfN65yDBzgwlcz8MRxZlKxEHdkIUFuM4VJuUkwA Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 5e7ac42179504ad0880c13b33a4e0c76 Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-VolumesNegativeTest-1517476696 Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5e7ac42179504ad0880c13b33a4e0c76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_5e7ac42179504ad0880c13b33a4e0c76", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5e7ac42179504ad0880c13b33a4e0c76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/5e7ac42179504ad0880c13b33a4e0c76"}]}] Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-VolumesNegativeTest-1517476696 Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 5e7ac42179504ad0880c13b33a4e0c76 Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-VolumesNegativeTest-1517476696 Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-VolumesNegativeTest-1517476696-project Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: d8dce1942ea94de9aec17f73ae06fa0f Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-VolumesNegativeTest-1517476696-project Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: exception: Volume tempest-invalid-493426110 could not be found. Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'tempest-invalid-493426110'} Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-493426110 could not be found. (HTTP 404) (Request-ID: req-f8c20f30-7eda-49c7-ae50-085f491afd8b) Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 10:51:57.287147 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-493426110 could not be found. Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-493426110 could not be found. Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-493426110 could not be found. Aug 24 10:51:57.291857 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.294608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5a7894e7-80fb-415c-86b0-46d588150d3f tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] Returning 404 to user: Volume tempest-invalid-493426110 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:51:57.294864 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5a7894e7-80fb-415c-86b0-46d588150d3f tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/tempest-invalid-493426110" status: 404 len: 98 microversion: 2.1 time: 0.056623 Aug 24 10:51:57.295540 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3212/6075] 10.222.0.85 () {58 vars in 1215 bytes} [Wed Aug 24 10:51:57 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-493426110 => generated 98 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:51:57.306722 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7ba8077e-cdf9-4eba-932f-53333a9998ab tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005601 Aug 24 10:51:57.311561 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3213/6076] 10.222.0.85 () {58 vars in 1140 bytes} [Wed Aug 24 10:51:57 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 24 10:51:57.317590 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-766bf16d-9972-40ef-91cc-6b47a3e101a2 tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004625 Aug 24 10:51:57.318269 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3214/6077] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Aug 24 10:51:57 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 10:51:57.331928 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-51c75eb7-39f0-4fe6-91d3-43151d27acca tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] Calling method '.version_select at 0x7f4647c26940>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:57.384611 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7dbef8a7-9c08-47c1-af96-4a5fa64f4510 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:57.390675 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-51c75eb7-39f0-4fe6-91d3-43151d27acca tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] HTTP exception thrown: Volume a709219a-929e-4901-bc97-1f66dd7397ac could not be found. Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-51c75eb7-39f0-4fe6-91d3-43151d27acca tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] Request method failure captured: Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-volumes/a709219a-929e-4901-bc97-1f66dd7397ac HTTP/1.1 Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgLM4-3fT5_otLOuRhc9WPFJgefDy33tPrKFrORpj_dgDPTVD33dS8vaS8HIDoltRfrU8ISC9TPeyHF2VQ0IbwCdTH5bwycoFvzjxcBEqafqlri9tFrTDYy7hE3NY7TNwSvVPGhpPfN65yDBzgwlcz8MRxZlKxEHdkIUFuM4VJuUkwA Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 5e7ac42179504ad0880c13b33a4e0c76 Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-VolumesNegativeTest-1517476696 Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5e7ac42179504ad0880c13b33a4e0c76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_5e7ac42179504ad0880c13b33a4e0c76", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5e7ac42179504ad0880c13b33a4e0c76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/5e7ac42179504ad0880c13b33a4e0c76"}]}] Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-VolumesNegativeTest-1517476696 Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 5e7ac42179504ad0880c13b33a4e0c76 Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-VolumesNegativeTest-1517476696 Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-VolumesNegativeTest-1517476696-project Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: d8dce1942ea94de9aec17f73ae06fa0f Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-VolumesNegativeTest-1517476696-project Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: exception: Volume a709219a-929e-4901-bc97-1f66dd7397ac could not be found. Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'a709219a-929e-4901-bc97-1f66dd7397ac'} Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a709219a-929e-4901-bc97-1f66dd7397ac could not be found. (HTTP 404) (Request-ID: req-6a58827c-fa07-426d-8d75-bc4f0c14ad4f) Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 10:51:57.392728 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a709219a-929e-4901-bc97-1f66dd7397ac could not be found. Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a709219a-929e-4901-bc97-1f66dd7397ac could not be found. Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a709219a-929e-4901-bc97-1f66dd7397ac could not be found. Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-51c75eb7-39f0-4fe6-91d3-43151d27acca tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] Returning 404 to user: Volume a709219a-929e-4901-bc97-1f66dd7397ac could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:51:57.396977 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-51c75eb7-39f0-4fe6-91d3-43151d27acca tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/a709219a-929e-4901-bc97-1f66dd7397ac" status: 404 len: 109 microversion: 2.1 time: 0.070462 Aug 24 10:51:57.400522 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7dbef8a7-9c08-47c1-af96-4a5fa64f4510 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22" status: 200 len: 1471 microversion: 2.1 time: 0.149126 Aug 24 10:51:57.400620 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3215/6078] 10.222.0.85 () {58 vars in 1248 bytes} [Wed Aug 24 10:51:57 2022] DELETE /compute/v2.1/os-volumes/a709219a-929e-4901-bc97-1f66dd7397ac => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:51:57.406418 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2864/6079] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:57 2022] GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22 => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:51:57.410869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c71ac9e2-4ab3-4242-80d0-741466fcc8fa tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] Calling method '.version_select at 0x7f465a26adc0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:57.416934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-60b79f93-4f2a-4c84-aa42-0ef671805941 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:57.417952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-60b79f93-4f2a-4c84-aa42-0ef671805941 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 19aa1dcc-c3d9-4def-b772-e393eaf11a22] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:57.424689 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60b79f93-4f2a-4c84-aa42-0ef671805941 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:57.425226 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60b79f93-4f2a-4c84-aa42-0ef671805941 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:57.425672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60b79f93-4f2a-4c84-aa42-0ef671805941 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:57.426375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60b79f93-4f2a-4c84-aa42-0ef671805941 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:57.426831 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60b79f93-4f2a-4c84-aa42-0ef671805941 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:57.427256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60b79f93-4f2a-4c84-aa42-0ef671805941 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:57.440689 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-c71ac9e2-4ab3-4242-80d0-741466fcc8fa tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] HTTP exception thrown: Volume b89b78bd-b235-41c1-8526-e5b9b3e65533 could not be found. Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c71ac9e2-4ab3-4242-80d0-741466fcc8fa tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] Request method failure captured: Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-volumes/b89b78bd-b235-41c1-8526-e5b9b3e65533 HTTP/1.1 Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgLM4-3fT5_otLOuRhc9WPFJgefDy33tPrKFrORpj_dgDPTVD33dS8vaS8HIDoltRfrU8ISC9TPeyHF2VQ0IbwCdTH5bwycoFvzjxcBEqafqlri9tFrTDYy7hE3NY7TNwSvVPGhpPfN65yDBzgwlcz8MRxZlKxEHdkIUFuM4VJuUkwA Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 5e7ac42179504ad0880c13b33a4e0c76 Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-VolumesNegativeTest-1517476696 Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5e7ac42179504ad0880c13b33a4e0c76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_5e7ac42179504ad0880c13b33a4e0c76", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5e7ac42179504ad0880c13b33a4e0c76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/5e7ac42179504ad0880c13b33a4e0c76"}]}] Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-VolumesNegativeTest-1517476696 Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 5e7ac42179504ad0880c13b33a4e0c76 Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-VolumesNegativeTest-1517476696 Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-VolumesNegativeTest-1517476696-project Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: d8dce1942ea94de9aec17f73ae06fa0f Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-VolumesNegativeTest-1517476696-project Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: method: Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: exception: Volume b89b78bd-b235-41c1-8526-e5b9b3e65533 could not be found. Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'b89b78bd-b235-41c1-8526-e5b9b3e65533'} Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b89b78bd-b235-41c1-8526-e5b9b3e65533 could not be found. (HTTP 404) (Request-ID: req-05794748-dc8e-4dba-bf6f-33dae87c8eae) Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 10:51:57.442706 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b89b78bd-b235-41c1-8526-e5b9b3e65533 could not be found. Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b89b78bd-b235-41c1-8526-e5b9b3e65533 could not be found. Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b89b78bd-b235-41c1-8526-e5b9b3e65533 could not be found. Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c71ac9e2-4ab3-4242-80d0-741466fcc8fa tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] Returning 404 to user: Volume b89b78bd-b235-41c1-8526-e5b9b3e65533 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c71ac9e2-4ab3-4242-80d0-741466fcc8fa tempest-VolumesNegativeTest-1517476696 tempest-VolumesNegativeTest-1517476696-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/b89b78bd-b235-41c1-8526-e5b9b3e65533" status: 404 len: 109 microversion: 2.1 time: 0.042714 Aug 24 10:51:57.447495 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3216/6080] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Aug 24 10:51:57 2022] GET /compute/v2.1/os-volumes/b89b78bd-b235-41c1-8526-e5b9b3e65533 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:51:57.532692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-60b79f93-4f2a-4c84-aa42-0ef671805941 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:57.543367 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-60b79f93-4f2a-4c84-aa42-0ef671805941 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22" status: 200 len: 1471 microversion: 2.1 time: 0.132355 Aug 24 10:51:57.543999 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2865/6081] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:57 2022] GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22 => generated 1471 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:51:57.566234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4715be10-68ce-4909-beb6-95597f40b4fd tempest-TestSecurityGroupsBasicOps-890088947 tempest-TestSecurityGroupsBasicOps-890088947-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:57.567351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4715be10-68ce-4909-beb6-95597f40b4fd tempest-TestSecurityGroupsBasicOps-890088947 tempest-TestSecurityGroupsBasicOps-890088947-project-admin] [instance: 19aa1dcc-c3d9-4def-b772-e393eaf11a22] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:57.581036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4715be10-68ce-4909-beb6-95597f40b4fd tempest-TestSecurityGroupsBasicOps-890088947 tempest-TestSecurityGroupsBasicOps-890088947-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:57.581942 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4715be10-68ce-4909-beb6-95597f40b4fd tempest-TestSecurityGroupsBasicOps-890088947 tempest-TestSecurityGroupsBasicOps-890088947-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:57.582936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4715be10-68ce-4909-beb6-95597f40b4fd tempest-TestSecurityGroupsBasicOps-890088947 tempest-TestSecurityGroupsBasicOps-890088947-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:57.583876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4715be10-68ce-4909-beb6-95597f40b4fd tempest-TestSecurityGroupsBasicOps-890088947 tempest-TestSecurityGroupsBasicOps-890088947-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:57.584725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4715be10-68ce-4909-beb6-95597f40b4fd tempest-TestSecurityGroupsBasicOps-890088947 tempest-TestSecurityGroupsBasicOps-890088947-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:57.585491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4715be10-68ce-4909-beb6-95597f40b4fd tempest-TestSecurityGroupsBasicOps-890088947 tempest-TestSecurityGroupsBasicOps-890088947-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:57.591870 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:57.693195 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4715be10-68ce-4909-beb6-95597f40b4fd tempest-TestSecurityGroupsBasicOps-890088947 tempest-TestSecurityGroupsBasicOps-890088947-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22" status: 200 len: 1622 microversion: 2.1 time: 0.131775 Aug 24 10:51:57.696879 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3217/6082] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:57 2022] GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22 => generated 1622 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:57.718290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-de0eec11-1dcb-44a5-87f5-db9238725d87 tempest-TestSecurityGroupsBasicOps-890088947 tempest-TestSecurityGroupsBasicOps-890088947-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:57.719634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-de0eec11-1dcb-44a5-87f5-db9238725d87 tempest-TestSecurityGroupsBasicOps-890088947 tempest-TestSecurityGroupsBasicOps-890088947-project-admin] [instance: 5bf06a96-37db-4b6f-ad24-f5a10125701d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:57.729139 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de0eec11-1dcb-44a5-87f5-db9238725d87 tempest-TestSecurityGroupsBasicOps-890088947 tempest-TestSecurityGroupsBasicOps-890088947-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:57.729951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de0eec11-1dcb-44a5-87f5-db9238725d87 tempest-TestSecurityGroupsBasicOps-890088947 tempest-TestSecurityGroupsBasicOps-890088947-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:57.731074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de0eec11-1dcb-44a5-87f5-db9238725d87 tempest-TestSecurityGroupsBasicOps-890088947 tempest-TestSecurityGroupsBasicOps-890088947-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:57.732313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de0eec11-1dcb-44a5-87f5-db9238725d87 tempest-TestSecurityGroupsBasicOps-890088947 tempest-TestSecurityGroupsBasicOps-890088947-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:57.733066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de0eec11-1dcb-44a5-87f5-db9238725d87 tempest-TestSecurityGroupsBasicOps-890088947 tempest-TestSecurityGroupsBasicOps-890088947-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:57.734243 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de0eec11-1dcb-44a5-87f5-db9238725d87 tempest-TestSecurityGroupsBasicOps-890088947 tempest-TestSecurityGroupsBasicOps-890088947-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:57.937101 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-de0eec11-1dcb-44a5-87f5-db9238725d87 tempest-TestSecurityGroupsBasicOps-890088947 tempest-TestSecurityGroupsBasicOps-890088947-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d" status: 200 len: 1910 microversion: 2.1 time: 0.224804 Aug 24 10:51:57.937732 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2866/6083] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:57 2022] GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d => generated 1910 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:58.027684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7aa7f447-bc98-456e-ae95-1d6ab1427c3b tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:58.029075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7aa7f447-bc98-456e-ae95-1d6ab1427c3b tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 19aa1dcc-c3d9-4def-b772-e393eaf11a22] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:58.039985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7aa7f447-bc98-456e-ae95-1d6ab1427c3b tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:58.041094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7aa7f447-bc98-456e-ae95-1d6ab1427c3b tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:58.041743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7aa7f447-bc98-456e-ae95-1d6ab1427c3b tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:58.043164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7aa7f447-bc98-456e-ae95-1d6ab1427c3b tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:58.043798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7aa7f447-bc98-456e-ae95-1d6ab1427c3b tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:58.044413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7aa7f447-bc98-456e-ae95-1d6ab1427c3b tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:58.081653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7aa7f447-bc98-456e-ae95-1d6ab1427c3b tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 19aa1dcc-c3d9-4def-b772-e393eaf11a22] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:51:58.202199 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7aa7f447-bc98-456e-ae95-1d6ab1427c3b tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "DELETE /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22" status: 204 len: 0 microversion: 2.1 time: 0.182847 Aug 24 10:51:58.203353 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3218/6084] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:51:58 2022] DELETE /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:51:58.212763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-113580b2-b16f-49b6-98a2-0f06371f52c5 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:58.213469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-113580b2-b16f-49b6-98a2-0f06371f52c5 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 19aa1dcc-c3d9-4def-b772-e393eaf11a22] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:58.220479 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-113580b2-b16f-49b6-98a2-0f06371f52c5 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:58.220949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-113580b2-b16f-49b6-98a2-0f06371f52c5 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:58.221422 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-113580b2-b16f-49b6-98a2-0f06371f52c5 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:58.222126 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-113580b2-b16f-49b6-98a2-0f06371f52c5 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:58.222747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-113580b2-b16f-49b6-98a2-0f06371f52c5 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:58.223168 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-113580b2-b16f-49b6-98a2-0f06371f52c5 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:58.393809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-113580b2-b16f-49b6-98a2-0f06371f52c5 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:58.413334 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-113580b2-b16f-49b6-98a2-0f06371f52c5 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22" status: 200 len: 1477 microversion: 2.1 time: 0.205848 Aug 24 10:51:58.413947 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2867/6085] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:58 2022] GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22 => generated 1477 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:51:59.440668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aeab5c65-42db-4f11-a565-5e52c8ae7b44 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:51:59.441642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aeab5c65-42db-4f11-a565-5e52c8ae7b44 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 19aa1dcc-c3d9-4def-b772-e393eaf11a22] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:51:59.455802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aeab5c65-42db-4f11-a565-5e52c8ae7b44 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:59.456306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aeab5c65-42db-4f11-a565-5e52c8ae7b44 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:59.457315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aeab5c65-42db-4f11-a565-5e52c8ae7b44 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:59.458392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aeab5c65-42db-4f11-a565-5e52c8ae7b44 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:51:59.458849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aeab5c65-42db-4f11-a565-5e52c8ae7b44 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:51:59.459631 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aeab5c65-42db-4f11-a565-5e52c8ae7b44 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:51:59.571171 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aeab5c65-42db-4f11-a565-5e52c8ae7b44 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:51:59.580280 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aeab5c65-42db-4f11-a565-5e52c8ae7b44 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22" status: 200 len: 1477 microversion: 2.1 time: 0.149235 Aug 24 10:51:59.581287 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3219/6086] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:51:59 2022] GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22 => generated 1477 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:00.329231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-a78e68df-b869-4976-a3a3-4b42f9a12be4 req-b1cda62b-a053-4b7c-af01-7cd96753574c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19aa1dcc-c3d9-4def-b772-e393eaf11a22", "name": "network-vif-deleted", "tag": "9bd7b794-dad4-4e62-a7dc-6a05be1ab963"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:52:00.356117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a78e68df-b869-4976-a3a3-4b42f9a12be4 req-b1cda62b-a053-4b7c-af01-7cd96753574c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:00.358291 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a78e68df-b869-4976-a3a3-4b42f9a12be4 req-b1cda62b-a053-4b7c-af01-7cd96753574c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:00.359085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a78e68df-b869-4976-a3a3-4b42f9a12be4 req-b1cda62b-a053-4b7c-af01-7cd96753574c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:00.391225 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-a78e68df-b869-4976-a3a3-4b42f9a12be4 req-b1cda62b-a053-4b7c-af01-7cd96753574c service nova] Creating event network-vif-deleted:9bd7b794-dad4-4e62-a7dc-6a05be1ab963 for instance 19aa1dcc-c3d9-4def-b772-e393eaf11a22 on n-h1-849328-3 Aug 24 10:52:00.413928 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-a78e68df-b869-4976-a3a3-4b42f9a12be4 req-b1cda62b-a053-4b7c-af01-7cd96753574c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091333 Aug 24 10:52:00.414560 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2868/6087] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:52:00.603182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fcf65de8-2a3b-46c9-83a4-2ac9aeecca8d tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:00.603860 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fcf65de8-2a3b-46c9-83a4-2ac9aeecca8d tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 19aa1dcc-c3d9-4def-b772-e393eaf11a22] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:00.611113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcf65de8-2a3b-46c9-83a4-2ac9aeecca8d tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:00.611887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcf65de8-2a3b-46c9-83a4-2ac9aeecca8d tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:00.612325 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcf65de8-2a3b-46c9-83a4-2ac9aeecca8d tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:00.613239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcf65de8-2a3b-46c9-83a4-2ac9aeecca8d tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:00.613703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcf65de8-2a3b-46c9-83a4-2ac9aeecca8d tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:00.614135 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcf65de8-2a3b-46c9-83a4-2ac9aeecca8d tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:00.649668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcf65de8-2a3b-46c9-83a4-2ac9aeecca8d tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:00.650458 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcf65de8-2a3b-46c9-83a4-2ac9aeecca8d tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:00.651574 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcf65de8-2a3b-46c9-83a4-2ac9aeecca8d tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:00.651796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-fcf65de8-2a3b-46c9-83a4-2ac9aeecca8d tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lazy-loading 'fault' on Instance uuid 19aa1dcc-c3d9-4def-b772-e393eaf11a22 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:52:00.704424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fcf65de8-2a3b-46c9-83a4-2ac9aeecca8d tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:00.716870 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fcf65de8-2a3b-46c9-83a4-2ac9aeecca8d tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22" status: 200 len: 1330 microversion: 2.1 time: 0.118249 Aug 24 10:52:00.718005 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3220/6088] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:00 2022] GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22 => generated 1330 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:01.744322 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c3813f2e-4f0a-458b-8c6e-9ed56e3652f7 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:01.745506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c3813f2e-4f0a-458b-8c6e-9ed56e3652f7 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 19aa1dcc-c3d9-4def-b772-e393eaf11a22] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:01.754682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3813f2e-4f0a-458b-8c6e-9ed56e3652f7 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:01.755206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3813f2e-4f0a-458b-8c6e-9ed56e3652f7 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:01.755916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3813f2e-4f0a-458b-8c6e-9ed56e3652f7 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:01.756932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3813f2e-4f0a-458b-8c6e-9ed56e3652f7 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:01.757535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3813f2e-4f0a-458b-8c6e-9ed56e3652f7 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:01.758188 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3813f2e-4f0a-458b-8c6e-9ed56e3652f7 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:01.781040 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-c3813f2e-4f0a-458b-8c6e-9ed56e3652f7 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] HTTP exception thrown: Instance 19aa1dcc-c3d9-4def-b772-e393eaf11a22 could not be found. Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c3813f2e-4f0a-458b-8c6e-9ed56e3652f7 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Request method failure captured: Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22 HTTP/1.1 Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgJmw8GqF6xD1VWp09e8QvO-X9n-bG9agWynUzoH0Ul8tlOOLEyW6IecaQFdxAPVfKubzNi3DuE4ckFGR5-76iEfR1AUmZmkSmFPoyQWr63Pb3Zjhj7ow9M6CqNIC1tcFtNH67_j1rqAOUofhZR1VFfi2bvsnMogETklqfu_IzhKPCs Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 5566add1862d44f5be270fcefeb1a4bf Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1742835842 Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5566add1862d44f5be270fcefeb1a4bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_5566add1862d44f5be270fcefeb1a4bf", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5566add1862d44f5be270fcefeb1a4bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/5566add1862d44f5be270fcefeb1a4bf"}]}] Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1742835842 Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 5566add1862d44f5be270fcefeb1a4bf Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1742835842 Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-TestSecurityGroupsBasicOps-1742835842-project Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 7465bc2e09b4455b8cee5e8aeb11dbb9 Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1742835842-project Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 19aa1dcc-c3d9-4def-b772-e393eaf11a22 could not be found. Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '19aa1dcc-c3d9-4def-b772-e393eaf11a22'} Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19aa1dcc-c3d9-4def-b772-e393eaf11a22 could not be found. Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19aa1dcc-c3d9-4def-b772-e393eaf11a22 could not be found. Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:52:01.783530 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:52:01.787256 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:52:01.787256 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:52:01.787256 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:52:01.787256 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:52:01.787256 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:52:01.787256 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:52:01.787256 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19aa1dcc-c3d9-4def-b772-e393eaf11a22 could not be found. Aug 24 10:52:01.787256 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:52:01.787256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c3813f2e-4f0a-458b-8c6e-9ed56e3652f7 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Returning 404 to user: Instance 19aa1dcc-c3d9-4def-b772-e393eaf11a22 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:52:01.787256 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c3813f2e-4f0a-458b-8c6e-9ed56e3652f7 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22" status: 404 len: 111 microversion: 2.1 time: 0.048092 Aug 24 10:52:01.791466 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2869/6089] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:01 2022] GET /compute/v2.1/servers/19aa1dcc-c3d9-4def-b772-e393eaf11a22 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:52:07.408697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9dbe4d8c-8134-45e8-9fed-72219e5ed10f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:52:07.413109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9dbe4d8c-8134-45e8-9fed-72219e5ed10f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:07.416422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:07.422044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9dbe4d8c-8134-45e8-9fed-72219e5ed10f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:07.422818 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9dbe4d8c-8134-45e8-9fed-72219e5ed10f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:07.423513 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9dbe4d8c-8134-45e8-9fed-72219e5ed10f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:07.424461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9dbe4d8c-8134-45e8-9fed-72219e5ed10f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:07.425162 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9dbe4d8c-8134-45e8-9fed-72219e5ed10f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:07.425806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9dbe4d8c-8134-45e8-9fed-72219e5ed10f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:07.500645 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9dbe4d8c-8134-45e8-9fed-72219e5ed10f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "POST /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f/action" status: 200 len: 24562 microversion: 2.1 time: 0.093675 Aug 24 10:52:07.502507 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3221/6090] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:52:07 2022] POST /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f/action => generated 24562 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:52:08.089323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6b04d91c-8b9f-496a-8475-a4aba70a58ac tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:08.089936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6b04d91c-8b9f-496a-8475-a4aba70a58ac tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 5bf06a96-37db-4b6f-ad24-f5a10125701d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:08.096868 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:08.112984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-702140a2-2a1e-4c62-9863-ef522941d9f7 req-61493b36-491c-4d54-82fb-117deffdd070 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bf06a96-37db-4b6f-ad24-f5a10125701d", "tag": "73a62d46-7d7c-4125-87a7-decdce4f8e2f"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:52:08.115036 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b04d91c-8b9f-496a-8475-a4aba70a58ac tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:08.115649 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b04d91c-8b9f-496a-8475-a4aba70a58ac tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:08.116248 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b04d91c-8b9f-496a-8475-a4aba70a58ac tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:08.117738 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b04d91c-8b9f-496a-8475-a4aba70a58ac tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:08.118570 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b04d91c-8b9f-496a-8475-a4aba70a58ac tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:08.119731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b04d91c-8b9f-496a-8475-a4aba70a58ac tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:08.128234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-702140a2-2a1e-4c62-9863-ef522941d9f7 req-61493b36-491c-4d54-82fb-117deffdd070 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:08.132211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-702140a2-2a1e-4c62-9863-ef522941d9f7 req-61493b36-491c-4d54-82fb-117deffdd070 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:08.135403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-702140a2-2a1e-4c62-9863-ef522941d9f7 req-61493b36-491c-4d54-82fb-117deffdd070 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:08.156295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6b04d91c-8b9f-496a-8475-a4aba70a58ac tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 5bf06a96-37db-4b6f-ad24-f5a10125701d] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:52:08.160460 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-702140a2-2a1e-4c62-9863-ef522941d9f7 req-61493b36-491c-4d54-82fb-117deffdd070 service nova] Creating event network-changed:73a62d46-7d7c-4125-87a7-decdce4f8e2f for instance 5bf06a96-37db-4b6f-ad24-f5a10125701d on n-h2-849328-3 Aug 24 10:52:08.171065 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-702140a2-2a1e-4c62-9863-ef522941d9f7 req-61493b36-491c-4d54-82fb-117deffdd070 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062127 Aug 24 10:52:08.177280 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3222/6091] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:52:08.329796 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6b04d91c-8b9f-496a-8475-a4aba70a58ac tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "DELETE /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d" status: 204 len: 0 microversion: 2.1 time: 0.243914 Aug 24 10:52:08.337717 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2870/6092] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:52:08 2022] DELETE /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:52:08.350475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e4f693d9-b306-4466-b490-581799e1c56e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:08.353682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e4f693d9-b306-4466-b490-581799e1c56e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 5bf06a96-37db-4b6f-ad24-f5a10125701d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:08.372139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4f693d9-b306-4466-b490-581799e1c56e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:08.376525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4f693d9-b306-4466-b490-581799e1c56e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:08.377163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4f693d9-b306-4466-b490-581799e1c56e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:08.378048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4f693d9-b306-4466-b490-581799e1c56e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:08.379069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4f693d9-b306-4466-b490-581799e1c56e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:08.379389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4f693d9-b306-4466-b490-581799e1c56e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:08.706542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e4f693d9-b306-4466-b490-581799e1c56e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:08.720838 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e4f693d9-b306-4466-b490-581799e1c56e tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d" status: 200 len: 1765 microversion: 2.1 time: 0.377135 Aug 24 10:52:08.722012 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3223/6093] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:08 2022] GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d => generated 1765 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:09.751267 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fc59f6d9-4a49-41fd-a3c2-7061d489e092 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:09.753030 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fc59f6d9-4a49-41fd-a3c2-7061d489e092 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 5bf06a96-37db-4b6f-ad24-f5a10125701d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:09.764697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc59f6d9-4a49-41fd-a3c2-7061d489e092 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:09.766097 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc59f6d9-4a49-41fd-a3c2-7061d489e092 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:09.766988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc59f6d9-4a49-41fd-a3c2-7061d489e092 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:09.768430 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc59f6d9-4a49-41fd-a3c2-7061d489e092 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:09.769231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc59f6d9-4a49-41fd-a3c2-7061d489e092 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:09.769938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc59f6d9-4a49-41fd-a3c2-7061d489e092 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:10.091341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fc59f6d9-4a49-41fd-a3c2-7061d489e092 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:10.100978 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fc59f6d9-4a49-41fd-a3c2-7061d489e092 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d" status: 200 len: 1765 microversion: 2.1 time: 0.359454 Aug 24 10:52:10.104708 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2871/6094] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:09 2022] GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d => generated 1765 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:10.802356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-ba0985fa-2898-4d1d-b275-850516384e2a req-effd1e65-bb93-4aa2-ad5a-8ee2ab0f869d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf06a96-37db-4b6f-ad24-f5a10125701d", "name": "network-vif-deleted", "tag": "73a62d46-7d7c-4125-87a7-decdce4f8e2f"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:52:10.839357 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ba0985fa-2898-4d1d-b275-850516384e2a req-effd1e65-bb93-4aa2-ad5a-8ee2ab0f869d service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:10.846720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ba0985fa-2898-4d1d-b275-850516384e2a req-effd1e65-bb93-4aa2-ad5a-8ee2ab0f869d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:10.847355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ba0985fa-2898-4d1d-b275-850516384e2a req-effd1e65-bb93-4aa2-ad5a-8ee2ab0f869d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:10.885370 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-ba0985fa-2898-4d1d-b275-850516384e2a req-effd1e65-bb93-4aa2-ad5a-8ee2ab0f869d service nova] Creating event network-vif-deleted:73a62d46-7d7c-4125-87a7-decdce4f8e2f for instance 5bf06a96-37db-4b6f-ad24-f5a10125701d on n-h2-849328-3 Aug 24 10:52:10.906286 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-ba0985fa-2898-4d1d-b275-850516384e2a req-effd1e65-bb93-4aa2-ad5a-8ee2ab0f869d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108733 Aug 24 10:52:10.906964 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3224/6095] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:52:11.128394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-10c2add6-3e3f-4335-a677-5bbe19f254c6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:11.128901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-10c2add6-3e3f-4335-a677-5bbe19f254c6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 5bf06a96-37db-4b6f-ad24-f5a10125701d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:11.142263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10c2add6-3e3f-4335-a677-5bbe19f254c6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:11.147715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10c2add6-3e3f-4335-a677-5bbe19f254c6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:11.153102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10c2add6-3e3f-4335-a677-5bbe19f254c6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:11.157336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10c2add6-3e3f-4335-a677-5bbe19f254c6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:11.158439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10c2add6-3e3f-4335-a677-5bbe19f254c6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:11.160730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10c2add6-3e3f-4335-a677-5bbe19f254c6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:11.164364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:11.210699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10c2add6-3e3f-4335-a677-5bbe19f254c6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:11.211414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10c2add6-3e3f-4335-a677-5bbe19f254c6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:11.212246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10c2add6-3e3f-4335-a677-5bbe19f254c6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:11.212969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-10c2add6-3e3f-4335-a677-5bbe19f254c6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lazy-loading 'fault' on Instance uuid 5bf06a96-37db-4b6f-ad24-f5a10125701d {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:52:11.332287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-10c2add6-3e3f-4335-a677-5bbe19f254c6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7465bc2e09b4455b8cee5e8aeb11dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5566add1862d44f5be270fcefeb1a4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:11.347606 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-10c2add6-3e3f-4335-a677-5bbe19f254c6 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d" status: 200 len: 1382 microversion: 2.1 time: 0.223736 Aug 24 10:52:11.350059 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2872/6096] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:11 2022] GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d => generated 1382 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:12.375887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-088f8230-21cb-4e51-bfc5-4d3443c66810 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:12.379121 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-088f8230-21cb-4e51-bfc5-4d3443c66810 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] [instance: 5bf06a96-37db-4b6f-ad24-f5a10125701d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:12.389754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-088f8230-21cb-4e51-bfc5-4d3443c66810 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:12.390468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-088f8230-21cb-4e51-bfc5-4d3443c66810 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:12.391015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-088f8230-21cb-4e51-bfc5-4d3443c66810 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:12.391722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-088f8230-21cb-4e51-bfc5-4d3443c66810 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:12.392170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-088f8230-21cb-4e51-bfc5-4d3443c66810 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:12.392776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-088f8230-21cb-4e51-bfc5-4d3443c66810 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:12.411257 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-088f8230-21cb-4e51-bfc5-4d3443c66810 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] HTTP exception thrown: Instance 5bf06a96-37db-4b6f-ad24-f5a10125701d could not be found. Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-088f8230-21cb-4e51-bfc5-4d3443c66810 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Request method failure captured: Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d HTTP/1.1 Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgJmw8GqF6xD1VWp09e8QvO-X9n-bG9agWynUzoH0Ul8tlOOLEyW6IecaQFdxAPVfKubzNi3DuE4ckFGR5-76iEfR1AUmZmkSmFPoyQWr63Pb3Zjhj7ow9M6CqNIC1tcFtNH67_j1rqAOUofhZR1VFfi2bvsnMogETklqfu_IzhKPCs Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 5566add1862d44f5be270fcefeb1a4bf Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1742835842 Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5566add1862d44f5be270fcefeb1a4bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_5566add1862d44f5be270fcefeb1a4bf", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5566add1862d44f5be270fcefeb1a4bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/5566add1862d44f5be270fcefeb1a4bf"}]}] Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1742835842 Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 5566add1862d44f5be270fcefeb1a4bf Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1742835842 Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestSecurityGroupsBasicOps-1742835842-project Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 7465bc2e09b4455b8cee5e8aeb11dbb9 Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1742835842-project Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 5bf06a96-37db-4b6f-ad24-f5a10125701d could not be found. Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '5bf06a96-37db-4b6f-ad24-f5a10125701d'} Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bf06a96-37db-4b6f-ad24-f5a10125701d could not be found. Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bf06a96-37db-4b6f-ad24-f5a10125701d could not be found. Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:52:12.412921 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:52:12.423001 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:52:12.423001 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:52:12.423001 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:52:12.423001 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:52:12.423001 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:52:12.423001 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:52:12.423001 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bf06a96-37db-4b6f-ad24-f5a10125701d could not be found. Aug 24 10:52:12.423001 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:52:12.423001 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-088f8230-21cb-4e51-bfc5-4d3443c66810 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Returning 404 to user: Instance 5bf06a96-37db-4b6f-ad24-f5a10125701d could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:52:12.423001 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-088f8230-21cb-4e51-bfc5-4d3443c66810 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d" status: 404 len: 111 microversion: 2.1 time: 0.043327 Aug 24 10:52:12.423001 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3225/6097] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:12 2022] GET /compute/v2.1/servers/5bf06a96-37db-4b6f-ad24-f5a10125701d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:52:18.427521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-817f6970-4bd1-4db5-a718-971cd48a46f2 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] Calling method '.version_select at 0x7f4654cdfb80>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:18.465364 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-817f6970-4bd1-4db5-a718-971cd48a46f2 tempest-TestSecurityGroupsBasicOps-1742835842 tempest-TestSecurityGroupsBasicOps-1742835842-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-427861830" status: 202 len: 0 microversion: 2.1 time: 0.045040 Aug 24 10:52:18.466538 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2873/6098] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Aug 24 10:52:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-427861830 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:52:18.519128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fa0185e8-a486-4847-9c67-79eacbfbaefe tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:18.519833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fa0185e8-a486-4847-9c67-79eacbfbaefe tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:18.530838 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa0185e8-a486-4847-9c67-79eacbfbaefe tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:18.531456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa0185e8-a486-4847-9c67-79eacbfbaefe tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:18.531926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa0185e8-a486-4847-9c67-79eacbfbaefe tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:18.532833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa0185e8-a486-4847-9c67-79eacbfbaefe tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:18.533520 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa0185e8-a486-4847-9c67-79eacbfbaefe tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:18.534050 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa0185e8-a486-4847-9c67-79eacbfbaefe tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:18.718166 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fa0185e8-a486-4847-9c67-79eacbfbaefe tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1835 microversion: 2.1 time: 0.203165 Aug 24 10:52:18.718989 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3226/6099] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:18 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1835 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:18.739533 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-86ad11e3-120f-4434-b754-5a49ab373324 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:18.740161 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-86ad11e3-120f-4434-b754-5a49ab373324 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:18.747771 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86ad11e3-120f-4434-b754-5a49ab373324 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:18.748282 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86ad11e3-120f-4434-b754-5a49ab373324 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:18.748883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86ad11e3-120f-4434-b754-5a49ab373324 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:18.749636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86ad11e3-120f-4434-b754-5a49ab373324 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:18.750098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86ad11e3-120f-4434-b754-5a49ab373324 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:18.750531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86ad11e3-120f-4434-b754-5a49ab373324 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:18.898179 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-86ad11e3-120f-4434-b754-5a49ab373324 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:18.910018 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-86ad11e3-120f-4434-b754-5a49ab373324 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1684 microversion: 2.1 time: 0.174461 Aug 24 10:52:18.910723 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2874/6100] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:18 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1684 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:52:19.072258 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-627d077b-6c82-42fc-9537-2b29d133f5fb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:52:19.075142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-627d077b-6c82-42fc-9537-2b29d133f5fb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:19.084006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-627d077b-6c82-42fc-9537-2b29d133f5fb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:19.084657 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-627d077b-6c82-42fc-9537-2b29d133f5fb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:19.085351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-627d077b-6c82-42fc-9537-2b29d133f5fb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:19.086411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-627d077b-6c82-42fc-9537-2b29d133f5fb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:19.087414 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-627d077b-6c82-42fc-9537-2b29d133f5fb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:19.088442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-627d077b-6c82-42fc-9537-2b29d133f5fb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:19.162265 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-627d077b-6c82-42fc-9537-2b29d133f5fb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "POST /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f/action" status: 200 len: 32635 microversion: 2.1 time: 0.107266 Aug 24 10:52:19.167034 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3227/6101] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:52:19 2022] POST /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f/action => generated 32635 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 10:52:19.280546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dce4251a-fe24-4e48-af81-5a7f1667d674 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1956282399", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5d76917f-d74f-45e1-982e-bbcf6d5e6aeb", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "9996d4a7-fe50-441a-b919-9c80031d0109"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:52:19.343061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e4a6c22f-d5aa-4dfe-99e4-f14aa66125cb tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:52:19.343732 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e4a6c22f-d5aa-4dfe-99e4-f14aa66125cb tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:19.354137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4a6c22f-d5aa-4dfe-99e4-f14aa66125cb tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:19.354635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4a6c22f-d5aa-4dfe-99e4-f14aa66125cb tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:19.355068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4a6c22f-d5aa-4dfe-99e4-f14aa66125cb tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:19.355961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4a6c22f-d5aa-4dfe-99e4-f14aa66125cb tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:19.356568 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4a6c22f-d5aa-4dfe-99e4-f14aa66125cb tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:19.358096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4a6c22f-d5aa-4dfe-99e4-f14aa66125cb tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:19.397246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-dce4251a-fe24-4e48-af81-5a7f1667d674 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] validate_networks() for [('9996d4a7-fe50-441a-b919-9c80031d0109', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:52:19.434525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e4a6c22f-d5aa-4dfe-99e4-f14aa66125cb tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6f15314107944f66855d13dca1b2e97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e720f1f52028408c84b0e478336c938d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:19.435515 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e4a6c22f-d5aa-4dfe-99e4-f14aa66125cb tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] flavor_id is None. Assuming migration. {{(pid=122433) resize /opt/stack/nova/nova/compute/api.py:4181}} Aug 24 10:52:19.436547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e4a6c22f-d5aa-4dfe-99e4-f14aa66125cb tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122433) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 10:52:19.851836 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e4a6c22f-d5aa-4dfe-99e4-f14aa66125cb tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f/action" status: 202 len: 0 microversion: 2.1 time: 0.514534 Aug 24 10:52:19.858300 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3228/6102] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:52:19 2022] POST /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:52:19.868649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f65e5bf5-2388-4c40-ad4e-f81bfdff10ae tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:19.874558 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f65e5bf5-2388-4c40-ad4e-f81bfdff10ae tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:19.889879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f65e5bf5-2388-4c40-ad4e-f81bfdff10ae tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:19.892064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f65e5bf5-2388-4c40-ad4e-f81bfdff10ae tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:19.896502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f65e5bf5-2388-4c40-ad4e-f81bfdff10ae tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:19.897660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f65e5bf5-2388-4c40-ad4e-f81bfdff10ae tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:19.898571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f65e5bf5-2388-4c40-ad4e-f81bfdff10ae tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:19.899030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f65e5bf5-2388-4c40-ad4e-f81bfdff10ae tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:19.938995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-dce4251a-fe24-4e48-af81-5a7f1667d674 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:52:19.939811 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-dce4251a-fe24-4e48-af81-5a7f1667d674 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:52:19.940793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-dce4251a-fe24-4e48-af81-5a7f1667d674 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:52:19.941656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-dce4251a-fe24-4e48-af81-5a7f1667d674 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:52:19.942424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-dce4251a-fe24-4e48-af81-5a7f1667d674 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:52:19.959351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dce4251a-fe24-4e48-af81-5a7f1667d674 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:19.960442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dce4251a-fe24-4e48-af81-5a7f1667d674 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:19.961201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dce4251a-fe24-4e48-af81-5a7f1667d674 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:19.962439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dce4251a-fe24-4e48-af81-5a7f1667d674 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:19.963075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dce4251a-fe24-4e48-af81-5a7f1667d674 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:19.963655 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dce4251a-fe24-4e48-af81-5a7f1667d674 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:19.985492 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-dce4251a-fe24-4e48-af81-5a7f1667d674 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Getting quotas for project d1785d661bbd41619a7046600ad435b1. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:52:19.992480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-dce4251a-fe24-4e48-af81-5a7f1667d674 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Getting quotas for user 26b7ff61eab4477890d20977574e8dac and project d1785d661bbd41619a7046600ad435b1. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:52:20.007721 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dce4251a-fe24-4e48-af81-5a7f1667d674 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:52:20.010448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dce4251a-fe24-4e48-af81-5a7f1667d674 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='5d76917f-d74f-45e1-982e-bbcf6d5e6aeb',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:52:20.114516 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dce4251a-fe24-4e48-af81-5a7f1667d674 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.836460 Aug 24 10:52:20.122729 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2875/6103] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:52:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:52:20.128517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f0c03bdb-20a0-4fbf-9b3b-71717ca42ecc tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:20.130768 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f0c03bdb-20a0-4fbf-9b3b-71717ca42ecc tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:20.202570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f65e5bf5-2388-4c40-ad4e-f81bfdff10ae tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:20.213828 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f65e5bf5-2388-4c40-ad4e-f81bfdff10ae tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1693 microversion: 2.1 time: 0.352641 Aug 24 10:52:20.217872 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3229/6104] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:19 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1693 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:20.234401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f0c03bdb-20a0-4fbf-9b3b-71717ca42ecc tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:20.248042 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f0c03bdb-20a0-4fbf-9b3b-71717ca42ecc tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1057 microversion: 2.1 time: 0.123243 Aug 24 10:52:20.254393 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2876/6105] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:20 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1057 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:21.235890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9fa5ba68-8883-4255-bbbd-fdb036c9cc57 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:21.236583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9fa5ba68-8883-4255-bbbd-fdb036c9cc57 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:21.245974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9fa5ba68-8883-4255-bbbd-fdb036c9cc57 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:21.246507 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9fa5ba68-8883-4255-bbbd-fdb036c9cc57 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:21.246897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9fa5ba68-8883-4255-bbbd-fdb036c9cc57 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:21.247951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9fa5ba68-8883-4255-bbbd-fdb036c9cc57 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:21.248397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9fa5ba68-8883-4255-bbbd-fdb036c9cc57 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:21.249325 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9fa5ba68-8883-4255-bbbd-fdb036c9cc57 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:21.276318 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b95c56cd-3f55-4f70-8e39-ee9b6219f027 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:21.278776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b95c56cd-3f55-4f70-8e39-ee9b6219f027 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:21.293661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b95c56cd-3f55-4f70-8e39-ee9b6219f027 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:21.294451 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b95c56cd-3f55-4f70-8e39-ee9b6219f027 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:21.295210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b95c56cd-3f55-4f70-8e39-ee9b6219f027 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:21.296384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b95c56cd-3f55-4f70-8e39-ee9b6219f027 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:21.297194 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b95c56cd-3f55-4f70-8e39-ee9b6219f027 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:21.297842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b95c56cd-3f55-4f70-8e39-ee9b6219f027 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:21.393783 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b95c56cd-3f55-4f70-8e39-ee9b6219f027 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:21.403133 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b95c56cd-3f55-4f70-8e39-ee9b6219f027 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1109 microversion: 2.1 time: 0.136573 Aug 24 10:52:21.417526 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2877/6106] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:21 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1109 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:21.450569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9fa5ba68-8883-4255-bbbd-fdb036c9cc57 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:21.460156 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9fa5ba68-8883-4255-bbbd-fdb036c9cc57 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1693 microversion: 2.1 time: 0.228734 Aug 24 10:52:21.461152 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3230/6107] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:21 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1693 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:22.433611 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b54ca86b-995e-433e-83a8-58d18f027423 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:22.435947 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b54ca86b-995e-433e-83a8-58d18f027423 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:22.465502 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b54ca86b-995e-433e-83a8-58d18f027423 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:22.466162 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b54ca86b-995e-433e-83a8-58d18f027423 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:22.466623 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b54ca86b-995e-433e-83a8-58d18f027423 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:22.467392 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b54ca86b-995e-433e-83a8-58d18f027423 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:22.474393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b54ca86b-995e-433e-83a8-58d18f027423 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:22.475011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b54ca86b-995e-433e-83a8-58d18f027423 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:22.485364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e0dcd8a7-218c-4902-9438-f666c90fe418 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:22.489612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e0dcd8a7-218c-4902-9438-f666c90fe418 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:22.501266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0dcd8a7-218c-4902-9438-f666c90fe418 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:22.503211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0dcd8a7-218c-4902-9438-f666c90fe418 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:22.503864 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0dcd8a7-218c-4902-9438-f666c90fe418 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:22.504820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0dcd8a7-218c-4902-9438-f666c90fe418 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:22.505508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0dcd8a7-218c-4902-9438-f666c90fe418 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:22.506515 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0dcd8a7-218c-4902-9438-f666c90fe418 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:22.648447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b54ca86b-995e-433e-83a8-58d18f027423 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:22.659625 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b54ca86b-995e-433e-83a8-58d18f027423 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1127 microversion: 2.1 time: 0.232856 Aug 24 10:52:22.664800 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2878/6108] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:22 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1127 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:22.734420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e0dcd8a7-218c-4902-9438-f666c90fe418 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:22.747249 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e0dcd8a7-218c-4902-9438-f666c90fe418 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1693 microversion: 2.1 time: 0.269051 Aug 24 10:52:22.753036 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3231/6109] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:22 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1693 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:23.687421 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6812db04-d255-4db9-bcff-669a0765f83d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:23.689324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6812db04-d255-4db9-bcff-669a0765f83d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:23.703358 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6812db04-d255-4db9-bcff-669a0765f83d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:23.703933 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6812db04-d255-4db9-bcff-669a0765f83d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:23.704385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6812db04-d255-4db9-bcff-669a0765f83d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:23.705544 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6812db04-d255-4db9-bcff-669a0765f83d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:23.706012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6812db04-d255-4db9-bcff-669a0765f83d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:23.706443 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6812db04-d255-4db9-bcff-669a0765f83d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:23.777169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bed48ce8-c337-4f34-b25f-dc14f20c5626 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:23.778049 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bed48ce8-c337-4f34-b25f-dc14f20c5626 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:23.789271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bed48ce8-c337-4f34-b25f-dc14f20c5626 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:23.791773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bed48ce8-c337-4f34-b25f-dc14f20c5626 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:23.793373 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bed48ce8-c337-4f34-b25f-dc14f20c5626 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:23.795594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bed48ce8-c337-4f34-b25f-dc14f20c5626 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:23.797655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bed48ce8-c337-4f34-b25f-dc14f20c5626 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:23.798555 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bed48ce8-c337-4f34-b25f-dc14f20c5626 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:24.092412 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bed48ce8-c337-4f34-b25f-dc14f20c5626 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:24.102664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:24.106173 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bed48ce8-c337-4f34-b25f-dc14f20c5626 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1693 microversion: 2.1 time: 0.333028 Aug 24 10:52:24.108395 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3232/6110] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:23 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1693 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:52:24.248179 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6812db04-d255-4db9-bcff-669a0765f83d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:24.265112 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6812db04-d255-4db9-bcff-669a0765f83d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1169 microversion: 2.1 time: 0.578954 Aug 24 10:52:24.265112 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2879/6111] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:23 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1169 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:25.131118 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ed943527-7391-4115-9050-1294254882cb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:25.131795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ed943527-7391-4115-9050-1294254882cb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:25.148241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed943527-7391-4115-9050-1294254882cb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:25.152585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed943527-7391-4115-9050-1294254882cb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:25.153338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed943527-7391-4115-9050-1294254882cb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:25.154262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed943527-7391-4115-9050-1294254882cb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:25.157496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed943527-7391-4115-9050-1294254882cb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:25.158139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed943527-7391-4115-9050-1294254882cb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:25.289292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-79aad27f-8d7e-47c9-b6cb-8c3d991d0903 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:25.290254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-79aad27f-8d7e-47c9-b6cb-8c3d991d0903 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:25.319303 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79aad27f-8d7e-47c9-b6cb-8c3d991d0903 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:25.320173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79aad27f-8d7e-47c9-b6cb-8c3d991d0903 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:25.320854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79aad27f-8d7e-47c9-b6cb-8c3d991d0903 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:25.324517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79aad27f-8d7e-47c9-b6cb-8c3d991d0903 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:25.326314 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79aad27f-8d7e-47c9-b6cb-8c3d991d0903 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:25.326956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79aad27f-8d7e-47c9-b6cb-8c3d991d0903 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:25.418992 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ed943527-7391-4115-9050-1294254882cb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:25.453224 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ed943527-7391-4115-9050-1294254882cb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1698 microversion: 2.1 time: 0.329063 Aug 24 10:52:25.463416 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3233/6112] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:25 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1698 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:25.495889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-668e4f87-d63a-4f8c-a21b-7dbaad2a6fbb req-cd513ec7-e2f3-4641-9687-cc891ca2d7a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad6e3a34-00af-471c-b9a3-b75c8ac73714", "tag": "7f6a3e74-c3ef-45cf-8100-a9905efc8d92"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:52:25.534143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-668e4f87-d63a-4f8c-a21b-7dbaad2a6fbb req-cd513ec7-e2f3-4641-9687-cc891ca2d7a9 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:25.535163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-668e4f87-d63a-4f8c-a21b-7dbaad2a6fbb req-cd513ec7-e2f3-4641-9687-cc891ca2d7a9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:25.536149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-668e4f87-d63a-4f8c-a21b-7dbaad2a6fbb req-cd513ec7-e2f3-4641-9687-cc891ca2d7a9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:25.560136 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-668e4f87-d63a-4f8c-a21b-7dbaad2a6fbb req-cd513ec7-e2f3-4641-9687-cc891ca2d7a9 service nova] Creating event network-changed:7f6a3e74-c3ef-45cf-8100-a9905efc8d92 for instance ad6e3a34-00af-471c-b9a3-b75c8ac73714 on n-h1-849328-3 Aug 24 10:52:25.583992 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-668e4f87-d63a-4f8c-a21b-7dbaad2a6fbb req-cd513ec7-e2f3-4641-9687-cc891ca2d7a9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113615 Aug 24 10:52:25.591513 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3234/6113] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:52:25.774936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-79aad27f-8d7e-47c9-b6cb-8c3d991d0903 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:25.785359 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-79aad27f-8d7e-47c9-b6cb-8c3d991d0903 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1169 microversion: 2.1 time: 0.502616 Aug 24 10:52:25.786020 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2880/6114] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:25 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1169 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:52:26.496741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9e7ed4e7-796e-4dba-a300-44ce2847fcbd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:26.498224 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9e7ed4e7-796e-4dba-a300-44ce2847fcbd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:26.510908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e7ed4e7-796e-4dba-a300-44ce2847fcbd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:26.513986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e7ed4e7-796e-4dba-a300-44ce2847fcbd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:26.514534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e7ed4e7-796e-4dba-a300-44ce2847fcbd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:26.515361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e7ed4e7-796e-4dba-a300-44ce2847fcbd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:26.515996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e7ed4e7-796e-4dba-a300-44ce2847fcbd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:26.516515 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e7ed4e7-796e-4dba-a300-44ce2847fcbd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:26.786135 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9e7ed4e7-796e-4dba-a300-44ce2847fcbd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:26.825819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32d94182-2660-48e9-857c-d8d56a2f9d21 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:26.828368 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9e7ed4e7-796e-4dba-a300-44ce2847fcbd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1698 microversion: 2.1 time: 0.314979 Aug 24 10:52:26.828953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-32d94182-2660-48e9-857c-d8d56a2f9d21 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:26.833289 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3235/6115] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:26 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1698 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:26.839544 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d94182-2660-48e9-857c-d8d56a2f9d21 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:26.840309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d94182-2660-48e9-857c-d8d56a2f9d21 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:26.840952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d94182-2660-48e9-857c-d8d56a2f9d21 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:26.842060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d94182-2660-48e9-857c-d8d56a2f9d21 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:26.842692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d94182-2660-48e9-857c-d8d56a2f9d21 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:26.843274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d94182-2660-48e9-857c-d8d56a2f9d21 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:27.131240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-32d94182-2660-48e9-857c-d8d56a2f9d21 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:27.142459 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-32d94182-2660-48e9-857c-d8d56a2f9d21 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1169 microversion: 2.1 time: 0.335530 Aug 24 10:52:27.159127 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2881/6116] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:26 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1169 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:27.857548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-78148fd7-9043-4380-929a-ce314a4a0e6a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:27.858576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-78148fd7-9043-4380-929a-ce314a4a0e6a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:27.872598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78148fd7-9043-4380-929a-ce314a4a0e6a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:27.873256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78148fd7-9043-4380-929a-ce314a4a0e6a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:27.873812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78148fd7-9043-4380-929a-ce314a4a0e6a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:27.874793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78148fd7-9043-4380-929a-ce314a4a0e6a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:27.875626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78148fd7-9043-4380-929a-ce314a4a0e6a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:27.876261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78148fd7-9043-4380-929a-ce314a4a0e6a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:28.080849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-78148fd7-9043-4380-929a-ce314a4a0e6a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:28.097981 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-78148fd7-9043-4380-929a-ce314a4a0e6a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1698 microversion: 2.1 time: 0.247645 Aug 24 10:52:28.109536 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3236/6117] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:27 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1698 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:28.175332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-78ae2583-5543-498f-b119-cd7f159c8f43 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:28.179382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-78ae2583-5543-498f-b119-cd7f159c8f43 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:28.190448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78ae2583-5543-498f-b119-cd7f159c8f43 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:28.191332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78ae2583-5543-498f-b119-cd7f159c8f43 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:28.192307 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78ae2583-5543-498f-b119-cd7f159c8f43 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:28.193527 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78ae2583-5543-498f-b119-cd7f159c8f43 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:28.194181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78ae2583-5543-498f-b119-cd7f159c8f43 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:28.194739 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78ae2583-5543-498f-b119-cd7f159c8f43 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:28.470672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-78ae2583-5543-498f-b119-cd7f159c8f43 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:28.482614 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-78ae2583-5543-498f-b119-cd7f159c8f43 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1169 microversion: 2.1 time: 0.318846 Aug 24 10:52:28.497253 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2882/6118] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:28 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1169 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:29.125703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0d0f550a-3e8a-44e9-bed5-57aa7181225d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:29.126961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0d0f550a-3e8a-44e9-bed5-57aa7181225d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:29.142854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d0f550a-3e8a-44e9-bed5-57aa7181225d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:29.147192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d0f550a-3e8a-44e9-bed5-57aa7181225d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:29.147394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d0f550a-3e8a-44e9-bed5-57aa7181225d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:29.154248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d0f550a-3e8a-44e9-bed5-57aa7181225d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:29.154758 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d0f550a-3e8a-44e9-bed5-57aa7181225d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:29.155201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d0f550a-3e8a-44e9-bed5-57aa7181225d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:29.459907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0d0f550a-3e8a-44e9-bed5-57aa7181225d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:29.470413 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0d0f550a-3e8a-44e9-bed5-57aa7181225d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1698 microversion: 2.1 time: 0.348944 Aug 24 10:52:29.474069 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3237/6119] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:29 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1698 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:29.508405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-90b10f46-13e1-43fe-b3be-39bebe15b3e5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:29.509426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-90b10f46-13e1-43fe-b3be-39bebe15b3e5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:29.518457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90b10f46-13e1-43fe-b3be-39bebe15b3e5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:29.519150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90b10f46-13e1-43fe-b3be-39bebe15b3e5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:29.519755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90b10f46-13e1-43fe-b3be-39bebe15b3e5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:29.521287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90b10f46-13e1-43fe-b3be-39bebe15b3e5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:29.522051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90b10f46-13e1-43fe-b3be-39bebe15b3e5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:29.522671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90b10f46-13e1-43fe-b3be-39bebe15b3e5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:29.810062 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-90b10f46-13e1-43fe-b3be-39bebe15b3e5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:29.825438 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-90b10f46-13e1-43fe-b3be-39bebe15b3e5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1169 microversion: 2.1 time: 0.323023 Aug 24 10:52:29.826907 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2883/6120] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:29 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1169 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:30.493541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-559ecae0-0b4c-4b1b-bb36-9f3013d338eb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:30.494755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-559ecae0-0b4c-4b1b-bb36-9f3013d338eb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:30.506769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-559ecae0-0b4c-4b1b-bb36-9f3013d338eb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:30.507380 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-559ecae0-0b4c-4b1b-bb36-9f3013d338eb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:30.507910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-559ecae0-0b4c-4b1b-bb36-9f3013d338eb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:30.508712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-559ecae0-0b4c-4b1b-bb36-9f3013d338eb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:30.509286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-559ecae0-0b4c-4b1b-bb36-9f3013d338eb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:30.509794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-559ecae0-0b4c-4b1b-bb36-9f3013d338eb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:30.725555 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-559ecae0-0b4c-4b1b-bb36-9f3013d338eb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:30.737861 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-559ecae0-0b4c-4b1b-bb36-9f3013d338eb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1698 microversion: 2.1 time: 0.248789 Aug 24 10:52:30.739937 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3238/6121] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:30 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1698 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:30.861364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e66c060-1b38-4ada-a34f-c2de2a3d85fe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:30.862188 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6e66c060-1b38-4ada-a34f-c2de2a3d85fe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:30.872435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:30.875562 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:30.884947 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e66c060-1b38-4ada-a34f-c2de2a3d85fe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:30.886401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e66c060-1b38-4ada-a34f-c2de2a3d85fe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:30.887581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e66c060-1b38-4ada-a34f-c2de2a3d85fe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:30.890631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e66c060-1b38-4ada-a34f-c2de2a3d85fe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:30.892133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e66c060-1b38-4ada-a34f-c2de2a3d85fe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:30.892287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e66c060-1b38-4ada-a34f-c2de2a3d85fe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:31.101710 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6e66c060-1b38-4ada-a34f-c2de2a3d85fe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:31.113294 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6e66c060-1b38-4ada-a34f-c2de2a3d85fe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1169 microversion: 2.1 time: 0.266614 Aug 24 10:52:31.128380 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2884/6122] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:30 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1169 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:31.763047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fc3f3059-ac9d-4855-ab74-a1a2e0ef972f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:31.763047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fc3f3059-ac9d-4855-ab74-a1a2e0ef972f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:31.775566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc3f3059-ac9d-4855-ab74-a1a2e0ef972f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:31.776061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc3f3059-ac9d-4855-ab74-a1a2e0ef972f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:31.776499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc3f3059-ac9d-4855-ab74-a1a2e0ef972f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:31.779976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc3f3059-ac9d-4855-ab74-a1a2e0ef972f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:31.780454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc3f3059-ac9d-4855-ab74-a1a2e0ef972f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:31.782994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc3f3059-ac9d-4855-ab74-a1a2e0ef972f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:32.023111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fc3f3059-ac9d-4855-ab74-a1a2e0ef972f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:32.032321 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fc3f3059-ac9d-4855-ab74-a1a2e0ef972f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1698 microversion: 2.1 time: 0.274947 Aug 24 10:52:32.033511 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3239/6123] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:31 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1698 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:32.136283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5446bb62-b213-42bf-b073-2b5058163da5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:32.136895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5446bb62-b213-42bf-b073-2b5058163da5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:32.149361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5446bb62-b213-42bf-b073-2b5058163da5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:32.150323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5446bb62-b213-42bf-b073-2b5058163da5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:32.151080 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5446bb62-b213-42bf-b073-2b5058163da5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:32.152054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5446bb62-b213-42bf-b073-2b5058163da5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:32.152863 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5446bb62-b213-42bf-b073-2b5058163da5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:32.153480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5446bb62-b213-42bf-b073-2b5058163da5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:32.370793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5446bb62-b213-42bf-b073-2b5058163da5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:32.382219 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5446bb62-b213-42bf-b073-2b5058163da5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1169 microversion: 2.1 time: 0.250054 Aug 24 10:52:32.383304 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2885/6124] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:32 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1169 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:33.056683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d8aa0c9f-c865-4519-8e40-5be08164f4ba tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:33.057271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d8aa0c9f-c865-4519-8e40-5be08164f4ba tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:33.071996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8aa0c9f-c865-4519-8e40-5be08164f4ba tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:33.072805 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8aa0c9f-c865-4519-8e40-5be08164f4ba tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:33.077724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8aa0c9f-c865-4519-8e40-5be08164f4ba tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:33.079428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8aa0c9f-c865-4519-8e40-5be08164f4ba tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:33.079428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8aa0c9f-c865-4519-8e40-5be08164f4ba tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:33.080310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8aa0c9f-c865-4519-8e40-5be08164f4ba tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:33.272984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d8aa0c9f-c865-4519-8e40-5be08164f4ba tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:33.283514 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d8aa0c9f-c865-4519-8e40-5be08164f4ba tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1698 microversion: 2.1 time: 0.232006 Aug 24 10:52:33.283983 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3240/6125] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:33 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1698 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:33.406442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c3ca3ae8-0201-44ed-a11b-729594d4dc7c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:33.407179 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c3ca3ae8-0201-44ed-a11b-729594d4dc7c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:33.423845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3ca3ae8-0201-44ed-a11b-729594d4dc7c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:33.424963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3ca3ae8-0201-44ed-a11b-729594d4dc7c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:33.425442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3ca3ae8-0201-44ed-a11b-729594d4dc7c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:33.426608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3ca3ae8-0201-44ed-a11b-729594d4dc7c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:33.427748 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3ca3ae8-0201-44ed-a11b-729594d4dc7c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:33.428177 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3ca3ae8-0201-44ed-a11b-729594d4dc7c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:33.588671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c3ca3ae8-0201-44ed-a11b-729594d4dc7c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:33.597931 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c3ca3ae8-0201-44ed-a11b-729594d4dc7c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1169 microversion: 2.1 time: 0.197073 Aug 24 10:52:33.598627 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2886/6126] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:33 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1169 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:34.304030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-493e329b-767c-4d8d-8e47-ad9a5ce93ec0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:34.304677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-493e329b-767c-4d8d-8e47-ad9a5ce93ec0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:34.311851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-493e329b-767c-4d8d-8e47-ad9a5ce93ec0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:34.312341 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-493e329b-767c-4d8d-8e47-ad9a5ce93ec0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:34.312770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-493e329b-767c-4d8d-8e47-ad9a5ce93ec0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:34.313572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-493e329b-767c-4d8d-8e47-ad9a5ce93ec0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:34.314034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-493e329b-767c-4d8d-8e47-ad9a5ce93ec0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:34.314462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-493e329b-767c-4d8d-8e47-ad9a5ce93ec0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:34.460867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-493e329b-767c-4d8d-8e47-ad9a5ce93ec0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:34.470526 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-493e329b-767c-4d8d-8e47-ad9a5ce93ec0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1698 microversion: 2.1 time: 0.170170 Aug 24 10:52:34.471533 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3241/6127] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:34 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1698 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:34.620001 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-723b648f-0619-4c0f-a810-cc18941be3a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:34.630358 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-723b648f-0619-4c0f-a810-cc18941be3a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:34.630358 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-723b648f-0619-4c0f-a810-cc18941be3a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:34.630358 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-723b648f-0619-4c0f-a810-cc18941be3a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:34.630358 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-723b648f-0619-4c0f-a810-cc18941be3a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:34.630358 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-723b648f-0619-4c0f-a810-cc18941be3a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:34.630358 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-723b648f-0619-4c0f-a810-cc18941be3a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:34.633989 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-723b648f-0619-4c0f-a810-cc18941be3a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:34.787340 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-723b648f-0619-4c0f-a810-cc18941be3a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:34.795739 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-723b648f-0619-4c0f-a810-cc18941be3a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1169 microversion: 2.1 time: 0.179972 Aug 24 10:52:34.796579 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2887/6128] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:34 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1169 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:35.495813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f6ed2a74-0645-4cee-860f-bff8be58c1f8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:35.496776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f6ed2a74-0645-4cee-860f-bff8be58c1f8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:35.505573 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6ed2a74-0645-4cee-860f-bff8be58c1f8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:35.506057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6ed2a74-0645-4cee-860f-bff8be58c1f8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:35.506666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6ed2a74-0645-4cee-860f-bff8be58c1f8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:35.507515 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6ed2a74-0645-4cee-860f-bff8be58c1f8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:35.508067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6ed2a74-0645-4cee-860f-bff8be58c1f8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:35.508568 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6ed2a74-0645-4cee-860f-bff8be58c1f8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:35.693298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f6ed2a74-0645-4cee-860f-bff8be58c1f8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:35.703236 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f6ed2a74-0645-4cee-860f-bff8be58c1f8 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1698 microversion: 2.1 time: 0.214917 Aug 24 10:52:35.705280 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3242/6129] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:35 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1698 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:35.817732 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-27d18dbb-9260-4cc6-a4b7-62d7e50915d4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:35.818573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-27d18dbb-9260-4cc6-a4b7-62d7e50915d4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:35.827765 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27d18dbb-9260-4cc6-a4b7-62d7e50915d4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:35.828359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27d18dbb-9260-4cc6-a4b7-62d7e50915d4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:35.828868 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27d18dbb-9260-4cc6-a4b7-62d7e50915d4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:35.829709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27d18dbb-9260-4cc6-a4b7-62d7e50915d4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:35.830235 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27d18dbb-9260-4cc6-a4b7-62d7e50915d4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:35.830743 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27d18dbb-9260-4cc6-a4b7-62d7e50915d4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:36.023642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-27d18dbb-9260-4cc6-a4b7-62d7e50915d4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:36.033644 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-27d18dbb-9260-4cc6-a4b7-62d7e50915d4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1169 microversion: 2.1 time: 0.221471 Aug 24 10:52:36.035051 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2888/6130] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:35 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1169 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:36.740438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-75422ddd-0b66-48da-9412-66887c73f1c7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:36.743287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-75422ddd-0b66-48da-9412-66887c73f1c7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:36.751481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75422ddd-0b66-48da-9412-66887c73f1c7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:36.752116 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75422ddd-0b66-48da-9412-66887c73f1c7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:36.752770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75422ddd-0b66-48da-9412-66887c73f1c7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:36.753495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75422ddd-0b66-48da-9412-66887c73f1c7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:36.753950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75422ddd-0b66-48da-9412-66887c73f1c7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:36.754373 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75422ddd-0b66-48da-9412-66887c73f1c7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:36.892362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-75422ddd-0b66-48da-9412-66887c73f1c7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:36.902503 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-75422ddd-0b66-48da-9412-66887c73f1c7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1698 microversion: 2.1 time: 0.174109 Aug 24 10:52:36.903598 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3243/6131] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:36 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1698 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:37.055901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-46a6d865-d16f-4155-81c6-0b4ed4cffa5c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:37.062172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-46a6d865-d16f-4155-81c6-0b4ed4cffa5c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:37.070432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46a6d865-d16f-4155-81c6-0b4ed4cffa5c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:37.071580 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46a6d865-d16f-4155-81c6-0b4ed4cffa5c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:37.072258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46a6d865-d16f-4155-81c6-0b4ed4cffa5c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:37.073242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46a6d865-d16f-4155-81c6-0b4ed4cffa5c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:37.073857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46a6d865-d16f-4155-81c6-0b4ed4cffa5c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:37.074438 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46a6d865-d16f-4155-81c6-0b4ed4cffa5c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:37.289665 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-46a6d865-d16f-4155-81c6-0b4ed4cffa5c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:37.298405 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-46a6d865-d16f-4155-81c6-0b4ed4cffa5c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1169 microversion: 2.1 time: 0.247172 Aug 24 10:52:37.299214 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2889/6132] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:37 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1169 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:37.926697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-77baedf5-59ed-48c7-9fc6-9aefb30216f9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:37.927579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-77baedf5-59ed-48c7-9fc6-9aefb30216f9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:37.931281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=48 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:37.943470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77baedf5-59ed-48c7-9fc6-9aefb30216f9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:37.944357 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77baedf5-59ed-48c7-9fc6-9aefb30216f9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:37.945231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77baedf5-59ed-48c7-9fc6-9aefb30216f9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:37.946540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77baedf5-59ed-48c7-9fc6-9aefb30216f9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:37.947570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77baedf5-59ed-48c7-9fc6-9aefb30216f9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:37.948975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77baedf5-59ed-48c7-9fc6-9aefb30216f9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:38.136077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-77baedf5-59ed-48c7-9fc6-9aefb30216f9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:38.148894 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-77baedf5-59ed-48c7-9fc6-9aefb30216f9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1698 microversion: 2.1 time: 0.226123 Aug 24 10:52:38.161826 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3244/6133] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:37 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1698 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:38.321857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-40f02bb9-8886-4fcb-aa03-70fe6b3172d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:38.322829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-40f02bb9-8886-4fcb-aa03-70fe6b3172d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:38.330192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:38.331630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40f02bb9-8886-4fcb-aa03-70fe6b3172d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:38.332357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40f02bb9-8886-4fcb-aa03-70fe6b3172d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:38.333495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40f02bb9-8886-4fcb-aa03-70fe6b3172d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:38.334393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40f02bb9-8886-4fcb-aa03-70fe6b3172d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:38.335314 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40f02bb9-8886-4fcb-aa03-70fe6b3172d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:38.336043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40f02bb9-8886-4fcb-aa03-70fe6b3172d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:38.637833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-40f02bb9-8886-4fcb-aa03-70fe6b3172d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:38.647141 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-40f02bb9-8886-4fcb-aa03-70fe6b3172d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1169 microversion: 2.1 time: 0.329788 Aug 24 10:52:38.648552 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2890/6134] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:38 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1169 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:52:39.172896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b03d47e3-23ce-4b28-bb95-365d944eb9e6 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:39.174471 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b03d47e3-23ce-4b28-bb95-365d944eb9e6 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:39.184552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b03d47e3-23ce-4b28-bb95-365d944eb9e6 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:39.185313 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b03d47e3-23ce-4b28-bb95-365d944eb9e6 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:39.186127 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b03d47e3-23ce-4b28-bb95-365d944eb9e6 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:39.187324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b03d47e3-23ce-4b28-bb95-365d944eb9e6 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:39.188134 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b03d47e3-23ce-4b28-bb95-365d944eb9e6 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:39.188751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b03d47e3-23ce-4b28-bb95-365d944eb9e6 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:39.397986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b03d47e3-23ce-4b28-bb95-365d944eb9e6 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:39.437884 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b03d47e3-23ce-4b28-bb95-365d944eb9e6 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1698 microversion: 2.1 time: 0.270304 Aug 24 10:52:39.440083 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3245/6135] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:39 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1698 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:39.670907 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-081e609d-b670-4873-bbd5-04029383c808 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:39.672800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-081e609d-b670-4873-bbd5-04029383c808 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:39.681503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-081e609d-b670-4873-bbd5-04029383c808 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:39.682881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-081e609d-b670-4873-bbd5-04029383c808 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:39.683572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-081e609d-b670-4873-bbd5-04029383c808 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:39.684634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-081e609d-b670-4873-bbd5-04029383c808 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:39.685445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-081e609d-b670-4873-bbd5-04029383c808 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:39.686216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-081e609d-b670-4873-bbd5-04029383c808 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:39.689721 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:39.875211 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-081e609d-b670-4873-bbd5-04029383c808 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:39.887826 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-081e609d-b670-4873-bbd5-04029383c808 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1169 microversion: 2.1 time: 0.223124 Aug 24 10:52:39.889503 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2891/6136] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:39 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1169 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:52:40.467645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1d2d561d-bba3-482e-953b-22e11541a140 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:40.469710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1d2d561d-bba3-482e-953b-22e11541a140 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:40.480980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d2d561d-bba3-482e-953b-22e11541a140 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:40.481938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d2d561d-bba3-482e-953b-22e11541a140 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:40.482621 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d2d561d-bba3-482e-953b-22e11541a140 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:40.486633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d2d561d-bba3-482e-953b-22e11541a140 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:40.487440 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d2d561d-bba3-482e-953b-22e11541a140 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:40.488156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d2d561d-bba3-482e-953b-22e11541a140 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:40.682556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1d2d561d-bba3-482e-953b-22e11541a140 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:40.693147 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1d2d561d-bba3-482e-953b-22e11541a140 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1698 microversion: 2.1 time: 0.231234 Aug 24 10:52:40.706039 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3246/6137] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:40 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1698 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:40.910040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eb449577-432b-4a55-9a0e-19db57e90539 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:40.910641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eb449577-432b-4a55-9a0e-19db57e90539 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:40.922525 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb449577-432b-4a55-9a0e-19db57e90539 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:40.923458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb449577-432b-4a55-9a0e-19db57e90539 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:40.924529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb449577-432b-4a55-9a0e-19db57e90539 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:40.926090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb449577-432b-4a55-9a0e-19db57e90539 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:40.926999 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb449577-432b-4a55-9a0e-19db57e90539 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:40.927572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb449577-432b-4a55-9a0e-19db57e90539 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:41.156153 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eb449577-432b-4a55-9a0e-19db57e90539 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:41.171270 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eb449577-432b-4a55-9a0e-19db57e90539 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1215 microversion: 2.1 time: 0.260579 Aug 24 10:52:41.185170 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2892/6138] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:40 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1215 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:41.248189 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1be3b7e4-29d3-4264-a230-9990099a0304 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1250824423 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1250824423-project-admin] Calling method '.version_select at 0x7f465a27d1f0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:41.249351 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:52:41.249351 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 10:52:41.251167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1be3b7e4-29d3-4264-a230-9990099a0304 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1250824423 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1250824423-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:41.251670 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1be3b7e4-29d3-4264-a230-9990099a0304 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1250824423 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1250824423-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:41.252641 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1be3b7e4-29d3-4264-a230-9990099a0304 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1250824423 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1250824423-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:41.267209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1be3b7e4-29d3-4264-a230-9990099a0304 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1250824423 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1250824423-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:41.267701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1be3b7e4-29d3-4264-a230-9990099a0304 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1250824423 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1250824423-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:41.268143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1be3b7e4-29d3-4264-a230-9990099a0304 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1250824423 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1250824423-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:41.280110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1be3b7e4-29d3-4264-a230-9990099a0304 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1250824423 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1250824423-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:41.280589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1be3b7e4-29d3-4264-a230-9990099a0304 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1250824423 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1250824423-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:41.281021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1be3b7e4-29d3-4264-a230-9990099a0304 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1250824423 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1250824423-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:41.287099 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1be3b7e4-29d3-4264-a230-9990099a0304 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1250824423 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1250824423-project-admin] 10.222.0.85 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.252715 Aug 24 10:52:41.288004 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3247/6139] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 10:52:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:52:41.719833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1cf37649-5a67-41d3-9306-65b59815cab6 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:41.720602 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1cf37649-5a67-41d3-9306-65b59815cab6 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:41.729973 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cf37649-5a67-41d3-9306-65b59815cab6 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:41.730569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cf37649-5a67-41d3-9306-65b59815cab6 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:41.731757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cf37649-5a67-41d3-9306-65b59815cab6 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:41.732696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cf37649-5a67-41d3-9306-65b59815cab6 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:41.733294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cf37649-5a67-41d3-9306-65b59815cab6 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:41.733903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cf37649-5a67-41d3-9306-65b59815cab6 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:41.987692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1cf37649-5a67-41d3-9306-65b59815cab6 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:41.996529 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1cf37649-5a67-41d3-9306-65b59815cab6 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1697 microversion: 2.1 time: 0.281304 Aug 24 10:52:42.009578 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2893/6140] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:41 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1697 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:52:42.194675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7c903565-4dd3-4d45-88dc-7afa49915a0c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:42.195429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7c903565-4dd3-4d45-88dc-7afa49915a0c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:42.203764 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c903565-4dd3-4d45-88dc-7afa49915a0c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:42.204249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c903565-4dd3-4d45-88dc-7afa49915a0c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:42.204679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c903565-4dd3-4d45-88dc-7afa49915a0c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:42.205433 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c903565-4dd3-4d45-88dc-7afa49915a0c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:42.205882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c903565-4dd3-4d45-88dc-7afa49915a0c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:42.206303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c903565-4dd3-4d45-88dc-7afa49915a0c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:42.374895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7c903565-4dd3-4d45-88dc-7afa49915a0c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:42.384060 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7c903565-4dd3-4d45-88dc-7afa49915a0c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1203 microversion: 2.1 time: 0.193377 Aug 24 10:52:42.384720 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3248/6141] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:42 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1203 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:42.636635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-07b82008-5854-4d46-9664-3433f52d3e62 req-60d9ec0f-be90-4db0-8513-f67d9691b131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c50590b2-3366-4439-8a10-6e8f1014882f", "name": "network-vif-unplugged", "status": "completed", "tag": "694c2288-dc06-4d72-81de-d7b13c0b0cb3"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:52:42.646491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-07b82008-5854-4d46-9664-3433f52d3e62 req-60d9ec0f-be90-4db0-8513-f67d9691b131 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:42.647369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-07b82008-5854-4d46-9664-3433f52d3e62 req-60d9ec0f-be90-4db0-8513-f67d9691b131 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:42.648033 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-07b82008-5854-4d46-9664-3433f52d3e62 req-60d9ec0f-be90-4db0-8513-f67d9691b131 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:42.665158 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-07b82008-5854-4d46-9664-3433f52d3e62 req-60d9ec0f-be90-4db0-8513-f67d9691b131 service nova] Creating event network-vif-unplugged:694c2288-dc06-4d72-81de-d7b13c0b0cb3 for instance c50590b2-3366-4439-8a10-6e8f1014882f on n-h1-849328-3 Aug 24 10:52:42.676691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-07b82008-5854-4d46-9664-3433f52d3e62 req-60d9ec0f-be90-4db0-8513-f67d9691b131 service nova] Instance c50590b2-3366-4439-8a10-6e8f1014882f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 10:52:42.688208 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-07b82008-5854-4d46-9664-3433f52d3e62 req-60d9ec0f-be90-4db0-8513-f67d9691b131 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.149702 Aug 24 10:52:42.689459 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2894/6142] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:52:43.021636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f49248aa-169b-48fc-99a3-1fc5246c4e72 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:43.022273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f49248aa-169b-48fc-99a3-1fc5246c4e72 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:43.035889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f49248aa-169b-48fc-99a3-1fc5246c4e72 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:43.036438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f49248aa-169b-48fc-99a3-1fc5246c4e72 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:43.036978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f49248aa-169b-48fc-99a3-1fc5246c4e72 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:43.042114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f49248aa-169b-48fc-99a3-1fc5246c4e72 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:43.043064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f49248aa-169b-48fc-99a3-1fc5246c4e72 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:43.043797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f49248aa-169b-48fc-99a3-1fc5246c4e72 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:43.292231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f49248aa-169b-48fc-99a3-1fc5246c4e72 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:43.306191 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f49248aa-169b-48fc-99a3-1fc5246c4e72 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1697 microversion: 2.1 time: 0.289535 Aug 24 10:52:43.308138 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3249/6143] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:43 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1697 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:43.413043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a2750d80-5ad9-4dfe-837e-4b10961e0f8a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:43.413840 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a2750d80-5ad9-4dfe-837e-4b10961e0f8a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:43.423871 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2750d80-5ad9-4dfe-837e-4b10961e0f8a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:43.424729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2750d80-5ad9-4dfe-837e-4b10961e0f8a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:43.429394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2750d80-5ad9-4dfe-837e-4b10961e0f8a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:43.430934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2750d80-5ad9-4dfe-837e-4b10961e0f8a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:43.431590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2750d80-5ad9-4dfe-837e-4b10961e0f8a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:43.432790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2750d80-5ad9-4dfe-837e-4b10961e0f8a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:43.674794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a2750d80-5ad9-4dfe-837e-4b10961e0f8a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:43.683413 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a2750d80-5ad9-4dfe-837e-4b10961e0f8a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1203 microversion: 2.1 time: 0.280911 Aug 24 10:52:43.699444 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2895/6144] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:43 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1203 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:44.328829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0639f611-271e-48c5-b25e-e38fa5a6d02a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:44.329672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0639f611-271e-48c5-b25e-e38fa5a6d02a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:44.337256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0639f611-271e-48c5-b25e-e38fa5a6d02a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:44.337821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0639f611-271e-48c5-b25e-e38fa5a6d02a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:44.338483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0639f611-271e-48c5-b25e-e38fa5a6d02a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:44.339228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0639f611-271e-48c5-b25e-e38fa5a6d02a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:44.339831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0639f611-271e-48c5-b25e-e38fa5a6d02a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:44.340268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0639f611-271e-48c5-b25e-e38fa5a6d02a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:44.344562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:44.503141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0639f611-271e-48c5-b25e-e38fa5a6d02a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:44.515729 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0639f611-271e-48c5-b25e-e38fa5a6d02a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1695 microversion: 2.1 time: 0.191323 Aug 24 10:52:44.516786 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3250/6145] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:44 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1695 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:44.705758 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-45bf1244-e11c-41ad-a488-4c9c5b7bb49d req-108f3fd7-c9d0-45c1-8eb6-25db501fe1c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c50590b2-3366-4439-8a10-6e8f1014882f", "tag": "694c2288-dc06-4d72-81de-d7b13c0b0cb3"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:52:44.711512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de7b688f-bb91-4135-ad32-bf57dde1ab69 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:44.712650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-de7b688f-bb91-4135-ad32-bf57dde1ab69 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:44.717600 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-45bf1244-e11c-41ad-a488-4c9c5b7bb49d req-108f3fd7-c9d0-45c1-8eb6-25db501fe1c2 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:44.718077 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-45bf1244-e11c-41ad-a488-4c9c5b7bb49d req-108f3fd7-c9d0-45c1-8eb6-25db501fe1c2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:44.718503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-45bf1244-e11c-41ad-a488-4c9c5b7bb49d req-108f3fd7-c9d0-45c1-8eb6-25db501fe1c2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:44.721578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de7b688f-bb91-4135-ad32-bf57dde1ab69 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:44.722360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de7b688f-bb91-4135-ad32-bf57dde1ab69 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:44.723031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de7b688f-bb91-4135-ad32-bf57dde1ab69 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:44.724159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de7b688f-bb91-4135-ad32-bf57dde1ab69 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:44.725303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de7b688f-bb91-4135-ad32-bf57dde1ab69 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:44.725970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de7b688f-bb91-4135-ad32-bf57dde1ab69 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:44.731358 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-45bf1244-e11c-41ad-a488-4c9c5b7bb49d req-108f3fd7-c9d0-45c1-8eb6-25db501fe1c2 service nova] Creating event network-changed:694c2288-dc06-4d72-81de-d7b13c0b0cb3 for instance c50590b2-3366-4439-8a10-6e8f1014882f on n-h1-849328-3 Aug 24 10:52:44.737560 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-45bf1244-e11c-41ad-a488-4c9c5b7bb49d req-108f3fd7-c9d0-45c1-8eb6-25db501fe1c2 service nova] Instance c50590b2-3366-4439-8a10-6e8f1014882f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 10:52:44.749901 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-45bf1244-e11c-41ad-a488-4c9c5b7bb49d req-108f3fd7-c9d0-45c1-8eb6-25db501fe1c2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046589 Aug 24 10:52:44.749901 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2896/6146] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:52:45.231872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-de7b688f-bb91-4135-ad32-bf57dde1ab69 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:45.260422 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-de7b688f-bb91-4135-ad32-bf57dde1ab69 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1203 microversion: 2.1 time: 0.555564 Aug 24 10:52:45.279084 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3251/6147] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:44 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1203 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:52:45.540671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0f8aa439-f8dc-4f36-9294-40c5b26d3320 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:45.542289 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0f8aa439-f8dc-4f36-9294-40c5b26d3320 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:45.557102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f8aa439-f8dc-4f36-9294-40c5b26d3320 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:45.557815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f8aa439-f8dc-4f36-9294-40c5b26d3320 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:45.558360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f8aa439-f8dc-4f36-9294-40c5b26d3320 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:45.559211 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f8aa439-f8dc-4f36-9294-40c5b26d3320 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:45.559837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f8aa439-f8dc-4f36-9294-40c5b26d3320 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:45.560355 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f8aa439-f8dc-4f36-9294-40c5b26d3320 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:45.900966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0f8aa439-f8dc-4f36-9294-40c5b26d3320 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:45.911012 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0f8aa439-f8dc-4f36-9294-40c5b26d3320 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1692 microversion: 2.1 time: 0.376722 Aug 24 10:52:45.916598 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2897/6148] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:45 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1692 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:45.936244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bbb5ea4e-75df-4842-803c-1d26623ddc1b tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:52:45.936866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bbb5ea4e-75df-4842-803c-1d26623ddc1b tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:45.944243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbb5ea4e-75df-4842-803c-1d26623ddc1b tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:45.945010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbb5ea4e-75df-4842-803c-1d26623ddc1b tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:45.945725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbb5ea4e-75df-4842-803c-1d26623ddc1b tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:45.946791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbb5ea4e-75df-4842-803c-1d26623ddc1b tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:45.948119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbb5ea4e-75df-4842-803c-1d26623ddc1b tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:45.948710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbb5ea4e-75df-4842-803c-1d26623ddc1b tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:46.118646 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bbb5ea4e-75df-4842-803c-1d26623ddc1b tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "POST /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f/action" status: 202 len: 0 microversion: 2.1 time: 0.186471 Aug 24 10:52:46.119275 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3252/6149] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:52:45 2022] POST /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:52:46.127723 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f1960461-8af5-43b2-9818-1f5bea097b1c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:46.128349 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f1960461-8af5-43b2-9818-1f5bea097b1c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:46.152769 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1960461-8af5-43b2-9818-1f5bea097b1c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:46.153386 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1960461-8af5-43b2-9818-1f5bea097b1c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:46.153826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1960461-8af5-43b2-9818-1f5bea097b1c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:46.156348 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1960461-8af5-43b2-9818-1f5bea097b1c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:46.156348 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1960461-8af5-43b2-9818-1f5bea097b1c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:46.156348 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1960461-8af5-43b2-9818-1f5bea097b1c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:46.286415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-192cbaf6-0811-492f-8063-101243db9af0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:46.287128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-192cbaf6-0811-492f-8063-101243db9af0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:46.295538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-192cbaf6-0811-492f-8063-101243db9af0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:46.296539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-192cbaf6-0811-492f-8063-101243db9af0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:46.307996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-192cbaf6-0811-492f-8063-101243db9af0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:46.308995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-192cbaf6-0811-492f-8063-101243db9af0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:46.312103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-192cbaf6-0811-492f-8063-101243db9af0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:46.312643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-192cbaf6-0811-492f-8063-101243db9af0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:46.649845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-192cbaf6-0811-492f-8063-101243db9af0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:46.664253 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-192cbaf6-0811-492f-8063-101243db9af0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1203 microversion: 2.1 time: 0.382637 Aug 24 10:52:46.678457 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3253/6150] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:46 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1203 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:46.745011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f1960461-8af5-43b2-9818-1f5bea097b1c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:46.755714 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f1960461-8af5-43b2-9818-1f5bea097b1c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1691 microversion: 2.1 time: 0.631964 Aug 24 10:52:46.757606 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2898/6151] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:46 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1691 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:52:47.686805 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d85c9da1-f65c-4a2c-b5d6-1d1a44965c90 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:47.687423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d85c9da1-f65c-4a2c-b5d6-1d1a44965c90 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:47.698717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d85c9da1-f65c-4a2c-b5d6-1d1a44965c90 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:47.699463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d85c9da1-f65c-4a2c-b5d6-1d1a44965c90 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:47.700068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d85c9da1-f65c-4a2c-b5d6-1d1a44965c90 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:47.700924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d85c9da1-f65c-4a2c-b5d6-1d1a44965c90 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:47.701554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d85c9da1-f65c-4a2c-b5d6-1d1a44965c90 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:47.702127 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d85c9da1-f65c-4a2c-b5d6-1d1a44965c90 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:47.777157 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d27ee2bb-b2ac-4eaf-ac1b-8c06cd1e6668 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:47.778464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d27ee2bb-b2ac-4eaf-ac1b-8c06cd1e6668 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:47.789787 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d27ee2bb-b2ac-4eaf-ac1b-8c06cd1e6668 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:47.801939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d27ee2bb-b2ac-4eaf-ac1b-8c06cd1e6668 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:47.802495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d27ee2bb-b2ac-4eaf-ac1b-8c06cd1e6668 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:47.803379 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d27ee2bb-b2ac-4eaf-ac1b-8c06cd1e6668 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:47.803832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d27ee2bb-b2ac-4eaf-ac1b-8c06cd1e6668 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:47.804467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d27ee2bb-b2ac-4eaf-ac1b-8c06cd1e6668 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:47.984659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d85c9da1-f65c-4a2c-b5d6-1d1a44965c90 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:47.998446 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d85c9da1-f65c-4a2c-b5d6-1d1a44965c90 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1203 microversion: 2.1 time: 0.313059 Aug 24 10:52:48.000901 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3254/6152] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:47 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1203 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:48.091431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d27ee2bb-b2ac-4eaf-ac1b-8c06cd1e6668 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:48.111135 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d27ee2bb-b2ac-4eaf-ac1b-8c06cd1e6668 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1691 microversion: 2.1 time: 0.337955 Aug 24 10:52:48.111942 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2899/6153] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:47 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1691 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:49.019882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ffd813f-acd0-4be7-bf1a-fbaece96ee81 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:49.020843 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4ffd813f-acd0-4be7-bf1a-fbaece96ee81 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:49.028909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ffd813f-acd0-4be7-bf1a-fbaece96ee81 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:49.029425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ffd813f-acd0-4be7-bf1a-fbaece96ee81 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:49.030099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ffd813f-acd0-4be7-bf1a-fbaece96ee81 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:49.051570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ffd813f-acd0-4be7-bf1a-fbaece96ee81 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:49.052078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ffd813f-acd0-4be7-bf1a-fbaece96ee81 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:49.052522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ffd813f-acd0-4be7-bf1a-fbaece96ee81 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:49.132983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e31d7df7-8441-42cc-8470-9c9c8e4ae96d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:49.136003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e31d7df7-8441-42cc-8470-9c9c8e4ae96d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:49.144305 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e31d7df7-8441-42cc-8470-9c9c8e4ae96d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:49.145164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e31d7df7-8441-42cc-8470-9c9c8e4ae96d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:49.145977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e31d7df7-8441-42cc-8470-9c9c8e4ae96d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:49.147073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e31d7df7-8441-42cc-8470-9c9c8e4ae96d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:49.147544 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e31d7df7-8441-42cc-8470-9c9c8e4ae96d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:49.147976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e31d7df7-8441-42cc-8470-9c9c8e4ae96d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:49.231086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4ffd813f-acd0-4be7-bf1a-fbaece96ee81 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:49.240046 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4ffd813f-acd0-4be7-bf1a-fbaece96ee81 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1203 microversion: 2.1 time: 0.224041 Aug 24 10:52:49.253810 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3255/6154] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:49 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1203 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:49.336554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e31d7df7-8441-42cc-8470-9c9c8e4ae96d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:49.345921 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e31d7df7-8441-42cc-8470-9c9c8e4ae96d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1691 microversion: 2.1 time: 0.217066 Aug 24 10:52:49.346793 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2900/6155] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:49 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1691 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:52:50.260491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-011640b6-d8c6-470a-8f21-ab340b2c2ddd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:50.261197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-011640b6-d8c6-470a-8f21-ab340b2c2ddd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:50.275120 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-011640b6-d8c6-470a-8f21-ab340b2c2ddd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:50.275631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-011640b6-d8c6-470a-8f21-ab340b2c2ddd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:50.276072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-011640b6-d8c6-470a-8f21-ab340b2c2ddd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:50.276802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-011640b6-d8c6-470a-8f21-ab340b2c2ddd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:50.277293 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-011640b6-d8c6-470a-8f21-ab340b2c2ddd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:50.277731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-011640b6-d8c6-470a-8f21-ab340b2c2ddd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:50.564402 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0fc9afca-0b13-4bab-9250-519cb7292a95 req-8731c9e3-9300-4656-93f7-b71ae6ec5731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c50590b2-3366-4439-8a10-6e8f1014882f", "name": "network-vif-plugged", "status": "completed", "tag": "694c2288-dc06-4d72-81de-d7b13c0b0cb3"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:52:50.582208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0fc9afca-0b13-4bab-9250-519cb7292a95 req-8731c9e3-9300-4656-93f7-b71ae6ec5731 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:50.583056 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0fc9afca-0b13-4bab-9250-519cb7292a95 req-8731c9e3-9300-4656-93f7-b71ae6ec5731 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:50.584029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0fc9afca-0b13-4bab-9250-519cb7292a95 req-8731c9e3-9300-4656-93f7-b71ae6ec5731 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:50.594253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-011640b6-d8c6-470a-8f21-ab340b2c2ddd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:50.601796 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0fc9afca-0b13-4bab-9250-519cb7292a95 req-8731c9e3-9300-4656-93f7-b71ae6ec5731 service nova] Creating event network-vif-plugged:694c2288-dc06-4d72-81de-d7b13c0b0cb3 for instance c50590b2-3366-4439-8a10-6e8f1014882f on n-h2-849328-3 Aug 24 10:52:50.609264 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-011640b6-d8c6-470a-8f21-ab340b2c2ddd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1203 microversion: 2.1 time: 0.352867 Aug 24 10:52:50.609883 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2901/6156] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:50 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1203 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:52:50.619408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-61d59350-09cc-444f-aa40-7061586815b1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:50.622523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-0fc9afca-0b13-4bab-9250-519cb7292a95 req-8731c9e3-9300-4656-93f7-b71ae6ec5731 service nova] Instance c50590b2-3366-4439-8a10-6e8f1014882f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 10:52:50.636944 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-61d59350-09cc-444f-aa40-7061586815b1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:50.638111 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0fc9afca-0b13-4bab-9250-519cb7292a95 req-8731c9e3-9300-4656-93f7-b71ae6ec5731 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.413424 Aug 24 10:52:50.639138 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3256/6157] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:52:50.647885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61d59350-09cc-444f-aa40-7061586815b1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:50.651847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61d59350-09cc-444f-aa40-7061586815b1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:50.652296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61d59350-09cc-444f-aa40-7061586815b1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:50.653025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61d59350-09cc-444f-aa40-7061586815b1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:50.653504 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61d59350-09cc-444f-aa40-7061586815b1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:50.655846 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61d59350-09cc-444f-aa40-7061586815b1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:50.939930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-61d59350-09cc-444f-aa40-7061586815b1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:50.948544 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-61d59350-09cc-444f-aa40-7061586815b1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1691 microversion: 2.1 time: 0.334982 Aug 24 10:52:50.949478 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2902/6158] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:50 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1691 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:51.085637 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-1a4a9c0b-4a41-43a5-8c48-bf5a9b77be96 req-2fa59967-174f-45bf-b408-2d86b4648bab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c50590b2-3366-4439-8a10-6e8f1014882f", "name": "network-vif-unplugged", "status": "completed", "tag": "694c2288-dc06-4d72-81de-d7b13c0b0cb3"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:52:51.098944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1a4a9c0b-4a41-43a5-8c48-bf5a9b77be96 req-2fa59967-174f-45bf-b408-2d86b4648bab service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:51.099648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1a4a9c0b-4a41-43a5-8c48-bf5a9b77be96 req-2fa59967-174f-45bf-b408-2d86b4648bab service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:51.100838 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1a4a9c0b-4a41-43a5-8c48-bf5a9b77be96 req-2fa59967-174f-45bf-b408-2d86b4648bab service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:51.121997 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-1a4a9c0b-4a41-43a5-8c48-bf5a9b77be96 req-2fa59967-174f-45bf-b408-2d86b4648bab service nova] Creating event network-vif-unplugged:694c2288-dc06-4d72-81de-d7b13c0b0cb3 for instance c50590b2-3366-4439-8a10-6e8f1014882f on n-h2-849328-3 Aug 24 10:52:51.129498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-1a4a9c0b-4a41-43a5-8c48-bf5a9b77be96 req-2fa59967-174f-45bf-b408-2d86b4648bab service nova] Instance c50590b2-3366-4439-8a10-6e8f1014882f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 10:52:51.141221 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-1a4a9c0b-4a41-43a5-8c48-bf5a9b77be96 req-2fa59967-174f-45bf-b408-2d86b4648bab service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068717 Aug 24 10:52:51.142021 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3257/6159] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:52:51.633472 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-504b3639-a4e9-4691-a44a-a99a57b1d394 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:51.634186 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-504b3639-a4e9-4691-a44a-a99a57b1d394 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:51.643709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-504b3639-a4e9-4691-a44a-a99a57b1d394 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:51.646188 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-504b3639-a4e9-4691-a44a-a99a57b1d394 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:51.646967 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-504b3639-a4e9-4691-a44a-a99a57b1d394 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:51.647694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-504b3639-a4e9-4691-a44a-a99a57b1d394 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:51.650921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-504b3639-a4e9-4691-a44a-a99a57b1d394 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:51.651370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-504b3639-a4e9-4691-a44a-a99a57b1d394 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:51.839994 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-504b3639-a4e9-4691-a44a-a99a57b1d394 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:51.852511 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-504b3639-a4e9-4691-a44a-a99a57b1d394 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1203 microversion: 2.1 time: 0.221337 Aug 24 10:52:51.853198 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2903/6160] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:51 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1203 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:51.972746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-303dfe1f-a1b9-4f36-a802-b2cf60f18459 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:51.974550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-303dfe1f-a1b9-4f36-a802-b2cf60f18459 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:51.983909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-303dfe1f-a1b9-4f36-a802-b2cf60f18459 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:51.984712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-303dfe1f-a1b9-4f36-a802-b2cf60f18459 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:51.985912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-303dfe1f-a1b9-4f36-a802-b2cf60f18459 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:51.988177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-303dfe1f-a1b9-4f36-a802-b2cf60f18459 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:51.989006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-303dfe1f-a1b9-4f36-a802-b2cf60f18459 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:51.989500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-303dfe1f-a1b9-4f36-a802-b2cf60f18459 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:52.332789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-303dfe1f-a1b9-4f36-a802-b2cf60f18459 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:52.345484 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-303dfe1f-a1b9-4f36-a802-b2cf60f18459 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1691 microversion: 2.1 time: 0.378691 Aug 24 10:52:52.359219 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3258/6161] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:51 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1691 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:52.662769 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-8d59c906-110b-4353-990c-f6f470ec928f req-14dbbaba-8e2b-4281-a08f-3f9cb9243a1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad6e3a34-00af-471c-b9a3-b75c8ac73714", "name": "network-vif-plugged", "status": "completed", "tag": "7f6a3e74-c3ef-45cf-8100-a9905efc8d92"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:52:52.673755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8d59c906-110b-4353-990c-f6f470ec928f req-14dbbaba-8e2b-4281-a08f-3f9cb9243a1f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:52.674364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8d59c906-110b-4353-990c-f6f470ec928f req-14dbbaba-8e2b-4281-a08f-3f9cb9243a1f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:52.674986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8d59c906-110b-4353-990c-f6f470ec928f req-14dbbaba-8e2b-4281-a08f-3f9cb9243a1f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:52.687773 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-8d59c906-110b-4353-990c-f6f470ec928f req-14dbbaba-8e2b-4281-a08f-3f9cb9243a1f service nova] Creating event network-vif-plugged:7f6a3e74-c3ef-45cf-8100-a9905efc8d92 for instance ad6e3a34-00af-471c-b9a3-b75c8ac73714 on n-h1-849328-3 Aug 24 10:52:52.693469 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-8d59c906-110b-4353-990c-f6f470ec928f req-14dbbaba-8e2b-4281-a08f-3f9cb9243a1f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034678 Aug 24 10:52:52.694507 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2904/6162] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:52:52.878059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3d5a5d67-fb52-4d09-9ffd-ecdd86b9f197 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:52.879551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3d5a5d67-fb52-4d09-9ffd-ecdd86b9f197 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:52.888215 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d5a5d67-fb52-4d09-9ffd-ecdd86b9f197 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:52.889638 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d5a5d67-fb52-4d09-9ffd-ecdd86b9f197 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:52.890259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d5a5d67-fb52-4d09-9ffd-ecdd86b9f197 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:52.891226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d5a5d67-fb52-4d09-9ffd-ecdd86b9f197 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:52.892488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d5a5d67-fb52-4d09-9ffd-ecdd86b9f197 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:52.893094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d5a5d67-fb52-4d09-9ffd-ecdd86b9f197 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:53.165629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-fc310421-a062-4e63-9f4e-00f54791d479 req-ec1f04c5-63a3-497c-b32d-0f80677e2cdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c50590b2-3366-4439-8a10-6e8f1014882f", "tag": "694c2288-dc06-4d72-81de-d7b13c0b0cb3"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:52:53.175936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fc310421-a062-4e63-9f4e-00f54791d479 req-ec1f04c5-63a3-497c-b32d-0f80677e2cdd service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:53.176420 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fc310421-a062-4e63-9f4e-00f54791d479 req-ec1f04c5-63a3-497c-b32d-0f80677e2cdd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:53.176851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fc310421-a062-4e63-9f4e-00f54791d479 req-ec1f04c5-63a3-497c-b32d-0f80677e2cdd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:53.181781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3d5a5d67-fb52-4d09-9ffd-ecdd86b9f197 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:53.190846 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3d5a5d67-fb52-4d09-9ffd-ecdd86b9f197 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1203 microversion: 2.1 time: 0.318579 Aug 24 10:52:53.192051 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-fc310421-a062-4e63-9f4e-00f54791d479 req-ec1f04c5-63a3-497c-b32d-0f80677e2cdd service nova] Creating event network-changed:694c2288-dc06-4d72-81de-d7b13c0b0cb3 for instance c50590b2-3366-4439-8a10-6e8f1014882f on n-h2-849328-3 Aug 24 10:52:53.198928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-fc310421-a062-4e63-9f4e-00f54791d479 req-ec1f04c5-63a3-497c-b32d-0f80677e2cdd service nova] Instance c50590b2-3366-4439-8a10-6e8f1014882f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 10:52:53.203409 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3259/6163] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:52 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1203 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:53.212159 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-fc310421-a062-4e63-9f4e-00f54791d479 req-ec1f04c5-63a3-497c-b32d-0f80677e2cdd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050983 Aug 24 10:52:53.213451 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2905/6164] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:52:53.367158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-264de28b-228f-4887-96ae-78396771c0bd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:53.367776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-264de28b-228f-4887-96ae-78396771c0bd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:53.377671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-264de28b-228f-4887-96ae-78396771c0bd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:53.378164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-264de28b-228f-4887-96ae-78396771c0bd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:53.378574 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-264de28b-228f-4887-96ae-78396771c0bd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:53.379744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-264de28b-228f-4887-96ae-78396771c0bd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:53.380228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-264de28b-228f-4887-96ae-78396771c0bd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:53.380730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-264de28b-228f-4887-96ae-78396771c0bd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:53.541605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-264de28b-228f-4887-96ae-78396771c0bd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:53.556131 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-264de28b-228f-4887-96ae-78396771c0bd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1691 microversion: 2.1 time: 0.192869 Aug 24 10:52:53.556741 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3260/6165] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:53 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1691 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:54.213569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-23c0bfba-267c-4034-a80e-81ef9e22032c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:54.214276 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-23c0bfba-267c-4034-a80e-81ef9e22032c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:54.221874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23c0bfba-267c-4034-a80e-81ef9e22032c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:54.222571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23c0bfba-267c-4034-a80e-81ef9e22032c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:54.223161 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23c0bfba-267c-4034-a80e-81ef9e22032c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:54.224590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23c0bfba-267c-4034-a80e-81ef9e22032c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:54.225494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23c0bfba-267c-4034-a80e-81ef9e22032c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:54.225935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23c0bfba-267c-4034-a80e-81ef9e22032c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:54.574864 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-23c0bfba-267c-4034-a80e-81ef9e22032c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:54.582986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c1cd0d59-8181-4728-b0a0-4422f51ec1f7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:54.585058 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c1cd0d59-8181-4728-b0a0-4422f51ec1f7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:54.592190 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-23c0bfba-267c-4034-a80e-81ef9e22032c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1390 microversion: 2.1 time: 0.383307 Aug 24 10:52:54.592701 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2906/6166] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:54 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1390 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:54.613162 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1cd0d59-8181-4728-b0a0-4422f51ec1f7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:54.613421 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-caf8886b-ba94-48af-8037-a2a5054e335f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:54.614000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-caf8886b-ba94-48af-8037-a2a5054e335f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:54.615187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1cd0d59-8181-4728-b0a0-4422f51ec1f7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:54.615644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1cd0d59-8181-4728-b0a0-4422f51ec1f7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:54.619596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1cd0d59-8181-4728-b0a0-4422f51ec1f7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:54.620219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1cd0d59-8181-4728-b0a0-4422f51ec1f7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:54.620677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1cd0d59-8181-4728-b0a0-4422f51ec1f7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:54.625628 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-caf8886b-ba94-48af-8037-a2a5054e335f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:54.628907 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-caf8886b-ba94-48af-8037-a2a5054e335f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:54.630431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-caf8886b-ba94-48af-8037-a2a5054e335f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:54.632847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-caf8886b-ba94-48af-8037-a2a5054e335f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:54.633729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-caf8886b-ba94-48af-8037-a2a5054e335f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:54.635648 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-caf8886b-ba94-48af-8037-a2a5054e335f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:54.896516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c1cd0d59-8181-4728-b0a0-4422f51ec1f7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:54.905495 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c1cd0d59-8181-4728-b0a0-4422f51ec1f7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1684 microversion: 2.1 time: 0.331256 Aug 24 10:52:54.906107 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3261/6167] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:54 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1684 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:52:54.965365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-caf8886b-ba94-48af-8037-a2a5054e335f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:54.975296 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-caf8886b-ba94-48af-8037-a2a5054e335f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1390 microversion: 2.1 time: 0.366512 Aug 24 10:52:54.979883 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2907/6168] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:54 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1390 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:55.000621 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-59a59c14-2594-46c3-94df-e07db4d278ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:55.001113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-59a59c14-2594-46c3-94df-e07db4d278ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:55.008338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59a59c14-2594-46c3-94df-e07db4d278ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:55.009571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59a59c14-2594-46c3-94df-e07db4d278ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:55.010234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59a59c14-2594-46c3-94df-e07db4d278ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:55.011350 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59a59c14-2594-46c3-94df-e07db4d278ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:55.011984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59a59c14-2594-46c3-94df-e07db4d278ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:55.012551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59a59c14-2594-46c3-94df-e07db4d278ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:55.229674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-59a59c14-2594-46c3-94df-e07db4d278ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:55.240482 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-59a59c14-2594-46c3-94df-e07db4d278ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1390 microversion: 2.1 time: 0.244750 Aug 24 10:52:55.243422 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3262/6169] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:54 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1390 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:55.337417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-adbe2eab-02a1-47a3-8e27-f2a9ed043f50 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:55.338822 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-adbe2eab-02a1-47a3-8e27-f2a9ed043f50 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:55.346854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adbe2eab-02a1-47a3-8e27-f2a9ed043f50 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:55.347351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adbe2eab-02a1-47a3-8e27-f2a9ed043f50 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:55.347787 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adbe2eab-02a1-47a3-8e27-f2a9ed043f50 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:55.348671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adbe2eab-02a1-47a3-8e27-f2a9ed043f50 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:55.349180 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adbe2eab-02a1-47a3-8e27-f2a9ed043f50 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:55.349608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adbe2eab-02a1-47a3-8e27-f2a9ed043f50 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:55.379767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-adbe2eab-02a1-47a3-8e27-f2a9ed043f50 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:52:55.410615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:55.470691 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-adbe2eab-02a1-47a3-8e27-f2a9ed043f50 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "DELETE /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 204 len: 0 microversion: 2.1 time: 0.138717 Aug 24 10:52:55.472469 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2908/6170] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:52:55 2022] DELETE /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:52:55.481478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f3f5ac03-3c21-4d5c-a657-d686d2c679a6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:55.482241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f3f5ac03-3c21-4d5c-a657-d686d2c679a6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:55.490095 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3f5ac03-3c21-4d5c-a657-d686d2c679a6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:55.494522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3f5ac03-3c21-4d5c-a657-d686d2c679a6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:55.495400 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3f5ac03-3c21-4d5c-a657-d686d2c679a6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:55.500198 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3f5ac03-3c21-4d5c-a657-d686d2c679a6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:55.501532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3f5ac03-3c21-4d5c-a657-d686d2c679a6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:55.513963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3f5ac03-3c21-4d5c-a657-d686d2c679a6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:55.671499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f3f5ac03-3c21-4d5c-a657-d686d2c679a6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:55.679930 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f3f5ac03-3c21-4d5c-a657-d686d2c679a6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1396 microversion: 2.1 time: 0.203090 Aug 24 10:52:55.690344 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3263/6171] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:55 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1396 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:55.956851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-89bb8fc6-e32f-4d30-b6c7-0642bb9d1b9a req-55da6db6-bf4a-4479-8b7d-10b9794ed071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c50590b2-3366-4439-8a10-6e8f1014882f", "name": "network-vif-plugged", "status": "completed", "tag": "694c2288-dc06-4d72-81de-d7b13c0b0cb3"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:52:55.970859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-89bb8fc6-e32f-4d30-b6c7-0642bb9d1b9a req-55da6db6-bf4a-4479-8b7d-10b9794ed071 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:55.971620 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-89bb8fc6-e32f-4d30-b6c7-0642bb9d1b9a req-55da6db6-bf4a-4479-8b7d-10b9794ed071 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:55.972206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-89bb8fc6-e32f-4d30-b6c7-0642bb9d1b9a req-55da6db6-bf4a-4479-8b7d-10b9794ed071 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:55.990979 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-89bb8fc6-e32f-4d30-b6c7-0642bb9d1b9a req-55da6db6-bf4a-4479-8b7d-10b9794ed071 service nova] Creating event network-vif-plugged:694c2288-dc06-4d72-81de-d7b13c0b0cb3 for instance c50590b2-3366-4439-8a10-6e8f1014882f on n-h2-849328-3 Aug 24 10:52:56.006682 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-89bb8fc6-e32f-4d30-b6c7-0642bb9d1b9a req-55da6db6-bf4a-4479-8b7d-10b9794ed071 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048750 Aug 24 10:52:56.011792 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2909/6172] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:52:56.703128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a468e10e-86a2-4a6a-b3b4-07e7eb4fe3ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:56.703741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a468e10e-86a2-4a6a-b3b4-07e7eb4fe3ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:56.712119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a468e10e-86a2-4a6a-b3b4-07e7eb4fe3ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:56.712619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a468e10e-86a2-4a6a-b3b4-07e7eb4fe3ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:56.713216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a468e10e-86a2-4a6a-b3b4-07e7eb4fe3ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:56.713933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a468e10e-86a2-4a6a-b3b4-07e7eb4fe3ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:56.714390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a468e10e-86a2-4a6a-b3b4-07e7eb4fe3ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:56.714993 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a468e10e-86a2-4a6a-b3b4-07e7eb4fe3ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:56.860182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a468e10e-86a2-4a6a-b3b4-07e7eb4fe3ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:56.870956 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a468e10e-86a2-4a6a-b3b4-07e7eb4fe3ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1396 microversion: 2.1 time: 0.170854 Aug 24 10:52:56.871757 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3264/6173] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:56 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1396 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:52:57.896137 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a7098602-5ebd-4304-b47c-5d48d726c88d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:57.897856 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a7098602-5ebd-4304-b47c-5d48d726c88d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:57.906007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7098602-5ebd-4304-b47c-5d48d726c88d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:57.907063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7098602-5ebd-4304-b47c-5d48d726c88d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:57.907707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7098602-5ebd-4304-b47c-5d48d726c88d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:57.908792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7098602-5ebd-4304-b47c-5d48d726c88d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:57.909511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7098602-5ebd-4304-b47c-5d48d726c88d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:57.910299 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7098602-5ebd-4304-b47c-5d48d726c88d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:58.023854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a7098602-5ebd-4304-b47c-5d48d726c88d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:58.037213 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a7098602-5ebd-4304-b47c-5d48d726c88d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1354 microversion: 2.1 time: 0.148148 Aug 24 10:52:58.038291 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2910/6174] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:57 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1354 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:52:58.094924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-4669c6fd-738c-4b9a-8a41-bdc1ab11da9d req-93afbc47-4ee0-48d1-8283-9fa35c98e5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad6e3a34-00af-471c-b9a3-b75c8ac73714", "name": "network-vif-deleted", "tag": "7f6a3e74-c3ef-45cf-8100-a9905efc8d92"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:52:58.122671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4669c6fd-738c-4b9a-8a41-bdc1ab11da9d req-93afbc47-4ee0-48d1-8283-9fa35c98e5e6 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:58.123438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4669c6fd-738c-4b9a-8a41-bdc1ab11da9d req-93afbc47-4ee0-48d1-8283-9fa35c98e5e6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:58.124033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4669c6fd-738c-4b9a-8a41-bdc1ab11da9d req-93afbc47-4ee0-48d1-8283-9fa35c98e5e6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:58.143676 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-4669c6fd-738c-4b9a-8a41-bdc1ab11da9d req-93afbc47-4ee0-48d1-8283-9fa35c98e5e6 service nova] Creating event network-vif-deleted:7f6a3e74-c3ef-45cf-8100-a9905efc8d92 for instance ad6e3a34-00af-471c-b9a3-b75c8ac73714 on n-h1-849328-3 Aug 24 10:52:58.156162 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-4669c6fd-738c-4b9a-8a41-bdc1ab11da9d req-93afbc47-4ee0-48d1-8283-9fa35c98e5e6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064888 Aug 24 10:52:58.157377 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3265/6175] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:52:59.061884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b118b29e-3830-4d3d-9732-f6920b82af7c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:52:59.062864 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b118b29e-3830-4d3d-9732-f6920b82af7c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:52:59.073869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b118b29e-3830-4d3d-9732-f6920b82af7c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:59.075145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b118b29e-3830-4d3d-9732-f6920b82af7c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:59.076121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b118b29e-3830-4d3d-9732-f6920b82af7c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:59.077722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b118b29e-3830-4d3d-9732-f6920b82af7c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:52:59.079941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b118b29e-3830-4d3d-9732-f6920b82af7c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:52:59.081079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b118b29e-3830-4d3d-9732-f6920b82af7c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:52:59.217604 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b118b29e-3830-4d3d-9732-f6920b82af7c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:52:59.227383 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b118b29e-3830-4d3d-9732-f6920b82af7c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1188 microversion: 2.1 time: 0.169842 Aug 24 10:52:59.239301 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2911/6176] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:52:59 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1188 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:53:00.254317 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-64685504-6a9f-4ace-a09e-3281ede3fd93 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:00.255638 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-64685504-6a9f-4ace-a09e-3281ede3fd93 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:00.262642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64685504-6a9f-4ace-a09e-3281ede3fd93 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:00.263595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64685504-6a9f-4ace-a09e-3281ede3fd93 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:00.264196 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64685504-6a9f-4ace-a09e-3281ede3fd93 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:00.265069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64685504-6a9f-4ace-a09e-3281ede3fd93 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:00.265714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64685504-6a9f-4ace-a09e-3281ede3fd93 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:00.266301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64685504-6a9f-4ace-a09e-3281ede3fd93 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:00.271017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:00.371463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-64685504-6a9f-4ace-a09e-3281ede3fd93 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:53:00.397319 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-64685504-6a9f-4ace-a09e-3281ede3fd93 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1188 microversion: 2.1 time: 0.148125 Aug 24 10:53:00.397319 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3266/6177] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:53:00 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1188 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:53:01.412355 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bdff82ff-57f6-41ef-96a1-9e3d94f8e8c9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:01.413736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bdff82ff-57f6-41ef-96a1-9e3d94f8e8c9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:01.425085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdff82ff-57f6-41ef-96a1-9e3d94f8e8c9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:01.430222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdff82ff-57f6-41ef-96a1-9e3d94f8e8c9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:01.431091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdff82ff-57f6-41ef-96a1-9e3d94f8e8c9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:01.435181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdff82ff-57f6-41ef-96a1-9e3d94f8e8c9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:01.437022 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdff82ff-57f6-41ef-96a1-9e3d94f8e8c9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:01.437574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdff82ff-57f6-41ef-96a1-9e3d94f8e8c9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:01.606140 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bdff82ff-57f6-41ef-96a1-9e3d94f8e8c9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:53:01.620765 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bdff82ff-57f6-41ef-96a1-9e3d94f8e8c9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1188 microversion: 2.1 time: 0.211186 Aug 24 10:53:01.621904 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2912/6178] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:53:01 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1188 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:53:02.645392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-44f0cf28-0514-4b3c-a5fe-ec277658608d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:02.646817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-44f0cf28-0514-4b3c-a5fe-ec277658608d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:02.665263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44f0cf28-0514-4b3c-a5fe-ec277658608d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:02.665827 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44f0cf28-0514-4b3c-a5fe-ec277658608d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:02.666200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44f0cf28-0514-4b3c-a5fe-ec277658608d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:02.667452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44f0cf28-0514-4b3c-a5fe-ec277658608d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:02.667915 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44f0cf28-0514-4b3c-a5fe-ec277658608d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:02.668338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44f0cf28-0514-4b3c-a5fe-ec277658608d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:02.798177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-44f0cf28-0514-4b3c-a5fe-ec277658608d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:53:02.812810 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-44f0cf28-0514-4b3c-a5fe-ec277658608d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 200 len: 1188 microversion: 2.1 time: 0.171918 Aug 24 10:53:02.813682 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3267/6179] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:53:02 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 1188 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:53:03.835082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a8cd2f32-1684-47b5-8b1f-5fdbfd248207 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:03.836967 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a8cd2f32-1684-47b5-8b1f-5fdbfd248207 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:03.845232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8cd2f32-1684-47b5-8b1f-5fdbfd248207 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:03.845922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8cd2f32-1684-47b5-8b1f-5fdbfd248207 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:03.847182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8cd2f32-1684-47b5-8b1f-5fdbfd248207 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:03.848212 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8cd2f32-1684-47b5-8b1f-5fdbfd248207 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:03.848840 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8cd2f32-1684-47b5-8b1f-5fdbfd248207 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:03.849510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8cd2f32-1684-47b5-8b1f-5fdbfd248207 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:03.873239 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-a8cd2f32-1684-47b5-8b1f-5fdbfd248207 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] HTTP exception thrown: Instance ad6e3a34-00af-471c-b9a3-b75c8ac73714 could not be found. Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a8cd2f32-1684-47b5-8b1f-5fdbfd248207 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Request method failure captured: Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 HTTP/1.1 Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgJaL-kWwlcIRB5LGdxUOg9NstdlrO4InCZtaIlL6zMAKoO2x9AaKw5QTM5Yc447Qz9dKY7jxkolr7Q3liCCaPxpGdqV4sv_A4_Emu-qJmA0z5hB1ngNyBGm9n-W2LyGX7LaKy8OE29M25iXwnWnUlWVb7vPgN3qX9b_bYxZIyExFQ4 Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d1785d661bbd41619a7046600ad435b1", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d1785d661bbd41619a7046600ad435b1"}]}] Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-TestVolumeBootPattern-1780678770-project Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 26b7ff61eab4477890d20977574e8dac Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-TestVolumeBootPattern-1780678770-project Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance ad6e3a34-00af-471c-b9a3-b75c8ac73714 could not be found. Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'ad6e3a34-00af-471c-b9a3-b75c8ac73714'} Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad6e3a34-00af-471c-b9a3-b75c8ac73714 could not be found. Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad6e3a34-00af-471c-b9a3-b75c8ac73714 could not be found. Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:53:03.875451 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:53:03.884445 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:53:03.884445 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:53:03.884445 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:53:03.884445 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:53:03.884445 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:53:03.884445 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad6e3a34-00af-471c-b9a3-b75c8ac73714 could not be found. Aug 24 10:53:03.884445 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:53:03.884445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a8cd2f32-1684-47b5-8b1f-5fdbfd248207 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Returning 404 to user: Instance ad6e3a34-00af-471c-b9a3-b75c8ac73714 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:53:03.884445 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a8cd2f32-1684-47b5-8b1f-5fdbfd248207 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 404 len: 111 microversion: 2.1 time: 0.049237 Aug 24 10:53:03.884445 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2913/6180] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:53:03 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:53:07.217351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-95a1e159-5811-49a2-867c-ce43f9338270 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:07.218260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-95a1e159-5811-49a2-867c-ce43f9338270 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:07.224712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95a1e159-5811-49a2-867c-ce43f9338270 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:07.225800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95a1e159-5811-49a2-867c-ce43f9338270 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:07.226171 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95a1e159-5811-49a2-867c-ce43f9338270 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:07.227454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95a1e159-5811-49a2-867c-ce43f9338270 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:07.228293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95a1e159-5811-49a2-867c-ce43f9338270 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:07.229016 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95a1e159-5811-49a2-867c-ce43f9338270 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:07.275420 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-95a1e159-5811-49a2-867c-ce43f9338270 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] HTTP exception thrown: Instance ad6e3a34-00af-471c-b9a3-b75c8ac73714 could not be found. Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-95a1e159-5811-49a2-867c-ce43f9338270 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Request method failure captured: Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 HTTP/1.1 Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgJaL-kWwlcIRB5LGdxUOg9NstdlrO4InCZtaIlL6zMAKoO2x9AaKw5QTM5Yc447Qz9dKY7jxkolr7Q3liCCaPxpGdqV4sv_A4_Emu-qJmA0z5hB1ngNyBGm9n-W2LyGX7LaKy8OE29M25iXwnWnUlWVb7vPgN3qX9b_bYxZIyExFQ4 Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d1785d661bbd41619a7046600ad435b1", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d1785d661bbd41619a7046600ad435b1"}]}] Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestVolumeBootPattern-1780678770-project Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 26b7ff61eab4477890d20977574e8dac Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestVolumeBootPattern-1780678770-project Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance ad6e3a34-00af-471c-b9a3-b75c8ac73714 could not be found. Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'ad6e3a34-00af-471c-b9a3-b75c8ac73714'} Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad6e3a34-00af-471c-b9a3-b75c8ac73714 could not be found. Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:53:07.277476 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:53:07.282241 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad6e3a34-00af-471c-b9a3-b75c8ac73714 could not be found. Aug 24 10:53:07.282241 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:53:07.282241 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:53:07.282241 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:53:07.282241 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:53:07.282241 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:53:07.282241 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:53:07.282241 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:53:07.282241 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:53:07.282241 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad6e3a34-00af-471c-b9a3-b75c8ac73714 could not be found. Aug 24 10:53:07.282241 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:53:07.282241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-95a1e159-5811-49a2-867c-ce43f9338270 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Returning 404 to user: Instance ad6e3a34-00af-471c-b9a3-b75c8ac73714 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:53:07.282241 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-95a1e159-5811-49a2-867c-ce43f9338270 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "DELETE /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 404 len: 111 microversion: 2.1 time: 0.065641 Aug 24 10:53:07.283397 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3268/6181] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:53:07 2022] DELETE /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:53:07.289617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0c01a64d-c910-4914-a073-f2b7c51d2103 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:07.290930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0c01a64d-c910-4914-a073-f2b7c51d2103 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: ad6e3a34-00af-471c-b9a3-b75c8ac73714] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:07.300553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c01a64d-c910-4914-a073-f2b7c51d2103 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:07.301788 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c01a64d-c910-4914-a073-f2b7c51d2103 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:07.302399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c01a64d-c910-4914-a073-f2b7c51d2103 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:07.303310 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c01a64d-c910-4914-a073-f2b7c51d2103 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:07.304324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c01a64d-c910-4914-a073-f2b7c51d2103 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:07.304916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c01a64d-c910-4914-a073-f2b7c51d2103 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:07.324576 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-0c01a64d-c910-4914-a073-f2b7c51d2103 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] HTTP exception thrown: Instance ad6e3a34-00af-471c-b9a3-b75c8ac73714 could not be found. Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0c01a64d-c910-4914-a073-f2b7c51d2103 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Request method failure captured: Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 HTTP/1.1 Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgJaL-kWwlcIRB5LGdxUOg9NstdlrO4InCZtaIlL6zMAKoO2x9AaKw5QTM5Yc447Qz9dKY7jxkolr7Q3liCCaPxpGdqV4sv_A4_Emu-qJmA0z5hB1ngNyBGm9n-W2LyGX7LaKy8OE29M25iXwnWnUlWVb7vPgN3qX9b_bYxZIyExFQ4 Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d1785d661bbd41619a7046600ad435b1", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d1785d661bbd41619a7046600ad435b1"}]}] Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-TestVolumeBootPattern-1780678770-project Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 26b7ff61eab4477890d20977574e8dac Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-TestVolumeBootPattern-1780678770-project Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance ad6e3a34-00af-471c-b9a3-b75c8ac73714 could not be found. Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'ad6e3a34-00af-471c-b9a3-b75c8ac73714'} Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad6e3a34-00af-471c-b9a3-b75c8ac73714 could not be found. Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad6e3a34-00af-471c-b9a3-b75c8ac73714 could not be found. Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:53:07.326540 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:53:07.331503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:53:07.331503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:53:07.331503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:53:07.331503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:53:07.331503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:53:07.331503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad6e3a34-00af-471c-b9a3-b75c8ac73714 could not be found. Aug 24 10:53:07.331503 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:53:07.341181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0c01a64d-c910-4914-a073-f2b7c51d2103 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Returning 404 to user: Instance ad6e3a34-00af-471c-b9a3-b75c8ac73714 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:53:07.342415 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0c01a64d-c910-4914-a073-f2b7c51d2103 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714" status: 404 len: 111 microversion: 2.1 time: 0.057325 Aug 24 10:53:07.343212 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2914/6182] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:53:07 2022] GET /compute/v2.1/servers/ad6e3a34-00af-471c-b9a3-b75c8ac73714 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:53:21.162665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7f26cde4-8b60-4f9f-8b0e-a23912656bab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:53:21.172919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7f26cde4-8b60-4f9f-8b0e-a23912656bab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:21.176646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=55 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:21.186175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=12 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:21.210347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f26cde4-8b60-4f9f-8b0e-a23912656bab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:21.211334 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f26cde4-8b60-4f9f-8b0e-a23912656bab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:21.212145 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f26cde4-8b60-4f9f-8b0e-a23912656bab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:21.214453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f26cde4-8b60-4f9f-8b0e-a23912656bab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:21.215273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f26cde4-8b60-4f9f-8b0e-a23912656bab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:21.232593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f26cde4-8b60-4f9f-8b0e-a23912656bab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:21.307496 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7f26cde4-8b60-4f9f-8b0e-a23912656bab tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "POST /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f/action" status: 200 len: 63168 microversion: 2.1 time: 0.153844 Aug 24 10:53:21.310098 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3269/6183] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:53:21 2022] POST /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f/action => generated 63168 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:53:27.929308 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0f2977cd-58b0-4799-bd68-60d407045275 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:27.930958 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0f2977cd-58b0-4799-bd68-60d407045275 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:27.939401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:27.940568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:27.942600 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f2977cd-58b0-4799-bd68-60d407045275 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:27.943748 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f2977cd-58b0-4799-bd68-60d407045275 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:27.944525 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f2977cd-58b0-4799-bd68-60d407045275 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:27.945712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f2977cd-58b0-4799-bd68-60d407045275 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:27.946838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f2977cd-58b0-4799-bd68-60d407045275 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:27.947802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f2977cd-58b0-4799-bd68-60d407045275 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:28.145083 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0f2977cd-58b0-4799-bd68-60d407045275 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1835 microversion: 2.1 time: 0.220251 Aug 24 10:53:28.148443 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2915/6184] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:53:27 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1835 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:53:30.057694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d5c94685-8657-4ceb-ba53-277d2ba9316c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:30.058296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d5c94685-8657-4ceb-ba53-277d2ba9316c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:30.062553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-8a967c6c-8252-4e3d-a0c1-834a9979eece req-c07dc459-250a-4846-b070-e8c04b44756a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c50590b2-3366-4439-8a10-6e8f1014882f", "tag": "694c2288-dc06-4d72-81de-d7b13c0b0cb3"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:53:30.074535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5c94685-8657-4ceb-ba53-277d2ba9316c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:30.076694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5c94685-8657-4ceb-ba53-277d2ba9316c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:30.077197 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5c94685-8657-4ceb-ba53-277d2ba9316c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:30.078144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5c94685-8657-4ceb-ba53-277d2ba9316c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:30.078694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8a967c6c-8252-4e3d-a0c1-834a9979eece req-c07dc459-250a-4846-b070-e8c04b44756a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:30.079067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5c94685-8657-4ceb-ba53-277d2ba9316c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:30.079429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8a967c6c-8252-4e3d-a0c1-834a9979eece req-c07dc459-250a-4846-b070-e8c04b44756a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:30.079864 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5c94685-8657-4ceb-ba53-277d2ba9316c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:30.080060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8a967c6c-8252-4e3d-a0c1-834a9979eece req-c07dc459-250a-4846-b070-e8c04b44756a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:30.111500 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-8a967c6c-8252-4e3d-a0c1-834a9979eece req-c07dc459-250a-4846-b070-e8c04b44756a service nova] Creating event network-changed:694c2288-dc06-4d72-81de-d7b13c0b0cb3 for instance c50590b2-3366-4439-8a10-6e8f1014882f on n-h2-849328-3 Aug 24 10:53:30.113976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d5c94685-8657-4ceb-ba53-277d2ba9316c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:53:30.120932 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-8a967c6c-8252-4e3d-a0c1-834a9979eece req-c07dc459-250a-4846-b070-e8c04b44756a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062770 Aug 24 10:53:30.124972 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2916/6185] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:53:30.408574 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d5c94685-8657-4ceb-ba53-277d2ba9316c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "DELETE /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 204 len: 0 microversion: 2.1 time: 0.355349 Aug 24 10:53:30.409849 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3270/6186] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:53:30 2022] DELETE /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:53:30.424937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4ebc400b-ecb8-4bc7-8122-e3e686329975 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:30.428668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4ebc400b-ecb8-4bc7-8122-e3e686329975 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:30.462430 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ebc400b-ecb8-4bc7-8122-e3e686329975 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:30.466228 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ebc400b-ecb8-4bc7-8122-e3e686329975 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:30.467499 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ebc400b-ecb8-4bc7-8122-e3e686329975 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:30.469199 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ebc400b-ecb8-4bc7-8122-e3e686329975 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:30.470614 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ebc400b-ecb8-4bc7-8122-e3e686329975 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:30.471670 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ebc400b-ecb8-4bc7-8122-e3e686329975 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:30.746448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4ebc400b-ecb8-4bc7-8122-e3e686329975 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:53:30.777266 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4ebc400b-ecb8-4bc7-8122-e3e686329975 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1690 microversion: 2.1 time: 0.362031 Aug 24 10:53:30.783081 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2917/6187] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:53:30 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1690 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:53:31.804856 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-54d64813-46ba-4645-acbb-9338735d9978 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:31.805823 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-54d64813-46ba-4645-acbb-9338735d9978 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:31.822231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54d64813-46ba-4645-acbb-9338735d9978 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:31.825136 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54d64813-46ba-4645-acbb-9338735d9978 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:31.825942 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54d64813-46ba-4645-acbb-9338735d9978 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:31.828028 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54d64813-46ba-4645-acbb-9338735d9978 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:31.829581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54d64813-46ba-4645-acbb-9338735d9978 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:31.860588 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54d64813-46ba-4645-acbb-9338735d9978 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:32.286019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-54d64813-46ba-4645-acbb-9338735d9978 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:53:32.300282 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-54d64813-46ba-4645-acbb-9338735d9978 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1690 microversion: 2.1 time: 0.500698 Aug 24 10:53:32.302565 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3271/6188] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:53:31 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1690 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:53:32.953615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-6a57b648-0331-4d85-acc2-4f4797cf11b8 req-edc42971-3ab4-4d9f-b6f1-873310016f77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c50590b2-3366-4439-8a10-6e8f1014882f", "name": "network-vif-deleted", "tag": "694c2288-dc06-4d72-81de-d7b13c0b0cb3"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:53:32.968973 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6a57b648-0331-4d85-acc2-4f4797cf11b8 req-edc42971-3ab4-4d9f-b6f1-873310016f77 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:32.969804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6a57b648-0331-4d85-acc2-4f4797cf11b8 req-edc42971-3ab4-4d9f-b6f1-873310016f77 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:32.970440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6a57b648-0331-4d85-acc2-4f4797cf11b8 req-edc42971-3ab4-4d9f-b6f1-873310016f77 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:33.018341 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-6a57b648-0331-4d85-acc2-4f4797cf11b8 req-edc42971-3ab4-4d9f-b6f1-873310016f77 service nova] Creating event network-vif-deleted:694c2288-dc06-4d72-81de-d7b13c0b0cb3 for instance c50590b2-3366-4439-8a10-6e8f1014882f on n-h2-849328-3 Aug 24 10:53:33.024578 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-6a57b648-0331-4d85-acc2-4f4797cf11b8 req-edc42971-3ab4-4d9f-b6f1-873310016f77 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076252 Aug 24 10:53:33.038874 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2918/6189] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:53:33.327357 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-584a7627-206b-4648-a764-656cf0b3fc29 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:33.328028 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-584a7627-206b-4648-a764-656cf0b3fc29 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:33.338807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-584a7627-206b-4648-a764-656cf0b3fc29 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:33.340155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-584a7627-206b-4648-a764-656cf0b3fc29 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:33.340807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-584a7627-206b-4648-a764-656cf0b3fc29 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:33.341802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-584a7627-206b-4648-a764-656cf0b3fc29 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:33.342495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-584a7627-206b-4648-a764-656cf0b3fc29 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:33.343740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-584a7627-206b-4648-a764-656cf0b3fc29 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:33.431557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-584a7627-206b-4648-a764-656cf0b3fc29 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:33.432918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-584a7627-206b-4648-a764-656cf0b3fc29 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:33.433412 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-584a7627-206b-4648-a764-656cf0b3fc29 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:33.433888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-584a7627-206b-4648-a764-656cf0b3fc29 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lazy-loading 'fault' on Instance uuid c50590b2-3366-4439-8a10-6e8f1014882f {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:53:33.544210 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-584a7627-206b-4648-a764-656cf0b3fc29 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:53:33.582912 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-584a7627-206b-4648-a764-656cf0b3fc29 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 200 len: 1357 microversion: 2.1 time: 0.259314 Aug 24 10:53:33.591286 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3272/6190] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:53:33 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 1357 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:53:34.607953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-96d80ca2-92d3-44ae-84f0-35fe65775bae tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:34.608989 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-96d80ca2-92d3-44ae-84f0-35fe65775bae tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: c50590b2-3366-4439-8a10-6e8f1014882f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:34.616438 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96d80ca2-92d3-44ae-84f0-35fe65775bae tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:34.633298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96d80ca2-92d3-44ae-84f0-35fe65775bae tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:34.634465 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96d80ca2-92d3-44ae-84f0-35fe65775bae tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:34.638117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96d80ca2-92d3-44ae-84f0-35fe65775bae tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:34.638939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96d80ca2-92d3-44ae-84f0-35fe65775bae tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:34.641637 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96d80ca2-92d3-44ae-84f0-35fe65775bae tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:34.667547 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-96d80ca2-92d3-44ae-84f0-35fe65775bae tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] HTTP exception thrown: Instance c50590b2-3366-4439-8a10-6e8f1014882f could not be found. Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-96d80ca2-92d3-44ae-84f0-35fe65775bae tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Request method failure captured: Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f HTTP/1.1 Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgIYr3m0kczioH5SSbuV0siG9VfGIEhErhXgPNYWqTrwdwzLctBv4d_yF7_2o3Bo2OCW0F3YBxLt_VBZKvzJVotT6Q8BjQkCHvOThFjqvFIwYZTCav5UQXePGBVbTY6y1fdzkpkRSvMUUvzdkP7LJWZQ1ilcF3WX7Nwy-FzIhdwxmrY Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: de650d3c897a409dbf54c32bfd45d672 Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-639544488 Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/de650d3c897a409dbf54c32bfd45d672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_de650d3c897a409dbf54c32bfd45d672", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/de650d3c897a409dbf54c32bfd45d672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/de650d3c897a409dbf54c32bfd45d672"}]}] Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-TestNetworkAdvancedServerOps-639544488 Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: de650d3c897a409dbf54c32bfd45d672 Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-639544488 Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-TestNetworkAdvancedServerOps-639544488-project Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 127a30846ae64f268baf7f3231b84273 Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-TestNetworkAdvancedServerOps-639544488-project Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance c50590b2-3366-4439-8a10-6e8f1014882f could not be found. Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'c50590b2-3366-4439-8a10-6e8f1014882f'} Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c50590b2-3366-4439-8a10-6e8f1014882f could not be found. Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c50590b2-3366-4439-8a10-6e8f1014882f could not be found. Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:53:34.669405 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:53:34.673389 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:53:34.673389 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:53:34.673389 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:53:34.673389 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:53:34.673389 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:53:34.673389 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:53:34.673389 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c50590b2-3366-4439-8a10-6e8f1014882f could not be found. Aug 24 10:53:34.673389 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:53:34.673389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-96d80ca2-92d3-44ae-84f0-35fe65775bae tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Returning 404 to user: Instance c50590b2-3366-4439-8a10-6e8f1014882f could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:53:34.673389 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-96d80ca2-92d3-44ae-84f0-35fe65775bae tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f" status: 404 len: 111 microversion: 2.1 time: 0.067973 Aug 24 10:53:34.673389 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2919/6191] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:53:34 2022] GET /compute/v2.1/servers/c50590b2-3366-4439-8a10-6e8f1014882f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:53:40.848456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f4307905-7c48-40aa-9b26-b784bc99ba98 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '.version_select at 0x7f4647bf7700>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:40.900787 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f4307905-7c48-40aa-9b26-b784bc99ba98 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1520876587" status: 202 len: 0 microversion: 2.1 time: 0.057592 Aug 24 10:53:40.901505 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3273/6192] 10.222.0.85 () {58 vars in 1284 bytes} [Wed Aug 24 10:53:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1520876587 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:53:40.942884 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a7f5656c-1b5b-4a46-98c1-58b844c7d75b tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Action: 'create', calling method: .version_select at 0x7f46550fd790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1527265487", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/hsO512RwVfgK3jIVaUOsWzGexvobzYBUNY3hRk5IJ0DmPoKZka8JRViiqp7VLyv198IpD1ClvlLU3X48YSO/WMWQOpW+DfrXWNuPDl9Kh3h+Kx5Tn0jbM54CvmdDjwQ=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:53:40.984774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-a7f5656c-1b5b-4a46-98c1-58b844c7d75b tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Getting quotas for project de650d3c897a409dbf54c32bfd45d672. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:53:40.991550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-a7f5656c-1b5b-4a46-98c1-58b844c7d75b tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Getting quotas for user 127a30846ae64f268baf7f3231b84273 and project de650d3c897a409dbf54c32bfd45d672. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:53:41.043349 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a7f5656c-1b5b-4a46-98c1-58b844c7d75b tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.104469 Aug 24 10:53:41.044292 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2920/6193] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:53:40 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:53:41.111029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-55ef7273-1018-43b0-b5bc-4ad9a8be52ce tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-869003621", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "dff7cc5d-106d-4b1a-b5dd-72b5723e4468", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "9996d4a7-fe50-441a-b919-9c80031d0109"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:53:41.207674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-55ef7273-1018-43b0-b5bc-4ad9a8be52ce tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] validate_networks() for [('9996d4a7-fe50-441a-b919-9c80031d0109', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:53:41.786239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-55ef7273-1018-43b0-b5bc-4ad9a8be52ce tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:53:41.786239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-55ef7273-1018-43b0-b5bc-4ad9a8be52ce tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:53:41.786239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-55ef7273-1018-43b0-b5bc-4ad9a8be52ce tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:53:41.786239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-55ef7273-1018-43b0-b5bc-4ad9a8be52ce tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:53:41.786812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-55ef7273-1018-43b0-b5bc-4ad9a8be52ce tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:53:41.803873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55ef7273-1018-43b0-b5bc-4ad9a8be52ce tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:41.804361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55ef7273-1018-43b0-b5bc-4ad9a8be52ce tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:41.804796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55ef7273-1018-43b0-b5bc-4ad9a8be52ce tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:41.805662 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55ef7273-1018-43b0-b5bc-4ad9a8be52ce tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:41.806135 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55ef7273-1018-43b0-b5bc-4ad9a8be52ce tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:41.806552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55ef7273-1018-43b0-b5bc-4ad9a8be52ce tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:41.848774 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-55ef7273-1018-43b0-b5bc-4ad9a8be52ce tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Getting quotas for project d1785d661bbd41619a7046600ad435b1. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:53:41.861278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-55ef7273-1018-43b0-b5bc-4ad9a8be52ce tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Getting quotas for user 26b7ff61eab4477890d20977574e8dac and project d1785d661bbd41619a7046600ad435b1. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:53:41.949900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-55ef7273-1018-43b0-b5bc-4ad9a8be52ce tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:53:41.952572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-55ef7273-1018-43b0-b5bc-4ad9a8be52ce tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dff7cc5d-106d-4b1a-b5dd-72b5723e4468',volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:53:42.153838 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-55ef7273-1018-43b0-b5bc-4ad9a8be52ce tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.047019 Aug 24 10:53:42.154741 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3274/6194] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:53:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:53:42.168420 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-03f7aec7-1626-4edf-bda8-001232578f20 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:42.170359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-03f7aec7-1626-4edf-bda8-001232578f20 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:42.321590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-03f7aec7-1626-4edf-bda8-001232578f20 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:53:42.335982 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-03f7aec7-1626-4edf-bda8-001232578f20 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1070 microversion: 2.1 time: 0.172823 Aug 24 10:53:42.337944 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2921/6195] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:53:42 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1070 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:53:43.357801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1d266958-0f8e-414f-be3b-ddffd30dc13d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:43.359096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1d266958-0f8e-414f-be3b-ddffd30dc13d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:43.375225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d266958-0f8e-414f-be3b-ddffd30dc13d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:43.376491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d266958-0f8e-414f-be3b-ddffd30dc13d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:43.377266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d266958-0f8e-414f-be3b-ddffd30dc13d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:43.378283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d266958-0f8e-414f-be3b-ddffd30dc13d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:43.381428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d266958-0f8e-414f-be3b-ddffd30dc13d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:43.381990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d266958-0f8e-414f-be3b-ddffd30dc13d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:43.610114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1d266958-0f8e-414f-be3b-ddffd30dc13d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:53:43.634480 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1d266958-0f8e-414f-be3b-ddffd30dc13d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1168 microversion: 2.1 time: 0.279291 Aug 24 10:53:43.636201 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3275/6196] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:53:43 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1168 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:53:44.663465 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3207abbc-6e5a-4646-a69c-fa2ddc1a43fc tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:44.664714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3207abbc-6e5a-4646-a69c-fa2ddc1a43fc tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:44.680020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=18 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:44.688444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3207abbc-6e5a-4646-a69c-fa2ddc1a43fc tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:44.689289 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3207abbc-6e5a-4646-a69c-fa2ddc1a43fc tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:44.689887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3207abbc-6e5a-4646-a69c-fa2ddc1a43fc tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:44.690768 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3207abbc-6e5a-4646-a69c-fa2ddc1a43fc tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:44.691775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3207abbc-6e5a-4646-a69c-fa2ddc1a43fc tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:44.692364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3207abbc-6e5a-4646-a69c-fa2ddc1a43fc tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:44.866677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3207abbc-6e5a-4646-a69c-fa2ddc1a43fc tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:53:44.882196 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3207abbc-6e5a-4646-a69c-fa2ddc1a43fc tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1186 microversion: 2.1 time: 0.223108 Aug 24 10:53:44.883083 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2922/6197] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:53:44 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1186 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:53:45.903844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b05f4ab0-1357-40b6-9ec3-a5eac535a787 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:45.905043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b05f4ab0-1357-40b6-9ec3-a5eac535a787 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:45.919675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b05f4ab0-1357-40b6-9ec3-a5eac535a787 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:45.926281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b05f4ab0-1357-40b6-9ec3-a5eac535a787 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:45.927237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b05f4ab0-1357-40b6-9ec3-a5eac535a787 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:45.928158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b05f4ab0-1357-40b6-9ec3-a5eac535a787 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:45.930859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b05f4ab0-1357-40b6-9ec3-a5eac535a787 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:45.935118 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b05f4ab0-1357-40b6-9ec3-a5eac535a787 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:46.243622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b05f4ab0-1357-40b6-9ec3-a5eac535a787 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:53:46.256751 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b05f4ab0-1357-40b6-9ec3-a5eac535a787 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1228 microversion: 2.1 time: 0.356521 Aug 24 10:53:46.261225 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3276/6198] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:53:45 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1228 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:53:47.283230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3014238d-54fa-4d9c-8385-8a85afed9495 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:47.284927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3014238d-54fa-4d9c-8385-8a85afed9495 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:47.294791 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3014238d-54fa-4d9c-8385-8a85afed9495 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:47.295855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3014238d-54fa-4d9c-8385-8a85afed9495 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:47.296700 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3014238d-54fa-4d9c-8385-8a85afed9495 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:47.298285 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3014238d-54fa-4d9c-8385-8a85afed9495 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:47.299008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3014238d-54fa-4d9c-8385-8a85afed9495 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:47.299599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3014238d-54fa-4d9c-8385-8a85afed9495 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:47.657659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3014238d-54fa-4d9c-8385-8a85afed9495 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:53:47.666947 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3014238d-54fa-4d9c-8385-8a85afed9495 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1228 microversion: 2.1 time: 0.387781 Aug 24 10:53:47.671829 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2923/6199] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:53:47 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1228 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:53:47.970275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-57b19bdf-a965-4697-a749-3772046d8168 req-2e069997-256e-4694-9860-8519432e8abf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bda76a1-cfeb-49da-84de-4792a08ce846", "tag": "13cff44a-2b36-403d-93d9-2b389e9a8491"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:53:47.995904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-57b19bdf-a965-4697-a749-3772046d8168 req-2e069997-256e-4694-9860-8519432e8abf service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:47.999241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-57b19bdf-a965-4697-a749-3772046d8168 req-2e069997-256e-4694-9860-8519432e8abf service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:47.999850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-57b19bdf-a965-4697-a749-3772046d8168 req-2e069997-256e-4694-9860-8519432e8abf service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:48.053527 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-57b19bdf-a965-4697-a749-3772046d8168 req-2e069997-256e-4694-9860-8519432e8abf service nova] Creating event network-changed:13cff44a-2b36-403d-93d9-2b389e9a8491 for instance 9bda76a1-cfeb-49da-84de-4792a08ce846 on n-h1-849328-3 Aug 24 10:53:48.077569 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-57b19bdf-a965-4697-a749-3772046d8168 req-2e069997-256e-4694-9860-8519432e8abf service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113268 Aug 24 10:53:48.081203 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3277/6200] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:53:48.698018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-518c0565-092f-4964-b0c2-fe7f0d264cb0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:48.698643 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-518c0565-092f-4964-b0c2-fe7f0d264cb0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:48.708531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-518c0565-092f-4964-b0c2-fe7f0d264cb0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:48.709035 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-518c0565-092f-4964-b0c2-fe7f0d264cb0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:48.709555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-518c0565-092f-4964-b0c2-fe7f0d264cb0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:48.710630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-518c0565-092f-4964-b0c2-fe7f0d264cb0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:48.711090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-518c0565-092f-4964-b0c2-fe7f0d264cb0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:48.711521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-518c0565-092f-4964-b0c2-fe7f0d264cb0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:49.093815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-518c0565-092f-4964-b0c2-fe7f0d264cb0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:53:49.102928 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-518c0565-092f-4964-b0c2-fe7f0d264cb0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1228 microversion: 2.1 time: 0.408784 Aug 24 10:53:49.103548 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2924/6201] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:53:48 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1228 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:53:50.124585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-43623140-d8e5-4ec1-9d29-4ac27eee561b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:50.125874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-43623140-d8e5-4ec1-9d29-4ac27eee561b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:50.137543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43623140-d8e5-4ec1-9d29-4ac27eee561b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:50.142408 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43623140-d8e5-4ec1-9d29-4ac27eee561b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:50.143047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43623140-d8e5-4ec1-9d29-4ac27eee561b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:50.145712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43623140-d8e5-4ec1-9d29-4ac27eee561b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:50.146193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43623140-d8e5-4ec1-9d29-4ac27eee561b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:50.146635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43623140-d8e5-4ec1-9d29-4ac27eee561b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:50.609352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-43623140-d8e5-4ec1-9d29-4ac27eee561b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:53:50.625085 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-43623140-d8e5-4ec1-9d29-4ac27eee561b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1228 microversion: 2.1 time: 0.502303 Aug 24 10:53:50.628047 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3278/6202] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:53:50 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1228 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:53:51.651183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ecf27a9d-782a-4e80-a8be-987b30a5784f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:51.651822 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ecf27a9d-782a-4e80-a8be-987b30a5784f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:51.661270 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecf27a9d-782a-4e80-a8be-987b30a5784f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:51.661808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecf27a9d-782a-4e80-a8be-987b30a5784f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:51.672315 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecf27a9d-782a-4e80-a8be-987b30a5784f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:51.673722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecf27a9d-782a-4e80-a8be-987b30a5784f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:51.674221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecf27a9d-782a-4e80-a8be-987b30a5784f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:51.675469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecf27a9d-782a-4e80-a8be-987b30a5784f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:52.208701 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ecf27a9d-782a-4e80-a8be-987b30a5784f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:53:52.221378 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ecf27a9d-782a-4e80-a8be-987b30a5784f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1228 microversion: 2.1 time: 0.578017 Aug 24 10:53:52.236186 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2925/6203] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:53:51 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1228 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:53:53.137534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2cd1dd4f-914a-4f8a-8c4b-c6db9f52ab08 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1720820942", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "8e81cafa-eef9-46ac-9f00-1952206f7b42"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1527265487", "security_groups": [{"name": "tempest-secgroup-smoke-607993273"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:53:53.152616 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:53.153372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:53.154072 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:53.249726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-070cae9e-dc07-485a-b05f-d0aa4f580003 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:53.250357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-070cae9e-dc07-485a-b05f-d0aa4f580003 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:53.265303 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:53.276359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-070cae9e-dc07-485a-b05f-d0aa4f580003 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:53.277418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-070cae9e-dc07-485a-b05f-d0aa4f580003 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:53.296941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-070cae9e-dc07-485a-b05f-d0aa4f580003 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:53.298741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-070cae9e-dc07-485a-b05f-d0aa4f580003 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:53.301544 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-070cae9e-dc07-485a-b05f-d0aa4f580003 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:53.303096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-070cae9e-dc07-485a-b05f-d0aa4f580003 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:53.436645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-2cd1dd4f-914a-4f8a-8c4b-c6db9f52ab08 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] validate_networks() for [('8e81cafa-eef9-46ac-9f00-1952206f7b42', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:53:53.720801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-070cae9e-dc07-485a-b05f-d0aa4f580003 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:53:53.768941 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-070cae9e-dc07-485a-b05f-d0aa4f580003 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1228 microversion: 2.1 time: 0.528481 Aug 24 10:53:53.770276 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2926/6204] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:53:53 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1228 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:53:54.464483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-2cd1dd4f-914a-4f8a-8c4b-c6db9f52ab08 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:53:54.464901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-2cd1dd4f-914a-4f8a-8c4b-c6db9f52ab08 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:53:54.465388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-2cd1dd4f-914a-4f8a-8c4b-c6db9f52ab08 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:53:54.465798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-2cd1dd4f-914a-4f8a-8c4b-c6db9f52ab08 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:53:54.466206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-2cd1dd4f-914a-4f8a-8c4b-c6db9f52ab08 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:53:54.482684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cd1dd4f-914a-4f8a-8c4b-c6db9f52ab08 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:54.483420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cd1dd4f-914a-4f8a-8c4b-c6db9f52ab08 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:54.483665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cd1dd4f-914a-4f8a-8c4b-c6db9f52ab08 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:54.484394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cd1dd4f-914a-4f8a-8c4b-c6db9f52ab08 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:54.484852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cd1dd4f-914a-4f8a-8c4b-c6db9f52ab08 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:54.485298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cd1dd4f-914a-4f8a-8c4b-c6db9f52ab08 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:54.517369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:54.541464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-2cd1dd4f-914a-4f8a-8c4b-c6db9f52ab08 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Getting quotas for project de650d3c897a409dbf54c32bfd45d672. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:53:54.558021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-2cd1dd4f-914a-4f8a-8c4b-c6db9f52ab08 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Getting quotas for user 127a30846ae64f268baf7f3231b84273 and project de650d3c897a409dbf54c32bfd45d672. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:53:54.594912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2cd1dd4f-914a-4f8a-8c4b-c6db9f52ab08 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:53:54.597311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2cd1dd4f-914a-4f8a-8c4b-c6db9f52ab08 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:53:54.722821 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2cd1dd4f-914a-4f8a-8c4b-c6db9f52ab08 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.589917 Aug 24 10:53:54.734699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f946a244-50e1-4f2a-a2f3-b2c3578bd6de tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:54.735319 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f946a244-50e1-4f2a-a2f3-b2c3578bd6de tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:54.741573 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3279/6205] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:53:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 1608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:53:54.793931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-94c80727-0468-47e7-9c97-e77190ac2cbd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:54.794557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-94c80727-0468-47e7-9c97-e77190ac2cbd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:54.803658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94c80727-0468-47e7-9c97-e77190ac2cbd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:54.804090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94c80727-0468-47e7-9c97-e77190ac2cbd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:54.804525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94c80727-0468-47e7-9c97-e77190ac2cbd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:54.813412 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94c80727-0468-47e7-9c97-e77190ac2cbd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:54.814454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94c80727-0468-47e7-9c97-e77190ac2cbd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:54.815750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94c80727-0468-47e7-9c97-e77190ac2cbd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:54.894106 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f946a244-50e1-4f2a-a2f3-b2c3578bd6de tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:53:54.902536 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f946a244-50e1-4f2a-a2f3-b2c3578bd6de tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1267 microversion: 2.1 time: 0.171691 Aug 24 10:53:54.903143 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2927/6206] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:53:54 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:53:55.255712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-94c80727-0468-47e7-9c97-e77190ac2cbd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:53:55.268545 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-94c80727-0468-47e7-9c97-e77190ac2cbd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1228 microversion: 2.1 time: 0.478572 Aug 24 10:53:55.271331 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3280/6207] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:53:54 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1228 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:53:55.928945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-011f738b-9f54-4d28-9749-06cb29265b36 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:55.930352 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-011f738b-9f54-4d28-9749-06cb29265b36 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:55.956333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-011f738b-9f54-4d28-9749-06cb29265b36 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:55.957327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-011f738b-9f54-4d28-9749-06cb29265b36 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:55.957830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-011f738b-9f54-4d28-9749-06cb29265b36 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:55.958508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-011f738b-9f54-4d28-9749-06cb29265b36 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:55.961802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-011f738b-9f54-4d28-9749-06cb29265b36 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:55.963900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-011f738b-9f54-4d28-9749-06cb29265b36 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:56.145050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-011f738b-9f54-4d28-9749-06cb29265b36 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:53:56.167021 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-011f738b-9f54-4d28-9749-06cb29265b36 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1263 microversion: 2.1 time: 0.239382 Aug 24 10:53:56.192271 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2928/6208] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:53:55 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1263 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:53:56.298069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bd8ce70a-bbf3-4ba7-a07f-de143b1126ad tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:56.298889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bd8ce70a-bbf3-4ba7-a07f-de143b1126ad tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:56.314726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd8ce70a-bbf3-4ba7-a07f-de143b1126ad tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:56.316529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd8ce70a-bbf3-4ba7-a07f-de143b1126ad tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:56.318991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd8ce70a-bbf3-4ba7-a07f-de143b1126ad tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:56.320522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd8ce70a-bbf3-4ba7-a07f-de143b1126ad tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:56.322099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd8ce70a-bbf3-4ba7-a07f-de143b1126ad tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:56.322529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd8ce70a-bbf3-4ba7-a07f-de143b1126ad tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:56.777152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bd8ce70a-bbf3-4ba7-a07f-de143b1126ad tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:53:56.785514 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bd8ce70a-bbf3-4ba7-a07f-de143b1126ad tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1228 microversion: 2.1 time: 0.492994 Aug 24 10:53:56.793465 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3281/6209] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:53:56 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1228 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:53:57.210297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eb650a80-8166-4d3f-8297-a8063b937c19 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:57.212114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eb650a80-8166-4d3f-8297-a8063b937c19 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:57.233482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb650a80-8166-4d3f-8297-a8063b937c19 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:57.240478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb650a80-8166-4d3f-8297-a8063b937c19 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:57.241147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb650a80-8166-4d3f-8297-a8063b937c19 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:57.243937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb650a80-8166-4d3f-8297-a8063b937c19 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:57.244712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb650a80-8166-4d3f-8297-a8063b937c19 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:57.245818 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb650a80-8166-4d3f-8297-a8063b937c19 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:57.471913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eb650a80-8166-4d3f-8297-a8063b937c19 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:53:57.484861 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eb650a80-8166-4d3f-8297-a8063b937c19 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1325 microversion: 2.1 time: 0.279553 Aug 24 10:53:57.495901 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2929/6210] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:53:57 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1325 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:53:57.807096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-56722824-82ca-4c39-a0f9-7484bb373d5a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:57.807816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-56722824-82ca-4c39-a0f9-7484bb373d5a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:57.820798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56722824-82ca-4c39-a0f9-7484bb373d5a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:57.826153 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56722824-82ca-4c39-a0f9-7484bb373d5a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:57.826872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56722824-82ca-4c39-a0f9-7484bb373d5a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:57.832215 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56722824-82ca-4c39-a0f9-7484bb373d5a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:57.833235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56722824-82ca-4c39-a0f9-7484bb373d5a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:57.836453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56722824-82ca-4c39-a0f9-7484bb373d5a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:58.518793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f5445ebb-487e-45ba-8004-ec777e33ce5c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:58.519607 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f5445ebb-487e-45ba-8004-ec777e33ce5c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:58.532801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:58.536137 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5445ebb-487e-45ba-8004-ec777e33ce5c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:58.537597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5445ebb-487e-45ba-8004-ec777e33ce5c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:58.539077 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5445ebb-487e-45ba-8004-ec777e33ce5c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:58.540231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5445ebb-487e-45ba-8004-ec777e33ce5c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:58.542079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5445ebb-487e-45ba-8004-ec777e33ce5c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:58.543302 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5445ebb-487e-45ba-8004-ec777e33ce5c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:58.762290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f5445ebb-487e-45ba-8004-ec777e33ce5c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:53:58.778944 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f5445ebb-487e-45ba-8004-ec777e33ce5c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1325 microversion: 2.1 time: 0.264358 Aug 24 10:53:58.780575 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2930/6211] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:53:58 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1325 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:53:59.069177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-56722824-82ca-4c39-a0f9-7484bb373d5a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:53:59.083985 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-56722824-82ca-4c39-a0f9-7484bb373d5a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1216 microversion: 2.1 time: 1.281199 Aug 24 10:53:59.086721 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3282/6212] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:53:57 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1216 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:53:59.806218 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e641abf1-63b4-40cb-980d-56598dd35c31 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:53:59.807585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e641abf1-63b4-40cb-980d-56598dd35c31 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:53:59.818905 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e641abf1-63b4-40cb-980d-56598dd35c31 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:59.819690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e641abf1-63b4-40cb-980d-56598dd35c31 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:59.822839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e641abf1-63b4-40cb-980d-56598dd35c31 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:53:59.823973 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e641abf1-63b4-40cb-980d-56598dd35c31 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:53:59.824626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e641abf1-63b4-40cb-980d-56598dd35c31 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:53:59.825639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e641abf1-63b4-40cb-980d-56598dd35c31 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:00.046686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e641abf1-63b4-40cb-980d-56598dd35c31 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:00.056082 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e641abf1-63b4-40cb-980d-56598dd35c31 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1392 microversion: 2.1 time: 0.257039 Aug 24 10:54:00.056700 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2931/6213] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:53:59 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1392 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:00.106483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-edb497cd-4ebf-4596-b9f5-6867a3c070d6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:00.107128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-edb497cd-4ebf-4596-b9f5-6867a3c070d6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:00.114277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edb497cd-4ebf-4596-b9f5-6867a3c070d6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:00.114700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edb497cd-4ebf-4596-b9f5-6867a3c070d6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:00.115141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edb497cd-4ebf-4596-b9f5-6867a3c070d6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:00.115851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edb497cd-4ebf-4596-b9f5-6867a3c070d6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:00.116306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edb497cd-4ebf-4596-b9f5-6867a3c070d6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:00.116737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edb497cd-4ebf-4596-b9f5-6867a3c070d6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:00.414023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-edb497cd-4ebf-4596-b9f5-6867a3c070d6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:00.430144 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-edb497cd-4ebf-4596-b9f5-6867a3c070d6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1216 microversion: 2.1 time: 0.326905 Aug 24 10:54:00.432188 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3283/6214] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:00 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1216 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:00.930864 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-a586a3b8-aa65-47b9-ab53-7719a116f8b0 req-b355b852-9cae-46fe-93bd-e6ff058c1693 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f71f034-8a70-4049-8987-f32b3a2626b4", "tag": "a00c703f-fe1f-49fe-baa8-f5e6c0363285"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:54:00.957177 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a586a3b8-aa65-47b9-ab53-7719a116f8b0 req-b355b852-9cae-46fe-93bd-e6ff058c1693 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:00.957672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a586a3b8-aa65-47b9-ab53-7719a116f8b0 req-b355b852-9cae-46fe-93bd-e6ff058c1693 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:00.958113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a586a3b8-aa65-47b9-ab53-7719a116f8b0 req-b355b852-9cae-46fe-93bd-e6ff058c1693 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:00.983326 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-a586a3b8-aa65-47b9-ab53-7719a116f8b0 req-b355b852-9cae-46fe-93bd-e6ff058c1693 service nova] Creating event network-changed:a00c703f-fe1f-49fe-baa8-f5e6c0363285 for instance 2f71f034-8a70-4049-8987-f32b3a2626b4 on n-h2-849328-3 Aug 24 10:54:00.989105 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-a586a3b8-aa65-47b9-ab53-7719a116f8b0 req-b355b852-9cae-46fe-93bd-e6ff058c1693 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062930 Aug 24 10:54:00.989941 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2932/6215] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:54:01.076175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ef722d98-a85d-4eaf-bf35-a04e826ef455 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:01.076817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ef722d98-a85d-4eaf-bf35-a04e826ef455 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:01.085366 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef722d98-a85d-4eaf-bf35-a04e826ef455 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:01.086113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef722d98-a85d-4eaf-bf35-a04e826ef455 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:01.086787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef722d98-a85d-4eaf-bf35-a04e826ef455 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:01.087667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef722d98-a85d-4eaf-bf35-a04e826ef455 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:01.088644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef722d98-a85d-4eaf-bf35-a04e826ef455 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:01.089464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef722d98-a85d-4eaf-bf35-a04e826ef455 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:01.454162 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1650ffc7-6d26-4dd3-b348-2f5479c8b999 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:01.454162 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1650ffc7-6d26-4dd3-b348-2f5479c8b999 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:01.460958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ef722d98-a85d-4eaf-bf35-a04e826ef455 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:01.476232 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ef722d98-a85d-4eaf-bf35-a04e826ef455 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1392 microversion: 2.1 time: 0.403911 Aug 24 10:54:01.478647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1650ffc7-6d26-4dd3-b348-2f5479c8b999 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:01.479432 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3284/6216] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:01 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1392 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:01.482614 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1650ffc7-6d26-4dd3-b348-2f5479c8b999 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:01.483514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1650ffc7-6d26-4dd3-b348-2f5479c8b999 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:01.484473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1650ffc7-6d26-4dd3-b348-2f5479c8b999 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:01.485165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1650ffc7-6d26-4dd3-b348-2f5479c8b999 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:01.485825 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1650ffc7-6d26-4dd3-b348-2f5479c8b999 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:01.730712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1650ffc7-6d26-4dd3-b348-2f5479c8b999 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:01.748680 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1650ffc7-6d26-4dd3-b348-2f5479c8b999 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1216 microversion: 2.1 time: 0.298734 Aug 24 10:54:01.750207 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2933/6217] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:01 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1216 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:02.503165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-26819e8a-ae19-4dae-8b92-f189b3d36f53 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:02.504708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-26819e8a-ae19-4dae-8b92-f189b3d36f53 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:02.512397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26819e8a-ae19-4dae-8b92-f189b3d36f53 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:02.513106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26819e8a-ae19-4dae-8b92-f189b3d36f53 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:02.513685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26819e8a-ae19-4dae-8b92-f189b3d36f53 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:02.514504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26819e8a-ae19-4dae-8b92-f189b3d36f53 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:02.515097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26819e8a-ae19-4dae-8b92-f189b3d36f53 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:02.515626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26819e8a-ae19-4dae-8b92-f189b3d36f53 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:02.774445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-13cdbbb1-340c-4611-af82-7259b9bf3dea tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:02.774987 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-13cdbbb1-340c-4611-af82-7259b9bf3dea tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:02.786117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13cdbbb1-340c-4611-af82-7259b9bf3dea tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:02.786973 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13cdbbb1-340c-4611-af82-7259b9bf3dea tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:02.787696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13cdbbb1-340c-4611-af82-7259b9bf3dea tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:02.788565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13cdbbb1-340c-4611-af82-7259b9bf3dea tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:02.789538 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13cdbbb1-340c-4611-af82-7259b9bf3dea tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:02.790054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13cdbbb1-340c-4611-af82-7259b9bf3dea tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:02.799267 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-26819e8a-ae19-4dae-8b92-f189b3d36f53 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:02.810508 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-26819e8a-ae19-4dae-8b92-f189b3d36f53 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1392 microversion: 2.1 time: 0.312344 Aug 24 10:54:02.813621 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3285/6218] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:02 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1392 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:03.025942 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-13cdbbb1-340c-4611-af82-7259b9bf3dea tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:03.039995 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-13cdbbb1-340c-4611-af82-7259b9bf3dea tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1216 microversion: 2.1 time: 0.271889 Aug 24 10:54:03.044036 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2934/6219] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:02 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1216 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:54:03.844396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cd153bfa-4fa4-40c0-8ee3-586a768a4aee tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:03.848099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cd153bfa-4fa4-40c0-8ee3-586a768a4aee tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:03.856131 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd153bfa-4fa4-40c0-8ee3-586a768a4aee tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:03.856640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd153bfa-4fa4-40c0-8ee3-586a768a4aee tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:03.857078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd153bfa-4fa4-40c0-8ee3-586a768a4aee tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:03.857966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd153bfa-4fa4-40c0-8ee3-586a768a4aee tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:03.859408 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd153bfa-4fa4-40c0-8ee3-586a768a4aee tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:03.859863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd153bfa-4fa4-40c0-8ee3-586a768a4aee tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:04.072176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bc6ee110-2285-46be-8326-0364c7108c8a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:04.072925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bc6ee110-2285-46be-8326-0364c7108c8a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:04.103690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cd153bfa-4fa4-40c0-8ee3-586a768a4aee tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:04.112964 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cd153bfa-4fa4-40c0-8ee3-586a768a4aee tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1392 microversion: 2.1 time: 0.278365 Aug 24 10:54:04.113608 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3286/6220] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:03 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1392 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:04.114319 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc6ee110-2285-46be-8326-0364c7108c8a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:04.115209 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc6ee110-2285-46be-8326-0364c7108c8a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:04.115764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc6ee110-2285-46be-8326-0364c7108c8a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:04.116610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc6ee110-2285-46be-8326-0364c7108c8a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:04.117197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc6ee110-2285-46be-8326-0364c7108c8a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:04.117730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc6ee110-2285-46be-8326-0364c7108c8a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:04.332800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bc6ee110-2285-46be-8326-0364c7108c8a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:04.347762 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bc6ee110-2285-46be-8326-0364c7108c8a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1216 microversion: 2.1 time: 0.286807 Aug 24 10:54:04.349278 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2935/6221] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:04 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1216 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:05.133928 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a5724172-fe27-4c6b-9e68-0efd5e8185db tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:05.135011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a5724172-fe27-4c6b-9e68-0efd5e8185db tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:05.137085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:05.137792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:05.146275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5724172-fe27-4c6b-9e68-0efd5e8185db tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:05.146767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5724172-fe27-4c6b-9e68-0efd5e8185db tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:05.147203 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5724172-fe27-4c6b-9e68-0efd5e8185db tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:05.148021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5724172-fe27-4c6b-9e68-0efd5e8185db tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:05.148365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5724172-fe27-4c6b-9e68-0efd5e8185db tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:05.148787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5724172-fe27-4c6b-9e68-0efd5e8185db tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:05.312684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a5724172-fe27-4c6b-9e68-0efd5e8185db tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:05.321579 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a5724172-fe27-4c6b-9e68-0efd5e8185db tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1392 microversion: 2.1 time: 0.191606 Aug 24 10:54:05.322314 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3287/6222] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:05 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1392 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:05.368705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-912ba943-1330-4b21-a720-5d17ea04e4ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:05.369364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-912ba943-1330-4b21-a720-5d17ea04e4ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:05.372455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:05.377461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-912ba943-1330-4b21-a720-5d17ea04e4ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:05.377957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-912ba943-1330-4b21-a720-5d17ea04e4ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:05.378400 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-912ba943-1330-4b21-a720-5d17ea04e4ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:05.379115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-912ba943-1330-4b21-a720-5d17ea04e4ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:05.379582 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-912ba943-1330-4b21-a720-5d17ea04e4ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:05.380179 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-912ba943-1330-4b21-a720-5d17ea04e4ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:05.522951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-912ba943-1330-4b21-a720-5d17ea04e4ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:05.531249 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-912ba943-1330-4b21-a720-5d17ea04e4ae tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1216 microversion: 2.1 time: 0.166905 Aug 24 10:54:05.531848 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2936/6223] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:05 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1216 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:06.351015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7802f0ab-800b-4784-917f-1a46f9ef5a8f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:06.351667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7802f0ab-800b-4784-917f-1a46f9ef5a8f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:06.359533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7802f0ab-800b-4784-917f-1a46f9ef5a8f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:06.359995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7802f0ab-800b-4784-917f-1a46f9ef5a8f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:06.360534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7802f0ab-800b-4784-917f-1a46f9ef5a8f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:06.361441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7802f0ab-800b-4784-917f-1a46f9ef5a8f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:06.362010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7802f0ab-800b-4784-917f-1a46f9ef5a8f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:06.362543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7802f0ab-800b-4784-917f-1a46f9ef5a8f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:06.554381 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dc3f6f8c-6c4f-4407-95bc-291fb5e54c67 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:06.555168 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dc3f6f8c-6c4f-4407-95bc-291fb5e54c67 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:06.568680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc3f6f8c-6c4f-4407-95bc-291fb5e54c67 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:06.571397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc3f6f8c-6c4f-4407-95bc-291fb5e54c67 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:06.572040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc3f6f8c-6c4f-4407-95bc-291fb5e54c67 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:06.573914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc3f6f8c-6c4f-4407-95bc-291fb5e54c67 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:06.577906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7802f0ab-800b-4784-917f-1a46f9ef5a8f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:06.591981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc3f6f8c-6c4f-4407-95bc-291fb5e54c67 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:06.598533 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc3f6f8c-6c4f-4407-95bc-291fb5e54c67 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:06.603936 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7802f0ab-800b-4784-917f-1a46f9ef5a8f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1392 microversion: 2.1 time: 0.259180 Aug 24 10:54:06.604646 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3288/6224] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:06 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1392 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:06.630545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-d05e94fe-ba0d-4ba8-82e3-2954a5bb824c req-c45bbf8d-c5bb-41f8-a369-e99d046d0470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f71f034-8a70-4049-8987-f32b3a2626b4", "name": "network-vif-plugged", "status": "completed", "tag": "a00c703f-fe1f-49fe-baa8-f5e6c0363285"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:54:06.669520 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d05e94fe-ba0d-4ba8-82e3-2954a5bb824c req-c45bbf8d-c5bb-41f8-a369-e99d046d0470 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:06.671222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d05e94fe-ba0d-4ba8-82e3-2954a5bb824c req-c45bbf8d-c5bb-41f8-a369-e99d046d0470 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:06.671736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d05e94fe-ba0d-4ba8-82e3-2954a5bb824c req-c45bbf8d-c5bb-41f8-a369-e99d046d0470 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:06.708775 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-d05e94fe-ba0d-4ba8-82e3-2954a5bb824c req-c45bbf8d-c5bb-41f8-a369-e99d046d0470 service nova] Creating event network-vif-plugged:a00c703f-fe1f-49fe-baa8-f5e6c0363285 for instance 2f71f034-8a70-4049-8987-f32b3a2626b4 on n-h2-849328-3 Aug 24 10:54:06.742076 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-d05e94fe-ba0d-4ba8-82e3-2954a5bb824c req-c45bbf8d-c5bb-41f8-a369-e99d046d0470 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116298 Aug 24 10:54:06.742717 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3289/6225] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:54:06.874856 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dc3f6f8c-6c4f-4407-95bc-291fb5e54c67 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:06.883212 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dc3f6f8c-6c4f-4407-95bc-291fb5e54c67 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1216 microversion: 2.1 time: 0.333348 Aug 24 10:54:06.896728 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2937/6226] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:06 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1216 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:07.629261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d48b9d3c-f359-4028-b353-2aca2fe23277 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:07.630014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d48b9d3c-f359-4028-b353-2aca2fe23277 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:07.638267 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d48b9d3c-f359-4028-b353-2aca2fe23277 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:07.639242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d48b9d3c-f359-4028-b353-2aca2fe23277 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:07.639748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d48b9d3c-f359-4028-b353-2aca2fe23277 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:07.640629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d48b9d3c-f359-4028-b353-2aca2fe23277 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:07.641247 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d48b9d3c-f359-4028-b353-2aca2fe23277 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:07.641996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d48b9d3c-f359-4028-b353-2aca2fe23277 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:07.823266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d48b9d3c-f359-4028-b353-2aca2fe23277 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:07.842417 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d48b9d3c-f359-4028-b353-2aca2fe23277 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1392 microversion: 2.1 time: 0.218149 Aug 24 10:54:07.843478 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3290/6227] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:07 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1392 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:07.904523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f6038c4d-b595-48dc-bfc8-82dc7c8f9a7e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:07.905220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f6038c4d-b595-48dc-bfc8-82dc7c8f9a7e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:07.921473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6038c4d-b595-48dc-bfc8-82dc7c8f9a7e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:07.922443 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6038c4d-b595-48dc-bfc8-82dc7c8f9a7e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:07.923225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6038c4d-b595-48dc-bfc8-82dc7c8f9a7e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:07.924216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6038c4d-b595-48dc-bfc8-82dc7c8f9a7e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:07.924936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6038c4d-b595-48dc-bfc8-82dc7c8f9a7e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:07.925596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6038c4d-b595-48dc-bfc8-82dc7c8f9a7e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:08.189343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f6038c4d-b595-48dc-bfc8-82dc7c8f9a7e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:08.205764 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f6038c4d-b595-48dc-bfc8-82dc7c8f9a7e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1216 microversion: 2.1 time: 0.305586 Aug 24 10:54:08.209338 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2938/6228] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:07 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1216 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:08.770473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-7a3737b7-213a-42c4-9c05-4394fe013e70 req-25a5bc4f-7e4b-4159-8d60-db926ca87df1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bda76a1-cfeb-49da-84de-4792a08ce846", "name": "network-vif-plugged", "status": "completed", "tag": "13cff44a-2b36-403d-93d9-2b389e9a8491"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:54:08.784373 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7a3737b7-213a-42c4-9c05-4394fe013e70 req-25a5bc4f-7e4b-4159-8d60-db926ca87df1 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:08.784869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7a3737b7-213a-42c4-9c05-4394fe013e70 req-25a5bc4f-7e4b-4159-8d60-db926ca87df1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:08.785387 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7a3737b7-213a-42c4-9c05-4394fe013e70 req-25a5bc4f-7e4b-4159-8d60-db926ca87df1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:08.796822 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-7a3737b7-213a-42c4-9c05-4394fe013e70 req-25a5bc4f-7e4b-4159-8d60-db926ca87df1 service nova] Creating event network-vif-plugged:13cff44a-2b36-403d-93d9-2b389e9a8491 for instance 9bda76a1-cfeb-49da-84de-4792a08ce846 on n-h1-849328-3 Aug 24 10:54:08.802035 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-7a3737b7-213a-42c4-9c05-4394fe013e70 req-25a5bc4f-7e4b-4159-8d60-db926ca87df1 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036597 Aug 24 10:54:08.802848 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3291/6229] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:54:08.868722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c960aad1-45a7-4baf-a435-a044a043d583 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:08.869985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c960aad1-45a7-4baf-a435-a044a043d583 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:08.882383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c960aad1-45a7-4baf-a435-a044a043d583 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:08.883273 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c960aad1-45a7-4baf-a435-a044a043d583 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:08.884468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c960aad1-45a7-4baf-a435-a044a043d583 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:08.885643 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c960aad1-45a7-4baf-a435-a044a043d583 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:08.886315 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c960aad1-45a7-4baf-a435-a044a043d583 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:08.886965 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c960aad1-45a7-4baf-a435-a044a043d583 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:09.104598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c960aad1-45a7-4baf-a435-a044a043d583 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:09.113978 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c960aad1-45a7-4baf-a435-a044a043d583 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1564 microversion: 2.1 time: 0.253277 Aug 24 10:54:09.134797 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2939/6230] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:08 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1564 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:09.138384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4cf021c0-f0f3-4bfa-94c6-b8676366db83 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:09.139132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4cf021c0-f0f3-4bfa-94c6-b8676366db83 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:09.154232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cf021c0-f0f3-4bfa-94c6-b8676366db83 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:09.154726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cf021c0-f0f3-4bfa-94c6-b8676366db83 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:09.155381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cf021c0-f0f3-4bfa-94c6-b8676366db83 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:09.156355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cf021c0-f0f3-4bfa-94c6-b8676366db83 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:09.156823 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cf021c0-f0f3-4bfa-94c6-b8676366db83 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:09.157283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cf021c0-f0f3-4bfa-94c6-b8676366db83 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:09.257147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ac4d9b66-a722-460c-a91b-7830472b76fb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:09.257763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ac4d9b66-a722-460c-a91b-7830472b76fb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:09.268411 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac4d9b66-a722-460c-a91b-7830472b76fb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:09.268904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac4d9b66-a722-460c-a91b-7830472b76fb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:09.269358 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac4d9b66-a722-460c-a91b-7830472b76fb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:09.279054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac4d9b66-a722-460c-a91b-7830472b76fb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:09.279869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac4d9b66-a722-460c-a91b-7830472b76fb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:09.280697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac4d9b66-a722-460c-a91b-7830472b76fb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:09.287145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:09.325490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4cf021c0-f0f3-4bfa-94c6-b8676366db83 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:09.334923 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4cf021c0-f0f3-4bfa-94c6-b8676366db83 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1564 microversion: 2.1 time: 0.201864 Aug 24 10:54:09.336918 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3292/6231] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:09 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1564 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:09.480782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ac4d9b66-a722-460c-a91b-7830472b76fb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:09.489157 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ac4d9b66-a722-460c-a91b-7830472b76fb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1216 microversion: 2.1 time: 0.246342 Aug 24 10:54:09.489986 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2940/6232] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:09 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1216 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:10.521323 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-29bc241c-f679-4152-a4f1-159e3ac71bef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:10.522021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-29bc241c-f679-4152-a4f1-159e3ac71bef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:10.529914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29bc241c-f679-4152-a4f1-159e3ac71bef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:10.530407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29bc241c-f679-4152-a4f1-159e3ac71bef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:10.530847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29bc241c-f679-4152-a4f1-159e3ac71bef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:10.531549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29bc241c-f679-4152-a4f1-159e3ac71bef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:10.532005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29bc241c-f679-4152-a4f1-159e3ac71bef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:10.532432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29bc241c-f679-4152-a4f1-159e3ac71bef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:10.676431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-29bc241c-f679-4152-a4f1-159e3ac71bef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:10.685640 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-29bc241c-f679-4152-a4f1-159e3ac71bef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1403 microversion: 2.1 time: 0.171597 Aug 24 10:54:10.686362 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3293/6233] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:10 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1403 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:10.708323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4f711b07-e3f1-464b-99eb-eb3ff5b57eec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:10.709294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4f711b07-e3f1-464b-99eb-eb3ff5b57eec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:10.718468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f711b07-e3f1-464b-99eb-eb3ff5b57eec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:10.719382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f711b07-e3f1-464b-99eb-eb3ff5b57eec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:10.720050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f711b07-e3f1-464b-99eb-eb3ff5b57eec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:10.720896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f711b07-e3f1-464b-99eb-eb3ff5b57eec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:10.721527 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f711b07-e3f1-464b-99eb-eb3ff5b57eec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:10.722062 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f711b07-e3f1-464b-99eb-eb3ff5b57eec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:10.979055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4f711b07-e3f1-464b-99eb-eb3ff5b57eec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:10.988297 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4f711b07-e3f1-464b-99eb-eb3ff5b57eec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1403 microversion: 2.1 time: 0.284596 Aug 24 10:54:10.988916 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2941/6234] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:10 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1403 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:11.010897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ba48bac4-fd05-47b5-bc88-299057a270a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-315261678"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:54:11.013341 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ba48bac4-fd05-47b5-bc88-299057a270a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:11.024680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba48bac4-fd05-47b5-bc88-299057a270a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:11.025638 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba48bac4-fd05-47b5-bc88-299057a270a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:11.026255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba48bac4-fd05-47b5-bc88-299057a270a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:11.027465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba48bac4-fd05-47b5-bc88-299057a270a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:11.028286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba48bac4-fd05-47b5-bc88-299057a270a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:11.028959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba48bac4-fd05-47b5-bc88-299057a270a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:11.165594 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.compute.api [None req-ba48bac4-fd05-47b5-bc88-299057a270a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Attempting to quiesce instance before volume snapshot. Aug 24 10:54:11.247229 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.compute.api [None req-ba48bac4-fd05-47b5-bc88-299057a270a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 24 10:54:11.348290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ba48bac4-fd05-47b5-bc88-299057a270a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Creating snapshot from volume dff7cc5d-106d-4b1a-b5dd-72b5723e4468. {{(pid=122433) snapshot_instance /opt/stack/nova/nova/compute/api.py:3496}} Aug 24 10:54:11.856508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2cf42b0b-f3c6-4135-bdc1-55d3da91cdea tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:11.857902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2cf42b0b-f3c6-4135-bdc1-55d3da91cdea tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:11.868669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cf42b0b-f3c6-4135-bdc1-55d3da91cdea tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:11.869463 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cf42b0b-f3c6-4135-bdc1-55d3da91cdea tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:11.870244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cf42b0b-f3c6-4135-bdc1-55d3da91cdea tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:11.871336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cf42b0b-f3c6-4135-bdc1-55d3da91cdea tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:11.872333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cf42b0b-f3c6-4135-bdc1-55d3da91cdea tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:11.873156 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cf42b0b-f3c6-4135-bdc1-55d3da91cdea tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:12.221916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2cf42b0b-f3c6-4135-bdc1-55d3da91cdea tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:12.233463 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2cf42b0b-f3c6-4135-bdc1-55d3da91cdea tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1564 microversion: 2.1 time: 0.382776 Aug 24 10:54:12.246644 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2942/6235] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:11 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1564 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:12.259389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-51198688-910c-4afa-8282-2821fb570a83 req-9b60d954-9a89-4ab1-9cb3-0e66292bafe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f71f034-8a70-4049-8987-f32b3a2626b4", "tag": "a00c703f-fe1f-49fe-baa8-f5e6c0363285"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:54:12.284476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-51198688-910c-4afa-8282-2821fb570a83 req-9b60d954-9a89-4ab1-9cb3-0e66292bafe8 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:12.285468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-51198688-910c-4afa-8282-2821fb570a83 req-9b60d954-9a89-4ab1-9cb3-0e66292bafe8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:12.286186 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-51198688-910c-4afa-8282-2821fb570a83 req-9b60d954-9a89-4ab1-9cb3-0e66292bafe8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:12.303606 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-51198688-910c-4afa-8282-2821fb570a83 req-9b60d954-9a89-4ab1-9cb3-0e66292bafe8 service nova] Creating event network-changed:a00c703f-fe1f-49fe-baa8-f5e6c0363285 for instance 2f71f034-8a70-4049-8987-f32b3a2626b4 on n-h2-849328-3 Aug 24 10:54:12.311208 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-51198688-910c-4afa-8282-2821fb570a83 req-9b60d954-9a89-4ab1-9cb3-0e66292bafe8 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057954 Aug 24 10:54:12.312342 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2943/6236] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:54:13.046829 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ba48bac4-fd05-47b5-bc88-299057a270a4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "POST /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846/action" status: 202 len: 0 microversion: 2.1 time: 2.038370 Aug 24 10:54:13.048387 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3294/6237] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:54:11 2022] POST /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846/action => generated 0 bytes in 2042 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 10:54:15.411932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d40e187b-9702-4b1a-adb1-a459da34f5be tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1604590275", "imageRef": "b9a6527e-5528-4fb6-8349-154bd2df9ea2", "flavorRef": "452", "networks": [{"uuid": "9996d4a7-fe50-441a-b919-9c80031d0109"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:54:15.475401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-d40e187b-9702-4b1a-adb1-a459da34f5be tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] validate_networks() for [('9996d4a7-fe50-441a-b919-9c80031d0109', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:54:15.955150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d40e187b-9702-4b1a-adb1-a459da34f5be tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:54:15.955802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d40e187b-9702-4b1a-adb1-a459da34f5be tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:54:15.956485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d40e187b-9702-4b1a-adb1-a459da34f5be tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:54:15.957258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d40e187b-9702-4b1a-adb1-a459da34f5be tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:54:15.957699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d40e187b-9702-4b1a-adb1-a459da34f5be tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:54:15.967744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d40e187b-9702-4b1a-adb1-a459da34f5be tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:15.968207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d40e187b-9702-4b1a-adb1-a459da34f5be tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:15.968641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d40e187b-9702-4b1a-adb1-a459da34f5be tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:15.969514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d40e187b-9702-4b1a-adb1-a459da34f5be tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:15.969969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d40e187b-9702-4b1a-adb1-a459da34f5be tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:15.970441 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d40e187b-9702-4b1a-adb1-a459da34f5be tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:15.995405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-d40e187b-9702-4b1a-adb1-a459da34f5be tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Getting quotas for project d1785d661bbd41619a7046600ad435b1. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:54:16.000932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-d40e187b-9702-4b1a-adb1-a459da34f5be tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Getting quotas for user 26b7ff61eab4477890d20977574e8dac and project d1785d661bbd41619a7046600ad435b1. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:54:16.014951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d40e187b-9702-4b1a-adb1-a459da34f5be tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:54:16.017708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d40e187b-9702-4b1a-adb1-a459da34f5be tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='505e25e8-7e57-4c31-a5c5-6da09ef15095',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:54:16.111576 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d40e187b-9702-4b1a-adb1-a459da34f5be tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.704195 Aug 24 10:54:16.112752 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2944/6238] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:54:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:54:16.124694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c5249aad-38a5-4016-a69a-524cba64a568 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:16.126365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c5249aad-38a5-4016-a69a-524cba64a568 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:16.216268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c5249aad-38a5-4016-a69a-524cba64a568 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:16.247062 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c5249aad-38a5-4016-a69a-524cba64a568 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1230 microversion: 2.1 time: 0.125571 Aug 24 10:54:16.248518 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3295/6239] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:16 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1230 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:17.269705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-931f6dd0-be54-4d54-83e2-bebff201603c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:17.270999 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-931f6dd0-be54-4d54-83e2-bebff201603c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:17.278505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-931f6dd0-be54-4d54-83e2-bebff201603c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:17.279340 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-931f6dd0-be54-4d54-83e2-bebff201603c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:17.279975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-931f6dd0-be54-4d54-83e2-bebff201603c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:17.280887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-931f6dd0-be54-4d54-83e2-bebff201603c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:17.281572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-931f6dd0-be54-4d54-83e2-bebff201603c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:17.282194 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-931f6dd0-be54-4d54-83e2-bebff201603c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:17.368508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-931f6dd0-be54-4d54-83e2-bebff201603c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:17.377596 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-931f6dd0-be54-4d54-83e2-bebff201603c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1282 microversion: 2.1 time: 0.112883 Aug 24 10:54:17.378211 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2945/6240] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:17 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1282 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:18.399633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fdb7820f-386c-48b2-9947-29fbf54ecc17 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:18.400267 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fdb7820f-386c-48b2-9947-29fbf54ecc17 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:18.409981 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdb7820f-386c-48b2-9947-29fbf54ecc17 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:18.410770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdb7820f-386c-48b2-9947-29fbf54ecc17 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:18.411672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdb7820f-386c-48b2-9947-29fbf54ecc17 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:18.412580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdb7820f-386c-48b2-9947-29fbf54ecc17 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:18.413244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdb7820f-386c-48b2-9947-29fbf54ecc17 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:18.413848 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdb7820f-386c-48b2-9947-29fbf54ecc17 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:18.474671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:18.713058 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fdb7820f-386c-48b2-9947-29fbf54ecc17 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:18.726569 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fdb7820f-386c-48b2-9947-29fbf54ecc17 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1342 microversion: 2.1 time: 0.331422 Aug 24 10:54:18.728107 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3296/6241] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:18 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1342 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:19.620368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-a84b4d18-b3e6-4c61-8869-0c73ab188f4c req-5fb86f5c-e4dc-4e8e-b11b-bca76f448966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844", "tag": "a717148f-3ef9-4b33-b7d5-82ac52cc117c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:54:19.658102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a84b4d18-b3e6-4c61-8869-0c73ab188f4c req-5fb86f5c-e4dc-4e8e-b11b-bca76f448966 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:19.658787 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a84b4d18-b3e6-4c61-8869-0c73ab188f4c req-5fb86f5c-e4dc-4e8e-b11b-bca76f448966 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:19.659348 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a84b4d18-b3e6-4c61-8869-0c73ab188f4c req-5fb86f5c-e4dc-4e8e-b11b-bca76f448966 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:19.679021 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-a84b4d18-b3e6-4c61-8869-0c73ab188f4c req-5fb86f5c-e4dc-4e8e-b11b-bca76f448966 service nova] Creating event network-changed:a717148f-3ef9-4b33-b7d5-82ac52cc117c for instance 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 on n-h1-849328-3 Aug 24 10:54:19.685728 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-a84b4d18-b3e6-4c61-8869-0c73ab188f4c req-5fb86f5c-e4dc-4e8e-b11b-bca76f448966 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069840 Aug 24 10:54:19.686941 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2946/6242] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:54:19.758928 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4f1c3500-b5cc-4457-9397-5262ed1462b5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:19.759820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4f1c3500-b5cc-4457-9397-5262ed1462b5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:19.770201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f1c3500-b5cc-4457-9397-5262ed1462b5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:19.770925 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f1c3500-b5cc-4457-9397-5262ed1462b5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:19.771683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f1c3500-b5cc-4457-9397-5262ed1462b5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:19.773716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f1c3500-b5cc-4457-9397-5262ed1462b5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:19.774439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f1c3500-b5cc-4457-9397-5262ed1462b5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:19.775246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f1c3500-b5cc-4457-9397-5262ed1462b5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:20.033710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4f1c3500-b5cc-4457-9397-5262ed1462b5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:20.053829 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4f1c3500-b5cc-4457-9397-5262ed1462b5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1342 microversion: 2.1 time: 0.301416 Aug 24 10:54:20.065814 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3297/6243] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:19 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1342 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:21.086939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bd386949-4b23-4f9a-8e9d-b066c6e0ab73 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:21.087807 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bd386949-4b23-4f9a-8e9d-b066c6e0ab73 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:21.097787 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd386949-4b23-4f9a-8e9d-b066c6e0ab73 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:21.098290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd386949-4b23-4f9a-8e9d-b066c6e0ab73 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:21.098789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd386949-4b23-4f9a-8e9d-b066c6e0ab73 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:21.099539 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd386949-4b23-4f9a-8e9d-b066c6e0ab73 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:21.100753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd386949-4b23-4f9a-8e9d-b066c6e0ab73 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:21.101564 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd386949-4b23-4f9a-8e9d-b066c6e0ab73 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:21.476292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bd386949-4b23-4f9a-8e9d-b066c6e0ab73 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:21.493222 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bd386949-4b23-4f9a-8e9d-b066c6e0ab73 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1342 microversion: 2.1 time: 0.417101 Aug 24 10:54:21.494582 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2947/6244] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:21 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1342 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:54:22.518959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7d2e72d3-f3cf-41f3-aa05-604eb398d37d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:22.519815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7d2e72d3-f3cf-41f3-aa05-604eb398d37d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:22.531034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d2e72d3-f3cf-41f3-aa05-604eb398d37d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:22.531547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d2e72d3-f3cf-41f3-aa05-604eb398d37d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:22.531998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d2e72d3-f3cf-41f3-aa05-604eb398d37d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:22.532724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d2e72d3-f3cf-41f3-aa05-604eb398d37d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:22.533216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d2e72d3-f3cf-41f3-aa05-604eb398d37d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:22.533657 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d2e72d3-f3cf-41f3-aa05-604eb398d37d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:22.739170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7d2e72d3-f3cf-41f3-aa05-604eb398d37d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:22.748101 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7d2e72d3-f3cf-41f3-aa05-604eb398d37d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1342 microversion: 2.1 time: 0.233929 Aug 24 10:54:22.761580 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3298/6245] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:22 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1342 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:23.778270 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-26b9435a-09c4-41b9-9422-319729ba7856 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:23.780497 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-26b9435a-09c4-41b9-9422-319729ba7856 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:23.802567 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26b9435a-09c4-41b9-9422-319729ba7856 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:23.803226 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26b9435a-09c4-41b9-9422-319729ba7856 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:23.803484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26b9435a-09c4-41b9-9422-319729ba7856 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:23.804200 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26b9435a-09c4-41b9-9422-319729ba7856 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:23.804696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26b9435a-09c4-41b9-9422-319729ba7856 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:23.805102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26b9435a-09c4-41b9-9422-319729ba7856 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:24.054673 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-26b9435a-09c4-41b9-9422-319729ba7856 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:24.069726 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-26b9435a-09c4-41b9-9422-319729ba7856 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1342 microversion: 2.1 time: 0.302805 Aug 24 10:54:24.084354 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2948/6246] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:23 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1342 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:25.101949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2b006a24-619f-486a-bf07-0cc11e9cde46 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:25.103844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2b006a24-619f-486a-bf07-0cc11e9cde46 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:25.108863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:25.123775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b006a24-619f-486a-bf07-0cc11e9cde46 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:25.127154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b006a24-619f-486a-bf07-0cc11e9cde46 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:25.129718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b006a24-619f-486a-bf07-0cc11e9cde46 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:25.132339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b006a24-619f-486a-bf07-0cc11e9cde46 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:25.135999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b006a24-619f-486a-bf07-0cc11e9cde46 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:25.136855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b006a24-619f-486a-bf07-0cc11e9cde46 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:25.384241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2b006a24-619f-486a-bf07-0cc11e9cde46 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:25.413683 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2b006a24-619f-486a-bf07-0cc11e9cde46 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1342 microversion: 2.1 time: 0.313433 Aug 24 10:54:25.419029 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3299/6247] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:25 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1342 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:26.448755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fa56a754-5238-46aa-bfbe-17265b38f3f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:26.449627 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fa56a754-5238-46aa-bfbe-17265b38f3f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:26.454306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:26.455481 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:26.471562 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa56a754-5238-46aa-bfbe-17265b38f3f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:26.472070 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa56a754-5238-46aa-bfbe-17265b38f3f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:26.472509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa56a754-5238-46aa-bfbe-17265b38f3f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:26.477551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa56a754-5238-46aa-bfbe-17265b38f3f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:26.478280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa56a754-5238-46aa-bfbe-17265b38f3f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:26.482339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa56a754-5238-46aa-bfbe-17265b38f3f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:26.750280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fa56a754-5238-46aa-bfbe-17265b38f3f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:26.767303 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fa56a754-5238-46aa-bfbe-17265b38f3f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1342 microversion: 2.1 time: 0.322577 Aug 24 10:54:26.786873 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2949/6248] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:26 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1342 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:27.808537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9a2ff54a-c3e0-40c7-8ed1-fc6f4cdc4ca6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:27.809901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9a2ff54a-c3e0-40c7-8ed1-fc6f4cdc4ca6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:27.813714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:27.822044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a2ff54a-c3e0-40c7-8ed1-fc6f4cdc4ca6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:27.822840 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a2ff54a-c3e0-40c7-8ed1-fc6f4cdc4ca6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:27.823646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a2ff54a-c3e0-40c7-8ed1-fc6f4cdc4ca6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:27.824384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a2ff54a-c3e0-40c7-8ed1-fc6f4cdc4ca6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:27.825022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a2ff54a-c3e0-40c7-8ed1-fc6f4cdc4ca6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:27.825657 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a2ff54a-c3e0-40c7-8ed1-fc6f4cdc4ca6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:28.040056 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9a2ff54a-c3e0-40c7-8ed1-fc6f4cdc4ca6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:28.064829 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9a2ff54a-c3e0-40c7-8ed1-fc6f4cdc4ca6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1342 microversion: 2.1 time: 0.264806 Aug 24 10:54:28.065472 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3300/6249] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:27 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1342 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:29.090383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1b6cf4d2-48a1-4630-b875-52ee70b4d829 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:29.091234 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1b6cf4d2-48a1-4630-b875-52ee70b4d829 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:29.094774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:29.101579 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b6cf4d2-48a1-4630-b875-52ee70b4d829 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:29.102680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b6cf4d2-48a1-4630-b875-52ee70b4d829 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:29.103436 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b6cf4d2-48a1-4630-b875-52ee70b4d829 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:29.104047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b6cf4d2-48a1-4630-b875-52ee70b4d829 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:29.104572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b6cf4d2-48a1-4630-b875-52ee70b4d829 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:29.105090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b6cf4d2-48a1-4630-b875-52ee70b4d829 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:29.289895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1b6cf4d2-48a1-4630-b875-52ee70b4d829 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:29.300391 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1b6cf4d2-48a1-4630-b875-52ee70b4d829 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1342 microversion: 2.1 time: 0.214598 Aug 24 10:54:29.300391 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2950/6250] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:29 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1342 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:30.325990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7a2db64c-5401-49d4-82c6-fd1a78b4eccd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:30.326775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7a2db64c-5401-49d4-82c6-fd1a78b4eccd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:30.334230 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a2db64c-5401-49d4-82c6-fd1a78b4eccd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:30.334744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a2db64c-5401-49d4-82c6-fd1a78b4eccd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:30.335344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a2db64c-5401-49d4-82c6-fd1a78b4eccd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:30.336489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a2db64c-5401-49d4-82c6-fd1a78b4eccd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:30.336987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a2db64c-5401-49d4-82c6-fd1a78b4eccd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:30.337468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a2db64c-5401-49d4-82c6-fd1a78b4eccd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:30.555862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7a2db64c-5401-49d4-82c6-fd1a78b4eccd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:30.564390 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7a2db64c-5401-49d4-82c6-fd1a78b4eccd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1342 microversion: 2.1 time: 0.245139 Aug 24 10:54:30.565089 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3301/6251] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:30 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1342 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:31.591645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ee9d672a-48d2-4a30-840f-243bde68e1c4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:31.593031 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ee9d672a-48d2-4a30-840f-243bde68e1c4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:31.608196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee9d672a-48d2-4a30-840f-243bde68e1c4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:31.609059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee9d672a-48d2-4a30-840f-243bde68e1c4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:31.609705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee9d672a-48d2-4a30-840f-243bde68e1c4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:31.610918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee9d672a-48d2-4a30-840f-243bde68e1c4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:31.611528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee9d672a-48d2-4a30-840f-243bde68e1c4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:31.612351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee9d672a-48d2-4a30-840f-243bde68e1c4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:31.802769 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ee9d672a-48d2-4a30-840f-243bde68e1c4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:31.814493 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ee9d672a-48d2-4a30-840f-243bde68e1c4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1342 microversion: 2.1 time: 0.232148 Aug 24 10:54:31.815444 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2951/6252] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:31 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1342 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:32.843601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4bd7bba1-73b5-45f6-86a4-ab144a417968 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:32.845033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4bd7bba1-73b5-45f6-86a4-ab144a417968 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:32.864824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bd7bba1-73b5-45f6-86a4-ab144a417968 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:32.865952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bd7bba1-73b5-45f6-86a4-ab144a417968 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:32.866648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bd7bba1-73b5-45f6-86a4-ab144a417968 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:32.867662 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bd7bba1-73b5-45f6-86a4-ab144a417968 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:32.868305 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bd7bba1-73b5-45f6-86a4-ab144a417968 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:32.868903 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bd7bba1-73b5-45f6-86a4-ab144a417968 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:33.052814 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4bd7bba1-73b5-45f6-86a4-ab144a417968 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:33.064212 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4bd7bba1-73b5-45f6-86a4-ab144a417968 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1342 microversion: 2.1 time: 0.224623 Aug 24 10:54:33.065881 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3302/6253] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:32 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1342 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:34.089342 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6431bba9-965e-45ee-8b1a-12b17c15b708 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:34.091598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6431bba9-965e-45ee-8b1a-12b17c15b708 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:34.105851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6431bba9-965e-45ee-8b1a-12b17c15b708 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:34.106554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6431bba9-965e-45ee-8b1a-12b17c15b708 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:34.107155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6431bba9-965e-45ee-8b1a-12b17c15b708 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:34.108034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6431bba9-965e-45ee-8b1a-12b17c15b708 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:34.108917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6431bba9-965e-45ee-8b1a-12b17c15b708 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:34.109836 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6431bba9-965e-45ee-8b1a-12b17c15b708 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:34.286254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6431bba9-965e-45ee-8b1a-12b17c15b708 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:34.297604 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6431bba9-965e-45ee-8b1a-12b17c15b708 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1342 microversion: 2.1 time: 0.213955 Aug 24 10:54:34.298814 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2952/6254] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:34 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1342 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:35.330094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dcb45459-09a8-4908-a940-8f06117c516a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:35.333986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dcb45459-09a8-4908-a940-8f06117c516a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:35.366423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcb45459-09a8-4908-a940-8f06117c516a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:35.367496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcb45459-09a8-4908-a940-8f06117c516a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:35.368503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcb45459-09a8-4908-a940-8f06117c516a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:35.369465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcb45459-09a8-4908-a940-8f06117c516a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:35.370124 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcb45459-09a8-4908-a940-8f06117c516a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:35.370726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcb45459-09a8-4908-a940-8f06117c516a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:35.566180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dcb45459-09a8-4908-a940-8f06117c516a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:35.580015 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dcb45459-09a8-4908-a940-8f06117c516a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1342 microversion: 2.1 time: 0.262973 Aug 24 10:54:35.581037 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3303/6255] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:35 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1342 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:36.609855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4c431263-c468-4d8e-9af6-7c025accfdca tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:36.612108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4c431263-c468-4d8e-9af6-7c025accfdca tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:36.620266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c431263-c468-4d8e-9af6-7c025accfdca tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:36.620901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c431263-c468-4d8e-9af6-7c025accfdca tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:36.621665 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c431263-c468-4d8e-9af6-7c025accfdca tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:36.622793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c431263-c468-4d8e-9af6-7c025accfdca tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:36.623385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c431263-c468-4d8e-9af6-7c025accfdca tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:36.623903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c431263-c468-4d8e-9af6-7c025accfdca tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:36.801331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4c431263-c468-4d8e-9af6-7c025accfdca tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:36.810997 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4c431263-c468-4d8e-9af6-7c025accfdca tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1342 microversion: 2.1 time: 0.205232 Aug 24 10:54:36.816085 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2953/6256] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:36 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1342 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:36.935373 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-777150ed-c9e8-4d2f-82ad-0ddc5f2d5969 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:54:36.937829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-777150ed-c9e8-4d2f-82ad-0ddc5f2d5969 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:36.945434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-777150ed-c9e8-4d2f-82ad-0ddc5f2d5969 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:36.946444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-777150ed-c9e8-4d2f-82ad-0ddc5f2d5969 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:36.947064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-777150ed-c9e8-4d2f-82ad-0ddc5f2d5969 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:36.947978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-777150ed-c9e8-4d2f-82ad-0ddc5f2d5969 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:36.948612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-777150ed-c9e8-4d2f-82ad-0ddc5f2d5969 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:36.949258 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-777150ed-c9e8-4d2f-82ad-0ddc5f2d5969 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:37.023416 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-777150ed-c9e8-4d2f-82ad-0ddc5f2d5969 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "POST /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4/action" status: 200 len: 24554 microversion: 2.1 time: 0.091938 Aug 24 10:54:37.026325 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3304/6257] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:54:36 2022] POST /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4/action => generated 24554 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:54:37.840368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e5ad4a96-d2e9-4383-b0db-b5621be2acb4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:37.841864 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e5ad4a96-d2e9-4383-b0db-b5621be2acb4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:37.855731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5ad4a96-d2e9-4383-b0db-b5621be2acb4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:37.855731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5ad4a96-d2e9-4383-b0db-b5621be2acb4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:37.856465 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5ad4a96-d2e9-4383-b0db-b5621be2acb4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:37.857455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5ad4a96-d2e9-4383-b0db-b5621be2acb4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:37.858014 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5ad4a96-d2e9-4383-b0db-b5621be2acb4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:37.858535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5ad4a96-d2e9-4383-b0db-b5621be2acb4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:38.011867 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e5ad4a96-d2e9-4383-b0db-b5621be2acb4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:38.026644 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e5ad4a96-d2e9-4383-b0db-b5621be2acb4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1376 microversion: 2.1 time: 0.195741 Aug 24 10:54:38.027442 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2954/6258] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:37 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1376 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:39.051121 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-97e5a985-7ae7-4420-b737-9d78631ac56c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:39.052229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-97e5a985-7ae7-4420-b737-9d78631ac56c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:39.064250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97e5a985-7ae7-4420-b737-9d78631ac56c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:39.064941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97e5a985-7ae7-4420-b737-9d78631ac56c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:39.065666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97e5a985-7ae7-4420-b737-9d78631ac56c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:39.066779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97e5a985-7ae7-4420-b737-9d78631ac56c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:39.067447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97e5a985-7ae7-4420-b737-9d78631ac56c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:39.068064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97e5a985-7ae7-4420-b737-9d78631ac56c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:39.278719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-97e5a985-7ae7-4420-b737-9d78631ac56c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:39.290780 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-97e5a985-7ae7-4420-b737-9d78631ac56c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1376 microversion: 2.1 time: 0.245546 Aug 24 10:54:39.292230 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3305/6259] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:39 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1376 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:40.322082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a968a750-3b1f-4e53-b026-6fa6d5d1c614 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:40.322927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a968a750-3b1f-4e53-b026-6fa6d5d1c614 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:40.332693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a968a750-3b1f-4e53-b026-6fa6d5d1c614 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:40.334046 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a968a750-3b1f-4e53-b026-6fa6d5d1c614 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:40.334688 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a968a750-3b1f-4e53-b026-6fa6d5d1c614 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:40.336516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a968a750-3b1f-4e53-b026-6fa6d5d1c614 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:40.337841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a968a750-3b1f-4e53-b026-6fa6d5d1c614 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:40.338873 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a968a750-3b1f-4e53-b026-6fa6d5d1c614 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:40.344323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=77 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:40.508256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a968a750-3b1f-4e53-b026-6fa6d5d1c614 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:40.518170 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a968a750-3b1f-4e53-b026-6fa6d5d1c614 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1376 microversion: 2.1 time: 0.201724 Aug 24 10:54:40.518925 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2955/6260] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:40 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1376 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:41.540377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ea39e354-1685-4bc4-8c01-59a17851f2ef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:41.541232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ea39e354-1685-4bc4-8c01-59a17851f2ef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:41.549171 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea39e354-1685-4bc4-8c01-59a17851f2ef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:41.549744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea39e354-1685-4bc4-8c01-59a17851f2ef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:41.550264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea39e354-1685-4bc4-8c01-59a17851f2ef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:41.551095 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea39e354-1685-4bc4-8c01-59a17851f2ef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:41.551786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea39e354-1685-4bc4-8c01-59a17851f2ef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:41.552258 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea39e354-1685-4bc4-8c01-59a17851f2ef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:41.709933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ea39e354-1685-4bc4-8c01-59a17851f2ef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:41.719346 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ea39e354-1685-4bc4-8c01-59a17851f2ef tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1376 microversion: 2.1 time: 0.183578 Aug 24 10:54:41.719964 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3306/6261] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:41 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1376 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:42.743593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a608d770-25d8-454a-af5e-91e850603e19 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:42.744969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a608d770-25d8-454a-af5e-91e850603e19 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:42.753067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a608d770-25d8-454a-af5e-91e850603e19 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:42.753660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a608d770-25d8-454a-af5e-91e850603e19 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:42.754080 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a608d770-25d8-454a-af5e-91e850603e19 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:42.755062 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a608d770-25d8-454a-af5e-91e850603e19 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:42.755636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a608d770-25d8-454a-af5e-91e850603e19 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:42.756039 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a608d770-25d8-454a-af5e-91e850603e19 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:42.928711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a608d770-25d8-454a-af5e-91e850603e19 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:42.941016 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a608d770-25d8-454a-af5e-91e850603e19 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1376 microversion: 2.1 time: 0.201690 Aug 24 10:54:42.941703 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2956/6262] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:42 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1376 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:43.964211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ecd3f703-9bc1-4a3a-9792-70b4649e8bb6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:43.964825 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ecd3f703-9bc1-4a3a-9792-70b4649e8bb6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:43.972170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ecd3f703-9bc1-4a3a-9792-70b4649e8bb6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:43.972665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ecd3f703-9bc1-4a3a-9792-70b4649e8bb6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:43.973112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ecd3f703-9bc1-4a3a-9792-70b4649e8bb6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:43.973937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ecd3f703-9bc1-4a3a-9792-70b4649e8bb6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:43.974324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ecd3f703-9bc1-4a3a-9792-70b4649e8bb6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:43.974769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ecd3f703-9bc1-4a3a-9792-70b4649e8bb6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:44.136756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ecd3f703-9bc1-4a3a-9792-70b4649e8bb6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:44.152975 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ecd3f703-9bc1-4a3a-9792-70b4649e8bb6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1376 microversion: 2.1 time: 0.192451 Aug 24 10:54:44.160611 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3307/6263] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:43 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1376 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:45.184147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-68c510b2-8e4a-4c27-be14-23bacde2c15e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:45.184751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-68c510b2-8e4a-4c27-be14-23bacde2c15e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:45.192228 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68c510b2-8e4a-4c27-be14-23bacde2c15e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:45.192737 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68c510b2-8e4a-4c27-be14-23bacde2c15e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:45.193175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68c510b2-8e4a-4c27-be14-23bacde2c15e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:45.194083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68c510b2-8e4a-4c27-be14-23bacde2c15e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:45.194531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68c510b2-8e4a-4c27-be14-23bacde2c15e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:45.194967 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68c510b2-8e4a-4c27-be14-23bacde2c15e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:45.393600 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-68c510b2-8e4a-4c27-be14-23bacde2c15e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:45.403938 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-68c510b2-8e4a-4c27-be14-23bacde2c15e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1376 microversion: 2.1 time: 0.223902 Aug 24 10:54:45.405212 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2957/6264] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:45 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1376 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:46.427467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-57777e98-8839-44f4-8d09-b02455e5a7b0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:46.428117 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-57777e98-8839-44f4-8d09-b02455e5a7b0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:46.437887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57777e98-8839-44f4-8d09-b02455e5a7b0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:46.438595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57777e98-8839-44f4-8d09-b02455e5a7b0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:46.439566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57777e98-8839-44f4-8d09-b02455e5a7b0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:46.440453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57777e98-8839-44f4-8d09-b02455e5a7b0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:46.441082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57777e98-8839-44f4-8d09-b02455e5a7b0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:46.441692 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57777e98-8839-44f4-8d09-b02455e5a7b0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:46.624852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-57777e98-8839-44f4-8d09-b02455e5a7b0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:46.634713 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-57777e98-8839-44f4-8d09-b02455e5a7b0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1376 microversion: 2.1 time: 0.211113 Aug 24 10:54:46.650901 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3308/6265] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:46 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1376 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:47.659170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-76b068a8-4d89-4e11-8d33-d596480168e0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:47.660421 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-76b068a8-4d89-4e11-8d33-d596480168e0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:47.668514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76b068a8-4d89-4e11-8d33-d596480168e0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:47.669069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76b068a8-4d89-4e11-8d33-d596480168e0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:47.669553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76b068a8-4d89-4e11-8d33-d596480168e0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:47.670258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76b068a8-4d89-4e11-8d33-d596480168e0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:47.671041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76b068a8-4d89-4e11-8d33-d596480168e0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:47.671129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76b068a8-4d89-4e11-8d33-d596480168e0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:47.840421 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-76b068a8-4d89-4e11-8d33-d596480168e0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:47.849432 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-76b068a8-4d89-4e11-8d33-d596480168e0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1376 microversion: 2.1 time: 0.197401 Aug 24 10:54:47.865832 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2958/6266] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:47 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1376 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:48.090581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-18939037-c00c-434d-85e0-33d0f4b72664 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:48.095367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-18939037-c00c-434d-85e0-33d0f4b72664 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:48.103820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18939037-c00c-434d-85e0-33d0f4b72664 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:48.104515 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18939037-c00c-434d-85e0-33d0f4b72664 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:48.104901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18939037-c00c-434d-85e0-33d0f4b72664 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:48.105644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18939037-c00c-434d-85e0-33d0f4b72664 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:48.106124 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18939037-c00c-434d-85e0-33d0f4b72664 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:48.106572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18939037-c00c-434d-85e0-33d0f4b72664 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:48.253845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-18939037-c00c-434d-85e0-33d0f4b72664 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:48.262541 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-18939037-c00c-434d-85e0-33d0f4b72664 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1683 microversion: 2.1 time: 0.178685 Aug 24 10:54:48.263137 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3309/6267] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:48 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1683 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:48.388458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0cd18c83-bceb-49c2-9ea9-20010fb98a5c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:54:48.391196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0cd18c83-bceb-49c2-9ea9-20010fb98a5c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:48.397899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cd18c83-bceb-49c2-9ea9-20010fb98a5c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:48.398403 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cd18c83-bceb-49c2-9ea9-20010fb98a5c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:48.398843 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cd18c83-bceb-49c2-9ea9-20010fb98a5c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:48.399597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cd18c83-bceb-49c2-9ea9-20010fb98a5c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:48.400054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cd18c83-bceb-49c2-9ea9-20010fb98a5c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:48.400694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cd18c83-bceb-49c2-9ea9-20010fb98a5c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:48.474638 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0cd18c83-bceb-49c2-9ea9-20010fb98a5c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "POST /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4/action" status: 200 len: 32628 microversion: 2.1 time: 0.090040 Aug 24 10:54:48.484723 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2959/6268] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:54:48 2022] POST /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4/action => generated 32628 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:54:48.559932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-3d28a9b2-b30e-46fc-b2e3-1e3bd3341bdc req-2b8a39d0-b793-4b24-95c7-32bc596bdac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844", "name": "network-vif-plugged", "status": "completed", "tag": "a717148f-3ef9-4b33-b7d5-82ac52cc117c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:54:48.573462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3d28a9b2-b30e-46fc-b2e3-1e3bd3341bdc req-2b8a39d0-b793-4b24-95c7-32bc596bdac3 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:48.574528 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3d28a9b2-b30e-46fc-b2e3-1e3bd3341bdc req-2b8a39d0-b793-4b24-95c7-32bc596bdac3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:48.575575 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3d28a9b2-b30e-46fc-b2e3-1e3bd3341bdc req-2b8a39d0-b793-4b24-95c7-32bc596bdac3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:48.578995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=79 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:48.594917 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-3d28a9b2-b30e-46fc-b2e3-1e3bd3341bdc req-2b8a39d0-b793-4b24-95c7-32bc596bdac3 service nova] Creating event network-vif-plugged:a717148f-3ef9-4b33-b7d5-82ac52cc117c for instance 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 on n-h1-849328-3 Aug 24 10:54:48.602539 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-3d28a9b2-b30e-46fc-b2e3-1e3bd3341bdc req-2b8a39d0-b793-4b24-95c7-32bc596bdac3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046215 Aug 24 10:54:48.603482 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3310/6269] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:54:48.696911 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9c8b7bc9-1509-4750-a8fc-5ecbc843d2f5 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:48.696911 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9c8b7bc9-1509-4750-a8fc-5ecbc843d2f5 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:48.711822 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c8b7bc9-1509-4750-a8fc-5ecbc843d2f5 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:48.712283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c8b7bc9-1509-4750-a8fc-5ecbc843d2f5 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:48.713218 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c8b7bc9-1509-4750-a8fc-5ecbc843d2f5 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:48.713924 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c8b7bc9-1509-4750-a8fc-5ecbc843d2f5 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:48.714533 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c8b7bc9-1509-4750-a8fc-5ecbc843d2f5 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:48.714977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c8b7bc9-1509-4750-a8fc-5ecbc843d2f5 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:48.874057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cbe13f2b-2113-400b-8ab0-06a02845d806 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:48.874897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cbe13f2b-2113-400b-8ab0-06a02845d806 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:48.892389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbe13f2b-2113-400b-8ab0-06a02845d806 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:48.894096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbe13f2b-2113-400b-8ab0-06a02845d806 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:48.894835 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbe13f2b-2113-400b-8ab0-06a02845d806 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:48.896424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbe13f2b-2113-400b-8ab0-06a02845d806 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:48.898144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbe13f2b-2113-400b-8ab0-06a02845d806 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:48.902865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbe13f2b-2113-400b-8ab0-06a02845d806 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:48.953720 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9c8b7bc9-1509-4750-a8fc-5ecbc843d2f5 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1834 microversion: 2.1 time: 0.267701 Aug 24 10:54:48.965162 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2960/6270] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:48 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1834 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:48.985398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7521a248-69b6-40e3-8eb7-2728dbcd24a3 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:54:48.988011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7521a248-69b6-40e3-8eb7-2728dbcd24a3 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:49.002933 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7521a248-69b6-40e3-8eb7-2728dbcd24a3 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:49.003372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7521a248-69b6-40e3-8eb7-2728dbcd24a3 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:49.003846 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7521a248-69b6-40e3-8eb7-2728dbcd24a3 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:49.004619 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7521a248-69b6-40e3-8eb7-2728dbcd24a3 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:49.005101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7521a248-69b6-40e3-8eb7-2728dbcd24a3 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:49.005569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7521a248-69b6-40e3-8eb7-2728dbcd24a3 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:49.038109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-7521a248-69b6-40e3-8eb7-2728dbcd24a3 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lazy-loading 'flavor' on Instance uuid 2f71f034-8a70-4049-8987-f32b3a2626b4 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:54:49.052046 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7521a248-69b6-40e3-8eb7-2728dbcd24a3 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Going to try to live migrate instance to another host {{(pid=122432) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 10:54:49.118897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cbe13f2b-2113-400b-8ab0-06a02845d806 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:49.137860 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cbe13f2b-2113-400b-8ab0-06a02845d806 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1376 microversion: 2.1 time: 0.269774 Aug 24 10:54:49.139592 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3311/6271] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:48 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1376 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:54:50.163999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4d1fa6e7-19b3-430b-954c-e7e27601a9dd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:50.164985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4d1fa6e7-19b3-430b-954c-e7e27601a9dd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:50.175704 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d1fa6e7-19b3-430b-954c-e7e27601a9dd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:50.176805 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d1fa6e7-19b3-430b-954c-e7e27601a9dd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:50.177760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d1fa6e7-19b3-430b-954c-e7e27601a9dd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:50.179684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d1fa6e7-19b3-430b-954c-e7e27601a9dd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:50.179684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d1fa6e7-19b3-430b-954c-e7e27601a9dd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:50.180682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d1fa6e7-19b3-430b-954c-e7e27601a9dd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:50.404377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4d1fa6e7-19b3-430b-954c-e7e27601a9dd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:50.416169 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4d1fa6e7-19b3-430b-954c-e7e27601a9dd tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1564 microversion: 2.1 time: 0.256321 Aug 24 10:54:50.429758 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3312/6272] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:50 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1564 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:50.442119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2df15a1c-6050-4303-986c-2bde53862707 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:50.445208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2df15a1c-6050-4303-986c-2bde53862707 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:50.453933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2df15a1c-6050-4303-986c-2bde53862707 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:50.454988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2df15a1c-6050-4303-986c-2bde53862707 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:50.455708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2df15a1c-6050-4303-986c-2bde53862707 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:50.456924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2df15a1c-6050-4303-986c-2bde53862707 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:50.457851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2df15a1c-6050-4303-986c-2bde53862707 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:50.458451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2df15a1c-6050-4303-986c-2bde53862707 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:50.714320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2df15a1c-6050-4303-986c-2bde53862707 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:50.724378 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2df15a1c-6050-4303-986c-2bde53862707 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1564 microversion: 2.1 time: 0.287321 Aug 24 10:54:50.725667 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3313/6273] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:50 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1564 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:50.836474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-706a7c2a-87f2-427b-aa20-bf938d633e3d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:50.837310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-706a7c2a-87f2-427b-aa20-bf938d633e3d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:50.847646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-706a7c2a-87f2-427b-aa20-bf938d633e3d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:50.848167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-706a7c2a-87f2-427b-aa20-bf938d633e3d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:50.848642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-706a7c2a-87f2-427b-aa20-bf938d633e3d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:50.849836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-706a7c2a-87f2-427b-aa20-bf938d633e3d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:50.851429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-706a7c2a-87f2-427b-aa20-bf938d633e3d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:50.853597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-706a7c2a-87f2-427b-aa20-bf938d633e3d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:50.898112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-706a7c2a-87f2-427b-aa20-bf938d633e3d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:54:50.939867 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7521a248-69b6-40e3-8eb7-2728dbcd24a3 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4/action" status: 202 len: 0 microversion: 2.1 time: 1.958509 Aug 24 10:54:50.941671 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2961/6274] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:54:48 2022] POST /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4/action => generated 0 bytes in 1961 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 10:54:50.951473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-34fb0bc8-42df-442e-99fc-0dcd423904f1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:50.953008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-34fb0bc8-42df-442e-99fc-0dcd423904f1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:50.973094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34fb0bc8-42df-442e-99fc-0dcd423904f1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:50.973648 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34fb0bc8-42df-442e-99fc-0dcd423904f1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:50.974501 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34fb0bc8-42df-442e-99fc-0dcd423904f1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:50.975263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34fb0bc8-42df-442e-99fc-0dcd423904f1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:50.975731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34fb0bc8-42df-442e-99fc-0dcd423904f1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:50.976165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34fb0bc8-42df-442e-99fc-0dcd423904f1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:51.041630 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-706a7c2a-87f2-427b-aa20-bf938d633e3d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "DELETE /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 204 len: 0 microversion: 2.1 time: 0.209862 Aug 24 10:54:51.043162 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3314/6275] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:54:50 2022] DELETE /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:54:51.052537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a9f6d65a-9ee2-4c30-9e61-d1873ee66448 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:51.053369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a9f6d65a-9ee2-4c30-9e61-d1873ee66448 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:51.061474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9f6d65a-9ee2-4c30-9e61-d1873ee66448 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:51.063252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9f6d65a-9ee2-4c30-9e61-d1873ee66448 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:51.063778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9f6d65a-9ee2-4c30-9e61-d1873ee66448 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:51.064774 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9f6d65a-9ee2-4c30-9e61-d1873ee66448 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:51.065345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9f6d65a-9ee2-4c30-9e61-d1873ee66448 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:51.065789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9f6d65a-9ee2-4c30-9e61-d1873ee66448 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:51.170969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-34fb0bc8-42df-442e-99fc-0dcd423904f1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:51.180703 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-34fb0bc8-42df-442e-99fc-0dcd423904f1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1693 microversion: 2.1 time: 0.234488 Aug 24 10:54:51.181458 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2962/6276] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:50 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1693 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:54:51.248905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a9f6d65a-9ee2-4c30-9e61-d1873ee66448 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:51.260752 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a9f6d65a-9ee2-4c30-9e61-d1873ee66448 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1570 microversion: 2.1 time: 0.212906 Aug 24 10:54:51.261606 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3315/6277] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:51 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1570 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:52.204206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c63fd886-3628-49d5-be74-52cc1c42e2a1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:52.205303 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c63fd886-3628-49d5-be74-52cc1c42e2a1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:52.214125 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c63fd886-3628-49d5-be74-52cc1c42e2a1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:52.214758 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c63fd886-3628-49d5-be74-52cc1c42e2a1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:52.215435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c63fd886-3628-49d5-be74-52cc1c42e2a1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:52.216402 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c63fd886-3628-49d5-be74-52cc1c42e2a1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:52.217112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c63fd886-3628-49d5-be74-52cc1c42e2a1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:52.217764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c63fd886-3628-49d5-be74-52cc1c42e2a1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:52.286312 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-92b6a735-a4db-4004-a219-1281c0adea95 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:52.288014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-92b6a735-a4db-4004-a219-1281c0adea95 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:52.305102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92b6a735-a4db-4004-a219-1281c0adea95 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:52.305741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92b6a735-a4db-4004-a219-1281c0adea95 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:52.306287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92b6a735-a4db-4004-a219-1281c0adea95 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:52.307167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92b6a735-a4db-4004-a219-1281c0adea95 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:52.307874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92b6a735-a4db-4004-a219-1281c0adea95 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:52.308388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92b6a735-a4db-4004-a219-1281c0adea95 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:52.386403 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c63fd886-3628-49d5-be74-52cc1c42e2a1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:52.404874 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c63fd886-3628-49d5-be74-52cc1c42e2a1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1693 microversion: 2.1 time: 0.205386 Aug 24 10:54:52.405978 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2963/6278] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:52 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1693 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:52.575977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-92b6a735-a4db-4004-a219-1281c0adea95 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:52.590847 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-92b6a735-a4db-4004-a219-1281c0adea95 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1570 microversion: 2.1 time: 0.310586 Aug 24 10:54:52.591547 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3316/6279] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:52 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1570 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:54:53.439477 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-30373187-3f29-413c-ba86-fdd7594494e7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:53.441699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-30373187-3f29-413c-ba86-fdd7594494e7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:53.462777 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30373187-3f29-413c-ba86-fdd7594494e7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:53.463718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30373187-3f29-413c-ba86-fdd7594494e7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:53.464543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30373187-3f29-413c-ba86-fdd7594494e7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:53.467704 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30373187-3f29-413c-ba86-fdd7594494e7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:53.468387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30373187-3f29-413c-ba86-fdd7594494e7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:53.468998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30373187-3f29-413c-ba86-fdd7594494e7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:53.617768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-96a2b775-fc30-45d8-b30d-6a15945a2e89 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:53.619349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-96a2b775-fc30-45d8-b30d-6a15945a2e89 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:53.633648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96a2b775-fc30-45d8-b30d-6a15945a2e89 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:53.634281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96a2b775-fc30-45d8-b30d-6a15945a2e89 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:53.634785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96a2b775-fc30-45d8-b30d-6a15945a2e89 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:53.635592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96a2b775-fc30-45d8-b30d-6a15945a2e89 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:53.636266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96a2b775-fc30-45d8-b30d-6a15945a2e89 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:53.640193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96a2b775-fc30-45d8-b30d-6a15945a2e89 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:53.778372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-30373187-3f29-413c-ba86-fdd7594494e7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:53.827705 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-30373187-3f29-413c-ba86-fdd7594494e7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1693 microversion: 2.1 time: 0.397243 Aug 24 10:54:53.858017 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2964/6280] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:53 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1693 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:53.919473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-96a2b775-fc30-45d8-b30d-6a15945a2e89 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:53.929596 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-96a2b775-fc30-45d8-b30d-6a15945a2e89 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1570 microversion: 2.1 time: 0.319069 Aug 24 10:54:53.934087 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3317/6281] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:53 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1570 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:54:54.333329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-15ad2974-f8e3-4bda-91fd-a1eeb5a00291 req-312d330b-7d13-4d00-a423-977f82c4af0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844", "name": "network-vif-deleted", "tag": "a717148f-3ef9-4b33-b7d5-82ac52cc117c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:54:54.373082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-15ad2974-f8e3-4bda-91fd-a1eeb5a00291 req-312d330b-7d13-4d00-a423-977f82c4af0f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:54.374719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-15ad2974-f8e3-4bda-91fd-a1eeb5a00291 req-312d330b-7d13-4d00-a423-977f82c4af0f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:54.377809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-15ad2974-f8e3-4bda-91fd-a1eeb5a00291 req-312d330b-7d13-4d00-a423-977f82c4af0f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:54.436323 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-15ad2974-f8e3-4bda-91fd-a1eeb5a00291 req-312d330b-7d13-4d00-a423-977f82c4af0f service nova] Creating event network-vif-deleted:a717148f-3ef9-4b33-b7d5-82ac52cc117c for instance 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 on n-h1-849328-3 Aug 24 10:54:54.456807 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-15ad2974-f8e3-4bda-91fd-a1eeb5a00291 req-312d330b-7d13-4d00-a423-977f82c4af0f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125550 Aug 24 10:54:54.460310 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2965/6282] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:54:54.867564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b3657eaf-be97-488d-aa3b-c5e751a7793d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:54.868242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b3657eaf-be97-488d-aa3b-c5e751a7793d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:54.879113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3657eaf-be97-488d-aa3b-c5e751a7793d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:54.879599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3657eaf-be97-488d-aa3b-c5e751a7793d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:54.880059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3657eaf-be97-488d-aa3b-c5e751a7793d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:54.880835 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3657eaf-be97-488d-aa3b-c5e751a7793d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:54.881364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3657eaf-be97-488d-aa3b-c5e751a7793d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:54.881816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3657eaf-be97-488d-aa3b-c5e751a7793d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:54.958957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8fb6f155-9fb8-403f-b5b4-618b6c043bab tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:54.960253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8fb6f155-9fb8-403f-b5b4-618b6c043bab tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:54.987526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fb6f155-9fb8-403f-b5b4-618b6c043bab tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:54.988285 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fb6f155-9fb8-403f-b5b4-618b6c043bab tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:54.990104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fb6f155-9fb8-403f-b5b4-618b6c043bab tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:54.991865 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fb6f155-9fb8-403f-b5b4-618b6c043bab tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:54.993956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fb6f155-9fb8-403f-b5b4-618b6c043bab tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:54.994569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fb6f155-9fb8-403f-b5b4-618b6c043bab tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:55.132708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b3657eaf-be97-488d-aa3b-c5e751a7793d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:55.143233 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b3657eaf-be97-488d-aa3b-c5e751a7793d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1693 microversion: 2.1 time: 0.278935 Aug 24 10:54:55.144365 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3318/6283] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:54 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1693 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:55.174450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8fb6f155-9fb8-403f-b5b4-618b6c043bab tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:55.190060 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8fb6f155-9fb8-403f-b5b4-618b6c043bab tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1361 microversion: 2.1 time: 0.235234 Aug 24 10:54:55.193147 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2966/6284] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:54 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1361 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:54:56.173259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1afa37c8-baf7-4197-a944-713ff6a14dea tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:56.174532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1afa37c8-baf7-4197-a944-713ff6a14dea tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:56.178013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:56.186930 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1afa37c8-baf7-4197-a944-713ff6a14dea tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:56.187703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1afa37c8-baf7-4197-a944-713ff6a14dea tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:56.188324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1afa37c8-baf7-4197-a944-713ff6a14dea tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:56.189885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1afa37c8-baf7-4197-a944-713ff6a14dea tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:56.190550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1afa37c8-baf7-4197-a944-713ff6a14dea tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:56.191396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1afa37c8-baf7-4197-a944-713ff6a14dea tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:56.220572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2730aed0-b492-4598-be1b-8450960d2f7b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:56.222199 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2730aed0-b492-4598-be1b-8450960d2f7b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:56.233697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2730aed0-b492-4598-be1b-8450960d2f7b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:56.234602 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2730aed0-b492-4598-be1b-8450960d2f7b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:56.235268 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2730aed0-b492-4598-be1b-8450960d2f7b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:56.236253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2730aed0-b492-4598-be1b-8450960d2f7b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:56.237756 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2730aed0-b492-4598-be1b-8450960d2f7b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:56.238468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2730aed0-b492-4598-be1b-8450960d2f7b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:56.381593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2730aed0-b492-4598-be1b-8450960d2f7b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:56.414171 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2730aed0-b492-4598-be1b-8450960d2f7b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1361 microversion: 2.1 time: 0.201462 Aug 24 10:54:56.418206 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2967/6285] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:56 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1361 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:54:56.445722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1afa37c8-baf7-4197-a944-713ff6a14dea tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:56.455465 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1afa37c8-baf7-4197-a944-713ff6a14dea tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1693 microversion: 2.1 time: 0.286991 Aug 24 10:54:56.456908 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3319/6286] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:56 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1693 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:56.497436 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-abee4f65-5fc9-4fd8-a62d-e812a72eb4fe req-74c68e3f-2941-4778-b875-a5ff935cae77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f71f034-8a70-4049-8987-f32b3a2626b4", "name": "network-vif-unplugged", "status": "completed", "tag": "a00c703f-fe1f-49fe-baa8-f5e6c0363285"}, {"name": "network-changed", "server_uuid": "2f71f034-8a70-4049-8987-f32b3a2626b4", "tag": "a00c703f-fe1f-49fe-baa8-f5e6c0363285"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:54:56.508764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-abee4f65-5fc9-4fd8-a62d-e812a72eb4fe req-74c68e3f-2941-4778-b875-a5ff935cae77 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:56.509579 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-abee4f65-5fc9-4fd8-a62d-e812a72eb4fe req-74c68e3f-2941-4778-b875-a5ff935cae77 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:56.510224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-abee4f65-5fc9-4fd8-a62d-e812a72eb4fe req-74c68e3f-2941-4778-b875-a5ff935cae77 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:56.524513 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-abee4f65-5fc9-4fd8-a62d-e812a72eb4fe req-74c68e3f-2941-4778-b875-a5ff935cae77 service nova] Creating event network-vif-unplugged:a00c703f-fe1f-49fe-baa8-f5e6c0363285 for instance 2f71f034-8a70-4049-8987-f32b3a2626b4 on n-h2-849328-3 Aug 24 10:54:56.525413 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-abee4f65-5fc9-4fd8-a62d-e812a72eb4fe req-74c68e3f-2941-4778-b875-a5ff935cae77 service nova] Creating event network-changed:a00c703f-fe1f-49fe-baa8-f5e6c0363285 for instance 2f71f034-8a70-4049-8987-f32b3a2626b4 on n-h2-849328-3 Aug 24 10:54:56.533184 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-abee4f65-5fc9-4fd8-a62d-e812a72eb4fe req-74c68e3f-2941-4778-b875-a5ff935cae77 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.039650 Aug 24 10:54:56.535279 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2968/6287] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:54:57.441774 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-22d3d8d1-fde2-4993-abb8-32dbef0bee47 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:57.443285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-22d3d8d1-fde2-4993-abb8-32dbef0bee47 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:57.451962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22d3d8d1-fde2-4993-abb8-32dbef0bee47 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:57.452882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22d3d8d1-fde2-4993-abb8-32dbef0bee47 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:57.453610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22d3d8d1-fde2-4993-abb8-32dbef0bee47 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:57.454625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22d3d8d1-fde2-4993-abb8-32dbef0bee47 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:57.455356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22d3d8d1-fde2-4993-abb8-32dbef0bee47 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:57.456019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22d3d8d1-fde2-4993-abb8-32dbef0bee47 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:57.485026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b02fbec3-7685-4622-a974-64596392349d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:57.486479 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b02fbec3-7685-4622-a974-64596392349d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:57.501157 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b02fbec3-7685-4622-a974-64596392349d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:57.504858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b02fbec3-7685-4622-a974-64596392349d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:57.505671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b02fbec3-7685-4622-a974-64596392349d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:57.506658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b02fbec3-7685-4622-a974-64596392349d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:57.508494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b02fbec3-7685-4622-a974-64596392349d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:57.510062 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b02fbec3-7685-4622-a974-64596392349d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:57.579363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-22d3d8d1-fde2-4993-abb8-32dbef0bee47 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:57.590335 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-22d3d8d1-fde2-4993-abb8-32dbef0bee47 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1361 microversion: 2.1 time: 0.152337 Aug 24 10:54:57.592212 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3320/6288] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:57 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:57.722274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b02fbec3-7685-4622-a974-64596392349d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:57.731489 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b02fbec3-7685-4622-a974-64596392349d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1693 microversion: 2.1 time: 0.252872 Aug 24 10:54:57.732600 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2969/6289] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:57 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1693 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:58.613918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d7221c19-5a32-4f67-9ac0-59d40ff517b6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:58.615123 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d7221c19-5a32-4f67-9ac0-59d40ff517b6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:58.622844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7221c19-5a32-4f67-9ac0-59d40ff517b6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:58.623603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7221c19-5a32-4f67-9ac0-59d40ff517b6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:58.624243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7221c19-5a32-4f67-9ac0-59d40ff517b6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:58.624955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7221c19-5a32-4f67-9ac0-59d40ff517b6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:58.625675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7221c19-5a32-4f67-9ac0-59d40ff517b6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:58.626269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7221c19-5a32-4f67-9ac0-59d40ff517b6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:58.706526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d7221c19-5a32-4f67-9ac0-59d40ff517b6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:58.719081 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d7221c19-5a32-4f67-9ac0-59d40ff517b6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1361 microversion: 2.1 time: 0.109123 Aug 24 10:54:58.720261 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3321/6290] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:58 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1361 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:58.754375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e2c71cc4-3051-4cc3-bbd3-edb41503e947 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:58.755167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e2c71cc4-3051-4cc3-bbd3-edb41503e947 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:58.765167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2c71cc4-3051-4cc3-bbd3-edb41503e947 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:58.766179 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2c71cc4-3051-4cc3-bbd3-edb41503e947 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:58.766956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2c71cc4-3051-4cc3-bbd3-edb41503e947 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:58.768084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2c71cc4-3051-4cc3-bbd3-edb41503e947 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:58.768654 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2c71cc4-3051-4cc3-bbd3-edb41503e947 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:58.769420 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2c71cc4-3051-4cc3-bbd3-edb41503e947 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:59.078543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e2c71cc4-3051-4cc3-bbd3-edb41503e947 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:59.102568 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e2c71cc4-3051-4cc3-bbd3-edb41503e947 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1693 microversion: 2.1 time: 0.348732 Aug 24 10:54:59.107894 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2970/6291] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:58 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1693 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:54:59.739966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-76f4e5cc-a0bd-42ea-998f-ed900ee4b9f8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:54:59.741557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-76f4e5cc-a0bd-42ea-998f-ed900ee4b9f8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:54:59.749548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76f4e5cc-a0bd-42ea-998f-ed900ee4b9f8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:59.759817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76f4e5cc-a0bd-42ea-998f-ed900ee4b9f8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:59.760640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76f4e5cc-a0bd-42ea-998f-ed900ee4b9f8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:59.762940 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76f4e5cc-a0bd-42ea-998f-ed900ee4b9f8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:54:59.763502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76f4e5cc-a0bd-42ea-998f-ed900ee4b9f8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:54:59.764026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76f4e5cc-a0bd-42ea-998f-ed900ee4b9f8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:54:59.851481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-76f4e5cc-a0bd-42ea-998f-ed900ee4b9f8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:54:59.859699 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-76f4e5cc-a0bd-42ea-998f-ed900ee4b9f8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1361 microversion: 2.1 time: 0.123625 Aug 24 10:54:59.860314 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3322/6292] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:54:59 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1361 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:00.145267 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8959a417-9c2d-4838-8b22-17bc169d6207 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:00.146176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8959a417-9c2d-4838-8b22-17bc169d6207 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:00.162597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=44 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:00.164961 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8959a417-9c2d-4838-8b22-17bc169d6207 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:00.165751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8959a417-9c2d-4838-8b22-17bc169d6207 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:00.166413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8959a417-9c2d-4838-8b22-17bc169d6207 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:00.167335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8959a417-9c2d-4838-8b22-17bc169d6207 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:00.167987 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8959a417-9c2d-4838-8b22-17bc169d6207 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:00.168616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8959a417-9c2d-4838-8b22-17bc169d6207 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:00.347748 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8959a417-9c2d-4838-8b22-17bc169d6207 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:00.350906 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:00.364086 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8959a417-9c2d-4838-8b22-17bc169d6207 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1693 microversion: 2.1 time: 0.236327 Aug 24 10:55:00.364907 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2971/6293] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:00 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1693 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:00.881228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1cc27cdc-b90e-4361-9112-356ed3edf755 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:00.882537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1cc27cdc-b90e-4361-9112-356ed3edf755 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:00.898190 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cc27cdc-b90e-4361-9112-356ed3edf755 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:00.899149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cc27cdc-b90e-4361-9112-356ed3edf755 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:00.900029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cc27cdc-b90e-4361-9112-356ed3edf755 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:00.901691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cc27cdc-b90e-4361-9112-356ed3edf755 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:00.903336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cc27cdc-b90e-4361-9112-356ed3edf755 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:00.904494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cc27cdc-b90e-4361-9112-356ed3edf755 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:00.970999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cc27cdc-b90e-4361-9112-356ed3edf755 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:00.971503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cc27cdc-b90e-4361-9112-356ed3edf755 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:00.972149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cc27cdc-b90e-4361-9112-356ed3edf755 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:00.979447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-1cc27cdc-b90e-4361-9112-356ed3edf755 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lazy-loading 'fault' on Instance uuid 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:55:01.050773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1cc27cdc-b90e-4361-9112-356ed3edf755 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:01.061316 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1cc27cdc-b90e-4361-9112-356ed3edf755 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 200 len: 1366 microversion: 2.1 time: 0.185033 Aug 24 10:55:01.069282 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3323/6294] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:00 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:01.386221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e6a7d64a-e5e4-4c1a-819b-5519f76f45bd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:01.386992 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e6a7d64a-e5e4-4c1a-819b-5519f76f45bd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:01.400572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6a7d64a-e5e4-4c1a-819b-5519f76f45bd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:01.403457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6a7d64a-e5e4-4c1a-819b-5519f76f45bd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:01.404115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6a7d64a-e5e4-4c1a-819b-5519f76f45bd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:01.404841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6a7d64a-e5e4-4c1a-819b-5519f76f45bd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:01.405318 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6a7d64a-e5e4-4c1a-819b-5519f76f45bd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:01.409195 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6a7d64a-e5e4-4c1a-819b-5519f76f45bd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:01.706014 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e6a7d64a-e5e4-4c1a-819b-5519f76f45bd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:01.715624 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e6a7d64a-e5e4-4c1a-819b-5519f76f45bd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1693 microversion: 2.1 time: 0.333607 Aug 24 10:55:01.717176 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2972/6295] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:01 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1693 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:02.083933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d0c2b9c1-3494-4eff-9ce5-5cdc4b430efa tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:02.084566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d0c2b9c1-3494-4eff-9ce5-5cdc4b430efa tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:02.100534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0c2b9c1-3494-4eff-9ce5-5cdc4b430efa tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:02.104294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0c2b9c1-3494-4eff-9ce5-5cdc4b430efa tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:02.104759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0c2b9c1-3494-4eff-9ce5-5cdc4b430efa tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:02.105533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0c2b9c1-3494-4eff-9ce5-5cdc4b430efa tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:02.106200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0c2b9c1-3494-4eff-9ce5-5cdc4b430efa tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:02.107956 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0c2b9c1-3494-4eff-9ce5-5cdc4b430efa tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:02.134533 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-d0c2b9c1-3494-4eff-9ce5-5cdc4b430efa tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] HTTP exception thrown: Instance 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 could not be found. Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d0c2b9c1-3494-4eff-9ce5-5cdc4b430efa tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Request method failure captured: Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 HTTP/1.1 Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgJaL-kWwlcIRB5LGdxUOg9NstdlrO4InCZtaIlL6zMAKoO2x9AaKw5QTM5Yc447Qz9dKY7jxkolr7Q3liCCaPxpGdqV4sv_A4_Emu-qJmA0z5hB1ngNyBGm9n-W2LyGX7LaKy8OE29M25iXwnWnUlWVb7vPgN3qX9b_bYxZIyExFQ4 Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d1785d661bbd41619a7046600ad435b1", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d1785d661bbd41619a7046600ad435b1"}]}] Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestVolumeBootPattern-1780678770-project Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 26b7ff61eab4477890d20977574e8dac Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestVolumeBootPattern-1780678770-project Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 could not be found. Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844'} Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 could not be found. Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 could not be found. Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:55:02.138050 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:55:02.143013 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:55:02.143013 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:55:02.143013 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:55:02.143013 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:55:02.143013 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:55:02.143013 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 could not be found. Aug 24 10:55:02.143013 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:55:02.143013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d0c2b9c1-3494-4eff-9ce5-5cdc4b430efa tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Returning 404 to user: Instance 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:55:02.143689 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d0c2b9c1-3494-4eff-9ce5-5cdc4b430efa tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 404 len: 111 microversion: 2.1 time: 0.062553 Aug 24 10:55:02.144655 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3324/6296] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:02 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:55:02.739892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9e1c35c7-f4a9-4d6d-ab9f-28e2e6d37821 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:02.740615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9e1c35c7-f4a9-4d6d-ab9f-28e2e6d37821 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:02.748480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e1c35c7-f4a9-4d6d-ab9f-28e2e6d37821 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:02.748971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e1c35c7-f4a9-4d6d-ab9f-28e2e6d37821 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:02.749454 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e1c35c7-f4a9-4d6d-ab9f-28e2e6d37821 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:02.750168 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e1c35c7-f4a9-4d6d-ab9f-28e2e6d37821 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:02.750621 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e1c35c7-f4a9-4d6d-ab9f-28e2e6d37821 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:02.751224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e1c35c7-f4a9-4d6d-ab9f-28e2e6d37821 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:03.031923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9e1c35c7-f4a9-4d6d-ab9f-28e2e6d37821 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:03.045663 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9e1c35c7-f4a9-4d6d-ab9f-28e2e6d37821 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1693 microversion: 2.1 time: 0.304281 Aug 24 10:55:03.046745 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2973/6297] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:02 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1693 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:55:04.068945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a90ed018-09d3-4966-a973-eeebbe5f2bd0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:04.071941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a90ed018-09d3-4966-a973-eeebbe5f2bd0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:04.084784 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a90ed018-09d3-4966-a973-eeebbe5f2bd0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:04.086608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a90ed018-09d3-4966-a973-eeebbe5f2bd0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:04.087252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a90ed018-09d3-4966-a973-eeebbe5f2bd0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:04.088184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a90ed018-09d3-4966-a973-eeebbe5f2bd0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:04.090369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a90ed018-09d3-4966-a973-eeebbe5f2bd0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:04.091592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a90ed018-09d3-4966-a973-eeebbe5f2bd0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:04.280293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a90ed018-09d3-4966-a973-eeebbe5f2bd0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:04.291285 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a90ed018-09d3-4966-a973-eeebbe5f2bd0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1683 microversion: 2.1 time: 0.227710 Aug 24 10:55:04.292134 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3325/6298] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:04 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1683 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:04.316471 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-50c99440-bd57-4473-9a28-48e813719f95 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:04.318096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-50c99440-bd57-4473-9a28-48e813719f95 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:04.330581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50c99440-bd57-4473-9a28-48e813719f95 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:04.331530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50c99440-bd57-4473-9a28-48e813719f95 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:04.335865 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50c99440-bd57-4473-9a28-48e813719f95 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:04.337166 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50c99440-bd57-4473-9a28-48e813719f95 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:04.337987 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50c99440-bd57-4473-9a28-48e813719f95 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:04.338590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50c99440-bd57-4473-9a28-48e813719f95 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:04.607704 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-50c99440-bd57-4473-9a28-48e813719f95 tempest-TestNetworkAdvancedServerOps-1862550466 tempest-TestNetworkAdvancedServerOps-1862550466-project-admin] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1834 microversion: 2.1 time: 0.296370 Aug 24 10:55:04.609311 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2974/6299] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:04 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1834 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:04.636667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cdc61a36-b199-481d-89cd-23aa180aa9ec tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:04.637593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cdc61a36-b199-481d-89cd-23aa180aa9ec tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:04.647646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdc61a36-b199-481d-89cd-23aa180aa9ec tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:04.648618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdc61a36-b199-481d-89cd-23aa180aa9ec tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:04.649325 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdc61a36-b199-481d-89cd-23aa180aa9ec tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:04.650262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdc61a36-b199-481d-89cd-23aa180aa9ec tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:04.650890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdc61a36-b199-481d-89cd-23aa180aa9ec tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:04.651636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdc61a36-b199-481d-89cd-23aa180aa9ec tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:04.656793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:04.862472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cdc61a36-b199-481d-89cd-23aa180aa9ec tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:04.873589 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cdc61a36-b199-481d-89cd-23aa180aa9ec tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1683 microversion: 2.1 time: 0.245196 Aug 24 10:55:04.875274 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3326/6300] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:04 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1683 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:06.563684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad9c9784-2613-4066-8b1a-5b202f7f58d8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:06.564278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ad9c9784-2613-4066-8b1a-5b202f7f58d8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:06.572062 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad9c9784-2613-4066-8b1a-5b202f7f58d8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:06.572644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad9c9784-2613-4066-8b1a-5b202f7f58d8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:06.573216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad9c9784-2613-4066-8b1a-5b202f7f58d8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:06.573979 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad9c9784-2613-4066-8b1a-5b202f7f58d8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:06.574679 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad9c9784-2613-4066-8b1a-5b202f7f58d8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:06.575163 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad9c9784-2613-4066-8b1a-5b202f7f58d8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:06.605845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ad9c9784-2613-4066-8b1a-5b202f7f58d8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:55:06.689624 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ad9c9784-2613-4066-8b1a-5b202f7f58d8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "DELETE /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 204 len: 0 microversion: 2.1 time: 0.129825 Aug 24 10:55:06.690353 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2975/6301] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:55:06 2022] DELETE /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:55:06.698965 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8e95fa7a-5fdb-4310-b082-1ba6fed5721b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:06.699598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8e95fa7a-5fdb-4310-b082-1ba6fed5721b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:06.707253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e95fa7a-5fdb-4310-b082-1ba6fed5721b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:06.708276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e95fa7a-5fdb-4310-b082-1ba6fed5721b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:06.708871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e95fa7a-5fdb-4310-b082-1ba6fed5721b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:06.709736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e95fa7a-5fdb-4310-b082-1ba6fed5721b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:06.710296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e95fa7a-5fdb-4310-b082-1ba6fed5721b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:06.711650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e95fa7a-5fdb-4310-b082-1ba6fed5721b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:06.867018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8e95fa7a-5fdb-4310-b082-1ba6fed5721b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:06.875539 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8e95fa7a-5fdb-4310-b082-1ba6fed5721b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1409 microversion: 2.1 time: 0.180509 Aug 24 10:55:06.876433 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3327/6302] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:06 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1409 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:07.049208 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-99400037-ce7e-48ba-b321-88e4fba4a87e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:55:07.052395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-99400037-ce7e-48ba-b321-88e4fba4a87e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:07.063103 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99400037-ce7e-48ba-b321-88e4fba4a87e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:07.064392 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99400037-ce7e-48ba-b321-88e4fba4a87e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:07.065365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99400037-ce7e-48ba-b321-88e4fba4a87e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:07.066842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99400037-ce7e-48ba-b321-88e4fba4a87e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:07.067459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99400037-ce7e-48ba-b321-88e4fba4a87e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:07.068068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99400037-ce7e-48ba-b321-88e4fba4a87e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:07.768790 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-99400037-ce7e-48ba-b321-88e4fba4a87e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "POST /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4/action" status: 200 len: 38612 microversion: 2.1 time: 0.723322 Aug 24 10:55:07.769963 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2976/6303] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:55:07 2022] POST /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4/action => generated 38612 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:55:07.896220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7f041631-98a0-4b08-a9b1-5f46b702d567 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:07.897385 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7f041631-98a0-4b08-a9b1-5f46b702d567 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:07.905140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f041631-98a0-4b08-a9b1-5f46b702d567 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:07.905654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f041631-98a0-4b08-a9b1-5f46b702d567 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:07.906098 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f041631-98a0-4b08-a9b1-5f46b702d567 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:07.906859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f041631-98a0-4b08-a9b1-5f46b702d567 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:07.907324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f041631-98a0-4b08-a9b1-5f46b702d567 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:07.907757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f041631-98a0-4b08-a9b1-5f46b702d567 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:08.160740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7f041631-98a0-4b08-a9b1-5f46b702d567 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:08.173182 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7f041631-98a0-4b08-a9b1-5f46b702d567 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1409 microversion: 2.1 time: 0.280886 Aug 24 10:55:08.174263 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3328/6304] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:07 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1409 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:08.936122 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-1c3c8e12-73b9-4c9c-9860-8becc04db710 req-159bd586-dfdd-47a6-96bb-7890d9a660ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bda76a1-cfeb-49da-84de-4792a08ce846", "name": "network-vif-deleted", "tag": "13cff44a-2b36-403d-93d9-2b389e9a8491"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:55:08.956215 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1c3c8e12-73b9-4c9c-9860-8becc04db710 req-159bd586-dfdd-47a6-96bb-7890d9a660ee service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:08.956910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1c3c8e12-73b9-4c9c-9860-8becc04db710 req-159bd586-dfdd-47a6-96bb-7890d9a660ee service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:08.957635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1c3c8e12-73b9-4c9c-9860-8becc04db710 req-159bd586-dfdd-47a6-96bb-7890d9a660ee service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:08.972712 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-1c3c8e12-73b9-4c9c-9860-8becc04db710 req-159bd586-dfdd-47a6-96bb-7890d9a660ee service nova] Creating event network-vif-deleted:13cff44a-2b36-403d-93d9-2b389e9a8491 for instance 9bda76a1-cfeb-49da-84de-4792a08ce846 on n-h1-849328-3 Aug 24 10:55:08.979880 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-1c3c8e12-73b9-4c9c-9860-8becc04db710 req-159bd586-dfdd-47a6-96bb-7890d9a660ee service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049584 Aug 24 10:55:08.981185 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2977/6305] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:55:09.122249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a6eecc01-9f83-4839-8e7b-70c349bb9be7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:09.135467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a6eecc01-9f83-4839-8e7b-70c349bb9be7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:09.151773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6eecc01-9f83-4839-8e7b-70c349bb9be7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:09.153656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6eecc01-9f83-4839-8e7b-70c349bb9be7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:09.155161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6eecc01-9f83-4839-8e7b-70c349bb9be7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:09.156281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6eecc01-9f83-4839-8e7b-70c349bb9be7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:09.159237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6eecc01-9f83-4839-8e7b-70c349bb9be7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:09.160687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6eecc01-9f83-4839-8e7b-70c349bb9be7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:09.235125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a6eecc01-9f83-4839-8e7b-70c349bb9be7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:55:09.472091 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a6eecc01-9f83-4839-8e7b-70c349bb9be7 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "DELETE /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 204 len: 0 microversion: 2.1 time: 0.353468 Aug 24 10:55:09.473857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-ed3ae54f-e586-482f-b951-2537bb3edc20 req-7f774839-abbf-4bb9-a86b-47ecb23abdfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f71f034-8a70-4049-8987-f32b3a2626b4", "tag": "a00c703f-fe1f-49fe-baa8-f5e6c0363285"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:55:09.477540 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3329/6306] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:55:09 2022] DELETE /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:55:09.483748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-783c1705-8f08-4113-93f0-5ab7256ae3ad tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:09.484778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-783c1705-8f08-4113-93f0-5ab7256ae3ad tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:09.493738 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-783c1705-8f08-4113-93f0-5ab7256ae3ad tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:09.496731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-783c1705-8f08-4113-93f0-5ab7256ae3ad tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:09.498020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-783c1705-8f08-4113-93f0-5ab7256ae3ad tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:09.499097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-783c1705-8f08-4113-93f0-5ab7256ae3ad tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:09.500597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-783c1705-8f08-4113-93f0-5ab7256ae3ad tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:09.501359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-783c1705-8f08-4113-93f0-5ab7256ae3ad tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:09.512297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ed3ae54f-e586-482f-b951-2537bb3edc20 req-7f774839-abbf-4bb9-a86b-47ecb23abdfd service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:09.513512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ed3ae54f-e586-482f-b951-2537bb3edc20 req-7f774839-abbf-4bb9-a86b-47ecb23abdfd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:09.513512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ed3ae54f-e586-482f-b951-2537bb3edc20 req-7f774839-abbf-4bb9-a86b-47ecb23abdfd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:09.545664 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-ed3ae54f-e586-482f-b951-2537bb3edc20 req-7f774839-abbf-4bb9-a86b-47ecb23abdfd service nova] Creating event network-changed:a00c703f-fe1f-49fe-baa8-f5e6c0363285 for instance 2f71f034-8a70-4049-8987-f32b3a2626b4 on n-h1-849328-3 Aug 24 10:55:09.552431 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-ed3ae54f-e586-482f-b951-2537bb3edc20 req-7f774839-abbf-4bb9-a86b-47ecb23abdfd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.427948 Aug 24 10:55:09.555591 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2978/6307] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:55:09.566961 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-42416ba5-752a-410c-87d2-f88ee6a757c1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:09.567679 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-42416ba5-752a-410c-87d2-f88ee6a757c1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:09.579948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42416ba5-752a-410c-87d2-f88ee6a757c1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:09.580442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42416ba5-752a-410c-87d2-f88ee6a757c1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:09.580880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42416ba5-752a-410c-87d2-f88ee6a757c1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:09.581612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42416ba5-752a-410c-87d2-f88ee6a757c1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:09.582059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42416ba5-752a-410c-87d2-f88ee6a757c1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:09.582484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42416ba5-752a-410c-87d2-f88ee6a757c1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:09.661026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-783c1705-8f08-4113-93f0-5ab7256ae3ad tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:09.669551 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-783c1705-8f08-4113-93f0-5ab7256ae3ad tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1201 microversion: 2.1 time: 0.190338 Aug 24 10:55:09.672730 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3330/6308] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:09 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1201 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:09.959106 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-42416ba5-752a-410c-87d2-f88ee6a757c1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:09.972005 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-42416ba5-752a-410c-87d2-f88ee6a757c1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1689 microversion: 2.1 time: 0.415197 Aug 24 10:55:09.978374 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2979/6309] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:09 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1689 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:10.873795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fbfdb181-aa5f-4212-894f-e2f11449fba0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:10.875354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fbfdb181-aa5f-4212-894f-e2f11449fba0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:10.882987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbfdb181-aa5f-4212-894f-e2f11449fba0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:10.883855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbfdb181-aa5f-4212-894f-e2f11449fba0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:10.884617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbfdb181-aa5f-4212-894f-e2f11449fba0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:10.886902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbfdb181-aa5f-4212-894f-e2f11449fba0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:10.887614 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbfdb181-aa5f-4212-894f-e2f11449fba0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:10.888353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbfdb181-aa5f-4212-894f-e2f11449fba0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:10.990229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fbfdb181-aa5f-4212-894f-e2f11449fba0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:10.999639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32b6f369-1fe7-4ebd-b21b-69d5648c2f7f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:11.001154 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-32b6f369-1fe7-4ebd-b21b-69d5648c2f7f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:11.004681 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fbfdb181-aa5f-4212-894f-e2f11449fba0 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1201 microversion: 2.1 time: 0.313637 Aug 24 10:55:11.025148 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3331/6310] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:10 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1201 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:11.025413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32b6f369-1fe7-4ebd-b21b-69d5648c2f7f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:11.025413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32b6f369-1fe7-4ebd-b21b-69d5648c2f7f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:11.025413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32b6f369-1fe7-4ebd-b21b-69d5648c2f7f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:11.025413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32b6f369-1fe7-4ebd-b21b-69d5648c2f7f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:11.025413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32b6f369-1fe7-4ebd-b21b-69d5648c2f7f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:11.025413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32b6f369-1fe7-4ebd-b21b-69d5648c2f7f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:11.068409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-bead7189-6739-4f8e-b64a-d03a86a7f584 req-6e1fc27e-db8c-4582-b922-de070f56e349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f71f034-8a70-4049-8987-f32b3a2626b4", "name": "network-vif-deleted", "tag": "a00c703f-fe1f-49fe-baa8-f5e6c0363285"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:55:11.088184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bead7189-6739-4f8e-b64a-d03a86a7f584 req-6e1fc27e-db8c-4582-b922-de070f56e349 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:11.089060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bead7189-6739-4f8e-b64a-d03a86a7f584 req-6e1fc27e-db8c-4582-b922-de070f56e349 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:11.089749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bead7189-6739-4f8e-b64a-d03a86a7f584 req-6e1fc27e-db8c-4582-b922-de070f56e349 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:11.102633 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-bead7189-6739-4f8e-b64a-d03a86a7f584 req-6e1fc27e-db8c-4582-b922-de070f56e349 service nova] Creating event network-vif-deleted:a00c703f-fe1f-49fe-baa8-f5e6c0363285 for instance 2f71f034-8a70-4049-8987-f32b3a2626b4 on n-h1-849328-3 Aug 24 10:55:11.111981 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-bead7189-6739-4f8e-b64a-d03a86a7f584 req-6e1fc27e-db8c-4582-b922-de070f56e349 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047256 Aug 24 10:55:11.113277 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3332/6311] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:55:11.167519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-32b6f369-1fe7-4ebd-b21b-69d5648c2f7f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:11.181424 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-32b6f369-1fe7-4ebd-b21b-69d5648c2f7f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 200 len: 1503 microversion: 2.1 time: 0.182738 Aug 24 10:55:11.183035 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2980/6312] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:10 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:12.055779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9ad34883-36ac-4d76-863f-5663cd2e7928 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:12.057159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9ad34883-36ac-4d76-863f-5663cd2e7928 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:12.064067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ad34883-36ac-4d76-863f-5663cd2e7928 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:12.064788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ad34883-36ac-4d76-863f-5663cd2e7928 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:12.065431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ad34883-36ac-4d76-863f-5663cd2e7928 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:12.066304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ad34883-36ac-4d76-863f-5663cd2e7928 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:12.066926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ad34883-36ac-4d76-863f-5663cd2e7928 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:12.068156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ad34883-36ac-4d76-863f-5663cd2e7928 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:12.155664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9ad34883-36ac-4d76-863f-5663cd2e7928 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:12.163871 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9ad34883-36ac-4d76-863f-5663cd2e7928 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1201 microversion: 2.1 time: 0.129219 Aug 24 10:55:12.165193 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3333/6313] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:12 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1201 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:12.204283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-27e5d5e8-5c0d-4952-8174-a6ffb835286a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:12.205574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-27e5d5e8-5c0d-4952-8174-a6ffb835286a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 2f71f034-8a70-4049-8987-f32b3a2626b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:12.213225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27e5d5e8-5c0d-4952-8174-a6ffb835286a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:12.214093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27e5d5e8-5c0d-4952-8174-a6ffb835286a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:12.214748 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27e5d5e8-5c0d-4952-8174-a6ffb835286a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:12.215678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27e5d5e8-5c0d-4952-8174-a6ffb835286a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:12.216331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27e5d5e8-5c0d-4952-8174-a6ffb835286a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:12.216950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27e5d5e8-5c0d-4952-8174-a6ffb835286a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:12.232253 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-27e5d5e8-5c0d-4952-8174-a6ffb835286a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] HTTP exception thrown: Instance 2f71f034-8a70-4049-8987-f32b3a2626b4 could not be found. Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-27e5d5e8-5c0d-4952-8174-a6ffb835286a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Request method failure captured: Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 HTTP/1.1 Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgIYr3m0kczioH5SSbuV0siG9VfGIEhErhXgPNYWqTrwdwzLctBv4d_yF7_2o3Bo2OCW0F3YBxLt_VBZKvzJVotT6Q8BjQkCHvOThFjqvFIwYZTCav5UQXePGBVbTY6y1fdzkpkRSvMUUvzdkP7LJWZQ1ilcF3WX7Nwy-FzIhdwxmrY Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: de650d3c897a409dbf54c32bfd45d672 Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-639544488 Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/de650d3c897a409dbf54c32bfd45d672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_de650d3c897a409dbf54c32bfd45d672", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/de650d3c897a409dbf54c32bfd45d672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/de650d3c897a409dbf54c32bfd45d672"}]}] Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-TestNetworkAdvancedServerOps-639544488 Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: de650d3c897a409dbf54c32bfd45d672 Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-639544488 Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-TestNetworkAdvancedServerOps-639544488-project Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 127a30846ae64f268baf7f3231b84273 Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-TestNetworkAdvancedServerOps-639544488-project Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 2f71f034-8a70-4049-8987-f32b3a2626b4 could not be found. Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '2f71f034-8a70-4049-8987-f32b3a2626b4'} Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f71f034-8a70-4049-8987-f32b3a2626b4 could not be found. Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f71f034-8a70-4049-8987-f32b3a2626b4 could not be found. Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:55:12.234331 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:55:12.238423 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:55:12.238423 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:55:12.238423 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:55:12.238423 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:55:12.238423 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:55:12.238423 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:55:12.238423 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f71f034-8a70-4049-8987-f32b3a2626b4 could not be found. Aug 24 10:55:12.238423 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:55:12.240435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-27e5d5e8-5c0d-4952-8174-a6ffb835286a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Returning 404 to user: Instance 2f71f034-8a70-4049-8987-f32b3a2626b4 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:55:12.241617 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-27e5d5e8-5c0d-4952-8174-a6ffb835286a tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4" status: 404 len: 111 microversion: 2.1 time: 0.041430 Aug 24 10:55:12.242945 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2981/6314] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:12 2022] GET /compute/v2.1/servers/2f71f034-8a70-4049-8987-f32b3a2626b4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:55:13.186839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ab8ccb62-b0c2-4e47-849e-36087117d351 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:13.188192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ab8ccb62-b0c2-4e47-849e-36087117d351 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:13.209139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab8ccb62-b0c2-4e47-849e-36087117d351 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:13.210034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab8ccb62-b0c2-4e47-849e-36087117d351 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:13.210697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab8ccb62-b0c2-4e47-849e-36087117d351 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:13.212192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab8ccb62-b0c2-4e47-849e-36087117d351 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:13.212877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab8ccb62-b0c2-4e47-849e-36087117d351 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:13.213563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab8ccb62-b0c2-4e47-849e-36087117d351 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:13.367808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ab8ccb62-b0c2-4e47-849e-36087117d351 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:13.385169 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ab8ccb62-b0c2-4e47-849e-36087117d351 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1201 microversion: 2.1 time: 0.202304 Aug 24 10:55:13.386133 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3334/6315] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:13 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1201 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:14.407129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3fb6065b-9af5-43b2-8c9e-f995cda91a58 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:14.408540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3fb6065b-9af5-43b2-8c9e-f995cda91a58 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:14.418482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fb6065b-9af5-43b2-8c9e-f995cda91a58 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:14.419473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fb6065b-9af5-43b2-8c9e-f995cda91a58 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:14.420372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fb6065b-9af5-43b2-8c9e-f995cda91a58 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:14.422336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fb6065b-9af5-43b2-8c9e-f995cda91a58 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:14.423039 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fb6065b-9af5-43b2-8c9e-f995cda91a58 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:14.425059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fb6065b-9af5-43b2-8c9e-f995cda91a58 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:14.570626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3fb6065b-9af5-43b2-8c9e-f995cda91a58 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:14.583033 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3fb6065b-9af5-43b2-8c9e-f995cda91a58 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1201 microversion: 2.1 time: 0.180351 Aug 24 10:55:14.584285 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2982/6316] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:14 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1201 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:15.606110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-298857f3-e3b3-4aba-b968-ec340aa48504 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:15.606922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-298857f3-e3b3-4aba-b968-ec340aa48504 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:15.620842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-298857f3-e3b3-4aba-b968-ec340aa48504 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:15.621636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-298857f3-e3b3-4aba-b968-ec340aa48504 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:15.622415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-298857f3-e3b3-4aba-b968-ec340aa48504 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:15.625946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-298857f3-e3b3-4aba-b968-ec340aa48504 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:15.626741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-298857f3-e3b3-4aba-b968-ec340aa48504 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:15.627406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-298857f3-e3b3-4aba-b968-ec340aa48504 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:16.087531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-298857f3-e3b3-4aba-b968-ec340aa48504 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:16.114656 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-298857f3-e3b3-4aba-b968-ec340aa48504 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 200 len: 1201 microversion: 2.1 time: 0.510275 Aug 24 10:55:16.115471 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3335/6317] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:15 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 1201 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:17.143123 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8dd74bbe-e087-48aa-a60c-12adfd581835 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:17.143942 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8dd74bbe-e087-48aa-a60c-12adfd581835 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:17.158285 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dd74bbe-e087-48aa-a60c-12adfd581835 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:17.158943 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dd74bbe-e087-48aa-a60c-12adfd581835 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:17.159483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dd74bbe-e087-48aa-a60c-12adfd581835 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:17.160304 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dd74bbe-e087-48aa-a60c-12adfd581835 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:17.160861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dd74bbe-e087-48aa-a60c-12adfd581835 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:17.161419 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dd74bbe-e087-48aa-a60c-12adfd581835 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:17.200084 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-8dd74bbe-e087-48aa-a60c-12adfd581835 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] HTTP exception thrown: Instance 9bda76a1-cfeb-49da-84de-4792a08ce846 could not be found. Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8dd74bbe-e087-48aa-a60c-12adfd581835 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Request method failure captured: Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 HTTP/1.1 Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgJaL-kWwlcIRB5LGdxUOg9NstdlrO4InCZtaIlL6zMAKoO2x9AaKw5QTM5Yc447Qz9dKY7jxkolr7Q3liCCaPxpGdqV4sv_A4_Emu-qJmA0z5hB1ngNyBGm9n-W2LyGX7LaKy8OE29M25iXwnWnUlWVb7vPgN3qX9b_bYxZIyExFQ4 Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d1785d661bbd41619a7046600ad435b1", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d1785d661bbd41619a7046600ad435b1"}]}] Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-TestVolumeBootPattern-1780678770-project Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 26b7ff61eab4477890d20977574e8dac Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-TestVolumeBootPattern-1780678770-project Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 9bda76a1-cfeb-49da-84de-4792a08ce846 could not be found. Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '9bda76a1-cfeb-49da-84de-4792a08ce846'} Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bda76a1-cfeb-49da-84de-4792a08ce846 could not be found. Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bda76a1-cfeb-49da-84de-4792a08ce846 could not be found. Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:55:17.207002 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:55:17.211394 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:55:17.211394 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:55:17.211394 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:55:17.211394 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:55:17.211394 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:55:17.211394 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bda76a1-cfeb-49da-84de-4792a08ce846 could not be found. Aug 24 10:55:17.211394 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:55:17.216455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8dd74bbe-e087-48aa-a60c-12adfd581835 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Returning 404 to user: Instance 9bda76a1-cfeb-49da-84de-4792a08ce846 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:55:17.219497 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8dd74bbe-e087-48aa-a60c-12adfd581835 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 404 len: 111 microversion: 2.1 time: 0.086844 Aug 24 10:55:17.229311 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2983/6318] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:17 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:55:18.297577 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-81e77c91-ac65-4585-a06e-0fe80deb1734 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '.version_select at 0x7f4654f2b0d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:18.339093 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-81e77c91-ac65-4585-a06e-0fe80deb1734 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1527265487" status: 202 len: 0 microversion: 2.1 time: 0.040273 Aug 24 10:55:18.341200 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3336/6319] 10.222.0.85 () {58 vars in 1284 bytes} [Wed Aug 24 10:55:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1527265487 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:55:18.382661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b78a5d9b-392c-4817-a718-3ac53053b192 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Action: 'create', calling method: .version_select at 0x7f465a2bc040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-656277632", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG27RlsliepPNkuFZEnXXX++rJxtFBiSlGCdplJ7YC1Ugnmu4F7YpLTWzwoZ9kWg1NzkW90C3VJhpm2VD/MQEuSFXoqFtiZvvy+Y/2nqXOonqNYru7uURdzXPt/4voKJzA=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:55:18.413391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-b78a5d9b-392c-4817-a718-3ac53053b192 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Getting quotas for project de650d3c897a409dbf54c32bfd45d672. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:55:18.430576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-b78a5d9b-392c-4817-a718-3ac53053b192 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Getting quotas for user 127a30846ae64f268baf7f3231b84273 and project de650d3c897a409dbf54c32bfd45d672. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:55:18.510427 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b78a5d9b-392c-4817-a718-3ac53053b192 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.138721 Aug 24 10:55:18.511052 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2984/6320] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:55:18 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:55:20.676785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-444f1e0b-ba36-40ba-b91b-f35ee46a6c57 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:20.678283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-444f1e0b-ba36-40ba-b91b-f35ee46a6c57 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:20.701091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-444f1e0b-ba36-40ba-b91b-f35ee46a6c57 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:20.703780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-444f1e0b-ba36-40ba-b91b-f35ee46a6c57 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:20.705097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-444f1e0b-ba36-40ba-b91b-f35ee46a6c57 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:20.707548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-444f1e0b-ba36-40ba-b91b-f35ee46a6c57 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:20.709668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-444f1e0b-ba36-40ba-b91b-f35ee46a6c57 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:20.710608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-444f1e0b-ba36-40ba-b91b-f35ee46a6c57 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:20.750792 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-444f1e0b-ba36-40ba-b91b-f35ee46a6c57 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] HTTP exception thrown: Instance 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 could not be found. Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-444f1e0b-ba36-40ba-b91b-f35ee46a6c57 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Request method failure captured: Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 HTTP/1.1 Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgJaL-kWwlcIRB5LGdxUOg9NstdlrO4InCZtaIlL6zMAKoO2x9AaKw5QTM5Yc447Qz9dKY7jxkolr7Q3liCCaPxpGdqV4sv_A4_Emu-qJmA0z5hB1ngNyBGm9n-W2LyGX7LaKy8OE29M25iXwnWnUlWVb7vPgN3qX9b_bYxZIyExFQ4 Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d1785d661bbd41619a7046600ad435b1", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d1785d661bbd41619a7046600ad435b1"}]}] Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestVolumeBootPattern-1780678770-project Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 26b7ff61eab4477890d20977574e8dac Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestVolumeBootPattern-1780678770-project Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 could not be found. Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844'} Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 could not be found. Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:55:20.753164 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:55:20.758362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 could not be found. Aug 24 10:55:20.758362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:55:20.758362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:55:20.758362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:55:20.758362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:55:20.758362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:55:20.758362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:55:20.758362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:55:20.758362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:55:20.758362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 could not be found. Aug 24 10:55:20.758362 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:55:20.779982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-444f1e0b-ba36-40ba-b91b-f35ee46a6c57 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Returning 404 to user: Instance 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:55:20.781689 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-444f1e0b-ba36-40ba-b91b-f35ee46a6c57 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "DELETE /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 404 len: 111 microversion: 2.1 time: 0.109421 Aug 24 10:55:20.785980 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3337/6321] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:55:20 2022] DELETE /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:55:20.791196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f8bf775a-61eb-4601-bbe3-c8fb78a7fec4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:20.791827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f8bf775a-61eb-4601-bbe3-c8fb78a7fec4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:20.800497 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8bf775a-61eb-4601-bbe3-c8fb78a7fec4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:20.801394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8bf775a-61eb-4601-bbe3-c8fb78a7fec4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:20.802012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8bf775a-61eb-4601-bbe3-c8fb78a7fec4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:20.802897 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8bf775a-61eb-4601-bbe3-c8fb78a7fec4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:20.803546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8bf775a-61eb-4601-bbe3-c8fb78a7fec4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:20.804129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8bf775a-61eb-4601-bbe3-c8fb78a7fec4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:20.819083 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-f8bf775a-61eb-4601-bbe3-c8fb78a7fec4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] HTTP exception thrown: Instance 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 could not be found. Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f8bf775a-61eb-4601-bbe3-c8fb78a7fec4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Request method failure captured: Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 HTTP/1.1 Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgJaL-kWwlcIRB5LGdxUOg9NstdlrO4InCZtaIlL6zMAKoO2x9AaKw5QTM5Yc447Qz9dKY7jxkolr7Q3liCCaPxpGdqV4sv_A4_Emu-qJmA0z5hB1ngNyBGm9n-W2LyGX7LaKy8OE29M25iXwnWnUlWVb7vPgN3qX9b_bYxZIyExFQ4 Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d1785d661bbd41619a7046600ad435b1", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d1785d661bbd41619a7046600ad435b1"}]}] Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-TestVolumeBootPattern-1780678770-project Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 26b7ff61eab4477890d20977574e8dac Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-TestVolumeBootPattern-1780678770-project Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 could not be found. Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844'} Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 could not be found. Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 could not be found. Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:55:20.820677 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:55:20.825917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:55:20.825917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:55:20.825917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:55:20.825917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:55:20.825917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:55:20.825917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 could not be found. Aug 24 10:55:20.825917 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:55:20.826966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f8bf775a-61eb-4601-bbe3-c8fb78a7fec4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Returning 404 to user: Instance 7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:55:20.827467 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f8bf775a-61eb-4601-bbe3-c8fb78a7fec4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844" status: 404 len: 111 microversion: 2.1 time: 0.040301 Aug 24 10:55:20.828690 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2985/6322] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:20 2022] GET /compute/v2.1/servers/7f1dd332-ddc5-4c8c-bfc5-ae2b6ad90844 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:55:21.634683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-14d34ddd-8a7d-48eb-b8ff-6270f8a17b5e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:21.635494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-14d34ddd-8a7d-48eb-b8ff-6270f8a17b5e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:21.645370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14d34ddd-8a7d-48eb-b8ff-6270f8a17b5e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:21.653719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14d34ddd-8a7d-48eb-b8ff-6270f8a17b5e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:21.654525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14d34ddd-8a7d-48eb-b8ff-6270f8a17b5e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:21.655461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14d34ddd-8a7d-48eb-b8ff-6270f8a17b5e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:21.656122 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14d34ddd-8a7d-48eb-b8ff-6270f8a17b5e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:21.657377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14d34ddd-8a7d-48eb-b8ff-6270f8a17b5e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:21.678861 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-14d34ddd-8a7d-48eb-b8ff-6270f8a17b5e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] HTTP exception thrown: Instance 9bda76a1-cfeb-49da-84de-4792a08ce846 could not be found. Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-14d34ddd-8a7d-48eb-b8ff-6270f8a17b5e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Request method failure captured: Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 HTTP/1.1 Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgJaL-kWwlcIRB5LGdxUOg9NstdlrO4InCZtaIlL6zMAKoO2x9AaKw5QTM5Yc447Qz9dKY7jxkolr7Q3liCCaPxpGdqV4sv_A4_Emu-qJmA0z5hB1ngNyBGm9n-W2LyGX7LaKy8OE29M25iXwnWnUlWVb7vPgN3qX9b_bYxZIyExFQ4 Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d1785d661bbd41619a7046600ad435b1", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d1785d661bbd41619a7046600ad435b1"}]}] Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestVolumeBootPattern-1780678770-project Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 26b7ff61eab4477890d20977574e8dac Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestVolumeBootPattern-1780678770-project Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 9bda76a1-cfeb-49da-84de-4792a08ce846 could not be found. Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '9bda76a1-cfeb-49da-84de-4792a08ce846'} Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bda76a1-cfeb-49da-84de-4792a08ce846 could not be found. Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:55:21.681668 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:55:21.688827 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bda76a1-cfeb-49da-84de-4792a08ce846 could not be found. Aug 24 10:55:21.688827 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:55:21.688827 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:55:21.688827 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:55:21.688827 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:55:21.688827 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:55:21.688827 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:55:21.688827 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:55:21.688827 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:55:21.688827 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bda76a1-cfeb-49da-84de-4792a08ce846 could not be found. Aug 24 10:55:21.688827 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:55:21.691424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-14d34ddd-8a7d-48eb-b8ff-6270f8a17b5e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Returning 404 to user: Instance 9bda76a1-cfeb-49da-84de-4792a08ce846 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:55:21.692581 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-14d34ddd-8a7d-48eb-b8ff-6270f8a17b5e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "DELETE /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 404 len: 111 microversion: 2.1 time: 0.062315 Aug 24 10:55:21.693787 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3338/6323] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:55:21 2022] DELETE /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:55:21.702149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ab4624ba-3bb0-48ca-8ff5-bbfb34384240 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:21.702845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ab4624ba-3bb0-48ca-8ff5-bbfb34384240 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 9bda76a1-cfeb-49da-84de-4792a08ce846] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:21.719901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab4624ba-3bb0-48ca-8ff5-bbfb34384240 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:21.720408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab4624ba-3bb0-48ca-8ff5-bbfb34384240 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:21.721094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab4624ba-3bb0-48ca-8ff5-bbfb34384240 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:21.721885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab4624ba-3bb0-48ca-8ff5-bbfb34384240 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:21.722354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab4624ba-3bb0-48ca-8ff5-bbfb34384240 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:21.722793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab4624ba-3bb0-48ca-8ff5-bbfb34384240 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:21.756798 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-ab4624ba-3bb0-48ca-8ff5-bbfb34384240 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] HTTP exception thrown: Instance 9bda76a1-cfeb-49da-84de-4792a08ce846 could not be found. Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ab4624ba-3bb0-48ca-8ff5-bbfb34384240 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Request method failure captured: Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 HTTP/1.1 Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgJaL-kWwlcIRB5LGdxUOg9NstdlrO4InCZtaIlL6zMAKoO2x9AaKw5QTM5Yc447Qz9dKY7jxkolr7Q3liCCaPxpGdqV4sv_A4_Emu-qJmA0z5hB1ngNyBGm9n-W2LyGX7LaKy8OE29M25iXwnWnUlWVb7vPgN3qX9b_bYxZIyExFQ4 Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d1785d661bbd41619a7046600ad435b1", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d1785d661bbd41619a7046600ad435b1"}]}] Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-TestVolumeBootPattern-1780678770-project Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 26b7ff61eab4477890d20977574e8dac Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-TestVolumeBootPattern-1780678770-project Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 9bda76a1-cfeb-49da-84de-4792a08ce846 could not be found. Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '9bda76a1-cfeb-49da-84de-4792a08ce846'} Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bda76a1-cfeb-49da-84de-4792a08ce846 could not be found. Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bda76a1-cfeb-49da-84de-4792a08ce846 could not be found. Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:55:21.758524 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:55:21.762875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:55:21.762875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:55:21.762875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:55:21.762875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:55:21.762875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:55:21.762875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bda76a1-cfeb-49da-84de-4792a08ce846 could not be found. Aug 24 10:55:21.762875 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 10:55:21.762875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ab4624ba-3bb0-48ca-8ff5-bbfb34384240 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Returning 404 to user: Instance 9bda76a1-cfeb-49da-84de-4792a08ce846 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:55:21.762875 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ab4624ba-3bb0-48ca-8ff5-bbfb34384240 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846" status: 404 len: 111 microversion: 2.1 time: 0.061986 Aug 24 10:55:21.762875 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2986/6324] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:21 2022] GET /compute/v2.1/servers/9bda76a1-cfeb-49da-84de-4792a08ce846 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:55:21.892057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c851a2cc-ea67-484b-aa30-2a6a474056eb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Action: 'create', calling method: .version_select at 0x7f464797af70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1418087682", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCO6QPWsGepaeCkYjI+KCoyfp+4JFzIlx/lvLLdragFSq8YJzBYooEUb1n52Xf7vWe/nQ8b0Zsz/ZINnGfZgpwdyIZ9yoQIi0jIkdQVegcPYjODCxKkeUaS6rECIH3LRg=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:55:21.928176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-c851a2cc-ea67-484b-aa30-2a6a474056eb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Getting quotas for project d1785d661bbd41619a7046600ad435b1. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:55:21.944443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-c851a2cc-ea67-484b-aa30-2a6a474056eb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Getting quotas for user 26b7ff61eab4477890d20977574e8dac and project d1785d661bbd41619a7046600ad435b1. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:55:21.999228 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c851a2cc-ea67-484b-aa30-2a6a474056eb tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.112433 Aug 24 10:55:22.000072 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3339/6325] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:55:21 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:55:28.256678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b5d7d17-b04c-49ca-ba62-7d2fd44516cb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1880642535", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "511edeaa-f8dc-4fdc-b263-eeaf0d37116a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-656277632", "security_groups": [{"name": "tempest-secgroup-smoke-995301105"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:55:28.464416 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:31.728106 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:38.290977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:42.750337 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-2b5d7d17-b04c-49ca-ba62-7d2fd44516cb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] validate_networks() for [('511edeaa-f8dc-4fdc-b263-eeaf0d37116a', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:55:43.349642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2b5d7d17-b04c-49ca-ba62-7d2fd44516cb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:55:43.350340 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2b5d7d17-b04c-49ca-ba62-7d2fd44516cb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:55:43.350844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2b5d7d17-b04c-49ca-ba62-7d2fd44516cb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:55:43.351476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2b5d7d17-b04c-49ca-ba62-7d2fd44516cb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:55:43.351892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2b5d7d17-b04c-49ca-ba62-7d2fd44516cb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:55:43.368012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b5d7d17-b04c-49ca-ba62-7d2fd44516cb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:43.368501 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b5d7d17-b04c-49ca-ba62-7d2fd44516cb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:43.369211 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b5d7d17-b04c-49ca-ba62-7d2fd44516cb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:43.369943 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b5d7d17-b04c-49ca-ba62-7d2fd44516cb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:43.370413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b5d7d17-b04c-49ca-ba62-7d2fd44516cb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:43.371334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b5d7d17-b04c-49ca-ba62-7d2fd44516cb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:43.403044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-2b5d7d17-b04c-49ca-ba62-7d2fd44516cb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Getting quotas for project de650d3c897a409dbf54c32bfd45d672. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:55:43.419487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-2b5d7d17-b04c-49ca-ba62-7d2fd44516cb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Getting quotas for user 127a30846ae64f268baf7f3231b84273 and project de650d3c897a409dbf54c32bfd45d672. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:55:43.438491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2b5d7d17-b04c-49ca-ba62-7d2fd44516cb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:55:43.441108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2b5d7d17-b04c-49ca-ba62-7d2fd44516cb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:55:43.512614 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2b5d7d17-b04c-49ca-ba62-7d2fd44516cb tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 15.260396 Aug 24 10:55:43.513313 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2987/6326] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:55:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 15262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:55:43.524486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-86c85da5-a392-4f5a-bd93-a67a5785217e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:43.525172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-86c85da5-a392-4f5a-bd93-a67a5785217e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:43.528097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:43.528787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:43.531580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:43.644708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-86c85da5-a392-4f5a-bd93-a67a5785217e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:43.656776 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-86c85da5-a392-4f5a-bd93-a67a5785217e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 200 len: 1266 microversion: 2.1 time: 0.136380 Aug 24 10:55:43.657671 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3340/6327] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:43 2022] GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:55:44.690072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4ea81390-a81b-4bc8-920b-8ea9a143a24f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:44.695719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4ea81390-a81b-4bc8-920b-8ea9a143a24f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:44.709384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ea81390-a81b-4bc8-920b-8ea9a143a24f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:44.709384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ea81390-a81b-4bc8-920b-8ea9a143a24f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:44.709772 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ea81390-a81b-4bc8-920b-8ea9a143a24f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:44.710514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ea81390-a81b-4bc8-920b-8ea9a143a24f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:44.710979 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ea81390-a81b-4bc8-920b-8ea9a143a24f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:44.711414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ea81390-a81b-4bc8-920b-8ea9a143a24f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:44.894705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4ea81390-a81b-4bc8-920b-8ea9a143a24f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:44.912184 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4ea81390-a81b-4bc8-920b-8ea9a143a24f tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 200 len: 1326 microversion: 2.1 time: 0.218339 Aug 24 10:55:44.912770 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2988/6328] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:44 2022] GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 1326 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:45.933730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-39f44e62-4268-40f7-bdb9-2dd8a6351551 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:45.934359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-39f44e62-4268-40f7-bdb9-2dd8a6351551 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:45.949888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39f44e62-4268-40f7-bdb9-2dd8a6351551 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:45.950848 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39f44e62-4268-40f7-bdb9-2dd8a6351551 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:45.951593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39f44e62-4268-40f7-bdb9-2dd8a6351551 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:45.952602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39f44e62-4268-40f7-bdb9-2dd8a6351551 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:45.953087 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39f44e62-4268-40f7-bdb9-2dd8a6351551 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:45.955443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39f44e62-4268-40f7-bdb9-2dd8a6351551 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:46.220611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-39f44e62-4268-40f7-bdb9-2dd8a6351551 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:46.231359 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-39f44e62-4268-40f7-bdb9-2dd8a6351551 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 200 len: 1391 microversion: 2.1 time: 0.301491 Aug 24 10:55:46.232457 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3341/6329] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:45 2022] GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 1391 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:55:47.178713 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-25c3757d-4ad8-4db2-bdd6-58bdba419696 req-1a69488d-0883-47da-9f01-a0ddb94d0535 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b9a9458-d33b-4947-9b66-bf18a2bcd7a5", "tag": "c9d1fdbe-2e15-40f2-b3c2-b069844d3161"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:55:47.200646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-25c3757d-4ad8-4db2-bdd6-58bdba419696 req-1a69488d-0883-47da-9f01-a0ddb94d0535 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:47.201143 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-25c3757d-4ad8-4db2-bdd6-58bdba419696 req-1a69488d-0883-47da-9f01-a0ddb94d0535 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:47.201577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-25c3757d-4ad8-4db2-bdd6-58bdba419696 req-1a69488d-0883-47da-9f01-a0ddb94d0535 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:47.221803 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-25c3757d-4ad8-4db2-bdd6-58bdba419696 req-1a69488d-0883-47da-9f01-a0ddb94d0535 service nova] Creating event network-changed:c9d1fdbe-2e15-40f2-b3c2-b069844d3161 for instance 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 on n-h1-849328-3 Aug 24 10:55:47.227268 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-25c3757d-4ad8-4db2-bdd6-58bdba419696 req-1a69488d-0883-47da-9f01-a0ddb94d0535 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053066 Aug 24 10:55:47.228418 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2989/6330] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:55:47.254104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-af792335-e376-4b79-bff6-3eba55fa6c48 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:47.254748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-af792335-e376-4b79-bff6-3eba55fa6c48 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:47.266846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af792335-e376-4b79-bff6-3eba55fa6c48 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:47.267360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af792335-e376-4b79-bff6-3eba55fa6c48 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:47.267819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af792335-e376-4b79-bff6-3eba55fa6c48 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:47.268545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af792335-e376-4b79-bff6-3eba55fa6c48 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:47.269013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af792335-e376-4b79-bff6-3eba55fa6c48 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:47.274576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af792335-e376-4b79-bff6-3eba55fa6c48 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:47.567239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-af792335-e376-4b79-bff6-3eba55fa6c48 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:47.580251 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-af792335-e376-4b79-bff6-3eba55fa6c48 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 200 len: 1391 microversion: 2.1 time: 0.329078 Aug 24 10:55:47.584085 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3342/6331] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:47 2022] GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 1391 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:48.603900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1afa3bb2-d69f-435f-9498-98f0b62211fa tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:48.604495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1afa3bb2-d69f-435f-9498-98f0b62211fa tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:48.623233 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1afa3bb2-d69f-435f-9498-98f0b62211fa tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:48.623497 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1afa3bb2-d69f-435f-9498-98f0b62211fa tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:48.623933 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1afa3bb2-d69f-435f-9498-98f0b62211fa tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:48.624641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1afa3bb2-d69f-435f-9498-98f0b62211fa tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:48.625092 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1afa3bb2-d69f-435f-9498-98f0b62211fa tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:48.625562 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1afa3bb2-d69f-435f-9498-98f0b62211fa tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:48.973991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1afa3bb2-d69f-435f-9498-98f0b62211fa tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:48.987486 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1afa3bb2-d69f-435f-9498-98f0b62211fa tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 200 len: 1391 microversion: 2.1 time: 0.388831 Aug 24 10:55:48.988783 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2990/6332] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:48 2022] GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 1391 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:50.007865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aea15e92-1b85-4b5a-a966-53bed45c883c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:50.009305 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aea15e92-1b85-4b5a-a966-53bed45c883c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:50.018375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aea15e92-1b85-4b5a-a966-53bed45c883c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:50.019185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aea15e92-1b85-4b5a-a966-53bed45c883c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:50.020013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aea15e92-1b85-4b5a-a966-53bed45c883c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:50.021795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aea15e92-1b85-4b5a-a966-53bed45c883c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:50.023953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aea15e92-1b85-4b5a-a966-53bed45c883c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:50.023953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aea15e92-1b85-4b5a-a966-53bed45c883c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:50.202794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aea15e92-1b85-4b5a-a966-53bed45c883c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:50.211200 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aea15e92-1b85-4b5a-a966-53bed45c883c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 200 len: 1391 microversion: 2.1 time: 0.206973 Aug 24 10:55:50.228573 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3343/6333] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:50 2022] GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 1391 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:51.183056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-733c70d6-5e6c-41e9-8b6d-b1830bf92a40 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1626802367", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1418087682", "security_groups": [{"name": "tempest-secgroup-smoke-793359891"}], "block_device_mapping_v2": [{"uuid": "546c69ec-c617-4c14-9054-28ddf87bfdc7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9996d4a7-fe50-441a-b919-9c80031d0109"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:55:51.234042 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dc1de3a0-ef00-428d-8a69-ce3109077c00 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:51.234766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dc1de3a0-ef00-428d-8a69-ce3109077c00 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:51.275529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc1de3a0-ef00-428d-8a69-ce3109077c00 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:51.276520 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc1de3a0-ef00-428d-8a69-ce3109077c00 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:51.277169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc1de3a0-ef00-428d-8a69-ce3109077c00 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:51.283281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc1de3a0-ef00-428d-8a69-ce3109077c00 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:51.284601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc1de3a0-ef00-428d-8a69-ce3109077c00 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:51.289364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc1de3a0-ef00-428d-8a69-ce3109077c00 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:51.471027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-733c70d6-5e6c-41e9-8b6d-b1830bf92a40 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] validate_networks() for [('9996d4a7-fe50-441a-b919-9c80031d0109', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:55:51.520710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dc1de3a0-ef00-428d-8a69-ce3109077c00 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:51.535346 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dc1de3a0-ef00-428d-8a69-ce3109077c00 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 200 len: 1391 microversion: 2.1 time: 0.305289 Aug 24 10:55:51.537772 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3344/6334] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:51 2022] GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 1391 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:51.927102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-733c70d6-5e6c-41e9-8b6d-b1830bf92a40 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:55:51.927777 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-733c70d6-5e6c-41e9-8b6d-b1830bf92a40 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:55:51.928358 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-733c70d6-5e6c-41e9-8b6d-b1830bf92a40 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:55:51.928875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-733c70d6-5e6c-41e9-8b6d-b1830bf92a40 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:55:51.929432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-733c70d6-5e6c-41e9-8b6d-b1830bf92a40 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:55:51.939966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-733c70d6-5e6c-41e9-8b6d-b1830bf92a40 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:51.940703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-733c70d6-5e6c-41e9-8b6d-b1830bf92a40 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:51.941396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-733c70d6-5e6c-41e9-8b6d-b1830bf92a40 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:51.942427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-733c70d6-5e6c-41e9-8b6d-b1830bf92a40 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:51.942998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-733c70d6-5e6c-41e9-8b6d-b1830bf92a40 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:51.943530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-733c70d6-5e6c-41e9-8b6d-b1830bf92a40 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:51.961640 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-733c70d6-5e6c-41e9-8b6d-b1830bf92a40 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Getting quotas for project d1785d661bbd41619a7046600ad435b1. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:55:51.967258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-733c70d6-5e6c-41e9-8b6d-b1830bf92a40 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Getting quotas for user 26b7ff61eab4477890d20977574e8dac and project d1785d661bbd41619a7046600ad435b1. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:55:52.032616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-733c70d6-5e6c-41e9-8b6d-b1830bf92a40 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:55:52.036590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-733c70d6-5e6c-41e9-8b6d-b1830bf92a40 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='546c69ec-c617-4c14-9054-28ddf87bfdc7',volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:55:52.185102 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-733c70d6-5e6c-41e9-8b6d-b1830bf92a40 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.006735 Aug 24 10:55:52.186838 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2991/6335] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:55:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:55:52.197872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-98e3fe70-2bc4-46bb-adf0-51cd3a07a4c6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:52.198918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-98e3fe70-2bc4-46bb-adf0-51cd3a07a4c6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:52.276776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-98e3fe70-2bc4-46bb-adf0-51cd3a07a4c6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:52.291763 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-98e3fe70-2bc4-46bb-adf0-51cd3a07a4c6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 200 len: 1095 microversion: 2.1 time: 0.097905 Aug 24 10:55:52.297263 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3345/6336] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:52 2022] GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 1095 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:55:52.560562 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4502faab-9ae6-4f09-8109-2f51bfbbcba2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:52.561475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4502faab-9ae6-4f09-8109-2f51bfbbcba2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:52.570307 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4502faab-9ae6-4f09-8109-2f51bfbbcba2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:52.571172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4502faab-9ae6-4f09-8109-2f51bfbbcba2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:52.571975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4502faab-9ae6-4f09-8109-2f51bfbbcba2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:52.573150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4502faab-9ae6-4f09-8109-2f51bfbbcba2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:52.573953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4502faab-9ae6-4f09-8109-2f51bfbbcba2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:52.574714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4502faab-9ae6-4f09-8109-2f51bfbbcba2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:52.737480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4502faab-9ae6-4f09-8109-2f51bfbbcba2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:52.748448 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4502faab-9ae6-4f09-8109-2f51bfbbcba2 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 200 len: 1391 microversion: 2.1 time: 0.192481 Aug 24 10:55:52.749051 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2992/6337] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:52 2022] GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 1391 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:52.750064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-b15b5303-8291-4897-819f-025a740d6840 req-fde95204-f944-4f3f-8387-257508d2f6ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b9a9458-d33b-4947-9b66-bf18a2bcd7a5", "name": "network-vif-plugged", "status": "completed", "tag": "c9d1fdbe-2e15-40f2-b3c2-b069844d3161"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:55:52.772280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b15b5303-8291-4897-819f-025a740d6840 req-fde95204-f944-4f3f-8387-257508d2f6ed service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:52.772780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b15b5303-8291-4897-819f-025a740d6840 req-fde95204-f944-4f3f-8387-257508d2f6ed service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:52.773280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b15b5303-8291-4897-819f-025a740d6840 req-fde95204-f944-4f3f-8387-257508d2f6ed service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:52.785776 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-b15b5303-8291-4897-819f-025a740d6840 req-fde95204-f944-4f3f-8387-257508d2f6ed service nova] Creating event network-vif-plugged:c9d1fdbe-2e15-40f2-b3c2-b069844d3161 for instance 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 on n-h1-849328-3 Aug 24 10:55:52.794332 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-b15b5303-8291-4897-819f-025a740d6840 req-fde95204-f944-4f3f-8387-257508d2f6ed service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051725 Aug 24 10:55:52.795493 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3346/6338] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:55:53.312321 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-04938845-160b-490b-96b1-ee796f6240a8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:53.312941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-04938845-160b-490b-96b1-ee796f6240a8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:53.320830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04938845-160b-490b-96b1-ee796f6240a8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:53.325871 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04938845-160b-490b-96b1-ee796f6240a8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:53.326671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04938845-160b-490b-96b1-ee796f6240a8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:53.327690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04938845-160b-490b-96b1-ee796f6240a8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:53.331082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04938845-160b-490b-96b1-ee796f6240a8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:53.332762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04938845-160b-490b-96b1-ee796f6240a8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:53.434885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-04938845-160b-490b-96b1-ee796f6240a8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:53.446437 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-04938845-160b-490b-96b1-ee796f6240a8 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 200 len: 1201 microversion: 2.1 time: 0.137697 Aug 24 10:55:53.447432 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2993/6339] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:53 2022] GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 1201 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:53.771217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1b5ca1b5-040f-4b4e-ae40-14a6836a28b3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:53.776040 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1b5ca1b5-040f-4b4e-ae40-14a6836a28b3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:53.789545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b5ca1b5-040f-4b4e-ae40-14a6836a28b3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:53.797857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b5ca1b5-040f-4b4e-ae40-14a6836a28b3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:53.798572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b5ca1b5-040f-4b4e-ae40-14a6836a28b3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:53.799506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b5ca1b5-040f-4b4e-ae40-14a6836a28b3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:53.800139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b5ca1b5-040f-4b4e-ae40-14a6836a28b3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:53.800758 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b5ca1b5-040f-4b4e-ae40-14a6836a28b3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:54.228120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1b5ca1b5-040f-4b4e-ae40-14a6836a28b3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:54.238395 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1b5ca1b5-040f-4b4e-ae40-14a6836a28b3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 200 len: 1391 microversion: 2.1 time: 0.471843 Aug 24 10:55:54.239635 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3347/6340] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:53 2022] GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 1391 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:54.468485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-21b47a79-8dcf-4e5e-af7e-9aec5f956c67 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:54.478174 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-21b47a79-8dcf-4e5e-af7e-9aec5f956c67 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:54.495903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21b47a79-8dcf-4e5e-af7e-9aec5f956c67 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:54.498048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21b47a79-8dcf-4e5e-af7e-9aec5f956c67 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:54.498685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21b47a79-8dcf-4e5e-af7e-9aec5f956c67 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:54.500534 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21b47a79-8dcf-4e5e-af7e-9aec5f956c67 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:54.502964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21b47a79-8dcf-4e5e-af7e-9aec5f956c67 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:54.503934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21b47a79-8dcf-4e5e-af7e-9aec5f956c67 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:54.716903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-21b47a79-8dcf-4e5e-af7e-9aec5f956c67 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:54.726376 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-21b47a79-8dcf-4e5e-af7e-9aec5f956c67 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 200 len: 1278 microversion: 2.1 time: 0.261898 Aug 24 10:55:54.727932 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2994/6341] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:54 2022] GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 1278 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:55.268385 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b6959541-c8ca-4f85-bdb1-4b69548f1e8d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:55.272556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b6959541-c8ca-4f85-bdb1-4b69548f1e8d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:55.291118 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6959541-c8ca-4f85-bdb1-4b69548f1e8d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:55.291707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6959541-c8ca-4f85-bdb1-4b69548f1e8d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:55.295628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6959541-c8ca-4f85-bdb1-4b69548f1e8d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:55.296646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6959541-c8ca-4f85-bdb1-4b69548f1e8d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:55.297410 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6959541-c8ca-4f85-bdb1-4b69548f1e8d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:55.298055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6959541-c8ca-4f85-bdb1-4b69548f1e8d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:55.563161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b6959541-c8ca-4f85-bdb1-4b69548f1e8d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:55.577344 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b6959541-c8ca-4f85-bdb1-4b69548f1e8d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 200 len: 1563 microversion: 2.1 time: 0.319634 Aug 24 10:55:55.578721 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3348/6342] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:55 2022] GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 1563 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:55.598782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cdca9eda-cf56-4fdd-91ee-bcf3cc83b8b9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:55.599468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cdca9eda-cf56-4fdd-91ee-bcf3cc83b8b9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:55.614131 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-f721568a-211d-48cd-af00-0747bfa18e04 req-722bd0a9-66a3-4762-83e1-eea9662bd0ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30efa0e8-e35a-4785-bb4c-fc0354bec60b", "tag": "3d8fbecc-df04-4d22-855e-b0912b1a1cc3"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:55:55.620916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdca9eda-cf56-4fdd-91ee-bcf3cc83b8b9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:55.621452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdca9eda-cf56-4fdd-91ee-bcf3cc83b8b9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:55.621890 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdca9eda-cf56-4fdd-91ee-bcf3cc83b8b9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:55.622607 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdca9eda-cf56-4fdd-91ee-bcf3cc83b8b9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:55.623066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdca9eda-cf56-4fdd-91ee-bcf3cc83b8b9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:55.623493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdca9eda-cf56-4fdd-91ee-bcf3cc83b8b9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:55.640699 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f721568a-211d-48cd-af00-0747bfa18e04 req-722bd0a9-66a3-4762-83e1-eea9662bd0ca service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:55.641300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f721568a-211d-48cd-af00-0747bfa18e04 req-722bd0a9-66a3-4762-83e1-eea9662bd0ca service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:55.667544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f721568a-211d-48cd-af00-0747bfa18e04 req-722bd0a9-66a3-4762-83e1-eea9662bd0ca service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:55.689222 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-f721568a-211d-48cd-af00-0747bfa18e04 req-722bd0a9-66a3-4762-83e1-eea9662bd0ca service nova] Creating event network-changed:3d8fbecc-df04-4d22-855e-b0912b1a1cc3 for instance 30efa0e8-e35a-4785-bb4c-fc0354bec60b on n-h2-849328-3 Aug 24 10:55:55.706654 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-f721568a-211d-48cd-af00-0747bfa18e04 req-722bd0a9-66a3-4762-83e1-eea9662bd0ca service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096341 Aug 24 10:55:55.707637 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3349/6343] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:55:55.748533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3f952500-5e83-4307-83f1-73c41df04ff7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:55.749618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3f952500-5e83-4307-83f1-73c41df04ff7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:55.773255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f952500-5e83-4307-83f1-73c41df04ff7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:55.774137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f952500-5e83-4307-83f1-73c41df04ff7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:55.775121 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f952500-5e83-4307-83f1-73c41df04ff7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:55.776096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f952500-5e83-4307-83f1-73c41df04ff7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:55.776810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f952500-5e83-4307-83f1-73c41df04ff7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:55.777534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f952500-5e83-4307-83f1-73c41df04ff7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:55.917775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cdca9eda-cf56-4fdd-91ee-bcf3cc83b8b9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:55.931440 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cdca9eda-cf56-4fdd-91ee-bcf3cc83b8b9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 200 len: 1563 microversion: 2.1 time: 0.336786 Aug 24 10:55:55.950472 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2995/6344] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:55 2022] GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 1563 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:56.111334 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3f952500-5e83-4307-83f1-73c41df04ff7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:56.120190 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3f952500-5e83-4307-83f1-73c41df04ff7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 200 len: 1278 microversion: 2.1 time: 0.375805 Aug 24 10:55:56.125622 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3350/6345] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:55 2022] GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 1278 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:55:57.146018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-40175316-c46f-412d-8db9-2acac033a385 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:57.146634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-40175316-c46f-412d-8db9-2acac033a385 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:57.161951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40175316-c46f-412d-8db9-2acac033a385 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:57.162457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40175316-c46f-412d-8db9-2acac033a385 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:57.162894 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40175316-c46f-412d-8db9-2acac033a385 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:57.163613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40175316-c46f-412d-8db9-2acac033a385 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:57.164065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40175316-c46f-412d-8db9-2acac033a385 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:57.164490 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40175316-c46f-412d-8db9-2acac033a385 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:57.344172 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:55:57.344774 n-d-849328-3 devstack@n-api.service[122433]: Wed Aug 24 10:55:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:55:57.415432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-40175316-c46f-412d-8db9-2acac033a385 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:57.426556 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-40175316-c46f-412d-8db9-2acac033a385 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 200 len: 1278 microversion: 2.1 time: 0.284629 Aug 24 10:55:57.431987 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2996/6346] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:57 2022] GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 1278 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:58.454344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-21456910-f3d1-42fc-ae46-2d0e28810597 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:58.456138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-21456910-f3d1-42fc-ae46-2d0e28810597 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:58.469666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21456910-f3d1-42fc-ae46-2d0e28810597 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:58.472355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21456910-f3d1-42fc-ae46-2d0e28810597 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:58.474544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21456910-f3d1-42fc-ae46-2d0e28810597 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:58.475652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21456910-f3d1-42fc-ae46-2d0e28810597 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:58.479065 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21456910-f3d1-42fc-ae46-2d0e28810597 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:58.479711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21456910-f3d1-42fc-ae46-2d0e28810597 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:58.714979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-21456910-f3d1-42fc-ae46-2d0e28810597 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:58.728400 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-21456910-f3d1-42fc-ae46-2d0e28810597 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 200 len: 1278 microversion: 2.1 time: 0.278710 Aug 24 10:55:58.733363 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3351/6347] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:58 2022] GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 1278 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:59.052249 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3ebd8d5b-f685-476c-9728-3488a60709a5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:59.054903 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-f6c92676-5883-41e8-ac83-c75f785a342d req-4ae45591-a0f0-4609-a85e-eaf29a9723a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b9a9458-d33b-4947-9b66-bf18a2bcd7a5", "tag": "c9d1fdbe-2e15-40f2-b3c2-b069844d3161"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:55:59.057455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3ebd8d5b-f685-476c-9728-3488a60709a5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:59.087324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ebd8d5b-f685-476c-9728-3488a60709a5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:59.094551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ebd8d5b-f685-476c-9728-3488a60709a5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:59.096592 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ebd8d5b-f685-476c-9728-3488a60709a5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:59.098275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f6c92676-5883-41e8-ac83-c75f785a342d req-4ae45591-a0f0-4609-a85e-eaf29a9723a5 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:59.099168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f6c92676-5883-41e8-ac83-c75f785a342d req-4ae45591-a0f0-4609-a85e-eaf29a9723a5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:59.099758 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ebd8d5b-f685-476c-9728-3488a60709a5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:59.102491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ebd8d5b-f685-476c-9728-3488a60709a5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:59.102910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f6c92676-5883-41e8-ac83-c75f785a342d req-4ae45591-a0f0-4609-a85e-eaf29a9723a5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:59.105762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ebd8d5b-f685-476c-9728-3488a60709a5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:59.116184 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-f6c92676-5883-41e8-ac83-c75f785a342d req-4ae45591-a0f0-4609-a85e-eaf29a9723a5 service nova] Creating event network-changed:c9d1fdbe-2e15-40f2-b3c2-b069844d3161 for instance 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 on n-h1-849328-3 Aug 24 10:55:59.125813 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-f6c92676-5883-41e8-ac83-c75f785a342d req-4ae45591-a0f0-4609-a85e-eaf29a9723a5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078749 Aug 24 10:55:59.128544 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3352/6348] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:55:59.468030 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3ebd8d5b-f685-476c-9728-3488a60709a5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:55:59.486076 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3ebd8d5b-f685-476c-9728-3488a60709a5 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 200 len: 1563 microversion: 2.1 time: 0.440927 Aug 24 10:55:59.504134 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2997/6349] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:59 2022] GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 1563 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:55:59.754972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3f6526ae-de4f-41f9-a361-94949f04b9f7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:55:59.755676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3f6526ae-de4f-41f9-a361-94949f04b9f7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:55:59.763492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f6526ae-de4f-41f9-a361-94949f04b9f7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:59.764487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f6526ae-de4f-41f9-a361-94949f04b9f7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:59.765300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f6526ae-de4f-41f9-a361-94949f04b9f7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:55:59.766260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f6526ae-de4f-41f9-a361-94949f04b9f7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:55:59.767035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f6526ae-de4f-41f9-a361-94949f04b9f7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:55:59.767765 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f6526ae-de4f-41f9-a361-94949f04b9f7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:00.026248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3f6526ae-de4f-41f9-a361-94949f04b9f7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:00.036687 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3f6526ae-de4f-41f9-a361-94949f04b9f7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 200 len: 1278 microversion: 2.1 time: 0.288465 Aug 24 10:56:00.037317 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3353/6350] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:55:59 2022] GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 1278 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:00.851130 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0553cb72-b5fa-4e85-9a88-9bb88234c09d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1241757644", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "a7f46039-2c34-4bba-b65f-2e3d596297a0"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:56:00.915228 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-0553cb72-b5fa-4e85-9a88-9bb88234c09d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] validate_networks() for [('a7f46039-2c34-4bba-b65f-2e3d596297a0', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:56:01.060003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-00bcca99-33fb-455a-8e30-b7073f46ce61 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:01.060635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-00bcca99-33fb-455a-8e30-b7073f46ce61 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:01.067786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00bcca99-33fb-455a-8e30-b7073f46ce61 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:01.068268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00bcca99-33fb-455a-8e30-b7073f46ce61 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:01.068710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00bcca99-33fb-455a-8e30-b7073f46ce61 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:01.069658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00bcca99-33fb-455a-8e30-b7073f46ce61 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:01.070359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00bcca99-33fb-455a-8e30-b7073f46ce61 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:01.071028 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00bcca99-33fb-455a-8e30-b7073f46ce61 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:01.281700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-00bcca99-33fb-455a-8e30-b7073f46ce61 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:01.292129 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-00bcca99-33fb-455a-8e30-b7073f46ce61 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 200 len: 1266 microversion: 2.1 time: 0.236691 Aug 24 10:56:01.293045 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3354/6351] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:01 2022] GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:56:01.332547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0553cb72-b5fa-4e85-9a88-9bb88234c09d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:56:01.333108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0553cb72-b5fa-4e85-9a88-9bb88234c09d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:56:01.333775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0553cb72-b5fa-4e85-9a88-9bb88234c09d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:56:01.334421 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0553cb72-b5fa-4e85-9a88-9bb88234c09d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:56:01.334907 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0553cb72-b5fa-4e85-9a88-9bb88234c09d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:56:01.344263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0553cb72-b5fa-4e85-9a88-9bb88234c09d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:01.344823 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0553cb72-b5fa-4e85-9a88-9bb88234c09d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:01.345578 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0553cb72-b5fa-4e85-9a88-9bb88234c09d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:01.346369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0553cb72-b5fa-4e85-9a88-9bb88234c09d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:01.346890 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0553cb72-b5fa-4e85-9a88-9bb88234c09d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:01.347382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0553cb72-b5fa-4e85-9a88-9bb88234c09d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:01.364829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-0553cb72-b5fa-4e85-9a88-9bb88234c09d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Getting quotas for project fee612fd19a14212b3ed146810b8b54f. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:56:01.370778 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-0553cb72-b5fa-4e85-9a88-9bb88234c09d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Getting quotas for user 0d6d8782da4e44e1b99d43bf03c16f0b and project fee612fd19a14212b3ed146810b8b54f. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:56:01.383890 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0553cb72-b5fa-4e85-9a88-9bb88234c09d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:56:01.386171 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0553cb72-b5fa-4e85-9a88-9bb88234c09d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:56:01.431200 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0553cb72-b5fa-4e85-9a88-9bb88234c09d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765449 Aug 24 10:56:01.432075 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2998/6352] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:56:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:56:01.443481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-95485f60-51fb-4e8e-869c-4a8412a34725 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:01.443713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-95485f60-51fb-4e8e-869c-4a8412a34725 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:01.520972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-95485f60-51fb-4e8e-869c-4a8412a34725 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6d8782da4e44e1b99d43bf03c16f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee612fd19a14212b3ed146810b8b54f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:01.550018 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-95485f60-51fb-4e8e-869c-4a8412a34725 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576" status: 200 len: 1215 microversion: 2.1 time: 0.109365 Aug 24 10:56:01.551048 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3355/6353] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:01 2022] GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576 => generated 1215 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:02.315445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c1b224ab-c343-43e6-89d2-9b99b371c508 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:02.316047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c1b224ab-c343-43e6-89d2-9b99b371c508 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:02.322619 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1b224ab-c343-43e6-89d2-9b99b371c508 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:02.323108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1b224ab-c343-43e6-89d2-9b99b371c508 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:02.323549 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1b224ab-c343-43e6-89d2-9b99b371c508 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:02.324245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1b224ab-c343-43e6-89d2-9b99b371c508 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:02.324683 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1b224ab-c343-43e6-89d2-9b99b371c508 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:02.325108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1b224ab-c343-43e6-89d2-9b99b371c508 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:02.470101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c1b224ab-c343-43e6-89d2-9b99b371c508 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:02.482094 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c1b224ab-c343-43e6-89d2-9b99b371c508 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 200 len: 1266 microversion: 2.1 time: 0.171379 Aug 24 10:56:02.482783 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2999/6354] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:02 2022] GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:02.570680 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-10542658-5c79-4136-b2c1-b58f572f456f tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:02.571402 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-10542658-5c79-4136-b2c1-b58f572f456f tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:02.579758 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10542658-5c79-4136-b2c1-b58f572f456f tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:02.580429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10542658-5c79-4136-b2c1-b58f572f456f tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:02.580886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10542658-5c79-4136-b2c1-b58f572f456f tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:02.582161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10542658-5c79-4136-b2c1-b58f572f456f tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:02.582691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10542658-5c79-4136-b2c1-b58f572f456f tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:02.583255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10542658-5c79-4136-b2c1-b58f572f456f tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:02.675815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-10542658-5c79-4136-b2c1-b58f572f456f tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6d8782da4e44e1b99d43bf03c16f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee612fd19a14212b3ed146810b8b54f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:02.687723 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-10542658-5c79-4136-b2c1-b58f572f456f tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576" status: 200 len: 1285 microversion: 2.1 time: 0.121008 Aug 24 10:56:02.688414 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3356/6355] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:02 2022] GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576 => generated 1285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:03.503572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4b978d32-e547-4cbd-9be5-71458f1c2bfe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:03.505587 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4b978d32-e547-4cbd-9be5-71458f1c2bfe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:03.512695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b978d32-e547-4cbd-9be5-71458f1c2bfe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:03.513210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b978d32-e547-4cbd-9be5-71458f1c2bfe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:03.513645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b978d32-e547-4cbd-9be5-71458f1c2bfe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:03.514552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b978d32-e547-4cbd-9be5-71458f1c2bfe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:03.515000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b978d32-e547-4cbd-9be5-71458f1c2bfe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:03.515423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b978d32-e547-4cbd-9be5-71458f1c2bfe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:03.709311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b5779a06-0b08-4399-9c4e-206d00536dc2 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:03.710029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b5779a06-0b08-4399-9c4e-206d00536dc2 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:03.717929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5779a06-0b08-4399-9c4e-206d00536dc2 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:03.718442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5779a06-0b08-4399-9c4e-206d00536dc2 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:03.718889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5779a06-0b08-4399-9c4e-206d00536dc2 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:03.719800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5779a06-0b08-4399-9c4e-206d00536dc2 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:03.720459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5779a06-0b08-4399-9c4e-206d00536dc2 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:03.720901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5779a06-0b08-4399-9c4e-206d00536dc2 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:03.726593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4b978d32-e547-4cbd-9be5-71458f1c2bfe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:03.734790 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4b978d32-e547-4cbd-9be5-71458f1c2bfe tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 200 len: 1266 microversion: 2.1 time: 0.234916 Aug 24 10:56:03.748503 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3000/6356] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:03 2022] GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:03.871916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b5779a06-0b08-4399-9c4e-206d00536dc2 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6d8782da4e44e1b99d43bf03c16f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee612fd19a14212b3ed146810b8b54f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:03.886735 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b5779a06-0b08-4399-9c4e-206d00536dc2 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576" status: 200 len: 1315 microversion: 2.1 time: 0.181509 Aug 24 10:56:03.887536 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3357/6357] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:03 2022] GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:04.035932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3055f457-9d05-4386-9280-6b4df4cd3a4f req-2c8dbf54-2cc6-4676-8c0b-d9419ab60fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb52f74d-4b91-4de4-9de5-17bdae601576", "tag": "d1a71849-8764-4fe6-9323-c061d3b66717"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:56:04.048865 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3055f457-9d05-4386-9280-6b4df4cd3a4f req-2c8dbf54-2cc6-4676-8c0b-d9419ab60fb2 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:04.050005 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3055f457-9d05-4386-9280-6b4df4cd3a4f req-2c8dbf54-2cc6-4676-8c0b-d9419ab60fb2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:04.051045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3055f457-9d05-4386-9280-6b4df4cd3a4f req-2c8dbf54-2cc6-4676-8c0b-d9419ab60fb2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:04.070879 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3055f457-9d05-4386-9280-6b4df4cd3a4f req-2c8dbf54-2cc6-4676-8c0b-d9419ab60fb2 service nova] Creating event network-changed:d1a71849-8764-4fe6-9323-c061d3b66717 for instance cb52f74d-4b91-4de4-9de5-17bdae601576 on n-h1-849328-3 Aug 24 10:56:04.078780 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3055f457-9d05-4386-9280-6b4df4cd3a4f req-2c8dbf54-2cc6-4676-8c0b-d9419ab60fb2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045910 Aug 24 10:56:04.080355 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3001/6358] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:56:04.759628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d4053921-1fac-4ad1-b6df-d80769ac4204 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:04.760677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d4053921-1fac-4ad1-b6df-d80769ac4204 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:04.770934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4053921-1fac-4ad1-b6df-d80769ac4204 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:04.771395 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4053921-1fac-4ad1-b6df-d80769ac4204 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:04.771859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4053921-1fac-4ad1-b6df-d80769ac4204 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:04.772586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4053921-1fac-4ad1-b6df-d80769ac4204 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:04.773310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4053921-1fac-4ad1-b6df-d80769ac4204 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:04.773994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4053921-1fac-4ad1-b6df-d80769ac4204 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:04.911506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aa04bd68-8862-415b-87b5-48395bd8fede tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:04.912230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aa04bd68-8862-415b-87b5-48395bd8fede tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:04.912422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d4053921-1fac-4ad1-b6df-d80769ac4204 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:04.919025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa04bd68-8862-415b-87b5-48395bd8fede tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:04.919506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa04bd68-8862-415b-87b5-48395bd8fede tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:04.919935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa04bd68-8862-415b-87b5-48395bd8fede tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:04.920624 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa04bd68-8862-415b-87b5-48395bd8fede tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:04.920734 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d4053921-1fac-4ad1-b6df-d80769ac4204 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 200 len: 1266 microversion: 2.1 time: 0.167676 Aug 24 10:56:04.921072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa04bd68-8862-415b-87b5-48395bd8fede tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:04.921657 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3358/6359] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:04 2022] GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:04.921777 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa04bd68-8862-415b-87b5-48395bd8fede tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:05.070508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aa04bd68-8862-415b-87b5-48395bd8fede tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6d8782da4e44e1b99d43bf03c16f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee612fd19a14212b3ed146810b8b54f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:05.078612 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aa04bd68-8862-415b-87b5-48395bd8fede tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576" status: 200 len: 1315 microversion: 2.1 time: 0.172112 Aug 24 10:56:05.079041 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3002/6360] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:04 2022] GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:05.942411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-845495b7-2a43-4afc-b896-88c650d25eff tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:05.943077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-845495b7-2a43-4afc-b896-88c650d25eff tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:05.949384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-845495b7-2a43-4afc-b896-88c650d25eff tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:05.949965 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-845495b7-2a43-4afc-b896-88c650d25eff tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:05.950456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-845495b7-2a43-4afc-b896-88c650d25eff tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:05.951145 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-845495b7-2a43-4afc-b896-88c650d25eff tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:05.951596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-845495b7-2a43-4afc-b896-88c650d25eff tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:05.952006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-845495b7-2a43-4afc-b896-88c650d25eff tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:06.101235 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd296380-271d-4950-abc7-9c202f3b2198 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:06.102099 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dd296380-271d-4950-abc7-9c202f3b2198 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:06.115992 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd296380-271d-4950-abc7-9c202f3b2198 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:06.116481 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd296380-271d-4950-abc7-9c202f3b2198 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:06.116914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd296380-271d-4950-abc7-9c202f3b2198 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:06.117651 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd296380-271d-4950-abc7-9c202f3b2198 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:06.118152 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd296380-271d-4950-abc7-9c202f3b2198 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:06.118574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd296380-271d-4950-abc7-9c202f3b2198 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:06.308449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-845495b7-2a43-4afc-b896-88c650d25eff tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:06.316359 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-845495b7-2a43-4afc-b896-88c650d25eff tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 200 len: 1266 microversion: 2.1 time: 0.378686 Aug 24 10:56:06.316958 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3359/6361] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:05 2022] GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 1266 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:06.358892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dd296380-271d-4950-abc7-9c202f3b2198 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6d8782da4e44e1b99d43bf03c16f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee612fd19a14212b3ed146810b8b54f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:06.367692 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dd296380-271d-4950-abc7-9c202f3b2198 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576" status: 200 len: 1315 microversion: 2.1 time: 0.270755 Aug 24 10:56:06.368293 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3003/6362] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:06 2022] GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:56:07.338599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1ddd8136-d96e-4d67-9442-f0c886f6a190 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:07.339218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1ddd8136-d96e-4d67-9442-f0c886f6a190 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:07.346469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ddd8136-d96e-4d67-9442-f0c886f6a190 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:07.346985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ddd8136-d96e-4d67-9442-f0c886f6a190 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:07.347439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ddd8136-d96e-4d67-9442-f0c886f6a190 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:07.348156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ddd8136-d96e-4d67-9442-f0c886f6a190 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:07.348766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ddd8136-d96e-4d67-9442-f0c886f6a190 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:07.349253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ddd8136-d96e-4d67-9442-f0c886f6a190 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:07.388453 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6b52c604-5f78-449e-a924-8a03f908c869 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:07.389160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6b52c604-5f78-449e-a924-8a03f908c869 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:07.396872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b52c604-5f78-449e-a924-8a03f908c869 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:07.397509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b52c604-5f78-449e-a924-8a03f908c869 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:07.398064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b52c604-5f78-449e-a924-8a03f908c869 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:07.398880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b52c604-5f78-449e-a924-8a03f908c869 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:07.399563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b52c604-5f78-449e-a924-8a03f908c869 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:07.400087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b52c604-5f78-449e-a924-8a03f908c869 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:07.485906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1ddd8136-d96e-4d67-9442-f0c886f6a190 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:07.500335 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1ddd8136-d96e-4d67-9442-f0c886f6a190 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 200 len: 1266 microversion: 2.1 time: 0.166101 Aug 24 10:56:07.501223 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3360/6363] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:07 2022] GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:07.547874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6b52c604-5f78-449e-a924-8a03f908c869 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6d8782da4e44e1b99d43bf03c16f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee612fd19a14212b3ed146810b8b54f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:07.555829 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6b52c604-5f78-449e-a924-8a03f908c869 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576" status: 200 len: 1315 microversion: 2.1 time: 0.171386 Aug 24 10:56:07.556419 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3004/6364] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:07 2022] GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:08.520730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-684d4a0f-7022-4ce6-8db1-4c3978f376e2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:08.522027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-684d4a0f-7022-4ce6-8db1-4c3978f376e2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:08.529935 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-684d4a0f-7022-4ce6-8db1-4c3978f376e2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:08.530535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-684d4a0f-7022-4ce6-8db1-4c3978f376e2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:08.531011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-684d4a0f-7022-4ce6-8db1-4c3978f376e2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:08.531981 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-684d4a0f-7022-4ce6-8db1-4c3978f376e2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:08.532481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-684d4a0f-7022-4ce6-8db1-4c3978f376e2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:08.533171 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-684d4a0f-7022-4ce6-8db1-4c3978f376e2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:08.555777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:08.580449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e391f6f6-adad-4b2c-8fe4-00a525f9db7c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:08.582289 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e391f6f6-adad-4b2c-8fe4-00a525f9db7c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:08.587002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=9 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:08.607698 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e391f6f6-adad-4b2c-8fe4-00a525f9db7c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:08.608605 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e391f6f6-adad-4b2c-8fe4-00a525f9db7c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:08.609348 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e391f6f6-adad-4b2c-8fe4-00a525f9db7c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:08.610612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e391f6f6-adad-4b2c-8fe4-00a525f9db7c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:08.611427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e391f6f6-adad-4b2c-8fe4-00a525f9db7c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:08.612191 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e391f6f6-adad-4b2c-8fe4-00a525f9db7c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:08.931144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e391f6f6-adad-4b2c-8fe4-00a525f9db7c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6d8782da4e44e1b99d43bf03c16f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee612fd19a14212b3ed146810b8b54f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:08.941448 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e391f6f6-adad-4b2c-8fe4-00a525f9db7c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576" status: 200 len: 1315 microversion: 2.1 time: 0.368849 Aug 24 10:56:08.956502 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3005/6365] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:08 2022] GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576 => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:09.086306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d2e364b1-dd6e-4bc3-a1b3-a5a235fe5ec2 req-22531934-4661-478c-9504-7e4584b89b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb52f74d-4b91-4de4-9de5-17bdae601576", "name": "network-vif-plugged", "status": "completed", "tag": "d1a71849-8764-4fe6-9323-c061d3b66717"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:56:09.107221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d2e364b1-dd6e-4bc3-a1b3-a5a235fe5ec2 req-22531934-4661-478c-9504-7e4584b89b24 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:09.109191 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d2e364b1-dd6e-4bc3-a1b3-a5a235fe5ec2 req-22531934-4661-478c-9504-7e4584b89b24 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:09.109808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d2e364b1-dd6e-4bc3-a1b3-a5a235fe5ec2 req-22531934-4661-478c-9504-7e4584b89b24 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:09.147509 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d2e364b1-dd6e-4bc3-a1b3-a5a235fe5ec2 req-22531934-4661-478c-9504-7e4584b89b24 service nova] Creating event network-vif-plugged:d1a71849-8764-4fe6-9323-c061d3b66717 for instance cb52f74d-4b91-4de4-9de5-17bdae601576 on n-h1-849328-3 Aug 24 10:56:09.165998 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d2e364b1-dd6e-4bc3-a1b3-a5a235fe5ec2 req-22531934-4661-478c-9504-7e4584b89b24 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080636 Aug 24 10:56:09.167755 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3006/6366] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:56:09.301378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-684d4a0f-7022-4ce6-8db1-4c3978f376e2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:09.311500 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-684d4a0f-7022-4ce6-8db1-4c3978f376e2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 200 len: 1266 microversion: 2.1 time: 0.794538 Aug 24 10:56:09.312155 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3361/6367] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:08 2022] GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 1266 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:09.965545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eceb4e84-40f5-425a-accc-f96f1e40282e tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:09.966233 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eceb4e84-40f5-425a-accc-f96f1e40282e tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:09.972982 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eceb4e84-40f5-425a-accc-f96f1e40282e tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:09.973635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eceb4e84-40f5-425a-accc-f96f1e40282e tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:09.974075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eceb4e84-40f5-425a-accc-f96f1e40282e tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:09.974773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eceb4e84-40f5-425a-accc-f96f1e40282e tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:09.975264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eceb4e84-40f5-425a-accc-f96f1e40282e tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:09.975694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eceb4e84-40f5-425a-accc-f96f1e40282e tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:09.994196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:10.128842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eceb4e84-40f5-425a-accc-f96f1e40282e tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6d8782da4e44e1b99d43bf03c16f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee612fd19a14212b3ed146810b8b54f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:10.137419 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eceb4e84-40f5-425a-accc-f96f1e40282e tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576" status: 200 len: 1315 microversion: 2.1 time: 0.177407 Aug 24 10:56:10.138018 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3007/6368] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:09 2022] GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:10.334092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-be99eccb-bc9b-4c97-ac6f-18a9457c0c42 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:10.334861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-be99eccb-bc9b-4c97-ac6f-18a9457c0c42 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:10.342671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be99eccb-bc9b-4c97-ac6f-18a9457c0c42 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:10.343174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be99eccb-bc9b-4c97-ac6f-18a9457c0c42 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:10.343597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be99eccb-bc9b-4c97-ac6f-18a9457c0c42 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:10.344299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be99eccb-bc9b-4c97-ac6f-18a9457c0c42 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:10.344762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be99eccb-bc9b-4c97-ac6f-18a9457c0c42 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:10.345229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be99eccb-bc9b-4c97-ac6f-18a9457c0c42 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:10.480876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-be99eccb-bc9b-4c97-ac6f-18a9457c0c42 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:10.491311 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-be99eccb-bc9b-4c97-ac6f-18a9457c0c42 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 200 len: 1266 microversion: 2.1 time: 0.161065 Aug 24 10:56:10.499631 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3362/6369] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:10 2022] GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:11.158424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b7298768-68a5-466e-9522-3d7dd6ed4c76 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:11.159024 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b7298768-68a5-466e-9522-3d7dd6ed4c76 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:11.167749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7298768-68a5-466e-9522-3d7dd6ed4c76 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:11.168255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7298768-68a5-466e-9522-3d7dd6ed4c76 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:11.168754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7298768-68a5-466e-9522-3d7dd6ed4c76 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:11.169571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7298768-68a5-466e-9522-3d7dd6ed4c76 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:11.170023 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7298768-68a5-466e-9522-3d7dd6ed4c76 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:11.170440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7298768-68a5-466e-9522-3d7dd6ed4c76 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:11.182639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-54c787d0-470b-4df9-a894-c4b4e9d67772 req-2226e698-6cfc-4256-b41e-0833194b016b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30efa0e8-e35a-4785-bb4c-fc0354bec60b", "name": "network-vif-plugged", "status": "completed", "tag": "3d8fbecc-df04-4d22-855e-b0912b1a1cc3"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:56:11.192703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-54c787d0-470b-4df9-a894-c4b4e9d67772 req-2226e698-6cfc-4256-b41e-0833194b016b service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:11.193202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-54c787d0-470b-4df9-a894-c4b4e9d67772 req-2226e698-6cfc-4256-b41e-0833194b016b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:11.193878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-54c787d0-470b-4df9-a894-c4b4e9d67772 req-2226e698-6cfc-4256-b41e-0833194b016b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:11.205431 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-54c787d0-470b-4df9-a894-c4b4e9d67772 req-2226e698-6cfc-4256-b41e-0833194b016b service nova] Creating event network-vif-plugged:3d8fbecc-df04-4d22-855e-b0912b1a1cc3 for instance 30efa0e8-e35a-4785-bb4c-fc0354bec60b on n-h2-849328-3 Aug 24 10:56:11.210525 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-54c787d0-470b-4df9-a894-c4b4e9d67772 req-2226e698-6cfc-4256-b41e-0833194b016b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031696 Aug 24 10:56:11.211146 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3363/6370] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:56:11.332478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b7298768-68a5-466e-9522-3d7dd6ed4c76 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6d8782da4e44e1b99d43bf03c16f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee612fd19a14212b3ed146810b8b54f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:11.341492 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b7298768-68a5-466e-9522-3d7dd6ed4c76 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576" status: 200 len: 1503 microversion: 2.1 time: 0.186967 Aug 24 10:56:11.342105 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3008/6371] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:11 2022] GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576 => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:11.363729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cc748c1c-eb81-4a1f-b263-b146c42cbdfd tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:11.364438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cc748c1c-eb81-4a1f-b263-b146c42cbdfd tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:11.370752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc748c1c-eb81-4a1f-b263-b146c42cbdfd tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:11.371249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc748c1c-eb81-4a1f-b263-b146c42cbdfd tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:11.371697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc748c1c-eb81-4a1f-b263-b146c42cbdfd tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:11.372402 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc748c1c-eb81-4a1f-b263-b146c42cbdfd tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:11.372865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc748c1c-eb81-4a1f-b263-b146c42cbdfd tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:11.373337 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc748c1c-eb81-4a1f-b263-b146c42cbdfd tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:11.513419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cc748c1c-eb81-4a1f-b263-b146c42cbdfd tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6d8782da4e44e1b99d43bf03c16f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee612fd19a14212b3ed146810b8b54f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:11.519144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a54dc0ba-fa2e-4f3a-9a2d-78efa2cdac95 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:11.519959 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a54dc0ba-fa2e-4f3a-9a2d-78efa2cdac95 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:11.521908 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cc748c1c-eb81-4a1f-b263-b146c42cbdfd tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576" status: 200 len: 1503 microversion: 2.1 time: 0.163284 Aug 24 10:56:11.522508 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3364/6372] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:11 2022] GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576 => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:11.526004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:11.526925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=18 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:11.528521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a54dc0ba-fa2e-4f3a-9a2d-78efa2cdac95 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:11.529202 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a54dc0ba-fa2e-4f3a-9a2d-78efa2cdac95 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:11.529834 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a54dc0ba-fa2e-4f3a-9a2d-78efa2cdac95 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:11.530722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a54dc0ba-fa2e-4f3a-9a2d-78efa2cdac95 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:11.531335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a54dc0ba-fa2e-4f3a-9a2d-78efa2cdac95 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:11.531917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a54dc0ba-fa2e-4f3a-9a2d-78efa2cdac95 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:11.544441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c410f9f9-408a-4bdf-8c8d-75fdbf56fdfb tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:56:11.545016 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c410f9f9-408a-4bdf-8c8d-75fdbf56fdfb tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:11.547092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:11.553029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c410f9f9-408a-4bdf-8c8d-75fdbf56fdfb tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:11.553593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c410f9f9-408a-4bdf-8c8d-75fdbf56fdfb tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:11.554066 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c410f9f9-408a-4bdf-8c8d-75fdbf56fdfb tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:11.554782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c410f9f9-408a-4bdf-8c8d-75fdbf56fdfb tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:11.555259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c410f9f9-408a-4bdf-8c8d-75fdbf56fdfb tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:11.555706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c410f9f9-408a-4bdf-8c8d-75fdbf56fdfb tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:11.581659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-c410f9f9-408a-4bdf-8c8d-75fdbf56fdfb tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lazy-loading 'flavor' on Instance uuid cb52f74d-4b91-4de4-9de5-17bdae601576 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:56:11.666141 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c410f9f9-408a-4bdf-8c8d-75fdbf56fdfb tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "POST /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576/action" status: 202 len: 0 microversion: 2.1 time: 0.125126 Aug 24 10:56:11.669448 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3365/6373] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:56:11 2022] POST /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:56:11.679078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a4d05259-c467-44ef-94c6-4609fa4a951c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:11.680643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a4d05259-c467-44ef-94c6-4609fa4a951c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:11.690145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a54dc0ba-fa2e-4f3a-9a2d-78efa2cdac95 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:11.698207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4d05259-c467-44ef-94c6-4609fa4a951c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:11.698726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4d05259-c467-44ef-94c6-4609fa4a951c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:11.699181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4d05259-c467-44ef-94c6-4609fa4a951c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:11.699305 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a54dc0ba-fa2e-4f3a-9a2d-78efa2cdac95 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 200 len: 1266 microversion: 2.1 time: 0.190656 Aug 24 10:56:11.699903 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3009/6374] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:11 2022] GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:11.700058 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4d05259-c467-44ef-94c6-4609fa4a951c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:11.700371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4d05259-c467-44ef-94c6-4609fa4a951c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:11.700803 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4d05259-c467-44ef-94c6-4609fa4a951c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:11.845146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a4d05259-c467-44ef-94c6-4609fa4a951c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6d8782da4e44e1b99d43bf03c16f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee612fd19a14212b3ed146810b8b54f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:11.853890 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a4d05259-c467-44ef-94c6-4609fa4a951c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576" status: 200 len: 1511 microversion: 2.1 time: 0.182252 Aug 24 10:56:11.854606 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3366/6375] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:11 2022] GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576 => generated 1511 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:56:12.720809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-404eb4b1-6059-4bdc-b04e-0f23a367fbf7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:12.721519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-404eb4b1-6059-4bdc-b04e-0f23a367fbf7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:12.728752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-404eb4b1-6059-4bdc-b04e-0f23a367fbf7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:12.729290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-404eb4b1-6059-4bdc-b04e-0f23a367fbf7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:12.729724 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-404eb4b1-6059-4bdc-b04e-0f23a367fbf7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:12.730429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-404eb4b1-6059-4bdc-b04e-0f23a367fbf7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:12.730879 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-404eb4b1-6059-4bdc-b04e-0f23a367fbf7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:12.731298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-404eb4b1-6059-4bdc-b04e-0f23a367fbf7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:12.870059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-404eb4b1-6059-4bdc-b04e-0f23a367fbf7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:12.875824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3bdee70a-dca4-43dc-baba-6d4069027313 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:12.876379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3bdee70a-dca4-43dc-baba-6d4069027313 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:12.878928 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-404eb4b1-6059-4bdc-b04e-0f23a367fbf7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 200 len: 1453 microversion: 2.1 time: 0.162128 Aug 24 10:56:12.879630 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3010/6376] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:12 2022] GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:12.883731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bdee70a-dca4-43dc-baba-6d4069027313 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:12.884223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bdee70a-dca4-43dc-baba-6d4069027313 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:12.884666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bdee70a-dca4-43dc-baba-6d4069027313 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:12.885394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bdee70a-dca4-43dc-baba-6d4069027313 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:12.885856 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bdee70a-dca4-43dc-baba-6d4069027313 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:12.886283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bdee70a-dca4-43dc-baba-6d4069027313 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:12.902337 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cc46a6b3-c2b6-4cdc-bf6d-d7d1dd7e4575 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:12.903279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cc46a6b3-c2b6-4cdc-bf6d-d7d1dd7e4575 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:12.909249 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc46a6b3-c2b6-4cdc-bf6d-d7d1dd7e4575 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:12.909729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc46a6b3-c2b6-4cdc-bf6d-d7d1dd7e4575 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:12.910158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc46a6b3-c2b6-4cdc-bf6d-d7d1dd7e4575 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:12.910829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc46a6b3-c2b6-4cdc-bf6d-d7d1dd7e4575 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:12.911466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc46a6b3-c2b6-4cdc-bf6d-d7d1dd7e4575 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:12.911970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc46a6b3-c2b6-4cdc-bf6d-d7d1dd7e4575 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:13.043185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3bdee70a-dca4-43dc-baba-6d4069027313 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6d8782da4e44e1b99d43bf03c16f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee612fd19a14212b3ed146810b8b54f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:13.052100 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3bdee70a-dca4-43dc-baba-6d4069027313 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576" status: 200 len: 1494 microversion: 2.1 time: 0.180170 Aug 24 10:56:13.066493 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3367/6377] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:12 2022] GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576 => generated 1494 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:56:13.073535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9700ede2-3c39-4328-8e4f-135a39ce5fa3 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:56:13.074308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9700ede2-3c39-4328-8e4f-135a39ce5fa3 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:13.080658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9700ede2-3c39-4328-8e4f-135a39ce5fa3 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:13.081509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9700ede2-3c39-4328-8e4f-135a39ce5fa3 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:13.082118 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9700ede2-3c39-4328-8e4f-135a39ce5fa3 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:13.083124 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9700ede2-3c39-4328-8e4f-135a39ce5fa3 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:13.083797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9700ede2-3c39-4328-8e4f-135a39ce5fa3 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:13.084377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9700ede2-3c39-4328-8e4f-135a39ce5fa3 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:13.091562 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cc46a6b3-c2b6-4cdc-bf6d-d7d1dd7e4575 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:13.099753 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cc46a6b3-c2b6-4cdc-bf6d-d7d1dd7e4575 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 200 len: 1453 microversion: 2.1 time: 0.201432 Aug 24 10:56:13.109590 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3011/6378] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:12 2022] GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 1453 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:13.183299 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9700ede2-3c39-4328-8e4f-135a39ce5fa3 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "POST /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576/action" status: 202 len: 0 microversion: 2.1 time: 0.113484 Aug 24 10:56:13.185225 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3368/6379] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:56:13 2022] POST /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 10:56:13.195227 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-08333af2-c168-4068-8005-541a2d68f6be tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:13.196757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-08333af2-c168-4068-8005-541a2d68f6be tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:13.208815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08333af2-c168-4068-8005-541a2d68f6be tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:13.210919 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08333af2-c168-4068-8005-541a2d68f6be tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:13.212105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08333af2-c168-4068-8005-541a2d68f6be tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:13.213774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08333af2-c168-4068-8005-541a2d68f6be tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:13.214241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08333af2-c168-4068-8005-541a2d68f6be tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:13.214718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08333af2-c168-4068-8005-541a2d68f6be tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:13.490049 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-08333af2-c168-4068-8005-541a2d68f6be tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6d8782da4e44e1b99d43bf03c16f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee612fd19a14212b3ed146810b8b54f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:13.506386 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-08333af2-c168-4068-8005-541a2d68f6be tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576" status: 200 len: 1500 microversion: 2.1 time: 0.316569 Aug 24 10:56:13.507190 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3012/6380] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:13 2022] GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576 => generated 1500 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:14.529846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b142f881-1026-4024-8ed5-80784b566d6d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:14.531260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b142f881-1026-4024-8ed5-80784b566d6d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:14.538160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=65 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:14.540652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b142f881-1026-4024-8ed5-80784b566d6d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:14.541495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b142f881-1026-4024-8ed5-80784b566d6d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:14.543370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b142f881-1026-4024-8ed5-80784b566d6d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:14.544314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b142f881-1026-4024-8ed5-80784b566d6d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:14.545057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b142f881-1026-4024-8ed5-80784b566d6d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:14.545833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b142f881-1026-4024-8ed5-80784b566d6d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:14.760002 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b142f881-1026-4024-8ed5-80784b566d6d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6d8782da4e44e1b99d43bf03c16f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee612fd19a14212b3ed146810b8b54f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:14.769177 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b142f881-1026-4024-8ed5-80784b566d6d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576" status: 200 len: 1500 microversion: 2.1 time: 0.245201 Aug 24 10:56:14.770254 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3369/6381] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:14 2022] GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576 => generated 1500 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:15.423134 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3973385a-3241-4154-8f5d-776469e996b7 req-a629dacb-c6c0-468b-8fc8-d4f3b2f11ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30efa0e8-e35a-4785-bb4c-fc0354bec60b", "tag": "3d8fbecc-df04-4d22-855e-b0912b1a1cc3"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:56:15.435171 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3973385a-3241-4154-8f5d-776469e996b7 req-a629dacb-c6c0-468b-8fc8-d4f3b2f11ad9 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:15.435877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3973385a-3241-4154-8f5d-776469e996b7 req-a629dacb-c6c0-468b-8fc8-d4f3b2f11ad9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:15.436313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3973385a-3241-4154-8f5d-776469e996b7 req-a629dacb-c6c0-468b-8fc8-d4f3b2f11ad9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:15.448469 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3973385a-3241-4154-8f5d-776469e996b7 req-a629dacb-c6c0-468b-8fc8-d4f3b2f11ad9 service nova] Creating event network-changed:3d8fbecc-df04-4d22-855e-b0912b1a1cc3 for instance 30efa0e8-e35a-4785-bb4c-fc0354bec60b on n-h2-849328-3 Aug 24 10:56:15.454216 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3973385a-3241-4154-8f5d-776469e996b7 req-a629dacb-c6c0-468b-8fc8-d4f3b2f11ad9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035691 Aug 24 10:56:15.455062 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3013/6382] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:56:15.796526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-65f404bf-26b5-4e33-b12a-874e30a52e3d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:15.797184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-65f404bf-26b5-4e33-b12a-874e30a52e3d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:15.807422 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65f404bf-26b5-4e33-b12a-874e30a52e3d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:15.808302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65f404bf-26b5-4e33-b12a-874e30a52e3d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:15.809244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65f404bf-26b5-4e33-b12a-874e30a52e3d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:15.810572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65f404bf-26b5-4e33-b12a-874e30a52e3d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:15.811261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65f404bf-26b5-4e33-b12a-874e30a52e3d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:15.812198 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65f404bf-26b5-4e33-b12a-874e30a52e3d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:16.052067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-65f404bf-26b5-4e33-b12a-874e30a52e3d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6d8782da4e44e1b99d43bf03c16f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee612fd19a14212b3ed146810b8b54f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:16.062076 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-65f404bf-26b5-4e33-b12a-874e30a52e3d tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576" status: 200 len: 1503 microversion: 2.1 time: 0.269057 Aug 24 10:56:16.063787 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3370/6383] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:15 2022] GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576 => generated 1503 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:16.084996 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-47a34188-9d6d-427a-bf14-d6aaf4e21e4c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:56:16.085982 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-47a34188-9d6d-427a-bf14-d6aaf4e21e4c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:16.092774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47a34188-9d6d-427a-bf14-d6aaf4e21e4c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:16.093569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47a34188-9d6d-427a-bf14-d6aaf4e21e4c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:16.094106 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47a34188-9d6d-427a-bf14-d6aaf4e21e4c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:16.094978 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47a34188-9d6d-427a-bf14-d6aaf4e21e4c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:16.095573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47a34188-9d6d-427a-bf14-d6aaf4e21e4c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:16.096092 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47a34188-9d6d-427a-bf14-d6aaf4e21e4c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:16.123367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-47a34188-9d6d-427a-bf14-d6aaf4e21e4c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lazy-loading 'flavor' on Instance uuid cb52f74d-4b91-4de4-9de5-17bdae601576 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:56:16.205742 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-47a34188-9d6d-427a-bf14-d6aaf4e21e4c tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "POST /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576/action" status: 202 len: 0 microversion: 2.1 time: 0.124961 Aug 24 10:56:16.206860 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3014/6384] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:56:16 2022] POST /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:56:16.224246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e93658b8-6a7d-4ca1-9b9b-7cc0e49fe43b tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:16.226446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e93658b8-6a7d-4ca1-9b9b-7cc0e49fe43b tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:16.238274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e93658b8-6a7d-4ca1-9b9b-7cc0e49fe43b tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:16.240169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e93658b8-6a7d-4ca1-9b9b-7cc0e49fe43b tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:16.241502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e93658b8-6a7d-4ca1-9b9b-7cc0e49fe43b tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:16.242570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e93658b8-6a7d-4ca1-9b9b-7cc0e49fe43b tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:16.243235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e93658b8-6a7d-4ca1-9b9b-7cc0e49fe43b tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:16.243811 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e93658b8-6a7d-4ca1-9b9b-7cc0e49fe43b tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:16.393028 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e93658b8-6a7d-4ca1-9b9b-7cc0e49fe43b tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6d8782da4e44e1b99d43bf03c16f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee612fd19a14212b3ed146810b8b54f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:16.403602 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e93658b8-6a7d-4ca1-9b9b-7cc0e49fe43b tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576" status: 200 len: 1511 microversion: 2.1 time: 0.191591 Aug 24 10:56:16.404211 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3371/6385] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:16 2022] GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576 => generated 1511 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:17.425885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c7ee0bc8-b2df-48a0-9c67-4432db9ce86a tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:17.426608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c7ee0bc8-b2df-48a0-9c67-4432db9ce86a tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:17.432974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7ee0bc8-b2df-48a0-9c67-4432db9ce86a tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:17.433494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7ee0bc8-b2df-48a0-9c67-4432db9ce86a tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:17.433930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7ee0bc8-b2df-48a0-9c67-4432db9ce86a tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:17.434628 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7ee0bc8-b2df-48a0-9c67-4432db9ce86a tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:17.435071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7ee0bc8-b2df-48a0-9c67-4432db9ce86a tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:17.435497 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7ee0bc8-b2df-48a0-9c67-4432db9ce86a tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:17.573528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c7ee0bc8-b2df-48a0-9c67-4432db9ce86a tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6d8782da4e44e1b99d43bf03c16f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee612fd19a14212b3ed146810b8b54f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:17.581628 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c7ee0bc8-b2df-48a0-9c67-4432db9ce86a tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576" status: 200 len: 1494 microversion: 2.1 time: 0.160895 Aug 24 10:56:17.582210 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3015/6386] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:17 2022] GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576 => generated 1494 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:17.602912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-512b3db2-3032-42c6-bd01-93fe9043addf tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:56:17.604072 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-512b3db2-3032-42c6-bd01-93fe9043addf tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:17.613647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-512b3db2-3032-42c6-bd01-93fe9043addf tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:17.614397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-512b3db2-3032-42c6-bd01-93fe9043addf tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:17.615017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-512b3db2-3032-42c6-bd01-93fe9043addf tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:17.615888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-512b3db2-3032-42c6-bd01-93fe9043addf tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:17.617019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-512b3db2-3032-42c6-bd01-93fe9043addf tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:17.618291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-512b3db2-3032-42c6-bd01-93fe9043addf tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:17.700195 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-512b3db2-3032-42c6-bd01-93fe9043addf tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "POST /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576/action" status: 202 len: 0 microversion: 2.1 time: 0.101476 Aug 24 10:56:17.703927 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3372/6387] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:56:17 2022] POST /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:56:17.709643 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1f32969b-dee3-463b-bae4-f165e3284b27 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:17.710272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1f32969b-dee3-463b-bae4-f165e3284b27 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:17.717034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f32969b-dee3-463b-bae4-f165e3284b27 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:17.717581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f32969b-dee3-463b-bae4-f165e3284b27 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:17.718089 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f32969b-dee3-463b-bae4-f165e3284b27 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:17.718806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f32969b-dee3-463b-bae4-f165e3284b27 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:17.719266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f32969b-dee3-463b-bae4-f165e3284b27 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:17.719701 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f32969b-dee3-463b-bae4-f165e3284b27 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:18.278324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1f32969b-dee3-463b-bae4-f165e3284b27 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6d8782da4e44e1b99d43bf03c16f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee612fd19a14212b3ed146810b8b54f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:18.288054 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1f32969b-dee3-463b-bae4-f165e3284b27 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576" status: 200 len: 1500 microversion: 2.1 time: 0.582371 Aug 24 10:56:18.288634 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3016/6388] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:17 2022] GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576 => generated 1500 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:19.311894 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f6734eba-9b95-420d-a064-a7715349b650 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:19.312659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f6734eba-9b95-420d-a064-a7715349b650 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:19.319726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6734eba-9b95-420d-a064-a7715349b650 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:19.320274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6734eba-9b95-420d-a064-a7715349b650 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:19.320710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6734eba-9b95-420d-a064-a7715349b650 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:19.321530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6734eba-9b95-420d-a064-a7715349b650 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:19.322010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6734eba-9b95-420d-a064-a7715349b650 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:19.322490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6734eba-9b95-420d-a064-a7715349b650 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:19.458146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f6734eba-9b95-420d-a064-a7715349b650 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6d8782da4e44e1b99d43bf03c16f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee612fd19a14212b3ed146810b8b54f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:19.466744 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f6734eba-9b95-420d-a064-a7715349b650 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576" status: 200 len: 1503 microversion: 2.1 time: 0.160850 Aug 24 10:56:19.467337 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3373/6389] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:19 2022] GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:19.487043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-062be95d-1271-41e3-85d3-2324541b6bfa tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:19.487630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-062be95d-1271-41e3-85d3-2324541b6bfa tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:19.494875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-062be95d-1271-41e3-85d3-2324541b6bfa tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:19.495560 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-062be95d-1271-41e3-85d3-2324541b6bfa tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:19.496077 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-062be95d-1271-41e3-85d3-2324541b6bfa tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:19.496878 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-062be95d-1271-41e3-85d3-2324541b6bfa tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:19.497434 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-062be95d-1271-41e3-85d3-2324541b6bfa tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:19.497927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-062be95d-1271-41e3-85d3-2324541b6bfa tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:19.524952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-062be95d-1271-41e3-85d3-2324541b6bfa tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:56:19.604488 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-062be95d-1271-41e3-85d3-2324541b6bfa tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "DELETE /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576" status: 204 len: 0 microversion: 2.1 time: 0.120968 Aug 24 10:56:19.605060 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3017/6390] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:56:19 2022] DELETE /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:56:19.614257 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-68228368-e310-4fc0-bc33-9fe5ebf74dc6 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:19.615017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-68228368-e310-4fc0-bc33-9fe5ebf74dc6 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:19.621839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68228368-e310-4fc0-bc33-9fe5ebf74dc6 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:19.622489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68228368-e310-4fc0-bc33-9fe5ebf74dc6 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:19.622968 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68228368-e310-4fc0-bc33-9fe5ebf74dc6 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:19.623812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68228368-e310-4fc0-bc33-9fe5ebf74dc6 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:19.624375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68228368-e310-4fc0-bc33-9fe5ebf74dc6 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:19.624887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68228368-e310-4fc0-bc33-9fe5ebf74dc6 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:19.913248 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-37c9e0cb-dcca-4d32-bf04-8f41a022e291 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:56:19.916106 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-37c9e0cb-dcca-4d32-bf04-8f41a022e291 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:19.923083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37c9e0cb-dcca-4d32-bf04-8f41a022e291 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:19.924057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37c9e0cb-dcca-4d32-bf04-8f41a022e291 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:19.924729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37c9e0cb-dcca-4d32-bf04-8f41a022e291 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:19.925790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37c9e0cb-dcca-4d32-bf04-8f41a022e291 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:19.926573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37c9e0cb-dcca-4d32-bf04-8f41a022e291 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:19.927006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37c9e0cb-dcca-4d32-bf04-8f41a022e291 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:20.039665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-68228368-e310-4fc0-bc33-9fe5ebf74dc6 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6d8782da4e44e1b99d43bf03c16f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee612fd19a14212b3ed146810b8b54f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:20.047991 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-68228368-e310-4fc0-bc33-9fe5ebf74dc6 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576" status: 200 len: 1509 microversion: 2.1 time: 0.437914 Aug 24 10:56:20.048750 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3374/6391] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:19 2022] GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576 => generated 1509 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:21.070278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fcec0191-26dd-4ddc-883a-347343fe42c2 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:21.071041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fcec0191-26dd-4ddc-883a-347343fe42c2 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:21.080350 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcec0191-26dd-4ddc-883a-347343fe42c2 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:21.081061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcec0191-26dd-4ddc-883a-347343fe42c2 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:21.081704 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcec0191-26dd-4ddc-883a-347343fe42c2 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:21.082750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcec0191-26dd-4ddc-883a-347343fe42c2 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:21.083308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcec0191-26dd-4ddc-883a-347343fe42c2 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:21.083682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcec0191-26dd-4ddc-883a-347343fe42c2 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:21.089494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:21.235940 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fcec0191-26dd-4ddc-883a-347343fe42c2 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6d8782da4e44e1b99d43bf03c16f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee612fd19a14212b3ed146810b8b54f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:21.249510 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fcec0191-26dd-4ddc-883a-347343fe42c2 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576" status: 200 len: 1509 microversion: 2.1 time: 0.181189 Aug 24 10:56:21.249510 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3375/6392] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:21 2022] GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576 => generated 1509 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:56:21.353535 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-37c9e0cb-dcca-4d32-bf04-8f41a022e291 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "POST /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5/action" status: 200 len: 24575 microversion: 2.1 time: 1.444998 Aug 24 10:56:21.355432 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3018/6393] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:56:19 2022] POST /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5/action => generated 24575 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 10:56:22.163043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-6c922f4c-4a8a-4beb-8f8d-a322e992d082 req-72e92183-6819-450f-99ec-5fe23d0fded5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb52f74d-4b91-4de4-9de5-17bdae601576", "name": "network-vif-deleted", "tag": "d1a71849-8764-4fe6-9323-c061d3b66717"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:56:22.174195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6c922f4c-4a8a-4beb-8f8d-a322e992d082 req-72e92183-6819-450f-99ec-5fe23d0fded5 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:22.174698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6c922f4c-4a8a-4beb-8f8d-a322e992d082 req-72e92183-6819-450f-99ec-5fe23d0fded5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:22.175142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6c922f4c-4a8a-4beb-8f8d-a322e992d082 req-72e92183-6819-450f-99ec-5fe23d0fded5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:22.193242 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-6c922f4c-4a8a-4beb-8f8d-a322e992d082 req-72e92183-6819-450f-99ec-5fe23d0fded5 service nova] Creating event network-vif-deleted:d1a71849-8764-4fe6-9323-c061d3b66717 for instance cb52f74d-4b91-4de4-9de5-17bdae601576 on n-h1-849328-3 Aug 24 10:56:22.198724 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-6c922f4c-4a8a-4beb-8f8d-a322e992d082 req-72e92183-6819-450f-99ec-5fe23d0fded5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039594 Aug 24 10:56:22.199416 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3376/6394] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:56:22.269098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-29fb468a-1f5d-4622-8c9b-d06083c4ef75 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:22.269948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-29fb468a-1f5d-4622-8c9b-d06083c4ef75 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:22.278713 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29fb468a-1f5d-4622-8c9b-d06083c4ef75 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:22.279300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29fb468a-1f5d-4622-8c9b-d06083c4ef75 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:22.279806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29fb468a-1f5d-4622-8c9b-d06083c4ef75 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:22.280627 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29fb468a-1f5d-4622-8c9b-d06083c4ef75 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:22.281156 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29fb468a-1f5d-4622-8c9b-d06083c4ef75 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:22.281660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29fb468a-1f5d-4622-8c9b-d06083c4ef75 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:22.318766 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29fb468a-1f5d-4622-8c9b-d06083c4ef75 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:22.319255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29fb468a-1f5d-4622-8c9b-d06083c4ef75 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:22.319760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29fb468a-1f5d-4622-8c9b-d06083c4ef75 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:22.320283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-29fb468a-1f5d-4622-8c9b-d06083c4ef75 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lazy-loading 'fault' on Instance uuid cb52f74d-4b91-4de4-9de5-17bdae601576 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:56:22.369460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-29fb468a-1f5d-4622-8c9b-d06083c4ef75 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6d8782da4e44e1b99d43bf03c16f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee612fd19a14212b3ed146810b8b54f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:22.377597 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-29fb468a-1f5d-4622-8c9b-d06083c4ef75 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576" status: 200 len: 1305 microversion: 2.1 time: 0.113164 Aug 24 10:56:22.378210 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3019/6395] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:22 2022] GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576 => generated 1305 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:23.402501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-98dc5221-df67-4db2-97bb-50796677c616 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:23.403894 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-98dc5221-df67-4db2-97bb-50796677c616 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] [instance: cb52f74d-4b91-4de4-9de5-17bdae601576] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:23.412736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98dc5221-df67-4db2-97bb-50796677c616 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:23.413305 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98dc5221-df67-4db2-97bb-50796677c616 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:23.414268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98dc5221-df67-4db2-97bb-50796677c616 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:23.415141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98dc5221-df67-4db2-97bb-50796677c616 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:23.415616 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98dc5221-df67-4db2-97bb-50796677c616 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:23.416065 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98dc5221-df67-4db2-97bb-50796677c616 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:23.433128 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-98dc5221-df67-4db2-97bb-50796677c616 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] HTTP exception thrown: Instance cb52f74d-4b91-4de4-9de5-17bdae601576 could not be found. Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-98dc5221-df67-4db2-97bb-50796677c616 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Request method failure captured: Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576 HTTP/1.1 Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgO-z5IfikjLlymLcIxa0K5BkA-oGMtg3uhUznqGX9m_eTQN5Dz-XuHlMHBCH2w_Vhd6sRPP7j-av_Y6r-lwOPfaXcqV1ys4kVH0GSRrQ9nxhmG2ZigDNIseMkClf9X1-EGQLLaNB2PjMJmzvsM9WbHJ2DGZoR1dTQq19t5I4H0TE6E Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: fee612fd19a14212b3ed146810b8b54f Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestServerAdvancedOps-1790309008 Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fee612fd19a14212b3ed146810b8b54f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_fee612fd19a14212b3ed146810b8b54f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fee612fd19a14212b3ed146810b8b54f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/fee612fd19a14212b3ed146810b8b54f"}]}] Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestServerAdvancedOps-1790309008 Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: fee612fd19a14212b3ed146810b8b54f Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestServerAdvancedOps-1790309008 Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestServerAdvancedOps-1790309008-project Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 0d6d8782da4e44e1b99d43bf03c16f0b Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestServerAdvancedOps-1790309008-project Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance cb52f74d-4b91-4de4-9de5-17bdae601576 could not be found. Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'cb52f74d-4b91-4de4-9de5-17bdae601576'} Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb52f74d-4b91-4de4-9de5-17bdae601576 could not be found. Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb52f74d-4b91-4de4-9de5-17bdae601576 could not be found. Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:56:23.435006 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:56:23.440314 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:56:23.440314 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:56:23.440314 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:56:23.440314 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:56:23.440314 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:56:23.440314 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb52f74d-4b91-4de4-9de5-17bdae601576 could not be found. Aug 24 10:56:23.440314 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:56:23.440314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-98dc5221-df67-4db2-97bb-50796677c616 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] Returning 404 to user: Instance cb52f74d-4b91-4de4-9de5-17bdae601576 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:56:23.440314 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-98dc5221-df67-4db2-97bb-50796677c616 tempest-TestServerAdvancedOps-1790309008 tempest-TestServerAdvancedOps-1790309008-project] 10.222.0.85 "GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576" status: 404 len: 111 microversion: 2.1 time: 0.038802 Aug 24 10:56:23.440314 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3377/6396] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:23 2022] GET /compute/v2.1/servers/cb52f74d-4b91-4de4-9de5-17bdae601576 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:56:27.744145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0a2f9bab-e3f8-44a8-b00d-261dd1c0a166 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:56:27.747199 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0a2f9bab-e3f8-44a8-b00d-261dd1c0a166 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:27.764587 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a2f9bab-e3f8-44a8-b00d-261dd1c0a166 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:27.765107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a2f9bab-e3f8-44a8-b00d-261dd1c0a166 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:27.765575 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a2f9bab-e3f8-44a8-b00d-261dd1c0a166 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:27.766291 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a2f9bab-e3f8-44a8-b00d-261dd1c0a166 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:27.771708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a2f9bab-e3f8-44a8-b00d-261dd1c0a166 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:27.772164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a2f9bab-e3f8-44a8-b00d-261dd1c0a166 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:27.883151 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0a2f9bab-e3f8-44a8-b00d-261dd1c0a166 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:56:27.883640 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0a2f9bab-e3f8-44a8-b00d-261dd1c0a166 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:56:27.884138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0a2f9bab-e3f8-44a8-b00d-261dd1c0a166 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:56:27.884526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0a2f9bab-e3f8-44a8-b00d-261dd1c0a166 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:56:27.884932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0a2f9bab-e3f8-44a8-b00d-261dd1c0a166 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:56:27.937005 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:27.994051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0a2f9bab-e3f8-44a8-b00d-261dd1c0a166 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:28.007265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a2f9bab-e3f8-44a8-b00d-261dd1c0a166 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:28.008038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a2f9bab-e3f8-44a8-b00d-261dd1c0a166 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:28.009409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a2f9bab-e3f8-44a8-b00d-261dd1c0a166 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:28.011207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a2f9bab-e3f8-44a8-b00d-261dd1c0a166 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:28.012142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a2f9bab-e3f8-44a8-b00d-261dd1c0a166 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:28.012786 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a2f9bab-e3f8-44a8-b00d-261dd1c0a166 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:28.075521 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0a2f9bab-e3f8-44a8-b00d-261dd1c0a166 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "POST /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5/action" status: 202 len: 1137 microversion: 2.1 time: 0.336761 Aug 24 10:56:28.079625 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3020/6397] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:56:27 2022] POST /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5/action => generated 1137 bytes in 342 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 10:56:28.098308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-82a57c8e-6bc0-4a5c-b1f3-b73945ea0fb4 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:28.100002 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-82a57c8e-6bc0-4a5c-b1f3-b73945ea0fb4 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:28.117606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82a57c8e-6bc0-4a5c-b1f3-b73945ea0fb4 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:28.119479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82a57c8e-6bc0-4a5c-b1f3-b73945ea0fb4 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:28.119963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82a57c8e-6bc0-4a5c-b1f3-b73945ea0fb4 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:28.120713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82a57c8e-6bc0-4a5c-b1f3-b73945ea0fb4 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:28.123415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82a57c8e-6bc0-4a5c-b1f3-b73945ea0fb4 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:28.125615 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82a57c8e-6bc0-4a5c-b1f3-b73945ea0fb4 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:28.588859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-82a57c8e-6bc0-4a5c-b1f3-b73945ea0fb4 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:28.610433 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-82a57c8e-6bc0-4a5c-b1f3-b73945ea0fb4 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 200 len: 1690 microversion: 2.1 time: 0.513834 Aug 24 10:56:28.611050 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3378/6398] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:28 2022] GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 1690 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:29.634112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d6df8fad-c6b3-498b-8aa1-8b3b967725d9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:29.634677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d6df8fad-c6b3-498b-8aa1-8b3b967725d9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:29.646448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6df8fad-c6b3-498b-8aa1-8b3b967725d9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:29.647279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6df8fad-c6b3-498b-8aa1-8b3b967725d9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:29.647901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6df8fad-c6b3-498b-8aa1-8b3b967725d9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:29.650094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6df8fad-c6b3-498b-8aa1-8b3b967725d9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:29.650799 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6df8fad-c6b3-498b-8aa1-8b3b967725d9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:29.651404 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6df8fad-c6b3-498b-8aa1-8b3b967725d9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:29.839875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d6df8fad-c6b3-498b-8aa1-8b3b967725d9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:29.853845 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d6df8fad-c6b3-498b-8aa1-8b3b967725d9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 200 len: 1690 microversion: 2.1 time: 0.226069 Aug 24 10:56:29.854705 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3021/6399] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:29 2022] GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 1690 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:30.880190 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dd3d5414-8a82-4ef2-a8ea-fc77d39ce65c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:30.880941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dd3d5414-8a82-4ef2-a8ea-fc77d39ce65c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:30.889362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd3d5414-8a82-4ef2-a8ea-fc77d39ce65c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:30.890031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd3d5414-8a82-4ef2-a8ea-fc77d39ce65c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:30.890548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd3d5414-8a82-4ef2-a8ea-fc77d39ce65c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:30.891496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd3d5414-8a82-4ef2-a8ea-fc77d39ce65c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:30.892200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd3d5414-8a82-4ef2-a8ea-fc77d39ce65c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:30.892850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd3d5414-8a82-4ef2-a8ea-fc77d39ce65c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:31.134214 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dd3d5414-8a82-4ef2-a8ea-fc77d39ce65c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:31.148376 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dd3d5414-8a82-4ef2-a8ea-fc77d39ce65c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 200 len: 1690 microversion: 2.1 time: 0.273183 Aug 24 10:56:31.150788 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3379/6400] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:30 2022] GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 1690 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:32.175716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-49146731-165a-49ff-b072-539fee24a1a0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:32.176898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-49146731-165a-49ff-b072-539fee24a1a0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:32.187355 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49146731-165a-49ff-b072-539fee24a1a0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:32.187850 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49146731-165a-49ff-b072-539fee24a1a0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:32.188298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49146731-165a-49ff-b072-539fee24a1a0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:32.189050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49146731-165a-49ff-b072-539fee24a1a0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:32.189546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49146731-165a-49ff-b072-539fee24a1a0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:32.189944 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49146731-165a-49ff-b072-539fee24a1a0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:32.361397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-49146731-165a-49ff-b072-539fee24a1a0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:32.371550 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-49146731-165a-49ff-b072-539fee24a1a0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 200 len: 1690 microversion: 2.1 time: 0.203793 Aug 24 10:56:32.373069 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3022/6401] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:32 2022] GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 1690 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:33.397064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-32a9ab70-628d-42da-88c4-d026aa48b708 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:33.397883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-32a9ab70-628d-42da-88c4-d026aa48b708 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:33.405523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32a9ab70-628d-42da-88c4-d026aa48b708 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:33.406461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32a9ab70-628d-42da-88c4-d026aa48b708 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:33.407388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32a9ab70-628d-42da-88c4-d026aa48b708 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:33.408618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32a9ab70-628d-42da-88c4-d026aa48b708 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:33.409504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32a9ab70-628d-42da-88c4-d026aa48b708 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:33.411632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32a9ab70-628d-42da-88c4-d026aa48b708 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:33.641676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-32a9ab70-628d-42da-88c4-d026aa48b708 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:33.662685 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-32a9ab70-628d-42da-88c4-d026aa48b708 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 200 len: 1690 microversion: 2.1 time: 0.270724 Aug 24 10:56:33.664301 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3380/6402] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:33 2022] GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 1690 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:34.687889 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f4dd0ca8-2fd1-4330-9585-e449ac2454a3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:34.689776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f4dd0ca8-2fd1-4330-9585-e449ac2454a3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:34.704944 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4dd0ca8-2fd1-4330-9585-e449ac2454a3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:34.705493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4dd0ca8-2fd1-4330-9585-e449ac2454a3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:34.705933 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4dd0ca8-2fd1-4330-9585-e449ac2454a3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:34.706663 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4dd0ca8-2fd1-4330-9585-e449ac2454a3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:34.707407 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4dd0ca8-2fd1-4330-9585-e449ac2454a3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:34.707843 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4dd0ca8-2fd1-4330-9585-e449ac2454a3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:34.934996 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f4dd0ca8-2fd1-4330-9585-e449ac2454a3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:34.947474 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f4dd0ca8-2fd1-4330-9585-e449ac2454a3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 200 len: 1690 microversion: 2.1 time: 0.264935 Aug 24 10:56:34.948781 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3023/6403] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:34 2022] GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 1690 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:35.971976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b534ad0f-61f3-41ad-a454-75e5eaff01fd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:35.972602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b534ad0f-61f3-41ad-a454-75e5eaff01fd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:35.990374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b534ad0f-61f3-41ad-a454-75e5eaff01fd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:35.990971 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b534ad0f-61f3-41ad-a454-75e5eaff01fd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:35.991437 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b534ad0f-61f3-41ad-a454-75e5eaff01fd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:35.992184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b534ad0f-61f3-41ad-a454-75e5eaff01fd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:35.992677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b534ad0f-61f3-41ad-a454-75e5eaff01fd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:35.993205 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b534ad0f-61f3-41ad-a454-75e5eaff01fd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:36.347795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b534ad0f-61f3-41ad-a454-75e5eaff01fd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:36.359347 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b534ad0f-61f3-41ad-a454-75e5eaff01fd tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 200 len: 1690 microversion: 2.1 time: 0.391230 Aug 24 10:56:36.377641 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3381/6404] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:35 2022] GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 1690 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:37.390051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b41dd463-34e1-45b9-a633-bf159827dfb0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:37.391386 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b41dd463-34e1-45b9-a633-bf159827dfb0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:37.413253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b41dd463-34e1-45b9-a633-bf159827dfb0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:37.415090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b41dd463-34e1-45b9-a633-bf159827dfb0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:37.418444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b41dd463-34e1-45b9-a633-bf159827dfb0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:37.421810 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b41dd463-34e1-45b9-a633-bf159827dfb0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:37.423665 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b41dd463-34e1-45b9-a633-bf159827dfb0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:37.424419 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b41dd463-34e1-45b9-a633-bf159827dfb0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:37.904920 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b41dd463-34e1-45b9-a633-bf159827dfb0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:37.918177 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b41dd463-34e1-45b9-a633-bf159827dfb0 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 200 len: 1690 microversion: 2.1 time: 0.537116 Aug 24 10:56:37.919491 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3024/6405] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:37 2022] GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 1690 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:38.941743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0987e065-60be-41bf-b39a-2b1016a617f1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:38.942586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0987e065-60be-41bf-b39a-2b1016a617f1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:38.983177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0987e065-60be-41bf-b39a-2b1016a617f1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:38.984168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0987e065-60be-41bf-b39a-2b1016a617f1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:38.984991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0987e065-60be-41bf-b39a-2b1016a617f1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:38.993998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0987e065-60be-41bf-b39a-2b1016a617f1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:39.007208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0987e065-60be-41bf-b39a-2b1016a617f1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:39.008059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0987e065-60be-41bf-b39a-2b1016a617f1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:39.255021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0987e065-60be-41bf-b39a-2b1016a617f1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:39.278592 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0987e065-60be-41bf-b39a-2b1016a617f1 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 200 len: 1690 microversion: 2.1 time: 0.340756 Aug 24 10:56:39.285019 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3382/6406] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:38 2022] GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 1690 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:39.554453 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-371fc891-8395-4f5c-a024-c00322e1e2f4 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Action: 'create', calling method: .version_select at 0x7f465508a8b0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1583485824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvwJG4Kii+l6Fj21Gbdi/mFU40mKn86PbfExA2j/vAKFZJzDktjNPzMO7sL/eQqmhWrypRDJquYUGDxb45CS+UNXXAw+mTrSuI8fZArarAgQUf7QlaXyb3pj9W5mZmZgw=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:56:39.562761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:39.576435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-371fc891-8395-4f5c-a024-c00322e1e2f4 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Getting quotas for project 8e944f10139342e4aa29d2b18f901449. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:56:39.582899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-371fc891-8395-4f5c-a024-c00322e1e2f4 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Getting quotas for user 4fb5d9cc56ba4dee8d73aab4d1a5a4a6 and project 8e944f10139342e4aa29d2b18f901449. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:56:39.618962 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-371fc891-8395-4f5c-a024-c00322e1e2f4 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.309226 Aug 24 10:56:39.619561 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3025/6407] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:56:39 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:56:40.305607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1f41a4c5-d84e-4a8f-ae0d-7b0ba62760c9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:40.306860 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1f41a4c5-d84e-4a8f-ae0d-7b0ba62760c9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:40.315352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f41a4c5-d84e-4a8f-ae0d-7b0ba62760c9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:40.316168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f41a4c5-d84e-4a8f-ae0d-7b0ba62760c9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:40.317019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f41a4c5-d84e-4a8f-ae0d-7b0ba62760c9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:40.317904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f41a4c5-d84e-4a8f-ae0d-7b0ba62760c9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:40.318884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f41a4c5-d84e-4a8f-ae0d-7b0ba62760c9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:40.319409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f41a4c5-d84e-4a8f-ae0d-7b0ba62760c9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:40.519053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1f41a4c5-d84e-4a8f-ae0d-7b0ba62760c9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:40.530006 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1f41a4c5-d84e-4a8f-ae0d-7b0ba62760c9 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 200 len: 1696 microversion: 2.1 time: 0.229075 Aug 24 10:56:40.530929 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3383/6408] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:40 2022] GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 1696 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:41.558418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-98eb91ca-3091-4639-afd9-ef3e97f09e1e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:41.559916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-98eb91ca-3091-4639-afd9-ef3e97f09e1e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:41.571383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98eb91ca-3091-4639-afd9-ef3e97f09e1e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:41.579804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98eb91ca-3091-4639-afd9-ef3e97f09e1e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:41.580856 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98eb91ca-3091-4639-afd9-ef3e97f09e1e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:41.581511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98eb91ca-3091-4639-afd9-ef3e97f09e1e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:41.581994 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98eb91ca-3091-4639-afd9-ef3e97f09e1e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:41.582418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98eb91ca-3091-4639-afd9-ef3e97f09e1e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:41.667173 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-89cbf721-20bc-4eb8-9e2a-2375f90bdd15 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-705109620", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1583485824", "security_groups": [{"name": "tempest-secgroup-smoke-1277724207"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "e36e55de-4d42-4151-8971-d223fd76fbde"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:56:41.753316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-98eb91ca-3091-4639-afd9-ef3e97f09e1e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:41.769286 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-98eb91ca-3091-4639-afd9-ef3e97f09e1e tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 200 len: 1696 microversion: 2.1 time: 0.215704 Aug 24 10:56:41.782114 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3026/6409] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:41 2022] GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 1696 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:41.792537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-89cbf721-20bc-4eb8-9e2a-2375f90bdd15 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] validate_networks() for [('e36e55de-4d42-4151-8971-d223fd76fbde', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:56:42.379246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-89cbf721-20bc-4eb8-9e2a-2375f90bdd15 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Getting quotas for project 8e944f10139342e4aa29d2b18f901449. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:56:42.385853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-89cbf721-20bc-4eb8-9e2a-2375f90bdd15 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Getting quotas for user 4fb5d9cc56ba4dee8d73aab4d1a5a4a6 and project 8e944f10139342e4aa29d2b18f901449. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:56:42.402074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-89cbf721-20bc-4eb8-9e2a-2375f90bdd15 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:56:42.402786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-89cbf721-20bc-4eb8-9e2a-2375f90bdd15 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:56:42.403557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-89cbf721-20bc-4eb8-9e2a-2375f90bdd15 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:56:42.403946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-89cbf721-20bc-4eb8-9e2a-2375f90bdd15 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:56:42.404569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-89cbf721-20bc-4eb8-9e2a-2375f90bdd15 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:56:42.414762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89cbf721-20bc-4eb8-9e2a-2375f90bdd15 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:42.415333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89cbf721-20bc-4eb8-9e2a-2375f90bdd15 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:42.415949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89cbf721-20bc-4eb8-9e2a-2375f90bdd15 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:42.416793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89cbf721-20bc-4eb8-9e2a-2375f90bdd15 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:42.417498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89cbf721-20bc-4eb8-9e2a-2375f90bdd15 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:42.418106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89cbf721-20bc-4eb8-9e2a-2375f90bdd15 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:42.438112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-89cbf721-20bc-4eb8-9e2a-2375f90bdd15 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Getting quotas for project 8e944f10139342e4aa29d2b18f901449. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:56:42.445578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-89cbf721-20bc-4eb8-9e2a-2375f90bdd15 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Getting quotas for user 4fb5d9cc56ba4dee8d73aab4d1a5a4a6 and project 8e944f10139342e4aa29d2b18f901449. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:56:42.462559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-89cbf721-20bc-4eb8-9e2a-2375f90bdd15 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:56:42.465468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-89cbf721-20bc-4eb8-9e2a-2375f90bdd15 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] [instance: 0862ce5f-9ad4-444e-b277-8d05e384a451] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:56:42.518005 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-89cbf721-20bc-4eb8-9e2a-2375f90bdd15 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.857093 Aug 24 10:56:42.518765 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3384/6410] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:56:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:56:42.532464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-13820af2-a24a-4a53-ab7f-84d0d23097f1 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:42.534814 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-13820af2-a24a-4a53-ab7f-84d0d23097f1 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] [instance: 0862ce5f-9ad4-444e-b277-8d05e384a451] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:42.598966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-13820af2-a24a-4a53-ab7f-84d0d23097f1 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb5d9cc56ba4dee8d73aab4d1a5a4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e944f10139342e4aa29d2b18f901449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:42.608515 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-13820af2-a24a-4a53-ab7f-84d0d23097f1 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] 10.222.0.85 "GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451" status: 200 len: 1302 microversion: 2.1 time: 0.080910 Aug 24 10:56:42.609102 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3027/6411] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:42 2022] GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451 => generated 1302 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:56:42.793560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5e37348a-f925-439d-844b-c584fdca0f3d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:42.795144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5e37348a-f925-439d-844b-c584fdca0f3d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:42.802088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e37348a-f925-439d-844b-c584fdca0f3d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:42.802979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e37348a-f925-439d-844b-c584fdca0f3d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:42.803852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e37348a-f925-439d-844b-c584fdca0f3d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:42.808628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e37348a-f925-439d-844b-c584fdca0f3d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:42.808771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e37348a-f925-439d-844b-c584fdca0f3d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:42.809335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e37348a-f925-439d-844b-c584fdca0f3d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:43.061470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5e37348a-f925-439d-844b-c584fdca0f3d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:43.074344 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5e37348a-f925-439d-844b-c584fdca0f3d tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 200 len: 1681 microversion: 2.1 time: 0.282423 Aug 24 10:56:43.091944 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3385/6412] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:42 2022] GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 1681 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:43.631684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-81715518-7705-4756-9bbf-1c0d9e7c1932 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:43.633195 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-81715518-7705-4756-9bbf-1c0d9e7c1932 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] [instance: 0862ce5f-9ad4-444e-b277-8d05e384a451] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:43.641565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81715518-7705-4756-9bbf-1c0d9e7c1932 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:43.643107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81715518-7705-4756-9bbf-1c0d9e7c1932 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:43.643754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81715518-7705-4756-9bbf-1c0d9e7c1932 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:43.644676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81715518-7705-4756-9bbf-1c0d9e7c1932 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:43.645464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81715518-7705-4756-9bbf-1c0d9e7c1932 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:43.646576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81715518-7705-4756-9bbf-1c0d9e7c1932 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:43.738958 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-81715518-7705-4756-9bbf-1c0d9e7c1932 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb5d9cc56ba4dee8d73aab4d1a5a4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e944f10139342e4aa29d2b18f901449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:43.760099 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-81715518-7705-4756-9bbf-1c0d9e7c1932 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] 10.222.0.85 "GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451" status: 200 len: 1354 microversion: 2.1 time: 0.133497 Aug 24 10:56:43.773163 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3028/6413] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:43 2022] GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451 => generated 1354 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:44.787440 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-179aaa04-d4d5-4873-9b3c-bbad0bf8871a tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:44.788300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-179aaa04-d4d5-4873-9b3c-bbad0bf8871a tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] [instance: 0862ce5f-9ad4-444e-b277-8d05e384a451] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:44.795816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:44.806706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-179aaa04-d4d5-4873-9b3c-bbad0bf8871a tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:44.807452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-179aaa04-d4d5-4873-9b3c-bbad0bf8871a tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:44.808219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-179aaa04-d4d5-4873-9b3c-bbad0bf8871a tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:44.809312 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-179aaa04-d4d5-4873-9b3c-bbad0bf8871a tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:44.810056 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-179aaa04-d4d5-4873-9b3c-bbad0bf8871a tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:44.810668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-179aaa04-d4d5-4873-9b3c-bbad0bf8871a tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:45.165505 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-179aaa04-d4d5-4873-9b3c-bbad0bf8871a tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb5d9cc56ba4dee8d73aab4d1a5a4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e944f10139342e4aa29d2b18f901449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:45.192450 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-179aaa04-d4d5-4873-9b3c-bbad0bf8871a tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] 10.222.0.85 "GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451" status: 200 len: 1428 microversion: 2.1 time: 0.401140 Aug 24 10:56:45.193476 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3386/6414] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:44 2022] GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451 => generated 1428 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:45.277452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9becb9a0-d9eb-4494-b4af-1a1f325b94e0 req-1d0bd5e8-a967-4d2d-ac5b-d64de3891cff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b9a9458-d33b-4947-9b66-bf18a2bcd7a5", "name": "network-vif-plugged", "status": "completed", "tag": "c9d1fdbe-2e15-40f2-b3c2-b069844d3161"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:56:45.297417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9becb9a0-d9eb-4494-b4af-1a1f325b94e0 req-1d0bd5e8-a967-4d2d-ac5b-d64de3891cff service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:45.303126 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9becb9a0-d9eb-4494-b4af-1a1f325b94e0 req-1d0bd5e8-a967-4d2d-ac5b-d64de3891cff service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:45.304268 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9becb9a0-d9eb-4494-b4af-1a1f325b94e0 req-1d0bd5e8-a967-4d2d-ac5b-d64de3891cff service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:45.328821 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9becb9a0-d9eb-4494-b4af-1a1f325b94e0 req-1d0bd5e8-a967-4d2d-ac5b-d64de3891cff service nova] Creating event network-vif-plugged:c9d1fdbe-2e15-40f2-b3c2-b069844d3161 for instance 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 on n-h1-849328-3 Aug 24 10:56:45.343527 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9becb9a0-d9eb-4494-b4af-1a1f325b94e0 req-1d0bd5e8-a967-4d2d-ac5b-d64de3891cff service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073346 Aug 24 10:56:45.344472 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3029/6415] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:56:46.047469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-020a024a-ce15-4abb-8a87-3b8ff6f62566 req-cf68247a-7406-48eb-aec2-8699e95967ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0862ce5f-9ad4-444e-b277-8d05e384a451", "tag": "0caf0534-6cb1-43c7-b86d-bcaa57dc92ac"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:56:46.060316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-020a024a-ce15-4abb-8a87-3b8ff6f62566 req-cf68247a-7406-48eb-aec2-8699e95967ad service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:46.060803 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-020a024a-ce15-4abb-8a87-3b8ff6f62566 req-cf68247a-7406-48eb-aec2-8699e95967ad service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:46.061493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-020a024a-ce15-4abb-8a87-3b8ff6f62566 req-cf68247a-7406-48eb-aec2-8699e95967ad service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:46.079771 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-020a024a-ce15-4abb-8a87-3b8ff6f62566 req-cf68247a-7406-48eb-aec2-8699e95967ad service nova] Creating event network-changed:0caf0534-6cb1-43c7-b86d-bcaa57dc92ac for instance 0862ce5f-9ad4-444e-b277-8d05e384a451 on n-h2-849328-3 Aug 24 10:56:46.090591 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-020a024a-ce15-4abb-8a87-3b8ff6f62566 req-cf68247a-7406-48eb-aec2-8699e95967ad service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053011 Aug 24 10:56:46.092696 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3387/6416] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:56:46.222888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d1f34fd5-1b0e-4908-9cdd-93b4aee9fe3b tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:46.224259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d1f34fd5-1b0e-4908-9cdd-93b4aee9fe3b tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] [instance: 0862ce5f-9ad4-444e-b277-8d05e384a451] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:46.232082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1f34fd5-1b0e-4908-9cdd-93b4aee9fe3b tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:46.232975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1f34fd5-1b0e-4908-9cdd-93b4aee9fe3b tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:46.233838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1f34fd5-1b0e-4908-9cdd-93b4aee9fe3b tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:46.234898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1f34fd5-1b0e-4908-9cdd-93b4aee9fe3b tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:46.235581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1f34fd5-1b0e-4908-9cdd-93b4aee9fe3b tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:46.236235 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1f34fd5-1b0e-4908-9cdd-93b4aee9fe3b tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:46.399801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d1f34fd5-1b0e-4908-9cdd-93b4aee9fe3b tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb5d9cc56ba4dee8d73aab4d1a5a4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e944f10139342e4aa29d2b18f901449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:46.412467 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d1f34fd5-1b0e-4908-9cdd-93b4aee9fe3b tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] 10.222.0.85 "GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451" status: 200 len: 1428 microversion: 2.1 time: 0.193608 Aug 24 10:56:46.414471 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3030/6417] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:46 2022] GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451 => generated 1428 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:47.435034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b68cf7b5-27fb-423b-b982-a7b2fb5423f2 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:47.435913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b68cf7b5-27fb-423b-b982-a7b2fb5423f2 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] [instance: 0862ce5f-9ad4-444e-b277-8d05e384a451] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:47.443843 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b68cf7b5-27fb-423b-b982-a7b2fb5423f2 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:47.444342 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b68cf7b5-27fb-423b-b982-a7b2fb5423f2 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:47.444793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b68cf7b5-27fb-423b-b982-a7b2fb5423f2 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:47.445535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b68cf7b5-27fb-423b-b982-a7b2fb5423f2 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:47.446162 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b68cf7b5-27fb-423b-b982-a7b2fb5423f2 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:47.446604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b68cf7b5-27fb-423b-b982-a7b2fb5423f2 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:47.633702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b68cf7b5-27fb-423b-b982-a7b2fb5423f2 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb5d9cc56ba4dee8d73aab4d1a5a4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e944f10139342e4aa29d2b18f901449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:47.645858 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b68cf7b5-27fb-423b-b982-a7b2fb5423f2 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] 10.222.0.85 "GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451" status: 200 len: 1428 microversion: 2.1 time: 0.215352 Aug 24 10:56:47.649938 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3388/6418] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:47 2022] GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451 => generated 1428 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:48.667261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bef7bc4a-490e-4975-9f60-74bf9ba2ff2f tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:48.667967 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bef7bc4a-490e-4975-9f60-74bf9ba2ff2f tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] [instance: 0862ce5f-9ad4-444e-b277-8d05e384a451] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:48.676253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bef7bc4a-490e-4975-9f60-74bf9ba2ff2f tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:48.677029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bef7bc4a-490e-4975-9f60-74bf9ba2ff2f tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:48.677757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bef7bc4a-490e-4975-9f60-74bf9ba2ff2f tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:48.678683 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bef7bc4a-490e-4975-9f60-74bf9ba2ff2f tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:48.679315 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bef7bc4a-490e-4975-9f60-74bf9ba2ff2f tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:48.679913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bef7bc4a-490e-4975-9f60-74bf9ba2ff2f tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:48.853844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bef7bc4a-490e-4975-9f60-74bf9ba2ff2f tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb5d9cc56ba4dee8d73aab4d1a5a4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e944f10139342e4aa29d2b18f901449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:48.863052 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bef7bc4a-490e-4975-9f60-74bf9ba2ff2f tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] 10.222.0.85 "GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451" status: 200 len: 1428 microversion: 2.1 time: 0.199791 Aug 24 10:56:48.864065 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3031/6419] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:48 2022] GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451 => generated 1428 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:49.887980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dcb3764d-e7f7-4823-8ce3-6cc2ec7c8590 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:49.888620 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dcb3764d-e7f7-4823-8ce3-6cc2ec7c8590 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] [instance: 0862ce5f-9ad4-444e-b277-8d05e384a451] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:49.898111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcb3764d-e7f7-4823-8ce3-6cc2ec7c8590 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:49.898823 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcb3764d-e7f7-4823-8ce3-6cc2ec7c8590 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:49.899600 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcb3764d-e7f7-4823-8ce3-6cc2ec7c8590 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:49.900528 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcb3764d-e7f7-4823-8ce3-6cc2ec7c8590 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:49.901162 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcb3764d-e7f7-4823-8ce3-6cc2ec7c8590 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:49.901846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcb3764d-e7f7-4823-8ce3-6cc2ec7c8590 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:50.063785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dcb3764d-e7f7-4823-8ce3-6cc2ec7c8590 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb5d9cc56ba4dee8d73aab4d1a5a4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e944f10139342e4aa29d2b18f901449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:50.072433 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dcb3764d-e7f7-4823-8ce3-6cc2ec7c8590 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] 10.222.0.85 "GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451" status: 200 len: 1428 microversion: 2.1 time: 0.188779 Aug 24 10:56:50.073036 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3389/6420] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:49 2022] GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451 => generated 1428 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:51.095775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-309e3950-87f1-452f-9fba-d22a2a5a7dea tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:51.096374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-309e3950-87f1-452f-9fba-d22a2a5a7dea tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] [instance: 0862ce5f-9ad4-444e-b277-8d05e384a451] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:51.104671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-309e3950-87f1-452f-9fba-d22a2a5a7dea tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:51.105439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-309e3950-87f1-452f-9fba-d22a2a5a7dea tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:51.105877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-309e3950-87f1-452f-9fba-d22a2a5a7dea tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:51.106627 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-309e3950-87f1-452f-9fba-d22a2a5a7dea tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:51.107027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-309e3950-87f1-452f-9fba-d22a2a5a7dea tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:51.107695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-309e3950-87f1-452f-9fba-d22a2a5a7dea tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:51.267886 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-309e3950-87f1-452f-9fba-d22a2a5a7dea tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb5d9cc56ba4dee8d73aab4d1a5a4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e944f10139342e4aa29d2b18f901449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:51.278856 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-309e3950-87f1-452f-9fba-d22a2a5a7dea tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] 10.222.0.85 "GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451" status: 200 len: 1428 microversion: 2.1 time: 0.187820 Aug 24 10:56:51.280160 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3032/6421] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:51 2022] GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451 => generated 1428 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:52.315073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f86b89fb-5779-44d5-8870-3e1ca7b7b9c4 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:52.315776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f86b89fb-5779-44d5-8870-3e1ca7b7b9c4 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] [instance: 0862ce5f-9ad4-444e-b277-8d05e384a451] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:52.323985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f86b89fb-5779-44d5-8870-3e1ca7b7b9c4 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:52.324503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f86b89fb-5779-44d5-8870-3e1ca7b7b9c4 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:52.325235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f86b89fb-5779-44d5-8870-3e1ca7b7b9c4 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:52.325971 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f86b89fb-5779-44d5-8870-3e1ca7b7b9c4 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:52.326448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f86b89fb-5779-44d5-8870-3e1ca7b7b9c4 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:52.326902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f86b89fb-5779-44d5-8870-3e1ca7b7b9c4 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:52.330033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=73 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:52.428417 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:52.453895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=10 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:52.488125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f86b89fb-5779-44d5-8870-3e1ca7b7b9c4 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb5d9cc56ba4dee8d73aab4d1a5a4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e944f10139342e4aa29d2b18f901449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:52.500154 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f86b89fb-5779-44d5-8870-3e1ca7b7b9c4 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] 10.222.0.85 "GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451" status: 200 len: 1428 microversion: 2.1 time: 0.188854 Aug 24 10:56:52.502393 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3390/6422] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:52 2022] GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451 => generated 1428 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:52.935828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-fb8f0d13-25ea-48da-82e9-4e09c02ad779 req-6fb980f7-30ff-4d1c-8e5c-b4bc88d9ac5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0862ce5f-9ad4-444e-b277-8d05e384a451", "name": "network-vif-plugged", "status": "completed", "tag": "0caf0534-6cb1-43c7-b86d-bcaa57dc92ac"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:56:52.944533 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:52.949804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fb8f0d13-25ea-48da-82e9-4e09c02ad779 req-6fb980f7-30ff-4d1c-8e5c-b4bc88d9ac5b service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:52.951108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fb8f0d13-25ea-48da-82e9-4e09c02ad779 req-6fb980f7-30ff-4d1c-8e5c-b4bc88d9ac5b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:52.951595 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fb8f0d13-25ea-48da-82e9-4e09c02ad779 req-6fb980f7-30ff-4d1c-8e5c-b4bc88d9ac5b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:52.966000 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-fb8f0d13-25ea-48da-82e9-4e09c02ad779 req-6fb980f7-30ff-4d1c-8e5c-b4bc88d9ac5b service nova] Creating event network-vif-plugged:0caf0534-6cb1-43c7-b86d-bcaa57dc92ac for instance 0862ce5f-9ad4-444e-b277-8d05e384a451 on n-h2-849328-3 Aug 24 10:56:52.973958 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-fb8f0d13-25ea-48da-82e9-4e09c02ad779 req-6fb980f7-30ff-4d1c-8e5c-b4bc88d9ac5b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039718 Aug 24 10:56:52.973958 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3033/6423] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:56:53.524472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-988a2917-a67e-4af7-9cd1-a388f09387cc tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:53.525183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-988a2917-a67e-4af7-9cd1-a388f09387cc tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] [instance: 0862ce5f-9ad4-444e-b277-8d05e384a451] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:53.536318 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-988a2917-a67e-4af7-9cd1-a388f09387cc tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:53.537310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-988a2917-a67e-4af7-9cd1-a388f09387cc tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:53.538425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-988a2917-a67e-4af7-9cd1-a388f09387cc tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:53.540096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-988a2917-a67e-4af7-9cd1-a388f09387cc tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:53.540587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-988a2917-a67e-4af7-9cd1-a388f09387cc tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:53.541036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-988a2917-a67e-4af7-9cd1-a388f09387cc tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:53.722771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-988a2917-a67e-4af7-9cd1-a388f09387cc tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb5d9cc56ba4dee8d73aab4d1a5a4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e944f10139342e4aa29d2b18f901449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:53.736128 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-988a2917-a67e-4af7-9cd1-a388f09387cc tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] 10.222.0.85 "GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451" status: 200 len: 1428 microversion: 2.1 time: 0.216336 Aug 24 10:56:53.737910 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3391/6424] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:53 2022] GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451 => generated 1428 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:54.760335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-209aff36-a4bd-4438-9098-255610b82a10 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:54.761685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-209aff36-a4bd-4438-9098-255610b82a10 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] [instance: 0862ce5f-9ad4-444e-b277-8d05e384a451] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:54.772571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-209aff36-a4bd-4438-9098-255610b82a10 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:54.773532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-209aff36-a4bd-4438-9098-255610b82a10 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:54.774307 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-209aff36-a4bd-4438-9098-255610b82a10 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:54.775354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-209aff36-a4bd-4438-9098-255610b82a10 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:54.776133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-209aff36-a4bd-4438-9098-255610b82a10 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:54.776859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-209aff36-a4bd-4438-9098-255610b82a10 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:54.953522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-209aff36-a4bd-4438-9098-255610b82a10 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb5d9cc56ba4dee8d73aab4d1a5a4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e944f10139342e4aa29d2b18f901449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:54.962670 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-209aff36-a4bd-4438-9098-255610b82a10 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] 10.222.0.85 "GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451" status: 200 len: 1608 microversion: 2.1 time: 0.208041 Aug 24 10:56:54.964474 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3034/6425] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:54 2022] GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451 => generated 1608 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:54.990538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ce7ac43-5128-480f-b3ac-ae0f7fd89efd tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:54.992007 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8ce7ac43-5128-480f-b3ac-ae0f7fd89efd tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] [instance: 0862ce5f-9ad4-444e-b277-8d05e384a451] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:55.006384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ce7ac43-5128-480f-b3ac-ae0f7fd89efd tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:55.007470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ce7ac43-5128-480f-b3ac-ae0f7fd89efd tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:55.008453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ce7ac43-5128-480f-b3ac-ae0f7fd89efd tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:55.010008 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ce7ac43-5128-480f-b3ac-ae0f7fd89efd tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:55.010747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ce7ac43-5128-480f-b3ac-ae0f7fd89efd tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:55.011431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ce7ac43-5128-480f-b3ac-ae0f7fd89efd tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:55.164084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8ce7ac43-5128-480f-b3ac-ae0f7fd89efd tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb5d9cc56ba4dee8d73aab4d1a5a4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e944f10139342e4aa29d2b18f901449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:55.172376 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8ce7ac43-5128-480f-b3ac-ae0f7fd89efd tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] 10.222.0.85 "GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451" status: 200 len: 1608 microversion: 2.1 time: 0.190606 Aug 24 10:56:55.172986 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3392/6426] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:54 2022] GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451 => generated 1608 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:55.195454 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c147acb5-93db-47c5-b0b4-c62d8e8fcda4 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:56:55.196208 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c147acb5-93db-47c5-b0b4-c62d8e8fcda4 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] [instance: 0862ce5f-9ad4-444e-b277-8d05e384a451] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:56:55.203262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c147acb5-93db-47c5-b0b4-c62d8e8fcda4 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:55.203804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c147acb5-93db-47c5-b0b4-c62d8e8fcda4 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:55.204250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c147acb5-93db-47c5-b0b4-c62d8e8fcda4 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:55.204969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c147acb5-93db-47c5-b0b4-c62d8e8fcda4 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:55.205460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c147acb5-93db-47c5-b0b4-c62d8e8fcda4 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:55.205895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c147acb5-93db-47c5-b0b4-c62d8e8fcda4 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:55.358365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c147acb5-93db-47c5-b0b4-c62d8e8fcda4 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb5d9cc56ba4dee8d73aab4d1a5a4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e944f10139342e4aa29d2b18f901449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:56:55.367019 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c147acb5-93db-47c5-b0b4-c62d8e8fcda4 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] 10.222.0.85 "GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451" status: 200 len: 1608 microversion: 2.1 time: 0.176663 Aug 24 10:56:55.367865 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3035/6427] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:56:55 2022] GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451 => generated 1608 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:56:57.248822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-2e154043-445a-47c1-87a0-08e1942be711 req-2114d674-6001-4c02-9e6f-816f18b1a263 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0862ce5f-9ad4-444e-b277-8d05e384a451", "tag": "0caf0534-6cb1-43c7-b86d-bcaa57dc92ac"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:56:57.260098 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2e154043-445a-47c1-87a0-08e1942be711 req-2114d674-6001-4c02-9e6f-816f18b1a263 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:56:57.260595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2e154043-445a-47c1-87a0-08e1942be711 req-2114d674-6001-4c02-9e6f-816f18b1a263 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:56:57.261038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2e154043-445a-47c1-87a0-08e1942be711 req-2114d674-6001-4c02-9e6f-816f18b1a263 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:56:57.273155 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-2e154043-445a-47c1-87a0-08e1942be711 req-2114d674-6001-4c02-9e6f-816f18b1a263 service nova] Creating event network-changed:0caf0534-6cb1-43c7-b86d-bcaa57dc92ac for instance 0862ce5f-9ad4-444e-b277-8d05e384a451 on n-h2-849328-3 Aug 24 10:56:57.278323 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-2e154043-445a-47c1-87a0-08e1942be711 req-2114d674-6001-4c02-9e6f-816f18b1a263 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033318 Aug 24 10:56:57.278947 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3393/6428] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:57:07.395598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-266bd956-e721-44cc-b8b6-b850f4a694d3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:57:07.397952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-266bd956-e721-44cc-b8b6-b850f4a694d3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:57:07.400988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:57:07.402184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=76,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:57:07.409683 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-266bd956-e721-44cc-b8b6-b850f4a694d3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:57:07.410170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-266bd956-e721-44cc-b8b6-b850f4a694d3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:57:07.410603 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-266bd956-e721-44cc-b8b6-b850f4a694d3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:57:07.411300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-266bd956-e721-44cc-b8b6-b850f4a694d3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:57:07.411749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-266bd956-e721-44cc-b8b6-b850f4a694d3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:57:07.412167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-266bd956-e721-44cc-b8b6-b850f4a694d3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:57:07.490113 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-266bd956-e721-44cc-b8b6-b850f4a694d3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "POST /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5/action" status: 200 len: 24566 microversion: 2.1 time: 0.101835 Aug 24 10:57:07.491201 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3036/6429] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 10:57:07 2022] POST /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5/action => generated 24566 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:57:14.877570 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c8566ec3-79fc-4731-a258-b2091a1a0271 req-6602aa92-f885-48b3-ba1f-ca85a116e5f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b9a9458-d33b-4947-9b66-bf18a2bcd7a5", "tag": "c9d1fdbe-2e15-40f2-b3c2-b069844d3161"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:57:14.892570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=15 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:57:14.892570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=19 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:57:14.895822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-76199bf4-ebb5-42d4-aca1-79a34dae9b35 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:57:14.896451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-76199bf4-ebb5-42d4-aca1-79a34dae9b35 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:57:14.903431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c8566ec3-79fc-4731-a258-b2091a1a0271 req-6602aa92-f885-48b3-ba1f-ca85a116e5f4 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:57:14.904271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c8566ec3-79fc-4731-a258-b2091a1a0271 req-6602aa92-f885-48b3-ba1f-ca85a116e5f4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:57:14.904698 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c8566ec3-79fc-4731-a258-b2091a1a0271 req-6602aa92-f885-48b3-ba1f-ca85a116e5f4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:57:14.904861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76199bf4-ebb5-42d4-aca1-79a34dae9b35 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:57:14.905302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76199bf4-ebb5-42d4-aca1-79a34dae9b35 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:57:14.905760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76199bf4-ebb5-42d4-aca1-79a34dae9b35 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:57:14.906471 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76199bf4-ebb5-42d4-aca1-79a34dae9b35 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:57:14.906938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76199bf4-ebb5-42d4-aca1-79a34dae9b35 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:57:14.907374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76199bf4-ebb5-42d4-aca1-79a34dae9b35 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:57:14.920086 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c8566ec3-79fc-4731-a258-b2091a1a0271 req-6602aa92-f885-48b3-ba1f-ca85a116e5f4 service nova] Creating event network-changed:c9d1fdbe-2e15-40f2-b3c2-b069844d3161 for instance 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 on n-h1-849328-3 Aug 24 10:57:14.926167 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c8566ec3-79fc-4731-a258-b2091a1a0271 req-6602aa92-f885-48b3-ba1f-ca85a116e5f4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052632 Aug 24 10:57:14.930837 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3037/6430] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:57:14.956133 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-76199bf4-ebb5-42d4-aca1-79a34dae9b35 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:57:15.082137 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-76199bf4-ebb5-42d4-aca1-79a34dae9b35 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "DELETE /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 204 len: 0 microversion: 2.1 time: 0.211637 Aug 24 10:57:15.082803 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3394/6431] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:57:14 2022] DELETE /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:57:15.093886 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e7cbd3a-26a9-44c1-a409-43f1ed81b94c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:57:15.095212 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6e7cbd3a-26a9-44c1-a409-43f1ed81b94c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:57:15.109082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e7cbd3a-26a9-44c1-a409-43f1ed81b94c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:57:15.115492 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e7cbd3a-26a9-44c1-a409-43f1ed81b94c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:57:15.116367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e7cbd3a-26a9-44c1-a409-43f1ed81b94c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:57:15.117636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e7cbd3a-26a9-44c1-a409-43f1ed81b94c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:57:15.118604 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e7cbd3a-26a9-44c1-a409-43f1ed81b94c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:57:15.118885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e7cbd3a-26a9-44c1-a409-43f1ed81b94c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:57:15.328100 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6e7cbd3a-26a9-44c1-a409-43f1ed81b94c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:57:15.337763 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6e7cbd3a-26a9-44c1-a409-43f1ed81b94c tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 200 len: 1687 microversion: 2.1 time: 0.249756 Aug 24 10:57:15.338902 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3038/6432] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:57:15 2022] GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 1687 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:57:16.371805 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-04898087-c8d7-4df1-90d3-0278dd163300 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:57:16.372540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-04898087-c8d7-4df1-90d3-0278dd163300 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:57:16.379951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04898087-c8d7-4df1-90d3-0278dd163300 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:57:16.380539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04898087-c8d7-4df1-90d3-0278dd163300 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:57:16.381221 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04898087-c8d7-4df1-90d3-0278dd163300 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:57:16.381763 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04898087-c8d7-4df1-90d3-0278dd163300 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:57:16.382238 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04898087-c8d7-4df1-90d3-0278dd163300 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:57:16.382685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04898087-c8d7-4df1-90d3-0278dd163300 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:57:16.533225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-04898087-c8d7-4df1-90d3-0278dd163300 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:57:16.545683 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-04898087-c8d7-4df1-90d3-0278dd163300 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 200 len: 1687 microversion: 2.1 time: 0.177775 Aug 24 10:57:16.546655 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3395/6433] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:57:16 2022] GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 1687 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:57:17.568603 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7940db6e-dcf7-4877-8710-44e880308e19 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:57:17.569805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7940db6e-dcf7-4877-8710-44e880308e19 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:57:17.579057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7940db6e-dcf7-4877-8710-44e880308e19 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:57:17.579946 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7940db6e-dcf7-4877-8710-44e880308e19 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:57:17.580704 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7940db6e-dcf7-4877-8710-44e880308e19 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:57:17.581680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7940db6e-dcf7-4877-8710-44e880308e19 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:57:17.582235 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7940db6e-dcf7-4877-8710-44e880308e19 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:57:17.582856 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7940db6e-dcf7-4877-8710-44e880308e19 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:57:17.592238 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-7cb1f0c7-ab89-4447-94e3-2d63ee7c2a30 req-0df725a5-9755-405f-9db4-d66a823c5f3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b9a9458-d33b-4947-9b66-bf18a2bcd7a5", "name": "network-vif-deleted", "tag": "c9d1fdbe-2e15-40f2-b3c2-b069844d3161"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:57:17.609501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7cb1f0c7-ab89-4447-94e3-2d63ee7c2a30 req-0df725a5-9755-405f-9db4-d66a823c5f3f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:57:17.610168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7cb1f0c7-ab89-4447-94e3-2d63ee7c2a30 req-0df725a5-9755-405f-9db4-d66a823c5f3f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:57:17.610986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7cb1f0c7-ab89-4447-94e3-2d63ee7c2a30 req-0df725a5-9755-405f-9db4-d66a823c5f3f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:57:17.655718 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-7cb1f0c7-ab89-4447-94e3-2d63ee7c2a30 req-0df725a5-9755-405f-9db4-d66a823c5f3f service nova] Creating event network-vif-deleted:c9d1fdbe-2e15-40f2-b3c2-b069844d3161 for instance 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 on n-h1-849328-3 Aug 24 10:57:17.661968 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-7cb1f0c7-ab89-4447-94e3-2d63ee7c2a30 req-0df725a5-9755-405f-9db4-d66a823c5f3f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074330 Aug 24 10:57:17.662837 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3396/6434] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:57:17.698150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7940db6e-dcf7-4877-8710-44e880308e19 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a30846ae64f268baf7f3231b84273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de650d3c897a409dbf54c32bfd45d672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:57:17.708834 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7940db6e-dcf7-4877-8710-44e880308e19 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 200 len: 1502 microversion: 2.1 time: 0.144919 Aug 24 10:57:17.709722 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3039/6435] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:57:17 2022] GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 1502 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:57:18.746329 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-866fe1d4-45ff-4ef9-a6d8-4fb644b9f7e3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:57:18.747310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-866fe1d4-45ff-4ef9-a6d8-4fb644b9f7e3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] [instance: 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:57:18.756277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-866fe1d4-45ff-4ef9-a6d8-4fb644b9f7e3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:57:18.756879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-866fe1d4-45ff-4ef9-a6d8-4fb644b9f7e3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:57:18.757382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-866fe1d4-45ff-4ef9-a6d8-4fb644b9f7e3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:57:18.758119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-866fe1d4-45ff-4ef9-a6d8-4fb644b9f7e3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:57:18.758690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-866fe1d4-45ff-4ef9-a6d8-4fb644b9f7e3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:57:18.759240 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-866fe1d4-45ff-4ef9-a6d8-4fb644b9f7e3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:57:18.775054 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-866fe1d4-45ff-4ef9-a6d8-4fb644b9f7e3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] HTTP exception thrown: Instance 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 could not be found. Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-866fe1d4-45ff-4ef9-a6d8-4fb644b9f7e3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Request method failure captured: Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 HTTP/1.1 Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgIYr3m0kczioH5SSbuV0siG9VfGIEhErhXgPNYWqTrwdwzLctBv4d_yF7_2o3Bo2OCW0F3YBxLt_VBZKvzJVotT6Q8BjQkCHvOThFjqvFIwYZTCav5UQXePGBVbTY6y1fdzkpkRSvMUUvzdkP7LJWZQ1ilcF3WX7Nwy-FzIhdwxmrY Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: de650d3c897a409dbf54c32bfd45d672 Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-639544488 Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/de650d3c897a409dbf54c32bfd45d672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_de650d3c897a409dbf54c32bfd45d672", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/de650d3c897a409dbf54c32bfd45d672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/de650d3c897a409dbf54c32bfd45d672"}]}] Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestNetworkAdvancedServerOps-639544488 Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: de650d3c897a409dbf54c32bfd45d672 Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-639544488 Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestNetworkAdvancedServerOps-639544488-project Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 127a30846ae64f268baf7f3231b84273 Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestNetworkAdvancedServerOps-639544488-project Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 could not be found. Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '1b9a9458-d33b-4947-9b66-bf18a2bcd7a5'} Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 could not be found. Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 could not be found. Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:57:18.776753 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:57:18.782122 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:57:18.782122 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:57:18.782122 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:57:18.782122 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:57:18.782122 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:57:18.782122 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:57:18.782122 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 could not be found. Aug 24 10:57:18.782122 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:57:18.782122 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-866fe1d4-45ff-4ef9-a6d8-4fb644b9f7e3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Returning 404 to user: Instance 1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:57:18.782122 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-866fe1d4-45ff-4ef9-a6d8-4fb644b9f7e3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5" status: 404 len: 111 microversion: 2.1 time: 0.039244 Aug 24 10:57:18.782122 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3397/6436] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:57:18 2022] GET /compute/v2.1/servers/1b9a9458-d33b-4947-9b66-bf18a2bcd7a5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:57:22.248712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1bf528b3-9b26-4493-8273-1e8e29c2ddc3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] Calling method '.version_select at 0x7f46540ea1f0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:57:22.275536 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1bf528b3-9b26-4493-8273-1e8e29c2ddc3 tempest-TestNetworkAdvancedServerOps-639544488 tempest-TestNetworkAdvancedServerOps-639544488-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-656277632" status: 202 len: 0 microversion: 2.1 time: 0.031707 Aug 24 10:57:22.288461 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3040/6437] 10.222.0.85 () {58 vars in 1281 bytes} [Wed Aug 24 10:57:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-656277632 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:57:36.014587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d511aba1-e1ac-41dc-a461-f1b32a3b8888 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:57:36.015177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d511aba1-e1ac-41dc-a461-f1b32a3b8888 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] [instance: 0862ce5f-9ad4-444e-b277-8d05e384a451] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:57:36.017952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:57:36.018644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:57:36.032639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d511aba1-e1ac-41dc-a461-f1b32a3b8888 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:57:36.033189 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d511aba1-e1ac-41dc-a461-f1b32a3b8888 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:57:36.033889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d511aba1-e1ac-41dc-a461-f1b32a3b8888 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:57:36.034641 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d511aba1-e1ac-41dc-a461-f1b32a3b8888 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:57:36.035298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d511aba1-e1ac-41dc-a461-f1b32a3b8888 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:57:36.035909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d511aba1-e1ac-41dc-a461-f1b32a3b8888 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:57:36.073262 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d511aba1-e1ac-41dc-a461-f1b32a3b8888 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] 10.222.0.85 "GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.062627 Aug 24 10:57:36.073884 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3398/6438] 10.222.0.85 () {58 vars in 1293 bytes} [Wed Aug 24 10:57:36 2022] GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451/os-server-password => generated 116 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:58:20.746434 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=18 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:20.747250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:20.751768 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4db4a216-4217-4b61-b600-29b9c7a4a6d4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:58:20.752242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4db4a216-4217-4b61-b600-29b9c7a4a6d4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:58:20.760924 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4db4a216-4217-4b61-b600-29b9c7a4a6d4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:20.761412 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4db4a216-4217-4b61-b600-29b9c7a4a6d4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:20.761861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4db4a216-4217-4b61-b600-29b9c7a4a6d4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:20.762578 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4db4a216-4217-4b61-b600-29b9c7a4a6d4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:20.763038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4db4a216-4217-4b61-b600-29b9c7a4a6d4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:20.763464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4db4a216-4217-4b61-b600-29b9c7a4a6d4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:20.790975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4db4a216-4217-4b61-b600-29b9c7a4a6d4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:58:20.873803 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4db4a216-4217-4b61-b600-29b9c7a4a6d4 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "DELETE /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 204 len: 0 microversion: 2.1 time: 0.129839 Aug 24 10:58:20.874530 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3041/6439] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 10:58:20 2022] DELETE /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:58:20.882875 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0a325cfe-4e89-45d0-bb8c-8d6f081c5483 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:58:20.883492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0a325cfe-4e89-45d0-bb8c-8d6f081c5483 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:58:20.887015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:20.887684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:20.891579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a325cfe-4e89-45d0-bb8c-8d6f081c5483 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:20.892173 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a325cfe-4e89-45d0-bb8c-8d6f081c5483 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:20.892547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a325cfe-4e89-45d0-bb8c-8d6f081c5483 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:20.893315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a325cfe-4e89-45d0-bb8c-8d6f081c5483 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:20.893795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a325cfe-4e89-45d0-bb8c-8d6f081c5483 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:20.894392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a325cfe-4e89-45d0-bb8c-8d6f081c5483 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:21.037151 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0a325cfe-4e89-45d0-bb8c-8d6f081c5483 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:58:21.045660 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0a325cfe-4e89-45d0-bb8c-8d6f081c5483 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 200 len: 1578 microversion: 2.1 time: 0.166716 Aug 24 10:58:21.046279 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3399/6440] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:58:20 2022] GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:58:22.068475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f1c4a9b9-8da3-4468-a16c-8918e4da148f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:58:22.069335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f1c4a9b9-8da3-4468-a16c-8918e4da148f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:58:22.076891 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1c4a9b9-8da3-4468-a16c-8918e4da148f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:22.077835 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1c4a9b9-8da3-4468-a16c-8918e4da148f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:22.078326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1c4a9b9-8da3-4468-a16c-8918e4da148f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:22.079322 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1c4a9b9-8da3-4468-a16c-8918e4da148f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:22.079858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1c4a9b9-8da3-4468-a16c-8918e4da148f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:22.080423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1c4a9b9-8da3-4468-a16c-8918e4da148f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:22.253008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f1c4a9b9-8da3-4468-a16c-8918e4da148f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:58:22.261375 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f1c4a9b9-8da3-4468-a16c-8918e4da148f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 200 len: 1578 microversion: 2.1 time: 0.197448 Aug 24 10:58:22.262116 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3042/6441] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:58:22 2022] GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 1578 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:58:23.283138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7987c2bf-4cbd-4e04-bf7b-3e1d347774d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:58:23.283899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7987c2bf-4cbd-4e04-bf7b-3e1d347774d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:58:23.291785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7987c2bf-4cbd-4e04-bf7b-3e1d347774d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:23.292291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7987c2bf-4cbd-4e04-bf7b-3e1d347774d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:23.292740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7987c2bf-4cbd-4e04-bf7b-3e1d347774d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:23.293469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7987c2bf-4cbd-4e04-bf7b-3e1d347774d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:23.294257 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7987c2bf-4cbd-4e04-bf7b-3e1d347774d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:23.294706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7987c2bf-4cbd-4e04-bf7b-3e1d347774d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:23.374256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7987c2bf-4cbd-4e04-bf7b-3e1d347774d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:58:23.382891 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7987c2bf-4cbd-4e04-bf7b-3e1d347774d5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 200 len: 1511 microversion: 2.1 time: 0.103957 Aug 24 10:58:23.383562 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3400/6442] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:58:23 2022] GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 1511 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:58:23.577608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-fea3c342-cf9d-4c4a-9ff2-1a41f8eebf39 req-033c270b-7a9a-4981-bd35-5ec4302d34fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30efa0e8-e35a-4785-bb4c-fc0354bec60b", "name": "network-vif-deleted", "tag": "3d8fbecc-df04-4d22-855e-b0912b1a1cc3"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:58:23.596490 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fea3c342-cf9d-4c4a-9ff2-1a41f8eebf39 req-033c270b-7a9a-4981-bd35-5ec4302d34fe service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:23.596979 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fea3c342-cf9d-4c4a-9ff2-1a41f8eebf39 req-033c270b-7a9a-4981-bd35-5ec4302d34fe service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:23.598329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fea3c342-cf9d-4c4a-9ff2-1a41f8eebf39 req-033c270b-7a9a-4981-bd35-5ec4302d34fe service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:23.613463 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-fea3c342-cf9d-4c4a-9ff2-1a41f8eebf39 req-033c270b-7a9a-4981-bd35-5ec4302d34fe service nova] Creating event network-vif-deleted:3d8fbecc-df04-4d22-855e-b0912b1a1cc3 for instance 30efa0e8-e35a-4785-bb4c-fc0354bec60b on n-h2-849328-3 Aug 24 10:58:23.619575 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-fea3c342-cf9d-4c4a-9ff2-1a41f8eebf39 req-033c270b-7a9a-4981-bd35-5ec4302d34fe service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046183 Aug 24 10:58:23.624317 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3043/6443] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:58:24.404668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4cbedd9f-9caa-4f82-8d75-80edcbc7bd29 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:58:24.406187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4cbedd9f-9caa-4f82-8d75-80edcbc7bd29 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:58:24.414221 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cbedd9f-9caa-4f82-8d75-80edcbc7bd29 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:24.414871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cbedd9f-9caa-4f82-8d75-80edcbc7bd29 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:24.415344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cbedd9f-9caa-4f82-8d75-80edcbc7bd29 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:24.416134 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cbedd9f-9caa-4f82-8d75-80edcbc7bd29 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:24.416679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cbedd9f-9caa-4f82-8d75-80edcbc7bd29 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:24.417128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cbedd9f-9caa-4f82-8d75-80edcbc7bd29 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:24.494862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4cbedd9f-9caa-4f82-8d75-80edcbc7bd29 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:58:24.505097 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4cbedd9f-9caa-4f82-8d75-80edcbc7bd29 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 200 len: 1226 microversion: 2.1 time: 0.104784 Aug 24 10:58:24.506713 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3401/6444] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:58:24 2022] GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:58:25.527253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-13937c23-b93a-41b6-a6c6-ab937a8d4d69 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:58:25.528072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-13937c23-b93a-41b6-a6c6-ab937a8d4d69 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:58:25.536068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13937c23-b93a-41b6-a6c6-ab937a8d4d69 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:25.536762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13937c23-b93a-41b6-a6c6-ab937a8d4d69 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:25.537206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13937c23-b93a-41b6-a6c6-ab937a8d4d69 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:25.538005 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13937c23-b93a-41b6-a6c6-ab937a8d4d69 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:25.538524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13937c23-b93a-41b6-a6c6-ab937a8d4d69 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:25.539054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13937c23-b93a-41b6-a6c6-ab937a8d4d69 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:25.631990 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-13937c23-b93a-41b6-a6c6-ab937a8d4d69 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:58:25.647232 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-13937c23-b93a-41b6-a6c6-ab937a8d4d69 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 200 len: 1226 microversion: 2.1 time: 0.124303 Aug 24 10:58:25.649372 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3044/6445] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:58:25 2022] GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 1226 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:58:26.668742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5de601b2-0fc5-42b2-b2a8-ab955eebe957 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:58:26.671178 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5de601b2-0fc5-42b2-b2a8-ab955eebe957 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:58:26.679346 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5de601b2-0fc5-42b2-b2a8-ab955eebe957 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:26.680769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5de601b2-0fc5-42b2-b2a8-ab955eebe957 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:26.681390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5de601b2-0fc5-42b2-b2a8-ab955eebe957 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:26.682115 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5de601b2-0fc5-42b2-b2a8-ab955eebe957 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:26.682586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5de601b2-0fc5-42b2-b2a8-ab955eebe957 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:26.683023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5de601b2-0fc5-42b2-b2a8-ab955eebe957 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:26.775672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5de601b2-0fc5-42b2-b2a8-ab955eebe957 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:58:26.784648 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5de601b2-0fc5-42b2-b2a8-ab955eebe957 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 200 len: 1226 microversion: 2.1 time: 0.119788 Aug 24 10:58:26.797964 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3402/6446] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:58:26 2022] GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 1226 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:58:27.807222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a1d4f5fc-b4b9-4c62-80e5-cf4e964c3629 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:58:27.808491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a1d4f5fc-b4b9-4c62-80e5-cf4e964c3629 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:58:27.817535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1d4f5fc-b4b9-4c62-80e5-cf4e964c3629 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:27.818333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1d4f5fc-b4b9-4c62-80e5-cf4e964c3629 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:27.818772 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1d4f5fc-b4b9-4c62-80e5-cf4e964c3629 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:27.819475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1d4f5fc-b4b9-4c62-80e5-cf4e964c3629 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:27.820104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1d4f5fc-b4b9-4c62-80e5-cf4e964c3629 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:27.820531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1d4f5fc-b4b9-4c62-80e5-cf4e964c3629 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:27.905074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a1d4f5fc-b4b9-4c62-80e5-cf4e964c3629 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:58:27.917943 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a1d4f5fc-b4b9-4c62-80e5-cf4e964c3629 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 200 len: 1226 microversion: 2.1 time: 0.115992 Aug 24 10:58:27.918891 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3045/6447] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:58:27 2022] GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 1226 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:58:28.939266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e85fffca-a7de-4ca5-ae31-52156dca2d79 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:58:28.940015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e85fffca-a7de-4ca5-ae31-52156dca2d79 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:58:28.947125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85fffca-a7de-4ca5-ae31-52156dca2d79 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:28.947622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85fffca-a7de-4ca5-ae31-52156dca2d79 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:28.948067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85fffca-a7de-4ca5-ae31-52156dca2d79 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:28.948791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85fffca-a7de-4ca5-ae31-52156dca2d79 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:28.949288 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85fffca-a7de-4ca5-ae31-52156dca2d79 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:28.949744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85fffca-a7de-4ca5-ae31-52156dca2d79 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:28.964702 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-e85fffca-a7de-4ca5-ae31-52156dca2d79 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] HTTP exception thrown: Instance 30efa0e8-e35a-4785-bb4c-fc0354bec60b could not be found. Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e85fffca-a7de-4ca5-ae31-52156dca2d79 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Request method failure captured: Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b HTTP/1.1 Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgJaL-kWwlcIRB5LGdxUOg9NstdlrO4InCZtaIlL6zMAKoO2x9AaKw5QTM5Yc447Qz9dKY7jxkolr7Q3liCCaPxpGdqV4sv_A4_Emu-qJmA0z5hB1ngNyBGm9n-W2LyGX7LaKy8OE29M25iXwnWnUlWVb7vPgN3qX9b_bYxZIyExFQ4 Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d1785d661bbd41619a7046600ad435b1", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d1785d661bbd41619a7046600ad435b1"}]}] Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestVolumeBootPattern-1780678770-project Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 26b7ff61eab4477890d20977574e8dac Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestVolumeBootPattern-1780678770-project Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 30efa0e8-e35a-4785-bb4c-fc0354bec60b could not be found. Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '30efa0e8-e35a-4785-bb4c-fc0354bec60b'} Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30efa0e8-e35a-4785-bb4c-fc0354bec60b could not be found. Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30efa0e8-e35a-4785-bb4c-fc0354bec60b could not be found. Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:58:28.966623 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:58:28.972244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:58:28.972244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:58:28.972244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:58:28.972244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:58:28.972244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:58:28.972244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30efa0e8-e35a-4785-bb4c-fc0354bec60b could not be found. Aug 24 10:58:28.972244 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 10:58:28.972244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e85fffca-a7de-4ca5-ae31-52156dca2d79 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Returning 404 to user: Instance 30efa0e8-e35a-4785-bb4c-fc0354bec60b could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:58:28.972244 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e85fffca-a7de-4ca5-ae31-52156dca2d79 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 404 len: 111 microversion: 2.1 time: 0.032812 Aug 24 10:58:28.974647 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3403/6448] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:58:28 2022] GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:58:29.067231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-88155408-cfc1-42af-bce7-8c75e6279e0e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1691793245", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1418087682", "security_groups": [{"name": "tempest-secgroup-smoke-793359891"}], "block_device_mapping_v2": [{"uuid": "546c69ec-c617-4c14-9054-28ddf87bfdc7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9996d4a7-fe50-441a-b919-9c80031d0109"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:58:29.187067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-88155408-cfc1-42af-bce7-8c75e6279e0e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] validate_networks() for [('9996d4a7-fe50-441a-b919-9c80031d0109', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:58:29.568796 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-88155408-cfc1-42af-bce7-8c75e6279e0e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:58:29.569356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-88155408-cfc1-42af-bce7-8c75e6279e0e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:58:29.569844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-88155408-cfc1-42af-bce7-8c75e6279e0e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:58:29.570261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-88155408-cfc1-42af-bce7-8c75e6279e0e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:58:29.570677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-88155408-cfc1-42af-bce7-8c75e6279e0e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:58:29.580006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88155408-cfc1-42af-bce7-8c75e6279e0e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:29.580495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88155408-cfc1-42af-bce7-8c75e6279e0e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:29.580939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88155408-cfc1-42af-bce7-8c75e6279e0e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:29.581700 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88155408-cfc1-42af-bce7-8c75e6279e0e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:29.582159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88155408-cfc1-42af-bce7-8c75e6279e0e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:29.582769 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88155408-cfc1-42af-bce7-8c75e6279e0e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:29.600165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-88155408-cfc1-42af-bce7-8c75e6279e0e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Getting quotas for project d1785d661bbd41619a7046600ad435b1. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:58:29.605740 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-88155408-cfc1-42af-bce7-8c75e6279e0e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Getting quotas for user 26b7ff61eab4477890d20977574e8dac and project d1785d661bbd41619a7046600ad435b1. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:58:29.665661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-88155408-cfc1-42af-bce7-8c75e6279e0e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:58:29.667855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-88155408-cfc1-42af-bce7-8c75e6279e0e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 16096adc-d1e6-4c42-b149-f3f987f6df9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='546c69ec-c617-4c14-9054-28ddf87bfdc7',volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:58:29.810069 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-88155408-cfc1-42af-bce7-8c75e6279e0e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.746706 Aug 24 10:58:29.811298 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3046/6449] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:58:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:58:29.822192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-00080b08-dead-4810-9e20-15c0e63df940 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:58:29.823202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-00080b08-dead-4810-9e20-15c0e63df940 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 16096adc-d1e6-4c42-b149-f3f987f6df9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:58:29.881961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-00080b08-dead-4810-9e20-15c0e63df940 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:58:29.889273 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-00080b08-dead-4810-9e20-15c0e63df940 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d" status: 200 len: 1095 microversion: 2.1 time: 0.071122 Aug 24 10:58:29.890209 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3404/6450] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:58:29 2022] GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:58:30.914581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-23590d7a-ce6d-4c50-b794-0173af41ad65 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:58:30.915848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-23590d7a-ce6d-4c50-b794-0173af41ad65 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 16096adc-d1e6-4c42-b149-f3f987f6df9d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:58:30.923347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23590d7a-ce6d-4c50-b794-0173af41ad65 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:30.924159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23590d7a-ce6d-4c50-b794-0173af41ad65 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:30.924782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23590d7a-ce6d-4c50-b794-0173af41ad65 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:30.925702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23590d7a-ce6d-4c50-b794-0173af41ad65 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:30.926333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23590d7a-ce6d-4c50-b794-0173af41ad65 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:30.926973 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23590d7a-ce6d-4c50-b794-0173af41ad65 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:31.015804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-23590d7a-ce6d-4c50-b794-0173af41ad65 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:58:31.029957 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-23590d7a-ce6d-4c50-b794-0173af41ad65 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d" status: 200 len: 1201 microversion: 2.1 time: 0.120573 Aug 24 10:58:31.030992 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3047/6451] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:58:30 2022] GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d => generated 1201 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:58:32.050676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b66368fd-b989-4de4-9cb0-a1075cbeb0b2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:58:32.051579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b66368fd-b989-4de4-9cb0-a1075cbeb0b2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 16096adc-d1e6-4c42-b149-f3f987f6df9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:58:32.076003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b66368fd-b989-4de4-9cb0-a1075cbeb0b2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:32.080347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b66368fd-b989-4de4-9cb0-a1075cbeb0b2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:32.081237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b66368fd-b989-4de4-9cb0-a1075cbeb0b2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:32.082500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b66368fd-b989-4de4-9cb0-a1075cbeb0b2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:32.083255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b66368fd-b989-4de4-9cb0-a1075cbeb0b2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:32.084000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b66368fd-b989-4de4-9cb0-a1075cbeb0b2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:32.275833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b66368fd-b989-4de4-9cb0-a1075cbeb0b2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:58:32.285502 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b66368fd-b989-4de4-9cb0-a1075cbeb0b2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d" status: 200 len: 1278 microversion: 2.1 time: 0.238585 Aug 24 10:58:32.286936 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3405/6452] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:58:32 2022] GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d => generated 1278 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:58:33.019981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-ad2f1a38-d212-4725-bd66-51e6f9fc42b5 req-d55be0e6-0234-41e3-946d-8e8e93244190 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16096adc-d1e6-4c42-b149-f3f987f6df9d", "tag": "a53bf1c8-83a7-4502-a211-32fada58f71b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:58:33.033084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ad2f1a38-d212-4725-bd66-51e6f9fc42b5 req-d55be0e6-0234-41e3-946d-8e8e93244190 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:33.033714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ad2f1a38-d212-4725-bd66-51e6f9fc42b5 req-d55be0e6-0234-41e3-946d-8e8e93244190 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:33.034269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ad2f1a38-d212-4725-bd66-51e6f9fc42b5 req-d55be0e6-0234-41e3-946d-8e8e93244190 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:33.046885 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-ad2f1a38-d212-4725-bd66-51e6f9fc42b5 req-d55be0e6-0234-41e3-946d-8e8e93244190 service nova] Creating event network-changed:a53bf1c8-83a7-4502-a211-32fada58f71b for instance 16096adc-d1e6-4c42-b149-f3f987f6df9d on n-h1-849328-3 Aug 24 10:58:33.052604 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-ad2f1a38-d212-4725-bd66-51e6f9fc42b5 req-d55be0e6-0234-41e3-946d-8e8e93244190 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209207 Aug 24 10:58:33.053765 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3048/6453] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:58:33.310101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dad8893d-dc9b-455b-b5da-77ec452b12e3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:58:33.312753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dad8893d-dc9b-455b-b5da-77ec452b12e3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 16096adc-d1e6-4c42-b149-f3f987f6df9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:58:33.325279 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dad8893d-dc9b-455b-b5da-77ec452b12e3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:33.326525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dad8893d-dc9b-455b-b5da-77ec452b12e3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:33.327194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dad8893d-dc9b-455b-b5da-77ec452b12e3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:33.329326 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dad8893d-dc9b-455b-b5da-77ec452b12e3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:33.330017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dad8893d-dc9b-455b-b5da-77ec452b12e3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:33.330661 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dad8893d-dc9b-455b-b5da-77ec452b12e3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:33.480909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dad8893d-dc9b-455b-b5da-77ec452b12e3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:58:33.495224 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dad8893d-dc9b-455b-b5da-77ec452b12e3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d" status: 200 len: 1278 microversion: 2.1 time: 0.191397 Aug 24 10:58:33.495940 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3406/6454] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:58:33 2022] GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d => generated 1278 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:58:34.517470 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1fae8bbe-89a9-4baa-96a1-58821f466f4c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:58:34.518256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1fae8bbe-89a9-4baa-96a1-58821f466f4c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 16096adc-d1e6-4c42-b149-f3f987f6df9d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:58:34.525734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fae8bbe-89a9-4baa-96a1-58821f466f4c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:34.526311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fae8bbe-89a9-4baa-96a1-58821f466f4c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:34.526902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fae8bbe-89a9-4baa-96a1-58821f466f4c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:34.527669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fae8bbe-89a9-4baa-96a1-58821f466f4c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:34.528192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fae8bbe-89a9-4baa-96a1-58821f466f4c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:34.528679 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fae8bbe-89a9-4baa-96a1-58821f466f4c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:34.671423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1fae8bbe-89a9-4baa-96a1-58821f466f4c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:58:34.679856 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1fae8bbe-89a9-4baa-96a1-58821f466f4c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d" status: 200 len: 1278 microversion: 2.1 time: 0.167592 Aug 24 10:58:34.680471 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3049/6455] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:58:34 2022] GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:58:35.702650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-97864e5e-a614-4dc9-aa8c-aab37b92d691 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:58:35.703303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-97864e5e-a614-4dc9-aa8c-aab37b92d691 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 16096adc-d1e6-4c42-b149-f3f987f6df9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:58:35.710870 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97864e5e-a614-4dc9-aa8c-aab37b92d691 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:35.711437 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97864e5e-a614-4dc9-aa8c-aab37b92d691 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:35.711913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97864e5e-a614-4dc9-aa8c-aab37b92d691 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:35.712640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97864e5e-a614-4dc9-aa8c-aab37b92d691 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:35.713099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97864e5e-a614-4dc9-aa8c-aab37b92d691 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:35.713602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97864e5e-a614-4dc9-aa8c-aab37b92d691 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:35.875209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-97864e5e-a614-4dc9-aa8c-aab37b92d691 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:58:35.885400 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-97864e5e-a614-4dc9-aa8c-aab37b92d691 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d" status: 200 len: 1278 microversion: 2.1 time: 0.187540 Aug 24 10:58:35.886405 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3407/6456] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:58:35 2022] GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d => generated 1278 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:58:36.907723 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-28712c6f-195d-4808-a439-b8d840d97d9c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:58:36.908408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-28712c6f-195d-4808-a439-b8d840d97d9c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 16096adc-d1e6-4c42-b149-f3f987f6df9d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:58:36.916863 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28712c6f-195d-4808-a439-b8d840d97d9c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:36.917370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28712c6f-195d-4808-a439-b8d840d97d9c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:36.917817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28712c6f-195d-4808-a439-b8d840d97d9c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:36.918507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28712c6f-195d-4808-a439-b8d840d97d9c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:36.918974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28712c6f-195d-4808-a439-b8d840d97d9c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:36.919372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28712c6f-195d-4808-a439-b8d840d97d9c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:37.062676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-28712c6f-195d-4808-a439-b8d840d97d9c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:58:37.070575 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-28712c6f-195d-4808-a439-b8d840d97d9c tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d" status: 200 len: 1266 microversion: 2.1 time: 0.167586 Aug 24 10:58:37.071387 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3050/6457] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:58:36 2022] GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:58:38.092421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a3ef4121-5558-4288-98ec-0f686b6aad7f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:58:38.093145 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a3ef4121-5558-4288-98ec-0f686b6aad7f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 16096adc-d1e6-4c42-b149-f3f987f6df9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:58:38.101064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3ef4121-5558-4288-98ec-0f686b6aad7f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:38.101592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3ef4121-5558-4288-98ec-0f686b6aad7f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:38.102052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3ef4121-5558-4288-98ec-0f686b6aad7f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:38.102776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3ef4121-5558-4288-98ec-0f686b6aad7f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:38.103253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3ef4121-5558-4288-98ec-0f686b6aad7f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:38.103704 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3ef4121-5558-4288-98ec-0f686b6aad7f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:38.256535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a3ef4121-5558-4288-98ec-0f686b6aad7f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:58:38.264670 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a3ef4121-5558-4288-98ec-0f686b6aad7f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d" status: 200 len: 1266 microversion: 2.1 time: 0.176491 Aug 24 10:58:38.265287 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3408/6458] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:58:38 2022] GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:58:39.286135 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4e7389a6-af47-4e8b-a40e-88dda00e83f9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:58:39.286738 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4e7389a6-af47-4e8b-a40e-88dda00e83f9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 16096adc-d1e6-4c42-b149-f3f987f6df9d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:58:39.294040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e7389a6-af47-4e8b-a40e-88dda00e83f9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:39.294532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e7389a6-af47-4e8b-a40e-88dda00e83f9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:39.294964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e7389a6-af47-4e8b-a40e-88dda00e83f9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:39.295918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e7389a6-af47-4e8b-a40e-88dda00e83f9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:39.296408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e7389a6-af47-4e8b-a40e-88dda00e83f9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:39.296828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e7389a6-af47-4e8b-a40e-88dda00e83f9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:39.441799 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4e7389a6-af47-4e8b-a40e-88dda00e83f9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:58:39.455480 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4e7389a6-af47-4e8b-a40e-88dda00e83f9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d" status: 200 len: 1266 microversion: 2.1 time: 0.173391 Aug 24 10:58:39.469288 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3051/6459] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:58:39 2022] GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:58:40.475098 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:40.479368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1cdef795-f24e-4564-aa45-43d9263c1596 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:58:40.479970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1cdef795-f24e-4564-aa45-43d9263c1596 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 16096adc-d1e6-4c42-b149-f3f987f6df9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:58:40.486442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cdef795-f24e-4564-aa45-43d9263c1596 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:40.486973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cdef795-f24e-4564-aa45-43d9263c1596 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:40.487406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cdef795-f24e-4564-aa45-43d9263c1596 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:40.488102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cdef795-f24e-4564-aa45-43d9263c1596 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:40.488567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cdef795-f24e-4564-aa45-43d9263c1596 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:40.488975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cdef795-f24e-4564-aa45-43d9263c1596 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:40.625034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1cdef795-f24e-4564-aa45-43d9263c1596 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:58:40.633192 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1cdef795-f24e-4564-aa45-43d9263c1596 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d" status: 200 len: 1266 microversion: 2.1 time: 0.159726 Aug 24 10:58:40.633851 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3409/6460] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:58:40 2022] GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:58:41.586071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:41.588694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:41.653933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3961879b-24cc-466d-a54d-42643f13325e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:58:41.654562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3961879b-24cc-466d-a54d-42643f13325e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 16096adc-d1e6-4c42-b149-f3f987f6df9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:58:41.661023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3961879b-24cc-466d-a54d-42643f13325e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:41.661567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3961879b-24cc-466d-a54d-42643f13325e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:41.662096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3961879b-24cc-466d-a54d-42643f13325e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:41.662724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3961879b-24cc-466d-a54d-42643f13325e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:41.665675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3961879b-24cc-466d-a54d-42643f13325e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:41.666218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3961879b-24cc-466d-a54d-42643f13325e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:41.670251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-f750764b-e0c4-4185-9eea-20bf69e7c7f4 req-951cc12b-f4ad-4306-a190-3b31365a73e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16096adc-d1e6-4c42-b149-f3f987f6df9d", "name": "network-vif-plugged", "status": "completed", "tag": "a53bf1c8-83a7-4502-a211-32fada58f71b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:58:41.680113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f750764b-e0c4-4185-9eea-20bf69e7c7f4 req-951cc12b-f4ad-4306-a190-3b31365a73e0 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:41.680594 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f750764b-e0c4-4185-9eea-20bf69e7c7f4 req-951cc12b-f4ad-4306-a190-3b31365a73e0 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:41.681025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f750764b-e0c4-4185-9eea-20bf69e7c7f4 req-951cc12b-f4ad-4306-a190-3b31365a73e0 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:41.692262 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-f750764b-e0c4-4185-9eea-20bf69e7c7f4 req-951cc12b-f4ad-4306-a190-3b31365a73e0 service nova] Creating event network-vif-plugged:a53bf1c8-83a7-4502-a211-32fada58f71b for instance 16096adc-d1e6-4c42-b149-f3f987f6df9d on n-h1-849328-3 Aug 24 10:58:41.698002 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-f750764b-e0c4-4185-9eea-20bf69e7c7f4 req-951cc12b-f4ad-4306-a190-3b31365a73e0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116780 Aug 24 10:58:41.698593 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3052/6461] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:58:41.824890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3961879b-24cc-466d-a54d-42643f13325e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:58:41.835655 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3961879b-24cc-466d-a54d-42643f13325e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d" status: 200 len: 1266 microversion: 2.1 time: 0.185613 Aug 24 10:58:41.836427 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3410/6462] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:58:41 2022] GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:58:42.862864 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b6d47301-cede-4b39-a359-0aed87709e33 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:58:42.863722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b6d47301-cede-4b39-a359-0aed87709e33 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 16096adc-d1e6-4c42-b149-f3f987f6df9d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:58:42.870436 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6d47301-cede-4b39-a359-0aed87709e33 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:42.870897 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6d47301-cede-4b39-a359-0aed87709e33 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:42.871326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6d47301-cede-4b39-a359-0aed87709e33 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:42.872029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6d47301-cede-4b39-a359-0aed87709e33 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:42.872469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6d47301-cede-4b39-a359-0aed87709e33 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:42.872880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6d47301-cede-4b39-a359-0aed87709e33 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:43.022282 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b6d47301-cede-4b39-a359-0aed87709e33 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:58:43.031104 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b6d47301-cede-4b39-a359-0aed87709e33 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d" status: 200 len: 1266 microversion: 2.1 time: 0.173666 Aug 24 10:58:43.031776 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3053/6463] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:58:42 2022] GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:58:44.052060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ed23fa0-2a87-4a6c-b6f2-af47af4ef888 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:58:44.052788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8ed23fa0-2a87-4a6c-b6f2-af47af4ef888 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 16096adc-d1e6-4c42-b149-f3f987f6df9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:58:44.060382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ed23fa0-2a87-4a6c-b6f2-af47af4ef888 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:44.060882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ed23fa0-2a87-4a6c-b6f2-af47af4ef888 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:44.061383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ed23fa0-2a87-4a6c-b6f2-af47af4ef888 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:44.062092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ed23fa0-2a87-4a6c-b6f2-af47af4ef888 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:44.062560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ed23fa0-2a87-4a6c-b6f2-af47af4ef888 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:44.063005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ed23fa0-2a87-4a6c-b6f2-af47af4ef888 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:44.207364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8ed23fa0-2a87-4a6c-b6f2-af47af4ef888 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:58:44.215683 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8ed23fa0-2a87-4a6c-b6f2-af47af4ef888 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d" status: 200 len: 1453 microversion: 2.1 time: 0.167636 Aug 24 10:58:44.216595 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3411/6464] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:58:44 2022] GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:58:44.236934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1c9018f1-2eba-4479-9b71-54f91418907e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:58:44.237614 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1c9018f1-2eba-4479-9b71-54f91418907e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 16096adc-d1e6-4c42-b149-f3f987f6df9d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:58:44.250829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c9018f1-2eba-4479-9b71-54f91418907e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:44.250829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c9018f1-2eba-4479-9b71-54f91418907e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:44.250829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c9018f1-2eba-4479-9b71-54f91418907e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:44.250829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c9018f1-2eba-4479-9b71-54f91418907e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:44.250829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c9018f1-2eba-4479-9b71-54f91418907e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:44.250829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c9018f1-2eba-4479-9b71-54f91418907e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:44.381459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1c9018f1-2eba-4479-9b71-54f91418907e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:58:44.390133 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1c9018f1-2eba-4479-9b71-54f91418907e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d" status: 200 len: 1453 microversion: 2.1 time: 0.157699 Aug 24 10:58:44.390690 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3054/6465] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:58:44 2022] GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:58:46.396525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-d07ed598-e3c6-468e-8c3d-e99da6f7da57 req-26f0ff24-9926-49f1-bbd1-6cb0e062475f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16096adc-d1e6-4c42-b149-f3f987f6df9d", "tag": "a53bf1c8-83a7-4502-a211-32fada58f71b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:58:46.407826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d07ed598-e3c6-468e-8c3d-e99da6f7da57 req-26f0ff24-9926-49f1-bbd1-6cb0e062475f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:46.408398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d07ed598-e3c6-468e-8c3d-e99da6f7da57 req-26f0ff24-9926-49f1-bbd1-6cb0e062475f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:46.408904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d07ed598-e3c6-468e-8c3d-e99da6f7da57 req-26f0ff24-9926-49f1-bbd1-6cb0e062475f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:46.421301 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-d07ed598-e3c6-468e-8c3d-e99da6f7da57 req-26f0ff24-9926-49f1-bbd1-6cb0e062475f service nova] Creating event network-changed:a53bf1c8-83a7-4502-a211-32fada58f71b for instance 16096adc-d1e6-4c42-b149-f3f987f6df9d on n-h1-849328-3 Aug 24 10:58:46.427730 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-d07ed598-e3c6-468e-8c3d-e99da6f7da57 req-26f0ff24-9926-49f1-bbd1-6cb0e062475f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035422 Aug 24 10:58:46.429187 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3412/6466] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:59:17.362178 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:59:17.363397 n-d-849328-3 devstack@n-api.service[122433]: Wed Aug 24 10:59:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:59:45.753225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:59:45.753987 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:59:45.758173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bf14af02-1bd0-43f8-9d6c-aac4501d7c5a tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Action: 'create', calling method: .version_select at 0x7f4655280790>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1585459204", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwwBdpVs0kYJF55mYQpSPf8sJkKNMBmjluQEH5Vm1pC737m15S/S2aIkd06clmbELw735VU9OH6ihtUg+vNXZmI98pR/wufsD619posvqmTRJTBALaFc2EYVrDs4+Zdxg=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:59:45.779354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-bf14af02-1bd0-43f8-9d6c-aac4501d7c5a tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Getting quotas for project 1b8a596c16ed4114b7638e6ce9fc1434. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:59:45.785256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-bf14af02-1bd0-43f8-9d6c-aac4501d7c5a tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Getting quotas for user 70e7402639774ba08c1250c3d0c3f584 and project 1b8a596c16ed4114b7638e6ce9fc1434. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:59:45.814880 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bf14af02-1bd0-43f8-9d6c-aac4501d7c5a tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.063554 Aug 24 10:59:45.815626 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3055/6467] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 10:59:45 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:59:46.845019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=30 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:59:46.845824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=70 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:59:46.850472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a21f98ae-343c-4f70-a458-29aeb99c4e30 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1456084040", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d8066fb9-b4af-44e7-b660-d776825aa944", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1585459204", "security_groups": [{"name": "tempest-secgroup-smoke-1271736870"}], "networks": [{"uuid": "35758fe4-195c-4a5e-a41d-6f6941bdf7a5"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:59:46.966325 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-a21f98ae-343c-4f70-a458-29aeb99c4e30 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] validate_networks() for [('35758fe4-195c-4a5e-a41d-6f6941bdf7a5', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:59:47.369078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a21f98ae-343c-4f70-a458-29aeb99c4e30 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:59:47.369548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a21f98ae-343c-4f70-a458-29aeb99c4e30 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:59:47.370064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a21f98ae-343c-4f70-a458-29aeb99c4e30 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:59:47.370489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a21f98ae-343c-4f70-a458-29aeb99c4e30 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:59:47.370913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a21f98ae-343c-4f70-a458-29aeb99c4e30 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:59:47.381218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a21f98ae-343c-4f70-a458-29aeb99c4e30 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:59:47.381751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a21f98ae-343c-4f70-a458-29aeb99c4e30 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:59:47.382191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a21f98ae-343c-4f70-a458-29aeb99c4e30 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:59:47.382958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a21f98ae-343c-4f70-a458-29aeb99c4e30 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:59:47.383419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a21f98ae-343c-4f70-a458-29aeb99c4e30 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:59:47.383890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a21f98ae-343c-4f70-a458-29aeb99c4e30 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:59:47.401477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-a21f98ae-343c-4f70-a458-29aeb99c4e30 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Getting quotas for project 1b8a596c16ed4114b7638e6ce9fc1434. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:59:47.407430 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-a21f98ae-343c-4f70-a458-29aeb99c4e30 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Getting quotas for user 70e7402639774ba08c1250c3d0c3f584 and project 1b8a596c16ed4114b7638e6ce9fc1434. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:59:47.469275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a21f98ae-343c-4f70-a458-29aeb99c4e30 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:59:47.471546 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a21f98ae-343c-4f70-a458-29aeb99c4e30 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] [instance: 6fcb1eb9-d46a-4177-9d35-5257666fe546] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d8066fb9-b4af-44e7-b660-d776825aa944',volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:59:47.616851 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a21f98ae-343c-4f70-a458-29aeb99c4e30 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.774555 Aug 24 10:59:47.617439 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3413/6468] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 10:59:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:59:47.630262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6aeee25b-25f8-4b17-8d61-fbbce1df6bc1 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:59:47.630983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6aeee25b-25f8-4b17-8d61-fbbce1df6bc1 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] [instance: 6fcb1eb9-d46a-4177-9d35-5257666fe546] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:59:47.692160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6aeee25b-25f8-4b17-8d61-fbbce1df6bc1 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e7402639774ba08c1250c3d0c3f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8a596c16ed4114b7638e6ce9fc1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:59:47.700286 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6aeee25b-25f8-4b17-8d61-fbbce1df6bc1 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] 10.222.0.85 "GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546" status: 200 len: 1099 microversion: 2.1 time: 0.075666 Aug 24 10:59:47.700963 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3056/6469] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:59:47 2022] GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546 => generated 1099 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:59:48.721109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-76a22d71-186f-4493-854f-e1b95b911f17 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:59:48.721757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-76a22d71-186f-4493-854f-e1b95b911f17 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] [instance: 6fcb1eb9-d46a-4177-9d35-5257666fe546] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:59:48.728956 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76a22d71-186f-4493-854f-e1b95b911f17 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:59:48.729481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76a22d71-186f-4493-854f-e1b95b911f17 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:59:48.729929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76a22d71-186f-4493-854f-e1b95b911f17 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:59:48.730630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76a22d71-186f-4493-854f-e1b95b911f17 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:59:48.731097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76a22d71-186f-4493-854f-e1b95b911f17 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:59:48.731528 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76a22d71-186f-4493-854f-e1b95b911f17 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:59:48.797645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-76a22d71-186f-4493-854f-e1b95b911f17 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e7402639774ba08c1250c3d0c3f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8a596c16ed4114b7638e6ce9fc1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:59:48.805708 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-76a22d71-186f-4493-854f-e1b95b911f17 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] 10.222.0.85 "GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546" status: 200 len: 1197 microversion: 2.1 time: 0.089249 Aug 24 10:59:48.806518 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3414/6470] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:59:48 2022] GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546 => generated 1197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:59:49.827933 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0417ed68-3b9d-43c2-a1aa-2acb49c5e24b tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:59:49.829672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0417ed68-3b9d-43c2-a1aa-2acb49c5e24b tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] [instance: 6fcb1eb9-d46a-4177-9d35-5257666fe546] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:59:49.838175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0417ed68-3b9d-43c2-a1aa-2acb49c5e24b tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:59:49.839357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0417ed68-3b9d-43c2-a1aa-2acb49c5e24b tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:59:49.839997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0417ed68-3b9d-43c2-a1aa-2acb49c5e24b tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:59:49.841781 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0417ed68-3b9d-43c2-a1aa-2acb49c5e24b tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:59:49.842254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0417ed68-3b9d-43c2-a1aa-2acb49c5e24b tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:59:49.843007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0417ed68-3b9d-43c2-a1aa-2acb49c5e24b tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:59:50.079723 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0417ed68-3b9d-43c2-a1aa-2acb49c5e24b tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e7402639774ba08c1250c3d0c3f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8a596c16ed4114b7638e6ce9fc1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:59:50.088091 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0417ed68-3b9d-43c2-a1aa-2acb49c5e24b tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] 10.222.0.85 "GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546" status: 200 len: 1283 microversion: 2.1 time: 0.264996 Aug 24 10:59:50.101216 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3057/6471] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:59:49 2022] GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546 => generated 1283 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:59:50.358664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-751acf3d-cd6b-4ae4-a227-ca7ed21cf227 req-aadd7143-3dab-4482-92c8-f9802498ee00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fcb1eb9-d46a-4177-9d35-5257666fe546", "tag": "695d1f1b-1f92-44a4-921d-deb96d370572"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:59:50.372731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-751acf3d-cd6b-4ae4-a227-ca7ed21cf227 req-aadd7143-3dab-4482-92c8-f9802498ee00 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:59:50.373273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-751acf3d-cd6b-4ae4-a227-ca7ed21cf227 req-aadd7143-3dab-4482-92c8-f9802498ee00 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:59:50.373720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-751acf3d-cd6b-4ae4-a227-ca7ed21cf227 req-aadd7143-3dab-4482-92c8-f9802498ee00 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:59:50.387702 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-751acf3d-cd6b-4ae4-a227-ca7ed21cf227 req-aadd7143-3dab-4482-92c8-f9802498ee00 service nova] Creating event network-changed:695d1f1b-1f92-44a4-921d-deb96d370572 for instance 6fcb1eb9-d46a-4177-9d35-5257666fe546 on n-h1-849328-3 Aug 24 10:59:50.394110 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-751acf3d-cd6b-4ae4-a227-ca7ed21cf227 req-aadd7143-3dab-4482-92c8-f9802498ee00 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041349 Aug 24 10:59:50.394718 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3415/6472] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 10:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:59:51.110475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e607d3bf-fe66-4d5c-a7e6-0701be66d894 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:59:51.111885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e607d3bf-fe66-4d5c-a7e6-0701be66d894 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] [instance: 6fcb1eb9-d46a-4177-9d35-5257666fe546] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:59:51.119880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e607d3bf-fe66-4d5c-a7e6-0701be66d894 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:59:51.120371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e607d3bf-fe66-4d5c-a7e6-0701be66d894 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:59:51.120811 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e607d3bf-fe66-4d5c-a7e6-0701be66d894 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:59:51.121576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e607d3bf-fe66-4d5c-a7e6-0701be66d894 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:59:51.122029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e607d3bf-fe66-4d5c-a7e6-0701be66d894 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:59:51.122453 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e607d3bf-fe66-4d5c-a7e6-0701be66d894 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:59:51.340013 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e607d3bf-fe66-4d5c-a7e6-0701be66d894 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e7402639774ba08c1250c3d0c3f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8a596c16ed4114b7638e6ce9fc1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:59:51.349484 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e607d3bf-fe66-4d5c-a7e6-0701be66d894 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] 10.222.0.85 "GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546" status: 200 len: 1283 microversion: 2.1 time: 0.243126 Aug 24 10:59:51.350175 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3058/6473] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:59:51 2022] GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546 => generated 1283 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:59:52.371965 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5b868069-a2ad-4c26-a4a0-0f753ad661d6 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:59:52.372871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5b868069-a2ad-4c26-a4a0-0f753ad661d6 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] [instance: 6fcb1eb9-d46a-4177-9d35-5257666fe546] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:59:52.379613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b868069-a2ad-4c26-a4a0-0f753ad661d6 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:59:52.380112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b868069-a2ad-4c26-a4a0-0f753ad661d6 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:59:52.380554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b868069-a2ad-4c26-a4a0-0f753ad661d6 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:59:52.381297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b868069-a2ad-4c26-a4a0-0f753ad661d6 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:59:52.381770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b868069-a2ad-4c26-a4a0-0f753ad661d6 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:59:52.382201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b868069-a2ad-4c26-a4a0-0f753ad661d6 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:59:52.520968 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5b868069-a2ad-4c26-a4a0-0f753ad661d6 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e7402639774ba08c1250c3d0c3f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8a596c16ed4114b7638e6ce9fc1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:59:52.529400 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5b868069-a2ad-4c26-a4a0-0f753ad661d6 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] 10.222.0.85 "GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546" status: 200 len: 1283 microversion: 2.1 time: 0.162627 Aug 24 10:59:52.530013 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3416/6474] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:59:52 2022] GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546 => generated 1283 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:59:53.550287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fc623bf9-c12a-4280-af61-61e59758c0f8 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:59:53.550857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fc623bf9-c12a-4280-af61-61e59758c0f8 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] [instance: 6fcb1eb9-d46a-4177-9d35-5257666fe546] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:59:53.557983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc623bf9-c12a-4280-af61-61e59758c0f8 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:59:53.558464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc623bf9-c12a-4280-af61-61e59758c0f8 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:59:53.558868 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc623bf9-c12a-4280-af61-61e59758c0f8 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:59:53.559586 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc623bf9-c12a-4280-af61-61e59758c0f8 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:59:53.560011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc623bf9-c12a-4280-af61-61e59758c0f8 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:59:53.560446 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc623bf9-c12a-4280-af61-61e59758c0f8 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:59:53.705004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fc623bf9-c12a-4280-af61-61e59758c0f8 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e7402639774ba08c1250c3d0c3f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8a596c16ed4114b7638e6ce9fc1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:59:53.713611 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fc623bf9-c12a-4280-af61-61e59758c0f8 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] 10.222.0.85 "GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546" status: 200 len: 1283 microversion: 2.1 time: 0.167220 Aug 24 10:59:53.717075 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3059/6475] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:59:53 2022] GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546 => generated 1283 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:59:54.739037 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-45be1f4a-1981-4ef8-8a81-a64e94079b01 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:59:54.739740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-45be1f4a-1981-4ef8-8a81-a64e94079b01 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] [instance: 6fcb1eb9-d46a-4177-9d35-5257666fe546] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:59:54.750082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45be1f4a-1981-4ef8-8a81-a64e94079b01 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:59:54.750758 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45be1f4a-1981-4ef8-8a81-a64e94079b01 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:59:54.751377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45be1f4a-1981-4ef8-8a81-a64e94079b01 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:59:54.752380 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45be1f4a-1981-4ef8-8a81-a64e94079b01 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:59:54.752991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45be1f4a-1981-4ef8-8a81-a64e94079b01 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:59:54.753560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45be1f4a-1981-4ef8-8a81-a64e94079b01 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:59:54.895103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-45be1f4a-1981-4ef8-8a81-a64e94079b01 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e7402639774ba08c1250c3d0c3f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8a596c16ed4114b7638e6ce9fc1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:59:54.902597 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-45be1f4a-1981-4ef8-8a81-a64e94079b01 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] 10.222.0.85 "GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546" status: 200 len: 1271 microversion: 2.1 time: 0.168232 Aug 24 10:59:54.903286 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3417/6476] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:59:54 2022] GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546 => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:59:55.927989 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d224033d-b040-4568-b351-503e900e5f71 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:59:55.929005 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d224033d-b040-4568-b351-503e900e5f71 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] [instance: 6fcb1eb9-d46a-4177-9d35-5257666fe546] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:59:55.940821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d224033d-b040-4568-b351-503e900e5f71 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:59:55.941705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d224033d-b040-4568-b351-503e900e5f71 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:59:55.942398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d224033d-b040-4568-b351-503e900e5f71 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:59:55.943582 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d224033d-b040-4568-b351-503e900e5f71 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:59:55.944334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d224033d-b040-4568-b351-503e900e5f71 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:59:55.945039 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d224033d-b040-4568-b351-503e900e5f71 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:59:56.086665 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d224033d-b040-4568-b351-503e900e5f71 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e7402639774ba08c1250c3d0c3f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8a596c16ed4114b7638e6ce9fc1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:59:56.099711 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d224033d-b040-4568-b351-503e900e5f71 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] 10.222.0.85 "GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546" status: 200 len: 1271 microversion: 2.1 time: 0.178139 Aug 24 10:59:56.100628 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3060/6477] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:59:55 2022] GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546 => generated 1271 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:59:57.121454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-01694766-0997-4643-b212-2ee16da9f8cc tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:59:57.122063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-01694766-0997-4643-b212-2ee16da9f8cc tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] [instance: 6fcb1eb9-d46a-4177-9d35-5257666fe546] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:59:57.129538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01694766-0997-4643-b212-2ee16da9f8cc tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:59:57.130040 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01694766-0997-4643-b212-2ee16da9f8cc tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:59:57.130491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01694766-0997-4643-b212-2ee16da9f8cc tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:59:57.131199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01694766-0997-4643-b212-2ee16da9f8cc tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:59:57.131667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01694766-0997-4643-b212-2ee16da9f8cc tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:59:57.132105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01694766-0997-4643-b212-2ee16da9f8cc tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:59:57.272898 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-01694766-0997-4643-b212-2ee16da9f8cc tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e7402639774ba08c1250c3d0c3f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8a596c16ed4114b7638e6ce9fc1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:59:57.281471 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-01694766-0997-4643-b212-2ee16da9f8cc tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] 10.222.0.85 "GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546" status: 200 len: 1271 microversion: 2.1 time: 0.164088 Aug 24 10:59:57.282057 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3418/6478] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:59:57 2022] GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546 => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:59:58.306461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-42d39f23-b755-4a6b-91f9-211a16bde34c tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:59:58.307499 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-42d39f23-b755-4a6b-91f9-211a16bde34c tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] [instance: 6fcb1eb9-d46a-4177-9d35-5257666fe546] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:59:58.311742 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:59:58.321091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42d39f23-b755-4a6b-91f9-211a16bde34c tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:59:58.321779 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42d39f23-b755-4a6b-91f9-211a16bde34c tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:59:58.322237 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42d39f23-b755-4a6b-91f9-211a16bde34c tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:59:58.322933 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42d39f23-b755-4a6b-91f9-211a16bde34c tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:59:58.323384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42d39f23-b755-4a6b-91f9-211a16bde34c tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:59:58.323804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42d39f23-b755-4a6b-91f9-211a16bde34c tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:59:58.465549 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-42d39f23-b755-4a6b-91f9-211a16bde34c tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e7402639774ba08c1250c3d0c3f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8a596c16ed4114b7638e6ce9fc1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:59:58.473742 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-42d39f23-b755-4a6b-91f9-211a16bde34c tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] 10.222.0.85 "GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546" status: 200 len: 1271 microversion: 2.1 time: 0.173865 Aug 24 10:59:58.474325 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3061/6479] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:59:58 2022] GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546 => generated 1271 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:59:59.496236 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-546dbd83-6d0c-41e8-9e52-fe3da1882479 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:59:59.496816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-546dbd83-6d0c-41e8-9e52-fe3da1882479 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] [instance: 6fcb1eb9-d46a-4177-9d35-5257666fe546] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:59:59.498909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:59:59.499590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:59:59.506599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-546dbd83-6d0c-41e8-9e52-fe3da1882479 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:59:59.507093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-546dbd83-6d0c-41e8-9e52-fe3da1882479 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:59:59.507528 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-546dbd83-6d0c-41e8-9e52-fe3da1882479 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:59:59.508234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-546dbd83-6d0c-41e8-9e52-fe3da1882479 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:59:59.508763 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-546dbd83-6d0c-41e8-9e52-fe3da1882479 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:59:59.509234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-546dbd83-6d0c-41e8-9e52-fe3da1882479 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:59:59.647405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-546dbd83-6d0c-41e8-9e52-fe3da1882479 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e7402639774ba08c1250c3d0c3f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8a596c16ed4114b7638e6ce9fc1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:59:59.656269 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-546dbd83-6d0c-41e8-9e52-fe3da1882479 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] 10.222.0.85 "GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546" status: 200 len: 1271 microversion: 2.1 time: 0.164826 Aug 24 10:59:59.656854 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3419/6480] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 10:59:59 2022] GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546 => generated 1271 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:00.680653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-24aade4b-ecbd-49bd-adf6-48a19f33512c tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:00.681489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-24aade4b-ecbd-49bd-adf6-48a19f33512c tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] [instance: 6fcb1eb9-d46a-4177-9d35-5257666fe546] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:00.689703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24aade4b-ecbd-49bd-adf6-48a19f33512c tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:00.690208 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24aade4b-ecbd-49bd-adf6-48a19f33512c tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:00.690670 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24aade4b-ecbd-49bd-adf6-48a19f33512c tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:00.691400 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24aade4b-ecbd-49bd-adf6-48a19f33512c tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:00.691876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24aade4b-ecbd-49bd-adf6-48a19f33512c tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:00.692306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24aade4b-ecbd-49bd-adf6-48a19f33512c tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:00.831878 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-24aade4b-ecbd-49bd-adf6-48a19f33512c tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e7402639774ba08c1250c3d0c3f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8a596c16ed4114b7638e6ce9fc1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:00.840554 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-24aade4b-ecbd-49bd-adf6-48a19f33512c tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] 10.222.0.85 "GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546" status: 200 len: 1271 microversion: 2.1 time: 0.164140 Aug 24 11:00:00.841152 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3062/6481] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:00 2022] GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546 => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:01.861879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7af030c5-c8bd-483c-8792-c0735abe2fcd tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:01.862621 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7af030c5-c8bd-483c-8792-c0735abe2fcd tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] [instance: 6fcb1eb9-d46a-4177-9d35-5257666fe546] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:01.870483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7af030c5-c8bd-483c-8792-c0735abe2fcd tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:01.871001 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7af030c5-c8bd-483c-8792-c0735abe2fcd tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:01.871449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7af030c5-c8bd-483c-8792-c0735abe2fcd tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:01.872193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7af030c5-c8bd-483c-8792-c0735abe2fcd tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:01.872661 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7af030c5-c8bd-483c-8792-c0735abe2fcd tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:01.873092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7af030c5-c8bd-483c-8792-c0735abe2fcd tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:02.009812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7af030c5-c8bd-483c-8792-c0735abe2fcd tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e7402639774ba08c1250c3d0c3f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8a596c16ed4114b7638e6ce9fc1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:02.017917 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7af030c5-c8bd-483c-8792-c0735abe2fcd tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] 10.222.0.85 "GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546" status: 200 len: 1271 microversion: 2.1 time: 0.159692 Aug 24 11:00:02.018197 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3420/6482] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:01 2022] GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546 => generated 1271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:03.045642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-00d5bee1-c418-4e36-b316-5cfa87730803 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:03.046612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-00d5bee1-c418-4e36-b316-5cfa87730803 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] [instance: 6fcb1eb9-d46a-4177-9d35-5257666fe546] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:03.056734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00d5bee1-c418-4e36-b316-5cfa87730803 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:03.057257 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00d5bee1-c418-4e36-b316-5cfa87730803 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:03.057701 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00d5bee1-c418-4e36-b316-5cfa87730803 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:03.058397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00d5bee1-c418-4e36-b316-5cfa87730803 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:03.058856 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00d5bee1-c418-4e36-b316-5cfa87730803 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:03.059284 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00d5bee1-c418-4e36-b316-5cfa87730803 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:03.198047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-00d5bee1-c418-4e36-b316-5cfa87730803 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e7402639774ba08c1250c3d0c3f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8a596c16ed4114b7638e6ce9fc1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:03.206620 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-00d5bee1-c418-4e36-b316-5cfa87730803 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] 10.222.0.85 "GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546" status: 200 len: 1271 microversion: 2.1 time: 0.170990 Aug 24 11:00:03.207211 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3063/6483] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:03 2022] GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546 => generated 1271 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:03.963175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-93a5da7a-694a-45ab-937e-5894755d627b req-0fcd6b85-09cd-43be-a952-8aaa757c382a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fcb1eb9-d46a-4177-9d35-5257666fe546", "name": "network-vif-plugged", "status": "completed", "tag": "695d1f1b-1f92-44a4-921d-deb96d370572"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:00:03.975057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-93a5da7a-694a-45ab-937e-5894755d627b req-0fcd6b85-09cd-43be-a952-8aaa757c382a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:03.975558 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-93a5da7a-694a-45ab-937e-5894755d627b req-0fcd6b85-09cd-43be-a952-8aaa757c382a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:03.975996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-93a5da7a-694a-45ab-937e-5894755d627b req-0fcd6b85-09cd-43be-a952-8aaa757c382a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:03.987297 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-93a5da7a-694a-45ab-937e-5894755d627b req-0fcd6b85-09cd-43be-a952-8aaa757c382a service nova] Creating event network-vif-plugged:695d1f1b-1f92-44a4-921d-deb96d370572 for instance 6fcb1eb9-d46a-4177-9d35-5257666fe546 on n-h1-849328-3 Aug 24 11:00:03.992738 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-93a5da7a-694a-45ab-937e-5894755d627b req-0fcd6b85-09cd-43be-a952-8aaa757c382a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033266 Aug 24 11:00:03.993444 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3421/6484] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:00:04.227848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-884aa69a-7d76-4322-8d87-045a235a7417 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:04.228697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-884aa69a-7d76-4322-8d87-045a235a7417 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] [instance: 6fcb1eb9-d46a-4177-9d35-5257666fe546] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:04.236007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-884aa69a-7d76-4322-8d87-045a235a7417 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:04.236485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-884aa69a-7d76-4322-8d87-045a235a7417 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:04.236917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-884aa69a-7d76-4322-8d87-045a235a7417 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:04.237615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-884aa69a-7d76-4322-8d87-045a235a7417 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:04.238095 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-884aa69a-7d76-4322-8d87-045a235a7417 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:04.238516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-884aa69a-7d76-4322-8d87-045a235a7417 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:04.370216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-884aa69a-7d76-4322-8d87-045a235a7417 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e7402639774ba08c1250c3d0c3f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8a596c16ed4114b7638e6ce9fc1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:04.378365 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-884aa69a-7d76-4322-8d87-045a235a7417 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] 10.222.0.85 "GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546" status: 200 len: 1271 microversion: 2.1 time: 0.154583 Aug 24 11:00:04.378948 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3064/6485] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:04 2022] GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546 => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:05.405010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ac6921eb-decd-429c-a52a-45450e61794b tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:05.405822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ac6921eb-decd-429c-a52a-45450e61794b tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] [instance: 6fcb1eb9-d46a-4177-9d35-5257666fe546] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:05.413059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac6921eb-decd-429c-a52a-45450e61794b tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:05.413637 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac6921eb-decd-429c-a52a-45450e61794b tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:05.414131 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac6921eb-decd-429c-a52a-45450e61794b tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:05.415201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac6921eb-decd-429c-a52a-45450e61794b tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:05.415786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac6921eb-decd-429c-a52a-45450e61794b tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:05.416150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac6921eb-decd-429c-a52a-45450e61794b tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:05.552147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ac6921eb-decd-429c-a52a-45450e61794b tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e7402639774ba08c1250c3d0c3f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8a596c16ed4114b7638e6ce9fc1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:05.560605 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ac6921eb-decd-429c-a52a-45450e61794b tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] 10.222.0.85 "GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546" status: 200 len: 1461 microversion: 2.1 time: 0.161839 Aug 24 11:00:05.561181 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3422/6486] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:05 2022] GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546 => generated 1461 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:05.580312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-397c2913-cd63-40a4-98a2-2294c89a2295 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:05.580924 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-397c2913-cd63-40a4-98a2-2294c89a2295 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] [instance: 6fcb1eb9-d46a-4177-9d35-5257666fe546] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:05.588197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-397c2913-cd63-40a4-98a2-2294c89a2295 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:05.588682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-397c2913-cd63-40a4-98a2-2294c89a2295 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:05.589113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-397c2913-cd63-40a4-98a2-2294c89a2295 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:05.589861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-397c2913-cd63-40a4-98a2-2294c89a2295 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:05.590316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-397c2913-cd63-40a4-98a2-2294c89a2295 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:05.590742 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-397c2913-cd63-40a4-98a2-2294c89a2295 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:06.059687 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-397c2913-cd63-40a4-98a2-2294c89a2295 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e7402639774ba08c1250c3d0c3f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8a596c16ed4114b7638e6ce9fc1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:06.068026 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-397c2913-cd63-40a4-98a2-2294c89a2295 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] 10.222.0.85 "GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546" status: 200 len: 1461 microversion: 2.1 time: 0.491611 Aug 24 11:00:06.068609 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3065/6487] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:05 2022] GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546 => generated 1461 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:07.844836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0ac5c7b8-aef5-43c6-a922-b35899dee99f req-c7f9ede5-0dcc-4d2e-bad2-4afb11c280b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fcb1eb9-d46a-4177-9d35-5257666fe546", "tag": "695d1f1b-1f92-44a4-921d-deb96d370572"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:00:07.869374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0ac5c7b8-aef5-43c6-a922-b35899dee99f req-c7f9ede5-0dcc-4d2e-bad2-4afb11c280b5 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:07.870114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0ac5c7b8-aef5-43c6-a922-b35899dee99f req-c7f9ede5-0dcc-4d2e-bad2-4afb11c280b5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:07.870300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0ac5c7b8-aef5-43c6-a922-b35899dee99f req-c7f9ede5-0dcc-4d2e-bad2-4afb11c280b5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:07.888538 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0ac5c7b8-aef5-43c6-a922-b35899dee99f req-c7f9ede5-0dcc-4d2e-bad2-4afb11c280b5 service nova] Creating event network-changed:695d1f1b-1f92-44a4-921d-deb96d370572 for instance 6fcb1eb9-d46a-4177-9d35-5257666fe546 on n-h1-849328-3 Aug 24 11:00:07.894099 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0ac5c7b8-aef5-43c6-a922-b35899dee99f req-c7f9ede5-0dcc-4d2e-bad2-4afb11c280b5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053308 Aug 24 11:00:07.895109 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3423/6488] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:00:09.909948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-7144c351-3296-4896-984b-bdee92680594 req-26221ad8-5f99-4f1e-a5d4-3d010006df00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fcb1eb9-d46a-4177-9d35-5257666fe546", "tag": "695d1f1b-1f92-44a4-921d-deb96d370572"}, {"name": "network-changed", "server_uuid": "6fcb1eb9-d46a-4177-9d35-5257666fe546", "tag": "695d1f1b-1f92-44a4-921d-deb96d370572"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:00:09.920990 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7144c351-3296-4896-984b-bdee92680594 req-26221ad8-5f99-4f1e-a5d4-3d010006df00 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:09.921374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7144c351-3296-4896-984b-bdee92680594 req-26221ad8-5f99-4f1e-a5d4-3d010006df00 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:09.921799 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7144c351-3296-4896-984b-bdee92680594 req-26221ad8-5f99-4f1e-a5d4-3d010006df00 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:09.934114 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7144c351-3296-4896-984b-bdee92680594 req-26221ad8-5f99-4f1e-a5d4-3d010006df00 service nova] Creating event network-changed:695d1f1b-1f92-44a4-921d-deb96d370572 for instance 6fcb1eb9-d46a-4177-9d35-5257666fe546 on n-h1-849328-3 Aug 24 11:00:09.934630 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7144c351-3296-4896-984b-bdee92680594 req-26221ad8-5f99-4f1e-a5d4-3d010006df00 service nova] Creating event network-changed:695d1f1b-1f92-44a4-921d-deb96d370572 for instance 6fcb1eb9-d46a-4177-9d35-5257666fe546 on n-h1-849328-3 Aug 24 11:00:09.940224 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-7144c351-3296-4896-984b-bdee92680594 req-26221ad8-5f99-4f1e-a5d4-3d010006df00 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034081 Aug 24 11:00:09.940825 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3066/6489] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:00:36.778583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:00:36.779351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=50 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:00:36.783421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-863a974b-05b9-4cab-a6f9-4fbca284ff6b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1672939494", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1418087682", "security_groups": [{"name": "tempest-secgroup-smoke-793359891"}], "block_device_mapping_v2": [{"uuid": "d173fef6-ce97-46e1-b732-c7e740e3dc48", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9996d4a7-fe50-441a-b919-9c80031d0109"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:00:36.909608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-863a974b-05b9-4cab-a6f9-4fbca284ff6b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] validate_networks() for [('9996d4a7-fe50-441a-b919-9c80031d0109', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:00:37.311706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-863a974b-05b9-4cab-a6f9-4fbca284ff6b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:00:37.312165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-863a974b-05b9-4cab-a6f9-4fbca284ff6b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:00:37.312671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-863a974b-05b9-4cab-a6f9-4fbca284ff6b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:00:37.313163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-863a974b-05b9-4cab-a6f9-4fbca284ff6b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:00:37.313611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-863a974b-05b9-4cab-a6f9-4fbca284ff6b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:00:37.323182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-863a974b-05b9-4cab-a6f9-4fbca284ff6b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:37.323690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-863a974b-05b9-4cab-a6f9-4fbca284ff6b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:37.324139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-863a974b-05b9-4cab-a6f9-4fbca284ff6b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:37.324864 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-863a974b-05b9-4cab-a6f9-4fbca284ff6b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:37.325361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-863a974b-05b9-4cab-a6f9-4fbca284ff6b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:37.325798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-863a974b-05b9-4cab-a6f9-4fbca284ff6b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:37.344341 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-863a974b-05b9-4cab-a6f9-4fbca284ff6b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Getting quotas for project d1785d661bbd41619a7046600ad435b1. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:00:37.350158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-863a974b-05b9-4cab-a6f9-4fbca284ff6b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Getting quotas for user 26b7ff61eab4477890d20977574e8dac and project d1785d661bbd41619a7046600ad435b1. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:00:37.420793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-863a974b-05b9-4cab-a6f9-4fbca284ff6b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:00:37.423096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-863a974b-05b9-4cab-a6f9-4fbca284ff6b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d173fef6-ce97-46e1-b732-c7e740e3dc48',volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:00:37.568085 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-863a974b-05b9-4cab-a6f9-4fbca284ff6b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.791360 Aug 24 11:00:37.568663 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3424/6490] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 11:00:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:00:37.578083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:00:37.579028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=56 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:00:37.585139 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-33b651ad-78b5-47ed-a9bd-bb00acfdc155 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:37.585845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-33b651ad-78b5-47ed-a9bd-bb00acfdc155 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:37.642274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-33b651ad-78b5-47ed-a9bd-bb00acfdc155 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:37.649755 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-33b651ad-78b5-47ed-a9bd-bb00acfdc155 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a" status: 200 len: 1095 microversion: 2.1 time: 0.073489 Aug 24 11:00:37.651078 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3067/6491] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:37 2022] GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:38.671161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-853b167a-bb84-4257-9721-5afe571cf771 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:38.672545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-853b167a-bb84-4257-9721-5afe571cf771 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:38.681789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-853b167a-bb84-4257-9721-5afe571cf771 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:38.682278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-853b167a-bb84-4257-9721-5afe571cf771 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:38.682726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-853b167a-bb84-4257-9721-5afe571cf771 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:38.683460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-853b167a-bb84-4257-9721-5afe571cf771 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:38.683917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-853b167a-bb84-4257-9721-5afe571cf771 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:38.684448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-853b167a-bb84-4257-9721-5afe571cf771 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:38.764398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-853b167a-bb84-4257-9721-5afe571cf771 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:38.774398 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-853b167a-bb84-4257-9721-5afe571cf771 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a" status: 200 len: 1201 microversion: 2.1 time: 0.107102 Aug 24 11:00:38.775099 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3425/6492] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:38 2022] GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a => generated 1201 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:39.797529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e07e7307-7aff-4be0-b8f9-522565ded61f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:39.798153 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e07e7307-7aff-4be0-b8f9-522565ded61f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:39.806596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e07e7307-7aff-4be0-b8f9-522565ded61f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:39.807403 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e07e7307-7aff-4be0-b8f9-522565ded61f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:39.807838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e07e7307-7aff-4be0-b8f9-522565ded61f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:39.808541 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e07e7307-7aff-4be0-b8f9-522565ded61f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:39.808987 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e07e7307-7aff-4be0-b8f9-522565ded61f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:39.809434 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e07e7307-7aff-4be0-b8f9-522565ded61f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:39.956980 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e07e7307-7aff-4be0-b8f9-522565ded61f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:39.968254 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e07e7307-7aff-4be0-b8f9-522565ded61f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a" status: 200 len: 1278 microversion: 2.1 time: 0.174604 Aug 24 11:00:39.969174 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3068/6493] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:39 2022] GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a => generated 1278 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:00:40.257801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-2741fc67-9695-459f-997c-df94c84be7b9 req-f3d79eda-1db8-4c04-a8f8-82f074007078 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e7a6174-1aea-4150-8ccb-c68139d9930a", "tag": "7e13d1a2-dfd4-457a-ba7f-71f8dbd4535d"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:00:40.268269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2741fc67-9695-459f-997c-df94c84be7b9 req-f3d79eda-1db8-4c04-a8f8-82f074007078 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:40.268906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2741fc67-9695-459f-997c-df94c84be7b9 req-f3d79eda-1db8-4c04-a8f8-82f074007078 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:40.269382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2741fc67-9695-459f-997c-df94c84be7b9 req-f3d79eda-1db8-4c04-a8f8-82f074007078 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:40.282652 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-2741fc67-9695-459f-997c-df94c84be7b9 req-f3d79eda-1db8-4c04-a8f8-82f074007078 service nova] Creating event network-changed:7e13d1a2-dfd4-457a-ba7f-71f8dbd4535d for instance 6e7a6174-1aea-4150-8ccb-c68139d9930a on n-h2-849328-3 Aug 24 11:00:40.287894 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-2741fc67-9695-459f-997c-df94c84be7b9 req-f3d79eda-1db8-4c04-a8f8-82f074007078 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147088 Aug 24 11:00:40.289101 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3426/6494] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:00:40.990228 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5e286218-16d4-4f30-8ba7-adb1bb3b5bc6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:40.990801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5e286218-16d4-4f30-8ba7-adb1bb3b5bc6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:40.998389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e286218-16d4-4f30-8ba7-adb1bb3b5bc6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:40.998835 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e286218-16d4-4f30-8ba7-adb1bb3b5bc6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:40.999300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e286218-16d4-4f30-8ba7-adb1bb3b5bc6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:41.000311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e286218-16d4-4f30-8ba7-adb1bb3b5bc6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:41.000794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e286218-16d4-4f30-8ba7-adb1bb3b5bc6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:41.001246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e286218-16d4-4f30-8ba7-adb1bb3b5bc6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:41.149894 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5e286218-16d4-4f30-8ba7-adb1bb3b5bc6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:41.158411 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5e286218-16d4-4f30-8ba7-adb1bb3b5bc6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a" status: 200 len: 1278 microversion: 2.1 time: 0.171998 Aug 24 11:00:41.159220 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3069/6495] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:40 2022] GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:42.182019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-523c70ca-c997-4965-a6f8-fbe92b3af61e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:42.182830 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-523c70ca-c997-4965-a6f8-fbe92b3af61e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:42.190052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-523c70ca-c997-4965-a6f8-fbe92b3af61e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:42.190553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-523c70ca-c997-4965-a6f8-fbe92b3af61e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:42.191004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-523c70ca-c997-4965-a6f8-fbe92b3af61e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:42.191720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-523c70ca-c997-4965-a6f8-fbe92b3af61e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:42.192343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-523c70ca-c997-4965-a6f8-fbe92b3af61e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:42.192629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-523c70ca-c997-4965-a6f8-fbe92b3af61e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:42.352590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-523c70ca-c997-4965-a6f8-fbe92b3af61e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:42.361146 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-523c70ca-c997-4965-a6f8-fbe92b3af61e tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a" status: 200 len: 1278 microversion: 2.1 time: 0.184762 Aug 24 11:00:42.377196 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3427/6496] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:42 2022] GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a => generated 1278 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:43.197970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4bf49cd1-6655-44ec-9361-6a83d6debfdc tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:43.199242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4bf49cd1-6655-44ec-9361-6a83d6debfdc tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] [instance: 6fcb1eb9-d46a-4177-9d35-5257666fe546] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:43.204785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a097839d-a2bc-4f82-a106-266d79fcaafb req-b5d54648-d5bc-46d9-8b57-ef47b3db440f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fcb1eb9-d46a-4177-9d35-5257666fe546", "tag": "695d1f1b-1f92-44a4-921d-deb96d370572"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:00:43.213753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4bf49cd1-6655-44ec-9361-6a83d6debfdc tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:43.213963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4bf49cd1-6655-44ec-9361-6a83d6debfdc tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:43.214400 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4bf49cd1-6655-44ec-9361-6a83d6debfdc tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:43.216211 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4bf49cd1-6655-44ec-9361-6a83d6debfdc tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:43.217161 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4bf49cd1-6655-44ec-9361-6a83d6debfdc tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:43.217980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a097839d-a2bc-4f82-a106-266d79fcaafb req-b5d54648-d5bc-46d9-8b57-ef47b3db440f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:43.219033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a097839d-a2bc-4f82-a106-266d79fcaafb req-b5d54648-d5bc-46d9-8b57-ef47b3db440f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:43.219452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4bf49cd1-6655-44ec-9361-6a83d6debfdc tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:43.219949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a097839d-a2bc-4f82-a106-266d79fcaafb req-b5d54648-d5bc-46d9-8b57-ef47b3db440f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:43.235588 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a097839d-a2bc-4f82-a106-266d79fcaafb req-b5d54648-d5bc-46d9-8b57-ef47b3db440f service nova] Creating event network-changed:695d1f1b-1f92-44a4-921d-deb96d370572 for instance 6fcb1eb9-d46a-4177-9d35-5257666fe546 on n-h1-849328-3 Aug 24 11:00:43.242590 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a097839d-a2bc-4f82-a106-266d79fcaafb req-b5d54648-d5bc-46d9-8b57-ef47b3db440f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042391 Aug 24 11:00:43.244293 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3428/6497] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:00:43.262458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4bf49cd1-6655-44ec-9361-6a83d6debfdc tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] [instance: 6fcb1eb9-d46a-4177-9d35-5257666fe546] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:00:43.382539 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4bf49cd1-6655-44ec-9361-6a83d6debfdc tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] 10.222.0.85 "DELETE /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546" status: 204 len: 0 microversion: 2.1 time: 0.189177 Aug 24 11:00:43.384328 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3070/6498] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:00:43 2022] DELETE /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 11:00:43.389590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0e7f1cf8-177b-4a4d-81b2-ce1402b1241a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:43.391089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0e7f1cf8-177b-4a4d-81b2-ce1402b1241a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:43.398729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e7f1cf8-177b-4a4d-81b2-ce1402b1241a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:43.399630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e7f1cf8-177b-4a4d-81b2-ce1402b1241a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:43.400414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-db5ad577-9f2a-46cd-abb3-58479f5220c2 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:43.400873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e7f1cf8-177b-4a4d-81b2-ce1402b1241a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:43.402159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e7f1cf8-177b-4a4d-81b2-ce1402b1241a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:43.402878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e7f1cf8-177b-4a4d-81b2-ce1402b1241a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:43.403173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-db5ad577-9f2a-46cd-abb3-58479f5220c2 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] [instance: 6fcb1eb9-d46a-4177-9d35-5257666fe546] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:43.403709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e7f1cf8-177b-4a4d-81b2-ce1402b1241a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:43.420451 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db5ad577-9f2a-46cd-abb3-58479f5220c2 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:43.420959 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db5ad577-9f2a-46cd-abb3-58479f5220c2 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:43.422115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db5ad577-9f2a-46cd-abb3-58479f5220c2 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:43.423053 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db5ad577-9f2a-46cd-abb3-58479f5220c2 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:43.425568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db5ad577-9f2a-46cd-abb3-58479f5220c2 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:43.426160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db5ad577-9f2a-46cd-abb3-58479f5220c2 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:43.592625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0e7f1cf8-177b-4a4d-81b2-ce1402b1241a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:43.615537 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0e7f1cf8-177b-4a4d-81b2-ce1402b1241a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a" status: 200 len: 1278 microversion: 2.1 time: 0.234727 Aug 24 11:00:43.617011 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3429/6499] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:43 2022] GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a => generated 1278 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:00:43.634828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-db5ad577-9f2a-46cd-abb3-58479f5220c2 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e7402639774ba08c1250c3d0c3f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8a596c16ed4114b7638e6ce9fc1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:43.646466 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-db5ad577-9f2a-46cd-abb3-58479f5220c2 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] 10.222.0.85 "GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546" status: 200 len: 1585 microversion: 2.1 time: 0.256751 Aug 24 11:00:43.649216 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3071/6500] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:43 2022] GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546 => generated 1585 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:44.641338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cf12dad2-dc71-4c38-bb7d-a8e9a9036051 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:44.641960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cf12dad2-dc71-4c38-bb7d-a8e9a9036051 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:44.649244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf12dad2-dc71-4c38-bb7d-a8e9a9036051 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:44.649746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf12dad2-dc71-4c38-bb7d-a8e9a9036051 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:44.650216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf12dad2-dc71-4c38-bb7d-a8e9a9036051 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:44.650928 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf12dad2-dc71-4c38-bb7d-a8e9a9036051 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:44.651737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf12dad2-dc71-4c38-bb7d-a8e9a9036051 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:44.652185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf12dad2-dc71-4c38-bb7d-a8e9a9036051 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:44.677025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-527c217e-c311-4be2-b39c-944e572122f0 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:44.678233 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-527c217e-c311-4be2-b39c-944e572122f0 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] [instance: 6fcb1eb9-d46a-4177-9d35-5257666fe546] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:44.687968 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-527c217e-c311-4be2-b39c-944e572122f0 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:44.688817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-527c217e-c311-4be2-b39c-944e572122f0 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:44.689600 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-527c217e-c311-4be2-b39c-944e572122f0 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:44.690827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-527c217e-c311-4be2-b39c-944e572122f0 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:44.691587 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-527c217e-c311-4be2-b39c-944e572122f0 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:44.692334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-527c217e-c311-4be2-b39c-944e572122f0 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:44.811984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cf12dad2-dc71-4c38-bb7d-a8e9a9036051 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:44.820093 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cf12dad2-dc71-4c38-bb7d-a8e9a9036051 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a" status: 200 len: 1266 microversion: 2.1 time: 0.183908 Aug 24 11:00:44.820689 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3430/6501] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:44 2022] GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:44.926926 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-527c217e-c311-4be2-b39c-944e572122f0 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e7402639774ba08c1250c3d0c3f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8a596c16ed4114b7638e6ce9fc1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:44.936544 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-527c217e-c311-4be2-b39c-944e572122f0 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] 10.222.0.85 "GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546" status: 200 len: 1585 microversion: 2.1 time: 0.264800 Aug 24 11:00:44.937365 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3072/6502] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:44 2022] GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546 => generated 1585 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:45.588009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-9c1ce28e-42dd-4a7d-b06a-2650553de5ca req-3bb16e99-7c96-4533-b9db-af67047e9fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fcb1eb9-d46a-4177-9d35-5257666fe546", "name": "network-vif-deleted", "tag": "695d1f1b-1f92-44a4-921d-deb96d370572"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:00:45.598415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9c1ce28e-42dd-4a7d-b06a-2650553de5ca req-3bb16e99-7c96-4533-b9db-af67047e9fc9 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:45.598897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9c1ce28e-42dd-4a7d-b06a-2650553de5ca req-3bb16e99-7c96-4533-b9db-af67047e9fc9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:45.599417 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9c1ce28e-42dd-4a7d-b06a-2650553de5ca req-3bb16e99-7c96-4533-b9db-af67047e9fc9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:45.614994 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-9c1ce28e-42dd-4a7d-b06a-2650553de5ca req-3bb16e99-7c96-4533-b9db-af67047e9fc9 service nova] Creating event network-vif-deleted:695d1f1b-1f92-44a4-921d-deb96d370572 for instance 6fcb1eb9-d46a-4177-9d35-5257666fe546 on n-h1-849328-3 Aug 24 11:00:45.620475 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-9c1ce28e-42dd-4a7d-b06a-2650553de5ca req-3bb16e99-7c96-4533-b9db-af67047e9fc9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036179 Aug 24 11:00:45.621057 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3431/6503] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:00:45.841780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-80b60c31-6d62-475a-8285-601ec7a48190 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:45.842407 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-80b60c31-6d62-475a-8285-601ec7a48190 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:45.850248 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80b60c31-6d62-475a-8285-601ec7a48190 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:45.850989 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80b60c31-6d62-475a-8285-601ec7a48190 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:45.851614 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80b60c31-6d62-475a-8285-601ec7a48190 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:45.852584 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80b60c31-6d62-475a-8285-601ec7a48190 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:45.853509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80b60c31-6d62-475a-8285-601ec7a48190 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:45.854146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80b60c31-6d62-475a-8285-601ec7a48190 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:45.960273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-85510ab6-f646-4f69-b177-6ee5cfa7536e tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:45.960962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-85510ab6-f646-4f69-b177-6ee5cfa7536e tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] [instance: 6fcb1eb9-d46a-4177-9d35-5257666fe546] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:45.976109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85510ab6-f646-4f69-b177-6ee5cfa7536e tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:45.976857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85510ab6-f646-4f69-b177-6ee5cfa7536e tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:45.979178 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85510ab6-f646-4f69-b177-6ee5cfa7536e tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:45.980578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85510ab6-f646-4f69-b177-6ee5cfa7536e tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:45.981551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85510ab6-f646-4f69-b177-6ee5cfa7536e tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:45.982024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85510ab6-f646-4f69-b177-6ee5cfa7536e tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:46.053692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-80b60c31-6d62-475a-8285-601ec7a48190 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:46.063892 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-80b60c31-6d62-475a-8285-601ec7a48190 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a" status: 200 len: 1266 microversion: 2.1 time: 0.226042 Aug 24 11:00:46.065077 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3073/6504] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:45 2022] GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:46.416850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-85510ab6-f646-4f69-b177-6ee5cfa7536e tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e7402639774ba08c1250c3d0c3f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8a596c16ed4114b7638e6ce9fc1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:46.426172 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-85510ab6-f646-4f69-b177-6ee5cfa7536e tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] 10.222.0.85 "GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546" status: 200 len: 1230 microversion: 2.1 time: 0.471198 Aug 24 11:00:46.427013 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3432/6505] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:45 2022] GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546 => generated 1230 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:00:47.090729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2825e555-32c7-463d-861a-363a681e0e05 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:47.091489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2825e555-32c7-463d-861a-363a681e0e05 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:47.099142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2825e555-32c7-463d-861a-363a681e0e05 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:47.099637 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2825e555-32c7-463d-861a-363a681e0e05 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:47.100073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2825e555-32c7-463d-861a-363a681e0e05 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:47.100783 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2825e555-32c7-463d-861a-363a681e0e05 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:47.101262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2825e555-32c7-463d-861a-363a681e0e05 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:47.101689 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2825e555-32c7-463d-861a-363a681e0e05 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:47.240338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2825e555-32c7-463d-861a-363a681e0e05 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:47.248319 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2825e555-32c7-463d-861a-363a681e0e05 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a" status: 200 len: 1266 microversion: 2.1 time: 0.162812 Aug 24 11:00:47.248907 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3074/6506] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:47 2022] GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:47.448687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d40fc189-4555-4f36-ae6d-4349298509b7 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:47.449438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d40fc189-4555-4f36-ae6d-4349298509b7 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] [instance: 6fcb1eb9-d46a-4177-9d35-5257666fe546] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:47.452876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:00:47.453845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:00:47.461995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d40fc189-4555-4f36-ae6d-4349298509b7 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:47.462621 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d40fc189-4555-4f36-ae6d-4349298509b7 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:47.463122 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d40fc189-4555-4f36-ae6d-4349298509b7 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:47.464036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d40fc189-4555-4f36-ae6d-4349298509b7 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:47.464521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d40fc189-4555-4f36-ae6d-4349298509b7 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:47.465327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d40fc189-4555-4f36-ae6d-4349298509b7 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:47.557632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d40fc189-4555-4f36-ae6d-4349298509b7 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e7402639774ba08c1250c3d0c3f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8a596c16ed4114b7638e6ce9fc1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:47.566310 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d40fc189-4555-4f36-ae6d-4349298509b7 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] 10.222.0.85 "GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546" status: 200 len: 1230 microversion: 2.1 time: 0.122469 Aug 24 11:00:47.567027 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3433/6507] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:47 2022] GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546 => generated 1230 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:48.269753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7ca21f38-19c9-4e0a-8474-77f779010204 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:48.270351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7ca21f38-19c9-4e0a-8474-77f779010204 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:48.273788 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:00:48.280250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ca21f38-19c9-4e0a-8474-77f779010204 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:48.280793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ca21f38-19c9-4e0a-8474-77f779010204 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:48.281309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ca21f38-19c9-4e0a-8474-77f779010204 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:48.281894 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ca21f38-19c9-4e0a-8474-77f779010204 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:48.282341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ca21f38-19c9-4e0a-8474-77f779010204 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:48.282760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ca21f38-19c9-4e0a-8474-77f779010204 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:48.419956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7ca21f38-19c9-4e0a-8474-77f779010204 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:48.428655 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7ca21f38-19c9-4e0a-8474-77f779010204 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a" status: 200 len: 1266 microversion: 2.1 time: 0.162869 Aug 24 11:00:48.429243 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3075/6508] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:48 2022] GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:48.588430 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-48cd6992-ee46-40b9-b6fe-03bad7381172 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:48.588992 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-48cd6992-ee46-40b9-b6fe-03bad7381172 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] [instance: 6fcb1eb9-d46a-4177-9d35-5257666fe546] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:48.596645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48cd6992-ee46-40b9-b6fe-03bad7381172 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:48.597154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48cd6992-ee46-40b9-b6fe-03bad7381172 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:48.597628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48cd6992-ee46-40b9-b6fe-03bad7381172 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:48.598336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48cd6992-ee46-40b9-b6fe-03bad7381172 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:48.598797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48cd6992-ee46-40b9-b6fe-03bad7381172 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:48.599238 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48cd6992-ee46-40b9-b6fe-03bad7381172 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:48.661944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-48cd6992-ee46-40b9-b6fe-03bad7381172 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e7402639774ba08c1250c3d0c3f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8a596c16ed4114b7638e6ce9fc1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:48.670239 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-48cd6992-ee46-40b9-b6fe-03bad7381172 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] 10.222.0.85 "GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546" status: 200 len: 1230 microversion: 2.1 time: 0.086053 Aug 24 11:00:48.670815 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3434/6509] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:48 2022] GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546 => generated 1230 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:49.451210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-24846033-71da-4f63-95e2-fd2e969def71 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:49.451886 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-24846033-71da-4f63-95e2-fd2e969def71 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:49.458925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24846033-71da-4f63-95e2-fd2e969def71 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:49.459415 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24846033-71da-4f63-95e2-fd2e969def71 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:49.459841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24846033-71da-4f63-95e2-fd2e969def71 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:49.460531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24846033-71da-4f63-95e2-fd2e969def71 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:49.460989 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24846033-71da-4f63-95e2-fd2e969def71 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:49.461446 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24846033-71da-4f63-95e2-fd2e969def71 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:49.601830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-24846033-71da-4f63-95e2-fd2e969def71 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:49.610023 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-24846033-71da-4f63-95e2-fd2e969def71 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a" status: 200 len: 1266 microversion: 2.1 time: 0.163162 Aug 24 11:00:49.610608 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3076/6510] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:49 2022] GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:49.692235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c111b433-bc5d-4f46-aa46-9e5f71647d25 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:49.692840 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c111b433-bc5d-4f46-aa46-9e5f71647d25 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] [instance: 6fcb1eb9-d46a-4177-9d35-5257666fe546] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:49.700501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c111b433-bc5d-4f46-aa46-9e5f71647d25 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:49.701045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c111b433-bc5d-4f46-aa46-9e5f71647d25 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:49.701589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c111b433-bc5d-4f46-aa46-9e5f71647d25 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:49.702246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c111b433-bc5d-4f46-aa46-9e5f71647d25 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:49.702715 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c111b433-bc5d-4f46-aa46-9e5f71647d25 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:49.703151 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c111b433-bc5d-4f46-aa46-9e5f71647d25 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:49.766275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c111b433-bc5d-4f46-aa46-9e5f71647d25 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e7402639774ba08c1250c3d0c3f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8a596c16ed4114b7638e6ce9fc1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:49.774529 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c111b433-bc5d-4f46-aa46-9e5f71647d25 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] 10.222.0.85 "GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546" status: 200 len: 1230 microversion: 2.1 time: 0.086281 Aug 24 11:00:49.775115 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3435/6511] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:49 2022] GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546 => generated 1230 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:50.635107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c5ce4e0c-0ff2-4c15-aed3-2337e406e3d1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:50.635784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c5ce4e0c-0ff2-4c15-aed3-2337e406e3d1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:50.643656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5ce4e0c-0ff2-4c15-aed3-2337e406e3d1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:50.644152 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5ce4e0c-0ff2-4c15-aed3-2337e406e3d1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:50.644588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5ce4e0c-0ff2-4c15-aed3-2337e406e3d1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:50.645795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5ce4e0c-0ff2-4c15-aed3-2337e406e3d1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:50.645951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5ce4e0c-0ff2-4c15-aed3-2337e406e3d1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:50.646332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5ce4e0c-0ff2-4c15-aed3-2337e406e3d1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:50.788628 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c5ce4e0c-0ff2-4c15-aed3-2337e406e3d1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:50.795166 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-31fd5938-7cd6-4a1f-95dc-258d47537089 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:50.795808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-31fd5938-7cd6-4a1f-95dc-258d47537089 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] [instance: 6fcb1eb9-d46a-4177-9d35-5257666fe546] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:50.797028 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c5ce4e0c-0ff2-4c15-aed3-2337e406e3d1 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a" status: 200 len: 1266 microversion: 2.1 time: 0.168662 Aug 24 11:00:50.797690 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3077/6512] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:50 2022] GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:50.803034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31fd5938-7cd6-4a1f-95dc-258d47537089 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:50.803539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31fd5938-7cd6-4a1f-95dc-258d47537089 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:50.803993 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31fd5938-7cd6-4a1f-95dc-258d47537089 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:50.804708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31fd5938-7cd6-4a1f-95dc-258d47537089 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:50.805175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31fd5938-7cd6-4a1f-95dc-258d47537089 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:50.805683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31fd5938-7cd6-4a1f-95dc-258d47537089 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:50.819123 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-31fd5938-7cd6-4a1f-95dc-258d47537089 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] HTTP exception thrown: Instance 6fcb1eb9-d46a-4177-9d35-5257666fe546 could not be found. Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-31fd5938-7cd6-4a1f-95dc-258d47537089 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Request method failure captured: Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546 HTTP/1.1 Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgQZkCnErfzB3BCzEYYxRFzAmrKh2y7UdVMaGeneajuqVztbT24JYKdejBmX_Wmwghgzmp1FRkS8GGrfv5HRDb7a1cHCm1zjJQJSnbdJbDLizbk5uwb4blBvMGm-DdsQlGm9L33lP730aFJbvcYPKa9gOiJsxymQBGrfB4gKrOXDttg Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 1b8a596c16ed4114b7638e6ce9fc1434 Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestVolumeBackupRestore-1176693696 Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1b8a596c16ed4114b7638e6ce9fc1434"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_1b8a596c16ed4114b7638e6ce9fc1434", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1b8a596c16ed4114b7638e6ce9fc1434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/1b8a596c16ed4114b7638e6ce9fc1434"}]}] Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestVolumeBackupRestore-1176693696 Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 1b8a596c16ed4114b7638e6ce9fc1434 Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1176693696 Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestVolumeBackupRestore-1176693696-project Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 70e7402639774ba08c1250c3d0c3f584 Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestVolumeBackupRestore-1176693696-project Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 6fcb1eb9-d46a-4177-9d35-5257666fe546 could not be found. Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '6fcb1eb9-d46a-4177-9d35-5257666fe546'} Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fcb1eb9-d46a-4177-9d35-5257666fe546 could not be found. Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fcb1eb9-d46a-4177-9d35-5257666fe546 could not be found. Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:00:50.820812 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:00:50.826686 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:00:50.826686 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:00:50.826686 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:00:50.826686 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:00:50.826686 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:00:50.826686 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fcb1eb9-d46a-4177-9d35-5257666fe546 could not be found. Aug 24 11:00:50.826686 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:00:50.826686 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-31fd5938-7cd6-4a1f-95dc-258d47537089 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Returning 404 to user: Instance 6fcb1eb9-d46a-4177-9d35-5257666fe546 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:00:50.826686 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-31fd5938-7cd6-4a1f-95dc-258d47537089 tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] 10.222.0.85 "GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546" status: 404 len: 111 microversion: 2.1 time: 0.031186 Aug 24 11:00:50.826686 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3436/6513] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:50 2022] GET /compute/v2.1/servers/6fcb1eb9-d46a-4177-9d35-5257666fe546 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:00:51.016842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-818cd6f2-2ddd-4cba-a887-245916bba57c tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] Calling method '.version_select at 0x7f4647e9bca0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:51.038837 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-818cd6f2-2ddd-4cba-a887-245916bba57c tempest-TestVolumeBackupRestore-1176693696 tempest-TestVolumeBackupRestore-1176693696-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1585459204" status: 202 len: 0 microversion: 2.1 time: 0.026378 Aug 24 11:00:51.039444 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3078/6514] 10.222.0.85 () {58 vars in 1269 bytes} [Wed Aug 24 11:00:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1585459204 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:00:51.818828 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-55e70b37-f900-4171-a79a-6ece099b5689 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:51.819375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-55e70b37-f900-4171-a79a-6ece099b5689 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:51.826953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55e70b37-f900-4171-a79a-6ece099b5689 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:51.827552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55e70b37-f900-4171-a79a-6ece099b5689 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:51.828070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55e70b37-f900-4171-a79a-6ece099b5689 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:51.828921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55e70b37-f900-4171-a79a-6ece099b5689 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:51.829477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55e70b37-f900-4171-a79a-6ece099b5689 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:51.830024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55e70b37-f900-4171-a79a-6ece099b5689 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:52.003476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-55e70b37-f900-4171-a79a-6ece099b5689 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:52.029278 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-55e70b37-f900-4171-a79a-6ece099b5689 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a" status: 200 len: 1266 microversion: 2.1 time: 0.214576 Aug 24 11:00:52.048312 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3437/6515] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:51 2022] GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:53.052321 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a38c55e4-245e-42cb-bf97-2d7598df0fd3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:53.053054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a38c55e4-245e-42cb-bf97-2d7598df0fd3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:53.065724 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a38c55e4-245e-42cb-bf97-2d7598df0fd3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:53.068592 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a38c55e4-245e-42cb-bf97-2d7598df0fd3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:53.069203 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a38c55e4-245e-42cb-bf97-2d7598df0fd3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:53.070197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a38c55e4-245e-42cb-bf97-2d7598df0fd3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:53.071414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a38c55e4-245e-42cb-bf97-2d7598df0fd3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:53.077708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a38c55e4-245e-42cb-bf97-2d7598df0fd3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:53.256715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a38c55e4-245e-42cb-bf97-2d7598df0fd3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:53.269483 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a38c55e4-245e-42cb-bf97-2d7598df0fd3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a" status: 200 len: 1266 microversion: 2.1 time: 0.222104 Aug 24 11:00:53.270102 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3079/6516] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:53 2022] GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:54.205452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-52960cdc-19ae-4dd9-8b38-ee60a8f6a145 req-260cd162-f807-44b0-aa90-b89a6a0635c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e7a6174-1aea-4150-8ccb-c68139d9930a", "name": "network-vif-plugged", "status": "completed", "tag": "7e13d1a2-dfd4-457a-ba7f-71f8dbd4535d"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:00:54.219077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-52960cdc-19ae-4dd9-8b38-ee60a8f6a145 req-260cd162-f807-44b0-aa90-b89a6a0635c6 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:54.219590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-52960cdc-19ae-4dd9-8b38-ee60a8f6a145 req-260cd162-f807-44b0-aa90-b89a6a0635c6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:54.220053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-52960cdc-19ae-4dd9-8b38-ee60a8f6a145 req-260cd162-f807-44b0-aa90-b89a6a0635c6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:54.267466 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-52960cdc-19ae-4dd9-8b38-ee60a8f6a145 req-260cd162-f807-44b0-aa90-b89a6a0635c6 service nova] Creating event network-vif-plugged:7e13d1a2-dfd4-457a-ba7f-71f8dbd4535d for instance 6e7a6174-1aea-4150-8ccb-c68139d9930a on n-h2-849328-3 Aug 24 11:00:54.294745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6043324e-0b9a-452a-be08-d1236a6bc5ac tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:54.295514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6043324e-0b9a-452a-be08-d1236a6bc5ac tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:54.296314 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-52960cdc-19ae-4dd9-8b38-ee60a8f6a145 req-260cd162-f807-44b0-aa90-b89a6a0635c6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085315 Aug 24 11:00:54.298128 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3438/6517] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:00:54.328408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6043324e-0b9a-452a-be08-d1236a6bc5ac tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:54.330401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6043324e-0b9a-452a-be08-d1236a6bc5ac tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:54.331177 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6043324e-0b9a-452a-be08-d1236a6bc5ac tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:54.333296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6043324e-0b9a-452a-be08-d1236a6bc5ac tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:54.336776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6043324e-0b9a-452a-be08-d1236a6bc5ac tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:54.337389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6043324e-0b9a-452a-be08-d1236a6bc5ac tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:54.565057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6043324e-0b9a-452a-be08-d1236a6bc5ac tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:54.574045 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6043324e-0b9a-452a-be08-d1236a6bc5ac tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a" status: 200 len: 1266 microversion: 2.1 time: 0.285895 Aug 24 11:00:54.575439 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3080/6518] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:54 2022] GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a => generated 1266 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:55.601268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3becb0d3-dc7f-48f2-801d-22c6506cb530 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:55.601987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3becb0d3-dc7f-48f2-801d-22c6506cb530 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:55.610483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3becb0d3-dc7f-48f2-801d-22c6506cb530 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:55.610699 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3becb0d3-dc7f-48f2-801d-22c6506cb530 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:55.611035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3becb0d3-dc7f-48f2-801d-22c6506cb530 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:55.611939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3becb0d3-dc7f-48f2-801d-22c6506cb530 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:55.612580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3becb0d3-dc7f-48f2-801d-22c6506cb530 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:55.613292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3becb0d3-dc7f-48f2-801d-22c6506cb530 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:55.813416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3becb0d3-dc7f-48f2-801d-22c6506cb530 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:55.827083 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3becb0d3-dc7f-48f2-801d-22c6506cb530 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a" status: 200 len: 1266 microversion: 2.1 time: 0.229342 Aug 24 11:00:55.828957 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3439/6519] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:55 2022] GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:56.853554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c28257fe-4c96-425c-afd1-1b8f041db8b5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:56.854322 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c28257fe-4c96-425c-afd1-1b8f041db8b5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:56.861912 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c28257fe-4c96-425c-afd1-1b8f041db8b5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:56.862399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c28257fe-4c96-425c-afd1-1b8f041db8b5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:56.862820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c28257fe-4c96-425c-afd1-1b8f041db8b5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:56.863535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c28257fe-4c96-425c-afd1-1b8f041db8b5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:56.864012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c28257fe-4c96-425c-afd1-1b8f041db8b5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:56.864430 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c28257fe-4c96-425c-afd1-1b8f041db8b5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:57.230029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c28257fe-4c96-425c-afd1-1b8f041db8b5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:57.238081 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c28257fe-4c96-425c-afd1-1b8f041db8b5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a" status: 200 len: 1453 microversion: 2.1 time: 0.390608 Aug 24 11:00:57.238747 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3081/6520] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:56 2022] GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a => generated 1453 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:57.260565 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-55797469-3460-4fc6-97e1-9c9621211cc5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:57.261224 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-55797469-3460-4fc6-97e1-9c9621211cc5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:00:57.267599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55797469-3460-4fc6-97e1-9c9621211cc5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:57.268106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55797469-3460-4fc6-97e1-9c9621211cc5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:57.268560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55797469-3460-4fc6-97e1-9c9621211cc5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:57.269308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55797469-3460-4fc6-97e1-9c9621211cc5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:00:57.269778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55797469-3460-4fc6-97e1-9c9621211cc5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:00:57.270256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55797469-3460-4fc6-97e1-9c9621211cc5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:00:57.303800 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:00:57.304315 n-d-849328-3 devstack@n-api.service[122433]: Wed Aug 24 11:00:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a (ip 10.222.0.85) !!! Aug 24 11:00:57.406695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-55797469-3460-4fc6-97e1-9c9621211cc5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:00:57.415198 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-55797469-3460-4fc6-97e1-9c9621211cc5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a" status: 200 len: 1453 microversion: 2.1 time: 0.160568 Aug 24 11:00:57.415821 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3440/6521] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:00:57 2022] GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:01:00.114498 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-655b765f-afd5-48cc-a47c-6477c21e4b66 req-25143c29-e5bf-4bbe-bcc6-25a1b220c436 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e7a6174-1aea-4150-8ccb-c68139d9930a", "tag": "7e13d1a2-dfd4-457a-ba7f-71f8dbd4535d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:01:00.125736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-655b765f-afd5-48cc-a47c-6477c21e4b66 req-25143c29-e5bf-4bbe-bcc6-25a1b220c436 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:01:00.126214 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-655b765f-afd5-48cc-a47c-6477c21e4b66 req-25143c29-e5bf-4bbe-bcc6-25a1b220c436 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:01:00.126632 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-655b765f-afd5-48cc-a47c-6477c21e4b66 req-25143c29-e5bf-4bbe-bcc6-25a1b220c436 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:01:00.140214 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-655b765f-afd5-48cc-a47c-6477c21e4b66 req-25143c29-e5bf-4bbe-bcc6-25a1b220c436 service nova] Creating event network-changed:7e13d1a2-dfd4-457a-ba7f-71f8dbd4535d for instance 6e7a6174-1aea-4150-8ccb-c68139d9930a on n-h2-849328-3 Aug 24 11:01:00.152287 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-655b765f-afd5-48cc-a47c-6477c21e4b66 req-25143c29-e5bf-4bbe-bcc6-25a1b220c436 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034816 Aug 24 11:01:00.152287 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3082/6522] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:01:23.825915 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:01:23.826809 n-d-849328-3 devstack@n-api.service[122432]: Wed Aug 24 11:01:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:01:39.766711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:01:39.767794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=78 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:01:40.051509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bf291e03-f4b5-4fa5-a55e-8d1f2bf1b555 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:01:40.051985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bf291e03-f4b5-4fa5-a55e-8d1f2bf1b555 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] [instance: 0862ce5f-9ad4-444e-b277-8d05e384a451] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:01:40.059873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf291e03-f4b5-4fa5-a55e-8d1f2bf1b555 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:01:40.060398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf291e03-f4b5-4fa5-a55e-8d1f2bf1b555 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:01:40.060836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf291e03-f4b5-4fa5-a55e-8d1f2bf1b555 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:01:40.061575 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf291e03-f4b5-4fa5-a55e-8d1f2bf1b555 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:01:40.062041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf291e03-f4b5-4fa5-a55e-8d1f2bf1b555 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:01:40.062471 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf291e03-f4b5-4fa5-a55e-8d1f2bf1b555 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:01:40.093045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bf291e03-f4b5-4fa5-a55e-8d1f2bf1b555 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] [instance: 0862ce5f-9ad4-444e-b277-8d05e384a451] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:01:40.175914 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bf291e03-f4b5-4fa5-a55e-8d1f2bf1b555 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] 10.222.0.85 "DELETE /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451" status: 204 len: 0 microversion: 2.1 time: 0.414480 Aug 24 11:01:40.176640 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3441/6523] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:01:39 2022] DELETE /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:01:40.183337 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:01:40.184154 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:01:40.188556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5d575e1a-e159-4f47-963e-78c00fcb224d tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:01:40.189287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5d575e1a-e159-4f47-963e-78c00fcb224d tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] [instance: 0862ce5f-9ad4-444e-b277-8d05e384a451] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:01:40.199566 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d575e1a-e159-4f47-963e-78c00fcb224d tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:01:40.200078 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d575e1a-e159-4f47-963e-78c00fcb224d tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:01:40.200522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d575e1a-e159-4f47-963e-78c00fcb224d tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:01:40.201426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d575e1a-e159-4f47-963e-78c00fcb224d tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:01:40.201813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d575e1a-e159-4f47-963e-78c00fcb224d tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:01:40.202273 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d575e1a-e159-4f47-963e-78c00fcb224d tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:01:40.466092 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5d575e1a-e159-4f47-963e-78c00fcb224d tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb5d9cc56ba4dee8d73aab4d1a5a4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e944f10139342e4aa29d2b18f901449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:01:40.475004 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5d575e1a-e159-4f47-963e-78c00fcb224d tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] 10.222.0.85 "GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451" status: 200 len: 1733 microversion: 2.1 time: 0.293704 Aug 24 11:01:40.475606 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3083/6524] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:01:40 2022] GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451 => generated 1733 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:01:41.501865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-378c8daf-a917-4f5d-a12a-ca81ed7979ab tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:01:41.503069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-378c8daf-a917-4f5d-a12a-ca81ed7979ab tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] [instance: 0862ce5f-9ad4-444e-b277-8d05e384a451] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:01:41.514794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-378c8daf-a917-4f5d-a12a-ca81ed7979ab tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:01:41.515609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-378c8daf-a917-4f5d-a12a-ca81ed7979ab tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:01:41.516339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-378c8daf-a917-4f5d-a12a-ca81ed7979ab tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:01:41.517580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-378c8daf-a917-4f5d-a12a-ca81ed7979ab tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:01:41.518366 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-378c8daf-a917-4f5d-a12a-ca81ed7979ab tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:01:41.519080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-378c8daf-a917-4f5d-a12a-ca81ed7979ab tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:01:41.797475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-378c8daf-a917-4f5d-a12a-ca81ed7979ab tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb5d9cc56ba4dee8d73aab4d1a5a4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e944f10139342e4aa29d2b18f901449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:01:41.805826 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-378c8daf-a917-4f5d-a12a-ca81ed7979ab tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] 10.222.0.85 "GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451" status: 200 len: 1733 microversion: 2.1 time: 0.312032 Aug 24 11:01:41.806263 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3442/6525] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:01:41 2022] GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451 => generated 1733 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:01:42.618014 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3de84e47-ccf0-40d6-80ac-efc18c52f8ed req-4b8d8aa4-c5da-41da-bbaa-f840e3afda2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0862ce5f-9ad4-444e-b277-8d05e384a451", "name": "network-vif-deleted", "tag": "0caf0534-6cb1-43c7-b86d-bcaa57dc92ac"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:01:42.634172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3de84e47-ccf0-40d6-80ac-efc18c52f8ed req-4b8d8aa4-c5da-41da-bbaa-f840e3afda2c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:01:42.634849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3de84e47-ccf0-40d6-80ac-efc18c52f8ed req-4b8d8aa4-c5da-41da-bbaa-f840e3afda2c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:01:42.635678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3de84e47-ccf0-40d6-80ac-efc18c52f8ed req-4b8d8aa4-c5da-41da-bbaa-f840e3afda2c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:01:42.648910 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3de84e47-ccf0-40d6-80ac-efc18c52f8ed req-4b8d8aa4-c5da-41da-bbaa-f840e3afda2c service nova] Creating event network-vif-deleted:0caf0534-6cb1-43c7-b86d-bcaa57dc92ac for instance 0862ce5f-9ad4-444e-b277-8d05e384a451 on n-h2-849328-3 Aug 24 11:01:42.656277 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3de84e47-ccf0-40d6-80ac-efc18c52f8ed req-4b8d8aa4-c5da-41da-bbaa-f840e3afda2c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042484 Aug 24 11:01:42.657403 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3084/6526] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:01:42.827653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a27f690f-2b40-4f57-990b-923a65acfd6d tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:01:42.829012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a27f690f-2b40-4f57-990b-923a65acfd6d tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] [instance: 0862ce5f-9ad4-444e-b277-8d05e384a451] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:01:42.840520 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a27f690f-2b40-4f57-990b-923a65acfd6d tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:01:42.841036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a27f690f-2b40-4f57-990b-923a65acfd6d tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:01:42.841540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a27f690f-2b40-4f57-990b-923a65acfd6d tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:01:42.842345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a27f690f-2b40-4f57-990b-923a65acfd6d tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:01:42.842846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a27f690f-2b40-4f57-990b-923a65acfd6d tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:01:42.843628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a27f690f-2b40-4f57-990b-923a65acfd6d tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:01:42.888208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a27f690f-2b40-4f57-990b-923a65acfd6d tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:01:42.888795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a27f690f-2b40-4f57-990b-923a65acfd6d tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:01:42.889322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a27f690f-2b40-4f57-990b-923a65acfd6d tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:01:42.889833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-a27f690f-2b40-4f57-990b-923a65acfd6d tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lazy-loading 'fault' on Instance uuid 0862ce5f-9ad4-444e-b277-8d05e384a451 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:01:42.935949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a27f690f-2b40-4f57-990b-923a65acfd6d tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb5d9cc56ba4dee8d73aab4d1a5a4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e944f10139342e4aa29d2b18f901449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:01:42.944875 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a27f690f-2b40-4f57-990b-923a65acfd6d tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] 10.222.0.85 "GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451" status: 200 len: 1388 microversion: 2.1 time: 0.122371 Aug 24 11:01:42.945581 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3443/6527] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:01:42 2022] GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451 => generated 1388 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:01:43.969730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-38a57a2f-2939-4ed5-9891-bed5ce4debca tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:01:43.970852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-38a57a2f-2939-4ed5-9891-bed5ce4debca tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] [instance: 0862ce5f-9ad4-444e-b277-8d05e384a451] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:01:43.978330 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38a57a2f-2939-4ed5-9891-bed5ce4debca tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:01:43.978869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38a57a2f-2939-4ed5-9891-bed5ce4debca tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:01:43.979470 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38a57a2f-2939-4ed5-9891-bed5ce4debca tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:01:43.980185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38a57a2f-2939-4ed5-9891-bed5ce4debca tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:01:43.980774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38a57a2f-2939-4ed5-9891-bed5ce4debca tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:01:43.981229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38a57a2f-2939-4ed5-9891-bed5ce4debca tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:01:43.996971 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-38a57a2f-2939-4ed5-9891-bed5ce4debca tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] HTTP exception thrown: Instance 0862ce5f-9ad4-444e-b277-8d05e384a451 could not be found. Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-38a57a2f-2939-4ed5-9891-bed5ce4debca tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Request method failure captured: Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451 HTTP/1.1 Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgPgR19TSMEvBzGW_iten9bcuoXs2cUhPgbqBwo721VE6uvs8IWdZ10jqld9UugL7aOC0llLCEB8Q2ZMq2lhoTAwDu1OT6pnPT5v2pvcAQc36lRcX-lSzLVdkK8dDlmrqI5Psw1ClLdW4Fy6earR9KEPDg38kqqLMmS3VpRM83bdwXE Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 8e944f10139342e4aa29d2b18f901449 Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-TestServerBasicOps-878994554 Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8e944f10139342e4aa29d2b18f901449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8e944f10139342e4aa29d2b18f901449", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8e944f10139342e4aa29d2b18f901449"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8e944f10139342e4aa29d2b18f901449"}]}] Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-TestServerBasicOps-878994554 Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 8e944f10139342e4aa29d2b18f901449 Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestServerBasicOps-878994554 Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-TestServerBasicOps-878994554-project Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 4fb5d9cc56ba4dee8d73aab4d1a5a4a6 Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-TestServerBasicOps-878994554-project Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 0862ce5f-9ad4-444e-b277-8d05e384a451 could not be found. Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '0862ce5f-9ad4-444e-b277-8d05e384a451'} Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0862ce5f-9ad4-444e-b277-8d05e384a451 could not be found. Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0862ce5f-9ad4-444e-b277-8d05e384a451 could not be found. Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:01:43.998904 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:01:44.004963 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:01:44.004963 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:01:44.004963 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:01:44.004963 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:01:44.004963 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:01:44.004963 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0862ce5f-9ad4-444e-b277-8d05e384a451 could not be found. Aug 24 11:01:44.004963 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:01:44.004963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-38a57a2f-2939-4ed5-9891-bed5ce4debca tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Returning 404 to user: Instance 0862ce5f-9ad4-444e-b277-8d05e384a451 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:01:44.004963 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-38a57a2f-2939-4ed5-9891-bed5ce4debca tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] 10.222.0.85 "GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451" status: 404 len: 111 microversion: 2.1 time: 0.036604 Aug 24 11:01:44.004963 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3085/6528] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:01:43 2022] GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:01:44.507927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f73536b2-5710-4396-b419-209480125e94 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:01:44.508501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f73536b2-5710-4396-b419-209480125e94 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] [instance: 0862ce5f-9ad4-444e-b277-8d05e384a451] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:01:44.516360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f73536b2-5710-4396-b419-209480125e94 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:01:44.516930 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f73536b2-5710-4396-b419-209480125e94 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:01:44.517397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f73536b2-5710-4396-b419-209480125e94 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:01:44.518264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f73536b2-5710-4396-b419-209480125e94 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:01:44.518802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f73536b2-5710-4396-b419-209480125e94 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:01:44.519263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f73536b2-5710-4396-b419-209480125e94 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:01:44.545586 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-f73536b2-5710-4396-b419-209480125e94 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] HTTP exception thrown: Instance 0862ce5f-9ad4-444e-b277-8d05e384a451 could not be found. Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f73536b2-5710-4396-b419-209480125e94 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Request method failure captured: Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451 HTTP/1.1 Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgPgR19TSMEvBzGW_iten9bcuoXs2cUhPgbqBwo721VE6uvs8IWdZ10jqld9UugL7aOC0llLCEB8Q2ZMq2lhoTAwDu1OT6pnPT5v2pvcAQc36lRcX-lSzLVdkK8dDlmrqI5Psw1ClLdW4Fy6earR9KEPDg38kqqLMmS3VpRM83bdwXE Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 8e944f10139342e4aa29d2b18f901449 Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestServerBasicOps-878994554 Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8e944f10139342e4aa29d2b18f901449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8e944f10139342e4aa29d2b18f901449", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8e944f10139342e4aa29d2b18f901449"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8e944f10139342e4aa29d2b18f901449"}]}] Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestServerBasicOps-878994554 Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 8e944f10139342e4aa29d2b18f901449 Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestServerBasicOps-878994554 Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestServerBasicOps-878994554-project Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 4fb5d9cc56ba4dee8d73aab4d1a5a4a6 Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestServerBasicOps-878994554-project Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 0862ce5f-9ad4-444e-b277-8d05e384a451 could not be found. Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '0862ce5f-9ad4-444e-b277-8d05e384a451'} Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0862ce5f-9ad4-444e-b277-8d05e384a451 could not be found. Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:01:44.547327 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:01:44.557152 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0862ce5f-9ad4-444e-b277-8d05e384a451 could not be found. Aug 24 11:01:44.557152 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:01:44.557152 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:01:44.557152 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:01:44.557152 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:01:44.557152 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:01:44.557152 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:01:44.557152 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:01:44.557152 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:01:44.557152 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0862ce5f-9ad4-444e-b277-8d05e384a451 could not be found. Aug 24 11:01:44.557152 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:01:44.557152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f73536b2-5710-4396-b419-209480125e94 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Returning 404 to user: Instance 0862ce5f-9ad4-444e-b277-8d05e384a451 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:01:44.557152 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f73536b2-5710-4396-b419-209480125e94 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] 10.222.0.85 "DELETE /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451" status: 404 len: 111 microversion: 2.1 time: 0.046060 Aug 24 11:01:44.557152 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3444/6529] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:01:44 2022] DELETE /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:01:44.559106 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-decba31f-7623-4f43-a470-75d867c07950 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:01:44.559729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-decba31f-7623-4f43-a470-75d867c07950 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] [instance: 0862ce5f-9ad4-444e-b277-8d05e384a451] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:01:44.566636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-decba31f-7623-4f43-a470-75d867c07950 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:01:44.567144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-decba31f-7623-4f43-a470-75d867c07950 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:01:44.567724 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-decba31f-7623-4f43-a470-75d867c07950 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:01:44.568441 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-decba31f-7623-4f43-a470-75d867c07950 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:01:44.568890 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-decba31f-7623-4f43-a470-75d867c07950 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:01:44.569590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-decba31f-7623-4f43-a470-75d867c07950 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:01:44.584917 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-decba31f-7623-4f43-a470-75d867c07950 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] HTTP exception thrown: Instance 0862ce5f-9ad4-444e-b277-8d05e384a451 could not be found. Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-decba31f-7623-4f43-a470-75d867c07950 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Request method failure captured: Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451 HTTP/1.1 Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgPgR19TSMEvBzGW_iten9bcuoXs2cUhPgbqBwo721VE6uvs8IWdZ10jqld9UugL7aOC0llLCEB8Q2ZMq2lhoTAwDu1OT6pnPT5v2pvcAQc36lRcX-lSzLVdkK8dDlmrqI5Psw1ClLdW4Fy6earR9KEPDg38kqqLMmS3VpRM83bdwXE Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 8e944f10139342e4aa29d2b18f901449 Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-TestServerBasicOps-878994554 Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8e944f10139342e4aa29d2b18f901449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8e944f10139342e4aa29d2b18f901449", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8e944f10139342e4aa29d2b18f901449"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8e944f10139342e4aa29d2b18f901449"}]}] Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-TestServerBasicOps-878994554 Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 8e944f10139342e4aa29d2b18f901449 Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestServerBasicOps-878994554 Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-TestServerBasicOps-878994554-project Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 4fb5d9cc56ba4dee8d73aab4d1a5a4a6 Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-TestServerBasicOps-878994554-project Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 0862ce5f-9ad4-444e-b277-8d05e384a451 could not be found. Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '0862ce5f-9ad4-444e-b277-8d05e384a451'} Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0862ce5f-9ad4-444e-b277-8d05e384a451 could not be found. Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0862ce5f-9ad4-444e-b277-8d05e384a451 could not be found. Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:01:44.586749 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:01:44.592859 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:01:44.592859 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:01:44.592859 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:01:44.592859 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:01:44.592859 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:01:44.592859 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0862ce5f-9ad4-444e-b277-8d05e384a451 could not be found. Aug 24 11:01:44.592859 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:01:44.592859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-decba31f-7623-4f43-a470-75d867c07950 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Returning 404 to user: Instance 0862ce5f-9ad4-444e-b277-8d05e384a451 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:01:44.592859 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-decba31f-7623-4f43-a470-75d867c07950 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] 10.222.0.85 "GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451" status: 404 len: 111 microversion: 2.1 time: 0.033774 Aug 24 11:01:44.592859 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3086/6530] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:01:44 2022] GET /compute/v2.1/servers/0862ce5f-9ad4-444e-b277-8d05e384a451 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 11:01:44.772011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-71fcf8dd-8e66-468c-90e4-b34ca22462d3 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] Calling method '.version_select at 0x7f4647a6f8b0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:01:44.801247 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-71fcf8dd-8e66-468c-90e4-b34ca22462d3 tempest-TestServerBasicOps-878994554 tempest-TestServerBasicOps-878994554-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1583485824" status: 202 len: 0 microversion: 2.1 time: 0.033102 Aug 24 11:01:44.802060 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3445/6531] 10.222.0.85 () {58 vars in 1254 bytes} [Wed Aug 24 11:01:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1583485824 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:02:40.174770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:02:40.175438 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fecd801c-ac86-4d7b-aa77-7acdce6e6407 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:02:40.175438 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fecd801c-ac86-4d7b-aa77-7acdce6e6407 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:02:40.177468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:02:40.178346 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:02:40.179210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=12 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:02:40.182626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a851920e-2cd7-4103-8cae-f0ad619d8129 req-355146d5-7e64-4b8b-8d75-4f88ee937106 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e7a6174-1aea-4150-8ccb-c68139d9930a", "tag": "7e13d1a2-dfd4-457a-ba7f-71f8dbd4535d"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:02:40.185456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fecd801c-ac86-4d7b-aa77-7acdce6e6407 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:40.186150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fecd801c-ac86-4d7b-aa77-7acdce6e6407 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:40.186597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fecd801c-ac86-4d7b-aa77-7acdce6e6407 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:40.187314 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fecd801c-ac86-4d7b-aa77-7acdce6e6407 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:40.187776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fecd801c-ac86-4d7b-aa77-7acdce6e6407 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:40.188206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fecd801c-ac86-4d7b-aa77-7acdce6e6407 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:40.194007 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a851920e-2cd7-4103-8cae-f0ad619d8129 req-355146d5-7e64-4b8b-8d75-4f88ee937106 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:40.194505 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a851920e-2cd7-4103-8cae-f0ad619d8129 req-355146d5-7e64-4b8b-8d75-4f88ee937106 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:40.194954 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a851920e-2cd7-4103-8cae-f0ad619d8129 req-355146d5-7e64-4b8b-8d75-4f88ee937106 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:40.209499 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a851920e-2cd7-4103-8cae-f0ad619d8129 req-355146d5-7e64-4b8b-8d75-4f88ee937106 service nova] Creating event network-changed:7e13d1a2-dfd4-457a-ba7f-71f8dbd4535d for instance 6e7a6174-1aea-4150-8ccb-c68139d9930a on n-h2-849328-3 Aug 24 11:02:40.215772 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a851920e-2cd7-4103-8cae-f0ad619d8129 req-355146d5-7e64-4b8b-8d75-4f88ee937106 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042971 Aug 24 11:02:40.216688 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3446/6532] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:02:40.219700 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fecd801c-ac86-4d7b-aa77-7acdce6e6407 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:02:40.308575 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fecd801c-ac86-4d7b-aa77-7acdce6e6407 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "DELETE /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a" status: 204 len: 0 microversion: 2.1 time: 0.138179 Aug 24 11:02:40.309824 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3087/6533] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:02:40 2022] DELETE /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:02:40.319182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c5759270-2532-4a95-9447-c0a1254becb7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:02:40.320231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c5759270-2532-4a95-9447-c0a1254becb7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:02:40.330328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5759270-2532-4a95-9447-c0a1254becb7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:40.331695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5759270-2532-4a95-9447-c0a1254becb7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:40.332261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5759270-2532-4a95-9447-c0a1254becb7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:40.333331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5759270-2532-4a95-9447-c0a1254becb7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:40.333903 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5759270-2532-4a95-9447-c0a1254becb7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:40.334421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5759270-2532-4a95-9447-c0a1254becb7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:40.519930 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c5759270-2532-4a95-9447-c0a1254becb7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:02:40.528107 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c5759270-2532-4a95-9447-c0a1254becb7 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a" status: 200 len: 1577 microversion: 2.1 time: 0.213612 Aug 24 11:02:40.528693 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3447/6534] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:02:40 2022] GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a => generated 1577 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:02:41.550396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e54b7199-8c2e-4bcd-b15e-cf15aa8fac3a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:02:41.551104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e54b7199-8c2e-4bcd-b15e-cf15aa8fac3a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:02:41.558518 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e54b7199-8c2e-4bcd-b15e-cf15aa8fac3a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:41.559009 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e54b7199-8c2e-4bcd-b15e-cf15aa8fac3a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:41.566397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e54b7199-8c2e-4bcd-b15e-cf15aa8fac3a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:41.567809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e54b7199-8c2e-4bcd-b15e-cf15aa8fac3a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:41.568290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e54b7199-8c2e-4bcd-b15e-cf15aa8fac3a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:41.568733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e54b7199-8c2e-4bcd-b15e-cf15aa8fac3a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:41.731777 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e54b7199-8c2e-4bcd-b15e-cf15aa8fac3a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:02:41.740502 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e54b7199-8c2e-4bcd-b15e-cf15aa8fac3a tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a" status: 200 len: 1577 microversion: 2.1 time: 0.194442 Aug 24 11:02:41.741164 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3088/6535] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:02:41 2022] GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a => generated 1577 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:02:42.765332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-484af41b-5492-46ba-ad39-f6f1d5023a89 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:02:42.766132 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-484af41b-5492-46ba-ad39-f6f1d5023a89 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:02:42.768954 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-67827bda-45d4-4804-896f-6a5826bd5935 req-b0816e53-df11-44cd-9874-badd0ddbec0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e7a6174-1aea-4150-8ccb-c68139d9930a", "name": "network-vif-deleted", "tag": "7e13d1a2-dfd4-457a-ba7f-71f8dbd4535d"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:02:42.777113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-484af41b-5492-46ba-ad39-f6f1d5023a89 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:42.777751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-484af41b-5492-46ba-ad39-f6f1d5023a89 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:42.778449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-484af41b-5492-46ba-ad39-f6f1d5023a89 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:42.779690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-484af41b-5492-46ba-ad39-f6f1d5023a89 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:42.780259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-484af41b-5492-46ba-ad39-f6f1d5023a89 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:42.781002 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-484af41b-5492-46ba-ad39-f6f1d5023a89 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:42.784567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-67827bda-45d4-4804-896f-6a5826bd5935 req-b0816e53-df11-44cd-9874-badd0ddbec0b service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:42.785059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-67827bda-45d4-4804-896f-6a5826bd5935 req-b0816e53-df11-44cd-9874-badd0ddbec0b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:42.785523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-67827bda-45d4-4804-896f-6a5826bd5935 req-b0816e53-df11-44cd-9874-badd0ddbec0b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:42.799842 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-67827bda-45d4-4804-896f-6a5826bd5935 req-b0816e53-df11-44cd-9874-badd0ddbec0b service nova] Creating event network-vif-deleted:7e13d1a2-dfd4-457a-ba7f-71f8dbd4535d for instance 6e7a6174-1aea-4150-8ccb-c68139d9930a on n-h2-849328-3 Aug 24 11:02:42.808046 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-67827bda-45d4-4804-896f-6a5826bd5935 req-b0816e53-df11-44cd-9874-badd0ddbec0b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049130 Aug 24 11:02:42.808981 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3448/6536] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:02:42.861156 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-484af41b-5492-46ba-ad39-f6f1d5023a89 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:02:42.869274 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-484af41b-5492-46ba-ad39-f6f1d5023a89 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a" status: 200 len: 1392 microversion: 2.1 time: 0.109302 Aug 24 11:02:42.870131 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3089/6537] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:02:42 2022] GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a => generated 1392 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:02:43.893892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7dfd86f4-55d8-4972-b622-ea1b36cd1ddf tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:02:43.894499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7dfd86f4-55d8-4972-b622-ea1b36cd1ddf tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:02:43.901977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7dfd86f4-55d8-4972-b622-ea1b36cd1ddf tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:43.902615 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7dfd86f4-55d8-4972-b622-ea1b36cd1ddf tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:43.903076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7dfd86f4-55d8-4972-b622-ea1b36cd1ddf tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:43.904093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7dfd86f4-55d8-4972-b622-ea1b36cd1ddf tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:43.904573 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7dfd86f4-55d8-4972-b622-ea1b36cd1ddf tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:43.905010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7dfd86f4-55d8-4972-b622-ea1b36cd1ddf tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:43.975261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7dfd86f4-55d8-4972-b622-ea1b36cd1ddf tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:02:43.983463 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7dfd86f4-55d8-4972-b622-ea1b36cd1ddf tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a" status: 200 len: 1226 microversion: 2.1 time: 0.095562 Aug 24 11:02:43.984117 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3449/6538] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:02:43 2022] GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:02:45.004310 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d4974046-3e9b-431c-9679-605da878c363 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:02:45.005146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d4974046-3e9b-431c-9679-605da878c363 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:02:45.013091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4974046-3e9b-431c-9679-605da878c363 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:45.013680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4974046-3e9b-431c-9679-605da878c363 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:45.014192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4974046-3e9b-431c-9679-605da878c363 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:45.014998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4974046-3e9b-431c-9679-605da878c363 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:45.015525 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4974046-3e9b-431c-9679-605da878c363 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:45.016020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4974046-3e9b-431c-9679-605da878c363 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:45.082320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d4974046-3e9b-431c-9679-605da878c363 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:02:45.090690 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d4974046-3e9b-431c-9679-605da878c363 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a" status: 200 len: 1226 microversion: 2.1 time: 0.090404 Aug 24 11:02:45.091392 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3090/6539] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:02:44 2022] GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:02:46.112664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8a8006c0-02a6-4b14-ac8d-bfe34a2c8c79 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:02:46.113477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8a8006c0-02a6-4b14-ac8d-bfe34a2c8c79 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:02:46.121079 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a8006c0-02a6-4b14-ac8d-bfe34a2c8c79 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:46.121592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a8006c0-02a6-4b14-ac8d-bfe34a2c8c79 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:46.122069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a8006c0-02a6-4b14-ac8d-bfe34a2c8c79 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:46.122778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a8006c0-02a6-4b14-ac8d-bfe34a2c8c79 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:46.123239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a8006c0-02a6-4b14-ac8d-bfe34a2c8c79 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:46.123674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a8006c0-02a6-4b14-ac8d-bfe34a2c8c79 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:46.189878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8a8006c0-02a6-4b14-ac8d-bfe34a2c8c79 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:02:46.198585 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8a8006c0-02a6-4b14-ac8d-bfe34a2c8c79 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a" status: 200 len: 1226 microversion: 2.1 time: 0.090175 Aug 24 11:02:46.199169 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3450/6540] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:02:46 2022] GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:02:47.220426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9953cfd3-a259-47a5-9e2d-079bc3246a0b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:02:47.221460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9953cfd3-a259-47a5-9e2d-079bc3246a0b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:02:47.229498 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9953cfd3-a259-47a5-9e2d-079bc3246a0b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:47.229966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9953cfd3-a259-47a5-9e2d-079bc3246a0b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:47.230426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9953cfd3-a259-47a5-9e2d-079bc3246a0b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:47.231125 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9953cfd3-a259-47a5-9e2d-079bc3246a0b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:47.231569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9953cfd3-a259-47a5-9e2d-079bc3246a0b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:47.231986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9953cfd3-a259-47a5-9e2d-079bc3246a0b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:47.267165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9953cfd3-a259-47a5-9e2d-079bc3246a0b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:47.267667 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9953cfd3-a259-47a5-9e2d-079bc3246a0b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:47.268085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9953cfd3-a259-47a5-9e2d-079bc3246a0b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:47.268530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-9953cfd3-a259-47a5-9e2d-079bc3246a0b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lazy-loading 'fault' on Instance uuid 6e7a6174-1aea-4150-8ccb-c68139d9930a {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:02:47.320565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9953cfd3-a259-47a5-9e2d-079bc3246a0b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:02:47.328823 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9953cfd3-a259-47a5-9e2d-079bc3246a0b tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a" status: 200 len: 1231 microversion: 2.1 time: 0.112927 Aug 24 11:02:47.329511 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3091/6541] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:02:47 2022] GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a => generated 1231 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:02:48.355361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-59dad710-c608-4e92-9568-a32855c8cbc3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:02:48.356343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-59dad710-c608-4e92-9568-a32855c8cbc3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 6e7a6174-1aea-4150-8ccb-c68139d9930a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:02:48.364791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59dad710-c608-4e92-9568-a32855c8cbc3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:48.365326 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59dad710-c608-4e92-9568-a32855c8cbc3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:48.365771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59dad710-c608-4e92-9568-a32855c8cbc3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:48.366476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59dad710-c608-4e92-9568-a32855c8cbc3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:48.366949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59dad710-c608-4e92-9568-a32855c8cbc3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:48.367382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59dad710-c608-4e92-9568-a32855c8cbc3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:48.382638 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-59dad710-c608-4e92-9568-a32855c8cbc3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] HTTP exception thrown: Instance 6e7a6174-1aea-4150-8ccb-c68139d9930a could not be found. Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-59dad710-c608-4e92-9568-a32855c8cbc3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Request method failure captured: Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a HTTP/1.1 Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgJaL-kWwlcIRB5LGdxUOg9NstdlrO4InCZtaIlL6zMAKoO2x9AaKw5QTM5Yc447Qz9dKY7jxkolr7Q3liCCaPxpGdqV4sv_A4_Emu-qJmA0z5hB1ngNyBGm9n-W2LyGX7LaKy8OE29M25iXwnWnUlWVb7vPgN3qX9b_bYxZIyExFQ4 Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d1785d661bbd41619a7046600ad435b1", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d1785d661bbd41619a7046600ad435b1"}]}] Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestVolumeBootPattern-1780678770 Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestVolumeBootPattern-1780678770-project Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 26b7ff61eab4477890d20977574e8dac Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestVolumeBootPattern-1780678770-project Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 6e7a6174-1aea-4150-8ccb-c68139d9930a could not be found. Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '6e7a6174-1aea-4150-8ccb-c68139d9930a'} Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e7a6174-1aea-4150-8ccb-c68139d9930a could not be found. Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e7a6174-1aea-4150-8ccb-c68139d9930a could not be found. Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:02:48.384354 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:02:48.390536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:02:48.390536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:02:48.390536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:02:48.390536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:02:48.390536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:02:48.390536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e7a6174-1aea-4150-8ccb-c68139d9930a could not be found. Aug 24 11:02:48.390536 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:02:48.390536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-59dad710-c608-4e92-9568-a32855c8cbc3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Returning 404 to user: Instance 6e7a6174-1aea-4150-8ccb-c68139d9930a could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:02:48.390536 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-59dad710-c608-4e92-9568-a32855c8cbc3 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a" status: 404 len: 111 microversion: 2.1 time: 0.037173 Aug 24 11:02:48.390536 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3451/6542] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:02:48 2022] GET /compute/v2.1/servers/6e7a6174-1aea-4150-8ccb-c68139d9930a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:02:54.683505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ac07995c-01c1-4316-baeb-b90cb61fd07f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:02:54.684010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ac07995c-01c1-4316-baeb-b90cb61fd07f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 16096adc-d1e6-4c42-b149-f3f987f6df9d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:02:54.686485 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8ddfea26-b00a-4ad5-91f7-6ef478bd58b2 req-a656c796-3835-4c16-878e-b815ccbfa679 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16096adc-d1e6-4c42-b149-f3f987f6df9d", "tag": "a53bf1c8-83a7-4502-a211-32fada58f71b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:02:54.690814 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac07995c-01c1-4316-baeb-b90cb61fd07f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:54.691552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac07995c-01c1-4316-baeb-b90cb61fd07f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:54.691991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac07995c-01c1-4316-baeb-b90cb61fd07f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:54.692906 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac07995c-01c1-4316-baeb-b90cb61fd07f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:54.693391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac07995c-01c1-4316-baeb-b90cb61fd07f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:54.693817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac07995c-01c1-4316-baeb-b90cb61fd07f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:54.697005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8ddfea26-b00a-4ad5-91f7-6ef478bd58b2 req-a656c796-3835-4c16-878e-b815ccbfa679 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:54.697608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8ddfea26-b00a-4ad5-91f7-6ef478bd58b2 req-a656c796-3835-4c16-878e-b815ccbfa679 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:54.698088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8ddfea26-b00a-4ad5-91f7-6ef478bd58b2 req-a656c796-3835-4c16-878e-b815ccbfa679 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:54.709537 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8ddfea26-b00a-4ad5-91f7-6ef478bd58b2 req-a656c796-3835-4c16-878e-b815ccbfa679 service nova] Creating event network-changed:a53bf1c8-83a7-4502-a211-32fada58f71b for instance 16096adc-d1e6-4c42-b149-f3f987f6df9d on n-h1-849328-3 Aug 24 11:02:54.715067 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8ddfea26-b00a-4ad5-91f7-6ef478bd58b2 req-a656c796-3835-4c16-878e-b815ccbfa679 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032402 Aug 24 11:02:54.716040 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3452/6543] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:02:54.720070 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ac07995c-01c1-4316-baeb-b90cb61fd07f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 16096adc-d1e6-4c42-b149-f3f987f6df9d] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:02:54.803101 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ac07995c-01c1-4316-baeb-b90cb61fd07f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "DELETE /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d" status: 204 len: 0 microversion: 2.1 time: 0.123184 Aug 24 11:02:54.804111 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3092/6544] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:02:54 2022] DELETE /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:02:54.814044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6dc153a6-45a1-4476-8af8-40b0e59e166d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:02:54.815472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6dc153a6-45a1-4476-8af8-40b0e59e166d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 16096adc-d1e6-4c42-b149-f3f987f6df9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:02:54.822124 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dc153a6-45a1-4476-8af8-40b0e59e166d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:54.822776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dc153a6-45a1-4476-8af8-40b0e59e166d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:54.823226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dc153a6-45a1-4476-8af8-40b0e59e166d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:54.823939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dc153a6-45a1-4476-8af8-40b0e59e166d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:54.824401 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dc153a6-45a1-4476-8af8-40b0e59e166d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:54.824832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dc153a6-45a1-4476-8af8-40b0e59e166d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:54.974441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6dc153a6-45a1-4476-8af8-40b0e59e166d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:02:54.983075 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6dc153a6-45a1-4476-8af8-40b0e59e166d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d" status: 200 len: 1578 microversion: 2.1 time: 0.174380 Aug 24 11:02:54.983893 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3453/6545] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:02:54 2022] GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d => generated 1578 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:02:56.004699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d33cef25-dffe-499d-ae15-efde39942a2f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:02:56.005626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d33cef25-dffe-499d-ae15-efde39942a2f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 16096adc-d1e6-4c42-b149-f3f987f6df9d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:02:56.012696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d33cef25-dffe-499d-ae15-efde39942a2f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:56.013208 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d33cef25-dffe-499d-ae15-efde39942a2f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:56.013645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d33cef25-dffe-499d-ae15-efde39942a2f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:56.014343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d33cef25-dffe-499d-ae15-efde39942a2f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:56.014789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d33cef25-dffe-499d-ae15-efde39942a2f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:56.015210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d33cef25-dffe-499d-ae15-efde39942a2f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:56.217478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d33cef25-dffe-499d-ae15-efde39942a2f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:02:56.227135 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d33cef25-dffe-499d-ae15-efde39942a2f tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d" status: 200 len: 1578 microversion: 2.1 time: 0.226788 Aug 24 11:02:56.227860 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3093/6546] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:02:55 2022] GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d => generated 1578 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:02:57.111646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-b16ee000-4143-462e-ad15-ae82130efd81 req-65160328-80cc-48b2-92a1-e29d61485815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16096adc-d1e6-4c42-b149-f3f987f6df9d", "name": "network-vif-deleted", "tag": "a53bf1c8-83a7-4502-a211-32fada58f71b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:02:57.122297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b16ee000-4143-462e-ad15-ae82130efd81 req-65160328-80cc-48b2-92a1-e29d61485815 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:57.122801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b16ee000-4143-462e-ad15-ae82130efd81 req-65160328-80cc-48b2-92a1-e29d61485815 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:57.123233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b16ee000-4143-462e-ad15-ae82130efd81 req-65160328-80cc-48b2-92a1-e29d61485815 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:57.137050 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-b16ee000-4143-462e-ad15-ae82130efd81 req-65160328-80cc-48b2-92a1-e29d61485815 service nova] Creating event network-vif-deleted:a53bf1c8-83a7-4502-a211-32fada58f71b for instance 16096adc-d1e6-4c42-b149-f3f987f6df9d on n-h1-849328-3 Aug 24 11:02:57.142209 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-b16ee000-4143-462e-ad15-ae82130efd81 req-65160328-80cc-48b2-92a1-e29d61485815 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034344 Aug 24 11:02:57.142840 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3454/6547] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:02:57.250091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ca984d70-546f-4b77-bd16-d92827eaed64 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:02:57.250716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ca984d70-546f-4b77-bd16-d92827eaed64 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 16096adc-d1e6-4c42-b149-f3f987f6df9d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:02:57.258187 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca984d70-546f-4b77-bd16-d92827eaed64 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:57.258666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca984d70-546f-4b77-bd16-d92827eaed64 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:57.259099 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca984d70-546f-4b77-bd16-d92827eaed64 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:57.259800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca984d70-546f-4b77-bd16-d92827eaed64 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:57.260252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca984d70-546f-4b77-bd16-d92827eaed64 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:57.260662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca984d70-546f-4b77-bd16-d92827eaed64 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:57.327653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ca984d70-546f-4b77-bd16-d92827eaed64 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:02:57.337063 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ca984d70-546f-4b77-bd16-d92827eaed64 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d" status: 200 len: 1226 microversion: 2.1 time: 0.091003 Aug 24 11:02:57.337708 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3094/6548] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:02:57 2022] GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:02:58.360232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1eecbfc9-5375-4261-bdca-b035881c669d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:02:58.360799 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1eecbfc9-5375-4261-bdca-b035881c669d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 16096adc-d1e6-4c42-b149-f3f987f6df9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:02:58.367684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1eecbfc9-5375-4261-bdca-b035881c669d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:58.368182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1eecbfc9-5375-4261-bdca-b035881c669d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:58.368627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1eecbfc9-5375-4261-bdca-b035881c669d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:58.369370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1eecbfc9-5375-4261-bdca-b035881c669d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:58.369837 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1eecbfc9-5375-4261-bdca-b035881c669d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:58.370269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1eecbfc9-5375-4261-bdca-b035881c669d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:58.433832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1eecbfc9-5375-4261-bdca-b035881c669d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:02:58.442463 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1eecbfc9-5375-4261-bdca-b035881c669d tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d" status: 200 len: 1226 microversion: 2.1 time: 0.087725 Aug 24 11:02:58.443045 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3455/6549] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:02:58 2022] GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:02:59.463678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8a434eab-dcff-4cf2-972c-f5650d2701ec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:02:59.464310 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8a434eab-dcff-4cf2-972c-f5650d2701ec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 16096adc-d1e6-4c42-b149-f3f987f6df9d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:02:59.472074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a434eab-dcff-4cf2-972c-f5650d2701ec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:59.472558 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a434eab-dcff-4cf2-972c-f5650d2701ec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:59.472994 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a434eab-dcff-4cf2-972c-f5650d2701ec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:59.473731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a434eab-dcff-4cf2-972c-f5650d2701ec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:02:59.474185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a434eab-dcff-4cf2-972c-f5650d2701ec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:02:59.474607 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a434eab-dcff-4cf2-972c-f5650d2701ec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:02:59.540284 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8a434eab-dcff-4cf2-972c-f5650d2701ec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:02:59.548651 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8a434eab-dcff-4cf2-972c-f5650d2701ec tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d" status: 200 len: 1226 microversion: 2.1 time: 0.088931 Aug 24 11:02:59.549372 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3095/6550] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:02:59 2022] GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:03:00.570180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1c2ee5b0-8b9f-41be-99f0-c2a8c4aaaec9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:00.570864 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1c2ee5b0-8b9f-41be-99f0-c2a8c4aaaec9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 16096adc-d1e6-4c42-b149-f3f987f6df9d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:00.578255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c2ee5b0-8b9f-41be-99f0-c2a8c4aaaec9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:00.578758 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c2ee5b0-8b9f-41be-99f0-c2a8c4aaaec9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:00.579210 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c2ee5b0-8b9f-41be-99f0-c2a8c4aaaec9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:00.579927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c2ee5b0-8b9f-41be-99f0-c2a8c4aaaec9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:00.580370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c2ee5b0-8b9f-41be-99f0-c2a8c4aaaec9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:00.580838 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c2ee5b0-8b9f-41be-99f0-c2a8c4aaaec9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:00.648077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1c2ee5b0-8b9f-41be-99f0-c2a8c4aaaec9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b7ff61eab4477890d20977574e8dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1785d661bbd41619a7046600ad435b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:00.656878 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1c2ee5b0-8b9f-41be-99f0-c2a8c4aaaec9 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d" status: 200 len: 1226 microversion: 2.1 time: 0.090751 Aug 24 11:03:00.657503 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3456/6551] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:00 2022] GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:03:01.678800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2eb6abbb-a819-49f0-b6b8-df4ca3b76ec2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:01.679456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2eb6abbb-a819-49f0-b6b8-df4ca3b76ec2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 16096adc-d1e6-4c42-b149-f3f987f6df9d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:01.687364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2eb6abbb-a819-49f0-b6b8-df4ca3b76ec2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:01.687865 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2eb6abbb-a819-49f0-b6b8-df4ca3b76ec2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:01.688305 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2eb6abbb-a819-49f0-b6b8-df4ca3b76ec2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:01.689016 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2eb6abbb-a819-49f0-b6b8-df4ca3b76ec2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:01.689513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2eb6abbb-a819-49f0-b6b8-df4ca3b76ec2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:01.689941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2eb6abbb-a819-49f0-b6b8-df4ca3b76ec2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:01.705243 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-2eb6abbb-a819-49f0-b6b8-df4ca3b76ec2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] HTTP exception thrown: Instance 16096adc-d1e6-4c42-b149-f3f987f6df9d could not be found. Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2eb6abbb-a819-49f0-b6b8-df4ca3b76ec2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Request method failure captured: Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d HTTP/1.1 Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgJaL-kWwlcIRB5LGdxUOg9NstdlrO4InCZtaIlL6zMAKoO2x9AaKw5QTM5Yc447Qz9dKY7jxkolr7Q3liCCaPxpGdqV4sv_A4_Emu-qJmA0z5hB1ngNyBGm9n-W2LyGX7LaKy8OE29M25iXwnWnUlWVb7vPgN3qX9b_bYxZIyExFQ4 Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d1785d661bbd41619a7046600ad435b1", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d1785d661bbd41619a7046600ad435b1"}]}] Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-TestVolumeBootPattern-1780678770 Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-TestVolumeBootPattern-1780678770-project Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 26b7ff61eab4477890d20977574e8dac Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-TestVolumeBootPattern-1780678770-project Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 16096adc-d1e6-4c42-b149-f3f987f6df9d could not be found. Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '16096adc-d1e6-4c42-b149-f3f987f6df9d'} Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16096adc-d1e6-4c42-b149-f3f987f6df9d could not be found. Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16096adc-d1e6-4c42-b149-f3f987f6df9d could not be found. Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:03:01.706961 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:03:01.712266 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:03:01.712266 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:03:01.712266 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:03:01.712266 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:03:01.712266 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:03:01.712266 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16096adc-d1e6-4c42-b149-f3f987f6df9d could not be found. Aug 24 11:03:01.712266 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:03:01.712266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2eb6abbb-a819-49f0-b6b8-df4ca3b76ec2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Returning 404 to user: Instance 16096adc-d1e6-4c42-b149-f3f987f6df9d could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:03:01.712266 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2eb6abbb-a819-49f0-b6b8-df4ca3b76ec2 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d" status: 404 len: 111 microversion: 2.1 time: 0.034119 Aug 24 11:03:01.712266 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3096/6552] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:01 2022] GET /compute/v2.1/servers/16096adc-d1e6-4c42-b149-f3f987f6df9d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:03:02.193600 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7b6b3b08-0825-49d7-a3e7-37570d3eb7f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:02.194246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7b6b3b08-0825-49d7-a3e7-37570d3eb7f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:02.201263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b6b3b08-0825-49d7-a3e7-37570d3eb7f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:02.201760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b6b3b08-0825-49d7-a3e7-37570d3eb7f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:02.202216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b6b3b08-0825-49d7-a3e7-37570d3eb7f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:02.202911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b6b3b08-0825-49d7-a3e7-37570d3eb7f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:02.203375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b6b3b08-0825-49d7-a3e7-37570d3eb7f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:02.204265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b6b3b08-0825-49d7-a3e7-37570d3eb7f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:02.223383 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-7b6b3b08-0825-49d7-a3e7-37570d3eb7f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] HTTP exception thrown: Instance 30efa0e8-e35a-4785-bb4c-fc0354bec60b could not be found. Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7b6b3b08-0825-49d7-a3e7-37570d3eb7f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Request method failure captured: Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b HTTP/1.1 Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgJaL-kWwlcIRB5LGdxUOg9NstdlrO4InCZtaIlL6zMAKoO2x9AaKw5QTM5Yc447Qz9dKY7jxkolr7Q3liCCaPxpGdqV4sv_A4_Emu-qJmA0z5hB1ngNyBGm9n-W2LyGX7LaKy8OE29M25iXwnWnUlWVb7vPgN3qX9b_bYxZIyExFQ4 Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d1785d661bbd41619a7046600ad435b1", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d1785d661bbd41619a7046600ad435b1"}]}] Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestVolumeBootPattern-1780678770 Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestVolumeBootPattern-1780678770-project Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 26b7ff61eab4477890d20977574e8dac Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestVolumeBootPattern-1780678770-project Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 30efa0e8-e35a-4785-bb4c-fc0354bec60b could not be found. Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '30efa0e8-e35a-4785-bb4c-fc0354bec60b'} Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30efa0e8-e35a-4785-bb4c-fc0354bec60b could not be found. Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:03:02.225082 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:03:02.230530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30efa0e8-e35a-4785-bb4c-fc0354bec60b could not be found. Aug 24 11:03:02.230530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:03:02.230530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:03:02.230530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:03:02.230530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:03:02.230530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:03:02.230530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:03:02.230530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:03:02.230530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:03:02.230530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30efa0e8-e35a-4785-bb4c-fc0354bec60b could not be found. Aug 24 11:03:02.230530 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:03:02.230530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7b6b3b08-0825-49d7-a3e7-37570d3eb7f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Returning 404 to user: Instance 30efa0e8-e35a-4785-bb4c-fc0354bec60b could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:03:02.230530 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7b6b3b08-0825-49d7-a3e7-37570d3eb7f6 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "DELETE /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 404 len: 111 microversion: 2.1 time: 0.038249 Aug 24 11:03:02.230530 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3457/6553] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:03:02 2022] DELETE /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:03:02.235855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-06604f70-bc92-4930-8bf5-e42dd05ba092 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:02.236476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-06604f70-bc92-4930-8bf5-e42dd05ba092 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] [instance: 30efa0e8-e35a-4785-bb4c-fc0354bec60b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:02.243915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06604f70-bc92-4930-8bf5-e42dd05ba092 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:02.245015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06604f70-bc92-4930-8bf5-e42dd05ba092 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:02.245662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06604f70-bc92-4930-8bf5-e42dd05ba092 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:02.246717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06604f70-bc92-4930-8bf5-e42dd05ba092 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:02.247388 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06604f70-bc92-4930-8bf5-e42dd05ba092 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:02.247852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06604f70-bc92-4930-8bf5-e42dd05ba092 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:02.263412 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-06604f70-bc92-4930-8bf5-e42dd05ba092 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] HTTP exception thrown: Instance 30efa0e8-e35a-4785-bb4c-fc0354bec60b could not be found. Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-06604f70-bc92-4930-8bf5-e42dd05ba092 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Request method failure captured: Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b HTTP/1.1 Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgJaL-kWwlcIRB5LGdxUOg9NstdlrO4InCZtaIlL6zMAKoO2x9AaKw5QTM5Yc447Qz9dKY7jxkolr7Q3liCCaPxpGdqV4sv_A4_Emu-qJmA0z5hB1ngNyBGm9n-W2LyGX7LaKy8OE29M25iXwnWnUlWVb7vPgN3qX9b_bYxZIyExFQ4 Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d1785d661bbd41619a7046600ad435b1", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d1785d661bbd41619a7046600ad435b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d1785d661bbd41619a7046600ad435b1"}]}] Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-TestVolumeBootPattern-1780678770 Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: d1785d661bbd41619a7046600ad435b1 Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780678770 Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-TestVolumeBootPattern-1780678770-project Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 26b7ff61eab4477890d20977574e8dac Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-TestVolumeBootPattern-1780678770-project Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 30efa0e8-e35a-4785-bb4c-fc0354bec60b could not be found. Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '30efa0e8-e35a-4785-bb4c-fc0354bec60b'} Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30efa0e8-e35a-4785-bb4c-fc0354bec60b could not be found. Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30efa0e8-e35a-4785-bb4c-fc0354bec60b could not be found. Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:03:02.264968 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:03:02.270130 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:03:02.270130 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:03:02.270130 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:03:02.270130 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:03:02.270130 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:03:02.270130 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30efa0e8-e35a-4785-bb4c-fc0354bec60b could not be found. Aug 24 11:03:02.270130 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:03:02.270130 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-06604f70-bc92-4930-8bf5-e42dd05ba092 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Returning 404 to user: Instance 30efa0e8-e35a-4785-bb4c-fc0354bec60b could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:03:02.270130 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-06604f70-bc92-4930-8bf5-e42dd05ba092 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b" status: 404 len: 111 microversion: 2.1 time: 0.034668 Aug 24 11:03:02.270130 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3097/6554] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:02 2022] GET /compute/v2.1/servers/30efa0e8-e35a-4785-bb4c-fc0354bec60b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:03:05.687106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-19355c51-620f-41ea-9017-770cf1c27ec5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] Calling method '.version_select at 0x7f4654184670>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:05.711045 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-19355c51-620f-41ea-9017-770cf1c27ec5 tempest-TestVolumeBootPattern-1780678770 tempest-TestVolumeBootPattern-1780678770-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1418087682" status: 202 len: 0 microversion: 2.1 time: 0.028004 Aug 24 11:03:05.711649 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3458/6555] 10.222.0.85 () {58 vars in 1263 bytes} [Wed Aug 24 11:03:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1418087682 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:03:20.334518 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:03:20.335170 n-d-849328-3 devstack@n-api.service[122432]: Wed Aug 24 11:03:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:03:24.191959 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:03:24.192701 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:03:24.312094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ff22a9f0-c641-4ba6-8215-a9a63bfbeddc tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-222461410", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:03:24.372087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-ff22a9f0-c641-4ba6-8215-a9a63bfbeddc tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:03:24.565322 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-ff22a9f0-c641-4ba6-8215-a9a63bfbeddc tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:03:24.565915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-ff22a9f0-c641-4ba6-8215-a9a63bfbeddc tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:03:24.566618 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-ff22a9f0-c641-4ba6-8215-a9a63bfbeddc tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:03:24.567031 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-ff22a9f0-c641-4ba6-8215-a9a63bfbeddc tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:03:24.567441 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-ff22a9f0-c641-4ba6-8215-a9a63bfbeddc tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:03:24.577584 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff22a9f0-c641-4ba6-8215-a9a63bfbeddc tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:24.578070 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff22a9f0-c641-4ba6-8215-a9a63bfbeddc tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:24.578510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff22a9f0-c641-4ba6-8215-a9a63bfbeddc tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:24.579239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff22a9f0-c641-4ba6-8215-a9a63bfbeddc tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:24.579695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff22a9f0-c641-4ba6-8215-a9a63bfbeddc tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:24.580112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff22a9f0-c641-4ba6-8215-a9a63bfbeddc tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:24.597992 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-ff22a9f0-c641-4ba6-8215-a9a63bfbeddc tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Getting quotas for project 7f75f7d314b94af99cc354b07c8bef66. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:03:24.603674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-ff22a9f0-c641-4ba6-8215-a9a63bfbeddc tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Getting quotas for user 3ae0b5958c3c47a98677ec6debb4201f and project 7f75f7d314b94af99cc354b07c8bef66. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:03:24.616494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ff22a9f0-c641-4ba6-8215-a9a63bfbeddc tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:03:24.618856 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ff22a9f0-c641-4ba6-8215-a9a63bfbeddc tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] [instance: 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:03:24.664740 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ff22a9f0-c641-4ba6-8215-a9a63bfbeddc tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.477687 Aug 24 11:03:24.665426 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3098/6556] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 11:03:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:03:24.678490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f492a50b-aedb-4223-9cbd-490424e7869d tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:24.679215 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f492a50b-aedb-4223-9cbd-490424e7869d tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] [instance: 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:24.683299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=48 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:03:24.684128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:03:24.738837 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f492a50b-aedb-4223-9cbd-490424e7869d tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae0b5958c3c47a98677ec6debb4201f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f75f7d314b94af99cc354b07c8bef66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:24.745882 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f492a50b-aedb-4223-9cbd-490424e7869d tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] 10.222.0.85 "GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab" status: 200 len: 1221 microversion: 2.1 time: 0.071473 Aug 24 11:03:24.747035 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3459/6557] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:24 2022] GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab => generated 1221 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:03:25.767404 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d8e4065f-ff6a-4456-8807-f95f3b8aa0d4 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:25.768022 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d8e4065f-ff6a-4456-8807-f95f3b8aa0d4 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] [instance: 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:25.777559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8e4065f-ff6a-4456-8807-f95f3b8aa0d4 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:25.778086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8e4065f-ff6a-4456-8807-f95f3b8aa0d4 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:25.778532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8e4065f-ff6a-4456-8807-f95f3b8aa0d4 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:25.779255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8e4065f-ff6a-4456-8807-f95f3b8aa0d4 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:25.779710 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8e4065f-ff6a-4456-8807-f95f3b8aa0d4 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:25.780137 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8e4065f-ff6a-4456-8807-f95f3b8aa0d4 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:25.882138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d8e4065f-ff6a-4456-8807-f95f3b8aa0d4 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae0b5958c3c47a98677ec6debb4201f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f75f7d314b94af99cc354b07c8bef66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:25.890092 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d8e4065f-ff6a-4456-8807-f95f3b8aa0d4 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] 10.222.0.85 "GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab" status: 200 len: 1281 microversion: 2.1 time: 0.127756 Aug 24 11:03:25.890684 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3099/6558] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:25 2022] GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab => generated 1281 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:03:26.913912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0bc92b35-85aa-4af0-a960-8d970318d50d tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:26.914498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0bc92b35-85aa-4af0-a960-8d970318d50d tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] [instance: 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:26.922154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bc92b35-85aa-4af0-a960-8d970318d50d tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:26.922783 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bc92b35-85aa-4af0-a960-8d970318d50d tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:26.923313 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bc92b35-85aa-4af0-a960-8d970318d50d tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:26.924120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bc92b35-85aa-4af0-a960-8d970318d50d tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:26.924592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bc92b35-85aa-4af0-a960-8d970318d50d tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:26.925032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bc92b35-85aa-4af0-a960-8d970318d50d tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:27.061045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0bc92b35-85aa-4af0-a960-8d970318d50d tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae0b5958c3c47a98677ec6debb4201f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f75f7d314b94af99cc354b07c8bef66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:27.069928 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0bc92b35-85aa-4af0-a960-8d970318d50d tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] 10.222.0.85 "GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab" status: 200 len: 1321 microversion: 2.1 time: 0.161144 Aug 24 11:03:27.078648 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3460/6559] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:26 2022] GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:03:27.313339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-dd944c48-cb30-45ab-a7d9-e463c768b3bb req-0389a87e-c612-4763-8eee-e9fb05136036 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f38833d-7fcf-42ee-8f16-c51f4e28a1ab", "tag": "39610f84-1318-4bbf-93f5-f0a7c17e356c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:03:27.327089 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dd944c48-cb30-45ab-a7d9-e463c768b3bb req-0389a87e-c612-4763-8eee-e9fb05136036 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:27.327571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dd944c48-cb30-45ab-a7d9-e463c768b3bb req-0389a87e-c612-4763-8eee-e9fb05136036 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:27.328000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dd944c48-cb30-45ab-a7d9-e463c768b3bb req-0389a87e-c612-4763-8eee-e9fb05136036 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:27.339709 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-dd944c48-cb30-45ab-a7d9-e463c768b3bb req-0389a87e-c612-4763-8eee-e9fb05136036 service nova] Creating event network-changed:39610f84-1318-4bbf-93f5-f0a7c17e356c for instance 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab on n-h1-849328-3 Aug 24 11:03:27.345843 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-dd944c48-cb30-45ab-a7d9-e463c768b3bb req-0389a87e-c612-4763-8eee-e9fb05136036 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036599 Aug 24 11:03:27.346811 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3100/6560] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:03:28.092235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d8fe5fa2-0363-435f-b49e-9ef6567ddc75 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:28.092863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d8fe5fa2-0363-435f-b49e-9ef6567ddc75 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] [instance: 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:28.100327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8fe5fa2-0363-435f-b49e-9ef6567ddc75 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:28.100814 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8fe5fa2-0363-435f-b49e-9ef6567ddc75 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:28.101328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8fe5fa2-0363-435f-b49e-9ef6567ddc75 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:28.102009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8fe5fa2-0363-435f-b49e-9ef6567ddc75 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:28.102473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8fe5fa2-0363-435f-b49e-9ef6567ddc75 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:28.102903 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8fe5fa2-0363-435f-b49e-9ef6567ddc75 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:28.245403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d8fe5fa2-0363-435f-b49e-9ef6567ddc75 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae0b5958c3c47a98677ec6debb4201f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f75f7d314b94af99cc354b07c8bef66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:28.257100 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d8fe5fa2-0363-435f-b49e-9ef6567ddc75 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] 10.222.0.85 "GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab" status: 200 len: 1321 microversion: 2.1 time: 0.168550 Aug 24 11:03:28.257791 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3461/6561] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:28 2022] GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:03:29.279128 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eeb8481e-bd6c-4126-989c-5346f564c365 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:29.279829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eeb8481e-bd6c-4126-989c-5346f564c365 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] [instance: 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:29.287292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eeb8481e-bd6c-4126-989c-5346f564c365 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:29.287767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eeb8481e-bd6c-4126-989c-5346f564c365 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:29.288245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eeb8481e-bd6c-4126-989c-5346f564c365 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:29.288937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eeb8481e-bd6c-4126-989c-5346f564c365 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:29.289428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eeb8481e-bd6c-4126-989c-5346f564c365 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:29.289855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eeb8481e-bd6c-4126-989c-5346f564c365 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:29.428539 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eeb8481e-bd6c-4126-989c-5346f564c365 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae0b5958c3c47a98677ec6debb4201f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f75f7d314b94af99cc354b07c8bef66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:29.436653 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eeb8481e-bd6c-4126-989c-5346f564c365 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] 10.222.0.85 "GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab" status: 200 len: 1321 microversion: 2.1 time: 0.161833 Aug 24 11:03:29.437366 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3101/6562] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:29 2022] GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:03:30.462114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5132a463-24d6-4aa9-a8eb-36537cf6d6de tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:30.462755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5132a463-24d6-4aa9-a8eb-36537cf6d6de tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] [instance: 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:30.470123 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5132a463-24d6-4aa9-a8eb-36537cf6d6de tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:30.470617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5132a463-24d6-4aa9-a8eb-36537cf6d6de tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:30.471064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5132a463-24d6-4aa9-a8eb-36537cf6d6de tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:30.471771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5132a463-24d6-4aa9-a8eb-36537cf6d6de tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:30.472551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5132a463-24d6-4aa9-a8eb-36537cf6d6de tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:30.472992 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5132a463-24d6-4aa9-a8eb-36537cf6d6de tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:30.610780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5132a463-24d6-4aa9-a8eb-36537cf6d6de tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae0b5958c3c47a98677ec6debb4201f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f75f7d314b94af99cc354b07c8bef66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:30.619524 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5132a463-24d6-4aa9-a8eb-36537cf6d6de tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] 10.222.0.85 "GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab" status: 200 len: 1321 microversion: 2.1 time: 0.162958 Aug 24 11:03:30.620139 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3462/6563] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:30 2022] GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:03:31.647733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-63dbffe5-764a-4925-b611-8a53a692a1e9 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:31.648396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-63dbffe5-764a-4925-b611-8a53a692a1e9 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] [instance: 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:31.656436 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63dbffe5-764a-4925-b611-8a53a692a1e9 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:31.656929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63dbffe5-764a-4925-b611-8a53a692a1e9 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:31.657396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63dbffe5-764a-4925-b611-8a53a692a1e9 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:31.658101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63dbffe5-764a-4925-b611-8a53a692a1e9 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:31.658551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63dbffe5-764a-4925-b611-8a53a692a1e9 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:31.658981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63dbffe5-764a-4925-b611-8a53a692a1e9 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:31.814071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-63dbffe5-764a-4925-b611-8a53a692a1e9 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae0b5958c3c47a98677ec6debb4201f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f75f7d314b94af99cc354b07c8bef66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:31.822481 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-63dbffe5-764a-4925-b611-8a53a692a1e9 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] 10.222.0.85 "GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab" status: 200 len: 1321 microversion: 2.1 time: 0.178813 Aug 24 11:03:31.823070 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3102/6564] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:31 2022] GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:03:32.843848 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb57df6c-c169-42cf-b54c-ea54fd018546 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:32.844484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cb57df6c-c169-42cf-b54c-ea54fd018546 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] [instance: 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:32.852122 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb57df6c-c169-42cf-b54c-ea54fd018546 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:32.852625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb57df6c-c169-42cf-b54c-ea54fd018546 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:32.853081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb57df6c-c169-42cf-b54c-ea54fd018546 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:32.853818 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb57df6c-c169-42cf-b54c-ea54fd018546 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:32.854289 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb57df6c-c169-42cf-b54c-ea54fd018546 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:32.854729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb57df6c-c169-42cf-b54c-ea54fd018546 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:32.989288 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cb57df6c-c169-42cf-b54c-ea54fd018546 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae0b5958c3c47a98677ec6debb4201f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f75f7d314b94af99cc354b07c8bef66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:32.995005 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-de4c39d0-8af5-4f28-ae69-f3887e54c520 req-66341342-aa21-48ee-a7f3-3654c9e67d04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f38833d-7fcf-42ee-8f16-c51f4e28a1ab", "name": "network-vif-plugged", "status": "completed", "tag": "39610f84-1318-4bbf-93f5-f0a7c17e356c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:03:32.998177 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cb57df6c-c169-42cf-b54c-ea54fd018546 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] 10.222.0.85 "GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab" status: 200 len: 1321 microversion: 2.1 time: 0.158245 Aug 24 11:03:32.999015 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3463/6565] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:32 2022] GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:03:33.007517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-de4c39d0-8af5-4f28-ae69-f3887e54c520 req-66341342-aa21-48ee-a7f3-3654c9e67d04 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:33.008000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-de4c39d0-8af5-4f28-ae69-f3887e54c520 req-66341342-aa21-48ee-a7f3-3654c9e67d04 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:33.009261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-de4c39d0-8af5-4f28-ae69-f3887e54c520 req-66341342-aa21-48ee-a7f3-3654c9e67d04 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:33.025769 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-de4c39d0-8af5-4f28-ae69-f3887e54c520 req-66341342-aa21-48ee-a7f3-3654c9e67d04 service nova] Creating event network-vif-plugged:39610f84-1318-4bbf-93f5-f0a7c17e356c for instance 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab on n-h1-849328-3 Aug 24 11:03:33.031189 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-de4c39d0-8af5-4f28-ae69-f3887e54c520 req-66341342-aa21-48ee-a7f3-3654c9e67d04 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040675 Aug 24 11:03:33.031799 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3103/6566] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:03:34.030142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-90981bf7-5216-471d-a780-8f3c1daa2878 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:34.031147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-90981bf7-5216-471d-a780-8f3c1daa2878 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] [instance: 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:34.041924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90981bf7-5216-471d-a780-8f3c1daa2878 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:34.042434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90981bf7-5216-471d-a780-8f3c1daa2878 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:34.042885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90981bf7-5216-471d-a780-8f3c1daa2878 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:34.043597 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90981bf7-5216-471d-a780-8f3c1daa2878 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:34.044071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90981bf7-5216-471d-a780-8f3c1daa2878 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:34.044518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90981bf7-5216-471d-a780-8f3c1daa2878 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:34.180443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-90981bf7-5216-471d-a780-8f3c1daa2878 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae0b5958c3c47a98677ec6debb4201f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f75f7d314b94af99cc354b07c8bef66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:34.188450 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-90981bf7-5216-471d-a780-8f3c1daa2878 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] 10.222.0.85 "GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab" status: 200 len: 1321 microversion: 2.1 time: 0.165126 Aug 24 11:03:34.189083 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3464/6567] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:34 2022] GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:03:35.213526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cad3c090-f99a-4f68-94da-2bfd10b926f9 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:35.214241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cad3c090-f99a-4f68-94da-2bfd10b926f9 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] [instance: 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:35.217156 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:03:35.217826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:03:35.224264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cad3c090-f99a-4f68-94da-2bfd10b926f9 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:35.224754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cad3c090-f99a-4f68-94da-2bfd10b926f9 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:35.225224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cad3c090-f99a-4f68-94da-2bfd10b926f9 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:35.225931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cad3c090-f99a-4f68-94da-2bfd10b926f9 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:35.226384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cad3c090-f99a-4f68-94da-2bfd10b926f9 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:35.226842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cad3c090-f99a-4f68-94da-2bfd10b926f9 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:35.369155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cad3c090-f99a-4f68-94da-2bfd10b926f9 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae0b5958c3c47a98677ec6debb4201f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f75f7d314b94af99cc354b07c8bef66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:35.377522 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cad3c090-f99a-4f68-94da-2bfd10b926f9 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] 10.222.0.85 "GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab" status: 200 len: 1471 microversion: 2.1 time: 0.170144 Aug 24 11:03:35.378112 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3104/6568] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:35 2022] GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab => generated 1471 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:03:35.402413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:03:35.459085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6545a16e-a0e2-4b44-b57e-cdcd517a2209 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Calling method '.version_select at 0x7f4647b473a0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:35.538004 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6545a16e-a0e2-4b44-b57e-cdcd517a2209 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] 10.222.0.85 "GET /compute/v2.1/os-quota-sets/3897ca70d7854f12a51eefffed47630a" status: 200 len: 371 microversion: 2.1 time: 0.139768 Aug 24 11:03:35.538831 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3465/6569] 10.222.0.85 () {58 vars in 1242 bytes} [Wed Aug 24 11:03:35 2022] GET /compute/v2.1/os-quota-sets/3897ca70d7854f12a51eefffed47630a => generated 371 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:03:35.550978 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f50f7184-1ca1-4c81-ae99-301ad4a0fdee tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2098665211", "id": 1610201279, "os-flavor-access:is_public": "True"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:03:35.554008 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:03:35.554008 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 11:03:35.570998 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f50f7184-1ca1-4c81-ae99-301ad4a0fdee tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.023742 Aug 24 11:03:35.571609 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3105/6570] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 11:03:35 2022] POST /compute/v2.1/flavors => generated 438 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:03:35.583413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-407b3729-d773-462c-a625-5a704784d330 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1610201279"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:03:35.585792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-407b3729-d773-462c-a625-5a704784d330 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] [instance: 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:35.591964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-407b3729-d773-462c-a625-5a704784d330 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:35.592488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-407b3729-d773-462c-a625-5a704784d330 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:35.592939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-407b3729-d773-462c-a625-5a704784d330 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:35.593670 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-407b3729-d773-462c-a625-5a704784d330 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:35.594136 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-407b3729-d773-462c-a625-5a704784d330 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:35.594569 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-407b3729-d773-462c-a625-5a704784d330 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:35.752445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-407b3729-d773-462c-a625-5a704784d330 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3ca37da152284c93b8a50e0694d8fb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3897ca70d7854f12a51eefffed47630a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:35.759268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-407b3729-d773-462c-a625-5a704784d330 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] [instance: 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2098665211 {{(pid=122433) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 11:03:35.766390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-407b3729-d773-462c-a625-5a704784d330 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:35.766880 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-407b3729-d773-462c-a625-5a704784d330 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:35.767319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-407b3729-d773-462c-a625-5a704784d330 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:35.768041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-407b3729-d773-462c-a625-5a704784d330 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:35.768499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-407b3729-d773-462c-a625-5a704784d330 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:35.768929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-407b3729-d773-462c-a625-5a704784d330 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:35.788946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-407b3729-d773-462c-a625-5a704784d330 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Getting quotas for project 7f75f7d314b94af99cc354b07c8bef66. Resources: {'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:03:35.794288 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-407b3729-d773-462c-a625-5a704784d330 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Getting quotas for user 3ae0b5958c3c47a98677ec6debb4201f and project 7f75f7d314b94af99cc354b07c8bef66. Resources: {'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:03:35.806270 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.compute.api [None req-407b3729-d773-462c-a625-5a704784d330 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] ram quota exceeded for 3897ca70d7854f12a51eefffed47630a, tried to resize instance. Aug 24 11:03:35.806821 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-407b3729-d773-462c-a625-5a704784d330 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-407b3729-d773-462c-a625-5a704784d330 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Request method failure captured: Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab/action HTTP/1.1 Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 39 Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgV8DnYWAViZGxrzsGsrN-AIbPvEWfYP5nSg0pTFWDI1z4JJbhO4csEpQeR0oJzgrVLSfNV2oLen8UukghrolipcQMbvj4GfOCYYHQvz7ACT2TwW-C_17OC7UKD3s_TpyBhUyJx75GakmAueFyfp1cSAKDwmy3nakxa2kNzjva7U41Y Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 3897ca70d7854f12a51eefffed47630a Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1337808769 Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,admin,member Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,admin,member Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3897ca70d7854f12a51eefffed47630a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3897ca70d7854f12a51eefffed47630a", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3897ca70d7854f12a51eefffed47630a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3897ca70d7854f12a51eefffed47630a"}]}] Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1337808769 Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 3897ca70d7854f12a51eefffed47630a Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1337808769 Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersAdminNegativeTestJSON-1337808769-project-admin Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 3ca37da152284c93b8a50e0694d8fb29 Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1337808769-project-admin Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: {"resize": {"flavorRef": "1610201279"}} Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '3f38833d-7fcf-42ee-8f16-c51f4e28a1ab', 'body': {'resize': {'flavorRef': '1610201279'}}} Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3863, in _check_quota_for_upsize Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 11:03:35.811976 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4229, in resize Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3881, in _check_quota_for_upsize Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-407b3729-d773-462c-a625-5a704784d330 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-407b3729-d773-462c-a625-5a704784d330 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab/action" status: 403 len: 118 microversion: 2.1 time: 0.233923 Aug 24 11:03:35.818071 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3466/6571] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:03:35 2022] POST /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab/action => generated 118 bytes in 235 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:03:35.822619 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c7d0b83b-2a2f-4770-9590-fd1ccd4fcb11 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:35.823377 n-d-849328-3 devstack@n-api.service[122432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:03:35.823377 n-d-849328-3 devstack@n-api.service[122432]: warnings.warn(msg) Aug 24 11:03:35.842031 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c7d0b83b-2a2f-4770-9590-fd1ccd4fcb11 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/1610201279" status: 202 len: 0 microversion: 2.1 time: 0.023110 Aug 24 11:03:35.842582 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3106/6572] 10.222.0.85 () {58 vars in 1161 bytes} [Wed Aug 24 11:03:35 2022] DELETE /compute/v2.1/flavors/1610201279 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:03:35.850816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-322717b1-5eb9-404f-b37b-34e50455e3f7 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:35.870830 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-322717b1-5eb9-404f-b37b-34e50455e3f7 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024038 Aug 24 11:03:35.871395 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3467/6573] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 11:03:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:03:35.890408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-171a7fbd-c576-41a7-82bd-5fc6a863f3fe tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Calling method '.version_select at 0x7f4654fb9550>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:35.965456 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-171a7fbd-c576-41a7-82bd-5fc6a863f3fe tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] 10.222.0.85 "GET /compute/v2.1/os-quota-sets/3897ca70d7854f12a51eefffed47630a" status: 200 len: 371 microversion: 2.1 time: 0.078528 Aug 24 11:03:35.966308 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3107/6574] 10.222.0.85 () {58 vars in 1242 bytes} [Wed Aug 24 11:03:35 2022] GET /compute/v2.1/os-quota-sets/3897ca70d7854f12a51eefffed47630a => generated 371 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:03:35.981489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-202347b7-9736-4bf7-8e95-78b00cd5f5f7 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1492973800", "id": 398360915, "os-flavor-access:is_public": "True"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:03:35.984719 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:03:35.984719 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 11:03:36.002153 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-202347b7-9736-4bf7-8e95-78b00cd5f5f7 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.024649 Aug 24 11:03:36.002753 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3468/6575] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 11:03:35 2022] POST /compute/v2.1/flavors => generated 434 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:03:36.014592 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-226046b8-6007-4d21-bcbe-9509cdf1171a tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "398360915"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:03:36.016935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-226046b8-6007-4d21-bcbe-9509cdf1171a tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] [instance: 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:36.023051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-226046b8-6007-4d21-bcbe-9509cdf1171a tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:36.023531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-226046b8-6007-4d21-bcbe-9509cdf1171a tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:36.023962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-226046b8-6007-4d21-bcbe-9509cdf1171a tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:36.024684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-226046b8-6007-4d21-bcbe-9509cdf1171a tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:36.025145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-226046b8-6007-4d21-bcbe-9509cdf1171a tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:36.025586 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-226046b8-6007-4d21-bcbe-9509cdf1171a tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:36.183740 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-226046b8-6007-4d21-bcbe-9509cdf1171a tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3ca37da152284c93b8a50e0694d8fb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3897ca70d7854f12a51eefffed47630a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:36.192929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-226046b8-6007-4d21-bcbe-9509cdf1171a tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] [instance: 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1492973800 {{(pid=122432) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 11:03:36.204639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-226046b8-6007-4d21-bcbe-9509cdf1171a tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:36.205150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-226046b8-6007-4d21-bcbe-9509cdf1171a tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:36.205579 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-226046b8-6007-4d21-bcbe-9509cdf1171a tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:36.206292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-226046b8-6007-4d21-bcbe-9509cdf1171a tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:36.206775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-226046b8-6007-4d21-bcbe-9509cdf1171a tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:36.207164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-226046b8-6007-4d21-bcbe-9509cdf1171a tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:36.229637 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-226046b8-6007-4d21-bcbe-9509cdf1171a tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Getting quotas for project 7f75f7d314b94af99cc354b07c8bef66. Resources: {'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:03:36.234974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-226046b8-6007-4d21-bcbe-9509cdf1171a tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Getting quotas for user 3ae0b5958c3c47a98677ec6debb4201f and project 7f75f7d314b94af99cc354b07c8bef66. Resources: {'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:03:36.247498 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.compute.api [None req-226046b8-6007-4d21-bcbe-9509cdf1171a tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] cores quota exceeded for 3897ca70d7854f12a51eefffed47630a, tried to resize instance. Aug 24 11:03:36.248035 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-226046b8-6007-4d21-bcbe-9509cdf1171a tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-226046b8-6007-4d21-bcbe-9509cdf1171a tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Request method failure captured: Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab/action HTTP/1.1 Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 38 Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgV8DnYWAViZGxrzsGsrN-AIbPvEWfYP5nSg0pTFWDI1z4JJbhO4csEpQeR0oJzgrVLSfNV2oLen8UukghrolipcQMbvj4GfOCYYHQvz7ACT2TwW-C_17OC7UKD3s_TpyBhUyJx75GakmAueFyfp1cSAKDwmy3nakxa2kNzjva7U41Y Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 3897ca70d7854f12a51eefffed47630a Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1337808769 Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,admin,member Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,admin,member Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3897ca70d7854f12a51eefffed47630a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3897ca70d7854f12a51eefffed47630a", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3897ca70d7854f12a51eefffed47630a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3897ca70d7854f12a51eefffed47630a"}]}] Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1337808769 Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 3897ca70d7854f12a51eefffed47630a Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1337808769 Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersAdminNegativeTestJSON-1337808769-project-admin Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 3ca37da152284c93b8a50e0694d8fb29 Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1337808769-project-admin Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: {"resize": {"flavorRef": "398360915"}} Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '3f38833d-7fcf-42ee-8f16-c51f4e28a1ab', 'body': {'resize': {'flavorRef': '398360915'}}} Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3863, in _check_quota_for_upsize Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 11:03:36.250109 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4229, in resize Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3881, in _check_quota_for_upsize Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-226046b8-6007-4d21-bcbe-9509cdf1171a tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-226046b8-6007-4d21-bcbe-9509cdf1171a tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] 10.222.0.85 "POST /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab/action" status: 403 len: 113 microversion: 2.1 time: 0.240869 Aug 24 11:03:36.255618 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3108/6576] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:03:36 2022] POST /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab/action => generated 113 bytes in 242 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:03:36.261915 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cfb73a8c-f717-4c75-8c48-af71701824f5 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:36.262708 n-d-849328-3 devstack@n-api.service[122433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:03:36.262708 n-d-849328-3 devstack@n-api.service[122433]: warnings.warn(msg) Aug 24 11:03:36.281835 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cfb73a8c-f717-4c75-8c48-af71701824f5 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] 10.222.0.85 "DELETE /compute/v2.1/flavors/398360915" status: 202 len: 0 microversion: 2.1 time: 0.023965 Aug 24 11:03:36.282417 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3469/6577] 10.222.0.85 () {58 vars in 1158 bytes} [Wed Aug 24 11:03:36 2022] DELETE /compute/v2.1/flavors/398360915 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:03:36.290647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-67026237-16c2-41ef-a8f7-36099fb3a126 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:36.310389 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-67026237-16c2-41ef-a8f7-36099fb3a126 tempest-ServersAdminNegativeTestJSON-1337808769 tempest-ServersAdminNegativeTestJSON-1337808769-project-admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023534 Aug 24 11:03:36.310950 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3109/6578] 10.222.0.85 () {58 vars in 1146 bytes} [Wed Aug 24 11:03:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:03:36.333345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3b6f33c4-8f18-4e69-8329-6f7a9e1b787f tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:36.333961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3b6f33c4-8f18-4e69-8329-6f7a9e1b787f tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] [instance: 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:36.343288 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b6f33c4-8f18-4e69-8329-6f7a9e1b787f tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:36.343919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b6f33c4-8f18-4e69-8329-6f7a9e1b787f tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:36.344382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b6f33c4-8f18-4e69-8329-6f7a9e1b787f tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:36.345504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b6f33c4-8f18-4e69-8329-6f7a9e1b787f tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:36.346128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b6f33c4-8f18-4e69-8329-6f7a9e1b787f tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:36.346747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b6f33c4-8f18-4e69-8329-6f7a9e1b787f tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:36.377168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3b6f33c4-8f18-4e69-8329-6f7a9e1b787f tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] [instance: 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:03:36.466443 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3b6f33c4-8f18-4e69-8329-6f7a9e1b787f tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] 10.222.0.85 "DELETE /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab" status: 204 len: 0 microversion: 2.1 time: 0.138525 Aug 24 11:03:36.467349 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3470/6579] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:03:36 2022] DELETE /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:03:36.475697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c789b24d-1570-4c59-8b98-cb599789b393 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:36.476325 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c789b24d-1570-4c59-8b98-cb599789b393 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] [instance: 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:36.483149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c789b24d-1570-4c59-8b98-cb599789b393 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:36.483627 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c789b24d-1570-4c59-8b98-cb599789b393 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:36.484059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c789b24d-1570-4c59-8b98-cb599789b393 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:36.484745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c789b24d-1570-4c59-8b98-cb599789b393 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:36.485229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c789b24d-1570-4c59-8b98-cb599789b393 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:36.485651 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c789b24d-1570-4c59-8b98-cb599789b393 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:36.631343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c789b24d-1570-4c59-8b98-cb599789b393 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae0b5958c3c47a98677ec6debb4201f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f75f7d314b94af99cc354b07c8bef66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:36.639524 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c789b24d-1570-4c59-8b98-cb599789b393 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] 10.222.0.85 "GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab" status: 200 len: 1477 microversion: 2.1 time: 0.167953 Aug 24 11:03:36.640089 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3110/6580] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:36 2022] GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab => generated 1477 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:03:37.665078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9a28e7ca-c2a9-4b46-8e4d-c0289cfe42d0 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:37.666118 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9a28e7ca-c2a9-4b46-8e4d-c0289cfe42d0 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] [instance: 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:37.674812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a28e7ca-c2a9-4b46-8e4d-c0289cfe42d0 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:37.675312 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a28e7ca-c2a9-4b46-8e4d-c0289cfe42d0 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:37.675757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a28e7ca-c2a9-4b46-8e4d-c0289cfe42d0 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:37.676484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a28e7ca-c2a9-4b46-8e4d-c0289cfe42d0 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:37.676952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a28e7ca-c2a9-4b46-8e4d-c0289cfe42d0 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:37.677416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a28e7ca-c2a9-4b46-8e4d-c0289cfe42d0 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:37.817543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9a28e7ca-c2a9-4b46-8e4d-c0289cfe42d0 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae0b5958c3c47a98677ec6debb4201f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f75f7d314b94af99cc354b07c8bef66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:37.828904 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9a28e7ca-c2a9-4b46-8e4d-c0289cfe42d0 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] 10.222.0.85 "GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab" status: 200 len: 1477 microversion: 2.1 time: 0.170769 Aug 24 11:03:37.830193 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3471/6581] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:37 2022] GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab => generated 1477 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:03:38.444636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-bfd308b1-d4f9-47fc-bf87-0dfadf2e13cb req-dbd82c76-9e96-419b-b6c3-d985257bb087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f38833d-7fcf-42ee-8f16-c51f4e28a1ab", "name": "network-vif-deleted", "tag": "39610f84-1318-4bbf-93f5-f0a7c17e356c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:03:38.456295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-bfd308b1-d4f9-47fc-bf87-0dfadf2e13cb req-dbd82c76-9e96-419b-b6c3-d985257bb087 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:38.456897 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-bfd308b1-d4f9-47fc-bf87-0dfadf2e13cb req-dbd82c76-9e96-419b-b6c3-d985257bb087 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:38.457513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-bfd308b1-d4f9-47fc-bf87-0dfadf2e13cb req-dbd82c76-9e96-419b-b6c3-d985257bb087 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:38.469758 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-bfd308b1-d4f9-47fc-bf87-0dfadf2e13cb req-dbd82c76-9e96-419b-b6c3-d985257bb087 service nova] Creating event network-vif-deleted:39610f84-1318-4bbf-93f5-f0a7c17e356c for instance 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab on n-h1-849328-3 Aug 24 11:03:38.475218 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-bfd308b1-d4f9-47fc-bf87-0dfadf2e13cb req-dbd82c76-9e96-419b-b6c3-d985257bb087 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110102 Aug 24 11:03:38.475839 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3111/6582] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:03:38.858264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-99df9815-f8ed-4561-8fba-2cf2a7c3e731 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:38.858926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-99df9815-f8ed-4561-8fba-2cf2a7c3e731 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] [instance: 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:38.866827 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99df9815-f8ed-4561-8fba-2cf2a7c3e731 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:38.867346 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99df9815-f8ed-4561-8fba-2cf2a7c3e731 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:38.867802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99df9815-f8ed-4561-8fba-2cf2a7c3e731 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:38.868531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99df9815-f8ed-4561-8fba-2cf2a7c3e731 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:38.869257 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99df9815-f8ed-4561-8fba-2cf2a7c3e731 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:38.869747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99df9815-f8ed-4561-8fba-2cf2a7c3e731 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:38.908567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99df9815-f8ed-4561-8fba-2cf2a7c3e731 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:38.910087 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99df9815-f8ed-4561-8fba-2cf2a7c3e731 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:38.910591 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99df9815-f8ed-4561-8fba-2cf2a7c3e731 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:38.911126 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-99df9815-f8ed-4561-8fba-2cf2a7c3e731 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lazy-loading 'fault' on Instance uuid 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:03:38.959448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-99df9815-f8ed-4561-8fba-2cf2a7c3e731 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae0b5958c3c47a98677ec6debb4201f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f75f7d314b94af99cc354b07c8bef66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:38.968366 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-99df9815-f8ed-4561-8fba-2cf2a7c3e731 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] 10.222.0.85 "GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab" status: 200 len: 1311 microversion: 2.1 time: 0.114535 Aug 24 11:03:38.968971 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3472/6583] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:38 2022] GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab => generated 1311 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:03:39.990681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2396fde1-0b49-4861-8485-bfe7fd23b1b3 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:39.991356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2396fde1-0b49-4861-8485-bfe7fd23b1b3 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] [instance: 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:39.998968 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2396fde1-0b49-4861-8485-bfe7fd23b1b3 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:39.999448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2396fde1-0b49-4861-8485-bfe7fd23b1b3 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:39.999885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2396fde1-0b49-4861-8485-bfe7fd23b1b3 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:40.000579 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2396fde1-0b49-4861-8485-bfe7fd23b1b3 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:40.001027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2396fde1-0b49-4861-8485-bfe7fd23b1b3 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:40.001474 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2396fde1-0b49-4861-8485-bfe7fd23b1b3 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:40.015080 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-2396fde1-0b49-4861-8485-bfe7fd23b1b3 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] HTTP exception thrown: Instance 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab could not be found. Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2396fde1-0b49-4861-8485-bfe7fd23b1b3 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Request method failure captured: Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab HTTP/1.1 Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgV76Pa3xlGPDMAhiFH5roChpvUJ_-ZmfI_yBTV1my8iBHiYzFRfUP0zEnrPj372A3YJNX5rMWoEBJA1SoVm75bv9fFdDps0vSCjGBLs-36tDV3ZxTS3-UcK-2fP5Z3NkWDLeWZXDlHXaPu_JabQI8Jf6mjJZ8nHkRW6IYi28kK6Rmo Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 7f75f7d314b94af99cc354b07c8bef66 Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1136674881 Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/7f75f7d314b94af99cc354b07c8bef66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_7f75f7d314b94af99cc354b07c8bef66", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/7f75f7d314b94af99cc354b07c8bef66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/7f75f7d314b94af99cc354b07c8bef66"}]}] Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1136674881 Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 7f75f7d314b94af99cc354b07c8bef66 Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1136674881 Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersAdminNegativeTestJSON-1136674881-project Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 3ae0b5958c3c47a98677ec6debb4201f Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1136674881-project Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab could not be found. Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '3f38833d-7fcf-42ee-8f16-c51f4e28a1ab'} Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab could not be found. Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab could not be found. Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:03:40.016691 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:03:40.022070 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:03:40.022070 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:03:40.022070 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:03:40.022070 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:03:40.022070 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:03:40.022070 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:03:40.022070 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab could not be found. Aug 24 11:03:40.022070 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:03:40.022070 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2396fde1-0b49-4861-8485-bfe7fd23b1b3 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] Returning 404 to user: Instance 3f38833d-7fcf-42ee-8f16-c51f4e28a1ab could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:03:40.022070 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2396fde1-0b49-4861-8485-bfe7fd23b1b3 tempest-ServersAdminNegativeTestJSON-1136674881 tempest-ServersAdminNegativeTestJSON-1136674881-project] 10.222.0.85 "GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab" status: 404 len: 111 microversion: 2.1 time: 0.031811 Aug 24 11:03:40.022070 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3112/6584] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:39 2022] GET /compute/v2.1/servers/3f38833d-7fcf-42ee-8f16-c51f4e28a1ab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:03:46.360640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:03:46.362115 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:03:46.490480 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ffd6e0ef-4251-4d9c-9e94-b3e665918bff tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-65537590", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "4dbf9d75-d880-4bf4-8427-629e6a44c844"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:03:46.545959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-ffd6e0ef-4251-4d9c-9e94-b3e665918bff tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] validate_networks() for [('4dbf9d75-d880-4bf4-8427-629e6a44c844', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:03:46.968294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ffd6e0ef-4251-4d9c-9e94-b3e665918bff tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:03:46.968769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ffd6e0ef-4251-4d9c-9e94-b3e665918bff tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:03:46.969314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ffd6e0ef-4251-4d9c-9e94-b3e665918bff tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:03:46.969742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ffd6e0ef-4251-4d9c-9e94-b3e665918bff tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:03:46.970172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ffd6e0ef-4251-4d9c-9e94-b3e665918bff tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:03:46.980702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffd6e0ef-4251-4d9c-9e94-b3e665918bff tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:46.981243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffd6e0ef-4251-4d9c-9e94-b3e665918bff tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:46.981694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffd6e0ef-4251-4d9c-9e94-b3e665918bff tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:46.982430 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffd6e0ef-4251-4d9c-9e94-b3e665918bff tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:46.982899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffd6e0ef-4251-4d9c-9e94-b3e665918bff tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:46.983340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffd6e0ef-4251-4d9c-9e94-b3e665918bff tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:47.001067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-ffd6e0ef-4251-4d9c-9e94-b3e665918bff tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Getting quotas for project fccbd798ad364ff28e349d31457e93e3. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:03:47.006696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-ffd6e0ef-4251-4d9c-9e94-b3e665918bff tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Getting quotas for user 0a5e4c3b743445a1b701e387ad949194 and project fccbd798ad364ff28e349d31457e93e3. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:03:47.020278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ffd6e0ef-4251-4d9c-9e94-b3e665918bff tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:03:47.023118 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ffd6e0ef-4251-4d9c-9e94-b3e665918bff tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:03:47.075819 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ffd6e0ef-4251-4d9c-9e94-b3e665918bff tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.720982 Aug 24 11:03:47.077084 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3473/6585] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 11:03:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:03:47.087915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bfa3c34b-520a-4139-8151-4bd0603c9ef3 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:47.088698 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bfa3c34b-520a-4139-8151-4bd0603c9ef3 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:47.092129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:03:47.092826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:03:47.163305 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bfa3c34b-520a-4139-8151-4bd0603c9ef3 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:47.170795 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bfa3c34b-520a-4139-8151-4bd0603c9ef3 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1213 microversion: 2.1 time: 0.086903 Aug 24 11:03:47.172787 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3113/6586] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:47 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:03:48.192593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5db0e102-2090-418e-8570-1f6afb1d3658 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:48.194150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5db0e102-2090-418e-8570-1f6afb1d3658 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:48.203596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5db0e102-2090-418e-8570-1f6afb1d3658 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:48.204575 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5db0e102-2090-418e-8570-1f6afb1d3658 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:48.205239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5db0e102-2090-418e-8570-1f6afb1d3658 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:48.206146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5db0e102-2090-418e-8570-1f6afb1d3658 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:48.206793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5db0e102-2090-418e-8570-1f6afb1d3658 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:48.207409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5db0e102-2090-418e-8570-1f6afb1d3658 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:48.295786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5db0e102-2090-418e-8570-1f6afb1d3658 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:48.307345 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5db0e102-2090-418e-8570-1f6afb1d3658 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1273 microversion: 2.1 time: 0.118831 Aug 24 11:03:48.308472 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3474/6587] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:48 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1273 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:03:49.329147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a00461ce-b274-4230-9dca-694726327e96 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:49.329784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a00461ce-b274-4230-9dca-694726327e96 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:49.337821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a00461ce-b274-4230-9dca-694726327e96 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:49.338397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a00461ce-b274-4230-9dca-694726327e96 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:49.338910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a00461ce-b274-4230-9dca-694726327e96 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:49.339687 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a00461ce-b274-4230-9dca-694726327e96 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:49.340199 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a00461ce-b274-4230-9dca-694726327e96 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:49.340644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a00461ce-b274-4230-9dca-694726327e96 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:49.912406 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a00461ce-b274-4230-9dca-694726327e96 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:49.921554 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a00461ce-b274-4230-9dca-694726327e96 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1313 microversion: 2.1 time: 0.596004 Aug 24 11:03:49.922359 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3114/6588] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:49 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1313 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:03:50.006042 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-2c4e1736-f5e9-48d6-8383-fcd8149737db req-0d1fc5bf-94ca-4ac6-baeb-ecdd90587915 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b914f01e-8fbd-4ef9-9c2f-e99fdd006548", "tag": "a1f34ebb-c2eb-47bd-bf18-dff5a3aacf8b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:03:50.024552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2c4e1736-f5e9-48d6-8383-fcd8149737db req-0d1fc5bf-94ca-4ac6-baeb-ecdd90587915 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:50.025563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2c4e1736-f5e9-48d6-8383-fcd8149737db req-0d1fc5bf-94ca-4ac6-baeb-ecdd90587915 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:50.026237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2c4e1736-f5e9-48d6-8383-fcd8149737db req-0d1fc5bf-94ca-4ac6-baeb-ecdd90587915 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:50.039067 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-2c4e1736-f5e9-48d6-8383-fcd8149737db req-0d1fc5bf-94ca-4ac6-baeb-ecdd90587915 service nova] Creating event network-changed:a1f34ebb-c2eb-47bd-bf18-dff5a3aacf8b for instance b914f01e-8fbd-4ef9-9c2f-e99fdd006548 on n-h1-849328-3 Aug 24 11:03:50.044800 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-2c4e1736-f5e9-48d6-8383-fcd8149737db req-0d1fc5bf-94ca-4ac6-baeb-ecdd90587915 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042925 Aug 24 11:03:50.045700 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3475/6589] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:03:50.947102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7e52d8d1-5fde-4fa2-b2b1-1307ab6f0a14 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:50.948116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7e52d8d1-5fde-4fa2-b2b1-1307ab6f0a14 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:50.959831 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e52d8d1-5fde-4fa2-b2b1-1307ab6f0a14 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:50.960637 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e52d8d1-5fde-4fa2-b2b1-1307ab6f0a14 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:50.961417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e52d8d1-5fde-4fa2-b2b1-1307ab6f0a14 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:50.962568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e52d8d1-5fde-4fa2-b2b1-1307ab6f0a14 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:50.963321 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e52d8d1-5fde-4fa2-b2b1-1307ab6f0a14 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:50.964123 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e52d8d1-5fde-4fa2-b2b1-1307ab6f0a14 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:51.107925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7e52d8d1-5fde-4fa2-b2b1-1307ab6f0a14 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:51.115815 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7e52d8d1-5fde-4fa2-b2b1-1307ab6f0a14 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1313 microversion: 2.1 time: 0.175305 Aug 24 11:03:51.116656 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3115/6590] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:50 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:03:52.138724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cae907d6-17f8-4d3d-a4f9-529ddda2b535 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:52.139330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cae907d6-17f8-4d3d-a4f9-529ddda2b535 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:52.146043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cae907d6-17f8-4d3d-a4f9-529ddda2b535 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:52.146537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cae907d6-17f8-4d3d-a4f9-529ddda2b535 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:52.146981 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cae907d6-17f8-4d3d-a4f9-529ddda2b535 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:52.147696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cae907d6-17f8-4d3d-a4f9-529ddda2b535 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:52.148181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cae907d6-17f8-4d3d-a4f9-529ddda2b535 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:52.148622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cae907d6-17f8-4d3d-a4f9-529ddda2b535 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:52.315261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cae907d6-17f8-4d3d-a4f9-529ddda2b535 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:52.327056 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cae907d6-17f8-4d3d-a4f9-529ddda2b535 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1313 microversion: 2.1 time: 0.193584 Aug 24 11:03:52.327917 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3476/6591] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:52 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:03:53.354108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-76e2ed3d-d59d-4d1b-87b6-f526fd783a31 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:53.354814 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-76e2ed3d-d59d-4d1b-87b6-f526fd783a31 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:53.361858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76e2ed3d-d59d-4d1b-87b6-f526fd783a31 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:53.362347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76e2ed3d-d59d-4d1b-87b6-f526fd783a31 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:53.362780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76e2ed3d-d59d-4d1b-87b6-f526fd783a31 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:53.363472 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76e2ed3d-d59d-4d1b-87b6-f526fd783a31 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:53.363928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76e2ed3d-d59d-4d1b-87b6-f526fd783a31 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:53.364352 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76e2ed3d-d59d-4d1b-87b6-f526fd783a31 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:53.506117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-76e2ed3d-d59d-4d1b-87b6-f526fd783a31 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:53.514825 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-76e2ed3d-d59d-4d1b-87b6-f526fd783a31 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1313 microversion: 2.1 time: 0.167252 Aug 24 11:03:53.515408 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3116/6592] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:53 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:03:54.535506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cc472635-808c-46d5-95b0-ae64af8420bd tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:54.536135 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cc472635-808c-46d5-95b0-ae64af8420bd tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:54.543218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc472635-808c-46d5-95b0-ae64af8420bd tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:54.543724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc472635-808c-46d5-95b0-ae64af8420bd tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:54.544175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc472635-808c-46d5-95b0-ae64af8420bd tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:54.544884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc472635-808c-46d5-95b0-ae64af8420bd tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:54.545397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc472635-808c-46d5-95b0-ae64af8420bd tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:54.545844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc472635-808c-46d5-95b0-ae64af8420bd tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:54.681782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cc472635-808c-46d5-95b0-ae64af8420bd tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:54.690167 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cc472635-808c-46d5-95b0-ae64af8420bd tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1313 microversion: 2.1 time: 0.158897 Aug 24 11:03:54.690775 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3477/6593] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:54 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:03:55.166067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-1af2f282-430b-45fd-a90a-390f2a0dc985 req-9b14b059-376b-43c6-a5fb-997665450335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b914f01e-8fbd-4ef9-9c2f-e99fdd006548", "name": "network-vif-plugged", "status": "completed", "tag": "a1f34ebb-c2eb-47bd-bf18-dff5a3aacf8b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:03:55.171130 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:03:55.178008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1af2f282-430b-45fd-a90a-390f2a0dc985 req-9b14b059-376b-43c6-a5fb-997665450335 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:55.178504 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1af2f282-430b-45fd-a90a-390f2a0dc985 req-9b14b059-376b-43c6-a5fb-997665450335 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:55.178916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1af2f282-430b-45fd-a90a-390f2a0dc985 req-9b14b059-376b-43c6-a5fb-997665450335 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:55.182180 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=72 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:03:55.193169 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-1af2f282-430b-45fd-a90a-390f2a0dc985 req-9b14b059-376b-43c6-a5fb-997665450335 service nova] Creating event network-vif-plugged:a1f34ebb-c2eb-47bd-bf18-dff5a3aacf8b for instance b914f01e-8fbd-4ef9-9c2f-e99fdd006548 on n-h1-849328-3 Aug 24 11:03:55.198407 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-1af2f282-430b-45fd-a90a-390f2a0dc985 req-9b14b059-376b-43c6-a5fb-997665450335 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107826 Aug 24 11:03:55.199014 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3117/6594] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:03:55.714849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9de9c06d-5438-448f-a4c0-55cce5e61ffa tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:55.715543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9de9c06d-5438-448f-a4c0-55cce5e61ffa tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:55.719345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:03:55.728160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9de9c06d-5438-448f-a4c0-55cce5e61ffa tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:55.728968 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9de9c06d-5438-448f-a4c0-55cce5e61ffa tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:55.729612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9de9c06d-5438-448f-a4c0-55cce5e61ffa tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:55.730898 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9de9c06d-5438-448f-a4c0-55cce5e61ffa tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:55.731381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9de9c06d-5438-448f-a4c0-55cce5e61ffa tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:55.731827 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9de9c06d-5438-448f-a4c0-55cce5e61ffa tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:55.735309 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:03:55.873219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9de9c06d-5438-448f-a4c0-55cce5e61ffa tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:55.881315 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9de9c06d-5438-448f-a4c0-55cce5e61ffa tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1313 microversion: 2.1 time: 0.172965 Aug 24 11:03:55.881913 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3478/6595] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:55 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:03:56.906898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6882e6ff-cba2-4f85-ad93-d72e6da1d896 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:56.907681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6882e6ff-cba2-4f85-ad93-d72e6da1d896 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:56.916022 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6882e6ff-cba2-4f85-ad93-d72e6da1d896 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:56.916551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6882e6ff-cba2-4f85-ad93-d72e6da1d896 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:56.917054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6882e6ff-cba2-4f85-ad93-d72e6da1d896 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:56.917845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6882e6ff-cba2-4f85-ad93-d72e6da1d896 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:56.918375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6882e6ff-cba2-4f85-ad93-d72e6da1d896 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:56.918842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6882e6ff-cba2-4f85-ad93-d72e6da1d896 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:57.054939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6882e6ff-cba2-4f85-ad93-d72e6da1d896 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:57.063496 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6882e6ff-cba2-4f85-ad93-d72e6da1d896 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1501 microversion: 2.1 time: 0.163259 Aug 24 11:03:57.064082 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3118/6596] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:56 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1501 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:03:57.084762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ff14ecb-c84c-4b28-9317-3d13d16ac350 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:03:57.087216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3ff14ecb-c84c-4b28-9317-3d13d16ac350 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:57.090169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:03:57.090884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:03:57.097659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ff14ecb-c84c-4b28-9317-3d13d16ac350 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:57.098500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ff14ecb-c84c-4b28-9317-3d13d16ac350 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:57.098953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ff14ecb-c84c-4b28-9317-3d13d16ac350 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:57.099677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ff14ecb-c84c-4b28-9317-3d13d16ac350 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:57.100149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ff14ecb-c84c-4b28-9317-3d13d16ac350 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:57.100589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ff14ecb-c84c-4b28-9317-3d13d16ac350 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:57.129400 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3ff14ecb-c84c-4b28-9317-3d13d16ac350 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:57.135701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3ff14ecb-c84c-4b28-9317-3d13d16ac350 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Old instance type m1.heat2, new instance type m1.heat {{(pid=122433) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 11:03:57.142545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-3ff14ecb-c84c-4b28-9317-3d13d16ac350 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:03:57.142979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-3ff14ecb-c84c-4b28-9317-3d13d16ac350 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:03:57.143466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-3ff14ecb-c84c-4b28-9317-3d13d16ac350 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:03:57.143922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-3ff14ecb-c84c-4b28-9317-3d13d16ac350 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:03:57.144698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-3ff14ecb-c84c-4b28-9317-3d13d16ac350 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:03:57.217928 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ff14ecb-c84c-4b28-9317-3d13d16ac350 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "POST /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548/action" status: 202 len: 0 microversion: 2.1 time: 0.137333 Aug 24 11:03:57.218567 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3479/6597] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:03:57 2022] POST /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:03:57.227088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f72943bb-3a0c-4662-b772-2f3ef27c2cbb tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:57.227701 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f72943bb-3a0c-4662-b772-2f3ef27c2cbb tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:57.229805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:03:57.235432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f72943bb-3a0c-4662-b772-2f3ef27c2cbb tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:57.235999 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f72943bb-3a0c-4662-b772-2f3ef27c2cbb tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:57.236517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f72943bb-3a0c-4662-b772-2f3ef27c2cbb tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:57.237270 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f72943bb-3a0c-4662-b772-2f3ef27c2cbb tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:57.237721 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f72943bb-3a0c-4662-b772-2f3ef27c2cbb tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:57.238145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f72943bb-3a0c-4662-b772-2f3ef27c2cbb tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:57.377996 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f72943bb-3a0c-4662-b772-2f3ef27c2cbb tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:57.386167 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f72943bb-3a0c-4662-b772-2f3ef27c2cbb tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1510 microversion: 2.1 time: 0.163276 Aug 24 11:03:57.386748 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3119/6598] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:57 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:03:58.409344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3e209066-f57f-4f9d-b201-7f64021db294 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:58.409983 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3e209066-f57f-4f9d-b201-7f64021db294 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:58.416668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e209066-f57f-4f9d-b201-7f64021db294 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:58.417152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e209066-f57f-4f9d-b201-7f64021db294 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:58.417608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e209066-f57f-4f9d-b201-7f64021db294 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:58.418350 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e209066-f57f-4f9d-b201-7f64021db294 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:58.418835 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e209066-f57f-4f9d-b201-7f64021db294 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:58.419247 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e209066-f57f-4f9d-b201-7f64021db294 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:58.559544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3e209066-f57f-4f9d-b201-7f64021db294 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:58.569532 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3e209066-f57f-4f9d-b201-7f64021db294 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1510 microversion: 2.1 time: 0.164895 Aug 24 11:03:58.570144 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3480/6599] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:58 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:03:59.595734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6f951bc5-4b35-438c-8e98-dde51f0aad7c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:03:59.596586 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6f951bc5-4b35-438c-8e98-dde51f0aad7c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:03:59.608970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f951bc5-4b35-438c-8e98-dde51f0aad7c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:59.609691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f951bc5-4b35-438c-8e98-dde51f0aad7c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:59.610677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f951bc5-4b35-438c-8e98-dde51f0aad7c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:59.611273 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f951bc5-4b35-438c-8e98-dde51f0aad7c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:03:59.611671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f951bc5-4b35-438c-8e98-dde51f0aad7c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:03:59.612109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f951bc5-4b35-438c-8e98-dde51f0aad7c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:03:59.753997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6f951bc5-4b35-438c-8e98-dde51f0aad7c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:03:59.766079 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6f951bc5-4b35-438c-8e98-dde51f0aad7c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1515 microversion: 2.1 time: 0.177486 Aug 24 11:03:59.766929 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3120/6600] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:03:59 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:00.791927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bd405a48-544c-4694-aefc-e75649de217b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:00.792959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bd405a48-544c-4694-aefc-e75649de217b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:00.804738 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd405a48-544c-4694-aefc-e75649de217b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:00.805610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd405a48-544c-4694-aefc-e75649de217b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:00.806358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd405a48-544c-4694-aefc-e75649de217b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:00.807528 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd405a48-544c-4694-aefc-e75649de217b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:00.808297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd405a48-544c-4694-aefc-e75649de217b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:00.809021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd405a48-544c-4694-aefc-e75649de217b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:00.947036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bd405a48-544c-4694-aefc-e75649de217b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:00.960131 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bd405a48-544c-4694-aefc-e75649de217b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1515 microversion: 2.1 time: 0.174674 Aug 24 11:04:00.961081 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3481/6601] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:00 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:01.986256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-398d54d5-125c-4169-9036-680d41f60f91 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:01.986904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-398d54d5-125c-4169-9036-680d41f60f91 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:01.994916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-398d54d5-125c-4169-9036-680d41f60f91 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:01.995434 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-398d54d5-125c-4169-9036-680d41f60f91 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:01.995894 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-398d54d5-125c-4169-9036-680d41f60f91 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:01.996629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-398d54d5-125c-4169-9036-680d41f60f91 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:01.997103 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-398d54d5-125c-4169-9036-680d41f60f91 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:01.997585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-398d54d5-125c-4169-9036-680d41f60f91 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:02.144224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-398d54d5-125c-4169-9036-680d41f60f91 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:02.152391 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-398d54d5-125c-4169-9036-680d41f60f91 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1515 microversion: 2.1 time: 0.172389 Aug 24 11:04:02.152963 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3121/6602] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:01 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:03.177154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5dccabe0-64d2-4d1f-99e7-6e525adb240c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:03.177943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5dccabe0-64d2-4d1f-99e7-6e525adb240c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:03.185728 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dccabe0-64d2-4d1f-99e7-6e525adb240c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:03.186179 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dccabe0-64d2-4d1f-99e7-6e525adb240c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:03.186815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dccabe0-64d2-4d1f-99e7-6e525adb240c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:03.187638 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dccabe0-64d2-4d1f-99e7-6e525adb240c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:03.188112 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dccabe0-64d2-4d1f-99e7-6e525adb240c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:03.188713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dccabe0-64d2-4d1f-99e7-6e525adb240c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:03.330952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5dccabe0-64d2-4d1f-99e7-6e525adb240c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:03.339569 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5dccabe0-64d2-4d1f-99e7-6e525adb240c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1515 microversion: 2.1 time: 0.168907 Aug 24 11:04:03.340216 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3482/6603] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:03 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:04.372910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2a333c78-e89f-4c3a-b73e-4ac723030f1c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:04.374007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2a333c78-e89f-4c3a-b73e-4ac723030f1c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:04.382728 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a333c78-e89f-4c3a-b73e-4ac723030f1c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:04.383216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a333c78-e89f-4c3a-b73e-4ac723030f1c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:04.383645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a333c78-e89f-4c3a-b73e-4ac723030f1c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:04.384335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a333c78-e89f-4c3a-b73e-4ac723030f1c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:04.384796 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a333c78-e89f-4c3a-b73e-4ac723030f1c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:04.385233 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a333c78-e89f-4c3a-b73e-4ac723030f1c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:04.526784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2a333c78-e89f-4c3a-b73e-4ac723030f1c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:04.534837 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2a333c78-e89f-4c3a-b73e-4ac723030f1c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1515 microversion: 2.1 time: 0.168646 Aug 24 11:04:04.535429 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3122/6604] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:04 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:05.559416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-46412e61-12c7-4c29-b5af-7af2aa3c23ff tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:05.560334 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-46412e61-12c7-4c29-b5af-7af2aa3c23ff tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:05.571227 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46412e61-12c7-4c29-b5af-7af2aa3c23ff tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:05.571994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46412e61-12c7-4c29-b5af-7af2aa3c23ff tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:05.572676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46412e61-12c7-4c29-b5af-7af2aa3c23ff tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:05.573771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46412e61-12c7-4c29-b5af-7af2aa3c23ff tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:05.574529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46412e61-12c7-4c29-b5af-7af2aa3c23ff tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:05.575209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46412e61-12c7-4c29-b5af-7af2aa3c23ff tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:05.714480 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-46412e61-12c7-4c29-b5af-7af2aa3c23ff tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:05.727283 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-46412e61-12c7-4c29-b5af-7af2aa3c23ff tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1515 microversion: 2.1 time: 0.173646 Aug 24 11:04:05.728121 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3483/6605] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:05 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:06.755162 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e2bdb6fb-886e-400a-8c10-8bad5b65d644 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:06.755885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e2bdb6fb-886e-400a-8c10-8bad5b65d644 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:06.764681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2bdb6fb-886e-400a-8c10-8bad5b65d644 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:06.765177 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2bdb6fb-886e-400a-8c10-8bad5b65d644 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:06.765767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2bdb6fb-886e-400a-8c10-8bad5b65d644 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:06.766608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2bdb6fb-886e-400a-8c10-8bad5b65d644 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:06.767135 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2bdb6fb-886e-400a-8c10-8bad5b65d644 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:06.767625 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2bdb6fb-886e-400a-8c10-8bad5b65d644 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:06.904593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e2bdb6fb-886e-400a-8c10-8bad5b65d644 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:06.913341 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e2bdb6fb-886e-400a-8c10-8bad5b65d644 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1515 microversion: 2.1 time: 0.163886 Aug 24 11:04:06.913935 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3123/6606] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:06 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:07.939111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec343e7b-1b24-4a78-b0a4-5f572585d76c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:07.940167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ec343e7b-1b24-4a78-b0a4-5f572585d76c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:07.952117 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec343e7b-1b24-4a78-b0a4-5f572585d76c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:07.952956 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec343e7b-1b24-4a78-b0a4-5f572585d76c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:07.953767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec343e7b-1b24-4a78-b0a4-5f572585d76c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:07.954941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec343e7b-1b24-4a78-b0a4-5f572585d76c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:07.955722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec343e7b-1b24-4a78-b0a4-5f572585d76c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:07.956452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec343e7b-1b24-4a78-b0a4-5f572585d76c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:08.090056 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ec343e7b-1b24-4a78-b0a4-5f572585d76c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:08.099288 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ec343e7b-1b24-4a78-b0a4-5f572585d76c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1515 microversion: 2.1 time: 0.166810 Aug 24 11:04:08.099926 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3484/6607] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:07 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:09.121437 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-479b3ba2-09f5-4acf-a255-1fd041186ce0 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:09.122057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-479b3ba2-09f5-4acf-a255-1fd041186ce0 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:09.130505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-479b3ba2-09f5-4acf-a255-1fd041186ce0 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:09.130981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-479b3ba2-09f5-4acf-a255-1fd041186ce0 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:09.131416 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-479b3ba2-09f5-4acf-a255-1fd041186ce0 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:09.132116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-479b3ba2-09f5-4acf-a255-1fd041186ce0 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:09.132569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-479b3ba2-09f5-4acf-a255-1fd041186ce0 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:09.132988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-479b3ba2-09f5-4acf-a255-1fd041186ce0 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:09.276399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-479b3ba2-09f5-4acf-a255-1fd041186ce0 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:09.284801 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-479b3ba2-09f5-4acf-a255-1fd041186ce0 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1515 microversion: 2.1 time: 0.167769 Aug 24 11:04:09.285338 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3124/6608] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:09 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:10.308540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b118b002-b140-4b50-b7b6-46f10085d010 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:10.309227 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b118b002-b140-4b50-b7b6-46f10085d010 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:10.319421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b118b002-b140-4b50-b7b6-46f10085d010 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:10.319927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b118b002-b140-4b50-b7b6-46f10085d010 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:10.320382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b118b002-b140-4b50-b7b6-46f10085d010 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:10.321091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b118b002-b140-4b50-b7b6-46f10085d010 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:10.321592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b118b002-b140-4b50-b7b6-46f10085d010 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:10.322037 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b118b002-b140-4b50-b7b6-46f10085d010 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:10.464214 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b118b002-b140-4b50-b7b6-46f10085d010 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:10.474933 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b118b002-b140-4b50-b7b6-46f10085d010 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1515 microversion: 2.1 time: 0.172572 Aug 24 11:04:10.475530 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3485/6609] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:10 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:11.496506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5982a89f-8512-479c-9e92-eb13cb486d1b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:11.497142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5982a89f-8512-479c-9e92-eb13cb486d1b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:11.504463 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5982a89f-8512-479c-9e92-eb13cb486d1b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:11.504929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5982a89f-8512-479c-9e92-eb13cb486d1b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:11.505424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5982a89f-8512-479c-9e92-eb13cb486d1b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:11.506160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5982a89f-8512-479c-9e92-eb13cb486d1b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:11.506616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5982a89f-8512-479c-9e92-eb13cb486d1b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:11.507038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5982a89f-8512-479c-9e92-eb13cb486d1b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:11.656447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5982a89f-8512-479c-9e92-eb13cb486d1b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:11.668451 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5982a89f-8512-479c-9e92-eb13cb486d1b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1515 microversion: 2.1 time: 0.175793 Aug 24 11:04:11.669292 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3125/6610] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:11 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:12.695240 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4a3ff1c4-4ae6-499a-8b86-8e34779ebae3 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:12.695863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4a3ff1c4-4ae6-499a-8b86-8e34779ebae3 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:12.703023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a3ff1c4-4ae6-499a-8b86-8e34779ebae3 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:12.703532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a3ff1c4-4ae6-499a-8b86-8e34779ebae3 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:12.703973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a3ff1c4-4ae6-499a-8b86-8e34779ebae3 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:12.704675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a3ff1c4-4ae6-499a-8b86-8e34779ebae3 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:12.705148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a3ff1c4-4ae6-499a-8b86-8e34779ebae3 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:12.705606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a3ff1c4-4ae6-499a-8b86-8e34779ebae3 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:12.838115 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4a3ff1c4-4ae6-499a-8b86-8e34779ebae3 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:12.846547 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4a3ff1c4-4ae6-499a-8b86-8e34779ebae3 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1515 microversion: 2.1 time: 0.156994 Aug 24 11:04:12.847116 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3486/6611] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:12 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:13.868529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2efeed41-4247-4c06-9d66-50eb35a3fcf4 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:13.869041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2efeed41-4247-4c06-9d66-50eb35a3fcf4 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:13.876330 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2efeed41-4247-4c06-9d66-50eb35a3fcf4 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:13.876822 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2efeed41-4247-4c06-9d66-50eb35a3fcf4 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:13.877314 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2efeed41-4247-4c06-9d66-50eb35a3fcf4 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:13.878010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2efeed41-4247-4c06-9d66-50eb35a3fcf4 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:13.878464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2efeed41-4247-4c06-9d66-50eb35a3fcf4 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:13.878889 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2efeed41-4247-4c06-9d66-50eb35a3fcf4 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:14.024039 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2efeed41-4247-4c06-9d66-50eb35a3fcf4 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:14.035968 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2efeed41-4247-4c06-9d66-50eb35a3fcf4 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1515 microversion: 2.1 time: 0.171325 Aug 24 11:04:14.036702 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3126/6612] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:13 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:15.062246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-64736562-04c3-4102-a6b1-f1d97057a5a3 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:15.063290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-64736562-04c3-4102-a6b1-f1d97057a5a3 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:15.072776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64736562-04c3-4102-a6b1-f1d97057a5a3 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:15.073314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64736562-04c3-4102-a6b1-f1d97057a5a3 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:15.073768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64736562-04c3-4102-a6b1-f1d97057a5a3 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:15.074444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64736562-04c3-4102-a6b1-f1d97057a5a3 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:15.074951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64736562-04c3-4102-a6b1-f1d97057a5a3 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:15.075390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64736562-04c3-4102-a6b1-f1d97057a5a3 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:15.216692 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-64736562-04c3-4102-a6b1-f1d97057a5a3 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:15.225282 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-64736562-04c3-4102-a6b1-f1d97057a5a3 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1515 microversion: 2.1 time: 0.169695 Aug 24 11:04:15.225874 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3487/6613] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:15 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:16.247660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f904a040-9c45-4510-9d4b-5c65973a0843 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:16.248512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f904a040-9c45-4510-9d4b-5c65973a0843 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:16.256694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f904a040-9c45-4510-9d4b-5c65973a0843 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:16.257203 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f904a040-9c45-4510-9d4b-5c65973a0843 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:16.257641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f904a040-9c45-4510-9d4b-5c65973a0843 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:16.258325 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f904a040-9c45-4510-9d4b-5c65973a0843 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:16.258771 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f904a040-9c45-4510-9d4b-5c65973a0843 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:16.259190 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f904a040-9c45-4510-9d4b-5c65973a0843 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:16.394371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f904a040-9c45-4510-9d4b-5c65973a0843 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:16.406206 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f904a040-9c45-4510-9d4b-5c65973a0843 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1515 microversion: 2.1 time: 0.162804 Aug 24 11:04:16.407008 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3127/6614] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:16 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:17.432779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-486ca6c3-da8b-4104-866a-d5d2b98b7aea tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:17.433779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-486ca6c3-da8b-4104-866a-d5d2b98b7aea tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:17.444503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-486ca6c3-da8b-4104-866a-d5d2b98b7aea tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:17.444992 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-486ca6c3-da8b-4104-866a-d5d2b98b7aea tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:17.445482 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-486ca6c3-da8b-4104-866a-d5d2b98b7aea tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:17.446193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-486ca6c3-da8b-4104-866a-d5d2b98b7aea tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:17.446653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-486ca6c3-da8b-4104-866a-d5d2b98b7aea tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:17.447095 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-486ca6c3-da8b-4104-866a-d5d2b98b7aea tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:17.591658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-486ca6c3-da8b-4104-866a-d5d2b98b7aea tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:17.600475 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-486ca6c3-da8b-4104-866a-d5d2b98b7aea tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1515 microversion: 2.1 time: 0.173797 Aug 24 11:04:17.601138 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3488/6615] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:17 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:18.622321 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-42207f2d-8c82-424e-82af-6d8c734f4be5 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:18.622930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-42207f2d-8c82-424e-82af-6d8c734f4be5 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:18.632808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42207f2d-8c82-424e-82af-6d8c734f4be5 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:18.633340 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42207f2d-8c82-424e-82af-6d8c734f4be5 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:18.633772 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42207f2d-8c82-424e-82af-6d8c734f4be5 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:18.634474 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42207f2d-8c82-424e-82af-6d8c734f4be5 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:18.635081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42207f2d-8c82-424e-82af-6d8c734f4be5 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:18.635783 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42207f2d-8c82-424e-82af-6d8c734f4be5 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:18.773240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-42207f2d-8c82-424e-82af-6d8c734f4be5 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:18.781881 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-42207f2d-8c82-424e-82af-6d8c734f4be5 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1515 microversion: 2.1 time: 0.163551 Aug 24 11:04:18.782465 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3128/6616] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:18 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:19.808010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-00362345-8a98-4825-a1da-f799a5bbac56 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:19.808602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-00362345-8a98-4825-a1da-f799a5bbac56 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:19.818868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00362345-8a98-4825-a1da-f799a5bbac56 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:19.819376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00362345-8a98-4825-a1da-f799a5bbac56 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:19.819826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00362345-8a98-4825-a1da-f799a5bbac56 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:19.820530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00362345-8a98-4825-a1da-f799a5bbac56 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:19.820999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00362345-8a98-4825-a1da-f799a5bbac56 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:19.821469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00362345-8a98-4825-a1da-f799a5bbac56 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:19.969996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-00362345-8a98-4825-a1da-f799a5bbac56 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:19.979008 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-00362345-8a98-4825-a1da-f799a5bbac56 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1515 microversion: 2.1 time: 0.177804 Aug 24 11:04:19.979598 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3489/6617] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:19 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:21.003877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-57d0f19d-9d99-4efa-9c49-fd8028eade1e tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:21.004841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-57d0f19d-9d99-4efa-9c49-fd8028eade1e tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:21.016081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57d0f19d-9d99-4efa-9c49-fd8028eade1e tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:21.016881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57d0f19d-9d99-4efa-9c49-fd8028eade1e tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:21.017653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57d0f19d-9d99-4efa-9c49-fd8028eade1e tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:21.018830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57d0f19d-9d99-4efa-9c49-fd8028eade1e tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:21.019584 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57d0f19d-9d99-4efa-9c49-fd8028eade1e tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:21.020310 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57d0f19d-9d99-4efa-9c49-fd8028eade1e tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:21.161756 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-57d0f19d-9d99-4efa-9c49-fd8028eade1e tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:21.170116 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-57d0f19d-9d99-4efa-9c49-fd8028eade1e tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1515 microversion: 2.1 time: 0.173106 Aug 24 11:04:21.170706 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3129/6618] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:20 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:22.195867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-62e09350-e289-4cd0-b125-b941894729be tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:22.196539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-62e09350-e289-4cd0-b125-b941894729be tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:22.203858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62e09350-e289-4cd0-b125-b941894729be tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:22.204355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62e09350-e289-4cd0-b125-b941894729be tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:22.204800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62e09350-e289-4cd0-b125-b941894729be tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:22.205523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62e09350-e289-4cd0-b125-b941894729be tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:22.205993 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62e09350-e289-4cd0-b125-b941894729be tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:22.206429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62e09350-e289-4cd0-b125-b941894729be tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:22.343781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-62e09350-e289-4cd0-b125-b941894729be tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:22.352395 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-62e09350-e289-4cd0-b125-b941894729be tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1515 microversion: 2.1 time: 0.162930 Aug 24 11:04:22.352986 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3490/6619] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:22 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:23.377938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-57b53ad3-a041-4f14-b972-6f12ec8f1d91 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:23.378800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-57b53ad3-a041-4f14-b972-6f12ec8f1d91 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:23.386792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57b53ad3-a041-4f14-b972-6f12ec8f1d91 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:23.387277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57b53ad3-a041-4f14-b972-6f12ec8f1d91 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:23.387710 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57b53ad3-a041-4f14-b972-6f12ec8f1d91 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:23.388408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57b53ad3-a041-4f14-b972-6f12ec8f1d91 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:23.388859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57b53ad3-a041-4f14-b972-6f12ec8f1d91 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:23.389330 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57b53ad3-a041-4f14-b972-6f12ec8f1d91 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:23.527036 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-57b53ad3-a041-4f14-b972-6f12ec8f1d91 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:23.534997 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-57b53ad3-a041-4f14-b972-6f12ec8f1d91 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1515 microversion: 2.1 time: 0.163992 Aug 24 11:04:23.535616 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3130/6620] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:23 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:24.559703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e97c12d3-256e-41e5-a510-2edd499a74c9 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:24.560336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e97c12d3-256e-41e5-a510-2edd499a74c9 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:24.571114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e97c12d3-256e-41e5-a510-2edd499a74c9 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:24.571622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e97c12d3-256e-41e5-a510-2edd499a74c9 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:24.572076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e97c12d3-256e-41e5-a510-2edd499a74c9 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:24.572781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e97c12d3-256e-41e5-a510-2edd499a74c9 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:24.573280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e97c12d3-256e-41e5-a510-2edd499a74c9 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:24.573720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e97c12d3-256e-41e5-a510-2edd499a74c9 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:24.718673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e97c12d3-256e-41e5-a510-2edd499a74c9 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:24.727647 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e97c12d3-256e-41e5-a510-2edd499a74c9 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1515 microversion: 2.1 time: 0.174572 Aug 24 11:04:24.728251 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3491/6621] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:24 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:25.749945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7603e548-392e-40a8-90d6-e9db0d3e40f6 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:25.750722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7603e548-392e-40a8-90d6-e9db0d3e40f6 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:25.760418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7603e548-392e-40a8-90d6-e9db0d3e40f6 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:25.761081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7603e548-392e-40a8-90d6-e9db0d3e40f6 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:25.761675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7603e548-392e-40a8-90d6-e9db0d3e40f6 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:25.762569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7603e548-392e-40a8-90d6-e9db0d3e40f6 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:25.763152 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7603e548-392e-40a8-90d6-e9db0d3e40f6 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:25.763706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7603e548-392e-40a8-90d6-e9db0d3e40f6 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:25.766999 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=80 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:04:25.929411 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7603e548-392e-40a8-90d6-e9db0d3e40f6 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:25.938040 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7603e548-392e-40a8-90d6-e9db0d3e40f6 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1515 microversion: 2.1 time: 0.193261 Aug 24 11:04:25.938629 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3131/6622] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:25 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1515 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:26.926145 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-df2562a3-b84d-4a8d-a1a7-ca7f3fd56d85 req-b00a7c81-7c49-4eb5-879b-a225a10d8e3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b914f01e-8fbd-4ef9-9c2f-e99fdd006548", "name": "network-vif-unplugged", "status": "completed", "tag": "a1f34ebb-c2eb-47bd-bf18-dff5a3aacf8b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:04:26.933598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=32 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:04:26.938871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-df2562a3-b84d-4a8d-a1a7-ca7f3fd56d85 req-b00a7c81-7c49-4eb5-879b-a225a10d8e3c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:26.939361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-df2562a3-b84d-4a8d-a1a7-ca7f3fd56d85 req-b00a7c81-7c49-4eb5-879b-a225a10d8e3c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:26.939801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-df2562a3-b84d-4a8d-a1a7-ca7f3fd56d85 req-b00a7c81-7c49-4eb5-879b-a225a10d8e3c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:26.943144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:04:26.955035 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-df2562a3-b84d-4a8d-a1a7-ca7f3fd56d85 req-b00a7c81-7c49-4eb5-879b-a225a10d8e3c service nova] Creating event network-vif-unplugged:a1f34ebb-c2eb-47bd-bf18-dff5a3aacf8b for instance b914f01e-8fbd-4ef9-9c2f-e99fdd006548 on n-h2-849328-3 Aug 24 11:04:26.959625 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5c220549-7be5-4bf9-929b-233a38d1456c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:26.960299 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5c220549-7be5-4bf9-929b-233a38d1456c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:26.961922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-df2562a3-b84d-4a8d-a1a7-ca7f3fd56d85 req-b00a7c81-7c49-4eb5-879b-a225a10d8e3c service nova] Instance b914f01e-8fbd-4ef9-9c2f-e99fdd006548 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 11:04:26.967666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=30 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:04:26.969955 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c220549-7be5-4bf9-929b-233a38d1456c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:26.970505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c220549-7be5-4bf9-929b-233a38d1456c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:26.971025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c220549-7be5-4bf9-929b-233a38d1456c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:26.971863 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c220549-7be5-4bf9-929b-233a38d1456c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:26.972339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c220549-7be5-4bf9-929b-233a38d1456c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:26.972744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c220549-7be5-4bf9-929b-233a38d1456c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:26.974612 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-df2562a3-b84d-4a8d-a1a7-ca7f3fd56d85 req-b00a7c81-7c49-4eb5-879b-a225a10d8e3c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052848 Aug 24 11:04:26.975584 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3492/6623] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:04:27.193695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5c220549-7be5-4bf9-929b-233a38d1456c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:27.203401 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5c220549-7be5-4bf9-929b-233a38d1456c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1514 microversion: 2.1 time: 0.247775 Aug 24 11:04:27.204204 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3132/6624] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:26 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1514 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:28.226807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2e421861-4055-448f-8515-736ef7f6f6d8 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:28.227543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2e421861-4055-448f-8515-736ef7f6f6d8 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:28.234742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e421861-4055-448f-8515-736ef7f6f6d8 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:28.235248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e421861-4055-448f-8515-736ef7f6f6d8 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:28.235729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e421861-4055-448f-8515-736ef7f6f6d8 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:28.236453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e421861-4055-448f-8515-736ef7f6f6d8 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:28.236923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e421861-4055-448f-8515-736ef7f6f6d8 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:28.237392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e421861-4055-448f-8515-736ef7f6f6d8 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:28.384469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2e421861-4055-448f-8515-736ef7f6f6d8 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:28.392808 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2e421861-4055-448f-8515-736ef7f6f6d8 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1512 microversion: 2.1 time: 0.171634 Aug 24 11:04:28.393445 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3493/6625] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:28 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:29.005259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-48dce1ab-0ee4-4909-a194-12e34c400e88 req-e7a1b4b3-68d2-42d9-bcf3-5c3adf1b1578 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b914f01e-8fbd-4ef9-9c2f-e99fdd006548", "tag": "a1f34ebb-c2eb-47bd-bf18-dff5a3aacf8b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:04:29.017289 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-48dce1ab-0ee4-4909-a194-12e34c400e88 req-e7a1b4b3-68d2-42d9-bcf3-5c3adf1b1578 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:29.017771 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-48dce1ab-0ee4-4909-a194-12e34c400e88 req-e7a1b4b3-68d2-42d9-bcf3-5c3adf1b1578 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:29.018206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-48dce1ab-0ee4-4909-a194-12e34c400e88 req-e7a1b4b3-68d2-42d9-bcf3-5c3adf1b1578 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:29.031948 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-48dce1ab-0ee4-4909-a194-12e34c400e88 req-e7a1b4b3-68d2-42d9-bcf3-5c3adf1b1578 service nova] Creating event network-changed:a1f34ebb-c2eb-47bd-bf18-dff5a3aacf8b for instance b914f01e-8fbd-4ef9-9c2f-e99fdd006548 on n-h2-849328-3 Aug 24 11:04:29.038005 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-48dce1ab-0ee4-4909-a194-12e34c400e88 req-e7a1b4b3-68d2-42d9-bcf3-5c3adf1b1578 service nova] Instance b914f01e-8fbd-4ef9-9c2f-e99fdd006548 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 11:04:29.051034 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-48dce1ab-0ee4-4909-a194-12e34c400e88 req-e7a1b4b3-68d2-42d9-bcf3-5c3adf1b1578 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050256 Aug 24 11:04:29.051951 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3133/6626] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:04:29.415439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-243f225e-1000-4e3e-a604-85c5f93bfa7c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:29.416179 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-243f225e-1000-4e3e-a604-85c5f93bfa7c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:29.424086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-243f225e-1000-4e3e-a604-85c5f93bfa7c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:29.424596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-243f225e-1000-4e3e-a604-85c5f93bfa7c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:29.425050 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-243f225e-1000-4e3e-a604-85c5f93bfa7c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:29.425810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-243f225e-1000-4e3e-a604-85c5f93bfa7c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:29.426270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-243f225e-1000-4e3e-a604-85c5f93bfa7c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:29.426706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-243f225e-1000-4e3e-a604-85c5f93bfa7c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:29.579947 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-243f225e-1000-4e3e-a604-85c5f93bfa7c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:29.593137 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-243f225e-1000-4e3e-a604-85c5f93bfa7c tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1512 microversion: 2.1 time: 0.182286 Aug 24 11:04:29.593779 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3494/6627] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:29 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1512 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:04:30.617476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-000ce4e6-39ef-437e-b479-123f091cceae tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:30.618197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-000ce4e6-39ef-437e-b479-123f091cceae tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:30.625037 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-000ce4e6-39ef-437e-b479-123f091cceae tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:30.625556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-000ce4e6-39ef-437e-b479-123f091cceae tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:30.625970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-000ce4e6-39ef-437e-b479-123f091cceae tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:30.626653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-000ce4e6-39ef-437e-b479-123f091cceae tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:30.627136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-000ce4e6-39ef-437e-b479-123f091cceae tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:30.627560 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-000ce4e6-39ef-437e-b479-123f091cceae tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:30.766426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-000ce4e6-39ef-437e-b479-123f091cceae tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:30.774873 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-000ce4e6-39ef-437e-b479-123f091cceae tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1509 microversion: 2.1 time: 0.162677 Aug 24 11:04:30.775440 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3134/6628] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:30 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:30.795637 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-338ecc55-74fd-4985-9642-8492530cba18 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:30.796180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-338ecc55-74fd-4985-9642-8492530cba18 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:30.803506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-338ecc55-74fd-4985-9642-8492530cba18 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:30.804005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-338ecc55-74fd-4985-9642-8492530cba18 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:30.804457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-338ecc55-74fd-4985-9642-8492530cba18 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:30.805149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-338ecc55-74fd-4985-9642-8492530cba18 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:30.805667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-338ecc55-74fd-4985-9642-8492530cba18 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:30.806103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-338ecc55-74fd-4985-9642-8492530cba18 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:30.832535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-338ecc55-74fd-4985-9642-8492530cba18 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:04:30.884384 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.compute.api [None req-338ecc55-74fd-4985-9642-8492530cba18 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Found an unconfirmed migration during delete, id: 16, status: finished Aug 24 11:04:32.357334 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-338ecc55-74fd-4985-9642-8492530cba18 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 204 len: 0 microversion: 2.1 time: 1.565233 Aug 24 11:04:32.358001 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3495/6629] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:04:30 2022] DELETE /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 0 bytes in 1567 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:04:32.366838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3f82387a-e4ee-410e-88e6-8fa4e5dde32d tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:32.367510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3f82387a-e4ee-410e-88e6-8fa4e5dde32d tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:32.375198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f82387a-e4ee-410e-88e6-8fa4e5dde32d tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:32.375694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f82387a-e4ee-410e-88e6-8fa4e5dde32d tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:32.376136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f82387a-e4ee-410e-88e6-8fa4e5dde32d tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:32.376844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f82387a-e4ee-410e-88e6-8fa4e5dde32d tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:32.377338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f82387a-e4ee-410e-88e6-8fa4e5dde32d tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:32.377765 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f82387a-e4ee-410e-88e6-8fa4e5dde32d tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:32.518828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3f82387a-e4ee-410e-88e6-8fa4e5dde32d tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:32.529008 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3f82387a-e4ee-410e-88e6-8fa4e5dde32d tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1501 microversion: 2.1 time: 0.166487 Aug 24 11:04:32.529784 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3135/6630] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:32 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1501 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:33.290498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a4592c0b-12fe-4597-8b4c-bc46da312892 req-f0748d28-cfe2-49fc-bec1-972209c3f42d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b914f01e-8fbd-4ef9-9c2f-e99fdd006548", "name": "network-vif-plugged", "status": "completed", "tag": "a1f34ebb-c2eb-47bd-bf18-dff5a3aacf8b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:04:33.302191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a4592c0b-12fe-4597-8b4c-bc46da312892 req-f0748d28-cfe2-49fc-bec1-972209c3f42d service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:33.302719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a4592c0b-12fe-4597-8b4c-bc46da312892 req-f0748d28-cfe2-49fc-bec1-972209c3f42d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:33.303174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a4592c0b-12fe-4597-8b4c-bc46da312892 req-f0748d28-cfe2-49fc-bec1-972209c3f42d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:33.315481 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a4592c0b-12fe-4597-8b4c-bc46da312892 req-f0748d28-cfe2-49fc-bec1-972209c3f42d service nova] Creating event network-vif-plugged:a1f34ebb-c2eb-47bd-bf18-dff5a3aacf8b for instance b914f01e-8fbd-4ef9-9c2f-e99fdd006548 on n-h2-849328-3 Aug 24 11:04:33.320699 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a4592c0b-12fe-4597-8b4c-bc46da312892 req-f0748d28-cfe2-49fc-bec1-972209c3f42d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034429 Aug 24 11:04:33.321595 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3496/6631] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:04:33.550832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-96f0c479-a06e-48a7-a8a5-517b4433a50b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:33.551526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-96f0c479-a06e-48a7-a8a5-517b4433a50b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:33.559911 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96f0c479-a06e-48a7-a8a5-517b4433a50b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:33.560469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96f0c479-a06e-48a7-a8a5-517b4433a50b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:33.561063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96f0c479-a06e-48a7-a8a5-517b4433a50b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:33.561989 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96f0c479-a06e-48a7-a8a5-517b4433a50b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:33.562445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96f0c479-a06e-48a7-a8a5-517b4433a50b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:33.562866 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96f0c479-a06e-48a7-a8a5-517b4433a50b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:33.711968 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-96f0c479-a06e-48a7-a8a5-517b4433a50b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e4c3b743445a1b701e387ad949194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fccbd798ad364ff28e349d31457e93e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:33.721505 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-96f0c479-a06e-48a7-a8a5-517b4433a50b tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 200 len: 1501 microversion: 2.1 time: 0.174061 Aug 24 11:04:33.721505 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3136/6632] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:33 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 1501 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:34.405256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-84f74a4f-7745-41a7-93d5-ef025587651f req-4fcad83b-bf94-414c-8345-ada67244cd8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b914f01e-8fbd-4ef9-9c2f-e99fdd006548", "name": "network-vif-deleted", "tag": "a1f34ebb-c2eb-47bd-bf18-dff5a3aacf8b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:04:34.419647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-84f74a4f-7745-41a7-93d5-ef025587651f req-4fcad83b-bf94-414c-8345-ada67244cd8f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:34.420576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-84f74a4f-7745-41a7-93d5-ef025587651f req-4fcad83b-bf94-414c-8345-ada67244cd8f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:34.421296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-84f74a4f-7745-41a7-93d5-ef025587651f req-4fcad83b-bf94-414c-8345-ada67244cd8f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:34.434157 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-84f74a4f-7745-41a7-93d5-ef025587651f req-4fcad83b-bf94-414c-8345-ada67244cd8f service nova] Creating event network-vif-deleted:a1f34ebb-c2eb-47bd-bf18-dff5a3aacf8b for instance b914f01e-8fbd-4ef9-9c2f-e99fdd006548 on n-h2-849328-3 Aug 24 11:04:34.439316 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-84f74a4f-7745-41a7-93d5-ef025587651f req-4fcad83b-bf94-414c-8345-ada67244cd8f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038253 Aug 24 11:04:34.440484 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3497/6633] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:04:34.743041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1326289e-ea33-4ea9-aad0-d78ff6de14d6 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:34.743710 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1326289e-ea33-4ea9-aad0-d78ff6de14d6 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:34.751166 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1326289e-ea33-4ea9-aad0-d78ff6de14d6 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:34.751668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1326289e-ea33-4ea9-aad0-d78ff6de14d6 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:34.752081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1326289e-ea33-4ea9-aad0-d78ff6de14d6 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:34.752991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1326289e-ea33-4ea9-aad0-d78ff6de14d6 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:34.753473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1326289e-ea33-4ea9-aad0-d78ff6de14d6 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:34.754279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1326289e-ea33-4ea9-aad0-d78ff6de14d6 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:34.769430 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-1326289e-ea33-4ea9-aad0-d78ff6de14d6 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] HTTP exception thrown: Instance b914f01e-8fbd-4ef9-9c2f-e99fdd006548 could not be found. Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1326289e-ea33-4ea9-aad0-d78ff6de14d6 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Request method failure captured: Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 HTTP/1.1 Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgWSjceeu9m2nqnTGQj9fPJYdAoPEb7JxLeR_ko7VDoo5Il02atmxTwsQE2acyhfI7DOC2ZTYSygvxGQkfu4PMFiQeAfxQXtBAK7UgaeqrMUy2ONmEdPjJ0H7R0Q7YQGn58bl4DA5SANvCo93JOv6LJQ2L6RA4eI4OIvj_b67TUtKsQ Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: fccbd798ad364ff28e349d31457e93e3 Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1207520442 Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fccbd798ad364ff28e349d31457e93e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_fccbd798ad364ff28e349d31457e93e3", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fccbd798ad364ff28e349d31457e93e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/fccbd798ad364ff28e349d31457e93e3"}]}] Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1207520442 Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: fccbd798ad364ff28e349d31457e93e3 Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1207520442 Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1207520442-project Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 0a5e4c3b743445a1b701e387ad949194 Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1207520442-project Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance b914f01e-8fbd-4ef9-9c2f-e99fdd006548 could not be found. Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'b914f01e-8fbd-4ef9-9c2f-e99fdd006548'} Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b914f01e-8fbd-4ef9-9c2f-e99fdd006548 could not be found. Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b914f01e-8fbd-4ef9-9c2f-e99fdd006548 could not be found. Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:04:34.771117 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:04:34.777362 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:04:34.777362 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:04:34.777362 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:04:34.777362 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:04:34.777362 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:04:34.777362 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b914f01e-8fbd-4ef9-9c2f-e99fdd006548 could not be found. Aug 24 11:04:34.777362 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:04:34.777362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1326289e-ea33-4ea9-aad0-d78ff6de14d6 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Returning 404 to user: Instance b914f01e-8fbd-4ef9-9c2f-e99fdd006548 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:04:34.777362 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1326289e-ea33-4ea9-aad0-d78ff6de14d6 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 404 len: 111 microversion: 2.1 time: 0.033643 Aug 24 11:04:34.777362 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3137/6634] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:34 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:04:34.790339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f54c2a8e-2679-4136-9b34-3dbf0bc00651 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:34.791174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f54c2a8e-2679-4136-9b34-3dbf0bc00651 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:34.798442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f54c2a8e-2679-4136-9b34-3dbf0bc00651 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:34.799050 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f54c2a8e-2679-4136-9b34-3dbf0bc00651 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:34.799588 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f54c2a8e-2679-4136-9b34-3dbf0bc00651 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:34.800406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f54c2a8e-2679-4136-9b34-3dbf0bc00651 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:34.800945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f54c2a8e-2679-4136-9b34-3dbf0bc00651 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:34.801522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f54c2a8e-2679-4136-9b34-3dbf0bc00651 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:34.816520 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-f54c2a8e-2679-4136-9b34-3dbf0bc00651 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] HTTP exception thrown: Instance b914f01e-8fbd-4ef9-9c2f-e99fdd006548 could not be found. Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f54c2a8e-2679-4136-9b34-3dbf0bc00651 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Request method failure captured: Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 HTTP/1.1 Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgWSjceeu9m2nqnTGQj9fPJYdAoPEb7JxLeR_ko7VDoo5Il02atmxTwsQE2acyhfI7DOC2ZTYSygvxGQkfu4PMFiQeAfxQXtBAK7UgaeqrMUy2ONmEdPjJ0H7R0Q7YQGn58bl4DA5SANvCo93JOv6LJQ2L6RA4eI4OIvj_b67TUtKsQ Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: fccbd798ad364ff28e349d31457e93e3 Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-DeleteServersTestJSON-1207520442 Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fccbd798ad364ff28e349d31457e93e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_fccbd798ad364ff28e349d31457e93e3", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fccbd798ad364ff28e349d31457e93e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/fccbd798ad364ff28e349d31457e93e3"}]}] Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-DeleteServersTestJSON-1207520442 Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: fccbd798ad364ff28e349d31457e93e3 Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1207520442 Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-DeleteServersTestJSON-1207520442-project Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 0a5e4c3b743445a1b701e387ad949194 Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-DeleteServersTestJSON-1207520442-project Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance b914f01e-8fbd-4ef9-9c2f-e99fdd006548 could not be found. Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'b914f01e-8fbd-4ef9-9c2f-e99fdd006548'} Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b914f01e-8fbd-4ef9-9c2f-e99fdd006548 could not be found. Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:04:34.818283 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:04:34.822200 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b914f01e-8fbd-4ef9-9c2f-e99fdd006548 could not be found. Aug 24 11:04:34.822200 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:04:34.822200 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:04:34.822200 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:04:34.822200 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:04:34.822200 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:04:34.822200 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:04:34.822200 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:04:34.822200 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:04:34.822200 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b914f01e-8fbd-4ef9-9c2f-e99fdd006548 could not be found. Aug 24 11:04:34.822200 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:04:34.822200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f54c2a8e-2679-4136-9b34-3dbf0bc00651 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Returning 404 to user: Instance b914f01e-8fbd-4ef9-9c2f-e99fdd006548 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:04:34.825035 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f54c2a8e-2679-4136-9b34-3dbf0bc00651 tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 404 len: 111 microversion: 2.1 time: 0.039054 Aug 24 11:04:34.825232 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3498/6635] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:04:34 2022] DELETE /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:04:34.834281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c61d0c61-2133-46d1-93dd-4497016e97dd tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:34.835766 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c61d0c61-2133-46d1-93dd-4497016e97dd tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] [instance: b914f01e-8fbd-4ef9-9c2f-e99fdd006548] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:34.843265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c61d0c61-2133-46d1-93dd-4497016e97dd tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:34.843741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c61d0c61-2133-46d1-93dd-4497016e97dd tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:34.844178 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c61d0c61-2133-46d1-93dd-4497016e97dd tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:34.844971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c61d0c61-2133-46d1-93dd-4497016e97dd tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:34.845435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c61d0c61-2133-46d1-93dd-4497016e97dd tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:34.845810 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c61d0c61-2133-46d1-93dd-4497016e97dd tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:34.860828 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-c61d0c61-2133-46d1-93dd-4497016e97dd tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] HTTP exception thrown: Instance b914f01e-8fbd-4ef9-9c2f-e99fdd006548 could not be found. Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c61d0c61-2133-46d1-93dd-4497016e97dd tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Request method failure captured: Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 HTTP/1.1 Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgWSjceeu9m2nqnTGQj9fPJYdAoPEb7JxLeR_ko7VDoo5Il02atmxTwsQE2acyhfI7DOC2ZTYSygvxGQkfu4PMFiQeAfxQXtBAK7UgaeqrMUy2ONmEdPjJ0H7R0Q7YQGn58bl4DA5SANvCo93JOv6LJQ2L6RA4eI4OIvj_b67TUtKsQ Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: fccbd798ad364ff28e349d31457e93e3 Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1207520442 Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fccbd798ad364ff28e349d31457e93e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_fccbd798ad364ff28e349d31457e93e3", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fccbd798ad364ff28e349d31457e93e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/fccbd798ad364ff28e349d31457e93e3"}]}] Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1207520442 Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: fccbd798ad364ff28e349d31457e93e3 Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1207520442 Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1207520442-project Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 0a5e4c3b743445a1b701e387ad949194 Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1207520442-project Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance b914f01e-8fbd-4ef9-9c2f-e99fdd006548 could not be found. Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'b914f01e-8fbd-4ef9-9c2f-e99fdd006548'} Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b914f01e-8fbd-4ef9-9c2f-e99fdd006548 could not be found. Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b914f01e-8fbd-4ef9-9c2f-e99fdd006548 could not be found. Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:04:34.862484 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:04:34.866541 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:04:34.866541 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:04:34.866541 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:04:34.866541 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:04:34.866541 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:04:34.866541 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b914f01e-8fbd-4ef9-9c2f-e99fdd006548 could not be found. Aug 24 11:04:34.866541 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:04:34.866541 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c61d0c61-2133-46d1-93dd-4497016e97dd tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] Returning 404 to user: Instance b914f01e-8fbd-4ef9-9c2f-e99fdd006548 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:04:34.866541 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c61d0c61-2133-46d1-93dd-4497016e97dd tempest-DeleteServersTestJSON-1207520442 tempest-DeleteServersTestJSON-1207520442-project] 10.222.0.85 "GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548" status: 404 len: 111 microversion: 2.1 time: 0.033872 Aug 24 11:04:34.866541 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3138/6636] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:34 2022] GET /compute/v2.1/servers/b914f01e-8fbd-4ef9-9c2f-e99fdd006548 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 11:04:43.741605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b75814a5-41c4-4ebf-bb5e-d2d68acf5eac tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-736500286", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "19439d20-5a96-4b08-9b42-b79f358981f7"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:04:43.796586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-b75814a5-41c4-4ebf-bb5e-d2d68acf5eac tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] validate_networks() for [('19439d20-5a96-4b08-9b42-b79f358981f7', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:04:44.195764 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b75814a5-41c4-4ebf-bb5e-d2d68acf5eac tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:04:44.196201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b75814a5-41c4-4ebf-bb5e-d2d68acf5eac tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:04:44.196756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b75814a5-41c4-4ebf-bb5e-d2d68acf5eac tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:04:44.197208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b75814a5-41c4-4ebf-bb5e-d2d68acf5eac tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:04:44.197655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b75814a5-41c4-4ebf-bb5e-d2d68acf5eac tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:04:44.207012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b75814a5-41c4-4ebf-bb5e-d2d68acf5eac tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:44.207514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b75814a5-41c4-4ebf-bb5e-d2d68acf5eac tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:44.207972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b75814a5-41c4-4ebf-bb5e-d2d68acf5eac tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:44.208712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b75814a5-41c4-4ebf-bb5e-d2d68acf5eac tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:44.209231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b75814a5-41c4-4ebf-bb5e-d2d68acf5eac tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:44.209665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b75814a5-41c4-4ebf-bb5e-d2d68acf5eac tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:44.228360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b75814a5-41c4-4ebf-bb5e-d2d68acf5eac tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Getting quotas for project 6dcb817ffa24404ab42a2a036d7c8ba6. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:04:44.233834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b75814a5-41c4-4ebf-bb5e-d2d68acf5eac tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Getting quotas for user 076b20c8d634432bb5c1773d56892a32 and project 6dcb817ffa24404ab42a2a036d7c8ba6. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:04:44.246428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b75814a5-41c4-4ebf-bb5e-d2d68acf5eac tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:04:44.248774 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b75814a5-41c4-4ebf-bb5e-d2d68acf5eac tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:04:44.295270 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b75814a5-41c4-4ebf-bb5e-d2d68acf5eac tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.672830 Aug 24 11:04:44.296135 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3499/6637] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 11:04:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:04:44.310491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-78340212-77f2-42e6-8c3b-9dd2f2d4bf56 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:44.311318 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-78340212-77f2-42e6-8c3b-9dd2f2d4bf56 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:44.390101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-78340212-77f2-42e6-8c3b-9dd2f2d4bf56 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:44.401477 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-78340212-77f2-42e6-8c3b-9dd2f2d4bf56 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1217 microversion: 2.1 time: 0.094874 Aug 24 11:04:44.401984 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3139/6638] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:44 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:45.423359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4df01d24-fce9-4481-a786-ac3995614c62 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:45.424053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4df01d24-fce9-4481-a786-ac3995614c62 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:45.432841 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4df01d24-fce9-4481-a786-ac3995614c62 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:45.433579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4df01d24-fce9-4481-a786-ac3995614c62 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:45.435236 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4df01d24-fce9-4481-a786-ac3995614c62 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:45.436438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4df01d24-fce9-4481-a786-ac3995614c62 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:45.437074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4df01d24-fce9-4481-a786-ac3995614c62 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:45.438403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4df01d24-fce9-4481-a786-ac3995614c62 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:45.534354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4df01d24-fce9-4481-a786-ac3995614c62 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:45.545286 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4df01d24-fce9-4481-a786-ac3995614c62 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1277 microversion: 2.1 time: 0.126870 Aug 24 11:04:45.546485 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3500/6639] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:45 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1277 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:46.566496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-95472343-b588-4a5b-91bf-79c3cb996832 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:46.567133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-95472343-b588-4a5b-91bf-79c3cb996832 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:46.573619 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=37 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:04:46.576285 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95472343-b588-4a5b-91bf-79c3cb996832 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:46.576955 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95472343-b588-4a5b-91bf-79c3cb996832 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:46.577624 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95472343-b588-4a5b-91bf-79c3cb996832 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:46.578934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95472343-b588-4a5b-91bf-79c3cb996832 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:46.579590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95472343-b588-4a5b-91bf-79c3cb996832 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:46.580200 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95472343-b588-4a5b-91bf-79c3cb996832 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:46.829849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-95472343-b588-4a5b-91bf-79c3cb996832 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:46.839685 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-95472343-b588-4a5b-91bf-79c3cb996832 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1317 microversion: 2.1 time: 0.277106 Aug 24 11:04:46.840684 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3140/6640] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:46 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1317 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:46.980910 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-7573c313-14de-4905-9aec-43c9a8ac48ed req-67f12afb-ca3a-49b4-b4fc-d219496c5332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68d33464-c5b1-49ba-a850-4078da5039de", "tag": "21f878d5-044d-4c5b-b465-11e66502a8c4"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:04:46.997492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7573c313-14de-4905-9aec-43c9a8ac48ed req-67f12afb-ca3a-49b4-b4fc-d219496c5332 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:46.998026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7573c313-14de-4905-9aec-43c9a8ac48ed req-67f12afb-ca3a-49b4-b4fc-d219496c5332 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:46.998446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7573c313-14de-4905-9aec-43c9a8ac48ed req-67f12afb-ca3a-49b4-b4fc-d219496c5332 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:47.015552 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-7573c313-14de-4905-9aec-43c9a8ac48ed req-67f12afb-ca3a-49b4-b4fc-d219496c5332 service nova] Creating event network-changed:21f878d5-044d-4c5b-b465-11e66502a8c4 for instance 68d33464-c5b1-49ba-a850-4078da5039de on n-h1-849328-3 Aug 24 11:04:47.022526 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-7573c313-14de-4905-9aec-43c9a8ac48ed req-67f12afb-ca3a-49b4-b4fc-d219496c5332 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045785 Aug 24 11:04:47.023684 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3501/6641] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:04:47.862950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1784e48b-f5ae-4c78-8ab3-9dbf87ddd4f2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:47.863578 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1784e48b-f5ae-4c78-8ab3-9dbf87ddd4f2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:47.872070 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1784e48b-f5ae-4c78-8ab3-9dbf87ddd4f2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:47.872643 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1784e48b-f5ae-4c78-8ab3-9dbf87ddd4f2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:47.873236 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1784e48b-f5ae-4c78-8ab3-9dbf87ddd4f2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:47.874003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1784e48b-f5ae-4c78-8ab3-9dbf87ddd4f2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:47.874577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1784e48b-f5ae-4c78-8ab3-9dbf87ddd4f2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:47.875110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1784e48b-f5ae-4c78-8ab3-9dbf87ddd4f2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:48.018566 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1784e48b-f5ae-4c78-8ab3-9dbf87ddd4f2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:48.030462 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1784e48b-f5ae-4c78-8ab3-9dbf87ddd4f2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1317 microversion: 2.1 time: 0.171956 Aug 24 11:04:48.031206 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3141/6642] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:47 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:49.058022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6fe23b1e-c0c0-4c35-b6c1-d9f73c7bbbdf tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:49.058796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6fe23b1e-c0c0-4c35-b6c1-d9f73c7bbbdf tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:49.065429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fe23b1e-c0c0-4c35-b6c1-d9f73c7bbbdf tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:49.065928 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fe23b1e-c0c0-4c35-b6c1-d9f73c7bbbdf tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:49.066360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fe23b1e-c0c0-4c35-b6c1-d9f73c7bbbdf tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:49.067074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fe23b1e-c0c0-4c35-b6c1-d9f73c7bbbdf tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:49.067537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fe23b1e-c0c0-4c35-b6c1-d9f73c7bbbdf tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:49.067973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fe23b1e-c0c0-4c35-b6c1-d9f73c7bbbdf tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:49.209571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6fe23b1e-c0c0-4c35-b6c1-d9f73c7bbbdf tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:49.217967 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6fe23b1e-c0c0-4c35-b6c1-d9f73c7bbbdf tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1317 microversion: 2.1 time: 0.167959 Aug 24 11:04:49.218563 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3502/6643] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:49 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:50.243038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-96c69dc7-a2e3-460e-9b26-9c84eb1133bb tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:50.244136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-96c69dc7-a2e3-460e-9b26-9c84eb1133bb tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:50.256005 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96c69dc7-a2e3-460e-9b26-9c84eb1133bb tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:50.256810 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96c69dc7-a2e3-460e-9b26-9c84eb1133bb tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:50.257583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96c69dc7-a2e3-460e-9b26-9c84eb1133bb tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:50.258728 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96c69dc7-a2e3-460e-9b26-9c84eb1133bb tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:50.259587 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96c69dc7-a2e3-460e-9b26-9c84eb1133bb tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:50.260009 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96c69dc7-a2e3-460e-9b26-9c84eb1133bb tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:50.395286 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-96c69dc7-a2e3-460e-9b26-9c84eb1133bb tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:50.403632 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-96c69dc7-a2e3-460e-9b26-9c84eb1133bb tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1317 microversion: 2.1 time: 0.167156 Aug 24 11:04:50.404192 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3142/6644] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:50 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:51.324809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8163c0de-dae1-4013-bb79-55f967bbc778 req-9408acb9-1172-4776-a9ff-ad349c221934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d33464-c5b1-49ba-a850-4078da5039de", "name": "network-vif-plugged", "status": "completed", "tag": "21f878d5-044d-4c5b-b465-11e66502a8c4"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:04:51.337907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8163c0de-dae1-4013-bb79-55f967bbc778 req-9408acb9-1172-4776-a9ff-ad349c221934 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:51.338408 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8163c0de-dae1-4013-bb79-55f967bbc778 req-9408acb9-1172-4776-a9ff-ad349c221934 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:51.338850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8163c0de-dae1-4013-bb79-55f967bbc778 req-9408acb9-1172-4776-a9ff-ad349c221934 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:51.351804 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8163c0de-dae1-4013-bb79-55f967bbc778 req-9408acb9-1172-4776-a9ff-ad349c221934 service nova] Creating event network-vif-plugged:21f878d5-044d-4c5b-b465-11e66502a8c4 for instance 68d33464-c5b1-49ba-a850-4078da5039de on n-h1-849328-3 Aug 24 11:04:51.356933 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8163c0de-dae1-4013-bb79-55f967bbc778 req-9408acb9-1172-4776-a9ff-ad349c221934 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036126 Aug 24 11:04:51.357900 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3503/6645] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:04:51.425314 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-46eb72ae-d6d8-4aed-974c-7cefdc4b1a6a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:51.425876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-46eb72ae-d6d8-4aed-974c-7cefdc4b1a6a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:51.436233 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46eb72ae-d6d8-4aed-974c-7cefdc4b1a6a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:51.436723 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46eb72ae-d6d8-4aed-974c-7cefdc4b1a6a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:51.437181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46eb72ae-d6d8-4aed-974c-7cefdc4b1a6a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:51.437905 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46eb72ae-d6d8-4aed-974c-7cefdc4b1a6a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:51.438345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46eb72ae-d6d8-4aed-974c-7cefdc4b1a6a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:51.438766 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46eb72ae-d6d8-4aed-974c-7cefdc4b1a6a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:51.622326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-46eb72ae-d6d8-4aed-974c-7cefdc4b1a6a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:51.630370 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-46eb72ae-d6d8-4aed-974c-7cefdc4b1a6a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1317 microversion: 2.1 time: 0.210281 Aug 24 11:04:51.630964 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3143/6646] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:51 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:52.652693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d2abdf1e-bb19-40ff-b9c6-aaef37cbe9b8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:52.653452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d2abdf1e-bb19-40ff-b9c6-aaef37cbe9b8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:52.662496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2abdf1e-bb19-40ff-b9c6-aaef37cbe9b8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:52.663104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2abdf1e-bb19-40ff-b9c6-aaef37cbe9b8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:52.663698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2abdf1e-bb19-40ff-b9c6-aaef37cbe9b8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:52.664836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2abdf1e-bb19-40ff-b9c6-aaef37cbe9b8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:52.665581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2abdf1e-bb19-40ff-b9c6-aaef37cbe9b8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:52.666038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2abdf1e-bb19-40ff-b9c6-aaef37cbe9b8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:52.802493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d2abdf1e-bb19-40ff-b9c6-aaef37cbe9b8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:52.810620 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d2abdf1e-bb19-40ff-b9c6-aaef37cbe9b8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1507 microversion: 2.1 time: 0.162457 Aug 24 11:04:52.811230 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3504/6647] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:52 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:52.833473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-65c7c1e7-d3b0-45a0-a2a6-3b9b293de86d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:52.834460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-65c7c1e7-d3b0-45a0-a2a6-3b9b293de86d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:52.842831 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65c7c1e7-d3b0-45a0-a2a6-3b9b293de86d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:52.843311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65c7c1e7-d3b0-45a0-a2a6-3b9b293de86d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:52.843740 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65c7c1e7-d3b0-45a0-a2a6-3b9b293de86d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:52.844428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65c7c1e7-d3b0-45a0-a2a6-3b9b293de86d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:52.844873 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65c7c1e7-d3b0-45a0-a2a6-3b9b293de86d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:52.845368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65c7c1e7-d3b0-45a0-a2a6-3b9b293de86d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:52.987015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-65c7c1e7-d3b0-45a0-a2a6-3b9b293de86d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:52.997521 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-65c7c1e7-d3b0-45a0-a2a6-3b9b293de86d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1507 microversion: 2.1 time: 0.169889 Aug 24 11:04:52.998117 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3144/6648] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:52 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:53.021653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e4b26b66-f456-465e-a612-56f5c063e9c3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:04:53.024164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e4b26b66-f456-465e-a612-56f5c063e9c3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:53.030728 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4b26b66-f456-465e-a612-56f5c063e9c3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:53.031237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4b26b66-f456-465e-a612-56f5c063e9c3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:53.031691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4b26b66-f456-465e-a612-56f5c063e9c3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:53.032404 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4b26b66-f456-465e-a612-56f5c063e9c3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:53.032877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4b26b66-f456-465e-a612-56f5c063e9c3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:53.033357 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4b26b66-f456-465e-a612-56f5c063e9c3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:53.110205 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e4b26b66-f456-465e-a612-56f5c063e9c3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "PUT /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1079 microversion: 2.1 time: 0.092530 Aug 24 11:04:53.110900 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3505/6649] 10.222.0.85 () {60 vars in 1256 bytes} [Wed Aug 24 11:04:53 2022] PUT /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1079 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:53.130999 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-544b2e82-91ed-4761-81c5-dc93f15b8636 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:53.131856 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-544b2e82-91ed-4761-81c5-dc93f15b8636 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:53.139423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-544b2e82-91ed-4761-81c5-dc93f15b8636 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:53.139925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-544b2e82-91ed-4761-81c5-dc93f15b8636 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:53.140361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-544b2e82-91ed-4761-81c5-dc93f15b8636 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:53.141053 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-544b2e82-91ed-4761-81c5-dc93f15b8636 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:53.141530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-544b2e82-91ed-4761-81c5-dc93f15b8636 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:53.141954 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-544b2e82-91ed-4761-81c5-dc93f15b8636 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:53.282662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-544b2e82-91ed-4761-81c5-dc93f15b8636 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:53.291025 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-544b2e82-91ed-4761-81c5-dc93f15b8636 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1505 microversion: 2.1 time: 0.166360 Aug 24 11:04:53.291581 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3145/6650] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:53 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:53.311076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c768ba8-1340-4290-b582-7cf81703a1aa tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:53.311669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2c768ba8-1340-4290-b582-7cf81703a1aa tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:53.318109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c768ba8-1340-4290-b582-7cf81703a1aa tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:53.318640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c768ba8-1340-4290-b582-7cf81703a1aa tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:53.319083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c768ba8-1340-4290-b582-7cf81703a1aa tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:53.319785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c768ba8-1340-4290-b582-7cf81703a1aa tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:53.320248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c768ba8-1340-4290-b582-7cf81703a1aa tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:53.320685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c768ba8-1340-4290-b582-7cf81703a1aa tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:53.463133 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2c768ba8-1340-4290-b582-7cf81703a1aa tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:53.471286 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2c768ba8-1340-4290-b582-7cf81703a1aa tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1505 microversion: 2.1 time: 0.164309 Aug 24 11:04:53.471872 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3506/6651] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:53 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:53.491918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8a538ce8-5b59-4100-8c5d-eba4f5579df5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:04:53.494278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8a538ce8-5b59-4100-8c5d-eba4f5579df5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:53.500984 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a538ce8-5b59-4100-8c5d-eba4f5579df5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:53.501516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a538ce8-5b59-4100-8c5d-eba4f5579df5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:53.501951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a538ce8-5b59-4100-8c5d-eba4f5579df5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:53.502647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a538ce8-5b59-4100-8c5d-eba4f5579df5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:53.503118 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a538ce8-5b59-4100-8c5d-eba4f5579df5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:53.503546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a538ce8-5b59-4100-8c5d-eba4f5579df5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:53.576203 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8a538ce8-5b59-4100-8c5d-eba4f5579df5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:53.582229 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8a538ce8-5b59-4100-8c5d-eba4f5579df5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Old instance type m1.heat2, new instance type m1.heat {{(pid=122432) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 11:04:53.588955 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8a538ce8-5b59-4100-8c5d-eba4f5579df5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:04:53.589416 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8a538ce8-5b59-4100-8c5d-eba4f5579df5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:04:53.589885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8a538ce8-5b59-4100-8c5d-eba4f5579df5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:04:53.590290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8a538ce8-5b59-4100-8c5d-eba4f5579df5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:04:53.590703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8a538ce8-5b59-4100-8c5d-eba4f5579df5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:04:53.706643 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8a538ce8-5b59-4100-8c5d-eba4f5579df5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "POST /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de/action" status: 202 len: 0 microversion: 2.1 time: 0.218770 Aug 24 11:04:53.707385 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3146/6652] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:04:53 2022] POST /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:04:53.716075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b3cce2bc-ee03-4318-beff-3e54cdb15a8d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:53.716708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b3cce2bc-ee03-4318-beff-3e54cdb15a8d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:53.724360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3cce2bc-ee03-4318-beff-3e54cdb15a8d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:53.724886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3cce2bc-ee03-4318-beff-3e54cdb15a8d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:53.725366 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3cce2bc-ee03-4318-beff-3e54cdb15a8d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:53.726084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3cce2bc-ee03-4318-beff-3e54cdb15a8d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:53.726554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3cce2bc-ee03-4318-beff-3e54cdb15a8d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:53.726988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3cce2bc-ee03-4318-beff-3e54cdb15a8d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:53.885789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b3cce2bc-ee03-4318-beff-3e54cdb15a8d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:53.893897 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b3cce2bc-ee03-4318-beff-3e54cdb15a8d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1516 microversion: 2.1 time: 0.181963 Aug 24 11:04:53.894535 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3507/6653] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:53 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1516 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:54.912967 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:04:54.918806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5a97f6f8-d3f1-4206-9a43-a4a01d8052f3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:54.918806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5a97f6f8-d3f1-4206-9a43-a4a01d8052f3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:54.931335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a97f6f8-d3f1-4206-9a43-a4a01d8052f3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:54.931861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a97f6f8-d3f1-4206-9a43-a4a01d8052f3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:54.932298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a97f6f8-d3f1-4206-9a43-a4a01d8052f3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:54.933011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a97f6f8-d3f1-4206-9a43-a4a01d8052f3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:54.933487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a97f6f8-d3f1-4206-9a43-a4a01d8052f3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:54.933913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a97f6f8-d3f1-4206-9a43-a4a01d8052f3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:55.084890 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5a97f6f8-d3f1-4206-9a43-a4a01d8052f3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:55.092976 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5a97f6f8-d3f1-4206-9a43-a4a01d8052f3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1516 microversion: 2.1 time: 0.181298 Aug 24 11:04:55.093602 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3147/6654] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:54 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1516 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:56.118660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b97b999c-5c58-4987-a3be-6fd625f77684 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:56.120262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b97b999c-5c58-4987-a3be-6fd625f77684 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:56.123675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:04:56.124790 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:04:56.135259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b97b999c-5c58-4987-a3be-6fd625f77684 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:56.135755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b97b999c-5c58-4987-a3be-6fd625f77684 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:56.136204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b97b999c-5c58-4987-a3be-6fd625f77684 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:56.136901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b97b999c-5c58-4987-a3be-6fd625f77684 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:56.137392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b97b999c-5c58-4987-a3be-6fd625f77684 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:56.137822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b97b999c-5c58-4987-a3be-6fd625f77684 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:56.278906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b97b999c-5c58-4987-a3be-6fd625f77684 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:56.287099 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b97b999c-5c58-4987-a3be-6fd625f77684 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1521 microversion: 2.1 time: 0.175051 Aug 24 11:04:56.288046 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3508/6655] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:56 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:57.308571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ed2a4d15-0dfd-4b72-a848-f94d94ecfcdf tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:57.309110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ed2a4d15-0dfd-4b72-a848-f94d94ecfcdf tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:57.311851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=38 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:04:57.317644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed2a4d15-0dfd-4b72-a848-f94d94ecfcdf tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:57.318128 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed2a4d15-0dfd-4b72-a848-f94d94ecfcdf tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:57.318545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed2a4d15-0dfd-4b72-a848-f94d94ecfcdf tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:57.319240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed2a4d15-0dfd-4b72-a848-f94d94ecfcdf tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:57.319696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed2a4d15-0dfd-4b72-a848-f94d94ecfcdf tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:57.320136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed2a4d15-0dfd-4b72-a848-f94d94ecfcdf tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:57.460697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ed2a4d15-0dfd-4b72-a848-f94d94ecfcdf tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:57.471895 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ed2a4d15-0dfd-4b72-a848-f94d94ecfcdf tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1521 microversion: 2.1 time: 0.167226 Aug 24 11:04:57.472699 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3148/6656] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:57 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:58.499518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f598895d-0f6c-4b7f-a2bf-afe83917040e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:58.500564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f598895d-0f6c-4b7f-a2bf-afe83917040e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:58.504888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:04:58.516131 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f598895d-0f6c-4b7f-a2bf-afe83917040e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:58.516923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f598895d-0f6c-4b7f-a2bf-afe83917040e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:58.517485 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f598895d-0f6c-4b7f-a2bf-afe83917040e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:58.518534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f598895d-0f6c-4b7f-a2bf-afe83917040e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:58.519253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f598895d-0f6c-4b7f-a2bf-afe83917040e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:58.519879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f598895d-0f6c-4b7f-a2bf-afe83917040e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:58.524883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:04:58.666957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f598895d-0f6c-4b7f-a2bf-afe83917040e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:58.678134 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f598895d-0f6c-4b7f-a2bf-afe83917040e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1521 microversion: 2.1 time: 0.185094 Aug 24 11:04:58.679161 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3509/6657] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:58 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:59.706466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-28cf0501-dfef-4918-b747-2dc5ad895364 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:59.707059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-28cf0501-dfef-4918-b747-2dc5ad895364 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:04:59.714337 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28cf0501-dfef-4918-b747-2dc5ad895364 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:59.714816 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28cf0501-dfef-4918-b747-2dc5ad895364 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:59.715265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28cf0501-dfef-4918-b747-2dc5ad895364 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:59.715954 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28cf0501-dfef-4918-b747-2dc5ad895364 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:59.716402 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28cf0501-dfef-4918-b747-2dc5ad895364 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:59.716820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28cf0501-dfef-4918-b747-2dc5ad895364 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:59.864335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-28cf0501-dfef-4918-b747-2dc5ad895364 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:04:59.872631 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-28cf0501-dfef-4918-b747-2dc5ad895364 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1521 microversion: 2.1 time: 0.170109 Aug 24 11:04:59.873240 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3149/6658] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:04:59 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:00.898315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d89a3582-466b-4478-975e-1e2cb46956aa tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:00.899358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d89a3582-466b-4478-975e-1e2cb46956aa tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:00.907191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d89a3582-466b-4478-975e-1e2cb46956aa tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:00.907697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d89a3582-466b-4478-975e-1e2cb46956aa tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:00.908151 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d89a3582-466b-4478-975e-1e2cb46956aa tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:00.908862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d89a3582-466b-4478-975e-1e2cb46956aa tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:00.909372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d89a3582-466b-4478-975e-1e2cb46956aa tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:00.909813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d89a3582-466b-4478-975e-1e2cb46956aa tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:01.056151 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d89a3582-466b-4478-975e-1e2cb46956aa tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:01.064228 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d89a3582-466b-4478-975e-1e2cb46956aa tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1521 microversion: 2.1 time: 0.172637 Aug 24 11:05:01.064834 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3510/6659] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:00 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:02.089571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-152e77f6-872d-4b97-8065-ffd36c3ed8bc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:02.090621 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-152e77f6-872d-4b97-8065-ffd36c3ed8bc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:02.103342 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-152e77f6-872d-4b97-8065-ffd36c3ed8bc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:02.103848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-152e77f6-872d-4b97-8065-ffd36c3ed8bc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:02.104294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-152e77f6-872d-4b97-8065-ffd36c3ed8bc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:02.105050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-152e77f6-872d-4b97-8065-ffd36c3ed8bc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:02.105557 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-152e77f6-872d-4b97-8065-ffd36c3ed8bc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:02.106001 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-152e77f6-872d-4b97-8065-ffd36c3ed8bc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:02.245034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-152e77f6-872d-4b97-8065-ffd36c3ed8bc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:02.256414 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-152e77f6-872d-4b97-8065-ffd36c3ed8bc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1521 microversion: 2.1 time: 0.173181 Aug 24 11:05:02.257338 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3150/6660] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:02 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:03.284371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-86a2f2e3-562d-4b2c-b559-8ffac1f68eda tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:03.284984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-86a2f2e3-562d-4b2c-b559-8ffac1f68eda tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:03.292543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86a2f2e3-562d-4b2c-b559-8ffac1f68eda tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:03.293040 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86a2f2e3-562d-4b2c-b559-8ffac1f68eda tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:03.293520 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86a2f2e3-562d-4b2c-b559-8ffac1f68eda tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:03.294232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86a2f2e3-562d-4b2c-b559-8ffac1f68eda tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:03.294709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86a2f2e3-562d-4b2c-b559-8ffac1f68eda tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:03.295142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86a2f2e3-562d-4b2c-b559-8ffac1f68eda tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:03.433497 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-86a2f2e3-562d-4b2c-b559-8ffac1f68eda tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:03.442044 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-86a2f2e3-562d-4b2c-b559-8ffac1f68eda tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1521 microversion: 2.1 time: 0.161763 Aug 24 11:05:03.442614 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3511/6661] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:03 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:04.467680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1ad71c32-033c-41a2-aa5d-d2fdeb8e59cb tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:04.468396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1ad71c32-033c-41a2-aa5d-d2fdeb8e59cb tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:04.480815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ad71c32-033c-41a2-aa5d-d2fdeb8e59cb tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:04.481336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ad71c32-033c-41a2-aa5d-d2fdeb8e59cb tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:04.481770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ad71c32-033c-41a2-aa5d-d2fdeb8e59cb tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:04.482468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ad71c32-033c-41a2-aa5d-d2fdeb8e59cb tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:04.482906 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ad71c32-033c-41a2-aa5d-d2fdeb8e59cb tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:04.483335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ad71c32-033c-41a2-aa5d-d2fdeb8e59cb tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:04.626684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1ad71c32-033c-41a2-aa5d-d2fdeb8e59cb tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:04.634732 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1ad71c32-033c-41a2-aa5d-d2fdeb8e59cb tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1521 microversion: 2.1 time: 0.173990 Aug 24 11:05:04.635333 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3151/6662] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:04 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:05.656988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b42b4e31-da9a-4f32-8f62-d78ead2dfb91 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:05.657663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b42b4e31-da9a-4f32-8f62-d78ead2dfb91 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:05.665063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b42b4e31-da9a-4f32-8f62-d78ead2dfb91 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:05.665599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b42b4e31-da9a-4f32-8f62-d78ead2dfb91 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:05.666062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b42b4e31-da9a-4f32-8f62-d78ead2dfb91 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:05.667866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b42b4e31-da9a-4f32-8f62-d78ead2dfb91 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:05.668363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b42b4e31-da9a-4f32-8f62-d78ead2dfb91 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:05.668811 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b42b4e31-da9a-4f32-8f62-d78ead2dfb91 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:05.819165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b42b4e31-da9a-4f32-8f62-d78ead2dfb91 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:05.827493 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b42b4e31-da9a-4f32-8f62-d78ead2dfb91 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1521 microversion: 2.1 time: 0.174535 Aug 24 11:05:05.828060 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3512/6663] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:05 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:06.853331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6cd3e8ca-1056-42c6-b316-a63723e920ee tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:06.854206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6cd3e8ca-1056-42c6-b316-a63723e920ee tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:06.866196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cd3e8ca-1056-42c6-b316-a63723e920ee tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:06.867030 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cd3e8ca-1056-42c6-b316-a63723e920ee tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:06.867749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cd3e8ca-1056-42c6-b316-a63723e920ee tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:06.868894 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cd3e8ca-1056-42c6-b316-a63723e920ee tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:06.869694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cd3e8ca-1056-42c6-b316-a63723e920ee tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:06.870400 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cd3e8ca-1056-42c6-b316-a63723e920ee tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:07.014919 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6cd3e8ca-1056-42c6-b316-a63723e920ee tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:07.023125 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6cd3e8ca-1056-42c6-b316-a63723e920ee tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1521 microversion: 2.1 time: 0.176835 Aug 24 11:05:07.023718 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3152/6664] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:06 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:08.048101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7b93957e-0f8f-489d-acfa-60a592d34a78 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:08.048767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7b93957e-0f8f-489d-acfa-60a592d34a78 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:08.058966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b93957e-0f8f-489d-acfa-60a592d34a78 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:08.059476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b93957e-0f8f-489d-acfa-60a592d34a78 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:08.059958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b93957e-0f8f-489d-acfa-60a592d34a78 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:08.060668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b93957e-0f8f-489d-acfa-60a592d34a78 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:08.061165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b93957e-0f8f-489d-acfa-60a592d34a78 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:08.061653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b93957e-0f8f-489d-acfa-60a592d34a78 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:08.211451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7b93957e-0f8f-489d-acfa-60a592d34a78 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:08.219883 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7b93957e-0f8f-489d-acfa-60a592d34a78 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1521 microversion: 2.1 time: 0.177777 Aug 24 11:05:08.220481 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3513/6665] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:08 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:09.244307 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5ad7d3c4-5c6e-432f-904c-9d530d0f0f82 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:09.244890 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5ad7d3c4-5c6e-432f-904c-9d530d0f0f82 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:09.252682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ad7d3c4-5c6e-432f-904c-9d530d0f0f82 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:09.253182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ad7d3c4-5c6e-432f-904c-9d530d0f0f82 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:09.253630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ad7d3c4-5c6e-432f-904c-9d530d0f0f82 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:09.254470 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ad7d3c4-5c6e-432f-904c-9d530d0f0f82 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:09.254980 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ad7d3c4-5c6e-432f-904c-9d530d0f0f82 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:09.255471 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ad7d3c4-5c6e-432f-904c-9d530d0f0f82 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:09.393811 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5ad7d3c4-5c6e-432f-904c-9d530d0f0f82 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:09.402029 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5ad7d3c4-5c6e-432f-904c-9d530d0f0f82 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1521 microversion: 2.1 time: 0.163395 Aug 24 11:05:09.402687 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3153/6666] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:09 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:10.427607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-428afe07-25f1-4685-b681-9ebb2c2978f0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:10.428634 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-428afe07-25f1-4685-b681-9ebb2c2978f0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:10.440712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-428afe07-25f1-4685-b681-9ebb2c2978f0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:10.441598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-428afe07-25f1-4685-b681-9ebb2c2978f0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:10.442325 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-428afe07-25f1-4685-b681-9ebb2c2978f0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:10.443528 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-428afe07-25f1-4685-b681-9ebb2c2978f0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:10.444375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-428afe07-25f1-4685-b681-9ebb2c2978f0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:10.445168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-428afe07-25f1-4685-b681-9ebb2c2978f0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:10.587037 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-428afe07-25f1-4685-b681-9ebb2c2978f0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:10.596252 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-428afe07-25f1-4685-b681-9ebb2c2978f0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1521 microversion: 2.1 time: 0.175448 Aug 24 11:05:10.596844 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3514/6667] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:10 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:11.618809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d10ebab8-07e6-4d50-b660-02d318c29f80 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:11.619473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d10ebab8-07e6-4d50-b660-02d318c29f80 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:11.627200 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d10ebab8-07e6-4d50-b660-02d318c29f80 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:11.627687 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d10ebab8-07e6-4d50-b660-02d318c29f80 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:11.628122 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d10ebab8-07e6-4d50-b660-02d318c29f80 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:11.628813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d10ebab8-07e6-4d50-b660-02d318c29f80 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:11.629307 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d10ebab8-07e6-4d50-b660-02d318c29f80 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:11.629731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d10ebab8-07e6-4d50-b660-02d318c29f80 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:11.770823 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d10ebab8-07e6-4d50-b660-02d318c29f80 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:11.778802 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d10ebab8-07e6-4d50-b660-02d318c29f80 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1521 microversion: 2.1 time: 0.164635 Aug 24 11:05:11.779403 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3154/6668] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:11 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:12.803414 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b0a3fd6b-2fda-438d-a5db-484dde0f58a2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:12.804203 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b0a3fd6b-2fda-438d-a5db-484dde0f58a2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:12.813172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0a3fd6b-2fda-438d-a5db-484dde0f58a2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:12.813700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0a3fd6b-2fda-438d-a5db-484dde0f58a2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:12.814148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0a3fd6b-2fda-438d-a5db-484dde0f58a2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:12.814858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0a3fd6b-2fda-438d-a5db-484dde0f58a2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:12.815319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0a3fd6b-2fda-438d-a5db-484dde0f58a2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:12.815753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0a3fd6b-2fda-438d-a5db-484dde0f58a2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:12.966948 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b0a3fd6b-2fda-438d-a5db-484dde0f58a2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:12.975349 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b0a3fd6b-2fda-438d-a5db-484dde0f58a2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1521 microversion: 2.1 time: 0.178180 Aug 24 11:05:12.975914 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3515/6669] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:12 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:14.001060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-34b4e224-abd9-427e-ac71-42420c83614f tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:14.002116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-34b4e224-abd9-427e-ac71-42420c83614f tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:14.013154 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34b4e224-abd9-427e-ac71-42420c83614f tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:14.013646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34b4e224-abd9-427e-ac71-42420c83614f tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:14.014110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34b4e224-abd9-427e-ac71-42420c83614f tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:14.014797 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34b4e224-abd9-427e-ac71-42420c83614f tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:14.015247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34b4e224-abd9-427e-ac71-42420c83614f tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:14.015669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34b4e224-abd9-427e-ac71-42420c83614f tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:14.022091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:05:14.158433 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-34b4e224-abd9-427e-ac71-42420c83614f tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:14.166600 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-34b4e224-abd9-427e-ac71-42420c83614f tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1521 microversion: 2.1 time: 0.172069 Aug 24 11:05:14.167193 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3155/6670] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:13 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:15.190381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b489ecbd-d782-41a8-a70c-235e155ed141 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:15.190979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b489ecbd-d782-41a8-a70c-235e155ed141 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:15.198516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b489ecbd-d782-41a8-a70c-235e155ed141 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:15.199073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b489ecbd-d782-41a8-a70c-235e155ed141 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:15.199560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b489ecbd-d782-41a8-a70c-235e155ed141 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:15.200272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b489ecbd-d782-41a8-a70c-235e155ed141 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:15.200734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b489ecbd-d782-41a8-a70c-235e155ed141 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:15.201177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b489ecbd-d782-41a8-a70c-235e155ed141 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:15.340311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b489ecbd-d782-41a8-a70c-235e155ed141 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:15.348502 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b489ecbd-d782-41a8-a70c-235e155ed141 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1521 microversion: 2.1 time: 0.164224 Aug 24 11:05:15.349112 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3516/6671] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:15 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:16.374347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-56a8512b-cb82-4cbc-aeec-af2488232b97 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:16.375356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-56a8512b-cb82-4cbc-aeec-af2488232b97 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:16.386939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56a8512b-cb82-4cbc-aeec-af2488232b97 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:16.387742 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56a8512b-cb82-4cbc-aeec-af2488232b97 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:16.388467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56a8512b-cb82-4cbc-aeec-af2488232b97 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:16.389801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56a8512b-cb82-4cbc-aeec-af2488232b97 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:16.390259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56a8512b-cb82-4cbc-aeec-af2488232b97 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:16.390685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56a8512b-cb82-4cbc-aeec-af2488232b97 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:16.537889 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-56a8512b-cb82-4cbc-aeec-af2488232b97 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:16.550243 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-56a8512b-cb82-4cbc-aeec-af2488232b97 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1521 microversion: 2.1 time: 0.182428 Aug 24 11:05:16.551119 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3156/6672] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:16 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:17.576674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ba5be4a1-d829-4a10-afcf-2ba186516c03 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:17.577547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ba5be4a1-d829-4a10-afcf-2ba186516c03 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:17.584750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba5be4a1-d829-4a10-afcf-2ba186516c03 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:17.585281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba5be4a1-d829-4a10-afcf-2ba186516c03 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:17.585787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba5be4a1-d829-4a10-afcf-2ba186516c03 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:17.586495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba5be4a1-d829-4a10-afcf-2ba186516c03 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:17.586957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba5be4a1-d829-4a10-afcf-2ba186516c03 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:17.587393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba5be4a1-d829-4a10-afcf-2ba186516c03 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:17.740644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ba5be4a1-d829-4a10-afcf-2ba186516c03 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:17.753347 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ba5be4a1-d829-4a10-afcf-2ba186516c03 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1521 microversion: 2.1 time: 0.183015 Aug 24 11:05:17.754129 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3517/6673] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:17 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:05:18.781473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9a3501e0-926a-4a02-8112-463bf105cafc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:18.781997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9a3501e0-926a-4a02-8112-463bf105cafc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:18.789708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a3501e0-926a-4a02-8112-463bf105cafc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:18.790200 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a3501e0-926a-4a02-8112-463bf105cafc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:18.790638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a3501e0-926a-4a02-8112-463bf105cafc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:18.791326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a3501e0-926a-4a02-8112-463bf105cafc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:18.791784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a3501e0-926a-4a02-8112-463bf105cafc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:18.792205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a3501e0-926a-4a02-8112-463bf105cafc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:18.934691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9a3501e0-926a-4a02-8112-463bf105cafc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:18.943149 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9a3501e0-926a-4a02-8112-463bf105cafc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1521 microversion: 2.1 time: 0.167713 Aug 24 11:05:18.943755 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3157/6674] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:18 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:19.967291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-09efdb6d-1af4-4e4f-91a5-f522056ff987 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:19.967892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-09efdb6d-1af4-4e4f-91a5-f522056ff987 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:19.977697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09efdb6d-1af4-4e4f-91a5-f522056ff987 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:19.978195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09efdb6d-1af4-4e4f-91a5-f522056ff987 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:19.978644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09efdb6d-1af4-4e4f-91a5-f522056ff987 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:19.979347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09efdb6d-1af4-4e4f-91a5-f522056ff987 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:19.979808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09efdb6d-1af4-4e4f-91a5-f522056ff987 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:19.980245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09efdb6d-1af4-4e4f-91a5-f522056ff987 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:20.127091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-09efdb6d-1af4-4e4f-91a5-f522056ff987 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:20.135269 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-09efdb6d-1af4-4e4f-91a5-f522056ff987 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1521 microversion: 2.1 time: 0.173735 Aug 24 11:05:20.135863 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3518/6675] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:19 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:21.158711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-410aa4b7-7d11-4160-b22a-1315a13db808 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:21.159447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-410aa4b7-7d11-4160-b22a-1315a13db808 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:21.168189 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-410aa4b7-7d11-4160-b22a-1315a13db808 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:21.168681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-410aa4b7-7d11-4160-b22a-1315a13db808 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:21.169162 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-410aa4b7-7d11-4160-b22a-1315a13db808 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:21.169891 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-410aa4b7-7d11-4160-b22a-1315a13db808 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:21.170348 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-410aa4b7-7d11-4160-b22a-1315a13db808 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:21.170762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-410aa4b7-7d11-4160-b22a-1315a13db808 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:21.320964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-410aa4b7-7d11-4160-b22a-1315a13db808 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:21.329316 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-410aa4b7-7d11-4160-b22a-1315a13db808 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1521 microversion: 2.1 time: 0.176296 Aug 24 11:05:21.329892 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3158/6676] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:21 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:22.355034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8b723833-b6df-4284-aebd-fbf5edc030bc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:22.356118 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8b723833-b6df-4284-aebd-fbf5edc030bc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:22.364579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b723833-b6df-4284-aebd-fbf5edc030bc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:22.365007 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b723833-b6df-4284-aebd-fbf5edc030bc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:22.365499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b723833-b6df-4284-aebd-fbf5edc030bc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:22.366209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b723833-b6df-4284-aebd-fbf5edc030bc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:22.366681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b723833-b6df-4284-aebd-fbf5edc030bc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:22.367111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b723833-b6df-4284-aebd-fbf5edc030bc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:22.509332 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8b723833-b6df-4284-aebd-fbf5edc030bc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:22.517513 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8b723833-b6df-4284-aebd-fbf5edc030bc tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1521 microversion: 2.1 time: 0.169612 Aug 24 11:05:22.518223 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3519/6677] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:22 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:23.140305 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-16d3e9a0-dadb-4e48-8516-f74c1ff39ac7 req-c6e7e21b-edd9-4f5c-9c48-7a9fdb81a032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d33464-c5b1-49ba-a850-4078da5039de", "name": "network-vif-unplugged", "status": "completed", "tag": "21f878d5-044d-4c5b-b465-11e66502a8c4"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:05:23.152147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-16d3e9a0-dadb-4e48-8516-f74c1ff39ac7 req-c6e7e21b-edd9-4f5c-9c48-7a9fdb81a032 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:23.152626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-16d3e9a0-dadb-4e48-8516-f74c1ff39ac7 req-c6e7e21b-edd9-4f5c-9c48-7a9fdb81a032 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:23.153049 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-16d3e9a0-dadb-4e48-8516-f74c1ff39ac7 req-c6e7e21b-edd9-4f5c-9c48-7a9fdb81a032 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:23.165715 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-16d3e9a0-dadb-4e48-8516-f74c1ff39ac7 req-c6e7e21b-edd9-4f5c-9c48-7a9fdb81a032 service nova] Creating event network-vif-unplugged:21f878d5-044d-4c5b-b465-11e66502a8c4 for instance 68d33464-c5b1-49ba-a850-4078da5039de on n-h2-849328-3 Aug 24 11:05:23.171648 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-16d3e9a0-dadb-4e48-8516-f74c1ff39ac7 req-c6e7e21b-edd9-4f5c-9c48-7a9fdb81a032 service nova] Instance 68d33464-c5b1-49ba-a850-4078da5039de is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 11:05:23.183018 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-16d3e9a0-dadb-4e48-8516-f74c1ff39ac7 req-c6e7e21b-edd9-4f5c-9c48-7a9fdb81a032 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046662 Aug 24 11:05:23.183749 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3159/6678] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:05:23.537967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fad05961-5960-4f74-be54-03f8ca33af4d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:23.538598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fad05961-5960-4f74-be54-03f8ca33af4d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:23.547092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad05961-5960-4f74-be54-03f8ca33af4d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:23.547836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad05961-5960-4f74-be54-03f8ca33af4d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:23.548575 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad05961-5960-4f74-be54-03f8ca33af4d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:23.549331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad05961-5960-4f74-be54-03f8ca33af4d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:23.549802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad05961-5960-4f74-be54-03f8ca33af4d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:23.550260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad05961-5960-4f74-be54-03f8ca33af4d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:23.689924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fad05961-5960-4f74-be54-03f8ca33af4d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:23.698216 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fad05961-5960-4f74-be54-03f8ca33af4d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1520 microversion: 2.1 time: 0.164235 Aug 24 11:05:23.698840 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3520/6679] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:23 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:24.721562 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-893b806c-22bf-4b5d-8f84-8e052391b9f6 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:24.722289 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-893b806c-22bf-4b5d-8f84-8e052391b9f6 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:24.729736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-893b806c-22bf-4b5d-8f84-8e052391b9f6 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:24.730225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-893b806c-22bf-4b5d-8f84-8e052391b9f6 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:24.730655 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-893b806c-22bf-4b5d-8f84-8e052391b9f6 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:24.731375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-893b806c-22bf-4b5d-8f84-8e052391b9f6 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:24.731827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-893b806c-22bf-4b5d-8f84-8e052391b9f6 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:24.732255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-893b806c-22bf-4b5d-8f84-8e052391b9f6 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:24.879121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-893b806c-22bf-4b5d-8f84-8e052391b9f6 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:24.888217 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-893b806c-22bf-4b5d-8f84-8e052391b9f6 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1518 microversion: 2.1 time: 0.172001 Aug 24 11:05:24.888845 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3160/6680] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:24 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:25.213892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-28194b52-141b-4b2e-8b1a-8e26159bfda0 req-5628f5a0-676e-49ca-b410-ad806daa45ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68d33464-c5b1-49ba-a850-4078da5039de", "tag": "21f878d5-044d-4c5b-b465-11e66502a8c4"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:05:25.230885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-28194b52-141b-4b2e-8b1a-8e26159bfda0 req-5628f5a0-676e-49ca-b410-ad806daa45ec service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:25.231891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-28194b52-141b-4b2e-8b1a-8e26159bfda0 req-5628f5a0-676e-49ca-b410-ad806daa45ec service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:25.232337 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-28194b52-141b-4b2e-8b1a-8e26159bfda0 req-5628f5a0-676e-49ca-b410-ad806daa45ec service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:25.245829 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-28194b52-141b-4b2e-8b1a-8e26159bfda0 req-5628f5a0-676e-49ca-b410-ad806daa45ec service nova] Creating event network-changed:21f878d5-044d-4c5b-b465-11e66502a8c4 for instance 68d33464-c5b1-49ba-a850-4078da5039de on n-h2-849328-3 Aug 24 11:05:25.252089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-28194b52-141b-4b2e-8b1a-8e26159bfda0 req-5628f5a0-676e-49ca-b410-ad806daa45ec service nova] Instance 68d33464-c5b1-49ba-a850-4078da5039de is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 11:05:25.263840 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-28194b52-141b-4b2e-8b1a-8e26159bfda0 req-5628f5a0-676e-49ca-b410-ad806daa45ec service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054882 Aug 24 11:05:25.264465 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3521/6681] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:05:25.909730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6ac5194f-5a76-456a-a3ef-48973c5364c8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:25.910374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6ac5194f-5a76-456a-a3ef-48973c5364c8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:25.917862 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ac5194f-5a76-456a-a3ef-48973c5364c8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:25.918356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ac5194f-5a76-456a-a3ef-48973c5364c8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:25.918808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ac5194f-5a76-456a-a3ef-48973c5364c8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:25.919607 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ac5194f-5a76-456a-a3ef-48973c5364c8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:25.920064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ac5194f-5a76-456a-a3ef-48973c5364c8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:25.920476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ac5194f-5a76-456a-a3ef-48973c5364c8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:26.564471 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6ac5194f-5a76-456a-a3ef-48973c5364c8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:26.574070 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6ac5194f-5a76-456a-a3ef-48973c5364c8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1515 microversion: 2.1 time: 0.668418 Aug 24 11:05:26.574675 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3161/6682] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:25 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1515 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:26.597391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fc175d73-564e-46f9-ab37-0ffba42f784b tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:05:26.598026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fc175d73-564e-46f9-ab37-0ffba42f784b tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:26.604882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc175d73-564e-46f9-ab37-0ffba42f784b tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:26.605631 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc175d73-564e-46f9-ab37-0ffba42f784b tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:26.606304 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc175d73-564e-46f9-ab37-0ffba42f784b tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:26.607032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc175d73-564e-46f9-ab37-0ffba42f784b tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:26.607507 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc175d73-564e-46f9-ab37-0ffba42f784b tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:26.607949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc175d73-564e-46f9-ab37-0ffba42f784b tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:26.669599 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fc175d73-564e-46f9-ab37-0ffba42f784b tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "POST /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de/action" status: 204 len: 0 microversion: 2.1 time: 0.077338 Aug 24 11:05:26.670178 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3522/6683] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:05:26 2022] POST /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:05:26.679480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aeb7218a-2df3-4097-894e-e23e94a487d2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:26.680119 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aeb7218a-2df3-4097-894e-e23e94a487d2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:26.686705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aeb7218a-2df3-4097-894e-e23e94a487d2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:26.687183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aeb7218a-2df3-4097-894e-e23e94a487d2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:26.687636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aeb7218a-2df3-4097-894e-e23e94a487d2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:26.688334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aeb7218a-2df3-4097-894e-e23e94a487d2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:26.688780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aeb7218a-2df3-4097-894e-e23e94a487d2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:26.689361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aeb7218a-2df3-4097-894e-e23e94a487d2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:26.895116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aeb7218a-2df3-4097-894e-e23e94a487d2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:26.903966 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aeb7218a-2df3-4097-894e-e23e94a487d2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1515 microversion: 2.1 time: 0.229070 Aug 24 11:05:26.904581 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3162/6684] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:26 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1515 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:27.930217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f8f31f78-564a-470a-b2a6-87cf4191d1d7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:27.931039 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f8f31f78-564a-470a-b2a6-87cf4191d1d7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:27.939696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8f31f78-564a-470a-b2a6-87cf4191d1d7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:27.940210 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8f31f78-564a-470a-b2a6-87cf4191d1d7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:27.940677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8f31f78-564a-470a-b2a6-87cf4191d1d7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:27.941442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8f31f78-564a-470a-b2a6-87cf4191d1d7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:27.941914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8f31f78-564a-470a-b2a6-87cf4191d1d7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:27.942350 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8f31f78-564a-470a-b2a6-87cf4191d1d7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:28.089149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f8f31f78-564a-470a-b2a6-87cf4191d1d7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:28.098714 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f8f31f78-564a-470a-b2a6-87cf4191d1d7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1507 microversion: 2.1 time: 0.173988 Aug 24 11:05:28.099402 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3523/6685] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:27 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:28.123317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-99613227-616f-44c1-9fe8-bfcb36c184d2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:28.123922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-99613227-616f-44c1-9fe8-bfcb36c184d2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:28.127256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=30 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:05:28.136137 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99613227-616f-44c1-9fe8-bfcb36c184d2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:28.136636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99613227-616f-44c1-9fe8-bfcb36c184d2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:28.137079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99613227-616f-44c1-9fe8-bfcb36c184d2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:28.137834 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99613227-616f-44c1-9fe8-bfcb36c184d2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:28.138272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99613227-616f-44c1-9fe8-bfcb36c184d2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:28.138716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99613227-616f-44c1-9fe8-bfcb36c184d2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:28.272414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-99613227-616f-44c1-9fe8-bfcb36c184d2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:28.280630 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-99613227-616f-44c1-9fe8-bfcb36c184d2 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1507 microversion: 2.1 time: 0.161269 Aug 24 11:05:28.281224 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3163/6686] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:28 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:28.304122 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f8e35efe-4eea-43a2-ac3f-c506571a50ec tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Action: 'create', calling method: .version_select at 0x7f4654f0b820>, body: {"keypair": {"name": "tempest-keypair-1543710140", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLx6C8y66AawL5gsiqz1RDW0ITnKcbCTaaQtW/30llYgGp8MA2Q4r/+g7lVK0LJYPJrTwAbAIPYxDviEkiqAItcBz/+5IBS0j4J0b196X7r54YLUBtP0TolBEfoiEaPsRg=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:05:28.320542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f8e35efe-4eea-43a2-ac3f-c506571a50ec tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Getting quotas for project 6dcb817ffa24404ab42a2a036d7c8ba6. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:05:28.326007 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f8e35efe-4eea-43a2-ac3f-c506571a50ec tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Getting quotas for user 076b20c8d634432bb5c1773d56892a32 and project 6dcb817ffa24404ab42a2a036d7c8ba6. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:05:28.354842 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f8e35efe-4eea-43a2-ac3f-c506571a50ec tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054666 Aug 24 11:05:28.355474 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3524/6687] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 11:05:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:05:29.442699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-b15464c7-dc6b-425a-b137-33b3d06d6697 req-6837b428-e84d-4256-a3e6-4710d62fc779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d33464-c5b1-49ba-a850-4078da5039de", "name": "network-vif-plugged", "status": "completed", "tag": "21f878d5-044d-4c5b-b465-11e66502a8c4"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:05:29.456043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b15464c7-dc6b-425a-b137-33b3d06d6697 req-6837b428-e84d-4256-a3e6-4710d62fc779 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:29.456638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b15464c7-dc6b-425a-b137-33b3d06d6697 req-6837b428-e84d-4256-a3e6-4710d62fc779 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:29.457650 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b15464c7-dc6b-425a-b137-33b3d06d6697 req-6837b428-e84d-4256-a3e6-4710d62fc779 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:29.472245 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b15464c7-dc6b-425a-b137-33b3d06d6697 req-6837b428-e84d-4256-a3e6-4710d62fc779 service nova] Creating event network-vif-plugged:21f878d5-044d-4c5b-b465-11e66502a8c4 for instance 68d33464-c5b1-49ba-a850-4078da5039de on n-h2-849328-3 Aug 24 11:05:29.478731 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-b15464c7-dc6b-425a-b137-33b3d06d6697 req-6837b428-e84d-4256-a3e6-4710d62fc779 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041535 Aug 24 11:05:29.479671 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3164/6688] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:05:29.603232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-75bbfb07-a69b-49d1-a4d3-f8787280c6ba tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:29.603868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-75bbfb07-a69b-49d1-a4d3-f8787280c6ba tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:29.605879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:05:29.612280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75bbfb07-a69b-49d1-a4d3-f8787280c6ba tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:29.612786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75bbfb07-a69b-49d1-a4d3-f8787280c6ba tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:29.613273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75bbfb07-a69b-49d1-a4d3-f8787280c6ba tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:29.613999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75bbfb07-a69b-49d1-a4d3-f8787280c6ba tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:29.614499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75bbfb07-a69b-49d1-a4d3-f8787280c6ba tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:29.614941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75bbfb07-a69b-49d1-a4d3-f8787280c6ba tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:29.618545 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:05:29.751558 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-75bbfb07-a69b-49d1-a4d3-f8787280c6ba tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:29.759776 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-75bbfb07-a69b-49d1-a4d3-f8787280c6ba tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 200 len: 1507 microversion: 2.1 time: 0.162117 Aug 24 11:05:29.760445 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3525/6689] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:29 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:29.782045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-de32575e-8f46-488d-af2c-a6042d6a008a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:29.782642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-de32575e-8f46-488d-af2c-a6042d6a008a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:29.789340 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de32575e-8f46-488d-af2c-a6042d6a008a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:29.789830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de32575e-8f46-488d-af2c-a6042d6a008a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:29.790272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de32575e-8f46-488d-af2c-a6042d6a008a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:29.790960 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de32575e-8f46-488d-af2c-a6042d6a008a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:29.791410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de32575e-8f46-488d-af2c-a6042d6a008a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:29.791838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de32575e-8f46-488d-af2c-a6042d6a008a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:29.816976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-de32575e-8f46-488d-af2c-a6042d6a008a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:05:29.899391 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-de32575e-8f46-488d-af2c-a6042d6a008a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "DELETE /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 204 len: 0 microversion: 2.1 time: 0.120887 Aug 24 11:05:29.900171 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3165/6690] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:05:29 2022] DELETE /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 11:05:29.965134 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c59d048d-4cc8-4e57-89ab-9543c954e38c tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1060645579", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "19439d20-5a96-4b08-9b42-b79f358981f7"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:05:30.020916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-c59d048d-4cc8-4e57-89ab-9543c954e38c tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] validate_networks() for [('19439d20-5a96-4b08-9b42-b79f358981f7', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:05:30.415882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c59d048d-4cc8-4e57-89ab-9543c954e38c tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:05:30.416322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c59d048d-4cc8-4e57-89ab-9543c954e38c tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:05:30.416807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c59d048d-4cc8-4e57-89ab-9543c954e38c tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:05:30.417252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c59d048d-4cc8-4e57-89ab-9543c954e38c tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:05:30.417664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c59d048d-4cc8-4e57-89ab-9543c954e38c tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:05:30.431188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c59d048d-4cc8-4e57-89ab-9543c954e38c tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:30.431795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c59d048d-4cc8-4e57-89ab-9543c954e38c tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:30.432371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c59d048d-4cc8-4e57-89ab-9543c954e38c tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:30.433095 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c59d048d-4cc8-4e57-89ab-9543c954e38c tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:30.433594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c59d048d-4cc8-4e57-89ab-9543c954e38c tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:30.434239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c59d048d-4cc8-4e57-89ab-9543c954e38c tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:30.454167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-c59d048d-4cc8-4e57-89ab-9543c954e38c tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Getting quotas for project 6dcb817ffa24404ab42a2a036d7c8ba6. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:05:30.459852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-c59d048d-4cc8-4e57-89ab-9543c954e38c tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Getting quotas for user 076b20c8d634432bb5c1773d56892a32 and project 6dcb817ffa24404ab42a2a036d7c8ba6. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:05:30.472631 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c59d048d-4cc8-4e57-89ab-9543c954e38c tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:05:30.475374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c59d048d-4cc8-4e57-89ab-9543c954e38c tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:05:30.523650 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c59d048d-4cc8-4e57-89ab-9543c954e38c tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562471 Aug 24 11:05:30.524320 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3526/6691] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 11:05:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:05:30.536738 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-29e6eb43-623d-4efd-8dfa-897775acb6f7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:30.537475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-29e6eb43-623d-4efd-8dfa-897775acb6f7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:30.603277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-29e6eb43-623d-4efd-8dfa-897775acb6f7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:30.611554 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-29e6eb43-623d-4efd-8dfa-897775acb6f7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1218 microversion: 2.1 time: 0.079933 Aug 24 11:05:30.612155 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3166/6692] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:30 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:31.633705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-27582b83-6a02-4300-b917-bf11e45ba8a7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:31.634751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-27582b83-6a02-4300-b917-bf11e45ba8a7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:31.642222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27582b83-6a02-4300-b917-bf11e45ba8a7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:31.642721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27582b83-6a02-4300-b917-bf11e45ba8a7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:31.643165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27582b83-6a02-4300-b917-bf11e45ba8a7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:31.643891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27582b83-6a02-4300-b917-bf11e45ba8a7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:31.644342 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27582b83-6a02-4300-b917-bf11e45ba8a7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:31.644749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27582b83-6a02-4300-b917-bf11e45ba8a7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:31.712965 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-27582b83-6a02-4300-b917-bf11e45ba8a7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:31.721488 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-27582b83-6a02-4300-b917-bf11e45ba8a7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1270 microversion: 2.1 time: 0.093126 Aug 24 11:05:31.722115 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3527/6693] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:31 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:31.895838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-7b4b38ff-1a67-47ad-8799-0db61d86992c req-21222316-c8cd-4b53-89e4-bf769db8cad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d33464-c5b1-49ba-a850-4078da5039de", "name": "network-vif-deleted", "tag": "21f878d5-044d-4c5b-b465-11e66502a8c4"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:05:31.907213 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7b4b38ff-1a67-47ad-8799-0db61d86992c req-21222316-c8cd-4b53-89e4-bf769db8cad7 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:31.907796 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7b4b38ff-1a67-47ad-8799-0db61d86992c req-21222316-c8cd-4b53-89e4-bf769db8cad7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:31.908538 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7b4b38ff-1a67-47ad-8799-0db61d86992c req-21222316-c8cd-4b53-89e4-bf769db8cad7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:31.921984 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7b4b38ff-1a67-47ad-8799-0db61d86992c req-21222316-c8cd-4b53-89e4-bf769db8cad7 service nova] Creating event network-vif-deleted:21f878d5-044d-4c5b-b465-11e66502a8c4 for instance 68d33464-c5b1-49ba-a850-4078da5039de on n-h2-849328-3 Aug 24 11:05:31.927050 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-7b4b38ff-1a67-47ad-8799-0db61d86992c req-21222316-c8cd-4b53-89e4-bf769db8cad7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035013 Aug 24 11:05:31.927691 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3167/6694] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:05:32.745351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4033f4d3-8071-406e-8370-01b61904a836 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:32.746291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4033f4d3-8071-406e-8370-01b61904a836 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:32.755644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4033f4d3-8071-406e-8370-01b61904a836 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:32.756415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4033f4d3-8071-406e-8370-01b61904a836 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:32.757083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4033f4d3-8071-406e-8370-01b61904a836 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:32.759280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4033f4d3-8071-406e-8370-01b61904a836 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:32.760017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4033f4d3-8071-406e-8370-01b61904a836 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:32.760667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4033f4d3-8071-406e-8370-01b61904a836 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:32.933798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4033f4d3-8071-406e-8370-01b61904a836 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:32.947393 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4033f4d3-8071-406e-8370-01b61904a836 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1318 microversion: 2.1 time: 0.205574 Aug 24 11:05:32.963103 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3528/6695] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:32 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:33.943775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-66b4d367-a864-49a2-830b-ddc65577ca78 req-b33e1ea2-de53-4164-bd6e-1237b7f15eef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be84088b-5ff0-4ef4-a8ff-34313e52ad60", "tag": "0dbccdbd-e31d-4112-addf-212be4a4c7ee"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:05:33.953561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-66b4d367-a864-49a2-830b-ddc65577ca78 req-b33e1ea2-de53-4164-bd6e-1237b7f15eef service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:33.954034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-66b4d367-a864-49a2-830b-ddc65577ca78 req-b33e1ea2-de53-4164-bd6e-1237b7f15eef service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:33.954459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-66b4d367-a864-49a2-830b-ddc65577ca78 req-b33e1ea2-de53-4164-bd6e-1237b7f15eef service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:33.967975 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-66b4d367-a864-49a2-830b-ddc65577ca78 req-b33e1ea2-de53-4164-bd6e-1237b7f15eef service nova] Creating event network-changed:0dbccdbd-e31d-4112-addf-212be4a4c7ee for instance be84088b-5ff0-4ef4-a8ff-34313e52ad60 on n-h2-849328-3 Aug 24 11:05:33.970583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de599d77-2eef-4938-a717-7efd5cea0288 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:33.971435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-de599d77-2eef-4938-a717-7efd5cea0288 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:33.973436 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-66b4d367-a864-49a2-830b-ddc65577ca78 req-b33e1ea2-de53-4164-bd6e-1237b7f15eef service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034698 Aug 24 11:05:33.974040 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3168/6696] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:05:33.979319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de599d77-2eef-4938-a717-7efd5cea0288 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:33.979849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de599d77-2eef-4938-a717-7efd5cea0288 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:33.980410 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de599d77-2eef-4938-a717-7efd5cea0288 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:33.981203 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de599d77-2eef-4938-a717-7efd5cea0288 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:33.981698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de599d77-2eef-4938-a717-7efd5cea0288 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:33.982131 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de599d77-2eef-4938-a717-7efd5cea0288 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:34.118498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-de599d77-2eef-4938-a717-7efd5cea0288 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:34.127589 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-de599d77-2eef-4938-a717-7efd5cea0288 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1318 microversion: 2.1 time: 0.160799 Aug 24 11:05:34.128187 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3529/6697] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:33 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:05:35.151369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7cb65b12-7e2c-427b-adb4-a03e68ba1a8a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:35.152189 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7cb65b12-7e2c-427b-adb4-a03e68ba1a8a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:35.159060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cb65b12-7e2c-427b-adb4-a03e68ba1a8a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:35.159551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cb65b12-7e2c-427b-adb4-a03e68ba1a8a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:35.160051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cb65b12-7e2c-427b-adb4-a03e68ba1a8a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:35.160839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cb65b12-7e2c-427b-adb4-a03e68ba1a8a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:35.161374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cb65b12-7e2c-427b-adb4-a03e68ba1a8a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:35.161876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cb65b12-7e2c-427b-adb4-a03e68ba1a8a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:35.377030 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7cb65b12-7e2c-427b-adb4-a03e68ba1a8a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:35.385393 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7cb65b12-7e2c-427b-adb4-a03e68ba1a8a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1318 microversion: 2.1 time: 0.239174 Aug 24 11:05:35.386053 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3169/6698] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:35 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:36.411248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f06ce825-72ca-4570-9873-1169f9294723 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:36.412433 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f06ce825-72ca-4570-9873-1169f9294723 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:36.423882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f06ce825-72ca-4570-9873-1169f9294723 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:36.424380 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f06ce825-72ca-4570-9873-1169f9294723 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:36.424821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f06ce825-72ca-4570-9873-1169f9294723 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:36.425554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f06ce825-72ca-4570-9873-1169f9294723 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:36.426020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f06ce825-72ca-4570-9873-1169f9294723 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:36.426443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f06ce825-72ca-4570-9873-1169f9294723 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:36.562543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f06ce825-72ca-4570-9873-1169f9294723 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:36.570495 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f06ce825-72ca-4570-9873-1169f9294723 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1318 microversion: 2.1 time: 0.165981 Aug 24 11:05:36.571068 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3530/6699] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:36 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:37.490698 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-93046230-c6eb-43fb-af57-7c518cd765eb req-3b75fe45-213e-449e-b0a6-3c6d6a92fe63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be84088b-5ff0-4ef4-a8ff-34313e52ad60", "name": "network-vif-plugged", "status": "completed", "tag": "0dbccdbd-e31d-4112-addf-212be4a4c7ee"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:05:37.501026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-93046230-c6eb-43fb-af57-7c518cd765eb req-3b75fe45-213e-449e-b0a6-3c6d6a92fe63 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:37.501719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-93046230-c6eb-43fb-af57-7c518cd765eb req-3b75fe45-213e-449e-b0a6-3c6d6a92fe63 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:37.502192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-93046230-c6eb-43fb-af57-7c518cd765eb req-3b75fe45-213e-449e-b0a6-3c6d6a92fe63 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:37.514593 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-93046230-c6eb-43fb-af57-7c518cd765eb req-3b75fe45-213e-449e-b0a6-3c6d6a92fe63 service nova] Creating event network-vif-plugged:0dbccdbd-e31d-4112-addf-212be4a4c7ee for instance be84088b-5ff0-4ef4-a8ff-34313e52ad60 on n-h2-849328-3 Aug 24 11:05:37.519586 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-93046230-c6eb-43fb-af57-7c518cd765eb req-3b75fe45-213e-449e-b0a6-3c6d6a92fe63 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032856 Aug 24 11:05:37.520200 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3170/6700] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:05:37.594430 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7a01d79b-abc1-497a-8b9e-a211c4166bf0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:37.595037 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7a01d79b-abc1-497a-8b9e-a211c4166bf0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:37.603305 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a01d79b-abc1-497a-8b9e-a211c4166bf0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:37.603921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a01d79b-abc1-497a-8b9e-a211c4166bf0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:37.604428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a01d79b-abc1-497a-8b9e-a211c4166bf0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:37.605179 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a01d79b-abc1-497a-8b9e-a211c4166bf0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:37.605691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a01d79b-abc1-497a-8b9e-a211c4166bf0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:37.606121 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a01d79b-abc1-497a-8b9e-a211c4166bf0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:37.754151 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7a01d79b-abc1-497a-8b9e-a211c4166bf0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:37.761978 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7a01d79b-abc1-497a-8b9e-a211c4166bf0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1318 microversion: 2.1 time: 0.171605 Aug 24 11:05:37.762562 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3531/6701] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:37 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:38.784539 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fc117ef8-4de6-4854-aabc-20e9f3447802 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:38.785366 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fc117ef8-4de6-4854-aabc-20e9f3447802 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:38.792941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc117ef8-4de6-4854-aabc-20e9f3447802 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:38.793465 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc117ef8-4de6-4854-aabc-20e9f3447802 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:38.793898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc117ef8-4de6-4854-aabc-20e9f3447802 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:38.794605 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc117ef8-4de6-4854-aabc-20e9f3447802 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:38.795052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc117ef8-4de6-4854-aabc-20e9f3447802 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:38.795502 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc117ef8-4de6-4854-aabc-20e9f3447802 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:38.933012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fc117ef8-4de6-4854-aabc-20e9f3447802 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:38.941178 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fc117ef8-4de6-4854-aabc-20e9f3447802 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1318 microversion: 2.1 time: 0.162059 Aug 24 11:05:38.941862 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3171/6702] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:38 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:39.963029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7292de5f-5ed0-40b4-bc76-5086aa2775d0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:39.963656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7292de5f-5ed0-40b4-bc76-5086aa2775d0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:39.971163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7292de5f-5ed0-40b4-bc76-5086aa2775d0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:39.971660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7292de5f-5ed0-40b4-bc76-5086aa2775d0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:39.972102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7292de5f-5ed0-40b4-bc76-5086aa2775d0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:39.972809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7292de5f-5ed0-40b4-bc76-5086aa2775d0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:39.973307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7292de5f-5ed0-40b4-bc76-5086aa2775d0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:39.973742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7292de5f-5ed0-40b4-bc76-5086aa2775d0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:40.109945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7292de5f-5ed0-40b4-bc76-5086aa2775d0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:40.118264 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7292de5f-5ed0-40b4-bc76-5086aa2775d0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1508 microversion: 2.1 time: 0.159311 Aug 24 11:05:40.118854 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3532/6703] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:39 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:40.138609 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-114e00b9-3e1c-4cc9-b550-f91995b5aac3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:40.139259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-114e00b9-3e1c-4cc9-b550-f91995b5aac3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:40.146594 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-114e00b9-3e1c-4cc9-b550-f91995b5aac3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:40.147081 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-114e00b9-3e1c-4cc9-b550-f91995b5aac3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:40.147534 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-114e00b9-3e1c-4cc9-b550-f91995b5aac3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:40.148205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-114e00b9-3e1c-4cc9-b550-f91995b5aac3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:40.148654 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-114e00b9-3e1c-4cc9-b550-f91995b5aac3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:40.149077 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-114e00b9-3e1c-4cc9-b550-f91995b5aac3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:40.283111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-114e00b9-3e1c-4cc9-b550-f91995b5aac3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:40.291511 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-114e00b9-3e1c-4cc9-b550-f91995b5aac3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1508 microversion: 2.1 time: 0.156793 Aug 24 11:05:40.292119 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3172/6704] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:40 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:40.312583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-efb0ee41-d800-49f4-84d8-f8dd8e858cc9 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:05:40.315063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-efb0ee41-d800-49f4-84d8-f8dd8e858cc9 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:40.321635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efb0ee41-d800-49f4-84d8-f8dd8e858cc9 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:40.322139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efb0ee41-d800-49f4-84d8-f8dd8e858cc9 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:40.322595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efb0ee41-d800-49f4-84d8-f8dd8e858cc9 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:40.323301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efb0ee41-d800-49f4-84d8-f8dd8e858cc9 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:40.323776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efb0ee41-d800-49f4-84d8-f8dd8e858cc9 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:40.324216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efb0ee41-d800-49f4-84d8-f8dd8e858cc9 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:40.357427 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-efb0ee41-d800-49f4-84d8-f8dd8e858cc9 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:40.363587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-efb0ee41-d800-49f4-84d8-f8dd8e858cc9 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Old instance type m1.heat2, new instance type m1.heat {{(pid=122433) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 11:05:40.370560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-efb0ee41-d800-49f4-84d8-f8dd8e858cc9 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:05:40.371036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-efb0ee41-d800-49f4-84d8-f8dd8e858cc9 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:05:40.371518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-efb0ee41-d800-49f4-84d8-f8dd8e858cc9 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:05:40.371943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-efb0ee41-d800-49f4-84d8-f8dd8e858cc9 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:05:40.372368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-efb0ee41-d800-49f4-84d8-f8dd8e858cc9 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:05:40.437567 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-efb0ee41-d800-49f4-84d8-f8dd8e858cc9 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "POST /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60/action" status: 202 len: 0 microversion: 2.1 time: 0.128957 Aug 24 11:05:40.438195 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3533/6705] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:05:40 2022] POST /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:05:40.446666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e8a35439-e635-492a-b44a-8532cad626ba tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:40.447278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e8a35439-e635-492a-b44a-8532cad626ba tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:40.453305 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8a35439-e635-492a-b44a-8532cad626ba tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:40.453793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8a35439-e635-492a-b44a-8532cad626ba tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:40.454226 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8a35439-e635-492a-b44a-8532cad626ba tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:40.454924 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8a35439-e635-492a-b44a-8532cad626ba tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:40.455357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8a35439-e635-492a-b44a-8532cad626ba tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:40.455778 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8a35439-e635-492a-b44a-8532cad626ba tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:40.587519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e8a35439-e635-492a-b44a-8532cad626ba tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:40.597524 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e8a35439-e635-492a-b44a-8532cad626ba tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1515 microversion: 2.1 time: 0.154550 Aug 24 11:05:40.598285 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3173/6706] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:40 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:41.616052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:05:41.616777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=10 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:05:41.621621 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7c38d009-7185-44fa-96f8-a9fb269db650 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:41.622248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7c38d009-7185-44fa-96f8-a9fb269db650 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:41.630174 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c38d009-7185-44fa-96f8-a9fb269db650 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:41.630667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c38d009-7185-44fa-96f8-a9fb269db650 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:41.631107 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c38d009-7185-44fa-96f8-a9fb269db650 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:41.631792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c38d009-7185-44fa-96f8-a9fb269db650 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:41.632254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c38d009-7185-44fa-96f8-a9fb269db650 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:41.632689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c38d009-7185-44fa-96f8-a9fb269db650 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:41.767556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7c38d009-7185-44fa-96f8-a9fb269db650 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:41.776864 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7c38d009-7185-44fa-96f8-a9fb269db650 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1515 microversion: 2.1 time: 0.161594 Aug 24 11:05:41.777718 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3534/6707] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:41 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:42.798400 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d98d29dc-99fe-4669-918d-841369e17e75 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:42.798954 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d98d29dc-99fe-4669-918d-841369e17e75 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:42.801192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:05:42.808017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d98d29dc-99fe-4669-918d-841369e17e75 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:42.808506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d98d29dc-99fe-4669-918d-841369e17e75 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:42.808946 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d98d29dc-99fe-4669-918d-841369e17e75 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:42.809686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d98d29dc-99fe-4669-918d-841369e17e75 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:42.810138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d98d29dc-99fe-4669-918d-841369e17e75 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:42.810565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d98d29dc-99fe-4669-918d-841369e17e75 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:42.814626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:05:42.946311 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d98d29dc-99fe-4669-918d-841369e17e75 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:42.954680 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d98d29dc-99fe-4669-918d-841369e17e75 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1520 microversion: 2.1 time: 0.160320 Aug 24 11:05:42.955248 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3174/6708] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:42 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:43.976677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4b62d218-c772-4866-b545-57a4d343d92e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:43.977347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4b62d218-c772-4866-b545-57a4d343d92e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:43.984775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b62d218-c772-4866-b545-57a4d343d92e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:43.985321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b62d218-c772-4866-b545-57a4d343d92e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:43.985809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b62d218-c772-4866-b545-57a4d343d92e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:43.986525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b62d218-c772-4866-b545-57a4d343d92e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:43.987000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b62d218-c772-4866-b545-57a4d343d92e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:43.987448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b62d218-c772-4866-b545-57a4d343d92e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:44.120902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4b62d218-c772-4866-b545-57a4d343d92e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:44.129371 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4b62d218-c772-4866-b545-57a4d343d92e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1520 microversion: 2.1 time: 0.157084 Aug 24 11:05:44.130002 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3535/6709] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:43 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:45.150261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-17a079cd-a159-4121-b4b6-064a0adc0912 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:45.150870 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-17a079cd-a159-4121-b4b6-064a0adc0912 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:45.158552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17a079cd-a159-4121-b4b6-064a0adc0912 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:45.159046 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17a079cd-a159-4121-b4b6-064a0adc0912 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:45.159472 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17a079cd-a159-4121-b4b6-064a0adc0912 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:45.160260 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17a079cd-a159-4121-b4b6-064a0adc0912 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:45.160709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17a079cd-a159-4121-b4b6-064a0adc0912 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:45.161156 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17a079cd-a159-4121-b4b6-064a0adc0912 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:45.304857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-17a079cd-a159-4121-b4b6-064a0adc0912 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:45.313293 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-17a079cd-a159-4121-b4b6-064a0adc0912 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1520 microversion: 2.1 time: 0.166909 Aug 24 11:05:45.313893 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3175/6710] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:45 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:46.335405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cf67cb84-5d6f-4520-adc2-7c94ef4b58f7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:46.336079 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cf67cb84-5d6f-4520-adc2-7c94ef4b58f7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:46.343438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf67cb84-5d6f-4520-adc2-7c94ef4b58f7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:46.343945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf67cb84-5d6f-4520-adc2-7c94ef4b58f7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:46.344389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf67cb84-5d6f-4520-adc2-7c94ef4b58f7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:46.345102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf67cb84-5d6f-4520-adc2-7c94ef4b58f7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:46.345603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf67cb84-5d6f-4520-adc2-7c94ef4b58f7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:46.346044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf67cb84-5d6f-4520-adc2-7c94ef4b58f7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:46.480983 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cf67cb84-5d6f-4520-adc2-7c94ef4b58f7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:46.489065 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cf67cb84-5d6f-4520-adc2-7c94ef4b58f7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1520 microversion: 2.1 time: 0.157848 Aug 24 11:05:46.489719 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3536/6711] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:46 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:47.510612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fb396f8a-491e-4fb2-bbff-2c13199bbd09 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:47.511231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fb396f8a-491e-4fb2-bbff-2c13199bbd09 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:47.518930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb396f8a-491e-4fb2-bbff-2c13199bbd09 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:47.519480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb396f8a-491e-4fb2-bbff-2c13199bbd09 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:47.519913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb396f8a-491e-4fb2-bbff-2c13199bbd09 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:47.520610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb396f8a-491e-4fb2-bbff-2c13199bbd09 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:47.521058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb396f8a-491e-4fb2-bbff-2c13199bbd09 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:47.521590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb396f8a-491e-4fb2-bbff-2c13199bbd09 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:47.663992 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fb396f8a-491e-4fb2-bbff-2c13199bbd09 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:47.675342 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fb396f8a-491e-4fb2-bbff-2c13199bbd09 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1520 microversion: 2.1 time: 0.168339 Aug 24 11:05:47.676039 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3176/6712] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:47 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:48.697706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0b5131dd-146c-43fb-accc-14ea622e6f44 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:48.698374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0b5131dd-146c-43fb-accc-14ea622e6f44 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:48.705891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b5131dd-146c-43fb-accc-14ea622e6f44 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:48.706398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b5131dd-146c-43fb-accc-14ea622e6f44 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:48.706941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b5131dd-146c-43fb-accc-14ea622e6f44 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:48.707698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b5131dd-146c-43fb-accc-14ea622e6f44 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:48.708172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b5131dd-146c-43fb-accc-14ea622e6f44 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:48.708619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b5131dd-146c-43fb-accc-14ea622e6f44 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:48.845878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0b5131dd-146c-43fb-accc-14ea622e6f44 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:48.854502 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0b5131dd-146c-43fb-accc-14ea622e6f44 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1520 microversion: 2.1 time: 0.162029 Aug 24 11:05:48.855089 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3537/6713] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:48 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:49.882900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5ef94d31-51fc-4f0c-b8e6-e1deae688e15 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:49.883591 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5ef94d31-51fc-4f0c-b8e6-e1deae688e15 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:49.894087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ef94d31-51fc-4f0c-b8e6-e1deae688e15 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:49.894834 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ef94d31-51fc-4f0c-b8e6-e1deae688e15 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:49.895493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ef94d31-51fc-4f0c-b8e6-e1deae688e15 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:49.896409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ef94d31-51fc-4f0c-b8e6-e1deae688e15 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:49.896864 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ef94d31-51fc-4f0c-b8e6-e1deae688e15 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:49.897328 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ef94d31-51fc-4f0c-b8e6-e1deae688e15 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:50.039319 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5ef94d31-51fc-4f0c-b8e6-e1deae688e15 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:50.047327 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5ef94d31-51fc-4f0c-b8e6-e1deae688e15 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1520 microversion: 2.1 time: 0.170501 Aug 24 11:05:50.047912 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3177/6714] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:49 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:51.068977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c635ad89-ca1f-450d-bd5d-4614cd644371 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:51.069644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c635ad89-ca1f-450d-bd5d-4614cd644371 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:51.077457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c635ad89-ca1f-450d-bd5d-4614cd644371 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:51.078000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c635ad89-ca1f-450d-bd5d-4614cd644371 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:51.078417 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c635ad89-ca1f-450d-bd5d-4614cd644371 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:51.079366 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c635ad89-ca1f-450d-bd5d-4614cd644371 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:51.080160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c635ad89-ca1f-450d-bd5d-4614cd644371 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:51.080633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c635ad89-ca1f-450d-bd5d-4614cd644371 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:51.216693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c635ad89-ca1f-450d-bd5d-4614cd644371 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:51.224775 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c635ad89-ca1f-450d-bd5d-4614cd644371 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1520 microversion: 2.1 time: 0.160069 Aug 24 11:05:51.225733 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3538/6715] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:51 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:52.246646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e2bbc170-5651-44ac-90f2-f2d13d4b0ff7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:52.247264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e2bbc170-5651-44ac-90f2-f2d13d4b0ff7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:52.254705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2bbc170-5651-44ac-90f2-f2d13d4b0ff7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:52.255193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2bbc170-5651-44ac-90f2-f2d13d4b0ff7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:52.255629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2bbc170-5651-44ac-90f2-f2d13d4b0ff7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:52.256330 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2bbc170-5651-44ac-90f2-f2d13d4b0ff7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:52.256781 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2bbc170-5651-44ac-90f2-f2d13d4b0ff7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:52.257254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2bbc170-5651-44ac-90f2-f2d13d4b0ff7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:52.398466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e2bbc170-5651-44ac-90f2-f2d13d4b0ff7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:52.407100 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e2bbc170-5651-44ac-90f2-f2d13d4b0ff7 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1520 microversion: 2.1 time: 0.164365 Aug 24 11:05:52.407690 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3178/6716] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:52 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:53.430217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9bc93920-b6e3-4e35-a141-1725c496385a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:53.430854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9bc93920-b6e3-4e35-a141-1725c496385a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:53.438365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bc93920-b6e3-4e35-a141-1725c496385a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:53.438867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bc93920-b6e3-4e35-a141-1725c496385a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:53.439311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bc93920-b6e3-4e35-a141-1725c496385a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:53.440030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bc93920-b6e3-4e35-a141-1725c496385a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:53.440493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bc93920-b6e3-4e35-a141-1725c496385a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:53.441161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bc93920-b6e3-4e35-a141-1725c496385a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:53.583721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9bc93920-b6e3-4e35-a141-1725c496385a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:53.591663 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9bc93920-b6e3-4e35-a141-1725c496385a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1520 microversion: 2.1 time: 0.165894 Aug 24 11:05:53.592257 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3539/6717] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:53 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:54.614364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-334b6bd6-ffce-4d01-89ec-3c344d6f9dbe tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:54.614964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-334b6bd6-ffce-4d01-89ec-3c344d6f9dbe tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:54.622291 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-334b6bd6-ffce-4d01-89ec-3c344d6f9dbe tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:54.622775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-334b6bd6-ffce-4d01-89ec-3c344d6f9dbe tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:54.623204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-334b6bd6-ffce-4d01-89ec-3c344d6f9dbe tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:54.623893 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-334b6bd6-ffce-4d01-89ec-3c344d6f9dbe tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:54.624341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-334b6bd6-ffce-4d01-89ec-3c344d6f9dbe tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:54.624759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-334b6bd6-ffce-4d01-89ec-3c344d6f9dbe tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:54.760293 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-334b6bd6-ffce-4d01-89ec-3c344d6f9dbe tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:54.773506 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-334b6bd6-ffce-4d01-89ec-3c344d6f9dbe tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1520 microversion: 2.1 time: 0.163023 Aug 24 11:05:54.774108 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3179/6718] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:54 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:55.801296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a6081050-538f-462a-9b90-f63a3c5812b5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:55.801888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a6081050-538f-462a-9b90-f63a3c5812b5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:55.809502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6081050-538f-462a-9b90-f63a3c5812b5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:55.809991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6081050-538f-462a-9b90-f63a3c5812b5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:55.810440 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6081050-538f-462a-9b90-f63a3c5812b5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:55.811148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6081050-538f-462a-9b90-f63a3c5812b5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:55.811613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6081050-538f-462a-9b90-f63a3c5812b5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:55.812046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6081050-538f-462a-9b90-f63a3c5812b5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:55.954838 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a6081050-538f-462a-9b90-f63a3c5812b5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:55.962870 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a6081050-538f-462a-9b90-f63a3c5812b5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1520 microversion: 2.1 time: 0.167960 Aug 24 11:05:55.963474 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3540/6719] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:55 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:56.986736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ce10c989-dead-4e26-94a0-5f244e1d81c3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:56.987460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ce10c989-dead-4e26-94a0-5f244e1d81c3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:56.998661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce10c989-dead-4e26-94a0-5f244e1d81c3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:56.999432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce10c989-dead-4e26-94a0-5f244e1d81c3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:57.000131 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce10c989-dead-4e26-94a0-5f244e1d81c3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:57.001278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce10c989-dead-4e26-94a0-5f244e1d81c3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:57.002015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce10c989-dead-4e26-94a0-5f244e1d81c3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:57.002791 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce10c989-dead-4e26-94a0-5f244e1d81c3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:57.142969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ce10c989-dead-4e26-94a0-5f244e1d81c3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:57.151923 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ce10c989-dead-4e26-94a0-5f244e1d81c3 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1520 microversion: 2.1 time: 0.170956 Aug 24 11:05:57.152511 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3180/6720] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:56 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:58.177582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c4a57583-ed01-464b-8f88-404475c42f72 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:58.178220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c4a57583-ed01-464b-8f88-404475c42f72 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:58.185724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4a57583-ed01-464b-8f88-404475c42f72 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:58.186235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4a57583-ed01-464b-8f88-404475c42f72 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:58.186691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4a57583-ed01-464b-8f88-404475c42f72 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:58.187405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4a57583-ed01-464b-8f88-404475c42f72 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:58.187878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4a57583-ed01-464b-8f88-404475c42f72 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:58.188326 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4a57583-ed01-464b-8f88-404475c42f72 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:58.192392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:05:58.322560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c4a57583-ed01-464b-8f88-404475c42f72 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:58.331031 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c4a57583-ed01-464b-8f88-404475c42f72 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1520 microversion: 2.1 time: 0.160213 Aug 24 11:05:58.331641 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3541/6721] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:58 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:05:59.355682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a686a7cb-7fa7-41cc-89c7-1066a5b42101 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:05:59.356217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a686a7cb-7fa7-41cc-89c7-1066a5b42101 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:05:59.359085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:05:59.364763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a686a7cb-7fa7-41cc-89c7-1066a5b42101 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:59.365266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a686a7cb-7fa7-41cc-89c7-1066a5b42101 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:59.365703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a686a7cb-7fa7-41cc-89c7-1066a5b42101 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:59.366413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a686a7cb-7fa7-41cc-89c7-1066a5b42101 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:59.367014 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a686a7cb-7fa7-41cc-89c7-1066a5b42101 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:59.367616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a686a7cb-7fa7-41cc-89c7-1066a5b42101 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:59.509553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a686a7cb-7fa7-41cc-89c7-1066a5b42101 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:05:59.521526 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a686a7cb-7fa7-41cc-89c7-1066a5b42101 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1520 microversion: 2.1 time: 0.169634 Aug 24 11:05:59.522488 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3181/6722] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:05:59 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:00.544266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d54c97a8-9d7a-4861-be55-3cfbbe79ffde tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:00.544939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d54c97a8-9d7a-4861-be55-3cfbbe79ffde tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:00.547809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:06:00.553634 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d54c97a8-9d7a-4861-be55-3cfbbe79ffde tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:00.554140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d54c97a8-9d7a-4861-be55-3cfbbe79ffde tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:00.554589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d54c97a8-9d7a-4861-be55-3cfbbe79ffde tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:00.555288 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d54c97a8-9d7a-4861-be55-3cfbbe79ffde tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:00.555752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d54c97a8-9d7a-4861-be55-3cfbbe79ffde tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:00.556184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d54c97a8-9d7a-4861-be55-3cfbbe79ffde tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:00.730053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d54c97a8-9d7a-4861-be55-3cfbbe79ffde tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:00.738926 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d54c97a8-9d7a-4861-be55-3cfbbe79ffde tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1520 microversion: 2.1 time: 0.198653 Aug 24 11:06:00.739531 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3542/6723] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:00 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:01.767391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ff4cb88a-e336-4bad-81d6-9f7431bd962e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:01.767986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ff4cb88a-e336-4bad-81d6-9f7431bd962e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:01.776980 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff4cb88a-e336-4bad-81d6-9f7431bd962e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:01.777503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff4cb88a-e336-4bad-81d6-9f7431bd962e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:01.777940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff4cb88a-e336-4bad-81d6-9f7431bd962e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:01.778650 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff4cb88a-e336-4bad-81d6-9f7431bd962e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:01.779094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff4cb88a-e336-4bad-81d6-9f7431bd962e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:01.779511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff4cb88a-e336-4bad-81d6-9f7431bd962e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:02.196861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ff4cb88a-e336-4bad-81d6-9f7431bd962e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:02.208768 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ff4cb88a-e336-4bad-81d6-9f7431bd962e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1520 microversion: 2.1 time: 0.447399 Aug 24 11:06:02.209619 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3182/6724] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:01 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1520 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:03.237510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3f97173c-71ee-4709-85d4-acdb870651c0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:03.238119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3f97173c-71ee-4709-85d4-acdb870651c0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:03.245666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f97173c-71ee-4709-85d4-acdb870651c0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:03.246143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f97173c-71ee-4709-85d4-acdb870651c0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:03.246612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f97173c-71ee-4709-85d4-acdb870651c0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:03.247324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f97173c-71ee-4709-85d4-acdb870651c0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:03.247786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f97173c-71ee-4709-85d4-acdb870651c0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:03.248225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f97173c-71ee-4709-85d4-acdb870651c0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:03.398007 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3f97173c-71ee-4709-85d4-acdb870651c0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:03.406310 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3f97173c-71ee-4709-85d4-acdb870651c0 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1520 microversion: 2.1 time: 0.172891 Aug 24 11:06:03.406920 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3543/6725] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:03 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:04.428656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d47a4381-0a55-410b-acc9-7c6bd9b14e27 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:04.429277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d47a4381-0a55-410b-acc9-7c6bd9b14e27 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:04.437033 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d47a4381-0a55-410b-acc9-7c6bd9b14e27 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:04.437631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d47a4381-0a55-410b-acc9-7c6bd9b14e27 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:04.438192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d47a4381-0a55-410b-acc9-7c6bd9b14e27 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:04.439089 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d47a4381-0a55-410b-acc9-7c6bd9b14e27 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:04.439686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d47a4381-0a55-410b-acc9-7c6bd9b14e27 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:04.440172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d47a4381-0a55-410b-acc9-7c6bd9b14e27 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:04.576427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d47a4381-0a55-410b-acc9-7c6bd9b14e27 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:04.585516 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d47a4381-0a55-410b-acc9-7c6bd9b14e27 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1520 microversion: 2.1 time: 0.160916 Aug 24 11:06:04.586179 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3183/6726] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:04 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:05.606915 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-573d9b3a-235c-4a4f-8619-af745f845fd8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:05.607493 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-573d9b3a-235c-4a4f-8619-af745f845fd8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:05.615398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-573d9b3a-235c-4a4f-8619-af745f845fd8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:05.615902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-573d9b3a-235c-4a4f-8619-af745f845fd8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:05.616389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-573d9b3a-235c-4a4f-8619-af745f845fd8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:05.617092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-573d9b3a-235c-4a4f-8619-af745f845fd8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:05.617592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-573d9b3a-235c-4a4f-8619-af745f845fd8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:05.618027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-573d9b3a-235c-4a4f-8619-af745f845fd8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:05.756204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-573d9b3a-235c-4a4f-8619-af745f845fd8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:05.765441 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-573d9b3a-235c-4a4f-8619-af745f845fd8 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1520 microversion: 2.1 time: 0.162408 Aug 24 11:06:05.765961 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3544/6727] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:05 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:06.787496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bd053bba-9149-430b-839f-b8227a2f6915 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:06.788062 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bd053bba-9149-430b-839f-b8227a2f6915 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:06.795516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd053bba-9149-430b-839f-b8227a2f6915 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:06.796009 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd053bba-9149-430b-839f-b8227a2f6915 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:06.796448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd053bba-9149-430b-839f-b8227a2f6915 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:06.797158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd053bba-9149-430b-839f-b8227a2f6915 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:06.797632 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd053bba-9149-430b-839f-b8227a2f6915 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:06.798062 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd053bba-9149-430b-839f-b8227a2f6915 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:06.959117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bd053bba-9149-430b-839f-b8227a2f6915 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:06.969361 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bd053bba-9149-430b-839f-b8227a2f6915 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1520 microversion: 2.1 time: 0.185547 Aug 24 11:06:06.969774 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3184/6728] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:06 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:07.991565 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4c464f51-58f8-4695-8db1-3f253f2d4198 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:07.992285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4c464f51-58f8-4695-8db1-3f253f2d4198 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:08.000891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c464f51-58f8-4695-8db1-3f253f2d4198 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:08.001543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c464f51-58f8-4695-8db1-3f253f2d4198 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:08.002129 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c464f51-58f8-4695-8db1-3f253f2d4198 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:08.003042 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c464f51-58f8-4695-8db1-3f253f2d4198 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:08.003701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c464f51-58f8-4695-8db1-3f253f2d4198 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:08.004413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c464f51-58f8-4695-8db1-3f253f2d4198 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:08.154394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4c464f51-58f8-4695-8db1-3f253f2d4198 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:08.163368 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4c464f51-58f8-4695-8db1-3f253f2d4198 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1520 microversion: 2.1 time: 0.176322 Aug 24 11:06:08.163986 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3545/6729] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:07 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:09.187927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-59e95b1c-ed67-4051-b44c-e5cfe0e0567e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:09.188533 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-59e95b1c-ed67-4051-b44c-e5cfe0e0567e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:09.198717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59e95b1c-ed67-4051-b44c-e5cfe0e0567e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:09.199456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59e95b1c-ed67-4051-b44c-e5cfe0e0567e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:09.199967 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59e95b1c-ed67-4051-b44c-e5cfe0e0567e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:09.200845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59e95b1c-ed67-4051-b44c-e5cfe0e0567e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:09.201307 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59e95b1c-ed67-4051-b44c-e5cfe0e0567e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:09.201730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59e95b1c-ed67-4051-b44c-e5cfe0e0567e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:09.372524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-59e95b1c-ed67-4051-b44c-e5cfe0e0567e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:09.380716 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-59e95b1c-ed67-4051-b44c-e5cfe0e0567e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1520 microversion: 2.1 time: 0.198901 Aug 24 11:06:09.381354 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3185/6730] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:09 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:09.945225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-74f568bb-c1cb-40ce-b677-b9a101f848bb req-56a98f27-435a-4136-ab94-4021dea3497d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be84088b-5ff0-4ef4-a8ff-34313e52ad60", "name": "network-vif-unplugged", "status": "completed", "tag": "0dbccdbd-e31d-4112-addf-212be4a4c7ee"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:06:09.957436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-74f568bb-c1cb-40ce-b677-b9a101f848bb req-56a98f27-435a-4136-ab94-4021dea3497d service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:09.958333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-74f568bb-c1cb-40ce-b677-b9a101f848bb req-56a98f27-435a-4136-ab94-4021dea3497d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:09.959103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-74f568bb-c1cb-40ce-b677-b9a101f848bb req-56a98f27-435a-4136-ab94-4021dea3497d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:09.973239 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-74f568bb-c1cb-40ce-b677-b9a101f848bb req-56a98f27-435a-4136-ab94-4021dea3497d service nova] Creating event network-vif-unplugged:0dbccdbd-e31d-4112-addf-212be4a4c7ee for instance be84088b-5ff0-4ef4-a8ff-34313e52ad60 on n-h1-849328-3 Aug 24 11:06:09.979917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-74f568bb-c1cb-40ce-b677-b9a101f848bb req-56a98f27-435a-4136-ab94-4021dea3497d service nova] Instance be84088b-5ff0-4ef4-a8ff-34313e52ad60 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 11:06:09.991011 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-74f568bb-c1cb-40ce-b677-b9a101f848bb req-56a98f27-435a-4136-ab94-4021dea3497d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050117 Aug 24 11:06:09.991962 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3546/6731] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:06:10.402498 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cd15db37-470f-4c5d-a514-d46452d4120e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:10.403158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cd15db37-470f-4c5d-a514-d46452d4120e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:10.412329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd15db37-470f-4c5d-a514-d46452d4120e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:10.412994 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd15db37-470f-4c5d-a514-d46452d4120e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:10.413466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd15db37-470f-4c5d-a514-d46452d4120e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:10.414172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd15db37-470f-4c5d-a514-d46452d4120e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:10.414621 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd15db37-470f-4c5d-a514-d46452d4120e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:10.415067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd15db37-470f-4c5d-a514-d46452d4120e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:10.930164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cd15db37-470f-4c5d-a514-d46452d4120e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:10.939516 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cd15db37-470f-4c5d-a514-d46452d4120e tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1519 microversion: 2.1 time: 0.541125 Aug 24 11:06:10.940115 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3186/6732] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:10 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1519 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:11.968068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1f9c282e-5223-4da9-9954-9fbd2958df2f tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:11.969291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1f9c282e-5223-4da9-9954-9fbd2958df2f tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:11.979412 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f9c282e-5223-4da9-9954-9fbd2958df2f tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:11.979915 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f9c282e-5223-4da9-9954-9fbd2958df2f tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:11.980401 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f9c282e-5223-4da9-9954-9fbd2958df2f tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:11.981172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f9c282e-5223-4da9-9954-9fbd2958df2f tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:11.981623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f9c282e-5223-4da9-9954-9fbd2958df2f tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:11.982066 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f9c282e-5223-4da9-9954-9fbd2958df2f tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:12.007332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c1d6e202-61a1-42b5-9918-35b604c6612c req-d8a8467a-7177-47a8-a24d-f3dece567f9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be84088b-5ff0-4ef4-a8ff-34313e52ad60", "tag": "0dbccdbd-e31d-4112-addf-212be4a4c7ee"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:06:12.018027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c1d6e202-61a1-42b5-9918-35b604c6612c req-d8a8467a-7177-47a8-a24d-f3dece567f9c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:12.018507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c1d6e202-61a1-42b5-9918-35b604c6612c req-d8a8467a-7177-47a8-a24d-f3dece567f9c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:12.018929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c1d6e202-61a1-42b5-9918-35b604c6612c req-d8a8467a-7177-47a8-a24d-f3dece567f9c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:12.030991 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c1d6e202-61a1-42b5-9918-35b604c6612c req-d8a8467a-7177-47a8-a24d-f3dece567f9c service nova] Creating event network-changed:0dbccdbd-e31d-4112-addf-212be4a4c7ee for instance be84088b-5ff0-4ef4-a8ff-34313e52ad60 on n-h1-849328-3 Aug 24 11:06:12.036600 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-c1d6e202-61a1-42b5-9918-35b604c6612c req-d8a8467a-7177-47a8-a24d-f3dece567f9c service nova] Instance be84088b-5ff0-4ef4-a8ff-34313e52ad60 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 11:06:12.047517 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c1d6e202-61a1-42b5-9918-35b604c6612c req-d8a8467a-7177-47a8-a24d-f3dece567f9c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043878 Aug 24 11:06:12.048172 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3187/6733] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:06:12.121009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1f9c282e-5223-4da9-9954-9fbd2958df2f tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:12.129760 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1f9c282e-5223-4da9-9954-9fbd2958df2f tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1517 microversion: 2.1 time: 0.169983 Aug 24 11:06:12.130682 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3547/6734] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:11 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:13.155405 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a13be3c3-c8a3-44c5-a02e-beead1984d20 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:13.156126 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a13be3c3-c8a3-44c5-a02e-beead1984d20 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:13.162958 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a13be3c3-c8a3-44c5-a02e-beead1984d20 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:13.163423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a13be3c3-c8a3-44c5-a02e-beead1984d20 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:13.163861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a13be3c3-c8a3-44c5-a02e-beead1984d20 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:13.164556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a13be3c3-c8a3-44c5-a02e-beead1984d20 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:13.165012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a13be3c3-c8a3-44c5-a02e-beead1984d20 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:13.165471 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a13be3c3-c8a3-44c5-a02e-beead1984d20 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:13.168096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=81 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:06:13.312463 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a13be3c3-c8a3-44c5-a02e-beead1984d20 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:13.323594 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a13be3c3-c8a3-44c5-a02e-beead1984d20 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1514 microversion: 2.1 time: 0.173760 Aug 24 11:06:13.324193 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3188/6735] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:13 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:13.352537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3eb53e59-d200-4592-ac98-bd9683fa612a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:06:13.353140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3eb53e59-d200-4592-ac98-bd9683fa612a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:13.360775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3eb53e59-d200-4592-ac98-bd9683fa612a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:13.361149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3eb53e59-d200-4592-ac98-bd9683fa612a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:13.361625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3eb53e59-d200-4592-ac98-bd9683fa612a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:13.362339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3eb53e59-d200-4592-ac98-bd9683fa612a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:13.362816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3eb53e59-d200-4592-ac98-bd9683fa612a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:13.363259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3eb53e59-d200-4592-ac98-bd9683fa612a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:13.425479 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3eb53e59-d200-4592-ac98-bd9683fa612a tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "POST /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60/action" status: 204 len: 0 microversion: 2.1 time: 0.077419 Aug 24 11:06:13.426202 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3548/6736] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:06:13 2022] POST /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:06:13.435021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e12a51d0-7a36-4f79-aeaf-20db6461eef9 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:13.435728 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e12a51d0-7a36-4f79-aeaf-20db6461eef9 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:13.442741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e12a51d0-7a36-4f79-aeaf-20db6461eef9 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:13.442966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e12a51d0-7a36-4f79-aeaf-20db6461eef9 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:13.443404 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e12a51d0-7a36-4f79-aeaf-20db6461eef9 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:13.444116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e12a51d0-7a36-4f79-aeaf-20db6461eef9 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:13.444569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e12a51d0-7a36-4f79-aeaf-20db6461eef9 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:13.444984 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e12a51d0-7a36-4f79-aeaf-20db6461eef9 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:13.655946 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e12a51d0-7a36-4f79-aeaf-20db6461eef9 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:13.664648 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e12a51d0-7a36-4f79-aeaf-20db6461eef9 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1514 microversion: 2.1 time: 0.233761 Aug 24 11:06:13.665607 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3189/6737] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:13 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1514 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:14.688085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d21e5396-f96d-4384-b7ee-3e2e29db9f3c tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:14.688816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d21e5396-f96d-4384-b7ee-3e2e29db9f3c tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:14.696311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d21e5396-f96d-4384-b7ee-3e2e29db9f3c tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:14.696817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d21e5396-f96d-4384-b7ee-3e2e29db9f3c tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:14.697294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d21e5396-f96d-4384-b7ee-3e2e29db9f3c tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:14.698005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d21e5396-f96d-4384-b7ee-3e2e29db9f3c tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:14.698574 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d21e5396-f96d-4384-b7ee-3e2e29db9f3c tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:14.699713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d21e5396-f96d-4384-b7ee-3e2e29db9f3c tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:14.842024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d21e5396-f96d-4384-b7ee-3e2e29db9f3c tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:14.851506 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d21e5396-f96d-4384-b7ee-3e2e29db9f3c tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1506 microversion: 2.1 time: 0.168605 Aug 24 11:06:14.852124 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3549/6738] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:14 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:14.873297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-08c98e9b-2ebd-4055-8142-8799aec8b26b tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:14.873909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-08c98e9b-2ebd-4055-8142-8799aec8b26b tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:14.881000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08c98e9b-2ebd-4055-8142-8799aec8b26b tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:14.881595 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08c98e9b-2ebd-4055-8142-8799aec8b26b tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:14.882029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08c98e9b-2ebd-4055-8142-8799aec8b26b tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:14.882715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08c98e9b-2ebd-4055-8142-8799aec8b26b tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:14.883155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08c98e9b-2ebd-4055-8142-8799aec8b26b tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:14.883574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08c98e9b-2ebd-4055-8142-8799aec8b26b tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:15.018316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-08c98e9b-2ebd-4055-8142-8799aec8b26b tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:15.026455 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-08c98e9b-2ebd-4055-8142-8799aec8b26b tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1506 microversion: 2.1 time: 0.157423 Aug 24 11:06:15.027048 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3190/6739] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:14 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:15.047053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bbc3595a-76e3-4964-b1e7-cd446bd8e13d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:15.047694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bbc3595a-76e3-4964-b1e7-cd446bd8e13d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:15.054245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbc3595a-76e3-4964-b1e7-cd446bd8e13d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:15.054743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbc3595a-76e3-4964-b1e7-cd446bd8e13d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:15.055222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbc3595a-76e3-4964-b1e7-cd446bd8e13d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:15.055939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbc3595a-76e3-4964-b1e7-cd446bd8e13d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:15.056413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbc3595a-76e3-4964-b1e7-cd446bd8e13d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:15.056866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbc3595a-76e3-4964-b1e7-cd446bd8e13d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:15.198184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bbc3595a-76e3-4964-b1e7-cd446bd8e13d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:15.210602 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bbc3595a-76e3-4964-b1e7-cd446bd8e13d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1506 microversion: 2.1 time: 0.167319 Aug 24 11:06:15.211453 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3550/6740] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:15 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:15.232669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d69fcb8b-a3e6-45c0-8758-b187ecd0d517 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:15.233162 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d69fcb8b-a3e6-45c0-8758-b187ecd0d517 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:15.239514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d69fcb8b-a3e6-45c0-8758-b187ecd0d517 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:15.240000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d69fcb8b-a3e6-45c0-8758-b187ecd0d517 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:15.240437 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d69fcb8b-a3e6-45c0-8758-b187ecd0d517 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:15.241145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d69fcb8b-a3e6-45c0-8758-b187ecd0d517 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:15.241636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d69fcb8b-a3e6-45c0-8758-b187ecd0d517 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:15.242045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d69fcb8b-a3e6-45c0-8758-b187ecd0d517 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:15.266788 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d69fcb8b-a3e6-45c0-8758-b187ecd0d517 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:06:15.350457 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d69fcb8b-a3e6-45c0-8758-b187ecd0d517 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "DELETE /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 204 len: 0 microversion: 2.1 time: 0.121594 Aug 24 11:06:15.351433 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3191/6741] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:06:15 2022] DELETE /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:06:15.367016 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-73b5ce5f-f0f5-4e1e-b1e8-d54f078d5ea5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:15.367596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-73b5ce5f-f0f5-4e1e-b1e8-d54f078d5ea5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:15.373972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73b5ce5f-f0f5-4e1e-b1e8-d54f078d5ea5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:15.374496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73b5ce5f-f0f5-4e1e-b1e8-d54f078d5ea5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:15.374945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73b5ce5f-f0f5-4e1e-b1e8-d54f078d5ea5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:15.375655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73b5ce5f-f0f5-4e1e-b1e8-d54f078d5ea5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:15.376122 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73b5ce5f-f0f5-4e1e-b1e8-d54f078d5ea5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:15.376560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73b5ce5f-f0f5-4e1e-b1e8-d54f078d5ea5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:15.403526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-73b5ce5f-f0f5-4e1e-b1e8-d54f078d5ea5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:06:15.450661 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.compute.api [None req-73b5ce5f-f0f5-4e1e-b1e8-d54f078d5ea5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Instance is already in deleting state, ignoring this request Aug 24 11:06:15.451515 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-73b5ce5f-f0f5-4e1e-b1e8-d54f078d5ea5 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "DELETE /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 204 len: 0 microversion: 2.1 time: 0.088557 Aug 24 11:06:15.452094 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3551/6742] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:06:15 2022] DELETE /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:06:15.464238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8109e2eb-5e74-4ba1-a3ce-904ff3b99830 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:15.465268 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8109e2eb-5e74-4ba1-a3ce-904ff3b99830 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:15.474170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8109e2eb-5e74-4ba1-a3ce-904ff3b99830 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:15.474866 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8109e2eb-5e74-4ba1-a3ce-904ff3b99830 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:15.475468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8109e2eb-5e74-4ba1-a3ce-904ff3b99830 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:15.476484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8109e2eb-5e74-4ba1-a3ce-904ff3b99830 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:15.477109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8109e2eb-5e74-4ba1-a3ce-904ff3b99830 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:15.477736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8109e2eb-5e74-4ba1-a3ce-904ff3b99830 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:15.617682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8109e2eb-5e74-4ba1-a3ce-904ff3b99830 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:15.625694 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8109e2eb-5e74-4ba1-a3ce-904ff3b99830 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1512 microversion: 2.1 time: 0.168520 Aug 24 11:06:15.626276 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3192/6743] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:15 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:15.866003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-7fab36a8-51eb-479f-8cf9-ccf24c1f9ef9 req-e35a9cd2-e974-4eab-9d80-a91a2ee510a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be84088b-5ff0-4ef4-a8ff-34313e52ad60", "name": "network-vif-plugged", "status": "completed", "tag": "0dbccdbd-e31d-4112-addf-212be4a4c7ee"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:06:15.877946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7fab36a8-51eb-479f-8cf9-ccf24c1f9ef9 req-e35a9cd2-e974-4eab-9d80-a91a2ee510a2 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:15.878541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7fab36a8-51eb-479f-8cf9-ccf24c1f9ef9 req-e35a9cd2-e974-4eab-9d80-a91a2ee510a2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:15.878987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7fab36a8-51eb-479f-8cf9-ccf24c1f9ef9 req-e35a9cd2-e974-4eab-9d80-a91a2ee510a2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:15.892814 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-7fab36a8-51eb-479f-8cf9-ccf24c1f9ef9 req-e35a9cd2-e974-4eab-9d80-a91a2ee510a2 service nova] Creating event network-vif-plugged:0dbccdbd-e31d-4112-addf-212be4a4c7ee for instance be84088b-5ff0-4ef4-a8ff-34313e52ad60 on n-h1-849328-3 Aug 24 11:06:15.898171 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-7fab36a8-51eb-479f-8cf9-ccf24c1f9ef9 req-e35a9cd2-e974-4eab-9d80-a91a2ee510a2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036181 Aug 24 11:06:15.898811 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3552/6744] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:06:16.646656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b8c3ab4f-0259-41e9-a345-a7f5b1db980d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:16.647225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b8c3ab4f-0259-41e9-a345-a7f5b1db980d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:16.654708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8c3ab4f-0259-41e9-a345-a7f5b1db980d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:16.655194 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8c3ab4f-0259-41e9-a345-a7f5b1db980d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:16.655623 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8c3ab4f-0259-41e9-a345-a7f5b1db980d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:16.656321 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8c3ab4f-0259-41e9-a345-a7f5b1db980d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:16.656770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8c3ab4f-0259-41e9-a345-a7f5b1db980d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:16.657217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8c3ab4f-0259-41e9-a345-a7f5b1db980d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:16.817277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b8c3ab4f-0259-41e9-a345-a7f5b1db980d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076b20c8d634432bb5c1773d56892a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb817ffa24404ab42a2a036d7c8ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:16.825679 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b8c3ab4f-0259-41e9-a345-a7f5b1db980d tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 200 len: 1512 microversion: 2.1 time: 0.182996 Aug 24 11:06:16.826315 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3193/6745] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:16 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 1512 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:17.335107 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-41aaa68a-9ff4-4723-8483-403689656fa5 req-feafb7b8-129c-48cf-86b3-c73078eb8653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be84088b-5ff0-4ef4-a8ff-34313e52ad60", "name": "network-vif-deleted", "tag": "0dbccdbd-e31d-4112-addf-212be4a4c7ee"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:06:17.356052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-41aaa68a-9ff4-4723-8483-403689656fa5 req-feafb7b8-129c-48cf-86b3-c73078eb8653 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:17.356839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-41aaa68a-9ff4-4723-8483-403689656fa5 req-feafb7b8-129c-48cf-86b3-c73078eb8653 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:17.357325 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-41aaa68a-9ff4-4723-8483-403689656fa5 req-feafb7b8-129c-48cf-86b3-c73078eb8653 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:17.373293 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-41aaa68a-9ff4-4723-8483-403689656fa5 req-feafb7b8-129c-48cf-86b3-c73078eb8653 service nova] Creating event network-vif-deleted:0dbccdbd-e31d-4112-addf-212be4a4c7ee for instance be84088b-5ff0-4ef4-a8ff-34313e52ad60 on n-h1-849328-3 Aug 24 11:06:17.379587 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-41aaa68a-9ff4-4723-8483-403689656fa5 req-feafb7b8-129c-48cf-86b3-c73078eb8653 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048600 Aug 24 11:06:17.380460 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3553/6746] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:06:17.850156 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2ef06b00-8cfe-49e4-9a50-68f0993d9e61 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:17.851118 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2ef06b00-8cfe-49e4-9a50-68f0993d9e61 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: be84088b-5ff0-4ef4-a8ff-34313e52ad60] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:17.860013 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ef06b00-8cfe-49e4-9a50-68f0993d9e61 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:17.860498 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ef06b00-8cfe-49e4-9a50-68f0993d9e61 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:17.860969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ef06b00-8cfe-49e4-9a50-68f0993d9e61 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:17.861719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ef06b00-8cfe-49e4-9a50-68f0993d9e61 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:17.862172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ef06b00-8cfe-49e4-9a50-68f0993d9e61 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:17.862623 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ef06b00-8cfe-49e4-9a50-68f0993d9e61 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:17.877259 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-2ef06b00-8cfe-49e4-9a50-68f0993d9e61 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] HTTP exception thrown: Instance be84088b-5ff0-4ef4-a8ff-34313e52ad60 could not be found. Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2ef06b00-8cfe-49e4-9a50-68f0993d9e61 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Request method failure captured: Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 HTTP/1.1 Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgXLNIot-qt43oT9VnYVXNtohVHoBWsAj9THMMOzyT1H3HCF5MScbsqvYbUAZAzgcSxQLhsp5VtxCSSZcRWQ5VBhFSNy8q8fuGOLVSAtUrQTuKSGxBztYLdMh4McyXeZ55M4AyTVnH6xQstLiZ-I_qn33t8nBkz1YIJWAloGlAb-vZA Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 6dcb817ffa24404ab42a2a036d7c8ba6 Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerDiskConfigTestJSON-541330211 Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6dcb817ffa24404ab42a2a036d7c8ba6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6dcb817ffa24404ab42a2a036d7c8ba6", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6dcb817ffa24404ab42a2a036d7c8ba6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6dcb817ffa24404ab42a2a036d7c8ba6"}]}] Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerDiskConfigTestJSON-541330211 Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 6dcb817ffa24404ab42a2a036d7c8ba6 Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-541330211 Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerDiskConfigTestJSON-541330211-project Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 076b20c8d634432bb5c1773d56892a32 Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerDiskConfigTestJSON-541330211-project Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance be84088b-5ff0-4ef4-a8ff-34313e52ad60 could not be found. Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'be84088b-5ff0-4ef4-a8ff-34313e52ad60'} Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be84088b-5ff0-4ef4-a8ff-34313e52ad60 could not be found. Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be84088b-5ff0-4ef4-a8ff-34313e52ad60 could not be found. Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:06:17.878936 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:06:17.882827 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:17.882827 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:06:17.882827 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:06:17.882827 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:06:17.882827 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:06:17.882827 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be84088b-5ff0-4ef4-a8ff-34313e52ad60 could not be found. Aug 24 11:06:17.882827 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:06:17.882827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2ef06b00-8cfe-49e4-9a50-68f0993d9e61 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Returning 404 to user: Instance be84088b-5ff0-4ef4-a8ff-34313e52ad60 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:06:17.882827 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2ef06b00-8cfe-49e4-9a50-68f0993d9e61 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60" status: 404 len: 111 microversion: 2.1 time: 0.035776 Aug 24 11:06:17.882827 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3194/6747] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:17 2022] GET /compute/v2.1/servers/be84088b-5ff0-4ef4-a8ff-34313e52ad60 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:06:17.890104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0b935082-f271-48df-9235-964f77fbf3fe tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '.version_select at 0x7f4654f3f040>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:17.914398 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0b935082-f271-48df-9235-964f77fbf3fe tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1543710140" status: 202 len: 0 microversion: 2.1 time: 0.028498 Aug 24 11:06:17.915025 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3554/6748] 10.222.0.85 () {58 vars in 1221 bytes} [Wed Aug 24 11:06:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1543710140 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:06:18.818757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-632ee21a-14ef-4a04-9213-f87ae00d06b6 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:18.819259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-632ee21a-14ef-4a04-9213-f87ae00d06b6 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:18.825838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-632ee21a-14ef-4a04-9213-f87ae00d06b6 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:18.826255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-632ee21a-14ef-4a04-9213-f87ae00d06b6 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:18.826696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-632ee21a-14ef-4a04-9213-f87ae00d06b6 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:18.827384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-632ee21a-14ef-4a04-9213-f87ae00d06b6 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:18.827847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-632ee21a-14ef-4a04-9213-f87ae00d06b6 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:18.828271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-632ee21a-14ef-4a04-9213-f87ae00d06b6 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:18.844852 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-632ee21a-14ef-4a04-9213-f87ae00d06b6 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] HTTP exception thrown: Instance 68d33464-c5b1-49ba-a850-4078da5039de could not be found. Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-632ee21a-14ef-4a04-9213-f87ae00d06b6 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Request method failure captured: Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de HTTP/1.1 Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgXLNIot-qt43oT9VnYVXNtohVHoBWsAj9THMMOzyT1H3HCF5MScbsqvYbUAZAzgcSxQLhsp5VtxCSSZcRWQ5VBhFSNy8q8fuGOLVSAtUrQTuKSGxBztYLdMh4McyXeZ55M4AyTVnH6xQstLiZ-I_qn33t8nBkz1YIJWAloGlAb-vZA Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 6dcb817ffa24404ab42a2a036d7c8ba6 Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerDiskConfigTestJSON-541330211 Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6dcb817ffa24404ab42a2a036d7c8ba6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6dcb817ffa24404ab42a2a036d7c8ba6", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6dcb817ffa24404ab42a2a036d7c8ba6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6dcb817ffa24404ab42a2a036d7c8ba6"}]}] Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerDiskConfigTestJSON-541330211 Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 6dcb817ffa24404ab42a2a036d7c8ba6 Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-541330211 Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerDiskConfigTestJSON-541330211-project Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 076b20c8d634432bb5c1773d56892a32 Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerDiskConfigTestJSON-541330211-project Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 68d33464-c5b1-49ba-a850-4078da5039de could not be found. Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '68d33464-c5b1-49ba-a850-4078da5039de'} Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68d33464-c5b1-49ba-a850-4078da5039de could not be found. Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:06:18.846450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:06:18.852458 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68d33464-c5b1-49ba-a850-4078da5039de could not be found. Aug 24 11:06:18.852458 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:06:18.852458 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:06:18.852458 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:06:18.852458 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:18.852458 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:06:18.852458 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:06:18.852458 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:06:18.852458 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:06:18.852458 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68d33464-c5b1-49ba-a850-4078da5039de could not be found. Aug 24 11:06:18.852458 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:06:18.852458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-632ee21a-14ef-4a04-9213-f87ae00d06b6 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Returning 404 to user: Instance 68d33464-c5b1-49ba-a850-4078da5039de could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:06:18.852458 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-632ee21a-14ef-4a04-9213-f87ae00d06b6 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "DELETE /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 404 len: 111 microversion: 2.1 time: 0.033166 Aug 24 11:06:18.852458 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3195/6749] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:06:18 2022] DELETE /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:06:18.860715 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b54b8ca4-15be-445a-9a91-24305d213f03 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:18.861704 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b54b8ca4-15be-445a-9a91-24305d213f03 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] [instance: 68d33464-c5b1-49ba-a850-4078da5039de] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:18.871383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b54b8ca4-15be-445a-9a91-24305d213f03 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:18.871880 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b54b8ca4-15be-445a-9a91-24305d213f03 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:18.872393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b54b8ca4-15be-445a-9a91-24305d213f03 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:18.873100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b54b8ca4-15be-445a-9a91-24305d213f03 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:18.873588 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b54b8ca4-15be-445a-9a91-24305d213f03 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:18.874046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b54b8ca4-15be-445a-9a91-24305d213f03 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:18.887617 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-b54b8ca4-15be-445a-9a91-24305d213f03 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] HTTP exception thrown: Instance 68d33464-c5b1-49ba-a850-4078da5039de could not be found. Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b54b8ca4-15be-445a-9a91-24305d213f03 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Request method failure captured: Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de HTTP/1.1 Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgXLNIot-qt43oT9VnYVXNtohVHoBWsAj9THMMOzyT1H3HCF5MScbsqvYbUAZAzgcSxQLhsp5VtxCSSZcRWQ5VBhFSNy8q8fuGOLVSAtUrQTuKSGxBztYLdMh4McyXeZ55M4AyTVnH6xQstLiZ-I_qn33t8nBkz1YIJWAloGlAb-vZA Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 6dcb817ffa24404ab42a2a036d7c8ba6 Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerDiskConfigTestJSON-541330211 Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6dcb817ffa24404ab42a2a036d7c8ba6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6dcb817ffa24404ab42a2a036d7c8ba6", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6dcb817ffa24404ab42a2a036d7c8ba6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6dcb817ffa24404ab42a2a036d7c8ba6"}]}] Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerDiskConfigTestJSON-541330211 Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 6dcb817ffa24404ab42a2a036d7c8ba6 Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-541330211 Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerDiskConfigTestJSON-541330211-project Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 076b20c8d634432bb5c1773d56892a32 Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerDiskConfigTestJSON-541330211-project Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 68d33464-c5b1-49ba-a850-4078da5039de could not be found. Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '68d33464-c5b1-49ba-a850-4078da5039de'} Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68d33464-c5b1-49ba-a850-4078da5039de could not be found. Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68d33464-c5b1-49ba-a850-4078da5039de could not be found. Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:06:18.889375 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:06:18.893393 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:18.893393 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:06:18.893393 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:06:18.893393 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:06:18.893393 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:06:18.893393 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68d33464-c5b1-49ba-a850-4078da5039de could not be found. Aug 24 11:06:18.893393 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:06:18.893393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b54b8ca4-15be-445a-9a91-24305d213f03 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] Returning 404 to user: Instance 68d33464-c5b1-49ba-a850-4078da5039de could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:06:18.893393 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b54b8ca4-15be-445a-9a91-24305d213f03 tempest-ServerDiskConfigTestJSON-541330211 tempest-ServerDiskConfigTestJSON-541330211-project] 10.222.0.85 "GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de" status: 404 len: 111 microversion: 2.1 time: 0.037582 Aug 24 11:06:18.893393 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3555/6750] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:18 2022] GET /compute/v2.1/servers/68d33464-c5b1-49ba-a850-4078da5039de => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:06:27.793367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-724947d4-1739-4648-ac49-e095a2a32df9 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Action: 'create', calling method: .version_select at 0x7f4647eba430>, body: {"keypair": {"name": "tempest-keypair-1870957699", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaecyteS9wWwbQYefwsARDASQ2z6i1Xl80JrXM3LZ3t3ZEBVd2rR13TQg+43mZwrOEcBgUKfvY5vpeDt+NjbNFgu+VhHfqFiuyRGGdpEgiLyCWPPoAYYv9HfVmWzgg0jQ=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:06:27.810509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-724947d4-1739-4648-ac49-e095a2a32df9 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Getting quotas for project 9a617355a8b94576bf4edcf58a078a8e. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:06:27.816046 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-724947d4-1739-4648-ac49-e095a2a32df9 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Getting quotas for user 4a1864aed01d473ea51ec9de243ddfa4 and project 9a617355a8b94576bf4edcf58a078a8e. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:06:27.830349 n-d-849328-3 devstack@n-api.service[122432]: ERROR oslo.messaging._drivers.impl_rabbit [None req-724947d4-1739-4648-ac49-e095a2a32df9 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [b60230c6-5780-45e5-a183-c06fec8b377e] AMQP server on 10.222.0.85:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 11:06:28.833771 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:06:28.841811 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [None req-724947d4-1739-4648-ac49-e095a2a32df9 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [b60230c6-5780-45e5-a183-c06fec8b377e] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 53738. Aug 24 11:06:28.860585 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-724947d4-1739-4648-ac49-e095a2a32df9 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.208054 Aug 24 11:06:28.861221 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3196/6751] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 11:06:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:06:30.177937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e22363ab-b37e-44f0-a8de-b6446c92d84f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-412217824", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b96fded5-b753-414c-9ed5-a66d8cc1cc36"}], "security_groups": [{"name": "tempest-securitygroup--100998936"}], "key_name": "tempest-keypair-1870957699", "user_data": "}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:06:30.187331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:06:30.188017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:06:30.302717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-e22363ab-b37e-44f0-a8de-b6446c92d84f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] validate_networks() for [('b96fded5-b753-414c-9ed5-a66d8cc1cc36', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:06:30.688437 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e22363ab-b37e-44f0-a8de-b6446c92d84f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:06:30.688880 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e22363ab-b37e-44f0-a8de-b6446c92d84f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:06:30.689389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e22363ab-b37e-44f0-a8de-b6446c92d84f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:06:30.689810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e22363ab-b37e-44f0-a8de-b6446c92d84f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:06:30.690235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e22363ab-b37e-44f0-a8de-b6446c92d84f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:06:30.700834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e22363ab-b37e-44f0-a8de-b6446c92d84f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:30.701418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e22363ab-b37e-44f0-a8de-b6446c92d84f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:30.701868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e22363ab-b37e-44f0-a8de-b6446c92d84f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:30.702636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e22363ab-b37e-44f0-a8de-b6446c92d84f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:30.703103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e22363ab-b37e-44f0-a8de-b6446c92d84f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:30.703540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e22363ab-b37e-44f0-a8de-b6446c92d84f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:30.721050 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-e22363ab-b37e-44f0-a8de-b6446c92d84f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Getting quotas for project 9a617355a8b94576bf4edcf58a078a8e. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:06:30.727116 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-e22363ab-b37e-44f0-a8de-b6446c92d84f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Getting quotas for user 4a1864aed01d473ea51ec9de243ddfa4 and project 9a617355a8b94576bf4edcf58a078a8e. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:06:30.740756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e22363ab-b37e-44f0-a8de-b6446c92d84f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:06:30.743201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e22363ab-b37e-44f0-a8de-b6446c92d84f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:06:30.798808 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e22363ab-b37e-44f0-a8de-b6446c92d84f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.626053 Aug 24 11:06:30.799469 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3556/6752] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 11:06:30 2022] POST /compute/v2.1/servers => generated 408 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:06:30.810671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-46b42fdf-42ab-4d76-863a-2a3a2dcba3c1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:30.811295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-46b42fdf-42ab-4d76-863a-2a3a2dcba3c1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:30.815227 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:06:30.870561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-46b42fdf-42ab-4d76-863a-2a3a2dcba3c1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:30.878254 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-46b42fdf-42ab-4d76-863a-2a3a2dcba3c1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1238 microversion: 2.1 time: 0.071372 Aug 24 11:06:30.878855 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3197/6753] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:30 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:31.900120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-39ddda51-a74f-4bc5-91bb-3b0bb419a512 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:31.900750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-39ddda51-a74f-4bc5-91bb-3b0bb419a512 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:31.908281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39ddda51-a74f-4bc5-91bb-3b0bb419a512 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:31.908792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39ddda51-a74f-4bc5-91bb-3b0bb419a512 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:31.909278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39ddda51-a74f-4bc5-91bb-3b0bb419a512 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:31.909984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39ddda51-a74f-4bc5-91bb-3b0bb419a512 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:31.910428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39ddda51-a74f-4bc5-91bb-3b0bb419a512 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:31.911968 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39ddda51-a74f-4bc5-91bb-3b0bb419a512 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:31.974336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-39ddda51-a74f-4bc5-91bb-3b0bb419a512 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:31.983075 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-39ddda51-a74f-4bc5-91bb-3b0bb419a512 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1290 microversion: 2.1 time: 0.087935 Aug 24 11:06:31.983660 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3557/6754] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:31 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1290 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:33.004296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-85459bdd-6c5d-4d6c-99ee-5ac4c834da22 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:33.005102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-85459bdd-6c5d-4d6c-99ee-5ac4c834da22 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:33.012486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85459bdd-6c5d-4d6c-99ee-5ac4c834da22 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:33.013029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85459bdd-6c5d-4d6c-99ee-5ac4c834da22 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:33.013492 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85459bdd-6c5d-4d6c-99ee-5ac4c834da22 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:33.014190 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85459bdd-6c5d-4d6c-99ee-5ac4c834da22 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:33.014630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85459bdd-6c5d-4d6c-99ee-5ac4c834da22 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:33.015059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85459bdd-6c5d-4d6c-99ee-5ac4c834da22 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:33.228525 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-85459bdd-6c5d-4d6c-99ee-5ac4c834da22 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:33.236665 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-85459bdd-6c5d-4d6c-99ee-5ac4c834da22 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1363 microversion: 2.1 time: 0.236404 Aug 24 11:06:33.237368 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3198/6755] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:32 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:33.527593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-7034c879-1fb4-4f02-8b40-30fd77b0a13b req-1b5d45cd-4825-4af5-b4bf-2961952355bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "009add20-7850-405d-b93b-f33c860242eb", "tag": "48022812-84b7-43b4-9694-f9cb1cfaa6a7"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:06:33.541677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7034c879-1fb4-4f02-8b40-30fd77b0a13b req-1b5d45cd-4825-4af5-b4bf-2961952355bc service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:33.542595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7034c879-1fb4-4f02-8b40-30fd77b0a13b req-1b5d45cd-4825-4af5-b4bf-2961952355bc service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:33.543125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7034c879-1fb4-4f02-8b40-30fd77b0a13b req-1b5d45cd-4825-4af5-b4bf-2961952355bc service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:33.555250 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-7034c879-1fb4-4f02-8b40-30fd77b0a13b req-1b5d45cd-4825-4af5-b4bf-2961952355bc service nova] Creating event network-changed:48022812-84b7-43b4-9694-f9cb1cfaa6a7 for instance 009add20-7850-405d-b93b-f33c860242eb on n-h1-849328-3 Aug 24 11:06:33.560589 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-7034c879-1fb4-4f02-8b40-30fd77b0a13b req-1b5d45cd-4825-4af5-b4bf-2961952355bc service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038105 Aug 24 11:06:33.561427 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3558/6756] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:06:34.260443 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-72a62592-0b62-4588-95ac-536c847ac646 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:34.261201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-72a62592-0b62-4588-95ac-536c847ac646 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:34.271017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72a62592-0b62-4588-95ac-536c847ac646 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:34.271505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72a62592-0b62-4588-95ac-536c847ac646 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:34.271929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72a62592-0b62-4588-95ac-536c847ac646 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:34.272632 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72a62592-0b62-4588-95ac-536c847ac646 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:34.273105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72a62592-0b62-4588-95ac-536c847ac646 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:34.273585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72a62592-0b62-4588-95ac-536c847ac646 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:34.411677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-72a62592-0b62-4588-95ac-536c847ac646 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:34.421993 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-72a62592-0b62-4588-95ac-536c847ac646 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1363 microversion: 2.1 time: 0.166887 Aug 24 11:06:34.422590 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3199/6757] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:34 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:35.445064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-500ada82-cb9f-430c-80c7-36217f1da492 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:35.445853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-500ada82-cb9f-430c-80c7-36217f1da492 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:35.452893 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-500ada82-cb9f-430c-80c7-36217f1da492 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:35.453449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-500ada82-cb9f-430c-80c7-36217f1da492 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:35.453927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-500ada82-cb9f-430c-80c7-36217f1da492 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:35.454669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-500ada82-cb9f-430c-80c7-36217f1da492 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:35.455168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-500ada82-cb9f-430c-80c7-36217f1da492 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:35.455633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-500ada82-cb9f-430c-80c7-36217f1da492 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:35.604881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-500ada82-cb9f-430c-80c7-36217f1da492 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:35.613042 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-500ada82-cb9f-430c-80c7-36217f1da492 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1363 microversion: 2.1 time: 0.173627 Aug 24 11:06:35.613653 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3559/6758] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:35 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:36.634147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7df46d47-fd14-4f0c-8373-4974a90a5930 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:36.634732 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7df46d47-fd14-4f0c-8373-4974a90a5930 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:36.642498 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7df46d47-fd14-4f0c-8373-4974a90a5930 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:36.642985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7df46d47-fd14-4f0c-8373-4974a90a5930 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:36.643420 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7df46d47-fd14-4f0c-8373-4974a90a5930 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:36.644107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7df46d47-fd14-4f0c-8373-4974a90a5930 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:36.644563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7df46d47-fd14-4f0c-8373-4974a90a5930 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:36.644986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7df46d47-fd14-4f0c-8373-4974a90a5930 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:36.778449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7df46d47-fd14-4f0c-8373-4974a90a5930 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:36.786892 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7df46d47-fd14-4f0c-8373-4974a90a5930 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1363 microversion: 2.1 time: 0.156749 Aug 24 11:06:36.787486 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3200/6759] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:36 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:37.811606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a62a7509-cead-44c2-8705-8d8696ecad60 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:37.812225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a62a7509-cead-44c2-8705-8d8696ecad60 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:37.819684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a62a7509-cead-44c2-8705-8d8696ecad60 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:37.820199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a62a7509-cead-44c2-8705-8d8696ecad60 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:37.820650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a62a7509-cead-44c2-8705-8d8696ecad60 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:37.821399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a62a7509-cead-44c2-8705-8d8696ecad60 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:37.821873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a62a7509-cead-44c2-8705-8d8696ecad60 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:37.822297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a62a7509-cead-44c2-8705-8d8696ecad60 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:37.957724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a62a7509-cead-44c2-8705-8d8696ecad60 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:37.961142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3f42743d-da38-4354-9649-46797879e347 req-64be686b-6414-4e66-881a-e617c1269fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "009add20-7850-405d-b93b-f33c860242eb", "name": "network-vif-plugged", "status": "completed", "tag": "48022812-84b7-43b4-9694-f9cb1cfaa6a7"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:06:37.966537 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a62a7509-cead-44c2-8705-8d8696ecad60 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1363 microversion: 2.1 time: 0.161118 Aug 24 11:06:37.967277 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3560/6760] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:37 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:37.974161 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3f42743d-da38-4354-9649-46797879e347 req-64be686b-6414-4e66-881a-e617c1269fa4 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:37.974678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3f42743d-da38-4354-9649-46797879e347 req-64be686b-6414-4e66-881a-e617c1269fa4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:37.976012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3f42743d-da38-4354-9649-46797879e347 req-64be686b-6414-4e66-881a-e617c1269fa4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:37.990122 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3f42743d-da38-4354-9649-46797879e347 req-64be686b-6414-4e66-881a-e617c1269fa4 service nova] Creating event network-vif-plugged:48022812-84b7-43b4-9694-f9cb1cfaa6a7 for instance 009add20-7850-405d-b93b-f33c860242eb on n-h1-849328-3 Aug 24 11:06:37.995303 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3f42743d-da38-4354-9649-46797879e347 req-64be686b-6414-4e66-881a-e617c1269fa4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038292 Aug 24 11:06:37.996326 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3201/6761] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:06:38.991394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5278478c-1e89-4a7e-99eb-1ed13c1a29ad tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:38.992095 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5278478c-1e89-4a7e-99eb-1ed13c1a29ad tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:39.001829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5278478c-1e89-4a7e-99eb-1ed13c1a29ad tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:39.002320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5278478c-1e89-4a7e-99eb-1ed13c1a29ad tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:39.002771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5278478c-1e89-4a7e-99eb-1ed13c1a29ad tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:39.003483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5278478c-1e89-4a7e-99eb-1ed13c1a29ad tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:39.003948 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5278478c-1e89-4a7e-99eb-1ed13c1a29ad tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:39.004385 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5278478c-1e89-4a7e-99eb-1ed13c1a29ad tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:39.136843 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5278478c-1e89-4a7e-99eb-1ed13c1a29ad tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:39.145095 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5278478c-1e89-4a7e-99eb-1ed13c1a29ad tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1363 microversion: 2.1 time: 0.160263 Aug 24 11:06:39.145817 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3561/6762] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:38 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:40.171097 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad8c9686-2c68-40fc-8ed6-47543076cdce tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:40.171836 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ad8c9686-2c68-40fc-8ed6-47543076cdce tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:40.179697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad8c9686-2c68-40fc-8ed6-47543076cdce tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:40.180184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad8c9686-2c68-40fc-8ed6-47543076cdce tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:40.180626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad8c9686-2c68-40fc-8ed6-47543076cdce tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:40.181374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad8c9686-2c68-40fc-8ed6-47543076cdce tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:40.181833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad8c9686-2c68-40fc-8ed6-47543076cdce tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:40.182242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad8c9686-2c68-40fc-8ed6-47543076cdce tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:40.378945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ad8c9686-2c68-40fc-8ed6-47543076cdce tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:40.387048 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ad8c9686-2c68-40fc-8ed6-47543076cdce tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1551 microversion: 2.1 time: 0.222616 Aug 24 11:06:40.387657 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3202/6763] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:40 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1551 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:40.408031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4e062fac-a3bf-4cc0-b82a-9a60b354f281 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:40.408515 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4e062fac-a3bf-4cc0-b82a-9a60b354f281 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:40.415856 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e062fac-a3bf-4cc0-b82a-9a60b354f281 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:40.416353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e062fac-a3bf-4cc0-b82a-9a60b354f281 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:40.416800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e062fac-a3bf-4cc0-b82a-9a60b354f281 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:40.417613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e062fac-a3bf-4cc0-b82a-9a60b354f281 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:40.418080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e062fac-a3bf-4cc0-b82a-9a60b354f281 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:40.418512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e062fac-a3bf-4cc0-b82a-9a60b354f281 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:40.572285 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4e062fac-a3bf-4cc0-b82a-9a60b354f281 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.168296 Aug 24 11:06:40.572927 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3562/6764] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Aug 24 11:06:40 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb/os-interface => generated 285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:06:41.530929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:06:41.592874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c2cba298-5cae-46ce-b8fd-a82c4d51cb68 req-cf04826d-4780-4299-bed4-9ef622e0bda7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "009add20-7850-405d-b93b-f33c860242eb", "tag": "48022812-84b7-43b4-9694-f9cb1cfaa6a7"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:06:41.603731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c2cba298-5cae-46ce-b8fd-a82c4d51cb68 req-cf04826d-4780-4299-bed4-9ef622e0bda7 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:41.604296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c2cba298-5cae-46ce-b8fd-a82c4d51cb68 req-cf04826d-4780-4299-bed4-9ef622e0bda7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:41.604802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c2cba298-5cae-46ce-b8fd-a82c4d51cb68 req-cf04826d-4780-4299-bed4-9ef622e0bda7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:41.615470 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c2cba298-5cae-46ce-b8fd-a82c4d51cb68 req-cf04826d-4780-4299-bed4-9ef622e0bda7 service nova] Creating event network-changed:48022812-84b7-43b4-9694-f9cb1cfaa6a7 for instance 009add20-7850-405d-b93b-f33c860242eb on n-h1-849328-3 Aug 24 11:06:41.620935 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c2cba298-5cae-46ce-b8fd-a82c4d51cb68 req-cf04826d-4780-4299-bed4-9ef622e0bda7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094521 Aug 24 11:06:41.621611 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3203/6765] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:07:15.507574 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:15.508547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:15.511063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:15.511364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=32 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:15.515626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fb64a515-e95b-4da8-aaf9-07772c282a37 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:15.516253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fb64a515-e95b-4da8-aaf9-07772c282a37 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:15.524213 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb64a515-e95b-4da8-aaf9-07772c282a37 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:15.524705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb64a515-e95b-4da8-aaf9-07772c282a37 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:15.525149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb64a515-e95b-4da8-aaf9-07772c282a37 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:15.525860 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb64a515-e95b-4da8-aaf9-07772c282a37 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:15.526329 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb64a515-e95b-4da8-aaf9-07772c282a37 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:15.526761 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb64a515-e95b-4da8-aaf9-07772c282a37 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:15.670786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fb64a515-e95b-4da8-aaf9-07772c282a37 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:15.682169 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fb64a515-e95b-4da8-aaf9-07772c282a37 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1670 microversion: 2.1 time: 0.175665 Aug 24 11:07:15.682867 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3563/6766] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:15 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1670 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:15.702754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=15 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:15.703568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=28 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:15.708948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6f31b135-7e35-42c2-9e7a-c7d57b1b477e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:15.709913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6f31b135-7e35-42c2-9e7a-c7d57b1b477e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:15.720173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f31b135-7e35-42c2-9e7a-c7d57b1b477e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:15.720885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f31b135-7e35-42c2-9e7a-c7d57b1b477e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:15.721538 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f31b135-7e35-42c2-9e7a-c7d57b1b477e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:15.722573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f31b135-7e35-42c2-9e7a-c7d57b1b477e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:15.723677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f31b135-7e35-42c2-9e7a-c7d57b1b477e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:15.723821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f31b135-7e35-42c2-9e7a-c7d57b1b477e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:15.879164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6f31b135-7e35-42c2-9e7a-c7d57b1b477e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:15.888024 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6f31b135-7e35-42c2-9e7a-c7d57b1b477e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1670 microversion: 2.1 time: 0.188464 Aug 24 11:07:15.888623 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3204/6767] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:15 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1670 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:15.911018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b9269030-7daa-4dcc-a4dd-b1e56f9fb483 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:15.911980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b9269030-7daa-4dcc-a4dd-b1e56f9fb483 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:15.921943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9269030-7daa-4dcc-a4dd-b1e56f9fb483 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:15.922703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9269030-7daa-4dcc-a4dd-b1e56f9fb483 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:15.923321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9269030-7daa-4dcc-a4dd-b1e56f9fb483 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:15.924279 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9269030-7daa-4dcc-a4dd-b1e56f9fb483 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:15.924834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9269030-7daa-4dcc-a4dd-b1e56f9fb483 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:15.925529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9269030-7daa-4dcc-a4dd-b1e56f9fb483 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:16.079372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b9269030-7daa-4dcc-a4dd-b1e56f9fb483 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:16.090524 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b9269030-7daa-4dcc-a4dd-b1e56f9fb483 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1670 microversion: 2.1 time: 0.185710 Aug 24 11:07:16.091116 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3564/6768] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:15 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1670 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:16.111828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b07daa45-072c-425e-828f-4863375e02a8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:07:16.114348 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b07daa45-072c-425e-828f-4863375e02a8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:16.121497 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b07daa45-072c-425e-828f-4863375e02a8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:16.121993 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b07daa45-072c-425e-828f-4863375e02a8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:16.122426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b07daa45-072c-425e-828f-4863375e02a8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:16.123136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b07daa45-072c-425e-828f-4863375e02a8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:16.123593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b07daa45-072c-425e-828f-4863375e02a8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:16.124018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b07daa45-072c-425e-828f-4863375e02a8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:16.161253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b07daa45-072c-425e-828f-4863375e02a8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:16.167908 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b07daa45-072c-425e-828f-4863375e02a8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Old instance type m1.heat2, new instance type m1.heat {{(pid=122432) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 11:07:16.174851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b07daa45-072c-425e-828f-4863375e02a8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:07:16.175279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b07daa45-072c-425e-828f-4863375e02a8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:07:16.175771 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b07daa45-072c-425e-828f-4863375e02a8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:07:16.176302 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b07daa45-072c-425e-828f-4863375e02a8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:07:16.176727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b07daa45-072c-425e-828f-4863375e02a8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:07:16.255588 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b07daa45-072c-425e-828f-4863375e02a8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "POST /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb/action" status: 202 len: 0 microversion: 2.1 time: 0.147758 Aug 24 11:07:16.256418 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3205/6769] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:07:16 2022] POST /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:07:16.264809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3a31d248-e550-41e5-b20f-403e699cb117 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:16.265480 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3a31d248-e550-41e5-b20f-403e699cb117 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:16.271952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a31d248-e550-41e5-b20f-403e699cb117 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:16.272451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a31d248-e550-41e5-b20f-403e699cb117 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:16.272895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a31d248-e550-41e5-b20f-403e699cb117 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:16.273663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a31d248-e550-41e5-b20f-403e699cb117 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:16.274124 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a31d248-e550-41e5-b20f-403e699cb117 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:16.274561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a31d248-e550-41e5-b20f-403e699cb117 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:16.438933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3a31d248-e550-41e5-b20f-403e699cb117 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:16.447176 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3a31d248-e550-41e5-b20f-403e699cb117 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1679 microversion: 2.1 time: 0.186484 Aug 24 11:07:16.447803 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3565/6770] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:16 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1679 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:17.470338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-60ea0300-d363-47a6-9b42-d1cf588a775b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:17.471094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-60ea0300-d363-47a6-9b42-d1cf588a775b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:17.478192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60ea0300-d363-47a6-9b42-d1cf588a775b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:17.478693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60ea0300-d363-47a6-9b42-d1cf588a775b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:17.479139 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60ea0300-d363-47a6-9b42-d1cf588a775b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:17.479849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60ea0300-d363-47a6-9b42-d1cf588a775b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:17.480305 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60ea0300-d363-47a6-9b42-d1cf588a775b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:17.480734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60ea0300-d363-47a6-9b42-d1cf588a775b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:17.618473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-60ea0300-d363-47a6-9b42-d1cf588a775b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:17.626970 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-60ea0300-d363-47a6-9b42-d1cf588a775b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1679 microversion: 2.1 time: 0.161610 Aug 24 11:07:17.627568 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3206/6771] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:17 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:18.650908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8f73cd10-beea-4eaf-aa7a-18ae9c0beb90 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:18.651743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8f73cd10-beea-4eaf-aa7a-18ae9c0beb90 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:18.661317 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f73cd10-beea-4eaf-aa7a-18ae9c0beb90 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:18.662011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f73cd10-beea-4eaf-aa7a-18ae9c0beb90 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:18.662596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f73cd10-beea-4eaf-aa7a-18ae9c0beb90 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:18.663557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f73cd10-beea-4eaf-aa7a-18ae9c0beb90 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:18.664177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f73cd10-beea-4eaf-aa7a-18ae9c0beb90 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:18.664786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f73cd10-beea-4eaf-aa7a-18ae9c0beb90 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:18.798674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8f73cd10-beea-4eaf-aa7a-18ae9c0beb90 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:18.807180 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8f73cd10-beea-4eaf-aa7a-18ae9c0beb90 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1684 microversion: 2.1 time: 0.162261 Aug 24 11:07:18.807764 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3566/6772] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:18 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:19.832687 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0722cb33-bc7c-4537-a816-738eb5885e06 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:19.833606 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0722cb33-bc7c-4537-a816-738eb5885e06 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:19.843589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0722cb33-bc7c-4537-a816-738eb5885e06 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:19.844087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0722cb33-bc7c-4537-a816-738eb5885e06 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:19.844528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0722cb33-bc7c-4537-a816-738eb5885e06 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:19.845273 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0722cb33-bc7c-4537-a816-738eb5885e06 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:19.845734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0722cb33-bc7c-4537-a816-738eb5885e06 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:19.846168 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0722cb33-bc7c-4537-a816-738eb5885e06 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:19.987544 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0722cb33-bc7c-4537-a816-738eb5885e06 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:19.996372 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0722cb33-bc7c-4537-a816-738eb5885e06 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1684 microversion: 2.1 time: 0.170635 Aug 24 11:07:19.996968 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3207/6773] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:19 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1684 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:21.023140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-219e1aeb-e47f-40ca-b6dd-de7c3cc9e535 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:21.024213 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-219e1aeb-e47f-40ca-b6dd-de7c3cc9e535 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:21.034929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-219e1aeb-e47f-40ca-b6dd-de7c3cc9e535 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:21.035455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-219e1aeb-e47f-40ca-b6dd-de7c3cc9e535 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:21.035914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-219e1aeb-e47f-40ca-b6dd-de7c3cc9e535 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:21.036630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-219e1aeb-e47f-40ca-b6dd-de7c3cc9e535 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:21.037157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-219e1aeb-e47f-40ca-b6dd-de7c3cc9e535 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:21.037611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-219e1aeb-e47f-40ca-b6dd-de7c3cc9e535 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:21.182619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-219e1aeb-e47f-40ca-b6dd-de7c3cc9e535 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:21.191003 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-219e1aeb-e47f-40ca-b6dd-de7c3cc9e535 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1684 microversion: 2.1 time: 0.175056 Aug 24 11:07:21.191632 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3567/6774] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:21 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:22.214588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-49da3b59-74a5-4e6e-a69d-d5deb262d97d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:22.215357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-49da3b59-74a5-4e6e-a69d-d5deb262d97d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:22.225178 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49da3b59-74a5-4e6e-a69d-d5deb262d97d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:22.225874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49da3b59-74a5-4e6e-a69d-d5deb262d97d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:22.226460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49da3b59-74a5-4e6e-a69d-d5deb262d97d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:22.227727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49da3b59-74a5-4e6e-a69d-d5deb262d97d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:22.228333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49da3b59-74a5-4e6e-a69d-d5deb262d97d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:22.228877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49da3b59-74a5-4e6e-a69d-d5deb262d97d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:22.376349 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-49da3b59-74a5-4e6e-a69d-d5deb262d97d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:22.384579 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-49da3b59-74a5-4e6e-a69d-d5deb262d97d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1684 microversion: 2.1 time: 0.175276 Aug 24 11:07:22.385177 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3208/6775] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:22 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:23.409987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-31683eb4-7a88-470c-b34f-5ee7ac52c602 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:23.410745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-31683eb4-7a88-470c-b34f-5ee7ac52c602 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:23.419108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31683eb4-7a88-470c-b34f-5ee7ac52c602 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:23.419697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31683eb4-7a88-470c-b34f-5ee7ac52c602 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:23.420233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31683eb4-7a88-470c-b34f-5ee7ac52c602 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:23.421068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31683eb4-7a88-470c-b34f-5ee7ac52c602 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:23.421662 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31683eb4-7a88-470c-b34f-5ee7ac52c602 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:23.422181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31683eb4-7a88-470c-b34f-5ee7ac52c602 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:23.561290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-31683eb4-7a88-470c-b34f-5ee7ac52c602 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:23.569645 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-31683eb4-7a88-470c-b34f-5ee7ac52c602 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1684 microversion: 2.1 time: 0.165411 Aug 24 11:07:23.570248 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3568/6776] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:23 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:24.593016 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd6e14e5-6eb6-43a7-b1c5-d55b61707d30 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:24.593637 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dd6e14e5-6eb6-43a7-b1c5-d55b61707d30 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:24.604168 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd6e14e5-6eb6-43a7-b1c5-d55b61707d30 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:24.604852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd6e14e5-6eb6-43a7-b1c5-d55b61707d30 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:24.605452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd6e14e5-6eb6-43a7-b1c5-d55b61707d30 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:24.606486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd6e14e5-6eb6-43a7-b1c5-d55b61707d30 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:24.607114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd6e14e5-6eb6-43a7-b1c5-d55b61707d30 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:24.607632 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd6e14e5-6eb6-43a7-b1c5-d55b61707d30 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:24.747930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dd6e14e5-6eb6-43a7-b1c5-d55b61707d30 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:24.756509 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dd6e14e5-6eb6-43a7-b1c5-d55b61707d30 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1684 microversion: 2.1 time: 0.167894 Aug 24 11:07:24.757090 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3209/6777] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:24 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:25.780915 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9d949bb0-25dd-4294-9ebc-3c86daa717eb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:25.781509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9d949bb0-25dd-4294-9ebc-3c86daa717eb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:25.789393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d949bb0-25dd-4294-9ebc-3c86daa717eb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:25.789905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d949bb0-25dd-4294-9ebc-3c86daa717eb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:25.790354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d949bb0-25dd-4294-9ebc-3c86daa717eb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:25.791081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d949bb0-25dd-4294-9ebc-3c86daa717eb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:25.791550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d949bb0-25dd-4294-9ebc-3c86daa717eb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:25.791992 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d949bb0-25dd-4294-9ebc-3c86daa717eb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:25.931498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9d949bb0-25dd-4294-9ebc-3c86daa717eb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:25.939897 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9d949bb0-25dd-4294-9ebc-3c86daa717eb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1684 microversion: 2.1 time: 0.165138 Aug 24 11:07:25.940504 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3569/6778] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:25 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:26.960685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-373769b7-9cb6-4e9d-9a3f-aee5c0fe7c1c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:26.961338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-373769b7-9cb6-4e9d-9a3f-aee5c0fe7c1c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:26.969004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-373769b7-9cb6-4e9d-9a3f-aee5c0fe7c1c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:26.969549 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-373769b7-9cb6-4e9d-9a3f-aee5c0fe7c1c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:26.969988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-373769b7-9cb6-4e9d-9a3f-aee5c0fe7c1c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:26.970744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-373769b7-9cb6-4e9d-9a3f-aee5c0fe7c1c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:26.971211 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-373769b7-9cb6-4e9d-9a3f-aee5c0fe7c1c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:26.971640 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-373769b7-9cb6-4e9d-9a3f-aee5c0fe7c1c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:27.120054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-373769b7-9cb6-4e9d-9a3f-aee5c0fe7c1c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:27.128295 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-373769b7-9cb6-4e9d-9a3f-aee5c0fe7c1c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1684 microversion: 2.1 time: 0.171754 Aug 24 11:07:27.128902 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3210/6779] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:26 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1684 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:28.157944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f107bd85-d415-4001-b313-061c3f3f505c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:28.158575 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f107bd85-d415-4001-b313-061c3f3f505c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:28.166164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f107bd85-d415-4001-b313-061c3f3f505c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:28.166660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f107bd85-d415-4001-b313-061c3f3f505c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:28.167106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f107bd85-d415-4001-b313-061c3f3f505c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:28.167815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f107bd85-d415-4001-b313-061c3f3f505c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:28.168277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f107bd85-d415-4001-b313-061c3f3f505c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:28.168712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f107bd85-d415-4001-b313-061c3f3f505c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:28.309487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f107bd85-d415-4001-b313-061c3f3f505c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:28.321964 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f107bd85-d415-4001-b313-061c3f3f505c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1684 microversion: 2.1 time: 0.168473 Aug 24 11:07:28.322866 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3570/6780] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:28 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:29.348867 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3e92ccda-5a26-499d-a8f4-6dcd92cdcef3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:29.349555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3e92ccda-5a26-499d-a8f4-6dcd92cdcef3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:29.357151 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e92ccda-5a26-499d-a8f4-6dcd92cdcef3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:29.357669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e92ccda-5a26-499d-a8f4-6dcd92cdcef3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:29.358106 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e92ccda-5a26-499d-a8f4-6dcd92cdcef3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:29.358795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e92ccda-5a26-499d-a8f4-6dcd92cdcef3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:29.359247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e92ccda-5a26-499d-a8f4-6dcd92cdcef3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:29.359669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e92ccda-5a26-499d-a8f4-6dcd92cdcef3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:29.498489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3e92ccda-5a26-499d-a8f4-6dcd92cdcef3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:29.510353 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3e92ccda-5a26-499d-a8f4-6dcd92cdcef3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1684 microversion: 2.1 time: 0.165515 Aug 24 11:07:29.510353 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3211/6781] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:29 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:30.532266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fd2eb5aa-b174-4206-834c-578ef7cc52aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:30.532870 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fd2eb5aa-b174-4206-834c-578ef7cc52aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:30.540520 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd2eb5aa-b174-4206-834c-578ef7cc52aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:30.541019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd2eb5aa-b174-4206-834c-578ef7cc52aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:30.541510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd2eb5aa-b174-4206-834c-578ef7cc52aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:30.542237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd2eb5aa-b174-4206-834c-578ef7cc52aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:30.542709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd2eb5aa-b174-4206-834c-578ef7cc52aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:30.543148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd2eb5aa-b174-4206-834c-578ef7cc52aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:30.680653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fd2eb5aa-b174-4206-834c-578ef7cc52aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:30.688835 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fd2eb5aa-b174-4206-834c-578ef7cc52aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1683 microversion: 2.1 time: 0.160608 Aug 24 11:07:30.689651 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3571/6782] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:30 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:30.858857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-0bdd1528-4708-43b1-aecb-3d441ab0fe77 req-8def4bd2-ed64-432d-9fe4-9d824649960d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "009add20-7850-405d-b93b-f33c860242eb", "name": "network-vif-unplugged", "status": "completed", "tag": "48022812-84b7-43b4-9694-f9cb1cfaa6a7"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:07:30.869849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0bdd1528-4708-43b1-aecb-3d441ab0fe77 req-8def4bd2-ed64-432d-9fe4-9d824649960d service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:30.870307 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0bdd1528-4708-43b1-aecb-3d441ab0fe77 req-8def4bd2-ed64-432d-9fe4-9d824649960d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:30.870764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0bdd1528-4708-43b1-aecb-3d441ab0fe77 req-8def4bd2-ed64-432d-9fe4-9d824649960d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:30.883319 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-0bdd1528-4708-43b1-aecb-3d441ab0fe77 req-8def4bd2-ed64-432d-9fe4-9d824649960d service nova] Creating event network-vif-unplugged:48022812-84b7-43b4-9694-f9cb1cfaa6a7 for instance 009add20-7850-405d-b93b-f33c860242eb on n-h2-849328-3 Aug 24 11:07:30.889016 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-0bdd1528-4708-43b1-aecb-3d441ab0fe77 req-8def4bd2-ed64-432d-9fe4-9d824649960d service nova] Instance 009add20-7850-405d-b93b-f33c860242eb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 11:07:30.900721 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-0bdd1528-4708-43b1-aecb-3d441ab0fe77 req-8def4bd2-ed64-432d-9fe4-9d824649960d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045416 Aug 24 11:07:30.901510 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3212/6783] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:07:31.711401 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a22e731a-1c2f-4b98-8c9b-787e19c71f12 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:31.712167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a22e731a-1c2f-4b98-8c9b-787e19c71f12 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:31.719151 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a22e731a-1c2f-4b98-8c9b-787e19c71f12 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:31.719650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a22e731a-1c2f-4b98-8c9b-787e19c71f12 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:31.720095 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a22e731a-1c2f-4b98-8c9b-787e19c71f12 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:31.720791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a22e731a-1c2f-4b98-8c9b-787e19c71f12 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:31.721324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a22e731a-1c2f-4b98-8c9b-787e19c71f12 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:31.721732 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a22e731a-1c2f-4b98-8c9b-787e19c71f12 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:31.859583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a22e731a-1c2f-4b98-8c9b-787e19c71f12 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:31.868764 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a22e731a-1c2f-4b98-8c9b-787e19c71f12 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1683 microversion: 2.1 time: 0.161497 Aug 24 11:07:31.869370 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3572/6784] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:31 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:32.892719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b9343bfd-1c88-4d69-bc97-4c6d3e0870e1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:32.893318 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b9343bfd-1c88-4d69-bc97-4c6d3e0870e1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:32.900365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9343bfd-1c88-4d69-bc97-4c6d3e0870e1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:32.900837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9343bfd-1c88-4d69-bc97-4c6d3e0870e1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:32.901321 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9343bfd-1c88-4d69-bc97-4c6d3e0870e1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:32.902058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9343bfd-1c88-4d69-bc97-4c6d3e0870e1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:32.902516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9343bfd-1c88-4d69-bc97-4c6d3e0870e1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:32.902923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9343bfd-1c88-4d69-bc97-4c6d3e0870e1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:32.919549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-5055dab3-498c-4125-b295-d735ed19824a req-7001db2a-8b21-4080-b4cc-de2c2cd1257a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "009add20-7850-405d-b93b-f33c860242eb", "tag": "48022812-84b7-43b4-9694-f9cb1cfaa6a7"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:07:32.930462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5055dab3-498c-4125-b295-d735ed19824a req-7001db2a-8b21-4080-b4cc-de2c2cd1257a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:32.930968 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5055dab3-498c-4125-b295-d735ed19824a req-7001db2a-8b21-4080-b4cc-de2c2cd1257a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:32.931404 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5055dab3-498c-4125-b295-d735ed19824a req-7001db2a-8b21-4080-b4cc-de2c2cd1257a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:32.944525 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-5055dab3-498c-4125-b295-d735ed19824a req-7001db2a-8b21-4080-b4cc-de2c2cd1257a service nova] Creating event network-changed:48022812-84b7-43b4-9694-f9cb1cfaa6a7 for instance 009add20-7850-405d-b93b-f33c860242eb on n-h2-849328-3 Aug 24 11:07:32.951120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-5055dab3-498c-4125-b295-d735ed19824a req-7001db2a-8b21-4080-b4cc-de2c2cd1257a service nova] Instance 009add20-7850-405d-b93b-f33c860242eb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 11:07:32.962639 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-5055dab3-498c-4125-b295-d735ed19824a req-7001db2a-8b21-4080-b4cc-de2c2cd1257a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047470 Aug 24 11:07:32.963246 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3573/6785] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:07:33.082057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b9343bfd-1c88-4d69-bc97-4c6d3e0870e1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:33.090641 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b9343bfd-1c88-4d69-bc97-4c6d3e0870e1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1681 microversion: 2.1 time: 0.203279 Aug 24 11:07:33.091238 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3213/6786] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:32 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1681 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:34.114844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-36fa69ee-668a-4c8b-bbc2-4b60f44302bc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:34.116374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-36fa69ee-668a-4c8b-bbc2-4b60f44302bc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:34.123958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36fa69ee-668a-4c8b-bbc2-4b60f44302bc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:34.124470 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36fa69ee-668a-4c8b-bbc2-4b60f44302bc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:34.124924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36fa69ee-668a-4c8b-bbc2-4b60f44302bc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:34.125857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36fa69ee-668a-4c8b-bbc2-4b60f44302bc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:34.126536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36fa69ee-668a-4c8b-bbc2-4b60f44302bc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:34.127345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36fa69ee-668a-4c8b-bbc2-4b60f44302bc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:34.278481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-36fa69ee-668a-4c8b-bbc2-4b60f44302bc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:34.287726 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-36fa69ee-668a-4c8b-bbc2-4b60f44302bc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1678 microversion: 2.1 time: 0.177792 Aug 24 11:07:34.300665 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3574/6787] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:34 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1678 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:34.309730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-051e0f40-e382-4fc3-978b-27522fc28c66 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:07:34.310403 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-051e0f40-e382-4fc3-978b-27522fc28c66 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:34.319217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-051e0f40-e382-4fc3-978b-27522fc28c66 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:34.319717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-051e0f40-e382-4fc3-978b-27522fc28c66 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:34.320157 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-051e0f40-e382-4fc3-978b-27522fc28c66 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:34.320880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-051e0f40-e382-4fc3-978b-27522fc28c66 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:34.321371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-051e0f40-e382-4fc3-978b-27522fc28c66 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:34.321804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-051e0f40-e382-4fc3-978b-27522fc28c66 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:34.393920 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-051e0f40-e382-4fc3-978b-27522fc28c66 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "POST /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb/action" status: 204 len: 0 microversion: 2.1 time: 0.088189 Aug 24 11:07:34.394764 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3214/6788] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:07:34 2022] POST /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb/action => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:07:34.403687 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-902cf28b-1d50-447d-863c-9bb7c5de9275 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:34.404334 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-902cf28b-1d50-447d-863c-9bb7c5de9275 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:34.411259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-902cf28b-1d50-447d-863c-9bb7c5de9275 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:34.411859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-902cf28b-1d50-447d-863c-9bb7c5de9275 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:34.412303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-902cf28b-1d50-447d-863c-9bb7c5de9275 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:34.413104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-902cf28b-1d50-447d-863c-9bb7c5de9275 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:34.414337 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-902cf28b-1d50-447d-863c-9bb7c5de9275 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:34.414790 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-902cf28b-1d50-447d-863c-9bb7c5de9275 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:34.616514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-902cf28b-1d50-447d-863c-9bb7c5de9275 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:34.625832 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-902cf28b-1d50-447d-863c-9bb7c5de9275 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1678 microversion: 2.1 time: 0.226409 Aug 24 11:07:34.626751 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3575/6789] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:34 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1678 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:35.650509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-06f3c0c5-1859-45eb-9a9e-594fb969a424 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:35.651529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-06f3c0c5-1859-45eb-9a9e-594fb969a424 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:35.658671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06f3c0c5-1859-45eb-9a9e-594fb969a424 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:35.659160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06f3c0c5-1859-45eb-9a9e-594fb969a424 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:35.659593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06f3c0c5-1859-45eb-9a9e-594fb969a424 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:35.660466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06f3c0c5-1859-45eb-9a9e-594fb969a424 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:35.660936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06f3c0c5-1859-45eb-9a9e-594fb969a424 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:35.661379 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06f3c0c5-1859-45eb-9a9e-594fb969a424 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:35.811312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-06f3c0c5-1859-45eb-9a9e-594fb969a424 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:35.819515 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-06f3c0c5-1859-45eb-9a9e-594fb969a424 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1678 microversion: 2.1 time: 0.176625 Aug 24 11:07:35.820069 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3215/6790] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:35 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:36.178438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-46934c83-a04f-4e22-bf07-bc9067dd1ac7 req-a73dddfc-416e-4c1b-b469-9385698ecf58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "009add20-7850-405d-b93b-f33c860242eb", "name": "network-vif-plugged", "status": "completed", "tag": "48022812-84b7-43b4-9694-f9cb1cfaa6a7"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:07:36.192390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-46934c83-a04f-4e22-bf07-bc9067dd1ac7 req-a73dddfc-416e-4c1b-b469-9385698ecf58 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:36.192924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-46934c83-a04f-4e22-bf07-bc9067dd1ac7 req-a73dddfc-416e-4c1b-b469-9385698ecf58 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:36.193556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-46934c83-a04f-4e22-bf07-bc9067dd1ac7 req-a73dddfc-416e-4c1b-b469-9385698ecf58 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:36.211310 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-46934c83-a04f-4e22-bf07-bc9067dd1ac7 req-a73dddfc-416e-4c1b-b469-9385698ecf58 service nova] Creating event network-vif-plugged:48022812-84b7-43b4-9694-f9cb1cfaa6a7 for instance 009add20-7850-405d-b93b-f33c860242eb on n-h2-849328-3 Aug 24 11:07:36.217551 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-46934c83-a04f-4e22-bf07-bc9067dd1ac7 req-a73dddfc-416e-4c1b-b469-9385698ecf58 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043096 Aug 24 11:07:36.218340 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3576/6791] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:07:36.841637 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-53c4e2e7-b0eb-427b-8f58-a8f1843e61aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:36.842242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-53c4e2e7-b0eb-427b-8f58-a8f1843e61aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:36.849632 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53c4e2e7-b0eb-427b-8f58-a8f1843e61aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:36.850148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53c4e2e7-b0eb-427b-8f58-a8f1843e61aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:36.850579 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53c4e2e7-b0eb-427b-8f58-a8f1843e61aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:36.851313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53c4e2e7-b0eb-427b-8f58-a8f1843e61aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:36.851793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53c4e2e7-b0eb-427b-8f58-a8f1843e61aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:36.852224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53c4e2e7-b0eb-427b-8f58-a8f1843e61aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:36.989834 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-53c4e2e7-b0eb-427b-8f58-a8f1843e61aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:36.998114 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-53c4e2e7-b0eb-427b-8f58-a8f1843e61aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1670 microversion: 2.1 time: 0.160566 Aug 24 11:07:36.998719 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3216/6792] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:36 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:37.019323 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c4d42be0-d8c6-49f0-973e-3859967c2fa4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:37.020038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c4d42be0-d8c6-49f0-973e-3859967c2fa4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:37.026721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4d42be0-d8c6-49f0-973e-3859967c2fa4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:37.027219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4d42be0-d8c6-49f0-973e-3859967c2fa4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:37.027668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4d42be0-d8c6-49f0-973e-3859967c2fa4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:37.028366 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4d42be0-d8c6-49f0-973e-3859967c2fa4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:37.028831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4d42be0-d8c6-49f0-973e-3859967c2fa4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:37.029300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4d42be0-d8c6-49f0-973e-3859967c2fa4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:37.163384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c4d42be0-d8c6-49f0-973e-3859967c2fa4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:37.171557 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c4d42be0-d8c6-49f0-973e-3859967c2fa4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1670 microversion: 2.1 time: 0.156482 Aug 24 11:07:37.172145 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3577/6793] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:37 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:37.194495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-928f41e0-3d15-42f5-8bf3-8316930bf1b6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:37.195141 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-928f41e0-3d15-42f5-8bf3-8316930bf1b6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:37.201817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-928f41e0-3d15-42f5-8bf3-8316930bf1b6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:37.202312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-928f41e0-3d15-42f5-8bf3-8316930bf1b6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:37.202751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-928f41e0-3d15-42f5-8bf3-8316930bf1b6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:37.203456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-928f41e0-3d15-42f5-8bf3-8316930bf1b6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:37.203912 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-928f41e0-3d15-42f5-8bf3-8316930bf1b6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:37.204341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-928f41e0-3d15-42f5-8bf3-8316930bf1b6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:37.336974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-928f41e0-3d15-42f5-8bf3-8316930bf1b6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:37.345328 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-928f41e0-3d15-42f5-8bf3-8316930bf1b6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1670 microversion: 2.1 time: 0.154891 Aug 24 11:07:37.345931 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3217/6794] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:37 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:37.365974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4c73a6cf-ea68-454e-acfe-df11ce3169aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:37.366480 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4c73a6cf-ea68-454e-acfe-df11ce3169aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:37.373852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c73a6cf-ea68-454e-acfe-df11ce3169aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:37.374353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c73a6cf-ea68-454e-acfe-df11ce3169aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:37.374804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c73a6cf-ea68-454e-acfe-df11ce3169aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:37.375513 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c73a6cf-ea68-454e-acfe-df11ce3169aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:37.375989 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c73a6cf-ea68-454e-acfe-df11ce3169aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:37.376424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c73a6cf-ea68-454e-acfe-df11ce3169aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:37.402793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4c73a6cf-ea68-454e-acfe-df11ce3169aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:07:37.454474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:37.483678 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4c73a6cf-ea68-454e-acfe-df11ce3169aa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "DELETE /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 204 len: 0 microversion: 2.1 time: 0.121469 Aug 24 11:07:37.484304 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3578/6795] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:07:37 2022] DELETE /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:07:37.492817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fc56b945-cdf4-4cec-ac75-299990153d83 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:37.493622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fc56b945-cdf4-4cec-ac75-299990153d83 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:37.499991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc56b945-cdf4-4cec-ac75-299990153d83 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:37.500485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc56b945-cdf4-4cec-ac75-299990153d83 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:37.500920 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc56b945-cdf4-4cec-ac75-299990153d83 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:37.501656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc56b945-cdf4-4cec-ac75-299990153d83 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:37.502119 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc56b945-cdf4-4cec-ac75-299990153d83 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:37.502545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc56b945-cdf4-4cec-ac75-299990153d83 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:37.520522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:37.641568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fc56b945-cdf4-4cec-ac75-299990153d83 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:37.649869 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fc56b945-cdf4-4cec-ac75-299990153d83 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1676 microversion: 2.1 time: 0.161014 Aug 24 11:07:37.650466 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3218/6796] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:37 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:07:38.672729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3771621c-25a2-4685-959a-d671c4f31e62 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:38.673494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3771621c-25a2-4685-959a-d671c4f31e62 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:38.681008 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3771621c-25a2-4685-959a-d671c4f31e62 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:38.681544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3771621c-25a2-4685-959a-d671c4f31e62 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:38.681994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3771621c-25a2-4685-959a-d671c4f31e62 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:38.682710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3771621c-25a2-4685-959a-d671c4f31e62 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:38.683157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3771621c-25a2-4685-959a-d671c4f31e62 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:38.683607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3771621c-25a2-4685-959a-d671c4f31e62 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:38.840663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3771621c-25a2-4685-959a-d671c4f31e62 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:38.850324 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3771621c-25a2-4685-959a-d671c4f31e62 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1676 microversion: 2.1 time: 0.181620 Aug 24 11:07:38.851316 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3579/6797] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:38 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:39.836736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-b077aa5f-2be6-46e0-8e14-91a3f22d3133 req-ea5aa006-680f-4827-a66e-1cd891d32a23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "009add20-7850-405d-b93b-f33c860242eb", "name": "network-vif-deleted", "tag": "48022812-84b7-43b4-9694-f9cb1cfaa6a7"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:07:39.848196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b077aa5f-2be6-46e0-8e14-91a3f22d3133 req-ea5aa006-680f-4827-a66e-1cd891d32a23 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:39.848875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b077aa5f-2be6-46e0-8e14-91a3f22d3133 req-ea5aa006-680f-4827-a66e-1cd891d32a23 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:39.849429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b077aa5f-2be6-46e0-8e14-91a3f22d3133 req-ea5aa006-680f-4827-a66e-1cd891d32a23 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:39.862314 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b077aa5f-2be6-46e0-8e14-91a3f22d3133 req-ea5aa006-680f-4827-a66e-1cd891d32a23 service nova] Creating event network-vif-deleted:48022812-84b7-43b4-9694-f9cb1cfaa6a7 for instance 009add20-7850-405d-b93b-f33c860242eb on n-h2-849328-3 Aug 24 11:07:39.874415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f9e40410-d8f5-43d9-ada5-06c9be257be0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:39.875391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f9e40410-d8f5-43d9-ada5-06c9be257be0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:39.881047 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-b077aa5f-2be6-46e0-8e14-91a3f22d3133 req-ea5aa006-680f-4827-a66e-1cd891d32a23 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049799 Aug 24 11:07:39.882049 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3219/6798] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:07:39.885292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9e40410-d8f5-43d9-ada5-06c9be257be0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:39.889866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9e40410-d8f5-43d9-ada5-06c9be257be0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:39.890542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9e40410-d8f5-43d9-ada5-06c9be257be0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:39.891662 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9e40410-d8f5-43d9-ada5-06c9be257be0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:39.892143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9e40410-d8f5-43d9-ada5-06c9be257be0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:39.892587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9e40410-d8f5-43d9-ada5-06c9be257be0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:39.964494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f9e40410-d8f5-43d9-ada5-06c9be257be0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:39.974788 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f9e40410-d8f5-43d9-ada5-06c9be257be0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 200 len: 1323 microversion: 2.1 time: 0.104068 Aug 24 11:07:39.975109 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3580/6799] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:39 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 1323 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:41.001496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df8f3ca1-183c-44c7-abac-05e68913bce2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:41.002640 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-df8f3ca1-183c-44c7-abac-05e68913bce2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:41.012605 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df8f3ca1-183c-44c7-abac-05e68913bce2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:41.013084 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df8f3ca1-183c-44c7-abac-05e68913bce2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:41.013555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df8f3ca1-183c-44c7-abac-05e68913bce2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:41.014248 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df8f3ca1-183c-44c7-abac-05e68913bce2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:41.014695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df8f3ca1-183c-44c7-abac-05e68913bce2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:41.015118 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df8f3ca1-183c-44c7-abac-05e68913bce2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:41.028578 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-df8f3ca1-183c-44c7-abac-05e68913bce2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] HTTP exception thrown: Instance 009add20-7850-405d-b93b-f33c860242eb could not be found. Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df8f3ca1-183c-44c7-abac-05e68913bce2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Request method failure captured: Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb HTTP/1.1 Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgYz1BeplfuXTHJkOfHIc4HHvWpgmtACVIDqhl2KznLucjDfZdsOv1oOnIJj7M5GsHbWVqHtaPFjE7I8aaNF99wTlcW31oPZk8MPZn4ZadZqVCq5-FgBuGU54DnrikOmEdTLzwsqELSN-iClqJCMIFBnVqLgAZU8nGnLFDU8lQ5UBJs Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9a617355a8b94576bf4edcf58a078a8e", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9a617355a8b94576bf4edcf58a078a8e"}]}] Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 4a1864aed01d473ea51ec9de243ddfa4 Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 009add20-7850-405d-b93b-f33c860242eb could not be found. Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '009add20-7850-405d-b93b-f33c860242eb'} Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 009add20-7850-405d-b93b-f33c860242eb could not be found. Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 009add20-7850-405d-b93b-f33c860242eb could not be found. Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:07:41.030221 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:07:41.034450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:07:41.034450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:07:41.034450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:07:41.034450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:07:41.034450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:07:41.034450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 009add20-7850-405d-b93b-f33c860242eb could not be found. Aug 24 11:07:41.034450 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:07:41.034450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df8f3ca1-183c-44c7-abac-05e68913bce2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Returning 404 to user: Instance 009add20-7850-405d-b93b-f33c860242eb could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:07:41.034450 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-df8f3ca1-183c-44c7-abac-05e68913bce2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 404 len: 111 microversion: 2.1 time: 0.038655 Aug 24 11:07:41.034450 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3220/6800] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:40 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:07:41.043812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3e332832-a2bb-4f69-9735-bd1165b6494c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:41.044423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3e332832-a2bb-4f69-9735-bd1165b6494c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:41.051473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e332832-a2bb-4f69-9735-bd1165b6494c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:41.051974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e332832-a2bb-4f69-9735-bd1165b6494c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:41.052419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e332832-a2bb-4f69-9735-bd1165b6494c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:41.053135 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e332832-a2bb-4f69-9735-bd1165b6494c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:41.053610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e332832-a2bb-4f69-9735-bd1165b6494c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:41.054048 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e332832-a2bb-4f69-9735-bd1165b6494c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:41.067856 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-3e332832-a2bb-4f69-9735-bd1165b6494c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] HTTP exception thrown: Instance 009add20-7850-405d-b93b-f33c860242eb could not be found. Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3e332832-a2bb-4f69-9735-bd1165b6494c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Request method failure captured: Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb HTTP/1.1 Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgYz1BeplfuXTHJkOfHIc4HHvWpgmtACVIDqhl2KznLucjDfZdsOv1oOnIJj7M5GsHbWVqHtaPFjE7I8aaNF99wTlcW31oPZk8MPZn4ZadZqVCq5-FgBuGU54DnrikOmEdTLzwsqELSN-iClqJCMIFBnVqLgAZU8nGnLFDU8lQ5UBJs Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9a617355a8b94576bf4edcf58a078a8e", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9a617355a8b94576bf4edcf58a078a8e"}]}] Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 4a1864aed01d473ea51ec9de243ddfa4 Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 009add20-7850-405d-b93b-f33c860242eb could not be found. Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '009add20-7850-405d-b93b-f33c860242eb'} Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 009add20-7850-405d-b93b-f33c860242eb could not be found. Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 009add20-7850-405d-b93b-f33c860242eb could not be found. Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:07:41.069497 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:07:41.074088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:07:41.074088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:07:41.074088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:07:41.074088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:07:41.074088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:07:41.074088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 009add20-7850-405d-b93b-f33c860242eb could not be found. Aug 24 11:07:41.074088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:07:41.074088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3e332832-a2bb-4f69-9735-bd1165b6494c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Returning 404 to user: Instance 009add20-7850-405d-b93b-f33c860242eb could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:07:41.074088 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3e332832-a2bb-4f69-9735-bd1165b6494c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 404 len: 111 microversion: 2.1 time: 0.031149 Aug 24 11:07:41.074088 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3581/6801] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:41 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:07:41.122813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cb36139f-83d7-4092-8a3c-c7b06119f2a0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-115131525", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "b96fded5-b753-414c-9ed5-a66d8cc1cc36"}], "security_groups": [{"name": "tempest-securitygroup--100998936"}], "key_name": "tempest-keypair-1870957699", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:07:41.239678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-cb36139f-83d7-4092-8a3c-c7b06119f2a0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] validate_networks() for [('b96fded5-b753-414c-9ed5-a66d8cc1cc36', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:07:41.643326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cb36139f-83d7-4092-8a3c-c7b06119f2a0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:07:41.643754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cb36139f-83d7-4092-8a3c-c7b06119f2a0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:07:41.644230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cb36139f-83d7-4092-8a3c-c7b06119f2a0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:07:41.644638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cb36139f-83d7-4092-8a3c-c7b06119f2a0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:07:41.645319 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cb36139f-83d7-4092-8a3c-c7b06119f2a0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:07:41.654783 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb36139f-83d7-4092-8a3c-c7b06119f2a0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:41.655267 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb36139f-83d7-4092-8a3c-c7b06119f2a0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:41.655709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb36139f-83d7-4092-8a3c-c7b06119f2a0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:41.656436 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb36139f-83d7-4092-8a3c-c7b06119f2a0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:41.656902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb36139f-83d7-4092-8a3c-c7b06119f2a0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:41.657360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb36139f-83d7-4092-8a3c-c7b06119f2a0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:41.674676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-cb36139f-83d7-4092-8a3c-c7b06119f2a0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Getting quotas for project 9a617355a8b94576bf4edcf58a078a8e. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:07:41.680668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-cb36139f-83d7-4092-8a3c-c7b06119f2a0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Getting quotas for user 4a1864aed01d473ea51ec9de243ddfa4 and project 9a617355a8b94576bf4edcf58a078a8e. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:07:41.694068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cb36139f-83d7-4092-8a3c-c7b06119f2a0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:07:41.696404 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cb36139f-83d7-4092-8a3c-c7b06119f2a0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:07:41.744608 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cb36139f-83d7-4092-8a3c-c7b06119f2a0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.628288 Aug 24 11:07:41.745298 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3221/6802] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 11:07:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:07:41.756854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1b257ba8-1399-4855-be7d-a74345865aa7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:41.757557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1b257ba8-1399-4855-be7d-a74345865aa7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:41.811475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1b257ba8-1399-4855-be7d-a74345865aa7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:41.818726 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1b257ba8-1399-4855-be7d-a74345865aa7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1238 microversion: 2.1 time: 0.066042 Aug 24 11:07:41.819316 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3582/6803] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:41 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:07:42.841726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5afd02e2-597b-4063-a7ea-ae4d8a66b878 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:42.842486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5afd02e2-597b-4063-a7ea-ae4d8a66b878 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:42.850043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5afd02e2-597b-4063-a7ea-ae4d8a66b878 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:42.850633 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5afd02e2-597b-4063-a7ea-ae4d8a66b878 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:42.851188 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5afd02e2-597b-4063-a7ea-ae4d8a66b878 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:42.851980 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5afd02e2-597b-4063-a7ea-ae4d8a66b878 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:42.852546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5afd02e2-597b-4063-a7ea-ae4d8a66b878 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:42.853508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5afd02e2-597b-4063-a7ea-ae4d8a66b878 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:42.931303 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5afd02e2-597b-4063-a7ea-ae4d8a66b878 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:42.939752 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5afd02e2-597b-4063-a7ea-ae4d8a66b878 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1298 microversion: 2.1 time: 0.103825 Aug 24 11:07:42.940326 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3222/6804] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:42 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1298 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:43.961964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-45e12194-ca91-4de2-9f08-2798bd07fd7b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:43.962656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-45e12194-ca91-4de2-9f08-2798bd07fd7b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:43.970604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45e12194-ca91-4de2-9f08-2798bd07fd7b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:43.971113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45e12194-ca91-4de2-9f08-2798bd07fd7b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:43.971600 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45e12194-ca91-4de2-9f08-2798bd07fd7b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:43.972293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45e12194-ca91-4de2-9f08-2798bd07fd7b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:43.972765 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45e12194-ca91-4de2-9f08-2798bd07fd7b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:43.973239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45e12194-ca91-4de2-9f08-2798bd07fd7b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:44.114107 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-45e12194-ca91-4de2-9f08-2798bd07fd7b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:44.122479 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-45e12194-ca91-4de2-9f08-2798bd07fd7b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1363 microversion: 2.1 time: 0.164642 Aug 24 11:07:44.123245 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3583/6805] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:43 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:44.478291 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3deb4742-f9ce-497e-8d44-1689fe0c14c9 req-edd3071b-1669-4e86-adb2-9ea1878d19e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eed0602b-69ae-45fb-bce8-571f94493a4f", "tag": "c4c27e09-ac2a-46ad-80c3-4d6ba418820c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:07:44.491584 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3deb4742-f9ce-497e-8d44-1689fe0c14c9 req-edd3071b-1669-4e86-adb2-9ea1878d19e9 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:44.492478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3deb4742-f9ce-497e-8d44-1689fe0c14c9 req-edd3071b-1669-4e86-adb2-9ea1878d19e9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:44.493211 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3deb4742-f9ce-497e-8d44-1689fe0c14c9 req-edd3071b-1669-4e86-adb2-9ea1878d19e9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:44.506384 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3deb4742-f9ce-497e-8d44-1689fe0c14c9 req-edd3071b-1669-4e86-adb2-9ea1878d19e9 service nova] Creating event network-changed:c4c27e09-ac2a-46ad-80c3-4d6ba418820c for instance eed0602b-69ae-45fb-bce8-571f94493a4f on n-h1-849328-3 Aug 24 11:07:44.512240 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3deb4742-f9ce-497e-8d44-1689fe0c14c9 req-edd3071b-1669-4e86-adb2-9ea1878d19e9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038345 Aug 24 11:07:44.512958 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3223/6806] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:07:45.148141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-630dde7f-b354-46be-95ec-9efa8aea9d8c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:45.148842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-630dde7f-b354-46be-95ec-9efa8aea9d8c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:45.158951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-630dde7f-b354-46be-95ec-9efa8aea9d8c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:45.159456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-630dde7f-b354-46be-95ec-9efa8aea9d8c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:45.159982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-630dde7f-b354-46be-95ec-9efa8aea9d8c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:45.160741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-630dde7f-b354-46be-95ec-9efa8aea9d8c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:45.161225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-630dde7f-b354-46be-95ec-9efa8aea9d8c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:45.161726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-630dde7f-b354-46be-95ec-9efa8aea9d8c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:45.312110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-630dde7f-b354-46be-95ec-9efa8aea9d8c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:45.322794 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-630dde7f-b354-46be-95ec-9efa8aea9d8c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1363 microversion: 2.1 time: 0.180931 Aug 24 11:07:45.323542 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3584/6807] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:45 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:46.347308 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-63e82631-b4c0-45bb-892b-42182c921c2b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:46.348760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-63e82631-b4c0-45bb-892b-42182c921c2b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:46.354468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:46.364779 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63e82631-b4c0-45bb-892b-42182c921c2b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:46.365560 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63e82631-b4c0-45bb-892b-42182c921c2b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:46.365744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63e82631-b4c0-45bb-892b-42182c921c2b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:46.375528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63e82631-b4c0-45bb-892b-42182c921c2b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:46.376028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63e82631-b4c0-45bb-892b-42182c921c2b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:46.376689 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63e82631-b4c0-45bb-892b-42182c921c2b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:46.607223 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-63e82631-b4c0-45bb-892b-42182c921c2b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:46.615471 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-63e82631-b4c0-45bb-892b-42182c921c2b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1363 microversion: 2.1 time: 0.274585 Aug 24 11:07:46.616076 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3224/6808] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:46 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:47.640936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4a410618-ec1a-4b5b-bdd9-1f03dd149278 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:47.641653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4a410618-ec1a-4b5b-bdd9-1f03dd149278 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:47.644816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:47.650630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a410618-ec1a-4b5b-bdd9-1f03dd149278 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:47.651144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a410618-ec1a-4b5b-bdd9-1f03dd149278 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:47.651600 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a410618-ec1a-4b5b-bdd9-1f03dd149278 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:47.652327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a410618-ec1a-4b5b-bdd9-1f03dd149278 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:47.652808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a410618-ec1a-4b5b-bdd9-1f03dd149278 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:47.653291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a410618-ec1a-4b5b-bdd9-1f03dd149278 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:47.832723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4a410618-ec1a-4b5b-bdd9-1f03dd149278 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:47.841182 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4a410618-ec1a-4b5b-bdd9-1f03dd149278 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1363 microversion: 2.1 time: 0.206792 Aug 24 11:07:47.841783 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3585/6809] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:47 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:48.333656 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c0904a76-62bd-4ca3-9db2-f07437aad7a5 req-e8abb84c-b1ff-406c-a1cd-21e6fd83ee95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed0602b-69ae-45fb-bce8-571f94493a4f", "name": "network-vif-plugged", "status": "completed", "tag": "c4c27e09-ac2a-46ad-80c3-4d6ba418820c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:07:48.349530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c0904a76-62bd-4ca3-9db2-f07437aad7a5 req-e8abb84c-b1ff-406c-a1cd-21e6fd83ee95 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:48.350178 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c0904a76-62bd-4ca3-9db2-f07437aad7a5 req-e8abb84c-b1ff-406c-a1cd-21e6fd83ee95 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:48.350769 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c0904a76-62bd-4ca3-9db2-f07437aad7a5 req-e8abb84c-b1ff-406c-a1cd-21e6fd83ee95 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:48.369094 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c0904a76-62bd-4ca3-9db2-f07437aad7a5 req-e8abb84c-b1ff-406c-a1cd-21e6fd83ee95 service nova] Creating event network-vif-plugged:c4c27e09-ac2a-46ad-80c3-4d6ba418820c for instance eed0602b-69ae-45fb-bce8-571f94493a4f on n-h1-849328-3 Aug 24 11:07:48.375364 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c0904a76-62bd-4ca3-9db2-f07437aad7a5 req-e8abb84c-b1ff-406c-a1cd-21e6fd83ee95 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047450 Aug 24 11:07:48.376535 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3225/6810] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:07:48.866812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-edc9d410-3792-486f-9a48-5235160b3b87 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:48.867798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-edc9d410-3792-486f-9a48-5235160b3b87 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:48.877642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edc9d410-3792-486f-9a48-5235160b3b87 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:48.878138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edc9d410-3792-486f-9a48-5235160b3b87 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:48.878601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edc9d410-3792-486f-9a48-5235160b3b87 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:48.879314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edc9d410-3792-486f-9a48-5235160b3b87 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:48.879821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edc9d410-3792-486f-9a48-5235160b3b87 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:48.880241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edc9d410-3792-486f-9a48-5235160b3b87 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:49.018359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-edc9d410-3792-486f-9a48-5235160b3b87 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:49.026822 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-edc9d410-3792-486f-9a48-5235160b3b87 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1363 microversion: 2.1 time: 0.166765 Aug 24 11:07:49.027424 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3586/6811] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:48 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:50.050891 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-760325e6-415b-4e34-bdc2-2e82e6f7bbfb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:50.051801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-760325e6-415b-4e34-bdc2-2e82e6f7bbfb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:50.058623 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-760325e6-415b-4e34-bdc2-2e82e6f7bbfb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:50.059111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-760325e6-415b-4e34-bdc2-2e82e6f7bbfb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:50.059545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-760325e6-415b-4e34-bdc2-2e82e6f7bbfb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:50.060245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-760325e6-415b-4e34-bdc2-2e82e6f7bbfb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:50.060702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-760325e6-415b-4e34-bdc2-2e82e6f7bbfb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:50.061148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-760325e6-415b-4e34-bdc2-2e82e6f7bbfb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:50.198747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-760325e6-415b-4e34-bdc2-2e82e6f7bbfb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:50.207189 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-760325e6-415b-4e34-bdc2-2e82e6f7bbfb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1550 microversion: 2.1 time: 0.161819 Aug 24 11:07:50.207784 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3226/6812] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:50 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1550 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:50.229064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-910440b5-9dd6-488b-b01a-027795d621a3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:50.229659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-910440b5-9dd6-488b-b01a-027795d621a3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:50.236917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-910440b5-9dd6-488b-b01a-027795d621a3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:50.237453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-910440b5-9dd6-488b-b01a-027795d621a3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:50.237911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-910440b5-9dd6-488b-b01a-027795d621a3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:50.238660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-910440b5-9dd6-488b-b01a-027795d621a3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:50.239131 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-910440b5-9dd6-488b-b01a-027795d621a3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:50.239579 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-910440b5-9dd6-488b-b01a-027795d621a3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:50.322031 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-910440b5-9dd6-488b-b01a-027795d621a3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097034 Aug 24 11:07:50.322872 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3587/6813] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Aug 24 11:07:50 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:07:51.656581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e9346082-0d96-4e2a-abb5-bc2c2cc0116b req-94d82ed5-55c0-45ae-9fef-478ad4dcbcf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eed0602b-69ae-45fb-bce8-571f94493a4f", "tag": "c4c27e09-ac2a-46ad-80c3-4d6ba418820c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:07:51.664528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:51.671268 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e9346082-0d96-4e2a-abb5-bc2c2cc0116b req-94d82ed5-55c0-45ae-9fef-478ad4dcbcf6 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:51.671780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e9346082-0d96-4e2a-abb5-bc2c2cc0116b req-94d82ed5-55c0-45ae-9fef-478ad4dcbcf6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:51.672213 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e9346082-0d96-4e2a-abb5-bc2c2cc0116b req-94d82ed5-55c0-45ae-9fef-478ad4dcbcf6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:51.684882 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e9346082-0d96-4e2a-abb5-bc2c2cc0116b req-94d82ed5-55c0-45ae-9fef-478ad4dcbcf6 service nova] Creating event network-changed:c4c27e09-ac2a-46ad-80c3-4d6ba418820c for instance eed0602b-69ae-45fb-bce8-571f94493a4f on n-h1-849328-3 Aug 24 11:07:51.688491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:51.690824 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e9346082-0d96-4e2a-abb5-bc2c2cc0116b req-94d82ed5-55c0-45ae-9fef-478ad4dcbcf6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039623 Aug 24 11:07:51.691681 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3227/6814] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:08:24.601358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:08:24.602284 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=5 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:08:24.602962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=42 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:08:24.607303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-410e706d-9cd1-4c60-ac6f-73e83b409ccb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:08:24.615214 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-410e706d-9cd1-4c60-ac6f-73e83b409ccb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:24.615684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-410e706d-9cd1-4c60-ac6f-73e83b409ccb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:24.616158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-410e706d-9cd1-4c60-ac6f-73e83b409ccb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:24.639846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-410e706d-9cd1-4c60-ac6f-73e83b409ccb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Going to try to stop instance {{(pid=122433) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 11:08:24.697678 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-410e706d-9cd1-4c60-ac6f-73e83b409ccb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "POST /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f/action" status: 202 len: 0 microversion: 2.1 time: 0.097442 Aug 24 11:08:24.698598 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3588/6815] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:08:24 2022] POST /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:08:24.708780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=7 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:08:24.710079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=33 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:08:24.716170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1868da41-dde1-40d0-ac5c-fc6c72dcac1d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:24.717344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1868da41-dde1-40d0-ac5c-fc6c72dcac1d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:24.729524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1868da41-dde1-40d0-ac5c-fc6c72dcac1d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:24.730198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1868da41-dde1-40d0-ac5c-fc6c72dcac1d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:24.730812 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1868da41-dde1-40d0-ac5c-fc6c72dcac1d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:24.731840 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1868da41-dde1-40d0-ac5c-fc6c72dcac1d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:24.732509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1868da41-dde1-40d0-ac5c-fc6c72dcac1d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:24.733174 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1868da41-dde1-40d0-ac5c-fc6c72dcac1d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:24.887896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1868da41-dde1-40d0-ac5c-fc6c72dcac1d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:24.895969 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1868da41-dde1-40d0-ac5c-fc6c72dcac1d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1679 microversion: 2.1 time: 0.192358 Aug 24 11:08:24.896524 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3228/6816] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:24 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1679 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:08:25.930178 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-58d769bd-0f64-499d-99c5-2e3be71d94c3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:25.931354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-58d769bd-0f64-499d-99c5-2e3be71d94c3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:25.942087 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58d769bd-0f64-499d-99c5-2e3be71d94c3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:25.942926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58d769bd-0f64-499d-99c5-2e3be71d94c3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:25.943601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58d769bd-0f64-499d-99c5-2e3be71d94c3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:25.944309 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58d769bd-0f64-499d-99c5-2e3be71d94c3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:25.944782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58d769bd-0f64-499d-99c5-2e3be71d94c3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:25.945266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58d769bd-0f64-499d-99c5-2e3be71d94c3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:26.098761 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-58d769bd-0f64-499d-99c5-2e3be71d94c3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:26.110973 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-58d769bd-0f64-499d-99c5-2e3be71d94c3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1679 microversion: 2.1 time: 0.189137 Aug 24 11:08:26.111782 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3589/6817] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:25 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1679 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:27.140734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e246d8ab-34c5-4777-a083-109fdf4e9308 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:27.141743 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e246d8ab-34c5-4777-a083-109fdf4e9308 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:27.151336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e246d8ab-34c5-4777-a083-109fdf4e9308 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:27.151823 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e246d8ab-34c5-4777-a083-109fdf4e9308 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:27.152263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e246d8ab-34c5-4777-a083-109fdf4e9308 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:27.152955 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e246d8ab-34c5-4777-a083-109fdf4e9308 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:27.153435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e246d8ab-34c5-4777-a083-109fdf4e9308 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:27.153863 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e246d8ab-34c5-4777-a083-109fdf4e9308 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:27.293088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e246d8ab-34c5-4777-a083-109fdf4e9308 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:27.300940 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e246d8ab-34c5-4777-a083-109fdf4e9308 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1679 microversion: 2.1 time: 0.166910 Aug 24 11:08:27.301562 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3229/6818] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:27 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:28.322564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-972fe5b4-101c-441d-b7a1-bcbbfc49a7d4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:28.323172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-972fe5b4-101c-441d-b7a1-bcbbfc49a7d4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:28.330690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-972fe5b4-101c-441d-b7a1-bcbbfc49a7d4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:28.331208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-972fe5b4-101c-441d-b7a1-bcbbfc49a7d4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:28.331660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-972fe5b4-101c-441d-b7a1-bcbbfc49a7d4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:28.332375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-972fe5b4-101c-441d-b7a1-bcbbfc49a7d4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:28.332845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-972fe5b4-101c-441d-b7a1-bcbbfc49a7d4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:28.333327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-972fe5b4-101c-441d-b7a1-bcbbfc49a7d4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:28.495163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-972fe5b4-101c-441d-b7a1-bcbbfc49a7d4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:28.503323 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-972fe5b4-101c-441d-b7a1-bcbbfc49a7d4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1679 microversion: 2.1 time: 0.184891 Aug 24 11:08:28.503926 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3590/6819] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:28 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1679 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:29.529266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4818daa6-319d-431d-8ba2-5105b3069aa2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:29.529897 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4818daa6-319d-431d-8ba2-5105b3069aa2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:29.537113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4818daa6-319d-431d-8ba2-5105b3069aa2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:29.537634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4818daa6-319d-431d-8ba2-5105b3069aa2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:29.538071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4818daa6-319d-431d-8ba2-5105b3069aa2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:29.538792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4818daa6-319d-431d-8ba2-5105b3069aa2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:29.539240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4818daa6-319d-431d-8ba2-5105b3069aa2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:29.539652 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4818daa6-319d-431d-8ba2-5105b3069aa2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:29.694900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4818daa6-319d-431d-8ba2-5105b3069aa2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:29.703467 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4818daa6-319d-431d-8ba2-5105b3069aa2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1679 microversion: 2.1 time: 0.178222 Aug 24 11:08:29.704050 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3230/6820] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:29 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:30.726216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-20ee1df0-3d92-418b-95a3-f8ad0b0295fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:30.727082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-20ee1df0-3d92-418b-95a3-f8ad0b0295fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:30.734930 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20ee1df0-3d92-418b-95a3-f8ad0b0295fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:30.735445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20ee1df0-3d92-418b-95a3-f8ad0b0295fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:30.735868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20ee1df0-3d92-418b-95a3-f8ad0b0295fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:30.736599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20ee1df0-3d92-418b-95a3-f8ad0b0295fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:30.737061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20ee1df0-3d92-418b-95a3-f8ad0b0295fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:30.737527 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20ee1df0-3d92-418b-95a3-f8ad0b0295fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:30.888970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-20ee1df0-3d92-418b-95a3-f8ad0b0295fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:30.897075 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-20ee1df0-3d92-418b-95a3-f8ad0b0295fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1679 microversion: 2.1 time: 0.174852 Aug 24 11:08:30.897707 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3591/6821] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:30 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:31.921072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2ad3af54-6a47-4301-8dc7-037e370e0515 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:31.921773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2ad3af54-6a47-4301-8dc7-037e370e0515 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:31.930434 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ad3af54-6a47-4301-8dc7-037e370e0515 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:31.931007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ad3af54-6a47-4301-8dc7-037e370e0515 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:31.931529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ad3af54-6a47-4301-8dc7-037e370e0515 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:31.932349 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ad3af54-6a47-4301-8dc7-037e370e0515 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:31.932886 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ad3af54-6a47-4301-8dc7-037e370e0515 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:31.933422 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ad3af54-6a47-4301-8dc7-037e370e0515 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:32.076276 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2ad3af54-6a47-4301-8dc7-037e370e0515 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:32.086836 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2ad3af54-6a47-4301-8dc7-037e370e0515 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1679 microversion: 2.1 time: 0.170598 Aug 24 11:08:32.087433 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3231/6822] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:31 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:33.112474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-525ed5dd-b89c-46c5-b903-fcee13d38b4e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:33.113525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-525ed5dd-b89c-46c5-b903-fcee13d38b4e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:33.122297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-525ed5dd-b89c-46c5-b903-fcee13d38b4e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:33.122794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-525ed5dd-b89c-46c5-b903-fcee13d38b4e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:33.123249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-525ed5dd-b89c-46c5-b903-fcee13d38b4e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:33.123961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-525ed5dd-b89c-46c5-b903-fcee13d38b4e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:33.124440 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-525ed5dd-b89c-46c5-b903-fcee13d38b4e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:33.124875 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-525ed5dd-b89c-46c5-b903-fcee13d38b4e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:33.268010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-525ed5dd-b89c-46c5-b903-fcee13d38b4e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:33.277010 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-525ed5dd-b89c-46c5-b903-fcee13d38b4e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1679 microversion: 2.1 time: 0.171052 Aug 24 11:08:33.277692 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3592/6823] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:33 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:34.310232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b09ad291-cc5b-407e-8288-067510fd3ef3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:34.310838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b09ad291-cc5b-407e-8288-067510fd3ef3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:34.318409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b09ad291-cc5b-407e-8288-067510fd3ef3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:34.318933 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b09ad291-cc5b-407e-8288-067510fd3ef3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:34.319553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b09ad291-cc5b-407e-8288-067510fd3ef3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:34.320289 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b09ad291-cc5b-407e-8288-067510fd3ef3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:34.320737 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b09ad291-cc5b-407e-8288-067510fd3ef3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:34.321175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b09ad291-cc5b-407e-8288-067510fd3ef3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:34.464752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b09ad291-cc5b-407e-8288-067510fd3ef3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:34.473856 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b09ad291-cc5b-407e-8288-067510fd3ef3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1679 microversion: 2.1 time: 0.168654 Aug 24 11:08:34.474445 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3232/6824] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:34 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:35.502140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1b8ef934-8d6f-4fa1-8b75-a2c56dadbd17 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:35.502778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1b8ef934-8d6f-4fa1-8b75-a2c56dadbd17 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:35.511605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b8ef934-8d6f-4fa1-8b75-a2c56dadbd17 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:35.512223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b8ef934-8d6f-4fa1-8b75-a2c56dadbd17 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:35.512752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b8ef934-8d6f-4fa1-8b75-a2c56dadbd17 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:35.513639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b8ef934-8d6f-4fa1-8b75-a2c56dadbd17 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:35.514259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b8ef934-8d6f-4fa1-8b75-a2c56dadbd17 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:35.514704 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b8ef934-8d6f-4fa1-8b75-a2c56dadbd17 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:35.658775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1b8ef934-8d6f-4fa1-8b75-a2c56dadbd17 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:35.671245 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1b8ef934-8d6f-4fa1-8b75-a2c56dadbd17 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1679 microversion: 2.1 time: 0.173997 Aug 24 11:08:35.671807 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3593/6825] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:35 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:36.692980 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bd698ef9-a813-4db7-b30a-2cf977b97224 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:36.693658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bd698ef9-a813-4db7-b30a-2cf977b97224 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:36.701711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd698ef9-a813-4db7-b30a-2cf977b97224 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:36.702211 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd698ef9-a813-4db7-b30a-2cf977b97224 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:36.702669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd698ef9-a813-4db7-b30a-2cf977b97224 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:36.703484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd698ef9-a813-4db7-b30a-2cf977b97224 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:36.703956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd698ef9-a813-4db7-b30a-2cf977b97224 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:36.704387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd698ef9-a813-4db7-b30a-2cf977b97224 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:36.842984 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bd698ef9-a813-4db7-b30a-2cf977b97224 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:36.851751 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bd698ef9-a813-4db7-b30a-2cf977b97224 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1679 microversion: 2.1 time: 0.162943 Aug 24 11:08:36.852359 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3233/6826] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:36 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:37.876775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b0d6eea4-90c2-41c7-91be-cd8d713e77ec tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:37.877673 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b0d6eea4-90c2-41c7-91be-cd8d713e77ec tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:37.889411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0d6eea4-90c2-41c7-91be-cd8d713e77ec tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:37.889933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0d6eea4-90c2-41c7-91be-cd8d713e77ec tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:37.890381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0d6eea4-90c2-41c7-91be-cd8d713e77ec tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:37.891084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0d6eea4-90c2-41c7-91be-cd8d713e77ec tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:37.891547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0d6eea4-90c2-41c7-91be-cd8d713e77ec tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:37.891984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0d6eea4-90c2-41c7-91be-cd8d713e77ec tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:38.035577 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b0d6eea4-90c2-41c7-91be-cd8d713e77ec tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:38.048091 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b0d6eea4-90c2-41c7-91be-cd8d713e77ec tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1679 microversion: 2.1 time: 0.177675 Aug 24 11:08:38.048763 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3594/6827] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:37 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:39.073713 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9cbbf8a8-ff0e-4604-87ed-e2f52f47e3a4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:39.074688 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9cbbf8a8-ff0e-4604-87ed-e2f52f47e3a4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:39.086341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9cbbf8a8-ff0e-4604-87ed-e2f52f47e3a4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:39.087147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9cbbf8a8-ff0e-4604-87ed-e2f52f47e3a4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:39.087881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9cbbf8a8-ff0e-4604-87ed-e2f52f47e3a4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:39.089024 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9cbbf8a8-ff0e-4604-87ed-e2f52f47e3a4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:39.089829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9cbbf8a8-ff0e-4604-87ed-e2f52f47e3a4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:39.090542 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9cbbf8a8-ff0e-4604-87ed-e2f52f47e3a4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:39.224337 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9cbbf8a8-ff0e-4604-87ed-e2f52f47e3a4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:39.232955 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9cbbf8a8-ff0e-4604-87ed-e2f52f47e3a4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1679 microversion: 2.1 time: 0.165920 Aug 24 11:08:39.233742 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3234/6828] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:39 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:40.255113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9af53406-af86-4db2-8b4e-c55eaa5617ea tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:40.255724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9af53406-af86-4db2-8b4e-c55eaa5617ea tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:40.263153 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9af53406-af86-4db2-8b4e-c55eaa5617ea tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:40.263652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9af53406-af86-4db2-8b4e-c55eaa5617ea tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:40.264102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9af53406-af86-4db2-8b4e-c55eaa5617ea tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:40.264812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9af53406-af86-4db2-8b4e-c55eaa5617ea tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:40.265319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9af53406-af86-4db2-8b4e-c55eaa5617ea tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:40.265789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9af53406-af86-4db2-8b4e-c55eaa5617ea tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:40.424055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9af53406-af86-4db2-8b4e-c55eaa5617ea tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:40.432344 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9af53406-af86-4db2-8b4e-c55eaa5617ea tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1656 microversion: 2.1 time: 0.181369 Aug 24 11:08:40.432940 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3595/6829] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:40 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1656 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:40.453078 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-793f5856-291a-49f9-ad58-753520efe84d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:08:40.455447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-793f5856-291a-49f9-ad58-753520efe84d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:40.462715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-793f5856-291a-49f9-ad58-753520efe84d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:40.463199 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-793f5856-291a-49f9-ad58-753520efe84d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:40.463629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-793f5856-291a-49f9-ad58-753520efe84d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:40.464317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-793f5856-291a-49f9-ad58-753520efe84d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:40.464764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-793f5856-291a-49f9-ad58-753520efe84d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:40.465211 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-793f5856-291a-49f9-ad58-753520efe84d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:40.496082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-793f5856-291a-49f9-ad58-753520efe84d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:40.502621 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-793f5856-291a-49f9-ad58-753520efe84d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Old instance type m1.heat2, new instance type m1.heat {{(pid=122432) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 11:08:40.509928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-793f5856-291a-49f9-ad58-753520efe84d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:08:40.510126 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-793f5856-291a-49f9-ad58-753520efe84d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:08:40.510601 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-793f5856-291a-49f9-ad58-753520efe84d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:08:40.511006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-793f5856-291a-49f9-ad58-753520efe84d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:08:40.511413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-793f5856-291a-49f9-ad58-753520efe84d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:08:40.577959 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-793f5856-291a-49f9-ad58-753520efe84d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "POST /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f/action" status: 202 len: 0 microversion: 2.1 time: 0.128904 Aug 24 11:08:40.578576 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3235/6830] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:08:40 2022] POST /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:08:40.586962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3fd4216a-8f4a-4b9f-83e1-2c01bed39c89 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:40.587592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3fd4216a-8f4a-4b9f-83e1-2c01bed39c89 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:40.593771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd4216a-8f4a-4b9f-83e1-2c01bed39c89 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:40.594284 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd4216a-8f4a-4b9f-83e1-2c01bed39c89 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:40.594744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd4216a-8f4a-4b9f-83e1-2c01bed39c89 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:40.595454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd4216a-8f4a-4b9f-83e1-2c01bed39c89 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:40.595922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd4216a-8f4a-4b9f-83e1-2c01bed39c89 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:40.596363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fd4216a-8f4a-4b9f-83e1-2c01bed39c89 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:40.782547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3fd4216a-8f4a-4b9f-83e1-2c01bed39c89 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:40.792572 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3fd4216a-8f4a-4b9f-83e1-2c01bed39c89 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1679 microversion: 2.1 time: 0.209354 Aug 24 11:08:40.793262 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3596/6831] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:40 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1679 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:41.816745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4e04f509-4347-42b3-ac96-631e0b25d205 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:41.817432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4e04f509-4347-42b3-ac96-631e0b25d205 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:41.825557 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e04f509-4347-42b3-ac96-631e0b25d205 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:41.826218 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e04f509-4347-42b3-ac96-631e0b25d205 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:41.826868 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e04f509-4347-42b3-ac96-631e0b25d205 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:41.827867 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e04f509-4347-42b3-ac96-631e0b25d205 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:41.828708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e04f509-4347-42b3-ac96-631e0b25d205 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:41.829357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e04f509-4347-42b3-ac96-631e0b25d205 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:42.014974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4e04f509-4347-42b3-ac96-631e0b25d205 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:42.025344 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4e04f509-4347-42b3-ac96-631e0b25d205 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1679 microversion: 2.1 time: 0.213984 Aug 24 11:08:42.025939 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3236/6832] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:41 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1679 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:43.047226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8592da70-8ef4-4cb4-98c2-07724b2698e2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:43.047847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8592da70-8ef4-4cb4-98c2-07724b2698e2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:43.055344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8592da70-8ef4-4cb4-98c2-07724b2698e2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:43.055852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8592da70-8ef4-4cb4-98c2-07724b2698e2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:43.056297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8592da70-8ef4-4cb4-98c2-07724b2698e2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:43.057013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8592da70-8ef4-4cb4-98c2-07724b2698e2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:43.057506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8592da70-8ef4-4cb4-98c2-07724b2698e2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:43.057941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8592da70-8ef4-4cb4-98c2-07724b2698e2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:43.203344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8592da70-8ef4-4cb4-98c2-07724b2698e2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:43.211504 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8592da70-8ef4-4cb4-98c2-07724b2698e2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1684 microversion: 2.1 time: 0.168638 Aug 24 11:08:43.212094 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3597/6833] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:43 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:44.237967 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f14cee3d-e287-483c-9480-ccfd70ce9323 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:44.238684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f14cee3d-e287-483c-9480-ccfd70ce9323 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:44.247695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f14cee3d-e287-483c-9480-ccfd70ce9323 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:44.248189 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f14cee3d-e287-483c-9480-ccfd70ce9323 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:44.248663 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f14cee3d-e287-483c-9480-ccfd70ce9323 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:44.249553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f14cee3d-e287-483c-9480-ccfd70ce9323 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:44.250012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f14cee3d-e287-483c-9480-ccfd70ce9323 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:44.250443 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f14cee3d-e287-483c-9480-ccfd70ce9323 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:44.437349 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f14cee3d-e287-483c-9480-ccfd70ce9323 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:44.449045 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f14cee3d-e287-483c-9480-ccfd70ce9323 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1684 microversion: 2.1 time: 0.216344 Aug 24 11:08:44.450393 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3237/6834] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:44 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1684 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:45.310446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c11fe7ba-76df-4602-948d-966af5c91f7c req-5853f78e-57d7-41c5-9f1f-695eedd3169f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed0602b-69ae-45fb-bce8-571f94493a4f", "name": "network-vif-unplugged", "status": "completed", "tag": "c4c27e09-ac2a-46ad-80c3-4d6ba418820c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:08:45.321713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c11fe7ba-76df-4602-948d-966af5c91f7c req-5853f78e-57d7-41c5-9f1f-695eedd3169f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:45.322349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c11fe7ba-76df-4602-948d-966af5c91f7c req-5853f78e-57d7-41c5-9f1f-695eedd3169f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:45.323120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c11fe7ba-76df-4602-948d-966af5c91f7c req-5853f78e-57d7-41c5-9f1f-695eedd3169f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:45.338201 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c11fe7ba-76df-4602-948d-966af5c91f7c req-5853f78e-57d7-41c5-9f1f-695eedd3169f service nova] Creating event network-vif-unplugged:c4c27e09-ac2a-46ad-80c3-4d6ba418820c for instance eed0602b-69ae-45fb-bce8-571f94493a4f on n-h2-849328-3 Aug 24 11:08:45.344613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-c11fe7ba-76df-4602-948d-966af5c91f7c req-5853f78e-57d7-41c5-9f1f-695eedd3169f service nova] Instance eed0602b-69ae-45fb-bce8-571f94493a4f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 11:08:45.357375 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c11fe7ba-76df-4602-948d-966af5c91f7c req-5853f78e-57d7-41c5-9f1f-695eedd3169f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129539 Aug 24 11:08:45.358589 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3598/6835] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:08:45.472889 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-464f640a-031e-4be3-ae89-5a9a930d7e72 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:45.473789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-464f640a-031e-4be3-ae89-5a9a930d7e72 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:45.481565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-464f640a-031e-4be3-ae89-5a9a930d7e72 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:45.482085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-464f640a-031e-4be3-ae89-5a9a930d7e72 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:45.482724 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-464f640a-031e-4be3-ae89-5a9a930d7e72 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:45.483432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-464f640a-031e-4be3-ae89-5a9a930d7e72 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:45.484028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-464f640a-031e-4be3-ae89-5a9a930d7e72 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:45.484489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-464f640a-031e-4be3-ae89-5a9a930d7e72 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:45.689384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-464f640a-031e-4be3-ae89-5a9a930d7e72 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:45.703131 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-464f640a-031e-4be3-ae89-5a9a930d7e72 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1683 microversion: 2.1 time: 0.235194 Aug 24 11:08:45.704210 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3238/6836] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:45 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1683 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:46.727698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-19558359-c4f6-4924-9d44-b23fc299343a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:46.728423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-19558359-c4f6-4924-9d44-b23fc299343a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:46.736661 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19558359-c4f6-4924-9d44-b23fc299343a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:46.737144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19558359-c4f6-4924-9d44-b23fc299343a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:46.737645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19558359-c4f6-4924-9d44-b23fc299343a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:46.738367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19558359-c4f6-4924-9d44-b23fc299343a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:46.738842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19558359-c4f6-4924-9d44-b23fc299343a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:46.739279 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19558359-c4f6-4924-9d44-b23fc299343a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:46.889433 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-19558359-c4f6-4924-9d44-b23fc299343a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:46.897924 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-19558359-c4f6-4924-9d44-b23fc299343a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1681 microversion: 2.1 time: 0.175319 Aug 24 11:08:46.898521 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3599/6837] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:46 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:47.374761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-ea3f7610-b069-4f9d-846d-81b7e3113446 req-4d0bd44c-164c-461b-a638-4c99ed5d252b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eed0602b-69ae-45fb-bce8-571f94493a4f", "tag": "c4c27e09-ac2a-46ad-80c3-4d6ba418820c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:08:47.385962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ea3f7610-b069-4f9d-846d-81b7e3113446 req-4d0bd44c-164c-461b-a638-4c99ed5d252b service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:47.386451 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ea3f7610-b069-4f9d-846d-81b7e3113446 req-4d0bd44c-164c-461b-a638-4c99ed5d252b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:47.386863 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ea3f7610-b069-4f9d-846d-81b7e3113446 req-4d0bd44c-164c-461b-a638-4c99ed5d252b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:47.400066 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-ea3f7610-b069-4f9d-846d-81b7e3113446 req-4d0bd44c-164c-461b-a638-4c99ed5d252b service nova] Creating event network-changed:c4c27e09-ac2a-46ad-80c3-4d6ba418820c for instance eed0602b-69ae-45fb-bce8-571f94493a4f on n-h2-849328-3 Aug 24 11:08:47.405988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-ea3f7610-b069-4f9d-846d-81b7e3113446 req-4d0bd44c-164c-461b-a638-4c99ed5d252b service nova] Instance eed0602b-69ae-45fb-bce8-571f94493a4f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 11:08:47.417242 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-ea3f7610-b069-4f9d-846d-81b7e3113446 req-4d0bd44c-164c-461b-a638-4c99ed5d252b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046365 Aug 24 11:08:47.418362 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3239/6838] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:08:47.921252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-184154cd-dfc9-457c-932e-c106b70839f4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:47.921895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-184154cd-dfc9-457c-932e-c106b70839f4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:47.929863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-184154cd-dfc9-457c-932e-c106b70839f4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:47.930368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-184154cd-dfc9-457c-932e-c106b70839f4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:47.930832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-184154cd-dfc9-457c-932e-c106b70839f4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:47.931593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-184154cd-dfc9-457c-932e-c106b70839f4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:47.932055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-184154cd-dfc9-457c-932e-c106b70839f4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:47.932491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-184154cd-dfc9-457c-932e-c106b70839f4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:48.070510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-184154cd-dfc9-457c-932e-c106b70839f4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:48.079162 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-184154cd-dfc9-457c-932e-c106b70839f4 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1677 microversion: 2.1 time: 0.162218 Aug 24 11:08:48.079773 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3600/6839] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:47 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:48.101357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c87bba0b-973f-4d5b-9091-f5715b64b8be tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:08:48.101983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c87bba0b-973f-4d5b-9091-f5715b64b8be tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:48.109169 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c87bba0b-973f-4d5b-9091-f5715b64b8be tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:48.109659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c87bba0b-973f-4d5b-9091-f5715b64b8be tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:48.110091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c87bba0b-973f-4d5b-9091-f5715b64b8be tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:48.110810 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c87bba0b-973f-4d5b-9091-f5715b64b8be tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:48.111261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c87bba0b-973f-4d5b-9091-f5715b64b8be tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:48.111682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c87bba0b-973f-4d5b-9091-f5715b64b8be tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:48.175023 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c87bba0b-973f-4d5b-9091-f5715b64b8be tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "POST /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f/action" status: 204 len: 0 microversion: 2.1 time: 0.077904 Aug 24 11:08:48.175844 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3240/6840] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:08:48 2022] POST /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:08:48.184379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0fc4ab62-bbe8-45f5-af91-491292236c69 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:48.185468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0fc4ab62-bbe8-45f5-af91-491292236c69 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:48.192237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fc4ab62-bbe8-45f5-af91-491292236c69 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:48.192767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fc4ab62-bbe8-45f5-af91-491292236c69 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:48.194200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fc4ab62-bbe8-45f5-af91-491292236c69 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:48.195031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fc4ab62-bbe8-45f5-af91-491292236c69 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:48.195509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fc4ab62-bbe8-45f5-af91-491292236c69 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:48.196128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fc4ab62-bbe8-45f5-af91-491292236c69 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:48.342560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0fc4ab62-bbe8-45f5-af91-491292236c69 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:48.351839 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0fc4ab62-bbe8-45f5-af91-491292236c69 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1677 microversion: 2.1 time: 0.171426 Aug 24 11:08:48.352444 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3601/6841] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:48 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:49.374865 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4a052a6f-59da-4a10-81e9-fabd580dc898 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:49.375594 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4a052a6f-59da-4a10-81e9-fabd580dc898 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:49.382507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a052a6f-59da-4a10-81e9-fabd580dc898 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:49.382986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a052a6f-59da-4a10-81e9-fabd580dc898 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:49.383422 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a052a6f-59da-4a10-81e9-fabd580dc898 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:49.384117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a052a6f-59da-4a10-81e9-fabd580dc898 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:49.384563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a052a6f-59da-4a10-81e9-fabd580dc898 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:49.384984 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a052a6f-59da-4a10-81e9-fabd580dc898 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:49.523917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4a052a6f-59da-4a10-81e9-fabd580dc898 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:49.533060 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4a052a6f-59da-4a10-81e9-fabd580dc898 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1677 microversion: 2.1 time: 0.162905 Aug 24 11:08:49.533674 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3241/6842] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:49 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:50.555523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-91f85418-f450-45a3-a057-c2801a3e258d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:50.556155 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-91f85418-f450-45a3-a057-c2801a3e258d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:50.563353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91f85418-f450-45a3-a057-c2801a3e258d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:50.563882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91f85418-f450-45a3-a057-c2801a3e258d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:50.564352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91f85418-f450-45a3-a057-c2801a3e258d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:50.565062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91f85418-f450-45a3-a057-c2801a3e258d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:50.565560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91f85418-f450-45a3-a057-c2801a3e258d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:50.565997 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91f85418-f450-45a3-a057-c2801a3e258d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:50.719111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-91f85418-f450-45a3-a057-c2801a3e258d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:50.728463 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-91f85418-f450-45a3-a057-c2801a3e258d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1656 microversion: 2.1 time: 0.176944 Aug 24 11:08:50.733649 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3602/6843] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:50 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1656 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:50.750557 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6d00c01d-7f5e-429b-83af-d1d05b4a23bd tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:50.751182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6d00c01d-7f5e-429b-83af-d1d05b4a23bd tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:50.758488 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d00c01d-7f5e-429b-83af-d1d05b4a23bd tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:50.758974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d00c01d-7f5e-429b-83af-d1d05b4a23bd tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:50.759411 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d00c01d-7f5e-429b-83af-d1d05b4a23bd tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:50.760112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d00c01d-7f5e-429b-83af-d1d05b4a23bd tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:50.760592 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d00c01d-7f5e-429b-83af-d1d05b4a23bd tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:50.761000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d00c01d-7f5e-429b-83af-d1d05b4a23bd tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:50.777164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:08:50.908762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6d00c01d-7f5e-429b-83af-d1d05b4a23bd tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:50.916791 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6d00c01d-7f5e-429b-83af-d1d05b4a23bd tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1656 microversion: 2.1 time: 0.170852 Aug 24 11:08:50.917376 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3242/6844] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:50 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1656 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:50.937267 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0598cc2c-4dbe-4d5f-a1aa-1dbf9448b373 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:08:50.943378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0598cc2c-4dbe-4d5f-a1aa-1dbf9448b373 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:50.943881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0598cc2c-4dbe-4d5f-a1aa-1dbf9448b373 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:50.944378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0598cc2c-4dbe-4d5f-a1aa-1dbf9448b373 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:50.970452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0598cc2c-4dbe-4d5f-a1aa-1dbf9448b373 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Going to try to start instance {{(pid=122433) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 11:08:50.975393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:08:51.019867 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0598cc2c-4dbe-4d5f-a1aa-1dbf9448b373 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "POST /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f/action" status: 202 len: 0 microversion: 2.1 time: 0.086500 Aug 24 11:08:51.020508 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3603/6845] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:08:50 2022] POST /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:08:51.032226 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b4ba6fc4-a69b-4eca-827b-7fcedbc78468 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:51.033150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b4ba6fc4-a69b-4eca-827b-7fcedbc78468 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:51.039982 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4ba6fc4-a69b-4eca-827b-7fcedbc78468 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:51.040478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4ba6fc4-a69b-4eca-827b-7fcedbc78468 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:51.040914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4ba6fc4-a69b-4eca-827b-7fcedbc78468 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:51.041669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4ba6fc4-a69b-4eca-827b-7fcedbc78468 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:51.042121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4ba6fc4-a69b-4eca-827b-7fcedbc78468 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:51.042542 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4ba6fc4-a69b-4eca-827b-7fcedbc78468 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:51.252803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b4ba6fc4-a69b-4eca-827b-7fcedbc78468 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:51.261322 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b4ba6fc4-a69b-4eca-827b-7fcedbc78468 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1665 microversion: 2.1 time: 0.232975 Aug 24 11:08:51.261945 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3243/6846] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:51 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1665 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:52.286046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e1c78f02-ed47-4f74-b295-be76c2e1ad78 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:52.287134 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e1c78f02-ed47-4f74-b295-be76c2e1ad78 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:52.293781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1c78f02-ed47-4f74-b295-be76c2e1ad78 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:52.294669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1c78f02-ed47-4f74-b295-be76c2e1ad78 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:52.294792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1c78f02-ed47-4f74-b295-be76c2e1ad78 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:52.295437 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1c78f02-ed47-4f74-b295-be76c2e1ad78 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:52.295990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1c78f02-ed47-4f74-b295-be76c2e1ad78 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:52.296429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1c78f02-ed47-4f74-b295-be76c2e1ad78 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:52.437302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e1c78f02-ed47-4f74-b295-be76c2e1ad78 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:52.446277 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e1c78f02-ed47-4f74-b295-be76c2e1ad78 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1669 microversion: 2.1 time: 0.166873 Aug 24 11:08:52.446854 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3604/6847] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:52 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1669 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:08:52.467477 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6b42491f-7ccc-40a3-b9c8-b3aab1ef282f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:52.468204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6b42491f-7ccc-40a3-b9c8-b3aab1ef282f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:52.476144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b42491f-7ccc-40a3-b9c8-b3aab1ef282f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:52.476681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b42491f-7ccc-40a3-b9c8-b3aab1ef282f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:52.477114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b42491f-7ccc-40a3-b9c8-b3aab1ef282f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:52.477842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b42491f-7ccc-40a3-b9c8-b3aab1ef282f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:52.478262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b42491f-7ccc-40a3-b9c8-b3aab1ef282f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:52.478804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b42491f-7ccc-40a3-b9c8-b3aab1ef282f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:52.513566 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6b42491f-7ccc-40a3-b9c8-b3aab1ef282f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:08:52.523263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-50a296b5-d3dd-40f3-85d1-36359e5409c5 req-d0bbbc68-2144-4c0b-aa38-94339d70fc86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed0602b-69ae-45fb-bce8-571f94493a4f", "name": "network-vif-plugged", "status": "completed", "tag": "c4c27e09-ac2a-46ad-80c3-4d6ba418820c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:08:52.533831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-50a296b5-d3dd-40f3-85d1-36359e5409c5 req-d0bbbc68-2144-4c0b-aa38-94339d70fc86 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:52.534437 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-50a296b5-d3dd-40f3-85d1-36359e5409c5 req-d0bbbc68-2144-4c0b-aa38-94339d70fc86 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:52.535151 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-50a296b5-d3dd-40f3-85d1-36359e5409c5 req-d0bbbc68-2144-4c0b-aa38-94339d70fc86 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:52.549429 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-50a296b5-d3dd-40f3-85d1-36359e5409c5 req-d0bbbc68-2144-4c0b-aa38-94339d70fc86 service nova] Creating event network-vif-plugged:c4c27e09-ac2a-46ad-80c3-4d6ba418820c for instance eed0602b-69ae-45fb-bce8-571f94493a4f on n-h2-849328-3 Aug 24 11:08:52.555118 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-50a296b5-d3dd-40f3-85d1-36359e5409c5 req-d0bbbc68-2144-4c0b-aa38-94339d70fc86 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036235 Aug 24 11:08:52.556147 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3605/6848] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:08:52.609765 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6b42491f-7ccc-40a3-b9c8-b3aab1ef282f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "DELETE /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 204 len: 0 microversion: 2.1 time: 0.146280 Aug 24 11:08:52.610472 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3244/6849] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:08:52 2022] DELETE /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 11:08:52.627209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9d0a8153-336a-4e31-ad49-9ee7e0dc3ba7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:52.627928 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9d0a8153-336a-4e31-ad49-9ee7e0dc3ba7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:52.634690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d0a8153-336a-4e31-ad49-9ee7e0dc3ba7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:52.635219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d0a8153-336a-4e31-ad49-9ee7e0dc3ba7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:52.635663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d0a8153-336a-4e31-ad49-9ee7e0dc3ba7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:52.636405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d0a8153-336a-4e31-ad49-9ee7e0dc3ba7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:52.636877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d0a8153-336a-4e31-ad49-9ee7e0dc3ba7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:52.637351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d0a8153-336a-4e31-ad49-9ee7e0dc3ba7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:52.787634 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9d0a8153-336a-4e31-ad49-9ee7e0dc3ba7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:52.796154 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9d0a8153-336a-4e31-ad49-9ee7e0dc3ba7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1675 microversion: 2.1 time: 0.173258 Aug 24 11:08:52.796760 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3606/6850] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:52 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:53.818832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a63c062d-4c98-4882-b746-c9056d0f2db6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:53.819425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a63c062d-4c98-4882-b746-c9056d0f2db6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:53.826627 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a63c062d-4c98-4882-b746-c9056d0f2db6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:53.827096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a63c062d-4c98-4882-b746-c9056d0f2db6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:53.827560 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a63c062d-4c98-4882-b746-c9056d0f2db6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:53.828269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a63c062d-4c98-4882-b746-c9056d0f2db6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:53.828718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a63c062d-4c98-4882-b746-c9056d0f2db6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:53.829166 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a63c062d-4c98-4882-b746-c9056d0f2db6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:53.974648 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a63c062d-4c98-4882-b746-c9056d0f2db6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:53.983275 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a63c062d-4c98-4882-b746-c9056d0f2db6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1675 microversion: 2.1 time: 0.168909 Aug 24 11:08:53.983858 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3245/6851] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:53 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:54.957872 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-395f3ba0-5bed-4fca-a490-b0874094f0a7 req-2208af79-ce5b-4bd6-a0dc-46c384a22beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed0602b-69ae-45fb-bce8-571f94493a4f", "name": "network-vif-deleted", "tag": "c4c27e09-ac2a-46ad-80c3-4d6ba418820c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:08:54.964055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=39 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:08:54.970462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-395f3ba0-5bed-4fca-a490-b0874094f0a7 req-2208af79-ce5b-4bd6-a0dc-46c384a22beb service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:54.970969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-395f3ba0-5bed-4fca-a490-b0874094f0a7 req-2208af79-ce5b-4bd6-a0dc-46c384a22beb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:54.971414 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-395f3ba0-5bed-4fca-a490-b0874094f0a7 req-2208af79-ce5b-4bd6-a0dc-46c384a22beb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:54.984563 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-395f3ba0-5bed-4fca-a490-b0874094f0a7 req-2208af79-ce5b-4bd6-a0dc-46c384a22beb service nova] Creating event network-vif-deleted:c4c27e09-ac2a-46ad-80c3-4d6ba418820c for instance eed0602b-69ae-45fb-bce8-571f94493a4f on n-h2-849328-3 Aug 24 11:08:54.990046 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-395f3ba0-5bed-4fca-a490-b0874094f0a7 req-2208af79-ce5b-4bd6-a0dc-46c384a22beb service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036079 Aug 24 11:08:54.991135 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3607/6852] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:08:55.005545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c843f7bc-f233-4d17-9bb8-7787926f3954 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:55.006356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c843f7bc-f233-4d17-9bb8-7787926f3954 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:55.009085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:08:55.014904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c843f7bc-f233-4d17-9bb8-7787926f3954 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:55.015397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c843f7bc-f233-4d17-9bb8-7787926f3954 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:55.015832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c843f7bc-f233-4d17-9bb8-7787926f3954 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:55.016789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c843f7bc-f233-4d17-9bb8-7787926f3954 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:55.017270 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c843f7bc-f233-4d17-9bb8-7787926f3954 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:55.017846 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c843f7bc-f233-4d17-9bb8-7787926f3954 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:55.094139 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c843f7bc-f233-4d17-9bb8-7787926f3954 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:55.113257 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c843f7bc-f233-4d17-9bb8-7787926f3954 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 200 len: 1323 microversion: 2.1 time: 0.111992 Aug 24 11:08:55.114156 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3246/6853] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:54 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 1323 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:56.136785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b501a6be-da49-49fe-8898-6c616b4db44c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:56.137541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b501a6be-da49-49fe-8898-6c616b4db44c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:56.144752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b501a6be-da49-49fe-8898-6c616b4db44c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:56.145537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b501a6be-da49-49fe-8898-6c616b4db44c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:56.146122 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b501a6be-da49-49fe-8898-6c616b4db44c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:56.146977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b501a6be-da49-49fe-8898-6c616b4db44c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:56.147449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b501a6be-da49-49fe-8898-6c616b4db44c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:56.147887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b501a6be-da49-49fe-8898-6c616b4db44c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:56.164230 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-b501a6be-da49-49fe-8898-6c616b4db44c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] HTTP exception thrown: Instance eed0602b-69ae-45fb-bce8-571f94493a4f could not be found. Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b501a6be-da49-49fe-8898-6c616b4db44c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Request method failure captured: Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f HTTP/1.1 Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgYz1BeplfuXTHJkOfHIc4HHvWpgmtACVIDqhl2KznLucjDfZdsOv1oOnIJj7M5GsHbWVqHtaPFjE7I8aaNF99wTlcW31oPZk8MPZn4ZadZqVCq5-FgBuGU54DnrikOmEdTLzwsqELSN-iClqJCMIFBnVqLgAZU8nGnLFDU8lQ5UBJs Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9a617355a8b94576bf4edcf58a078a8e", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9a617355a8b94576bf4edcf58a078a8e"}]}] Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 4a1864aed01d473ea51ec9de243ddfa4 Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance eed0602b-69ae-45fb-bce8-571f94493a4f could not be found. Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'eed0602b-69ae-45fb-bce8-571f94493a4f'} Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eed0602b-69ae-45fb-bce8-571f94493a4f could not be found. Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eed0602b-69ae-45fb-bce8-571f94493a4f could not be found. Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:08:56.166025 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:08:56.170180 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:08:56.170180 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:08:56.170180 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:08:56.170180 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:08:56.170180 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:08:56.170180 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eed0602b-69ae-45fb-bce8-571f94493a4f could not be found. Aug 24 11:08:56.170180 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:08:56.170180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b501a6be-da49-49fe-8898-6c616b4db44c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Returning 404 to user: Instance eed0602b-69ae-45fb-bce8-571f94493a4f could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:08:56.170180 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b501a6be-da49-49fe-8898-6c616b4db44c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 404 len: 111 microversion: 2.1 time: 0.036236 Aug 24 11:08:56.170180 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3608/6854] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:56 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:08:56.186135 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bcd1ab51-ee46-4743-946a-c014999dba7a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:56.187006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bcd1ab51-ee46-4743-946a-c014999dba7a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:56.194951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcd1ab51-ee46-4743-946a-c014999dba7a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:56.195551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcd1ab51-ee46-4743-946a-c014999dba7a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:56.196057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcd1ab51-ee46-4743-946a-c014999dba7a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:56.196898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcd1ab51-ee46-4743-946a-c014999dba7a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:56.197453 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcd1ab51-ee46-4743-946a-c014999dba7a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:56.197928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcd1ab51-ee46-4743-946a-c014999dba7a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:56.213476 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-bcd1ab51-ee46-4743-946a-c014999dba7a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] HTTP exception thrown: Instance eed0602b-69ae-45fb-bce8-571f94493a4f could not be found. Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bcd1ab51-ee46-4743-946a-c014999dba7a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Request method failure captured: Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f HTTP/1.1 Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgYz1BeplfuXTHJkOfHIc4HHvWpgmtACVIDqhl2KznLucjDfZdsOv1oOnIJj7M5GsHbWVqHtaPFjE7I8aaNF99wTlcW31oPZk8MPZn4ZadZqVCq5-FgBuGU54DnrikOmEdTLzwsqELSN-iClqJCMIFBnVqLgAZU8nGnLFDU8lQ5UBJs Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9a617355a8b94576bf4edcf58a078a8e", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9a617355a8b94576bf4edcf58a078a8e"}]}] Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 4a1864aed01d473ea51ec9de243ddfa4 Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance eed0602b-69ae-45fb-bce8-571f94493a4f could not be found. Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'eed0602b-69ae-45fb-bce8-571f94493a4f'} Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eed0602b-69ae-45fb-bce8-571f94493a4f could not be found. Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eed0602b-69ae-45fb-bce8-571f94493a4f could not be found. Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:08:56.215262 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:08:56.220065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:08:56.220065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:08:56.220065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:08:56.220065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:08:56.220065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:08:56.220065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eed0602b-69ae-45fb-bce8-571f94493a4f could not be found. Aug 24 11:08:56.220065 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:08:56.220065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bcd1ab51-ee46-4743-946a-c014999dba7a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Returning 404 to user: Instance eed0602b-69ae-45fb-bce8-571f94493a4f could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:08:56.220065 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bcd1ab51-ee46-4743-946a-c014999dba7a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 404 len: 111 microversion: 2.1 time: 0.034765 Aug 24 11:08:56.220065 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3247/6855] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:56 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:08:56.273139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fd519c89-741a-4f2d-bdcd-6fe593e74d16 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-789627206", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "b96fded5-b753-414c-9ed5-a66d8cc1cc36"}], "security_groups": [{"name": "tempest-securitygroup--100998936"}], "key_name": "tempest-keypair-1870957699", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:08:56.439352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-fd519c89-741a-4f2d-bdcd-6fe593e74d16 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] validate_networks() for [('b96fded5-b753-414c-9ed5-a66d8cc1cc36', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:08:56.884411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-fd519c89-741a-4f2d-bdcd-6fe593e74d16 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:08:56.884854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-fd519c89-741a-4f2d-bdcd-6fe593e74d16 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:08:56.885374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-fd519c89-741a-4f2d-bdcd-6fe593e74d16 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:08:56.885802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-fd519c89-741a-4f2d-bdcd-6fe593e74d16 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:08:56.886235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-fd519c89-741a-4f2d-bdcd-6fe593e74d16 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:08:56.895896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd519c89-741a-4f2d-bdcd-6fe593e74d16 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:56.896400 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd519c89-741a-4f2d-bdcd-6fe593e74d16 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:56.896856 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd519c89-741a-4f2d-bdcd-6fe593e74d16 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:56.897763 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd519c89-741a-4f2d-bdcd-6fe593e74d16 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:56.898235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd519c89-741a-4f2d-bdcd-6fe593e74d16 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:56.898674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd519c89-741a-4f2d-bdcd-6fe593e74d16 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:56.915914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-fd519c89-741a-4f2d-bdcd-6fe593e74d16 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Getting quotas for project 9a617355a8b94576bf4edcf58a078a8e. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:08:56.921343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-fd519c89-741a-4f2d-bdcd-6fe593e74d16 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Getting quotas for user 4a1864aed01d473ea51ec9de243ddfa4 and project 9a617355a8b94576bf4edcf58a078a8e. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:08:56.934027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fd519c89-741a-4f2d-bdcd-6fe593e74d16 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:08:56.936474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fd519c89-741a-4f2d-bdcd-6fe593e74d16 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:08:56.985758 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fd519c89-741a-4f2d-bdcd-6fe593e74d16 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.716468 Aug 24 11:08:56.986325 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3609/6856] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 11:08:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:08:56.997364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c45a5498-b06b-40e6-a3e0-b3bc9c0305e0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:56.997992 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c45a5498-b06b-40e6-a3e0-b3bc9c0305e0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:57.093898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c45a5498-b06b-40e6-a3e0-b3bc9c0305e0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:57.103851 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c45a5498-b06b-40e6-a3e0-b3bc9c0305e0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1238 microversion: 2.1 time: 0.110375 Aug 24 11:08:57.104846 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3248/6857] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:56 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1238 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:58.126252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4888f44d-299a-4f9f-8c1b-73dd9526af51 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:58.126878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4888f44d-299a-4f9f-8c1b-73dd9526af51 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:58.134558 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4888f44d-299a-4f9f-8c1b-73dd9526af51 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:58.135061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4888f44d-299a-4f9f-8c1b-73dd9526af51 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:58.135486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4888f44d-299a-4f9f-8c1b-73dd9526af51 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:58.136425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4888f44d-299a-4f9f-8c1b-73dd9526af51 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:58.136895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4888f44d-299a-4f9f-8c1b-73dd9526af51 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:58.137361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4888f44d-299a-4f9f-8c1b-73dd9526af51 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:58.203332 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4888f44d-299a-4f9f-8c1b-73dd9526af51 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:58.211405 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4888f44d-299a-4f9f-8c1b-73dd9526af51 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1308 microversion: 2.1 time: 0.089141 Aug 24 11:08:58.212109 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3610/6858] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:58 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1308 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:59.234040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c4892998-fa3d-4a3f-ba2f-508b95196804 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:59.234812 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c4892998-fa3d-4a3f-ba2f-508b95196804 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:59.243801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4892998-fa3d-4a3f-ba2f-508b95196804 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:59.244280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4892998-fa3d-4a3f-ba2f-508b95196804 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:59.245037 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4892998-fa3d-4a3f-ba2f-508b95196804 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:59.245767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4892998-fa3d-4a3f-ba2f-508b95196804 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:59.246424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4892998-fa3d-4a3f-ba2f-508b95196804 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:59.246860 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4892998-fa3d-4a3f-ba2f-508b95196804 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:59.428448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c4892998-fa3d-4a3f-ba2f-508b95196804 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:59.436671 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c4892998-fa3d-4a3f-ba2f-508b95196804 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1363 microversion: 2.1 time: 0.207211 Aug 24 11:08:59.437248 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3249/6859] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:59 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:59.487862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-99395aa9-beaa-4e96-94cf-8f65bd189169 req-dd9c8f19-a41d-4e92-9ff0-823ee2146cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21016f2b-85d1-41ee-965a-e983abadfc51", "tag": "055bcb5b-0d43-4c23-bece-0ab8705bcbb7"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:08:59.500649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-99395aa9-beaa-4e96-94cf-8f65bd189169 req-dd9c8f19-a41d-4e92-9ff0-823ee2146cb3 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:59.501207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-99395aa9-beaa-4e96-94cf-8f65bd189169 req-dd9c8f19-a41d-4e92-9ff0-823ee2146cb3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:59.501973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-99395aa9-beaa-4e96-94cf-8f65bd189169 req-dd9c8f19-a41d-4e92-9ff0-823ee2146cb3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:59.517944 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-99395aa9-beaa-4e96-94cf-8f65bd189169 req-dd9c8f19-a41d-4e92-9ff0-823ee2146cb3 service nova] Creating event network-changed:055bcb5b-0d43-4c23-bece-0ab8705bcbb7 for instance 21016f2b-85d1-41ee-965a-e983abadfc51 on n-h2-849328-3 Aug 24 11:08:59.523867 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-99395aa9-beaa-4e96-94cf-8f65bd189169 req-dd9c8f19-a41d-4e92-9ff0-823ee2146cb3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039978 Aug 24 11:08:59.524777 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3611/6860] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:09:00.459585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-47306d98-f151-44ca-925b-dfeed050bfe6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:00.460207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-47306d98-f151-44ca-925b-dfeed050bfe6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:00.468015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47306d98-f151-44ca-925b-dfeed050bfe6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:00.468476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47306d98-f151-44ca-925b-dfeed050bfe6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:00.468937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47306d98-f151-44ca-925b-dfeed050bfe6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:00.469672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47306d98-f151-44ca-925b-dfeed050bfe6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:00.470129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47306d98-f151-44ca-925b-dfeed050bfe6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:00.470552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47306d98-f151-44ca-925b-dfeed050bfe6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:00.611529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-47306d98-f151-44ca-925b-dfeed050bfe6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:00.621429 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-47306d98-f151-44ca-925b-dfeed050bfe6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1363 microversion: 2.1 time: 0.166403 Aug 24 11:09:00.622030 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3250/6861] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:00 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:01.646985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aac06e84-14c0-4ff9-bdb1-15e7db8db193 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:01.647876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aac06e84-14c0-4ff9-bdb1-15e7db8db193 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:01.656351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aac06e84-14c0-4ff9-bdb1-15e7db8db193 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:01.656842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aac06e84-14c0-4ff9-bdb1-15e7db8db193 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:01.657324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aac06e84-14c0-4ff9-bdb1-15e7db8db193 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:01.658025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aac06e84-14c0-4ff9-bdb1-15e7db8db193 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:01.658484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aac06e84-14c0-4ff9-bdb1-15e7db8db193 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:01.658921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aac06e84-14c0-4ff9-bdb1-15e7db8db193 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:01.905668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aac06e84-14c0-4ff9-bdb1-15e7db8db193 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:01.914310 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aac06e84-14c0-4ff9-bdb1-15e7db8db193 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1363 microversion: 2.1 time: 0.273805 Aug 24 11:09:01.914916 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3612/6862] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:01 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:02.936231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3f7b5fba-1a07-4043-a13c-d8a77d39dfac tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:02.936831 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3f7b5fba-1a07-4043-a13c-d8a77d39dfac tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:02.944591 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f7b5fba-1a07-4043-a13c-d8a77d39dfac tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:02.945082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f7b5fba-1a07-4043-a13c-d8a77d39dfac tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:02.945547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f7b5fba-1a07-4043-a13c-d8a77d39dfac tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:02.946258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f7b5fba-1a07-4043-a13c-d8a77d39dfac tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:02.946712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f7b5fba-1a07-4043-a13c-d8a77d39dfac tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:02.947134 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f7b5fba-1a07-4043-a13c-d8a77d39dfac tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:03.177176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3f7b5fba-1a07-4043-a13c-d8a77d39dfac tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:03.185674 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3f7b5fba-1a07-4043-a13c-d8a77d39dfac tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1363 microversion: 2.1 time: 0.253461 Aug 24 11:09:03.186365 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3251/6863] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:02 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:04.213646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e80c3cd3-626e-40d9-8f6a-156e825eb776 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:04.214693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e80c3cd3-626e-40d9-8f6a-156e825eb776 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:04.226967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e80c3cd3-626e-40d9-8f6a-156e825eb776 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:04.227849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e80c3cd3-626e-40d9-8f6a-156e825eb776 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:04.228604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e80c3cd3-626e-40d9-8f6a-156e825eb776 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:04.230245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e80c3cd3-626e-40d9-8f6a-156e825eb776 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:04.231094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e80c3cd3-626e-40d9-8f6a-156e825eb776 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:04.231836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e80c3cd3-626e-40d9-8f6a-156e825eb776 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:04.373787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e80c3cd3-626e-40d9-8f6a-156e825eb776 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:04.382550 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e80c3cd3-626e-40d9-8f6a-156e825eb776 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1363 microversion: 2.1 time: 0.175734 Aug 24 11:09:04.383111 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3613/6864] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:04 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:04.655133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3ba0fa5d-ca49-4f6b-8627-73b98f04ad9e req-9c78d717-fc72-43f2-8ddd-187f86b2eab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21016f2b-85d1-41ee-965a-e983abadfc51", "name": "network-vif-plugged", "status": "completed", "tag": "055bcb5b-0d43-4c23-bece-0ab8705bcbb7"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:09:04.665574 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3ba0fa5d-ca49-4f6b-8627-73b98f04ad9e req-9c78d717-fc72-43f2-8ddd-187f86b2eab9 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:04.666158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3ba0fa5d-ca49-4f6b-8627-73b98f04ad9e req-9c78d717-fc72-43f2-8ddd-187f86b2eab9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:04.666584 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3ba0fa5d-ca49-4f6b-8627-73b98f04ad9e req-9c78d717-fc72-43f2-8ddd-187f86b2eab9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:04.678269 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3ba0fa5d-ca49-4f6b-8627-73b98f04ad9e req-9c78d717-fc72-43f2-8ddd-187f86b2eab9 service nova] Creating event network-vif-plugged:055bcb5b-0d43-4c23-bece-0ab8705bcbb7 for instance 21016f2b-85d1-41ee-965a-e983abadfc51 on n-h2-849328-3 Aug 24 11:09:04.683317 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3ba0fa5d-ca49-4f6b-8627-73b98f04ad9e req-9c78d717-fc72-43f2-8ddd-187f86b2eab9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101722 Aug 24 11:09:04.684115 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3252/6865] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:09:05.404562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-811d50e3-95b8-48b9-a2c9-55d97b340cae tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:05.405211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-811d50e3-95b8-48b9-a2c9-55d97b340cae tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:05.412933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-811d50e3-95b8-48b9-a2c9-55d97b340cae tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:05.413473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-811d50e3-95b8-48b9-a2c9-55d97b340cae tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:05.413927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-811d50e3-95b8-48b9-a2c9-55d97b340cae tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:05.414651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-811d50e3-95b8-48b9-a2c9-55d97b340cae tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:05.415120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-811d50e3-95b8-48b9-a2c9-55d97b340cae tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:05.415560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-811d50e3-95b8-48b9-a2c9-55d97b340cae tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:05.560011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-811d50e3-95b8-48b9-a2c9-55d97b340cae tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:05.568730 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-811d50e3-95b8-48b9-a2c9-55d97b340cae tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1363 microversion: 2.1 time: 0.168067 Aug 24 11:09:05.569375 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3614/6866] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:05 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:06.591791 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0d2ff441-12ba-4f42-a002-f5716538d4a8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:06.592510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0d2ff441-12ba-4f42-a002-f5716538d4a8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:06.600691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d2ff441-12ba-4f42-a002-f5716538d4a8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:06.601377 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d2ff441-12ba-4f42-a002-f5716538d4a8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:06.602144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d2ff441-12ba-4f42-a002-f5716538d4a8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:06.603376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d2ff441-12ba-4f42-a002-f5716538d4a8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:06.604187 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d2ff441-12ba-4f42-a002-f5716538d4a8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:06.605283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d2ff441-12ba-4f42-a002-f5716538d4a8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:06.746747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0d2ff441-12ba-4f42-a002-f5716538d4a8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:06.755142 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0d2ff441-12ba-4f42-a002-f5716538d4a8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1550 microversion: 2.1 time: 0.168294 Aug 24 11:09:06.755696 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3253/6867] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:06 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1550 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:06.776456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-33461030-326d-4ff4-9f01-58778c527d34 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:06.777018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-33461030-326d-4ff4-9f01-58778c527d34 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:06.784226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33461030-326d-4ff4-9f01-58778c527d34 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:06.784724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33461030-326d-4ff4-9f01-58778c527d34 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:06.785203 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33461030-326d-4ff4-9f01-58778c527d34 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:06.785995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33461030-326d-4ff4-9f01-58778c527d34 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:06.786466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33461030-326d-4ff4-9f01-58778c527d34 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:06.786908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33461030-326d-4ff4-9f01-58778c527d34 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:06.869012 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-33461030-326d-4ff4-9f01-58778c527d34 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096587 Aug 24 11:09:06.869659 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3615/6868] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Aug 24 11:09:06 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:09:07.804806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-73ff546a-3512-45a0-b2fc-efcdda1d3597 req-5103c943-7718-4824-90d7-a7d1a6762076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21016f2b-85d1-41ee-965a-e983abadfc51", "tag": "055bcb5b-0d43-4c23-bece-0ab8705bcbb7"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:09:07.810306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:09:07.817166 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-73ff546a-3512-45a0-b2fc-efcdda1d3597 req-5103c943-7718-4824-90d7-a7d1a6762076 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:07.817758 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-73ff546a-3512-45a0-b2fc-efcdda1d3597 req-5103c943-7718-4824-90d7-a7d1a6762076 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:07.818259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-73ff546a-3512-45a0-b2fc-efcdda1d3597 req-5103c943-7718-4824-90d7-a7d1a6762076 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:07.829854 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-73ff546a-3512-45a0-b2fc-efcdda1d3597 req-5103c943-7718-4824-90d7-a7d1a6762076 service nova] Creating event network-changed:055bcb5b-0d43-4c23-bece-0ab8705bcbb7 for instance 21016f2b-85d1-41ee-965a-e983abadfc51 on n-h2-849328-3 Aug 24 11:09:07.835532 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-73ff546a-3512-45a0-b2fc-efcdda1d3597 req-5103c943-7718-4824-90d7-a7d1a6762076 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034070 Aug 24 11:09:07.836001 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3254/6869] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:09:17.318812 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:09:17.319404 n-d-849328-3 devstack@n-api.service[122433]: Wed Aug 24 11:09:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:09:48.485433 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:09:48.486463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:09:48.490445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:09:48.491630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:09:48.498586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0d45890d-7bf6-4ec7-950f-6942ad0bf152 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:09:48.502195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0d45890d-7bf6-4ec7-950f-6942ad0bf152 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:48.514485 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d45890d-7bf6-4ec7-950f-6942ad0bf152 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:48.515115 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d45890d-7bf6-4ec7-950f-6942ad0bf152 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:48.515626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d45890d-7bf6-4ec7-950f-6942ad0bf152 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:48.516652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d45890d-7bf6-4ec7-950f-6942ad0bf152 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:48.517403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d45890d-7bf6-4ec7-950f-6942ad0bf152 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:48.518041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d45890d-7bf6-4ec7-950f-6942ad0bf152 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:48.548628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0d45890d-7bf6-4ec7-950f-6942ad0bf152 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:48.555125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0d45890d-7bf6-4ec7-950f-6942ad0bf152 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Old instance type m1.heat2, new instance type m1.heat {{(pid=122433) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 11:09:48.562381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0d45890d-7bf6-4ec7-950f-6942ad0bf152 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:09:48.562813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0d45890d-7bf6-4ec7-950f-6942ad0bf152 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:09:48.563293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0d45890d-7bf6-4ec7-950f-6942ad0bf152 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:09:48.563882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0d45890d-7bf6-4ec7-950f-6942ad0bf152 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:09:48.564308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0d45890d-7bf6-4ec7-950f-6942ad0bf152 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:09:48.634743 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0d45890d-7bf6-4ec7-950f-6942ad0bf152 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "POST /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51/action" status: 202 len: 0 microversion: 2.1 time: 0.150431 Aug 24 11:09:48.635384 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3616/6870] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:09:48 2022] POST /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:09:48.642264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=19 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:09:48.643096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:09:48.647985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e475ed8f-baca-4dce-8939-107399150ddf tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:48.648716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e475ed8f-baca-4dce-8939-107399150ddf tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:48.656490 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e475ed8f-baca-4dce-8939-107399150ddf tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:48.657080 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e475ed8f-baca-4dce-8939-107399150ddf tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:48.657669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e475ed8f-baca-4dce-8939-107399150ddf tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:48.658344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e475ed8f-baca-4dce-8939-107399150ddf tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:48.658804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e475ed8f-baca-4dce-8939-107399150ddf tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:48.659635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e475ed8f-baca-4dce-8939-107399150ddf tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:48.808731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e475ed8f-baca-4dce-8939-107399150ddf tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:48.817077 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e475ed8f-baca-4dce-8939-107399150ddf tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1678 microversion: 2.1 time: 0.177080 Aug 24 11:09:48.817728 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3255/6871] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:48 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:49.839500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ad0b8c8c-22b4-43a0-b53f-897c76bf66fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:49.840061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ad0b8c8c-22b4-43a0-b53f-897c76bf66fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:49.847677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad0b8c8c-22b4-43a0-b53f-897c76bf66fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:49.848181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad0b8c8c-22b4-43a0-b53f-897c76bf66fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:49.848637 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad0b8c8c-22b4-43a0-b53f-897c76bf66fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:49.849441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad0b8c8c-22b4-43a0-b53f-897c76bf66fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:49.849920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad0b8c8c-22b4-43a0-b53f-897c76bf66fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:49.850367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad0b8c8c-22b4-43a0-b53f-897c76bf66fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:49.996924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ad0b8c8c-22b4-43a0-b53f-897c76bf66fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:50.005301 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ad0b8c8c-22b4-43a0-b53f-897c76bf66fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1678 microversion: 2.1 time: 0.170549 Aug 24 11:09:50.005868 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3617/6872] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:49 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:51.028000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0031c2cc-7736-49e6-9a7d-078a29645b14 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:51.028632 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0031c2cc-7736-49e6-9a7d-078a29645b14 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:51.035845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0031c2cc-7736-49e6-9a7d-078a29645b14 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:51.036332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0031c2cc-7736-49e6-9a7d-078a29645b14 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:51.036766 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0031c2cc-7736-49e6-9a7d-078a29645b14 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:51.037501 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0031c2cc-7736-49e6-9a7d-078a29645b14 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:51.037952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0031c2cc-7736-49e6-9a7d-078a29645b14 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:51.038373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0031c2cc-7736-49e6-9a7d-078a29645b14 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:51.197852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0031c2cc-7736-49e6-9a7d-078a29645b14 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:51.206213 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0031c2cc-7736-49e6-9a7d-078a29645b14 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1678 microversion: 2.1 time: 0.182385 Aug 24 11:09:51.206810 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3256/6873] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:51 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:52.227182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-63731de4-3a3c-4ff4-b905-518bb9373ffb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:52.228023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-63731de4-3a3c-4ff4-b905-518bb9373ffb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:52.235942 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63731de4-3a3c-4ff4-b905-518bb9373ffb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:52.236466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63731de4-3a3c-4ff4-b905-518bb9373ffb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:52.236923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63731de4-3a3c-4ff4-b905-518bb9373ffb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:52.237679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63731de4-3a3c-4ff4-b905-518bb9373ffb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:52.238120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63731de4-3a3c-4ff4-b905-518bb9373ffb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:52.238565 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63731de4-3a3c-4ff4-b905-518bb9373ffb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:52.376102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-63731de4-3a3c-4ff4-b905-518bb9373ffb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:52.384015 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-63731de4-3a3c-4ff4-b905-518bb9373ffb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1683 microversion: 2.1 time: 0.160933 Aug 24 11:09:52.384604 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3618/6874] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:52 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:53.405993 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e2f02a9d-0f57-4a33-a8a8-9b34930f3e49 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:53.406603 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e2f02a9d-0f57-4a33-a8a8-9b34930f3e49 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:53.413703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2f02a9d-0f57-4a33-a8a8-9b34930f3e49 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:53.414216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2f02a9d-0f57-4a33-a8a8-9b34930f3e49 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:53.414649 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2f02a9d-0f57-4a33-a8a8-9b34930f3e49 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:53.415371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2f02a9d-0f57-4a33-a8a8-9b34930f3e49 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:53.415823 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2f02a9d-0f57-4a33-a8a8-9b34930f3e49 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:53.416254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2f02a9d-0f57-4a33-a8a8-9b34930f3e49 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:53.556262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e2f02a9d-0f57-4a33-a8a8-9b34930f3e49 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:53.564304 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e2f02a9d-0f57-4a33-a8a8-9b34930f3e49 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1683 microversion: 2.1 time: 0.162266 Aug 24 11:09:53.564909 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3257/6875] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:53 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:54.586176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d416045a-6339-4540-ad2f-41f1c051a38b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:54.586923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d416045a-6339-4540-ad2f-41f1c051a38b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:54.595649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d416045a-6339-4540-ad2f-41f1c051a38b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:54.596294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d416045a-6339-4540-ad2f-41f1c051a38b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:54.596834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d416045a-6339-4540-ad2f-41f1c051a38b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:54.597794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d416045a-6339-4540-ad2f-41f1c051a38b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:54.598363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d416045a-6339-4540-ad2f-41f1c051a38b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:54.598889 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d416045a-6339-4540-ad2f-41f1c051a38b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:54.751957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d416045a-6339-4540-ad2f-41f1c051a38b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:54.760301 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d416045a-6339-4540-ad2f-41f1c051a38b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1683 microversion: 2.1 time: 0.179092 Aug 24 11:09:54.760881 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3619/6876] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:54 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1683 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:55.783510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f70339cf-69f2-4ff9-8fc3-5354be9504ee tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:55.784171 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f70339cf-69f2-4ff9-8fc3-5354be9504ee tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:55.793166 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f70339cf-69f2-4ff9-8fc3-5354be9504ee tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:55.793772 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f70339cf-69f2-4ff9-8fc3-5354be9504ee tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:55.794317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f70339cf-69f2-4ff9-8fc3-5354be9504ee tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:55.795180 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f70339cf-69f2-4ff9-8fc3-5354be9504ee tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:55.795743 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f70339cf-69f2-4ff9-8fc3-5354be9504ee tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:55.796264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f70339cf-69f2-4ff9-8fc3-5354be9504ee tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:55.951750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f70339cf-69f2-4ff9-8fc3-5354be9504ee tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:55.960172 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f70339cf-69f2-4ff9-8fc3-5354be9504ee tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1683 microversion: 2.1 time: 0.181700 Aug 24 11:09:55.960768 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3258/6877] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:55 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1683 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:56.983348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ce4413c-dc98-4423-ae55-b5f0885daafd tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:56.984335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0ce4413c-dc98-4423-ae55-b5f0885daafd tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:56.994645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ce4413c-dc98-4423-ae55-b5f0885daafd tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:56.995146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ce4413c-dc98-4423-ae55-b5f0885daafd tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:56.995588 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ce4413c-dc98-4423-ae55-b5f0885daafd tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:56.996290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ce4413c-dc98-4423-ae55-b5f0885daafd tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:56.996754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ce4413c-dc98-4423-ae55-b5f0885daafd tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:56.997278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ce4413c-dc98-4423-ae55-b5f0885daafd tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:57.135723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0ce4413c-dc98-4423-ae55-b5f0885daafd tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:57.144128 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0ce4413c-dc98-4423-ae55-b5f0885daafd tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1683 microversion: 2.1 time: 0.166518 Aug 24 11:09:57.144714 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3620/6878] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:56 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:58.168660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-313b1d93-7933-4743-8347-ce09c4c94088 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:58.169412 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-313b1d93-7933-4743-8347-ce09c4c94088 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:58.177733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-313b1d93-7933-4743-8347-ce09c4c94088 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:58.178302 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-313b1d93-7933-4743-8347-ce09c4c94088 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:58.178811 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-313b1d93-7933-4743-8347-ce09c4c94088 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:58.179659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-313b1d93-7933-4743-8347-ce09c4c94088 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:58.180189 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-313b1d93-7933-4743-8347-ce09c4c94088 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:58.180686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-313b1d93-7933-4743-8347-ce09c4c94088 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:58.327622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-313b1d93-7933-4743-8347-ce09c4c94088 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:58.340428 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-313b1d93-7933-4743-8347-ce09c4c94088 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1683 microversion: 2.1 time: 0.177202 Aug 24 11:09:58.341327 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3259/6879] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:58 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:59.362442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f11c7fe8-98c9-4803-a465-fdc6caa96a93 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:59.363046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f11c7fe8-98c9-4803-a465-fdc6caa96a93 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:59.370794 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f11c7fe8-98c9-4803-a465-fdc6caa96a93 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:59.371301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f11c7fe8-98c9-4803-a465-fdc6caa96a93 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:59.371785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f11c7fe8-98c9-4803-a465-fdc6caa96a93 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:59.372502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f11c7fe8-98c9-4803-a465-fdc6caa96a93 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:59.372975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f11c7fe8-98c9-4803-a465-fdc6caa96a93 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:59.373467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f11c7fe8-98c9-4803-a465-fdc6caa96a93 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:59.519915 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f11c7fe8-98c9-4803-a465-fdc6caa96a93 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:59.529036 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f11c7fe8-98c9-4803-a465-fdc6caa96a93 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1683 microversion: 2.1 time: 0.170592 Aug 24 11:09:59.529700 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3621/6880] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:59 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:00.552195 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2cef788d-c886-4e90-aef9-f8010e59d6c8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:00.552832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2cef788d-c886-4e90-aef9-f8010e59d6c8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:00.562545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cef788d-c886-4e90-aef9-f8010e59d6c8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:00.563266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cef788d-c886-4e90-aef9-f8010e59d6c8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:00.563956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cef788d-c886-4e90-aef9-f8010e59d6c8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:00.564767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cef788d-c886-4e90-aef9-f8010e59d6c8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:00.565309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cef788d-c886-4e90-aef9-f8010e59d6c8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:00.565739 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cef788d-c886-4e90-aef9-f8010e59d6c8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:00.717779 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2cef788d-c886-4e90-aef9-f8010e59d6c8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:00.726066 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2cef788d-c886-4e90-aef9-f8010e59d6c8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1683 microversion: 2.1 time: 0.178396 Aug 24 11:10:00.726642 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3260/6881] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:00 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1683 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:01.756367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dc14dce3-9418-4ea3-96cd-9b74554af181 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:01.756976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dc14dce3-9418-4ea3-96cd-9b74554af181 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:01.765874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc14dce3-9418-4ea3-96cd-9b74554af181 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:01.766306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc14dce3-9418-4ea3-96cd-9b74554af181 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:01.766757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc14dce3-9418-4ea3-96cd-9b74554af181 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:01.767478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc14dce3-9418-4ea3-96cd-9b74554af181 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:01.767965 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc14dce3-9418-4ea3-96cd-9b74554af181 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:01.768415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc14dce3-9418-4ea3-96cd-9b74554af181 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:01.912695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dc14dce3-9418-4ea3-96cd-9b74554af181 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:01.921340 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dc14dce3-9418-4ea3-96cd-9b74554af181 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1683 microversion: 2.1 time: 0.176080 Aug 24 11:10:01.921925 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3622/6882] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:01 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:02.946746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-48a9a707-3c1d-4e2d-bbcb-8cfb73e49313 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:02.947829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-48a9a707-3c1d-4e2d-bbcb-8cfb73e49313 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:02.958343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48a9a707-3c1d-4e2d-bbcb-8cfb73e49313 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:02.958829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48a9a707-3c1d-4e2d-bbcb-8cfb73e49313 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:02.959264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48a9a707-3c1d-4e2d-bbcb-8cfb73e49313 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:02.960251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48a9a707-3c1d-4e2d-bbcb-8cfb73e49313 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:02.960849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48a9a707-3c1d-4e2d-bbcb-8cfb73e49313 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:02.961310 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48a9a707-3c1d-4e2d-bbcb-8cfb73e49313 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:03.105426 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-48a9a707-3c1d-4e2d-bbcb-8cfb73e49313 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:03.115698 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-48a9a707-3c1d-4e2d-bbcb-8cfb73e49313 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1683 microversion: 2.1 time: 0.172917 Aug 24 11:10:03.116292 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3261/6883] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:02 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:04.137412 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e97c3bf7-4789-4244-a144-051fb0a17f16 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:04.138188 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e97c3bf7-4789-4244-a144-051fb0a17f16 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:04.144978 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e97c3bf7-4789-4244-a144-051fb0a17f16 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:04.145697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e97c3bf7-4789-4244-a144-051fb0a17f16 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:04.146302 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e97c3bf7-4789-4244-a144-051fb0a17f16 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:04.147041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e97c3bf7-4789-4244-a144-051fb0a17f16 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:04.147487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e97c3bf7-4789-4244-a144-051fb0a17f16 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:04.147892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e97c3bf7-4789-4244-a144-051fb0a17f16 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:04.151589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-1034cd24-099e-4ae3-b7b6-e3748dde07cf req-dbf2525c-5c44-4210-9194-fab00aefd69b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21016f2b-85d1-41ee-965a-e983abadfc51", "name": "network-vif-unplugged", "status": "completed", "tag": "055bcb5b-0d43-4c23-bece-0ab8705bcbb7"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:04.163854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1034cd24-099e-4ae3-b7b6-e3748dde07cf req-dbf2525c-5c44-4210-9194-fab00aefd69b service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:04.164416 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1034cd24-099e-4ae3-b7b6-e3748dde07cf req-dbf2525c-5c44-4210-9194-fab00aefd69b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:04.165043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1034cd24-099e-4ae3-b7b6-e3748dde07cf req-dbf2525c-5c44-4210-9194-fab00aefd69b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:04.180074 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-1034cd24-099e-4ae3-b7b6-e3748dde07cf req-dbf2525c-5c44-4210-9194-fab00aefd69b service nova] Creating event network-vif-unplugged:055bcb5b-0d43-4c23-bece-0ab8705bcbb7 for instance 21016f2b-85d1-41ee-965a-e983abadfc51 on n-h1-849328-3 Aug 24 11:10:04.186226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-1034cd24-099e-4ae3-b7b6-e3748dde07cf req-dbf2525c-5c44-4210-9194-fab00aefd69b service nova] Instance 21016f2b-85d1-41ee-965a-e983abadfc51 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 11:10:04.198279 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-1034cd24-099e-4ae3-b7b6-e3748dde07cf req-dbf2525c-5c44-4210-9194-fab00aefd69b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107939 Aug 24 11:10:04.199119 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3623/6884] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:10:04.369450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e97c3bf7-4789-4244-a144-051fb0a17f16 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:04.377826 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e97c3bf7-4789-4244-a144-051fb0a17f16 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1682 microversion: 2.1 time: 0.244819 Aug 24 11:10:04.378425 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3262/6885] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:04 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1682 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:05.404345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6989d6c6-ec07-44f7-956d-e61f264e4ad1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:05.405273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6989d6c6-ec07-44f7-956d-e61f264e4ad1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:05.415383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6989d6c6-ec07-44f7-956d-e61f264e4ad1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:05.416073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6989d6c6-ec07-44f7-956d-e61f264e4ad1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:05.416754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6989d6c6-ec07-44f7-956d-e61f264e4ad1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:05.417863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6989d6c6-ec07-44f7-956d-e61f264e4ad1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:05.418526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6989d6c6-ec07-44f7-956d-e61f264e4ad1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:05.419144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6989d6c6-ec07-44f7-956d-e61f264e4ad1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:05.566911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6989d6c6-ec07-44f7-956d-e61f264e4ad1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:05.576389 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6989d6c6-ec07-44f7-956d-e61f264e4ad1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1680 microversion: 2.1 time: 0.177989 Aug 24 11:10:05.577009 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3624/6886] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:05 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:06.245820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-27bbaacc-12c8-4248-98e3-c86de56ffaf8 req-2180559e-4c86-4df4-8afa-1437d9445a80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21016f2b-85d1-41ee-965a-e983abadfc51", "tag": "055bcb5b-0d43-4c23-bece-0ab8705bcbb7"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:06.256548 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-27bbaacc-12c8-4248-98e3-c86de56ffaf8 req-2180559e-4c86-4df4-8afa-1437d9445a80 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:06.257021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-27bbaacc-12c8-4248-98e3-c86de56ffaf8 req-2180559e-4c86-4df4-8afa-1437d9445a80 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:06.257484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-27bbaacc-12c8-4248-98e3-c86de56ffaf8 req-2180559e-4c86-4df4-8afa-1437d9445a80 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:06.269416 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-27bbaacc-12c8-4248-98e3-c86de56ffaf8 req-2180559e-4c86-4df4-8afa-1437d9445a80 service nova] Creating event network-changed:055bcb5b-0d43-4c23-bece-0ab8705bcbb7 for instance 21016f2b-85d1-41ee-965a-e983abadfc51 on n-h1-849328-3 Aug 24 11:10:06.275287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-27bbaacc-12c8-4248-98e3-c86de56ffaf8 req-2180559e-4c86-4df4-8afa-1437d9445a80 service nova] Instance 21016f2b-85d1-41ee-965a-e983abadfc51 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 11:10:06.286068 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-27bbaacc-12c8-4248-98e3-c86de56ffaf8 req-2180559e-4c86-4df4-8afa-1437d9445a80 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045362 Aug 24 11:10:06.286630 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3263/6887] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:10:06.598572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-66b7d19d-6030-486d-846a-91be1d3fcc88 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:06.599214 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-66b7d19d-6030-486d-846a-91be1d3fcc88 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:06.607293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66b7d19d-6030-486d-846a-91be1d3fcc88 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:06.607808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66b7d19d-6030-486d-846a-91be1d3fcc88 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:06.608292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66b7d19d-6030-486d-846a-91be1d3fcc88 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:06.609017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66b7d19d-6030-486d-846a-91be1d3fcc88 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:06.609522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66b7d19d-6030-486d-846a-91be1d3fcc88 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:06.609970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66b7d19d-6030-486d-846a-91be1d3fcc88 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:06.758450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-66b7d19d-6030-486d-846a-91be1d3fcc88 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:06.767747 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-66b7d19d-6030-486d-846a-91be1d3fcc88 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1680 microversion: 2.1 time: 0.173318 Aug 24 11:10:06.768582 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3625/6888] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:06 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:07.792062 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d706d2b6-e529-4222-8e7d-e47e9ec42b1d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:07.792629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d706d2b6-e529-4222-8e7d-e47e9ec42b1d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:07.799634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d706d2b6-e529-4222-8e7d-e47e9ec42b1d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:07.800145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d706d2b6-e529-4222-8e7d-e47e9ec42b1d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:07.800557 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d706d2b6-e529-4222-8e7d-e47e9ec42b1d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:07.801286 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d706d2b6-e529-4222-8e7d-e47e9ec42b1d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:07.801744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d706d2b6-e529-4222-8e7d-e47e9ec42b1d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:07.802168 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d706d2b6-e529-4222-8e7d-e47e9ec42b1d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:07.938185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d706d2b6-e529-4222-8e7d-e47e9ec42b1d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:07.947005 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d706d2b6-e529-4222-8e7d-e47e9ec42b1d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1677 microversion: 2.1 time: 0.160162 Aug 24 11:10:07.947633 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3264/6889] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:07 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:07.967409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-45124933-4bdd-40a2-b14e-67a11191c19e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:07.967918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-45124933-4bdd-40a2-b14e-67a11191c19e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:07.975488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45124933-4bdd-40a2-b14e-67a11191c19e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:07.975987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45124933-4bdd-40a2-b14e-67a11191c19e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:07.976433 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45124933-4bdd-40a2-b14e-67a11191c19e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:07.977156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45124933-4bdd-40a2-b14e-67a11191c19e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:07.977624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45124933-4bdd-40a2-b14e-67a11191c19e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:07.978104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45124933-4bdd-40a2-b14e-67a11191c19e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:08.016162 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45124933-4bdd-40a2-b14e-67a11191c19e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:08.016656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45124933-4bdd-40a2-b14e-67a11191c19e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:08.017096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45124933-4bdd-40a2-b14e-67a11191c19e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:08.017851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45124933-4bdd-40a2-b14e-67a11191c19e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:08.018311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45124933-4bdd-40a2-b14e-67a11191c19e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:08.018741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45124933-4bdd-40a2-b14e-67a11191c19e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:08.039243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-45124933-4bdd-40a2-b14e-67a11191c19e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Getting quotas for project 9a617355a8b94576bf4edcf58a078a8e. Resources: {'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:10:08.044749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-45124933-4bdd-40a2-b14e-67a11191c19e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Getting quotas for user 4a1864aed01d473ea51ec9de243ddfa4 and project 9a617355a8b94576bf4edcf58a078a8e. Resources: {'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:10:08.152338 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-45124933-4bdd-40a2-b14e-67a11191c19e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "POST /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51/action" status: 202 len: 0 microversion: 2.1 time: 0.188664 Aug 24 11:10:08.153327 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3626/6890] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:10:07 2022] POST /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:10:08.165852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-140786ef-b798-4dbe-835a-f09a4e481ce5 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:08.166477 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-140786ef-b798-4dbe-835a-f09a4e481ce5 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:08.172945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-140786ef-b798-4dbe-835a-f09a4e481ce5 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:08.173668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-140786ef-b798-4dbe-835a-f09a4e481ce5 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:08.174073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-140786ef-b798-4dbe-835a-f09a4e481ce5 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:08.174801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-140786ef-b798-4dbe-835a-f09a4e481ce5 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:08.175430 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-140786ef-b798-4dbe-835a-f09a4e481ce5 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:08.175805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-140786ef-b798-4dbe-835a-f09a4e481ce5 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:08.370424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-140786ef-b798-4dbe-835a-f09a4e481ce5 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:08.379148 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-140786ef-b798-4dbe-835a-f09a4e481ce5 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1676 microversion: 2.1 time: 0.220231 Aug 24 11:10:08.379754 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3265/6891] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:08 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1676 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:09.400677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c8dde363-9464-44ab-a4be-a1832714745b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:09.401426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c8dde363-9464-44ab-a4be-a1832714745b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:09.409942 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8dde363-9464-44ab-a4be-a1832714745b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:09.410453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8dde363-9464-44ab-a4be-a1832714745b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:09.411141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8dde363-9464-44ab-a4be-a1832714745b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:09.411933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8dde363-9464-44ab-a4be-a1832714745b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:09.412409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8dde363-9464-44ab-a4be-a1832714745b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:09.412855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8dde363-9464-44ab-a4be-a1832714745b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:09.545353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c8dde363-9464-44ab-a4be-a1832714745b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:09.553403 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c8dde363-9464-44ab-a4be-a1832714745b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1676 microversion: 2.1 time: 0.157258 Aug 24 11:10:09.553999 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3627/6892] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:09 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:10.575121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3c1f3863-8914-4465-aea1-2b4392322860 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:10.575737 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3c1f3863-8914-4465-aea1-2b4392322860 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:10.584517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c1f3863-8914-4465-aea1-2b4392322860 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:10.585297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c1f3863-8914-4465-aea1-2b4392322860 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:10.586017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c1f3863-8914-4465-aea1-2b4392322860 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:10.587288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c1f3863-8914-4465-aea1-2b4392322860 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:10.587746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c1f3863-8914-4465-aea1-2b4392322860 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:10.588171 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c1f3863-8914-4465-aea1-2b4392322860 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:10.734860 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3c1f3863-8914-4465-aea1-2b4392322860 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:10.743152 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3c1f3863-8914-4465-aea1-2b4392322860 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1676 microversion: 2.1 time: 0.172026 Aug 24 11:10:10.743809 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3266/6893] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:10 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:11.205645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-3da714cd-a6bb-4973-ba90-201a17163366 req-7bf2b4e4-fc6b-4fe7-a063-051d7c8aa403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21016f2b-85d1-41ee-965a-e983abadfc51", "name": "network-vif-plugged", "status": "completed", "tag": "055bcb5b-0d43-4c23-bece-0ab8705bcbb7"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:11.215629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3da714cd-a6bb-4973-ba90-201a17163366 req-7bf2b4e4-fc6b-4fe7-a063-051d7c8aa403 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:11.216120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3da714cd-a6bb-4973-ba90-201a17163366 req-7bf2b4e4-fc6b-4fe7-a063-051d7c8aa403 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:11.216558 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3da714cd-a6bb-4973-ba90-201a17163366 req-7bf2b4e4-fc6b-4fe7-a063-051d7c8aa403 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:11.228976 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-3da714cd-a6bb-4973-ba90-201a17163366 req-7bf2b4e4-fc6b-4fe7-a063-051d7c8aa403 service nova] Creating event network-vif-plugged:055bcb5b-0d43-4c23-bece-0ab8705bcbb7 for instance 21016f2b-85d1-41ee-965a-e983abadfc51 on n-h2-849328-3 Aug 24 11:10:11.232475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:11.237475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-3da714cd-a6bb-4973-ba90-201a17163366 req-7bf2b4e4-fc6b-4fe7-a063-051d7c8aa403 service nova] Instance 21016f2b-85d1-41ee-965a-e983abadfc51 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 11:10:11.248744 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-3da714cd-a6bb-4973-ba90-201a17163366 req-7bf2b4e4-fc6b-4fe7-a063-051d7c8aa403 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108561 Aug 24 11:10:11.249594 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3628/6894] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:10:11.745146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-738ed195-e159-4888-82f1-380b4054a3fb req-f60ec3bc-7d8d-4789-b729-5b021f2df565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21016f2b-85d1-41ee-965a-e983abadfc51", "name": "network-vif-unplugged", "status": "completed", "tag": "055bcb5b-0d43-4c23-bece-0ab8705bcbb7"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:11.756344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-738ed195-e159-4888-82f1-380b4054a3fb req-f60ec3bc-7d8d-4789-b729-5b021f2df565 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:11.756830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-738ed195-e159-4888-82f1-380b4054a3fb req-f60ec3bc-7d8d-4789-b729-5b021f2df565 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:11.757300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-738ed195-e159-4888-82f1-380b4054a3fb req-f60ec3bc-7d8d-4789-b729-5b021f2df565 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:11.766474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a35b0ef2-fc04-4b4e-91dc-7ed9e89ae8b7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:11.767228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a35b0ef2-fc04-4b4e-91dc-7ed9e89ae8b7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:11.771044 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-738ed195-e159-4888-82f1-380b4054a3fb req-f60ec3bc-7d8d-4789-b729-5b021f2df565 service nova] Creating event network-vif-unplugged:055bcb5b-0d43-4c23-bece-0ab8705bcbb7 for instance 21016f2b-85d1-41ee-965a-e983abadfc51 on n-h2-849328-3 Aug 24 11:10:11.774004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a35b0ef2-fc04-4b4e-91dc-7ed9e89ae8b7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:11.774488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a35b0ef2-fc04-4b4e-91dc-7ed9e89ae8b7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:11.775064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a35b0ef2-fc04-4b4e-91dc-7ed9e89ae8b7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:11.775748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a35b0ef2-fc04-4b4e-91dc-7ed9e89ae8b7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:11.776415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a35b0ef2-fc04-4b4e-91dc-7ed9e89ae8b7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:11.776846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a35b0ef2-fc04-4b4e-91dc-7ed9e89ae8b7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:11.777440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-738ed195-e159-4888-82f1-380b4054a3fb req-f60ec3bc-7d8d-4789-b729-5b021f2df565 service nova] Instance 21016f2b-85d1-41ee-965a-e983abadfc51 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 11:10:11.791998 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-738ed195-e159-4888-82f1-380b4054a3fb req-f60ec3bc-7d8d-4789-b729-5b021f2df565 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048478 Aug 24 11:10:11.791998 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3267/6895] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:10:11.916437 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a35b0ef2-fc04-4b4e-91dc-7ed9e89ae8b7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:11.925032 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a35b0ef2-fc04-4b4e-91dc-7ed9e89ae8b7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1676 microversion: 2.1 time: 0.164188 Aug 24 11:10:11.925651 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3629/6896] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:11 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:12.949003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cb07587e-715c-44f5-9e6f-b26f98a14b2f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:12.949783 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cb07587e-715c-44f5-9e6f-b26f98a14b2f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:12.956598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb07587e-715c-44f5-9e6f-b26f98a14b2f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:12.957086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb07587e-715c-44f5-9e6f-b26f98a14b2f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:12.957548 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb07587e-715c-44f5-9e6f-b26f98a14b2f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:12.958247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb07587e-715c-44f5-9e6f-b26f98a14b2f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:12.958694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb07587e-715c-44f5-9e6f-b26f98a14b2f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:12.959113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb07587e-715c-44f5-9e6f-b26f98a14b2f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:13.102043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cb07587e-715c-44f5-9e6f-b26f98a14b2f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:13.111175 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cb07587e-715c-44f5-9e6f-b26f98a14b2f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1676 microversion: 2.1 time: 0.168149 Aug 24 11:10:13.111775 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3268/6897] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:12 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:13.826195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-bd413042-8706-4ea1-b3ce-e14f8dbac5f7 req-8d0710c3-92c8-413c-98c5-5c882852b6cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21016f2b-85d1-41ee-965a-e983abadfc51", "tag": "055bcb5b-0d43-4c23-bece-0ab8705bcbb7"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:13.836959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bd413042-8706-4ea1-b3ce-e14f8dbac5f7 req-8d0710c3-92c8-413c-98c5-5c882852b6cb service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:13.837484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bd413042-8706-4ea1-b3ce-e14f8dbac5f7 req-8d0710c3-92c8-413c-98c5-5c882852b6cb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:13.837929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bd413042-8706-4ea1-b3ce-e14f8dbac5f7 req-8d0710c3-92c8-413c-98c5-5c882852b6cb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:13.853876 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-bd413042-8706-4ea1-b3ce-e14f8dbac5f7 req-8d0710c3-92c8-413c-98c5-5c882852b6cb service nova] Creating event network-changed:055bcb5b-0d43-4c23-bece-0ab8705bcbb7 for instance 21016f2b-85d1-41ee-965a-e983abadfc51 on n-h2-849328-3 Aug 24 11:10:13.860581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-bd413042-8706-4ea1-b3ce-e14f8dbac5f7 req-8d0710c3-92c8-413c-98c5-5c882852b6cb service nova] Instance 21016f2b-85d1-41ee-965a-e983abadfc51 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 11:10:13.871609 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-bd413042-8706-4ea1-b3ce-e14f8dbac5f7 req-8d0710c3-92c8-413c-98c5-5c882852b6cb service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049106 Aug 24 11:10:13.872216 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3630/6898] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:10:14.132765 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e583fb9a-922b-4d8d-800b-8df6b64af55f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:14.133683 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e583fb9a-922b-4d8d-800b-8df6b64af55f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:14.142276 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e583fb9a-922b-4d8d-800b-8df6b64af55f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:14.142880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e583fb9a-922b-4d8d-800b-8df6b64af55f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:14.143414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e583fb9a-922b-4d8d-800b-8df6b64af55f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:14.144269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e583fb9a-922b-4d8d-800b-8df6b64af55f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:14.144803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e583fb9a-922b-4d8d-800b-8df6b64af55f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:14.145555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e583fb9a-922b-4d8d-800b-8df6b64af55f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:14.448914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e583fb9a-922b-4d8d-800b-8df6b64af55f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:14.458391 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e583fb9a-922b-4d8d-800b-8df6b64af55f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1676 microversion: 2.1 time: 0.330060 Aug 24 11:10:14.458975 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3269/6899] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:14 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1676 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:15.482618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a2c4b311-c4a6-4e3e-8203-0d9d5136ed17 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:15.483216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a2c4b311-c4a6-4e3e-8203-0d9d5136ed17 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:15.492913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2c4b311-c4a6-4e3e-8203-0d9d5136ed17 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:15.493489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2c4b311-c4a6-4e3e-8203-0d9d5136ed17 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:15.493943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2c4b311-c4a6-4e3e-8203-0d9d5136ed17 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:15.494659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2c4b311-c4a6-4e3e-8203-0d9d5136ed17 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:15.495129 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2c4b311-c4a6-4e3e-8203-0d9d5136ed17 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:15.495567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2c4b311-c4a6-4e3e-8203-0d9d5136ed17 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:15.633105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a2c4b311-c4a6-4e3e-8203-0d9d5136ed17 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:15.641441 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a2c4b311-c4a6-4e3e-8203-0d9d5136ed17 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1669 microversion: 2.1 time: 0.164591 Aug 24 11:10:15.642037 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3631/6900] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:15 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1669 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:15.661511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-74c587fc-d373-454d-8bc9-40a8cb496084 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:15.662131 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-74c587fc-d373-454d-8bc9-40a8cb496084 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:15.669325 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74c587fc-d373-454d-8bc9-40a8cb496084 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:15.669812 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74c587fc-d373-454d-8bc9-40a8cb496084 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:15.670251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74c587fc-d373-454d-8bc9-40a8cb496084 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:15.670949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74c587fc-d373-454d-8bc9-40a8cb496084 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:15.671401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74c587fc-d373-454d-8bc9-40a8cb496084 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:15.671826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74c587fc-d373-454d-8bc9-40a8cb496084 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:15.807569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-74c587fc-d373-454d-8bc9-40a8cb496084 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:15.815971 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-74c587fc-d373-454d-8bc9-40a8cb496084 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1669 microversion: 2.1 time: 0.158394 Aug 24 11:10:15.816565 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3270/6901] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:15 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1669 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:15.837067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5d8a2398-0c62-4999-8053-514e1f0b9c0e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:15.837761 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5d8a2398-0c62-4999-8053-514e1f0b9c0e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:15.844226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d8a2398-0c62-4999-8053-514e1f0b9c0e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:15.844730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d8a2398-0c62-4999-8053-514e1f0b9c0e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:15.845221 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d8a2398-0c62-4999-8053-514e1f0b9c0e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:15.845932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d8a2398-0c62-4999-8053-514e1f0b9c0e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:15.846447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d8a2398-0c62-4999-8053-514e1f0b9c0e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:15.846975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d8a2398-0c62-4999-8053-514e1f0b9c0e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:15.982170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5d8a2398-0c62-4999-8053-514e1f0b9c0e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:15.990258 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5d8a2398-0c62-4999-8053-514e1f0b9c0e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1669 microversion: 2.1 time: 0.157255 Aug 24 11:10:15.990884 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3632/6902] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:15 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:16.011536 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a42a9701-065e-4045-8d66-0dec6d591a77 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:16.012000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a42a9701-065e-4045-8d66-0dec6d591a77 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:16.021492 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a42a9701-065e-4045-8d66-0dec6d591a77 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:16.021992 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a42a9701-065e-4045-8d66-0dec6d591a77 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:16.022447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a42a9701-065e-4045-8d66-0dec6d591a77 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:16.023124 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a42a9701-065e-4045-8d66-0dec6d591a77 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:16.023573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a42a9701-065e-4045-8d66-0dec6d591a77 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:16.023992 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a42a9701-065e-4045-8d66-0dec6d591a77 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:16.049966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a42a9701-065e-4045-8d66-0dec6d591a77 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:10:16.064339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:16.131197 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a42a9701-065e-4045-8d66-0dec6d591a77 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "DELETE /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 204 len: 0 microversion: 2.1 time: 0.123626 Aug 24 11:10:16.131786 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3271/6903] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:10:16 2022] DELETE /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:10:16.140605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b8b69c2a-39ec-4e64-88aa-e5f6195d7e95 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:16.141277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b8b69c2a-39ec-4e64-88aa-e5f6195d7e95 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:16.148838 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8b69c2a-39ec-4e64-88aa-e5f6195d7e95 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:16.149372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8b69c2a-39ec-4e64-88aa-e5f6195d7e95 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:16.149823 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8b69c2a-39ec-4e64-88aa-e5f6195d7e95 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:16.150547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8b69c2a-39ec-4e64-88aa-e5f6195d7e95 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:16.151018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8b69c2a-39ec-4e64-88aa-e5f6195d7e95 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:16.151664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8b69c2a-39ec-4e64-88aa-e5f6195d7e95 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:16.294866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b8b69c2a-39ec-4e64-88aa-e5f6195d7e95 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:16.303488 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b8b69c2a-39ec-4e64-88aa-e5f6195d7e95 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1675 microversion: 2.1 time: 0.166892 Aug 24 11:10:16.304127 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3633/6904] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:16 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:17.325500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-43a2f272-5f60-4bae-ac1d-a0a90d78e647 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:17.326484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-43a2f272-5f60-4bae-ac1d-a0a90d78e647 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:17.338425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43a2f272-5f60-4bae-ac1d-a0a90d78e647 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:17.338425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43a2f272-5f60-4bae-ac1d-a0a90d78e647 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:17.338775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43a2f272-5f60-4bae-ac1d-a0a90d78e647 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:17.339528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43a2f272-5f60-4bae-ac1d-a0a90d78e647 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:17.339846 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43a2f272-5f60-4bae-ac1d-a0a90d78e647 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:17.340349 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43a2f272-5f60-4bae-ac1d-a0a90d78e647 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:17.514500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-43a2f272-5f60-4bae-ac1d-a0a90d78e647 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:17.523006 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-43a2f272-5f60-4bae-ac1d-a0a90d78e647 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1675 microversion: 2.1 time: 0.201849 Aug 24 11:10:17.523712 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3272/6905] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:17 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1675 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:18.380651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:18.385817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-ff20bf46-2546-4816-ae46-fcb2ee259354 req-118592da-0d0d-4f99-9dca-52eb543ad4e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21016f2b-85d1-41ee-965a-e983abadfc51", "name": "network-vif-deleted", "tag": "055bcb5b-0d43-4c23-bece-0ab8705bcbb7"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:18.397791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ff20bf46-2546-4816-ae46-fcb2ee259354 req-118592da-0d0d-4f99-9dca-52eb543ad4e8 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:18.398287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ff20bf46-2546-4816-ae46-fcb2ee259354 req-118592da-0d0d-4f99-9dca-52eb543ad4e8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:18.398727 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ff20bf46-2546-4816-ae46-fcb2ee259354 req-118592da-0d0d-4f99-9dca-52eb543ad4e8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:18.412078 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-ff20bf46-2546-4816-ae46-fcb2ee259354 req-118592da-0d0d-4f99-9dca-52eb543ad4e8 service nova] Creating event network-vif-deleted:055bcb5b-0d43-4c23-bece-0ab8705bcbb7 for instance 21016f2b-85d1-41ee-965a-e983abadfc51 on n-h2-849328-3 Aug 24 11:10:18.417464 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-ff20bf46-2546-4816-ae46-fcb2ee259354 req-118592da-0d0d-4f99-9dca-52eb543ad4e8 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038056 Aug 24 11:10:18.418200 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3634/6906] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:10:18.544315 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-54071a69-e46e-41fb-80ea-5ef3b373f1bc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:18.545580 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-54071a69-e46e-41fb-80ea-5ef3b373f1bc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:18.553444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54071a69-e46e-41fb-80ea-5ef3b373f1bc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:18.553944 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54071a69-e46e-41fb-80ea-5ef3b373f1bc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:18.554399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54071a69-e46e-41fb-80ea-5ef3b373f1bc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:18.555213 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54071a69-e46e-41fb-80ea-5ef3b373f1bc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:18.556019 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54071a69-e46e-41fb-80ea-5ef3b373f1bc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:18.556427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54071a69-e46e-41fb-80ea-5ef3b373f1bc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:18.601898 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54071a69-e46e-41fb-80ea-5ef3b373f1bc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:18.602364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54071a69-e46e-41fb-80ea-5ef3b373f1bc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:18.602761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54071a69-e46e-41fb-80ea-5ef3b373f1bc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:18.604487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-54071a69-e46e-41fb-80ea-5ef3b373f1bc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lazy-loading 'fault' on Instance uuid 21016f2b-85d1-41ee-965a-e983abadfc51 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:10:18.651998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-54071a69-e46e-41fb-80ea-5ef3b373f1bc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:18.660238 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-54071a69-e46e-41fb-80ea-5ef3b373f1bc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 200 len: 1328 microversion: 2.1 time: 0.119990 Aug 24 11:10:18.673146 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3273/6907] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:18 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 1328 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:19.687345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ff07c685-78ce-432c-936b-270740943919 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:19.688067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ff07c685-78ce-432c-936b-270740943919 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:19.690075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:19.695894 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff07c685-78ce-432c-936b-270740943919 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:19.696389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff07c685-78ce-432c-936b-270740943919 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:19.696838 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff07c685-78ce-432c-936b-270740943919 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:19.697576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff07c685-78ce-432c-936b-270740943919 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:19.698041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff07c685-78ce-432c-936b-270740943919 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:19.698551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff07c685-78ce-432c-936b-270740943919 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:19.713241 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-ff07c685-78ce-432c-936b-270740943919 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] HTTP exception thrown: Instance 21016f2b-85d1-41ee-965a-e983abadfc51 could not be found. Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ff07c685-78ce-432c-936b-270740943919 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Request method failure captured: Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 HTTP/1.1 Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgYz1BeplfuXTHJkOfHIc4HHvWpgmtACVIDqhl2KznLucjDfZdsOv1oOnIJj7M5GsHbWVqHtaPFjE7I8aaNF99wTlcW31oPZk8MPZn4ZadZqVCq5-FgBuGU54DnrikOmEdTLzwsqELSN-iClqJCMIFBnVqLgAZU8nGnLFDU8lQ5UBJs Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9a617355a8b94576bf4edcf58a078a8e", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9a617355a8b94576bf4edcf58a078a8e"}]}] Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 4a1864aed01d473ea51ec9de243ddfa4 Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 21016f2b-85d1-41ee-965a-e983abadfc51 could not be found. Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '21016f2b-85d1-41ee-965a-e983abadfc51'} Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21016f2b-85d1-41ee-965a-e983abadfc51 could not be found. Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21016f2b-85d1-41ee-965a-e983abadfc51 could not be found. Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:10:19.714936 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:10:19.719684 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:10:19.719684 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:10:19.719684 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:10:19.719684 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:10:19.719684 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:10:19.719684 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21016f2b-85d1-41ee-965a-e983abadfc51 could not be found. Aug 24 11:10:19.719684 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:10:19.719684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ff07c685-78ce-432c-936b-270740943919 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Returning 404 to user: Instance 21016f2b-85d1-41ee-965a-e983abadfc51 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:10:19.719684 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ff07c685-78ce-432c-936b-270740943919 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 404 len: 111 microversion: 2.1 time: 0.034379 Aug 24 11:10:19.719684 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3635/6908] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:19 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:10:19.733856 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4627e575-aeec-4177-b02a-7e11b3539559 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:19.734481 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4627e575-aeec-4177-b02a-7e11b3539559 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:19.737114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:19.742519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4627e575-aeec-4177-b02a-7e11b3539559 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:19.742999 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4627e575-aeec-4177-b02a-7e11b3539559 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:19.743478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4627e575-aeec-4177-b02a-7e11b3539559 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:19.744170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4627e575-aeec-4177-b02a-7e11b3539559 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:19.744623 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4627e575-aeec-4177-b02a-7e11b3539559 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:19.745041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4627e575-aeec-4177-b02a-7e11b3539559 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:19.759446 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-4627e575-aeec-4177-b02a-7e11b3539559 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] HTTP exception thrown: Instance 21016f2b-85d1-41ee-965a-e983abadfc51 could not be found. Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4627e575-aeec-4177-b02a-7e11b3539559 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Request method failure captured: Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 HTTP/1.1 Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgYz1BeplfuXTHJkOfHIc4HHvWpgmtACVIDqhl2KznLucjDfZdsOv1oOnIJj7M5GsHbWVqHtaPFjE7I8aaNF99wTlcW31oPZk8MPZn4ZadZqVCq5-FgBuGU54DnrikOmEdTLzwsqELSN-iClqJCMIFBnVqLgAZU8nGnLFDU8lQ5UBJs Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9a617355a8b94576bf4edcf58a078a8e", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9a617355a8b94576bf4edcf58a078a8e"}]}] Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 4a1864aed01d473ea51ec9de243ddfa4 Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 21016f2b-85d1-41ee-965a-e983abadfc51 could not be found. Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '21016f2b-85d1-41ee-965a-e983abadfc51'} Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21016f2b-85d1-41ee-965a-e983abadfc51 could not be found. Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21016f2b-85d1-41ee-965a-e983abadfc51 could not be found. Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:10:19.761235 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:10:19.765460 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:10:19.765460 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:10:19.765460 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:10:19.765460 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:10:19.765460 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:10:19.765460 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21016f2b-85d1-41ee-965a-e983abadfc51 could not be found. Aug 24 11:10:19.765460 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:10:19.765460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4627e575-aeec-4177-b02a-7e11b3539559 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Returning 404 to user: Instance 21016f2b-85d1-41ee-965a-e983abadfc51 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:10:19.765460 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4627e575-aeec-4177-b02a-7e11b3539559 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 404 len: 111 microversion: 2.1 time: 0.033106 Aug 24 11:10:19.766240 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3274/6909] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:19 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:10:19.812266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-57ec0c9f-c294-4cff-ac59-f7181caf8c39 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1257219280", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "b96fded5-b753-414c-9ed5-a66d8cc1cc36"}], "security_groups": [{"name": "tempest-securitygroup--100998936"}], "key_name": "tempest-keypair-1870957699", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:19.927937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-57ec0c9f-c294-4cff-ac59-f7181caf8c39 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] validate_networks() for [('b96fded5-b753-414c-9ed5-a66d8cc1cc36', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:10:20.615913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-57ec0c9f-c294-4cff-ac59-f7181caf8c39 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:10:20.616587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-57ec0c9f-c294-4cff-ac59-f7181caf8c39 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:10:20.617446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-57ec0c9f-c294-4cff-ac59-f7181caf8c39 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:10:20.618074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-57ec0c9f-c294-4cff-ac59-f7181caf8c39 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:10:20.618645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-57ec0c9f-c294-4cff-ac59-f7181caf8c39 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:10:20.635116 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57ec0c9f-c294-4cff-ac59-f7181caf8c39 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:20.635612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57ec0c9f-c294-4cff-ac59-f7181caf8c39 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:20.636093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57ec0c9f-c294-4cff-ac59-f7181caf8c39 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:20.636840 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57ec0c9f-c294-4cff-ac59-f7181caf8c39 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:20.637343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57ec0c9f-c294-4cff-ac59-f7181caf8c39 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:20.637779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57ec0c9f-c294-4cff-ac59-f7181caf8c39 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:20.658139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-57ec0c9f-c294-4cff-ac59-f7181caf8c39 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Getting quotas for project 9a617355a8b94576bf4edcf58a078a8e. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:10:20.663653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-57ec0c9f-c294-4cff-ac59-f7181caf8c39 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Getting quotas for user 4a1864aed01d473ea51ec9de243ddfa4 and project 9a617355a8b94576bf4edcf58a078a8e. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:10:20.676806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-57ec0c9f-c294-4cff-ac59-f7181caf8c39 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:10:20.679134 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-57ec0c9f-c294-4cff-ac59-f7181caf8c39 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:10:20.738898 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-57ec0c9f-c294-4cff-ac59-f7181caf8c39 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.930573 Aug 24 11:10:20.739555 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3636/6910] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 11:10:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:10:20.751864 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6762fd68-44db-4fde-82ff-250f06d7dc27 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:20.752479 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6762fd68-44db-4fde-82ff-250f06d7dc27 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:20.810888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6762fd68-44db-4fde-82ff-250f06d7dc27 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:20.821585 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6762fd68-44db-4fde-82ff-250f06d7dc27 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1239 microversion: 2.1 time: 0.074059 Aug 24 11:10:20.822298 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3275/6911] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:20 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1239 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:21.844000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4468e574-de2f-4a53-bb25-9b1ed1bb5095 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:21.844552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4468e574-de2f-4a53-bb25-9b1ed1bb5095 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:21.853377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4468e574-de2f-4a53-bb25-9b1ed1bb5095 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:21.853900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4468e574-de2f-4a53-bb25-9b1ed1bb5095 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:21.854360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4468e574-de2f-4a53-bb25-9b1ed1bb5095 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:21.855206 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4468e574-de2f-4a53-bb25-9b1ed1bb5095 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:21.855764 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4468e574-de2f-4a53-bb25-9b1ed1bb5095 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:21.856638 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4468e574-de2f-4a53-bb25-9b1ed1bb5095 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:21.924172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4468e574-de2f-4a53-bb25-9b1ed1bb5095 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:21.933153 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4468e574-de2f-4a53-bb25-9b1ed1bb5095 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1309 microversion: 2.1 time: 0.094461 Aug 24 11:10:21.933947 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3637/6912] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:21 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:22.954689 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2faa9455-2420-4750-b245-3c163e0b39a6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:22.955249 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2faa9455-2420-4750-b245-3c163e0b39a6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:22.962804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2faa9455-2420-4750-b245-3c163e0b39a6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:22.963290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2faa9455-2420-4750-b245-3c163e0b39a6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:22.963724 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2faa9455-2420-4750-b245-3c163e0b39a6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:22.964842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2faa9455-2420-4750-b245-3c163e0b39a6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:22.965357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2faa9455-2420-4750-b245-3c163e0b39a6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:22.965776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2faa9455-2420-4750-b245-3c163e0b39a6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:23.240861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2faa9455-2420-4750-b245-3c163e0b39a6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:23.249731 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2faa9455-2420-4750-b245-3c163e0b39a6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1364 microversion: 2.1 time: 0.299159 Aug 24 11:10:23.250865 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3276/6913] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:22 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1364 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:23.600685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-9fdb4dd0-7042-4196-9ff6-85e7f6db5477 req-87946921-c64f-4571-ae4e-03a91a1eab8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfa6c7be-5543-480f-8f41-3452635d6fe2", "tag": "53255380-02e7-4af7-a6e9-b224c7e4892b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:23.614324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9fdb4dd0-7042-4196-9ff6-85e7f6db5477 req-87946921-c64f-4571-ae4e-03a91a1eab8e service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:23.615207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9fdb4dd0-7042-4196-9ff6-85e7f6db5477 req-87946921-c64f-4571-ae4e-03a91a1eab8e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:23.615726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9fdb4dd0-7042-4196-9ff6-85e7f6db5477 req-87946921-c64f-4571-ae4e-03a91a1eab8e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:23.628242 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-9fdb4dd0-7042-4196-9ff6-85e7f6db5477 req-87946921-c64f-4571-ae4e-03a91a1eab8e service nova] Creating event network-changed:53255380-02e7-4af7-a6e9-b224c7e4892b for instance bfa6c7be-5543-480f-8f41-3452635d6fe2 on n-h1-849328-3 Aug 24 11:10:23.634779 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-9fdb4dd0-7042-4196-9ff6-85e7f6db5477 req-87946921-c64f-4571-ae4e-03a91a1eab8e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038307 Aug 24 11:10:23.635919 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3638/6914] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:10:24.275693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a6bca417-7c9f-4bec-b60c-4aaf8663a14c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:24.276295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a6bca417-7c9f-4bec-b60c-4aaf8663a14c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:24.283746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6bca417-7c9f-4bec-b60c-4aaf8663a14c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:24.284236 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6bca417-7c9f-4bec-b60c-4aaf8663a14c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:24.284666 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6bca417-7c9f-4bec-b60c-4aaf8663a14c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:24.285401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6bca417-7c9f-4bec-b60c-4aaf8663a14c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:24.285879 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6bca417-7c9f-4bec-b60c-4aaf8663a14c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:24.286301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6bca417-7c9f-4bec-b60c-4aaf8663a14c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:24.430154 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a6bca417-7c9f-4bec-b60c-4aaf8663a14c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:24.438860 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a6bca417-7c9f-4bec-b60c-4aaf8663a14c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1364 microversion: 2.1 time: 0.169423 Aug 24 11:10:24.439452 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3277/6915] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:24 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:25.471512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7489e5b1-0e73-4df9-908e-6dadf28ae813 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:25.472566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7489e5b1-0e73-4df9-908e-6dadf28ae813 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:25.482392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7489e5b1-0e73-4df9-908e-6dadf28ae813 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:25.482894 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7489e5b1-0e73-4df9-908e-6dadf28ae813 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:25.483344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7489e5b1-0e73-4df9-908e-6dadf28ae813 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:25.484057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7489e5b1-0e73-4df9-908e-6dadf28ae813 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:25.484529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7489e5b1-0e73-4df9-908e-6dadf28ae813 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:25.484970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7489e5b1-0e73-4df9-908e-6dadf28ae813 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:25.626517 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7489e5b1-0e73-4df9-908e-6dadf28ae813 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:25.637147 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7489e5b1-0e73-4df9-908e-6dadf28ae813 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1364 microversion: 2.1 time: 0.172672 Aug 24 11:10:25.637754 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3639/6916] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:25 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:26.662774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b156c932-198b-4588-ac90-420205f2a829 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:26.663736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b156c932-198b-4588-ac90-420205f2a829 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:26.675600 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b156c932-198b-4588-ac90-420205f2a829 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:26.676384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b156c932-198b-4588-ac90-420205f2a829 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:26.677434 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b156c932-198b-4588-ac90-420205f2a829 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:26.678318 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b156c932-198b-4588-ac90-420205f2a829 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:26.679079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b156c932-198b-4588-ac90-420205f2a829 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:26.679791 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b156c932-198b-4588-ac90-420205f2a829 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:26.829982 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b156c932-198b-4588-ac90-420205f2a829 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:26.838008 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b156c932-198b-4588-ac90-420205f2a829 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1364 microversion: 2.1 time: 0.181916 Aug 24 11:10:26.838695 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3278/6917] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:26 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:27.869038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e43a8f00-e241-431e-9a5a-b651a516f5f6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:27.869818 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e43a8f00-e241-431e-9a5a-b651a516f5f6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:27.880809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e43a8f00-e241-431e-9a5a-b651a516f5f6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:27.881504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e43a8f00-e241-431e-9a5a-b651a516f5f6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:27.882244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e43a8f00-e241-431e-9a5a-b651a516f5f6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:27.883401 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e43a8f00-e241-431e-9a5a-b651a516f5f6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:27.884190 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e43a8f00-e241-431e-9a5a-b651a516f5f6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:27.884964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e43a8f00-e241-431e-9a5a-b651a516f5f6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:28.060535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e43a8f00-e241-431e-9a5a-b651a516f5f6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:28.069078 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e43a8f00-e241-431e-9a5a-b651a516f5f6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1364 microversion: 2.1 time: 0.205780 Aug 24 11:10:28.069784 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3640/6918] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:27 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1364 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:29.014512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-499048de-380e-4f25-a7aa-7f1201dd4b3a req-0dfb2d58-585e-4515-9fe2-9d15ec44eac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfa6c7be-5543-480f-8f41-3452635d6fe2", "name": "network-vif-plugged", "status": "completed", "tag": "53255380-02e7-4af7-a6e9-b224c7e4892b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:29.027465 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-499048de-380e-4f25-a7aa-7f1201dd4b3a req-0dfb2d58-585e-4515-9fe2-9d15ec44eac2 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:29.027952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-499048de-380e-4f25-a7aa-7f1201dd4b3a req-0dfb2d58-585e-4515-9fe2-9d15ec44eac2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:29.028395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-499048de-380e-4f25-a7aa-7f1201dd4b3a req-0dfb2d58-585e-4515-9fe2-9d15ec44eac2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:29.043257 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-499048de-380e-4f25-a7aa-7f1201dd4b3a req-0dfb2d58-585e-4515-9fe2-9d15ec44eac2 service nova] Creating event network-vif-plugged:53255380-02e7-4af7-a6e9-b224c7e4892b for instance bfa6c7be-5543-480f-8f41-3452635d6fe2 on n-h1-849328-3 Aug 24 11:10:29.048446 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-499048de-380e-4f25-a7aa-7f1201dd4b3a req-0dfb2d58-585e-4515-9fe2-9d15ec44eac2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037690 Aug 24 11:10:29.049104 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3279/6919] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:10:29.091364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ae68c875-36bd-42fa-8d73-79f940a0cbb7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:29.091997 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ae68c875-36bd-42fa-8d73-79f940a0cbb7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:29.100201 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae68c875-36bd-42fa-8d73-79f940a0cbb7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:29.100636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae68c875-36bd-42fa-8d73-79f940a0cbb7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:29.101094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae68c875-36bd-42fa-8d73-79f940a0cbb7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:29.101861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae68c875-36bd-42fa-8d73-79f940a0cbb7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:29.102327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae68c875-36bd-42fa-8d73-79f940a0cbb7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:29.102840 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae68c875-36bd-42fa-8d73-79f940a0cbb7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:29.246490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ae68c875-36bd-42fa-8d73-79f940a0cbb7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:29.254827 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ae68c875-36bd-42fa-8d73-79f940a0cbb7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1364 microversion: 2.1 time: 0.167874 Aug 24 11:10:29.255437 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3641/6920] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:29 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:30.277808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3f6f448c-74ef-4448-88f9-294bf36930cb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:30.278536 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3f6f448c-74ef-4448-88f9-294bf36930cb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:30.285971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f6f448c-74ef-4448-88f9-294bf36930cb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:30.285971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f6f448c-74ef-4448-88f9-294bf36930cb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:30.286410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f6f448c-74ef-4448-88f9-294bf36930cb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:30.287111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f6f448c-74ef-4448-88f9-294bf36930cb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:30.287565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f6f448c-74ef-4448-88f9-294bf36930cb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:30.287991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f6f448c-74ef-4448-88f9-294bf36930cb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:30.434711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3f6f448c-74ef-4448-88f9-294bf36930cb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:30.443405 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3f6f448c-74ef-4448-88f9-294bf36930cb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1364 microversion: 2.1 time: 0.170969 Aug 24 11:10:30.444000 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3280/6921] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:30 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:31.467117 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a3a2edb2-8b82-4915-97df-8bd7e7ace9f2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:31.467724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a3a2edb2-8b82-4915-97df-8bd7e7ace9f2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:31.470726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:31.471420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:31.478038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3a2edb2-8b82-4915-97df-8bd7e7ace9f2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:31.478619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3a2edb2-8b82-4915-97df-8bd7e7ace9f2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:31.479074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3a2edb2-8b82-4915-97df-8bd7e7ace9f2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:31.479798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3a2edb2-8b82-4915-97df-8bd7e7ace9f2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:31.480271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3a2edb2-8b82-4915-97df-8bd7e7ace9f2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:31.480712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3a2edb2-8b82-4915-97df-8bd7e7ace9f2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:31.627223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a3a2edb2-8b82-4915-97df-8bd7e7ace9f2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:31.638057 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a3a2edb2-8b82-4915-97df-8bd7e7ace9f2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1551 microversion: 2.1 time: 0.175124 Aug 24 11:10:31.638642 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3642/6922] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:31 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1551 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:31.658589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5bdc78a7-578c-4329-8ab6-42ae1884bb2e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:31.659136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5bdc78a7-578c-4329-8ab6-42ae1884bb2e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:31.661222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:31.667700 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bdc78a7-578c-4329-8ab6-42ae1884bb2e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:31.668197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bdc78a7-578c-4329-8ab6-42ae1884bb2e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:31.668613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bdc78a7-578c-4329-8ab6-42ae1884bb2e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:31.669338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bdc78a7-578c-4329-8ab6-42ae1884bb2e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:31.669794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bdc78a7-578c-4329-8ab6-42ae1884bb2e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:31.670220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bdc78a7-578c-4329-8ab6-42ae1884bb2e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:31.761061 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5bdc78a7-578c-4329-8ab6-42ae1884bb2e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106272 Aug 24 11:10:31.761732 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3281/6923] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Aug 24 11:10:31 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:10:32.737973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-f2383ff5-3919-4483-a18e-948e6ff65d27 req-21dacf4a-7e9c-4894-8f32-052d9360f399 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfa6c7be-5543-480f-8f41-3452635d6fe2", "tag": "53255380-02e7-4af7-a6e9-b224c7e4892b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:32.748775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f2383ff5-3919-4483-a18e-948e6ff65d27 req-21dacf4a-7e9c-4894-8f32-052d9360f399 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:32.749414 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f2383ff5-3919-4483-a18e-948e6ff65d27 req-21dacf4a-7e9c-4894-8f32-052d9360f399 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:32.749922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f2383ff5-3919-4483-a18e-948e6ff65d27 req-21dacf4a-7e9c-4894-8f32-052d9360f399 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:32.761363 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-f2383ff5-3919-4483-a18e-948e6ff65d27 req-21dacf4a-7e9c-4894-8f32-052d9360f399 service nova] Creating event network-changed:53255380-02e7-4af7-a6e9-b224c7e4892b for instance bfa6c7be-5543-480f-8f41-3452635d6fe2 on n-h1-849328-3 Aug 24 11:10:32.766555 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-f2383ff5-3919-4483-a18e-948e6ff65d27 req-21dacf4a-7e9c-4894-8f32-052d9360f399 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032341 Aug 24 11:10:32.767252 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3643/6924] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:11:07.997421 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=17 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:11:07.998268 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:11:08.002375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-079c83eb-ecc8-4ebb-a19e-1b3043b6ab8e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:08.003000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-079c83eb-ecc8-4ebb-a19e-1b3043b6ab8e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:08.010347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-079c83eb-ecc8-4ebb-a19e-1b3043b6ab8e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:08.010852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-079c83eb-ecc8-4ebb-a19e-1b3043b6ab8e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:08.011293 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-079c83eb-ecc8-4ebb-a19e-1b3043b6ab8e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:08.012016 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-079c83eb-ecc8-4ebb-a19e-1b3043b6ab8e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:08.012471 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-079c83eb-ecc8-4ebb-a19e-1b3043b6ab8e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:08.012882 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-079c83eb-ecc8-4ebb-a19e-1b3043b6ab8e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:08.162718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-079c83eb-ecc8-4ebb-a19e-1b3043b6ab8e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:08.171291 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-079c83eb-ecc8-4ebb-a19e-1b3043b6ab8e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1670 microversion: 2.1 time: 0.175950 Aug 24 11:11:08.171892 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3282/6925] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:07 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1670 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:08.191638 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:11:08.192424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=68 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:11:08.197034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c5def833-eb2e-4e7c-9d6f-4fe2b93d6ef2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b082327b-6c38-4f7a-b87b-5b6b15f6fc47"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:11:08.199534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c5def833-eb2e-4e7c-9d6f-4fe2b93d6ef2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:08.208069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5def833-eb2e-4e7c-9d6f-4fe2b93d6ef2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:08.208567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5def833-eb2e-4e7c-9d6f-4fe2b93d6ef2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:08.209020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5def833-eb2e-4e7c-9d6f-4fe2b93d6ef2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:08.209744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5def833-eb2e-4e7c-9d6f-4fe2b93d6ef2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:08.210211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5def833-eb2e-4e7c-9d6f-4fe2b93d6ef2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:08.210654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5def833-eb2e-4e7c-9d6f-4fe2b93d6ef2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:08.488335 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c5def833-eb2e-4e7c-9d6f-4fe2b93d6ef2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "POST /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298647 Aug 24 11:11:08.494268 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3644/6926] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Aug 24 11:11:08 2022] POST /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:11:19.248780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c7bdb4a8-7b70-4c94-9421-db848af2cef8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:11:19.251095 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c7bdb4a8-7b70-4c94-9421-db848af2cef8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:19.253934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:11:19.254597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:11:19.261927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7bdb4a8-7b70-4c94-9421-db848af2cef8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:19.262720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7bdb4a8-7b70-4c94-9421-db848af2cef8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:19.263297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7bdb4a8-7b70-4c94-9421-db848af2cef8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:19.264138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7bdb4a8-7b70-4c94-9421-db848af2cef8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:19.264913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7bdb4a8-7b70-4c94-9421-db848af2cef8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:19.265455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7bdb4a8-7b70-4c94-9421-db848af2cef8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:19.296026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c7bdb4a8-7b70-4c94-9421-db848af2cef8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:19.302169 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c7bdb4a8-7b70-4c94-9421-db848af2cef8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Old instance type m1.heat2, new instance type m1.heat {{(pid=122432) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 11:11:19.309639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c7bdb4a8-7b70-4c94-9421-db848af2cef8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:11:19.310060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c7bdb4a8-7b70-4c94-9421-db848af2cef8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:11:19.310532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c7bdb4a8-7b70-4c94-9421-db848af2cef8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:11:19.310933 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c7bdb4a8-7b70-4c94-9421-db848af2cef8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:11:19.311341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c7bdb4a8-7b70-4c94-9421-db848af2cef8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:11:19.379548 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c7bdb4a8-7b70-4c94-9421-db848af2cef8 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "POST /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2/action" status: 202 len: 0 microversion: 2.1 time: 0.134954 Aug 24 11:11:19.380441 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3283/6927] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:11:19 2022] POST /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:11:19.386868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:11:19.387666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:11:19.391908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6b8622f2-08ff-424f-a90b-f2f6b543e051 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:19.392660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6b8622f2-08ff-424f-a90b-f2f6b543e051 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:19.403544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b8622f2-08ff-424f-a90b-f2f6b543e051 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:19.404018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b8622f2-08ff-424f-a90b-f2f6b543e051 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:19.404669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b8622f2-08ff-424f-a90b-f2f6b543e051 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:19.405415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b8622f2-08ff-424f-a90b-f2f6b543e051 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:19.405871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b8622f2-08ff-424f-a90b-f2f6b543e051 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:19.406315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b8622f2-08ff-424f-a90b-f2f6b543e051 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:19.570249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6b8622f2-08ff-424f-a90b-f2f6b543e051 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:19.578821 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6b8622f2-08ff-424f-a90b-f2f6b543e051 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1725 microversion: 2.1 time: 0.193944 Aug 24 11:11:19.579420 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3645/6928] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:19 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:20.601560 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-07ffc459-b5ad-4925-a056-fc0331681a14 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:20.602144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-07ffc459-b5ad-4925-a056-fc0331681a14 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:20.609392 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07ffc459-b5ad-4925-a056-fc0331681a14 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:20.609883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07ffc459-b5ad-4925-a056-fc0331681a14 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:20.610320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07ffc459-b5ad-4925-a056-fc0331681a14 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:20.611030 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07ffc459-b5ad-4925-a056-fc0331681a14 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:20.611482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07ffc459-b5ad-4925-a056-fc0331681a14 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:20.611905 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07ffc459-b5ad-4925-a056-fc0331681a14 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:20.750437 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-07ffc459-b5ad-4925-a056-fc0331681a14 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:20.759907 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-07ffc459-b5ad-4925-a056-fc0331681a14 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1725 microversion: 2.1 time: 0.163423 Aug 24 11:11:20.760482 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3284/6929] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:20 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:21.782338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1faabb19-19a8-400f-b736-77c50375372b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:21.782947 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1faabb19-19a8-400f-b736-77c50375372b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:21.790329 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1faabb19-19a8-400f-b736-77c50375372b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:21.790832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1faabb19-19a8-400f-b736-77c50375372b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:21.791314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1faabb19-19a8-400f-b736-77c50375372b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:21.792021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1faabb19-19a8-400f-b736-77c50375372b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:21.792519 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1faabb19-19a8-400f-b736-77c50375372b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:21.792956 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1faabb19-19a8-400f-b736-77c50375372b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:21.932724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1faabb19-19a8-400f-b736-77c50375372b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:21.941304 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1faabb19-19a8-400f-b736-77c50375372b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1730 microversion: 2.1 time: 0.162978 Aug 24 11:11:21.941866 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3646/6930] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:21 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:22.976928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-93f8a49c-2653-480f-b773-0766af6d7c9e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:22.978058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-93f8a49c-2653-480f-b773-0766af6d7c9e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:22.986441 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93f8a49c-2653-480f-b773-0766af6d7c9e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:22.986930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93f8a49c-2653-480f-b773-0766af6d7c9e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:22.987359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93f8a49c-2653-480f-b773-0766af6d7c9e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:22.988044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93f8a49c-2653-480f-b773-0766af6d7c9e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:22.988494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93f8a49c-2653-480f-b773-0766af6d7c9e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:22.988914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93f8a49c-2653-480f-b773-0766af6d7c9e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:23.128222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-93f8a49c-2653-480f-b773-0766af6d7c9e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:23.137022 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-93f8a49c-2653-480f-b773-0766af6d7c9e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1730 microversion: 2.1 time: 0.168073 Aug 24 11:11:23.137681 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3285/6931] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:22 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:24.161991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ac343b2-4c8e-4715-97a3-c82807a55d5a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:24.162881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8ac343b2-4c8e-4715-97a3-c82807a55d5a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:24.171283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ac343b2-4c8e-4715-97a3-c82807a55d5a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:24.171789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ac343b2-4c8e-4715-97a3-c82807a55d5a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:24.172243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ac343b2-4c8e-4715-97a3-c82807a55d5a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:24.172953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ac343b2-4c8e-4715-97a3-c82807a55d5a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:24.173462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ac343b2-4c8e-4715-97a3-c82807a55d5a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:24.173906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ac343b2-4c8e-4715-97a3-c82807a55d5a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:24.328602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8ac343b2-4c8e-4715-97a3-c82807a55d5a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:24.337573 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8ac343b2-4c8e-4715-97a3-c82807a55d5a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1730 microversion: 2.1 time: 0.181850 Aug 24 11:11:24.338162 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3647/6932] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:24 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:25.359677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b7108563-a5b6-463a-afc1-507f4996711c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:25.360282 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b7108563-a5b6-463a-afc1-507f4996711c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:25.367578 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7108563-a5b6-463a-afc1-507f4996711c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:25.368093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7108563-a5b6-463a-afc1-507f4996711c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:25.368522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7108563-a5b6-463a-afc1-507f4996711c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:25.369382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7108563-a5b6-463a-afc1-507f4996711c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:25.370166 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7108563-a5b6-463a-afc1-507f4996711c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:25.370300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7108563-a5b6-463a-afc1-507f4996711c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:25.514335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b7108563-a5b6-463a-afc1-507f4996711c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:25.523121 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b7108563-a5b6-463a-afc1-507f4996711c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1730 microversion: 2.1 time: 0.167722 Aug 24 11:11:25.523650 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3286/6933] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:25 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:26.544549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c04447a7-c5f5-4199-ac09-9ec97ef0b0cf tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:26.545163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c04447a7-c5f5-4199-ac09-9ec97ef0b0cf tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:26.552478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c04447a7-c5f5-4199-ac09-9ec97ef0b0cf tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:26.552977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c04447a7-c5f5-4199-ac09-9ec97ef0b0cf tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:26.553450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c04447a7-c5f5-4199-ac09-9ec97ef0b0cf tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:26.554151 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c04447a7-c5f5-4199-ac09-9ec97ef0b0cf tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:26.554616 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c04447a7-c5f5-4199-ac09-9ec97ef0b0cf tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:26.555052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c04447a7-c5f5-4199-ac09-9ec97ef0b0cf tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:26.691081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c04447a7-c5f5-4199-ac09-9ec97ef0b0cf tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:26.703614 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c04447a7-c5f5-4199-ac09-9ec97ef0b0cf tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1730 microversion: 2.1 time: 0.162852 Aug 24 11:11:26.704350 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3648/6934] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:26 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:27.732328 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f9e38893-dedf-44ec-86f2-dff6f5f5f990 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:27.733788 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f9e38893-dedf-44ec-86f2-dff6f5f5f990 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:27.744827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9e38893-dedf-44ec-86f2-dff6f5f5f990 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:27.745345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9e38893-dedf-44ec-86f2-dff6f5f5f990 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:27.745783 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9e38893-dedf-44ec-86f2-dff6f5f5f990 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:27.746473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9e38893-dedf-44ec-86f2-dff6f5f5f990 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:27.746929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9e38893-dedf-44ec-86f2-dff6f5f5f990 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:27.747333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9e38893-dedf-44ec-86f2-dff6f5f5f990 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:27.879264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f9e38893-dedf-44ec-86f2-dff6f5f5f990 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:27.888162 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f9e38893-dedf-44ec-86f2-dff6f5f5f990 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1730 microversion: 2.1 time: 0.162439 Aug 24 11:11:27.888741 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3287/6935] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:27 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:28.964430 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-63c33398-4988-473c-8f43-f024292b6509 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:28.965065 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-63c33398-4988-473c-8f43-f024292b6509 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:28.971502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63c33398-4988-473c-8f43-f024292b6509 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:28.971975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63c33398-4988-473c-8f43-f024292b6509 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:28.972462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63c33398-4988-473c-8f43-f024292b6509 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:28.973230 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63c33398-4988-473c-8f43-f024292b6509 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:28.973670 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63c33398-4988-473c-8f43-f024292b6509 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:28.974113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63c33398-4988-473c-8f43-f024292b6509 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:29.115469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-63c33398-4988-473c-8f43-f024292b6509 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:29.124627 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-63c33398-4988-473c-8f43-f024292b6509 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1730 microversion: 2.1 time: 0.218289 Aug 24 11:11:29.125253 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3649/6936] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:28 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1730 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:30.150448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ebcb3086-00b1-494b-ad26-258c57567636 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:30.151529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ebcb3086-00b1-494b-ad26-258c57567636 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:30.162882 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebcb3086-00b1-494b-ad26-258c57567636 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:30.163661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebcb3086-00b1-494b-ad26-258c57567636 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:30.164396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebcb3086-00b1-494b-ad26-258c57567636 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:30.165590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebcb3086-00b1-494b-ad26-258c57567636 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:30.166284 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebcb3086-00b1-494b-ad26-258c57567636 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:30.166714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebcb3086-00b1-494b-ad26-258c57567636 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:30.302631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ebcb3086-00b1-494b-ad26-258c57567636 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:30.311519 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ebcb3086-00b1-494b-ad26-258c57567636 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1730 microversion: 2.1 time: 0.167600 Aug 24 11:11:30.312090 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3288/6937] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:30 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:31.332450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f8ae7569-a991-402d-bd7b-7edd34e1992a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:31.333088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f8ae7569-a991-402d-bd7b-7edd34e1992a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:31.341589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8ae7569-a991-402d-bd7b-7edd34e1992a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:31.342218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8ae7569-a991-402d-bd7b-7edd34e1992a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:31.342774 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8ae7569-a991-402d-bd7b-7edd34e1992a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:31.343843 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8ae7569-a991-402d-bd7b-7edd34e1992a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:31.344534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8ae7569-a991-402d-bd7b-7edd34e1992a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:31.345166 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8ae7569-a991-402d-bd7b-7edd34e1992a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:31.491455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f8ae7569-a991-402d-bd7b-7edd34e1992a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:31.500715 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f8ae7569-a991-402d-bd7b-7edd34e1992a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1730 microversion: 2.1 time: 0.172390 Aug 24 11:11:31.501346 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3650/6938] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:31 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:32.522210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c251adca-cb98-48a3-8d04-2969f9191b01 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:32.522965 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c251adca-cb98-48a3-8d04-2969f9191b01 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:32.530025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c251adca-cb98-48a3-8d04-2969f9191b01 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:32.530517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c251adca-cb98-48a3-8d04-2969f9191b01 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:32.530961 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c251adca-cb98-48a3-8d04-2969f9191b01 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:32.531641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c251adca-cb98-48a3-8d04-2969f9191b01 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:32.532105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c251adca-cb98-48a3-8d04-2969f9191b01 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:32.532546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c251adca-cb98-48a3-8d04-2969f9191b01 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:32.683658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c251adca-cb98-48a3-8d04-2969f9191b01 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:32.692303 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c251adca-cb98-48a3-8d04-2969f9191b01 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1730 microversion: 2.1 time: 0.174112 Aug 24 11:11:32.692925 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3289/6939] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:32 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:33.716871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a5dd632a-5689-4cfc-a2fd-c4e52aa0d9d0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:33.717592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a5dd632a-5689-4cfc-a2fd-c4e52aa0d9d0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:33.724898 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5dd632a-5689-4cfc-a2fd-c4e52aa0d9d0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:33.725434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5dd632a-5689-4cfc-a2fd-c4e52aa0d9d0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:33.725899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5dd632a-5689-4cfc-a2fd-c4e52aa0d9d0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:33.726609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5dd632a-5689-4cfc-a2fd-c4e52aa0d9d0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:33.727083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5dd632a-5689-4cfc-a2fd-c4e52aa0d9d0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:33.727525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5dd632a-5689-4cfc-a2fd-c4e52aa0d9d0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:33.878574 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a5dd632a-5689-4cfc-a2fd-c4e52aa0d9d0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:33.889154 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a5dd632a-5689-4cfc-a2fd-c4e52aa0d9d0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1730 microversion: 2.1 time: 0.178707 Aug 24 11:11:33.889792 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3651/6940] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:33 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:34.914408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1820202d-e230-4c07-bfcb-c538e5a33c46 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:34.915335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1820202d-e230-4c07-bfcb-c538e5a33c46 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:34.924788 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1820202d-e230-4c07-bfcb-c538e5a33c46 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:34.925623 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1820202d-e230-4c07-bfcb-c538e5a33c46 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:34.926314 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1820202d-e230-4c07-bfcb-c538e5a33c46 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:34.927333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1820202d-e230-4c07-bfcb-c538e5a33c46 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:34.928036 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1820202d-e230-4c07-bfcb-c538e5a33c46 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:34.928726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1820202d-e230-4c07-bfcb-c538e5a33c46 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:35.075606 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1820202d-e230-4c07-bfcb-c538e5a33c46 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:35.082037 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1820202d-e230-4c07-bfcb-c538e5a33c46 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1730 microversion: 2.1 time: 0.175108 Aug 24 11:11:35.082604 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3290/6941] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:34 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:36.109415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d259babe-36da-475c-9ee6-64f789f1719f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:36.110116 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d259babe-36da-475c-9ee6-64f789f1719f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:36.118583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d259babe-36da-475c-9ee6-64f789f1719f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:36.119176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d259babe-36da-475c-9ee6-64f789f1719f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:36.119709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d259babe-36da-475c-9ee6-64f789f1719f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:36.120536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d259babe-36da-475c-9ee6-64f789f1719f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:36.121093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d259babe-36da-475c-9ee6-64f789f1719f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:36.121648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d259babe-36da-475c-9ee6-64f789f1719f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:36.258994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d259babe-36da-475c-9ee6-64f789f1719f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:36.267519 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d259babe-36da-475c-9ee6-64f789f1719f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1730 microversion: 2.1 time: 0.164594 Aug 24 11:11:36.268071 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3652/6942] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:36 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:37.291151 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bd723f61-2b09-4142-b700-196b9acb1c39 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:37.291828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bd723f61-2b09-4142-b700-196b9acb1c39 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:37.301899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd723f61-2b09-4142-b700-196b9acb1c39 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:37.302394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd723f61-2b09-4142-b700-196b9acb1c39 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:37.302840 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd723f61-2b09-4142-b700-196b9acb1c39 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:37.303521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd723f61-2b09-4142-b700-196b9acb1c39 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:37.304487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd723f61-2b09-4142-b700-196b9acb1c39 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:37.304610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd723f61-2b09-4142-b700-196b9acb1c39 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:37.460962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bd723f61-2b09-4142-b700-196b9acb1c39 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:37.470555 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bd723f61-2b09-4142-b700-196b9acb1c39 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1730 microversion: 2.1 time: 0.185610 Aug 24 11:11:37.471171 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3291/6943] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:37 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:38.496042 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-237c4ec9-b405-4259-846a-8aa551ffaa0d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:38.497315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-237c4ec9-b405-4259-846a-8aa551ffaa0d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:38.509740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-237c4ec9-b405-4259-846a-8aa551ffaa0d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:38.510262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-237c4ec9-b405-4259-846a-8aa551ffaa0d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:38.510718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-237c4ec9-b405-4259-846a-8aa551ffaa0d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:38.511455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-237c4ec9-b405-4259-846a-8aa551ffaa0d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:38.511935 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-237c4ec9-b405-4259-846a-8aa551ffaa0d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:38.513145 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-237c4ec9-b405-4259-846a-8aa551ffaa0d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:38.655317 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-237c4ec9-b405-4259-846a-8aa551ffaa0d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:38.664025 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-237c4ec9-b405-4259-846a-8aa551ffaa0d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1730 microversion: 2.1 time: 0.174599 Aug 24 11:11:38.664609 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3653/6944] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:38 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:39.686148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5de0c62f-9394-4f92-9681-2d43fed11be9 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:39.686753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5de0c62f-9394-4f92-9681-2d43fed11be9 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:39.694387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5de0c62f-9394-4f92-9681-2d43fed11be9 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:39.694863 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5de0c62f-9394-4f92-9681-2d43fed11be9 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:39.695294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5de0c62f-9394-4f92-9681-2d43fed11be9 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:39.695986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5de0c62f-9394-4f92-9681-2d43fed11be9 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:39.696431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5de0c62f-9394-4f92-9681-2d43fed11be9 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:39.696861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5de0c62f-9394-4f92-9681-2d43fed11be9 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:39.837338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5de0c62f-9394-4f92-9681-2d43fed11be9 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:39.846008 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5de0c62f-9394-4f92-9681-2d43fed11be9 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1730 microversion: 2.1 time: 0.163883 Aug 24 11:11:39.846581 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3292/6945] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:39 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:40.350987 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:11:40.351270 n-d-849328-3 devstack@n-api.service[122432]: Wed Aug 24 11:11:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:11:40.867306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e4eab7a7-da18-4b6d-ac90-cf03729a2e4d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:40.868182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e4eab7a7-da18-4b6d-ac90-cf03729a2e4d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:40.875376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4eab7a7-da18-4b6d-ac90-cf03729a2e4d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:40.875888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4eab7a7-da18-4b6d-ac90-cf03729a2e4d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:40.876345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4eab7a7-da18-4b6d-ac90-cf03729a2e4d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:40.877093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4eab7a7-da18-4b6d-ac90-cf03729a2e4d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:40.877581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4eab7a7-da18-4b6d-ac90-cf03729a2e4d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:40.878046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4eab7a7-da18-4b6d-ac90-cf03729a2e4d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:41.021840 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e4eab7a7-da18-4b6d-ac90-cf03729a2e4d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:41.030447 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e4eab7a7-da18-4b6d-ac90-cf03729a2e4d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1729 microversion: 2.1 time: 0.167170 Aug 24 11:11:41.031048 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3654/6946] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:40 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:41.106289 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-1902bdb1-a1bc-4120-8697-8c69a718d2db req-0ad1e86c-9d54-4abc-a22b-0f64e1f44ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfa6c7be-5543-480f-8f41-3452635d6fe2", "name": "network-vif-unplugged", "status": "completed", "tag": "53255380-02e7-4af7-a6e9-b224c7e4892b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:11:41.119776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1902bdb1-a1bc-4120-8697-8c69a718d2db req-0ad1e86c-9d54-4abc-a22b-0f64e1f44ec7 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:41.120301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1902bdb1-a1bc-4120-8697-8c69a718d2db req-0ad1e86c-9d54-4abc-a22b-0f64e1f44ec7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:41.120732 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1902bdb1-a1bc-4120-8697-8c69a718d2db req-0ad1e86c-9d54-4abc-a22b-0f64e1f44ec7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:41.133044 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-1902bdb1-a1bc-4120-8697-8c69a718d2db req-0ad1e86c-9d54-4abc-a22b-0f64e1f44ec7 service nova] Creating event network-vif-unplugged:53255380-02e7-4af7-a6e9-b224c7e4892b for instance bfa6c7be-5543-480f-8f41-3452635d6fe2 on n-h2-849328-3 Aug 24 11:11:41.138797 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-1902bdb1-a1bc-4120-8697-8c69a718d2db req-0ad1e86c-9d54-4abc-a22b-0f64e1f44ec7 service nova] Instance bfa6c7be-5543-480f-8f41-3452635d6fe2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 11:11:41.150275 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-1902bdb1-a1bc-4120-8697-8c69a718d2db req-0ad1e86c-9d54-4abc-a22b-0f64e1f44ec7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048414 Aug 24 11:11:41.150901 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3293/6947] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:11:42.052020 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b58715e2-9a9f-4993-8298-c3056e736dbe tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:42.052691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b58715e2-9a9f-4993-8298-c3056e736dbe tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:42.060213 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b58715e2-9a9f-4993-8298-c3056e736dbe tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:42.060717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b58715e2-9a9f-4993-8298-c3056e736dbe tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:42.061167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b58715e2-9a9f-4993-8298-c3056e736dbe tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:42.061880 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b58715e2-9a9f-4993-8298-c3056e736dbe tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:42.062383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b58715e2-9a9f-4993-8298-c3056e736dbe tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:42.062824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b58715e2-9a9f-4993-8298-c3056e736dbe tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:42.200963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b58715e2-9a9f-4993-8298-c3056e736dbe tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:42.209598 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b58715e2-9a9f-4993-8298-c3056e736dbe tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1729 microversion: 2.1 time: 0.161516 Aug 24 11:11:42.210223 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3655/6948] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:42 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:43.189583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-1bb0bac0-f83b-4c41-a902-db6b1290040a req-6a952d26-204c-4857-835c-4cdd2e8b3403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfa6c7be-5543-480f-8f41-3452635d6fe2", "tag": "53255380-02e7-4af7-a6e9-b224c7e4892b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:11:43.201269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1bb0bac0-f83b-4c41-a902-db6b1290040a req-6a952d26-204c-4857-835c-4cdd2e8b3403 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:43.201761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1bb0bac0-f83b-4c41-a902-db6b1290040a req-6a952d26-204c-4857-835c-4cdd2e8b3403 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:43.202198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1bb0bac0-f83b-4c41-a902-db6b1290040a req-6a952d26-204c-4857-835c-4cdd2e8b3403 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:43.216082 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-1bb0bac0-f83b-4c41-a902-db6b1290040a req-6a952d26-204c-4857-835c-4cdd2e8b3403 service nova] Creating event network-changed:53255380-02e7-4af7-a6e9-b224c7e4892b for instance bfa6c7be-5543-480f-8f41-3452635d6fe2 on n-h2-849328-3 Aug 24 11:11:43.222625 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-1bb0bac0-f83b-4c41-a902-db6b1290040a req-6a952d26-204c-4857-835c-4cdd2e8b3403 service nova] Instance bfa6c7be-5543-480f-8f41-3452635d6fe2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 11:11:43.230841 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0de85329-3b61-4c66-8680-8f8dcde7c0fa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:43.231566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0de85329-3b61-4c66-8680-8f8dcde7c0fa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:43.235391 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-1bb0bac0-f83b-4c41-a902-db6b1290040a req-6a952d26-204c-4857-835c-4cdd2e8b3403 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049727 Aug 24 11:11:43.236158 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3294/6949] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:11:43.239634 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0de85329-3b61-4c66-8680-8f8dcde7c0fa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:43.240144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0de85329-3b61-4c66-8680-8f8dcde7c0fa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:43.240604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0de85329-3b61-4c66-8680-8f8dcde7c0fa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:43.241378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0de85329-3b61-4c66-8680-8f8dcde7c0fa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:43.241849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0de85329-3b61-4c66-8680-8f8dcde7c0fa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:43.242307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0de85329-3b61-4c66-8680-8f8dcde7c0fa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:43.392358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0de85329-3b61-4c66-8680-8f8dcde7c0fa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:43.402767 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0de85329-3b61-4c66-8680-8f8dcde7c0fa tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1727 microversion: 2.1 time: 0.175989 Aug 24 11:11:43.403695 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3656/6950] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:43 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:44.427871 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d834acb0-08a4-4141-b33f-af1f495aafb0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:44.428971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d834acb0-08a4-4141-b33f-af1f495aafb0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:44.438769 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d834acb0-08a4-4141-b33f-af1f495aafb0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:44.439534 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d834acb0-08a4-4141-b33f-af1f495aafb0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:44.440244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d834acb0-08a4-4141-b33f-af1f495aafb0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:44.441462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d834acb0-08a4-4141-b33f-af1f495aafb0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:44.442160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d834acb0-08a4-4141-b33f-af1f495aafb0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:44.442782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d834acb0-08a4-4141-b33f-af1f495aafb0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:44.585356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d834acb0-08a4-4141-b33f-af1f495aafb0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:44.594186 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d834acb0-08a4-4141-b33f-af1f495aafb0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1727 microversion: 2.1 time: 0.173723 Aug 24 11:11:44.594754 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3295/6951] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:44 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:45.618161 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c2be8c0b-ea78-4ce7-a477-7e2d5d81e87f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:45.619556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c2be8c0b-ea78-4ce7-a477-7e2d5d81e87f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:45.628019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2be8c0b-ea78-4ce7-a477-7e2d5d81e87f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:45.628832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2be8c0b-ea78-4ce7-a477-7e2d5d81e87f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:45.629533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2be8c0b-ea78-4ce7-a477-7e2d5d81e87f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:45.630526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2be8c0b-ea78-4ce7-a477-7e2d5d81e87f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:45.631402 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2be8c0b-ea78-4ce7-a477-7e2d5d81e87f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:45.632210 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2be8c0b-ea78-4ce7-a477-7e2d5d81e87f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:45.782977 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c2be8c0b-ea78-4ce7-a477-7e2d5d81e87f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:45.799812 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c2be8c0b-ea78-4ce7-a477-7e2d5d81e87f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1727 microversion: 2.1 time: 0.187252 Aug 24 11:11:45.814850 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3657/6952] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:45 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1727 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:46.824668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cb67eea8-838d-4693-a39f-9e72a302b89c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:46.825341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cb67eea8-838d-4693-a39f-9e72a302b89c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:46.832587 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb67eea8-838d-4693-a39f-9e72a302b89c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:46.833071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb67eea8-838d-4693-a39f-9e72a302b89c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:46.833530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb67eea8-838d-4693-a39f-9e72a302b89c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:46.834221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb67eea8-838d-4693-a39f-9e72a302b89c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:46.834672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb67eea8-838d-4693-a39f-9e72a302b89c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:46.835090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb67eea8-838d-4693-a39f-9e72a302b89c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:46.965994 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cb67eea8-838d-4693-a39f-9e72a302b89c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:46.974653 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cb67eea8-838d-4693-a39f-9e72a302b89c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1727 microversion: 2.1 time: 0.153986 Aug 24 11:11:46.975243 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3296/6953] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:46 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:47.997251 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-55d42c40-d212-4f15-ab2c-5ec35095fe7b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:47.997988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-55d42c40-d212-4f15-ab2c-5ec35095fe7b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:48.005510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55d42c40-d212-4f15-ab2c-5ec35095fe7b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:48.006041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55d42c40-d212-4f15-ab2c-5ec35095fe7b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:48.006492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55d42c40-d212-4f15-ab2c-5ec35095fe7b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:48.007182 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55d42c40-d212-4f15-ab2c-5ec35095fe7b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:48.007676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55d42c40-d212-4f15-ab2c-5ec35095fe7b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:48.008115 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55d42c40-d212-4f15-ab2c-5ec35095fe7b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:48.152932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-55d42c40-d212-4f15-ab2c-5ec35095fe7b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:48.165569 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-55d42c40-d212-4f15-ab2c-5ec35095fe7b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1727 microversion: 2.1 time: 0.172223 Aug 24 11:11:48.166189 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3658/6954] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:47 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:49.190800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-10cdadf8-62b3-40a0-9b5b-f33928ad4645 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:49.191389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-10cdadf8-62b3-40a0-9b5b-f33928ad4645 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:49.198590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10cdadf8-62b3-40a0-9b5b-f33928ad4645 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:49.199079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10cdadf8-62b3-40a0-9b5b-f33928ad4645 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:49.199514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10cdadf8-62b3-40a0-9b5b-f33928ad4645 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:49.200220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10cdadf8-62b3-40a0-9b5b-f33928ad4645 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:49.200677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10cdadf8-62b3-40a0-9b5b-f33928ad4645 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:49.201108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10cdadf8-62b3-40a0-9b5b-f33928ad4645 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:49.337598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-10cdadf8-62b3-40a0-9b5b-f33928ad4645 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:49.341182 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:11:49.348651 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-10cdadf8-62b3-40a0-9b5b-f33928ad4645 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1727 microversion: 2.1 time: 0.164749 Aug 24 11:11:49.349290 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3297/6955] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:49 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:50.374660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4232b4cc-eb04-4621-b929-52bff0e94c3f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:50.375632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4232b4cc-eb04-4621-b929-52bff0e94c3f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:50.379743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=29 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:11:50.387149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4232b4cc-eb04-4621-b929-52bff0e94c3f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:50.387656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4232b4cc-eb04-4621-b929-52bff0e94c3f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:50.388090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4232b4cc-eb04-4621-b929-52bff0e94c3f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:50.388797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4232b4cc-eb04-4621-b929-52bff0e94c3f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:50.389301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4232b4cc-eb04-4621-b929-52bff0e94c3f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:50.389736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4232b4cc-eb04-4621-b929-52bff0e94c3f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:50.392556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=85 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:11:50.540716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4232b4cc-eb04-4621-b929-52bff0e94c3f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:50.553679 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4232b4cc-eb04-4621-b929-52bff0e94c3f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1727 microversion: 2.1 time: 0.185391 Aug 24 11:11:50.554458 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3659/6956] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:50 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1727 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:51.586678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-56bbf17a-766f-46e1-943e-7119a70698f3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:51.587551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-56bbf17a-766f-46e1-943e-7119a70698f3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:51.591108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=35 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:11:51.598068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56bbf17a-766f-46e1-943e-7119a70698f3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:51.598307 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56bbf17a-766f-46e1-943e-7119a70698f3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:51.598741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56bbf17a-766f-46e1-943e-7119a70698f3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:51.599434 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56bbf17a-766f-46e1-943e-7119a70698f3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:51.599883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56bbf17a-766f-46e1-943e-7119a70698f3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:51.600304 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56bbf17a-766f-46e1-943e-7119a70698f3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:51.743708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-56bbf17a-766f-46e1-943e-7119a70698f3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:51.752522 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-56bbf17a-766f-46e1-943e-7119a70698f3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1727 microversion: 2.1 time: 0.172567 Aug 24 11:11:51.753154 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3298/6957] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:51 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:52.773774 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-73c1af05-b8d9-41ed-a5bb-a67609e9ba25 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:52.774318 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-73c1af05-b8d9-41ed-a5bb-a67609e9ba25 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:52.782426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73c1af05-b8d9-41ed-a5bb-a67609e9ba25 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:52.782945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73c1af05-b8d9-41ed-a5bb-a67609e9ba25 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:52.783415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73c1af05-b8d9-41ed-a5bb-a67609e9ba25 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:52.784148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73c1af05-b8d9-41ed-a5bb-a67609e9ba25 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:52.784642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73c1af05-b8d9-41ed-a5bb-a67609e9ba25 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:52.785101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73c1af05-b8d9-41ed-a5bb-a67609e9ba25 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:52.928362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-73c1af05-b8d9-41ed-a5bb-a67609e9ba25 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:52.937040 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-73c1af05-b8d9-41ed-a5bb-a67609e9ba25 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1727 microversion: 2.1 time: 0.167578 Aug 24 11:11:52.937664 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3660/6958] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:52 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:53.960111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f2b78a7d-dc9a-47d8-be83-ab4af57d67c0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:53.960698 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f2b78a7d-dc9a-47d8-be83-ab4af57d67c0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:53.968357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2b78a7d-dc9a-47d8-be83-ab4af57d67c0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:53.968848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2b78a7d-dc9a-47d8-be83-ab4af57d67c0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:53.969391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2b78a7d-dc9a-47d8-be83-ab4af57d67c0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:53.970121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2b78a7d-dc9a-47d8-be83-ab4af57d67c0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:53.970602 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2b78a7d-dc9a-47d8-be83-ab4af57d67c0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:53.971026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2b78a7d-dc9a-47d8-be83-ab4af57d67c0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:54.120480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f2b78a7d-dc9a-47d8-be83-ab4af57d67c0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:54.129753 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f2b78a7d-dc9a-47d8-be83-ab4af57d67c0 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1727 microversion: 2.1 time: 0.174648 Aug 24 11:11:54.130375 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3299/6959] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:53 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:55.151817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-68e0239c-d14b-4567-95c5-8bae1ae1ceb5 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:55.152550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-68e0239c-d14b-4567-95c5-8bae1ae1ceb5 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:55.159883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68e0239c-d14b-4567-95c5-8bae1ae1ceb5 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:55.160387 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68e0239c-d14b-4567-95c5-8bae1ae1ceb5 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:55.160852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68e0239c-d14b-4567-95c5-8bae1ae1ceb5 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:55.161605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68e0239c-d14b-4567-95c5-8bae1ae1ceb5 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:55.162080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68e0239c-d14b-4567-95c5-8bae1ae1ceb5 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:55.162603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68e0239c-d14b-4567-95c5-8bae1ae1ceb5 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:55.299912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-68e0239c-d14b-4567-95c5-8bae1ae1ceb5 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:55.308681 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-68e0239c-d14b-4567-95c5-8bae1ae1ceb5 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1724 microversion: 2.1 time: 0.160983 Aug 24 11:11:55.309304 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3661/6960] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:55 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:55.329333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eaef5b79-dbe7-4419-b413-7865f78845fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:11:55.329869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eaef5b79-dbe7-4419-b413-7865f78845fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:55.337075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaef5b79-dbe7-4419-b413-7865f78845fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:55.337589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaef5b79-dbe7-4419-b413-7865f78845fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:55.338119 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaef5b79-dbe7-4419-b413-7865f78845fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:55.338810 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaef5b79-dbe7-4419-b413-7865f78845fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:55.339263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaef5b79-dbe7-4419-b413-7865f78845fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:55.339680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaef5b79-dbe7-4419-b413-7865f78845fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:55.377678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaef5b79-dbe7-4419-b413-7865f78845fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:55.378158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaef5b79-dbe7-4419-b413-7865f78845fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:55.378591 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaef5b79-dbe7-4419-b413-7865f78845fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:55.379302 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaef5b79-dbe7-4419-b413-7865f78845fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:55.379750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaef5b79-dbe7-4419-b413-7865f78845fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:55.380166 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaef5b79-dbe7-4419-b413-7865f78845fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:55.404602 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-eaef5b79-dbe7-4419-b413-7865f78845fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Getting quotas for project 9a617355a8b94576bf4edcf58a078a8e. Resources: {'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:11:55.410051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-eaef5b79-dbe7-4419-b413-7865f78845fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Getting quotas for user 4a1864aed01d473ea51ec9de243ddfa4 and project 9a617355a8b94576bf4edcf58a078a8e. Resources: {'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:11:55.520990 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eaef5b79-dbe7-4419-b413-7865f78845fb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "POST /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2/action" status: 202 len: 0 microversion: 2.1 time: 0.195428 Aug 24 11:11:55.521544 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3300/6961] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:11:55 2022] POST /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:11:55.530088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b18e72e2-d00d-4c93-b912-c45171ba8225 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:55.530708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b18e72e2-d00d-4c93-b912-c45171ba8225 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:55.537154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b18e72e2-d00d-4c93-b912-c45171ba8225 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:55.537655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b18e72e2-d00d-4c93-b912-c45171ba8225 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:55.538102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b18e72e2-d00d-4c93-b912-c45171ba8225 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:55.538887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b18e72e2-d00d-4c93-b912-c45171ba8225 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:55.539352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b18e72e2-d00d-4c93-b912-c45171ba8225 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:55.539857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b18e72e2-d00d-4c93-b912-c45171ba8225 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:55.678125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b18e72e2-d00d-4c93-b912-c45171ba8225 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:55.687280 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b18e72e2-d00d-4c93-b912-c45171ba8225 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1723 microversion: 2.1 time: 0.161086 Aug 24 11:11:55.687875 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3662/6962] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:55 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:56.711894 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9fd8e081-3125-4e68-92a0-232f207f252c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:56.712597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9fd8e081-3125-4e68-92a0-232f207f252c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:56.720596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fd8e081-3125-4e68-92a0-232f207f252c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:56.721107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fd8e081-3125-4e68-92a0-232f207f252c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:56.721570 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fd8e081-3125-4e68-92a0-232f207f252c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:56.722257 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fd8e081-3125-4e68-92a0-232f207f252c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:56.722710 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fd8e081-3125-4e68-92a0-232f207f252c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:56.723136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fd8e081-3125-4e68-92a0-232f207f252c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:56.871349 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9fd8e081-3125-4e68-92a0-232f207f252c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:56.880163 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9fd8e081-3125-4e68-92a0-232f207f252c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1723 microversion: 2.1 time: 0.173554 Aug 24 11:11:56.880785 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3301/6963] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:56 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:57.902640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b370b740-7c2a-4c2f-8f0c-afdd8afd615e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:57.903227 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b370b740-7c2a-4c2f-8f0c-afdd8afd615e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:57.910757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b370b740-7c2a-4c2f-8f0c-afdd8afd615e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:57.911271 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b370b740-7c2a-4c2f-8f0c-afdd8afd615e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:57.911718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b370b740-7c2a-4c2f-8f0c-afdd8afd615e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:57.912436 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b370b740-7c2a-4c2f-8f0c-afdd8afd615e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:57.912907 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b370b740-7c2a-4c2f-8f0c-afdd8afd615e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:57.913375 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b370b740-7c2a-4c2f-8f0c-afdd8afd615e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:58.070723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b370b740-7c2a-4c2f-8f0c-afdd8afd615e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:58.080227 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b370b740-7c2a-4c2f-8f0c-afdd8afd615e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1723 microversion: 2.1 time: 0.181698 Aug 24 11:11:58.080975 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3663/6964] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:57 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:59.101396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a9169d28-5d12-478b-a14d-90f2a8bc137c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:59.102152 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a9169d28-5d12-478b-a14d-90f2a8bc137c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:59.109659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9169d28-5d12-478b-a14d-90f2a8bc137c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:59.110145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9169d28-5d12-478b-a14d-90f2a8bc137c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:59.110576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9169d28-5d12-478b-a14d-90f2a8bc137c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:59.111270 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9169d28-5d12-478b-a14d-90f2a8bc137c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:59.111719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9169d28-5d12-478b-a14d-90f2a8bc137c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:59.112138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9169d28-5d12-478b-a14d-90f2a8bc137c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:59.253652 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a9169d28-5d12-478b-a14d-90f2a8bc137c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:59.262604 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a9169d28-5d12-478b-a14d-90f2a8bc137c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1723 microversion: 2.1 time: 0.165338 Aug 24 11:11:59.263316 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3302/6965] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:59 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:00.287967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ea0722d-ec86-4fef-b2aa-7a9b4f1a5228 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:00.288611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0ea0722d-ec86-4fef-b2aa-7a9b4f1a5228 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:00.295003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ea0722d-ec86-4fef-b2aa-7a9b4f1a5228 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:00.295423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ea0722d-ec86-4fef-b2aa-7a9b4f1a5228 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:00.295863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ea0722d-ec86-4fef-b2aa-7a9b4f1a5228 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:00.296570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ea0722d-ec86-4fef-b2aa-7a9b4f1a5228 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:00.297027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ea0722d-ec86-4fef-b2aa-7a9b4f1a5228 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:00.297522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ea0722d-ec86-4fef-b2aa-7a9b4f1a5228 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:00.433138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0ea0722d-ec86-4fef-b2aa-7a9b4f1a5228 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:00.442330 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0ea0722d-ec86-4fef-b2aa-7a9b4f1a5228 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1723 microversion: 2.1 time: 0.159235 Aug 24 11:12:00.442928 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3664/6966] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:00 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:01.300198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9172f71e-76dd-4e67-9116-40d5ae77e58e req-f786aa8e-c293-4864-883a-a0b49dcbd349 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfa6c7be-5543-480f-8f41-3452635d6fe2", "tag": "53255380-02e7-4af7-a6e9-b224c7e4892b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:12:01.311804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9172f71e-76dd-4e67-9116-40d5ae77e58e req-f786aa8e-c293-4864-883a-a0b49dcbd349 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:01.312272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9172f71e-76dd-4e67-9116-40d5ae77e58e req-f786aa8e-c293-4864-883a-a0b49dcbd349 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:01.312741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9172f71e-76dd-4e67-9116-40d5ae77e58e req-f786aa8e-c293-4864-883a-a0b49dcbd349 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:01.325722 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9172f71e-76dd-4e67-9116-40d5ae77e58e req-f786aa8e-c293-4864-883a-a0b49dcbd349 service nova] Creating event network-changed:53255380-02e7-4af7-a6e9-b224c7e4892b for instance bfa6c7be-5543-480f-8f41-3452635d6fe2 on n-h1-849328-3 Aug 24 11:12:01.331632 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-9172f71e-76dd-4e67-9116-40d5ae77e58e req-f786aa8e-c293-4864-883a-a0b49dcbd349 service nova] Instance bfa6c7be-5543-480f-8f41-3452635d6fe2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 11:12:01.343039 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9172f71e-76dd-4e67-9116-40d5ae77e58e req-f786aa8e-c293-4864-883a-a0b49dcbd349 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047485 Aug 24 11:12:01.343856 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3303/6967] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:12:01.464026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-21a8ff56-cb88-49f0-9830-9bfef73bd47b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:01.464768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-21a8ff56-cb88-49f0-9830-9bfef73bd47b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:01.472103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21a8ff56-cb88-49f0-9830-9bfef73bd47b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:01.472577 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21a8ff56-cb88-49f0-9830-9bfef73bd47b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:01.473167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21a8ff56-cb88-49f0-9830-9bfef73bd47b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:01.473890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21a8ff56-cb88-49f0-9830-9bfef73bd47b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:01.474360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21a8ff56-cb88-49f0-9830-9bfef73bd47b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:01.474802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21a8ff56-cb88-49f0-9830-9bfef73bd47b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:01.612125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-21a8ff56-cb88-49f0-9830-9bfef73bd47b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:01.620853 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-21a8ff56-cb88-49f0-9830-9bfef73bd47b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1723 microversion: 2.1 time: 0.160761 Aug 24 11:12:01.621485 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3665/6968] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:01 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:02.642763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bbfb0a49-25ec-4b35-8ed7-42137f76ce3f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:02.643454 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bbfb0a49-25ec-4b35-8ed7-42137f76ce3f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:02.650561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbfb0a49-25ec-4b35-8ed7-42137f76ce3f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:02.651040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbfb0a49-25ec-4b35-8ed7-42137f76ce3f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:02.651678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbfb0a49-25ec-4b35-8ed7-42137f76ce3f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:02.653254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbfb0a49-25ec-4b35-8ed7-42137f76ce3f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:02.653254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbfb0a49-25ec-4b35-8ed7-42137f76ce3f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:02.653522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbfb0a49-25ec-4b35-8ed7-42137f76ce3f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:02.869318 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bbfb0a49-25ec-4b35-8ed7-42137f76ce3f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:02.882429 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bbfb0a49-25ec-4b35-8ed7-42137f76ce3f tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1723 microversion: 2.1 time: 0.244054 Aug 24 11:12:02.883520 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3304/6969] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:02 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:03.904041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c40d7a8a-18b2-4d63-b185-86002e8b915e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:03.904661 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c40d7a8a-18b2-4d63-b185-86002e8b915e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:03.912852 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c40d7a8a-18b2-4d63-b185-86002e8b915e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:03.913471 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c40d7a8a-18b2-4d63-b185-86002e8b915e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:03.913805 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c40d7a8a-18b2-4d63-b185-86002e8b915e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:03.914524 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c40d7a8a-18b2-4d63-b185-86002e8b915e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:03.914998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c40d7a8a-18b2-4d63-b185-86002e8b915e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:03.915438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c40d7a8a-18b2-4d63-b185-86002e8b915e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:04.060017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c40d7a8a-18b2-4d63-b185-86002e8b915e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:04.069378 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c40d7a8a-18b2-4d63-b185-86002e8b915e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1723 microversion: 2.1 time: 0.169277 Aug 24 11:12:04.069992 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3666/6970] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:03 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:05.091390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cb5d2fa3-3ed4-48df-bd36-6a1f314511d7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:05.091932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cb5d2fa3-3ed4-48df-bd36-6a1f314511d7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:05.099902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb5d2fa3-3ed4-48df-bd36-6a1f314511d7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:05.100394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb5d2fa3-3ed4-48df-bd36-6a1f314511d7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:05.100833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb5d2fa3-3ed4-48df-bd36-6a1f314511d7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:05.101599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb5d2fa3-3ed4-48df-bd36-6a1f314511d7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:05.102054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb5d2fa3-3ed4-48df-bd36-6a1f314511d7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:05.102476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb5d2fa3-3ed4-48df-bd36-6a1f314511d7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:05.240734 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cb5d2fa3-3ed4-48df-bd36-6a1f314511d7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:05.249785 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cb5d2fa3-3ed4-48df-bd36-6a1f314511d7 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1723 microversion: 2.1 time: 0.162516 Aug 24 11:12:05.250397 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3305/6971] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:05 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:06.270389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4e5d1a3d-6e69-47e2-a090-89d6cd62fff2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:06.270971 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4e5d1a3d-6e69-47e2-a090-89d6cd62fff2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:06.277908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e5d1a3d-6e69-47e2-a090-89d6cd62fff2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:06.278379 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e5d1a3d-6e69-47e2-a090-89d6cd62fff2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:06.278815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e5d1a3d-6e69-47e2-a090-89d6cd62fff2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:06.279518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e5d1a3d-6e69-47e2-a090-89d6cd62fff2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:06.279980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e5d1a3d-6e69-47e2-a090-89d6cd62fff2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:06.280415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e5d1a3d-6e69-47e2-a090-89d6cd62fff2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:06.418609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4e5d1a3d-6e69-47e2-a090-89d6cd62fff2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:06.427266 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4e5d1a3d-6e69-47e2-a090-89d6cd62fff2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1723 microversion: 2.1 time: 0.161169 Aug 24 11:12:06.427871 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3667/6972] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:06 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:07.450914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-26147a34-d0a0-4c11-b219-a2ccd10f0d9c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:07.451471 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-26147a34-d0a0-4c11-b219-a2ccd10f0d9c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:07.453464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:12:07.460319 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26147a34-d0a0-4c11-b219-a2ccd10f0d9c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:07.461188 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26147a34-d0a0-4c11-b219-a2ccd10f0d9c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:07.461792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26147a34-d0a0-4c11-b219-a2ccd10f0d9c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:07.462731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26147a34-d0a0-4c11-b219-a2ccd10f0d9c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:07.463334 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26147a34-d0a0-4c11-b219-a2ccd10f0d9c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:07.463927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26147a34-d0a0-4c11-b219-a2ccd10f0d9c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:07.609795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-26147a34-d0a0-4c11-b219-a2ccd10f0d9c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:07.620228 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-26147a34-d0a0-4c11-b219-a2ccd10f0d9c tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1723 microversion: 2.1 time: 0.173973 Aug 24 11:12:07.621017 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3306/6973] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:07 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:08.652003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1e639fcb-0399-4300-bf2f-79c957ebb5ab tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:08.653102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1e639fcb-0399-4300-bf2f-79c957ebb5ab tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:08.660862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e639fcb-0399-4300-bf2f-79c957ebb5ab tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:08.661405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e639fcb-0399-4300-bf2f-79c957ebb5ab tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:08.661859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e639fcb-0399-4300-bf2f-79c957ebb5ab tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:08.662583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e639fcb-0399-4300-bf2f-79c957ebb5ab tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:08.663063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e639fcb-0399-4300-bf2f-79c957ebb5ab tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:08.663511 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e639fcb-0399-4300-bf2f-79c957ebb5ab tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:08.808457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1e639fcb-0399-4300-bf2f-79c957ebb5ab tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:08.817402 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1e639fcb-0399-4300-bf2f-79c957ebb5ab tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1723 microversion: 2.1 time: 0.172110 Aug 24 11:12:08.818016 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3668/6974] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:08 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:09.841669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df7052b4-dd5b-46bb-9cb2-93f2799e7e27 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:09.842450 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-df7052b4-dd5b-46bb-9cb2-93f2799e7e27 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:09.852161 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df7052b4-dd5b-46bb-9cb2-93f2799e7e27 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:09.852810 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df7052b4-dd5b-46bb-9cb2-93f2799e7e27 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:09.853449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df7052b4-dd5b-46bb-9cb2-93f2799e7e27 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:09.854376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df7052b4-dd5b-46bb-9cb2-93f2799e7e27 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:09.854982 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df7052b4-dd5b-46bb-9cb2-93f2799e7e27 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:09.855548 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df7052b4-dd5b-46bb-9cb2-93f2799e7e27 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:10.005513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-df7052b4-dd5b-46bb-9cb2-93f2799e7e27 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:10.014259 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-df7052b4-dd5b-46bb-9cb2-93f2799e7e27 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1723 microversion: 2.1 time: 0.178144 Aug 24 11:12:10.014854 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3307/6975] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:09 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:11.038108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9af54f79-072a-475d-9a1c-72c76a8f73cc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:11.038945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9af54f79-072a-475d-9a1c-72c76a8f73cc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:11.048647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9af54f79-072a-475d-9a1c-72c76a8f73cc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:11.049347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9af54f79-072a-475d-9a1c-72c76a8f73cc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:11.049939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9af54f79-072a-475d-9a1c-72c76a8f73cc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:11.050857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9af54f79-072a-475d-9a1c-72c76a8f73cc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:11.051499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9af54f79-072a-475d-9a1c-72c76a8f73cc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:11.052053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9af54f79-072a-475d-9a1c-72c76a8f73cc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:11.195714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9af54f79-072a-475d-9a1c-72c76a8f73cc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:11.204670 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9af54f79-072a-475d-9a1c-72c76a8f73cc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1723 microversion: 2.1 time: 0.171852 Aug 24 11:12:11.205365 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3669/6976] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:11 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:12.226350 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4a1235a6-8635-46b4-86e4-c20edb5ba8e1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:12.226957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4a1235a6-8635-46b4-86e4-c20edb5ba8e1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:12.234827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a1235a6-8635-46b4-86e4-c20edb5ba8e1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:12.235331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a1235a6-8635-46b4-86e4-c20edb5ba8e1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:12.235761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a1235a6-8635-46b4-86e4-c20edb5ba8e1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:12.236471 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a1235a6-8635-46b4-86e4-c20edb5ba8e1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:12.236921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a1235a6-8635-46b4-86e4-c20edb5ba8e1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:12.237379 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a1235a6-8635-46b4-86e4-c20edb5ba8e1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:12.371504 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4a1235a6-8635-46b4-86e4-c20edb5ba8e1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:12.380098 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4a1235a6-8635-46b4-86e4-c20edb5ba8e1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1723 microversion: 2.1 time: 0.157781 Aug 24 11:12:12.380690 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3308/6977] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:12 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:13.404611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e896c15b-79e0-4530-96dc-1e948146605b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:13.405214 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e896c15b-79e0-4530-96dc-1e948146605b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:13.412607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e896c15b-79e0-4530-96dc-1e948146605b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:13.413107 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e896c15b-79e0-4530-96dc-1e948146605b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:13.413588 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e896c15b-79e0-4530-96dc-1e948146605b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:13.414294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e896c15b-79e0-4530-96dc-1e948146605b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:13.414756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e896c15b-79e0-4530-96dc-1e948146605b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:13.415188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e896c15b-79e0-4530-96dc-1e948146605b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:13.564591 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e896c15b-79e0-4530-96dc-1e948146605b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:13.573594 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e896c15b-79e0-4530-96dc-1e948146605b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1723 microversion: 2.1 time: 0.174589 Aug 24 11:12:13.574191 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3670/6978] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:13 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:14.597272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-29f7267f-db9a-463d-b721-4ddc2b5228bb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:14.597941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-29f7267f-db9a-463d-b721-4ddc2b5228bb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:14.607189 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29f7267f-db9a-463d-b721-4ddc2b5228bb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:14.607814 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29f7267f-db9a-463d-b721-4ddc2b5228bb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:14.608418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29f7267f-db9a-463d-b721-4ddc2b5228bb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:14.609653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29f7267f-db9a-463d-b721-4ddc2b5228bb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:14.610270 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29f7267f-db9a-463d-b721-4ddc2b5228bb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:14.610809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29f7267f-db9a-463d-b721-4ddc2b5228bb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:14.758549 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-29f7267f-db9a-463d-b721-4ddc2b5228bb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:14.767427 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-29f7267f-db9a-463d-b721-4ddc2b5228bb tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1716 microversion: 2.1 time: 0.175481 Aug 24 11:12:14.768013 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3309/6979] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:14 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1716 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:14.787873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b54c3dcb-d5fd-4c78-b48e-efa55477f1c3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:14.788498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b54c3dcb-d5fd-4c78-b48e-efa55477f1c3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:14.795834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b54c3dcb-d5fd-4c78-b48e-efa55477f1c3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:14.796336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b54c3dcb-d5fd-4c78-b48e-efa55477f1c3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:14.796816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b54c3dcb-d5fd-4c78-b48e-efa55477f1c3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:14.797543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b54c3dcb-d5fd-4c78-b48e-efa55477f1c3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:14.798006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b54c3dcb-d5fd-4c78-b48e-efa55477f1c3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:14.798445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b54c3dcb-d5fd-4c78-b48e-efa55477f1c3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:14.935905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b54c3dcb-d5fd-4c78-b48e-efa55477f1c3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:14.944916 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b54c3dcb-d5fd-4c78-b48e-efa55477f1c3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1716 microversion: 2.1 time: 0.161043 Aug 24 11:12:14.945561 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3671/6980] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:14 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1716 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:14.968011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-61b48d9c-94fc-4fbb-a942-d30d791ff6e3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:14.968631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-61b48d9c-94fc-4fbb-a942-d30d791ff6e3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:14.975101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61b48d9c-94fc-4fbb-a942-d30d791ff6e3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:14.975623 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61b48d9c-94fc-4fbb-a942-d30d791ff6e3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:14.976055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61b48d9c-94fc-4fbb-a942-d30d791ff6e3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:14.976747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61b48d9c-94fc-4fbb-a942-d30d791ff6e3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:14.977238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61b48d9c-94fc-4fbb-a942-d30d791ff6e3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:14.977664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61b48d9c-94fc-4fbb-a942-d30d791ff6e3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:15.114692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-61b48d9c-94fc-4fbb-a942-d30d791ff6e3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:15.127611 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-61b48d9c-94fc-4fbb-a942-d30d791ff6e3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1716 microversion: 2.1 time: 0.163344 Aug 24 11:12:15.128410 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3310/6981] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:14 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1716 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:15.151530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-769f1b45-2e45-48fb-a9da-48ef616f71fc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:15.152053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-769f1b45-2e45-48fb-a9da-48ef616f71fc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:15.158587 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-769f1b45-2e45-48fb-a9da-48ef616f71fc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:15.159093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-769f1b45-2e45-48fb-a9da-48ef616f71fc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:15.159544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-769f1b45-2e45-48fb-a9da-48ef616f71fc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:15.160253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-769f1b45-2e45-48fb-a9da-48ef616f71fc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:15.160782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-769f1b45-2e45-48fb-a9da-48ef616f71fc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:15.161321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-769f1b45-2e45-48fb-a9da-48ef616f71fc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:15.187411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-769f1b45-2e45-48fb-a9da-48ef616f71fc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:12:15.275662 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-769f1b45-2e45-48fb-a9da-48ef616f71fc tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "DELETE /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 204 len: 0 microversion: 2.1 time: 0.127949 Aug 24 11:12:15.276316 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3672/6982] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:12:15 2022] DELETE /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:12:15.285171 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-85443e6a-caac-4cfe-a404-2e018c18327b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:15.285820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-85443e6a-caac-4cfe-a404-2e018c18327b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:15.292069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85443e6a-caac-4cfe-a404-2e018c18327b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:15.292660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85443e6a-caac-4cfe-a404-2e018c18327b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:15.293201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85443e6a-caac-4cfe-a404-2e018c18327b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:15.293947 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85443e6a-caac-4cfe-a404-2e018c18327b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:15.294430 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85443e6a-caac-4cfe-a404-2e018c18327b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:15.294859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85443e6a-caac-4cfe-a404-2e018c18327b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:15.431185 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-85443e6a-caac-4cfe-a404-2e018c18327b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:15.433529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:12:15.441851 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-85443e6a-caac-4cfe-a404-2e018c18327b tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1722 microversion: 2.1 time: 0.160617 Aug 24 11:12:15.442448 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3311/6983] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:15 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:16.464983 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-29d227f3-6fb7-4d96-94f7-c3a1560c62a6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:16.465800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-29d227f3-6fb7-4d96-94f7-c3a1560c62a6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:16.473867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29d227f3-6fb7-4d96-94f7-c3a1560c62a6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:16.474381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29d227f3-6fb7-4d96-94f7-c3a1560c62a6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:16.474831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29d227f3-6fb7-4d96-94f7-c3a1560c62a6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:16.475609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29d227f3-6fb7-4d96-94f7-c3a1560c62a6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:16.476022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29d227f3-6fb7-4d96-94f7-c3a1560c62a6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:16.476462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29d227f3-6fb7-4d96-94f7-c3a1560c62a6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:16.620429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-29d227f3-6fb7-4d96-94f7-c3a1560c62a6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:16.629469 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-29d227f3-6fb7-4d96-94f7-c3a1560c62a6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1722 microversion: 2.1 time: 0.169632 Aug 24 11:12:16.630055 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3673/6984] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:16 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:17.650722 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2f88faab-0bc8-430c-b79c-e187ada044d1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:17.651979 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2f88faab-0bc8-430c-b79c-e187ada044d1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:17.660155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f88faab-0bc8-430c-b79c-e187ada044d1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:17.661063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f88faab-0bc8-430c-b79c-e187ada044d1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:17.661761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f88faab-0bc8-430c-b79c-e187ada044d1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:17.662487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f88faab-0bc8-430c-b79c-e187ada044d1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:17.662935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f88faab-0bc8-430c-b79c-e187ada044d1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:17.663361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f88faab-0bc8-430c-b79c-e187ada044d1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:17.735457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2f88faab-0bc8-430c-b79c-e187ada044d1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:17.745579 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2f88faab-0bc8-430c-b79c-e187ada044d1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1655 microversion: 2.1 time: 0.098571 Aug 24 11:12:17.756367 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3312/6985] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:17 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1655 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:17.910289 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-fbd89115-b2d5-486b-b572-9ed3cff22150 req-069b549f-8afc-4aa0-a35c-0dfe7917113d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfa6c7be-5543-480f-8f41-3452635d6fe2", "name": "network-vif-deleted", "tag": "53255380-02e7-4af7-a6e9-b224c7e4892b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:12:17.922269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fbd89115-b2d5-486b-b572-9ed3cff22150 req-069b549f-8afc-4aa0-a35c-0dfe7917113d service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:17.922810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fbd89115-b2d5-486b-b572-9ed3cff22150 req-069b549f-8afc-4aa0-a35c-0dfe7917113d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:17.923257 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fbd89115-b2d5-486b-b572-9ed3cff22150 req-069b549f-8afc-4aa0-a35c-0dfe7917113d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:17.927477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:12:17.936809 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-fbd89115-b2d5-486b-b572-9ed3cff22150 req-069b549f-8afc-4aa0-a35c-0dfe7917113d service nova] Creating event network-vif-deleted:53255380-02e7-4af7-a6e9-b224c7e4892b for instance bfa6c7be-5543-480f-8f41-3452635d6fe2 on n-h1-849328-3 Aug 24 11:12:17.942798 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-fbd89115-b2d5-486b-b572-9ed3cff22150 req-069b549f-8afc-4aa0-a35c-0dfe7917113d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036191 Aug 24 11:12:17.943428 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3674/6986] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:12:18.767572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e0648940-3553-47a7-993d-c0b74fb939d9 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:18.769995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e0648940-3553-47a7-993d-c0b74fb939d9 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:18.778558 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0648940-3553-47a7-993d-c0b74fb939d9 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:18.779149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0648940-3553-47a7-993d-c0b74fb939d9 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:18.779588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0648940-3553-47a7-993d-c0b74fb939d9 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:18.780750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0648940-3553-47a7-993d-c0b74fb939d9 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:18.781244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0648940-3553-47a7-993d-c0b74fb939d9 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:18.781669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0648940-3553-47a7-993d-c0b74fb939d9 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:18.849769 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e0648940-3553-47a7-993d-c0b74fb939d9 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:18.859018 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e0648940-3553-47a7-993d-c0b74fb939d9 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1370 microversion: 2.1 time: 0.095247 Aug 24 11:12:18.859621 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3313/6987] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:18 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1370 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:19.882371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1dfe8bde-0b40-4a4e-ae48-41eebfce1862 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:19.882990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1dfe8bde-0b40-4a4e-ae48-41eebfce1862 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:19.890148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dfe8bde-0b40-4a4e-ae48-41eebfce1862 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:19.890650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dfe8bde-0b40-4a4e-ae48-41eebfce1862 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:19.891106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dfe8bde-0b40-4a4e-ae48-41eebfce1862 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:19.891822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dfe8bde-0b40-4a4e-ae48-41eebfce1862 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:19.892297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dfe8bde-0b40-4a4e-ae48-41eebfce1862 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:19.892738 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dfe8bde-0b40-4a4e-ae48-41eebfce1862 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:19.961576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1dfe8bde-0b40-4a4e-ae48-41eebfce1862 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:19.970765 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1dfe8bde-0b40-4a4e-ae48-41eebfce1862 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1370 microversion: 2.1 time: 0.094185 Aug 24 11:12:19.971361 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3675/6988] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:19 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1370 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:20.992273 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b19caf14-7ffa-4811-b72f-26425c0d59e3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:20.992887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b19caf14-7ffa-4811-b72f-26425c0d59e3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:21.000435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b19caf14-7ffa-4811-b72f-26425c0d59e3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:21.000930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b19caf14-7ffa-4811-b72f-26425c0d59e3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:21.001406 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b19caf14-7ffa-4811-b72f-26425c0d59e3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:21.002111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b19caf14-7ffa-4811-b72f-26425c0d59e3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:21.002568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b19caf14-7ffa-4811-b72f-26425c0d59e3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:21.002997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b19caf14-7ffa-4811-b72f-26425c0d59e3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:21.070918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b19caf14-7ffa-4811-b72f-26425c0d59e3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:21.079927 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b19caf14-7ffa-4811-b72f-26425c0d59e3 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1370 microversion: 2.1 time: 0.091632 Aug 24 11:12:21.080509 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3314/6989] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:20 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1370 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:22.101282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3f8b6c0-1042-4441-b216-b2616989def1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:22.101943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d3f8b6c0-1042-4441-b216-b2616989def1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:22.106120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:12:22.110426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3f8b6c0-1042-4441-b216-b2616989def1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:22.111030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3f8b6c0-1042-4441-b216-b2616989def1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:22.111644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3f8b6c0-1042-4441-b216-b2616989def1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:22.112360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3f8b6c0-1042-4441-b216-b2616989def1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:22.112834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3f8b6c0-1042-4441-b216-b2616989def1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:22.113301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3f8b6c0-1042-4441-b216-b2616989def1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:22.150181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3f8b6c0-1042-4441-b216-b2616989def1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:22.150649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3f8b6c0-1042-4441-b216-b2616989def1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:22.151092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3f8b6c0-1042-4441-b216-b2616989def1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:22.151553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-d3f8b6c0-1042-4441-b216-b2616989def1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lazy-loading 'fault' on Instance uuid bfa6c7be-5543-480f-8f41-3452635d6fe2 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:12:22.197885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d3f8b6c0-1042-4441-b216-b2616989def1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1864aed01d473ea51ec9de243ddfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a617355a8b94576bf4edcf58a078a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:22.206535 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d3f8b6c0-1042-4441-b216-b2616989def1 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 200 len: 1375 microversion: 2.1 time: 0.109568 Aug 24 11:12:22.207135 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3676/6990] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:22 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 1375 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:23.232917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cf8075a1-b0af-4b27-be53-970961e9bb8d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:23.233698 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cf8075a1-b0af-4b27-be53-970961e9bb8d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:23.239796 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:12:23.246223 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf8075a1-b0af-4b27-be53-970961e9bb8d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:23.246697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf8075a1-b0af-4b27-be53-970961e9bb8d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:23.247129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf8075a1-b0af-4b27-be53-970961e9bb8d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:23.247825 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf8075a1-b0af-4b27-be53-970961e9bb8d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:23.248272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf8075a1-b0af-4b27-be53-970961e9bb8d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:23.248698 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf8075a1-b0af-4b27-be53-970961e9bb8d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:23.263906 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-cf8075a1-b0af-4b27-be53-970961e9bb8d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] HTTP exception thrown: Instance bfa6c7be-5543-480f-8f41-3452635d6fe2 could not be found. Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cf8075a1-b0af-4b27-be53-970961e9bb8d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Request method failure captured: Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 HTTP/1.1 Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgYz1BeplfuXTHJkOfHIc4HHvWpgmtACVIDqhl2KznLucjDfZdsOv1oOnIJj7M5GsHbWVqHtaPFjE7I8aaNF99wTlcW31oPZk8MPZn4ZadZqVCq5-FgBuGU54DnrikOmEdTLzwsqELSN-iClqJCMIFBnVqLgAZU8nGnLFDU8lQ5UBJs Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9a617355a8b94576bf4edcf58a078a8e", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9a617355a8b94576bf4edcf58a078a8e"}]}] Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 4a1864aed01d473ea51ec9de243ddfa4 Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance bfa6c7be-5543-480f-8f41-3452635d6fe2 could not be found. Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'bfa6c7be-5543-480f-8f41-3452635d6fe2'} Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfa6c7be-5543-480f-8f41-3452635d6fe2 could not be found. Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfa6c7be-5543-480f-8f41-3452635d6fe2 could not be found. Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:12:23.265798 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:12:23.269639 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:23.269639 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:12:23.269639 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:12:23.269639 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:12:23.269639 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:12:23.269639 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfa6c7be-5543-480f-8f41-3452635d6fe2 could not be found. Aug 24 11:12:23.269639 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:12:23.269639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cf8075a1-b0af-4b27-be53-970961e9bb8d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Returning 404 to user: Instance bfa6c7be-5543-480f-8f41-3452635d6fe2 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:12:23.269639 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cf8075a1-b0af-4b27-be53-970961e9bb8d tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 404 len: 111 microversion: 2.1 time: 0.040446 Aug 24 11:12:23.269639 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3315/6991] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:23 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:12:23.339832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d161da12-2dd5-4eac-8eaa-bb1b91e83d9a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:23.342217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d161da12-2dd5-4eac-8eaa-bb1b91e83d9a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:23.349559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d161da12-2dd5-4eac-8eaa-bb1b91e83d9a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:23.350067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d161da12-2dd5-4eac-8eaa-bb1b91e83d9a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:23.350529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d161da12-2dd5-4eac-8eaa-bb1b91e83d9a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:23.351245 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d161da12-2dd5-4eac-8eaa-bb1b91e83d9a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:23.351721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d161da12-2dd5-4eac-8eaa-bb1b91e83d9a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:23.352164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d161da12-2dd5-4eac-8eaa-bb1b91e83d9a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:23.365768 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-d161da12-2dd5-4eac-8eaa-bb1b91e83d9a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] HTTP exception thrown: Instance bfa6c7be-5543-480f-8f41-3452635d6fe2 could not be found. Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d161da12-2dd5-4eac-8eaa-bb1b91e83d9a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Request method failure captured: Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2/os-volume_attachments HTTP/1.1 Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgYz1BeplfuXTHJkOfHIc4HHvWpgmtACVIDqhl2KznLucjDfZdsOv1oOnIJj7M5GsHbWVqHtaPFjE7I8aaNF99wTlcW31oPZk8MPZn4ZadZqVCq5-FgBuGU54DnrikOmEdTLzwsqELSN-iClqJCMIFBnVqLgAZU8nGnLFDU8lQ5UBJs Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9a617355a8b94576bf4edcf58a078a8e", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9a617355a8b94576bf4edcf58a078a8e"}]}] Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 4a1864aed01d473ea51ec9de243ddfa4 Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance bfa6c7be-5543-480f-8f41-3452635d6fe2 could not be found. Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'server_id': 'bfa6c7be-5543-480f-8f41-3452635d6fe2'} Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfa6c7be-5543-480f-8f41-3452635d6fe2 could not be found. Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:12:23.367486 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:12:23.371371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfa6c7be-5543-480f-8f41-3452635d6fe2 could not be found. Aug 24 11:12:23.371371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:12:23.371371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:12:23.371371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:12:23.371371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:23.371371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:12:23.371371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:12:23.371371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:12:23.371371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:12:23.371371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfa6c7be-5543-480f-8f41-3452635d6fe2 could not be found. Aug 24 11:12:23.371371 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:12:23.371371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d161da12-2dd5-4eac-8eaa-bb1b91e83d9a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Returning 404 to user: Instance bfa6c7be-5543-480f-8f41-3452635d6fe2 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:12:23.371371 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d161da12-2dd5-4eac-8eaa-bb1b91e83d9a tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033388 Aug 24 11:12:23.371371 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3677/6992] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:12:23 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:12:26.703390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d6d17acb-b130-4432-a46a-915685f67cda tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:26.703907 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d6d17acb-b130-4432-a46a-915685f67cda tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:26.711046 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6d17acb-b130-4432-a46a-915685f67cda tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:26.711526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6d17acb-b130-4432-a46a-915685f67cda tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:26.711960 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6d17acb-b130-4432-a46a-915685f67cda tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:26.712642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6d17acb-b130-4432-a46a-915685f67cda tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:26.713098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6d17acb-b130-4432-a46a-915685f67cda tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:26.713548 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6d17acb-b130-4432-a46a-915685f67cda tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:26.727471 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-d6d17acb-b130-4432-a46a-915685f67cda tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] HTTP exception thrown: Instance bfa6c7be-5543-480f-8f41-3452635d6fe2 could not be found. Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d6d17acb-b130-4432-a46a-915685f67cda tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Request method failure captured: Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 HTTP/1.1 Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgYz1BeplfuXTHJkOfHIc4HHvWpgmtACVIDqhl2KznLucjDfZdsOv1oOnIJj7M5GsHbWVqHtaPFjE7I8aaNF99wTlcW31oPZk8MPZn4ZadZqVCq5-FgBuGU54DnrikOmEdTLzwsqELSN-iClqJCMIFBnVqLgAZU8nGnLFDU8lQ5UBJs Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9a617355a8b94576bf4edcf58a078a8e", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9a617355a8b94576bf4edcf58a078a8e"}]}] Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 4a1864aed01d473ea51ec9de243ddfa4 Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance bfa6c7be-5543-480f-8f41-3452635d6fe2 could not be found. Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'bfa6c7be-5543-480f-8f41-3452635d6fe2'} Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfa6c7be-5543-480f-8f41-3452635d6fe2 could not be found. Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:12:26.729033 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:12:26.732528 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfa6c7be-5543-480f-8f41-3452635d6fe2 could not be found. Aug 24 11:12:26.732528 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.732528 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:12:26.732528 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.732528 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:26.732528 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:12:26.732528 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:12:26.732528 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:12:26.732528 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:12:26.732528 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfa6c7be-5543-480f-8f41-3452635d6fe2 could not be found. Aug 24 11:12:26.732528 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.732528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d6d17acb-b130-4432-a46a-915685f67cda tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Returning 404 to user: Instance bfa6c7be-5543-480f-8f41-3452635d6fe2 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:12:26.732528 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d6d17acb-b130-4432-a46a-915685f67cda tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "DELETE /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 404 len: 111 microversion: 2.1 time: 0.031103 Aug 24 11:12:26.732528 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3316/6993] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:12:26 2022] DELETE /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:12:26.739695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5f4e20ad-57f1-4f64-a33d-d9b4c685db31 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:26.740452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5f4e20ad-57f1-4f64-a33d-d9b4c685db31 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: bfa6c7be-5543-480f-8f41-3452635d6fe2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:26.747927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f4e20ad-57f1-4f64-a33d-d9b4c685db31 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:26.748429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f4e20ad-57f1-4f64-a33d-d9b4c685db31 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:26.748885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f4e20ad-57f1-4f64-a33d-d9b4c685db31 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:26.749629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f4e20ad-57f1-4f64-a33d-d9b4c685db31 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:26.750073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f4e20ad-57f1-4f64-a33d-d9b4c685db31 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:26.750518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f4e20ad-57f1-4f64-a33d-d9b4c685db31 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:26.764597 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-5f4e20ad-57f1-4f64-a33d-d9b4c685db31 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] HTTP exception thrown: Instance bfa6c7be-5543-480f-8f41-3452635d6fe2 could not be found. Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5f4e20ad-57f1-4f64-a33d-d9b4c685db31 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Request method failure captured: Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 HTTP/1.1 Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgYz1BeplfuXTHJkOfHIc4HHvWpgmtACVIDqhl2KznLucjDfZdsOv1oOnIJj7M5GsHbWVqHtaPFjE7I8aaNF99wTlcW31oPZk8MPZn4ZadZqVCq5-FgBuGU54DnrikOmEdTLzwsqELSN-iClqJCMIFBnVqLgAZU8nGnLFDU8lQ5UBJs Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9a617355a8b94576bf4edcf58a078a8e", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9a617355a8b94576bf4edcf58a078a8e"}]}] Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 4a1864aed01d473ea51ec9de243ddfa4 Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance bfa6c7be-5543-480f-8f41-3452635d6fe2 could not be found. Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'bfa6c7be-5543-480f-8f41-3452635d6fe2'} Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfa6c7be-5543-480f-8f41-3452635d6fe2 could not be found. Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfa6c7be-5543-480f-8f41-3452635d6fe2 could not be found. Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:12:26.766124 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.770240 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:26.770240 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:12:26.770240 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:12:26.770240 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:12:26.770240 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:12:26.770240 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfa6c7be-5543-480f-8f41-3452635d6fe2 could not be found. Aug 24 11:12:26.770240 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.770240 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5f4e20ad-57f1-4f64-a33d-d9b4c685db31 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Returning 404 to user: Instance bfa6c7be-5543-480f-8f41-3452635d6fe2 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:12:26.770240 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5f4e20ad-57f1-4f64-a33d-d9b4c685db31 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2" status: 404 len: 111 microversion: 2.1 time: 0.031802 Aug 24 11:12:26.770240 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3678/6994] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:26 2022] GET /compute/v2.1/servers/bfa6c7be-5543-480f-8f41-3452635d6fe2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:12:26.776354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7898ef93-449b-4a84-a55f-3098c3c61ee2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:26.776885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7898ef93-449b-4a84-a55f-3098c3c61ee2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:26.783517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7898ef93-449b-4a84-a55f-3098c3c61ee2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:26.784024 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7898ef93-449b-4a84-a55f-3098c3c61ee2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:26.784463 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7898ef93-449b-4a84-a55f-3098c3c61ee2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:26.785278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7898ef93-449b-4a84-a55f-3098c3c61ee2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:26.785757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7898ef93-449b-4a84-a55f-3098c3c61ee2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:26.786167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7898ef93-449b-4a84-a55f-3098c3c61ee2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:26.801720 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-7898ef93-449b-4a84-a55f-3098c3c61ee2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] HTTP exception thrown: Instance 21016f2b-85d1-41ee-965a-e983abadfc51 could not be found. Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7898ef93-449b-4a84-a55f-3098c3c61ee2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Request method failure captured: Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 HTTP/1.1 Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgYz1BeplfuXTHJkOfHIc4HHvWpgmtACVIDqhl2KznLucjDfZdsOv1oOnIJj7M5GsHbWVqHtaPFjE7I8aaNF99wTlcW31oPZk8MPZn4ZadZqVCq5-FgBuGU54DnrikOmEdTLzwsqELSN-iClqJCMIFBnVqLgAZU8nGnLFDU8lQ5UBJs Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9a617355a8b94576bf4edcf58a078a8e", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9a617355a8b94576bf4edcf58a078a8e"}]}] Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 4a1864aed01d473ea51ec9de243ddfa4 Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 21016f2b-85d1-41ee-965a-e983abadfc51 could not be found. Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '21016f2b-85d1-41ee-965a-e983abadfc51'} Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21016f2b-85d1-41ee-965a-e983abadfc51 could not be found. Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:12:26.803313 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:12:26.807399 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21016f2b-85d1-41ee-965a-e983abadfc51 could not be found. Aug 24 11:12:26.807399 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.807399 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:12:26.807399 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.807399 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:26.807399 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:12:26.807399 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:12:26.807399 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:12:26.807399 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:12:26.807399 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21016f2b-85d1-41ee-965a-e983abadfc51 could not be found. Aug 24 11:12:26.807399 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.807399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7898ef93-449b-4a84-a55f-3098c3c61ee2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Returning 404 to user: Instance 21016f2b-85d1-41ee-965a-e983abadfc51 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:12:26.807399 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7898ef93-449b-4a84-a55f-3098c3c61ee2 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "DELETE /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 404 len: 111 microversion: 2.1 time: 0.032418 Aug 24 11:12:26.807399 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3317/6995] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:12:26 2022] DELETE /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:12:26.814092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9350bcc3-01f0-4181-bd3f-230b356ce779 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:26.814727 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9350bcc3-01f0-4181-bd3f-230b356ce779 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 21016f2b-85d1-41ee-965a-e983abadfc51] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:26.822006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9350bcc3-01f0-4181-bd3f-230b356ce779 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:26.822683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9350bcc3-01f0-4181-bd3f-230b356ce779 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:26.823158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9350bcc3-01f0-4181-bd3f-230b356ce779 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:26.823984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9350bcc3-01f0-4181-bd3f-230b356ce779 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:26.824499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9350bcc3-01f0-4181-bd3f-230b356ce779 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:26.824959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9350bcc3-01f0-4181-bd3f-230b356ce779 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:26.840722 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-9350bcc3-01f0-4181-bd3f-230b356ce779 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] HTTP exception thrown: Instance 21016f2b-85d1-41ee-965a-e983abadfc51 could not be found. Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9350bcc3-01f0-4181-bd3f-230b356ce779 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Request method failure captured: Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 HTTP/1.1 Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgYz1BeplfuXTHJkOfHIc4HHvWpgmtACVIDqhl2KznLucjDfZdsOv1oOnIJj7M5GsHbWVqHtaPFjE7I8aaNF99wTlcW31oPZk8MPZn4ZadZqVCq5-FgBuGU54DnrikOmEdTLzwsqELSN-iClqJCMIFBnVqLgAZU8nGnLFDU8lQ5UBJs Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9a617355a8b94576bf4edcf58a078a8e", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9a617355a8b94576bf4edcf58a078a8e"}]}] Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 4a1864aed01d473ea51ec9de243ddfa4 Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 21016f2b-85d1-41ee-965a-e983abadfc51 could not be found. Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '21016f2b-85d1-41ee-965a-e983abadfc51'} Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21016f2b-85d1-41ee-965a-e983abadfc51 could not be found. Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21016f2b-85d1-41ee-965a-e983abadfc51 could not be found. Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:12:26.842403 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.846429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:26.846429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:12:26.846429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:12:26.846429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:12:26.846429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:12:26.846429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21016f2b-85d1-41ee-965a-e983abadfc51 could not be found. Aug 24 11:12:26.846429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.846429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9350bcc3-01f0-4181-bd3f-230b356ce779 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Returning 404 to user: Instance 21016f2b-85d1-41ee-965a-e983abadfc51 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:12:26.846429 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9350bcc3-01f0-4181-bd3f-230b356ce779 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51" status: 404 len: 111 microversion: 2.1 time: 0.033862 Aug 24 11:12:26.846429 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3679/6996] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:26 2022] GET /compute/v2.1/servers/21016f2b-85d1-41ee-965a-e983abadfc51 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:12:26.852879 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fa13c811-4d0d-4e0c-b5d9-040e9a3b86ba tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:26.853461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fa13c811-4d0d-4e0c-b5d9-040e9a3b86ba tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:26.860118 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa13c811-4d0d-4e0c-b5d9-040e9a3b86ba tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:26.860609 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa13c811-4d0d-4e0c-b5d9-040e9a3b86ba tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:26.861044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa13c811-4d0d-4e0c-b5d9-040e9a3b86ba tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:26.861772 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa13c811-4d0d-4e0c-b5d9-040e9a3b86ba tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:26.862225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa13c811-4d0d-4e0c-b5d9-040e9a3b86ba tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:26.862652 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa13c811-4d0d-4e0c-b5d9-040e9a3b86ba tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:26.879103 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-fa13c811-4d0d-4e0c-b5d9-040e9a3b86ba tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] HTTP exception thrown: Instance eed0602b-69ae-45fb-bce8-571f94493a4f could not be found. Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fa13c811-4d0d-4e0c-b5d9-040e9a3b86ba tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Request method failure captured: Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f HTTP/1.1 Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgYz1BeplfuXTHJkOfHIc4HHvWpgmtACVIDqhl2KznLucjDfZdsOv1oOnIJj7M5GsHbWVqHtaPFjE7I8aaNF99wTlcW31oPZk8MPZn4ZadZqVCq5-FgBuGU54DnrikOmEdTLzwsqELSN-iClqJCMIFBnVqLgAZU8nGnLFDU8lQ5UBJs Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9a617355a8b94576bf4edcf58a078a8e", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9a617355a8b94576bf4edcf58a078a8e"}]}] Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 4a1864aed01d473ea51ec9de243ddfa4 Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance eed0602b-69ae-45fb-bce8-571f94493a4f could not be found. Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'eed0602b-69ae-45fb-bce8-571f94493a4f'} Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eed0602b-69ae-45fb-bce8-571f94493a4f could not be found. Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:12:26.880706 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:12:26.885137 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eed0602b-69ae-45fb-bce8-571f94493a4f could not be found. Aug 24 11:12:26.885137 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.885137 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:12:26.885137 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.885137 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:26.885137 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:12:26.885137 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:12:26.885137 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:12:26.885137 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:12:26.885137 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eed0602b-69ae-45fb-bce8-571f94493a4f could not be found. Aug 24 11:12:26.885137 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.885137 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fa13c811-4d0d-4e0c-b5d9-040e9a3b86ba tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Returning 404 to user: Instance eed0602b-69ae-45fb-bce8-571f94493a4f could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:12:26.885137 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fa13c811-4d0d-4e0c-b5d9-040e9a3b86ba tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "DELETE /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 404 len: 111 microversion: 2.1 time: 0.033778 Aug 24 11:12:26.885137 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3318/6997] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:12:26 2022] DELETE /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:12:26.891571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7995a9f6-f1eb-4d66-b16e-d2594b2e9f0e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:26.892196 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7995a9f6-f1eb-4d66-b16e-d2594b2e9f0e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: eed0602b-69ae-45fb-bce8-571f94493a4f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:26.898193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7995a9f6-f1eb-4d66-b16e-d2594b2e9f0e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:26.898685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7995a9f6-f1eb-4d66-b16e-d2594b2e9f0e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:26.899132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7995a9f6-f1eb-4d66-b16e-d2594b2e9f0e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:26.899847 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7995a9f6-f1eb-4d66-b16e-d2594b2e9f0e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:26.900310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7995a9f6-f1eb-4d66-b16e-d2594b2e9f0e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:26.900745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7995a9f6-f1eb-4d66-b16e-d2594b2e9f0e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:26.914535 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-7995a9f6-f1eb-4d66-b16e-d2594b2e9f0e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] HTTP exception thrown: Instance eed0602b-69ae-45fb-bce8-571f94493a4f could not be found. Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7995a9f6-f1eb-4d66-b16e-d2594b2e9f0e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Request method failure captured: Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f HTTP/1.1 Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgYz1BeplfuXTHJkOfHIc4HHvWpgmtACVIDqhl2KznLucjDfZdsOv1oOnIJj7M5GsHbWVqHtaPFjE7I8aaNF99wTlcW31oPZk8MPZn4ZadZqVCq5-FgBuGU54DnrikOmEdTLzwsqELSN-iClqJCMIFBnVqLgAZU8nGnLFDU8lQ5UBJs Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9a617355a8b94576bf4edcf58a078a8e", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9a617355a8b94576bf4edcf58a078a8e"}]}] Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 4a1864aed01d473ea51ec9de243ddfa4 Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance eed0602b-69ae-45fb-bce8-571f94493a4f could not be found. Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'eed0602b-69ae-45fb-bce8-571f94493a4f'} Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eed0602b-69ae-45fb-bce8-571f94493a4f could not be found. Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eed0602b-69ae-45fb-bce8-571f94493a4f could not be found. Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:12:26.916088 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.920004 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:26.920004 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:12:26.920004 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:12:26.920004 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:12:26.920004 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:12:26.920004 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eed0602b-69ae-45fb-bce8-571f94493a4f could not be found. Aug 24 11:12:26.920004 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.920004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7995a9f6-f1eb-4d66-b16e-d2594b2e9f0e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Returning 404 to user: Instance eed0602b-69ae-45fb-bce8-571f94493a4f could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:12:26.920004 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7995a9f6-f1eb-4d66-b16e-d2594b2e9f0e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f" status: 404 len: 111 microversion: 2.1 time: 0.029932 Aug 24 11:12:26.920004 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3680/6998] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:26 2022] GET /compute/v2.1/servers/eed0602b-69ae-45fb-bce8-571f94493a4f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:12:26.926206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-27c948ad-b7a3-48dc-80d0-c03d77312168 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:26.926702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-27c948ad-b7a3-48dc-80d0-c03d77312168 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:26.932835 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27c948ad-b7a3-48dc-80d0-c03d77312168 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:26.933367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27c948ad-b7a3-48dc-80d0-c03d77312168 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:26.933862 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27c948ad-b7a3-48dc-80d0-c03d77312168 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:26.934552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27c948ad-b7a3-48dc-80d0-c03d77312168 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:26.935007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27c948ad-b7a3-48dc-80d0-c03d77312168 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:26.935482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27c948ad-b7a3-48dc-80d0-c03d77312168 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:26.949529 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-27c948ad-b7a3-48dc-80d0-c03d77312168 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] HTTP exception thrown: Instance 009add20-7850-405d-b93b-f33c860242eb could not be found. Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-27c948ad-b7a3-48dc-80d0-c03d77312168 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Request method failure captured: Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb HTTP/1.1 Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgYz1BeplfuXTHJkOfHIc4HHvWpgmtACVIDqhl2KznLucjDfZdsOv1oOnIJj7M5GsHbWVqHtaPFjE7I8aaNF99wTlcW31oPZk8MPZn4ZadZqVCq5-FgBuGU54DnrikOmEdTLzwsqELSN-iClqJCMIFBnVqLgAZU8nGnLFDU8lQ5UBJs Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9a617355a8b94576bf4edcf58a078a8e", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9a617355a8b94576bf4edcf58a078a8e"}]}] Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 4a1864aed01d473ea51ec9de243ddfa4 Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 009add20-7850-405d-b93b-f33c860242eb could not be found. Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '009add20-7850-405d-b93b-f33c860242eb'} Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 009add20-7850-405d-b93b-f33c860242eb could not be found. Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:12:26.951132 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:12:26.954869 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 009add20-7850-405d-b93b-f33c860242eb could not be found. Aug 24 11:12:26.954869 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.954869 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:12:26.954869 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.954869 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:26.954869 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:12:26.954869 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:12:26.954869 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:12:26.954869 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:12:26.954869 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 009add20-7850-405d-b93b-f33c860242eb could not be found. Aug 24 11:12:26.954869 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.954869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-27c948ad-b7a3-48dc-80d0-c03d77312168 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Returning 404 to user: Instance 009add20-7850-405d-b93b-f33c860242eb could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:12:26.954869 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-27c948ad-b7a3-48dc-80d0-c03d77312168 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "DELETE /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 404 len: 111 microversion: 2.1 time: 0.030297 Aug 24 11:12:26.954869 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3319/6999] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:12:26 2022] DELETE /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 11:12:26.961335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1c7c0830-5670-4d18-a3a7-efe4d073685e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:26.961964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1c7c0830-5670-4d18-a3a7-efe4d073685e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] [instance: 009add20-7850-405d-b93b-f33c860242eb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:26.968077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c7c0830-5670-4d18-a3a7-efe4d073685e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:26.968568 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c7c0830-5670-4d18-a3a7-efe4d073685e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:26.969016 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c7c0830-5670-4d18-a3a7-efe4d073685e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:26.969737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c7c0830-5670-4d18-a3a7-efe4d073685e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:26.970205 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c7c0830-5670-4d18-a3a7-efe4d073685e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:26.970676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c7c0830-5670-4d18-a3a7-efe4d073685e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:26.984845 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-1c7c0830-5670-4d18-a3a7-efe4d073685e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] HTTP exception thrown: Instance 009add20-7850-405d-b93b-f33c860242eb could not be found. Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1c7c0830-5670-4d18-a3a7-efe4d073685e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Request method failure captured: Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb HTTP/1.1 Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgYz1BeplfuXTHJkOfHIc4HHvWpgmtACVIDqhl2KznLucjDfZdsOv1oOnIJj7M5GsHbWVqHtaPFjE7I8aaNF99wTlcW31oPZk8MPZn4ZadZqVCq5-FgBuGU54DnrikOmEdTLzwsqELSN-iClqJCMIFBnVqLgAZU8nGnLFDU8lQ5UBJs Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_9a617355a8b94576bf4edcf58a078a8e", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/9a617355a8b94576bf4edcf58a078a8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/9a617355a8b94576bf4edcf58a078a8e"}]}] Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 9a617355a8b94576bf4edcf58a078a8e Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerActionsTestJSON-1247552861 Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 4a1864aed01d473ea51ec9de243ddfa4 Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServerActionsTestJSON-1247552861-project Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 009add20-7850-405d-b93b-f33c860242eb could not be found. Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '009add20-7850-405d-b93b-f33c860242eb'} Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 009add20-7850-405d-b93b-f33c860242eb could not be found. Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 009add20-7850-405d-b93b-f33c860242eb could not be found. Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:12:26.986429 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.994012 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:12:26.994012 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:12:26.994012 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:12:26.994012 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:12:26.994012 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:12:26.994012 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 009add20-7850-405d-b93b-f33c860242eb could not be found. Aug 24 11:12:26.994012 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:12:26.994012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1c7c0830-5670-4d18-a3a7-efe4d073685e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Returning 404 to user: Instance 009add20-7850-405d-b93b-f33c860242eb could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:12:26.994012 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1c7c0830-5670-4d18-a3a7-efe4d073685e tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb" status: 404 len: 111 microversion: 2.1 time: 0.030567 Aug 24 11:12:26.994012 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3681/7000] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:26 2022] GET /compute/v2.1/servers/009add20-7850-405d-b93b-f33c860242eb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:12:26.999006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a6a47a02-7808-4a20-8389-eeb9001724e6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] Calling method '.version_select at 0x7f4654fca820>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:27.024726 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a6a47a02-7808-4a20-8389-eeb9001724e6 tempest-ServerActionsTestJSON-1247552861 tempest-ServerActionsTestJSON-1247552861-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1870957699" status: 202 len: 0 microversion: 2.1 time: 0.030342 Aug 24 11:12:27.028451 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3320/7001] 10.222.0.85 () {58 vars in 1221 bytes} [Wed Aug 24 11:12:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1870957699 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:12:36.807027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5f3af533-170a-46aa-a15a-9e2ee63fe4a0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1439250983", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "a0941ff9-100a-4eaf-a233-320d5a404850"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:12:36.866017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-5f3af533-170a-46aa-a15a-9e2ee63fe4a0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] validate_networks() for [('a0941ff9-100a-4eaf-a233-320d5a404850', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:12:36.975871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=25 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:12:37.328803 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:12:37.328980 n-d-849328-3 devstack@n-api.service[122433]: Wed Aug 24 11:12:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.85) !!! Aug 24 11:12:37.367666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-5f3af533-170a-46aa-a15a-9e2ee63fe4a0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:12:37.368109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-5f3af533-170a-46aa-a15a-9e2ee63fe4a0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:12:37.368593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-5f3af533-170a-46aa-a15a-9e2ee63fe4a0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:12:37.369010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-5f3af533-170a-46aa-a15a-9e2ee63fe4a0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:12:37.369454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-5f3af533-170a-46aa-a15a-9e2ee63fe4a0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:12:37.381676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f3af533-170a-46aa-a15a-9e2ee63fe4a0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:37.382184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f3af533-170a-46aa-a15a-9e2ee63fe4a0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:37.382665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f3af533-170a-46aa-a15a-9e2ee63fe4a0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:37.383407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f3af533-170a-46aa-a15a-9e2ee63fe4a0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:37.383878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f3af533-170a-46aa-a15a-9e2ee63fe4a0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:37.384388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f3af533-170a-46aa-a15a-9e2ee63fe4a0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:37.403835 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-5f3af533-170a-46aa-a15a-9e2ee63fe4a0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Getting quotas for project e2bc36e65c034436ab8421ee91f9f1ec. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:12:37.409603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-5f3af533-170a-46aa-a15a-9e2ee63fe4a0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Getting quotas for user 41a54f6758e44b788efd37691f87ef7e and project e2bc36e65c034436ab8421ee91f9f1ec. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:12:37.422914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5f3af533-170a-46aa-a15a-9e2ee63fe4a0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:12:37.425566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5f3af533-170a-46aa-a15a-9e2ee63fe4a0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: 1f905769-98f7-4215-8cec-8a850042915a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:12:37.474018 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5f3af533-170a-46aa-a15a-9e2ee63fe4a0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.791785 Aug 24 11:12:37.474811 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3682/7002] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 11:12:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:12:37.483933 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=29 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:12:37.485150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:12:37.493101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-06584e60-338d-4ad7-b0af-88bab4041165 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:37.493101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-06584e60-338d-4ad7-b0af-88bab4041165 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: 1f905769-98f7-4215-8cec-8a850042915a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:37.559321 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-06584e60-338d-4ad7-b0af-88bab4041165 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:37.568040 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-06584e60-338d-4ad7-b0af-88bab4041165 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a" status: 200 len: 1217 microversion: 2.1 time: 0.085842 Aug 24 11:12:37.568973 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3321/7003] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:37 2022] GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:38.589715 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8e845464-d75a-4e4c-b397-b4924a25e4ab tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:38.590623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8e845464-d75a-4e4c-b397-b4924a25e4ab tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: 1f905769-98f7-4215-8cec-8a850042915a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:38.598027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e845464-d75a-4e4c-b397-b4924a25e4ab tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:38.598631 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e845464-d75a-4e4c-b397-b4924a25e4ab tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:38.599086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e845464-d75a-4e4c-b397-b4924a25e4ab tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:38.599799 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e845464-d75a-4e4c-b397-b4924a25e4ab tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:38.600257 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e845464-d75a-4e4c-b397-b4924a25e4ab tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:38.600684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e845464-d75a-4e4c-b397-b4924a25e4ab tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:38.667356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8e845464-d75a-4e4c-b397-b4924a25e4ab tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:38.680249 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8e845464-d75a-4e4c-b397-b4924a25e4ab tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a" status: 200 len: 1269 microversion: 2.1 time: 0.094603 Aug 24 11:12:38.681380 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3683/7004] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:38 2022] GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a => generated 1269 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:39.701612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ecee9ec4-c404-466c-aad1-92b850e61933 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:39.708974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ecee9ec4-c404-466c-aad1-92b850e61933 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: 1f905769-98f7-4215-8cec-8a850042915a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:39.716904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecee9ec4-c404-466c-aad1-92b850e61933 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:39.718561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecee9ec4-c404-466c-aad1-92b850e61933 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:39.719399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecee9ec4-c404-466c-aad1-92b850e61933 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:39.720376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecee9ec4-c404-466c-aad1-92b850e61933 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:39.721046 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecee9ec4-c404-466c-aad1-92b850e61933 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:39.721725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecee9ec4-c404-466c-aad1-92b850e61933 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:39.951516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ecee9ec4-c404-466c-aad1-92b850e61933 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:39.962968 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ecee9ec4-c404-466c-aad1-92b850e61933 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a" status: 200 len: 1317 microversion: 2.1 time: 0.265759 Aug 24 11:12:39.963834 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3322/7005] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:39 2022] GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:40.903975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-2b6e1215-9350-45ec-b794-a76874798dea req-e334ec4e-bb64-4467-a360-f93355aabd2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f905769-98f7-4215-8cec-8a850042915a", "tag": "b4198cca-6380-4dd0-9ab8-bc69100aa406"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:12:40.915414 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2b6e1215-9350-45ec-b794-a76874798dea req-e334ec4e-bb64-4467-a360-f93355aabd2b service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:40.915920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2b6e1215-9350-45ec-b794-a76874798dea req-e334ec4e-bb64-4467-a360-f93355aabd2b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:40.916358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2b6e1215-9350-45ec-b794-a76874798dea req-e334ec4e-bb64-4467-a360-f93355aabd2b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:40.928028 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-2b6e1215-9350-45ec-b794-a76874798dea req-e334ec4e-bb64-4467-a360-f93355aabd2b service nova] Creating event network-changed:b4198cca-6380-4dd0-9ab8-bc69100aa406 for instance 1f905769-98f7-4215-8cec-8a850042915a on n-h2-849328-3 Aug 24 11:12:40.933934 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-2b6e1215-9350-45ec-b794-a76874798dea req-e334ec4e-bb64-4467-a360-f93355aabd2b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034076 Aug 24 11:12:40.934596 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3684/7006] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:12:40.984926 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-46e90b71-cbc6-44b7-b120-f42cf5f9dca4 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:40.985668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-46e90b71-cbc6-44b7-b120-f42cf5f9dca4 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: 1f905769-98f7-4215-8cec-8a850042915a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:40.993064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46e90b71-cbc6-44b7-b120-f42cf5f9dca4 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:40.993595 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46e90b71-cbc6-44b7-b120-f42cf5f9dca4 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:40.994028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46e90b71-cbc6-44b7-b120-f42cf5f9dca4 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:40.994714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46e90b71-cbc6-44b7-b120-f42cf5f9dca4 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:40.995215 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46e90b71-cbc6-44b7-b120-f42cf5f9dca4 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:40.995655 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46e90b71-cbc6-44b7-b120-f42cf5f9dca4 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:41.221577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-46e90b71-cbc6-44b7-b120-f42cf5f9dca4 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:41.229972 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-46e90b71-cbc6-44b7-b120-f42cf5f9dca4 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a" status: 200 len: 1317 microversion: 2.1 time: 0.249794 Aug 24 11:12:41.230554 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3323/7007] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:40 2022] GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a => generated 1317 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:42.254658 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-89af56d6-95be-45b0-bf49-11c17a4d3aa0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:42.255267 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-89af56d6-95be-45b0-bf49-11c17a4d3aa0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: 1f905769-98f7-4215-8cec-8a850042915a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:42.263032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89af56d6-95be-45b0-bf49-11c17a4d3aa0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:42.263536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89af56d6-95be-45b0-bf49-11c17a4d3aa0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:42.263962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89af56d6-95be-45b0-bf49-11c17a4d3aa0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:42.264708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89af56d6-95be-45b0-bf49-11c17a4d3aa0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:42.265157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89af56d6-95be-45b0-bf49-11c17a4d3aa0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:42.265628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89af56d6-95be-45b0-bf49-11c17a4d3aa0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:42.411350 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-89af56d6-95be-45b0-bf49-11c17a4d3aa0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:42.419481 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-89af56d6-95be-45b0-bf49-11c17a4d3aa0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a" status: 200 len: 1317 microversion: 2.1 time: 0.170333 Aug 24 11:12:42.420070 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3685/7008] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:42 2022] GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:43.444582 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-79cbfd76-5385-4475-a788-a04b80cde066 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:43.445716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-79cbfd76-5385-4475-a788-a04b80cde066 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: 1f905769-98f7-4215-8cec-8a850042915a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:43.454661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79cbfd76-5385-4475-a788-a04b80cde066 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:43.455160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79cbfd76-5385-4475-a788-a04b80cde066 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:43.455605 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79cbfd76-5385-4475-a788-a04b80cde066 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:43.456309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79cbfd76-5385-4475-a788-a04b80cde066 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:43.456775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79cbfd76-5385-4475-a788-a04b80cde066 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:43.457237 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79cbfd76-5385-4475-a788-a04b80cde066 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:43.599320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-79cbfd76-5385-4475-a788-a04b80cde066 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:43.609957 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-79cbfd76-5385-4475-a788-a04b80cde066 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a" status: 200 len: 1317 microversion: 2.1 time: 0.172208 Aug 24 11:12:43.610558 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3324/7009] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:43 2022] GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:44.632574 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eb1e0210-3440-4603-b65f-137808ad6839 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:44.633090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-eb1e0210-3440-4603-b65f-137808ad6839 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: 1f905769-98f7-4215-8cec-8a850042915a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:44.640471 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb1e0210-3440-4603-b65f-137808ad6839 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:44.640978 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb1e0210-3440-4603-b65f-137808ad6839 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:44.641460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb1e0210-3440-4603-b65f-137808ad6839 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:44.642176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb1e0210-3440-4603-b65f-137808ad6839 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:44.642647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb1e0210-3440-4603-b65f-137808ad6839 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:44.643090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb1e0210-3440-4603-b65f-137808ad6839 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:44.783374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-eb1e0210-3440-4603-b65f-137808ad6839 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:44.791516 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eb1e0210-3440-4603-b65f-137808ad6839 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a" status: 200 len: 1317 microversion: 2.1 time: 0.163104 Aug 24 11:12:44.792089 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3686/7010] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:44 2022] GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:45.813029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-464cb7a7-f1c9-4888-806a-b89dd0bf6e25 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:45.813913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-464cb7a7-f1c9-4888-806a-b89dd0bf6e25 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: 1f905769-98f7-4215-8cec-8a850042915a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:45.824441 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-464cb7a7-f1c9-4888-806a-b89dd0bf6e25 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:45.825425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-464cb7a7-f1c9-4888-806a-b89dd0bf6e25 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:45.826041 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-464cb7a7-f1c9-4888-806a-b89dd0bf6e25 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:45.826801 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-464cb7a7-f1c9-4888-806a-b89dd0bf6e25 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:45.827367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-464cb7a7-f1c9-4888-806a-b89dd0bf6e25 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:45.827762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-464cb7a7-f1c9-4888-806a-b89dd0bf6e25 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:45.976916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-464cb7a7-f1c9-4888-806a-b89dd0bf6e25 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:45.986267 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-464cb7a7-f1c9-4888-806a-b89dd0bf6e25 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a" status: 200 len: 1317 microversion: 2.1 time: 0.177556 Aug 24 11:12:45.986863 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3325/7011] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:45 2022] GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:47.011150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5e6337d4-1d7a-4070-b2b2-86637a23f824 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:47.012179 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5e6337d4-1d7a-4070-b2b2-86637a23f824 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: 1f905769-98f7-4215-8cec-8a850042915a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:47.019868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e6337d4-1d7a-4070-b2b2-86637a23f824 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:47.020368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e6337d4-1d7a-4070-b2b2-86637a23f824 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:47.020793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e6337d4-1d7a-4070-b2b2-86637a23f824 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:47.021562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e6337d4-1d7a-4070-b2b2-86637a23f824 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:47.022032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e6337d4-1d7a-4070-b2b2-86637a23f824 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:47.022464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e6337d4-1d7a-4070-b2b2-86637a23f824 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:47.166684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5e6337d4-1d7a-4070-b2b2-86637a23f824 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:47.174725 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5e6337d4-1d7a-4070-b2b2-86637a23f824 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a" status: 200 len: 1317 microversion: 2.1 time: 0.170297 Aug 24 11:12:47.175315 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3687/7012] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:47 2022] GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:47.550736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-2fc9e642-9efe-4dfb-a41d-b38a6b3fc1b4 req-d97a2a2c-a130-4fed-9f8e-099e61c9ea36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f905769-98f7-4215-8cec-8a850042915a", "name": "network-vif-plugged", "status": "completed", "tag": "b4198cca-6380-4dd0-9ab8-bc69100aa406"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:12:47.562584 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2fc9e642-9efe-4dfb-a41d-b38a6b3fc1b4 req-d97a2a2c-a130-4fed-9f8e-099e61c9ea36 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:47.563834 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2fc9e642-9efe-4dfb-a41d-b38a6b3fc1b4 req-d97a2a2c-a130-4fed-9f8e-099e61c9ea36 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:47.564254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2fc9e642-9efe-4dfb-a41d-b38a6b3fc1b4 req-d97a2a2c-a130-4fed-9f8e-099e61c9ea36 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:47.567636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:12:47.578381 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-2fc9e642-9efe-4dfb-a41d-b38a6b3fc1b4 req-d97a2a2c-a130-4fed-9f8e-099e61c9ea36 service nova] Creating event network-vif-plugged:b4198cca-6380-4dd0-9ab8-bc69100aa406 for instance 1f905769-98f7-4215-8cec-8a850042915a on n-h2-849328-3 Aug 24 11:12:47.583681 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-2fc9e642-9efe-4dfb-a41d-b38a6b3fc1b4 req-d97a2a2c-a130-4fed-9f8e-099e61c9ea36 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037094 Aug 24 11:12:47.584629 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3326/7013] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:12:48.197693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9a5e7fdc-e10e-4230-afbe-5492ac947a56 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:48.198330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9a5e7fdc-e10e-4230-afbe-5492ac947a56 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: 1f905769-98f7-4215-8cec-8a850042915a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:48.200444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:12:48.201152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:12:48.208952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a5e7fdc-e10e-4230-afbe-5492ac947a56 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:48.210455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a5e7fdc-e10e-4230-afbe-5492ac947a56 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:48.210455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a5e7fdc-e10e-4230-afbe-5492ac947a56 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:48.211053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a5e7fdc-e10e-4230-afbe-5492ac947a56 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:48.211602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a5e7fdc-e10e-4230-afbe-5492ac947a56 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:48.212202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a5e7fdc-e10e-4230-afbe-5492ac947a56 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:48.353399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9a5e7fdc-e10e-4230-afbe-5492ac947a56 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:48.361881 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9a5e7fdc-e10e-4230-afbe-5492ac947a56 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a" status: 200 len: 1317 microversion: 2.1 time: 0.169997 Aug 24 11:12:48.362473 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3688/7014] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:48 2022] GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:49.390774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-114de92e-0f6b-4992-b522-4673a88b489d tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:49.391471 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-114de92e-0f6b-4992-b522-4673a88b489d tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: 1f905769-98f7-4215-8cec-8a850042915a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:49.398883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-114de92e-0f6b-4992-b522-4673a88b489d tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:49.399368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-114de92e-0f6b-4992-b522-4673a88b489d tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:49.399799 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-114de92e-0f6b-4992-b522-4673a88b489d tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:49.400488 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-114de92e-0f6b-4992-b522-4673a88b489d tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:49.400939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-114de92e-0f6b-4992-b522-4673a88b489d tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:49.401398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-114de92e-0f6b-4992-b522-4673a88b489d tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:49.540290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-114de92e-0f6b-4992-b522-4673a88b489d tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:49.548433 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-114de92e-0f6b-4992-b522-4673a88b489d tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a" status: 200 len: 1506 microversion: 2.1 time: 0.162046 Aug 24 11:12:49.549001 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3327/7015] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:49 2022] GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:49.610831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e2998b45-c51c-434b-b9ea-2e757a9ab562 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1325589918", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "a0941ff9-100a-4eaf-a233-320d5a404850"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:12:49.663897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-e2998b45-c51c-434b-b9ea-2e757a9ab562 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] validate_networks() for [('a0941ff9-100a-4eaf-a233-320d5a404850', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:12:50.037653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e2998b45-c51c-434b-b9ea-2e757a9ab562 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:12:50.038094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e2998b45-c51c-434b-b9ea-2e757a9ab562 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:12:50.038586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e2998b45-c51c-434b-b9ea-2e757a9ab562 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:12:50.039011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e2998b45-c51c-434b-b9ea-2e757a9ab562 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:12:50.039439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e2998b45-c51c-434b-b9ea-2e757a9ab562 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:12:50.049301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2998b45-c51c-434b-b9ea-2e757a9ab562 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:50.049806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2998b45-c51c-434b-b9ea-2e757a9ab562 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:50.050259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2998b45-c51c-434b-b9ea-2e757a9ab562 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:50.051003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2998b45-c51c-434b-b9ea-2e757a9ab562 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:50.051486 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2998b45-c51c-434b-b9ea-2e757a9ab562 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:50.051925 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2998b45-c51c-434b-b9ea-2e757a9ab562 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:50.069094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-e2998b45-c51c-434b-b9ea-2e757a9ab562 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Getting quotas for project e2bc36e65c034436ab8421ee91f9f1ec. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:12:50.074772 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-e2998b45-c51c-434b-b9ea-2e757a9ab562 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Getting quotas for user 41a54f6758e44b788efd37691f87ef7e and project e2bc36e65c034436ab8421ee91f9f1ec. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:12:50.089365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e2998b45-c51c-434b-b9ea-2e757a9ab562 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:12:50.091485 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e2998b45-c51c-434b-b9ea-2e757a9ab562 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: b0c16368-f5df-4cca-b411-cab473919098] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:12:50.138300 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e2998b45-c51c-434b-b9ea-2e757a9ab562 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531765 Aug 24 11:12:50.138984 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3689/7016] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 11:12:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:12:50.151099 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-af636d1a-69b3-4001-94ff-6b98525321e1 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:50.152062 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-af636d1a-69b3-4001-94ff-6b98525321e1 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: b0c16368-f5df-4cca-b411-cab473919098] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:50.207260 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-af636d1a-69b3-4001-94ff-6b98525321e1 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:50.215499 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-af636d1a-69b3-4001-94ff-6b98525321e1 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098" status: 200 len: 1217 microversion: 2.1 time: 0.068399 Aug 24 11:12:50.216171 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3328/7017] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:50 2022] GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:51.244027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-69366b74-d63e-457a-bf64-166fa907f2d2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:51.244865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-69366b74-d63e-457a-bf64-166fa907f2d2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: b0c16368-f5df-4cca-b411-cab473919098] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:51.252749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69366b74-d63e-457a-bf64-166fa907f2d2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:51.253413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69366b74-d63e-457a-bf64-166fa907f2d2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:51.253938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69366b74-d63e-457a-bf64-166fa907f2d2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:51.254762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69366b74-d63e-457a-bf64-166fa907f2d2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:51.255307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69366b74-d63e-457a-bf64-166fa907f2d2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:51.256347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69366b74-d63e-457a-bf64-166fa907f2d2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:51.321428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-69366b74-d63e-457a-bf64-166fa907f2d2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:51.329818 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-69366b74-d63e-457a-bf64-166fa907f2d2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098" status: 200 len: 1287 microversion: 2.1 time: 0.093375 Aug 24 11:12:51.330403 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3690/7018] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:51 2022] GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098 => generated 1287 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:52.351329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6a192cd0-d6f0-46cb-92a5-816997f4958f tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:52.352112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6a192cd0-d6f0-46cb-92a5-816997f4958f tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: b0c16368-f5df-4cca-b411-cab473919098] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:52.360686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a192cd0-d6f0-46cb-92a5-816997f4958f tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:52.361191 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a192cd0-d6f0-46cb-92a5-816997f4958f tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:52.361649 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a192cd0-d6f0-46cb-92a5-816997f4958f tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:52.362358 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a192cd0-d6f0-46cb-92a5-816997f4958f tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:52.363139 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a192cd0-d6f0-46cb-92a5-816997f4958f tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:52.363573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a192cd0-d6f0-46cb-92a5-816997f4958f tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:52.558519 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6a192cd0-d6f0-46cb-92a5-816997f4958f tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:52.559103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-f724eac9-9c3e-4b4c-a4c7-0df6ec67da05 req-2e521982-e623-424f-a243-212ccd3b5f72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c16368-f5df-4cca-b411-cab473919098", "tag": "4b525be7-dca1-45e7-ac0a-ac890410a2f9"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:12:52.565208 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:12:52.568677 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6a192cd0-d6f0-46cb-92a5-816997f4958f tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098" status: 200 len: 1317 microversion: 2.1 time: 0.221629 Aug 24 11:12:52.569896 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3329/7019] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:52 2022] GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:52.584858 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f724eac9-9c3e-4b4c-a4c7-0df6ec67da05 req-2e521982-e623-424f-a243-212ccd3b5f72 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:52.585459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f724eac9-9c3e-4b4c-a4c7-0df6ec67da05 req-2e521982-e623-424f-a243-212ccd3b5f72 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:52.585970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f724eac9-9c3e-4b4c-a4c7-0df6ec67da05 req-2e521982-e623-424f-a243-212ccd3b5f72 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:52.600722 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-f724eac9-9c3e-4b4c-a4c7-0df6ec67da05 req-2e521982-e623-424f-a243-212ccd3b5f72 service nova] Creating event network-changed:4b525be7-dca1-45e7-ac0a-ac890410a2f9 for instance b0c16368-f5df-4cca-b411-cab473919098 on n-h1-849328-3 Aug 24 11:12:52.606447 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-f724eac9-9c3e-4b4c-a4c7-0df6ec67da05 req-2e521982-e623-424f-a243-212ccd3b5f72 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053600 Aug 24 11:12:52.607282 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3691/7020] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:12:53.594398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d1462abb-6501-43c6-9ed4-c31b502c2143 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:53.595256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d1462abb-6501-43c6-9ed4-c31b502c2143 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: b0c16368-f5df-4cca-b411-cab473919098] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:53.605349 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1462abb-6501-43c6-9ed4-c31b502c2143 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:53.606150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1462abb-6501-43c6-9ed4-c31b502c2143 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:53.606849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1462abb-6501-43c6-9ed4-c31b502c2143 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:53.607538 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1462abb-6501-43c6-9ed4-c31b502c2143 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:53.607991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1462abb-6501-43c6-9ed4-c31b502c2143 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:53.608378 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1462abb-6501-43c6-9ed4-c31b502c2143 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:53.756310 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d1462abb-6501-43c6-9ed4-c31b502c2143 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:53.764948 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d1462abb-6501-43c6-9ed4-c31b502c2143 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098" status: 200 len: 1317 microversion: 2.1 time: 0.177467 Aug 24 11:12:53.765573 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3330/7021] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:53 2022] GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:54.788653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b2335cb0-3b1e-4acb-be79-f07959819670 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:54.789676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b2335cb0-3b1e-4acb-be79-f07959819670 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: b0c16368-f5df-4cca-b411-cab473919098] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:54.796646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2335cb0-3b1e-4acb-be79-f07959819670 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:54.797317 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2335cb0-3b1e-4acb-be79-f07959819670 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:54.797980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2335cb0-3b1e-4acb-be79-f07959819670 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:54.799016 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2335cb0-3b1e-4acb-be79-f07959819670 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:54.799622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2335cb0-3b1e-4acb-be79-f07959819670 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:54.800269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2335cb0-3b1e-4acb-be79-f07959819670 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:54.942994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b2335cb0-3b1e-4acb-be79-f07959819670 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:54.951130 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b2335cb0-3b1e-4acb-be79-f07959819670 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098" status: 200 len: 1317 microversion: 2.1 time: 0.167920 Aug 24 11:12:54.951760 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3692/7022] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:54 2022] GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:55.971776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ebe07660-3a3e-487d-bd4d-0b93d62b109a tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:55.972539 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ebe07660-3a3e-487d-bd4d-0b93d62b109a tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: b0c16368-f5df-4cca-b411-cab473919098] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:55.979812 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebe07660-3a3e-487d-bd4d-0b93d62b109a tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:55.980295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebe07660-3a3e-487d-bd4d-0b93d62b109a tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:55.980727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebe07660-3a3e-487d-bd4d-0b93d62b109a tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:55.982359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebe07660-3a3e-487d-bd4d-0b93d62b109a tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:55.983175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebe07660-3a3e-487d-bd4d-0b93d62b109a tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:55.983603 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebe07660-3a3e-487d-bd4d-0b93d62b109a tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:56.124403 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ebe07660-3a3e-487d-bd4d-0b93d62b109a tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:56.132707 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ebe07660-3a3e-487d-bd4d-0b93d62b109a tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098" status: 200 len: 1317 microversion: 2.1 time: 0.164924 Aug 24 11:12:56.133352 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3331/7023] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:55 2022] GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:57.154595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-24aa85a7-d28e-4821-a969-1b0039df03e2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:57.155165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-24aa85a7-d28e-4821-a969-1b0039df03e2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: b0c16368-f5df-4cca-b411-cab473919098] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:57.162294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24aa85a7-d28e-4821-a969-1b0039df03e2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:57.162797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24aa85a7-d28e-4821-a969-1b0039df03e2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:57.163240 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24aa85a7-d28e-4821-a969-1b0039df03e2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:57.163941 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24aa85a7-d28e-4821-a969-1b0039df03e2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:57.164467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24aa85a7-d28e-4821-a969-1b0039df03e2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:57.164905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24aa85a7-d28e-4821-a969-1b0039df03e2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:57.297220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-24aa85a7-d28e-4821-a969-1b0039df03e2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:57.305725 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-24aa85a7-d28e-4821-a969-1b0039df03e2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098" status: 200 len: 1317 microversion: 2.1 time: 0.155413 Aug 24 11:12:57.306315 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3693/7024] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:57 2022] GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:57.722715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-61fbb775-8299-4fa4-980f-1b2ec2a94433 req-9f8dd84a-576f-4d5a-b4fe-c5295597fa63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c16368-f5df-4cca-b411-cab473919098", "name": "network-vif-plugged", "status": "completed", "tag": "4b525be7-dca1-45e7-ac0a-ac890410a2f9"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:12:57.733017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-61fbb775-8299-4fa4-980f-1b2ec2a94433 req-9f8dd84a-576f-4d5a-b4fe-c5295597fa63 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:57.733892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-61fbb775-8299-4fa4-980f-1b2ec2a94433 req-9f8dd84a-576f-4d5a-b4fe-c5295597fa63 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:57.733892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-61fbb775-8299-4fa4-980f-1b2ec2a94433 req-9f8dd84a-576f-4d5a-b4fe-c5295597fa63 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:57.746594 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-61fbb775-8299-4fa4-980f-1b2ec2a94433 req-9f8dd84a-576f-4d5a-b4fe-c5295597fa63 service nova] Creating event network-vif-plugged:4b525be7-dca1-45e7-ac0a-ac890410a2f9 for instance b0c16368-f5df-4cca-b411-cab473919098 on n-h1-849328-3 Aug 24 11:12:57.751969 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-61fbb775-8299-4fa4-980f-1b2ec2a94433 req-9f8dd84a-576f-4d5a-b4fe-c5295597fa63 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032887 Aug 24 11:12:57.752563 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3332/7025] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:12:58.327097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ccf38de8-3c9d-4d6d-9847-d45035ed2676 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:58.327803 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ccf38de8-3c9d-4d6d-9847-d45035ed2676 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: b0c16368-f5df-4cca-b411-cab473919098] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:58.335548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ccf38de8-3c9d-4d6d-9847-d45035ed2676 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:58.336070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ccf38de8-3c9d-4d6d-9847-d45035ed2676 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:58.336524 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ccf38de8-3c9d-4d6d-9847-d45035ed2676 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:58.337280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ccf38de8-3c9d-4d6d-9847-d45035ed2676 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:58.337748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ccf38de8-3c9d-4d6d-9847-d45035ed2676 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:58.338188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ccf38de8-3c9d-4d6d-9847-d45035ed2676 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:58.475408 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ccf38de8-3c9d-4d6d-9847-d45035ed2676 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:58.484465 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ccf38de8-3c9d-4d6d-9847-d45035ed2676 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098" status: 200 len: 1317 microversion: 2.1 time: 0.160824 Aug 24 11:12:58.484465 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3694/7026] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:58 2022] GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:59.505824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ee647700-c35d-4fe6-a0a8-658846002fed tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:59.506693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ee647700-c35d-4fe6-a0a8-658846002fed tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: b0c16368-f5df-4cca-b411-cab473919098] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:59.514498 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee647700-c35d-4fe6-a0a8-658846002fed tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:59.514959 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee647700-c35d-4fe6-a0a8-658846002fed tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:59.515427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee647700-c35d-4fe6-a0a8-658846002fed tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:59.516099 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee647700-c35d-4fe6-a0a8-658846002fed tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:59.516566 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee647700-c35d-4fe6-a0a8-658846002fed tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:59.517003 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee647700-c35d-4fe6-a0a8-658846002fed tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:59.664007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ee647700-c35d-4fe6-a0a8-658846002fed tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:59.672818 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ee647700-c35d-4fe6-a0a8-658846002fed tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098" status: 200 len: 1505 microversion: 2.1 time: 0.172392 Aug 24 11:12:59.673407 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3333/7027] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:59 2022] GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098 => generated 1505 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:59.695263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1bf7f4b0-4035-4be7-9fc4-c69cbebe6d27 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:59.695827 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1bf7f4b0-4035-4be7-9fc4-c69cbebe6d27 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: b0c16368-f5df-4cca-b411-cab473919098] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:59.703397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bf7f4b0-4035-4be7-9fc4-c69cbebe6d27 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:59.703904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bf7f4b0-4035-4be7-9fc4-c69cbebe6d27 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:59.704355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bf7f4b0-4035-4be7-9fc4-c69cbebe6d27 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:59.705209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bf7f4b0-4035-4be7-9fc4-c69cbebe6d27 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:59.705705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bf7f4b0-4035-4be7-9fc4-c69cbebe6d27 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:59.706232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bf7f4b0-4035-4be7-9fc4-c69cbebe6d27 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:59.732986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1bf7f4b0-4035-4be7-9fc4-c69cbebe6d27 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: b0c16368-f5df-4cca-b411-cab473919098] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:12:59.825493 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1bf7f4b0-4035-4be7-9fc4-c69cbebe6d27 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098" status: 204 len: 0 microversion: 2.1 time: 0.133633 Aug 24 11:12:59.826171 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3695/7028] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:12:59 2022] DELETE /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:12:59.834539 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-664f7b3c-d266-4c50-b842-6c06baac51e0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:59.835162 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-664f7b3c-d266-4c50-b842-6c06baac51e0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: b0c16368-f5df-4cca-b411-cab473919098] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:59.841687 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-664f7b3c-d266-4c50-b842-6c06baac51e0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:59.842102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-664f7b3c-d266-4c50-b842-6c06baac51e0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:59.842534 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-664f7b3c-d266-4c50-b842-6c06baac51e0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:59.843389 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-664f7b3c-d266-4c50-b842-6c06baac51e0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:59.843705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-664f7b3c-d266-4c50-b842-6c06baac51e0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:59.844111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-664f7b3c-d266-4c50-b842-6c06baac51e0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:59.981658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-664f7b3c-d266-4c50-b842-6c06baac51e0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:59.990016 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-664f7b3c-d266-4c50-b842-6c06baac51e0 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098" status: 200 len: 1511 microversion: 2.1 time: 0.159453 Aug 24 11:12:59.990581 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3334/7029] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:59 2022] GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098 => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:01.015036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-91dcf530-15db-4c5f-972a-991775751ef7 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:01.015784 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-91dcf530-15db-4c5f-972a-991775751ef7 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: b0c16368-f5df-4cca-b411-cab473919098] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:01.017757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:13:01.018446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:13:01.026681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91dcf530-15db-4c5f-972a-991775751ef7 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:01.027176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91dcf530-15db-4c5f-972a-991775751ef7 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:01.027624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91dcf530-15db-4c5f-972a-991775751ef7 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:01.028320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91dcf530-15db-4c5f-972a-991775751ef7 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:01.028844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91dcf530-15db-4c5f-972a-991775751ef7 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:01.029310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91dcf530-15db-4c5f-972a-991775751ef7 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:01.168485 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-91dcf530-15db-4c5f-972a-991775751ef7 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:01.176987 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-91dcf530-15db-4c5f-972a-991775751ef7 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098" status: 200 len: 1511 microversion: 2.1 time: 0.168464 Aug 24 11:13:01.177587 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3696/7030] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:01 2022] GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098 => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:01.752782 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-8450a29e-c803-4efe-8e68-7b8e26646163 req-447e21ff-82d7-4a9c-815c-7ce3763d2722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c16368-f5df-4cca-b411-cab473919098", "name": "network-vif-deleted", "tag": "4b525be7-dca1-45e7-ac0a-ac890410a2f9"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:13:01.761463 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:13:01.775577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8450a29e-c803-4efe-8e68-7b8e26646163 req-447e21ff-82d7-4a9c-815c-7ce3763d2722 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:01.776077 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8450a29e-c803-4efe-8e68-7b8e26646163 req-447e21ff-82d7-4a9c-815c-7ce3763d2722 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:01.776684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8450a29e-c803-4efe-8e68-7b8e26646163 req-447e21ff-82d7-4a9c-815c-7ce3763d2722 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:01.794220 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-8450a29e-c803-4efe-8e68-7b8e26646163 req-447e21ff-82d7-4a9c-815c-7ce3763d2722 service nova] Creating event network-vif-deleted:4b525be7-dca1-45e7-ac0a-ac890410a2f9 for instance b0c16368-f5df-4cca-b411-cab473919098 on n-h1-849328-3 Aug 24 11:13:01.800287 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-8450a29e-c803-4efe-8e68-7b8e26646163 req-447e21ff-82d7-4a9c-815c-7ce3763d2722 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051134 Aug 24 11:13:01.801266 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3335/7031] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:13:02.204479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-831d1634-d268-4fd2-9714-f439d057cf92 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:02.205424 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-831d1634-d268-4fd2-9714-f439d057cf92 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: b0c16368-f5df-4cca-b411-cab473919098] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:02.213153 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-831d1634-d268-4fd2-9714-f439d057cf92 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:02.213743 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-831d1634-d268-4fd2-9714-f439d057cf92 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:02.214280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-831d1634-d268-4fd2-9714-f439d057cf92 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:02.215097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-831d1634-d268-4fd2-9714-f439d057cf92 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:02.215656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-831d1634-d268-4fd2-9714-f439d057cf92 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:02.216093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-831d1634-d268-4fd2-9714-f439d057cf92 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:02.253777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-831d1634-d268-4fd2-9714-f439d057cf92 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:02.254617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-831d1634-d268-4fd2-9714-f439d057cf92 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:02.255412 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-831d1634-d268-4fd2-9714-f439d057cf92 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:02.256185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-831d1634-d268-4fd2-9714-f439d057cf92 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lazy-loading 'fault' on Instance uuid b0c16368-f5df-4cca-b411-cab473919098 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:13:02.305543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-831d1634-d268-4fd2-9714-f439d057cf92 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:02.315620 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-831d1634-d268-4fd2-9714-f439d057cf92 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098" status: 200 len: 1307 microversion: 2.1 time: 0.115198 Aug 24 11:13:02.316223 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3697/7032] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:02 2022] GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098 => generated 1307 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:03.340563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5400a04e-a058-4d55-8f3f-ab4070d6f415 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:03.341700 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5400a04e-a058-4d55-8f3f-ab4070d6f415 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: b0c16368-f5df-4cca-b411-cab473919098] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:03.348540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5400a04e-a058-4d55-8f3f-ab4070d6f415 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:03.349064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5400a04e-a058-4d55-8f3f-ab4070d6f415 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:03.349548 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5400a04e-a058-4d55-8f3f-ab4070d6f415 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:03.350253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5400a04e-a058-4d55-8f3f-ab4070d6f415 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:03.350718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5400a04e-a058-4d55-8f3f-ab4070d6f415 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:03.351148 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5400a04e-a058-4d55-8f3f-ab4070d6f415 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:03.365386 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-5400a04e-a058-4d55-8f3f-ab4070d6f415 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] HTTP exception thrown: Instance b0c16368-f5df-4cca-b411-cab473919098 could not be found. Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5400a04e-a058-4d55-8f3f-ab4070d6f415 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Request method failure captured: Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098 HTTP/1.1 Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgekbPcl5lwri6YH7Tjkl1EP3XKZeGCH8eifeJJRibjnkWpcsuBrkqJe66-GN3B0ps0sn6PFYof1_OMvr2WTUy7GESxpVaLs6HWrZIHWhsQDLyHUYwglC2b5z_e2NxI4JufLxz_t4I8-bNRLjRaiOBnHJF-b7Rjt9aouXISoWua-lqA Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: e2bc36e65c034436ab8421ee91f9f1ec Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-714232356 Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e2bc36e65c034436ab8421ee91f9f1ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e2bc36e65c034436ab8421ee91f9f1ec", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e2bc36e65c034436ab8421ee91f9f1ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e2bc36e65c034436ab8421ee91f9f1ec"}]}] Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-714232356 Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: e2bc36e65c034436ab8421ee91f9f1ec Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-714232356 Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-714232356-project Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 41a54f6758e44b788efd37691f87ef7e Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-714232356-project Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance b0c16368-f5df-4cca-b411-cab473919098 could not be found. Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'b0c16368-f5df-4cca-b411-cab473919098'} Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c16368-f5df-4cca-b411-cab473919098 could not be found. Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c16368-f5df-4cca-b411-cab473919098 could not be found. Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:13:03.367038 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:13:03.371910 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:13:03.371910 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:13:03.371910 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:13:03.371910 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:13:03.371910 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:13:03.371910 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c16368-f5df-4cca-b411-cab473919098 could not be found. Aug 24 11:13:03.371910 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:13:03.371910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5400a04e-a058-4d55-8f3f-ab4070d6f415 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Returning 404 to user: Instance b0c16368-f5df-4cca-b411-cab473919098 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:13:03.371910 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5400a04e-a058-4d55-8f3f-ab4070d6f415 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098" status: 404 len: 111 microversion: 2.1 time: 0.035125 Aug 24 11:13:03.371910 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3336/7033] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:03 2022] GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:13:03.378790 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c8a20d6e-b48e-450a-b570-79c623cf1598 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:03.379315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c8a20d6e-b48e-450a-b570-79c623cf1598 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: 1f905769-98f7-4215-8cec-8a850042915a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:03.386031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8a20d6e-b48e-450a-b570-79c623cf1598 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:03.386537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8a20d6e-b48e-450a-b570-79c623cf1598 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:03.386994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8a20d6e-b48e-450a-b570-79c623cf1598 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:03.387702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8a20d6e-b48e-450a-b570-79c623cf1598 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:03.388197 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8a20d6e-b48e-450a-b570-79c623cf1598 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:03.388666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8a20d6e-b48e-450a-b570-79c623cf1598 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:03.533591 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c8a20d6e-b48e-450a-b570-79c623cf1598 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:03.542018 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c8a20d6e-b48e-450a-b570-79c623cf1598 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a" status: 200 len: 1506 microversion: 2.1 time: 0.167597 Aug 24 11:13:03.542613 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3698/7034] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:03 2022] GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:03.562433 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d632916-6111-4e6b-a4a9-c5fbb5df74ee tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:13:03.564846 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9d632916-6111-4e6b-a4a9-c5fbb5df74ee tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: e5c34ba8-f17d-4a98-9a8f-0686b6528725] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:03.570801 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-9d632916-6111-4e6b-a4a9-c5fbb5df74ee tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] HTTP exception thrown: Instance e5c34ba8-f17d-4a98-9a8f-0686b6528725 could not be found. Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d632916-6111-4e6b-a4a9-c5fbb5df74ee tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Request method failure captured: Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/e5c34ba8-f17d-4a98-9a8f-0686b6528725/action HTTP/1.1 Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 32 Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgekbPcl5lwri6YH7Tjkl1EP3XKZeGCH8eifeJJRibjnkWpcsuBrkqJe66-GN3B0ps0sn6PFYof1_OMvr2WTUy7GESxpVaLs6HWrZIHWhsQDLyHUYwglC2b5z_e2NxI4JufLxz_t4I8-bNRLjRaiOBnHJF-b7Rjt9aouXISoWua-lqA Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: e2bc36e65c034436ab8421ee91f9f1ec Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-714232356 Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e2bc36e65c034436ab8421ee91f9f1ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e2bc36e65c034436ab8421ee91f9f1ec", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e2bc36e65c034436ab8421ee91f9f1ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e2bc36e65c034436ab8421ee91f9f1ec"}]}] Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-714232356 Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: e2bc36e65c034436ab8421ee91f9f1ec Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-714232356 Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-714232356-project Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 41a54f6758e44b788efd37691f87ef7e Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-714232356-project Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: {"resize": {"flavorRef": "452"}} Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance e5c34ba8-f17d-4a98-9a8f-0686b6528725 could not be found. Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'e5c34ba8-f17d-4a98-9a8f-0686b6528725', 'body': {'resize': {'flavorRef': '452'}}} Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5c34ba8-f17d-4a98-9a8f-0686b6528725 could not be found. Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:13:03.572390 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:13:03.577050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5c34ba8-f17d-4a98-9a8f-0686b6528725 could not be found. Aug 24 11:13:03.577050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:13:03.577050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:13:03.577050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:13:03.577050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:13:03.577050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:13:03.577050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:13:03.577050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:13:03.577050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:13:03.577050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5c34ba8-f17d-4a98-9a8f-0686b6528725 could not be found. Aug 24 11:13:03.577050 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:13:03.577050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d632916-6111-4e6b-a4a9-c5fbb5df74ee tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Returning 404 to user: Instance e5c34ba8-f17d-4a98-9a8f-0686b6528725 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:13:03.577050 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9d632916-6111-4e6b-a4a9-c5fbb5df74ee tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "POST /compute/v2.1/servers/e5c34ba8-f17d-4a98-9a8f-0686b6528725/action" status: 404 len: 111 microversion: 2.1 time: 0.015680 Aug 24 11:13:03.577050 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3337/7035] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:13:03 2022] POST /compute/v2.1/servers/e5c34ba8-f17d-4a98-9a8f-0686b6528725/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:13:03.582864 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb4d2e4d-e197-435b-b4aa-0fb4ce6c3b05 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:03.583710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cb4d2e4d-e197-435b-b4aa-0fb4ce6c3b05 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: 1f905769-98f7-4215-8cec-8a850042915a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:03.590017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb4d2e4d-e197-435b-b4aa-0fb4ce6c3b05 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:03.590589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb4d2e4d-e197-435b-b4aa-0fb4ce6c3b05 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:03.591043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb4d2e4d-e197-435b-b4aa-0fb4ce6c3b05 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:03.591891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb4d2e4d-e197-435b-b4aa-0fb4ce6c3b05 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:03.592361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb4d2e4d-e197-435b-b4aa-0fb4ce6c3b05 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:03.592801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb4d2e4d-e197-435b-b4aa-0fb4ce6c3b05 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:03.597624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:13:03.733344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cb4d2e4d-e197-435b-b4aa-0fb4ce6c3b05 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:03.741910 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cb4d2e4d-e197-435b-b4aa-0fb4ce6c3b05 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a" status: 200 len: 1506 microversion: 2.1 time: 0.163198 Aug 24 11:13:03.742832 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3699/7036] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:03 2022] GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:03.768265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-08b9c30f-a143-41c0-a5fe-9d2e67a405a5 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:03.769886 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-08b9c30f-a143-41c0-a5fe-9d2e67a405a5 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: 1f905769-98f7-4215-8cec-8a850042915a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:03.776044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08b9c30f-a143-41c0-a5fe-9d2e67a405a5 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:03.776542 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08b9c30f-a143-41c0-a5fe-9d2e67a405a5 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:03.776977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08b9c30f-a143-41c0-a5fe-9d2e67a405a5 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:03.777696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08b9c30f-a143-41c0-a5fe-9d2e67a405a5 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:03.779833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08b9c30f-a143-41c0-a5fe-9d2e67a405a5 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:03.780288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08b9c30f-a143-41c0-a5fe-9d2e67a405a5 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:03.918719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-08b9c30f-a143-41c0-a5fe-9d2e67a405a5 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:03.928185 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-08b9c30f-a143-41c0-a5fe-9d2e67a405a5 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a" status: 200 len: 1506 microversion: 2.1 time: 0.163710 Aug 24 11:13:03.928854 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3338/7037] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:03 2022] GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:03.952125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6e6646aa-2d4a-440c-9da5-b3232453becf tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "26e91a8d-af48-4b6e-b7dd-6b93183f1b10"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:13:03.954595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6e6646aa-2d4a-440c-9da5-b3232453becf tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: 1f905769-98f7-4215-8cec-8a850042915a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:03.961151 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e6646aa-2d4a-440c-9da5-b3232453becf tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:03.961677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e6646aa-2d4a-440c-9da5-b3232453becf tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:03.962130 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e6646aa-2d4a-440c-9da5-b3232453becf tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:03.962839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e6646aa-2d4a-440c-9da5-b3232453becf tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:03.963310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e6646aa-2d4a-440c-9da5-b3232453becf tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:03.963750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e6646aa-2d4a-440c-9da5-b3232453becf tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:03.992705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6e6646aa-2d4a-440c-9da5-b3232453becf tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:03.998163 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-6e6646aa-2d4a-440c-9da5-b3232453becf tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] HTTP exception thrown: Flavor 26e91a8d-af48-4b6e-b7dd-6b93183f1b10 could not be found. Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6e6646aa-2d4a-440c-9da5-b3232453becf tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Request method failure captured: Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a/action HTTP/1.1 Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 65 Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgekbPcl5lwri6YH7Tjkl1EP3XKZeGCH8eifeJJRibjnkWpcsuBrkqJe66-GN3B0ps0sn6PFYof1_OMvr2WTUy7GESxpVaLs6HWrZIHWhsQDLyHUYwglC2b5z_e2NxI4JufLxz_t4I8-bNRLjRaiOBnHJF-b7Rjt9aouXISoWua-lqA Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: e2bc36e65c034436ab8421ee91f9f1ec Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-714232356 Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e2bc36e65c034436ab8421ee91f9f1ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e2bc36e65c034436ab8421ee91f9f1ec", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e2bc36e65c034436ab8421ee91f9f1ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e2bc36e65c034436ab8421ee91f9f1ec"}]}] Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-714232356 Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: e2bc36e65c034436ab8421ee91f9f1ec Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-714232356 Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-714232356-project Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 41a54f6758e44b788efd37691f87ef7e Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-714232356-project Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: {"resize": {"flavorRef": "26e91a8d-af48-4b6e-b7dd-6b93183f1b10"}} Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: exception: Flavor 26e91a8d-af48-4b6e-b7dd-6b93183f1b10 could not be found. Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '1f905769-98f7-4215-8cec-8a850042915a', 'body': {'resize': {'flavorRef': '26e91a8d-af48-4b6e-b7dd-6b93183f1b10'}}} Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4185, in resize Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:13:04.019415 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 26e91a8d-af48-4b6e-b7dd-6b93183f1b10 could not be found. Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 26e91a8d-af48-4b6e-b7dd-6b93183f1b10 could not be found. Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 26e91a8d-af48-4b6e-b7dd-6b93183f1b10 could not be found. Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6e6646aa-2d4a-440c-9da5-b3232453becf tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Returning 400 to user: Flavor 26e91a8d-af48-4b6e-b7dd-6b93183f1b10 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6e6646aa-2d4a-440c-9da5-b3232453becf tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "POST /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a/action" status: 400 len: 107 microversion: 2.1 time: 0.073826 Aug 24 11:13:04.023980 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3700/7038] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:13:03 2022] POST /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a/action => generated 107 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:13:04.032373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-205ac509-ad96-4428-a956-3d51c13e5725 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:04.033010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-205ac509-ad96-4428-a956-3d51c13e5725 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: 1f905769-98f7-4215-8cec-8a850042915a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:04.039480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-205ac509-ad96-4428-a956-3d51c13e5725 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:04.039979 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-205ac509-ad96-4428-a956-3d51c13e5725 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:04.040428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-205ac509-ad96-4428-a956-3d51c13e5725 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:04.041147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-205ac509-ad96-4428-a956-3d51c13e5725 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:04.041620 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-205ac509-ad96-4428-a956-3d51c13e5725 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:04.042028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-205ac509-ad96-4428-a956-3d51c13e5725 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:04.180772 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-205ac509-ad96-4428-a956-3d51c13e5725 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:04.188980 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-205ac509-ad96-4428-a956-3d51c13e5725 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a" status: 200 len: 1506 microversion: 2.1 time: 0.160631 Aug 24 11:13:04.189613 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3339/7039] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:04 2022] GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:04.210606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1fdfc976-4e9b-4d2a-8dce-9f6ff67f46ab tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:04.211242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1fdfc976-4e9b-4d2a-8dce-9f6ff67f46ab tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: 1f905769-98f7-4215-8cec-8a850042915a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:04.217778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fdfc976-4e9b-4d2a-8dce-9f6ff67f46ab tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:04.218310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fdfc976-4e9b-4d2a-8dce-9f6ff67f46ab tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:04.218762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fdfc976-4e9b-4d2a-8dce-9f6ff67f46ab tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:04.219473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fdfc976-4e9b-4d2a-8dce-9f6ff67f46ab tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:04.219943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fdfc976-4e9b-4d2a-8dce-9f6ff67f46ab tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:04.220381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fdfc976-4e9b-4d2a-8dce-9f6ff67f46ab tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:04.362339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1fdfc976-4e9b-4d2a-8dce-9f6ff67f46ab tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:04.372658 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1fdfc976-4e9b-4d2a-8dce-9f6ff67f46ab tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a" status: 200 len: 1506 microversion: 2.1 time: 0.165980 Aug 24 11:13:04.373293 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3701/7040] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:04 2022] GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:04.392756 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-735b3d52-86be-4af8-9de3-2b09ac8cc067 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-735b3d52-86be-4af8-9de3-2b09ac8cc067 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Request method failure captured: Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a/action HTTP/1.1 Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 29 Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgekbPcl5lwri6YH7Tjkl1EP3XKZeGCH8eifeJJRibjnkWpcsuBrkqJe66-GN3B0ps0sn6PFYof1_OMvr2WTUy7GESxpVaLs6HWrZIHWhsQDLyHUYwglC2b5z_e2NxI4JufLxz_t4I8-bNRLjRaiOBnHJF-b7Rjt9aouXISoWua-lqA Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: e2bc36e65c034436ab8421ee91f9f1ec Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-714232356 Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e2bc36e65c034436ab8421ee91f9f1ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e2bc36e65c034436ab8421ee91f9f1ec", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e2bc36e65c034436ab8421ee91f9f1ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e2bc36e65c034436ab8421ee91f9f1ec"}]}] Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-714232356 Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: e2bc36e65c034436ab8421ee91f9f1ec Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-714232356 Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-714232356-project Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 41a54f6758e44b788efd37691f87ef7e Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-714232356-project Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: {"resize": {"flavorRef": ""}} Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '1f905769-98f7-4215-8cec-8a850042915a', 'body': {'resize': {'flavorRef': ''}}} Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi '' Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:13:04.396396 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:13:04.400348 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:13:04.400348 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:13:04.400348 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:13:04.400348 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:13:04.400348 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 11:13:04.400348 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 11:13:04.400348 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 24 11:13:04.400348 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:13:04.400348 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-735b3d52-86be-4af8-9de3-2b09ac8cc067 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:13:04.400348 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-735b3d52-86be-4af8-9de3-2b09ac8cc067 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "POST /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a/action" status: 400 len: 113 microversion: 2.1 time: 0.009319 Aug 24 11:13:04.400348 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3340/7041] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:13:04 2022] POST /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:13:04.406757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1d81c314-1f09-40eb-9800-ec0715bbf364 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:04.407420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1d81c314-1f09-40eb-9800-ec0715bbf364 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: 1f905769-98f7-4215-8cec-8a850042915a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:04.414643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d81c314-1f09-40eb-9800-ec0715bbf364 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:04.415143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d81c314-1f09-40eb-9800-ec0715bbf364 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:04.415600 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d81c314-1f09-40eb-9800-ec0715bbf364 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:04.416309 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d81c314-1f09-40eb-9800-ec0715bbf364 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:04.416782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d81c314-1f09-40eb-9800-ec0715bbf364 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:04.417247 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d81c314-1f09-40eb-9800-ec0715bbf364 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:04.560936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1d81c314-1f09-40eb-9800-ec0715bbf364 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:04.571450 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1d81c314-1f09-40eb-9800-ec0715bbf364 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a" status: 200 len: 1506 microversion: 2.1 time: 0.168542 Aug 24 11:13:04.572201 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3702/7042] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:04 2022] GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:04.600394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a13b23b2-d119-4e1f-86c2-c46700b29ecb tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:04.601452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a13b23b2-d119-4e1f-86c2-c46700b29ecb tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: b0c16368-f5df-4cca-b411-cab473919098] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:04.612035 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a13b23b2-d119-4e1f-86c2-c46700b29ecb tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:04.612521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a13b23b2-d119-4e1f-86c2-c46700b29ecb tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:04.612957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a13b23b2-d119-4e1f-86c2-c46700b29ecb tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:04.613690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a13b23b2-d119-4e1f-86c2-c46700b29ecb tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:04.614149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a13b23b2-d119-4e1f-86c2-c46700b29ecb tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:04.614571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a13b23b2-d119-4e1f-86c2-c46700b29ecb tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:04.628219 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-a13b23b2-d119-4e1f-86c2-c46700b29ecb tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] HTTP exception thrown: Instance b0c16368-f5df-4cca-b411-cab473919098 could not be found. Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a13b23b2-d119-4e1f-86c2-c46700b29ecb tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Request method failure captured: Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098 HTTP/1.1 Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgekbPcl5lwri6YH7Tjkl1EP3XKZeGCH8eifeJJRibjnkWpcsuBrkqJe66-GN3B0ps0sn6PFYof1_OMvr2WTUy7GESxpVaLs6HWrZIHWhsQDLyHUYwglC2b5z_e2NxI4JufLxz_t4I8-bNRLjRaiOBnHJF-b7Rjt9aouXISoWua-lqA Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: e2bc36e65c034436ab8421ee91f9f1ec Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-714232356 Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e2bc36e65c034436ab8421ee91f9f1ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e2bc36e65c034436ab8421ee91f9f1ec", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e2bc36e65c034436ab8421ee91f9f1ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e2bc36e65c034436ab8421ee91f9f1ec"}]}] Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-714232356 Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: e2bc36e65c034436ab8421ee91f9f1ec Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-714232356 Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-714232356-project Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: 41a54f6758e44b788efd37691f87ef7e Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-714232356-project Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance b0c16368-f5df-4cca-b411-cab473919098 could not be found. Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'b0c16368-f5df-4cca-b411-cab473919098'} Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c16368-f5df-4cca-b411-cab473919098 could not be found. Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:13:04.629832 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:13:04.634204 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c16368-f5df-4cca-b411-cab473919098 could not be found. Aug 24 11:13:04.634204 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:13:04.634204 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:13:04.634204 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:13:04.634204 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:13:04.634204 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:13:04.634204 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:13:04.634204 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:13:04.634204 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:13:04.634204 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c16368-f5df-4cca-b411-cab473919098 could not be found. Aug 24 11:13:04.634204 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:13:04.634204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a13b23b2-d119-4e1f-86c2-c46700b29ecb tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Returning 404 to user: Instance b0c16368-f5df-4cca-b411-cab473919098 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:13:04.634204 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a13b23b2-d119-4e1f-86c2-c46700b29ecb tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098" status: 404 len: 111 microversion: 2.1 time: 0.038920 Aug 24 11:13:04.634204 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3341/7043] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:13:04 2022] DELETE /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 11:13:04.640147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b6c194df-84bb-4d8f-932c-64371aba238a tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:04.640857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b6c194df-84bb-4d8f-932c-64371aba238a tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: b0c16368-f5df-4cca-b411-cab473919098] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:04.648490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6c194df-84bb-4d8f-932c-64371aba238a tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:04.648490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6c194df-84bb-4d8f-932c-64371aba238a tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:04.648490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6c194df-84bb-4d8f-932c-64371aba238a tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:04.648490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6c194df-84bb-4d8f-932c-64371aba238a tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:04.649480 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6c194df-84bb-4d8f-932c-64371aba238a tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:04.649648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6c194df-84bb-4d8f-932c-64371aba238a tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:04.663778 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-b6c194df-84bb-4d8f-932c-64371aba238a tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] HTTP exception thrown: Instance b0c16368-f5df-4cca-b411-cab473919098 could not be found. Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b6c194df-84bb-4d8f-932c-64371aba238a tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Request method failure captured: Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098 HTTP/1.1 Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgekbPcl5lwri6YH7Tjkl1EP3XKZeGCH8eifeJJRibjnkWpcsuBrkqJe66-GN3B0ps0sn6PFYof1_OMvr2WTUy7GESxpVaLs6HWrZIHWhsQDLyHUYwglC2b5z_e2NxI4JufLxz_t4I8-bNRLjRaiOBnHJF-b7Rjt9aouXISoWua-lqA Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: e2bc36e65c034436ab8421ee91f9f1ec Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-714232356 Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e2bc36e65c034436ab8421ee91f9f1ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e2bc36e65c034436ab8421ee91f9f1ec", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e2bc36e65c034436ab8421ee91f9f1ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e2bc36e65c034436ab8421ee91f9f1ec"}]}] Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-714232356 Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: e2bc36e65c034436ab8421ee91f9f1ec Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-714232356 Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-714232356-project Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 41a54f6758e44b788efd37691f87ef7e Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-714232356-project Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance b0c16368-f5df-4cca-b411-cab473919098 could not be found. Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'b0c16368-f5df-4cca-b411-cab473919098'} Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c16368-f5df-4cca-b411-cab473919098 could not be found. Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c16368-f5df-4cca-b411-cab473919098 could not be found. Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:13:04.665455 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:13:04.669670 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:13:04.669670 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:13:04.669670 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:13:04.669670 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:13:04.669670 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:13:04.669670 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c16368-f5df-4cca-b411-cab473919098 could not be found. Aug 24 11:13:04.669670 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:13:04.669670 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b6c194df-84bb-4d8f-932c-64371aba238a tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Returning 404 to user: Instance b0c16368-f5df-4cca-b411-cab473919098 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:13:04.669670 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b6c194df-84bb-4d8f-932c-64371aba238a tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098" status: 404 len: 111 microversion: 2.1 time: 0.030779 Aug 24 11:13:04.669670 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3703/7044] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:04 2022] GET /compute/v2.1/servers/b0c16368-f5df-4cca-b411-cab473919098 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 11:13:04.675763 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-18181336-980d-4822-a64b-33def3e881c9 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:04.676261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-18181336-980d-4822-a64b-33def3e881c9 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: 1f905769-98f7-4215-8cec-8a850042915a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:04.682330 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18181336-980d-4822-a64b-33def3e881c9 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:04.682817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18181336-980d-4822-a64b-33def3e881c9 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:04.683263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18181336-980d-4822-a64b-33def3e881c9 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:04.683961 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18181336-980d-4822-a64b-33def3e881c9 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:04.684650 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18181336-980d-4822-a64b-33def3e881c9 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:04.685256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18181336-980d-4822-a64b-33def3e881c9 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:04.711080 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-18181336-980d-4822-a64b-33def3e881c9 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: 1f905769-98f7-4215-8cec-8a850042915a] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:13:04.794165 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-18181336-980d-4822-a64b-33def3e881c9 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "DELETE /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a" status: 204 len: 0 microversion: 2.1 time: 0.121895 Aug 24 11:13:04.794749 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3342/7045] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:13:04 2022] DELETE /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:13:04.803164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-053241c4-36a6-47b2-a5c8-73a37b65a9a2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:04.803729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-053241c4-36a6-47b2-a5c8-73a37b65a9a2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: 1f905769-98f7-4215-8cec-8a850042915a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:04.810472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-053241c4-36a6-47b2-a5c8-73a37b65a9a2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:04.810984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-053241c4-36a6-47b2-a5c8-73a37b65a9a2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:04.811434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-053241c4-36a6-47b2-a5c8-73a37b65a9a2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:04.812154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-053241c4-36a6-47b2-a5c8-73a37b65a9a2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:04.812627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-053241c4-36a6-47b2-a5c8-73a37b65a9a2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:04.813070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-053241c4-36a6-47b2-a5c8-73a37b65a9a2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:04.968719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-053241c4-36a6-47b2-a5c8-73a37b65a9a2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:04.976921 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-053241c4-36a6-47b2-a5c8-73a37b65a9a2 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a" status: 200 len: 1512 microversion: 2.1 time: 0.177811 Aug 24 11:13:04.977604 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3704/7046] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:04 2022] GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:05.999605 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e7c6c1a6-200e-4750-9468-b74aa6c2278c tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:06.000324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e7c6c1a6-200e-4750-9468-b74aa6c2278c tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: 1f905769-98f7-4215-8cec-8a850042915a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:06.007975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7c6c1a6-200e-4750-9468-b74aa6c2278c tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:06.008490 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7c6c1a6-200e-4750-9468-b74aa6c2278c tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:06.008938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7c6c1a6-200e-4750-9468-b74aa6c2278c tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:06.009701 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7c6c1a6-200e-4750-9468-b74aa6c2278c tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:06.010171 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7c6c1a6-200e-4750-9468-b74aa6c2278c tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:06.010612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7c6c1a6-200e-4750-9468-b74aa6c2278c tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:06.016629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:13:06.158367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e7c6c1a6-200e-4750-9468-b74aa6c2278c tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:06.167733 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e7c6c1a6-200e-4750-9468-b74aa6c2278c tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a" status: 200 len: 1512 microversion: 2.1 time: 0.172492 Aug 24 11:13:06.168529 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3343/7047] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:05 2022] GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:06.789684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-e6477103-6b2c-4069-bbf5-8bf733dff728 req-265487c8-d9da-42c8-ba04-9818400057b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f905769-98f7-4215-8cec-8a850042915a", "name": "network-vif-deleted", "tag": "b4198cca-6380-4dd0-9ab8-bc69100aa406"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:13:06.807074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e6477103-6b2c-4069-bbf5-8bf733dff728 req-265487c8-d9da-42c8-ba04-9818400057b9 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:06.808082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e6477103-6b2c-4069-bbf5-8bf733dff728 req-265487c8-d9da-42c8-ba04-9818400057b9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:06.808914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e6477103-6b2c-4069-bbf5-8bf733dff728 req-265487c8-d9da-42c8-ba04-9818400057b9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:06.822455 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-e6477103-6b2c-4069-bbf5-8bf733dff728 req-265487c8-d9da-42c8-ba04-9818400057b9 service nova] Creating event network-vif-deleted:b4198cca-6380-4dd0-9ab8-bc69100aa406 for instance 1f905769-98f7-4215-8cec-8a850042915a on n-h2-849328-3 Aug 24 11:13:06.834561 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-e6477103-6b2c-4069-bbf5-8bf733dff728 req-265487c8-d9da-42c8-ba04-9818400057b9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049519 Aug 24 11:13:06.835537 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3705/7048] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:13:07.189986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fcc3e592-ff36-4a8f-9c7d-1b0962bd052e tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:07.190852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fcc3e592-ff36-4a8f-9c7d-1b0962bd052e tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: 1f905769-98f7-4215-8cec-8a850042915a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:07.198015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fcc3e592-ff36-4a8f-9c7d-1b0962bd052e tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:07.198499 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fcc3e592-ff36-4a8f-9c7d-1b0962bd052e tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:07.198936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fcc3e592-ff36-4a8f-9c7d-1b0962bd052e tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:07.199625 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fcc3e592-ff36-4a8f-9c7d-1b0962bd052e tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:07.200075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fcc3e592-ff36-4a8f-9c7d-1b0962bd052e tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:07.200494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fcc3e592-ff36-4a8f-9c7d-1b0962bd052e tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:07.233486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fcc3e592-ff36-4a8f-9c7d-1b0962bd052e tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:07.233982 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fcc3e592-ff36-4a8f-9c7d-1b0962bd052e tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:07.234476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fcc3e592-ff36-4a8f-9c7d-1b0962bd052e tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:07.235197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-fcc3e592-ff36-4a8f-9c7d-1b0962bd052e tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lazy-loading 'fault' on Instance uuid 1f905769-98f7-4215-8cec-8a850042915a {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:13:07.277814 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fcc3e592-ff36-4a8f-9c7d-1b0962bd052e tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a54f6758e44b788efd37691f87ef7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bc36e65c034436ab8421ee91f9f1ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:07.286215 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fcc3e592-ff36-4a8f-9c7d-1b0962bd052e tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a" status: 200 len: 1307 microversion: 2.1 time: 0.100140 Aug 24 11:13:07.286651 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3344/7049] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:07 2022] GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:08.308608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-316fd82d-7814-4236-b1c2-11163aa95c36 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:08.309338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-316fd82d-7814-4236-b1c2-11163aa95c36 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] [instance: 1f905769-98f7-4215-8cec-8a850042915a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:08.316366 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-316fd82d-7814-4236-b1c2-11163aa95c36 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:08.316891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-316fd82d-7814-4236-b1c2-11163aa95c36 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:08.317351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-316fd82d-7814-4236-b1c2-11163aa95c36 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:08.318053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-316fd82d-7814-4236-b1c2-11163aa95c36 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:08.318517 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-316fd82d-7814-4236-b1c2-11163aa95c36 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:08.318954 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-316fd82d-7814-4236-b1c2-11163aa95c36 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:08.333585 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-316fd82d-7814-4236-b1c2-11163aa95c36 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] HTTP exception thrown: Instance 1f905769-98f7-4215-8cec-8a850042915a could not be found. Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-316fd82d-7814-4236-b1c2-11163aa95c36 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Request method failure captured: Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a HTTP/1.1 Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgekbPcl5lwri6YH7Tjkl1EP3XKZeGCH8eifeJJRibjnkWpcsuBrkqJe66-GN3B0ps0sn6PFYof1_OMvr2WTUy7GESxpVaLs6HWrZIHWhsQDLyHUYwglC2b5z_e2NxI4JufLxz_t4I8-bNRLjRaiOBnHJF-b7Rjt9aouXISoWua-lqA Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: e2bc36e65c034436ab8421ee91f9f1ec Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-714232356 Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e2bc36e65c034436ab8421ee91f9f1ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e2bc36e65c034436ab8421ee91f9f1ec", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e2bc36e65c034436ab8421ee91f9f1ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e2bc36e65c034436ab8421ee91f9f1ec"}]}] Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-714232356 Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: e2bc36e65c034436ab8421ee91f9f1ec Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-714232356 Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-714232356-project Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 41a54f6758e44b788efd37691f87ef7e Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-714232356-project Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 1f905769-98f7-4215-8cec-8a850042915a could not be found. Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '1f905769-98f7-4215-8cec-8a850042915a'} Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f905769-98f7-4215-8cec-8a850042915a could not be found. Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f905769-98f7-4215-8cec-8a850042915a could not be found. Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:13:08.335233 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:13:08.339038 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:13:08.339038 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:13:08.339038 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:13:08.339038 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:13:08.339038 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:13:08.339038 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f905769-98f7-4215-8cec-8a850042915a could not be found. Aug 24 11:13:08.339038 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:13:08.339038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-316fd82d-7814-4236-b1c2-11163aa95c36 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] Returning 404 to user: Instance 1f905769-98f7-4215-8cec-8a850042915a could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:13:08.339038 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-316fd82d-7814-4236-b1c2-11163aa95c36 tempest-ServersNegativeTestJSON-714232356 tempest-ServersNegativeTestJSON-714232356-project] 10.222.0.85 "GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a" status: 404 len: 111 microversion: 2.1 time: 0.033313 Aug 24 11:13:08.339038 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3706/7050] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:08 2022] GET /compute/v2.1/servers/1f905769-98f7-4215-8cec-8a850042915a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:13:41.933051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:13:41.934255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=12 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:13:42.123480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-05492aab-6949-4434-a76d-c6ed0e8bda2e tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Action: 'create', calling method: .version_select at 0x7f4654fd6ca0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1607842191", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRVT1b9sIfDJgVU94FVWqZi2KpnouKaqc3quBgWpPEJRY/NcJB5niMEffNhcx6V3RzT3xR/pjdBUcgy7+6BxakGPn0ckWMYI28cdP8Pby/AieMtDRHo/zwi2KAWQnZ/ZQ=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:13:42.183238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-05492aab-6949-4434-a76d-c6ed0e8bda2e tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Getting quotas for project bc838a17ae334ea48e149b6b5010e857. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:13:42.189371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-05492aab-6949-4434-a76d-c6ed0e8bda2e tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Getting quotas for user d7c0ac68e72f40faaff82435f960b81a and project bc838a17ae334ea48e149b6b5010e857. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:13:42.225496 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-05492aab-6949-4434-a76d-c6ed0e8bda2e tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.297570 Aug 24 11:13:42.226660 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3345/7051] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 11:13:41 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:13:42.280462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e49d207c-676f-4174-bc0f-51cac03b73df tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1723538135", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1607842191", "networks": [{"uuid": "e61a9b3f-0cff-4c72-823f-b1da0d5845a9"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:13:42.296259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:13:42.297333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=32 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:13:42.346162 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-e49d207c-676f-4174-bc0f-51cac03b73df tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] validate_networks() for [('e61a9b3f-0cff-4c72-823f-b1da0d5845a9', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:13:42.736707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e49d207c-676f-4174-bc0f-51cac03b73df tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:13:42.737168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e49d207c-676f-4174-bc0f-51cac03b73df tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:13:42.737677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e49d207c-676f-4174-bc0f-51cac03b73df tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:13:42.738105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e49d207c-676f-4174-bc0f-51cac03b73df tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:13:42.738535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e49d207c-676f-4174-bc0f-51cac03b73df tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:13:42.748264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e49d207c-676f-4174-bc0f-51cac03b73df tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:42.748773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e49d207c-676f-4174-bc0f-51cac03b73df tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:42.749279 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e49d207c-676f-4174-bc0f-51cac03b73df tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:42.750061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e49d207c-676f-4174-bc0f-51cac03b73df tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:42.750530 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e49d207c-676f-4174-bc0f-51cac03b73df tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:42.750970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e49d207c-676f-4174-bc0f-51cac03b73df tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:42.769802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-e49d207c-676f-4174-bc0f-51cac03b73df tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Getting quotas for project bc838a17ae334ea48e149b6b5010e857. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:13:42.775272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-e49d207c-676f-4174-bc0f-51cac03b73df tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Getting quotas for user d7c0ac68e72f40faaff82435f960b81a and project bc838a17ae334ea48e149b6b5010e857. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:13:42.788616 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e49d207c-676f-4174-bc0f-51cac03b73df tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:13:42.790969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e49d207c-676f-4174-bc0f-51cac03b73df tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: b7f0754c-9e78-4e0f-a4b0-154acf00a2b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:13:42.842030 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e49d207c-676f-4174-bc0f-51cac03b73df tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.565812 Aug 24 11:13:42.842711 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3707/7052] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 11:13:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 11:13:42.853661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-edbf797a-5d4b-4b87-bce6-587e9548d79f tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:42.854272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-edbf797a-5d4b-4b87-bce6-587e9548d79f tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: b7f0754c-9e78-4e0f-a4b0-154acf00a2b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:42.908935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-edbf797a-5d4b-4b87-bce6-587e9548d79f tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:42.916060 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-edbf797a-5d4b-4b87-bce6-587e9548d79f tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4" status: 200 len: 1263 microversion: 2.1 time: 0.066522 Aug 24 11:13:42.916898 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3346/7053] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:42 2022] GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 => generated 1263 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:43.936679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-996bdca6-d6c7-42b7-943f-7ff74f329bb6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:43.938829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-996bdca6-d6c7-42b7-943f-7ff74f329bb6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: b7f0754c-9e78-4e0f-a4b0-154acf00a2b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:43.946844 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-996bdca6-d6c7-42b7-943f-7ff74f329bb6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:43.947353 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-996bdca6-d6c7-42b7-943f-7ff74f329bb6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:43.947811 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-996bdca6-d6c7-42b7-943f-7ff74f329bb6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:43.948523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-996bdca6-d6c7-42b7-943f-7ff74f329bb6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:43.949156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-996bdca6-d6c7-42b7-943f-7ff74f329bb6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:43.949613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-996bdca6-d6c7-42b7-943f-7ff74f329bb6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:44.057063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-996bdca6-d6c7-42b7-943f-7ff74f329bb6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:44.065691 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-996bdca6-d6c7-42b7-943f-7ff74f329bb6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4" status: 200 len: 1323 microversion: 2.1 time: 0.133322 Aug 24 11:13:44.066319 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3708/7054] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:43 2022] GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 => generated 1323 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:45.087705 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c49d68ad-20d2-455b-912e-644ac9f72227 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:45.089268 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c49d68ad-20d2-455b-912e-644ac9f72227 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: b7f0754c-9e78-4e0f-a4b0-154acf00a2b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:45.098190 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c49d68ad-20d2-455b-912e-644ac9f72227 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:45.099183 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c49d68ad-20d2-455b-912e-644ac9f72227 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:45.099697 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c49d68ad-20d2-455b-912e-644ac9f72227 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:45.100685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c49d68ad-20d2-455b-912e-644ac9f72227 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:45.101240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c49d68ad-20d2-455b-912e-644ac9f72227 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:45.101760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c49d68ad-20d2-455b-912e-644ac9f72227 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:45.299307 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c49d68ad-20d2-455b-912e-644ac9f72227 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:45.309994 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c49d68ad-20d2-455b-912e-644ac9f72227 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4" status: 200 len: 1363 microversion: 2.1 time: 0.226313 Aug 24 11:13:45.325147 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3347/7055] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:45 2022] GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:45.793793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-578f92a6-27e9-48c5-946c-0b73306488df req-dbcd8887-a643-40fe-8659-4bb641038b4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7f0754c-9e78-4e0f-a4b0-154acf00a2b4", "tag": "79796880-63e9-45d4-beea-c144fe198609"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:13:45.806668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-578f92a6-27e9-48c5-946c-0b73306488df req-dbcd8887-a643-40fe-8659-4bb641038b4b service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:45.807524 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-578f92a6-27e9-48c5-946c-0b73306488df req-dbcd8887-a643-40fe-8659-4bb641038b4b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:45.808229 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-578f92a6-27e9-48c5-946c-0b73306488df req-dbcd8887-a643-40fe-8659-4bb641038b4b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:45.823535 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-578f92a6-27e9-48c5-946c-0b73306488df req-dbcd8887-a643-40fe-8659-4bb641038b4b service nova] Creating event network-changed:79796880-63e9-45d4-beea-c144fe198609 for instance b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 on n-h1-849328-3 Aug 24 11:13:45.833863 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-578f92a6-27e9-48c5-946c-0b73306488df req-dbcd8887-a643-40fe-8659-4bb641038b4b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046324 Aug 24 11:13:45.842037 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3709/7056] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:13:46.334594 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3c9088e3-faf2-4f28-b005-a483da8ab35c tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:46.335987 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3c9088e3-faf2-4f28-b005-a483da8ab35c tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: b7f0754c-9e78-4e0f-a4b0-154acf00a2b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:46.344227 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c9088e3-faf2-4f28-b005-a483da8ab35c tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:46.344729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c9088e3-faf2-4f28-b005-a483da8ab35c tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:46.345367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c9088e3-faf2-4f28-b005-a483da8ab35c tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:46.346136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c9088e3-faf2-4f28-b005-a483da8ab35c tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:46.346591 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c9088e3-faf2-4f28-b005-a483da8ab35c tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:46.347008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c9088e3-faf2-4f28-b005-a483da8ab35c tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:46.495738 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3c9088e3-faf2-4f28-b005-a483da8ab35c tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:46.504953 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3c9088e3-faf2-4f28-b005-a483da8ab35c tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4" status: 200 len: 1363 microversion: 2.1 time: 0.175575 Aug 24 11:13:46.517008 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3348/7057] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:46 2022] GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:47.528450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-db3801a6-5add-4f59-8311-f395e049e724 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:47.529259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-db3801a6-5add-4f59-8311-f395e049e724 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: b7f0754c-9e78-4e0f-a4b0-154acf00a2b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:47.536194 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db3801a6-5add-4f59-8311-f395e049e724 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:47.538653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db3801a6-5add-4f59-8311-f395e049e724 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:47.539377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db3801a6-5add-4f59-8311-f395e049e724 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:47.540288 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db3801a6-5add-4f59-8311-f395e049e724 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:47.540902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db3801a6-5add-4f59-8311-f395e049e724 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:47.542655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db3801a6-5add-4f59-8311-f395e049e724 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:47.692810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-db3801a6-5add-4f59-8311-f395e049e724 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:47.700974 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-db3801a6-5add-4f59-8311-f395e049e724 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4" status: 200 len: 1363 microversion: 2.1 time: 0.178355 Aug 24 11:13:47.701616 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3710/7058] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:47 2022] GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:48.725881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df7b3af1-7b8a-410a-a765-541b3b29f965 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:48.727006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-df7b3af1-7b8a-410a-a765-541b3b29f965 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: b7f0754c-9e78-4e0f-a4b0-154acf00a2b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:48.736484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df7b3af1-7b8a-410a-a765-541b3b29f965 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:48.736977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df7b3af1-7b8a-410a-a765-541b3b29f965 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:48.737452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df7b3af1-7b8a-410a-a765-541b3b29f965 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:48.738157 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df7b3af1-7b8a-410a-a765-541b3b29f965 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:48.738611 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df7b3af1-7b8a-410a-a765-541b3b29f965 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:48.739054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df7b3af1-7b8a-410a-a765-541b3b29f965 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:48.875192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-df7b3af1-7b8a-410a-a765-541b3b29f965 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:48.885722 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-df7b3af1-7b8a-410a-a765-541b3b29f965 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4" status: 200 len: 1363 microversion: 2.1 time: 0.166470 Aug 24 11:13:48.886342 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3349/7059] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:48 2022] GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:49.907616 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-309854be-f086-4d3d-8968-b95e8cf3ccc9 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:49.908233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-309854be-f086-4d3d-8968-b95e8cf3ccc9 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: b7f0754c-9e78-4e0f-a4b0-154acf00a2b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:49.916250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-309854be-f086-4d3d-8968-b95e8cf3ccc9 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:49.916882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-309854be-f086-4d3d-8968-b95e8cf3ccc9 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:49.917534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-309854be-f086-4d3d-8968-b95e8cf3ccc9 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:49.918566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-309854be-f086-4d3d-8968-b95e8cf3ccc9 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:49.919183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-309854be-f086-4d3d-8968-b95e8cf3ccc9 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:49.920062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-309854be-f086-4d3d-8968-b95e8cf3ccc9 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:50.062135 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-309854be-f086-4d3d-8968-b95e8cf3ccc9 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:50.073750 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-309854be-f086-4d3d-8968-b95e8cf3ccc9 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4" status: 200 len: 1363 microversion: 2.1 time: 0.170053 Aug 24 11:13:50.074584 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3711/7060] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:49 2022] GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:13:51.098780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-146fadaf-61a6-4736-b6fd-27d9ff3c5b35 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:51.099880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-146fadaf-61a6-4736-b6fd-27d9ff3c5b35 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: b7f0754c-9e78-4e0f-a4b0-154acf00a2b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:51.110010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-146fadaf-61a6-4736-b6fd-27d9ff3c5b35 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:51.110504 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-146fadaf-61a6-4736-b6fd-27d9ff3c5b35 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:51.111292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-146fadaf-61a6-4736-b6fd-27d9ff3c5b35 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:51.111990 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-146fadaf-61a6-4736-b6fd-27d9ff3c5b35 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:51.112446 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-146fadaf-61a6-4736-b6fd-27d9ff3c5b35 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:51.112876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-146fadaf-61a6-4736-b6fd-27d9ff3c5b35 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:51.245851 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-146fadaf-61a6-4736-b6fd-27d9ff3c5b35 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:51.254451 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-146fadaf-61a6-4736-b6fd-27d9ff3c5b35 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4" status: 200 len: 1363 microversion: 2.1 time: 0.162386 Aug 24 11:13:51.255034 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3350/7061] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:51 2022] GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:51.974195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-91576a68-2c80-4d3c-aceb-0b1adaee95ea req-61e68566-dc9d-42ed-948d-43bf783e61d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f0754c-9e78-4e0f-a4b0-154acf00a2b4", "name": "network-vif-plugged", "status": "completed", "tag": "79796880-63e9-45d4-beea-c144fe198609"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:13:51.985529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-91576a68-2c80-4d3c-aceb-0b1adaee95ea req-61e68566-dc9d-42ed-948d-43bf783e61d2 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:51.986439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-91576a68-2c80-4d3c-aceb-0b1adaee95ea req-61e68566-dc9d-42ed-948d-43bf783e61d2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:51.986895 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-91576a68-2c80-4d3c-aceb-0b1adaee95ea req-61e68566-dc9d-42ed-948d-43bf783e61d2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:51.999613 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-91576a68-2c80-4d3c-aceb-0b1adaee95ea req-61e68566-dc9d-42ed-948d-43bf783e61d2 service nova] Creating event network-vif-plugged:79796880-63e9-45d4-beea-c144fe198609 for instance b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 on n-h1-849328-3 Aug 24 11:13:52.006043 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-91576a68-2c80-4d3c-aceb-0b1adaee95ea req-61e68566-dc9d-42ed-948d-43bf783e61d2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035306 Aug 24 11:13:52.006958 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3712/7062] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:13:52.275760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1b239941-663a-4abf-962b-27e99eb4951d tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:52.276375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1b239941-663a-4abf-962b-27e99eb4951d tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: b7f0754c-9e78-4e0f-a4b0-154acf00a2b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:52.284598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b239941-663a-4abf-962b-27e99eb4951d tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:52.285086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b239941-663a-4abf-962b-27e99eb4951d tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:52.285550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b239941-663a-4abf-962b-27e99eb4951d tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:52.286265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b239941-663a-4abf-962b-27e99eb4951d tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:52.286715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b239941-663a-4abf-962b-27e99eb4951d tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:52.287235 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b239941-663a-4abf-962b-27e99eb4951d tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:52.427829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1b239941-663a-4abf-962b-27e99eb4951d tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:52.438400 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1b239941-663a-4abf-962b-27e99eb4951d tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4" status: 200 len: 1363 microversion: 2.1 time: 0.166749 Aug 24 11:13:52.438995 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3351/7063] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:52 2022] GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:53.462016 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fc85f85a-9850-4e07-99be-15bef58d492e tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:53.462822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fc85f85a-9850-4e07-99be-15bef58d492e tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: b7f0754c-9e78-4e0f-a4b0-154acf00a2b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:53.465017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:13:53.465806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:13:53.473107 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc85f85a-9850-4e07-99be-15bef58d492e tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:53.473788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc85f85a-9850-4e07-99be-15bef58d492e tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:53.474343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc85f85a-9850-4e07-99be-15bef58d492e tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:53.475057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc85f85a-9850-4e07-99be-15bef58d492e tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:53.475571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc85f85a-9850-4e07-99be-15bef58d492e tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:53.476054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc85f85a-9850-4e07-99be-15bef58d492e tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:53.621988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fc85f85a-9850-4e07-99be-15bef58d492e tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:53.630359 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fc85f85a-9850-4e07-99be-15bef58d492e tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4" status: 200 len: 1556 microversion: 2.1 time: 0.173321 Aug 24 11:13:53.630966 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3713/7064] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:53 2022] GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 => generated 1556 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:53.650727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a4532d1b-49d4-4c5d-97b5-3885810d4d07 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:53.651316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a4532d1b-49d4-4c5d-97b5-3885810d4d07 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: b7f0754c-9e78-4e0f-a4b0-154acf00a2b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:53.653290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:13:53.660948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4532d1b-49d4-4c5d-97b5-3885810d4d07 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:53.661834 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4532d1b-49d4-4c5d-97b5-3885810d4d07 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:53.662938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4532d1b-49d4-4c5d-97b5-3885810d4d07 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:53.663553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4532d1b-49d4-4c5d-97b5-3885810d4d07 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:53.664209 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4532d1b-49d4-4c5d-97b5-3885810d4d07 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:53.664830 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4532d1b-49d4-4c5d-97b5-3885810d4d07 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:53.815172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a4532d1b-49d4-4c5d-97b5-3885810d4d07 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:53.823186 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a4532d1b-49d4-4c5d-97b5-3885810d4d07 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4" status: 200 len: 1556 microversion: 2.1 time: 0.176636 Aug 24 11:13:53.823787 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3352/7065] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:53 2022] GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 => generated 1556 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:55.537992 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-62383701-2d36-47ac-a0b0-9cf1a39c25c2 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6c16869-2f1e-4e47-b30e-aa8ec02681b5"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:13:55.540383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-62383701-2d36-47ac-a0b0-9cf1a39c25c2 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: b7f0754c-9e78-4e0f-a4b0-154acf00a2b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:55.547969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62383701-2d36-47ac-a0b0-9cf1a39c25c2 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:55.548475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62383701-2d36-47ac-a0b0-9cf1a39c25c2 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:55.548929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62383701-2d36-47ac-a0b0-9cf1a39c25c2 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:55.549679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62383701-2d36-47ac-a0b0-9cf1a39c25c2 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:55.550149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62383701-2d36-47ac-a0b0-9cf1a39c25c2 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:55.550594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62383701-2d36-47ac-a0b0-9cf1a39c25c2 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:55.847784 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-62383701-2d36-47ac-a0b0-9cf1a39c25c2 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "POST /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313694 Aug 24 11:13:55.848450 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3714/7066] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Aug 24 11:13:55 2022] POST /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:14:06.591883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-af21b8ce-3799-4317-b2d6-bb6aaa1f3540 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:06.592475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-af21b8ce-3799-4317-b2d6-bb6aaa1f3540 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: b7f0754c-9e78-4e0f-a4b0-154acf00a2b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:06.595474 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:14:06.596331 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=36 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:14:06.602491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af21b8ce-3799-4317-b2d6-bb6aaa1f3540 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:06.602985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af21b8ce-3799-4317-b2d6-bb6aaa1f3540 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:06.603431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af21b8ce-3799-4317-b2d6-bb6aaa1f3540 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:06.604144 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af21b8ce-3799-4317-b2d6-bb6aaa1f3540 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:06.604599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af21b8ce-3799-4317-b2d6-bb6aaa1f3540 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:06.605026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af21b8ce-3799-4317-b2d6-bb6aaa1f3540 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:06.745101 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-af21b8ce-3799-4317-b2d6-bb6aaa1f3540 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lazy-loading 'services' on Instance uuid b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:14:06.821489 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-af21b8ce-3799-4317-b2d6-bb6aaa1f3540 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4/os-volume_attachments/e6c16869-2f1e-4e47-b30e-aa8ec02681b5" status: 202 len: 0 microversion: 2.1 time: 0.233507 Aug 24 11:14:06.822145 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3353/7067] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Aug 24 11:14:06 2022] DELETE /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4/os-volume_attachments/e6c16869-2f1e-4e47-b30e-aa8ec02681b5 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:14:06.828821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:14:06.829841 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:14:06.834273 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3901b0d7-b5eb-49e2-89e5-346c73cb81dd tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:06.836697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3901b0d7-b5eb-49e2-89e5-346c73cb81dd tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: b7f0754c-9e78-4e0f-a4b0-154acf00a2b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:06.844598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3901b0d7-b5eb-49e2-89e5-346c73cb81dd tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:06.845268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3901b0d7-b5eb-49e2-89e5-346c73cb81dd tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:06.845703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3901b0d7-b5eb-49e2-89e5-346c73cb81dd tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:06.846435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3901b0d7-b5eb-49e2-89e5-346c73cb81dd tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:06.846897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3901b0d7-b5eb-49e2-89e5-346c73cb81dd tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:06.847331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3901b0d7-b5eb-49e2-89e5-346c73cb81dd tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:06.879299 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3901b0d7-b5eb-49e2-89e5-346c73cb81dd tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052378 Aug 24 11:14:06.879880 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3715/7068] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:14:06 2022] GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:14:07.893750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-947b25ff-b16c-4802-be16-d24d47ebc685 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:07.896130 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-947b25ff-b16c-4802-be16-d24d47ebc685 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: b7f0754c-9e78-4e0f-a4b0-154acf00a2b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:07.903127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-947b25ff-b16c-4802-be16-d24d47ebc685 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:07.903627 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-947b25ff-b16c-4802-be16-d24d47ebc685 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:07.904074 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-947b25ff-b16c-4802-be16-d24d47ebc685 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:07.904780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-947b25ff-b16c-4802-be16-d24d47ebc685 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:07.905276 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-947b25ff-b16c-4802-be16-d24d47ebc685 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:07.905706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-947b25ff-b16c-4802-be16-d24d47ebc685 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:07.936980 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-947b25ff-b16c-4802-be16-d24d47ebc685 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048575 Aug 24 11:14:07.937965 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3354/7069] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:14:07 2022] GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:14:08.953837 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-707546f4-e642-4f12-b229-9e9a92fdb19b tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:08.956411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-707546f4-e642-4f12-b229-9e9a92fdb19b tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: b7f0754c-9e78-4e0f-a4b0-154acf00a2b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:08.964105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-707546f4-e642-4f12-b229-9e9a92fdb19b tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:08.964650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-707546f4-e642-4f12-b229-9e9a92fdb19b tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:08.965108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-707546f4-e642-4f12-b229-9e9a92fdb19b tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:08.965876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-707546f4-e642-4f12-b229-9e9a92fdb19b tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:08.966349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-707546f4-e642-4f12-b229-9e9a92fdb19b tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:08.966800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-707546f4-e642-4f12-b229-9e9a92fdb19b tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:08.999665 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-707546f4-e642-4f12-b229-9e9a92fdb19b tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052629 Aug 24 11:14:09.000254 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3716/7070] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:14:08 2022] GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:14:10.012398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d80a54ad-1932-4155-88c7-6fec31c3a6c5 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:10.014786 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d80a54ad-1932-4155-88c7-6fec31c3a6c5 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: b7f0754c-9e78-4e0f-a4b0-154acf00a2b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:10.022122 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d80a54ad-1932-4155-88c7-6fec31c3a6c5 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:10.022617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d80a54ad-1932-4155-88c7-6fec31c3a6c5 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:10.023052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d80a54ad-1932-4155-88c7-6fec31c3a6c5 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:10.023758 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d80a54ad-1932-4155-88c7-6fec31c3a6c5 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:10.024239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d80a54ad-1932-4155-88c7-6fec31c3a6c5 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:10.024658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d80a54ad-1932-4155-88c7-6fec31c3a6c5 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:10.055559 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d80a54ad-1932-4155-88c7-6fec31c3a6c5 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047173 Aug 24 11:14:10.056031 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3355/7071] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:14:10 2022] GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:14:11.067627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fca47a95-2062-4008-bbe5-f4607e1e7ba4 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:11.069928 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fca47a95-2062-4008-bbe5-f4607e1e7ba4 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: b7f0754c-9e78-4e0f-a4b0-154acf00a2b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:11.077294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fca47a95-2062-4008-bbe5-f4607e1e7ba4 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:11.077802 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fca47a95-2062-4008-bbe5-f4607e1e7ba4 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:11.078243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fca47a95-2062-4008-bbe5-f4607e1e7ba4 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:11.078952 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fca47a95-2062-4008-bbe5-f4607e1e7ba4 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:11.079419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fca47a95-2062-4008-bbe5-f4607e1e7ba4 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:11.079877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fca47a95-2062-4008-bbe5-f4607e1e7ba4 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:11.113755 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fca47a95-2062-4008-bbe5-f4607e1e7ba4 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050200 Aug 24 11:14:11.114376 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3717/7072] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:14:11 2022] GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:14:12.129974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f1b87d88-15dc-4d33-ba16-337a8db94c08 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:12.133502 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f1b87d88-15dc-4d33-ba16-337a8db94c08 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: b7f0754c-9e78-4e0f-a4b0-154acf00a2b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:12.144335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1b87d88-15dc-4d33-ba16-337a8db94c08 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:12.144880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1b87d88-15dc-4d33-ba16-337a8db94c08 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:12.145368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1b87d88-15dc-4d33-ba16-337a8db94c08 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:12.146495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1b87d88-15dc-4d33-ba16-337a8db94c08 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:12.146939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1b87d88-15dc-4d33-ba16-337a8db94c08 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:12.147424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1b87d88-15dc-4d33-ba16-337a8db94c08 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:12.186433 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f1b87d88-15dc-4d33-ba16-337a8db94c08 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063598 Aug 24 11:14:12.187011 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3356/7073] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:14:12 2022] GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:14:12.198367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f8f38a9-d5d8-4604-bf00-900e3b874c88 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:12.198918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0f8f38a9-d5d8-4604-bf00-900e3b874c88 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: b7f0754c-9e78-4e0f-a4b0-154acf00a2b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:12.206033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f8f38a9-d5d8-4604-bf00-900e3b874c88 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:12.206539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f8f38a9-d5d8-4604-bf00-900e3b874c88 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:12.207296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f8f38a9-d5d8-4604-bf00-900e3b874c88 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:12.207835 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f8f38a9-d5d8-4604-bf00-900e3b874c88 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:12.208275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f8f38a9-d5d8-4604-bf00-900e3b874c88 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:12.208963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f8f38a9-d5d8-4604-bf00-900e3b874c88 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:12.346384 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-0f8f38a9-d5d8-4604-bf00-900e3b874c88 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] HTTP exception thrown: Instance b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 is not attached to volume e6c16869-2f1e-4e47-b30e-aa8ec02681b5 Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f8f38a9-d5d8-4604-bf00-900e3b874c88 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Request method failure captured: Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4/os-volume_attachments/e6c16869-2f1e-4e47-b30e-aa8ec02681b5 HTTP/1.1 Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgfgBqfRgZu77BVk8DO02clRic8_7bHj1_TPsvhFDMvKymD-h31XDC3NGl38uf9w_il53-IzucRZuAFOHiBwXYEBxj7roFUibBA2108fxZwTXkCZGpUT9C2EZ-nHOQ-Azk4hGMldieOQaGkY5PsaG3Qnqd4ecUfi0J0PJ5HSBuKBL0I Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: bc838a17ae334ea48e149b6b5010e857 Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1328932639 Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bc838a17ae334ea48e149b6b5010e857"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bc838a17ae334ea48e149b6b5010e857", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bc838a17ae334ea48e149b6b5010e857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bc838a17ae334ea48e149b6b5010e857"}]}] Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestEncryptedCinderVolumes-1328932639 Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: bc838a17ae334ea48e149b6b5010e857 Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1328932639 Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestEncryptedCinderVolumes-1328932639-project Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: d7c0ac68e72f40faaff82435f960b81a Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestEncryptedCinderVolumes-1328932639-project Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 is not attached to volume e6c16869-2f1e-4e47-b30e-aa8ec02681b5 Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'server_id': 'b7f0754c-9e78-4e0f-a4b0-154acf00a2b4', 'id': 'e6c16869-2f1e-4e47-b30e-aa8ec02681b5'} Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e6c16869-2f1e-4e47-b30e-aa8ec02681b5. Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 is not attached to volume e6c16869-2f1e-4e47-b30e-aa8ec02681b5 Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:14:12.352830 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:14:12.357295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:14:12.357295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:14:12.357295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 is not attached to volume e6c16869-2f1e-4e47-b30e-aa8ec02681b5 Aug 24 11:14:12.357295 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:14:12.357295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f8f38a9-d5d8-4604-bf00-900e3b874c88 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Returning 404 to user: Instance b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 is not attached to volume e6c16869-2f1e-4e47-b30e-aa8ec02681b5 {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:14:12.357295 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0f8f38a9-d5d8-4604-bf00-900e3b874c88 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4/os-volume_attachments/e6c16869-2f1e-4e47-b30e-aa8ec02681b5" status: 404 len: 154 microversion: 2.1 time: 0.160161 Aug 24 11:14:12.357295 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3718/7074] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Aug 24 11:14:12 2022] DELETE /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4/os-volume_attachments/e6c16869-2f1e-4e47-b30e-aa8ec02681b5 => generated 154 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:14:15.702919 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3800988f-68ca-4888-8ad6-bb18cbb01e26 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:15.703468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3800988f-68ca-4888-8ad6-bb18cbb01e26 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: b7f0754c-9e78-4e0f-a4b0-154acf00a2b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:15.710849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3800988f-68ca-4888-8ad6-bb18cbb01e26 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:15.711346 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3800988f-68ca-4888-8ad6-bb18cbb01e26 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:15.711791 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3800988f-68ca-4888-8ad6-bb18cbb01e26 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:15.712491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3800988f-68ca-4888-8ad6-bb18cbb01e26 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:15.712949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3800988f-68ca-4888-8ad6-bb18cbb01e26 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:15.713383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3800988f-68ca-4888-8ad6-bb18cbb01e26 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:15.740694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3800988f-68ca-4888-8ad6-bb18cbb01e26 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: b7f0754c-9e78-4e0f-a4b0-154acf00a2b4] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:14:15.835899 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3800988f-68ca-4888-8ad6-bb18cbb01e26 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4" status: 204 len: 0 microversion: 2.1 time: 0.136738 Aug 24 11:14:15.836511 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3357/7075] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:14:15 2022] DELETE /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:14:15.845103 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-60cdb9c5-0687-4c9b-9bd4-9d0722e55bf6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:15.845790 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-60cdb9c5-0687-4c9b-9bd4-9d0722e55bf6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: b7f0754c-9e78-4e0f-a4b0-154acf00a2b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:15.856204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60cdb9c5-0687-4c9b-9bd4-9d0722e55bf6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:15.856695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60cdb9c5-0687-4c9b-9bd4-9d0722e55bf6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:15.857146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60cdb9c5-0687-4c9b-9bd4-9d0722e55bf6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:15.857883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60cdb9c5-0687-4c9b-9bd4-9d0722e55bf6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:15.858355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60cdb9c5-0687-4c9b-9bd4-9d0722e55bf6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:15.858792 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60cdb9c5-0687-4c9b-9bd4-9d0722e55bf6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:15.992795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-60cdb9c5-0687-4c9b-9bd4-9d0722e55bf6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:16.000968 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-60cdb9c5-0687-4c9b-9bd4-9d0722e55bf6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4" status: 200 len: 1562 microversion: 2.1 time: 0.159794 Aug 24 11:14:16.001611 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3719/7076] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:15 2022] GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:17.027432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ff66e0b3-1ce2-4d6b-a89f-4e714bab7d69 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:17.028475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ff66e0b3-1ce2-4d6b-a89f-4e714bab7d69 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: b7f0754c-9e78-4e0f-a4b0-154acf00a2b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:17.038072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff66e0b3-1ce2-4d6b-a89f-4e714bab7d69 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:17.038568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff66e0b3-1ce2-4d6b-a89f-4e714bab7d69 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:17.039000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff66e0b3-1ce2-4d6b-a89f-4e714bab7d69 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:17.039693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff66e0b3-1ce2-4d6b-a89f-4e714bab7d69 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:17.040142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff66e0b3-1ce2-4d6b-a89f-4e714bab7d69 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:17.040562 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff66e0b3-1ce2-4d6b-a89f-4e714bab7d69 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:17.181939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ff66e0b3-1ce2-4d6b-a89f-4e714bab7d69 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:17.190824 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ff66e0b3-1ce2-4d6b-a89f-4e714bab7d69 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4" status: 200 len: 1562 microversion: 2.1 time: 0.170512 Aug 24 11:14:17.191486 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3358/7077] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:17 2022] GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 => generated 1562 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:17.993981 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a1d8ea3a-82a1-452a-81fe-216cc39245ed req-1209959b-bfaf-40ae-b1ea-dc0b2fd5a7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f0754c-9e78-4e0f-a4b0-154acf00a2b4", "name": "network-vif-deleted", "tag": "79796880-63e9-45d4-beea-c144fe198609"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:14:18.003622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a1d8ea3a-82a1-452a-81fe-216cc39245ed req-1209959b-bfaf-40ae-b1ea-dc0b2fd5a7f3 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:18.004613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a1d8ea3a-82a1-452a-81fe-216cc39245ed req-1209959b-bfaf-40ae-b1ea-dc0b2fd5a7f3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:18.004613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a1d8ea3a-82a1-452a-81fe-216cc39245ed req-1209959b-bfaf-40ae-b1ea-dc0b2fd5a7f3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:18.016368 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a1d8ea3a-82a1-452a-81fe-216cc39245ed req-1209959b-bfaf-40ae-b1ea-dc0b2fd5a7f3 service nova] Creating event network-vif-deleted:79796880-63e9-45d4-beea-c144fe198609 for instance b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 on n-h1-849328-3 Aug 24 11:14:18.021827 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a1d8ea3a-82a1-452a-81fe-216cc39245ed req-1209959b-bfaf-40ae-b1ea-dc0b2fd5a7f3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032495 Aug 24 11:14:18.022453 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3720/7078] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:14:18.215055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8bc5d058-1695-4f26-8817-9decf6af97af tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:18.215619 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8bc5d058-1695-4f26-8817-9decf6af97af tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: b7f0754c-9e78-4e0f-a4b0-154acf00a2b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:18.223819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bc5d058-1695-4f26-8817-9decf6af97af tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:18.224293 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bc5d058-1695-4f26-8817-9decf6af97af tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:18.224731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bc5d058-1695-4f26-8817-9decf6af97af tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:18.225437 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bc5d058-1695-4f26-8817-9decf6af97af tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:18.225885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bc5d058-1695-4f26-8817-9decf6af97af tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:18.226304 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bc5d058-1695-4f26-8817-9decf6af97af tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:18.261899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bc5d058-1695-4f26-8817-9decf6af97af tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:18.262400 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bc5d058-1695-4f26-8817-9decf6af97af tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:18.262843 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bc5d058-1695-4f26-8817-9decf6af97af tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:18.263303 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-8bc5d058-1695-4f26-8817-9decf6af97af tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lazy-loading 'fault' on Instance uuid b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:14:18.308383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8bc5d058-1695-4f26-8817-9decf6af97af tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:18.317053 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8bc5d058-1695-4f26-8817-9decf6af97af tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4" status: 200 len: 1353 microversion: 2.1 time: 0.108351 Aug 24 11:14:18.317704 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3359/7079] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:18 2022] GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 => generated 1353 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:19.342293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1d791711-ebc4-4b4b-b7e8-97e3024c2339 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:19.343023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1d791711-ebc4-4b4b-b7e8-97e3024c2339 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: b7f0754c-9e78-4e0f-a4b0-154acf00a2b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:19.350224 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d791711-ebc4-4b4b-b7e8-97e3024c2339 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:19.350730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d791711-ebc4-4b4b-b7e8-97e3024c2339 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:19.351183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d791711-ebc4-4b4b-b7e8-97e3024c2339 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:19.351891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d791711-ebc4-4b4b-b7e8-97e3024c2339 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:19.352362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d791711-ebc4-4b4b-b7e8-97e3024c2339 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:19.352801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d791711-ebc4-4b4b-b7e8-97e3024c2339 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:19.368036 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-1d791711-ebc4-4b4b-b7e8-97e3024c2339 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] HTTP exception thrown: Instance b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 could not be found. Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1d791711-ebc4-4b4b-b7e8-97e3024c2339 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Request method failure captured: Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 HTTP/1.1 Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgfgBqfRgZu77BVk8DO02clRic8_7bHj1_TPsvhFDMvKymD-h31XDC3NGl38uf9w_il53-IzucRZuAFOHiBwXYEBxj7roFUibBA2108fxZwTXkCZGpUT9C2EZ-nHOQ-Azk4hGMldieOQaGkY5PsaG3Qnqd4ecUfi0J0PJ5HSBuKBL0I Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: bc838a17ae334ea48e149b6b5010e857 Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1328932639 Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bc838a17ae334ea48e149b6b5010e857"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bc838a17ae334ea48e149b6b5010e857", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bc838a17ae334ea48e149b6b5010e857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bc838a17ae334ea48e149b6b5010e857"}]}] Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestEncryptedCinderVolumes-1328932639 Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: bc838a17ae334ea48e149b6b5010e857 Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1328932639 Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestEncryptedCinderVolumes-1328932639-project Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: d7c0ac68e72f40faaff82435f960b81a Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestEncryptedCinderVolumes-1328932639-project Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 could not be found. Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'b7f0754c-9e78-4e0f-a4b0-154acf00a2b4'} Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 could not be found. Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 could not be found. Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:14:19.370072 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:14:19.374479 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:14:19.374479 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:14:19.374479 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:14:19.374479 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:14:19.374479 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:14:19.374479 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:14:19.374479 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 could not be found. Aug 24 11:14:19.374479 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:14:19.374479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1d791711-ebc4-4b4b-b7e8-97e3024c2339 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Returning 404 to user: Instance b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:14:19.374479 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1d791711-ebc4-4b4b-b7e8-97e3024c2339 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4" status: 404 len: 111 microversion: 2.1 time: 0.035710 Aug 24 11:14:19.374479 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3721/7080] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:19 2022] GET /compute/v2.1/servers/b7f0754c-9e78-4e0f-a4b0-154acf00a2b4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:14:19.380907 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4652a9b0-2132-4ae6-b0b1-44311618f578 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '.version_select at 0x7f46550e55e0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:19.404337 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4652a9b0-2132-4ae6-b0b1-44311618f578 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1607842191" status: 202 len: 0 microversion: 2.1 time: 0.027503 Aug 24 11:14:19.404933 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3360/7081] 10.222.0.85 () {58 vars in 1278 bytes} [Wed Aug 24 11:14:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1607842191 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:14:19.424574 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d7caef5d-1dea-42eb-9bff-0be4f8bf6640 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Action: 'create', calling method: .version_select at 0x7f4647d1c280>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1913005746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKR8z/ocvBkhXlX0MBvJgnMMFbI6wVJeFXgp69faRbBVtYqOZ8sCajW/jWAl7iXayQl20B7zDvhCBfGVvULgbAmtD7IltIl2VtAtdFE28tJvzaPoj+24XOoXXjuUcqjV6A=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:14:19.441253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-d7caef5d-1dea-42eb-9bff-0be4f8bf6640 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Getting quotas for project bc838a17ae334ea48e149b6b5010e857. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:14:19.446996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-d7caef5d-1dea-42eb-9bff-0be4f8bf6640 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Getting quotas for user d7c0ac68e72f40faaff82435f960b81a and project bc838a17ae334ea48e149b6b5010e857. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:14:19.477869 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d7caef5d-1dea-42eb-9bff-0be4f8bf6640 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.059209 Aug 24 11:14:19.478477 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3722/7082] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 11:14:19 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:14:19.532456 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-30c69d44-abb8-4783-ba00-81a76396f9a7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1269529312", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1913005746", "networks": [{"uuid": "e61a9b3f-0cff-4c72-823f-b1da0d5845a9"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:14:19.589344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-30c69d44-abb8-4783-ba00-81a76396f9a7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] validate_networks() for [('e61a9b3f-0cff-4c72-823f-b1da0d5845a9', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:14:20.153628 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-30c69d44-abb8-4783-ba00-81a76396f9a7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:14:20.154246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-30c69d44-abb8-4783-ba00-81a76396f9a7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:14:20.154990 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-30c69d44-abb8-4783-ba00-81a76396f9a7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:14:20.155577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-30c69d44-abb8-4783-ba00-81a76396f9a7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:14:20.156176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-30c69d44-abb8-4783-ba00-81a76396f9a7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:14:20.171711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30c69d44-abb8-4783-ba00-81a76396f9a7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:20.172355 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30c69d44-abb8-4783-ba00-81a76396f9a7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:20.172934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30c69d44-abb8-4783-ba00-81a76396f9a7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:20.173950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30c69d44-abb8-4783-ba00-81a76396f9a7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:20.174402 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30c69d44-abb8-4783-ba00-81a76396f9a7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:20.174821 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30c69d44-abb8-4783-ba00-81a76396f9a7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:20.192973 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-30c69d44-abb8-4783-ba00-81a76396f9a7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Getting quotas for project bc838a17ae334ea48e149b6b5010e857. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:14:20.198466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-30c69d44-abb8-4783-ba00-81a76396f9a7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Getting quotas for user d7c0ac68e72f40faaff82435f960b81a and project bc838a17ae334ea48e149b6b5010e857. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:14:20.211949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-30c69d44-abb8-4783-ba00-81a76396f9a7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:14:20.214344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-30c69d44-abb8-4783-ba00-81a76396f9a7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: d1a2b64e-81c6-4435-a90e-8125d78512f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:14:20.273720 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-30c69d44-abb8-4783-ba00-81a76396f9a7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.745208 Aug 24 11:14:20.274446 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3361/7083] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 11:14:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:14:20.285292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2b7bb733-8f68-46a4-930a-d3ee5e35269b tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:20.285917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2b7bb733-8f68-46a4-930a-d3ee5e35269b tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: d1a2b64e-81c6-4435-a90e-8125d78512f4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:20.340354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2b7bb733-8f68-46a4-930a-d3ee5e35269b tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:20.352213 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2b7bb733-8f68-46a4-930a-d3ee5e35269b tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4" status: 200 len: 1263 microversion: 2.1 time: 0.070511 Aug 24 11:14:20.353146 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3723/7084] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:20 2022] GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4 => generated 1263 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:21.376941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-21bd03c4-46e8-4540-8768-983c02ee4475 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:21.377630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-21bd03c4-46e8-4540-8768-983c02ee4475 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: d1a2b64e-81c6-4435-a90e-8125d78512f4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:21.385241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21bd03c4-46e8-4540-8768-983c02ee4475 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:21.385755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21bd03c4-46e8-4540-8768-983c02ee4475 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:21.386190 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21bd03c4-46e8-4540-8768-983c02ee4475 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:21.386888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21bd03c4-46e8-4540-8768-983c02ee4475 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:21.387336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21bd03c4-46e8-4540-8768-983c02ee4475 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:21.387759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21bd03c4-46e8-4540-8768-983c02ee4475 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:21.461754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-21bd03c4-46e8-4540-8768-983c02ee4475 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:21.472048 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-21bd03c4-46e8-4540-8768-983c02ee4475 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4" status: 200 len: 1323 microversion: 2.1 time: 0.099754 Aug 24 11:14:21.473188 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3362/7085] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:21 2022] GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4 => generated 1323 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:22.493807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8bd81c1a-cc1d-4b41-b509-e71d987d3a6a tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:22.494446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8bd81c1a-cc1d-4b41-b509-e71d987d3a6a tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: d1a2b64e-81c6-4435-a90e-8125d78512f4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:22.501625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bd81c1a-cc1d-4b41-b509-e71d987d3a6a tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:22.502123 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bd81c1a-cc1d-4b41-b509-e71d987d3a6a tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:22.507538 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bd81c1a-cc1d-4b41-b509-e71d987d3a6a tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:22.508327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bd81c1a-cc1d-4b41-b509-e71d987d3a6a tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:22.508929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bd81c1a-cc1d-4b41-b509-e71d987d3a6a tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:22.509417 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bd81c1a-cc1d-4b41-b509-e71d987d3a6a tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:22.656627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8bd81c1a-cc1d-4b41-b509-e71d987d3a6a tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:22.665989 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8bd81c1a-cc1d-4b41-b509-e71d987d3a6a tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4" status: 200 len: 1363 microversion: 2.1 time: 0.176105 Aug 24 11:14:22.666621 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3724/7086] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:22 2022] GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:22.733508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-19b2ce2b-73ba-4a81-a197-9fd3a2343585 req-32fe2942-94f1-4bc8-a7f2-75e6ad2618fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1a2b64e-81c6-4435-a90e-8125d78512f4", "tag": "82472b02-c277-4d26-9616-34dc2bc2faec"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:14:22.751382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-19b2ce2b-73ba-4a81-a197-9fd3a2343585 req-32fe2942-94f1-4bc8-a7f2-75e6ad2618fd service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:22.752116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-19b2ce2b-73ba-4a81-a197-9fd3a2343585 req-32fe2942-94f1-4bc8-a7f2-75e6ad2618fd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:22.753239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-19b2ce2b-73ba-4a81-a197-9fd3a2343585 req-32fe2942-94f1-4bc8-a7f2-75e6ad2618fd service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:22.765304 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-19b2ce2b-73ba-4a81-a197-9fd3a2343585 req-32fe2942-94f1-4bc8-a7f2-75e6ad2618fd service nova] Creating event network-changed:82472b02-c277-4d26-9616-34dc2bc2faec for instance d1a2b64e-81c6-4435-a90e-8125d78512f4 on n-h1-849328-3 Aug 24 11:14:22.770215 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-19b2ce2b-73ba-4a81-a197-9fd3a2343585 req-32fe2942-94f1-4bc8-a7f2-75e6ad2618fd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043215 Aug 24 11:14:22.770848 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3363/7087] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:14:23.687276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e839e1e2-0ba6-4cb8-827d-ba2569efd5a0 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:23.687881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e839e1e2-0ba6-4cb8-827d-ba2569efd5a0 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: d1a2b64e-81c6-4435-a90e-8125d78512f4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:23.696776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e839e1e2-0ba6-4cb8-827d-ba2569efd5a0 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:23.697323 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e839e1e2-0ba6-4cb8-827d-ba2569efd5a0 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:23.697850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e839e1e2-0ba6-4cb8-827d-ba2569efd5a0 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:23.698567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e839e1e2-0ba6-4cb8-827d-ba2569efd5a0 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:23.699032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e839e1e2-0ba6-4cb8-827d-ba2569efd5a0 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:23.699465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e839e1e2-0ba6-4cb8-827d-ba2569efd5a0 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:23.845503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e839e1e2-0ba6-4cb8-827d-ba2569efd5a0 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:23.858205 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e839e1e2-0ba6-4cb8-827d-ba2569efd5a0 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4" status: 200 len: 1363 microversion: 2.1 time: 0.174750 Aug 24 11:14:23.859156 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3725/7088] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:23 2022] GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:24.881806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0a111987-b592-4cf5-a04a-926c6f066a65 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:24.882508 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0a111987-b592-4cf5-a04a-926c6f066a65 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: d1a2b64e-81c6-4435-a90e-8125d78512f4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:24.889858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a111987-b592-4cf5-a04a-926c6f066a65 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:24.890346 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a111987-b592-4cf5-a04a-926c6f066a65 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:24.890790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a111987-b592-4cf5-a04a-926c6f066a65 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:24.891487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a111987-b592-4cf5-a04a-926c6f066a65 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:24.891922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a111987-b592-4cf5-a04a-926c6f066a65 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:24.892371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a111987-b592-4cf5-a04a-926c6f066a65 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:25.025747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0a111987-b592-4cf5-a04a-926c6f066a65 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:25.036884 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0a111987-b592-4cf5-a04a-926c6f066a65 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4" status: 200 len: 1363 microversion: 2.1 time: 0.160411 Aug 24 11:14:25.037528 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3364/7089] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:24 2022] GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:26.061887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-16c52a45-e1a9-44ff-94f2-28c9aeae52e1 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:26.063060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-16c52a45-e1a9-44ff-94f2-28c9aeae52e1 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: d1a2b64e-81c6-4435-a90e-8125d78512f4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:26.075170 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16c52a45-e1a9-44ff-94f2-28c9aeae52e1 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:26.076068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16c52a45-e1a9-44ff-94f2-28c9aeae52e1 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:26.076861 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16c52a45-e1a9-44ff-94f2-28c9aeae52e1 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:26.078111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16c52a45-e1a9-44ff-94f2-28c9aeae52e1 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:26.078939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16c52a45-e1a9-44ff-94f2-28c9aeae52e1 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:26.079718 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16c52a45-e1a9-44ff-94f2-28c9aeae52e1 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:26.220289 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-16c52a45-e1a9-44ff-94f2-28c9aeae52e1 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:26.231816 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-16c52a45-e1a9-44ff-94f2-28c9aeae52e1 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4" status: 200 len: 1363 microversion: 2.1 time: 0.177303 Aug 24 11:14:26.232503 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3726/7090] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:26 2022] GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:27.256503 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2205f1ef-f1d4-4dee-bb79-9a76558bdfa7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:27.257110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2205f1ef-f1d4-4dee-bb79-9a76558bdfa7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: d1a2b64e-81c6-4435-a90e-8125d78512f4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:27.264459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2205f1ef-f1d4-4dee-bb79-9a76558bdfa7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:27.265023 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2205f1ef-f1d4-4dee-bb79-9a76558bdfa7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:27.265507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2205f1ef-f1d4-4dee-bb79-9a76558bdfa7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:27.266202 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2205f1ef-f1d4-4dee-bb79-9a76558bdfa7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:27.266655 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2205f1ef-f1d4-4dee-bb79-9a76558bdfa7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:27.267076 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2205f1ef-f1d4-4dee-bb79-9a76558bdfa7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:27.411265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2205f1ef-f1d4-4dee-bb79-9a76558bdfa7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:27.419573 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2205f1ef-f1d4-4dee-bb79-9a76558bdfa7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4" status: 200 len: 1363 microversion: 2.1 time: 0.168555 Aug 24 11:14:27.420161 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3365/7091] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:27 2022] GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:28.021828 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-9e46da36-fd47-4524-aced-404ad0d01461 req-0ba107bb-f6da-4b9b-9960-4fbaf42cb2d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1a2b64e-81c6-4435-a90e-8125d78512f4", "name": "network-vif-plugged", "status": "completed", "tag": "82472b02-c277-4d26-9616-34dc2bc2faec"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:14:28.032755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9e46da36-fd47-4524-aced-404ad0d01461 req-0ba107bb-f6da-4b9b-9960-4fbaf42cb2d2 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:28.033369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9e46da36-fd47-4524-aced-404ad0d01461 req-0ba107bb-f6da-4b9b-9960-4fbaf42cb2d2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:28.033832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9e46da36-fd47-4524-aced-404ad0d01461 req-0ba107bb-f6da-4b9b-9960-4fbaf42cb2d2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:28.045257 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-9e46da36-fd47-4524-aced-404ad0d01461 req-0ba107bb-f6da-4b9b-9960-4fbaf42cb2d2 service nova] Creating event network-vif-plugged:82472b02-c277-4d26-9616-34dc2bc2faec for instance d1a2b64e-81c6-4435-a90e-8125d78512f4 on n-h1-849328-3 Aug 24 11:14:28.050290 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-9e46da36-fd47-4524-aced-404ad0d01461 req-0ba107bb-f6da-4b9b-9960-4fbaf42cb2d2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032280 Aug 24 11:14:28.050900 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3727/7092] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:14:28.455043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-07e27758-9bea-446c-80e6-3804fd699684 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:28.455868 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-07e27758-9bea-446c-80e6-3804fd699684 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: d1a2b64e-81c6-4435-a90e-8125d78512f4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:28.464001 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07e27758-9bea-446c-80e6-3804fd699684 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:28.464491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07e27758-9bea-446c-80e6-3804fd699684 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:28.464931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07e27758-9bea-446c-80e6-3804fd699684 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:28.465661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07e27758-9bea-446c-80e6-3804fd699684 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:28.466120 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07e27758-9bea-446c-80e6-3804fd699684 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:28.466549 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07e27758-9bea-446c-80e6-3804fd699684 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:28.602980 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-07e27758-9bea-446c-80e6-3804fd699684 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:28.610909 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-07e27758-9bea-446c-80e6-3804fd699684 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4" status: 200 len: 1363 microversion: 2.1 time: 0.165330 Aug 24 11:14:28.611500 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3366/7093] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:28 2022] GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:29.634644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ed5f42c1-c147-4789-a18a-454697421c42 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:29.635348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ed5f42c1-c147-4789-a18a-454697421c42 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: d1a2b64e-81c6-4435-a90e-8125d78512f4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:29.642398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed5f42c1-c147-4789-a18a-454697421c42 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:29.642904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed5f42c1-c147-4789-a18a-454697421c42 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:29.643346 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed5f42c1-c147-4789-a18a-454697421c42 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:29.644043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed5f42c1-c147-4789-a18a-454697421c42 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:29.644537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed5f42c1-c147-4789-a18a-454697421c42 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:29.644940 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed5f42c1-c147-4789-a18a-454697421c42 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:29.794557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ed5f42c1-c147-4789-a18a-454697421c42 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:29.804818 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ed5f42c1-c147-4789-a18a-454697421c42 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4" status: 200 len: 1556 microversion: 2.1 time: 0.175542 Aug 24 11:14:29.805459 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3728/7094] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:29 2022] GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4 => generated 1556 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:29.825917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-867589db-43af-4296-b5b1-a823d6f05971 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:29.826523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-867589db-43af-4296-b5b1-a823d6f05971 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: d1a2b64e-81c6-4435-a90e-8125d78512f4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:29.834018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-867589db-43af-4296-b5b1-a823d6f05971 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:29.834509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-867589db-43af-4296-b5b1-a823d6f05971 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:29.834957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-867589db-43af-4296-b5b1-a823d6f05971 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:29.835659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-867589db-43af-4296-b5b1-a823d6f05971 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:29.836118 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-867589db-43af-4296-b5b1-a823d6f05971 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:29.836546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-867589db-43af-4296-b5b1-a823d6f05971 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:29.981085 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-867589db-43af-4296-b5b1-a823d6f05971 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:29.992706 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-867589db-43af-4296-b5b1-a823d6f05971 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4" status: 200 len: 1556 microversion: 2.1 time: 0.170467 Aug 24 11:14:29.993311 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3367/7095] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:29 2022] GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4 => generated 1556 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:31.533067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-55eb738a-b9a3-4833-88c8-1daa554e8248 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f89f222a-5df3-41bb-921b-640fbab44bd3"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:14:31.535456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-55eb738a-b9a3-4833-88c8-1daa554e8248 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: d1a2b64e-81c6-4435-a90e-8125d78512f4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:31.537519 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:14:31.544011 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55eb738a-b9a3-4833-88c8-1daa554e8248 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:31.544492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55eb738a-b9a3-4833-88c8-1daa554e8248 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:31.544944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55eb738a-b9a3-4833-88c8-1daa554e8248 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:31.545686 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55eb738a-b9a3-4833-88c8-1daa554e8248 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:31.546158 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55eb738a-b9a3-4833-88c8-1daa554e8248 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:31.546592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55eb738a-b9a3-4833-88c8-1daa554e8248 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:31.820758 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-55eb738a-b9a3-4833-88c8-1daa554e8248 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "POST /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291514 Aug 24 11:14:31.821470 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3729/7096] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Aug 24 11:14:31 2022] POST /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:14:42.594058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d7201865-ec23-4d36-9704-b4cdf7b3490f tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:42.594623 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d7201865-ec23-4d36-9704-b4cdf7b3490f tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: d1a2b64e-81c6-4435-a90e-8125d78512f4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:42.596634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:14:42.597340 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:14:42.599138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:14:42.599967 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:14:42.606646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7201865-ec23-4d36-9704-b4cdf7b3490f tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:42.607131 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7201865-ec23-4d36-9704-b4cdf7b3490f tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:42.607568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7201865-ec23-4d36-9704-b4cdf7b3490f tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:42.608260 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7201865-ec23-4d36-9704-b4cdf7b3490f tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:42.608709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7201865-ec23-4d36-9704-b4cdf7b3490f tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:42.609164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7201865-ec23-4d36-9704-b4cdf7b3490f tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:42.699286 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-d7201865-ec23-4d36-9704-b4cdf7b3490f tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lazy-loading 'services' on Instance uuid d1a2b64e-81c6-4435-a90e-8125d78512f4 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:14:42.789390 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d7201865-ec23-4d36-9704-b4cdf7b3490f tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4/os-volume_attachments/f89f222a-5df3-41bb-921b-640fbab44bd3" status: 202 len: 0 microversion: 2.1 time: 0.199208 Aug 24 11:14:42.790070 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3368/7097] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Aug 24 11:14:42 2022] DELETE /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4/os-volume_attachments/f89f222a-5df3-41bb-921b-640fbab44bd3 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:14:42.796824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:14:42.797876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:14:42.802341 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bdcf9ac8-6999-4619-81c5-c9223e655914 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:42.804816 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bdcf9ac8-6999-4619-81c5-c9223e655914 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: d1a2b64e-81c6-4435-a90e-8125d78512f4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:42.813238 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdcf9ac8-6999-4619-81c5-c9223e655914 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:42.813829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdcf9ac8-6999-4619-81c5-c9223e655914 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:42.814295 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdcf9ac8-6999-4619-81c5-c9223e655914 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:42.815022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdcf9ac8-6999-4619-81c5-c9223e655914 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:42.815492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdcf9ac8-6999-4619-81c5-c9223e655914 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:42.815931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdcf9ac8-6999-4619-81c5-c9223e655914 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:42.848601 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bdcf9ac8-6999-4619-81c5-c9223e655914 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053648 Aug 24 11:14:42.849550 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3730/7098] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:14:42 2022] GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:14:43.863152 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e5880b0b-bcd7-4aeb-adf3-79c7d21e7d38 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:43.865646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e5880b0b-bcd7-4aeb-adf3-79c7d21e7d38 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: d1a2b64e-81c6-4435-a90e-8125d78512f4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:43.872260 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5880b0b-bcd7-4aeb-adf3-79c7d21e7d38 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:43.872749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5880b0b-bcd7-4aeb-adf3-79c7d21e7d38 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:43.873322 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5880b0b-bcd7-4aeb-adf3-79c7d21e7d38 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:43.874021 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5880b0b-bcd7-4aeb-adf3-79c7d21e7d38 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:43.874475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5880b0b-bcd7-4aeb-adf3-79c7d21e7d38 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:43.874902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5880b0b-bcd7-4aeb-adf3-79c7d21e7d38 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:43.905811 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e5880b0b-bcd7-4aeb-adf3-79c7d21e7d38 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048209 Aug 24 11:14:43.906369 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3369/7099] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:14:43 2022] GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:14:44.918796 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6647c17f-f4e1-4890-9132-ed9c3e13a411 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:44.921217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6647c17f-f4e1-4890-9132-ed9c3e13a411 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: d1a2b64e-81c6-4435-a90e-8125d78512f4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:44.928980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6647c17f-f4e1-4890-9132-ed9c3e13a411 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:44.929857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6647c17f-f4e1-4890-9132-ed9c3e13a411 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:44.930115 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6647c17f-f4e1-4890-9132-ed9c3e13a411 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:44.930746 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6647c17f-f4e1-4890-9132-ed9c3e13a411 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:44.931180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6647c17f-f4e1-4890-9132-ed9c3e13a411 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:44.931612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6647c17f-f4e1-4890-9132-ed9c3e13a411 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:44.964323 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6647c17f-f4e1-4890-9132-ed9c3e13a411 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049623 Aug 24 11:14:44.964883 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3731/7100] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:14:44 2022] GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:14:45.977155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-acc0a8e0-b0fe-45f4-ba50-29c07437f4cc tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:45.979467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-acc0a8e0-b0fe-45f4-ba50-29c07437f4cc tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: d1a2b64e-81c6-4435-a90e-8125d78512f4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:45.986951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acc0a8e0-b0fe-45f4-ba50-29c07437f4cc tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:45.987866 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acc0a8e0-b0fe-45f4-ba50-29c07437f4cc tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:45.988410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acc0a8e0-b0fe-45f4-ba50-29c07437f4cc tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:45.989280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acc0a8e0-b0fe-45f4-ba50-29c07437f4cc tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:45.989744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acc0a8e0-b0fe-45f4-ba50-29c07437f4cc tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:45.990147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acc0a8e0-b0fe-45f4-ba50-29c07437f4cc tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:46.022010 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-acc0a8e0-b0fe-45f4-ba50-29c07437f4cc tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049227 Aug 24 11:14:46.022827 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3370/7101] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:14:45 2022] GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:14:47.034788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9df7d1ff-2908-40bd-a7f2-16b783dc4009 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:47.037154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9df7d1ff-2908-40bd-a7f2-16b783dc4009 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: d1a2b64e-81c6-4435-a90e-8125d78512f4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:47.044729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9df7d1ff-2908-40bd-a7f2-16b783dc4009 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:47.045276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9df7d1ff-2908-40bd-a7f2-16b783dc4009 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:47.045719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9df7d1ff-2908-40bd-a7f2-16b783dc4009 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:47.046427 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9df7d1ff-2908-40bd-a7f2-16b783dc4009 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:47.047594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9df7d1ff-2908-40bd-a7f2-16b783dc4009 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:47.048032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9df7d1ff-2908-40bd-a7f2-16b783dc4009 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:47.079461 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9df7d1ff-2908-40bd-a7f2-16b783dc4009 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048830 Aug 24 11:14:47.080048 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3732/7102] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:14:47 2022] GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:14:48.097326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3e79a572-8424-4bc2-917d-ab3cace40721 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:48.101190 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3e79a572-8424-4bc2-917d-ab3cace40721 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: d1a2b64e-81c6-4435-a90e-8125d78512f4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:48.114470 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e79a572-8424-4bc2-917d-ab3cace40721 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:48.115266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e79a572-8424-4bc2-917d-ab3cace40721 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:48.115708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e79a572-8424-4bc2-917d-ab3cace40721 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:48.116407 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e79a572-8424-4bc2-917d-ab3cace40721 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:48.116858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e79a572-8424-4bc2-917d-ab3cace40721 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:48.117313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e79a572-8424-4bc2-917d-ab3cace40721 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:48.147578 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3e79a572-8424-4bc2-917d-ab3cace40721 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057789 Aug 24 11:14:48.148155 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3371/7103] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:14:48 2022] GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:14:48.158982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6c7a84d3-1cb5-476c-925b-216a13aff5b7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:48.159531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6c7a84d3-1cb5-476c-925b-216a13aff5b7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: d1a2b64e-81c6-4435-a90e-8125d78512f4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:48.166311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c7a84d3-1cb5-476c-925b-216a13aff5b7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:48.166804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c7a84d3-1cb5-476c-925b-216a13aff5b7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:48.167248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c7a84d3-1cb5-476c-925b-216a13aff5b7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:48.167944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c7a84d3-1cb5-476c-925b-216a13aff5b7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:48.168405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c7a84d3-1cb5-476c-925b-216a13aff5b7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:48.168834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c7a84d3-1cb5-476c-925b-216a13aff5b7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:48.256201 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-6c7a84d3-1cb5-476c-925b-216a13aff5b7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] HTTP exception thrown: Instance d1a2b64e-81c6-4435-a90e-8125d78512f4 is not attached to volume f89f222a-5df3-41bb-921b-640fbab44bd3 Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6c7a84d3-1cb5-476c-925b-216a13aff5b7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Request method failure captured: Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4/os-volume_attachments/f89f222a-5df3-41bb-921b-640fbab44bd3 HTTP/1.1 Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgfgBqfRgZu77BVk8DO02clRic8_7bHj1_TPsvhFDMvKymD-h31XDC3NGl38uf9w_il53-IzucRZuAFOHiBwXYEBxj7roFUibBA2108fxZwTXkCZGpUT9C2EZ-nHOQ-Azk4hGMldieOQaGkY5PsaG3Qnqd4ecUfi0J0PJ5HSBuKBL0I Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: bc838a17ae334ea48e149b6b5010e857 Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1328932639 Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bc838a17ae334ea48e149b6b5010e857"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bc838a17ae334ea48e149b6b5010e857", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bc838a17ae334ea48e149b6b5010e857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bc838a17ae334ea48e149b6b5010e857"}]}] Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestEncryptedCinderVolumes-1328932639 Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: bc838a17ae334ea48e149b6b5010e857 Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1328932639 Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestEncryptedCinderVolumes-1328932639-project Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: d7c0ac68e72f40faaff82435f960b81a Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestEncryptedCinderVolumes-1328932639-project Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance d1a2b64e-81c6-4435-a90e-8125d78512f4 is not attached to volume f89f222a-5df3-41bb-921b-640fbab44bd3 Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'server_id': 'd1a2b64e-81c6-4435-a90e-8125d78512f4', 'id': 'f89f222a-5df3-41bb-921b-640fbab44bd3'} Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f89f222a-5df3-41bb-921b-640fbab44bd3. Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1a2b64e-81c6-4435-a90e-8125d78512f4 is not attached to volume f89f222a-5df3-41bb-921b-640fbab44bd3 Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:14:48.258106 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:14:48.262563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:14:48.262563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:14:48.262563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1a2b64e-81c6-4435-a90e-8125d78512f4 is not attached to volume f89f222a-5df3-41bb-921b-640fbab44bd3 Aug 24 11:14:48.262563 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:14:48.262563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6c7a84d3-1cb5-476c-925b-216a13aff5b7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Returning 404 to user: Instance d1a2b64e-81c6-4435-a90e-8125d78512f4 is not attached to volume f89f222a-5df3-41bb-921b-640fbab44bd3 {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:14:48.262563 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6c7a84d3-1cb5-476c-925b-216a13aff5b7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4/os-volume_attachments/f89f222a-5df3-41bb-921b-640fbab44bd3" status: 404 len: 154 microversion: 2.1 time: 0.104692 Aug 24 11:14:48.262563 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3733/7104] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Aug 24 11:14:48 2022] DELETE /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4/os-volume_attachments/f89f222a-5df3-41bb-921b-640fbab44bd3 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:14:51.619520 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-937c0c2c-30a5-4296-a389-074e7b0a125a tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:51.620151 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-937c0c2c-30a5-4296-a389-074e7b0a125a tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: d1a2b64e-81c6-4435-a90e-8125d78512f4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:51.627566 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-937c0c2c-30a5-4296-a389-074e7b0a125a tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:51.628091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-937c0c2c-30a5-4296-a389-074e7b0a125a tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:51.628760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-937c0c2c-30a5-4296-a389-074e7b0a125a tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:51.629532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-937c0c2c-30a5-4296-a389-074e7b0a125a tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:51.629972 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-937c0c2c-30a5-4296-a389-074e7b0a125a tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:51.630415 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-937c0c2c-30a5-4296-a389-074e7b0a125a tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:51.660577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-937c0c2c-30a5-4296-a389-074e7b0a125a tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: d1a2b64e-81c6-4435-a90e-8125d78512f4] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:14:51.747732 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-937c0c2c-30a5-4296-a389-074e7b0a125a tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4" status: 204 len: 0 microversion: 2.1 time: 0.132180 Aug 24 11:14:51.750675 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3372/7105] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:14:51 2022] DELETE /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:14:51.761077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-60684973-ff9d-4026-a46e-bc0b1cd4c996 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:51.761724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-60684973-ff9d-4026-a46e-bc0b1cd4c996 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: d1a2b64e-81c6-4435-a90e-8125d78512f4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:51.769280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60684973-ff9d-4026-a46e-bc0b1cd4c996 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:51.769999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60684973-ff9d-4026-a46e-bc0b1cd4c996 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:51.770454 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60684973-ff9d-4026-a46e-bc0b1cd4c996 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:51.771237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60684973-ff9d-4026-a46e-bc0b1cd4c996 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:51.771698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60684973-ff9d-4026-a46e-bc0b1cd4c996 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:51.772137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60684973-ff9d-4026-a46e-bc0b1cd4c996 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:51.929090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-60684973-ff9d-4026-a46e-bc0b1cd4c996 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:51.940896 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-60684973-ff9d-4026-a46e-bc0b1cd4c996 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4" status: 200 len: 1562 microversion: 2.1 time: 0.185554 Aug 24 11:14:51.942309 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3734/7106] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:51 2022] GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4 => generated 1562 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:52.973612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b7054389-df61-424b-8892-db68b8887fa4 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:52.974688 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b7054389-df61-424b-8892-db68b8887fa4 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: d1a2b64e-81c6-4435-a90e-8125d78512f4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:52.986365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7054389-df61-424b-8892-db68b8887fa4 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:52.987478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7054389-df61-424b-8892-db68b8887fa4 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:52.988245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7054389-df61-424b-8892-db68b8887fa4 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:52.989455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7054389-df61-424b-8892-db68b8887fa4 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:52.990205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7054389-df61-424b-8892-db68b8887fa4 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:52.990945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7054389-df61-424b-8892-db68b8887fa4 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:53.138141 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b7054389-df61-424b-8892-db68b8887fa4 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:53.149267 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b7054389-df61-424b-8892-db68b8887fa4 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4" status: 200 len: 1562 microversion: 2.1 time: 0.182510 Aug 24 11:14:53.149855 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3373/7107] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:52 2022] GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4 => generated 1562 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:54.023773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a49efbdf-1ef5-40f7-a833-3c1b63728e94 req-2cff828d-91d3-4259-b46a-29566b6387a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1a2b64e-81c6-4435-a90e-8125d78512f4", "name": "network-vif-deleted", "tag": "82472b02-c277-4d26-9616-34dc2bc2faec"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:14:54.039029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a49efbdf-1ef5-40f7-a833-3c1b63728e94 req-2cff828d-91d3-4259-b46a-29566b6387a2 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:54.039427 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a49efbdf-1ef5-40f7-a833-3c1b63728e94 req-2cff828d-91d3-4259-b46a-29566b6387a2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:54.039870 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a49efbdf-1ef5-40f7-a833-3c1b63728e94 req-2cff828d-91d3-4259-b46a-29566b6387a2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:54.052491 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a49efbdf-1ef5-40f7-a833-3c1b63728e94 req-2cff828d-91d3-4259-b46a-29566b6387a2 service nova] Creating event network-vif-deleted:82472b02-c277-4d26-9616-34dc2bc2faec for instance d1a2b64e-81c6-4435-a90e-8125d78512f4 on n-h1-849328-3 Aug 24 11:14:54.058851 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a49efbdf-1ef5-40f7-a833-3c1b63728e94 req-2cff828d-91d3-4259-b46a-29566b6387a2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041399 Aug 24 11:14:54.059489 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3735/7108] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:14:54.171502 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-025ad2e6-0e67-4a07-a2c0-355070061d44 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:54.172168 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-025ad2e6-0e67-4a07-a2c0-355070061d44 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: d1a2b64e-81c6-4435-a90e-8125d78512f4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:54.179840 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025ad2e6-0e67-4a07-a2c0-355070061d44 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:54.180359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025ad2e6-0e67-4a07-a2c0-355070061d44 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:54.180789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025ad2e6-0e67-4a07-a2c0-355070061d44 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:54.181517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025ad2e6-0e67-4a07-a2c0-355070061d44 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:54.181960 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025ad2e6-0e67-4a07-a2c0-355070061d44 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:54.182380 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025ad2e6-0e67-4a07-a2c0-355070061d44 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:54.216491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025ad2e6-0e67-4a07-a2c0-355070061d44 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:54.216969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025ad2e6-0e67-4a07-a2c0-355070061d44 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:54.217446 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025ad2e6-0e67-4a07-a2c0-355070061d44 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:54.217903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-025ad2e6-0e67-4a07-a2c0-355070061d44 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lazy-loading 'fault' on Instance uuid d1a2b64e-81c6-4435-a90e-8125d78512f4 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:14:54.259746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-025ad2e6-0e67-4a07-a2c0-355070061d44 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:54.268129 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-025ad2e6-0e67-4a07-a2c0-355070061d44 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4" status: 200 len: 1353 microversion: 2.1 time: 0.101009 Aug 24 11:14:54.268695 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3374/7109] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:54 2022] GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4 => generated 1353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:55.293154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1a68f005-b1e1-409b-ad46-5d6b00977bee tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:55.293841 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1a68f005-b1e1-409b-ad46-5d6b00977bee tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: d1a2b64e-81c6-4435-a90e-8125d78512f4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:55.302928 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a68f005-b1e1-409b-ad46-5d6b00977bee tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:55.303682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a68f005-b1e1-409b-ad46-5d6b00977bee tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:55.304292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a68f005-b1e1-409b-ad46-5d6b00977bee tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:55.305001 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a68f005-b1e1-409b-ad46-5d6b00977bee tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:55.305562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a68f005-b1e1-409b-ad46-5d6b00977bee tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:55.306061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a68f005-b1e1-409b-ad46-5d6b00977bee tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:55.320391 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-1a68f005-b1e1-409b-ad46-5d6b00977bee tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] HTTP exception thrown: Instance d1a2b64e-81c6-4435-a90e-8125d78512f4 could not be found. Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1a68f005-b1e1-409b-ad46-5d6b00977bee tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Request method failure captured: Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4 HTTP/1.1 Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgfgBqfRgZu77BVk8DO02clRic8_7bHj1_TPsvhFDMvKymD-h31XDC3NGl38uf9w_il53-IzucRZuAFOHiBwXYEBxj7roFUibBA2108fxZwTXkCZGpUT9C2EZ-nHOQ-Azk4hGMldieOQaGkY5PsaG3Qnqd4ecUfi0J0PJ5HSBuKBL0I Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: bc838a17ae334ea48e149b6b5010e857 Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1328932639 Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bc838a17ae334ea48e149b6b5010e857"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bc838a17ae334ea48e149b6b5010e857", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bc838a17ae334ea48e149b6b5010e857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bc838a17ae334ea48e149b6b5010e857"}]}] Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestEncryptedCinderVolumes-1328932639 Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: bc838a17ae334ea48e149b6b5010e857 Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1328932639 Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestEncryptedCinderVolumes-1328932639-project Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: d7c0ac68e72f40faaff82435f960b81a Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestEncryptedCinderVolumes-1328932639-project Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance d1a2b64e-81c6-4435-a90e-8125d78512f4 could not be found. Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'd1a2b64e-81c6-4435-a90e-8125d78512f4'} Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1a2b64e-81c6-4435-a90e-8125d78512f4 could not be found. Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1a2b64e-81c6-4435-a90e-8125d78512f4 could not be found. Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:14:55.322127 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:14:55.327643 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:14:55.327643 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:14:55.327643 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:14:55.327643 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:14:55.327643 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:14:55.327643 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:14:55.327643 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1a2b64e-81c6-4435-a90e-8125d78512f4 could not be found. Aug 24 11:14:55.327643 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:14:55.327643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1a68f005-b1e1-409b-ad46-5d6b00977bee tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Returning 404 to user: Instance d1a2b64e-81c6-4435-a90e-8125d78512f4 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:14:55.327643 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1a68f005-b1e1-409b-ad46-5d6b00977bee tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4" status: 404 len: 111 microversion: 2.1 time: 0.038061 Aug 24 11:14:55.327643 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3736/7110] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:55 2022] GET /compute/v2.1/servers/d1a2b64e-81c6-4435-a90e-8125d78512f4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:14:55.335496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ceb3b1c5-196a-4ad3-acc1-c3e30e2ed8f0 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '.version_select at 0x7f4655074040>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:55.357742 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ceb3b1c5-196a-4ad3-acc1-c3e30e2ed8f0 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1913005746" status: 202 len: 0 microversion: 2.1 time: 0.028152 Aug 24 11:14:55.358353 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3375/7111] 10.222.0.85 () {58 vars in 1278 bytes} [Wed Aug 24 11:14:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1913005746 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:14:55.379938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-40963657-7f18-4030-a4c6-484461f1d62a tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Action: 'create', calling method: .version_select at 0x7f465a1ed5e0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-828521682", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6Qf0izuddh1Ri+9WCSqhkgKmOeAQB5NEyE3teDMySB0JENRpG02YBcoqG7gSEJc1wII0peicK6Fshoh96QuZ79EbHp86hSH49M6tW1qyOde4HpE6x1dZJ0mGxHB1HYTg=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:14:55.400479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-40963657-7f18-4030-a4c6-484461f1d62a tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Getting quotas for project bc838a17ae334ea48e149b6b5010e857. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:14:55.405849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-40963657-7f18-4030-a4c6-484461f1d62a tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Getting quotas for user d7c0ac68e72f40faaff82435f960b81a and project bc838a17ae334ea48e149b6b5010e857. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:14:55.433339 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-40963657-7f18-4030-a4c6-484461f1d62a tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.059178 Aug 24 11:14:55.433962 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3737/7112] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 11:14:55 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:14:55.492632 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9ae829c2-1c8f-4f38-8b1d-22153824b707 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1581992283", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-828521682", "networks": [{"uuid": "e61a9b3f-0cff-4c72-823f-b1da0d5845a9"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:14:55.547972 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-9ae829c2-1c8f-4f38-8b1d-22153824b707 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] validate_networks() for [('e61a9b3f-0cff-4c72-823f-b1da0d5845a9', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:14:55.956747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9ae829c2-1c8f-4f38-8b1d-22153824b707 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:14:55.957383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9ae829c2-1c8f-4f38-8b1d-22153824b707 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:14:55.958114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9ae829c2-1c8f-4f38-8b1d-22153824b707 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:14:55.958691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9ae829c2-1c8f-4f38-8b1d-22153824b707 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:14:55.959350 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9ae829c2-1c8f-4f38-8b1d-22153824b707 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:14:55.969614 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ae829c2-1c8f-4f38-8b1d-22153824b707 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:55.970123 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ae829c2-1c8f-4f38-8b1d-22153824b707 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:55.970558 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ae829c2-1c8f-4f38-8b1d-22153824b707 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:55.971275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ae829c2-1c8f-4f38-8b1d-22153824b707 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:55.971729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ae829c2-1c8f-4f38-8b1d-22153824b707 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:55.972152 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ae829c2-1c8f-4f38-8b1d-22153824b707 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:55.990011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-9ae829c2-1c8f-4f38-8b1d-22153824b707 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Getting quotas for project bc838a17ae334ea48e149b6b5010e857. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:14:55.995888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-9ae829c2-1c8f-4f38-8b1d-22153824b707 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Getting quotas for user d7c0ac68e72f40faaff82435f960b81a and project bc838a17ae334ea48e149b6b5010e857. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:14:56.010071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9ae829c2-1c8f-4f38-8b1d-22153824b707 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:14:56.012424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9ae829c2-1c8f-4f38-8b1d-22153824b707 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: 15899627-a417-4cb7-857b-d265273f692d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:14:56.060063 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9ae829c2-1c8f-4f38-8b1d-22153824b707 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571624 Aug 24 11:14:56.060759 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3376/7113] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 11:14:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:14:56.071862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-795d4c39-a614-44cb-94b5-7bff9e90b29d tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:56.072483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-795d4c39-a614-44cb-94b5-7bff9e90b29d tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: 15899627-a417-4cb7-857b-d265273f692d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:56.127730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-795d4c39-a614-44cb-94b5-7bff9e90b29d tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:56.135711 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-795d4c39-a614-44cb-94b5-7bff9e90b29d tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d" status: 200 len: 1262 microversion: 2.1 time: 0.067820 Aug 24 11:14:56.136294 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3738/7114] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:56 2022] GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d => generated 1262 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:57.157741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df2db3ee-74b2-4f1d-97a4-0ba10cdeb4b5 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:57.159835 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-df2db3ee-74b2-4f1d-97a4-0ba10cdeb4b5 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: 15899627-a417-4cb7-857b-d265273f692d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:57.166532 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df2db3ee-74b2-4f1d-97a4-0ba10cdeb4b5 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:57.167026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df2db3ee-74b2-4f1d-97a4-0ba10cdeb4b5 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:57.167429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df2db3ee-74b2-4f1d-97a4-0ba10cdeb4b5 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:57.168414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df2db3ee-74b2-4f1d-97a4-0ba10cdeb4b5 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:57.168962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df2db3ee-74b2-4f1d-97a4-0ba10cdeb4b5 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:57.169486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df2db3ee-74b2-4f1d-97a4-0ba10cdeb4b5 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:57.236343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-df2db3ee-74b2-4f1d-97a4-0ba10cdeb4b5 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:57.245175 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-df2db3ee-74b2-4f1d-97a4-0ba10cdeb4b5 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d" status: 200 len: 1322 microversion: 2.1 time: 0.092088 Aug 24 11:14:57.245919 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3377/7115] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:57 2022] GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d => generated 1322 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:58.267054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-be7e21af-8164-4d33-90d3-d1b602ccedff tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:58.267616 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-be7e21af-8164-4d33-90d3-d1b602ccedff tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: 15899627-a417-4cb7-857b-d265273f692d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:58.274573 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be7e21af-8164-4d33-90d3-d1b602ccedff tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:58.275090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be7e21af-8164-4d33-90d3-d1b602ccedff tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:58.275566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be7e21af-8164-4d33-90d3-d1b602ccedff tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:58.276291 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be7e21af-8164-4d33-90d3-d1b602ccedff tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:58.276765 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be7e21af-8164-4d33-90d3-d1b602ccedff tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:58.277233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be7e21af-8164-4d33-90d3-d1b602ccedff tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:58.412840 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-be7e21af-8164-4d33-90d3-d1b602ccedff tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:58.421928 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-be7e21af-8164-4d33-90d3-d1b602ccedff tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d" status: 200 len: 1362 microversion: 2.1 time: 0.158931 Aug 24 11:14:58.422533 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3739/7116] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:58 2022] GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:58.572052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e1f25c81-14a7-44fc-a537-0f9e94cb461d req-e2bf2894-f5a0-48c8-8f28-620bbdd13d57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15899627-a417-4cb7-857b-d265273f692d", "tag": "aba71a99-b4ba-4cb4-8452-cb5c8ba6dd27"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:14:58.583732 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e1f25c81-14a7-44fc-a537-0f9e94cb461d req-e2bf2894-f5a0-48c8-8f28-620bbdd13d57 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:58.584217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e1f25c81-14a7-44fc-a537-0f9e94cb461d req-e2bf2894-f5a0-48c8-8f28-620bbdd13d57 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:58.584653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e1f25c81-14a7-44fc-a537-0f9e94cb461d req-e2bf2894-f5a0-48c8-8f28-620bbdd13d57 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:58.597004 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e1f25c81-14a7-44fc-a537-0f9e94cb461d req-e2bf2894-f5a0-48c8-8f28-620bbdd13d57 service nova] Creating event network-changed:aba71a99-b4ba-4cb4-8452-cb5c8ba6dd27 for instance 15899627-a417-4cb7-857b-d265273f692d on n-h2-849328-3 Aug 24 11:14:58.602446 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e1f25c81-14a7-44fc-a537-0f9e94cb461d req-e2bf2894-f5a0-48c8-8f28-620bbdd13d57 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034570 Aug 24 11:14:58.603235 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3378/7117] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:14:59.446107 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b0edf2ea-3ef9-4892-87f3-d44ed4768613 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:59.446918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b0edf2ea-3ef9-4892-87f3-d44ed4768613 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: 15899627-a417-4cb7-857b-d265273f692d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:59.460369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0edf2ea-3ef9-4892-87f3-d44ed4768613 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:59.460369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0edf2ea-3ef9-4892-87f3-d44ed4768613 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:59.460369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0edf2ea-3ef9-4892-87f3-d44ed4768613 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:59.460369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0edf2ea-3ef9-4892-87f3-d44ed4768613 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:59.460369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0edf2ea-3ef9-4892-87f3-d44ed4768613 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:59.460369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0edf2ea-3ef9-4892-87f3-d44ed4768613 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:59.609693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b0edf2ea-3ef9-4892-87f3-d44ed4768613 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:59.621231 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b0edf2ea-3ef9-4892-87f3-d44ed4768613 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d" status: 200 len: 1362 microversion: 2.1 time: 0.180997 Aug 24 11:14:59.622094 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3740/7118] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:59 2022] GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:00.650925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9ede6161-e8b3-4fa6-8e15-98cbdcc82ebf tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:00.651628 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9ede6161-e8b3-4fa6-8e15-98cbdcc82ebf tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: 15899627-a417-4cb7-857b-d265273f692d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:00.658569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ede6161-e8b3-4fa6-8e15-98cbdcc82ebf tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:00.659049 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ede6161-e8b3-4fa6-8e15-98cbdcc82ebf tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:00.659486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ede6161-e8b3-4fa6-8e15-98cbdcc82ebf tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:00.660158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ede6161-e8b3-4fa6-8e15-98cbdcc82ebf tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:00.660630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ede6161-e8b3-4fa6-8e15-98cbdcc82ebf tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:00.661055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ede6161-e8b3-4fa6-8e15-98cbdcc82ebf tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:00.819620 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9ede6161-e8b3-4fa6-8e15-98cbdcc82ebf tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:00.830242 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9ede6161-e8b3-4fa6-8e15-98cbdcc82ebf tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d" status: 200 len: 1362 microversion: 2.1 time: 0.185871 Aug 24 11:15:00.831134 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3379/7119] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:00 2022] GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:01.855915 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4f1f96e2-66dd-43ce-aad2-5bc3997e2ad9 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:01.856598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4f1f96e2-66dd-43ce-aad2-5bc3997e2ad9 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: 15899627-a417-4cb7-857b-d265273f692d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:01.866235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f1f96e2-66dd-43ce-aad2-5bc3997e2ad9 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:01.866926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f1f96e2-66dd-43ce-aad2-5bc3997e2ad9 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:01.867562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f1f96e2-66dd-43ce-aad2-5bc3997e2ad9 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:01.868444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f1f96e2-66dd-43ce-aad2-5bc3997e2ad9 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:01.869015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f1f96e2-66dd-43ce-aad2-5bc3997e2ad9 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:01.869735 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f1f96e2-66dd-43ce-aad2-5bc3997e2ad9 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:02.012441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4f1f96e2-66dd-43ce-aad2-5bc3997e2ad9 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:02.020352 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4f1f96e2-66dd-43ce-aad2-5bc3997e2ad9 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d" status: 200 len: 1362 microversion: 2.1 time: 0.169770 Aug 24 11:15:02.021303 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3741/7120] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:01 2022] GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:03.045007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b66f54d1-2742-4c95-b1c2-e3620ef72d45 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:03.046073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b66f54d1-2742-4c95-b1c2-e3620ef72d45 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: 15899627-a417-4cb7-857b-d265273f692d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:03.056538 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b66f54d1-2742-4c95-b1c2-e3620ef72d45 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:03.057025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b66f54d1-2742-4c95-b1c2-e3620ef72d45 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:03.057497 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b66f54d1-2742-4c95-b1c2-e3620ef72d45 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:03.058202 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b66f54d1-2742-4c95-b1c2-e3620ef72d45 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:03.058654 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b66f54d1-2742-4c95-b1c2-e3620ef72d45 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:03.059050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b66f54d1-2742-4c95-b1c2-e3620ef72d45 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:03.208499 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b66f54d1-2742-4c95-b1c2-e3620ef72d45 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:03.220920 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b66f54d1-2742-4c95-b1c2-e3620ef72d45 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d" status: 200 len: 1362 microversion: 2.1 time: 0.182245 Aug 24 11:15:03.222064 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3380/7121] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:03 2022] GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:04.127620 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-7fb424b9-7365-4d5a-b425-33fac8409c89 req-d57c5492-cb01-4b97-8ac8-83583a9fd020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15899627-a417-4cb7-857b-d265273f692d", "name": "network-vif-plugged", "status": "completed", "tag": "aba71a99-b4ba-4cb4-8452-cb5c8ba6dd27"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:15:04.140179 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7fb424b9-7365-4d5a-b425-33fac8409c89 req-d57c5492-cb01-4b97-8ac8-83583a9fd020 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:04.140686 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7fb424b9-7365-4d5a-b425-33fac8409c89 req-d57c5492-cb01-4b97-8ac8-83583a9fd020 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:04.141152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7fb424b9-7365-4d5a-b425-33fac8409c89 req-d57c5492-cb01-4b97-8ac8-83583a9fd020 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:04.152986 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-7fb424b9-7365-4d5a-b425-33fac8409c89 req-d57c5492-cb01-4b97-8ac8-83583a9fd020 service nova] Creating event network-vif-plugged:aba71a99-b4ba-4cb4-8452-cb5c8ba6dd27 for instance 15899627-a417-4cb7-857b-d265273f692d on n-h2-849328-3 Aug 24 11:15:04.158305 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-7fb424b9-7365-4d5a-b425-33fac8409c89 req-d57c5492-cb01-4b97-8ac8-83583a9fd020 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034570 Aug 24 11:15:04.159144 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3742/7122] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:15:04.243172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-00b92d89-5b51-46d8-b17f-b582a4c18ed6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:04.243744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-00b92d89-5b51-46d8-b17f-b582a4c18ed6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: 15899627-a417-4cb7-857b-d265273f692d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:04.251176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b92d89-5b51-46d8-b17f-b582a4c18ed6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:04.251750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b92d89-5b51-46d8-b17f-b582a4c18ed6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:04.252961 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b92d89-5b51-46d8-b17f-b582a4c18ed6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:04.253702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b92d89-5b51-46d8-b17f-b582a4c18ed6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:04.255029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b92d89-5b51-46d8-b17f-b582a4c18ed6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:04.255029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00b92d89-5b51-46d8-b17f-b582a4c18ed6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:04.418387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-00b92d89-5b51-46d8-b17f-b582a4c18ed6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:04.426681 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-00b92d89-5b51-46d8-b17f-b582a4c18ed6 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d" status: 200 len: 1362 microversion: 2.1 time: 0.187666 Aug 24 11:15:04.427271 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3381/7123] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:04 2022] GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:05.449875 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-62877d6e-a96e-4c3d-b57f-8fa26fcdcddc tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:05.450793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-62877d6e-a96e-4c3d-b57f-8fa26fcdcddc tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: 15899627-a417-4cb7-857b-d265273f692d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:05.457492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62877d6e-a96e-4c3d-b57f-8fa26fcdcddc tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:05.458010 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62877d6e-a96e-4c3d-b57f-8fa26fcdcddc tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:05.458460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62877d6e-a96e-4c3d-b57f-8fa26fcdcddc tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:05.459191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62877d6e-a96e-4c3d-b57f-8fa26fcdcddc tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:05.459664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62877d6e-a96e-4c3d-b57f-8fa26fcdcddc tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:05.460122 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62877d6e-a96e-4c3d-b57f-8fa26fcdcddc tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:05.600238 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-62877d6e-a96e-4c3d-b57f-8fa26fcdcddc tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:05.608638 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-62877d6e-a96e-4c3d-b57f-8fa26fcdcddc tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d" status: 200 len: 1362 microversion: 2.1 time: 0.164270 Aug 24 11:15:05.609262 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3743/7124] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:05 2022] GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:06.630280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c97f7ef5-ca5a-4752-9fa4-70cec7e18707 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:06.631056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c97f7ef5-ca5a-4752-9fa4-70cec7e18707 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: 15899627-a417-4cb7-857b-d265273f692d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:06.634206 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:15:06.634885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:15:06.641147 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c97f7ef5-ca5a-4752-9fa4-70cec7e18707 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:06.641660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c97f7ef5-ca5a-4752-9fa4-70cec7e18707 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:06.642097 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c97f7ef5-ca5a-4752-9fa4-70cec7e18707 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:06.642792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c97f7ef5-ca5a-4752-9fa4-70cec7e18707 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:06.643241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c97f7ef5-ca5a-4752-9fa4-70cec7e18707 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:06.643667 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c97f7ef5-ca5a-4752-9fa4-70cec7e18707 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:06.775809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c97f7ef5-ca5a-4752-9fa4-70cec7e18707 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:06.784030 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c97f7ef5-ca5a-4752-9fa4-70cec7e18707 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d" status: 200 len: 1554 microversion: 2.1 time: 0.157693 Aug 24 11:15:06.784612 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3382/7125] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:06 2022] GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:06.804397 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b870f9a3-e715-48b7-97fc-88dd397784dd tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:06.805138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b870f9a3-e715-48b7-97fc-88dd397784dd tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: 15899627-a417-4cb7-857b-d265273f692d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:06.807149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:15:06.813534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b870f9a3-e715-48b7-97fc-88dd397784dd tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:06.814033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b870f9a3-e715-48b7-97fc-88dd397784dd tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:06.814478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b870f9a3-e715-48b7-97fc-88dd397784dd tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:06.815185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b870f9a3-e715-48b7-97fc-88dd397784dd tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:06.815648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b870f9a3-e715-48b7-97fc-88dd397784dd tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:06.816085 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b870f9a3-e715-48b7-97fc-88dd397784dd tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:06.946006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b870f9a3-e715-48b7-97fc-88dd397784dd tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:06.954169 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b870f9a3-e715-48b7-97fc-88dd397784dd tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d" status: 200 len: 1554 microversion: 2.1 time: 0.153795 Aug 24 11:15:06.954757 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3744/7126] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:06 2022] GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:08.453448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c50f9163-03ef-429f-a1b7-4a61556473fd tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fc3ee88-4735-4ae3-8b0e-8a0eaff51e10"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:15:08.455922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c50f9163-03ef-429f-a1b7-4a61556473fd tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: 15899627-a417-4cb7-857b-d265273f692d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:08.462978 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c50f9163-03ef-429f-a1b7-4a61556473fd tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:08.463468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c50f9163-03ef-429f-a1b7-4a61556473fd tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:08.463902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c50f9163-03ef-429f-a1b7-4a61556473fd tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:08.464592 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c50f9163-03ef-429f-a1b7-4a61556473fd tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:08.465045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c50f9163-03ef-429f-a1b7-4a61556473fd tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:08.465495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c50f9163-03ef-429f-a1b7-4a61556473fd tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:08.598670 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:15:08.721050 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c50f9163-03ef-429f-a1b7-4a61556473fd tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "POST /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271474 Aug 24 11:15:08.726981 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3383/7127] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Aug 24 11:15:08 2022] POST /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:15:19.465325 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0888cbcd-512d-4ecc-8af3-5ad9e2a46b30 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:19.465866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0888cbcd-512d-4ecc-8af3-5ad9e2a46b30 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: 15899627-a417-4cb7-857b-d265273f692d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:19.468301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:15:19.469023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=66 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:15:19.475484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0888cbcd-512d-4ecc-8af3-5ad9e2a46b30 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:19.475983 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0888cbcd-512d-4ecc-8af3-5ad9e2a46b30 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:19.476414 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0888cbcd-512d-4ecc-8af3-5ad9e2a46b30 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:19.477147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0888cbcd-512d-4ecc-8af3-5ad9e2a46b30 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:19.477630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0888cbcd-512d-4ecc-8af3-5ad9e2a46b30 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:19.478062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0888cbcd-512d-4ecc-8af3-5ad9e2a46b30 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:19.563557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-0888cbcd-512d-4ecc-8af3-5ad9e2a46b30 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lazy-loading 'services' on Instance uuid 15899627-a417-4cb7-857b-d265273f692d {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:15:19.650131 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0888cbcd-512d-4ecc-8af3-5ad9e2a46b30 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "DELETE /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d/os-volume_attachments/5fc3ee88-4735-4ae3-8b0e-8a0eaff51e10" status: 202 len: 0 microversion: 2.1 time: 0.188885 Aug 24 11:15:19.650794 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3745/7128] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Aug 24 11:15:19 2022] DELETE /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d/os-volume_attachments/5fc3ee88-4735-4ae3-8b0e-8a0eaff51e10 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:15:19.658454 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:15:19.659317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:15:19.664589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b7cedd40-2fe5-4cc3-a45e-d2afd07d0281 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:19.667273 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b7cedd40-2fe5-4cc3-a45e-d2afd07d0281 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: 15899627-a417-4cb7-857b-d265273f692d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:19.676916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7cedd40-2fe5-4cc3-a45e-d2afd07d0281 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:19.677449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7cedd40-2fe5-4cc3-a45e-d2afd07d0281 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:19.677894 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7cedd40-2fe5-4cc3-a45e-d2afd07d0281 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:19.678609 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7cedd40-2fe5-4cc3-a45e-d2afd07d0281 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:19.679062 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7cedd40-2fe5-4cc3-a45e-d2afd07d0281 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:19.679493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7cedd40-2fe5-4cc3-a45e-d2afd07d0281 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:19.718508 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b7cedd40-2fe5-4cc3-a45e-d2afd07d0281 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062935 Aug 24 11:15:19.719193 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3384/7129] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:15:19 2022] GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:15:20.732667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b6d9a3fa-9928-41ea-b79a-4196ad3d635c tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:20.735070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b6d9a3fa-9928-41ea-b79a-4196ad3d635c tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: 15899627-a417-4cb7-857b-d265273f692d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:20.742955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6d9a3fa-9928-41ea-b79a-4196ad3d635c tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:20.743463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6d9a3fa-9928-41ea-b79a-4196ad3d635c tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:20.743913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6d9a3fa-9928-41ea-b79a-4196ad3d635c tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:20.744608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6d9a3fa-9928-41ea-b79a-4196ad3d635c tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:20.745078 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6d9a3fa-9928-41ea-b79a-4196ad3d635c tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:20.745543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6d9a3fa-9928-41ea-b79a-4196ad3d635c tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:20.777581 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b6d9a3fa-9928-41ea-b79a-4196ad3d635c tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050027 Aug 24 11:15:20.778069 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3746/7130] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:15:20 2022] GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:15:21.790769 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6a91fc89-f761-4678-84f6-e43fc7ac0481 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:21.793012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6a91fc89-f761-4678-84f6-e43fc7ac0481 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: 15899627-a417-4cb7-857b-d265273f692d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:21.800485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a91fc89-f761-4678-84f6-e43fc7ac0481 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:21.801005 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a91fc89-f761-4678-84f6-e43fc7ac0481 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:21.801698 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a91fc89-f761-4678-84f6-e43fc7ac0481 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:21.802168 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a91fc89-f761-4678-84f6-e43fc7ac0481 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:21.802620 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a91fc89-f761-4678-84f6-e43fc7ac0481 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:21.803044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a91fc89-f761-4678-84f6-e43fc7ac0481 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:21.835679 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6a91fc89-f761-4678-84f6-e43fc7ac0481 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049483 Aug 24 11:15:21.836321 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3385/7131] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:15:21 2022] GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:15:22.848905 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-53d33625-1594-4dcd-95d5-e53f0e8393f1 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:22.851183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-53d33625-1594-4dcd-95d5-e53f0e8393f1 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: 15899627-a417-4cb7-857b-d265273f692d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:22.858553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53d33625-1594-4dcd-95d5-e53f0e8393f1 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:22.859057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53d33625-1594-4dcd-95d5-e53f0e8393f1 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:22.859504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53d33625-1594-4dcd-95d5-e53f0e8393f1 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:22.860237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53d33625-1594-4dcd-95d5-e53f0e8393f1 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:22.860711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53d33625-1594-4dcd-95d5-e53f0e8393f1 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:22.861152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53d33625-1594-4dcd-95d5-e53f0e8393f1 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:22.894972 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-53d33625-1594-4dcd-95d5-e53f0e8393f1 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050491 Aug 24 11:15:22.895635 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3747/7132] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:15:22 2022] GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:15:23.908098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-52212824-54ca-422c-9624-dad28f4c5099 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:23.910525 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-52212824-54ca-422c-9624-dad28f4c5099 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: 15899627-a417-4cb7-857b-d265273f692d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:23.917901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52212824-54ca-422c-9624-dad28f4c5099 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:23.918395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52212824-54ca-422c-9624-dad28f4c5099 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:23.918836 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52212824-54ca-422c-9624-dad28f4c5099 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:23.919550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52212824-54ca-422c-9624-dad28f4c5099 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:23.920011 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52212824-54ca-422c-9624-dad28f4c5099 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:23.920442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52212824-54ca-422c-9624-dad28f4c5099 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:23.957560 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-52212824-54ca-422c-9624-dad28f4c5099 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053915 Aug 24 11:15:23.958169 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3386/7133] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:15:23 2022] GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:15:24.971394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-63f4e966-9621-4a82-b600-1417d0c8deab tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:24.973648 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-63f4e966-9621-4a82-b600-1417d0c8deab tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: 15899627-a417-4cb7-857b-d265273f692d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:24.982374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63f4e966-9621-4a82-b600-1417d0c8deab tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:24.982877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63f4e966-9621-4a82-b600-1417d0c8deab tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:24.983329 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63f4e966-9621-4a82-b600-1417d0c8deab tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:24.984044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63f4e966-9621-4a82-b600-1417d0c8deab tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:24.984509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63f4e966-9621-4a82-b600-1417d0c8deab tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:24.984944 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63f4e966-9621-4a82-b600-1417d0c8deab tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:25.016352 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-63f4e966-9621-4a82-b600-1417d0c8deab tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049005 Aug 24 11:15:25.016937 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3748/7134] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:15:24 2022] GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:15:25.031116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2799b1db-43a0-4de1-b6b1-082d537aef5f tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:25.031660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2799b1db-43a0-4de1-b6b1-082d537aef5f tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: 15899627-a417-4cb7-857b-d265273f692d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:25.040497 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2799b1db-43a0-4de1-b6b1-082d537aef5f tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:25.040985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2799b1db-43a0-4de1-b6b1-082d537aef5f tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:25.041445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2799b1db-43a0-4de1-b6b1-082d537aef5f tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:25.042676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2799b1db-43a0-4de1-b6b1-082d537aef5f tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:25.042676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2799b1db-43a0-4de1-b6b1-082d537aef5f tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:25.043094 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2799b1db-43a0-4de1-b6b1-082d537aef5f tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:25.122715 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-2799b1db-43a0-4de1-b6b1-082d537aef5f tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] HTTP exception thrown: Instance 15899627-a417-4cb7-857b-d265273f692d is not attached to volume 5fc3ee88-4735-4ae3-8b0e-8a0eaff51e10 Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2799b1db-43a0-4de1-b6b1-082d537aef5f tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Request method failure captured: Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d/os-volume_attachments/5fc3ee88-4735-4ae3-8b0e-8a0eaff51e10 HTTP/1.1 Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgfgBqfRgZu77BVk8DO02clRic8_7bHj1_TPsvhFDMvKymD-h31XDC3NGl38uf9w_il53-IzucRZuAFOHiBwXYEBxj7roFUibBA2108fxZwTXkCZGpUT9C2EZ-nHOQ-Azk4hGMldieOQaGkY5PsaG3Qnqd4ecUfi0J0PJ5HSBuKBL0I Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: bc838a17ae334ea48e149b6b5010e857 Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1328932639 Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bc838a17ae334ea48e149b6b5010e857"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bc838a17ae334ea48e149b6b5010e857", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bc838a17ae334ea48e149b6b5010e857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bc838a17ae334ea48e149b6b5010e857"}]}] Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-TestEncryptedCinderVolumes-1328932639 Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: bc838a17ae334ea48e149b6b5010e857 Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1328932639 Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-TestEncryptedCinderVolumes-1328932639-project Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: d7c0ac68e72f40faaff82435f960b81a Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-TestEncryptedCinderVolumes-1328932639-project Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 15899627-a417-4cb7-857b-d265273f692d is not attached to volume 5fc3ee88-4735-4ae3-8b0e-8a0eaff51e10 Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'server_id': '15899627-a417-4cb7-857b-d265273f692d', 'id': '5fc3ee88-4735-4ae3-8b0e-8a0eaff51e10'} Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5fc3ee88-4735-4ae3-8b0e-8a0eaff51e10. Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15899627-a417-4cb7-857b-d265273f692d is not attached to volume 5fc3ee88-4735-4ae3-8b0e-8a0eaff51e10 Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:15:25.124703 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:15:25.128877 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:15:25.128877 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:15:25.128877 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15899627-a417-4cb7-857b-d265273f692d is not attached to volume 5fc3ee88-4735-4ae3-8b0e-8a0eaff51e10 Aug 24 11:15:25.128877 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:15:25.128877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2799b1db-43a0-4de1-b6b1-082d537aef5f tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Returning 404 to user: Instance 15899627-a417-4cb7-857b-d265273f692d is not attached to volume 5fc3ee88-4735-4ae3-8b0e-8a0eaff51e10 {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:15:25.128877 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2799b1db-43a0-4de1-b6b1-082d537aef5f tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "DELETE /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d/os-volume_attachments/5fc3ee88-4735-4ae3-8b0e-8a0eaff51e10" status: 404 len: 154 microversion: 2.1 time: 0.101219 Aug 24 11:15:25.128877 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3387/7135] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Aug 24 11:15:25 2022] DELETE /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d/os-volume_attachments/5fc3ee88-4735-4ae3-8b0e-8a0eaff51e10 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:15:28.489449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c2360500-e9a1-4a7f-870d-3bcf9dd738ce tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:28.490735 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c2360500-e9a1-4a7f-870d-3bcf9dd738ce tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: 15899627-a417-4cb7-857b-d265273f692d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:28.498665 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2360500-e9a1-4a7f-870d-3bcf9dd738ce tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:28.499209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2360500-e9a1-4a7f-870d-3bcf9dd738ce tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:28.499698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2360500-e9a1-4a7f-870d-3bcf9dd738ce tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:28.500453 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2360500-e9a1-4a7f-870d-3bcf9dd738ce tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:28.500914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2360500-e9a1-4a7f-870d-3bcf9dd738ce tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:28.501384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2360500-e9a1-4a7f-870d-3bcf9dd738ce tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:28.534223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c2360500-e9a1-4a7f-870d-3bcf9dd738ce tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: 15899627-a417-4cb7-857b-d265273f692d] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:15:28.624177 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c2360500-e9a1-4a7f-870d-3bcf9dd738ce tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "DELETE /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d" status: 204 len: 0 microversion: 2.1 time: 0.139094 Aug 24 11:15:28.624863 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3749/7136] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:15:28 2022] DELETE /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:15:28.633731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1a586fc6-029e-4179-8f46-9236feb36cf2 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:28.634613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1a586fc6-029e-4179-8f46-9236feb36cf2 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: 15899627-a417-4cb7-857b-d265273f692d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:28.643680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a586fc6-029e-4179-8f46-9236feb36cf2 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:28.644733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a586fc6-029e-4179-8f46-9236feb36cf2 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:28.645396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a586fc6-029e-4179-8f46-9236feb36cf2 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:28.646115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a586fc6-029e-4179-8f46-9236feb36cf2 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:28.646712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a586fc6-029e-4179-8f46-9236feb36cf2 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:28.647126 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a586fc6-029e-4179-8f46-9236feb36cf2 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:28.799271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1a586fc6-029e-4179-8f46-9236feb36cf2 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:28.808187 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1a586fc6-029e-4179-8f46-9236feb36cf2 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d" status: 200 len: 1560 microversion: 2.1 time: 0.178761 Aug 24 11:15:28.808775 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3388/7137] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:28 2022] GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:29.839233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b8bcc78d-52ab-4123-a2e5-a12f40fa08b7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:29.840703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b8bcc78d-52ab-4123-a2e5-a12f40fa08b7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: 15899627-a417-4cb7-857b-d265273f692d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:29.850053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8bcc78d-52ab-4123-a2e5-a12f40fa08b7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:29.850820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8bcc78d-52ab-4123-a2e5-a12f40fa08b7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:29.851503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8bcc78d-52ab-4123-a2e5-a12f40fa08b7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:29.852570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8bcc78d-52ab-4123-a2e5-a12f40fa08b7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:29.853055 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8bcc78d-52ab-4123-a2e5-a12f40fa08b7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:29.853497 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8bcc78d-52ab-4123-a2e5-a12f40fa08b7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:30.012666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b8bcc78d-52ab-4123-a2e5-a12f40fa08b7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:30.021056 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b8bcc78d-52ab-4123-a2e5-a12f40fa08b7 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d" status: 200 len: 1560 microversion: 2.1 time: 0.186412 Aug 24 11:15:30.021694 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3750/7138] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:29 2022] GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:30.932498 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-08c8cadc-cc0e-47ea-9e28-d87708a01cee req-9514f1f4-08e3-412f-85f9-a966ab227708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15899627-a417-4cb7-857b-d265273f692d", "name": "network-vif-deleted", "tag": "aba71a99-b4ba-4cb4-8452-cb5c8ba6dd27"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:15:30.946755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-08c8cadc-cc0e-47ea-9e28-d87708a01cee req-9514f1f4-08e3-412f-85f9-a966ab227708 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:30.947579 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-08c8cadc-cc0e-47ea-9e28-d87708a01cee req-9514f1f4-08e3-412f-85f9-a966ab227708 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:30.948195 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-08c8cadc-cc0e-47ea-9e28-d87708a01cee req-9514f1f4-08e3-412f-85f9-a966ab227708 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:30.961393 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-08c8cadc-cc0e-47ea-9e28-d87708a01cee req-9514f1f4-08e3-412f-85f9-a966ab227708 service nova] Creating event network-vif-deleted:aba71a99-b4ba-4cb4-8452-cb5c8ba6dd27 for instance 15899627-a417-4cb7-857b-d265273f692d on n-h2-849328-3 Aug 24 11:15:30.967130 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-08c8cadc-cc0e-47ea-9e28-d87708a01cee req-9514f1f4-08e3-412f-85f9-a966ab227708 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102018 Aug 24 11:15:30.967878 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3389/7139] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:15:31.042661 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cf63dcf7-b642-466f-9455-733893c1f901 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:31.043216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cf63dcf7-b642-466f-9455-733893c1f901 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: 15899627-a417-4cb7-857b-d265273f692d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:31.050537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf63dcf7-b642-466f-9455-733893c1f901 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:31.051039 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf63dcf7-b642-466f-9455-733893c1f901 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:31.051490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf63dcf7-b642-466f-9455-733893c1f901 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:31.052211 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf63dcf7-b642-466f-9455-733893c1f901 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:31.052677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf63dcf7-b642-466f-9455-733893c1f901 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:31.053145 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf63dcf7-b642-466f-9455-733893c1f901 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:31.086613 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf63dcf7-b642-466f-9455-733893c1f901 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:31.087019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf63dcf7-b642-466f-9455-733893c1f901 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:31.087456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf63dcf7-b642-466f-9455-733893c1f901 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:31.087918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-cf63dcf7-b642-466f-9455-733893c1f901 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lazy-loading 'fault' on Instance uuid 15899627-a417-4cb7-857b-d265273f692d {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:15:31.130887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cf63dcf7-b642-466f-9455-733893c1f901 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c0ac68e72f40faaff82435f960b81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc838a17ae334ea48e149b6b5010e857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:31.139362 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cf63dcf7-b642-466f-9455-733893c1f901 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d" status: 200 len: 1352 microversion: 2.1 time: 0.100825 Aug 24 11:15:31.139961 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3751/7140] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:31 2022] GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d => generated 1352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:32.162410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e1fddd4f-4078-4c9f-a453-c941bc0a8042 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:32.163114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e1fddd4f-4078-4c9f-a453-c941bc0a8042 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] [instance: 15899627-a417-4cb7-857b-d265273f692d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:32.169868 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1fddd4f-4078-4c9f-a453-c941bc0a8042 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:32.170349 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1fddd4f-4078-4c9f-a453-c941bc0a8042 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:32.170791 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1fddd4f-4078-4c9f-a453-c941bc0a8042 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:32.171485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1fddd4f-4078-4c9f-a453-c941bc0a8042 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:32.171936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1fddd4f-4078-4c9f-a453-c941bc0a8042 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:32.172355 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1fddd4f-4078-4c9f-a453-c941bc0a8042 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:32.185918 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-e1fddd4f-4078-4c9f-a453-c941bc0a8042 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] HTTP exception thrown: Instance 15899627-a417-4cb7-857b-d265273f692d could not be found. Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e1fddd4f-4078-4c9f-a453-c941bc0a8042 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Request method failure captured: Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d HTTP/1.1 Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgfgBqfRgZu77BVk8DO02clRic8_7bHj1_TPsvhFDMvKymD-h31XDC3NGl38uf9w_il53-IzucRZuAFOHiBwXYEBxj7roFUibBA2108fxZwTXkCZGpUT9C2EZ-nHOQ-Azk4hGMldieOQaGkY5PsaG3Qnqd4ecUfi0J0PJ5HSBuKBL0I Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: bc838a17ae334ea48e149b6b5010e857 Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1328932639 Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bc838a17ae334ea48e149b6b5010e857"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bc838a17ae334ea48e149b6b5010e857", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bc838a17ae334ea48e149b6b5010e857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bc838a17ae334ea48e149b6b5010e857"}]}] Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-TestEncryptedCinderVolumes-1328932639 Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: bc838a17ae334ea48e149b6b5010e857 Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1328932639 Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-TestEncryptedCinderVolumes-1328932639-project Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: d7c0ac68e72f40faaff82435f960b81a Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-TestEncryptedCinderVolumes-1328932639-project Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 15899627-a417-4cb7-857b-d265273f692d could not be found. Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '15899627-a417-4cb7-857b-d265273f692d'} Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15899627-a417-4cb7-857b-d265273f692d could not be found. Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15899627-a417-4cb7-857b-d265273f692d could not be found. Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:15:32.187562 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:15:32.191818 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:15:32.191818 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:15:32.191818 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:15:32.191818 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:15:32.191818 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:15:32.191818 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:15:32.191818 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15899627-a417-4cb7-857b-d265273f692d could not be found. Aug 24 11:15:32.191818 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:15:32.191818 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e1fddd4f-4078-4c9f-a453-c941bc0a8042 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Returning 404 to user: Instance 15899627-a417-4cb7-857b-d265273f692d could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:15:32.191818 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e1fddd4f-4078-4c9f-a453-c941bc0a8042 tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d" status: 404 len: 111 microversion: 2.1 time: 0.032140 Aug 24 11:15:32.191818 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3390/7141] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:32 2022] GET /compute/v2.1/servers/15899627-a417-4cb7-857b-d265273f692d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:15:32.201150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5e519843-46b9-42f8-b66f-c57ce6d6247d tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] Calling method '.version_select at 0x7f4647992a60>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:32.226282 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5e519843-46b9-42f8-b66f-c57ce6d6247d tempest-TestEncryptedCinderVolumes-1328932639 tempest-TestEncryptedCinderVolumes-1328932639-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-828521682" status: 202 len: 0 microversion: 2.1 time: 0.031678 Aug 24 11:15:32.226886 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3752/7142] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Aug 24 11:15:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-828521682 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:15:59.502985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0f51603c-0e34-4312-9dcb-597c1246d50f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Action: 'create', calling method: .version_select at 0x7f4655212af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1594306928", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEI7+SuxOAJoflG3DV6JasUBn2gZ3J/esY4iHpVHS+AIDv7BCtjALmfN+I7SiKCqglOxt5DK6CVAx6QhFXBVjs+9i82sGZXwKOcfbRMve/TsE27el2KPZovce52qC2kHGA=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:15:59.508485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=14 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:15:59.509168 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=34 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:15:59.521639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-0f51603c-0e34-4312-9dcb-597c1246d50f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Getting quotas for project a00b24f5a0cd4a4c9681d5512fec24ed. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:15:59.527251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-0f51603c-0e34-4312-9dcb-597c1246d50f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Getting quotas for user 2fc9ed8a81f64078b05bfb981164d3a8 and project a00b24f5a0cd4a4c9681d5512fec24ed. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:15:59.552886 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0f51603c-0e34-4312-9dcb-597c1246d50f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.054501 Aug 24 11:15:59.553540 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3391/7143] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 11:15:59 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:15:59.603202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:15:59.604002 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:15:59.608159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c52e0d6f-6bc6-4514-b306-44bdcc0c929e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1147594758", "imageRef": "af8f6f57-a61b-42ee-9bad-9787a2968241", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1594306928", "networks": [{"uuid": "bdbcb075-17fc-4c83-9f27-ac4f1079ab19"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:15:59.661252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-c52e0d6f-6bc6-4514-b306-44bdcc0c929e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] validate_networks() for [('bdbcb075-17fc-4c83-9f27-ac4f1079ab19', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:16:00.041146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c52e0d6f-6bc6-4514-b306-44bdcc0c929e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:16:00.041609 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c52e0d6f-6bc6-4514-b306-44bdcc0c929e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:16:00.042128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c52e0d6f-6bc6-4514-b306-44bdcc0c929e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:16:00.042551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c52e0d6f-6bc6-4514-b306-44bdcc0c929e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:16:00.042974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c52e0d6f-6bc6-4514-b306-44bdcc0c929e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:16:00.052763 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c52e0d6f-6bc6-4514-b306-44bdcc0c929e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:00.053307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c52e0d6f-6bc6-4514-b306-44bdcc0c929e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:00.053762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c52e0d6f-6bc6-4514-b306-44bdcc0c929e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:00.054497 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c52e0d6f-6bc6-4514-b306-44bdcc0c929e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:00.054973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c52e0d6f-6bc6-4514-b306-44bdcc0c929e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:00.055403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c52e0d6f-6bc6-4514-b306-44bdcc0c929e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:00.075386 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-c52e0d6f-6bc6-4514-b306-44bdcc0c929e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Getting quotas for project a00b24f5a0cd4a4c9681d5512fec24ed. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:16:00.081102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-c52e0d6f-6bc6-4514-b306-44bdcc0c929e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Getting quotas for user 2fc9ed8a81f64078b05bfb981164d3a8 and project a00b24f5a0cd4a4c9681d5512fec24ed. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:16:00.095503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c52e0d6f-6bc6-4514-b306-44bdcc0c929e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:16:00.097800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c52e0d6f-6bc6-4514-b306-44bdcc0c929e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af8f6f57-a61b-42ee-9bad-9787a2968241',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:16:00.146688 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c52e0d6f-6bc6-4514-b306-44bdcc0c929e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545806 Aug 24 11:16:00.147435 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3753/7144] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 11:15:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:16:00.158124 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-608c94e3-ded4-4f7d-b371-cd09361d354d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:00.158784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-608c94e3-ded4-4f7d-b371-cd09361d354d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:00.215950 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-608c94e3-ded4-4f7d-b371-cd09361d354d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:00.226136 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-608c94e3-ded4-4f7d-b371-cd09361d354d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8" status: 200 len: 1259 microversion: 2.1 time: 0.071703 Aug 24 11:16:00.226791 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3392/7145] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:16:00 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:16:01.248391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ee300063-50d3-4477-9dfd-b71d2749aee9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:01.249914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ee300063-50d3-4477-9dfd-b71d2749aee9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:01.257296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee300063-50d3-4477-9dfd-b71d2749aee9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:01.257959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee300063-50d3-4477-9dfd-b71d2749aee9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:01.258532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee300063-50d3-4477-9dfd-b71d2749aee9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:01.259358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee300063-50d3-4477-9dfd-b71d2749aee9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:01.260075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee300063-50d3-4477-9dfd-b71d2749aee9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:01.260602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee300063-50d3-4477-9dfd-b71d2749aee9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:01.331452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ee300063-50d3-4477-9dfd-b71d2749aee9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:01.340642 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ee300063-50d3-4477-9dfd-b71d2749aee9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8" status: 200 len: 1319 microversion: 2.1 time: 0.097171 Aug 24 11:16:01.350688 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3754/7146] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:16:01 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 => generated 1319 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:16:02.364307 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ef42be96-369a-4d18-8e50-632126c12e09 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:02.365779 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ef42be96-369a-4d18-8e50-632126c12e09 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:02.374568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef42be96-369a-4d18-8e50-632126c12e09 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:02.375344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef42be96-369a-4d18-8e50-632126c12e09 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:02.375792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef42be96-369a-4d18-8e50-632126c12e09 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:02.376513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef42be96-369a-4d18-8e50-632126c12e09 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:02.376969 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef42be96-369a-4d18-8e50-632126c12e09 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:02.377583 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef42be96-369a-4d18-8e50-632126c12e09 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:02.530020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ef42be96-369a-4d18-8e50-632126c12e09 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:02.538599 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ef42be96-369a-4d18-8e50-632126c12e09 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8" status: 200 len: 1359 microversion: 2.1 time: 0.179685 Aug 24 11:16:02.539202 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3393/7147] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:16:02 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:16:03.560499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-534be2f3-b207-4a5a-9751-e5524ec2e606 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:03.561108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-534be2f3-b207-4a5a-9751-e5524ec2e606 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:03.568642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-534be2f3-b207-4a5a-9751-e5524ec2e606 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:03.569388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-534be2f3-b207-4a5a-9751-e5524ec2e606 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:03.569899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-534be2f3-b207-4a5a-9751-e5524ec2e606 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:03.570626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-534be2f3-b207-4a5a-9751-e5524ec2e606 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:03.571105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-534be2f3-b207-4a5a-9751-e5524ec2e606 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:03.571601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-534be2f3-b207-4a5a-9751-e5524ec2e606 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:03.706253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-534be2f3-b207-4a5a-9751-e5524ec2e606 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:03.715811 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-534be2f3-b207-4a5a-9751-e5524ec2e606 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8" status: 200 len: 1359 microversion: 2.1 time: 0.159508 Aug 24 11:16:03.716430 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3755/7148] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:16:03 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:16:04.738295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-95985d6b-1616-4ca3-bad9-89fbd11b6f0d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:04.738839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-95985d6b-1616-4ca3-bad9-89fbd11b6f0d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:04.746634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95985d6b-1616-4ca3-bad9-89fbd11b6f0d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:04.747136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95985d6b-1616-4ca3-bad9-89fbd11b6f0d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:04.747572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95985d6b-1616-4ca3-bad9-89fbd11b6f0d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:04.748286 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95985d6b-1616-4ca3-bad9-89fbd11b6f0d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:04.748741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95985d6b-1616-4ca3-bad9-89fbd11b6f0d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:04.749195 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95985d6b-1616-4ca3-bad9-89fbd11b6f0d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:04.892914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-95985d6b-1616-4ca3-bad9-89fbd11b6f0d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:04.901250 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-95985d6b-1616-4ca3-bad9-89fbd11b6f0d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8" status: 200 len: 1359 microversion: 2.1 time: 0.167030 Aug 24 11:16:04.901839 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3394/7149] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:16:04 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:16:05.922843 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-64541d4c-c0c4-4d4f-b7c3-76ca1fe19376 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:05.923550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-64541d4c-c0c4-4d4f-b7c3-76ca1fe19376 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:05.930937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64541d4c-c0c4-4d4f-b7c3-76ca1fe19376 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:05.931625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64541d4c-c0c4-4d4f-b7c3-76ca1fe19376 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:05.932175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64541d4c-c0c4-4d4f-b7c3-76ca1fe19376 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:05.932901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64541d4c-c0c4-4d4f-b7c3-76ca1fe19376 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:05.933401 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64541d4c-c0c4-4d4f-b7c3-76ca1fe19376 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:05.933845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64541d4c-c0c4-4d4f-b7c3-76ca1fe19376 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:06.076021 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-64541d4c-c0c4-4d4f-b7c3-76ca1fe19376 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:06.084265 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-64541d4c-c0c4-4d4f-b7c3-76ca1fe19376 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8" status: 200 len: 1359 microversion: 2.1 time: 0.166148 Aug 24 11:16:06.085081 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3756/7150] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:16:05 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:16:07.106897 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-20be2d99-f371-4e28-8f29-aeb9c2b75c19 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:07.107588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-20be2d99-f371-4e28-8f29-aeb9c2b75c19 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:07.115090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20be2d99-f371-4e28-8f29-aeb9c2b75c19 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:07.115724 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20be2d99-f371-4e28-8f29-aeb9c2b75c19 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:07.116150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20be2d99-f371-4e28-8f29-aeb9c2b75c19 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:07.116839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20be2d99-f371-4e28-8f29-aeb9c2b75c19 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:07.117301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20be2d99-f371-4e28-8f29-aeb9c2b75c19 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:07.117727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20be2d99-f371-4e28-8f29-aeb9c2b75c19 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:07.266044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-20be2d99-f371-4e28-8f29-aeb9c2b75c19 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:07.274670 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-20be2d99-f371-4e28-8f29-aeb9c2b75c19 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8" status: 200 len: 1359 microversion: 2.1 time: 0.172672 Aug 24 11:16:07.275605 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3395/7151] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:16:07 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:16:08.309899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4f1b76df-2034-4e13-85f0-8c904f2caf84 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:08.311467 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4f1b76df-2034-4e13-85f0-8c904f2caf84 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:08.318697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f1b76df-2034-4e13-85f0-8c904f2caf84 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:08.319204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f1b76df-2034-4e13-85f0-8c904f2caf84 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:08.319651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f1b76df-2034-4e13-85f0-8c904f2caf84 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:08.320365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f1b76df-2034-4e13-85f0-8c904f2caf84 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:08.320821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f1b76df-2034-4e13-85f0-8c904f2caf84 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:08.321292 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f1b76df-2034-4e13-85f0-8c904f2caf84 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:08.463363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4f1b76df-2034-4e13-85f0-8c904f2caf84 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:08.471058 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4f1b76df-2034-4e13-85f0-8c904f2caf84 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8" status: 200 len: 1359 microversion: 2.1 time: 0.173128 Aug 24 11:16:08.471642 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3757/7152] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:16:08 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:16:09.496317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-45192f85-3594-4a8c-ae1d-a709998ed97b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:09.497725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-45192f85-3594-4a8c-ae1d-a709998ed97b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:09.505807 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-45192f85-3594-4a8c-ae1d-a709998ed97b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:09.506335 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-45192f85-3594-4a8c-ae1d-a709998ed97b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:09.506727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-45192f85-3594-4a8c-ae1d-a709998ed97b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:09.507546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-45192f85-3594-4a8c-ae1d-a709998ed97b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:09.507992 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-45192f85-3594-4a8c-ae1d-a709998ed97b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:09.508541 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-45192f85-3594-4a8c-ae1d-a709998ed97b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:09.689245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-45192f85-3594-4a8c-ae1d-a709998ed97b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:09.699440 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-45192f85-3594-4a8c-ae1d-a709998ed97b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8" status: 200 len: 1359 microversion: 2.1 time: 0.208385 Aug 24 11:16:09.700315 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3396/7153] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:16:09 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:16:10.226372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c185f4da-5fca-41a9-aec0-b17e97118c68 req-febbdcf9-6a0a-4d91-b833-dfde3df19406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "943ff7e8-b470-4a4a-a849-c8aa1cb697b8", "tag": "fca96306-d44a-43d8-8757-c7f9c4399b37"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:16:10.235157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:16:10.236334 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:16:10.246062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c185f4da-5fca-41a9-aec0-b17e97118c68 req-febbdcf9-6a0a-4d91-b833-dfde3df19406 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:10.246571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c185f4da-5fca-41a9-aec0-b17e97118c68 req-febbdcf9-6a0a-4d91-b833-dfde3df19406 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:10.247026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c185f4da-5fca-41a9-aec0-b17e97118c68 req-febbdcf9-6a0a-4d91-b833-dfde3df19406 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:10.258147 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c185f4da-5fca-41a9-aec0-b17e97118c68 req-febbdcf9-6a0a-4d91-b833-dfde3df19406 service nova] Creating event network-changed:fca96306-d44a-43d8-8757-c7f9c4399b37 for instance 943ff7e8-b470-4a4a-a849-c8aa1cb697b8 on n-h1-849328-3 Aug 24 11:16:10.263093 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c185f4da-5fca-41a9-aec0-b17e97118c68 req-febbdcf9-6a0a-4d91-b833-dfde3df19406 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041728 Aug 24 11:16:10.264012 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3758/7154] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:16:10.725531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6a9c05b7-8e5d-40e8-b957-d621cab000d5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:10.726129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6a9c05b7-8e5d-40e8-b957-d621cab000d5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:10.728554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:16:10.734825 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a9c05b7-8e5d-40e8-b957-d621cab000d5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:10.735316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a9c05b7-8e5d-40e8-b957-d621cab000d5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:10.735814 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a9c05b7-8e5d-40e8-b957-d621cab000d5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:10.736531 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a9c05b7-8e5d-40e8-b957-d621cab000d5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:10.736987 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a9c05b7-8e5d-40e8-b957-d621cab000d5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:10.737444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a9c05b7-8e5d-40e8-b957-d621cab000d5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:10.875390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6a9c05b7-8e5d-40e8-b957-d621cab000d5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:10.883730 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6a9c05b7-8e5d-40e8-b957-d621cab000d5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8" status: 200 len: 1359 microversion: 2.1 time: 0.165008 Aug 24 11:16:10.884429 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3397/7155] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:16:10 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:16:11.905840 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bc3d584d-e506-49c7-803d-4ddb6652b693 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:11.906700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bc3d584d-e506-49c7-803d-4ddb6652b693 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:11.913881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc3d584d-e506-49c7-803d-4ddb6652b693 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:11.914399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc3d584d-e506-49c7-803d-4ddb6652b693 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:11.914868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc3d584d-e506-49c7-803d-4ddb6652b693 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:11.915605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc3d584d-e506-49c7-803d-4ddb6652b693 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:11.916064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc3d584d-e506-49c7-803d-4ddb6652b693 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:11.916502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc3d584d-e506-49c7-803d-4ddb6652b693 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:12.047730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bc3d584d-e506-49c7-803d-4ddb6652b693 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:12.056002 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bc3d584d-e506-49c7-803d-4ddb6652b693 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8" status: 200 len: 1359 microversion: 2.1 time: 0.155503 Aug 24 11:16:12.056697 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3759/7156] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:16:11 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:16:13.081525 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-85bd959a-a01e-46b3-94f4-f2a24fd38ec6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:13.082608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-85bd959a-a01e-46b3-94f4-f2a24fd38ec6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:13.094325 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85bd959a-a01e-46b3-94f4-f2a24fd38ec6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:13.095125 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85bd959a-a01e-46b3-94f4-f2a24fd38ec6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:13.095847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85bd959a-a01e-46b3-94f4-f2a24fd38ec6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:13.097329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85bd959a-a01e-46b3-94f4-f2a24fd38ec6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:13.098117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85bd959a-a01e-46b3-94f4-f2a24fd38ec6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:13.098869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85bd959a-a01e-46b3-94f4-f2a24fd38ec6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:13.236551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-85bd959a-a01e-46b3-94f4-f2a24fd38ec6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:13.244580 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-85bd959a-a01e-46b3-94f4-f2a24fd38ec6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8" status: 200 len: 1359 microversion: 2.1 time: 0.169579 Aug 24 11:16:13.245221 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3398/7157] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:16:13 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:16:14.266901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-63fafd12-fceb-4177-9003-9637d9cbde3a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:14.267542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-63fafd12-fceb-4177-9003-9637d9cbde3a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:14.275264 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63fafd12-fceb-4177-9003-9637d9cbde3a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:14.275736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63fafd12-fceb-4177-9003-9637d9cbde3a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:14.276181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63fafd12-fceb-4177-9003-9637d9cbde3a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:14.276882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63fafd12-fceb-4177-9003-9637d9cbde3a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:14.277384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63fafd12-fceb-4177-9003-9637d9cbde3a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:14.277843 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63fafd12-fceb-4177-9003-9637d9cbde3a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:14.425970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-63fafd12-fceb-4177-9003-9637d9cbde3a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:14.434561 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-63fafd12-fceb-4177-9003-9637d9cbde3a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8" status: 200 len: 1359 microversion: 2.1 time: 0.171767 Aug 24 11:16:14.435213 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3760/7158] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:16:14 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:16:15.459935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4fff40a1-d224-4d9c-b5ce-9c0e131f6a27 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:15.460839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4fff40a1-d224-4d9c-b5ce-9c0e131f6a27 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:15.468071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fff40a1-d224-4d9c-b5ce-9c0e131f6a27 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:15.468577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fff40a1-d224-4d9c-b5ce-9c0e131f6a27 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:15.469012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fff40a1-d224-4d9c-b5ce-9c0e131f6a27 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:15.469741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fff40a1-d224-4d9c-b5ce-9c0e131f6a27 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:15.470197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fff40a1-d224-4d9c-b5ce-9c0e131f6a27 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:15.470644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fff40a1-d224-4d9c-b5ce-9c0e131f6a27 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:15.605895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4fff40a1-d224-4d9c-b5ce-9c0e131f6a27 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:15.614285 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4fff40a1-d224-4d9c-b5ce-9c0e131f6a27 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8" status: 200 len: 1359 microversion: 2.1 time: 0.161148 Aug 24 11:16:15.614884 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3399/7159] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:16:15 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:16:16.636465 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5b7303be-8700-400a-b65e-4fac4b4684cf tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:16.637765 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5b7303be-8700-400a-b65e-4fac4b4684cf tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:16.645918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b7303be-8700-400a-b65e-4fac4b4684cf tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:16.646391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b7303be-8700-400a-b65e-4fac4b4684cf tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:16.647231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b7303be-8700-400a-b65e-4fac4b4684cf tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:16.648128 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b7303be-8700-400a-b65e-4fac4b4684cf tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:16.648584 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b7303be-8700-400a-b65e-4fac4b4684cf tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:16.649014 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b7303be-8700-400a-b65e-4fac4b4684cf tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:16.768635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-30ea8417-bbe1-48aa-9d8f-4966b98dc4b9 req-2fce80b2-a46d-4e4c-bdb4-e6b8cfbf2f31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "943ff7e8-b470-4a4a-a849-c8aa1cb697b8", "name": "network-vif-plugged", "status": "completed", "tag": "fca96306-d44a-43d8-8757-c7f9c4399b37"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:16:16.778703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-30ea8417-bbe1-48aa-9d8f-4966b98dc4b9 req-2fce80b2-a46d-4e4c-bdb4-e6b8cfbf2f31 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:16.779195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-30ea8417-bbe1-48aa-9d8f-4966b98dc4b9 req-2fce80b2-a46d-4e4c-bdb4-e6b8cfbf2f31 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:16.779956 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-30ea8417-bbe1-48aa-9d8f-4966b98dc4b9 req-2fce80b2-a46d-4e4c-bdb4-e6b8cfbf2f31 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:16.787129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5b7303be-8700-400a-b65e-4fac4b4684cf tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:16.791998 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-30ea8417-bbe1-48aa-9d8f-4966b98dc4b9 req-2fce80b2-a46d-4e4c-bdb4-e6b8cfbf2f31 service nova] Creating event network-vif-plugged:fca96306-d44a-43d8-8757-c7f9c4399b37 for instance 943ff7e8-b470-4a4a-a849-c8aa1cb697b8 on n-h1-849328-3 Aug 24 11:16:16.794883 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5b7303be-8700-400a-b65e-4fac4b4684cf tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8" status: 200 len: 1359 microversion: 2.1 time: 0.162915 Aug 24 11:16:16.795717 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3400/7160] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:16:16 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:16:16.797339 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-30ea8417-bbe1-48aa-9d8f-4966b98dc4b9 req-2fce80b2-a46d-4e4c-bdb4-e6b8cfbf2f31 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169947 Aug 24 11:16:16.798031 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3761/7161] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:16:17.817655 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8f471781-02ad-4c00-a83e-a588d22945d2 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:17.818319 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8f471781-02ad-4c00-a83e-a588d22945d2 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:17.827231 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f471781-02ad-4c00-a83e-a588d22945d2 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:17.827832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f471781-02ad-4c00-a83e-a588d22945d2 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:17.828376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f471781-02ad-4c00-a83e-a588d22945d2 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:17.829280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f471781-02ad-4c00-a83e-a588d22945d2 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:17.829845 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f471781-02ad-4c00-a83e-a588d22945d2 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:17.830372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f471781-02ad-4c00-a83e-a588d22945d2 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:17.989506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8f471781-02ad-4c00-a83e-a588d22945d2 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:17.998485 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8f471781-02ad-4c00-a83e-a588d22945d2 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8" status: 200 len: 1359 microversion: 2.1 time: 0.185745 Aug 24 11:16:17.999228 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3401/7162] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:16:17 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:16:19.025035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-64f065c4-42ca-45ec-b035-e86babe9f83b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:19.026566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-64f065c4-42ca-45ec-b035-e86babe9f83b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:19.039202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64f065c4-42ca-45ec-b035-e86babe9f83b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:19.039711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64f065c4-42ca-45ec-b035-e86babe9f83b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:19.040164 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64f065c4-42ca-45ec-b035-e86babe9f83b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:19.040879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64f065c4-42ca-45ec-b035-e86babe9f83b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:19.041382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64f065c4-42ca-45ec-b035-e86babe9f83b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:19.041827 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64f065c4-42ca-45ec-b035-e86babe9f83b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:19.173732 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-64f065c4-42ca-45ec-b035-e86babe9f83b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:19.181657 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-64f065c4-42ca-45ec-b035-e86babe9f83b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8" status: 200 len: 1548 microversion: 2.1 time: 0.164033 Aug 24 11:16:19.182280 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3762/7163] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:16:19 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:16:19.202425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cbfb0ca6-a5e2-4296-a14c-00fd2f4e9425 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:19.203044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cbfb0ca6-a5e2-4296-a14c-00fd2f4e9425 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:19.210044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbfb0ca6-a5e2-4296-a14c-00fd2f4e9425 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:19.210530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbfb0ca6-a5e2-4296-a14c-00fd2f4e9425 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:19.210977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbfb0ca6-a5e2-4296-a14c-00fd2f4e9425 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:19.211684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbfb0ca6-a5e2-4296-a14c-00fd2f4e9425 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:19.212131 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbfb0ca6-a5e2-4296-a14c-00fd2f4e9425 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:19.212620 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbfb0ca6-a5e2-4296-a14c-00fd2f4e9425 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:19.354000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cbfb0ca6-a5e2-4296-a14c-00fd2f4e9425 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:19.366230 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cbfb0ca6-a5e2-4296-a14c-00fd2f4e9425 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8" status: 200 len: 1548 microversion: 2.1 time: 0.168007 Aug 24 11:16:19.366820 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3402/7164] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:16:19 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 => generated 1548 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:16:19.387268 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6c557ef3-5d79-467e-a324-4be9930614a5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:19.392544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6c557ef3-5d79-467e-a324-4be9930614a5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:19.393568 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6c557ef3-5d79-467e-a324-4be9930614a5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Searching by: {'deleted': False, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 11:16:19.399329 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c557ef3-5d79-467e-a324-4be9930614a5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:19.399824 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c557ef3-5d79-467e-a324-4be9930614a5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:19.400266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c557ef3-5d79-467e-a324-4be9930614a5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:19.400985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c557ef3-5d79-467e-a324-4be9930614a5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:19.401474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c557ef3-5d79-467e-a324-4be9930614a5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:19.401902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c557ef3-5d79-467e-a324-4be9930614a5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:19.429831 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-6c557ef3-5d79-467e-a324-4be9930614a5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 11:16:19.456565 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6c557ef3-5d79-467e-a324-4be9930614a5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.073237 Aug 24 11:16:19.457287 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3763/7165] 10.222.0.85 () {58 vars in 1125 bytes} [Wed Aug 24 11:16:19 2022] GET /compute/v2.1/servers => generated 343 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:16:19.469043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1c780319-bf51-4b64-bd6f-071c73aa5257 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:19.469695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1c780319-bf51-4b64-bd6f-071c73aa5257 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:19.480110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c780319-bf51-4b64-bd6f-071c73aa5257 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:19.480770 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c780319-bf51-4b64-bd6f-071c73aa5257 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:19.481217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c780319-bf51-4b64-bd6f-071c73aa5257 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:19.482357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c780319-bf51-4b64-bd6f-071c73aa5257 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:19.482902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c780319-bf51-4b64-bd6f-071c73aa5257 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:19.483488 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c780319-bf51-4b64-bd6f-071c73aa5257 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:19.622941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1c780319-bf51-4b64-bd6f-071c73aa5257 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:19.633798 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1c780319-bf51-4b64-bd6f-071c73aa5257 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8" status: 200 len: 1548 microversion: 2.1 time: 0.168840 Aug 24 11:16:19.634387 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3403/7166] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:16:19 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:16:21.211760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-039c2a30-1b42-4207-9e99-1b9ad7d351ad tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd4a7c70-d594-4ecb-8464-0a9f1574a68f"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:16:21.215331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-039c2a30-1b42-4207-9e99-1b9ad7d351ad tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:21.225335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-039c2a30-1b42-4207-9e99-1b9ad7d351ad tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:21.225834 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-039c2a30-1b42-4207-9e99-1b9ad7d351ad tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:21.226278 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-039c2a30-1b42-4207-9e99-1b9ad7d351ad tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:21.226984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-039c2a30-1b42-4207-9e99-1b9ad7d351ad tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:21.227446 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-039c2a30-1b42-4207-9e99-1b9ad7d351ad tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:21.227880 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-039c2a30-1b42-4207-9e99-1b9ad7d351ad tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:21.524777 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-039c2a30-1b42-4207-9e99-1b9ad7d351ad tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "POST /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319281 Aug 24 11:16:21.528523 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3764/7167] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Aug 24 11:16:21 2022] POST /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:16:34.669693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5821a934-8737-4f95-be38-7aad9ef8b4c1 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:34.670273 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5821a934-8737-4f95-be38-7aad9ef8b4c1 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:34.673040 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:16:34.673768 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=66 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:16:34.684581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5821a934-8737-4f95-be38-7aad9ef8b4c1 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:34.685077 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5821a934-8737-4f95-be38-7aad9ef8b4c1 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:34.685539 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5821a934-8737-4f95-be38-7aad9ef8b4c1 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:34.686251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5821a934-8737-4f95-be38-7aad9ef8b4c1 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:34.686739 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5821a934-8737-4f95-be38-7aad9ef8b4c1 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:34.687119 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5821a934-8737-4f95-be38-7aad9ef8b4c1 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:34.838543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5821a934-8737-4f95-be38-7aad9ef8b4c1 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:34.848409 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5821a934-8737-4f95-be38-7aad9ef8b4c1 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8" status: 200 len: 1594 microversion: 2.1 time: 0.182565 Aug 24 11:16:34.848999 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3404/7168] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:16:34 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 => generated 1594 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:16:36.657314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:16:36.658456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:16:36.659065 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:16:36.663439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-3429ac55-8566-4621-a09c-9ded61005690 req-1d55c8ef-98fc-446c-b30b-3fa5b24eb6a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "943ff7e8-b470-4a4a-a849-c8aa1cb697b8", "tag": "fca96306-d44a-43d8-8757-c7f9c4399b37"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:16:36.673735 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3429ac55-8566-4621-a09c-9ded61005690 req-1d55c8ef-98fc-446c-b30b-3fa5b24eb6a2 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:36.674228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3429ac55-8566-4621-a09c-9ded61005690 req-1d55c8ef-98fc-446c-b30b-3fa5b24eb6a2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:36.674667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3429ac55-8566-4621-a09c-9ded61005690 req-1d55c8ef-98fc-446c-b30b-3fa5b24eb6a2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:36.688312 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-3429ac55-8566-4621-a09c-9ded61005690 req-1d55c8ef-98fc-446c-b30b-3fa5b24eb6a2 service nova] Creating event network-changed:fca96306-d44a-43d8-8757-c7f9c4399b37 for instance 943ff7e8-b470-4a4a-a849-c8aa1cb697b8 on n-h1-849328-3 Aug 24 11:16:36.695154 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-3429ac55-8566-4621-a09c-9ded61005690 req-1d55c8ef-98fc-446c-b30b-3fa5b24eb6a2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039925 Aug 24 11:16:36.697286 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3765/7169] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:16:37.893066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-98cf8c68-b156-496e-b948-8825cc3369e9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-985610447"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:16:37.893717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-98cf8c68-b156-496e-b948-8825cc3369e9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:37.900581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98cf8c68-b156-496e-b948-8825cc3369e9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:37.901051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98cf8c68-b156-496e-b948-8825cc3369e9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:37.901522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98cf8c68-b156-496e-b948-8825cc3369e9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:37.902217 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98cf8c68-b156-496e-b948-8825cc3369e9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:37.902665 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98cf8c68-b156-496e-b948-8825cc3369e9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:37.903093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98cf8c68-b156-496e-b948-8825cc3369e9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:38.049416 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.network.security_group_api [None req-98cf8c68-b156-496e-b948-8825cc3369e9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Adding security group 5dcad484-d7a2-40a8-a400-9a1a97293f68 to port fca96306-d44a-43d8-8757-c7f9c4399b37 Aug 24 11:16:38.378404 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-98cf8c68-b156-496e-b948-8825cc3369e9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "POST /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8/action" status: 202 len: 0 microversion: 2.1 time: 0.489351 Aug 24 11:16:38.379111 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3405/7170] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:16:37 2022] POST /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:16:38.390071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d2589191-9a4d-4ad6-bfbd-a0463cc1abc3 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:38.390708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d2589191-9a4d-4ad6-bfbd-a0463cc1abc3 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:38.397462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2589191-9a4d-4ad6-bfbd-a0463cc1abc3 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:38.397955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2589191-9a4d-4ad6-bfbd-a0463cc1abc3 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:38.398488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2589191-9a4d-4ad6-bfbd-a0463cc1abc3 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:38.399293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2589191-9a4d-4ad6-bfbd-a0463cc1abc3 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:38.399808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2589191-9a4d-4ad6-bfbd-a0463cc1abc3 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:38.400255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2589191-9a4d-4ad6-bfbd-a0463cc1abc3 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:38.563879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d2589191-9a4d-4ad6-bfbd-a0463cc1abc3 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:38.572471 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d2589191-9a4d-4ad6-bfbd-a0463cc1abc3 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8" status: 200 len: 1759 microversion: 2.1 time: 0.188723 Aug 24 11:16:38.585023 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3766/7171] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:16:38 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 => generated 1759 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:16:38.711353 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-1228f87d-7712-43a7-a5d6-6c8b03eaa054 req-c7b53aae-f10d-44b9-9338-f291b65c9a9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "943ff7e8-b470-4a4a-a849-c8aa1cb697b8", "tag": "fca96306-d44a-43d8-8757-c7f9c4399b37"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:16:38.723330 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1228f87d-7712-43a7-a5d6-6c8b03eaa054 req-c7b53aae-f10d-44b9-9338-f291b65c9a9c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:38.723932 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1228f87d-7712-43a7-a5d6-6c8b03eaa054 req-c7b53aae-f10d-44b9-9338-f291b65c9a9c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:38.724424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1228f87d-7712-43a7-a5d6-6c8b03eaa054 req-c7b53aae-f10d-44b9-9338-f291b65c9a9c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:38.737689 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-1228f87d-7712-43a7-a5d6-6c8b03eaa054 req-c7b53aae-f10d-44b9-9338-f291b65c9a9c service nova] Creating event network-changed:fca96306-d44a-43d8-8757-c7f9c4399b37 for instance 943ff7e8-b470-4a4a-a849-c8aa1cb697b8 on n-h1-849328-3 Aug 24 11:16:38.743450 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-1228f87d-7712-43a7-a5d6-6c8b03eaa054 req-c7b53aae-f10d-44b9-9338-f291b65c9a9c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035730 Aug 24 11:16:38.744075 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3406/7172] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:17:37.342974 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:17:37.344108 n-d-849328-3 devstack@n-api.service[122433]: Wed Aug 24 11:17:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:18:03.854455 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:18:03.855357 n-d-849328-3 devstack@n-api.service[122432]: Wed Aug 24 11:18:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:18:16.302479 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:18:16.303252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:18:16.308058 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fee687ca-7338-432b-ac06-5e4c9357e542 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:18:16.310394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fee687ca-7338-432b-ac06-5e4c9357e542 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:18:16.317939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fee687ca-7338-432b-ac06-5e4c9357e542 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:16.318523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fee687ca-7338-432b-ac06-5e4c9357e542 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:16.318979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fee687ca-7338-432b-ac06-5e4c9357e542 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:16.319675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fee687ca-7338-432b-ac06-5e4c9357e542 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:16.320136 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fee687ca-7338-432b-ac06-5e4c9357e542 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:16.320567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fee687ca-7338-432b-ac06-5e4c9357e542 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:16.414392 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fee687ca-7338-432b-ac06-5e4c9357e542 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "POST /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8/action" status: 202 len: 0 microversion: 2.1 time: 0.113845 Aug 24 11:18:16.415062 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3767/7173] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:18:16 2022] POST /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:18:16.422025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:18:16.422936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=12 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:18:16.427484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-747f2293-f7a4-4a1e-a035-3654aa820d12 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:16.428202 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-747f2293-f7a4-4a1e-a035-3654aa820d12 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:18:16.435352 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-747f2293-f7a4-4a1e-a035-3654aa820d12 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:16.436230 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-747f2293-f7a4-4a1e-a035-3654aa820d12 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:16.436921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-747f2293-f7a4-4a1e-a035-3654aa820d12 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:16.437681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-747f2293-f7a4-4a1e-a035-3654aa820d12 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:16.438292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-747f2293-f7a4-4a1e-a035-3654aa820d12 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:16.438927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-747f2293-f7a4-4a1e-a035-3654aa820d12 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:16.685794 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-747f2293-f7a4-4a1e-a035-3654aa820d12 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:18:16.695548 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-747f2293-f7a4-4a1e-a035-3654aa820d12 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8" status: 200 len: 1761 microversion: 2.1 time: 0.275839 Aug 24 11:18:16.696169 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3407/7174] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:18:16 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 => generated 1761 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:18:17.719678 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-287d121b-118c-4b9d-9812-4bc004d133ef tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:17.720391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-287d121b-118c-4b9d-9812-4bc004d133ef tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:18:17.726979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-287d121b-118c-4b9d-9812-4bc004d133ef tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:17.727784 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-287d121b-118c-4b9d-9812-4bc004d133ef tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:17.728205 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-287d121b-118c-4b9d-9812-4bc004d133ef tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:17.728937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-287d121b-118c-4b9d-9812-4bc004d133ef tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:17.729432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-287d121b-118c-4b9d-9812-4bc004d133ef tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:17.729869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-287d121b-118c-4b9d-9812-4bc004d133ef tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:17.902130 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-287d121b-118c-4b9d-9812-4bc004d133ef tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:18:17.913890 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-287d121b-118c-4b9d-9812-4bc004d133ef tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8" status: 200 len: 1759 microversion: 2.1 time: 0.199556 Aug 24 11:18:17.914461 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3768/7175] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:18:17 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 => generated 1759 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:17.394206 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:19:17.394903 n-d-849328-3 devstack@n-api.service[122433]: Wed Aug 24 11:19:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:19:30.599081 n-d-849328-3 devstack@n-api.service[122432]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41245b8f-4363-4ade-bbd0-55c91ce540ab] AMQP server on 10.222.0.85:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 11:19:30.601233 n-d-849328-3 devstack@n-api.service[122432]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e64df5b4-05c3-4b69-9f47-fe01a91d09ba] AMQP server on 10.222.0.85:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 11:19:30.601233 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:30.601439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:30.605634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5d319da1-d567-47e2-bebc-d85bd4385b5b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-985610447"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:19:30.606161 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5d319da1-d567-47e2-bebc-d85bd4385b5b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:19:30.613455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d319da1-d567-47e2-bebc-d85bd4385b5b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:30.613938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d319da1-d567-47e2-bebc-d85bd4385b5b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:30.614370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d319da1-d567-47e2-bebc-d85bd4385b5b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:30.615051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d319da1-d567-47e2-bebc-d85bd4385b5b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:30.615472 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d319da1-d567-47e2-bebc-d85bd4385b5b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:30.615922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d319da1-d567-47e2-bebc-d85bd4385b5b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:30.822756 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.network.security_group_api [None req-5d319da1-d567-47e2-bebc-d85bd4385b5b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Removing security group 5dcad484-d7a2-40a8-a400-9a1a97293f68 from port fca96306-d44a-43d8-8757-c7f9c4399b37 Aug 24 11:19:31.136423 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5d319da1-d567-47e2-bebc-d85bd4385b5b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "POST /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8/action" status: 202 len: 0 microversion: 2.1 time: 0.539082 Aug 24 11:19:31.137049 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3408/7176] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:19:30 2022] POST /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:19:31.143860 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:31.145644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:31.151551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-33366f28-2cfa-4ef1-bb66-839566051c41 req-f656803d-c845-48e1-b149-55743074b509 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "943ff7e8-b470-4a4a-a849-c8aa1cb697b8", "tag": "fca96306-d44a-43d8-8757-c7f9c4399b37"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:19:31.169359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-33366f28-2cfa-4ef1-bb66-839566051c41 req-f656803d-c845-48e1-b149-55743074b509 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:31.170385 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-33366f28-2cfa-4ef1-bb66-839566051c41 req-f656803d-c845-48e1-b149-55743074b509 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:31.171275 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-33366f28-2cfa-4ef1-bb66-839566051c41 req-f656803d-c845-48e1-b149-55743074b509 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:31.204163 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-33366f28-2cfa-4ef1-bb66-839566051c41 req-f656803d-c845-48e1-b149-55743074b509 service nova] Creating event network-changed:fca96306-d44a-43d8-8757-c7f9c4399b37 for instance 943ff7e8-b470-4a4a-a849-c8aa1cb697b8 on n-h1-849328-3 Aug 24 11:19:31.219278 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-33366f28-2cfa-4ef1-bb66-839566051c41 req-f656803d-c845-48e1-b149-55743074b509 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077240 Aug 24 11:19:31.224289 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3769/7177] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:19:32.267774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-780cc6ea-7c6f-46b9-acb3-ee18227254de tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:32.268378 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-780cc6ea-7c6f-46b9-acb3-ee18227254de tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:19:32.277629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-780cc6ea-7c6f-46b9-acb3-ee18227254de tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:32.278204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-780cc6ea-7c6f-46b9-acb3-ee18227254de tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:32.278701 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-780cc6ea-7c6f-46b9-acb3-ee18227254de tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:32.279533 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-780cc6ea-7c6f-46b9-acb3-ee18227254de tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:32.280128 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-780cc6ea-7c6f-46b9-acb3-ee18227254de tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:32.280612 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-780cc6ea-7c6f-46b9-acb3-ee18227254de tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:32.286968 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] [e64df5b4-05c3-4b69-9f47-fe01a91d09ba] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 56022. Aug 24 11:19:32.287895 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] [41245b8f-4363-4ade-bbd0-55c91ce540ab] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 56020. Aug 24 11:19:32.356495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-628403e4-2241-448a-aa6f-07f46755fa2b req-1e11c3af-8a4a-4329-8fd6-73ca5d145e5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "943ff7e8-b470-4a4a-a849-c8aa1cb697b8", "tag": "fca96306-d44a-43d8-8757-c7f9c4399b37"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:19:32.367605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-628403e4-2241-448a-aa6f-07f46755fa2b req-1e11c3af-8a4a-4329-8fd6-73ca5d145e5c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:32.368328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-628403e4-2241-448a-aa6f-07f46755fa2b req-1e11c3af-8a4a-4329-8fd6-73ca5d145e5c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:32.368986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-628403e4-2241-448a-aa6f-07f46755fa2b req-1e11c3af-8a4a-4329-8fd6-73ca5d145e5c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:32.374187 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-780cc6ea-7c6f-46b9-acb3-ee18227254de tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lazy-loading 'services' on Instance uuid 943ff7e8-b470-4a4a-a849-c8aa1cb697b8 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:19:32.381104 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-628403e4-2241-448a-aa6f-07f46755fa2b req-1e11c3af-8a4a-4329-8fd6-73ca5d145e5c service nova] Creating event network-changed:fca96306-d44a-43d8-8757-c7f9c4399b37 for instance 943ff7e8-b470-4a4a-a849-c8aa1cb697b8 on n-h1-849328-3 Aug 24 11:19:32.386536 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-628403e4-2241-448a-aa6f-07f46755fa2b req-1e11c3af-8a4a-4329-8fd6-73ca5d145e5c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085902 Aug 24 11:19:32.387716 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3770/7178] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:19:32.451770 n-d-849328-3 devstack@n-api.service[122432]: ERROR oslo.messaging._drivers.impl_rabbit [None req-780cc6ea-7c6f-46b9-acb3-ee18227254de tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [c8de5569-63e0-4522-bb5e-9d9925ea3a68] AMQP server on 10.222.0.85:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 11:19:33.460251 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [None req-780cc6ea-7c6f-46b9-acb3-ee18227254de tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [c8de5569-63e0-4522-bb5e-9d9925ea3a68] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 56032. Aug 24 11:19:33.465027 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-780cc6ea-7c6f-46b9-acb3-ee18227254de tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "DELETE /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8/os-volume_attachments/bd4a7c70-d594-4ecb-8464-0a9f1574a68f" status: 202 len: 0 microversion: 2.1 time: 1.204372 Aug 24 11:19:33.466700 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3409/7179] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Aug 24 11:19:32 2022] DELETE /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8/os-volume_attachments/bd4a7c70-d594-4ecb-8464-0a9f1574a68f => generated 0 bytes in 1207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:19:33.475525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e961523c-288b-4271-b5a2-a189cbc1a8a6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:33.477877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e961523c-288b-4271-b5a2-a189cbc1a8a6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:19:33.485384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e961523c-288b-4271-b5a2-a189cbc1a8a6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:33.485940 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e961523c-288b-4271-b5a2-a189cbc1a8a6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:33.486393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e961523c-288b-4271-b5a2-a189cbc1a8a6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:33.487108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e961523c-288b-4271-b5a2-a189cbc1a8a6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:33.487578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e961523c-288b-4271-b5a2-a189cbc1a8a6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:33.488018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e961523c-288b-4271-b5a2-a189cbc1a8a6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:33.519539 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e961523c-288b-4271-b5a2-a189cbc1a8a6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048577 Aug 24 11:19:33.520127 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3771/7180] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:19:33 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:19:34.533791 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d6d60c78-7483-494c-b2d7-6d72250a0e3d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:34.536623 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d6d60c78-7483-494c-b2d7-6d72250a0e3d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:19:34.544482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6d60c78-7483-494c-b2d7-6d72250a0e3d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:34.544680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6d60c78-7483-494c-b2d7-6d72250a0e3d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:34.545023 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6d60c78-7483-494c-b2d7-6d72250a0e3d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:34.545785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6d60c78-7483-494c-b2d7-6d72250a0e3d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:34.546276 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6d60c78-7483-494c-b2d7-6d72250a0e3d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:34.546835 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6d60c78-7483-494c-b2d7-6d72250a0e3d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:34.578717 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d6d60c78-7483-494c-b2d7-6d72250a0e3d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050298 Aug 24 11:19:34.579306 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3410/7181] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:19:34 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:19:35.591842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1aa7955d-cb4c-4991-b8bb-83a873d442d2 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:35.594488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1aa7955d-cb4c-4991-b8bb-83a873d442d2 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:19:35.602225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aa7955d-cb4c-4991-b8bb-83a873d442d2 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:35.602739 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aa7955d-cb4c-4991-b8bb-83a873d442d2 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:35.603193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aa7955d-cb4c-4991-b8bb-83a873d442d2 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:35.604069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aa7955d-cb4c-4991-b8bb-83a873d442d2 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:35.604406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aa7955d-cb4c-4991-b8bb-83a873d442d2 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:35.604821 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aa7955d-cb4c-4991-b8bb-83a873d442d2 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:35.637204 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1aa7955d-cb4c-4991-b8bb-83a873d442d2 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049604 Aug 24 11:19:35.637879 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3772/7182] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:19:35 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:19:36.649819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e5ce7c39-724a-4cc7-bdd0-5396c2d57ba9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:36.652141 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e5ce7c39-724a-4cc7-bdd0-5396c2d57ba9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:19:36.659564 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5ce7c39-724a-4cc7-bdd0-5396c2d57ba9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:36.660059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5ce7c39-724a-4cc7-bdd0-5396c2d57ba9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:36.660501 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5ce7c39-724a-4cc7-bdd0-5396c2d57ba9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:36.661238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5ce7c39-724a-4cc7-bdd0-5396c2d57ba9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:36.661696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5ce7c39-724a-4cc7-bdd0-5396c2d57ba9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:36.662132 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5ce7c39-724a-4cc7-bdd0-5396c2d57ba9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:36.693619 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e5ce7c39-724a-4cc7-bdd0-5396c2d57ba9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047936 Aug 24 11:19:36.694429 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3411/7183] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:19:36 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:19:37.707255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5dd38480-7f71-45e1-b9e6-c7983428845c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:37.709498 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5dd38480-7f71-45e1-b9e6-c7983428845c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:19:37.716586 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dd38480-7f71-45e1-b9e6-c7983428845c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:37.717089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dd38480-7f71-45e1-b9e6-c7983428845c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:37.717562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dd38480-7f71-45e1-b9e6-c7983428845c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:37.718300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dd38480-7f71-45e1-b9e6-c7983428845c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:37.718779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dd38480-7f71-45e1-b9e6-c7983428845c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:37.719213 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dd38480-7f71-45e1-b9e6-c7983428845c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:37.749952 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5dd38480-7f71-45e1-b9e6-c7983428845c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046645 Aug 24 11:19:37.750517 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3773/7184] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:19:37 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:19:38.765721 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2a1d1a4e-507d-4ff0-9ef0-1a210e510bd4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:38.768690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2a1d1a4e-507d-4ff0-9ef0-1a210e510bd4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:19:38.778962 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a1d1a4e-507d-4ff0-9ef0-1a210e510bd4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:38.779660 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a1d1a4e-507d-4ff0-9ef0-1a210e510bd4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:38.780394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a1d1a4e-507d-4ff0-9ef0-1a210e510bd4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:38.781097 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a1d1a4e-507d-4ff0-9ef0-1a210e510bd4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:38.781584 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a1d1a4e-507d-4ff0-9ef0-1a210e510bd4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:38.782004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a1d1a4e-507d-4ff0-9ef0-1a210e510bd4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:38.811833 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2a1d1a4e-507d-4ff0-9ef0-1a210e510bd4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052392 Aug 24 11:19:38.812408 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3412/7185] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:19:38 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:19:38.826092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a2f62fb9-be6c-4826-bf05-6bb79df346e9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:38.826931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a2f62fb9-be6c-4826-bf05-6bb79df346e9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:19:38.838383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2f62fb9-be6c-4826-bf05-6bb79df346e9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:38.839212 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2f62fb9-be6c-4826-bf05-6bb79df346e9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:38.839930 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2f62fb9-be6c-4826-bf05-6bb79df346e9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:38.841022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2f62fb9-be6c-4826-bf05-6bb79df346e9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:38.841749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2f62fb9-be6c-4826-bf05-6bb79df346e9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:38.842473 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2f62fb9-be6c-4826-bf05-6bb79df346e9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:39.020720 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-a2f62fb9-be6c-4826-bf05-6bb79df346e9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] HTTP exception thrown: Instance 943ff7e8-b470-4a4a-a849-c8aa1cb697b8 is not attached to volume bd4a7c70-d594-4ecb-8464-0a9f1574a68f Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a2f62fb9-be6c-4826-bf05-6bb79df346e9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Request method failure captured: Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8/os-volume_attachments/bd4a7c70-d594-4ecb-8464-0a9f1574a68f HTTP/1.1 Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBghg97lEA2gQIWUfNMzlK3V0EIIjk9mOBMW-vkv-koy1jQ3HkdlVCPwNKfJQFBtFe0q2buT_VSjq55s-sbMarsDwTdroFMIZJstc5ISrLMfitv1V3Q2fZcTlvJRx7JoOXH9Tu-5vTuCx1oe9w8KlW6LaOu1WIUQQVqFxUfCG-ER4mV4 Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: a00b24f5a0cd4a4c9681d5512fec24ed Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestMinimumBasicScenario-1553071017 Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a00b24f5a0cd4a4c9681d5512fec24ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_a00b24f5a0cd4a4c9681d5512fec24ed", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a00b24f5a0cd4a4c9681d5512fec24ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/a00b24f5a0cd4a4c9681d5512fec24ed"}]}] Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestMinimumBasicScenario-1553071017 Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: a00b24f5a0cd4a4c9681d5512fec24ed Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1553071017 Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestMinimumBasicScenario-1553071017-project Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 2fc9ed8a81f64078b05bfb981164d3a8 Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestMinimumBasicScenario-1553071017-project Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 943ff7e8-b470-4a4a-a849-c8aa1cb697b8 is not attached to volume bd4a7c70-d594-4ecb-8464-0a9f1574a68f Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'server_id': '943ff7e8-b470-4a4a-a849-c8aa1cb697b8', 'id': 'bd4a7c70-d594-4ecb-8464-0a9f1574a68f'} Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bd4a7c70-d594-4ecb-8464-0a9f1574a68f. Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 943ff7e8-b470-4a4a-a849-c8aa1cb697b8 is not attached to volume bd4a7c70-d594-4ecb-8464-0a9f1574a68f Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:19:39.022301 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:19:39.026723 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:19:39.026723 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:19:39.026723 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 943ff7e8-b470-4a4a-a849-c8aa1cb697b8 is not attached to volume bd4a7c70-d594-4ecb-8464-0a9f1574a68f Aug 24 11:19:39.026723 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:19:39.026723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a2f62fb9-be6c-4826-bf05-6bb79df346e9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Returning 404 to user: Instance 943ff7e8-b470-4a4a-a849-c8aa1cb697b8 is not attached to volume bd4a7c70-d594-4ecb-8464-0a9f1574a68f {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:19:39.026723 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a2f62fb9-be6c-4826-bf05-6bb79df346e9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "DELETE /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8/os-volume_attachments/bd4a7c70-d594-4ecb-8464-0a9f1574a68f" status: 404 len: 154 microversion: 2.1 time: 0.204164 Aug 24 11:19:39.026723 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3774/7186] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Aug 24 11:19:38 2022] DELETE /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8/os-volume_attachments/bd4a7c70-d594-4ecb-8464-0a9f1574a68f => generated 154 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:19:42.289138 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f94358fb-1bdb-44d1-aa7b-4c22cc9aadda tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:42.289631 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f94358fb-1bdb-44d1-aa7b-4c22cc9aadda tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:19:42.296952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f94358fb-1bdb-44d1-aa7b-4c22cc9aadda tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:42.297476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f94358fb-1bdb-44d1-aa7b-4c22cc9aadda tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:42.297915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f94358fb-1bdb-44d1-aa7b-4c22cc9aadda tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:42.298926 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f94358fb-1bdb-44d1-aa7b-4c22cc9aadda tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:42.299376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f94358fb-1bdb-44d1-aa7b-4c22cc9aadda tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:42.299798 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f94358fb-1bdb-44d1-aa7b-4c22cc9aadda tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:42.325137 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f94358fb-1bdb-44d1-aa7b-4c22cc9aadda tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:19:42.407962 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f94358fb-1bdb-44d1-aa7b-4c22cc9aadda tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "DELETE /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8" status: 204 len: 0 microversion: 2.1 time: 0.122469 Aug 24 11:19:42.408582 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3413/7187] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:19:42 2022] DELETE /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:42.417459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9beec9e2-61ce-4bc5-8873-5a42c8a8a34b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:42.418374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9beec9e2-61ce-4bc5-8873-5a42c8a8a34b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:19:42.427562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9beec9e2-61ce-4bc5-8873-5a42c8a8a34b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:42.428147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9beec9e2-61ce-4bc5-8873-5a42c8a8a34b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:42.428610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9beec9e2-61ce-4bc5-8873-5a42c8a8a34b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:42.429401 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9beec9e2-61ce-4bc5-8873-5a42c8a8a34b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:42.429874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9beec9e2-61ce-4bc5-8873-5a42c8a8a34b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:42.430316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9beec9e2-61ce-4bc5-8873-5a42c8a8a34b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:42.570004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9beec9e2-61ce-4bc5-8873-5a42c8a8a34b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:19:42.578419 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9beec9e2-61ce-4bc5-8873-5a42c8a8a34b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8" status: 200 len: 1554 microversion: 2.1 time: 0.165100 Aug 24 11:19:42.579028 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3775/7188] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:19:42 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:43.604963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ed14a9ba-1fa2-457b-921b-8584bffe3eaa tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:43.606169 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ed14a9ba-1fa2-457b-921b-8584bffe3eaa tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:19:43.614800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed14a9ba-1fa2-457b-921b-8584bffe3eaa tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:43.615286 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed14a9ba-1fa2-457b-921b-8584bffe3eaa tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:43.615727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed14a9ba-1fa2-457b-921b-8584bffe3eaa tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:43.616424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed14a9ba-1fa2-457b-921b-8584bffe3eaa tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:43.616878 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed14a9ba-1fa2-457b-921b-8584bffe3eaa tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:43.617346 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed14a9ba-1fa2-457b-921b-8584bffe3eaa tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:43.766923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ed14a9ba-1fa2-457b-921b-8584bffe3eaa tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:19:43.774821 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ed14a9ba-1fa2-457b-921b-8584bffe3eaa tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8" status: 200 len: 1554 microversion: 2.1 time: 0.176949 Aug 24 11:19:43.775407 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3414/7189] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:19:43 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:44.608803 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0fa70091-e3bc-4a8b-aaca-a19ad3612e2f req-2c0b6d5b-56c1-41bd-aa3e-d46efaf2a5d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "943ff7e8-b470-4a4a-a849-c8aa1cb697b8", "name": "network-vif-deleted", "tag": "fca96306-d44a-43d8-8757-c7f9c4399b37"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:19:44.619813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0fa70091-e3bc-4a8b-aaca-a19ad3612e2f req-2c0b6d5b-56c1-41bd-aa3e-d46efaf2a5d8 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:44.620324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0fa70091-e3bc-4a8b-aaca-a19ad3612e2f req-2c0b6d5b-56c1-41bd-aa3e-d46efaf2a5d8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:44.620753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0fa70091-e3bc-4a8b-aaca-a19ad3612e2f req-2c0b6d5b-56c1-41bd-aa3e-d46efaf2a5d8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:44.632454 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0fa70091-e3bc-4a8b-aaca-a19ad3612e2f req-2c0b6d5b-56c1-41bd-aa3e-d46efaf2a5d8 service nova] Creating event network-vif-deleted:fca96306-d44a-43d8-8757-c7f9c4399b37 for instance 943ff7e8-b470-4a4a-a849-c8aa1cb697b8 on n-h1-849328-3 Aug 24 11:19:44.637803 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0fa70091-e3bc-4a8b-aaca-a19ad3612e2f req-2c0b6d5b-56c1-41bd-aa3e-d46efaf2a5d8 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032902 Aug 24 11:19:44.638567 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3776/7190] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:19:44.796467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7df33655-e756-47b2-aac8-cce54a0a1edb tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:44.797439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7df33655-e756-47b2-aac8-cce54a0a1edb tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:19:44.804744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7df33655-e756-47b2-aac8-cce54a0a1edb tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:44.805270 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7df33655-e756-47b2-aac8-cce54a0a1edb tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:44.805708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7df33655-e756-47b2-aac8-cce54a0a1edb tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:44.806398 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7df33655-e756-47b2-aac8-cce54a0a1edb tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:44.806842 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7df33655-e756-47b2-aac8-cce54a0a1edb tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:44.807260 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7df33655-e756-47b2-aac8-cce54a0a1edb tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:44.850226 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7df33655-e756-47b2-aac8-cce54a0a1edb tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:44.850608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7df33655-e756-47b2-aac8-cce54a0a1edb tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:44.851037 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7df33655-e756-47b2-aac8-cce54a0a1edb tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:44.851485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-7df33655-e756-47b2-aac8-cce54a0a1edb tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lazy-loading 'fault' on Instance uuid 943ff7e8-b470-4a4a-a849-c8aa1cb697b8 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:19:44.892747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7df33655-e756-47b2-aac8-cce54a0a1edb tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:19:44.901460 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7df33655-e756-47b2-aac8-cce54a0a1edb tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8" status: 200 len: 1349 microversion: 2.1 time: 0.109116 Aug 24 11:19:44.902081 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3415/7191] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:19:44 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 => generated 1349 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:45.924517 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fa4f5e14-fe69-49d7-b96d-92c12d82744d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:45.925281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fa4f5e14-fe69-49d7-b96d-92c12d82744d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 943ff7e8-b470-4a4a-a849-c8aa1cb697b8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:19:45.932051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa4f5e14-fe69-49d7-b96d-92c12d82744d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:45.932550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa4f5e14-fe69-49d7-b96d-92c12d82744d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:45.933001 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa4f5e14-fe69-49d7-b96d-92c12d82744d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:45.933753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa4f5e14-fe69-49d7-b96d-92c12d82744d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:45.934221 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa4f5e14-fe69-49d7-b96d-92c12d82744d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:45.934663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa4f5e14-fe69-49d7-b96d-92c12d82744d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:45.948786 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-fa4f5e14-fe69-49d7-b96d-92c12d82744d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] HTTP exception thrown: Instance 943ff7e8-b470-4a4a-a849-c8aa1cb697b8 could not be found. Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fa4f5e14-fe69-49d7-b96d-92c12d82744d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Request method failure captured: Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 HTTP/1.1 Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBghg97lEA2gQIWUfNMzlK3V0EIIjk9mOBMW-vkv-koy1jQ3HkdlVCPwNKfJQFBtFe0q2buT_VSjq55s-sbMarsDwTdroFMIZJstc5ISrLMfitv1V3Q2fZcTlvJRx7JoOXH9Tu-5vTuCx1oe9w8KlW6LaOu1WIUQQVqFxUfCG-ER4mV4 Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: a00b24f5a0cd4a4c9681d5512fec24ed Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestMinimumBasicScenario-1553071017 Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a00b24f5a0cd4a4c9681d5512fec24ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_a00b24f5a0cd4a4c9681d5512fec24ed", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a00b24f5a0cd4a4c9681d5512fec24ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/a00b24f5a0cd4a4c9681d5512fec24ed"}]}] Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestMinimumBasicScenario-1553071017 Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: a00b24f5a0cd4a4c9681d5512fec24ed Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1553071017 Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestMinimumBasicScenario-1553071017-project Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 2fc9ed8a81f64078b05bfb981164d3a8 Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestMinimumBasicScenario-1553071017-project Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 943ff7e8-b470-4a4a-a849-c8aa1cb697b8 could not be found. Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '943ff7e8-b470-4a4a-a849-c8aa1cb697b8'} Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 943ff7e8-b470-4a4a-a849-c8aa1cb697b8 could not be found. Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 943ff7e8-b470-4a4a-a849-c8aa1cb697b8 could not be found. Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:19:45.950522 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:19:45.954635 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:19:45.954635 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:19:45.954635 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:19:45.954635 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:19:45.954635 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:19:45.954635 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 943ff7e8-b470-4a4a-a849-c8aa1cb697b8 could not be found. Aug 24 11:19:45.954635 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:19:45.954635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fa4f5e14-fe69-49d7-b96d-92c12d82744d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Returning 404 to user: Instance 943ff7e8-b470-4a4a-a849-c8aa1cb697b8 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:19:45.954635 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fa4f5e14-fe69-49d7-b96d-92c12d82744d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8" status: 404 len: 111 microversion: 2.1 time: 0.033201 Aug 24 11:19:45.954635 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3777/7192] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:19:45 2022] GET /compute/v2.1/servers/943ff7e8-b470-4a4a-a849-c8aa1cb697b8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:19:45.961072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e8428438-79da-4134-a186-6a484aebe04e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '.version_select at 0x7f465a2d11f0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:45.983000 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e8428438-79da-4134-a186-6a484aebe04e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1594306928" status: 202 len: 0 microversion: 2.1 time: 0.025726 Aug 24 11:19:45.983609 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3416/7193] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 11:19:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1594306928 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:19:54.888806 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4a7ebec4-d55f-4453-95b8-1b4d2aef049d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Action: 'create', calling method: .version_select at 0x7f4647caf160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1747033762", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEb6o1KtiirZavOmoZDEPsC4P5s7GPP7SFhqSlMPaIWRSkdNHPfmNxLl3zfn4j4nN18jWC2Pw9M7Gzek/2IsGiAinq69jLy92eHThDwMIw0kyfZaHUPJkdSFs5hrhchqmA=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:19:54.906113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-4a7ebec4-d55f-4453-95b8-1b4d2aef049d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Getting quotas for project a00b24f5a0cd4a4c9681d5512fec24ed. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:19:54.911776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-4a7ebec4-d55f-4453-95b8-1b4d2aef049d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Getting quotas for user 2fc9ed8a81f64078b05bfb981164d3a8 and project a00b24f5a0cd4a4c9681d5512fec24ed. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:19:54.943290 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4a7ebec4-d55f-4453-95b8-1b4d2aef049d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.060143 Aug 24 11:19:54.947091 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3778/7194] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 11:19:54 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:19:55.021759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:55.027362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e410a067-272c-47ad-82f1-dcdd358249dd tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2014929476", "imageRef": "30e48221-8be6-4a57-9b2a-a4c9bb1d307a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1747033762", "networks": [{"uuid": "bdbcb075-17fc-4c83-9f27-ac4f1079ab19"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:19:55.088155 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-e410a067-272c-47ad-82f1-dcdd358249dd tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] validate_networks() for [('bdbcb075-17fc-4c83-9f27-ac4f1079ab19', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:19:55.564971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e410a067-272c-47ad-82f1-dcdd358249dd tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:19:55.565622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e410a067-272c-47ad-82f1-dcdd358249dd tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:19:55.566323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e410a067-272c-47ad-82f1-dcdd358249dd tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:19:55.566857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e410a067-272c-47ad-82f1-dcdd358249dd tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:19:55.567408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e410a067-272c-47ad-82f1-dcdd358249dd tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:19:55.579375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e410a067-272c-47ad-82f1-dcdd358249dd tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:55.579869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e410a067-272c-47ad-82f1-dcdd358249dd tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:55.580297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e410a067-272c-47ad-82f1-dcdd358249dd tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:55.581032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e410a067-272c-47ad-82f1-dcdd358249dd tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:55.581555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e410a067-272c-47ad-82f1-dcdd358249dd tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:55.581988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e410a067-272c-47ad-82f1-dcdd358249dd tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:55.599760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-e410a067-272c-47ad-82f1-dcdd358249dd tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Getting quotas for project a00b24f5a0cd4a4c9681d5512fec24ed. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:19:55.605875 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-e410a067-272c-47ad-82f1-dcdd358249dd tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Getting quotas for user 2fc9ed8a81f64078b05bfb981164d3a8 and project a00b24f5a0cd4a4c9681d5512fec24ed. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:19:55.618665 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e410a067-272c-47ad-82f1-dcdd358249dd tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:19:55.621141 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e410a067-272c-47ad-82f1-dcdd358249dd tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30e48221-8be6-4a57-9b2a-a4c9bb1d307a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:19:55.668772 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e410a067-272c-47ad-82f1-dcdd358249dd tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649997 Aug 24 11:19:55.669453 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3417/7195] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 11:19:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:19:55.680642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bd4eb367-335f-4c49-81d4-e0c085f9ad8c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:55.681430 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bd4eb367-335f-4c49-81d4-e0c085f9ad8c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:19:55.739581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bd4eb367-335f-4c49-81d4-e0c085f9ad8c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:19:55.749090 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bd4eb367-335f-4c49-81d4-e0c085f9ad8c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1259 microversion: 2.1 time: 0.072290 Aug 24 11:19:55.750062 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3779/7196] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:19:55 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1259 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:56.771522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-efe02301-ce9d-4781-87cb-4ec99559fc5c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:56.772080 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-efe02301-ce9d-4781-87cb-4ec99559fc5c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:19:56.779320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-efe02301-ce9d-4781-87cb-4ec99559fc5c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:56.779813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-efe02301-ce9d-4781-87cb-4ec99559fc5c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:56.780247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-efe02301-ce9d-4781-87cb-4ec99559fc5c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:56.780948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-efe02301-ce9d-4781-87cb-4ec99559fc5c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:56.781429 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-efe02301-ce9d-4781-87cb-4ec99559fc5c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:56.781857 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-efe02301-ce9d-4781-87cb-4ec99559fc5c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:56.872261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-efe02301-ce9d-4781-87cb-4ec99559fc5c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:19:56.881066 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-efe02301-ce9d-4781-87cb-4ec99559fc5c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1311 microversion: 2.1 time: 0.113802 Aug 24 11:19:56.881066 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3418/7197] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:19:56 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1311 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:57.903927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-76d3b217-8160-41c1-b457-ed86cb3b2a83 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:57.905463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-76d3b217-8160-41c1-b457-ed86cb3b2a83 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:19:57.918931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=38 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:57.921018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76d3b217-8160-41c1-b457-ed86cb3b2a83 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:57.922146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76d3b217-8160-41c1-b457-ed86cb3b2a83 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:57.922633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76d3b217-8160-41c1-b457-ed86cb3b2a83 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:57.923412 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76d3b217-8160-41c1-b457-ed86cb3b2a83 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:57.923904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76d3b217-8160-41c1-b457-ed86cb3b2a83 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:57.924358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76d3b217-8160-41c1-b457-ed86cb3b2a83 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:58.090808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-76d3b217-8160-41c1-b457-ed86cb3b2a83 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:19:58.099699 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-76d3b217-8160-41c1-b457-ed86cb3b2a83 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1359 microversion: 2.1 time: 0.201115 Aug 24 11:19:58.100723 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3780/7198] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:19:57 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1359 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:59.124644 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-933e0993-84be-444f-b3a5-7b6b3c1fbe1e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:59.125342 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-933e0993-84be-444f-b3a5-7b6b3c1fbe1e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:19:59.134134 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-933e0993-84be-444f-b3a5-7b6b3c1fbe1e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:59.134824 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-933e0993-84be-444f-b3a5-7b6b3c1fbe1e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:59.135281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-933e0993-84be-444f-b3a5-7b6b3c1fbe1e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:59.136436 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-933e0993-84be-444f-b3a5-7b6b3c1fbe1e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:59.137272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-933e0993-84be-444f-b3a5-7b6b3c1fbe1e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:59.138432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-933e0993-84be-444f-b3a5-7b6b3c1fbe1e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:59.295112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-933e0993-84be-444f-b3a5-7b6b3c1fbe1e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:19:59.304172 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-933e0993-84be-444f-b3a5-7b6b3c1fbe1e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1359 microversion: 2.1 time: 0.184219 Aug 24 11:19:59.304962 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3419/7199] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:19:59 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:00.325950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9447e25c-9b6a-47b5-8539-01bbd08a7860 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:00.326866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9447e25c-9b6a-47b5-8539-01bbd08a7860 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:00.336219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9447e25c-9b6a-47b5-8539-01bbd08a7860 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:00.337146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9447e25c-9b6a-47b5-8539-01bbd08a7860 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:00.337561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9447e25c-9b6a-47b5-8539-01bbd08a7860 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:00.338305 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9447e25c-9b6a-47b5-8539-01bbd08a7860 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:00.338781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9447e25c-9b6a-47b5-8539-01bbd08a7860 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:00.339287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9447e25c-9b6a-47b5-8539-01bbd08a7860 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:00.485054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9447e25c-9b6a-47b5-8539-01bbd08a7860 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:00.493912 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9447e25c-9b6a-47b5-8539-01bbd08a7860 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1359 microversion: 2.1 time: 0.172041 Aug 24 11:20:00.494715 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3781/7200] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:00 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:01.515107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0a67e176-e7c1-43df-84be-a36927f979d4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:01.515920 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0a67e176-e7c1-43df-84be-a36927f979d4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:01.518751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:01.525354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a67e176-e7c1-43df-84be-a36927f979d4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:01.525882 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a67e176-e7c1-43df-84be-a36927f979d4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:01.526328 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a67e176-e7c1-43df-84be-a36927f979d4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:01.527046 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a67e176-e7c1-43df-84be-a36927f979d4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:01.527513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a67e176-e7c1-43df-84be-a36927f979d4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:01.527939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a67e176-e7c1-43df-84be-a36927f979d4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:01.674591 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0a67e176-e7c1-43df-84be-a36927f979d4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:01.684591 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0a67e176-e7c1-43df-84be-a36927f979d4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1359 microversion: 2.1 time: 0.173621 Aug 24 11:20:01.685645 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3420/7201] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:01 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:02.706392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-14f29cd1-2cdd-4cbf-91db-df0463fc54d8 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:02.707041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-14f29cd1-2cdd-4cbf-91db-df0463fc54d8 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:02.709926 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:02.716096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14f29cd1-2cdd-4cbf-91db-df0463fc54d8 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:02.716595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14f29cd1-2cdd-4cbf-91db-df0463fc54d8 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:02.717045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14f29cd1-2cdd-4cbf-91db-df0463fc54d8 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:02.717789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14f29cd1-2cdd-4cbf-91db-df0463fc54d8 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:02.718259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14f29cd1-2cdd-4cbf-91db-df0463fc54d8 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:02.718696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14f29cd1-2cdd-4cbf-91db-df0463fc54d8 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:02.863612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-14f29cd1-2cdd-4cbf-91db-df0463fc54d8 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:02.873104 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-14f29cd1-2cdd-4cbf-91db-df0463fc54d8 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1359 microversion: 2.1 time: 0.171300 Aug 24 11:20:02.881233 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3782/7202] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:02 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:03.895164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e10f58e1-a411-4068-8f7c-b5124606dd8f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:03.895759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e10f58e1-a411-4068-8f7c-b5124606dd8f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:03.903559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e10f58e1-a411-4068-8f7c-b5124606dd8f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:03.904606 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e10f58e1-a411-4068-8f7c-b5124606dd8f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:03.905455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e10f58e1-a411-4068-8f7c-b5124606dd8f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:03.906444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e10f58e1-a411-4068-8f7c-b5124606dd8f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:03.907300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e10f58e1-a411-4068-8f7c-b5124606dd8f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:03.908106 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e10f58e1-a411-4068-8f7c-b5124606dd8f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:04.073577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e10f58e1-a411-4068-8f7c-b5124606dd8f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:04.084622 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e10f58e1-a411-4068-8f7c-b5124606dd8f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1359 microversion: 2.1 time: 0.193664 Aug 24 11:20:04.097203 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3421/7203] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:03 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:05.109276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fbe841f8-3106-41ee-8640-63589c370bec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:05.110169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fbe841f8-3106-41ee-8640-63589c370bec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:05.118863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbe841f8-3106-41ee-8640-63589c370bec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:05.119592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbe841f8-3106-41ee-8640-63589c370bec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:05.120049 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbe841f8-3106-41ee-8640-63589c370bec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:05.120793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbe841f8-3106-41ee-8640-63589c370bec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:05.121303 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbe841f8-3106-41ee-8640-63589c370bec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:05.121751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbe841f8-3106-41ee-8640-63589c370bec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:05.268197 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fbe841f8-3106-41ee-8640-63589c370bec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:05.277285 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fbe841f8-3106-41ee-8640-63589c370bec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1359 microversion: 2.1 time: 0.173020 Aug 24 11:20:05.277986 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3783/7204] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:05 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:05.812554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-835c881f-17c1-4f7a-94e5-24c0bca5edc8 req-f78e1164-4f28-40fe-a647-9d5fc14a8b94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53e4f093-8ec8-4d7f-9541-33a2f4dad3cd", "tag": "70cce2ae-f2bb-4cd7-b8b3-6c14fbc60060"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:20:05.818728 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:05.819476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:05.826510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-835c881f-17c1-4f7a-94e5-24c0bca5edc8 req-f78e1164-4f28-40fe-a647-9d5fc14a8b94 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:05.826996 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-835c881f-17c1-4f7a-94e5-24c0bca5edc8 req-f78e1164-4f28-40fe-a647-9d5fc14a8b94 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:05.827625 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-835c881f-17c1-4f7a-94e5-24c0bca5edc8 req-f78e1164-4f28-40fe-a647-9d5fc14a8b94 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:05.840612 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-835c881f-17c1-4f7a-94e5-24c0bca5edc8 req-f78e1164-4f28-40fe-a647-9d5fc14a8b94 service nova] Creating event network-changed:70cce2ae-f2bb-4cd7-b8b3-6c14fbc60060 for instance 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd on n-h2-849328-3 Aug 24 11:20:05.845825 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-835c881f-17c1-4f7a-94e5-24c0bca5edc8 req-f78e1164-4f28-40fe-a647-9d5fc14a8b94 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037039 Aug 24 11:20:05.846451 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3422/7205] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:20:06.300751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a7d5a4a6-635b-4af5-b1f8-a1106c48d7bc tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:06.301382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a7d5a4a6-635b-4af5-b1f8-a1106c48d7bc tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:06.303352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:06.309753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7d5a4a6-635b-4af5-b1f8-a1106c48d7bc tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:06.310259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7d5a4a6-635b-4af5-b1f8-a1106c48d7bc tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:06.310707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7d5a4a6-635b-4af5-b1f8-a1106c48d7bc tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:06.311419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7d5a4a6-635b-4af5-b1f8-a1106c48d7bc tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:06.311882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7d5a4a6-635b-4af5-b1f8-a1106c48d7bc tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:06.312351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7d5a4a6-635b-4af5-b1f8-a1106c48d7bc tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:06.450708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a7d5a4a6-635b-4af5-b1f8-a1106c48d7bc tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:06.458938 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a7d5a4a6-635b-4af5-b1f8-a1106c48d7bc tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1359 microversion: 2.1 time: 0.162138 Aug 24 11:20:06.459541 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3784/7206] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:06 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:07.481552 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a5e0eee7-456a-4147-a457-1e8473e1d63b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:07.482266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a5e0eee7-456a-4147-a457-1e8473e1d63b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:07.493001 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5e0eee7-456a-4147-a457-1e8473e1d63b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:07.494063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5e0eee7-456a-4147-a457-1e8473e1d63b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:07.494696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5e0eee7-456a-4147-a457-1e8473e1d63b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:07.495460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5e0eee7-456a-4147-a457-1e8473e1d63b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:07.495881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5e0eee7-456a-4147-a457-1e8473e1d63b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:07.496309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5e0eee7-456a-4147-a457-1e8473e1d63b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:07.725457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a5e0eee7-456a-4147-a457-1e8473e1d63b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:07.734278 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a5e0eee7-456a-4147-a457-1e8473e1d63b tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1359 microversion: 2.1 time: 0.257894 Aug 24 11:20:07.734900 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3423/7207] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:07 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1359 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:08.761987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c38db0ca-825e-416d-98fa-1f8b5556f54c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:08.762984 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c38db0ca-825e-416d-98fa-1f8b5556f54c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:08.774897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c38db0ca-825e-416d-98fa-1f8b5556f54c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:08.775593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c38db0ca-825e-416d-98fa-1f8b5556f54c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:08.776330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c38db0ca-825e-416d-98fa-1f8b5556f54c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:08.777076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c38db0ca-825e-416d-98fa-1f8b5556f54c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:08.777582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c38db0ca-825e-416d-98fa-1f8b5556f54c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:08.778228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c38db0ca-825e-416d-98fa-1f8b5556f54c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:08.920894 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c38db0ca-825e-416d-98fa-1f8b5556f54c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:08.933597 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c38db0ca-825e-416d-98fa-1f8b5556f54c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1359 microversion: 2.1 time: 0.179926 Aug 24 11:20:08.934330 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3785/7208] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:08 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:09.560320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-41832ad0-3e74-43c1-a642-6f3cc422e83e req-5e26159c-705a-4372-9914-c3bdbf8d187f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53e4f093-8ec8-4d7f-9541-33a2f4dad3cd", "name": "network-vif-plugged", "status": "completed", "tag": "70cce2ae-f2bb-4cd7-b8b3-6c14fbc60060"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:20:09.570736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-41832ad0-3e74-43c1-a642-6f3cc422e83e req-5e26159c-705a-4372-9914-c3bdbf8d187f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:09.571187 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-41832ad0-3e74-43c1-a642-6f3cc422e83e req-5e26159c-705a-4372-9914-c3bdbf8d187f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:09.571615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-41832ad0-3e74-43c1-a642-6f3cc422e83e req-5e26159c-705a-4372-9914-c3bdbf8d187f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:09.583422 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-41832ad0-3e74-43c1-a642-6f3cc422e83e req-5e26159c-705a-4372-9914-c3bdbf8d187f service nova] Creating event network-vif-plugged:70cce2ae-f2bb-4cd7-b8b3-6c14fbc60060 for instance 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd on n-h2-849328-3 Aug 24 11:20:09.589161 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-41832ad0-3e74-43c1-a642-6f3cc422e83e req-5e26159c-705a-4372-9914-c3bdbf8d187f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032704 Aug 24 11:20:09.589789 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3424/7209] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:20:09.955152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de1fef78-0170-4762-be00-ffceb4286cb1 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:09.955772 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-de1fef78-0170-4762-be00-ffceb4286cb1 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:09.963052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de1fef78-0170-4762-be00-ffceb4286cb1 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:09.963640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de1fef78-0170-4762-be00-ffceb4286cb1 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:09.964082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de1fef78-0170-4762-be00-ffceb4286cb1 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:09.964784 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de1fef78-0170-4762-be00-ffceb4286cb1 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:09.965281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de1fef78-0170-4762-be00-ffceb4286cb1 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:09.965721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de1fef78-0170-4762-be00-ffceb4286cb1 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:10.101683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-de1fef78-0170-4762-be00-ffceb4286cb1 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:10.113674 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-de1fef78-0170-4762-be00-ffceb4286cb1 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1359 microversion: 2.1 time: 0.162165 Aug 24 11:20:10.114526 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3786/7210] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:09 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:11.136696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-50ed1491-e561-4312-9696-76109b15009a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:11.137469 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-50ed1491-e561-4312-9696-76109b15009a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:11.144207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50ed1491-e561-4312-9696-76109b15009a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:11.144696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50ed1491-e561-4312-9696-76109b15009a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:11.145143 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50ed1491-e561-4312-9696-76109b15009a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:11.145902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50ed1491-e561-4312-9696-76109b15009a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:11.146357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50ed1491-e561-4312-9696-76109b15009a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:11.146785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50ed1491-e561-4312-9696-76109b15009a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:11.280505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-50ed1491-e561-4312-9696-76109b15009a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:11.288672 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-50ed1491-e561-4312-9696-76109b15009a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1548 microversion: 2.1 time: 0.157339 Aug 24 11:20:11.289365 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3425/7211] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:11 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:11.309880 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3b4b1eee-5ee4-4595-8639-f0bdec94ac74 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:11.310504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3b4b1eee-5ee4-4595-8639-f0bdec94ac74 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:11.317612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b4b1eee-5ee4-4595-8639-f0bdec94ac74 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:11.318113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b4b1eee-5ee4-4595-8639-f0bdec94ac74 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:11.318553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b4b1eee-5ee4-4595-8639-f0bdec94ac74 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:11.319557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b4b1eee-5ee4-4595-8639-f0bdec94ac74 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:11.320014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b4b1eee-5ee4-4595-8639-f0bdec94ac74 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:11.320445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b4b1eee-5ee4-4595-8639-f0bdec94ac74 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:11.452160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3b4b1eee-5ee4-4595-8639-f0bdec94ac74 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:11.461158 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3b4b1eee-5ee4-4595-8639-f0bdec94ac74 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1548 microversion: 2.1 time: 0.155782 Aug 24 11:20:11.461739 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3787/7212] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:11 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:11.481391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e56819aa-7ed9-4d92-8127-36cfd09c1fec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:11.485964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e56819aa-7ed9-4d92-8127-36cfd09c1fec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:11.486723 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e56819aa-7ed9-4d92-8127-36cfd09c1fec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Searching by: {'deleted': False, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 11:20:11.492363 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e56819aa-7ed9-4d92-8127-36cfd09c1fec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:11.492837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e56819aa-7ed9-4d92-8127-36cfd09c1fec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:11.493294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e56819aa-7ed9-4d92-8127-36cfd09c1fec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:11.494014 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e56819aa-7ed9-4d92-8127-36cfd09c1fec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:11.494510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e56819aa-7ed9-4d92-8127-36cfd09c1fec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:11.494927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e56819aa-7ed9-4d92-8127-36cfd09c1fec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:11.519065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-e56819aa-7ed9-4d92-8127-36cfd09c1fec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 11:20:11.548943 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e56819aa-7ed9-4d92-8127-36cfd09c1fec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.071457 Aug 24 11:20:11.549591 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3426/7213] 10.222.0.85 () {58 vars in 1125 bytes} [Wed Aug 24 11:20:11 2022] GET /compute/v2.1/servers => generated 343 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:20:11.561341 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-17f5e78e-082b-463f-807b-48f2db71d83c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:11.561976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-17f5e78e-082b-463f-807b-48f2db71d83c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:11.568253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17f5e78e-082b-463f-807b-48f2db71d83c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:11.568756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17f5e78e-082b-463f-807b-48f2db71d83c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:11.569239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17f5e78e-082b-463f-807b-48f2db71d83c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:11.569951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17f5e78e-082b-463f-807b-48f2db71d83c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:11.570418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17f5e78e-082b-463f-807b-48f2db71d83c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:11.570854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17f5e78e-082b-463f-807b-48f2db71d83c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:11.701322 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-17f5e78e-082b-463f-807b-48f2db71d83c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:11.709332 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-17f5e78e-082b-463f-807b-48f2db71d83c tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1548 microversion: 2.1 time: 0.152052 Aug 24 11:20:11.709920 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3788/7214] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:11 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:13.232611 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a090376e-7fbc-4cb7-8055-bccfd774ac95 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "205569d0-4478-4155-aaee-fa942fee85bb"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:20:13.235078 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a090376e-7fbc-4cb7-8055-bccfd774ac95 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:13.242279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a090376e-7fbc-4cb7-8055-bccfd774ac95 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:13.242742 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a090376e-7fbc-4cb7-8055-bccfd774ac95 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:13.243216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a090376e-7fbc-4cb7-8055-bccfd774ac95 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:13.243971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a090376e-7fbc-4cb7-8055-bccfd774ac95 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:13.244487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a090376e-7fbc-4cb7-8055-bccfd774ac95 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:13.244931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a090376e-7fbc-4cb7-8055-bccfd774ac95 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:13.500862 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a090376e-7fbc-4cb7-8055-bccfd774ac95 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "POST /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268032 Aug 24 11:20:13.500862 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3427/7215] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Aug 24 11:20:13 2022] POST /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:20:24.308483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ac6bd782-5b2f-4fc2-95e2-cdbb996a7d81 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:24.309141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ac6bd782-5b2f-4fc2-95e2-cdbb996a7d81 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:24.311314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=13 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:24.311974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=54 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:24.317828 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac6bd782-5b2f-4fc2-95e2-cdbb996a7d81 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:24.320075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac6bd782-5b2f-4fc2-95e2-cdbb996a7d81 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:24.320075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac6bd782-5b2f-4fc2-95e2-cdbb996a7d81 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:24.320075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac6bd782-5b2f-4fc2-95e2-cdbb996a7d81 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:24.320075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac6bd782-5b2f-4fc2-95e2-cdbb996a7d81 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:24.320541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac6bd782-5b2f-4fc2-95e2-cdbb996a7d81 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:24.468542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ac6bd782-5b2f-4fc2-95e2-cdbb996a7d81 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:24.477689 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ac6bd782-5b2f-4fc2-95e2-cdbb996a7d81 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1594 microversion: 2.1 time: 0.175158 Aug 24 11:20:24.478334 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3789/7216] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:24 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1594 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:26.427480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:26.428815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=15 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:26.429268 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:26.434605 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-b6782242-bd0b-45e8-9001-4ac58594e82e req-91da7e58-9637-456b-85f7-4cdb177dc222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53e4f093-8ec8-4d7f-9541-33a2f4dad3cd", "tag": "70cce2ae-f2bb-4cd7-b8b3-6c14fbc60060"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:20:26.447152 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b6782242-bd0b-45e8-9001-4ac58594e82e req-91da7e58-9637-456b-85f7-4cdb177dc222 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:26.447598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b6782242-bd0b-45e8-9001-4ac58594e82e req-91da7e58-9637-456b-85f7-4cdb177dc222 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:26.447972 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b6782242-bd0b-45e8-9001-4ac58594e82e req-91da7e58-9637-456b-85f7-4cdb177dc222 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:26.460527 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b6782242-bd0b-45e8-9001-4ac58594e82e req-91da7e58-9637-456b-85f7-4cdb177dc222 service nova] Creating event network-changed:70cce2ae-f2bb-4cd7-b8b3-6c14fbc60060 for instance 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd on n-h2-849328-3 Aug 24 11:20:26.466950 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-b6782242-bd0b-45e8-9001-4ac58594e82e req-91da7e58-9637-456b-85f7-4cdb177dc222 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040932 Aug 24 11:20:26.467587 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3428/7217] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:20:27.567777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d74a5748-80e8-4d12-b0a5-6a8d0a70ece6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-635028369"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:20:27.568481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d74a5748-80e8-4d12-b0a5-6a8d0a70ece6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:27.577338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d74a5748-80e8-4d12-b0a5-6a8d0a70ece6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:27.577995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d74a5748-80e8-4d12-b0a5-6a8d0a70ece6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:27.578598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d74a5748-80e8-4d12-b0a5-6a8d0a70ece6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:27.579456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d74a5748-80e8-4d12-b0a5-6a8d0a70ece6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:27.580358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d74a5748-80e8-4d12-b0a5-6a8d0a70ece6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:27.580893 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d74a5748-80e8-4d12-b0a5-6a8d0a70ece6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:27.722637 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.network.security_group_api [None req-d74a5748-80e8-4d12-b0a5-6a8d0a70ece6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Adding security group 99f11e0c-20a7-4fba-ba8a-0ec01abc5d74 to port 70cce2ae-f2bb-4cd7-b8b3-6c14fbc60060 Aug 24 11:20:28.102056 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d74a5748-80e8-4d12-b0a5-6a8d0a70ece6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "POST /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd/action" status: 202 len: 0 microversion: 2.1 time: 0.539300 Aug 24 11:20:28.102735 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3790/7218] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:20:27 2022] POST /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:20:28.112757 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-14913050-a220-4ad0-92da-f355322cc762 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:28.114261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-14913050-a220-4ad0-92da-f355322cc762 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:28.121854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14913050-a220-4ad0-92da-f355322cc762 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:28.122561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14913050-a220-4ad0-92da-f355322cc762 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:28.122858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14913050-a220-4ad0-92da-f355322cc762 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:28.123784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14913050-a220-4ad0-92da-f355322cc762 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:28.124435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14913050-a220-4ad0-92da-f355322cc762 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:28.124818 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14913050-a220-4ad0-92da-f355322cc762 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:28.294728 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-14913050-a220-4ad0-92da-f355322cc762 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:28.305962 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-14913050-a220-4ad0-92da-f355322cc762 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1758 microversion: 2.1 time: 0.197454 Aug 24 11:20:28.306574 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3429/7219] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:28 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1758 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:28.485319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-bce20179-f0d8-4d57-8126-92ba14654de3 req-c5ab7391-6811-42a8-af27-946c268f0ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53e4f093-8ec8-4d7f-9541-33a2f4dad3cd", "tag": "70cce2ae-f2bb-4cd7-b8b3-6c14fbc60060"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:20:28.497461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bce20179-f0d8-4d57-8126-92ba14654de3 req-c5ab7391-6811-42a8-af27-946c268f0ae9 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:28.498173 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bce20179-f0d8-4d57-8126-92ba14654de3 req-c5ab7391-6811-42a8-af27-946c268f0ae9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:28.498675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bce20179-f0d8-4d57-8126-92ba14654de3 req-c5ab7391-6811-42a8-af27-946c268f0ae9 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:28.515251 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-bce20179-f0d8-4d57-8126-92ba14654de3 req-c5ab7391-6811-42a8-af27-946c268f0ae9 service nova] Creating event network-changed:70cce2ae-f2bb-4cd7-b8b3-6c14fbc60060 for instance 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd on n-h2-849328-3 Aug 24 11:20:28.520566 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-bce20179-f0d8-4d57-8126-92ba14654de3 req-c5ab7391-6811-42a8-af27-946c268f0ae9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039560 Aug 24 11:20:28.521518 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3791/7220] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:20:50.664326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:50.665153 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:50.722606 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f3b5fd85-2992-4051-bfd4-28add21ee28f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:20:50.724665 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f3b5fd85-2992-4051-bfd4-28add21ee28f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:50.731033 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3b5fd85-2992-4051-bfd4-28add21ee28f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:50.731521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3b5fd85-2992-4051-bfd4-28add21ee28f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:50.731948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3b5fd85-2992-4051-bfd4-28add21ee28f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:50.732639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3b5fd85-2992-4051-bfd4-28add21ee28f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:50.733089 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3b5fd85-2992-4051-bfd4-28add21ee28f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:50.733547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3b5fd85-2992-4051-bfd4-28add21ee28f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:50.829247 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f3b5fd85-2992-4051-bfd4-28add21ee28f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "POST /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd/action" status: 202 len: 0 microversion: 2.1 time: 0.170843 Aug 24 11:20:50.830973 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3430/7221] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:20:50 2022] POST /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:20:50.837062 n-d-849328-3 devstack@n-api.service[122433]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5886a733-ca00-414d-91f6-f1df23acfbb8] AMQP server on 10.222.0.85:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 11:20:50.838139 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:50.838942 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=12 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:50.843298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0443963c-593d-4f54-a5a4-31be78250b12 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:50.844017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0443963c-593d-4f54-a5a4-31be78250b12 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:50.851846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0443963c-593d-4f54-a5a4-31be78250b12 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:50.852347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0443963c-593d-4f54-a5a4-31be78250b12 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:50.852832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0443963c-593d-4f54-a5a4-31be78250b12 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:50.853584 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0443963c-593d-4f54-a5a4-31be78250b12 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:50.854052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0443963c-593d-4f54-a5a4-31be78250b12 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:50.854495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0443963c-593d-4f54-a5a4-31be78250b12 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:51.024070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0443963c-593d-4f54-a5a4-31be78250b12 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:51.034334 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0443963c-593d-4f54-a5a4-31be78250b12 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1750 microversion: 2.1 time: 0.198741 Aug 24 11:20:51.034939 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3792/7222] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:50 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1750 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:20:52.059960 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d667f634-4480-4c85-8db8-eddeee37e1ec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:52.060650 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d667f634-4480-4c85-8db8-eddeee37e1ec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:52.067678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d667f634-4480-4c85-8db8-eddeee37e1ec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:52.068160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d667f634-4480-4c85-8db8-eddeee37e1ec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:52.068590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d667f634-4480-4c85-8db8-eddeee37e1ec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:52.069329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d667f634-4480-4c85-8db8-eddeee37e1ec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:52.069779 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d667f634-4480-4c85-8db8-eddeee37e1ec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:52.070195 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d667f634-4480-4c85-8db8-eddeee37e1ec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:52.228220 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d667f634-4480-4c85-8db8-eddeee37e1ec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:52.237696 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d667f634-4480-4c85-8db8-eddeee37e1ec tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1755 microversion: 2.1 time: 0.183075 Aug 24 11:20:52.238350 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3431/7223] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:52 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:53.259995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0b161854-6e7b-4222-aa07-798d2727705f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:53.260624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0b161854-6e7b-4222-aa07-798d2727705f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:53.269556 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b161854-6e7b-4222-aa07-798d2727705f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:53.270074 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b161854-6e7b-4222-aa07-798d2727705f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:53.270520 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b161854-6e7b-4222-aa07-798d2727705f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:53.271234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b161854-6e7b-4222-aa07-798d2727705f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:53.271697 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b161854-6e7b-4222-aa07-798d2727705f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:53.272138 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b161854-6e7b-4222-aa07-798d2727705f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:53.289335 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] [5886a733-ca00-414d-91f6-f1df23acfbb8] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 56350. Aug 24 11:20:53.421344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0b161854-6e7b-4222-aa07-798d2727705f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:53.430495 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0b161854-6e7b-4222-aa07-798d2727705f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1755 microversion: 2.1 time: 0.175029 Aug 24 11:20:53.431088 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3793/7224] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:53 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:54.452131 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-561b76df-0712-4d7e-b75d-43abacd3da74 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:54.452818 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-561b76df-0712-4d7e-b75d-43abacd3da74 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:54.460052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-561b76df-0712-4d7e-b75d-43abacd3da74 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:54.460586 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-561b76df-0712-4d7e-b75d-43abacd3da74 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:54.461024 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-561b76df-0712-4d7e-b75d-43abacd3da74 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:54.461733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-561b76df-0712-4d7e-b75d-43abacd3da74 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:54.462189 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-561b76df-0712-4d7e-b75d-43abacd3da74 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:54.462618 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-561b76df-0712-4d7e-b75d-43abacd3da74 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:54.612600 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-561b76df-0712-4d7e-b75d-43abacd3da74 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:54.620899 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-561b76df-0712-4d7e-b75d-43abacd3da74 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1755 microversion: 2.1 time: 0.172878 Aug 24 11:20:54.621720 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3432/7225] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:54 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:55.644116 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-46f8cf9f-590a-4662-8b17-ba7585d5ac7a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:55.644716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-46f8cf9f-590a-4662-8b17-ba7585d5ac7a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:55.652003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46f8cf9f-590a-4662-8b17-ba7585d5ac7a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:55.652499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46f8cf9f-590a-4662-8b17-ba7585d5ac7a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:55.652950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46f8cf9f-590a-4662-8b17-ba7585d5ac7a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:55.653678 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46f8cf9f-590a-4662-8b17-ba7585d5ac7a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:55.654147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46f8cf9f-590a-4662-8b17-ba7585d5ac7a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:55.654581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46f8cf9f-590a-4662-8b17-ba7585d5ac7a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:55.812045 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-46f8cf9f-590a-4662-8b17-ba7585d5ac7a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:55.820607 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-46f8cf9f-590a-4662-8b17-ba7585d5ac7a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1755 microversion: 2.1 time: 0.181842 Aug 24 11:20:55.821185 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3794/7226] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:55 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:56.843847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-50a30dbc-ee2a-4ee0-877d-500fbad5ae5f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:56.844447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-50a30dbc-ee2a-4ee0-877d-500fbad5ae5f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:56.852384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50a30dbc-ee2a-4ee0-877d-500fbad5ae5f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:56.852895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50a30dbc-ee2a-4ee0-877d-500fbad5ae5f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:56.853369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50a30dbc-ee2a-4ee0-877d-500fbad5ae5f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:56.854044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50a30dbc-ee2a-4ee0-877d-500fbad5ae5f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:56.854491 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50a30dbc-ee2a-4ee0-877d-500fbad5ae5f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:56.854937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50a30dbc-ee2a-4ee0-877d-500fbad5ae5f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:57.027067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-50a30dbc-ee2a-4ee0-877d-500fbad5ae5f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:57.039849 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-50a30dbc-ee2a-4ee0-877d-500fbad5ae5f tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1755 microversion: 2.1 time: 0.201157 Aug 24 11:20:57.040486 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3433/7227] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:56 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1755 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:58.065607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e17ef5a0-4fc8-40fd-8411-cd2ac9e7a915 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:58.066184 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e17ef5a0-4fc8-40fd-8411-cd2ac9e7a915 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:58.073550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e17ef5a0-4fc8-40fd-8411-cd2ac9e7a915 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:58.074052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e17ef5a0-4fc8-40fd-8411-cd2ac9e7a915 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:58.074503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e17ef5a0-4fc8-40fd-8411-cd2ac9e7a915 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:58.075213 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e17ef5a0-4fc8-40fd-8411-cd2ac9e7a915 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:58.075679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e17ef5a0-4fc8-40fd-8411-cd2ac9e7a915 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:58.076118 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e17ef5a0-4fc8-40fd-8411-cd2ac9e7a915 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:58.227373 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e17ef5a0-4fc8-40fd-8411-cd2ac9e7a915 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:58.236390 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e17ef5a0-4fc8-40fd-8411-cd2ac9e7a915 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1755 microversion: 2.1 time: 0.177388 Aug 24 11:20:58.237103 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3795/7228] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:58 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:59.261664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6c3d7a1e-1f15-4872-9474-9e4db22fe992 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:59.262634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6c3d7a1e-1f15-4872-9474-9e4db22fe992 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:59.271761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c3d7a1e-1f15-4872-9474-9e4db22fe992 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:59.272252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c3d7a1e-1f15-4872-9474-9e4db22fe992 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:59.272692 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c3d7a1e-1f15-4872-9474-9e4db22fe992 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:59.273428 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c3d7a1e-1f15-4872-9474-9e4db22fe992 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:59.273880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c3d7a1e-1f15-4872-9474-9e4db22fe992 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:59.274309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c3d7a1e-1f15-4872-9474-9e4db22fe992 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:59.449791 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6c3d7a1e-1f15-4872-9474-9e4db22fe992 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:59.459021 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6c3d7a1e-1f15-4872-9474-9e4db22fe992 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1755 microversion: 2.1 time: 0.203515 Aug 24 11:20:59.459654 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3434/7229] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:59 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1755 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:21:00.480879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-87d66f5a-a465-4407-aceb-5a1d93a69386 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:00.481627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-87d66f5a-a465-4407-aceb-5a1d93a69386 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:00.488789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87d66f5a-a465-4407-aceb-5a1d93a69386 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:00.489333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87d66f5a-a465-4407-aceb-5a1d93a69386 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:00.489786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87d66f5a-a465-4407-aceb-5a1d93a69386 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:00.490513 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87d66f5a-a465-4407-aceb-5a1d93a69386 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:00.490980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87d66f5a-a465-4407-aceb-5a1d93a69386 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:00.491421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87d66f5a-a465-4407-aceb-5a1d93a69386 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:00.638605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-87d66f5a-a465-4407-aceb-5a1d93a69386 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:21:00.651496 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-87d66f5a-a465-4407-aceb-5a1d93a69386 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1755 microversion: 2.1 time: 0.174263 Aug 24 11:21:00.652301 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3796/7230] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:21:00 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:21:01.682679 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cce9ff11-4d16-49fc-aa06-92bae5fabb91 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:01.683372 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cce9ff11-4d16-49fc-aa06-92bae5fabb91 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:01.691959 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cce9ff11-4d16-49fc-aa06-92bae5fabb91 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:01.692557 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cce9ff11-4d16-49fc-aa06-92bae5fabb91 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:01.692994 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cce9ff11-4d16-49fc-aa06-92bae5fabb91 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:01.693726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cce9ff11-4d16-49fc-aa06-92bae5fabb91 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:01.694176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cce9ff11-4d16-49fc-aa06-92bae5fabb91 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:01.694725 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cce9ff11-4d16-49fc-aa06-92bae5fabb91 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:01.850064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cce9ff11-4d16-49fc-aa06-92bae5fabb91 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:21:01.859932 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cce9ff11-4d16-49fc-aa06-92bae5fabb91 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1755 microversion: 2.1 time: 0.181733 Aug 24 11:21:01.860534 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3435/7231] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:21:01 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:21:02.884948 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-11a97165-bbab-4841-a470-0fb5a1b3511d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:02.885602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-11a97165-bbab-4841-a470-0fb5a1b3511d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:02.893760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11a97165-bbab-4841-a470-0fb5a1b3511d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:02.894261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11a97165-bbab-4841-a470-0fb5a1b3511d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:02.894754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11a97165-bbab-4841-a470-0fb5a1b3511d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:02.895477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11a97165-bbab-4841-a470-0fb5a1b3511d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:02.895943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11a97165-bbab-4841-a470-0fb5a1b3511d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:02.896381 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11a97165-bbab-4841-a470-0fb5a1b3511d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:03.053931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-11a97165-bbab-4841-a470-0fb5a1b3511d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:21:03.062473 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-11a97165-bbab-4841-a470-0fb5a1b3511d tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1755 microversion: 2.1 time: 0.182023 Aug 24 11:21:03.063060 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3797/7232] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:21:02 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:21:04.084274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ff34a181-014a-4925-8a63-af739a8175d4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:04.084868 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ff34a181-014a-4925-8a63-af739a8175d4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:04.091569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff34a181-014a-4925-8a63-af739a8175d4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:04.092058 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff34a181-014a-4925-8a63-af739a8175d4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:04.092829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff34a181-014a-4925-8a63-af739a8175d4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:04.093214 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff34a181-014a-4925-8a63-af739a8175d4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:04.093766 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff34a181-014a-4925-8a63-af739a8175d4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:04.094197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff34a181-014a-4925-8a63-af739a8175d4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:04.245459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ff34a181-014a-4925-8a63-af739a8175d4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:21:04.254727 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ff34a181-014a-4925-8a63-af739a8175d4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1755 microversion: 2.1 time: 0.174564 Aug 24 11:21:04.255340 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3436/7233] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:21:04 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:21:05.276407 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ae0d520-4537-4af1-a9d0-d3a087ab0ec7 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:05.277147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8ae0d520-4537-4af1-a9d0-d3a087ab0ec7 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:05.285312 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ae0d520-4537-4af1-a9d0-d3a087ab0ec7 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:05.285819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ae0d520-4537-4af1-a9d0-d3a087ab0ec7 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:05.286261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ae0d520-4537-4af1-a9d0-d3a087ab0ec7 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:05.287299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ae0d520-4537-4af1-a9d0-d3a087ab0ec7 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:05.287767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ae0d520-4537-4af1-a9d0-d3a087ab0ec7 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:05.288197 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ae0d520-4537-4af1-a9d0-d3a087ab0ec7 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:05.447770 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8ae0d520-4537-4af1-a9d0-d3a087ab0ec7 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:21:05.459032 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8ae0d520-4537-4af1-a9d0-d3a087ab0ec7 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1755 microversion: 2.1 time: 0.186414 Aug 24 11:21:05.459638 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3798/7234] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:21:05 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:21:06.484737 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e34e8363-bc33-4c00-9c52-620d897ed178 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:06.485912 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e34e8363-bc33-4c00-9c52-620d897ed178 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:06.497850 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e34e8363-bc33-4c00-9c52-620d897ed178 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:06.498659 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e34e8363-bc33-4c00-9c52-620d897ed178 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:06.499418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e34e8363-bc33-4c00-9c52-620d897ed178 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:06.500530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e34e8363-bc33-4c00-9c52-620d897ed178 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:06.501481 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e34e8363-bc33-4c00-9c52-620d897ed178 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:06.501913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e34e8363-bc33-4c00-9c52-620d897ed178 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:06.654246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e34e8363-bc33-4c00-9c52-620d897ed178 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:21:06.667227 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e34e8363-bc33-4c00-9c52-620d897ed178 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1755 microversion: 2.1 time: 0.188770 Aug 24 11:21:06.668045 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3437/7235] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:21:06 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1755 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:21:07.690625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d75b8e6a-75ba-439d-a15f-312c231fe45a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:07.691233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d75b8e6a-75ba-439d-a15f-312c231fe45a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:07.698855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d75b8e6a-75ba-439d-a15f-312c231fe45a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:07.699364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d75b8e6a-75ba-439d-a15f-312c231fe45a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:07.699808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d75b8e6a-75ba-439d-a15f-312c231fe45a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:07.700519 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d75b8e6a-75ba-439d-a15f-312c231fe45a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:07.700985 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d75b8e6a-75ba-439d-a15f-312c231fe45a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:07.701441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d75b8e6a-75ba-439d-a15f-312c231fe45a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:07.852957 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d75b8e6a-75ba-439d-a15f-312c231fe45a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:21:07.861993 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d75b8e6a-75ba-439d-a15f-312c231fe45a tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1758 microversion: 2.1 time: 0.175560 Aug 24 11:21:07.862606 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3799/7236] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:21:07 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:21:41.452443 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a985f746-5b42-41d1-9ed6-3b02b10132e4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-635028369"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:21:41.453606 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a985f746-5b42-41d1-9ed6-3b02b10132e4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:41.457501 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=16 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:41.458535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:41.467975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a985f746-5b42-41d1-9ed6-3b02b10132e4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:41.468642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a985f746-5b42-41d1-9ed6-3b02b10132e4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:41.469350 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a985f746-5b42-41d1-9ed6-3b02b10132e4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:41.470462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a985f746-5b42-41d1-9ed6-3b02b10132e4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:41.471049 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a985f746-5b42-41d1-9ed6-3b02b10132e4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:41.471599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a985f746-5b42-41d1-9ed6-3b02b10132e4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:41.614237 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.network.security_group_api [None req-a985f746-5b42-41d1-9ed6-3b02b10132e4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Removing security group 99f11e0c-20a7-4fba-ba8a-0ec01abc5d74 from port 70cce2ae-f2bb-4cd7-b8b3-6c14fbc60060 Aug 24 11:21:41.938923 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a985f746-5b42-41d1-9ed6-3b02b10132e4 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "POST /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd/action" status: 202 len: 0 microversion: 2.1 time: 0.493052 Aug 24 11:21:41.947974 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3438/7237] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:21:41 2022] POST /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:21:41.962089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=16 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:41.963525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=48 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:42.077645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-433610f4-5a9a-4404-be05-72a0793c3919 req-e0f058d3-d645-44d5-b5f8-dfc52adbd324 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53e4f093-8ec8-4d7f-9541-33a2f4dad3cd", "tag": "70cce2ae-f2bb-4cd7-b8b3-6c14fbc60060"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:21:42.089033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-433610f4-5a9a-4404-be05-72a0793c3919 req-e0f058d3-d645-44d5-b5f8-dfc52adbd324 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:42.089596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-433610f4-5a9a-4404-be05-72a0793c3919 req-e0f058d3-d645-44d5-b5f8-dfc52adbd324 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:42.090047 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-433610f4-5a9a-4404-be05-72a0793c3919 req-e0f058d3-d645-44d5-b5f8-dfc52adbd324 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:42.104338 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-433610f4-5a9a-4404-be05-72a0793c3919 req-e0f058d3-d645-44d5-b5f8-dfc52adbd324 service nova] Creating event network-changed:70cce2ae-f2bb-4cd7-b8b3-6c14fbc60060 for instance 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd on n-h2-849328-3 Aug 24 11:21:42.111058 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-433610f4-5a9a-4404-be05-72a0793c3919 req-e0f058d3-d645-44d5-b5f8-dfc52adbd324 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159742 Aug 24 11:21:42.116235 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3800/7238] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:21:43.134357 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8ec95c47-0c4d-4e9f-ae8a-98b853d669d5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:43.135008 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8ec95c47-0c4d-4e9f-ae8a-98b853d669d5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:43.135400 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-1e37fe24-fbd0-46a4-9fad-63a61d8d1867 req-298003f7-8e98-4425-94e9-ab18918f57aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53e4f093-8ec8-4d7f-9541-33a2f4dad3cd", "tag": "70cce2ae-f2bb-4cd7-b8b3-6c14fbc60060"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:21:43.141747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ec95c47-0c4d-4e9f-ae8a-98b853d669d5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:43.142646 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ec95c47-0c4d-4e9f-ae8a-98b853d669d5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:43.143112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ec95c47-0c4d-4e9f-ae8a-98b853d669d5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:43.144313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ec95c47-0c4d-4e9f-ae8a-98b853d669d5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:43.144777 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ec95c47-0c4d-4e9f-ae8a-98b853d669d5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:43.145239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ec95c47-0c4d-4e9f-ae8a-98b853d669d5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:43.147668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1e37fe24-fbd0-46a4-9fad-63a61d8d1867 req-298003f7-8e98-4425-94e9-ab18918f57aa service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:43.148321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1e37fe24-fbd0-46a4-9fad-63a61d8d1867 req-298003f7-8e98-4425-94e9-ab18918f57aa service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:43.148777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1e37fe24-fbd0-46a4-9fad-63a61d8d1867 req-298003f7-8e98-4425-94e9-ab18918f57aa service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:43.162011 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-1e37fe24-fbd0-46a4-9fad-63a61d8d1867 req-298003f7-8e98-4425-94e9-ab18918f57aa service nova] Creating event network-changed:70cce2ae-f2bb-4cd7-b8b3-6c14fbc60060 for instance 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd on n-h2-849328-3 Aug 24 11:21:43.171329 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-1e37fe24-fbd0-46a4-9fad-63a61d8d1867 req-298003f7-8e98-4425-94e9-ab18918f57aa service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036650 Aug 24 11:21:43.171329 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3801/7239] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:21:43.249576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-8ec95c47-0c4d-4e9f-ae8a-98b853d669d5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lazy-loading 'services' on Instance uuid 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:21:43.334593 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8ec95c47-0c4d-4e9f-ae8a-98b853d669d5 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "DELETE /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd/os-volume_attachments/205569d0-4478-4155-aaee-fa942fee85bb" status: 202 len: 0 microversion: 2.1 time: 0.205791 Aug 24 11:21:43.335340 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3439/7240] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Aug 24 11:21:43 2022] DELETE /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd/os-volume_attachments/205569d0-4478-4155-aaee-fa942fee85bb => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:21:43.345298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f74747b5-9ff9-426f-a828-f0f8b4d5e4ce tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:43.348391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f74747b5-9ff9-426f-a828-f0f8b4d5e4ce tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:43.355964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f74747b5-9ff9-426f-a828-f0f8b4d5e4ce tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:43.356855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f74747b5-9ff9-426f-a828-f0f8b4d5e4ce tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:43.357599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f74747b5-9ff9-426f-a828-f0f8b4d5e4ce tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:43.358706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f74747b5-9ff9-426f-a828-f0f8b4d5e4ce tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:43.359388 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f74747b5-9ff9-426f-a828-f0f8b4d5e4ce tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:43.360032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f74747b5-9ff9-426f-a828-f0f8b4d5e4ce tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:43.396678 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f74747b5-9ff9-426f-a828-f0f8b4d5e4ce tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054681 Aug 24 11:21:43.397354 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3802/7241] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:21:43 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:21:44.413909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b134fd54-7a26-4c75-a00e-9e480c3726be tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:44.416329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b134fd54-7a26-4c75-a00e-9e480c3726be tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:44.423366 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b134fd54-7a26-4c75-a00e-9e480c3726be tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:44.423855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b134fd54-7a26-4c75-a00e-9e480c3726be tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:44.424301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b134fd54-7a26-4c75-a00e-9e480c3726be tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:44.425029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b134fd54-7a26-4c75-a00e-9e480c3726be tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:44.425522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b134fd54-7a26-4c75-a00e-9e480c3726be tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:44.425948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b134fd54-7a26-4c75-a00e-9e480c3726be tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:44.456733 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b134fd54-7a26-4c75-a00e-9e480c3726be tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048198 Aug 24 11:21:44.457343 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3440/7242] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:21:44 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:21:45.468719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e872eedc-f69a-497c-95e0-7c1d14e94d85 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:45.472222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e872eedc-f69a-497c-95e0-7c1d14e94d85 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:45.481525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e872eedc-f69a-497c-95e0-7c1d14e94d85 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:45.482337 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e872eedc-f69a-497c-95e0-7c1d14e94d85 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:45.482791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e872eedc-f69a-497c-95e0-7c1d14e94d85 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:45.483522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e872eedc-f69a-497c-95e0-7c1d14e94d85 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:45.483996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e872eedc-f69a-497c-95e0-7c1d14e94d85 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:45.484452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e872eedc-f69a-497c-95e0-7c1d14e94d85 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:45.520733 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e872eedc-f69a-497c-95e0-7c1d14e94d85 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056253 Aug 24 11:21:45.522174 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3803/7243] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:21:45 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:21:46.534904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d469da77-ad67-467a-9e12-a468f63dd5d3 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:46.537359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d469da77-ad67-467a-9e12-a468f63dd5d3 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:46.546126 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d469da77-ad67-467a-9e12-a468f63dd5d3 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:46.546616 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d469da77-ad67-467a-9e12-a468f63dd5d3 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:46.547056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d469da77-ad67-467a-9e12-a468f63dd5d3 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:46.547759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d469da77-ad67-467a-9e12-a468f63dd5d3 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:46.548212 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d469da77-ad67-467a-9e12-a468f63dd5d3 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:46.548638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d469da77-ad67-467a-9e12-a468f63dd5d3 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:46.578997 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d469da77-ad67-467a-9e12-a468f63dd5d3 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048575 Aug 24 11:21:46.579592 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3441/7244] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:21:46 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:21:47.592307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4b2ee7a0-2e08-43b6-aff9-c82b8792c1d6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:47.594539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4b2ee7a0-2e08-43b6-aff9-c82b8792c1d6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:47.601696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b2ee7a0-2e08-43b6-aff9-c82b8792c1d6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:47.602190 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b2ee7a0-2e08-43b6-aff9-c82b8792c1d6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:47.602618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b2ee7a0-2e08-43b6-aff9-c82b8792c1d6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:47.603336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b2ee7a0-2e08-43b6-aff9-c82b8792c1d6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:47.604028 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b2ee7a0-2e08-43b6-aff9-c82b8792c1d6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:47.604474 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b2ee7a0-2e08-43b6-aff9-c82b8792c1d6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:47.636552 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4b2ee7a0-2e08-43b6-aff9-c82b8792c1d6 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048228 Aug 24 11:21:47.637179 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3804/7245] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:21:47 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:21:48.652957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7ca301c8-76fa-4d24-9afd-70f4cb63f826 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:48.656517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7ca301c8-76fa-4d24-9afd-70f4cb63f826 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:48.669545 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ca301c8-76fa-4d24-9afd-70f4cb63f826 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:48.670358 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ca301c8-76fa-4d24-9afd-70f4cb63f826 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:48.671142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ca301c8-76fa-4d24-9afd-70f4cb63f826 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:48.672248 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ca301c8-76fa-4d24-9afd-70f4cb63f826 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:48.672977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ca301c8-76fa-4d24-9afd-70f4cb63f826 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:48.674172 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ca301c8-76fa-4d24-9afd-70f4cb63f826 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:48.716231 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7ca301c8-76fa-4d24-9afd-70f4cb63f826 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070169 Aug 24 11:21:48.716817 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3442/7246] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Aug 24 11:21:48 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:21:48.733032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fe589502-2dcb-46dc-afcb-ce12e27bc8f8 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:48.733588 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fe589502-2dcb-46dc-afcb-ce12e27bc8f8 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:48.741737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe589502-2dcb-46dc-afcb-ce12e27bc8f8 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:48.742242 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe589502-2dcb-46dc-afcb-ce12e27bc8f8 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:48.742700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe589502-2dcb-46dc-afcb-ce12e27bc8f8 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:48.743382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe589502-2dcb-46dc-afcb-ce12e27bc8f8 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:48.743881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe589502-2dcb-46dc-afcb-ce12e27bc8f8 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:48.744326 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe589502-2dcb-46dc-afcb-ce12e27bc8f8 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:48.823607 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-fe589502-2dcb-46dc-afcb-ce12e27bc8f8 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] HTTP exception thrown: Instance 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd is not attached to volume 205569d0-4478-4155-aaee-fa942fee85bb Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fe589502-2dcb-46dc-afcb-ce12e27bc8f8 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Request method failure captured: Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd/os-volume_attachments/205569d0-4478-4155-aaee-fa942fee85bb HTTP/1.1 Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBghg97lEA2gQIWUfNMzlK3V0EIIjk9mOBMW-vkv-koy1jQ3HkdlVCPwNKfJQFBtFe0q2buT_VSjq55s-sbMarsDwTdroFMIZJstc5ISrLMfitv1V3Q2fZcTlvJRx7JoOXH9Tu-5vTuCx1oe9w8KlW6LaOu1WIUQQVqFxUfCG-ER4mV4 Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: a00b24f5a0cd4a4c9681d5512fec24ed Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestMinimumBasicScenario-1553071017 Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a00b24f5a0cd4a4c9681d5512fec24ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_a00b24f5a0cd4a4c9681d5512fec24ed", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a00b24f5a0cd4a4c9681d5512fec24ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/a00b24f5a0cd4a4c9681d5512fec24ed"}]}] Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestMinimumBasicScenario-1553071017 Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: a00b24f5a0cd4a4c9681d5512fec24ed Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1553071017 Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestMinimumBasicScenario-1553071017-project Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 2fc9ed8a81f64078b05bfb981164d3a8 Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestMinimumBasicScenario-1553071017-project Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd is not attached to volume 205569d0-4478-4155-aaee-fa942fee85bb Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'server_id': '53e4f093-8ec8-4d7f-9541-33a2f4dad3cd', 'id': '205569d0-4478-4155-aaee-fa942fee85bb'} Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 205569d0-4478-4155-aaee-fa942fee85bb. Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd is not attached to volume 205569d0-4478-4155-aaee-fa942fee85bb Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:21:48.825312 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:21:48.831832 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:21:48.831832 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:21:48.831832 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd is not attached to volume 205569d0-4478-4155-aaee-fa942fee85bb Aug 24 11:21:48.831832 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:21:48.831832 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fe589502-2dcb-46dc-afcb-ce12e27bc8f8 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Returning 404 to user: Instance 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd is not attached to volume 205569d0-4478-4155-aaee-fa942fee85bb {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:21:48.831832 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fe589502-2dcb-46dc-afcb-ce12e27bc8f8 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "DELETE /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd/os-volume_attachments/205569d0-4478-4155-aaee-fa942fee85bb" status: 404 len: 154 microversion: 2.1 time: 0.100177 Aug 24 11:21:48.831832 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3805/7247] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Aug 24 11:21:48 2022] DELETE /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd/os-volume_attachments/205569d0-4478-4155-aaee-fa942fee85bb => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:21:52.089236 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f261e159-8dc9-455b-92e0-66cb111d8f83 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:52.089764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f261e159-8dc9-455b-92e0-66cb111d8f83 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:52.098839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f261e159-8dc9-455b-92e0-66cb111d8f83 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:52.099323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f261e159-8dc9-455b-92e0-66cb111d8f83 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:52.099754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f261e159-8dc9-455b-92e0-66cb111d8f83 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:52.100441 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f261e159-8dc9-455b-92e0-66cb111d8f83 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:52.100888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f261e159-8dc9-455b-92e0-66cb111d8f83 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:52.101358 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f261e159-8dc9-455b-92e0-66cb111d8f83 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:52.126852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f261e159-8dc9-455b-92e0-66cb111d8f83 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:21:52.219496 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f261e159-8dc9-455b-92e0-66cb111d8f83 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "DELETE /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 204 len: 0 microversion: 2.1 time: 0.131242 Aug 24 11:21:52.219496 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3443/7248] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:21:52 2022] DELETE /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:21:52.226719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2544c968-452f-443f-860c-85ce317e8091 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:52.227361 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2544c968-452f-443f-860c-85ce317e8091 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:52.234734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2544c968-452f-443f-860c-85ce317e8091 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:52.235237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2544c968-452f-443f-860c-85ce317e8091 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:52.235871 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2544c968-452f-443f-860c-85ce317e8091 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:52.236596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2544c968-452f-443f-860c-85ce317e8091 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:52.237086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2544c968-452f-443f-860c-85ce317e8091 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:52.237671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2544c968-452f-443f-860c-85ce317e8091 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:52.377226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2544c968-452f-443f-860c-85ce317e8091 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:21:52.385996 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2544c968-452f-443f-860c-85ce317e8091 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1554 microversion: 2.1 time: 0.163703 Aug 24 11:21:52.397384 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3806/7249] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:21:52 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:21:53.414496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1ff8812c-fc41-430c-8af2-a8f8d83ec78e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:53.415192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1ff8812c-fc41-430c-8af2-a8f8d83ec78e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:53.422423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ff8812c-fc41-430c-8af2-a8f8d83ec78e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:53.422948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ff8812c-fc41-430c-8af2-a8f8d83ec78e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:53.423417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ff8812c-fc41-430c-8af2-a8f8d83ec78e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:53.424160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ff8812c-fc41-430c-8af2-a8f8d83ec78e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:53.424617 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ff8812c-fc41-430c-8af2-a8f8d83ec78e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:53.425064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ff8812c-fc41-430c-8af2-a8f8d83ec78e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:53.572809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1ff8812c-fc41-430c-8af2-a8f8d83ec78e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:21:53.581876 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1ff8812c-fc41-430c-8af2-a8f8d83ec78e tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1554 microversion: 2.1 time: 0.171686 Aug 24 11:21:53.582491 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3444/7250] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:21:53 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:21:54.606068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f1581a8a-edae-4054-a1a9-2f88d69e3bea tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:54.606694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f1581a8a-edae-4054-a1a9-2f88d69e3bea tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:54.613574 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1581a8a-edae-4054-a1a9-2f88d69e3bea tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:54.614069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1581a8a-edae-4054-a1a9-2f88d69e3bea tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:54.614514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1581a8a-edae-4054-a1a9-2f88d69e3bea tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:54.615204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1581a8a-edae-4054-a1a9-2f88d69e3bea tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:54.615691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1581a8a-edae-4054-a1a9-2f88d69e3bea tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:54.616101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1581a8a-edae-4054-a1a9-2f88d69e3bea tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:54.756717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f1581a8a-edae-4054-a1a9-2f88d69e3bea tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc9ed8a81f64078b05bfb981164d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00b24f5a0cd4a4c9681d5512fec24ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:21:54.764740 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f1581a8a-edae-4054-a1a9-2f88d69e3bea tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 200 len: 1554 microversion: 2.1 time: 0.162905 Aug 24 11:21:54.765545 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3807/7251] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:21:54 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:21:55.142425 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-81ea3409-bf3e-4ef9-94b5-850409d8e79b req-3329b7c8-3b69-4639-8396-f403bc8f33f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53e4f093-8ec8-4d7f-9541-33a2f4dad3cd", "name": "network-vif-deleted", "tag": "70cce2ae-f2bb-4cd7-b8b3-6c14fbc60060"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:21:55.160501 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-81ea3409-bf3e-4ef9-94b5-850409d8e79b req-3329b7c8-3b69-4639-8396-f403bc8f33f3 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:55.161142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-81ea3409-bf3e-4ef9-94b5-850409d8e79b req-3329b7c8-3b69-4639-8396-f403bc8f33f3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:55.161596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-81ea3409-bf3e-4ef9-94b5-850409d8e79b req-3329b7c8-3b69-4639-8396-f403bc8f33f3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:55.173941 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-81ea3409-bf3e-4ef9-94b5-850409d8e79b req-3329b7c8-3b69-4639-8396-f403bc8f33f3 service nova] Creating event network-vif-deleted:70cce2ae-f2bb-4cd7-b8b3-6c14fbc60060 for instance 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd on n-h2-849328-3 Aug 24 11:21:55.179265 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-81ea3409-bf3e-4ef9-94b5-850409d8e79b req-3329b7c8-3b69-4639-8396-f403bc8f33f3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040831 Aug 24 11:21:55.180472 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3445/7252] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:21:55.787531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6fe0e6d7-29fb-415a-b911-6598c49833f9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:55.788100 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6fe0e6d7-29fb-415a-b911-6598c49833f9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] [instance: 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:55.795595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fe0e6d7-29fb-415a-b911-6598c49833f9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:55.796098 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fe0e6d7-29fb-415a-b911-6598c49833f9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:55.796550 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fe0e6d7-29fb-415a-b911-6598c49833f9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:55.797293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fe0e6d7-29fb-415a-b911-6598c49833f9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:55.797785 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fe0e6d7-29fb-415a-b911-6598c49833f9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:55.798223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fe0e6d7-29fb-415a-b911-6598c49833f9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:55.812528 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-6fe0e6d7-29fb-415a-b911-6598c49833f9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] HTTP exception thrown: Instance 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd could not be found. Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6fe0e6d7-29fb-415a-b911-6598c49833f9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Request method failure captured: Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd HTTP/1.1 Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBghg97lEA2gQIWUfNMzlK3V0EIIjk9mOBMW-vkv-koy1jQ3HkdlVCPwNKfJQFBtFe0q2buT_VSjq55s-sbMarsDwTdroFMIZJstc5ISrLMfitv1V3Q2fZcTlvJRx7JoOXH9Tu-5vTuCx1oe9w8KlW6LaOu1WIUQQVqFxUfCG-ER4mV4 Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: a00b24f5a0cd4a4c9681d5512fec24ed Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestMinimumBasicScenario-1553071017 Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a00b24f5a0cd4a4c9681d5512fec24ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_a00b24f5a0cd4a4c9681d5512fec24ed", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a00b24f5a0cd4a4c9681d5512fec24ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/a00b24f5a0cd4a4c9681d5512fec24ed"}]}] Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestMinimumBasicScenario-1553071017 Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: a00b24f5a0cd4a4c9681d5512fec24ed Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1553071017 Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestMinimumBasicScenario-1553071017-project Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: 2fc9ed8a81f64078b05bfb981164d3a8 Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestMinimumBasicScenario-1553071017-project Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd could not be found. Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '53e4f093-8ec8-4d7f-9541-33a2f4dad3cd'} Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd could not be found. Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd could not be found. Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:21:55.814222 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:21:55.818309 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:21:55.818309 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:21:55.818309 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:21:55.818309 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:21:55.818309 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:21:55.818309 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd could not be found. Aug 24 11:21:55.818309 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:21:55.818309 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6fe0e6d7-29fb-415a-b911-6598c49833f9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Returning 404 to user: Instance 53e4f093-8ec8-4d7f-9541-33a2f4dad3cd could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:21:55.818309 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6fe0e6d7-29fb-415a-b911-6598c49833f9 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd" status: 404 len: 111 microversion: 2.1 time: 0.032355 Aug 24 11:21:55.818309 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3808/7253] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:21:55 2022] GET /compute/v2.1/servers/53e4f093-8ec8-4d7f-9541-33a2f4dad3cd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:21:55.825181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ec06bd33-e953-409f-b8c5-d2c3d61e4dc2 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] Calling method '.version_select at 0x7f465a2d19d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:55.848565 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ec06bd33-e953-409f-b8c5-d2c3d61e4dc2 tempest-TestMinimumBasicScenario-1553071017 tempest-TestMinimumBasicScenario-1553071017-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1747033762" status: 202 len: 0 microversion: 2.1 time: 0.027472 Aug 24 11:21:55.849324 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3446/7254] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Aug 24 11:21:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1747033762 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:22:05.133929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bf2b5b5a-2470-44e4-ad72-86cca1fe8dab tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'create', calling method: .version_select at 0x7f464798ab80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-12436498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsD90A4QEwvRhWhCmzw2j7n6LjcHecI48elhX692/tdd8xxDULffIEwCr9HhJLWQZeD92uBt4rZqpoCMfcjq1CJB2Igz7Wj448nTiDYt7X/qfLfoOF9C6FASIAubQJHCA=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:22:05.153255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-bf2b5b5a-2470-44e4-ad72-86cca1fe8dab tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Getting quotas for project 36574fcb42ea44ca970b5bfa9697af8c. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:22:05.159999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-bf2b5b5a-2470-44e4-ad72-86cca1fe8dab tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Getting quotas for user ab7f1eb7298e4cad86ad953eac53c9c3 and project 36574fcb42ea44ca970b5bfa9697af8c. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:22:05.188494 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bf2b5b5a-2470-44e4-ad72-86cca1fe8dab tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.227751 Aug 24 11:22:05.189103 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3809/7255] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 11:22:04 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:22:11.422921 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:11.423815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:11.428302 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fb4b7683-7203-4d1c-832d-0c97bcbe4182 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-197748342", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "523ad373-8edd-4bf7-b0d8-b0041344af75"}], "key_name": "tempest-TestNetworkAdvancedServerOps-12436498", "security_groups": [{"name": "tempest-secgroup-smoke-2111751010"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:22:11.562826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-fb4b7683-7203-4d1c-832d-0c97bcbe4182 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] validate_networks() for [('523ad373-8edd-4bf7-b0d8-b0041344af75', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:22:12.023910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fb4b7683-7203-4d1c-832d-0c97bcbe4182 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:22:12.024417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fb4b7683-7203-4d1c-832d-0c97bcbe4182 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:22:12.024965 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fb4b7683-7203-4d1c-832d-0c97bcbe4182 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:22:12.025481 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fb4b7683-7203-4d1c-832d-0c97bcbe4182 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:22:12.025968 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fb4b7683-7203-4d1c-832d-0c97bcbe4182 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:22:12.039883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb4b7683-7203-4d1c-832d-0c97bcbe4182 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:12.040480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb4b7683-7203-4d1c-832d-0c97bcbe4182 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:12.041228 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb4b7683-7203-4d1c-832d-0c97bcbe4182 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:12.042200 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb4b7683-7203-4d1c-832d-0c97bcbe4182 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:12.042872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb4b7683-7203-4d1c-832d-0c97bcbe4182 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:12.043524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb4b7683-7203-4d1c-832d-0c97bcbe4182 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:12.076108 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-fb4b7683-7203-4d1c-832d-0c97bcbe4182 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Getting quotas for project 36574fcb42ea44ca970b5bfa9697af8c. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:22:12.086253 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-fb4b7683-7203-4d1c-832d-0c97bcbe4182 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Getting quotas for user ab7f1eb7298e4cad86ad953eac53c9c3 and project 36574fcb42ea44ca970b5bfa9697af8c. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:22:12.107079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fb4b7683-7203-4d1c-832d-0c97bcbe4182 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:22:12.110354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fb4b7683-7203-4d1c-832d-0c97bcbe4182 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 9459a821-b751-4677-9187-a99992840895] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:22:12.174466 n-d-849328-3 devstack@n-api.service[122432]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fb4b7683-7203-4d1c-832d-0c97bcbe4182 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [71362138-cca8-4714-a2e3-8ecfd2f426c3] AMQP server on 10.222.0.85:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 11:22:13.189095 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [None req-fb4b7683-7203-4d1c-832d-0c97bcbe4182 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [71362138-cca8-4714-a2e3-8ecfd2f426c3] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 56628. Aug 24 11:22:13.194535 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fb4b7683-7203-4d1c-832d-0c97bcbe4182 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.773575 Aug 24 11:22:13.195849 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3447/7256] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 11:22:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:22:13.206924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c208dc6d-c6c4-4e87-a21d-61fc9afc4193 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:13.207523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c208dc6d-c6c4-4e87-a21d-61fc9afc4193 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 9459a821-b751-4677-9187-a99992840895] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:13.211943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=42 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:13.215394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:13.276828 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c208dc6d-c6c4-4e87-a21d-61fc9afc4193 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:13.285384 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c208dc6d-c6c4-4e87-a21d-61fc9afc4193 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895" status: 200 len: 1264 microversion: 2.1 time: 0.082390 Aug 24 11:22:13.286159 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3810/7257] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:13 2022] GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895 => generated 1264 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:22:14.323054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-02d3321a-056a-4140-80a4-fca0d82272dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:14.323746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-02d3321a-056a-4140-80a4-fca0d82272dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 9459a821-b751-4677-9187-a99992840895] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:14.330624 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02d3321a-056a-4140-80a4-fca0d82272dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:14.331124 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02d3321a-056a-4140-80a4-fca0d82272dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:14.331559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02d3321a-056a-4140-80a4-fca0d82272dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:14.332332 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02d3321a-056a-4140-80a4-fca0d82272dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:14.332727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02d3321a-056a-4140-80a4-fca0d82272dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:14.333269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02d3321a-056a-4140-80a4-fca0d82272dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:14.405619 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-02d3321a-056a-4140-80a4-fca0d82272dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:14.414809 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-02d3321a-056a-4140-80a4-fca0d82272dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895" status: 200 len: 1316 microversion: 2.1 time: 0.096937 Aug 24 11:22:14.415524 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3448/7258] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:14 2022] GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895 => generated 1316 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:22:15.436224 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1d81db43-d062-4fb3-8f2d-396cfae49806 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:15.437018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1d81db43-d062-4fb3-8f2d-396cfae49806 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 9459a821-b751-4677-9187-a99992840895] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:15.445349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d81db43-d062-4fb3-8f2d-396cfae49806 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:15.445846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d81db43-d062-4fb3-8f2d-396cfae49806 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:15.446290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d81db43-d062-4fb3-8f2d-396cfae49806 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:15.447023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d81db43-d062-4fb3-8f2d-396cfae49806 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:15.447491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d81db43-d062-4fb3-8f2d-396cfae49806 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:15.447911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d81db43-d062-4fb3-8f2d-396cfae49806 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:15.607932 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1d81db43-d062-4fb3-8f2d-396cfae49806 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:15.616815 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1d81db43-d062-4fb3-8f2d-396cfae49806 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895" status: 200 len: 1390 microversion: 2.1 time: 0.184569 Aug 24 11:22:15.617783 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3811/7259] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:15 2022] GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895 => generated 1390 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:22:16.182490 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3ad9aa80-f50b-479f-975d-0cc6234b7fdf req-48d13aa8-c6ec-4cbb-a247-44f1d1d6d590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9459a821-b751-4677-9187-a99992840895", "tag": "069fda77-917d-44bd-b425-69a13c2fcd37"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:22:16.198768 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3ad9aa80-f50b-479f-975d-0cc6234b7fdf req-48d13aa8-c6ec-4cbb-a247-44f1d1d6d590 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:16.199955 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3ad9aa80-f50b-479f-975d-0cc6234b7fdf req-48d13aa8-c6ec-4cbb-a247-44f1d1d6d590 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:16.200399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3ad9aa80-f50b-479f-975d-0cc6234b7fdf req-48d13aa8-c6ec-4cbb-a247-44f1d1d6d590 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:16.212119 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3ad9aa80-f50b-479f-975d-0cc6234b7fdf req-48d13aa8-c6ec-4cbb-a247-44f1d1d6d590 service nova] Creating event network-changed:069fda77-917d-44bd-b425-69a13c2fcd37 for instance 9459a821-b751-4677-9187-a99992840895 on n-h1-849328-3 Aug 24 11:22:16.217588 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3ad9aa80-f50b-479f-975d-0cc6234b7fdf req-48d13aa8-c6ec-4cbb-a247-44f1d1d6d590 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040884 Aug 24 11:22:16.218238 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3449/7260] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:22:16.638903 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-095b12dc-2a31-4e77-a398-509cafef0938 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:16.639605 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-095b12dc-2a31-4e77-a398-509cafef0938 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 9459a821-b751-4677-9187-a99992840895] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:16.646731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-095b12dc-2a31-4e77-a398-509cafef0938 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:16.647234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-095b12dc-2a31-4e77-a398-509cafef0938 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:16.647683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-095b12dc-2a31-4e77-a398-509cafef0938 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:16.648385 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-095b12dc-2a31-4e77-a398-509cafef0938 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:16.648954 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-095b12dc-2a31-4e77-a398-509cafef0938 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:16.649427 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-095b12dc-2a31-4e77-a398-509cafef0938 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:16.787497 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-095b12dc-2a31-4e77-a398-509cafef0938 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:16.795923 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-095b12dc-2a31-4e77-a398-509cafef0938 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895" status: 200 len: 1390 microversion: 2.1 time: 0.161183 Aug 24 11:22:16.796434 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3812/7261] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:16 2022] GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895 => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:22:17.818027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0287b3bc-602a-4b56-a819-35874f47b7ff tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:17.818599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0287b3bc-602a-4b56-a819-35874f47b7ff tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 9459a821-b751-4677-9187-a99992840895] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:17.825275 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0287b3bc-602a-4b56-a819-35874f47b7ff tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:17.825743 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0287b3bc-602a-4b56-a819-35874f47b7ff tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:17.826250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0287b3bc-602a-4b56-a819-35874f47b7ff tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:17.826940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0287b3bc-602a-4b56-a819-35874f47b7ff tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:17.827394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0287b3bc-602a-4b56-a819-35874f47b7ff tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:17.827822 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0287b3bc-602a-4b56-a819-35874f47b7ff tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:18.051382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0287b3bc-602a-4b56-a819-35874f47b7ff tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:18.061694 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0287b3bc-602a-4b56-a819-35874f47b7ff tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895" status: 200 len: 1390 microversion: 2.1 time: 0.249167 Aug 24 11:22:18.062325 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3450/7262] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:17 2022] GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895 => generated 1390 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:22:19.087510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bcb8ef56-1a4d-4545-9d88-6bdcae2eed7e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:19.088059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bcb8ef56-1a4d-4545-9d88-6bdcae2eed7e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 9459a821-b751-4677-9187-a99992840895] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:19.095181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcb8ef56-1a4d-4545-9d88-6bdcae2eed7e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:19.095683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcb8ef56-1a4d-4545-9d88-6bdcae2eed7e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:19.096134 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcb8ef56-1a4d-4545-9d88-6bdcae2eed7e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:19.096843 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcb8ef56-1a4d-4545-9d88-6bdcae2eed7e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:19.097344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcb8ef56-1a4d-4545-9d88-6bdcae2eed7e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:19.097782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcb8ef56-1a4d-4545-9d88-6bdcae2eed7e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:19.234369 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bcb8ef56-1a4d-4545-9d88-6bdcae2eed7e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:19.242446 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bcb8ef56-1a4d-4545-9d88-6bdcae2eed7e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895" status: 200 len: 1390 microversion: 2.1 time: 0.159340 Aug 24 11:22:19.243032 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3813/7263] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:19 2022] GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:22:20.264048 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dffbf7d2-651c-49cb-a0c8-6d8bc4ebeb2f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:20.264731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dffbf7d2-651c-49cb-a0c8-6d8bc4ebeb2f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 9459a821-b751-4677-9187-a99992840895] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:20.273316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dffbf7d2-651c-49cb-a0c8-6d8bc4ebeb2f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:20.273882 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dffbf7d2-651c-49cb-a0c8-6d8bc4ebeb2f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:20.274390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dffbf7d2-651c-49cb-a0c8-6d8bc4ebeb2f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:20.275198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dffbf7d2-651c-49cb-a0c8-6d8bc4ebeb2f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:20.276480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dffbf7d2-651c-49cb-a0c8-6d8bc4ebeb2f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:20.277294 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dffbf7d2-651c-49cb-a0c8-6d8bc4ebeb2f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:20.422383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dffbf7d2-651c-49cb-a0c8-6d8bc4ebeb2f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:20.430617 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dffbf7d2-651c-49cb-a0c8-6d8bc4ebeb2f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895" status: 200 len: 1390 microversion: 2.1 time: 0.171216 Aug 24 11:22:20.431275 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3451/7264] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:20 2022] GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895 => generated 1390 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:22:21.454315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-63fa37c4-af4c-4d12-b414-b98f9410295f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:21.454979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-63fa37c4-af4c-4d12-b414-b98f9410295f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 9459a821-b751-4677-9187-a99992840895] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:21.462566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63fa37c4-af4c-4d12-b414-b98f9410295f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:21.463076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63fa37c4-af4c-4d12-b414-b98f9410295f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:21.463522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63fa37c4-af4c-4d12-b414-b98f9410295f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:21.464238 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63fa37c4-af4c-4d12-b414-b98f9410295f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:21.464714 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63fa37c4-af4c-4d12-b414-b98f9410295f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:21.465159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63fa37c4-af4c-4d12-b414-b98f9410295f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:21.612032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-63fa37c4-af4c-4d12-b414-b98f9410295f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:21.623977 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-63fa37c4-af4c-4d12-b414-b98f9410295f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895" status: 200 len: 1390 microversion: 2.1 time: 0.174235 Aug 24 11:22:21.624798 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3814/7265] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:21 2022] GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895 => generated 1390 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:22:22.579910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:22.580672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:22.641523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-98e7473c-6e48-4532-ad0b-62c17b1ab0c5 req-b197847c-2441-41f9-bf6b-c102e34da1cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9459a821-b751-4677-9187-a99992840895", "name": "network-vif-plugged", "status": "completed", "tag": "069fda77-917d-44bd-b425-69a13c2fcd37"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:22:22.650764 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-785e39a4-aa9a-4c29-9028-9604fa470038 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:22.651257 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-98e7473c-6e48-4532-ad0b-62c17b1ab0c5 req-b197847c-2441-41f9-bf6b-c102e34da1cb service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:22.651764 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-98e7473c-6e48-4532-ad0b-62c17b1ab0c5 req-b197847c-2441-41f9-bf6b-c102e34da1cb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:22.652080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-785e39a4-aa9a-4c29-9028-9604fa470038 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 9459a821-b751-4677-9187-a99992840895] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:22.652196 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-98e7473c-6e48-4532-ad0b-62c17b1ab0c5 req-b197847c-2441-41f9-bf6b-c102e34da1cb service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:22.659732 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-785e39a4-aa9a-4c29-9028-9604fa470038 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:22.660455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-785e39a4-aa9a-4c29-9028-9604fa470038 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:22.660686 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-785e39a4-aa9a-4c29-9028-9604fa470038 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:22.661430 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-785e39a4-aa9a-4c29-9028-9604fa470038 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:22.661913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-785e39a4-aa9a-4c29-9028-9604fa470038 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:22.662393 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-785e39a4-aa9a-4c29-9028-9604fa470038 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:22.664588 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-98e7473c-6e48-4532-ad0b-62c17b1ab0c5 req-b197847c-2441-41f9-bf6b-c102e34da1cb service nova] Creating event network-vif-plugged:069fda77-917d-44bd-b425-69a13c2fcd37 for instance 9459a821-b751-4677-9187-a99992840895 on n-h1-849328-3 Aug 24 11:22:22.669800 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-98e7473c-6e48-4532-ad0b-62c17b1ab0c5 req-b197847c-2441-41f9-bf6b-c102e34da1cb service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095253 Aug 24 11:22:22.670415 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3452/7266] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:22:22.798819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-785e39a4-aa9a-4c29-9028-9604fa470038 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:22.806665 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-785e39a4-aa9a-4c29-9028-9604fa470038 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895" status: 200 len: 1390 microversion: 2.1 time: 0.165461 Aug 24 11:22:22.807733 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3815/7267] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:22 2022] GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895 => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:22:23.832605 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eddac737-a59e-43fd-8f7a-8254b3a743c6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:23.833356 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eddac737-a59e-43fd-8f7a-8254b3a743c6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 9459a821-b751-4677-9187-a99992840895] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:23.840146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eddac737-a59e-43fd-8f7a-8254b3a743c6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:23.840636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eddac737-a59e-43fd-8f7a-8254b3a743c6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:23.841080 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eddac737-a59e-43fd-8f7a-8254b3a743c6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:23.841803 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eddac737-a59e-43fd-8f7a-8254b3a743c6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:23.842261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eddac737-a59e-43fd-8f7a-8254b3a743c6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:23.842695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eddac737-a59e-43fd-8f7a-8254b3a743c6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:23.993214 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eddac737-a59e-43fd-8f7a-8254b3a743c6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:24.005086 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eddac737-a59e-43fd-8f7a-8254b3a743c6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895" status: 200 len: 1561 microversion: 2.1 time: 0.179108 Aug 24 11:22:24.005745 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3453/7268] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:23 2022] GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895 => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:22:24.028757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e60301f9-a095-4461-b947-d74090ed08ba tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:24.029360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e60301f9-a095-4461-b947-d74090ed08ba tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 9459a821-b751-4677-9187-a99992840895] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:24.031272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:24.037868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e60301f9-a095-4461-b947-d74090ed08ba tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:24.038342 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e60301f9-a095-4461-b947-d74090ed08ba tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:24.038797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e60301f9-a095-4461-b947-d74090ed08ba tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:24.039496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e60301f9-a095-4461-b947-d74090ed08ba tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:24.039988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e60301f9-a095-4461-b947-d74090ed08ba tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:24.040417 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e60301f9-a095-4461-b947-d74090ed08ba tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:24.176029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e60301f9-a095-4461-b947-d74090ed08ba tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:24.183932 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e60301f9-a095-4461-b947-d74090ed08ba tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895" status: 200 len: 1561 microversion: 2.1 time: 0.159837 Aug 24 11:22:24.184489 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3816/7269] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:24 2022] GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:22:25.825093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-359dfc8e-b50d-4052-a5c6-7c700f63a841 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:25.825760 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-359dfc8e-b50d-4052-a5c6-7c700f63a841 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 9459a821-b751-4677-9187-a99992840895] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:25.827435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0b6271ba-8475-4a8a-95e8-6f8f0407d5ff req-ad367343-087b-4116-9669-a4e5304b710f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9459a821-b751-4677-9187-a99992840895", "tag": "069fda77-917d-44bd-b425-69a13c2fcd37"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:22:25.838382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0b6271ba-8475-4a8a-95e8-6f8f0407d5ff req-ad367343-087b-4116-9669-a4e5304b710f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:25.838800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0b6271ba-8475-4a8a-95e8-6f8f0407d5ff req-ad367343-087b-4116-9669-a4e5304b710f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:25.839276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0b6271ba-8475-4a8a-95e8-6f8f0407d5ff req-ad367343-087b-4116-9669-a4e5304b710f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:25.842668 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-359dfc8e-b50d-4052-a5c6-7c700f63a841 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:25.843269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-359dfc8e-b50d-4052-a5c6-7c700f63a841 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:25.843707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-359dfc8e-b50d-4052-a5c6-7c700f63a841 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:25.844542 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-359dfc8e-b50d-4052-a5c6-7c700f63a841 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:25.844997 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-359dfc8e-b50d-4052-a5c6-7c700f63a841 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:25.845550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-359dfc8e-b50d-4052-a5c6-7c700f63a841 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:25.852510 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0b6271ba-8475-4a8a-95e8-6f8f0407d5ff req-ad367343-087b-4116-9669-a4e5304b710f service nova] Creating event network-changed:069fda77-917d-44bd-b425-69a13c2fcd37 for instance 9459a821-b751-4677-9187-a99992840895 on n-h1-849328-3 Aug 24 11:22:25.858411 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0b6271ba-8475-4a8a-95e8-6f8f0407d5ff req-ad367343-087b-4116-9669-a4e5304b710f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034552 Aug 24 11:22:25.859288 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3817/7270] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:22:26.084443 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-359dfc8e-b50d-4052-a5c6-7c700f63a841 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:26.092533 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-359dfc8e-b50d-4052-a5c6-7c700f63a841 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895" status: 200 len: 1561 microversion: 2.1 time: 0.271239 Aug 24 11:22:26.093047 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3454/7271] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:25 2022] GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895 => generated 1561 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:22:37.404115 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:22:37.404922 n-d-849328-3 devstack@n-api.service[122433]: Wed Aug 24 11:22:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:22:49.425041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=17 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:49.425859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=38 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:49.430298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8c9479c0-47fb-46df-9941-d557af602465 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:22:49.432567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8c9479c0-47fb-46df-9941-d557af602465 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 9459a821-b751-4677-9187-a99992840895] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:49.439595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c9479c0-47fb-46df-9941-d557af602465 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:49.440088 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c9479c0-47fb-46df-9941-d557af602465 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:49.440532 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c9479c0-47fb-46df-9941-d557af602465 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:49.441254 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c9479c0-47fb-46df-9941-d557af602465 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:49.441719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c9479c0-47fb-46df-9941-d557af602465 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:49.442152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c9479c0-47fb-46df-9941-d557af602465 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:49.512706 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8c9479c0-47fb-46df-9941-d557af602465 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895/action" status: 200 len: 24565 microversion: 2.1 time: 0.089391 Aug 24 11:22:49.513427 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3818/7272] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:22:49 2022] POST /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895/action => generated 24565 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:22:55.809412 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-30b69b69-2782-441e-be9c-be678dcf4802 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:22:55.810114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-30b69b69-2782-441e-be9c-be678dcf4802 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 9459a821-b751-4677-9187-a99992840895] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:55.812885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:55.813998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=36 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:55.820391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30b69b69-2782-441e-be9c-be678dcf4802 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:55.820910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30b69b69-2782-441e-be9c-be678dcf4802 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:55.821383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30b69b69-2782-441e-be9c-be678dcf4802 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:55.822105 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30b69b69-2782-441e-be9c-be678dcf4802 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:55.822560 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30b69b69-2782-441e-be9c-be678dcf4802 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:55.822986 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30b69b69-2782-441e-be9c-be678dcf4802 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:55.895600 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-30b69b69-2782-441e-be9c-be678dcf4802 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895/action" status: 202 len: 0 microversion: 2.1 time: 0.091438 Aug 24 11:22:55.896490 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3455/7273] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:22:55 2022] POST /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:22:55.906496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5563f3c1-84a4-486f-99c8-515c7497b6b7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:55.907608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5563f3c1-84a4-486f-99c8-515c7497b6b7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 9459a821-b751-4677-9187-a99992840895] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:55.916789 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5563f3c1-84a4-486f-99c8-515c7497b6b7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:55.917634 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5563f3c1-84a4-486f-99c8-515c7497b6b7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:55.918555 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5563f3c1-84a4-486f-99c8-515c7497b6b7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:55.919443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5563f3c1-84a4-486f-99c8-515c7497b6b7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:55.920191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5563f3c1-84a4-486f-99c8-515c7497b6b7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:55.920951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5563f3c1-84a4-486f-99c8-515c7497b6b7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:56.076490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5563f3c1-84a4-486f-99c8-515c7497b6b7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:56.084651 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5563f3c1-84a4-486f-99c8-515c7497b6b7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895" status: 200 len: 1684 microversion: 2.1 time: 0.182791 Aug 24 11:22:56.085232 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3819/7274] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:55 2022] GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895 => generated 1684 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:22:57.111602 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bae48a4b-9a7d-4bf7-8c12-861e995c79d9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:57.112817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bae48a4b-9a7d-4bf7-8c12-861e995c79d9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 9459a821-b751-4677-9187-a99992840895] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:57.124473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bae48a4b-9a7d-4bf7-8c12-861e995c79d9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:57.124929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bae48a4b-9a7d-4bf7-8c12-861e995c79d9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:57.125424 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bae48a4b-9a7d-4bf7-8c12-861e995c79d9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:57.126115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bae48a4b-9a7d-4bf7-8c12-861e995c79d9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:57.126599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bae48a4b-9a7d-4bf7-8c12-861e995c79d9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:57.127026 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bae48a4b-9a7d-4bf7-8c12-861e995c79d9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:57.266411 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bae48a4b-9a7d-4bf7-8c12-861e995c79d9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:57.274769 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bae48a4b-9a7d-4bf7-8c12-861e995c79d9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895" status: 200 len: 1664 microversion: 2.1 time: 0.170549 Aug 24 11:22:57.275707 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3456/7275] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:57 2022] GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895 => generated 1664 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:22:58.376756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ed770947-ef95-4c3f-9948-f43cbe68e8ea tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:22:58.379173 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ed770947-ef95-4c3f-9948-f43cbe68e8ea tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 9459a821-b751-4677-9187-a99992840895] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:58.387274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed770947-ef95-4c3f-9948-f43cbe68e8ea tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:58.387771 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed770947-ef95-4c3f-9948-f43cbe68e8ea tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:58.388218 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed770947-ef95-4c3f-9948-f43cbe68e8ea tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:58.389041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed770947-ef95-4c3f-9948-f43cbe68e8ea tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:58.389539 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed770947-ef95-4c3f-9948-f43cbe68e8ea tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:58.389981 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed770947-ef95-4c3f-9948-f43cbe68e8ea tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:58.464128 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ed770947-ef95-4c3f-9948-f43cbe68e8ea tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895/action" status: 200 len: 32635 microversion: 2.1 time: 0.091188 Aug 24 11:22:58.465090 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3820/7276] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:22:58 2022] POST /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895/action => generated 32635 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:22:58.476708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9122a9df-4d87-405e-88c0-c08ff0bdde84 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:22:58.477300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9122a9df-4d87-405e-88c0-c08ff0bdde84 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 9459a821-b751-4677-9187-a99992840895] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:58.484547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9122a9df-4d87-405e-88c0-c08ff0bdde84 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:58.485044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9122a9df-4d87-405e-88c0-c08ff0bdde84 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:58.485535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9122a9df-4d87-405e-88c0-c08ff0bdde84 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:58.486237 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9122a9df-4d87-405e-88c0-c08ff0bdde84 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:58.486694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9122a9df-4d87-405e-88c0-c08ff0bdde84 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:58.487123 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9122a9df-4d87-405e-88c0-c08ff0bdde84 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:58.565634 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9122a9df-4d87-405e-88c0-c08ff0bdde84 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895/action" status: 202 len: 0 microversion: 2.1 time: 0.092733 Aug 24 11:22:58.569284 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3457/7277] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:22:58 2022] POST /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:22:58.575723 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d85a53d3-2bfa-4af5-bd01-d1afb0df0313 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:58.576583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d85a53d3-2bfa-4af5-bd01-d1afb0df0313 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 9459a821-b751-4677-9187-a99992840895] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:58.584056 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d85a53d3-2bfa-4af5-bd01-d1afb0df0313 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:58.584570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d85a53d3-2bfa-4af5-bd01-d1afb0df0313 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:58.585006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d85a53d3-2bfa-4af5-bd01-d1afb0df0313 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:58.585762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d85a53d3-2bfa-4af5-bd01-d1afb0df0313 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:58.586516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d85a53d3-2bfa-4af5-bd01-d1afb0df0313 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:58.586647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d85a53d3-2bfa-4af5-bd01-d1afb0df0313 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:58.727489 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d85a53d3-2bfa-4af5-bd01-d1afb0df0313 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:58.735429 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d85a53d3-2bfa-4af5-bd01-d1afb0df0313 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895" status: 200 len: 1671 microversion: 2.1 time: 0.164064 Aug 24 11:22:58.735982 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3821/7278] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:58 2022] GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895 => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:22:59.758505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9158e03f-93ac-40d8-a6a0-2c5830811012 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:59.759299 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9158e03f-93ac-40d8-a6a0-2c5830811012 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 9459a821-b751-4677-9187-a99992840895] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:59.765784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9158e03f-93ac-40d8-a6a0-2c5830811012 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:59.766247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9158e03f-93ac-40d8-a6a0-2c5830811012 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:59.766687 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9158e03f-93ac-40d8-a6a0-2c5830811012 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:59.767376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9158e03f-93ac-40d8-a6a0-2c5830811012 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:59.767831 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9158e03f-93ac-40d8-a6a0-2c5830811012 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:59.768295 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9158e03f-93ac-40d8-a6a0-2c5830811012 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:59.912006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9158e03f-93ac-40d8-a6a0-2c5830811012 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:59.923053 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9158e03f-93ac-40d8-a6a0-2c5830811012 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895" status: 200 len: 1679 microversion: 2.1 time: 0.169748 Aug 24 11:22:59.923660 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3458/7279] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:59 2022] GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:00.026541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f2eb4954-4577-4c42-b4f7-9d3bfda06f8d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:23:00.029651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f2eb4954-4577-4c42-b4f7-9d3bfda06f8d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 9459a821-b751-4677-9187-a99992840895] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:00.038120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2eb4954-4577-4c42-b4f7-9d3bfda06f8d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:00.038657 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2eb4954-4577-4c42-b4f7-9d3bfda06f8d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:00.039142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2eb4954-4577-4c42-b4f7-9d3bfda06f8d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:00.039855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2eb4954-4577-4c42-b4f7-9d3bfda06f8d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:00.040354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2eb4954-4577-4c42-b4f7-9d3bfda06f8d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:00.040913 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2eb4954-4577-4c42-b4f7-9d3bfda06f8d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:00.103815 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f2eb4954-4577-4c42-b4f7-9d3bfda06f8d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895/action" status: 200 len: 35569 microversion: 2.1 time: 0.083437 Aug 24 11:23:00.104490 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3822/7280] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:23:00 2022] POST /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895/action => generated 35569 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:23:01.118645 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dee580b1-7b0a-4558-a044-cb1819aeb3c6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:01.119156 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dee580b1-7b0a-4558-a044-cb1819aeb3c6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 9459a821-b751-4677-9187-a99992840895] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:01.121682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8dc7d9bc-8e06-45e2-90df-cf6c51003f84 req-34973be5-b1bb-4ba0-bb88-4fd6d31147ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9459a821-b751-4677-9187-a99992840895", "tag": "069fda77-917d-44bd-b425-69a13c2fcd37"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:23:01.128840 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dee580b1-7b0a-4558-a044-cb1819aeb3c6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:01.129381 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dee580b1-7b0a-4558-a044-cb1819aeb3c6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:01.129835 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dee580b1-7b0a-4558-a044-cb1819aeb3c6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:01.130561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dee580b1-7b0a-4558-a044-cb1819aeb3c6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:01.131022 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dee580b1-7b0a-4558-a044-cb1819aeb3c6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:01.131454 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dee580b1-7b0a-4558-a044-cb1819aeb3c6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:01.137321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8dc7d9bc-8e06-45e2-90df-cf6c51003f84 req-34973be5-b1bb-4ba0-bb88-4fd6d31147ec service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:01.137888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8dc7d9bc-8e06-45e2-90df-cf6c51003f84 req-34973be5-b1bb-4ba0-bb88-4fd6d31147ec service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:01.138767 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8dc7d9bc-8e06-45e2-90df-cf6c51003f84 req-34973be5-b1bb-4ba0-bb88-4fd6d31147ec service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:01.151578 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8dc7d9bc-8e06-45e2-90df-cf6c51003f84 req-34973be5-b1bb-4ba0-bb88-4fd6d31147ec service nova] Creating event network-changed:069fda77-917d-44bd-b425-69a13c2fcd37 for instance 9459a821-b751-4677-9187-a99992840895 on n-h1-849328-3 Aug 24 11:23:01.157884 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8dc7d9bc-8e06-45e2-90df-cf6c51003f84 req-34973be5-b1bb-4ba0-bb88-4fd6d31147ec service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040147 Aug 24 11:23:01.158861 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3823/7281] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:23:01.159000 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dee580b1-7b0a-4558-a044-cb1819aeb3c6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 9459a821-b751-4677-9187-a99992840895] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:23:01.251220 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dee580b1-7b0a-4558-a044-cb1819aeb3c6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "DELETE /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895" status: 204 len: 0 microversion: 2.1 time: 0.135451 Aug 24 11:23:01.252897 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3459/7282] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:23:01 2022] DELETE /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:23:01.263749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-60586f66-4535-4a56-ba9c-ddb60239abd9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:01.264576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-60586f66-4535-4a56-ba9c-ddb60239abd9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 9459a821-b751-4677-9187-a99992840895] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:01.272434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60586f66-4535-4a56-ba9c-ddb60239abd9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:01.272933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60586f66-4535-4a56-ba9c-ddb60239abd9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:01.273406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60586f66-4535-4a56-ba9c-ddb60239abd9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:01.274114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60586f66-4535-4a56-ba9c-ddb60239abd9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:01.274578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60586f66-4535-4a56-ba9c-ddb60239abd9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:01.275321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60586f66-4535-4a56-ba9c-ddb60239abd9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:01.411312 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-60586f66-4535-4a56-ba9c-ddb60239abd9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:01.419453 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-60586f66-4535-4a56-ba9c-ddb60239abd9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895" status: 200 len: 1685 microversion: 2.1 time: 0.161541 Aug 24 11:23:01.420099 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3824/7283] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:01 2022] GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895 => generated 1685 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:02.447894 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-09bc3221-b7a5-4014-b21e-f4c16f967489 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:02.449029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-09bc3221-b7a5-4014-b21e-f4c16f967489 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 9459a821-b751-4677-9187-a99992840895] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:02.459482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09bc3221-b7a5-4014-b21e-f4c16f967489 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:02.460323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09bc3221-b7a5-4014-b21e-f4c16f967489 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:02.461104 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09bc3221-b7a5-4014-b21e-f4c16f967489 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:02.462324 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09bc3221-b7a5-4014-b21e-f4c16f967489 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:02.463080 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09bc3221-b7a5-4014-b21e-f4c16f967489 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:02.463797 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09bc3221-b7a5-4014-b21e-f4c16f967489 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:02.942638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-09bc3221-b7a5-4014-b21e-f4c16f967489 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:02.951659 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-09bc3221-b7a5-4014-b21e-f4c16f967489 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895" status: 200 len: 1685 microversion: 2.1 time: 0.511784 Aug 24 11:23:02.952300 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3460/7284] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:02 2022] GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895 => generated 1685 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:03.497897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-f1049ec7-57ce-4003-b11b-22047f3944fe req-78aea397-63c5-4d4d-8448-d9e44f3a24fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9459a821-b751-4677-9187-a99992840895", "name": "network-vif-deleted", "tag": "069fda77-917d-44bd-b425-69a13c2fcd37"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:23:03.511466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f1049ec7-57ce-4003-b11b-22047f3944fe req-78aea397-63c5-4d4d-8448-d9e44f3a24fa service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:03.511973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f1049ec7-57ce-4003-b11b-22047f3944fe req-78aea397-63c5-4d4d-8448-d9e44f3a24fa service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:03.512421 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f1049ec7-57ce-4003-b11b-22047f3944fe req-78aea397-63c5-4d4d-8448-d9e44f3a24fa service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:03.523670 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-f1049ec7-57ce-4003-b11b-22047f3944fe req-78aea397-63c5-4d4d-8448-d9e44f3a24fa service nova] Creating event network-vif-deleted:069fda77-917d-44bd-b425-69a13c2fcd37 for instance 9459a821-b751-4677-9187-a99992840895 on n-h1-849328-3 Aug 24 11:23:03.529758 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-f1049ec7-57ce-4003-b11b-22047f3944fe req-78aea397-63c5-4d4d-8448-d9e44f3a24fa service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035829 Aug 24 11:23:03.530877 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3825/7285] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:23:03.974278 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-17d66b0c-773d-46cf-9a95-6890700b5f64 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:03.975027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-17d66b0c-773d-46cf-9a95-6890700b5f64 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 9459a821-b751-4677-9187-a99992840895] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:03.982507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17d66b0c-773d-46cf-9a95-6890700b5f64 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:03.983014 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17d66b0c-773d-46cf-9a95-6890700b5f64 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:03.983459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17d66b0c-773d-46cf-9a95-6890700b5f64 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:03.984166 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17d66b0c-773d-46cf-9a95-6890700b5f64 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:03.984621 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17d66b0c-773d-46cf-9a95-6890700b5f64 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:03.985046 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17d66b0c-773d-46cf-9a95-6890700b5f64 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:04.018590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17d66b0c-773d-46cf-9a95-6890700b5f64 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:04.019007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17d66b0c-773d-46cf-9a95-6890700b5f64 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:04.019504 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17d66b0c-773d-46cf-9a95-6890700b5f64 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:04.020035 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-17d66b0c-773d-46cf-9a95-6890700b5f64 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lazy-loading 'fault' on Instance uuid 9459a821-b751-4677-9187-a99992840895 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:23:04.068391 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-17d66b0c-773d-46cf-9a95-6890700b5f64 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:04.078228 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-17d66b0c-773d-46cf-9a95-6890700b5f64 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895" status: 200 len: 1354 microversion: 2.1 time: 0.107887 Aug 24 11:23:04.078814 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3461/7286] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:03 2022] GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895 => generated 1354 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:05.105656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-361d4346-af54-4da9-ac3d-0237add7017f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:05.106684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-361d4346-af54-4da9-ac3d-0237add7017f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 9459a821-b751-4677-9187-a99992840895] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:05.113870 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361d4346-af54-4da9-ac3d-0237add7017f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:05.114370 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361d4346-af54-4da9-ac3d-0237add7017f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:05.114822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361d4346-af54-4da9-ac3d-0237add7017f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:05.115523 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361d4346-af54-4da9-ac3d-0237add7017f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:05.115992 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361d4346-af54-4da9-ac3d-0237add7017f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:05.116428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361d4346-af54-4da9-ac3d-0237add7017f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:05.130323 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-361d4346-af54-4da9-ac3d-0237add7017f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] HTTP exception thrown: Instance 9459a821-b751-4677-9187-a99992840895 could not be found. Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-361d4346-af54-4da9-ac3d-0237add7017f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Request method failure captured: Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895 HTTP/1.1 Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgncfDWps3oSnkGWh604hOpiheCjj8_0BYAjCgEtswuOyN76lOlAH_8p8Uj7QuLZqZrHJqGhmKvQcmRgQjYyq3xw0zzP1xAec9u3lQcKsftkv7yoMv-UqmOKrubG7PpaZzLpooDFEsUT2iVLZk3IHgmNHmgtRKVhQiSyHbimZM2IotU Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 36574fcb42ea44ca970b5bfa9697af8c Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1665657358 Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/36574fcb42ea44ca970b5bfa9697af8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_36574fcb42ea44ca970b5bfa9697af8c", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/36574fcb42ea44ca970b5bfa9697af8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/36574fcb42ea44ca970b5bfa9697af8c"}]}] Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1665657358 Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 36574fcb42ea44ca970b5bfa9697af8c Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1665657358 Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestNetworkAdvancedServerOps-1665657358-project Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: ab7f1eb7298e4cad86ad953eac53c9c3 Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1665657358-project Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 9459a821-b751-4677-9187-a99992840895 could not be found. Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '9459a821-b751-4677-9187-a99992840895'} Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9459a821-b751-4677-9187-a99992840895 could not be found. Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9459a821-b751-4677-9187-a99992840895 could not be found. Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:23:05.131959 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:23:05.136620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:23:05.136620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:23:05.136620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:23:05.136620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:23:05.136620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:23:05.136620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:23:05.136620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9459a821-b751-4677-9187-a99992840895 could not be found. Aug 24 11:23:05.136620 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:23:05.136620 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-361d4346-af54-4da9-ac3d-0237add7017f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Returning 404 to user: Instance 9459a821-b751-4677-9187-a99992840895 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:23:05.136620 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-361d4346-af54-4da9-ac3d-0237add7017f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895" status: 404 len: 111 microversion: 2.1 time: 0.035888 Aug 24 11:23:05.136620 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3826/7287] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:05 2022] GET /compute/v2.1/servers/9459a821-b751-4677-9187-a99992840895 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:23:08.222223 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ecafaa29-b19c-4ef6-9fe8-7b7468473d4c tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '.version_select at 0x7f465a2d1310>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:08.244119 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ecafaa29-b19c-4ef6-9fe8-7b7468473d4c tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-12436498" status: 202 len: 0 microversion: 2.1 time: 0.025675 Aug 24 11:23:08.244638 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3462/7288] 10.222.0.85 () {58 vars in 1278 bytes} [Wed Aug 24 11:23:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-12436498 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:23:08.269190 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dd452c68-6a87-4f26-af55-3a60e3a8247c tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'create', calling method: .version_select at 0x7f464791c670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2009877323", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoLRBPwgha09PgX8pYuSbkj8gUuexhAxa2Ssiat8SgntCX9+eehH7qLaANokmJOAxov6K8mI7TYSooGSqBZnuc7yObQkpzTK6qkKH2kcTu0OZStnyyBq0Vg0USQR1vYMg=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:23:08.286632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-dd452c68-6a87-4f26-af55-3a60e3a8247c tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Getting quotas for project 36574fcb42ea44ca970b5bfa9697af8c. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:23:08.291612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-dd452c68-6a87-4f26-af55-3a60e3a8247c tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Getting quotas for user ab7f1eb7298e4cad86ad953eac53c9c3 and project 36574fcb42ea44ca970b5bfa9697af8c. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:23:08.317621 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dd452c68-6a87-4f26-af55-3a60e3a8247c tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052360 Aug 24 11:23:08.318416 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3827/7289] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 11:23:08 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:23:13.900807 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0eb29301-ca8a-413a-8c0a-7b0f0f0f5c82 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1905127242", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "cd422fe5-76a1-46c6-b4d4-61ef1a7990b1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2009877323", "security_groups": [{"name": "tempest-secgroup-smoke-1356152242"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:23:14.024983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-0eb29301-ca8a-413a-8c0a-7b0f0f0f5c82 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] validate_networks() for [('cd422fe5-76a1-46c6-b4d4-61ef1a7990b1', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:23:14.074960 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:14.472809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0eb29301-ca8a-413a-8c0a-7b0f0f0f5c82 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:23:14.473386 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0eb29301-ca8a-413a-8c0a-7b0f0f0f5c82 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:23:14.473923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0eb29301-ca8a-413a-8c0a-7b0f0f0f5c82 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:23:14.474394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0eb29301-ca8a-413a-8c0a-7b0f0f0f5c82 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:23:14.474946 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0eb29301-ca8a-413a-8c0a-7b0f0f0f5c82 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:23:14.484387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0eb29301-ca8a-413a-8c0a-7b0f0f0f5c82 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:14.484874 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0eb29301-ca8a-413a-8c0a-7b0f0f0f5c82 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:14.485359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0eb29301-ca8a-413a-8c0a-7b0f0f0f5c82 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:14.486068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0eb29301-ca8a-413a-8c0a-7b0f0f0f5c82 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:14.486516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0eb29301-ca8a-413a-8c0a-7b0f0f0f5c82 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:14.486938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0eb29301-ca8a-413a-8c0a-7b0f0f0f5c82 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:14.506931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-0eb29301-ca8a-413a-8c0a-7b0f0f0f5c82 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Getting quotas for project 36574fcb42ea44ca970b5bfa9697af8c. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:23:14.515980 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-0eb29301-ca8a-413a-8c0a-7b0f0f0f5c82 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Getting quotas for user ab7f1eb7298e4cad86ad953eac53c9c3 and project 36574fcb42ea44ca970b5bfa9697af8c. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:23:14.528925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0eb29301-ca8a-413a-8c0a-7b0f0f0f5c82 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:23:14.531326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0eb29301-ca8a-413a-8c0a-7b0f0f0f5c82 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:23:14.580823 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0eb29301-ca8a-413a-8c0a-7b0f0f0f5c82 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.685472 Aug 24 11:23:14.581860 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3463/7290] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 11:23:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 11:23:14.592731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0acdc14d-ba4a-4f69-8104-33eb5d7a249f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:14.594125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0acdc14d-ba4a-4f69-8104-33eb5d7a249f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:14.673306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0acdc14d-ba4a-4f69-8104-33eb5d7a249f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:14.683769 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0acdc14d-ba4a-4f69-8104-33eb5d7a249f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba" status: 200 len: 1267 microversion: 2.1 time: 0.094990 Aug 24 11:23:14.684965 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3828/7291] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:14 2022] GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba => generated 1267 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:15.705098 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-486b34cc-596d-4567-a9e7-255381b0f6f9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:15.705752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-486b34cc-596d-4567-a9e7-255381b0f6f9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:15.717218 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-486b34cc-596d-4567-a9e7-255381b0f6f9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:15.718227 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-486b34cc-596d-4567-a9e7-255381b0f6f9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:15.718774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-486b34cc-596d-4567-a9e7-255381b0f6f9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:15.719900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-486b34cc-596d-4567-a9e7-255381b0f6f9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:15.720651 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-486b34cc-596d-4567-a9e7-255381b0f6f9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:15.721528 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-486b34cc-596d-4567-a9e7-255381b0f6f9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:15.820012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-486b34cc-596d-4567-a9e7-255381b0f6f9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:15.835930 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-486b34cc-596d-4567-a9e7-255381b0f6f9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba" status: 200 len: 1337 microversion: 2.1 time: 0.134868 Aug 24 11:23:15.838719 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3464/7292] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:15 2022] GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba => generated 1337 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:16.859817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aefa5944-b325-449a-9c55-8d0e1c5fd8fd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:16.860630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aefa5944-b325-449a-9c55-8d0e1c5fd8fd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:16.862968 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=36 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:16.871590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aefa5944-b325-449a-9c55-8d0e1c5fd8fd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:16.872748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aefa5944-b325-449a-9c55-8d0e1c5fd8fd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:16.873043 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aefa5944-b325-449a-9c55-8d0e1c5fd8fd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:16.874041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aefa5944-b325-449a-9c55-8d0e1c5fd8fd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:16.874625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aefa5944-b325-449a-9c55-8d0e1c5fd8fd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:16.875220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aefa5944-b325-449a-9c55-8d0e1c5fd8fd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:17.036643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aefa5944-b325-449a-9c55-8d0e1c5fd8fd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:17.045638 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aefa5944-b325-449a-9c55-8d0e1c5fd8fd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba" status: 200 len: 1393 microversion: 2.1 time: 0.189873 Aug 24 11:23:17.046256 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3829/7293] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:16 2022] GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba => generated 1393 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:17.457965 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-f32eb4c1-002a-403a-84b2-4b06c97fa512 req-3ed751e7-6494-47e5-b863-1a476b2247dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b6c6a67-bc31-4378-ac77-e3e52def8fba", "tag": "7d1d18a2-f8f6-4456-94ef-bb5ee6296dbe"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:23:17.483412 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f32eb4c1-002a-403a-84b2-4b06c97fa512 req-3ed751e7-6494-47e5-b863-1a476b2247dc service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:17.484004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f32eb4c1-002a-403a-84b2-4b06c97fa512 req-3ed751e7-6494-47e5-b863-1a476b2247dc service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:17.484510 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f32eb4c1-002a-403a-84b2-4b06c97fa512 req-3ed751e7-6494-47e5-b863-1a476b2247dc service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:17.496918 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-f32eb4c1-002a-403a-84b2-4b06c97fa512 req-3ed751e7-6494-47e5-b863-1a476b2247dc service nova] Creating event network-changed:7d1d18a2-f8f6-4456-94ef-bb5ee6296dbe for instance 7b6c6a67-bc31-4378-ac77-e3e52def8fba on n-h2-849328-3 Aug 24 11:23:17.502029 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-f32eb4c1-002a-403a-84b2-4b06c97fa512 req-3ed751e7-6494-47e5-b863-1a476b2247dc service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049852 Aug 24 11:23:17.502978 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3465/7294] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:23:18.067590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-abfe5915-784f-4878-8b5c-0b89bc234f22 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:18.068226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-abfe5915-784f-4878-8b5c-0b89bc234f22 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:18.075522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abfe5915-784f-4878-8b5c-0b89bc234f22 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:18.076029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abfe5915-784f-4878-8b5c-0b89bc234f22 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:18.076543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abfe5915-784f-4878-8b5c-0b89bc234f22 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:18.077209 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abfe5915-784f-4878-8b5c-0b89bc234f22 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:18.077807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abfe5915-784f-4878-8b5c-0b89bc234f22 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:18.078316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abfe5915-784f-4878-8b5c-0b89bc234f22 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:18.227570 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-abfe5915-784f-4878-8b5c-0b89bc234f22 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:18.236889 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-abfe5915-784f-4878-8b5c-0b89bc234f22 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba" status: 200 len: 1393 microversion: 2.1 time: 0.173012 Aug 24 11:23:18.237837 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3830/7295] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:18 2022] GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba => generated 1393 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:19.263852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e45a4dfc-f4f6-499a-8bab-1725abf5b70a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:19.264577 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e45a4dfc-f4f6-499a-8bab-1725abf5b70a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:19.270964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e45a4dfc-f4f6-499a-8bab-1725abf5b70a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:19.271447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e45a4dfc-f4f6-499a-8bab-1725abf5b70a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:19.271856 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e45a4dfc-f4f6-499a-8bab-1725abf5b70a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:19.272573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e45a4dfc-f4f6-499a-8bab-1725abf5b70a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:19.273017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e45a4dfc-f4f6-499a-8bab-1725abf5b70a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:19.273784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e45a4dfc-f4f6-499a-8bab-1725abf5b70a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:19.474750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e45a4dfc-f4f6-499a-8bab-1725abf5b70a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:19.482944 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e45a4dfc-f4f6-499a-8bab-1725abf5b70a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba" status: 200 len: 1393 microversion: 2.1 time: 0.224379 Aug 24 11:23:19.483557 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3466/7296] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:19 2022] GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba => generated 1393 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:20.503664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d81bb173-add8-44c0-b0cf-e0568eff14b5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:20.504296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d81bb173-add8-44c0-b0cf-e0568eff14b5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:20.507121 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:20.513899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d81bb173-add8-44c0-b0cf-e0568eff14b5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:20.514632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d81bb173-add8-44c0-b0cf-e0568eff14b5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:20.515276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d81bb173-add8-44c0-b0cf-e0568eff14b5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:20.516451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d81bb173-add8-44c0-b0cf-e0568eff14b5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:20.517261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d81bb173-add8-44c0-b0cf-e0568eff14b5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:20.517989 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d81bb173-add8-44c0-b0cf-e0568eff14b5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:20.668707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d81bb173-add8-44c0-b0cf-e0568eff14b5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:20.677221 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d81bb173-add8-44c0-b0cf-e0568eff14b5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba" status: 200 len: 1393 microversion: 2.1 time: 0.177416 Aug 24 11:23:20.677845 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3831/7297] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:20 2022] GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba => generated 1393 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:21.703297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-822c2f22-dc5f-43ba-bc46-52d338547f54 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:21.704240 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-822c2f22-dc5f-43ba-bc46-52d338547f54 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:21.716201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-822c2f22-dc5f-43ba-bc46-52d338547f54 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:21.716738 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-822c2f22-dc5f-43ba-bc46-52d338547f54 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:21.717204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-822c2f22-dc5f-43ba-bc46-52d338547f54 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:21.717985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-822c2f22-dc5f-43ba-bc46-52d338547f54 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:21.718461 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-822c2f22-dc5f-43ba-bc46-52d338547f54 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:21.718873 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-822c2f22-dc5f-43ba-bc46-52d338547f54 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:21.856022 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-822c2f22-dc5f-43ba-bc46-52d338547f54 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:21.865661 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-822c2f22-dc5f-43ba-bc46-52d338547f54 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba" status: 200 len: 1393 microversion: 2.1 time: 0.168941 Aug 24 11:23:21.866420 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3467/7298] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:21 2022] GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba => generated 1393 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:22.378183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8426a9c2-165e-4bba-8fe3-e968a7a4b09c req-143cf2cb-8f30-4d43-ad1d-1d61737fe620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b6c6a67-bc31-4378-ac77-e3e52def8fba", "name": "network-vif-plugged", "status": "completed", "tag": "7d1d18a2-f8f6-4456-94ef-bb5ee6296dbe"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:23:22.388921 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8426a9c2-165e-4bba-8fe3-e968a7a4b09c req-143cf2cb-8f30-4d43-ad1d-1d61737fe620 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:22.389443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8426a9c2-165e-4bba-8fe3-e968a7a4b09c req-143cf2cb-8f30-4d43-ad1d-1d61737fe620 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:22.389878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8426a9c2-165e-4bba-8fe3-e968a7a4b09c req-143cf2cb-8f30-4d43-ad1d-1d61737fe620 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:22.401812 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8426a9c2-165e-4bba-8fe3-e968a7a4b09c req-143cf2cb-8f30-4d43-ad1d-1d61737fe620 service nova] Creating event network-vif-plugged:7d1d18a2-f8f6-4456-94ef-bb5ee6296dbe for instance 7b6c6a67-bc31-4378-ac77-e3e52def8fba on n-h2-849328-3 Aug 24 11:23:22.406829 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8426a9c2-165e-4bba-8fe3-e968a7a4b09c req-143cf2cb-8f30-4d43-ad1d-1d61737fe620 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032643 Aug 24 11:23:22.407441 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3832/7299] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:23:22.888876 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-63dc8f0f-9e24-42f3-b393-796407313c28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:22.889507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-63dc8f0f-9e24-42f3-b393-796407313c28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:22.897166 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63dc8f0f-9e24-42f3-b393-796407313c28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:22.897674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63dc8f0f-9e24-42f3-b393-796407313c28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:22.898439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63dc8f0f-9e24-42f3-b393-796407313c28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:22.899333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63dc8f0f-9e24-42f3-b393-796407313c28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:22.899609 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63dc8f0f-9e24-42f3-b393-796407313c28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:22.900033 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63dc8f0f-9e24-42f3-b393-796407313c28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:23.047974 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-63dc8f0f-9e24-42f3-b393-796407313c28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:23.057995 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-63dc8f0f-9e24-42f3-b393-796407313c28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba" status: 200 len: 1393 microversion: 2.1 time: 0.172983 Aug 24 11:23:23.058594 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3468/7300] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:22 2022] GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:24.080696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-80b1c91a-96e7-46f0-a35b-1f61c6509d36 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:24.081457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-80b1c91a-96e7-46f0-a35b-1f61c6509d36 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:24.088469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80b1c91a-96e7-46f0-a35b-1f61c6509d36 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:24.088970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80b1c91a-96e7-46f0-a35b-1f61c6509d36 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:24.089478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80b1c91a-96e7-46f0-a35b-1f61c6509d36 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:24.090272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80b1c91a-96e7-46f0-a35b-1f61c6509d36 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:24.090736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80b1c91a-96e7-46f0-a35b-1f61c6509d36 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:24.091175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80b1c91a-96e7-46f0-a35b-1f61c6509d36 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:24.228662 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-80b1c91a-96e7-46f0-a35b-1f61c6509d36 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:24.236983 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-80b1c91a-96e7-46f0-a35b-1f61c6509d36 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba" status: 200 len: 1566 microversion: 2.1 time: 0.161598 Aug 24 11:23:24.237602 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3833/7301] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:24 2022] GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:24.257445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9dd5bcb9-fb1a-41c6-a276-1fc641002639 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:24.258050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9dd5bcb9-fb1a-41c6-a276-1fc641002639 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:24.265056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9dd5bcb9-fb1a-41c6-a276-1fc641002639 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:24.265643 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9dd5bcb9-fb1a-41c6-a276-1fc641002639 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:24.266005 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9dd5bcb9-fb1a-41c6-a276-1fc641002639 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:24.266696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9dd5bcb9-fb1a-41c6-a276-1fc641002639 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:24.267145 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9dd5bcb9-fb1a-41c6-a276-1fc641002639 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:24.267563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9dd5bcb9-fb1a-41c6-a276-1fc641002639 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:24.403913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9dd5bcb9-fb1a-41c6-a276-1fc641002639 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:24.412665 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9dd5bcb9-fb1a-41c6-a276-1fc641002639 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba" status: 200 len: 1566 microversion: 2.1 time: 0.159048 Aug 24 11:23:24.413311 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3469/7302] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:24 2022] GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:26.004628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-52635bb4-4e3c-45db-8ece-a67d95f56dbb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:26.005345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-52635bb4-4e3c-45db-8ece-a67d95f56dbb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:26.007374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e4a92887-8f89-48a9-ab93-4111bf568488 req-1cfcc05a-6f88-4968-a16f-74668517d1e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b6c6a67-bc31-4378-ac77-e3e52def8fba", "tag": "7d1d18a2-f8f6-4456-94ef-bb5ee6296dbe"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:23:26.007911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:26.015097 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52635bb4-4e3c-45db-8ece-a67d95f56dbb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:26.015622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52635bb4-4e3c-45db-8ece-a67d95f56dbb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:26.016079 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52635bb4-4e3c-45db-8ece-a67d95f56dbb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:26.016800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52635bb4-4e3c-45db-8ece-a67d95f56dbb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:26.017660 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52635bb4-4e3c-45db-8ece-a67d95f56dbb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:26.018107 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52635bb4-4e3c-45db-8ece-a67d95f56dbb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:26.018330 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:26.019547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:26.022175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:26.026132 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e4a92887-8f89-48a9-ab93-4111bf568488 req-1cfcc05a-6f88-4968-a16f-74668517d1e1 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:26.026975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e4a92887-8f89-48a9-ab93-4111bf568488 req-1cfcc05a-6f88-4968-a16f-74668517d1e1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:26.027786 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e4a92887-8f89-48a9-ab93-4111bf568488 req-1cfcc05a-6f88-4968-a16f-74668517d1e1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:26.046959 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e4a92887-8f89-48a9-ab93-4111bf568488 req-1cfcc05a-6f88-4968-a16f-74668517d1e1 service nova] Creating event network-changed:7d1d18a2-f8f6-4456-94ef-bb5ee6296dbe for instance 7b6c6a67-bc31-4378-ac77-e3e52def8fba on n-h2-849328-3 Aug 24 11:23:26.053925 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e4a92887-8f89-48a9-ab93-4111bf568488 req-1cfcc05a-6f88-4968-a16f-74668517d1e1 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049549 Aug 24 11:23:26.055397 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3470/7303] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:23:26.181077 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-52635bb4-4e3c-45db-8ece-a67d95f56dbb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:26.189842 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-52635bb4-4e3c-45db-8ece-a67d95f56dbb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba" status: 200 len: 1566 microversion: 2.1 time: 0.189261 Aug 24 11:23:26.190435 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3834/7304] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:25 2022] GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba => generated 1566 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:51.463413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=36 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:51.469547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-14edc89b-ed81-4a39-aa94-125cad6bc33e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:23:51.472828 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-14edc89b-ed81-4a39-aa94-125cad6bc33e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:51.484937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14edc89b-ed81-4a39-aa94-125cad6bc33e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:51.485767 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14edc89b-ed81-4a39-aa94-125cad6bc33e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:51.486417 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14edc89b-ed81-4a39-aa94-125cad6bc33e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:51.487509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14edc89b-ed81-4a39-aa94-125cad6bc33e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:51.488200 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14edc89b-ed81-4a39-aa94-125cad6bc33e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:51.488858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14edc89b-ed81-4a39-aa94-125cad6bc33e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:51.550106 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-14edc89b-ed81-4a39-aa94-125cad6bc33e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba/action" status: 200 len: 24563 microversion: 2.1 time: 0.089324 Aug 24 11:23:51.550789 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3471/7305] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:23:51 2022] POST /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba/action => generated 24563 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:24:02.502163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=7 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:02.503180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=32 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:02.507428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f71e8f6a-93d6-43ba-a3ea-854ae055425d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:02.509988 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f71e8f6a-93d6-43ba-a3ea-854ae055425d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:02.517405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f71e8f6a-93d6-43ba-a3ea-854ae055425d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:02.517918 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f71e8f6a-93d6-43ba-a3ea-854ae055425d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:02.518372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f71e8f6a-93d6-43ba-a3ea-854ae055425d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:02.519134 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f71e8f6a-93d6-43ba-a3ea-854ae055425d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:02.519934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f71e8f6a-93d6-43ba-a3ea-854ae055425d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:02.520389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f71e8f6a-93d6-43ba-a3ea-854ae055425d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:02.600676 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f71e8f6a-93d6-43ba-a3ea-854ae055425d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba/action" status: 202 len: 0 microversion: 2.1 time: 0.099956 Aug 24 11:24:02.601382 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3835/7306] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:24:02 2022] POST /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:24:02.611566 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-14cc2d50-ac1e-4e95-a394-035ad35611cd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:02.612263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-14cc2d50-ac1e-4e95-a394-035ad35611cd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:02.615055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:02.615701 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:02.622273 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14cc2d50-ac1e-4e95-a394-035ad35611cd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:02.622791 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14cc2d50-ac1e-4e95-a394-035ad35611cd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:02.623245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14cc2d50-ac1e-4e95-a394-035ad35611cd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:02.624093 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14cc2d50-ac1e-4e95-a394-035ad35611cd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:02.624556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14cc2d50-ac1e-4e95-a394-035ad35611cd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:02.624983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14cc2d50-ac1e-4e95-a394-035ad35611cd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:03.165687 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-14cc2d50-ac1e-4e95-a394-035ad35611cd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:03.175165 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-14cc2d50-ac1e-4e95-a394-035ad35611cd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba" status: 200 len: 1676 microversion: 2.1 time: 0.568547 Aug 24 11:24:03.175773 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3472/7307] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:02 2022] GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba => generated 1676 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:04.203171 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1a52c2ae-c012-4fdf-bca7-6e45e987c8dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:04.204339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1a52c2ae-c012-4fdf-bca7-6e45e987c8dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:04.214599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a52c2ae-c012-4fdf-bca7-6e45e987c8dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:04.215261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a52c2ae-c012-4fdf-bca7-6e45e987c8dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:04.216018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a52c2ae-c012-4fdf-bca7-6e45e987c8dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:04.217252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a52c2ae-c012-4fdf-bca7-6e45e987c8dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:04.217731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a52c2ae-c012-4fdf-bca7-6e45e987c8dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:04.218175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a52c2ae-c012-4fdf-bca7-6e45e987c8dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:04.363860 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1a52c2ae-c012-4fdf-bca7-6e45e987c8dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:04.372212 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1a52c2ae-c012-4fdf-bca7-6e45e987c8dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba" status: 200 len: 1681 microversion: 2.1 time: 0.176575 Aug 24 11:24:04.372811 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3836/7308] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:04 2022] GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:05.394149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-950add02-dd3a-43b1-bbaf-310f6fd69714 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:05.395082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-950add02-dd3a-43b1-bbaf-310f6fd69714 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:05.403319 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-950add02-dd3a-43b1-bbaf-310f6fd69714 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:05.403806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-950add02-dd3a-43b1-bbaf-310f6fd69714 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:05.404241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-950add02-dd3a-43b1-bbaf-310f6fd69714 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:05.405143 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-950add02-dd3a-43b1-bbaf-310f6fd69714 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:05.405608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-950add02-dd3a-43b1-bbaf-310f6fd69714 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:05.406083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-950add02-dd3a-43b1-bbaf-310f6fd69714 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:05.547243 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-950add02-dd3a-43b1-bbaf-310f6fd69714 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:05.559150 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-950add02-dd3a-43b1-bbaf-310f6fd69714 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba" status: 200 len: 1681 microversion: 2.1 time: 0.168653 Aug 24 11:24:05.560191 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3473/7309] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:05 2022] GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:06.585328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5ec7d4c9-41a3-445e-a4eb-a3c8045a2daa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:06.585938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5ec7d4c9-41a3-445e-a4eb-a3c8045a2daa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:06.593708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ec7d4c9-41a3-445e-a4eb-a3c8045a2daa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:06.594202 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ec7d4c9-41a3-445e-a4eb-a3c8045a2daa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:06.594652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ec7d4c9-41a3-445e-a4eb-a3c8045a2daa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:06.595385 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ec7d4c9-41a3-445e-a4eb-a3c8045a2daa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:06.595850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ec7d4c9-41a3-445e-a4eb-a3c8045a2daa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:06.596281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ec7d4c9-41a3-445e-a4eb-a3c8045a2daa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:06.733747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5ec7d4c9-41a3-445e-a4eb-a3c8045a2daa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:06.742554 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5ec7d4c9-41a3-445e-a4eb-a3c8045a2daa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba" status: 200 len: 1681 microversion: 2.1 time: 0.163097 Aug 24 11:24:06.743225 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3837/7310] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:06 2022] GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:07.764711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4067578e-985d-4c04-9b55-8df9661f2b3c tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:07.765328 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4067578e-985d-4c04-9b55-8df9661f2b3c tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:07.772826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4067578e-985d-4c04-9b55-8df9661f2b3c tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:07.773353 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4067578e-985d-4c04-9b55-8df9661f2b3c tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:07.773793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4067578e-985d-4c04-9b55-8df9661f2b3c tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:07.774590 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4067578e-985d-4c04-9b55-8df9661f2b3c tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:07.775050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4067578e-985d-4c04-9b55-8df9661f2b3c tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:07.775479 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4067578e-985d-4c04-9b55-8df9661f2b3c tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:07.927585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4067578e-985d-4c04-9b55-8df9661f2b3c tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:07.936777 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4067578e-985d-4c04-9b55-8df9661f2b3c tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba" status: 200 len: 1681 microversion: 2.1 time: 0.176168 Aug 24 11:24:07.937422 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3474/7311] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:07 2022] GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:08.958189 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ee1f81fe-a018-45bd-8680-e18244fc2cc4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:08.958773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ee1f81fe-a018-45bd-8680-e18244fc2cc4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:08.966708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee1f81fe-a018-45bd-8680-e18244fc2cc4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:08.967541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee1f81fe-a018-45bd-8680-e18244fc2cc4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:08.968283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee1f81fe-a018-45bd-8680-e18244fc2cc4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:08.969494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee1f81fe-a018-45bd-8680-e18244fc2cc4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:08.970203 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee1f81fe-a018-45bd-8680-e18244fc2cc4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:08.970935 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee1f81fe-a018-45bd-8680-e18244fc2cc4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:09.112777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ee1f81fe-a018-45bd-8680-e18244fc2cc4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:09.121145 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ee1f81fe-a018-45bd-8680-e18244fc2cc4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba" status: 200 len: 1681 microversion: 2.1 time: 0.166863 Aug 24 11:24:09.121748 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3838/7312] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:08 2022] GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:10.143817 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0b872c5d-b50f-4319-8d5d-3724f54f975f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:10.144777 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0b872c5d-b50f-4319-8d5d-3724f54f975f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:10.154241 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b872c5d-b50f-4319-8d5d-3724f54f975f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:10.154773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b872c5d-b50f-4319-8d5d-3724f54f975f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:10.155211 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b872c5d-b50f-4319-8d5d-3724f54f975f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:10.155914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b872c5d-b50f-4319-8d5d-3724f54f975f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:10.156366 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b872c5d-b50f-4319-8d5d-3724f54f975f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:10.156795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b872c5d-b50f-4319-8d5d-3724f54f975f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:10.292523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0b872c5d-b50f-4319-8d5d-3724f54f975f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:10.302107 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0b872c5d-b50f-4319-8d5d-3724f54f975f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba" status: 200 len: 1681 microversion: 2.1 time: 0.163177 Aug 24 11:24:10.302718 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3475/7313] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:10 2022] GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:11.325068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-922b360b-7d2a-4db1-99c9-2050cbad84e0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:11.325780 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-922b360b-7d2a-4db1-99c9-2050cbad84e0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:11.332330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-922b360b-7d2a-4db1-99c9-2050cbad84e0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:11.332825 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-922b360b-7d2a-4db1-99c9-2050cbad84e0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:11.333319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-922b360b-7d2a-4db1-99c9-2050cbad84e0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:11.334016 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-922b360b-7d2a-4db1-99c9-2050cbad84e0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:11.334483 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-922b360b-7d2a-4db1-99c9-2050cbad84e0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:11.334919 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-922b360b-7d2a-4db1-99c9-2050cbad84e0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:11.479340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-922b360b-7d2a-4db1-99c9-2050cbad84e0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:11.487734 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-922b360b-7d2a-4db1-99c9-2050cbad84e0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba" status: 200 len: 1681 microversion: 2.1 time: 0.167473 Aug 24 11:24:11.488320 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3839/7314] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:11 2022] GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:12.510364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8fffd401-6e9f-4e10-80da-6278d4a88ea3 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:12.510901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8fffd401-6e9f-4e10-80da-6278d4a88ea3 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:12.518737 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fffd401-6e9f-4e10-80da-6278d4a88ea3 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:12.519548 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fffd401-6e9f-4e10-80da-6278d4a88ea3 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:12.520018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fffd401-6e9f-4e10-80da-6278d4a88ea3 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:12.520740 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fffd401-6e9f-4e10-80da-6278d4a88ea3 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:12.521244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fffd401-6e9f-4e10-80da-6278d4a88ea3 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:12.521681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fffd401-6e9f-4e10-80da-6278d4a88ea3 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:12.664589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8fffd401-6e9f-4e10-80da-6278d4a88ea3 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:12.673092 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8fffd401-6e9f-4e10-80da-6278d4a88ea3 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba" status: 200 len: 1681 microversion: 2.1 time: 0.167006 Aug 24 11:24:12.673704 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3476/7315] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:12 2022] GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:13.698633 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9e3ab9e1-233f-4021-98fb-e913ee599e28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:13.699661 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9e3ab9e1-233f-4021-98fb-e913ee599e28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:13.711640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e3ab9e1-233f-4021-98fb-e913ee599e28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:13.712510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e3ab9e1-233f-4021-98fb-e913ee599e28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:13.713352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e3ab9e1-233f-4021-98fb-e913ee599e28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:13.714496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e3ab9e1-233f-4021-98fb-e913ee599e28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:13.715287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e3ab9e1-233f-4021-98fb-e913ee599e28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:13.716018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e3ab9e1-233f-4021-98fb-e913ee599e28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:13.853625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9e3ab9e1-233f-4021-98fb-e913ee599e28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:13.862107 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9e3ab9e1-233f-4021-98fb-e913ee599e28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba" status: 200 len: 1681 microversion: 2.1 time: 0.170269 Aug 24 11:24:13.862706 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3840/7316] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:13 2022] GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:14.884078 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-78df257b-3a3d-4284-9e70-8738283f283a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:14.884693 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-78df257b-3a3d-4284-9e70-8738283f283a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:14.892161 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78df257b-3a3d-4284-9e70-8738283f283a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:14.893320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78df257b-3a3d-4284-9e70-8738283f283a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:14.893320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78df257b-3a3d-4284-9e70-8738283f283a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:14.894161 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78df257b-3a3d-4284-9e70-8738283f283a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:14.894624 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78df257b-3a3d-4284-9e70-8738283f283a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:14.895054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78df257b-3a3d-4284-9e70-8738283f283a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:15.036247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-78df257b-3a3d-4284-9e70-8738283f283a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:15.044318 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-78df257b-3a3d-4284-9e70-8738283f283a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba" status: 200 len: 1684 microversion: 2.1 time: 0.164313 Aug 24 11:24:15.044913 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3477/7317] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:14 2022] GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:41.247216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-df703990-453a-4d00-8216-315921b78592 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:41.249643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-df703990-453a-4d00-8216-315921b78592 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:41.252068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=12 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:41.252744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:41.259995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df703990-453a-4d00-8216-315921b78592 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:41.260577 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df703990-453a-4d00-8216-315921b78592 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:41.261057 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df703990-453a-4d00-8216-315921b78592 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:41.261851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df703990-453a-4d00-8216-315921b78592 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:41.262449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df703990-453a-4d00-8216-315921b78592 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:41.264425 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df703990-453a-4d00-8216-315921b78592 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:41.338986 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-df703990-453a-4d00-8216-315921b78592 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba/action" status: 200 len: 69136 microversion: 2.1 time: 0.095688 Aug 24 11:24:41.339721 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3841/7318] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:24:41 2022] POST /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba/action => generated 69136 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:24:48.855062 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5496d727-4332-4a3f-84ff-c2286a7df3ef tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:48.855641 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5496d727-4332-4a3f-84ff-c2286a7df3ef tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:48.857790 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=12 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:48.858853 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=36 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:48.860867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-3bc1ee77-63f1-4e93-9aba-93751806537c req-c5ecc802-0d7f-4a9a-ae8e-92ab8ea69b33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b6c6a67-bc31-4378-ac77-e3e52def8fba", "tag": "7d1d18a2-f8f6-4456-94ef-bb5ee6296dbe"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:48.872468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3bc1ee77-63f1-4e93-9aba-93751806537c req-c5ecc802-0d7f-4a9a-ae8e-92ab8ea69b33 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:48.873582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3bc1ee77-63f1-4e93-9aba-93751806537c req-c5ecc802-0d7f-4a9a-ae8e-92ab8ea69b33 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:48.874200 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5496d727-4332-4a3f-84ff-c2286a7df3ef tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:48.874380 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3bc1ee77-63f1-4e93-9aba-93751806537c req-c5ecc802-0d7f-4a9a-ae8e-92ab8ea69b33 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:48.874700 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5496d727-4332-4a3f-84ff-c2286a7df3ef tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:48.875128 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5496d727-4332-4a3f-84ff-c2286a7df3ef tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:48.877800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5496d727-4332-4a3f-84ff-c2286a7df3ef tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:48.877800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5496d727-4332-4a3f-84ff-c2286a7df3ef tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:48.877800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5496d727-4332-4a3f-84ff-c2286a7df3ef tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:48.893163 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-3bc1ee77-63f1-4e93-9aba-93751806537c req-c5ecc802-0d7f-4a9a-ae8e-92ab8ea69b33 service nova] Creating event network-changed:7d1d18a2-f8f6-4456-94ef-bb5ee6296dbe for instance 7b6c6a67-bc31-4378-ac77-e3e52def8fba on n-h2-849328-3 Aug 24 11:24:48.898666 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-3bc1ee77-63f1-4e93-9aba-93751806537c req-c5ecc802-0d7f-4a9a-ae8e-92ab8ea69b33 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044672 Aug 24 11:24:48.899859 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3842/7319] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:48.905978 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5496d727-4332-4a3f-84ff-c2286a7df3ef tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:24:48.991993 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5496d727-4332-4a3f-84ff-c2286a7df3ef tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "DELETE /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba" status: 204 len: 0 microversion: 2.1 time: 0.140547 Aug 24 11:24:48.993109 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3478/7320] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:24:48 2022] DELETE /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:24:49.002120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6ba26460-a5f7-47b6-aedc-688562f13cc4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:49.003328 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6ba26460-a5f7-47b6-aedc-688562f13cc4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:49.012287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ba26460-a5f7-47b6-aedc-688562f13cc4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:49.012800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ba26460-a5f7-47b6-aedc-688562f13cc4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:49.013519 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ba26460-a5f7-47b6-aedc-688562f13cc4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:49.014284 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ba26460-a5f7-47b6-aedc-688562f13cc4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:49.014766 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ba26460-a5f7-47b6-aedc-688562f13cc4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:49.015296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ba26460-a5f7-47b6-aedc-688562f13cc4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:49.270541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6ba26460-a5f7-47b6-aedc-688562f13cc4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:49.278873 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6ba26460-a5f7-47b6-aedc-688562f13cc4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba" status: 200 len: 1690 microversion: 2.1 time: 0.280989 Aug 24 11:24:49.279683 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3843/7321] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:48 2022] GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba => generated 1690 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:50.302137 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b7a15454-3e35-421f-aa0a-d716891b18be tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:50.302854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b7a15454-3e35-421f-aa0a-d716891b18be tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:50.310896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7a15454-3e35-421f-aa0a-d716891b18be tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:50.311377 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7a15454-3e35-421f-aa0a-d716891b18be tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:50.311852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7a15454-3e35-421f-aa0a-d716891b18be tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:50.312609 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7a15454-3e35-421f-aa0a-d716891b18be tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:50.313075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7a15454-3e35-421f-aa0a-d716891b18be tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:50.313521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7a15454-3e35-421f-aa0a-d716891b18be tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:50.584625 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b7a15454-3e35-421f-aa0a-d716891b18be tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:50.593361 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b7a15454-3e35-421f-aa0a-d716891b18be tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba" status: 200 len: 1690 microversion: 2.1 time: 0.295636 Aug 24 11:24:50.593972 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3479/7322] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:50 2022] GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba => generated 1690 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:51.301807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-ebfd0b8f-de97-4009-99d0-9f4683fee5b9 req-73d676c9-f6e6-4d4c-ac0d-d95f54a37a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b6c6a67-bc31-4378-ac77-e3e52def8fba", "name": "network-vif-deleted", "tag": "7d1d18a2-f8f6-4456-94ef-bb5ee6296dbe"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:51.312274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ebfd0b8f-de97-4009-99d0-9f4683fee5b9 req-73d676c9-f6e6-4d4c-ac0d-d95f54a37a83 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:51.312774 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ebfd0b8f-de97-4009-99d0-9f4683fee5b9 req-73d676c9-f6e6-4d4c-ac0d-d95f54a37a83 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:51.314051 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ebfd0b8f-de97-4009-99d0-9f4683fee5b9 req-73d676c9-f6e6-4d4c-ac0d-d95f54a37a83 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:51.325569 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-ebfd0b8f-de97-4009-99d0-9f4683fee5b9 req-73d676c9-f6e6-4d4c-ac0d-d95f54a37a83 service nova] Creating event network-vif-deleted:7d1d18a2-f8f6-4456-94ef-bb5ee6296dbe for instance 7b6c6a67-bc31-4378-ac77-e3e52def8fba on n-h2-849328-3 Aug 24 11:24:51.330781 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-ebfd0b8f-de97-4009-99d0-9f4683fee5b9 req-73d676c9-f6e6-4d4c-ac0d-d95f54a37a83 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091964 Aug 24 11:24:51.331376 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3844/7323] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:51.617400 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9584fa14-ba06-4810-8d75-5d65b0283458 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:51.617998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9584fa14-ba06-4810-8d75-5d65b0283458 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:51.624502 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9584fa14-ba06-4810-8d75-5d65b0283458 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:51.625025 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9584fa14-ba06-4810-8d75-5d65b0283458 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:51.625497 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9584fa14-ba06-4810-8d75-5d65b0283458 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:51.626199 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9584fa14-ba06-4810-8d75-5d65b0283458 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:51.626667 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9584fa14-ba06-4810-8d75-5d65b0283458 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:51.627090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9584fa14-ba06-4810-8d75-5d65b0283458 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:51.672371 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9584fa14-ba06-4810-8d75-5d65b0283458 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:51.673062 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9584fa14-ba06-4810-8d75-5d65b0283458 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:51.673905 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9584fa14-ba06-4810-8d75-5d65b0283458 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:51.674484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-9584fa14-ba06-4810-8d75-5d65b0283458 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lazy-loading 'fault' on Instance uuid 7b6c6a67-bc31-4378-ac77-e3e52def8fba {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:24:51.718598 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9584fa14-ba06-4810-8d75-5d65b0283458 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:51.726723 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9584fa14-ba06-4810-8d75-5d65b0283458 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba" status: 200 len: 1357 microversion: 2.1 time: 0.114861 Aug 24 11:24:51.727323 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3480/7324] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:51 2022] GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba => generated 1357 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:52.752081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2008a82e-00de-4e55-af46-72448d1c7edc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:52.752787 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2008a82e-00de-4e55-af46-72448d1c7edc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 7b6c6a67-bc31-4378-ac77-e3e52def8fba] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:52.760562 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2008a82e-00de-4e55-af46-72448d1c7edc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:52.761154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2008a82e-00de-4e55-af46-72448d1c7edc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:52.761548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2008a82e-00de-4e55-af46-72448d1c7edc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:52.762256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2008a82e-00de-4e55-af46-72448d1c7edc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:52.762720 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2008a82e-00de-4e55-af46-72448d1c7edc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:52.763152 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2008a82e-00de-4e55-af46-72448d1c7edc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:52.777943 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-2008a82e-00de-4e55-af46-72448d1c7edc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] HTTP exception thrown: Instance 7b6c6a67-bc31-4378-ac77-e3e52def8fba could not be found. Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2008a82e-00de-4e55-af46-72448d1c7edc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Request method failure captured: Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba HTTP/1.1 Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgncfDWps3oSnkGWh604hOpiheCjj8_0BYAjCgEtswuOyN76lOlAH_8p8Uj7QuLZqZrHJqGhmKvQcmRgQjYyq3xw0zzP1xAec9u3lQcKsftkv7yoMv-UqmOKrubG7PpaZzLpooDFEsUT2iVLZk3IHgmNHmgtRKVhQiSyHbimZM2IotU Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 36574fcb42ea44ca970b5bfa9697af8c Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1665657358 Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/36574fcb42ea44ca970b5bfa9697af8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_36574fcb42ea44ca970b5bfa9697af8c", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/36574fcb42ea44ca970b5bfa9697af8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/36574fcb42ea44ca970b5bfa9697af8c"}]}] Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1665657358 Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 36574fcb42ea44ca970b5bfa9697af8c Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1665657358 Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestNetworkAdvancedServerOps-1665657358-project Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: ab7f1eb7298e4cad86ad953eac53c9c3 Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1665657358-project Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 7b6c6a67-bc31-4378-ac77-e3e52def8fba could not be found. Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '7b6c6a67-bc31-4378-ac77-e3e52def8fba'} Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b6c6a67-bc31-4378-ac77-e3e52def8fba could not be found. Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b6c6a67-bc31-4378-ac77-e3e52def8fba could not be found. Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:24:52.779737 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:24:52.784110 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:24:52.784110 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:24:52.784110 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:24:52.784110 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:24:52.784110 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:24:52.784110 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:24:52.784110 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b6c6a67-bc31-4378-ac77-e3e52def8fba could not be found. Aug 24 11:24:52.784110 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:24:52.784110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2008a82e-00de-4e55-af46-72448d1c7edc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Returning 404 to user: Instance 7b6c6a67-bc31-4378-ac77-e3e52def8fba could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:24:52.784110 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2008a82e-00de-4e55-af46-72448d1c7edc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba" status: 404 len: 111 microversion: 2.1 time: 0.034693 Aug 24 11:24:52.784110 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3845/7325] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:52 2022] GET /compute/v2.1/servers/7b6c6a67-bc31-4378-ac77-e3e52def8fba => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:24:56.130671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-756833dc-51f1-44b3-b485-ba810f4dda3f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '.version_select at 0x7f465505edc0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:56.154317 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-756833dc-51f1-44b3-b485-ba810f4dda3f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2009877323" status: 202 len: 0 microversion: 2.1 time: 0.027491 Aug 24 11:24:56.154954 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3481/7326] 10.222.0.85 () {58 vars in 1284 bytes} [Wed Aug 24 11:24:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2009877323 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:24:56.179316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e853fd6e-6f2b-4cfd-b6bb-4ebac10205df tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'create', calling method: .version_select at 0x7f465a1dd790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-902488205", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF20/vOP8Ru1Hz4aY8xnSC49uqUKdee1CYnPqkC5FO7izncfaR8EjpGCf27XpJ3P9zateqdWzjnp++6iScGZ55zDPWqshSYqlLg67A0Mc3eVHNUoVYWc/R+9Zj5V3NqyLw=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:56.198109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-e853fd6e-6f2b-4cfd-b6bb-4ebac10205df tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Getting quotas for project 36574fcb42ea44ca970b5bfa9697af8c. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:24:56.204537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-e853fd6e-6f2b-4cfd-b6bb-4ebac10205df tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Getting quotas for user ab7f1eb7298e4cad86ad953eac53c9c3 and project 36574fcb42ea44ca970b5bfa9697af8c. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:24:56.235222 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e853fd6e-6f2b-4cfd-b6bb-4ebac10205df tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.060022 Aug 24 11:24:56.235945 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3846/7327] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 11:24:56 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:25:02.332210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a005f1b2-1809-4139-8060-5054eaba3be7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1722655865", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "3f91a58c-ebfc-4451-acad-db876781bc3e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-902488205", "security_groups": [{"name": "tempest-secgroup-smoke-1374773477"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:25:02.343301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:02.451512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-a005f1b2-1809-4139-8060-5054eaba3be7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] validate_networks() for [('3f91a58c-ebfc-4451-acad-db876781bc3e', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:25:02.981468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-a005f1b2-1809-4139-8060-5054eaba3be7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:25:02.982125 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-a005f1b2-1809-4139-8060-5054eaba3be7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:25:02.982605 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-a005f1b2-1809-4139-8060-5054eaba3be7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:25:02.983020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-a005f1b2-1809-4139-8060-5054eaba3be7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:25:02.983730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-a005f1b2-1809-4139-8060-5054eaba3be7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:25:02.993848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a005f1b2-1809-4139-8060-5054eaba3be7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:02.994680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a005f1b2-1809-4139-8060-5054eaba3be7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:02.995343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a005f1b2-1809-4139-8060-5054eaba3be7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:02.996290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a005f1b2-1809-4139-8060-5054eaba3be7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:02.997027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a005f1b2-1809-4139-8060-5054eaba3be7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:02.997716 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a005f1b2-1809-4139-8060-5054eaba3be7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:03.018717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-a005f1b2-1809-4139-8060-5054eaba3be7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Getting quotas for project 36574fcb42ea44ca970b5bfa9697af8c. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:25:03.025264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-a005f1b2-1809-4139-8060-5054eaba3be7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Getting quotas for user ab7f1eb7298e4cad86ad953eac53c9c3 and project 36574fcb42ea44ca970b5bfa9697af8c. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:25:03.039553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a005f1b2-1809-4139-8060-5054eaba3be7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:25:03.042257 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a005f1b2-1809-4139-8060-5054eaba3be7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:25:03.094344 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a005f1b2-1809-4139-8060-5054eaba3be7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.766572 Aug 24 11:25:03.102131 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3482/7328] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 11:25:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 11:25:03.105546 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=16 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:03.110690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-604796d3-ef95-4c2a-8985-a1add057dbcf tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:03.111319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-604796d3-ef95-4c2a-8985-a1add057dbcf tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:03.221032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-604796d3-ef95-4c2a-8985-a1add057dbcf tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:03.231895 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-604796d3-ef95-4c2a-8985-a1add057dbcf tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1266 microversion: 2.1 time: 0.127332 Aug 24 11:25:03.235926 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3847/7329] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:03 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1266 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:04.258164 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-36fd3f95-c150-4cfb-a1d6-1ed162641451 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:04.259569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-36fd3f95-c150-4cfb-a1d6-1ed162641451 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:04.273420 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36fd3f95-c150-4cfb-a1d6-1ed162641451 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:04.274347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36fd3f95-c150-4cfb-a1d6-1ed162641451 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:04.275561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36fd3f95-c150-4cfb-a1d6-1ed162641451 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:04.276493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36fd3f95-c150-4cfb-a1d6-1ed162641451 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:04.278837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36fd3f95-c150-4cfb-a1d6-1ed162641451 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:04.279489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36fd3f95-c150-4cfb-a1d6-1ed162641451 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:04.389525 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-36fd3f95-c150-4cfb-a1d6-1ed162641451 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:04.399231 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-36fd3f95-c150-4cfb-a1d6-1ed162641451 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1336 microversion: 2.1 time: 0.147344 Aug 24 11:25:04.400040 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3483/7330] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:04 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1336 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:05.420318 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-98c8614f-147b-47b4-824a-9be7a004bcd5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:05.421492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-98c8614f-147b-47b4-824a-9be7a004bcd5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:05.429504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98c8614f-147b-47b4-824a-9be7a004bcd5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:05.430108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98c8614f-147b-47b4-824a-9be7a004bcd5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:05.430625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98c8614f-147b-47b4-824a-9be7a004bcd5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:05.431447 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98c8614f-147b-47b4-824a-9be7a004bcd5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:05.431991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98c8614f-147b-47b4-824a-9be7a004bcd5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:05.432505 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98c8614f-147b-47b4-824a-9be7a004bcd5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:05.667382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-98c8614f-147b-47b4-824a-9be7a004bcd5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:05.675567 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-98c8614f-147b-47b4-824a-9be7a004bcd5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1392 microversion: 2.1 time: 0.259292 Aug 24 11:25:05.676314 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3848/7331] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:05 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1392 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:05.793589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c79da7b1-515e-40bc-ba18-d4a531c6419d req-10989210-840f-4565-a338-f7e2e9be43ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "927efccc-0497-419c-8aa5-faabadd15c24", "tag": "2ccf95ae-c951-43b0-ad29-ab5899ac6622"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:25:05.805287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c79da7b1-515e-40bc-ba18-d4a531c6419d req-10989210-840f-4565-a338-f7e2e9be43ee service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:05.806082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c79da7b1-515e-40bc-ba18-d4a531c6419d req-10989210-840f-4565-a338-f7e2e9be43ee service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:05.806750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c79da7b1-515e-40bc-ba18-d4a531c6419d req-10989210-840f-4565-a338-f7e2e9be43ee service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:05.821963 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c79da7b1-515e-40bc-ba18-d4a531c6419d req-10989210-840f-4565-a338-f7e2e9be43ee service nova] Creating event network-changed:2ccf95ae-c951-43b0-ad29-ab5899ac6622 for instance 927efccc-0497-419c-8aa5-faabadd15c24 on n-h1-849328-3 Aug 24 11:25:05.827423 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c79da7b1-515e-40bc-ba18-d4a531c6419d req-10989210-840f-4565-a338-f7e2e9be43ee service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038002 Aug 24 11:25:05.828809 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3484/7332] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:25:06.698285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bae3cb28-0bea-4d45-b1b4-87cfb7c0aa92 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:06.699122 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bae3cb28-0bea-4d45-b1b4-87cfb7c0aa92 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:06.708970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bae3cb28-0bea-4d45-b1b4-87cfb7c0aa92 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:06.709762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bae3cb28-0bea-4d45-b1b4-87cfb7c0aa92 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:06.710367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bae3cb28-0bea-4d45-b1b4-87cfb7c0aa92 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:06.711336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bae3cb28-0bea-4d45-b1b4-87cfb7c0aa92 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:06.711975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bae3cb28-0bea-4d45-b1b4-87cfb7c0aa92 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:06.712561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bae3cb28-0bea-4d45-b1b4-87cfb7c0aa92 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:06.868836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bae3cb28-0bea-4d45-b1b4-87cfb7c0aa92 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:06.877383 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bae3cb28-0bea-4d45-b1b4-87cfb7c0aa92 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1392 microversion: 2.1 time: 0.184369 Aug 24 11:25:06.877927 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3849/7333] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:06 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:07.905363 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dff7f8b5-2576-411d-9a74-112fd2f2a887 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:07.906494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dff7f8b5-2576-411d-9a74-112fd2f2a887 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:07.916931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dff7f8b5-2576-411d-9a74-112fd2f2a887 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:07.917784 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dff7f8b5-2576-411d-9a74-112fd2f2a887 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:07.918493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dff7f8b5-2576-411d-9a74-112fd2f2a887 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:07.919506 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dff7f8b5-2576-411d-9a74-112fd2f2a887 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:07.919971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dff7f8b5-2576-411d-9a74-112fd2f2a887 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:07.920413 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dff7f8b5-2576-411d-9a74-112fd2f2a887 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:08.056279 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dff7f8b5-2576-411d-9a74-112fd2f2a887 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:08.064292 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dff7f8b5-2576-411d-9a74-112fd2f2a887 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1392 microversion: 2.1 time: 0.167720 Aug 24 11:25:08.064892 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3485/7334] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:07 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:09.089086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7faafcf7-f588-4ca4-8af5-866a297ccd6f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:09.090270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7faafcf7-f588-4ca4-8af5-866a297ccd6f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:09.101901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7faafcf7-f588-4ca4-8af5-866a297ccd6f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:09.102729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7faafcf7-f588-4ca4-8af5-866a297ccd6f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:09.103585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7faafcf7-f588-4ca4-8af5-866a297ccd6f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:09.104801 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7faafcf7-f588-4ca4-8af5-866a297ccd6f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:09.105624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7faafcf7-f588-4ca4-8af5-866a297ccd6f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:09.106347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7faafcf7-f588-4ca4-8af5-866a297ccd6f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:09.239829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7faafcf7-f588-4ca4-8af5-866a297ccd6f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:09.247877 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7faafcf7-f588-4ca4-8af5-866a297ccd6f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1392 microversion: 2.1 time: 0.165248 Aug 24 11:25:09.248481 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3850/7335] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:09 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:10.270050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3740e384-10e4-42ee-8787-8105fbbf2088 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:10.270931 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3740e384-10e4-42ee-8787-8105fbbf2088 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:10.279769 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3740e384-10e4-42ee-8787-8105fbbf2088 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:10.280269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3740e384-10e4-42ee-8787-8105fbbf2088 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:10.280717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3740e384-10e4-42ee-8787-8105fbbf2088 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:10.281465 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3740e384-10e4-42ee-8787-8105fbbf2088 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:10.281925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3740e384-10e4-42ee-8787-8105fbbf2088 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:10.282358 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3740e384-10e4-42ee-8787-8105fbbf2088 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:10.444436 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3740e384-10e4-42ee-8787-8105fbbf2088 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:10.452639 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3740e384-10e4-42ee-8787-8105fbbf2088 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1392 microversion: 2.1 time: 0.187860 Aug 24 11:25:10.453244 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3486/7336] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:10 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1392 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:11.306344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-bd7f5450-d1b8-4192-a535-0a14ff4cc5ac req-da6e4357-7592-4b7d-a84e-222d3d8b2a69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "927efccc-0497-419c-8aa5-faabadd15c24", "name": "network-vif-plugged", "status": "completed", "tag": "2ccf95ae-c951-43b0-ad29-ab5899ac6622"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:25:11.312459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:11.319122 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bd7f5450-d1b8-4192-a535-0a14ff4cc5ac req-da6e4357-7592-4b7d-a84e-222d3d8b2a69 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:11.320120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bd7f5450-d1b8-4192-a535-0a14ff4cc5ac req-da6e4357-7592-4b7d-a84e-222d3d8b2a69 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:11.320747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bd7f5450-d1b8-4192-a535-0a14ff4cc5ac req-da6e4357-7592-4b7d-a84e-222d3d8b2a69 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:11.335851 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-bd7f5450-d1b8-4192-a535-0a14ff4cc5ac req-da6e4357-7592-4b7d-a84e-222d3d8b2a69 service nova] Creating event network-vif-plugged:2ccf95ae-c951-43b0-ad29-ab5899ac6622 for instance 927efccc-0497-419c-8aa5-faabadd15c24 on n-h1-849328-3 Aug 24 11:25:11.340943 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-bd7f5450-d1b8-4192-a535-0a14ff4cc5ac req-da6e4357-7592-4b7d-a84e-222d3d8b2a69 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038528 Aug 24 11:25:11.341620 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3851/7337] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:25:11.476495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-565c256d-268f-4e09-9596-98e4e9020a47 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:11.477095 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-565c256d-268f-4e09-9596-98e4e9020a47 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:11.484251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-565c256d-268f-4e09-9596-98e4e9020a47 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:11.484736 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-565c256d-268f-4e09-9596-98e4e9020a47 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:11.485190 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-565c256d-268f-4e09-9596-98e4e9020a47 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:11.485888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-565c256d-268f-4e09-9596-98e4e9020a47 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:11.486994 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-565c256d-268f-4e09-9596-98e4e9020a47 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:11.486994 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-565c256d-268f-4e09-9596-98e4e9020a47 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:11.624877 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-565c256d-268f-4e09-9596-98e4e9020a47 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:11.632992 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-565c256d-268f-4e09-9596-98e4e9020a47 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1392 microversion: 2.1 time: 0.160850 Aug 24 11:25:11.633623 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3487/7338] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:11 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:12.656016 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ea4d712f-e903-4e4c-be5c-8869cf825a94 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:12.656713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ea4d712f-e903-4e4c-be5c-8869cf825a94 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:12.663389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea4d712f-e903-4e4c-be5c-8869cf825a94 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:12.663887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea4d712f-e903-4e4c-be5c-8869cf825a94 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:12.664333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea4d712f-e903-4e4c-be5c-8869cf825a94 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:12.665049 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea4d712f-e903-4e4c-be5c-8869cf825a94 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:12.665576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea4d712f-e903-4e4c-be5c-8869cf825a94 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:12.666013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea4d712f-e903-4e4c-be5c-8869cf825a94 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:12.812465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ea4d712f-e903-4e4c-be5c-8869cf825a94 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:12.824261 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ea4d712f-e903-4e4c-be5c-8869cf825a94 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1564 microversion: 2.1 time: 0.173688 Aug 24 11:25:12.825058 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3852/7339] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:12 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1564 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:12.845978 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c254ae05-e370-4a6f-a644-ba9bb569840a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:12.846543 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c254ae05-e370-4a6f-a644-ba9bb569840a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:12.854303 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c254ae05-e370-4a6f-a644-ba9bb569840a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:12.855034 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c254ae05-e370-4a6f-a644-ba9bb569840a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:12.855482 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c254ae05-e370-4a6f-a644-ba9bb569840a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:12.856674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c254ae05-e370-4a6f-a644-ba9bb569840a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:12.857149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c254ae05-e370-4a6f-a644-ba9bb569840a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:12.857622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c254ae05-e370-4a6f-a644-ba9bb569840a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:12.998746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c254ae05-e370-4a6f-a644-ba9bb569840a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:13.006844 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c254ae05-e370-4a6f-a644-ba9bb569840a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1564 microversion: 2.1 time: 0.164978 Aug 24 11:25:13.007438 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3488/7340] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:12 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:14.655839 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c19b3f8e-6f10-4a02-8870-a40b908601ab tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:14.656440 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c19b3f8e-6f10-4a02-8870-a40b908601ab tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:14.661685 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e099cf25-d1c1-4572-9168-b319813da65e req-9f8d9b34-04de-4f70-8f21-3d4e3882a7b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "927efccc-0497-419c-8aa5-faabadd15c24", "tag": "2ccf95ae-c951-43b0-ad29-ab5899ac6622"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:25:14.666597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:14.668965 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:14.674629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:14.676363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c19b3f8e-6f10-4a02-8870-a40b908601ab tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:14.677731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c19b3f8e-6f10-4a02-8870-a40b908601ab tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:14.678104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c19b3f8e-6f10-4a02-8870-a40b908601ab tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:14.678763 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c19b3f8e-6f10-4a02-8870-a40b908601ab tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:14.679269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c19b3f8e-6f10-4a02-8870-a40b908601ab tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:14.679711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c19b3f8e-6f10-4a02-8870-a40b908601ab tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:14.681983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e099cf25-d1c1-4572-9168-b319813da65e req-9f8d9b34-04de-4f70-8f21-3d4e3882a7b4 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:14.682460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e099cf25-d1c1-4572-9168-b319813da65e req-9f8d9b34-04de-4f70-8f21-3d4e3882a7b4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:14.683086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e099cf25-d1c1-4572-9168-b319813da65e req-9f8d9b34-04de-4f70-8f21-3d4e3882a7b4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:14.695903 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e099cf25-d1c1-4572-9168-b319813da65e req-9f8d9b34-04de-4f70-8f21-3d4e3882a7b4 service nova] Creating event network-changed:2ccf95ae-c951-43b0-ad29-ab5899ac6622 for instance 927efccc-0497-419c-8aa5-faabadd15c24 on n-h1-849328-3 Aug 24 11:25:14.701480 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e099cf25-d1c1-4572-9168-b319813da65e req-9f8d9b34-04de-4f70-8f21-3d4e3882a7b4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043340 Aug 24 11:25:14.702429 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3489/7341] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:25:14.924612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c19b3f8e-6f10-4a02-8870-a40b908601ab tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:14.933873 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c19b3f8e-6f10-4a02-8870-a40b908601ab tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1564 microversion: 2.1 time: 0.282090 Aug 24 11:25:14.934770 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3853/7342] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:14 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1564 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:38.227951 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:38.228640 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=36 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:38.233103 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5154ad81-316d-4204-8df2-442125f5cba6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:25:38.235455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5154ad81-316d-4204-8df2-442125f5cba6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:38.243409 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5154ad81-316d-4204-8df2-442125f5cba6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:38.243902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5154ad81-316d-4204-8df2-442125f5cba6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:38.244344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5154ad81-316d-4204-8df2-442125f5cba6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:38.245047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5154ad81-316d-4204-8df2-442125f5cba6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:38.245593 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5154ad81-316d-4204-8df2-442125f5cba6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:38.246028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5154ad81-316d-4204-8df2-442125f5cba6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:38.314579 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5154ad81-316d-4204-8df2-442125f5cba6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24/action" status: 200 len: 24566 microversion: 2.1 time: 0.088402 Aug 24 11:25:38.315239 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3490/7343] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:25:38 2022] POST /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24/action => generated 24566 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:25:44.686937 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-502f9991-1df2-4d1a-922e-f518874edba8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:25:44.690098 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-502f9991-1df2-4d1a-922e-f518874edba8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:44.692721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=5 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:44.693463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=32 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:44.700515 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-502f9991-1df2-4d1a-922e-f518874edba8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:44.701012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-502f9991-1df2-4d1a-922e-f518874edba8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:44.701500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-502f9991-1df2-4d1a-922e-f518874edba8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:44.702204 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-502f9991-1df2-4d1a-922e-f518874edba8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:44.702677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-502f9991-1df2-4d1a-922e-f518874edba8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:44.703131 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-502f9991-1df2-4d1a-922e-f518874edba8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:44.791248 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-502f9991-1df2-4d1a-922e-f518874edba8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:44.797974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-502f9991-1df2-4d1a-922e-f518874edba8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Old instance type m1.heat2, new instance type m1.heat {{(pid=122433) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 11:25:44.807799 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-502f9991-1df2-4d1a-922e-f518874edba8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:25:44.808241 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-502f9991-1df2-4d1a-922e-f518874edba8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:25:44.808911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-502f9991-1df2-4d1a-922e-f518874edba8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:25:44.809622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-502f9991-1df2-4d1a-922e-f518874edba8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:25:44.810357 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-502f9991-1df2-4d1a-922e-f518874edba8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:25:44.885382 n-d-849328-3 devstack@n-api.service[122433]: ERROR oslo.messaging._drivers.impl_rabbit [None req-502f9991-1df2-4d1a-922e-f518874edba8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [4a8aa9be-e4e1-482d-abcb-73a80a47b19f] AMQP server on 10.222.0.85:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 11:25:45.895080 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [None req-502f9991-1df2-4d1a-922e-f518874edba8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [4a8aa9be-e4e1-482d-abcb-73a80a47b19f] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 57058. Aug 24 11:25:45.898707 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-502f9991-1df2-4d1a-922e-f518874edba8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24/action" status: 202 len: 0 microversion: 2.1 time: 1.217576 Aug 24 11:25:45.899733 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3854/7344] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:25:44 2022] POST /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24/action => generated 0 bytes in 1219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:25:45.908913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0361df62-3c21-4568-aa50-2bbd87bbefa7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:45.909661 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0361df62-3c21-4568-aa50-2bbd87bbefa7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:45.917320 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0361df62-3c21-4568-aa50-2bbd87bbefa7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:45.917819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0361df62-3c21-4568-aa50-2bbd87bbefa7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:45.918264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0361df62-3c21-4568-aa50-2bbd87bbefa7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:45.919007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0361df62-3c21-4568-aa50-2bbd87bbefa7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:45.919435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0361df62-3c21-4568-aa50-2bbd87bbefa7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:45.919864 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0361df62-3c21-4568-aa50-2bbd87bbefa7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:46.078556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0361df62-3c21-4568-aa50-2bbd87bbefa7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:46.087062 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0361df62-3c21-4568-aa50-2bbd87bbefa7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1691 microversion: 2.1 time: 0.182780 Aug 24 11:25:46.087676 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3491/7345] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:45 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:47.111775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-42be99ae-8b6c-4c8f-95da-eefa970d8797 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:47.112850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-42be99ae-8b6c-4c8f-95da-eefa970d8797 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:47.122492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42be99ae-8b6c-4c8f-95da-eefa970d8797 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:47.123385 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42be99ae-8b6c-4c8f-95da-eefa970d8797 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:47.123995 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42be99ae-8b6c-4c8f-95da-eefa970d8797 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:47.124997 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42be99ae-8b6c-4c8f-95da-eefa970d8797 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:47.125682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42be99ae-8b6c-4c8f-95da-eefa970d8797 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:47.126341 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42be99ae-8b6c-4c8f-95da-eefa970d8797 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:47.287552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-42be99ae-8b6c-4c8f-95da-eefa970d8797 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:47.299871 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-42be99ae-8b6c-4c8f-95da-eefa970d8797 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1691 microversion: 2.1 time: 0.194072 Aug 24 11:25:47.300487 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3855/7346] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:47 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1691 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:48.325975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4e91173d-3b3b-4f9b-8fd8-cb27fcbd5ca0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:48.326853 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4e91173d-3b3b-4f9b-8fd8-cb27fcbd5ca0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:48.338700 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e91173d-3b3b-4f9b-8fd8-cb27fcbd5ca0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:48.339507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e91173d-3b3b-4f9b-8fd8-cb27fcbd5ca0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:48.340239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e91173d-3b3b-4f9b-8fd8-cb27fcbd5ca0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:48.341443 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e91173d-3b3b-4f9b-8fd8-cb27fcbd5ca0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:48.342266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e91173d-3b3b-4f9b-8fd8-cb27fcbd5ca0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:48.342987 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e91173d-3b3b-4f9b-8fd8-cb27fcbd5ca0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:48.481880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4e91173d-3b3b-4f9b-8fd8-cb27fcbd5ca0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:48.490323 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4e91173d-3b3b-4f9b-8fd8-cb27fcbd5ca0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1691 microversion: 2.1 time: 0.171078 Aug 24 11:25:48.490888 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3492/7347] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:48 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:49.514069 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5ac8205c-67ff-4e0d-b56d-78dc9d7201a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:49.514813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5ac8205c-67ff-4e0d-b56d-78dc9d7201a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:49.523764 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ac8205c-67ff-4e0d-b56d-78dc9d7201a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:49.524293 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ac8205c-67ff-4e0d-b56d-78dc9d7201a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:49.524753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ac8205c-67ff-4e0d-b56d-78dc9d7201a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:49.525533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ac8205c-67ff-4e0d-b56d-78dc9d7201a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:49.526003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ac8205c-67ff-4e0d-b56d-78dc9d7201a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:49.526442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ac8205c-67ff-4e0d-b56d-78dc9d7201a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:49.668337 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5ac8205c-67ff-4e0d-b56d-78dc9d7201a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:49.676643 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5ac8205c-67ff-4e0d-b56d-78dc9d7201a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1691 microversion: 2.1 time: 0.168382 Aug 24 11:25:49.677255 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3856/7348] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:49 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:50.702029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4138fe1a-18c0-4fa4-8701-b9027c993cae tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:50.702985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4138fe1a-18c0-4fa4-8701-b9027c993cae tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:50.714701 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4138fe1a-18c0-4fa4-8701-b9027c993cae tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:50.715512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4138fe1a-18c0-4fa4-8701-b9027c993cae tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:50.716246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4138fe1a-18c0-4fa4-8701-b9027c993cae tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:50.717458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4138fe1a-18c0-4fa4-8701-b9027c993cae tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:50.718227 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4138fe1a-18c0-4fa4-8701-b9027c993cae tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:50.718948 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4138fe1a-18c0-4fa4-8701-b9027c993cae tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:50.869563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4138fe1a-18c0-4fa4-8701-b9027c993cae tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:50.878189 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4138fe1a-18c0-4fa4-8701-b9027c993cae tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1691 microversion: 2.1 time: 0.182626 Aug 24 11:25:50.878777 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3493/7349] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:50 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:51.900408 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6e37fa2c-d3ea-4b5a-9299-cc1165db70aa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:51.900992 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6e37fa2c-d3ea-4b5a-9299-cc1165db70aa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:51.908499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e37fa2c-d3ea-4b5a-9299-cc1165db70aa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:51.909003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e37fa2c-d3ea-4b5a-9299-cc1165db70aa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:51.909477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e37fa2c-d3ea-4b5a-9299-cc1165db70aa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:51.910195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e37fa2c-d3ea-4b5a-9299-cc1165db70aa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:51.910661 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e37fa2c-d3ea-4b5a-9299-cc1165db70aa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:51.911098 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e37fa2c-d3ea-4b5a-9299-cc1165db70aa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:52.347936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6e37fa2c-d3ea-4b5a-9299-cc1165db70aa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:52.356210 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6e37fa2c-d3ea-4b5a-9299-cc1165db70aa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1691 microversion: 2.1 time: 0.460058 Aug 24 11:25:52.356790 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3857/7350] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:51 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1691 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:53.381351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9acb418b-b566-4252-acc5-70e4bfb66d61 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:53.382309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9acb418b-b566-4252-acc5-70e4bfb66d61 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:53.394325 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9acb418b-b566-4252-acc5-70e4bfb66d61 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:53.394813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9acb418b-b566-4252-acc5-70e4bfb66d61 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:53.395247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9acb418b-b566-4252-acc5-70e4bfb66d61 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:53.395937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9acb418b-b566-4252-acc5-70e4bfb66d61 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:53.396390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9acb418b-b566-4252-acc5-70e4bfb66d61 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:53.396810 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9acb418b-b566-4252-acc5-70e4bfb66d61 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:53.534351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9acb418b-b566-4252-acc5-70e4bfb66d61 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:53.542626 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9acb418b-b566-4252-acc5-70e4bfb66d61 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1696 microversion: 2.1 time: 0.167989 Aug 24 11:25:53.543208 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3494/7351] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:53 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:54.567131 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-147df6e3-a714-4fad-bed7-2690dac8e0dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:54.567859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-147df6e3-a714-4fad-bed7-2690dac8e0dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:54.574243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-147df6e3-a714-4fad-bed7-2690dac8e0dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:54.574740 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-147df6e3-a714-4fad-bed7-2690dac8e0dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:54.575191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-147df6e3-a714-4fad-bed7-2690dac8e0dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:54.575892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-147df6e3-a714-4fad-bed7-2690dac8e0dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:54.576365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-147df6e3-a714-4fad-bed7-2690dac8e0dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:54.576808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-147df6e3-a714-4fad-bed7-2690dac8e0dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:54.708001 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-147df6e3-a714-4fad-bed7-2690dac8e0dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:54.716546 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-147df6e3-a714-4fad-bed7-2690dac8e0dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1696 microversion: 2.1 time: 0.155058 Aug 24 11:25:54.717534 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3858/7352] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:54 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:55.749833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2cf04290-b988-4a5d-b7dd-d0aab16e0949 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:55.750819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2cf04290-b988-4a5d-b7dd-d0aab16e0949 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:55.762975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cf04290-b988-4a5d-b7dd-d0aab16e0949 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:55.763871 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cf04290-b988-4a5d-b7dd-d0aab16e0949 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:55.764610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cf04290-b988-4a5d-b7dd-d0aab16e0949 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:55.765812 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cf04290-b988-4a5d-b7dd-d0aab16e0949 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:55.766608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cf04290-b988-4a5d-b7dd-d0aab16e0949 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:55.767298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cf04290-b988-4a5d-b7dd-d0aab16e0949 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:55.911664 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2cf04290-b988-4a5d-b7dd-d0aab16e0949 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:55.920105 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2cf04290-b988-4a5d-b7dd-d0aab16e0949 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1696 microversion: 2.1 time: 0.177177 Aug 24 11:25:55.920694 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3495/7353] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:55 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:56.954360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3c2494c2-feef-4c3d-ad08-0f81b85aec6c tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:56.955537 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3c2494c2-feef-4c3d-ad08-0f81b85aec6c tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:56.962724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c2494c2-feef-4c3d-ad08-0f81b85aec6c tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:56.963217 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c2494c2-feef-4c3d-ad08-0f81b85aec6c tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:56.963664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c2494c2-feef-4c3d-ad08-0f81b85aec6c tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:56.964371 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c2494c2-feef-4c3d-ad08-0f81b85aec6c tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:56.964869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c2494c2-feef-4c3d-ad08-0f81b85aec6c tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:56.965346 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c2494c2-feef-4c3d-ad08-0f81b85aec6c tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:57.113154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3c2494c2-feef-4c3d-ad08-0f81b85aec6c tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:57.121042 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3c2494c2-feef-4c3d-ad08-0f81b85aec6c tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1696 microversion: 2.1 time: 0.173296 Aug 24 11:25:57.121737 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3859/7354] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:56 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:58.145550 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-31e1dfd8-782a-4f8e-8564-887a2eede028 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:58.146439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-31e1dfd8-782a-4f8e-8564-887a2eede028 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:58.157968 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31e1dfd8-782a-4f8e-8564-887a2eede028 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:58.158747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31e1dfd8-782a-4f8e-8564-887a2eede028 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:58.159297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31e1dfd8-782a-4f8e-8564-887a2eede028 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:58.159906 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31e1dfd8-782a-4f8e-8564-887a2eede028 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:58.160362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31e1dfd8-782a-4f8e-8564-887a2eede028 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:58.160787 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31e1dfd8-782a-4f8e-8564-887a2eede028 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:58.305989 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-31e1dfd8-782a-4f8e-8564-887a2eede028 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:58.314185 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-31e1dfd8-782a-4f8e-8564-887a2eede028 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1696 microversion: 2.1 time: 0.174856 Aug 24 11:25:58.314882 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3496/7355] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:58 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:59.340631 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fa588559-9676-4bcd-86b2-e43dba80e345 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:59.341487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fa588559-9676-4bcd-86b2-e43dba80e345 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:59.353495 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa588559-9676-4bcd-86b2-e43dba80e345 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:59.354342 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa588559-9676-4bcd-86b2-e43dba80e345 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:59.355105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa588559-9676-4bcd-86b2-e43dba80e345 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:59.356282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa588559-9676-4bcd-86b2-e43dba80e345 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:59.357079 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa588559-9676-4bcd-86b2-e43dba80e345 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:59.357869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa588559-9676-4bcd-86b2-e43dba80e345 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:59.504137 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fa588559-9676-4bcd-86b2-e43dba80e345 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:59.512426 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fa588559-9676-4bcd-86b2-e43dba80e345 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1696 microversion: 2.1 time: 0.178536 Aug 24 11:25:59.513052 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3860/7356] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:59 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:00.534333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4b10ff8a-1c30-4014-aeaf-8a804a8821cf tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:00.534956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4b10ff8a-1c30-4014-aeaf-8a804a8821cf tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:00.542540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b10ff8a-1c30-4014-aeaf-8a804a8821cf tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:00.543030 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b10ff8a-1c30-4014-aeaf-8a804a8821cf tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:00.543467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b10ff8a-1c30-4014-aeaf-8a804a8821cf tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:00.544286 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b10ff8a-1c30-4014-aeaf-8a804a8821cf tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:00.544746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b10ff8a-1c30-4014-aeaf-8a804a8821cf tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:00.545170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b10ff8a-1c30-4014-aeaf-8a804a8821cf tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:00.694678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4b10ff8a-1c30-4014-aeaf-8a804a8821cf tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:00.704962 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4b10ff8a-1c30-4014-aeaf-8a804a8821cf tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1696 microversion: 2.1 time: 0.174641 Aug 24 11:26:00.705648 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3497/7357] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:00 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:01.731344 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-470a2b5d-6e4d-4cf8-a7e1-94cf9b8bf76a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:01.732415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-470a2b5d-6e4d-4cf8-a7e1-94cf9b8bf76a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:01.741386 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-470a2b5d-6e4d-4cf8-a7e1-94cf9b8bf76a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:01.741890 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-470a2b5d-6e4d-4cf8-a7e1-94cf9b8bf76a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:01.742346 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-470a2b5d-6e4d-4cf8-a7e1-94cf9b8bf76a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:01.743070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-470a2b5d-6e4d-4cf8-a7e1-94cf9b8bf76a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:01.743553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-470a2b5d-6e4d-4cf8-a7e1-94cf9b8bf76a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:01.743972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-470a2b5d-6e4d-4cf8-a7e1-94cf9b8bf76a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:01.885967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-470a2b5d-6e4d-4cf8-a7e1-94cf9b8bf76a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:01.894449 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-470a2b5d-6e4d-4cf8-a7e1-94cf9b8bf76a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1696 microversion: 2.1 time: 0.169715 Aug 24 11:26:01.895246 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3861/7358] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:01 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:02.919749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1a43d24b-fc75-4da9-b79a-d35529f9d9f9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:02.920681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1a43d24b-fc75-4da9-b79a-d35529f9d9f9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:02.929038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a43d24b-fc75-4da9-b79a-d35529f9d9f9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:02.929558 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a43d24b-fc75-4da9-b79a-d35529f9d9f9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:02.929990 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a43d24b-fc75-4da9-b79a-d35529f9d9f9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:02.930687 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a43d24b-fc75-4da9-b79a-d35529f9d9f9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:02.931139 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a43d24b-fc75-4da9-b79a-d35529f9d9f9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:02.931560 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a43d24b-fc75-4da9-b79a-d35529f9d9f9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:03.107789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1a43d24b-fc75-4da9-b79a-d35529f9d9f9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:03.118065 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1a43d24b-fc75-4da9-b79a-d35529f9d9f9 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1696 microversion: 2.1 time: 0.204796 Aug 24 11:26:03.118727 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3498/7359] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:02 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1696 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:04.144606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f14096a5-243e-4ec7-8606-09a9788c4ade tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:04.145724 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f14096a5-243e-4ec7-8606-09a9788c4ade tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:04.157400 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f14096a5-243e-4ec7-8606-09a9788c4ade tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:04.158259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f14096a5-243e-4ec7-8606-09a9788c4ade tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:04.158708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f14096a5-243e-4ec7-8606-09a9788c4ade tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:04.159412 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f14096a5-243e-4ec7-8606-09a9788c4ade tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:04.159877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f14096a5-243e-4ec7-8606-09a9788c4ade tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:04.160310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f14096a5-243e-4ec7-8606-09a9788c4ade tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:04.297198 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f14096a5-243e-4ec7-8606-09a9788c4ade tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:04.308980 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f14096a5-243e-4ec7-8606-09a9788c4ade tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1696 microversion: 2.1 time: 0.170804 Aug 24 11:26:04.309786 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3862/7360] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:04 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:05.332640 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-199d84da-5c80-4a6a-921c-6f119e28b3cf tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:05.333251 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-199d84da-5c80-4a6a-921c-6f119e28b3cf tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:05.340832 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-199d84da-5c80-4a6a-921c-6f119e28b3cf tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:05.341355 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-199d84da-5c80-4a6a-921c-6f119e28b3cf tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:05.341798 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-199d84da-5c80-4a6a-921c-6f119e28b3cf tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:05.342489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-199d84da-5c80-4a6a-921c-6f119e28b3cf tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:05.342945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-199d84da-5c80-4a6a-921c-6f119e28b3cf tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:05.343375 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-199d84da-5c80-4a6a-921c-6f119e28b3cf tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:05.361172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c19d6cbe-c1ad-41b4-9440-6e6159d867d0 req-54b5b066-80c6-417a-a337-f54afa0d7f25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "927efccc-0497-419c-8aa5-faabadd15c24", "name": "network-vif-unplugged", "status": "completed", "tag": "2ccf95ae-c951-43b0-ad29-ab5899ac6622"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:05.373435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c19d6cbe-c1ad-41b4-9440-6e6159d867d0 req-54b5b066-80c6-417a-a337-f54afa0d7f25 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:05.373929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c19d6cbe-c1ad-41b4-9440-6e6159d867d0 req-54b5b066-80c6-417a-a337-f54afa0d7f25 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:05.374561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c19d6cbe-c1ad-41b4-9440-6e6159d867d0 req-54b5b066-80c6-417a-a337-f54afa0d7f25 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:05.388870 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c19d6cbe-c1ad-41b4-9440-6e6159d867d0 req-54b5b066-80c6-417a-a337-f54afa0d7f25 service nova] Creating event network-vif-unplugged:2ccf95ae-c951-43b0-ad29-ab5899ac6622 for instance 927efccc-0497-419c-8aa5-faabadd15c24 on n-h2-849328-3 Aug 24 11:26:05.399325 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-c19d6cbe-c1ad-41b4-9440-6e6159d867d0 req-54b5b066-80c6-417a-a337-f54afa0d7f25 service nova] Instance 927efccc-0497-419c-8aa5-faabadd15c24 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 11:26:05.414235 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c19d6cbe-c1ad-41b4-9440-6e6159d867d0 req-54b5b066-80c6-417a-a337-f54afa0d7f25 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057678 Aug 24 11:26:05.415085 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3863/7361] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:26:05.508706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-199d84da-5c80-4a6a-921c-6f119e28b3cf tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:05.518921 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-199d84da-5c80-4a6a-921c-6f119e28b3cf tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1695 microversion: 2.1 time: 0.190453 Aug 24 11:26:05.519841 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3499/7362] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:05 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1695 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:06.541274 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-24714358-5bb1-42cf-9202-b13fe90e2d26 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:06.542014 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-24714358-5bb1-42cf-9202-b13fe90e2d26 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:06.549701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24714358-5bb1-42cf-9202-b13fe90e2d26 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:06.550196 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24714358-5bb1-42cf-9202-b13fe90e2d26 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:06.550645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24714358-5bb1-42cf-9202-b13fe90e2d26 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:06.551469 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24714358-5bb1-42cf-9202-b13fe90e2d26 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:06.551935 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24714358-5bb1-42cf-9202-b13fe90e2d26 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:06.552368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24714358-5bb1-42cf-9202-b13fe90e2d26 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:06.696798 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-24714358-5bb1-42cf-9202-b13fe90e2d26 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:06.708323 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-24714358-5bb1-42cf-9202-b13fe90e2d26 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1693 microversion: 2.1 time: 0.171473 Aug 24 11:26:06.708955 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3864/7363] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:06 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:07.445769 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-caf38024-5187-4e66-82dd-66c406017375 req-1ea82adf-5118-4db6-93aa-2fb23013f1cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "927efccc-0497-419c-8aa5-faabadd15c24", "tag": "2ccf95ae-c951-43b0-ad29-ab5899ac6622"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:07.457970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-caf38024-5187-4e66-82dd-66c406017375 req-1ea82adf-5118-4db6-93aa-2fb23013f1cf service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:07.458535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-caf38024-5187-4e66-82dd-66c406017375 req-1ea82adf-5118-4db6-93aa-2fb23013f1cf service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:07.458911 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-caf38024-5187-4e66-82dd-66c406017375 req-1ea82adf-5118-4db6-93aa-2fb23013f1cf service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:07.473880 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-caf38024-5187-4e66-82dd-66c406017375 req-1ea82adf-5118-4db6-93aa-2fb23013f1cf service nova] Creating event network-changed:2ccf95ae-c951-43b0-ad29-ab5899ac6622 for instance 927efccc-0497-419c-8aa5-faabadd15c24 on n-h2-849328-3 Aug 24 11:26:07.479578 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-caf38024-5187-4e66-82dd-66c406017375 req-1ea82adf-5118-4db6-93aa-2fb23013f1cf service nova] Instance 927efccc-0497-419c-8aa5-faabadd15c24 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849328-3', 'n-h2-849328-3'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 11:26:07.492454 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-caf38024-5187-4e66-82dd-66c406017375 req-1ea82adf-5118-4db6-93aa-2fb23013f1cf service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050212 Aug 24 11:26:07.494112 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3500/7364] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:26:07.730582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6f3c8d3a-5794-41c4-b1a5-9a32fd0a28a2 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:07.731226 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6f3c8d3a-5794-41c4-b1a5-9a32fd0a28a2 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:07.739443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f3c8d3a-5794-41c4-b1a5-9a32fd0a28a2 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:07.739974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f3c8d3a-5794-41c4-b1a5-9a32fd0a28a2 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:07.740415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f3c8d3a-5794-41c4-b1a5-9a32fd0a28a2 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:07.741167 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f3c8d3a-5794-41c4-b1a5-9a32fd0a28a2 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:07.741979 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f3c8d3a-5794-41c4-b1a5-9a32fd0a28a2 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:07.742642 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f3c8d3a-5794-41c4-b1a5-9a32fd0a28a2 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:08.041617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6f3c8d3a-5794-41c4-b1a5-9a32fd0a28a2 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:08.050231 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6f3c8d3a-5794-41c4-b1a5-9a32fd0a28a2 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1693 microversion: 2.1 time: 0.323031 Aug 24 11:26:08.050231 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3865/7365] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:07 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1693 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:09.073883 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-85658fcf-fab3-42c1-9336-d9440cd2f889 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:09.074677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-85658fcf-fab3-42c1-9336-d9440cd2f889 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:09.076726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=23 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:09.082795 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85658fcf-fab3-42c1-9336-d9440cd2f889 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:09.083350 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85658fcf-fab3-42c1-9336-d9440cd2f889 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:09.083872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85658fcf-fab3-42c1-9336-d9440cd2f889 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:09.084691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85658fcf-fab3-42c1-9336-d9440cd2f889 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:09.085142 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85658fcf-fab3-42c1-9336-d9440cd2f889 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:09.085589 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85658fcf-fab3-42c1-9336-d9440cd2f889 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:09.089919 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=63 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:09.242838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-85658fcf-fab3-42c1-9336-d9440cd2f889 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:09.250487 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-85658fcf-fab3-42c1-9336-d9440cd2f889 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1690 microversion: 2.1 time: 0.181771 Aug 24 11:26:09.251032 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3501/7366] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:09 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1690 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:09.271320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-63247ef6-f46d-4098-8cb0-62640e8540f4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:09.271899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-63247ef6-f46d-4098-8cb0-62640e8540f4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:09.278969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63247ef6-f46d-4098-8cb0-62640e8540f4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:09.279465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63247ef6-f46d-4098-8cb0-62640e8540f4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:09.279914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63247ef6-f46d-4098-8cb0-62640e8540f4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:09.280619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63247ef6-f46d-4098-8cb0-62640e8540f4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:09.281068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63247ef6-f46d-4098-8cb0-62640e8540f4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:09.281533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63247ef6-f46d-4098-8cb0-62640e8540f4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:09.346549 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-63247ef6-f46d-4098-8cb0-62640e8540f4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24/action" status: 204 len: 0 microversion: 2.1 time: 0.079022 Aug 24 11:26:09.347556 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3866/7367] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:26:09 2022] POST /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:26:09.355732 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fa081fdd-26f2-447f-8631-b4595a2d1588 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:09.356282 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fa081fdd-26f2-447f-8631-b4595a2d1588 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:09.362414 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa081fdd-26f2-447f-8631-b4595a2d1588 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:09.363014 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa081fdd-26f2-447f-8631-b4595a2d1588 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:09.363416 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa081fdd-26f2-447f-8631-b4595a2d1588 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:09.364166 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa081fdd-26f2-447f-8631-b4595a2d1588 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:09.364704 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa081fdd-26f2-447f-8631-b4595a2d1588 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:09.365197 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa081fdd-26f2-447f-8631-b4595a2d1588 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:09.509337 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fa081fdd-26f2-447f-8631-b4595a2d1588 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:09.520553 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fa081fdd-26f2-447f-8631-b4595a2d1588 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1690 microversion: 2.1 time: 0.168777 Aug 24 11:26:09.521350 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3502/7368] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:09 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:09.542336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b150bd33-6d5f-4b99-963d-b02c04ac41da tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:09.543049 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b150bd33-6d5f-4b99-963d-b02c04ac41da tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:09.549654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b150bd33-6d5f-4b99-963d-b02c04ac41da tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:09.550434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b150bd33-6d5f-4b99-963d-b02c04ac41da tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:09.550863 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b150bd33-6d5f-4b99-963d-b02c04ac41da tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:09.551760 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b150bd33-6d5f-4b99-963d-b02c04ac41da tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:09.552228 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b150bd33-6d5f-4b99-963d-b02c04ac41da tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:09.552661 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b150bd33-6d5f-4b99-963d-b02c04ac41da tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:10.084360 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b150bd33-6d5f-4b99-963d-b02c04ac41da tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:10.092733 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b150bd33-6d5f-4b99-963d-b02c04ac41da tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1690 microversion: 2.1 time: 0.554490 Aug 24 11:26:10.093361 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3867/7369] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:09 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1690 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:11.037535 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-af2239c3-9265-4ae5-9b7d-f0c0b3304080 req-322f2f00-d615-406e-b0a7-a59481bab60b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "927efccc-0497-419c-8aa5-faabadd15c24", "name": "network-vif-plugged", "status": "completed", "tag": "2ccf95ae-c951-43b0-ad29-ab5899ac6622"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:11.048964 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-af2239c3-9265-4ae5-9b7d-f0c0b3304080 req-322f2f00-d615-406e-b0a7-a59481bab60b service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:11.049467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-af2239c3-9265-4ae5-9b7d-f0c0b3304080 req-322f2f00-d615-406e-b0a7-a59481bab60b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:11.050064 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-af2239c3-9265-4ae5-9b7d-f0c0b3304080 req-322f2f00-d615-406e-b0a7-a59481bab60b service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:11.063072 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-af2239c3-9265-4ae5-9b7d-f0c0b3304080 req-322f2f00-d615-406e-b0a7-a59481bab60b service nova] Creating event network-vif-plugged:2ccf95ae-c951-43b0-ad29-ab5899ac6622 for instance 927efccc-0497-419c-8aa5-faabadd15c24 on n-h2-849328-3 Aug 24 11:26:11.069446 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-af2239c3-9265-4ae5-9b7d-f0c0b3304080 req-322f2f00-d615-406e-b0a7-a59481bab60b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035460 Aug 24 11:26:11.070182 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3503/7370] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:26:11.114383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4f6971fa-fcd2-4147-bb95-5cc93b47c7cc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:11.114960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4f6971fa-fcd2-4147-bb95-5cc93b47c7cc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:11.122110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f6971fa-fcd2-4147-bb95-5cc93b47c7cc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:11.122619 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f6971fa-fcd2-4147-bb95-5cc93b47c7cc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:11.123070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f6971fa-fcd2-4147-bb95-5cc93b47c7cc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:11.123791 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f6971fa-fcd2-4147-bb95-5cc93b47c7cc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:11.124265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f6971fa-fcd2-4147-bb95-5cc93b47c7cc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:11.124710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f6971fa-fcd2-4147-bb95-5cc93b47c7cc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:11.141349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:11.284663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4f6971fa-fcd2-4147-bb95-5cc93b47c7cc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:11.292884 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4f6971fa-fcd2-4147-bb95-5cc93b47c7cc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1682 microversion: 2.1 time: 0.182584 Aug 24 11:26:11.293516 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3868/7371] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:11 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:35.489113 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=5 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:35.489977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=13 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:35.494507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-87e90ee7-ebff-4cbc-a3e2-3139d498d563 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:35.496886 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-87e90ee7-ebff-4cbc-a3e2-3139d498d563 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:35.507880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87e90ee7-ebff-4cbc-a3e2-3139d498d563 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:35.508359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87e90ee7-ebff-4cbc-a3e2-3139d498d563 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:35.508797 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87e90ee7-ebff-4cbc-a3e2-3139d498d563 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:35.509540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87e90ee7-ebff-4cbc-a3e2-3139d498d563 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:35.510345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87e90ee7-ebff-4cbc-a3e2-3139d498d563 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:35.511037 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87e90ee7-ebff-4cbc-a3e2-3139d498d563 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:35.571430 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-87e90ee7-ebff-4cbc-a3e2-3139d498d563 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24/action" status: 200 len: 24571 microversion: 2.1 time: 0.084582 Aug 24 11:26:35.572417 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3504/7372] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:26:35 2022] POST /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24/action => generated 24571 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:26:42.664498 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-04811d93-b73a-40d2-8d94-d20d9984a092 req-d0977bd4-9122-4c37-a2c5-3fa0b9aff0da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "927efccc-0497-419c-8aa5-faabadd15c24", "tag": "2ccf95ae-c951-43b0-ad29-ab5899ac6622"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:42.669157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d5c983fc-2ec0-4561-894c-5f0ee82de666 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:42.669744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d5c983fc-2ec0-4561-894c-5f0ee82de666 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:42.672143 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=34 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:42.673084 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:42.679841 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5c983fc-2ec0-4561-894c-5f0ee82de666 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:42.680337 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5c983fc-2ec0-4561-894c-5f0ee82de666 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:42.680484 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-04811d93-b73a-40d2-8d94-d20d9984a092 req-d0977bd4-9122-4c37-a2c5-3fa0b9aff0da service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:42.680933 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-04811d93-b73a-40d2-8d94-d20d9984a092 req-d0977bd4-9122-4c37-a2c5-3fa0b9aff0da service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:42.681394 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-04811d93-b73a-40d2-8d94-d20d9984a092 req-d0977bd4-9122-4c37-a2c5-3fa0b9aff0da service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:42.681521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5c983fc-2ec0-4561-894c-5f0ee82de666 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:42.682147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5c983fc-2ec0-4561-894c-5f0ee82de666 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:42.682655 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5c983fc-2ec0-4561-894c-5f0ee82de666 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:42.683106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5c983fc-2ec0-4561-894c-5f0ee82de666 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:42.695713 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-04811d93-b73a-40d2-8d94-d20d9984a092 req-d0977bd4-9122-4c37-a2c5-3fa0b9aff0da service nova] Creating event network-changed:2ccf95ae-c951-43b0-ad29-ab5899ac6622 for instance 927efccc-0497-419c-8aa5-faabadd15c24 on n-h2-849328-3 Aug 24 11:26:42.702099 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-04811d93-b73a-40d2-8d94-d20d9984a092 req-d0977bd4-9122-4c37-a2c5-3fa0b9aff0da service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041011 Aug 24 11:26:42.703406 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3505/7373] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:26:42.716426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d5c983fc-2ec0-4561-894c-5f0ee82de666 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:26:42.811567 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d5c983fc-2ec0-4561-894c-5f0ee82de666 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "DELETE /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 204 len: 0 microversion: 2.1 time: 0.153319 Aug 24 11:26:42.815525 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3869/7374] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:26:42 2022] DELETE /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:26:42.821888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6658ad52-4a75-4c58-b761-b276359a902d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:42.822629 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6658ad52-4a75-4c58-b761-b276359a902d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:42.832855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6658ad52-4a75-4c58-b761-b276359a902d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:42.833494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6658ad52-4a75-4c58-b761-b276359a902d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:42.834119 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6658ad52-4a75-4c58-b761-b276359a902d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:42.835029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6658ad52-4a75-4c58-b761-b276359a902d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:42.835497 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6658ad52-4a75-4c58-b761-b276359a902d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:42.835926 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6658ad52-4a75-4c58-b761-b276359a902d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:42.988788 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6658ad52-4a75-4c58-b761-b276359a902d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:42.997085 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6658ad52-4a75-4c58-b761-b276359a902d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1688 microversion: 2.1 time: 0.179826 Aug 24 11:26:42.997706 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3506/7375] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:42 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1688 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:44.022914 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3f54cd22-1335-47d2-9d9b-377eabb9092f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:44.023628 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3f54cd22-1335-47d2-9d9b-377eabb9092f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:44.030541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f54cd22-1335-47d2-9d9b-377eabb9092f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:44.031038 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f54cd22-1335-47d2-9d9b-377eabb9092f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:44.031492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f54cd22-1335-47d2-9d9b-377eabb9092f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:44.032220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f54cd22-1335-47d2-9d9b-377eabb9092f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:44.032688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f54cd22-1335-47d2-9d9b-377eabb9092f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:44.033147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f54cd22-1335-47d2-9d9b-377eabb9092f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:44.216884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3f54cd22-1335-47d2-9d9b-377eabb9092f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:44.227943 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3f54cd22-1335-47d2-9d9b-377eabb9092f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 200 len: 1688 microversion: 2.1 time: 0.210273 Aug 24 11:26:44.228793 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3870/7376] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:44 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 1688 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:44.915007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-1b9f5cf4-4b45-4ef1-b14d-c689cdbf219d req-d91b8709-8811-4eb3-a3a4-919d643fe27a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "927efccc-0497-419c-8aa5-faabadd15c24", "name": "network-vif-deleted", "tag": "2ccf95ae-c951-43b0-ad29-ab5899ac6622"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:44.924799 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1b9f5cf4-4b45-4ef1-b14d-c689cdbf219d req-d91b8709-8811-4eb3-a3a4-919d643fe27a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:44.925307 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1b9f5cf4-4b45-4ef1-b14d-c689cdbf219d req-d91b8709-8811-4eb3-a3a4-919d643fe27a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:44.925715 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1b9f5cf4-4b45-4ef1-b14d-c689cdbf219d req-d91b8709-8811-4eb3-a3a4-919d643fe27a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:44.937418 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-1b9f5cf4-4b45-4ef1-b14d-c689cdbf219d req-d91b8709-8811-4eb3-a3a4-919d643fe27a service nova] Creating event network-vif-deleted:2ccf95ae-c951-43b0-ad29-ab5899ac6622 for instance 927efccc-0497-419c-8aa5-faabadd15c24 on n-h2-849328-3 Aug 24 11:26:44.942262 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-1b9f5cf4-4b45-4ef1-b14d-c689cdbf219d req-d91b8709-8811-4eb3-a3a4-919d643fe27a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091950 Aug 24 11:26:44.942884 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3507/7377] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:26:45.253063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-590083bb-6514-4838-b941-ea7f58fda6f0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:45.253879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-590083bb-6514-4838-b941-ea7f58fda6f0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 927efccc-0497-419c-8aa5-faabadd15c24] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:45.263200 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-590083bb-6514-4838-b941-ea7f58fda6f0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:45.263862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-590083bb-6514-4838-b941-ea7f58fda6f0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:45.264672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-590083bb-6514-4838-b941-ea7f58fda6f0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:45.265433 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-590083bb-6514-4838-b941-ea7f58fda6f0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:45.266067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-590083bb-6514-4838-b941-ea7f58fda6f0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:45.266700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-590083bb-6514-4838-b941-ea7f58fda6f0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:45.281609 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-590083bb-6514-4838-b941-ea7f58fda6f0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] HTTP exception thrown: Instance 927efccc-0497-419c-8aa5-faabadd15c24 could not be found. Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-590083bb-6514-4838-b941-ea7f58fda6f0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Request method failure captured: Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 HTTP/1.1 Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgncfDWps3oSnkGWh604hOpiheCjj8_0BYAjCgEtswuOyN76lOlAH_8p8Uj7QuLZqZrHJqGhmKvQcmRgQjYyq3xw0zzP1xAec9u3lQcKsftkv7yoMv-UqmOKrubG7PpaZzLpooDFEsUT2iVLZk3IHgmNHmgtRKVhQiSyHbimZM2IotU Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 36574fcb42ea44ca970b5bfa9697af8c Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1665657358 Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/36574fcb42ea44ca970b5bfa9697af8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_36574fcb42ea44ca970b5bfa9697af8c", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/36574fcb42ea44ca970b5bfa9697af8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/36574fcb42ea44ca970b5bfa9697af8c"}]}] Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1665657358 Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 36574fcb42ea44ca970b5bfa9697af8c Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1665657358 Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestNetworkAdvancedServerOps-1665657358-project Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: ab7f1eb7298e4cad86ad953eac53c9c3 Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1665657358-project Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 927efccc-0497-419c-8aa5-faabadd15c24 could not be found. Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '927efccc-0497-419c-8aa5-faabadd15c24'} Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 927efccc-0497-419c-8aa5-faabadd15c24 could not be found. Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 927efccc-0497-419c-8aa5-faabadd15c24 could not be found. Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:26:45.283441 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:26:45.288154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:26:45.288154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:26:45.288154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:26:45.288154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:26:45.288154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:26:45.288154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:26:45.288154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 927efccc-0497-419c-8aa5-faabadd15c24 could not be found. Aug 24 11:26:45.288154 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:26:45.288154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-590083bb-6514-4838-b941-ea7f58fda6f0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Returning 404 to user: Instance 927efccc-0497-419c-8aa5-faabadd15c24 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:26:45.288154 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-590083bb-6514-4838-b941-ea7f58fda6f0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24" status: 404 len: 111 microversion: 2.1 time: 0.039059 Aug 24 11:26:45.288154 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3871/7378] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:45 2022] GET /compute/v2.1/servers/927efccc-0497-419c-8aa5-faabadd15c24 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:26:48.806387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-98e5b196-2b44-4de3-b976-3b5fe078c788 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '.version_select at 0x7f465459ce50>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:48.835125 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-98e5b196-2b44-4de3-b976-3b5fe078c788 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-902488205" status: 202 len: 0 microversion: 2.1 time: 0.034846 Aug 24 11:26:48.840683 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3508/7379] 10.222.0.85 () {58 vars in 1281 bytes} [Wed Aug 24 11:26:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-902488205 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:26:48.861820 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-38a8c0b8-501a-4a7c-b9f1-fc10be1a6e2d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'create', calling method: .version_select at 0x7f4647cb2af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1469325958", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKVjRCjgf+dUUjgE2O1sxTobr9J6dSMrMs+eb5dHxMAGccsLGSxJ3MG00LWs42J68ueCiz1Ulb9O5fOdRyxuqRygCZ0XyyBrxfMie7/nhBra75VCyjpLbLzfR6+gVXR1Q=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:48.878930 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-38a8c0b8-501a-4a7c-b9f1-fc10be1a6e2d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Getting quotas for project 36574fcb42ea44ca970b5bfa9697af8c. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:26:48.885402 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-38a8c0b8-501a-4a7c-b9f1-fc10be1a6e2d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Getting quotas for user ab7f1eb7298e4cad86ad953eac53c9c3 and project 36574fcb42ea44ca970b5bfa9697af8c. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:26:48.910902 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-38a8c0b8-501a-4a7c-b9f1-fc10be1a6e2d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052946 Aug 24 11:26:48.911509 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3872/7380] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 11:26:48 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:26:54.471903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-75809ffe-47e8-45ca-8392-908a305d7dfa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-824301014", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "fbef8f5c-0670-4848-b0a8-75bc465912fa"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1469325958", "security_groups": [{"name": "tempest-secgroup-smoke-1811798816"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:54.615662 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-75809ffe-47e8-45ca-8392-908a305d7dfa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] validate_networks() for [('fbef8f5c-0670-4848-b0a8-75bc465912fa', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:26:54.932280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=14 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:55.024739 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-75809ffe-47e8-45ca-8392-908a305d7dfa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:26:55.025304 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-75809ffe-47e8-45ca-8392-908a305d7dfa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:26:55.025881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-75809ffe-47e8-45ca-8392-908a305d7dfa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:26:55.026387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-75809ffe-47e8-45ca-8392-908a305d7dfa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:26:55.027044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-75809ffe-47e8-45ca-8392-908a305d7dfa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:26:55.037367 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75809ffe-47e8-45ca-8392-908a305d7dfa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:55.037952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75809ffe-47e8-45ca-8392-908a305d7dfa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:55.038459 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75809ffe-47e8-45ca-8392-908a305d7dfa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:55.039272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75809ffe-47e8-45ca-8392-908a305d7dfa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:55.039807 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75809ffe-47e8-45ca-8392-908a305d7dfa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:55.040396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75809ffe-47e8-45ca-8392-908a305d7dfa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:55.058892 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-75809ffe-47e8-45ca-8392-908a305d7dfa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Getting quotas for project 36574fcb42ea44ca970b5bfa9697af8c. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:26:55.064467 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-75809ffe-47e8-45ca-8392-908a305d7dfa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Getting quotas for user ab7f1eb7298e4cad86ad953eac53c9c3 and project 36574fcb42ea44ca970b5bfa9697af8c. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:26:55.078587 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-75809ffe-47e8-45ca-8392-908a305d7dfa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:26:55.081072 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-75809ffe-47e8-45ca-8392-908a305d7dfa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:26:55.131945 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-75809ffe-47e8-45ca-8392-908a305d7dfa tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.664848 Aug 24 11:26:55.132799 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3509/7381] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 11:26:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:26:55.146734 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-154b4eb7-d510-4c50-b072-1efa69d2fae3 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:55.147512 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-154b4eb7-d510-4c50-b072-1efa69d2fae3 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:55.215886 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-154b4eb7-d510-4c50-b072-1efa69d2fae3 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:55.222975 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-154b4eb7-d510-4c50-b072-1efa69d2fae3 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1266 microversion: 2.1 time: 0.082363 Aug 24 11:26:55.223590 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3873/7382] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:55 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:56.246150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ae26faf7-6f3a-4572-bb67-b0cefe2d918f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:56.247847 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ae26faf7-6f3a-4572-bb67-b0cefe2d918f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:56.260242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae26faf7-6f3a-4572-bb67-b0cefe2d918f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:56.261096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae26faf7-6f3a-4572-bb67-b0cefe2d918f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:56.262360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae26faf7-6f3a-4572-bb67-b0cefe2d918f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:56.263809 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae26faf7-6f3a-4572-bb67-b0cefe2d918f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:56.264680 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae26faf7-6f3a-4572-bb67-b0cefe2d918f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:56.265395 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae26faf7-6f3a-4572-bb67-b0cefe2d918f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:56.387170 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ae26faf7-6f3a-4572-bb67-b0cefe2d918f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:56.396113 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ae26faf7-6f3a-4572-bb67-b0cefe2d918f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1326 microversion: 2.1 time: 0.155738 Aug 24 11:26:56.409834 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3510/7383] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:56 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1326 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:57.420576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-86f4d186-a6df-4ad2-a708-a4d3c695c068 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:57.421149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-86f4d186-a6df-4ad2-a708-a4d3c695c068 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:57.426366 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:57.430185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86f4d186-a6df-4ad2-a708-a4d3c695c068 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:57.430699 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86f4d186-a6df-4ad2-a708-a4d3c695c068 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:57.431414 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86f4d186-a6df-4ad2-a708-a4d3c695c068 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:57.432510 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86f4d186-a6df-4ad2-a708-a4d3c695c068 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:57.434032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86f4d186-a6df-4ad2-a708-a4d3c695c068 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:57.434911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86f4d186-a6df-4ad2-a708-a4d3c695c068 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:57.664256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-86f4d186-a6df-4ad2-a708-a4d3c695c068 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:57.672743 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-86f4d186-a6df-4ad2-a708-a4d3c695c068 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1392 microversion: 2.1 time: 0.257575 Aug 24 11:26:57.673266 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3874/7384] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:57 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1392 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:57.771521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c4396b2d-47bb-4e96-b5ac-b602198753e2 req-12814ae5-0703-423d-ad4f-102b80713ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e067fd81-410a-4c34-872e-0cdad20eda59", "tag": "d2aeb663-785a-490f-9bf4-3d02e9a7d3a3"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:57.784562 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c4396b2d-47bb-4e96-b5ac-b602198753e2 req-12814ae5-0703-423d-ad4f-102b80713ee8 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:57.785514 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c4396b2d-47bb-4e96-b5ac-b602198753e2 req-12814ae5-0703-423d-ad4f-102b80713ee8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:57.786316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c4396b2d-47bb-4e96-b5ac-b602198753e2 req-12814ae5-0703-423d-ad4f-102b80713ee8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:57.802966 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c4396b2d-47bb-4e96-b5ac-b602198753e2 req-12814ae5-0703-423d-ad4f-102b80713ee8 service nova] Creating event network-changed:d2aeb663-785a-490f-9bf4-3d02e9a7d3a3 for instance e067fd81-410a-4c34-872e-0cdad20eda59 on n-h1-849328-3 Aug 24 11:26:57.810095 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c4396b2d-47bb-4e96-b5ac-b602198753e2 req-12814ae5-0703-423d-ad4f-102b80713ee8 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043160 Aug 24 11:26:57.811000 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3511/7385] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:26:58.698343 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-23bf17a1-7a3a-403c-bdb1-cff8782602f3 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:58.699008 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-23bf17a1-7a3a-403c-bdb1-cff8782602f3 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:58.706517 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23bf17a1-7a3a-403c-bdb1-cff8782602f3 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:58.707022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23bf17a1-7a3a-403c-bdb1-cff8782602f3 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:58.707475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23bf17a1-7a3a-403c-bdb1-cff8782602f3 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:58.708187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23bf17a1-7a3a-403c-bdb1-cff8782602f3 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:58.708656 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23bf17a1-7a3a-403c-bdb1-cff8782602f3 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:58.709092 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23bf17a1-7a3a-403c-bdb1-cff8782602f3 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:59.195883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-23bf17a1-7a3a-403c-bdb1-cff8782602f3 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:59.204644 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-23bf17a1-7a3a-403c-bdb1-cff8782602f3 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1392 microversion: 2.1 time: 0.512353 Aug 24 11:26:59.205230 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3875/7386] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:58 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1392 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:00.227169 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3ac3e2b2-0316-477b-b4c1-565b2269a662 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:00.228132 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3ac3e2b2-0316-477b-b4c1-565b2269a662 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:00.234690 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ac3e2b2-0316-477b-b4c1-565b2269a662 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:00.235175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ac3e2b2-0316-477b-b4c1-565b2269a662 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:00.235687 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ac3e2b2-0316-477b-b4c1-565b2269a662 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:00.236407 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ac3e2b2-0316-477b-b4c1-565b2269a662 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:00.236866 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ac3e2b2-0316-477b-b4c1-565b2269a662 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:00.237313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ac3e2b2-0316-477b-b4c1-565b2269a662 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:00.377826 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3ac3e2b2-0316-477b-b4c1-565b2269a662 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:00.386852 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3ac3e2b2-0316-477b-b4c1-565b2269a662 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1392 microversion: 2.1 time: 0.164779 Aug 24 11:27:00.387471 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3512/7387] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:00 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:01.411976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-070097cb-95fc-486b-952c-1019cbb0b53b tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:01.413087 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-070097cb-95fc-486b-952c-1019cbb0b53b tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:01.424488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-070097cb-95fc-486b-952c-1019cbb0b53b tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:01.425367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-070097cb-95fc-486b-952c-1019cbb0b53b tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:01.426087 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-070097cb-95fc-486b-952c-1019cbb0b53b tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:01.427281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-070097cb-95fc-486b-952c-1019cbb0b53b tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:01.428060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-070097cb-95fc-486b-952c-1019cbb0b53b tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:01.428781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-070097cb-95fc-486b-952c-1019cbb0b53b tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:01.576649 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-070097cb-95fc-486b-952c-1019cbb0b53b tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:01.585684 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-070097cb-95fc-486b-952c-1019cbb0b53b tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1392 microversion: 2.1 time: 0.180209 Aug 24 11:27:01.586294 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3876/7388] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:01 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1392 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:01.801872 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3317c26b-5f1b-442d-ae49-4f860d381a0f req-34e3328a-65f2-4c19-a3e1-a74ec99bfb3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e067fd81-410a-4c34-872e-0cdad20eda59", "name": "network-vif-plugged", "status": "completed", "tag": "d2aeb663-785a-490f-9bf4-3d02e9a7d3a3"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:01.813448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3317c26b-5f1b-442d-ae49-4f860d381a0f req-34e3328a-65f2-4c19-a3e1-a74ec99bfb3d service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:01.813933 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3317c26b-5f1b-442d-ae49-4f860d381a0f req-34e3328a-65f2-4c19-a3e1-a74ec99bfb3d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:01.814388 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3317c26b-5f1b-442d-ae49-4f860d381a0f req-34e3328a-65f2-4c19-a3e1-a74ec99bfb3d service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:01.826170 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3317c26b-5f1b-442d-ae49-4f860d381a0f req-34e3328a-65f2-4c19-a3e1-a74ec99bfb3d service nova] Creating event network-vif-plugged:d2aeb663-785a-490f-9bf4-3d02e9a7d3a3 for instance e067fd81-410a-4c34-872e-0cdad20eda59 on n-h1-849328-3 Aug 24 11:27:01.831309 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3317c26b-5f1b-442d-ae49-4f860d381a0f req-34e3328a-65f2-4c19-a3e1-a74ec99bfb3d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033356 Aug 24 11:27:01.832601 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3513/7389] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:27:02.609516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-12353c10-4076-4b14-8f18-c7631dfd0214 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:02.610337 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-12353c10-4076-4b14-8f18-c7631dfd0214 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:02.619817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12353c10-4076-4b14-8f18-c7631dfd0214 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:02.620476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12353c10-4076-4b14-8f18-c7631dfd0214 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:02.621072 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12353c10-4076-4b14-8f18-c7631dfd0214 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:02.622049 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12353c10-4076-4b14-8f18-c7631dfd0214 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:02.622679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12353c10-4076-4b14-8f18-c7631dfd0214 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:02.623261 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12353c10-4076-4b14-8f18-c7631dfd0214 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:02.757429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-12353c10-4076-4b14-8f18-c7631dfd0214 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:02.766214 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-12353c10-4076-4b14-8f18-c7631dfd0214 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1392 microversion: 2.1 time: 0.161914 Aug 24 11:27:02.766736 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3877/7390] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:02 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:03.788897 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-482d554e-e9ac-422b-875b-5f4b9280b576 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:03.789928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-482d554e-e9ac-422b-875b-5f4b9280b576 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:03.796913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-482d554e-e9ac-422b-875b-5f4b9280b576 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:03.797673 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-482d554e-e9ac-422b-875b-5f4b9280b576 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:03.798159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-482d554e-e9ac-422b-875b-5f4b9280b576 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:03.798869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-482d554e-e9ac-422b-875b-5f4b9280b576 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:03.799336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-482d554e-e9ac-422b-875b-5f4b9280b576 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:03.799825 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-482d554e-e9ac-422b-875b-5f4b9280b576 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:03.947730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-482d554e-e9ac-422b-875b-5f4b9280b576 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:03.956517 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-482d554e-e9ac-422b-875b-5f4b9280b576 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1563 microversion: 2.1 time: 0.172892 Aug 24 11:27:03.957113 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3514/7391] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:03 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1563 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:03.984722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5856cc35-3553-41d3-b218-ce314e62e9d8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:03.985383 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5856cc35-3553-41d3-b218-ce314e62e9d8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:03.992644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5856cc35-3553-41d3-b218-ce314e62e9d8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:03.993185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5856cc35-3553-41d3-b218-ce314e62e9d8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:03.993638 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5856cc35-3553-41d3-b218-ce314e62e9d8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:03.994590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5856cc35-3553-41d3-b218-ce314e62e9d8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:03.995403 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5856cc35-3553-41d3-b218-ce314e62e9d8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:03.996169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5856cc35-3553-41d3-b218-ce314e62e9d8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:04.143380 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5856cc35-3553-41d3-b218-ce314e62e9d8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:04.152150 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5856cc35-3553-41d3-b218-ce314e62e9d8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1563 microversion: 2.1 time: 0.171390 Aug 24 11:27:04.152743 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3878/7392] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:03 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:05.777934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-855fc8b4-aa89-45dc-bace-34234247eabb req-b85623d4-f7f2-4318-8e2b-8c317d066347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e067fd81-410a-4c34-872e-0cdad20eda59", "tag": "d2aeb663-785a-490f-9bf4-3d02e9a7d3a3"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:05.783416 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:05.792260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:05.794110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:05.802508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-855fc8b4-aa89-45dc-bace-34234247eabb req-b85623d4-f7f2-4318-8e2b-8c317d066347 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:05.803018 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-855fc8b4-aa89-45dc-bace-34234247eabb req-b85623d4-f7f2-4318-8e2b-8c317d066347 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:05.803450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-855fc8b4-aa89-45dc-bace-34234247eabb req-b85623d4-f7f2-4318-8e2b-8c317d066347 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:05.817146 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-855fc8b4-aa89-45dc-bace-34234247eabb req-b85623d4-f7f2-4318-8e2b-8c317d066347 service nova] Creating event network-changed:d2aeb663-785a-490f-9bf4-3d02e9a7d3a3 for instance e067fd81-410a-4c34-872e-0cdad20eda59 on n-h1-849328-3 Aug 24 11:27:05.826338 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-855fc8b4-aa89-45dc-bace-34234247eabb req-b85623d4-f7f2-4318-8e2b-8c317d066347 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052188 Aug 24 11:27:05.827839 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3879/7393] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:27:05.849309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dee2a62f-043a-4049-91c5-560bb72af938 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:05.849920 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dee2a62f-043a-4049-91c5-560bb72af938 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:05.851918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:05.858330 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dee2a62f-043a-4049-91c5-560bb72af938 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:05.858754 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dee2a62f-043a-4049-91c5-560bb72af938 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:05.859212 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dee2a62f-043a-4049-91c5-560bb72af938 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:05.859910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dee2a62f-043a-4049-91c5-560bb72af938 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:05.860362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dee2a62f-043a-4049-91c5-560bb72af938 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:05.860841 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dee2a62f-043a-4049-91c5-560bb72af938 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:06.007636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dee2a62f-043a-4049-91c5-560bb72af938 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:06.016739 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dee2a62f-043a-4049-91c5-560bb72af938 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1563 microversion: 2.1 time: 0.248334 Aug 24 11:27:06.017692 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3515/7394] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:05 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1563 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:27.288382 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-80812d5d-b047-4d37-9e54-9505e2b504be tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:27.290945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-80812d5d-b047-4d37-9e54-9505e2b504be tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:27.293284 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:27.294054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=32 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:27.300091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80812d5d-b047-4d37-9e54-9505e2b504be tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:27.300607 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80812d5d-b047-4d37-9e54-9505e2b504be tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:27.301060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80812d5d-b047-4d37-9e54-9505e2b504be tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:27.301900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80812d5d-b047-4d37-9e54-9505e2b504be tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:27.302404 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80812d5d-b047-4d37-9e54-9505e2b504be tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:27.302826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80812d5d-b047-4d37-9e54-9505e2b504be tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:27.379514 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-80812d5d-b047-4d37-9e54-9505e2b504be tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59/action" status: 200 len: 24557 microversion: 2.1 time: 0.096342 Aug 24 11:27:27.380177 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3880/7395] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:27:27 2022] POST /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59/action => generated 24557 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:27:38.416813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cbb0120b-3dc9-47a4-ad93-8c86ad748b9b tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:38.419317 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:38.419985 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=30 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:38.425442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbb0120b-3dc9-47a4-ad93-8c86ad748b9b tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:38.425929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbb0120b-3dc9-47a4-ad93-8c86ad748b9b tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:38.426360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbb0120b-3dc9-47a4-ad93-8c86ad748b9b tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:38.449622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cbb0120b-3dc9-47a4-ad93-8c86ad748b9b tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Going to try to stop instance {{(pid=122432) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 11:27:38.500832 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cbb0120b-3dc9-47a4-ad93-8c86ad748b9b tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59/action" status: 202 len: 0 microversion: 2.1 time: 0.088416 Aug 24 11:27:38.501583 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3516/7396] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:27:38 2022] POST /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:27:38.508972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:38.510372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:38.515507 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1fa9cdfb-36f6-4364-884a-61814b9e8648 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:38.516463 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1fa9cdfb-36f6-4364-884a-61814b9e8648 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:38.524991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fa9cdfb-36f6-4364-884a-61814b9e8648 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:38.525541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fa9cdfb-36f6-4364-884a-61814b9e8648 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:38.525998 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fa9cdfb-36f6-4364-884a-61814b9e8648 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:38.526704 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fa9cdfb-36f6-4364-884a-61814b9e8648 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:38.527177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fa9cdfb-36f6-4364-884a-61814b9e8648 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:38.527614 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fa9cdfb-36f6-4364-884a-61814b9e8648 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:38.660327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1fa9cdfb-36f6-4364-884a-61814b9e8648 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:38.668764 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1fa9cdfb-36f6-4364-884a-61814b9e8648 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1691 microversion: 2.1 time: 0.162084 Aug 24 11:27:38.669284 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3881/7397] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:38 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:39.693205 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b1f4bda3-ca05-4dcc-9bca-529eece0b39d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:39.694133 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b1f4bda3-ca05-4dcc-9bca-529eece0b39d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:39.704263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1f4bda3-ca05-4dcc-9bca-529eece0b39d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:39.704907 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1f4bda3-ca05-4dcc-9bca-529eece0b39d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:39.705523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1f4bda3-ca05-4dcc-9bca-529eece0b39d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:39.706523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1f4bda3-ca05-4dcc-9bca-529eece0b39d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:39.707042 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1f4bda3-ca05-4dcc-9bca-529eece0b39d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:39.707605 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1f4bda3-ca05-4dcc-9bca-529eece0b39d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:39.852559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b1f4bda3-ca05-4dcc-9bca-529eece0b39d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:39.863018 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b1f4bda3-ca05-4dcc-9bca-529eece0b39d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1691 microversion: 2.1 time: 0.175214 Aug 24 11:27:39.863821 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3517/7398] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:39 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:40.895160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4e318310-21a1-481e-8e10-5ceb21334c34 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:40.895883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4e318310-21a1-481e-8e10-5ceb21334c34 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:40.905661 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e318310-21a1-481e-8e10-5ceb21334c34 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:40.906351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e318310-21a1-481e-8e10-5ceb21334c34 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:40.906946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e318310-21a1-481e-8e10-5ceb21334c34 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:40.908005 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e318310-21a1-481e-8e10-5ceb21334c34 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:40.908652 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e318310-21a1-481e-8e10-5ceb21334c34 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:40.909311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e318310-21a1-481e-8e10-5ceb21334c34 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:41.057541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4e318310-21a1-481e-8e10-5ceb21334c34 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:41.069591 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4e318310-21a1-481e-8e10-5ceb21334c34 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1691 microversion: 2.1 time: 0.179655 Aug 24 11:27:41.070333 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3882/7399] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:40 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1691 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:42.100717 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-94845c22-3afd-4c0a-a296-be16185b88a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:42.101831 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-94845c22-3afd-4c0a-a296-be16185b88a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:42.109143 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94845c22-3afd-4c0a-a296-be16185b88a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:42.109637 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94845c22-3afd-4c0a-a296-be16185b88a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:42.110073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94845c22-3afd-4c0a-a296-be16185b88a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:42.110762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94845c22-3afd-4c0a-a296-be16185b88a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:42.111212 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94845c22-3afd-4c0a-a296-be16185b88a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:42.111636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94845c22-3afd-4c0a-a296-be16185b88a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:42.268669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-94845c22-3afd-4c0a-a296-be16185b88a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:42.280764 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-94845c22-3afd-4c0a-a296-be16185b88a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1691 microversion: 2.1 time: 0.186398 Aug 24 11:27:42.281700 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3518/7400] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:42 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1691 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:43.301969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d8e7f20d-e6c2-4c48-af1b-ec3ca7b7bde2 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:43.302593 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d8e7f20d-e6c2-4c48-af1b-ec3ca7b7bde2 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:43.310490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8e7f20d-e6c2-4c48-af1b-ec3ca7b7bde2 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:43.311025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8e7f20d-e6c2-4c48-af1b-ec3ca7b7bde2 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:43.311478 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8e7f20d-e6c2-4c48-af1b-ec3ca7b7bde2 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:43.312195 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8e7f20d-e6c2-4c48-af1b-ec3ca7b7bde2 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:43.312666 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8e7f20d-e6c2-4c48-af1b-ec3ca7b7bde2 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:43.313110 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8e7f20d-e6c2-4c48-af1b-ec3ca7b7bde2 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:43.448674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d8e7f20d-e6c2-4c48-af1b-ec3ca7b7bde2 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:43.461016 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d8e7f20d-e6c2-4c48-af1b-ec3ca7b7bde2 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1691 microversion: 2.1 time: 0.162595 Aug 24 11:27:43.461638 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3883/7401] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:43 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:44.493517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b9c99f78-7799-4d83-9697-0e211a04b3b1 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:44.494596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b9c99f78-7799-4d83-9697-0e211a04b3b1 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:44.506818 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9c99f78-7799-4d83-9697-0e211a04b3b1 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:44.507773 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9c99f78-7799-4d83-9697-0e211a04b3b1 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:44.508233 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9c99f78-7799-4d83-9697-0e211a04b3b1 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:44.508960 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9c99f78-7799-4d83-9697-0e211a04b3b1 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:44.509443 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9c99f78-7799-4d83-9697-0e211a04b3b1 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:44.509873 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9c99f78-7799-4d83-9697-0e211a04b3b1 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:44.657520 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b9c99f78-7799-4d83-9697-0e211a04b3b1 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:44.665714 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b9c99f78-7799-4d83-9697-0e211a04b3b1 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1691 microversion: 2.1 time: 0.179261 Aug 24 11:27:44.666311 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3519/7402] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:44 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1691 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:45.690429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-70356a0d-36ac-4deb-90d9-0f507572ca3d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:45.691378 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-70356a0d-36ac-4deb-90d9-0f507572ca3d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:45.702870 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70356a0d-36ac-4deb-90d9-0f507572ca3d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:45.703708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70356a0d-36ac-4deb-90d9-0f507572ca3d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:45.704465 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70356a0d-36ac-4deb-90d9-0f507572ca3d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:45.705825 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70356a0d-36ac-4deb-90d9-0f507572ca3d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:45.706626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70356a0d-36ac-4deb-90d9-0f507572ca3d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:45.707362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70356a0d-36ac-4deb-90d9-0f507572ca3d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:45.848692 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-70356a0d-36ac-4deb-90d9-0f507572ca3d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:45.857156 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-70356a0d-36ac-4deb-90d9-0f507572ca3d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1691 microversion: 2.1 time: 0.173090 Aug 24 11:27:45.858131 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3884/7403] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:45 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1691 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:46.879321 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-73cd2d00-90ab-4eb3-b69d-3687acc7a1cc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:46.879890 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-73cd2d00-90ab-4eb3-b69d-3687acc7a1cc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:46.887780 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73cd2d00-90ab-4eb3-b69d-3687acc7a1cc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:46.888265 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73cd2d00-90ab-4eb3-b69d-3687acc7a1cc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:46.888699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73cd2d00-90ab-4eb3-b69d-3687acc7a1cc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:46.889423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73cd2d00-90ab-4eb3-b69d-3687acc7a1cc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:46.889904 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73cd2d00-90ab-4eb3-b69d-3687acc7a1cc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:46.890327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73cd2d00-90ab-4eb3-b69d-3687acc7a1cc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:47.037393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-73cd2d00-90ab-4eb3-b69d-3687acc7a1cc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:47.049774 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-73cd2d00-90ab-4eb3-b69d-3687acc7a1cc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1691 microversion: 2.1 time: 0.174204 Aug 24 11:27:47.050657 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3520/7404] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:46 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1691 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:48.071845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4f3443ca-5129-4f64-9d2b-f0c8f29e62a8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:48.072472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4f3443ca-5129-4f64-9d2b-f0c8f29e62a8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:48.079860 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f3443ca-5129-4f64-9d2b-f0c8f29e62a8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:48.080367 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f3443ca-5129-4f64-9d2b-f0c8f29e62a8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:48.080815 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f3443ca-5129-4f64-9d2b-f0c8f29e62a8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:48.081564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f3443ca-5129-4f64-9d2b-f0c8f29e62a8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:48.082035 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f3443ca-5129-4f64-9d2b-f0c8f29e62a8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:48.082475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f3443ca-5129-4f64-9d2b-f0c8f29e62a8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:48.233964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4f3443ca-5129-4f64-9d2b-f0c8f29e62a8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:48.245042 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4f3443ca-5129-4f64-9d2b-f0c8f29e62a8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1691 microversion: 2.1 time: 0.177007 Aug 24 11:27:48.245962 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3885/7405] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:48 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:49.272678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-53c8d2f0-924b-4bb9-97e3-9448ec0bb0a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:49.273344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-53c8d2f0-924b-4bb9-97e3-9448ec0bb0a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:49.280691 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53c8d2f0-924b-4bb9-97e3-9448ec0bb0a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:49.281211 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53c8d2f0-924b-4bb9-97e3-9448ec0bb0a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:49.281626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53c8d2f0-924b-4bb9-97e3-9448ec0bb0a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:49.282308 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53c8d2f0-924b-4bb9-97e3-9448ec0bb0a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:49.282753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53c8d2f0-924b-4bb9-97e3-9448ec0bb0a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:49.283167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53c8d2f0-924b-4bb9-97e3-9448ec0bb0a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:49.431156 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-53c8d2f0-924b-4bb9-97e3-9448ec0bb0a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:49.439446 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-53c8d2f0-924b-4bb9-97e3-9448ec0bb0a7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1691 microversion: 2.1 time: 0.170869 Aug 24 11:27:49.440006 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3521/7406] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:49 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:50.469867 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-55179c8a-ebbc-49f8-ae91-eec2dd8aa250 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:50.470843 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-55179c8a-ebbc-49f8-ae91-eec2dd8aa250 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:50.480442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55179c8a-ebbc-49f8-ae91-eec2dd8aa250 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:50.480947 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55179c8a-ebbc-49f8-ae91-eec2dd8aa250 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:50.481434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55179c8a-ebbc-49f8-ae91-eec2dd8aa250 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:50.482149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55179c8a-ebbc-49f8-ae91-eec2dd8aa250 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:50.482632 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55179c8a-ebbc-49f8-ae91-eec2dd8aa250 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:50.483070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55179c8a-ebbc-49f8-ae91-eec2dd8aa250 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:50.620134 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-55179c8a-ebbc-49f8-ae91-eec2dd8aa250 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:50.628354 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-55179c8a-ebbc-49f8-ae91-eec2dd8aa250 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1691 microversion: 2.1 time: 0.165540 Aug 24 11:27:50.628962 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3886/7407] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:50 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:51.650368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-24b0c364-c51c-4272-8b24-33b007ed4a93 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:51.650983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-24b0c364-c51c-4272-8b24-33b007ed4a93 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:51.658756 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24b0c364-c51c-4272-8b24-33b007ed4a93 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:51.659247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24b0c364-c51c-4272-8b24-33b007ed4a93 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:51.659684 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24b0c364-c51c-4272-8b24-33b007ed4a93 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:51.660384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24b0c364-c51c-4272-8b24-33b007ed4a93 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:51.660838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24b0c364-c51c-4272-8b24-33b007ed4a93 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:51.661304 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24b0c364-c51c-4272-8b24-33b007ed4a93 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:51.804387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-24b0c364-c51c-4272-8b24-33b007ed4a93 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:51.812712 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-24b0c364-c51c-4272-8b24-33b007ed4a93 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1691 microversion: 2.1 time: 0.166397 Aug 24 11:27:51.813327 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3522/7408] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:51 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:52.835779 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-da809da6-f08d-4dfb-84da-a5fd931d8262 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:52.836455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-da809da6-f08d-4dfb-84da-a5fd931d8262 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:52.845277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da809da6-f08d-4dfb-84da-a5fd931d8262 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:52.845931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da809da6-f08d-4dfb-84da-a5fd931d8262 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:52.846491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da809da6-f08d-4dfb-84da-a5fd931d8262 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:52.847366 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da809da6-f08d-4dfb-84da-a5fd931d8262 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:52.847953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da809da6-f08d-4dfb-84da-a5fd931d8262 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:52.848531 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da809da6-f08d-4dfb-84da-a5fd931d8262 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:52.999574 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da809da6-f08d-4dfb-84da-a5fd931d8262 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:53.008041 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-da809da6-f08d-4dfb-84da-a5fd931d8262 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1691 microversion: 2.1 time: 0.177167 Aug 24 11:27:53.008658 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3887/7409] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:52 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:54.029900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c1b66d21-dcd9-48f0-9925-4e429a8cb305 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:54.030517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c1b66d21-dcd9-48f0-9925-4e429a8cb305 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:54.037708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1b66d21-dcd9-48f0-9925-4e429a8cb305 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:54.038181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1b66d21-dcd9-48f0-9925-4e429a8cb305 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:54.038610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1b66d21-dcd9-48f0-9925-4e429a8cb305 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:54.039313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1b66d21-dcd9-48f0-9925-4e429a8cb305 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:54.039744 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1b66d21-dcd9-48f0-9925-4e429a8cb305 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:54.040161 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1b66d21-dcd9-48f0-9925-4e429a8cb305 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:54.178412 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c1b66d21-dcd9-48f0-9925-4e429a8cb305 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:54.186757 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c1b66d21-dcd9-48f0-9925-4e429a8cb305 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1668 microversion: 2.1 time: 0.160838 Aug 24 11:27:54.187311 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3523/7410] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:54 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:55.282855 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dd3bc1a3-1d43-4fbb-bcab-47a7c47503ca tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:55.285622 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dd3bc1a3-1d43-4fbb-bcab-47a7c47503ca tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:55.293235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd3bc1a3-1d43-4fbb-bcab-47a7c47503ca tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:55.293732 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd3bc1a3-1d43-4fbb-bcab-47a7c47503ca tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:55.294175 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd3bc1a3-1d43-4fbb-bcab-47a7c47503ca tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:55.294878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd3bc1a3-1d43-4fbb-bcab-47a7c47503ca tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:55.295348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd3bc1a3-1d43-4fbb-bcab-47a7c47503ca tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:55.295786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd3bc1a3-1d43-4fbb-bcab-47a7c47503ca tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:55.359482 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dd3bc1a3-1d43-4fbb-bcab-47a7c47503ca tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59/action" status: 200 len: 38405 microversion: 2.1 time: 0.081299 Aug 24 11:27:55.360280 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3888/7411] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:27:55 2022] POST /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59/action => generated 38405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:27:55.378216 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-56e6ffc9-19d4-4dc2-b589-3055b3d17947 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:55.388316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56e6ffc9-19d4-4dc2-b589-3055b3d17947 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:55.388802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56e6ffc9-19d4-4dc2-b589-3055b3d17947 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:55.389274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56e6ffc9-19d4-4dc2-b589-3055b3d17947 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:55.412775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-56e6ffc9-19d4-4dc2-b589-3055b3d17947 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Going to try to start instance {{(pid=122432) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 11:27:55.465956 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-56e6ffc9-19d4-4dc2-b589-3055b3d17947 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59/action" status: 202 len: 0 microversion: 2.1 time: 0.094133 Aug 24 11:27:55.466582 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3524/7412] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:27:55 2022] POST /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:27:55.475885 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c1edf876-147e-4e12-b381-a80eb8c18a16 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:55.476717 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c1edf876-147e-4e12-b381-a80eb8c18a16 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:55.484336 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1edf876-147e-4e12-b381-a80eb8c18a16 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:55.484962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1edf876-147e-4e12-b381-a80eb8c18a16 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:55.485522 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1edf876-147e-4e12-b381-a80eb8c18a16 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:55.486219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1edf876-147e-4e12-b381-a80eb8c18a16 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:55.486705 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1edf876-147e-4e12-b381-a80eb8c18a16 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:55.487134 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1edf876-147e-4e12-b381-a80eb8c18a16 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:55.642784 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c1edf876-147e-4e12-b381-a80eb8c18a16 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:55.651109 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c1edf876-147e-4e12-b381-a80eb8c18a16 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1677 microversion: 2.1 time: 0.179483 Aug 24 11:27:55.651695 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3889/7413] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:55 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:56.678460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5fb8e0f2-75e5-47e4-a08c-33cba84af5ac tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:56.679588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5fb8e0f2-75e5-47e4-a08c-33cba84af5ac tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:56.691316 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fb8e0f2-75e5-47e4-a08c-33cba84af5ac tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:56.692117 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fb8e0f2-75e5-47e4-a08c-33cba84af5ac tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:56.692855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fb8e0f2-75e5-47e4-a08c-33cba84af5ac tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:56.694045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fb8e0f2-75e5-47e4-a08c-33cba84af5ac tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:56.694805 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fb8e0f2-75e5-47e4-a08c-33cba84af5ac tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:56.695481 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fb8e0f2-75e5-47e4-a08c-33cba84af5ac tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:57.154387 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5fb8e0f2-75e5-47e4-a08c-33cba84af5ac tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:57.166123 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5fb8e0f2-75e5-47e4-a08c-33cba84af5ac tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1677 microversion: 2.1 time: 0.494625 Aug 24 11:27:57.166900 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3525/7414] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:56 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1677 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:58.196148 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-048a6825-fa9b-4a44-b2f7-6d2a9a2ae8fb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:58.196744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-048a6825-fa9b-4a44-b2f7-6d2a9a2ae8fb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:58.204178 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-048a6825-fa9b-4a44-b2f7-6d2a9a2ae8fb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:58.204679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-048a6825-fa9b-4a44-b2f7-6d2a9a2ae8fb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:58.205156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-048a6825-fa9b-4a44-b2f7-6d2a9a2ae8fb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:58.205881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-048a6825-fa9b-4a44-b2f7-6d2a9a2ae8fb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:58.206354 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-048a6825-fa9b-4a44-b2f7-6d2a9a2ae8fb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:58.206795 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-048a6825-fa9b-4a44-b2f7-6d2a9a2ae8fb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:58.341972 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-048a6825-fa9b-4a44-b2f7-6d2a9a2ae8fb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:58.350342 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-048a6825-fa9b-4a44-b2f7-6d2a9a2ae8fb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1681 microversion: 2.1 time: 0.160551 Aug 24 11:27:58.350928 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3890/7415] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:58 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:22.586774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-17991e98-60a8-4309-a6d1-c48cbd8a1b21 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:22.589080 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-17991e98-60a8-4309-a6d1-c48cbd8a1b21 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:22.591596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=20 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:22.592250 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:22.598242 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17991e98-60a8-4309-a6d1-c48cbd8a1b21 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:22.598728 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17991e98-60a8-4309-a6d1-c48cbd8a1b21 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:22.599165 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17991e98-60a8-4309-a6d1-c48cbd8a1b21 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:22.599865 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17991e98-60a8-4309-a6d1-c48cbd8a1b21 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:22.600326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17991e98-60a8-4309-a6d1-c48cbd8a1b21 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:22.600749 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17991e98-60a8-4309-a6d1-c48cbd8a1b21 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:22.677394 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-17991e98-60a8-4309-a6d1-c48cbd8a1b21 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59/action" status: 200 len: 62970 microversion: 2.1 time: 0.096312 Aug 24 11:28:22.678605 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3526/7416] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:28:22 2022] POST /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59/action => generated 62970 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:28:29.955939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e78fb14f-367c-4371-8682-dad30bfebc67 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:29.956487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e78fb14f-367c-4371-8682-dad30bfebc67 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:29.958554 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3e9acdc2-6e75-49d6-8191-ef5dc1379a11 req-273dd97b-1739-4a8d-8c30-2458b91a34af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e067fd81-410a-4c34-872e-0cdad20eda59", "tag": "d2aeb663-785a-490f-9bf4-3d02e9a7d3a3"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:29.959722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=20 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:29.960671 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=58 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:29.967415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e78fb14f-367c-4371-8682-dad30bfebc67 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:29.968166 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e78fb14f-367c-4371-8682-dad30bfebc67 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:29.968618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e78fb14f-367c-4371-8682-dad30bfebc67 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:29.969542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e78fb14f-367c-4371-8682-dad30bfebc67 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:29.970025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e78fb14f-367c-4371-8682-dad30bfebc67 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:29.970459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e78fb14f-367c-4371-8682-dad30bfebc67 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:29.971777 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3e9acdc2-6e75-49d6-8191-ef5dc1379a11 req-273dd97b-1739-4a8d-8c30-2458b91a34af service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:29.972261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3e9acdc2-6e75-49d6-8191-ef5dc1379a11 req-273dd97b-1739-4a8d-8c30-2458b91a34af service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:29.972917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3e9acdc2-6e75-49d6-8191-ef5dc1379a11 req-273dd97b-1739-4a8d-8c30-2458b91a34af service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:29.984678 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3e9acdc2-6e75-49d6-8191-ef5dc1379a11 req-273dd97b-1739-4a8d-8c30-2458b91a34af service nova] Creating event network-changed:d2aeb663-785a-490f-9bf4-3d02e9a7d3a3 for instance e067fd81-410a-4c34-872e-0cdad20eda59 on n-h1-849328-3 Aug 24 11:28:29.989905 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3e9acdc2-6e75-49d6-8191-ef5dc1379a11 req-273dd97b-1739-4a8d-8c30-2458b91a34af service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035473 Aug 24 11:28:29.990554 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3527/7417] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:28:30.002089 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e78fb14f-367c-4371-8682-dad30bfebc67 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:28:30.091808 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e78fb14f-367c-4371-8682-dad30bfebc67 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "DELETE /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 204 len: 0 microversion: 2.1 time: 0.139982 Aug 24 11:28:30.094176 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3891/7418] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:28:29 2022] DELETE /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:28:30.102415 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bbdee569-7d0d-429d-ad96-12fd190c8151 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:30.103478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bbdee569-7d0d-429d-ad96-12fd190c8151 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:30.112159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbdee569-7d0d-429d-ad96-12fd190c8151 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:30.112650 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbdee569-7d0d-429d-ad96-12fd190c8151 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:30.113090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbdee569-7d0d-429d-ad96-12fd190c8151 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:30.113850 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbdee569-7d0d-429d-ad96-12fd190c8151 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:30.114302 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbdee569-7d0d-429d-ad96-12fd190c8151 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:30.114726 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbdee569-7d0d-429d-ad96-12fd190c8151 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:30.252829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bbdee569-7d0d-429d-ad96-12fd190c8151 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:30.261156 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bbdee569-7d0d-429d-ad96-12fd190c8151 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1687 microversion: 2.1 time: 0.163358 Aug 24 11:28:30.261754 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3528/7419] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:30 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:31.288026 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-35ea2bf5-9c20-4cea-8293-d47caeeeea82 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:31.289178 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-35ea2bf5-9c20-4cea-8293-d47caeeeea82 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:31.300837 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35ea2bf5-9c20-4cea-8293-d47caeeeea82 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:31.301688 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35ea2bf5-9c20-4cea-8293-d47caeeeea82 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:31.302435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35ea2bf5-9c20-4cea-8293-d47caeeeea82 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:31.303644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35ea2bf5-9c20-4cea-8293-d47caeeeea82 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:31.304419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35ea2bf5-9c20-4cea-8293-d47caeeeea82 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:31.305031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35ea2bf5-9c20-4cea-8293-d47caeeeea82 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:31.493352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-35ea2bf5-9c20-4cea-8293-d47caeeeea82 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:31.505380 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-35ea2bf5-9c20-4cea-8293-d47caeeeea82 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1687 microversion: 2.1 time: 0.224194 Aug 24 11:28:31.506250 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3892/7420] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:31 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1687 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:32.180977 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-2f7935ae-c6f3-4811-8470-b90532620cbc req-8d5db1b9-436c-4505-b416-ca5b01f43331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e067fd81-410a-4c34-872e-0cdad20eda59", "name": "network-vif-deleted", "tag": "d2aeb663-785a-490f-9bf4-3d02e9a7d3a3"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:32.192209 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2f7935ae-c6f3-4811-8470-b90532620cbc req-8d5db1b9-436c-4505-b416-ca5b01f43331 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:32.192696 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2f7935ae-c6f3-4811-8470-b90532620cbc req-8d5db1b9-436c-4505-b416-ca5b01f43331 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:32.193224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2f7935ae-c6f3-4811-8470-b90532620cbc req-8d5db1b9-436c-4505-b416-ca5b01f43331 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:32.204885 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-2f7935ae-c6f3-4811-8470-b90532620cbc req-8d5db1b9-436c-4505-b416-ca5b01f43331 service nova] Creating event network-vif-deleted:d2aeb663-785a-490f-9bf4-3d02e9a7d3a3 for instance e067fd81-410a-4c34-872e-0cdad20eda59 on n-h1-849328-3 Aug 24 11:28:32.210081 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-2f7935ae-c6f3-4811-8470-b90532620cbc req-8d5db1b9-436c-4505-b416-ca5b01f43331 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032986 Aug 24 11:28:32.210728 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3529/7421] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:28:32.535418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-268949b4-d486-48b4-9a60-c2d3d0863163 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:32.536049 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-268949b4-d486-48b4-9a60-c2d3d0863163 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:32.543679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-268949b4-d486-48b4-9a60-c2d3d0863163 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:32.544188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-268949b4-d486-48b4-9a60-c2d3d0863163 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:32.544640 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-268949b4-d486-48b4-9a60-c2d3d0863163 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:32.545481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-268949b4-d486-48b4-9a60-c2d3d0863163 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:32.545958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-268949b4-d486-48b4-9a60-c2d3d0863163 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:32.546400 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-268949b4-d486-48b4-9a60-c2d3d0863163 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:32.581897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-268949b4-d486-48b4-9a60-c2d3d0863163 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:32.582636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-268949b4-d486-48b4-9a60-c2d3d0863163 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:32.582826 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-268949b4-d486-48b4-9a60-c2d3d0863163 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:32.583290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-268949b4-d486-48b4-9a60-c2d3d0863163 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lazy-loading 'fault' on Instance uuid e067fd81-410a-4c34-872e-0cdad20eda59 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:28:32.627404 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-268949b4-d486-48b4-9a60-c2d3d0863163 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:32.637247 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-268949b4-d486-48b4-9a60-c2d3d0863163 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 200 len: 1356 microversion: 2.1 time: 0.105701 Aug 24 11:28:32.637848 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3893/7422] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:32 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 1356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:33.664792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-20c70430-6b85-4cfa-ac0a-d58025d7349e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:33.665500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-20c70430-6b85-4cfa-ac0a-d58025d7349e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: e067fd81-410a-4c34-872e-0cdad20eda59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:33.672340 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20c70430-6b85-4cfa-ac0a-d58025d7349e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:33.672833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20c70430-6b85-4cfa-ac0a-d58025d7349e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:33.673301 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20c70430-6b85-4cfa-ac0a-d58025d7349e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:33.673990 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20c70430-6b85-4cfa-ac0a-d58025d7349e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:33.674443 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20c70430-6b85-4cfa-ac0a-d58025d7349e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:33.674864 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20c70430-6b85-4cfa-ac0a-d58025d7349e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:33.688462 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-20c70430-6b85-4cfa-ac0a-d58025d7349e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] HTTP exception thrown: Instance e067fd81-410a-4c34-872e-0cdad20eda59 could not be found. Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-20c70430-6b85-4cfa-ac0a-d58025d7349e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Request method failure captured: Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 HTTP/1.1 Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBgncfDWps3oSnkGWh604hOpiheCjj8_0BYAjCgEtswuOyN76lOlAH_8p8Uj7QuLZqZrHJqGhmKvQcmRgQjYyq3xw0zzP1xAec9u3lQcKsftkv7yoMv-UqmOKrubG7PpaZzLpooDFEsUT2iVLZk3IHgmNHmgtRKVhQiSyHbimZM2IotU Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 36574fcb42ea44ca970b5bfa9697af8c Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1665657358 Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/36574fcb42ea44ca970b5bfa9697af8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_36574fcb42ea44ca970b5bfa9697af8c", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/36574fcb42ea44ca970b5bfa9697af8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/36574fcb42ea44ca970b5bfa9697af8c"}]}] Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1665657358 Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 36574fcb42ea44ca970b5bfa9697af8c Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1665657358 Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-TestNetworkAdvancedServerOps-1665657358-project Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: ab7f1eb7298e4cad86ad953eac53c9c3 Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1665657358-project Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance e067fd81-410a-4c34-872e-0cdad20eda59 could not be found. Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': 'e067fd81-410a-4c34-872e-0cdad20eda59'} Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e067fd81-410a-4c34-872e-0cdad20eda59 could not be found. Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e067fd81-410a-4c34-872e-0cdad20eda59 could not be found. Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:28:33.690163 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:28:33.694380 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:28:33.694380 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:28:33.694380 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:28:33.694380 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:28:33.694380 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:28:33.694380 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:28:33.694380 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e067fd81-410a-4c34-872e-0cdad20eda59 could not be found. Aug 24 11:28:33.694380 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:28:33.694380 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-20c70430-6b85-4cfa-ac0a-d58025d7349e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Returning 404 to user: Instance e067fd81-410a-4c34-872e-0cdad20eda59 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:28:33.694380 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-20c70430-6b85-4cfa-ac0a-d58025d7349e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59" status: 404 len: 111 microversion: 2.1 time: 0.035234 Aug 24 11:28:33.694380 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3530/7423] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:33 2022] GET /compute/v2.1/servers/e067fd81-410a-4c34-872e-0cdad20eda59 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:28:37.103518 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3fa2e246-17ed-4357-971c-95fbe2885414 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '.version_select at 0x7f4647a75820>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:37.130660 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3fa2e246-17ed-4357-971c-95fbe2885414 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1469325958" status: 202 len: 0 microversion: 2.1 time: 0.030954 Aug 24 11:28:37.131324 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3894/7424] 10.222.0.85 () {58 vars in 1284 bytes} [Wed Aug 24 11:28:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1469325958 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:28:37.163355 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2536fcf0-ab35-41ae-99c6-7caa137cf137 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'create', calling method: .version_select at 0x7f46540578b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-326313020", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/FwT3uDDHRu3Ff7lFO2U2q6W49ygiRQPY8TKLE6Iy+NG74zFX192FjLnTeTqyfYGwVKArWsPOw9X6xx6zlQ/3Hjkes+PoiRIsAme7hgZ86xRE+K413aNDvlNY9nTgHzA=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:37.181837 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-2536fcf0-ab35-41ae-99c6-7caa137cf137 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Getting quotas for project 36574fcb42ea44ca970b5bfa9697af8c. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:28:37.187289 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-2536fcf0-ab35-41ae-99c6-7caa137cf137 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Getting quotas for user ab7f1eb7298e4cad86ad953eac53c9c3 and project 36574fcb42ea44ca970b5bfa9697af8c. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:28:37.212043 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2536fcf0-ab35-41ae-99c6-7caa137cf137 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052828 Aug 24 11:28:37.212658 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3531/7425] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 11:28:37 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:28:42.866618 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:42.871329 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1a78a03c-fb99-498a-a3fa-7019acd3211f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-763809131", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "networks": [{"uuid": "eb637b63-2938-4983-8b95-90d7dc487500"}], "key_name": "tempest-TestNetworkAdvancedServerOps-326313020", "security_groups": [{"name": "tempest-secgroup-smoke-491247252"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:42.987070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-1a78a03c-fb99-498a-a3fa-7019acd3211f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] validate_networks() for [('eb637b63-2938-4983-8b95-90d7dc487500', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:28:43.451472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-1a78a03c-fb99-498a-a3fa-7019acd3211f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:28:43.452132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-1a78a03c-fb99-498a-a3fa-7019acd3211f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:28:43.452896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-1a78a03c-fb99-498a-a3fa-7019acd3211f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:28:43.453294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-1a78a03c-fb99-498a-a3fa-7019acd3211f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:28:43.453800 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-1a78a03c-fb99-498a-a3fa-7019acd3211f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:28:43.468491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a78a03c-fb99-498a-a3fa-7019acd3211f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:43.469086 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a78a03c-fb99-498a-a3fa-7019acd3211f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:43.469553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a78a03c-fb99-498a-a3fa-7019acd3211f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:43.470289 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a78a03c-fb99-498a-a3fa-7019acd3211f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:43.470750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a78a03c-fb99-498a-a3fa-7019acd3211f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:43.471213 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a78a03c-fb99-498a-a3fa-7019acd3211f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:43.494508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-1a78a03c-fb99-498a-a3fa-7019acd3211f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Getting quotas for project 36574fcb42ea44ca970b5bfa9697af8c. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:28:43.500514 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-1a78a03c-fb99-498a-a3fa-7019acd3211f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Getting quotas for user ab7f1eb7298e4cad86ad953eac53c9c3 and project 36574fcb42ea44ca970b5bfa9697af8c. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:28:43.518616 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1a78a03c-fb99-498a-a3fa-7019acd3211f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:28:43.520968 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1a78a03c-fb99-498a-a3fa-7019acd3211f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:28:43.575464 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1a78a03c-fb99-498a-a3fa-7019acd3211f tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.710639 Aug 24 11:28:43.576279 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3895/7426] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 11:28:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:28:43.588669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-577d9bc5-e8e2-4c4f-8c88-b8d0118f35a2 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:43.589890 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-577d9bc5-e8e2-4c4f-8c88-b8d0118f35a2 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:43.668158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-577d9bc5-e8e2-4c4f-8c88-b8d0118f35a2 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:43.678934 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-577d9bc5-e8e2-4c4f-8c88-b8d0118f35a2 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a" status: 200 len: 1265 microversion: 2.1 time: 0.095073 Aug 24 11:28:43.685166 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3532/7427] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:43 2022] GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a => generated 1265 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:44.700924 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb6c0404-a3db-4dc8-8724-5229d983ac6a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:44.702578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cb6c0404-a3db-4dc8-8724-5229d983ac6a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:44.712130 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb6c0404-a3db-4dc8-8724-5229d983ac6a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:44.712927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb6c0404-a3db-4dc8-8724-5229d983ac6a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:44.713651 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb6c0404-a3db-4dc8-8724-5229d983ac6a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:44.714608 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb6c0404-a3db-4dc8-8724-5229d983ac6a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:44.715232 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb6c0404-a3db-4dc8-8724-5229d983ac6a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:44.715878 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb6c0404-a3db-4dc8-8724-5229d983ac6a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:44.794149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cb6c0404-a3db-4dc8-8724-5229d983ac6a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:44.805156 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cb6c0404-a3db-4dc8-8724-5229d983ac6a tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a" status: 200 len: 1335 microversion: 2.1 time: 0.108577 Aug 24 11:28:44.806301 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3896/7428] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:44 2022] GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a => generated 1335 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:45.827853 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-82bf9259-6797-4d98-872d-42e4ee3317e7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:45.828522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-82bf9259-6797-4d98-872d-42e4ee3317e7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:45.831107 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=16 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:45.839186 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82bf9259-6797-4d98-872d-42e4ee3317e7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:45.839676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82bf9259-6797-4d98-872d-42e4ee3317e7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:45.840118 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82bf9259-6797-4d98-872d-42e4ee3317e7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:45.840825 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82bf9259-6797-4d98-872d-42e4ee3317e7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:45.841329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82bf9259-6797-4d98-872d-42e4ee3317e7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:45.841755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82bf9259-6797-4d98-872d-42e4ee3317e7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:46.087258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-82bf9259-6797-4d98-872d-42e4ee3317e7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:46.097341 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-82bf9259-6797-4d98-872d-42e4ee3317e7 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a" status: 200 len: 1390 microversion: 2.1 time: 0.273487 Aug 24 11:28:46.098516 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3533/7429] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:45 2022] GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a => generated 1390 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:46.237216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-4da6960d-6101-4733-9986-4d7c490cec00 req-555c6608-f0a8-4dcb-b023-942930f9877a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "888fa81b-390a-472d-a305-4af89437b94a", "tag": "10a0719a-9ab8-43d7-9539-46dc1683e6f5"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:46.255456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4da6960d-6101-4733-9986-4d7c490cec00 req-555c6608-f0a8-4dcb-b023-942930f9877a service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:46.255962 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4da6960d-6101-4733-9986-4d7c490cec00 req-555c6608-f0a8-4dcb-b023-942930f9877a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:46.256432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4da6960d-6101-4733-9986-4d7c490cec00 req-555c6608-f0a8-4dcb-b023-942930f9877a service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:46.289476 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-4da6960d-6101-4733-9986-4d7c490cec00 req-555c6608-f0a8-4dcb-b023-942930f9877a service nova] Creating event network-changed:10a0719a-9ab8-43d7-9539-46dc1683e6f5 for instance 888fa81b-390a-472d-a305-4af89437b94a on n-h2-849328-3 Aug 24 11:28:46.298380 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-4da6960d-6101-4733-9986-4d7c490cec00 req-555c6608-f0a8-4dcb-b023-942930f9877a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065809 Aug 24 11:28:46.299631 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3897/7430] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:28:47.119095 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-234d908f-6c13-46e0-9b81-cc5f54ef1bb8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:47.119730 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-234d908f-6c13-46e0-9b81-cc5f54ef1bb8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:47.127934 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-234d908f-6c13-46e0-9b81-cc5f54ef1bb8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:47.129037 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-234d908f-6c13-46e0-9b81-cc5f54ef1bb8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:47.129478 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-234d908f-6c13-46e0-9b81-cc5f54ef1bb8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:47.130181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-234d908f-6c13-46e0-9b81-cc5f54ef1bb8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:47.130627 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-234d908f-6c13-46e0-9b81-cc5f54ef1bb8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:47.131043 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-234d908f-6c13-46e0-9b81-cc5f54ef1bb8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:47.282160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-234d908f-6c13-46e0-9b81-cc5f54ef1bb8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:47.290568 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-234d908f-6c13-46e0-9b81-cc5f54ef1bb8 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a" status: 200 len: 1390 microversion: 2.1 time: 0.175425 Aug 24 11:28:47.291161 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3534/7431] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:47 2022] GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a => generated 1390 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:48.318207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-15c52a10-2175-4094-9e09-b301171a16c4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:48.319256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-15c52a10-2175-4094-9e09-b301171a16c4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:48.329352 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15c52a10-2175-4094-9e09-b301171a16c4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:48.330108 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15c52a10-2175-4094-9e09-b301171a16c4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:48.330793 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15c52a10-2175-4094-9e09-b301171a16c4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:48.331868 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15c52a10-2175-4094-9e09-b301171a16c4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:48.332590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15c52a10-2175-4094-9e09-b301171a16c4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:48.333389 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15c52a10-2175-4094-9e09-b301171a16c4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:48.483667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-15c52a10-2175-4094-9e09-b301171a16c4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:48.492061 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-15c52a10-2175-4094-9e09-b301171a16c4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a" status: 200 len: 1390 microversion: 2.1 time: 0.182023 Aug 24 11:28:48.492669 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3898/7432] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:48 2022] GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a => generated 1390 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:49.518925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1c503dfb-f2ad-45ba-a48b-293eff9a2da5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:49.519791 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1c503dfb-f2ad-45ba-a48b-293eff9a2da5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:49.527476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c503dfb-f2ad-45ba-a48b-293eff9a2da5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:49.528303 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c503dfb-f2ad-45ba-a48b-293eff9a2da5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:49.528916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c503dfb-f2ad-45ba-a48b-293eff9a2da5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:49.529880 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c503dfb-f2ad-45ba-a48b-293eff9a2da5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:49.530340 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c503dfb-f2ad-45ba-a48b-293eff9a2da5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:49.530766 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c503dfb-f2ad-45ba-a48b-293eff9a2da5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:49.669497 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1c503dfb-f2ad-45ba-a48b-293eff9a2da5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:49.677673 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1c503dfb-f2ad-45ba-a48b-293eff9a2da5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a" status: 200 len: 1390 microversion: 2.1 time: 0.162819 Aug 24 11:28:49.678231 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3535/7433] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:49 2022] GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:50.699853 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-96428a16-1657-4c6b-a28f-f0f9b142f26d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:50.700571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-96428a16-1657-4c6b-a28f-f0f9b142f26d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:50.709171 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96428a16-1657-4c6b-a28f-f0f9b142f26d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:50.709733 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96428a16-1657-4c6b-a28f-f0f9b142f26d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:50.710180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96428a16-1657-4c6b-a28f-f0f9b142f26d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:50.710888 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96428a16-1657-4c6b-a28f-f0f9b142f26d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:50.711356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96428a16-1657-4c6b-a28f-f0f9b142f26d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:50.711790 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96428a16-1657-4c6b-a28f-f0f9b142f26d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:50.860266 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-96428a16-1657-4c6b-a28f-f0f9b142f26d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:50.869223 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-96428a16-1657-4c6b-a28f-f0f9b142f26d tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a" status: 200 len: 1390 microversion: 2.1 time: 0.173756 Aug 24 11:28:50.869824 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3899/7434] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:50 2022] GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a => generated 1390 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:51.751711 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-f7c8b909-d8f6-4a70-83ad-6d50b184b566 req-5d816648-3505-44da-bf83-f9abf600599f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "888fa81b-390a-472d-a305-4af89437b94a", "name": "network-vif-plugged", "status": "completed", "tag": "10a0719a-9ab8-43d7-9539-46dc1683e6f5"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:51.762096 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f7c8b909-d8f6-4a70-83ad-6d50b184b566 req-5d816648-3505-44da-bf83-f9abf600599f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:51.762569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f7c8b909-d8f6-4a70-83ad-6d50b184b566 req-5d816648-3505-44da-bf83-f9abf600599f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:51.763383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f7c8b909-d8f6-4a70-83ad-6d50b184b566 req-5d816648-3505-44da-bf83-f9abf600599f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:51.774697 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-f7c8b909-d8f6-4a70-83ad-6d50b184b566 req-5d816648-3505-44da-bf83-f9abf600599f service nova] Creating event network-vif-plugged:10a0719a-9ab8-43d7-9539-46dc1683e6f5 for instance 888fa81b-390a-472d-a305-4af89437b94a on n-h2-849328-3 Aug 24 11:28:51.779777 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-f7c8b909-d8f6-4a70-83ad-6d50b184b566 req-5d816648-3505-44da-bf83-f9abf600599f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094338 Aug 24 11:28:51.780469 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3536/7435] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:28:51.894419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bc423f57-c00a-421d-bd03-2d96221c9038 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:51.895140 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bc423f57-c00a-421d-bd03-2d96221c9038 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:51.902877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc423f57-c00a-421d-bd03-2d96221c9038 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:51.903267 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc423f57-c00a-421d-bd03-2d96221c9038 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:51.903722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc423f57-c00a-421d-bd03-2d96221c9038 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:51.904594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc423f57-c00a-421d-bd03-2d96221c9038 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:51.905070 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc423f57-c00a-421d-bd03-2d96221c9038 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:51.905543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc423f57-c00a-421d-bd03-2d96221c9038 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:52.045915 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bc423f57-c00a-421d-bd03-2d96221c9038 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:52.054195 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bc423f57-c00a-421d-bd03-2d96221c9038 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a" status: 200 len: 1390 microversion: 2.1 time: 0.163918 Aug 24 11:28:52.054816 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3900/7436] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:51 2022] GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:53.083458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-31fac06a-22a7-43bb-b238-069f98e3fdfb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:53.084173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-31fac06a-22a7-43bb-b238-069f98e3fdfb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:53.086347 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:53.094406 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31fac06a-22a7-43bb-b238-069f98e3fdfb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:53.094406 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31fac06a-22a7-43bb-b238-069f98e3fdfb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:53.094406 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31fac06a-22a7-43bb-b238-069f98e3fdfb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:53.094946 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31fac06a-22a7-43bb-b238-069f98e3fdfb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:53.095555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31fac06a-22a7-43bb-b238-069f98e3fdfb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:53.096010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31fac06a-22a7-43bb-b238-069f98e3fdfb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:53.243755 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-31fac06a-22a7-43bb-b238-069f98e3fdfb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:53.251967 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-31fac06a-22a7-43bb-b238-069f98e3fdfb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a" status: 200 len: 1390 microversion: 2.1 time: 0.180200 Aug 24 11:28:53.252571 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3537/7437] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:53 2022] GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a => generated 1390 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:54.274426 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-87baecaf-ebf2-41c9-8a92-71ebbfaf59dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:54.275032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-87baecaf-ebf2-41c9-8a92-71ebbfaf59dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:54.277395 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:54.278071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:54.284109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87baecaf-ebf2-41c9-8a92-71ebbfaf59dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:54.284611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87baecaf-ebf2-41c9-8a92-71ebbfaf59dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:54.285062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87baecaf-ebf2-41c9-8a92-71ebbfaf59dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:54.285838 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87baecaf-ebf2-41c9-8a92-71ebbfaf59dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:54.286319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87baecaf-ebf2-41c9-8a92-71ebbfaf59dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:54.286759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87baecaf-ebf2-41c9-8a92-71ebbfaf59dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:54.422621 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-87baecaf-ebf2-41c9-8a92-71ebbfaf59dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:54.431117 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-87baecaf-ebf2-41c9-8a92-71ebbfaf59dd tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a" status: 200 len: 1561 microversion: 2.1 time: 0.160874 Aug 24 11:28:54.431713 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3901/7438] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:54 2022] GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:54.453323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-09a7ef06-bebd-474d-bd44-83008eed68a5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:54.453925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-09a7ef06-bebd-474d-bd44-83008eed68a5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:54.455914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:54.462458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09a7ef06-bebd-474d-bd44-83008eed68a5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:54.462939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09a7ef06-bebd-474d-bd44-83008eed68a5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:54.463344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09a7ef06-bebd-474d-bd44-83008eed68a5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:54.464036 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09a7ef06-bebd-474d-bd44-83008eed68a5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:54.464487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09a7ef06-bebd-474d-bd44-83008eed68a5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:54.464910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09a7ef06-bebd-474d-bd44-83008eed68a5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:54.602312 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-09a7ef06-bebd-474d-bd44-83008eed68a5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:54.610384 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-09a7ef06-bebd-474d-bd44-83008eed68a5 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a" status: 200 len: 1561 microversion: 2.1 time: 0.161070 Aug 24 11:28:54.610948 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3538/7439] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:54 2022] GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:56.505781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-68fae762-e68c-4464-a1de-641aa1a569cb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:56.506464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-68fae762-e68c-4464-a1de-641aa1a569cb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:56.511175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-b02ec042-4d75-46e3-b1e1-58816ed39817 req-55cd771b-25a5-4cae-9269-12c019b6c7e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "888fa81b-390a-472d-a305-4af89437b94a", "tag": "10a0719a-9ab8-43d7-9539-46dc1683e6f5"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:56.520216 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68fae762-e68c-4464-a1de-641aa1a569cb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:56.520730 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68fae762-e68c-4464-a1de-641aa1a569cb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:56.521203 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68fae762-e68c-4464-a1de-641aa1a569cb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:56.522013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68fae762-e68c-4464-a1de-641aa1a569cb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:56.522521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68fae762-e68c-4464-a1de-641aa1a569cb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:56.522967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68fae762-e68c-4464-a1de-641aa1a569cb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:56.528086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b02ec042-4d75-46e3-b1e1-58816ed39817 req-55cd771b-25a5-4cae-9269-12c019b6c7e6 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:56.528569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b02ec042-4d75-46e3-b1e1-58816ed39817 req-55cd771b-25a5-4cae-9269-12c019b6c7e6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:56.529327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b02ec042-4d75-46e3-b1e1-58816ed39817 req-55cd771b-25a5-4cae-9269-12c019b6c7e6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:56.541592 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b02ec042-4d75-46e3-b1e1-58816ed39817 req-55cd771b-25a5-4cae-9269-12c019b6c7e6 service nova] Creating event network-changed:10a0719a-9ab8-43d7-9539-46dc1683e6f5 for instance 888fa81b-390a-472d-a305-4af89437b94a on n-h2-849328-3 Aug 24 11:28:56.547369 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-b02ec042-4d75-46e3-b1e1-58816ed39817 req-55cd771b-25a5-4cae-9269-12c019b6c7e6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041906 Aug 24 11:28:56.548562 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3539/7440] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:28:56.683160 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-68fae762-e68c-4464-a1de-641aa1a569cb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:56.691904 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-68fae762-e68c-4464-a1de-641aa1a569cb tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a" status: 200 len: 1561 microversion: 2.1 time: 0.190450 Aug 24 11:28:56.692816 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3902/7441] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:56 2022] GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a => generated 1561 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:19.963923 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9bb0c825-2350-4d74-9d93-8d5837042397 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:19.966404 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9bb0c825-2350-4d74-9d93-8d5837042397 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:19.968743 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=5 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:19.969538 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=34 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:19.976354 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9bb0c825-2350-4d74-9d93-8d5837042397 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:19.976834 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9bb0c825-2350-4d74-9d93-8d5837042397 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:19.977296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9bb0c825-2350-4d74-9d93-8d5837042397 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:19.977990 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9bb0c825-2350-4d74-9d93-8d5837042397 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:19.978471 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9bb0c825-2350-4d74-9d93-8d5837042397 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:19.978891 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9bb0c825-2350-4d74-9d93-8d5837042397 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:20.037577 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9bb0c825-2350-4d74-9d93-8d5837042397 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a/action" status: 200 len: 24574 microversion: 2.1 time: 0.078502 Aug 24 11:29:20.038414 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3540/7442] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:29:19 2022] POST /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a/action => generated 24574 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:29:30.987244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7b43bf2a-67ac-4ff9-965d-0e62227298ae tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:30.987874 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7b43bf2a-67ac-4ff9-965d-0e62227298ae tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:30.990503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:30.991145 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=40 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:30.999884 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b43bf2a-67ac-4ff9-965d-0e62227298ae tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:31.000399 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b43bf2a-67ac-4ff9-965d-0e62227298ae tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:31.001049 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b43bf2a-67ac-4ff9-965d-0e62227298ae tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:31.002560 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b43bf2a-67ac-4ff9-965d-0e62227298ae tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:31.003306 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b43bf2a-67ac-4ff9-965d-0e62227298ae tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:31.003925 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b43bf2a-67ac-4ff9-965d-0e62227298ae tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:31.032811 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-7b43bf2a-67ac-4ff9-965d-0e62227298ae tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lazy-loading 'flavor' on Instance uuid 888fa81b-390a-472d-a305-4af89437b94a {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:29:31.114751 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7b43bf2a-67ac-4ff9-965d-0e62227298ae tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a/action" status: 202 len: 0 microversion: 2.1 time: 0.131572 Aug 24 11:29:31.115902 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3903/7443] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:29:30 2022] POST /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:29:31.125548 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-96560339-d52b-44d7-acb6-cf8ae4142987 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:31.130678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-96560339-d52b-44d7-acb6-cf8ae4142987 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:31.130678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:31.131565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:31.136785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96560339-d52b-44d7-acb6-cf8ae4142987 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:31.138111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96560339-d52b-44d7-acb6-cf8ae4142987 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:31.138111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96560339-d52b-44d7-acb6-cf8ae4142987 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:31.138439 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96560339-d52b-44d7-acb6-cf8ae4142987 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:31.138966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96560339-d52b-44d7-acb6-cf8ae4142987 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:31.142486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96560339-d52b-44d7-acb6-cf8ae4142987 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:31.356464 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-96560339-d52b-44d7-acb6-cf8ae4142987 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:31.365908 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-96560339-d52b-44d7-acb6-cf8ae4142987 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a" status: 200 len: 1688 microversion: 2.1 time: 0.244545 Aug 24 11:29:31.366580 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3541/7444] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:31 2022] GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a => generated 1688 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:32.390109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f0471017-871f-493d-8d34-f47a42d15fa6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:32.390810 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f0471017-871f-493d-8d34-f47a42d15fa6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:32.397428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0471017-871f-493d-8d34-f47a42d15fa6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:32.397938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0471017-871f-493d-8d34-f47a42d15fa6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:32.398391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0471017-871f-493d-8d34-f47a42d15fa6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:32.399096 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0471017-871f-493d-8d34-f47a42d15fa6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:32.399567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0471017-871f-493d-8d34-f47a42d15fa6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:32.400009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0471017-871f-493d-8d34-f47a42d15fa6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:32.556773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f0471017-871f-493d-8d34-f47a42d15fa6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:32.565850 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f0471017-871f-493d-8d34-f47a42d15fa6 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a" status: 200 len: 1671 microversion: 2.1 time: 0.181093 Aug 24 11:29:32.566468 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3904/7445] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:32 2022] GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a => generated 1671 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:33.672811 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b72263a1-4184-4e26-b293-d09ee6b1d60e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:33.675819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b72263a1-4184-4e26-b293-d09ee6b1d60e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:33.689918 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b72263a1-4184-4e26-b293-d09ee6b1d60e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:33.690556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b72263a1-4184-4e26-b293-d09ee6b1d60e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:33.691136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b72263a1-4184-4e26-b293-d09ee6b1d60e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:33.692078 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b72263a1-4184-4e26-b293-d09ee6b1d60e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:33.692521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b72263a1-4184-4e26-b293-d09ee6b1d60e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:33.692939 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b72263a1-4184-4e26-b293-d09ee6b1d60e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:33.752074 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b72263a1-4184-4e26-b293-d09ee6b1d60e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a/action" status: 200 len: 38237 microversion: 2.1 time: 0.083953 Aug 24 11:29:33.753088 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3542/7446] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:29:33 2022] POST /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a/action => generated 38237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:29:33.768409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-166e899c-5b3a-4ac9-bccf-2bf5eef91d68 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:33.768953 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-166e899c-5b3a-4ac9-bccf-2bf5eef91d68 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:33.778900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-166e899c-5b3a-4ac9-bccf-2bf5eef91d68 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:33.779496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-166e899c-5b3a-4ac9-bccf-2bf5eef91d68 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:33.780580 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-166e899c-5b3a-4ac9-bccf-2bf5eef91d68 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:33.781342 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-166e899c-5b3a-4ac9-bccf-2bf5eef91d68 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:33.781829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-166e899c-5b3a-4ac9-bccf-2bf5eef91d68 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:33.782428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-166e899c-5b3a-4ac9-bccf-2bf5eef91d68 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:33.858531 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-166e899c-5b3a-4ac9-bccf-2bf5eef91d68 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a/action" status: 202 len: 0 microversion: 2.1 time: 0.095564 Aug 24 11:29:33.859266 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3905/7447] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:29:33 2022] POST /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:29:33.870167 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1513bdd5-1b44-4690-a6ec-b9c040e2d28b tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:33.871364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1513bdd5-1b44-4690-a6ec-b9c040e2d28b tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:33.880418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1513bdd5-1b44-4690-a6ec-b9c040e2d28b tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:33.880998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1513bdd5-1b44-4690-a6ec-b9c040e2d28b tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:33.881438 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1513bdd5-1b44-4690-a6ec-b9c040e2d28b tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:33.882121 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1513bdd5-1b44-4690-a6ec-b9c040e2d28b tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:33.882643 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1513bdd5-1b44-4690-a6ec-b9c040e2d28b tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:33.883066 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1513bdd5-1b44-4690-a6ec-b9c040e2d28b tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:34.111079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1513bdd5-1b44-4690-a6ec-b9c040e2d28b tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:34.119438 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1513bdd5-1b44-4690-a6ec-b9c040e2d28b tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a" status: 200 len: 1677 microversion: 2.1 time: 0.254146 Aug 24 11:29:34.120037 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3543/7448] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:33 2022] GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a => generated 1677 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:35.143542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-db60b075-8485-4af4-bade-4a5ff1f1ef78 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:35.144256 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-db60b075-8485-4af4-bade-4a5ff1f1ef78 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:35.151681 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db60b075-8485-4af4-bade-4a5ff1f1ef78 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:35.152440 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db60b075-8485-4af4-bade-4a5ff1f1ef78 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:35.153156 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db60b075-8485-4af4-bade-4a5ff1f1ef78 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:35.154098 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db60b075-8485-4af4-bade-4a5ff1f1ef78 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:35.154567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db60b075-8485-4af4-bade-4a5ff1f1ef78 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:35.155004 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db60b075-8485-4af4-bade-4a5ff1f1ef78 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:35.309835 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-db60b075-8485-4af4-bade-4a5ff1f1ef78 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:35.317240 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-db60b075-8485-4af4-bade-4a5ff1f1ef78 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a" status: 200 len: 1677 microversion: 2.1 time: 0.178915 Aug 24 11:29:35.317847 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3906/7449] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:35 2022] GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:36.340677 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bbb493cd-79b9-439a-b247-b86cd712526e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:36.341292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bbb493cd-79b9-439a-b247-b86cd712526e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:36.349476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbb493cd-79b9-439a-b247-b86cd712526e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:36.349902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbb493cd-79b9-439a-b247-b86cd712526e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:36.350333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbb493cd-79b9-439a-b247-b86cd712526e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:36.351030 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbb493cd-79b9-439a-b247-b86cd712526e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:36.351479 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbb493cd-79b9-439a-b247-b86cd712526e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:36.351900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbb493cd-79b9-439a-b247-b86cd712526e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:36.489916 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bbb493cd-79b9-439a-b247-b86cd712526e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:36.501796 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bbb493cd-79b9-439a-b247-b86cd712526e tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a" status: 200 len: 1680 microversion: 2.1 time: 0.165261 Aug 24 11:29:36.502784 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3544/7450] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:36 2022] GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:36.604115 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-104753bc-56a1-4a1a-9734-d0dbef5171f4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:36.606324 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-104753bc-56a1-4a1a-9734-d0dbef5171f4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:36.613849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-104753bc-56a1-4a1a-9734-d0dbef5171f4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:36.614364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-104753bc-56a1-4a1a-9734-d0dbef5171f4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:36.614817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-104753bc-56a1-4a1a-9734-d0dbef5171f4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:36.615533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-104753bc-56a1-4a1a-9734-d0dbef5171f4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:36.616001 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-104753bc-56a1-4a1a-9734-d0dbef5171f4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:36.616443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-104753bc-56a1-4a1a-9734-d0dbef5171f4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:36.659706 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-104753bc-56a1-4a1a-9734-d0dbef5171f4 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "POST /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a/action" status: 200 len: 38237 microversion: 2.1 time: 0.059620 Aug 24 11:29:36.660385 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3907/7451] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:29:36 2022] POST /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a/action => generated 38237 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:29:37.666534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-79b3547d-1a32-4f93-9276-e03c2b763fa6 req-c1448ddc-6adc-484d-a1b8-44138ce4a223 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "888fa81b-390a-472d-a305-4af89437b94a", "tag": "10a0719a-9ab8-43d7-9539-46dc1683e6f5"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:37.671374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-950f3318-4d71-4936-a181-3f3dddcacf28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:37.671953 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-950f3318-4d71-4936-a181-3f3dddcacf28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:37.679559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-950f3318-4d71-4936-a181-3f3dddcacf28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:37.680050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-950f3318-4d71-4936-a181-3f3dddcacf28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:37.680486 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-950f3318-4d71-4936-a181-3f3dddcacf28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:37.681420 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-950f3318-4d71-4936-a181-3f3dddcacf28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:37.681850 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-950f3318-4d71-4936-a181-3f3dddcacf28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:37.682480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-950f3318-4d71-4936-a181-3f3dddcacf28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:37.688052 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-79b3547d-1a32-4f93-9276-e03c2b763fa6 req-c1448ddc-6adc-484d-a1b8-44138ce4a223 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:37.688641 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-79b3547d-1a32-4f93-9276-e03c2b763fa6 req-c1448ddc-6adc-484d-a1b8-44138ce4a223 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:37.689163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-79b3547d-1a32-4f93-9276-e03c2b763fa6 req-c1448ddc-6adc-484d-a1b8-44138ce4a223 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:37.703624 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-79b3547d-1a32-4f93-9276-e03c2b763fa6 req-c1448ddc-6adc-484d-a1b8-44138ce4a223 service nova] Creating event network-changed:10a0719a-9ab8-43d7-9539-46dc1683e6f5 for instance 888fa81b-390a-472d-a305-4af89437b94a on n-h2-849328-3 Aug 24 11:29:37.708759 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-79b3547d-1a32-4f93-9276-e03c2b763fa6 req-c1448ddc-6adc-484d-a1b8-44138ce4a223 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047145 Aug 24 11:29:37.709499 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3908/7452] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:37.710052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-950f3318-4d71-4936-a181-3f3dddcacf28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:29:37.797183 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-950f3318-4d71-4936-a181-3f3dddcacf28 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "DELETE /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a" status: 204 len: 0 microversion: 2.1 time: 0.137961 Aug 24 11:29:37.798113 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3545/7453] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:29:37 2022] DELETE /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:29:37.808773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aa69334a-24bd-4c4c-afdb-19f164332abc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:37.809849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aa69334a-24bd-4c4c-afdb-19f164332abc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:37.817276 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa69334a-24bd-4c4c-afdb-19f164332abc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:37.817786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa69334a-24bd-4c4c-afdb-19f164332abc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:37.818445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa69334a-24bd-4c4c-afdb-19f164332abc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:37.819444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa69334a-24bd-4c4c-afdb-19f164332abc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:37.819930 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa69334a-24bd-4c4c-afdb-19f164332abc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:37.820372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa69334a-24bd-4c4c-afdb-19f164332abc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:37.973484 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aa69334a-24bd-4c4c-afdb-19f164332abc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:37.982848 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aa69334a-24bd-4c4c-afdb-19f164332abc tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a" status: 200 len: 1686 microversion: 2.1 time: 0.179476 Aug 24 11:29:37.983433 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3909/7454] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:37 2022] GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a => generated 1686 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:39.006993 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-80d64153-db44-4fe8-8c55-266725c400b0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:39.007600 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-80d64153-db44-4fe8-8c55-266725c400b0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:39.015437 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80d64153-db44-4fe8-8c55-266725c400b0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:39.015935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80d64153-db44-4fe8-8c55-266725c400b0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:39.016404 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80d64153-db44-4fe8-8c55-266725c400b0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:39.017249 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80d64153-db44-4fe8-8c55-266725c400b0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:39.017737 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80d64153-db44-4fe8-8c55-266725c400b0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:39.018168 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80d64153-db44-4fe8-8c55-266725c400b0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:39.172055 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-80d64153-db44-4fe8-8c55-266725c400b0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:39.180642 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-80d64153-db44-4fe8-8c55-266725c400b0 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a" status: 200 len: 1686 microversion: 2.1 time: 0.178206 Aug 24 11:29:39.181276 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3546/7455] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:39 2022] GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a => generated 1686 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:40.202700 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c4260c45-b045-4a35-a332-b3a94abe0914 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:40.203332 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c4260c45-b045-4a35-a332-b3a94abe0914 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:40.211860 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4260c45-b045-4a35-a332-b3a94abe0914 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:40.212368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4260c45-b045-4a35-a332-b3a94abe0914 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:40.212819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4260c45-b045-4a35-a332-b3a94abe0914 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:40.213595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4260c45-b045-4a35-a332-b3a94abe0914 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:40.214063 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4260c45-b045-4a35-a332-b3a94abe0914 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:40.214500 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4260c45-b045-4a35-a332-b3a94abe0914 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:40.317864 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c4260c45-b045-4a35-a332-b3a94abe0914 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7f1eb7298e4cad86ad953eac53c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36574fcb42ea44ca970b5bfa9697af8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:40.328079 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c4260c45-b045-4a35-a332-b3a94abe0914 tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a" status: 200 len: 1500 microversion: 2.1 time: 0.129251 Aug 24 11:29:40.328706 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3910/7456] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:40 2022] GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a => generated 1500 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:40.371614 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3527b53e-695d-4122-97a9-a303b137d55b req-fc283a44-554e-4a15-8be7-7809bea3253e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "888fa81b-390a-472d-a305-4af89437b94a", "name": "network-vif-deleted", "tag": "10a0719a-9ab8-43d7-9539-46dc1683e6f5"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:40.385671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3527b53e-695d-4122-97a9-a303b137d55b req-fc283a44-554e-4a15-8be7-7809bea3253e service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:40.386466 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3527b53e-695d-4122-97a9-a303b137d55b req-fc283a44-554e-4a15-8be7-7809bea3253e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:40.386860 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3527b53e-695d-4122-97a9-a303b137d55b req-fc283a44-554e-4a15-8be7-7809bea3253e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:40.400301 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3527b53e-695d-4122-97a9-a303b137d55b req-fc283a44-554e-4a15-8be7-7809bea3253e service nova] Creating event network-vif-deleted:10a0719a-9ab8-43d7-9539-46dc1683e6f5 for instance 888fa81b-390a-472d-a305-4af89437b94a on n-h2-849328-3 Aug 24 11:29:40.406118 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3527b53e-695d-4122-97a9-a303b137d55b req-fc283a44-554e-4a15-8be7-7809bea3253e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038592 Aug 24 11:29:40.406744 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3547/7457] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:41.352612 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-68f6774b-4cb4-45bf-9d42-8e976e1486ce tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:41.353246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-68f6774b-4cb4-45bf-9d42-8e976e1486ce tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] [instance: 888fa81b-390a-472d-a305-4af89437b94a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:41.360909 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68f6774b-4cb4-45bf-9d42-8e976e1486ce tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:41.361459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68f6774b-4cb4-45bf-9d42-8e976e1486ce tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:41.361916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68f6774b-4cb4-45bf-9d42-8e976e1486ce tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:41.362627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68f6774b-4cb4-45bf-9d42-8e976e1486ce tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:41.363095 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68f6774b-4cb4-45bf-9d42-8e976e1486ce tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:41.363536 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68f6774b-4cb4-45bf-9d42-8e976e1486ce tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:41.378231 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-68f6774b-4cb4-45bf-9d42-8e976e1486ce tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] HTTP exception thrown: Instance 888fa81b-390a-472d-a305-4af89437b94a could not be found. Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-68f6774b-4cb4-45bf-9d42-8e976e1486ce tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Request method failure captured: Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a HTTP/1.1 Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBgncfDWps3oSnkGWh604hOpiheCjj8_0BYAjCgEtswuOyN76lOlAH_8p8Uj7QuLZqZrHJqGhmKvQcmRgQjYyq3xw0zzP1xAec9u3lQcKsftkv7yoMv-UqmOKrubG7PpaZzLpooDFEsUT2iVLZk3IHgmNHmgtRKVhQiSyHbimZM2IotU Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 36574fcb42ea44ca970b5bfa9697af8c Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1665657358 Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/36574fcb42ea44ca970b5bfa9697af8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_36574fcb42ea44ca970b5bfa9697af8c", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/36574fcb42ea44ca970b5bfa9697af8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/36574fcb42ea44ca970b5bfa9697af8c"}]}] Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1665657358 Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 36574fcb42ea44ca970b5bfa9697af8c Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1665657358 Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestNetworkAdvancedServerOps-1665657358-project Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: ab7f1eb7298e4cad86ad953eac53c9c3 Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1665657358-project Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance 888fa81b-390a-472d-a305-4af89437b94a could not be found. Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': '888fa81b-390a-472d-a305-4af89437b94a'} Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 888fa81b-390a-472d-a305-4af89437b94a could not be found. Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 888fa81b-390a-472d-a305-4af89437b94a could not be found. Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:29:41.379882 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:29:41.384964 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:29:41.384964 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:29:41.384964 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:29:41.384964 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:29:41.384964 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:29:41.384964 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:29:41.384964 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 888fa81b-390a-472d-a305-4af89437b94a could not be found. Aug 24 11:29:41.384964 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:29:41.384964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-68f6774b-4cb4-45bf-9d42-8e976e1486ce tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Returning 404 to user: Instance 888fa81b-390a-472d-a305-4af89437b94a could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:29:41.384964 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-68f6774b-4cb4-45bf-9d42-8e976e1486ce tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a" status: 404 len: 111 microversion: 2.1 time: 0.034198 Aug 24 11:29:41.384964 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3911/7458] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:41 2022] GET /compute/v2.1/servers/888fa81b-390a-472d-a305-4af89437b94a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:29:43.878219 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:29:43.878219 n-d-849328-3 devstack@n-api.service[122432]: Wed Aug 24 11:29:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:29:44.473284 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e5ed761e-5404-41ec-ad1b-9767780646bf tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] Calling method '.version_select at 0x7f4647e9b8b0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:44.500185 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e5ed761e-5404-41ec-ad1b-9767780646bf tempest-TestNetworkAdvancedServerOps-1665657358 tempest-TestNetworkAdvancedServerOps-1665657358-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-326313020" status: 202 len: 0 microversion: 2.1 time: 0.032289 Aug 24 11:29:44.501078 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3548/7459] 10.222.0.85 () {58 vars in 1281 bytes} [Wed Aug 24 11:29:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-326313020 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:29:56.323142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=18 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:56.324321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:56.564460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e2090c5e-05d3-4018-8fa3-f0de778bf37f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Action: 'create', calling method: .version_select at 0x7f464405aa60>, body: {"keypair": {"name": "tempest-TestShelveInstance-633364026", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp30qCSCeOsxZzaJwck0R7+jtMDMbyM9RmbbtEP8fAb3JNvTVs8gOCr/4Pwuf20ZIGnTFqAKCbzizrwIcUcJoFURWs1UaSsRAKgJtOOuD0zfigj79/mJHkN8rjbkULwIw=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:56.580980 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-e2090c5e-05d3-4018-8fa3-f0de778bf37f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Getting quotas for project 5a6a7095e5e94f7e9db48308288c4583. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:29:56.592299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-e2090c5e-05d3-4018-8fa3-f0de778bf37f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Getting quotas for user d38342bcd5c4427ca84becd8060b454a and project 5a6a7095e5e94f7e9db48308288c4583. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:29:56.620576 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e2090c5e-05d3-4018-8fa3-f0de778bf37f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.304071 Aug 24 11:29:56.625729 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3912/7460] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 11:29:56 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:57.634287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e6f84ca8-922f-4d49-b1d9-33c8eb33ad65 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1470943778", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-633364026", "security_groups": [{"name": "tempest-secgroup-smoke-375441611"}], "networks": [{"uuid": "d5aa48c5-2ea9-4042-9a43-cc933bde32ea"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:57.647652 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:57.648596 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:57.882452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-e6f84ca8-922f-4d49-b1d9-33c8eb33ad65 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] validate_networks() for [('d5aa48c5-2ea9-4042-9a43-cc933bde32ea', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:29:58.282443 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e6f84ca8-922f-4d49-b1d9-33c8eb33ad65 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:29:58.282838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e6f84ca8-922f-4d49-b1d9-33c8eb33ad65 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:29:58.283306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e6f84ca8-922f-4d49-b1d9-33c8eb33ad65 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:29:58.283708 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e6f84ca8-922f-4d49-b1d9-33c8eb33ad65 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:29:58.284114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e6f84ca8-922f-4d49-b1d9-33c8eb33ad65 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:29:58.293422 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6f84ca8-922f-4d49-b1d9-33c8eb33ad65 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:58.293905 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6f84ca8-922f-4d49-b1d9-33c8eb33ad65 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:58.294337 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6f84ca8-922f-4d49-b1d9-33c8eb33ad65 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:58.295052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6f84ca8-922f-4d49-b1d9-33c8eb33ad65 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:58.295500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6f84ca8-922f-4d49-b1d9-33c8eb33ad65 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:58.295919 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6f84ca8-922f-4d49-b1d9-33c8eb33ad65 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:58.313516 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-e6f84ca8-922f-4d49-b1d9-33c8eb33ad65 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Getting quotas for project 5a6a7095e5e94f7e9db48308288c4583. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:29:58.320006 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-e6f84ca8-922f-4d49-b1d9-33c8eb33ad65 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Getting quotas for user d38342bcd5c4427ca84becd8060b454a and project 5a6a7095e5e94f7e9db48308288c4583. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:29:58.334572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e6f84ca8-922f-4d49-b1d9-33c8eb33ad65 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:29:58.337292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e6f84ca8-922f-4d49-b1d9-33c8eb33ad65 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:29:58.389484 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e6f84ca8-922f-4d49-b1d9-33c8eb33ad65 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.759324 Aug 24 11:29:58.390569 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3549/7461] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 11:29:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:29:58.401471 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cefce90b-5f07-4e76-90cc-497461de6b97 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:58.402246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cefce90b-5f07-4e76-90cc-497461de6b97 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:58.600445 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cefce90b-5f07-4e76-90cc-497461de6b97 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:58.607833 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cefce90b-5f07-4e76-90cc-497461de6b97 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1246 microversion: 2.1 time: 0.210327 Aug 24 11:29:58.608430 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3913/7462] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:58 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1246 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:59.636200 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-50bd83c9-e886-4a66-8590-44954595a268 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:59.637457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-50bd83c9-e886-4a66-8590-44954595a268 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:59.646010 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50bd83c9-e886-4a66-8590-44954595a268 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:59.646808 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50bd83c9-e886-4a66-8590-44954595a268 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:59.647434 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50bd83c9-e886-4a66-8590-44954595a268 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:59.648158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50bd83c9-e886-4a66-8590-44954595a268 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:59.648620 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50bd83c9-e886-4a66-8590-44954595a268 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:59.649053 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50bd83c9-e886-4a66-8590-44954595a268 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:59.729628 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-50bd83c9-e886-4a66-8590-44954595a268 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:59.737874 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-50bd83c9-e886-4a66-8590-44954595a268 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1306 microversion: 2.1 time: 0.113264 Aug 24 11:29:59.738810 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3550/7463] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:59 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1306 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:30:00.760339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6b613dd8-7fb5-44db-8e30-8ae31663b754 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:00.761106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6b613dd8-7fb5-44db-8e30-8ae31663b754 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:00.769712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b613dd8-7fb5-44db-8e30-8ae31663b754 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:00.770244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b613dd8-7fb5-44db-8e30-8ae31663b754 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:00.770698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b613dd8-7fb5-44db-8e30-8ae31663b754 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:00.771488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b613dd8-7fb5-44db-8e30-8ae31663b754 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:00.772009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b613dd8-7fb5-44db-8e30-8ae31663b754 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:00.772434 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b613dd8-7fb5-44db-8e30-8ae31663b754 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:00.906199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6b613dd8-7fb5-44db-8e30-8ae31663b754 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:00.914359 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6b613dd8-7fb5-44db-8e30-8ae31663b754 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1371 microversion: 2.1 time: 0.158030 Aug 24 11:30:00.915065 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3914/7464] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:00 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:01.092970 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-59f372f6-e1d6-4a26-8904-cb42837f21f2 req-601954ed-6083-4646-8fe7-ca97d650bcd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2", "tag": "1e3aa78f-b6e2-4c58-8886-39f05f879f01"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:01.105776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-59f372f6-e1d6-4a26-8904-cb42837f21f2 req-601954ed-6083-4646-8fe7-ca97d650bcd6 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:01.106376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-59f372f6-e1d6-4a26-8904-cb42837f21f2 req-601954ed-6083-4646-8fe7-ca97d650bcd6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:01.107031 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-59f372f6-e1d6-4a26-8904-cb42837f21f2 req-601954ed-6083-4646-8fe7-ca97d650bcd6 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:01.118830 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-59f372f6-e1d6-4a26-8904-cb42837f21f2 req-601954ed-6083-4646-8fe7-ca97d650bcd6 service nova] Creating event network-changed:1e3aa78f-b6e2-4c58-8886-39f05f879f01 for instance c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 on n-h1-849328-3 Aug 24 11:30:01.124013 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-59f372f6-e1d6-4a26-8904-cb42837f21f2 req-601954ed-6083-4646-8fe7-ca97d650bcd6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034904 Aug 24 11:30:01.125505 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3551/7465] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:30:01.941106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9b1620f9-4e82-4703-9087-cc193dc5a424 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:01.941804 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9b1620f9-4e82-4703-9087-cc193dc5a424 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:01.952058 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b1620f9-4e82-4703-9087-cc193dc5a424 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:01.952898 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b1620f9-4e82-4703-9087-cc193dc5a424 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:01.953696 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b1620f9-4e82-4703-9087-cc193dc5a424 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:01.954879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b1620f9-4e82-4703-9087-cc193dc5a424 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:01.955670 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b1620f9-4e82-4703-9087-cc193dc5a424 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:01.956455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b1620f9-4e82-4703-9087-cc193dc5a424 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:02.102617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9b1620f9-4e82-4703-9087-cc193dc5a424 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:02.110899 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9b1620f9-4e82-4703-9087-cc193dc5a424 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1371 microversion: 2.1 time: 0.177491 Aug 24 11:30:02.111503 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3915/7466] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:01 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:03.135975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6d8fc401-3af9-47ed-8b20-330deca2394a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:03.136638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6d8fc401-3af9-47ed-8b20-330deca2394a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:03.144298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d8fc401-3af9-47ed-8b20-330deca2394a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:03.144820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d8fc401-3af9-47ed-8b20-330deca2394a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:03.145345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d8fc401-3af9-47ed-8b20-330deca2394a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:03.146208 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d8fc401-3af9-47ed-8b20-330deca2394a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:03.146657 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d8fc401-3af9-47ed-8b20-330deca2394a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:03.147083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d8fc401-3af9-47ed-8b20-330deca2394a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:03.295272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6d8fc401-3af9-47ed-8b20-330deca2394a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:03.303536 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6d8fc401-3af9-47ed-8b20-330deca2394a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1371 microversion: 2.1 time: 0.174214 Aug 24 11:30:03.304125 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3552/7467] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:03 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:04.328513 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e2280c18-15a5-4ba6-839b-3e73c2730ca7 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:04.329391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e2280c18-15a5-4ba6-839b-3e73c2730ca7 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:04.341349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2280c18-15a5-4ba6-839b-3e73c2730ca7 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:04.342237 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2280c18-15a5-4ba6-839b-3e73c2730ca7 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:04.343064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2280c18-15a5-4ba6-839b-3e73c2730ca7 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:04.344239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2280c18-15a5-4ba6-839b-3e73c2730ca7 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:04.345030 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2280c18-15a5-4ba6-839b-3e73c2730ca7 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:04.345842 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2280c18-15a5-4ba6-839b-3e73c2730ca7 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:04.478903 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e2280c18-15a5-4ba6-839b-3e73c2730ca7 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:04.490918 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e2280c18-15a5-4ba6-839b-3e73c2730ca7 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1371 microversion: 2.1 time: 0.167679 Aug 24 11:30:04.490918 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3916/7468] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:04 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:05.515248 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0ad7841d-f691-4574-8ba8-cd8c5cb70a1a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:05.516266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0ad7841d-f691-4574-8ba8-cd8c5cb70a1a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:05.525564 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ad7841d-f691-4574-8ba8-cd8c5cb70a1a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:05.526045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ad7841d-f691-4574-8ba8-cd8c5cb70a1a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:05.526489 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ad7841d-f691-4574-8ba8-cd8c5cb70a1a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:05.527173 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ad7841d-f691-4574-8ba8-cd8c5cb70a1a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:05.527653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ad7841d-f691-4574-8ba8-cd8c5cb70a1a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:05.528079 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ad7841d-f691-4574-8ba8-cd8c5cb70a1a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:05.668447 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0ad7841d-f691-4574-8ba8-cd8c5cb70a1a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:05.677191 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0ad7841d-f691-4574-8ba8-cd8c5cb70a1a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1371 microversion: 2.1 time: 0.168686 Aug 24 11:30:05.677808 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3553/7469] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:05 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:06.660476 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-2569d4f5-4e28-492f-bc9c-8bad2d8d0c72 req-e8439b85-515f-4ce5-83ae-ba2019d456a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2", "name": "network-vif-plugged", "status": "completed", "tag": "1e3aa78f-b6e2-4c58-8886-39f05f879f01"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:06.671583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2569d4f5-4e28-492f-bc9c-8bad2d8d0c72 req-e8439b85-515f-4ce5-83ae-ba2019d456a4 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:06.672082 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2569d4f5-4e28-492f-bc9c-8bad2d8d0c72 req-e8439b85-515f-4ce5-83ae-ba2019d456a4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:06.672534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2569d4f5-4e28-492f-bc9c-8bad2d8d0c72 req-e8439b85-515f-4ce5-83ae-ba2019d456a4 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:06.684466 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-2569d4f5-4e28-492f-bc9c-8bad2d8d0c72 req-e8439b85-515f-4ce5-83ae-ba2019d456a4 service nova] Creating event network-vif-plugged:1e3aa78f-b6e2-4c58-8886-39f05f879f01 for instance c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 on n-h1-849328-3 Aug 24 11:30:06.689651 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-2569d4f5-4e28-492f-bc9c-8bad2d8d0c72 req-e8439b85-515f-4ce5-83ae-ba2019d456a4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033018 Aug 24 11:30:06.690288 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3917/7470] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:30:06.698929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3091de74-e77f-4c51-8a30-9a8388628d0b tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:06.699540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3091de74-e77f-4c51-8a30-9a8388628d0b tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:06.706578 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3091de74-e77f-4c51-8a30-9a8388628d0b tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:06.707061 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3091de74-e77f-4c51-8a30-9a8388628d0b tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:06.707493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3091de74-e77f-4c51-8a30-9a8388628d0b tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:06.708193 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3091de74-e77f-4c51-8a30-9a8388628d0b tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:06.708643 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3091de74-e77f-4c51-8a30-9a8388628d0b tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:06.709059 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3091de74-e77f-4c51-8a30-9a8388628d0b tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:06.899819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3091de74-e77f-4c51-8a30-9a8388628d0b tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:06.909316 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3091de74-e77f-4c51-8a30-9a8388628d0b tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1371 microversion: 2.1 time: 0.214421 Aug 24 11:30:06.909914 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3554/7471] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:06 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:07.930959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d0e16044-485a-4357-a683-56d26e3e9666 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:07.931684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d0e16044-485a-4357-a683-56d26e3e9666 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:07.939054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0e16044-485a-4357-a683-56d26e3e9666 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:07.939564 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0e16044-485a-4357-a683-56d26e3e9666 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:07.940003 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0e16044-485a-4357-a683-56d26e3e9666 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:07.940695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0e16044-485a-4357-a683-56d26e3e9666 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:07.941180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0e16044-485a-4357-a683-56d26e3e9666 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:07.941617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0e16044-485a-4357-a683-56d26e3e9666 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:08.092298 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d0e16044-485a-4357-a683-56d26e3e9666 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:08.100320 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d0e16044-485a-4357-a683-56d26e3e9666 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1371 microversion: 2.1 time: 0.173836 Aug 24 11:30:08.100904 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3918/7472] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:07 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:09.126141 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cb4d7496-4bda-4999-aa82-77e9302ce8f3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:09.127112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cb4d7496-4bda-4999-aa82-77e9302ce8f3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:09.131530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:30:09.132608 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:30:09.143492 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb4d7496-4bda-4999-aa82-77e9302ce8f3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:09.144283 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb4d7496-4bda-4999-aa82-77e9302ce8f3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:09.145004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb4d7496-4bda-4999-aa82-77e9302ce8f3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:09.146178 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb4d7496-4bda-4999-aa82-77e9302ce8f3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:09.146920 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb4d7496-4bda-4999-aa82-77e9302ce8f3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:09.147618 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb4d7496-4bda-4999-aa82-77e9302ce8f3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:09.290277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cb4d7496-4bda-4999-aa82-77e9302ce8f3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:09.298664 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cb4d7496-4bda-4999-aa82-77e9302ce8f3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1555 microversion: 2.1 time: 0.179441 Aug 24 11:30:09.299245 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3555/7473] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:09 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1555 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:09.319013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-efcfb04e-2782-45bb-b63f-9dc6f0a47983 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:09.319672 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-efcfb04e-2782-45bb-b63f-9dc6f0a47983 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:09.321738 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:30:09.328119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efcfb04e-2782-45bb-b63f-9dc6f0a47983 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:09.328623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efcfb04e-2782-45bb-b63f-9dc6f0a47983 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:09.329067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efcfb04e-2782-45bb-b63f-9dc6f0a47983 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:09.329803 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efcfb04e-2782-45bb-b63f-9dc6f0a47983 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:09.330267 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efcfb04e-2782-45bb-b63f-9dc6f0a47983 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:09.330702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efcfb04e-2782-45bb-b63f-9dc6f0a47983 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:09.466440 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-efcfb04e-2782-45bb-b63f-9dc6f0a47983 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:09.478401 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-efcfb04e-2782-45bb-b63f-9dc6f0a47983 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1555 microversion: 2.1 time: 0.163356 Aug 24 11:30:09.479009 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3919/7474] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:09 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:11.513266 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-2c46b454-d10b-4930-8070-c30acd7efb4a req-fda4e0a7-40f5-4558-8366-91721450ead1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2", "tag": "1e3aa78f-b6e2-4c58-8886-39f05f879f01"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:11.523689 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2c46b454-d10b-4930-8070-c30acd7efb4a req-fda4e0a7-40f5-4558-8366-91721450ead1 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:11.524221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2c46b454-d10b-4930-8070-c30acd7efb4a req-fda4e0a7-40f5-4558-8366-91721450ead1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:11.524658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2c46b454-d10b-4930-8070-c30acd7efb4a req-fda4e0a7-40f5-4558-8366-91721450ead1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:11.539240 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-2c46b454-d10b-4930-8070-c30acd7efb4a req-fda4e0a7-40f5-4558-8366-91721450ead1 service nova] Creating event network-changed:1e3aa78f-b6e2-4c58-8886-39f05f879f01 for instance c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 on n-h1-849328-3 Aug 24 11:30:11.544548 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-2c46b454-d10b-4930-8070-c30acd7efb4a req-fda4e0a7-40f5-4558-8366-91721450ead1 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035353 Aug 24 11:30:11.545170 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3556/7475] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:30:57.419122 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:30:57.419933 n-d-849328-3 devstack@n-api.service[122433]: Wed Aug 24 11:30:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:32:06.491117 n-d-849328-3 devstack@n-api.service[122433]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d2cfb5b7-d0cc-487d-9468-a34ffc98a2cb] AMQP server on 10.222.0.85:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 11:32:06.492087 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:06.492916 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=32 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:06.497540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-baf2ea3e-521c-4b18-a5ae-58f3d1fd205a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:06.498095 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-baf2ea3e-521c-4b18-a5ae-58f3d1fd205a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:06.505299 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-baf2ea3e-521c-4b18-a5ae-58f3d1fd205a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:06.505819 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-baf2ea3e-521c-4b18-a5ae-58f3d1fd205a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:06.506269 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-baf2ea3e-521c-4b18-a5ae-58f3d1fd205a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:06.506976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-baf2ea3e-521c-4b18-a5ae-58f3d1fd205a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:06.507439 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-baf2ea3e-521c-4b18-a5ae-58f3d1fd205a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:06.507865 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-baf2ea3e-521c-4b18-a5ae-58f3d1fd205a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:06.534585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-baf2ea3e-521c-4b18-a5ae-58f3d1fd205a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lazy-loading 'flavor' on Instance uuid c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:32:06.734969 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-baf2ea3e-521c-4b18-a5ae-58f3d1fd205a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "POST /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2/action" status: 202 len: 0 microversion: 2.1 time: 0.245276 Aug 24 11:32:06.735776 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3920/7476] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:32:06 2022] POST /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:32:06.742568 n-d-849328-3 devstack@n-api.service[122432]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41245b8f-4363-4ade-bbd0-55c91ce540ab] AMQP server on 10.222.0.85:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 24 11:32:06.743503 n-d-849328-3 devstack@n-api.service[122432]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e64df5b4-05c3-4b69-9f47-fe01a91d09ba] AMQP server on 10.222.0.85:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 24 11:32:06.744150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:06.744924 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=36 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:06.749676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-560bd880-c852-465d-8c3b-9b2fbee4d09e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:06.750370 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-560bd880-c852-465d-8c3b-9b2fbee4d09e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:06.757802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-560bd880-c852-465d-8c3b-9b2fbee4d09e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:06.758287 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-560bd880-c852-465d-8c3b-9b2fbee4d09e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:06.758718 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-560bd880-c852-465d-8c3b-9b2fbee4d09e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:06.759566 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-560bd880-c852-465d-8c3b-9b2fbee4d09e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:06.760015 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-560bd880-c852-465d-8c3b-9b2fbee4d09e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:06.760442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-560bd880-c852-465d-8c3b-9b2fbee4d09e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:06.905500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-560bd880-c852-465d-8c3b-9b2fbee4d09e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:06.913525 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-560bd880-c852-465d-8c3b-9b2fbee4d09e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1680 microversion: 2.1 time: 0.172944 Aug 24 11:32:06.914086 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3557/7477] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:06 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:07.940024 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-50097ce2-e5ab-46ca-9490-847e2621185a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:07.940974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-50097ce2-e5ab-46ca-9490-847e2621185a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:07.948602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50097ce2-e5ab-46ca-9490-847e2621185a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:07.949099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50097ce2-e5ab-46ca-9490-847e2621185a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:07.949582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50097ce2-e5ab-46ca-9490-847e2621185a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:07.950283 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50097ce2-e5ab-46ca-9490-847e2621185a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:07.950749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50097ce2-e5ab-46ca-9490-847e2621185a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:07.951191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50097ce2-e5ab-46ca-9490-847e2621185a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:07.955549 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] [d2cfb5b7-d0cc-487d-9468-a34ffc98a2cb] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 57780. Aug 24 11:32:08.095758 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-50097ce2-e5ab-46ca-9490-847e2621185a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:08.108524 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-50097ce2-e5ab-46ca-9490-847e2621185a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1680 microversion: 2.1 time: 0.175852 Aug 24 11:32:08.109684 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3921/7478] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:07 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:09.134873 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f8653a7c-54e9-497f-90cd-dd444f3cc5d4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:09.135706 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f8653a7c-54e9-497f-90cd-dd444f3cc5d4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:09.148520 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8653a7c-54e9-497f-90cd-dd444f3cc5d4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:09.149249 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8653a7c-54e9-497f-90cd-dd444f3cc5d4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:09.149818 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8653a7c-54e9-497f-90cd-dd444f3cc5d4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:09.150742 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8653a7c-54e9-497f-90cd-dd444f3cc5d4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:09.151350 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8653a7c-54e9-497f-90cd-dd444f3cc5d4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:09.151912 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8653a7c-54e9-497f-90cd-dd444f3cc5d4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:09.160170 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] [e64df5b4-05c3-4b69-9f47-fe01a91d09ba] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 57788. Aug 24 11:32:09.171482 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] [41245b8f-4363-4ade-bbd0-55c91ce540ab] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 57786. Aug 24 11:32:09.302966 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f8653a7c-54e9-497f-90cd-dd444f3cc5d4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:09.315371 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f8653a7c-54e9-497f-90cd-dd444f3cc5d4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1680 microversion: 2.1 time: 0.185483 Aug 24 11:32:09.316186 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3558/7479] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:09 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1680 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:10.340896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7433cc23-9e25-408e-884f-51c4ecc30084 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:10.341970 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7433cc23-9e25-408e-884f-51c4ecc30084 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:10.353213 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7433cc23-9e25-408e-884f-51c4ecc30084 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:10.354067 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7433cc23-9e25-408e-884f-51c4ecc30084 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:10.354764 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7433cc23-9e25-408e-884f-51c4ecc30084 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:10.355906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7433cc23-9e25-408e-884f-51c4ecc30084 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:10.356669 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7433cc23-9e25-408e-884f-51c4ecc30084 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:10.357405 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7433cc23-9e25-408e-884f-51c4ecc30084 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:10.497710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7433cc23-9e25-408e-884f-51c4ecc30084 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:10.506090 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7433cc23-9e25-408e-884f-51c4ecc30084 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1680 microversion: 2.1 time: 0.171615 Aug 24 11:32:10.506684 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3922/7480] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:10 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:11.528410 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-683b718f-a544-42a9-84f4-48b251f718d6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:11.529017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-683b718f-a544-42a9-84f4-48b251f718d6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:11.536435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-683b718f-a544-42a9-84f4-48b251f718d6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:11.536920 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-683b718f-a544-42a9-84f4-48b251f718d6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:11.537382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-683b718f-a544-42a9-84f4-48b251f718d6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:11.538050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-683b718f-a544-42a9-84f4-48b251f718d6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:11.538497 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-683b718f-a544-42a9-84f4-48b251f718d6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:11.538940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-683b718f-a544-42a9-84f4-48b251f718d6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:11.677057 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-683b718f-a544-42a9-84f4-48b251f718d6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:11.685206 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-683b718f-a544-42a9-84f4-48b251f718d6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1680 microversion: 2.1 time: 0.160868 Aug 24 11:32:11.685773 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3559/7481] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:11 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:12.706964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0eb90793-0d2c-422d-9d05-37231e530748 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:12.707670 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0eb90793-0d2c-422d-9d05-37231e530748 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:12.715019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0eb90793-0d2c-422d-9d05-37231e530748 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:12.715521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0eb90793-0d2c-422d-9d05-37231e530748 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:12.715992 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0eb90793-0d2c-422d-9d05-37231e530748 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:12.716683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0eb90793-0d2c-422d-9d05-37231e530748 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:12.717146 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0eb90793-0d2c-422d-9d05-37231e530748 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:12.717624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0eb90793-0d2c-422d-9d05-37231e530748 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:12.852949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0eb90793-0d2c-422d-9d05-37231e530748 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:12.861376 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0eb90793-0d2c-422d-9d05-37231e530748 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1680 microversion: 2.1 time: 0.158517 Aug 24 11:32:12.861971 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3923/7482] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:12 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:13.884401 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e618ce41-bc31-4b5c-bebe-49f7f4b6aad9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:13.884967 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e618ce41-bc31-4b5c-bebe-49f7f4b6aad9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:13.891134 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e618ce41-bc31-4b5c-bebe-49f7f4b6aad9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:13.891615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e618ce41-bc31-4b5c-bebe-49f7f4b6aad9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:13.892045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e618ce41-bc31-4b5c-bebe-49f7f4b6aad9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:13.892727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e618ce41-bc31-4b5c-bebe-49f7f4b6aad9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:13.893175 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e618ce41-bc31-4b5c-bebe-49f7f4b6aad9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:13.893615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e618ce41-bc31-4b5c-bebe-49f7f4b6aad9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:14.029955 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e618ce41-bc31-4b5c-bebe-49f7f4b6aad9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:14.038218 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e618ce41-bc31-4b5c-bebe-49f7f4b6aad9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1680 microversion: 2.1 time: 0.158864 Aug 24 11:32:14.038807 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3560/7483] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:13 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:15.063973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-14a34533-1ef8-4ded-9e33-941abb8b5c51 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:15.064797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-14a34533-1ef8-4ded-9e33-941abb8b5c51 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:15.077689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14a34533-1ef8-4ded-9e33-941abb8b5c51 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:15.078499 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14a34533-1ef8-4ded-9e33-941abb8b5c51 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:15.079272 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14a34533-1ef8-4ded-9e33-941abb8b5c51 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:15.080413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14a34533-1ef8-4ded-9e33-941abb8b5c51 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:15.081193 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14a34533-1ef8-4ded-9e33-941abb8b5c51 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:15.081897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14a34533-1ef8-4ded-9e33-941abb8b5c51 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:15.224132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-14a34533-1ef8-4ded-9e33-941abb8b5c51 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:15.232116 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-14a34533-1ef8-4ded-9e33-941abb8b5c51 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1680 microversion: 2.1 time: 0.174900 Aug 24 11:32:15.232703 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3924/7484] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:15 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:16.253422 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-94ece1df-4a44-4699-80e0-302df4546b8a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:16.254007 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-94ece1df-4a44-4699-80e0-302df4546b8a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:16.261432 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94ece1df-4a44-4699-80e0-302df4546b8a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:16.261922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94ece1df-4a44-4699-80e0-302df4546b8a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:16.262355 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94ece1df-4a44-4699-80e0-302df4546b8a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:16.263050 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94ece1df-4a44-4699-80e0-302df4546b8a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:16.263512 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94ece1df-4a44-4699-80e0-302df4546b8a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:16.263936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94ece1df-4a44-4699-80e0-302df4546b8a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:16.399300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-94ece1df-4a44-4699-80e0-302df4546b8a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:16.407547 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-94ece1df-4a44-4699-80e0-302df4546b8a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1680 microversion: 2.1 time: 0.158102 Aug 24 11:32:16.408073 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3561/7485] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:16 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:17.432762 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-79e6b70c-f569-4e55-b3e4-35eab1219a94 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:17.433923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-79e6b70c-f569-4e55-b3e4-35eab1219a94 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:17.444316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79e6b70c-f569-4e55-b3e4-35eab1219a94 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:17.444814 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79e6b70c-f569-4e55-b3e4-35eab1219a94 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:17.445297 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79e6b70c-f569-4e55-b3e4-35eab1219a94 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:17.445999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79e6b70c-f569-4e55-b3e4-35eab1219a94 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:17.446462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79e6b70c-f569-4e55-b3e4-35eab1219a94 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:17.446877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79e6b70c-f569-4e55-b3e4-35eab1219a94 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:17.581177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-79e6b70c-f569-4e55-b3e4-35eab1219a94 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:17.589871 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-79e6b70c-f569-4e55-b3e4-35eab1219a94 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1701 microversion: 2.1 time: 0.163754 Aug 24 11:32:17.590471 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3925/7486] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:17 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1701 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:18.614834 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b7823da6-40ef-4297-96c1-ccee5bf8734d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:18.615457 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b7823da6-40ef-4297-96c1-ccee5bf8734d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:18.623630 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7823da6-40ef-4297-96c1-ccee5bf8734d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:18.624143 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7823da6-40ef-4297-96c1-ccee5bf8734d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:18.624610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7823da6-40ef-4297-96c1-ccee5bf8734d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:18.625383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7823da6-40ef-4297-96c1-ccee5bf8734d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:18.625860 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7823da6-40ef-4297-96c1-ccee5bf8734d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:18.626336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7823da6-40ef-4297-96c1-ccee5bf8734d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:18.770218 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b7823da6-40ef-4297-96c1-ccee5bf8734d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:18.778464 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b7823da6-40ef-4297-96c1-ccee5bf8734d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1701 microversion: 2.1 time: 0.169741 Aug 24 11:32:18.779005 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3562/7487] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:18 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1701 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:19.803150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c8ff2545-351b-43ab-8704-2ee201819caa tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:19.804000 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c8ff2545-351b-43ab-8704-2ee201819caa tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:19.811553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8ff2545-351b-43ab-8704-2ee201819caa tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:19.812083 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8ff2545-351b-43ab-8704-2ee201819caa tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:19.812585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8ff2545-351b-43ab-8704-2ee201819caa tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:19.813335 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8ff2545-351b-43ab-8704-2ee201819caa tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:19.813813 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8ff2545-351b-43ab-8704-2ee201819caa tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:19.814243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8ff2545-351b-43ab-8704-2ee201819caa tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:19.957492 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c8ff2545-351b-43ab-8704-2ee201819caa tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:19.965850 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c8ff2545-351b-43ab-8704-2ee201819caa tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1696 microversion: 2.1 time: 0.166703 Aug 24 11:32:19.966443 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3926/7488] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:19 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1696 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:20.990110 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-98ecc8fd-9901-454d-9c0b-53f489850450 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:20.990965 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-98ecc8fd-9901-454d-9c0b-53f489850450 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:20.998785 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98ecc8fd-9901-454d-9c0b-53f489850450 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:20.999348 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98ecc8fd-9901-454d-9c0b-53f489850450 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:20.999895 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98ecc8fd-9901-454d-9c0b-53f489850450 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:21.000863 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98ecc8fd-9901-454d-9c0b-53f489850450 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:21.001341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98ecc8fd-9901-454d-9c0b-53f489850450 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:21.003109 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98ecc8fd-9901-454d-9c0b-53f489850450 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:21.159090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-98ecc8fd-9901-454d-9c0b-53f489850450 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:21.168259 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-98ecc8fd-9901-454d-9c0b-53f489850450 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1696 microversion: 2.1 time: 0.183401 Aug 24 11:32:21.183341 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3563/7489] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:20 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1696 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:21.296699 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-35888d47-dd58-4cb6-af9e-31fd6920bf26 req-1be0c2b2-fea4-4ef5-9719-0d4995d1ad84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2", "name": "network-vif-plugged", "status": "completed", "tag": "1e3aa78f-b6e2-4c58-8886-39f05f879f01"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:21.316076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-35888d47-dd58-4cb6-af9e-31fd6920bf26 req-1be0c2b2-fea4-4ef5-9719-0d4995d1ad84 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:21.321475 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-35888d47-dd58-4cb6-af9e-31fd6920bf26 req-1be0c2b2-fea4-4ef5-9719-0d4995d1ad84 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:21.321992 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-35888d47-dd58-4cb6-af9e-31fd6920bf26 req-1be0c2b2-fea4-4ef5-9719-0d4995d1ad84 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:21.334607 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-35888d47-dd58-4cb6-af9e-31fd6920bf26 req-1be0c2b2-fea4-4ef5-9719-0d4995d1ad84 service nova] Creating event network-vif-plugged:1e3aa78f-b6e2-4c58-8886-39f05f879f01 for instance c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 on n-h1-849328-3 Aug 24 11:32:21.340611 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-35888d47-dd58-4cb6-af9e-31fd6920bf26 req-1be0c2b2-fea4-4ef5-9719-0d4995d1ad84 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047651 Aug 24 11:32:21.341864 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3927/7490] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:22.190493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4a67fc28-b6d5-42f6-9f00-0d0af1164c59 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:22.191116 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4a67fc28-b6d5-42f6-9f00-0d0af1164c59 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:22.201815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a67fc28-b6d5-42f6-9f00-0d0af1164c59 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:22.202315 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a67fc28-b6d5-42f6-9f00-0d0af1164c59 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:22.202762 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a67fc28-b6d5-42f6-9f00-0d0af1164c59 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:22.203490 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a67fc28-b6d5-42f6-9f00-0d0af1164c59 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:22.203978 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a67fc28-b6d5-42f6-9f00-0d0af1164c59 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:22.204408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a67fc28-b6d5-42f6-9f00-0d0af1164c59 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:22.350638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4a67fc28-b6d5-42f6-9f00-0d0af1164c59 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:22.359786 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4a67fc28-b6d5-42f6-9f00-0d0af1164c59 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1696 microversion: 2.1 time: 0.173152 Aug 24 11:32:22.360393 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3564/7491] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:22 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1696 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:23.388678 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-11171a52-d65c-4516-ad82-f3d399c2cf4d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:23.389431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-11171a52-d65c-4516-ad82-f3d399c2cf4d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:23.399363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11171a52-d65c-4516-ad82-f3d399c2cf4d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:23.399904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11171a52-d65c-4516-ad82-f3d399c2cf4d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:23.400348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11171a52-d65c-4516-ad82-f3d399c2cf4d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:23.401075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11171a52-d65c-4516-ad82-f3d399c2cf4d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:23.401582 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11171a52-d65c-4516-ad82-f3d399c2cf4d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:23.402027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11171a52-d65c-4516-ad82-f3d399c2cf4d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:23.557462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-11171a52-d65c-4516-ad82-f3d399c2cf4d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:23.565777 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-11171a52-d65c-4516-ad82-f3d399c2cf4d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1696 microversion: 2.1 time: 0.181896 Aug 24 11:32:23.581476 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3928/7492] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:23 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1696 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:24.588806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-89a5e481-b320-4f8e-bc15-877e22621bfa tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:24.590222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-89a5e481-b320-4f8e-bc15-877e22621bfa tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:24.599016 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89a5e481-b320-4f8e-bc15-877e22621bfa tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:24.599525 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89a5e481-b320-4f8e-bc15-877e22621bfa tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:24.600073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89a5e481-b320-4f8e-bc15-877e22621bfa tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:24.600956 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89a5e481-b320-4f8e-bc15-877e22621bfa tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:24.601509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89a5e481-b320-4f8e-bc15-877e22621bfa tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:24.601955 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89a5e481-b320-4f8e-bc15-877e22621bfa tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:24.757212 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-89a5e481-b320-4f8e-bc15-877e22621bfa tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:24.766725 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-89a5e481-b320-4f8e-bc15-877e22621bfa tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1696 microversion: 2.1 time: 0.180543 Aug 24 11:32:24.775467 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3565/7493] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:24 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1696 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:25.787107 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2984fb9b-3bc5-43ae-9329-bf54c30a6cc2 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:25.787661 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2984fb9b-3bc5-43ae-9329-bf54c30a6cc2 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:25.797277 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2984fb9b-3bc5-43ae-9329-bf54c30a6cc2 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:25.798338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2984fb9b-3bc5-43ae-9329-bf54c30a6cc2 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:25.798338 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2984fb9b-3bc5-43ae-9329-bf54c30a6cc2 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:25.799062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2984fb9b-3bc5-43ae-9329-bf54c30a6cc2 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:25.799617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2984fb9b-3bc5-43ae-9329-bf54c30a6cc2 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:25.801101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2984fb9b-3bc5-43ae-9329-bf54c30a6cc2 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:25.959420 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2984fb9b-3bc5-43ae-9329-bf54c30a6cc2 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:25.969570 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2984fb9b-3bc5-43ae-9329-bf54c30a6cc2 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1696 microversion: 2.1 time: 0.186547 Aug 24 11:32:25.970620 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3929/7494] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:25 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1696 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:26.990999 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-014e81a4-a753-4608-b0d9-ced3792d6129 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:26.993190 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-014e81a4-a753-4608-b0d9-ced3792d6129 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:27.002497 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-014e81a4-a753-4608-b0d9-ced3792d6129 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:27.003327 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-014e81a4-a753-4608-b0d9-ced3792d6129 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:27.004020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-014e81a4-a753-4608-b0d9-ced3792d6129 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:27.005049 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-014e81a4-a753-4608-b0d9-ced3792d6129 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:27.005635 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-014e81a4-a753-4608-b0d9-ced3792d6129 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:27.006062 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-014e81a4-a753-4608-b0d9-ced3792d6129 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:27.181176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-014e81a4-a753-4608-b0d9-ced3792d6129 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:27.193346 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-014e81a4-a753-4608-b0d9-ced3792d6129 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1696 microversion: 2.1 time: 0.206215 Aug 24 11:32:27.194246 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3566/7495] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:26 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1696 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:28.214444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3a170dc6-bbf5-4afa-82df-056b4474b1b9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:28.215168 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3a170dc6-bbf5-4afa-82df-056b4474b1b9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:28.222973 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a170dc6-bbf5-4afa-82df-056b4474b1b9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:28.223773 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a170dc6-bbf5-4afa-82df-056b4474b1b9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:28.224347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a170dc6-bbf5-4afa-82df-056b4474b1b9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:28.225385 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a170dc6-bbf5-4afa-82df-056b4474b1b9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:28.225929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a170dc6-bbf5-4afa-82df-056b4474b1b9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:28.226384 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a170dc6-bbf5-4afa-82df-056b4474b1b9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:28.383340 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3a170dc6-bbf5-4afa-82df-056b4474b1b9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:28.391681 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3a170dc6-bbf5-4afa-82df-056b4474b1b9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1696 microversion: 2.1 time: 0.181114 Aug 24 11:32:28.392283 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3930/7496] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:28 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1696 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:29.413694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-969991cb-2576-4e65-bdff-9ce860093399 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:29.414344 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-969991cb-2576-4e65-bdff-9ce860093399 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:29.422362 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-969991cb-2576-4e65-bdff-9ce860093399 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:29.422844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-969991cb-2576-4e65-bdff-9ce860093399 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:29.423271 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-969991cb-2576-4e65-bdff-9ce860093399 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:29.423965 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-969991cb-2576-4e65-bdff-9ce860093399 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:29.424418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-969991cb-2576-4e65-bdff-9ce860093399 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:29.424843 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-969991cb-2576-4e65-bdff-9ce860093399 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:29.643235 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-969991cb-2576-4e65-bdff-9ce860093399 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:29.651292 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-969991cb-2576-4e65-bdff-9ce860093399 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1678 microversion: 2.1 time: 0.241667 Aug 24 11:32:29.651972 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3567/7497] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:29 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1678 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:30.677691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5c6ea596-c706-403c-9aff-b257ef76ddad tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:30.678443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5c6ea596-c706-403c-9aff-b257ef76ddad tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:30.685808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c6ea596-c706-403c-9aff-b257ef76ddad tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:30.686307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c6ea596-c706-403c-9aff-b257ef76ddad tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:30.686752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c6ea596-c706-403c-9aff-b257ef76ddad tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:30.687450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c6ea596-c706-403c-9aff-b257ef76ddad tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:30.687912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c6ea596-c706-403c-9aff-b257ef76ddad tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:30.688345 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c6ea596-c706-403c-9aff-b257ef76ddad tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:30.825991 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5c6ea596-c706-403c-9aff-b257ef76ddad tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:30.834361 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5c6ea596-c706-403c-9aff-b257ef76ddad tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1678 microversion: 2.1 time: 0.163256 Aug 24 11:32:30.834945 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3931/7498] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:30 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:31.859578 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f137709e-8ef6-464c-8d84-1756338555d4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:31.860365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f137709e-8ef6-464c-8d84-1756338555d4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:31.870954 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f137709e-8ef6-464c-8d84-1756338555d4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:31.871643 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f137709e-8ef6-464c-8d84-1756338555d4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:31.872263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f137709e-8ef6-464c-8d84-1756338555d4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:31.873281 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f137709e-8ef6-464c-8d84-1756338555d4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:31.873938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f137709e-8ef6-464c-8d84-1756338555d4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:31.874559 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f137709e-8ef6-464c-8d84-1756338555d4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:32.023886 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f137709e-8ef6-464c-8d84-1756338555d4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:32.046064 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f137709e-8ef6-464c-8d84-1756338555d4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1621 microversion: 2.1 time: 0.192135 Aug 24 11:32:32.046965 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3568/7499] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:31 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1621 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:32.069630 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4d378446-42e8-4429-8b62-228d0317a778 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:32.070265 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4d378446-42e8-4429-8b62-228d0317a778 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:32.078015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d378446-42e8-4429-8b62-228d0317a778 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:32.078517 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d378446-42e8-4429-8b62-228d0317a778 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:32.078964 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d378446-42e8-4429-8b62-228d0317a778 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:32.079676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d378446-42e8-4429-8b62-228d0317a778 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:32.080141 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d378446-42e8-4429-8b62-228d0317a778 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:32.080578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d378446-42e8-4429-8b62-228d0317a778 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:32.177249 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4d378446-42e8-4429-8b62-228d0317a778 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122433) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 11:32:32.544051 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4d378446-42e8-4429-8b62-228d0317a778 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "POST /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2/action" status: 202 len: 0 microversion: 2.1 time: 0.478491 Aug 24 11:32:32.544680 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3932/7500] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:32:32 2022] POST /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:32:32.553063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e972fbd2-1ab0-4ba5-860f-31c264e07b3a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:32.553720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e972fbd2-1ab0-4ba5-860f-31c264e07b3a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:32.559989 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e972fbd2-1ab0-4ba5-860f-31c264e07b3a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:32.560473 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e972fbd2-1ab0-4ba5-860f-31c264e07b3a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:32.560910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e972fbd2-1ab0-4ba5-860f-31c264e07b3a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:32.561637 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e972fbd2-1ab0-4ba5-860f-31c264e07b3a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:32.562088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e972fbd2-1ab0-4ba5-860f-31c264e07b3a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:32.562505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e972fbd2-1ab0-4ba5-860f-31c264e07b3a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:32.699047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e972fbd2-1ab0-4ba5-860f-31c264e07b3a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:32.709156 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e972fbd2-1ab0-4ba5-860f-31c264e07b3a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1629 microversion: 2.1 time: 0.159930 Aug 24 11:32:32.709828 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3569/7501] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:32 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1629 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:33.245533 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-44bd3677-545b-4328-b850-98dedd5cd13e req-c11e955c-ca90-4a7f-8cce-8eebb4c82285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2", "name": "network-vif-unplugged", "status": "completed", "tag": "1e3aa78f-b6e2-4c58-8886-39f05f879f01"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:33.256239 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-44bd3677-545b-4328-b850-98dedd5cd13e req-c11e955c-ca90-4a7f-8cce-8eebb4c82285 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:33.256711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-44bd3677-545b-4328-b850-98dedd5cd13e req-c11e955c-ca90-4a7f-8cce-8eebb4c82285 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:33.257230 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-44bd3677-545b-4328-b850-98dedd5cd13e req-c11e955c-ca90-4a7f-8cce-8eebb4c82285 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:33.269111 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.compute.server_external_events [req-44bd3677-545b-4328-b850-98dedd5cd13e req-c11e955c-ca90-4a7f-8cce-8eebb4c82285 service nova] Unable to find a host for instance c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2. Dropping event network-vif-unplugged {{(pid=122433) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 11:32:33.270057 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-44bd3677-545b-4328-b850-98dedd5cd13e req-c11e955c-ca90-4a7f-8cce-8eebb4c82285 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030533 Aug 24 11:32:33.271004 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3933/7502] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 11:32:33.730423 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-00fc6fd4-4a31-4bfe-9a85-b8c2e57b8244 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:33.731062 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-00fc6fd4-4a31-4bfe-9a85-b8c2e57b8244 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:33.738671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00fc6fd4-4a31-4bfe-9a85-b8c2e57b8244 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:33.739157 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00fc6fd4-4a31-4bfe-9a85-b8c2e57b8244 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:33.739601 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00fc6fd4-4a31-4bfe-9a85-b8c2e57b8244 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:33.740517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00fc6fd4-4a31-4bfe-9a85-b8c2e57b8244 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:33.740781 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00fc6fd4-4a31-4bfe-9a85-b8c2e57b8244 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:33.741400 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00fc6fd4-4a31-4bfe-9a85-b8c2e57b8244 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:33.894268 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-00fc6fd4-4a31-4bfe-9a85-b8c2e57b8244 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:33.902599 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-00fc6fd4-4a31-4bfe-9a85-b8c2e57b8244 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1687 microversion: 2.1 time: 0.176251 Aug 24 11:32:33.903185 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3570/7503] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:33 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:34.827076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-6bd38170-557c-4065-9f99-7140ca70dbd8 req-060e8149-28c1-4922-9afa-ef4ed6a4a31f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2", "tag": "1e3aa78f-b6e2-4c58-8886-39f05f879f01"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:34.838462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6bd38170-557c-4065-9f99-7140ca70dbd8 req-060e8149-28c1-4922-9afa-ef4ed6a4a31f service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:34.839036 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6bd38170-557c-4065-9f99-7140ca70dbd8 req-060e8149-28c1-4922-9afa-ef4ed6a4a31f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:34.839534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6bd38170-557c-4065-9f99-7140ca70dbd8 req-060e8149-28c1-4922-9afa-ef4ed6a4a31f service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:34.850817 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-6bd38170-557c-4065-9f99-7140ca70dbd8 req-060e8149-28c1-4922-9afa-ef4ed6a4a31f service nova] Creating event network-changed:1e3aa78f-b6e2-4c58-8886-39f05f879f01 for instance c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 on n-h2-849328-3 Aug 24 11:32:34.856642 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-6bd38170-557c-4065-9f99-7140ca70dbd8 req-060e8149-28c1-4922-9afa-ef4ed6a4a31f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093204 Aug 24 11:32:34.857296 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3934/7504] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:34.924095 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-52835430-d1e4-446d-acda-e688dc765035 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:34.924712 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-52835430-d1e4-446d-acda-e688dc765035 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:34.931854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52835430-d1e4-446d-acda-e688dc765035 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:34.932361 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52835430-d1e4-446d-acda-e688dc765035 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:34.932831 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52835430-d1e4-446d-acda-e688dc765035 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:34.933564 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52835430-d1e4-446d-acda-e688dc765035 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:34.934022 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52835430-d1e4-446d-acda-e688dc765035 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:34.934445 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52835430-d1e4-446d-acda-e688dc765035 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:35.069129 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-52835430-d1e4-446d-acda-e688dc765035 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:35.077541 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-52835430-d1e4-446d-acda-e688dc765035 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1687 microversion: 2.1 time: 0.157402 Aug 24 11:32:35.078143 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3571/7505] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:34 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:36.101104 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e6ba4c3d-a754-4a82-99c2-f5b27472916c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:36.101745 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e6ba4c3d-a754-4a82-99c2-f5b27472916c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:36.108713 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6ba4c3d-a754-4a82-99c2-f5b27472916c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:36.109332 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6ba4c3d-a754-4a82-99c2-f5b27472916c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:36.109875 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6ba4c3d-a754-4a82-99c2-f5b27472916c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:36.110781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6ba4c3d-a754-4a82-99c2-f5b27472916c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:36.111368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6ba4c3d-a754-4a82-99c2-f5b27472916c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:36.111846 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6ba4c3d-a754-4a82-99c2-f5b27472916c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:36.131679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:36.274661 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e6ba4c3d-a754-4a82-99c2-f5b27472916c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:36.283549 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e6ba4c3d-a754-4a82-99c2-f5b27472916c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1687 microversion: 2.1 time: 0.188147 Aug 24 11:32:36.284632 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3935/7506] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:36 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1687 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:37.307431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ecb52160-c6bc-433e-ac8c-0f4da75864c5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:37.308897 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ecb52160-c6bc-433e-ac8c-0f4da75864c5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:37.315351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=31 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:37.317746 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecb52160-c6bc-433e-ac8c-0f4da75864c5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:37.318626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecb52160-c6bc-433e-ac8c-0f4da75864c5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:37.319323 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecb52160-c6bc-433e-ac8c-0f4da75864c5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:37.320833 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecb52160-c6bc-433e-ac8c-0f4da75864c5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:37.321568 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecb52160-c6bc-433e-ac8c-0f4da75864c5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:37.322276 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecb52160-c6bc-433e-ac8c-0f4da75864c5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:37.356917 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=91 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:37.370085 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:32:37.370888 n-d-849328-3 devstack@n-api.service[122433]: Wed Aug 24 11:32:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:32:37.505949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ecb52160-c6bc-433e-ac8c-0f4da75864c5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:37.515414 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ecb52160-c6bc-433e-ac8c-0f4da75864c5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1687 microversion: 2.1 time: 0.212885 Aug 24 11:32:37.526354 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3572/7507] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:37 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1687 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:38.538504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9b1de23b-2556-4549-9f2e-0508a310012c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:38.539900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9b1de23b-2556-4549-9f2e-0508a310012c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:38.544629 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:38.548722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b1de23b-2556-4549-9f2e-0508a310012c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:38.549376 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b1de23b-2556-4549-9f2e-0508a310012c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:38.549931 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b1de23b-2556-4549-9f2e-0508a310012c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:38.550901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b1de23b-2556-4549-9f2e-0508a310012c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:38.551460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b1de23b-2556-4549-9f2e-0508a310012c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:38.551975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b1de23b-2556-4549-9f2e-0508a310012c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:38.721132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9b1de23b-2556-4549-9f2e-0508a310012c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:38.730343 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9b1de23b-2556-4549-9f2e-0508a310012c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1687 microversion: 2.1 time: 0.196439 Aug 24 11:32:38.731057 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3936/7508] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:38 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1687 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:39.768513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d9443c4a-1c61-4b11-b894-ec1016e73f15 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:39.769813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d9443c4a-1c61-4b11-b894-ec1016e73f15 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:39.776381 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9443c4a-1c61-4b11-b894-ec1016e73f15 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:39.776886 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9443c4a-1c61-4b11-b894-ec1016e73f15 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:39.777346 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9443c4a-1c61-4b11-b894-ec1016e73f15 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:39.778056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9443c4a-1c61-4b11-b894-ec1016e73f15 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:39.778498 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9443c4a-1c61-4b11-b894-ec1016e73f15 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:39.778938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9443c4a-1c61-4b11-b894-ec1016e73f15 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:39.949163 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d9443c4a-1c61-4b11-b894-ec1016e73f15 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:39.957077 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d9443c4a-1c61-4b11-b894-ec1016e73f15 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1687 microversion: 2.1 time: 0.193108 Aug 24 11:32:39.957715 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3573/7509] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:39 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1687 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:40.978679 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b025f82e-e472-4d80-891d-0242f8f570a5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:40.979391 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b025f82e-e472-4d80-891d-0242f8f570a5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:40.986423 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b025f82e-e472-4d80-891d-0242f8f570a5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:40.986927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b025f82e-e472-4d80-891d-0242f8f570a5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:40.987412 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b025f82e-e472-4d80-891d-0242f8f570a5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:40.988133 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b025f82e-e472-4d80-891d-0242f8f570a5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:40.988596 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b025f82e-e472-4d80-891d-0242f8f570a5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:40.989025 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b025f82e-e472-4d80-891d-0242f8f570a5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:41.186625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b025f82e-e472-4d80-891d-0242f8f570a5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:41.195046 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b025f82e-e472-4d80-891d-0242f8f570a5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1687 microversion: 2.1 time: 0.220507 Aug 24 11:32:41.195647 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3937/7510] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:40 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1687 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:42.218909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f8cf77d1-f4c3-44f6-8224-7307a8a1f29c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:42.219709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f8cf77d1-f4c3-44f6-8224-7307a8a1f29c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:42.228938 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8cf77d1-f4c3-44f6-8224-7307a8a1f29c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:42.229561 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8cf77d1-f4c3-44f6-8224-7307a8a1f29c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:42.230060 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8cf77d1-f4c3-44f6-8224-7307a8a1f29c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:42.230836 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8cf77d1-f4c3-44f6-8224-7307a8a1f29c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:42.231351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8cf77d1-f4c3-44f6-8224-7307a8a1f29c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:42.231858 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8cf77d1-f4c3-44f6-8224-7307a8a1f29c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:42.398547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f8cf77d1-f4c3-44f6-8224-7307a8a1f29c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:42.407543 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f8cf77d1-f4c3-44f6-8224-7307a8a1f29c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1687 microversion: 2.1 time: 0.194615 Aug 24 11:32:42.408498 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3574/7511] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:42 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1687 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:43.438807 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4f262bc0-7033-4077-9c24-a873404773cc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:43.439419 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4f262bc0-7033-4077-9c24-a873404773cc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:43.446939 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f262bc0-7033-4077-9c24-a873404773cc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:43.447443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f262bc0-7033-4077-9c24-a873404773cc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:43.447951 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f262bc0-7033-4077-9c24-a873404773cc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:43.448676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f262bc0-7033-4077-9c24-a873404773cc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:43.449147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f262bc0-7033-4077-9c24-a873404773cc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:43.449645 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f262bc0-7033-4077-9c24-a873404773cc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:43.605339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4f262bc0-7033-4077-9c24-a873404773cc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:43.615357 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4f262bc0-7033-4077-9c24-a873404773cc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1687 microversion: 2.1 time: 0.180510 Aug 24 11:32:43.615994 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3938/7512] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:43 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1687 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:44.646576 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8a942e8a-112b-408b-b6c4-154782a70d4f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:44.647255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8a942e8a-112b-408b-b6c4-154782a70d4f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:44.654444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a942e8a-112b-408b-b6c4-154782a70d4f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:44.654925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a942e8a-112b-408b-b6c4-154782a70d4f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:44.655359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a942e8a-112b-408b-b6c4-154782a70d4f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:44.656069 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a942e8a-112b-408b-b6c4-154782a70d4f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:44.656521 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a942e8a-112b-408b-b6c4-154782a70d4f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:44.656945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a942e8a-112b-408b-b6c4-154782a70d4f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:44.800358 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8a942e8a-112b-408b-b6c4-154782a70d4f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:44.809014 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8a942e8a-112b-408b-b6c4-154782a70d4f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1687 microversion: 2.1 time: 0.167595 Aug 24 11:32:44.809649 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3575/7513] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:44 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:45.830294 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8aa41c71-e5a7-4552-b4e9-b9c90d728f91 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:45.830900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8aa41c71-e5a7-4552-b4e9-b9c90d728f91 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:45.838412 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8aa41c71-e5a7-4552-b4e9-b9c90d728f91 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:45.838943 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8aa41c71-e5a7-4552-b4e9-b9c90d728f91 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:45.839394 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8aa41c71-e5a7-4552-b4e9-b9c90d728f91 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:45.840105 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8aa41c71-e5a7-4552-b4e9-b9c90d728f91 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:45.840577 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8aa41c71-e5a7-4552-b4e9-b9c90d728f91 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:45.841015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8aa41c71-e5a7-4552-b4e9-b9c90d728f91 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:45.985646 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8aa41c71-e5a7-4552-b4e9-b9c90d728f91 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:45.993950 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8aa41c71-e5a7-4552-b4e9-b9c90d728f91 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1687 microversion: 2.1 time: 0.167690 Aug 24 11:32:45.994570 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3939/7514] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:45 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:47.019056 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a5603ba9-1bab-4bf2-bd9a-05c8a7e48935 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:47.019679 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a5603ba9-1bab-4bf2-bd9a-05c8a7e48935 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:47.027221 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5603ba9-1bab-4bf2-bd9a-05c8a7e48935 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:47.027750 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5603ba9-1bab-4bf2-bd9a-05c8a7e48935 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:47.028171 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5603ba9-1bab-4bf2-bd9a-05c8a7e48935 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:47.028949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5603ba9-1bab-4bf2-bd9a-05c8a7e48935 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:47.029597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5603ba9-1bab-4bf2-bd9a-05c8a7e48935 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:47.030028 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5603ba9-1bab-4bf2-bd9a-05c8a7e48935 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:47.177288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a5603ba9-1bab-4bf2-bd9a-05c8a7e48935 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:47.185959 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a5603ba9-1bab-4bf2-bd9a-05c8a7e48935 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1687 microversion: 2.1 time: 0.172718 Aug 24 11:32:47.186566 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3576/7515] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:47 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:48.212046 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fe7a98a0-8227-4975-a3f9-8d8fbb030ebe tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:48.212698 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fe7a98a0-8227-4975-a3f9-8d8fbb030ebe tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:48.220019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe7a98a0-8227-4975-a3f9-8d8fbb030ebe tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:48.220521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe7a98a0-8227-4975-a3f9-8d8fbb030ebe tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:48.220969 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe7a98a0-8227-4975-a3f9-8d8fbb030ebe tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:48.221699 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe7a98a0-8227-4975-a3f9-8d8fbb030ebe tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:48.222169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe7a98a0-8227-4975-a3f9-8d8fbb030ebe tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:48.222606 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe7a98a0-8227-4975-a3f9-8d8fbb030ebe tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:48.361488 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fe7a98a0-8227-4975-a3f9-8d8fbb030ebe tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:48.372361 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fe7a98a0-8227-4975-a3f9-8d8fbb030ebe tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1687 microversion: 2.1 time: 0.164275 Aug 24 11:32:48.372954 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3940/7516] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:48 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:48.921444 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-80a934ea-dfb6-4e15-9290-9df3f5fb276d req-0de68f3e-d8e8-4ae3-bc0f-c7e7861cbe51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2", "name": "network-vif-plugged", "status": "completed", "tag": "1e3aa78f-b6e2-4c58-8886-39f05f879f01"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:48.932627 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-80a934ea-dfb6-4e15-9290-9df3f5fb276d req-0de68f3e-d8e8-4ae3-bc0f-c7e7861cbe51 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:48.933298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-80a934ea-dfb6-4e15-9290-9df3f5fb276d req-0de68f3e-d8e8-4ae3-bc0f-c7e7861cbe51 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:48.933745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-80a934ea-dfb6-4e15-9290-9df3f5fb276d req-0de68f3e-d8e8-4ae3-bc0f-c7e7861cbe51 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:48.945638 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-80a934ea-dfb6-4e15-9290-9df3f5fb276d req-0de68f3e-d8e8-4ae3-bc0f-c7e7861cbe51 service nova] Creating event network-vif-plugged:1e3aa78f-b6e2-4c58-8886-39f05f879f01 for instance c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 on n-h2-849328-3 Aug 24 11:32:48.949306 n-d-849328-3 devstack@n-api.service[122432]: ERROR oslo.messaging._drivers.impl_rabbit [req-80a934ea-dfb6-4e15-9290-9df3f5fb276d req-0de68f3e-d8e8-4ae3-bc0f-c7e7861cbe51 service nova] [c8de5569-63e0-4522-bb5e-9d9925ea3a68] AMQP server on 10.222.0.85:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 11:32:49.396598 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b183a98f-c0b8-4705-a715-958ddcc1ed8d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:49.397529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b183a98f-c0b8-4705-a715-958ddcc1ed8d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:49.406118 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b183a98f-c0b8-4705-a715-958ddcc1ed8d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:49.406620 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b183a98f-c0b8-4705-a715-958ddcc1ed8d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:49.407073 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b183a98f-c0b8-4705-a715-958ddcc1ed8d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:49.407781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b183a98f-c0b8-4705-a715-958ddcc1ed8d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:49.408253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b183a98f-c0b8-4705-a715-958ddcc1ed8d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:49.408693 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b183a98f-c0b8-4705-a715-958ddcc1ed8d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:49.550568 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b183a98f-c0b8-4705-a715-958ddcc1ed8d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:49.559098 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b183a98f-c0b8-4705-a715-958ddcc1ed8d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1687 microversion: 2.1 time: 0.168704 Aug 24 11:32:49.559691 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3941/7517] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:49 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:49.958230 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [req-80a934ea-dfb6-4e15-9290-9df3f5fb276d req-0de68f3e-d8e8-4ae3-bc0f-c7e7861cbe51 service nova] [c8de5569-63e0-4522-bb5e-9d9925ea3a68] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 57974. Aug 24 11:32:49.962747 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-80a934ea-dfb6-4e15-9290-9df3f5fb276d req-0de68f3e-d8e8-4ae3-bc0f-c7e7861cbe51 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.045583 Aug 24 11:32:49.963410 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3577/7518] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:50.580392 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ac622216-a01f-4742-9494-bdb28d49ac7e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:50.580974 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ac622216-a01f-4742-9494-bdb28d49ac7e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:50.588741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac622216-a01f-4742-9494-bdb28d49ac7e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:50.589290 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac622216-a01f-4742-9494-bdb28d49ac7e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:50.589725 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac622216-a01f-4742-9494-bdb28d49ac7e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:50.590448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac622216-a01f-4742-9494-bdb28d49ac7e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:50.590917 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac622216-a01f-4742-9494-bdb28d49ac7e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:50.591355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac622216-a01f-4742-9494-bdb28d49ac7e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:50.728187 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ac622216-a01f-4742-9494-bdb28d49ac7e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:50.736833 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ac622216-a01f-4742-9494-bdb28d49ac7e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1687 microversion: 2.1 time: 0.160183 Aug 24 11:32:50.737715 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3942/7519] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:50 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:51.760529 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d04632ef-eb40-4ea7-87d5-363bf49335df tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:51.761280 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d04632ef-eb40-4ea7-87d5-363bf49335df tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:51.767863 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d04632ef-eb40-4ea7-87d5-363bf49335df tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:51.768352 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d04632ef-eb40-4ea7-87d5-363bf49335df tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:51.768788 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d04632ef-eb40-4ea7-87d5-363bf49335df tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:51.769524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d04632ef-eb40-4ea7-87d5-363bf49335df tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:51.769981 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d04632ef-eb40-4ea7-87d5-363bf49335df tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:51.770402 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d04632ef-eb40-4ea7-87d5-363bf49335df tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:51.912325 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d04632ef-eb40-4ea7-87d5-363bf49335df tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:51.920553 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d04632ef-eb40-4ea7-87d5-363bf49335df tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1687 microversion: 2.1 time: 0.165368 Aug 24 11:32:51.921144 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3578/7520] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:51 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:52.943080 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cedf21f2-bbbf-49f6-ba79-fb20fd668527 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:52.943716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cedf21f2-bbbf-49f6-ba79-fb20fd668527 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:52.951173 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cedf21f2-bbbf-49f6-ba79-fb20fd668527 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:52.951684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cedf21f2-bbbf-49f6-ba79-fb20fd668527 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:52.952142 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cedf21f2-bbbf-49f6-ba79-fb20fd668527 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:52.952862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cedf21f2-bbbf-49f6-ba79-fb20fd668527 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:52.953377 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cedf21f2-bbbf-49f6-ba79-fb20fd668527 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:52.953828 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cedf21f2-bbbf-49f6-ba79-fb20fd668527 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:53.091451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cedf21f2-bbbf-49f6-ba79-fb20fd668527 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:53.099666 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cedf21f2-bbbf-49f6-ba79-fb20fd668527 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1674 microversion: 2.1 time: 0.160631 Aug 24 11:32:53.100263 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3943/7521] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:52 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:03.890067 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:33:03.890647 n-d-849328-3 devstack@n-api.service[122432]: Wed Aug 24 11:33:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:34:09.672925 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=13 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:09.673707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=37 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:09.679948 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=15 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:09.680999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=50 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:09.682822 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-db89a598-a73e-40a7-857b-fb0116fbe6fc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:09.683336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-db89a598-a73e-40a7-857b-fb0116fbe6fc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:09.692941 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db89a598-a73e-40a7-857b-fb0116fbe6fc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:09.693462 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db89a598-a73e-40a7-857b-fb0116fbe6fc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:09.693901 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db89a598-a73e-40a7-857b-fb0116fbe6fc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:09.694682 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db89a598-a73e-40a7-857b-fb0116fbe6fc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:09.695146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db89a598-a73e-40a7-857b-fb0116fbe6fc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:09.695571 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db89a598-a73e-40a7-857b-fb0116fbe6fc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:09.726254 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-db89a598-a73e-40a7-857b-fb0116fbe6fc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:34:09.746410 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-55e0d84b-2085-4bde-a5b5-42ba05279708 req-c7812da8-fe5a-4f80-9546-4e349f74007e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2", "tag": "1e3aa78f-b6e2-4c58-8886-39f05f879f01"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:09.757535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-55e0d84b-2085-4bde-a5b5-42ba05279708 req-c7812da8-fe5a-4f80-9546-4e349f74007e service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:09.758041 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-55e0d84b-2085-4bde-a5b5-42ba05279708 req-c7812da8-fe5a-4f80-9546-4e349f74007e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:09.758504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-55e0d84b-2085-4bde-a5b5-42ba05279708 req-c7812da8-fe5a-4f80-9546-4e349f74007e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:09.771186 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-55e0d84b-2085-4bde-a5b5-42ba05279708 req-c7812da8-fe5a-4f80-9546-4e349f74007e service nova] Creating event network-changed:1e3aa78f-b6e2-4c58-8886-39f05f879f01 for instance c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 on n-h2-849328-3 Aug 24 11:34:09.776731 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-55e0d84b-2085-4bde-a5b5-42ba05279708 req-c7812da8-fe5a-4f80-9546-4e349f74007e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098616 Aug 24 11:34:09.777645 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3944/7522] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:09.817779 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-db89a598-a73e-40a7-857b-fb0116fbe6fc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "DELETE /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 204 len: 0 microversion: 2.1 time: 0.146343 Aug 24 11:34:09.818791 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3579/7523] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:34:09 2022] DELETE /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:34:09.829752 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-754ebf59-17a2-4a4c-a516-b8f5010476ed tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:09.830876 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-754ebf59-17a2-4a4c-a516-b8f5010476ed tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:09.838120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-754ebf59-17a2-4a4c-a516-b8f5010476ed tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:09.838751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-754ebf59-17a2-4a4c-a516-b8f5010476ed tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:09.839285 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-754ebf59-17a2-4a4c-a516-b8f5010476ed tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:09.840300 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-754ebf59-17a2-4a4c-a516-b8f5010476ed tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:09.840636 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-754ebf59-17a2-4a4c-a516-b8f5010476ed tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:09.841192 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-754ebf59-17a2-4a4c-a516-b8f5010476ed tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:09.993235 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-754ebf59-17a2-4a4c-a516-b8f5010476ed tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:10.002278 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-754ebf59-17a2-4a4c-a516-b8f5010476ed tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1680 microversion: 2.1 time: 0.178030 Aug 24 11:34:10.002934 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3945/7524] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:09 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:34:11.026184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5aba266e-e519-4fc8-9b8d-268237de540f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:11.027166 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5aba266e-e519-4fc8-9b8d-268237de540f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:11.035610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5aba266e-e519-4fc8-9b8d-268237de540f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:11.036118 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5aba266e-e519-4fc8-9b8d-268237de540f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:11.036536 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5aba266e-e519-4fc8-9b8d-268237de540f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:11.037288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5aba266e-e519-4fc8-9b8d-268237de540f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:11.037740 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5aba266e-e519-4fc8-9b8d-268237de540f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:11.038141 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5aba266e-e519-4fc8-9b8d-268237de540f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:11.200602 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5aba266e-e519-4fc8-9b8d-268237de540f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:11.212780 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5aba266e-e519-4fc8-9b8d-268237de540f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1680 microversion: 2.1 time: 0.191787 Aug 24 11:34:11.213789 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3580/7525] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:11 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1680 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:11.817106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-bdfa8241-c38a-40b3-aef9-a1c2c1db6f19 req-dd2c16f4-a6ad-42e5-941f-b945be75ebe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2", "name": "network-vif-deleted", "tag": "1e3aa78f-b6e2-4c58-8886-39f05f879f01"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:11.831759 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bdfa8241-c38a-40b3-aef9-a1c2c1db6f19 req-dd2c16f4-a6ad-42e5-941f-b945be75ebe1 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:11.832163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bdfa8241-c38a-40b3-aef9-a1c2c1db6f19 req-dd2c16f4-a6ad-42e5-941f-b945be75ebe1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:11.832611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bdfa8241-c38a-40b3-aef9-a1c2c1db6f19 req-dd2c16f4-a6ad-42e5-941f-b945be75ebe1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:11.847767 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-bdfa8241-c38a-40b3-aef9-a1c2c1db6f19 req-dd2c16f4-a6ad-42e5-941f-b945be75ebe1 service nova] Creating event network-vif-deleted:1e3aa78f-b6e2-4c58-8886-39f05f879f01 for instance c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 on n-h2-849328-3 Aug 24 11:34:11.853623 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-bdfa8241-c38a-40b3-aef9-a1c2c1db6f19 req-dd2c16f4-a6ad-42e5-941f-b945be75ebe1 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040204 Aug 24 11:34:11.854251 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3946/7526] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:12.247042 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-daf52366-39ff-478f-9439-1562dc6f7b7a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:12.247728 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-daf52366-39ff-478f-9439-1562dc6f7b7a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:12.261427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-daf52366-39ff-478f-9439-1562dc6f7b7a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:12.261894 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-daf52366-39ff-478f-9439-1562dc6f7b7a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:12.262341 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-daf52366-39ff-478f-9439-1562dc6f7b7a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:12.263012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-daf52366-39ff-478f-9439-1562dc6f7b7a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:12.263455 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-daf52366-39ff-478f-9439-1562dc6f7b7a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:12.263887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-daf52366-39ff-478f-9439-1562dc6f7b7a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:12.302381 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-daf52366-39ff-478f-9439-1562dc6f7b7a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:12.302879 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-daf52366-39ff-478f-9439-1562dc6f7b7a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:12.303308 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-daf52366-39ff-478f-9439-1562dc6f7b7a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:12.303827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-daf52366-39ff-478f-9439-1562dc6f7b7a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lazy-loading 'fault' on Instance uuid c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:34:12.359053 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-daf52366-39ff-478f-9439-1562dc6f7b7a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:12.368633 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-daf52366-39ff-478f-9439-1562dc6f7b7a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 200 len: 1336 microversion: 2.1 time: 0.128095 Aug 24 11:34:12.369294 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3581/7527] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:12 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 1336 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:13.396362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a66b983e-10e2-46de-8303-732ef7d837a1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:13.397551 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a66b983e-10e2-46de-8303-732ef7d837a1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:13.408076 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a66b983e-10e2-46de-8303-732ef7d837a1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:13.408575 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a66b983e-10e2-46de-8303-732ef7d837a1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:13.409028 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a66b983e-10e2-46de-8303-732ef7d837a1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:13.409769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a66b983e-10e2-46de-8303-732ef7d837a1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:13.410246 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a66b983e-10e2-46de-8303-732ef7d837a1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:13.410690 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a66b983e-10e2-46de-8303-732ef7d837a1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:13.424627 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-a66b983e-10e2-46de-8303-732ef7d837a1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] HTTP exception thrown: Instance c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 could not be found. Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a66b983e-10e2-46de-8303-732ef7d837a1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Request method failure captured: Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 HTTP/1.1 Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBguuLSbaLThv-Qm6CLmB4grpf6WhLwYqSIAAY-iCIddBdo3E9v2k--BnjOhKxowplnH4EBGe1asfWKeb4GjhljRqyk7ilOJwRWlVXGKqC6GTMccalJegCY4ttxuBUtJy6H_fMZlLZOe8YffApiq1P3zOMFore8tIXKe3ZwhxAMxwvxg Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 5a6a7095e5e94f7e9db48308288c4583 Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestShelveInstance-128365738 Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5a6a7095e5e94f7e9db48308288c4583"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_5a6a7095e5e94f7e9db48308288c4583", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5a6a7095e5e94f7e9db48308288c4583"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/5a6a7095e5e94f7e9db48308288c4583"}]}] Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestShelveInstance-128365738 Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 5a6a7095e5e94f7e9db48308288c4583 Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestShelveInstance-128365738 Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestShelveInstance-128365738-project Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: d38342bcd5c4427ca84becd8060b454a Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestShelveInstance-128365738-project Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 could not be found. Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2'} Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 could not be found. Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 could not be found. Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:13.426308 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:34:13.431502 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:13.431502 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:13.431502 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:13.431502 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:34:13.431502 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:34:13.431502 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 could not be found. Aug 24 11:34:13.431502 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:34:13.431502 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a66b983e-10e2-46de-8303-732ef7d837a1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Returning 404 to user: Instance c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:34:13.431502 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a66b983e-10e2-46de-8303-732ef7d837a1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2" status: 404 len: 111 microversion: 2.1 time: 0.040046 Aug 24 11:34:13.431502 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3947/7528] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:13 2022] GET /compute/v2.1/servers/c2a0073d-9e4f-48d5-9f47-c1e9717dc9b2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:34:13.607274 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7ed81924-cfce-49f2-97a8-a9d76634814d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '.version_select at 0x7f465459c040>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:13.632576 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7ed81924-cfce-49f2-97a8-a9d76634814d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-633364026" status: 202 len: 0 microversion: 2.1 time: 0.029503 Aug 24 11:34:13.633235 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3582/7529] 10.222.0.85 () {58 vars in 1251 bytes} [Wed Aug 24 11:34:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-633364026 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:34:13.657347 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-462258af-bf75-4052-94c9-826e69c91693 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Action: 'create', calling method: .version_select at 0x7f465418d1f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1686440220", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+5UEH024k+0Elhz4hwUiI+P42Wh2MbrTRgzfkEt/bomwgJ1oMziG0P8K2WIVEklwQ5E4tPues7h5iH6aVuZR2wwC/Ehbg2tuJMhc+iRa2DL65xF0+6/HujUvDgCvQTZQ=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:13.673481 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-462258af-bf75-4052-94c9-826e69c91693 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Getting quotas for project 5a6a7095e5e94f7e9db48308288c4583. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:34:13.678854 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-462258af-bf75-4052-94c9-826e69c91693 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Getting quotas for user d38342bcd5c4427ca84becd8060b454a and project 5a6a7095e5e94f7e9db48308288c4583. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:34:13.710667 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-462258af-bf75-4052-94c9-826e69c91693 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.057462 Aug 24 11:34:13.711280 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3948/7530] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 11:34:13 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:31.039480 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6aaecd1a-e73d-4606-a9aa-7f8760dc0ed3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1314507938", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1686440220", "security_groups": [{"name": "tempest-secgroup-smoke-927242231"}], "networks": [{"uuid": "d5aa48c5-2ea9-4042-9a43-cc933bde32ea"}], "block_device_mapping_v2": [{"uuid": "5654072c-c008-40c5-985d-5649ecb91989", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:31.050672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:31.051336 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:31.157374 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-6aaecd1a-e73d-4606-a9aa-7f8760dc0ed3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] validate_networks() for [('d5aa48c5-2ea9-4042-9a43-cc933bde32ea', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:34:31.602263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-6aaecd1a-e73d-4606-a9aa-7f8760dc0ed3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:34:31.602838 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-6aaecd1a-e73d-4606-a9aa-7f8760dc0ed3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:34:31.603580 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-6aaecd1a-e73d-4606-a9aa-7f8760dc0ed3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:34:31.604150 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-6aaecd1a-e73d-4606-a9aa-7f8760dc0ed3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:34:31.604710 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-6aaecd1a-e73d-4606-a9aa-7f8760dc0ed3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:34:31.617427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aaecd1a-e73d-4606-a9aa-7f8760dc0ed3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:31.617914 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aaecd1a-e73d-4606-a9aa-7f8760dc0ed3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:31.618346 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aaecd1a-e73d-4606-a9aa-7f8760dc0ed3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:31.619102 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aaecd1a-e73d-4606-a9aa-7f8760dc0ed3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:31.619553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aaecd1a-e73d-4606-a9aa-7f8760dc0ed3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:31.619971 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6aaecd1a-e73d-4606-a9aa-7f8760dc0ed3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:31.637991 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-6aaecd1a-e73d-4606-a9aa-7f8760dc0ed3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Getting quotas for project 5a6a7095e5e94f7e9db48308288c4583. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:34:31.643699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-6aaecd1a-e73d-4606-a9aa-7f8760dc0ed3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Getting quotas for user d38342bcd5c4427ca84becd8060b454a and project 5a6a7095e5e94f7e9db48308288c4583. Resources: {'instances', 'ram', 'cores'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:34:31.703207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6aaecd1a-e73d-4606-a9aa-7f8760dc0ed3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:34:31.705385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6aaecd1a-e73d-4606-a9aa-7f8760dc0ed3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5654072c-c008-40c5-985d-5649ecb91989',volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:34:31.843901 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6aaecd1a-e73d-4606-a9aa-7f8760dc0ed3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.808416 Aug 24 11:34:31.844564 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3583/7531] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 11:34:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:34:31.853923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=12 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:31.854668 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:31.855571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:31.860494 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8a356ef8-ea05-463b-b0b4-d34b464c77ae tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:31.861153 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8a356ef8-ea05-463b-b0b4-d34b464c77ae tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:31.921212 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8a356ef8-ea05-463b-b0b4-d34b464c77ae tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:31.928378 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8a356ef8-ea05-463b-b0b4-d34b464c77ae tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1089 microversion: 2.1 time: 0.076454 Aug 24 11:34:31.929106 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3949/7532] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:31 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1089 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:32.951865 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5f70087d-9226-4e97-a893-dd155a43d2ce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:32.952570 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5f70087d-9226-4e97-a893-dd155a43d2ce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:32.960211 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f70087d-9226-4e97-a893-dd155a43d2ce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:32.960896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f70087d-9226-4e97-a893-dd155a43d2ce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:32.961547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f70087d-9226-4e97-a893-dd155a43d2ce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:32.962269 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f70087d-9226-4e97-a893-dd155a43d2ce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:32.962928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f70087d-9226-4e97-a893-dd155a43d2ce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:32.963665 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f70087d-9226-4e97-a893-dd155a43d2ce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:33.046210 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5f70087d-9226-4e97-a893-dd155a43d2ce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:33.056656 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5f70087d-9226-4e97-a893-dd155a43d2ce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1205 microversion: 2.1 time: 0.110558 Aug 24 11:34:33.057261 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3584/7533] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:32 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1205 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:34.078797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c6afe4c8-af68-4fd2-a1d5-eb3044a7aa5e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:34.079677 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c6afe4c8-af68-4fd2-a1d5-eb3044a7aa5e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:34.087736 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6afe4c8-af68-4fd2-a1d5-eb3044a7aa5e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:34.088461 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6afe4c8-af68-4fd2-a1d5-eb3044a7aa5e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:34.089064 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6afe4c8-af68-4fd2-a1d5-eb3044a7aa5e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:34.089896 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6afe4c8-af68-4fd2-a1d5-eb3044a7aa5e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:34.090438 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6afe4c8-af68-4fd2-a1d5-eb3044a7aa5e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:34.090990 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6afe4c8-af68-4fd2-a1d5-eb3044a7aa5e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:34.244188 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c6afe4c8-af68-4fd2-a1d5-eb3044a7aa5e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:34.253537 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c6afe4c8-af68-4fd2-a1d5-eb3044a7aa5e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1272 microversion: 2.1 time: 0.179041 Aug 24 11:34:34.254857 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3950/7534] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:34 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1272 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:34.384671 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-823be812-293d-4459-b3dd-2f1fc45579ab req-ab1e7c72-dabd-4a4f-ac38-96aec34508c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "225f56de-327c-438d-a2a4-685ab32c626f", "tag": "0d0f785c-dcc6-47c9-9441-07f633085207"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:34.398299 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-823be812-293d-4459-b3dd-2f1fc45579ab req-ab1e7c72-dabd-4a4f-ac38-96aec34508c2 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:34.398930 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-823be812-293d-4459-b3dd-2f1fc45579ab req-ab1e7c72-dabd-4a4f-ac38-96aec34508c2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:34.399556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-823be812-293d-4459-b3dd-2f1fc45579ab req-ab1e7c72-dabd-4a4f-ac38-96aec34508c2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:34.413975 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-823be812-293d-4459-b3dd-2f1fc45579ab req-ab1e7c72-dabd-4a4f-ac38-96aec34508c2 service nova] Creating event network-changed:0d0f785c-dcc6-47c9-9441-07f633085207 for instance 225f56de-327c-438d-a2a4-685ab32c626f on n-h1-849328-3 Aug 24 11:34:34.419940 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-823be812-293d-4459-b3dd-2f1fc45579ab req-ab1e7c72-dabd-4a4f-ac38-96aec34508c2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042689 Aug 24 11:34:34.421157 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3585/7535] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:35.276169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-139f41b7-3b24-4091-af4e-c8db43bd75b6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:35.277572 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-139f41b7-3b24-4091-af4e-c8db43bd75b6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:35.285153 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-139f41b7-3b24-4091-af4e-c8db43bd75b6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:35.285768 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-139f41b7-3b24-4091-af4e-c8db43bd75b6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:35.286281 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-139f41b7-3b24-4091-af4e-c8db43bd75b6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:35.287116 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-139f41b7-3b24-4091-af4e-c8db43bd75b6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:35.287650 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-139f41b7-3b24-4091-af4e-c8db43bd75b6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:35.288180 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-139f41b7-3b24-4091-af4e-c8db43bd75b6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:35.426950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-139f41b7-3b24-4091-af4e-c8db43bd75b6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:35.435034 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-139f41b7-3b24-4091-af4e-c8db43bd75b6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1272 microversion: 2.1 time: 0.163996 Aug 24 11:34:35.435894 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3951/7536] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:35 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1272 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:36.458338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4262476b-d353-45ae-95c2-45346442a5ea tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:36.459068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4262476b-d353-45ae-95c2-45346442a5ea tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:36.466024 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4262476b-d353-45ae-95c2-45346442a5ea tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:36.466511 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4262476b-d353-45ae-95c2-45346442a5ea tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:36.466946 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4262476b-d353-45ae-95c2-45346442a5ea tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:36.467642 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4262476b-d353-45ae-95c2-45346442a5ea tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:36.468095 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4262476b-d353-45ae-95c2-45346442a5ea tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:36.468517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4262476b-d353-45ae-95c2-45346442a5ea tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:36.609446 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4262476b-d353-45ae-95c2-45346442a5ea tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:36.619509 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4262476b-d353-45ae-95c2-45346442a5ea tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1272 microversion: 2.1 time: 0.166414 Aug 24 11:34:36.620106 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3586/7537] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:36 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1272 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:37.640814 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ca31c2fb-5329-4377-98d3-17549b615ea5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:37.641485 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ca31c2fb-5329-4377-98d3-17549b615ea5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:37.649199 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca31c2fb-5329-4377-98d3-17549b615ea5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:37.649748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca31c2fb-5329-4377-98d3-17549b615ea5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:37.650203 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca31c2fb-5329-4377-98d3-17549b615ea5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:37.650934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca31c2fb-5329-4377-98d3-17549b615ea5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:37.651415 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca31c2fb-5329-4377-98d3-17549b615ea5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:37.651851 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca31c2fb-5329-4377-98d3-17549b615ea5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:37.789930 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ca31c2fb-5329-4377-98d3-17549b615ea5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:37.797958 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ca31c2fb-5329-4377-98d3-17549b615ea5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1272 microversion: 2.1 time: 0.161483 Aug 24 11:34:37.798547 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3952/7538] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:37 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1272 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:38.823244 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e4312656-dfce-44b5-a8db-81816f64ddb9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:38.824130 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e4312656-dfce-44b5-a8db-81816f64ddb9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:38.835306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4312656-dfce-44b5-a8db-81816f64ddb9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:38.835831 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4312656-dfce-44b5-a8db-81816f64ddb9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:38.836296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4312656-dfce-44b5-a8db-81816f64ddb9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:38.836988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4312656-dfce-44b5-a8db-81816f64ddb9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:38.837463 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4312656-dfce-44b5-a8db-81816f64ddb9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:38.837891 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4312656-dfce-44b5-a8db-81816f64ddb9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:38.982867 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e4312656-dfce-44b5-a8db-81816f64ddb9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:38.991092 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e4312656-dfce-44b5-a8db-81816f64ddb9 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1260 microversion: 2.1 time: 0.174733 Aug 24 11:34:38.991681 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3587/7539] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:38 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:40.017659 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a2e8f11e-d4de-4877-a1b2-6619daa57430 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:40.018604 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a2e8f11e-d4de-4877-a1b2-6619daa57430 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:40.030071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2e8f11e-d4de-4877-a1b2-6619daa57430 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:40.030903 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2e8f11e-d4de-4877-a1b2-6619daa57430 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:40.031641 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2e8f11e-d4de-4877-a1b2-6619daa57430 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:40.032811 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2e8f11e-d4de-4877-a1b2-6619daa57430 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:40.033625 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2e8f11e-d4de-4877-a1b2-6619daa57430 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:40.034358 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2e8f11e-d4de-4877-a1b2-6619daa57430 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:40.173032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a2e8f11e-d4de-4877-a1b2-6619daa57430 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:40.181511 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a2e8f11e-d4de-4877-a1b2-6619daa57430 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1260 microversion: 2.1 time: 0.170664 Aug 24 11:34:40.182105 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3953/7540] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:40 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:41.203300 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3fd2c175-3ad9-40bf-906b-5ccc4700d6ec tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:41.203896 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3fd2c175-3ad9-40bf-906b-5ccc4700d6ec tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:41.210458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fd2c175-3ad9-40bf-906b-5ccc4700d6ec tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:41.210926 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fd2c175-3ad9-40bf-906b-5ccc4700d6ec tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:41.211384 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fd2c175-3ad9-40bf-906b-5ccc4700d6ec tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:41.212086 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fd2c175-3ad9-40bf-906b-5ccc4700d6ec tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:41.212524 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fd2c175-3ad9-40bf-906b-5ccc4700d6ec tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:41.212947 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fd2c175-3ad9-40bf-906b-5ccc4700d6ec tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:41.345483 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3fd2c175-3ad9-40bf-906b-5ccc4700d6ec tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:41.353522 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3fd2c175-3ad9-40bf-906b-5ccc4700d6ec tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1260 microversion: 2.1 time: 0.154557 Aug 24 11:34:41.354109 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3588/7541] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:41 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:42.378181 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0a593693-e433-4d20-bca8-2aad48dee5ed tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:42.379359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0a593693-e433-4d20-bca8-2aad48dee5ed tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:42.382891 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:42.388637 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a593693-e433-4d20-bca8-2aad48dee5ed tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:42.389159 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a593693-e433-4d20-bca8-2aad48dee5ed tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:42.389602 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a593693-e433-4d20-bca8-2aad48dee5ed tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:42.390308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a593693-e433-4d20-bca8-2aad48dee5ed tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:42.390781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a593693-e433-4d20-bca8-2aad48dee5ed tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:42.391219 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a593693-e433-4d20-bca8-2aad48dee5ed tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:42.533210 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0a593693-e433-4d20-bca8-2aad48dee5ed tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:42.542037 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0a593693-e433-4d20-bca8-2aad48dee5ed tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1260 microversion: 2.1 time: 0.169949 Aug 24 11:34:42.542675 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3954/7542] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:42 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:43.567194 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7998e7ae-b938-4b34-a244-8e80bcd14f1b tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:43.568248 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7998e7ae-b938-4b34-a244-8e80bcd14f1b tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:43.571475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:43.572563 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:43.584366 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7998e7ae-b938-4b34-a244-8e80bcd14f1b tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:43.585239 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7998e7ae-b938-4b34-a244-8e80bcd14f1b tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:43.585701 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7998e7ae-b938-4b34-a244-8e80bcd14f1b tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:43.586397 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7998e7ae-b938-4b34-a244-8e80bcd14f1b tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:43.586848 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7998e7ae-b938-4b34-a244-8e80bcd14f1b tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:43.587293 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7998e7ae-b938-4b34-a244-8e80bcd14f1b tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:43.745919 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7998e7ae-b938-4b34-a244-8e80bcd14f1b tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:43.754427 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7998e7ae-b938-4b34-a244-8e80bcd14f1b tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1260 microversion: 2.1 time: 0.193783 Aug 24 11:34:43.755036 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3589/7543] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:43 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:44.776464 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-08926b66-53fa-4cc1-a749-64861be98baf tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:44.777029 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-08926b66-53fa-4cc1-a749-64861be98baf tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:44.784571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08926b66-53fa-4cc1-a749-64861be98baf tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:44.785053 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08926b66-53fa-4cc1-a749-64861be98baf tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:44.785544 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08926b66-53fa-4cc1-a749-64861be98baf tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:44.786263 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08926b66-53fa-4cc1-a749-64861be98baf tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:44.786744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08926b66-53fa-4cc1-a749-64861be98baf tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:44.787191 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08926b66-53fa-4cc1-a749-64861be98baf tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:44.927028 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-08926b66-53fa-4cc1-a749-64861be98baf tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:44.935893 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-08926b66-53fa-4cc1-a749-64861be98baf tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1260 microversion: 2.1 time: 0.163613 Aug 24 11:34:44.936580 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3955/7544] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:44 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:45.958111 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8298c0ad-9cd1-4c04-b850-8b2867e94668 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:45.958700 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8298c0ad-9cd1-4c04-b850-8b2867e94668 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:45.967191 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8298c0ad-9cd1-4c04-b850-8b2867e94668 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:45.967651 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8298c0ad-9cd1-4c04-b850-8b2867e94668 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:45.968092 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8298c0ad-9cd1-4c04-b850-8b2867e94668 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:45.968789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8298c0ad-9cd1-4c04-b850-8b2867e94668 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:45.969442 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8298c0ad-9cd1-4c04-b850-8b2867e94668 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:45.970075 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8298c0ad-9cd1-4c04-b850-8b2867e94668 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:46.103792 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8298c0ad-9cd1-4c04-b850-8b2867e94668 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:46.112000 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8298c0ad-9cd1-4c04-b850-8b2867e94668 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1260 microversion: 2.1 time: 0.158497 Aug 24 11:34:46.112570 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3590/7545] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:45 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:47.138359 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b3bdbce3-1722-43dd-a1b3-480f70e3accc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:47.139323 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b3bdbce3-1722-43dd-a1b3-480f70e3accc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:47.149902 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3bdbce3-1722-43dd-a1b3-480f70e3accc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:47.150417 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3bdbce3-1722-43dd-a1b3-480f70e3accc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:47.150869 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3bdbce3-1722-43dd-a1b3-480f70e3accc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:47.151583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3bdbce3-1722-43dd-a1b3-480f70e3accc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:47.152061 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3bdbce3-1722-43dd-a1b3-480f70e3accc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:47.152503 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3bdbce3-1722-43dd-a1b3-480f70e3accc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:47.295748 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b3bdbce3-1722-43dd-a1b3-480f70e3accc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:47.304310 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b3bdbce3-1722-43dd-a1b3-480f70e3accc tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1260 microversion: 2.1 time: 0.172721 Aug 24 11:34:47.304932 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3956/7546] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:47 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:47.964156 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-35974c8e-3cd1-46aa-9fd4-59191458c7a5 req-77c3f2bd-c51d-460f-a7ee-b15e74b04fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "225f56de-327c-438d-a2a4-685ab32c626f", "name": "network-vif-plugged", "status": "completed", "tag": "0d0f785c-dcc6-47c9-9441-07f633085207"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:47.974369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-35974c8e-3cd1-46aa-9fd4-59191458c7a5 req-77c3f2bd-c51d-460f-a7ee-b15e74b04fc2 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:47.974881 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-35974c8e-3cd1-46aa-9fd4-59191458c7a5 req-77c3f2bd-c51d-460f-a7ee-b15e74b04fc2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:47.975314 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-35974c8e-3cd1-46aa-9fd4-59191458c7a5 req-77c3f2bd-c51d-460f-a7ee-b15e74b04fc2 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:47.987054 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-35974c8e-3cd1-46aa-9fd4-59191458c7a5 req-77c3f2bd-c51d-460f-a7ee-b15e74b04fc2 service nova] Creating event network-vif-plugged:0d0f785c-dcc6-47c9-9441-07f633085207 for instance 225f56de-327c-438d-a2a4-685ab32c626f on n-h1-849328-3 Aug 24 11:34:47.992058 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-35974c8e-3cd1-46aa-9fd4-59191458c7a5 req-77c3f2bd-c51d-460f-a7ee-b15e74b04fc2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095748 Aug 24 11:34:47.992650 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3591/7547] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:48.336554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aa5bbe49-4513-4a7f-b73c-86ed9faa909f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:48.337721 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aa5bbe49-4513-4a7f-b73c-86ed9faa909f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:48.349349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa5bbe49-4513-4a7f-b73c-86ed9faa909f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:48.350215 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa5bbe49-4513-4a7f-b73c-86ed9faa909f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:48.350966 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa5bbe49-4513-4a7f-b73c-86ed9faa909f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:48.351674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa5bbe49-4513-4a7f-b73c-86ed9faa909f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:48.352144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa5bbe49-4513-4a7f-b73c-86ed9faa909f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:48.352583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa5bbe49-4513-4a7f-b73c-86ed9faa909f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:48.491554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aa5bbe49-4513-4a7f-b73c-86ed9faa909f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:48.500153 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aa5bbe49-4513-4a7f-b73c-86ed9faa909f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1260 microversion: 2.1 time: 0.170148 Aug 24 11:34:48.500745 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3957/7548] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:48 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:49.525989 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92a8fdaf-37b5-480f-9e03-5de9055556e3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:49.526681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-92a8fdaf-37b5-480f-9e03-5de9055556e3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:49.533573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92a8fdaf-37b5-480f-9e03-5de9055556e3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:49.534062 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92a8fdaf-37b5-480f-9e03-5de9055556e3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:49.534536 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92a8fdaf-37b5-480f-9e03-5de9055556e3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:49.535234 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92a8fdaf-37b5-480f-9e03-5de9055556e3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:49.535737 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92a8fdaf-37b5-480f-9e03-5de9055556e3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:49.536168 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92a8fdaf-37b5-480f-9e03-5de9055556e3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:49.678586 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-92a8fdaf-37b5-480f-9e03-5de9055556e3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:49.687924 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-92a8fdaf-37b5-480f-9e03-5de9055556e3 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1445 microversion: 2.1 time: 0.168718 Aug 24 11:34:49.688498 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3592/7549] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:49 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1445 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:49.708321 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7410967e-641d-48f5-8e41-37ed67c35c76 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:49.708920 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7410967e-641d-48f5-8e41-37ed67c35c76 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:49.716252 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7410967e-641d-48f5-8e41-37ed67c35c76 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:49.716757 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7410967e-641d-48f5-8e41-37ed67c35c76 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:49.717262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7410967e-641d-48f5-8e41-37ed67c35c76 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:49.717975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7410967e-641d-48f5-8e41-37ed67c35c76 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:49.718455 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7410967e-641d-48f5-8e41-37ed67c35c76 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:49.718923 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7410967e-641d-48f5-8e41-37ed67c35c76 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:49.865333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7410967e-641d-48f5-8e41-37ed67c35c76 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:49.878035 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7410967e-641d-48f5-8e41-37ed67c35c76 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1445 microversion: 2.1 time: 0.172947 Aug 24 11:34:49.878874 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3958/7550] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:49 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1445 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:51.807263 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-4e3b0edd-829b-437e-b340-ccb4a9d95faf req-fe00c7d0-9a7f-4a08-a9e2-3175a26431f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "225f56de-327c-438d-a2a4-685ab32c626f", "tag": "0d0f785c-dcc6-47c9-9441-07f633085207"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:51.819468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4e3b0edd-829b-437e-b340-ccb4a9d95faf req-fe00c7d0-9a7f-4a08-a9e2-3175a26431f1 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:51.820046 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4e3b0edd-829b-437e-b340-ccb4a9d95faf req-fe00c7d0-9a7f-4a08-a9e2-3175a26431f1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:51.820547 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4e3b0edd-829b-437e-b340-ccb4a9d95faf req-fe00c7d0-9a7f-4a08-a9e2-3175a26431f1 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:51.832717 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-4e3b0edd-829b-437e-b340-ccb4a9d95faf req-fe00c7d0-9a7f-4a08-a9e2-3175a26431f1 service nova] Creating event network-changed:0d0f785c-dcc6-47c9-9441-07f633085207 for instance 225f56de-327c-438d-a2a4-685ab32c626f on n-h1-849328-3 Aug 24 11:34:51.838405 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-4e3b0edd-829b-437e-b340-ccb4a9d95faf req-fe00c7d0-9a7f-4a08-a9e2-3175a26431f1 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035012 Aug 24 11:34:51.839431 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3593/7551] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:36:27.372841 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:36:27.373616 n-d-849328-3 devstack@n-api.service[122433]: Wed Aug 24 11:36:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:36:40.385170 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:36:40.385932 n-d-849328-3 devstack@n-api.service[122432]: Wed Aug 24 11:36:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:36:48.001641 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=22 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:48.002599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=54 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:48.060331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-38c7357b-3031-46b7-90cc-d8eb4eb05dc2 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:36:48.060892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-38c7357b-3031-46b7-90cc-d8eb4eb05dc2 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:48.067526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38c7357b-3031-46b7-90cc-d8eb4eb05dc2 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:48.068032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38c7357b-3031-46b7-90cc-d8eb4eb05dc2 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:48.068490 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38c7357b-3031-46b7-90cc-d8eb4eb05dc2 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:48.069314 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38c7357b-3031-46b7-90cc-d8eb4eb05dc2 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:48.069788 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38c7357b-3031-46b7-90cc-d8eb4eb05dc2 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:48.070230 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38c7357b-3031-46b7-90cc-d8eb4eb05dc2 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:48.093317 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-38c7357b-3031-46b7-90cc-d8eb4eb05dc2 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lazy-loading 'flavor' on Instance uuid 225f56de-327c-438d-a2a4-685ab32c626f {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:36:48.174137 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-38c7357b-3031-46b7-90cc-d8eb4eb05dc2 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "POST /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f/action" status: 202 len: 0 microversion: 2.1 time: 0.174959 Aug 24 11:36:48.174732 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3959/7552] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:36:47 2022] POST /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:36:48.182936 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:48.183695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=50 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:48.188067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f98dc2f5-fb69-4bdf-916e-dcfefc373403 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:48.188791 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f98dc2f5-fb69-4bdf-916e-dcfefc373403 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:48.196190 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f98dc2f5-fb69-4bdf-916e-dcfefc373403 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:48.196751 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f98dc2f5-fb69-4bdf-916e-dcfefc373403 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:48.197296 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f98dc2f5-fb69-4bdf-916e-dcfefc373403 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:48.197988 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f98dc2f5-fb69-4bdf-916e-dcfefc373403 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:48.198431 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f98dc2f5-fb69-4bdf-916e-dcfefc373403 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:48.198854 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f98dc2f5-fb69-4bdf-916e-dcfefc373403 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:48.406513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f98dc2f5-fb69-4bdf-916e-dcfefc373403 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:48.414793 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f98dc2f5-fb69-4bdf-916e-dcfefc373403 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1570 microversion: 2.1 time: 0.234135 Aug 24 11:36:48.415416 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3594/7553] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:48 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1570 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:49.443144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3d70e71-2a65-4a77-8438-a16869b64f94 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:49.444327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d3d70e71-2a65-4a77-8438-a16869b64f94 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:49.455115 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3d70e71-2a65-4a77-8438-a16869b64f94 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:49.455947 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3d70e71-2a65-4a77-8438-a16869b64f94 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:49.456701 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3d70e71-2a65-4a77-8438-a16869b64f94 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:49.457922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3d70e71-2a65-4a77-8438-a16869b64f94 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:49.458715 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3d70e71-2a65-4a77-8438-a16869b64f94 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:49.459444 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3d70e71-2a65-4a77-8438-a16869b64f94 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:49.649443 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d3d70e71-2a65-4a77-8438-a16869b64f94 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:49.657912 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d3d70e71-2a65-4a77-8438-a16869b64f94 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1570 microversion: 2.1 time: 0.223711 Aug 24 11:36:49.658509 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3960/7554] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:49 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1570 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:50.683572 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a47c13f5-9674-4558-be51-c86f42760d5e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:50.684634 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a47c13f5-9674-4558-be51-c86f42760d5e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:50.696745 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a47c13f5-9674-4558-be51-c86f42760d5e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:50.697665 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a47c13f5-9674-4558-be51-c86f42760d5e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:50.698099 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a47c13f5-9674-4558-be51-c86f42760d5e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:50.698799 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a47c13f5-9674-4558-be51-c86f42760d5e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:50.699252 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a47c13f5-9674-4558-be51-c86f42760d5e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:50.699675 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a47c13f5-9674-4558-be51-c86f42760d5e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:50.833063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a47c13f5-9674-4558-be51-c86f42760d5e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:50.842929 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a47c13f5-9674-4558-be51-c86f42760d5e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1570 microversion: 2.1 time: 0.166036 Aug 24 11:36:50.843518 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3595/7555] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:50 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:51.864749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0b691bbe-01ff-49dc-ac7b-00463003e170 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:51.865362 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0b691bbe-01ff-49dc-ac7b-00463003e170 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:51.872927 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b691bbe-01ff-49dc-ac7b-00463003e170 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:51.873457 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b691bbe-01ff-49dc-ac7b-00463003e170 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:51.873911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b691bbe-01ff-49dc-ac7b-00463003e170 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:51.874624 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b691bbe-01ff-49dc-ac7b-00463003e170 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:51.875093 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b691bbe-01ff-49dc-ac7b-00463003e170 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:51.875534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b691bbe-01ff-49dc-ac7b-00463003e170 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:52.010496 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0b691bbe-01ff-49dc-ac7b-00463003e170 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:52.019164 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0b691bbe-01ff-49dc-ac7b-00463003e170 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1570 microversion: 2.1 time: 0.158544 Aug 24 11:36:52.019750 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3961/7556] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:51 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:53.043699 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7aa014e6-d9db-432f-9dc8-7d7728e7468d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:53.044422 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7aa014e6-d9db-432f-9dc8-7d7728e7468d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:53.053365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7aa014e6-d9db-432f-9dc8-7d7728e7468d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:53.053975 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7aa014e6-d9db-432f-9dc8-7d7728e7468d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:53.054517 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7aa014e6-d9db-432f-9dc8-7d7728e7468d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:53.055382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7aa014e6-d9db-432f-9dc8-7d7728e7468d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:53.055949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7aa014e6-d9db-432f-9dc8-7d7728e7468d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:53.056479 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7aa014e6-d9db-432f-9dc8-7d7728e7468d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:53.211802 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7aa014e6-d9db-432f-9dc8-7d7728e7468d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:53.220313 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7aa014e6-d9db-432f-9dc8-7d7728e7468d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1570 microversion: 2.1 time: 0.182567 Aug 24 11:36:53.220891 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3596/7557] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:53 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1570 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:54.251805 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-429b1a2a-75e5-47f2-ba06-a2f9f1df65b7 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:54.252409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-429b1a2a-75e5-47f2-ba06-a2f9f1df65b7 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:54.262430 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-429b1a2a-75e5-47f2-ba06-a2f9f1df65b7 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:54.262933 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-429b1a2a-75e5-47f2-ba06-a2f9f1df65b7 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:54.263386 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-429b1a2a-75e5-47f2-ba06-a2f9f1df65b7 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:54.264094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-429b1a2a-75e5-47f2-ba06-a2f9f1df65b7 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:54.264566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-429b1a2a-75e5-47f2-ba06-a2f9f1df65b7 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:54.265007 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-429b1a2a-75e5-47f2-ba06-a2f9f1df65b7 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:54.417075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-429b1a2a-75e5-47f2-ba06-a2f9f1df65b7 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:54.425862 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-429b1a2a-75e5-47f2-ba06-a2f9f1df65b7 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1570 microversion: 2.1 time: 0.180883 Aug 24 11:36:54.426455 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3962/7558] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:54 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1570 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:55.448899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-87e6c103-c42d-4a1a-bb92-6149f35f3f8f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:55.449738 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-87e6c103-c42d-4a1a-bb92-6149f35f3f8f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:55.458639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87e6c103-c42d-4a1a-bb92-6149f35f3f8f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:55.459219 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87e6c103-c42d-4a1a-bb92-6149f35f3f8f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:55.459804 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87e6c103-c42d-4a1a-bb92-6149f35f3f8f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:55.460626 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87e6c103-c42d-4a1a-bb92-6149f35f3f8f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:55.461161 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87e6c103-c42d-4a1a-bb92-6149f35f3f8f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:55.461702 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87e6c103-c42d-4a1a-bb92-6149f35f3f8f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:55.617329 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-87e6c103-c42d-4a1a-bb92-6149f35f3f8f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:55.625628 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-87e6c103-c42d-4a1a-bb92-6149f35f3f8f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1570 microversion: 2.1 time: 0.181511 Aug 24 11:36:55.626187 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3597/7559] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:55 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1570 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:56.655197 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-48d1aa7d-85e4-44ed-b04a-0ca92b0b0dd1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:56.656233 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-48d1aa7d-85e4-44ed-b04a-0ca92b0b0dd1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:56.667982 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48d1aa7d-85e4-44ed-b04a-0ca92b0b0dd1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:56.668563 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48d1aa7d-85e4-44ed-b04a-0ca92b0b0dd1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:56.669015 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48d1aa7d-85e4-44ed-b04a-0ca92b0b0dd1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:56.669836 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48d1aa7d-85e4-44ed-b04a-0ca92b0b0dd1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:56.670305 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48d1aa7d-85e4-44ed-b04a-0ca92b0b0dd1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:56.670751 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48d1aa7d-85e4-44ed-b04a-0ca92b0b0dd1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:56.820689 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-48d1aa7d-85e4-44ed-b04a-0ca92b0b0dd1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:56.833439 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-48d1aa7d-85e4-44ed-b04a-0ca92b0b0dd1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1570 microversion: 2.1 time: 0.184350 Aug 24 11:36:56.834215 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3963/7560] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:56 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1570 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:57.857146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5886fcc4-0dc6-4c1c-bdaf-e8541b83f21e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:57.857789 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5886fcc4-0dc6-4c1c-bdaf-e8541b83f21e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:57.867225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5886fcc4-0dc6-4c1c-bdaf-e8541b83f21e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:57.868046 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5886fcc4-0dc6-4c1c-bdaf-e8541b83f21e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:57.868776 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5886fcc4-0dc6-4c1c-bdaf-e8541b83f21e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:57.869929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5886fcc4-0dc6-4c1c-bdaf-e8541b83f21e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:57.870853 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5886fcc4-0dc6-4c1c-bdaf-e8541b83f21e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:57.871308 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5886fcc4-0dc6-4c1c-bdaf-e8541b83f21e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:58.021507 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5886fcc4-0dc6-4c1c-bdaf-e8541b83f21e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:58.031821 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5886fcc4-0dc6-4c1c-bdaf-e8541b83f21e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1570 microversion: 2.1 time: 0.178739 Aug 24 11:36:58.032408 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3598/7561] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:57 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1570 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:59.055940 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3c8df1df-b2af-46c4-95b9-a1e312aa153e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:59.056557 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3c8df1df-b2af-46c4-95b9-a1e312aa153e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:59.064610 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c8df1df-b2af-46c4-95b9-a1e312aa153e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:59.065114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c8df1df-b2af-46c4-95b9-a1e312aa153e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:59.065594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c8df1df-b2af-46c4-95b9-a1e312aa153e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:59.066307 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c8df1df-b2af-46c4-95b9-a1e312aa153e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:59.066777 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c8df1df-b2af-46c4-95b9-a1e312aa153e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:59.067214 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c8df1df-b2af-46c4-95b9-a1e312aa153e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:59.223710 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3c8df1df-b2af-46c4-95b9-a1e312aa153e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:59.235152 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3c8df1df-b2af-46c4-95b9-a1e312aa153e tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1570 microversion: 2.1 time: 0.185388 Aug 24 11:36:59.235832 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3964/7562] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:59 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1570 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:00.263207 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-400316dc-5c4c-44e0-990e-5c464e6f6290 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:00.263849 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-400316dc-5c4c-44e0-990e-5c464e6f6290 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:00.271315 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-400316dc-5c4c-44e0-990e-5c464e6f6290 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:00.271813 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-400316dc-5c4c-44e0-990e-5c464e6f6290 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:00.272259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-400316dc-5c4c-44e0-990e-5c464e6f6290 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:00.272961 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-400316dc-5c4c-44e0-990e-5c464e6f6290 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:00.273449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-400316dc-5c4c-44e0-990e-5c464e6f6290 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:00.273885 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-400316dc-5c4c-44e0-990e-5c464e6f6290 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:00.425910 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-400316dc-5c4c-44e0-990e-5c464e6f6290 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:00.436595 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-400316dc-5c4c-44e0-990e-5c464e6f6290 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1570 microversion: 2.1 time: 0.179564 Aug 24 11:37:00.437203 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3599/7563] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:00 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1570 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:01.462368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fd2841a0-41fb-432b-b907-b909b87a9b6a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:01.462955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fd2841a0-41fb-432b-b907-b909b87a9b6a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:01.470555 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd2841a0-41fb-432b-b907-b909b87a9b6a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:01.471034 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd2841a0-41fb-432b-b907-b909b87a9b6a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:01.471509 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd2841a0-41fb-432b-b907-b909b87a9b6a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:01.472230 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd2841a0-41fb-432b-b907-b909b87a9b6a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:01.472694 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd2841a0-41fb-432b-b907-b909b87a9b6a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:01.473149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd2841a0-41fb-432b-b907-b909b87a9b6a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:01.608859 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fd2841a0-41fb-432b-b907-b909b87a9b6a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:01.617318 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fd2841a0-41fb-432b-b907-b909b87a9b6a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1570 microversion: 2.1 time: 0.158957 Aug 24 11:37:01.617919 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3965/7564] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:01 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:02.641290 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-96ca071a-9fb7-48d5-bacd-24d30f154f17 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:02.641913 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-96ca071a-9fb7-48d5-bacd-24d30f154f17 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:02.649698 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96ca071a-9fb7-48d5-bacd-24d30f154f17 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:02.650184 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96ca071a-9fb7-48d5-bacd-24d30f154f17 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:02.650613 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96ca071a-9fb7-48d5-bacd-24d30f154f17 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:02.651298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96ca071a-9fb7-48d5-bacd-24d30f154f17 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:02.651747 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96ca071a-9fb7-48d5-bacd-24d30f154f17 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:02.652166 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96ca071a-9fb7-48d5-bacd-24d30f154f17 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:02.813337 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-96ca071a-9fb7-48d5-bacd-24d30f154f17 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:02.821914 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-96ca071a-9fb7-48d5-bacd-24d30f154f17 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1571 microversion: 2.1 time: 0.185568 Aug 24 11:37:02.822843 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3600/7565] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:02 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1571 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:02.845812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c90a8e62-3bf7-4d3d-b39d-ba698ded6a3a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:02.846451 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c90a8e62-3bf7-4d3d-b39d-ba698ded6a3a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:02.856776 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c90a8e62-3bf7-4d3d-b39d-ba698ded6a3a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:02.857308 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c90a8e62-3bf7-4d3d-b39d-ba698ded6a3a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:02.857850 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c90a8e62-3bf7-4d3d-b39d-ba698ded6a3a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:02.858617 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c90a8e62-3bf7-4d3d-b39d-ba698ded6a3a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:02.859090 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c90a8e62-3bf7-4d3d-b39d-ba698ded6a3a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:02.859552 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c90a8e62-3bf7-4d3d-b39d-ba698ded6a3a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:02.895429 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c90a8e62-3bf7-4d3d-b39d-ba698ded6a3a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122433) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 11:37:02.971425 n-d-849328-3 devstack@n-api.service[122433]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c90a8e62-3bf7-4d3d-b39d-ba698ded6a3a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [4a8aa9be-e4e1-482d-abcb-73a80a47b19f] AMQP server on 10.222.0.85:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 11:37:03.984304 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [None req-c90a8e62-3bf7-4d3d-b39d-ba698ded6a3a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [4a8aa9be-e4e1-482d-abcb-73a80a47b19f] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 58368. Aug 24 11:37:03.988830 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c90a8e62-3bf7-4d3d-b39d-ba698ded6a3a tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "POST /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f/action" status: 202 len: 0 microversion: 2.1 time: 1.148286 Aug 24 11:37:03.989517 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3966/7566] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:37:02 2022] POST /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f/action => generated 0 bytes in 1150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:37:04.000258 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f8d1c709-67ee-4321-805c-d86fa04794f1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:04.000649 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f8d1c709-67ee-4321-805c-d86fa04794f1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:04.007366 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8d1c709-67ee-4321-805c-d86fa04794f1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:04.007850 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8d1c709-67ee-4321-805c-d86fa04794f1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:04.008638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8d1c709-67ee-4321-805c-d86fa04794f1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:04.009453 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8d1c709-67ee-4321-805c-d86fa04794f1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:04.010065 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8d1c709-67ee-4321-805c-d86fa04794f1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:04.010452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8d1c709-67ee-4321-805c-d86fa04794f1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:04.145143 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f8d1c709-67ee-4321-805c-d86fa04794f1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:04.156774 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f8d1c709-67ee-4321-805c-d86fa04794f1 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1519 microversion: 2.1 time: 0.162651 Aug 24 11:37:04.157398 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3601/7567] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:03 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:04.651818 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0faa869d-5943-4ab3-9c80-00c7c618cca3 req-57239e83-3af0-4b1b-930d-4bb1615f5228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "225f56de-327c-438d-a2a4-685ab32c626f", "name": "network-vif-unplugged", "status": "completed", "tag": "0d0f785c-dcc6-47c9-9441-07f633085207"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:04.662892 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0faa869d-5943-4ab3-9c80-00c7c618cca3 req-57239e83-3af0-4b1b-930d-4bb1615f5228 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:04.663396 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0faa869d-5943-4ab3-9c80-00c7c618cca3 req-57239e83-3af0-4b1b-930d-4bb1615f5228 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:04.663845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0faa869d-5943-4ab3-9c80-00c7c618cca3 req-57239e83-3af0-4b1b-930d-4bb1615f5228 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:04.675501 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.compute.server_external_events [req-0faa869d-5943-4ab3-9c80-00c7c618cca3 req-57239e83-3af0-4b1b-930d-4bb1615f5228 service nova] Unable to find a host for instance 225f56de-327c-438d-a2a4-685ab32c626f. Dropping event network-vif-unplugged {{(pid=122433) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 11:37:04.676428 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0faa869d-5943-4ab3-9c80-00c7c618cca3 req-57239e83-3af0-4b1b-930d-4bb1615f5228 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028900 Aug 24 11:37:04.677044 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3967/7568] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 11:37:05.185364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1380d849-9c7d-47e3-b061-586f4560e1b5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:05.186020 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1380d849-9c7d-47e3-b061-586f4560e1b5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:05.193233 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1380d849-9c7d-47e3-b061-586f4560e1b5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:05.193694 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1380d849-9c7d-47e3-b061-586f4560e1b5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:05.194132 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1380d849-9c7d-47e3-b061-586f4560e1b5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:05.194859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1380d849-9c7d-47e3-b061-586f4560e1b5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:05.195298 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1380d849-9c7d-47e3-b061-586f4560e1b5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:05.195728 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1380d849-9c7d-47e3-b061-586f4560e1b5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:05.344800 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1380d849-9c7d-47e3-b061-586f4560e1b5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:05.356626 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1380d849-9c7d-47e3-b061-586f4560e1b5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1519 microversion: 2.1 time: 0.175470 Aug 24 11:37:05.357436 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3602/7569] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:05 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:06.378726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6400ff9c-d4b0-48b6-a795-9a1cb5184ec4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:06.379350 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6400ff9c-d4b0-48b6-a795-9a1cb5184ec4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:06.386986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6400ff9c-d4b0-48b6-a795-9a1cb5184ec4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:06.387620 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6400ff9c-d4b0-48b6-a795-9a1cb5184ec4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:06.387945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6400ff9c-d4b0-48b6-a795-9a1cb5184ec4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:06.388727 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6400ff9c-d4b0-48b6-a795-9a1cb5184ec4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:06.389153 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6400ff9c-d4b0-48b6-a795-9a1cb5184ec4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:06.389559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6400ff9c-d4b0-48b6-a795-9a1cb5184ec4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:06.527349 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6400ff9c-d4b0-48b6-a795-9a1cb5184ec4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:06.537376 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6400ff9c-d4b0-48b6-a795-9a1cb5184ec4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1519 microversion: 2.1 time: 0.162811 Aug 24 11:37:06.537971 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3968/7570] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:06 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:07.565087 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-afcdebe9-5e83-4f33-a07f-a75be18cb528 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:07.565727 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-afcdebe9-5e83-4f33-a07f-a75be18cb528 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:07.573440 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afcdebe9-5e83-4f33-a07f-a75be18cb528 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:07.573940 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afcdebe9-5e83-4f33-a07f-a75be18cb528 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:07.574385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afcdebe9-5e83-4f33-a07f-a75be18cb528 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:07.575100 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afcdebe9-5e83-4f33-a07f-a75be18cb528 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:07.575540 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afcdebe9-5e83-4f33-a07f-a75be18cb528 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:07.575998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afcdebe9-5e83-4f33-a07f-a75be18cb528 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:07.722448 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-afcdebe9-5e83-4f33-a07f-a75be18cb528 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:07.731074 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-afcdebe9-5e83-4f33-a07f-a75be18cb528 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1519 microversion: 2.1 time: 0.169931 Aug 24 11:37:07.731676 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3603/7571] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:07 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:08.755963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f66e02c-c564-4b2a-a5e5-9c0e140b7788 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:08.756961 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0f66e02c-c564-4b2a-a5e5-9c0e140b7788 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:08.767960 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f66e02c-c564-4b2a-a5e5-9c0e140b7788 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:08.769829 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f66e02c-c564-4b2a-a5e5-9c0e140b7788 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:08.770576 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f66e02c-c564-4b2a-a5e5-9c0e140b7788 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:08.771626 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f66e02c-c564-4b2a-a5e5-9c0e140b7788 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:08.772280 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f66e02c-c564-4b2a-a5e5-9c0e140b7788 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:08.772857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f66e02c-c564-4b2a-a5e5-9c0e140b7788 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:08.911901 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0f66e02c-c564-4b2a-a5e5-9c0e140b7788 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:08.920403 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0f66e02c-c564-4b2a-a5e5-9c0e140b7788 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1521 microversion: 2.1 time: 0.170946 Aug 24 11:37:08.921022 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3969/7572] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:08 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:09.947928 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0b845d1c-60c3-40b1-b83a-ea4032b52064 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:09.948557 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0b845d1c-60c3-40b1-b83a-ea4032b52064 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:09.955339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b845d1c-60c3-40b1-b83a-ea4032b52064 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:09.955827 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b845d1c-60c3-40b1-b83a-ea4032b52064 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:09.956264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b845d1c-60c3-40b1-b83a-ea4032b52064 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:09.957136 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b845d1c-60c3-40b1-b83a-ea4032b52064 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:09.957609 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b845d1c-60c3-40b1-b83a-ea4032b52064 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:09.958032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b845d1c-60c3-40b1-b83a-ea4032b52064 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:10.092742 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0b845d1c-60c3-40b1-b83a-ea4032b52064 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:10.100776 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0b845d1c-60c3-40b1-b83a-ea4032b52064 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1521 microversion: 2.1 time: 0.157462 Aug 24 11:37:10.101463 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3604/7573] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:09 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:11.122583 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-01750204-8694-43cd-a599-70cb3c597846 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:11.123196 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-01750204-8694-43cd-a599-70cb3c597846 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:11.131060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01750204-8694-43cd-a599-70cb3c597846 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:11.131567 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01750204-8694-43cd-a599-70cb3c597846 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:11.132019 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01750204-8694-43cd-a599-70cb3c597846 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:11.132709 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01750204-8694-43cd-a599-70cb3c597846 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:11.133238 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01750204-8694-43cd-a599-70cb3c597846 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:11.134022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01750204-8694-43cd-a599-70cb3c597846 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:11.273487 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-01750204-8694-43cd-a599-70cb3c597846 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:11.281586 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-01750204-8694-43cd-a599-70cb3c597846 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1521 microversion: 2.1 time: 0.163002 Aug 24 11:37:11.282179 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3970/7574] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:11 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:12.302418 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6305a554-d499-4520-9e28-eb663a4e358c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:12.302994 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6305a554-d499-4520-9e28-eb663a4e358c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:12.310404 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6305a554-d499-4520-9e28-eb663a4e358c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:12.310902 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6305a554-d499-4520-9e28-eb663a4e358c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:12.311326 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6305a554-d499-4520-9e28-eb663a4e358c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:12.312038 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6305a554-d499-4520-9e28-eb663a4e358c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:12.312493 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6305a554-d499-4520-9e28-eb663a4e358c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:12.312922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6305a554-d499-4520-9e28-eb663a4e358c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:12.452051 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6305a554-d499-4520-9e28-eb663a4e358c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:12.460340 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6305a554-d499-4520-9e28-eb663a4e358c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1521 microversion: 2.1 time: 0.162017 Aug 24 11:37:12.461186 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3605/7575] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:12 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:13.483591 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9911ff4d-544f-4622-9043-2d0d6b7028a0 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:13.486373 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9911ff4d-544f-4622-9043-2d0d6b7028a0 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:13.497009 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9911ff4d-544f-4622-9043-2d0d6b7028a0 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:13.497590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9911ff4d-544f-4622-9043-2d0d6b7028a0 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:13.498398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9911ff4d-544f-4622-9043-2d0d6b7028a0 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:13.499922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9911ff4d-544f-4622-9043-2d0d6b7028a0 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:13.500032 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9911ff4d-544f-4622-9043-2d0d6b7028a0 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:13.500535 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9911ff4d-544f-4622-9043-2d0d6b7028a0 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:13.651741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9911ff4d-544f-4622-9043-2d0d6b7028a0 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:13.659910 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9911ff4d-544f-4622-9043-2d0d6b7028a0 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1521 microversion: 2.1 time: 0.181581 Aug 24 11:37:13.660534 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3971/7576] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:13 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:14.681793 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9f714789-8853-4546-842c-50f54be3fc2c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:14.682610 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9f714789-8853-4546-842c-50f54be3fc2c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:14.690159 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f714789-8853-4546-842c-50f54be3fc2c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:14.690636 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f714789-8853-4546-842c-50f54be3fc2c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:14.691067 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f714789-8853-4546-842c-50f54be3fc2c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:14.691775 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f714789-8853-4546-842c-50f54be3fc2c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:14.692232 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f714789-8853-4546-842c-50f54be3fc2c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:14.692653 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f714789-8853-4546-842c-50f54be3fc2c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:14.910114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9f714789-8853-4546-842c-50f54be3fc2c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:14.919535 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9f714789-8853-4546-842c-50f54be3fc2c tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1577 microversion: 2.1 time: 0.241915 Aug 24 11:37:14.925638 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3606/7577] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:14 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1577 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:15.946288 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b0f796c8-a5ab-4996-9ab2-49f6b70f77ce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:15.946922 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b0f796c8-a5ab-4996-9ab2-49f6b70f77ce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:15.954506 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0f796c8-a5ab-4996-9ab2-49f6b70f77ce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:15.954955 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0f796c8-a5ab-4996-9ab2-49f6b70f77ce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:15.955409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0f796c8-a5ab-4996-9ab2-49f6b70f77ce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:15.956119 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0f796c8-a5ab-4996-9ab2-49f6b70f77ce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:15.956589 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0f796c8-a5ab-4996-9ab2-49f6b70f77ce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:15.957027 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0f796c8-a5ab-4996-9ab2-49f6b70f77ce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:16.106643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b0f796c8-a5ab-4996-9ab2-49f6b70f77ce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:16.115067 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b0f796c8-a5ab-4996-9ab2-49f6b70f77ce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1577 microversion: 2.1 time: 0.172779 Aug 24 11:37:16.115648 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3972/7578] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:15 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:17.140551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f90563bb-4724-4062-9a84-6ea0d9c5eff0 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:17.141530 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f90563bb-4724-4062-9a84-6ea0d9c5eff0 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:17.153004 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f90563bb-4724-4062-9a84-6ea0d9c5eff0 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:17.153861 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f90563bb-4724-4062-9a84-6ea0d9c5eff0 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:17.154584 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f90563bb-4724-4062-9a84-6ea0d9c5eff0 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:17.155720 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f90563bb-4724-4062-9a84-6ea0d9c5eff0 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:17.156468 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f90563bb-4724-4062-9a84-6ea0d9c5eff0 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:17.157223 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f90563bb-4724-4062-9a84-6ea0d9c5eff0 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:17.294823 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f90563bb-4724-4062-9a84-6ea0d9c5eff0 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:17.303303 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f90563bb-4724-4062-9a84-6ea0d9c5eff0 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1577 microversion: 2.1 time: 0.169930 Aug 24 11:37:17.303888 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3607/7579] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:17 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:18.328769 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b356cb02-57cb-4dec-bb1c-99bbf90fd38f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:18.329899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b356cb02-57cb-4dec-bb1c-99bbf90fd38f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:18.333440 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:18.338967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b356cb02-57cb-4dec-bb1c-99bbf90fd38f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:18.339477 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b356cb02-57cb-4dec-bb1c-99bbf90fd38f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:18.339958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b356cb02-57cb-4dec-bb1c-99bbf90fd38f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:18.340674 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b356cb02-57cb-4dec-bb1c-99bbf90fd38f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:18.341144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b356cb02-57cb-4dec-bb1c-99bbf90fd38f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:18.341599 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b356cb02-57cb-4dec-bb1c-99bbf90fd38f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:18.345060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:18.482635 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b356cb02-57cb-4dec-bb1c-99bbf90fd38f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:18.495068 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b356cb02-57cb-4dec-bb1c-99bbf90fd38f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1577 microversion: 2.1 time: 0.172412 Aug 24 11:37:18.495634 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3973/7580] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:18 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:19.520526 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c09a3a22-34ac-4dda-83ac-77cecf2e3000 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:19.521146 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c09a3a22-34ac-4dda-83ac-77cecf2e3000 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:19.523899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=29 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:19.530030 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c09a3a22-34ac-4dda-83ac-77cecf2e3000 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:19.530494 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c09a3a22-34ac-4dda-83ac-77cecf2e3000 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:19.530929 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c09a3a22-34ac-4dda-83ac-77cecf2e3000 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:19.531622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c09a3a22-34ac-4dda-83ac-77cecf2e3000 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:19.532077 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c09a3a22-34ac-4dda-83ac-77cecf2e3000 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:19.532502 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c09a3a22-34ac-4dda-83ac-77cecf2e3000 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:19.535345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=85 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:19.683127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c09a3a22-34ac-4dda-83ac-77cecf2e3000 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:19.692924 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c09a3a22-34ac-4dda-83ac-77cecf2e3000 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1577 microversion: 2.1 time: 0.176400 Aug 24 11:37:19.693605 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3608/7581] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:19 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:20.714733 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c329f095-9917-40cb-90e6-1f2a082cb4bb tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:20.715365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c329f095-9917-40cb-90e6-1f2a082cb4bb tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:20.722750 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c329f095-9917-40cb-90e6-1f2a082cb4bb tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:20.723253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c329f095-9917-40cb-90e6-1f2a082cb4bb tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:20.723702 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c329f095-9917-40cb-90e6-1f2a082cb4bb tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:20.724411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c329f095-9917-40cb-90e6-1f2a082cb4bb tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:20.724877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c329f095-9917-40cb-90e6-1f2a082cb4bb tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:20.725356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c329f095-9917-40cb-90e6-1f2a082cb4bb tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:20.857497 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c329f095-9917-40cb-90e6-1f2a082cb4bb tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:20.865724 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c329f095-9917-40cb-90e6-1f2a082cb4bb tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1577 microversion: 2.1 time: 0.155114 Aug 24 11:37:20.866321 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3974/7582] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:20 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:21.891960 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0012b9fc-8974-42ef-b6f8-3366595721d8 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:21.892839 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0012b9fc-8974-42ef-b6f8-3366595721d8 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:21.904647 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0012b9fc-8974-42ef-b6f8-3366595721d8 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:21.905509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0012b9fc-8974-42ef-b6f8-3366595721d8 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:21.906228 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0012b9fc-8974-42ef-b6f8-3366595721d8 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:21.907383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0012b9fc-8974-42ef-b6f8-3366595721d8 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:21.908163 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0012b9fc-8974-42ef-b6f8-3366595721d8 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:21.908862 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0012b9fc-8974-42ef-b6f8-3366595721d8 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:22.054259 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0012b9fc-8974-42ef-b6f8-3366595721d8 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:22.062536 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0012b9fc-8974-42ef-b6f8-3366595721d8 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1577 microversion: 2.1 time: 0.177755 Aug 24 11:37:22.063098 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3609/7583] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:21 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:23.092311 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0da7ef38-12d0-4556-a7fc-c909af201217 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:23.092887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0da7ef38-12d0-4556-a7fc-c909af201217 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:23.100529 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0da7ef38-12d0-4556-a7fc-c909af201217 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:23.101037 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0da7ef38-12d0-4556-a7fc-c909af201217 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:23.101525 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0da7ef38-12d0-4556-a7fc-c909af201217 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:23.102243 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0da7ef38-12d0-4556-a7fc-c909af201217 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:23.102722 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0da7ef38-12d0-4556-a7fc-c909af201217 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:23.103165 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0da7ef38-12d0-4556-a7fc-c909af201217 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:23.247667 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0da7ef38-12d0-4556-a7fc-c909af201217 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:23.255975 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0da7ef38-12d0-4556-a7fc-c909af201217 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1577 microversion: 2.1 time: 0.167872 Aug 24 11:37:23.256594 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3975/7584] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:23 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:24.281351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-64205262-b7ff-49ad-aa94-29630ebc3cce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:24.282192 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-64205262-b7ff-49ad-aa94-29630ebc3cce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:24.293753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64205262-b7ff-49ad-aa94-29630ebc3cce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:24.294533 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64205262-b7ff-49ad-aa94-29630ebc3cce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:24.295225 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64205262-b7ff-49ad-aa94-29630ebc3cce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:24.296308 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64205262-b7ff-49ad-aa94-29630ebc3cce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:24.297019 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64205262-b7ff-49ad-aa94-29630ebc3cce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:24.297741 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64205262-b7ff-49ad-aa94-29630ebc3cce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:24.435130 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-64205262-b7ff-49ad-aa94-29630ebc3cce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:24.446899 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-64205262-b7ff-49ad-aa94-29630ebc3cce tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1577 microversion: 2.1 time: 0.171838 Aug 24 11:37:24.447692 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3610/7585] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:24 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:24.844413 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-d854e278-b074-4191-ba2b-24ebf058500e req-e8d2f919-ecc0-4117-8804-d82708f7d89c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "225f56de-327c-438d-a2a4-685ab32c626f", "name": "network-vif-plugged", "status": "completed", "tag": "0d0f785c-dcc6-47c9-9441-07f633085207"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:24.855695 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d854e278-b074-4191-ba2b-24ebf058500e req-e8d2f919-ecc0-4117-8804-d82708f7d89c service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:24.856094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d854e278-b074-4191-ba2b-24ebf058500e req-e8d2f919-ecc0-4117-8804-d82708f7d89c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:24.856542 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d854e278-b074-4191-ba2b-24ebf058500e req-e8d2f919-ecc0-4117-8804-d82708f7d89c service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:24.868054 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-d854e278-b074-4191-ba2b-24ebf058500e req-e8d2f919-ecc0-4117-8804-d82708f7d89c service nova] Creating event network-vif-plugged:0d0f785c-dcc6-47c9-9441-07f633085207 for instance 225f56de-327c-438d-a2a4-685ab32c626f on n-h1-849328-3 Aug 24 11:37:24.873338 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-d854e278-b074-4191-ba2b-24ebf058500e req-e8d2f919-ecc0-4117-8804-d82708f7d89c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032758 Aug 24 11:37:24.874035 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3976/7586] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:37:25.470546 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-96d3cb9d-4243-4e9f-a625-d546f34ed170 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:25.471333 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-96d3cb9d-4243-4e9f-a625-d546f34ed170 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:25.479585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96d3cb9d-4243-4e9f-a625-d546f34ed170 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:25.480068 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96d3cb9d-4243-4e9f-a625-d546f34ed170 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:25.480606 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96d3cb9d-4243-4e9f-a625-d546f34ed170 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:25.481365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96d3cb9d-4243-4e9f-a625-d546f34ed170 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:25.481815 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96d3cb9d-4243-4e9f-a625-d546f34ed170 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:25.482238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96d3cb9d-4243-4e9f-a625-d546f34ed170 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:25.620460 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-96d3cb9d-4243-4e9f-a625-d546f34ed170 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:25.629096 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-96d3cb9d-4243-4e9f-a625-d546f34ed170 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1577 microversion: 2.1 time: 0.163938 Aug 24 11:37:25.629721 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3611/7587] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:25 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:26.655647 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f96e4c01-6a46-444f-8b13-f5e9ca9a76d6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:26.656577 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f96e4c01-6a46-444f-8b13-f5e9ca9a76d6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:26.665414 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f96e4c01-6a46-444f-8b13-f5e9ca9a76d6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:26.666095 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f96e4c01-6a46-444f-8b13-f5e9ca9a76d6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:26.666862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f96e4c01-6a46-444f-8b13-f5e9ca9a76d6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:26.667814 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f96e4c01-6a46-444f-8b13-f5e9ca9a76d6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:26.668448 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f96e4c01-6a46-444f-8b13-f5e9ca9a76d6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:26.669044 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f96e4c01-6a46-444f-8b13-f5e9ca9a76d6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:26.808934 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f96e4c01-6a46-444f-8b13-f5e9ca9a76d6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:26.817107 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f96e4c01-6a46-444f-8b13-f5e9ca9a76d6 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1564 microversion: 2.1 time: 0.168561 Aug 24 11:37:26.817733 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3977/7588] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:26 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1564 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:53.487575 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:37:53.488269 n-d-849328-3 devstack@n-api.service[122432]: Wed Aug 24 11:37:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:38:40.689319 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ca3c027d-4f11-431f-b155-90fcddc3297f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:40.689976 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ca3c027d-4f11-431f-b155-90fcddc3297f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:40.692399 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=7 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:40.693047 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=23 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:40.696585 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=9 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:40.697374 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=25 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:40.710227 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca3c027d-4f11-431f-b155-90fcddc3297f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:40.710721 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca3c027d-4f11-431f-b155-90fcddc3297f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:40.711368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca3c027d-4f11-431f-b155-90fcddc3297f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:40.712091 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca3c027d-4f11-431f-b155-90fcddc3297f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:40.713309 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca3c027d-4f11-431f-b155-90fcddc3297f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:40.713753 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca3c027d-4f11-431f-b155-90fcddc3297f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:40.746082 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ca3c027d-4f11-431f-b155-90fcddc3297f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:38:40.760223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-ca1610f2-accb-4b25-adfa-8f776b3ee8ba req-0a93cdcc-0ec2-435a-95f1-0952f9868be3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "225f56de-327c-438d-a2a4-685ab32c626f", "tag": "0d0f785c-dcc6-47c9-9441-07f633085207"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:38:40.772400 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ca1610f2-accb-4b25-adfa-8f776b3ee8ba req-0a93cdcc-0ec2-435a-95f1-0952f9868be3 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:40.772808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ca1610f2-accb-4b25-adfa-8f776b3ee8ba req-0a93cdcc-0ec2-435a-95f1-0952f9868be3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:40.773296 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ca1610f2-accb-4b25-adfa-8f776b3ee8ba req-0a93cdcc-0ec2-435a-95f1-0952f9868be3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:40.786351 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-ca1610f2-accb-4b25-adfa-8f776b3ee8ba req-0a93cdcc-0ec2-435a-95f1-0952f9868be3 service nova] Creating event network-changed:0d0f785c-dcc6-47c9-9441-07f633085207 for instance 225f56de-327c-438d-a2a4-685ab32c626f on n-h1-849328-3 Aug 24 11:38:40.792172 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-ca1610f2-accb-4b25-adfa-8f776b3ee8ba req-0a93cdcc-0ec2-435a-95f1-0952f9868be3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097651 Aug 24 11:38:40.793113 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3978/7589] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:38:40.846385 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ca3c027d-4f11-431f-b155-90fcddc3297f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "DELETE /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 204 len: 0 microversion: 2.1 time: 0.161485 Aug 24 11:38:40.847161 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3612/7590] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:38:40 2022] DELETE /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:38:40.856691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d0f88108-1089-4ba4-a1ff-99ebd1967732 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:40.857466 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d0f88108-1089-4ba4-a1ff-99ebd1967732 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:40.866364 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0f88108-1089-4ba4-a1ff-99ebd1967732 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:40.866879 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0f88108-1089-4ba4-a1ff-99ebd1967732 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:40.867590 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0f88108-1089-4ba4-a1ff-99ebd1967732 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:40.868706 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0f88108-1089-4ba4-a1ff-99ebd1967732 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:40.869213 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0f88108-1089-4ba4-a1ff-99ebd1967732 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:40.869664 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0f88108-1089-4ba4-a1ff-99ebd1967732 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:41.020316 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d0f88108-1089-4ba4-a1ff-99ebd1967732 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:41.028591 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d0f88108-1089-4ba4-a1ff-99ebd1967732 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1570 microversion: 2.1 time: 0.176182 Aug 24 11:38:41.029154 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3979/7591] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:40 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:42.050891 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4b060d01-0844-4b6b-94a6-d15e46605f13 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:42.051618 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4b060d01-0844-4b6b-94a6-d15e46605f13 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:42.059752 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b060d01-0844-4b6b-94a6-d15e46605f13 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:42.060236 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b060d01-0844-4b6b-94a6-d15e46605f13 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:42.060674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b060d01-0844-4b6b-94a6-d15e46605f13 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:42.061393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b060d01-0844-4b6b-94a6-d15e46605f13 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:42.062141 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b060d01-0844-4b6b-94a6-d15e46605f13 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:42.062565 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b060d01-0844-4b6b-94a6-d15e46605f13 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:42.277176 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4b060d01-0844-4b6b-94a6-d15e46605f13 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:42.287959 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4b060d01-0844-4b6b-94a6-d15e46605f13 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1570 microversion: 2.1 time: 0.241474 Aug 24 11:38:42.288552 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3613/7592] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:42 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1570 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:42.987809 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-32ba473d-0b67-4383-a7c7-05edf2ded8d5 req-c0bb8cd5-292a-401c-b327-01e4a0819029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "225f56de-327c-438d-a2a4-685ab32c626f", "name": "network-vif-deleted", "tag": "0d0f785c-dcc6-47c9-9441-07f633085207"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:38:43.002744 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-32ba473d-0b67-4383-a7c7-05edf2ded8d5 req-c0bb8cd5-292a-401c-b327-01e4a0819029 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:43.003519 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-32ba473d-0b67-4383-a7c7-05edf2ded8d5 req-c0bb8cd5-292a-401c-b327-01e4a0819029 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:43.004001 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-32ba473d-0b67-4383-a7c7-05edf2ded8d5 req-c0bb8cd5-292a-401c-b327-01e4a0819029 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:43.016212 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-32ba473d-0b67-4383-a7c7-05edf2ded8d5 req-c0bb8cd5-292a-401c-b327-01e4a0819029 service nova] Creating event network-vif-deleted:0d0f785c-dcc6-47c9-9441-07f633085207 for instance 225f56de-327c-438d-a2a4-685ab32c626f on n-h1-849328-3 Aug 24 11:38:43.021618 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-32ba473d-0b67-4383-a7c7-05edf2ded8d5 req-c0bb8cd5-292a-401c-b327-01e4a0819029 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038309 Aug 24 11:38:43.022232 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3980/7593] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:38:43.312900 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-624eab49-5f1e-4e6f-953a-250ca087ba2f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:43.314013 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-624eab49-5f1e-4e6f-953a-250ca087ba2f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:43.323363 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-624eab49-5f1e-4e6f-953a-250ca087ba2f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:43.323983 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-624eab49-5f1e-4e6f-953a-250ca087ba2f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:43.324658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-624eab49-5f1e-4e6f-953a-250ca087ba2f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:43.325663 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-624eab49-5f1e-4e6f-953a-250ca087ba2f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:43.326204 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-624eab49-5f1e-4e6f-953a-250ca087ba2f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:43.326846 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-624eab49-5f1e-4e6f-953a-250ca087ba2f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:43.398277 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-624eab49-5f1e-4e6f-953a-250ca087ba2f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:43.406776 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-624eab49-5f1e-4e6f-953a-250ca087ba2f tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1220 microversion: 2.1 time: 0.099742 Aug 24 11:38:43.407382 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3614/7594] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:43 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:44.429351 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f30f2dcf-d65a-4025-81a5-19ec5a17d74d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:44.430149 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f30f2dcf-d65a-4025-81a5-19ec5a17d74d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:44.441012 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f30f2dcf-d65a-4025-81a5-19ec5a17d74d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:44.441540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f30f2dcf-d65a-4025-81a5-19ec5a17d74d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:44.441996 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f30f2dcf-d65a-4025-81a5-19ec5a17d74d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:44.442716 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f30f2dcf-d65a-4025-81a5-19ec5a17d74d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:44.443177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f30f2dcf-d65a-4025-81a5-19ec5a17d74d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:44.443611 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f30f2dcf-d65a-4025-81a5-19ec5a17d74d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:44.509963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f30f2dcf-d65a-4025-81a5-19ec5a17d74d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:44.519011 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f30f2dcf-d65a-4025-81a5-19ec5a17d74d tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1220 microversion: 2.1 time: 0.094890 Aug 24 11:38:44.519653 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3981/7595] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:44 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:45.540247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a3d614ab-6168-401f-b4ac-5f8832b9c1f5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:45.541228 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a3d614ab-6168-401f-b4ac-5f8832b9c1f5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:45.548731 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3d614ab-6168-401f-b4ac-5f8832b9c1f5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:45.549345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3d614ab-6168-401f-b4ac-5f8832b9c1f5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:45.549903 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3d614ab-6168-401f-b4ac-5f8832b9c1f5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:45.550856 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3d614ab-6168-401f-b4ac-5f8832b9c1f5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:45.551500 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3d614ab-6168-401f-b4ac-5f8832b9c1f5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:45.551998 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3d614ab-6168-401f-b4ac-5f8832b9c1f5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:45.616390 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a3d614ab-6168-401f-b4ac-5f8832b9c1f5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:45.625804 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a3d614ab-6168-401f-b4ac-5f8832b9c1f5 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1220 microversion: 2.1 time: 0.089561 Aug 24 11:38:45.626397 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3615/7596] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:45 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:46.650094 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dcae61dd-3272-459b-9cb0-51add34f21bd tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:46.650741 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dcae61dd-3272-459b-9cb0-51add34f21bd tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:46.660707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcae61dd-3272-459b-9cb0-51add34f21bd tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:46.661270 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcae61dd-3272-459b-9cb0-51add34f21bd tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:46.661712 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcae61dd-3272-459b-9cb0-51add34f21bd tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:46.662644 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcae61dd-3272-459b-9cb0-51add34f21bd tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:46.663125 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcae61dd-3272-459b-9cb0-51add34f21bd tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:46.663566 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcae61dd-3272-459b-9cb0-51add34f21bd tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:46.729332 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dcae61dd-3272-459b-9cb0-51add34f21bd tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38342bcd5c4427ca84becd8060b454a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6a7095e5e94f7e9db48308288c4583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:46.737680 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dcae61dd-3272-459b-9cb0-51add34f21bd tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 200 len: 1220 microversion: 2.1 time: 0.093869 Aug 24 11:38:46.738364 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3982/7597] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:46 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:47.759247 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-90aa1c0e-1106-4cf0-9ce1-ec1746ad9def tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:47.759869 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-90aa1c0e-1106-4cf0-9ce1-ec1746ad9def tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [instance: 225f56de-327c-438d-a2a4-685ab32c626f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:47.767556 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90aa1c0e-1106-4cf0-9ce1-ec1746ad9def tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:47.768049 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90aa1c0e-1106-4cf0-9ce1-ec1746ad9def tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:47.768522 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90aa1c0e-1106-4cf0-9ce1-ec1746ad9def tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:47.769369 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90aa1c0e-1106-4cf0-9ce1-ec1746ad9def tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:47.769829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90aa1c0e-1106-4cf0-9ce1-ec1746ad9def tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:47.770255 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90aa1c0e-1106-4cf0-9ce1-ec1746ad9def tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:47.784083 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-90aa1c0e-1106-4cf0-9ce1-ec1746ad9def tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] HTTP exception thrown: Instance 225f56de-327c-438d-a2a4-685ab32c626f could not be found. Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-90aa1c0e-1106-4cf0-9ce1-ec1746ad9def tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Request method failure captured: Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f HTTP/1.1 Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: Accept: application/json Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: Accept-Encoding: identity Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: Connection: close Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: Content-Length: 0 Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: Content-Type: application/json Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: Host: 10.222.0.85 Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: Openstack-System-Scope: None Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.11 Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjBguuLSbaLThv-Qm6CLmB4grpf6WhLwYqSIAAY-iCIddBdo3E9v2k--BnjOhKxowplnH4EBGe1asfWKeb4GjhljRqyk7ilOJwRWlVXGKqC6GTMccalJegCY4ttxuBUtJy6H_fMZlLZOe8YffApiq1P3zOMFore8tIXKe3ZwhxAMxwvxg Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Id: None Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: X-Domain-Name: None Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: X-Is-Admin-Project: True Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Id: default Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Id: 5a6a7095e5e94f7e9db48308288c4583 Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: X-Project-Name: tempest-TestShelveInstance-128365738 Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: X-Role: reader,member Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: X-Roles: reader,member Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5a6a7095e5e94f7e9db48308288c4583"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_5a6a7095e5e94f7e9db48308288c4583", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5a6a7095e5e94f7e9db48308288c4583"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/5a6a7095e5e94f7e9db48308288c4583"}]}] Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant: tempest-TestShelveInstance-128365738 Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Id: 5a6a7095e5e94f7e9db48308288c4583 Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestShelveInstance-128365738 Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: X-User: tempest-TestShelveInstance-128365738-project Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Id: default Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: X-User-Domain-Name: Default Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: X-User-Id: d38342bcd5c4427ca84becd8060b454a Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: X-User-Name: tempest-TestShelveInstance-128365738-project Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: method: > Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: exception: Instance 225f56de-327c-438d-a2a4-685ab32c626f could not be found. Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: action_args: {'id': '225f56de-327c-438d-a2a4-685ab32c626f'} Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 225f56de-327c-438d-a2a4-685ab32c626f could not be found. Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 225f56de-327c-438d-a2a4-685ab32c626f could not be found. Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:38:47.785729 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:38:47.790860 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:38:47.790860 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:38:47.790860 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:38:47.790860 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:38:47.790860 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:38:47.790860 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 225f56de-327c-438d-a2a4-685ab32c626f could not be found. Aug 24 11:38:47.790860 n-d-849328-3 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Aug 24 11:38:47.790860 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-90aa1c0e-1106-4cf0-9ce1-ec1746ad9def tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Returning 404 to user: Instance 225f56de-327c-438d-a2a4-685ab32c626f could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:38:47.790860 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-90aa1c0e-1106-4cf0-9ce1-ec1746ad9def tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f" status: 404 len: 111 microversion: 2.1 time: 0.032016 Aug 24 11:38:47.791615 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3616/7598] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:47 2022] GET /compute/v2.1/servers/225f56de-327c-438d-a2a4-685ab32c626f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:38:47.957459 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1bbbbcb9-67c9-4eea-95b7-79f8f903c7b4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] Calling method '.version_select at 0x7f46247b3e50>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:47.963538 n-d-849328-3 devstack@n-api.service[122433]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1bbbbcb9-67c9-4eea-95b7-79f8f903c7b4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [e72e49db-151f-4fe0-8fe7-c6c681bd6e62] AMQP server on 10.222.0.85:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 11:38:48.974204 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [None req-1bbbbcb9-67c9-4eea-95b7-79f8f903c7b4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] [e72e49db-151f-4fe0-8fe7-c6c681bd6e62] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 58484. Aug 24 11:38:48.997379 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1bbbbcb9-67c9-4eea-95b7-79f8f903c7b4 tempest-TestShelveInstance-128365738 tempest-TestShelveInstance-128365738-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1686440220" status: 202 len: 0 microversion: 2.1 time: 1.045769 Aug 24 11:38:48.997992 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3983/7599] 10.222.0.85 () {58 vars in 1254 bytes} [Wed Aug 24 11:38:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1686440220 => generated 0 bytes in 1048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:39:07.108127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:07.109638 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:07.288569 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0eb2e37f-51fc-4242-b2f4-5b6c7b4c2442 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Action: 'create', calling method: .version_select at 0x7f4647d13af0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1258200118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZIqOOe1MBUWPDSQa1NavxevNzO3gAOruQI00ONZbzg1LJ6NbwZ6YTrFw8XrKdGNrBWXI38Ek9s4EjjCUcfWaxF/Y5D/Jk7+nreYWLjLoNhohJkX/5cxdtwfHUV8gsnQw=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:39:07.304909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-0eb2e37f-51fc-4242-b2f4-5b6c7b4c2442 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Getting quotas for project 5969f4d5cff84df484f1481db211273a. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:39:07.311781 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.quota [None req-0eb2e37f-51fc-4242-b2f4-5b6c7b4c2442 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Getting quotas for user dec7201b3e28417fb8ec6ef81c259e14 and project 5969f4d5cff84df484f1481db211273a. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:39:07.343271 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0eb2e37f-51fc-4242-b2f4-5b6c7b4c2442 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.241751 Aug 24 11:39:07.344076 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3617/7600] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Aug 24 11:39:07 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:39:08.362571 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-04800dce-b498-4f99-9f16-56800cd9e947 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-42303639", "imageRef": "0a9df326-dcca-498d-8d8a-b320e539a1af", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1258200118", "security_groups": [{"name": "tempest-secgroup-smoke-169968113"}], "networks": [{"uuid": "4e3e5040-4232-404c-8ff9-30d95128a8fe"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:39:08.371183 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=22 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:08.371857 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:08.482873 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-04800dce-b498-4f99-9f16-56800cd9e947 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] validate_networks() for [('4e3e5040-4232-404c-8ff9-30d95128a8fe', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:39:09.005135 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-04800dce-b498-4f99-9f16-56800cd9e947 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:39:09.005578 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-04800dce-b498-4f99-9f16-56800cd9e947 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:39:09.006071 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-04800dce-b498-4f99-9f16-56800cd9e947 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:39:09.006561 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-04800dce-b498-4f99-9f16-56800cd9e947 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:39:09.006945 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-04800dce-b498-4f99-9f16-56800cd9e947 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:39:09.016812 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04800dce-b498-4f99-9f16-56800cd9e947 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:09.017355 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04800dce-b498-4f99-9f16-56800cd9e947 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:09.017814 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04800dce-b498-4f99-9f16-56800cd9e947 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:09.018553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04800dce-b498-4f99-9f16-56800cd9e947 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:09.019022 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04800dce-b498-4f99-9f16-56800cd9e947 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:09.019460 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04800dce-b498-4f99-9f16-56800cd9e947 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:09.038898 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-04800dce-b498-4f99-9f16-56800cd9e947 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Getting quotas for project 5969f4d5cff84df484f1481db211273a. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:39:09.044786 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-04800dce-b498-4f99-9f16-56800cd9e947 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Getting quotas for user dec7201b3e28417fb8ec6ef81c259e14 and project 5969f4d5cff84df484f1481db211273a. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:39:09.058764 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-04800dce-b498-4f99-9f16-56800cd9e947 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:39:09.061157 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-04800dce-b498-4f99-9f16-56800cd9e947 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: d43cbcca-c1be-4ae4-94b6-52b7dc137b97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a9df326-dcca-498d-8d8a-b320e539a1af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:39:09.111635 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-04800dce-b498-4f99-9f16-56800cd9e947 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.753525 Aug 24 11:39:09.118266 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3984/7601] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 11:39:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:39:09.124823 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b56a8138-6ce3-41d6-8db6-bc46ec44908c tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:09.125723 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b56a8138-6ce3-41d6-8db6-bc46ec44908c tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: d43cbcca-c1be-4ae4-94b6-52b7dc137b97] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:09.187392 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b56a8138-6ce3-41d6-8db6-bc46ec44908c tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:09.194877 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b56a8138-6ce3-41d6-8db6-bc46ec44908c tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97" status: 200 len: 1247 microversion: 2.1 time: 0.075174 Aug 24 11:39:09.195493 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3618/7602] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:09 2022] GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97 => generated 1247 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:10.217643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4aefd391-25e1-4d96-a8b9-f0feeae7e141 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:10.218284 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4aefd391-25e1-4d96-a8b9-f0feeae7e141 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: d43cbcca-c1be-4ae4-94b6-52b7dc137b97] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:10.277113 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4aefd391-25e1-4d96-a8b9-f0feeae7e141 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:10.285914 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4aefd391-25e1-4d96-a8b9-f0feeae7e141 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97" status: 200 len: 1247 microversion: 2.1 time: 0.073614 Aug 24 11:39:10.286581 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3985/7603] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:10 2022] GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97 => generated 1247 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:11.309393 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3cebd563-960e-48eb-8c28-f9f2c738ab2d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:11.310177 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3cebd563-960e-48eb-8c28-f9f2c738ab2d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: d43cbcca-c1be-4ae4-94b6-52b7dc137b97] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:11.370984 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3cebd563-960e-48eb-8c28-f9f2c738ab2d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:11.378368 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3cebd563-960e-48eb-8c28-f9f2c738ab2d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97" status: 200 len: 1247 microversion: 2.1 time: 0.074504 Aug 24 11:39:11.378949 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3619/7604] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:11 2022] GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97 => generated 1247 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:12.400163 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c2cb5400-6f1a-4eff-8767-e8673c35b4b5 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:12.400781 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c2cb5400-6f1a-4eff-8767-e8673c35b4b5 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: d43cbcca-c1be-4ae4-94b6-52b7dc137b97] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:12.462526 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c2cb5400-6f1a-4eff-8767-e8673c35b4b5 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:12.469977 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c2cb5400-6f1a-4eff-8767-e8673c35b4b5 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97" status: 200 len: 1247 microversion: 2.1 time: 0.074127 Aug 24 11:39:12.470519 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3986/7605] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:12 2022] GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97 => generated 1247 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:13.491729 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c3ad6cff-40cc-4b57-8ec3-d78275792ff9 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:13.492338 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c3ad6cff-40cc-4b57-8ec3-d78275792ff9 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: d43cbcca-c1be-4ae4-94b6-52b7dc137b97] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:13.500368 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3ad6cff-40cc-4b57-8ec3-d78275792ff9 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:13.500791 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3ad6cff-40cc-4b57-8ec3-d78275792ff9 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:13.501264 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3ad6cff-40cc-4b57-8ec3-d78275792ff9 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:13.501987 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3ad6cff-40cc-4b57-8ec3-d78275792ff9 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:13.502427 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3ad6cff-40cc-4b57-8ec3-d78275792ff9 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:13.502853 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3ad6cff-40cc-4b57-8ec3-d78275792ff9 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:13.566819 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c3ad6cff-40cc-4b57-8ec3-d78275792ff9 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:13.574973 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c3ad6cff-40cc-4b57-8ec3-d78275792ff9 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97" status: 200 len: 1251 microversion: 2.1 time: 0.087265 Aug 24 11:39:13.575556 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3620/7606] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:13 2022] GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97 => generated 1251 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:14.596898 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5d97635a-dc9f-4d3d-b1dd-2a0f10339a12 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:14.598017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5d97635a-dc9f-4d3d-b1dd-2a0f10339a12 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: d43cbcca-c1be-4ae4-94b6-52b7dc137b97] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:14.609726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d97635a-dc9f-4d3d-b1dd-2a0f10339a12 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:14.610472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d97635a-dc9f-4d3d-b1dd-2a0f10339a12 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:14.611147 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d97635a-dc9f-4d3d-b1dd-2a0f10339a12 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:14.612255 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d97635a-dc9f-4d3d-b1dd-2a0f10339a12 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:14.612958 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d97635a-dc9f-4d3d-b1dd-2a0f10339a12 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:14.613663 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d97635a-dc9f-4d3d-b1dd-2a0f10339a12 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:14.710398 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5d97635a-dc9f-4d3d-b1dd-2a0f10339a12 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:14.719121 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5d97635a-dc9f-4d3d-b1dd-2a0f10339a12 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97" status: 200 len: 1305 microversion: 2.1 time: 0.127028 Aug 24 11:39:14.719712 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3987/7607] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:14 2022] GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97 => generated 1305 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:15.740219 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cdcad483-1a01-4145-ac32-ad130e2e3d00 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:15.741639 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cdcad483-1a01-4145-ac32-ad130e2e3d00 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: d43cbcca-c1be-4ae4-94b6-52b7dc137b97] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:15.749256 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdcad483-1a01-4145-ac32-ad130e2e3d00 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:15.750032 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdcad483-1a01-4145-ac32-ad130e2e3d00 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:15.750452 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdcad483-1a01-4145-ac32-ad130e2e3d00 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:15.751385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdcad483-1a01-4145-ac32-ad130e2e3d00 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:15.751865 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdcad483-1a01-4145-ac32-ad130e2e3d00 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:15.752297 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdcad483-1a01-4145-ac32-ad130e2e3d00 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:15.892864 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cdcad483-1a01-4145-ac32-ad130e2e3d00 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:15.901287 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cdcad483-1a01-4145-ac32-ad130e2e3d00 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97" status: 200 len: 1372 microversion: 2.1 time: 0.165030 Aug 24 11:39:15.901998 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3621/7608] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:15 2022] GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:16.168967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-83f550ad-8119-45f7-9da7-82667f845353 req-1c999c34-07b6-41ff-87c4-96543c1d1372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d43cbcca-c1be-4ae4-94b6-52b7dc137b97", "tag": "a370f90f-4003-4701-b095-6bed9f8919f6"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:39:16.182006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-83f550ad-8119-45f7-9da7-82667f845353 req-1c999c34-07b6-41ff-87c4-96543c1d1372 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:16.182548 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-83f550ad-8119-45f7-9da7-82667f845353 req-1c999c34-07b6-41ff-87c4-96543c1d1372 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:16.182993 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-83f550ad-8119-45f7-9da7-82667f845353 req-1c999c34-07b6-41ff-87c4-96543c1d1372 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:16.194756 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-83f550ad-8119-45f7-9da7-82667f845353 req-1c999c34-07b6-41ff-87c4-96543c1d1372 service nova] Creating event network-changed:a370f90f-4003-4701-b095-6bed9f8919f6 for instance d43cbcca-c1be-4ae4-94b6-52b7dc137b97 on n-h1-849328-3 Aug 24 11:39:16.200423 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-83f550ad-8119-45f7-9da7-82667f845353 req-1c999c34-07b6-41ff-87c4-96543c1d1372 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035644 Aug 24 11:39:16.201505 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3988/7609] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:39:16.922855 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3e2385e4-b72f-44c7-9023-217bb9a64239 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:16.923422 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3e2385e4-b72f-44c7-9023-217bb9a64239 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: d43cbcca-c1be-4ae4-94b6-52b7dc137b97] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:16.930922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e2385e4-b72f-44c7-9023-217bb9a64239 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:16.931476 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e2385e4-b72f-44c7-9023-217bb9a64239 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:16.931959 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e2385e4-b72f-44c7-9023-217bb9a64239 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:16.932709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e2385e4-b72f-44c7-9023-217bb9a64239 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:16.933292 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e2385e4-b72f-44c7-9023-217bb9a64239 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:16.933765 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e2385e4-b72f-44c7-9023-217bb9a64239 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:17.077707 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3e2385e4-b72f-44c7-9023-217bb9a64239 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:17.090329 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3e2385e4-b72f-44c7-9023-217bb9a64239 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97" status: 200 len: 1372 microversion: 2.1 time: 0.171313 Aug 24 11:39:17.091257 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3622/7610] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:16 2022] GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97 => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:18.117101 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ceab6055-bbce-4f24-bf6e-389f3c9c9659 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:18.117729 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ceab6055-bbce-4f24-bf6e-389f3c9c9659 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: d43cbcca-c1be-4ae4-94b6-52b7dc137b97] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:18.124554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ceab6055-bbce-4f24-bf6e-389f3c9c9659 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:18.125054 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ceab6055-bbce-4f24-bf6e-389f3c9c9659 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:18.125541 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ceab6055-bbce-4f24-bf6e-389f3c9c9659 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:18.126244 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ceab6055-bbce-4f24-bf6e-389f3c9c9659 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:18.126708 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ceab6055-bbce-4f24-bf6e-389f3c9c9659 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:18.127144 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ceab6055-bbce-4f24-bf6e-389f3c9c9659 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:18.271114 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ceab6055-bbce-4f24-bf6e-389f3c9c9659 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:18.279159 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ceab6055-bbce-4f24-bf6e-389f3c9c9659 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97" status: 200 len: 1372 microversion: 2.1 time: 0.167432 Aug 24 11:39:18.279737 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3989/7611] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:18 2022] GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:19.300267 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d5f252f1-bca5-4726-bc91-c6ed2eccfacf tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:19.300853 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d5f252f1-bca5-4726-bc91-c6ed2eccfacf tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: d43cbcca-c1be-4ae4-94b6-52b7dc137b97] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:19.308212 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5f252f1-bca5-4726-bc91-c6ed2eccfacf tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:19.308995 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5f252f1-bca5-4726-bc91-c6ed2eccfacf tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:19.309485 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5f252f1-bca5-4726-bc91-c6ed2eccfacf tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:19.310169 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5f252f1-bca5-4726-bc91-c6ed2eccfacf tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:19.310658 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5f252f1-bca5-4726-bc91-c6ed2eccfacf tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:19.311090 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5f252f1-bca5-4726-bc91-c6ed2eccfacf tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:19.449161 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d5f252f1-bca5-4726-bc91-c6ed2eccfacf tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:19.457521 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d5f252f1-bca5-4726-bc91-c6ed2eccfacf tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97" status: 200 len: 1372 microversion: 2.1 time: 0.161161 Aug 24 11:39:19.458125 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3623/7612] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:19 2022] GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:20.483967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f2e48383-a4e4-4334-a71a-14cfd7f2e78c tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:20.485033 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f2e48383-a4e4-4334-a71a-14cfd7f2e78c tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: d43cbcca-c1be-4ae4-94b6-52b7dc137b97] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:20.488259 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:20.495755 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2e48383-a4e4-4334-a71a-14cfd7f2e78c tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:20.496260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2e48383-a4e4-4334-a71a-14cfd7f2e78c tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:20.496747 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2e48383-a4e4-4334-a71a-14cfd7f2e78c tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:20.497504 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2e48383-a4e4-4334-a71a-14cfd7f2e78c tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:20.497976 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2e48383-a4e4-4334-a71a-14cfd7f2e78c tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:20.498418 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2e48383-a4e4-4334-a71a-14cfd7f2e78c tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:20.661450 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f2e48383-a4e4-4334-a71a-14cfd7f2e78c tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:20.673659 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f2e48383-a4e4-4334-a71a-14cfd7f2e78c tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97" status: 200 len: 1372 microversion: 2.1 time: 0.196234 Aug 24 11:39:20.674554 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3990/7613] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:20 2022] GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97 => generated 1372 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:21.407695 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-986eb933-5bfe-4dd8-809b-b59ca27ec5b8 req-12500b9b-2c51-481e-ba73-8fe5104b6bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d43cbcca-c1be-4ae4-94b6-52b7dc137b97", "name": "network-vif-plugged", "status": "completed", "tag": "a370f90f-4003-4701-b095-6bed9f8919f6"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:39:21.414376 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:21.421073 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-986eb933-5bfe-4dd8-809b-b59ca27ec5b8 req-12500b9b-2c51-481e-ba73-8fe5104b6bb8 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:21.421588 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-986eb933-5bfe-4dd8-809b-b59ca27ec5b8 req-12500b9b-2c51-481e-ba73-8fe5104b6bb8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:21.422027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-986eb933-5bfe-4dd8-809b-b59ca27ec5b8 req-12500b9b-2c51-481e-ba73-8fe5104b6bb8 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:21.433656 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-986eb933-5bfe-4dd8-809b-b59ca27ec5b8 req-12500b9b-2c51-481e-ba73-8fe5104b6bb8 service nova] Creating event network-vif-plugged:a370f90f-4003-4701-b095-6bed9f8919f6 for instance d43cbcca-c1be-4ae4-94b6-52b7dc137b97 on n-h1-849328-3 Aug 24 11:39:21.438780 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-986eb933-5bfe-4dd8-809b-b59ca27ec5b8 req-12500b9b-2c51-481e-ba73-8fe5104b6bb8 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034950 Aug 24 11:39:21.439394 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3624/7614] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:39:21.698286 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b1720961-1db4-4814-b5d7-cc589179f1da tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:21.698911 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b1720961-1db4-4814-b5d7-cc589179f1da tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: d43cbcca-c1be-4ae4-94b6-52b7dc137b97] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:21.706287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1720961-1db4-4814-b5d7-cc589179f1da tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:21.706782 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1720961-1db4-4814-b5d7-cc589179f1da tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:21.707224 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1720961-1db4-4814-b5d7-cc589179f1da tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:21.707936 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1720961-1db4-4814-b5d7-cc589179f1da tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:21.708406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1720961-1db4-4814-b5d7-cc589179f1da tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:21.708845 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1720961-1db4-4814-b5d7-cc589179f1da tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:21.850797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b1720961-1db4-4814-b5d7-cc589179f1da tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:21.859327 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b1720961-1db4-4814-b5d7-cc589179f1da tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97" status: 200 len: 1372 microversion: 2.1 time: 0.165065 Aug 24 11:39:21.859891 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3991/7615] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:21 2022] GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:22.886505 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e883b58b-79ae-49ab-acef-d42657f43f56 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:22.887937 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e883b58b-79ae-49ab-acef-d42657f43f56 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: d43cbcca-c1be-4ae4-94b6-52b7dc137b97] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:22.898262 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e883b58b-79ae-49ab-acef-d42657f43f56 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:22.898748 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e883b58b-79ae-49ab-acef-d42657f43f56 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:22.899191 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e883b58b-79ae-49ab-acef-d42657f43f56 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:22.899888 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e883b58b-79ae-49ab-acef-d42657f43f56 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:22.900339 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e883b58b-79ae-49ab-acef-d42657f43f56 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:22.900766 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e883b58b-79ae-49ab-acef-d42657f43f56 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:23.044742 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e883b58b-79ae-49ab-acef-d42657f43f56 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:23.056761 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e883b58b-79ae-49ab-acef-d42657f43f56 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97" status: 200 len: 1557 microversion: 2.1 time: 0.178654 Aug 24 11:39:23.057616 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3625/7616] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:22 2022] GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97 => generated 1557 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:23.081409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3debadce-1cdf-441f-94d4-c6dec21224f8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:23.082068 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3debadce-1cdf-441f-94d4-c6dec21224f8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: d43cbcca-c1be-4ae4-94b6-52b7dc137b97] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:23.083986 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=10 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:23.090491 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3debadce-1cdf-441f-94d4-c6dec21224f8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:23.090999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3debadce-1cdf-441f-94d4-c6dec21224f8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:23.091462 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3debadce-1cdf-441f-94d4-c6dec21224f8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:23.092178 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3debadce-1cdf-441f-94d4-c6dec21224f8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:23.092654 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3debadce-1cdf-441f-94d4-c6dec21224f8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:23.093150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3debadce-1cdf-441f-94d4-c6dec21224f8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:23.237549 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3debadce-1cdf-441f-94d4-c6dec21224f8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:23.249201 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3debadce-1cdf-441f-94d4-c6dec21224f8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97" status: 200 len: 1557 microversion: 2.1 time: 0.171448 Aug 24 11:39:23.250109 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3992/7617] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:23 2022] GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97 => generated 1557 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:24.952774 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-2219fbc9-20c6-4f70-8977-57449f5c491d req-41e71df7-0809-4ccf-84a5-9d8d4c414c83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d43cbcca-c1be-4ae4-94b6-52b7dc137b97", "tag": "a370f90f-4003-4701-b095-6bed9f8919f6"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:39:24.963045 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2219fbc9-20c6-4f70-8977-57449f5c491d req-41e71df7-0809-4ccf-84a5-9d8d4c414c83 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:24.963573 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2219fbc9-20c6-4f70-8977-57449f5c491d req-41e71df7-0809-4ccf-84a5-9d8d4c414c83 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:24.964054 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2219fbc9-20c6-4f70-8977-57449f5c491d req-41e71df7-0809-4ccf-84a5-9d8d4c414c83 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:24.975833 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-2219fbc9-20c6-4f70-8977-57449f5c491d req-41e71df7-0809-4ccf-84a5-9d8d4c414c83 service nova] Creating event network-changed:a370f90f-4003-4701-b095-6bed9f8919f6 for instance d43cbcca-c1be-4ae4-94b6-52b7dc137b97 on n-h1-849328-3 Aug 24 11:39:24.981077 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-2219fbc9-20c6-4f70-8977-57449f5c491d req-41e71df7-0809-4ccf-84a5-9d8d4c414c83 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032069 Aug 24 11:39:24.982081 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3626/7618] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:39:43.903395 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:39:43.904431 n-d-849328-3 devstack@n-api.service[122432]: Wed Aug 24 11:39:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:41:20.065487 n-d-849328-3 devstack@n-api.service[122433]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5886a733-ca00-414d-91f6-f1df23acfbb8] AMQP server on 10.222.0.85:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 11:41:20.066423 n-d-849328-3 devstack@n-api.service[122433]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d2cfb5b7-d0cc-487d-9468-a34ffc98a2cb] AMQP server on 10.222.0.85:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 11:41:20.067225 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:20.068060 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=34 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:20.072262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-22c25501-72ab-4888-b862-8ff89a7894c0 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1105868038"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:41:20.074703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-22c25501-72ab-4888-b862-8ff89a7894c0 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: d43cbcca-c1be-4ae4-94b6-52b7dc137b97] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:20.081864 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22c25501-72ab-4888-b862-8ff89a7894c0 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:20.082363 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22c25501-72ab-4888-b862-8ff89a7894c0 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:20.082817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22c25501-72ab-4888-b862-8ff89a7894c0 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:20.083521 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22c25501-72ab-4888-b862-8ff89a7894c0 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:20.083994 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22c25501-72ab-4888-b862-8ff89a7894c0 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:20.084428 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22c25501-72ab-4888-b862-8ff89a7894c0 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:20.285243 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-22c25501-72ab-4888-b862-8ff89a7894c0 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "POST /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97/action" status: 202 len: 0 microversion: 2.1 time: 0.221448 Aug 24 11:41:20.286200 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3993/7619] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:41:20 2022] POST /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 11:41:26.122897 n-d-849328-3 devstack@n-api.service[122432]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41245b8f-4363-4ade-bbd0-55c91ce540ab] AMQP server on 10.222.0.85:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 11:41:26.124022 n-d-849328-3 devstack@n-api.service[122432]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e64df5b4-05c3-4b69-9f47-fe01a91d09ba] AMQP server on 10.222.0.85:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 11:41:26.124678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:26.128920 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=34 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:26.235030 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-0532512b-6093-401e-a220-3a4a99b7e18c req-22514163-d449-4c00-9bec-f7c8461e1520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d43cbcca-c1be-4ae4-94b6-52b7dc137b97", "name": "network-vif-plugged", "status": "completed", "tag": "a370f90f-4003-4701-b095-6bed9f8919f6"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:41:26.247005 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0532512b-6093-401e-a220-3a4a99b7e18c req-22514163-d449-4c00-9bec-f7c8461e1520 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:26.247602 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0532512b-6093-401e-a220-3a4a99b7e18c req-22514163-d449-4c00-9bec-f7c8461e1520 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:26.248267 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0532512b-6093-401e-a220-3a4a99b7e18c req-22514163-d449-4c00-9bec-f7c8461e1520 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:26.260529 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-0532512b-6093-401e-a220-3a4a99b7e18c req-22514163-d449-4c00-9bec-f7c8461e1520 service nova] Creating event network-vif-plugged:a370f90f-4003-4701-b095-6bed9f8919f6 for instance d43cbcca-c1be-4ae4-94b6-52b7dc137b97 on n-h1-849328-3 Aug 24 11:41:26.267138 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-0532512b-6093-401e-a220-3a4a99b7e18c req-22514163-d449-4c00-9bec-f7c8461e1520 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146558 Aug 24 11:41:26.268449 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3627/7620] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:41:33.871435 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:33.872250 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:33.876912 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-15ab9d99-a02f-4749-8291-d67dec8d0fee tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-901316987", "imageRef": "82dcad65-fc47-4ebe-bfbd-f7dc5d61b3b7", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1258200118", "security_groups": [{"name": "tempest-secgroup-smoke-169968113"}], "networks": [{"uuid": "4e3e5040-4232-404c-8ff9-30d95128a8fe"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:41:33.901570 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] [d2cfb5b7-d0cc-487d-9468-a34ffc98a2cb] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 58848. Aug 24 11:41:33.902293 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] [5886a733-ca00-414d-91f6-f1df23acfbb8] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 58846. Aug 24 11:41:33.994692 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-15ab9d99-a02f-4749-8291-d67dec8d0fee tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] validate_networks() for [('4e3e5040-4232-404c-8ff9-30d95128a8fe', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:41:34.697691 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-15ab9d99-a02f-4749-8291-d67dec8d0fee tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:41:34.698169 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-15ab9d99-a02f-4749-8291-d67dec8d0fee tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:41:34.698683 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-15ab9d99-a02f-4749-8291-d67dec8d0fee tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:41:34.699109 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-15ab9d99-a02f-4749-8291-d67dec8d0fee tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:41:34.699540 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-15ab9d99-a02f-4749-8291-d67dec8d0fee tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:41:34.709001 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15ab9d99-a02f-4749-8291-d67dec8d0fee tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:34.709543 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15ab9d99-a02f-4749-8291-d67dec8d0fee tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:34.709999 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15ab9d99-a02f-4749-8291-d67dec8d0fee tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:34.710754 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15ab9d99-a02f-4749-8291-d67dec8d0fee tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:34.711231 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15ab9d99-a02f-4749-8291-d67dec8d0fee tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:34.711676 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15ab9d99-a02f-4749-8291-d67dec8d0fee tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:34.733565 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-15ab9d99-a02f-4749-8291-d67dec8d0fee tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Getting quotas for project 5969f4d5cff84df484f1481db211273a. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:41:34.739414 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.quota [None req-15ab9d99-a02f-4749-8291-d67dec8d0fee tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Getting quotas for user dec7201b3e28417fb8ec6ef81c259e14 and project 5969f4d5cff84df484f1481db211273a. Resources: {'instances', 'ram', 'cores'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:41:34.752975 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-15ab9d99-a02f-4749-8291-d67dec8d0fee tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:41:34.755887 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-15ab9d99-a02f-4749-8291-d67dec8d0fee tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: b80bd2aa-43f2-4818-be0e-1181ae9b1d18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='82dcad65-fc47-4ebe-bfbd-f7dc5d61b3b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:41:34.803790 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-15ab9d99-a02f-4749-8291-d67dec8d0fee tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.934535 Aug 24 11:41:34.804460 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3994/7621] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Aug 24 11:41:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:41:34.816302 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bb59477f-c420-482c-a0bb-5385eca408d0 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:34.817293 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bb59477f-c420-482c-a0bb-5385eca408d0 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: b80bd2aa-43f2-4818-be0e-1181ae9b1d18] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:34.850904 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] [41245b8f-4363-4ade-bbd0-55c91ce540ab] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 58860. Aug 24 11:41:34.851760 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] [e64df5b4-05c3-4b69-9f47-fe01a91d09ba] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 58862. Aug 24 11:41:34.884018 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bb59477f-c420-482c-a0bb-5385eca408d0 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:34.892211 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bb59477f-c420-482c-a0bb-5385eca408d0 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18" status: 200 len: 1248 microversion: 2.1 time: 0.080102 Aug 24 11:41:34.892866 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3628/7622] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:34 2022] GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18 => generated 1248 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:35.913497 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-91e180bc-0446-4d52-b6b6-c6a221ac8ffe tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:35.914177 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-91e180bc-0446-4d52-b6b6-c6a221ac8ffe tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: b80bd2aa-43f2-4818-be0e-1181ae9b1d18] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:35.922172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91e180bc-0446-4d52-b6b6-c6a221ac8ffe tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:35.922684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91e180bc-0446-4d52-b6b6-c6a221ac8ffe tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:35.923131 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91e180bc-0446-4d52-b6b6-c6a221ac8ffe tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:35.923877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91e180bc-0446-4d52-b6b6-c6a221ac8ffe tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:35.924319 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91e180bc-0446-4d52-b6b6-c6a221ac8ffe tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:35.924749 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91e180bc-0446-4d52-b6b6-c6a221ac8ffe tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:35.992253 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-91e180bc-0446-4d52-b6b6-c6a221ac8ffe tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:36.001707 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-91e180bc-0446-4d52-b6b6-c6a221ac8ffe tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18" status: 200 len: 1308 microversion: 2.1 time: 0.092877 Aug 24 11:41:36.002520 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3995/7623] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:35 2022] GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18 => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:37.024408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1f46f987-d707-4a63-b071-2e206a6e6dd8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:37.025160 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1f46f987-d707-4a63-b071-2e206a6e6dd8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: b80bd2aa-43f2-4818-be0e-1181ae9b1d18] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:37.037200 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:37.039681 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f46f987-d707-4a63-b071-2e206a6e6dd8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:37.041049 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f46f987-d707-4a63-b071-2e206a6e6dd8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:37.041719 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f46f987-d707-4a63-b071-2e206a6e6dd8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:37.042676 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f46f987-d707-4a63-b071-2e206a6e6dd8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:37.043343 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f46f987-d707-4a63-b071-2e206a6e6dd8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:37.044120 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f46f987-d707-4a63-b071-2e206a6e6dd8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:37.246416 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1f46f987-d707-4a63-b071-2e206a6e6dd8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:37.254126 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1f46f987-d707-4a63-b071-2e206a6e6dd8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18" status: 200 len: 1373 microversion: 2.1 time: 0.234242 Aug 24 11:41:37.254722 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3629/7624] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:37 2022] GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18 => generated 1373 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:41:38.144431 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-f06f44e1-363c-41f0-bb81-64ae37323f4a req-7eb1038c-1d17-441d-8543-91be6f5b2831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d43cbcca-c1be-4ae4-94b6-52b7dc137b97", "name": "network-vif-unplugged", "status": "completed", "tag": "a370f90f-4003-4701-b095-6bed9f8919f6"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:41:38.161987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f06f44e1-363c-41f0-bb81-64ae37323f4a req-7eb1038c-1d17-441d-8543-91be6f5b2831 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:38.162808 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f06f44e1-363c-41f0-bb81-64ae37323f4a req-7eb1038c-1d17-441d-8543-91be6f5b2831 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:38.163534 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f06f44e1-363c-41f0-bb81-64ae37323f4a req-7eb1038c-1d17-441d-8543-91be6f5b2831 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:38.182414 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-f06f44e1-363c-41f0-bb81-64ae37323f4a req-7eb1038c-1d17-441d-8543-91be6f5b2831 service nova] Creating event network-vif-unplugged:a370f90f-4003-4701-b095-6bed9f8919f6 for instance d43cbcca-c1be-4ae4-94b6-52b7dc137b97 on n-h1-849328-3 Aug 24 11:41:38.188110 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-f06f44e1-363c-41f0-bb81-64ae37323f4a req-7eb1038c-1d17-441d-8543-91be6f5b2831 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047543 Aug 24 11:41:38.189328 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3996/7625] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:41:38.275957 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9181be11-9ff7-41d9-b884-a67b96968fb8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:38.276501 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9181be11-9ff7-41d9-b884-a67b96968fb8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: b80bd2aa-43f2-4818-be0e-1181ae9b1d18] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:38.290567 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9181be11-9ff7-41d9-b884-a67b96968fb8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:38.291052 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9181be11-9ff7-41d9-b884-a67b96968fb8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:38.291487 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9181be11-9ff7-41d9-b884-a67b96968fb8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:38.292219 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9181be11-9ff7-41d9-b884-a67b96968fb8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:38.292689 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9181be11-9ff7-41d9-b884-a67b96968fb8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:38.293201 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9181be11-9ff7-41d9-b884-a67b96968fb8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:38.464272 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9181be11-9ff7-41d9-b884-a67b96968fb8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:38.473212 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9181be11-9ff7-41d9-b884-a67b96968fb8 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18" status: 200 len: 1373 microversion: 2.1 time: 0.201303 Aug 24 11:41:38.487969 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3630/7626] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:38 2022] GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18 => generated 1373 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:39.497368 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6da318dd-c303-4f97-be9d-4d5a94751c84 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:39.498279 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6da318dd-c303-4f97-be9d-4d5a94751c84 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: b80bd2aa-43f2-4818-be0e-1181ae9b1d18] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:39.505949 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6da318dd-c303-4f97-be9d-4d5a94751c84 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:39.506456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6da318dd-c303-4f97-be9d-4d5a94751c84 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:39.506904 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6da318dd-c303-4f97-be9d-4d5a94751c84 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:39.507601 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6da318dd-c303-4f97-be9d-4d5a94751c84 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:39.508238 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6da318dd-c303-4f97-be9d-4d5a94751c84 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:39.508682 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6da318dd-c303-4f97-be9d-4d5a94751c84 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:39.672595 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6da318dd-c303-4f97-be9d-4d5a94751c84 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:39.681419 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6da318dd-c303-4f97-be9d-4d5a94751c84 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18" status: 200 len: 1373 microversion: 2.1 time: 0.190122 Aug 24 11:41:39.682367 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3997/7627] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:39 2022] GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18 => generated 1373 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:40.398150 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:41:40.398943 n-d-849328-3 devstack@n-api.service[122432]: Wed Aug 24 11:41:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:41:40.703123 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fd5c792a-de7d-4661-a5d5-75910caaa31a tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:40.703615 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fd5c792a-de7d-4661-a5d5-75910caaa31a tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: b80bd2aa-43f2-4818-be0e-1181ae9b1d18] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:40.711496 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd5c792a-de7d-4661-a5d5-75910caaa31a tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:40.712443 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd5c792a-de7d-4661-a5d5-75910caaa31a tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:40.713089 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd5c792a-de7d-4661-a5d5-75910caaa31a tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:40.714063 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd5c792a-de7d-4661-a5d5-75910caaa31a tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:40.714701 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd5c792a-de7d-4661-a5d5-75910caaa31a tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:40.715383 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd5c792a-de7d-4661-a5d5-75910caaa31a tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:40.882714 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fd5c792a-de7d-4661-a5d5-75910caaa31a tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:40.892730 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fd5c792a-de7d-4661-a5d5-75910caaa31a tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18" status: 200 len: 1373 microversion: 2.1 time: 0.193755 Aug 24 11:41:40.895605 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3631/7628] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:40 2022] GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18 => generated 1373 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:41.918282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-87b4735b-8645-4602-a0a0-d57cd382d34d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:41.919938 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-87b4735b-8645-4602-a0a0-d57cd382d34d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: b80bd2aa-43f2-4818-be0e-1181ae9b1d18] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:41.927631 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87b4735b-8645-4602-a0a0-d57cd382d34d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:41.928176 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87b4735b-8645-4602-a0a0-d57cd382d34d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:41.928637 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87b4735b-8645-4602-a0a0-d57cd382d34d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:41.929406 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87b4735b-8645-4602-a0a0-d57cd382d34d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:41.929883 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87b4735b-8645-4602-a0a0-d57cd382d34d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:41.930331 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87b4735b-8645-4602-a0a0-d57cd382d34d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:42.089091 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-87b4735b-8645-4602-a0a0-d57cd382d34d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:42.099729 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-87b4735b-8645-4602-a0a0-d57cd382d34d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18" status: 200 len: 1373 microversion: 2.1 time: 0.187207 Aug 24 11:41:42.100437 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3998/7629] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:41 2022] GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18 => generated 1373 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:43.120396 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c2fe04c2-aced-48d4-890b-704ebe4090c2 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:43.121071 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c2fe04c2-aced-48d4-890b-704ebe4090c2 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: b80bd2aa-43f2-4818-be0e-1181ae9b1d18] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:43.130364 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2fe04c2-aced-48d4-890b-704ebe4090c2 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:43.131359 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2fe04c2-aced-48d4-890b-704ebe4090c2 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:43.132112 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2fe04c2-aced-48d4-890b-704ebe4090c2 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:43.133114 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2fe04c2-aced-48d4-890b-704ebe4090c2 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:43.133952 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2fe04c2-aced-48d4-890b-704ebe4090c2 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:43.134597 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2fe04c2-aced-48d4-890b-704ebe4090c2 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:43.291843 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c2fe04c2-aced-48d4-890b-704ebe4090c2 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:43.300724 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c2fe04c2-aced-48d4-890b-704ebe4090c2 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18" status: 200 len: 1373 microversion: 2.1 time: 0.184091 Aug 24 11:41:43.313310 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3632/7630] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:43 2022] GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18 => generated 1373 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:44.322062 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4d33460e-65f5-4f71-b176-47e3a50fe7ee tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:44.322906 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4d33460e-65f5-4f71-b176-47e3a50fe7ee tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: b80bd2aa-43f2-4818-be0e-1181ae9b1d18] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:44.330059 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d33460e-65f5-4f71-b176-47e3a50fe7ee tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:44.330547 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d33460e-65f5-4f71-b176-47e3a50fe7ee tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:44.330987 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d33460e-65f5-4f71-b176-47e3a50fe7ee tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:44.331726 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d33460e-65f5-4f71-b176-47e3a50fe7ee tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:44.332198 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d33460e-65f5-4f71-b176-47e3a50fe7ee tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:44.332639 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d33460e-65f5-4f71-b176-47e3a50fe7ee tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:44.473098 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4d33460e-65f5-4f71-b176-47e3a50fe7ee tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:44.481090 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4d33460e-65f5-4f71-b176-47e3a50fe7ee tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18" status: 200 len: 1373 microversion: 2.1 time: 0.163073 Aug 24 11:41:44.481732 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3999/7631] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:44 2022] GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18 => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:44.890899 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:44.961622 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-461efcd9-a461-465a-b16f-dfbac8044d2d req-df2c30a2-4410-4b19-897f-f7eb5428dd2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b80bd2aa-43f2-4818-be0e-1181ae9b1d18", "tag": "a29d5a98-22c4-428b-b315-67b3c4bfb00c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:41:44.971672 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-461efcd9-a461-465a-b16f-dfbac8044d2d req-df2c30a2-4410-4b19-897f-f7eb5428dd2e service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:44.972153 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-461efcd9-a461-465a-b16f-dfbac8044d2d req-df2c30a2-4410-4b19-897f-f7eb5428dd2e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:44.972683 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-461efcd9-a461-465a-b16f-dfbac8044d2d req-df2c30a2-4410-4b19-897f-f7eb5428dd2e service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:44.984248 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-461efcd9-a461-465a-b16f-dfbac8044d2d req-df2c30a2-4410-4b19-897f-f7eb5428dd2e service nova] Creating event network-changed:a29d5a98-22c4-428b-b315-67b3c4bfb00c for instance b80bd2aa-43f2-4818-be0e-1181ae9b1d18 on n-h2-849328-3 Aug 24 11:41:44.990091 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-461efcd9-a461-465a-b16f-dfbac8044d2d req-df2c30a2-4410-4b19-897f-f7eb5428dd2e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106466 Aug 24 11:41:44.990906 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3633/7632] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:41:45.502641 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6aea69cf-8211-4031-8e90-bcd331581db7 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:45.508081 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6aea69cf-8211-4031-8e90-bcd331581db7 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: b80bd2aa-43f2-4818-be0e-1181ae9b1d18] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:45.510559 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:45.511327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:45.518900 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aea69cf-8211-4031-8e90-bcd331581db7 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:45.519386 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aea69cf-8211-4031-8e90-bcd331581db7 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:45.519833 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aea69cf-8211-4031-8e90-bcd331581db7 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:45.520553 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aea69cf-8211-4031-8e90-bcd331581db7 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:45.521017 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aea69cf-8211-4031-8e90-bcd331581db7 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:45.522121 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aea69cf-8211-4031-8e90-bcd331581db7 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:45.680554 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6aea69cf-8211-4031-8e90-bcd331581db7 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:45.695328 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6aea69cf-8211-4031-8e90-bcd331581db7 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18" status: 200 len: 1373 microversion: 2.1 time: 0.196228 Aug 24 11:41:45.696740 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 4000/7633] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:45 2022] GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18 => generated 1373 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:46.719674 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e14acf31-46c1-4c15-bb7a-15b81ab48b28 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:46.720408 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e14acf31-46c1-4c15-bb7a-15b81ab48b28 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: b80bd2aa-43f2-4818-be0e-1181ae9b1d18] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:46.727435 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e14acf31-46c1-4c15-bb7a-15b81ab48b28 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:46.727949 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e14acf31-46c1-4c15-bb7a-15b81ab48b28 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:46.728495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e14acf31-46c1-4c15-bb7a-15b81ab48b28 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:46.729585 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e14acf31-46c1-4c15-bb7a-15b81ab48b28 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:46.730351 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e14acf31-46c1-4c15-bb7a-15b81ab48b28 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:46.731027 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e14acf31-46c1-4c15-bb7a-15b81ab48b28 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:46.939844 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e14acf31-46c1-4c15-bb7a-15b81ab48b28 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:46.947898 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e14acf31-46c1-4c15-bb7a-15b81ab48b28 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18" status: 200 len: 1373 microversion: 2.1 time: 0.233742 Aug 24 11:41:46.948489 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3634/7634] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:46 2022] GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18 => generated 1373 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:47.969603 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e7b9674a-a1bd-4a68-a387-587623169f88 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:47.970339 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e7b9674a-a1bd-4a68-a387-587623169f88 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: b80bd2aa-43f2-4818-be0e-1181ae9b1d18] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:47.979323 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7b9674a-a1bd-4a68-a387-587623169f88 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:47.979908 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7b9674a-a1bd-4a68-a387-587623169f88 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:47.980440 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7b9674a-a1bd-4a68-a387-587623169f88 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:47.981310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7b9674a-a1bd-4a68-a387-587623169f88 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:47.981783 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7b9674a-a1bd-4a68-a387-587623169f88 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:47.982221 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7b9674a-a1bd-4a68-a387-587623169f88 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:48.134282 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e7b9674a-a1bd-4a68-a387-587623169f88 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:48.147582 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e7b9674a-a1bd-4a68-a387-587623169f88 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18" status: 200 len: 1373 microversion: 2.1 time: 0.182468 Aug 24 11:41:48.148593 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 4001/7635] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:47 2022] GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18 => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:49.172222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4e294c8d-9f74-4eac-8f44-36af3d740906 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:49.172831 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4e294c8d-9f74-4eac-8f44-36af3d740906 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: b80bd2aa-43f2-4818-be0e-1181ae9b1d18] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:49.180198 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e294c8d-9f74-4eac-8f44-36af3d740906 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:49.180686 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e294c8d-9f74-4eac-8f44-36af3d740906 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:49.181158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e294c8d-9f74-4eac-8f44-36af3d740906 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:49.181852 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e294c8d-9f74-4eac-8f44-36af3d740906 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:49.182305 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e294c8d-9f74-4eac-8f44-36af3d740906 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:49.182733 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e294c8d-9f74-4eac-8f44-36af3d740906 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:49.371245 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4e294c8d-9f74-4eac-8f44-36af3d740906 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:49.379957 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4e294c8d-9f74-4eac-8f44-36af3d740906 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18" status: 200 len: 1373 microversion: 2.1 time: 0.211916 Aug 24 11:41:49.380589 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3635/7636] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:49 2022] GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18 => generated 1373 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:50.406452 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4c2d2fa8-35d0-488e-ba28-503eef3bde2d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:50.407099 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4c2d2fa8-35d0-488e-ba28-503eef3bde2d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: b80bd2aa-43f2-4818-be0e-1181ae9b1d18] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:50.413742 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c2d2fa8-35d0-488e-ba28-503eef3bde2d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:50.414247 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c2d2fa8-35d0-488e-ba28-503eef3bde2d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:50.414703 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c2d2fa8-35d0-488e-ba28-503eef3bde2d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:50.415411 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c2d2fa8-35d0-488e-ba28-503eef3bde2d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:50.415881 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c2d2fa8-35d0-488e-ba28-503eef3bde2d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:50.416327 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c2d2fa8-35d0-488e-ba28-503eef3bde2d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:50.617756 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4c2d2fa8-35d0-488e-ba28-503eef3bde2d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:50.626085 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4c2d2fa8-35d0-488e-ba28-503eef3bde2d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18" status: 200 len: 1373 microversion: 2.1 time: 0.226180 Aug 24 11:41:50.626663 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 4002/7637] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:50 2022] GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18 => generated 1373 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:51.371224 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d27386d5-4418-4823-80ad-308fa9a73e05 req-de968cf5-aebf-4c30-a6f9-879bd7f8cb70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80bd2aa-43f2-4818-be0e-1181ae9b1d18", "name": "network-vif-plugged", "status": "completed", "tag": "a29d5a98-22c4-428b-b315-67b3c4bfb00c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:41:51.382887 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d27386d5-4418-4823-80ad-308fa9a73e05 req-de968cf5-aebf-4c30-a6f9-879bd7f8cb70 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:51.383382 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d27386d5-4418-4823-80ad-308fa9a73e05 req-de968cf5-aebf-4c30-a6f9-879bd7f8cb70 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:51.383806 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d27386d5-4418-4823-80ad-308fa9a73e05 req-de968cf5-aebf-4c30-a6f9-879bd7f8cb70 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:51.396014 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d27386d5-4418-4823-80ad-308fa9a73e05 req-de968cf5-aebf-4c30-a6f9-879bd7f8cb70 service nova] Creating event network-vif-plugged:a29d5a98-22c4-428b-b315-67b3c4bfb00c for instance b80bd2aa-43f2-4818-be0e-1181ae9b1d18 on n-h2-849328-3 Aug 24 11:41:51.401032 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d27386d5-4418-4823-80ad-308fa9a73e05 req-de968cf5-aebf-4c30-a6f9-879bd7f8cb70 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033793 Aug 24 11:41:51.401671 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3636/7638] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:41:51.647234 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-47a1a92d-76d6-4beb-82f1-c4d5cd26d980 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:51.647870 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-47a1a92d-76d6-4beb-82f1-c4d5cd26d980 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: b80bd2aa-43f2-4818-be0e-1181ae9b1d18] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:51.655372 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47a1a92d-76d6-4beb-82f1-c4d5cd26d980 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:51.655897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47a1a92d-76d6-4beb-82f1-c4d5cd26d980 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:51.656356 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47a1a92d-76d6-4beb-82f1-c4d5cd26d980 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:51.657106 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47a1a92d-76d6-4beb-82f1-c4d5cd26d980 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:51.657623 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47a1a92d-76d6-4beb-82f1-c4d5cd26d980 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:51.658072 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47a1a92d-76d6-4beb-82f1-c4d5cd26d980 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:51.798128 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-47a1a92d-76d6-4beb-82f1-c4d5cd26d980 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:51.808811 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-47a1a92d-76d6-4beb-82f1-c4d5cd26d980 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18" status: 200 len: 1373 microversion: 2.1 time: 0.165124 Aug 24 11:41:51.809597 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 4003/7639] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:51 2022] GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:52.831314 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c487b7b0-f63c-4dab-b1e0-c4cf53131468 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:52.832017 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c487b7b0-f63c-4dab-b1e0-c4cf53131468 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: b80bd2aa-43f2-4818-be0e-1181ae9b1d18] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:52.838765 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c487b7b0-f63c-4dab-b1e0-c4cf53131468 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:52.839233 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c487b7b0-f63c-4dab-b1e0-c4cf53131468 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:52.839670 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c487b7b0-f63c-4dab-b1e0-c4cf53131468 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:52.840463 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c487b7b0-f63c-4dab-b1e0-c4cf53131468 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:52.840915 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c487b7b0-f63c-4dab-b1e0-c4cf53131468 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:52.841373 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c487b7b0-f63c-4dab-b1e0-c4cf53131468 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:52.977963 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c487b7b0-f63c-4dab-b1e0-c4cf53131468 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:52.986315 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c487b7b0-f63c-4dab-b1e0-c4cf53131468 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18" status: 200 len: 1557 microversion: 2.1 time: 0.160180 Aug 24 11:41:52.986894 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3637/7640] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:52 2022] GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:53.006899 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-46377465-a248-41bd-ad6a-a73413db7f6d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:53.007528 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-46377465-a248-41bd-ad6a-a73413db7f6d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: b80bd2aa-43f2-4818-be0e-1181ae9b1d18] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:53.015365 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46377465-a248-41bd-ad6a-a73413db7f6d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:53.015862 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46377465-a248-41bd-ad6a-a73413db7f6d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:53.016310 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46377465-a248-41bd-ad6a-a73413db7f6d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:53.017006 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46377465-a248-41bd-ad6a-a73413db7f6d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:53.017508 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46377465-a248-41bd-ad6a-a73413db7f6d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:53.017946 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46377465-a248-41bd-ad6a-a73413db7f6d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:53.152731 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-46377465-a248-41bd-ad6a-a73413db7f6d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:53.161024 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-46377465-a248-41bd-ad6a-a73413db7f6d tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18" status: 200 len: 1557 microversion: 2.1 time: 0.158261 Aug 24 11:41:53.161650 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 4004/7641] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:41:53 2022] GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:41:54.758127 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-7c704189-6608-42bc-9e0d-7f9260785d7e req-8510fdb8-41a4-414f-bd9f-c460eb3c10ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b80bd2aa-43f2-4818-be0e-1181ae9b1d18", "tag": "a29d5a98-22c4-428b-b315-67b3c4bfb00c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:41:54.768669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7c704189-6608-42bc-9e0d-7f9260785d7e req-8510fdb8-41a4-414f-bd9f-c460eb3c10ed service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:54.769158 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7c704189-6608-42bc-9e0d-7f9260785d7e req-8510fdb8-41a4-414f-bd9f-c460eb3c10ed service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:54.769587 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7c704189-6608-42bc-9e0d-7f9260785d7e req-8510fdb8-41a4-414f-bd9f-c460eb3c10ed service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:54.784148 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7c704189-6608-42bc-9e0d-7f9260785d7e req-8510fdb8-41a4-414f-bd9f-c460eb3c10ed service nova] Creating event network-changed:a29d5a98-22c4-428b-b315-67b3c4bfb00c for instance b80bd2aa-43f2-4818-be0e-1181ae9b1d18 on n-h2-849328-3 Aug 24 11:41:54.789681 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-7c704189-6608-42bc-9e0d-7f9260785d7e req-8510fdb8-41a4-414f-bd9f-c460eb3c10ed service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035148 Aug 24 11:41:54.790368 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3638/7642] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:43:03.913939 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:43:03.915083 n-d-849328-3 devstack@n-api.service[122432]: Wed Aug 24 11:43:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:43:23.111594 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:43:23.112260 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=58 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:43:23.117013 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-54f81109-9af3-4a56-979d-255a9000f36a tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-692072170"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:43:23.119432 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-54f81109-9af3-4a56-979d-255a9000f36a tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: b80bd2aa-43f2-4818-be0e-1181ae9b1d18] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:23.127719 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54f81109-9af3-4a56-979d-255a9000f36a tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:23.128220 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54f81109-9af3-4a56-979d-255a9000f36a tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:23.128670 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54f81109-9af3-4a56-979d-255a9000f36a tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:23.129412 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54f81109-9af3-4a56-979d-255a9000f36a tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:23.129877 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54f81109-9af3-4a56-979d-255a9000f36a tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:23.130315 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54f81109-9af3-4a56-979d-255a9000f36a tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:23.340562 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-54f81109-9af3-4a56-979d-255a9000f36a tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "POST /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18/action" status: 202 len: 0 microversion: 2.1 time: 0.231192 Aug 24 11:43:23.341240 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 4005/7643] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Aug 24 11:43:23 2022] POST /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 11:43:29.993458 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=26 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:43:29.994748 n-d-849328-3 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=48 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:43:29.999523 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c315e32e-a809-4c8b-83e1-c1ebac10ed7e req-54c24071-d40e-4256-be12-97f7ed25f8e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80bd2aa-43f2-4818-be0e-1181ae9b1d18", "name": "network-vif-plugged", "status": "completed", "tag": "a29d5a98-22c4-428b-b315-67b3c4bfb00c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:43:30.012365 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c315e32e-a809-4c8b-83e1-c1ebac10ed7e req-54c24071-d40e-4256-be12-97f7ed25f8e7 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:30.013012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c315e32e-a809-4c8b-83e1-c1ebac10ed7e req-54c24071-d40e-4256-be12-97f7ed25f8e7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:30.013509 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c315e32e-a809-4c8b-83e1-c1ebac10ed7e req-54c24071-d40e-4256-be12-97f7ed25f8e7 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:30.034805 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c315e32e-a809-4c8b-83e1-c1ebac10ed7e req-54c24071-d40e-4256-be12-97f7ed25f8e7 service nova] Creating event network-vif-plugged:a29d5a98-22c4-428b-b315-67b3c4bfb00c for instance b80bd2aa-43f2-4818-be0e-1181ae9b1d18 on n-h2-849328-3 Aug 24 11:43:30.041692 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c315e32e-a809-4c8b-83e1-c1ebac10ed7e req-54c24071-d40e-4256-be12-97f7ed25f8e7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050869 Aug 24 11:43:30.042662 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3639/7644] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:43:38.134320 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:43:38.135468 n-d-849328-3 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:43:38.138149 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-a2eba80c-d737-4306-930e-7ecd2aa44b70 req-1f847bb9-2687-43f1-9fcd-53f366168b64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b80bd2aa-43f2-4818-be0e-1181ae9b1d18", "tag": "a29d5a98-22c4-428b-b315-67b3c4bfb00c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:43:38.141897 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-891e1342-90af-47cb-a212-502d439f79d3 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:38.142513 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-891e1342-90af-47cb-a212-502d439f79d3 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: b80bd2aa-43f2-4818-be0e-1181ae9b1d18] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:38.149222 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a2eba80c-d737-4306-930e-7ecd2aa44b70 req-1f847bb9-2687-43f1-9fcd-53f366168b64 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:38.150246 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a2eba80c-d737-4306-930e-7ecd2aa44b70 req-1f847bb9-2687-43f1-9fcd-53f366168b64 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:38.150859 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a2eba80c-d737-4306-930e-7ecd2aa44b70 req-1f847bb9-2687-43f1-9fcd-53f366168b64 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:38.152449 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-891e1342-90af-47cb-a212-502d439f79d3 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:38.152963 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-891e1342-90af-47cb-a212-502d439f79d3 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:38.153442 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-891e1342-90af-47cb-a212-502d439f79d3 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:38.154172 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-891e1342-90af-47cb-a212-502d439f79d3 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:38.154817 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-891e1342-90af-47cb-a212-502d439f79d3 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:38.155262 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-891e1342-90af-47cb-a212-502d439f79d3 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:38.164570 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-a2eba80c-d737-4306-930e-7ecd2aa44b70 req-1f847bb9-2687-43f1-9fcd-53f366168b64 service nova] Creating event network-changed:a29d5a98-22c4-428b-b315-67b3c4bfb00c for instance b80bd2aa-43f2-4818-be0e-1181ae9b1d18 on n-h2-849328-3 Aug 24 11:43:38.169841 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-a2eba80c-d737-4306-930e-7ecd2aa44b70 req-1f847bb9-2687-43f1-9fcd-53f366168b64 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036406 Aug 24 11:43:38.170934 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3640/7645] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:43:38.188348 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-891e1342-90af-47cb-a212-502d439f79d3 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: b80bd2aa-43f2-4818-be0e-1181ae9b1d18] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:43:38.282326 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-891e1342-90af-47cb-a212-502d439f79d3 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18" status: 204 len: 0 microversion: 2.1 time: 0.150578 Aug 24 11:43:38.289225 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 4006/7646] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:43:38 2022] DELETE /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:43:38.292289 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9ffeced2-496c-46d4-86d5-7c952b3a740e tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:38.293033 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9ffeced2-496c-46d4-86d5-7c952b3a740e tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: b80bd2aa-43f2-4818-be0e-1181ae9b1d18] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:38.300284 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ffeced2-496c-46d4-86d5-7c952b3a740e tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:38.301083 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ffeced2-496c-46d4-86d5-7c952b3a740e tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:38.301228 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ffeced2-496c-46d4-86d5-7c952b3a740e tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:38.302035 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ffeced2-496c-46d4-86d5-7c952b3a740e tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:38.302495 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ffeced2-496c-46d4-86d5-7c952b3a740e tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:38.302922 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ffeced2-496c-46d4-86d5-7c952b3a740e tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:38.462761 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9ffeced2-496c-46d4-86d5-7c952b3a740e tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:38.470861 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9ffeced2-496c-46d4-86d5-7c952b3a740e tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18" status: 200 len: 1682 microversion: 2.1 time: 0.182967 Aug 24 11:43:38.471462 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3641/7647] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:38 2022] GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18 => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:43:39.492653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1f1754ce-4278-4314-9beb-1b846e1459df tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:39.493287 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1f1754ce-4278-4314-9beb-1b846e1459df tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: b80bd2aa-43f2-4818-be0e-1181ae9b1d18] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:39.501154 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f1754ce-4278-4314-9beb-1b846e1459df tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:39.501685 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f1754ce-4278-4314-9beb-1b846e1459df tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:39.502132 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f1754ce-4278-4314-9beb-1b846e1459df tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:39.502849 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f1754ce-4278-4314-9beb-1b846e1459df tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:39.503318 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f1754ce-4278-4314-9beb-1b846e1459df tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:39.503753 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f1754ce-4278-4314-9beb-1b846e1459df tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:39.652390 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1f1754ce-4278-4314-9beb-1b846e1459df tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:39.660624 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1f1754ce-4278-4314-9beb-1b846e1459df tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18" status: 200 len: 1682 microversion: 2.1 time: 0.172511 Aug 24 11:43:39.661285 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 4007/7648] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:39 2022] GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:43:39.838947 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-7a7a660e-e853-4056-a3ac-829131b52f6c req-513c15f9-a96d-42ad-a487-6352ec57e864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80bd2aa-43f2-4818-be0e-1181ae9b1d18", "name": "network-vif-unplugged", "status": "completed", "tag": "a29d5a98-22c4-428b-b315-67b3c4bfb00c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:43:39.851308 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7a7a660e-e853-4056-a3ac-829131b52f6c req-513c15f9-a96d-42ad-a487-6352ec57e864 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:39.852360 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7a7a660e-e853-4056-a3ac-829131b52f6c req-513c15f9-a96d-42ad-a487-6352ec57e864 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:39.853261 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7a7a660e-e853-4056-a3ac-829131b52f6c req-513c15f9-a96d-42ad-a487-6352ec57e864 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:39.866570 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7a7a660e-e853-4056-a3ac-829131b52f6c req-513c15f9-a96d-42ad-a487-6352ec57e864 service nova] Creating event network-vif-unplugged:a29d5a98-22c4-428b-b315-67b3c4bfb00c for instance b80bd2aa-43f2-4818-be0e-1181ae9b1d18 on n-h2-849328-3 Aug 24 11:43:39.872053 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-7a7a660e-e853-4056-a3ac-829131b52f6c req-513c15f9-a96d-42ad-a487-6352ec57e864 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040533 Aug 24 11:43:39.872819 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3642/7649] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:43:40.642330 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-d24f3800-de17-4511-bf57-925d86001ea2 req-e844ff7a-b464-4d55-8aa8-8f9fa1f60ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80bd2aa-43f2-4818-be0e-1181ae9b1d18", "name": "network-vif-deleted", "tag": "a29d5a98-22c4-428b-b315-67b3c4bfb00c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:43:40.652185 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d24f3800-de17-4511-bf57-925d86001ea2 req-e844ff7a-b464-4d55-8aa8-8f9fa1f60ba3 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:40.652684 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d24f3800-de17-4511-bf57-925d86001ea2 req-e844ff7a-b464-4d55-8aa8-8f9fa1f60ba3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:40.653162 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d24f3800-de17-4511-bf57-925d86001ea2 req-e844ff7a-b464-4d55-8aa8-8f9fa1f60ba3 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:40.665439 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-d24f3800-de17-4511-bf57-925d86001ea2 req-e844ff7a-b464-4d55-8aa8-8f9fa1f60ba3 service nova] Creating event network-vif-deleted:a29d5a98-22c4-428b-b315-67b3c4bfb00c for instance b80bd2aa-43f2-4818-be0e-1181ae9b1d18 on n-h2-849328-3 Aug 24 11:43:40.670382 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-d24f3800-de17-4511-bf57-925d86001ea2 req-e844ff7a-b464-4d55-8aa8-8f9fa1f60ba3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111169 Aug 24 11:43:40.671001 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 4008/7650] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:43:40.682935 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9e4a4706-c060-45a4-b497-ba8db945fdcb tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:40.683669 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9e4a4706-c060-45a4-b497-ba8db945fdcb tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: b80bd2aa-43f2-4818-be0e-1181ae9b1d18] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:40.690044 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e4a4706-c060-45a4-b497-ba8db945fdcb tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:40.690536 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e4a4706-c060-45a4-b497-ba8db945fdcb tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:40.690980 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e4a4706-c060-45a4-b497-ba8db945fdcb tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:40.691678 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e4a4706-c060-45a4-b497-ba8db945fdcb tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:40.692132 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e4a4706-c060-45a4-b497-ba8db945fdcb tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:40.692555 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e4a4706-c060-45a4-b497-ba8db945fdcb tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:40.730909 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e4a4706-c060-45a4-b497-ba8db945fdcb tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:40.731306 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e4a4706-c060-45a4-b497-ba8db945fdcb tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:40.731771 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e4a4706-c060-45a4-b497-ba8db945fdcb tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:40.732238 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-9e4a4706-c060-45a4-b497-ba8db945fdcb tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lazy-loading 'fault' on Instance uuid b80bd2aa-43f2-4818-be0e-1181ae9b1d18 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:43:40.780430 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9e4a4706-c060-45a4-b497-ba8db945fdcb tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:40.788594 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9e4a4706-c060-45a4-b497-ba8db945fdcb tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18" status: 200 len: 1338 microversion: 2.1 time: 0.110147 Aug 24 11:43:40.789511 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3643/7651] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:40 2022] GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18 => generated 1338 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:43:41.815893 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1fc97785-c87c-4aa9-a4dc-2ff413c01e03 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:41.816822 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1fc97785-c87c-4aa9-a4dc-2ff413c01e03 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: b80bd2aa-43f2-4818-be0e-1181ae9b1d18] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:41.824516 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fc97785-c87c-4aa9-a4dc-2ff413c01e03 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:41.825023 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fc97785-c87c-4aa9-a4dc-2ff413c01e03 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:41.825581 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fc97785-c87c-4aa9-a4dc-2ff413c01e03 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:41.826302 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fc97785-c87c-4aa9-a4dc-2ff413c01e03 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:41.826778 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fc97785-c87c-4aa9-a4dc-2ff413c01e03 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:41.827223 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fc97785-c87c-4aa9-a4dc-2ff413c01e03 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:41.841292 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-1fc97785-c87c-4aa9-a4dc-2ff413c01e03 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] HTTP exception thrown: Instance b80bd2aa-43f2-4818-be0e-1181ae9b1d18 could not be found. Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1fc97785-c87c-4aa9-a4dc-2ff413c01e03 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Request method failure captured: Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18 HTTP/1.1 Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBg3V9KpYNDaJKPqm0JRPdDgVzvnN6vvT6Crdo0J_RZDODy9BeIut8pWoyiOC2foRPhNdRBhUu-Sf1SmXb5ElpNYxfnTyjeW0Q6K2ZXuwUXlMI7EVSBXzw0K7uK5fkLKzv6VHFA_OMrBB4bAsuHxVdyPuYawqxHtsb-kqNd__hx0SFeg Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 5969f4d5cff84df484f1481db211273a Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestSnapshotPattern-1181058750 Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5969f4d5cff84df484f1481db211273a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_5969f4d5cff84df484f1481db211273a", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5969f4d5cff84df484f1481db211273a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/5969f4d5cff84df484f1481db211273a"}]}] Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestSnapshotPattern-1181058750 Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 5969f4d5cff84df484f1481db211273a Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestSnapshotPattern-1181058750 Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestSnapshotPattern-1181058750-project Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: dec7201b3e28417fb8ec6ef81c259e14 Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestSnapshotPattern-1181058750-project Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance b80bd2aa-43f2-4818-be0e-1181ae9b1d18 could not be found. Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'b80bd2aa-43f2-4818-be0e-1181ae9b1d18'} Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b80bd2aa-43f2-4818-be0e-1181ae9b1d18 could not be found. Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b80bd2aa-43f2-4818-be0e-1181ae9b1d18 could not be found. Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:43:41.842967 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:43:41.847675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:43:41.847675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:43:41.847675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:43:41.847675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:43:41.847675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:43:41.847675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b80bd2aa-43f2-4818-be0e-1181ae9b1d18 could not be found. Aug 24 11:43:41.847675 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:43:41.847675 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1fc97785-c87c-4aa9-a4dc-2ff413c01e03 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Returning 404 to user: Instance b80bd2aa-43f2-4818-be0e-1181ae9b1d18 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:43:41.847675 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1fc97785-c87c-4aa9-a4dc-2ff413c01e03 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18" status: 404 len: 111 microversion: 2.1 time: 0.037269 Aug 24 11:43:41.847675 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 4009/7652] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:41 2022] GET /compute/v2.1/servers/b80bd2aa-43f2-4818-be0e-1181ae9b1d18 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:43:43.298029 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-441ae451-d5c3-4004-ad76-aeeaf432bd3f tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:43.298551 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-441ae451-d5c3-4004-ad76-aeeaf432bd3f tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: d43cbcca-c1be-4ae4-94b6-52b7dc137b97] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:43.300517 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c66ebc47-b150-456a-84f3-fc6d74872ea7 req-dbff242e-ac86-43cd-a6da-ad38d4149f10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d43cbcca-c1be-4ae4-94b6-52b7dc137b97", "tag": "a370f90f-4003-4701-b095-6bed9f8919f6"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:43:43.305698 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-441ae451-d5c3-4004-ad76-aeeaf432bd3f tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:43.306186 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-441ae451-d5c3-4004-ad76-aeeaf432bd3f tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:43.306619 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-441ae451-d5c3-4004-ad76-aeeaf432bd3f tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:43.307313 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-441ae451-d5c3-4004-ad76-aeeaf432bd3f tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:43.308513 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-441ae451-d5c3-4004-ad76-aeeaf432bd3f tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:43.308945 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-441ae451-d5c3-4004-ad76-aeeaf432bd3f tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:43.313643 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c66ebc47-b150-456a-84f3-fc6d74872ea7 req-dbff242e-ac86-43cd-a6da-ad38d4149f10 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:43.314207 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c66ebc47-b150-456a-84f3-fc6d74872ea7 req-dbff242e-ac86-43cd-a6da-ad38d4149f10 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:43.314711 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c66ebc47-b150-456a-84f3-fc6d74872ea7 req-dbff242e-ac86-43cd-a6da-ad38d4149f10 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:43.326159 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c66ebc47-b150-456a-84f3-fc6d74872ea7 req-dbff242e-ac86-43cd-a6da-ad38d4149f10 service nova] Creating event network-changed:a370f90f-4003-4701-b095-6bed9f8919f6 for instance d43cbcca-c1be-4ae4-94b6-52b7dc137b97 on n-h1-849328-3 Aug 24 11:43:43.331789 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c66ebc47-b150-456a-84f3-fc6d74872ea7 req-dbff242e-ac86-43cd-a6da-ad38d4149f10 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035730 Aug 24 11:43:43.332697 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 4010/7653] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:43:43.338436 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-441ae451-d5c3-4004-ad76-aeeaf432bd3f tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: d43cbcca-c1be-4ae4-94b6-52b7dc137b97] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:43:43.425448 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-441ae451-d5c3-4004-ad76-aeeaf432bd3f tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97" status: 204 len: 0 microversion: 2.1 time: 0.131515 Aug 24 11:43:43.426180 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3644/7654] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Aug 24 11:43:43 2022] DELETE /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:43:43.437707 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e0c649d7-7ce6-4cd5-9830-463b5c8807dd tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:43.441333 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e0c649d7-7ce6-4cd5-9830-463b5c8807dd tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: d43cbcca-c1be-4ae4-94b6-52b7dc137b97] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:43.448123 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0c649d7-7ce6-4cd5-9830-463b5c8807dd tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:43.448627 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0c649d7-7ce6-4cd5-9830-463b5c8807dd tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:43.449072 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0c649d7-7ce6-4cd5-9830-463b5c8807dd tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:43.449925 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0c649d7-7ce6-4cd5-9830-463b5c8807dd tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:43.450775 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0c649d7-7ce6-4cd5-9830-463b5c8807dd tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:43.451213 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0c649d7-7ce6-4cd5-9830-463b5c8807dd tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:43.588950 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e0c649d7-7ce6-4cd5-9830-463b5c8807dd tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:43.597337 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e0c649d7-7ce6-4cd5-9830-463b5c8807dd tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97" status: 200 len: 1681 microversion: 2.1 time: 0.164873 Aug 24 11:43:43.598012 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 4011/7655] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:43 2022] GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:43:44.619475 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5198daa9-a72a-4135-ad4c-ab82a4e2e8bf tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:44.620181 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5198daa9-a72a-4135-ad4c-ab82a4e2e8bf tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: d43cbcca-c1be-4ae4-94b6-52b7dc137b97] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:44.627820 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5198daa9-a72a-4135-ad4c-ab82a4e2e8bf tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:44.628302 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5198daa9-a72a-4135-ad4c-ab82a4e2e8bf tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:44.628759 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5198daa9-a72a-4135-ad4c-ab82a4e2e8bf tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:44.629479 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5198daa9-a72a-4135-ad4c-ab82a4e2e8bf tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:44.629927 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5198daa9-a72a-4135-ad4c-ab82a4e2e8bf tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:44.630345 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5198daa9-a72a-4135-ad4c-ab82a4e2e8bf tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:44.781449 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5198daa9-a72a-4135-ad4c-ab82a4e2e8bf tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:44.789477 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5198daa9-a72a-4135-ad4c-ab82a4e2e8bf tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97" status: 200 len: 1681 microversion: 2.1 time: 0.174361 Aug 24 11:43:44.790071 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3645/7656] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:44 2022] GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97 => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:43:45.564929 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-d71a0112-0866-450d-b365-195ba877ac17 req-1d09351b-5ff4-4a29-8b3e-4317fd1a7bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d43cbcca-c1be-4ae4-94b6-52b7dc137b97", "name": "network-vif-deleted", "tag": "a370f90f-4003-4701-b095-6bed9f8919f6"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:43:45.576150 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d71a0112-0866-450d-b365-195ba877ac17 req-1d09351b-5ff4-4a29-8b3e-4317fd1a7bb5 service nova] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:45.576653 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d71a0112-0866-450d-b365-195ba877ac17 req-1d09351b-5ff4-4a29-8b3e-4317fd1a7bb5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:45.577102 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d71a0112-0866-450d-b365-195ba877ac17 req-1d09351b-5ff4-4a29-8b3e-4317fd1a7bb5 service nova] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:45.589418 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-d71a0112-0866-450d-b365-195ba877ac17 req-1d09351b-5ff4-4a29-8b3e-4317fd1a7bb5 service nova] Creating event network-vif-deleted:a370f90f-4003-4701-b095-6bed9f8919f6 for instance d43cbcca-c1be-4ae4-94b6-52b7dc137b97 on n-h1-849328-3 Aug 24 11:43:45.595438 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-d71a0112-0866-450d-b365-195ba877ac17 req-1d09351b-5ff4-4a29-8b3e-4317fd1a7bb5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034064 Aug 24 11:43:45.596068 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 4012/7657] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Aug 24 11:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:43:45.812088 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e392c146-2af7-4dab-bc1e-88cc52e2a004 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:45.812709 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e392c146-2af7-4dab-bc1e-88cc52e2a004 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: d43cbcca-c1be-4ae4-94b6-52b7dc137b97] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:45.820599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e392c146-2af7-4dab-bc1e-88cc52e2a004 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:45.821541 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e392c146-2af7-4dab-bc1e-88cc52e2a004 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:45.821687 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e392c146-2af7-4dab-bc1e-88cc52e2a004 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:45.822385 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e392c146-2af7-4dab-bc1e-88cc52e2a004 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:45.822829 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e392c146-2af7-4dab-bc1e-88cc52e2a004 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:45.823599 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e392c146-2af7-4dab-bc1e-88cc52e2a004 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:45.866581 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e392c146-2af7-4dab-bc1e-88cc52e2a004 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:45.867115 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e392c146-2af7-4dab-bc1e-88cc52e2a004 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:45.867553 n-d-849328-3 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e392c146-2af7-4dab-bc1e-88cc52e2a004 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:45.868012 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-e392c146-2af7-4dab-bc1e-88cc52e2a004 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lazy-loading 'fault' on Instance uuid d43cbcca-c1be-4ae4-94b6-52b7dc137b97 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:43:45.913095 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e392c146-2af7-4dab-bc1e-88cc52e2a004 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec7201b3e28417fb8ec6ef81c259e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969f4d5cff84df484f1481db211273a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:43:45.922451 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e392c146-2af7-4dab-bc1e-88cc52e2a004 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97" status: 200 len: 1337 microversion: 2.1 time: 0.114189 Aug 24 11:43:45.923041 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3646/7658] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:45 2022] GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97 => generated 1337 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:43:46.946797 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-57c4bcf2-c9e8-4cfe-9ff8-218d6bf4ef4c tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:46.947472 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-57c4bcf2-c9e8-4cfe-9ff8-218d6bf4ef4c tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] [instance: d43cbcca-c1be-4ae4-94b6-52b7dc137b97] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:43:46.954456 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57c4bcf2-c9e8-4cfe-9ff8-218d6bf4ef4c tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:46.954959 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57c4bcf2-c9e8-4cfe-9ff8-218d6bf4ef4c tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:46.955409 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57c4bcf2-c9e8-4cfe-9ff8-218d6bf4ef4c tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:46.956120 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57c4bcf2-c9e8-4cfe-9ff8-218d6bf4ef4c tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Acquiring lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:43:46.956592 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57c4bcf2-c9e8-4cfe-9ff8-218d6bf4ef4c tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:43:46.957031 n-d-849328-3 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57c4bcf2-c9e8-4cfe-9ff8-218d6bf4ef4c tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Lock "e852a9c4-5bbb-4a78-aec0-794708e7e59e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:43:46.972281 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-57c4bcf2-c9e8-4cfe-9ff8-218d6bf4ef4c tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] HTTP exception thrown: Instance d43cbcca-c1be-4ae4-94b6-52b7dc137b97 could not be found. Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-57c4bcf2-c9e8-4cfe-9ff8-218d6bf4ef4c tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Request method failure captured: Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97 HTTP/1.1 Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: Accept: application/json Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: Accept-Encoding: identity Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: Connection: close Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: Content-Length: 0 Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: Content-Type: application/json Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: Host: 10.222.0.85 Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: Openstack-System-Scope: None Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.11 Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjBg3V9KpYNDaJKPqm0JRPdDgVzvnN6vvT6Crdo0J_RZDODy9BeIut8pWoyiOC2foRPhNdRBhUu-Sf1SmXb5ElpNYxfnTyjeW0Q6K2ZXuwUXlMI7EVSBXzw0K7uK5fkLKzv6VHFA_OMrBB4bAsuHxVdyPuYawqxHtsb-kqNd__hx0SFeg Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Id: None Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: X-Domain-Name: None Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: X-Is-Admin-Project: True Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Id: default Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Id: 5969f4d5cff84df484f1481db211273a Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: X-Project-Name: tempest-TestSnapshotPattern-1181058750 Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: X-Role: reader,member Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: X-Roles: reader,member Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5969f4d5cff84df484f1481db211273a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_5969f4d5cff84df484f1481db211273a", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5969f4d5cff84df484f1481db211273a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/5969f4d5cff84df484f1481db211273a"}]}] Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant: tempest-TestSnapshotPattern-1181058750 Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Id: 5969f4d5cff84df484f1481db211273a Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestSnapshotPattern-1181058750 Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: X-User: tempest-TestSnapshotPattern-1181058750-project Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Id: default Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: X-User-Domain-Name: Default Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: X-User-Id: dec7201b3e28417fb8ec6ef81c259e14 Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: X-User-Name: tempest-TestSnapshotPattern-1181058750-project Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: method: > Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: exception: Instance d43cbcca-c1be-4ae4-94b6-52b7dc137b97 could not be found. Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: action_args: {'id': 'd43cbcca-c1be-4ae4-94b6-52b7dc137b97'} Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d43cbcca-c1be-4ae4-94b6-52b7dc137b97 could not be found. Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d43cbcca-c1be-4ae4-94b6-52b7dc137b97 could not be found. Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:43:46.974075 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:43:46.979866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:43:46.979866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:43:46.979866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:43:46.979866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:43:46.979866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:43:46.979866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d43cbcca-c1be-4ae4-94b6-52b7dc137b97 could not be found. Aug 24 11:43:46.979866 n-d-849328-3 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Aug 24 11:43:46.979866 n-d-849328-3 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-57c4bcf2-c9e8-4cfe-9ff8-218d6bf4ef4c tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Returning 404 to user: Instance d43cbcca-c1be-4ae4-94b6-52b7dc137b97 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:43:46.979866 n-d-849328-3 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-57c4bcf2-c9e8-4cfe-9ff8-218d6bf4ef4c tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97" status: 404 len: 111 microversion: 2.1 time: 0.034288 Aug 24 11:43:46.979866 n-d-849328-3 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 4013/7659] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Aug 24 11:43:46 2022] GET /compute/v2.1/servers/d43cbcca-c1be-4ae4-94b6-52b7dc137b97 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:43:47.157288 n-d-849328-3 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-33ecc1dd-7cfe-45c4-8717-4954771c15b0 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] Calling method '.version_select at 0x7f4647ca9280>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:43:47.187021 n-d-849328-3 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-33ecc1dd-7cfe-45c4-8717-4954771c15b0 tempest-TestSnapshotPattern-1181058750 tempest-TestSnapshotPattern-1181058750-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1258200118" status: 202 len: 0 microversion: 2.1 time: 0.033610 Aug 24 11:43:47.187710 n-d-849328-3 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3647/7660] 10.222.0.85 () {58 vars in 1257 bytes} [Wed Aug 24 11:43:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1258200118 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:44:17.393166 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:44:17.394170 n-d-849328-3 devstack@n-api.service[122433]: Wed Aug 24 11:44:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:44:17.445999 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:44:17.446296 n-d-849328-3 devstack@n-api.service[122433]: Wed Aug 24 11:44:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:46:13.504342 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:46:13.504342 n-d-849328-3 devstack@n-api.service[122432]: Wed Aug 24 11:46:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:46:23.928732 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:46:23.929585 n-d-849328-3 devstack@n-api.service[122432]: Wed Aug 24 11:46:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:46:27.391968 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:46:27.392605 n-d-849328-3 devstack@n-api.service[122433]: Wed Aug 24 11:46:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:46:40.410005 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:46:40.410678 n-d-849328-3 devstack@n-api.service[122432]: Wed Aug 24 11:46:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:47:37.406661 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:47:37.407348 n-d-849328-3 devstack@n-api.service[122433]: Wed Aug 24 11:47:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:47:37.458813 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:47:37.459032 n-d-849328-3 devstack@n-api.service[122433]: Wed Aug 24 11:47:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:49:33.512706 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:49:33.513244 n-d-849328-3 devstack@n-api.service[122432]: Wed Aug 24 11:49:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:49:43.938079 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:49:43.938846 n-d-849328-3 devstack@n-api.service[122432]: Wed Aug 24 11:49:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:49:47.400707 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:49:47.401356 n-d-849328-3 devstack@n-api.service[122433]: Wed Aug 24 11:49:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:50:00.419490 n-d-849328-3 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:50:00.420172 n-d-849328-3 devstack@n-api.service[122432]: Wed Aug 24 11:50:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:50:57.416017 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:50:57.416803 n-d-849328-3 devstack@n-api.service[122433]: Wed Aug 24 11:50:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:50:57.466769 n-d-849328-3 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:50:57.466989 n-d-849328-3 devstack@n-api.service[122433]: Wed Aug 24 11:50:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!